2023-10-18T20:10:36.338 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-18T20:10:36.339 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429231 --owner scheduled_vshankar@teuthology --name vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi --verbose --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429231/orig.config.yaml 2023-10-18T20:10:36.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T20:10:36.492 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429231 branch: wip-vshankar-testing-pacific-20231016.091648 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} email: vshankar@redhat.com first_in_suite: false job_id: '7429231' kernel: flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific v16.2.4 ' name: vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-pacific-20231016.091648 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-pacific-20231016.091648 sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 7825 sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 sleep_before_teardown: 0 subset: 33/1024 suite: fs suite_branch: wip-vshankar-testing-pacific-20231016.091648 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLISEH1qpmZnKQL9Asy8o34ndM34GzbhBEqhFdDaWiBBRInlNj9KJ85y2stzn3Gj86zncPbMDqISIIIFhmJ8JcI= smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/PXpM34Ft5I8O2+qShLq+i2BWnOFRBcVAXwKgSgxY7P8FF2xiuDMKXtctKJ4PBBU7WCX6kwcBinLdgSdLLxfY= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - pexec: clients: - sudo modprobe -r ceph - sudo modprobe ceph disable_send_metrics=on - install: exclude_packages: - ceph-volume tag: v16.2.4 - print: '**** done install task...' - cephadm: avoid_pacific_features: true cephadm_branch: v16.2.4 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v16.2.4 roleless: true - print: '**** done starting v16.2.4' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_12:48:28 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-10-18T20:10:36.492 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa; will attempt to use it 2023-10-18T20:10:36.494 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks 2023-10-18T20:10:36.494 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-18T20:10:36.497 INFO:teuthology.task.internal:Checking packages... 2023-10-18T20:10:36.555 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5' 2023-10-18T20:10:36.556 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T20:10:36.557 INFO:teuthology.packaging:ref: None 2023-10-18T20:10:36.557 INFO:teuthology.packaging:tag: None 2023-10-18T20:10:36.557 INFO:teuthology.packaging:branch: wip-vshankar-testing-pacific-20231016.091648 2023-10-18T20:10:36.558 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:10:36.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-pacific-20231016.091648 2023-10-18T20:10:36.710 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-100.gb4ddd52c 2023-10-18T20:10:36.710 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-18T20:10:36.717 INFO:teuthology.task.internal:no buildpackages task found 2023-10-18T20:10:36.717 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-18T20:10:36.729 INFO:teuthology.task.internal:Saving configuration 2023-10-18T20:10:36.748 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-18T20:10:36.759 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T20:10:36.784 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429231', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 20:05:36.516086', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLISEH1qpmZnKQL9Asy8o34ndM34GzbhBEqhFdDaWiBBRInlNj9KJ85y2stzn3Gj86zncPbMDqISIIIFhmJ8JcI='} 2023-10-18T20:10:36.805 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429231', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 20:05:36.514684', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/PXpM34Ft5I8O2+qShLq+i2BWnOFRBcVAXwKgSgxY7P8FF2xiuDMKXtctKJ4PBBU7WCX6kwcBinLdgSdLLxfY='} 2023-10-18T20:10:36.805 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-18T20:10:36.815 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-10-18T20:10:36.815 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-10-18T20:10:36.816 INFO:teuthology.run_tasks:Running task console_log... 2023-10-18T20:10:36.896 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd37f8f4a60>, signals=[15]) 2023-10-18T20:10:36.898 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-18T20:10:36.904 INFO:teuthology.task.internal:Opening connections... 2023-10-18T20:10:36.905 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:10:36.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T20:10:36.976 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2023-10-18T20:10:36.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T20:10:37.047 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-18T20:10:37.056 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-10-18T20:10:37.080 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-10-18T20:10:37.081 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-18T20:10:37.142 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-10-18T20:10:37.142 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-10-18T20:10:37.142 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-10-18T20:10:37.143 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-10-18T20:10:37.143 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-10-18T20:10:37.143 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-10-18T20:10:37.143 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T20:10:37.143 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-18T20:10:37.144 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T20:10:37.144 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-10-18T20:10:37.144 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T20:10:37.144 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T20:10:37.145 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T20:10:37.145 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-18T20:10:37.171 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-10-18T20:10:37.195 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-10-18T20:10:37.195 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-10-18T20:10:37.257 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2023-10-18T20:10:37.257 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8" 2023-10-18T20:10:37.257 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2023-10-18T20:10:37.257 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2023-10-18T20:10:37.258 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8" 2023-10-18T20:10:37.258 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-10-18T20:10:37.258 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T20:10:37.258 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-10-18T20:10:37.258 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T20:10:37.259 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2023-10-18T20:10:37.259 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T20:10:37.259 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T20:10:37.259 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T20:10:37.260 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-10-18T20:10:37.278 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-18T20:10:37.288 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-18T20:10:37.296 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-18T20:10:37.297 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-10-18T20:10:37.300 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2023-10-18T20:10:37.321 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-18T20:10:37.331 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-18T20:10:37.331 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-10-18T20:10:37.362 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2023-10-18T20:10:37.393 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-18T20:10:37.449 INFO:teuthology.run_tasks:Running task kernel... 2023-10-18T20:10:37.465 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-18T20:10:37.465 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, timeout 300 2023-10-18T20:10:37.466 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T20:10:37.467 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T20:10:37.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T20:10:37.488 DEBUG:teuthology.task.kernel:sha1 for host.a is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T20:10:37.488 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-18T20:10:37.488 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-18T20:10:37.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T20:10:37.490 DEBUG:teuthology.task.kernel:sha1 for host.b is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T20:10:37.490 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-18T20:10:37.490 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2023-10-18T20:10:37.550 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-489.el8.x86_64 2023-10-18T20:10:37.550 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T20:10:37.551 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-18T20:10:37.551 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T20:10:37.555 INFO:teuthology.orchestra.run.smithi060.stdout:4.18.0-489.el8.x86_64 2023-10-18T20:10:37.555 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T20:10:37.555 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-18T20:10:37.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T20:10:37.691 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum upgrade -y linux-firmware 2023-10-18T20:10:37.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum upgrade -y linux-firmware 2023-10-18T20:10:42.973 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - AppStream 12 MB/s | 33 MB 00:02 2023-10-18T20:10:43.211 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - AppStream 11 MB/s | 33 MB 00:02 2023-10-18T20:10:53.765 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 50 MB 00:04 2023-10-18T20:10:54.069 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 50 MB 00:04 2023-10-18T20:11:01.632 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - Extras 84 kB/s | 18 kB 00:00 2023-10-18T20:11:02.086 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2023-10-18T20:11:03.003 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - Extras common packages 9.6 kB/s | 6.9 kB 00:00 2023-10-18T20:11:03.136 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - Extras common packages 5.3 kB/s | 6.9 kB 00:01 2023-10-18T20:11:03.321 INFO:teuthology.orchestra.run.smithi060.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-18T20:11:03.450 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-18T20:11:04.921 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-18T20:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 4.0 MB/s | 16 MB 00:03 2023-10-18T20:11:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 436 kB/s | 24 kB 00:00 2023-10-18T20:11:11.438 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 460 kB/s | 24 kB 00:00 2023-10-18T20:11:13.074 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:11:13.075 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:11:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-18T20:11:13.075 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:11:13.075 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-10-18T20:11:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-10-18T20:11:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:11:13.076 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:11:13.076 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:11:13.076 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 1 Package 2023-10-18T20:11:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:11:13.077 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 286 M 2023-10-18T20:11:13.077 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:11:15.550 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:11:15.551 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:11:15.551 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2023-10-18T20:11:15.551 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:11:15.551 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2023-10-18T20:11:15.551 INFO:teuthology.orchestra.run.smithi060.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-10-18T20:11:15.552 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:11:15.552 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:11:15.552 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:11:15.552 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 1 Package 2023-10-18T20:11:15.552 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:11:15.553 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 286 M 2023-10-18T20:11:15.553 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:11:34.377 INFO:teuthology.orchestra.run.smithi060.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 15 MB/s | 286 MB 00:18 2023-10-18T20:11:34.378 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:11:34.378 INFO:teuthology.orchestra.run.smithi060.stdout:Total 15 MB/s | 286 MB 00:18 2023-10-18T20:11:35.519 INFO:teuthology.orchestra.run.smithi008.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 13 MB/s | 286 MB 00:22 2023-10-18T20:11:35.520 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:11:35.520 INFO:teuthology.orchestra.run.smithi008.stdout:Total 13 MB/s | 286 MB 00:22 2023-10-18T20:11:36.173 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:11:36.260 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:11:36.261 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:11:37.307 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:11:37.377 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:11:37.378 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:11:38.126 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:11:38.154 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:11:39.260 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:11:39.288 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:11:58.269 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:11:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-18T20:11:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T20:11:59.133 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T20:11:59.133 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-18T20:11:59.343 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:11:59.727 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-18T20:11:59.928 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T20:11:59.928 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:11:59.928 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2023-10-18T20:11:59.929 INFO:teuthology.orchestra.run.smithi060.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-10-18T20:11:59.929 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:11:59.929 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:11:59.979 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T20:12:00.107 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on host.b... 2023-10-18T20:12:00.107 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T20:12:00.228 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T20:12:00.228 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-18T20:12:00.323 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ 2023-10-18T20:12:00.324 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-18T20:12:00.326 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi060.front.sepia.ceph.com to complete... 2023-10-18T20:12:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T20:12:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:12:01.052 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-10-18T20:12:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-10-18T20:12:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:12:01.053 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:12:01.241 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on host.a... 2023-10-18T20:12:01.242 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T20:12:01.492 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ 2023-10-18T20:12:01.493 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-18T20:12:01.495 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi008.front.sepia.ceph.com to complete... 2023-10-18T20:12:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18 20:12:15 URL:https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [383161052/383161052] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-18T20:12:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:FINISHED --2023-10-18 20:12:15-- 2023-10-18T20:12:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:Total wall clock time: 15s 2023-10-18T20:12:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:Downloaded: 1 files, 365M in 15s (25.0 MB/s) 2023-10-18T20:12:15.443 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on host.b... 2023-10-18T20:12:15.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-18T20:12:17.272 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying... ######################################## 2023-10-18T20:12:17.318 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing... ######################################## 2023-10-18T20:12:17.434 INFO:teuthology.orchestra.run.smithi060.stdout:Updating / installing... 2023-10-18T20:12:48.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18 20:12:48 URL:https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [383161052/383161052] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-18T20:12:48.637 INFO:teuthology.orchestra.run.smithi008.stderr:FINISHED --2023-10-18 20:12:48-- 2023-10-18T20:12:48.637 INFO:teuthology.orchestra.run.smithi008.stderr:Total wall clock time: 47s 2023-10-18T20:12:48.638 INFO:teuthology.orchestra.run.smithi008.stderr:Downloaded: 1 files, 365M in 47s (7.82 MB/s) 2023-10-18T20:12:48.639 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on host.a... 2023-10-18T20:12:48.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-18T20:12:50.387 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying... ######################################## 2023-10-18T20:12:50.433 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing... ######################################## 2023-10-18T20:12:50.549 INFO:teuthology.orchestra.run.smithi008.stdout:Updating / installing... 2023-10-18T20:12:58.137 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-18T20:13:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-18T20:13:20.605 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-18T20:13:20.606 DEBUG:teuthology.orchestra.run.smithi060:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-18T20:13:20.661 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T20:13:20.662 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-18T20:13:20.662 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T20:13:20.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-18T20:13:20.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-18T20:13:20.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-18T20:13:20.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-18T20:13:20.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-18T20:13:20.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-18T20:13:20.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-18T20:13:20.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-18T20:13:20.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-18T20:13:20.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-18T20:13:20.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-18T20:13:20.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-18T20:13:20.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-18T20:13:20.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-18T20:13:20.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-18T20:13:20.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-18T20:13:20.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-18T20:13:20.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-18T20:13:20.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-18T20:13:20.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-18T20:13:20.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-18T20:13:20.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-18T20:13:20.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-18T20:13:20.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-18T20:13:20.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-18T20:13:20.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-18T20:13:20.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-18T20:13:20.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-18T20:13:20.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-18T20:13:20.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-18T20:13:20.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-18T20:13:20.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-18T20:13:20.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-18T20:13:20.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-18T20:13:20.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-18T20:13:20.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-18T20:13:20.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-18T20:13:20.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-18T20:13:20.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-18T20:13:20.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-18T20:13:20.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-18T20:13:20.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-18T20:13:20.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-18T20:13:20.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-18T20:13:20.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-18T20:13:20.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-18T20:13:20.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-18T20:13:20.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-18T20:13:20.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-18T20:13:20.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-18T20:13:20.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-18T20:13:20.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-18T20:13:20.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-18T20:13:20.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-18T20:13:20.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-18T20:13:20.673 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-18T20:13:20.673 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-18T20:13:20.673 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-18T20:13:20.673 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-18T20:13:20.673 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-18T20:13:20.673 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-18T20:13:20.674 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-18T20:13:20.674 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-18T20:13:20.674 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-18T20:13:20.674 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-18T20:13:20.674 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-18T20:13:20.675 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-18T20:13:20.675 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-18T20:13:20.675 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-18T20:13:20.675 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-18T20:13:20.675 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-18T20:13:20.675 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-18T20:13:20.676 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-18T20:13:20.676 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-18T20:13:20.676 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-18T20:13:20.676 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-18T20:13:20.676 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-18T20:13:20.676 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-18T20:13:20.677 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-18T20:13:20.677 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-18T20:13:20.677 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-18T20:13:20.677 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-18T20:13:20.677 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-18T20:13:20.678 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-18T20:13:20.678 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-18T20:13:20.678 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-18T20:13:20.678 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-18T20:13:20.678 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-18T20:13:20.679 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-18T20:13:20.679 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-18T20:13:20.679 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-18T20:13:20.679 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-18T20:13:20.679 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-18T20:13:20.679 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-18T20:13:20.680 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-18T20:13:20.680 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-18T20:13:20.680 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-18T20:13:20.680 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-18T20:13:20.680 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-18T20:13:20.681 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-18T20:13:20.681 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-18T20:13:20.681 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-18T20:13:20.681 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-18T20:13:20.681 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-18T20:13:20.682 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-18T20:13:20.682 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-18T20:13:20.682 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-18T20:13:20.682 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-18T20:13:20.682 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-18T20:13:20.683 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-18T20:13:20.683 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-18T20:13:20.683 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-18T20:13:20.683 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-18T20:13:20.683 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-18T20:13:20.683 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-18T20:13:20.684 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-18T20:13:20.684 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-18T20:13:20.684 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-18T20:13:20.684 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-18T20:13:20.684 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-18T20:13:20.685 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-18T20:13:20.685 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-18T20:13:20.685 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-18T20:13:20.685 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-18T20:13:20.685 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-18T20:13:20.686 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-18T20:13:20.686 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-18T20:13:20.686 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-18T20:13:20.686 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-18T20:13:20.686 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-18T20:13:20.687 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-18T20:13:20.687 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-18T20:13:20.687 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-18T20:13:20.687 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-18T20:13:20.687 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-18T20:13:20.687 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-18T20:13:20.688 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-18T20:13:20.688 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-18T20:13:20.688 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-18T20:13:20.688 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-18T20:13:20.688 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-18T20:13:20.689 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-18T20:13:20.689 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-18T20:13:20.689 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-18T20:13:20.689 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-18T20:13:20.689 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-18T20:13:20.689 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-18T20:13:20.690 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-18T20:13:20.690 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-18T20:13:20.690 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-18T20:13:20.690 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-18T20:13:20.690 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-18T20:13:20.691 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-18T20:13:20.691 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-18T20:13:20.691 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-18T20:13:20.691 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-18T20:13:20.691 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-18T20:13:20.692 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-18T20:13:20.692 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-18T20:13:20.692 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-18T20:13:20.692 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-18T20:13:20.692 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-18T20:13:20.693 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-18T20:13:20.693 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-18T20:13:20.693 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-18T20:13:20.693 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-18T20:13:20.693 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-18T20:13:20.693 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-18T20:13:20.694 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-18T20:13:20.694 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-18T20:13:20.694 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-18T20:13:20.694 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-18T20:13:20.694 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-18T20:13:20.695 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-18T20:13:20.695 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-18T20:13:20.695 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-18T20:13:20.695 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-18T20:13:20.695 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-18T20:13:20.696 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-18T20:13:20.696 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-18T20:13:20.696 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-18T20:13:20.696 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-18T20:13:20.696 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-18T20:13:20.696 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-18T20:13:20.697 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-18T20:13:20.697 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-18T20:13:20.697 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-18T20:13:20.697 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-18T20:13:20.697 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-18T20:13:20.698 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-18T20:13:20.698 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-18T20:13:20.698 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-18T20:13:20.698 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-18T20:13:20.698 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-18T20:13:20.698 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-18T20:13:20.699 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-18T20:13:20.699 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-18T20:13:20.699 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-18T20:13:20.699 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-18T20:13:20.699 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-18T20:13:20.700 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-18T20:13:20.700 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-18T20:13:20.700 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-18T20:13:20.700 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-18T20:13:20.700 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-18T20:13:20.700 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-18T20:13:20.701 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-18T20:13:20.701 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-18T20:13:20.701 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-18T20:13:20.701 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-18T20:13:20.701 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-18T20:13:20.702 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-18T20:13:20.702 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-18T20:13:20.702 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-18T20:13:20.702 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-18T20:13:20.702 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-18T20:13:20.703 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-18T20:13:20.703 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-18T20:13:20.703 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-18T20:13:20.703 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-18T20:13:20.703 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-18T20:13:20.704 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-18T20:13:20.704 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-18T20:13:20.704 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-18T20:13:20.704 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-18T20:13:20.704 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-18T20:13:20.704 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-18T20:13:20.705 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-18T20:13:20.705 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-18T20:13:20.705 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-18T20:13:20.705 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-18T20:13:20.705 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-18T20:13:20.706 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-18T20:13:20.706 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-18T20:13:20.706 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-18T20:13:20.706 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-18T20:13:20.706 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-18T20:13:20.707 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-18T20:13:20.707 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-18T20:13:20.707 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-18T20:13:20.707 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-18T20:13:20.707 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-18T20:13:20.708 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-18T20:13:20.708 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-18T20:13:20.708 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-18T20:13:20.708 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-18T20:13:20.708 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-18T20:13:20.708 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-18T20:13:20.709 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-18T20:13:20.709 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-18T20:13:20.709 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-18T20:13:20.709 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-18T20:13:20.709 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-18T20:13:20.710 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-18T20:13:20.710 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-18T20:13:20.710 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-18T20:13:20.710 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-18T20:13:20.710 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-18T20:13:20.711 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-18T20:13:20.711 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-18T20:13:20.711 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-18T20:13:20.711 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-18T20:13:20.711 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-18T20:13:20.711 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-18T20:13:20.712 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-18T20:13:20.712 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-18T20:13:20.712 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-18T20:13:20.712 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-18T20:13:20.712 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-18T20:13:20.713 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-18T20:13:20.713 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-18T20:13:20.713 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-18T20:13:20.713 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-18T20:13:20.713 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-18T20:13:20.714 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-18T20:13:20.714 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-18T20:13:20.714 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-18T20:13:20.714 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-18T20:13:20.714 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-18T20:13:20.714 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-18T20:13:20.715 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-18T20:13:20.715 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-18T20:13:20.715 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-18T20:13:20.715 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-18T20:13:20.715 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-18T20:13:20.716 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-18T20:13:20.716 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-18T20:13:20.716 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-18T20:13:20.716 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-18T20:13:20.716 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-18T20:13:20.717 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-18T20:13:20.717 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-18T20:13:20.717 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-18T20:13:20.717 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-18T20:13:20.717 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-18T20:13:20.717 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-18T20:13:20.718 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-18T20:13:20.718 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-18T20:13:20.718 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-18T20:13:20.718 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-18T20:13:20.718 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-18T20:13:20.719 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-18T20:13:20.719 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-18T20:13:20.719 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-18T20:13:20.719 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-18T20:13:20.719 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-18T20:13:20.720 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-18T20:13:20.720 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-18T20:13:20.720 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-18T20:13:20.720 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-18T20:13:20.720 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-18T20:13:20.720 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-18T20:13:20.721 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-18T20:13:20.721 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-18T20:13:20.721 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-18T20:13:20.721 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-18T20:13:20.721 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-18T20:13:20.722 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-18T20:13:20.722 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-18T20:13:20.722 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-18T20:13:20.722 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-18T20:13:20.722 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-18T20:13:20.723 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-18T20:13:20.723 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-18T20:13:20.723 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-18T20:13:20.723 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-18T20:13:20.723 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-18T20:13:20.724 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-18T20:13:20.724 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-18T20:13:20.724 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-18T20:13:20.724 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-18T20:13:20.724 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-18T20:13:20.724 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-18T20:13:20.725 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-18T20:13:20.725 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-18T20:13:20.725 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-18T20:13:20.725 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-18T20:13:20.725 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-18T20:13:20.726 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-18T20:13:20.726 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-18T20:13:20.726 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-18T20:13:20.726 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-18T20:13:20.726 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-18T20:13:20.727 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-18T20:13:20.727 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-18T20:13:20.727 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-18T20:13:20.727 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-18T20:13:20.727 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-18T20:13:20.728 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-18T20:13:20.728 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-18T20:13:20.728 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-18T20:13:20.728 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-18T20:13:20.728 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-18T20:13:20.729 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-18T20:13:20.729 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-18T20:13:20.729 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-18T20:13:20.729 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-18T20:13:20.729 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-18T20:13:20.729 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-18T20:13:20.730 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-18T20:13:20.730 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-18T20:13:20.730 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-18T20:13:20.730 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-18T20:13:20.730 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-18T20:13:20.731 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-18T20:13:20.731 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-18T20:13:20.731 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-18T20:13:20.731 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-18T20:13:20.731 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-18T20:13:20.731 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-18T20:13:20.732 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-18T20:13:20.732 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-18T20:13:20.732 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-18T20:13:20.732 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-18T20:13:20.732 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-18T20:13:20.733 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-18T20:13:20.733 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-18T20:13:20.733 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-18T20:13:20.733 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-18T20:13:20.733 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-18T20:13:20.734 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-18T20:13:20.734 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-18T20:13:20.734 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-18T20:13:20.734 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-18T20:13:20.734 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-18T20:13:20.734 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-18T20:13:20.735 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-18T20:13:20.735 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-18T20:13:20.735 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-18T20:13:20.735 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-18T20:13:20.735 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-18T20:13:20.736 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-18T20:13:20.736 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-18T20:13:20.736 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-18T20:13:20.736 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-18T20:13:20.736 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-18T20:13:20.737 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-18T20:13:20.737 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-18T20:13:20.737 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-18T20:13:20.737 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-18T20:13:20.737 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-18T20:13:20.737 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-18T20:13:20.738 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-18T20:13:20.738 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-18T20:13:20.738 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-18T20:13:20.738 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-18T20:13:20.738 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-18T20:13:20.739 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-18T20:13:20.739 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-18T20:13:20.739 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-18T20:13:20.739 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-18T20:13:20.739 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-18T20:13:20.740 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-18T20:13:20.740 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-18T20:13:20.740 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-18T20:13:20.740 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-18T20:13:20.740 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-18T20:13:20.740 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-18T20:13:20.741 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-18T20:13:20.741 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-18T20:13:20.741 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-18T20:13:20.741 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-18T20:13:20.741 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-18T20:13:20.742 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-18T20:13:20.742 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-18T20:13:20.742 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-18T20:13:20.742 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-18T20:13:20.742 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-18T20:13:20.742 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-18T20:13:20.743 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-18T20:13:20.743 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-18T20:13:20.743 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-18T20:13:20.743 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-18T20:13:20.743 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-18T20:13:20.744 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-18T20:13:20.744 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-18T20:13:20.744 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-18T20:13:20.744 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-18T20:13:20.744 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-18T20:13:20.745 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-18T20:13:20.745 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-18T20:13:20.745 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-18T20:13:20.745 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-18T20:13:20.745 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-18T20:13:20.745 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-18T20:13:20.746 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-18T20:13:20.746 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-18T20:13:20.746 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-18T20:13:20.746 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-18T20:13:20.746 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-18T20:13:20.747 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-18T20:13:20.747 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-18T20:13:20.747 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-18T20:13:20.747 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-18T20:13:20.747 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-18T20:13:20.747 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-18T20:13:20.748 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-18T20:13:20.748 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-18T20:13:20.748 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-18T20:13:20.748 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-18T20:13:20.748 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-18T20:13:20.749 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-18T20:13:20.749 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-18T20:13:20.749 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-18T20:13:20.749 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-18T20:13:20.749 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-18T20:13:20.750 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-18T20:13:20.750 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-18T20:13:20.750 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-18T20:13:20.750 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-18T20:13:20.750 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-18T20:13:20.751 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-18T20:13:20.751 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-18T20:13:20.751 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-18T20:13:20.751 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-18T20:13:20.751 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-18T20:13:20.751 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-18T20:13:20.752 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-18T20:13:20.752 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-18T20:13:20.752 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-18T20:13:20.752 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-18T20:13:20.752 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-18T20:13:20.753 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-18T20:13:20.753 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-18T20:13:20.753 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-18T20:13:20.753 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-18T20:13:20.753 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-18T20:13:20.754 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-18T20:13:20.754 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-18T20:13:20.754 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-18T20:13:20.754 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-18T20:13:20.754 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-18T20:13:20.755 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-18T20:13:20.755 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-18T20:13:20.755 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-18T20:13:20.755 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-18T20:13:20.755 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-18T20:13:20.755 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-18T20:13:20.756 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-18T20:13:20.756 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-18T20:13:20.756 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-18T20:13:20.756 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-18T20:13:20.756 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-18T20:13:20.757 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-18T20:13:20.757 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-18T20:13:20.757 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-18T20:13:20.757 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-18T20:13:20.757 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-18T20:13:20.758 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-18T20:13:20.758 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-18T20:13:20.758 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-18T20:13:20.758 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-18T20:13:20.758 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-18T20:13:20.759 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-18T20:13:20.759 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-18T20:13:20.759 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-18T20:13:20.759 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-18T20:13:20.759 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-18T20:13:20.760 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-18T20:13:20.760 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-18T20:13:20.760 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-18T20:13:20.760 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-18T20:13:20.760 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-18T20:13:20.761 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-18T20:13:20.761 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-18T20:13:20.761 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-18T20:13:20.761 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-18T20:13:20.761 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-18T20:13:20.761 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-18T20:13:20.762 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-18T20:13:20.762 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-18T20:13:20.762 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-18T20:13:20.762 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-18T20:13:20.763 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-18T20:13:20.763 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-18T20:13:20.763 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-18T20:13:20.763 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-18T20:13:20.763 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-18T20:13:20.764 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-18T20:13:20.764 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-18T20:13:20.764 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-18T20:13:20.764 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-18T20:13:20.764 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-18T20:13:20.764 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-18T20:13:20.765 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-18T20:13:20.765 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-18T20:13:20.765 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-18T20:13:20.765 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-18T20:13:20.765 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-18T20:13:20.766 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-18T20:13:20.766 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-18T20:13:20.766 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-18T20:13:20.766 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-18T20:13:20.766 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-18T20:13:20.767 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-18T20:13:20.767 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-18T20:13:20.767 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-18T20:13:20.767 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-18T20:13:20.767 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-18T20:13:20.767 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-18T20:13:20.768 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-18T20:13:20.768 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-18T20:13:20.768 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-18T20:13:20.768 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-18T20:13:20.768 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-18T20:13:20.769 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-18T20:13:20.769 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-18T20:13:20.769 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-18T20:13:20.769 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-18T20:13:20.769 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-18T20:13:20.770 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-18T20:13:20.770 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-18T20:13:20.770 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-18T20:13:20.770 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-18T20:13:20.770 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-18T20:13:20.771 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-18T20:13:20.771 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-18T20:13:20.771 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-18T20:13:20.771 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-18T20:13:20.771 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-18T20:13:20.771 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-18T20:13:20.772 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-18T20:13:20.772 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-18T20:13:20.772 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-18T20:13:20.772 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-18T20:13:20.772 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-18T20:13:20.773 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-18T20:13:20.773 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-18T20:13:20.773 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-18T20:13:20.773 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-18T20:13:20.773 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-18T20:13:20.774 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-18T20:13:20.774 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-18T20:13:20.774 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-18T20:13:20.774 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-18T20:13:20.774 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-18T20:13:20.775 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-18T20:13:20.775 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-18T20:13:20.775 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-18T20:13:20.775 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-18T20:13:20.775 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-18T20:13:20.775 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-18T20:13:20.776 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-18T20:13:20.776 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-18T20:13:20.776 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-18T20:13:20.776 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-18T20:13:20.776 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-18T20:13:20.777 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-18T20:13:20.777 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-18T20:13:20.777 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-18T20:13:20.777 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-18T20:13:20.777 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-18T20:13:20.778 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-18T20:13:20.778 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-18T20:13:20.778 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-18T20:13:20.778 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-18T20:13:20.778 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-18T20:13:20.779 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-18T20:13:20.779 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-18T20:13:20.779 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-18T20:13:20.779 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-18T20:13:20.779 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-18T20:13:20.779 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-18T20:13:20.780 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-18T20:13:20.780 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-18T20:13:20.780 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-18T20:13:20.780 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-18T20:13:20.780 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-18T20:13:20.781 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-18T20:13:20.781 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-18T20:13:20.781 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-18T20:13:20.781 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-18T20:13:20.781 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-18T20:13:20.782 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-18T20:13:20.782 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-18T20:13:20.782 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-18T20:13:20.782 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-18T20:13:20.782 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-18T20:13:20.783 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-18T20:13:20.783 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-18T20:13:20.783 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-18T20:13:20.783 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-18T20:13:20.783 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-18T20:13:20.783 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-18T20:13:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-18T20:13:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-18T20:13:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-18T20:13:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-18T20:13:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-18T20:13:20.785 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-18T20:13:20.785 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-18T20:13:20.785 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-18T20:13:20.785 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-18T20:13:20.785 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-18T20:13:20.786 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-18T20:13:20.786 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-18T20:13:20.786 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-18T20:13:20.786 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-18T20:13:20.786 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-18T20:13:20.786 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-18T20:13:20.787 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-18T20:13:20.787 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-18T20:13:20.787 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-18T20:13:20.787 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-18T20:13:20.787 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-18T20:13:20.788 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-18T20:13:20.788 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-18T20:13:20.788 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-18T20:13:20.788 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-18T20:13:20.788 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-18T20:13:20.789 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-18T20:13:20.789 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-18T20:13:20.789 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-18T20:13:20.789 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-18T20:13:20.789 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-18T20:13:20.789 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-18T20:13:20.790 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-18T20:13:20.790 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-18T20:13:20.790 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-18T20:13:20.790 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-18T20:13:20.790 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-18T20:13:20.791 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-18T20:13:20.791 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-18T20:13:20.791 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-18T20:13:20.791 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-18T20:13:20.791 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-18T20:13:20.792 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-18T20:13:20.792 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-18T20:13:20.792 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-18T20:13:20.792 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-18T20:13:20.792 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-18T20:13:20.793 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-18T20:13:20.793 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-18T20:13:20.793 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-18T20:13:20.793 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-18T20:13:20.793 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-18T20:13:20.793 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-18T20:13:20.794 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-18T20:13:20.794 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-18T20:13:20.794 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-18T20:13:20.794 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-18T20:13:20.794 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-18T20:13:20.795 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-18T20:13:20.795 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-18T20:13:20.795 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-18T20:13:20.795 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-18T20:13:20.795 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-18T20:13:20.796 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-18T20:13:20.796 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-18T20:13:20.796 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-18T20:13:20.796 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-18T20:13:20.796 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-18T20:13:20.796 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-18T20:13:20.797 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-18T20:13:20.797 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-18T20:13:20.797 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-18T20:13:20.797 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-18T20:13:20.797 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-18T20:13:20.797 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-18T20:13:20.798 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-18T20:13:20.798 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-18T20:13:20.798 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-18T20:13:20.798 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-18T20:13:20.798 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-18T20:13:20.799 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-18T20:13:20.799 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-18T20:13:20.799 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-18T20:13:20.799 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-18T20:13:20.799 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-18T20:13:20.800 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-18T20:13:20.800 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-18T20:13:20.800 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-18T20:13:20.800 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-18T20:13:20.800 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-18T20:13:20.800 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-18T20:13:20.801 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-18T20:13:20.801 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-18T20:13:20.801 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-18T20:13:20.801 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-18T20:13:20.801 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-18T20:13:20.802 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-18T20:13:20.802 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-18T20:13:20.802 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-18T20:13:20.802 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-18T20:13:20.802 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-18T20:13:20.803 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-18T20:13:20.803 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-18T20:13:20.803 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-18T20:13:20.803 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-18T20:13:20.803 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-18T20:13:20.804 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-18T20:13:20.804 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-18T20:13:20.804 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-18T20:13:20.804 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-18T20:13:20.804 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-18T20:13:20.804 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-18T20:13:20.805 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-18T20:13:20.805 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-18T20:13:20.805 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-18T20:13:20.805 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-18T20:13:20.805 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-18T20:13:20.806 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-18T20:13:20.806 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-18T20:13:20.806 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-18T20:13:20.806 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-18T20:13:20.806 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-18T20:13:20.807 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-18T20:13:20.807 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-18T20:13:20.807 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-18T20:13:20.807 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-18T20:13:20.807 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-18T20:13:20.808 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-18T20:13:20.808 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-18T20:13:20.808 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-18T20:13:20.808 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-18T20:13:20.808 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-18T20:13:20.808 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-18T20:13:20.809 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-18T20:13:20.809 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-18T20:13:20.809 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-18T20:13:20.809 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-18T20:13:20.809 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-18T20:13:20.810 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-18T20:13:20.810 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-18T20:13:20.810 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-18T20:13:20.810 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-18T20:13:20.810 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-18T20:13:20.811 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-18T20:13:20.811 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-18T20:13:20.811 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-18T20:13:20.811 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-18T20:13:20.811 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-18T20:13:20.811 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-18T20:13:20.812 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-18T20:13:20.812 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-18T20:13:20.812 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-18T20:13:20.812 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-18T20:13:20.812 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-18T20:13:20.813 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-18T20:13:20.813 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-18T20:13:20.813 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-18T20:13:20.813 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-18T20:13:20.813 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-18T20:13:20.814 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-18T20:13:20.814 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-18T20:13:20.814 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-18T20:13:20.814 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-18T20:13:20.814 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-18T20:13:20.814 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-18T20:13:20.815 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-18T20:13:20.815 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-18T20:13:20.815 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-18T20:13:20.815 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-18T20:13:20.815 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-18T20:13:20.816 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-18T20:13:20.816 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-18T20:13:20.816 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-18T20:13:20.816 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-18T20:13:20.816 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-18T20:13:20.816 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-18T20:13:20.817 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-18T20:13:20.817 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-18T20:13:20.817 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-18T20:13:20.817 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-18T20:13:20.817 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-18T20:13:20.818 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-18T20:13:20.818 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-18T20:13:20.818 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-18T20:13:20.818 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-18T20:13:20.818 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-18T20:13:20.819 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-18T20:13:20.819 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-18T20:13:20.819 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-18T20:13:20.819 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-18T20:13:20.819 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-18T20:13:20.820 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-18T20:13:20.820 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-18T20:13:20.820 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-18T20:13:20.820 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-18T20:13:20.820 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-18T20:13:20.820 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-18T20:13:20.821 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-18T20:13:20.821 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-18T20:13:20.821 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-18T20:13:20.821 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-18T20:13:20.821 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-18T20:13:20.821 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-18T20:13:20.822 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-18T20:13:20.822 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-18T20:13:20.822 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-18T20:13:20.822 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-18T20:13:20.822 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-18T20:13:20.823 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-18T20:13:20.823 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-18T20:13:20.823 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-18T20:13:20.823 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-18T20:13:20.823 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-18T20:13:20.824 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-18T20:13:20.824 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-18T20:13:20.824 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-18T20:13:20.824 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-18T20:13:20.824 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-18T20:13:20.824 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-18T20:13:20.825 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-18T20:13:20.825 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-18T20:13:20.825 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-18T20:13:20.825 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-18T20:13:20.825 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-18T20:13:20.826 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-18T20:13:20.826 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-18T20:13:20.826 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-18T20:13:20.826 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-18T20:13:20.826 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-18T20:13:20.826 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-18T20:13:20.827 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-18T20:13:20.827 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-18T20:13:20.827 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-18T20:13:20.827 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-18T20:13:20.827 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-18T20:13:20.828 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-18T20:13:20.828 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-18T20:13:20.828 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-18T20:13:20.828 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-18T20:13:20.828 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-18T20:13:20.828 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-18T20:13:20.829 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-18T20:13:20.829 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-18T20:13:20.829 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-18T20:13:20.829 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-18T20:13:20.829 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-18T20:13:20.829 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-18T20:13:20.830 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-18T20:13:20.830 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-18T20:13:20.830 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-18T20:13:20.830 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-18T20:13:20.830 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-18T20:13:20.831 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-18T20:13:20.831 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-18T20:13:20.831 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-18T20:13:20.831 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-18T20:13:20.831 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-18T20:13:20.832 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-18T20:13:20.832 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-18T20:13:20.832 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-18T20:13:20.832 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-18T20:13:20.832 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-18T20:13:20.832 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-18T20:13:20.833 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-18T20:13:20.833 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-18T20:13:20.833 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-18T20:13:20.833 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-18T20:13:20.833 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-18T20:13:20.834 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-18T20:13:20.834 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-18T20:13:20.834 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-18T20:13:20.834 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-18T20:13:20.834 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-18T20:13:20.835 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-18T20:13:20.837 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-18T20:13:20.837 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-18T20:13:20.837 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-18T20:13:20.838 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-18T20:13:20.838 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-18T20:13:20.838 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-18T20:13:20.838 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-18T20:13:20.838 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-18T20:13:20.838 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-18T20:13:20.839 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-18T20:13:20.839 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-18T20:13:20.839 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-18T20:13:20.839 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-18T20:13:20.839 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-18T20:13:20.840 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-18T20:13:20.840 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-18T20:13:20.840 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-18T20:13:20.840 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-18T20:13:20.840 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-18T20:13:20.840 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-18T20:13:20.841 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-18T20:13:20.841 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-18T20:13:20.841 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-18T20:13:20.841 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-18T20:13:20.841 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-18T20:13:20.842 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-18T20:13:20.842 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-18T20:13:20.842 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-18T20:13:20.842 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-18T20:13:20.842 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-18T20:13:20.843 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-18T20:13:20.843 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-18T20:13:20.843 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-18T20:13:20.843 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-18T20:13:20.843 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-18T20:13:20.843 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-18T20:13:20.844 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-18T20:13:20.844 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-18T20:13:20.844 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-18T20:13:20.844 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-18T20:13:20.844 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-18T20:13:20.845 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-18T20:13:20.845 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-18T20:13:20.845 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-18T20:13:20.845 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-18T20:13:20.845 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-18T20:13:20.845 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-18T20:13:20.846 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-18T20:13:20.846 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-18T20:13:20.846 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-18T20:13:20.846 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-18T20:13:20.846 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-18T20:13:20.847 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-18T20:13:20.847 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-18T20:13:20.847 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-18T20:13:20.847 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-18T20:13:20.847 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-18T20:13:20.848 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-18T20:13:20.848 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-18T20:13:20.848 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-18T20:13:20.848 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-18T20:13:20.848 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-18T20:13:20.848 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-18T20:13:20.849 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-18T20:13:20.849 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-18T20:13:20.849 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-18T20:13:20.849 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-18T20:13:20.849 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-18T20:13:20.850 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-18T20:13:20.850 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-18T20:13:20.850 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-18T20:13:20.850 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-18T20:13:20.850 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-18T20:13:20.850 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-18T20:13:20.851 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-18T20:13:20.851 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-18T20:13:20.851 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-18T20:13:20.851 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-18T20:13:20.851 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-18T20:13:20.852 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-18T20:13:20.852 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-18T20:13:20.852 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-18T20:13:20.852 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-18T20:13:20.852 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-18T20:13:20.852 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-18T20:13:20.853 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-18T20:13:20.853 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-18T20:13:20.853 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-18T20:13:20.853 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-18T20:13:20.853 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-18T20:13:20.854 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-18T20:13:20.854 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-18T20:13:20.854 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-18T20:13:20.854 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-18T20:13:20.854 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-18T20:13:20.854 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-18T20:13:20.855 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-18T20:13:20.855 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-18T20:13:20.855 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-18T20:13:20.855 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-18T20:13:20.855 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-18T20:13:20.856 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-18T20:13:20.856 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-18T20:13:20.856 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-18T20:13:20.856 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-18T20:13:20.856 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-18T20:13:20.856 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-18T20:13:20.857 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-18T20:13:20.857 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-18T20:13:20.857 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-18T20:13:20.857 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-18T20:13:20.857 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-18T20:13:20.858 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-18T20:13:20.858 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-18T20:13:20.858 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-18T20:13:20.858 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-18T20:13:20.858 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-18T20:13:20.858 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-18T20:13:20.859 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-18T20:13:20.859 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-18T20:13:20.859 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-18T20:13:20.859 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-18T20:13:20.859 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-18T20:13:20.860 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-18T20:13:20.860 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-18T20:13:20.860 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-18T20:13:20.860 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-18T20:13:20.860 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-18T20:13:20.860 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-18T20:13:20.861 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-18T20:13:20.861 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-18T20:13:20.861 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-18T20:13:20.861 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-18T20:13:20.861 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-18T20:13:20.862 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-18T20:13:20.862 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-18T20:13:20.862 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-18T20:13:20.862 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-18T20:13:20.862 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-18T20:13:20.863 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-18T20:13:20.863 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-18T20:13:20.863 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-18T20:13:20.863 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-18T20:13:20.863 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-18T20:13:20.863 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-18T20:13:20.864 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-18T20:13:20.864 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-18T20:13:20.864 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-18T20:13:20.864 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-18T20:13:20.864 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-18T20:13:20.864 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-18T20:13:20.865 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-18T20:13:20.865 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-18T20:13:20.865 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-18T20:13:20.865 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-18T20:13:20.865 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-18T20:13:20.866 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-18T20:13:20.866 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-18T20:13:20.866 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-18T20:13:20.866 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-18T20:13:20.866 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-18T20:13:20.866 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-18T20:13:20.867 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-18T20:13:20.867 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-18T20:13:20.867 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-18T20:13:20.867 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-18T20:13:20.867 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-18T20:13:20.868 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-18T20:13:20.868 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-18T20:13:20.868 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-18T20:13:20.868 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-18T20:13:20.868 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-18T20:13:20.868 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-18T20:13:20.869 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-18T20:13:20.869 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-18T20:13:20.869 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-18T20:13:20.869 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-18T20:13:20.869 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-18T20:13:20.869 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-18T20:13:20.870 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-18T20:13:20.870 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-18T20:13:20.870 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-18T20:13:20.870 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-18T20:13:20.870 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-18T20:13:20.871 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-18T20:13:20.871 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-18T20:13:20.871 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-18T20:13:20.871 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-18T20:13:20.871 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-18T20:13:20.871 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-18T20:13:20.872 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-18T20:13:20.872 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-18T20:13:20.872 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-18T20:13:20.872 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-18T20:13:20.872 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-18T20:13:20.873 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-18T20:13:20.873 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-18T20:13:20.873 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-18T20:13:20.873 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-18T20:13:20.873 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-18T20:13:20.873 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-18T20:13:20.874 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-18T20:13:20.874 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-18T20:13:20.874 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-18T20:13:20.874 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-18T20:13:20.874 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-18T20:13:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-18T20:13:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-18T20:13:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-18T20:13:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-18T20:13:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-18T20:13:20.876 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-18T20:13:20.876 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-18T20:13:20.876 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-18T20:13:20.876 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-18T20:13:20.876 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-18T20:13:20.876 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-18T20:13:20.877 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-18T20:13:20.877 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-18T20:13:20.877 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-18T20:13:20.877 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-18T20:13:20.877 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-18T20:13:20.877 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-18T20:13:20.878 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-18T20:13:20.878 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-18T20:13:20.878 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-18T20:13:20.878 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-18T20:13:20.878 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-18T20:13:20.879 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-18T20:13:20.879 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-18T20:13:20.879 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-18T20:13:20.879 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-18T20:13:20.879 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-18T20:13:20.880 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-18T20:13:20.880 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-18T20:13:20.880 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-18T20:13:20.880 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-18T20:13:20.880 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-18T20:13:20.880 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-18T20:13:20.881 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-18T20:13:20.881 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-18T20:13:20.881 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-18T20:13:20.881 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-18T20:13:20.881 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-18T20:13:20.882 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-18T20:13:20.882 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-18T20:13:20.882 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-18T20:13:20.882 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-18T20:13:20.882 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-18T20:13:20.882 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-18T20:13:20.883 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-18T20:13:20.883 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-18T20:13:20.883 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-18T20:13:20.883 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-18T20:13:20.883 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-18T20:13:20.884 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-18T20:13:20.884 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-18T20:13:20.884 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-18T20:13:20.884 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-18T20:13:20.884 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-18T20:13:20.884 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-18T20:13:20.885 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-18T20:13:20.885 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-18T20:13:20.885 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-18T20:13:20.885 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-18T20:13:20.885 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-18T20:13:20.886 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-18T20:13:20.886 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-18T20:13:20.886 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-18T20:13:20.886 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-18T20:13:20.886 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-18T20:13:20.886 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-18T20:13:20.887 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-18T20:13:20.887 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-18T20:13:20.887 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-18T20:13:20.887 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-18T20:13:20.887 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-18T20:13:20.888 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-18T20:13:20.888 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-18T20:13:20.888 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-18T20:13:20.888 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-18T20:13:20.888 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-18T20:13:20.889 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-18T20:13:20.889 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-18T20:13:20.889 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-18T20:13:20.889 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-18T20:13:20.889 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-18T20:13:20.889 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-18T20:13:20.890 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-18T20:13:20.890 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-18T20:13:20.890 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-18T20:13:20.890 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-18T20:13:20.890 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-18T20:13:20.891 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-18T20:13:20.891 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-18T20:13:20.891 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-18T20:13:20.891 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-18T20:13:20.891 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-18T20:13:20.891 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-18T20:13:20.892 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-18T20:13:20.892 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-18T20:13:20.892 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-18T20:13:20.892 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-18T20:13:20.892 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-18T20:13:20.893 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-18T20:13:20.893 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-18T20:13:20.893 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-18T20:13:20.893 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-18T20:13:20.893 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-18T20:13:20.894 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-18T20:13:20.894 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-18T20:13:20.894 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-18T20:13:20.894 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-18T20:13:20.894 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-18T20:13:20.895 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-18T20:13:20.895 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-18T20:13:20.895 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-18T20:13:20.895 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-18T20:13:20.895 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-18T20:13:20.895 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-18T20:13:20.896 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-18T20:13:20.896 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-18T20:13:20.896 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-18T20:13:20.896 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-18T20:13:20.896 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-18T20:13:20.897 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-18T20:13:20.897 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-18T20:13:20.897 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-18T20:13:20.897 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-18T20:13:20.897 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-18T20:13:20.897 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-18T20:13:20.898 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-18T20:13:20.898 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-18T20:13:20.898 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-18T20:13:20.898 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-18T20:13:20.898 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-18T20:13:20.899 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-18T20:13:20.899 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-18T20:13:20.899 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-18T20:13:20.899 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-18T20:13:20.899 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-18T20:13:20.899 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-18T20:13:20.900 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-18T20:13:20.900 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-18T20:13:20.900 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-18T20:13:20.900 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-18T20:13:20.900 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-18T20:13:20.901 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-18T20:13:20.901 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-18T20:13:20.901 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-18T20:13:20.901 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-18T20:13:20.901 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-18T20:13:20.901 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-18T20:13:20.902 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-18T20:13:20.902 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-18T20:13:20.902 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-18T20:13:20.902 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-18T20:13:20.902 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-18T20:13:20.903 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-18T20:13:20.903 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-18T20:13:20.903 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-18T20:13:20.903 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-18T20:13:20.903 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-18T20:13:20.904 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-18T20:13:20.904 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-18T20:13:20.904 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-18T20:13:20.904 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-18T20:13:20.904 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-18T20:13:20.904 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-18T20:13:20.905 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-18T20:13:20.905 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-18T20:13:20.905 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-18T20:13:20.905 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-18T20:13:20.905 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-18T20:13:20.905 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-18T20:13:20.906 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-18T20:13:20.906 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-18T20:13:20.906 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-18T20:13:20.906 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-18T20:13:20.906 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-18T20:13:20.907 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-18T20:13:20.907 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-18T20:13:20.907 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-18T20:13:20.907 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-18T20:13:20.907 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-18T20:13:20.907 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-18T20:13:20.908 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-18T20:13:20.908 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-18T20:13:20.908 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-18T20:13:20.908 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-18T20:13:20.908 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-18T20:13:20.908 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-18T20:13:20.909 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-18T20:13:20.909 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-18T20:13:20.909 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-18T20:13:20.909 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-18T20:13:20.909 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-18T20:13:20.910 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-18T20:13:20.910 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-18T20:13:20.910 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-18T20:13:20.910 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-18T20:13:20.910 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-18T20:13:20.911 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-18T20:13:20.911 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-18T20:13:20.911 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-18T20:13:20.911 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-18T20:13:20.911 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-18T20:13:20.911 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-18T20:13:20.912 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-18T20:13:20.912 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-18T20:13:20.912 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-18T20:13:20.912 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-18T20:13:20.912 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-18T20:13:20.913 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-18T20:13:20.913 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-18T20:13:20.913 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-18T20:13:20.913 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-18T20:13:20.913 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-18T20:13:20.914 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-18T20:13:20.914 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-18T20:13:20.914 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-18T20:13:20.914 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-18T20:13:20.914 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-18T20:13:20.915 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-18T20:13:20.915 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-18T20:13:20.915 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-18T20:13:20.915 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-18T20:13:20.915 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-18T20:13:20.915 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-18T20:13:20.916 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-18T20:13:20.916 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-18T20:13:20.916 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-18T20:13:20.916 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-18T20:13:20.916 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-18T20:13:20.916 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-18T20:13:20.917 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-18T20:13:20.917 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-18T20:13:20.917 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-18T20:13:20.917 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-18T20:13:20.917 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-18T20:13:20.917 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-18T20:13:20.918 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-18T20:13:20.918 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-18T20:13:20.918 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-18T20:13:20.918 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-18T20:13:20.918 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-18T20:13:20.919 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-18T20:13:20.919 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-18T20:13:20.919 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-18T20:13:20.919 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-18T20:13:20.919 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-18T20:13:20.919 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-18T20:13:20.920 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-18T20:13:20.920 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-18T20:13:20.920 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-18T20:13:20.920 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-18T20:13:20.920 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-18T20:13:20.921 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-18T20:13:20.921 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-18T20:13:20.921 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-18T20:13:20.921 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-18T20:13:20.921 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-18T20:13:20.921 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-18T20:13:20.922 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-18T20:13:20.922 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-18T20:13:20.922 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-18T20:13:20.922 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-18T20:13:20.922 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-18T20:13:20.923 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-18T20:13:20.923 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-18T20:13:20.923 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-18T20:13:20.923 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-18T20:13:20.923 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-18T20:13:20.923 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-18T20:13:20.924 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-18T20:13:20.924 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-18T20:13:20.924 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-18T20:13:20.924 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-18T20:13:20.924 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-18T20:13:20.924 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-18T20:13:20.925 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-18T20:13:20.925 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-18T20:13:20.925 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-18T20:13:20.925 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-18T20:13:20.925 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-18T20:13:20.926 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-18T20:13:20.926 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-18T20:13:20.926 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-18T20:13:20.926 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-18T20:13:20.926 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-18T20:13:20.927 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-18T20:13:20.927 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-18T20:13:20.927 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-18T20:13:20.927 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-18T20:13:20.927 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-18T20:13:20.927 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-18T20:13:20.928 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-18T20:13:20.928 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-18T20:13:20.928 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-18T20:13:20.928 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-18T20:13:20.928 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-18T20:13:20.929 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-18T20:13:20.929 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-18T20:13:20.929 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-18T20:13:20.929 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-18T20:13:20.929 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-18T20:13:20.930 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-18T20:13:20.930 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-18T20:13:20.930 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-18T20:13:20.930 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-18T20:13:20.930 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-18T20:13:20.930 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-18T20:13:20.931 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-18T20:13:20.931 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-18T20:13:20.931 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-18T20:13:20.931 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-18T20:13:20.931 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-18T20:13:20.931 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-18T20:13:20.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-18T20:13:20.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-18T20:13:20.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-18T20:13:20.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-18T20:13:20.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-18T20:13:20.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-18T20:13:20.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-18T20:13:20.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-18T20:13:20.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-18T20:13:20.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-18T20:13:20.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-18T20:13:20.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-18T20:13:20.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-18T20:13:20.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-18T20:13:20.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-18T20:13:20.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-18T20:13:20.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-18T20:13:20.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-18T20:13:20.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-18T20:13:20.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-18T20:13:20.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-18T20:13:20.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-18T20:13:20.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-18T20:13:20.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-18T20:13:20.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-18T20:13:20.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-18T20:13:20.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-18T20:13:20.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-18T20:13:20.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-18T20:13:20.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-18T20:13:20.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-18T20:13:20.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-18T20:13:20.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-18T20:13:20.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-18T20:13:20.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-18T20:13:20.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-18T20:13:20.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-18T20:13:20.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-18T20:13:20.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-18T20:13:20.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-18T20:13:20.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-18T20:13:20.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-18T20:13:20.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-18T20:13:20.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-18T20:13:20.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-18T20:13:20.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-18T20:13:20.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-18T20:13:20.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-18T20:13:20.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-18T20:13:20.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-18T20:13:20.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-18T20:13:20.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-18T20:13:20.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-18T20:13:20.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-18T20:13:20.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-18T20:13:20.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-18T20:13:20.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-18T20:13:20.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-18T20:13:20.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-18T20:13:20.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-18T20:13:20.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-18T20:13:20.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-18T20:13:20.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-18T20:13:20.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-18T20:13:20.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-18T20:13:20.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-18T20:13:20.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-18T20:13:20.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-18T20:13:20.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-18T20:13:20.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-18T20:13:20.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-18T20:13:20.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-18T20:13:20.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-18T20:13:20.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-18T20:13:20.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-18T20:13:20.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-18T20:13:20.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-18T20:13:20.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-18T20:13:20.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-18T20:13:20.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-18T20:13:20.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-18T20:13:20.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-18T20:13:20.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-18T20:13:20.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-18T20:13:20.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-18T20:13:20.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-18T20:13:20.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-18T20:13:20.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-18T20:13:20.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-18T20:13:20.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-18T20:13:20.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-18T20:13:20.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-18T20:13:20.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-18T20:13:20.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-18T20:13:20.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-18T20:13:20.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-18T20:13:20.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-18T20:13:20.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-18T20:13:20.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-18T20:13:20.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-18T20:13:20.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-18T20:13:20.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-18T20:13:20.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-18T20:13:20.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-18T20:13:20.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-18T20:13:20.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-18T20:13:20.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-18T20:13:20.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-18T20:13:20.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-18T20:13:20.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-18T20:13:20.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-18T20:13:20.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-18T20:13:20.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-18T20:13:20.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-18T20:13:20.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-18T20:13:20.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-18T20:13:20.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-18T20:13:20.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-18T20:13:20.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-18T20:13:20.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-18T20:13:20.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-18T20:13:20.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-18T20:13:20.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-18T20:13:20.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-18T20:13:20.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-18T20:13:20.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-18T20:13:20.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-18T20:13:20.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-18T20:13:20.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-18T20:13:20.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-18T20:13:20.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-18T20:13:20.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-18T20:13:20.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-18T20:13:20.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-18T20:13:20.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-18T20:13:20.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-18T20:13:20.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-18T20:13:20.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-18T20:13:20.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-18T20:13:20.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-18T20:13:20.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-18T20:13:20.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-18T20:13:20.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-18T20:13:20.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-18T20:13:20.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-18T20:13:20.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-18T20:13:20.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-18T20:13:20.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-18T20:13:20.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-18T20:13:20.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-18T20:13:20.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-18T20:13:20.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-18T20:13:20.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-18T20:13:20.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-18T20:13:20.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-18T20:13:20.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-18T20:13:20.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-18T20:13:20.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-18T20:13:20.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-18T20:13:20.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-18T20:13:20.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-18T20:13:20.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-18T20:13:20.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-18T20:13:20.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-18T20:13:20.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-18T20:13:20.961 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-18T20:13:20.961 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-18T20:13:20.961 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-18T20:13:20.961 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-18T20:13:20.961 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-18T20:13:20.961 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-18T20:13:20.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-18T20:13:20.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-18T20:13:20.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-18T20:13:20.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-18T20:13:20.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-18T20:13:20.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-18T20:13:20.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-18T20:13:20.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-18T20:13:20.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-18T20:13:20.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-18T20:13:20.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-18T20:13:20.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-18T20:13:20.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-18T20:13:20.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-18T20:13:20.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-18T20:13:20.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-18T20:13:20.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-18T20:13:20.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-18T20:13:20.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-18T20:13:20.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-18T20:13:20.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-18T20:13:20.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-18T20:13:20.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-18T20:13:20.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-18T20:13:20.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-18T20:13:20.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-18T20:13:20.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-18T20:13:20.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-18T20:13:20.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-18T20:13:20.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-18T20:13:20.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-18T20:13:20.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-18T20:13:20.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-18T20:13:20.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-18T20:13:20.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-18T20:13:20.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-18T20:13:20.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-18T20:13:20.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-18T20:13:20.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-18T20:13:20.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-18T20:13:20.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-18T20:13:20.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-18T20:13:20.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-18T20:13:20.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-18T20:13:20.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-18T20:13:20.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-18T20:13:20.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-18T20:13:20.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-18T20:13:20.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-18T20:13:20.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-18T20:13:20.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-18T20:13:20.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-18T20:13:20.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-18T20:13:20.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-18T20:13:20.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-18T20:13:20.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-18T20:13:20.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-18T20:13:20.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-18T20:13:20.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-18T20:13:20.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-18T20:13:20.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-18T20:13:20.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-18T20:13:20.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-18T20:13:20.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-18T20:13:20.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-18T20:13:20.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-18T20:13:20.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-18T20:13:20.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-18T20:13:20.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-18T20:13:20.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-18T20:13:20.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-18T20:13:20.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-18T20:13:20.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-18T20:13:20.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-18T20:13:20.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-18T20:13:20.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-18T20:13:20.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-18T20:13:20.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-18T20:13:20.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-18T20:13:20.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-18T20:13:20.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-18T20:13:20.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-18T20:13:20.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-18T20:13:20.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-18T20:13:20.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-18T20:13:20.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-18T20:13:20.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-18T20:13:20.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-18T20:13:20.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-18T20:13:20.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-18T20:13:20.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-18T20:13:20.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-18T20:13:20.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-18T20:13:20.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-18T20:13:20.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-18T20:13:20.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-18T20:13:20.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-18T20:13:20.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-18T20:13:20.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-18T20:13:20.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-18T20:13:20.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-18T20:13:20.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-18T20:13:20.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-18T20:13:20.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-18T20:13:20.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-18T20:13:20.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-18T20:13:20.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-18T20:13:20.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-18T20:13:20.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-18T20:13:20.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-18T20:13:20.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-18T20:13:20.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-18T20:13:20.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-18T20:13:20.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-18T20:13:20.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-18T20:13:20.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-18T20:13:20.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-18T20:13:20.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-18T20:13:20.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-18T20:13:20.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-18T20:13:20.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-18T20:13:20.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-18T20:13:20.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-18T20:13:20.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-18T20:13:20.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-18T20:13:20.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-18T20:13:20.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-18T20:13:20.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-18T20:13:20.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-18T20:13:20.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-18T20:13:20.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-18T20:13:20.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-18T20:13:20.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-18T20:13:20.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-18T20:13:20.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-18T20:13:20.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-18T20:13:20.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-18T20:13:20.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-18T20:13:20.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-18T20:13:20.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-18T20:13:20.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-18T20:13:20.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-18T20:13:20.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-18T20:13:20.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-18T20:13:20.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-18T20:13:20.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-18T20:13:20.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-18T20:13:20.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-18T20:13:20.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-18T20:13:20.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-18T20:13:20.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-18T20:13:20.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-18T20:13:20.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-18T20:13:20.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-18T20:13:20.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-18T20:13:20.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-18T20:13:20.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-18T20:13:20.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-18T20:13:20.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-18T20:13:20.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-18T20:13:20.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-18T20:13:20.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-18T20:13:20.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-18T20:13:20.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-18T20:13:20.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-18T20:13:20.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-18T20:13:20.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-18T20:13:20.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-18T20:13:20.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-18T20:13:20.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-18T20:13:20.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-18T20:13:20.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-18T20:13:20.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-18T20:13:20.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-18T20:13:20.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-18T20:13:20.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-18T20:13:20.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-18T20:13:20.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-18T20:13:20.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-18T20:13:20.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-18T20:13:20.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-18T20:13:20.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-18T20:13:20.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-18T20:13:20.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-18T20:13:20.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-18T20:13:20.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-18T20:13:20.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-18T20:13:20.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-18T20:13:20.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-18T20:13:20.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-18T20:13:20.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-18T20:13:20.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-18T20:13:20.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-18T20:13:20.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-18T20:13:20.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-18T20:13:20.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-18T20:13:20.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-18T20:13:20.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-18T20:13:20.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-18T20:13:20.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-18T20:13:20.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-18T20:13:20.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-18T20:13:20.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-18T20:13:20.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-18T20:13:20.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-18T20:13:20.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-18T20:13:20.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-18T20:13:20.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-18T20:13:20.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-18T20:13:20.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-18T20:13:20.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-18T20:13:20.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-18T20:13:20.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-18T20:13:20.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-18T20:13:20.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-18T20:13:20.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-18T20:13:21.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-18T20:13:21.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-18T20:13:21.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-18T20:13:21.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-18T20:13:21.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-18T20:13:21.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-18T20:13:21.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-18T20:13:21.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-18T20:13:21.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-18T20:13:21.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-18T20:13:21.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-18T20:13:21.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-18T20:13:21.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-18T20:13:21.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-18T20:13:21.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-18T20:13:21.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-18T20:13:21.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-18T20:13:21.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-18T20:13:21.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-18T20:13:21.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-18T20:13:21.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-18T20:13:21.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-18T20:13:21.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-18T20:13:21.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-18T20:13:21.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-18T20:13:21.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-18T20:13:21.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-18T20:13:21.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-18T20:13:21.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-18T20:13:21.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-18T20:13:21.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-18T20:13:21.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-18T20:13:21.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-18T20:13:21.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-18T20:13:21.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-18T20:13:21.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-18T20:13:21.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-18T20:13:21.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-18T20:13:21.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-18T20:13:21.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-18T20:13:21.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-18T20:13:21.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-18T20:13:21.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-18T20:13:21.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-18T20:13:21.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-18T20:13:21.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-18T20:13:21.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-18T20:13:21.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-18T20:13:21.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-18T20:13:21.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-18T20:13:21.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-18T20:13:21.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-18T20:13:21.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-18T20:13:21.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-18T20:13:21.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-18T20:13:21.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-18T20:13:21.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-18T20:13:21.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-18T20:13:21.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-18T20:13:21.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-18T20:13:21.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-18T20:13:21.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-18T20:13:21.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-18T20:13:21.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-18T20:13:21.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-18T20:13:21.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-18T20:13:21.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-18T20:13:21.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-18T20:13:21.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-18T20:13:21.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-18T20:13:21.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-18T20:13:21.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-18T20:13:21.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-18T20:13:21.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-18T20:13:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-18T20:13:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-18T20:13:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-18T20:13:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-18T20:13:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-18T20:13:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-18T20:13:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-18T20:13:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-18T20:13:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-18T20:13:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-18T20:13:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-18T20:13:21.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-18T20:13:21.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-18T20:13:21.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-18T20:13:21.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-18T20:13:21.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-18T20:13:21.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-18T20:13:21.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-18T20:13:21.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-18T20:13:21.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-18T20:13:21.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-18T20:13:21.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-18T20:13:21.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-18T20:13:21.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-18T20:13:21.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-18T20:13:21.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-18T20:13:21.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-18T20:13:21.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-18T20:13:21.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-18T20:13:21.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-18T20:13:21.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-18T20:13:21.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-18T20:13:21.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-18T20:13:21.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-18T20:13:21.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-18T20:13:21.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-18T20:13:21.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-18T20:13:21.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-18T20:13:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-18T20:13:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-18T20:13:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-18T20:13:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-18T20:13:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-18T20:13:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-18T20:13:21.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-18T20:13:21.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-18T20:13:21.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-18T20:13:21.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-18T20:13:21.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-18T20:13:21.022 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-18T20:13:21.023 DEBUG:teuthology.orchestra.run.smithi060:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-18T20:13:21.052 INFO:teuthology.orchestra.run.smithi060.stdout:postinstall scriptlet (using /bin/sh): 2023-10-18T20:13:21.052 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-18T20:13:21.053 INFO:teuthology.orchestra.run.smithi060.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-18T20:13:21.053 INFO:teuthology.orchestra.run.smithi060.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T20:13:21.053 INFO:teuthology.orchestra.run.smithi060.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T20:13:21.053 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T20:13:21.054 INFO:teuthology.orchestra.run.smithi060.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T20:13:21.054 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2023-10-18T20:13:21.054 INFO:teuthology.orchestra.run.smithi060.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-18T20:13:21.054 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-18T20:13:21.054 INFO:teuthology.orchestra.run.smithi060.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-18T20:13:21.055 INFO:teuthology.orchestra.run.smithi060.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-18T20:13:21.055 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-18T20:13:21.055 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2023-10-18T20:13:21.055 INFO:teuthology.orchestra.run.smithi060.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-18T20:13:21.055 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-18T20:13:21.055 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-18T20:13:21.056 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2023-10-18T20:13:21.057 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2023-10-18T20:13:21.139 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2023-10-18T20:13:21.139 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2023-10-18T20:13:21.140 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.02 2023-10-18T20:13:21.140 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 129.el8 2023-10-18T20:13:21.140 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2023-10-18T20:13:21.140 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-18T20:13:21.140 INFO:teuthology.orchestra.run.smithi060.stdout:Group : System Environment/Base 2023-10-18T20:13:21.141 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 9265586 2023-10-18T20:13:21.141 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2023-10-18T20:13:21.141 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-18T20:13:21.141 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-18T20:13:21.141 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-18T20:13:21.141 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-18T20:13:21.142 INFO:teuthology.orchestra.run.smithi060.stdout:Relocations : (not relocatable) 2023-10-18T20:13:21.142 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : CentOS BuildSystem 2023-10-18T20:13:21.142 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2023-10-18T20:13:21.142 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-18T20:13:21.142 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2023-10-18T20:13:21.143 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2023-10-18T20:13:21.143 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:13:21.143 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-18T20:13:21.143 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-18T20:13:21.143 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-18T20:13:21.144 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2023-10-18T20:13:21.144 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:13:21.144 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2023-10-18T20:13:21.145 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-18T20:13:21.145 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 6.6.0-rc5-g47672119149b 2023-10-18T20:13:21.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-18T20:13:26.824 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2023-10-18T20:13:28.973 INFO:teuthology.orchestra.run.smithi060.stderr:done 2023-10-18T20:13:28.975 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2023-10-18T20:13:29.013 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.T7RtCEAKhm 2023-10-18T20:13:29.013 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.T7RtCEAKhm 2023-10-18T20:13:29.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.T7RtCEAKhm 2023-10-18T20:13:29.258 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.T7RtCEAKhm is 6KB 2023-10-18T20:13:29.306 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.T7RtCEAKhm 2023-10-18T20:13:29.325 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2023-10-18T20:13:29.390 INFO:teuthology.orchestra.run.smithi060.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-18T20:13:29.391 INFO:teuthology.orchestra.run.smithi060.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-18T20:13:29.391 INFO:teuthology.orchestra.run.smithi060.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-18T20:13:29.391 INFO:teuthology.orchestra.run.smithi060.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-rc5-g47672119149b.conf 2023-10-18T20:13:29.392 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-rc5-g47672119149b 2023-10-18T20:13:29.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2023-10-18T20:13:31.351 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-18T20:13:35.705 INFO:teuthology.orchestra.run.smithi008.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-18T20:13:55.490 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-18T20:13:55.491 DEBUG:teuthology.orchestra.run.smithi008:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-18T20:13:55.545 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T20:13:55.545 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-18T20:13:55.546 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T20:13:55.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-18T20:13:55.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-18T20:13:55.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-18T20:13:55.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-18T20:13:55.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-18T20:13:55.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-18T20:13:55.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-18T20:13:55.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-18T20:13:55.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-18T20:13:55.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-18T20:13:55.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-18T20:13:55.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-18T20:13:55.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-18T20:13:55.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-18T20:13:55.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-18T20:13:55.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-18T20:13:55.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-18T20:13:55.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-18T20:13:55.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-18T20:13:55.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-18T20:13:55.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-18T20:13:55.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-18T20:13:55.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-18T20:13:55.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-18T20:13:55.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-18T20:13:55.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-18T20:13:55.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-18T20:13:55.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-18T20:13:55.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-18T20:13:55.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-18T20:13:55.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-18T20:13:55.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-18T20:13:55.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-18T20:13:55.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-18T20:13:55.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-18T20:13:55.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-18T20:13:55.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-18T20:13:55.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-18T20:13:55.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-18T20:13:55.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-18T20:13:55.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-18T20:13:55.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-18T20:13:55.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-18T20:13:55.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-18T20:13:55.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-18T20:13:55.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-18T20:13:55.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-18T20:13:55.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-18T20:13:55.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-18T20:13:55.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-18T20:13:55.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-18T20:13:55.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-18T20:13:55.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-18T20:13:55.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-18T20:13:55.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-18T20:13:55.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-18T20:13:55.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-18T20:13:55.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-18T20:13:55.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-18T20:13:55.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-18T20:13:55.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-18T20:13:55.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-18T20:13:55.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-18T20:13:55.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-18T20:13:55.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-18T20:13:55.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-18T20:13:55.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-18T20:13:55.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-18T20:13:55.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-18T20:13:55.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-18T20:13:55.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-18T20:13:55.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-18T20:13:55.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-18T20:13:55.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-18T20:13:55.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-18T20:13:55.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-18T20:13:55.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-18T20:13:55.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-18T20:13:55.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-18T20:13:55.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-18T20:13:55.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-18T20:13:55.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-18T20:13:55.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-18T20:13:55.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-18T20:13:55.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-18T20:13:55.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-18T20:13:55.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-18T20:13:55.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-18T20:13:55.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-18T20:13:55.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-18T20:13:55.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-18T20:13:55.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-18T20:13:55.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-18T20:13:55.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-18T20:13:55.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-18T20:13:55.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-18T20:13:55.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-18T20:13:55.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-18T20:13:55.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-18T20:13:55.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-18T20:13:55.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-18T20:13:55.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-18T20:13:55.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-18T20:13:55.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-18T20:13:55.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-18T20:13:55.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-18T20:13:55.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-18T20:13:55.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-18T20:13:55.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-18T20:13:55.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-18T20:13:55.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-18T20:13:55.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-18T20:13:55.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-18T20:13:55.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-18T20:13:55.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-18T20:13:55.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-18T20:13:55.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-18T20:13:55.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-18T20:13:55.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-18T20:13:55.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-18T20:13:55.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-18T20:13:55.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-18T20:13:55.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-18T20:13:55.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-18T20:13:55.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-18T20:13:55.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-18T20:13:55.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-18T20:13:55.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-18T20:13:55.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-18T20:13:55.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-18T20:13:55.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-18T20:13:55.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-18T20:13:55.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-18T20:13:55.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-18T20:13:55.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-18T20:13:55.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-18T20:13:55.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-18T20:13:55.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-18T20:13:55.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-18T20:13:55.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-18T20:13:55.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-18T20:13:55.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-18T20:13:55.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-18T20:13:55.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-18T20:13:55.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-18T20:13:55.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-18T20:13:55.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-18T20:13:55.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-18T20:13:55.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-18T20:13:55.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-18T20:13:55.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-18T20:13:55.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-18T20:13:55.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-18T20:13:55.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-18T20:13:55.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-18T20:13:55.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-18T20:13:55.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-18T20:13:55.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-18T20:13:55.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-18T20:13:55.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-18T20:13:55.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-18T20:13:55.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-18T20:13:55.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-18T20:13:55.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-18T20:13:55.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-18T20:13:55.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-18T20:13:55.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-18T20:13:55.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-18T20:13:55.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-18T20:13:55.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-18T20:13:55.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-18T20:13:55.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-18T20:13:55.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-18T20:13:55.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-18T20:13:55.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-18T20:13:55.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-18T20:13:55.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-18T20:13:55.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-18T20:13:55.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-18T20:13:55.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-18T20:13:55.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-18T20:13:55.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-18T20:13:55.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-18T20:13:55.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-18T20:13:55.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-18T20:13:55.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-18T20:13:55.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-18T20:13:55.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-18T20:13:55.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-18T20:13:55.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-18T20:13:55.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-18T20:13:55.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-18T20:13:55.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-18T20:13:55.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-18T20:13:55.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-18T20:13:55.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-18T20:13:55.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-18T20:13:55.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-18T20:13:55.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-18T20:13:55.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-18T20:13:55.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-18T20:13:55.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-18T20:13:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-18T20:13:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-18T20:13:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-18T20:13:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-18T20:13:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-18T20:13:55.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-18T20:13:55.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-18T20:13:55.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-18T20:13:55.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-18T20:13:55.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-18T20:13:55.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-18T20:13:55.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-18T20:13:55.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-18T20:13:55.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-18T20:13:55.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-18T20:13:55.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-18T20:13:55.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-18T20:13:55.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-18T20:13:55.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-18T20:13:55.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-18T20:13:55.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-18T20:13:55.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-18T20:13:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-18T20:13:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-18T20:13:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-18T20:13:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-18T20:13:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-18T20:13:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-18T20:13:55.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-18T20:13:55.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-18T20:13:55.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-18T20:13:55.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-18T20:13:55.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-18T20:13:55.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-18T20:13:55.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-18T20:13:55.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-18T20:13:55.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-18T20:13:55.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-18T20:13:55.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-18T20:13:55.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-18T20:13:55.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-18T20:13:55.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-18T20:13:55.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-18T20:13:55.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-18T20:13:55.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-18T20:13:55.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-18T20:13:55.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-18T20:13:55.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-18T20:13:55.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-18T20:13:55.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-18T20:13:55.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-18T20:13:55.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-18T20:13:55.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-18T20:13:55.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-18T20:13:55.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-18T20:13:55.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-18T20:13:55.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-18T20:13:55.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-18T20:13:55.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-18T20:13:55.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-18T20:13:55.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-18T20:13:55.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-18T20:13:55.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-18T20:13:55.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-18T20:13:55.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-18T20:13:55.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-18T20:13:55.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-18T20:13:55.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-18T20:13:55.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-18T20:13:55.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-18T20:13:55.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-18T20:13:55.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-18T20:13:55.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-18T20:13:55.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-18T20:13:55.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-18T20:13:55.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-18T20:13:55.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-18T20:13:55.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-18T20:13:55.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-18T20:13:55.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-18T20:13:55.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-18T20:13:55.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-18T20:13:55.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-18T20:13:55.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-18T20:13:55.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-18T20:13:55.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-18T20:13:55.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-18T20:13:55.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-18T20:13:55.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-18T20:13:55.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-18T20:13:55.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-18T20:13:55.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-18T20:13:55.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-18T20:13:55.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-18T20:13:55.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-18T20:13:55.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-18T20:13:55.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-18T20:13:55.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-18T20:13:55.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-18T20:13:55.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-18T20:13:55.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-18T20:13:55.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-18T20:13:55.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-18T20:13:55.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-18T20:13:55.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-18T20:13:55.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-18T20:13:55.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-18T20:13:55.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-18T20:13:55.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-18T20:13:55.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-18T20:13:55.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-18T20:13:55.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-18T20:13:55.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-18T20:13:55.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-18T20:13:55.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-18T20:13:55.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-18T20:13:55.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-18T20:13:55.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-18T20:13:55.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-18T20:13:55.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-18T20:13:55.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-18T20:13:55.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-18T20:13:55.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-18T20:13:55.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-18T20:13:55.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-18T20:13:55.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-18T20:13:55.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-18T20:13:55.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-18T20:13:55.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-18T20:13:55.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-18T20:13:55.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-18T20:13:55.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-18T20:13:55.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-18T20:13:55.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-18T20:13:55.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-18T20:13:55.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-18T20:13:55.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-18T20:13:55.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-18T20:13:55.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-18T20:13:55.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-18T20:13:55.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-18T20:13:55.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-18T20:13:55.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-18T20:13:55.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-18T20:13:55.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-18T20:13:55.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-18T20:13:55.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-18T20:13:55.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-18T20:13:55.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-18T20:13:55.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-18T20:13:55.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-18T20:13:55.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-18T20:13:55.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-18T20:13:55.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-18T20:13:55.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-18T20:13:55.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-18T20:13:55.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-18T20:13:55.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-18T20:13:55.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-18T20:13:55.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-18T20:13:55.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-18T20:13:55.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-18T20:13:55.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-18T20:13:55.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-18T20:13:55.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-18T20:13:55.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-18T20:13:55.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-18T20:13:55.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-18T20:13:55.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-18T20:13:55.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-18T20:13:55.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-18T20:13:55.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-18T20:13:55.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-18T20:13:55.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-18T20:13:55.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-18T20:13:55.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-18T20:13:55.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-18T20:13:55.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-18T20:13:55.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-18T20:13:55.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-18T20:13:55.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-18T20:13:55.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-18T20:13:55.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-18T20:13:55.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-18T20:13:55.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-18T20:13:55.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-18T20:13:55.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-18T20:13:55.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-18T20:13:55.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-18T20:13:55.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-18T20:13:55.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-18T20:13:55.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-18T20:13:55.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-18T20:13:55.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-18T20:13:55.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-18T20:13:55.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-18T20:13:55.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-18T20:13:55.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-18T20:13:55.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-18T20:13:55.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-18T20:13:55.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-18T20:13:55.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-18T20:13:55.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-18T20:13:55.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-18T20:13:55.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-18T20:13:55.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-18T20:13:55.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-18T20:13:55.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-18T20:13:55.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-18T20:13:55.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-18T20:13:55.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-18T20:13:55.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-18T20:13:55.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-18T20:13:55.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-18T20:13:55.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-18T20:13:55.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-18T20:13:55.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-18T20:13:55.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-18T20:13:55.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-18T20:13:55.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-18T20:13:55.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-18T20:13:55.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-18T20:13:55.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-18T20:13:55.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-18T20:13:55.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-18T20:13:55.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-18T20:13:55.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-18T20:13:55.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-18T20:13:55.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-18T20:13:55.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-18T20:13:55.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-18T20:13:55.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-18T20:13:55.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-18T20:13:55.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-18T20:13:55.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-18T20:13:55.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-18T20:13:55.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-18T20:13:55.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-18T20:13:55.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-18T20:13:55.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-18T20:13:55.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-18T20:13:55.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-18T20:13:55.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-18T20:13:55.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-18T20:13:55.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-18T20:13:55.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-18T20:13:55.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-18T20:13:55.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-18T20:13:55.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-18T20:13:55.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-18T20:13:55.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-18T20:13:55.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-18T20:13:55.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-18T20:13:55.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-18T20:13:55.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-18T20:13:55.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-18T20:13:55.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-18T20:13:55.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-18T20:13:55.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-18T20:13:55.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-18T20:13:55.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-18T20:13:55.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-18T20:13:55.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-18T20:13:55.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-18T20:13:55.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-18T20:13:55.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-18T20:13:55.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-18T20:13:55.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-18T20:13:55.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-18T20:13:55.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-18T20:13:55.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-18T20:13:55.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-18T20:13:55.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-18T20:13:55.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-18T20:13:55.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-18T20:13:55.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-18T20:13:55.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-18T20:13:55.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-18T20:13:55.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-18T20:13:55.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-18T20:13:55.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-18T20:13:55.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-18T20:13:55.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-18T20:13:55.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-18T20:13:55.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-18T20:13:55.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-18T20:13:55.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-18T20:13:55.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-18T20:13:55.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-18T20:13:55.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-18T20:13:55.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-18T20:13:55.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-18T20:13:55.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-18T20:13:55.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-18T20:13:55.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-18T20:13:55.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-18T20:13:55.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-18T20:13:55.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-18T20:13:55.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-18T20:13:55.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-18T20:13:55.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-18T20:13:55.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-18T20:13:55.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-18T20:13:55.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-18T20:13:55.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-18T20:13:55.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-18T20:13:55.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-18T20:13:55.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-18T20:13:55.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-18T20:13:55.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-18T20:13:55.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-18T20:13:55.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-18T20:13:55.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-18T20:13:55.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-18T20:13:55.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-18T20:13:55.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-18T20:13:55.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-18T20:13:55.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-18T20:13:55.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-18T20:13:55.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-18T20:13:55.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-18T20:13:55.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-18T20:13:55.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-18T20:13:55.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-18T20:13:55.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-18T20:13:55.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-18T20:13:55.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-18T20:13:55.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-18T20:13:55.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-18T20:13:55.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-18T20:13:55.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-18T20:13:55.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-18T20:13:55.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-18T20:13:55.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-18T20:13:55.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-18T20:13:55.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-18T20:13:55.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-18T20:13:55.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-18T20:13:55.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-18T20:13:55.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-18T20:13:55.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-18T20:13:55.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-18T20:13:55.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-18T20:13:55.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-18T20:13:55.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-18T20:13:55.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-18T20:13:55.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-18T20:13:55.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-18T20:13:55.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-18T20:13:55.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-18T20:13:55.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-18T20:13:55.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-18T20:13:55.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-18T20:13:55.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-18T20:13:55.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-18T20:13:55.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-18T20:13:55.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-18T20:13:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-18T20:13:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-18T20:13:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-18T20:13:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-18T20:13:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-18T20:13:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-18T20:13:55.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-18T20:13:55.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-18T20:13:55.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-18T20:13:55.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-18T20:13:55.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-18T20:13:55.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-18T20:13:55.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-18T20:13:55.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-18T20:13:55.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-18T20:13:55.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-18T20:13:55.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-18T20:13:55.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-18T20:13:55.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-18T20:13:55.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-18T20:13:55.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-18T20:13:55.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-18T20:13:55.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-18T20:13:55.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-18T20:13:55.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-18T20:13:55.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-18T20:13:55.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-18T20:13:55.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-18T20:13:55.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-18T20:13:55.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-18T20:13:55.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-18T20:13:55.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-18T20:13:55.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-18T20:13:55.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-18T20:13:55.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-18T20:13:55.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-18T20:13:55.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-18T20:13:55.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-18T20:13:55.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-18T20:13:55.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-18T20:13:55.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-18T20:13:55.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-18T20:13:55.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-18T20:13:55.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-18T20:13:55.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-18T20:13:55.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-18T20:13:55.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-18T20:13:55.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-18T20:13:55.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-18T20:13:55.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-18T20:13:55.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-18T20:13:55.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-18T20:13:55.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-18T20:13:55.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-18T20:13:55.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-18T20:13:55.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-18T20:13:55.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-18T20:13:55.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-18T20:13:55.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-18T20:13:55.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-18T20:13:55.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-18T20:13:55.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-18T20:13:55.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-18T20:13:55.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-18T20:13:55.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-18T20:13:55.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-18T20:13:55.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-18T20:13:55.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-18T20:13:55.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-18T20:13:55.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-18T20:13:55.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-18T20:13:55.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-18T20:13:55.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-18T20:13:55.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-18T20:13:55.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-18T20:13:55.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-18T20:13:55.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-18T20:13:55.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-18T20:13:55.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-18T20:13:55.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-18T20:13:55.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-18T20:13:55.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-18T20:13:55.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-18T20:13:55.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-18T20:13:55.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-18T20:13:55.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-18T20:13:55.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-18T20:13:55.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-18T20:13:55.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-18T20:13:55.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-18T20:13:55.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-18T20:13:55.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-18T20:13:55.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-18T20:13:55.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-18T20:13:55.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-18T20:13:55.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-18T20:13:55.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-18T20:13:55.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-18T20:13:55.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-18T20:13:55.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-18T20:13:55.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-18T20:13:55.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-18T20:13:55.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-18T20:13:55.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-18T20:13:55.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-18T20:13:55.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-18T20:13:55.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-18T20:13:55.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-18T20:13:55.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-18T20:13:55.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-18T20:13:55.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-18T20:13:55.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-18T20:13:55.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-18T20:13:55.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-18T20:13:55.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-18T20:13:55.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-18T20:13:55.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-18T20:13:55.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-18T20:13:55.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-18T20:13:55.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-18T20:13:55.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-18T20:13:55.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-18T20:13:55.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-18T20:13:55.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-18T20:13:55.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-18T20:13:55.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-18T20:13:55.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-18T20:13:55.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-18T20:13:55.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-18T20:13:55.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-18T20:13:55.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-18T20:13:55.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-18T20:13:55.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-18T20:13:55.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-18T20:13:55.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-18T20:13:55.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-18T20:13:55.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-18T20:13:55.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-18T20:13:55.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-18T20:13:55.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-18T20:13:55.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-18T20:13:55.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-18T20:13:55.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-18T20:13:55.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-18T20:13:55.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-18T20:13:55.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-18T20:13:55.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-18T20:13:55.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-18T20:13:55.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-18T20:13:55.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-18T20:13:55.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-18T20:13:55.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-18T20:13:55.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-18T20:13:55.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-18T20:13:55.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-18T20:13:55.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-18T20:13:55.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-18T20:13:55.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-18T20:13:55.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-18T20:13:55.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-18T20:13:55.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-18T20:13:55.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-18T20:13:55.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-18T20:13:55.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-18T20:13:55.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-18T20:13:55.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-18T20:13:55.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-18T20:13:55.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-18T20:13:55.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-18T20:13:55.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-18T20:13:55.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-18T20:13:55.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-18T20:13:55.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-18T20:13:55.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-18T20:13:55.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-18T20:13:55.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-18T20:13:55.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-18T20:13:55.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-18T20:13:55.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-18T20:13:55.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-18T20:13:55.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-18T20:13:55.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-18T20:13:55.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-18T20:13:55.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-18T20:13:55.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-18T20:13:55.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-18T20:13:55.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-18T20:13:55.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-18T20:13:55.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-18T20:13:55.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-18T20:13:55.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-18T20:13:55.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-18T20:13:55.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-18T20:13:55.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-18T20:13:55.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-18T20:13:55.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-18T20:13:55.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-18T20:13:55.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-18T20:13:55.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-18T20:13:55.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-18T20:13:55.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-18T20:13:55.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-18T20:13:55.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-18T20:13:55.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-18T20:13:55.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-18T20:13:55.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-18T20:13:55.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-18T20:13:55.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-18T20:13:55.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-18T20:13:55.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-18T20:13:55.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-18T20:13:55.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-18T20:13:55.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-18T20:13:55.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-18T20:13:55.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-18T20:13:55.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-18T20:13:55.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-18T20:13:55.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-18T20:13:55.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-18T20:13:55.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-18T20:13:55.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-18T20:13:55.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-18T20:13:55.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-18T20:13:55.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-18T20:13:55.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-18T20:13:55.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-18T20:13:55.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-18T20:13:55.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-18T20:13:55.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-18T20:13:55.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-18T20:13:55.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-18T20:13:55.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-18T20:13:55.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-18T20:13:55.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-18T20:13:55.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-18T20:13:55.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-18T20:13:55.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-18T20:13:55.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-18T20:13:55.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-18T20:13:55.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-18T20:13:55.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-18T20:13:55.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-18T20:13:55.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-18T20:13:55.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-18T20:13:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-18T20:13:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-18T20:13:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-18T20:13:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-18T20:13:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-18T20:13:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-18T20:13:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-18T20:13:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-18T20:13:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-18T20:13:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-18T20:13:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-18T20:13:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-18T20:13:55.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-18T20:13:55.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-18T20:13:55.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-18T20:13:55.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-18T20:13:55.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-18T20:13:55.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-18T20:13:55.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-18T20:13:55.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-18T20:13:55.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-18T20:13:55.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-18T20:13:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-18T20:13:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-18T20:13:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-18T20:13:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-18T20:13:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-18T20:13:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-18T20:13:55.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-18T20:13:55.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-18T20:13:55.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-18T20:13:55.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-18T20:13:55.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-18T20:13:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-18T20:13:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-18T20:13:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-18T20:13:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-18T20:13:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-18T20:13:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-18T20:13:55.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-18T20:13:55.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-18T20:13:55.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-18T20:13:55.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-18T20:13:55.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-18T20:13:55.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-18T20:13:55.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-18T20:13:55.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-18T20:13:55.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-18T20:13:55.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-18T20:13:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-18T20:13:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-18T20:13:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-18T20:13:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-18T20:13:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-18T20:13:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-18T20:13:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-18T20:13:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-18T20:13:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-18T20:13:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-18T20:13:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-18T20:13:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-18T20:13:55.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-18T20:13:55.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-18T20:13:55.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-18T20:13:55.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-18T20:13:55.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-18T20:13:55.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-18T20:13:55.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-18T20:13:55.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-18T20:13:55.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-18T20:13:55.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-18T20:13:55.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-18T20:13:55.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-18T20:13:55.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-18T20:13:55.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-18T20:13:55.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-18T20:13:55.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-18T20:13:55.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-18T20:13:55.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-18T20:13:55.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-18T20:13:55.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-18T20:13:55.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-18T20:13:55.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-18T20:13:55.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-18T20:13:55.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-18T20:13:55.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-18T20:13:55.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-18T20:13:55.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-18T20:13:55.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-18T20:13:55.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-18T20:13:55.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-18T20:13:55.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-18T20:13:55.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-18T20:13:55.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-18T20:13:55.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-18T20:13:55.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-18T20:13:55.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-18T20:13:55.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-18T20:13:55.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-18T20:13:55.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-18T20:13:55.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-18T20:13:55.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-18T20:13:55.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-18T20:13:55.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-18T20:13:55.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-18T20:13:55.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-18T20:13:55.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-18T20:13:55.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-18T20:13:55.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-18T20:13:55.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-18T20:13:55.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-18T20:13:55.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-18T20:13:55.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-18T20:13:55.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-18T20:13:55.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-18T20:13:55.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-18T20:13:55.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-18T20:13:55.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-18T20:13:55.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-18T20:13:55.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-18T20:13:55.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-18T20:13:55.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-18T20:13:55.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-18T20:13:55.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-18T20:13:55.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-18T20:13:55.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-18T20:13:55.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-18T20:13:55.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-18T20:13:55.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-18T20:13:55.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-18T20:13:55.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-18T20:13:55.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-18T20:13:55.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-18T20:13:55.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-18T20:13:55.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-18T20:13:55.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-18T20:13:55.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-18T20:13:55.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-18T20:13:55.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-18T20:13:55.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-18T20:13:55.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-18T20:13:55.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-18T20:13:55.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-18T20:13:55.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-18T20:13:55.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-18T20:13:55.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-18T20:13:55.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-18T20:13:55.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-18T20:13:55.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-18T20:13:55.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-18T20:13:55.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-18T20:13:55.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-18T20:13:55.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-18T20:13:55.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-18T20:13:55.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-18T20:13:55.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-18T20:13:55.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-18T20:13:55.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-18T20:13:55.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-18T20:13:55.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-18T20:13:55.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-18T20:13:55.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-18T20:13:55.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-18T20:13:55.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-18T20:13:55.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-18T20:13:55.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-18T20:13:55.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-18T20:13:55.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-18T20:13:55.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-18T20:13:55.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-18T20:13:55.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-18T20:13:55.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-18T20:13:55.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-18T20:13:55.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-18T20:13:55.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-18T20:13:55.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-18T20:13:55.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-18T20:13:55.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-18T20:13:55.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-18T20:13:55.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-18T20:13:55.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-18T20:13:55.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-18T20:13:55.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-18T20:13:55.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-18T20:13:55.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-18T20:13:55.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-18T20:13:55.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-18T20:13:55.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-18T20:13:55.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-18T20:13:55.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-18T20:13:55.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-18T20:13:55.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-18T20:13:55.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-18T20:13:55.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-18T20:13:55.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-18T20:13:55.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-18T20:13:55.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-18T20:13:55.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-18T20:13:55.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-18T20:13:55.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-18T20:13:55.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-18T20:13:55.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-18T20:13:55.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-18T20:13:55.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-18T20:13:55.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-18T20:13:55.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-18T20:13:55.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-18T20:13:55.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-18T20:13:55.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-18T20:13:55.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-18T20:13:55.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-18T20:13:55.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-18T20:13:55.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-18T20:13:55.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-18T20:13:55.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-18T20:13:55.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-18T20:13:55.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-18T20:13:55.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-18T20:13:55.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-18T20:13:55.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-18T20:13:55.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-18T20:13:55.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-18T20:13:55.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-18T20:13:55.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-18T20:13:55.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-18T20:13:55.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-18T20:13:55.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-18T20:13:55.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-18T20:13:55.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-18T20:13:55.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-18T20:13:55.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-18T20:13:55.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-18T20:13:55.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-18T20:13:55.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-18T20:13:55.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-18T20:13:55.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-18T20:13:55.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-18T20:13:55.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-18T20:13:55.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-18T20:13:55.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-18T20:13:55.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-18T20:13:55.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-18T20:13:55.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-18T20:13:55.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-18T20:13:55.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-18T20:13:55.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-18T20:13:55.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-18T20:13:55.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-18T20:13:55.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-18T20:13:55.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-18T20:13:55.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-18T20:13:55.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-18T20:13:55.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-18T20:13:55.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-18T20:13:55.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-18T20:13:55.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-18T20:13:55.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-18T20:13:55.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-18T20:13:55.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-18T20:13:55.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-18T20:13:55.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-18T20:13:55.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-18T20:13:55.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-18T20:13:55.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-18T20:13:55.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-18T20:13:55.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-18T20:13:55.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-18T20:13:55.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-18T20:13:55.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-18T20:13:55.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-18T20:13:55.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-18T20:13:55.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-18T20:13:55.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-18T20:13:55.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-18T20:13:55.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-18T20:13:55.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-18T20:13:55.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-18T20:13:55.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-18T20:13:55.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-18T20:13:55.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-18T20:13:55.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-18T20:13:55.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-18T20:13:55.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-18T20:13:55.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-18T20:13:55.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-18T20:13:55.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-18T20:13:55.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-18T20:13:55.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-18T20:13:55.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-18T20:13:55.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-18T20:13:55.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-18T20:13:55.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-18T20:13:55.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-18T20:13:55.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-18T20:13:55.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-18T20:13:55.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-18T20:13:55.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-18T20:13:55.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-18T20:13:55.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-18T20:13:55.756 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-18T20:13:55.756 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-18T20:13:55.756 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-18T20:13:55.756 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-18T20:13:55.756 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-18T20:13:55.757 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-18T20:13:55.757 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-18T20:13:55.757 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-18T20:13:55.757 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-18T20:13:55.757 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-18T20:13:55.757 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-18T20:13:55.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-18T20:13:55.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-18T20:13:55.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-18T20:13:55.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-18T20:13:55.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-18T20:13:55.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-18T20:13:55.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-18T20:13:55.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-18T20:13:55.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-18T20:13:55.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-18T20:13:55.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-18T20:13:55.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-18T20:13:55.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-18T20:13:55.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-18T20:13:55.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-18T20:13:55.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-18T20:13:55.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-18T20:13:55.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-18T20:13:55.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-18T20:13:55.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-18T20:13:55.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-18T20:13:55.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-18T20:13:55.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-18T20:13:55.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-18T20:13:55.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-18T20:13:55.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-18T20:13:55.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-18T20:13:55.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-18T20:13:55.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-18T20:13:55.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-18T20:13:55.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-18T20:13:55.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-18T20:13:55.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-18T20:13:55.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-18T20:13:55.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-18T20:13:55.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-18T20:13:55.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-18T20:13:55.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-18T20:13:55.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-18T20:13:55.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-18T20:13:55.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-18T20:13:55.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-18T20:13:55.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-18T20:13:55.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-18T20:13:55.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-18T20:13:55.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-18T20:13:55.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-18T20:13:55.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-18T20:13:55.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-18T20:13:55.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-18T20:13:55.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-18T20:13:55.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-18T20:13:55.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-18T20:13:55.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-18T20:13:55.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-18T20:13:55.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-18T20:13:55.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-18T20:13:55.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-18T20:13:55.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-18T20:13:55.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-18T20:13:55.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-18T20:13:55.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-18T20:13:55.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-18T20:13:55.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-18T20:13:55.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-18T20:13:55.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-18T20:13:55.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-18T20:13:55.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-18T20:13:55.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-18T20:13:55.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-18T20:13:55.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-18T20:13:55.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-18T20:13:55.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-18T20:13:55.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-18T20:13:55.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-18T20:13:55.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-18T20:13:55.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-18T20:13:55.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-18T20:13:55.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-18T20:13:55.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-18T20:13:55.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-18T20:13:55.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-18T20:13:55.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-18T20:13:55.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-18T20:13:55.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-18T20:13:55.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-18T20:13:55.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-18T20:13:55.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-18T20:13:55.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-18T20:13:55.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-18T20:13:55.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-18T20:13:55.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-18T20:13:55.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-18T20:13:55.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-18T20:13:55.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-18T20:13:55.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-18T20:13:55.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-18T20:13:55.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-18T20:13:55.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-18T20:13:55.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-18T20:13:55.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-18T20:13:55.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-18T20:13:55.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-18T20:13:55.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-18T20:13:55.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-18T20:13:55.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-18T20:13:55.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-18T20:13:55.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-18T20:13:55.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-18T20:13:55.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-18T20:13:55.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-18T20:13:55.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-18T20:13:55.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-18T20:13:55.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-18T20:13:55.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-18T20:13:55.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-18T20:13:55.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-18T20:13:55.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-18T20:13:55.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-18T20:13:55.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-18T20:13:55.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-18T20:13:55.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-18T20:13:55.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-18T20:13:55.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-18T20:13:55.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-18T20:13:55.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-18T20:13:55.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-18T20:13:55.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-18T20:13:55.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-18T20:13:55.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-18T20:13:55.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-18T20:13:55.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-18T20:13:55.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-18T20:13:55.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-18T20:13:55.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-18T20:13:55.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-18T20:13:55.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-18T20:13:55.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-18T20:13:55.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-18T20:13:55.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-18T20:13:55.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-18T20:13:55.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-18T20:13:55.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-18T20:13:55.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-18T20:13:55.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-18T20:13:55.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-18T20:13:55.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-18T20:13:55.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-18T20:13:55.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-18T20:13:55.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-18T20:13:55.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-18T20:13:55.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-18T20:13:55.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-18T20:13:55.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-18T20:13:55.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-18T20:13:55.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-18T20:13:55.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-18T20:13:55.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-18T20:13:55.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-18T20:13:55.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-18T20:13:55.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-18T20:13:55.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-18T20:13:55.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-18T20:13:55.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-18T20:13:55.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-18T20:13:55.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-18T20:13:55.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-18T20:13:55.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-18T20:13:55.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-18T20:13:55.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-18T20:13:55.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-18T20:13:55.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-18T20:13:55.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-18T20:13:55.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-18T20:13:55.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-18T20:13:55.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-18T20:13:55.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-18T20:13:55.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-18T20:13:55.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-18T20:13:55.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-18T20:13:55.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-18T20:13:55.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-18T20:13:55.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-18T20:13:55.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-18T20:13:55.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-18T20:13:55.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-18T20:13:55.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-18T20:13:55.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-18T20:13:55.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-18T20:13:55.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-18T20:13:55.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-18T20:13:55.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-18T20:13:55.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-18T20:13:55.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-18T20:13:55.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-18T20:13:55.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-18T20:13:55.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-18T20:13:55.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-18T20:13:55.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-18T20:13:55.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-18T20:13:55.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-18T20:13:55.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-18T20:13:55.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-18T20:13:55.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-18T20:13:55.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-18T20:13:55.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-18T20:13:55.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-18T20:13:55.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-18T20:13:55.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-18T20:13:55.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-18T20:13:55.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-18T20:13:55.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-18T20:13:55.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-18T20:13:55.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-18T20:13:55.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-18T20:13:55.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-18T20:13:55.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-18T20:13:55.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-18T20:13:55.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-18T20:13:55.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-18T20:13:55.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-18T20:13:55.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-18T20:13:55.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-18T20:13:55.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-18T20:13:55.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-18T20:13:55.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-18T20:13:55.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-18T20:13:55.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-18T20:13:55.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-18T20:13:55.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-18T20:13:55.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-18T20:13:55.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-18T20:13:55.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-18T20:13:55.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-18T20:13:55.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-18T20:13:55.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-18T20:13:55.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-18T20:13:55.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-18T20:13:55.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-18T20:13:55.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-18T20:13:55.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-18T20:13:55.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-18T20:13:55.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-18T20:13:55.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-18T20:13:55.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-18T20:13:55.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-18T20:13:55.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-18T20:13:55.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-18T20:13:55.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-18T20:13:55.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-18T20:13:55.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-18T20:13:55.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-18T20:13:55.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-18T20:13:55.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-18T20:13:55.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-18T20:13:55.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-18T20:13:55.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-18T20:13:55.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-18T20:13:55.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-18T20:13:55.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-18T20:13:55.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-18T20:13:55.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-18T20:13:55.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-18T20:13:55.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-18T20:13:55.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-18T20:13:55.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-18T20:13:55.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-18T20:13:55.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-18T20:13:55.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-18T20:13:55.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-18T20:13:55.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-18T20:13:55.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-18T20:13:55.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-18T20:13:55.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-18T20:13:55.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-18T20:13:55.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-18T20:13:55.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-18T20:13:55.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-18T20:13:55.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-18T20:13:55.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-18T20:13:55.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-18T20:13:55.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-18T20:13:55.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-18T20:13:55.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-18T20:13:55.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-18T20:13:55.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-18T20:13:55.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-18T20:13:55.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-18T20:13:55.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-18T20:13:55.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-18T20:13:55.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-18T20:13:55.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-18T20:13:55.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-18T20:13:55.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-18T20:13:55.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-18T20:13:55.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-18T20:13:55.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-18T20:13:55.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-18T20:13:55.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-18T20:13:55.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-18T20:13:55.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-18T20:13:55.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-18T20:13:55.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-18T20:13:55.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-18T20:13:55.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-18T20:13:55.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-18T20:13:55.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-18T20:13:55.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-18T20:13:55.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-18T20:13:55.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-18T20:13:55.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-18T20:13:55.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-18T20:13:55.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-18T20:13:55.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-18T20:13:55.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-18T20:13:55.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-18T20:13:55.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-18T20:13:55.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-18T20:13:55.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-18T20:13:55.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-18T20:13:55.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-18T20:13:55.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-18T20:13:55.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-18T20:13:55.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-18T20:13:55.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-18T20:13:55.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-18T20:13:55.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-18T20:13:55.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-18T20:13:55.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-18T20:13:55.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-18T20:13:55.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-18T20:13:55.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-18T20:13:55.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-18T20:13:55.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-18T20:13:55.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-18T20:13:55.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-18T20:13:55.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-18T20:13:55.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-18T20:13:55.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-18T20:13:55.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-18T20:13:55.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-18T20:13:55.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-18T20:13:55.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-18T20:13:55.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-18T20:13:55.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-18T20:13:55.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-18T20:13:55.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-18T20:13:55.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-18T20:13:55.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-18T20:13:55.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-18T20:13:55.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-18T20:13:55.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-18T20:13:55.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-18T20:13:55.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-18T20:13:55.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-18T20:13:55.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-18T20:13:55.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-18T20:13:55.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-18T20:13:55.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-18T20:13:55.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-18T20:13:55.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-18T20:13:55.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-18T20:13:55.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-18T20:13:55.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-18T20:13:55.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-18T20:13:55.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-18T20:13:55.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-18T20:13:55.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-18T20:13:55.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-18T20:13:55.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-18T20:13:55.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-18T20:13:55.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-18T20:13:55.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-18T20:13:55.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-18T20:13:55.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-18T20:13:55.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-18T20:13:55.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-18T20:13:55.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-18T20:13:55.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-18T20:13:55.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-18T20:13:55.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-18T20:13:55.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-18T20:13:55.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-18T20:13:55.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-18T20:13:55.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-18T20:13:55.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-18T20:13:55.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-18T20:13:55.826 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-18T20:13:55.826 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-18T20:13:55.826 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-18T20:13:55.826 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-18T20:13:55.826 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-18T20:13:55.827 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-18T20:13:55.827 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-18T20:13:55.827 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-18T20:13:55.827 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-18T20:13:55.827 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-18T20:13:55.827 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-18T20:13:55.828 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-18T20:13:55.828 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-18T20:13:55.828 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-18T20:13:55.828 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-18T20:13:55.828 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-18T20:13:55.828 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-18T20:13:55.829 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-18T20:13:55.829 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-18T20:13:55.829 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-18T20:13:55.829 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-18T20:13:55.829 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-18T20:13:55.829 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-18T20:13:55.830 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-18T20:13:55.830 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-18T20:13:55.830 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-18T20:13:55.830 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-18T20:13:55.830 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-18T20:13:55.830 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-18T20:13:55.831 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-18T20:13:55.831 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-18T20:13:55.831 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-18T20:13:55.831 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-18T20:13:55.831 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-18T20:13:55.831 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-18T20:13:55.832 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-18T20:13:55.832 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-18T20:13:55.832 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-18T20:13:55.832 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-18T20:13:55.832 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-18T20:13:55.833 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-18T20:13:55.833 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-18T20:13:55.833 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-18T20:13:55.833 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-18T20:13:55.833 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-18T20:13:55.833 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-18T20:13:55.834 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-18T20:13:55.834 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-18T20:13:55.834 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-18T20:13:55.834 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-18T20:13:55.834 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-18T20:13:55.834 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-18T20:13:55.835 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-18T20:13:55.835 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-18T20:13:55.835 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-18T20:13:55.835 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-18T20:13:55.835 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-18T20:13:55.835 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-18T20:13:55.836 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-18T20:13:55.836 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-18T20:13:55.836 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-18T20:13:55.836 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-18T20:13:55.836 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-18T20:13:55.836 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-18T20:13:55.837 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-18T20:13:55.837 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-18T20:13:55.837 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-18T20:13:55.837 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-18T20:13:55.837 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-18T20:13:55.837 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-18T20:13:55.838 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-18T20:13:55.838 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-18T20:13:55.838 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-18T20:13:55.838 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-18T20:13:55.838 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-18T20:13:55.838 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-18T20:13:55.839 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-18T20:13:55.839 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-18T20:13:55.839 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-18T20:13:55.839 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-18T20:13:55.839 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-18T20:13:55.839 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-18T20:13:55.840 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-18T20:13:55.840 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-18T20:13:55.840 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-18T20:13:55.840 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-18T20:13:55.840 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-18T20:13:55.840 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-18T20:13:55.841 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-18T20:13:55.841 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-18T20:13:55.841 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-18T20:13:55.841 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-18T20:13:55.841 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-18T20:13:55.841 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-18T20:13:55.842 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-18T20:13:55.842 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-18T20:13:55.842 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-18T20:13:55.842 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-18T20:13:55.842 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-18T20:13:55.843 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-18T20:13:55.843 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-18T20:13:55.843 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-18T20:13:55.843 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-18T20:13:55.843 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-18T20:13:55.843 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-18T20:13:55.845 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-18T20:13:55.845 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-18T20:13:55.845 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-18T20:13:55.846 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-18T20:13:55.846 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-18T20:13:55.846 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-18T20:13:55.846 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-18T20:13:55.846 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-18T20:13:55.847 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-18T20:13:55.847 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-18T20:13:55.847 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-18T20:13:55.847 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-18T20:13:55.847 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-18T20:13:55.847 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-18T20:13:55.848 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-18T20:13:55.848 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-18T20:13:55.848 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-18T20:13:55.848 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-18T20:13:55.848 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-18T20:13:55.848 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-18T20:13:55.849 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-18T20:13:55.849 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-18T20:13:55.849 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-18T20:13:55.849 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-18T20:13:55.849 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-18T20:13:55.849 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-18T20:13:55.850 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-18T20:13:55.850 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-18T20:13:55.850 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-18T20:13:55.850 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-18T20:13:55.850 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-18T20:13:55.850 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-18T20:13:55.851 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-18T20:13:55.851 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-18T20:13:55.851 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-18T20:13:55.851 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-18T20:13:55.851 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-18T20:13:55.852 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-18T20:13:55.852 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-18T20:13:55.852 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-18T20:13:55.852 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-18T20:13:55.852 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-18T20:13:55.852 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-18T20:13:55.853 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-18T20:13:55.853 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-18T20:13:55.853 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-18T20:13:55.853 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-18T20:13:55.853 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-18T20:13:55.853 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-18T20:13:55.854 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-18T20:13:55.854 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-18T20:13:55.854 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-18T20:13:55.854 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-18T20:13:55.854 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-18T20:13:55.854 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-18T20:13:55.855 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-18T20:13:55.855 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-18T20:13:55.855 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-18T20:13:55.855 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-18T20:13:55.855 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-18T20:13:55.855 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-18T20:13:55.856 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-18T20:13:55.856 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-18T20:13:55.856 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-18T20:13:55.856 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-18T20:13:55.856 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-18T20:13:55.856 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-18T20:13:55.857 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-18T20:13:55.857 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-18T20:13:55.857 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-18T20:13:55.857 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-18T20:13:55.857 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-18T20:13:55.858 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-18T20:13:55.858 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-18T20:13:55.858 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-18T20:13:55.858 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-18T20:13:55.858 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-18T20:13:55.858 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-18T20:13:55.859 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-18T20:13:55.859 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-18T20:13:55.859 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-18T20:13:55.859 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-18T20:13:55.859 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-18T20:13:55.860 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-18T20:13:55.860 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-18T20:13:55.860 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-18T20:13:55.860 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-18T20:13:55.860 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-18T20:13:55.860 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-18T20:13:55.861 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-18T20:13:55.861 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-18T20:13:55.861 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-18T20:13:55.861 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-18T20:13:55.861 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-18T20:13:55.861 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-18T20:13:55.862 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-18T20:13:55.862 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-18T20:13:55.862 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-18T20:13:55.862 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-18T20:13:55.862 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-18T20:13:55.863 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-18T20:13:55.863 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-18T20:13:55.863 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-18T20:13:55.863 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-18T20:13:55.863 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-18T20:13:55.863 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-18T20:13:55.864 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-18T20:13:55.864 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-18T20:13:55.864 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-18T20:13:55.864 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-18T20:13:55.864 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-18T20:13:55.864 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-18T20:13:55.865 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-18T20:13:55.865 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-18T20:13:55.865 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-18T20:13:55.865 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-18T20:13:55.865 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-18T20:13:55.865 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-18T20:13:55.866 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-18T20:13:55.866 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-18T20:13:55.866 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-18T20:13:55.866 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-18T20:13:55.866 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-18T20:13:55.867 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-18T20:13:55.867 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-18T20:13:55.867 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-18T20:13:55.867 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-18T20:13:55.867 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-18T20:13:55.867 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-18T20:13:55.868 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-18T20:13:55.868 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-18T20:13:55.868 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-18T20:13:55.868 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-18T20:13:55.868 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-18T20:13:55.868 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-18T20:13:55.869 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-18T20:13:55.869 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-18T20:13:55.869 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-18T20:13:55.869 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-18T20:13:55.869 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-18T20:13:55.869 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-18T20:13:55.870 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-18T20:13:55.870 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-18T20:13:55.870 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-18T20:13:55.870 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-18T20:13:55.870 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-18T20:13:55.871 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-18T20:13:55.871 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-18T20:13:55.871 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-18T20:13:55.871 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-18T20:13:55.871 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-18T20:13:55.871 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-18T20:13:55.872 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-18T20:13:55.872 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-18T20:13:55.872 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-18T20:13:55.872 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-18T20:13:55.872 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-18T20:13:55.872 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-18T20:13:55.873 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-18T20:13:55.873 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-18T20:13:55.873 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-18T20:13:55.873 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-18T20:13:55.873 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-18T20:13:55.873 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-18T20:13:55.874 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-18T20:13:55.874 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-18T20:13:55.874 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-18T20:13:55.874 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-18T20:13:55.874 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-18T20:13:55.875 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-18T20:13:55.875 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-18T20:13:55.875 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-18T20:13:55.875 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-18T20:13:55.875 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-18T20:13:55.875 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-18T20:13:55.876 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-18T20:13:55.876 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-18T20:13:55.876 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-18T20:13:55.876 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-18T20:13:55.876 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-18T20:13:55.876 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-18T20:13:55.877 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-18T20:13:55.877 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-18T20:13:55.877 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-18T20:13:55.877 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-18T20:13:55.877 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-18T20:13:55.877 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-18T20:13:55.878 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-18T20:13:55.878 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-18T20:13:55.878 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-18T20:13:55.878 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-18T20:13:55.878 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-18T20:13:55.878 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-18T20:13:55.879 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-18T20:13:55.879 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-18T20:13:55.879 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-18T20:13:55.879 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-18T20:13:55.879 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-18T20:13:55.879 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-18T20:13:55.880 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-18T20:13:55.880 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-18T20:13:55.880 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-18T20:13:55.880 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-18T20:13:55.880 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-18T20:13:55.880 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-18T20:13:55.881 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-18T20:13:55.881 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-18T20:13:55.881 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-18T20:13:55.881 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-18T20:13:55.881 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-18T20:13:55.881 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-18T20:13:55.882 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-18T20:13:55.882 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-18T20:13:55.882 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-18T20:13:55.882 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-18T20:13:55.882 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-18T20:13:55.882 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-18T20:13:55.883 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-18T20:13:55.883 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-18T20:13:55.883 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-18T20:13:55.883 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-18T20:13:55.883 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-18T20:13:55.883 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-18T20:13:55.884 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-18T20:13:55.884 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-18T20:13:55.884 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-18T20:13:55.884 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-18T20:13:55.884 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-18T20:13:55.885 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-18T20:13:55.885 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-18T20:13:55.885 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-18T20:13:55.885 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-18T20:13:55.885 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-18T20:13:55.885 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-18T20:13:55.886 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-18T20:13:55.886 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-18T20:13:55.886 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-18T20:13:55.886 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-18T20:13:55.886 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-18T20:13:55.886 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-18T20:13:55.887 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-18T20:13:55.887 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-18T20:13:55.887 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-18T20:13:55.887 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-18T20:13:55.887 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-18T20:13:55.887 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-18T20:13:55.888 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-18T20:13:55.888 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-18T20:13:55.888 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-18T20:13:55.888 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-18T20:13:55.888 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-18T20:13:55.889 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-18T20:13:55.889 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-18T20:13:55.889 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-18T20:13:55.889 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-18T20:13:55.889 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-18T20:13:55.889 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-18T20:13:55.890 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-18T20:13:55.890 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-18T20:13:55.890 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-18T20:13:55.890 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-18T20:13:55.890 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-18T20:13:55.890 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-18T20:13:55.891 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-18T20:13:55.891 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-18T20:13:55.891 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-18T20:13:55.891 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-18T20:13:55.891 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-18T20:13:55.892 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-18T20:13:55.892 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-18T20:13:55.892 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-18T20:13:55.892 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-18T20:13:55.892 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-18T20:13:55.892 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-18T20:13:55.893 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-18T20:13:55.893 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-18T20:13:55.893 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-18T20:13:55.893 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-18T20:13:55.893 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-18T20:13:55.893 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-18T20:13:55.894 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-18T20:13:55.894 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-18T20:13:55.894 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-18T20:13:55.894 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-18T20:13:55.894 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-18T20:13:55.895 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-18T20:13:55.895 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-18T20:13:55.895 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-18T20:13:55.895 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-18T20:13:55.895 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-18T20:13:55.895 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-18T20:13:55.896 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-18T20:13:55.896 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-18T20:13:55.896 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-18T20:13:55.896 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-18T20:13:55.896 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-18T20:13:55.896 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-18T20:13:55.897 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-18T20:13:55.897 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-18T20:13:55.897 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-18T20:13:55.897 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-18T20:13:55.897 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-18T20:13:55.897 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-18T20:13:55.898 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-18T20:13:55.898 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-18T20:13:55.898 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-18T20:13:55.898 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-18T20:13:55.898 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-18T20:13:55.898 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-18T20:13:55.899 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-18T20:13:55.899 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-18T20:13:55.899 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-18T20:13:55.899 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-18T20:13:55.899 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-18T20:13:55.899 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-18T20:13:55.900 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-18T20:13:55.900 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-18T20:13:55.900 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-18T20:13:55.900 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-18T20:13:55.900 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-18T20:13:55.901 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-18T20:13:55.901 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-18T20:13:55.901 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-18T20:13:55.901 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-18T20:13:55.901 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-18T20:13:55.901 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-18T20:13:55.902 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-18T20:13:55.902 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-18T20:13:55.902 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-18T20:13:55.902 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-18T20:13:55.902 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-18T20:13:55.902 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-18T20:13:55.903 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-18T20:13:55.903 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-18T20:13:55.903 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-18T20:13:55.903 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-18T20:13:55.903 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-18T20:13:55.903 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-18T20:13:55.903 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-18T20:13:55.904 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-18T20:13:55.904 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-18T20:13:55.904 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-18T20:13:55.905 DEBUG:teuthology.orchestra.run.smithi008:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-18T20:13:55.935 INFO:teuthology.orchestra.run.smithi008.stdout:postinstall scriptlet (using /bin/sh): 2023-10-18T20:13:55.935 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-18T20:13:55.936 INFO:teuthology.orchestra.run.smithi008.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-18T20:13:55.936 INFO:teuthology.orchestra.run.smithi008.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T20:13:55.936 INFO:teuthology.orchestra.run.smithi008.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T20:13:55.936 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T20:13:55.936 INFO:teuthology.orchestra.run.smithi008.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T20:13:55.937 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-10-18T20:13:55.937 INFO:teuthology.orchestra.run.smithi008.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-18T20:13:55.937 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-18T20:13:55.937 INFO:teuthology.orchestra.run.smithi008.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-18T20:13:55.937 INFO:teuthology.orchestra.run.smithi008.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-18T20:13:55.938 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-18T20:13:55.938 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-10-18T20:13:55.938 INFO:teuthology.orchestra.run.smithi008.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-18T20:13:55.938 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-18T20:13:55.938 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-18T20:13:55.939 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-10-18T20:13:55.940 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2023-10-18T20:13:56.020 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2023-10-18T20:13:56.021 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2023-10-18T20:13:56.021 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.02 2023-10-18T20:13:56.021 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 129.el8 2023-10-18T20:13:56.022 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2023-10-18T20:13:56.022 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-18T20:13:56.022 INFO:teuthology.orchestra.run.smithi008.stdout:Group : System Environment/Base 2023-10-18T20:13:56.022 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 9265586 2023-10-18T20:13:56.022 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2023-10-18T20:13:56.023 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-18T20:13:56.023 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-18T20:13:56.023 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-18T20:13:56.023 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-18T20:13:56.023 INFO:teuthology.orchestra.run.smithi008.stdout:Relocations : (not relocatable) 2023-10-18T20:13:56.024 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : CentOS BuildSystem 2023-10-18T20:13:56.024 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : CentOS 2023-10-18T20:13:56.024 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-18T20:13:56.024 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2023-10-18T20:13:56.024 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2023-10-18T20:13:56.025 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:13:56.025 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-18T20:13:56.025 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-18T20:13:56.025 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-18T20:13:56.025 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2023-10-18T20:13:56.025 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:13:56.026 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2023-10-18T20:13:56.027 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-18T20:13:56.027 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 6.6.0-rc5-g47672119149b 2023-10-18T20:13:56.027 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-18T20:13:59.588 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-10-18T20:13:59.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-18T20:13:59.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T20:14:00.914 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2023-10-18T20:14:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:done 2023-10-18T20:14:03.071 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-10-18T20:14:03.097 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.TVd1hScSSV 2023-10-18T20:14:03.097 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TVd1hScSSV 2023-10-18T20:14:03.170 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.TVd1hScSSV 2023-10-18T20:14:03.439 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.TVd1hScSSV is 6KB 2023-10-18T20:14:03.488 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.TVd1hScSSV 2023-10-18T20:14:03.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2023-10-18T20:14:03.573 INFO:teuthology.orchestra.run.smithi008.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-18T20:14:03.573 INFO:teuthology.orchestra.run.smithi008.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-18T20:14:03.573 INFO:teuthology.orchestra.run.smithi008.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-18T20:14:03.573 INFO:teuthology.orchestra.run.smithi008.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-rc5-g47672119149b.conf 2023-10-18T20:14:03.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-rc5-g47672119149b 2023-10-18T20:14:03.812 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2023-10-18T20:14:33.817 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-10-18T20:14:33.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-18T20:14:33.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T20:14:59.614 DEBUG:teuthology.orchestra.remote:timed out 2023-10-18T20:15:08.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-18T20:15:08.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T20:15:08.902 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-10-18T20:15:09.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-18T20:15:09.311 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.6.0-rc5-g47672119149b"... 2023-10-18T20:15:09.311 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2023-10-18T20:15:09.357 INFO:teuthology.orchestra.run.smithi060.stdout:6.6.0-rc5-g47672119149b 2023-10-18T20:15:09.358 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-18T20:15:09.358 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-18T20:15:09.358 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-18T20:15:10.360 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-10-18T20:15:10.360 DEBUG:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-18T20:15:10.470 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2023-10-18T20:15:10.494 DEBUG:teuthology.parallel:result is None 2023-10-18T20:15:33.820 DEBUG:teuthology.orchestra.remote:timed out 2023-10-18T20:15:42.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-18T20:15:42.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T20:15:46.282 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-18T20:15:46.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-18T20:15:46.665 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.6.0-rc5-g47672119149b"... 2023-10-18T20:15:46.666 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-18T20:15:46.711 INFO:teuthology.orchestra.run.smithi008.stdout:6.6.0-rc5-g47672119149b 2023-10-18T20:15:46.712 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-18T20:15:46.712 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-18T20:15:46.712 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-18T20:15:47.713 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-10-18T20:15:47.713 DEBUG:teuthology.orchestra.run.smithi008:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-18T20:15:47.825 INFO:teuthology.orchestra.run.smithi008.stdout:ttyS1 2023-10-18T20:15:47.847 DEBUG:teuthology.parallel:result is None 2023-10-18T20:15:47.848 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-18T20:15:47.856 INFO:teuthology.task.internal:Creating test directory... 2023-10-18T20:15:47.857 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T20:15:47.861 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T20:15:47.913 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-18T20:15:47.919 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-18T20:15:48.096 INFO:teuthology.task.internal:Creating archive directory... 2023-10-18T20:15:48.097 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T20:15:48.101 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T20:15:48.162 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-18T20:15:48.169 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-18T20:15:48.169 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T20:15:48.173 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T20:15:48.248 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T20:15:48.260 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T20:15:48.276 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T20:15:48.288 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T20:15:48.291 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-18T20:15:48.298 INFO:teuthology.task.internal:Configuring sudo... 2023-10-18T20:15:48.299 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T20:15:48.303 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T20:15:48.377 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-18T20:15:48.386 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-18T20:15:48.387 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T20:15:48.391 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T20:15:48.437 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T20:15:48.547 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T20:15:48.618 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T20:15:48.689 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T20:15:48.760 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:15:48.760 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T20:15:48.831 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T20:15:48.904 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T20:15:48.983 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T20:15:49.055 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T20:15:49.127 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:15:49.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T20:15:49.198 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-10-18T20:15:49.203 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2023-10-18T20:15:49.315 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T20:15:49.371 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T20:15:49.767 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-18T20:15:49.775 INFO:teuthology.task.internal:Starting timer... 2023-10-18T20:15:49.776 INFO:teuthology.run_tasks:Running task pcp... 2023-10-18T20:15:49.785 INFO:teuthology.run_tasks:Running task selinux... 2023-10-18T20:15:49.794 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-18T20:15:49.795 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-10-18T20:15:49.921 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2023-10-18T20:15:49.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2023-10-18T20:15:50.068 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2023-10-18T20:15:50.071 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-18T20:15:50.072 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-10-18T20:15:50.159 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-10-18T20:15:50.160 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2023-10-18T20:15:50.216 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2023-10-18T20:15:50.217 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi060.front.sepia.ceph.com': 'permissive'} 2023-10-18T20:15:50.217 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T20:15:50.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T20:15:50.291 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T20:15:50.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T20:15:50.364 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-18T20:15:50.364 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-10-18T20:15:50.435 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2023-10-18T20:15:50.506 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-18T20:15:50.516 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-18T20:15:50.517 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-18T20:15:50.533 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-18T20:15:50.534 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi060.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-18T20:45:40.511 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi060.front.sepia.ceph.com')] 2023-10-18T20:45:40.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-18T20:45:40.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T20:45:40.607 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-18T20:45:40.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-18T20:45:40.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-18T20:45:40.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T20:45:40.826 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-10-18T20:45:40.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-18T20:45:40.947 INFO:teuthology.run_tasks:Running task clock... 2023-10-18T20:45:40.962 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-18T20:45:40.962 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T20:45:40.963 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T20:45:40.968 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T20:45:40.968 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T20:45:41.044 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-18T20:45:41.048 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-18T20:45:41.079 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-18T20:45:41.082 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-18T20:45:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2023-10-18T20:45:41.177 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-10-18T20:45:41.205 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2023-10-18T20:45:41.206 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-10-18T20:45:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-18T20:45:41.241 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-18T20:45:41.272 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-18T20:45:41.274 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-18T20:45:41.372 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-10-18T20:45:41.373 INFO:teuthology.orchestra.run.smithi060.stderr:bash: ntpq: command not found 2023-10-18T20:45:41.379 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T20:45:41.379 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-18T20:45:41.380 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T20:45:41.380 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T20:45:41.380 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T20:45:41.380 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T20:45:41.382 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T20:45:41.382 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2023-10-18T20:45:41.382 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T20:45:41.383 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T20:45:41.383 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T20:45:41.383 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T20:45:41.384 INFO:teuthology.run_tasks:Running task pexec... 2023-10-18T20:45:41.407 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-18T20:45:41.408 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:45:41.408 DEBUG:teuthology.orchestra.run.smithi008:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-18T20:45:41.408 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi060.front.sepia.ceph.com 2023-10-18T20:45:41.409 DEBUG:teuthology.orchestra.run.smithi060:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-18T20:45:42.521 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:03 ago on Wed 18 Oct 2023 08:43:39 PM UTC. 2023-10-18T20:45:42.525 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:02 ago on Wed 18 Oct 2023 08:43:40 PM UTC. 2023-10-18T20:45:44.790 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:45:44.791 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:45:44.792 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-18T20:45:44.792 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:45:44.792 INFO:teuthology.orchestra.run.smithi060.stdout:Resetting modules: 2023-10-18T20:45:44.792 INFO:teuthology.orchestra.run.smithi060.stdout: container-tools 2023-10-18T20:45:44.793 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:45:44.793 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:45:44.793 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:45:44.793 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:45:44.811 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:45:44.813 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:45:44.813 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-18T20:45:44.813 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:45:44.814 INFO:teuthology.orchestra.run.smithi008.stdout:Resetting modules: 2023-10-18T20:45:44.814 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools 2023-10-18T20:45:44.814 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:45:44.814 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:45:44.814 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:45:44.815 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:45:45.071 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:45:45.103 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:45:46.243 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:06 ago on Wed 18 Oct 2023 08:43:40 PM UTC. 2023-10-18T20:45:46.280 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:07 ago on Wed 18 Oct 2023 08:43:39 PM UTC. 2023-10-18T20:45:48.480 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:45:48.662 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:45:48.662 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-18T20:45:48.662 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:45:48.663 INFO:teuthology.orchestra.run.smithi060.stdout:Installing group/module packages: 2023-10-18T20:45:48.663 INFO:teuthology.orchestra.run.smithi060.stdout: aardvark-dns x86_64 2:1.7.0-1.module_el8+487+8e42a277 appstream 1.0 M 2023-10-18T20:45:48.663 INFO:teuthology.orchestra.run.smithi060.stdout: buildah x86_64 1:1.31.3-1.module_el8+664+4072b3ae appstream 8.8 M 2023-10-18T20:45:48.663 INFO:teuthology.orchestra.run.smithi060.stdout: cockpit-podman noarch 75-1.module_el8+664+4072b3ae appstream 739 k 2023-10-18T20:45:48.663 INFO:teuthology.orchestra.run.smithi060.stdout: crun x86_64 1.8.7-1.module_el8+661+d1afb926 appstream 239 k 2023-10-18T20:45:48.664 INFO:teuthology.orchestra.run.smithi060.stdout: netavark x86_64 2:1.7.0-1.module_el8+487+8e42a277 appstream 3.7 M 2023-10-18T20:45:48.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-podman noarch 4.6.0-1.module_el8+582+a2558ae2 appstream 177 k 2023-10-18T20:45:48.664 INFO:teuthology.orchestra.run.smithi060.stdout: skopeo x86_64 2:1.13.3-1.module_el8+664+4072b3ae appstream 8.1 M 2023-10-18T20:45:48.664 INFO:teuthology.orchestra.run.smithi060.stdout: toolbox x86_64 0.0.99.4-5.module_el8+649+e2deac1d appstream 2.5 M 2023-10-18T20:45:48.664 INFO:teuthology.orchestra.run.smithi060.stdout: udica noarch 0.2.6-20.module_el8+487+8e42a277 appstream 53 k 2023-10-18T20:45:48.665 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-18T20:45:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-10-18T20:45:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-10-18T20:45:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-10-18T20:45:48.665 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2023-10-18T20:45:48.665 INFO:teuthology.orchestra.run.smithi060.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-10-18T20:45:48.666 INFO:teuthology.orchestra.run.smithi060.stdout:Installing module profiles: 2023-10-18T20:45:48.666 INFO:teuthology.orchestra.run.smithi060.stdout: container-tools/common 2023-10-18T20:45:48.666 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:45:48.666 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling module streams: 2023-10-18T20:45:48.666 INFO:teuthology.orchestra.run.smithi060.stdout: container-tools rhel8 2023-10-18T20:45:48.667 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:45:48.667 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:45:48.667 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:45:48.667 INFO:teuthology.orchestra.run.smithi060.stdout:Install 13 Packages 2023-10-18T20:45:48.667 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:45:48.668 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 26 M 2023-10-18T20:45:48.668 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 87 M 2023-10-18T20:45:48.668 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:45:48.700 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:45:48.881 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:45:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-18T20:45:48.882 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:45:48.882 INFO:teuthology.orchestra.run.smithi008.stdout:Installing group/module packages: 2023-10-18T20:45:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: aardvark-dns x86_64 2:1.7.0-1.module_el8+487+8e42a277 appstream 1.0 M 2023-10-18T20:45:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: buildah x86_64 1:1.31.3-1.module_el8+664+4072b3ae appstream 8.8 M 2023-10-18T20:45:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: cockpit-podman noarch 75-1.module_el8+664+4072b3ae appstream 739 k 2023-10-18T20:45:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: crun x86_64 1.8.7-1.module_el8+661+d1afb926 appstream 239 k 2023-10-18T20:45:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: netavark x86_64 2:1.7.0-1.module_el8+487+8e42a277 appstream 3.7 M 2023-10-18T20:45:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: python3-podman noarch 4.6.0-1.module_el8+582+a2558ae2 appstream 177 k 2023-10-18T20:45:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: skopeo x86_64 2:1.13.3-1.module_el8+664+4072b3ae appstream 8.1 M 2023-10-18T20:45:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: toolbox x86_64 0.0.99.4-5.module_el8+649+e2deac1d appstream 2.5 M 2023-10-18T20:45:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: udica noarch 0.2.6-20.module_el8+487+8e42a277 appstream 53 k 2023-10-18T20:45:48.884 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-18T20:45:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-10-18T20:45:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-10-18T20:45:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-10-18T20:45:48.885 INFO:teuthology.orchestra.run.smithi008.stdout:Installing weak dependencies: 2023-10-18T20:45:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-10-18T20:45:48.885 INFO:teuthology.orchestra.run.smithi008.stdout:Installing module profiles: 2023-10-18T20:45:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools/common 2023-10-18T20:45:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:45:48.886 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling module streams: 2023-10-18T20:45:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools rhel8 2023-10-18T20:45:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:45:48.886 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:45:48.887 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:45:48.887 INFO:teuthology.orchestra.run.smithi008.stdout:Install 13 Packages 2023-10-18T20:45:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:45:48.888 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 26 M 2023-10-18T20:45:48.888 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 87 M 2023-10-18T20:45:48.888 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:45:49.242 INFO:teuthology.orchestra.run.smithi060.stdout:(1/13): aardvark-dns-1.7.0-1.module_el8+487+8e4 2.0 MB/s | 1.0 MB 00:00 2023-10-18T20:45:49.284 INFO:teuthology.orchestra.run.smithi060.stdout:(2/13): cockpit-podman-75-1.module_el8+664+4072 1.3 MB/s | 739 kB 00:00 2023-10-18T20:45:49.326 INFO:teuthology.orchestra.run.smithi060.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 454 kB/s | 38 kB 00:00 2023-10-18T20:45:49.385 INFO:teuthology.orchestra.run.smithi060.stdout:(4/13): crun-1.8.7-1.module_el8+661+d1afb926.x8 2.3 MB/s | 239 kB 00:00 2023-10-18T20:45:49.610 INFO:teuthology.orchestra.run.smithi008.stdout:(1/13): cockpit-podman-75-1.module_el8+664+4072 1.5 MB/s | 739 kB 00:00 2023-10-18T20:45:49.652 INFO:teuthology.orchestra.run.smithi008.stdout:(2/13): aardvark-dns-1.7.0-1.module_el8+487+8e4 1.9 MB/s | 1.0 MB 00:00 2023-10-18T20:45:49.669 INFO:teuthology.orchestra.run.smithi060.stdout:(5/13): buildah-1.31.3-1.module_el8+664+4072b3a 9.5 MB/s | 8.8 MB 00:00 2023-10-18T20:45:49.677 INFO:teuthology.orchestra.run.smithi008.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 567 kB/s | 38 kB 00:00 2023-10-18T20:45:49.685 INFO:teuthology.orchestra.run.smithi060.stdout:(6/13): python3-podman-4.6.0-1.module_el8+582+a 591 kB/s | 177 kB 00:00 2023-10-18T20:45:49.744 INFO:teuthology.orchestra.run.smithi008.stdout:(4/13): crun-1.8.7-1.module_el8+661+d1afb926.x8 2.5 MB/s | 239 kB 00:00 2023-10-18T20:45:49.745 INFO:teuthology.orchestra.run.smithi060.stdout:(7/13): netavark-1.7.0-1.module_el8+487+8e42a27 9.0 MB/s | 3.7 MB 00:00 2023-10-18T20:45:49.778 INFO:teuthology.orchestra.run.smithi060.stdout:(8/13): python3-pytoml-0.1.14-5.git7dea353.el8. 228 kB/s | 25 kB 00:00 2023-10-18T20:45:49.795 INFO:teuthology.orchestra.run.smithi060.stdout:(9/13): python3-pyxdg-0.25-16.el8.noarch.rpm 863 kB/s | 94 kB 00:00 2023-10-18T20:45:49.853 INFO:teuthology.orchestra.run.smithi008.stdout:(5/13): python3-podman-4.6.0-1.module_el8+582+a 1.6 MB/s | 177 kB 00:00 2023-10-18T20:45:49.920 INFO:teuthology.orchestra.run.smithi060.stdout:(10/13): udica-0.2.6-20.module_el8+487+8e42a277 421 kB/s | 53 kB 00:00 2023-10-18T20:45:49.953 INFO:teuthology.orchestra.run.smithi008.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 248 kB/s | 25 kB 00:00 2023-10-18T20:45:50.045 INFO:teuthology.orchestra.run.smithi008.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.0 MB/s | 94 kB 00:00 2023-10-18T20:45:50.129 INFO:teuthology.orchestra.run.smithi060.stdout:(11/13): toolbox-0.0.99.4-5.module_el8+649+e2de 7.2 MB/s | 2.5 MB 00:00 2023-10-18T20:45:50.154 INFO:teuthology.orchestra.run.smithi060.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 175 kB/s | 41 kB 00:00 2023-10-18T20:45:50.254 INFO:teuthology.orchestra.run.smithi008.stdout:(8/13): buildah-1.31.3-1.module_el8+664+4072b3a 7.8 MB/s | 8.8 MB 00:01 2023-10-18T20:45:50.329 INFO:teuthology.orchestra.run.smithi008.stdout:(9/13): netavark-1.7.0-1.module_el8+487+8e42a27 5.8 MB/s | 3.7 MB 00:00 2023-10-18T20:45:50.429 INFO:teuthology.orchestra.run.smithi008.stdout:(10/13): udica-0.2.6-20.module_el8+487+8e42a277 527 kB/s | 53 kB 00:00 2023-10-18T20:45:50.438 INFO:teuthology.orchestra.run.smithi060.stdout:(13/13): skopeo-1.13.3-1.module_el8+664+4072b3a 12 MB/s | 8.1 MB 00:00 2023-10-18T20:45:50.439 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:45:50.439 INFO:teuthology.orchestra.run.smithi060.stdout:Total 14 MB/s | 26 MB 00:01 2023-10-18T20:45:50.496 INFO:teuthology.orchestra.run.smithi008.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 617 kB/s | 41 kB 00:00 2023-10-18T20:45:50.546 INFO:teuthology.orchestra.run.smithi008.stdout:(12/13): toolbox-0.0.99.4-5.module_el8+649+e2de 8.7 MB/s | 2.5 MB 00:00 2023-10-18T20:45:50.688 INFO:teuthology.orchestra.run.smithi008.stdout:(13/13): skopeo-1.13.3-1.module_el8+664+4072b3a 13 MB/s | 8.1 MB 00:00 2023-10-18T20:45:50.689 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:45:50.689 INFO:teuthology.orchestra.run.smithi008.stdout:Total 14 MB/s | 26 MB 00:01 2023-10-18T20:45:50.880 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:45:50.907 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:45:50.907 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:45:51.132 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:45:51.160 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:45:51.160 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:45:51.182 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:45:51.186 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:45:51.537 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:45:51.541 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:45:51.880 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:45:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-10-18T20:45:52.278 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-10-18T20:45:52.280 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:45:52.467 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-10-18T20:45:52.507 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-10-18T20:45:52.673 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-10-18T20:45:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-10-18T20:45:52.851 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-10-18T20:45:53.110 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-10-18T20:45:53.281 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : aardvark-dns-2:1.7.0-1.module_el8+487+8e42a277.x86 5/13 2023-10-18T20:45:53.672 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : aardvark-dns-2:1.7.0-1.module_el8+487+8e42a277.x86 5/13 2023-10-18T20:45:54.288 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : netavark-2:1.7.0-1.module_el8+487+8e42a277.x86_64 6/13 2023-10-18T20:45:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : buildah-1:1.31.3-1.module_el8+664+4072b3ae.x86_64 7/13 2023-10-18T20:45:54.688 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : netavark-2:1.7.0-1.module_el8+487+8e42a277.x86_64 6/13 2023-10-18T20:45:54.775 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : crun-1.8.7-1.module_el8+661+d1afb926.x86_64 8/13 2023-10-18T20:45:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : buildah-1:1.31.3-1.module_el8+664+4072b3ae.x86_64 7/13 2023-10-18T20:45:55.008 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-podman-4.6.0-1.module_el8+582+a2558ae2.noa 9/13 2023-10-18T20:45:55.216 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : crun-1.8.7-1.module_el8+661+d1afb926.x86_64 8/13 2023-10-18T20:45:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : udica-0.2.6-20.module_el8+487+8e42a277.noarch 10/13 2023-10-18T20:45:55.445 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-podman-4.6.0-1.module_el8+582+a2558ae2.noa 9/13 2023-10-18T20:45:55.870 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : udica-0.2.6-20.module_el8+487+8e42a277.noarch 10/13 2023-10-18T20:45:56.497 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : toolbox-0.0.99.4-5.module_el8+649+e2deac1d.x86_64 11/13 2023-10-18T20:45:56.705 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : skopeo-2:1.13.3-1.module_el8+664+4072b3ae.x86_64 12/13 2023-10-18T20:45:56.851 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : toolbox-0.0.99.4-5.module_el8+649+e2deac1d.x86_64 11/13 2023-10-18T20:45:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cockpit-podman-75-1.module_el8+664+4072b3ae.noarch 13/13 2023-10-18T20:45:57.089 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : skopeo-2:1.13.3-1.module_el8+664+4072b3ae.x86_64 12/13 2023-10-18T20:45:57.287 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cockpit-podman-75-1.module_el8+664+4072b3ae.noarch 13/13 2023-10-18T20:45:57.598 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cockpit-podman-75-1.module_el8+664+4072b3ae.noarch 13/13 2023-10-18T20:45:57.598 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : aardvark-dns-2:1.7.0-1.module_el8+487+8e42a277.x86 1/13 2023-10-18T20:45:57.598 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : buildah-1:1.31.3-1.module_el8+664+4072b3ae.x86_64 2/13 2023-10-18T20:45:57.598 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cockpit-podman-75-1.module_el8+664+4072b3ae.noarch 3/13 2023-10-18T20:45:57.599 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-10-18T20:45:57.599 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : crun-1.8.7-1.module_el8+661+d1afb926.x86_64 5/13 2023-10-18T20:45:57.599 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : netavark-2:1.7.0-1.module_el8+487+8e42a277.x86_64 6/13 2023-10-18T20:45:57.599 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-podman-4.6.0-1.module_el8+582+a2558ae2.noa 7/13 2023-10-18T20:45:57.599 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-10-18T20:45:57.599 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-10-18T20:45:57.600 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+664+4072b3ae.x86_64 10/13 2023-10-18T20:45:57.600 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : toolbox-0.0.99.4-5.module_el8+649+e2deac1d.x86_64 11/13 2023-10-18T20:45:57.600 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : udica-0.2.6-20.module_el8+487+8e42a277.noarch 12/13 2023-10-18T20:45:57.956 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cockpit-podman-75-1.module_el8+664+4072b3ae.noarch 13/13 2023-10-18T20:45:57.956 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : aardvark-dns-2:1.7.0-1.module_el8+487+8e42a277.x86 1/13 2023-10-18T20:45:57.956 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : buildah-1:1.31.3-1.module_el8+664+4072b3ae.x86_64 2/13 2023-10-18T20:45:57.956 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cockpit-podman-75-1.module_el8+664+4072b3ae.noarch 3/13 2023-10-18T20:45:57.957 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-10-18T20:45:57.957 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : crun-1.8.7-1.module_el8+661+d1afb926.x86_64 5/13 2023-10-18T20:45:57.957 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : netavark-2:1.7.0-1.module_el8+487+8e42a277.x86_64 6/13 2023-10-18T20:45:57.957 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-podman-4.6.0-1.module_el8+582+a2558ae2.noa 7/13 2023-10-18T20:45:57.957 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-10-18T20:45:57.958 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-10-18T20:45:57.958 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+664+4072b3ae.x86_64 10/13 2023-10-18T20:45:57.958 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : toolbox-0.0.99.4-5.module_el8+649+e2deac1d.x86_64 11/13 2023-10-18T20:45:57.958 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : udica-0.2.6-20.module_el8+487+8e42a277.noarch 12/13 2023-10-18T20:45:58.401 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-10-18T20:45:58.401 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:45:58.401 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:45:58.401 INFO:teuthology.orchestra.run.smithi060.stdout: aardvark-dns-2:1.7.0-1.module_el8+487+8e42a277.x86_64 2023-10-18T20:45:58.401 INFO:teuthology.orchestra.run.smithi060.stdout: buildah-1:1.31.3-1.module_el8+664+4072b3ae.x86_64 2023-10-18T20:45:58.402 INFO:teuthology.orchestra.run.smithi060.stdout: cockpit-podman-75-1.module_el8+664+4072b3ae.noarch 2023-10-18T20:45:58.402 INFO:teuthology.orchestra.run.smithi060.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-10-18T20:45:58.402 INFO:teuthology.orchestra.run.smithi060.stdout: crun-1.8.7-1.module_el8+661+d1afb926.x86_64 2023-10-18T20:45:58.402 INFO:teuthology.orchestra.run.smithi060.stdout: netavark-2:1.7.0-1.module_el8+487+8e42a277.x86_64 2023-10-18T20:45:58.402 INFO:teuthology.orchestra.run.smithi060.stdout: python3-podman-4.6.0-1.module_el8+582+a2558ae2.noarch 2023-10-18T20:45:58.403 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-18T20:45:58.403 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-18T20:45:58.403 INFO:teuthology.orchestra.run.smithi060.stdout: skopeo-2:1.13.3-1.module_el8+664+4072b3ae.x86_64 2023-10-18T20:45:58.403 INFO:teuthology.orchestra.run.smithi060.stdout: toolbox-0.0.99.4-5.module_el8+649+e2deac1d.x86_64 2023-10-18T20:45:58.403 INFO:teuthology.orchestra.run.smithi060.stdout: udica-0.2.6-20.module_el8+487+8e42a277.noarch 2023-10-18T20:45:58.404 INFO:teuthology.orchestra.run.smithi060.stdout: yajl-2.1.0-12.el8.x86_64 2023-10-18T20:45:58.404 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:45:58.404 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:45:58.642 DEBUG:teuthology.parallel:result is None 2023-10-18T20:45:58.808 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-10-18T20:45:58.808 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:45:58.808 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:45:58.808 INFO:teuthology.orchestra.run.smithi008.stdout: aardvark-dns-2:1.7.0-1.module_el8+487+8e42a277.x86_64 2023-10-18T20:45:58.809 INFO:teuthology.orchestra.run.smithi008.stdout: buildah-1:1.31.3-1.module_el8+664+4072b3ae.x86_64 2023-10-18T20:45:58.809 INFO:teuthology.orchestra.run.smithi008.stdout: cockpit-podman-75-1.module_el8+664+4072b3ae.noarch 2023-10-18T20:45:58.809 INFO:teuthology.orchestra.run.smithi008.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-10-18T20:45:58.809 INFO:teuthology.orchestra.run.smithi008.stdout: crun-1.8.7-1.module_el8+661+d1afb926.x86_64 2023-10-18T20:45:58.809 INFO:teuthology.orchestra.run.smithi008.stdout: netavark-2:1.7.0-1.module_el8+487+8e42a277.x86_64 2023-10-18T20:45:58.810 INFO:teuthology.orchestra.run.smithi008.stdout: python3-podman-4.6.0-1.module_el8+582+a2558ae2.noarch 2023-10-18T20:45:58.810 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-18T20:45:58.810 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-18T20:45:58.810 INFO:teuthology.orchestra.run.smithi008.stdout: skopeo-2:1.13.3-1.module_el8+664+4072b3ae.x86_64 2023-10-18T20:45:58.810 INFO:teuthology.orchestra.run.smithi008.stdout: toolbox-0.0.99.4-5.module_el8+649+e2deac1d.x86_64 2023-10-18T20:45:58.811 INFO:teuthology.orchestra.run.smithi008.stdout: udica-0.2.6-20.module_el8+487+8e42a277.noarch 2023-10-18T20:45:58.811 INFO:teuthology.orchestra.run.smithi008.stdout: yajl-2.1.0-12.el8.x86_64 2023-10-18T20:45:58.811 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:45:58.811 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:45:59.024 DEBUG:teuthology.parallel:result is None 2023-10-18T20:45:59.025 INFO:teuthology.run_tasks:Running task pexec... 2023-10-18T20:45:59.034 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-18T20:45:59.034 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:45:59.035 DEBUG:teuthology.orchestra.run.smithi008:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-18T20:45:59.035 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi060.front.sepia.ceph.com 2023-10-18T20:45:59.036 DEBUG:teuthology.orchestra.run.smithi060:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-18T20:45:59.630 DEBUG:teuthology.parallel:result is None 2023-10-18T20:45:59.867 DEBUG:teuthology.parallel:result is None 2023-10-18T20:45:59.867 INFO:teuthology.run_tasks:Running task install... 2023-10-18T20:45:59.876 DEBUG:teuthology.task.install:project ceph 2023-10-18T20:45:59.876 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}} 2023-10-18T20:45:59.877 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v16.2.4', 'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'} 2023-10-18T20:45:59.877 INFO:teuthology.task.install:Using flavor: default 2023-10-18T20:45:59.882 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-18T20:45:59.883 INFO:teuthology.task.install:extra packages: [] 2023-10-18T20:45:59.883 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5', 'tag': 'v16.2.4', 'wait_for_package': False} 2023-10-18T20:45:59.884 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-10-18T20:45:59.884 INFO:teuthology.packaging:ref: None 2023-10-18T20:45:59.885 INFO:teuthology.packaging:tag: v16.2.4 2023-10-18T20:45:59.885 INFO:teuthology.packaging:branch: None 2023-10-18T20:45:59.885 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:46:00.122 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-10-18T20:46:00.123 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-10-18T20:46:00.126 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5', 'tag': 'v16.2.4', 'wait_for_package': False} 2023-10-18T20:46:00.126 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-10-18T20:46:00.126 INFO:teuthology.packaging:ref: None 2023-10-18T20:46:00.127 INFO:teuthology.packaging:tag: v16.2.4 2023-10-18T20:46:00.127 INFO:teuthology.packaging:branch: None 2023-10-18T20:46:00.127 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:46:00.315 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-10-18T20:46:00.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-10-18T20:46:00.476 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2023-10-18T20:46:00.477 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2023-10-18T20:46:00.507 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T20:46:00.508 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:46:00.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T20:46:00.544 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2023-10-18T20:46:00.544 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2023-10-18T20:46:00.568 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T20:46:00.569 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:46:00.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T20:46:00.588 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-18T20:46:00.588 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-10-18T20:46:00.588 INFO:teuthology.packaging:ref: None 2023-10-18T20:46:00.589 INFO:teuthology.packaging:tag: v16.2.4 2023-10-18T20:46:00.589 INFO:teuthology.packaging:branch: None 2023-10-18T20:46:00.589 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:46:00.589 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T20:46:00.649 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-18T20:46:00.649 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-10-18T20:46:00.649 INFO:teuthology.packaging:ref: None 2023-10-18T20:46:00.650 INFO:teuthology.packaging:tag: v16.2.4 2023-10-18T20:46:00.650 INFO:teuthology.packaging:branch: None 2023-10-18T20:46:00.650 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:46:00.650 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T20:46:00.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T20:46:00.765 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T20:46:00.801 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T20:46:00.864 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T20:46:00.871 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2023-10-18T20:46:00.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2023-10-18T20:46:00.936 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-10-18T20:46:00.939 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-10-18T20:46:01.250 INFO:teuthology.orchestra.run.smithi060.stdout:76 files removed 2023-10-18T20:46:01.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw 2023-10-18T20:46:01.315 INFO:teuthology.orchestra.run.smithi008.stdout:76 files removed 2023-10-18T20:46:01.352 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw 2023-10-18T20:46:01.938 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 965 kB/s | 74 kB 00:00 2023-10-18T20:46:02.014 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 846 kB/s | 74 kB 00:00 2023-10-18T20:46:02.063 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 177 kB/s | 15 kB 00:00 2023-10-18T20:46:02.131 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 197 kB/s | 15 kB 00:00 2023-10-18T20:46:02.173 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 22 kB/s | 1.7 kB 00:00 2023-10-18T20:46:02.249 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 20 kB/s | 1.7 kB 00:00 2023-10-18T20:46:04.083 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - AppStream 19 MB/s | 33 MB 00:01 2023-10-18T20:46:04.631 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - AppStream 14 MB/s | 33 MB 00:02 2023-10-18T20:46:13.249 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - BaseOS 36 MB/s | 50 MB 00:01 2023-10-18T20:46:13.933 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 50 MB 00:02 2023-10-18T20:46:21.882 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - Extras 37 kB/s | 18 kB 00:00 2023-10-18T20:46:22.583 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.9 kB 00:00 2023-10-18T20:46:22.908 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-10-18T20:46:23.492 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-10-18T20:46:23.626 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - PowerTools 7.4 MB/s | 6.5 MB 00:00 2023-10-18T20:46:25.335 INFO:teuthology.orchestra.run.smithi060.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-10-18T20:46:25.668 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - PowerTools 3.2 MB/s | 6.5 MB 00:02 2023-10-18T20:46:26.962 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-18T20:46:27.762 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 7.6 kB/s | 3.5 kB 00:00 2023-10-18T20:46:29.660 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 16 MB 00:01 2023-10-18T20:46:31.754 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 401 kB/s | 24 kB 00:00 2023-10-18T20:46:34.555 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 503 kB/s | 24 kB 00:00 2023-10-18T20:46:36.614 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:46:36.617 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:46:36.618 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-18T20:46:36.618 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:46:36.618 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:46:36.618 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2023-10-18T20:46:36.619 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2023-10-18T20:46:36.619 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2023-10-18T20:46:36.619 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2023-10-18T20:46:36.619 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-18T20:46:36.620 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2023-10-18T20:46:36.620 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2023-10-18T20:46:36.620 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2023-10-18T20:46:36.620 INFO:teuthology.orchestra.run.smithi060.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-10-18T20:46:36.620 INFO:teuthology.orchestra.run.smithi060.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2023-10-18T20:46:36.620 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-18T20:46:36.621 INFO:teuthology.orchestra.run.smithi060.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-18T20:46:36.621 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2023-10-18T20:46:36.621 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-18T20:46:36.621 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.6.1-1.el8 appstream 145 k 2023-10-18T20:46:36.621 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-18T20:46:36.622 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2023-10-18T20:46:36.622 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-18T20:46:36.622 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2023-10-18T20:46:36.622 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-18T20:46:36.622 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-18T20:46:36.623 INFO:teuthology.orchestra.run.smithi060.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-10-18T20:46:36.623 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2023-10-18T20:46:36.623 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2023-10-18T20:46:36.623 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2023-10-18T20:46:36.623 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-18T20:46:36.624 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2023-10-18T20:46:36.624 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2023-10-18T20:46:36.624 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2023-10-18T20:46:36.624 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:46:36.624 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:46:36.624 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:46:36.625 INFO:teuthology.orchestra.run.smithi060.stdout:Install 25 Packages 2023-10-18T20:46:36.625 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 2 Packages 2023-10-18T20:46:36.625 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:46:36.626 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 59 M 2023-10-18T20:46:36.626 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:46:37.480 INFO:teuthology.orchestra.run.smithi060.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 31 MB/s | 6.0 MB 00:00 2023-10-18T20:46:37.505 INFO:teuthology.orchestra.run.smithi060.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2023-10-18T20:46:37.547 INFO:teuthology.orchestra.run.smithi060.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 19 MB/s | 801 kB 00:00 2023-10-18T20:46:37.581 INFO:teuthology.orchestra.run.smithi060.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 14 MB/s | 486 kB 00:00 2023-10-18T20:46:37.706 INFO:teuthology.orchestra.run.smithi060.stdout:(5/27): librgw2-16.2.4-0.el8.x86_64.rpm 33 MB/s | 4.1 MB 00:00 2023-10-18T20:46:37.723 INFO:teuthology.orchestra.run.smithi060.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 2.6 MB/s | 44 kB 00:00 2023-10-18T20:46:37.748 INFO:teuthology.orchestra.run.smithi060.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 3.1 MB/s | 80 kB 00:00 2023-10-18T20:46:37.774 INFO:teuthology.orchestra.run.smithi060.stdout:(8/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 8.3 MB/s | 213 kB 00:00 2023-10-18T20:46:37.808 INFO:teuthology.orchestra.run.smithi060.stdout:(9/27): python3-rados-16.2.4-0.el8.x86_64.rpm 11 MB/s | 387 kB 00:00 2023-10-18T20:46:37.841 INFO:teuthology.orchestra.run.smithi060.stdout:(10/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 11 MB/s | 368 kB 00:00 2023-10-18T20:46:37.866 INFO:teuthology.orchestra.run.smithi060.stdout:(11/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2023-10-18T20:46:38.025 INFO:teuthology.orchestra.run.smithi060.stdout:(12/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 17 MB/s | 13 MB 00:00 2023-10-18T20:46:38.351 INFO:teuthology.orchestra.run.smithi060.stdout:(13/27): ceph-common-16.2.4-0.el8.x86_64.rpm 23 MB/s | 24 MB 00:01 2023-10-18T20:46:38.534 INFO:teuthology.orchestra.run.smithi060.stdout:(14/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 218 kB/s | 145 kB 00:00 2023-10-18T20:46:38.684 INFO:teuthology.orchestra.run.smithi060.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 293 kB/s | 44 kB 00:00 2023-10-18T20:46:38.726 INFO:teuthology.orchestra.run.smithi060.stdout:(16/27): librdkafka-0.11.4-3.el8.x86_64.rpm 505 kB/s | 354 kB 00:00 2023-10-18T20:46:38.768 INFO:teuthology.orchestra.run.smithi060.stdout:(17/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 622 kB/s | 259 kB 00:00 2023-10-18T20:46:38.802 INFO:teuthology.orchestra.run.smithi060.stdout:(18/27): daxctl-libs-71.1-7.el8.x86_64.rpm 360 kB/s | 42 kB 00:00 2023-10-18T20:46:38.827 INFO:teuthology.orchestra.run.smithi060.stdout:(19/27): librabbitmq-0.9.0-4.el8.x86_64.rpm 466 kB/s | 47 kB 00:00 2023-10-18T20:46:38.894 INFO:teuthology.orchestra.run.smithi060.stdout:(20/27): ndctl-libs-71.1-7.el8.x86_64.rpm 639 kB/s | 80 kB 00:00 2023-10-18T20:46:39.426 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:46:39.429 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:46:39.429 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-18T20:46:39.429 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:46:39.429 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:46:39.430 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2023-10-18T20:46:39.430 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-10-18T20:46:39.430 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2023-10-18T20:46:39.430 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2023-10-18T20:46:39.431 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-18T20:46:39.431 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2023-10-18T20:46:39.431 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2023-10-18T20:46:39.431 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2023-10-18T20:46:39.431 INFO:teuthology.orchestra.run.smithi008.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-10-18T20:46:39.432 INFO:teuthology.orchestra.run.smithi008.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2023-10-18T20:46:39.432 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-18T20:46:39.432 INFO:teuthology.orchestra.run.smithi008.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-18T20:46:39.432 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2023-10-18T20:46:39.432 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-18T20:46:39.432 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj x86_64 1.6.1-1.el8 appstream 145 k 2023-10-18T20:46:39.433 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-18T20:46:39.433 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2023-10-18T20:46:39.433 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-18T20:46:39.433 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2023-10-18T20:46:39.433 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-18T20:46:39.434 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-18T20:46:39.434 INFO:teuthology.orchestra.run.smithi008.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-10-18T20:46:39.434 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2023-10-18T20:46:39.434 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2023-10-18T20:46:39.434 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2023-10-18T20:46:39.435 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-18T20:46:39.435 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2023-10-18T20:46:39.435 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2023-10-18T20:46:39.435 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2023-10-18T20:46:39.435 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:46:39.436 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:46:39.436 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:46:39.436 INFO:teuthology.orchestra.run.smithi008.stdout:Install 25 Packages 2023-10-18T20:46:39.436 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 2 Packages 2023-10-18T20:46:39.436 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:46:39.437 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 59 M 2023-10-18T20:46:39.437 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:46:39.495 INFO:teuthology.orchestra.run.smithi060.stdout:(21/27): fmt-6.2.1-1.el8.x86_64.rpm 168 kB/s | 116 kB 00:00 2023-10-18T20:46:39.512 INFO:teuthology.orchestra.run.smithi060.stdout:(22/27): leveldb-1.22-1.el8.x86_64.rpm 293 kB/s | 181 kB 00:00 2023-10-18T20:46:39.537 INFO:teuthology.orchestra.run.smithi060.stdout:(23/27): gperftools-libs-2.7-9.el8.x86_64.rpm 432 kB/s | 306 kB 00:00 2023-10-18T20:46:39.629 INFO:teuthology.orchestra.run.smithi060.stdout:(24/27): librados2-16.2.4-0.el8.x86_64.rpm 41 MB/s | 3.7 MB 00:00 2023-10-18T20:46:39.654 INFO:teuthology.orchestra.run.smithi060.stdout:(25/27): libunwind-1.3.1-3.el8.x86_64.rpm 528 kB/s | 75 kB 00:00 2023-10-18T20:46:39.755 INFO:teuthology.orchestra.run.smithi060.stdout:(26/27): librbd1-16.2.4-0.el8.x86_64.rpm 32 MB/s | 4.0 MB 00:00 2023-10-18T20:46:39.780 INFO:teuthology.orchestra.run.smithi060.stdout:(27/27): liboath-2.6.2-3.el8.x86_64.rpm 207 kB/s | 59 kB 00:00 2023-10-18T20:46:39.781 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:46:39.781 INFO:teuthology.orchestra.run.smithi060.stdout:Total 19 MB/s | 59 MB 00:03 2023-10-18T20:46:39.943 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:46:40.001 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:46:40.001 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:46:40.273 INFO:teuthology.orchestra.run.smithi008.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 31 MB/s | 6.0 MB 00:00 2023-10-18T20:46:40.289 INFO:teuthology.orchestra.run.smithi008.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2023-10-18T20:46:40.331 INFO:teuthology.orchestra.run.smithi008.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 19 MB/s | 801 kB 00:00 2023-10-18T20:46:40.365 INFO:teuthology.orchestra.run.smithi008.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 14 MB/s | 486 kB 00:00 2023-10-18T20:46:40.406 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:46:40.410 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:46:40.490 INFO:teuthology.orchestra.run.smithi008.stdout:(5/27): librgw2-16.2.4-0.el8.x86_64.rpm 33 MB/s | 4.1 MB 00:00 2023-10-18T20:46:40.516 INFO:teuthology.orchestra.run.smithi008.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 1.8 MB/s | 44 kB 00:00 2023-10-18T20:46:40.541 INFO:teuthology.orchestra.run.smithi008.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 3.1 MB/s | 80 kB 00:00 2023-10-18T20:46:40.566 INFO:teuthology.orchestra.run.smithi008.stdout:(8/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 8.4 MB/s | 213 kB 00:00 2023-10-18T20:46:40.600 INFO:teuthology.orchestra.run.smithi008.stdout:(9/27): python3-rados-16.2.4-0.el8.x86_64.rpm 11 MB/s | 387 kB 00:00 2023-10-18T20:46:40.634 INFO:teuthology.orchestra.run.smithi008.stdout:(10/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 11 MB/s | 368 kB 00:00 2023-10-18T20:46:40.659 INFO:teuthology.orchestra.run.smithi008.stdout:(11/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2023-10-18T20:46:40.810 INFO:teuthology.orchestra.run.smithi008.stdout:(12/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 17 MB/s | 13 MB 00:00 2023-10-18T20:46:41.110 INFO:teuthology.orchestra.run.smithi008.stdout:(13/27): ceph-common-16.2.4-0.el8.x86_64.rpm 23 MB/s | 24 MB 00:01 2023-10-18T20:46:41.252 INFO:teuthology.orchestra.run.smithi008.stdout:(14/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 245 kB/s | 145 kB 00:00 2023-10-18T20:46:41.377 INFO:teuthology.orchestra.run.smithi008.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 352 kB/s | 44 kB 00:00 2023-10-18T20:46:41.461 INFO:teuthology.orchestra.run.smithi008.stdout:(16/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 741 kB/s | 259 kB 00:00 2023-10-18T20:46:41.486 INFO:teuthology.orchestra.run.smithi008.stdout:(17/27): daxctl-libs-71.1-7.el8.x86_64.rpm 389 kB/s | 42 kB 00:00 2023-10-18T20:46:41.553 INFO:teuthology.orchestra.run.smithi008.stdout:(18/27): ndctl-libs-71.1-7.el8.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2023-10-18T20:46:41.558 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:46:41.578 INFO:teuthology.orchestra.run.smithi008.stdout:(19/27): librabbitmq-0.9.0-4.el8.x86_64.rpm 400 kB/s | 47 kB 00:00 2023-10-18T20:46:41.621 INFO:teuthology.orchestra.run.smithi008.stdout:(20/27): librdkafka-0.11.4-3.el8.x86_64.rpm 437 kB/s | 354 kB 00:00 2023-10-18T20:46:41.781 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2023-10-18T20:46:41.804 INFO:teuthology.orchestra.run.smithi008.stdout:(21/27): fmt-6.2.1-1.el8.x86_64.rpm 464 kB/s | 116 kB 00:00 2023-10-18T20:46:41.854 INFO:teuthology.orchestra.run.smithi008.stdout:(22/27): leveldb-1.22-1.el8.x86_64.rpm 775 kB/s | 181 kB 00:00 2023-10-18T20:46:41.879 INFO:teuthology.orchestra.run.smithi008.stdout:(23/27): liboath-2.6.2-3.el8.x86_64.rpm 784 kB/s | 59 kB 00:00 2023-10-18T20:46:41.913 INFO:teuthology.orchestra.run.smithi008.stdout:(24/27): gperftools-libs-2.7-9.el8.x86_64.rpm 916 kB/s | 306 kB 00:00 2023-10-18T20:46:41.938 INFO:teuthology.orchestra.run.smithi008.stdout:(25/27): libunwind-1.3.1-3.el8.x86_64.rpm 898 kB/s | 75 kB 00:00 2023-10-18T20:46:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2023-10-18T20:46:42.039 INFO:teuthology.orchestra.run.smithi008.stdout:(26/27): librados2-16.2.4-0.el8.x86_64.rpm 24 MB/s | 3.7 MB 00:00 2023-10-18T20:46:42.106 INFO:teuthology.orchestra.run.smithi008.stdout:(27/27): librbd1-16.2.4-0.el8.x86_64.rpm 21 MB/s | 4.0 MB 00:00 2023-10-18T20:46:42.107 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:46:42.108 INFO:teuthology.orchestra.run.smithi008.stdout:Total 22 MB/s | 59 MB 00:02 2023-10-18T20:46:42.271 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:46:42.329 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:46:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2023-10-18T20:46:42.839 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:46:42.842 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:46:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2023-10-18T20:46:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2023-10-18T20:46:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2023-10-18T20:46:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2023-10-18T20:46:43.603 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2023-10-18T20:46:43.669 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2023-10-18T20:46:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/29 2023-10-18T20:46:44.026 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:46:44.060 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/29 2023-10-18T20:46:44.231 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2023-10-18T20:46:44.449 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2023-10-18T20:46:44.552 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/29 2023-10-18T20:46:44.640 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2023-10-18T20:46:44.694 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2023-10-18T20:46:44.787 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2023-10-18T20:46:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2023-10-18T20:46:45.114 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2023-10-18T20:46:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 11/29 2023-10-18T20:46:45.209 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 11/29 2023-10-18T20:46:45.306 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2023-10-18T20:46:45.430 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2023-10-18T20:46:45.502 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2023-10-18T20:46:45.679 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2023-10-18T20:46:45.681 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2023-10-18T20:46:45.840 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2023-10-18T20:46:45.860 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 14/29 2023-10-18T20:46:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2023-10-18T20:46:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 14/29 2023-10-18T20:46:46.101 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/29 2023-10-18T20:46:46.127 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2023-10-18T20:46:46.323 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/29 2023-10-18T20:46:46.634 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2023-10-18T20:46:46.811 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/29 2023-10-18T20:46:46.843 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2023-10-18T20:46:46.939 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2023-10-18T20:46:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2023-10-18T20:46:47.038 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2023-10-18T20:46:47.133 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2023-10-18T20:46:47.212 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2023-10-18T20:46:47.373 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 11/29 2023-10-18T20:46:47.427 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2023-10-18T20:46:47.460 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 11/29 2023-10-18T20:46:47.569 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2023-10-18T20:46:47.604 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2023-10-18T20:46:47.660 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2023-10-18T20:46:47.800 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2023-10-18T20:46:47.885 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2023-10-18T20:46:48.072 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 14/29 2023-10-18T20:46:48.128 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2023-10-18T20:46:48.163 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 14/29 2023-10-18T20:46:48.303 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2023-10-18T20:46:48.314 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2023-10-18T20:46:48.527 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2023-10-18T20:46:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2023-10-18T20:46:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2023-10-18T20:46:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2023-10-18T20:46:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2023-10-18T20:46:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2023-10-18T20:46:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2023-10-18T20:46:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2023-10-18T20:46:49.980 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2023-10-18T20:46:50.199 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2023-10-18T20:46:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2023-10-18T20:46:50.581 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2023-10-18T20:46:51.521 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-10-18T20:46:51.735 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-10-18T20:46:52.595 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-10-18T20:46:53.061 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2023-10-18T20:46:53.251 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2023-10-18T20:46:53.434 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2023-10-18T20:46:53.514 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-10-18T20:46:53.706 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-10-18T20:46:54.554 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-10-18T20:46:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2023-10-18T20:46:55.069 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2023-10-18T20:46:55.258 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2023-10-18T20:47:15.003 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2023-10-18T20:47:15.003 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2023-10-18T20:47:15.003 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2023-10-18T20:47:15.003 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-10-18T20:47:15.004 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /run 2023-10-18T20:47:15.004 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2023-10-18T20:47:15.004 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2023-10-18T20:47:15.004 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2023-10-18T20:47:15.004 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2023-10-18T20:47:15.005 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-10-18T20:47:15.005 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2023-10-18T20:47:16.226 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-10-18T20:47:16.226 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-10-18T20:47:16.226 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-18T20:47:16.227 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /run 2023-10-18T20:47:16.227 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-10-18T20:47:16.227 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-10-18T20:47:16.227 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-10-18T20:47:16.228 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-10-18T20:47:16.228 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-18T20:47:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:16.500 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2023-10-18T20:47:16.609 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2023-10-18T20:47:16.610 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2023-10-18T20:47:16.846 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2023-10-18T20:47:16.847 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2023-10-18T20:47:17.783 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2023-10-18T20:47:17.822 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2023-10-18T20:47:17.822 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2023-10-18T20:47:17.823 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2023-10-18T20:47:17.823 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2023-10-18T20:47:17.823 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2023-10-18T20:47:17.823 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2023-10-18T20:47:17.823 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2023-10-18T20:47:17.824 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2023-10-18T20:47:17.824 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2023-10-18T20:47:17.824 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2023-10-18T20:47:17.824 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2023-10-18T20:47:17.824 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2023-10-18T20:47:17.825 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2023-10-18T20:47:17.825 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2023-10-18T20:47:17.825 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2023-10-18T20:47:17.825 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 15/29 2023-10-18T20:47:17.825 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2023-10-18T20:47:17.826 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2023-10-18T20:47:17.826 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 18/29 2023-10-18T20:47:17.826 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 19/29 2023-10-18T20:47:17.826 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 20/29 2023-10-18T20:47:17.827 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2023-10-18T20:47:17.827 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2023-10-18T20:47:17.827 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2023-10-18T20:47:17.827 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2023-10-18T20:47:17.827 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2023-10-18T20:47:17.827 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2023-10-18T20:47:17.828 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2023-10-18T20:47:17.828 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2023-10-18T20:47:17.892 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2023-10-18T20:47:17.892 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2023-10-18T20:47:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2023-10-18T20:47:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2023-10-18T20:47:18.799 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2023-10-18T20:47:18.800 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:18.800 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2023-10-18T20:47:18.800 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.800 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:47:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: daxctl-libs-71.1-7.el8.x86_64 2023-10-18T20:47:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: fmt-6.2.1-1.el8.x86_64 2023-10-18T20:47:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-18T20:47:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: leveldb-1.22-1.el8.x86_64 2023-10-18T20:47:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-18T20:47:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.6.1-1.el8.x86_64 2023-10-18T20:47:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-18T20:47:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-18T20:47:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-18T20:47:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-18T20:47:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: ndctl-libs-71.1-7.el8.x86_64 2023-10-18T20:47:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-18T20:47:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:18.806 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:47:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2023-10-18T20:47:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2023-10-18T20:47:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2023-10-18T20:47:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2023-10-18T20:47:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2023-10-18T20:47:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2023-10-18T20:47:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2023-10-18T20:47:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2023-10-18T20:47:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2023-10-18T20:47:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2023-10-18T20:47:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2023-10-18T20:47:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2023-10-18T20:47:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2023-10-18T20:47:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2023-10-18T20:47:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2023-10-18T20:47:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 15/29 2023-10-18T20:47:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2023-10-18T20:47:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2023-10-18T20:47:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 18/29 2023-10-18T20:47:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 19/29 2023-10-18T20:47:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 20/29 2023-10-18T20:47:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2023-10-18T20:47:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2023-10-18T20:47:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2023-10-18T20:47:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2023-10-18T20:47:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2023-10-18T20:47:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2023-10-18T20:47:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2023-10-18T20:47:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2023-10-18T20:47:19.132 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-test 2023-10-18T20:47:20.120 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2023-10-18T20:47:20.121 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:20.121 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-10-18T20:47:20.121 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.121 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:47:20.121 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.122 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.122 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.122 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.122 INFO:teuthology.orchestra.run.smithi008.stdout: daxctl-libs-71.1-7.el8.x86_64 2023-10-18T20:47:20.122 INFO:teuthology.orchestra.run.smithi008.stdout: fmt-6.2.1-1.el8.x86_64 2023-10-18T20:47:20.123 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-18T20:47:20.123 INFO:teuthology.orchestra.run.smithi008.stdout: leveldb-1.22-1.el8.x86_64 2023-10-18T20:47:20.123 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.123 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-18T20:47:20.123 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj-1.6.1-1.el8.x86_64 2023-10-18T20:47:20.124 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-18T20:47:20.124 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.124 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-18T20:47:20.124 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.124 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-18T20:47:20.125 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-18T20:47:20.125 INFO:teuthology.orchestra.run.smithi008.stdout: ndctl-libs-71.1-7.el8.x86_64 2023-10-18T20:47:20.125 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.125 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.125 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.126 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-18T20:47:20.126 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.126 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.126 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:20.126 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:20.127 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:47:20.248 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:47:20.504 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-test 2023-10-18T20:47:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:47 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:47:22.053 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:47:22.055 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:47:22.055 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-18T20:47:22.055 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:47:22.055 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:47:22.056 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2023-10-18T20:47:22.056 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-18T20:47:22.056 INFO:teuthology.orchestra.run.smithi060.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-18T20:47:22.056 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2023-10-18T20:47:22.056 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-18T20:47:22.056 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-18T20:47:22.057 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-18T20:47:22.057 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:22.057 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:47:22.057 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:47:22.057 INFO:teuthology.orchestra.run.smithi060.stdout:Install 6 Packages 2023-10-18T20:47:22.058 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:22.058 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 53 M 2023-10-18T20:47:22.058 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 229 M 2023-10-18T20:47:22.059 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:47:22.200 INFO:teuthology.orchestra.run.smithi060.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 3.1 MB/s | 169 kB 00:00 2023-10-18T20:47:22.492 INFO:teuthology.orchestra.run.smithi060.stdout:(2/6): jq-1.6-7.el8.x86_64.rpm 586 kB/s | 202 kB 00:00 2023-10-18T20:47:22.534 INFO:teuthology.orchestra.run.smithi060.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 562 kB/s | 187 kB 00:00 2023-10-18T20:47:22.617 INFO:teuthology.orchestra.run.smithi060.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 849 kB/s | 71 kB 00:00 2023-10-18T20:47:22.643 INFO:teuthology.orchestra.run.smithi060.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2023-10-18T20:47:23.151 INFO:teuthology.orchestra.run.smithi060.stdout:(6/6): ceph-test-16.2.4-0.el8.x86_64.rpm 52 MB/s | 52 MB 00:01 2023-10-18T20:47:23.154 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:47:23.154 INFO:teuthology.orchestra.run.smithi060.stdout:Total 48 MB/s | 53 MB 00:01 2023-10-18T20:47:23.253 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:47:23.279 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:47:23.279 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:47:23.472 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:47:23.473 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:47:23.474 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-18T20:47:23.474 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:47:23.474 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:47:23.474 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2023-10-18T20:47:23.474 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-18T20:47:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-18T20:47:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2023-10-18T20:47:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-18T20:47:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-18T20:47:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-18T20:47:23.476 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:23.476 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:47:23.476 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:47:23.476 INFO:teuthology.orchestra.run.smithi008.stdout:Install 6 Packages 2023-10-18T20:47:23.476 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:23.477 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 53 M 2023-10-18T20:47:23.477 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 229 M 2023-10-18T20:47:23.477 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:47:23.633 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:47:23.637 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:47:23.783 INFO:teuthology.orchestra.run.smithi008.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 2.5 MB/s | 169 kB 00:00 2023-10-18T20:47:24.142 INFO:teuthology.orchestra.run.smithi008.stdout:(2/6): jq-1.6-7.el8.x86_64.rpm 478 kB/s | 202 kB 00:00 2023-10-18T20:47:24.159 INFO:teuthology.orchestra.run.smithi008.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 500 kB/s | 187 kB 00:00 2023-10-18T20:47:24.164 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:47:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-10-18T20:47:24.561 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-10-18T20:47:24.697 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-10-18T20:47:24.735 INFO:teuthology.orchestra.run.smithi008.stdout:(4/6): ceph-test-16.2.4-0.el8.x86_64.rpm 51 MB/s | 52 MB 00:01 2023-10-18T20:47:24.759 INFO:teuthology.orchestra.run.smithi008.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 118 kB/s | 71 kB 00:00 2023-10-18T20:47:24.785 INFO:teuthology.orchestra.run.smithi008.stdout:(6/6): socat-1.7.4.1-1.el8.x86_64.rpm 503 kB/s | 323 kB 00:00 2023-10-18T20:47:24.787 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:47:24.787 INFO:teuthology.orchestra.run.smithi008.stdout:Total 40 MB/s | 53 MB 00:01 2023-10-18T20:47:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-10-18T20:47:24.885 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:47:24.912 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:47:24.912 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:47:25.028 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : jq-1.6-7.el8.x86_64 4/6 2023-10-18T20:47:25.180 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2023-10-18T20:47:25.257 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:47:25.260 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:47:25.819 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:47:26.012 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-10-18T20:47:26.199 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-10-18T20:47:26.343 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-10-18T20:47:26.447 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-10-18T20:47:26.661 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-7.el8.x86_64 4/6 2023-10-18T20:47:26.851 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2023-10-18T20:47:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2023-10-18T20:47:31.079 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2023-10-18T20:47:31.442 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2023-10-18T20:47:31.443 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2023-10-18T20:47:31.443 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2023-10-18T20:47:31.443 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : jq-1.6-7.el8.x86_64 3/6 2023-10-18T20:47:31.443 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-10-18T20:47:31.444 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-10-18T20:47:32.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-10-18T20:47:32.198 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:47:32.198 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-7.el8.x86_64 2023-10-18T20:47:32.198 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2023-10-18T20:47:32.198 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2023-10-18T20:47:32.199 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:32.199 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:47:32.365 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2023-10-18T20:47:32.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph 2023-10-18T20:47:32.634 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2023-10-18T20:47:33.016 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2023-10-18T20:47:33.016 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2023-10-18T20:47:33.017 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2023-10-18T20:47:33.017 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-7.el8.x86_64 3/6 2023-10-18T20:47:33.017 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-10-18T20:47:33.017 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-10-18T20:47:33.549 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:02 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:47:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-10-18T20:47:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:33.814 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:47:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-7.el8.x86_64 2023-10-18T20:47:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2023-10-18T20:47:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2023-10-18T20:47:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:33.815 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:47:34.015 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph 2023-10-18T20:47:35.138 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:01 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:47:35.348 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:47:35.352 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:47:35.352 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-18T20:47:35.352 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:47:35.352 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:47:35.353 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2023-10-18T20:47:35.353 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-18T20:47:35.353 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2023-10-18T20:47:35.353 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2023-10-18T20:47:35.353 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2023-10-18T20:47:35.354 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2023-10-18T20:47:35.354 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2023-10-18T20:47:35.354 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-18T20:47:35.354 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-18T20:47:35.355 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-18T20:47:35.355 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-18T20:47:35.355 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-18T20:47:35.355 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-18T20:47:35.355 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-18T20:47:35.356 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-18T20:47:35.356 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-18T20:47:35.356 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-18T20:47:35.356 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-18T20:47:35.356 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-18T20:47:35.357 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-18T20:47:35.357 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-18T20:47:35.357 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-18T20:47:35.357 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-18T20:47:35.358 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-18T20:47:35.358 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-18T20:47:35.358 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-18T20:47:35.358 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-18T20:47:35.358 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-18T20:47:35.359 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-18T20:47:35.359 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-18T20:47:35.359 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-18T20:47:35.359 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-18T20:47:35.360 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-18T20:47:35.360 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:35.360 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:47:35.360 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:47:35.360 INFO:teuthology.orchestra.run.smithi060.stdout:Install 32 Packages 2023-10-18T20:47:35.361 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:35.361 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 31 M 2023-10-18T20:47:35.362 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 111 M 2023-10-18T20:47:35.362 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:47:35.845 INFO:teuthology.orchestra.run.smithi060.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 108 kB/s | 6.3 kB 00:00 2023-10-18T20:47:35.912 INFO:teuthology.orchestra.run.smithi060.stdout:(2/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2023-10-18T20:47:35.970 INFO:teuthology.orchestra.run.smithi060.stdout:(3/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2023-10-18T20:47:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 6.5 MB/s | 220 kB 00:00 2023-10-18T20:47:36.104 INFO:teuthology.orchestra.run.smithi060.stdout:(5/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 19 MB/s | 5.0 MB 00:00 2023-10-18T20:47:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:(6/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 38 MB/s | 18 MB 00:00 2023-10-18T20:47:36.413 INFO:teuthology.orchestra.run.smithi060.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 126 kB/s | 39 kB 00:00 2023-10-18T20:47:36.438 INFO:teuthology.orchestra.run.smithi060.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 362 kB/s | 157 kB 00:00 2023-10-18T20:47:36.530 INFO:teuthology.orchestra.run.smithi060.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 489 kB/s | 57 kB 00:00 2023-10-18T20:47:36.572 INFO:teuthology.orchestra.run.smithi060.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 3.3 MB/s | 457 kB 00:00 2023-10-18T20:47:36.614 INFO:teuthology.orchestra.run.smithi060.stdout:(11/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 458 kB/s | 103 kB 00:00 2023-10-18T20:47:36.698 INFO:teuthology.orchestra.run.smithi060.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 249 kB 00:00 2023-10-18T20:47:36.740 INFO:teuthology.orchestra.run.smithi060.stdout:(13/32): python3-cryptography-3.2.1-6.el8.x86_6 3.8 MB/s | 641 kB 00:00 2023-10-18T20:47:36.774 INFO:teuthology.orchestra.run.smithi060.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 686 kB/s | 109 kB 00:00 2023-10-18T20:47:36.941 INFO:teuthology.orchestra.run.smithi060.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 180 kB/s | 44 kB 00:00 2023-10-18T20:47:36.972 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:47:36.974 INFO:teuthology.orchestra.run.smithi060.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 791 kB/s | 185 kB 00:00 2023-10-18T20:47:36.976 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:47:36.976 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-18T20:47:36.977 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:47:36.977 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:47:36.977 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2023-10-18T20:47:36.977 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-18T20:47:36.978 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2023-10-18T20:47:36.978 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2023-10-18T20:47:36.978 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2023-10-18T20:47:36.978 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2023-10-18T20:47:36.978 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2023-10-18T20:47:36.979 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-18T20:47:36.979 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-18T20:47:36.979 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-18T20:47:36.979 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-18T20:47:36.979 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-18T20:47:36.980 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-18T20:47:36.980 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-18T20:47:36.980 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-18T20:47:36.980 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-18T20:47:36.980 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-18T20:47:36.981 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-18T20:47:36.981 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-18T20:47:36.981 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-18T20:47:36.981 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-18T20:47:36.981 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-18T20:47:36.982 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-18T20:47:36.982 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-18T20:47:36.982 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-18T20:47:36.982 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-18T20:47:36.983 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-18T20:47:36.983 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-18T20:47:36.983 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-18T20:47:36.983 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-18T20:47:36.983 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-18T20:47:36.984 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-18T20:47:36.984 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-18T20:47:36.984 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:36.984 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:47:36.984 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:47:36.984 INFO:teuthology.orchestra.run.smithi008.stdout:Install 32 Packages 2023-10-18T20:47:36.985 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:36.985 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 31 M 2023-10-18T20:47:36.986 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 111 M 2023-10-18T20:47:36.986 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:47:37.000 INFO:teuthology.orchestra.run.smithi060.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 765 kB/s | 173 kB 00:00 2023-10-18T20:47:37.042 INFO:teuthology.orchestra.run.smithi060.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-10-18T20:47:37.067 INFO:teuthology.orchestra.run.smithi060.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 263 kB/s | 18 kB 00:00 2023-10-18T20:47:37.109 INFO:teuthology.orchestra.run.smithi060.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 732 kB/s | 49 kB 00:00 2023-10-18T20:47:37.134 INFO:teuthology.orchestra.run.smithi060.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 878 kB/s | 59 kB 00:00 2023-10-18T20:47:37.193 INFO:teuthology.orchestra.run.smithi060.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2023-10-18T20:47:37.243 INFO:teuthology.orchestra.run.smithi060.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-10-18T20:47:37.268 INFO:teuthology.orchestra.run.smithi060.stdout:(24/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.1 MB/s | 384 kB 00:00 2023-10-18T20:47:37.285 INFO:teuthology.orchestra.run.smithi060.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 203 kB/s | 19 kB 00:00 2023-10-18T20:47:37.302 INFO:teuthology.orchestra.run.smithi060.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 408 kB/s | 24 kB 00:00 2023-10-18T20:47:37.328 INFO:teuthology.orchestra.run.smithi060.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 498 kB/s | 29 kB 00:00 2023-10-18T20:47:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 467 kB/s | 27 kB 00:00 2023-10-18T20:47:37.403 INFO:teuthology.orchestra.run.smithi060.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.4 MB/s | 85 kB 00:00 2023-10-18T20:47:37.462 INFO:teuthology.orchestra.run.smithi060.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.8 MB/s | 251 kB 00:00 2023-10-18T20:47:37.470 INFO:teuthology.orchestra.run.smithi008.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 127 kB/s | 6.3 kB 00:00 2023-10-18T20:47:37.479 INFO:teuthology.orchestra.run.smithi060.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2023-10-18T20:47:37.521 INFO:teuthology.orchestra.run.smithi060.stdout:(32/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.1 MB/s | 255 kB 00:00 2023-10-18T20:47:37.522 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:47:37.523 INFO:teuthology.orchestra.run.smithi060.stdout:Total 14 MB/s | 31 MB 00:02 2023-10-18T20:47:37.528 INFO:teuthology.orchestra.run.smithi008.stdout:(2/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2023-10-18T20:47:37.579 INFO:teuthology.orchestra.run.smithi008.stdout:(3/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2023-10-18T20:47:37.613 INFO:teuthology.orchestra.run.smithi008.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 6.5 MB/s | 220 kB 00:00 2023-10-18T20:47:37.705 INFO:teuthology.orchestra.run.smithi008.stdout:(5/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 21 MB/s | 5.0 MB 00:00 2023-10-18T20:47:37.716 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:47:37.763 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:47:37.763 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:47:37.997 INFO:teuthology.orchestra.run.smithi008.stdout:(6/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 39 MB/s | 18 MB 00:00 2023-10-18T20:47:38.014 INFO:teuthology.orchestra.run.smithi008.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 126 kB/s | 39 kB 00:00 2023-10-18T20:47:38.081 INFO:teuthology.orchestra.run.smithi008.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 336 kB/s | 157 kB 00:00 2023-10-18T20:47:38.114 INFO:teuthology.orchestra.run.smithi008.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 569 kB/s | 57 kB 00:00 2023-10-18T20:47:38.128 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:47:38.132 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:47:38.215 INFO:teuthology.orchestra.run.smithi008.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 477 kB/s | 103 kB 00:00 2023-10-18T20:47:38.307 INFO:teuthology.orchestra.run.smithi008.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2023-10-18T20:47:38.357 INFO:teuthology.orchestra.run.smithi008.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 2.1 MB/s | 109 kB 00:00 2023-10-18T20:47:38.408 INFO:teuthology.orchestra.run.smithi008.stdout:(13/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.4 MB/s | 457 kB 00:00 2023-10-18T20:47:38.441 INFO:teuthology.orchestra.run.smithi008.stdout:(14/32): python3-cryptography-3.2.1-6.el8.x86_6 2.8 MB/s | 641 kB 00:00 2023-10-18T20:47:38.658 INFO:teuthology.orchestra.run.smithi008.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 145 kB/s | 44 kB 00:00 2023-10-18T20:47:38.775 INFO:teuthology.orchestra.run.smithi008.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 504 kB/s | 185 kB 00:00 2023-10-18T20:47:38.800 INFO:teuthology.orchestra.run.smithi008.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 481 kB/s | 173 kB 00:00 2023-10-18T20:47:38.850 INFO:teuthology.orchestra.run.smithi008.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-10-18T20:47:38.876 INFO:teuthology.orchestra.run.smithi008.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 233 kB/s | 18 kB 00:00 2023-10-18T20:47:38.901 INFO:teuthology.orchestra.run.smithi008.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.5 MB/s | 384 kB 00:00 2023-10-18T20:47:38.935 INFO:teuthology.orchestra.run.smithi008.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 581 kB/s | 49 kB 00:00 2023-10-18T20:47:38.960 INFO:teuthology.orchestra.run.smithi008.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 702 kB/s | 59 kB 00:00 2023-10-18T20:47:38.994 INFO:teuthology.orchestra.run.smithi008.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-18T20:47:39.019 INFO:teuthology.orchestra.run.smithi008.stdout:(24/32): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2023-10-18T20:47:39.044 INFO:teuthology.orchestra.run.smithi008.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 224 kB/s | 19 kB 00:00 2023-10-18T20:47:39.069 INFO:teuthology.orchestra.run.smithi008.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 318 kB/s | 24 kB 00:00 2023-10-18T20:47:39.095 INFO:teuthology.orchestra.run.smithi008.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 389 kB/s | 29 kB 00:00 2023-10-18T20:47:39.120 INFO:teuthology.orchestra.run.smithi008.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2023-10-18T20:47:39.162 INFO:teuthology.orchestra.run.smithi008.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.7 MB/s | 255 kB 00:00 2023-10-18T20:47:39.204 INFO:teuthology.orchestra.run.smithi008.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2023-10-18T20:47:39.229 INFO:teuthology.orchestra.run.smithi008.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.8 MB/s | 251 kB 00:00 2023-10-18T20:47:39.254 INFO:teuthology.orchestra.run.smithi008.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 250 kB/s | 23 kB 00:00 2023-10-18T20:47:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:47:39.258 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:47:39.259 INFO:teuthology.orchestra.run.smithi008.stdout:Total 14 MB/s | 31 MB 00:02 2023-10-18T20:47:39.451 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:47:39.498 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:47:39.498 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:47:39.515 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-10-18T20:47:39.772 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-10-18T20:47:39.853 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:47:39.856 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:47:40.040 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-10-18T20:47:40.261 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-10-18T20:47:40.451 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-10-18T20:47:40.670 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-10-18T20:47:40.866 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-10-18T20:47:40.971 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:47:41.036 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-10-18T20:47:41.220 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-10-18T20:47:41.262 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-10-18T20:47:41.484 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-10-18T20:47:41.505 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-10-18T20:47:41.768 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-10-18T20:47:41.786 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-10-18T20:47:42.016 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-10-18T20:47:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-10-18T20:47:42.205 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-10-18T20:47:42.398 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-10-18T20:47:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-10-18T20:47:42.603 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-10-18T20:47:42.774 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-10-18T20:47:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-10-18T20:47:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-10-18T20:47:43.008 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-10-18T20:47:43.251 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-10-18T20:47:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-10-18T20:47:43.515 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-10-18T20:47:43.554 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-10-18T20:47:43.808 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-10-18T20:47:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-10-18T20:47:44.063 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-10-18T20:47:44.248 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-10-18T20:47:44.268 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-10-18T20:47:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-10-18T20:47:44.566 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-10-18T20:47:44.724 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-10-18T20:47:44.863 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-10-18T20:47:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-10-18T20:47:45.123 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-10-18T20:47:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-10-18T20:47:45.345 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-10-18T20:47:45.503 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-10-18T20:47:45.690 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-10-18T20:47:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-10-18T20:47:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-10-18T20:47:46.114 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-10-18T20:47:46.220 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2023-10-18T20:47:46.314 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-10-18T20:47:46.437 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2023-10-18T20:47:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-10-18T20:47:46.874 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-10-18T20:47:47.114 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-10-18T20:47:47.520 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-10-18T20:47:47.844 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-10-18T20:47:48.252 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2023-10-18T20:47:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2023-10-18T20:47:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2023-10-18T20:47:48.788 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2023-10-18T20:47:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2023-10-18T20:47:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2023-10-18T20:47:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2023-10-18T20:47:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2023-10-18T20:47:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2023-10-18T20:47:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2023-10-18T20:47:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2023-10-18T20:47:50.238 INFO:teuthology.orchestra.run.smithi060.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-18T20:47:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2023-10-18T20:47:50.537 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2023-10-18T20:47:50.806 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2023-10-18T20:47:50.807 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2023-10-18T20:47:50.807 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2023-10-18T20:47:50.807 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2023-10-18T20:47:50.807 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2023-10-18T20:47:50.808 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2023-10-18T20:47:50.808 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-10-18T20:47:50.808 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-10-18T20:47:50.808 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-10-18T20:47:50.808 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-10-18T20:47:50.809 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-10-18T20:47:50.809 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-10-18T20:47:50.809 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-10-18T20:47:50.809 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-10-18T20:47:50.809 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-10-18T20:47:50.809 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-10-18T20:47:50.810 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-10-18T20:47:50.810 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-10-18T20:47:50.810 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-10-18T20:47:50.810 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-10-18T20:47:50.810 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-10-18T20:47:50.811 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-10-18T20:47:50.811 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-10-18T20:47:50.811 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-10-18T20:47:50.811 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-10-18T20:47:50.812 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-10-18T20:47:50.812 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-10-18T20:47:50.812 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-10-18T20:47:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-10-18T20:47:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-10-18T20:47:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-10-18T20:47:51.059 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2023-10-18T20:47:51.270 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2023-10-18T20:47:51.546 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2023-10-18T20:47:51.757 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2023-10-18T20:47:51.800 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2023-10-18T20:47:51.881 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-10-18T20:47:51.881 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:51.881 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:47:51.881 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:51.882 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:51.882 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:51.882 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2023-10-18T20:47:51.882 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:51.882 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:51.883 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-18T20:47:51.883 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-18T20:47:51.884 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-18T20:47:51.884 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-18T20:47:51.884 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-18T20:47:51.885 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-18T20:47:51.885 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-18T20:47:51.885 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-18T20:47:51.885 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-18T20:47:51.886 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-18T20:47:51.886 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-18T20:47:51.887 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-18T20:47:51.887 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-18T20:47:51.887 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-2.6-1.el8.noarch 2023-10-18T20:47:51.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-18T20:47:51.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-18T20:47:51.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-18T20:47:51.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-18T20:47:51.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-18T20:47:51.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-18T20:47:51.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-18T20:47:51.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-18T20:47:51.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-18T20:47:51.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-18T20:47:51.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-18T20:47:51.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-18T20:47:51.892 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:51.892 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:47:51.949 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2023-10-18T20:47:52.056 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2023-10-18T20:47:52.057 INFO:teuthology.orchestra.run.smithi008.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-18T20:47:52.057 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:52.111 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-base 2023-10-18T20:47:52.623 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2023-10-18T20:47:52.623 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2023-10-18T20:47:52.623 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2023-10-18T20:47:52.623 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2023-10-18T20:47:52.624 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2023-10-18T20:47:52.624 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2023-10-18T20:47:52.624 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-10-18T20:47:52.624 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-10-18T20:47:52.625 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-10-18T20:47:52.625 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-10-18T20:47:52.625 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-10-18T20:47:52.625 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-10-18T20:47:52.625 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-10-18T20:47:52.626 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-10-18T20:47:52.626 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-10-18T20:47:52.626 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-10-18T20:47:52.626 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-10-18T20:47:52.626 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-10-18T20:47:52.627 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-10-18T20:47:52.627 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-10-18T20:47:52.627 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-10-18T20:47:52.627 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-10-18T20:47:52.627 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-10-18T20:47:52.628 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-10-18T20:47:52.628 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-10-18T20:47:52.628 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-10-18T20:47:52.628 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-10-18T20:47:52.629 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-10-18T20:47:52.629 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-10-18T20:47:52.630 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-10-18T20:47:52.630 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-10-18T20:47:53.231 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:47:53.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-10-18T20:47:53.828 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:53.829 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:47:53.829 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:53.829 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:53.829 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:53.830 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2023-10-18T20:47:53.830 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:53.830 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2023-10-18T20:47:53.830 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-18T20:47:53.831 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-18T20:47:53.831 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-18T20:47:53.831 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-18T20:47:53.831 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-18T20:47:53.831 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-18T20:47:53.832 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-18T20:47:53.832 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-18T20:47:53.832 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-18T20:47:53.832 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-18T20:47:53.832 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-18T20:47:53.833 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-18T20:47:53.833 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-18T20:47:53.833 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-2.6-1.el8.noarch 2023-10-18T20:47:53.833 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-18T20:47:53.833 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-18T20:47:53.833 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-18T20:47:53.834 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-18T20:47:53.834 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-18T20:47:53.834 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-18T20:47:53.834 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-18T20:47:53.835 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-18T20:47:53.835 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-18T20:47:53.835 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-18T20:47:53.835 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-18T20:47:53.835 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-18T20:47:53.836 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:47:53.836 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:47:54.134 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-base 2023-10-18T20:47:54.794 INFO:teuthology.orchestra.run.smithi060.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:47:55.019 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:47:55.021 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-18T20:47:55.021 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:47:55.141 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install cephadm 2023-10-18T20:47:55.245 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:21 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:47:56.249 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:25 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:47:56.980 INFO:teuthology.orchestra.run.smithi008.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:47:57.205 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:47:57.207 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-18T20:47:57.207 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:47:57.342 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install cephadm 2023-10-18T20:47:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:47:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:47:58.030 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-18T20:47:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:47:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:47:58.031 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2023-10-18T20:47:58.031 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:47:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:47:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2023-10-18T20:47:58.032 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:47:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 71 k 2023-10-18T20:47:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 290 k 2023-10-18T20:47:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:47:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:cephadm-16.2.4-0.el8.noarch.rpm 2.3 MB/s | 71 kB 00:00 2023-10-18T20:47:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:47:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:Total 2.2 MB/s | 71 kB 00:00 2023-10-18T20:47:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:47:58.073 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:47:58.074 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:47:58.077 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:47:58.080 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:47:58.127 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:47:58.446 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:24 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:48:00.175 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2023-10-18T20:48:00.276 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:48:00.277 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:00.278 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-18T20:48:00.278 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:00.278 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:48:00.278 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2023-10-18T20:48:00.278 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:48:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-18T20:48:00.279 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:00.279 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 71 k 2023-10-18T20:48:00.280 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 290 k 2023-10-18T20:48:00.280 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:48:00.366 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2023-10-18T20:48:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2023-10-18T20:48:00.965 INFO:teuthology.orchestra.run.smithi008.stdout:cephadm-16.2.4-0.el8.noarch.rpm 104 kB/s | 71 kB 00:00 2023-10-18T20:48:00.966 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:00.966 INFO:teuthology.orchestra.run.smithi008.stdout:Total 103 kB/s | 71 kB 00:00 2023-10-18T20:48:00.967 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:48:00.978 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:48:00.978 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:48:00.982 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:48:00.986 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:48:01.365 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2023-10-18T20:48:01.366 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:01.366 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:48:01.366 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:16.2.4-0.el8.noarch 2023-10-18T20:48:01.366 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:01.367 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:48:01.583 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-immutable-object-cache 2023-10-18T20:48:01.800 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:48:02.418 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2023-10-18T20:48:02.607 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2023-10-18T20:48:02.698 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:48:02.909 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2023-10-18T20:48:03.611 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2023-10-18T20:48:03.611 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:03.611 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:48:03.612 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:16.2.4-0.el8.noarch 2023-10-18T20:48:03.612 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:03.612 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:48:03.809 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-immutable-object-cache 2023-10-18T20:48:04.652 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:48:04.653 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2023-10-18T20:48:04.654 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:04.654 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:48:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2023-10-18T20:48:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:04.655 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:48:04.655 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:04.655 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2023-10-18T20:48:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:04.656 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 163 k 2023-10-18T20:48:04.656 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 587 k 2023-10-18T20:48:04.656 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:48:04.920 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:48:04.976 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 508 kB/s | 163 kB 00:00 2023-10-18T20:48:04.976 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:04.977 INFO:teuthology.orchestra.run.smithi060.stdout:Total 505 kB/s | 163 kB 00:00 2023-10-18T20:48:04.977 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:48:04.993 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:48:04.993 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:48:05.054 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:48:05.057 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:48:05.177 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:48:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:48:06.096 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:48:06.715 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:48:06.716 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:06.716 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-18T20:48:06.717 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:06.717 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:48:06.717 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2023-10-18T20:48:06.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:06.717 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:48:06.718 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:06.718 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-18T20:48:06.718 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:06.719 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 163 k 2023-10-18T20:48:06.719 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 587 k 2023-10-18T20:48:06.719 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:48:06.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:48:06.855 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:06.855 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:48:06.855 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2023-10-18T20:48:06.856 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:06.856 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:48:06.928 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 775 kB/s | 163 kB 00:00 2023-10-18T20:48:06.929 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:06.930 INFO:teuthology.orchestra.run.smithi008.stdout:Total 769 kB/s | 163 kB 00:00 2023-10-18T20:48:06.930 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:48:06.945 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:48:06.945 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:48:07.004 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:48:07.007 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:48:07.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr 2023-10-18T20:48:07.132 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:48:07.321 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:48:07.990 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:48:08.215 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:48:08.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:48:08.685 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:08.686 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:48:08.686 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2023-10-18T20:48:08.686 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:08.686 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:48:08.912 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr 2023-10-18T20:48:09.822 INFO:teuthology.orchestra.run.smithi060.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:48:10.037 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:48:10.046 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:48:10.048 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-18T20:48:10.048 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:48:10.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-dashboard 2023-10-18T20:48:11.289 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:48:11.603 INFO:teuthology.orchestra.run.smithi008.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:48:11.829 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:48:11.831 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-18T20:48:11.831 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:48:11.956 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-dashboard 2023-10-18T20:48:13.047 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:48:13.097 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:48:13.098 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:13.098 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-18T20:48:13.098 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:13.099 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:48:13.099 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2023-10-18T20:48:13.099 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-18T20:48:13.099 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2023-10-18T20:48:13.099 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2023-10-18T20:48:13.100 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-18T20:48:13.100 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-18T20:48:13.100 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-18T20:48:13.100 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:13.100 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:48:13.101 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:13.101 INFO:teuthology.orchestra.run.smithi060.stdout:Install 6 Packages 2023-10-18T20:48:13.101 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:13.102 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 3.0 M 2023-10-18T20:48:13.102 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 15 M 2023-10-18T20:48:13.102 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:48:13.228 INFO:teuthology.orchestra.run.smithi060.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 449 kB/s | 24 kB 00:00 2023-10-18T20:48:13.253 INFO:teuthology.orchestra.run.smithi060.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 113 kB/s | 8.9 kB 00:00 2023-10-18T20:48:13.320 INFO:teuthology.orchestra.run.smithi060.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 18 MB/s | 2.7 MB 00:00 2023-10-18T20:48:13.395 INFO:teuthology.orchestra.run.smithi060.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 255 kB/s | 43 kB 00:00 2023-10-18T20:48:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 155 kB/s | 34 kB 00:00 2023-10-18T20:48:13.637 INFO:teuthology.orchestra.run.smithi060.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 629 kB/s | 196 kB 00:00 2023-10-18T20:48:13.640 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:13.641 INFO:teuthology.orchestra.run.smithi060.stdout:Total 5.5 MB/s | 3.0 MB 00:00 2023-10-18T20:48:13.664 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:48:13.678 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:48:13.678 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:48:13.891 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:48:13.895 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:48:14.211 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:48:14.396 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-10-18T20:48:14.631 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-10-18T20:48:14.890 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:48:14.891 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:14.891 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-18T20:48:14.891 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:14.891 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:48:14.892 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2023-10-18T20:48:14.892 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-18T20:48:14.892 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2023-10-18T20:48:14.892 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2023-10-18T20:48:14.893 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-18T20:48:14.893 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-18T20:48:14.893 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-18T20:48:14.893 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:14.893 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:48:14.893 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:14.894 INFO:teuthology.orchestra.run.smithi008.stdout:Install 6 Packages 2023-10-18T20:48:14.894 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:14.895 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 3.0 M 2023-10-18T20:48:14.895 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 15 M 2023-10-18T20:48:14.895 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:48:15.139 INFO:teuthology.orchestra.run.smithi008.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 512 kB/s | 24 kB 00:00 2023-10-18T20:48:15.165 INFO:teuthology.orchestra.run.smithi008.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 124 kB/s | 8.9 kB 00:00 2023-10-18T20:48:15.223 INFO:teuthology.orchestra.run.smithi008.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 20 MB/s | 2.7 MB 00:00 2023-10-18T20:48:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-10-18T20:48:15.299 INFO:teuthology.orchestra.run.smithi008.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 252 kB/s | 34 kB 00:00 2023-10-18T20:48:15.324 INFO:teuthology.orchestra.run.smithi008.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 231 kB/s | 43 kB 00:00 2023-10-18T20:48:15.366 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2023-10-18T20:48:15.399 INFO:teuthology.orchestra.run.smithi008.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.1 MB/s | 196 kB 00:00 2023-10-18T20:48:15.401 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:15.401 INFO:teuthology.orchestra.run.smithi008.stdout:Total 5.8 MB/s | 3.0 MB 00:00 2023-10-18T20:48:15.426 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:48:15.440 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:48:15.440 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:48:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:48:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:48:15.932 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:48:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-10-18T20:48:16.444 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-10-18T20:48:16.579 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2023-10-18T20:48:16.656 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-10-18T20:48:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2023-10-18T20:48:16.858 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2023-10-18T20:48:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2023-10-18T20:48:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2023-10-18T20:48:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2023-10-18T20:48:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2023-10-18T20:48:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-10-18T20:48:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-10-18T20:48:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-10-18T20:48:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:17.936 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:48:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2023-10-18T20:48:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2023-10-18T20:48:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2023-10-18T20:48:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-18T20:48:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-18T20:48:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-18T20:48:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:17.938 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:48:18.082 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-18T20:48:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2023-10-18T20:48:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2023-10-18T20:48:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2023-10-18T20:48:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2023-10-18T20:48:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2023-10-18T20:48:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2023-10-18T20:48:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-10-18T20:48:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-10-18T20:48:19.196 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:48 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:48:19.853 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-10-18T20:48:19.853 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:19.853 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:48:19.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2023-10-18T20:48:19.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2023-10-18T20:48:19.854 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2023-10-18T20:48:19.854 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-18T20:48:19.854 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-18T20:48:19.855 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-18T20:48:19.855 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:19.855 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:48:20.040 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-18T20:48:21.031 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:48:21.032 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================================ 2023-10-18T20:48:21.032 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-18T20:48:21.033 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================================ 2023-10-18T20:48:21.033 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:48:21.033 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2023-10-18T20:48:21.034 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-18T20:48:21.034 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-10-18T20:48:21.034 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-10-18T20:48:21.035 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-18T20:48:21.035 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-18T20:48:21.035 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-18T20:48:21.036 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-18T20:48:21.036 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-18T20:48:21.037 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:21.037 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:48:21.037 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================================ 2023-10-18T20:48:21.038 INFO:teuthology.orchestra.run.smithi060.stdout:Install 8 Packages 2023-10-18T20:48:21.038 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:21.039 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 37 M 2023-10-18T20:48:21.039 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 210 M 2023-10-18T20:48:21.040 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:48:21.154 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:47 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:48:21.453 INFO:teuthology.orchestra.run.smithi060.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.4-0.e 47 MB/s | 8.6 MB 00:00 2023-10-18T20:48:21.861 INFO:teuthology.orchestra.run.smithi060.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 9.1 MB/s | 3.7 MB 00:00 2023-10-18T20:48:21.920 INFO:teuthology.orchestra.run.smithi060.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 3.8 MB/s | 225 kB 00:00 2023-10-18T20:48:22.370 INFO:teuthology.orchestra.run.smithi060.stdout:(4/8): python3-scipy-1.0.0-21.module_el8.5.0+77 30 MB/s | 14 MB 00:00 2023-10-18T20:48:22.537 INFO:teuthology.orchestra.run.smithi060.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 3.8 MB/s | 645 kB 00:00 2023-10-18T20:48:22.621 INFO:teuthology.orchestra.run.smithi060.stdout:(6/8): openblas-0.3.15-4.el8.x86_64.rpm 3.5 MB/s | 4.7 MB 00:01 2023-10-18T20:48:22.646 INFO:teuthology.orchestra.run.smithi060.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.5 MB/s | 172 kB 00:00 2023-10-18T20:48:22.721 INFO:teuthology.orchestra.run.smithi060.stdout:(8/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 3.3 MB/s | 4.9 MB 00:01 2023-10-18T20:48:22.722 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:22.723 INFO:teuthology.orchestra.run.smithi060.stdout:Total 22 MB/s | 37 MB 00:01 2023-10-18T20:48:22.996 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:48:22.997 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================================ 2023-10-18T20:48:22.997 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-18T20:48:22.998 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================================ 2023-10-18T20:48:22.998 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:48:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2023-10-18T20:48:22.999 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-18T20:48:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-10-18T20:48:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-10-18T20:48:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-18T20:48:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-18T20:48:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-18T20:48:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-18T20:48:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-18T20:48:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:23.001 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:48:23.001 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================================ 2023-10-18T20:48:23.001 INFO:teuthology.orchestra.run.smithi008.stdout:Install 8 Packages 2023-10-18T20:48:23.001 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:23.002 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 37 M 2023-10-18T20:48:23.002 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 210 M 2023-10-18T20:48:23.003 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:48:23.057 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:48:23.081 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:48:23.081 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:48:23.390 INFO:teuthology.orchestra.run.smithi008.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.4-0.e 28 MB/s | 8.6 MB 00:00 2023-10-18T20:48:23.456 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:48:23.460 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:48:23.815 INFO:teuthology.orchestra.run.smithi008.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 8.8 MB/s | 3.7 MB 00:00 2023-10-18T20:48:23.873 INFO:teuthology.orchestra.run.smithi008.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 3.8 MB/s | 225 kB 00:00 2023-10-18T20:48:24.073 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:48:24.214 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-10-18T20:48:24.232 INFO:teuthology.orchestra.run.smithi008.stdout:(4/8): python3-scipy-1.0.0-21.module_el8.5.0+77 38 MB/s | 14 MB 00:00 2023-10-18T20:48:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-10-18T20:48:24.399 INFO:teuthology.orchestra.run.smithi008.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 3.8 MB/s | 645 kB 00:00 2023-10-18T20:48:24.441 INFO:teuthology.orchestra.run.smithi008.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 4.1 MB/s | 172 kB 00:00 2023-10-18T20:48:24.531 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-10-18T20:48:24.591 INFO:teuthology.orchestra.run.smithi008.stdout:(7/8): openblas-0.3.15-4.el8.x86_64.rpm 3.1 MB/s | 4.7 MB 00:01 2023-10-18T20:48:24.666 INFO:teuthology.orchestra.run.smithi008.stdout:(8/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 3.1 MB/s | 4.9 MB 00:01 2023-10-18T20:48:24.667 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:24.668 INFO:teuthology.orchestra.run.smithi008.stdout:Total 22 MB/s | 37 MB 00:01 2023-10-18T20:48:25.002 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:48:25.026 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:48:25.027 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:48:25.237 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-10-18T20:48:25.399 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:48:25.402 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:48:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-10-18T20:48:26.031 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:48:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-10-18T20:48:26.177 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-10-18T20:48:26.298 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-10-18T20:48:26.343 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-10-18T20:48:26.502 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-10-18T20:48:27.179 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-10-18T20:48:27.206 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-10-18T20:48:27.385 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-10-18T20:48:27.538 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-10-18T20:48:27.781 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-10-18T20:48:28.111 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-10-18T20:48:28.294 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-10-18T20:48:29.173 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-10-18T20:48:29.517 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-10-18T20:48:29.768 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-10-18T20:48:29.989 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-10-18T20:48:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-10-18T20:48:31.755 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2023-10-18T20:48:31.984 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-10-18T20:48:32.170 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2023-10-18T20:48:32.170 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2023-10-18T20:48:32.170 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-10-18T20:48:32.170 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-10-18T20:48:32.171 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-10-18T20:48:32.171 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-10-18T20:48:32.171 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-10-18T20:48:32.171 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-10-18T20:48:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-10-18T20:48:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:32.938 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:48:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2023-10-18T20:48:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-10-18T20:48:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-10-18T20:48:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-18T20:48:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-18T20:48:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-18T20:48:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-18T20:48:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-18T20:48:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:32.940 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:48:33.089 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-rook 2023-10-18T20:48:33.471 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-10-18T20:48:33.650 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2023-10-18T20:48:34.062 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2023-10-18T20:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2023-10-18T20:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-10-18T20:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-10-18T20:48:34.063 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-10-18T20:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-10-18T20:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-10-18T20:48:34.064 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-10-18T20:48:34.196 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:03 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:48:34.864 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-10-18T20:48:34.864 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:34.864 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:48:34.865 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2023-10-18T20:48:34.865 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-10-18T20:48:34.865 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-10-18T20:48:34.865 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-18T20:48:34.865 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-18T20:48:34.865 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-18T20:48:34.866 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-18T20:48:34.866 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-18T20:48:34.866 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:34.866 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:48:35.014 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-rook 2023-10-18T20:48:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:48:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-18T20:48:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:48:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2023-10-18T20:48:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-18T20:48:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-18T20:48:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-18T20:48:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-18T20:48:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-18T20:48:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-18T20:48:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-18T20:48:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-18T20:48:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-18T20:48:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-18T20:48:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-18T20:48:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-18T20:48:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-18T20:48:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:36.008 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:48:36.008 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:36.008 INFO:teuthology.orchestra.run.smithi060.stdout:Install 13 Packages 2023-10-18T20:48:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:36.009 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 1.9 M 2023-10-18T20:48:36.009 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 24 M 2023-10-18T20:48:36.009 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:48:36.118 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:02 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:48:36.186 INFO:teuthology.orchestra.run.smithi060.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 507 kB/s | 27 kB 00:00 2023-10-18T20:48:36.319 INFO:teuthology.orchestra.run.smithi060.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 107 kB/s | 20 kB 00:00 2023-10-18T20:48:36.345 INFO:teuthology.orchestra.run.smithi060.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 125 kB/s | 27 kB 00:00 2023-10-18T20:48:36.412 INFO:teuthology.orchestra.run.smithi060.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 560 kB/s | 126 kB 00:00 2023-10-18T20:48:36.454 INFO:teuthology.orchestra.run.smithi060.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 822 kB/s | 110 kB 00:00 2023-10-18T20:48:36.479 INFO:teuthology.orchestra.run.smithi060.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.1 MB/s | 155 kB 00:00 2023-10-18T20:48:36.505 INFO:teuthology.orchestra.run.smithi060.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 461 kB/s | 43 kB 00:00 2023-10-18T20:48:36.838 INFO:teuthology.orchestra.run.smithi060.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 45 kB/s | 16 kB 00:00 2023-10-18T20:48:36.856 INFO:teuthology.orchestra.run.smithi060.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 82 kB/s | 33 kB 00:00 2023-10-18T20:48:36.972 INFO:teuthology.orchestra.run.smithi060.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 174 kB/s | 81 kB 00:00 2023-10-18T20:48:37.039 INFO:teuthology.orchestra.run.smithi060.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 350 kB/s | 64 kB 00:00 2023-10-18T20:48:37.106 INFO:teuthology.orchestra.run.smithi060.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 459 kB/s | 61 kB 00:00 2023-10-18T20:48:37.389 INFO:teuthology.orchestra.run.smithi060.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.1 MB/s | 1.2 MB 00:00 2023-10-18T20:48:37.392 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:37.392 INFO:teuthology.orchestra.run.smithi060.stdout:Total 1.4 MB/s | 1.9 MB 00:01 2023-10-18T20:48:37.535 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:48:37.555 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:48:37.556 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:48:37.670 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:48:37.673 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:48:37.914 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:48:37.916 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:37.916 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-18T20:48:37.916 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:37.916 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:48:37.917 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2023-10-18T20:48:37.917 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-18T20:48:37.917 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-18T20:48:37.917 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-18T20:48:37.918 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-18T20:48:37.918 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-18T20:48:37.918 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-18T20:48:37.918 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-18T20:48:37.918 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-18T20:48:37.919 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-18T20:48:37.919 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-18T20:48:37.919 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-18T20:48:37.919 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-18T20:48:37.919 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-18T20:48:37.920 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:37.920 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:48:37.920 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:37.920 INFO:teuthology.orchestra.run.smithi008.stdout:Install 13 Packages 2023-10-18T20:48:37.920 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:37.921 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 1.9 M 2023-10-18T20:48:37.921 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 24 M 2023-10-18T20:48:37.921 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:48:38.219 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:48:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-10-18T20:48:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-10-18T20:48:38.846 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-10-18T20:48:39.072 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-10-18T20:48:39.307 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-10-18T20:48:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-10-18T20:48:39.564 INFO:teuthology.orchestra.run.smithi008.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 472 kB/s | 27 kB 00:00 2023-10-18T20:48:39.657 INFO:teuthology.orchestra.run.smithi008.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 134 kB/s | 20 kB 00:00 2023-10-18T20:48:39.682 INFO:teuthology.orchestra.run.smithi008.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 153 kB/s | 27 kB 00:00 2023-10-18T20:48:39.782 INFO:teuthology.orchestra.run.smithi008.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 582 kB/s | 126 kB 00:00 2023-10-18T20:48:39.841 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-10-18T20:48:39.924 INFO:teuthology.orchestra.run.smithi008.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 412 kB/s | 110 kB 00:00 2023-10-18T20:48:39.949 INFO:teuthology.orchestra.run.smithi008.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 580 kB/s | 155 kB 00:00 2023-10-18T20:48:40.025 INFO:teuthology.orchestra.run.smithi008.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 176 kB/s | 43 kB 00:00 2023-10-18T20:48:40.041 INFO:teuthology.orchestra.run.smithi008.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 177 kB/s | 16 kB 00:00 2023-10-18T20:48:40.059 INFO:teuthology.orchestra.run.smithi008.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 247 kB/s | 33 kB 00:00 2023-10-18T20:48:40.108 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-10-18T20:48:40.126 INFO:teuthology.orchestra.run.smithi008.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 810 kB/s | 81 kB 00:00 2023-10-18T20:48:40.159 INFO:teuthology.orchestra.run.smithi008.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 640 kB/s | 64 kB 00:00 2023-10-18T20:48:40.268 INFO:teuthology.orchestra.run.smithi008.stdout:(12/13): python3-kubernetes-11.0.0-6.el8.noarch 5.2 MB/s | 1.2 MB 00:00 2023-10-18T20:48:40.293 INFO:teuthology.orchestra.run.smithi008.stdout:(13/13): python3-websocket-client-0.56.0-5.el8. 367 kB/s | 61 kB 00:00 2023-10-18T20:48:40.293 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:40.294 INFO:teuthology.orchestra.run.smithi008.stdout:Total 824 kB/s | 1.9 MB 00:02 2023-10-18T20:48:40.436 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:48:40.457 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:48:40.457 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:48:40.568 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:48:40.572 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:48:41.106 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:48:41.354 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-10-18T20:48:41.450 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-10-18T20:48:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-10-18T20:48:41.754 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-10-18T20:48:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-10-18T20:48:41.966 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-10-18T20:48:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-10-18T20:48:42.209 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-10-18T20:48:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2023-10-18T20:48:42.428 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-10-18T20:48:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2023-10-18T20:48:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2023-10-18T20:48:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-10-18T20:48:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-10-18T20:48:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-10-18T20:48:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-10-18T20:48:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-10-18T20:48:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-10-18T20:48:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-10-18T20:48:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-10-18T20:48:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-10-18T20:48:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-10-18T20:48:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-10-18T20:48:42.694 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-10-18T20:48:43.012 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-10-18T20:48:43.262 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-10-18T20:48:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-10-18T20:48:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:43.430 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:48:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2023-10-18T20:48:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-18T20:48:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-18T20:48:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-18T20:48:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-18T20:48:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-18T20:48:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-18T20:48:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-18T20:48:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-18T20:48:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-18T20:48:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-18T20:48:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-18T20:48:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-18T20:48:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:43.434 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:48:43.576 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-cephadm 2023-10-18T20:48:44.586 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-10-18T20:48:44.673 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:13 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:48:44.883 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-10-18T20:48:45.084 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-10-18T20:48:45.300 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-10-18T20:48:45.482 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2023-10-18T20:48:45.835 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2023-10-18T20:48:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2023-10-18T20:48:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-10-18T20:48:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-10-18T20:48:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-10-18T20:48:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-10-18T20:48:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-10-18T20:48:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-10-18T20:48:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-10-18T20:48:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-10-18T20:48:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-10-18T20:48:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-10-18T20:48:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-10-18T20:48:46.487 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:48:46.489 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:46.489 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-18T20:48:46.489 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:46.489 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:48:46.490 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2023-10-18T20:48:46.490 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-18T20:48:46.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-10-18T20:48:46.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-18T20:48:46.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-10-18T20:48:46.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-18T20:48:46.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-10-18T20:48:46.491 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:46.491 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:48:46.492 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:46.492 INFO:teuthology.orchestra.run.smithi060.stdout:Install 6 Packages 2023-10-18T20:48:46.492 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:46.493 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 5.8 M 2023-10-18T20:48:46.493 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 24 M 2023-10-18T20:48:46.493 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:48:46.660 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-10-18T20:48:46.660 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:46.660 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:48:46.661 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2023-10-18T20:48:46.661 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-18T20:48:46.661 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-18T20:48:46.661 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-18T20:48:46.662 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-18T20:48:46.662 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-18T20:48:46.662 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-18T20:48:46.662 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-18T20:48:46.662 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-18T20:48:46.663 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-18T20:48:46.663 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-18T20:48:46.663 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-18T20:48:46.663 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-18T20:48:46.664 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:46.664 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:48:46.815 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-cephadm 2023-10-18T20:48:46.974 INFO:teuthology.orchestra.run.smithi060.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 392 kB/s | 89 kB 00:00 2023-10-18T20:48:47.174 INFO:teuthology.orchestra.run.smithi060.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 106 kB/s | 21 kB 00:00 2023-10-18T20:48:47.349 INFO:teuthology.orchestra.run.smithi060.stdout:(3/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 892 kB/s | 538 kB 00:00 2023-10-18T20:48:47.433 INFO:teuthology.orchestra.run.smithi060.stdout:(4/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.3 MB/s | 355 kB 00:00 2023-10-18T20:48:47.566 INFO:teuthology.orchestra.run.smithi060.stdout:(5/6): python3-babel-2.5.1-7.el8.noarch.rpm 5.8 MB/s | 4.8 MB 00:00 2023-10-18T20:48:47.591 INFO:teuthology.orchestra.run.smithi060.stdout:(6/6): python3-remoto-1.2.1-1.el8.noarch.rpm 202 kB/s | 49 kB 00:00 2023-10-18T20:48:47.592 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:47.593 INFO:teuthology.orchestra.run.smithi060.stdout:Total 5.3 MB/s | 5.8 MB 00:01 2023-10-18T20:48:47.673 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:48:47.686 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:48:47.687 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:48:47.808 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:48:47.811 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:48:47.909 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:13 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:48:48.126 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:48:48.406 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2023-10-18T20:48:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2023-10-18T20:48:49.718 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:48:49.719 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-18T20:48:49.720 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:49.720 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:48:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2023-10-18T20:48:49.720 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-18T20:48:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-10-18T20:48:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-18T20:48:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-10-18T20:48:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-18T20:48:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-10-18T20:48:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:49.722 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:48:49.722 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:49.722 INFO:teuthology.orchestra.run.smithi008.stdout:Install 6 Packages 2023-10-18T20:48:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:49.724 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 5.8 M 2023-10-18T20:48:49.724 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 24 M 2023-10-18T20:48:49.724 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:48:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2023-10-18T20:48:49.894 INFO:teuthology.orchestra.run.smithi008.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 1.7 MB/s | 89 kB 00:00 2023-10-18T20:48:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2023-10-18T20:48:50.203 INFO:teuthology.orchestra.run.smithi008.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 69 kB/s | 21 kB 00:00 2023-10-18T20:48:50.286 INFO:teuthology.orchestra.run.smithi008.stdout:(3/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.2 MB/s | 538 kB 00:00 2023-10-18T20:48:50.492 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2023-10-18T20:48:50.553 INFO:teuthology.orchestra.run.smithi008.stdout:(4/6): python3-babel-2.5.1-7.el8.noarch.rpm 6.7 MB/s | 4.8 MB 00:00 2023-10-18T20:48:50.670 INFO:teuthology.orchestra.run.smithi008.stdout:(5/6): python3-execnet-1.7.1-1.el8.noarch.rpm 761 kB/s | 355 kB 00:00 2023-10-18T20:48:50.694 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2023-10-18T20:48:50.695 INFO:teuthology.orchestra.run.smithi008.stdout:(6/6): python3-remoto-1.2.1-1.el8.noarch.rpm 119 kB/s | 49 kB 00:00 2023-10-18T20:48:50.697 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:50.697 INFO:teuthology.orchestra.run.smithi008.stdout:Total 6.0 MB/s | 5.8 MB 00:00 2023-10-18T20:48:50.779 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:48:50.793 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:48:50.793 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:48:50.923 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:48:50.927 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:48:51.056 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2023-10-18T20:48:51.057 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2023-10-18T20:48:51.057 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2023-10-18T20:48:51.057 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2023-10-18T20:48:51.057 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2023-10-18T20:48:51.057 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2023-10-18T20:48:51.224 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:48:51.501 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2023-10-18T20:48:51.753 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2023-10-18T20:48:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2023-10-18T20:48:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:51.818 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:48:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2023-10-18T20:48:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2023-10-18T20:48:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.10.1-3.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2023-10-18T20:48:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:51.819 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:48:51.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-fuse 2023-10-18T20:48:52.903 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2023-10-18T20:48:53.070 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:22 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:48:53.293 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2023-10-18T20:48:53.579 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2023-10-18T20:48:53.823 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2023-10-18T20:48:54.184 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2023-10-18T20:48:54.185 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2023-10-18T20:48:54.185 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2023-10-18T20:48:54.185 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2023-10-18T20:48:54.185 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2023-10-18T20:48:54.185 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2023-10-18T20:48:54.874 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:48:54.875 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-18T20:48:54.875 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:54.875 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:48:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2023-10-18T20:48:54.876 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-18T20:48:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-18T20:48:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:54.877 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:48:54.877 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:48:54.877 INFO:teuthology.orchestra.run.smithi060.stdout:Install 2 Packages 2023-10-18T20:48:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:54.878 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 968 k 2023-10-18T20:48:54.878 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 3.2 M 2023-10-18T20:48:54.878 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:48:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2023-10-18T20:48:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:54.938 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:48:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2023-10-18T20:48:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2023-10-18T20:48:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.10.1-3.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2023-10-18T20:48:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:54.940 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:48:55.102 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-fuse 2023-10-18T20:48:55.184 INFO:teuthology.orchestra.run.smithi060.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 14 MB/s | 885 kB 00:00 2023-10-18T20:48:55.284 INFO:teuthology.orchestra.run.smithi060.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 509 kB/s | 83 kB 00:00 2023-10-18T20:48:55.285 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:55.286 INFO:teuthology.orchestra.run.smithi060.stdout:Total 2.3 MB/s | 968 kB 00:00 2023-10-18T20:48:55.309 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:48:55.336 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:48:55.336 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:48:55.447 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:48:55.451 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:48:55.648 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:48:55.930 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-10-18T20:48:56.111 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2023-10-18T20:48:56.198 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:22 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:48:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2023-10-18T20:48:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2023-10-18T20:48:57.978 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-10-18T20:48:57.978 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:48:57.979 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-10-18T20:48:57.979 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:48:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:48:58.007 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:48:58.008 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:58.009 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-18T20:48:58.009 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:58.009 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:48:58.010 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2023-10-18T20:48:58.010 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-18T20:48:58.010 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-18T20:48:58.011 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:58.011 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:48:58.012 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:48:58.012 INFO:teuthology.orchestra.run.smithi008.stdout:Install 2 Packages 2023-10-18T20:48:58.012 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:48:58.013 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 968 k 2023-10-18T20:48:58.013 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 3.2 M 2023-10-18T20:48:58.013 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:48:58.113 INFO:teuthology.orchestra.run.smithi008.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 15 MB/s | 885 kB 00:00 2023-10-18T20:48:58.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librados-devel 2023-10-18T20:48:58.205 INFO:teuthology.orchestra.run.smithi008.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 557 kB/s | 83 kB 00:00 2023-10-18T20:48:58.206 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:48:58.206 INFO:teuthology.orchestra.run.smithi008.stdout:Total 4.8 MB/s | 968 kB 00:00 2023-10-18T20:48:58.229 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:48:58.255 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:48:58.256 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:48:58.366 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:48:58.369 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:48:58.588 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:48:58.893 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-10-18T20:48:59.302 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:28 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:48:59.791 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2023-10-18T20:49:00.435 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2023-10-18T20:49:00.435 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2023-10-18T20:49:01.102 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:01.103 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:01.103 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-18T20:49:01.103 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:01.103 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:49:01.103 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2023-10-18T20:49:01.104 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:01.104 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:49:01.104 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:01.104 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2023-10-18T20:49:01.104 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:01.105 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 131 k 2023-10-18T20:49:01.105 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 439 k 2023-10-18T20:49:01.105 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:49:01.147 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-10-18T20:49:01.148 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:01.148 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:49:01.148 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-10-18T20:49:01.148 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:01.149 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:01.164 INFO:teuthology.orchestra.run.smithi060.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 2.1 MB/s | 131 kB 00:00 2023-10-18T20:49:01.165 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:49:01.165 INFO:teuthology.orchestra.run.smithi060.stdout:Total 2.1 MB/s | 131 kB 00:00 2023-10-18T20:49:01.166 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:49:01.174 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:49:01.174 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:49:01.235 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:49:01.238 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:49:01.363 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:49:01.406 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install librados-devel 2023-10-18T20:49:01.576 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:01.968 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:02.531 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:28 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:02.691 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:02.692 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:02.692 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:49:02.692 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2023-10-18T20:49:02.692 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:02.692 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:03.466 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install libcephfs2 2023-10-18T20:49:04.382 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:04.382 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:04.383 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-18T20:49:04.383 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:04.383 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:49:04.383 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2023-10-18T20:49:04.383 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:04.384 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:49:04.384 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:04.384 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-18T20:49:04.384 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:04.385 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 131 k 2023-10-18T20:49:04.385 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 439 k 2023-10-18T20:49:04.385 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:49:04.435 INFO:teuthology.orchestra.run.smithi008.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 2.5 MB/s | 131 kB 00:00 2023-10-18T20:49:04.436 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:49:04.436 INFO:teuthology.orchestra.run.smithi008.stdout:Total 2.5 MB/s | 131 kB 00:00 2023-10-18T20:49:04.436 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:49:04.444 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:49:04.444 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:49:04.505 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:49:04.508 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:49:04.587 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:33 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:05.554 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:49:05.755 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:06.135 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:06.145 INFO:teuthology.orchestra.run.smithi060.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:06.370 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:06.372 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-18T20:49:06.372 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:06.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install libcephfs-devel 2023-10-18T20:49:06.849 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:06.849 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:06.849 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:49:06.850 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2023-10-18T20:49:06.850 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:06.850 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:07.057 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install libcephfs2 2023-10-18T20:49:07.612 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:36 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:08.182 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:34 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:09.408 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:09.409 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:09.409 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-18T20:49:09.409 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:09.409 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:49:09.409 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2023-10-18T20:49:09.410 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:09.410 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:49:09.410 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:09.410 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2023-10-18T20:49:09.410 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:09.411 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 24 k 2023-10-18T20:49:09.411 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 94 k 2023-10-18T20:49:09.411 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:49:09.445 INFO:teuthology.orchestra.run.smithi060.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 695 kB/s | 24 kB 00:00 2023-10-18T20:49:09.445 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:49:09.446 INFO:teuthology.orchestra.run.smithi060.stdout:Total 667 kB/s | 24 kB 00:00 2023-10-18T20:49:09.446 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:49:09.451 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:49:09.452 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:49:09.456 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:49:09.460 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:49:09.512 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:49:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:09.979 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:09.981 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-18T20:49:09.982 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:10.046 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:10.101 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install libcephfs-devel 2023-10-18T20:49:10.731 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:10.731 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:10.731 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:49:10.731 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2023-10-18T20:49:10.731 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:10.732 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:10.881 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librados2 2023-10-18T20:49:11.215 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:37 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:12.001 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:40 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:13.004 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:13.004 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-18T20:49:13.005 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:13.005 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:49:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2023-10-18T20:49:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:13.006 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:49:13.006 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:13.006 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-18T20:49:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:13.007 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 24 k 2023-10-18T20:49:13.007 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 94 k 2023-10-18T20:49:13.007 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:49:13.057 INFO:teuthology.orchestra.run.smithi008.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 472 kB/s | 24 kB 00:00 2023-10-18T20:49:13.058 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:49:13.059 INFO:teuthology.orchestra.run.smithi008.stdout:Total 459 kB/s | 24 kB 00:00 2023-10-18T20:49:13.059 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:49:13.064 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:49:13.064 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:49:13.069 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:49:13.072 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:49:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:49:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:13.588 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-18T20:49:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:13.940 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librbd1 2023-10-18T20:49:14.338 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:14.339 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:49:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2023-10-18T20:49:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:14.340 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:14.483 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install librados2 2023-10-18T20:49:15.053 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:44 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:41 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:16.686 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:16.911 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:16.913 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-18T20:49:16.913 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:17.060 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rados 2023-10-18T20:49:17.170 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:17.394 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:17.395 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-18T20:49:17.395 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:17.511 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install librbd1 2023-10-18T20:49:18.178 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:47 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:18.628 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:44 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:19.780 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:20.005 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:20.014 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-18T20:49:20.014 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:20.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rgw 2023-10-18T20:49:20.202 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:20.427 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:20.428 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-18T20:49:20.429 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:20.723 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-rados 2023-10-18T20:49:21.242 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:50 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:21.835 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:47 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:22.979 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:23.204 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:23.206 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-18T20:49:23.206 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:23.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-cephfs 2023-10-18T20:49:23.562 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:23.786 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:23.787 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-18T20:49:23.787 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:23.907 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-rgw 2023-10-18T20:49:24.443 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:53 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:25.018 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:51 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:26.000 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:26.228 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:26.230 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-18T20:49:26.230 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:26.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rbd 2023-10-18T20:49:26.595 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:26.820 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:26.821 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-18T20:49:26.822 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:26.940 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-cephfs 2023-10-18T20:49:27.459 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:56 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:28.055 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:54 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:29.044 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:29.269 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:29.271 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-18T20:49:29.271 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:29.392 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-fuse 2023-10-18T20:49:29.616 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:29.842 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:29.844 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-18T20:49:29.844 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:29.968 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-rbd 2023-10-18T20:49:30.508 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:59 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:31.082 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:57 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:32.297 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:32.298 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:32.298 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-18T20:49:32.299 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:32.299 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:49:32.299 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2023-10-18T20:49:32.299 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:32.300 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:49:32.300 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:32.300 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2023-10-18T20:49:32.300 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:32.301 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 89 k 2023-10-18T20:49:32.301 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 298 k 2023-10-18T20:49:32.301 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:49:32.351 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 1.7 MB/s | 89 kB 00:00 2023-10-18T20:49:32.352 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:49:32.352 INFO:teuthology.orchestra.run.smithi060.stdout:Total 1.6 MB/s | 89 kB 00:00 2023-10-18T20:49:32.353 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:49:32.366 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:49:32.366 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:49:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:49:32.430 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:49:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:49:32.707 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2023-10-18T20:49:32.772 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:32.932 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:32.933 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-18T20:49:32.933 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:33.050 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install rbd-fuse 2023-10-18T20:49:33.154 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:33.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:33.855 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:33.856 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:49:33.856 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2023-10-18T20:49:33.856 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:33.856 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:34.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-mirror 2023-10-18T20:49:34.170 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:00 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:35.226 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:03:04 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:36.011 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:36.011 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-18T20:49:36.012 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:36.012 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:49:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2023-10-18T20:49:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:36.013 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:49:36.013 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:36.013 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-18T20:49:36.013 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:36.014 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 89 k 2023-10-18T20:49:36.014 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 298 k 2023-10-18T20:49:36.014 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:49:36.065 INFO:teuthology.orchestra.run.smithi008.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 1.7 MB/s | 89 kB 00:00 2023-10-18T20:49:36.065 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:49:36.066 INFO:teuthology.orchestra.run.smithi008.stdout:Total 1.6 MB/s | 89 kB 00:00 2023-10-18T20:49:36.066 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:49:36.079 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:49:36.079 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:49:36.140 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:49:36.143 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:49:36.271 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:49:36.459 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:36.834 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:37.053 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:37.053 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:37.053 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-18T20:49:37.054 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:37.054 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:49:37.054 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2023-10-18T20:49:37.054 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:37.055 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:49:37.055 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:37.055 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2023-10-18T20:49:37.055 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:37.056 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 3.7 M 2023-10-18T20:49:37.056 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 18 M 2023-10-18T20:49:37.056 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:49:37.171 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 32 MB/s | 3.7 MB 00:00 2023-10-18T20:49:37.172 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:49:37.172 INFO:teuthology.orchestra.run.smithi060.stdout:Total 31 MB/s | 3.7 MB 00:00 2023-10-18T20:49:37.173 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:49:37.189 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:49:37.189 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:49:37.263 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:49:37.266 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:49:37.562 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:37.562 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:37.562 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:49:37.562 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2023-10-18T20:49:37.563 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:37.563 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:37.778 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install rbd-mirror 2023-10-18T20:49:37.796 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:49:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:38.697 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:38.897 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:04 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:39.426 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:39.427 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:39.427 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:49:39.427 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2023-10-18T20:49:39.427 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:39.428 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:39.651 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-nbd 2023-10-18T20:49:40.693 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:40.694 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:40.694 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-18T20:49:40.694 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:40.695 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:49:40.695 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2023-10-18T20:49:40.695 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:40.695 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:49:40.695 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:40.695 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-18T20:49:40.696 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:40.696 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 3.7 M 2023-10-18T20:49:40.696 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 18 M 2023-10-18T20:49:40.697 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:49:40.775 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:03:09 ago on Wed 18 Oct 2023 08:46:31 PM UTC. 2023-10-18T20:49:40.792 INFO:teuthology.orchestra.run.smithi008.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 38 MB/s | 3.7 MB 00:00 2023-10-18T20:49:40.793 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:49:40.794 INFO:teuthology.orchestra.run.smithi008.stdout:Total 38 MB/s | 3.7 MB 00:00 2023-10-18T20:49:40.794 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:49:40.810 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:49:40.810 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:49:40.885 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:49:40.888 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:49:41.462 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:49:41.701 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:42.385 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:42.559 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-18T20:49:42.560 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-18T20:49:42.560 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:42.560 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-18T20:49:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2023-10-18T20:49:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:42.561 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-18T20:49:42.561 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-18T20:49:42.561 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2023-10-18T20:49:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:42.562 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 173 k 2023-10-18T20:49:42.562 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 649 k 2023-10-18T20:49:42.563 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-18T20:49:42.608 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 3.6 MB/s | 173 kB 00:00 2023-10-18T20:49:42.609 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:49:42.609 INFO:teuthology.orchestra.run.smithi060.stdout:Total 3.5 MB/s | 173 kB 00:00 2023-10-18T20:49:42.609 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-18T20:49:42.623 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-18T20:49:42.623 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-18T20:49:42.684 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-18T20:49:42.688 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-18T20:49:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-18T20:49:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:43.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:43.086 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:43.087 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:49:43.087 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2023-10-18T20:49:43.087 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:43.087 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:43.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install rbd-nbd 2023-10-18T20:49:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:44.176 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:44.176 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:44.176 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-18T20:49:44.177 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2023-10-18T20:49:44.177 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:49:44.177 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-18T20:49:44.404 DEBUG:teuthology.parallel:result is None 2023-10-18T20:49:44.445 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:10 ago on Wed 18 Oct 2023 08:46:34 PM UTC. 2023-10-18T20:49:46.298 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-18T20:49:46.300 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:46.300 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-18T20:49:46.300 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:46.300 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-18T20:49:46.300 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2023-10-18T20:49:46.301 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:46.301 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-18T20:49:46.301 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-18T20:49:46.301 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-18T20:49:46.301 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:46.302 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 173 k 2023-10-18T20:49:46.302 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 649 k 2023-10-18T20:49:46.302 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-18T20:49:46.354 INFO:teuthology.orchestra.run.smithi008.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 3.2 MB/s | 173 kB 00:00 2023-10-18T20:49:46.355 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-18T20:49:46.355 INFO:teuthology.orchestra.run.smithi008.stdout:Total 3.1 MB/s | 173 kB 00:00 2023-10-18T20:49:46.356 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-18T20:49:46.370 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-18T20:49:46.370 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-18T20:49:46.430 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-18T20:49:46.433 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-18T20:49:46.560 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-18T20:49:46.899 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:47.280 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:48.056 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-10-18T20:49:48.056 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:48.057 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-18T20:49:48.057 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2023-10-18T20:49:48.057 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:49:48.057 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-18T20:49:48.252 DEBUG:teuthology.parallel:result is None 2023-10-18T20:49:48.253 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-10-18T20:49:48.253 INFO:teuthology.packaging:ref: None 2023-10-18T20:49:48.253 INFO:teuthology.packaging:tag: v16.2.4 2023-10-18T20:49:48.254 INFO:teuthology.packaging:branch: None 2023-10-18T20:49:48.254 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:49:48.468 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-10-18T20:49:48.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-10-18T20:49:48.613 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T20:49:48.671 INFO:teuthology.orchestra.run.smithi008.stdout:16.2.4-0.el8 2023-10-18T20:49:48.672 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2023-10-18T20:49:48.673 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2023-10-18T20:49:48.673 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-10-18T20:49:48.674 INFO:teuthology.packaging:ref: None 2023-10-18T20:49:48.674 INFO:teuthology.packaging:tag: v16.2.4 2023-10-18T20:49:48.674 INFO:teuthology.packaging:branch: None 2023-10-18T20:49:48.675 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:49:48.872 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-10-18T20:49:48.873 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-10-18T20:49:49.018 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T20:49:49.079 INFO:teuthology.orchestra.run.smithi060.stdout:16.2.4-0.el8 2023-10-18T20:49:49.080 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2023-10-18T20:49:49.080 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2023-10-18T20:49:49.081 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-18T20:49:49.082 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:49:49.082 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T20:49:49.159 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:49:49.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T20:49:49.235 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-18T20:49:49.236 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:49:49.236 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T20:49:49.309 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T20:49:49.420 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:49:49.421 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T20:49:49.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T20:49:49.606 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-18T20:49:49.607 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:49:49.607 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T20:49:49.679 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T20:49:49.790 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:49:49.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T20:49:49.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T20:49:49.972 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-18T20:49:49.972 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:49:49.973 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T20:49:50.044 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T20:49:50.155 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:49:50.155 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T20:49:50.228 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T20:49:50.339 INFO:teuthology.run_tasks:Running task print... 2023-10-18T20:49:50.353 INFO:teuthology.task.print:**** done install task... 2023-10-18T20:49:50.354 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-18T20:49:50.545 INFO:tasks.cephadm:Config: {'avoid_pacific_features': True, 'cephadm_branch': 'v16.2.4', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v16.2.4', 'roleless': True, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'} 2023-10-18T20:49:50.546 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v16.2.4 2023-10-18T20:49:50.547 INFO:tasks.cephadm:Cluster fsid is e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:49:50.547 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-18T20:49:50.547 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-10-18T20:49:50.548 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi008': '172.21.15.8', 'mon.smithi060': '172.21.15.60'} 2023-10-18T20:49:50.548 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-18T20:49:50.548 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname $(hostname -s) 2023-10-18T20:49:50.623 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2023-10-18T20:49:50.698 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v16.2.4)... 2023-10-18T20:49:50.698 DEBUG:teuthology.orchestra.run.smithi008:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-18T20:49:50.990 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Oct 18 20:49 /home/ubuntu/cephtest/cephadm 2023-10-18T20:49:50.991 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-18T20:49:51.366 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Oct 18 20:49 /home/ubuntu/cephtest/cephadm 2023-10-18T20:49:51.366 DEBUG:teuthology.orchestra.run.smithi008:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-18T20:49:51.420 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-18T20:49:51.484 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph 2023-10-18T20:49:51.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2023-10-18T20:49:51.634 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /etc/ceph 2023-10-18T20:49:51.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2023-10-18T20:49:51.779 INFO:tasks.cephadm:Writing seed config... 2023-10-18T20:49:51.796 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-10-18T20:49:51.797 INFO:tasks.cephadm: override: [client] debug client = 20 2023-10-18T20:49:51.797 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-10-18T20:49:51.797 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-10-18T20:49:51.798 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-10-18T20:49:51.798 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-10-18T20:49:51.798 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-10-18T20:49:51.798 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-10-18T20:49:51.799 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-10-18T20:49:51.799 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-10-18T20:49:51.799 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-10-18T20:49:51.799 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-10-18T20:49:51.800 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-10-18T20:49:51.800 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-10-18T20:49:51.800 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-10-18T20:49:51.800 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-18T20:49:51.801 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-18T20:49:51.801 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-18T20:49:51.801 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-18T20:49:51.801 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-18T20:49:51.802 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-10-18T20:49:51.802 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-10-18T20:49:51.802 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-10-18T20:49:51.803 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-10-18T20:49:51.803 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-18T20:49:51.803 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-18T20:49:51.803 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-10-18T20:49:51.804 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-10-18T20:49:51.804 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-18T20:49:51.804 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-18T20:49:51.804 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-10-18T20:49:51.805 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-18T20:49:51.805 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-18T20:49:51.805 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-18T20:49:51.805 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-18T20:49:51.806 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-18T20:49:51.806 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-10-18T20:49:51.807 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:49:51.807 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-18T20:49:51.854 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e1aaa62c-6df7-11ee-8db6-212e2dc638e7 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-10-18T20:49:51.854 DEBUG:teuthology.orchestra.run.smithi008:mon.smithi008> sudo journalctl -f -n 0 -u ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008.service 2023-10-18T20:49:51.899 INFO:tasks.cephadm:Bootstrapping... 2023-10-18T20:49:51.899 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 -v bootstrap --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.8 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-18T20:49:51.970 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:-- Logs begin at Wed 2023-10-18 20:15:27 UTC. -- 2023-10-18T20:49:52.269 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2023-10-18T20:49:53.263 INFO:teuthology.orchestra.run.smithi008.stderr:/bin/podman: 4.6.1 2023-10-18T20:49:53.267 INFO:teuthology.orchestra.run.smithi008.stderr:Verifying podman|docker is present... 2023-10-18T20:49:53.267 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2023-10-18T20:49:53.308 INFO:teuthology.orchestra.run.smithi008.stderr:/bin/podman: 4.6.1 2023-10-18T20:49:53.315 INFO:teuthology.orchestra.run.smithi008.stderr:Verifying lvm2 is present... 2023-10-18T20:49:53.316 INFO:teuthology.orchestra.run.smithi008.stderr:Verifying time synchronization is in place... 2023-10-18T20:49:53.316 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-enabled chrony.service 2023-10-18T20:49:53.329 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2023-10-18T20:49:53.331 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-active chrony.service 2023-10-18T20:49:53.342 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: inactive 2023-10-18T20:49:53.344 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-enabled chronyd.service 2023-10-18T20:49:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: enabled 2023-10-18T20:49:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-active chronyd.service 2023-10-18T20:49:53.370 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: active 2023-10-18T20:49:53.371 INFO:teuthology.orchestra.run.smithi008.stderr:Unit chronyd.service is enabled and running 2023-10-18T20:49:53.371 INFO:teuthology.orchestra.run.smithi008.stderr:Repeating the final host check... 2023-10-18T20:49:53.371 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2023-10-18T20:49:53.410 INFO:teuthology.orchestra.run.smithi008.stderr:/bin/podman: 4.6.1 2023-10-18T20:49:53.414 INFO:teuthology.orchestra.run.smithi008.stderr:podman|docker (/bin/podman) is present 2023-10-18T20:49:53.415 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl is present 2023-10-18T20:49:53.415 INFO:teuthology.orchestra.run.smithi008.stderr:lvcreate is present 2023-10-18T20:49:53.415 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-enabled chrony.service 2023-10-18T20:49:53.427 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2023-10-18T20:49:53.428 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-active chrony.service 2023-10-18T20:49:53.441 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: inactive 2023-10-18T20:49:53.441 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-enabled chronyd.service 2023-10-18T20:49:53.454 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: enabled 2023-10-18T20:49:53.455 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-active chronyd.service 2023-10-18T20:49:53.467 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: active 2023-10-18T20:49:53.468 INFO:teuthology.orchestra.run.smithi008.stderr:Unit chronyd.service is enabled and running 2023-10-18T20:49:53.468 INFO:teuthology.orchestra.run.smithi008.stderr:Host looks OK 2023-10-18T20:49:53.469 INFO:teuthology.orchestra.run.smithi008.stderr:Cluster fsid: e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:49:53.469 INFO:teuthology.orchestra.run.smithi008.stderr:Acquiring lock 140594688068072 on /run/cephadm/e1aaa62c-6df7-11ee-8db6-212e2dc638e7.lock 2023-10-18T20:49:53.470 INFO:teuthology.orchestra.run.smithi008.stderr:Lock 140594688068072 acquired on /run/cephadm/e1aaa62c-6df7-11ee-8db6-212e2dc638e7.lock 2023-10-18T20:49:53.470 INFO:teuthology.orchestra.run.smithi008.stderr:Verifying IP 172.21.15.8 port 3300 ... 2023-10-18T20:49:53.470 INFO:teuthology.orchestra.run.smithi008.stderr:Verifying IP 172.21.15.8 port 6789 ... 2023-10-18T20:49:53.471 INFO:teuthology.orchestra.run.smithi008.stderr:Base mon IP is 172.21.15.8, final addrv is [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2023-10-18T20:49:53.471 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /sbin/ip route ls 2023-10-18T20:49:53.476 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.8 metric 100 2023-10-18T20:49:53.476 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.8 metric 100 2023-10-18T20:49:53.477 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /sbin/ip -6 route ls 2023-10-18T20:49:53.483 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2023-10-18T20:49:53.483 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-18T20:49:53.484 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2023-10-18T20:49:53.484 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /sbin/ip -6 addr ls 2023-10-18T20:49:53.490 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-18T20:49:53.491 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: inet6 ::1/128 scope host 2023-10-18T20:49:53.491 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2023-10-18T20:49:53.491 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2023-10-18T20:49:53.491 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-18T20:49:53.491 INFO:teuthology.orchestra.run.smithi008.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2023-10-18T20:49:53.492 INFO:teuthology.orchestra.run.smithi008.stderr:Mon IP 172.21.15.8 is in CIDR network 172.21.0.0/20 2023-10-18T20:49:53.492 INFO:teuthology.orchestra.run.smithi008.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-18T20:49:53.493 INFO:teuthology.orchestra.run.smithi008.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2023-10-18T20:49:53.494 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman pull docker.io/ceph/ceph:v16.2.4 2023-10-18T20:49:53.607 INFO:teuthology.orchestra.run.smithi008.stderr:/bin/podman: Trying to pull docker.io/ceph/ceph:v16.2.4... 2023-10-18T20:50:00.259 INFO:teuthology.orchestra.run.smithi008.stderr:/bin/podman: Getting image source signatures 2023-10-18T20:50:00.273 INFO:teuthology.orchestra.run.smithi008.stderr:/bin/podman: Copying blob sha256:551101690791055467b1840be133b2e6b029d263771bc6c46a96bb7acdacac39 2023-10-18T20:50:00.273 INFO:teuthology.orchestra.run.smithi008.stderr:/bin/podman: Copying blob sha256:7a0437f04f83f084b7ed68ad9c4a4947e12fc4e1b006b38129bac89114ec3621 2023-10-18T20:50:17.944 INFO:teuthology.orchestra.run.smithi008.stderr:/bin/podman: Copying config sha256:8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2023-10-18T20:50:18.001 INFO:teuthology.orchestra.run.smithi008.stderr:/bin/podman: Writing manifest to image destination 2023-10-18T20:50:18.423 INFO:teuthology.orchestra.run.smithi008.stderr:/bin/podman: 8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2023-10-18T20:50:18.437 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --version 2023-10-18T20:50:19.061 INFO:teuthology.orchestra.run.smithi008.stderr:ceph: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2023-10-18T20:50:19.394 INFO:teuthology.orchestra.run.smithi008.stderr:Ceph version: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2023-10-18T20:50:19.394 INFO:teuthology.orchestra.run.smithi008.stderr:Extracting ceph user uid/gid from container image... 2023-10-18T20:50:19.395 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint stat --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 -c %u %g /var/lib/ceph 2023-10-18T20:50:19.700 INFO:teuthology.orchestra.run.smithi008.stderr:stat: 167 167 2023-10-18T20:50:20.002 INFO:teuthology.orchestra.run.smithi008.stderr:Creating initial keys... 2023-10-18T20:50:20.002 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2023-10-18T20:50:20.275 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-authtool: AQAMRTBlgUEhEBAAsFCGFlIa1VuBdk8/1Aos7g== 2023-10-18T20:50:20.586 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2023-10-18T20:50:20.849 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-authtool: AQAMRTBl24hfMhAAmlTaLLlQj7eUoXmq07JBbQ== 2023-10-18T20:50:21.171 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2023-10-18T20:50:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-authtool: AQANRTBllyUDGhAA6P95EXsfheBuJuHNibhTMA== 2023-10-18T20:50:21.791 INFO:teuthology.orchestra.run.smithi008.stderr:Creating initial monmap... 2023-10-18T20:50:21.791 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmpkd9_t7_k:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --create --clobber --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 --addv smithi008 [v2:172.21.15.8:3300,v1:172.21.15.8:6789] /tmp/monmap 2023-10-18T20:50:22.083 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-18T20:50:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-18T20:50:22.393 INFO:teuthology.orchestra.run.smithi008.stderr:monmaptool for smithi008 [v2:172.21.15.8:3300,v1:172.21.15.8:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-18T20:50:22.393 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/monmaptool: set fsid to e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:22.393 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-18T20:50:22.394 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-18T20:50:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:Creating mon... 2023-10-18T20:50:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008:/var/lib/ceph/mon/ceph-smithi008:z -v /tmp/ceph-tmp1dkw23y9:/tmp/keyring:z -v /tmp/ceph-tmpkd9_t7_k:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --mkfs -i smithi008 --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2023-10-18T20:50:22.687 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.683+0000 7f86c6a5d700 0 set uid:gid to 167:167 (ceph:ceph) 2023-10-18T20:50:22.688 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.683+0000 7f86c6a5d700 1 imported monmap: 2023-10-18T20:50:22.688 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: epoch 0 2023-10-18T20:50:22.688 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:22.688 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: last_changed 2023-10-18T20:50:22.074847+0000 2023-10-18T20:50:22.688 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: created 2023-10-18T20:50:22.074847+0000 2023-10-18T20:50:22.688 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2023-10-18T20:50:22.689 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: election_strategy: 1 2023-10-18T20:50:22.689 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon.smithi008 2023-10-18T20:50:22.689 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.689 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.683+0000 7f86c6a5d700 0 /usr/bin/ceph-mon: set fsid to e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:22.691 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: RocksDB version: 6.8.1 2023-10-18T20:50:22.691 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.691 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-10-18T20:50:22.692 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Compile date May 13 2021 2023-10-18T20:50:22.692 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: DB SUMMARY 2023-10-18T20:50:22.692 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.692 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi008/store.db dir, Total Num: 0, files: 2023-10-18T20:50:22.692 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.693 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi008/store.db: 2023-10-18T20:50:22.693 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.693 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.error_if_exists: 0 2023-10-18T20:50:22.693 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.create_if_missing: 1 2023-10-18T20:50:22.693 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.paranoid_checks: 1 2023-10-18T20:50:22.694 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.env: 0x561f403a11c0 2023-10-18T20:50:22.698 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.fs: Posix File System 2023-10-18T20:50:22.699 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.info_log: 0x561f418caec0 2023-10-18T20:50:22.699 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.max_file_opening_threads: 16 2023-10-18T20:50:22.699 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.statistics: (nil) 2023-10-18T20:50:22.699 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.use_fsync: 0 2023-10-18T20:50:22.700 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.max_log_file_size: 0 2023-10-18T20:50:22.700 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-18T20:50:22.700 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.log_file_time_to_roll: 0 2023-10-18T20:50:22.700 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.keep_log_file_num: 1000 2023-10-18T20:50:22.700 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.recycle_log_file_num: 0 2023-10-18T20:50:22.701 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.allow_fallocate: 1 2023-10-18T20:50:22.701 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.allow_mmap_reads: 0 2023-10-18T20:50:22.701 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.allow_mmap_writes: 0 2023-10-18T20:50:22.701 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.use_direct_reads: 0 2023-10-18T20:50:22.701 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-18T20:50:22.702 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.create_missing_column_families: 0 2023-10-18T20:50:22.702 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.db_log_dir: 2023-10-18T20:50:22.702 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi008/store.db 2023-10-18T20:50:22.702 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.table_cache_numshardbits: 6 2023-10-18T20:50:22.702 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.max_subcompactions: 1 2023-10-18T20:50:22.703 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.max_background_flushes: -1 2023-10-18T20:50:22.703 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-10-18T20:50:22.703 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-10-18T20:50:22.703 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-18T20:50:22.703 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-18T20:50:22.704 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-10-18T20:50:22.704 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.advise_random_on_open: 1 2023-10-18T20:50:22.704 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.db_write_buffer_size: 0 2023-10-18T20:50:22.704 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.write_buffer_manager: 0x561f418d1530 2023-10-18T20:50:22.704 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-18T20:50:22.705 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-10-18T20:50:22.705 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-18T20:50:22.705 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.use_adaptive_mutex: 0 2023-10-18T20:50:22.705 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.rate_limiter: (nil) 2023-10-18T20:50:22.705 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-18T20:50:22.705 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.wal_recovery_mode: 2 2023-10-18T20:50:22.706 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.enable_thread_tracking: 0 2023-10-18T20:50:22.706 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.enable_pipelined_write: 0 2023-10-18T20:50:22.706 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.unordered_write: 0 2023-10-18T20:50:22.706 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-18T20:50:22.707 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-18T20:50:22.707 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-18T20:50:22.707 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-18T20:50:22.707 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.row_cache: None 2023-10-18T20:50:22.707 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.wal_filter: None 2023-10-18T20:50:22.707 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-18T20:50:22.708 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.allow_ingest_behind: 0 2023-10-18T20:50:22.708 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.preserve_deletes: 0 2023-10-18T20:50:22.708 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.two_write_queues: 0 2023-10-18T20:50:22.708 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.manual_wal_flush: 0 2023-10-18T20:50:22.708 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.atomic_flush: 0 2023-10-18T20:50:22.709 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-18T20:50:22.709 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.persist_stats_to_disk: 0 2023-10-18T20:50:22.709 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-10-18T20:50:22.726 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.log_readahead_size: 0 2023-10-18T20:50:22.726 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-10-18T20:50:22.726 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.max_background_jobs: 2 2023-10-18T20:50:22.727 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.max_background_compactions: -1 2023-10-18T20:50:22.727 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-18T20:50:22.727 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-18T20:50:22.727 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.delayed_write_rate : 16777216 2023-10-18T20:50:22.727 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.max_total_wal_size: 0 2023-10-18T20:50:22.728 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-18T20:50:22.728 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.stats_dump_period_sec: 600 2023-10-18T20:50:22.728 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.686+0000 7f86c6a5d700 4 rocksdb: Options.stats_persist_period_sec: 600 2023-10-18T20:50:22.728 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-18T20:50:22.728 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: Options.max_open_files: -1 2023-10-18T20:50:22.728 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: Options.bytes_per_sync: 0 2023-10-18T20:50:22.729 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-10-18T20:50:22.729 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-10-18T20:50:22.729 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: Options.compaction_readahead_size: 0 2023-10-18T20:50:22.729 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: Compression algorithms supported: 2023-10-18T20:50:22.729 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-18T20:50:22.730 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: kZSTD supported: 0 2023-10-18T20:50:22.730 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: kXpressCompression supported: 0 2023-10-18T20:50:22.730 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: kLZ4HCCompression supported: 1 2023-10-18T20:50:22.730 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: kLZ4Compression supported: 1 2023-10-18T20:50:22.730 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: kBZip2Compression supported: 0 2023-10-18T20:50:22.731 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: kZlibCompression supported: 1 2023-10-18T20:50:22.731 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: kSnappyCompression supported: 1 2023-10-18T20:50:22.731 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.687+0000 7f86c6a5d700 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-10-18T20:50:22.731 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.688+0000 7f86c6a5d700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2023-10-18T20:50:22.731 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.731 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi008/store.db/MANIFEST-000001 2023-10-18T20:50:22.732 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.732 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-10-18T20:50:22.732 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.732 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-18T20:50:22.732 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.merge_operator: 2023-10-18T20:50:22.733 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_filter: None 2023-10-18T20:50:22.733 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_filter_factory: None 2023-10-18T20:50:22.733 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-10-18T20:50:22.733 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.table_factory: BlockBasedTable 2023-10-18T20:50:22.733 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561f417dc120) 2023-10-18T20:50:22.734 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2023-10-18T20:50:22.734 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-18T20:50:22.734 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-18T20:50:22.734 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2023-10-18T20:50:22.734 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: index_type: 0 2023-10-18T20:50:22.735 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2023-10-18T20:50:22.735 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: index_shortening: 1 2023-10-18T20:50:22.735 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2023-10-18T20:50:22.735 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2023-10-18T20:50:22.735 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: checksum: 1 2023-10-18T20:50:22.736 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2023-10-18T20:50:22.736 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: block_cache: 0x561f41816d10 2023-10-18T20:50:22.736 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2023-10-18T20:50:22.736 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: block_cache_options: 2023-10-18T20:50:22.736 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: capacity : 536870912 2023-10-18T20:50:22.737 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2023-10-18T20:50:22.737 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2023-10-18T20:50:22.737 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2023-10-18T20:50:22.737 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2023-10-18T20:50:22.737 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2023-10-18T20:50:22.737 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: block_size: 4096 2023-10-18T20:50:22.738 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2023-10-18T20:50:22.738 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2023-10-18T20:50:22.738 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2023-10-18T20:50:22.738 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2023-10-18T20:50:22.738 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: partition_filters: 0 2023-10-18T20:50:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2023-10-18T20:50:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2023-10-18T20:50:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2023-10-18T20:50:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: verify_compression: 0 2023-10-18T20:50:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2023-10-18T20:50:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: format_version: 2 2023-10-18T20:50:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2023-10-18T20:50:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: block_align: 0 2023-10-18T20:50:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.write_buffer_size: 33554432 2023-10-18T20:50:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_write_buffer_number: 2 2023-10-18T20:50:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compression: NoCompression 2023-10-18T20:50:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.bottommost_compression: Disabled 2023-10-18T20:50:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.prefix_extractor: nullptr 2023-10-18T20:50:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-18T20:50:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.num_levels: 7 2023-10-18T20:50:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-18T20:50:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-18T20:50:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-18T20:50:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-18T20:50:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-18T20:50:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-18T20:50:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-18T20:50:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-18T20:50:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-18T20:50:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compression_opts.window_bits: -14 2023-10-18T20:50:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compression_opts.level: 32767 2023-10-18T20:50:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compression_opts.strategy: 0 2023-10-18T20:50:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-18T20:50:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-18T20:50:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compression_opts.enabled: false 2023-10-18T20:50:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-18T20:50:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-18T20:50:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-18T20:50:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.target_file_size_base: 67108864 2023-10-18T20:50:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.target_file_size_multiplier: 1 2023-10-18T20:50:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-18T20:50:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-18T20:50:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-18T20:50:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-18T20:50:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-18T20:50:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-18T20:50:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-18T20:50:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-18T20:50:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-18T20:50:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-18T20:50:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-18T20:50:22.748 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-18T20:50:22.748 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.arena_block_size: 4194304 2023-10-18T20:50:22.748 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-18T20:50:22.748 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-18T20:50:22.748 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-10-18T20:50:22.749 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.disable_auto_compactions: 0 2023-10-18T20:50:22.749 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-18T20:50:22.749 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-18T20:50:22.749 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-18T20:50:22.749 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-18T20:50:22.750 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-18T20:50:22.750 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-18T20:50:22.750 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-18T20:50:22.750 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-18T20:50:22.750 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-18T20:50:22.751 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-18T20:50:22.751 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.table_properties_collectors: 2023-10-18T20:50:22.751 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.inplace_update_support: 0 2023-10-18T20:50:22.751 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-10-18T20:50:22.751 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-18T20:50:22.752 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-18T20:50:22.752 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.memtable_huge_page_size: 0 2023-10-18T20:50:22.752 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.bloom_locality: 0 2023-10-18T20:50:22.752 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.max_successive_merges: 0 2023-10-18T20:50:22.752 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-10-18T20:50:22.752 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.paranoid_file_checks: 0 2023-10-18T20:50:22.753 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.force_consistency_checks: 0 2023-10-18T20:50:22.753 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.report_bg_io_stats: 0 2023-10-18T20:50:22.753 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.ttl: 2592000 2023-10-18T20:50:22.753 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.689+0000 7f86c6a5d700 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-10-18T20:50:22.753 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.692+0000 7f86c6a5d700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi008/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-18T20:50:22.754 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.754 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.692+0000 7f86c6a5d700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2023-10-18T20:50:22.754 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.754 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.694+0000 7f86c6a5d700 4 rocksdb: DB pointer 0x561f418dd800 2023-10-18T20:50:22.754 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.694+0000 7f86af8f6700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-10-18T20:50:22.755 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.694+0000 7f86af8f6700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-10-18T20:50:22.755 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2023-10-18T20:50:22.755 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:50:22.755 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-18T20:50:22.755 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T20:50:22.756 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T20:50:22.756 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-18T20:50:22.756 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-10-18T20:50:22.756 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T20:50:22.756 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.757 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2023-10-18T20:50:22.757 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:50:22.757 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:50:22.757 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:50:22.757 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:50:22.757 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.758 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2023-10-18T20:50:22.758 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:50:22.758 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:50:22.758 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:50:22.759 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2023-10-18T20:50:22.759 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T20:50:22.759 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T20:50:22.759 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T20:50:22.759 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2023-10-18T20:50:22.759 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:50:22.760 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:50:22.760 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T20:50:22.760 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.760 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2023-10-18T20:50:22.760 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.761 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2023-10-18T20:50:22.761 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:50:22.761 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:50:22.761 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:50:22.761 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:50:22.761 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.762 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2023-10-18T20:50:22.762 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:50:22.762 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:50:22.762 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:50:22.762 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2023-10-18T20:50:22.763 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T20:50:22.763 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T20:50:22.763 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T20:50:22.763 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2023-10-18T20:50:22.763 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:50:22.764 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:50:22.764 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T20:50:22.764 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.764 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2023-10-18T20:50:22.764 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: 2023-10-18T20:50:22.765 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.698+0000 7f86c6a5d700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2023-10-18T20:50:22.765 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.698+0000 7f86c6a5d700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2023-10-18T20:50:22.765 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph-mon: debug 2023-10-18T20:50:22.698+0000 7f86c6a5d700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi008 for mon.smithi008 2023-10-18T20:50:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:create mon.smithi008 on 2023-10-18T20:50:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:23.063 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl disable ceph.target 2023-10-18T20:50:23.078 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-18T20:50:23.274 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl enable ceph.target 2023-10-18T20:50:23.288 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-18T20:50:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl start ceph.target 2023-10-18T20:50:23.491 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl enable ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7.target 2023-10-18T20:50:23.504 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7.target → /etc/systemd/system/ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7.target. 2023-10-18T20:50:23.504 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7.target → /etc/systemd/system/ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7.target. 2023-10-18T20:50:23.679 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl start ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7.target 2023-10-18T20:50:23.695 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl daemon-reload 2023-10-18T20:50:23.889 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl stop ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008 2023-10-18T20:50:23.988 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl reset-failed ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008 2023-10-18T20:50:23.999 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: Failed to reset failed state of unit ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008.service: Unit ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008.service not loaded. 2023-10-18T20:50:24.001 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl enable ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008 2023-10-18T20:50:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: Created symlink /etc/systemd/system/ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7.target.wants/ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008.service → /etc/systemd/system/ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@.service. 2023-10-18T20:50:24.225 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl start ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008 2023-10-18T20:50:24.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:24 smithi008 systemd[1]: Starting Ceph mon.smithi008 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T20:50:24.633 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-enabled firewalld.service 2023-10-18T20:50:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: disabled 2023-10-18T20:50:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-active firewalld.service 2023-10-18T20:50:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: inactive 2023-10-18T20:50:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:firewalld.service is not enabled 2023-10-18T20:50:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:Not possible to enable service . firewalld.service is not available 2023-10-18T20:50:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:Not possible to open ports <[]>. firewalld.service is not available 2023-10-18T20:50:24.673 INFO:teuthology.orchestra.run.smithi008.stderr:Waiting for mon to start... 2023-10-18T20:50:24.673 INFO:teuthology.orchestra.run.smithi008.stderr:Waiting for mon... 2023-10-18T20:50:24.674 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008:/var/lib/ceph/mon/ceph-smithi008:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status 2023-10-18T20:50:24.890 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:24 smithi008 bash[107331]: 8b298c605acdcdcd1d91fb19ce877fbad5f8276ecaf825dcbe3fa6a978d42779 2023-10-18T20:50:24.891 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:24 smithi008 systemd[1]: Started Ceph mon.smithi008 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T20:50:24.891 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: cluster 2023-10-18T20:50:24.656324+0000 mon.smithi008 (mon.0) 0 : [INF] mkfs e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:24.891 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: cluster 2023-10-18T20:50:24.651442+0000 mon.smithi008 (mon.0) 1 : cluster [INF] mon.smithi008 is new leader, mons smithi008 in quorum (ranks 0) 2023-10-18T20:50:25.115 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.111+0000 7ff0e6089700 1 Processor -- start 2023-10-18T20:50:25.115 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.111+0000 7ff0e6089700 1 -- start start 2023-10-18T20:50:25.115 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.111+0000 7ff0e6089700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e0070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:25.115 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.111+0000 7ff0e6089700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0072110 con 0x7ff0e0071cf0 2023-10-18T20:50:25.117 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.112+0000 7ff0e5087700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e0070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:25.117 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.112+0000 7ff0e5087700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e0070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54364/0 (socket says 172.21.15.8:54364) 2023-10-18T20:50:25.118 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.112+0000 7ff0e5087700 1 -- 172.21.15.8:0/405427754 learned_addr learned my addr 172.21.15.8:0/405427754 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:25.118 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.113+0000 7ff0e5087700 1 -- 172.21.15.8:0/405427754 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0070780 con 0x7ff0e0071cf0 2023-10-18T20:50:25.118 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.113+0000 7ff0e5087700 1 --2- 172.21.15.8:0/405427754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e0070290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff0dc00b5f0 tx=0x7ff0dc006ee0).ready entity=mon.0 client_cookie=3431af9d833b14dd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:25.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.113+0000 7ff0cffff700 1 -- 172.21.15.8:0/405427754 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0dc00d600 con 0x7ff0e0071cf0 2023-10-18T20:50:25.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.113+0000 7ff0cffff700 1 -- 172.21.15.8:0/405427754 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc00d760 con 0x7ff0e0071cf0 2023-10-18T20:50:25.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.113+0000 7ff0cffff700 1 -- 172.21.15.8:0/405427754 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0dc00da30 con 0x7ff0e0071cf0 2023-10-18T20:50:25.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.113+0000 7ff0e6089700 1 -- 172.21.15.8:0/405427754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 msgr2=0x7ff0e0070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:25.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.114+0000 7ff0e6089700 1 --2- 172.21.15.8:0/405427754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e0070290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff0dc00b5f0 tx=0x7ff0dc006ee0).stop 2023-10-18T20:50:25.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.114+0000 7ff0e6089700 1 -- 172.21.15.8:0/405427754 shutdown_connections 2023-10-18T20:50:25.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.114+0000 7ff0e6089700 1 --2- 172.21.15.8:0/405427754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e0070290 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:25.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.114+0000 7ff0e6089700 1 -- 172.21.15.8:0/405427754 >> 172.21.15.8:0/405427754 conn(0x7ff0e00f71d0 msgr2=0x7ff0e00f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:25.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.114+0000 7ff0e6089700 1 -- 172.21.15.8:0/405427754 shutdown_connections 2023-10-18T20:50:25.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.114+0000 7ff0e6089700 1 -- 172.21.15.8:0/405427754 wait complete. 2023-10-18T20:50:25.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.115+0000 7ff0e6089700 1 Processor -- start 2023-10-18T20:50:25.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.115+0000 7ff0e6089700 1 -- start start 2023-10-18T20:50:25.123 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.115+0000 7ff0e6089700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e010c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:25.123 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.115+0000 7ff0e6089700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e010c750 con 0x7ff0e0071cf0 2023-10-18T20:50:25.123 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.116+0000 7ff0e5087700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e010c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:25.123 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.116+0000 7ff0e5087700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e010c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54374/0 (socket says 172.21.15.8:54374) 2023-10-18T20:50:25.123 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.116+0000 7ff0e5087700 1 -- 172.21.15.8:0/4053441480 learned_addr learned my addr 172.21.15.8:0/4053441480 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:25.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.116+0000 7ff0e5087700 1 -- 172.21.15.8:0/4053441480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc00b200 con 0x7ff0e0071cf0 2023-10-18T20:50:25.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.116+0000 7ff0e5087700 1 --2- 172.21.15.8:0/4053441480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e010c260 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff0dc006c70 tx=0x7ff0dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:25.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.117+0000 7ff0cdffb700 1 -- 172.21.15.8:0/4053441480 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0dc011b40 con 0x7ff0e0071cf0 2023-10-18T20:50:25.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.117+0000 7ff0cdffb700 1 -- 172.21.15.8:0/4053441480 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc011ca0 con 0x7ff0e0071cf0 2023-10-18T20:50:25.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.117+0000 7ff0e6089700 1 -- 172.21.15.8:0/4053441480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e010c950 con 0x7ff0e0071cf0 2023-10-18T20:50:25.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.117+0000 7ff0cdffb700 1 -- 172.21.15.8:0/4053441480 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0dc01d430 con 0x7ff0e0071cf0 2023-10-18T20:50:25.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.117+0000 7ff0e6089700 1 -- 172.21.15.8:0/4053441480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e010cd60 con 0x7ff0e0071cf0 2023-10-18T20:50:25.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.117+0000 7ff0cdffb700 1 -- 172.21.15.8:0/4053441480 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ff0dc00f070 con 0x7ff0e0071cf0 2023-10-18T20:50:25.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.117+0000 7ff0cdffb700 1 -- 172.21.15.8:0/4053441480 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff0dc027460 con 0x7ff0e0071cf0 2023-10-18T20:50:25.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.118+0000 7ff0e6089700 1 -- 172.21.15.8:0/4053441480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0045ad0 con 0x7ff0e0071cf0 2023-10-18T20:50:25.126 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.121+0000 7ff0cdffb700 1 -- 172.21.15.8:0/4053441480 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7ff0dc016070 con 0x7ff0e0071cf0 2023-10-18T20:50:25.200 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.195+0000 7ff0e6089700 1 -- 172.21.15.8:0/4053441480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff0e0105cc0 con 0x7ff0e0071cf0 2023-10-18T20:50:25.200 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.195+0000 7ff0cdffb700 1 -- 172.21.15.8:0/4053441480 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7ff0dc036070 con 0x7ff0e0071cf0 2023-10-18T20:50:25.201 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: cluster: 2023-10-18T20:50:25.201 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: id: e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:25.201 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: health: HEALTH_OK 2023-10-18T20:50:25.201 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.201 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: services: 2023-10-18T20:50:25.202 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi008 (age 0.541251s) 2023-10-18T20:50:25.202 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: mgr: no daemons active 2023-10-18T20:50:25.202 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2023-10-18T20:50:25.202 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.202 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: data: 2023-10-18T20:50:25.202 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2023-10-18T20:50:25.203 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2023-10-18T20:50:25.203 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2023-10-18T20:50:25.203 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: pgs: 2023-10-18T20:50:25.203 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.203 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.196+0000 7ff0e6089700 1 -- 172.21.15.8:0/4053441480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 msgr2=0x7ff0e010c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:25.204 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.196+0000 7ff0e6089700 1 --2- 172.21.15.8:0/4053441480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e010c260 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff0dc006c70 tx=0x7ff0dc016000).stop 2023-10-18T20:50:25.204 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.196+0000 7ff0e6089700 1 -- 172.21.15.8:0/4053441480 shutdown_connections 2023-10-18T20:50:25.204 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.196+0000 7ff0e6089700 1 --2- 172.21.15.8:0/4053441480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e0071cf0 0x7ff0e010c260 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:25.204 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.196+0000 7ff0e6089700 1 -- 172.21.15.8:0/4053441480 >> 172.21.15.8:0/4053441480 conn(0x7ff0e00f71d0 msgr2=0x7ff0e01009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:25.204 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.196+0000 7ff0e6089700 1 -- 172.21.15.8:0/4053441480 shutdown_connections 2023-10-18T20:50:25.205 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.196+0000 7ff0e6089700 1 -- 172.21.15.8:0/4053441480 wait complete. 2023-10-18T20:50:25.551 INFO:teuthology.orchestra.run.smithi008.stderr:mon is available 2023-10-18T20:50:25.552 INFO:teuthology.orchestra.run.smithi008.stderr:Assimilating anything we can from ceph.conf... 2023-10-18T20:50:25.552 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z -v /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008:/var/lib/ceph/mon/ceph-smithi008:z docker.io/ceph/ceph:v16.2.4 config assimilate-conf -i /var/lib/ceph/mon/ceph-smithi008/config 2023-10-18T20:50:25.748 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: cluster 2023-10-18T20:50:24.655754+0000 mon.smithi008 (mon.0) 2 : cluster [INF] mon.smithi008 is new leader, mons smithi008 in quorum (ranks 0) 2023-10-18T20:50:25.749 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: cluster 2023-10-18T20:50:24.655939+0000 mon.smithi008 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi008=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} 2023-10-18T20:50:25.749 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: cluster 2023-10-18T20:50:24.657611+0000 mon.smithi008 (mon.0) 4 : cluster [DBG] fsmap 2023-10-18T20:50:25.749 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: cluster 2023-10-18T20:50:24.660202+0000 mon.smithi008 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2023-10-18T20:50:25.749 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: cluster 2023-10-18T20:50:24.660659+0000 mon.smithi008 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2023-10-18T20:50:25.750 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: audit 2023-10-18T20:50:25.196967+0000 mon.smithi008 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.8:0/4053441480' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-18T20:50:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.993+0000 7f0f8f59e700 1 Processor -- start 2023-10-18T20:50:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.993+0000 7f0f8f59e700 1 -- start start 2023-10-18T20:50:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.993+0000 7f0f8f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f900fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:25.998 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.993+0000 7f0f8f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900feb40 con 0x7f0f9006fc30 2023-10-18T20:50:25.998 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.994+0000 7f0f8e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f900fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:25.998 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.994+0000 7f0f8e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f900fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54388/0 (socket says 172.21.15.8:54388) 2023-10-18T20:50:25.998 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.994+0000 7f0f8e59c700 1 -- 172.21.15.8:0/1604797114 learned_addr learned my addr 172.21.15.8:0/1604797114 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:26.001 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.994+0000 7f0f8e59c700 1 -- 172.21.15.8:0/1604797114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900fec80 con 0x7f0f9006fc30 2023-10-18T20:50:26.001 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.995+0000 7f0f8e59c700 1 --2- 172.21.15.8:0/1604797114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f900fe650 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f0f8000b5f0 tx=0x7f0f80006ee0).ready entity=mon.0 client_cookie=50a0d9ef1e05a563 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:26.002 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.995+0000 7f0f8d59a700 1 -- 172.21.15.8:0/1604797114 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f8000d600 con 0x7f0f9006fc30 2023-10-18T20:50:26.002 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.995+0000 7f0f8d59a700 1 -- 172.21.15.8:0/1604797114 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8000d760 con 0x7f0f9006fc30 2023-10-18T20:50:26.002 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.995+0000 7f0f8d59a700 1 -- 172.21.15.8:0/1604797114 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f8000da30 con 0x7f0f9006fc30 2023-10-18T20:50:26.002 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.995+0000 7f0f8f59e700 1 -- 172.21.15.8:0/1604797114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 msgr2=0x7f0f900fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:26.003 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.995+0000 7f0f8f59e700 1 --2- 172.21.15.8:0/1604797114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f900fe650 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f0f8000b5f0 tx=0x7f0f80006ee0).stop 2023-10-18T20:50:26.003 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.995+0000 7f0f8f59e700 1 -- 172.21.15.8:0/1604797114 shutdown_connections 2023-10-18T20:50:26.003 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.995+0000 7f0f8f59e700 1 --2- 172.21.15.8:0/1604797114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f900fe650 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:26.003 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.995+0000 7f0f8f59e700 1 -- 172.21.15.8:0/1604797114 >> 172.21.15.8:0/1604797114 conn(0x7f0f900f6130 msgr2=0x7f0f900f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:26.003 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.996+0000 7f0f8f59e700 1 -- 172.21.15.8:0/1604797114 shutdown_connections 2023-10-18T20:50:26.003 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.996+0000 7f0f8f59e700 1 -- 172.21.15.8:0/1604797114 wait complete. 2023-10-18T20:50:26.004 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.996+0000 7f0f8f59e700 1 Processor -- start 2023-10-18T20:50:26.004 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.997+0000 7f0f8f59e700 1 -- start start 2023-10-18T20:50:26.004 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.997+0000 7f0f8f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f9010c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:26.004 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.997+0000 7f0f8f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9010c710 con 0x7f0f9006fc30 2023-10-18T20:50:26.004 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.997+0000 7f0f8e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f9010c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:26.005 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.997+0000 7f0f8e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f9010c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54396/0 (socket says 172.21.15.8:54396) 2023-10-18T20:50:26.005 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.997+0000 7f0f8e59c700 1 -- 172.21.15.8:0/3872245791 learned_addr learned my addr 172.21.15.8:0/3872245791 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:26.005 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.998+0000 7f0f8e59c700 1 -- 172.21.15.8:0/3872245791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8000b200 con 0x7f0f9006fc30 2023-10-18T20:50:26.005 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.998+0000 7f0f8e59c700 1 --2- 172.21.15.8:0/3872245791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f9010c220 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f0f80006c70 tx=0x7f0f80016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:26.005 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.998+0000 7f0f7effd700 1 -- 172.21.15.8:0/3872245791 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f80011b40 con 0x7f0f9006fc30 2023-10-18T20:50:26.006 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.998+0000 7f0f7effd700 1 -- 172.21.15.8:0/3872245791 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f80011ca0 con 0x7f0f9006fc30 2023-10-18T20:50:26.006 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.998+0000 7f0f8f59e700 1 -- 172.21.15.8:0/3872245791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9010c910 con 0x7f0f9006fc30 2023-10-18T20:50:26.006 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.998+0000 7f0f7effd700 1 -- 172.21.15.8:0/3872245791 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f8001d430 con 0x7f0f9006fc30 2023-10-18T20:50:26.006 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.998+0000 7f0f8f59e700 1 -- 172.21.15.8:0/3872245791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9010cd20 con 0x7f0f9006fc30 2023-10-18T20:50:26.006 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.999+0000 7f0f7effd700 1 -- 172.21.15.8:0/3872245791 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f0f8000f070 con 0x7f0f9006fc30 2023-10-18T20:50:26.007 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.999+0000 7f0f7effd700 1 -- 172.21.15.8:0/3872245791 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0f80027460 con 0x7f0f9006fc30 2023-10-18T20:50:26.007 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:25.999+0000 7f0f8f59e700 1 -- 172.21.15.8:0/3872245791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f90045ad0 con 0x7f0f9006fc30 2023-10-18T20:50:26.007 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.002+0000 7f0f7effd700 1 -- 172.21.15.8:0/3872245791 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f0f80016070 con 0x7f0f9006fc30 2023-10-18T20:50:26.076 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.073+0000 7f0f8f59e700 1 -- 172.21.15.8:0/3872245791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f0f900fef30 con 0x7f0f9006fc30 2023-10-18T20:50:26.080 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.077+0000 7f0f7effd700 1 -- 172.21.15.8:0/3872245791 <== mon.0 v2:172.21.15.8:3300/0 7 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f0f8001d5e0 con 0x7f0f9006fc30 2023-10-18T20:50:26.081 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.077+0000 7f0f7effd700 1 -- 172.21.15.8:0/3872245791 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+462 (secure 0 0 0) 0x7f0f80036020 con 0x7f0f9006fc30 2023-10-18T20:50:26.081 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.081 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: [global] 2023-10-18T20:50:26.081 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: fsid = e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:26.083 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2023-10-18T20:50:26.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2023-10-18T20:50:26.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2023-10-18T20:50:26.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2023-10-18T20:50:26.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2023-10-18T20:50:26.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: [mgr] 2023-10-18T20:50:26.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2023-10-18T20:50:26.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: [osd] 2023-10-18T20:50:26.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2023-10-18T20:50:26.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2023-10-18T20:50:26.086 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2023-10-18T20:50:26.086 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2023-10-18T20:50:26.086 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: osd_memory_target_autotune = true 2023-10-18T20:50:26.086 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2023-10-18T20:50:26.086 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.078+0000 7f0f8f59e700 1 -- 172.21.15.8:0/3872245791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 msgr2=0x7f0f9010c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:26.087 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.078+0000 7f0f8f59e700 1 --2- 172.21.15.8:0/3872245791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f9010c220 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f0f80006c70 tx=0x7f0f80016000).stop 2023-10-18T20:50:26.087 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.078+0000 7f0f8f59e700 1 -- 172.21.15.8:0/3872245791 shutdown_connections 2023-10-18T20:50:26.087 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.078+0000 7f0f8f59e700 1 --2- 172.21.15.8:0/3872245791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9006fc30 0x7f0f9010c220 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:26.087 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.078+0000 7f0f8f59e700 1 -- 172.21.15.8:0/3872245791 >> 172.21.15.8:0/3872245791 conn(0x7f0f900f6130 msgr2=0x7f0f900f7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:26.087 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.079+0000 7f0f8f59e700 1 -- 172.21.15.8:0/3872245791 shutdown_connections 2023-10-18T20:50:26.088 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.079+0000 7f0f8f59e700 1 -- 172.21.15.8:0/3872245791 wait complete. 2023-10-18T20:50:26.448 INFO:teuthology.orchestra.run.smithi008.stderr:Generating new minimal ceph.conf... 2023-10-18T20:50:26.449 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z -v /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008:/var/lib/ceph/mon/ceph-smithi008:z docker.io/ceph/ceph:v16.2.4 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-smithi008/config 2023-10-18T20:50:26.878 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.874+0000 7f7b9b59e700 1 Processor -- start 2023-10-18T20:50:26.879 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.874+0000 7f7b9b59e700 1 -- start start 2023-10-18T20:50:26.879 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.875+0000 7f7b9b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c0fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:26.879 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.875+0000 7f7b9b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0feb40 con 0x7f7b9c06fc30 2023-10-18T20:50:26.879 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.875+0000 7f7b9a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c0fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.875+0000 7f7b9a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c0fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54398/0 (socket says 172.21.15.8:54398) 2023-10-18T20:50:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.875+0000 7f7b9a59c700 1 -- 172.21.15.8:0/751947285 learned_addr learned my addr 172.21.15.8:0/751947285 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.876+0000 7f7b9a59c700 1 -- 172.21.15.8:0/751947285 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0fec80 con 0x7f7b9c06fc30 2023-10-18T20:50:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.876+0000 7f7b9a59c700 1 --2- 172.21.15.8:0/751947285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c0fe650 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7b8c00b5f0 tx=0x7f7b8c006ee0).ready entity=mon.0 client_cookie=3dd424e56e34dd8f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:26.884 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.876+0000 7f7b9959a700 1 -- 172.21.15.8:0/751947285 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b8c00d600 con 0x7f7b9c06fc30 2023-10-18T20:50:26.884 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.876+0000 7f7b9959a700 1 -- 172.21.15.8:0/751947285 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f7b8c00dbd0 con 0x7f7b9c06fc30 2023-10-18T20:50:26.884 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.876+0000 7f7b9959a700 1 -- 172.21.15.8:0/751947285 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b8c011c00 con 0x7f7b9c06fc30 2023-10-18T20:50:26.885 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.877+0000 7f7b9b59e700 1 -- 172.21.15.8:0/751947285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 msgr2=0x7f7b9c0fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:26.885 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.877+0000 7f7b9b59e700 1 --2- 172.21.15.8:0/751947285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c0fe650 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7b8c00b5f0 tx=0x7f7b8c006ee0).stop 2023-10-18T20:50:26.885 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.877+0000 7f7b9b59e700 1 -- 172.21.15.8:0/751947285 shutdown_connections 2023-10-18T20:50:26.885 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.877+0000 7f7b9b59e700 1 --2- 172.21.15.8:0/751947285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c0fe650 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:26.885 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.877+0000 7f7b9b59e700 1 -- 172.21.15.8:0/751947285 >> 172.21.15.8:0/751947285 conn(0x7f7b9c0f6130 msgr2=0x7f7b9c0f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.877+0000 7f7b9b59e700 1 -- 172.21.15.8:0/751947285 shutdown_connections 2023-10-18T20:50:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.877+0000 7f7b9b59e700 1 -- 172.21.15.8:0/751947285 wait complete. 2023-10-18T20:50:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.878+0000 7f7b9b59e700 1 Processor -- start 2023-10-18T20:50:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.878+0000 7f7b9b59e700 1 -- start start 2023-10-18T20:50:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.879+0000 7f7b9b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c10a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.879+0000 7f7b9b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c10acd0 con 0x7f7b9c06fc30 2023-10-18T20:50:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.879+0000 7f7b9a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c10a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.879+0000 7f7b9a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c10a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54410/0 (socket says 172.21.15.8:54410) 2023-10-18T20:50:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.879+0000 7f7b9a59c700 1 -- 172.21.15.8:0/2720578798 learned_addr learned my addr 172.21.15.8:0/2720578798 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.879+0000 7f7b9a59c700 1 -- 172.21.15.8:0/2720578798 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c00b200 con 0x7f7b9c06fc30 2023-10-18T20:50:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.879+0000 7f7b9a59c700 1 --2- 172.21.15.8:0/2720578798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c10a7e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7b8c00e040 tx=0x7f7b8c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.880+0000 7f7b8affd700 1 -- 172.21.15.8:0/2720578798 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b8c00d9f0 con 0x7f7b9c06fc30 2023-10-18T20:50:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.880+0000 7f7b8affd700 1 -- 172.21.15.8:0/2720578798 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f7b8c01a9f0 con 0x7f7b9c06fc30 2023-10-18T20:50:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.880+0000 7f7b9b59e700 1 -- 172.21.15.8:0/2720578798 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c10aed0 con 0x7f7b9c06fc30 2023-10-18T20:50:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.880+0000 7f7b8affd700 1 -- 172.21.15.8:0/2720578798 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b8c01b8c0 con 0x7f7b9c06fc30 2023-10-18T20:50:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.880+0000 7f7b9b59e700 1 -- 172.21.15.8:0/2720578798 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c10b2e0 con 0x7f7b9c06fc30 2023-10-18T20:50:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.880+0000 7f7b8affd700 1 -- 172.21.15.8:0/2720578798 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f7b8c00f070 con 0x7f7b9c06fc30 2023-10-18T20:50:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.880+0000 7f7b8affd700 1 -- 172.21.15.8:0/2720578798 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f7b8c025ae0 con 0x7f7b9c06fc30 2023-10-18T20:50:26.890 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.882+0000 7f7b9b59e700 1 -- 172.21.15.8:0/2720578798 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c045ad0 con 0x7f7b9c06fc30 2023-10-18T20:50:26.890 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.884+0000 7f7b8affd700 1 -- 172.21.15.8:0/2720578798 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f7b8c016070 con 0x7f7b9c06fc30 2023-10-18T20:50:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: audit 2023-10-18T20:50:26.075074+0000 mon.smithi008 (mon.0) 8 : audit [INF] from='client.? 172.21.15.8:0/3872245791' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-18T20:50:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: audit 2023-10-18T20:50:26.079242+0000 mon.smithi008 (mon.0) 9 : audit [INF] from='client.? 172.21.15.8:0/3872245791' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-18T20:50:26.960 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.957+0000 7f7b9b59e700 1 -- 172.21.15.8:0/2720578798 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7b9c0ff8f0 con 0x7f7b9c06fc30 2023-10-18T20:50:26.960 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.957+0000 7f7b8affd700 1 -- 172.21.15.8:0/2720578798 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f7b8c01bd20 con 0x7f7b9c06fc30 2023-10-18T20:50:26.961 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.958+0000 7f7b9b59e700 1 -- 172.21.15.8:0/2720578798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 msgr2=0x7f7b9c10a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:26.961 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.958+0000 7f7b9b59e700 1 --2- 172.21.15.8:0/2720578798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c10a7e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7b8c00e040 tx=0x7f7b8c006ee0).stop 2023-10-18T20:50:26.962 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.958+0000 7f7b9b59e700 1 -- 172.21.15.8:0/2720578798 shutdown_connections 2023-10-18T20:50:26.962 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.958+0000 7f7b9b59e700 1 --2- 172.21.15.8:0/2720578798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b9c06fc30 0x7f7b9c10a7e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:26.962 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.958+0000 7f7b9b59e700 1 -- 172.21.15.8:0/2720578798 >> 172.21.15.8:0/2720578798 conn(0x7f7b9c0f6130 msgr2=0x7f7b9c0f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:26.962 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.958+0000 7f7b9b59e700 1 -- 172.21.15.8:0/2720578798 shutdown_connections 2023-10-18T20:50:26.962 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:26.958+0000 7f7b9b59e700 1 -- 172.21.15.8:0/2720578798 wait complete. 2023-10-18T20:50:27.312 INFO:teuthology.orchestra.run.smithi008.stderr:Restarting the monitor... 2023-10-18T20:50:27.313 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl restart ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008 2023-10-18T20:50:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:27 smithi008 systemd[1]: Stopping Ceph mon.smithi008 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T20:50:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: debug 2023-10-18T20:50:27.423+0000 7febc1214700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi008 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-10-18T20:50:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107346]: debug 2023-10-18T20:50:27.423+0000 7febc1214700 -1 mon.smithi008@0(leader) e1 *** Got Signal Terminated *** 2023-10-18T20:50:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:27 smithi008 podman[107672]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008 2023-10-18T20:50:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:27 smithi008 systemd[1]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008.service: Succeeded. 2023-10-18T20:50:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:27 smithi008 systemd[1]: Stopped Ceph mon.smithi008 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T20:50:28.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:27 smithi008 systemd[1]: Starting Ceph mon.smithi008 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T20:50:28.267 INFO:teuthology.orchestra.run.smithi008.stderr:Setting mon public_network to 172.21.0.0/20 2023-10-18T20:50:28.267 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mon public_network 172.21.0.0/20 2023-10-18T20:50:28.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 bash[107742]: 9de89e6e28e57680c3e2f72c75b316da3687be36dea51bf4c2a3341aea1ba63d 2023-10-18T20:50:28.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 systemd[1]: Started Ceph mon.smithi008 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T20:50:28.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.267+0000 7f9c44c45700 0 set uid:gid to 167:167 (ceph:ceph) 2023-10-18T20:50:28.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.267+0000 7f9c44c45700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2023-10-18T20:50:28.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.267+0000 7f9c44c45700 0 pidfile_write: ignore empty --pid-file 2023-10-18T20:50:28.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.273+0000 7f9c44c45700 0 load: jerasure load: lrc load: isa 2023-10-18T20:50:28.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: RocksDB version: 6.8.1 2023-10-18T20:50:28.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-10-18T20:50:28.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Compile date May 13 2021 2023-10-18T20:50:28.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: DB SUMMARY 2023-10-18T20:50:28.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: CURRENT file: CURRENT 2023-10-18T20:50:28.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: IDENTITY file: IDENTITY 2023-10-18T20:50:28.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2023-10-18T20:50:28.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi008/store.db dir, Total Num: 1, files: 000004.sst 2023-10-18T20:50:28.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi008/store.db: 000006.log size: 92472 ; 2023-10-18T20:50:28.678 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.678 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.error_if_exists: 0 2023-10-18T20:50:28.678 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.create_if_missing: 0 2023-10-18T20:50:28.678 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.paranoid_checks: 1 2023-10-18T20:50:28.679 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.env: 0x55c5971a11c0 2023-10-18T20:50:28.679 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.fs: Posix File System 2023-10-18T20:50:28.679 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.info_log: 0x55c5988fb960 2023-10-18T20:50:28.679 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.max_file_opening_threads: 16 2023-10-18T20:50:28.679 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.statistics: (nil) 2023-10-18T20:50:28.680 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.use_fsync: 0 2023-10-18T20:50:28.680 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.max_log_file_size: 0 2023-10-18T20:50:28.680 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-18T20:50:28.680 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.log_file_time_to_roll: 0 2023-10-18T20:50:28.681 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.keep_log_file_num: 1000 2023-10-18T20:50:28.681 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.recycle_log_file_num: 0 2023-10-18T20:50:28.681 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.allow_fallocate: 1 2023-10-18T20:50:28.681 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.allow_mmap_reads: 0 2023-10-18T20:50:28.681 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.allow_mmap_writes: 0 2023-10-18T20:50:28.682 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.use_direct_reads: 0 2023-10-18T20:50:28.682 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-18T20:50:28.682 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.create_missing_column_families: 0 2023-10-18T20:50:28.682 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.db_log_dir: 2023-10-18T20:50:28.683 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi008/store.db 2023-10-18T20:50:28.683 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.table_cache_numshardbits: 6 2023-10-18T20:50:28.683 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.max_subcompactions: 1 2023-10-18T20:50:28.683 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.max_background_flushes: -1 2023-10-18T20:50:28.684 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-10-18T20:50:28.684 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-10-18T20:50:28.684 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-18T20:50:28.684 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-18T20:50:28.684 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-10-18T20:50:28.685 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.advise_random_on_open: 1 2023-10-18T20:50:28.685 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.db_write_buffer_size: 0 2023-10-18T20:50:28.685 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.write_buffer_manager: 0x55c599570030 2023-10-18T20:50:28.685 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-18T20:50:28.685 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-10-18T20:50:28.686 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-18T20:50:28.686 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.use_adaptive_mutex: 0 2023-10-18T20:50:28.686 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.rate_limiter: (nil) 2023-10-18T20:50:28.686 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-18T20:50:28.687 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.wal_recovery_mode: 2 2023-10-18T20:50:28.687 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.enable_thread_tracking: 0 2023-10-18T20:50:28.687 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.enable_pipelined_write: 0 2023-10-18T20:50:28.687 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.unordered_write: 0 2023-10-18T20:50:28.687 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-18T20:50:28.688 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-18T20:50:28.688 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-18T20:50:28.688 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-18T20:50:28.688 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.row_cache: None 2023-10-18T20:50:28.689 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.wal_filter: None 2023-10-18T20:50:28.689 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-18T20:50:28.689 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.allow_ingest_behind: 0 2023-10-18T20:50:28.689 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.preserve_deletes: 0 2023-10-18T20:50:28.689 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.two_write_queues: 0 2023-10-18T20:50:28.690 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.manual_wal_flush: 0 2023-10-18T20:50:28.690 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.atomic_flush: 0 2023-10-18T20:50:28.690 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-18T20:50:28.690 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.persist_stats_to_disk: 0 2023-10-18T20:50:28.691 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-10-18T20:50:28.691 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.log_readahead_size: 0 2023-10-18T20:50:28.691 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-10-18T20:50:28.691 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.max_background_jobs: 2 2023-10-18T20:50:28.691 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.max_background_compactions: -1 2023-10-18T20:50:28.692 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-18T20:50:28.692 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-18T20:50:28.692 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.delayed_write_rate : 16777216 2023-10-18T20:50:28.692 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.max_total_wal_size: 0 2023-10-18T20:50:28.693 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-18T20:50:28.693 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.stats_dump_period_sec: 600 2023-10-18T20:50:28.693 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.stats_persist_period_sec: 600 2023-10-18T20:50:28.693 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-18T20:50:28.694 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.max_open_files: -1 2023-10-18T20:50:28.694 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.bytes_per_sync: 0 2023-10-18T20:50:28.694 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-10-18T20:50:28.694 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-10-18T20:50:28.694 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Options.compaction_readahead_size: 0 2023-10-18T20:50:28.695 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Compression algorithms supported: 2023-10-18T20:50:28.695 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-18T20:50:28.695 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: kZSTD supported: 0 2023-10-18T20:50:28.695 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: kXpressCompression supported: 0 2023-10-18T20:50:28.695 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: kLZ4HCCompression supported: 1 2023-10-18T20:50:28.696 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: kLZ4Compression supported: 1 2023-10-18T20:50:28.696 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: kBZip2Compression supported: 0 2023-10-18T20:50:28.696 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: kZlibCompression supported: 1 2023-10-18T20:50:28.696 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: kSnappyCompression supported: 1 2023-10-18T20:50:28.696 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-10-18T20:50:28.697 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.275+0000 7f9c44c45700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi008/store.db/MANIFEST-000005 2023-10-18T20:50:28.697 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.697 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-10-18T20:50:28.697 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.697 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-18T20:50:28.698 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.merge_operator: 2023-10-18T20:50:28.698 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_filter: None 2023-10-18T20:50:28.698 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_filter_factory: None 2023-10-18T20:50:28.698 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-10-18T20:50:28.698 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.table_factory: BlockBasedTable 2023-10-18T20:50:28.699 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c598812128) 2023-10-18T20:50:28.699 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cache_index_and_filter_blocks: 1 2023-10-18T20:50:28.699 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-18T20:50:28.699 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-18T20:50:28.699 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: pin_top_level_index_and_filter: 1 2023-10-18T20:50:28.700 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: index_type: 0 2023-10-18T20:50:28.700 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: data_block_index_type: 0 2023-10-18T20:50:28.700 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: index_shortening: 1 2023-10-18T20:50:28.700 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: data_block_hash_table_util_ratio: 0.750000 2023-10-18T20:50:28.700 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: hash_index_allow_collision: 1 2023-10-18T20:50:28.700 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: checksum: 1 2023-10-18T20:50:28.701 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: no_block_cache: 0 2023-10-18T20:50:28.701 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: block_cache: 0x55c598848f10 2023-10-18T20:50:28.701 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: block_cache_name: BinnedLRUCache 2023-10-18T20:50:28.701 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: block_cache_options: 2023-10-18T20:50:28.701 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: capacity : 536870912 2023-10-18T20:50:28.702 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: num_shard_bits : 4 2023-10-18T20:50:28.702 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: strict_capacity_limit : 0 2023-10-18T20:50:28.702 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: high_pri_pool_ratio: 0.000 2023-10-18T20:50:28.702 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: block_cache_compressed: (nil) 2023-10-18T20:50:28.702 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: persistent_cache: (nil) 2023-10-18T20:50:28.703 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: block_size: 4096 2023-10-18T20:50:28.703 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: block_size_deviation: 10 2023-10-18T20:50:28.703 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: block_restart_interval: 16 2023-10-18T20:50:28.703 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: index_block_restart_interval: 1 2023-10-18T20:50:28.704 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: metadata_block_size: 4096 2023-10-18T20:50:28.704 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: partition_filters: 0 2023-10-18T20:50:28.704 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: use_delta_encoding: 1 2023-10-18T20:50:28.704 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: filter_policy: rocksdb.BuiltinBloomFilter 2023-10-18T20:50:28.704 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: whole_key_filtering: 1 2023-10-18T20:50:28.705 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: verify_compression: 0 2023-10-18T20:50:28.705 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: read_amp_bytes_per_bit: 0 2023-10-18T20:50:28.705 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: format_version: 2 2023-10-18T20:50:28.705 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: enable_index_compression: 1 2023-10-18T20:50:28.705 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: block_align: 0 2023-10-18T20:50:28.706 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.706 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.write_buffer_size: 33554432 2023-10-18T20:50:28.706 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_write_buffer_number: 2 2023-10-18T20:50:28.706 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compression: NoCompression 2023-10-18T20:50:28.706 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.bottommost_compression: Disabled 2023-10-18T20:50:28.707 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.prefix_extractor: nullptr 2023-10-18T20:50:28.707 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-18T20:50:28.707 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.num_levels: 7 2023-10-18T20:50:28.707 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-18T20:50:28.707 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-18T20:50:28.707 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-18T20:50:28.708 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-18T20:50:28.708 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-18T20:50:28.708 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-18T20:50:28.708 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-18T20:50:28.708 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-18T20:50:28.709 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-18T20:50:28.709 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compression_opts.window_bits: -14 2023-10-18T20:50:28.709 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compression_opts.level: 32767 2023-10-18T20:50:28.709 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compression_opts.strategy: 0 2023-10-18T20:50:28.709 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-18T20:50:28.710 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-18T20:50:28.710 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compression_opts.enabled: false 2023-10-18T20:50:28.710 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-18T20:50:28.710 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-18T20:50:28.710 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-18T20:50:28.711 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.target_file_size_base: 67108864 2023-10-18T20:50:28.711 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.target_file_size_multiplier: 1 2023-10-18T20:50:28.711 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-18T20:50:28.711 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-18T20:50:28.711 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-18T20:50:28.712 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-18T20:50:28.712 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-18T20:50:28.712 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-18T20:50:28.712 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-18T20:50:28.712 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-18T20:50:28.712 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-18T20:50:28.713 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-18T20:50:28.713 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-18T20:50:28.713 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-18T20:50:28.713 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.arena_block_size: 4194304 2023-10-18T20:50:28.713 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-18T20:50:28.714 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-18T20:50:28.714 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-10-18T20:50:28.714 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.disable_auto_compactions: 0 2023-10-18T20:50:28.714 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-18T20:50:28.714 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-18T20:50:28.714 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-18T20:50:28.715 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-18T20:50:28.715 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-18T20:50:28.715 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-18T20:50:28.715 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-18T20:50:28.715 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-18T20:50:28.716 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-18T20:50:28.716 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-18T20:50:28.716 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.table_properties_collectors: 2023-10-18T20:50:28.716 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.inplace_update_support: 0 2023-10-18T20:50:28.716 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-10-18T20:50:28.717 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-18T20:50:28.717 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-18T20:50:28.717 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.memtable_huge_page_size: 0 2023-10-18T20:50:28.717 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.bloom_locality: 0 2023-10-18T20:50:28.717 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.max_successive_merges: 0 2023-10-18T20:50:28.718 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-10-18T20:50:28.718 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.paranoid_file_checks: 0 2023-10-18T20:50:28.718 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.force_consistency_checks: 0 2023-10-18T20:50:28.718 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.report_bg_io_stats: 0 2023-10-18T20:50:28.719 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.ttl: 2592000 2023-10-18T20:50:28.719 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.276+0000 7f9c44c45700 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-10-18T20:50:28.719 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.278+0000 7f9c44c45700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi008/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-18T20:50:28.719 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.719 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.278+0000 7f9c44c45700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2023-10-18T20:50:28.719 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.720 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.278+0000 7f9c44c45700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662228280351, "job": 1, "event": "recovery_started", "log_files": [6]} 2023-10-18T20:50:28.720 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.278+0000 7f9c44c45700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2023-10-18T20:50:28.720 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.279+0000 7f9c44c45700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-10-18T20:50:28.720 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.280+0000 7f9c44c45700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662228282208, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 88272, "table_properties": {"data_size": 86399, "index_size": 350, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12269, "raw_average_key_size": 49, "raw_value_size": 79613, "raw_average_value_size": 322, "num_data_blocks": 11, "num_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1697662228, "oldest_key_time": 3, "file_creation_time": 0}} 2023-10-18T20:50:28.721 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.280+0000 7f9c44c45700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2023-10-18T20:50:28.721 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.721 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.281+0000 7f9c44c45700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662228283159, "job": 1, "event": "recovery_finished"} 2023-10-18T20:50:28.721 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.283+0000 7f9c44c45700 4 rocksdb: DB pointer 0x55c59890d800 2023-10-18T20:50:28.721 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.283+0000 7f9c2ba5d700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-10-18T20:50:28.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.283+0000 7f9c2ba5d700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-10-18T20:50:28.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ** DB Stats ** 2023-10-18T20:50:28.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:50:28.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-18T20:50:28.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T20:50:28.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T20:50:28.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-18T20:50:28.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-10-18T20:50:28.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T20:50:28.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ** Compaction Stats [default] ** 2023-10-18T20:50:28.724 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:50:28.724 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:50:28.724 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: L0 2/0 87.90 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 71.8 0.00 0.00 1 0.001 0 0 2023-10-18T20:50:28.724 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Sum 2/0 87.90 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 71.8 0.00 0.00 1 0.001 0 0 2023-10-18T20:50:28.724 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 71.8 0.00 0.00 1 0.001 0 0 2023-10-18T20:50:28.724 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.725 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ** Compaction Stats [default] ** 2023-10-18T20:50:28.725 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:50:28.725 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:50:28.725 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 71.8 0.00 0.00 1 0.001 0 0 2023-10-18T20:50:28.725 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:50:28.726 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Flush(GB): cumulative 0.000, interval 0.000 2023-10-18T20:50:28.726 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T20:50:28.726 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T20:50:28.726 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T20:50:28.727 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: AddFile(Keys): cumulative 0, interval 0 2023-10-18T20:50:28.727 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Cumulative compaction: 0.00 GB write, 11.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:50:28.727 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Interval compaction: 0.00 GB write, 11.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:50:28.727 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T20:50:28.727 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.728 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ** File Read Latency Histogram By Level [default] ** 2023-10-18T20:50:28.728 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.728 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ** Compaction Stats [default] ** 2023-10-18T20:50:28.728 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:50:28.728 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:50:28.729 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: L0 2/0 87.90 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 71.8 0.00 0.00 1 0.001 0 0 2023-10-18T20:50:28.729 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Sum 2/0 87.90 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 71.8 0.00 0.00 1 0.001 0 0 2023-10-18T20:50:28.729 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:50:28.729 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.730 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ** Compaction Stats [default] ** 2023-10-18T20:50:28.730 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:50:28.730 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:50:28.730 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 71.8 0.00 0.00 1 0.001 0 0 2023-10-18T20:50:28.730 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:50:28.731 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Flush(GB): cumulative 0.000, interval 0.000 2023-10-18T20:50:28.731 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T20:50:28.732 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T20:50:28.732 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T20:50:28.732 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: AddFile(Keys): cumulative 0, interval 0 2023-10-18T20:50:28.733 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Cumulative compaction: 0.00 GB write, 11.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:50:28.733 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:50:28.733 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T20:50:28.733 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.734 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: ** File Read Latency Histogram By Level [default] ** 2023-10-18T20:50:28.734 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.734 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.284+0000 7f9c44c45700 0 starting mon.smithi008 rank 0 at public addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] at bind addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi008 fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:28.734 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.286+0000 7f9c44c45700 1 mon.smithi008@-1(???) e1 preinit fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:28.734 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.287+0000 7f9c44c45700 0 mon.smithi008@-1(???).mds e1 new map 2023-10-18T20:50:28.735 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.287+0000 7f9c44c45700 0 mon.smithi008@-1(???).mds e1 print_map 2023-10-18T20:50:28.735 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: e1 2023-10-18T20:50:28.735 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:50:28.735 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:50:28.736 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: legacy client fscid: -1 2023-10-18T20:50:28.736 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.736 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: No filesystems configured 2023-10-18T20:50:28.736 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: 2023-10-18T20:50:28.736 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.287+0000 7f9c44c45700 0 mon.smithi008@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-18T20:50:28.737 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.287+0000 7f9c44c45700 0 mon.smithi008@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T20:50:28.737 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.287+0000 7f9c44c45700 0 mon.smithi008@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T20:50:28.737 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:26.075074+0000 mon.smithi008 (mondebug 2023-10-18T20:50:28.287+0000 7f9c44c45700 0 mon.smithi008@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T20:50:28.737 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: .0) 8 : audit [INF] from='client.? 172.21.15.8:0/3872245791' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-18T20:50:28.738 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:26.079242+0000 mon.smithi008 (mon.0) 9 : audit [INF] from='client.? 172.21.15.8:0/3872245791' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-18T20:50:28.738 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:50:28.287+0000 7f9c44c45700 1 mon.smithi008@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-18T20:50:28.738 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:28.294095+0000 mon.smithi008 (mon.0) 1 : cluster [INF] mon.smithi008 is new leader, mons smithi008 in quorum (ranks 0) 2023-10-18T20:50:28.738 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:28.294155+0000 mon.smithi008 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi008=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} 2023-10-18T20:50:28.738 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:28.294188+0000 mon.smithi008 (mon.0) 3 : cluster [DBG] fsmap 2023-10-18T20:50:28.739 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:28.294233+0000 mon.smithi008 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2023-10-18T20:50:28.739 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:28.294658+0000 mon.smithi008 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2023-10-18T20:50:28.742 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.673+0000 7ff266aef700 1 Processor -- start 2023-10-18T20:50:28.742 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.673+0000 7ff266aef700 1 -- start start 2023-10-18T20:50:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.673+0000 7ff266aef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff2600fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.673+0000 7ff266aef700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2600feb40 con 0x7ff26006fc30 2023-10-18T20:50:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.674+0000 7ff265aed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff2600fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.674+0000 7ff265aed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff2600fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42490/0 (socket says 172.21.15.8:42490) 2023-10-18T20:50:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.674+0000 7ff265aed700 1 -- 172.21.15.8:0/721464387 learned_addr learned my addr 172.21.15.8:0/721464387 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:28.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.675+0000 7ff265aed700 1 -- 172.21.15.8:0/721464387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2600fec80 con 0x7ff26006fc30 2023-10-18T20:50:28.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.675+0000 7ff265aed700 1 --2- 172.21.15.8:0/721464387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff2600fe650 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff25c00b5f0 tx=0x7ff25c006ee0).ready entity=mon.0 client_cookie=27833e7514e698a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:28.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.675+0000 7ff264aeb700 1 -- 172.21.15.8:0/721464387 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff25c00d600 con 0x7ff26006fc30 2023-10-18T20:50:28.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.675+0000 7ff264aeb700 1 -- 172.21.15.8:0/721464387 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7ff25c00dbd0 con 0x7ff26006fc30 2023-10-18T20:50:28.744 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.675+0000 7ff264aeb700 1 -- 172.21.15.8:0/721464387 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff25c011c00 con 0x7ff26006fc30 2023-10-18T20:50:28.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.676+0000 7ff266aef700 1 -- 172.21.15.8:0/721464387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 msgr2=0x7ff2600fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:28.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.676+0000 7ff266aef700 1 --2- 172.21.15.8:0/721464387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff2600fe650 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff25c00b5f0 tx=0x7ff25c006ee0).stop 2023-10-18T20:50:28.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.676+0000 7ff266aef700 1 -- 172.21.15.8:0/721464387 shutdown_connections 2023-10-18T20:50:28.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.676+0000 7ff266aef700 1 --2- 172.21.15.8:0/721464387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff2600fe650 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:28.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.676+0000 7ff266aef700 1 -- 172.21.15.8:0/721464387 >> 172.21.15.8:0/721464387 conn(0x7ff2600f6130 msgr2=0x7ff2600f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:28.745 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.676+0000 7ff266aef700 1 -- 172.21.15.8:0/721464387 shutdown_connections 2023-10-18T20:50:28.746 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.676+0000 7ff266aef700 1 -- 172.21.15.8:0/721464387 wait complete. 2023-10-18T20:50:28.746 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.677+0000 7ff266aef700 1 Processor -- start 2023-10-18T20:50:28.746 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.677+0000 7ff266aef700 1 -- start start 2023-10-18T20:50:28.746 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.678+0000 7ff266aef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff26010c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:28.746 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.678+0000 7ff266aef700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26010ceb0 con 0x7ff26006fc30 2023-10-18T20:50:28.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.678+0000 7ff265aed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff26010c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:28.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.678+0000 7ff265aed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff26010c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42504/0 (socket says 172.21.15.8:42504) 2023-10-18T20:50:28.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.678+0000 7ff265aed700 1 -- 172.21.15.8:0/2319639904 learned_addr learned my addr 172.21.15.8:0/2319639904 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:28.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.679+0000 7ff265aed700 1 -- 172.21.15.8:0/2319639904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c00b200 con 0x7ff26006fc30 2023-10-18T20:50:28.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.679+0000 7ff265aed700 1 --2- 172.21.15.8:0/2319639904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff26010c9c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff25c00e040 tx=0x7ff25c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:28.747 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.679+0000 7ff24e7fc700 1 -- 172.21.15.8:0/2319639904 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff25c00d9f0 con 0x7ff26006fc30 2023-10-18T20:50:28.748 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.679+0000 7ff24e7fc700 1 -- 172.21.15.8:0/2319639904 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7ff25c01a9f0 con 0x7ff26006fc30 2023-10-18T20:50:28.748 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.679+0000 7ff24e7fc700 1 -- 172.21.15.8:0/2319639904 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff25c01b8c0 con 0x7ff26006fc30 2023-10-18T20:50:28.748 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.679+0000 7ff266aef700 1 -- 172.21.15.8:0/2319639904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26010d0b0 con 0x7ff26006fc30 2023-10-18T20:50:28.748 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.679+0000 7ff266aef700 1 -- 172.21.15.8:0/2319639904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26010d4c0 con 0x7ff26006fc30 2023-10-18T20:50:28.748 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.680+0000 7ff24e7fc700 1 -- 172.21.15.8:0/2319639904 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ff25c00f070 con 0x7ff26006fc30 2023-10-18T20:50:28.749 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.680+0000 7ff24e7fc700 1 -- 172.21.15.8:0/2319639904 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff25c025770 con 0x7ff26006fc30 2023-10-18T20:50:28.749 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.680+0000 7ff266aef700 1 -- 172.21.15.8:0/2319639904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff260045ad0 con 0x7ff26006fc30 2023-10-18T20:50:28.749 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.685+0000 7ff24e7fc700 1 -- 172.21.15.8:0/2319639904 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7ff25c016070 con 0x7ff26006fc30 2023-10-18T20:50:28.760 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.757+0000 7ff266aef700 1 -- 172.21.15.8:0/2319639904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7ff2600ffa40 con 0x7ff26006fc30 2023-10-18T20:50:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.760+0000 7ff24e7fc700 1 -- 172.21.15.8:0/2319639904 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff25c01bdc0 con 0x7ff26006fc30 2023-10-18T20:50:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.760+0000 7ff266aef700 1 -- 172.21.15.8:0/2319639904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 msgr2=0x7ff26010c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.760+0000 7ff266aef700 1 --2- 172.21.15.8:0/2319639904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff26010c9c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff25c00e040 tx=0x7ff25c006ee0).stop 2023-10-18T20:50:28.764 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.760+0000 7ff266aef700 1 -- 172.21.15.8:0/2319639904 shutdown_connections 2023-10-18T20:50:28.764 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.760+0000 7ff266aef700 1 --2- 172.21.15.8:0/2319639904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff26006fc30 0x7ff26010c9c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:28.765 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.760+0000 7ff266aef700 1 -- 172.21.15.8:0/2319639904 >> 172.21.15.8:0/2319639904 conn(0x7ff2600f6130 msgr2=0x7ff2600f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:28.765 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.761+0000 7ff266aef700 1 -- 172.21.15.8:0/2319639904 shutdown_connections 2023-10-18T20:50:28.765 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:28.761+0000 7ff266aef700 1 -- 172.21.15.8:0/2319639904 wait complete. 2023-10-18T20:50:29.103 INFO:teuthology.orchestra.run.smithi008.stderr:Wrote config to /etc/ceph/ceph.conf 2023-10-18T20:50:29.104 INFO:teuthology.orchestra.run.smithi008.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-18T20:50:29.104 INFO:teuthology.orchestra.run.smithi008.stderr:Creating mgr... 2023-10-18T20:50:29.104 INFO:teuthology.orchestra.run.smithi008.stderr:Verifying port 9283 ... 2023-10-18T20:50:29.107 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl daemon-reload 2023-10-18T20:50:29.319 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl stop ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mgr.smithi008.flmjzp 2023-10-18T20:50:29.408 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl reset-failed ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mgr.smithi008.flmjzp 2023-10-18T20:50:29.420 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: Failed to reset failed state of unit ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mgr.smithi008.flmjzp.service: Unit ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mgr.smithi008.flmjzp.service not loaded. 2023-10-18T20:50:29.421 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl enable ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mgr.smithi008.flmjzp 2023-10-18T20:50:29.435 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: Created symlink /etc/systemd/system/ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7.target.wants/ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mgr.smithi008.flmjzp.service → /etc/systemd/system/ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@.service. 2023-10-18T20:50:29.627 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl start ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mgr.smithi008.flmjzp 2023-10-18T20:50:30.031 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:28.761348+0000 mon.smithi008 (mon.0) 6 : audit [INF] from='client.? 172.21.15.8:0/2319639904' entity='client.admin' 2023-10-18T20:50:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-enabled firewalld.service 2023-10-18T20:50:30.061 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: disabled 2023-10-18T20:50:30.061 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-active firewalld.service 2023-10-18T20:50:30.078 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: inactive 2023-10-18T20:50:30.080 INFO:teuthology.orchestra.run.smithi008.stderr:firewalld.service is not enabled 2023-10-18T20:50:30.080 INFO:teuthology.orchestra.run.smithi008.stderr:Not possible to enable service . firewalld.service is not available 2023-10-18T20:50:30.081 INFO:teuthology.orchestra.run.smithi008.stderr:Not possible to open ports <[]>. firewalld.service is not available 2023-10-18T20:50:30.081 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-enabled firewalld.service 2023-10-18T20:50:30.097 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: disabled 2023-10-18T20:50:30.098 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-active firewalld.service 2023-10-18T20:50:30.115 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: inactive 2023-10-18T20:50:30.116 INFO:teuthology.orchestra.run.smithi008.stderr:firewalld.service is not enabled 2023-10-18T20:50:30.116 INFO:teuthology.orchestra.run.smithi008.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2023-10-18T20:50:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:Waiting for mgr to start... 2023-10-18T20:50:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:Waiting for mgr... 2023-10-18T20:50:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2023-10-18T20:50:30.535 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.530+0000 7f22a8a65700 1 Processor -- start 2023-10-18T20:50:30.536 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.530+0000 7f22a8a65700 1 -- start start 2023-10-18T20:50:30.536 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.531+0000 7f22a8a65700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a40fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:30.536 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.531+0000 7f22a8a65700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a40fc2a0 con 0x7f22a40fb990 2023-10-18T20:50:30.537 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.531+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a40fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:30.537 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.531+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a40fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42528/0 (socket says 172.21.15.8:42528) 2023-10-18T20:50:30.537 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.531+0000 7f22a37fe700 1 -- 172.21.15.8:0/3791252133 learned_addr learned my addr 172.21.15.8:0/3791252133 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:30.537 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.532+0000 7f22a37fe700 1 -- 172.21.15.8:0/3791252133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40fc3e0 con 0x7f22a40fb990 2023-10-18T20:50:30.540 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.532+0000 7f22a37fe700 1 --2- 172.21.15.8:0/3791252133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a40fbdb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f229400b5f0 tx=0x7f2294006ee0).ready entity=mon.0 client_cookie=a2a9c59fe53672a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:30.541 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.532+0000 7f22a27fc700 1 -- 172.21.15.8:0/3791252133 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f229400d600 con 0x7f22a40fb990 2023-10-18T20:50:30.541 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.532+0000 7f22a27fc700 1 -- 172.21.15.8:0/3791252133 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f229400dbd0 con 0x7f22a40fb990 2023-10-18T20:50:30.541 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.532+0000 7f22a27fc700 1 -- 172.21.15.8:0/3791252133 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2294011c00 con 0x7f22a40fb990 2023-10-18T20:50:30.541 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.533+0000 7f22a8a65700 1 -- 172.21.15.8:0/3791252133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 msgr2=0x7f22a40fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:30.541 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.533+0000 7f22a8a65700 1 --2- 172.21.15.8:0/3791252133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a40fbdb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f229400b5f0 tx=0x7f2294006ee0).stop 2023-10-18T20:50:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.533+0000 7f22a8a65700 1 -- 172.21.15.8:0/3791252133 shutdown_connections 2023-10-18T20:50:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.533+0000 7f22a8a65700 1 --2- 172.21.15.8:0/3791252133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a40fbdb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.533+0000 7f22a8a65700 1 -- 172.21.15.8:0/3791252133 >> 172.21.15.8:0/3791252133 conn(0x7f22a40f71d0 msgr2=0x7f22a40f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.533+0000 7f22a8a65700 1 -- 172.21.15.8:0/3791252133 shutdown_connections 2023-10-18T20:50:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.533+0000 7f22a8a65700 1 -- 172.21.15.8:0/3791252133 wait complete. 2023-10-18T20:50:30.543 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.534+0000 7f22a8a65700 1 Processor -- start 2023-10-18T20:50:30.543 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.535+0000 7f22a8a65700 1 -- start start 2023-10-18T20:50:30.543 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.535+0000 7f22a8a65700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a410c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:30.543 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.535+0000 7f22a8a65700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a410ce90 con 0x7f22a40fb990 2023-10-18T20:50:30.544 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.535+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a410c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:30.544 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.535+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a410c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42536/0 (socket says 172.21.15.8:42536) 2023-10-18T20:50:30.544 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.535+0000 7f22a37fe700 1 -- 172.21.15.8:0/453668815 learned_addr learned my addr 172.21.15.8:0/453668815 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:30.544 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.536+0000 7f22a37fe700 1 -- 172.21.15.8:0/453668815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229400b200 con 0x7f22a40fb990 2023-10-18T20:50:30.544 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.536+0000 7f22a37fe700 1 --2- 172.21.15.8:0/453668815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a410c9a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f229400e040 tx=0x7f2294006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:30.545 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.536+0000 7f228bfff700 1 -- 172.21.15.8:0/453668815 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f229401b410 con 0x7f22a40fb990 2023-10-18T20:50:30.545 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.536+0000 7f228bfff700 1 -- 172.21.15.8:0/453668815 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f229401b9e0 con 0x7f22a40fb990 2023-10-18T20:50:30.545 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.536+0000 7f228bfff700 1 -- 172.21.15.8:0/453668815 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f229401a820 con 0x7f22a40fb990 2023-10-18T20:50:30.545 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.536+0000 7f22a8a65700 1 -- 172.21.15.8:0/453668815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a410d090 con 0x7f22a40fb990 2023-10-18T20:50:30.545 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.537+0000 7f22a8a65700 1 -- 172.21.15.8:0/453668815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a410d4a0 con 0x7f22a40fb990 2023-10-18T20:50:30.546 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.537+0000 7f228bfff700 1 -- 172.21.15.8:0/453668815 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f229400f070 con 0x7f22a40fb990 2023-10-18T20:50:30.546 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.537+0000 7f228bfff700 1 -- 172.21.15.8:0/453668815 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f2294025cb0 con 0x7f22a40fb990 2023-10-18T20:50:30.546 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.538+0000 7f22a8a65700 1 -- 172.21.15.8:0/453668815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a4045ad0 con 0x7f22a40fb990 2023-10-18T20:50:30.547 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.540+0000 7f228bfff700 1 -- 172.21.15.8:0/453668815 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f2294016070 con 0x7f22a40fb990 2023-10-18T20:50:30.618 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.615+0000 7f22a8a65700 1 -- 172.21.15.8:0/453668815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f22a41069d0 con 0x7f22a40fb990 2023-10-18T20:50:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.615+0000 7f228bfff700 1 -- 172.21.15.8:0/453668815 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f2294025460 con 0x7f22a40fb990 2023-10-18T20:50:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: { 2023-10-18T20:50:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "fsid": "e1aaa62c-6df7-11ee-8db6-212e2dc638e7", 2023-10-18T20:50:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "health": { 2023-10-18T20:50:30.628 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2023-10-18T20:50:30.628 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "checks": {}, 2023-10-18T20:50:30.628 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "mutes": [] 2023-10-18T20:50:30.628 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:30.628 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "election_epoch": 5, 2023-10-18T20:50:30.628 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum": [ 2023-10-18T20:50:30.629 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 0 2023-10-18T20:50:30.629 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:30.629 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum_names": [ 2023-10-18T20:50:30.629 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "smithi008" 2023-10-18T20:50:30.629 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:30.630 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum_age": 2, 2023-10-18T20:50:30.630 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "monmap": { 2023-10-18T20:50:30.630 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:30.630 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2023-10-18T20:50:30.630 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_mons": 1 2023-10-18T20:50:30.630 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osdmap": { 2023-10-18T20:50:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_osds": 0, 2023-10-18T20:50:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_up_osds": 0, 2023-10-18T20:50:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osd_up_since": 0, 2023-10-18T20:50:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_in_osds": 0, 2023-10-18T20:50:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osd_in_since": 0, 2023-10-18T20:50:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2023-10-18T20:50:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "pgmap": { 2023-10-18T20:50:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "pgs_by_state": [], 2023-10-18T20:50:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_pgs": 0, 2023-10-18T20:50:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_pools": 0, 2023-10-18T20:50:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_objects": 0, 2023-10-18T20:50:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "data_bytes": 0, 2023-10-18T20:50:30.634 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_used": 0, 2023-10-18T20:50:30.634 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_avail": 0, 2023-10-18T20:50:30.634 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_total": 0 2023-10-18T20:50:30.634 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:30.634 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "fsmap": { 2023-10-18T20:50:30.635 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:30.635 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "by_rank": [], 2023-10-18T20:50:30.635 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "up:standby": 0 2023-10-18T20:50:30.635 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:30.635 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "mgrmap": { 2023-10-18T20:50:30.635 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "available": false, 2023-10-18T20:50:30.636 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_standbys": 0, 2023-10-18T20:50:30.636 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "modules": [ 2023-10-18T20:50:30.636 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "iostat", 2023-10-18T20:50:30.636 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "restful" 2023-10-18T20:50:30.636 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:30.637 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "services": {} 2023-10-18T20:50:30.637 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:30.637 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "servicemap": { 2023-10-18T20:50:30.637 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:30.637 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "modified": "2023-10-18T20:50:24.656714+0000", 2023-10-18T20:50:30.637 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "services": {} 2023-10-18T20:50:30.638 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:30.638 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "progress_events": {} 2023-10-18T20:50:30.638 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: } 2023-10-18T20:50:30.638 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.616+0000 7f22a8a65700 1 -- 172.21.15.8:0/453668815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 msgr2=0x7f22a410c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:30.638 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.616+0000 7f22a8a65700 1 --2- 172.21.15.8:0/453668815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a410c9a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f229400e040 tx=0x7f2294006ee0).stop 2023-10-18T20:50:30.639 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.617+0000 7f22a8a65700 1 -- 172.21.15.8:0/453668815 shutdown_connections 2023-10-18T20:50:30.639 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.617+0000 7f22a8a65700 1 --2- 172.21.15.8:0/453668815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22a40fb990 0x7f22a410c9a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:30.639 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.617+0000 7f22a8a65700 1 -- 172.21.15.8:0/453668815 >> 172.21.15.8:0/453668815 conn(0x7f22a40f71d0 msgr2=0x7f22a40f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:30.639 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.617+0000 7f22a8a65700 1 -- 172.21.15.8:0/453668815 shutdown_connections 2023-10-18T20:50:30.639 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:30.617+0000 7f22a8a65700 1 -- 172.21.15.8:0/453668815 wait complete. 2023-10-18T20:50:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:30.617138+0000 mon.smithi008 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.8:0/453668815' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-18T20:50:30.946 INFO:teuthology.orchestra.run.smithi008.stderr:mgr not available, waiting (1/15)... 2023-10-18T20:50:32.949 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2023-10-18T20:50:33.520 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.516+0000 7f2127f62700 1 Processor -- start 2023-10-18T20:50:33.520 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.516+0000 7f2127f62700 1 -- start start 2023-10-18T20:50:33.522 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.517+0000 7f2127f62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f21200fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:33.522 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.517+0000 7f2127f62700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21200fed20 con 0x7f212006fcd0 2023-10-18T20:50:33.522 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.517+0000 7f2125cfe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f21200fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:33.522 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.517+0000 7f2125cfe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f21200fe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42546/0 (socket says 172.21.15.8:42546) 2023-10-18T20:50:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.517+0000 7f2125cfe700 1 -- 172.21.15.8:0/1220240282 learned_addr learned my addr 172.21.15.8:0/1220240282 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.518+0000 7f2125cfe700 1 -- 172.21.15.8:0/1220240282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200fee60 con 0x7f212006fcd0 2023-10-18T20:50:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.518+0000 7f2125cfe700 1 --2- 172.21.15.8:0/1220240282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f21200fe7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f211c00b5f0 tx=0x7f211c006ee0).ready entity=mon.0 client_cookie=4298d843f6da9a91 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.518+0000 7f2124cfc700 1 -- 172.21.15.8:0/1220240282 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f211c00d600 con 0x7f212006fcd0 2023-10-18T20:50:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.518+0000 7f2124cfc700 1 -- 172.21.15.8:0/1220240282 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f211c00dbd0 con 0x7f212006fcd0 2023-10-18T20:50:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.518+0000 7f2124cfc700 1 -- 172.21.15.8:0/1220240282 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f211c011c00 con 0x7f212006fcd0 2023-10-18T20:50:33.524 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.519+0000 7f2127f62700 1 -- 172.21.15.8:0/1220240282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 msgr2=0x7f21200fe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:33.524 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.519+0000 7f2127f62700 1 --2- 172.21.15.8:0/1220240282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f21200fe7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f211c00b5f0 tx=0x7f211c006ee0).stop 2023-10-18T20:50:33.524 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.519+0000 7f2127f62700 1 -- 172.21.15.8:0/1220240282 shutdown_connections 2023-10-18T20:50:33.524 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.519+0000 7f2127f62700 1 --2- 172.21.15.8:0/1220240282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f21200fe7a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:33.526 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.519+0000 7f2127f62700 1 -- 172.21.15.8:0/1220240282 >> 172.21.15.8:0/1220240282 conn(0x7f21200f6280 msgr2=0x7f21200f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:33.526 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.519+0000 7f2127f62700 1 -- 172.21.15.8:0/1220240282 shutdown_connections 2023-10-18T20:50:33.527 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.519+0000 7f2127f62700 1 -- 172.21.15.8:0/1220240282 wait complete. 2023-10-18T20:50:33.527 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.520+0000 7f2127f62700 1 Processor -- start 2023-10-18T20:50:33.527 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.520+0000 7f2127f62700 1 -- start start 2023-10-18T20:50:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.521+0000 7f2127f62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f212010cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.521+0000 7f2127f62700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212010d0f0 con 0x7f212006fcd0 2023-10-18T20:50:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.521+0000 7f2125cfe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f212010cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.521+0000 7f2125cfe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f212010cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42550/0 (socket says 172.21.15.8:42550) 2023-10-18T20:50:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.521+0000 7f2125cfe700 1 -- 172.21.15.8:0/1364769467 learned_addr learned my addr 172.21.15.8:0/1364769467 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.521+0000 7f2125cfe700 1 -- 172.21.15.8:0/1364769467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c00b200 con 0x7f212006fcd0 2023-10-18T20:50:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.521+0000 7f2125cfe700 1 --2- 172.21.15.8:0/1364769467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f212010cc00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f211c000c00 tx=0x7f211c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.522+0000 7f210e7fc700 1 -- 172.21.15.8:0/1364769467 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f211c011690 con 0x7f212006fcd0 2023-10-18T20:50:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.522+0000 7f210e7fc700 1 -- 172.21.15.8:0/1364769467 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f211c00d9f0 con 0x7f212006fcd0 2023-10-18T20:50:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.522+0000 7f2127f62700 1 -- 172.21.15.8:0/1364769467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212010d2f0 con 0x7f212006fcd0 2023-10-18T20:50:33.530 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.522+0000 7f210e7fc700 1 -- 172.21.15.8:0/1364769467 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f211c01b710 con 0x7f212006fcd0 2023-10-18T20:50:33.530 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.522+0000 7f2127f62700 1 -- 172.21.15.8:0/1364769467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212010d700 con 0x7f212006fcd0 2023-10-18T20:50:33.530 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.522+0000 7f210e7fc700 1 -- 172.21.15.8:0/1364769467 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f211c00f070 con 0x7f212006fcd0 2023-10-18T20:50:33.531 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.522+0000 7f210e7fc700 1 -- 172.21.15.8:0/1364769467 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f211c025a80 con 0x7f212006fcd0 2023-10-18T20:50:33.531 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.523+0000 7f2127f62700 1 -- 172.21.15.8:0/1364769467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2120045ad0 con 0x7f212006fcd0 2023-10-18T20:50:33.531 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.526+0000 7f210e7fc700 1 -- 172.21.15.8:0/1364769467 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f211c016070 con 0x7f212006fcd0 2023-10-18T20:50:33.603 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.600+0000 7f2127f62700 1 -- 172.21.15.8:0/1364769467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f21200ffce0 con 0x7f212006fcd0 2023-10-18T20:50:33.603 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.600+0000 7f210e7fc700 1 -- 172.21.15.8:0/1364769467 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f211c01aaf0 con 0x7f212006fcd0 2023-10-18T20:50:33.604 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.604 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: { 2023-10-18T20:50:33.605 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "fsid": "e1aaa62c-6df7-11ee-8db6-212e2dc638e7", 2023-10-18T20:50:33.605 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "health": { 2023-10-18T20:50:33.605 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2023-10-18T20:50:33.605 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "checks": {}, 2023-10-18T20:50:33.605 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "mutes": [] 2023-10-18T20:50:33.606 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:33.606 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "election_epoch": 5, 2023-10-18T20:50:33.606 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum": [ 2023-10-18T20:50:33.612 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 0 2023-10-18T20:50:33.613 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:33.613 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum_names": [ 2023-10-18T20:50:33.613 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "smithi008" 2023-10-18T20:50:33.613 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:33.614 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum_age": 5, 2023-10-18T20:50:33.614 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "monmap": { 2023-10-18T20:50:33.614 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:33.614 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2023-10-18T20:50:33.615 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_mons": 1 2023-10-18T20:50:33.615 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:33.615 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osdmap": { 2023-10-18T20:50:33.615 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:33.615 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_osds": 0, 2023-10-18T20:50:33.615 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_up_osds": 0, 2023-10-18T20:50:33.616 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osd_up_since": 0, 2023-10-18T20:50:33.616 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_in_osds": 0, 2023-10-18T20:50:33.616 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osd_in_since": 0, 2023-10-18T20:50:33.616 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2023-10-18T20:50:33.616 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:33.617 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "pgmap": { 2023-10-18T20:50:33.617 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "pgs_by_state": [], 2023-10-18T20:50:33.617 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_pgs": 0, 2023-10-18T20:50:33.617 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_pools": 0, 2023-10-18T20:50:33.618 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_objects": 0, 2023-10-18T20:50:33.618 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "data_bytes": 0, 2023-10-18T20:50:33.618 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_used": 0, 2023-10-18T20:50:33.618 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_avail": 0, 2023-10-18T20:50:33.618 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_total": 0 2023-10-18T20:50:33.619 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:33.619 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "fsmap": { 2023-10-18T20:50:33.619 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:33.619 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "by_rank": [], 2023-10-18T20:50:33.620 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "up:standby": 0 2023-10-18T20:50:33.620 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:33.620 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "mgrmap": { 2023-10-18T20:50:33.620 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "available": false, 2023-10-18T20:50:33.620 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_standbys": 0, 2023-10-18T20:50:33.621 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "modules": [ 2023-10-18T20:50:33.621 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "iostat", 2023-10-18T20:50:33.621 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "restful" 2023-10-18T20:50:33.621 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:33.621 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "services": {} 2023-10-18T20:50:33.622 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:33.622 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "servicemap": { 2023-10-18T20:50:33.622 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:33.622 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "modified": "2023-10-18T20:50:24.656714+0000", 2023-10-18T20:50:33.622 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "services": {} 2023-10-18T20:50:33.623 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:33.623 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "progress_events": {} 2023-10-18T20:50:33.623 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: } 2023-10-18T20:50:33.623 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.601+0000 7f2127f62700 1 -- 172.21.15.8:0/1364769467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 msgr2=0x7f212010cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:33.623 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.601+0000 7f2127f62700 1 --2- 172.21.15.8:0/1364769467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f212010cc00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f211c000c00 tx=0x7f211c006ee0).stop 2023-10-18T20:50:33.624 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.601+0000 7f2127f62700 1 -- 172.21.15.8:0/1364769467 shutdown_connections 2023-10-18T20:50:33.624 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.601+0000 7f2127f62700 1 --2- 172.21.15.8:0/1364769467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f212006fcd0 0x7f212010cc00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:33.624 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.601+0000 7f2127f62700 1 -- 172.21.15.8:0/1364769467 >> 172.21.15.8:0/1364769467 conn(0x7f21200f6280 msgr2=0x7f21200f7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:33.624 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.601+0000 7f2127f62700 1 -- 172.21.15.8:0/1364769467 shutdown_connections 2023-10-18T20:50:33.624 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:33.601+0000 7f2127f62700 1 -- 172.21.15.8:0/1364769467 wait complete. 2023-10-18T20:50:33.970 INFO:teuthology.orchestra.run.smithi008.stderr:mgr not available, waiting (2/15)... 2023-10-18T20:50:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:33.601771+0000 mon.smithi008 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.8:0/1364769467' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-18T20:50:35.972 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2023-10-18T20:50:36.370 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.367+0000 7f130759e700 1 Processor -- start 2023-10-18T20:50:36.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.367+0000 7f130759e700 1 -- start start 2023-10-18T20:50:36.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.367+0000 7f130759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:36.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.367+0000 7f130759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080feb40 con 0x7f130806fc30 2023-10-18T20:50:36.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.368+0000 7f130659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:36.372 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.368+0000 7f130659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42566/0 (socket says 172.21.15.8:42566) 2023-10-18T20:50:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.368+0000 7f130659c700 1 -- 172.21.15.8:0/3985506647 learned_addr learned my addr 172.21.15.8:0/3985506647 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.368+0000 7f130659c700 1 -- 172.21.15.8:0/3985506647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080fec80 con 0x7f130806fc30 2023-10-18T20:50:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.368+0000 7f130659c700 1 --2- 172.21.15.8:0/3985506647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fe650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f12f800b5f0 tx=0x7f12f8006ee0).ready entity=mon.0 client_cookie=78c8eb5fba87ede4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.369+0000 7f130559a700 1 -- 172.21.15.8:0/3985506647 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12f800d600 con 0x7f130806fc30 2023-10-18T20:50:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.369+0000 7f130559a700 1 -- 172.21.15.8:0/3985506647 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f12f800dbd0 con 0x7f130806fc30 2023-10-18T20:50:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.369+0000 7f130559a700 1 -- 172.21.15.8:0/3985506647 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12f8011c00 con 0x7f130806fc30 2023-10-18T20:50:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.369+0000 7f130759e700 1 -- 172.21.15.8:0/3985506647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 msgr2=0x7f13080fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.369+0000 7f130759e700 1 --2- 172.21.15.8:0/3985506647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fe650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f12f800b5f0 tx=0x7f12f8006ee0).stop 2023-10-18T20:50:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.369+0000 7f130759e700 1 -- 172.21.15.8:0/3985506647 shutdown_connections 2023-10-18T20:50:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.369+0000 7f130759e700 1 --2- 172.21.15.8:0/3985506647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fe650 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.369+0000 7f130759e700 1 -- 172.21.15.8:0/3985506647 >> 172.21.15.8:0/3985506647 conn(0x7f13080f6130 msgr2=0x7f13080f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:36.376 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.369+0000 7f130759e700 1 -- 172.21.15.8:0/3985506647 shutdown_connections 2023-10-18T20:50:36.376 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.370+0000 7f130759e700 1 -- 172.21.15.8:0/3985506647 wait complete. 2023-10-18T20:50:36.376 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.370+0000 7f130759e700 1 Processor -- start 2023-10-18T20:50:36.376 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.371+0000 7f130759e700 1 -- start start 2023-10-18T20:50:36.376 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.371+0000 7f130759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:36.377 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.371+0000 7f130759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080fa550 con 0x7f130806fc30 2023-10-18T20:50:36.378 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.371+0000 7f130659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:36.378 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.371+0000 7f130659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42576/0 (socket says 172.21.15.8:42576) 2023-10-18T20:50:36.378 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.371+0000 7f130659c700 1 -- 172.21.15.8:0/1681053903 learned_addr learned my addr 172.21.15.8:0/1681053903 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.372+0000 7f130659c700 1 -- 172.21.15.8:0/1681053903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f800b200 con 0x7f130806fc30 2023-10-18T20:50:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.372+0000 7f130659c700 1 --2- 172.21.15.8:0/1681053903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fc0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f12f800b190 tx=0x7f12f8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.372+0000 7f12f6ffd700 1 -- 172.21.15.8:0/1681053903 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12f801b410 con 0x7f130806fc30 2023-10-18T20:50:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.372+0000 7f12f6ffd700 1 -- 172.21.15.8:0/1681053903 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f12f801b9e0 con 0x7f130806fc30 2023-10-18T20:50:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.372+0000 7f130759e700 1 -- 172.21.15.8:0/1681053903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13080fa6f0 con 0x7f130806fc30 2023-10-18T20:50:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.373+0000 7f12f6ffd700 1 -- 172.21.15.8:0/1681053903 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12f801a880 con 0x7f130806fc30 2023-10-18T20:50:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.373+0000 7f130759e700 1 -- 172.21.15.8:0/1681053903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13080fab00 con 0x7f130806fc30 2023-10-18T20:50:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.373+0000 7f12f6ffd700 1 -- 172.21.15.8:0/1681053903 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f12f800f070 con 0x7f130806fc30 2023-10-18T20:50:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.373+0000 7f12f6ffd700 1 -- 172.21.15.8:0/1681053903 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f12f8025b70 con 0x7f130806fc30 2023-10-18T20:50:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.374+0000 7f130759e700 1 -- 172.21.15.8:0/1681053903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1308045ad0 con 0x7f130806fc30 2023-10-18T20:50:36.381 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.378+0000 7f12f6ffd700 1 -- 172.21.15.8:0/1681053903 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f12f8016070 con 0x7f130806fc30 2023-10-18T20:50:36.457 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.454+0000 7f130759e700 1 -- 172.21.15.8:0/1681053903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f13080008d0 con 0x7f130806fc30 2023-10-18T20:50:36.463 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.455+0000 7f12f6ffd700 1 -- 172.21.15.8:0/1681053903 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f12f8006a70 con 0x7f130806fc30 2023-10-18T20:50:36.463 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.463 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: { 2023-10-18T20:50:36.464 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "fsid": "e1aaa62c-6df7-11ee-8db6-212e2dc638e7", 2023-10-18T20:50:36.464 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "health": { 2023-10-18T20:50:36.464 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2023-10-18T20:50:36.464 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "checks": {}, 2023-10-18T20:50:36.464 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "mutes": [] 2023-10-18T20:50:36.465 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:36.465 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "election_epoch": 5, 2023-10-18T20:50:36.465 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum": [ 2023-10-18T20:50:36.465 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 0 2023-10-18T20:50:36.465 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum_names": [ 2023-10-18T20:50:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "smithi008" 2023-10-18T20:50:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum_age": 8, 2023-10-18T20:50:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "monmap": { 2023-10-18T20:50:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2023-10-18T20:50:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_mons": 1 2023-10-18T20:50:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osdmap": { 2023-10-18T20:50:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:36.468 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_osds": 0, 2023-10-18T20:50:36.468 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_up_osds": 0, 2023-10-18T20:50:36.468 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osd_up_since": 0, 2023-10-18T20:50:36.468 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_in_osds": 0, 2023-10-18T20:50:36.468 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osd_in_since": 0, 2023-10-18T20:50:36.468 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2023-10-18T20:50:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "pgmap": { 2023-10-18T20:50:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "pgs_by_state": [], 2023-10-18T20:50:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_pgs": 0, 2023-10-18T20:50:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_pools": 0, 2023-10-18T20:50:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_objects": 0, 2023-10-18T20:50:36.470 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "data_bytes": 0, 2023-10-18T20:50:36.470 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_used": 0, 2023-10-18T20:50:36.470 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_avail": 0, 2023-10-18T20:50:36.470 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_total": 0 2023-10-18T20:50:36.470 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "fsmap": { 2023-10-18T20:50:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "by_rank": [], 2023-10-18T20:50:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "up:standby": 0 2023-10-18T20:50:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "mgrmap": { 2023-10-18T20:50:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "available": false, 2023-10-18T20:50:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_standbys": 0, 2023-10-18T20:50:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "modules": [ 2023-10-18T20:50:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "iostat", 2023-10-18T20:50:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "restful" 2023-10-18T20:50:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "services": {} 2023-10-18T20:50:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "servicemap": { 2023-10-18T20:50:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "modified": "2023-10-18T20:50:24.656714+0000", 2023-10-18T20:50:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "services": {} 2023-10-18T20:50:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "progress_events": {} 2023-10-18T20:50:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: } 2023-10-18T20:50:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.456+0000 7f130759e700 1 -- 172.21.15.8:0/1681053903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 msgr2=0x7f13080fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:36.475 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.456+0000 7f130759e700 1 --2- 172.21.15.8:0/1681053903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fc0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f12f800b190 tx=0x7f12f8006ee0).stop 2023-10-18T20:50:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.456+0000 7f130759e700 1 -- 172.21.15.8:0/1681053903 shutdown_connections 2023-10-18T20:50:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.456+0000 7f130759e700 1 --2- 172.21.15.8:0/1681053903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f130806fc30 0x7f13080fc0d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.456+0000 7f130759e700 1 -- 172.21.15.8:0/1681053903 >> 172.21.15.8:0/1681053903 conn(0x7f13080f6130 msgr2=0x7f13080f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.456+0000 7f130759e700 1 -- 172.21.15.8:0/1681053903 shutdown_connections 2023-10-18T20:50:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:36.456+0000 7f130759e700 1 -- 172.21.15.8:0/1681053903 wait complete. 2023-10-18T20:50:36.805 INFO:teuthology.orchestra.run.smithi008.stderr:mgr not available, waiting (3/15)... 2023-10-18T20:50:36.810 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.456367+0000 mon.smithi008 (mon.0) 9 : audit [DBG] from='client.? 172.21.15.8:0/1681053903' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-18T20:50:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:36.684392+0000 mon.smithi008 (mon.0) 10 : cluster [INF] Activating manager daemon smithi008.flmjzp 2023-10-18T20:50:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:36.687528+0000 mon.smithi008 (mon.0) 11 : cluster [DBG] mgrmap e2: smithi008.flmjzp(active, starting, since 0.00336893s) 2023-10-18T20:50:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.689159+0000 mon.smithi008 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.8:0/1690427218' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T20:50:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.689363+0000 mon.smithi008 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.8:0/1690427218' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T20:50:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.689501+0000 mon.smithi008 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.8:0/1690427218' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T20:50:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.689708+0000 mon.smithi008 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.8:0/1690427218' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:50:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.690540+0000 mon.smithi008 (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.15.8:0/1690427218' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr metadata", "who": "smithi008.flmjzp", "id": "smithi008.flmjzp"}]: dispatch 2023-10-18T20:50:37.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:36.693143+0000 mon.smithi008 (mon.0) 17 : cluster [INF] Manager daemon smithi008.flmjzp is now available 2023-10-18T20:50:37.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.701721+0000 mon.smithi008 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.8:0/1690427218' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:37.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.709352+0000 mon.smithi008 (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.8:0/1690427218' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:50:37.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.710932+0000 mon.smithi008 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.8:0/1690427218' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:50:37.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.717346+0000 mon.smithi008 (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.8:0/1690427218' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:37.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:36.720571+0000 mon.smithi008 (mon.0) 22 : audit [INF] from='mgr.14100 172.21.15.8:0/1690427218' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:38.807 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2023-10-18T20:50:38.953 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:37.691816+0000 mon.smithi008 (mon.0) 23 : cluster [DBG] mgrmap e3: smithi008.flmjzp(active, since 1.00765s) 2023-10-18T20:50:39.200 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.196+0000 7fb81f3d1700 1 Processor -- start 2023-10-18T20:50:39.200 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.197+0000 7fb81f3d1700 1 -- start start 2023-10-18T20:50:39.202 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.197+0000 7fb81f3d1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb8180fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:39.202 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.197+0000 7fb81f3d1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180feb40 con 0x7fb81806fc30 2023-10-18T20:50:39.202 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.197+0000 7fb81e3cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb8180fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:39.203 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.197+0000 7fb81e3cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb8180fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56710/0 (socket says 172.21.15.8:56710) 2023-10-18T20:50:39.203 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.197+0000 7fb81e3cf700 1 -- 172.21.15.8:0/1731947818 learned_addr learned my addr 172.21.15.8:0/1731947818 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:39.203 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.198+0000 7fb81e3cf700 1 -- 172.21.15.8:0/1731947818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180fec80 con 0x7fb81806fc30 2023-10-18T20:50:39.203 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.198+0000 7fb81e3cf700 1 --2- 172.21.15.8:0/1731947818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb8180fe650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fb81400b5f0 tx=0x7fb814006ee0).ready entity=mon.0 client_cookie=23ea1a442d1d0bcb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:39.204 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.198+0000 7fb81d3cd700 1 -- 172.21.15.8:0/1731947818 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb81400d600 con 0x7fb81806fc30 2023-10-18T20:50:39.204 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.198+0000 7fb81d3cd700 1 -- 172.21.15.8:0/1731947818 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fb81400dbd0 con 0x7fb81806fc30 2023-10-18T20:50:39.204 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.198+0000 7fb81d3cd700 1 -- 172.21.15.8:0/1731947818 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb814011c00 con 0x7fb81806fc30 2023-10-18T20:50:39.204 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.199+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1731947818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 msgr2=0x7fb8180fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:39.204 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.199+0000 7fb81f3d1700 1 --2- 172.21.15.8:0/1731947818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb8180fe650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fb81400b5f0 tx=0x7fb814006ee0).stop 2023-10-18T20:50:39.205 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.199+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1731947818 shutdown_connections 2023-10-18T20:50:39.205 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.199+0000 7fb81f3d1700 1 --2- 172.21.15.8:0/1731947818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb8180fe650 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:39.205 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.199+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1731947818 >> 172.21.15.8:0/1731947818 conn(0x7fb8180f6130 msgr2=0x7fb8180f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:39.205 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.199+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1731947818 shutdown_connections 2023-10-18T20:50:39.205 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.199+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1731947818 wait complete. 2023-10-18T20:50:39.208 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.200+0000 7fb81f3d1700 1 Processor -- start 2023-10-18T20:50:39.208 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.200+0000 7fb81f3d1700 1 -- start start 2023-10-18T20:50:39.208 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.200+0000 7fb81f3d1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb81810c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:39.208 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.200+0000 7fb81f3d1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81810ceb0 con 0x7fb81806fc30 2023-10-18T20:50:39.208 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.201+0000 7fb81e3cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb81810c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:39.209 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.201+0000 7fb81e3cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb81810c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56716/0 (socket says 172.21.15.8:56716) 2023-10-18T20:50:39.209 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.201+0000 7fb81e3cf700 1 -- 172.21.15.8:0/1622719216 learned_addr learned my addr 172.21.15.8:0/1622719216 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:39.209 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.201+0000 7fb81e3cf700 1 -- 172.21.15.8:0/1622719216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81400b200 con 0x7fb81806fc30 2023-10-18T20:50:39.209 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.201+0000 7fb81e3cf700 1 --2- 172.21.15.8:0/1622719216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb81810c9c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb81400e040 tx=0x7fb814006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:39.209 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.201+0000 7fb806ffd700 1 -- 172.21.15.8:0/1622719216 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb81400d9f0 con 0x7fb81806fc30 2023-10-18T20:50:39.209 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.201+0000 7fb806ffd700 1 -- 172.21.15.8:0/1622719216 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fb81401a9f0 con 0x7fb81806fc30 2023-10-18T20:50:39.210 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.201+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1622719216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81810d0b0 con 0x7fb81806fc30 2023-10-18T20:50:39.210 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.202+0000 7fb806ffd700 1 -- 172.21.15.8:0/1622719216 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb81401b8c0 con 0x7fb81806fc30 2023-10-18T20:50:39.210 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.202+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1622719216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81810d4c0 con 0x7fb81806fc30 2023-10-18T20:50:39.210 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.203+0000 7fb806ffd700 1 -- 172.21.15.8:0/1622719216 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 3) v1 ==== 36029+0+0 (secure 0 0 0) 0x7fb81400f070 con 0x7fb81806fc30 2023-10-18T20:50:39.210 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.203+0000 7fb806ffd700 1 --2- 172.21.15.8:0/1622719216 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7fb80002fcc0 0x7fb800032180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:39.211 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.203+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1622719216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb818045ad0 con 0x7fb81806fc30 2023-10-18T20:50:39.211 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.203+0000 7fb806ffd700 1 -- 172.21.15.8:0/1622719216 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb814041140 con 0x7fb81806fc30 2023-10-18T20:50:39.211 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.203+0000 7fb81dbce700 1 --2- 172.21.15.8:0/1622719216 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7fb80002fcc0 0x7fb800032180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:39.211 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.204+0000 7fb81dbce700 1 --2- 172.21.15.8:0/1622719216 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7fb80002fcc0 0x7fb800032180 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fb8080096a0 tx=0x7fb808006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:39.212 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.209+0000 7fb806ffd700 1 -- 172.21.15.8:0/1622719216 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb81406d2b0 con 0x7fb81806fc30 2023-10-18T20:50:39.298 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.295+0000 7fb806ffd700 1 -- 172.21.15.8:0/1622719216 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 4) v1 ==== 36109+0+0 (secure 0 0 0) 0x7fb81401ab60 con 0x7fb81806fc30 2023-10-18T20:50:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.436+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1622719216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb8180ff8f0 con 0x7fb81806fc30 2023-10-18T20:50:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.437+0000 7fb806ffd700 1 -- 172.21.15.8:0/1622719216 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7fb814016070 con 0x7fb81806fc30 2023-10-18T20:50:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: { 2023-10-18T20:50:39.446 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "fsid": "e1aaa62c-6df7-11ee-8db6-212e2dc638e7", 2023-10-18T20:50:39.446 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "health": { 2023-10-18T20:50:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2023-10-18T20:50:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "checks": {}, 2023-10-18T20:50:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "mutes": [] 2023-10-18T20:50:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "election_epoch": 5, 2023-10-18T20:50:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum": [ 2023-10-18T20:50:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 0 2023-10-18T20:50:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum_names": [ 2023-10-18T20:50:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "smithi008" 2023-10-18T20:50:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "quorum_age": 11, 2023-10-18T20:50:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "monmap": { 2023-10-18T20:50:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2023-10-18T20:50:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_mons": 1 2023-10-18T20:50:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osdmap": { 2023-10-18T20:50:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:39.450 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_osds": 0, 2023-10-18T20:50:39.451 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_up_osds": 0, 2023-10-18T20:50:39.451 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osd_up_since": 0, 2023-10-18T20:50:39.451 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_in_osds": 0, 2023-10-18T20:50:39.451 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "osd_in_since": 0, 2023-10-18T20:50:39.451 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2023-10-18T20:50:39.451 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:39.452 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "pgmap": { 2023-10-18T20:50:39.452 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "pgs_by_state": [], 2023-10-18T20:50:39.452 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_pgs": 0, 2023-10-18T20:50:39.452 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_pools": 0, 2023-10-18T20:50:39.452 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_objects": 0, 2023-10-18T20:50:39.453 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "data_bytes": 0, 2023-10-18T20:50:39.453 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_used": 0, 2023-10-18T20:50:39.453 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_avail": 0, 2023-10-18T20:50:39.453 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "bytes_total": 0 2023-10-18T20:50:39.453 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:39.454 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "fsmap": { 2023-10-18T20:50:39.454 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:39.454 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "by_rank": [], 2023-10-18T20:50:39.454 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "up:standby": 0 2023-10-18T20:50:39.454 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:39.455 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "mgrmap": { 2023-10-18T20:50:39.455 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "available": true, 2023-10-18T20:50:39.455 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_standbys": 0, 2023-10-18T20:50:39.455 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "modules": [ 2023-10-18T20:50:39.455 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "iostat", 2023-10-18T20:50:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "restful" 2023-10-18T20:50:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ], 2023-10-18T20:50:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "services": {} 2023-10-18T20:50:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:39.456 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "servicemap": { 2023-10-18T20:50:39.457 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 1, 2023-10-18T20:50:39.457 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "modified": "2023-10-18T20:50:24.656714+0000", 2023-10-18T20:50:39.457 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "services": {} 2023-10-18T20:50:39.457 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: }, 2023-10-18T20:50:39.457 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "progress_events": {} 2023-10-18T20:50:39.458 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: } 2023-10-18T20:50:39.459 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1622719216 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7fb80002fcc0 msgr2=0x7fb800032180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:39.459 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440+0000 7fb81f3d1700 1 --2- 172.21.15.8:0/1622719216 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7fb80002fcc0 0x7fb800032180 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fb8080096a0 tx=0x7fb808006b40).stop 2023-10-18T20:50:39.459 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1622719216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 msgr2=0x7fb81810c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:39.459 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440+0000 7fb81f3d1700 1 --2- 172.21.15.8:0/1622719216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb81810c9c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb81400e040 tx=0x7fb814006ee0).stop 2023-10-18T20:50:39.460 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1622719216 shutdown_connections 2023-10-18T20:50:39.460 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440+0000 7fb81f3d1700 1 --2- 172.21.15.8:0/1622719216 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7fb80002fcc0 0x7fb800032180 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:39.460 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440+0000 7fb81f3d1700 1 --2- 172.21.15.8:0/1622719216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81806fc30 0x7fb81810c9c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:39.460 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1622719216 >> 172.21.15.8:0/1622719216 conn(0x7fb8180f6130 msgr2=0x7fb8180f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:39.460 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1622719216 shutdown_connections 2023-10-18T20:50:39.461 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:39.440+0000 7fb81f3d1700 1 -- 172.21.15.8:0/1622719216 wait complete. 2023-10-18T20:50:39.811 INFO:teuthology.orchestra.run.smithi008.stderr:mgr is available 2023-10-18T20:50:39.812 INFO:teuthology.orchestra.run.smithi008.stderr:Enabling cephadm module... 2023-10-18T20:50:39.812 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable cephadm 2023-10-18T20:50:40.211 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.207+0000 7f53d9fad700 1 Processor -- start 2023-10-18T20:50:40.211 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.207+0000 7f53d9fad700 1 -- start start 2023-10-18T20:50:40.211 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.208+0000 7f53d9fad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d406fc30 0x7f53d40fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:40.212 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.208+0000 7f53d9fad700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40feb40 con 0x7f53d406fc30 2023-10-18T20:50:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.208+0000 7f53d8fab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d406fc30 0x7f53d40fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.208+0000 7f53d8fab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d406fc30 0x7f53d40fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56728/0 (socket says 172.21.15.8:56728) 2023-10-18T20:50:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.208+0000 7f53d8fab700 1 -- 172.21.15.8:0/4176205587 learned_addr learned my addr 172.21.15.8:0/4176205587 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.209+0000 7f53d8fab700 1 -- 172.21.15.8:0/4176205587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40fec80 con 0x7f53d406fc30 2023-10-18T20:50:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.209+0000 7f53d8fab700 1 --2- 172.21.15.8:0/4176205587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d406fc30 0x7f53d40fe650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f53c800b5f0 tx=0x7f53c8006ee0).ready entity=mon.0 client_cookie=b4e9d342f2b52121 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:40.215 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.209+0000 7f53d37fe700 1 -- 172.21.15.8:0/4176205587 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c800d600 con 0x7f53d406fc30 2023-10-18T20:50:40.215 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.209+0000 7f53d37fe700 1 -- 172.21.15.8:0/4176205587 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f53c800dbd0 con 0x7f53d406fc30 2023-10-18T20:50:40.215 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.209+0000 7f53d37fe700 1 -- 172.21.15.8:0/4176205587 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c8011c00 con 0x7f53d406fc30 2023-10-18T20:50:40.215 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.209+0000 7f53d9fad700 1 -- 172.21.15.8:0/4176205587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d406fc30 msgr2=0x7f53d40fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.209+0000 7f53d9fad700 1 --2- 172.21.15.8:0/4176205587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d406fc30 0x7f53d40fe650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f53c800b5f0 tx=0x7f53c8006ee0).stop 2023-10-18T20:50:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.210+0000 7f53d9fad700 1 -- 172.21.15.8:0/4176205587 shutdown_connections 2023-10-18T20:50:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.210+0000 7f53d9fad700 1 --2- 172.21.15.8:0/4176205587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d406fc30 0x7f53d40fe650 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.210+0000 7f53d9fad700 1 -- 172.21.15.8:0/4176205587 >> 172.21.15.8:0/4176205587 conn(0x7f53d40f6130 msgr2=0x7f53d40f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.210+0000 7f53d9fad700 1 -- 172.21.15.8:0/4176205587 shutdown_connections 2023-10-18T20:50:40.216 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.210+0000 7f53d9fad700 1 -- 172.21.15.8:0/4176205587 wait complete. 2023-10-18T20:50:40.217 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.211+0000 7f53d9fad700 1 Processor -- start 2023-10-18T20:50:40.217 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.211+0000 7f53d9fad700 1 -- start start 2023-10-18T20:50:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.212+0000 7f53d9fad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d410a8c0 0x7f53d410ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.212+0000 7f53d9fad700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d410b1d0 con 0x7f53d410a8c0 2023-10-18T20:50:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.212+0000 7f53d8fab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d410a8c0 0x7f53d410ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.212+0000 7f53d8fab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d410a8c0 0x7f53d410ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56742/0 (socket says 172.21.15.8:56742) 2023-10-18T20:50:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.212+0000 7f53d8fab700 1 -- 172.21.15.8:0/3830580483 learned_addr learned my addr 172.21.15.8:0/3830580483 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.212+0000 7f53d8fab700 1 -- 172.21.15.8:0/3830580483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c800b200 con 0x7f53d410a8c0 2023-10-18T20:50:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.212+0000 7f53d8fab700 1 --2- 172.21.15.8:0/3830580483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d410a8c0 0x7f53d410ace0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f53c800e040 tx=0x7f53c8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:40.221 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.213+0000 7f53d17fa700 1 -- 172.21.15.8:0/3830580483 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c800d9f0 con 0x7f53d410a8c0 2023-10-18T20:50:40.221 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.213+0000 7f53d17fa700 1 -- 172.21.15.8:0/3830580483 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f53c801a9f0 con 0x7f53d410a8c0 2023-10-18T20:50:40.221 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.213+0000 7f53d9fad700 1 -- 172.21.15.8:0/3830580483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d410b3d0 con 0x7f53d410a8c0 2023-10-18T20:50:40.221 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.213+0000 7f53d17fa700 1 -- 172.21.15.8:0/3830580483 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c801b790 con 0x7f53d410a8c0 2023-10-18T20:50:40.221 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.213+0000 7f53d9fad700 1 -- 172.21.15.8:0/3830580483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d410bea0 con 0x7f53d410a8c0 2023-10-18T20:50:40.222 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.214+0000 7f53d17fa700 1 -- 172.21.15.8:0/3830580483 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 36109+0+0 (secure 0 0 0) 0x7f53c800f070 con 0x7f53d410a8c0 2023-10-18T20:50:40.222 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.214+0000 7f53d9fad700 1 -- 172.21.15.8:0/3830580483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d4059100 con 0x7f53d410a8c0 2023-10-18T20:50:40.222 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.214+0000 7f53d17fa700 1 --2- 172.21.15.8:0/3830580483 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f53b802fd50 0x7f53b8032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:40.222 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.214+0000 7f53d17fa700 1 -- 172.21.15.8:0/3830580483 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f53c8041230 con 0x7f53d410a8c0 2023-10-18T20:50:40.222 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.215+0000 7f53d3fff700 1 --2- 172.21.15.8:0/3830580483 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f53b802fd50 0x7f53b8032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:40.223 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.215+0000 7f53d3fff700 1 --2- 172.21.15.8:0/3830580483 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f53b802fd50 0x7f53b8032210 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f53c00096a0 tx=0x7f53c0006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:40.223 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.219+0000 7f53d17fa700 1 -- 172.21.15.8:0/3830580483 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f53c8006a70 con 0x7f53d410a8c0 2023-10-18T20:50:40.428 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:40.426+0000 7f53d9fad700 1 -- 172.21.15.8:0/3830580483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f53d4045ad0 con 0x7f53d410a8c0 2023-10-18T20:50:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:39.297758+0000 mon.smithi008 (mon.0) 24 : cluster [DBG] mgrmap e4: smithi008.flmjzp(active, since 2s) 2023-10-18T20:50:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:39.438355+0000 mon.smithi008 (mon.0) 25 : audit [DBG] from='client.? 172.21.15.8:0/1622719216' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-18T20:50:41.303 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.299+0000 7f53d17fa700 1 -- 172.21.15.8:0/3830580483 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f53c8025460 con 0x7f53d410a8c0 2023-10-18T20:50:41.304 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.301+0000 7f53d17fa700 1 -- 172.21.15.8:0/3830580483 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f53c80224f0 con 0x7f53d410a8c0 2023-10-18T20:50:41.308 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.305+0000 7f53d9fad700 1 -- 172.21.15.8:0/3830580483 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f53b802fd50 msgr2=0x7f53b8032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:41.308 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.305+0000 7f53d9fad700 1 --2- 172.21.15.8:0/3830580483 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f53b802fd50 0x7f53b8032210 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f53c00096a0 tx=0x7f53c0006b40).stop 2023-10-18T20:50:41.308 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.305+0000 7f53d9fad700 1 -- 172.21.15.8:0/3830580483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d410a8c0 msgr2=0x7f53d410ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:41.309 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.305+0000 7f53d9fad700 1 --2- 172.21.15.8:0/3830580483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d410a8c0 0x7f53d410ace0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f53c800e040 tx=0x7f53c8006ee0).stop 2023-10-18T20:50:41.309 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.305+0000 7f53d9fad700 1 -- 172.21.15.8:0/3830580483 shutdown_connections 2023-10-18T20:50:41.310 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.305+0000 7f53d9fad700 1 --2- 172.21.15.8:0/3830580483 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f53b802fd50 0x7f53b8032210 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:41.310 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.305+0000 7f53d9fad700 1 --2- 172.21.15.8:0/3830580483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53d410a8c0 0x7f53d410ace0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:41.310 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.305+0000 7f53d9fad700 1 -- 172.21.15.8:0/3830580483 >> 172.21.15.8:0/3830580483 conn(0x7f53d40f6130 msgr2=0x7f53d40f7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:41.310 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.305+0000 7f53d9fad700 1 -- 172.21.15.8:0/3830580483 shutdown_connections 2023-10-18T20:50:41.310 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:41.305+0000 7f53d9fad700 1 -- 172.21.15.8:0/3830580483 wait complete. 2023-10-18T20:50:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:40.427868+0000 mon.smithi008 (mon.0) 26 : audit [INF] from='client.? 172.21.15.8:0/3830580483' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-18T20:50:41.672 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2023-10-18T20:50:42.078 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.074+0000 7f7a0c934700 1 Processor -- start 2023-10-18T20:50:42.078 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.074+0000 7f7a0c934700 1 -- start start 2023-10-18T20:50:42.078 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.074+0000 7f7a0c934700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a080fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:42.079 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.074+0000 7f7a0c934700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080feb40 con 0x7f7a0806fc30 2023-10-18T20:50:42.079 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.075+0000 7f7a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a080fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:42.081 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.075+0000 7f7a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a080fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56776/0 (socket says 172.21.15.8:56776) 2023-10-18T20:50:42.082 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.075+0000 7f7a077fe700 1 -- 172.21.15.8:0/3068024534 learned_addr learned my addr 172.21.15.8:0/3068024534 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:42.082 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.075+0000 7f7a077fe700 1 -- 172.21.15.8:0/3068024534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080fec80 con 0x7f7a0806fc30 2023-10-18T20:50:42.082 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.075+0000 7f7a077fe700 1 --2- 172.21.15.8:0/3068024534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a080fe650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f79f800b5f0 tx=0x7f79f8006ee0).ready entity=mon.0 client_cookie=d35a6094578f51b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:42.082 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.076+0000 7f7a067fc700 1 -- 172.21.15.8:0/3068024534 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79f800d600 con 0x7f7a0806fc30 2023-10-18T20:50:42.083 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.076+0000 7f7a067fc700 1 -- 172.21.15.8:0/3068024534 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f79f800dbd0 con 0x7f7a0806fc30 2023-10-18T20:50:42.083 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.076+0000 7f7a067fc700 1 -- 172.21.15.8:0/3068024534 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79f8011c00 con 0x7f7a0806fc30 2023-10-18T20:50:42.083 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.076+0000 7f7a0c934700 1 -- 172.21.15.8:0/3068024534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 msgr2=0x7f7a080fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:42.083 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.076+0000 7f7a0c934700 1 --2- 172.21.15.8:0/3068024534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a080fe650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f79f800b5f0 tx=0x7f79f8006ee0).stop 2023-10-18T20:50:42.083 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.076+0000 7f7a0c934700 1 -- 172.21.15.8:0/3068024534 shutdown_connections 2023-10-18T20:50:42.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.076+0000 7f7a0c934700 1 --2- 172.21.15.8:0/3068024534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a080fe650 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:42.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.076+0000 7f7a0c934700 1 -- 172.21.15.8:0/3068024534 >> 172.21.15.8:0/3068024534 conn(0x7f7a080f6130 msgr2=0x7f7a080f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:42.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.077+0000 7f7a0c934700 1 -- 172.21.15.8:0/3068024534 shutdown_connections 2023-10-18T20:50:42.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.077+0000 7f7a0c934700 1 -- 172.21.15.8:0/3068024534 wait complete. 2023-10-18T20:50:42.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.078+0000 7f7a0c934700 1 Processor -- start 2023-10-18T20:50:42.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.078+0000 7f7a0c934700 1 -- start start 2023-10-18T20:50:42.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.078+0000 7f7a0c934700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a0810c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:42.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.078+0000 7f7a0c934700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0810ceb0 con 0x7f7a0806fc30 2023-10-18T20:50:42.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.078+0000 7f7a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a0810c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:42.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.078+0000 7f7a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a0810c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56778/0 (socket says 172.21.15.8:56778) 2023-10-18T20:50:42.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.078+0000 7f7a077fe700 1 -- 172.21.15.8:0/3206011387 learned_addr learned my addr 172.21.15.8:0/3206011387 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:42.086 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.079+0000 7f7a077fe700 1 -- 172.21.15.8:0/3206011387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f800b200 con 0x7f7a0806fc30 2023-10-18T20:50:42.086 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.079+0000 7f7a077fe700 1 --2- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a0810c9c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f79f800e040 tx=0x7f79f8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:42.087 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.079+0000 7f79effff700 1 -- 172.21.15.8:0/3206011387 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79f800d9f0 con 0x7f7a0806fc30 2023-10-18T20:50:42.087 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.079+0000 7f79effff700 1 -- 172.21.15.8:0/3206011387 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f79f801a9f0 con 0x7f7a0806fc30 2023-10-18T20:50:42.087 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.079+0000 7f79effff700 1 -- 172.21.15.8:0/3206011387 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79f801b8c0 con 0x7f7a0806fc30 2023-10-18T20:50:42.088 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.079+0000 7f7a0c934700 1 -- 172.21.15.8:0/3206011387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0810d0b0 con 0x7f7a0806fc30 2023-10-18T20:50:42.088 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.080+0000 7f7a0c934700 1 -- 172.21.15.8:0/3206011387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0810d4c0 con 0x7f7a0806fc30 2023-10-18T20:50:42.088 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.080+0000 7f79effff700 1 -- 172.21.15.8:0/3206011387 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f79f800f070 con 0x7f7a0806fc30 2023-10-18T20:50:42.088 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.081+0000 7f7a0c934700 1 -- 172.21.15.8:0/3206011387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a08045ad0 con 0x7f7a0806fc30 2023-10-18T20:50:42.088 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.081+0000 7f79effff700 1 --2- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f79f402fdb0 0x7f79f4032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:42.089 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.081+0000 7f79effff700 1 -- 172.21.15.8:0/3206011387 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f79f8041280 con 0x7f7a0806fc30 2023-10-18T20:50:42.089 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.081+0000 7f7a06ffd700 1 -- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f79f402fdb0 msgr2=0x7f79f4032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4107557235 2023-10-18T20:50:42.089 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.081+0000 7f7a06ffd700 1 --2- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f79f402fdb0 0x7f79f4032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T20:50:42.089 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.085+0000 7f79effff700 1 -- 172.21.15.8:0/3206011387 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f79f8006a70 con 0x7f7a0806fc30 2023-10-18T20:50:42.285 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.282+0000 7f7a06ffd700 1 -- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f79f402fdb0 msgr2=0x7f79f4032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4107557235 2023-10-18T20:50:42.285 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.282+0000 7f7a06ffd700 1 --2- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f79f402fdb0 0x7f79f4032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T20:50:42.296 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.293+0000 7f7a0c934700 1 -- 172.21.15.8:0/3206011387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f7a0810e570 con 0x7f7a0806fc30 2023-10-18T20:50:42.297 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.294+0000 7f79effff700 1 -- 172.21.15.8:0/3206011387 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f79f8022310 con 0x7f7a0806fc30 2023-10-18T20:50:42.297 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: { 2023-10-18T20:50:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 5, 2023-10-18T20:50:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "available": true, 2023-10-18T20:50:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "active_name": "smithi008.flmjzp", 2023-10-18T20:50:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_standby": 0 2023-10-18T20:50:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: } 2023-10-18T20:50:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.296+0000 7f7a0c934700 1 -- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f79f402fdb0 msgr2=0x7f79f4032270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:50:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.296+0000 7f7a0c934700 1 --2- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f79f402fdb0 0x7f79f4032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:50:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.296+0000 7f7a0c934700 1 -- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 msgr2=0x7f7a0810c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.296+0000 7f7a0c934700 1 --2- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a0810c9c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f79f800e040 tx=0x7f79f8006ee0).stop 2023-10-18T20:50:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.296+0000 7f7a0c934700 1 -- 172.21.15.8:0/3206011387 shutdown_connections 2023-10-18T20:50:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.296+0000 7f7a0c934700 1 --2- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f79f402fdb0 0x7f79f4032270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:50:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.296+0000 7f7a0c934700 1 --2- 172.21.15.8:0/3206011387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0806fc30 0x7f7a0810c9c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.296+0000 7f7a0c934700 1 -- 172.21.15.8:0/3206011387 >> 172.21.15.8:0/3206011387 conn(0x7f7a080f6130 msgr2=0x7f7a080f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.296+0000 7f7a0c934700 1 -- 172.21.15.8:0/3206011387 shutdown_connections 2023-10-18T20:50:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:42.296+0000 7f7a0c934700 1 -- 172.21.15.8:0/3206011387 wait complete. 2023-10-18T20:50:42.651 INFO:teuthology.orchestra.run.smithi008.stderr:Waiting for the mgr to restart... 2023-10-18T20:50:42.651 INFO:teuthology.orchestra.run.smithi008.stderr:Waiting for mgr epoch 5... 2023-10-18T20:50:42.652 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:41.302358+0000 mon.smithi008 (mon.0) 27 : audit [INF] from='client.? 172.21.15.8:0/3830580483' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-18T20:50:42.652 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:41.302472+0000 mon.smithi008 (mon.0) 28 : cluster [DBG] mgrmap e5: smithi008.flmjzp(active, since 4s) 2023-10-18T20:50:42.652 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:42.295577+0000 mon.smithi008 (mon.0) 29 : audit [DBG] from='client.? 172.21.15.8:0/3206011387' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-18T20:50:42.653 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2023-10-18T20:50:43.116 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.112+0000 7f49d965f700 1 Processor -- start 2023-10-18T20:50:43.116 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.112+0000 7f49d965f700 1 -- start start 2023-10-18T20:50:43.116 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.113+0000 7f49d965f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:43.116 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.113+0000 7f49d965f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d4072110 con 0x7f49d4071cf0 2023-10-18T20:50:43.117 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.113+0000 7f49d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:43.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.113+0000 7f49d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56788/0 (socket says 172.21.15.8:56788) 2023-10-18T20:50:43.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.113+0000 7f49d3fff700 1 -- 172.21.15.8:0/2276838468 learned_addr learned my addr 172.21.15.8:0/2276838468 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:43.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.113+0000 7f49d3fff700 1 -- 172.21.15.8:0/2276838468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d4070780 con 0x7f49d4071cf0 2023-10-18T20:50:43.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.114+0000 7f49d3fff700 1 --2- 172.21.15.8:0/2276838468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4070290 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f49c400b5f0 tx=0x7f49c4006ee0).ready entity=mon.0 client_cookie=34ec3af42e74e1c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.114+0000 7f49d2ffd700 1 -- 172.21.15.8:0/2276838468 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49c400d600 con 0x7f49d4071cf0 2023-10-18T20:50:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.114+0000 7f49d2ffd700 1 -- 172.21.15.8:0/2276838468 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f49c400dbd0 con 0x7f49d4071cf0 2023-10-18T20:50:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.114+0000 7f49d2ffd700 1 -- 172.21.15.8:0/2276838468 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49c4011c00 con 0x7f49d4071cf0 2023-10-18T20:50:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.114+0000 7f49d965f700 1 -- 172.21.15.8:0/2276838468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 msgr2=0x7f49d4070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.114+0000 7f49d965f700 1 --2- 172.21.15.8:0/2276838468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4070290 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f49c400b5f0 tx=0x7f49c4006ee0).stop 2023-10-18T20:50:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.115+0000 7f49d965f700 1 -- 172.21.15.8:0/2276838468 shutdown_connections 2023-10-18T20:50:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.115+0000 7f49d965f700 1 --2- 172.21.15.8:0/2276838468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4070290 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.115+0000 7f49d965f700 1 -- 172.21.15.8:0/2276838468 >> 172.21.15.8:0/2276838468 conn(0x7f49d40f71d0 msgr2=0x7f49d40f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.115+0000 7f49d965f700 1 -- 172.21.15.8:0/2276838468 shutdown_connections 2023-10-18T20:50:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.115+0000 7f49d965f700 1 -- 172.21.15.8:0/2276838468 wait complete. 2023-10-18T20:50:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.116+0000 7f49d965f700 1 Processor -- start 2023-10-18T20:50:43.122 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.116+0000 7f49d965f700 1 -- start start 2023-10-18T20:50:43.122 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.116+0000 7f49d965f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4110ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:43.122 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.116+0000 7f49d965f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d4111390 con 0x7f49d4071cf0 2023-10-18T20:50:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.116+0000 7f49d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4110ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.116+0000 7f49d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4110ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56796/0 (socket says 172.21.15.8:56796) 2023-10-18T20:50:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.116+0000 7f49d3fff700 1 -- 172.21.15.8:0/1429266167 learned_addr learned my addr 172.21.15.8:0/1429266167 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.117+0000 7f49d3fff700 1 -- 172.21.15.8:0/1429266167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c400b200 con 0x7f49d4071cf0 2023-10-18T20:50:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.117+0000 7f49d3fff700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4110ea0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f49c4006c70 tx=0x7f49c4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.117+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49c400da30 con 0x7f49d4071cf0 2023-10-18T20:50:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.117+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f49c401a9f0 con 0x7f49d4071cf0 2023-10-18T20:50:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.117+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49c401b890 con 0x7f49d4071cf0 2023-10-18T20:50:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.117+0000 7f49d965f700 1 -- 172.21.15.8:0/1429266167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d4111590 con 0x7f49d4071cf0 2023-10-18T20:50:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.118+0000 7f49d965f700 1 -- 172.21.15.8:0/1429266167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d41119a0 con 0x7f49d4071cf0 2023-10-18T20:50:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.119+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f49c400f070 con 0x7f49d4071cf0 2023-10-18T20:50:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.119+0000 7f49d0ff9700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 0x7f49c0032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.119+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 --> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49c0032930 con 0x7f49c002fdb0 2023-10-18T20:50:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.119+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f49c40411c0 con 0x7f49d4071cf0 2023-10-18T20:50:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.119+0000 7f49d37fe700 1 -- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 msgr2=0x7f49c0032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4107557235 2023-10-18T20:50:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.119+0000 7f49d37fe700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 0x7f49c0032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T20:50:43.323 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.320+0000 7f49d37fe700 1 -- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 msgr2=0x7f49c0032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4107557235 2023-10-18T20:50:43.323 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.320+0000 7f49d37fe700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 0x7f49c0032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T20:50:43.724 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.721+0000 7f49d37fe700 1 -- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 msgr2=0x7f49c0032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4107557235 2023-10-18T20:50:43.724 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:43.721+0000 7f49d37fe700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 0x7f49c0032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T20:50:44.525 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:44.522+0000 7f49d37fe700 1 -- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 msgr2=0x7f49c0032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4107557235 2023-10-18T20:50:44.525 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:44.522+0000 7f49d37fe700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 0x7f49c0032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T20:50:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:46.123+0000 7f49d37fe700 1 -- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 msgr2=0x7f49c0032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4107557235 2023-10-18T20:50:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:46.123+0000 7f49d37fe700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 0x7f49c0032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-18T20:50:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:48.106+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mgrmap(e 6) v1 ==== 35970+0+0 (secure 0 0 0) 0x7f49c401b9f0 con 0x7f49d4071cf0 2023-10-18T20:50:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:48.107+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 msgr2=0x7f49c0032270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:50:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:48.107+0000 7f49d0ff9700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 0x7f49c0032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:50:48.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:48.056118+0000 mon.smithi008 (mon.0) 30 : cluster [INF] Active manager daemon smithi008.flmjzp restarted 2023-10-18T20:50:48.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:48.056604+0000 mon.smithi008 (mon.0) 31 : cluster [INF] Activating manager daemon smithi008.flmjzp 2023-10-18T20:50:48.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:48.058428+0000 mon.smithi008 (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2023-10-18T20:50:49.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.114+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 7) v1 ==== 36040+0+0 (secure 0 0 0) 0x7f49c40429f0 con 0x7f49d4071cf0 2023-10-18T20:50:49.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.115+0000 7f49d0ff9700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f49c0033880 0x7f49c0035c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:49.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.115+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49c0032930 con 0x7f49c0033880 2023-10-18T20:50:49.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.115+0000 7f49d37fe700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f49c0033880 0x7f49c0035c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.116+0000 7f49d37fe700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f49c0033880 0x7f49c0035c70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f49c8006fd0 tx=0x7f49c8006d70).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.117+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 <== mgr.14116 v2:172.21.15.8:6800/1016712461 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f49c0032930 con 0x7f49c0033880 2023-10-18T20:50:49.127 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.124+0000 7f49d965f700 1 -- 172.21.15.8:0/1429266167 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f49d4059100 con 0x7f49c0033880 2023-10-18T20:50:49.127 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d0ff9700 1 -- 172.21.15.8:0/1429266167 <== mgr.14116 v2:172.21.15.8:6800/1016712461 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f49d4059100 con 0x7f49c0033880 2023-10-18T20:50:49.127 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: { 2023-10-18T20:50:49.128 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2023-10-18T20:50:49.129 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "initialized": true 2023-10-18T20:50:49.129 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: } 2023-10-18T20:50:49.129 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 -- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f49c0033880 msgr2=0x7f49c0035c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:49.129 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f49c0033880 0x7f49c0035c70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f49c8006fd0 tx=0x7f49c8006d70).stop 2023-10-18T20:50:49.129 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 -- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 msgr2=0x7f49d4110ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4110ea0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f49c4006c70 tx=0x7f49c4006ee0).stop 2023-10-18T20:50:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 -- 172.21.15.8:0/1429266167 shutdown_connections 2023-10-18T20:50:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f49c0033880 0x7f49c0035c70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49d4071cf0 0x7f49d4110ea0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 --2- 172.21.15.8:0/1429266167 >> [v2:172.21.15.8:6800/4107557235,v1:172.21.15.8:6801/4107557235] conn(0x7f49c002fdb0 0x7f49c0032270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:50:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 -- 172.21.15.8:0/1429266167 >> 172.21.15.8:0/1429266167 conn(0x7f49d40f71d0 msgr2=0x7f49d40fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 -- 172.21.15.8:0/1429266167 shutdown_connections 2023-10-18T20:50:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:49.125+0000 7f49d965f700 1 -- 172.21.15.8:0/1429266167 wait complete. 2023-10-18T20:50:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:48.109120+0000 mon.smithi008 (mon.0) 33 : cluster [DBG] mgrmap e6: smithi008.flmjzp(active, starting, since 0.0525926s) 2023-10-18T20:50:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.112206+0000 mon.smithi008 (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:50:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.113122+0000 mon.smithi008 (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr metadata", "who": "smithi008.flmjzp", "id": "smithi008.flmjzp"}]: dispatch 2023-10-18T20:50:49.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.114127+0000 mon.smithi008 (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T20:50:49.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.114359+0000 mon.smithi008 (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T20:50:49.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.114613+0000 mon.smithi008 (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T20:50:49.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:48.117822+0000 mon.smithi008 (mon.0) 39 : cluster [INF] Manager daemon smithi008.flmjzp is now available 2023-10-18T20:50:49.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.135826+0000 mon.smithi008 (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:49.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.138687+0000 mon.smithi008 (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:49.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.141248+0000 mon.smithi008 (mon.0) 42 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:49.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.254815+0000 mon.smithi008 (mon.0) 43 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:49.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.255726+0000 mon.smithi008 (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:50:49.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.258007+0000 mon.smithi008 (mon.0) 45 : audit [DBG] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:50:49.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.263920+0000 mon.smithi008 (mon.0) 46 : audit [DBG] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:50:49.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.273010+0000 mon.smithi008 (mon.0) 47 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:50:49.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:48.274650+0000 mon.smithi008 (mon.0) 48 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:50:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:49.118493+0000 mon.smithi008 (mon.0) 49 : cluster [DBG] mgrmap e7: smithi008.flmjzp(active, since 1.06196s) 2023-10-18T20:50:50.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:49.118696+0000 mgr.smithi008.flmjzp (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-18T20:50:50.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:49.126267+0000 mgr.smithi008.flmjzp (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-18T20:50:51.398 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:50:50.121553+0000 mon.smithi008 (mon.0) 50 : cluster [DBG] mgrmap e8: smithi008.flmjzp(active, since 2s) 2023-10-18T20:50:51.544 INFO:teuthology.orchestra.run.smithi008.stderr:mgr epoch 5 is available 2023-10-18T20:50:51.544 INFO:teuthology.orchestra.run.smithi008.stderr:Setting orchestrator backend to cephadm... 2023-10-18T20:50:51.544 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch set backend cephadm 2023-10-18T20:50:51.967 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.964+0000 7f10effff700 1 Processor -- start 2023-10-18T20:50:51.967 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.964+0000 7f10effff700 1 -- start start 2023-10-18T20:50:51.968 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.964+0000 7f10effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f00fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:51.968 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.964+0000 7f10effff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00feb40 con 0x7f10f006fc30 2023-10-18T20:50:51.969 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.964+0000 7f10eeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f00fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:51.970 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.965+0000 7f10eeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f00fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39080/0 (socket says 172.21.15.8:39080) 2023-10-18T20:50:51.970 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.965+0000 7f10eeffd700 1 -- 172.21.15.8:0/1699761902 learned_addr learned my addr 172.21.15.8:0/1699761902 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:51.970 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.965+0000 7f10eeffd700 1 -- 172.21.15.8:0/1699761902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f00fec80 con 0x7f10f006fc30 2023-10-18T20:50:51.971 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.965+0000 7f10eeffd700 1 --2- 172.21.15.8:0/1699761902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f00fe650 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f10e000b5f0 tx=0x7f10e0006ee0).ready entity=mon.0 client_cookie=9595ade7d544620b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:51.971 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.965+0000 7f10edffb700 1 -- 172.21.15.8:0/1699761902 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10e000d600 con 0x7f10f006fc30 2023-10-18T20:50:51.971 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.965+0000 7f10edffb700 1 -- 172.21.15.8:0/1699761902 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f10e000dbd0 con 0x7f10f006fc30 2023-10-18T20:50:51.971 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.965+0000 7f10edffb700 1 -- 172.21.15.8:0/1699761902 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10e0011c00 con 0x7f10f006fc30 2023-10-18T20:50:51.971 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.966+0000 7f10effff700 1 -- 172.21.15.8:0/1699761902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 msgr2=0x7f10f00fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:51.971 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.966+0000 7f10effff700 1 --2- 172.21.15.8:0/1699761902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f00fe650 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f10e000b5f0 tx=0x7f10e0006ee0).stop 2023-10-18T20:50:51.972 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.966+0000 7f10effff700 1 -- 172.21.15.8:0/1699761902 shutdown_connections 2023-10-18T20:50:51.972 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.966+0000 7f10effff700 1 --2- 172.21.15.8:0/1699761902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f00fe650 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:51.972 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.966+0000 7f10effff700 1 -- 172.21.15.8:0/1699761902 >> 172.21.15.8:0/1699761902 conn(0x7f10f00f6130 msgr2=0x7f10f00f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:51.972 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.966+0000 7f10effff700 1 -- 172.21.15.8:0/1699761902 shutdown_connections 2023-10-18T20:50:51.972 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.966+0000 7f10effff700 1 -- 172.21.15.8:0/1699761902 wait complete. 2023-10-18T20:50:51.974 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.967+0000 7f10effff700 1 Processor -- start 2023-10-18T20:50:51.975 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.967+0000 7f10effff700 1 -- start start 2023-10-18T20:50:51.975 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.968+0000 7f10effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f010a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:51.975 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.968+0000 7f10effff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f010acd0 con 0x7f10f006fc30 2023-10-18T20:50:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.968+0000 7f10eeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f010a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.968+0000 7f10eeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f010a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39092/0 (socket says 172.21.15.8:39092) 2023-10-18T20:50:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.968+0000 7f10eeffd700 1 -- 172.21.15.8:0/2896389638 learned_addr learned my addr 172.21.15.8:0/2896389638 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.968+0000 7f10eeffd700 1 -- 172.21.15.8:0/2896389638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e000b200 con 0x7f10f006fc30 2023-10-18T20:50:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.968+0000 7f10eeffd700 1 --2- 172.21.15.8:0/2896389638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f010a7e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f10e000e040 tx=0x7f10e0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.969+0000 7f10d77fe700 1 -- 172.21.15.8:0/2896389638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10e000d9f0 con 0x7f10f006fc30 2023-10-18T20:50:51.977 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.969+0000 7f10d77fe700 1 -- 172.21.15.8:0/2896389638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f10e001a9f0 con 0x7f10f006fc30 2023-10-18T20:50:51.977 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.969+0000 7f10effff700 1 -- 172.21.15.8:0/2896389638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f010aed0 con 0x7f10f006fc30 2023-10-18T20:50:51.977 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.969+0000 7f10d77fe700 1 -- 172.21.15.8:0/2896389638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10e001b8c0 con 0x7f10f006fc30 2023-10-18T20:50:51.977 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.969+0000 7f10effff700 1 -- 172.21.15.8:0/2896389638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f010b2e0 con 0x7f10f006fc30 2023-10-18T20:50:51.977 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.970+0000 7f10d77fe700 1 -- 172.21.15.8:0/2896389638 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f10e000f070 con 0x7f10f006fc30 2023-10-18T20:50:51.978 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.970+0000 7f10effff700 1 -- 172.21.15.8:0/2896389638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f0045ad0 con 0x7f10f006fc30 2023-10-18T20:50:51.978 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.970+0000 7f10d77fe700 1 --2- 172.21.15.8:0/2896389638 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f10dc02fdb0 0x7f10dc032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:51.978 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.970+0000 7f10d77fe700 1 -- 172.21.15.8:0/2896389638 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f10e0041270 con 0x7f10f006fc30 2023-10-18T20:50:51.978 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.971+0000 7f10ee7fc700 1 --2- 172.21.15.8:0/2896389638 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f10dc02fdb0 0x7f10dc032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:51.978 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.971+0000 7f10ee7fc700 1 --2- 172.21.15.8:0/2896389638 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f10dc02fdb0 0x7f10dc032270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f10e40096a0 tx=0x7f10e4006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:51.979 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:51.975+0000 7f10d77fe700 1 -- 172.21.15.8:0/2896389638 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f10e0022310 con 0x7f10f006fc30 2023-10-18T20:50:52.175 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.172+0000 7f10effff700 1 -- 172.21.15.8:0/2896389638 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f10f010bc20 con 0x7f10dc02fdb0 2023-10-18T20:50:52.303 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.178+0000 7f10d77fe700 1 -- 172.21.15.8:0/2896389638 <== mgr.14116 v2:172.21.15.8:6800/1016712461 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f10f010bc20 con 0x7f10dc02fdb0 2023-10-18T20:50:52.303 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.180+0000 7f10effff700 1 -- 172.21.15.8:0/2896389638 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f10dc02fdb0 msgr2=0x7f10dc032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:52.303 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.180+0000 7f10effff700 1 --2- 172.21.15.8:0/2896389638 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f10dc02fdb0 0x7f10dc032270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f10e40096a0 tx=0x7f10e4006b40).stop 2023-10-18T20:50:52.304 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.180+0000 7f10effff700 1 -- 172.21.15.8:0/2896389638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 msgr2=0x7f10f010a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:52.304 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.180+0000 7f10effff700 1 --2- 172.21.15.8:0/2896389638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f010a7e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f10e000e040 tx=0x7f10e0006ee0).stop 2023-10-18T20:50:52.304 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.180+0000 7f10effff700 1 -- 172.21.15.8:0/2896389638 shutdown_connections 2023-10-18T20:50:52.304 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.180+0000 7f10effff700 1 --2- 172.21.15.8:0/2896389638 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f10dc02fdb0 0x7f10dc032270 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:52.304 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.180+0000 7f10effff700 1 --2- 172.21.15.8:0/2896389638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f006fc30 0x7f10f010a7e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:52.305 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.180+0000 7f10effff700 1 -- 172.21.15.8:0/2896389638 >> 172.21.15.8:0/2896389638 conn(0x7f10f00f6130 msgr2=0x7f10f00f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:52.305 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.180+0000 7f10effff700 1 -- 172.21.15.8:0/2896389638 shutdown_connections 2023-10-18T20:50:52.305 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.180+0000 7f10effff700 1 -- 172.21.15.8:0/2896389638 wait complete. 2023-10-18T20:50:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm set-user root 2023-10-18T20:50:52.933 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.930+0000 7ff2b672b700 1 Processor -- start 2023-10-18T20:50:52.934 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.930+0000 7ff2b672b700 1 -- start start 2023-10-18T20:50:52.934 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.930+0000 7ff2b672b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b00fc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:52.934 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.930+0000 7ff2b672b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b00fc930 con 0x7ff2b006fc30 2023-10-18T20:50:52.934 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.931+0000 7ff2b5729700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b00fc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:52.935 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.931+0000 7ff2b5729700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b00fc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39094/0 (socket says 172.21.15.8:39094) 2023-10-18T20:50:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.931+0000 7ff2b5729700 1 -- 172.21.15.8:0/2509571973 learned_addr learned my addr 172.21.15.8:0/2509571973 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.931+0000 7ff2b5729700 1 -- 172.21.15.8:0/2509571973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b00fca70 con 0x7ff2b006fc30 2023-10-18T20:50:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.931+0000 7ff2b5729700 1 --2- 172.21.15.8:0/2509571973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b00fc440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff2ac00b5f0 tx=0x7ff2ac006ee0).ready entity=mon.0 client_cookie=6cf12f2868db1333 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.932+0000 7ff29ffff700 1 -- 172.21.15.8:0/2509571973 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2ac00d600 con 0x7ff2b006fc30 2023-10-18T20:50:52.937 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.932+0000 7ff29ffff700 1 -- 172.21.15.8:0/2509571973 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7ff2ac00dbd0 con 0x7ff2b006fc30 2023-10-18T20:50:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.932+0000 7ff29ffff700 1 -- 172.21.15.8:0/2509571973 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2ac011c00 con 0x7ff2b006fc30 2023-10-18T20:50:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.932+0000 7ff2b672b700 1 -- 172.21.15.8:0/2509571973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 msgr2=0x7ff2b00fc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.932+0000 7ff2b672b700 1 --2- 172.21.15.8:0/2509571973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b00fc440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff2ac00b5f0 tx=0x7ff2ac006ee0).stop 2023-10-18T20:50:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.932+0000 7ff2b672b700 1 -- 172.21.15.8:0/2509571973 shutdown_connections 2023-10-18T20:50:52.938 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.932+0000 7ff2b672b700 1 --2- 172.21.15.8:0/2509571973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b00fc440 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:52.939 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.932+0000 7ff2b672b700 1 -- 172.21.15.8:0/2509571973 >> 172.21.15.8:0/2509571973 conn(0x7ff2b00f6130 msgr2=0x7ff2b00f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:52.939 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.933+0000 7ff2b672b700 1 -- 172.21.15.8:0/2509571973 shutdown_connections 2023-10-18T20:50:52.939 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.933+0000 7ff2b672b700 1 -- 172.21.15.8:0/2509571973 wait complete. 2023-10-18T20:50:52.939 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.933+0000 7ff2b672b700 1 Processor -- start 2023-10-18T20:50:52.939 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.934+0000 7ff2b672b700 1 -- start start 2023-10-18T20:50:52.940 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.934+0000 7ff2b672b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b0110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:52.940 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.934+0000 7ff2b672b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0111340 con 0x7ff2b006fc30 2023-10-18T20:50:52.942 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.934+0000 7ff2b5729700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b0110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:52.942 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.934+0000 7ff2b5729700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b0110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39102/0 (socket says 172.21.15.8:39102) 2023-10-18T20:50:52.942 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.934+0000 7ff2b5729700 1 -- 172.21.15.8:0/4216528876 learned_addr learned my addr 172.21.15.8:0/4216528876 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:52.942 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.934+0000 7ff2b5729700 1 -- 172.21.15.8:0/4216528876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac00b200 con 0x7ff2b006fc30 2023-10-18T20:50:52.942 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.935+0000 7ff2b5729700 1 --2- 172.21.15.8:0/4216528876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b0110e50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff2ac00e040 tx=0x7ff2ac006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.935+0000 7ff29dffb700 1 -- 172.21.15.8:0/4216528876 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2ac00d9f0 con 0x7ff2b006fc30 2023-10-18T20:50:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.935+0000 7ff29dffb700 1 -- 172.21.15.8:0/4216528876 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7ff2ac01a9f0 con 0x7ff2b006fc30 2023-10-18T20:50:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.935+0000 7ff2b672b700 1 -- 172.21.15.8:0/4216528876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b0111540 con 0x7ff2b006fc30 2023-10-18T20:50:52.944 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.935+0000 7ff29dffb700 1 -- 172.21.15.8:0/4216528876 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2ac01b8c0 con 0x7ff2b006fc30 2023-10-18T20:50:52.944 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.935+0000 7ff2b672b700 1 -- 172.21.15.8:0/4216528876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b0111950 con 0x7ff2b006fc30 2023-10-18T20:50:52.944 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.936+0000 7ff2b672b700 1 -- 172.21.15.8:0/4216528876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b0045ad0 con 0x7ff2b006fc30 2023-10-18T20:50:52.944 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.936+0000 7ff29dffb700 1 -- 172.21.15.8:0/4216528876 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7ff2ac00f070 con 0x7ff2b006fc30 2023-10-18T20:50:52.945 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.937+0000 7ff29dffb700 1 --2- 172.21.15.8:0/4216528876 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7ff29802fdb0 0x7ff298032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:52.945 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.937+0000 7ff29dffb700 1 -- 172.21.15.8:0/4216528876 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7ff2ac041290 con 0x7ff2b006fc30 2023-10-18T20:50:52.945 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.937+0000 7ff2b4f28700 1 --2- 172.21.15.8:0/4216528876 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7ff29802fdb0 0x7ff298032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:52.945 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.938+0000 7ff2b4f28700 1 --2- 172.21.15.8:0/4216528876 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7ff29802fdb0 0x7ff298032270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff2a00096a0 tx=0x7ff2a0006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:52.946 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:52.941+0000 7ff29dffb700 1 -- 172.21.15.8:0/4216528876 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff2ac006a70 con 0x7ff2b006fc30 2023-10-18T20:50:53.116 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.113+0000 7ff2b672b700 1 -- 172.21.15.8:0/4216528876 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2b0112b70 con 0x7ff29802fdb0 2023-10-18T20:50:53.116 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.113+0000 7ff29dffb700 1 -- 172.21.15.8:0/4216528876 <== mgr.14116 v2:172.21.15.8:6800/1016712461 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7ff2b0112b70 con 0x7ff29802fdb0 2023-10-18T20:50:53.116 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: value unchanged 2023-10-18T20:50:53.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.115+0000 7ff2b672b700 1 -- 172.21.15.8:0/4216528876 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7ff29802fdb0 msgr2=0x7ff298032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:53.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.115+0000 7ff2b672b700 1 --2- 172.21.15.8:0/4216528876 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7ff29802fdb0 0x7ff298032270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff2a00096a0 tx=0x7ff2a0006b40).stop 2023-10-18T20:50:53.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.115+0000 7ff2b672b700 1 -- 172.21.15.8:0/4216528876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 msgr2=0x7ff2b0110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:53.119 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.115+0000 7ff2b672b700 1 --2- 172.21.15.8:0/4216528876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b0110e50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff2ac00e040 tx=0x7ff2ac006ee0).stop 2023-10-18T20:50:53.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.115+0000 7ff2b672b700 1 -- 172.21.15.8:0/4216528876 shutdown_connections 2023-10-18T20:50:53.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.115+0000 7ff2b672b700 1 --2- 172.21.15.8:0/4216528876 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7ff29802fdb0 0x7ff298032270 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:53.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.115+0000 7ff2b672b700 1 --2- 172.21.15.8:0/4216528876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2b006fc30 0x7ff2b0110e50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:53.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.115+0000 7ff2b672b700 1 -- 172.21.15.8:0/4216528876 >> 172.21.15.8:0/4216528876 conn(0x7ff2b00f6130 msgr2=0x7ff2b00f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:53.120 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.115+0000 7ff2b672b700 1 -- 172.21.15.8:0/4216528876 shutdown_connections 2023-10-18T20:50:53.121 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.115+0000 7ff2b672b700 1 -- 172.21.15.8:0/4216528876 wait complete. 2023-10-18T20:50:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:52.174532+0000 mgr.smithi008.flmjzp (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:50:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:52.179161+0000 mon.smithi008 (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:52.183323+0000 mon.smithi008 (mon.0) 52 : audit [DBG] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:50:53.451 INFO:teuthology.orchestra.run.smithi008.stderr:Generating ssh key... 2023-10-18T20:50:53.451 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm generate-key 2023-10-18T20:50:53.849 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.845+0000 7f6371ad2700 1 Processor -- start 2023-10-18T20:50:53.849 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.845+0000 7f6371ad2700 1 -- start start 2023-10-18T20:50:53.849 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.846+0000 7f6371ad2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c0fad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:53.850 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.846+0000 7f6371ad2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0fb200 con 0x7f636c0fa8f0 2023-10-18T20:50:53.851 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.846+0000 7f6370ad0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c0fad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:53.852 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.846+0000 7f6370ad0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c0fad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39116/0 (socket says 172.21.15.8:39116) 2023-10-18T20:50:53.852 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.846+0000 7f6370ad0700 1 -- 172.21.15.8:0/1562600266 learned_addr learned my addr 172.21.15.8:0/1562600266 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:53.852 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.847+0000 7f6370ad0700 1 -- 172.21.15.8:0/1562600266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c0fb340 con 0x7f636c0fa8f0 2023-10-18T20:50:53.852 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.847+0000 7f6370ad0700 1 --2- 172.21.15.8:0/1562600266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c0fad10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f636000b5f0 tx=0x7f6360006ee0).ready entity=mon.0 client_cookie=afa172c9e26b4dbc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:53.852 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.847+0000 7f636b7fe700 1 -- 172.21.15.8:0/1562600266 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f636000d600 con 0x7f636c0fa8f0 2023-10-18T20:50:53.853 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.847+0000 7f636b7fe700 1 -- 172.21.15.8:0/1562600266 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f636000dbd0 con 0x7f636c0fa8f0 2023-10-18T20:50:53.853 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.847+0000 7f636b7fe700 1 -- 172.21.15.8:0/1562600266 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6360011c00 con 0x7f636c0fa8f0 2023-10-18T20:50:53.853 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.848+0000 7f6371ad2700 1 -- 172.21.15.8:0/1562600266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 msgr2=0x7f636c0fad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:53.853 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.848+0000 7f6371ad2700 1 --2- 172.21.15.8:0/1562600266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c0fad10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f636000b5f0 tx=0x7f6360006ee0).stop 2023-10-18T20:50:53.853 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.848+0000 7f6371ad2700 1 -- 172.21.15.8:0/1562600266 shutdown_connections 2023-10-18T20:50:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.848+0000 7f6371ad2700 1 --2- 172.21.15.8:0/1562600266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c0fad10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.848+0000 7f6371ad2700 1 -- 172.21.15.8:0/1562600266 >> 172.21.15.8:0/1562600266 conn(0x7f636c0f6130 msgr2=0x7f636c0f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.848+0000 7f6371ad2700 1 -- 172.21.15.8:0/1562600266 shutdown_connections 2023-10-18T20:50:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.848+0000 7f6371ad2700 1 -- 172.21.15.8:0/1562600266 wait complete. 2023-10-18T20:50:53.855 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.849+0000 7f6371ad2700 1 Processor -- start 2023-10-18T20:50:53.857 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.849+0000 7f6371ad2700 1 -- start start 2023-10-18T20:50:53.857 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.850+0000 7f6371ad2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c100b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:53.857 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.850+0000 7f6371ad2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0fef80 con 0x7f636c0fa8f0 2023-10-18T20:50:53.857 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.850+0000 7f6370ad0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:53.857 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.850+0000 7f6370ad0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c100b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39128/0 (socket says 172.21.15.8:39128) 2023-10-18T20:50:53.858 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.850+0000 7f6370ad0700 1 -- 172.21.15.8:0/4169906405 learned_addr learned my addr 172.21.15.8:0/4169906405 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:53.858 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.850+0000 7f6370ad0700 1 -- 172.21.15.8:0/4169906405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636000b200 con 0x7f636c0fa8f0 2023-10-18T20:50:53.858 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.851+0000 7f6370ad0700 1 --2- 172.21.15.8:0/4169906405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c100b00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f636000b1d0 tx=0x7f6360006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:53.858 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.851+0000 7f63697fa700 1 -- 172.21.15.8:0/4169906405 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f636001b410 con 0x7f636c0fa8f0 2023-10-18T20:50:53.858 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.851+0000 7f63697fa700 1 -- 172.21.15.8:0/4169906405 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f636001b9e0 con 0x7f636c0fa8f0 2023-10-18T20:50:53.859 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.851+0000 7f6371ad2700 1 -- 172.21.15.8:0/4169906405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c0ff120 con 0x7f636c0fa8f0 2023-10-18T20:50:53.859 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.851+0000 7f63697fa700 1 -- 172.21.15.8:0/4169906405 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f636001a840 con 0x7f636c0fa8f0 2023-10-18T20:50:53.859 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.851+0000 7f6371ad2700 1 -- 172.21.15.8:0/4169906405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c0ff530 con 0x7f636c0fa8f0 2023-10-18T20:50:53.859 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.852+0000 7f63697fa700 1 -- 172.21.15.8:0/4169906405 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f636000f070 con 0x7f636c0fa8f0 2023-10-18T20:50:53.859 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.852+0000 7f6371ad2700 1 -- 172.21.15.8:0/4169906405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c045ad0 con 0x7f636c0fa8f0 2023-10-18T20:50:53.860 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.852+0000 7f63697fa700 1 --2- 172.21.15.8:0/4169906405 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f635002fd50 0x7f6350032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:53.860 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.853+0000 7f63697fa700 1 -- 172.21.15.8:0/4169906405 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f6360041310 con 0x7f636c0fa8f0 2023-10-18T20:50:53.860 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.853+0000 7f636bfff700 1 --2- 172.21.15.8:0/4169906405 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f635002fd50 0x7f6350032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:53.860 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.853+0000 7f636bfff700 1 --2- 172.21.15.8:0/4169906405 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f635002fd50 0x7f6350032210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f63580096a0 tx=0x7f6358006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:53.861 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:53.858+0000 7f63697fa700 1 -- 172.21.15.8:0/4169906405 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6360019ab0 con 0x7f636c0fa8f0 2023-10-18T20:50:54.029 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.026+0000 7f6371ad2700 1 -- 172.21.15.8:0/4169906405 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f636c0ff770 con 0x7f635002fd50 2023-10-18T20:50:54.610 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:53.114884+0000 mgr.smithi008.flmjzp (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:50:54.617 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.614+0000 7f63697fa700 1 -- 172.21.15.8:0/4169906405 <== mgr.14116 v2:172.21.15.8:6800/1016712461 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f636c0ff770 con 0x7f635002fd50 2023-10-18T20:50:54.620 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.616+0000 7f6371ad2700 1 -- 172.21.15.8:0/4169906405 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f635002fd50 msgr2=0x7f6350032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:54.620 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.616+0000 7f6371ad2700 1 --2- 172.21.15.8:0/4169906405 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f635002fd50 0x7f6350032210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f63580096a0 tx=0x7f6358006b40).stop 2023-10-18T20:50:54.620 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.616+0000 7f6371ad2700 1 -- 172.21.15.8:0/4169906405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 msgr2=0x7f636c100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:54.620 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.616+0000 7f6371ad2700 1 --2- 172.21.15.8:0/4169906405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c100b00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f636000b1d0 tx=0x7f6360006ee0).stop 2023-10-18T20:50:54.621 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.617+0000 7f6371ad2700 1 -- 172.21.15.8:0/4169906405 shutdown_connections 2023-10-18T20:50:54.621 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.617+0000 7f6371ad2700 1 --2- 172.21.15.8:0/4169906405 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f635002fd50 0x7f6350032210 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:54.621 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.617+0000 7f6371ad2700 1 --2- 172.21.15.8:0/4169906405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c0fa8f0 0x7f636c100b00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:54.621 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.617+0000 7f6371ad2700 1 -- 172.21.15.8:0/4169906405 >> 172.21.15.8:0/4169906405 conn(0x7f636c0f6130 msgr2=0x7f636c0f6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:54.622 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.617+0000 7f6371ad2700 1 -- 172.21.15.8:0/4169906405 shutdown_connections 2023-10-18T20:50:54.622 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:54.617+0000 7f6371ad2700 1 -- 172.21.15.8:0/4169906405 wait complete. 2023-10-18T20:50:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm get-pub-key 2023-10-18T20:50:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.379+0000 7f0c6a6d6700 1 Processor -- start 2023-10-18T20:50:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.380+0000 7f0c6a6d6700 1 -- start start 2023-10-18T20:50:55.385 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.380+0000 7f0c6a6d6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c64100a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:55.385 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.380+0000 7f0c6a6d6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c640fc440 con 0x7f0c6406fc30 2023-10-18T20:50:55.386 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.380+0000 7f0c696d4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c64100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:55.386 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.380+0000 7f0c696d4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c64100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39140/0 (socket says 172.21.15.8:39140) 2023-10-18T20:50:55.386 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.380+0000 7f0c696d4700 1 -- 172.21.15.8:0/3425650780 learned_addr learned my addr 172.21.15.8:0/3425650780 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:55.386 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.381+0000 7f0c696d4700 1 -- 172.21.15.8:0/3425650780 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c64100f40 con 0x7f0c6406fc30 2023-10-18T20:50:55.386 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.381+0000 7f0c696d4700 1 --2- 172.21.15.8:0/3425650780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c64100a50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0c6000b5f0 tx=0x7f0c60006ee0).ready entity=mon.0 client_cookie=b12398a26b68095d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.381+0000 7f0c53fff700 1 -- 172.21.15.8:0/3425650780 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c6000d600 con 0x7f0c6406fc30 2023-10-18T20:50:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.381+0000 7f0c53fff700 1 -- 172.21.15.8:0/3425650780 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f0c6000dbd0 con 0x7f0c6406fc30 2023-10-18T20:50:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.381+0000 7f0c53fff700 1 -- 172.21.15.8:0/3425650780 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c60011c00 con 0x7f0c6406fc30 2023-10-18T20:50:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.382+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/3425650780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 msgr2=0x7f0c64100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.382+0000 7f0c6a6d6700 1 --2- 172.21.15.8:0/3425650780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c64100a50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0c6000b5f0 tx=0x7f0c60006ee0).stop 2023-10-18T20:50:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.382+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/3425650780 shutdown_connections 2023-10-18T20:50:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.382+0000 7f0c6a6d6700 1 --2- 172.21.15.8:0/3425650780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c64100a50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.382+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/3425650780 >> 172.21.15.8:0/3425650780 conn(0x7f0c640f6130 msgr2=0x7f0c640f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.382+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/3425650780 shutdown_connections 2023-10-18T20:50:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.382+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/3425650780 wait complete. 2023-10-18T20:50:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.383+0000 7f0c6a6d6700 1 Processor -- start 2023-10-18T20:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.383+0000 7f0c6a6d6700 1 -- start start 2023-10-18T20:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.383+0000 7f0c6a6d6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c6410c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.383+0000 7f0c6a6d6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6410ce80 con 0x7f0c6406fc30 2023-10-18T20:50:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.384+0000 7f0c696d4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c6410c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.384+0000 7f0c696d4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c6410c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39150/0 (socket says 172.21.15.8:39150) 2023-10-18T20:50:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.384+0000 7f0c696d4700 1 -- 172.21.15.8:0/2180741848 learned_addr learned my addr 172.21.15.8:0/2180741848 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.384+0000 7f0c696d4700 1 -- 172.21.15.8:0/2180741848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6000b200 con 0x7f0c6406fc30 2023-10-18T20:50:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.384+0000 7f0c696d4700 1 --2- 172.21.15.8:0/2180741848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c6410c990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f0c6000b190 tx=0x7f0c60006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.384+0000 7f0c51ffb700 1 -- 172.21.15.8:0/2180741848 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c6001b410 con 0x7f0c6406fc30 2023-10-18T20:50:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.384+0000 7f0c51ffb700 1 -- 172.21.15.8:0/2180741848 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f0c6001b9e0 con 0x7f0c6406fc30 2023-10-18T20:50:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.384+0000 7f0c51ffb700 1 -- 172.21.15.8:0/2180741848 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c6001a880 con 0x7f0c6406fc30 2023-10-18T20:50:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.385+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/2180741848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6410d080 con 0x7f0c6406fc30 2023-10-18T20:50:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.385+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/2180741848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6410d490 con 0x7f0c6406fc30 2023-10-18T20:50:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.386+0000 7f0c51ffb700 1 -- 172.21.15.8:0/2180741848 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f0c6000f070 con 0x7f0c6406fc30 2023-10-18T20:50:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.386+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/2180741848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c64045ad0 con 0x7f0c6406fc30 2023-10-18T20:50:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.386+0000 7f0c51ffb700 1 --2- 172.21.15.8:0/2180741848 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f0c4c02fdb0 0x7f0c4c032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.386+0000 7f0c51ffb700 1 -- 172.21.15.8:0/2180741848 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f0c60041230 con 0x7f0c6406fc30 2023-10-18T20:50:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.386+0000 7f0c68ed3700 1 --2- 172.21.15.8:0/2180741848 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f0c4c02fdb0 0x7f0c4c032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:55.395 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.387+0000 7f0c68ed3700 1 --2- 172.21.15.8:0/2180741848 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f0c4c02fdb0 0x7f0c4c032270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f0c540096a0 tx=0x7f0c54006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:55.395 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.391+0000 7f0c51ffb700 1 -- 172.21.15.8:0/2180741848 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0c60019950 con 0x7f0c6406fc30 2023-10-18T20:50:55.562 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.559+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/2180741848 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c6410dd70 con 0x7f0c4c02fdb0 2023-10-18T20:50:55.563 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.560+0000 7f0c51ffb700 1 -- 172.21.15.8:0/2180741848 <== mgr.14116 v2:172.21.15.8:6800/1016712461 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f0c6410dd70 con 0x7f0c4c02fdb0 2023-10-18T20:50:55.563 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgW0En+s+P7vkwBXIW29YusFRYJV0kaY+QbKLPQpcYPSkGPntNUsrMJLe7aRXCCwZlOcGrAxfp1ryLepSsSdx6hjJglen+kk3FczbtT9PX6jyGjGkIvdJLFo/NdtQ4I5QMjzb5c2lfVggkgaJIFrTYrS+O2zjUDk4/CB3avpNwiCbCdy7pBbO+pyHWdMZHRZ9c9ya0jurVdWM7NDovv5lIzTJXEXi173j3XAfYUiRnoDflYyktxnacmXdwUB68jqhmTWnKpIsbbNVrGa64syMBPup4AufB6Cm+VdHuySHtYpgWBeGpzcuNy/ccTNhNzAP2NJb1g7gxXyLejLDs9vQ9AzTTR9H5WNmG3gyG7+wumgqsKaxEQCLP0/1g+PunFwv9QwOnxOtu6CYvQOeTYwfiO0Xw8xvgw7v4Z3794LewlaXc5x4/hpsL1Y478wqwYP3p0qnJ4eJYBoneu0qD+LUGE3dNzn35BfYrvbXdQwSjxU1kUMMpdjgjmhCKmRjq9zU= ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:50:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.561+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/2180741848 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f0c4c02fdb0 msgr2=0x7f0c4c032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.561+0000 7f0c6a6d6700 1 --2- 172.21.15.8:0/2180741848 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f0c4c02fdb0 0x7f0c4c032270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f0c540096a0 tx=0x7f0c54006b40).stop 2023-10-18T20:50:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.561+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/2180741848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 msgr2=0x7f0c6410c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.561+0000 7f0c6a6d6700 1 --2- 172.21.15.8:0/2180741848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c6410c990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f0c6000b190 tx=0x7f0c60006ee0).stop 2023-10-18T20:50:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.561+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/2180741848 shutdown_connections 2023-10-18T20:50:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.562+0000 7f0c6a6d6700 1 --2- 172.21.15.8:0/2180741848 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f0c4c02fdb0 0x7f0c4c032270 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.562+0000 7f0c6a6d6700 1 --2- 172.21.15.8:0/2180741848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6406fc30 0x7f0c6410c990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.562+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/2180741848 >> 172.21.15.8:0/2180741848 conn(0x7f0c640f6130 msgr2=0x7f0c640f7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:55.567 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.562+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/2180741848 shutdown_connections 2023-10-18T20:50:55.567 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:55.562+0000 7f0c6a6d6700 1 -- 172.21.15.8:0/2180741848 wait complete. 2023-10-18T20:50:55.585 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:50:54.028788+0000 mgr.smithi008.flmjzp (mgr.14116) 6 : cephadm [INF] Generating ssh key... 2023-10-18T20:50:55.585 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:54.612770+0000 mon.smithi008 (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:55.585 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:54.614689+0000 mon.smithi008 (mon.0) 54 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:55.897 INFO:teuthology.orchestra.run.smithi008.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-18T20:50:55.897 INFO:teuthology.orchestra.run.smithi008.stderr:Adding key to root@localhost authorized_keys... 2023-10-18T20:50:55.898 INFO:teuthology.orchestra.run.smithi008.stderr:Adding host smithi008... 2023-10-18T20:50:55.898 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch host add smithi008 172.21.15.8 2023-10-18T20:50:56.325 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.315+0000 7fc88e2e2700 1 Processor -- start 2023-10-18T20:50:56.326 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.315+0000 7fc88e2e2700 1 -- start start 2023-10-18T20:50:56.326 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.315+0000 7fc88e2e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc8880fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:56.327 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.315+0000 7fc88e2e2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880feb40 con 0x7fc88806fc30 2023-10-18T20:50:56.327 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.316+0000 7fc88d2e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc8880fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:56.328 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.316+0000 7fc88d2e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc8880fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39160/0 (socket says 172.21.15.8:39160) 2023-10-18T20:50:56.328 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.316+0000 7fc88d2e0700 1 -- 172.21.15.8:0/776178155 learned_addr learned my addr 172.21.15.8:0/776178155 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:56.328 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.316+0000 7fc88d2e0700 1 -- 172.21.15.8:0/776178155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880fec80 con 0x7fc88806fc30 2023-10-18T20:50:56.329 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.316+0000 7fc88d2e0700 1 --2- 172.21.15.8:0/776178155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc8880fe650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc88400b5f0 tx=0x7fc884006ee0).ready entity=mon.0 client_cookie=b5a55a121ee606b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:56.329 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.317+0000 7fc877fff700 1 -- 172.21.15.8:0/776178155 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc88400d600 con 0x7fc88806fc30 2023-10-18T20:50:56.329 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.317+0000 7fc877fff700 1 -- 172.21.15.8:0/776178155 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fc88400dbd0 con 0x7fc88806fc30 2023-10-18T20:50:56.330 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.317+0000 7fc877fff700 1 -- 172.21.15.8:0/776178155 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc884011c00 con 0x7fc88806fc30 2023-10-18T20:50:56.330 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.317+0000 7fc88e2e2700 1 -- 172.21.15.8:0/776178155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 msgr2=0x7fc8880fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:56.330 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.317+0000 7fc88e2e2700 1 --2- 172.21.15.8:0/776178155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc8880fe650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc88400b5f0 tx=0x7fc884006ee0).stop 2023-10-18T20:50:56.331 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.318+0000 7fc88e2e2700 1 -- 172.21.15.8:0/776178155 shutdown_connections 2023-10-18T20:50:56.331 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.318+0000 7fc88e2e2700 1 --2- 172.21.15.8:0/776178155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc8880fe650 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:56.332 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.318+0000 7fc88e2e2700 1 -- 172.21.15.8:0/776178155 >> 172.21.15.8:0/776178155 conn(0x7fc8880f6130 msgr2=0x7fc8880f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:56.332 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.318+0000 7fc88e2e2700 1 -- 172.21.15.8:0/776178155 shutdown_connections 2023-10-18T20:50:56.332 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.318+0000 7fc88e2e2700 1 -- 172.21.15.8:0/776178155 wait complete. 2023-10-18T20:50:56.333 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.319+0000 7fc88e2e2700 1 Processor -- start 2023-10-18T20:50:56.333 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.319+0000 7fc88e2e2700 1 -- start start 2023-10-18T20:50:56.333 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.320+0000 7fc88e2e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc88810a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:56.334 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.320+0000 7fc88e2e2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88810ac50 con 0x7fc88806fc30 2023-10-18T20:50:56.334 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.320+0000 7fc88d2e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc88810a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:56.334 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.320+0000 7fc88d2e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc88810a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39172/0 (socket says 172.21.15.8:39172) 2023-10-18T20:50:56.335 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.320+0000 7fc88d2e0700 1 -- 172.21.15.8:0/3484733472 learned_addr learned my addr 172.21.15.8:0/3484733472 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:56.335 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.320+0000 7fc88d2e0700 1 -- 172.21.15.8:0/3484733472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88400b200 con 0x7fc88806fc30 2023-10-18T20:50:56.336 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.320+0000 7fc88d2e0700 1 --2- 172.21.15.8:0/3484733472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc88810a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc88400b190 tx=0x7fc884006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:56.336 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.321+0000 7fc875ffb700 1 -- 172.21.15.8:0/3484733472 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc88401b410 con 0x7fc88806fc30 2023-10-18T20:50:56.336 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.321+0000 7fc88e2e2700 1 -- 172.21.15.8:0/3484733472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88810ae50 con 0x7fc88806fc30 2023-10-18T20:50:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.321+0000 7fc875ffb700 1 -- 172.21.15.8:0/3484733472 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fc88401b9e0 con 0x7fc88806fc30 2023-10-18T20:50:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.321+0000 7fc875ffb700 1 -- 172.21.15.8:0/3484733472 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc88401a880 con 0x7fc88806fc30 2023-10-18T20:50:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.321+0000 7fc88e2e2700 1 -- 172.21.15.8:0/3484733472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88810b260 con 0x7fc88806fc30 2023-10-18T20:50:56.338 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.322+0000 7fc875ffb700 1 -- 172.21.15.8:0/3484733472 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fc88400f070 con 0x7fc88806fc30 2023-10-18T20:50:56.338 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.322+0000 7fc88e2e2700 1 -- 172.21.15.8:0/3484733472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc888045ad0 con 0x7fc88806fc30 2023-10-18T20:50:56.339 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.322+0000 7fc875ffb700 1 --2- 172.21.15.8:0/3484733472 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fc87002fdb0 0x7fc870032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:56.339 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.322+0000 7fc875ffb700 1 -- 172.21.15.8:0/3484733472 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fc884041280 con 0x7fc88806fc30 2023-10-18T20:50:56.339 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.323+0000 7fc88cadf700 1 --2- 172.21.15.8:0/3484733472 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fc87002fdb0 0x7fc870032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:56.340 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.323+0000 7fc88cadf700 1 --2- 172.21.15.8:0/3484733472 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fc87002fdb0 0x7fc870032270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc8780096a0 tx=0x7fc878006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:56.341 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.327+0000 7fc875ffb700 1 -- 172.21.15.8:0/3484733472 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc884019950 con 0x7fc88806fc30 2023-10-18T20:50:56.525 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:56.522+0000 7fc88e2e2700 1 -- 172.21.15.8:0/3484733472 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}) v1 -- 0x7fc88810bba0 con 0x7fc87002fdb0 2023-10-18T20:50:56.716 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:55.561254+0000 mgr.smithi008.flmjzp (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:50:57.435 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: Added host 'smithi008' 2023-10-18T20:50:57.435 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.431+0000 7fc875ffb700 1 -- 172.21.15.8:0/3484733472 <== mgr.14116 v2:172.21.15.8:6800/1016712461 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7fc88810bba0 con 0x7fc87002fdb0 2023-10-18T20:50:57.437 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.434+0000 7fc88e2e2700 1 -- 172.21.15.8:0/3484733472 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fc87002fdb0 msgr2=0x7fc870032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:57.437 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.434+0000 7fc88e2e2700 1 --2- 172.21.15.8:0/3484733472 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fc87002fdb0 0x7fc870032270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc8780096a0 tx=0x7fc878006b40).stop 2023-10-18T20:50:57.437 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.434+0000 7fc88e2e2700 1 -- 172.21.15.8:0/3484733472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 msgr2=0x7fc88810a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:57.438 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.434+0000 7fc88e2e2700 1 --2- 172.21.15.8:0/3484733472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc88810a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc88400b190 tx=0x7fc884006ee0).stop 2023-10-18T20:50:57.438 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.434+0000 7fc88e2e2700 1 -- 172.21.15.8:0/3484733472 shutdown_connections 2023-10-18T20:50:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.434+0000 7fc88e2e2700 1 --2- 172.21.15.8:0/3484733472 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fc87002fdb0 0x7fc870032270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.434+0000 7fc88e2e2700 1 --2- 172.21.15.8:0/3484733472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc88806fc30 0x7fc88810a760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.434+0000 7fc88e2e2700 1 -- 172.21.15.8:0/3484733472 >> 172.21.15.8:0/3484733472 conn(0x7fc8880f6130 msgr2=0x7fc8880f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.434+0000 7fc88e2e2700 1 -- 172.21.15.8:0/3484733472 shutdown_connections 2023-10-18T20:50:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:57.434+0000 7fc88e2e2700 1 -- 172.21.15.8:0/3484733472 wait complete. 2023-10-18T20:50:57.793 INFO:teuthology.orchestra.run.smithi008.stderr:Deploying mon service with default placement... 2023-10-18T20:50:57.794 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mon 2023-10-18T20:50:57.799 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:56.524226+0000 mgr.smithi008.flmjzp (mgr.14116) 8 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:50:57.800 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:57.432266+0000 mon.smithi008 (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:57.800 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:57.433012+0000 mon.smithi008 (mon.0) 56 : audit [DBG] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:50:58.187 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.182+0000 7f76da782700 1 Processor -- start 2023-10-18T20:50:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.183+0000 7f76da782700 1 -- start start 2023-10-18T20:50:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.183+0000 7f76da782700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.183+0000 7f76da782700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40feb40 con 0x7f76d406fc30 2023-10-18T20:50:58.190 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.183+0000 7f76d9780700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:58.193 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.183+0000 7f76d9780700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42770/0 (socket says 172.21.15.8:42770) 2023-10-18T20:50:58.193 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.183+0000 7f76d9780700 1 -- 172.21.15.8:0/2305936675 learned_addr learned my addr 172.21.15.8:0/2305936675 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:58.193 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.184+0000 7f76d9780700 1 -- 172.21.15.8:0/2305936675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d40fec80 con 0x7f76d406fc30 2023-10-18T20:50:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.184+0000 7f76d9780700 1 --2- 172.21.15.8:0/2305936675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fe650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f76d000b5f0 tx=0x7f76d0006ee0).ready entity=mon.0 client_cookie=457058c98fea1492 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.184+0000 7f76c3fff700 1 -- 172.21.15.8:0/2305936675 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76d000d600 con 0x7f76d406fc30 2023-10-18T20:50:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.184+0000 7f76c3fff700 1 -- 172.21.15.8:0/2305936675 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f76d000dbd0 con 0x7f76d406fc30 2023-10-18T20:50:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.184+0000 7f76c3fff700 1 -- 172.21.15.8:0/2305936675 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76d0011c00 con 0x7f76d406fc30 2023-10-18T20:50:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.185+0000 7f76da782700 1 -- 172.21.15.8:0/2305936675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 msgr2=0x7f76d40fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.185+0000 7f76da782700 1 --2- 172.21.15.8:0/2305936675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fe650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f76d000b5f0 tx=0x7f76d0006ee0).stop 2023-10-18T20:50:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.185+0000 7f76da782700 1 -- 172.21.15.8:0/2305936675 shutdown_connections 2023-10-18T20:50:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.185+0000 7f76da782700 1 --2- 172.21.15.8:0/2305936675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fe650 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:58.195 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.185+0000 7f76da782700 1 -- 172.21.15.8:0/2305936675 >> 172.21.15.8:0/2305936675 conn(0x7f76d40f6130 msgr2=0x7f76d40f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.185+0000 7f76da782700 1 -- 172.21.15.8:0/2305936675 shutdown_connections 2023-10-18T20:50:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.185+0000 7f76da782700 1 -- 172.21.15.8:0/2305936675 wait complete. 2023-10-18T20:50:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.186+0000 7f76da782700 1 Processor -- start 2023-10-18T20:50:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.187+0000 7f76da782700 1 -- start start 2023-10-18T20:50:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.187+0000 7f76da782700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:58.196 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.187+0000 7f76da782700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40fa550 con 0x7f76d406fc30 2023-10-18T20:50:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.187+0000 7f76d9780700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.187+0000 7f76d9780700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42776/0 (socket says 172.21.15.8:42776) 2023-10-18T20:50:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.187+0000 7f76d9780700 1 -- 172.21.15.8:0/4167490075 learned_addr learned my addr 172.21.15.8:0/4167490075 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.188+0000 7f76d9780700 1 -- 172.21.15.8:0/4167490075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d000b200 con 0x7f76d406fc30 2023-10-18T20:50:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.188+0000 7f76d9780700 1 --2- 172.21.15.8:0/4167490075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fc0d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f76d000e040 tx=0x7f76d0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.188+0000 7f76c1ffb700 1 -- 172.21.15.8:0/4167490075 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76d000d9f0 con 0x7f76d406fc30 2023-10-18T20:50:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.188+0000 7f76c1ffb700 1 -- 172.21.15.8:0/4167490075 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f76d001a9f0 con 0x7f76d406fc30 2023-10-18T20:50:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.188+0000 7f76c1ffb700 1 -- 172.21.15.8:0/4167490075 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76d001b8c0 con 0x7f76d406fc30 2023-10-18T20:50:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.188+0000 7f76da782700 1 -- 172.21.15.8:0/4167490075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d40fa6f0 con 0x7f76d406fc30 2023-10-18T20:50:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.188+0000 7f76da782700 1 -- 172.21.15.8:0/4167490075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d40fab00 con 0x7f76d406fc30 2023-10-18T20:50:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.189+0000 7f76da782700 1 -- 172.21.15.8:0/4167490075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d4045ad0 con 0x7f76d406fc30 2023-10-18T20:50:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.189+0000 7f76c1ffb700 1 -- 172.21.15.8:0/4167490075 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f76d000f070 con 0x7f76d406fc30 2023-10-18T20:50:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.190+0000 7f76c1ffb700 1 --2- 172.21.15.8:0/4167490075 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f76bc02fdb0 0x7f76bc032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.190+0000 7f76c1ffb700 1 -- 172.21.15.8:0/4167490075 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f76d0041380 con 0x7f76d406fc30 2023-10-18T20:50:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.190+0000 7f76d8f7f700 1 --2- 172.21.15.8:0/4167490075 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f76bc02fdb0 0x7f76bc032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.191+0000 7f76d8f7f700 1 --2- 172.21.15.8:0/4167490075 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f76bc02fdb0 0x7f76bc032270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f76c40096a0 tx=0x7f76c4006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.194+0000 7f76c1ffb700 1 -- 172.21.15.8:0/4167490075 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f76d0019d20 con 0x7f76d406fc30 2023-10-18T20:50:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.389+0000 7f76da782700 1 -- 172.21.15.8:0/4167490075 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f76d40fad40 con 0x7f76bc02fdb0 2023-10-18T20:50:58.396 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.394+0000 7f76c1ffb700 1 -- 172.21.15.8:0/4167490075 <== mgr.14116 v2:172.21.15.8:6800/1016712461 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f76d40fad40 con 0x7f76bc02fdb0 2023-10-18T20:50:58.397 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: Scheduled mon update... 2023-10-18T20:50:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.396+0000 7f76da782700 1 -- 172.21.15.8:0/4167490075 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f76bc02fdb0 msgr2=0x7f76bc032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.396+0000 7f76da782700 1 --2- 172.21.15.8:0/4167490075 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f76bc02fdb0 0x7f76bc032270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f76c40096a0 tx=0x7f76c4006b40).stop 2023-10-18T20:50:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.396+0000 7f76da782700 1 -- 172.21.15.8:0/4167490075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 msgr2=0x7f76d40fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.396+0000 7f76da782700 1 --2- 172.21.15.8:0/4167490075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fc0d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f76d000e040 tx=0x7f76d0006ee0).stop 2023-10-18T20:50:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.396+0000 7f76da782700 1 -- 172.21.15.8:0/4167490075 shutdown_connections 2023-10-18T20:50:58.400 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.396+0000 7f76da782700 1 --2- 172.21.15.8:0/4167490075 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f76bc02fdb0 0x7f76bc032270 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.396+0000 7f76da782700 1 --2- 172.21.15.8:0/4167490075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d406fc30 0x7f76d40fc0d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.396+0000 7f76da782700 1 -- 172.21.15.8:0/4167490075 >> 172.21.15.8:0/4167490075 conn(0x7f76d40f6130 msgr2=0x7f76d40f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.396+0000 7f76da782700 1 -- 172.21.15.8:0/4167490075 shutdown_connections 2023-10-18T20:50:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:58.396+0000 7f76da782700 1 -- 172.21.15.8:0/4167490075 wait complete. 2023-10-18T20:50:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:Deploying mgr service with default placement... 2023-10-18T20:50:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mgr 2023-10-18T20:50:59.132 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.121+0000 7f08c3f63700 1 Processor -- start 2023-10-18T20:50:59.132 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.121+0000 7f08c3f63700 1 -- start start 2023-10-18T20:50:59.133 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.121+0000 7f08c3f63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc100ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:59.133 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.121+0000 7f08c3f63700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0fc620 con 0x7f08bc06fcd0 2023-10-18T20:50:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.122+0000 7f08c1cff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc100ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.122+0000 7f08c1cff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc100ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42790/0 (socket says 172.21.15.8:42790) 2023-10-18T20:50:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.122+0000 7f08c1cff700 1 -- 172.21.15.8:0/1606663904 learned_addr learned my addr 172.21.15.8:0/1606663904 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:59.135 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.122+0000 7f08c1cff700 1 -- 172.21.15.8:0/1606663904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc101090 con 0x7f08bc06fcd0 2023-10-18T20:50:59.135 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.122+0000 7f08c1cff700 1 --2- 172.21.15.8:0/1606663904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc100ba0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f08b800b5f0 tx=0x7f08b8006ee0).ready entity=mon.0 client_cookie=2adb72b1af20ab11 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:59.136 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.123+0000 7f08c0cfd700 1 -- 172.21.15.8:0/1606663904 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08b800d600 con 0x7f08bc06fcd0 2023-10-18T20:50:59.136 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.123+0000 7f08c0cfd700 1 -- 172.21.15.8:0/1606663904 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f08b800dbd0 con 0x7f08bc06fcd0 2023-10-18T20:50:59.136 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.123+0000 7f08c0cfd700 1 -- 172.21.15.8:0/1606663904 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08b8011c00 con 0x7f08bc06fcd0 2023-10-18T20:50:59.137 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.123+0000 7f08c3f63700 1 -- 172.21.15.8:0/1606663904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 msgr2=0x7f08bc100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:59.137 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.123+0000 7f08c3f63700 1 --2- 172.21.15.8:0/1606663904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc100ba0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f08b800b5f0 tx=0x7f08b8006ee0).stop 2023-10-18T20:50:59.137 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.123+0000 7f08c3f63700 1 -- 172.21.15.8:0/1606663904 shutdown_connections 2023-10-18T20:50:59.138 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.123+0000 7f08c3f63700 1 --2- 172.21.15.8:0/1606663904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc100ba0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:59.138 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.123+0000 7f08c3f63700 1 -- 172.21.15.8:0/1606663904 >> 172.21.15.8:0/1606663904 conn(0x7f08bc0f6280 msgr2=0x7f08bc0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:59.139 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.123+0000 7f08c3f63700 1 -- 172.21.15.8:0/1606663904 shutdown_connections 2023-10-18T20:50:59.139 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.123+0000 7f08c3f63700 1 -- 172.21.15.8:0/1606663904 wait complete. 2023-10-18T20:50:59.139 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.124+0000 7f08c3f63700 1 Processor -- start 2023-10-18T20:50:59.140 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.124+0000 7f08c3f63700 1 -- start start 2023-10-18T20:50:59.140 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.125+0000 7f08c3f63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc10ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:59.141 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.125+0000 7f08c3f63700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc10d1b0 con 0x7f08bc06fcd0 2023-10-18T20:50:59.141 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.125+0000 7f08c1cff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc10ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:59.141 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.125+0000 7f08c1cff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc10ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42802/0 (socket says 172.21.15.8:42802) 2023-10-18T20:50:59.142 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.125+0000 7f08c1cff700 1 -- 172.21.15.8:0/563876443 learned_addr learned my addr 172.21.15.8:0/563876443 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:50:59.142 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.125+0000 7f08c1cff700 1 -- 172.21.15.8:0/563876443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b800b200 con 0x7f08bc06fcd0 2023-10-18T20:50:59.142 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.125+0000 7f08c1cff700 1 --2- 172.21.15.8:0/563876443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc10ccc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f08b8006c70 tx=0x7f08b8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:59.143 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.126+0000 7f08aa7fc700 1 -- 172.21.15.8:0/563876443 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08b8011690 con 0x7f08bc06fcd0 2023-10-18T20:50:59.143 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.126+0000 7f08aa7fc700 1 -- 172.21.15.8:0/563876443 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f08b801b880 con 0x7f08bc06fcd0 2023-10-18T20:50:59.144 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.126+0000 7f08c3f63700 1 -- 172.21.15.8:0/563876443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc10d3b0 con 0x7f08bc06fcd0 2023-10-18T20:50:59.144 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.126+0000 7f08aa7fc700 1 -- 172.21.15.8:0/563876443 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08b801a650 con 0x7f08bc06fcd0 2023-10-18T20:50:59.144 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.126+0000 7f08c3f63700 1 -- 172.21.15.8:0/563876443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc10d7c0 con 0x7f08bc06fcd0 2023-10-18T20:50:59.145 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.127+0000 7f08c3f63700 1 -- 172.21.15.8:0/563876443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc045ad0 con 0x7f08bc06fcd0 2023-10-18T20:50:59.145 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.127+0000 7f08aa7fc700 1 -- 172.21.15.8:0/563876443 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f08b800f070 con 0x7f08bc06fcd0 2023-10-18T20:50:59.146 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.127+0000 7f08aa7fc700 1 --2- 172.21.15.8:0/563876443 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f08a402fd50 0x7f08a4032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:50:59.146 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.128+0000 7f08aa7fc700 1 -- 172.21.15.8:0/563876443 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f08b80412f0 con 0x7f08bc06fcd0 2023-10-18T20:50:59.146 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.128+0000 7f08c14fe700 1 --2- 172.21.15.8:0/563876443 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f08a402fd50 0x7f08a4032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:50:59.147 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.128+0000 7f08c14fe700 1 --2- 172.21.15.8:0/563876443 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f08a402fd50 0x7f08a4032210 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f08ac0096a0 tx=0x7f08ac006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:50:59.148 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.132+0000 7f08aa7fc700 1 -- 172.21.15.8:0/563876443 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f08b801bd60 con 0x7f08bc06fcd0 2023-10-18T20:50:59.331 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.328+0000 7f08c3f63700 1 -- 172.21.15.8:0/563876443 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f08bc10e020 con 0x7f08a402fd50 2023-10-18T20:50:59.335 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.332+0000 7f08aa7fc700 1 -- 172.21.15.8:0/563876443 <== mgr.14116 v2:172.21.15.8:6800/1016712461 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f08bc10e020 con 0x7f08a402fd50 2023-10-18T20:50:59.335 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: Scheduled mgr update... 2023-10-18T20:50:59.338 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.334+0000 7f08c3f63700 1 -- 172.21.15.8:0/563876443 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f08a402fd50 msgr2=0x7f08a4032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:59.338 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.334+0000 7f08c3f63700 1 --2- 172.21.15.8:0/563876443 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f08a402fd50 0x7f08a4032210 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f08ac0096a0 tx=0x7f08ac006b40).stop 2023-10-18T20:50:59.338 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.334+0000 7f08c3f63700 1 -- 172.21.15.8:0/563876443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 msgr2=0x7f08bc10ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:50:59.339 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.334+0000 7f08c3f63700 1 --2- 172.21.15.8:0/563876443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc10ccc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f08b8006c70 tx=0x7f08b8006ee0).stop 2023-10-18T20:50:59.339 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.334+0000 7f08c3f63700 1 -- 172.21.15.8:0/563876443 shutdown_connections 2023-10-18T20:50:59.339 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.334+0000 7f08c3f63700 1 --2- 172.21.15.8:0/563876443 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f08a402fd50 0x7f08a4032210 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:59.339 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.334+0000 7f08c3f63700 1 --2- 172.21.15.8:0/563876443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc06fcd0 0x7f08bc10ccc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:50:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.334+0000 7f08c3f63700 1 -- 172.21.15.8:0/563876443 >> 172.21.15.8:0/563876443 conn(0x7f08bc0f6280 msgr2=0x7f08bc0f7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:50:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.335+0000 7f08c3f63700 1 -- 172.21.15.8:0/563876443 shutdown_connections 2023-10-18T20:50:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:50:59.335+0000 7f08c3f63700 1 -- 172.21.15.8:0/563876443 wait complete. 2023-10-18T20:50:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:50:57.432698+0000 mgr.smithi008.flmjzp (mgr.14116) 9 : cephadm [INF] Added host smithi008 2023-10-18T20:50:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:58.391958+0000 mgr.smithi008.flmjzp (mgr.14116) 10 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:50:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:50:58.392910+0000 mgr.smithi008.flmjzp (mgr.14116) 11 : cephadm [INF] Saving service mon spec with placement count:5 2023-10-18T20:50:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:58.395221+0000 mon.smithi008 (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:50:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:59.333445+0000 mon.smithi008 (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:50:59.709 INFO:teuthology.orchestra.run.smithi008.stderr:Deploying crash service with default placement... 2023-10-18T20:50:59.709 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply crash 2023-10-18T20:51:00.100 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.097+0000 7fe15b3be700 1 Processor -- start 2023-10-18T20:51:00.100 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.097+0000 7fe15b3be700 1 -- start start 2023-10-18T20:51:00.100 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.097+0000 7fe15b3be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe1540fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:00.101 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.097+0000 7fe15b3be700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540feb40 con 0x7fe15406fc30 2023-10-18T20:51:00.101 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.097+0000 7fe15a3bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe1540fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:00.101 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.097+0000 7fe15a3bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe1540fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42806/0 (socket says 172.21.15.8:42806) 2023-10-18T20:51:00.101 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.097+0000 7fe15a3bc700 1 -- 172.21.15.8:0/3206754065 learned_addr learned my addr 172.21.15.8:0/3206754065 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:00.104 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.097+0000 7fe15a3bc700 1 -- 172.21.15.8:0/3206754065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1540fec80 con 0x7fe15406fc30 2023-10-18T20:51:00.104 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.097+0000 7fe15a3bc700 1 --2- 172.21.15.8:0/3206754065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe1540fe650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe15000b5f0 tx=0x7fe150006ee0).ready entity=mon.0 client_cookie=85124d2ed4ce82d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:00.104 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.097+0000 7fe1593ba700 1 -- 172.21.15.8:0/3206754065 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe15000d600 con 0x7fe15406fc30 2023-10-18T20:51:00.104 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.098+0000 7fe1593ba700 1 -- 172.21.15.8:0/3206754065 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fe15000dbd0 con 0x7fe15406fc30 2023-10-18T20:51:00.105 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.098+0000 7fe1593ba700 1 -- 172.21.15.8:0/3206754065 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe150011c00 con 0x7fe15406fc30 2023-10-18T20:51:00.105 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.098+0000 7fe15b3be700 1 -- 172.21.15.8:0/3206754065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 msgr2=0x7fe1540fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:00.105 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.098+0000 7fe15b3be700 1 --2- 172.21.15.8:0/3206754065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe1540fe650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe15000b5f0 tx=0x7fe150006ee0).stop 2023-10-18T20:51:00.105 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.098+0000 7fe15b3be700 1 -- 172.21.15.8:0/3206754065 shutdown_connections 2023-10-18T20:51:00.105 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.098+0000 7fe15b3be700 1 --2- 172.21.15.8:0/3206754065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe1540fe650 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:00.106 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.098+0000 7fe15b3be700 1 -- 172.21.15.8:0/3206754065 >> 172.21.15.8:0/3206754065 conn(0x7fe1540f6130 msgr2=0x7fe1540f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:00.106 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.098+0000 7fe15b3be700 1 -- 172.21.15.8:0/3206754065 shutdown_connections 2023-10-18T20:51:00.106 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.098+0000 7fe15b3be700 1 -- 172.21.15.8:0/3206754065 wait complete. 2023-10-18T20:51:00.106 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.099+0000 7fe15b3be700 1 Processor -- start 2023-10-18T20:51:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.099+0000 7fe15b3be700 1 -- start start 2023-10-18T20:51:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.100+0000 7fe15b3be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe15410c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.100+0000 7fe15b3be700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15410ceb0 con 0x7fe15406fc30 2023-10-18T20:51:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.100+0000 7fe15a3bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe15410c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.100+0000 7fe15a3bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe15410c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42818/0 (socket says 172.21.15.8:42818) 2023-10-18T20:51:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.100+0000 7fe15a3bc700 1 -- 172.21.15.8:0/3043614961 learned_addr learned my addr 172.21.15.8:0/3043614961 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.100+0000 7fe15a3bc700 1 -- 172.21.15.8:0/3043614961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15000b200 con 0x7fe15406fc30 2023-10-18T20:51:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.100+0000 7fe15a3bc700 1 --2- 172.21.15.8:0/3043614961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe15410c9c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe15000e040 tx=0x7fe150006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.101+0000 7fe142ffd700 1 -- 172.21.15.8:0/3043614961 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe15000d9f0 con 0x7fe15406fc30 2023-10-18T20:51:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.101+0000 7fe142ffd700 1 -- 172.21.15.8:0/3043614961 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fe15001a9f0 con 0x7fe15406fc30 2023-10-18T20:51:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.101+0000 7fe15b3be700 1 -- 172.21.15.8:0/3043614961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15410d0b0 con 0x7fe15406fc30 2023-10-18T20:51:00.109 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.101+0000 7fe142ffd700 1 -- 172.21.15.8:0/3043614961 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe15001b8c0 con 0x7fe15406fc30 2023-10-18T20:51:00.109 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.101+0000 7fe15b3be700 1 -- 172.21.15.8:0/3043614961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15410d4c0 con 0x7fe15406fc30 2023-10-18T20:51:00.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.102+0000 7fe142ffd700 1 -- 172.21.15.8:0/3043614961 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fe15000f070 con 0x7fe15406fc30 2023-10-18T20:51:00.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.102+0000 7fe15b3be700 1 -- 172.21.15.8:0/3043614961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe154045ad0 con 0x7fe15406fc30 2023-10-18T20:51:00.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.102+0000 7fe142ffd700 1 --2- 172.21.15.8:0/3043614961 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe13c02fdb0 0x7fe13c032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:00.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.102+0000 7fe142ffd700 1 -- 172.21.15.8:0/3043614961 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fe150041330 con 0x7fe15406fc30 2023-10-18T20:51:00.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.103+0000 7fe159bbb700 1 --2- 172.21.15.8:0/3043614961 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe13c02fdb0 0x7fe13c032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:00.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.103+0000 7fe159bbb700 1 --2- 172.21.15.8:0/3043614961 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe13c02fdb0 0x7fe13c032270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fe1440096a0 tx=0x7fe144006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:00.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.108+0000 7fe142ffd700 1 -- 172.21.15.8:0/3043614961 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe150022310 con 0x7fe15406fc30 2023-10-18T20:51:00.306 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.304+0000 7fe15b3be700 1 -- 172.21.15.8:0/3043614961 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fe15410de00 con 0x7fe13c02fdb0 2023-10-18T20:51:00.310 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.308+0000 7fe142ffd700 1 -- 172.21.15.8:0/3043614961 <== mgr.14116 v2:172.21.15.8:6800/1016712461 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fe15410de00 con 0x7fe13c02fdb0 2023-10-18T20:51:00.311 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: Scheduled crash update... 2023-10-18T20:51:00.313 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.311+0000 7fe15b3be700 1 -- 172.21.15.8:0/3043614961 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe13c02fdb0 msgr2=0x7fe13c032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:00.313 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.311+0000 7fe15b3be700 1 --2- 172.21.15.8:0/3043614961 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe13c02fdb0 0x7fe13c032270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fe1440096a0 tx=0x7fe144006b40).stop 2023-10-18T20:51:00.313 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.311+0000 7fe15b3be700 1 -- 172.21.15.8:0/3043614961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 msgr2=0x7fe15410c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:00.313 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.311+0000 7fe15b3be700 1 --2- 172.21.15.8:0/3043614961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe15410c9c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe15000e040 tx=0x7fe150006ee0).stop 2023-10-18T20:51:00.314 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.311+0000 7fe15b3be700 1 -- 172.21.15.8:0/3043614961 shutdown_connections 2023-10-18T20:51:00.315 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.311+0000 7fe15b3be700 1 --2- 172.21.15.8:0/3043614961 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe13c02fdb0 0x7fe13c032270 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:00.315 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.311+0000 7fe15b3be700 1 --2- 172.21.15.8:0/3043614961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe15406fc30 0x7fe15410c9c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:00.315 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.311+0000 7fe15b3be700 1 -- 172.21.15.8:0/3043614961 >> 172.21.15.8:0/3043614961 conn(0x7fe1540f6130 msgr2=0x7fe1540f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:00.315 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.311+0000 7fe15b3be700 1 -- 172.21.15.8:0/3043614961 shutdown_connections 2023-10-18T20:51:00.315 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:00.311+0000 7fe15b3be700 1 -- 172.21.15.8:0/3043614961 wait complete. 2023-10-18T20:51:00.645 INFO:teuthology.orchestra.run.smithi008.stderr:Enabling mgr prometheus module... 2023-10-18T20:51:00.645 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable prometheus 2023-10-18T20:51:00.649 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:50:59.330614+0000 mgr.smithi008.flmjzp (mgr.14116) 12 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:51:00.649 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:50:59.331105+0000 mgr.smithi008.flmjzp (mgr.14116) 13 : cephadm [INF] Saving service mgr spec with placement count:2 2023-10-18T20:51:00.649 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:00.309343+0000 mon.smithi008 (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.8:0/3637900849' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:01.043 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.039+0000 7fe246b91700 1 Processor -- start 2023-10-18T20:51:01.043 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.039+0000 7fe246b91700 1 -- start start 2023-10-18T20:51:01.043 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.040+0000 7fe246b91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe2400fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:01.044 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.040+0000 7fe246b91700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400feb40 con 0x7fe24006fc30 2023-10-18T20:51:01.044 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.040+0000 7fe245b8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe2400fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:01.044 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.040+0000 7fe245b8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe2400fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42828/0 (socket says 172.21.15.8:42828) 2023-10-18T20:51:01.044 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.040+0000 7fe245b8f700 1 -- 172.21.15.8:0/2076175813 learned_addr learned my addr 172.21.15.8:0/2076175813 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:01.044 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.040+0000 7fe245b8f700 1 -- 172.21.15.8:0/2076175813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2400fec80 con 0x7fe24006fc30 2023-10-18T20:51:01.045 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.040+0000 7fe245b8f700 1 --2- 172.21.15.8:0/2076175813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe2400fe650 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe23c00b5f0 tx=0x7fe23c006ee0).ready entity=mon.0 client_cookie=e6b4b4db28cc1716 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:01.045 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.041+0000 7fe244b8d700 1 -- 172.21.15.8:0/2076175813 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe23c00d600 con 0x7fe24006fc30 2023-10-18T20:51:01.045 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.041+0000 7fe244b8d700 1 -- 172.21.15.8:0/2076175813 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fe23c00dbd0 con 0x7fe24006fc30 2023-10-18T20:51:01.048 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.041+0000 7fe244b8d700 1 -- 172.21.15.8:0/2076175813 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe23c011c00 con 0x7fe24006fc30 2023-10-18T20:51:01.048 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.041+0000 7fe246b91700 1 -- 172.21.15.8:0/2076175813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 msgr2=0x7fe2400fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:01.048 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.041+0000 7fe246b91700 1 --2- 172.21.15.8:0/2076175813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe2400fe650 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe23c00b5f0 tx=0x7fe23c006ee0).stop 2023-10-18T20:51:01.049 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.041+0000 7fe246b91700 1 -- 172.21.15.8:0/2076175813 shutdown_connections 2023-10-18T20:51:01.049 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.041+0000 7fe246b91700 1 --2- 172.21.15.8:0/2076175813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe2400fe650 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:01.049 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.041+0000 7fe246b91700 1 -- 172.21.15.8:0/2076175813 >> 172.21.15.8:0/2076175813 conn(0x7fe2400f6130 msgr2=0x7fe2400f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:01.049 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.042+0000 7fe246b91700 1 -- 172.21.15.8:0/2076175813 shutdown_connections 2023-10-18T20:51:01.049 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.042+0000 7fe246b91700 1 -- 172.21.15.8:0/2076175813 wait complete. 2023-10-18T20:51:01.050 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.042+0000 7fe246b91700 1 Processor -- start 2023-10-18T20:51:01.050 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.043+0000 7fe246b91700 1 -- start start 2023-10-18T20:51:01.050 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.043+0000 7fe246b91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe24010c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:01.050 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.043+0000 7fe246b91700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24010ceb0 con 0x7fe24006fc30 2023-10-18T20:51:01.050 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.043+0000 7fe245b8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe24010c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:01.051 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.043+0000 7fe245b8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe24010c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42834/0 (socket says 172.21.15.8:42834) 2023-10-18T20:51:01.051 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.043+0000 7fe245b8f700 1 -- 172.21.15.8:0/2894808746 learned_addr learned my addr 172.21.15.8:0/2894808746 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:01.051 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.044+0000 7fe245b8f700 1 -- 172.21.15.8:0/2894808746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c00b200 con 0x7fe24006fc30 2023-10-18T20:51:01.051 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.044+0000 7fe245b8f700 1 --2- 172.21.15.8:0/2894808746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe24010c9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe23c00e040 tx=0x7fe23c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:01.051 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.044+0000 7fe22e7fc700 1 -- 172.21.15.8:0/2894808746 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe23c00d9f0 con 0x7fe24006fc30 2023-10-18T20:51:01.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.044+0000 7fe22e7fc700 1 -- 172.21.15.8:0/2894808746 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fe23c01a9f0 con 0x7fe24006fc30 2023-10-18T20:51:01.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.044+0000 7fe246b91700 1 -- 172.21.15.8:0/2894808746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24010d0b0 con 0x7fe24006fc30 2023-10-18T20:51:01.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.044+0000 7fe22e7fc700 1 -- 172.21.15.8:0/2894808746 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe23c01b8c0 con 0x7fe24006fc30 2023-10-18T20:51:01.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.044+0000 7fe246b91700 1 -- 172.21.15.8:0/2894808746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24010d4c0 con 0x7fe24006fc30 2023-10-18T20:51:01.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.045+0000 7fe22e7fc700 1 -- 172.21.15.8:0/2894808746 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fe23c00f070 con 0x7fe24006fc30 2023-10-18T20:51:01.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.045+0000 7fe246b91700 1 -- 172.21.15.8:0/2894808746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe240045ad0 con 0x7fe24006fc30 2023-10-18T20:51:01.053 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.046+0000 7fe22e7fc700 1 --2- 172.21.15.8:0/2894808746 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe22802fdb0 0x7fe228032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:01.053 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.046+0000 7fe22e7fc700 1 -- 172.21.15.8:0/2894808746 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fe23c041270 con 0x7fe24006fc30 2023-10-18T20:51:01.053 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.046+0000 7fe24538e700 1 --2- 172.21.15.8:0/2894808746 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe22802fdb0 0x7fe228032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:01.053 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.046+0000 7fe24538e700 1 --2- 172.21.15.8:0/2894808746 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe22802fdb0 0x7fe228032270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fe2300096a0 tx=0x7fe230006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:01.053 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.050+0000 7fe22e7fc700 1 -- 172.21.15.8:0/2894808746 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe23c022310 con 0x7fe24006fc30 2023-10-18T20:51:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.254+0000 7fe246b91700 1 -- 172.21.15.8:0/2894808746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "prometheus"} v 0) v1 -- 0x7fe2400ff8f0 con 0x7fe24006fc30 2023-10-18T20:51:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.399+0000 7fe22e7fc700 1 -- 172.21.15.8:0/2894808746 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7fe23c01ab60 con 0x7fe24006fc30 2023-10-18T20:51:01.402 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.400+0000 7fe22e7fc700 1 -- 172.21.15.8:0/2894808746 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "prometheus"}]=0 v9) v1 ==== 89+0+0 (secure 0 0 0) 0x7fe23c0417c0 con 0x7fe24006fc30 2023-10-18T20:51:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.403+0000 7fe246b91700 1 -- 172.21.15.8:0/2894808746 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe22802fdb0 msgr2=0x7fe228032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.403+0000 7fe246b91700 1 --2- 172.21.15.8:0/2894808746 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe22802fdb0 0x7fe228032270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fe2300096a0 tx=0x7fe230006b40).stop 2023-10-18T20:51:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.403+0000 7fe246b91700 1 -- 172.21.15.8:0/2894808746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 msgr2=0x7fe24010c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.403+0000 7fe246b91700 1 --2- 172.21.15.8:0/2894808746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe24010c9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe23c00e040 tx=0x7fe23c006ee0).stop 2023-10-18T20:51:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.403+0000 7fe246b91700 1 -- 172.21.15.8:0/2894808746 shutdown_connections 2023-10-18T20:51:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.403+0000 7fe246b91700 1 --2- 172.21.15.8:0/2894808746 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7fe22802fdb0 0x7fe228032270 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.403+0000 7fe246b91700 1 --2- 172.21.15.8:0/2894808746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe24006fc30 0x7fe24010c9c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.403+0000 7fe246b91700 1 -- 172.21.15.8:0/2894808746 >> 172.21.15.8:0/2894808746 conn(0x7fe2400f6130 msgr2=0x7fe2400f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.403+0000 7fe246b91700 1 -- 172.21.15.8:0/2894808746 shutdown_connections 2023-10-18T20:51:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:01.403+0000 7fe246b91700 1 -- 172.21.15.8:0/2894808746 wait complete. 2023-10-18T20:51:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:00.306164+0000 mgr.smithi008.flmjzp (mgr.14116) 14 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:51:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:51:00.306876+0000 mgr.smithi008.flmjzp (mgr.14116) 15 : cephadm [INF] Saving service crash spec with placement * 2023-10-18T20:51:01.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:01.255620+0000 mon.smithi008 (mon.0) 60 : audit [INF] from='client.? 172.21.15.8:0/2894808746' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-10-18T20:51:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:Deploying prometheus service with default placement... 2023-10-18T20:51:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply prometheus 2023-10-18T20:51:02.176 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.173+0000 7f940a787700 1 Processor -- start 2023-10-18T20:51:02.177 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.173+0000 7f940a787700 1 -- start start 2023-10-18T20:51:02.177 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.174+0000 7f940a787700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f94040fbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:02.177 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.174+0000 7f940a787700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94040fc4c0 con 0x7f94040fbbb0 2023-10-18T20:51:02.177 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.174+0000 7f93fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f94040fbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:02.177 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.174+0000 7f93fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f94040fbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42858/0 (socket says 172.21.15.8:42858) 2023-10-18T20:51:02.180 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.174+0000 7f93fbfff700 1 -- 172.21.15.8:0/2308928171 learned_addr learned my addr 172.21.15.8:0/2308928171 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:02.180 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.175+0000 7f93fbfff700 1 -- 172.21.15.8:0/2308928171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94040fc600 con 0x7f94040fbbb0 2023-10-18T20:51:02.180 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.175+0000 7f93fbfff700 1 --2- 172.21.15.8:0/2308928171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f94040fbfd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f93f400b5f0 tx=0x7f93f4006ee0).ready entity=mon.0 client_cookie=261495458a5660f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:02.180 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.175+0000 7f94037fe700 1 -- 172.21.15.8:0/2308928171 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93f400d600 con 0x7f94040fbbb0 2023-10-18T20:51:02.180 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.175+0000 7f94037fe700 1 -- 172.21.15.8:0/2308928171 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f93f400dbd0 con 0x7f94040fbbb0 2023-10-18T20:51:02.181 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.175+0000 7f94037fe700 1 -- 172.21.15.8:0/2308928171 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93f4011c00 con 0x7f94040fbbb0 2023-10-18T20:51:02.181 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.176+0000 7f940a787700 1 -- 172.21.15.8:0/2308928171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 msgr2=0x7f94040fbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:02.181 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.176+0000 7f940a787700 1 --2- 172.21.15.8:0/2308928171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f94040fbfd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f93f400b5f0 tx=0x7f93f4006ee0).stop 2023-10-18T20:51:02.181 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.176+0000 7f940a787700 1 -- 172.21.15.8:0/2308928171 shutdown_connections 2023-10-18T20:51:02.181 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.176+0000 7f940a787700 1 --2- 172.21.15.8:0/2308928171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f94040fbfd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:02.181 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.176+0000 7f940a787700 1 -- 172.21.15.8:0/2308928171 >> 172.21.15.8:0/2308928171 conn(0x7f94040f73f0 msgr2=0x7f94040f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:02.182 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.176+0000 7f940a787700 1 -- 172.21.15.8:0/2308928171 shutdown_connections 2023-10-18T20:51:02.182 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.176+0000 7f940a787700 1 -- 172.21.15.8:0/2308928171 wait complete. 2023-10-18T20:51:02.182 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.177+0000 7f940a787700 1 Processor -- start 2023-10-18T20:51:02.182 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.177+0000 7f940a787700 1 -- start start 2023-10-18T20:51:02.182 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.177+0000 7f940a787700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f9404071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:02.183 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.177+0000 7f940a787700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94040701f0 con 0x7f94040fbbb0 2023-10-18T20:51:02.183 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.178+0000 7f93fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f9404071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:02.183 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.178+0000 7f93fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f9404071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42870/0 (socket says 172.21.15.8:42870) 2023-10-18T20:51:02.183 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.178+0000 7f93fbfff700 1 -- 172.21.15.8:0/562608999 learned_addr learned my addr 172.21.15.8:0/562608999 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:02.184 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.178+0000 7f93fbfff700 1 -- 172.21.15.8:0/562608999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f400b200 con 0x7f94040fbbb0 2023-10-18T20:51:02.184 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.178+0000 7f93fbfff700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f9404071d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f93f400e040 tx=0x7f93f4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.178+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93f401b410 con 0x7f94040fbbb0 2023-10-18T20:51:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.178+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f93f401b9e0 con 0x7f94040fbbb0 2023-10-18T20:51:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.178+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93f401a820 con 0x7f94040fbbb0 2023-10-18T20:51:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.179+0000 7f940a787700 1 -- 172.21.15.8:0/562608999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9404070390 con 0x7f94040fbbb0 2023-10-18T20:51:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.179+0000 7f940a787700 1 -- 172.21.15.8:0/562608999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94040707a0 con 0x7f94040fbbb0 2023-10-18T20:51:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.180+0000 7f940a787700 1 -- 172.21.15.8:0/562608999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9404045ad0 con 0x7f94040fbbb0 2023-10-18T20:51:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.180+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7f93f400f070 con 0x7f94040fbbb0 2023-10-18T20:51:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.180+0000 7f94017fa700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 0x7f93e40322c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.180+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f93f40414e0 con 0x7f94040fbbb0 2023-10-18T20:51:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.180+0000 7f9403fff700 1 -- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 msgr2=0x7f93e40322c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1016712461 2023-10-18T20:51:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.180+0000 7f9403fff700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 0x7f93e40322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T20:51:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.185+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f93f4022310 con 0x7f94040fbbb0 2023-10-18T20:51:02.382 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.380+0000 7f940a787700 1 -- 172.21.15.8:0/562608999 --> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f94040709e0 con 0x7f93e402fe00 2023-10-18T20:51:02.383 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.381+0000 7f9403fff700 1 -- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 msgr2=0x7f93e40322c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1016712461 2023-10-18T20:51:02.383 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.381+0000 7f9403fff700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 0x7f93e40322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T20:51:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:01.400946+0000 mon.smithi008 (mon.0) 61 : audit [INF] from='client.? 172.21.15.8:0/2894808746' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-10-18T20:51:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:01.401024+0000 mon.smithi008 (mon.0) 62 : cluster [DBG] mgrmap e9: smithi008.flmjzp(active, since 13s) 2023-10-18T20:51:02.784 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.782+0000 7f9403fff700 1 -- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 msgr2=0x7f93e40322c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1016712461 2023-10-18T20:51:02.784 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:02.782+0000 7f9403fff700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 0x7f93e40322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T20:51:03.585 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:03.583+0000 7f9403fff700 1 -- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 msgr2=0x7f93e40322c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1016712461 2023-10-18T20:51:03.585 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:03.583+0000 7f9403fff700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 0x7f93e40322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T20:51:05.186 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:05.184+0000 7f9403fff700 1 -- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 msgr2=0x7f93e40322c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1016712461 2023-10-18T20:51:05.186 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:05.184+0000 7f9403fff700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 0x7f93e40322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-18T20:51:08.124 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:08.121+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 10) v1 ==== 35984+0+0 (secure 0 0 0) 0x7f93f401a980 con 0x7f94040fbbb0 2023-10-18T20:51:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:08.121+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 msgr2=0x7f93e40322c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:51:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:08.121+0000 7f94017fa700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 0x7f93e40322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:51:08.401 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:08.069140+0000 mon.smithi008 (mon.0) 63 : cluster [INF] Active manager daemon smithi008.flmjzp restarted 2023-10-18T20:51:08.401 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:08.069651+0000 mon.smithi008 (mon.0) 64 : cluster [INF] Activating manager daemon smithi008.flmjzp 2023-10-18T20:51:08.401 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:08.071658+0000 mon.smithi008 (mon.0) 65 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2023-10-18T20:51:09.131 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.128+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mgrmap(e 11) v1 ==== 36054+0+0 (secure 0 0 0) 0x7f93f403d3b0 con 0x7f94040fbbb0 2023-10-18T20:51:09.131 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.128+0000 7f94017fa700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f93e4033c20 0x7f93e4036010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:09.131 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.128+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 --> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f94040709e0 con 0x7f93e4033c20 2023-10-18T20:51:09.132 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.129+0000 7f9403fff700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f93e4033c20 0x7f93e4036010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:09.132 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.130+0000 7f9403fff700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f93e4033c20 0x7f93e4036010 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f93ec006fd0 tx=0x7f93ec006d30).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:09.137 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.135+0000 7f94017fa700 1 -- 172.21.15.8:0/562608999 <== mgr.14144 v2:172.21.15.8:6800/2925059353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f94040709e0 con 0x7f93e4033c20 2023-10-18T20:51:09.137 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: Scheduled prometheus update... 2023-10-18T20:51:09.140 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.137+0000 7f940a787700 1 -- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f93e4033c20 msgr2=0x7f93e4036010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:09.140 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.137+0000 7f940a787700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f93e4033c20 0x7f93e4036010 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f93ec006fd0 tx=0x7f93ec006d30).stop 2023-10-18T20:51:09.140 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.137+0000 7f940a787700 1 -- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 msgr2=0x7f9404071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:09.140 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.137+0000 7f940a787700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f9404071d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f93f400e040 tx=0x7f93f4006ee0).stop 2023-10-18T20:51:09.141 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.138+0000 7f940a787700 1 -- 172.21.15.8:0/562608999 shutdown_connections 2023-10-18T20:51:09.141 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.138+0000 7f940a787700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f93e4033c20 0x7f93e4036010 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:09.141 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.138+0000 7f940a787700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94040fbbb0 0x7f9404071d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:09.141 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.138+0000 7f940a787700 1 --2- 172.21.15.8:0/562608999 >> [v2:172.21.15.8:6800/1016712461,v1:172.21.15.8:6801/1016712461] conn(0x7f93e402fe00 0x7f93e40322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:51:09.141 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.138+0000 7f940a787700 1 -- 172.21.15.8:0/562608999 >> 172.21.15.8:0/562608999 conn(0x7f94040f73f0 msgr2=0x7f94040f8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:09.142 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.138+0000 7f940a787700 1 -- 172.21.15.8:0/562608999 shutdown_connections 2023-10-18T20:51:09.142 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.138+0000 7f940a787700 1 -- 172.21.15.8:0/562608999 wait complete. 2023-10-18T20:51:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:08.122289+0000 mon.smithi008 (mon.0) 66 : cluster [DBG] mgrmap e10: smithi008.flmjzp(active, starting, since 0.0527256s) 2023-10-18T20:51:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:08.125713+0000 mon.smithi008 (mon.0) 67 : audit [DBG] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:51:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:08.126593+0000 mon.smithi008 (mon.0) 68 : audit [DBG] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr metadata", "who": "smithi008.flmjzp", "id": "smithi008.flmjzp"}]: dispatch 2023-10-18T20:51:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:08.127673+0000 mon.smithi008 (mon.0) 69 : audit [DBG] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T20:51:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:08.127871+0000 mon.smithi008 (mon.0) 70 : audit [DBG] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T20:51:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:08.128027+0000 mon.smithi008 (mon.0) 71 : audit [DBG] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T20:51:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:08.131142+0000 mon.smithi008 (mon.0) 72 : cluster [INF] Manager daemon smithi008.flmjzp is now available 2023-10-18T20:51:09.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:08.258855+0000 mon.smithi008 (mon.0) 73 : audit [DBG] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:51:09.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:08.260613+0000 mon.smithi008 (mon.0) 74 : audit [DBG] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:51:09.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:08.279260+0000 mon.smithi008 (mon.0) 75 : audit [INF] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:51:09.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:08.283279+0000 mon.smithi008 (mon.0) 76 : audit [INF] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:51:09.507 INFO:teuthology.orchestra.run.smithi008.stderr:Deploying grafana service with default placement... 2023-10-18T20:51:09.507 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply grafana 2023-10-18T20:51:09.901 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.898+0000 7fc5ff57f700 1 Processor -- start 2023-10-18T20:51:09.901 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.898+0000 7fc5ff57f700 1 -- start start 2023-10-18T20:51:09.901 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.898+0000 7fc5ff57f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f80fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:09.901 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.898+0000 7fc5ff57f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80feb40 con 0x7fc5f806fc30 2023-10-18T20:51:09.902 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.899+0000 7fc5fe57d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f80fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:09.904 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.899+0000 7fc5fe57d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f80fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36888/0 (socket says 172.21.15.8:36888) 2023-10-18T20:51:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.899+0000 7fc5fe57d700 1 -- 172.21.15.8:0/3051135152 learned_addr learned my addr 172.21.15.8:0/3051135152 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.899+0000 7fc5fe57d700 1 -- 172.21.15.8:0/3051135152 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f80fec80 con 0x7fc5f806fc30 2023-10-18T20:51:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.899+0000 7fc5fe57d700 1 --2- 172.21.15.8:0/3051135152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f80fe650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc5f400b5f0 tx=0x7fc5f4006ee0).ready entity=mon.0 client_cookie=b123b8567baa4f65 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.899+0000 7fc5fd57b700 1 -- 172.21.15.8:0/3051135152 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5f400d600 con 0x7fc5f806fc30 2023-10-18T20:51:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.900+0000 7fc5fd57b700 1 -- 172.21.15.8:0/3051135152 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fc5f400dbd0 con 0x7fc5f806fc30 2023-10-18T20:51:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.900+0000 7fc5fd57b700 1 -- 172.21.15.8:0/3051135152 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5f4011c00 con 0x7fc5f806fc30 2023-10-18T20:51:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.900+0000 7fc5ff57f700 1 -- 172.21.15.8:0/3051135152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 msgr2=0x7fc5f80fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.900+0000 7fc5ff57f700 1 --2- 172.21.15.8:0/3051135152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f80fe650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc5f400b5f0 tx=0x7fc5f4006ee0).stop 2023-10-18T20:51:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.900+0000 7fc5ff57f700 1 -- 172.21.15.8:0/3051135152 shutdown_connections 2023-10-18T20:51:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.900+0000 7fc5ff57f700 1 --2- 172.21.15.8:0/3051135152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f80fe650 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.900+0000 7fc5ff57f700 1 -- 172.21.15.8:0/3051135152 >> 172.21.15.8:0/3051135152 conn(0x7fc5f80f6130 msgr2=0x7fc5f80f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.900+0000 7fc5ff57f700 1 -- 172.21.15.8:0/3051135152 shutdown_connections 2023-10-18T20:51:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.900+0000 7fc5ff57f700 1 -- 172.21.15.8:0/3051135152 wait complete. 2023-10-18T20:51:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.901+0000 7fc5ff57f700 1 Processor -- start 2023-10-18T20:51:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.901+0000 7fc5ff57f700 1 -- start start 2023-10-18T20:51:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.902+0000 7fc5ff57f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f810c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.902+0000 7fc5ff57f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f810ceb0 con 0x7fc5f806fc30 2023-10-18T20:51:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.902+0000 7fc5fe57d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f810c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.902+0000 7fc5fe57d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f810c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36904/0 (socket says 172.21.15.8:36904) 2023-10-18T20:51:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.902+0000 7fc5fe57d700 1 -- 172.21.15.8:0/2691810303 learned_addr learned my addr 172.21.15.8:0/2691810303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.902+0000 7fc5fe57d700 1 -- 172.21.15.8:0/2691810303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f400b200 con 0x7fc5f806fc30 2023-10-18T20:51:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.902+0000 7fc5fe57d700 1 --2- 172.21.15.8:0/2691810303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f810c9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc5f400e040 tx=0x7fc5f4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.903+0000 7fc5e6ffd700 1 -- 172.21.15.8:0/2691810303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5f400d9f0 con 0x7fc5f806fc30 2023-10-18T20:51:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.903+0000 7fc5e6ffd700 1 -- 172.21.15.8:0/2691810303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fc5f401a9f0 con 0x7fc5f806fc30 2023-10-18T20:51:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.903+0000 7fc5e6ffd700 1 -- 172.21.15.8:0/2691810303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5f401b8c0 con 0x7fc5f806fc30 2023-10-18T20:51:09.910 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.903+0000 7fc5ff57f700 1 -- 172.21.15.8:0/2691810303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f810d0b0 con 0x7fc5f806fc30 2023-10-18T20:51:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.903+0000 7fc5ff57f700 1 -- 172.21.15.8:0/2691810303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f810d4c0 con 0x7fc5f806fc30 2023-10-18T20:51:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.904+0000 7fc5e6ffd700 1 -- 172.21.15.8:0/2691810303 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 11) v1 ==== 36054+0+0 (secure 0 0 0) 0x7fc5f400f070 con 0x7fc5f806fc30 2023-10-18T20:51:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.904+0000 7fc5ff57f700 1 -- 172.21.15.8:0/2691810303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f8045ad0 con 0x7fc5f806fc30 2023-10-18T20:51:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.904+0000 7fc5e6ffd700 1 --2- 172.21.15.8:0/2691810303 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fc5e002fd70 0x7fc5e0032230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.904+0000 7fc5e6ffd700 1 -- 172.21.15.8:0/2691810303 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fc5f4041300 con 0x7fc5f806fc30 2023-10-18T20:51:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.905+0000 7fc5fdd7c700 1 --2- 172.21.15.8:0/2691810303 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fc5e002fd70 0x7fc5e0032230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.905+0000 7fc5fdd7c700 1 --2- 172.21.15.8:0/2691810303 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fc5e002fd70 0x7fc5e0032230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc5e80096a0 tx=0x7fc5e8006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:09.909+0000 7fc5e6ffd700 1 -- 172.21.15.8:0/2691810303 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc5f40224f0 con 0x7fc5f806fc30 2023-10-18T20:51:10.104 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.102+0000 7fc5ff57f700 1 -- 172.21.15.8:0/2691810303 --> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5f810dda0 con 0x7fc5e002fd70 2023-10-18T20:51:10.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.106+0000 7fc5e6ffd700 1 -- 172.21.15.8:0/2691810303 <== mgr.14144 v2:172.21.15.8:6800/2925059353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fc5f810dda0 con 0x7fc5e002fd70 2023-10-18T20:51:10.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: Scheduled grafana update... 2023-10-18T20:51:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.108+0000 7fc5ff57f700 1 -- 172.21.15.8:0/2691810303 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fc5e002fd70 msgr2=0x7fc5e0032230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.108+0000 7fc5ff57f700 1 --2- 172.21.15.8:0/2691810303 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fc5e002fd70 0x7fc5e0032230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc5e80096a0 tx=0x7fc5e8006b40).stop 2023-10-18T20:51:10.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.108+0000 7fc5ff57f700 1 -- 172.21.15.8:0/2691810303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 msgr2=0x7fc5f810c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:10.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.108+0000 7fc5ff57f700 1 --2- 172.21.15.8:0/2691810303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f810c9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc5f400e040 tx=0x7fc5f4006ee0).stop 2023-10-18T20:51:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.108+0000 7fc5ff57f700 1 -- 172.21.15.8:0/2691810303 shutdown_connections 2023-10-18T20:51:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.108+0000 7fc5ff57f700 1 --2- 172.21.15.8:0/2691810303 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fc5e002fd70 0x7fc5e0032230 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.108+0000 7fc5ff57f700 1 --2- 172.21.15.8:0/2691810303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5f806fc30 0x7fc5f810c9c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.108+0000 7fc5ff57f700 1 -- 172.21.15.8:0/2691810303 >> 172.21.15.8:0/2691810303 conn(0x7fc5f80f6130 msgr2=0x7fc5f80f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.109+0000 7fc5ff57f700 1 -- 172.21.15.8:0/2691810303 shutdown_connections 2023-10-18T20:51:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.109+0000 7fc5ff57f700 1 -- 172.21.15.8:0/2691810303 wait complete. 2023-10-18T20:51:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:09.131029+0000 mon.smithi008 (mon.0) 77 : cluster [DBG] mgrmap e11: smithi008.flmjzp(active, since 1.06147s) 2023-10-18T20:51:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:51:09.133194+0000 mgr.smithi008.flmjzp (mgr.14144) 2 : cephadm [INF] Saving service prometheus spec with placement count:1 2023-10-18T20:51:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:09.135419+0000 mon.smithi008 (mon.0) 78 : audit [INF] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:10.106860+0000 mon.smithi008 (mon.0) 79 : audit [INF] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:10.459 INFO:teuthology.orchestra.run.smithi008.stderr:Deploying node-exporter service with default placement... 2023-10-18T20:51:10.459 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply node-exporter 2023-10-18T20:51:10.857 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.855+0000 7f343df96700 1 Processor -- start 2023-10-18T20:51:10.858 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.855+0000 7f343df96700 1 -- start start 2023-10-18T20:51:10.858 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.855+0000 7f343df96700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f34380fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:10.858 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.855+0000 7f343df96700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34380feb40 con 0x7f343806fc30 2023-10-18T20:51:10.858 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.856+0000 7f343cf94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f34380fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:10.861 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.856+0000 7f343cf94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f34380fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36910/0 (socket says 172.21.15.8:36910) 2023-10-18T20:51:10.861 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.856+0000 7f343cf94700 1 -- 172.21.15.8:0/3051125483 learned_addr learned my addr 172.21.15.8:0/3051125483 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:10.861 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.856+0000 7f343cf94700 1 -- 172.21.15.8:0/3051125483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380fec80 con 0x7f343806fc30 2023-10-18T20:51:10.862 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.856+0000 7f343cf94700 1 --2- 172.21.15.8:0/3051125483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f34380fe650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f342c00b5f0 tx=0x7f342c006ee0).ready entity=mon.0 client_cookie=c3617f39de4c8c05 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:10.862 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.857+0000 7f34377fe700 1 -- 172.21.15.8:0/3051125483 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f342c00d600 con 0x7f343806fc30 2023-10-18T20:51:10.862 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.857+0000 7f34377fe700 1 -- 172.21.15.8:0/3051125483 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f342c00dbd0 con 0x7f343806fc30 2023-10-18T20:51:10.862 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.857+0000 7f34377fe700 1 -- 172.21.15.8:0/3051125483 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f342c011c00 con 0x7f343806fc30 2023-10-18T20:51:10.862 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.857+0000 7f343df96700 1 -- 172.21.15.8:0/3051125483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 msgr2=0x7f34380fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.857+0000 7f343df96700 1 --2- 172.21.15.8:0/3051125483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f34380fe650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f342c00b5f0 tx=0x7f342c006ee0).stop 2023-10-18T20:51:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.857+0000 7f343df96700 1 -- 172.21.15.8:0/3051125483 shutdown_connections 2023-10-18T20:51:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.857+0000 7f343df96700 1 --2- 172.21.15.8:0/3051125483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f34380fe650 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.857+0000 7f343df96700 1 -- 172.21.15.8:0/3051125483 >> 172.21.15.8:0/3051125483 conn(0x7f34380f6130 msgr2=0x7f34380f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.857+0000 7f343df96700 1 -- 172.21.15.8:0/3051125483 shutdown_connections 2023-10-18T20:51:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.857+0000 7f343df96700 1 -- 172.21.15.8:0/3051125483 wait complete. 2023-10-18T20:51:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.858+0000 7f343df96700 1 Processor -- start 2023-10-18T20:51:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.858+0000 7f343df96700 1 -- start start 2023-10-18T20:51:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.859+0000 7f343df96700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f343810c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.859+0000 7f343df96700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343810ceb0 con 0x7f343806fc30 2023-10-18T20:51:10.865 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.859+0000 7f343cf94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f343810c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:10.865 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.859+0000 7f343cf94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f343810c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36922/0 (socket says 172.21.15.8:36922) 2023-10-18T20:51:10.865 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.859+0000 7f343cf94700 1 -- 172.21.15.8:0/656295804 learned_addr learned my addr 172.21.15.8:0/656295804 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:10.865 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.859+0000 7f343cf94700 1 -- 172.21.15.8:0/656295804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c00b200 con 0x7f343806fc30 2023-10-18T20:51:10.865 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.859+0000 7f343cf94700 1 --2- 172.21.15.8:0/656295804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f343810c9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f342c00e040 tx=0x7f342c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.860+0000 7f34357fa700 1 -- 172.21.15.8:0/656295804 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f342c00d9f0 con 0x7f343806fc30 2023-10-18T20:51:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.860+0000 7f34357fa700 1 -- 172.21.15.8:0/656295804 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f342c01a9f0 con 0x7f343806fc30 2023-10-18T20:51:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.860+0000 7f34357fa700 1 -- 172.21.15.8:0/656295804 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f342c01b8c0 con 0x7f343806fc30 2023-10-18T20:51:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.860+0000 7f343df96700 1 -- 172.21.15.8:0/656295804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343810d0b0 con 0x7f343806fc30 2023-10-18T20:51:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.860+0000 7f343df96700 1 -- 172.21.15.8:0/656295804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343810d4c0 con 0x7f343806fc30 2023-10-18T20:51:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.861+0000 7f34357fa700 1 -- 172.21.15.8:0/656295804 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f342c00f070 con 0x7f343806fc30 2023-10-18T20:51:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.861+0000 7f343df96700 1 -- 172.21.15.8:0/656295804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3438045ad0 con 0x7f343806fc30 2023-10-18T20:51:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.861+0000 7f34357fa700 1 --2- 172.21.15.8:0/656295804 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f341c02feb0 0x7f341c032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.861+0000 7f34357fa700 1 -- 172.21.15.8:0/656295804 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f342c0414c0 con 0x7f343806fc30 2023-10-18T20:51:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.862+0000 7f3437fff700 1 --2- 172.21.15.8:0/656295804 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f341c02feb0 0x7f341c032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.862+0000 7f3437fff700 1 --2- 172.21.15.8:0/656295804 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f341c02feb0 0x7f341c032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f34240096a0 tx=0x7f3424006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:10.866+0000 7f34357fa700 1 -- 172.21.15.8:0/656295804 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f342c006a70 con 0x7f343806fc30 2023-10-18T20:51:11.062 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.060+0000 7f343df96700 1 -- 172.21.15.8:0/656295804 --> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f343810de00 con 0x7f341c02feb0 2023-10-18T20:51:11.066 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.065+0000 7f34357fa700 1 -- 172.21.15.8:0/656295804 <== mgr.14144 v2:172.21.15.8:6800/2925059353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f343810de00 con 0x7f341c02feb0 2023-10-18T20:51:11.067 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2023-10-18T20:51:11.069 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.067+0000 7f343df96700 1 -- 172.21.15.8:0/656295804 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f341c02feb0 msgr2=0x7f341c032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:11.069 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.067+0000 7f343df96700 1 --2- 172.21.15.8:0/656295804 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f341c02feb0 0x7f341c032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f34240096a0 tx=0x7f3424006b40).stop 2023-10-18T20:51:11.069 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.067+0000 7f343df96700 1 -- 172.21.15.8:0/656295804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 msgr2=0x7f343810c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:11.070 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.067+0000 7f343df96700 1 --2- 172.21.15.8:0/656295804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f343810c9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f342c00e040 tx=0x7f342c006ee0).stop 2023-10-18T20:51:11.071 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.067+0000 7f343df96700 1 -- 172.21.15.8:0/656295804 shutdown_connections 2023-10-18T20:51:11.071 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.067+0000 7f343df96700 1 --2- 172.21.15.8:0/656295804 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f341c02feb0 0x7f341c032370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:11.071 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.067+0000 7f343df96700 1 --2- 172.21.15.8:0/656295804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f343806fc30 0x7f343810c9c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:11.071 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.067+0000 7f343df96700 1 -- 172.21.15.8:0/656295804 >> 172.21.15.8:0/656295804 conn(0x7f34380f6130 msgr2=0x7f34380f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:11.071 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.067+0000 7f343df96700 1 -- 172.21.15.8:0/656295804 shutdown_connections 2023-10-18T20:51:11.072 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:11.067+0000 7f343df96700 1 -- 172.21.15.8:0/656295804 wait complete. 2023-10-18T20:51:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:10.104118+0000 mgr.smithi008.flmjzp (mgr.14144) 3 : audit [DBG] from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:51:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:51:10.104630+0000 mgr.smithi008.flmjzp (mgr.14144) 4 : cephadm [INF] Saving service grafana spec with placement count:1 2023-10-18T20:51:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:10.136881+0000 mon.smithi008 (mon.0) 80 : cluster [DBG] mgrmap e12: smithi008.flmjzp(active, since 2s) 2023-10-18T20:51:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:11.065328+0000 mon.smithi008 (mon.0) 81 : audit [INF] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:11.435 INFO:teuthology.orchestra.run.smithi008.stderr:Deploying alertmanager service with default placement... 2023-10-18T20:51:11.435 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply alertmanager 2023-10-18T20:51:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.146+0000 7fac298f0700 1 Processor -- start 2023-10-18T20:51:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.146+0000 7fac298f0700 1 -- start start 2023-10-18T20:51:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.146+0000 7fac298f0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac240fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.146+0000 7fac298f0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac240fc2a0 con 0x7fac240fb990 2023-10-18T20:51:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.146+0000 7fac288ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac240fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.147+0000 7fac288ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac240fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36926/0 (socket says 172.21.15.8:36926) 2023-10-18T20:51:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.147+0000 7fac288ee700 1 -- 172.21.15.8:0/2767509850 learned_addr learned my addr 172.21.15.8:0/2767509850 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.147+0000 7fac288ee700 1 -- 172.21.15.8:0/2767509850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240fc3e0 con 0x7fac240fb990 2023-10-18T20:51:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.147+0000 7fac288ee700 1 --2- 172.21.15.8:0/2767509850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac240fbdb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fac1800b5f0 tx=0x7fac18006ee0).ready entity=mon.0 client_cookie=3550fc165a691bfe server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.147+0000 7fac237fe700 1 -- 172.21.15.8:0/2767509850 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac1800d600 con 0x7fac240fb990 2023-10-18T20:51:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.147+0000 7fac237fe700 1 -- 172.21.15.8:0/2767509850 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fac1800dbd0 con 0x7fac240fb990 2023-10-18T20:51:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.147+0000 7fac237fe700 1 -- 172.21.15.8:0/2767509850 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac18011c00 con 0x7fac240fb990 2023-10-18T20:51:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.148+0000 7fac298f0700 1 -- 172.21.15.8:0/2767509850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 msgr2=0x7fac240fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.148+0000 7fac298f0700 1 --2- 172.21.15.8:0/2767509850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac240fbdb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fac1800b5f0 tx=0x7fac18006ee0).stop 2023-10-18T20:51:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.148+0000 7fac298f0700 1 -- 172.21.15.8:0/2767509850 shutdown_connections 2023-10-18T20:51:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.148+0000 7fac298f0700 1 --2- 172.21.15.8:0/2767509850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac240fbdb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.148+0000 7fac298f0700 1 -- 172.21.15.8:0/2767509850 >> 172.21.15.8:0/2767509850 conn(0x7fac240f71d0 msgr2=0x7fac240f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:12.154 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.148+0000 7fac298f0700 1 -- 172.21.15.8:0/2767509850 shutdown_connections 2023-10-18T20:51:12.154 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.148+0000 7fac298f0700 1 -- 172.21.15.8:0/2767509850 wait complete. 2023-10-18T20:51:12.156 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.149+0000 7fac298f0700 1 Processor -- start 2023-10-18T20:51:12.156 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.149+0000 7fac298f0700 1 -- start start 2023-10-18T20:51:12.156 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.150+0000 7fac298f0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac24071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:12.156 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.150+0000 7fac298f0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac240701f0 con 0x7fac240fb990 2023-10-18T20:51:12.157 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.150+0000 7fac288ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac24071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:12.157 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.150+0000 7fac288ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac24071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36938/0 (socket says 172.21.15.8:36938) 2023-10-18T20:51:12.157 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.150+0000 7fac288ee700 1 -- 172.21.15.8:0/2810419519 learned_addr learned my addr 172.21.15.8:0/2810419519 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:12.157 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.150+0000 7fac288ee700 1 -- 172.21.15.8:0/2810419519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1800b200 con 0x7fac240fb990 2023-10-18T20:51:12.158 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.150+0000 7fac288ee700 1 --2- 172.21.15.8:0/2810419519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac24071d70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fac1800e040 tx=0x7fac18006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:12.158 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.151+0000 7fac217fa700 1 -- 172.21.15.8:0/2810419519 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac1801b410 con 0x7fac240fb990 2023-10-18T20:51:12.158 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.151+0000 7fac217fa700 1 -- 172.21.15.8:0/2810419519 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fac1801b9e0 con 0x7fac240fb990 2023-10-18T20:51:12.158 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.151+0000 7fac217fa700 1 -- 172.21.15.8:0/2810419519 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac1801a820 con 0x7fac240fb990 2023-10-18T20:51:12.158 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.151+0000 7fac298f0700 1 -- 172.21.15.8:0/2810419519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac24070390 con 0x7fac240fb990 2023-10-18T20:51:12.159 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.151+0000 7fac298f0700 1 -- 172.21.15.8:0/2810419519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac240707a0 con 0x7fac240fb990 2023-10-18T20:51:12.159 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.152+0000 7fac217fa700 1 -- 172.21.15.8:0/2810419519 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7fac1800f070 con 0x7fac240fb990 2023-10-18T20:51:12.159 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.152+0000 7fac298f0700 1 -- 172.21.15.8:0/2810419519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac24045ad0 con 0x7fac240fb990 2023-10-18T20:51:12.159 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.152+0000 7fac217fa700 1 --2- 172.21.15.8:0/2810419519 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fac0802feb0 0x7fac08032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:12.159 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.152+0000 7fac217fa700 1 -- 172.21.15.8:0/2810419519 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fac18041580 con 0x7fac240fb990 2023-10-18T20:51:12.160 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.153+0000 7fac23fff700 1 --2- 172.21.15.8:0/2810419519 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fac0802feb0 0x7fac08032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:12.160 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.153+0000 7fac23fff700 1 --2- 172.21.15.8:0/2810419519 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fac0802feb0 0x7fac08032370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fac100096a0 tx=0x7fac10006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:12.160 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.157+0000 7fac217fa700 1 -- 172.21.15.8:0/2810419519 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fac1801aea0 con 0x7fac240fb990 2023-10-18T20:51:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:11.062193+0000 mgr.smithi008.flmjzp (mgr.14144) 5 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:51:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:51:11.062887+0000 mgr.smithi008.flmjzp (mgr.14144) 6 : cephadm [INF] Saving service node-exporter spec with placement * 2023-10-18T20:51:12.353 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.351+0000 7fac298f0700 1 -- 172.21.15.8:0/2810419519 --> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fac240fd880 con 0x7fac0802feb0 2023-10-18T20:51:12.357 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.355+0000 7fac217fa700 1 -- 172.21.15.8:0/2810419519 <== mgr.14144 v2:172.21.15.8:6800/2925059353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fac240fd880 con 0x7fac0802feb0 2023-10-18T20:51:12.357 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2023-10-18T20:51:12.360 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.357+0000 7fac298f0700 1 -- 172.21.15.8:0/2810419519 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fac0802feb0 msgr2=0x7fac08032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:12.360 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.357+0000 7fac298f0700 1 --2- 172.21.15.8:0/2810419519 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fac0802feb0 0x7fac08032370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fac100096a0 tx=0x7fac10006b40).stop 2023-10-18T20:51:12.360 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.357+0000 7fac298f0700 1 -- 172.21.15.8:0/2810419519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 msgr2=0x7fac24071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:12.360 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.357+0000 7fac298f0700 1 --2- 172.21.15.8:0/2810419519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac24071d70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fac1800e040 tx=0x7fac18006ee0).stop 2023-10-18T20:51:12.361 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.358+0000 7fac298f0700 1 -- 172.21.15.8:0/2810419519 shutdown_connections 2023-10-18T20:51:12.361 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.358+0000 7fac298f0700 1 --2- 172.21.15.8:0/2810419519 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7fac0802feb0 0x7fac08032370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:12.361 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.358+0000 7fac298f0700 1 --2- 172.21.15.8:0/2810419519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac240fb990 0x7fac24071d70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:12.361 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.358+0000 7fac298f0700 1 -- 172.21.15.8:0/2810419519 >> 172.21.15.8:0/2810419519 conn(0x7fac240f71d0 msgr2=0x7fac240f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:12.361 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.358+0000 7fac298f0700 1 -- 172.21.15.8:0/2810419519 shutdown_connections 2023-10-18T20:51:12.361 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:12.358+0000 7fac298f0700 1 -- 172.21.15.8:0/2810419519 wait complete. 2023-10-18T20:51:12.698 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/cephadm/container_init True --force 2023-10-18T20:51:13.101 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.098+0000 7f1391354700 1 Processor -- start 2023-10-18T20:51:13.102 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.098+0000 7f1391354700 1 -- start start 2023-10-18T20:51:13.102 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.098+0000 7f1391354700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c0fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:13.102 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.098+0000 7f1391354700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0fc2a0 con 0x7f138c0fb990 2023-10-18T20:51:13.102 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.099+0000 7f138bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c0fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:13.103 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.099+0000 7f138bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c0fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36950/0 (socket says 172.21.15.8:36950) 2023-10-18T20:51:13.103 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.099+0000 7f138bfff700 1 -- 172.21.15.8:0/375789228 learned_addr learned my addr 172.21.15.8:0/375789228 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:13.103 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.099+0000 7f138bfff700 1 -- 172.21.15.8:0/375789228 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0fc3e0 con 0x7f138c0fb990 2023-10-18T20:51:13.103 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.099+0000 7f138bfff700 1 --2- 172.21.15.8:0/375789228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c0fbdb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f137c00b5f0 tx=0x7f137c006ee0).ready entity=mon.0 client_cookie=741bd58cce54a11a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:13.103 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.100+0000 7f138affd700 1 -- 172.21.15.8:0/375789228 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f137c00d600 con 0x7f138c0fb990 2023-10-18T20:51:13.104 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.100+0000 7f138affd700 1 -- 172.21.15.8:0/375789228 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f137c00dbd0 con 0x7f138c0fb990 2023-10-18T20:51:13.104 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.100+0000 7f138affd700 1 -- 172.21.15.8:0/375789228 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f137c011c00 con 0x7f138c0fb990 2023-10-18T20:51:13.106 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.100+0000 7f1391354700 1 -- 172.21.15.8:0/375789228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 msgr2=0x7f138c0fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:13.107 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.100+0000 7f1391354700 1 --2- 172.21.15.8:0/375789228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c0fbdb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f137c00b5f0 tx=0x7f137c006ee0).stop 2023-10-18T20:51:13.107 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.100+0000 7f1391354700 1 -- 172.21.15.8:0/375789228 shutdown_connections 2023-10-18T20:51:13.107 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.100+0000 7f1391354700 1 --2- 172.21.15.8:0/375789228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c0fbdb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:13.107 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.100+0000 7f1391354700 1 -- 172.21.15.8:0/375789228 >> 172.21.15.8:0/375789228 conn(0x7f138c0f71d0 msgr2=0x7f138c0f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:13.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.100+0000 7f1391354700 1 -- 172.21.15.8:0/375789228 shutdown_connections 2023-10-18T20:51:13.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.101+0000 7f1391354700 1 -- 172.21.15.8:0/375789228 wait complete. 2023-10-18T20:51:13.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.101+0000 7f1391354700 1 Processor -- start 2023-10-18T20:51:13.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.102+0000 7f1391354700 1 -- start start 2023-10-18T20:51:13.108 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.102+0000 7f1391354700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:13.109 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.102+0000 7f1391354700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0701f0 con 0x7f138c0fb990 2023-10-18T20:51:13.109 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.102+0000 7f138bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:13.109 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.102+0000 7f138bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36952/0 (socket says 172.21.15.8:36952) 2023-10-18T20:51:13.109 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.102+0000 7f138bfff700 1 -- 172.21.15.8:0/358051815 learned_addr learned my addr 172.21.15.8:0/358051815 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:13.109 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.103+0000 7f138bfff700 1 -- 172.21.15.8:0/358051815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c00b200 con 0x7f138c0fb990 2023-10-18T20:51:13.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.103+0000 7f138bfff700 1 --2- 172.21.15.8:0/358051815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c071d70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f137c00b1d0 tx=0x7f137c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:13.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.103+0000 7f1388ff9700 1 -- 172.21.15.8:0/358051815 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f137c01b410 con 0x7f138c0fb990 2023-10-18T20:51:13.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.103+0000 7f1388ff9700 1 -- 172.21.15.8:0/358051815 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f137c01b9e0 con 0x7f138c0fb990 2023-10-18T20:51:13.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.103+0000 7f1391354700 1 -- 172.21.15.8:0/358051815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c070390 con 0x7f138c0fb990 2023-10-18T20:51:13.110 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.103+0000 7f1388ff9700 1 -- 172.21.15.8:0/358051815 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f137c01a840 con 0x7f138c0fb990 2023-10-18T20:51:13.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.103+0000 7f1391354700 1 -- 172.21.15.8:0/358051815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c0707a0 con 0x7f138c0fb990 2023-10-18T20:51:13.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.104+0000 7f1388ff9700 1 -- 172.21.15.8:0/358051815 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f137c00f070 con 0x7f138c0fb990 2023-10-18T20:51:13.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.105+0000 7f1391354700 1 -- 172.21.15.8:0/358051815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c045ad0 con 0x7f138c0fb990 2023-10-18T20:51:13.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.105+0000 7f1388ff9700 1 --2- 172.21.15.8:0/358051815 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f137802fe60 0x7f1378032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:13.111 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.105+0000 7f1388ff9700 1 -- 172.21.15.8:0/358051815 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f137c0414f0 con 0x7f138c0fb990 2023-10-18T20:51:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.105+0000 7f138b7fe700 1 --2- 172.21.15.8:0/358051815 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f137802fe60 0x7f1378032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.105+0000 7f138b7fe700 1 --2- 172.21.15.8:0/358051815 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f137802fe60 0x7f1378032320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f13800096a0 tx=0x7f1380006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.109+0000 7f1388ff9700 1 -- 172.21.15.8:0/358051815 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f137c019950 con 0x7f138c0fb990 2023-10-18T20:51:13.276 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.274+0000 7f1391354700 1 -- 172.21.15.8:0/358051815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f138c0fd810 con 0x7f138c0fb990 2023-10-18T20:51:13.279 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.277+0000 7f1388ff9700 1 -- 172.21.15.8:0/358051815 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v8)=0 v8) v1 ==== 142+0+0 (secure 0 0 0) 0x7f137c016030 con 0x7f138c0fb990 2023-10-18T20:51:13.281 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.279+0000 7f1391354700 1 -- 172.21.15.8:0/358051815 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f137802fe60 msgr2=0x7f1378032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:13.281 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.279+0000 7f1391354700 1 --2- 172.21.15.8:0/358051815 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f137802fe60 0x7f1378032320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f13800096a0 tx=0x7f1380006b40).stop 2023-10-18T20:51:13.282 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.279+0000 7f1391354700 1 -- 172.21.15.8:0/358051815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 msgr2=0x7f138c071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:13.282 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.279+0000 7f1391354700 1 --2- 172.21.15.8:0/358051815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c071d70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f137c00b1d0 tx=0x7f137c006ee0).stop 2023-10-18T20:51:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.279+0000 7f1391354700 1 -- 172.21.15.8:0/358051815 shutdown_connections 2023-10-18T20:51:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.279+0000 7f1391354700 1 --2- 172.21.15.8:0/358051815 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f137802fe60 0x7f1378032320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.279+0000 7f1391354700 1 --2- 172.21.15.8:0/358051815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0fb990 0x7f138c071d70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:13.283 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.279+0000 7f1391354700 1 -- 172.21.15.8:0/358051815 >> 172.21.15.8:0/358051815 conn(0x7f138c0f71d0 msgr2=0x7f138c0f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:13.284 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.280+0000 7f1391354700 1 -- 172.21.15.8:0/358051815 shutdown_connections 2023-10-18T20:51:13.284 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:13.280+0000 7f1391354700 1 -- 172.21.15.8:0/358051815 wait complete. 2023-10-18T20:51:13.626 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/dashboard/ssl_server_port 8443 2023-10-18T20:51:13.629 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:12.352963+0000 mgr.smithi008.flmjzp (mgr.14144) 7 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:51:13.629 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:51:12.353511+0000 mgr.smithi008.flmjzp (mgr.14144) 8 : cephadm [INF] Saving service alertmanager spec with placement count:1 2023-10-18T20:51:13.629 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:12.356002+0000 mon.smithi008 (mon.0) 82 : audit [INF] from='mgr.14144 172.21.15.8:0/3661510731' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:13.629 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:13.277641+0000 mon.smithi008 (mon.0) 83 : audit [INF] from='client.? 172.21.15.8:0/358051815' entity='client.admin' 2023-10-18T20:51:14.049 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.046+0000 7f90af59e700 1 Processor -- start 2023-10-18T20:51:14.049 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.047+0000 7f90af59e700 1 -- start start 2023-10-18T20:51:14.051 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.047+0000 7f90af59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b00fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:14.051 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.047+0000 7f90af59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00feb40 con 0x7f90b006fc30 2023-10-18T20:51:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.047+0000 7f90ae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b00fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.047+0000 7f90ae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b00fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36958/0 (socket says 172.21.15.8:36958) 2023-10-18T20:51:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.047+0000 7f90ae59c700 1 -- 172.21.15.8:0/486334778 learned_addr learned my addr 172.21.15.8:0/486334778 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.048+0000 7f90ae59c700 1 -- 172.21.15.8:0/486334778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b00fec80 con 0x7f90b006fc30 2023-10-18T20:51:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.048+0000 7f90ae59c700 1 --2- 172.21.15.8:0/486334778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b00fe650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f90a000b5f0 tx=0x7f90a0006ee0).ready entity=mon.0 client_cookie=bddd3ea99907eb16 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.048+0000 7f90ad59a700 1 -- 172.21.15.8:0/486334778 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90a000d600 con 0x7f90b006fc30 2023-10-18T20:51:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.048+0000 7f90ad59a700 1 -- 172.21.15.8:0/486334778 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f90a000dbd0 con 0x7f90b006fc30 2023-10-18T20:51:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.048+0000 7f90ad59a700 1 -- 172.21.15.8:0/486334778 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90a0011c00 con 0x7f90b006fc30 2023-10-18T20:51:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.049+0000 7f90af59e700 1 -- 172.21.15.8:0/486334778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 msgr2=0x7f90b00fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.049+0000 7f90af59e700 1 --2- 172.21.15.8:0/486334778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b00fe650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f90a000b5f0 tx=0x7f90a0006ee0).stop 2023-10-18T20:51:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.049+0000 7f90af59e700 1 -- 172.21.15.8:0/486334778 shutdown_connections 2023-10-18T20:51:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.049+0000 7f90af59e700 1 --2- 172.21.15.8:0/486334778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b00fe650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.049+0000 7f90af59e700 1 -- 172.21.15.8:0/486334778 >> 172.21.15.8:0/486334778 conn(0x7f90b00f6130 msgr2=0x7f90b00f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.049+0000 7f90af59e700 1 -- 172.21.15.8:0/486334778 shutdown_connections 2023-10-18T20:51:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.049+0000 7f90af59e700 1 -- 172.21.15.8:0/486334778 wait complete. 2023-10-18T20:51:14.057 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.050+0000 7f90af59e700 1 Processor -- start 2023-10-18T20:51:14.057 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.050+0000 7f90af59e700 1 -- start start 2023-10-18T20:51:14.057 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.050+0000 7f90af59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b01085d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:14.057 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.050+0000 7f90af59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b0108ac0 con 0x7f90b006fc30 2023-10-18T20:51:14.058 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.050+0000 7f90ae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b01085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:14.058 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.050+0000 7f90ae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b01085d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36964/0 (socket says 172.21.15.8:36964) 2023-10-18T20:51:14.058 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.050+0000 7f90ae59c700 1 -- 172.21.15.8:0/196941491 learned_addr learned my addr 172.21.15.8:0/196941491 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:14.058 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.051+0000 7f90ae59c700 1 -- 172.21.15.8:0/196941491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a000b200 con 0x7f90b006fc30 2023-10-18T20:51:14.058 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.051+0000 7f90ae59c700 1 --2- 172.21.15.8:0/196941491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b01085d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f90a000e040 tx=0x7f90a0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:14.059 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.051+0000 7f909effd700 1 -- 172.21.15.8:0/196941491 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90a000d9f0 con 0x7f90b006fc30 2023-10-18T20:51:14.059 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.051+0000 7f909effd700 1 -- 172.21.15.8:0/196941491 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f90a001a9f0 con 0x7f90b006fc30 2023-10-18T20:51:14.059 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.051+0000 7f90af59e700 1 -- 172.21.15.8:0/196941491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b0108cc0 con 0x7f90b006fc30 2023-10-18T20:51:14.059 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.051+0000 7f909effd700 1 -- 172.21.15.8:0/196941491 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90a001b8c0 con 0x7f90b006fc30 2023-10-18T20:51:14.059 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.051+0000 7f90af59e700 1 -- 172.21.15.8:0/196941491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b01090d0 con 0x7f90b006fc30 2023-10-18T20:51:14.060 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.052+0000 7f90af59e700 1 -- 172.21.15.8:0/196941491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b0045ad0 con 0x7f90b006fc30 2023-10-18T20:51:14.060 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.052+0000 7f909effd700 1 -- 172.21.15.8:0/196941491 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f90a000f070 con 0x7f90b006fc30 2023-10-18T20:51:14.060 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.053+0000 7f909effd700 1 --2- 172.21.15.8:0/196941491 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f9094034300 0x7f90940367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:14.060 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.053+0000 7f909effd700 1 -- 172.21.15.8:0/196941491 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f90a0041460 con 0x7f90b006fc30 2023-10-18T20:51:14.060 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.053+0000 7f90add9b700 1 --2- 172.21.15.8:0/196941491 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f9094034300 0x7f90940367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:14.061 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.054+0000 7f90add9b700 1 --2- 172.21.15.8:0/196941491 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f9094034300 0x7f90940367c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f90a40096a0 tx=0x7f90a4006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:14.061 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.057+0000 7f909effd700 1 -- 172.21.15.8:0/196941491 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f90a0019d70 con 0x7f90b006fc30 2023-10-18T20:51:14.225 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.223+0000 7f90af59e700 1 -- 172.21.15.8:0/196941491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f90b00faf10 con 0x7f90b006fc30 2023-10-18T20:51:14.227 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.226+0000 7f909effd700 1 -- 172.21.15.8:0/196941491 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v9)=0 v9) v1 ==== 130+0+0 (secure 0 0 0) 0x7f90a0016030 con 0x7f90b006fc30 2023-10-18T20:51:14.230 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.228+0000 7f90af59e700 1 -- 172.21.15.8:0/196941491 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f9094034300 msgr2=0x7f90940367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:14.230 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.228+0000 7f90af59e700 1 --2- 172.21.15.8:0/196941491 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f9094034300 0x7f90940367c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f90a40096a0 tx=0x7f90a4006b40).stop 2023-10-18T20:51:14.230 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.228+0000 7f90af59e700 1 -- 172.21.15.8:0/196941491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 msgr2=0x7f90b01085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:14.231 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.228+0000 7f90af59e700 1 --2- 172.21.15.8:0/196941491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b01085d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f90a000e040 tx=0x7f90a0006ee0).stop 2023-10-18T20:51:14.231 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.228+0000 7f90af59e700 1 -- 172.21.15.8:0/196941491 shutdown_connections 2023-10-18T20:51:14.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.228+0000 7f90af59e700 1 --2- 172.21.15.8:0/196941491 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f9094034300 0x7f90940367c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:14.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.228+0000 7f90af59e700 1 --2- 172.21.15.8:0/196941491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90b006fc30 0x7f90b01085d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:14.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.228+0000 7f90af59e700 1 -- 172.21.15.8:0/196941491 >> 172.21.15.8:0/196941491 conn(0x7f90b00f6130 msgr2=0x7f90b00fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:14.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.228+0000 7f90af59e700 1 -- 172.21.15.8:0/196941491 shutdown_connections 2023-10-18T20:51:14.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.228+0000 7f90af59e700 1 -- 172.21.15.8:0/196941491 wait complete. 2023-10-18T20:51:14.569 INFO:teuthology.orchestra.run.smithi008.stderr:Enabling the dashboard module... 2023-10-18T20:51:14.569 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable dashboard 2023-10-18T20:51:14.990 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.987+0000 7f1c82097700 1 Processor -- start 2023-10-18T20:51:14.990 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.987+0000 7f1c82097700 1 -- start start 2023-10-18T20:51:14.990 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.988+0000 7f1c82097700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c0fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:14.992 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.988+0000 7f1c82097700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0feb40 con 0x7f1c7c06fc30 2023-10-18T20:51:14.992 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.988+0000 7f1c81095700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c0fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:14.993 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.988+0000 7f1c81095700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c0fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36980/0 (socket says 172.21.15.8:36980) 2023-10-18T20:51:14.993 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.988+0000 7f1c81095700 1 -- 172.21.15.8:0/111540043 learned_addr learned my addr 172.21.15.8:0/111540043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:14.993 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.988+0000 7f1c81095700 1 -- 172.21.15.8:0/111540043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0fec80 con 0x7f1c7c06fc30 2023-10-18T20:51:14.993 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.989+0000 7f1c81095700 1 --2- 172.21.15.8:0/111540043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c0fe650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1c7800b5f0 tx=0x7f1c78006ee0).ready entity=mon.0 client_cookie=20063f34f426c6d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:14.993 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.989+0000 7f1c6bfff700 1 -- 172.21.15.8:0/111540043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c7800d600 con 0x7f1c7c06fc30 2023-10-18T20:51:14.994 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.989+0000 7f1c6bfff700 1 -- 172.21.15.8:0/111540043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f1c7800dbd0 con 0x7f1c7c06fc30 2023-10-18T20:51:14.994 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.989+0000 7f1c6bfff700 1 -- 172.21.15.8:0/111540043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c78011c00 con 0x7f1c7c06fc30 2023-10-18T20:51:14.994 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.990+0000 7f1c82097700 1 -- 172.21.15.8:0/111540043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 msgr2=0x7f1c7c0fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:14.994 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.990+0000 7f1c82097700 1 --2- 172.21.15.8:0/111540043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c0fe650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1c7800b5f0 tx=0x7f1c78006ee0).stop 2023-10-18T20:51:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.990+0000 7f1c82097700 1 -- 172.21.15.8:0/111540043 shutdown_connections 2023-10-18T20:51:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.990+0000 7f1c82097700 1 --2- 172.21.15.8:0/111540043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c0fe650 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.990+0000 7f1c82097700 1 -- 172.21.15.8:0/111540043 >> 172.21.15.8:0/111540043 conn(0x7f1c7c0f6130 msgr2=0x7f1c7c0f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.990+0000 7f1c82097700 1 -- 172.21.15.8:0/111540043 shutdown_connections 2023-10-18T20:51:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.990+0000 7f1c82097700 1 -- 172.21.15.8:0/111540043 wait complete. 2023-10-18T20:51:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.991+0000 7f1c82097700 1 Processor -- start 2023-10-18T20:51:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.991+0000 7f1c82097700 1 -- start start 2023-10-18T20:51:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.991+0000 7f1c82097700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c10a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.991+0000 7f1c82097700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c10acd0 con 0x7f1c7c06fc30 2023-10-18T20:51:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.992+0000 7f1c81095700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c10a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.992+0000 7f1c81095700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c10a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36988/0 (socket says 172.21.15.8:36988) 2023-10-18T20:51:14.999 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.992+0000 7f1c81095700 1 -- 172.21.15.8:0/2386290793 learned_addr learned my addr 172.21.15.8:0/2386290793 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:15.000 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.992+0000 7f1c81095700 1 -- 172.21.15.8:0/2386290793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7800b200 con 0x7f1c7c06fc30 2023-10-18T20:51:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.992+0000 7f1c81095700 1 --2- 172.21.15.8:0/2386290793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c10a7e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1c7800e040 tx=0x7f1c78006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.992+0000 7f1c69ffb700 1 -- 172.21.15.8:0/2386290793 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c7800d9f0 con 0x7f1c7c06fc30 2023-10-18T20:51:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.992+0000 7f1c69ffb700 1 -- 172.21.15.8:0/2386290793 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f1c7801a9f0 con 0x7f1c7c06fc30 2023-10-18T20:51:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.992+0000 7f1c69ffb700 1 -- 172.21.15.8:0/2386290793 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c7801b8c0 con 0x7f1c7c06fc30 2023-10-18T20:51:15.002 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.992+0000 7f1c82097700 1 -- 172.21.15.8:0/2386290793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c10aed0 con 0x7f1c7c06fc30 2023-10-18T20:51:15.002 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.993+0000 7f1c82097700 1 -- 172.21.15.8:0/2386290793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c10b2e0 con 0x7f1c7c06fc30 2023-10-18T20:51:15.002 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.994+0000 7f1c69ffb700 1 -- 172.21.15.8:0/2386290793 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f1c7800f070 con 0x7f1c7c06fc30 2023-10-18T20:51:15.002 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.994+0000 7f1c82097700 1 -- 172.21.15.8:0/2386290793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c045ad0 con 0x7f1c7c06fc30 2023-10-18T20:51:15.002 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.994+0000 7f1c69ffb700 1 --2- 172.21.15.8:0/2386290793 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f1c6402feb0 0x7f1c64032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:15.003 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.994+0000 7f1c69ffb700 1 -- 172.21.15.8:0/2386290793 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f1c780414c0 con 0x7f1c7c06fc30 2023-10-18T20:51:15.003 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.994+0000 7f1c80894700 1 --2- 172.21.15.8:0/2386290793 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f1c6402feb0 0x7f1c64032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:15.003 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.995+0000 7f1c80894700 1 --2- 172.21.15.8:0/2386290793 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f1c6402feb0 0x7f1c64032370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f1c6c0096a0 tx=0x7f1c6c006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:15.004 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:14.998+0000 7f1c69ffb700 1 -- 172.21.15.8:0/2386290793 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1c78006a70 con 0x7f1c7c06fc30 2023-10-18T20:51:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.207+0000 7f1c82097700 1 -- 172.21.15.8:0/2386290793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f1c7c0ff8f0 con 0x7f1c7c06fc30 2023-10-18T20:51:15.228 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.226+0000 7f1c69ffb700 1 -- 172.21.15.8:0/2386290793 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f1c7801a6c0 con 0x7f1c7c06fc30 2023-10-18T20:51:15.229 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.227+0000 7f1c69ffb700 1 -- 172.21.15.8:0/2386290793 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v13) v1 ==== 88+0+0 (secure 0 0 0) 0x7f1c78005d50 con 0x7f1c7c06fc30 2023-10-18T20:51:15.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.230+0000 7f1c82097700 1 -- 172.21.15.8:0/2386290793 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f1c6402feb0 msgr2=0x7f1c64032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:15.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.230+0000 7f1c82097700 1 --2- 172.21.15.8:0/2386290793 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f1c6402feb0 0x7f1c64032370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f1c6c0096a0 tx=0x7f1c6c006b40).stop 2023-10-18T20:51:15.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.230+0000 7f1c82097700 1 -- 172.21.15.8:0/2386290793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 msgr2=0x7f1c7c10a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:15.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.230+0000 7f1c82097700 1 --2- 172.21.15.8:0/2386290793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c10a7e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1c7800e040 tx=0x7f1c78006ee0).stop 2023-10-18T20:51:15.233 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.230+0000 7f1c82097700 1 -- 172.21.15.8:0/2386290793 shutdown_connections 2023-10-18T20:51:15.233 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.230+0000 7f1c82097700 1 --2- 172.21.15.8:0/2386290793 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f1c6402feb0 0x7f1c64032370 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:15.234 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.230+0000 7f1c82097700 1 --2- 172.21.15.8:0/2386290793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c7c06fc30 0x7f1c7c10a7e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:15.234 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.230+0000 7f1c82097700 1 -- 172.21.15.8:0/2386290793 >> 172.21.15.8:0/2386290793 conn(0x7f1c7c0f6130 msgr2=0x7f1c7c0f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:15.234 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.230+0000 7f1c82097700 1 -- 172.21.15.8:0/2386290793 shutdown_connections 2023-10-18T20:51:15.234 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:15.230+0000 7f1c82097700 1 -- 172.21.15.8:0/2386290793 wait complete. 2023-10-18T20:51:15.648 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2023-10-18T20:51:15.655 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:14.226527+0000 mon.smithi008 (mon.0) 84 : audit [INF] from='client.? 172.21.15.8:0/196941491' entity='client.admin' 2023-10-18T20:51:15.656 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:15.207905+0000 mon.smithi008 (mon.0) 85 : audit [INF] from='client.? 172.21.15.8:0/2386290793' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-18T20:51:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.224+0000 7efccd31b700 1 Processor -- start 2023-10-18T20:51:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.224+0000 7efccd31b700 1 -- start start 2023-10-18T20:51:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.224+0000 7efccd31b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc8100a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.224+0000 7efccd31b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc80fc440 con 0x7efcc806fc30 2023-10-18T20:51:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.225+0000 7efcc7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc8100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:16.230 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.225+0000 7efcc7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc8100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37002/0 (socket says 172.21.15.8:37002) 2023-10-18T20:51:16.230 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.225+0000 7efcc7fff700 1 -- 172.21.15.8:0/1247598298 learned_addr learned my addr 172.21.15.8:0/1247598298 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:16.230 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.225+0000 7efcc7fff700 1 -- 172.21.15.8:0/1247598298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8100f40 con 0x7efcc806fc30 2023-10-18T20:51:16.231 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.225+0000 7efcc7fff700 1 --2- 172.21.15.8:0/1247598298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc8100a50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7efcb800b5f0 tx=0x7efcb8006ee0).ready entity=mon.0 client_cookie=b62b37e0c6191217 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:16.231 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.226+0000 7efcc6ffd700 1 -- 172.21.15.8:0/1247598298 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcb800d600 con 0x7efcc806fc30 2023-10-18T20:51:16.231 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.226+0000 7efcc6ffd700 1 -- 172.21.15.8:0/1247598298 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7efcb800dbd0 con 0x7efcc806fc30 2023-10-18T20:51:16.231 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.226+0000 7efcc6ffd700 1 -- 172.21.15.8:0/1247598298 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcb8011c00 con 0x7efcc806fc30 2023-10-18T20:51:16.231 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.226+0000 7efccd31b700 1 -- 172.21.15.8:0/1247598298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 msgr2=0x7efcc8100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:16.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.226+0000 7efccd31b700 1 --2- 172.21.15.8:0/1247598298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc8100a50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7efcb800b5f0 tx=0x7efcb8006ee0).stop 2023-10-18T20:51:16.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.226+0000 7efccd31b700 1 -- 172.21.15.8:0/1247598298 shutdown_connections 2023-10-18T20:51:16.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.226+0000 7efccd31b700 1 --2- 172.21.15.8:0/1247598298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc8100a50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:16.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.226+0000 7efccd31b700 1 -- 172.21.15.8:0/1247598298 >> 172.21.15.8:0/1247598298 conn(0x7efcc80f6130 msgr2=0x7efcc80f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:16.232 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.227+0000 7efccd31b700 1 -- 172.21.15.8:0/1247598298 shutdown_connections 2023-10-18T20:51:16.233 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.227+0000 7efccd31b700 1 -- 172.21.15.8:0/1247598298 wait complete. 2023-10-18T20:51:16.233 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.228+0000 7efccd31b700 1 Processor -- start 2023-10-18T20:51:16.233 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.228+0000 7efccd31b700 1 -- start start 2023-10-18T20:51:16.234 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.229+0000 7efccd31b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc810c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:16.234 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.229+0000 7efccd31b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc810cec0 con 0x7efcc806fc30 2023-10-18T20:51:16.235 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.229+0000 7efcc7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc810c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:16.235 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.229+0000 7efcc7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc810c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37014/0 (socket says 172.21.15.8:37014) 2023-10-18T20:51:16.235 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.229+0000 7efcc7fff700 1 -- 172.21.15.8:0/2426263930 learned_addr learned my addr 172.21.15.8:0/2426263930 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:16.235 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.229+0000 7efcc7fff700 1 -- 172.21.15.8:0/2426263930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb800b200 con 0x7efcc806fc30 2023-10-18T20:51:16.236 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.230+0000 7efcc7fff700 1 --2- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc810c9d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efcb800e040 tx=0x7efcb8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:16.236 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.232+0000 7efcc4ff9700 1 -- 172.21.15.8:0/2426263930 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcb800d9f0 con 0x7efcc806fc30 2023-10-18T20:51:16.236 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.232+0000 7efcc4ff9700 1 -- 172.21.15.8:0/2426263930 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7efcb801a9f0 con 0x7efcc806fc30 2023-10-18T20:51:16.236 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.232+0000 7efccd31b700 1 -- 172.21.15.8:0/2426263930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc810d0c0 con 0x7efcc806fc30 2023-10-18T20:51:16.236 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.232+0000 7efcc4ff9700 1 -- 172.21.15.8:0/2426263930 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcb801b8c0 con 0x7efcc806fc30 2023-10-18T20:51:16.236 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.232+0000 7efccd31b700 1 -- 172.21.15.8:0/2426263930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc810d4d0 con 0x7efcc806fc30 2023-10-18T20:51:16.237 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.233+0000 7efccd31b700 1 -- 172.21.15.8:0/2426263930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc8045ad0 con 0x7efcc806fc30 2023-10-18T20:51:16.238 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.233+0000 7efcc4ff9700 1 -- 172.21.15.8:0/2426263930 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7efcb800f070 con 0x7efcc806fc30 2023-10-18T20:51:16.238 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.234+0000 7efcc4ff9700 1 --2- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7efcb402ff00 0x7efcb40323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:16.238 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.234+0000 7efcc4ff9700 1 -- 172.21.15.8:0/2426263930 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7efcb80414e0 con 0x7efcc806fc30 2023-10-18T20:51:16.238 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.234+0000 7efcc77fe700 1 -- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7efcb402ff00 msgr2=0x7efcb40323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2925059353 2023-10-18T20:51:16.239 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.234+0000 7efcc77fe700 1 --2- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7efcb402ff00 0x7efcb40323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T20:51:16.240 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.238+0000 7efcc4ff9700 1 -- 172.21.15.8:0/2426263930 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7efcb80224f0 con 0x7efcc806fc30 2023-10-18T20:51:16.437 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.435+0000 7efcc77fe700 1 -- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7efcb402ff00 msgr2=0x7efcb40323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2925059353 2023-10-18T20:51:16.437 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.435+0000 7efcc77fe700 1 --2- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7efcb402ff00 0x7efcb40323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T20:51:16.471 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.468+0000 7efccd31b700 1 -- 172.21.15.8:0/2426263930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7efcc810e5e0 con 0x7efcc806fc30 2023-10-18T20:51:16.471 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.469+0000 7efcc4ff9700 1 -- 172.21.15.8:0/2426263930 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v13) v1 ==== 56+0+104 (secure 0 0 0) 0x7efcb8006a70 con 0x7efcc806fc30 2023-10-18T20:51:16.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: { 2023-10-18T20:51:16.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "epoch": 13, 2023-10-18T20:51:16.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "available": true, 2023-10-18T20:51:16.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "active_name": "smithi008.flmjzp", 2023-10-18T20:51:16.472 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "num_standby": 0 2023-10-18T20:51:16.473 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: } 2023-10-18T20:51:16.474 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.471+0000 7efccd31b700 1 -- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7efcb402ff00 msgr2=0x7efcb40323c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:51:16.474 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.471+0000 7efccd31b700 1 --2- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7efcb402ff00 0x7efcb40323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:51:16.474 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.471+0000 7efccd31b700 1 -- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 msgr2=0x7efcc810c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:16.475 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.471+0000 7efccd31b700 1 --2- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc810c9d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efcb800e040 tx=0x7efcb8006ee0).stop 2023-10-18T20:51:16.475 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.471+0000 7efccd31b700 1 -- 172.21.15.8:0/2426263930 shutdown_connections 2023-10-18T20:51:16.475 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.471+0000 7efccd31b700 1 --2- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7efcb402ff00 0x7efcb40323c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:51:16.475 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.471+0000 7efccd31b700 1 --2- 172.21.15.8:0/2426263930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcc806fc30 0x7efcc810c9d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:16.476 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.471+0000 7efccd31b700 1 -- 172.21.15.8:0/2426263930 >> 172.21.15.8:0/2426263930 conn(0x7efcc80f6130 msgr2=0x7efcc80f7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:16.476 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.471+0000 7efccd31b700 1 -- 172.21.15.8:0/2426263930 shutdown_connections 2023-10-18T20:51:16.476 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:16.471+0000 7efccd31b700 1 -- 172.21.15.8:0/2426263930 wait complete. 2023-10-18T20:51:16.490 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:15.228212+0000 mon.smithi008 (mon.0) 86 : audit [INF] from='client.? 172.21.15.8:0/2386290793' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-18T20:51:16.490 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:15.228314+0000 mon.smithi008 (mon.0) 87 : cluster [DBG] mgrmap e13: smithi008.flmjzp(active, since 7s) 2023-10-18T20:51:16.919 INFO:teuthology.orchestra.run.smithi008.stderr:Waiting for the mgr to restart... 2023-10-18T20:51:16.919 INFO:teuthology.orchestra.run.smithi008.stderr:Waiting for mgr epoch 13... 2023-10-18T20:51:16.919 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2023-10-18T20:51:17.360 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.357+0000 7f5dede7d700 1 Processor -- start 2023-10-18T20:51:17.361 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.357+0000 7f5dede7d700 1 -- start start 2023-10-18T20:51:17.361 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.358+0000 7f5dede7d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:17.361 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.358+0000 7f5dede7d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80feb40 con 0x7f5de806fc30 2023-10-18T20:51:17.361 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.358+0000 7f5dece7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.358+0000 7f5dece7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40594/0 (socket says 172.21.15.8:40594) 2023-10-18T20:51:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.358+0000 7f5dece7b700 1 -- 172.21.15.8:0/3313488584 learned_addr learned my addr 172.21.15.8:0/3313488584 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.359+0000 7f5dece7b700 1 -- 172.21.15.8:0/3313488584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de80fec80 con 0x7f5de806fc30 2023-10-18T20:51:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.359+0000 7f5dece7b700 1 --2- 172.21.15.8:0/3313488584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fe650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5ddc00b5f0 tx=0x7f5ddc006ee0).ready entity=mon.0 client_cookie=c3b75f16e8ad593f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.359+0000 7f5de77fe700 1 -- 172.21.15.8:0/3313488584 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ddc00d600 con 0x7f5de806fc30 2023-10-18T20:51:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.359+0000 7f5de77fe700 1 -- 172.21.15.8:0/3313488584 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f5ddc00dbd0 con 0x7f5de806fc30 2023-10-18T20:51:17.365 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.359+0000 7f5de77fe700 1 -- 172.21.15.8:0/3313488584 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ddc011c00 con 0x7f5de806fc30 2023-10-18T20:51:17.365 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.360+0000 7f5dede7d700 1 -- 172.21.15.8:0/3313488584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 msgr2=0x7f5de80fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:17.365 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.360+0000 7f5dede7d700 1 --2- 172.21.15.8:0/3313488584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fe650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5ddc00b5f0 tx=0x7f5ddc006ee0).stop 2023-10-18T20:51:17.365 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.360+0000 7f5dede7d700 1 -- 172.21.15.8:0/3313488584 shutdown_connections 2023-10-18T20:51:17.365 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.360+0000 7f5dede7d700 1 --2- 172.21.15.8:0/3313488584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fe650 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.360+0000 7f5dede7d700 1 -- 172.21.15.8:0/3313488584 >> 172.21.15.8:0/3313488584 conn(0x7f5de80f6130 msgr2=0x7f5de80f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.360+0000 7f5dede7d700 1 -- 172.21.15.8:0/3313488584 shutdown_connections 2023-10-18T20:51:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.360+0000 7f5dede7d700 1 -- 172.21.15.8:0/3313488584 wait complete. 2023-10-18T20:51:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.361+0000 7f5dede7d700 1 Processor -- start 2023-10-18T20:51:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.362+0000 7f5dede7d700 1 -- start start 2023-10-18T20:51:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.362+0000 7f5dede7d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.362+0000 7f5dede7d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80fa550 con 0x7f5de806fc30 2023-10-18T20:51:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.362+0000 7f5dece7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.362+0000 7f5dece7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40606/0 (socket says 172.21.15.8:40606) 2023-10-18T20:51:17.369 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.362+0000 7f5dece7b700 1 -- 172.21.15.8:0/3798478932 learned_addr learned my addr 172.21.15.8:0/3798478932 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:17.369 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.363+0000 7f5dece7b700 1 -- 172.21.15.8:0/3798478932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc00b200 con 0x7f5de806fc30 2023-10-18T20:51:17.369 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.363+0000 7f5dece7b700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fc0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5ddc00b190 tx=0x7f5ddc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:17.370 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.363+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ddc01b410 con 0x7f5de806fc30 2023-10-18T20:51:17.370 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.363+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f5ddc01b9e0 con 0x7f5de806fc30 2023-10-18T20:51:17.370 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.363+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ddc01a880 con 0x7f5de806fc30 2023-10-18T20:51:17.370 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.363+0000 7f5dede7d700 1 -- 172.21.15.8:0/3798478932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de80fa6f0 con 0x7f5de806fc30 2023-10-18T20:51:17.370 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.364+0000 7f5dede7d700 1 -- 172.21.15.8:0/3798478932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de80fab00 con 0x7f5de806fc30 2023-10-18T20:51:17.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.365+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f5ddc00f070 con 0x7f5de806fc30 2023-10-18T20:51:17.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.365+0000 7f5de57fa700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 0x7f5dcc032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:17.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.365+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 --> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5dcc032a30 con 0x7f5dcc02feb0 2023-10-18T20:51:17.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.365+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f5ddc041460 con 0x7f5de806fc30 2023-10-18T20:51:17.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.365+0000 7f5de7fff700 1 -- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 msgr2=0x7f5dcc032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2925059353 2023-10-18T20:51:17.372 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.365+0000 7f5de7fff700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 0x7f5dcc032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T20:51:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:16.469743+0000 mon.smithi008 (mon.0) 88 : audit [DBG] from='client.? 172.21.15.8:0/2426263930' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-18T20:51:17.568 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.566+0000 7f5de7fff700 1 -- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 msgr2=0x7f5dcc032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2925059353 2023-10-18T20:51:17.568 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.566+0000 7f5de7fff700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 0x7f5dcc032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-18T20:51:17.969 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.967+0000 7f5de7fff700 1 -- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 msgr2=0x7f5dcc032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2925059353 2023-10-18T20:51:17.969 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:17.967+0000 7f5de7fff700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 0x7f5dcc032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-18T20:51:18.770 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:18.768+0000 7f5de7fff700 1 -- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 msgr2=0x7f5dcc032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2925059353 2023-10-18T20:51:18.770 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:18.768+0000 7f5de7fff700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 0x7f5dcc032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-18T20:51:20.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:20.369+0000 7f5de7fff700 1 -- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 msgr2=0x7f5dcc032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2925059353 2023-10-18T20:51:20.371 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:20.369+0000 7f5de7fff700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 0x7f5dcc032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-18T20:51:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:22.074+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mgrmap(e 14) v1 ==== 35997+0+0 (secure 0 0 0) 0x7f5ddc025980 con 0x7f5de806fc30 2023-10-18T20:51:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:22.074+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 msgr2=0x7f5dcc032370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:51:22.077 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:22.074+0000 7f5de57fa700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 0x7f5dcc032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:51:22.354 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:22.022295+0000 mon.smithi008 (mon.0) 89 : cluster [INF] Active manager daemon smithi008.flmjzp restarted 2023-10-18T20:51:22.354 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:22.022842+0000 mon.smithi008 (mon.0) 90 : cluster [INF] Activating manager daemon smithi008.flmjzp 2023-10-18T20:51:22.354 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:22.024553+0000 mon.smithi008 (mon.0) 91 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2023-10-18T20:51:23.083 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.081+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 15) v1 ==== 36067+0+0 (secure 0 0 0) 0x7f5ddc041170 con 0x7f5de806fc30 2023-10-18T20:51:23.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.081+0000 7f5de57fa700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5dcc033b40 0x7f5dcc035f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:23.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.081+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5dcc032a30 con 0x7f5dcc033b40 2023-10-18T20:51:23.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.082+0000 7f5de7fff700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5dcc033b40 0x7f5dcc035f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:23.085 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.083+0000 7f5de7fff700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5dcc033b40 0x7f5dcc035f30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f5dd4006fd0 tx=0x7f5dd4006cf0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:23.086 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.084+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f5dcc032a30 con 0x7f5dcc033b40 2023-10-18T20:51:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.090+0000 7f5dede7d700 1 -- 172.21.15.8:0/3798478932 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f5de8059100 con 0x7f5dcc033b40 2023-10-18T20:51:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.090+0000 7f5de57fa700 1 -- 172.21.15.8:0/3798478932 <== mgr.14164 v2:172.21.15.8:6800/2622286163 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f5de8059100 con 0x7f5dcc033b40 2023-10-18T20:51:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: { 2023-10-18T20:51:23.094 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "mgrmap_epoch": 15, 2023-10-18T20:51:23.094 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: "initialized": true 2023-10-18T20:51:23.095 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: } 2023-10-18T20:51:23.095 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 -- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5dcc033b40 msgr2=0x7f5dcc035f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:23.095 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5dcc033b40 0x7f5dcc035f30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f5dd4006fd0 tx=0x7f5dd4006cf0).stop 2023-10-18T20:51:23.095 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 -- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 msgr2=0x7f5de80fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:23.096 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fc0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5ddc00b190 tx=0x7f5ddc006ee0).stop 2023-10-18T20:51:23.096 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 -- 172.21.15.8:0/3798478932 shutdown_connections 2023-10-18T20:51:23.096 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5dcc033b40 0x7f5dcc035f30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:23.096 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de806fc30 0x7f5de80fc0d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:23.096 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 --2- 172.21.15.8:0/3798478932 >> [v2:172.21.15.8:6800/2925059353,v1:172.21.15.8:6801/2925059353] conn(0x7f5dcc02feb0 0x7f5dcc032370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:51:23.096 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 -- 172.21.15.8:0/3798478932 >> 172.21.15.8:0/3798478932 conn(0x7f5de80f6130 msgr2=0x7f5de80f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 -- 172.21.15.8:0/3798478932 shutdown_connections 2023-10-18T20:51:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.091+0000 7f5dede7d700 1 -- 172.21.15.8:0/3798478932 wait complete. 2023-10-18T20:51:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:22.075516+0000 mon.smithi008 (mon.0) 92 : cluster [DBG] mgrmap e14: smithi008.flmjzp(active, starting, since 0.0527601s) 2023-10-18T20:51:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:22.078650+0000 mon.smithi008 (mon.0) 93 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:51:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:22.079490+0000 mon.smithi008 (mon.0) 94 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr metadata", "who": "smithi008.flmjzp", "id": "smithi008.flmjzp"}]: dispatch 2023-10-18T20:51:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:22.080653+0000 mon.smithi008 (mon.0) 95 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T20:51:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:22.080902+0000 mon.smithi008 (mon.0) 96 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T20:51:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:22.081146+0000 mon.smithi008 (mon.0) 97 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T20:51:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:22.084206+0000 mon.smithi008 (mon.0) 98 : cluster [INF] Manager daemon smithi008.flmjzp is now available 2023-10-18T20:51:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:22.213078+0000 mon.smithi008 (mon.0) 99 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:51:23.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:22.215815+0000 mon.smithi008 (mon.0) 100 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:51:23.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:22.249740+0000 mon.smithi008 (mon.0) 101 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:51:23.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:22.255056+0000 mon.smithi008 (mon.0) 102 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:51:23.424 INFO:teuthology.orchestra.run.smithi008.stderr:mgr epoch 13 is available 2023-10-18T20:51:23.424 INFO:teuthology.orchestra.run.smithi008.stderr:Generating a dashboard self-signed certificate... 2023-10-18T20:51:23.424 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 dashboard create-self-signed-cert 2023-10-18T20:51:23.815 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.812+0000 7ffb8d200700 1 Processor -- start 2023-10-18T20:51:23.815 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.812+0000 7ffb8d200700 1 -- start start 2023-10-18T20:51:23.816 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.812+0000 7ffb8d200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:23.818 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.812+0000 7ffb8d200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880feb40 con 0x7ffb8806fc30 2023-10-18T20:51:23.818 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.813+0000 7ffb87fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:23.819 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.813+0000 7ffb87fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40668/0 (socket says 172.21.15.8:40668) 2023-10-18T20:51:23.819 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.813+0000 7ffb87fff700 1 -- 172.21.15.8:0/740948209 learned_addr learned my addr 172.21.15.8:0/740948209 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:23.819 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.813+0000 7ffb87fff700 1 -- 172.21.15.8:0/740948209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb880fec80 con 0x7ffb8806fc30 2023-10-18T20:51:23.819 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.814+0000 7ffb87fff700 1 --2- 172.21.15.8:0/740948209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fe650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ffb7800b5f0 tx=0x7ffb78006ee0).ready entity=mon.0 client_cookie=d3be56969b5774b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:23.819 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.814+0000 7ffb86ffd700 1 -- 172.21.15.8:0/740948209 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb7800d600 con 0x7ffb8806fc30 2023-10-18T20:51:23.820 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.814+0000 7ffb86ffd700 1 -- 172.21.15.8:0/740948209 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7ffb7800dbd0 con 0x7ffb8806fc30 2023-10-18T20:51:23.820 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.814+0000 7ffb86ffd700 1 -- 172.21.15.8:0/740948209 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb78011c00 con 0x7ffb8806fc30 2023-10-18T20:51:23.820 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.814+0000 7ffb8d200700 1 -- 172.21.15.8:0/740948209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 msgr2=0x7ffb880fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:23.820 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.814+0000 7ffb8d200700 1 --2- 172.21.15.8:0/740948209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fe650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ffb7800b5f0 tx=0x7ffb78006ee0).stop 2023-10-18T20:51:23.820 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.815+0000 7ffb8d200700 1 -- 172.21.15.8:0/740948209 shutdown_connections 2023-10-18T20:51:23.821 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.815+0000 7ffb8d200700 1 --2- 172.21.15.8:0/740948209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fe650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:23.821 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.815+0000 7ffb8d200700 1 -- 172.21.15.8:0/740948209 >> 172.21.15.8:0/740948209 conn(0x7ffb880f6130 msgr2=0x7ffb880f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:23.821 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.815+0000 7ffb8d200700 1 -- 172.21.15.8:0/740948209 shutdown_connections 2023-10-18T20:51:23.821 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.815+0000 7ffb8d200700 1 -- 172.21.15.8:0/740948209 wait complete. 2023-10-18T20:51:23.821 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.815+0000 7ffb8d200700 1 Processor -- start 2023-10-18T20:51:23.822 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.816+0000 7ffb8d200700 1 -- start start 2023-10-18T20:51:23.822 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.816+0000 7ffb8d200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:23.822 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.816+0000 7ffb8d200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880fa550 con 0x7ffb8806fc30 2023-10-18T20:51:23.822 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.816+0000 7ffb87fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:23.822 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.816+0000 7ffb87fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40684/0 (socket says 172.21.15.8:40684) 2023-10-18T20:51:23.823 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.816+0000 7ffb87fff700 1 -- 172.21.15.8:0/2986784512 learned_addr learned my addr 172.21.15.8:0/2986784512 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:23.823 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.817+0000 7ffb87fff700 1 -- 172.21.15.8:0/2986784512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7800b200 con 0x7ffb8806fc30 2023-10-18T20:51:23.824 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.817+0000 7ffb87fff700 1 --2- 172.21.15.8:0/2986784512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fc0d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ffb7800e040 tx=0x7ffb78006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:23.824 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.817+0000 7ffb84ff9700 1 -- 172.21.15.8:0/2986784512 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb7800d9f0 con 0x7ffb8806fc30 2023-10-18T20:51:23.825 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.817+0000 7ffb8d200700 1 -- 172.21.15.8:0/2986784512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb880fa6f0 con 0x7ffb8806fc30 2023-10-18T20:51:23.825 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.817+0000 7ffb84ff9700 1 -- 172.21.15.8:0/2986784512 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7ffb7801a9f0 con 0x7ffb8806fc30 2023-10-18T20:51:23.825 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.817+0000 7ffb84ff9700 1 -- 172.21.15.8:0/2986784512 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb7801b8c0 con 0x7ffb8806fc30 2023-10-18T20:51:23.825 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.817+0000 7ffb8d200700 1 -- 172.21.15.8:0/2986784512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb880fab00 con 0x7ffb8806fc30 2023-10-18T20:51:23.826 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.818+0000 7ffb84ff9700 1 -- 172.21.15.8:0/2986784512 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 15) v1 ==== 36067+0+0 (secure 0 0 0) 0x7ffb7800f070 con 0x7ffb8806fc30 2023-10-18T20:51:23.826 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.818+0000 7ffb8d200700 1 -- 172.21.15.8:0/2986784512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb88045ad0 con 0x7ffb8806fc30 2023-10-18T20:51:23.826 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.819+0000 7ffb84ff9700 1 --2- 172.21.15.8:0/2986784512 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ffb7402fd70 0x7ffb74032230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:23.826 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.819+0000 7ffb84ff9700 1 -- 172.21.15.8:0/2986784512 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7ffb780414b0 con 0x7ffb8806fc30 2023-10-18T20:51:23.826 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.819+0000 7ffb877fe700 1 --2- 172.21.15.8:0/2986784512 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ffb7402fd70 0x7ffb74032230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:23.827 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.819+0000 7ffb877fe700 1 --2- 172.21.15.8:0/2986784512 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ffb7402fd70 0x7ffb74032230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ffb7c0096a0 tx=0x7ffb7c006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:23.827 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.823+0000 7ffb84ff9700 1 -- 172.21.15.8:0/2986784512 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ffb78022d70 con 0x7ffb8806fc30 2023-10-18T20:51:23.996 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:23.994+0000 7ffb8d200700 1 -- 172.21.15.8:0/2986784512 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb880ffa70 con 0x7ffb7402fd70 2023-10-18T20:51:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.138+0000 7ffb84ff9700 1 -- 172.21.15.8:0/2986784512 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7ffb880ffa70 con 0x7ffb7402fd70 2023-10-18T20:51:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: Self-signed certificate created 2023-10-18T20:51:24.143 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.139+0000 7ffb8d200700 1 -- 172.21.15.8:0/2986784512 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ffb7402fd70 msgr2=0x7ffb74032230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:24.143 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.139+0000 7ffb8d200700 1 --2- 172.21.15.8:0/2986784512 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ffb7402fd70 0x7ffb74032230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ffb7c0096a0 tx=0x7ffb7c006b40).stop 2023-10-18T20:51:24.143 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.140+0000 7ffb8d200700 1 -- 172.21.15.8:0/2986784512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 msgr2=0x7ffb880fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:24.143 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.140+0000 7ffb8d200700 1 --2- 172.21.15.8:0/2986784512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fc0d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ffb7800e040 tx=0x7ffb78006ee0).stop 2023-10-18T20:51:24.143 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.140+0000 7ffb8d200700 1 -- 172.21.15.8:0/2986784512 shutdown_connections 2023-10-18T20:51:24.144 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.140+0000 7ffb8d200700 1 --2- 172.21.15.8:0/2986784512 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ffb7402fd70 0x7ffb74032230 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:24.144 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.140+0000 7ffb8d200700 1 --2- 172.21.15.8:0/2986784512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8806fc30 0x7ffb880fc0d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:24.144 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.140+0000 7ffb8d200700 1 -- 172.21.15.8:0/2986784512 >> 172.21.15.8:0/2986784512 conn(0x7ffb880f6130 msgr2=0x7ffb880f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:24.144 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.140+0000 7ffb8d200700 1 -- 172.21.15.8:0/2986784512 shutdown_connections 2023-10-18T20:51:24.144 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.140+0000 7ffb8d200700 1 -- 172.21.15.8:0/2986784512 wait complete. 2023-10-18T20:51:24.340 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:23.083929+0000 mon.smithi008 (mon.0) 103 : cluster [DBG] mgrmap e15: smithi008.flmjzp(active, since 1.06116s) 2023-10-18T20:51:24.341 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:23.084305+0000 mgr.smithi008.flmjzp (mgr.14164) 1 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-18T20:51:24.341 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:23.091221+0000 mgr.smithi008.flmjzp (mgr.14164) 2 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-18T20:51:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:Creating initial admin user... 2023-10-18T20:51:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpss_nzljl:/tmp/dashboard.pw:z docker.io/ceph/ceph:v16.2.4 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2023-10-18T20:51:24.891 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.888+0000 7f8de3fff700 1 Processor -- start 2023-10-18T20:51:24.891 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.888+0000 7f8de3fff700 1 -- start start 2023-10-18T20:51:24.892 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.888+0000 7f8de3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de40fe710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:24.892 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.888+0000 7f8de3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de406ff90 con 0x7f8de406fb70 2023-10-18T20:51:24.892 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.889+0000 7f8de2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de40fe710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:24.892 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.889+0000 7f8de2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de40fe710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40698/0 (socket says 172.21.15.8:40698) 2023-10-18T20:51:24.895 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.889+0000 7f8de2ffd700 1 -- 172.21.15.8:0/3111439763 learned_addr learned my addr 172.21.15.8:0/3111439763 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:24.895 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.889+0000 7f8de2ffd700 1 -- 172.21.15.8:0/3111439763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de40fec00 con 0x7f8de406fb70 2023-10-18T20:51:24.895 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.889+0000 7f8de2ffd700 1 --2- 172.21.15.8:0/3111439763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de40fe710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8dd400b5f0 tx=0x7f8dd4006ee0).ready entity=mon.0 client_cookie=9196e74b4dfcdf35 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:24.895 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.890+0000 7f8de1ffb700 1 -- 172.21.15.8:0/3111439763 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8dd400d600 con 0x7f8de406fb70 2023-10-18T20:51:24.895 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.890+0000 7f8de1ffb700 1 -- 172.21.15.8:0/3111439763 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f8dd400dbd0 con 0x7f8de406fb70 2023-10-18T20:51:24.896 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.890+0000 7f8de1ffb700 1 -- 172.21.15.8:0/3111439763 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8dd4011c00 con 0x7f8de406fb70 2023-10-18T20:51:24.896 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.890+0000 7f8de3fff700 1 -- 172.21.15.8:0/3111439763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 msgr2=0x7f8de40fe710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:24.896 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.890+0000 7f8de3fff700 1 --2- 172.21.15.8:0/3111439763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de40fe710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8dd400b5f0 tx=0x7f8dd4006ee0).stop 2023-10-18T20:51:24.896 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.891+0000 7f8de3fff700 1 -- 172.21.15.8:0/3111439763 shutdown_connections 2023-10-18T20:51:24.896 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.891+0000 7f8de3fff700 1 --2- 172.21.15.8:0/3111439763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de40fe710 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:24.897 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.891+0000 7f8de3fff700 1 -- 172.21.15.8:0/3111439763 >> 172.21.15.8:0/3111439763 conn(0x7f8de40f6130 msgr2=0x7f8de40f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:24.897 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.891+0000 7f8de3fff700 1 -- 172.21.15.8:0/3111439763 shutdown_connections 2023-10-18T20:51:24.897 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.891+0000 7f8de3fff700 1 -- 172.21.15.8:0/3111439763 wait complete. 2023-10-18T20:51:24.897 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.891+0000 7f8de3fff700 1 Processor -- start 2023-10-18T20:51:24.897 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.892+0000 7f8de3fff700 1 -- start start 2023-10-18T20:51:24.898 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.892+0000 7f8de3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de410ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:24.898 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.892+0000 7f8de3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de410cef0 con 0x7f8de406fb70 2023-10-18T20:51:24.898 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.892+0000 7f8de2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de410ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:24.898 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.893+0000 7f8de2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de410ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40700/0 (socket says 172.21.15.8:40700) 2023-10-18T20:51:24.898 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.893+0000 7f8de2ffd700 1 -- 172.21.15.8:0/645091815 learned_addr learned my addr 172.21.15.8:0/645091815 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:24.899 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.893+0000 7f8de2ffd700 1 -- 172.21.15.8:0/645091815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd400b200 con 0x7f8de406fb70 2023-10-18T20:51:24.899 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.893+0000 7f8de2ffd700 1 --2- 172.21.15.8:0/645091815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de410ca00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8dd400e040 tx=0x7f8dd4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:24.900 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.893+0000 7f8dcb7fe700 1 -- 172.21.15.8:0/645091815 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8dd400d9f0 con 0x7f8de406fb70 2023-10-18T20:51:24.900 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.893+0000 7f8dcb7fe700 1 -- 172.21.15.8:0/645091815 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f8dd401a9f0 con 0x7f8de406fb70 2023-10-18T20:51:24.900 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.893+0000 7f8dcb7fe700 1 -- 172.21.15.8:0/645091815 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8dd401b8c0 con 0x7f8de406fb70 2023-10-18T20:51:24.901 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.893+0000 7f8de3fff700 1 -- 172.21.15.8:0/645091815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de410d0f0 con 0x7f8de406fb70 2023-10-18T20:51:24.901 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.894+0000 7f8de3fff700 1 -- 172.21.15.8:0/645091815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de410d500 con 0x7f8de406fb70 2023-10-18T20:51:24.901 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.894+0000 7f8dcb7fe700 1 -- 172.21.15.8:0/645091815 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f8dd400f070 con 0x7f8de406fb70 2023-10-18T20:51:24.901 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.895+0000 7f8de3fff700 1 -- 172.21.15.8:0/645091815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de4045ad0 con 0x7f8de406fb70 2023-10-18T20:51:24.901 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.895+0000 7f8dcb7fe700 1 --2- 172.21.15.8:0/645091815 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8dd002feb0 0x7f8dd0032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:24.902 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.895+0000 7f8dcb7fe700 1 -- 172.21.15.8:0/645091815 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f8dd4041630 con 0x7f8de406fb70 2023-10-18T20:51:24.902 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.895+0000 7f8de27fc700 1 --2- 172.21.15.8:0/645091815 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8dd002feb0 0x7f8dd0032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:24.902 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.896+0000 7f8de27fc700 1 --2- 172.21.15.8:0/645091815 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8dd002feb0 0x7f8dd0032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8dd80096a0 tx=0x7f8dd8006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:24.903 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:24.899+0000 7f8dcb7fe700 1 -- 172.21.15.8:0/645091815 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8dd40224f0 con 0x7f8de406fb70 2023-10-18T20:51:25.084 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.082+0000 7f8de3fff700 1 -- 172.21.15.8:0/645091815 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8de4106bc0 con 0x7f8dd002feb0 2023-10-18T20:51:25.330 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.328+0000 7f8dcb7fe700 1 -- 172.21.15.8:0/645091815 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f8de4106bc0 con 0x7f8dd002feb0 2023-10-18T20:51:25.330 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$dYrgzeAnFu0ouDIY4NrV2eZxS2Pwlki.VESLLXhkLUObh3FAlw8gq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1697662285, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-18T20:51:25.332 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.330+0000 7f8de3fff700 1 -- 172.21.15.8:0/645091815 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8dd002feb0 msgr2=0x7f8dd0032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:25.332 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.330+0000 7f8de3fff700 1 --2- 172.21.15.8:0/645091815 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8dd002feb0 0x7f8dd0032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8dd80096a0 tx=0x7f8dd8006b40).stop 2023-10-18T20:51:25.333 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.330+0000 7f8de3fff700 1 -- 172.21.15.8:0/645091815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 msgr2=0x7f8de410ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:25.333 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.330+0000 7f8de3fff700 1 --2- 172.21.15.8:0/645091815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de410ca00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8dd400e040 tx=0x7f8dd4006ee0).stop 2023-10-18T20:51:25.333 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.330+0000 7f8de3fff700 1 -- 172.21.15.8:0/645091815 shutdown_connections 2023-10-18T20:51:25.333 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.330+0000 7f8de3fff700 1 --2- 172.21.15.8:0/645091815 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8dd002feb0 0x7f8dd0032370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:25.333 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.330+0000 7f8de3fff700 1 --2- 172.21.15.8:0/645091815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de406fb70 0x7f8de410ca00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:25.334 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.330+0000 7f8de3fff700 1 -- 172.21.15.8:0/645091815 >> 172.21.15.8:0/645091815 conn(0x7f8de40f6130 msgr2=0x7f8de40f7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:25.334 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.330+0000 7f8de3fff700 1 -- 172.21.15.8:0/645091815 shutdown_connections 2023-10-18T20:51:25.334 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:25.330+0000 7f8de3fff700 1 -- 172.21.15.8:0/645091815 wait complete. 2023-10-18T20:51:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:23.995641+0000 mgr.smithi008.flmjzp (mgr.14164) 3 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:51:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:24.136130+0000 mon.smithi008 (mon.0) 104 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:24.138147+0000 mon.smithi008 (mon.0) 105 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:24.305593+0000 mon.smithi008 (mon.0) 106 : cluster [DBG] mgrmap e16: smithi008.flmjzp(active, since 2s) 2023-10-18T20:51:25.659 INFO:teuthology.orchestra.run.smithi008.stderr:Fetching dashboard port number... 2023-10-18T20:51:25.659 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi008 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7:/var/log/ceph:z -v /tmp/ceph-tmpi1zb0o0g:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp2ve_l47r:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config get mgr mgr/dashboard/ssl_server_port 2023-10-18T20:51:26.064 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.061+0000 7fa0ea71a700 1 Processor -- start 2023-10-18T20:51:26.065 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.062+0000 7fa0ea71a700 1 -- start start 2023-10-18T20:51:26.065 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.062+0000 7fa0ea71a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:26.065 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.062+0000 7fa0ea71a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4072110 con 0x7fa0e4071cf0 2023-10-18T20:51:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.062+0000 7fa0e9718700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.062+0000 7fa0e9718700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40712/0 (socket says 172.21.15.8:40712) 2023-10-18T20:51:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.062+0000 7fa0e9718700 1 -- 172.21.15.8:0/3849615124 learned_addr learned my addr 172.21.15.8:0/3849615124 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:26.067 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.063+0000 7fa0e9718700 1 -- 172.21.15.8:0/3849615124 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4070780 con 0x7fa0e4071cf0 2023-10-18T20:51:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.063+0000 7fa0e9718700 1 --2- 172.21.15.8:0/3849615124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4070290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa0e000b5f0 tx=0x7fa0e0006ee0).ready entity=mon.0 client_cookie=5904aef320e28ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.063+0000 7fa0d3fff700 1 -- 172.21.15.8:0/3849615124 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0e000d600 con 0x7fa0e4071cf0 2023-10-18T20:51:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.063+0000 7fa0d3fff700 1 -- 172.21.15.8:0/3849615124 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fa0e000dbd0 con 0x7fa0e4071cf0 2023-10-18T20:51:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.063+0000 7fa0d3fff700 1 -- 172.21.15.8:0/3849615124 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0e0011c00 con 0x7fa0e4071cf0 2023-10-18T20:51:26.068 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.064+0000 7fa0ea71a700 1 -- 172.21.15.8:0/3849615124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 msgr2=0x7fa0e4070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.064+0000 7fa0ea71a700 1 --2- 172.21.15.8:0/3849615124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4070290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa0e000b5f0 tx=0x7fa0e0006ee0).stop 2023-10-18T20:51:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.064+0000 7fa0ea71a700 1 -- 172.21.15.8:0/3849615124 shutdown_connections 2023-10-18T20:51:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.064+0000 7fa0ea71a700 1 --2- 172.21.15.8:0/3849615124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4070290 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.064+0000 7fa0ea71a700 1 -- 172.21.15.8:0/3849615124 >> 172.21.15.8:0/3849615124 conn(0x7fa0e40f71d0 msgr2=0x7fa0e40f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:26.069 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.064+0000 7fa0ea71a700 1 -- 172.21.15.8:0/3849615124 shutdown_connections 2023-10-18T20:51:26.070 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.064+0000 7fa0ea71a700 1 -- 172.21.15.8:0/3849615124 wait complete. 2023-10-18T20:51:26.070 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.065+0000 7fa0ea71a700 1 Processor -- start 2023-10-18T20:51:26.072 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.065+0000 7fa0ea71a700 1 -- start start 2023-10-18T20:51:26.072 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.066+0000 7fa0ea71a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4110ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:26.072 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.066+0000 7fa0ea71a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4111390 con 0x7fa0e4071cf0 2023-10-18T20:51:26.073 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.066+0000 7fa0e9718700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4110ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:26.073 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.066+0000 7fa0e9718700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4110ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40728/0 (socket says 172.21.15.8:40728) 2023-10-18T20:51:26.073 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.066+0000 7fa0e9718700 1 -- 172.21.15.8:0/2162961934 learned_addr learned my addr 172.21.15.8:0/2162961934 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:26.073 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.067+0000 7fa0e9718700 1 -- 172.21.15.8:0/2162961934 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e000b200 con 0x7fa0e4071cf0 2023-10-18T20:51:26.073 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.067+0000 7fa0e9718700 1 --2- 172.21.15.8:0/2162961934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4110ea0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa0e0011820 tx=0x7fa0e0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:26.074 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.067+0000 7fa0d1ffb700 1 -- 172.21.15.8:0/2162961934 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0e001b410 con 0x7fa0e4071cf0 2023-10-18T20:51:26.074 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.067+0000 7fa0d1ffb700 1 -- 172.21.15.8:0/2162961934 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fa0e001b9e0 con 0x7fa0e4071cf0 2023-10-18T20:51:26.074 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.067+0000 7fa0d1ffb700 1 -- 172.21.15.8:0/2162961934 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0e001a8b0 con 0x7fa0e4071cf0 2023-10-18T20:51:26.076 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.067+0000 7fa0ea71a700 1 -- 172.21.15.8:0/2162961934 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e4111590 con 0x7fa0e4071cf0 2023-10-18T20:51:26.076 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.067+0000 7fa0ea71a700 1 -- 172.21.15.8:0/2162961934 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e41119a0 con 0x7fa0e4071cf0 2023-10-18T20:51:26.076 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.068+0000 7fa0d1ffb700 1 -- 172.21.15.8:0/2162961934 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7fa0e000f070 con 0x7fa0e4071cf0 2023-10-18T20:51:26.076 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.068+0000 7fa0d1ffb700 1 --2- 172.21.15.8:0/2162961934 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa0cc02ff00 0x7fa0cc0323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:26.077 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.069+0000 7fa0d1ffb700 1 -- 172.21.15.8:0/2162961934 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fa0e0041610 con 0x7fa0e4071cf0 2023-10-18T20:51:26.077 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.068+0000 7fa0ea71a700 1 -- 172.21.15.8:0/2162961934 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e4045ad0 con 0x7fa0e4071cf0 2023-10-18T20:51:26.077 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.069+0000 7fa0e8f17700 1 --2- 172.21.15.8:0/2162961934 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa0cc02ff00 0x7fa0cc0323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:26.077 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.069+0000 7fa0e8f17700 1 --2- 172.21.15.8:0/2162961934 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa0cc02ff00 0x7fa0cc0323c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa0d40096a0 tx=0x7fa0d4006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:26.078 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.073+0000 7fa0d1ffb700 1 -- 172.21.15.8:0/2162961934 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa0e0016070 con 0x7fa0e4071cf0 2023-10-18T20:51:26.243 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.241+0000 7fa0ea71a700 1 -- 172.21.15.8:0/2162961934 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fa0e40fd790 con 0x7fa0e4071cf0 2023-10-18T20:51:26.243 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.241+0000 7fa0d1ffb700 1 -- 172.21.15.8:0/2162961934 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v9) v1 ==== 112+0+5 (secure 0 0 0) 0x7fa0e0019cd0 con 0x7fa0e4071cf0 2023-10-18T20:51:26.244 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 8443 2023-10-18T20:51:26.246 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.243+0000 7fa0ea71a700 1 -- 172.21.15.8:0/2162961934 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa0cc02ff00 msgr2=0x7fa0cc0323c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:26.246 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.243+0000 7fa0ea71a700 1 --2- 172.21.15.8:0/2162961934 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa0cc02ff00 0x7fa0cc0323c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa0d40096a0 tx=0x7fa0d4006b40).stop 2023-10-18T20:51:26.246 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.243+0000 7fa0ea71a700 1 -- 172.21.15.8:0/2162961934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 msgr2=0x7fa0e4110ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:26.246 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.243+0000 7fa0ea71a700 1 --2- 172.21.15.8:0/2162961934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4110ea0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa0e0011820 tx=0x7fa0e0006ee0).stop 2023-10-18T20:51:26.247 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.243+0000 7fa0ea71a700 1 -- 172.21.15.8:0/2162961934 shutdown_connections 2023-10-18T20:51:26.247 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.243+0000 7fa0ea71a700 1 --2- 172.21.15.8:0/2162961934 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa0cc02ff00 0x7fa0cc0323c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:26.247 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.243+0000 7fa0ea71a700 1 --2- 172.21.15.8:0/2162961934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4071cf0 0x7fa0e4110ea0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:26.247 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.243+0000 7fa0ea71a700 1 -- 172.21.15.8:0/2162961934 >> 172.21.15.8:0/2162961934 conn(0x7fa0e40f71d0 msgr2=0x7fa0e40fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:26.248 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.243+0000 7fa0ea71a700 1 -- 172.21.15.8:0/2162961934 shutdown_connections 2023-10-18T20:51:26.248 INFO:teuthology.orchestra.run.smithi008.stderr:/usr/bin/ceph: 2023-10-18T20:51:26.243+0000 7fa0ea71a700 1 -- 172.21.15.8:0/2162961934 wait complete. 2023-10-18T20:51:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:25.083529+0000 mgr.smithi008.flmjzp (mgr.14164) 4 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:51:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:25.328687+0000 mon.smithi008 (mon.0) 107 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:26.621 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-enabled firewalld.service 2023-10-18T20:51:26.641 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: disabled 2023-10-18T20:51:26.641 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: systemctl is-active firewalld.service 2023-10-18T20:51:26.658 INFO:teuthology.orchestra.run.smithi008.stderr:systemctl: inactive 2023-10-18T20:51:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:firewalld.service is not enabled 2023-10-18T20:51:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-18T20:51:26.662 INFO:teuthology.orchestra.run.smithi008.stderr:Ceph Dashboard is now available at: 2023-10-18T20:51:26.662 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-18T20:51:26.663 INFO:teuthology.orchestra.run.smithi008.stderr: URL: https://smithi008.front.sepia.ceph.com:8443/ 2023-10-18T20:51:26.663 INFO:teuthology.orchestra.run.smithi008.stderr: User: admin 2023-10-18T20:51:26.663 INFO:teuthology.orchestra.run.smithi008.stderr: Password: 5nl872tgei 2023-10-18T20:51:26.663 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-18T20:51:26.664 INFO:teuthology.orchestra.run.smithi008.stderr:You can access the Ceph CLI with: 2023-10-18T20:51:26.664 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-18T20:51:26.664 INFO:teuthology.orchestra.run.smithi008.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-18T20:51:26.665 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-18T20:51:26.665 INFO:teuthology.orchestra.run.smithi008.stderr:Please consider enabling telemetry to help improve Ceph: 2023-10-18T20:51:26.665 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-18T20:51:26.665 INFO:teuthology.orchestra.run.smithi008.stderr: ceph telemetry on 2023-10-18T20:51:26.665 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-18T20:51:26.665 INFO:teuthology.orchestra.run.smithi008.stderr:For more information see: 2023-10-18T20:51:26.666 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-18T20:51:26.666 INFO:teuthology.orchestra.run.smithi008.stderr: https://docs.ceph.com/docs/pacific/mgr/telemetry/ 2023-10-18T20:51:26.666 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-18T20:51:26.666 INFO:teuthology.orchestra.run.smithi008.stderr:Bootstrap complete. 2023-10-18T20:51:26.666 INFO:teuthology.orchestra.run.smithi008.stderr:Releasing lock 140594688068072 on /run/cephadm/e1aaa62c-6df7-11ee-8db6-212e2dc638e7.lock 2023-10-18T20:51:26.667 INFO:teuthology.orchestra.run.smithi008.stderr:Lock 140594688068072 released on /run/cephadm/e1aaa62c-6df7-11ee-8db6-212e2dc638e7.lock 2023-10-18T20:51:26.719 INFO:tasks.cephadm:Fetching config... 2023-10-18T20:51:26.720 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:51:26.720 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-18T20:51:26.806 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-18T20:51:26.806 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:51:26.806 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-18T20:51:26.893 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-18T20:51:26.894 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:51:26.894 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/keyring of=/dev/stdout 2023-10-18T20:51:27.004 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-18T20:51:27.005 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:51:27.005 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-18T20:51:27.091 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-18T20:51:27.091 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgW0En+s+P7vkwBXIW29YusFRYJV0kaY+QbKLPQpcYPSkGPntNUsrMJLe7aRXCCwZlOcGrAxfp1ryLepSsSdx6hjJglen+kk3FczbtT9PX6jyGjGkIvdJLFo/NdtQ4I5QMjzb5c2lfVggkgaJIFrTYrS+O2zjUDk4/CB3avpNwiCbCdy7pBbO+pyHWdMZHRZ9c9ya0jurVdWM7NDovv5lIzTJXEXi173j3XAfYUiRnoDflYyktxnacmXdwUB68jqhmTWnKpIsbbNVrGa64syMBPup4AufB6Cm+VdHuySHtYpgWBeGpzcuNy/ccTNhNzAP2NJb1g7gxXyLejLDs9vQ9AzTTR9H5WNmG3gyG7+wumgqsKaxEQCLP0/1g+PunFwv9QwOnxOtu6CYvQOeTYwfiO0Xw8xvgw7v4Z3794LewlaXc5x4/hpsL1Y478wqwYP3p0qnJ4eJYBoneu0qD+LUGE3dNzn35BfYrvbXdQwSjxU1kUMMpdjgjmhCKmRjq9zU= ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-18T20:51:27.230 INFO:teuthology.orchestra.run.smithi008.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgW0En+s+P7vkwBXIW29YusFRYJV0kaY+QbKLPQpcYPSkGPntNUsrMJLe7aRXCCwZlOcGrAxfp1ryLepSsSdx6hjJglen+kk3FczbtT9PX6jyGjGkIvdJLFo/NdtQ4I5QMjzb5c2lfVggkgaJIFrTYrS+O2zjUDk4/CB3avpNwiCbCdy7pBbO+pyHWdMZHRZ9c9ya0jurVdWM7NDovv5lIzTJXEXi173j3XAfYUiRnoDflYyktxnacmXdwUB68jqhmTWnKpIsbbNVrGa64syMBPup4AufB6Cm+VdHuySHtYpgWBeGpzcuNy/ccTNhNzAP2NJb1g7gxXyLejLDs9vQ9AzTTR9H5WNmG3gyG7+wumgqsKaxEQCLP0/1g+PunFwv9QwOnxOtu6CYvQOeTYwfiO0Xw8xvgw7v4Z3794LewlaXc5x4/hpsL1Y478wqwYP3p0qnJ4eJYBoneu0qD+LUGE3dNzn35BfYrvbXdQwSjxU1kUMMpdjgjmhCKmRjq9zU= ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:51:27.251 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:26.241902+0000 mon.smithi008 (mon.0) 108 : audit [DBG] from='client.? 172.21.15.8:0/2162961934' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-18T20:51:27.260 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgW0En+s+P7vkwBXIW29YusFRYJV0kaY+QbKLPQpcYPSkGPntNUsrMJLe7aRXCCwZlOcGrAxfp1ryLepSsSdx6hjJglen+kk3FczbtT9PX6jyGjGkIvdJLFo/NdtQ4I5QMjzb5c2lfVggkgaJIFrTYrS+O2zjUDk4/CB3avpNwiCbCdy7pBbO+pyHWdMZHRZ9c9ya0jurVdWM7NDovv5lIzTJXEXi173j3XAfYUiRnoDflYyktxnacmXdwUB68jqhmTWnKpIsbbNVrGa64syMBPup4AufB6Cm+VdHuySHtYpgWBeGpzcuNy/ccTNhNzAP2NJb1g7gxXyLejLDs9vQ9AzTTR9H5WNmG3gyG7+wumgqsKaxEQCLP0/1g+PunFwv9QwOnxOtu6CYvQOeTYwfiO0Xw8xvgw7v4Z3794LewlaXc5x4/hpsL1Y478wqwYP3p0qnJ4eJYBoneu0qD+LUGE3dNzn35BfYrvbXdQwSjxU1kUMMpdjgjmhCKmRjq9zU= ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-18T20:51:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgW0En+s+P7vkwBXIW29YusFRYJV0kaY+QbKLPQpcYPSkGPntNUsrMJLe7aRXCCwZlOcGrAxfp1ryLepSsSdx6hjJglen+kk3FczbtT9PX6jyGjGkIvdJLFo/NdtQ4I5QMjzb5c2lfVggkgaJIFrTYrS+O2zjUDk4/CB3avpNwiCbCdy7pBbO+pyHWdMZHRZ9c9ya0jurVdWM7NDovv5lIzTJXEXi173j3XAfYUiRnoDflYyktxnacmXdwUB68jqhmTWnKpIsbbNVrGa64syMBPup4AufB6Cm+VdHuySHtYpgWBeGpzcuNy/ccTNhNzAP2NJb1g7gxXyLejLDs9vQ9AzTTR9H5WNmG3gyG7+wumgqsKaxEQCLP0/1g+PunFwv9QwOnxOtu6CYvQOeTYwfiO0Xw8xvgw7v4Z3794LewlaXc5x4/hpsL1Y478wqwYP3p0qnJ4eJYBoneu0qD+LUGE3dNzn35BfYrvbXdQwSjxU1kUMMpdjgjmhCKmRjq9zU= ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:51:27.397 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-18T20:51:28.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.749+0000 7fc1cd82e700 1 -- 172.21.15.8:0/2198127926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1c8060180 msgr2=0x7fc1c80f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:28.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.749+0000 7fc1cd82e700 1 --2- 172.21.15.8:0/2198127926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1c8060180 0x7fc1c80f8f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc1bc009fb0 tx=0x7fc1bc009b30).stop 2023-10-18T20:51:28.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.749+0000 7fc1cd82e700 1 -- 172.21.15.8:0/2198127926 shutdown_connections 2023-10-18T20:51:28.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.749+0000 7fc1cd82e700 1 --2- 172.21.15.8:0/2198127926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1c8060180 0x7fc1c80f8f80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:28.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.749+0000 7fc1cd82e700 1 -- 172.21.15.8:0/2198127926 >> 172.21.15.8:0/2198127926 conn(0x7fc1c80f09a0 msgr2=0x7fc1c80f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:28.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.749+0000 7fc1cd82e700 1 -- 172.21.15.8:0/2198127926 shutdown_connections 2023-10-18T20:51:28.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.749+0000 7fc1cd82e700 1 -- 172.21.15.8:0/2198127926 wait complete. 2023-10-18T20:51:28.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.750+0000 7fc1cd82e700 1 Processor -- start 2023-10-18T20:51:28.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.750+0000 7fc1cd82e700 1 -- start start 2023-10-18T20:51:28.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.750+0000 7fc1cd82e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1c8060180 0x7fc1c81086e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:28.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.750+0000 7fc1cd82e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c8108bd0 con 0x7fc1c8060180 2023-10-18T20:51:28.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.751+0000 7fc1cc82c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1c8060180 0x7fc1c81086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:28.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.751+0000 7fc1cc82c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1c8060180 0x7fc1c81086e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52642/0 (socket says 172.21.15.8:52642) 2023-10-18T20:51:28.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.751+0000 7fc1cc82c700 1 -- 172.21.15.8:0/3187540462 learned_addr learned my addr 172.21.15.8:0/3187540462 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:51:28.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.751+0000 7fc1cc82c700 1 -- 172.21.15.8:0/3187540462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc005040 con 0x7fc1c8060180 2023-10-18T20:51:28.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.751+0000 7fc1cc82c700 1 --2- 172.21.15.8:0/3187540462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1c8060180 0x7fc1c81086e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc1bc000c00 tx=0x7fc1bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:28.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.751+0000 7fc1c57fa700 1 -- 172.21.15.8:0/3187540462 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1bc0095f0 con 0x7fc1c8060180 2023-10-18T20:51:28.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.751+0000 7fc1c57fa700 1 -- 172.21.15.8:0/3187540462 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fc1bc007e30 con 0x7fc1c8060180 2023-10-18T20:51:28.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.751+0000 7fc1cd82e700 1 -- 172.21.15.8:0/3187540462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c8108dd0 con 0x7fc1c8060180 2023-10-18T20:51:28.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.751+0000 7fc1c57fa700 1 -- 172.21.15.8:0/3187540462 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1bc014d20 con 0x7fc1c8060180 2023-10-18T20:51:28.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.752+0000 7fc1cd82e700 1 -- 172.21.15.8:0/3187540462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c8109260 con 0x7fc1c8060180 2023-10-18T20:51:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.752+0000 7fc1c57fa700 1 -- 172.21.15.8:0/3187540462 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fc1bc025070 con 0x7fc1c8060180 2023-10-18T20:51:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.752+0000 7fc1cd82e700 1 -- 172.21.15.8:0/3187540462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c8045ad0 con 0x7fc1c8060180 2023-10-18T20:51:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.753+0000 7fc1c57fa700 1 --2- 172.21.15.8:0/3187540462 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc1b802ff60 0x7fc1b8032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.753+0000 7fc1c57fa700 1 -- 172.21.15.8:0/3187540462 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fc1bc040970 con 0x7fc1c8060180 2023-10-18T20:51:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.753+0000 7fc1c7fff700 1 --2- 172.21.15.8:0/3187540462 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc1b802ff60 0x7fc1b8032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.754+0000 7fc1c7fff700 1 --2- 172.21.15.8:0/3187540462 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc1b802ff60 0x7fc1b8032420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc1b40096a0 tx=0x7fc1b4006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:28.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.758+0000 7fc1c57fa700 1 -- 172.21.15.8:0/3187540462 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc1bc00f4e0 con 0x7fc1c8060180 2023-10-18T20:51:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.923+0000 7fc1cd82e700 1 -- 172.21.15.8:0/3187540462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fc1c810a120 con 0x7fc1c8060180 2023-10-18T20:51:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.926+0000 7fc1c57fa700 1 -- 172.21.15.8:0/3187540462 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v10)=0 v10) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc1bc00f300 con 0x7fc1c8060180 2023-10-18T20:51:28.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.928+0000 7fc1cd82e700 1 -- 172.21.15.8:0/3187540462 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc1b802ff60 msgr2=0x7fc1b8032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:28.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.928+0000 7fc1cd82e700 1 --2- 172.21.15.8:0/3187540462 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc1b802ff60 0x7fc1b8032420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc1b40096a0 tx=0x7fc1b4006b40).stop 2023-10-18T20:51:28.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.928+0000 7fc1cd82e700 1 -- 172.21.15.8:0/3187540462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1c8060180 msgr2=0x7fc1c81086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:28.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.928+0000 7fc1cd82e700 1 --2- 172.21.15.8:0/3187540462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1c8060180 0x7fc1c81086e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc1bc000c00 tx=0x7fc1bc00b040).stop 2023-10-18T20:51:28.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.928+0000 7fc1cd82e700 1 -- 172.21.15.8:0/3187540462 shutdown_connections 2023-10-18T20:51:28.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.928+0000 7fc1cd82e700 1 --2- 172.21.15.8:0/3187540462 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc1b802ff60 0x7fc1b8032420 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:28.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.928+0000 7fc1cd82e700 1 --2- 172.21.15.8:0/3187540462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1c8060180 0x7fc1c81086e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:28.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.928+0000 7fc1cd82e700 1 -- 172.21.15.8:0/3187540462 >> 172.21.15.8:0/3187540462 conn(0x7fc1c80f09a0 msgr2=0x7fc1c80f13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:28.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.928+0000 7fc1cd82e700 1 -- 172.21.15.8:0/3187540462 shutdown_connections 2023-10-18T20:51:28.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:51:28.928+0000 7fc1cd82e700 1 -- 172.21.15.8:0/3187540462 wait complete. 2023-10-18T20:51:29.293 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:28.141037+0000 mon.smithi008 (mon.0) 109 : cluster [DBG] mgrmap e17: smithi008.flmjzp(active, since 6s) 2023-10-18T20:51:29.294 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:28.926522+0000 mon.smithi008 (mon.0) 110 : audit [INF] from='client.? 172.21.15.8:0/3187540462' entity='client.admin' 2023-10-18T20:51:29.317 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi060 2023-10-18T20:51:29.318 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:51:29.318 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.conf 2023-10-18T20:51:29.370 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:51:29.370 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-18T20:51:29.459 INFO:tasks.cephadm:Adding host smithi060 to orchestrator... 2023-10-18T20:51:29.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph orch host add smithi060 2023-10-18T20:51:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:34.326736+0000 mon.smithi008 (mon.0) 111 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:34.651050+0000 mon.smithi008 (mon.0) 112 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:35.593809+0000 mon.smithi008 (mon.0) 113 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:38.485219+0000 mon.smithi008 (mon.0) 114 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:38.949909+0000 mon.smithi008 (mon.0) 115 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:38.952165+0000 mon.smithi008 (mon.0) 116 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:51:38.959236+0000 mgr.smithi008.flmjzp (mgr.14164) 5 : cephadm [INF] Deploying daemon alertmanager.smithi008 on smithi008 2023-10-18T20:51:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:42.082044+0000 mgr.smithi008.flmjzp (mgr.14164) 6 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:51:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:44.082410+0000 mgr.smithi008.flmjzp (mgr.14164) 7 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:51:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:46.082746+0000 mgr.smithi008.flmjzp (mgr.14164) 8 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:51:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:48.083006+0000 mgr.smithi008.flmjzp (mgr.14164) 9 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:51:51.612 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:50.083244+0000 mgr.smithi008.flmjzp (mgr.14164) 10 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:51:51.613 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:51.112318+0000 mon.smithi008 (mon.0) 117 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:51.613 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:51.113372+0000 mon.smithi008 (mon.0) 118 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi008", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-10-18T20:51:51.614 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:51.115045+0000 mon.smithi008 (mon.0) 119 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi008", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-10-18T20:51:51.614 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:51.115716+0000 mon.smithi008 (mon.0) 120 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:51:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:51:51.116345+0000 mgr.smithi008.flmjzp (mgr.14164) 11 : cephadm [INF] Deploying daemon crash.smithi008 on smithi008 2023-10-18T20:51:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:52.083461+0000 mgr.smithi008.flmjzp (mgr.14164) 12 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:51:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:53.177057+0000 mon.smithi008 (mon.0) 121 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:53.250621+0000 mon.smithi008 (mon.0) 122 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:53.252755+0000 mon.smithi008 (mon.0) 123 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:53.253292+0000 mon.smithi008 (mon.0) 124 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-10-18T20:51:53.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:53.256439+0000 mon.smithi008 (mon.0) 125 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:53.253826+0000 mgr.smithi008.flmjzp (mgr.14164) 13 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-10-18T20:51:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:51:53.261218+0000 mgr.smithi008.flmjzp (mgr.14164) 14 : cephadm [INF] Deploying daemon grafana.smithi008 on smithi008 2023-10-18T20:51:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:54.083813+0000 mgr.smithi008.flmjzp (mgr.14164) 15 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:51:57.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.079+0000 7f60bbfff700 1 -- 172.21.15.60:0/3540559629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60bc0f79a0 msgr2=0x7f60bc0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:57.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.079+0000 7f60bbfff700 1 --2- 172.21.15.60:0/3540559629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60bc0f79a0 0x7f60bc0f7dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f60ac009fb0 tx=0x7f60ac009b30).stop 2023-10-18T20:51:57.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.079+0000 7f60bbfff700 1 -- 172.21.15.60:0/3540559629 shutdown_connections 2023-10-18T20:51:57.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.079+0000 7f60bbfff700 1 --2- 172.21.15.60:0/3540559629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60bc0f79a0 0x7f60bc0f7dc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:57.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.079+0000 7f60bbfff700 1 -- 172.21.15.60:0/3540559629 >> 172.21.15.60:0/3540559629 conn(0x7f60bc0f0120 msgr2=0x7f60bc0f2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:57.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.079+0000 7f60bbfff700 1 -- 172.21.15.60:0/3540559629 shutdown_connections 2023-10-18T20:51:57.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.079+0000 7f60bbfff700 1 -- 172.21.15.60:0/3540559629 wait complete. 2023-10-18T20:51:57.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.080+0000 7f60bbfff700 1 Processor -- start 2023-10-18T20:51:57.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.080+0000 7f60bbfff700 1 -- start start 2023-10-18T20:51:57.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.080+0000 7f60bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60bc0f79a0 0x7f60bc1064c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:57.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.080+0000 7f60bbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc1069b0 con 0x7f60bc0f79a0 2023-10-18T20:51:57.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.081+0000 7f60baffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60bc0f79a0 0x7f60bc1064c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:57.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.081+0000 7f60baffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60bc0f79a0 0x7f60bc1064c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:44668/0 (socket says 172.21.15.60:44668) 2023-10-18T20:51:57.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.081+0000 7f60baffd700 1 -- 172.21.15.60:0/1476696472 learned_addr learned my addr 172.21.15.60:0/1476696472 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:51:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.081+0000 7f60baffd700 1 -- 172.21.15.60:0/1476696472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac005040 con 0x7f60bc0f79a0 2023-10-18T20:51:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.081+0000 7f60baffd700 1 --2- 172.21.15.60:0/1476696472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60bc0f79a0 0x7f60bc1064c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f60ac009830 tx=0x7f60ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.081+0000 7f60a37fe700 1 -- 172.21.15.60:0/1476696472 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60ac009320 con 0x7f60bc0f79a0 2023-10-18T20:51:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.081+0000 7f60bbfff700 1 -- 172.21.15.60:0/1476696472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc106bb0 con 0x7f60bc0f79a0 2023-10-18T20:51:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.082+0000 7f60bbfff700 1 -- 172.21.15.60:0/1476696472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc107040 con 0x7f60bc0f79a0 2023-10-18T20:51:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.082+0000 7f60a37fe700 1 -- 172.21.15.60:0/1476696472 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60ac0136c0 con 0x7f60bc0f79a0 2023-10-18T20:51:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.082+0000 7f60a37fe700 1 -- 172.21.15.60:0/1476696472 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60ac01ee90 con 0x7f60bc0f79a0 2023-10-18T20:51:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.082+0000 7f60a37fe700 1 -- 172.21.15.60:0/1476696472 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f60ac014420 con 0x7f60bc0f79a0 2023-10-18T20:51:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.083+0000 7f60a37fe700 1 --2- 172.21.15.60:0/1476696472 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f60a402ff10 0x7f60a40323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.083+0000 7f60bbfff700 1 -- 172.21.15.60:0/1476696472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60bc045ad0 con 0x7f60bc0f79a0 2023-10-18T20:51:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.083+0000 7f60a37fe700 1 -- 172.21.15.60:0/1476696472 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f60ac041ff0 con 0x7f60bc0f79a0 2023-10-18T20:51:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.083+0000 7f60ba7fc700 1 --2- 172.21.15.60:0/1476696472 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f60a402ff10 0x7f60a40323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:57.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.084+0000 7f60ba7fc700 1 --2- 172.21.15.60:0/1476696472 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f60a402ff10 0x7f60a40323d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f60b00096a0 tx=0x7f60b0006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.089+0000 7f60a37fe700 1 -- 172.21.15.60:0/1476696472 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f60ac027770 con 0x7f60bc0f79a0 2023-10-18T20:51:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:57.277+0000 7f60bbfff700 1 -- 172.21.15.60:0/1476696472 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}) v1 -- 0x7f60bc0f12b0 con 0x7f60a402ff10 2023-10-18T20:51:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:56.084047+0000 mgr.smithi008.flmjzp (mgr.14164) 16 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:51:58.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.181+0000 7f60a37fe700 1 -- 172.21.15.60:0/1476696472 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f60bc0f12b0 con 0x7f60a402ff10 2023-10-18T20:51:58.185 INFO:teuthology.orchestra.run.smithi060.stdout:Added host 'smithi060' 2023-10-18T20:51:58.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.184+0000 7f60bbfff700 1 -- 172.21.15.60:0/1476696472 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f60a402ff10 msgr2=0x7f60a40323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:58.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.184+0000 7f60bbfff700 1 --2- 172.21.15.60:0/1476696472 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f60a402ff10 0x7f60a40323d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f60b00096a0 tx=0x7f60b0006b40).stop 2023-10-18T20:51:58.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.184+0000 7f60bbfff700 1 -- 172.21.15.60:0/1476696472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60bc0f79a0 msgr2=0x7f60bc1064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:58.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.184+0000 7f60bbfff700 1 --2- 172.21.15.60:0/1476696472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60bc0f79a0 0x7f60bc1064c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f60ac009830 tx=0x7f60ac00b040).stop 2023-10-18T20:51:58.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.184+0000 7f60bbfff700 1 -- 172.21.15.60:0/1476696472 shutdown_connections 2023-10-18T20:51:58.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.184+0000 7f60bbfff700 1 --2- 172.21.15.60:0/1476696472 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f60a402ff10 0x7f60a40323d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:58.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.184+0000 7f60bbfff700 1 --2- 172.21.15.60:0/1476696472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60bc0f79a0 0x7f60bc1064c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:58.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.184+0000 7f60bbfff700 1 -- 172.21.15.60:0/1476696472 >> 172.21.15.60:0/1476696472 conn(0x7f60bc0f0120 msgr2=0x7f60bc0f0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:58.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.184+0000 7f60bbfff700 1 -- 172.21.15.60:0/1476696472 shutdown_connections 2023-10-18T20:51:58.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:58.184+0000 7f60bbfff700 1 -- 172.21.15.60:0/1476696472 wait complete. 2023-10-18T20:51:58.513 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-18T20:51:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:57.278855+0000 mgr.smithi008.flmjzp (mgr.14164) 17 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:51:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:58.181118+0000 mon.smithi008 (mon.0) 126 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:51:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:51:58.084536+0000 mgr.smithi008.flmjzp (mgr.14164) 18 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:51:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:51:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:51:58.181621+0000 mgr.smithi008.flmjzp (mgr.14164) 19 : cephadm [INF] Added host smithi060 2023-10-18T20:51:59.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.784+0000 7f9dde86f700 1 -- 172.21.15.60:0/3383894036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9dd8060180 msgr2=0x7f9dd80f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:59.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.784+0000 7f9dde86f700 1 --2- 172.21.15.60:0/3383894036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9dd8060180 0x7f9dd80f8f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9dd4009fb0 tx=0x7f9dd4009b30).stop 2023-10-18T20:51:59.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.784+0000 7f9dde86f700 1 -- 172.21.15.60:0/3383894036 shutdown_connections 2023-10-18T20:51:59.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.784+0000 7f9dde86f700 1 --2- 172.21.15.60:0/3383894036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9dd8060180 0x7f9dd80f8f80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:59.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.784+0000 7f9dde86f700 1 -- 172.21.15.60:0/3383894036 >> 172.21.15.60:0/3383894036 conn(0x7f9dd80f09a0 msgr2=0x7f9dd80f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:59.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.784+0000 7f9dde86f700 1 -- 172.21.15.60:0/3383894036 shutdown_connections 2023-10-18T20:51:59.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.784+0000 7f9dde86f700 1 -- 172.21.15.60:0/3383894036 wait complete. 2023-10-18T20:51:59.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.785+0000 7f9dde86f700 1 Processor -- start 2023-10-18T20:51:59.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.785+0000 7f9dde86f700 1 -- start start 2023-10-18T20:51:59.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.785+0000 7f9dde86f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9dd8060180 0x7f9dd8108720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:59.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.785+0000 7f9dde86f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8108c10 con 0x7f9dd8060180 2023-10-18T20:51:59.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.785+0000 7f9ddd86d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9dd8060180 0x7f9dd8108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:59.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.785+0000 7f9ddd86d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9dd8060180 0x7f9dd8108720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:55460/0 (socket says 172.21.15.60:55460) 2023-10-18T20:51:59.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.785+0000 7f9ddd86d700 1 -- 172.21.15.60:0/3794940456 learned_addr learned my addr 172.21.15.60:0/3794940456 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:51:59.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.786+0000 7f9ddd86d700 1 -- 172.21.15.60:0/3794940456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4005040 con 0x7f9dd8060180 2023-10-18T20:51:59.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.786+0000 7f9ddd86d700 1 --2- 172.21.15.60:0/3794940456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9dd8060180 0x7f9dd8108720 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9dd4013510 tx=0x7f9dd400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:59.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.786+0000 7f9dce7fc700 1 -- 172.21.15.60:0/3794940456 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dd4009320 con 0x7f9dd8060180 2023-10-18T20:51:59.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.786+0000 7f9dde86f700 1 -- 172.21.15.60:0/3794940456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd8108e10 con 0x7f9dd8060180 2023-10-18T20:51:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.786+0000 7f9dce7fc700 1 -- 172.21.15.60:0/3794940456 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9dd4013f00 con 0x7f9dd8060180 2023-10-18T20:51:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.786+0000 7f9dce7fc700 1 -- 172.21.15.60:0/3794940456 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dd4014d90 con 0x7f9dd8060180 2023-10-18T20:51:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.786+0000 7f9dde86f700 1 -- 172.21.15.60:0/3794940456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd81092a0 con 0x7f9dd8060180 2023-10-18T20:51:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.787+0000 7f9dce7fc700 1 -- 172.21.15.60:0/3794940456 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f9dd4014420 con 0x7f9dd8060180 2023-10-18T20:51:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.787+0000 7f9dde86f700 1 -- 172.21.15.60:0/3794940456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd8045ad0 con 0x7f9dd8060180 2023-10-18T20:51:59.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.788+0000 7f9dce7fc700 1 --2- 172.21.15.60:0/3794940456 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9dc402ffb0 0x7f9dc4032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:51:59.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.788+0000 7f9dce7fc700 1 -- 172.21.15.60:0/3794940456 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f9dd40410b0 con 0x7f9dd8060180 2023-10-18T20:51:59.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.788+0000 7f9ddd06c700 1 --2- 172.21.15.60:0/3794940456 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9dc402ffb0 0x7f9dc4032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:51:59.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.789+0000 7f9ddd06c700 1 --2- 172.21.15.60:0/3794940456 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9dc402ffb0 0x7f9dc4032470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f9dc80096a0 tx=0x7f9dc8006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:51:59.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.793+0000 7f9dce7fc700 1 -- 172.21.15.60:0/3794940456 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9dd406d2b0 con 0x7f9dd8060180 2023-10-18T20:51:59.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.985+0000 7f9dde86f700 1 -- 172.21.15.60:0/3794940456 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9dd80f1b40 con 0x7f9dc402ffb0 2023-10-18T20:51:59.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.988+0000 7f9dce7fc700 1 -- 172.21.15.60:0/3794940456 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+155 (secure 0 0 0) 0x7f9dd80f1b40 con 0x7f9dc402ffb0 2023-10-18T20:51:59.990 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:51:59.990 INFO:teuthology.orchestra.run.smithi060.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "smithi060", "hostname": "smithi060", "labels": [], "status": ""}] 2023-10-18T20:51:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.989+0000 7f9dde86f700 1 -- 172.21.15.60:0/3794940456 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9dc402ffb0 msgr2=0x7f9dc4032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.989+0000 7f9dde86f700 1 --2- 172.21.15.60:0/3794940456 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9dc402ffb0 0x7f9dc4032470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f9dc80096a0 tx=0x7f9dc8006b40).stop 2023-10-18T20:51:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.989+0000 7f9dde86f700 1 -- 172.21.15.60:0/3794940456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9dd8060180 msgr2=0x7f9dd8108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:51:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.989+0000 7f9dde86f700 1 --2- 172.21.15.60:0/3794940456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9dd8060180 0x7f9dd8108720 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9dd4013510 tx=0x7f9dd400b040).stop 2023-10-18T20:51:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.989+0000 7f9dde86f700 1 -- 172.21.15.60:0/3794940456 shutdown_connections 2023-10-18T20:51:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.989+0000 7f9dde86f700 1 --2- 172.21.15.60:0/3794940456 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9dc402ffb0 0x7f9dc4032470 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.989+0000 7f9dde86f700 1 --2- 172.21.15.60:0/3794940456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9dd8060180 0x7f9dd8108720 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:51:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.989+0000 7f9dde86f700 1 -- 172.21.15.60:0/3794940456 >> 172.21.15.60:0/3794940456 conn(0x7f9dd80f09a0 msgr2=0x7f9dd80f1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:51:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.989+0000 7f9dde86f700 1 -- 172.21.15.60:0/3794940456 shutdown_connections 2023-10-18T20:51:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:51:59.989+0000 7f9dde86f700 1 -- 172.21.15.60:0/3794940456 wait complete. 2023-10-18T20:52:00.373 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-18T20:52:00.373 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd crush tunables default 2023-10-18T20:52:01.558 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:51:59.987594+0000 mgr.smithi008.flmjzp (mgr.14164) 20 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T20:52:01.559 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:00.084937+0000 mgr.smithi008.flmjzp (mgr.14164) 21 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:01.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.816+0000 7fbcef59e700 1 -- 172.21.15.8:0/3966052399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcf00601a0 msgr2=0x7fbcf00f8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:01.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.816+0000 7fbcef59e700 1 --2- 172.21.15.8:0/3966052399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcf00601a0 0x7fbcf00f8f60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fbce0009fb0 tx=0x7fbce0009b30).stop 2023-10-18T20:52:01.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.816+0000 7fbcef59e700 1 -- 172.21.15.8:0/3966052399 shutdown_connections 2023-10-18T20:52:01.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.816+0000 7fbcef59e700 1 --2- 172.21.15.8:0/3966052399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcf00601a0 0x7fbcf00f8f60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:01.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.816+0000 7fbcef59e700 1 -- 172.21.15.8:0/3966052399 >> 172.21.15.8:0/3966052399 conn(0x7fbcf00f09a0 msgr2=0x7fbcf00f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:01.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.816+0000 7fbcef59e700 1 -- 172.21.15.8:0/3966052399 shutdown_connections 2023-10-18T20:52:01.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.816+0000 7fbcef59e700 1 -- 172.21.15.8:0/3966052399 wait complete. 2023-10-18T20:52:01.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.817+0000 7fbcef59e700 1 Processor -- start 2023-10-18T20:52:01.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.818+0000 7fbcef59e700 1 -- start start 2023-10-18T20:52:01.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.818+0000 7fbcef59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcf00601a0 0x7fbcf0106500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:01.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.818+0000 7fbcef59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf01069f0 con 0x7fbcf00601a0 2023-10-18T20:52:01.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.818+0000 7fbcee59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcf00601a0 0x7fbcf0106500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.818+0000 7fbcee59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcf00601a0 0x7fbcf0106500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35994/0 (socket says 172.21.15.8:35994) 2023-10-18T20:52:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.818+0000 7fbcee59c700 1 -- 172.21.15.8:0/1072758765 learned_addr learned my addr 172.21.15.8:0/1072758765 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:52:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.819+0000 7fbcee59c700 1 -- 172.21.15.8:0/1072758765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0005040 con 0x7fbcf00601a0 2023-10-18T20:52:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.819+0000 7fbcee59c700 1 --2- 172.21.15.8:0/1072758765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcf00601a0 0x7fbcf0106500 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbce0014000 tx=0x7fbce000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:01.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.819+0000 7fbcdeffd700 1 -- 172.21.15.8:0/1072758765 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbce00095f0 con 0x7fbcf00601a0 2023-10-18T20:52:01.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.819+0000 7fbcdeffd700 1 -- 172.21.15.8:0/1072758765 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbce0007e70 con 0x7fbcf00601a0 2023-10-18T20:52:01.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.819+0000 7fbcef59e700 1 -- 172.21.15.8:0/1072758765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf0106bf0 con 0x7fbcf00601a0 2023-10-18T20:52:01.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.819+0000 7fbcdeffd700 1 -- 172.21.15.8:0/1072758765 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbce0014ea0 con 0x7fbcf00601a0 2023-10-18T20:52:01.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.819+0000 7fbcef59e700 1 -- 172.21.15.8:0/1072758765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf0107080 con 0x7fbcf00601a0 2023-10-18T20:52:01.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.820+0000 7fbcef59e700 1 -- 172.21.15.8:0/1072758765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf0045ad0 con 0x7fbcf00601a0 2023-10-18T20:52:01.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.820+0000 7fbcdeffd700 1 -- 172.21.15.8:0/1072758765 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fbce0025070 con 0x7fbcf00601a0 2023-10-18T20:52:01.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.821+0000 7fbcdeffd700 1 --2- 172.21.15.8:0/1072758765 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbcd802ff60 0x7fbcd8032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:01.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.821+0000 7fbcdeffd700 1 -- 172.21.15.8:0/1072758765 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fbce0040990 con 0x7fbcf00601a0 2023-10-18T20:52:01.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.821+0000 7fbcedd9b700 1 --2- 172.21.15.8:0/1072758765 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbcd802ff60 0x7fbcd8032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:01.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.822+0000 7fbcedd9b700 1 --2- 172.21.15.8:0/1072758765 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbcd802ff60 0x7fbcd8032420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fbce40096a0 tx=0x7fbce4006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:01.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:01.825+0000 7fbcdeffd700 1 -- 172.21.15.8:0/1072758765 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fbce0026350 con 0x7fbcf00601a0 2023-10-18T20:52:02.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.020+0000 7fbcef59e700 1 -- 172.21.15.8:0/1072758765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbcf0107ed0 con 0x7fbcf00601a0 2023-10-18T20:52:02.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.331+0000 7fbcdeffd700 1 -- 172.21.15.8:0/1072758765 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v5) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbce0025300 con 0x7fbcf00601a0 2023-10-18T20:52:02.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.333+0000 7fbcef59e700 1 -- 172.21.15.8:0/1072758765 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbcd802ff60 msgr2=0x7fbcd8032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:02.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.333+0000 7fbcef59e700 1 --2- 172.21.15.8:0/1072758765 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbcd802ff60 0x7fbcd8032420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fbce40096a0 tx=0x7fbce4006b40).stop 2023-10-18T20:52:02.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.333+0000 7fbcef59e700 1 -- 172.21.15.8:0/1072758765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcf00601a0 msgr2=0x7fbcf0106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:02.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.333+0000 7fbcef59e700 1 --2- 172.21.15.8:0/1072758765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcf00601a0 0x7fbcf0106500 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbce0014000 tx=0x7fbce000b040).stop 2023-10-18T20:52:02.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.333+0000 7fbcef59e700 1 -- 172.21.15.8:0/1072758765 shutdown_connections 2023-10-18T20:52:02.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.333+0000 7fbcef59e700 1 --2- 172.21.15.8:0/1072758765 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbcd802ff60 0x7fbcd8032420 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:02.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.333+0000 7fbcef59e700 1 --2- 172.21.15.8:0/1072758765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcf00601a0 0x7fbcf0106500 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:02.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.333+0000 7fbcef59e700 1 -- 172.21.15.8:0/1072758765 >> 172.21.15.8:0/1072758765 conn(0x7fbcf00f09a0 msgr2=0x7fbcf00f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:02.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.333+0000 7fbcef59e700 1 -- 172.21.15.8:0/1072758765 shutdown_connections 2023-10-18T20:52:02.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:02.333+0000 7fbcef59e700 1 -- 172.21.15.8:0/1072758765 wait complete. 2023-10-18T20:52:02.338 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2023-10-18T20:52:02.584 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:02.022289+0000 mon.smithi008 (mon.0) 127 : audit [INF] from='client.? 172.21.15.8:0/1072758765' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-18T20:52:02.751 INFO:tasks.cephadm:Adding mon.smithi008 on smithi008 2023-10-18T20:52:02.752 INFO:tasks.cephadm:Adding mon.smithi060 on smithi060 2023-10-18T20:52:02.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph orch apply mon '2;smithi008:172.21.15.8=smithi008;smithi060:172.21.15.60=smithi060' 2023-10-18T20:52:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:02.085165+0000 mgr.smithi008.flmjzp (mgr.14164) 22 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:02.332445+0000 mon.smithi008 (mon.0) 128 : audit [INF] from='client.? 172.21.15.8:0/1072758765' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-18T20:52:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:02.332520+0000 mon.smithi008 (mon.0) 129 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2023-10-18T20:52:04.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.064+0000 7f4dadb71700 1 -- 172.21.15.60:0/3719039340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da8060160 msgr2=0x7f4da80fb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.064+0000 7f4dadb71700 1 --2- 172.21.15.60:0/3719039340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da8060160 0x7f4da80fb3a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f4d9c009fb0 tx=0x7f4d9c009b30).stop 2023-10-18T20:52:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.064+0000 7f4dadb71700 1 -- 172.21.15.60:0/3719039340 shutdown_connections 2023-10-18T20:52:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.064+0000 7f4dadb71700 1 --2- 172.21.15.60:0/3719039340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da8060160 0x7f4da80fb3a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.064+0000 7f4dadb71700 1 -- 172.21.15.60:0/3719039340 >> 172.21.15.60:0/3719039340 conn(0x7f4da80f09a0 msgr2=0x7f4da80f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.064+0000 7f4dadb71700 1 -- 172.21.15.60:0/3719039340 shutdown_connections 2023-10-18T20:52:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.064+0000 7f4dadb71700 1 -- 172.21.15.60:0/3719039340 wait complete. 2023-10-18T20:52:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.065+0000 7f4dadb71700 1 Processor -- start 2023-10-18T20:52:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.065+0000 7f4dadb71700 1 -- start start 2023-10-18T20:52:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.065+0000 7f4dadb71700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da8060160 0x7f4da81086f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.065+0000 7f4dadb71700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8108be0 con 0x7f4da8060160 2023-10-18T20:52:04.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.066+0000 7f4dacb6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da8060160 0x7f4da81086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:04.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.066+0000 7f4dacb6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da8060160 0x7f4da81086f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:55482/0 (socket says 172.21.15.60:55482) 2023-10-18T20:52:04.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.066+0000 7f4dacb6f700 1 -- 172.21.15.60:0/3516547871 learned_addr learned my addr 172.21.15.60:0/3516547871 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:04.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.066+0000 7f4dacb6f700 1 -- 172.21.15.60:0/3516547871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c005040 con 0x7f4da8060160 2023-10-18T20:52:04.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.066+0000 7f4dacb6f700 1 --2- 172.21.15.60:0/3516547871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da8060160 0x7f4da81086f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4d9c013510 tx=0x7f4d9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:04.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.067+0000 7f4da57fa700 1 -- 172.21.15.60:0/3516547871 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d9c009320 con 0x7f4da8060160 2023-10-18T20:52:04.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.067+0000 7f4dadb71700 1 -- 172.21.15.60:0/3516547871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da8108de0 con 0x7f4da8060160 2023-10-18T20:52:04.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.067+0000 7f4da57fa700 1 -- 172.21.15.60:0/3516547871 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d9c013f00 con 0x7f4da8060160 2023-10-18T20:52:04.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.067+0000 7f4da57fa700 1 -- 172.21.15.60:0/3516547871 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d9c014d90 con 0x7f4da8060160 2023-10-18T20:52:04.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.067+0000 7f4dadb71700 1 -- 172.21.15.60:0/3516547871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da8109270 con 0x7f4da8060160 2023-10-18T20:52:04.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.068+0000 7f4da57fa700 1 -- 172.21.15.60:0/3516547871 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f4d9c014420 con 0x7f4da8060160 2023-10-18T20:52:04.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.068+0000 7f4dadb71700 1 -- 172.21.15.60:0/3516547871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da8045ad0 con 0x7f4da8060160 2023-10-18T20:52:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.068+0000 7f4da57fa700 1 --2- 172.21.15.60:0/3516547871 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4d9802ffb0 0x7f4d98032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.068+0000 7f4da57fa700 1 -- 172.21.15.60:0/3516547871 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f4d9c0410b0 con 0x7f4da8060160 2023-10-18T20:52:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.069+0000 7f4da7fff700 1 --2- 172.21.15.60:0/3516547871 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4d9802ffb0 0x7f4d98032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.069+0000 7f4da7fff700 1 --2- 172.21.15.60:0/3516547871 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4d9802ffb0 0x7f4d98032470 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f4d940096a0 tx=0x7f4d94006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.074+0000 7f4da57fa700 1 -- 172.21.15.60:0/3516547871 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4d9c06d2b0 con 0x7f4da8060160 2023-10-18T20:52:04.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.266+0000 7f4dadb71700 1 -- 172.21.15.60:0/3516547871 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi008:172.21.15.8=smithi008;smithi060:172.21.15.60=smithi060", "target": ["mon-mgr", ""]}) v1 -- 0x7f4da80f1bb0 con 0x7f4d9802ffb0 2023-10-18T20:52:04.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.272+0000 7f4da57fa700 1 -- 172.21.15.60:0/3516547871 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4da80f1bb0 con 0x7f4d9802ffb0 2023-10-18T20:52:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:Scheduled mon update... 2023-10-18T20:52:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.274+0000 7f4dadb71700 1 -- 172.21.15.60:0/3516547871 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4d9802ffb0 msgr2=0x7f4d98032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.274+0000 7f4dadb71700 1 --2- 172.21.15.60:0/3516547871 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4d9802ffb0 0x7f4d98032470 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f4d940096a0 tx=0x7f4d94006b40).stop 2023-10-18T20:52:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.274+0000 7f4dadb71700 1 -- 172.21.15.60:0/3516547871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da8060160 msgr2=0x7f4da81086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.274+0000 7f4dadb71700 1 --2- 172.21.15.60:0/3516547871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da8060160 0x7f4da81086f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4d9c013510 tx=0x7f4d9c00b040).stop 2023-10-18T20:52:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.274+0000 7f4dadb71700 1 -- 172.21.15.60:0/3516547871 shutdown_connections 2023-10-18T20:52:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.274+0000 7f4dadb71700 1 --2- 172.21.15.60:0/3516547871 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4d9802ffb0 0x7f4d98032470 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.274+0000 7f4dadb71700 1 --2- 172.21.15.60:0/3516547871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da8060160 0x7f4da81086f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.274+0000 7f4dadb71700 1 -- 172.21.15.60:0/3516547871 >> 172.21.15.60:0/3516547871 conn(0x7f4da80f09a0 msgr2=0x7f4da80f14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.274+0000 7f4dadb71700 1 -- 172.21.15.60:0/3516547871 shutdown_connections 2023-10-18T20:52:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:04.274+0000 7f4dadb71700 1 -- 172.21.15.60:0/3516547871 wait complete. 2023-10-18T20:52:04.631 DEBUG:teuthology.orchestra.run.smithi060:mon.smithi060> sudo journalctl -f -n 0 -u ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi060.service 2023-10-18T20:52:04.636 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:04.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:04.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:-- Logs begin at Wed 2023-10-18 20:14:49 UTC. -- 2023-10-18T20:52:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:04.085379+0000 mgr.smithi008.flmjzp (mgr.14164) 23 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:04.268543+0000 mgr.smithi008.flmjzp (mgr.14164) 24 : audit [DBG] from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi008:172.21.15.8=smithi008;smithi060:172.21.15.60=smithi060", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:52:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:52:04.269965+0000 mgr.smithi008.flmjzp (mgr.14164) 25 : cephadm [INF] Saving service mon spec with placement smithi008:172.21.15.8=smithi008;smithi060:172.21.15.60=smithi060;count:2 2023-10-18T20:52:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:04.272504+0000 mon.smithi008 (mon.0) 130 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.050+0000 7fc44095d700 1 -- 172.21.15.60:0/4154140929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c060180 msgr2=0x7fc43c0f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.050+0000 7fc44095d700 1 --2- 172.21.15.60:0/4154140929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c060180 0x7fc43c0f8f80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fc42c009fb0 tx=0x7fc42c009b30).stop 2023-10-18T20:52:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.050+0000 7fc44095d700 1 -- 172.21.15.60:0/4154140929 shutdown_connections 2023-10-18T20:52:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.050+0000 7fc44095d700 1 --2- 172.21.15.60:0/4154140929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c060180 0x7fc43c0f8f80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.050+0000 7fc44095d700 1 -- 172.21.15.60:0/4154140929 >> 172.21.15.60:0/4154140929 conn(0x7fc43c0f09a0 msgr2=0x7fc43c0f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.050+0000 7fc44095d700 1 -- 172.21.15.60:0/4154140929 shutdown_connections 2023-10-18T20:52:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.050+0000 7fc44095d700 1 -- 172.21.15.60:0/4154140929 wait complete. 2023-10-18T20:52:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.051+0000 7fc44095d700 1 Processor -- start 2023-10-18T20:52:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.051+0000 7fc44095d700 1 -- start start 2023-10-18T20:52:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.051+0000 7fc44095d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c060180 0x7fc43c108720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.051+0000 7fc44095d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c108c10 con 0x7fc43c060180 2023-10-18T20:52:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.051+0000 7fc43b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c060180 0x7fc43c108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.051+0000 7fc43b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c060180 0x7fc43c108720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:55494/0 (socket says 172.21.15.60:55494) 2023-10-18T20:52:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.051+0000 7fc43b7fe700 1 -- 172.21.15.60:0/1742430438 learned_addr learned my addr 172.21.15.60:0/1742430438 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.052+0000 7fc43b7fe700 1 -- 172.21.15.60:0/1742430438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c005040 con 0x7fc43c060180 2023-10-18T20:52:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.052+0000 7fc43b7fe700 1 --2- 172.21.15.60:0/1742430438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c060180 0x7fc43c108720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc42c013510 tx=0x7fc42c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.052+0000 7fc423fff700 1 -- 172.21.15.60:0/1742430438 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc42c009320 con 0x7fc43c060180 2023-10-18T20:52:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.052+0000 7fc423fff700 1 -- 172.21.15.60:0/1742430438 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc42c013f00 con 0x7fc43c060180 2023-10-18T20:52:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.052+0000 7fc44095d700 1 -- 172.21.15.60:0/1742430438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c108e10 con 0x7fc43c060180 2023-10-18T20:52:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.052+0000 7fc423fff700 1 -- 172.21.15.60:0/1742430438 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc42c014d90 con 0x7fc43c060180 2023-10-18T20:52:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.052+0000 7fc44095d700 1 -- 172.21.15.60:0/1742430438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c1092a0 con 0x7fc43c060180 2023-10-18T20:52:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.053+0000 7fc423fff700 1 -- 172.21.15.60:0/1742430438 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fc42c014420 con 0x7fc43c060180 2023-10-18T20:52:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.053+0000 7fc44095d700 1 -- 172.21.15.60:0/1742430438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c045ad0 con 0x7fc43c060180 2023-10-18T20:52:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.054+0000 7fc423fff700 1 --2- 172.21.15.60:0/1742430438 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc42402ffb0 0x7fc424032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.054+0000 7fc423fff700 1 -- 172.21.15.60:0/1742430438 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fc42c0410b0 con 0x7fc43c060180 2023-10-18T20:52:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.054+0000 7fc43affd700 1 --2- 172.21.15.60:0/1742430438 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc42402ffb0 0x7fc424032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.055+0000 7fc43affd700 1 --2- 172.21.15.60:0/1742430438 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc42402ffb0 0x7fc424032470 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fc4300096a0 tx=0x7fc430006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.058+0000 7fc423fff700 1 -- 172.21.15.60:0/1742430438 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc42c06d2b0 con 0x7fc43c060180 2023-10-18T20:52:06.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.291+0000 7fc44095d700 1 -- 172.21.15.60:0/1742430438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc43c10a0f0 con 0x7fc43c060180 2023-10-18T20:52:06.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.292+0000 7fc423fff700 1 -- 172.21.15.60:0/1742430438 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7fc42c0095f0 con 0x7fc43c060180 2023-10-18T20:52:06.295 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:06.295 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.294+0000 7fc44095d700 1 -- 172.21.15.60:0/1742430438 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc42402ffb0 msgr2=0x7fc424032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.294+0000 7fc44095d700 1 --2- 172.21.15.60:0/1742430438 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc42402ffb0 0x7fc424032470 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fc4300096a0 tx=0x7fc430006b40).stop 2023-10-18T20:52:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.294+0000 7fc44095d700 1 -- 172.21.15.60:0/1742430438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c060180 msgr2=0x7fc43c108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.294+0000 7fc44095d700 1 --2- 172.21.15.60:0/1742430438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c060180 0x7fc43c108720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc42c013510 tx=0x7fc42c00b040).stop 2023-10-18T20:52:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.294+0000 7fc44095d700 1 -- 172.21.15.60:0/1742430438 shutdown_connections 2023-10-18T20:52:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.294+0000 7fc44095d700 1 --2- 172.21.15.60:0/1742430438 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc42402ffb0 0x7fc424032470 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.294+0000 7fc44095d700 1 --2- 172.21.15.60:0/1742430438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c060180 0x7fc43c108720 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.294+0000 7fc44095d700 1 -- 172.21.15.60:0/1742430438 >> 172.21.15.60:0/1742430438 conn(0x7fc43c0f09a0 msgr2=0x7fc43c0f1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.294+0000 7fc44095d700 1 -- 172.21.15.60:0/1742430438 shutdown_connections 2023-10-18T20:52:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:06.294+0000 7fc44095d700 1 -- 172.21.15.60:0/1742430438 wait complete. 2023-10-18T20:52:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:07.669 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:07.669 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:06.085619+0000 mgr.smithi008.flmjzp (mgr.14164) 26 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:06.293030+0000 mon.smithi008 (mon.0) 131 : audit [DBG] from='client.? 172.21.15.60:0/1742430438' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:08.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.955+0000 7f4e654e5700 1 -- 172.21.15.60:0/3825526359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e600601e0 msgr2=0x7f4e600f8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:08.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.955+0000 7f4e654e5700 1 --2- 172.21.15.60:0/3825526359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e600601e0 0x7f4e600f8f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4e50009fb0 tx=0x7f4e50009b30).stop 2023-10-18T20:52:08.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.955+0000 7f4e654e5700 1 -- 172.21.15.60:0/3825526359 shutdown_connections 2023-10-18T20:52:08.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.955+0000 7f4e654e5700 1 --2- 172.21.15.60:0/3825526359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e600601e0 0x7f4e600f8f20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:08.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.955+0000 7f4e654e5700 1 -- 172.21.15.60:0/3825526359 >> 172.21.15.60:0/3825526359 conn(0x7f4e600f09a0 msgr2=0x7f4e600f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:08.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.955+0000 7f4e654e5700 1 -- 172.21.15.60:0/3825526359 shutdown_connections 2023-10-18T20:52:08.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.955+0000 7f4e654e5700 1 -- 172.21.15.60:0/3825526359 wait complete. 2023-10-18T20:52:08.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.956+0000 7f4e654e5700 1 Processor -- start 2023-10-18T20:52:08.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.956+0000 7f4e654e5700 1 -- start start 2023-10-18T20:52:08.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.956+0000 7f4e654e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e600601e0 0x7f4e60108720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:08.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.956+0000 7f4e654e5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60108c10 con 0x7f4e600601e0 2023-10-18T20:52:08.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.957+0000 7f4e5ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e600601e0 0x7f4e60108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:08.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.957+0000 7f4e5ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e600601e0 0x7f4e60108720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:38856/0 (socket says 172.21.15.60:38856) 2023-10-18T20:52:08.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.957+0000 7f4e5ffff700 1 -- 172.21.15.60:0/3701633716 learned_addr learned my addr 172.21.15.60:0/3701633716 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:08.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.957+0000 7f4e5ffff700 1 -- 172.21.15.60:0/3701633716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50005040 con 0x7f4e600601e0 2023-10-18T20:52:08.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.957+0000 7f4e5ffff700 1 --2- 172.21.15.60:0/3701633716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e600601e0 0x7f4e60108720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4e50013510 tx=0x7f4e5000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:08.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.957+0000 7f4e5cff9700 1 -- 172.21.15.60:0/3701633716 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e50009320 con 0x7f4e600601e0 2023-10-18T20:52:08.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.957+0000 7f4e5cff9700 1 -- 172.21.15.60:0/3701633716 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e50013f00 con 0x7f4e600601e0 2023-10-18T20:52:08.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.957+0000 7f4e654e5700 1 -- 172.21.15.60:0/3701633716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e60108e10 con 0x7f4e600601e0 2023-10-18T20:52:08.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.957+0000 7f4e5cff9700 1 -- 172.21.15.60:0/3701633716 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e50014d90 con 0x7f4e600601e0 2023-10-18T20:52:08.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.958+0000 7f4e654e5700 1 -- 172.21.15.60:0/3701633716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e601092a0 con 0x7f4e600601e0 2023-10-18T20:52:08.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.958+0000 7f4e5cff9700 1 -- 172.21.15.60:0/3701633716 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f4e500095f0 con 0x7f4e600601e0 2023-10-18T20:52:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.958+0000 7f4e654e5700 1 -- 172.21.15.60:0/3701633716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e60045ad0 con 0x7f4e600601e0 2023-10-18T20:52:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.959+0000 7f4e5cff9700 1 --2- 172.21.15.60:0/3701633716 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e4802ff60 0x7f4e48032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.959+0000 7f4e5cff9700 1 -- 172.21.15.60:0/3701633716 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f4e500410c0 con 0x7f4e600601e0 2023-10-18T20:52:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.959+0000 7f4e5f7fe700 1 --2- 172.21.15.60:0/3701633716 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e4802ff60 0x7f4e48032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.960+0000 7f4e5f7fe700 1 --2- 172.21.15.60:0/3701633716 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e4802ff60 0x7f4e48032420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4e540096a0 tx=0x7f4e54006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:08.964+0000 7f4e5cff9700 1 -- 172.21.15.60:0/3701633716 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4e5001d7f0 con 0x7f4e600601e0 2023-10-18T20:52:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.194+0000 7f4e654e5700 1 -- 172.21.15.60:0/3701633716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4e6010a150 con 0x7f4e600601e0 2023-10-18T20:52:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.194+0000 7f4e5cff9700 1 -- 172.21.15.60:0/3701633716 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7f4e50010230 con 0x7f4e600601e0 2023-10-18T20:52:09.197 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:09.197 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:09.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.196+0000 7f4e654e5700 1 -- 172.21.15.60:0/3701633716 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e4802ff60 msgr2=0x7f4e48032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:09.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.196+0000 7f4e654e5700 1 --2- 172.21.15.60:0/3701633716 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e4802ff60 0x7f4e48032420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4e540096a0 tx=0x7f4e54006b40).stop 2023-10-18T20:52:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.196+0000 7f4e654e5700 1 -- 172.21.15.60:0/3701633716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e600601e0 msgr2=0x7f4e60108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.196+0000 7f4e654e5700 1 --2- 172.21.15.60:0/3701633716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e600601e0 0x7f4e60108720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4e50013510 tx=0x7f4e5000b040).stop 2023-10-18T20:52:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.196+0000 7f4e654e5700 1 -- 172.21.15.60:0/3701633716 shutdown_connections 2023-10-18T20:52:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.196+0000 7f4e654e5700 1 --2- 172.21.15.60:0/3701633716 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e4802ff60 0x7f4e48032420 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.196+0000 7f4e654e5700 1 --2- 172.21.15.60:0/3701633716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e600601e0 0x7f4e60108720 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:09.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.196+0000 7f4e654e5700 1 -- 172.21.15.60:0/3701633716 >> 172.21.15.60:0/3701633716 conn(0x7f4e600f09a0 msgr2=0x7f4e600f13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:09.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.196+0000 7f4e654e5700 1 -- 172.21.15.60:0/3701633716 shutdown_connections 2023-10-18T20:52:09.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:09.196+0000 7f4e654e5700 1 -- 172.21.15.60:0/3701633716 wait complete. 2023-10-18T20:52:09.200 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:08.085867+0000 mgr.smithi008.flmjzp (mgr.14164) 27 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:09.195483+0000 mon.smithi008 (mon.0) 132 : audit [DBG] from='client.? 172.21.15.60:0/3701633716' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:10.671 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:10.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:10.086316+0000 mgr.smithi008.flmjzp (mgr.14164) 28 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:12.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.615+0000 7f8a72762700 1 -- 172.21.15.60:0/3800280225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a6c0601e0 msgr2=0x7f8a6c0f8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:12.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.615+0000 7f8a72762700 1 --2- 172.21.15.60:0/3800280225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a6c0601e0 0x7f8a6c0f8f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8a68009fb0 tx=0x7f8a68009b30).stop 2023-10-18T20:52:12.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.615+0000 7f8a72762700 1 -- 172.21.15.60:0/3800280225 shutdown_connections 2023-10-18T20:52:12.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.615+0000 7f8a72762700 1 --2- 172.21.15.60:0/3800280225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a6c0601e0 0x7f8a6c0f8f20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:12.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.615+0000 7f8a72762700 1 -- 172.21.15.60:0/3800280225 >> 172.21.15.60:0/3800280225 conn(0x7f8a6c0f09a0 msgr2=0x7f8a6c0f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:12.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.615+0000 7f8a72762700 1 -- 172.21.15.60:0/3800280225 shutdown_connections 2023-10-18T20:52:12.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.615+0000 7f8a72762700 1 -- 172.21.15.60:0/3800280225 wait complete. 2023-10-18T20:52:12.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.616+0000 7f8a72762700 1 Processor -- start 2023-10-18T20:52:12.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.616+0000 7f8a72762700 1 -- start start 2023-10-18T20:52:12.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.617+0000 7f8a72762700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a6c0601e0 0x7f8a6c0f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:12.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.617+0000 7f8a72762700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0f4e20 con 0x7f8a6c0601e0 2023-10-18T20:52:12.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.617+0000 7f8a71760700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a6c0601e0 0x7f8a6c0f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:12.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.617+0000 7f8a71760700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a6c0601e0 0x7f8a6c0f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:38878/0 (socket says 172.21.15.60:38878) 2023-10-18T20:52:12.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.617+0000 7f8a71760700 1 -- 172.21.15.60:0/1091906400 learned_addr learned my addr 172.21.15.60:0/1091906400 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:12.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.617+0000 7f8a71760700 1 -- 172.21.15.60:0/1091906400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68005040 con 0x7f8a6c0601e0 2023-10-18T20:52:12.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.618+0000 7f8a71760700 1 --2- 172.21.15.60:0/1091906400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a6c0601e0 0x7f8a6c0f69a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8a68013510 tx=0x7f8a6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:12.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.618+0000 7f8a61ffb700 1 -- 172.21.15.60:0/1091906400 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a68009320 con 0x7f8a6c0601e0 2023-10-18T20:52:12.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.618+0000 7f8a72762700 1 -- 172.21.15.60:0/1091906400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c0f4fc0 con 0x7f8a6c0601e0 2023-10-18T20:52:12.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.618+0000 7f8a61ffb700 1 -- 172.21.15.60:0/1091906400 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a68013f00 con 0x7f8a6c0601e0 2023-10-18T20:52:12.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.618+0000 7f8a61ffb700 1 -- 172.21.15.60:0/1091906400 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a68014d90 con 0x7f8a6c0601e0 2023-10-18T20:52:12.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.618+0000 7f8a72762700 1 -- 172.21.15.60:0/1091906400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c0f5450 con 0x7f8a6c0601e0 2023-10-18T20:52:12.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.619+0000 7f8a61ffb700 1 -- 172.21.15.60:0/1091906400 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f8a68014420 con 0x7f8a6c0601e0 2023-10-18T20:52:12.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.619+0000 7f8a72762700 1 -- 172.21.15.60:0/1091906400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c059100 con 0x7f8a6c0601e0 2023-10-18T20:52:12.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.619+0000 7f8a61ffb700 1 --2- 172.21.15.60:0/1091906400 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a5802ff60 0x7f8a58032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:12.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.619+0000 7f8a61ffb700 1 -- 172.21.15.60:0/1091906400 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f8a680410c0 con 0x7f8a6c0601e0 2023-10-18T20:52:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.620+0000 7f8a70f5f700 1 --2- 172.21.15.60:0/1091906400 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a5802ff60 0x7f8a58032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.620+0000 7f8a70f5f700 1 --2- 172.21.15.60:0/1091906400 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a5802ff60 0x7f8a58032420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f8a5c0096a0 tx=0x7f8a5c006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.624+0000 7f8a61ffb700 1 -- 172.21.15.60:0/1091906400 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8a680095f0 con 0x7f8a6c0601e0 2023-10-18T20:52:12.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.850+0000 7f8a72762700 1 -- 172.21.15.60:0/1091906400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8a6c0fbcd0 con 0x7f8a6c0601e0 2023-10-18T20:52:12.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.851+0000 7f8a61ffb700 1 -- 172.21.15.60:0/1091906400 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7f8a6801db70 con 0x7f8a6c0601e0 2023-10-18T20:52:12.853 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:12.854 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.852+0000 7f8a72762700 1 -- 172.21.15.60:0/1091906400 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a5802ff60 msgr2=0x7f8a58032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.852+0000 7f8a72762700 1 --2- 172.21.15.60:0/1091906400 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a5802ff60 0x7f8a58032420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f8a5c0096a0 tx=0x7f8a5c006b40).stop 2023-10-18T20:52:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.852+0000 7f8a72762700 1 -- 172.21.15.60:0/1091906400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a6c0601e0 msgr2=0x7f8a6c0f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.852+0000 7f8a72762700 1 --2- 172.21.15.60:0/1091906400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a6c0601e0 0x7f8a6c0f69a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8a68013510 tx=0x7f8a6800b040).stop 2023-10-18T20:52:12.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.853+0000 7f8a72762700 1 -- 172.21.15.60:0/1091906400 shutdown_connections 2023-10-18T20:52:12.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.853+0000 7f8a72762700 1 --2- 172.21.15.60:0/1091906400 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a5802ff60 0x7f8a58032420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:12.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.853+0000 7f8a72762700 1 --2- 172.21.15.60:0/1091906400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a6c0601e0 0x7f8a6c0f69a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:12.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.853+0000 7f8a72762700 1 -- 172.21.15.60:0/1091906400 >> 172.21.15.60:0/1091906400 conn(0x7f8a6c0f09a0 msgr2=0x7f8a6c0f1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:12.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.853+0000 7f8a72762700 1 -- 172.21.15.60:0/1091906400 shutdown_connections 2023-10-18T20:52:12.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:12.853+0000 7f8a72762700 1 -- 172.21.15.60:0/1091906400 wait complete. 2023-10-18T20:52:12.857 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:12.016462+0000 mon.smithi008 (mon.0) 133 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:52:12.018909+0000 mgr.smithi008.flmjzp (mgr.14164) 29 : cephadm [INF] Deploying daemon node-exporter.smithi008 on smithi008 2023-10-18T20:52:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:12.086524+0000 mgr.smithi008.flmjzp (mgr.14164) 30 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:12.851982+0000 mon.smithi008 (mon.0) 134 : audit [DBG] from='client.? 172.21.15.60:0/1091906400' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:14.326 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:14.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:15.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.613+0000 7f743c872700 1 -- 172.21.15.60:0/487156913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7438060180 msgr2=0x7f74380f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:15.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.613+0000 7f743c872700 1 --2- 172.21.15.60:0/487156913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7438060180 0x7f74380f8f80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f7428009fb0 tx=0x7f7428009b30).stop 2023-10-18T20:52:15.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.614+0000 7f743c872700 1 -- 172.21.15.60:0/487156913 shutdown_connections 2023-10-18T20:52:15.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.614+0000 7f743c872700 1 --2- 172.21.15.60:0/487156913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7438060180 0x7f74380f8f80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:15.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.614+0000 7f743c872700 1 -- 172.21.15.60:0/487156913 >> 172.21.15.60:0/487156913 conn(0x7f74380f09a0 msgr2=0x7f74380f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:15.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.614+0000 7f743c872700 1 -- 172.21.15.60:0/487156913 shutdown_connections 2023-10-18T20:52:15.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.614+0000 7f743c872700 1 -- 172.21.15.60:0/487156913 wait complete. 2023-10-18T20:52:15.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.614+0000 7f743c872700 1 Processor -- start 2023-10-18T20:52:15.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.615+0000 7f743c872700 1 -- start start 2023-10-18T20:52:15.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.615+0000 7f743c872700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7438060180 0x7f7438108720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:15.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.615+0000 7f743c872700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7438108c10 con 0x7f7438060180 2023-10-18T20:52:15.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.615+0000 7f7436d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7438060180 0x7f7438108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:15.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.615+0000 7f7436d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7438060180 0x7f7438108720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:38904/0 (socket says 172.21.15.60:38904) 2023-10-18T20:52:15.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.615+0000 7f7436d9d700 1 -- 172.21.15.60:0/1493987475 learned_addr learned my addr 172.21.15.60:0/1493987475 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:15.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.616+0000 7f7436d9d700 1 -- 172.21.15.60:0/1493987475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428005040 con 0x7f7438060180 2023-10-18T20:52:15.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.616+0000 7f7436d9d700 1 --2- 172.21.15.60:0/1493987475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7438060180 0x7f7438108720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f7428013510 tx=0x7f742800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:15.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.616+0000 7f741f7fe700 1 -- 172.21.15.60:0/1493987475 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7428009320 con 0x7f7438060180 2023-10-18T20:52:15.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.616+0000 7f741f7fe700 1 -- 172.21.15.60:0/1493987475 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7428013f00 con 0x7f7438060180 2023-10-18T20:52:15.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.616+0000 7f741f7fe700 1 -- 172.21.15.60:0/1493987475 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7428014d90 con 0x7f7438060180 2023-10-18T20:52:15.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.616+0000 7f743c872700 1 -- 172.21.15.60:0/1493987475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7438108e10 con 0x7f7438060180 2023-10-18T20:52:15.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.617+0000 7f743c872700 1 -- 172.21.15.60:0/1493987475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74381092a0 con 0x7f7438060180 2023-10-18T20:52:15.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.617+0000 7f743c872700 1 -- 172.21.15.60:0/1493987475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7438045ad0 con 0x7f7438060180 2023-10-18T20:52:15.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.617+0000 7f741f7fe700 1 -- 172.21.15.60:0/1493987475 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f74280263a0 con 0x7f7438060180 2023-10-18T20:52:15.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.618+0000 7f741f7fe700 1 --2- 172.21.15.60:0/1493987475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f742002ffb0 0x7f7420032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:15.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.618+0000 7f741f7fe700 1 -- 172.21.15.60:0/1493987475 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f7428041340 con 0x7f7438060180 2023-10-18T20:52:15.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.618+0000 7f743659c700 1 --2- 172.21.15.60:0/1493987475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f742002ffb0 0x7f7420032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:15.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.619+0000 7f743659c700 1 --2- 172.21.15.60:0/1493987475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f742002ffb0 0x7f7420032470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f742c0096a0 tx=0x7f742c006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:15.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.623+0000 7f741f7fe700 1 -- 172.21.15.60:0/1493987475 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f74280126f0 con 0x7f7438060180 2023-10-18T20:52:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:14.086915+0000 mgr.smithi008.flmjzp (mgr.14164) 31 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:15.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.850+0000 7f743c872700 1 -- 172.21.15.60:0/1493987475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f743810a150 con 0x7f7438060180 2023-10-18T20:52:15.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.851+0000 7f741f7fe700 1 -- 172.21.15.60:0/1493987475 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7f7428012330 con 0x7f7438060180 2023-10-18T20:52:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:15.854 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:15.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.853+0000 7f743c872700 1 -- 172.21.15.60:0/1493987475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f742002ffb0 msgr2=0x7f7420032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:15.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.853+0000 7f743c872700 1 --2- 172.21.15.60:0/1493987475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f742002ffb0 0x7f7420032470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f742c0096a0 tx=0x7f742c006b40).stop 2023-10-18T20:52:15.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.853+0000 7f743c872700 1 -- 172.21.15.60:0/1493987475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7438060180 msgr2=0x7f7438108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:15.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.853+0000 7f743c872700 1 --2- 172.21.15.60:0/1493987475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7438060180 0x7f7438108720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f7428013510 tx=0x7f742800b040).stop 2023-10-18T20:52:15.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.853+0000 7f743c872700 1 -- 172.21.15.60:0/1493987475 shutdown_connections 2023-10-18T20:52:15.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.853+0000 7f743c872700 1 --2- 172.21.15.60:0/1493987475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f742002ffb0 0x7f7420032470 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:15.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.853+0000 7f743c872700 1 --2- 172.21.15.60:0/1493987475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7438060180 0x7f7438108720 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:15.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.853+0000 7f743c872700 1 -- 172.21.15.60:0/1493987475 >> 172.21.15.60:0/1493987475 conn(0x7f74380f09a0 msgr2=0x7f74380f1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:15.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.853+0000 7f743c872700 1 -- 172.21.15.60:0/1493987475 shutdown_connections 2023-10-18T20:52:15.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:15.853+0000 7f743c872700 1 -- 172.21.15.60:0/1493987475 wait complete. 2023-10-18T20:52:15.857 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:15.851810+0000 mon.smithi008 (mon.0) 135 : audit [DBG] from='client.? 172.21.15.60:0/1493987475' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:17.223 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:17.224 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:16.087278+0000 mgr.smithi008.flmjzp (mgr.14164) 32 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:19.667 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:18.087592+0000 mgr.smithi008.flmjzp (mgr.14164) 33 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.421+0000 7f81b60ad700 1 -- 172.21.15.60:0/1095472278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b0060120 msgr2=0x7f81b00f8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.421+0000 7f81b60ad700 1 --2- 172.21.15.60:0/1095472278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b0060120 0x7f81b00f8fe0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f81ac009fb0 tx=0x7f81ac009b30).stop 2023-10-18T20:52:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.422+0000 7f81b60ad700 1 -- 172.21.15.60:0/1095472278 shutdown_connections 2023-10-18T20:52:21.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.422+0000 7f81b60ad700 1 --2- 172.21.15.60:0/1095472278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b0060120 0x7f81b00f8fe0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:21.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.422+0000 7f81b60ad700 1 -- 172.21.15.60:0/1095472278 >> 172.21.15.60:0/1095472278 conn(0x7f81b00f09a0 msgr2=0x7f81b00f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:21.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.422+0000 7f81b60ad700 1 -- 172.21.15.60:0/1095472278 shutdown_connections 2023-10-18T20:52:21.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.422+0000 7f81b60ad700 1 -- 172.21.15.60:0/1095472278 wait complete. 2023-10-18T20:52:21.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.423+0000 7f81b60ad700 1 Processor -- start 2023-10-18T20:52:21.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.423+0000 7f81b60ad700 1 -- start start 2023-10-18T20:52:21.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.423+0000 7f81b60ad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b0060120 0x7f81b01064d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:21.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.423+0000 7f81b60ad700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b01069c0 con 0x7f81b0060120 2023-10-18T20:52:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.423+0000 7f81b50ab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b0060120 0x7f81b01064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.424+0000 7f81b50ab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b0060120 0x7f81b01064d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:60294/0 (socket says 172.21.15.60:60294) 2023-10-18T20:52:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.424+0000 7f81b50ab700 1 -- 172.21.15.60:0/659494479 learned_addr learned my addr 172.21.15.60:0/659494479 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.424+0000 7f81b50ab700 1 -- 172.21.15.60:0/659494479 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac005040 con 0x7f81b0060120 2023-10-18T20:52:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.424+0000 7f81b50ab700 1 --2- 172.21.15.60:0/659494479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b0060120 0x7f81b01064d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f81ac014000 tx=0x7f81ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.424+0000 7f81a5ffb700 1 -- 172.21.15.60:0/659494479 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f81ac0095f0 con 0x7f81b0060120 2023-10-18T20:52:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.424+0000 7f81a5ffb700 1 -- 172.21.15.60:0/659494479 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81ac007e70 con 0x7f81b0060120 2023-10-18T20:52:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.424+0000 7f81a5ffb700 1 -- 172.21.15.60:0/659494479 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f81ac014ea0 con 0x7f81b0060120 2023-10-18T20:52:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.424+0000 7f81b60ad700 1 -- 172.21.15.60:0/659494479 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b0106bc0 con 0x7f81b0060120 2023-10-18T20:52:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.424+0000 7f81b60ad700 1 -- 172.21.15.60:0/659494479 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b0107050 con 0x7f81b0060120 2023-10-18T20:52:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.425+0000 7f81a5ffb700 1 -- 172.21.15.60:0/659494479 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f81ac025070 con 0x7f81b0060120 2023-10-18T20:52:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.425+0000 7f81b60ad700 1 -- 172.21.15.60:0/659494479 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b0045ad0 con 0x7f81b0060120 2023-10-18T20:52:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.426+0000 7f81a5ffb700 1 --2- 172.21.15.60:0/659494479 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f819c02ffb0 0x7f819c032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.426+0000 7f81a5ffb700 1 -- 172.21.15.60:0/659494479 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f81ac0409a0 con 0x7f81b0060120 2023-10-18T20:52:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.426+0000 7f81b48aa700 1 --2- 172.21.15.60:0/659494479 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f819c02ffb0 0x7f819c032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:21.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.426+0000 7f81b48aa700 1 --2- 172.21.15.60:0/659494479 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f819c02ffb0 0x7f819c032470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f81a00096a0 tx=0x7f81a0006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:21.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.431+0000 7f81a5ffb700 1 -- 172.21.15.60:0/659494479 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f81ac00f4e0 con 0x7f81b0060120 2023-10-18T20:52:21.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.658+0000 7f81b60ad700 1 -- 172.21.15.60:0/659494479 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f81b0107f00 con 0x7f81b0060120 2023-10-18T20:52:21.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.658+0000 7f81a5ffb700 1 -- 172.21.15.60:0/659494479 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7f81ac00f300 con 0x7f81b0060120 2023-10-18T20:52:21.661 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:21.661 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:21.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.660+0000 7f81b60ad700 1 -- 172.21.15.60:0/659494479 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f819c02ffb0 msgr2=0x7f819c032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:21.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.660+0000 7f81b60ad700 1 --2- 172.21.15.60:0/659494479 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f819c02ffb0 0x7f819c032470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f81a00096a0 tx=0x7f81a0006b40).stop 2023-10-18T20:52:21.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.660+0000 7f81b60ad700 1 -- 172.21.15.60:0/659494479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b0060120 msgr2=0x7f81b01064d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:21.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.660+0000 7f81b60ad700 1 --2- 172.21.15.60:0/659494479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b0060120 0x7f81b01064d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f81ac014000 tx=0x7f81ac00b040).stop 2023-10-18T20:52:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.661+0000 7f81b60ad700 1 -- 172.21.15.60:0/659494479 shutdown_connections 2023-10-18T20:52:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.661+0000 7f81b60ad700 1 --2- 172.21.15.60:0/659494479 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f819c02ffb0 0x7f819c032470 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.661+0000 7f81b60ad700 1 --2- 172.21.15.60:0/659494479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b0060120 0x7f81b01064d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.661+0000 7f81b60ad700 1 -- 172.21.15.60:0/659494479 >> 172.21.15.60:0/659494479 conn(0x7f81b00f09a0 msgr2=0x7f81b00f1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.661+0000 7f81b60ad700 1 -- 172.21.15.60:0/659494479 shutdown_connections 2023-10-18T20:52:21.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:21.661+0000 7f81b60ad700 1 -- 172.21.15.60:0/659494479 wait complete. 2023-10-18T20:52:21.665 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:20.087851+0000 mgr.smithi008.flmjzp (mgr.14164) 34 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:21.627652+0000 mon.smithi008 (mon.0) 136 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:52:21.633703+0000 mgr.smithi008.flmjzp (mgr.14164) 35 : cephadm [INF] Deploying daemon prometheus.smithi008 on smithi008 2023-10-18T20:52:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:21.659683+0000 mon.smithi008 (mon.0) 137 : audit [DBG] from='client.? 172.21.15.60:0/659494479' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:22.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:22.088055+0000 mgr.smithi008.flmjzp (mgr.14164) 36 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:22.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:22.253165+0000 mon.smithi008 (mon.0) 138 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:52:22.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:22.257474+0000 mon.smithi008 (mon.0) 139 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:52:23.018 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:23.019 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:24.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.311+0000 7f4068e33700 1 -- 172.21.15.60:0/2986651615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40640f62a0 msgr2=0x7f40640f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:24.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.311+0000 7f4068e33700 1 --2- 172.21.15.60:0/2986651615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40640f62a0 0x7f40640f66c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f4054009fb0 tx=0x7f4054009b30).stop 2023-10-18T20:52:24.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.311+0000 7f4068e33700 1 -- 172.21.15.60:0/2986651615 shutdown_connections 2023-10-18T20:52:24.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.311+0000 7f4068e33700 1 --2- 172.21.15.60:0/2986651615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40640f62a0 0x7f40640f66c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:24.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.311+0000 7f4068e33700 1 -- 172.21.15.60:0/2986651615 >> 172.21.15.60:0/2986651615 conn(0x7f40640f1aa0 msgr2=0x7f40640f3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:24.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.311+0000 7f4068e33700 1 -- 172.21.15.60:0/2986651615 shutdown_connections 2023-10-18T20:52:24.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.311+0000 7f4068e33700 1 -- 172.21.15.60:0/2986651615 wait complete. 2023-10-18T20:52:24.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.312+0000 7f4068e33700 1 Processor -- start 2023-10-18T20:52:24.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.312+0000 7f4068e33700 1 -- start start 2023-10-18T20:52:24.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.313+0000 7f4068e33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40640f62a0 0x7f40641064b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:24.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.313+0000 7f4068e33700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40641069a0 con 0x7f40640f62a0 2023-10-18T20:52:24.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.313+0000 7f40637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40640f62a0 0x7f40641064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:24.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.313+0000 7f40637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40640f62a0 0x7f40641064b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:60308/0 (socket says 172.21.15.60:60308) 2023-10-18T20:52:24.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.313+0000 7f40637fe700 1 -- 172.21.15.60:0/1223153799 learned_addr learned my addr 172.21.15.60:0/1223153799 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:24.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.313+0000 7f40637fe700 1 -- 172.21.15.60:0/1223153799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054005040 con 0x7f40640f62a0 2023-10-18T20:52:24.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.314+0000 7f40637fe700 1 --2- 172.21.15.60:0/1223153799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40640f62a0 0x7f40641064b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4054013510 tx=0x7f405400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:24.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.314+0000 7f404bfff700 1 -- 172.21.15.60:0/1223153799 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4054009320 con 0x7f40640f62a0 2023-10-18T20:52:24.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.315+0000 7f404bfff700 1 -- 172.21.15.60:0/1223153799 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4054013f00 con 0x7f40640f62a0 2023-10-18T20:52:24.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.315+0000 7f404bfff700 1 -- 172.21.15.60:0/1223153799 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4054014dc0 con 0x7f40640f62a0 2023-10-18T20:52:24.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.315+0000 7f4068e33700 1 -- 172.21.15.60:0/1223153799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4064106ba0 con 0x7f40640f62a0 2023-10-18T20:52:24.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.315+0000 7f4068e33700 1 -- 172.21.15.60:0/1223153799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4064107030 con 0x7f40640f62a0 2023-10-18T20:52:24.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.316+0000 7f4068e33700 1 -- 172.21.15.60:0/1223153799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4064045ad0 con 0x7f40640f62a0 2023-10-18T20:52:24.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.316+0000 7f404bfff700 1 -- 172.21.15.60:0/1223153799 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f40540095f0 con 0x7f40640f62a0 2023-10-18T20:52:24.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.316+0000 7f404bfff700 1 --2- 172.21.15.60:0/1223153799 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f404c02ffb0 0x7f404c032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:24.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.316+0000 7f404bfff700 1 -- 172.21.15.60:0/1223153799 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f4054040ff0 con 0x7f40640f62a0 2023-10-18T20:52:24.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.317+0000 7f4062ffd700 1 --2- 172.21.15.60:0/1223153799 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f404c02ffb0 0x7f404c032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:24.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.317+0000 7f4062ffd700 1 --2- 172.21.15.60:0/1223153799 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f404c02ffb0 0x7f404c032470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f40580096a0 tx=0x7f4058006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.321+0000 7f404bfff700 1 -- 172.21.15.60:0/1223153799 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f405406d2b0 con 0x7f40640f62a0 2023-10-18T20:52:24.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.549+0000 7f4068e33700 1 -- 172.21.15.60:0/1223153799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4064107ee0 con 0x7f40640f62a0 2023-10-18T20:52:24.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.550+0000 7f404bfff700 1 -- 172.21.15.60:0/1223153799 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7f4054014420 con 0x7f40640f62a0 2023-10-18T20:52:24.553 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:24.554 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:24.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.552+0000 7f4068e33700 1 -- 172.21.15.60:0/1223153799 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f404c02ffb0 msgr2=0x7f404c032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:24.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.552+0000 7f4068e33700 1 --2- 172.21.15.60:0/1223153799 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f404c02ffb0 0x7f404c032470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f40580096a0 tx=0x7f4058006b40).stop 2023-10-18T20:52:24.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.552+0000 7f4068e33700 1 -- 172.21.15.60:0/1223153799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40640f62a0 msgr2=0x7f40641064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:24.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.552+0000 7f4068e33700 1 --2- 172.21.15.60:0/1223153799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40640f62a0 0x7f40641064b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4054013510 tx=0x7f405400b040).stop 2023-10-18T20:52:24.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.552+0000 7f4068e33700 1 -- 172.21.15.60:0/1223153799 shutdown_connections 2023-10-18T20:52:24.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.552+0000 7f4068e33700 1 --2- 172.21.15.60:0/1223153799 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f404c02ffb0 0x7f404c032470 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:24.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.552+0000 7f4068e33700 1 --2- 172.21.15.60:0/1223153799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40640f62a0 0x7f40641064b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:24.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.552+0000 7f4068e33700 1 -- 172.21.15.60:0/1223153799 >> 172.21.15.60:0/1223153799 conn(0x7f40640f1aa0 msgr2=0x7f40640f2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:24.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.552+0000 7f4068e33700 1 -- 172.21.15.60:0/1223153799 shutdown_connections 2023-10-18T20:52:24.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:24.552+0000 7f4068e33700 1 -- 172.21.15.60:0/1223153799 wait complete. 2023-10-18T20:52:24.557 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:24.088533+0000 mgr.smithi008.flmjzp (mgr.14164) 37 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:24.552103+0000 mon.smithi008 (mon.0) 140 : audit [DBG] from='client.? 172.21.15.60:0/1223153799' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:25.907 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:25.908 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:26.088917+0000 mgr.smithi008.flmjzp (mgr.14164) 38 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:28.089203+0000 mgr.smithi008.flmjzp (mgr.14164) 39 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:31.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.445+0000 7f588c9f4700 1 -- 172.21.15.60:0/3565404186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58880f51a0 msgr2=0x7f58880f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:31.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.445+0000 7f588c9f4700 1 --2- 172.21.15.60:0/3565404186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58880f51a0 0x7f58880f55c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5878009fb0 tx=0x7f5878009b30).stop 2023-10-18T20:52:31.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.445+0000 7f588c9f4700 1 -- 172.21.15.60:0/3565404186 shutdown_connections 2023-10-18T20:52:31.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.445+0000 7f588c9f4700 1 --2- 172.21.15.60:0/3565404186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58880f51a0 0x7f58880f55c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:31.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.445+0000 7f588c9f4700 1 -- 172.21.15.60:0/3565404186 >> 172.21.15.60:0/3565404186 conn(0x7f58880f09a0 msgr2=0x7f58880f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:31.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.445+0000 7f588c9f4700 1 -- 172.21.15.60:0/3565404186 shutdown_connections 2023-10-18T20:52:31.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.445+0000 7f588c9f4700 1 -- 172.21.15.60:0/3565404186 wait complete. 2023-10-18T20:52:31.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.446+0000 7f588c9f4700 1 Processor -- start 2023-10-18T20:52:31.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.447+0000 7f588c9f4700 1 -- start start 2023-10-18T20:52:31.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.447+0000 7f588c9f4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58880f51a0 0x7f58881064a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:31.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.447+0000 7f588c9f4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5888106990 con 0x7f58880f51a0 2023-10-18T20:52:31.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.447+0000 7f5886d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58880f51a0 0x7f58881064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:31.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.447+0000 7f5886d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58880f51a0 0x7f58881064a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:36784/0 (socket says 172.21.15.60:36784) 2023-10-18T20:52:31.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.447+0000 7f5886d9d700 1 -- 172.21.15.60:0/1397552973 learned_addr learned my addr 172.21.15.60:0/1397552973 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:31.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.448+0000 7f5886d9d700 1 -- 172.21.15.60:0/1397552973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878005040 con 0x7f58880f51a0 2023-10-18T20:52:31.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.448+0000 7f5886d9d700 1 --2- 172.21.15.60:0/1397552973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58880f51a0 0x7f58881064a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5878013510 tx=0x7f587800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:31.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.448+0000 7f586f7fe700 1 -- 172.21.15.60:0/1397552973 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5878009320 con 0x7f58880f51a0 2023-10-18T20:52:31.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.448+0000 7f588c9f4700 1 -- 172.21.15.60:0/1397552973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5888106b90 con 0x7f58880f51a0 2023-10-18T20:52:31.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.448+0000 7f586f7fe700 1 -- 172.21.15.60:0/1397552973 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5878013f00 con 0x7f58880f51a0 2023-10-18T20:52:31.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.448+0000 7f586f7fe700 1 -- 172.21.15.60:0/1397552973 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5878014dc0 con 0x7f58880f51a0 2023-10-18T20:52:31.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.448+0000 7f588c9f4700 1 -- 172.21.15.60:0/1397552973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5888107020 con 0x7f58880f51a0 2023-10-18T20:52:31.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.449+0000 7f586f7fe700 1 -- 172.21.15.60:0/1397552973 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f5878014420 con 0x7f58880f51a0 2023-10-18T20:52:31.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.449+0000 7f588c9f4700 1 -- 172.21.15.60:0/1397552973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5888045ad0 con 0x7f58880f51a0 2023-10-18T20:52:31.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.450+0000 7f586f7fe700 1 --2- 172.21.15.60:0/1397552973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f587002ff60 0x7f5870032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:31.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.450+0000 7f586f7fe700 1 -- 172.21.15.60:0/1397552973 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f5878041030 con 0x7f58880f51a0 2023-10-18T20:52:31.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.450+0000 7f588659c700 1 --2- 172.21.15.60:0/1397552973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f587002ff60 0x7f5870032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:31.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.450+0000 7f588659c700 1 --2- 172.21.15.60:0/1397552973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f587002ff60 0x7f5870032420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f587c0096a0 tx=0x7f587c006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:31.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.455+0000 7f586f7fe700 1 -- 172.21.15.60:0/1397552973 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f58780095f0 con 0x7f58880f51a0 2023-10-18T20:52:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:30.089443+0000 mgr.smithi008.flmjzp (mgr.14164) 40 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:31.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.685+0000 7f588c9f4700 1 -- 172.21.15.60:0/1397552973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5888107ed0 con 0x7f58880f51a0 2023-10-18T20:52:31.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.686+0000 7f586f7fe700 1 -- 172.21.15.60:0/1397552973 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7f587801cb10 con 0x7f58880f51a0 2023-10-18T20:52:31.688 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:31.689 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.688+0000 7f588c9f4700 1 -- 172.21.15.60:0/1397552973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f587002ff60 msgr2=0x7f5870032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.688+0000 7f588c9f4700 1 --2- 172.21.15.60:0/1397552973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f587002ff60 0x7f5870032420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f587c0096a0 tx=0x7f587c006b40).stop 2023-10-18T20:52:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.688+0000 7f588c9f4700 1 -- 172.21.15.60:0/1397552973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58880f51a0 msgr2=0x7f58881064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.688+0000 7f588c9f4700 1 --2- 172.21.15.60:0/1397552973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58880f51a0 0x7f58881064a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5878013510 tx=0x7f587800b040).stop 2023-10-18T20:52:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.688+0000 7f588c9f4700 1 -- 172.21.15.60:0/1397552973 shutdown_connections 2023-10-18T20:52:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.688+0000 7f588c9f4700 1 --2- 172.21.15.60:0/1397552973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f587002ff60 0x7f5870032420 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.688+0000 7f588c9f4700 1 --2- 172.21.15.60:0/1397552973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58880f51a0 0x7f58881064a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.688+0000 7f588c9f4700 1 -- 172.21.15.60:0/1397552973 >> 172.21.15.60:0/1397552973 conn(0x7f58880f09a0 msgr2=0x7f588805fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.688+0000 7f588c9f4700 1 -- 172.21.15.60:0/1397552973 shutdown_connections 2023-10-18T20:52:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:31.688+0000 7f588c9f4700 1 -- 172.21.15.60:0/1397552973 wait complete. 2023-10-18T20:52:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:31.687147+0000 mon.smithi008 (mon.0) 141 : audit [DBG] from='client.? 172.21.15.60:0/1397552973' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:33.200 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:33.200 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:33.597 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:32.089737+0000 mgr.smithi008.flmjzp (mgr.14164) 41 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:34.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.485+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/613049395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40f62a0 msgr2=0x7fa6c40f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:34.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.485+0000 7fa6c9ebd700 1 --2- 172.21.15.60:0/613049395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40f62a0 0x7fa6c40f66c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa6b8009fb0 tx=0x7fa6b8009b30).stop 2023-10-18T20:52:34.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.485+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/613049395 shutdown_connections 2023-10-18T20:52:34.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.485+0000 7fa6c9ebd700 1 --2- 172.21.15.60:0/613049395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40f62a0 0x7fa6c40f66c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:34.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.485+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/613049395 >> 172.21.15.60:0/613049395 conn(0x7fa6c40f1aa0 msgr2=0x7fa6c40f3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:34.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.485+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/613049395 shutdown_connections 2023-10-18T20:52:34.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.485+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/613049395 wait complete. 2023-10-18T20:52:34.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.486+0000 7fa6c9ebd700 1 Processor -- start 2023-10-18T20:52:34.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.487+0000 7fa6c9ebd700 1 -- start start 2023-10-18T20:52:34.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.487+0000 7fa6c9ebd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40f62a0 0x7fa6c41086b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:34.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.487+0000 7fa6c9ebd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c4108ba0 con 0x7fa6c40f62a0 2023-10-18T20:52:34.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.488+0000 7fa6c8ebb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40f62a0 0x7fa6c41086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:34.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.488+0000 7fa6c8ebb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40f62a0 0x7fa6c41086b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:36800/0 (socket says 172.21.15.60:36800) 2023-10-18T20:52:34.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.488+0000 7fa6c8ebb700 1 -- 172.21.15.60:0/1830554977 learned_addr learned my addr 172.21.15.60:0/1830554977 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:34.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.488+0000 7fa6c8ebb700 1 -- 172.21.15.60:0/1830554977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b8005040 con 0x7fa6c40f62a0 2023-10-18T20:52:34.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.488+0000 7fa6c8ebb700 1 --2- 172.21.15.60:0/1830554977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40f62a0 0x7fa6c41086b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fa6b8013510 tx=0x7fa6b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:34.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.488+0000 7fa6c17fa700 1 -- 172.21.15.60:0/1830554977 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6b8009320 con 0x7fa6c40f62a0 2023-10-18T20:52:34.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.489+0000 7fa6c17fa700 1 -- 172.21.15.60:0/1830554977 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa6b8013f00 con 0x7fa6c40f62a0 2023-10-18T20:52:34.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.489+0000 7fa6c17fa700 1 -- 172.21.15.60:0/1830554977 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6b8014dc0 con 0x7fa6c40f62a0 2023-10-18T20:52:34.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.489+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/1830554977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c4108da0 con 0x7fa6c40f62a0 2023-10-18T20:52:34.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.489+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/1830554977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c4109230 con 0x7fa6c40f62a0 2023-10-18T20:52:34.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.490+0000 7fa6c17fa700 1 -- 172.21.15.60:0/1830554977 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fa6b80095f0 con 0x7fa6c40f62a0 2023-10-18T20:52:34.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.490+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/1830554977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c4045ad0 con 0x7fa6c40f62a0 2023-10-18T20:52:34.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.490+0000 7fa6c17fa700 1 --2- 172.21.15.60:0/1830554977 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa6b402ffb0 0x7fa6b4032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:34.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.490+0000 7fa6c17fa700 1 -- 172.21.15.60:0/1830554977 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fa6b80410b0 con 0x7fa6c40f62a0 2023-10-18T20:52:34.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.491+0000 7fa6c3fff700 1 --2- 172.21.15.60:0/1830554977 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa6b402ffb0 0x7fa6b4032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:34.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.491+0000 7fa6c3fff700 1 --2- 172.21.15.60:0/1830554977 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa6b402ffb0 0x7fa6b4032470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa6b00096a0 tx=0x7fa6b0006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:34.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.495+0000 7fa6c17fa700 1 -- 172.21.15.60:0/1830554977 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa6b806d2b0 con 0x7fa6c40f62a0 2023-10-18T20:52:34.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.727+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/1830554977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa6c410a0e0 con 0x7fa6c40f62a0 2023-10-18T20:52:34.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.728+0000 7fa6c17fa700 1 -- 172.21.15.60:0/1830554977 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7fa6b8014420 con 0x7fa6c40f62a0 2023-10-18T20:52:34.731 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:34.731 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:34.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.730+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/1830554977 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa6b402ffb0 msgr2=0x7fa6b4032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:34.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.730+0000 7fa6c9ebd700 1 --2- 172.21.15.60:0/1830554977 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa6b402ffb0 0x7fa6b4032470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa6b00096a0 tx=0x7fa6b0006b40).stop 2023-10-18T20:52:34.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.730+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/1830554977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40f62a0 msgr2=0x7fa6c41086b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:34.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.730+0000 7fa6c9ebd700 1 --2- 172.21.15.60:0/1830554977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40f62a0 0x7fa6c41086b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fa6b8013510 tx=0x7fa6b800b040).stop 2023-10-18T20:52:34.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.730+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/1830554977 shutdown_connections 2023-10-18T20:52:34.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.730+0000 7fa6c9ebd700 1 --2- 172.21.15.60:0/1830554977 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa6b402ffb0 0x7fa6b4032470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:34.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.730+0000 7fa6c9ebd700 1 --2- 172.21.15.60:0/1830554977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40f62a0 0x7fa6c41086b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:34.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.730+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/1830554977 >> 172.21.15.60:0/1830554977 conn(0x7fa6c40f1aa0 msgr2=0x7fa6c40f2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:34.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.730+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/1830554977 shutdown_connections 2023-10-18T20:52:34.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:34.730+0000 7fa6c9ebd700 1 -- 172.21.15.60:0/1830554977 wait complete. 2023-10-18T20:52:34.735 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:34.089992+0000 mgr.smithi008.flmjzp (mgr.14164) 42 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:34.729369+0000 mon.smithi008 (mon.0) 142 : audit [DBG] from='client.? 172.21.15.60:0/1830554977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:36.075 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:36.076 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:35.909247+0000 mon.smithi008 (mon.0) 143 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:35.909886+0000 mon.smithi008 (mon.0) 144 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:52:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:36.090236+0000 mgr.smithi008.flmjzp (mgr.14164) 43 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:36.256388+0000 mon.smithi008 (mon.0) 145 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:37.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:36.747499+0000 mon.smithi008 (mon.0) 146 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:37.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.956+0000 7f075e343700 1 -- 172.21.15.60:0/3513379959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07580601e0 msgr2=0x7f07580f8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:37.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.956+0000 7f075e343700 1 --2- 172.21.15.60:0/3513379959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07580601e0 0x7f07580f8f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f0754009fb0 tx=0x7f0754009b30).stop 2023-10-18T20:52:37.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.956+0000 7f075e343700 1 -- 172.21.15.60:0/3513379959 shutdown_connections 2023-10-18T20:52:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.956+0000 7f075e343700 1 --2- 172.21.15.60:0/3513379959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07580601e0 0x7f07580f8f20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.956+0000 7f075e343700 1 -- 172.21.15.60:0/3513379959 >> 172.21.15.60:0/3513379959 conn(0x7f07580f09a0 msgr2=0x7f07580f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.956+0000 7f075e343700 1 -- 172.21.15.60:0/3513379959 shutdown_connections 2023-10-18T20:52:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.956+0000 7f075e343700 1 -- 172.21.15.60:0/3513379959 wait complete. 2023-10-18T20:52:37.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.957+0000 7f075e343700 1 Processor -- start 2023-10-18T20:52:37.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.958+0000 7f075e343700 1 -- start start 2023-10-18T20:52:37.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.958+0000 7f075e343700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07580601e0 0x7f07580f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:37.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.958+0000 7f075e343700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580f4e20 con 0x7f07580601e0 2023-10-18T20:52:37.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.958+0000 7f075d341700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07580601e0 0x7f07580f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.958+0000 7f075d341700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07580601e0 0x7f07580f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:36812/0 (socket says 172.21.15.60:36812) 2023-10-18T20:52:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.959+0000 7f075d341700 1 -- 172.21.15.60:0/3011968196 learned_addr learned my addr 172.21.15.60:0/3011968196 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.959+0000 7f075d341700 1 -- 172.21.15.60:0/3011968196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754005040 con 0x7f07580601e0 2023-10-18T20:52:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.959+0000 7f075d341700 1 --2- 172.21.15.60:0/3011968196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07580601e0 0x7f07580f69a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0754013510 tx=0x7f075400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.959+0000 7f074dffb700 1 -- 172.21.15.60:0/3011968196 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0754009320 con 0x7f07580601e0 2023-10-18T20:52:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.959+0000 7f074dffb700 1 -- 172.21.15.60:0/3011968196 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0754013f00 con 0x7f07580601e0 2023-10-18T20:52:37.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.959+0000 7f074dffb700 1 -- 172.21.15.60:0/3011968196 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0754014d90 con 0x7f07580601e0 2023-10-18T20:52:37.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.959+0000 7f075e343700 1 -- 172.21.15.60:0/3011968196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07580f4fc0 con 0x7f07580601e0 2023-10-18T20:52:37.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.959+0000 7f075e343700 1 -- 172.21.15.60:0/3011968196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07580f5450 con 0x7f07580601e0 2023-10-18T20:52:37.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.960+0000 7f074dffb700 1 -- 172.21.15.60:0/3011968196 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f07540095f0 con 0x7f07580601e0 2023-10-18T20:52:37.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.960+0000 7f075e343700 1 -- 172.21.15.60:0/3011968196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0758059100 con 0x7f07580601e0 2023-10-18T20:52:37.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.961+0000 7f074dffb700 1 --2- 172.21.15.60:0/3011968196 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f074402ffb0 0x7f0744032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:37.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.961+0000 7f074dffb700 1 -- 172.21.15.60:0/3011968196 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f0754041050 con 0x7f07580601e0 2023-10-18T20:52:37.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.961+0000 7f075cb40700 1 --2- 172.21.15.60:0/3011968196 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f074402ffb0 0x7f0744032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:37.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.962+0000 7f075cb40700 1 --2- 172.21.15.60:0/3011968196 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f074402ffb0 0x7f0744032470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f07480096a0 tx=0x7f0748006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:37.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:37.965+0000 7f074dffb700 1 -- 172.21.15.60:0/3011968196 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0754014420 con 0x7f07580601e0 2023-10-18T20:52:38.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.204+0000 7f075e343700 1 -- 172.21.15.60:0/3011968196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f07580fbcd0 con 0x7f07580601e0 2023-10-18T20:52:38.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.205+0000 7f074dffb700 1 -- 172.21.15.60:0/3011968196 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7f075401d7f0 con 0x7f07580601e0 2023-10-18T20:52:38.207 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:38.207 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.206+0000 7f075e343700 1 -- 172.21.15.60:0/3011968196 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f074402ffb0 msgr2=0x7f0744032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.206+0000 7f075e343700 1 --2- 172.21.15.60:0/3011968196 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f074402ffb0 0x7f0744032470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f07480096a0 tx=0x7f0748006b40).stop 2023-10-18T20:52:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.206+0000 7f075e343700 1 -- 172.21.15.60:0/3011968196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07580601e0 msgr2=0x7f07580f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.206+0000 7f075e343700 1 --2- 172.21.15.60:0/3011968196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07580601e0 0x7f07580f69a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0754013510 tx=0x7f075400b040).stop 2023-10-18T20:52:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.207+0000 7f075e343700 1 -- 172.21.15.60:0/3011968196 shutdown_connections 2023-10-18T20:52:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.207+0000 7f075e343700 1 --2- 172.21.15.60:0/3011968196 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f074402ffb0 0x7f0744032470 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.207+0000 7f075e343700 1 --2- 172.21.15.60:0/3011968196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07580601e0 0x7f07580f69a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.207+0000 7f075e343700 1 -- 172.21.15.60:0/3011968196 >> 172.21.15.60:0/3011968196 conn(0x7f07580f09a0 msgr2=0x7f07580f1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.207+0000 7f075e343700 1 -- 172.21.15.60:0/3011968196 shutdown_connections 2023-10-18T20:52:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:38.207+0000 7f075e343700 1 -- 172.21.15.60:0/3011968196 wait complete. 2023-10-18T20:52:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:38.090461+0000 mgr.smithi008.flmjzp (mgr.14164) 44 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:38.205808+0000 mon.smithi008 (mon.0) 147 : audit [DBG] from='client.? 172.21.15.60:0/3011968196' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:38.982138+0000 mon.smithi008 (mon.0) 148 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:39.688 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:39.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:41.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.064+0000 7f16d2890700 1 -- 172.21.15.60:0/3068110616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16cc0f5140 msgr2=0x7f16cc0f5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.064+0000 7f16d2890700 1 --2- 172.21.15.60:0/3068110616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16cc0f5140 0x7f16cc0f5560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f16c8009fb0 tx=0x7f16c8009b30).stop 2023-10-18T20:52:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.064+0000 7f16d2890700 1 -- 172.21.15.60:0/3068110616 shutdown_connections 2023-10-18T20:52:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.064+0000 7f16d2890700 1 --2- 172.21.15.60:0/3068110616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16cc0f5140 0x7f16cc0f5560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.064+0000 7f16d2890700 1 -- 172.21.15.60:0/3068110616 >> 172.21.15.60:0/3068110616 conn(0x7f16cc0f08c0 msgr2=0x7f16cc0f2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.064+0000 7f16d2890700 1 -- 172.21.15.60:0/3068110616 shutdown_connections 2023-10-18T20:52:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.064+0000 7f16d2890700 1 -- 172.21.15.60:0/3068110616 wait complete. 2023-10-18T20:52:41.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.065+0000 7f16d2890700 1 Processor -- start 2023-10-18T20:52:41.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.065+0000 7f16d2890700 1 -- start start 2023-10-18T20:52:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.065+0000 7f16d2890700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16cc0f5140 0x7f16cc0fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.065+0000 7f16d2890700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0fb5c0 con 0x7f16cc0f5140 2023-10-18T20:52:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.066+0000 7f16d188e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16cc0f5140 0x7f16cc0fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.066+0000 7f16d188e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16cc0f5140 0x7f16cc0fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:37482/0 (socket says 172.21.15.60:37482) 2023-10-18T20:52:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.066+0000 7f16d188e700 1 -- 172.21.15.60:0/474643974 learned_addr learned my addr 172.21.15.60:0/474643974 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.066+0000 7f16d188e700 1 -- 172.21.15.60:0/474643974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8005040 con 0x7f16cc0f5140 2023-10-18T20:52:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.067+0000 7f16d188e700 1 --2- 172.21.15.60:0/474643974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16cc0f5140 0x7f16cc0fd140 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f16c8014000 tx=0x7f16c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.067+0000 7f16c27fc700 1 -- 172.21.15.60:0/474643974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16c80095f0 con 0x7f16cc0f5140 2023-10-18T20:52:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.067+0000 7f16c27fc700 1 -- 172.21.15.60:0/474643974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f16c8007e70 con 0x7f16cc0f5140 2023-10-18T20:52:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.067+0000 7f16c27fc700 1 -- 172.21.15.60:0/474643974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16c8014ea0 con 0x7f16cc0f5140 2023-10-18T20:52:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.067+0000 7f16d2890700 1 -- 172.21.15.60:0/474643974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc0fb760 con 0x7f16cc0f5140 2023-10-18T20:52:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.067+0000 7f16d2890700 1 -- 172.21.15.60:0/474643974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc0fbbf0 con 0x7f16cc0f5140 2023-10-18T20:52:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.068+0000 7f16d2890700 1 -- 172.21.15.60:0/474643974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc059100 con 0x7f16cc0f5140 2023-10-18T20:52:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.069+0000 7f16c27fc700 1 -- 172.21.15.60:0/474643974 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f16c8025070 con 0x7f16cc0f5140 2023-10-18T20:52:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.069+0000 7f16c27fc700 1 --2- 172.21.15.60:0/474643974 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f16b802ff60 0x7f16b8032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.069+0000 7f16c27fc700 1 -- 172.21.15.60:0/474643974 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f16c8040980 con 0x7f16cc0f5140 2023-10-18T20:52:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.069+0000 7f16d108d700 1 --2- 172.21.15.60:0/474643974 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f16b802ff60 0x7f16b8032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.070+0000 7f16d108d700 1 --2- 172.21.15.60:0/474643974 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f16b802ff60 0x7f16b8032420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f16bc0096a0 tx=0x7f16bc006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:41.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.074+0000 7f16c27fc700 1 -- 172.21.15.60:0/474643974 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f16c80079c0 con 0x7f16cc0f5140 2023-10-18T20:52:41.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.314+0000 7f16d2890700 1 -- 172.21.15.60:0/474643974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f16cc0fac00 con 0x7f16cc0f5140 2023-10-18T20:52:41.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.315+0000 7f16c27fc700 1 -- 172.21.15.60:0/474643974 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7f16c800f300 con 0x7f16cc0f5140 2023-10-18T20:52:41.317 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:41.317 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:41.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.319+0000 7f16d2890700 1 -- 172.21.15.60:0/474643974 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f16b802ff60 msgr2=0x7f16b8032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:41.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.319+0000 7f16d2890700 1 --2- 172.21.15.60:0/474643974 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f16b802ff60 0x7f16b8032420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f16bc0096a0 tx=0x7f16bc006b40).stop 2023-10-18T20:52:41.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.319+0000 7f16d2890700 1 -- 172.21.15.60:0/474643974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16cc0f5140 msgr2=0x7f16cc0fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:41.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.319+0000 7f16d2890700 1 --2- 172.21.15.60:0/474643974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16cc0f5140 0x7f16cc0fd140 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f16c8014000 tx=0x7f16c800b040).stop 2023-10-18T20:52:41.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.319+0000 7f16d2890700 1 -- 172.21.15.60:0/474643974 shutdown_connections 2023-10-18T20:52:41.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.319+0000 7f16d2890700 1 --2- 172.21.15.60:0/474643974 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f16b802ff60 0x7f16b8032420 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:41.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.319+0000 7f16d2890700 1 --2- 172.21.15.60:0/474643974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16cc0f5140 0x7f16cc0fd140 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:41.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.319+0000 7f16d2890700 1 -- 172.21.15.60:0/474643974 >> 172.21.15.60:0/474643974 conn(0x7f16cc0f08c0 msgr2=0x7f16cc0f13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:41.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.319+0000 7f16d2890700 1 -- 172.21.15.60:0/474643974 shutdown_connections 2023-10-18T20:52:41.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:41.319+0000 7f16d2890700 1 -- 172.21.15.60:0/474643974 wait complete. 2023-10-18T20:52:41.323 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:40.015257+0000 mon.smithi008 (mon.0) 149 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:40.090782+0000 mgr.smithi008.flmjzp (mgr.14164) 45 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:40.751196+0000 mon.smithi008 (mon.0) 150 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:40.754176+0000 mon.smithi008 (mon.0) 151 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:40.755443+0000 mon.smithi008 (mon.0) 152 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-10-18T20:52:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:40.757379+0000 mon.smithi008 (mon.0) 153 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-10-18T20:52:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:40.758218+0000 mon.smithi008 (mon.0) 154 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:52:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:52:40.758972+0000 mgr.smithi008.flmjzp (mgr.14164) 46 : cephadm [INF] Deploying daemon crash.smithi060 on smithi060 2023-10-18T20:52:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:41.315731+0000 mon.smithi008 (mon.0) 155 : audit [DBG] from='client.? 172.21.15.60:0/474643974' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:42.896 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:42.897 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:43.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:42.091142+0000 mgr.smithi008.flmjzp (mgr.14164) 47 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:44.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.372+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3479011843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c8060180 msgr2=0x7f87c80f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:44.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.372+0000 7f87ce5bc700 1 --2- 172.21.15.60:0/3479011843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c8060180 0x7f87c80f8f80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f87c4009fb0 tx=0x7f87c4009b30).stop 2023-10-18T20:52:44.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.372+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3479011843 shutdown_connections 2023-10-18T20:52:44.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.372+0000 7f87ce5bc700 1 --2- 172.21.15.60:0/3479011843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c8060180 0x7f87c80f8f80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:44.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.372+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3479011843 >> 172.21.15.60:0/3479011843 conn(0x7f87c80f09a0 msgr2=0x7f87c80f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:44.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.372+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3479011843 shutdown_connections 2023-10-18T20:52:44.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.372+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3479011843 wait complete. 2023-10-18T20:52:44.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.373+0000 7f87ce5bc700 1 Processor -- start 2023-10-18T20:52:44.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.373+0000 7f87ce5bc700 1 -- start start 2023-10-18T20:52:44.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.373+0000 7f87ce5bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c8060180 0x7f87c8106500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:44.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.373+0000 7f87ce5bc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c81069f0 con 0x7f87c8060180 2023-10-18T20:52:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.374+0000 7f87cd5ba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c8060180 0x7f87c8106500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.374+0000 7f87cd5ba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c8060180 0x7f87c8106500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:37496/0 (socket says 172.21.15.60:37496) 2023-10-18T20:52:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.374+0000 7f87cd5ba700 1 -- 172.21.15.60:0/3233055490 learned_addr learned my addr 172.21.15.60:0/3233055490 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.374+0000 7f87cd5ba700 1 -- 172.21.15.60:0/3233055490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c4005040 con 0x7f87c8060180 2023-10-18T20:52:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.374+0000 7f87cd5ba700 1 --2- 172.21.15.60:0/3233055490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c8060180 0x7f87c8106500 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f87c4014000 tx=0x7f87c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:44.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.375+0000 7f87bdffb700 1 -- 172.21.15.60:0/3233055490 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87c40095f0 con 0x7f87c8060180 2023-10-18T20:52:44.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.375+0000 7f87bdffb700 1 -- 172.21.15.60:0/3233055490 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f87c4007e70 con 0x7f87c8060180 2023-10-18T20:52:44.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.375+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3233055490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c8106bf0 con 0x7f87c8060180 2023-10-18T20:52:44.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.375+0000 7f87bdffb700 1 -- 172.21.15.60:0/3233055490 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87c4014ea0 con 0x7f87c8060180 2023-10-18T20:52:44.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.375+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3233055490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c8107080 con 0x7f87c8060180 2023-10-18T20:52:44.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.376+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3233055490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c8045ad0 con 0x7f87c8060180 2023-10-18T20:52:44.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.376+0000 7f87bdffb700 1 -- 172.21.15.60:0/3233055490 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f87c4025070 con 0x7f87c8060180 2023-10-18T20:52:44.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.376+0000 7f87bdffb700 1 --2- 172.21.15.60:0/3233055490 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f87b402ffb0 0x7f87b4032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:44.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.376+0000 7f87bdffb700 1 -- 172.21.15.60:0/3233055490 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f87c40409c0 con 0x7f87c8060180 2023-10-18T20:52:44.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.377+0000 7f87ccdb9700 1 --2- 172.21.15.60:0/3233055490 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f87b402ffb0 0x7f87b4032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:44.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.377+0000 7f87ccdb9700 1 --2- 172.21.15.60:0/3233055490 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f87b402ffb0 0x7f87b4032470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f87b80096a0 tx=0x7f87b8006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:44.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.381+0000 7f87bdffb700 1 -- 172.21.15.60:0/3233055490 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f87c40079c0 con 0x7f87c8060180 2023-10-18T20:52:44.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.622+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3233055490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f87c8107f30 con 0x7f87c8060180 2023-10-18T20:52:44.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.623+0000 7f87bdffb700 1 -- 172.21.15.60:0/3233055490 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7f87c400f300 con 0x7f87c8060180 2023-10-18T20:52:44.626 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:44.626 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:44.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.625+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3233055490 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f87b402ffb0 msgr2=0x7f87b4032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:44.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.625+0000 7f87ce5bc700 1 --2- 172.21.15.60:0/3233055490 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f87b402ffb0 0x7f87b4032470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f87b80096a0 tx=0x7f87b8006b40).stop 2023-10-18T20:52:44.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.625+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3233055490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c8060180 msgr2=0x7f87c8106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:44.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.625+0000 7f87ce5bc700 1 --2- 172.21.15.60:0/3233055490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c8060180 0x7f87c8106500 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f87c4014000 tx=0x7f87c400b040).stop 2023-10-18T20:52:44.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.625+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3233055490 shutdown_connections 2023-10-18T20:52:44.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.625+0000 7f87ce5bc700 1 --2- 172.21.15.60:0/3233055490 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f87b402ffb0 0x7f87b4032470 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:44.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.625+0000 7f87ce5bc700 1 --2- 172.21.15.60:0/3233055490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c8060180 0x7f87c8106500 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:44.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.625+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3233055490 >> 172.21.15.60:0/3233055490 conn(0x7f87c80f09a0 msgr2=0x7f87c80f1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:44.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.625+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3233055490 shutdown_connections 2023-10-18T20:52:44.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:44.625+0000 7f87ce5bc700 1 -- 172.21.15.60:0/3233055490 wait complete. 2023-10-18T20:52:44.630 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:45.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:43.819523+0000 mon.smithi008 (mon.0) 156 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:45.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:43.821368+0000 mon.smithi008 (mon.0) 157 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.pgqqwa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:52:45.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:43.823755+0000 mon.smithi008 (mon.0) 158 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.pgqqwa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-18T20:52:45.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:43.824794+0000 mon.smithi008 (mon.0) 159 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:52:45.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:43.825943+0000 mon.smithi008 (mon.0) 160 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:52:45.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:52:43.826915+0000 mgr.smithi008.flmjzp (mgr.14164) 48 : cephadm [INF] Deploying daemon mgr.smithi060.pgqqwa on smithi060 2023-10-18T20:52:45.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:44.091520+0000 mgr.smithi008.flmjzp (mgr.14164) 49 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:45.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:44.624281+0000 mon.smithi008 (mon.0) 161 : audit [DBG] from='client.? 172.21.15.60:0/3233055490' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:46.222 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:46.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:46.091769+0000 mgr.smithi008.flmjzp (mgr.14164) 50 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:46.645262+0000 mon.smithi008 (mon.0) 162 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:46.646911+0000 mon.smithi008 (mon.0) 163 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T20:52:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:46.648094+0000 mon.smithi008 (mon.0) 164 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:52:47.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.772+0000 7f8e99b5f700 1 -- 172.21.15.60:0/2178967532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e94060140 msgr2=0x7f8e940f8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:47.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.772+0000 7f8e99b5f700 1 --2- 172.21.15.60:0/2178967532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e94060140 0x7f8e940f8fc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8e88009fb0 tx=0x7f8e88009b30).stop 2023-10-18T20:52:47.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.772+0000 7f8e99b5f700 1 -- 172.21.15.60:0/2178967532 shutdown_connections 2023-10-18T20:52:47.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.772+0000 7f8e99b5f700 1 --2- 172.21.15.60:0/2178967532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e94060140 0x7f8e940f8fc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:47.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.772+0000 7f8e99b5f700 1 -- 172.21.15.60:0/2178967532 >> 172.21.15.60:0/2178967532 conn(0x7f8e940f09a0 msgr2=0x7f8e940f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:47.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.772+0000 7f8e99b5f700 1 -- 172.21.15.60:0/2178967532 shutdown_connections 2023-10-18T20:52:47.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.772+0000 7f8e99b5f700 1 -- 172.21.15.60:0/2178967532 wait complete. 2023-10-18T20:52:47.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.774+0000 7f8e99b5f700 1 Processor -- start 2023-10-18T20:52:47.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.774+0000 7f8e99b5f700 1 -- start start 2023-10-18T20:52:47.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.774+0000 7f8e99b5f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e94060140 0x7f8e94108720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:47.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.774+0000 7f8e99b5f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e94108c10 con 0x7f8e94060140 2023-10-18T20:52:47.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.775+0000 7f8e98b5d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e94060140 0x7f8e94108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:47.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.775+0000 7f8e98b5d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e94060140 0x7f8e94108720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:37524/0 (socket says 172.21.15.60:37524) 2023-10-18T20:52:47.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.775+0000 7f8e98b5d700 1 -- 172.21.15.60:0/3098698379 learned_addr learned my addr 172.21.15.60:0/3098698379 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:47.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.775+0000 7f8e98b5d700 1 -- 172.21.15.60:0/3098698379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88005040 con 0x7f8e94060140 2023-10-18T20:52:47.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.776+0000 7f8e98b5d700 1 --2- 172.21.15.60:0/3098698379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e94060140 0x7f8e94108720 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8e88014000 tx=0x7f8e8800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:47.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.776+0000 7f8e917fa700 1 -- 172.21.15.60:0/3098698379 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e880095f0 con 0x7f8e94060140 2023-10-18T20:52:47.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.776+0000 7f8e917fa700 1 -- 172.21.15.60:0/3098698379 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e88007e70 con 0x7f8e94060140 2023-10-18T20:52:47.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.776+0000 7f8e99b5f700 1 -- 172.21.15.60:0/3098698379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e94108e10 con 0x7f8e94060140 2023-10-18T20:52:47.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.776+0000 7f8e917fa700 1 -- 172.21.15.60:0/3098698379 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e88014ea0 con 0x7f8e94060140 2023-10-18T20:52:47.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.776+0000 7f8e99b5f700 1 -- 172.21.15.60:0/3098698379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e941092a0 con 0x7f8e94060140 2023-10-18T20:52:47.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.777+0000 7f8e99b5f700 1 -- 172.21.15.60:0/3098698379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e94045ad0 con 0x7f8e94060140 2023-10-18T20:52:47.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.777+0000 7f8e917fa700 1 -- 172.21.15.60:0/3098698379 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f8e88025070 con 0x7f8e94060140 2023-10-18T20:52:47.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.778+0000 7f8e917fa700 1 --2- 172.21.15.60:0/3098698379 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8e8402ff60 0x7f8e84032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:47.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.778+0000 7f8e917fa700 1 -- 172.21.15.60:0/3098698379 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f8e88040940 con 0x7f8e94060140 2023-10-18T20:52:47.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.778+0000 7f8e93fff700 1 --2- 172.21.15.60:0/3098698379 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8e8402ff60 0x7f8e84032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:47.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.779+0000 7f8e93fff700 1 --2- 172.21.15.60:0/3098698379 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8e8402ff60 0x7f8e84032420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8e800096a0 tx=0x7f8e80006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:47.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:47.783+0000 7f8e917fa700 1 -- 172.21.15.60:0/3098698379 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8e880079c0 con 0x7f8e94060140 2023-10-18T20:52:48.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.045+0000 7f8e99b5f700 1 -- 172.21.15.60:0/3098698379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8e9410a150 con 0x7f8e94060140 2023-10-18T20:52:48.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.046+0000 7f8e917fa700 1 -- 172.21.15.60:0/3098698379 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+686 (secure 0 0 0) 0x7f8e8800f300 con 0x7f8e94060140 2023-10-18T20:52:48.048 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:48.048 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:50:22.074847Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T20:52:48.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.048+0000 7f8e99b5f700 1 -- 172.21.15.60:0/3098698379 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8e8402ff60 msgr2=0x7f8e84032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:48.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.048+0000 7f8e99b5f700 1 --2- 172.21.15.60:0/3098698379 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8e8402ff60 0x7f8e84032420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8e800096a0 tx=0x7f8e80006b40).stop 2023-10-18T20:52:48.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.048+0000 7f8e99b5f700 1 -- 172.21.15.60:0/3098698379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e94060140 msgr2=0x7f8e94108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:48.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.048+0000 7f8e99b5f700 1 --2- 172.21.15.60:0/3098698379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e94060140 0x7f8e94108720 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8e88014000 tx=0x7f8e8800b040).stop 2023-10-18T20:52:48.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.048+0000 7f8e99b5f700 1 -- 172.21.15.60:0/3098698379 shutdown_connections 2023-10-18T20:52:48.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.048+0000 7f8e99b5f700 1 --2- 172.21.15.60:0/3098698379 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8e8402ff60 0x7f8e84032420 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:48.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.048+0000 7f8e99b5f700 1 --2- 172.21.15.60:0/3098698379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e94060140 0x7f8e94108720 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:48.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.048+0000 7f8e99b5f700 1 -- 172.21.15.60:0/3098698379 >> 172.21.15.60:0/3098698379 conn(0x7f8e940f09a0 msgr2=0x7f8e940f1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:48.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.048+0000 7f8e99b5f700 1 -- 172.21.15.60:0/3098698379 shutdown_connections 2023-10-18T20:52:48.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:48.048+0000 7f8e99b5f700 1 -- 172.21.15.60:0/3098698379 wait complete. 2023-10-18T20:52:48.052 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-18T20:52:48.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:52:46.649226+0000 mgr.smithi008.flmjzp (mgr.14164) 51 : cephadm [INF] Deploying daemon mon.smithi060 on smithi060 2023-10-18T20:52:48.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:48.046806+0000 mon.smithi008 (mon.0) 165 : audit [DBG] from='client.? 172.21.15.60:0/3098698379' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:49.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 systemd[1]: Starting Ceph mon.smithi060 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T20:52:49.515 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-10-18T20:52:49.516 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T20:52:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:48.092103+0000 mgr.smithi008.flmjzp (mgr.14164) 52 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 bash[110677]: d7c00f2c13a447ca895600a36330a75e60e4d57e510bef12a53f01149ea0d54a 2023-10-18T20:52:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.733+0000 7f01ac605700 0 set uid:gid to 167:167 (ceph:ceph) 2023-10-18T20:52:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.733+0000 7f01ac605700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2023-10-18T20:52:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.733+0000 7f01ac605700 0 pidfile_write: ignore empty --pid-file 2023-10-18T20:52:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 systemd[1]: Started Ceph mon.smithi060 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T20:52:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.739+0000 7f01ac605700 0 load: jerasure load: lrc load: isa 2023-10-18T20:52:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: RocksDB version: 6.8.1 2023-10-18T20:52:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-10-18T20:52:49.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Compile date May 13 2021 2023-10-18T20:52:49.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: DB SUMMARY 2023-10-18T20:52:49.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:49.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: CURRENT file: CURRENT 2023-10-18T20:52:49.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:49.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: IDENTITY file: IDENTITY 2023-10-18T20:52:49.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:49.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2023-10-18T20:52:49.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:49.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi060/store.db dir, Total Num: 0, files: 2023-10-18T20:52:49.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:49.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi060/store.db: 000003.log size: 511 ; 2023-10-18T20:52:49.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:49.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.error_if_exists: 0 2023-10-18T20:52:49.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.create_if_missing: 0 2023-10-18T20:52:49.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.paranoid_checks: 1 2023-10-18T20:52:49.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.env: 0x558b087a11c0 2023-10-18T20:52:49.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.fs: Posix File System 2023-10-18T20:52:49.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.info_log: 0x558b09679960 2023-10-18T20:52:49.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.max_file_opening_threads: 16 2023-10-18T20:52:49.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.statistics: (nil) 2023-10-18T20:52:49.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.use_fsync: 0 2023-10-18T20:52:49.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.max_log_file_size: 0 2023-10-18T20:52:49.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-18T20:52:49.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.log_file_time_to_roll: 0 2023-10-18T20:52:49.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.keep_log_file_num: 1000 2023-10-18T20:52:49.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.recycle_log_file_num: 0 2023-10-18T20:52:49.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.allow_fallocate: 1 2023-10-18T20:52:49.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.allow_mmap_reads: 0 2023-10-18T20:52:49.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.allow_mmap_writes: 0 2023-10-18T20:52:49.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.use_direct_reads: 0 2023-10-18T20:52:49.996 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-18T20:52:49.996 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.create_missing_column_families: 0 2023-10-18T20:52:49.996 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.db_log_dir: 2023-10-18T20:52:49.996 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi060/store.db 2023-10-18T20:52:49.996 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.table_cache_numshardbits: 6 2023-10-18T20:52:49.999 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.max_subcompactions: 1 2023-10-18T20:52:49.999 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.max_background_flushes: -1 2023-10-18T20:52:49.999 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-10-18T20:52:49.999 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-10-18T20:52:49.999 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-18T20:52:50.000 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-18T20:52:50.000 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-10-18T20:52:50.000 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.advise_random_on_open: 1 2023-10-18T20:52:50.000 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.db_write_buffer_size: 0 2023-10-18T20:52:50.000 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.write_buffer_manager: 0x558b0a2ee030 2023-10-18T20:52:50.001 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-18T20:52:50.001 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-10-18T20:52:50.001 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-18T20:52:50.001 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.use_adaptive_mutex: 0 2023-10-18T20:52:50.001 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.rate_limiter: (nil) 2023-10-18T20:52:50.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-18T20:52:50.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.wal_recovery_mode: 2 2023-10-18T20:52:50.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.enable_thread_tracking: 0 2023-10-18T20:52:50.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.enable_pipelined_write: 0 2023-10-18T20:52:50.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.unordered_write: 0 2023-10-18T20:52:50.003 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-18T20:52:50.003 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-18T20:52:50.003 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-18T20:52:50.003 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-18T20:52:50.003 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.row_cache: None 2023-10-18T20:52:50.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.wal_filter: None 2023-10-18T20:52:50.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-18T20:52:50.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.allow_ingest_behind: 0 2023-10-18T20:52:50.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.preserve_deletes: 0 2023-10-18T20:52:50.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.two_write_queues: 0 2023-10-18T20:52:50.005 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.manual_wal_flush: 0 2023-10-18T20:52:50.005 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.atomic_flush: 0 2023-10-18T20:52:50.005 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-18T20:52:50.005 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.persist_stats_to_disk: 0 2023-10-18T20:52:50.005 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-10-18T20:52:50.005 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.log_readahead_size: 0 2023-10-18T20:52:50.006 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-10-18T20:52:50.006 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.max_background_jobs: 2 2023-10-18T20:52:50.006 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.max_background_compactions: -1 2023-10-18T20:52:50.006 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-18T20:52:50.006 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-18T20:52:50.007 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.delayed_write_rate : 16777216 2023-10-18T20:52:50.007 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.max_total_wal_size: 0 2023-10-18T20:52:50.007 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-18T20:52:50.007 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.stats_dump_period_sec: 600 2023-10-18T20:52:50.007 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.stats_persist_period_sec: 600 2023-10-18T20:52:50.008 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-18T20:52:50.008 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.max_open_files: -1 2023-10-18T20:52:50.008 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.bytes_per_sync: 0 2023-10-18T20:52:50.008 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-10-18T20:52:50.008 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-10-18T20:52:50.009 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Options.compaction_readahead_size: 0 2023-10-18T20:52:50.009 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Compression algorithms supported: 2023-10-18T20:52:50.009 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-18T20:52:50.009 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: kZSTD supported: 0 2023-10-18T20:52:50.009 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: kXpressCompression supported: 0 2023-10-18T20:52:50.010 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: kLZ4HCCompression supported: 1 2023-10-18T20:52:50.010 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: kLZ4Compression supported: 1 2023-10-18T20:52:50.010 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: kBZip2Compression supported: 0 2023-10-18T20:52:50.010 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: kZlibCompression supported: 1 2023-10-18T20:52:50.010 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: kSnappyCompression supported: 1 2023-10-18T20:52:50.011 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.741+0000 7f01ac605700 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-10-18T20:52:50.011 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000001 2023-10-18T20:52:50.011 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.011 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-10-18T20:52:50.011 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.012 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-18T20:52:50.012 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.merge_operator: 2023-10-18T20:52:50.012 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_filter: None 2023-10-18T20:52:50.012 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_filter_factory: None 2023-10-18T20:52:50.012 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-10-18T20:52:50.013 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.table_factory: BlockBasedTable 2023-10-18T20:52:50.013 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558b09590128) 2023-10-18T20:52:50.013 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cache_index_and_filter_blocks: 1 2023-10-18T20:52:50.013 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-18T20:52:50.013 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-18T20:52:50.014 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: pin_top_level_index_and_filter: 1 2023-10-18T20:52:50.014 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: index_type: 0 2023-10-18T20:52:50.014 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: data_block_index_type: 0 2023-10-18T20:52:50.014 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: index_shortening: 1 2023-10-18T20:52:50.014 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: data_block_hash_table_util_ratio: 0.750000 2023-10-18T20:52:50.015 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: hash_index_allow_collision: 1 2023-10-18T20:52:50.015 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: checksum: 1 2023-10-18T20:52:50.015 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: no_block_cache: 0 2023-10-18T20:52:50.015 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: block_cache: 0x558b095c6f10 2023-10-18T20:52:50.015 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: block_cache_name: BinnedLRUCache 2023-10-18T20:52:50.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: block_cache_options: 2023-10-18T20:52:50.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: capacity : 536870912 2023-10-18T20:52:50.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: num_shard_bits : 4 2023-10-18T20:52:50.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: strict_capacity_limit : 0 2023-10-18T20:52:50.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: high_pri_pool_ratio: 0.000 2023-10-18T20:52:50.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: block_cache_compressed: (nil) 2023-10-18T20:52:50.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: persistent_cache: (nil) 2023-10-18T20:52:50.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: block_size: 4096 2023-10-18T20:52:50.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: block_size_deviation: 10 2023-10-18T20:52:50.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: block_restart_interval: 16 2023-10-18T20:52:50.018 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: index_block_restart_interval: 1 2023-10-18T20:52:50.018 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: metadata_block_size: 4096 2023-10-18T20:52:50.018 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: partition_filters: 0 2023-10-18T20:52:50.018 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: use_delta_encoding: 1 2023-10-18T20:52:50.018 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: filter_policy: rocksdb.BuiltinBloomFilter 2023-10-18T20:52:50.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: whole_key_filtering: 1 2023-10-18T20:52:50.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: verify_compression: 0 2023-10-18T20:52:50.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: read_amp_bytes_per_bit: 0 2023-10-18T20:52:50.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: format_version: 2 2023-10-18T20:52:50.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: enable_index_compression: 1 2023-10-18T20:52:50.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: block_align: 0 2023-10-18T20:52:50.020 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.020 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.write_buffer_size: 33554432 2023-10-18T20:52:50.020 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_write_buffer_number: 2 2023-10-18T20:52:50.020 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compression: NoCompression 2023-10-18T20:52:50.020 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.bottommost_compression: Disabled 2023-10-18T20:52:50.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.prefix_extractor: nullptr 2023-10-18T20:52:50.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-18T20:52:50.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.num_levels: 7 2023-10-18T20:52:50.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-18T20:52:50.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-18T20:52:50.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-18T20:52:50.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-18T20:52:50.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-18T20:52:50.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-18T20:52:50.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-18T20:52:50.023 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-18T20:52:50.023 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-18T20:52:50.023 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compression_opts.window_bits: -14 2023-10-18T20:52:50.023 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compression_opts.level: 32767 2023-10-18T20:52:50.023 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compression_opts.strategy: 0 2023-10-18T20:52:50.024 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-18T20:52:50.024 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-18T20:52:50.024 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compression_opts.enabled: false 2023-10-18T20:52:50.024 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-18T20:52:50.024 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-18T20:52:50.025 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-18T20:52:50.025 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.target_file_size_base: 67108864 2023-10-18T20:52:50.025 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.target_file_size_multiplier: 1 2023-10-18T20:52:50.025 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-18T20:52:50.025 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-18T20:52:50.026 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-18T20:52:50.026 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-18T20:52:50.026 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-18T20:52:50.026 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-18T20:52:50.026 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-18T20:52:50.027 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-18T20:52:50.027 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-18T20:52:50.027 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-18T20:52:50.027 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-18T20:52:50.027 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-18T20:52:50.028 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.arena_block_size: 4194304 2023-10-18T20:52:50.028 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-18T20:52:50.028 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-18T20:52:50.028 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-10-18T20:52:50.028 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.disable_auto_compactions: 0 2023-10-18T20:52:50.029 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-18T20:52:50.029 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-18T20:52:50.029 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-18T20:52:50.029 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-18T20:52:50.029 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-18T20:52:50.030 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-18T20:52:50.030 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-18T20:52:50.030 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-18T20:52:50.030 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-18T20:52:50.030 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-18T20:52:50.030 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.table_properties_collectors: 2023-10-18T20:52:50.031 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.inplace_update_support: 0 2023-10-18T20:52:50.031 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-10-18T20:52:50.031 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-18T20:52:50.031 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-18T20:52:50.031 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.memtable_huge_page_size: 0 2023-10-18T20:52:50.032 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.bloom_locality: 0 2023-10-18T20:52:50.032 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.max_successive_merges: 0 2023-10-18T20:52:50.032 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-10-18T20:52:50.032 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.paranoid_file_checks: 0 2023-10-18T20:52:50.032 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.force_consistency_checks: 0 2023-10-18T20:52:50.033 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.report_bg_io_stats: 0 2023-10-18T20:52:50.033 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.ttl: 2592000 2023-10-18T20:52:50.033 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.742+0000 7f01ac605700 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-10-18T20:52:50.033 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.744+0000 7f01ac605700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-18T20:52:50.033 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.034 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.744+0000 7f01ac605700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2023-10-18T20:52:50.034 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.034 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.744+0000 7f01ac605700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662369745889, "job": 1, "event": "recovery_started", "log_files": [3]} 2023-10-18T20:52:50.034 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.744+0000 7f01ac605700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2023-10-18T20:52:50.034 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.745+0000 7f01ac605700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-10-18T20:52:50.035 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.746+0000 7f01ac605700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662369747386, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1697662369, "oldest_key_time": 3, "file_creation_time": 0}} 2023-10-18T20:52:50.035 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.746+0000 7f01ac605700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2023-10-18T20:52:50.035 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.035 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.748+0000 7f01ac605700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662369749201, "job": 1, "event": "recovery_finished"} 2023-10-18T20:52:50.035 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.750+0000 7f01ac605700 4 rocksdb: DB pointer 0x558b0968b800 2023-10-18T20:52:50.036 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.751+0000 7f019341d700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-10-18T20:52:50.036 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.751+0000 7f019341d700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-10-18T20:52:50.036 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ** DB Stats ** 2023-10-18T20:52:50.036 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:52:50.036 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-18T20:52:50.036 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T20:52:50.037 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T20:52:50.037 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-18T20:52:50.037 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-10-18T20:52:50.037 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T20:52:50.038 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.038 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ** Compaction Stats [default] ** 2023-10-18T20:52:50.038 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:52:50.038 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:52:50.038 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.1 0.00 0.00 1 0.001 0 0 2023-10-18T20:52:50.039 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.1 0.00 0.00 1 0.001 0 0 2023-10-18T20:52:50.039 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.1 0.00 0.00 1 0.001 0 0 2023-10-18T20:52:50.039 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.039 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ** Compaction Stats [default] ** 2023-10-18T20:52:50.039 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:52:50.040 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:52:50.040 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.1 0.00 0.00 1 0.001 0 0 2023-10-18T20:52:50.040 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:52:50.040 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Flush(GB): cumulative 0.000, interval 0.000 2023-10-18T20:52:50.040 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T20:52:50.041 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T20:52:50.041 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T20:52:50.041 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: AddFile(Keys): cumulative 0, interval 0 2023-10-18T20:52:50.041 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Cumulative compaction: 0.00 GB write, 0.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:52:50.041 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Interval compaction: 0.00 GB write, 0.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:52:50.042 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T20:52:50.042 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.042 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ** File Read Latency Histogram By Level [default] ** 2023-10-18T20:52:50.042 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.042 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ** Compaction Stats [default] ** 2023-10-18T20:52:50.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:52:50.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:52:50.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.1 0.00 0.00 1 0.001 0 0 2023-10-18T20:52:50.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.1 0.00 0.00 1 0.001 0 0 2023-10-18T20:52:50.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:52:50.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ** Compaction Stats [default] ** 2023-10-18T20:52:50.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:52:50.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:52:50.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.1 0.00 0.00 1 0.001 0 0 2023-10-18T20:52:50.045 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:52:50.045 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Flush(GB): cumulative 0.000, interval 0.000 2023-10-18T20:52:50.045 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T20:52:50.045 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T20:52:50.045 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T20:52:50.046 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: AddFile(Keys): cumulative 0, interval 0 2023-10-18T20:52:50.046 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Cumulative compaction: 0.00 GB write, 0.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:52:50.046 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:52:50.046 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T20:52:50.046 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.047 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: ** File Read Latency Histogram By Level [default] ** 2023-10-18T20:52:50.047 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.047 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.751+0000 7f01ac605700 0 mon.smithi060 does not exist in monmap, will attempt to join an existing cluster 2023-10-18T20:52:50.047 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.752+0000 7f01ac605700 0 using public_addr v2:172.21.15.60:0/0 -> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] 2023-10-18T20:52:50.047 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.753+0000 7f01ac605700 0 starting mon.smithi060 rank -1 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi060 fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:52:50.048 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.755+0000 7f01ac605700 1 mon.smithi060@-1(???) e0 preinit fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:52:50.048 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.799+0000 7f0195c22700 0 mon.smithi060@-1(synchronizing).mds e1 new map 2023-10-18T20:52:50.048 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.799+0000 7f0195c22700 0 mon.smithi060@-1(synchronizing).mds e1 print_map 2023-10-18T20:52:50.048 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: e1 2023-10-18T20:52:50.048 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:52:50.049 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:52:50.049 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: legacy client fscid: -1 2023-10-18T20:52:50.049 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.049 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: No filesystems configured 2023-10-18T20:52:50.049 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: 2023-10-18T20:52:50.049 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.799+0000 7f0195c22700 1 mon.smithi060@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-18T20:52:50.050 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 1 mon.smithi060@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-18T20:52:50.050 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 1 mon.smithi060@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-18T20:52:50.050 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 1 mon.smithi060@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-18T20:52:50.050 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 1 mon.smithi060@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-18T20:52:50.050 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 1 mon.smithi060@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-18T20:52:50.051 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 1 mon.smithi060@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-10-18T20:52:50.051 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 0 mon.smithi060@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-18T20:52:50.051 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 0 mon.smithi060@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T20:52:50.051 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 0 mon.smithi060@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T20:52:50.051 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 0 mon.smithi060@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T20:52:50.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:48.092103+0000 mgr.smithi008.flmjzp (mgr.14164) 52 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:50.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.800+0000 7f0195c22700 1 mon.smithi060@-1(synchronizing).paxosservice(auth 1..7) refresh upgraded, format 0 -> 3 2023-10-18T20:52:50.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta expand map: {default=false} 2023-10-18T20:52:50.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta from 'false' to 'false' 2023-10-18T20:52:50.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta expanded map: {default=false} 2023-10-18T20:52:50.053 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta expand map: {default=info} 2023-10-18T20:52:50.053 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta from 'info' to 'info' 2023-10-18T20:52:50.053 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta expanded map: {default=info} 2023-10-18T20:52:50.053 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta expand map: {default=daemon} 2023-10-18T20:52:50.053 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta from 'daemon' to 'daemon' 2023-10-18T20:52:50.054 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta expanded map: {default=daemon} 2023-10-18T20:52:50.054 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta expand map: {default=debug} 2023-10-18T20:52:50.054 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta from 'debug' to 'debug' 2023-10-18T20:52:50.054 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 20 expand_channel_meta expanded map: {default=debug} 2023-10-18T20:52:50.054 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:52:49.802+0000 7f0195c22700 10 mon.smithi060@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-10-18T20:52:55.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:49.810093+0000 mon.smithi008 (mon.0) 167 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:52:55.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:49.810329+0000 mon.smithi008 (mon.0) 168 : cluster [INF] mon.smithi008 calling monitor election 2023-10-18T20:52:55.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:49.812090+0000 mon.smithi008 (mon.0) 169 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:50.092438+0000 mgr.smithi008.flmjzp (mgr.14164) 53 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:55.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:50.806685+0000 mon.smithi008 (mon.0) 170 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:51.806711+0000 mon.smithi008 (mon.0) 171 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:51.808047+0000 mon.smithi060 (mon.1) 1 : cluster [INF] mon.smithi060 calling monitor election 2023-10-18T20:52:55.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:52.092864+0000 mgr.smithi008.flmjzp (mgr.14164) 54 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:55.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:52.806804+0000 mon.smithi008 (mon.0) 172 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:53.475888+0000 mon.smithi008 (mon.0) 173 : audit [DBG] from='mgr.? 172.21.15.60:0/821722761' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/crt"}]: dispatch 2023-10-18T20:52:55.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:53.806710+0000 mon.smithi008 (mon.0) 174 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:54.093209+0000 mgr.smithi008.flmjzp (mgr.14164) 55 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:55.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:54.806924+0000 mon.smithi008 (mon.0) 175 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:54.815136+0000 mon.smithi008 (mon.0) 176 : cluster [INF] mon.smithi008 is new leader, mons smithi008,smithi060 in quorum (ranks 0,1) 2023-10-18T20:52:55.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:54.818598+0000 mon.smithi008 (mon.0) 177 : cluster [DBG] monmap e2: 2 mons at {smithi008=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} 2023-10-18T20:52:55.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:54.818643+0000 mon.smithi008 (mon.0) 178 : cluster [DBG] fsmap 2023-10-18T20:52:55.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:54.818671+0000 mon.smithi008 (mon.0) 179 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2023-10-18T20:52:55.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:54.818884+0000 mon.smithi008 (mon.0) 180 : cluster [DBG] mgrmap e17: smithi008.flmjzp(active, since 92s) 2023-10-18T20:52:55.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:54.820130+0000 mon.smithi008 (mon.0) 181 : cluster [DBG] Standby manager daemon smithi060.pgqqwa started 2023-10-18T20:52:55.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:54.821072+0000 mon.smithi008 (mon.0) 182 : audit [DBG] from='mgr.? 172.21.15.60:0/821722761' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:52:55.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:54.822733+0000 mon.smithi008 (mon.0) 183 : cluster [INF] overall HEALTH_OK 2023-10-18T20:52:55.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:54.825195+0000 mon.smithi008 (mon.0) 184 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:55.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:54.825422+0000 mon.smithi008 (mon.0) 185 : audit [DBG] from='mgr.? 172.21.15.60:0/821722761' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/key"}]: dispatch 2023-10-18T20:52:55.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:54.825999+0000 mon.smithi008 (mon.0) 186 : audit [DBG] from='mgr.? 172.21.15.60:0/821722761' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:52:55.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:49.810093+0000 mon.smithi008 (mon.0) 167 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:52:55.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:49.810329+0000 mon.smithi008 (mon.0) 168 : cluster [INF] mon.smithi008 calling monitor election 2023-10-18T20:52:55.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:49.812090+0000 mon.smithi008 (mon.0) 169 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:50.092438+0000 mgr.smithi008.flmjzp (mgr.14164) 53 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:55.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:50.806685+0000 mon.smithi008 (mon.0) 170 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:51.806711+0000 mon.smithi008 (mon.0) 171 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:51.808047+0000 mon.smithi060 (mon.1) 1 : cluster [INF] mon.smithi060 calling monitor election 2023-10-18T20:52:55.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:52.092864+0000 mgr.smithi008.flmjzp (mgr.14164) 54 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:55.190 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:52.806804+0000 mon.smithi008 (mon.0) 172 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.190 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:53.475888+0000 mon.smithi008 (mon.0) 173 : audit [DBG] from='mgr.? 172.21.15.60:0/821722761' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/crt"}]: dispatch 2023-10-18T20:52:55.190 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:53.806710+0000 mon.smithi008 (mon.0) 174 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.190 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:54.093209+0000 mgr.smithi008.flmjzp (mgr.14164) 55 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:55.190 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:54.806924+0000 mon.smithi008 (mon.0) 175 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:55.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:54.815136+0000 mon.smithi008 (mon.0) 176 : cluster [INF] mon.smithi008 is new leader, mons smithi008,smithi060 in quorum (ranks 0,1) 2023-10-18T20:52:55.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:54.818598+0000 mon.smithi008 (mon.0) 177 : cluster [DBG] monmap e2: 2 mons at {smithi008=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} 2023-10-18T20:52:55.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:54.818643+0000 mon.smithi008 (mon.0) 178 : cluster [DBG] fsmap 2023-10-18T20:52:55.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:54.818671+0000 mon.smithi008 (mon.0) 179 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2023-10-18T20:52:55.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:54.818884+0000 mon.smithi008 (mon.0) 180 : cluster [DBG] mgrmap e17: smithi008.flmjzp(active, since 92s) 2023-10-18T20:52:55.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:54.820130+0000 mon.smithi008 (mon.0) 181 : cluster [DBG] Standby manager daemon smithi060.pgqqwa started 2023-10-18T20:52:55.192 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:54.821072+0000 mon.smithi008 (mon.0) 182 : audit [DBG] from='mgr.? 172.21.15.60:0/821722761' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:52:55.192 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:54.822733+0000 mon.smithi008 (mon.0) 183 : cluster [INF] overall HEALTH_OK 2023-10-18T20:52:55.192 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:54.825195+0000 mon.smithi008 (mon.0) 184 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:52:55.192 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:54.825422+0000 mon.smithi008 (mon.0) 185 : audit [DBG] from='mgr.? 172.21.15.60:0/821722761' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/key"}]: dispatch 2023-10-18T20:52:55.192 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:54.825999+0000 mon.smithi008 (mon.0) 186 : audit [DBG] from='mgr.? 172.21.15.60:0/821722761' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:52:55.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.268+0000 7f05f1ffb700 1 -- 172.21.15.60:0/1617912190 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e4017670 con 0x7f05dc003250 2023-10-18T20:52:55.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.268+0000 7f05f3fff700 1 -- 172.21.15.60:0/1617912190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05dc003250 msgr2=0x7f05dc0056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:55.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.268+0000 7f05f3fff700 1 --2- 172.21.15.60:0/1617912190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05dc003250 0x7f05dc0056e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f05f40f9300 tx=0x7f05e4002040).stop 2023-10-18T20:52:55.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.268+0000 7f05f3fff700 1 -- 172.21.15.60:0/1617912190 shutdown_connections 2023-10-18T20:52:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.268+0000 7f05f3fff700 1 --2- 172.21.15.60:0/1617912190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05dc003250 0x7f05dc0056e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.268+0000 7f05f3fff700 1 -- 172.21.15.60:0/1617912190 >> 172.21.15.60:0/1617912190 conn(0x7f05f40610d0 msgr2=0x7f05f40f60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.268+0000 7f05f3fff700 1 -- 172.21.15.60:0/1617912190 shutdown_connections 2023-10-18T20:52:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.269+0000 7f05f3fff700 1 -- 172.21.15.60:0/1617912190 wait complete. 2023-10-18T20:52:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.269+0000 7f05f3fff700 1 Processor -- start 2023-10-18T20:52:55.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.270+0000 7f05f3fff700 1 -- start start 2023-10-18T20:52:55.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.270+0000 7f05f3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05dc003250 0x7f05f41086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:55.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.270+0000 7f05f3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05f4108b90 0x7f05f4109a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:55.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.270+0000 7f05f3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f41090f0 con 0x7f05dc003250 2023-10-18T20:52:55.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.270+0000 7f05f3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f4109230 con 0x7f05f4108b90 2023-10-18T20:52:55.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.270+0000 7f05f2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05dc003250 0x7f05f41086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.271+0000 7f05f2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05dc003250 0x7f05f41086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.60:48126/0 (socket says 172.21.15.60:48126) 2023-10-18T20:52:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.271+0000 7f05f2ffd700 1 -- 172.21.15.60:0/382115616 learned_addr learned my addr 172.21.15.60:0/382115616 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:52:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.271+0000 7f05f2ffd700 1 -- 172.21.15.60:0/382115616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05f4108b90 msgr2=0x7f05f4109a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.271+0000 7f05f2ffd700 1 --2- 172.21.15.60:0/382115616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05f4108b90 0x7f05f4109a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:52:55.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.271+0000 7f05f2ffd700 1 -- 172.21.15.60:0/382115616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e4005040 con 0x7f05dc003250 2023-10-18T20:52:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.271+0000 7f05f2ffd700 1 --2- 172.21.15.60:0/382115616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05dc003250 0x7f05f41086a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f05e4000ea0 tx=0x7f05e4002040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.271+0000 7f05db7fe700 1 -- 172.21.15.60:0/382115616 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e4017410 con 0x7f05dc003250 2023-10-18T20:52:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.271+0000 7f05db7fe700 1 -- 172.21.15.60:0/382115616 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f05e400f040 con 0x7f05dc003250 2023-10-18T20:52:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.271+0000 7f05f3fff700 1 -- 172.21.15.60:0/382115616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f410a030 con 0x7f05dc003250 2023-10-18T20:52:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.271+0000 7f05db7fe700 1 -- 172.21.15.60:0/382115616 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e4021950 con 0x7f05dc003250 2023-10-18T20:52:55.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.272+0000 7f05f3fff700 1 -- 172.21.15.60:0/382115616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f410a5f0 con 0x7f05dc003250 2023-10-18T20:52:55.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.273+0000 7f05f3fff700 1 -- 172.21.15.60:0/382115616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f4059100 con 0x7f05dc003250 2023-10-18T20:52:55.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.274+0000 7f05db7fe700 1 -- 172.21.15.60:0/382115616 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f05e4028030 con 0x7f05dc003250 2023-10-18T20:52:55.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.275+0000 7f05db7fe700 1 --2- 172.21.15.60:0/382115616 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f05e005c3f0 0x7f05e005e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:55.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.275+0000 7f05db7fe700 1 -- 172.21.15.60:0/382115616 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f05e4076410 con 0x7f05dc003250 2023-10-18T20:52:55.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.275+0000 7f05f27fc700 1 --2- 172.21.15.60:0/382115616 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f05e005c3f0 0x7f05e005e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:55.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.276+0000 7f05f27fc700 1 --2- 172.21.15.60:0/382115616 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f05e005c3f0 0x7f05e005e8b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f05e80095b0 tx=0x7f05e8006ae0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:55.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.280+0000 7f05db7fe700 1 -- 172.21.15.60:0/382115616 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f05e404a0f0 con 0x7f05dc003250 2023-10-18T20:52:55.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.510+0000 7f05f3fff700 1 -- 172.21.15.60:0/382115616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f05f4045ad0 con 0x7f05dc003250 2023-10-18T20:52:55.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.511+0000 7f05db7fe700 1 -- 172.21.15.60:0/382115616 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+960 (secure 0 0 0) 0x7f05e4026030 con 0x7f05dc003250 2023-10-18T20:52:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-18T20:52:55.514 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":2,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","modified":"2023-10-18T20:52:49.806997Z","created":"2023-10-18T20:50:22.074847Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi008","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-18T20:52:55.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 -- 172.21.15.60:0/382115616 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f05e005c3f0 msgr2=0x7f05e005e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:55.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 --2- 172.21.15.60:0/382115616 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f05e005c3f0 0x7f05e005e8b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f05e80095b0 tx=0x7f05e8006ae0).stop 2023-10-18T20:52:55.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 -- 172.21.15.60:0/382115616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05dc003250 msgr2=0x7f05f41086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:55.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 --2- 172.21.15.60:0/382115616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05dc003250 0x7f05f41086a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f05e4000ea0 tx=0x7f05e4002040).stop 2023-10-18T20:52:55.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 -- 172.21.15.60:0/382115616 shutdown_connections 2023-10-18T20:52:55.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 --2- 172.21.15.60:0/382115616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05dc003250 0x7f05f41086a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:55.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 --2- 172.21.15.60:0/382115616 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f05e005c3f0 0x7f05e005e8b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:55.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 --2- 172.21.15.60:0/382115616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05f4108b90 0x7f05f4109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:52:55.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 -- 172.21.15.60:0/382115616 >> 172.21.15.60:0/382115616 conn(0x7f05f40610d0 msgr2=0x7f05f40fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:55.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 -- 172.21.15.60:0/382115616 shutdown_connections 2023-10-18T20:52:55.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:52:55.513+0000 7f05f3fff700 1 -- 172.21.15.60:0/382115616 wait complete. 2023-10-18T20:52:55.518 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 2 2023-10-18T20:52:56.031 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-18T20:52:56.031 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-18T20:52:56.149 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:52:54.826295+0000 mgr.smithi008.flmjzp (mgr.14164) 56 : cephadm [INF] Deploying daemon node-exporter.smithi060 on smithi060 2023-10-18T20:52:56.149 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:54.882524+0000 mon.smithi008 (mon.0) 187 : cluster [DBG] mgrmap e18: smithi008.flmjzp(active, since 92s), standbys: smithi060.pgqqwa 2023-10-18T20:52:56.150 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:54.882662+0000 mon.smithi008 (mon.0) 188 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr metadata", "who": "smithi060.pgqqwa", "id": "smithi060.pgqqwa"}]: dispatch 2023-10-18T20:52:56.150 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:55.512293+0000 mon.smithi008 (mon.0) 189 : audit [DBG] from='client.? 172.21.15.60:0/382115616' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:56.150 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:55.807046+0000 mon.smithi008 (mon.0) 190 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:52:54.826295+0000 mgr.smithi008.flmjzp (mgr.14164) 56 : cephadm [INF] Deploying daemon node-exporter.smithi060 on smithi060 2023-10-18T20:52:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:54.882524+0000 mon.smithi008 (mon.0) 187 : cluster [DBG] mgrmap e18: smithi008.flmjzp(active, since 92s), standbys: smithi060.pgqqwa 2023-10-18T20:52:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:54.882662+0000 mon.smithi008 (mon.0) 188 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr metadata", "who": "smithi060.pgqqwa", "id": "smithi060.pgqqwa"}]: dispatch 2023-10-18T20:52:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:55.512293+0000 mon.smithi008 (mon.0) 189 : audit [DBG] from='client.? 172.21.15.60:0/382115616' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T20:52:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:55.807046+0000 mon.smithi008 (mon.0) 190 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:52:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:56.093470+0000 mgr.smithi008.flmjzp (mgr.14164) 57 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:56.093470+0000 mgr.smithi008.flmjzp (mgr.14164) 57 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:57.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.470+0000 7fd617fff700 1 -- 172.21.15.8:0/1442981646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd618060180 msgr2=0x7fd6180f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:57.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.470+0000 7fd617fff700 1 --2- 172.21.15.8:0/1442981646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd618060180 0x7fd6180f8f80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fd608009fb0 tx=0x7fd608009b30).stop 2023-10-18T20:52:57.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.470+0000 7fd617fff700 1 -- 172.21.15.8:0/1442981646 shutdown_connections 2023-10-18T20:52:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.470+0000 7fd617fff700 1 --2- 172.21.15.8:0/1442981646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd618060180 0x7fd6180f8f80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.470+0000 7fd617fff700 1 -- 172.21.15.8:0/1442981646 >> 172.21.15.8:0/1442981646 conn(0x7fd6180f09a0 msgr2=0x7fd6180f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.470+0000 7fd617fff700 1 -- 172.21.15.8:0/1442981646 shutdown_connections 2023-10-18T20:52:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.470+0000 7fd617fff700 1 -- 172.21.15.8:0/1442981646 wait complete. 2023-10-18T20:52:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.471+0000 7fd617fff700 1 Processor -- start 2023-10-18T20:52:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.471+0000 7fd617fff700 1 -- start start 2023-10-18T20:52:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.471+0000 7fd617fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd618060180 0x7fd6181087d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.471+0000 7fd617fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd618108cc0 0x7fd618109bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.471+0000 7fd617fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd618109220 con 0x7fd618060180 2023-10-18T20:52:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.471+0000 7fd617fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd618109360 con 0x7fd618108cc0 2023-10-18T20:52:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.471+0000 7fd616ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd618060180 0x7fd6181087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd616ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd618060180 0x7fd6181087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37962/0 (socket says 172.21.15.8:37962) 2023-10-18T20:52:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd616ffd700 1 -- 172.21.15.8:0/4228126598 learned_addr learned my addr 172.21.15.8:0/4228126598 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:52:57.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd6167fc700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd618108cc0 0x7fd618109bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:57.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd616ffd700 1 -- 172.21.15.8:0/4228126598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd618108cc0 msgr2=0x7fd618109bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:57.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd616ffd700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd618108cc0 0x7fd618109bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:57.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd616ffd700 1 -- 172.21.15.8:0/4228126598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608005040 con 0x7fd618060180 2023-10-18T20:52:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd6167fc700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd618108cc0 0x7fd618109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T20:52:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd616ffd700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd618060180 0x7fd6181087d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd608000c00 tx=0x7fd60800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd5ff7fe700 1 -- 172.21.15.8:0/4228126598 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd608019070 con 0x7fd618060180 2023-10-18T20:52:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd5ff7fe700 1 -- 172.21.15.8:0/4228126598 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd608007cc0 con 0x7fd618060180 2023-10-18T20:52:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd5ff7fe700 1 -- 172.21.15.8:0/4228126598 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd60801d620 con 0x7fd618060180 2023-10-18T20:52:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd617fff700 1 -- 172.21.15.8:0/4228126598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61810a160 con 0x7fd618060180 2023-10-18T20:52:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.472+0000 7fd617fff700 1 -- 172.21.15.8:0/4228126598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61810a6c0 con 0x7fd618060180 2023-10-18T20:52:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.473+0000 7fd617fff700 1 -- 172.21.15.8:0/4228126598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd618045ad0 con 0x7fd618060180 2023-10-18T20:52:57.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.474+0000 7fd5ff7fe700 1 -- 172.21.15.8:0/4228126598 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd608025070 con 0x7fd618060180 2023-10-18T20:52:57.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.475+0000 7fd5ff7fe700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd60005c400 0x7fd60005e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:52:57.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.475+0000 7fd5ff7fe700 1 -- 172.21.15.8:0/4228126598 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fd608076410 con 0x7fd618060180 2023-10-18T20:52:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.475+0000 7fd6167fc700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd60005c400 0x7fd60005e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:52:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.476+0000 7fd6167fc700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd60005c400 0x7fd60005e8c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd60c00a820 tx=0x7fd60c008040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:52:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.479+0000 7fd5ff7fe700 1 -- 172.21.15.8:0/4228126598 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd60804a060 con 0x7fd618060180 2023-10-18T20:52:57.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.644+0000 7fd617fff700 1 -- 172.21.15.8:0/4228126598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd61810a8e0 con 0x7fd618060180 2023-10-18T20:52:57.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.644+0000 7fd5ff7fe700 1 -- 172.21.15.8:0/4228126598 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v12) v1 ==== 76+0+221 (secure 0 0 0) 0x7fd61810a8e0 con 0x7fd618060180 2023-10-18T20:52:57.647 INFO:teuthology.orchestra.run.smithi008.stdout:# minimal ceph.conf for e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:52:57.647 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-10-18T20:52:57.647 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:52:57.647 INFO:teuthology.orchestra.run.smithi008.stdout: mon_host = [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] 2023-10-18T20:52:57.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 -- 172.21.15.8:0/4228126598 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd60005c400 msgr2=0x7fd60005e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:57.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd60005c400 0x7fd60005e8c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd60c00a820 tx=0x7fd60c008040).stop 2023-10-18T20:52:57.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 -- 172.21.15.8:0/4228126598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd618060180 msgr2=0x7fd6181087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:52:57.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd618060180 0x7fd6181087d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd608000c00 tx=0x7fd60800b040).stop 2023-10-18T20:52:57.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 -- 172.21.15.8:0/4228126598 shutdown_connections 2023-10-18T20:52:57.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd618060180 0x7fd6181087d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:57.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd60005c400 0x7fd60005e8c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:57.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 --2- 172.21.15.8:0/4228126598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd618108cc0 0x7fd618109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:52:57.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 -- 172.21.15.8:0/4228126598 >> 172.21.15.8:0/4228126598 conn(0x7fd6180f09a0 msgr2=0x7fd6180f1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:52:57.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 -- 172.21.15.8:0/4228126598 shutdown_connections 2023-10-18T20:52:57.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:52:57.646+0000 7fd617fff700 1 -- 172.21.15.8:0/4228126598 wait complete. 2023-10-18T20:52:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:52:57.645185+0000 mon.smithi008 (mon.0) 191 : audit [DBG] from='client.? 172.21.15.8:0/4228126598' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:52:58.037 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-18T20:52:58.037 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:52:58.038 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.conf 2023-10-18T20:52:58.113 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:52:58.114 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-18T20:52:58.224 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:52:58.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2023-10-18T20:52:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:52:57.645185+0000 mon.smithi008 (mon.0) 191 : audit [DBG] from='client.? 172.21.15.8:0/4228126598' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:52:58.309 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:52:58.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-18T20:52:58.424 INFO:tasks.cephadm:Deploying OSDs... 2023-10-18T20:52:58.424 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:52:58.425 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T20:52:58.473 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T20:52:58.473 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-10-18T20:52:58.560 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T20:52:58.561 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T20:52:58.561 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-18T20:52:58.561 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T20:52:58.561 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T20:52:58.561 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-18 20:52:35.250417463 +0000 2023-10-18T20:52:58.562 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-18 20:44:49.862383754 +0000 2023-10-18T20:52:58.562 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-18 20:44:49.862383754 +0000 2023-10-18T20:52:58.562 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-18 20:44:49.841383997 +0000 2023-10-18T20:52:58.562 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T20:52:58.632 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-18T20:52:58.632 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-18T20:52:58.632 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000180618 s, 2.8 MB/s 2023-10-18T20:52:58.635 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T20:52:58.684 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-10-18T20:52:58.731 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T20:52:58.731 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T20:52:58.731 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-18T20:52:58.732 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T20:52:58.732 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T20:52:58.732 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-18 20:52:35.250417463 +0000 2023-10-18T20:52:58.732 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-18 20:44:50.699374067 +0000 2023-10-18T20:52:58.732 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-18 20:44:50.699374067 +0000 2023-10-18T20:52:58.733 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-18 20:44:50.679374298 +0000 2023-10-18T20:52:58.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T20:52:58.801 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-18T20:52:58.802 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-18T20:52:58.802 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000163276 s, 3.1 MB/s 2023-10-18T20:52:58.804 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T20:52:58.854 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-10-18T20:52:58.901 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T20:52:58.902 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T20:52:58.902 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-18T20:52:58.902 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T20:52:58.902 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T20:52:58.902 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-18 20:52:35.251417452 +0000 2023-10-18T20:52:58.903 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-18 20:44:51.542364310 +0000 2023-10-18T20:52:58.903 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-18 20:44:51.542364310 +0000 2023-10-18T20:52:58.903 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-18 20:44:51.522364542 +0000 2023-10-18T20:52:58.903 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T20:52:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-18T20:52:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-18T20:52:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000164225 s, 3.1 MB/s 2023-10-18T20:52:58.975 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T20:52:59.024 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-10-18T20:52:59.071 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T20:52:59.071 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T20:52:59.072 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-18T20:52:59.072 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T20:52:59.072 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T20:52:59.072 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-18 20:52:35.251417452 +0000 2023-10-18T20:52:59.072 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-18 20:44:52.366354774 +0000 2023-10-18T20:52:59.073 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-18 20:44:52.366354774 +0000 2023-10-18T20:52:59.073 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-18 20:44:52.346355005 +0000 2023-10-18T20:52:59.073 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T20:52:59.142 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-18T20:52:59.142 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-18T20:52:59.142 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000173953 s, 2.9 MB/s 2023-10-18T20:52:59.144 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T20:52:59.194 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:52:59.194 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T20:52:59.246 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T20:52:59.247 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2023-10-18T20:52:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T20:52:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T20:52:59.297 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-18T20:52:59.298 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T20:52:59.298 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T20:52:59.298 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-18 20:52:55.661714143 +0000 2023-10-18T20:52:59.298 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-18 20:44:49.867987961 +0000 2023-10-18T20:52:59.298 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-18 20:44:49.867987961 +0000 2023-10-18T20:52:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2023-10-18 20:44:49.844988183 +0000 2023-10-18T20:52:59.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T20:52:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-18T20:52:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-18T20:52:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000175747 s, 2.9 MB/s 2023-10-18T20:52:59.372 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T20:52:59.422 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2023-10-18T20:52:59.470 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T20:52:59.470 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T20:52:59.470 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-18T20:52:59.470 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T20:52:59.471 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T20:52:59.473 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-18 20:52:55.661714143 +0000 2023-10-18T20:52:59.474 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-18 20:44:50.740979533 +0000 2023-10-18T20:52:59.474 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-18 20:44:50.740979533 +0000 2023-10-18T20:52:59.474 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2023-10-18 20:44:50.715979774 +0000 2023-10-18T20:52:59.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T20:52:59.578 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-18T20:52:59.578 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-18T20:52:59.579 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000177751 s, 2.9 MB/s 2023-10-18T20:52:59.579 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:52:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:52:58.093679+0000 mgr.smithi008.flmjzp (mgr.14164) 58 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:59.581 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T20:52:59.630 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2023-10-18T20:52:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:52:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:52:58.093679+0000 mgr.smithi008.flmjzp (mgr.14164) 58 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:52:59.677 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T20:52:59.677 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T20:52:59.678 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-18T20:52:59.678 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T20:52:59.678 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T20:52:59.678 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-18 20:52:55.662714134 +0000 2023-10-18T20:52:59.679 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-18 20:44:51.567971547 +0000 2023-10-18T20:52:59.679 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-18 20:44:51.567971547 +0000 2023-10-18T20:52:59.679 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2023-10-18 20:44:51.546971750 +0000 2023-10-18T20:52:59.679 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T20:52:59.747 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-18T20:52:59.748 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-18T20:52:59.748 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000174249 s, 2.9 MB/s 2023-10-18T20:52:59.750 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T20:52:59.800 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2023-10-18T20:52:59.847 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T20:52:59.847 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T20:52:59.847 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-18T20:52:59.848 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T20:52:59.848 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T20:52:59.848 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-18 20:52:55.662714134 +0000 2023-10-18T20:52:59.848 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-18 20:44:52.421963304 +0000 2023-10-18T20:52:59.848 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-18 20:44:52.421963304 +0000 2023-10-18T20:52:59.849 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2023-10-18 20:44:52.398963526 +0000 2023-10-18T20:52:59.849 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T20:52:59.956 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-18T20:52:59.956 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-18T20:52:59.956 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000189754 s, 2.7 MB/s 2023-10-18T20:52:59.958 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T20:53:00.007 INFO:tasks.cephadm:Deploying osd.0 on smithi008 with /dev/vg_nvme/lv_4... 2023-10-18T20:53:00.008 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-18T20:53:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:00.093995+0000 mgr.smithi008.flmjzp (mgr.14164) 59 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:00.093995+0000 mgr.smithi008.flmjzp (mgr.14164) 59 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-18T20:53:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-18T20:53:01.841 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-18T20:53:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-18T20:53:01.842 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0309506 s, 339 MB/s 2023-10-18T20:53:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-18T20:53:02.254 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_4 2023-10-18T20:53:03.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:02.094266+0000 mgr.smithi008.flmjzp (mgr.14164) 60 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:03.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:02.094266+0000 mgr.smithi008.flmjzp (mgr.14164) 60 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:04.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.471+0000 7f31bb0b7700 1 -- 172.21.15.8:0/609996760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31b40f6530 msgr2=0x7f31b40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:04.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.471+0000 7f31bb0b7700 1 --2- 172.21.15.8:0/609996760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31b40f6530 0x7f31b40f6950 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f31b0004660 tx=0x7f31b0009b30).stop 2023-10-18T20:53:04.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.472+0000 7f31bb0b7700 1 -- 172.21.15.8:0/609996760 shutdown_connections 2023-10-18T20:53:04.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.472+0000 7f31bb0b7700 1 --2- 172.21.15.8:0/609996760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40f77d0 0x7f31b40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:04.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.472+0000 7f31bb0b7700 1 --2- 172.21.15.8:0/609996760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31b40f6530 0x7f31b40f6950 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:04.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.472+0000 7f31bb0b7700 1 -- 172.21.15.8:0/609996760 >> 172.21.15.8:0/609996760 conn(0x7f31b40f1c90 msgr2=0x7f31b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:53:04.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.472+0000 7f31bb0b7700 1 -- 172.21.15.8:0/609996760 shutdown_connections 2023-10-18T20:53:04.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.472+0000 7f31bb0b7700 1 -- 172.21.15.8:0/609996760 wait complete. 2023-10-18T20:53:04.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.472+0000 7f31bb0b7700 1 Processor -- start 2023-10-18T20:53:04.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.473+0000 7f31bb0b7700 1 -- start start 2023-10-18T20:53:04.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.473+0000 7f31bb0b7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31b40f6530 0x7f31b406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:53:04.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.473+0000 7f31bb0b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40f77d0 0x7f31b4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:53:04.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.473+0000 7f31bb0b7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b406a380 con 0x7f31b40f6530 2023-10-18T20:53:04.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.473+0000 7f31bb0b7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b406a4c0 con 0x7f31b40f77d0 2023-10-18T20:53:04.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.473+0000 7f31ba0b5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31b40f6530 0x7f31b406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:53:04.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.473+0000 7f31ba0b5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31b40f6530 0x7f31b406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37990/0 (socket says 172.21.15.8:37990) 2023-10-18T20:53:04.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.473+0000 7f31b98b4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40f77d0 0x7f31b4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:53:04.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.473+0000 7f31ba0b5700 1 -- 172.21.15.8:0/4008311973 learned_addr learned my addr 172.21.15.8:0/4008311973 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:53:04.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.474+0000 7f31ba0b5700 1 -- 172.21.15.8:0/4008311973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40f77d0 msgr2=0x7f31b4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:04.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.474+0000 7f31ba0b5700 1 --2- 172.21.15.8:0/4008311973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40f77d0 0x7f31b4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:04.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.474+0000 7f31ba0b5700 1 -- 172.21.15.8:0/4008311973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0005040 con 0x7f31b40f6530 2023-10-18T20:53:04.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.474+0000 7f31ba0b5700 1 --2- 172.21.15.8:0/4008311973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31b40f6530 0x7f31b406b9a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f31b0000c00 tx=0x7f31b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:53:04.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.474+0000 7f31aaffd700 1 -- 172.21.15.8:0/4008311973 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31b0019070 con 0x7f31b40f6530 2023-10-18T20:53:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.474+0000 7f31aaffd700 1 -- 172.21.15.8:0/4008311973 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f31b0007e70 con 0x7f31b40f6530 2023-10-18T20:53:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.474+0000 7f31bb0b7700 1 -- 172.21.15.8:0/4008311973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b406a740 con 0x7f31b40f6530 2023-10-18T20:53:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.474+0000 7f31aaffd700 1 -- 172.21.15.8:0/4008311973 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31b0014c90 con 0x7f31b40f6530 2023-10-18T20:53:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.474+0000 7f31bb0b7700 1 -- 172.21.15.8:0/4008311973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b406aca0 con 0x7f31b40f6530 2023-10-18T20:53:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.475+0000 7f31bb0b7700 1 -- 172.21.15.8:0/4008311973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b4045ad0 con 0x7f31b40f6530 2023-10-18T20:53:04.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.476+0000 7f31aaffd700 1 -- 172.21.15.8:0/4008311973 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f31b0025070 con 0x7f31b40f6530 2023-10-18T20:53:04.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.477+0000 7f31aaffd700 1 --2- 172.21.15.8:0/4008311973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f31a005c2f0 0x7f31a005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:53:04.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.477+0000 7f31aaffd700 1 -- 172.21.15.8:0/4008311973 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f31b0075e10 con 0x7f31b40f6530 2023-10-18T20:53:04.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.477+0000 7f31b98b4700 1 --2- 172.21.15.8:0/4008311973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f31a005c2f0 0x7f31a005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:53:04.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.478+0000 7f31b98b4700 1 --2- 172.21.15.8:0/4008311973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f31a005c2f0 0x7f31a005e7b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f31a4009fd0 tx=0x7f31a400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:53:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.481+0000 7f31aaffd700 1 -- 172.21.15.8:0/4008311973 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f31b0049ae0 con 0x7f31b40f6530 2023-10-18T20:53:04.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:04.681+0000 7f31bb0b7700 1 -- 172.21.15.8:0/4008311973 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f31b40fee00 con 0x7f31a005c2f0 2023-10-18T20:53:05.607 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:04.094537+0000 mgr.smithi008.flmjzp (mgr.14164) 61 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:05.607 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:04.497896+0000 mon.smithi008 (mon.0) 192 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:05.607 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:04.498725+0000 mon.smithi008 (mon.0) 193 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:53:05.607 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:04.683274+0000 mon.smithi008 (mon.0) 194 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:53:05.607 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:04.685129+0000 mon.smithi008 (mon.0) 195 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:53:05.608 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:04.685927+0000 mon.smithi008 (mon.0) 196 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:04.094537+0000 mgr.smithi008.flmjzp (mgr.14164) 61 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:04.497896+0000 mon.smithi008 (mon.0) 192 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:04.498725+0000 mon.smithi008 (mon.0) 193 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:53:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:04.683274+0000 mon.smithi008 (mon.0) 194 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:53:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:04.685129+0000 mon.smithi008 (mon.0) 195 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:53:05.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:04.685927+0000 mon.smithi008 (mon.0) 196 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:04.682381+0000 mgr.smithi008.flmjzp (mgr.14164) 62 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:53:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:04.684824+0000 mgr.smithi008.flmjzp (mgr.14164) 63 : cephadm [INF] Applying service osd.None on host smithi008... 2023-10-18T20:53:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:06.061571+0000 mon.smithi008 (mon.0) 197 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:04.682381+0000 mgr.smithi008.flmjzp (mgr.14164) 62 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:53:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:04.684824+0000 mgr.smithi008.flmjzp (mgr.14164) 63 : cephadm [INF] Applying service osd.None on host smithi008... 2023-10-18T20:53:06.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:06.061571+0000 mon.smithi008 (mon.0) 197 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:06.094773+0000 mgr.smithi008.flmjzp (mgr.14164) 64 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:06.981482+0000 mon.smithi008 (mon.0) 198 : audit [INF] from='client.? 172.21.15.8:0/4206388667' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84acbfd0-21a5-4744-9fba-9b1ae8ac4018"}]: dispatch 2023-10-18T20:53:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:06.985612+0000 mon.smithi008 (mon.0) 199 : audit [INF] from='client.? 172.21.15.8:0/4206388667' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84acbfd0-21a5-4744-9fba-9b1ae8ac4018"}]': finished 2023-10-18T20:53:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:06.985653+0000 mon.smithi008 (mon.0) 200 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2023-10-18T20:53:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:06.985744+0000 mon.smithi008 (mon.0) 201 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:53:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:06.094773+0000 mgr.smithi008.flmjzp (mgr.14164) 64 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:06.981482+0000 mon.smithi008 (mon.0) 198 : audit [INF] from='client.? 172.21.15.8:0/4206388667' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84acbfd0-21a5-4744-9fba-9b1ae8ac4018"}]: dispatch 2023-10-18T20:53:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:06.985612+0000 mon.smithi008 (mon.0) 199 : audit [INF] from='client.? 172.21.15.8:0/4206388667' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84acbfd0-21a5-4744-9fba-9b1ae8ac4018"}]': finished 2023-10-18T20:53:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:06.985653+0000 mon.smithi008 (mon.0) 200 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2023-10-18T20:53:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:06.985744+0000 mon.smithi008 (mon.0) 201 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:53:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:07.547234+0000 mon.smithi008 (mon.0) 202 : audit [DBG] from='client.? 172.21.15.8:0/2181604984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:53:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:08.206507+0000 mon.smithi008 (mon.0) 203 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:08.210442+0000 mon.smithi008 (mon.0) 204 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:08.212638+0000 mon.smithi008 (mon.0) 205 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T20:53:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:08.213281+0000 mon.smithi008 (mon.0) 206 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T20:53:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:08.213979+0000 mon.smithi008 (mon.0) 207 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:07.547234+0000 mon.smithi008 (mon.0) 202 : audit [DBG] from='client.? 172.21.15.8:0/2181604984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:53:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:08.206507+0000 mon.smithi008 (mon.0) 203 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:08.210442+0000 mon.smithi008 (mon.0) 204 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:08.212638+0000 mon.smithi008 (mon.0) 205 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T20:53:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:08.213281+0000 mon.smithi008 (mon.0) 206 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T20:53:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:08.213979+0000 mon.smithi008 (mon.0) 207 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:08.094987+0000 mgr.smithi008.flmjzp (mgr.14164) 65 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:08.212369+0000 mgr.smithi008.flmjzp (mgr.14164) 66 : cephadm [INF] Reconfiguring mon.smithi008 (unknown last config time)... 2023-10-18T20:53:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:08.214547+0000 mgr.smithi008.flmjzp (mgr.14164) 67 : cephadm [INF] Reconfiguring daemon mon.smithi008 on smithi008 2023-10-18T20:53:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:08.094987+0000 mgr.smithi008.flmjzp (mgr.14164) 65 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:08.212369+0000 mgr.smithi008.flmjzp (mgr.14164) 66 : cephadm [INF] Reconfiguring mon.smithi008 (unknown last config time)... 2023-10-18T20:53:09.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:08.214547+0000 mgr.smithi008.flmjzp (mgr.14164) 67 : cephadm [INF] Reconfiguring daemon mon.smithi008 on smithi008 2023-10-18T20:53:11.523 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:10.095325+0000 mgr.smithi008.flmjzp (mgr.14164) 68 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:11.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:10.095325+0000 mgr.smithi008.flmjzp (mgr.14164) 68 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:13.584 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:12.095582+0000 mgr.smithi008.flmjzp (mgr.14164) 69 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:13.584 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:12.304747+0000 mon.smithi008 (mon.0) 208 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:13.584 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:12.305292+0000 mgr.smithi008.flmjzp (mgr.14164) 70 : cephadm [INF] Reconfiguring mgr.smithi008.flmjzp (unknown last config time)... 2023-10-18T20:53:13.585 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:12.305616+0000 mon.smithi008 (mon.0) 209 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi008.flmjzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:53:13.585 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:12.306521+0000 mon.smithi008 (mon.0) 210 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:53:13.585 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:12.307185+0000 mon.smithi008 (mon.0) 211 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:13.585 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:12.307883+0000 mgr.smithi008.flmjzp (mgr.14164) 71 : cephadm [INF] Reconfiguring daemon mgr.smithi008.flmjzp on smithi008 2023-10-18T20:53:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:12.095582+0000 mgr.smithi008.flmjzp (mgr.14164) 69 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:12.304747+0000 mon.smithi008 (mon.0) 208 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:12.305292+0000 mgr.smithi008.flmjzp (mgr.14164) 70 : cephadm [INF] Reconfiguring mgr.smithi008.flmjzp (unknown last config time)... 2023-10-18T20:53:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:12.305616+0000 mon.smithi008 (mon.0) 209 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi008.flmjzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:53:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:12.306521+0000 mon.smithi008 (mon.0) 210 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:53:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:12.307185+0000 mon.smithi008 (mon.0) 211 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:13.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:12.307883+0000 mgr.smithi008.flmjzp (mgr.14164) 71 : cephadm [INF] Reconfiguring daemon mgr.smithi008.flmjzp on smithi008 2023-10-18T20:53:14.624 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:13.399846+0000 mon.smithi008 (mon.0) 212 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-18T20:53:14.625 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:13.400768+0000 mon.smithi008 (mon.0) 213 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:14.625 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:14.192627+0000 mon.smithi008 (mon.0) 214 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:13.399846+0000 mon.smithi008 (mon.0) 212 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-18T20:53:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:13.400768+0000 mon.smithi008 (mon.0) 213 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:14.192627+0000 mon.smithi008 (mon.0) 214 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:13.401356+0000 mgr.smithi008.flmjzp (mgr.14164) 72 : cephadm [INF] Deploying daemon osd.0 on smithi008 2023-10-18T20:53:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:14.095967+0000 mgr.smithi008.flmjzp (mgr.14164) 73 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:14.193222+0000 mgr.smithi008.flmjzp (mgr.14164) 74 : cephadm [INF] Reconfiguring alertmanager.smithi008 (dependencies changed)... 2023-10-18T20:53:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:14.195444+0000 mgr.smithi008.flmjzp (mgr.14164) 75 : cephadm [INF] Reconfiguring daemon alertmanager.smithi008 on smithi008 2023-10-18T20:53:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:13.401356+0000 mgr.smithi008.flmjzp (mgr.14164) 72 : cephadm [INF] Deploying daemon osd.0 on smithi008 2023-10-18T20:53:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:14.095967+0000 mgr.smithi008.flmjzp (mgr.14164) 73 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:14.193222+0000 mgr.smithi008.flmjzp (mgr.14164) 74 : cephadm [INF] Reconfiguring alertmanager.smithi008 (dependencies changed)... 2023-10-18T20:53:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:14.195444+0000 mgr.smithi008.flmjzp (mgr.14164) 75 : cephadm [INF] Reconfiguring daemon alertmanager.smithi008 on smithi008 2023-10-18T20:53:17.274 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 0 on host 'smithi008' 2023-10-18T20:53:17.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.270+0000 7f31aaffd700 1 -- 172.21.15.8:0/4008311973 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f31b40fee00 con 0x7f31a005c2f0 2023-10-18T20:53:17.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 -- 172.21.15.8:0/4008311973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f31a005c2f0 msgr2=0x7f31a005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:17.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 --2- 172.21.15.8:0/4008311973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f31a005c2f0 0x7f31a005e7b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f31a4009fd0 tx=0x7f31a400b040).stop 2023-10-18T20:53:17.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 -- 172.21.15.8:0/4008311973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31b40f6530 msgr2=0x7f31b406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:17.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 --2- 172.21.15.8:0/4008311973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31b40f6530 0x7f31b406b9a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f31b0000c00 tx=0x7f31b000b040).stop 2023-10-18T20:53:17.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 -- 172.21.15.8:0/4008311973 shutdown_connections 2023-10-18T20:53:17.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 --2- 172.21.15.8:0/4008311973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31b40f6530 0x7f31b406b9a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:17.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 --2- 172.21.15.8:0/4008311973 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f31a005c2f0 0x7f31a005e7b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:17.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 --2- 172.21.15.8:0/4008311973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40f77d0 0x7f31b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:17.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 -- 172.21.15.8:0/4008311973 >> 172.21.15.8:0/4008311973 conn(0x7f31b40f1c90 msgr2=0x7f31b40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:53:17.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 -- 172.21.15.8:0/4008311973 shutdown_connections 2023-10-18T20:53:17.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:17.273+0000 7f31bb0b7700 1 -- 172.21.15.8:0/4008311973 wait complete. 2023-10-18T20:53:17.527 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:16.096289+0000 mgr.smithi008.flmjzp (mgr.14164) 76 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:17.528 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:17.266760+0000 mon.smithi008 (mon.0) 215 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:17.528 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:17.270994+0000 mon.smithi008 (mon.0) 216 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:16.096289+0000 mgr.smithi008.flmjzp (mgr.14164) 76 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:17.266760+0000 mon.smithi008 (mon.0) 215 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:17.270994+0000 mon.smithi008 (mon.0) 216 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:18.147 DEBUG:teuthology.orchestra.run.smithi008:osd.0> sudo journalctl -f -n 0 -u ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.0.service 2023-10-18T20:53:18.152 INFO:tasks.cephadm:Deploying osd.1 on smithi008 with /dev/vg_nvme/lv_3... 2023-10-18T20:53:18.153 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-18T20:53:18.230 INFO:journalctl@ceph.osd.0.smithi008.stdout:-- Logs begin at Wed 2023-10-18 20:15:27 UTC. -- 2023-10-18T20:53:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:18.096521+0000 mgr.smithi008.flmjzp (mgr.14164) 77 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:18.096521+0000 mgr.smithi008.flmjzp (mgr.14164) 77 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:20.728 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-18T20:53:20.729 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-18T20:53:20.729 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-18T20:53:20.729 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-18T20:53:20.730 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0460982 s, 227 MB/s 2023-10-18T20:53:20.730 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-18T20:53:21.147 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_3 2023-10-18T20:53:21.596 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:20.096734+0000 mgr.smithi008.flmjzp (mgr.14164) 78 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:21.596 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:20.589181+0000 mon.smithi008 (mon.0) 217 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:21.597 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:20.590004+0000 mon.smithi008 (mon.0) 218 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi008", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-10-18T20:53:21.597 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:20.590849+0000 mon.smithi008 (mon.0) 219 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:21.597 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:21.295511+0000 mon.smithi008 (mon.0) 220 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-18T20:53:21.597 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.0[117858]: debug 2023-10-18T20:53:21.285+0000 7fe23bd46080 -1 osd.0 0 log_to_monitors {default=true} 2023-10-18T20:53:21.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:20.096734+0000 mgr.smithi008.flmjzp (mgr.14164) 78 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:21.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:20.589181+0000 mon.smithi008 (mon.0) 217 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:21.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:20.590004+0000 mon.smithi008 (mon.0) 218 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi008", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-10-18T20:53:21.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:20.590849+0000 mon.smithi008 (mon.0) 219 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:21.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:21.295511+0000 mon.smithi008 (mon.0) 220 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-18T20:53:22.500 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:20.589740+0000 mgr.smithi008.flmjzp (mgr.14164) 79 : cephadm [INF] Reconfiguring crash.smithi008 (monmap changed)... 2023-10-18T20:53:22.501 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:20.591419+0000 mgr.smithi008.flmjzp (mgr.14164) 80 : cephadm [INF] Reconfiguring daemon crash.smithi008 on smithi008 2023-10-18T20:53:22.501 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:21.591060+0000 mon.smithi008 (mon.0) 221 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-18T20:53:22.501 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:21.591124+0000 mon.smithi008 (mon.0) 222 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2023-10-18T20:53:22.501 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:21.591235+0000 mon.smithi008 (mon.0) 223 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:53:22.501 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:21.591704+0000 mon.smithi008 (mon.0) 224 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T20:53:22.502 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:21.840761+0000 mon.smithi008 (mon.0) 225 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:22.502 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:22.254167+0000 mon.smithi008 (mon.0) 226 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:53:22.502 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:22.258332+0000 mon.smithi008 (mon.0) 227 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:53:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:20.589740+0000 mgr.smithi008.flmjzp (mgr.14164) 79 : cephadm [INF] Reconfiguring crash.smithi008 (monmap changed)... 2023-10-18T20:53:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:20.591419+0000 mgr.smithi008.flmjzp (mgr.14164) 80 : cephadm [INF] Reconfiguring daemon crash.smithi008 on smithi008 2023-10-18T20:53:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:21.591060+0000 mon.smithi008 (mon.0) 221 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-18T20:53:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:21.591124+0000 mon.smithi008 (mon.0) 222 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2023-10-18T20:53:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:21.591235+0000 mon.smithi008 (mon.0) 223 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:53:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:21.591704+0000 mon.smithi008 (mon.0) 224 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T20:53:22.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:21.840761+0000 mon.smithi008 (mon.0) 225 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:22.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:22.254167+0000 mon.smithi008 (mon.0) 226 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:53:22.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:22.258332+0000 mon.smithi008 (mon.0) 227 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:53:22.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.878+0000 7f48e55a5700 1 -- 172.21.15.8:0/238060493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00680c0 msgr2=0x7f48e0068540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.878+0000 7f48e55a5700 1 --2- 172.21.15.8:0/238060493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00680c0 0x7f48e0068540 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f48d4004660 tx=0x7f48d4009b30).stop 2023-10-18T20:53:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.878+0000 7f48e55a5700 1 -- 172.21.15.8:0/238060493 shutdown_connections 2023-10-18T20:53:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.878+0000 7f48e55a5700 1 --2- 172.21.15.8:0/238060493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00680c0 0x7f48e0068540 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.878+0000 7f48e55a5700 1 --2- 172.21.15.8:0/238060493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e0069540 0x7f48e0067bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:22.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.878+0000 7f48e55a5700 1 -- 172.21.15.8:0/238060493 >> 172.21.15.8:0/238060493 conn(0x7f48e0063530 msgr2=0x7f48e0065950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:53:22.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.878+0000 7f48e55a5700 1 -- 172.21.15.8:0/238060493 shutdown_connections 2023-10-18T20:53:22.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.878+0000 7f48e55a5700 1 -- 172.21.15.8:0/238060493 wait complete. 2023-10-18T20:53:22.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.879+0000 7f48e55a5700 1 Processor -- start 2023-10-18T20:53:22.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.879+0000 7f48e55a5700 1 -- start start 2023-10-18T20:53:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48e55a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00680c0 0x7f48e0100770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:53:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48e55a5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e0069540 0x7f48e00febf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:53:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48e55a5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00ff150 con 0x7f48e0069540 2023-10-18T20:53:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48e55a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00ff290 con 0x7f48e00680c0 2023-10-18T20:53:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e0069540 0x7f48e00febf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:53:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e0069540 0x7f48e00febf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42422/0 (socket says 172.21.15.8:42422) 2023-10-18T20:53:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48dffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00680c0 0x7f48e0100770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:53:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48df7fe700 1 -- 172.21.15.8:0/3730494445 learned_addr learned my addr 172.21.15.8:0/3730494445 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:53:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48df7fe700 1 -- 172.21.15.8:0/3730494445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00680c0 msgr2=0x7f48e0100770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48df7fe700 1 --2- 172.21.15.8:0/3730494445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00680c0 0x7f48e0100770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.880+0000 7f48df7fe700 1 -- 172.21.15.8:0/3730494445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4005040 con 0x7f48e0069540 2023-10-18T20:53:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.881+0000 7f48df7fe700 1 --2- 172.21.15.8:0/3730494445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e0069540 0x7f48e00febf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f48d4009720 tx=0x7f48d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:53:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.881+0000 7f48dcff9700 1 -- 172.21.15.8:0/3730494445 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48d4019070 con 0x7f48e0069540 2023-10-18T20:53:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.881+0000 7f48dcff9700 1 -- 172.21.15.8:0/3730494445 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f48d4013380 con 0x7f48e0069540 2023-10-18T20:53:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.881+0000 7f48e55a5700 1 -- 172.21.15.8:0/3730494445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e00ff510 con 0x7f48e0069540 2023-10-18T20:53:22.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.881+0000 7f48dcff9700 1 -- 172.21.15.8:0/3730494445 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48d4014d60 con 0x7f48e0069540 2023-10-18T20:53:22.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.881+0000 7f48e55a5700 1 -- 172.21.15.8:0/3730494445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e00ffa70 con 0x7f48e0069540 2023-10-18T20:53:22.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.882+0000 7f48e55a5700 1 -- 172.21.15.8:0/3730494445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e0045ad0 con 0x7f48e0069540 2023-10-18T20:53:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.883+0000 7f48dcff9700 1 -- 172.21.15.8:0/3730494445 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f48d400f070 con 0x7f48e0069540 2023-10-18T20:53:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.884+0000 7f48dcff9700 1 --2- 172.21.15.8:0/3730494445 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f48c805c300 0x7f48c805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:53:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.884+0000 7f48dcff9700 1 -- 172.21.15.8:0/3730494445 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1602+0+0 (secure 0 0 0) 0x7f48d4076180 con 0x7f48e0069540 2023-10-18T20:53:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.884+0000 7f48dffff700 1 --2- 172.21.15.8:0/3730494445 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f48c805c300 0x7f48c805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:53:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.885+0000 7f48dffff700 1 --2- 172.21.15.8:0/3730494445 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f48c805c300 0x7f48c805e7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f48e0100500 tx=0x7f48d000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:53:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:22.889+0000 7f48dcff9700 1 -- 172.21.15.8:0/3730494445 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f48d4049d80 con 0x7f48e0069540 2023-10-18T20:53:22.920 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.0[117858]: debug 2023-10-18T20:53:22.595+0000 7fe2322b7700 -1 osd.0 0 waiting for initial osdmap 2023-10-18T20:53:22.921 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.0[117858]: debug 2023-10-18T20:53:22.601+0000 7fe22c22e700 -1 osd.0 8 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-10-18T20:53:23.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:23.087+0000 7f48e55a5700 1 -- 172.21.15.8:0/3730494445 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f48e0107640 con 0x7f48c805c300 2023-10-18T20:53:23.521 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:21.841384+0000 mgr.smithi008.flmjzp (mgr.14164) 81 : cephadm [INF] Reconfiguring grafana.smithi008 (dependencies changed)... 2023-10-18T20:53:23.521 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:21.845813+0000 mgr.smithi008.flmjzp (mgr.14164) 82 : cephadm [INF] Reconfiguring daemon grafana.smithi008 on smithi008 2023-10-18T20:53:23.521 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:22.097002+0000 mgr.smithi008.flmjzp (mgr.14164) 83 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:23.522 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:22.592940+0000 mon.smithi008 (mon.0) 228 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-18T20:53:23.522 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:22.593005+0000 mon.smithi008 (mon.0) 229 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2023-10-18T20:53:23.522 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:22.593103+0000 mon.smithi008 (mon.0) 230 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:53:23.522 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:22.597381+0000 mon.smithi008 (mon.0) 231 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:53:23.523 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:23.089266+0000 mgr.smithi008.flmjzp (mgr.14164) 84 : audit [DBG] from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:53:23.523 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:23.090222+0000 mon.smithi008 (mon.0) 232 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:53:23.523 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:23.091638+0000 mgr.smithi008.flmjzp (mgr.14164) 85 : cephadm [INF] Applying service osd.None on host smithi008... 2023-10-18T20:53:23.523 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:23.092167+0000 mon.smithi008 (mon.0) 233 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:53:23.523 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:23.092979+0000 mon.smithi008 (mon.0) 234 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:21.841384+0000 mgr.smithi008.flmjzp (mgr.14164) 81 : cephadm [INF] Reconfiguring grafana.smithi008 (dependencies changed)... 2023-10-18T20:53:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:21.845813+0000 mgr.smithi008.flmjzp (mgr.14164) 82 : cephadm [INF] Reconfiguring daemon grafana.smithi008 on smithi008 2023-10-18T20:53:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:22.097002+0000 mgr.smithi008.flmjzp (mgr.14164) 83 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T20:53:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:22.592940+0000 mon.smithi008 (mon.0) 228 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-18T20:53:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:22.593005+0000 mon.smithi008 (mon.0) 229 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2023-10-18T20:53:23.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:22.593103+0000 mon.smithi008 (mon.0) 230 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:53:23.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:22.597381+0000 mon.smithi008 (mon.0) 231 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:53:23.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:23.089266+0000 mgr.smithi008.flmjzp (mgr.14164) 84 : audit [DBG] from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:53:23.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:23.090222+0000 mon.smithi008 (mon.0) 232 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:53:23.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:23.091638+0000 mgr.smithi008.flmjzp (mgr.14164) 85 : cephadm [INF] Applying service osd.None on host smithi008... 2023-10-18T20:53:23.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:23.092167+0000 mon.smithi008 (mon.0) 233 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:53:23.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:23.092979+0000 mon.smithi008 (mon.0) 234 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:22.261998+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:53:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:22.262125+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:53:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:23.594381+0000 mon.smithi008 (mon.0) 235 : cluster [INF] osd.0 [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968] boot 2023-10-18T20:53:24.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:23.594412+0000 mon.smithi008 (mon.0) 236 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2023-10-18T20:53:24.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:23.594664+0000 mon.smithi008 (mon.0) 237 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:53:24.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:24.097317+0000 mgr.smithi008.flmjzp (mgr.14164) 86 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:22.261998+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:53:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:22.262125+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:53:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:23.594381+0000 mon.smithi008 (mon.0) 235 : cluster [INF] osd.0 [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968] boot 2023-10-18T20:53:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:23.594412+0000 mon.smithi008 (mon.0) 236 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2023-10-18T20:53:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:23.594664+0000 mon.smithi008 (mon.0) 237 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:53:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:24.097317+0000 mgr.smithi008.flmjzp (mgr.14164) 86 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:25.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:24.599889+0000 mon.smithi008 (mon.0) 238 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2023-10-18T20:53:25.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:24.796774+0000 mon.smithi008 (mon.0) 239 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:25.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:24.797561+0000 mgr.smithi008.flmjzp (mgr.14164) 87 : cephadm [INF] Reconfiguring prometheus.smithi008 (dependencies changed)... 2023-10-18T20:53:25.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:24.800161+0000 mgr.smithi008.flmjzp (mgr.14164) 88 : cephadm [INF] Reconfiguring daemon prometheus.smithi008 on smithi008 2023-10-18T20:53:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:24.599889+0000 mon.smithi008 (mon.0) 238 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2023-10-18T20:53:25.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:24.796774+0000 mon.smithi008 (mon.0) 239 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:25.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:24.797561+0000 mgr.smithi008.flmjzp (mgr.14164) 87 : cephadm [INF] Reconfiguring prometheus.smithi008 (dependencies changed)... 2023-10-18T20:53:25.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:24.800161+0000 mgr.smithi008.flmjzp (mgr.14164) 88 : cephadm [INF] Reconfiguring daemon prometheus.smithi008 on smithi008 2023-10-18T20:53:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:25.909511+0000 mon.smithi008 (mon.0) 240 : audit [INF] from='client.? 172.21.15.8:0/88695136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40db6fdb-ab66-473c-b471-ae97389d8be3"}]: dispatch 2023-10-18T20:53:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:25.913715+0000 mon.smithi008 (mon.0) 241 : audit [INF] from='client.? 172.21.15.8:0/88695136' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40db6fdb-ab66-473c-b471-ae97389d8be3"}]': finished 2023-10-18T20:53:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:25.913758+0000 mon.smithi008 (mon.0) 242 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2023-10-18T20:53:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:25.913845+0000 mon.smithi008 (mon.0) 243 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:53:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:26.097576+0000 mgr.smithi008.flmjzp (mgr.14164) 89 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:26.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:26.457021+0000 mon.smithi008 (mon.0) 244 : audit [DBG] from='client.? 172.21.15.8:0/2448951398' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:53:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:25.909511+0000 mon.smithi008 (mon.0) 240 : audit [INF] from='client.? 172.21.15.8:0/88695136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40db6fdb-ab66-473c-b471-ae97389d8be3"}]: dispatch 2023-10-18T20:53:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:25.913715+0000 mon.smithi008 (mon.0) 241 : audit [INF] from='client.? 172.21.15.8:0/88695136' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40db6fdb-ab66-473c-b471-ae97389d8be3"}]': finished 2023-10-18T20:53:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:25.913758+0000 mon.smithi008 (mon.0) 242 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2023-10-18T20:53:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:25.913845+0000 mon.smithi008 (mon.0) 243 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:53:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:26.097576+0000 mgr.smithi008.flmjzp (mgr.14164) 89 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:26.457021+0000 mon.smithi008 (mon.0) 244 : audit [DBG] from='client.? 172.21.15.8:0/2448951398' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:53:29.604 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:28.097947+0000 mgr.smithi008.flmjzp (mgr.14164) 90 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:28.097947+0000 mgr.smithi008.flmjzp (mgr.14164) 90 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:31.349 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:30.098301+0000 mgr.smithi008.flmjzp (mgr.14164) 91 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:30.098301+0000 mgr.smithi008.flmjzp (mgr.14164) 91 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:32.098696+0000 mgr.smithi008.flmjzp (mgr.14164) 92 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:32.775092+0000 mon.smithi008 (mon.0) 245 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:33.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:32.776485+0000 mon.smithi008 (mon.0) 246 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-10-18T20:53:33.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:32.777400+0000 mon.smithi008 (mon.0) 247 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:32.098696+0000 mgr.smithi008.flmjzp (mgr.14164) 92 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:32.775092+0000 mon.smithi008 (mon.0) 245 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:32.776485+0000 mon.smithi008 (mon.0) 246 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-10-18T20:53:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:32.777400+0000 mon.smithi008 (mon.0) 247 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:34.475 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:32.776098+0000 mgr.smithi008.flmjzp (mgr.14164) 93 : cephadm [INF] Reconfiguring crash.smithi060 (monmap changed)... 2023-10-18T20:53:34.475 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:32.778025+0000 mgr.smithi008.flmjzp (mgr.14164) 94 : cephadm [INF] Reconfiguring daemon crash.smithi060 on smithi060 2023-10-18T20:53:34.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:33.731001+0000 mon.smithi008 (mon.0) 248 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:34.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:33.731841+0000 mon.smithi008 (mon.0) 249 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.pgqqwa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:53:34.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:33.732629+0000 mon.smithi008 (mon.0) 250 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:53:34.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:33.733282+0000 mon.smithi008 (mon.0) 251 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:34.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:33.925801+0000 mon.smithi008 (mon.0) 252 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-18T20:53:34.477 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:33.926592+0000 mon.smithi008 (mon.0) 253 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:32.776098+0000 mgr.smithi008.flmjzp (mgr.14164) 93 : cephadm [INF] Reconfiguring crash.smithi060 (monmap changed)... 2023-10-18T20:53:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:32.778025+0000 mgr.smithi008.flmjzp (mgr.14164) 94 : cephadm [INF] Reconfiguring daemon crash.smithi060 on smithi060 2023-10-18T20:53:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:33.731001+0000 mon.smithi008 (mon.0) 248 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:33.731841+0000 mon.smithi008 (mon.0) 249 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.pgqqwa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:53:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:33.732629+0000 mon.smithi008 (mon.0) 250 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:53:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:33.733282+0000 mon.smithi008 (mon.0) 251 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:33.925801+0000 mon.smithi008 (mon.0) 252 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-18T20:53:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:33.926592+0000 mon.smithi008 (mon.0) 253 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:35.475 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:33.731592+0000 mgr.smithi008.flmjzp (mgr.14164) 95 : cephadm [INF] Reconfiguring mgr.smithi060.pgqqwa (monmap changed)... 2023-10-18T20:53:35.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:33.733853+0000 mgr.smithi008.flmjzp (mgr.14164) 96 : cephadm [INF] Reconfiguring daemon mgr.smithi060.pgqqwa on smithi060 2023-10-18T20:53:35.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:33.927210+0000 mgr.smithi008.flmjzp (mgr.14164) 97 : cephadm [INF] Deploying daemon osd.1 on smithi008 2023-10-18T20:53:35.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:34.099003+0000 mgr.smithi008.flmjzp (mgr.14164) 98 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:35.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:34.701518+0000 mon.smithi008 (mon.0) 254 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:35.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:34.702315+0000 mon.smithi008 (mon.0) 255 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T20:53:35.477 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:34.702975+0000 mon.smithi008 (mon.0) 256 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T20:53:35.477 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:34.703591+0000 mon.smithi008 (mon.0) 257 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:35.603 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:33.731592+0000 mgr.smithi008.flmjzp (mgr.14164) 95 : cephadm [INF] Reconfiguring mgr.smithi060.pgqqwa (monmap changed)... 2023-10-18T20:53:35.603 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:33.733853+0000 mgr.smithi008.flmjzp (mgr.14164) 96 : cephadm [INF] Reconfiguring daemon mgr.smithi060.pgqqwa on smithi060 2023-10-18T20:53:35.603 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:33.927210+0000 mgr.smithi008.flmjzp (mgr.14164) 97 : cephadm [INF] Deploying daemon osd.1 on smithi008 2023-10-18T20:53:35.604 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:34.099003+0000 mgr.smithi008.flmjzp (mgr.14164) 98 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:35.604 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:34.701518+0000 mon.smithi008 (mon.0) 254 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:35.604 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:34.702315+0000 mon.smithi008 (mon.0) 255 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T20:53:35.604 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:34.702975+0000 mon.smithi008 (mon.0) 256 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T20:53:35.604 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:34.703591+0000 mon.smithi008 (mon.0) 257 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:34.702070+0000 mgr.smithi008.flmjzp (mgr.14164) 99 : cephadm [INF] Reconfiguring mon.smithi060 (monmap changed)... 2023-10-18T20:53:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:34.704101+0000 mgr.smithi008.flmjzp (mgr.14164) 100 : cephadm [INF] Reconfiguring daemon mon.smithi060 on smithi060 2023-10-18T20:53:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:35.690832+0000 mon.smithi008 (mon.0) 258 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:35.693207+0000 mon.smithi008 (mon.0) 259 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-10-18T20:53:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:34.702070+0000 mgr.smithi008.flmjzp (mgr.14164) 99 : cephadm [INF] Reconfiguring mon.smithi060 (monmap changed)... 2023-10-18T20:53:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:34.704101+0000 mgr.smithi008.flmjzp (mgr.14164) 100 : cephadm [INF] Reconfiguring daemon mon.smithi060 on smithi060 2023-10-18T20:53:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:35.690832+0000 mon.smithi008 (mon.0) 258 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:35.693207+0000 mon.smithi008 (mon.0) 259 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-10-18T20:53:37.139 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 1 on host 'smithi008' 2023-10-18T20:53:37.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.135+0000 7f48dcff9700 1 -- 172.21.15.8:0/3730494445 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f48e0107640 con 0x7f48c805c300 2023-10-18T20:53:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 -- 172.21.15.8:0/3730494445 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f48c805c300 msgr2=0x7f48c805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 --2- 172.21.15.8:0/3730494445 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f48c805c300 0x7f48c805e7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f48e0100500 tx=0x7f48d000b040).stop 2023-10-18T20:53:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 -- 172.21.15.8:0/3730494445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e0069540 msgr2=0x7f48e00febf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 --2- 172.21.15.8:0/3730494445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e0069540 0x7f48e00febf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f48d4009720 tx=0x7f48d400b040).stop 2023-10-18T20:53:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 -- 172.21.15.8:0/3730494445 shutdown_connections 2023-10-18T20:53:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 --2- 172.21.15.8:0/3730494445 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f48c805c300 0x7f48c805e7c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 --2- 172.21.15.8:0/3730494445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00680c0 0x7f48e0100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 --2- 172.21.15.8:0/3730494445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e0069540 0x7f48e00febf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 -- 172.21.15.8:0/3730494445 >> 172.21.15.8:0/3730494445 conn(0x7f48e0063530 msgr2=0x7f48e0103510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:53:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 -- 172.21.15.8:0/3730494445 shutdown_connections 2023-10-18T20:53:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:37.138+0000 7f48e55a5700 1 -- 172.21.15.8:0/3730494445 wait complete. 2023-10-18T20:53:37.474 DEBUG:teuthology.orchestra.run.smithi008:osd.1> sudo journalctl -f -n 0 -u ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.1.service 2023-10-18T20:53:37.479 INFO:tasks.cephadm:Deploying osd.2 on smithi008 with /dev/vg_nvme/lv_2... 2023-10-18T20:53:37.479 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-18T20:53:37.558 INFO:journalctl@ceph.osd.1.smithi008.stdout:-- Logs begin at Wed 2023-10-18 20:15:27 UTC. -- 2023-10-18T20:53:37.670 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.1[121925]: debug 2023-10-18T20:53:37.594+0000 7fc983253080 -1 Falling back to public interface 2023-10-18T20:53:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:35.693572+0000 mgr.smithi008.flmjzp (mgr.14164) 101 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-10-18T20:53:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:36.099261+0000 mgr.smithi008.flmjzp (mgr.14164) 102 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.131993+0000 mon.smithi008 (mon.0) 260 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:37.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.136144+0000 mon.smithi008 (mon.0) 261 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:37.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.149137+0000 mon.smithi008 (mon.0) 262 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.8:9093"}]: dispatch 2023-10-18T20:53:37.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.153568+0000 mon.smithi008 (mon.0) 263 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:37.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.157936+0000 mon.smithi008 (mon.0) 264 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-10-18T20:53:37.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.163755+0000 mon.smithi008 (mon.0) 265 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.8:3000"}]: dispatch 2023-10-18T20:53:37.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.168164+0000 mon.smithi008 (mon.0) 266 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:37.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.171720+0000 mon.smithi008 (mon.0) 267 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-10-18T20:53:37.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.176044+0000 mon.smithi008 (mon.0) 268 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.8:9095"}]: dispatch 2023-10-18T20:53:37.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.180077+0000 mon.smithi008 (mon.0) 269 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:37.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.182960+0000 mon.smithi008 (mon.0) 270 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:53:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:35.693572+0000 mgr.smithi008.flmjzp (mgr.14164) 101 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-10-18T20:53:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:36.099261+0000 mgr.smithi008.flmjzp (mgr.14164) 102 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.131993+0000 mon.smithi008 (mon.0) 260 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.136144+0000 mon.smithi008 (mon.0) 261 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.149137+0000 mon.smithi008 (mon.0) 262 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.8:9093"}]: dispatch 2023-10-18T20:53:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.153568+0000 mon.smithi008 (mon.0) 263 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:37.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.157936+0000 mon.smithi008 (mon.0) 264 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-10-18T20:53:37.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.163755+0000 mon.smithi008 (mon.0) 265 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.8:3000"}]: dispatch 2023-10-18T20:53:37.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.168164+0000 mon.smithi008 (mon.0) 266 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:37.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.171720+0000 mon.smithi008 (mon.0) 267 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-10-18T20:53:37.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.176044+0000 mon.smithi008 (mon.0) 268 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.8:9095"}]: dispatch 2023-10-18T20:53:37.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.180077+0000 mon.smithi008 (mon.0) 269 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:37.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.182960+0000 mon.smithi008 (mon.0) 270 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:53:38.557 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.149482+0000 mgr.smithi008.flmjzp (mgr.14164) 103 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.8:9093"}]: dispatch 2023-10-18T20:53:38.558 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.158455+0000 mgr.smithi008.flmjzp (mgr.14164) 104 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-10-18T20:53:38.558 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.164094+0000 mgr.smithi008.flmjzp (mgr.14164) 105 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.8:3000"}]: dispatch 2023-10-18T20:53:38.558 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.172049+0000 mgr.smithi008.flmjzp (mgr.14164) 106 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-10-18T20:53:38.558 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:37.176323+0000 mgr.smithi008.flmjzp (mgr.14164) 107 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.8:9095"}]: dispatch 2023-10-18T20:53:38.559 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:38.099549+0000 mgr.smithi008.flmjzp (mgr.14164) 108 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.149482+0000 mgr.smithi008.flmjzp (mgr.14164) 103 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.8:9093"}]: dispatch 2023-10-18T20:53:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.158455+0000 mgr.smithi008.flmjzp (mgr.14164) 104 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-10-18T20:53:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.164094+0000 mgr.smithi008.flmjzp (mgr.14164) 105 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.8:3000"}]: dispatch 2023-10-18T20:53:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.172049+0000 mgr.smithi008.flmjzp (mgr.14164) 106 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-10-18T20:53:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:37.176323+0000 mgr.smithi008.flmjzp (mgr.14164) 107 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.8:9095"}]: dispatch 2023-10-18T20:53:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:38.099549+0000 mgr.smithi008.flmjzp (mgr.14164) 108 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:39.781 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-18T20:53:39.782 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-18T20:53:39.782 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-18T20:53:39.782 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-18T20:53:39.782 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0551325 s, 190 MB/s 2023-10-18T20:53:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-18T20:53:39.828 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:38.663847+0000 mon.smithi008 (mon.0) 271 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:38.663847+0000 mon.smithi008 (mon.0) 271 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:40.368 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_2 2023-10-18T20:53:40.866 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:40.099824+0000 mgr.smithi008.flmjzp (mgr.14164) 109 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:40.099824+0000 mgr.smithi008.flmjzp (mgr.14164) 109 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:41.420 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 20:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.1[121925]: debug 2023-10-18T20:53:41.115+0000 7fc983253080 -1 osd.1 0 log_to_monitors {default=true} 2023-10-18T20:53:41.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.884+0000 7ff97bfff700 1 -- 172.21.15.8:0/345751237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff97c0f6530 msgr2=0x7ff97c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.884+0000 7ff97bfff700 1 --2- 172.21.15.8:0/345751237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff97c0f6530 0x7ff97c0f6950 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff96c004660 tx=0x7ff96c009b30).stop 2023-10-18T20:53:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.884+0000 7ff97bfff700 1 -- 172.21.15.8:0/345751237 shutdown_connections 2023-10-18T20:53:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.884+0000 7ff97bfff700 1 --2- 172.21.15.8:0/345751237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff97c0f77d0 0x7ff97c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.884+0000 7ff97bfff700 1 --2- 172.21.15.8:0/345751237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff97c0f6530 0x7ff97c0f6950 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.884+0000 7ff97bfff700 1 -- 172.21.15.8:0/345751237 >> 172.21.15.8:0/345751237 conn(0x7ff97c0f1c70 msgr2=0x7ff97c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:53:41.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.884+0000 7ff97bfff700 1 -- 172.21.15.8:0/345751237 shutdown_connections 2023-10-18T20:53:41.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.884+0000 7ff97bfff700 1 -- 172.21.15.8:0/345751237 wait complete. 2023-10-18T20:53:41.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.885+0000 7ff97bfff700 1 Processor -- start 2023-10-18T20:53:41.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.885+0000 7ff97bfff700 1 -- start start 2023-10-18T20:53:41.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.886+0000 7ff97bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff97c0f6530 0x7ff97c108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:53:41.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.886+0000 7ff97bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff97c0f77d0 0x7ff97c1094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:53:41.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.886+0000 7ff97bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c109a80 con 0x7ff97c0f77d0 2023-10-18T20:53:41.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.886+0000 7ff97bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c109bc0 con 0x7ff97c0f6530 2023-10-18T20:53:41.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.886+0000 7ff97a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff97c0f77d0 0x7ff97c1094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:53:41.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.886+0000 7ff97a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff97c0f77d0 0x7ff97c1094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58406/0 (socket says 172.21.15.8:58406) 2023-10-18T20:53:41.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.886+0000 7ff97a7fc700 1 -- 172.21.15.8:0/2234795638 learned_addr learned my addr 172.21.15.8:0/2234795638 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:53:41.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.886+0000 7ff97affd700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff97c0f6530 0x7ff97c108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:53:41.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.886+0000 7ff97a7fc700 1 -- 172.21.15.8:0/2234795638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff97c0f6530 msgr2=0x7ff97c108fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:41.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.887+0000 7ff97a7fc700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff97c0f6530 0x7ff97c108fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:41.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.887+0000 7ff97a7fc700 1 -- 172.21.15.8:0/2234795638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c005040 con 0x7ff97c0f77d0 2023-10-18T20:53:41.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.887+0000 7ff97a7fc700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff97c0f77d0 0x7ff97c1094d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff97000c790 tx=0x7ff970007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:53:41.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.887+0000 7ff9637fe700 1 -- 172.21.15.8:0/2234795638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff970002590 con 0x7ff97c0f77d0 2023-10-18T20:53:41.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.887+0000 7ff9637fe700 1 -- 172.21.15.8:0/2234795638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff970002ba0 con 0x7ff97c0f77d0 2023-10-18T20:53:41.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.887+0000 7ff97bfff700 1 -- 172.21.15.8:0/2234795638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c10a560 con 0x7ff97c0f77d0 2023-10-18T20:53:41.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.887+0000 7ff9637fe700 1 -- 172.21.15.8:0/2234795638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff970013d90 con 0x7ff97c0f77d0 2023-10-18T20:53:41.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.887+0000 7ff97bfff700 1 -- 172.21.15.8:0/2234795638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c10ab20 con 0x7ff97c0f77d0 2023-10-18T20:53:41.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.888+0000 7ff97bfff700 1 -- 172.21.15.8:0/2234795638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c045ad0 con 0x7ff97c0f77d0 2023-10-18T20:53:41.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.889+0000 7ff9637fe700 1 -- 172.21.15.8:0/2234795638 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff97001a060 con 0x7ff97c0f77d0 2023-10-18T20:53:41.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.890+0000 7ff9637fe700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff96405c2f0 0x7ff96405e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:53:41.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.890+0000 7ff9637fe700 1 -- 172.21.15.8:0/2234795638 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2018+0+0 (secure 0 0 0) 0x7ff970075460 con 0x7ff97c0f77d0 2023-10-18T20:53:41.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.890+0000 7ff97affd700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff96405c2f0 0x7ff96405e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:53:41.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.891+0000 7ff97affd700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff96405c2f0 0x7ff96405e7b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff96c004e30 tx=0x7ff96c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:53:41.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:41.895+0000 7ff9637fe700 1 -- 172.21.15.8:0/2234795638 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff970048e00 con 0x7ff97c0f77d0 2023-10-18T20:53:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:41.124838+0000 mon.smithi008 (mon.0) 272 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-18T20:53:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:41.124838+0000 mon.smithi008 (mon.0) 272 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-18T20:53:42.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:42.109+0000 7ff97bfff700 1 -- 172.21.15.8:0/2234795638 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff97c0fee30 con 0x7ff96405c2f0 2023-10-18T20:53:42.745 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.1[121925]: debug 2023-10-18T20:53:42.676+0000 7fc9797c4700 -1 osd.1 0 waiting for initial osdmap 2023-10-18T20:53:42.745 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.1[121925]: debug 2023-10-18T20:53:42.683+0000 7fc973f3c700 -1 osd.1 13 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-10-18T20:53:42.746 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:41.672997+0000 mon.smithi008 (mon.0) 273 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-18T20:53:42.746 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:41.673064+0000 mon.smithi008 (mon.0) 274 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2023-10-18T20:53:42.746 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:41.673546+0000 mon.smithi008 (mon.0) 275 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:53:42.747 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:41.673789+0000 mon.smithi008 (mon.0) 276 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T20:53:42.747 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:41.699132+0000 mon.smithi008 (mon.0) 277 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:42.747 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:42.100064+0000 mgr.smithi008.flmjzp (mgr.14164) 110 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:42.747 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:42.111531+0000 mgr.smithi008.flmjzp (mgr.14164) 111 : audit [DBG] from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:53:42.747 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:42.112294+0000 mon.smithi008 (mon.0) 278 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:53:42.748 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:42.113443+0000 mgr.smithi008.flmjzp (mgr.14164) 112 : cephadm [INF] Applying service osd.None on host smithi008... 2023-10-18T20:53:42.748 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:42.113679+0000 mon.smithi008 (mon.0) 279 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:53:42.748 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:42.114276+0000 mon.smithi008 (mon.0) 280 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:42.748 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:42.674129+0000 mon.smithi008 (mon.0) 281 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-18T20:53:42.748 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:42.674188+0000 mon.smithi008 (mon.0) 282 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2023-10-18T20:53:42.749 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:42.674297+0000 mon.smithi008 (mon.0) 283 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:53:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:41.672997+0000 mon.smithi008 (mon.0) 273 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-18T20:53:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:41.673064+0000 mon.smithi008 (mon.0) 274 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2023-10-18T20:53:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:41.673546+0000 mon.smithi008 (mon.0) 275 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:53:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:41.673789+0000 mon.smithi008 (mon.0) 276 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T20:53:42.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:41.699132+0000 mon.smithi008 (mon.0) 277 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:42.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:42.100064+0000 mgr.smithi008.flmjzp (mgr.14164) 110 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:42.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:42.111531+0000 mgr.smithi008.flmjzp (mgr.14164) 111 : audit [DBG] from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:53:42.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:42.112294+0000 mon.smithi008 (mon.0) 278 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:53:42.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:42.113443+0000 mgr.smithi008.flmjzp (mgr.14164) 112 : cephadm [INF] Applying service osd.None on host smithi008... 2023-10-18T20:53:42.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:42.113679+0000 mon.smithi008 (mon.0) 279 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:53:42.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:42.114276+0000 mon.smithi008 (mon.0) 280 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:42.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:42.674129+0000 mon.smithi008 (mon.0) 281 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-18T20:53:42.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:42.674188+0000 mon.smithi008 (mon.0) 282 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2023-10-18T20:53:42.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:42.674297+0000 mon.smithi008 (mon.0) 283 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:53:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:42.679868+0000 mon.smithi008 (mon.0) 284 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:53:44.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:42.679868+0000 mon.smithi008 (mon.0) 284 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:53:44.721 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:42.140328+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:53:44.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:42.140612+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:53:44.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:43.680619+0000 mon.smithi008 (mon.0) 285 : cluster [INF] osd.1 [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529] boot 2023-10-18T20:53:44.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:43.680661+0000 mon.smithi008 (mon.0) 286 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2023-10-18T20:53:44.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:43.681219+0000 mon.smithi008 (mon.0) 287 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:53:44.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:44.100304+0000 mgr.smithi008.flmjzp (mgr.14164) 113 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:42.140328+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:53:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:42.140612+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:53:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:43.680619+0000 mon.smithi008 (mon.0) 285 : cluster [INF] osd.1 [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529] boot 2023-10-18T20:53:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:43.680661+0000 mon.smithi008 (mon.0) 286 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2023-10-18T20:53:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:43.681219+0000 mon.smithi008 (mon.0) 287 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:53:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:44.100304+0000 mgr.smithi008.flmjzp (mgr.14164) 113 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-10-18T20:53:45.971 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:44.689442+0000 mon.smithi008 (mon.0) 288 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2023-10-18T20:53:45.972 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:44.806279+0000 mgr.smithi008.flmjzp (mgr.14164) 114 : cephadm [INF] Detected new or changed devices on smithi008 2023-10-18T20:53:45.972 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:44.812788+0000 mon.smithi008 (mon.0) 289 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:45.972 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:45.245474+0000 mon.smithi008 (mon.0) 290 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:45.972 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:45.247988+0000 mon.smithi008 (mon.0) 291 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:53:45.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:45.636109+0000 mon.smithi008 (mon.0) 292 : audit [INF] from='client.? 172.21.15.8:0/1757111404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21ea78f3-f3ad-42dc-b034-a9e350635ada"}]: dispatch 2023-10-18T20:53:45.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:45.640479+0000 mon.smithi008 (mon.0) 293 : audit [INF] from='client.? 172.21.15.8:0/1757111404' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21ea78f3-f3ad-42dc-b034-a9e350635ada"}]': finished 2023-10-18T20:53:45.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:45.640532+0000 mon.smithi008 (mon.0) 294 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2023-10-18T20:53:45.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:45.640644+0000 mon.smithi008 (mon.0) 295 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:53:46.012 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:44.689442+0000 mon.smithi008 (mon.0) 288 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2023-10-18T20:53:46.012 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:44.806279+0000 mgr.smithi008.flmjzp (mgr.14164) 114 : cephadm [INF] Detected new or changed devices on smithi008 2023-10-18T20:53:46.012 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:44.812788+0000 mon.smithi008 (mon.0) 289 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:46.012 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:45.245474+0000 mon.smithi008 (mon.0) 290 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:46.013 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:45.247988+0000 mon.smithi008 (mon.0) 291 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:53:46.013 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:45.636109+0000 mon.smithi008 (mon.0) 292 : audit [INF] from='client.? 172.21.15.8:0/1757111404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21ea78f3-f3ad-42dc-b034-a9e350635ada"}]: dispatch 2023-10-18T20:53:46.013 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:45.640479+0000 mon.smithi008 (mon.0) 293 : audit [INF] from='client.? 172.21.15.8:0/1757111404' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21ea78f3-f3ad-42dc-b034-a9e350635ada"}]': finished 2023-10-18T20:53:46.013 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:45.640532+0000 mon.smithi008 (mon.0) 294 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2023-10-18T20:53:46.013 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:45.640644+0000 mon.smithi008 (mon.0) 295 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:53:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:46.100536+0000 mgr.smithi008.flmjzp (mgr.14164) 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:46.196333+0000 mon.smithi008 (mon.0) 296 : audit [DBG] from='client.? 172.21.15.8:0/739310224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:53:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:46.100536+0000 mgr.smithi008.flmjzp (mgr.14164) 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:46.196333+0000 mon.smithi008 (mon.0) 296 : audit [DBG] from='client.? 172.21.15.8:0/739310224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:53:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:46.699031+0000 mon.smithi008 (mon.0) 297 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:46.699031+0000 mon.smithi008 (mon.0) 297 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:49.576 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:48.100984+0000 mgr.smithi008.flmjzp (mgr.14164) 116 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:49.576 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:48.550380+0000 mon.smithi008 (mon.0) 298 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:48.100984+0000 mgr.smithi008.flmjzp (mgr.14164) 116 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:48.550380+0000 mon.smithi008 (mon.0) 298 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:51.560 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:50.101269+0000 mgr.smithi008.flmjzp (mgr.14164) 117 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:51.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:50.101269+0000 mgr.smithi008.flmjzp (mgr.14164) 117 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:53.191 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:51.929242+0000 mgr.smithi008.flmjzp (mgr.14164) 118 : cephadm [INF] Detected new or changed devices on smithi008 2023-10-18T20:53:53.192 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:51.934458+0000 mon.smithi008 (mon.0) 299 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:53.192 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:51.938035+0000 mon.smithi008 (mon.0) 300 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:53.192 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:52.101569+0000 mgr.smithi008.flmjzp (mgr.14164) 119 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:53.192 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:52.673951+0000 mon.smithi008 (mon.0) 301 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-18T20:53:53.192 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:52.674669+0000 mon.smithi008 (mon.0) 302 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:51.929242+0000 mgr.smithi008.flmjzp (mgr.14164) 118 : cephadm [INF] Detected new or changed devices on smithi008 2023-10-18T20:53:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:51.934458+0000 mon.smithi008 (mon.0) 299 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:51.938035+0000 mon.smithi008 (mon.0) 300 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:52.101569+0000 mgr.smithi008.flmjzp (mgr.14164) 119 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:52.673951+0000 mon.smithi008 (mon.0) 301 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-18T20:53:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:52.674669+0000 mon.smithi008 (mon.0) 302 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:53:54.406 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:53:52.675234+0000 mgr.smithi008.flmjzp (mgr.14164) 120 : cephadm [INF] Deploying daemon osd.2 on smithi008 2023-10-18T20:53:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:53:52.675234+0000 mgr.smithi008.flmjzp (mgr.14164) 120 : cephadm [INF] Deploying daemon osd.2 on smithi008 2023-10-18T20:53:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:54.101853+0000 mgr.smithi008.flmjzp (mgr.14164) 121 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:54.101853+0000 mgr.smithi008.flmjzp (mgr.14164) 121 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:55.990 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 2 on host 'smithi008' 2023-10-18T20:53:55.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.986+0000 7ff9637fe700 1 -- 172.21.15.8:0/2234795638 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff97c0fee30 con 0x7ff96405c2f0 2023-10-18T20:53:55.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 -- 172.21.15.8:0/2234795638 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff96405c2f0 msgr2=0x7ff96405e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:55.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff96405c2f0 0x7ff96405e7b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff96c004e30 tx=0x7ff96c009b30).stop 2023-10-18T20:53:55.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 -- 172.21.15.8:0/2234795638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff97c0f77d0 msgr2=0x7ff97c1094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:53:55.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff97c0f77d0 0x7ff97c1094d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff97000c790 tx=0x7ff970007d70).stop 2023-10-18T20:53:55.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 -- 172.21.15.8:0/2234795638 shutdown_connections 2023-10-18T20:53:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff96405c2f0 0x7ff96405e7b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff97c0f6530 0x7ff97c108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 --2- 172.21.15.8:0/2234795638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff97c0f77d0 0x7ff97c1094d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:53:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 -- 172.21.15.8:0/2234795638 >> 172.21.15.8:0/2234795638 conn(0x7ff97c0f1c70 msgr2=0x7ff97c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:53:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 -- 172.21.15.8:0/2234795638 shutdown_connections 2023-10-18T20:53:55.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:53:55.989+0000 7ff97bfff700 1 -- 172.21.15.8:0/2234795638 wait complete. 2023-10-18T20:53:56.400 DEBUG:teuthology.orchestra.run.smithi008:osd.2> sudo journalctl -f -n 0 -u ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.2.service 2023-10-18T20:53:56.405 INFO:tasks.cephadm:Deploying osd.3 on smithi060 with /dev/vg_nvme/lv_4... 2023-10-18T20:53:56.406 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-18T20:53:56.478 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:55.976717+0000 mon.smithi008 (mon.0) 303 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:53:56.478 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:55.981168+0000 mon.smithi008 (mon.0) 304 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:56.478 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:55.987067+0000 mon.smithi008 (mon.0) 305 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:56.491 INFO:journalctl@ceph.osd.2.smithi008.stdout:-- Logs begin at Wed 2023-10-18 20:15:27 UTC. -- 2023-10-18T20:53:56.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:55.976717+0000 mon.smithi008 (mon.0) 303 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:53:56.724 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:55.981168+0000 mon.smithi008 (mon.0) 304 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:56.724 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:55.987067+0000 mon.smithi008 (mon.0) 305 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:56.102189+0000 mgr.smithi008.flmjzp (mgr.14164) 122 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:57.675 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:56.102189+0000 mgr.smithi008.flmjzp (mgr.14164) 122 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:58.348 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-18T20:53:58.348 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-18T20:53:58.349 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-18T20:53:58.349 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-18T20:53:58.349 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0311455 s, 337 MB/s 2023-10-18T20:53:58.349 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-18T20:53:58.824 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2023-10-18T20:53:59.361 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:53:58.102489+0000 mgr.smithi008.flmjzp (mgr.14164) 123 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:59.361 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:53:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:58.106534+0000 mon.smithi008 (mon.0) 306 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:53:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:53:58.102489+0000 mgr.smithi008.flmjzp (mgr.14164) 123 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:53:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:53:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:58.106534+0000 mon.smithi008 (mon.0) 306 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:00.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.228+0000 7fc99efbd700 1 -- 172.21.15.60:0/1673978997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9980f6530 msgr2=0x7fc9980f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:00.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.228+0000 7fc99efbd700 1 --2- 172.21.15.60:0/1673978997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9980f6530 0x7fc9980f6950 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fc994004660 tx=0x7fc994009b30).stop 2023-10-18T20:54:00.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.228+0000 7fc99efbd700 1 -- 172.21.15.60:0/1673978997 shutdown_connections 2023-10-18T20:54:00.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.228+0000 7fc99efbd700 1 --2- 172.21.15.60:0/1673978997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9980f77d0 0x7fc9980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:00.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.228+0000 7fc99efbd700 1 --2- 172.21.15.60:0/1673978997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9980f6530 0x7fc9980f6950 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:00.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.228+0000 7fc99efbd700 1 -- 172.21.15.60:0/1673978997 >> 172.21.15.60:0/1673978997 conn(0x7fc9980f1c90 msgr2=0x7fc9980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:00.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.228+0000 7fc99efbd700 1 -- 172.21.15.60:0/1673978997 shutdown_connections 2023-10-18T20:54:00.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.228+0000 7fc99efbd700 1 -- 172.21.15.60:0/1673978997 wait complete. 2023-10-18T20:54:00.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.229+0000 7fc99efbd700 1 Processor -- start 2023-10-18T20:54:00.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.229+0000 7fc99efbd700 1 -- start start 2023-10-18T20:54:00.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99efbd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9980f6530 0x7fc99806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:00.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99efbd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9980f77d0 0x7fc998069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:00.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99efbd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99806a380 con 0x7fc9980f77d0 2023-10-18T20:54:00.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99efbd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99806a4c0 con 0x7fc9980f6530 2023-10-18T20:54:00.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99dfbb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9980f6530 0x7fc99806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:00.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99dfbb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9980f6530 0x7fc99806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48806/0 (socket says 172.21.15.60:48806) 2023-10-18T20:54:00.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99dfbb700 1 -- 172.21.15.60:0/1760615209 learned_addr learned my addr 172.21.15.60:0/1760615209 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:54:00.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99d7ba700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9980f77d0 0x7fc998069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:00.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99dfbb700 1 -- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9980f77d0 msgr2=0x7fc998069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:00.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99dfbb700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9980f77d0 0x7fc998069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:00.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99dfbb700 1 -- 172.21.15.60:0/1760615209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994005040 con 0x7fc9980f6530 2023-10-18T20:54:00.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99d7ba700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9980f77d0 0x7fc998069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T20:54:00.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.230+0000 7fc99dfbb700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9980f6530 0x7fc99806b9a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc994007a60 tx=0x7fc994009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:00.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.231+0000 7fc98e7fc700 1 -- 172.21.15.60:0/1760615209 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc994018070 con 0x7fc9980f6530 2023-10-18T20:54:00.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.231+0000 7fc99efbd700 1 -- 172.21.15.60:0/1760615209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99806a740 con 0x7fc9980f6530 2023-10-18T20:54:00.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.231+0000 7fc98e7fc700 1 -- 172.21.15.60:0/1760615209 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc994013410 con 0x7fc9980f6530 2023-10-18T20:54:00.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.231+0000 7fc98e7fc700 1 -- 172.21.15.60:0/1760615209 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc99401c620 con 0x7fc9980f6530 2023-10-18T20:54:00.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.231+0000 7fc99efbd700 1 -- 172.21.15.60:0/1760615209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99806aca0 con 0x7fc9980f6530 2023-10-18T20:54:00.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.232+0000 7fc99efbd700 1 -- 172.21.15.60:0/1760615209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc998045ad0 con 0x7fc9980f6530 2023-10-18T20:54:00.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.232+0000 7fc98e7fc700 1 -- 172.21.15.60:0/1760615209 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc99401c890 con 0x7fc9980f6530 2023-10-18T20:54:00.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.233+0000 7fc98e7fc700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc98405c2f0 0x7fc98405e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:00.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.233+0000 7fc98e7fc700 1 -- 172.21.15.60:0/1760615209 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2429+0+0 (secure 0 0 0) 0x7fc9940772e0 con 0x7fc9980f6530 2023-10-18T20:54:00.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.234+0000 7fc99d7ba700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc98405c2f0 0x7fc98405e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:00.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.234+0000 7fc99d7ba700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc98405c2f0 0x7fc98405e7b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc988009780 tx=0x7fc988009c80).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:00.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.238+0000 7fc98e7fc700 1 -- 172.21.15.60:0/1760615209 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc99404aa70 con 0x7fc9980f6530 2023-10-18T20:54:00.324 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 20:53:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.2[126564]: debug 2023-10-18T20:53:59.973+0000 7f810e587080 -1 osd.2 0 log_to_monitors {default=true} 2023-10-18T20:54:00.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:00.429+0000 7fc99efbd700 1 -- 172.21.15.60:0/1760615209 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9980fee00 con 0x7fc98405c2f0 2023-10-18T20:54:00.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:59.581025+0000 mon.smithi008 (mon.0) 307 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:00.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:53:59.979969+0000 mon.smithi008 (mon.0) 308 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-18T20:54:00.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:00.102871+0000 mgr.smithi008.flmjzp (mgr.14164) 124 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:54:00.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:00.431624+0000 mon.smithi008 (mon.0) 309 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:54:00.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:00.433176+0000 mon.smithi008 (mon.0) 310 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:54:00.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:00.433882+0000 mon.smithi008 (mon.0) 311 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:59.581025+0000 mon.smithi008 (mon.0) 307 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:53:59.979969+0000 mon.smithi008 (mon.0) 308 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-18T20:54:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:00.102871+0000 mgr.smithi008.flmjzp (mgr.14164) 124 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:54:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:00.431624+0000 mon.smithi008 (mon.0) 309 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:54:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:00.433176+0000 mon.smithi008 (mon.0) 310 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:54:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:00.433882+0000 mon.smithi008 (mon.0) 311 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:01.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:00.430733+0000 mgr.smithi008.flmjzp (mgr.14164) 125 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:54:01.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:54:00.432959+0000 mgr.smithi008.flmjzp (mgr.14164) 126 : cephadm [INF] Applying service osd.None on host smithi060... 2023-10-18T20:54:01.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:00.587420+0000 mon.smithi008 (mon.0) 312 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-18T20:54:01.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:00.587506+0000 mon.smithi008 (mon.0) 313 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2023-10-18T20:54:01.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:00.587775+0000 mon.smithi008 (mon.0) 314 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:54:01.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:00.588171+0000 mon.smithi008 (mon.0) 315 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T20:54:01.866 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 20:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.2[126564]: debug 2023-10-18T20:54:01.591+0000 7f8104af8700 -1 osd.2 0 waiting for initial osdmap 2023-10-18T20:54:01.866 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 20:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.2[126564]: debug 2023-10-18T20:54:01.600+0000 7f80fd26c700 -1 osd.2 18 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-10-18T20:54:01.867 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:00.430733+0000 mgr.smithi008.flmjzp (mgr.14164) 125 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:54:01.867 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:54:00.432959+0000 mgr.smithi008.flmjzp (mgr.14164) 126 : cephadm [INF] Applying service osd.None on host smithi060... 2023-10-18T20:54:01.867 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:00.587420+0000 mon.smithi008 (mon.0) 312 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-18T20:54:01.867 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:00.587506+0000 mon.smithi008 (mon.0) 313 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2023-10-18T20:54:01.867 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:00.587775+0000 mon.smithi008 (mon.0) 314 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:54:01.868 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:00.588171+0000 mon.smithi008 (mon.0) 315 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T20:54:02.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:01.588619+0000 mon.smithi008 (mon.0) 316 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-18T20:54:02.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:01.588679+0000 mon.smithi008 (mon.0) 317 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2023-10-18T20:54:02.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:01.589161+0000 mon.smithi008 (mon.0) 318 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:54:02.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:01.594034+0000 mon.smithi008 (mon.0) 319 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:54:02.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:02.103169+0000 mgr.smithi008.flmjzp (mgr.14164) 127 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:54:02.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:02.316556+0000 mon.smithi060 (mon.1) 2 : audit [INF] from='client.? 172.21.15.60:0/3145087844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c8b8dd3-cec0-4acb-a59d-bcdadf4097fb"}]: dispatch 2023-10-18T20:54:02.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:02.317059+0000 mon.smithi008 (mon.0) 320 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c8b8dd3-cec0-4acb-a59d-bcdadf4097fb"}]: dispatch 2023-10-18T20:54:02.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:02.321822+0000 mon.smithi008 (mon.0) 321 : cluster [INF] osd.2 [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731] boot 2023-10-18T20:54:02.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:02.321880+0000 mon.smithi008 (mon.0) 322 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c8b8dd3-cec0-4acb-a59d-bcdadf4097fb"}]': finished 2023-10-18T20:54:02.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:02.321960+0000 mon.smithi008 (mon.0) 323 : cluster [DBG] osdmap e19: 4 total, 3 up, 4 in 2023-10-18T20:54:02.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:02.322235+0000 mon.smithi008 (mon.0) 324 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:54:02.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:02.322518+0000 mon.smithi008 (mon.0) 325 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:02.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:02.448903+0000 mon.smithi008 (mon.0) 326 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:02.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:02.452105+0000 mon.smithi008 (mon.0) 327 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:02.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:02.454477+0000 mon.smithi008 (mon.0) 328 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:01.588619+0000 mon.smithi008 (mon.0) 316 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-18T20:54:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:01.588679+0000 mon.smithi008 (mon.0) 317 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2023-10-18T20:54:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:01.589161+0000 mon.smithi008 (mon.0) 318 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:54:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:01.594034+0000 mon.smithi008 (mon.0) 319 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:54:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:02.103169+0000 mgr.smithi008.flmjzp (mgr.14164) 127 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2023-10-18T20:54:02.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:02.316556+0000 mon.smithi060 (mon.1) 2 : audit [INF] from='client.? 172.21.15.60:0/3145087844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c8b8dd3-cec0-4acb-a59d-bcdadf4097fb"}]: dispatch 2023-10-18T20:54:02.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:02.317059+0000 mon.smithi008 (mon.0) 320 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c8b8dd3-cec0-4acb-a59d-bcdadf4097fb"}]: dispatch 2023-10-18T20:54:02.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:02.321822+0000 mon.smithi008 (mon.0) 321 : cluster [INF] osd.2 [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731] boot 2023-10-18T20:54:02.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:02.321880+0000 mon.smithi008 (mon.0) 322 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c8b8dd3-cec0-4acb-a59d-bcdadf4097fb"}]': finished 2023-10-18T20:54:02.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:02.321960+0000 mon.smithi008 (mon.0) 323 : cluster [DBG] osdmap e19: 4 total, 3 up, 4 in 2023-10-18T20:54:02.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:02.322235+0000 mon.smithi008 (mon.0) 324 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:54:02.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:02.322518+0000 mon.smithi008 (mon.0) 325 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:02.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:02.448903+0000 mon.smithi008 (mon.0) 326 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:02.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:02.452105+0000 mon.smithi008 (mon.0) 327 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:02.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:02.454477+0000 mon.smithi008 (mon.0) 328 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:00.948035+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:54:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:00.948166+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:54:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:02.860162+0000 mon.smithi060 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.60:0/3895530929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:54:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:00.948035+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:54:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:00.948166+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:54:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:02.860162+0000 mon.smithi060 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.60:0/3895530929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:54:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:03.598838+0000 mon.smithi008 (mon.0) 329 : cluster [DBG] osdmap e20: 4 total, 3 up, 4 in 2023-10-18T20:54:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:03.599432+0000 mon.smithi008 (mon.0) 330 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:04.103424+0000 mgr.smithi008.flmjzp (mgr.14164) 128 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:03.598838+0000 mon.smithi008 (mon.0) 329 : cluster [DBG] osdmap e20: 4 total, 3 up, 4 in 2023-10-18T20:54:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:03.599432+0000 mon.smithi008 (mon.0) 330 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:04.103424+0000 mgr.smithi008.flmjzp (mgr.14164) 128 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:06.901 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:05.641881+0000 mon.smithi008 (mon.0) 331 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:06.902 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:05.645071+0000 mon.smithi008 (mon.0) 332 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:06.902 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:06.103754+0000 mgr.smithi008.flmjzp (mgr.14164) 129 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:05.641881+0000 mon.smithi008 (mon.0) 331 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:05.645071+0000 mon.smithi008 (mon.0) 332 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:06.103754+0000 mgr.smithi008.flmjzp (mgr.14164) 129 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:08.104022+0000 mgr.smithi008.flmjzp (mgr.14164) 130 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:08.300432+0000 mon.smithi008 (mon.0) 333 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-18T20:54:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:08.301497+0000 mon.smithi008 (mon.0) 334 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:54:08.302312+0000 mgr.smithi008.flmjzp (mgr.14164) 131 : cephadm [INF] Deploying daemon osd.3 on smithi060 2023-10-18T20:54:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:08.104022+0000 mgr.smithi008.flmjzp (mgr.14164) 130 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:08.300432+0000 mon.smithi008 (mon.0) 333 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-18T20:54:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:08.301497+0000 mon.smithi008 (mon.0) 334 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:54:08.302312+0000 mgr.smithi008.flmjzp (mgr.14164) 131 : cephadm [INF] Deploying daemon osd.3 on smithi060 2023-10-18T20:54:11.370 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 3 on host 'smithi060' 2023-10-18T20:54:11.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.367+0000 7fc98e7fc700 1 -- 172.21.15.60:0/1760615209 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc9980fee00 con 0x7fc98405c2f0 2023-10-18T20:54:11.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.369+0000 7fc99efbd700 1 -- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc98405c2f0 msgr2=0x7fc98405e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:11.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.369+0000 7fc99efbd700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc98405c2f0 0x7fc98405e7b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc988009780 tx=0x7fc988009c80).stop 2023-10-18T20:54:11.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.369+0000 7fc99efbd700 1 -- 172.21.15.60:0/1760615209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9980f6530 msgr2=0x7fc99806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:11.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.369+0000 7fc99efbd700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9980f6530 0x7fc99806b9a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc994007a60 tx=0x7fc994009b30).stop 2023-10-18T20:54:11.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.370+0000 7fc99efbd700 1 -- 172.21.15.60:0/1760615209 shutdown_connections 2023-10-18T20:54:11.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.370+0000 7fc99efbd700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc98405c2f0 0x7fc98405e7b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:11.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.370+0000 7fc99efbd700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9980f6530 0x7fc99806b9a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:11.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.370+0000 7fc99efbd700 1 --2- 172.21.15.60:0/1760615209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9980f77d0 0x7fc998069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:11.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.370+0000 7fc99efbd700 1 -- 172.21.15.60:0/1760615209 >> 172.21.15.60:0/1760615209 conn(0x7fc9980f1c90 msgr2=0x7fc9980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:11.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.370+0000 7fc99efbd700 1 -- 172.21.15.60:0/1760615209 shutdown_connections 2023-10-18T20:54:11.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:11.370+0000 7fc99efbd700 1 -- 172.21.15.60:0/1760615209 wait complete. 2023-10-18T20:54:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:10.104335+0000 mgr.smithi008.flmjzp (mgr.14164) 132 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:10.104335+0000 mgr.smithi008.flmjzp (mgr.14164) 132 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:11.720 DEBUG:teuthology.orchestra.run.smithi060:osd.3> sudo journalctl -f -n 0 -u ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.3.service 2023-10-18T20:54:11.725 INFO:tasks.cephadm:Deploying osd.4 on smithi060 with /dev/vg_nvme/lv_3... 2023-10-18T20:54:11.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-18T20:54:11.804 INFO:journalctl@ceph.osd.3.smithi060.stdout:-- Logs begin at Wed 2023-10-18 20:14:49 UTC. -- 2023-10-18T20:54:12.166 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 20:54:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.3[114985]: debug 2023-10-18T20:54:11.824+0000 7fe422c92080 -1 Falling back to public interface 2023-10-18T20:54:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:11.356311+0000 mon.smithi008 (mon.0) 335 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:11.360923+0000 mon.smithi008 (mon.0) 336 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:11.367271+0000 mon.smithi008 (mon.0) 337 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:11.369602+0000 mon.smithi008 (mon.0) 338 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2023-10-18T20:54:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:11.356311+0000 mon.smithi008 (mon.0) 335 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:11.360923+0000 mon.smithi008 (mon.0) 336 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:11.367271+0000 mon.smithi008 (mon.0) 337 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:11.369602+0000 mon.smithi008 (mon.0) 338 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2023-10-18T20:54:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:12.104631+0000 mgr.smithi008.flmjzp (mgr.14164) 133 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:12.371739+0000 mon.smithi008 (mon.0) 339 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2023-10-18T20:54:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:12.371790+0000 mon.smithi008 (mon.0) 340 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2023-10-18T20:54:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:12.371905+0000 mon.smithi008 (mon.0) 341 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:12.372661+0000 mon.smithi008 (mon.0) 342 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-10-18T20:54:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:12.104631+0000 mgr.smithi008.flmjzp (mgr.14164) 133 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:13.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:12.371739+0000 mon.smithi008 (mon.0) 339 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2023-10-18T20:54:13.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:12.371790+0000 mon.smithi008 (mon.0) 340 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2023-10-18T20:54:13.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:12.371905+0000 mon.smithi008 (mon.0) 341 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:13.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:12.372661+0000 mon.smithi008 (mon.0) 342 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-10-18T20:54:13.770 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-18T20:54:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-18T20:54:13.771 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-18T20:54:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-18T20:54:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0577285 s, 182 MB/s 2023-10-18T20:54:13.771 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 2023-10-18T20:54:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-18T20:54:14.276 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2023-10-18T20:54:14.650 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:13.373661+0000 mon.smithi008 (mon.0) 343 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-10-18T20:54:14.650 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:13.373787+0000 mon.smithi008 (mon.0) 344 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2023-10-18T20:54:14.650 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:13.373984+0000 mon.smithi008 (mon.0) 345 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:14.651 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:13.441467+0000 mon.smithi008 (mon.0) 346 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:14.651 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:14.104960+0000 mgr.smithi008.flmjzp (mgr.14164) 134 : cluster [DBG] pgmap v97: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:13.373661+0000 mon.smithi008 (mon.0) 343 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-10-18T20:54:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:13.373787+0000 mon.smithi008 (mon.0) 344 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2023-10-18T20:54:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:13.373984+0000 mon.smithi008 (mon.0) 345 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:13.441467+0000 mon.smithi008 (mon.0) 346 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:14.104960+0000 mgr.smithi008.flmjzp (mgr.14164) 134 : cluster [DBG] pgmap v97: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:15.737 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 20:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.3[114985]: debug 2023-10-18T20:54:15.391+0000 7fe422c92080 -1 osd.3 0 log_to_monitors {default=true} 2023-10-18T20:54:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:14.445581+0000 mon.smithi008 (mon.0) 347 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2023-10-18T20:54:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:14.445771+0000 mon.smithi008 (mon.0) 348 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:14.668796+0000 mon.smithi008 (mon.0) 349 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:15.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:15.398480+0000 mon.smithi060 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T20:54:15.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:15.398911+0000 mon.smithi008 (mon.0) 350 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T20:54:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.735+0000 7f85197f3700 1 -- 172.21.15.60:0/1787759208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85140f77d0 msgr2=0x7f85140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:15.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.735+0000 7f85197f3700 1 --2- 172.21.15.60:0/1787759208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85140f77d0 0x7f85140f7c30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8508004660 tx=0x7f8508009b30).stop 2023-10-18T20:54:15.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.735+0000 7f85197f3700 1 -- 172.21.15.60:0/1787759208 shutdown_connections 2023-10-18T20:54:15.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.735+0000 7f85197f3700 1 --2- 172.21.15.60:0/1787759208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85140f77d0 0x7f85140f7c30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:15.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.735+0000 7f85197f3700 1 --2- 172.21.15.60:0/1787759208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140f6530 0x7f85140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.735+0000 7f85197f3700 1 -- 172.21.15.60:0/1787759208 >> 172.21.15.60:0/1787759208 conn(0x7f85140f1c90 msgr2=0x7f85140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.735+0000 7f85197f3700 1 -- 172.21.15.60:0/1787759208 shutdown_connections 2023-10-18T20:54:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.735+0000 7f85197f3700 1 -- 172.21.15.60:0/1787759208 wait complete. 2023-10-18T20:54:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.736+0000 7f85197f3700 1 Processor -- start 2023-10-18T20:54:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.736+0000 7f85197f3700 1 -- start start 2023-10-18T20:54:15.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.736+0000 7f85197f3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85140f6530 0x7f8514106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:15.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.736+0000 7f85197f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140f77d0 0x7f8514107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:15.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.736+0000 7f85197f3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514107900 con 0x7f85140f77d0 2023-10-18T20:54:15.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.736+0000 7f85197f3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514108110 con 0x7f85140f6530 2023-10-18T20:54:15.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f8513fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85140f6530 0x7f8514106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:15.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f8513fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85140f6530 0x7f8514106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52934/0 (socket says 172.21.15.60:52934) 2023-10-18T20:54:15.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f8513fff700 1 -- 172.21.15.60:0/2220278179 learned_addr learned my addr 172.21.15.60:0/2220278179 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:54:15.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f85137fe700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140f77d0 0x7f8514107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:15.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f8513fff700 1 -- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140f77d0 msgr2=0x7f8514107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:15.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f8513fff700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140f77d0 0x7f8514107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:15.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f8513fff700 1 -- 172.21.15.60:0/2220278179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8508005040 con 0x7f85140f6530 2023-10-18T20:54:15.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f85137fe700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140f77d0 0x7f8514107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T20:54:15.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f8513fff700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85140f6530 0x7f8514106e10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f8504002700 tx=0x7f8504009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:15.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f8510ff9700 1 -- 172.21.15.60:0/2220278179 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8504009320 con 0x7f85140f6530 2023-10-18T20:54:15.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f8510ff9700 1 -- 172.21.15.60:0/2220278179 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f850400f040 con 0x7f85140f6530 2023-10-18T20:54:15.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f8510ff9700 1 -- 172.21.15.60:0/2220278179 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8504014900 con 0x7f85140f6530 2023-10-18T20:54:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.737+0000 7f85197f3700 1 -- 172.21.15.60:0/2220278179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8514108390 con 0x7f85140f6530 2023-10-18T20:54:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.738+0000 7f85197f3700 1 -- 172.21.15.60:0/2220278179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8514108950 con 0x7f85140f6530 2023-10-18T20:54:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.739+0000 7f85197f3700 1 -- 172.21.15.60:0/2220278179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8514059100 con 0x7f85140f6530 2023-10-18T20:54:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.740+0000 7f8510ff9700 1 -- 172.21.15.60:0/2220278179 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f85040077b0 con 0x7f85140f6530 2023-10-18T20:54:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.740+0000 7f8510ff9700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f84fc05c2f0 0x7f84fc05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.740+0000 7f8510ff9700 1 -- 172.21.15.60:0/2220278179 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3282+0+0 (secure 0 0 0) 0x7f85040759c0 con 0x7f85140f6530 2023-10-18T20:54:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.741+0000 7f85137fe700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f84fc05c2f0 0x7f84fc05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.742+0000 7f85137fe700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f84fc05c2f0 0x7f84fc05e7b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8508009d60 tx=0x7f8508009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.745+0000 7f8510ff9700 1 -- 172.21.15.60:0/2220278179 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8504048e70 con 0x7f85140f6530 2023-10-18T20:54:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:14.445581+0000 mon.smithi008 (mon.0) 347 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2023-10-18T20:54:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:14.445771+0000 mon.smithi008 (mon.0) 348 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:14.668796+0000 mon.smithi008 (mon.0) 349 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:15.398480+0000 mon.smithi060 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T20:54:15.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:15.398911+0000 mon.smithi008 (mon.0) 350 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T20:54:15.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:15.940+0000 7f85197f3700 1 -- 172.21.15.60:0/2220278179 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f85140feda0 con 0x7f84fc05c2f0 2023-10-18T20:54:16.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:15.671184+0000 mon.smithi008 (mon.0) 351 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-18T20:54:16.987 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.3[114985]: debug 2023-10-18T20:54:16.680+0000 7fe419203700 -1 osd.3 0 waiting for initial osdmap 2023-10-18T20:54:16.987 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.3[114985]: debug 2023-10-18T20:54:16.692+0000 7fe412979700 -1 osd.3 25 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-10-18T20:54:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:15.671299+0000 mon.smithi008 (mon.0) 352 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2023-10-18T20:54:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:15.671485+0000 mon.smithi008 (mon.0) 353 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:15.672109+0000 mon.smithi060 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T20:54:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:15.672530+0000 mon.smithi008 (mon.0) 354 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T20:54:16.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:15.943247+0000 mgr.smithi008.flmjzp (mgr.14164) 135 : audit [DBG] from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:54:16.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:15.944260+0000 mon.smithi008 (mon.0) 355 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:54:16.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:54:15.945867+0000 mgr.smithi008.flmjzp (mgr.14164) 136 : cephadm [INF] Applying service osd.None on host smithi060... 2023-10-18T20:54:16.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:15.946180+0000 mon.smithi008 (mon.0) 356 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:54:16.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:15.947168+0000 mon.smithi008 (mon.0) 357 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:16.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:16.105345+0000 mgr.smithi008.flmjzp (mgr.14164) 137 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:17.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:15.671184+0000 mon.smithi008 (mon.0) 351 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-18T20:54:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:15.671299+0000 mon.smithi008 (mon.0) 352 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2023-10-18T20:54:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:15.671485+0000 mon.smithi008 (mon.0) 353 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:15.672109+0000 mon.smithi060 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T20:54:17.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:15.672530+0000 mon.smithi008 (mon.0) 354 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T20:54:17.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:15.943247+0000 mgr.smithi008.flmjzp (mgr.14164) 135 : audit [DBG] from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:54:17.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:15.944260+0000 mon.smithi008 (mon.0) 355 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:54:17.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:54:15.945867+0000 mgr.smithi008.flmjzp (mgr.14164) 136 : cephadm [INF] Applying service osd.None on host smithi060... 2023-10-18T20:54:17.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:15.946180+0000 mon.smithi008 (mon.0) 356 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:54:17.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:15.947168+0000 mon.smithi008 (mon.0) 357 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:17.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:16.105345+0000 mgr.smithi008.flmjzp (mgr.14164) 137 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:16.674006+0000 mon.smithi008 (mon.0) 358 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-18T20:54:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:16.674140+0000 mon.smithi008 (mon.0) 359 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2023-10-18T20:54:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:16.674893+0000 mon.smithi008 (mon.0) 360 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:16.680880+0000 mon.smithi008 (mon.0) 361 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:54:16.771958+0000 mgr.smithi008.flmjzp (mgr.14164) 138 : cephadm [INF] Detected new or changed devices on smithi060 2023-10-18T20:54:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:16.777195+0000 mon.smithi008 (mon.0) 362 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:16.781348+0000 mon.smithi008 (mon.0) 363 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:16.784539+0000 mon.smithi008 (mon.0) 364 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:16.674006+0000 mon.smithi008 (mon.0) 358 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-18T20:54:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:16.674140+0000 mon.smithi008 (mon.0) 359 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2023-10-18T20:54:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:16.674893+0000 mon.smithi008 (mon.0) 360 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:16.680880+0000 mon.smithi008 (mon.0) 361 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:54:16.771958+0000 mgr.smithi008.flmjzp (mgr.14164) 138 : cephadm [INF] Detected new or changed devices on smithi060 2023-10-18T20:54:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:16.777195+0000 mon.smithi008 (mon.0) 362 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:17.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:16.781348+0000 mon.smithi008 (mon.0) 363 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:17.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:16.784539+0000 mon.smithi008 (mon.0) 364 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:18.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:16.430036+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:54:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:16.430233+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:54:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:17.680434+0000 mon.smithi008 (mon.0) 365 : cluster [INF] osd.3 [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194] boot 2023-10-18T20:54:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:17.680490+0000 mon.smithi008 (mon.0) 366 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2023-10-18T20:54:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:17.681068+0000 mon.smithi008 (mon.0) 367 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:18.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:18.078184+0000 mon.smithi060 (mon.1) 6 : audit [INF] from='client.? 172.21.15.60:0/1765877842' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7469ba83-d780-4657-9add-610badaa3bd5"}]: dispatch 2023-10-18T20:54:18.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:18.078709+0000 mon.smithi008 (mon.0) 368 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7469ba83-d780-4657-9add-610badaa3bd5"}]: dispatch 2023-10-18T20:54:18.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:18.083511+0000 mon.smithi008 (mon.0) 369 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7469ba83-d780-4657-9add-610badaa3bd5"}]': finished 2023-10-18T20:54:18.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:18.083591+0000 mon.smithi008 (mon.0) 370 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2023-10-18T20:54:18.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:18.083764+0000 mon.smithi008 (mon.0) 371 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:18.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:18.105800+0000 mgr.smithi008.flmjzp (mgr.14164) 139 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:18.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:18.614372+0000 mon.smithi060 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.60:0/3243427170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:54:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:16.430036+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:54:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:16.430233+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:54:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:17.680434+0000 mon.smithi008 (mon.0) 365 : cluster [INF] osd.3 [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194] boot 2023-10-18T20:54:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:17.680490+0000 mon.smithi008 (mon.0) 366 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2023-10-18T20:54:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:17.681068+0000 mon.smithi008 (mon.0) 367 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:54:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:18.078184+0000 mon.smithi060 (mon.1) 6 : audit [INF] from='client.? 172.21.15.60:0/1765877842' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7469ba83-d780-4657-9add-610badaa3bd5"}]: dispatch 2023-10-18T20:54:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:18.078709+0000 mon.smithi008 (mon.0) 368 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7469ba83-d780-4657-9add-610badaa3bd5"}]: dispatch 2023-10-18T20:54:18.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:18.083511+0000 mon.smithi008 (mon.0) 369 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7469ba83-d780-4657-9add-610badaa3bd5"}]': finished 2023-10-18T20:54:18.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:18.083591+0000 mon.smithi008 (mon.0) 370 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2023-10-18T20:54:18.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:18.083764+0000 mon.smithi008 (mon.0) 371 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:18.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:18.105800+0000 mgr.smithi008.flmjzp (mgr.14164) 139 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-10-18T20:54:18.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:18.614372+0000 mon.smithi060 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.60:0/3243427170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:54:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:19.087575+0000 mon.smithi008 (mon.0) 372 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2023-10-18T20:54:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:19.087765+0000 mon.smithi008 (mon.0) 373 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:20.041898+0000 mon.smithi008 (mon.0) 374 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:20.045058+0000 mon.smithi008 (mon.0) 375 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:19.087575+0000 mon.smithi008 (mon.0) 372 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2023-10-18T20:54:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:19.087765+0000 mon.smithi008 (mon.0) 373 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:20.041898+0000 mon.smithi008 (mon.0) 374 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:20.045058+0000 mon.smithi008 (mon.0) 375 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:20.106095+0000 mgr.smithi008.flmjzp (mgr.14164) 140 : cluster [DBG] pgmap v106: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:20.106095+0000 mgr.smithi008.flmjzp (mgr.14164) 140 : cluster [DBG] pgmap v106: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:22.106573+0000 mgr.smithi008.flmjzp (mgr.14164) 141 : cluster [DBG] pgmap v107: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:22.255495+0000 mon.smithi008 (mon.0) 376 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:54:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:22.259632+0000 mon.smithi008 (mon.0) 377 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:54:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:22.106573+0000 mgr.smithi008.flmjzp (mgr.14164) 141 : cluster [DBG] pgmap v107: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:22.255495+0000 mon.smithi008 (mon.0) 376 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:54:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:22.259632+0000 mon.smithi008 (mon.0) 377 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:54:24.622 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:23.984216+0000 mon.smithi008 (mon.0) 378 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-18T20:54:24.623 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:23.985217+0000 mon.smithi008 (mon.0) 379 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:23.984216+0000 mon.smithi008 (mon.0) 378 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-18T20:54:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:23.985217+0000 mon.smithi008 (mon.0) 379 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:25.658 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:54:23.986007+0000 mgr.smithi008.flmjzp (mgr.14164) 142 : cephadm [INF] Deploying daemon osd.4 on smithi060 2023-10-18T20:54:25.658 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:24.106967+0000 mgr.smithi008.flmjzp (mgr.14164) 143 : cluster [DBG] pgmap v108: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:54:23.986007+0000 mgr.smithi008.flmjzp (mgr.14164) 142 : cephadm [INF] Deploying daemon osd.4 on smithi060 2023-10-18T20:54:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:24.106967+0000 mgr.smithi008.flmjzp (mgr.14164) 143 : cluster [DBG] pgmap v108: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:26.107393+0000 mgr.smithi008.flmjzp (mgr.14164) 144 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:26.107393+0000 mgr.smithi008.flmjzp (mgr.14164) 144 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:27.192 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 4 on host 'smithi060' 2023-10-18T20:54:27.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.188+0000 7f8510ff9700 1 -- 172.21.15.60:0/2220278179 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f85140feda0 con 0x7f84fc05c2f0 2023-10-18T20:54:27.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 -- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f84fc05c2f0 msgr2=0x7f84fc05e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:27.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f84fc05c2f0 0x7f84fc05e7b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8508009d60 tx=0x7f8508009b30).stop 2023-10-18T20:54:27.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 -- 172.21.15.60:0/2220278179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85140f6530 msgr2=0x7f8514106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:27.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85140f6530 0x7f8514106e10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f8504002700 tx=0x7f8504009d80).stop 2023-10-18T20:54:27.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 -- 172.21.15.60:0/2220278179 shutdown_connections 2023-10-18T20:54:27.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f84fc05c2f0 0x7f84fc05e7b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:27.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85140f6530 0x7f8514106e10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:27.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 --2- 172.21.15.60:0/2220278179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85140f77d0 0x7f8514107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:27.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 -- 172.21.15.60:0/2220278179 >> 172.21.15.60:0/2220278179 conn(0x7f85140f1c90 msgr2=0x7f85140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:27.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 -- 172.21.15.60:0/2220278179 shutdown_connections 2023-10-18T20:54:27.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:27.191+0000 7f85197f3700 1 -- 172.21.15.60:0/2220278179 wait complete. 2023-10-18T20:54:27.544 DEBUG:teuthology.orchestra.run.smithi060:osd.4> sudo journalctl -f -n 0 -u ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.4.service 2023-10-18T20:54:27.549 INFO:tasks.cephadm:Deploying osd.5 on smithi060 with /dev/vg_nvme/lv_2... 2023-10-18T20:54:27.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-18T20:54:27.630 INFO:journalctl@ceph.osd.4.smithi060.stdout:-- Logs begin at Wed 2023-10-18 20:14:49 UTC. -- 2023-10-18T20:54:27.642 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:27.177976+0000 mon.smithi008 (mon.0) 380 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:27.642 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:27.183088+0000 mon.smithi008 (mon.0) 381 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:27.643 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:27.188746+0000 mon.smithi008 (mon.0) 382 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:27.177976+0000 mon.smithi008 (mon.0) 380 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:27.183088+0000 mon.smithi008 (mon.0) 381 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:27.188746+0000 mon.smithi008 (mon.0) 382 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:27.987 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 20:54:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.4[118604]: debug 2023-10-18T20:54:27.639+0000 7f12b19fe080 -1 Falling back to public interface 2023-10-18T20:54:29.610 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-18T20:54:29.613 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-18T20:54:29.613 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-18T20:54:29.613 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-18T20:54:29.614 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0356453 s, 294 MB/s 2023-10-18T20:54:29.614 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-18T20:54:29.649 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:28.107634+0000 mgr.smithi008.flmjzp (mgr.14164) 145 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:28.107634+0000 mgr.smithi008.flmjzp (mgr.14164) 145 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:29.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2023-10-18T20:54:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:29.448809+0000 mon.smithi008 (mon.0) 383 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:30.108028+0000 mgr.smithi008.flmjzp (mgr.14164) 146 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:29.448809+0000 mon.smithi008 (mon.0) 383 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:30.108028+0000 mgr.smithi008.flmjzp (mgr.14164) 146 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:31.460 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 20:54:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.4[118604]: debug 2023-10-18T20:54:31.229+0000 7f12b19fe080 -1 osd.4 0 log_to_monitors {default=true} 2023-10-18T20:54:31.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.696+0000 7f550a50c700 1 -- 172.21.15.60:0/2459705676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55040f6530 msgr2=0x7f55040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:31.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.696+0000 7f550a50c700 1 --2- 172.21.15.60:0/2459705676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55040f6530 0x7f55040f6950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5500004660 tx=0x7f5500009b30).stop 2023-10-18T20:54:31.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.696+0000 7f550a50c700 1 -- 172.21.15.60:0/2459705676 shutdown_connections 2023-10-18T20:54:31.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.696+0000 7f550a50c700 1 --2- 172.21.15.60:0/2459705676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55040f77d0 0x7f55040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:31.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.696+0000 7f550a50c700 1 --2- 172.21.15.60:0/2459705676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55040f6530 0x7f55040f6950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:31.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.696+0000 7f550a50c700 1 -- 172.21.15.60:0/2459705676 >> 172.21.15.60:0/2459705676 conn(0x7f55040f1c90 msgr2=0x7f55040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:31.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.697+0000 7f550a50c700 1 -- 172.21.15.60:0/2459705676 shutdown_connections 2023-10-18T20:54:31.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.697+0000 7f550a50c700 1 -- 172.21.15.60:0/2459705676 wait complete. 2023-10-18T20:54:31.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.697+0000 7f550a50c700 1 Processor -- start 2023-10-18T20:54:31.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.698+0000 7f550a50c700 1 -- start start 2023-10-18T20:54:31.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.698+0000 7f550a50c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55040f6530 0x7f5504108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:31.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.698+0000 7f550a50c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55040f77d0 0x7f5504109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:31.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.698+0000 7f550a50c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5504109a40 con 0x7f55040f6530 2023-10-18T20:54:31.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.698+0000 7f550a50c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5504109b80 con 0x7f55040f77d0 2023-10-18T20:54:31.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.698+0000 7f5508d09700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55040f77d0 0x7f5504109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:31.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.698+0000 7f5508d09700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55040f77d0 0x7f5504109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36932/0 (socket says 172.21.15.60:36932) 2023-10-18T20:54:31.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.698+0000 7f5508d09700 1 -- 172.21.15.60:0/516378545 learned_addr learned my addr 172.21.15.60:0/516378545 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:54:31.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.698+0000 7f550950a700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55040f6530 0x7f5504108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:31.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.699+0000 7f5508d09700 1 -- 172.21.15.60:0/516378545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55040f6530 msgr2=0x7f5504108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:31.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.699+0000 7f5508d09700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55040f6530 0x7f5504108fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:31.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.699+0000 7f5508d09700 1 -- 172.21.15.60:0/516378545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5500005040 con 0x7f55040f77d0 2023-10-18T20:54:31.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.699+0000 7f5508d09700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55040f77d0 0x7f5504109490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f54f40026d0 tx=0x7f54f4009de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:31.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.699+0000 7f54f9ffb700 1 -- 172.21.15.60:0/516378545 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54f40079c0 con 0x7f55040f77d0 2023-10-18T20:54:31.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.699+0000 7f54f9ffb700 1 -- 172.21.15.60:0/516378545 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54f400f040 con 0x7f55040f77d0 2023-10-18T20:54:31.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.699+0000 7f54f9ffb700 1 -- 172.21.15.60:0/516378545 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54f40148b0 con 0x7f55040f77d0 2023-10-18T20:54:31.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.699+0000 7f550a50c700 1 -- 172.21.15.60:0/516378545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550410a520 con 0x7f55040f77d0 2023-10-18T20:54:31.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.699+0000 7f550a50c700 1 -- 172.21.15.60:0/516378545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550410aa90 con 0x7f55040f77d0 2023-10-18T20:54:31.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.701+0000 7f550a50c700 1 -- 172.21.15.60:0/516378545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5504045ad0 con 0x7f55040f77d0 2023-10-18T20:54:31.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.701+0000 7f54f9ffb700 1 -- 172.21.15.60:0/516378545 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f54f4007b20 con 0x7f55040f77d0 2023-10-18T20:54:31.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.702+0000 7f54f9ffb700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54f005c2f0 0x7f54f005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:31.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.702+0000 7f54f9ffb700 1 -- 172.21.15.60:0/516378545 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3824+0+0 (secure 0 0 0) 0x7f54f4075820 con 0x7f55040f77d0 2023-10-18T20:54:31.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.703+0000 7f550950a700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54f005c2f0 0x7f54f005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:31.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.703+0000 7f550950a700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54f005c2f0 0x7f54f005e7b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5500005010 tx=0x7f5500009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:31.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.706+0000 7f54f9ffb700 1 -- 172.21.15.60:0/516378545 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f54f4048b00 con 0x7f55040f77d0 2023-10-18T20:54:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:30.562408+0000 mon.smithi008 (mon.0) 384 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:31.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:31.236464+0000 mon.smithi060 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T20:54:31.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:31.237058+0000 mon.smithi008 (mon.0) 385 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T20:54:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:30.562408+0000 mon.smithi008 (mon.0) 384 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:31.236464+0000 mon.smithi060 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T20:54:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:31.237058+0000 mon.smithi008 (mon.0) 385 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T20:54:31.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:31.931+0000 7f550a50c700 1 -- 172.21.15.60:0/516378545 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f550410ad60 con 0x7f54f005c2f0 2023-10-18T20:54:32.709 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.4[118604]: debug 2023-10-18T20:54:32.578+0000 7f12a7f6f700 -1 osd.4 0 waiting for initial osdmap 2023-10-18T20:54:32.710 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.4[118604]: debug 2023-10-18T20:54:32.588+0000 7f12a0ee4700 -1 osd.4 30 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-10-18T20:54:32.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:31.569844+0000 mon.smithi008 (mon.0) 386 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-18T20:54:32.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:31.569950+0000 mon.smithi008 (mon.0) 387 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2023-10-18T20:54:32.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:31.570130+0000 mon.smithi008 (mon.0) 388 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:32.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:31.571147+0000 mon.smithi060 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T20:54:32.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:31.571621+0000 mon.smithi008 (mon.0) 389 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T20:54:32.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:31.933861+0000 mgr.smithi008.flmjzp (mgr.14164) 147 : audit [DBG] from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:54:32.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:31.934798+0000 mon.smithi008 (mon.0) 390 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:54:32.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:54:31.936330+0000 mgr.smithi008.flmjzp (mgr.14164) 148 : cephadm [INF] Applying service osd.None on host smithi060... 2023-10-18T20:54:32.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:31.936630+0000 mon.smithi008 (mon.0) 391 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:54:32.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:31.937526+0000 mon.smithi008 (mon.0) 392 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:32.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:32.108323+0000 mgr.smithi008.flmjzp (mgr.14164) 149 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:31.569844+0000 mon.smithi008 (mon.0) 386 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-18T20:54:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:31.569950+0000 mon.smithi008 (mon.0) 387 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2023-10-18T20:54:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:31.570130+0000 mon.smithi008 (mon.0) 388 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:31.571147+0000 mon.smithi060 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T20:54:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:31.571621+0000 mon.smithi008 (mon.0) 389 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T20:54:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:31.933861+0000 mgr.smithi008.flmjzp (mgr.14164) 147 : audit [DBG] from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:54:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:31.934798+0000 mon.smithi008 (mon.0) 390 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T20:54:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:54:31.936330+0000 mgr.smithi008.flmjzp (mgr.14164) 148 : cephadm [INF] Applying service osd.None on host smithi060... 2023-10-18T20:54:32.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:31.936630+0000 mon.smithi008 (mon.0) 391 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T20:54:32.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:31.937526+0000 mon.smithi008 (mon.0) 392 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:32.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:32.108323+0000 mgr.smithi008.flmjzp (mgr.14164) 149 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-10-18T20:54:33.914 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:32.572077+0000 mon.smithi008 (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-18T20:54:33.914 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:32.572189+0000 mon.smithi008 (mon.0) 394 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2023-10-18T20:54:33.915 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:32.572865+0000 mon.smithi008 (mon.0) 395 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:33.915 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:32.578551+0000 mon.smithi008 (mon.0) 396 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:33.915 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:54:33.167765+0000 mgr.smithi008.flmjzp (mgr.14164) 150 : cephadm [INF] Detected new or changed devices on smithi060 2023-10-18T20:54:33.915 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:33.173620+0000 mon.smithi008 (mon.0) 397 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:33.915 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:33.177655+0000 mon.smithi008 (mon.0) 398 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:33.916 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:33.180940+0000 mon.smithi008 (mon.0) 399 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:33.916 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:33.573265+0000 mon.smithi008 (mon.0) 400 : cluster [INF] osd.4 [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500] boot 2023-10-18T20:54:33.916 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:33.573340+0000 mon.smithi008 (mon.0) 401 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2023-10-18T20:54:33.916 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:33.573520+0000 mon.smithi008 (mon.0) 402 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:32.572077+0000 mon.smithi008 (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-18T20:54:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:32.572189+0000 mon.smithi008 (mon.0) 394 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2023-10-18T20:54:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:32.572865+0000 mon.smithi008 (mon.0) 395 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:32.578551+0000 mon.smithi008 (mon.0) 396 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:54:33.167765+0000 mgr.smithi008.flmjzp (mgr.14164) 150 : cephadm [INF] Detected new or changed devices on smithi060 2023-10-18T20:54:33.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:33.173620+0000 mon.smithi008 (mon.0) 397 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:33.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:33.177655+0000 mon.smithi008 (mon.0) 398 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:33.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:33.180940+0000 mon.smithi008 (mon.0) 399 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:33.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:33.573265+0000 mon.smithi008 (mon.0) 400 : cluster [INF] osd.4 [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500] boot 2023-10-18T20:54:33.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:33.573340+0000 mon.smithi008 (mon.0) 401 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2023-10-18T20:54:33.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:33.573520+0000 mon.smithi008 (mon.0) 402 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:54:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:32.190221+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:54:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:32.190354+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:54:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:34.108671+0000 mgr.smithi008.flmjzp (mgr.14164) 151 : cluster [DBG] pgmap v116: 1 pgs: 1 activating; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:34.142669+0000 mon.smithi060 (mon.1) 10 : audit [INF] from='client.? 172.21.15.60:0/1345407060' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "077c57b2-d346-4723-acd2-348cc46831cd"}]: dispatch 2023-10-18T20:54:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:34.143146+0000 mon.smithi008 (mon.0) 403 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "077c57b2-d346-4723-acd2-348cc46831cd"}]: dispatch 2023-10-18T20:54:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:34.148143+0000 mon.smithi008 (mon.0) 404 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "077c57b2-d346-4723-acd2-348cc46831cd"}]': finished 2023-10-18T20:54:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:34.148230+0000 mon.smithi008 (mon.0) 405 : cluster [DBG] osdmap e32: 6 total, 5 up, 6 in 2023-10-18T20:54:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:34.148371+0000 mon.smithi008 (mon.0) 406 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:54:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:32.190221+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:54:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:32.190354+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:54:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:34.108671+0000 mgr.smithi008.flmjzp (mgr.14164) 151 : cluster [DBG] pgmap v116: 1 pgs: 1 activating; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:34.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:34.142669+0000 mon.smithi060 (mon.1) 10 : audit [INF] from='client.? 172.21.15.60:0/1345407060' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "077c57b2-d346-4723-acd2-348cc46831cd"}]: dispatch 2023-10-18T20:54:34.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:34.143146+0000 mon.smithi008 (mon.0) 403 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "077c57b2-d346-4723-acd2-348cc46831cd"}]: dispatch 2023-10-18T20:54:34.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:34.148143+0000 mon.smithi008 (mon.0) 404 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "077c57b2-d346-4723-acd2-348cc46831cd"}]': finished 2023-10-18T20:54:34.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:34.148230+0000 mon.smithi008 (mon.0) 405 : cluster [DBG] osdmap e32: 6 total, 5 up, 6 in 2023-10-18T20:54:34.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:34.148371+0000 mon.smithi008 (mon.0) 406 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:54:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:34.688357+0000 mon.smithi060 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.60:0/1881238918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:54:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:34.688357+0000 mon.smithi060 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.60:0/1881238918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T20:54:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:36.109103+0000 mgr.smithi008.flmjzp (mgr.14164) 152 : cluster [DBG] pgmap v118: 1 pgs: 1 activating; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:36.495988+0000 mon.smithi008 (mon.0) 407 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:36.499513+0000 mon.smithi008 (mon.0) 408 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:36.109103+0000 mgr.smithi008.flmjzp (mgr.14164) 152 : cluster [DBG] pgmap v118: 1 pgs: 1 activating; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:36.495988+0000 mon.smithi008 (mon.0) 407 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:36.499513+0000 mon.smithi008 (mon.0) 408 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:38.109569+0000 mgr.smithi008.flmjzp (mgr.14164) 153 : cluster [DBG] pgmap v119: 1 pgs: 1 activating; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:38.109569+0000 mgr.smithi008.flmjzp (mgr.14164) 153 : cluster [DBG] pgmap v119: 1 pgs: 1 activating; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:40.639 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:40.109047+0000 mon.smithi008 (mon.0) 409 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-18T20:54:40.639 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:40.110032+0000 mon.smithi008 (mon.0) 410 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:40.109047+0000 mon.smithi008 (mon.0) 409 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-18T20:54:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:40.110032+0000 mon.smithi008 (mon.0) 410 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:54:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:40.109915+0000 mgr.smithi008.flmjzp (mgr.14164) 154 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:54:40.110900+0000 mgr.smithi008.flmjzp (mgr.14164) 155 : cephadm [INF] Deploying daemon osd.5 on smithi060 2023-10-18T20:54:41.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:40.109915+0000 mgr.smithi008.flmjzp (mgr.14164) 154 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:41.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:54:40.110900+0000 mgr.smithi008.flmjzp (mgr.14164) 155 : cephadm [INF] Deploying daemon osd.5 on smithi060 2023-10-18T20:54:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:42.110307+0000 mgr.smithi008.flmjzp (mgr.14164) 156 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:42.110307+0000 mgr.smithi008.flmjzp (mgr.14164) 156 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:43.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.361+0000 7f54f9ffb700 1 -- 172.21.15.60:0/516378545 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f550410ad60 con 0x7f54f005c2f0 2023-10-18T20:54:43.365 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 5 on host 'smithi060' 2023-10-18T20:54:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.363+0000 7f550a50c700 1 -- 172.21.15.60:0/516378545 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54f005c2f0 msgr2=0x7f54f005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.363+0000 7f550a50c700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54f005c2f0 0x7f54f005e7b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5500005010 tx=0x7f5500009b30).stop 2023-10-18T20:54:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.363+0000 7f550a50c700 1 -- 172.21.15.60:0/516378545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55040f77d0 msgr2=0x7f5504109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.363+0000 7f550a50c700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55040f77d0 0x7f5504109490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f54f40026d0 tx=0x7f54f4009de0).stop 2023-10-18T20:54:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.363+0000 7f550a50c700 1 -- 172.21.15.60:0/516378545 shutdown_connections 2023-10-18T20:54:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.363+0000 7f550a50c700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55040f6530 0x7f5504108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.363+0000 7f550a50c700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54f005c2f0 0x7f54f005e7b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.363+0000 7f550a50c700 1 --2- 172.21.15.60:0/516378545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55040f77d0 0x7f5504109490 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.363+0000 7f550a50c700 1 -- 172.21.15.60:0/516378545 >> 172.21.15.60:0/516378545 conn(0x7f55040f1c90 msgr2=0x7f550406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.363+0000 7f550a50c700 1 -- 172.21.15.60:0/516378545 shutdown_connections 2023-10-18T20:54:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:43.364+0000 7f550a50c700 1 -- 172.21.15.60:0/516378545 wait complete. 2023-10-18T20:54:43.723 DEBUG:teuthology.orchestra.run.smithi060:osd.5> sudo journalctl -f -n 0 -u ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.5.service 2023-10-18T20:54:43.728 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-10-18T20:54:43.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-18T20:54:43.807 INFO:journalctl@ceph.osd.5.smithi060.stdout:-- Logs begin at Wed 2023-10-18 20:14:49 UTC. -- 2023-10-18T20:54:44.223 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 20:54:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.5[122249]: debug 2023-10-18T20:54:43.810+0000 7ff03d08b080 -1 Falling back to public interface 2023-10-18T20:54:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:43.350844+0000 mon.smithi008 (mon.0) 411 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:43.355753+0000 mon.smithi008 (mon.0) 412 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:44.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:43.361120+0000 mon.smithi008 (mon.0) 413 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:44.652 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:43.350844+0000 mon.smithi008 (mon.0) 411 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:44.652 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:43.355753+0000 mon.smithi008 (mon.0) 412 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:44.652 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:43.361120+0000 mon.smithi008 (mon.0) 413 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:45.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.328+0000 7fdeaf45b700 1 -- 172.21.15.8:0/3342213201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdea8060310 msgr2=0x7fdea80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:45.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.328+0000 7fdeaf45b700 1 --2- 172.21.15.8:0/3342213201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdea8060310 0x7fdea80f9110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fdea4004660 tx=0x7fdea4009b30).stop 2023-10-18T20:54:45.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.329+0000 7fdeaf45b700 1 -- 172.21.15.8:0/3342213201 shutdown_connections 2023-10-18T20:54:45.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.329+0000 7fdeaf45b700 1 --2- 172.21.15.8:0/3342213201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea80f9690 0x7fdea80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:45.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.329+0000 7fdeaf45b700 1 --2- 172.21.15.8:0/3342213201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdea8060310 0x7fdea80f9110 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:45.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.329+0000 7fdeaf45b700 1 -- 172.21.15.8:0/3342213201 >> 172.21.15.8:0/3342213201 conn(0x7fdea80f0b90 msgr2=0x7fdea80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:45.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.329+0000 7fdeaf45b700 1 -- 172.21.15.8:0/3342213201 shutdown_connections 2023-10-18T20:54:45.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.329+0000 7fdeaf45b700 1 -- 172.21.15.8:0/3342213201 wait complete. 2023-10-18T20:54:45.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.330+0000 7fdeaf45b700 1 Processor -- start 2023-10-18T20:54:45.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.330+0000 7fdeaf45b700 1 -- start start 2023-10-18T20:54:45.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.330+0000 7fdeaf45b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdea8060310 0x7fdea8106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:45.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.330+0000 7fdeaf45b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea80f9690 0x7fdea81072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:45.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.330+0000 7fdeaf45b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea81078a0 con 0x7fdea8060310 2023-10-18T20:54:45.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.330+0000 7fdeaf45b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea81080e0 con 0x7fdea80f9690 2023-10-18T20:54:45.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.330+0000 7fdeae459700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdea8060310 0x7fdea8106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:45.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.330+0000 7fdeae459700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdea8060310 0x7fdea8106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36762/0 (socket says 172.21.15.8:36762) 2023-10-18T20:54:45.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.331+0000 7fdeae459700 1 -- 172.21.15.8:0/541205647 learned_addr learned my addr 172.21.15.8:0/541205647 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:54:45.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.331+0000 7fdeadc58700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea80f9690 0x7fdea81072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:45.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.331+0000 7fdeae459700 1 -- 172.21.15.8:0/541205647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea80f9690 msgr2=0x7fdea81072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:45.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.331+0000 7fdeae459700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea80f9690 0x7fdea81072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:45.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.331+0000 7fdeae459700 1 -- 172.21.15.8:0/541205647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea4005040 con 0x7fdea8060310 2023-10-18T20:54:45.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.331+0000 7fdeae459700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdea8060310 0x7fdea8106db0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fdea4009990 tx=0x7fdea4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:45.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.331+0000 7fde9effd700 1 -- 172.21.15.8:0/541205647 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdea4018070 con 0x7fdea8060310 2023-10-18T20:54:45.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.331+0000 7fde9effd700 1 -- 172.21.15.8:0/541205647 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdea4013410 con 0x7fdea8060310 2023-10-18T20:54:45.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.331+0000 7fde9effd700 1 -- 172.21.15.8:0/541205647 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdea401c3c0 con 0x7fdea8060310 2023-10-18T20:54:45.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.331+0000 7fdeaf45b700 1 -- 172.21.15.8:0/541205647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea8108360 con 0x7fdea8060310 2023-10-18T20:54:45.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.332+0000 7fdeaf45b700 1 -- 172.21.15.8:0/541205647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea8108840 con 0x7fdea8060310 2023-10-18T20:54:45.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.333+0000 7fdeaf45b700 1 -- 172.21.15.8:0/541205647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea8059100 con 0x7fdea8060310 2023-10-18T20:54:45.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.334+0000 7fde9effd700 1 -- 172.21.15.8:0/541205647 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fdea401d420 con 0x7fdea8060310 2023-10-18T20:54:45.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.335+0000 7fde9effd700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fde9405c2f0 0x7fde9405e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:45.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.335+0000 7fde9effd700 1 -- 172.21.15.8:0/541205647 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4235+0+0 (secure 0 0 0) 0x7fdea4077830 con 0x7fdea8060310 2023-10-18T20:54:45.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.335+0000 7fdeadc58700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fde9405c2f0 0x7fde9405e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:45.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.336+0000 7fdeadc58700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fde9405c2f0 0x7fde9405e7b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fdea8106b40 tx=0x7fde9800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:45.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.340+0000 7fde9effd700 1 -- 172.21.15.8:0/541205647 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdea404a850 con 0x7fdea8060310 2023-10-18T20:54:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.530+0000 7fdeaf45b700 1 -- 172.21.15.8:0/541205647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fdea80fece0 con 0x7fdea8060310 2023-10-18T20:54:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.530+0000 7fde9effd700 1 -- 172.21.15.8:0/541205647 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v32) v1 ==== 74+0+130 (secure 0 0 0) 0x7fdea404de70 con 0x7fdea8060310 2023-10-18T20:54:45.532 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:54:45.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 -- 172.21.15.8:0/541205647 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fde9405c2f0 msgr2=0x7fde9405e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:45.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fde9405c2f0 0x7fde9405e7b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fdea8106b40 tx=0x7fde9800b040).stop 2023-10-18T20:54:45.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 -- 172.21.15.8:0/541205647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdea8060310 msgr2=0x7fdea8106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:45.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdea8060310 0x7fdea8106db0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fdea4009990 tx=0x7fdea4009b30).stop 2023-10-18T20:54:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 -- 172.21.15.8:0/541205647 shutdown_connections 2023-10-18T20:54:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdea8060310 0x7fdea8106db0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fde9405c2f0 0x7fde9405e7b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 --2- 172.21.15.8:0/541205647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea80f9690 0x7fdea81072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 -- 172.21.15.8:0/541205647 >> 172.21.15.8:0/541205647 conn(0x7fdea80f0b90 msgr2=0x7fdea80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 -- 172.21.15.8:0/541205647 shutdown_connections 2023-10-18T20:54:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:45.532+0000 7fdeaf45b700 1 -- 172.21.15.8:0/541205647 wait complete. 2023-10-18T20:54:45.636 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:44.110631+0000 mgr.smithi008.flmjzp (mgr.14164) 157 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:45.637 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:45.244113+0000 mon.smithi008 (mon.0) 414 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:45.650 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:44.110631+0000 mgr.smithi008.flmjzp (mgr.14164) 157 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:45.650 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:45.244113+0000 mon.smithi008 (mon.0) 414 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:46.032 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":32,"num_osds":6,"num_up_osds":5,"osd_up_since":1697662473,"num_in_osds":6,"osd_in_since":1697662474,"num_remapped_pgs":0} 2023-10-18T20:54:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:45.530887+0000 mon.smithi008 (mon.0) 415 : audit [DBG] from='client.? 172.21.15.8:0/541205647' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T20:54:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:45.530887+0000 mon.smithi008 (mon.0) 415 : audit [DBG] from='client.? 172.21.15.8:0/541205647' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T20:54:47.033 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-18T20:54:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:46.111092+0000 mgr.smithi008.flmjzp (mgr.14164) 158 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:47.174904+0000 mon.smithi008 (mon.0) 416 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:46.111092+0000 mgr.smithi008.flmjzp (mgr.14164) 158 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:47.174904+0000 mon.smithi008 (mon.0) 416 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:47.738 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 20:54:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.5[122249]: debug 2023-10-18T20:54:47.386+0000 7ff03d08b080 -1 osd.5 0 log_to_monitors {default=true} 2023-10-18T20:54:48.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.449+0000 7f2cebfff700 1 -- 172.21.15.8:0/1963230076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cec0f6530 msgr2=0x7f2cec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:48.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.449+0000 7f2cebfff700 1 --2- 172.21.15.8:0/1963230076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cec0f6530 0x7f2cec0f6950 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2cdc004660 tx=0x7f2cdc009b30).stop 2023-10-18T20:54:48.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.449+0000 7f2cebfff700 1 -- 172.21.15.8:0/1963230076 shutdown_connections 2023-10-18T20:54:48.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.449+0000 7f2cebfff700 1 --2- 172.21.15.8:0/1963230076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cec0f77d0 0x7f2cec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:48.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.449+0000 7f2cebfff700 1 --2- 172.21.15.8:0/1963230076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cec0f6530 0x7f2cec0f6950 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:48.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.449+0000 7f2cebfff700 1 -- 172.21.15.8:0/1963230076 >> 172.21.15.8:0/1963230076 conn(0x7f2cec0f1c90 msgr2=0x7f2cec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:48.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.449+0000 7f2cebfff700 1 -- 172.21.15.8:0/1963230076 shutdown_connections 2023-10-18T20:54:48.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.449+0000 7f2cebfff700 1 -- 172.21.15.8:0/1963230076 wait complete. 2023-10-18T20:54:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.450+0000 7f2cebfff700 1 Processor -- start 2023-10-18T20:54:48.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.450+0000 7f2cebfff700 1 -- start start 2023-10-18T20:54:48.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.451+0000 7f2cebfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cec0f6530 0x7f2cec108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:48.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.451+0000 7f2cebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cec0f77d0 0x7f2cec109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:48.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.451+0000 7f2cebfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1099e0 con 0x7f2cec0f6530 2023-10-18T20:54:48.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.451+0000 7f2cebfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec109b20 con 0x7f2cec0f77d0 2023-10-18T20:54:48.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.451+0000 7f2ceaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cec0f6530 0x7f2cec108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:48.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.451+0000 7f2ceaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cec0f6530 0x7f2cec108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59944/0 (socket says 172.21.15.8:59944) 2023-10-18T20:54:48.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.451+0000 7f2ceaffd700 1 -- 172.21.15.8:0/3308166484 learned_addr learned my addr 172.21.15.8:0/3308166484 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:54:48.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.451+0000 7f2cea7fc700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cec0f77d0 0x7f2cec109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:48.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.452+0000 7f2ceaffd700 1 -- 172.21.15.8:0/3308166484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cec0f77d0 msgr2=0x7f2cec109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:48.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.452+0000 7f2ceaffd700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cec0f77d0 0x7f2cec109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:48.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.452+0000 7f2ceaffd700 1 -- 172.21.15.8:0/3308166484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc005040 con 0x7f2cec0f6530 2023-10-18T20:54:48.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.452+0000 7f2ceaffd700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cec0f6530 0x7f2cec108f40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f2cdc000c00 tx=0x7f2cdc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:48.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.452+0000 7f2cd37fe700 1 -- 172.21.15.8:0/3308166484 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cdc019070 con 0x7f2cec0f6530 2023-10-18T20:54:48.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.452+0000 7f2cd37fe700 1 -- 172.21.15.8:0/3308166484 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2cdc007e70 con 0x7f2cec0f6530 2023-10-18T20:54:48.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.452+0000 7f2cebfff700 1 -- 172.21.15.8:0/3308166484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec10a460 con 0x7f2cec0f6530 2023-10-18T20:54:48.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.452+0000 7f2cd37fe700 1 -- 172.21.15.8:0/3308166484 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cdc014c90 con 0x7f2cec0f6530 2023-10-18T20:54:48.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.452+0000 7f2cebfff700 1 -- 172.21.15.8:0/3308166484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec10a9c0 con 0x7f2cec0f6530 2023-10-18T20:54:48.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.453+0000 7f2cebfff700 1 -- 172.21.15.8:0/3308166484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec045ad0 con 0x7f2cec0f6530 2023-10-18T20:54:48.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.454+0000 7f2cd37fe700 1 -- 172.21.15.8:0/3308166484 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2cdc025070 con 0x7f2cec0f6530 2023-10-18T20:54:48.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.455+0000 7f2cd37fe700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2cd405c2f0 0x7f2cd405e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:48.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.455+0000 7f2cd37fe700 1 -- 172.21.15.8:0/3308166484 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4256+0+0 (secure 0 0 0) 0x7f2cdc076a90 con 0x7f2cec0f6530 2023-10-18T20:54:48.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.455+0000 7f2cea7fc700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2cd405c2f0 0x7f2cd405e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:48.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.456+0000 7f2cea7fc700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2cd405c2f0 0x7f2cd405e7b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2ce0009fd0 tx=0x7f2ce000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:48.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.459+0000 7f2cd37fe700 1 -- 172.21.15.8:0/3308166484 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2cdc049b20 con 0x7f2cec0f6530 2023-10-18T20:54:48.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.626+0000 7f2cebfff700 1 -- 172.21.15.8:0/3308166484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f2cec027a00 con 0x7f2cec0f6530 2023-10-18T20:54:48.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.626+0000 7f2cd37fe700 1 -- 172.21.15.8:0/3308166484 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v33) v1 ==== 74+0+130 (secure 0 0 0) 0x7f2cdc04d140 con 0x7f2cec0f6530 2023-10-18T20:54:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:54:48.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 -- 172.21.15.8:0/3308166484 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2cd405c2f0 msgr2=0x7f2cd405e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:48.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2cd405c2f0 0x7f2cd405e7b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2ce0009fd0 tx=0x7f2ce000b040).stop 2023-10-18T20:54:48.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 -- 172.21.15.8:0/3308166484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cec0f6530 msgr2=0x7f2cec108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:48.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cec0f6530 0x7f2cec108f40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f2cdc000c00 tx=0x7f2cdc00b040).stop 2023-10-18T20:54:48.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 -- 172.21.15.8:0/3308166484 shutdown_connections 2023-10-18T20:54:48.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cec0f6530 0x7f2cec108f40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:48.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2cd405c2f0 0x7f2cd405e7b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:48.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 --2- 172.21.15.8:0/3308166484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cec0f77d0 0x7f2cec109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:48.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 -- 172.21.15.8:0/3308166484 >> 172.21.15.8:0/3308166484 conn(0x7f2cec0f1c90 msgr2=0x7f2cec06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:48.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 -- 172.21.15.8:0/3308166484 shutdown_connections 2023-10-18T20:54:48.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:48.628+0000 7f2cebfff700 1 -- 172.21.15.8:0/3308166484 wait complete. 2023-10-18T20:54:48.652 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:47.395371+0000 mon.smithi008 (mon.0) 417 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T20:54:48.653 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:48.111637+0000 mgr.smithi008.flmjzp (mgr.14164) 159 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:48.653 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:54:48.238168+0000 mgr.smithi008.flmjzp (mgr.14164) 160 : cephadm [INF] Detected new or changed devices on smithi060 2023-10-18T20:54:48.653 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:48.243591+0000 mon.smithi008 (mon.0) 418 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:47.395371+0000 mon.smithi008 (mon.0) 417 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T20:54:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:48.111637+0000 mgr.smithi008.flmjzp (mgr.14164) 159 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:54:48.238168+0000 mgr.smithi008.flmjzp (mgr.14164) 160 : cephadm [INF] Detected new or changed devices on smithi060 2023-10-18T20:54:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:48.243591+0000 mon.smithi008 (mon.0) 418 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:49.024 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":33,"num_osds":6,"num_up_osds":5,"osd_up_since":1697662473,"num_in_osds":6,"osd_in_since":1697662474,"num_remapped_pgs":0} 2023-10-18T20:54:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:48.365840+0000 mon.smithi008 (mon.0) 419 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-18T20:54:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:48.365904+0000 mon.smithi008 (mon.0) 420 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2023-10-18T20:54:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:48.366073+0000 mon.smithi008 (mon.0) 421 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:54:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:48.366508+0000 mon.smithi008 (mon.0) 422 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T20:54:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:48.628004+0000 mon.smithi008 (mon.0) 423 : audit [DBG] from='client.? 172.21.15.8:0/3308166484' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T20:54:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:48.650884+0000 mon.smithi008 (mon.0) 424 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:48.654233+0000 mon.smithi008 (mon.0) 425 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:48.659009+0000 mon.smithi008 (mon.0) 426 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:49.737 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 20:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.5[122249]: debug 2023-10-18T20:54:49.372+0000 7ff0335fc700 -1 osd.5 0 waiting for initial osdmap 2023-10-18T20:54:49.738 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 20:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.5[122249]: debug 2023-10-18T20:54:49.385+0000 7ff02ed76700 -1 osd.5 34 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-10-18T20:54:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:48.365840+0000 mon.smithi008 (mon.0) 419 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-18T20:54:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:48.365904+0000 mon.smithi008 (mon.0) 420 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2023-10-18T20:54:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:48.366073+0000 mon.smithi008 (mon.0) 421 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:54:49.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:48.366508+0000 mon.smithi008 (mon.0) 422 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T20:54:49.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:48.628004+0000 mon.smithi008 (mon.0) 423 : audit [DBG] from='client.? 172.21.15.8:0/3308166484' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T20:54:49.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:48.650884+0000 mon.smithi008 (mon.0) 424 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:49.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:48.654233+0000 mon.smithi008 (mon.0) 425 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:54:49.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:48.659009+0000 mon.smithi008 (mon.0) 426 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:54:50.025 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-18T20:54:50.629 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:49.368347+0000 mon.smithi008 (mon.0) 427 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-18T20:54:50.630 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:49.368413+0000 mon.smithi008 (mon.0) 428 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2023-10-18T20:54:50.630 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:49.368883+0000 mon.smithi008 (mon.0) 429 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:54:50.630 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:49.374317+0000 mon.smithi008 (mon.0) 430 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:54:50.630 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:50.111950+0000 mgr.smithi008.flmjzp (mgr.14164) 161 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:49.368347+0000 mon.smithi008 (mon.0) 427 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-18T20:54:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:49.368413+0000 mon.smithi008 (mon.0) 428 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2023-10-18T20:54:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:49.368883+0000 mon.smithi008 (mon.0) 429 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:54:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:49.374317+0000 mon.smithi008 (mon.0) 430 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:54:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:50.111950+0000 mgr.smithi008.flmjzp (mgr.14164) 161 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-10-18T20:54:51.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.386+0000 7efca7fff700 1 -- 172.21.15.8:0/3573111564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efca80f6530 msgr2=0x7efca80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:51.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.386+0000 7efca7fff700 1 --2- 172.21.15.8:0/3573111564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efca80f6530 0x7efca80f6950 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7efc98004660 tx=0x7efc98009b30).stop 2023-10-18T20:54:51.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.386+0000 7efca7fff700 1 -- 172.21.15.8:0/3573111564 shutdown_connections 2023-10-18T20:54:51.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.386+0000 7efca7fff700 1 --2- 172.21.15.8:0/3573111564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca80f77d0 0x7efca80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:51.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.386+0000 7efca7fff700 1 --2- 172.21.15.8:0/3573111564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efca80f6530 0x7efca80f6950 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:51.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.386+0000 7efca7fff700 1 -- 172.21.15.8:0/3573111564 >> 172.21.15.8:0/3573111564 conn(0x7efca80f1c90 msgr2=0x7efca80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:51.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.386+0000 7efca7fff700 1 -- 172.21.15.8:0/3573111564 shutdown_connections 2023-10-18T20:54:51.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.386+0000 7efca7fff700 1 -- 172.21.15.8:0/3573111564 wait complete. 2023-10-18T20:54:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.387+0000 7efca7fff700 1 Processor -- start 2023-10-18T20:54:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.387+0000 7efca7fff700 1 -- start start 2023-10-18T20:54:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.388+0000 7efca7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efca80f6530 0x7efca8108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.388+0000 7efca7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca80f77d0 0x7efca81094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.388+0000 7efca7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca8109a60 con 0x7efca80f6530 2023-10-18T20:54:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.388+0000 7efca7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca8109ba0 con 0x7efca80f77d0 2023-10-18T20:54:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.388+0000 7efca6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efca80f6530 0x7efca8108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.388+0000 7efca6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efca80f6530 0x7efca8108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59966/0 (socket says 172.21.15.8:59966) 2023-10-18T20:54:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.388+0000 7efca6ffd700 1 -- 172.21.15.8:0/2766395151 learned_addr learned my addr 172.21.15.8:0/2766395151 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:54:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.388+0000 7efca67fc700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca80f77d0 0x7efca81094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.388+0000 7efca6ffd700 1 -- 172.21.15.8:0/2766395151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca80f77d0 msgr2=0x7efca81094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.388+0000 7efca6ffd700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca80f77d0 0x7efca81094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.389+0000 7efca6ffd700 1 -- 172.21.15.8:0/2766395151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98005040 con 0x7efca80f6530 2023-10-18T20:54:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.389+0000 7efca6ffd700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efca80f6530 0x7efca8108fc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7efc98007a60 tx=0x7efc98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.389+0000 7efc8f7fe700 1 -- 172.21.15.8:0/2766395151 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc98018070 con 0x7efca80f6530 2023-10-18T20:54:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.389+0000 7efc8f7fe700 1 -- 172.21.15.8:0/2766395151 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efc98013410 con 0x7efca80f6530 2023-10-18T20:54:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.389+0000 7efca7fff700 1 -- 172.21.15.8:0/2766395151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca810a4e0 con 0x7efca80f6530 2023-10-18T20:54:51.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.389+0000 7efc8f7fe700 1 -- 172.21.15.8:0/2766395151 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc9801c3c0 con 0x7efca80f6530 2023-10-18T20:54:51.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.389+0000 7efca7fff700 1 -- 172.21.15.8:0/2766395151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca810aa40 con 0x7efca80f6530 2023-10-18T20:54:51.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.390+0000 7efc8d7fa700 1 -- 172.21.15.8:0/2766395151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8045ad0 con 0x7efca80f6530 2023-10-18T20:54:51.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.391+0000 7efc8f7fe700 1 -- 172.21.15.8:0/2766395151 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7efc9801d420 con 0x7efca80f6530 2023-10-18T20:54:51.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.392+0000 7efc8f7fe700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7efc9005c2f0 0x7efc9005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:51.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.392+0000 7efc8f7fe700 1 -- 172.21.15.8:0/2766395151 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7efc98077a40 con 0x7efca80f6530 2023-10-18T20:54:51.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.392+0000 7efca67fc700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7efc9005c2f0 0x7efc9005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:51.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.392+0000 7efca67fc700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7efc9005c2f0 0x7efc9005e7b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7efc9c004c40 tx=0x7efc9c00b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:51.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.396+0000 7efc8f7fe700 1 -- 172.21.15.8:0/2766395151 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7efc9804a980 con 0x7efca80f6530 2023-10-18T20:54:51.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.562+0000 7efc8d7fa700 1 -- 172.21.15.8:0/2766395151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7efca80fee40 con 0x7efca80f6530 2023-10-18T20:54:51.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.563+0000 7efc8f7fe700 1 -- 172.21.15.8:0/2766395151 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7efc9804dfa0 con 0x7efca80f6530 2023-10-18T20:54:51.566 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:54:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 -- 172.21.15.8:0/2766395151 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7efc9005c2f0 msgr2=0x7efc9005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7efc9005c2f0 0x7efc9005e7b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7efc9c004c40 tx=0x7efc9c00b040).stop 2023-10-18T20:54:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 -- 172.21.15.8:0/2766395151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efca80f6530 msgr2=0x7efca8108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efca80f6530 0x7efca8108fc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7efc98007a60 tx=0x7efc98009b30).stop 2023-10-18T20:54:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 -- 172.21.15.8:0/2766395151 shutdown_connections 2023-10-18T20:54:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efca80f6530 0x7efca8108fc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7efc9005c2f0 0x7efc9005e7b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 --2- 172.21.15.8:0/2766395151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca80f77d0 0x7efca81094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 -- 172.21.15.8:0/2766395151 >> 172.21.15.8:0/2766395151 conn(0x7efca80f1c90 msgr2=0x7efca80f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 -- 172.21.15.8:0/2766395151 shutdown_connections 2023-10-18T20:54:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:51.565+0000 7efc8d7fa700 1 -- 172.21.15.8:0/2766395151 wait complete. 2023-10-18T20:54:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:48.411609+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:54:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:48.411740+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:54:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:50.374712+0000 mon.smithi008 (mon.0) 431 : cluster [INF] osd.5 [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318] boot 2023-10-18T20:54:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:50.374754+0000 mon.smithi008 (mon.0) 432 : cluster [DBG] osdmap e35: 6 total, 6 up, 6 in 2023-10-18T20:54:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:50.375334+0000 mon.smithi008 (mon.0) 433 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:54:51.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:48.411609+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2023-10-18T20:54:51.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:48.411740+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2023-10-18T20:54:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:50.374712+0000 mon.smithi008 (mon.0) 431 : cluster [INF] osd.5 [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318] boot 2023-10-18T20:54:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:50.374754+0000 mon.smithi008 (mon.0) 432 : cluster [DBG] osdmap e35: 6 total, 6 up, 6 in 2023-10-18T20:54:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:50.375334+0000 mon.smithi008 (mon.0) 433 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:54:51.923 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"num_osds":6,"num_up_osds":6,"osd_up_since":1697662490,"num_in_osds":6,"osd_in_since":1697662474,"num_remapped_pgs":0} 2023-10-18T20:54:51.924 INFO:tasks.cephadm:Setting up client nodes... 2023-10-18T20:54:51.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-18T20:54:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:51.384378+0000 mon.smithi008 (mon.0) 434 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2023-10-18T20:54:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:51.564611+0000 mon.smithi008 (mon.0) 435 : audit [DBG] from='client.? 172.21.15.8:0/2766395151' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T20:54:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:52.112224+0000 mgr.smithi008.flmjzp (mgr.14164) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:54:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:51.384378+0000 mon.smithi008 (mon.0) 434 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2023-10-18T20:54:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:51.564611+0000 mon.smithi008 (mon.0) 435 : audit [DBG] from='client.? 172.21.15.8:0/2766395151' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T20:54:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:52.112224+0000 mgr.smithi008.flmjzp (mgr.14164) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:54:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.253+0000 7f3da538e700 1 -- 172.21.15.8:0/1696900789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3da00f6530 msgr2=0x7f3da00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.253+0000 7f3da538e700 1 --2- 172.21.15.8:0/1696900789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3da00f6530 0x7f3da00f6950 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f3d90004660 tx=0x7f3d90009b30).stop 2023-10-18T20:54:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.253+0000 7f3da538e700 1 -- 172.21.15.8:0/1696900789 shutdown_connections 2023-10-18T20:54:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.253+0000 7f3da538e700 1 --2- 172.21.15.8:0/1696900789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3da00f77d0 0x7f3da00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.253+0000 7f3da538e700 1 --2- 172.21.15.8:0/1696900789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3da00f6530 0x7f3da00f6950 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.253+0000 7f3da538e700 1 -- 172.21.15.8:0/1696900789 >> 172.21.15.8:0/1696900789 conn(0x7f3da00f1c90 msgr2=0x7f3da00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.253+0000 7f3da538e700 1 -- 172.21.15.8:0/1696900789 shutdown_connections 2023-10-18T20:54:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.253+0000 7f3da538e700 1 -- 172.21.15.8:0/1696900789 wait complete. 2023-10-18T20:54:53.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.254+0000 7f3da538e700 1 Processor -- start 2023-10-18T20:54:53.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.254+0000 7f3da538e700 1 -- start start 2023-10-18T20:54:53.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.255+0000 7f3da538e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3da00f6530 0x7f3da006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:53.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.255+0000 7f3da538e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3da00f77d0 0x7f3da0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:53.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.255+0000 7f3da538e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da006a380 con 0x7f3da00f6530 2023-10-18T20:54:53.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.255+0000 7f3da538e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da006a4c0 con 0x7f3da00f77d0 2023-10-18T20:54:53.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.255+0000 7f3d9ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3da00f6530 0x7f3da006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:53.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.255+0000 7f3d9ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3da00f6530 0x7f3da006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59984/0 (socket says 172.21.15.8:59984) 2023-10-18T20:54:53.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.255+0000 7f3d9ffff700 1 -- 172.21.15.8:0/1823853303 learned_addr learned my addr 172.21.15.8:0/1823853303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:54:53.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.255+0000 7f3d9f7fe700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3da00f77d0 0x7f3da0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:53.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.256+0000 7f3d9ffff700 1 -- 172.21.15.8:0/1823853303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3da00f77d0 msgr2=0x7f3da0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:53.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.256+0000 7f3d9ffff700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3da00f77d0 0x7f3da0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:53.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.256+0000 7f3d9ffff700 1 -- 172.21.15.8:0/1823853303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90005040 con 0x7f3da00f6530 2023-10-18T20:54:53.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.256+0000 7f3d9ffff700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3da00f6530 0x7f3da006b9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f3d90007a60 tx=0x7f3d90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:53.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.256+0000 7f3d9cff9700 1 -- 172.21.15.8:0/1823853303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d90018070 con 0x7f3da00f6530 2023-10-18T20:54:53.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.256+0000 7f3da538e700 1 -- 172.21.15.8:0/1823853303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da006a740 con 0x7f3da00f6530 2023-10-18T20:54:53.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.256+0000 7f3d9cff9700 1 -- 172.21.15.8:0/1823853303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d90013410 con 0x7f3da00f6530 2023-10-18T20:54:53.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.256+0000 7f3d9cff9700 1 -- 172.21.15.8:0/1823853303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d9001c3c0 con 0x7f3da00f6530 2023-10-18T20:54:53.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.256+0000 7f3da538e700 1 -- 172.21.15.8:0/1823853303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da006aca0 con 0x7f3da00f6530 2023-10-18T20:54:53.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.257+0000 7f3da538e700 1 -- 172.21.15.8:0/1823853303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da0045ad0 con 0x7f3da00f6530 2023-10-18T20:54:53.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.258+0000 7f3d9cff9700 1 -- 172.21.15.8:0/1823853303 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3d9001d420 con 0x7f3da00f6530 2023-10-18T20:54:53.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.259+0000 7f3d9cff9700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f3d8805c2f0 0x7f3d8805e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:53.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.259+0000 7f3d9cff9700 1 -- 172.21.15.8:0/1823853303 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f3d90077950 con 0x7f3da00f6530 2023-10-18T20:54:53.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.259+0000 7f3d9f7fe700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f3d8805c2f0 0x7f3d8805e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:53.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.259+0000 7f3d9f7fe700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f3d8805c2f0 0x7f3d8805e7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3d94004e20 tx=0x7f3d9400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:53.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.262+0000 7f3d9cff9700 1 -- 172.21.15.8:0/1823853303 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3d9004a910 con 0x7f3da00f6530 2023-10-18T20:54:53.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.487+0000 7f3da538e700 1 -- 172.21.15.8:0/1823853303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3da0027a00 con 0x7f3da00f6530 2023-10-18T20:54:53.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.491+0000 7f3d9cff9700 1 -- 172.21.15.8:0/1823853303 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3d9004df30 con 0x7f3da00f6530 2023-10-18T20:54:53.494 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-10-18T20:54:53.494 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQAdRjBl7CUsHRAAgYHoAALo6WKndl8fu2Rolg== 2023-10-18T20:54:53.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.493+0000 7f3da538e700 1 -- 172.21.15.8:0/1823853303 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f3d8805c2f0 msgr2=0x7f3d8805e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:53.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.493+0000 7f3da538e700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f3d8805c2f0 0x7f3d8805e7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3d94004e20 tx=0x7f3d9400b040).stop 2023-10-18T20:54:53.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.493+0000 7f3da538e700 1 -- 172.21.15.8:0/1823853303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3da00f6530 msgr2=0x7f3da006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:53.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.493+0000 7f3da538e700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3da00f6530 0x7f3da006b9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f3d90007a60 tx=0x7f3d90009b30).stop 2023-10-18T20:54:53.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.493+0000 7f3da538e700 1 -- 172.21.15.8:0/1823853303 shutdown_connections 2023-10-18T20:54:53.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.493+0000 7f3da538e700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3da00f6530 0x7f3da006b9a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:53.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.493+0000 7f3da538e700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f3d8805c2f0 0x7f3d8805e7b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:53.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.493+0000 7f3da538e700 1 --2- 172.21.15.8:0/1823853303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3da00f77d0 0x7f3da0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:53.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.493+0000 7f3da538e700 1 -- 172.21.15.8:0/1823853303 >> 172.21.15.8:0/1823853303 conn(0x7f3da00f1c90 msgr2=0x7f3da00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:53.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.494+0000 7f3da538e700 1 -- 172.21.15.8:0/1823853303 shutdown_connections 2023-10-18T20:54:53.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:53.494+0000 7f3da538e700 1 -- 172.21.15.8:0/1823853303 wait complete. 2023-10-18T20:54:53.916 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:54:53.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-18T20:54:53.917 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-18T20:54:54.019 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-18T20:54:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:53.489272+0000 mon.smithi008 (mon.0) 436 : audit [INF] from='client.? 172.21.15.8:0/1823853303' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-18T20:54:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:53.493064+0000 mon.smithi008 (mon.0) 437 : audit [INF] from='client.? 172.21.15.8:0/1823853303' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-18T20:54:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:53.489272+0000 mon.smithi008 (mon.0) 436 : audit [INF] from='client.? 172.21.15.8:0/1823853303' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-18T20:54:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:53.493064+0000 mon.smithi008 (mon.0) 437 : audit [INF] from='client.? 172.21.15.8:0/1823853303' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-18T20:54:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.485+0000 7f8851f02700 1 -- 172.21.15.60:0/2607307490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884c0602b0 msgr2=0x7f884c0f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.485+0000 7f8851f02700 1 --2- 172.21.15.60:0/2607307490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884c0602b0 0x7f884c0f9170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8840004660 tx=0x7f8840009b30).stop 2023-10-18T20:54:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.485+0000 7f8851f02700 1 -- 172.21.15.60:0/2607307490 shutdown_connections 2023-10-18T20:54:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.485+0000 7f8851f02700 1 --2- 172.21.15.60:0/2607307490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884c0f96f0 0x7f884c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.485+0000 7f8851f02700 1 --2- 172.21.15.60:0/2607307490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884c0602b0 0x7f884c0f9170 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.485+0000 7f8851f02700 1 -- 172.21.15.60:0/2607307490 >> 172.21.15.60:0/2607307490 conn(0x7f884c0f0b90 msgr2=0x7f884c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.485+0000 7f8851f02700 1 -- 172.21.15.60:0/2607307490 shutdown_connections 2023-10-18T20:54:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.486+0000 7f8851f02700 1 -- 172.21.15.60:0/2607307490 wait complete. 2023-10-18T20:54:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.487+0000 7f8851f02700 1 Processor -- start 2023-10-18T20:54:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.487+0000 7f8851f02700 1 -- start start 2023-10-18T20:54:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.487+0000 7f8851f02700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884c0602b0 0x7f884c106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.487+0000 7f8851f02700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884c0f96f0 0x7f884c1072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.487+0000 7f8851f02700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c1078b0 con 0x7f884c0602b0 2023-10-18T20:54:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.487+0000 7f8851f02700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c1080f0 con 0x7f884c0f96f0 2023-10-18T20:54:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.488+0000 7f884bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884c0f96f0 0x7f884c1072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.488+0000 7f884bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884c0f96f0 0x7f884c1072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49288/0 (socket says 172.21.15.60:49288) 2023-10-18T20:54:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.488+0000 7f884bfff700 1 -- 172.21.15.60:0/3193136725 learned_addr learned my addr 172.21.15.60:0/3193136725 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:54:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.488+0000 7f8850f00700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884c0602b0 0x7f884c106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.488+0000 7f884bfff700 1 -- 172.21.15.60:0/3193136725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884c0602b0 msgr2=0x7f884c106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.488+0000 7f884bfff700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884c0602b0 0x7f884c106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.488+0000 7f884bfff700 1 -- 172.21.15.60:0/3193136725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840005040 con 0x7f884c0f96f0 2023-10-18T20:54:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.488+0000 7f884bfff700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884c0f96f0 0x7f884c1072b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f883800c790 tx=0x7f8838007d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.489+0000 7f88497fa700 1 -- 172.21.15.60:0/3193136725 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8838013630 con 0x7f884c0f96f0 2023-10-18T20:54:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.489+0000 7f88497fa700 1 -- 172.21.15.60:0/3193136725 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8838013c40 con 0x7f884c0f96f0 2023-10-18T20:54:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.489+0000 7f8851f02700 1 -- 172.21.15.60:0/3193136725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c1083d0 con 0x7f884c0f96f0 2023-10-18T20:54:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.489+0000 7f88497fa700 1 -- 172.21.15.60:0/3193136725 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8838002b80 con 0x7f884c0f96f0 2023-10-18T20:54:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.489+0000 7f8851f02700 1 -- 172.21.15.60:0/3193136725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c108910 con 0x7f884c0f96f0 2023-10-18T20:54:55.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.490+0000 7f8851f02700 1 -- 172.21.15.60:0/3193136725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c059100 con 0x7f884c0f96f0 2023-10-18T20:54:55.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.491+0000 7f88497fa700 1 -- 172.21.15.60:0/3193136725 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f883801a060 con 0x7f884c0f96f0 2023-10-18T20:54:55.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.492+0000 7f88497fa700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f883c05c2f0 0x7f883c05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:55.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.492+0000 7f88497fa700 1 -- 172.21.15.60:0/3193136725 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f8838075dc0 con 0x7f884c0f96f0 2023-10-18T20:54:55.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.492+0000 7f8850f00700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f883c05c2f0 0x7f883c05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:55.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.493+0000 7f8850f00700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f883c05c2f0 0x7f883c05e7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8840004e30 tx=0x7f8840009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.496+0000 7f88497fa700 1 -- 172.21.15.60:0/3193136725 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8838079030 con 0x7f884c0f96f0 2023-10-18T20:54:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:54.112733+0000 mgr.smithi008.flmjzp (mgr.14164) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:54:55.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.719+0000 7f8851f02700 1 -- 172.21.15.60:0/3193136725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f884c027a00 con 0x7f884c0f96f0 2023-10-18T20:54:55.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.723+0000 7f88497fa700 1 -- 172.21.15.60:0/3193136725 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f8838048d00 con 0x7f884c0f96f0 2023-10-18T20:54:55.726 INFO:teuthology.orchestra.run.smithi060.stdout:[client.1] 2023-10-18T20:54:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAfRjBllUD4KhAAP8vAVNbzx1wmPGBh39Qzrw== 2023-10-18T20:54:55.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.725+0000 7f8851f02700 1 -- 172.21.15.60:0/3193136725 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f883c05c2f0 msgr2=0x7f883c05e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:55.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.725+0000 7f8851f02700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f883c05c2f0 0x7f883c05e7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8840004e30 tx=0x7f8840009b30).stop 2023-10-18T20:54:55.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.725+0000 7f8851f02700 1 -- 172.21.15.60:0/3193136725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884c0f96f0 msgr2=0x7f884c1072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:55.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.725+0000 7f8851f02700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884c0f96f0 0x7f884c1072b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f883800c790 tx=0x7f8838007d40).stop 2023-10-18T20:54:55.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.725+0000 7f8851f02700 1 -- 172.21.15.60:0/3193136725 shutdown_connections 2023-10-18T20:54:55.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.725+0000 7f8851f02700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f884c0602b0 0x7f884c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:55.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.725+0000 7f8851f02700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f883c05c2f0 0x7f883c05e7b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:55.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.725+0000 7f8851f02700 1 --2- 172.21.15.60:0/3193136725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884c0f96f0 0x7f884c1072b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:55.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.725+0000 7f8851f02700 1 -- 172.21.15.60:0/3193136725 >> 172.21.15.60:0/3193136725 conn(0x7f884c0f0b90 msgr2=0x7f884c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:55.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.726+0000 7f8851f02700 1 -- 172.21.15.60:0/3193136725 shutdown_connections 2023-10-18T20:54:55.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:54:55.726+0000 7f8851f02700 1 -- 172.21.15.60:0/3193136725 wait complete. 2023-10-18T20:54:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:54.112733+0000 mgr.smithi008.flmjzp (mgr.14164) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:54:56.092 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:54:56.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-10-18T20:54:56.093 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-18T20:54:56.194 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-18T20:54:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:54:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:55.720312+0000 mon.smithi060 (mon.1) 12 : audit [INF] from='client.? 172.21.15.60:0/3193136725' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-18T20:54:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:55.720737+0000 mon.smithi008 (mon.0) 438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-18T20:54:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:55.724606+0000 mon.smithi008 (mon.0) 439 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-18T20:54:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:55.720312+0000 mon.smithi060 (mon.1) 12 : audit [INF] from='client.? 172.21.15.60:0/3193136725' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-18T20:54:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:55.720737+0000 mon.smithi008 (mon.0) 438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-18T20:54:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:55.724606+0000 mon.smithi008 (mon.0) 439 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-18T20:54:57.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.611+0000 7f363587b700 1 -- 172.21.15.8:0/4137172065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36300f6620 msgr2=0x7f36300f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.611+0000 7f363587b700 1 --2- 172.21.15.8:0/4137172065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36300f6620 0x7f36300f6a40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3624004660 tx=0x7f3624009b30).stop 2023-10-18T20:54:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.611+0000 7f363587b700 1 -- 172.21.15.8:0/4137172065 shutdown_connections 2023-10-18T20:54:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.611+0000 7f363587b700 1 --2- 172.21.15.8:0/4137172065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300f78c0 0x7f36300f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.611+0000 7f363587b700 1 --2- 172.21.15.8:0/4137172065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36300f6620 0x7f36300f6a40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.611+0000 7f363587b700 1 -- 172.21.15.8:0/4137172065 >> 172.21.15.8:0/4137172065 conn(0x7f36300f1da0 msgr2=0x7f36300f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.611+0000 7f363587b700 1 -- 172.21.15.8:0/4137172065 shutdown_connections 2023-10-18T20:54:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.611+0000 7f363587b700 1 -- 172.21.15.8:0/4137172065 wait complete. 2023-10-18T20:54:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.612+0000 7f363587b700 1 Processor -- start 2023-10-18T20:54:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.612+0000 7f363587b700 1 -- start start 2023-10-18T20:54:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.612+0000 7f363587b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300f6620 0x7f3630109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.612+0000 7f363587b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36300f78c0 0x7f36301095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.612+0000 7f363587b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630109ba0 con 0x7f36300f78c0 2023-10-18T20:54:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.612+0000 7f363587b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630109ce0 con 0x7f36300f6620 2023-10-18T20:54:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.613+0000 7f362ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36300f78c0 0x7f36301095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.613+0000 7f362ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36300f78c0 0x7f36301095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33418/0 (socket says 172.21.15.8:33418) 2023-10-18T20:54:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.613+0000 7f362ffff700 1 -- 172.21.15.8:0/227146591 learned_addr learned my addr 172.21.15.8:0/227146591 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:54:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.613+0000 7f3634879700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300f6620 0x7f3630109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.613+0000 7f362ffff700 1 -- 172.21.15.8:0/227146591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300f6620 msgr2=0x7f3630109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.613+0000 7f362ffff700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300f6620 0x7f3630109100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.613+0000 7f362ffff700 1 -- 172.21.15.8:0/227146591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3624005040 con 0x7f36300f78c0 2023-10-18T20:54:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.613+0000 7f362ffff700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36300f78c0 0x7f36301095f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f361c0026d0 tx=0x7f361c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.614+0000 7f362d7fa700 1 -- 172.21.15.8:0/227146591 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361c0079c0 con 0x7f36300f78c0 2023-10-18T20:54:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.614+0000 7f362d7fa700 1 -- 172.21.15.8:0/227146591 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f361c00f040 con 0x7f36300f78c0 2023-10-18T20:54:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.614+0000 7f362d7fa700 1 -- 172.21.15.8:0/227146591 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361c0148b0 con 0x7f36300f78c0 2023-10-18T20:54:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.614+0000 7f363587b700 1 -- 172.21.15.8:0/227146591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363010a680 con 0x7f36300f78c0 2023-10-18T20:54:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.614+0000 7f363587b700 1 -- 172.21.15.8:0/227146591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363010ac40 con 0x7f36300f78c0 2023-10-18T20:54:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.615+0000 7f363587b700 1 -- 172.21.15.8:0/227146591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3630045ad0 con 0x7f36300f78c0 2023-10-18T20:54:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.616+0000 7f362d7fa700 1 -- 172.21.15.8:0/227146591 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f361c007b20 con 0x7f36300f78c0 2023-10-18T20:54:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.616+0000 7f362d7fa700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f362005c2b0 0x7f362005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.616+0000 7f362d7fa700 1 -- 172.21.15.8:0/227146591 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f361c075bc0 con 0x7f36300f78c0 2023-10-18T20:54:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.617+0000 7f3634879700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f362005c2b0 0x7f362005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.617+0000 7f3634879700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f362005c2b0 0x7f362005e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3624009f50 tx=0x7f3624009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.620+0000 7f362d7fa700 1 -- 172.21.15.8:0/227146591 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f361c048c30 con 0x7f36300f78c0 2023-10-18T20:54:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:56.113220+0000 mgr.smithi008.flmjzp (mgr.14164) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:54:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:56.113220+0000 mgr.smithi008.flmjzp (mgr.14164) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:54:57.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.788+0000 7f363587b700 1 -- 172.21.15.8:0/227146591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3630027a00 con 0x7f36300f78c0 2023-10-18T20:54:57.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.789+0000 7f362d7fa700 1 -- 172.21.15.8:0/227146591 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+10827 (secure 0 0 0) 0x7f361c04c250 con 0x7f36300f78c0 2023-10-18T20:54:57.792 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:54:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","created":"2023-10-18T20:50:24.656195+0000","modified":"2023-10-18T20:54:51.377118+0000","last_up_change":"2023-10-18T20:54:50.370279+0000","last_in_change":"2023-10-18T20:54:34.143950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T20:54:11.909803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"84acbfd0-21a5-4744-9fba-9b1ae8ac4018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6803","nonce":1892122968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6805","nonce":1892122968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6809","nonce":1892122968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6807","nonce":1892122968}]},"public_addr":"172.21.15.8:6803/1892122968","cluster_addr":"172.21.15.8:6805/1892122968","heartbeat_back_addr":"172.21.15.8:6809/1892122968","heartbeat_front_addr":"172.21.15.8:6807/1892122968","state":["exists","up"]},{"osd":1,"uuid":"40db6fdb-ab66-473c-b471-ae97389d8be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6811","nonce":3500777529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6813","nonce":3500777529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6817","nonce":3500777529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6815","nonce":3500777529}]},"public_addr":"172.21.15.8:6811/3500777529","cluster_addr":"172.21.15.8:6813/3500777529","heartbeat_back_addr":"172.21.15.8:6817/3500777529","heartbeat_front_addr":"172.21.15.8:6815/3500777529","state":["exists","up"]},{"osd":2,"uuid":"21ea78f3-f3ad-42dc-b034-a9e350635ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6819","nonce":3366082731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6821","nonce":3366082731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6825","nonce":3366082731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6823","nonce":3366082731}]},"public_addr":"172.21.15.8:6819/3366082731","cluster_addr":"172.21.15.8:6821/3366082731","heartbeat_back_addr":"172.21.15.8:6825/3366082731","heartbeat_front_addr":"172.21.15.8:6823/3366082731","state":["exists","up"]},{"osd":3,"uuid":"6c8b8dd3-cec0-4acb-a59d-bcdadf4097fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6801","nonce":233749194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6803","nonce":233749194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6807","nonce":233749194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6805","nonce":233749194}]},"public_addr":"172.21.15.60:6801/233749194","cluster_addr":"172.21.15.60:6803/233749194","heartbeat_back_addr":"172.21.15.60:6807/233749194","heartbeat_front_addr":"172.21.15.60:6805/233749194","state":["exists","up"]},{"osd":4,"uuid":"7469ba83-d780-4657-9add-610badaa3bd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6809","nonce":347739500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6811","nonce":347739500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6815","nonce":347739500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6813","nonce":347739500}]},"public_addr":"172.21.15.60:6809/347739500","cluster_addr":"172.21.15.60:6811/347739500","heartbeat_back_addr":"172.21.15.60:6815/347739500","heartbeat_front_addr":"172.21.15.60:6813/347739500","state":["exists","up"]},{"osd":5,"uuid":"077c57b2-d346-4723-acd2-348cc46831cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6817","nonce":2728123318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6819","nonce":2728123318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6823","nonce":2728123318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6821","nonce":2728123318}]},"public_addr":"172.21.15.60:6817/2728123318","cluster_addr":"172.21.15.60:6819/2728123318","heartbeat_back_addr":"172.21.15.60:6823/2728123318","heartbeat_front_addr":"172.21.15.60:6821/2728123318","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:53:22.262127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:53:42.140616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:00.948168+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:16.430237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:32.190357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:48.411743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2241689910":"2023-10-19T20:51:22.022313+0000","172.21.15.8:6801/2925059353":"2023-10-19T20:51:22.022313+0000","172.21.15.8:6800/2925059353":"2023-10-19T20:51:22.022313+0000","172.21.15.8:0/3058413829":"2023-10-19T20:51:22.022313+0000","172.21.15.8:0/1911408625":"2023-10-19T20:51:08.069160+0000","172.21.15.8:0/3762975299":"2023-10-19T20:51:08.069160+0000","172.21.15.8:6800/1016712461":"2023-10-19T20:51:08.069160+0000","172.21.15.8:0/1222439770":"2023-10-19T20:50:48.056136+0000","172.21.15.8:6801/4107557235":"2023-10-19T20:50:48.056136+0000","172.21.15.8:6801/1016712461":"2023-10-19T20:51:08.069160+0000","172.21.15.8:6800/4107557235":"2023-10-19T20:50:48.056136+0000","172.21.15.8:0/439064198":"2023-10-19T20:50:48.056136+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T20:54:57.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.791+0000 7f363587b700 1 -- 172.21.15.8:0/227146591 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f362005c2b0 msgr2=0x7f362005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:57.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.791+0000 7f363587b700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f362005c2b0 0x7f362005e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3624009f50 tx=0x7f3624009b30).stop 2023-10-18T20:54:57.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.791+0000 7f363587b700 1 -- 172.21.15.8:0/227146591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36300f78c0 msgr2=0x7f36301095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:57.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.791+0000 7f363587b700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36300f78c0 0x7f36301095f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f361c0026d0 tx=0x7f361c009de0).stop 2023-10-18T20:54:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.792+0000 7f363587b700 1 -- 172.21.15.8:0/227146591 shutdown_connections 2023-10-18T20:54:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.792+0000 7f363587b700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f362005c2b0 0x7f362005e770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.792+0000 7f363587b700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36300f6620 0x7f3630109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.792+0000 7f363587b700 1 --2- 172.21.15.8:0/227146591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36300f78c0 0x7f36301095f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:57.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.792+0000 7f363587b700 1 -- 172.21.15.8:0/227146591 >> 172.21.15.8:0/227146591 conn(0x7f36300f1da0 msgr2=0x7f363006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:57.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.792+0000 7f363587b700 1 -- 172.21.15.8:0/227146591 shutdown_connections 2023-10-18T20:54:57.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:57.792+0000 7f363587b700 1 -- 172.21.15.8:0/227146591 wait complete. 2023-10-18T20:54:58.164 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-18T20:54:11.909803+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2023-10-18T20:54:58.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd pool get device_health_metrics pg_num 2023-10-18T20:54:58.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:57.790613+0000 mon.smithi008 (mon.0) 440 : audit [DBG] from='client.? 172.21.15.8:0/227146591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T20:54:58.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:54:58.113554+0000 mgr.smithi008.flmjzp (mgr.14164) 165 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:54:58.529 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:54:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:57.790613+0000 mon.smithi008 (mon.0) 440 : audit [DBG] from='client.? 172.21.15.8:0/227146591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T20:54:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:54:58.113554+0000 mgr.smithi008.flmjzp (mgr.14164) 165 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:54:59.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.555+0000 7fc61943e700 1 -- 172.21.15.8:0/2874528157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6140f6620 msgr2=0x7fc6140f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:59.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.555+0000 7fc61943e700 1 --2- 172.21.15.8:0/2874528157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6140f6620 0x7fc6140f6a40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fc604004660 tx=0x7fc604009b30).stop 2023-10-18T20:54:59.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.555+0000 7fc61943e700 1 -- 172.21.15.8:0/2874528157 shutdown_connections 2023-10-18T20:54:59.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.555+0000 7fc61943e700 1 --2- 172.21.15.8:0/2874528157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6140f78c0 0x7fc6140f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:54:59.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.555+0000 7fc61943e700 1 --2- 172.21.15.8:0/2874528157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6140f6620 0x7fc6140f6a40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:59.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.555+0000 7fc61943e700 1 -- 172.21.15.8:0/2874528157 >> 172.21.15.8:0/2874528157 conn(0x7fc6140f1da0 msgr2=0x7fc6140f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:59.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.555+0000 7fc61943e700 1 -- 172.21.15.8:0/2874528157 shutdown_connections 2023-10-18T20:54:59.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.555+0000 7fc61943e700 1 -- 172.21.15.8:0/2874528157 wait complete. 2023-10-18T20:54:59.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.556+0000 7fc61943e700 1 Processor -- start 2023-10-18T20:54:59.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.556+0000 7fc61943e700 1 -- start start 2023-10-18T20:54:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.556+0000 7fc61943e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6140f6620 0x7fc614106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.556+0000 7fc61943e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6140f78c0 0x7fc614107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.556+0000 7fc61943e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc614107a40 con 0x7fc6140f78c0 2023-10-18T20:54:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.556+0000 7fc61943e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6141082f0 con 0x7fc6140f6620 2023-10-18T20:54:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc6137fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6140f78c0 0x7fc614107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc6137fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6140f78c0 0x7fc614107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33430/0 (socket says 172.21.15.8:33430) 2023-10-18T20:54:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc6137fe700 1 -- 172.21.15.8:0/4019618692 learned_addr learned my addr 172.21.15.8:0/4019618692 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:54:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc613fff700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6140f6620 0x7fc614106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc6137fe700 1 -- 172.21.15.8:0/4019618692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6140f6620 msgr2=0x7fc614106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc6137fe700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6140f6620 0x7fc614106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc6137fe700 1 -- 172.21.15.8:0/4019618692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604005040 con 0x7fc6140f78c0 2023-10-18T20:54:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc6137fe700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6140f78c0 0x7fc614107400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fc60800b410 tx=0x7fc608006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc610ff9700 1 -- 172.21.15.8:0/4019618692 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6080125f0 con 0x7fc6140f78c0 2023-10-18T20:54:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc610ff9700 1 -- 172.21.15.8:0/4019618692 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc60800be30 con 0x7fc6140f78c0 2023-10-18T20:54:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc610ff9700 1 -- 172.21.15.8:0/4019618692 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc608002a20 con 0x7fc6140f78c0 2023-10-18T20:54:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.557+0000 7fc61943e700 1 -- 172.21.15.8:0/4019618692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6141085d0 con 0x7fc6140f78c0 2023-10-18T20:54:59.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.558+0000 7fc61943e700 1 -- 172.21.15.8:0/4019618692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc614108b90 con 0x7fc6140f78c0 2023-10-18T20:54:59.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.559+0000 7fc61943e700 1 -- 172.21.15.8:0/4019618692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc614059100 con 0x7fc6140f78c0 2023-10-18T20:54:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.559+0000 7fc610ff9700 1 -- 172.21.15.8:0/4019618692 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc60800f030 con 0x7fc6140f78c0 2023-10-18T20:54:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.560+0000 7fc610ff9700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc5fc05c2a0 0x7fc5fc05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:54:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.560+0000 7fc610ff9700 1 -- 172.21.15.8:0/4019618692 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fc608075ff0 con 0x7fc6140f78c0 2023-10-18T20:54:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.560+0000 7fc613fff700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc5fc05c2a0 0x7fc5fc05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:54:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.561+0000 7fc613fff700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc5fc05c2a0 0x7fc5fc05e760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc604004e30 tx=0x7fc604009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:54:59.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.564+0000 7fc610ff9700 1 -- 172.21.15.8:0/4019618692 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc608048f50 con 0x7fc6140f78c0 2023-10-18T20:54:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.729+0000 7fc61943e700 1 -- 172.21.15.8:0/4019618692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc6140fef00 con 0x7fc6140f78c0 2023-10-18T20:54:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.730+0000 7fc610ff9700 1 -- 172.21.15.8:0/4019618692 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v36) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc60804c570 con 0x7fc6140f78c0 2023-10-18T20:54:59.733 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-18T20:54:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 -- 172.21.15.8:0/4019618692 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc5fc05c2a0 msgr2=0x7fc5fc05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc5fc05c2a0 0x7fc5fc05e760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc604004e30 tx=0x7fc604009b30).stop 2023-10-18T20:54:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 -- 172.21.15.8:0/4019618692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6140f78c0 msgr2=0x7fc614107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:54:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6140f78c0 0x7fc614107400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fc60800b410 tx=0x7fc608006ef0).stop 2023-10-18T20:54:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 -- 172.21.15.8:0/4019618692 shutdown_connections 2023-10-18T20:54:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc5fc05c2a0 0x7fc5fc05e760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6140f6620 0x7fc614106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 --2- 172.21.15.8:0/4019618692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6140f78c0 0x7fc614107400 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:54:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 -- 172.21.15.8:0/4019618692 >> 172.21.15.8:0/4019618692 conn(0x7fc6140f1da0 msgr2=0x7fc6140fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:54:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 -- 172.21.15.8:0/4019618692 shutdown_connections 2023-10-18T20:54:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:54:59.732+0000 7fc61943e700 1 -- 172.21.15.8:0/4019618692 wait complete. 2023-10-18T20:55:00.083 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:54:59.731499+0000 mon.smithi008 (mon.0) 441 : audit [DBG] from='client.? 172.21.15.8:0/4019618692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-10-18T20:55:00.111 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-18T20:55:00.112 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-18T20:55:00.112 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-18T20:55:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:54:59.731499+0000 mon.smithi008 (mon.0) 441 : audit [DBG] from='client.? 172.21.15.8:0/4019618692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-10-18T20:55:00.476 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:00.113821+0000 mgr.smithi008.flmjzp (mgr.14164) 166 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:00.113821+0000 mgr.smithi008.flmjzp (mgr.14164) 166 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.493+0000 7f2c6a8fd700 1 -- 172.21.15.8:0/3986942513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c640f6ee0 msgr2=0x7f2c640f7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.493+0000 7f2c6a8fd700 1 --2- 172.21.15.8:0/3986942513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c640f6ee0 0x7f2c640f7910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2c54004660 tx=0x7f2c54009b30).stop 2023-10-18T20:55:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.494+0000 7f2c6a8fd700 1 -- 172.21.15.8:0/3986942513 shutdown_connections 2023-10-18T20:55:01.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.494+0000 7f2c6a8fd700 1 --2- 172.21.15.8:0/3986942513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c640f6ee0 0x7f2c640f7910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:01.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.494+0000 7f2c6a8fd700 1 --2- 172.21.15.8:0/3986942513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c640f65d0 0x7f2c640f69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:01.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.494+0000 7f2c6a8fd700 1 -- 172.21.15.8:0/3986942513 >> 172.21.15.8:0/3986942513 conn(0x7f2c640f1dd0 msgr2=0x7f2c640f41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:01.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.494+0000 7f2c6a8fd700 1 -- 172.21.15.8:0/3986942513 shutdown_connections 2023-10-18T20:55:01.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.494+0000 7f2c6a8fd700 1 -- 172.21.15.8:0/3986942513 wait complete. 2023-10-18T20:55:01.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.494+0000 7f2c6a8fd700 1 Processor -- start 2023-10-18T20:55:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.495+0000 7f2c6a8fd700 1 -- start start 2023-10-18T20:55:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.495+0000 7f2c6a8fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c640f65d0 0x7f2c64108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.495+0000 7f2c6a8fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c640f6ee0 0x7f2c641094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.495+0000 7f2c6a8fd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c64109a60 con 0x7f2c640f6ee0 2023-10-18T20:55:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.495+0000 7f2c6a8fd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c64109ba0 con 0x7f2c640f65d0 2023-10-18T20:55:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.495+0000 7f2c690fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c640f6ee0 0x7f2c641094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:01.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.495+0000 7f2c690fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c640f6ee0 0x7f2c641094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33438/0 (socket says 172.21.15.8:33438) 2023-10-18T20:55:01.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.495+0000 7f2c690fa700 1 -- 172.21.15.8:0/1759225480 learned_addr learned my addr 172.21.15.8:0/1759225480 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:01.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.495+0000 7f2c698fb700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c640f65d0 0x7f2c64108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:01.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.496+0000 7f2c690fa700 1 -- 172.21.15.8:0/1759225480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c640f65d0 msgr2=0x7f2c64108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:01.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.496+0000 7f2c690fa700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c640f65d0 0x7f2c64108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:01.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.496+0000 7f2c690fa700 1 -- 172.21.15.8:0/1759225480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54005040 con 0x7f2c640f6ee0 2023-10-18T20:55:01.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.496+0000 7f2c690fa700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c640f6ee0 0x7f2c641094b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f2c54009990 tx=0x7f2c54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:01.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.496+0000 7f2c5a7fc700 1 -- 172.21.15.8:0/1759225480 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c54018070 con 0x7f2c640f6ee0 2023-10-18T20:55:01.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.496+0000 7f2c6a8fd700 1 -- 172.21.15.8:0/1759225480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6410a4e0 con 0x7f2c640f6ee0 2023-10-18T20:55:01.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.496+0000 7f2c5a7fc700 1 -- 172.21.15.8:0/1759225480 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2c54013410 con 0x7f2c640f6ee0 2023-10-18T20:55:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.496+0000 7f2c5a7fc700 1 -- 172.21.15.8:0/1759225480 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c5401c3c0 con 0x7f2c640f6ee0 2023-10-18T20:55:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.496+0000 7f2c6a8fd700 1 -- 172.21.15.8:0/1759225480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6410aa40 con 0x7f2c640f6ee0 2023-10-18T20:55:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.498+0000 7f2c47fff700 1 -- 172.21.15.8:0/1759225480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c40004fa0 con 0x7f2c640f6ee0 2023-10-18T20:55:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.498+0000 7f2c5a7fc700 1 -- 172.21.15.8:0/1759225480 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2c5401d420 con 0x7f2c640f6ee0 2023-10-18T20:55:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.499+0000 7f2c5a7fc700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2c5005c2f0 0x7f2c5005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.499+0000 7f2c5a7fc700 1 -- 172.21.15.8:0/1759225480 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f2c540778a0 con 0x7f2c640f6ee0 2023-10-18T20:55:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.499+0000 7f2c698fb700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2c5005c2f0 0x7f2c5005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.500+0000 7f2c698fb700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2c5005c2f0 0x7f2c5005e7b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2c60004ce0 tx=0x7f2c6000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.503+0000 7f2c5a7fc700 1 -- 172.21.15.8:0/1759225480 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2c5404a800 con 0x7f2c640f6ee0 2023-10-18T20:55:01.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.709+0000 7f2c47fff700 1 -- 172.21.15.8:0/1759225480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2c40005670 con 0x7f2c640f6ee0 2023-10-18T20:55:01.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.712+0000 7f2c5a7fc700 1 -- 172.21.15.8:0/1759225480 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+143495 (secure 0 0 0) 0x7f2c5404de20 con 0x7f2c640f6ee0 2023-10-18T20:55:01.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:01.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 -- 172.21.15.8:0/1759225480 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2c5005c2f0 msgr2=0x7f2c5005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2c5005c2f0 0x7f2c5005e7b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2c60004ce0 tx=0x7f2c6000b040).stop 2023-10-18T20:55:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 -- 172.21.15.8:0/1759225480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c640f6ee0 msgr2=0x7f2c641094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c640f6ee0 0x7f2c641094b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f2c54009990 tx=0x7f2c54009b30).stop 2023-10-18T20:55:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 -- 172.21.15.8:0/1759225480 shutdown_connections 2023-10-18T20:55:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f2c5005c2f0 0x7f2c5005e7b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c640f65d0 0x7f2c64108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:01.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 --2- 172.21.15.8:0/1759225480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c640f6ee0 0x7f2c641094b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:01.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 -- 172.21.15.8:0/1759225480 >> 172.21.15.8:0/1759225480 conn(0x7f2c640f1dd0 msgr2=0x7f2c6406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:01.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 -- 172.21.15.8:0/1759225480 shutdown_connections 2023-10-18T20:55:01.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:01.715+0000 7f2c47fff700 1 -- 172.21.15.8:0/1759225480 wait complete. 2023-10-18T20:55:02.049 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:01.711320+0000 mon.smithi008 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.8:0/1759225480' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-18T20:55:02.077 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":18,"active_gid":14164,"active_name":"smithi008.flmjzp","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":2622286163},{"type":"v1","addr":"172.21.15.8:6801","nonce":2622286163}]},"active_addr":"172.21.15.8:6801/2622286163","active_change":"2023-10-18T20:51:22.022748+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":14212,"name":"smithi060.pgqqwa","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi008.front.sepia.ceph.com:8443/","prometheus":"http://smithi008.front.sepia.ceph.com:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":4,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":3027382276}]},{"addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":3314183872}]}]}} 2023-10-18T20:55:02.081 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-18T20:55:02.081 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-18T20:55:02.082 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-18T20:55:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:01.711320+0000 mon.smithi008 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.8:0/1759225480' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-18T20:55:02.445 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:02.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:02.114052+0000 mgr.smithi008.flmjzp (mgr.14164) 167 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:02.114052+0000 mgr.smithi008.flmjzp (mgr.14164) 167 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:03.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.453+0000 7f6ef8974700 1 -- 172.21.15.8:0/2420736957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ef40f6620 msgr2=0x7f6ef40f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:03.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.453+0000 7f6ef8974700 1 --2- 172.21.15.8:0/2420736957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ef40f6620 0x7f6ef40f6a40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f6ee4004660 tx=0x7f6ee4009b30).stop 2023-10-18T20:55:03.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.453+0000 7f6ef8974700 1 -- 172.21.15.8:0/2420736957 shutdown_connections 2023-10-18T20:55:03.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.453+0000 7f6ef8974700 1 --2- 172.21.15.8:0/2420736957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ef40f78c0 0x7f6ef40f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:03.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.453+0000 7f6ef8974700 1 --2- 172.21.15.8:0/2420736957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ef40f6620 0x7f6ef40f6a40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:03.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.453+0000 7f6ef8974700 1 -- 172.21.15.8:0/2420736957 >> 172.21.15.8:0/2420736957 conn(0x7f6ef40f1da0 msgr2=0x7f6ef40f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:03.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.453+0000 7f6ef8974700 1 -- 172.21.15.8:0/2420736957 shutdown_connections 2023-10-18T20:55:03.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.453+0000 7f6ef8974700 1 -- 172.21.15.8:0/2420736957 wait complete. 2023-10-18T20:55:03.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.454+0000 7f6ef8974700 1 Processor -- start 2023-10-18T20:55:03.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.455+0000 7f6ef8974700 1 -- start start 2023-10-18T20:55:03.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.455+0000 7f6ef8974700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ef40f6620 0x7f6ef4106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:03.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.455+0000 7f6ef8974700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ef40f78c0 0x7f6ef4107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:03.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.455+0000 7f6ef8974700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef41079b0 con 0x7f6ef40f78c0 2023-10-18T20:55:03.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.455+0000 7f6ef8974700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef4107af0 con 0x7f6ef40f6620 2023-10-18T20:55:03.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.455+0000 7f6ef2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ef40f78c0 0x7f6ef4107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:03.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.455+0000 7f6ef37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ef40f6620 0x7f6ef4106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:03.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.455+0000 7f6ef2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ef40f78c0 0x7f6ef4107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33454/0 (socket says 172.21.15.8:33454) 2023-10-18T20:55:03.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.455+0000 7f6ef2ffd700 1 -- 172.21.15.8:0/641167157 learned_addr learned my addr 172.21.15.8:0/641167157 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:03.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.456+0000 7f6ef2ffd700 1 -- 172.21.15.8:0/641167157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ef40f6620 msgr2=0x7f6ef4106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:03.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.456+0000 7f6ef2ffd700 1 --2- 172.21.15.8:0/641167157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ef40f6620 0x7f6ef4106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:03.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.456+0000 7f6ef2ffd700 1 -- 172.21.15.8:0/641167157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee4005040 con 0x7f6ef40f78c0 2023-10-18T20:55:03.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.456+0000 7f6ef2ffd700 1 --2- 172.21.15.8:0/641167157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ef40f78c0 0x7f6ef4107400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f6ee80026d0 tx=0x7f6ee8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:03.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.456+0000 7f6edbfff700 1 -- 172.21.15.8:0/641167157 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee80079c0 con 0x7f6ef40f78c0 2023-10-18T20:55:03.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.456+0000 7f6edbfff700 1 -- 172.21.15.8:0/641167157 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ee800f040 con 0x7f6ef40f78c0 2023-10-18T20:55:03.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.456+0000 7f6edbfff700 1 -- 172.21.15.8:0/641167157 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee80148b0 con 0x7f6ef40f78c0 2023-10-18T20:55:03.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.456+0000 7f6ef8974700 1 -- 172.21.15.8:0/641167157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef4108490 con 0x7f6ef40f78c0 2023-10-18T20:55:03.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.456+0000 7f6ef8974700 1 -- 172.21.15.8:0/641167157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef4108a50 con 0x7f6ef40f78c0 2023-10-18T20:55:03.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.457+0000 7f6ef8974700 1 -- 172.21.15.8:0/641167157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef4045ad0 con 0x7f6ef40f78c0 2023-10-18T20:55:03.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.458+0000 7f6edbfff700 1 -- 172.21.15.8:0/641167157 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6ee8007b20 con 0x7f6ef40f78c0 2023-10-18T20:55:03.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.459+0000 7f6edbfff700 1 --2- 172.21.15.8:0/641167157 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6edc05c2b0 0x7f6edc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:03.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.459+0000 7f6edbfff700 1 -- 172.21.15.8:0/641167157 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f6ee8075b10 con 0x7f6ef40f78c0 2023-10-18T20:55:03.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.459+0000 7f6ef37fe700 1 --2- 172.21.15.8:0/641167157 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6edc05c2b0 0x7f6edc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:03.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.460+0000 7f6ef37fe700 1 --2- 172.21.15.8:0/641167157 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6edc05c2b0 0x7f6edc05e770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6ee4009f50 tx=0x7f6ee4009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:03.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.463+0000 7f6edbfff700 1 -- 172.21.15.8:0/641167157 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6ee8048ad0 con 0x7f6ef40f78c0 2023-10-18T20:55:03.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.631+0000 7f6ef8974700 1 -- 172.21.15.8:0/641167157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ef4027a00 con 0x7f6ef40f78c0 2023-10-18T20:55:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.632+0000 7f6edbfff700 1 -- 172.21.15.8:0/641167157 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+10827 (secure 0 0 0) 0x7f6ee804c0f0 con 0x7f6ef40f78c0 2023-10-18T20:55:03.635 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:03.635 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","created":"2023-10-18T20:50:24.656195+0000","modified":"2023-10-18T20:54:51.377118+0000","last_up_change":"2023-10-18T20:54:50.370279+0000","last_in_change":"2023-10-18T20:54:34.143950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T20:54:11.909803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"84acbfd0-21a5-4744-9fba-9b1ae8ac4018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6803","nonce":1892122968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6805","nonce":1892122968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6809","nonce":1892122968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6807","nonce":1892122968}]},"public_addr":"172.21.15.8:6803/1892122968","cluster_addr":"172.21.15.8:6805/1892122968","heartbeat_back_addr":"172.21.15.8:6809/1892122968","heartbeat_front_addr":"172.21.15.8:6807/1892122968","state":["exists","up"]},{"osd":1,"uuid":"40db6fdb-ab66-473c-b471-ae97389d8be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6811","nonce":3500777529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6813","nonce":3500777529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6817","nonce":3500777529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6815","nonce":3500777529}]},"public_addr":"172.21.15.8:6811/3500777529","cluster_addr":"172.21.15.8:6813/3500777529","heartbeat_back_addr":"172.21.15.8:6817/3500777529","heartbeat_front_addr":"172.21.15.8:6815/3500777529","state":["exists","up"]},{"osd":2,"uuid":"21ea78f3-f3ad-42dc-b034-a9e350635ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6819","nonce":3366082731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6821","nonce":3366082731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6825","nonce":3366082731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6823","nonce":3366082731}]},"public_addr":"172.21.15.8:6819/3366082731","cluster_addr":"172.21.15.8:6821/3366082731","heartbeat_back_addr":"172.21.15.8:6825/3366082731","heartbeat_front_addr":"172.21.15.8:6823/3366082731","state":["exists","up"]},{"osd":3,"uuid":"6c8b8dd3-cec0-4acb-a59d-bcdadf4097fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6801","nonce":233749194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6803","nonce":233749194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6807","nonce":233749194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6805","nonce":233749194}]},"public_addr":"172.21.15.60:6801/233749194","cluster_addr":"172.21.15.60:6803/233749194","heartbeat_back_addr":"172.21.15.60:6807/233749194","heartbeat_front_addr":"172.21.15.60:6805/233749194","state":["exists","up"]},{"osd":4,"uuid":"7469ba83-d780-4657-9add-610badaa3bd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6809","nonce":347739500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6811","nonce":347739500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6815","nonce":347739500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6813","nonce":347739500}]},"public_addr":"172.21.15.60:6809/347739500","cluster_addr":"172.21.15.60:6811/347739500","heartbeat_back_addr":"172.21.15.60:6815/347739500","heartbeat_front_addr":"172.21.15.60:6813/347739500","state":["exists","up"]},{"osd":5,"uuid":"077c57b2-d346-4723-acd2-348cc46831cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6817","nonce":2728123318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6819","nonce":2728123318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6823","nonce":2728123318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6821","nonce":2728123318}]},"public_addr":"172.21.15.60:6817/2728123318","cluster_addr":"172.21.15.60:6819/2728123318","heartbeat_back_addr":"172.21.15.60:6823/2728123318","heartbeat_front_addr":"172.21.15.60:6821/2728123318","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:53:22.262127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:53:42.140616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:00.948168+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:16.430237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:32.190357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:48.411743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2241689910":"2023-10-19T20:51:22.022313+0000","172.21.15.8:6801/2925059353":"2023-10-19T20:51:22.022313+0000","172.21.15.8:6800/2925059353":"2023-10-19T20:51:22.022313+0000","172.21.15.8:0/3058413829":"2023-10-19T20:51:22.022313+0000","172.21.15.8:0/1911408625":"2023-10-19T20:51:08.069160+0000","172.21.15.8:0/3762975299":"2023-10-19T20:51:08.069160+0000","172.21.15.8:6800/1016712461":"2023-10-19T20:51:08.069160+0000","172.21.15.8:0/1222439770":"2023-10-19T20:50:48.056136+0000","172.21.15.8:6801/4107557235":"2023-10-19T20:50:48.056136+0000","172.21.15.8:6801/1016712461":"2023-10-19T20:51:08.069160+0000","172.21.15.8:6800/4107557235":"2023-10-19T20:50:48.056136+0000","172.21.15.8:0/439064198":"2023-10-19T20:50:48.056136+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T20:55:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.633+0000 7f6ef8974700 1 -- 172.21.15.8:0/641167157 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6edc05c2b0 msgr2=0x7f6edc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.633+0000 7f6ef8974700 1 --2- 172.21.15.8:0/641167157 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6edc05c2b0 0x7f6edc05e770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6ee4009f50 tx=0x7f6ee4009b30).stop 2023-10-18T20:55:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.633+0000 7f6ef8974700 1 -- 172.21.15.8:0/641167157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ef40f78c0 msgr2=0x7f6ef4107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.633+0000 7f6ef8974700 1 --2- 172.21.15.8:0/641167157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ef40f78c0 0x7f6ef4107400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f6ee80026d0 tx=0x7f6ee8009de0).stop 2023-10-18T20:55:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.634+0000 7f6ef8974700 1 -- 172.21.15.8:0/641167157 shutdown_connections 2023-10-18T20:55:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.634+0000 7f6ef8974700 1 --2- 172.21.15.8:0/641167157 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6edc05c2b0 0x7f6edc05e770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.634+0000 7f6ef8974700 1 --2- 172.21.15.8:0/641167157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ef40f6620 0x7f6ef4106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:03.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.634+0000 7f6ef8974700 1 --2- 172.21.15.8:0/641167157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ef40f78c0 0x7f6ef4107400 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:03.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.634+0000 7f6ef8974700 1 -- 172.21.15.8:0/641167157 >> 172.21.15.8:0/641167157 conn(0x7f6ef40f1da0 msgr2=0x7f6ef40fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:03.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.634+0000 7f6ef8974700 1 -- 172.21.15.8:0/641167157 shutdown_connections 2023-10-18T20:55:03.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:03.634+0000 7f6ef8974700 1 -- 172.21.15.8:0/641167157 wait complete. 2023-10-18T20:55:04.014 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-18T20:55:04.015 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-18T20:55:04.380 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:04.653 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:03.632928+0000 mon.smithi008 (mon.0) 443 : audit [DBG] from='client.? 172.21.15.8:0/641167157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T20:55:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:03.632928+0000 mon.smithi008 (mon.0) 443 : audit [DBG] from='client.? 172.21.15.8:0/641167157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T20:55:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.401+0000 7f9366d3c700 1 -- 172.21.15.8:0/3785003591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93600f6620 msgr2=0x7f93600f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.401+0000 7f9366d3c700 1 --2- 172.21.15.8:0/3785003591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93600f6620 0x7f93600f6a40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f935c004660 tx=0x7f935c009b30).stop 2023-10-18T20:55:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.402+0000 7f9366d3c700 1 -- 172.21.15.8:0/3785003591 shutdown_connections 2023-10-18T20:55:05.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.402+0000 7f9366d3c700 1 --2- 172.21.15.8:0/3785003591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93600f78c0 0x7f93600f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:05.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.402+0000 7f9366d3c700 1 --2- 172.21.15.8:0/3785003591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93600f6620 0x7f93600f6a40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:05.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.402+0000 7f9366d3c700 1 -- 172.21.15.8:0/3785003591 >> 172.21.15.8:0/3785003591 conn(0x7f93600f1da0 msgr2=0x7f93600f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:05.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.402+0000 7f9366d3c700 1 -- 172.21.15.8:0/3785003591 shutdown_connections 2023-10-18T20:55:05.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.402+0000 7f9366d3c700 1 -- 172.21.15.8:0/3785003591 wait complete. 2023-10-18T20:55:05.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.403+0000 7f9366d3c700 1 Processor -- start 2023-10-18T20:55:05.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.403+0000 7f9366d3c700 1 -- start start 2023-10-18T20:55:05.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.403+0000 7f9366d3c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93600f6620 0x7f9360106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.403+0000 7f9366d3c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93600f78c0 0x7f9360107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.403+0000 7f9366d3c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93601079b0 con 0x7f93600f78c0 2023-10-18T20:55:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.403+0000 7f9366d3c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9360107af0 con 0x7f93600f6620 2023-10-18T20:55:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.403+0000 7f9365539700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93600f78c0 0x7f9360107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.403+0000 7f9365539700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93600f78c0 0x7f9360107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33472/0 (socket says 172.21.15.8:33472) 2023-10-18T20:55:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.403+0000 7f9365539700 1 -- 172.21.15.8:0/2809849775 learned_addr learned my addr 172.21.15.8:0/2809849775 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.404+0000 7f9365d3a700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93600f6620 0x7f9360106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.404+0000 7f9365539700 1 -- 172.21.15.8:0/2809849775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93600f6620 msgr2=0x7f9360106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.404+0000 7f9365539700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93600f6620 0x7f9360106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.404+0000 7f9365539700 1 -- 172.21.15.8:0/2809849775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c005040 con 0x7f93600f78c0 2023-10-18T20:55:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.404+0000 7f9365539700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93600f78c0 0x7f9360107400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f93500026d0 tx=0x7f9350009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.404+0000 7f93567fc700 1 -- 172.21.15.8:0/2809849775 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93500079c0 con 0x7f93600f78c0 2023-10-18T20:55:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.404+0000 7f93567fc700 1 -- 172.21.15.8:0/2809849775 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f935000f040 con 0x7f93600f78c0 2023-10-18T20:55:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.404+0000 7f9366d3c700 1 -- 172.21.15.8:0/2809849775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9360108490 con 0x7f93600f78c0 2023-10-18T20:55:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.404+0000 7f93567fc700 1 -- 172.21.15.8:0/2809849775 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93500148b0 con 0x7f93600f78c0 2023-10-18T20:55:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.404+0000 7f9366d3c700 1 -- 172.21.15.8:0/2809849775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9360108a50 con 0x7f93600f78c0 2023-10-18T20:55:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.406+0000 7f9366d3c700 1 -- 172.21.15.8:0/2809849775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9360045ad0 con 0x7f93600f78c0 2023-10-18T20:55:05.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.406+0000 7f93567fc700 1 -- 172.21.15.8:0/2809849775 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9350007b20 con 0x7f93600f78c0 2023-10-18T20:55:05.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.407+0000 7f93567fc700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f934c05c2b0 0x7f934c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:05.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.407+0000 7f93567fc700 1 -- 172.21.15.8:0/2809849775 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f9350075b00 con 0x7f93600f78c0 2023-10-18T20:55:05.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.407+0000 7f9365d3a700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f934c05c2b0 0x7f934c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:05.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.408+0000 7f9365d3a700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f934c05c2b0 0x7f934c05e770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f935c009f50 tx=0x7f935c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:05.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.411+0000 7f93567fc700 1 -- 172.21.15.8:0/2809849775 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9350048b00 con 0x7f93600f78c0 2023-10-18T20:55:05.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.577+0000 7f9366d3c700 1 -- 172.21.15.8:0/2809849775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9360027a00 con 0x7f93600f78c0 2023-10-18T20:55:05.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.578+0000 7f93567fc700 1 -- 172.21.15.8:0/2809849775 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+10827 (secure 0 0 0) 0x7f935004c120 con 0x7f93600f78c0 2023-10-18T20:55:05.581 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:05.581 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","created":"2023-10-18T20:50:24.656195+0000","modified":"2023-10-18T20:54:51.377118+0000","last_up_change":"2023-10-18T20:54:50.370279+0000","last_in_change":"2023-10-18T20:54:34.143950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T20:54:11.909803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"84acbfd0-21a5-4744-9fba-9b1ae8ac4018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6803","nonce":1892122968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6805","nonce":1892122968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6809","nonce":1892122968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6807","nonce":1892122968}]},"public_addr":"172.21.15.8:6803/1892122968","cluster_addr":"172.21.15.8:6805/1892122968","heartbeat_back_addr":"172.21.15.8:6809/1892122968","heartbeat_front_addr":"172.21.15.8:6807/1892122968","state":["exists","up"]},{"osd":1,"uuid":"40db6fdb-ab66-473c-b471-ae97389d8be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6811","nonce":3500777529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6813","nonce":3500777529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6817","nonce":3500777529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6815","nonce":3500777529}]},"public_addr":"172.21.15.8:6811/3500777529","cluster_addr":"172.21.15.8:6813/3500777529","heartbeat_back_addr":"172.21.15.8:6817/3500777529","heartbeat_front_addr":"172.21.15.8:6815/3500777529","state":["exists","up"]},{"osd":2,"uuid":"21ea78f3-f3ad-42dc-b034-a9e350635ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6819","nonce":3366082731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6821","nonce":3366082731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6825","nonce":3366082731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6823","nonce":3366082731}]},"public_addr":"172.21.15.8:6819/3366082731","cluster_addr":"172.21.15.8:6821/3366082731","heartbeat_back_addr":"172.21.15.8:6825/3366082731","heartbeat_front_addr":"172.21.15.8:6823/3366082731","state":["exists","up"]},{"osd":3,"uuid":"6c8b8dd3-cec0-4acb-a59d-bcdadf4097fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6801","nonce":233749194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6803","nonce":233749194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6807","nonce":233749194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6805","nonce":233749194}]},"public_addr":"172.21.15.60:6801/233749194","cluster_addr":"172.21.15.60:6803/233749194","heartbeat_back_addr":"172.21.15.60:6807/233749194","heartbeat_front_addr":"172.21.15.60:6805/233749194","state":["exists","up"]},{"osd":4,"uuid":"7469ba83-d780-4657-9add-610badaa3bd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6809","nonce":347739500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6811","nonce":347739500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6815","nonce":347739500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6813","nonce":347739500}]},"public_addr":"172.21.15.60:6809/347739500","cluster_addr":"172.21.15.60:6811/347739500","heartbeat_back_addr":"172.21.15.60:6815/347739500","heartbeat_front_addr":"172.21.15.60:6813/347739500","state":["exists","up"]},{"osd":5,"uuid":"077c57b2-d346-4723-acd2-348cc46831cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6817","nonce":2728123318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6819","nonce":2728123318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6823","nonce":2728123318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6821","nonce":2728123318}]},"public_addr":"172.21.15.60:6817/2728123318","cluster_addr":"172.21.15.60:6819/2728123318","heartbeat_back_addr":"172.21.15.60:6823/2728123318","heartbeat_front_addr":"172.21.15.60:6821/2728123318","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:53:22.262127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:53:42.140616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:00.948168+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:16.430237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:32.190357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:48.411743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2241689910":"2023-10-19T20:51:22.022313+0000","172.21.15.8:6801/2925059353":"2023-10-19T20:51:22.022313+0000","172.21.15.8:6800/2925059353":"2023-10-19T20:51:22.022313+0000","172.21.15.8:0/3058413829":"2023-10-19T20:51:22.022313+0000","172.21.15.8:0/1911408625":"2023-10-19T20:51:08.069160+0000","172.21.15.8:0/3762975299":"2023-10-19T20:51:08.069160+0000","172.21.15.8:6800/1016712461":"2023-10-19T20:51:08.069160+0000","172.21.15.8:0/1222439770":"2023-10-19T20:50:48.056136+0000","172.21.15.8:6801/4107557235":"2023-10-19T20:50:48.056136+0000","172.21.15.8:6801/1016712461":"2023-10-19T20:51:08.069160+0000","172.21.15.8:6800/4107557235":"2023-10-19T20:50:48.056136+0000","172.21.15.8:0/439064198":"2023-10-19T20:50:48.056136+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T20:55:05.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 -- 172.21.15.8:0/2809849775 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f934c05c2b0 msgr2=0x7f934c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:05.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f934c05c2b0 0x7f934c05e770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f935c009f50 tx=0x7f935c009b30).stop 2023-10-18T20:55:05.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 -- 172.21.15.8:0/2809849775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93600f78c0 msgr2=0x7f9360107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:05.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93600f78c0 0x7f9360107400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f93500026d0 tx=0x7f9350009de0).stop 2023-10-18T20:55:05.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 -- 172.21.15.8:0/2809849775 shutdown_connections 2023-10-18T20:55:05.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f934c05c2b0 0x7f934c05e770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:05.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93600f6620 0x7f9360106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:05.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 --2- 172.21.15.8:0/2809849775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93600f78c0 0x7f9360107400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:05.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 -- 172.21.15.8:0/2809849775 >> 172.21.15.8:0/2809849775 conn(0x7f93600f1da0 msgr2=0x7f93600fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:05.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 -- 172.21.15.8:0/2809849775 shutdown_connections 2023-10-18T20:55:05.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:05.580+0000 7f9366d3c700 1 -- 172.21.15.8:0/2809849775 wait complete. 2023-10-18T20:55:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:04.114319+0000 mgr.smithi008.flmjzp (mgr.14164) 168 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:04.114319+0000 mgr.smithi008.flmjzp (mgr.14164) 168 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:05.981 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-18T20:55:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:06.618 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:05.579478+0000 mon.smithi008 (mon.0) 444 : audit [DBG] from='client.? 172.21.15.8:0/2809849775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T20:55:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:05.579478+0000 mon.smithi008 (mon.0) 444 : audit [DBG] from='client.? 172.21.15.8:0/2809849775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T20:55:07.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.361+0000 7f4a7759e700 1 -- 172.21.15.8:0/3397253594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a780f78c0 msgr2=0x7f4a780f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:07.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.361+0000 7f4a7759e700 1 --2- 172.21.15.8:0/3397253594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a780f78c0 0x7f4a780f7d20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f4a6c004660 tx=0x7f4a6c009b30).stop 2023-10-18T20:55:07.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.361+0000 7f4a7759e700 1 -- 172.21.15.8:0/3397253594 shutdown_connections 2023-10-18T20:55:07.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.361+0000 7f4a7759e700 1 --2- 172.21.15.8:0/3397253594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a780f78c0 0x7f4a780f7d20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:07.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.361+0000 7f4a7759e700 1 --2- 172.21.15.8:0/3397253594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a780f6620 0x7f4a780f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:07.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.361+0000 7f4a7759e700 1 -- 172.21.15.8:0/3397253594 >> 172.21.15.8:0/3397253594 conn(0x7f4a780f1da0 msgr2=0x7f4a780f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:07.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.361+0000 7f4a7759e700 1 -- 172.21.15.8:0/3397253594 shutdown_connections 2023-10-18T20:55:07.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.361+0000 7f4a7759e700 1 -- 172.21.15.8:0/3397253594 wait complete. 2023-10-18T20:55:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.362+0000 7f4a7759e700 1 Processor -- start 2023-10-18T20:55:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.362+0000 7f4a7759e700 1 -- start start 2023-10-18T20:55:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.362+0000 7f4a7759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a780f6620 0x7f4a7806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.362+0000 7f4a7759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a780f78c0 0x7f4a78069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.362+0000 7f4a7759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7806a380 con 0x7f4a780f78c0 2023-10-18T20:55:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.362+0000 7f4a7759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7806a4c0 con 0x7f4a780f6620 2023-10-18T20:55:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.363+0000 7f4a75d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a780f78c0 0x7f4a78069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.363+0000 7f4a75d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a780f78c0 0x7f4a78069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48876/0 (socket says 172.21.15.8:48876) 2023-10-18T20:55:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.363+0000 7f4a75d9b700 1 -- 172.21.15.8:0/3114244956 learned_addr learned my addr 172.21.15.8:0/3114244956 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.363+0000 7f4a7659c700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a780f6620 0x7f4a7806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:07.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.363+0000 7f4a75d9b700 1 -- 172.21.15.8:0/3114244956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a780f6620 msgr2=0x7f4a7806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:07.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.363+0000 7f4a75d9b700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a780f6620 0x7f4a7806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:07.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.363+0000 7f4a75d9b700 1 -- 172.21.15.8:0/3114244956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c005040 con 0x7f4a780f78c0 2023-10-18T20:55:07.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.363+0000 7f4a75d9b700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a780f78c0 0x7f4a78069e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f4a6c000c00 tx=0x7f4a6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:07.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.365+0000 7f4a66ffd700 1 -- 172.21.15.8:0/3114244956 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a6c019070 con 0x7f4a780f78c0 2023-10-18T20:55:07.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.365+0000 7f4a66ffd700 1 -- 172.21.15.8:0/3114244956 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a6c007e70 con 0x7f4a780f78c0 2023-10-18T20:55:07.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.365+0000 7f4a66ffd700 1 -- 172.21.15.8:0/3114244956 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a6c014c90 con 0x7f4a780f78c0 2023-10-18T20:55:07.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.365+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7806a740 con 0x7f4a780f78c0 2023-10-18T20:55:07.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.366+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7806aca0 con 0x7f4a780f78c0 2023-10-18T20:55:07.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.366+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a7805db60 con 0x7f4a780f78c0 2023-10-18T20:55:07.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.367+0000 7f4a66ffd700 1 -- 172.21.15.8:0/3114244956 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4a6c025070 con 0x7f4a780f78c0 2023-10-18T20:55:07.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.368+0000 7f4a66ffd700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4a6005c2b0 0x7f4a6005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:07.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.368+0000 7f4a66ffd700 1 -- 172.21.15.8:0/3114244956 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f4a6c076ad0 con 0x7f4a780f78c0 2023-10-18T20:55:07.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.368+0000 7f4a7659c700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4a6005c2b0 0x7f4a6005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:07.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.369+0000 7f4a66ffd700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968] conn(0x7f4a60062040 0x7f4a600644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:07.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.369+0000 7f4a66ffd700 1 -- 172.21.15.8:0/3114244956 --> [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a60064b20 con 0x7f4a60062040 2023-10-18T20:55:07.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.369+0000 7f4a66ffd700 1 -- 172.21.15.8:0/3114244956 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a6c07b220 con 0x7f4a780f78c0 2023-10-18T20:55:07.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.369+0000 7f4a76d9d700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968] conn(0x7f4a60062040 0x7f4a600644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:07.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.369+0000 7f4a7659c700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4a6005c2b0 0x7f4a6005e770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f4a7806b730 tx=0x7f4a6800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:07.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.369+0000 7f4a76d9d700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968] conn(0x7f4a60062040 0x7f4a600644a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:07.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.370+0000 7f4a66ffd700 1 -- 172.21.15.8:0/3114244956 <== osd.0 v2:172.21.15.8:6802/1892122968 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f4a60064b20 con 0x7f4a60062040 2023-10-18T20:55:07.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.385+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 --> [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a78058150 con 0x7f4a60062040 2023-10-18T20:55:07.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a66ffd700 1 -- 172.21.15.8:0/3114244956 <== osd.0 v2:172.21.15.8:6802/1892122968 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4a78058150 con 0x7f4a60062040 2023-10-18T20:55:07.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968] conn(0x7f4a60062040 msgr2=0x7f4a600644a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:07.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968] conn(0x7f4a60062040 0x7f4a600644a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:07.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4a6005c2b0 msgr2=0x7f4a6005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:07.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4a6005c2b0 0x7f4a6005e770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f4a7806b730 tx=0x7f4a6800b040).stop 2023-10-18T20:55:07.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a780f78c0 msgr2=0x7f4a78069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:07.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a780f78c0 0x7f4a78069e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f4a6c000c00 tx=0x7f4a6c00b040).stop 2023-10-18T20:55:07.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 shutdown_connections 2023-10-18T20:55:07.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6802/1892122968,v1:172.21.15.8:6803/1892122968] conn(0x7f4a60062040 0x7f4a600644a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:07.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4a6005c2b0 0x7f4a6005e770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:07.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a780f6620 0x7f4a7806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 --2- 172.21.15.8:0/3114244956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a780f78c0 0x7f4a78069e20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 >> 172.21.15.8:0/3114244956 conn(0x7f4a780f1da0 msgr2=0x7f4a780fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.386+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 shutdown_connections 2023-10-18T20:55:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:07.387+0000 7f4a7759e700 1 -- 172.21.15.8:0/3114244956 wait complete. 2023-10-18T20:55:07.618 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:06.114621+0000 mgr.smithi008.flmjzp (mgr.14164) 169 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:06.114621+0000 mgr.smithi008.flmjzp (mgr.14164) 169 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:07.773 INFO:teuthology.orchestra.run.smithi008.stdout:38654705687 2023-10-18T20:55:07.773 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-18T20:55:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.191+0000 7f244da68700 1 -- 172.21.15.8:0/4099710966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24480f78c0 msgr2=0x7f24480f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.191+0000 7f244da68700 1 --2- 172.21.15.8:0/4099710966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24480f78c0 0x7f24480f7d20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f2434004660 tx=0x7f2434009b30).stop 2023-10-18T20:55:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.192+0000 7f244da68700 1 -- 172.21.15.8:0/4099710966 shutdown_connections 2023-10-18T20:55:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.192+0000 7f244da68700 1 --2- 172.21.15.8:0/4099710966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24480f78c0 0x7f24480f7d20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.192+0000 7f244da68700 1 --2- 172.21.15.8:0/4099710966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24480f6620 0x7f24480f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.192+0000 7f244da68700 1 -- 172.21.15.8:0/4099710966 >> 172.21.15.8:0/4099710966 conn(0x7f24480f1da0 msgr2=0x7f24480f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.192+0000 7f244da68700 1 -- 172.21.15.8:0/4099710966 shutdown_connections 2023-10-18T20:55:09.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.192+0000 7f244da68700 1 -- 172.21.15.8:0/4099710966 wait complete. 2023-10-18T20:55:09.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.193+0000 7f244da68700 1 Processor -- start 2023-10-18T20:55:09.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.193+0000 7f244da68700 1 -- start start 2023-10-18T20:55:09.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.193+0000 7f244da68700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24480f6620 0x7f2448106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:09.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.193+0000 7f244da68700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24480f78c0 0x7f24481073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:09.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.193+0000 7f244da68700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448107980 con 0x7f24480f78c0 2023-10-18T20:55:09.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.193+0000 7f244da68700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448107ac0 con 0x7f24480f6620 2023-10-18T20:55:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.193+0000 7f2447fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24480f78c0 0x7f24481073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.193+0000 7f2447fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24480f78c0 0x7f24481073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48900/0 (socket says 172.21.15.8:48900) 2023-10-18T20:55:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.193+0000 7f2447fff700 1 -- 172.21.15.8:0/2799625147 learned_addr learned my addr 172.21.15.8:0/2799625147 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f244ca66700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24480f6620 0x7f2448106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f2447fff700 1 -- 172.21.15.8:0/2799625147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24480f6620 msgr2=0x7f2448106ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f2447fff700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24480f6620 0x7f2448106ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f2447fff700 1 -- 172.21.15.8:0/2799625147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434005040 con 0x7f24480f78c0 2023-10-18T20:55:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f244ca66700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24480f6620 0x7f2448106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T20:55:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f2447fff700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24480f78c0 0x7f24481073d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f2434009990 tx=0x7f2434009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f24457fa700 1 -- 172.21.15.8:0/2799625147 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2434018070 con 0x7f24480f78c0 2023-10-18T20:55:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f24457fa700 1 -- 172.21.15.8:0/2799625147 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2434013410 con 0x7f24480f78c0 2023-10-18T20:55:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2448108400 con 0x7f24480f78c0 2023-10-18T20:55:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f24457fa700 1 -- 172.21.15.8:0/2799625147 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f243401c3c0 con 0x7f24480f78c0 2023-10-18T20:55:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.194+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2448108960 con 0x7f24480f78c0 2023-10-18T20:55:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.195+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f244805db60 con 0x7f24480f78c0 2023-10-18T20:55:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.196+0000 7f24457fa700 1 -- 172.21.15.8:0/2799625147 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f243401d420 con 0x7f24480f78c0 2023-10-18T20:55:09.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.197+0000 7f24457fa700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f243805c2a0 0x7f243805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:09.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.197+0000 7f24457fa700 1 -- 172.21.15.8:0/2799625147 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f24340779c0 con 0x7f24480f78c0 2023-10-18T20:55:09.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.197+0000 7f24457fa700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529] conn(0x7f2438062030 0x7f2438064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:09.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.197+0000 7f244ca66700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f243805c2a0 0x7f243805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:09.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.197+0000 7f24457fa700 1 -- 172.21.15.8:0/2799625147 --> [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2438064b10 con 0x7f2438062030 2023-10-18T20:55:09.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.197+0000 7f24457fa700 1 -- 172.21.15.8:0/2799625147 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f243407c220 con 0x7f24480f78c0 2023-10-18T20:55:09.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.197+0000 7f244d267700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529] conn(0x7f2438062030 0x7f2438064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:09.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.198+0000 7f244ca66700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f243805c2a0 0x7f243805e760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f24480f7720 tx=0x7f243c009c00).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:09.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.198+0000 7f244d267700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529] conn(0x7f2438062030 0x7f2438064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:09.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.199+0000 7f24457fa700 1 -- 172.21.15.8:0/2799625147 <== osd.1 v2:172.21.15.8:6810/3500777529 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2438064b10 con 0x7f2438062030 2023-10-18T20:55:09.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.214+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 --> [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2448108e80 con 0x7f2438062030 2023-10-18T20:55:09.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.214+0000 7f24457fa700 1 -- 172.21.15.8:0/2799625147 <== osd.1 v2:172.21.15.8:6810/3500777529 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2448108e80 con 0x7f2438062030 2023-10-18T20:55:09.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.214+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529] conn(0x7f2438062030 msgr2=0x7f2438064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:09.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.214+0000 7f244da68700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529] conn(0x7f2438062030 0x7f2438064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:09.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.214+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f243805c2a0 msgr2=0x7f243805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:09.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f243805c2a0 0x7f243805e760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f24480f7720 tx=0x7f243c009c00).stop 2023-10-18T20:55:09.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24480f78c0 msgr2=0x7f24481073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:09.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24480f78c0 0x7f24481073d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f2434009990 tx=0x7f2434009b30).stop 2023-10-18T20:55:09.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 shutdown_connections 2023-10-18T20:55:09.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6810/3500777529,v1:172.21.15.8:6811/3500777529] conn(0x7f2438062030 0x7f2438064490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:09.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f243805c2a0 0x7f243805e760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:09.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24480f6620 0x7f2448106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:09.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 --2- 172.21.15.8:0/2799625147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24480f78c0 0x7f24481073d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:09.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 >> 172.21.15.8:0/2799625147 conn(0x7f24480f1da0 msgr2=0x7f24480fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:09.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 shutdown_connections 2023-10-18T20:55:09.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:09.215+0000 7f244da68700 1 -- 172.21.15.8:0/2799625147 wait complete. 2023-10-18T20:55:09.540 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:08.114880+0000 mgr.smithi008.flmjzp (mgr.14164) 170 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:09.568 INFO:teuthology.orchestra.run.smithi008.stdout:60129542163 2023-10-18T20:55:09.568 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-18T20:55:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:08.114880+0000 mgr.smithi008.flmjzp (mgr.14164) 170 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:10.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.976+0000 7f6753fff700 1 -- 172.21.15.8:0/3317708536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67540f78c0 msgr2=0x7f67540f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:10.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.976+0000 7f6753fff700 1 --2- 172.21.15.8:0/3317708536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67540f78c0 0x7f67540f7d20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f6748004660 tx=0x7f6748009b30).stop 2023-10-18T20:55:10.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.976+0000 7f6753fff700 1 -- 172.21.15.8:0/3317708536 shutdown_connections 2023-10-18T20:55:10.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.976+0000 7f6753fff700 1 --2- 172.21.15.8:0/3317708536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67540f78c0 0x7f67540f7d20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:10.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.976+0000 7f6753fff700 1 --2- 172.21.15.8:0/3317708536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67540f6620 0x7f67540f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:10.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.976+0000 7f6753fff700 1 -- 172.21.15.8:0/3317708536 >> 172.21.15.8:0/3317708536 conn(0x7f67540f1da0 msgr2=0x7f67540f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:10.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.976+0000 7f6753fff700 1 -- 172.21.15.8:0/3317708536 shutdown_connections 2023-10-18T20:55:10.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.977+0000 7f6753fff700 1 -- 172.21.15.8:0/3317708536 wait complete. 2023-10-18T20:55:10.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.977+0000 7f6753fff700 1 Processor -- start 2023-10-18T20:55:10.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.977+0000 7f6753fff700 1 -- start start 2023-10-18T20:55:10.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f6753fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67540f6620 0x7f6754109070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:10.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f6753fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67540f78c0 0x7f6754109560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:10.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f6753fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6754109b10 con 0x7f67540f6620 2023-10-18T20:55:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f6753fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6754109c50 con 0x7f67540f78c0 2023-10-18T20:55:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f6752ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67540f6620 0x7f6754109070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f6752ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67540f6620 0x7f6754109070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48926/0 (socket says 172.21.15.8:48926) 2023-10-18T20:55:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f6752ffd700 1 -- 172.21.15.8:0/1147017643 learned_addr learned my addr 172.21.15.8:0/1147017643 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f67527fc700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67540f78c0 0x7f6754109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f6752ffd700 1 -- 172.21.15.8:0/1147017643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67540f78c0 msgr2=0x7f6754109560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f6752ffd700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67540f78c0 0x7f6754109560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f6752ffd700 1 -- 172.21.15.8:0/1147017643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748005040 con 0x7f67540f6620 2023-10-18T20:55:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.978+0000 7f67527fc700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67540f78c0 0x7f6754109560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T20:55:10.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.979+0000 7f6752ffd700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67540f6620 0x7f6754109070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f674400e7c0 tx=0x7f674400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:10.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.979+0000 7f673b7fe700 1 -- 172.21.15.8:0/1147017643 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67440092e0 con 0x7f67540f6620 2023-10-18T20:55:10.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.979+0000 7f673b7fe700 1 -- 172.21.15.8:0/1147017643 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f674400f040 con 0x7f67540f6620 2023-10-18T20:55:10.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.979+0000 7f673b7fe700 1 -- 172.21.15.8:0/1147017643 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6744014750 con 0x7f67540f6620 2023-10-18T20:55:10.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.979+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675410a5f0 con 0x7f67540f6620 2023-10-18T20:55:10.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.979+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675410abb0 con 0x7f67540f6620 2023-10-18T20:55:10.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.980+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f675405db60 con 0x7f67540f6620 2023-10-18T20:55:10.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.981+0000 7f673b7fe700 1 -- 172.21.15.8:0/1147017643 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f674401b030 con 0x7f67540f6620 2023-10-18T20:55:10.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.982+0000 7f673b7fe700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f673c05c2b0 0x7f673c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:10.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.982+0000 7f673b7fe700 1 -- 172.21.15.8:0/1147017643 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f6744075c40 con 0x7f67540f6620 2023-10-18T20:55:10.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.982+0000 7f67527fc700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f673c05c2b0 0x7f673c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:10.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.982+0000 7f673b7fe700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731] conn(0x7f673c062040 0x7f673c0644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:10.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.982+0000 7f673b7fe700 1 -- 172.21.15.8:0/1147017643 --> [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f673c064b20 con 0x7f673c062040 2023-10-18T20:55:10.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.982+0000 7f673b7fe700 1 -- 172.21.15.8:0/1147017643 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67440781f0 con 0x7f67540f6620 2023-10-18T20:55:10.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.982+0000 7f67537fe700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731] conn(0x7f673c062040 0x7f673c0644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:10.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.982+0000 7f67527fc700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f673c05c2b0 0x7f673c05e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f6748005010 tx=0x7f674800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:10.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.983+0000 7f67537fe700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731] conn(0x7f673c062040 0x7f673c0644a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:10.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.984+0000 7f673b7fe700 1 -- 172.21.15.8:0/1147017643 <== osd.2 v2:172.21.15.8:6818/3366082731 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f673c064b20 con 0x7f673c062040 2023-10-18T20:55:11.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.999+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 --> [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f675410b0e0 con 0x7f673c062040 2023-10-18T20:55:11.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.999+0000 7f673b7fe700 1 -- 172.21.15.8:0/1147017643 <== osd.2 v2:172.21.15.8:6818/3366082731 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f675410b0e0 con 0x7f673c062040 2023-10-18T20:55:11.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.999+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731] conn(0x7f673c062040 msgr2=0x7f673c0644a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:11.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.999+0000 7f6753fff700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731] conn(0x7f673c062040 0x7f673c0644a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:11.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.999+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f673c05c2b0 msgr2=0x7f673c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:11.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.999+0000 7f6753fff700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f673c05c2b0 0x7f673c05e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f6748005010 tx=0x7f674800b040).stop 2023-10-18T20:55:11.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.999+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67540f6620 msgr2=0x7f6754109070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:10.999+0000 7f6753fff700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67540f6620 0x7f6754109070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f674400e7c0 tx=0x7f674400b040).stop 2023-10-18T20:55:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:11.000+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 shutdown_connections 2023-10-18T20:55:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:11.000+0000 7f6753fff700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67540f6620 0x7f6754109070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:11.000+0000 7f6753fff700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6818/3366082731,v1:172.21.15.8:6819/3366082731] conn(0x7f673c062040 0x7f673c0644a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:11.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:11.000+0000 7f6753fff700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f673c05c2b0 0x7f673c05e770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:11.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:11.000+0000 7f6753fff700 1 --2- 172.21.15.8:0/1147017643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67540f78c0 0x7f6754109560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:11.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:11.000+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 >> 172.21.15.8:0/1147017643 conn(0x7f67540f1da0 msgr2=0x7f675406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:11.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:11.000+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 shutdown_connections 2023-10-18T20:55:11.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:11.000+0000 7f6753fff700 1 -- 172.21.15.8:0/1147017643 wait complete. 2023-10-18T20:55:11.358 INFO:teuthology.orchestra.run.smithi008.stdout:81604378639 2023-10-18T20:55:11.359 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-18T20:55:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:10.115133+0000 mgr.smithi008.flmjzp (mgr.14164) 171 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:11.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:10.115133+0000 mgr.smithi008.flmjzp (mgr.14164) 171 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:12.553 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:12.115373+0000 mgr.smithi008.flmjzp (mgr.14164) 172 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:12.115373+0000 mgr.smithi008.flmjzp (mgr.14164) 172 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.768+0000 7fc13dab6700 1 -- 172.21.15.8:0/1979332310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1380f78c0 msgr2=0x7fc1380f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.768+0000 7fc13dab6700 1 --2- 172.21.15.8:0/1979332310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1380f78c0 0x7fc1380f7d20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fc124004660 tx=0x7fc124009b30).stop 2023-10-18T20:55:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.768+0000 7fc13dab6700 1 -- 172.21.15.8:0/1979332310 shutdown_connections 2023-10-18T20:55:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.768+0000 7fc13dab6700 1 --2- 172.21.15.8:0/1979332310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1380f78c0 0x7fc1380f7d20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.768+0000 7fc13dab6700 1 --2- 172.21.15.8:0/1979332310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1380f6620 0x7fc1380f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.768+0000 7fc13dab6700 1 -- 172.21.15.8:0/1979332310 >> 172.21.15.8:0/1979332310 conn(0x7fc1380f1da0 msgr2=0x7fc1380f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.768+0000 7fc13dab6700 1 -- 172.21.15.8:0/1979332310 shutdown_connections 2023-10-18T20:55:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.768+0000 7fc13dab6700 1 -- 172.21.15.8:0/1979332310 wait complete. 2023-10-18T20:55:12.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.769+0000 7fc13dab6700 1 Processor -- start 2023-10-18T20:55:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.769+0000 7fc13dab6700 1 -- start start 2023-10-18T20:55:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc13dab6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1380f6620 0x7fc138106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc13dab6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1380f78c0 0x7fc1381073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc13dab6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc138107980 con 0x7fc1380f78c0 2023-10-18T20:55:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc13dab6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc138107ac0 con 0x7fc1380f6620 2023-10-18T20:55:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc137fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1380f78c0 0x7fc1381073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc137fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1380f78c0 0x7fc1381073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48944/0 (socket says 172.21.15.8:48944) 2023-10-18T20:55:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc137fff700 1 -- 172.21.15.8:0/3353882894 learned_addr learned my addr 172.21.15.8:0/3353882894 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc13cab4700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1380f6620 0x7fc138106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc137fff700 1 -- 172.21.15.8:0/3353882894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1380f6620 msgr2=0x7fc138106ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc137fff700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1380f6620 0x7fc138106ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.770+0000 7fc137fff700 1 -- 172.21.15.8:0/3353882894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc124005040 con 0x7fc1380f78c0 2023-10-18T20:55:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.771+0000 7fc137fff700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1380f78c0 0x7fc1381073d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fc124009f50 tx=0x7fc124009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.771+0000 7fc1357fa700 1 -- 172.21.15.8:0/3353882894 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc124018070 con 0x7fc1380f78c0 2023-10-18T20:55:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.771+0000 7fc1357fa700 1 -- 172.21.15.8:0/3353882894 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc124013410 con 0x7fc1380f78c0 2023-10-18T20:55:12.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.771+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc138108400 con 0x7fc1380f78c0 2023-10-18T20:55:12.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.771+0000 7fc1357fa700 1 -- 172.21.15.8:0/3353882894 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc12401c3c0 con 0x7fc1380f78c0 2023-10-18T20:55:12.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.771+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc138108960 con 0x7fc1380f78c0 2023-10-18T20:55:12.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.772+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc13805db60 con 0x7fc1380f78c0 2023-10-18T20:55:12.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.773+0000 7fc1357fa700 1 -- 172.21.15.8:0/3353882894 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc12401d420 con 0x7fc1380f78c0 2023-10-18T20:55:12.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.774+0000 7fc1357fa700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc12805c2b0 0x7fc12805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:12.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.774+0000 7fc1357fa700 1 -- 172.21.15.8:0/3353882894 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fc124077920 con 0x7fc1380f78c0 2023-10-18T20:55:12.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.774+0000 7fc13cab4700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc12805c2b0 0x7fc12805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:12.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.774+0000 7fc1357fa700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194] conn(0x7fc128062040 0x7fc1280644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:12.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.774+0000 7fc1357fa700 1 -- 172.21.15.8:0/3353882894 --> [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc128064b20 con 0x7fc128062040 2023-10-18T20:55:12.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.774+0000 7fc1357fa700 1 -- 172.21.15.8:0/3353882894 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc12407c220 con 0x7fc1380f78c0 2023-10-18T20:55:12.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.774+0000 7fc13d2b5700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194] conn(0x7fc128062040 0x7fc1280644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:12.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.774+0000 7fc13cab4700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc12805c2b0 0x7fc12805e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc1380f7720 tx=0x7fc12c009c00).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:12.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.775+0000 7fc13d2b5700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194] conn(0x7fc128062040 0x7fc1280644a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:12.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.776+0000 7fc1357fa700 1 -- 172.21.15.8:0/3353882894 <== osd.3 v2:172.21.15.60:6800/233749194 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fc128064b20 con 0x7fc128062040 2023-10-18T20:55:12.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.791+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 --> [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc138108dc0 con 0x7fc128062040 2023-10-18T20:55:12.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc1357fa700 1 -- 172.21.15.8:0/3353882894 <== osd.3 v2:172.21.15.60:6800/233749194 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc138108dc0 con 0x7fc128062040 2023-10-18T20:55:12.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 >> [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194] conn(0x7fc128062040 msgr2=0x7fc1280644a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:12.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194] conn(0x7fc128062040 0x7fc1280644a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:12.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc12805c2b0 msgr2=0x7fc12805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:12.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc12805c2b0 0x7fc12805e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc1380f7720 tx=0x7fc12c009c00).stop 2023-10-18T20:55:12.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1380f78c0 msgr2=0x7fc1381073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:12.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1380f78c0 0x7fc1381073d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fc124009f50 tx=0x7fc124009b30).stop 2023-10-18T20:55:12.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 shutdown_connections 2023-10-18T20:55:12.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.60:6800/233749194,v1:172.21.15.60:6801/233749194] conn(0x7fc128062040 0x7fc1280644a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:12.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc12805c2b0 0x7fc12805e770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:12.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1380f6620 0x7fc138106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:12.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 --2- 172.21.15.8:0/3353882894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1380f78c0 0x7fc1381073d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:12.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 >> 172.21.15.8:0/3353882894 conn(0x7fc1380f1da0 msgr2=0x7fc1380fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:12.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.792+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 shutdown_connections 2023-10-18T20:55:12.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:12.793+0000 7fc13dab6700 1 -- 172.21.15.8:0/3353882894 wait complete. 2023-10-18T20:55:13.168 INFO:teuthology.orchestra.run.smithi008.stdout:111669149708 2023-10-18T20:55:13.168 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-18T20:55:13.532 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.510+0000 7f28bb59e700 1 -- 172.21.15.8:0/686249126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28bc0f6620 msgr2=0x7f28bc0f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.510+0000 7f28bb59e700 1 --2- 172.21.15.8:0/686249126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28bc0f6620 0x7f28bc0f6a40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f28ac004660 tx=0x7f28ac009b30).stop 2023-10-18T20:55:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.510+0000 7f28bb59e700 1 -- 172.21.15.8:0/686249126 shutdown_connections 2023-10-18T20:55:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.510+0000 7f28bb59e700 1 --2- 172.21.15.8:0/686249126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28bc0f78c0 0x7f28bc0f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.510+0000 7f28bb59e700 1 --2- 172.21.15.8:0/686249126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28bc0f6620 0x7f28bc0f6a40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.510+0000 7f28bb59e700 1 -- 172.21.15.8:0/686249126 >> 172.21.15.8:0/686249126 conn(0x7f28bc0f1da0 msgr2=0x7f28bc0f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.510+0000 7f28bb59e700 1 -- 172.21.15.8:0/686249126 shutdown_connections 2023-10-18T20:55:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.510+0000 7f28bb59e700 1 -- 172.21.15.8:0/686249126 wait complete. 2023-10-18T20:55:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.511+0000 7f28bb59e700 1 Processor -- start 2023-10-18T20:55:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.511+0000 7f28bb59e700 1 -- start start 2023-10-18T20:55:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28bb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28bc0f6620 0x7f28bc109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28bb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28bc0f78c0 0x7f28bc1095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28bb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc109ba0 con 0x7f28bc0f78c0 2023-10-18T20:55:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28bb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc109ce0 con 0x7f28bc0f6620 2023-10-18T20:55:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28b9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28bc0f78c0 0x7f28bc1095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28b9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28bc0f78c0 0x7f28bc1095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48958/0 (socket says 172.21.15.8:48958) 2023-10-18T20:55:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28b9d9b700 1 -- 172.21.15.8:0/3227170559 learned_addr learned my addr 172.21.15.8:0/3227170559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28ba59c700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28bc0f6620 0x7f28bc109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28b9d9b700 1 -- 172.21.15.8:0/3227170559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28bc0f6620 msgr2=0x7f28bc109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28b9d9b700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28bc0f6620 0x7f28bc109100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28b9d9b700 1 -- 172.21.15.8:0/3227170559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac005040 con 0x7f28bc0f78c0 2023-10-18T20:55:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.512+0000 7f28b9d9b700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28bc0f78c0 0x7f28bc1095f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f28b00026d0 tx=0x7f28b0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.513+0000 7f28aaffd700 1 -- 172.21.15.8:0/3227170559 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b00079c0 con 0x7f28bc0f78c0 2023-10-18T20:55:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.513+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc10a680 con 0x7f28bc0f78c0 2023-10-18T20:55:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.513+0000 7f28aaffd700 1 -- 172.21.15.8:0/3227170559 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f28b000f040 con 0x7f28bc0f78c0 2023-10-18T20:55:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.513+0000 7f28aaffd700 1 -- 172.21.15.8:0/3227170559 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b00148b0 con 0x7f28bc0f78c0 2023-10-18T20:55:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.513+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc10ac40 con 0x7f28bc0f78c0 2023-10-18T20:55:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.514+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28bc05db60 con 0x7f28bc0f78c0 2023-10-18T20:55:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.515+0000 7f28aaffd700 1 -- 172.21.15.8:0/3227170559 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f28b0007b20 con 0x7f28bc0f78c0 2023-10-18T20:55:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.515+0000 7f28aaffd700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f28a405c2a0 0x7f28a405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.515+0000 7f28aaffd700 1 -- 172.21.15.8:0/3227170559 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f28b0075bc0 con 0x7f28bc0f78c0 2023-10-18T20:55:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.516+0000 7f28ba59c700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f28a405c2a0 0x7f28a405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.516+0000 7f28aaffd700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500] conn(0x7f28a4062030 0x7f28a4064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.516+0000 7f28aaffd700 1 -- 172.21.15.8:0/3227170559 --> [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28a4064b10 con 0x7f28a4062030 2023-10-18T20:55:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.516+0000 7f28aaffd700 1 -- 172.21.15.8:0/3227170559 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28b007a220 con 0x7f28bc0f78c0 2023-10-18T20:55:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.516+0000 7f28bad9d700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500] conn(0x7f28a4062030 0x7f28a4064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.516+0000 7f28ba59c700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f28a405c2a0 0x7f28a405e760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f28ac005010 tx=0x7f28ac009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.517+0000 7f28bad9d700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500] conn(0x7f28a4062030 0x7f28a4064490 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.518+0000 7f28aaffd700 1 -- 172.21.15.8:0/3227170559 <== osd.4 v2:172.21.15.60:6808/347739500 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f28a4064b10 con 0x7f28a4062030 2023-10-18T20:55:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.533+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 --> [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f28bc10b100 con 0x7f28a4062030 2023-10-18T20:55:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28aaffd700 1 -- 172.21.15.8:0/3227170559 <== osd.4 v2:172.21.15.60:6808/347739500 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f28bc10b100 con 0x7f28a4062030 2023-10-18T20:55:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 >> [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500] conn(0x7f28a4062030 msgr2=0x7f28a4064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500] conn(0x7f28a4062030 0x7f28a4064490 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f28a405c2a0 msgr2=0x7f28a405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f28a405c2a0 0x7f28a405e760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f28ac005010 tx=0x7f28ac009b30).stop 2023-10-18T20:55:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28bc0f78c0 msgr2=0x7f28bc1095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28bc0f78c0 0x7f28bc1095f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f28b00026d0 tx=0x7f28b0009de0).stop 2023-10-18T20:55:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 shutdown_connections 2023-10-18T20:55:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.60:6808/347739500,v1:172.21.15.60:6809/347739500] conn(0x7f28a4062030 0x7f28a4064490 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:14.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f28a405c2a0 0x7f28a405e760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:14.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28bc0f6620 0x7f28bc109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:14.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 --2- 172.21.15.8:0/3227170559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28bc0f78c0 0x7f28bc1095f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:14.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 >> 172.21.15.8:0/3227170559 conn(0x7f28bc0f1da0 msgr2=0x7f28bc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:14.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 shutdown_connections 2023-10-18T20:55:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:14.534+0000 7f28bb59e700 1 -- 172.21.15.8:0/3227170559 wait complete. 2023-10-18T20:55:14.900 INFO:teuthology.orchestra.run.smithi008.stdout:133143986186 2023-10-18T20:55:14.900 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-18T20:55:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:14.115610+0000 mgr.smithi008.flmjzp (mgr.14164) 173 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:14.115610+0000 mgr.smithi008.flmjzp (mgr.14164) 173 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:16.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.303+0000 7ff3a8a75700 1 -- 172.21.15.8:0/3116710582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3a40607f0 msgr2=0x7ff3a40f9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:16.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.303+0000 7ff3a8a75700 1 --2- 172.21.15.8:0/3116710582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3a40607f0 0x7ff3a40f9270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7ff394004660 tx=0x7ff394009b30).stop 2023-10-18T20:55:16.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.303+0000 7ff3a8a75700 1 -- 172.21.15.8:0/3116710582 shutdown_connections 2023-10-18T20:55:16.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.303+0000 7ff3a8a75700 1 --2- 172.21.15.8:0/3116710582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3a40f97f0 0x7ff3a40fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:16.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.303+0000 7ff3a8a75700 1 --2- 172.21.15.8:0/3116710582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3a40607f0 0x7ff3a40f9270 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:16.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.303+0000 7ff3a8a75700 1 -- 172.21.15.8:0/3116710582 >> 172.21.15.8:0/3116710582 conn(0x7ff3a40f0c70 msgr2=0x7ff3a40f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:16.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.303+0000 7ff3a8a75700 1 -- 172.21.15.8:0/3116710582 shutdown_connections 2023-10-18T20:55:16.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.303+0000 7ff3a8a75700 1 -- 172.21.15.8:0/3116710582 wait complete. 2023-10-18T20:55:16.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.304+0000 7ff3a8a75700 1 Processor -- start 2023-10-18T20:55:16.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.304+0000 7ff3a8a75700 1 -- start start 2023-10-18T20:55:16.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.304+0000 7ff3a8a75700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3a40607f0 0x7ff3a4106e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:16.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.304+0000 7ff3a8a75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3a40f97f0 0x7ff3a4107360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:16.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.304+0000 7ff3a8a75700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4107910 con 0x7ff3a40607f0 2023-10-18T20:55:16.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.304+0000 7ff3a8a75700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4107a50 con 0x7ff3a40f97f0 2023-10-18T20:55:16.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff3a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3a40607f0 0x7ff3a4106e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:16.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff3a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3a40607f0 0x7ff3a4106e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48978/0 (socket says 172.21.15.8:48978) 2023-10-18T20:55:16.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff3a37fe700 1 -- 172.21.15.8:0/2125083008 learned_addr learned my addr 172.21.15.8:0/2125083008 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:16.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff3a2ffd700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3a40f97f0 0x7ff3a4107360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff3a37fe700 1 -- 172.21.15.8:0/2125083008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3a40f97f0 msgr2=0x7ff3a4107360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff3a37fe700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3a40f97f0 0x7ff3a4107360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff3a37fe700 1 -- 172.21.15.8:0/2125083008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394005040 con 0x7ff3a40607f0 2023-10-18T20:55:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff3a37fe700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3a40607f0 0x7ff3a4106e70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7ff394013530 tx=0x7ff39400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff38bfff700 1 -- 172.21.15.8:0/2125083008 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff394019070 con 0x7ff3a40607f0 2023-10-18T20:55:16.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff38bfff700 1 -- 172.21.15.8:0/2125083008 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff394007e70 con 0x7ff3a40607f0 2023-10-18T20:55:16.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.305+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a4108390 con 0x7ff3a40607f0 2023-10-18T20:55:16.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.306+0000 7ff38bfff700 1 -- 172.21.15.8:0/2125083008 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff394014c50 con 0x7ff3a40607f0 2023-10-18T20:55:16.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.306+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a41088f0 con 0x7ff3a40607f0 2023-10-18T20:55:16.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.306+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3a405db80 con 0x7ff3a40607f0 2023-10-18T20:55:16.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.307+0000 7ff38bfff700 1 -- 172.21.15.8:0/2125083008 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff394025070 con 0x7ff3a40607f0 2023-10-18T20:55:16.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.308+0000 7ff38bfff700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff38c05c2a0 0x7ff38c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:16.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.308+0000 7ff38bfff700 1 -- 172.21.15.8:0/2125083008 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7ff394076c40 con 0x7ff3a40607f0 2023-10-18T20:55:16.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.308+0000 7ff3a2ffd700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff38c05c2a0 0x7ff38c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:16.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.308+0000 7ff38bfff700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318] conn(0x7ff38c062030 0x7ff38c064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:16.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.308+0000 7ff38bfff700 1 -- 172.21.15.8:0/2125083008 --> [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff38c064b10 con 0x7ff38c062030 2023-10-18T20:55:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.308+0000 7ff38bfff700 1 -- 172.21.15.8:0/2125083008 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3940791f0 con 0x7ff3a40607f0 2023-10-18T20:55:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.309+0000 7ff3a2ffd700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff38c05c2a0 0x7ff38c05e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff398009fd0 tx=0x7ff39800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.309+0000 7ff3a3fff700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318] conn(0x7ff38c062030 0x7ff38c064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.309+0000 7ff3a3fff700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318] conn(0x7ff38c062030 0x7ff38c064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:16.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.311+0000 7ff38bfff700 1 -- 172.21.15.8:0/2125083008 <== osd.5 v2:172.21.15.60:6816/2728123318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7ff38c064b10 con 0x7ff38c062030 2023-10-18T20:55:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.326+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 --> [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff3a4108d50 con 0x7ff38c062030 2023-10-18T20:55:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.326+0000 7ff38bfff700 1 -- 172.21.15.8:0/2125083008 <== osd.5 v2:172.21.15.60:6816/2728123318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff3a4108d50 con 0x7ff38c062030 2023-10-18T20:55:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 >> [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318] conn(0x7ff38c062030 msgr2=0x7ff38c064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318] conn(0x7ff38c062030 0x7ff38c064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff38c05c2a0 msgr2=0x7ff38c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff38c05c2a0 0x7ff38c05e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff398009fd0 tx=0x7ff39800b040).stop 2023-10-18T20:55:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3a40607f0 msgr2=0x7ff3a4106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3a40607f0 0x7ff3a4106e70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7ff394013530 tx=0x7ff39400b040).stop 2023-10-18T20:55:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 shutdown_connections 2023-10-18T20:55:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.60:6816/2728123318,v1:172.21.15.60:6817/2728123318] conn(0x7ff38c062030 0x7ff38c064490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3a40607f0 0x7ff3a4106e70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff38c05c2a0 0x7ff38c05e760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 --2- 172.21.15.8:0/2125083008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3a40f97f0 0x7ff3a4107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 >> 172.21.15.8:0/2125083008 conn(0x7ff3a40f0c70 msgr2=0x7ff3a40f3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 shutdown_connections 2023-10-18T20:55:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:16.327+0000 7ff3a8a75700 1 -- 172.21.15.8:0/2125083008 wait complete. 2023-10-18T20:55:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:16.115851+0000 mgr.smithi008.flmjzp (mgr.14164) 174 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:150323855366 2023-10-18T20:55:16.700 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-18T20:55:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:16.115851+0000 mgr.smithi008.flmjzp (mgr.14164) 174 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:17.069 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.134+0000 7fa1db46c700 1 -- 172.21.15.8:0/553989637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1d4060870 msgr2=0x7fa1d40f6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:18.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.134+0000 7fa1db46c700 1 --2- 172.21.15.8:0/553989637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1d4060870 0x7fa1d40f6ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fa1d0004660 tx=0x7fa1d0009b30).stop 2023-10-18T20:55:18.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.134+0000 7fa1db46c700 1 -- 172.21.15.8:0/553989637 shutdown_connections 2023-10-18T20:55:18.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.134+0000 7fa1db46c700 1 --2- 172.21.15.8:0/553989637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d40f7570 0x7fa1d40f9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:18.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.134+0000 7fa1db46c700 1 --2- 172.21.15.8:0/553989637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1d4060870 0x7fa1d40f6ff0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:18.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.134+0000 7fa1db46c700 1 -- 172.21.15.8:0/553989637 >> 172.21.15.8:0/553989637 conn(0x7fa1d40f0ca0 msgr2=0x7fa1d40f30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:18.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.134+0000 7fa1db46c700 1 -- 172.21.15.8:0/553989637 shutdown_connections 2023-10-18T20:55:18.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.134+0000 7fa1db46c700 1 -- 172.21.15.8:0/553989637 wait complete. 2023-10-18T20:55:18.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.135+0000 7fa1db46c700 1 Processor -- start 2023-10-18T20:55:18.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.135+0000 7fa1db46c700 1 -- start start 2023-10-18T20:55:18.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.135+0000 7fa1db46c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d4060870 0x7fa1d410d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:18.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.135+0000 7fa1db46c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1d40f7570 0x7fa1d410d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:18.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.135+0000 7fa1db46c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d410df50 con 0x7fa1d40f7570 2023-10-18T20:55:18.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.135+0000 7fa1db46c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d410e090 con 0x7fa1d4060870 2023-10-18T20:55:18.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.135+0000 7fa1d9c69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1d40f7570 0x7fa1d410d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:18.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1d9c69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1d40f7570 0x7fa1d410d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57580/0 (socket says 172.21.15.8:57580) 2023-10-18T20:55:18.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1d9c69700 1 -- 172.21.15.8:0/1286387453 learned_addr learned my addr 172.21.15.8:0/1286387453 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:18.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1da46a700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d4060870 0x7fa1d410d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1d9c69700 1 -- 172.21.15.8:0/1286387453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d4060870 msgr2=0x7fa1d410d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1d9c69700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d4060870 0x7fa1d410d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1d9c69700 1 -- 172.21.15.8:0/1286387453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d0005040 con 0x7fa1d40f7570 2023-10-18T20:55:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1d9c69700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1d40f7570 0x7fa1d410d9a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fa1c40026d0 tx=0x7fa1c4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1caffd700 1 -- 172.21.15.8:0/1286387453 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1c4009320 con 0x7fa1d40f7570 2023-10-18T20:55:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1db46c700 1 -- 172.21.15.8:0/1286387453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d410ea30 con 0x7fa1d40f7570 2023-10-18T20:55:18.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1caffd700 1 -- 172.21.15.8:0/1286387453 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa1c400f040 con 0x7fa1d40f7570 2023-10-18T20:55:18.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.136+0000 7fa1caffd700 1 -- 172.21.15.8:0/1286387453 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1c40147e0 con 0x7fa1d40f7570 2023-10-18T20:55:18.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.137+0000 7fa1db46c700 1 -- 172.21.15.8:0/1286387453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d410eff0 con 0x7fa1d40f7570 2023-10-18T20:55:18.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.137+0000 7fa1db46c700 1 -- 172.21.15.8:0/1286387453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d4045ad0 con 0x7fa1d40f7570 2023-10-18T20:55:18.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.138+0000 7fa1caffd700 1 -- 172.21.15.8:0/1286387453 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa1c4009480 con 0x7fa1d40f7570 2023-10-18T20:55:18.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.139+0000 7fa1caffd700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa1c005c2a0 0x7fa1c005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:18.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.139+0000 7fa1caffd700 1 -- 172.21.15.8:0/1286387453 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fa1c4076330 con 0x7fa1d40f7570 2023-10-18T20:55:18.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.139+0000 7fa1da46a700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa1c005c2a0 0x7fa1c005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:18.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.140+0000 7fa1da46a700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa1c005c2a0 0x7fa1c005e760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa1d0005010 tx=0x7fa1d0009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:18.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.143+0000 7fa1caffd700 1 -- 172.21.15.8:0/1286387453 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa1c4049270 con 0x7fa1d40f7570 2023-10-18T20:55:18.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.314+0000 7fa1db46c700 1 -- 172.21.15.8:0/1286387453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa1d41054b0 con 0x7fa1d40f7570 2023-10-18T20:55:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.315+0000 7fa1caffd700 1 -- 172.21.15.8:0/1286387453 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1c404c890 con 0x7fa1d40f7570 2023-10-18T20:55:18.318 INFO:teuthology.orchestra.run.smithi008.stdout:38654705689 2023-10-18T20:55:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 -- 172.21.15.8:0/1286387453 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa1c005c2a0 msgr2=0x7fa1c005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa1c005c2a0 0x7fa1c005e760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa1d0005010 tx=0x7fa1d0009b30).stop 2023-10-18T20:55:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 -- 172.21.15.8:0/1286387453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1d40f7570 msgr2=0x7fa1d410d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1d40f7570 0x7fa1d410d9a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fa1c40026d0 tx=0x7fa1c4009de0).stop 2023-10-18T20:55:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 -- 172.21.15.8:0/1286387453 shutdown_connections 2023-10-18T20:55:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa1c005c2a0 0x7fa1c005e760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d4060870 0x7fa1d410d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 --2- 172.21.15.8:0/1286387453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1d40f7570 0x7fa1d410d9a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 -- 172.21.15.8:0/1286387453 >> 172.21.15.8:0/1286387453 conn(0x7fa1d40f0ca0 msgr2=0x7fa1d40f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 -- 172.21.15.8:0/1286387453 shutdown_connections 2023-10-18T20:55:18.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:18.317+0000 7fa1db46c700 1 -- 172.21.15.8:0/1286387453 wait complete. 2023-10-18T20:55:18.687 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705687 got 38654705689 for osd.0 2023-10-18T20:55:18.688 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-18T20:55:19.051 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:18.116111+0000 mgr.smithi008.flmjzp (mgr.14164) 175 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:18.316572+0000 mon.smithi008 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.8:0/1286387453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-18T20:55:19.547 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:18.116111+0000 mgr.smithi008.flmjzp (mgr.14164) 175 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:19.547 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:18.316572+0000 mon.smithi008 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.8:0/1286387453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-18T20:55:20.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.082+0000 7f980ed12700 1 -- 172.21.15.8:0/217386044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98080f6620 msgr2=0x7f98080f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:20.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.082+0000 7f980ed12700 1 --2- 172.21.15.8:0/217386044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98080f6620 0x7f98080f6a40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f9804004660 tx=0x7f9804009b30).stop 2023-10-18T20:55:20.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.082+0000 7f980ed12700 1 -- 172.21.15.8:0/217386044 shutdown_connections 2023-10-18T20:55:20.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.082+0000 7f980ed12700 1 --2- 172.21.15.8:0/217386044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98080f78c0 0x7f98080f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:20.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.082+0000 7f980ed12700 1 --2- 172.21.15.8:0/217386044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98080f6620 0x7f98080f6a40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:20.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.082+0000 7f980ed12700 1 -- 172.21.15.8:0/217386044 >> 172.21.15.8:0/217386044 conn(0x7f98080f1da0 msgr2=0x7f98080f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:20.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.082+0000 7f980ed12700 1 -- 172.21.15.8:0/217386044 shutdown_connections 2023-10-18T20:55:20.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.082+0000 7f980ed12700 1 -- 172.21.15.8:0/217386044 wait complete. 2023-10-18T20:55:20.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.083+0000 7f980ed12700 1 Processor -- start 2023-10-18T20:55:20.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.083+0000 7f980ed12700 1 -- start start 2023-10-18T20:55:20.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.083+0000 7f980ed12700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98080f6620 0x7f980806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:20.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.083+0000 7f980ed12700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98080f78c0 0x7f9808069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:20.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.083+0000 7f980ed12700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980806a380 con 0x7f98080f78c0 2023-10-18T20:55:20.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.083+0000 7f980ed12700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980806a4c0 con 0x7f98080f6620 2023-10-18T20:55:20.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.084+0000 7f980d50f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98080f78c0 0x7f9808069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:20.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.084+0000 7f980d50f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98080f78c0 0x7f9808069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57584/0 (socket says 172.21.15.8:57584) 2023-10-18T20:55:20.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.084+0000 7f980d50f700 1 -- 172.21.15.8:0/561074020 learned_addr learned my addr 172.21.15.8:0/561074020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:20.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.084+0000 7f980dd10700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98080f6620 0x7f980806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:20.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.084+0000 7f980d50f700 1 -- 172.21.15.8:0/561074020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98080f6620 msgr2=0x7f980806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:20.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.084+0000 7f980d50f700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98080f6620 0x7f980806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:20.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.084+0000 7f980d50f700 1 -- 172.21.15.8:0/561074020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9804005040 con 0x7f98080f78c0 2023-10-18T20:55:20.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.084+0000 7f980dd10700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98080f6620 0x7f980806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T20:55:20.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.084+0000 7f980d50f700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98080f78c0 0x7f9808069e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f97f800e7f0 tx=0x7f97f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:20.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.085+0000 7f97fe7fc700 1 -- 172.21.15.8:0/561074020 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f80092e0 con 0x7f98080f78c0 2023-10-18T20:55:20.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.085+0000 7f97fe7fc700 1 -- 172.21.15.8:0/561074020 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97f800f040 con 0x7f98080f78c0 2023-10-18T20:55:20.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.085+0000 7f980ed12700 1 -- 172.21.15.8:0/561074020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980806a7a0 con 0x7f98080f78c0 2023-10-18T20:55:20.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.085+0000 7f97fe7fc700 1 -- 172.21.15.8:0/561074020 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f80146c0 con 0x7f98080f78c0 2023-10-18T20:55:20.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.085+0000 7f980ed12700 1 -- 172.21.15.8:0/561074020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980810eef0 con 0x7f98080f78c0 2023-10-18T20:55:20.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.086+0000 7f980ed12700 1 -- 172.21.15.8:0/561074020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9808045ad0 con 0x7f98080f78c0 2023-10-18T20:55:20.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.087+0000 7f97fe7fc700 1 -- 172.21.15.8:0/561074020 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f97f801b030 con 0x7f98080f78c0 2023-10-18T20:55:20.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.087+0000 7f97fe7fc700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f97f405c2a0 0x7f97f405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:20.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.088+0000 7f97fe7fc700 1 -- 172.21.15.8:0/561074020 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f97f8075840 con 0x7f98080f78c0 2023-10-18T20:55:20.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.088+0000 7f980dd10700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f97f405c2a0 0x7f97f405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:20.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.088+0000 7f980dd10700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f97f405c2a0 0x7f97f405e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f98040043d0 tx=0x7f980400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:20.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.092+0000 7f97fe7fc700 1 -- 172.21.15.8:0/561074020 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f97f8048890 con 0x7f98080f78c0 2023-10-18T20:55:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.259+0000 7f980ed12700 1 -- 172.21.15.8:0/561074020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f98080fedb0 con 0x7f98080f78c0 2023-10-18T20:55:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.259+0000 7f97fe7fc700 1 -- 172.21.15.8:0/561074020 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97f8019020 con 0x7f98080f78c0 2023-10-18T20:55:20.263 INFO:teuthology.orchestra.run.smithi008.stdout:60129542166 2023-10-18T20:55:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.261+0000 7f980ed12700 1 -- 172.21.15.8:0/561074020 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f97f405c2a0 msgr2=0x7f97f405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.261+0000 7f980ed12700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f97f405c2a0 0x7f97f405e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f98040043d0 tx=0x7f980400b040).stop 2023-10-18T20:55:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.261+0000 7f980ed12700 1 -- 172.21.15.8:0/561074020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98080f78c0 msgr2=0x7f9808069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:20.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.261+0000 7f980ed12700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98080f78c0 0x7f9808069e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f97f800e7f0 tx=0x7f97f800b040).stop 2023-10-18T20:55:20.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.261+0000 7f980ed12700 1 -- 172.21.15.8:0/561074020 shutdown_connections 2023-10-18T20:55:20.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.261+0000 7f980ed12700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f97f405c2a0 0x7f97f405e760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:20.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.261+0000 7f980ed12700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98080f6620 0x7f980806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.261+0000 7f980ed12700 1 --2- 172.21.15.8:0/561074020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98080f78c0 0x7f9808069e20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.261+0000 7f980ed12700 1 -- 172.21.15.8:0/561074020 >> 172.21.15.8:0/561074020 conn(0x7f98080f1da0 msgr2=0x7f98080fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.262+0000 7f980ed12700 1 -- 172.21.15.8:0/561074020 shutdown_connections 2023-10-18T20:55:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:20.262+0000 7f980ed12700 1 -- 172.21.15.8:0/561074020 wait complete. 2023-10-18T20:55:20.666 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542163 got 60129542166 for osd.1 2023-10-18T20:55:20.666 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-18T20:55:21.027 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:20.116417+0000 mgr.smithi008.flmjzp (mgr.14164) 176 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:20.261304+0000 mon.smithi008 (mon.0) 446 : audit [DBG] from='client.? 172.21.15.8:0/561074020' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-18T20:55:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:20.116417+0000 mgr.smithi008.flmjzp (mgr.14164) 176 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:20.261304+0000 mon.smithi008 (mon.0) 446 : audit [DBG] from='client.? 172.21.15.8:0/561074020' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-18T20:55:22.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.009+0000 7f933dcff700 1 -- 172.21.15.8:0/128480598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93380f6620 msgr2=0x7f93380f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:22.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.009+0000 7f933dcff700 1 --2- 172.21.15.8:0/128480598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93380f6620 0x7f93380f6a40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f932c004660 tx=0x7f932c009b30).stop 2023-10-18T20:55:22.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.009+0000 7f933dcff700 1 -- 172.21.15.8:0/128480598 shutdown_connections 2023-10-18T20:55:22.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.009+0000 7f933dcff700 1 --2- 172.21.15.8:0/128480598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93380f78c0 0x7f93380f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:22.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.009+0000 7f933dcff700 1 --2- 172.21.15.8:0/128480598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93380f6620 0x7f93380f6a40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:22.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.009+0000 7f933dcff700 1 -- 172.21.15.8:0/128480598 >> 172.21.15.8:0/128480598 conn(0x7f93380f1da0 msgr2=0x7f93380f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:22.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.009+0000 7f933dcff700 1 -- 172.21.15.8:0/128480598 shutdown_connections 2023-10-18T20:55:22.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.009+0000 7f933dcff700 1 -- 172.21.15.8:0/128480598 wait complete. 2023-10-18T20:55:22.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.010+0000 7f933dcff700 1 Processor -- start 2023-10-18T20:55:22.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.010+0000 7f933dcff700 1 -- start start 2023-10-18T20:55:22.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.010+0000 7f933dcff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93380f6620 0x7f933806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:22.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.010+0000 7f933dcff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93380f78c0 0x7f9338069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:22.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.010+0000 7f933dcff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933806a380 con 0x7f93380f6620 2023-10-18T20:55:22.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.010+0000 7f933dcff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933806a4c0 con 0x7f93380f78c0 2023-10-18T20:55:22.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.010+0000 7f933ccfd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93380f6620 0x7f933806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:22.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.010+0000 7f933ccfd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93380f6620 0x7f933806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57612/0 (socket says 172.21.15.8:57612) 2023-10-18T20:55:22.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.010+0000 7f933ccfd700 1 -- 172.21.15.8:0/292895081 learned_addr learned my addr 172.21.15.8:0/292895081 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:22.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f9337fff700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93380f78c0 0x7f9338069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:22.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f933ccfd700 1 -- 172.21.15.8:0/292895081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93380f78c0 msgr2=0x7f9338069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:22.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f933ccfd700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93380f78c0 0x7f9338069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:22.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f933ccfd700 1 -- 172.21.15.8:0/292895081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c005040 con 0x7f93380f6620 2023-10-18T20:55:22.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f9337fff700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93380f78c0 0x7f9338069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T20:55:22.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f933ccfd700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93380f6620 0x7f933806b9a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f932c004e30 tx=0x7f932c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:22.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f93357fa700 1 -- 172.21.15.8:0/292895081 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f932c018070 con 0x7f93380f6620 2023-10-18T20:55:22.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f933dcff700 1 -- 172.21.15.8:0/292895081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933806a740 con 0x7f93380f6620 2023-10-18T20:55:22.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f93357fa700 1 -- 172.21.15.8:0/292895081 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f932c013410 con 0x7f93380f6620 2023-10-18T20:55:22.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f93357fa700 1 -- 172.21.15.8:0/292895081 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f932c01c3c0 con 0x7f93380f6620 2023-10-18T20:55:22.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.011+0000 7f933dcff700 1 -- 172.21.15.8:0/292895081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933806aca0 con 0x7f93380f6620 2023-10-18T20:55:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.012+0000 7f933dcff700 1 -- 172.21.15.8:0/292895081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9338045ad0 con 0x7f93380f6620 2023-10-18T20:55:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.013+0000 7f93357fa700 1 -- 172.21.15.8:0/292895081 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f932c01d420 con 0x7f93380f6620 2023-10-18T20:55:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.014+0000 7f93357fa700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f932805c2b0 0x7f932805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.014+0000 7f93357fa700 1 -- 172.21.15.8:0/292895081 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f932c077820 con 0x7f93380f6620 2023-10-18T20:55:22.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.014+0000 7f9337fff700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f932805c2b0 0x7f932805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:22.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.015+0000 7f9337fff700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f932805c2b0 0x7f932805e770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f9324009880 tx=0x7f932400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:22.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.018+0000 7f93357fa700 1 -- 172.21.15.8:0/292895081 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f932c04a820 con 0x7f93380f6620 2023-10-18T20:55:22.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.186+0000 7f933dcff700 1 -- 172.21.15.8:0/292895081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9338027a00 con 0x7f93380f6620 2023-10-18T20:55:22.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.186+0000 7f93357fa700 1 -- 172.21.15.8:0/292895081 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f932c04de40 con 0x7f93380f6620 2023-10-18T20:55:22.190 INFO:teuthology.orchestra.run.smithi008.stdout:81604378641 2023-10-18T20:55:22.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.188+0000 7f933dcff700 1 -- 172.21.15.8:0/292895081 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f932805c2b0 msgr2=0x7f932805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:22.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.188+0000 7f933dcff700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f932805c2b0 0x7f932805e770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f9324009880 tx=0x7f932400b040).stop 2023-10-18T20:55:22.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.188+0000 7f933dcff700 1 -- 172.21.15.8:0/292895081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93380f6620 msgr2=0x7f933806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:22.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.188+0000 7f933dcff700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93380f6620 0x7f933806b9a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f932c004e30 tx=0x7f932c009b30).stop 2023-10-18T20:55:22.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.188+0000 7f933dcff700 1 -- 172.21.15.8:0/292895081 shutdown_connections 2023-10-18T20:55:22.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.188+0000 7f933dcff700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93380f6620 0x7f933806b9a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:22.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.188+0000 7f933dcff700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f932805c2b0 0x7f932805e770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:22.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.188+0000 7f933dcff700 1 --2- 172.21.15.8:0/292895081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93380f78c0 0x7f9338069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:22.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.188+0000 7f933dcff700 1 -- 172.21.15.8:0/292895081 >> 172.21.15.8:0/292895081 conn(0x7f93380f1da0 msgr2=0x7f93380fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:22.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.189+0000 7f933dcff700 1 -- 172.21.15.8:0/292895081 shutdown_connections 2023-10-18T20:55:22.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:22.189+0000 7f933dcff700 1 -- 172.21.15.8:0/292895081 wait complete. 2023-10-18T20:55:22.557 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378639 got 81604378641 for osd.2 2023-10-18T20:55:22.558 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-18T20:55:22.922 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:23.389 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:22.116692+0000 mgr.smithi008.flmjzp (mgr.14164) 177 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:23.389 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:22.188158+0000 mon.smithi008 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.8:0/292895081' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-18T20:55:23.389 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:22.257075+0000 mon.smithi008 (mon.0) 448 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:55:23.390 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:22.260836+0000 mon.smithi008 (mon.0) 449 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:55:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:22.116692+0000 mgr.smithi008.flmjzp (mgr.14164) 177 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:22.188158+0000 mon.smithi008 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.8:0/292895081' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-18T20:55:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:22.257075+0000 mon.smithi008 (mon.0) 448 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:55:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:22.260836+0000 mon.smithi008 (mon.0) 449 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:55:23.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.932+0000 7f5b8ee44700 1 -- 172.21.15.8:0/2490509403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b880f78c0 msgr2=0x7f5b880f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:23.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.932+0000 7f5b8ee44700 1 --2- 172.21.15.8:0/2490509403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b880f78c0 0x7f5b880f7d20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f5b78004660 tx=0x7f5b78009b30).stop 2023-10-18T20:55:23.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.932+0000 7f5b8ee44700 1 -- 172.21.15.8:0/2490509403 shutdown_connections 2023-10-18T20:55:23.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.932+0000 7f5b8ee44700 1 --2- 172.21.15.8:0/2490509403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b880f78c0 0x7f5b880f7d20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:23.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.932+0000 7f5b8ee44700 1 --2- 172.21.15.8:0/2490509403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b880f6620 0x7f5b880f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:55:23.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.932+0000 7f5b8ee44700 1 -- 172.21.15.8:0/2490509403 >> 172.21.15.8:0/2490509403 conn(0x7f5b880f1da0 msgr2=0x7f5b880f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:23.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.932+0000 7f5b8ee44700 1 -- 172.21.15.8:0/2490509403 shutdown_connections 2023-10-18T20:55:23.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.933+0000 7f5b8ee44700 1 -- 172.21.15.8:0/2490509403 wait complete. 2023-10-18T20:55:23.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.933+0000 7f5b8ee44700 1 Processor -- start 2023-10-18T20:55:23.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.933+0000 7f5b8ee44700 1 -- start start 2023-10-18T20:55:23.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8ee44700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b880f6620 0x7f5b88109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:23.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8ee44700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b880f78c0 0x7f5b88109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:23.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8ee44700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b88109c40 con 0x7f5b880f6620 2023-10-18T20:55:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8ee44700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8810a4f0 con 0x7f5b880f78c0 2023-10-18T20:55:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8de42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b880f6620 0x7f5b88109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8de42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b880f6620 0x7f5b88109110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57628/0 (socket says 172.21.15.8:57628) 2023-10-18T20:55:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8de42700 1 -- 172.21.15.8:0/3423813923 learned_addr learned my addr 172.21.15.8:0/3423813923 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8d641700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b880f78c0 0x7f5b88109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:23.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8de42700 1 -- 172.21.15.8:0/3423813923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b880f78c0 msgr2=0x7f5b88109600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:23.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8de42700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b880f78c0 0x7f5b88109600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:23.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8de42700 1 -- 172.21.15.8:0/3423813923 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78005040 con 0x7f5b880f6620 2023-10-18T20:55:23.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.934+0000 7f5b8d641700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b880f78c0 0x7f5b88109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T20:55:23.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.935+0000 7f5b8de42700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b880f6620 0x7f5b88109110 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f5b840093f0 tx=0x7f5b84006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:23.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.935+0000 7f5b7e7fc700 1 -- 172.21.15.8:0/3423813923 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b84009ea0 con 0x7f5b880f6620 2023-10-18T20:55:23.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.935+0000 7f5b7e7fc700 1 -- 172.21.15.8:0/3423813923 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5b84013af0 con 0x7f5b880f6620 2023-10-18T20:55:23.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.935+0000 7f5b8ee44700 1 -- 172.21.15.8:0/3423813923 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8810a7d0 con 0x7f5b880f6620 2023-10-18T20:55:23.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.935+0000 7f5b7e7fc700 1 -- 172.21.15.8:0/3423813923 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b8400dad0 con 0x7f5b880f6620 2023-10-18T20:55:23.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.935+0000 7f5b8ee44700 1 -- 172.21.15.8:0/3423813923 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8810ad90 con 0x7f5b880f6620 2023-10-18T20:55:23.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.936+0000 7f5b8ee44700 1 -- 172.21.15.8:0/3423813923 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b88059100 con 0x7f5b880f6620 2023-10-18T20:55:23.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.937+0000 7f5b7e7fc700 1 -- 172.21.15.8:0/3423813923 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f5b8401a060 con 0x7f5b880f6620 2023-10-18T20:55:23.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.938+0000 7f5b7e7fc700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5b7405c2a0 0x7f5b7405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:23.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.938+0000 7f5b7e7fc700 1 -- 172.21.15.8:0/3423813923 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f5b84075bb0 con 0x7f5b880f6620 2023-10-18T20:55:23.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.938+0000 7f5b8d641700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5b7405c2a0 0x7f5b7405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:23.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.938+0000 7f5b8d641700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5b7405c2a0 0x7f5b7405e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5b78004e30 tx=0x7f5b78009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:23.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:23.942+0000 7f5b7e7fc700 1 -- 172.21.15.8:0/3423813923 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5b8407c080 con 0x7f5b880f6620 2023-10-18T20:55:24.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.108+0000 7f5b8ee44700 1 -- 172.21.15.8:0/3423813923 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5b880fee50 con 0x7f5b880f6620 2023-10-18T20:55:24.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.109+0000 7f5b7e7fc700 1 -- 172.21.15.8:0/3423813923 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b84048bb0 con 0x7f5b880f6620 2023-10-18T20:55:24.112 INFO:teuthology.orchestra.run.smithi008.stdout:111669149710 2023-10-18T20:55:24.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 -- 172.21.15.8:0/3423813923 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5b7405c2a0 msgr2=0x7f5b7405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:24.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5b7405c2a0 0x7f5b7405e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5b78004e30 tx=0x7f5b78009b30).stop 2023-10-18T20:55:24.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 -- 172.21.15.8:0/3423813923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b880f6620 msgr2=0x7f5b88109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:24.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b880f6620 0x7f5b88109110 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f5b840093f0 tx=0x7f5b84006ec0).stop 2023-10-18T20:55:24.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 -- 172.21.15.8:0/3423813923 shutdown_connections 2023-10-18T20:55:24.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b880f6620 0x7f5b88109110 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:24.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f5b7405c2a0 0x7f5b7405e760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:24.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 --2- 172.21.15.8:0/3423813923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b880f78c0 0x7f5b88109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:24.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 -- 172.21.15.8:0/3423813923 >> 172.21.15.8:0/3423813923 conn(0x7f5b880f1da0 msgr2=0x7f5b8806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:24.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 -- 172.21.15.8:0/3423813923 shutdown_connections 2023-10-18T20:55:24.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:24.111+0000 7f5b8ee44700 1 -- 172.21.15.8:0/3423813923 wait complete. 2023-10-18T20:55:24.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:24.110620+0000 mon.smithi008 (mon.0) 450 : audit [DBG] from='client.? 172.21.15.8:0/3423813923' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-18T20:55:24.453 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149708 got 111669149710 for osd.3 2023-10-18T20:55:24.454 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-18T20:55:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:24.110620+0000 mon.smithi008 (mon.0) 450 : audit [DBG] from='client.? 172.21.15.8:0/3423813923' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-18T20:55:24.815 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:25.529 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:24.116956+0000 mgr.smithi008.flmjzp (mgr.14164) 178 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:24.116956+0000 mgr.smithi008.flmjzp (mgr.14164) 178 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.741+0000 7f5500df6700 1 -- 172.21.15.8:0/1365041047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54fc0f6620 msgr2=0x7f54fc0f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.741+0000 7f5500df6700 1 --2- 172.21.15.8:0/1365041047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54fc0f6620 0x7f54fc0f6a40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f54ec004660 tx=0x7f54ec009b30).stop 2023-10-18T20:55:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.741+0000 7f5500df6700 1 -- 172.21.15.8:0/1365041047 shutdown_connections 2023-10-18T20:55:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.741+0000 7f5500df6700 1 --2- 172.21.15.8:0/1365041047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54fc0f78c0 0x7f54fc0f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.741+0000 7f5500df6700 1 --2- 172.21.15.8:0/1365041047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54fc0f6620 0x7f54fc0f6a40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.741+0000 7f5500df6700 1 -- 172.21.15.8:0/1365041047 >> 172.21.15.8:0/1365041047 conn(0x7f54fc0f1da0 msgr2=0x7f54fc0f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.742+0000 7f5500df6700 1 -- 172.21.15.8:0/1365041047 shutdown_connections 2023-10-18T20:55:25.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.742+0000 7f5500df6700 1 -- 172.21.15.8:0/1365041047 wait complete. 2023-10-18T20:55:25.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.742+0000 7f5500df6700 1 Processor -- start 2023-10-18T20:55:25.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.742+0000 7f5500df6700 1 -- start start 2023-10-18T20:55:25.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f5500df6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54fc0f6620 0x7f54fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:25.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f5500df6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54fc0f78c0 0x7f54fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:25.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f5500df6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc06a380 con 0x7f54fc0f6620 2023-10-18T20:55:25.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f5500df6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc06a4c0 con 0x7f54fc0f78c0 2023-10-18T20:55:25.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54fc0f6620 0x7f54fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:25.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54fc0f6620 0x7f54fc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57648/0 (socket says 172.21.15.8:57648) 2023-10-18T20:55:25.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f54fb7fe700 1 -- 172.21.15.8:0/3375473370 learned_addr learned my addr 172.21.15.8:0/3375473370 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:25.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f54faffd700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54fc0f78c0 0x7f54fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:25.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f54fb7fe700 1 -- 172.21.15.8:0/3375473370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54fc0f78c0 msgr2=0x7f54fc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:25.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f54fb7fe700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54fc0f78c0 0x7f54fc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:25.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.743+0000 7f54fb7fe700 1 -- 172.21.15.8:0/3375473370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec005040 con 0x7f54fc0f6620 2023-10-18T20:55:25.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.744+0000 7f54fb7fe700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54fc0f6620 0x7f54fc06b9a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f54ec000c00 tx=0x7f54ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:25.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.744+0000 7f54e3fff700 1 -- 172.21.15.8:0/3375473370 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54ec019070 con 0x7f54fc0f6620 2023-10-18T20:55:25.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.744+0000 7f54e3fff700 1 -- 172.21.15.8:0/3375473370 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54ec007e70 con 0x7f54fc0f6620 2023-10-18T20:55:25.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.744+0000 7f5500df6700 1 -- 172.21.15.8:0/3375473370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc06a740 con 0x7f54fc0f6620 2023-10-18T20:55:25.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.744+0000 7f54e3fff700 1 -- 172.21.15.8:0/3375473370 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54ec014d00 con 0x7f54fc0f6620 2023-10-18T20:55:25.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.744+0000 7f5500df6700 1 -- 172.21.15.8:0/3375473370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc06aca0 con 0x7f54fc0f6620 2023-10-18T20:55:25.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.745+0000 7f5500df6700 1 -- 172.21.15.8:0/3375473370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc045ad0 con 0x7f54fc0f6620 2023-10-18T20:55:25.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.746+0000 7f54e3fff700 1 -- 172.21.15.8:0/3375473370 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f54ec025070 con 0x7f54fc0f6620 2023-10-18T20:55:25.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.747+0000 7f54e3fff700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54e405c2a0 0x7f54e405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:25.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.747+0000 7f54e3fff700 1 -- 172.21.15.8:0/3375473370 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f54ec076b40 con 0x7f54fc0f6620 2023-10-18T20:55:25.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.747+0000 7f54faffd700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54e405c2a0 0x7f54e405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:25.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.747+0000 7f54faffd700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54e405c2a0 0x7f54e405e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f54f0007fd0 tx=0x7f54f000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:25.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.751+0000 7f54e3fff700 1 -- 172.21.15.8:0/3375473370 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f54ec049b00 con 0x7f54fc0f6620 2023-10-18T20:55:25.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.919+0000 7f5500df6700 1 -- 172.21.15.8:0/3375473370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f54fc027a00 con 0x7f54fc0f6620 2023-10-18T20:55:25.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.920+0000 7f54e3fff700 1 -- 172.21.15.8:0/3375473370 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54ec014e60 con 0x7f54fc0f6620 2023-10-18T20:55:25.923 INFO:teuthology.orchestra.run.smithi008.stdout:133143986188 2023-10-18T20:55:25.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.921+0000 7f5500df6700 1 -- 172.21.15.8:0/3375473370 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54e405c2a0 msgr2=0x7f54e405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:25.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.922+0000 7f5500df6700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54e405c2a0 0x7f54e405e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f54f0007fd0 tx=0x7f54f000b040).stop 2023-10-18T20:55:25.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.922+0000 7f5500df6700 1 -- 172.21.15.8:0/3375473370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54fc0f6620 msgr2=0x7f54fc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:25.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.922+0000 7f5500df6700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54fc0f6620 0x7f54fc06b9a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f54ec000c00 tx=0x7f54ec00b040).stop 2023-10-18T20:55:25.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.922+0000 7f5500df6700 1 -- 172.21.15.8:0/3375473370 shutdown_connections 2023-10-18T20:55:25.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.922+0000 7f5500df6700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54fc0f6620 0x7f54fc06b9a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:25.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.922+0000 7f5500df6700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f54e405c2a0 0x7f54e405e760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:25.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.922+0000 7f5500df6700 1 --2- 172.21.15.8:0/3375473370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54fc0f78c0 0x7f54fc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:25.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.922+0000 7f5500df6700 1 -- 172.21.15.8:0/3375473370 >> 172.21.15.8:0/3375473370 conn(0x7f54fc0f1da0 msgr2=0x7f54fc0fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:25.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.922+0000 7f5500df6700 1 -- 172.21.15.8:0/3375473370 shutdown_connections 2023-10-18T20:55:25.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:25.922+0000 7f5500df6700 1 -- 172.21.15.8:0/3375473370 wait complete. 2023-10-18T20:55:26.304 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986186 got 133143986188 for osd.4 2023-10-18T20:55:26.305 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-18T20:55:26.670 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:25.921576+0000 mon.smithi008 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.8:0/3375473370' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-18T20:55:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:26.117214+0000 mgr.smithi008.flmjzp (mgr.14164) 179 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:25.921576+0000 mon.smithi008 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.8:0/3375473370' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-18T20:55:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:26.117214+0000 mgr.smithi008.flmjzp (mgr.14164) 179 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:27.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.624+0000 7f661cea7700 1 -- 172.21.15.8:0/1704135334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66180f78c0 msgr2=0x7f66180f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:27.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.624+0000 7f661cea7700 1 --2- 172.21.15.8:0/1704135334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66180f78c0 0x7f66180f7d20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f660c004660 tx=0x7f660c009b30).stop 2023-10-18T20:55:27.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.624+0000 7f661cea7700 1 -- 172.21.15.8:0/1704135334 shutdown_connections 2023-10-18T20:55:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.624+0000 7f661cea7700 1 --2- 172.21.15.8:0/1704135334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66180f78c0 0x7f66180f7d20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.624+0000 7f661cea7700 1 --2- 172.21.15.8:0/1704135334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66180f6620 0x7f66180f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:55:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.624+0000 7f661cea7700 1 -- 172.21.15.8:0/1704135334 >> 172.21.15.8:0/1704135334 conn(0x7f66180f1da0 msgr2=0x7f66180f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:27.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.624+0000 7f661cea7700 1 -- 172.21.15.8:0/1704135334 shutdown_connections 2023-10-18T20:55:27.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.624+0000 7f661cea7700 1 -- 172.21.15.8:0/1704135334 wait complete. 2023-10-18T20:55:27.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.625+0000 7f661cea7700 1 Processor -- start 2023-10-18T20:55:27.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.625+0000 7f661cea7700 1 -- start start 2023-10-18T20:55:27.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f661cea7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66180f6620 0x7f661806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:27.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f661cea7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66180f78c0 0x7f6618069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:27.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f661cea7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661806a410 con 0x7f66180f78c0 2023-10-18T20:55:27.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f661cea7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661806a550 con 0x7f66180f6620 2023-10-18T20:55:27.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f6616ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66180f78c0 0x7f6618069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:27.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f6616ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66180f78c0 0x7f6618069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39138/0 (socket says 172.21.15.8:39138) 2023-10-18T20:55:27.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f6616ffd700 1 -- 172.21.15.8:0/3387394816 learned_addr learned my addr 172.21.15.8:0/3387394816 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f66177fe700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66180f6620 0x7f661806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f6616ffd700 1 -- 172.21.15.8:0/3387394816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66180f6620 msgr2=0x7f661806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f6616ffd700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66180f6620 0x7f661806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.626+0000 7f6616ffd700 1 -- 172.21.15.8:0/3387394816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c005040 con 0x7f66180f78c0 2023-10-18T20:55:27.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.627+0000 7f6616ffd700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66180f78c0 0x7f6618069e20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f660c009830 tx=0x7f660c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:27.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.627+0000 7f65fffff700 1 -- 172.21.15.8:0/3387394816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660c018070 con 0x7f66180f78c0 2023-10-18T20:55:27.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.627+0000 7f65fffff700 1 -- 172.21.15.8:0/3387394816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f660c013410 con 0x7f66180f78c0 2023-10-18T20:55:27.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.627+0000 7f661cea7700 1 -- 172.21.15.8:0/3387394816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661806a7d0 con 0x7f66180f78c0 2023-10-18T20:55:27.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.627+0000 7f65fffff700 1 -- 172.21.15.8:0/3387394816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660c01c400 con 0x7f66180f78c0 2023-10-18T20:55:27.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.627+0000 7f661cea7700 1 -- 172.21.15.8:0/3387394816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661810ef40 con 0x7f66180f78c0 2023-10-18T20:55:27.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.628+0000 7f661cea7700 1 -- 172.21.15.8:0/3387394816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6618045ad0 con 0x7f66180f78c0 2023-10-18T20:55:27.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.629+0000 7f65fffff700 1 -- 172.21.15.8:0/3387394816 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f660c01d420 con 0x7f66180f78c0 2023-10-18T20:55:27.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.630+0000 7f65fffff700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f660005c2b0 0x7f660005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:27.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.630+0000 7f65fffff700 1 -- 172.21.15.8:0/3387394816 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f660c077960 con 0x7f66180f78c0 2023-10-18T20:55:27.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.630+0000 7f66177fe700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f660005c2b0 0x7f660005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:27.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.630+0000 7f66177fe700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f660005c2b0 0x7f660005e770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f661806b730 tx=0x7f6608008040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:27.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.634+0000 7f65fffff700 1 -- 172.21.15.8:0/3387394816 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f660c04a9e0 con 0x7f66180f78c0 2023-10-18T20:55:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.800+0000 7f661cea7700 1 -- 172.21.15.8:0/3387394816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f66180fee50 con 0x7f66180f78c0 2023-10-18T20:55:27.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.800+0000 7f65fffff700 1 -- 172.21.15.8:0/3387394816 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f660c04e000 con 0x7f66180f78c0 2023-10-18T20:55:27.803 INFO:teuthology.orchestra.run.smithi008.stdout:150323855368 2023-10-18T20:55:27.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 -- 172.21.15.8:0/3387394816 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f660005c2b0 msgr2=0x7f660005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:27.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f660005c2b0 0x7f660005e770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f661806b730 tx=0x7f6608008040).stop 2023-10-18T20:55:27.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 -- 172.21.15.8:0/3387394816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66180f78c0 msgr2=0x7f6618069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:27.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66180f78c0 0x7f6618069e20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f660c009830 tx=0x7f660c009b30).stop 2023-10-18T20:55:27.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 -- 172.21.15.8:0/3387394816 shutdown_connections 2023-10-18T20:55:27.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f660005c2b0 0x7f660005e770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:27.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66180f6620 0x7f661806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:27.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 --2- 172.21.15.8:0/3387394816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66180f78c0 0x7f6618069e20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:27.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 -- 172.21.15.8:0/3387394816 >> 172.21.15.8:0/3387394816 conn(0x7f66180f1da0 msgr2=0x7f66180fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:27.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 -- 172.21.15.8:0/3387394816 shutdown_connections 2023-10-18T20:55:27.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:27.802+0000 7f661cea7700 1 -- 172.21.15.8:0/3387394816 wait complete. 2023-10-18T20:55:28.148 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:27.801818+0000 mon.smithi008 (mon.0) 452 : audit [DBG] from='client.? 172.21.15.8:0/3387394816' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-18T20:55:28.172 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855366 got 150323855368 for osd.5 2023-10-18T20:55:28.173 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-18T20:55:28.173 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph pg dump --format=json 2023-10-18T20:55:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:27.801818+0000 mon.smithi008 (mon.0) 452 : audit [DBG] from='client.? 172.21.15.8:0/3387394816' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-18T20:55:28.539 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.516+0000 7f86c23bd700 1 -- 172.21.15.8:0/69762124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86bc0f78c0 msgr2=0x7f86bc0f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.516+0000 7f86c23bd700 1 --2- 172.21.15.8:0/69762124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86bc0f78c0 0x7f86bc0f7d20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f86ac004660 tx=0x7f86ac009b30).stop 2023-10-18T20:55:29.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.516+0000 7f86c23bd700 1 -- 172.21.15.8:0/69762124 shutdown_connections 2023-10-18T20:55:29.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.516+0000 7f86c23bd700 1 --2- 172.21.15.8:0/69762124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86bc0f78c0 0x7f86bc0f7d20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:29.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.516+0000 7f86c23bd700 1 --2- 172.21.15.8:0/69762124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86bc0f6620 0x7f86bc0f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:29.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.516+0000 7f86c23bd700 1 -- 172.21.15.8:0/69762124 >> 172.21.15.8:0/69762124 conn(0x7f86bc0f1da0 msgr2=0x7f86bc0f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:29.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.516+0000 7f86c23bd700 1 -- 172.21.15.8:0/69762124 shutdown_connections 2023-10-18T20:55:29.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.516+0000 7f86c23bd700 1 -- 172.21.15.8:0/69762124 wait complete. 2023-10-18T20:55:29.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.517+0000 7f86c23bd700 1 Processor -- start 2023-10-18T20:55:29.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.518+0000 7f86c23bd700 1 -- start start 2023-10-18T20:55:29.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.518+0000 7f86c23bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86bc0f6620 0x7f86bc106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:29.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.518+0000 7f86c23bd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86bc0f78c0 0x7f86bc1073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:29.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.518+0000 7f86c23bd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc107980 con 0x7f86bc0f78c0 2023-10-18T20:55:29.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.518+0000 7f86c23bd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc107ac0 con 0x7f86bc0f6620 2023-10-18T20:55:29.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.518+0000 7f86c0bba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86bc0f78c0 0x7f86bc1073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:29.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.518+0000 7f86c0bba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86bc0f78c0 0x7f86bc1073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39152/0 (socket says 172.21.15.8:39152) 2023-10-18T20:55:29.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.518+0000 7f86c0bba700 1 -- 172.21.15.8:0/1174067860 learned_addr learned my addr 172.21.15.8:0/1174067860 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:29.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.519+0000 7f86c13bb700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86bc0f6620 0x7f86bc106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:29.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.519+0000 7f86c0bba700 1 -- 172.21.15.8:0/1174067860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86bc0f6620 msgr2=0x7f86bc106ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:29.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.519+0000 7f86c0bba700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86bc0f6620 0x7f86bc106ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:29.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.519+0000 7f86c0bba700 1 -- 172.21.15.8:0/1174067860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac005040 con 0x7f86bc0f78c0 2023-10-18T20:55:29.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.519+0000 7f86c0bba700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86bc0f78c0 0x7f86bc1073d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f86ac009990 tx=0x7f86ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:29.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.519+0000 7f86b1ffb700 1 -- 172.21.15.8:0/1174067860 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86ac018070 con 0x7f86bc0f78c0 2023-10-18T20:55:29.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.519+0000 7f86b1ffb700 1 -- 172.21.15.8:0/1174067860 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f86ac013410 con 0x7f86bc0f78c0 2023-10-18T20:55:29.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.519+0000 7f86b1ffb700 1 -- 172.21.15.8:0/1174067860 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86ac01c3c0 con 0x7f86bc0f78c0 2023-10-18T20:55:29.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.519+0000 7f86c23bd700 1 -- 172.21.15.8:0/1174067860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86bc108400 con 0x7f86bc0f78c0 2023-10-18T20:55:29.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.519+0000 7f86c23bd700 1 -- 172.21.15.8:0/1174067860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86bc108960 con 0x7f86bc0f78c0 2023-10-18T20:55:29.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.520+0000 7f86c23bd700 1 -- 172.21.15.8:0/1174067860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86bc045ad0 con 0x7f86bc0f78c0 2023-10-18T20:55:29.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.521+0000 7f86b1ffb700 1 -- 172.21.15.8:0/1174067860 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f86ac01d420 con 0x7f86bc0f78c0 2023-10-18T20:55:29.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.522+0000 7f86b1ffb700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f86a805c2a0 0x7f86a805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:29.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.522+0000 7f86b1ffb700 1 -- 172.21.15.8:0/1174067860 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f86ac0778d0 con 0x7f86bc0f78c0 2023-10-18T20:55:29.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.522+0000 7f86c13bb700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f86a805c2a0 0x7f86a805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:29.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.523+0000 7f86c13bb700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f86a805c2a0 0x7f86a805e760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f86bc0f7720 tx=0x7f86b8009c00).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:29.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.526+0000 7f86b1ffb700 1 -- 172.21.15.8:0/1174067860 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f86ac04a830 con 0x7f86bc0f78c0 2023-10-18T20:55:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:28.117496+0000 mgr.smithi008.flmjzp (mgr.14164) 180 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:29.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.689+0000 7f86c23bd700 1 -- 172.21.15.8:0/1174067860 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86bc0008d0 con 0x7f86a805c2a0 2023-10-18T20:55:29.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.690+0000 7f86b1ffb700 1 -- 172.21.15.8:0/1174067860 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24177 (secure 0 0 0) 0x7f86bc0008d0 con 0x7f86a805c2a0 2023-10-18T20:55:29.694 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:29.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.692+0000 7f86c23bd700 1 -- 172.21.15.8:0/1174067860 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f86a805c2a0 msgr2=0x7f86a805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:29.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.692+0000 7f86c23bd700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f86a805c2a0 0x7f86a805e760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f86bc0f7720 tx=0x7f86b8009c00).stop 2023-10-18T20:55:29.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.692+0000 7f86c23bd700 1 -- 172.21.15.8:0/1174067860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86bc0f78c0 msgr2=0x7f86bc1073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:29.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.692+0000 7f86c23bd700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86bc0f78c0 0x7f86bc1073d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f86ac009990 tx=0x7f86ac009b30).stop 2023-10-18T20:55:29.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.693+0000 7f86c23bd700 1 -- 172.21.15.8:0/1174067860 shutdown_connections 2023-10-18T20:55:29.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.693+0000 7f86c23bd700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f86a805c2a0 0x7f86a805e760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:29.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.693+0000 7f86c23bd700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86bc0f6620 0x7f86bc106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:29.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.693+0000 7f86c23bd700 1 --2- 172.21.15.8:0/1174067860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86bc0f78c0 0x7f86bc1073d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:29.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.693+0000 7f86c23bd700 1 -- 172.21.15.8:0/1174067860 >> 172.21.15.8:0/1174067860 conn(0x7f86bc0f1da0 msgr2=0x7f86bc0fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:29.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.693+0000 7f86c23bd700 1 -- 172.21.15.8:0/1174067860 shutdown_connections 2023-10-18T20:55:29.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:29.693+0000 7f86c23bd700 1 -- 172.21.15.8:0/1174067860 wait complete. 2023-10-18T20:55:29.699 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-18T20:55:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:28.117496+0000 mgr.smithi008.flmjzp (mgr.14164) 180 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:30.068 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-10-18T20:55:28.117373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":30936,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":28992,"kb_avail":562439976,"statfs":{"total":575970213888,"available":575938535424,"internally_reserved":0,"allocated":1941504,"data_stored":720732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29687808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"33","reported_epoch":"35","state":"active+clean","last_fresh":"2023-10-18T20:54:50.374620+0000","last_change":"2023-10-18T20:54:34.101500+0000","last_active":"2023-10-18T20:54:50.374620+0000","last_peered":"2023-10-18T20:54:50.374620+0000","last_clean":"2023-10-18T20:54:50.374620+0000","last_became_active":"2023-10-18T20:54:34.101173+0000","last_became_peered":"2023-10-18T20:54:34.101173+0000","last_unstale":"2023-10-18T20:54:50.374620+0000","last_undegraded":"2023-10-18T20:54:50.374620+0000","last_fullsized":"2023-10-18T20:54:50.374620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T20:54:12.365005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T20:54:12.365005+0000","last_clean_scrub_stamp":"2023-10-18T20:54:12.365005+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":35,"seq":150323855369,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5060,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740092,"statfs":{"total":95995035648,"available":95989854208,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":4,"up_from":31,"seq":133143986188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5060,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740092,"statfs":{"total":95995035648,"available":95989854208,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149711,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5124,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93740028,"statfs":{"total":95995035648,"available":95989788672,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54900000000000004}]},{"osd":1,"last update":"Wed Oct 18 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.5},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Oct 18 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378643,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5188,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739964,"statfs":{"total":95995035648,"available":95989723136,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 20:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.62},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64600000000000002}]},{"osd":1,"last update":"Wed Oct 18 20:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.66100000000000003}]},{"osd":3,"last update":"Wed Oct 18 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5252,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739900,"statfs":{"total":95995035648,"available":95989657600,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 20:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Wed Oct 18 20:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Wed Oct 18 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5252,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739900,"statfs":{"total":95995035648,"available":95989657600,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 20:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.36599999999999999}]},{"osd":2,"last update":"Wed Oct 18 20:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.432}]},{"osd":3,"last update":"Wed Oct 18 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T20:55:30.069 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph pg dump --format=json 2023-10-18T20:55:30.432 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:30.646 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:29.690977+0000 mgr.smithi008.flmjzp (mgr.14164) 181 : audit [DBG] from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T20:55:30.646 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:30.117745+0000 mgr.smithi008.flmjzp (mgr.14164) 182 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:29.690977+0000 mgr.smithi008.flmjzp (mgr.14164) 181 : audit [DBG] from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T20:55:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:30.117745+0000 mgr.smithi008.flmjzp (mgr.14164) 182 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:31.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.507+0000 7f44ff59e700 1 -- 172.21.15.8:0/721816974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45000f78c0 msgr2=0x7f45000f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:31.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.507+0000 7f44ff59e700 1 --2- 172.21.15.8:0/721816974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45000f78c0 0x7f45000f7d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f44f4004660 tx=0x7f44f4009b30).stop 2023-10-18T20:55:31.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.507+0000 7f44ff59e700 1 -- 172.21.15.8:0/721816974 shutdown_connections 2023-10-18T20:55:31.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.507+0000 7f44ff59e700 1 --2- 172.21.15.8:0/721816974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45000f78c0 0x7f45000f7d20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:31.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.507+0000 7f44ff59e700 1 --2- 172.21.15.8:0/721816974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45000f6620 0x7f45000f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:31.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.507+0000 7f44ff59e700 1 -- 172.21.15.8:0/721816974 >> 172.21.15.8:0/721816974 conn(0x7f45000f1da0 msgr2=0x7f45000f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:31.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.507+0000 7f44ff59e700 1 -- 172.21.15.8:0/721816974 shutdown_connections 2023-10-18T20:55:31.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.507+0000 7f44ff59e700 1 -- 172.21.15.8:0/721816974 wait complete. 2023-10-18T20:55:31.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.508+0000 7f44ff59e700 1 Processor -- start 2023-10-18T20:55:31.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.508+0000 7f44ff59e700 1 -- start start 2023-10-18T20:55:31.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.508+0000 7f44ff59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45000f6620 0x7f45001090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:31.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.508+0000 7f44ff59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45000f78c0 0x7f45001095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:31.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.508+0000 7f44ff59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4500109b90 con 0x7f45000f6620 2023-10-18T20:55:31.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.508+0000 7f44ff59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4500109cd0 con 0x7f45000f78c0 2023-10-18T20:55:31.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.509+0000 7f44fe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45000f6620 0x7f45001090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:31.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.509+0000 7f44fe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45000f6620 0x7f45001090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39172/0 (socket says 172.21.15.8:39172) 2023-10-18T20:55:31.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.509+0000 7f44fe59c700 1 -- 172.21.15.8:0/4066164475 learned_addr learned my addr 172.21.15.8:0/4066164475 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:31.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.509+0000 7f44fdd9b700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45000f78c0 0x7f45001095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:31.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.509+0000 7f44fe59c700 1 -- 172.21.15.8:0/4066164475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45000f78c0 msgr2=0x7f45001095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.509+0000 7f44fe59c700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45000f78c0 0x7f45001095e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.509+0000 7f44fe59c700 1 -- 172.21.15.8:0/4066164475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4005040 con 0x7f45000f6620 2023-10-18T20:55:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.509+0000 7f44fe59c700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45000f6620 0x7f45001090f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f44f0002700 tx=0x7f44f0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.509+0000 7f44eeffd700 1 -- 172.21.15.8:0/4066164475 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f00079c0 con 0x7f45000f6620 2023-10-18T20:55:31.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.509+0000 7f44eeffd700 1 -- 172.21.15.8:0/4066164475 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f44f000f040 con 0x7f45000f6620 2023-10-18T20:55:31.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.510+0000 7f44eeffd700 1 -- 172.21.15.8:0/4066164475 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f0014860 con 0x7f45000f6620 2023-10-18T20:55:31.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.510+0000 7f44ff59e700 1 -- 172.21.15.8:0/4066164475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450010a670 con 0x7f45000f6620 2023-10-18T20:55:31.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.510+0000 7f44ff59e700 1 -- 172.21.15.8:0/4066164475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450010ac30 con 0x7f45000f6620 2023-10-18T20:55:31.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.511+0000 7f44ff59e700 1 -- 172.21.15.8:0/4066164475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4500045ad0 con 0x7f45000f6620 2023-10-18T20:55:31.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.511+0000 7f44eeffd700 1 -- 172.21.15.8:0/4066164475 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f44f001b060 con 0x7f45000f6620 2023-10-18T20:55:31.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.512+0000 7f44eeffd700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f44e805c300 0x7f44e805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:31.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.512+0000 7f44eeffd700 1 -- 172.21.15.8:0/4066164475 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f44f0075a00 con 0x7f45000f6620 2023-10-18T20:55:31.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.513+0000 7f44fdd9b700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f44e805c300 0x7f44e805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:31.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.513+0000 7f44fdd9b700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f44e805c300 0x7f44e805e7c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f44f4009f50 tx=0x7f44f4009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:31.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.516+0000 7f44eeffd700 1 -- 172.21.15.8:0/4066164475 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f44f00489c0 con 0x7f45000f6620 2023-10-18T20:55:31.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.678+0000 7f44ff59e700 1 -- 172.21.15.8:0/4066164475 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45000fef20 con 0x7f44e805c300 2023-10-18T20:55:31.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.680+0000 7f44eeffd700 1 -- 172.21.15.8:0/4066164475 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24165 (secure 0 0 0) 0x7f45000fef20 con 0x7f44e805c300 2023-10-18T20:55:31.683 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:31.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 -- 172.21.15.8:0/4066164475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f44e805c300 msgr2=0x7f44e805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:31.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f44e805c300 0x7f44e805e7c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f44f4009f50 tx=0x7f44f4009b30).stop 2023-10-18T20:55:31.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 -- 172.21.15.8:0/4066164475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45000f6620 msgr2=0x7f45001090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:31.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45000f6620 0x7f45001090f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f44f0002700 tx=0x7f44f0009d80).stop 2023-10-18T20:55:31.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 -- 172.21.15.8:0/4066164475 shutdown_connections 2023-10-18T20:55:31.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45000f6620 0x7f45001090f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:31.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f44e805c300 0x7f44e805e7c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:31.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 --2- 172.21.15.8:0/4066164475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45000f78c0 0x7f45001095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:31.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 -- 172.21.15.8:0/4066164475 >> 172.21.15.8:0/4066164475 conn(0x7f45000f1da0 msgr2=0x7f450006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:31.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 -- 172.21.15.8:0/4066164475 shutdown_connections 2023-10-18T20:55:31.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:31.682+0000 7f44ff59e700 1 -- 172.21.15.8:0/4066164475 wait complete. 2023-10-18T20:55:31.687 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-18T20:55:32.041 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-10-18T20:55:30.117614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":30936,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":28992,"kb_avail":562439976,"statfs":{"total":575970213888,"available":575938535424,"internally_reserved":0,"allocated":1941504,"data_stored":720732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29687808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"33","reported_epoch":"35","state":"active+clean","last_fresh":"2023-10-18T20:54:50.374620+0000","last_change":"2023-10-18T20:54:34.101500+0000","last_active":"2023-10-18T20:54:50.374620+0000","last_peered":"2023-10-18T20:54:50.374620+0000","last_clean":"2023-10-18T20:54:50.374620+0000","last_became_active":"2023-10-18T20:54:34.101173+0000","last_became_peered":"2023-10-18T20:54:34.101173+0000","last_unstale":"2023-10-18T20:54:50.374620+0000","last_undegraded":"2023-10-18T20:54:50.374620+0000","last_fullsized":"2023-10-18T20:54:50.374620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T20:54:12.365005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T20:54:12.365005+0000","last_clean_scrub_stamp":"2023-10-18T20:54:12.365005+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":35,"seq":150323855369,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5060,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740092,"statfs":{"total":95995035648,"available":95989854208,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":4,"up_from":31,"seq":133143986189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5060,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740092,"statfs":{"total":95995035648,"available":95989854208,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149712,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5124,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93740028,"statfs":{"total":95995035648,"available":95989788672,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.69599999999999995}]},{"osd":1,"last update":"Wed Oct 18 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66000000000000003}]},{"osd":2,"last update":"Wed Oct 18 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.503},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378643,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5188,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739964,"statfs":{"total":95995035648,"available":95989723136,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 20:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.62},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64600000000000002}]},{"osd":1,"last update":"Wed Oct 18 20:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.66100000000000003}]},{"osd":3,"last update":"Wed Oct 18 20:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5252,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739900,"statfs":{"total":95995035648,"available":95989657600,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 20:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed Oct 18 20:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.377}]},{"osd":3,"last update":"Wed Oct 18 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5252,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739900,"statfs":{"total":95995035648,"available":95989657600,"internally_reserved":0,"allocated":323584,"data_stored":120122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 20:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.499},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.33800000000000002}]},{"osd":2,"last update":"Wed Oct 18 20:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.443},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.41199999999999998}]},{"osd":3,"last update":"Wed Oct 18 20:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T20:55:32.042 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-18T20:55:32.042 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-18T20:55:32.042 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-18T20:55:32.043 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- ceph health --format=json 2023-10-18T20:55:32.405 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e1aaa62c-6df7-11ee-8db6-212e2dc638e7/mon.smithi008/config 2023-10-18T20:55:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:31.680622+0000 mgr.smithi008.flmjzp (mgr.14164) 183 : audit [DBG] from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T20:55:33.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:32.118021+0000 mgr.smithi008.flmjzp (mgr.14164) 184 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:33.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.496+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2531979633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec0f6620 msgr2=0x7fc0ec0f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:33.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.496+0000 7fc0eb59e700 1 --2- 172.21.15.8:0/2531979633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec0f6620 0x7fc0ec0f6a40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fc0dc004660 tx=0x7fc0dc009b30).stop 2023-10-18T20:55:33.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.496+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2531979633 shutdown_connections 2023-10-18T20:55:33.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.496+0000 7fc0eb59e700 1 --2- 172.21.15.8:0/2531979633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0ec0f78c0 0x7fc0ec0f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.496+0000 7fc0eb59e700 1 --2- 172.21.15.8:0/2531979633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec0f6620 0x7fc0ec0f6a40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.496+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2531979633 >> 172.21.15.8:0/2531979633 conn(0x7fc0ec0f1da0 msgr2=0x7fc0ec0f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.496+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2531979633 shutdown_connections 2023-10-18T20:55:33.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.496+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2531979633 wait complete. 2023-10-18T20:55:33.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.497+0000 7fc0eb59e700 1 Processor -- start 2023-10-18T20:55:33.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.497+0000 7fc0eb59e700 1 -- start start 2023-10-18T20:55:33.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.497+0000 7fc0eb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0ec0f6620 0x7fc0ec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:33.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.497+0000 7fc0eb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec0f78c0 0x7fc0ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:33.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.497+0000 7fc0eb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec06a380 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.497+0000 7fc0eb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec06a4c0 con 0x7fc0ec0f6620 2023-10-18T20:55:33.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.498+0000 7fc0e9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec0f78c0 0x7fc0ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:33.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.498+0000 7fc0e9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec0f78c0 0x7fc0ec069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39204/0 (socket says 172.21.15.8:39204) 2023-10-18T20:55:33.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.498+0000 7fc0e9d9b700 1 -- 172.21.15.8:0/2303323194 learned_addr learned my addr 172.21.15.8:0/2303323194 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:33.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.498+0000 7fc0ea59c700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0ec0f6620 0x7fc0ec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:33.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.498+0000 7fc0e9d9b700 1 -- 172.21.15.8:0/2303323194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0ec0f6620 msgr2=0x7fc0ec06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:33.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.498+0000 7fc0e9d9b700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0ec0f6620 0x7fc0ec06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:33.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.498+0000 7fc0e9d9b700 1 -- 172.21.15.8:0/2303323194 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc005040 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.498+0000 7fc0e9d9b700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec0f78c0 0x7fc0ec069e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc0e00026d0 tx=0x7fc0e0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.499+0000 7fc0daffd700 1 -- 172.21.15.8:0/2303323194 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e00079c0 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.499+0000 7fc0daffd700 1 -- 172.21.15.8:0/2303323194 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc0e000f040 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.499+0000 7fc0daffd700 1 -- 172.21.15.8:0/2303323194 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e00148b0 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.499+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2303323194 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ec06a7a0 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.499+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2303323194 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ec10ef40 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.500+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2303323194 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ec045ad0 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.501+0000 7fc0daffd700 1 -- 172.21.15.8:0/2303323194 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc0e0007b20 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.501+0000 7fc0daffd700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc0d405c2a0 0x7fc0d405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.501+0000 7fc0daffd700 1 -- 172.21.15.8:0/2303323194 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fc0e0075a80 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.502+0000 7fc0ea59c700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc0d405c2a0 0x7fc0d405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.502+0000 7fc0ea59c700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc0d405c2a0 0x7fc0d405e760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc0dc005010 tx=0x7fc0dc009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.505+0000 7fc0daffd700 1 -- 172.21.15.8:0/2303323194 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc0e0048b00 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:31.680622+0000 mgr.smithi008.flmjzp (mgr.14164) 183 : audit [DBG] from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T20:55:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:32.118021+0000 mgr.smithi008.flmjzp (mgr.14164) 184 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:33.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.733+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2303323194 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc0ec06a930 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.733+0000 7fc0daffd700 1 -- 172.21.15.8:0/2303323194 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fc0ec06a930 con 0x7fc0ec0f78c0 2023-10-18T20:55:33.737 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:33.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.735+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2303323194 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc0d405c2a0 msgr2=0x7fc0d405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:33.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.735+0000 7fc0eb59e700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc0d405c2a0 0x7fc0d405e760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc0dc005010 tx=0x7fc0dc009b30).stop 2023-10-18T20:55:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.735+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2303323194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec0f78c0 msgr2=0x7fc0ec069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.735+0000 7fc0eb59e700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec0f78c0 0x7fc0ec069e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc0e00026d0 tx=0x7fc0e0009de0).stop 2023-10-18T20:55:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.735+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2303323194 shutdown_connections 2023-10-18T20:55:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.735+0000 7fc0eb59e700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc0d405c2a0 0x7fc0d405e760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.735+0000 7fc0eb59e700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0ec0f6620 0x7fc0ec06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.735+0000 7fc0eb59e700 1 --2- 172.21.15.8:0/2303323194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec0f78c0 0x7fc0ec069e20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.735+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2303323194 >> 172.21.15.8:0/2303323194 conn(0x7fc0ec0f1da0 msgr2=0x7fc0ec0fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.736+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2303323194 shutdown_connections 2023-10-18T20:55:33.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:33.736+0000 7fc0eb59e700 1 -- 172.21.15.8:0/2303323194 wait complete. 2023-10-18T20:55:34.115 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-18T20:55:34.115 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-18T20:55:34.116 INFO:tasks.cephadm:Setup complete, yielding 2023-10-18T20:55:34.116 INFO:teuthology.run_tasks:Running task print... 2023-10-18T20:55:34.126 INFO:teuthology.task.print:**** done starting v16.2.4 2023-10-18T20:55:34.126 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-18T20:55:34.134 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:55:34.135 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-18T20:55:34.622 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:33.735263+0000 mon.smithi008 (mon.0) 453 : audit [DBG] from='client.? 172.21.15.8:0/2303323194' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-18T20:55:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:33.735263+0000 mon.smithi008 (mon.0) 453 : audit [DBG] from='client.? 172.21.15.8:0/2303323194' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-18T20:55:35.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.434+0000 7f662ab8f700 1 -- 172.21.15.8:0/1859938299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66240f77d0 msgr2=0x7f66240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:35.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.434+0000 7f662ab8f700 1 --2- 172.21.15.8:0/1859938299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66240f77d0 0x7f66240f7c30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f6614004660 tx=0x7f6614009b30).stop 2023-10-18T20:55:35.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.434+0000 7f662ab8f700 1 -- 172.21.15.8:0/1859938299 shutdown_connections 2023-10-18T20:55:35.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.434+0000 7f662ab8f700 1 --2- 172.21.15.8:0/1859938299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66240f77d0 0x7f66240f7c30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:35.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.434+0000 7f662ab8f700 1 --2- 172.21.15.8:0/1859938299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66240f6530 0x7f66240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:35.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.434+0000 7f662ab8f700 1 -- 172.21.15.8:0/1859938299 >> 172.21.15.8:0/1859938299 conn(0x7f66240f1c90 msgr2=0x7f66240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:35.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.434+0000 7f662ab8f700 1 -- 172.21.15.8:0/1859938299 shutdown_connections 2023-10-18T20:55:35.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.434+0000 7f662ab8f700 1 -- 172.21.15.8:0/1859938299 wait complete. 2023-10-18T20:55:35.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.435+0000 7f662ab8f700 1 Processor -- start 2023-10-18T20:55:35.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.436+0000 7f662ab8f700 1 -- start start 2023-10-18T20:55:35.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.436+0000 7f662ab8f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66240f6530 0x7f6624108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:35.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.436+0000 7f662ab8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66240f77d0 0x7f6624109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:35.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.436+0000 7f662ab8f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66241099b0 con 0x7f66240f77d0 2023-10-18T20:55:35.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.436+0000 7f662ab8f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6624109af0 con 0x7f66240f6530 2023-10-18T20:55:35.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.436+0000 7f662938c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66240f77d0 0x7f6624109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:35.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.436+0000 7f6629b8d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66240f6530 0x7f6624108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:35.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.436+0000 7f662938c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66240f77d0 0x7f6624109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39234/0 (socket says 172.21.15.8:39234) 2023-10-18T20:55:35.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.436+0000 7f662938c700 1 -- 172.21.15.8:0/254940162 learned_addr learned my addr 172.21.15.8:0/254940162 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:35.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.437+0000 7f662938c700 1 -- 172.21.15.8:0/254940162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66240f6530 msgr2=0x7f6624108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:35.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.437+0000 7f662938c700 1 --2- 172.21.15.8:0/254940162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66240f6530 0x7f6624108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:35.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.437+0000 7f662938c700 1 -- 172.21.15.8:0/254940162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6614005040 con 0x7f66240f77d0 2023-10-18T20:55:35.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.437+0000 7f662938c700 1 --2- 172.21.15.8:0/254940162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66240f77d0 0x7f6624109400 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f6614009990 tx=0x7f6614009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:35.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.437+0000 7f661a7fc700 1 -- 172.21.15.8:0/254940162 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6614018070 con 0x7f66240f77d0 2023-10-18T20:55:35.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.437+0000 7f661a7fc700 1 -- 172.21.15.8:0/254940162 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6614013410 con 0x7f66240f77d0 2023-10-18T20:55:35.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.437+0000 7f662ab8f700 1 -- 172.21.15.8:0/254940162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662410a430 con 0x7f66240f77d0 2023-10-18T20:55:35.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.437+0000 7f661a7fc700 1 -- 172.21.15.8:0/254940162 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f661401c3c0 con 0x7f66240f77d0 2023-10-18T20:55:35.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.437+0000 7f662ab8f700 1 -- 172.21.15.8:0/254940162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662410a990 con 0x7f66240f77d0 2023-10-18T20:55:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.438+0000 7f662ab8f700 1 -- 172.21.15.8:0/254940162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6624045ad0 con 0x7f66240f77d0 2023-10-18T20:55:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.439+0000 7f661a7fc700 1 -- 172.21.15.8:0/254940162 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f661401d420 con 0x7f66240f77d0 2023-10-18T20:55:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.440+0000 7f661a7fc700 1 --2- 172.21.15.8:0/254940162 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f661005c2f0 0x7f661005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.440+0000 7f661a7fc700 1 -- 172.21.15.8:0/254940162 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f6614077970 con 0x7f66240f77d0 2023-10-18T20:55:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.440+0000 7f6629b8d700 1 --2- 172.21.15.8:0/254940162 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f661005c2f0 0x7f661005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.441+0000 7f6629b8d700 1 --2- 172.21.15.8:0/254940162 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f661005c2f0 0x7f661005e7b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f66240f7630 tx=0x7f662000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.444+0000 7f661a7fc700 1 -- 172.21.15.8:0/254940162 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f661404a850 con 0x7f66240f77d0 2023-10-18T20:55:35.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.641+0000 7f662ab8f700 1 -- 172.21.15.8:0/254940162 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66240fee30 con 0x7f661005c2f0 2023-10-18T20:55:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.643+0000 7f661a7fc700 1 -- 172.21.15.8:0/254940162 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f66240fee30 con 0x7f661005c2f0 2023-10-18T20:55:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:Backend: cephadm 2023-10-18T20:55:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:Available: Yes 2023-10-18T20:55:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:Paused: No 2023-10-18T20:55:35.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.644+0000 7f662ab8f700 1 -- 172.21.15.8:0/254940162 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f661005c2f0 msgr2=0x7f661005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:35.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.644+0000 7f662ab8f700 1 --2- 172.21.15.8:0/254940162 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f661005c2f0 0x7f661005e7b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f66240f7630 tx=0x7f662000b040).stop 2023-10-18T20:55:35.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.644+0000 7f662ab8f700 1 -- 172.21.15.8:0/254940162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66240f77d0 msgr2=0x7f6624109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:35.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.644+0000 7f662ab8f700 1 --2- 172.21.15.8:0/254940162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66240f77d0 0x7f6624109400 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f6614009990 tx=0x7f6614009b30).stop 2023-10-18T20:55:35.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.644+0000 7f662ab8f700 1 -- 172.21.15.8:0/254940162 shutdown_connections 2023-10-18T20:55:35.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.644+0000 7f662ab8f700 1 --2- 172.21.15.8:0/254940162 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f661005c2f0 0x7f661005e7b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:35.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.644+0000 7f662ab8f700 1 --2- 172.21.15.8:0/254940162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66240f6530 0x7f6624108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:35.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.644+0000 7f662ab8f700 1 --2- 172.21.15.8:0/254940162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66240f77d0 0x7f6624109400 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:35.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.644+0000 7f662ab8f700 1 -- 172.21.15.8:0/254940162 >> 172.21.15.8:0/254940162 conn(0x7f66240f1c90 msgr2=0x7f662406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:35.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.645+0000 7f662ab8f700 1 -- 172.21.15.8:0/254940162 shutdown_connections 2023-10-18T20:55:35.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:35.645+0000 7f662ab8f700 1 -- 172.21.15.8:0/254940162 wait complete. 2023-10-18T20:55:35.668 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:34.118363+0000 mgr.smithi008.flmjzp (mgr.14164) 185 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:34.118363+0000 mgr.smithi008.flmjzp (mgr.14164) 185 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:36.023 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-18T20:55:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:35.644097+0000 mgr.smithi008.flmjzp (mgr.14164) 186 : audit [DBG] from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:36.118651+0000 mgr.smithi008.flmjzp (mgr.14164) 187 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:35.644097+0000 mgr.smithi008.flmjzp (mgr.14164) 186 : audit [DBG] from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:36.118651+0000 mgr.smithi008.flmjzp (mgr.14164) 187 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.417+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/3815660770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3c00f77d0 msgr2=0x7fa3c00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.417+0000 7fa3c4f6b700 1 --2- 172.21.15.8:0/3815660770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3c00f77d0 0x7fa3c00f7c30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fa3b4004660 tx=0x7fa3b4009b30).stop 2023-10-18T20:55:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.417+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/3815660770 shutdown_connections 2023-10-18T20:55:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.417+0000 7fa3c4f6b700 1 --2- 172.21.15.8:0/3815660770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3c00f77d0 0x7fa3c00f7c30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.417+0000 7fa3c4f6b700 1 --2- 172.21.15.8:0/3815660770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c00f6530 0x7fa3c00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.417+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/3815660770 >> 172.21.15.8:0/3815660770 conn(0x7fa3c00f1c90 msgr2=0x7fa3c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.417+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/3815660770 shutdown_connections 2023-10-18T20:55:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.418+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/3815660770 wait complete. 2023-10-18T20:55:37.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.418+0000 7fa3c4f6b700 1 Processor -- start 2023-10-18T20:55:37.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.418+0000 7fa3c4f6b700 1 -- start start 2023-10-18T20:55:37.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3c4f6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3c00f6530 0x7fa3c0106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:37.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3c4f6b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c00f77d0 0x7fa3c0107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:37.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3c4f6b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01077d0 con 0x7fa3c00f6530 2023-10-18T20:55:37.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3c4f6b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0107fd0 con 0x7fa3c00f77d0 2023-10-18T20:55:37.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3c00f6530 0x7fa3c0106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:37.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3c00f6530 0x7fa3c0106d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51386/0 (socket says 172.21.15.8:51386) 2023-10-18T20:55:37.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3bf7fe700 1 -- 172.21.15.8:0/2509804391 learned_addr learned my addr 172.21.15.8:0/2509804391 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:37.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3bf7fe700 1 -- 172.21.15.8:0/2509804391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c00f77d0 msgr2=0x7fa3c0107220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:37.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3bf7fe700 1 --2- 172.21.15.8:0/2509804391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c00f77d0 0x7fa3c0107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:55:37.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3bf7fe700 1 -- 172.21.15.8:0/2509804391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b4005040 con 0x7fa3c00f6530 2023-10-18T20:55:37.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.419+0000 7fa3bf7fe700 1 --2- 172.21.15.8:0/2509804391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3c00f6530 0x7fa3c0106d30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fa3b000e7c0 tx=0x7fa3b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:37.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.420+0000 7fa3a7fff700 1 -- 172.21.15.8:0/2509804391 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3b00092e0 con 0x7fa3c00f6530 2023-10-18T20:55:37.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.420+0000 7fa3a7fff700 1 -- 172.21.15.8:0/2509804391 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa3b000f040 con 0x7fa3c00f6530 2023-10-18T20:55:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.420+0000 7fa3a7fff700 1 -- 172.21.15.8:0/2509804391 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3b0014750 con 0x7fa3c00f6530 2023-10-18T20:55:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.420+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/2509804391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c01082b0 con 0x7fa3c00f6530 2023-10-18T20:55:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.420+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/2509804391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c0108870 con 0x7fa3c00f6530 2023-10-18T20:55:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.421+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/2509804391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c0059100 con 0x7fa3c00f6530 2023-10-18T20:55:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.422+0000 7fa3a7fff700 1 -- 172.21.15.8:0/2509804391 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa3b001b030 con 0x7fa3c00f6530 2023-10-18T20:55:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.422+0000 7fa3a7fff700 1 --2- 172.21.15.8:0/2509804391 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa3a805c2f0 0x7fa3a805e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.423+0000 7fa3a7fff700 1 -- 172.21.15.8:0/2509804391 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fa3b0075b80 con 0x7fa3c00f6530 2023-10-18T20:55:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.423+0000 7fa3beffd700 1 --2- 172.21.15.8:0/2509804391 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa3a805c2f0 0x7fa3a805e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:37.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.423+0000 7fa3beffd700 1 --2- 172.21.15.8:0/2509804391 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa3a805c2f0 0x7fa3a805e7b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa3b4005010 tx=0x7fa3b400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:37.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.426+0000 7fa3a7fff700 1 -- 172.21.15.8:0/2509804391 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa3b0048b80 con 0x7fa3c00f6530 2023-10-18T20:55:37.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.623+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/2509804391 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3c00fee30 con 0x7fa3a805c2f0 2023-10-18T20:55:37.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.630+0000 7fa3a7fff700 1 -- 172.21.15.8:0/2509804391 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2160 (secure 0 0 0) 0x7fa3c00fee30 con 0x7fa3a805c2f0 2023-10-18T20:55:37.634 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2023-10-18T20:55:37.634 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (2m) 50s ago 3m 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T20:55:37.634 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (3m) 50s ago 3m 16.2.4 8d91d370c2b8 4b2c6838af84 2023-10-18T20:55:37.635 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (2m) 52s ago 2m 16.2.4 8d91d370c2b8 67dc04156fe1 2023-10-18T20:55:37.635 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (2m) 50s ago 3m 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T20:55:37.635 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:9283 running (5m) 50s ago 5m 16.2.4 8d91d370c2b8 ee1a6b0bd8ee 2023-10-18T20:55:37.635 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (2m) 52s ago 2m 16.2.4 8d91d370c2b8 b685ab58431c 2023-10-18T20:55:37.636 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (5m) 50s ago 5m 16.2.4 8d91d370c2b8 9de89e6e28e5 2023-10-18T20:55:37.636 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (2m) 52s ago 2m 16.2.4 8d91d370c2b8 d7c00f2c13a4 2023-10-18T20:55:37.636 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (3m) 50s ago 3m 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T20:55:37.637 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (2m) 52s ago 2m 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T20:55:37.637 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (2m) 50s ago 2m 16.2.4 8d91d370c2b8 885270808f90 2023-10-18T20:55:37.637 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (2m) 50s ago 2m 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T20:55:37.637 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (101s) 50s ago 101s 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T20:55:37.638 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (86s) 52s ago 86s 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T20:55:37.638 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (70s) 52s ago 70s 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T20:55:37.638 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (54s) 52s ago 54s 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T20:55:37.639 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (2m) 50s ago 3m 2.18.1 de242295e225 0af47d38e46d 2023-10-18T20:55:37.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/2509804391 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa3a805c2f0 msgr2=0x7fa3a805e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:37.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 --2- 172.21.15.8:0/2509804391 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa3a805c2f0 0x7fa3a805e7b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa3b4005010 tx=0x7fa3b400b040).stop 2023-10-18T20:55:37.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/2509804391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3c00f6530 msgr2=0x7fa3c0106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:37.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 --2- 172.21.15.8:0/2509804391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3c00f6530 0x7fa3c0106d30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fa3b000e7c0 tx=0x7fa3b000b040).stop 2023-10-18T20:55:37.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/2509804391 shutdown_connections 2023-10-18T20:55:37.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 --2- 172.21.15.8:0/2509804391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3c00f6530 0x7fa3c0106d30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:37.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 --2- 172.21.15.8:0/2509804391 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fa3a805c2f0 0x7fa3a805e7b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:37.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 --2- 172.21.15.8:0/2509804391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c00f77d0 0x7fa3c0107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:55:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/2509804391 >> 172.21.15.8:0/2509804391 conn(0x7fa3c00f1c90 msgr2=0x7fa3c00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/2509804391 shutdown_connections 2023-10-18T20:55:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:37.633+0000 7fa3c4f6b700 1 -- 172.21.15.8:0/2509804391 wait complete. 2023-10-18T20:55:37.931 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-18T20:55:39.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.266+0000 7f74ccc74700 1 -- 172.21.15.8:0/2168357789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c8060310 msgr2=0x7f74c80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:39.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.267+0000 7f74ccc74700 1 --2- 172.21.15.8:0/2168357789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c8060310 0x7f74c80f9110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f74b8004660 tx=0x7f74b8009b30).stop 2023-10-18T20:55:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.267+0000 7f74ccc74700 1 -- 172.21.15.8:0/2168357789 shutdown_connections 2023-10-18T20:55:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.267+0000 7f74ccc74700 1 --2- 172.21.15.8:0/2168357789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c80f9690 0x7f74c80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.267+0000 7f74ccc74700 1 --2- 172.21.15.8:0/2168357789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c8060310 0x7f74c80f9110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.267+0000 7f74ccc74700 1 -- 172.21.15.8:0/2168357789 >> 172.21.15.8:0/2168357789 conn(0x7f74c80f0b90 msgr2=0x7f74c80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.267+0000 7f74ccc74700 1 -- 172.21.15.8:0/2168357789 shutdown_connections 2023-10-18T20:55:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.267+0000 7f74ccc74700 1 -- 172.21.15.8:0/2168357789 wait complete. 2023-10-18T20:55:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.268+0000 7f74ccc74700 1 Processor -- start 2023-10-18T20:55:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.268+0000 7f74ccc74700 1 -- start start 2023-10-18T20:55:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.268+0000 7f74ccc74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c8060310 0x7f74c80f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.268+0000 7f74ccc74700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c80f9690 0x7f74c80f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.268+0000 7f74ccc74700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80f5570 con 0x7f74c8060310 2023-10-18T20:55:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.268+0000 7f74ccc74700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80f56b0 con 0x7f74c80f9690 2023-10-18T20:55:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.268+0000 7f74c77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c8060310 0x7f74c80f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.268+0000 7f74c77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c8060310 0x7f74c80f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51412/0 (socket says 172.21.15.8:51412) 2023-10-18T20:55:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.268+0000 7f74c77fe700 1 -- 172.21.15.8:0/982205434 learned_addr learned my addr 172.21.15.8:0/982205434 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.268+0000 7f74c6ffd700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c80f9690 0x7f74c80f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.269+0000 7f74c77fe700 1 -- 172.21.15.8:0/982205434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c80f9690 msgr2=0x7f74c80f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.269+0000 7f74c77fe700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c80f9690 0x7f74c80f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.269+0000 7f74c77fe700 1 -- 172.21.15.8:0/982205434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8005040 con 0x7f74c8060310 2023-10-18T20:55:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.269+0000 7f74c77fe700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c8060310 0x7f74c80f6b90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f74b8000c00 tx=0x7f74b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.269+0000 7f74affff700 1 -- 172.21.15.8:0/982205434 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b8019070 con 0x7f74c8060310 2023-10-18T20:55:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.269+0000 7f74affff700 1 -- 172.21.15.8:0/982205434 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74b8007e70 con 0x7f74c8060310 2023-10-18T20:55:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.269+0000 7f74ccc74700 1 -- 172.21.15.8:0/982205434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c80f5930 con 0x7f74c8060310 2023-10-18T20:55:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.269+0000 7f74affff700 1 -- 172.21.15.8:0/982205434 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b8014c90 con 0x7f74c8060310 2023-10-18T20:55:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.269+0000 7f74ccc74700 1 -- 172.21.15.8:0/982205434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c80f5e90 con 0x7f74c8060310 2023-10-18T20:55:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.270+0000 7f74ccc74700 1 -- 172.21.15.8:0/982205434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c8045ad0 con 0x7f74c8060310 2023-10-18T20:55:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.271+0000 7f74affff700 1 -- 172.21.15.8:0/982205434 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f74b8025070 con 0x7f74c8060310 2023-10-18T20:55:39.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.272+0000 7f74affff700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f74b005c300 0x7f74b005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:39.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.272+0000 7f74affff700 1 -- 172.21.15.8:0/982205434 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f74b8076be0 con 0x7f74c8060310 2023-10-18T20:55:39.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.272+0000 7f74c6ffd700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f74b005c300 0x7f74b005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.273+0000 7f74c6ffd700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f74b005c300 0x7f74b005e7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f74bc009fd0 tx=0x7f74bc00b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.276+0000 7f74affff700 1 -- 172.21.15.8:0/982205434 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f74b8049be0 con 0x7f74c8060310 2023-10-18T20:55:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:37.625936+0000 mgr.smithi008.flmjzp (mgr.14164) 188 : audit [DBG] from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:38.119085+0000 mgr.smithi008.flmjzp (mgr.14164) 189 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:39.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.469+0000 7f74ccc74700 1 -- 172.21.15.8:0/982205434 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f74c8057f10 con 0x7f74b005c300 2023-10-18T20:55:39.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.474+0000 7f74affff700 1 -- 172.21.15.8:0/982205434 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1098 (secure 0 0 0) 0x7f74c8057f10 con 0x7f74b005c300 2023-10-18T20:55:39.478 INFO:teuthology.orchestra.run.smithi008.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-18T20:55:39.479 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager 1/1 52s ago 4m count:1 2023-10-18T20:55:39.479 INFO:teuthology.orchestra.run.smithi008.stdout:crash 2/2 54s ago 4m * 2023-10-18T20:55:39.479 INFO:teuthology.orchestra.run.smithi008.stdout:grafana 1/1 52s ago 4m count:1 2023-10-18T20:55:39.480 INFO:teuthology.orchestra.run.smithi008.stdout:mgr 2/2 54s ago 4m count:2 2023-10-18T20:55:39.480 INFO:teuthology.orchestra.run.smithi008.stdout:mon 2/2 54s ago 3m smithi008:172.21.15.8=smithi008;smithi060:172.21.15.60=smithi060;count:2 2023-10-18T20:55:39.480 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter 2/2 54s ago 4m * 2023-10-18T20:55:39.481 INFO:teuthology.orchestra.run.smithi008.stdout:osd.unmanaged 6/6 54s ago - 2023-10-18T20:55:39.481 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus 1/1 52s ago 4m count:1 2023-10-18T20:55:39.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.475+0000 7f74ccc74700 1 -- 172.21.15.8:0/982205434 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f74b005c300 msgr2=0x7f74b005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:39.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.475+0000 7f74ccc74700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f74b005c300 0x7f74b005e7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f74bc009fd0 tx=0x7f74bc00b040).stop 2023-10-18T20:55:39.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.475+0000 7f74ccc74700 1 -- 172.21.15.8:0/982205434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c8060310 msgr2=0x7f74c80f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:39.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.475+0000 7f74ccc74700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c8060310 0x7f74c80f6b90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f74b8000c00 tx=0x7f74b800b040).stop 2023-10-18T20:55:39.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.476+0000 7f74ccc74700 1 -- 172.21.15.8:0/982205434 shutdown_connections 2023-10-18T20:55:39.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.476+0000 7f74ccc74700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c8060310 0x7f74c80f6b90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:39.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.476+0000 7f74ccc74700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f74b005c300 0x7f74b005e7c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:39.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.476+0000 7f74ccc74700 1 --2- 172.21.15.8:0/982205434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c80f9690 0x7f74c80f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:39.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.476+0000 7f74ccc74700 1 -- 172.21.15.8:0/982205434 >> 172.21.15.8:0/982205434 conn(0x7f74c80f0b90 msgr2=0x7f74c80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:39.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.476+0000 7f74ccc74700 1 -- 172.21.15.8:0/982205434 shutdown_connections 2023-10-18T20:55:39.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:39.476+0000 7f74ccc74700 1 -- 172.21.15.8:0/982205434 wait complete. 2023-10-18T20:55:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:37.625936+0000 mgr.smithi008.flmjzp (mgr.14164) 188 : audit [DBG] from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:39.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:38.119085+0000 mgr.smithi008.flmjzp (mgr.14164) 189 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:39.882 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-18T20:55:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.184+0000 7fb9771df700 1 -- 172.21.15.8:0/1361468233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9700f6530 msgr2=0x7fb9700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.184+0000 7fb9771df700 1 --2- 172.21.15.8:0/1361468233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9700f6530 0x7fb9700f6950 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fb96c004660 tx=0x7fb96c009b30).stop 2023-10-18T20:55:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.184+0000 7fb9771df700 1 -- 172.21.15.8:0/1361468233 shutdown_connections 2023-10-18T20:55:41.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.184+0000 7fb9771df700 1 --2- 172.21.15.8:0/1361468233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9700f77d0 0x7fb9700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:41.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.184+0000 7fb9771df700 1 --2- 172.21.15.8:0/1361468233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9700f6530 0x7fb9700f6950 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:41.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.184+0000 7fb9771df700 1 -- 172.21.15.8:0/1361468233 >> 172.21.15.8:0/1361468233 conn(0x7fb9700f1c90 msgr2=0x7fb9700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:41.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.184+0000 7fb9771df700 1 -- 172.21.15.8:0/1361468233 shutdown_connections 2023-10-18T20:55:41.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.184+0000 7fb9771df700 1 -- 172.21.15.8:0/1361468233 wait complete. 2023-10-18T20:55:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.185+0000 7fb9771df700 1 Processor -- start 2023-10-18T20:55:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.185+0000 7fb9771df700 1 -- start start 2023-10-18T20:55:41.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9771df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9700f6530 0x7fb97006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9771df700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9700f77d0 0x7fb970069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9771df700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97006a380 con 0x7fb9700f77d0 2023-10-18T20:55:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9771df700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97006a4c0 con 0x7fb9700f6530 2023-10-18T20:55:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9759dc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9700f77d0 0x7fb970069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9759dc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9700f77d0 0x7fb970069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51432/0 (socket says 172.21.15.8:51432) 2023-10-18T20:55:41.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9759dc700 1 -- 172.21.15.8:0/2739744733 learned_addr learned my addr 172.21.15.8:0/2739744733 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:41.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9761dd700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9700f6530 0x7fb97006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:41.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9759dc700 1 -- 172.21.15.8:0/2739744733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9700f6530 msgr2=0x7fb97006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:41.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9759dc700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9700f6530 0x7fb97006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:41.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.186+0000 7fb9759dc700 1 -- 172.21.15.8:0/2739744733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c005040 con 0x7fb9700f77d0 2023-10-18T20:55:41.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.187+0000 7fb9759dc700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9700f77d0 0x7fb970069e20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb960002700 tx=0x7fb960009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:41.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.187+0000 7fb966ffd700 1 -- 172.21.15.8:0/2739744733 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb960009320 con 0x7fb9700f77d0 2023-10-18T20:55:41.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.187+0000 7fb966ffd700 1 -- 172.21.15.8:0/2739744733 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb96000f040 con 0x7fb9700f77d0 2023-10-18T20:55:41.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.187+0000 7fb966ffd700 1 -- 172.21.15.8:0/2739744733 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb960014870 con 0x7fb9700f77d0 2023-10-18T20:55:41.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.187+0000 7fb9771df700 1 -- 172.21.15.8:0/2739744733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97006a7a0 con 0x7fb9700f77d0 2023-10-18T20:55:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.187+0000 7fb9771df700 1 -- 172.21.15.8:0/2739744733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97010ed70 con 0x7fb9700f77d0 2023-10-18T20:55:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.188+0000 7fb9771df700 1 -- 172.21.15.8:0/2739744733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb970045ad0 con 0x7fb9700f77d0 2023-10-18T20:55:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.189+0000 7fb966ffd700 1 -- 172.21.15.8:0/2739744733 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb960009480 con 0x7fb9700f77d0 2023-10-18T20:55:41.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.190+0000 7fb966ffd700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb95c05c2f0 0x7fb95c05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:41.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.190+0000 7fb966ffd700 1 -- 172.21.15.8:0/2739744733 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fb960075d60 con 0x7fb9700f77d0 2023-10-18T20:55:41.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.190+0000 7fb9761dd700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb95c05c2f0 0x7fb95c05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:41.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.190+0000 7fb9761dd700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb95c05c2f0 0x7fb95c05e7b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb96c005010 tx=0x7fb96c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:41.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.194+0000 7fb966ffd700 1 -- 172.21.15.8:0/2739744733 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb960048de0 con 0x7fb9700f77d0 2023-10-18T20:55:41.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.385+0000 7fb9771df700 1 -- 172.21.15.8:0/2739744733 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9700fedd0 con 0x7fb95c05c2f0 2023-10-18T20:55:41.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.386+0000 7fb966ffd700 1 -- 172.21.15.8:0/2739744733 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+123 (secure 0 0 0) 0x7fb9700fedd0 con 0x7fb95c05c2f0 2023-10-18T20:55:41.388 INFO:teuthology.orchestra.run.smithi008.stdout:HOST ADDR LABELS STATUS 2023-10-18T20:55:41.388 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 172.21.15.8 2023-10-18T20:55:41.389 INFO:teuthology.orchestra.run.smithi008.stdout:smithi060 smithi060 2023-10-18T20:55:41.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.388+0000 7fb9771df700 1 -- 172.21.15.8:0/2739744733 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb95c05c2f0 msgr2=0x7fb95c05e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:41.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.388+0000 7fb9771df700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb95c05c2f0 0x7fb95c05e7b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb96c005010 tx=0x7fb96c009b30).stop 2023-10-18T20:55:41.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.388+0000 7fb9771df700 1 -- 172.21.15.8:0/2739744733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9700f77d0 msgr2=0x7fb970069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:41.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.388+0000 7fb9771df700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9700f77d0 0x7fb970069e20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb960002700 tx=0x7fb960009e00).stop 2023-10-18T20:55:41.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.389+0000 7fb9771df700 1 -- 172.21.15.8:0/2739744733 shutdown_connections 2023-10-18T20:55:41.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.389+0000 7fb9771df700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb95c05c2f0 0x7fb95c05e7b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:41.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.389+0000 7fb9771df700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9700f6530 0x7fb97006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:41.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.389+0000 7fb9771df700 1 --2- 172.21.15.8:0/2739744733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9700f77d0 0x7fb970069e20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:41.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.389+0000 7fb9771df700 1 -- 172.21.15.8:0/2739744733 >> 172.21.15.8:0/2739744733 conn(0x7fb9700f1c90 msgr2=0x7fb9700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:41.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.389+0000 7fb9771df700 1 -- 172.21.15.8:0/2739744733 shutdown_connections 2023-10-18T20:55:41.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:41.389+0000 7fb9771df700 1 -- 172.21.15.8:0/2739744733 wait complete. 2023-10-18T20:55:41.412 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:39.471010+0000 mgr.smithi008.flmjzp (mgr.14164) 190 : audit [DBG] from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:41.412 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:40.119374+0000 mgr.smithi008.flmjzp (mgr.14164) 191 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:39.471010+0000 mgr.smithi008.flmjzp (mgr.14164) 190 : audit [DBG] from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:40.119374+0000 mgr.smithi008.flmjzp (mgr.14164) 191 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:41.789 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-18T20:55:43.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.150+0000 7f1860805700 1 -- 172.21.15.8:0/3252259213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f185c0f6530 msgr2=0x7f185c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:43.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.150+0000 7f1860805700 1 --2- 172.21.15.8:0/3252259213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f185c0f6530 0x7f185c0f6950 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f184c004660 tx=0x7f184c009b30).stop 2023-10-18T20:55:43.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.150+0000 7f1860805700 1 -- 172.21.15.8:0/3252259213 shutdown_connections 2023-10-18T20:55:43.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.150+0000 7f1860805700 1 --2- 172.21.15.8:0/3252259213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f185c0f77d0 0x7f185c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:43.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.150+0000 7f1860805700 1 --2- 172.21.15.8:0/3252259213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f185c0f6530 0x7f185c0f6950 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:43.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.150+0000 7f1860805700 1 -- 172.21.15.8:0/3252259213 >> 172.21.15.8:0/3252259213 conn(0x7f185c0f1c90 msgr2=0x7f185c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:43.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.150+0000 7f1860805700 1 -- 172.21.15.8:0/3252259213 shutdown_connections 2023-10-18T20:55:43.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.150+0000 7f1860805700 1 -- 172.21.15.8:0/3252259213 wait complete. 2023-10-18T20:55:43.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.151+0000 7f1860805700 1 Processor -- start 2023-10-18T20:55:43.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.151+0000 7f1860805700 1 -- start start 2023-10-18T20:55:43.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.152+0000 7f1860805700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f185c0f6530 0x7f185c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:43.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.152+0000 7f1860805700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f185c0f77d0 0x7f185c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:43.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.152+0000 7f1860805700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c107880 con 0x7f185c0f77d0 2023-10-18T20:55:43.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.152+0000 7f1860805700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c1080c0 con 0x7f185c0f6530 2023-10-18T20:55:43.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.152+0000 7f185affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f185c0f77d0 0x7f185c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:43.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.152+0000 7f185affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f185c0f77d0 0x7f185c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51440/0 (socket says 172.21.15.8:51440) 2023-10-18T20:55:43.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.152+0000 7f185affd700 1 -- 172.21.15.8:0/3283319895 learned_addr learned my addr 172.21.15.8:0/3283319895 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:43.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.152+0000 7f185b7fe700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f185c0f6530 0x7f185c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:43.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.153+0000 7f185affd700 1 -- 172.21.15.8:0/3283319895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f185c0f6530 msgr2=0x7f185c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:43.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.153+0000 7f185affd700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f185c0f6530 0x7f185c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:43.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.153+0000 7f185affd700 1 -- 172.21.15.8:0/3283319895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c005040 con 0x7f185c0f77d0 2023-10-18T20:55:43.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.153+0000 7f185affd700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f185c0f77d0 0x7f185c107280 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f1850002700 tx=0x7f1850009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:43.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.153+0000 7f1843fff700 1 -- 172.21.15.8:0/3283319895 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1850009320 con 0x7f185c0f77d0 2023-10-18T20:55:43.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.153+0000 7f1843fff700 1 -- 172.21.15.8:0/3283319895 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f185000f040 con 0x7f185c0f77d0 2023-10-18T20:55:43.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.153+0000 7f1860805700 1 -- 172.21.15.8:0/3283319895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c1083a0 con 0x7f185c0f77d0 2023-10-18T20:55:43.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.153+0000 7f1843fff700 1 -- 172.21.15.8:0/3283319895 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1850014820 con 0x7f185c0f77d0 2023-10-18T20:55:43.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.153+0000 7f1860805700 1 -- 172.21.15.8:0/3283319895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c1088e0 con 0x7f185c0f77d0 2023-10-18T20:55:43.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.154+0000 7f1860805700 1 -- 172.21.15.8:0/3283319895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c059100 con 0x7f185c0f77d0 2023-10-18T20:55:43.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.155+0000 7f1843fff700 1 -- 172.21.15.8:0/3283319895 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f18500077b0 con 0x7f185c0f77d0 2023-10-18T20:55:43.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.156+0000 7f1843fff700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f184405c300 0x7f184405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:43.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.156+0000 7f1843fff700 1 -- 172.21.15.8:0/3283319895 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f1850075f00 con 0x7f185c0f77d0 2023-10-18T20:55:43.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.156+0000 7f185b7fe700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f184405c300 0x7f184405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:43.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.157+0000 7f185b7fe700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f184405c300 0x7f184405e7c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f185c107b50 tx=0x7f184c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:43.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.159+0000 7f1843fff700 1 -- 172.21.15.8:0/3283319895 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1850048e40 con 0x7f185c0f77d0 2023-10-18T20:55:43.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.352+0000 7f1860805700 1 -- 172.21.15.8:0/3283319895 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f185c0fee30 con 0x7f184405c300 2023-10-18T20:55:43.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.353+0000 7f1843fff700 1 -- 172.21.15.8:0/3283319895 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+279 (secure 0 0 0) 0x7f185c0fee30 con 0x7f184405c300 2023-10-18T20:55:43.355 INFO:teuthology.orchestra.run.smithi008.stdout:Hostname Path Type Serial Size Health Ident Fault Available 2023-10-18T20:55:43.355 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 /dev/nvme0n1 ssd PHMB7476004A480DGN 480G Unknown N/A N/A No 2023-10-18T20:55:43.355 INFO:teuthology.orchestra.run.smithi008.stdout:smithi060 /dev/nvme0n1 ssd PHMB7476008A480DGN 480G Unknown N/A N/A No 2023-10-18T20:55:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.355+0000 7f1860805700 1 -- 172.21.15.8:0/3283319895 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f184405c300 msgr2=0x7f184405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.355+0000 7f1860805700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f184405c300 0x7f184405e7c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f185c107b50 tx=0x7f184c009b30).stop 2023-10-18T20:55:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.355+0000 7f1860805700 1 -- 172.21.15.8:0/3283319895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f185c0f77d0 msgr2=0x7f185c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.355+0000 7f1860805700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f185c0f77d0 0x7f185c107280 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f1850002700 tx=0x7f1850009e00).stop 2023-10-18T20:55:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.355+0000 7f1860805700 1 -- 172.21.15.8:0/3283319895 shutdown_connections 2023-10-18T20:55:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.355+0000 7f1860805700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f184405c300 0x7f184405e7c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.355+0000 7f1860805700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f185c0f6530 0x7f185c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.355+0000 7f1860805700 1 --2- 172.21.15.8:0/3283319895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f185c0f77d0 0x7f185c107280 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.355+0000 7f1860805700 1 -- 172.21.15.8:0/3283319895 >> 172.21.15.8:0/3283319895 conn(0x7f185c0f1c90 msgr2=0x7f185c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:43.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.355+0000 7f1860805700 1 -- 172.21.15.8:0/3283319895 shutdown_connections 2023-10-18T20:55:43.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:43.356+0000 7f1860805700 1 -- 172.21.15.8:0/3283319895 wait complete. 2023-10-18T20:55:43.477 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:41.386728+0000 mgr.smithi008.flmjzp (mgr.14164) 192 : audit [DBG] from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:43.477 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:42.119652+0000 mgr.smithi008.flmjzp (mgr.14164) 193 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:41.386728+0000 mgr.smithi008.flmjzp (mgr.14164) 192 : audit [DBG] from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:42.119652+0000 mgr.smithi008.flmjzp (mgr.14164) 193 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:43.681 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-18T20:55:43.691 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:55:43.692 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-10-18T20:55:44.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:43.353511+0000 mgr.smithi008.flmjzp (mgr.14164) 194 : audit [DBG] from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:43.353511+0000 mgr.smithi008.flmjzp (mgr.14164) 194 : audit [DBG] from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:44.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.969+0000 7fe624f2f700 1 -- 172.21.15.8:0/155064375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200f6530 msgr2=0x7fe6200f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:44.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.969+0000 7fe624f2f700 1 --2- 172.21.15.8:0/155064375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200f6530 0x7fe6200f6950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe610004660 tx=0x7fe610009b30).stop 2023-10-18T20:55:44.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.969+0000 7fe624f2f700 1 -- 172.21.15.8:0/155064375 shutdown_connections 2023-10-18T20:55:44.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.969+0000 7fe624f2f700 1 --2- 172.21.15.8:0/155064375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6200f77d0 0x7fe6200f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:44.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.969+0000 7fe624f2f700 1 --2- 172.21.15.8:0/155064375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200f6530 0x7fe6200f6950 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:44.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.969+0000 7fe624f2f700 1 -- 172.21.15.8:0/155064375 >> 172.21.15.8:0/155064375 conn(0x7fe6200f1c90 msgr2=0x7fe6200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:44.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.969+0000 7fe624f2f700 1 -- 172.21.15.8:0/155064375 shutdown_connections 2023-10-18T20:55:44.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.969+0000 7fe624f2f700 1 -- 172.21.15.8:0/155064375 wait complete. 2023-10-18T20:55:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.970+0000 7fe624f2f700 1 Processor -- start 2023-10-18T20:55:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.970+0000 7fe624f2f700 1 -- start start 2023-10-18T20:55:44.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.971+0000 7fe624f2f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200f6530 0x7fe62006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:44.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.971+0000 7fe624f2f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6200f77d0 0x7fe620069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:44.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.971+0000 7fe624f2f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62006a380 con 0x7fe6200f6530 2023-10-18T20:55:44.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.971+0000 7fe624f2f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62006a4c0 con 0x7fe6200f77d0 2023-10-18T20:55:44.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.971+0000 7fe61f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200f6530 0x7fe62006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:44.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.971+0000 7fe61f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200f6530 0x7fe62006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51460/0 (socket says 172.21.15.8:51460) 2023-10-18T20:55:44.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.971+0000 7fe61f7fe700 1 -- 172.21.15.8:0/337213787 learned_addr learned my addr 172.21.15.8:0/337213787 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:44.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.971+0000 7fe61f7fe700 1 -- 172.21.15.8:0/337213787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6200f77d0 msgr2=0x7fe620069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:44.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.971+0000 7fe61f7fe700 1 --2- 172.21.15.8:0/337213787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6200f77d0 0x7fe620069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:55:44.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.971+0000 7fe61f7fe700 1 -- 172.21.15.8:0/337213787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe610005040 con 0x7fe6200f6530 2023-10-18T20:55:44.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.972+0000 7fe61f7fe700 1 --2- 172.21.15.8:0/337213787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200f6530 0x7fe62006b9a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe610004e30 tx=0x7fe610009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:44.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.972+0000 7fe607fff700 1 -- 172.21.15.8:0/337213787 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe610018070 con 0x7fe6200f6530 2023-10-18T20:55:44.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.972+0000 7fe607fff700 1 -- 172.21.15.8:0/337213787 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe610013410 con 0x7fe6200f6530 2023-10-18T20:55:44.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.972+0000 7fe607fff700 1 -- 172.21.15.8:0/337213787 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe61001c3c0 con 0x7fe6200f6530 2023-10-18T20:55:44.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.972+0000 7fe624f2f700 1 -- 172.21.15.8:0/337213787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62006a740 con 0x7fe6200f6530 2023-10-18T20:55:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.972+0000 7fe624f2f700 1 -- 172.21.15.8:0/337213787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62006aca0 con 0x7fe6200f6530 2023-10-18T20:55:44.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.973+0000 7fe624f2f700 1 -- 172.21.15.8:0/337213787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe620045ad0 con 0x7fe6200f6530 2023-10-18T20:55:44.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.974+0000 7fe607fff700 1 -- 172.21.15.8:0/337213787 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe61001d420 con 0x7fe6200f6530 2023-10-18T20:55:44.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.975+0000 7fe607fff700 1 --2- 172.21.15.8:0/337213787 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe60805c300 0x7fe60805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:44.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.975+0000 7fe607fff700 1 -- 172.21.15.8:0/337213787 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fe610077750 con 0x7fe6200f6530 2023-10-18T20:55:44.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.975+0000 7fe61effd700 1 --2- 172.21.15.8:0/337213787 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe60805c300 0x7fe60805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:44.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.976+0000 7fe61effd700 1 --2- 172.21.15.8:0/337213787 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe60805c300 0x7fe60805e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe614004bd0 tx=0x7fe614009b10).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:44.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:44.979+0000 7fe607fff700 1 -- 172.21.15.8:0/337213787 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe61004a7d0 con 0x7fe6200f6530 2023-10-18T20:55:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:45.172+0000 7fe624f2f700 1 -- 172.21.15.8:0/337213787 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6200fee00 con 0x7fe60805c300 2023-10-18T20:55:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:44.119951+0000 mgr.smithi008.flmjzp (mgr.14164) 195 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:44.119951+0000 mgr.smithi008.flmjzp (mgr.14164) 195 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:46.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.786+0000 7fe607fff700 1 -- 172.21.15.8:0/337213787 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe6200fee00 con 0x7fe60805c300 2023-10-18T20:55:46.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.789+0000 7fe624f2f700 1 -- 172.21.15.8:0/337213787 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe60805c300 msgr2=0x7fe60805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:46.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.789+0000 7fe624f2f700 1 --2- 172.21.15.8:0/337213787 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe60805c300 0x7fe60805e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe614004bd0 tx=0x7fe614009b10).stop 2023-10-18T20:55:46.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.789+0000 7fe624f2f700 1 -- 172.21.15.8:0/337213787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200f6530 msgr2=0x7fe62006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:46.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.789+0000 7fe624f2f700 1 --2- 172.21.15.8:0/337213787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200f6530 0x7fe62006b9a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe610004e30 tx=0x7fe610009b30).stop 2023-10-18T20:55:46.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.789+0000 7fe624f2f700 1 -- 172.21.15.8:0/337213787 shutdown_connections 2023-10-18T20:55:46.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.789+0000 7fe624f2f700 1 --2- 172.21.15.8:0/337213787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6200f6530 0x7fe62006b9a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:46.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.789+0000 7fe624f2f700 1 --2- 172.21.15.8:0/337213787 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe60805c300 0x7fe60805e7c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:46.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.789+0000 7fe624f2f700 1 --2- 172.21.15.8:0/337213787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6200f77d0 0x7fe620069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:55:46.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.789+0000 7fe624f2f700 1 -- 172.21.15.8:0/337213787 >> 172.21.15.8:0/337213787 conn(0x7fe6200f1c90 msgr2=0x7fe6200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:46.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.790+0000 7fe624f2f700 1 -- 172.21.15.8:0/337213787 shutdown_connections 2023-10-18T20:55:46.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:46.790+0000 7fe624f2f700 1 -- 172.21.15.8:0/337213787 wait complete. 2023-10-18T20:55:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:45.173712+0000 mgr.smithi008.flmjzp (mgr.14164) 196 : audit [DBG] from='client.14448 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:45.174294+0000 mon.smithi008 (mon.0) 454 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-10-18T20:55:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:45.752989+0000 mon.smithi008 (mon.0) 455 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-10-18T20:55:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:45.753033+0000 mon.smithi008 (mon.0) 456 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2023-10-18T20:55:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:45.754311+0000 mon.smithi008 (mon.0) 457 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-10-18T20:55:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:46.120282+0000 mgr.smithi008.flmjzp (mgr.14164) 197 : cluster [DBG] pgmap v158: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:47.002 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:45.173712+0000 mgr.smithi008.flmjzp (mgr.14164) 196 : audit [DBG] from='client.14448 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:55:47.002 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:45.174294+0000 mon.smithi008 (mon.0) 454 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-10-18T20:55:47.002 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:45.752989+0000 mon.smithi008 (mon.0) 455 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-10-18T20:55:47.003 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:45.753033+0000 mon.smithi008 (mon.0) 456 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2023-10-18T20:55:47.003 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:45.754311+0000 mon.smithi008 (mon.0) 457 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-10-18T20:55:47.003 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:46.120282+0000 mgr.smithi008.flmjzp (mgr.14164) 197 : cluster [DBG] pgmap v158: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:47.003 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:55:46.761+0000 7f9c2e262700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T20:55:47.195 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-18T20:55:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:46.757955+0000 mon.smithi008 (mon.0) 458 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-10-18T20:55:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:46.758252+0000 mon.smithi008 (mon.0) 459 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2023-10-18T20:55:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:46.760681+0000 mon.smithi008 (mon.0) 460 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-10-18T20:55:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:46.761845+0000 mon.smithi008 (mon.0) 461 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T20:55:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:46.761888+0000 mon.smithi008 (mon.0) 462 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-18T20:55:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:46.771920+0000 mon.smithi008 (mon.0) 463 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2023-10-18T20:55:47.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:46.772174+0000 mon.smithi008 (mon.0) 464 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-10-18T20:55:47.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:46.772268+0000 mon.smithi008 (mon.0) 465 : cluster [DBG] fsmap cephfs:0 2023-10-18T20:55:47.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:55:46.775197+0000 mgr.smithi008.flmjzp (mgr.14164) 198 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2023-10-18T20:55:47.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:46.783193+0000 mon.smithi008 (mon.0) 466 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:47.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:46.789364+0000 mon.smithi008 (mon.0) 467 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:55:47.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:46.798435+0000 mon.smithi008 (mon.0) 468 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:47.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:46.806275+0000 mon.smithi008 (mon.0) 469 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:47.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:46.807433+0000 mon.smithi008 (mon.0) 470 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.lehgco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T20:55:47.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:46.811517+0000 mon.smithi008 (mon.0) 471 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.lehgco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T20:55:47.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:46.812527+0000 mon.smithi008 (mon.0) 472 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:55:47.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:55:46.813355+0000 mgr.smithi008.flmjzp (mgr.14164) 199 : cephadm [INF] Deploying daemon mds.cephfs.smithi008.lehgco on smithi008 2023-10-18T20:55:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:46.757955+0000 mon.smithi008 (mon.0) 458 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-10-18T20:55:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:46.758252+0000 mon.smithi008 (mon.0) 459 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2023-10-18T20:55:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:46.760681+0000 mon.smithi008 (mon.0) 460 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-10-18T20:55:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:46.761845+0000 mon.smithi008 (mon.0) 461 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T20:55:48.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:46.761888+0000 mon.smithi008 (mon.0) 462 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-18T20:55:48.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:46.771920+0000 mon.smithi008 (mon.0) 463 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2023-10-18T20:55:48.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:46.772174+0000 mon.smithi008 (mon.0) 464 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-10-18T20:55:48.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:46.772268+0000 mon.smithi008 (mon.0) 465 : cluster [DBG] fsmap cephfs:0 2023-10-18T20:55:48.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:55:46.775197+0000 mgr.smithi008.flmjzp (mgr.14164) 198 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2023-10-18T20:55:48.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:46.783193+0000 mon.smithi008 (mon.0) 466 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:48.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:46.789364+0000 mon.smithi008 (mon.0) 467 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:55:48.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:46.798435+0000 mon.smithi008 (mon.0) 468 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:48.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:46.806275+0000 mon.smithi008 (mon.0) 469 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:48.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:46.807433+0000 mon.smithi008 (mon.0) 470 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.lehgco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T20:55:48.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:46.811517+0000 mon.smithi008 (mon.0) 471 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.lehgco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T20:55:48.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:46.812527+0000 mon.smithi008 (mon.0) 472 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:55:48.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:55:46.813355+0000 mgr.smithi008.flmjzp (mgr.14164) 199 : cephadm [INF] Deploying daemon mds.cephfs.smithi008.lehgco on smithi008 2023-10-18T20:55:49.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:47.770993+0000 mon.smithi008 (mon.0) 473 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2023-10-18T20:55:49.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:48.120624+0000 mgr.smithi008.flmjzp (mgr.14164) 200 : cluster [DBG] pgmap v162: 65 pgs: 9 creating+peering, 6 active+clean, 50 unknown; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:47.770993+0000 mon.smithi008 (mon.0) 473 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2023-10-18T20:55:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:48.120624+0000 mgr.smithi008.flmjzp (mgr.14164) 200 : cluster [DBG] pgmap v162: 65 pgs: 9 creating+peering, 6 active+clean, 50 unknown; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:49.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.487+0000 7f1cc4f29700 1 -- 172.21.15.8:0/1158718053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cc00f6530 msgr2=0x7f1cc00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:49.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.487+0000 7f1cc4f29700 1 --2- 172.21.15.8:0/1158718053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cc00f6530 0x7f1cc00f6950 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f1cb0004660 tx=0x7f1cb0009b30).stop 2023-10-18T20:55:49.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.487+0000 7f1cc4f29700 1 -- 172.21.15.8:0/1158718053 shutdown_connections 2023-10-18T20:55:49.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.487+0000 7f1cc4f29700 1 --2- 172.21.15.8:0/1158718053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cc00f77d0 0x7f1cc00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:49.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.487+0000 7f1cc4f29700 1 --2- 172.21.15.8:0/1158718053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cc00f6530 0x7f1cc00f6950 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:49.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.487+0000 7f1cc4f29700 1 -- 172.21.15.8:0/1158718053 >> 172.21.15.8:0/1158718053 conn(0x7f1cc00f1c90 msgr2=0x7f1cc00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.487+0000 7f1cc4f29700 1 -- 172.21.15.8:0/1158718053 shutdown_connections 2023-10-18T20:55:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.487+0000 7f1cc4f29700 1 -- 172.21.15.8:0/1158718053 wait complete. 2023-10-18T20:55:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.488+0000 7f1cc4f29700 1 Processor -- start 2023-10-18T20:55:49.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.488+0000 7f1cc4f29700 1 -- start start 2023-10-18T20:55:49.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.488+0000 7f1cc4f29700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cc00f6530 0x7f1cc0108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:49.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.488+0000 7f1cc4f29700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cc00f77d0 0x7f1cc01094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:49.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.488+0000 7f1cc4f29700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0109a70 con 0x7f1cc00f6530 2023-10-18T20:55:49.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.488+0000 7f1cc4f29700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0109bb0 con 0x7f1cc00f77d0 2023-10-18T20:55:49.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.489+0000 7f1cbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cc00f6530 0x7f1cc0108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:49.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.489+0000 7f1cbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cc00f6530 0x7f1cc0108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37376/0 (socket says 172.21.15.8:37376) 2023-10-18T20:55:49.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.489+0000 7f1cbf7fe700 1 -- 172.21.15.8:0/2559354002 learned_addr learned my addr 172.21.15.8:0/2559354002 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:49.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.489+0000 7f1cbeffd700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cc00f77d0 0x7f1cc01094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:49.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.489+0000 7f1cbf7fe700 1 -- 172.21.15.8:0/2559354002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cc00f77d0 msgr2=0x7f1cc01094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:49.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.489+0000 7f1cbf7fe700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cc00f77d0 0x7f1cc01094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:49.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.489+0000 7f1cbf7fe700 1 -- 172.21.15.8:0/2559354002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb0005040 con 0x7f1cc00f6530 2023-10-18T20:55:49.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.490+0000 7f1cbf7fe700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cc00f6530 0x7f1cc0108fd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1cb0007a60 tx=0x7f1cb0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:49.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.490+0000 7f1ca7fff700 1 -- 172.21.15.8:0/2559354002 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb0018070 con 0x7f1cc00f6530 2023-10-18T20:55:49.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.490+0000 7f1ca7fff700 1 -- 172.21.15.8:0/2559354002 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1cb0013410 con 0x7f1cc00f6530 2023-10-18T20:55:49.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.490+0000 7f1cc4f29700 1 -- 172.21.15.8:0/2559354002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc010a4f0 con 0x7f1cc00f6530 2023-10-18T20:55:49.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.490+0000 7f1ca7fff700 1 -- 172.21.15.8:0/2559354002 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb001c3c0 con 0x7f1cc00f6530 2023-10-18T20:55:49.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.490+0000 7f1cc4f29700 1 -- 172.21.15.8:0/2559354002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc010aa50 con 0x7f1cc00f6530 2023-10-18T20:55:49.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.491+0000 7f1cc4f29700 1 -- 172.21.15.8:0/2559354002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc0045ad0 con 0x7f1cc00f6530 2023-10-18T20:55:49.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.493+0000 7f1ca7fff700 1 -- 172.21.15.8:0/2559354002 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f1cb001d420 con 0x7f1cc00f6530 2023-10-18T20:55:49.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.494+0000 7f1ca7fff700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f1ca805c2f0 0x7f1ca805e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:49.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.494+0000 7f1ca7fff700 1 -- 172.21.15.8:0/2559354002 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1cb0077be0 con 0x7f1cc00f6530 2023-10-18T20:55:49.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.495+0000 7f1cbeffd700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f1ca805c2f0 0x7f1ca805e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:49.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.495+0000 7f1cbeffd700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f1ca805c2f0 0x7f1ca805e7b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1cb4004c20 tx=0x7f1cb400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:49.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.500+0000 7f1ca7fff700 1 -- 172.21.15.8:0/2559354002 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1cb004a8a0 con 0x7f1cc00f6530 2023-10-18T20:55:49.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.711+0000 7f1cc4f29700 1 -- 172.21.15.8:0/2559354002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1cc00fed90 con 0x7f1cc00f6530 2023-10-18T20:55:49.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.711+0000 7f1ca7fff700 1 -- 172.21.15.8:0/2559354002 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1003 (secure 0 0 0) 0x7f1cb004dec0 con 0x7f1cc00f6530 2023-10-18T20:55:49.713 INFO:teuthology.orchestra.run.smithi008.stdout:e2 2023-10-18T20:55:49.714 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:55:49.714 INFO:teuthology.orchestra.run.smithi008.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:55:49.714 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T20:55:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:49.715 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T20:55:49.715 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T20:55:49.715 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 2 2023-10-18T20:55:49.715 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T20:55:49.715 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:55:49.715 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:55:46.761744+0000 2023-10-18T20:55:49.716 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T20:55:49.716 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T20:55:49.716 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T20:55:49.716 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T20:55:49.716 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T20:55:49.716 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T20:55:49.717 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T20:55:49.717 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T20:55:49.717 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:55:49.717 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T20:55:49.717 INFO:teuthology.orchestra.run.smithi008.stdout:in 2023-10-18T20:55:49.717 INFO:teuthology.orchestra.run.smithi008.stdout:up {} 2023-10-18T20:55:49.718 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T20:55:49.718 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T20:55:49.718 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T20:55:49.718 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T20:55:49.718 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T20:55:49.719 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T20:55:49.719 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T20:55:49.719 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 0 2023-10-18T20:55:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:49.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 -- 172.21.15.8:0/2559354002 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f1ca805c2f0 msgr2=0x7f1ca805e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:49.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f1ca805c2f0 0x7f1ca805e7b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1cb4004c20 tx=0x7f1cb400b040).stop 2023-10-18T20:55:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 -- 172.21.15.8:0/2559354002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cc00f6530 msgr2=0x7f1cc0108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cc00f6530 0x7f1cc0108fd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1cb0007a60 tx=0x7f1cb0009b30).stop 2023-10-18T20:55:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 -- 172.21.15.8:0/2559354002 shutdown_connections 2023-10-18T20:55:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cc00f6530 0x7f1cc0108fd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f1ca805c2f0 0x7f1ca805e7b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 --2- 172.21.15.8:0/2559354002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cc00f77d0 0x7f1cc01094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 -- 172.21.15.8:0/2559354002 >> 172.21.15.8:0/2559354002 conn(0x7f1cc00f1c90 msgr2=0x7f1cc006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 -- 172.21.15.8:0/2559354002 shutdown_connections 2023-10-18T20:55:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:49.713+0000 7f1cc4f29700 1 -- 172.21.15.8:0/2559354002 wait complete. 2023-10-18T20:55:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 2 2023-10-18T20:55:50.060 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:48.777656+0000 mon.smithi008 (mon.0) 474 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2023-10-18T20:55:50.060 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:49.571781+0000 mon.smithi008 (mon.0) 475 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:50.060 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:49.572642+0000 mon.smithi008 (mon.0) 476 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.grdzlm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T20:55:50.060 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:49.575343+0000 mon.smithi008 (mon.0) 477 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.grdzlm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T20:55:50.061 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:49.576116+0000 mon.smithi008 (mon.0) 478 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:55:50.061 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:49.711787+0000 mon.smithi008 (mon.0) 479 : audit [DBG] from='client.? 172.21.15.8:0/2559354002' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:55:50.088 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-18T20:55:50.098 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:55:50.098 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph fs set cephfs max_mds 2' 2023-10-18T20:55:50.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:48.777656+0000 mon.smithi008 (mon.0) 474 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2023-10-18T20:55:50.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:49.571781+0000 mon.smithi008 (mon.0) 475 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:50.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:49.572642+0000 mon.smithi008 (mon.0) 476 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.grdzlm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T20:55:50.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:49.575343+0000 mon.smithi008 (mon.0) 477 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.grdzlm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T20:55:50.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:49.576116+0000 mon.smithi008 (mon.0) 478 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:55:50.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:49.711787+0000 mon.smithi008 (mon.0) 479 : audit [DBG] from='client.? 172.21.15.8:0/2559354002' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:55:50.876 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:55:49.576895+0000 mgr.smithi008.flmjzp (mgr.14164) 201 : cephadm [INF] Deploying daemon mds.cephfs.smithi060.grdzlm on smithi060 2023-10-18T20:55:50.877 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:50.121167+0000 mgr.smithi008.flmjzp (mgr.14164) 202 : cluster [DBG] pgmap v164: 65 pgs: 9 creating+peering, 48 active+clean, 8 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:51.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:55:49.576895+0000 mgr.smithi008.flmjzp (mgr.14164) 201 : cephadm [INF] Deploying daemon mds.cephfs.smithi060.grdzlm on smithi060 2023-10-18T20:55:51.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:50.121167+0000 mgr.smithi008.flmjzp (mgr.14164) 202 : cluster [DBG] pgmap v164: 65 pgs: 9 creating+peering, 48 active+clean, 8 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:51.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.434+0000 7fbd04946700 1 -- 172.21.15.8:0/522884271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f6530 msgr2=0x7fbd000f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:51.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.434+0000 7fbd04946700 1 --2- 172.21.15.8:0/522884271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f6530 0x7fbd000f6950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fbcf0004660 tx=0x7fbcf0009b30).stop 2023-10-18T20:55:51.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.434+0000 7fbd04946700 1 -- 172.21.15.8:0/522884271 shutdown_connections 2023-10-18T20:55:51.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.434+0000 7fbd04946700 1 --2- 172.21.15.8:0/522884271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f77d0 0x7fbd000f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:51.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.434+0000 7fbd04946700 1 --2- 172.21.15.8:0/522884271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f6530 0x7fbd000f6950 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:51.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.434+0000 7fbd04946700 1 -- 172.21.15.8:0/522884271 >> 172.21.15.8:0/522884271 conn(0x7fbd000f1c90 msgr2=0x7fbd000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:51.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.434+0000 7fbd04946700 1 -- 172.21.15.8:0/522884271 shutdown_connections 2023-10-18T20:55:51.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.434+0000 7fbd04946700 1 -- 172.21.15.8:0/522884271 wait complete. 2023-10-18T20:55:51.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.435+0000 7fbd04946700 1 Processor -- start 2023-10-18T20:55:51.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.435+0000 7fbd04946700 1 -- start start 2023-10-18T20:55:51.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.435+0000 7fbd04946700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:51.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbd04946700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f77d0 0x7fbd00069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:51.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbd04946700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0006a380 con 0x7fbd000f77d0 2023-10-18T20:55:51.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbd04946700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0006a4c0 con 0x7fbd000f6530 2023-10-18T20:55:51.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbcfe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f77d0 0x7fbd00069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:51.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbcfed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:51.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbcfed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:37036/0 (socket says 172.21.15.8:37036) 2023-10-18T20:55:51.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbcfed9d700 1 -- 172.21.15.8:0/2177932378 learned_addr learned my addr 172.21.15.8:0/2177932378 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:51.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbcfed9d700 1 -- 172.21.15.8:0/2177932378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f77d0 msgr2=0x7fbd00069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:51.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbcfed9d700 1 --2- 172.21.15.8:0/2177932378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f77d0 0x7fbd00069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:51.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbcfed9d700 1 -- 172.21.15.8:0/2177932378 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0005040 con 0x7fbd000f6530 2023-10-18T20:55:51.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.436+0000 7fbcfed9d700 1 --2- 172.21.15.8:0/2177932378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fbcf0007a60 tx=0x7fbcf0009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:51.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.437+0000 7fbce77fe700 1 -- 172.21.15.8:0/2177932378 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcf0018070 con 0x7fbd000f6530 2023-10-18T20:55:51.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.437+0000 7fbce77fe700 1 -- 172.21.15.8:0/2177932378 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbcf0013410 con 0x7fbd000f6530 2023-10-18T20:55:51.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.437+0000 7fbd04946700 1 -- 172.21.15.8:0/2177932378 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0006a740 con 0x7fbd000f6530 2023-10-18T20:55:51.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.437+0000 7fbce77fe700 1 -- 172.21.15.8:0/2177932378 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcf001c3c0 con 0x7fbd000f6530 2023-10-18T20:55:51.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.437+0000 7fbd04946700 1 -- 172.21.15.8:0/2177932378 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0006aca0 con 0x7fbd000f6530 2023-10-18T20:55:51.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.438+0000 7fbd04946700 1 -- 172.21.15.8:0/2177932378 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd00045ad0 con 0x7fbd000f6530 2023-10-18T20:55:51.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.439+0000 7fbce77fe700 1 -- 172.21.15.8:0/2177932378 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fbcf001d420 con 0x7fbd000f6530 2023-10-18T20:55:51.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.439+0000 7fbce77fe700 1 --2- 172.21.15.8:0/2177932378 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbce805c2f0 0x7fbce805e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:51.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.439+0000 7fbce77fe700 1 -- 172.21.15.8:0/2177932378 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fbcf0077da0 con 0x7fbd000f6530 2023-10-18T20:55:51.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.439+0000 7fbcfe59c700 1 --2- 172.21.15.8:0/2177932378 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbce805c2f0 0x7fbce805e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:51.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.440+0000 7fbcfe59c700 1 --2- 172.21.15.8:0/2177932378 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbce805c2f0 0x7fbce805e7b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fbcf4004e20 tx=0x7fbcf400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:51.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.444+0000 7fbce77fe700 1 -- 172.21.15.8:0/2177932378 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fbcf004a9a0 con 0x7fbd000f6530 2023-10-18T20:55:51.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.651+0000 7fbd04946700 1 -- 172.21.15.8:0/2177932378 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fbd000586e0 con 0x7fbd000f6530 2023-10-18T20:55:51.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.787+0000 7fbce77fe700 1 -- 172.21.15.8:0/2177932378 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v3) v1 ==== 105+0+0 (secure 0 0 0) 0x7fbcf004dfc0 con 0x7fbd000f6530 2023-10-18T20:55:51.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.789+0000 7fbd04946700 1 -- 172.21.15.8:0/2177932378 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbce805c2f0 msgr2=0x7fbce805e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:51.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.789+0000 7fbd04946700 1 --2- 172.21.15.8:0/2177932378 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbce805c2f0 0x7fbce805e7b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fbcf4004e20 tx=0x7fbcf400b040).stop 2023-10-18T20:55:51.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.789+0000 7fbd04946700 1 -- 172.21.15.8:0/2177932378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f6530 msgr2=0x7fbd0006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:51.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.789+0000 7fbd04946700 1 --2- 172.21.15.8:0/2177932378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fbcf0007a60 tx=0x7fbcf0009b30).stop 2023-10-18T20:55:51.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.789+0000 7fbd04946700 1 -- 172.21.15.8:0/2177932378 shutdown_connections 2023-10-18T20:55:51.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.789+0000 7fbd04946700 1 --2- 172.21.15.8:0/2177932378 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fbce805c2f0 0x7fbce805e7b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:51.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.789+0000 7fbd04946700 1 --2- 172.21.15.8:0/2177932378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:51.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.789+0000 7fbd04946700 1 --2- 172.21.15.8:0/2177932378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f77d0 0x7fbd00069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:51.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.789+0000 7fbd04946700 1 -- 172.21.15.8:0/2177932378 >> 172.21.15.8:0/2177932378 conn(0x7fbd000f1c90 msgr2=0x7fbd000fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:51.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.790+0000 7fbd04946700 1 -- 172.21.15.8:0/2177932378 shutdown_connections 2023-10-18T20:55:51.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:51.790+0000 7fbd04946700 1 -- 172.21.15.8:0/2177932378 wait complete. 2023-10-18T20:55:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:51.652738+0000 mon.smithi060 (mon.1) 13 : audit [INF] from='client.? 172.21.15.8:0/2177932378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-10-18T20:55:51.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:51.653131+0000 mon.smithi008 (mon.0) 480 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-10-18T20:55:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:51.652738+0000 mon.smithi060 (mon.1) 13 : audit [INF] from='client.? 172.21.15.8:0/2177932378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-10-18T20:55:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:51.653131+0000 mon.smithi008 (mon.0) 480 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-10-18T20:55:52.200 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-18T20:55:52.210 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:55:52.210 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2023-10-18T20:55:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:51.781269+0000 mon.smithi008 (mon.0) 481 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:51.782123+0000 mon.smithi008 (mon.0) 482 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.mpstiw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T20:55:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:51.787514+0000 mon.smithi008 (mon.0) 483 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-10-18T20:55:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:51.787624+0000 mon.smithi008 (mon.0) 484 : cluster [DBG] fsmap cephfs:0 2023-10-18T20:55:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:51.787668+0000 mon.smithi008 (mon.0) 485 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.mpstiw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T20:55:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:51.788737+0000 mon.smithi008 (mon.0) 486 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:55:53.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:55:51.789460+0000 mgr.smithi008.flmjzp (mgr.14164) 203 : cephadm [INF] Deploying daemon mds.cephfs.smithi008.mpstiw on smithi008 2023-10-18T20:55:53.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:52.121594+0000 mgr.smithi008.flmjzp (mgr.14164) 204 : cluster [DBG] pgmap v165: 65 pgs: 4 creating+peering, 61 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:51.781269+0000 mon.smithi008 (mon.0) 481 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:51.782123+0000 mon.smithi008 (mon.0) 482 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.mpstiw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T20:55:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:51.787514+0000 mon.smithi008 (mon.0) 483 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-10-18T20:55:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:51.787624+0000 mon.smithi008 (mon.0) 484 : cluster [DBG] fsmap cephfs:0 2023-10-18T20:55:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:51.787668+0000 mon.smithi008 (mon.0) 485 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.mpstiw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T20:55:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:51.788737+0000 mon.smithi008 (mon.0) 486 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:55:53.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:55:51.789460+0000 mgr.smithi008.flmjzp (mgr.14164) 203 : cephadm [INF] Deploying daemon mds.cephfs.smithi008.mpstiw on smithi008 2023-10-18T20:55:53.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:52.121594+0000 mgr.smithi008.flmjzp (mgr.14164) 204 : cluster [DBG] pgmap v165: 65 pgs: 4 creating+peering, 61 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:54.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.279+0000 7f9e4d85a700 1 -- 172.21.15.8:0/2079942097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e480f6530 msgr2=0x7f9e480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:54.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.279+0000 7f9e4d85a700 1 --2- 172.21.15.8:0/2079942097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e480f6530 0x7f9e480f6950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f9e3c004660 tx=0x7f9e3c009b30).stop 2023-10-18T20:55:54.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.279+0000 7f9e4d85a700 1 -- 172.21.15.8:0/2079942097 shutdown_connections 2023-10-18T20:55:54.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.279+0000 7f9e4d85a700 1 --2- 172.21.15.8:0/2079942097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e480f77d0 0x7f9e480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:54.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.279+0000 7f9e4d85a700 1 --2- 172.21.15.8:0/2079942097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e480f6530 0x7f9e480f6950 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:54.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.279+0000 7f9e4d85a700 1 -- 172.21.15.8:0/2079942097 >> 172.21.15.8:0/2079942097 conn(0x7f9e480f1c90 msgr2=0x7f9e480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:54.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.279+0000 7f9e4d85a700 1 -- 172.21.15.8:0/2079942097 shutdown_connections 2023-10-18T20:55:54.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.279+0000 7f9e4d85a700 1 -- 172.21.15.8:0/2079942097 wait complete. 2023-10-18T20:55:54.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.280+0000 7f9e4d85a700 1 Processor -- start 2023-10-18T20:55:54.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.281+0000 7f9e4d85a700 1 -- start start 2023-10-18T20:55:54.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.281+0000 7f9e4d85a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e480f6530 0x7f9e48106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:54.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.281+0000 7f9e4d85a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e480f77d0 0x7f9e48107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:54.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.281+0000 7f9e4d85a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48107880 con 0x7f9e480f77d0 2023-10-18T20:55:54.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.281+0000 7f9e4d85a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e481080c0 con 0x7f9e480f6530 2023-10-18T20:55:54.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.281+0000 7f9e4c858700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e480f6530 0x7f9e48106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:54.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.281+0000 7f9e4c858700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e480f6530 0x7f9e48106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:37048/0 (socket says 172.21.15.8:37048) 2023-10-18T20:55:54.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.281+0000 7f9e4c858700 1 -- 172.21.15.8:0/3805821079 learned_addr learned my addr 172.21.15.8:0/3805821079 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:54.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.281+0000 7f9e47fff700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e480f77d0 0x7f9e48107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:54.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.282+0000 7f9e47fff700 1 -- 172.21.15.8:0/3805821079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e480f6530 msgr2=0x7f9e48106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:54.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.282+0000 7f9e47fff700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e480f6530 0x7f9e48106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:54.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.282+0000 7f9e47fff700 1 -- 172.21.15.8:0/3805821079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c005040 con 0x7f9e480f77d0 2023-10-18T20:55:54.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.282+0000 7f9e47fff700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e480f77d0 0x7f9e48107280 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f9e3400e7c0 tx=0x7f9e3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:54.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.282+0000 7f9e457fa700 1 -- 172.21.15.8:0/3805821079 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e340092e0 con 0x7f9e480f77d0 2023-10-18T20:55:54.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.282+0000 7f9e457fa700 1 -- 172.21.15.8:0/3805821079 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e3400f040 con 0x7f9e480f77d0 2023-10-18T20:55:54.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.282+0000 7f9e4d85a700 1 -- 172.21.15.8:0/3805821079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e481083a0 con 0x7f9e480f77d0 2023-10-18T20:55:54.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.282+0000 7f9e457fa700 1 -- 172.21.15.8:0/3805821079 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e34014880 con 0x7f9e480f77d0 2023-10-18T20:55:54.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.283+0000 7f9e4d85a700 1 -- 172.21.15.8:0/3805821079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e481088e0 con 0x7f9e480f77d0 2023-10-18T20:55:54.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.284+0000 7f9e4d85a700 1 -- 172.21.15.8:0/3805821079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e48059100 con 0x7f9e480f77d0 2023-10-18T20:55:54.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.285+0000 7f9e457fa700 1 -- 172.21.15.8:0/3805821079 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9e3401b030 con 0x7f9e480f77d0 2023-10-18T20:55:54.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.285+0000 7f9e457fa700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9e3805c2f0 0x7f9e3805e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:54.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.286+0000 7f9e457fa700 1 -- 172.21.15.8:0/3805821079 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9e34075d00 con 0x7f9e480f77d0 2023-10-18T20:55:54.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.286+0000 7f9e4c858700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9e3805c2f0 0x7f9e3805e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:54.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.286+0000 7f9e4c858700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9e3805c2f0 0x7f9e3805e7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f9e3c009d60 tx=0x7f9e3c016040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:54.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.290+0000 7f9e457fa700 1 -- 172.21.15.8:0/3805821079 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9e34048920 con 0x7f9e480f77d0 2023-10-18T20:55:54.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:54.524+0000 7f9e4d85a700 1 -- 172.21.15.8:0/3805821079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f9e48045ad0 con 0x7f9e480f77d0 2023-10-18T20:55:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:54.122189+0000 mgr.smithi008.flmjzp (mgr.14164) 205 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 0 B data, 32 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:54.372868+0000 mon.smithi008 (mon.0) 487 : cluster [DBG] mds.? [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] up:boot 2023-10-18T20:55:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:54.372938+0000 mon.smithi008 (mon.0) 488 : cluster [INF] daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-10-18T20:55:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:54.373037+0000 mon.smithi008 (mon.0) 489 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T20:55:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:54.373305+0000 mon.smithi008 (mon.0) 490 : cluster [DBG] fsmap cephfs:0 1 up:standby 2023-10-18T20:55:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:54.373423+0000 mon.smithi008 (mon.0) 491 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T20:55:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:54.376352+0000 mon.smithi008 (mon.0) 492 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.lehgco=up:creating} 2023-10-18T20:55:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:54.402257+0000 mon.smithi008 (mon.0) 493 : cluster [INF] daemon mds.cephfs.smithi008.lehgco is now active in filesystem cephfs as rank 0 2023-10-18T20:55:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:54.122189+0000 mgr.smithi008.flmjzp (mgr.14164) 205 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 0 B data, 32 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:54.372868+0000 mon.smithi008 (mon.0) 487 : cluster [DBG] mds.? [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] up:boot 2023-10-18T20:55:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:54.372938+0000 mon.smithi008 (mon.0) 488 : cluster [INF] daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-10-18T20:55:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:54.373037+0000 mon.smithi008 (mon.0) 489 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T20:55:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:54.373305+0000 mon.smithi008 (mon.0) 490 : cluster [DBG] fsmap cephfs:0 1 up:standby 2023-10-18T20:55:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:54.373423+0000 mon.smithi008 (mon.0) 491 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T20:55:54.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:54.376352+0000 mon.smithi008 (mon.0) 492 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.lehgco=up:creating} 2023-10-18T20:55:54.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:54.402257+0000 mon.smithi008 (mon.0) 493 : cluster [INF] daemon mds.cephfs.smithi008.lehgco is now active in filesystem cephfs as rank 0 2023-10-18T20:55:55.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.378+0000 7f9e457fa700 1 -- 172.21.15.8:0/3805821079 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v6) v1 ==== 121+0+0 (secure 0 0 0) 0x7f9e34019020 con 0x7f9e480f77d0 2023-10-18T20:55:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.381+0000 7f9e4d85a700 1 -- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9e3805c2f0 msgr2=0x7f9e3805e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.381+0000 7f9e4d85a700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9e3805c2f0 0x7f9e3805e7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f9e3c009d60 tx=0x7f9e3c016040).stop 2023-10-18T20:55:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.381+0000 7f9e4d85a700 1 -- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e480f77d0 msgr2=0x7f9e48107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.381+0000 7f9e4d85a700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e480f77d0 0x7f9e48107280 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f9e3400e7c0 tx=0x7f9e3400b040).stop 2023-10-18T20:55:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.381+0000 7f9e4d85a700 1 -- 172.21.15.8:0/3805821079 shutdown_connections 2023-10-18T20:55:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.381+0000 7f9e4d85a700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f9e3805c2f0 0x7f9e3805e7b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.381+0000 7f9e4d85a700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e480f6530 0x7f9e48106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.381+0000 7f9e4d85a700 1 --2- 172.21.15.8:0/3805821079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e480f77d0 0x7f9e48107280 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.381+0000 7f9e4d85a700 1 -- 172.21.15.8:0/3805821079 >> 172.21.15.8:0/3805821079 conn(0x7f9e480f1c90 msgr2=0x7f9e480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.381+0000 7f9e4d85a700 1 -- 172.21.15.8:0/3805821079 shutdown_connections 2023-10-18T20:55:55.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:55.382+0000 7f9e4d85a700 1 -- 172.21.15.8:0/3805821079 wait complete. 2023-10-18T20:55:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:54.525408+0000 mon.smithi008 (mon.0) 494 : audit [INF] from='client.? 172.21.15.8:0/3805821079' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-18T20:55:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:54.569228+0000 mon.smithi008 (mon.0) 495 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:54.570150+0000 mon.smithi008 (mon.0) 496 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.rvrncq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T20:55:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:54.573239+0000 mon.smithi008 (mon.0) 497 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.rvrncq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T20:55:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:54.574014+0000 mon.smithi008 (mon.0) 498 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:55:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:55:54.574814+0000 mgr.smithi008.flmjzp (mgr.14164) 206 : cephadm [INF] Deploying daemon mds.cephfs.smithi060.rvrncq on smithi060 2023-10-18T20:55:55.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:55.378972+0000 mon.smithi008 (mon.0) 499 : cluster [DBG] mds.? [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] up:active 2023-10-18T20:55:55.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:55.379081+0000 mon.smithi008 (mon.0) 500 : audit [INF] from='client.? 172.21.15.8:0/3805821079' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-18T20:55:55.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:55.379235+0000 mon.smithi008 (mon.0) 501 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.lehgco=up:active} 2023-10-18T20:55:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:54.525408+0000 mon.smithi008 (mon.0) 494 : audit [INF] from='client.? 172.21.15.8:0/3805821079' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-18T20:55:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:54.569228+0000 mon.smithi008 (mon.0) 495 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:54.570150+0000 mon.smithi008 (mon.0) 496 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.rvrncq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T20:55:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:54.573239+0000 mon.smithi008 (mon.0) 497 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.rvrncq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T20:55:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:54.574014+0000 mon.smithi008 (mon.0) 498 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:55:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:55:54.574814+0000 mgr.smithi008.flmjzp (mgr.14164) 206 : cephadm [INF] Deploying daemon mds.cephfs.smithi060.rvrncq on smithi060 2023-10-18T20:55:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:55.378972+0000 mon.smithi008 (mon.0) 499 : cluster [DBG] mds.? [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] up:active 2023-10-18T20:55:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:55.379081+0000 mon.smithi008 (mon.0) 500 : audit [INF] from='client.? 172.21.15.8:0/3805821079' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-18T20:55:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:55.379235+0000 mon.smithi008 (mon.0) 501 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.lehgco=up:active} 2023-10-18T20:55:55.759 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-18T20:55:55.770 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:55:55.770 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph fs set cephfs inline_data false' 2023-10-18T20:55:56.916 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:56.122623+0000 mgr.smithi008.flmjzp (mgr.14164) 207 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 160 B data, 32 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:56.917 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:56.520254+0000 mon.smithi008 (mon.0) 502 : cluster [DBG] mds.? [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] up:boot 2023-10-18T20:55:56.917 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:56.520294+0000 mon.smithi008 (mon.0) 503 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-18T20:55:56.917 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:56.520370+0000 mon.smithi008 (mon.0) 504 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-10-18T20:55:56.917 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:56.520397+0000 mon.smithi008 (mon.0) 505 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-18T20:55:56.917 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:56.520656+0000 mon.smithi008 (mon.0) 506 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.lehgco=up:active} 1 up:standby 2023-10-18T20:55:56.918 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:56.520737+0000 mon.smithi008 (mon.0) 507 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T20:55:56.918 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:56.522815+0000 mon.smithi008 (mon.0) 508 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:creating} 2023-10-18T20:55:56.918 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:56.539569+0000 mon.smithi008 (mon.0) 509 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm is now active in filesystem cephfs as rank 1 2023-10-18T20:55:56.918 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:56.648076+0000 mon.smithi008 (mon.0) 510 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:56.918 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:56.648792+0000 mon.smithi008 (mon.0) 511 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:55:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:56.122623+0000 mgr.smithi008.flmjzp (mgr.14164) 207 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 160 B data, 32 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:55:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:56.520254+0000 mon.smithi008 (mon.0) 502 : cluster [DBG] mds.? [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] up:boot 2023-10-18T20:55:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:56.520294+0000 mon.smithi008 (mon.0) 503 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-18T20:55:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:56.520370+0000 mon.smithi008 (mon.0) 504 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-10-18T20:55:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:56.520397+0000 mon.smithi008 (mon.0) 505 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-18T20:55:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:56.520656+0000 mon.smithi008 (mon.0) 506 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.lehgco=up:active} 1 up:standby 2023-10-18T20:55:56.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:56.520737+0000 mon.smithi008 (mon.0) 507 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T20:55:56.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:56.522815+0000 mon.smithi008 (mon.0) 508 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:creating} 2023-10-18T20:55:56.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:56.539569+0000 mon.smithi008 (mon.0) 509 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm is now active in filesystem cephfs as rank 1 2023-10-18T20:55:56.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:56.648076+0000 mon.smithi008 (mon.0) 510 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:56.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:56.648792+0000 mon.smithi008 (mon.0) 511 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:55:57.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.146+0000 7ff093fff700 1 -- 172.21.15.8:0/1505886837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0940f77d0 msgr2=0x7ff0940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:57.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.146+0000 7ff093fff700 1 --2- 172.21.15.8:0/1505886837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0940f77d0 0x7ff0940f7c30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7ff088004660 tx=0x7ff088009b30).stop 2023-10-18T20:55:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.146+0000 7ff093fff700 1 -- 172.21.15.8:0/1505886837 shutdown_connections 2023-10-18T20:55:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.146+0000 7ff093fff700 1 --2- 172.21.15.8:0/1505886837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0940f77d0 0x7ff0940f7c30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.146+0000 7ff093fff700 1 --2- 172.21.15.8:0/1505886837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0940f6530 0x7ff0940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.146+0000 7ff093fff700 1 -- 172.21.15.8:0/1505886837 >> 172.21.15.8:0/1505886837 conn(0x7ff0940f1c90 msgr2=0x7ff0940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.146+0000 7ff093fff700 1 -- 172.21.15.8:0/1505886837 shutdown_connections 2023-10-18T20:55:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.146+0000 7ff093fff700 1 -- 172.21.15.8:0/1505886837 wait complete. 2023-10-18T20:55:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.147+0000 7ff093fff700 1 Processor -- start 2023-10-18T20:55:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.147+0000 7ff093fff700 1 -- start start 2023-10-18T20:55:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.147+0000 7ff093fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0940f6530 0x7ff09406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.147+0000 7ff093fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0940f77d0 0x7ff094069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:57.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.148+0000 7ff093fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09406a380 con 0x7ff0940f77d0 2023-10-18T20:55:57.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.148+0000 7ff093fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09406a4c0 con 0x7ff0940f6530 2023-10-18T20:55:57.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.148+0000 7ff0927fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0940f77d0 0x7ff094069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:57.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.148+0000 7ff0927fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0940f77d0 0x7ff094069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38120/0 (socket says 172.21.15.8:38120) 2023-10-18T20:55:57.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.148+0000 7ff0927fc700 1 -- 172.21.15.8:0/2945074610 learned_addr learned my addr 172.21.15.8:0/2945074610 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.148+0000 7ff092ffd700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0940f6530 0x7ff09406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.148+0000 7ff0927fc700 1 -- 172.21.15.8:0/2945074610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0940f6530 msgr2=0x7ff09406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.148+0000 7ff0927fc700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0940f6530 0x7ff09406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.148+0000 7ff0927fc700 1 -- 172.21.15.8:0/2945074610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088005040 con 0x7ff0940f77d0 2023-10-18T20:55:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.148+0000 7ff092ffd700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0940f6530 0x7ff09406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T20:55:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.149+0000 7ff0927fc700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0940f77d0 0x7ff094069e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7ff088000c00 tx=0x7ff08800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.149+0000 7ff07b7fe700 1 -- 172.21.15.8:0/2945074610 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff088019070 con 0x7ff0940f77d0 2023-10-18T20:55:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.149+0000 7ff093fff700 1 -- 172.21.15.8:0/2945074610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09406a740 con 0x7ff0940f77d0 2023-10-18T20:55:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.149+0000 7ff07b7fe700 1 -- 172.21.15.8:0/2945074610 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff088007e70 con 0x7ff0940f77d0 2023-10-18T20:55:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.149+0000 7ff07b7fe700 1 -- 172.21.15.8:0/2945074610 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff088014c90 con 0x7ff0940f77d0 2023-10-18T20:55:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.149+0000 7ff093fff700 1 -- 172.21.15.8:0/2945074610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09406aca0 con 0x7ff0940f77d0 2023-10-18T20:55:57.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.150+0000 7ff093fff700 1 -- 172.21.15.8:0/2945074610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff094045ad0 con 0x7ff0940f77d0 2023-10-18T20:55:57.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.151+0000 7ff07b7fe700 1 -- 172.21.15.8:0/2945074610 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff088025070 con 0x7ff0940f77d0 2023-10-18T20:55:57.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.152+0000 7ff07b7fe700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff07c05c300 0x7ff07c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:57.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.152+0000 7ff07b7fe700 1 -- 172.21.15.8:0/2945074610 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff088076fe0 con 0x7ff0940f77d0 2023-10-18T20:55:57.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.152+0000 7ff092ffd700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff07c05c300 0x7ff07c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:57.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.153+0000 7ff092ffd700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff07c05c300 0x7ff07c05e7c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff09406b730 tx=0x7ff08400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:57.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.160+0000 7ff07b7fe700 1 -- 172.21.15.8:0/2945074610 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff0880a32b0 con 0x7ff0940f77d0 2023-10-18T20:55:57.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.383+0000 7ff093fff700 1 -- 172.21.15.8:0/2945074610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7ff094027a00 con 0x7ff0940f77d0 2023-10-18T20:55:57.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.525+0000 7ff07b7fe700 1 -- 172.21.15.8:0/2945074610 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v9) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff088049be0 con 0x7ff0940f77d0 2023-10-18T20:55:57.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 -- 172.21.15.8:0/2945074610 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff07c05c300 msgr2=0x7ff07c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:57.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff07c05c300 0x7ff07c05e7c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff09406b730 tx=0x7ff08400b040).stop 2023-10-18T20:55:57.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 -- 172.21.15.8:0/2945074610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0940f77d0 msgr2=0x7ff094069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:57.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0940f77d0 0x7ff094069e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7ff088000c00 tx=0x7ff08800b040).stop 2023-10-18T20:55:57.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 -- 172.21.15.8:0/2945074610 shutdown_connections 2023-10-18T20:55:57.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff07c05c300 0x7ff07c05e7c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:57.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0940f6530 0x7ff09406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:57.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 --2- 172.21.15.8:0/2945074610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0940f77d0 0x7ff094069e20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:57.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 -- 172.21.15.8:0/2945074610 >> 172.21.15.8:0/2945074610 conn(0x7ff0940f1c90 msgr2=0x7ff0940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:57.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 -- 172.21.15.8:0/2945074610 shutdown_connections 2023-10-18T20:55:57.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:57.527+0000 7ff093fff700 1 -- 172.21.15.8:0/2945074610 wait complete. 2023-10-18T20:55:57.533 INFO:teuthology.orchestra.run.smithi008.stderr:inline data disabled 2023-10-18T20:55:57.886 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-18T20:55:57.896 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:55:57.897 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-18T20:55:58.058 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:57.384051+0000 mon.smithi008 (mon.0) 512 : audit [INF] from='client.? 172.21.15.8:0/2945074610' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-10-18T20:55:58.058 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:57.525404+0000 mon.smithi008 (mon.0) 513 : cluster [DBG] mds.? [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] up:active 2023-10-18T20:55:58.058 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:57.525497+0000 mon.smithi008 (mon.0) 514 : audit [INF] from='client.? 172.21.15.8:0/2945074610' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-10-18T20:55:58.058 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:57.525584+0000 mon.smithi008 (mon.0) 515 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2023-10-18T20:55:58.143 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:57.384051+0000 mon.smithi008 (mon.0) 512 : audit [INF] from='client.? 172.21.15.8:0/2945074610' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-10-18T20:55:58.143 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:57.525404+0000 mon.smithi008 (mon.0) 513 : cluster [DBG] mds.? [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] up:active 2023-10-18T20:55:58.143 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:57.525497+0000 mon.smithi008 (mon.0) 514 : audit [INF] from='client.? 172.21.15.8:0/2945074610' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-10-18T20:55:58.144 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:57.525584+0000 mon.smithi008 (mon.0) 515 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2023-10-18T20:55:59.001 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:58.123018+0000 mgr.smithi008.flmjzp (mgr.14164) 208 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 160 B data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 8 op/s 2023-10-18T20:55:59.001 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:58.652852+0000 mon.smithi008 (mon.0) 516 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:58.123018+0000 mgr.smithi008.flmjzp (mgr.14164) 208 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 160 B data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 8 op/s 2023-10-18T20:55:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:58.652852+0000 mon.smithi008 (mon.0) 516 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:55:59.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.742+0000 7fc73f343700 1 -- 172.21.15.8:0/560254253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7380f6530 msgr2=0x7fc7380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:59.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.742+0000 7fc73f343700 1 --2- 172.21.15.8:0/560254253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7380f6530 0x7fc7380f6950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fc734004660 tx=0x7fc734009b30).stop 2023-10-18T20:55:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.742+0000 7fc73f343700 1 -- 172.21.15.8:0/560254253 shutdown_connections 2023-10-18T20:55:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.742+0000 7fc73f343700 1 --2- 172.21.15.8:0/560254253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7380f77d0 0x7fc7380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.742+0000 7fc73f343700 1 --2- 172.21.15.8:0/560254253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7380f6530 0x7fc7380f6950 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.742+0000 7fc73f343700 1 -- 172.21.15.8:0/560254253 >> 172.21.15.8:0/560254253 conn(0x7fc7380f1c90 msgr2=0x7fc7380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.742+0000 7fc73f343700 1 -- 172.21.15.8:0/560254253 shutdown_connections 2023-10-18T20:55:59.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.742+0000 7fc73f343700 1 -- 172.21.15.8:0/560254253 wait complete. 2023-10-18T20:55:59.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.743+0000 7fc73f343700 1 Processor -- start 2023-10-18T20:55:59.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.744+0000 7fc73f343700 1 -- start start 2023-10-18T20:55:59.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.744+0000 7fc73f343700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7380f6530 0x7fc738108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:59.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.744+0000 7fc73f343700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7380f77d0 0x7fc738109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.744+0000 7fc73f343700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc738109a00 con 0x7fc7380f77d0 2023-10-18T20:55:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.744+0000 7fc73f343700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc738109b40 con 0x7fc7380f6530 2023-10-18T20:55:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.744+0000 7fc73db40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7380f77d0 0x7fc738109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.744+0000 7fc73db40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7380f77d0 0x7fc738109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38142/0 (socket says 172.21.15.8:38142) 2023-10-18T20:55:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.744+0000 7fc73e341700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7380f6530 0x7fc738108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.744+0000 7fc73db40700 1 -- 172.21.15.8:0/1751424808 learned_addr learned my addr 172.21.15.8:0/1751424808 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:55:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.745+0000 7fc73e341700 1 -- 172.21.15.8:0/1751424808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7380f77d0 msgr2=0x7fc738109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.745+0000 7fc73e341700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7380f77d0 0x7fc738109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.745+0000 7fc73e341700 1 -- 172.21.15.8:0/1751424808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc734005040 con 0x7fc7380f6530 2023-10-18T20:55:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.745+0000 7fc73db40700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7380f77d0 0x7fc738109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T20:55:59.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.745+0000 7fc73e341700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7380f6530 0x7fc738108f60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc734000c00 tx=0x7fc73400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:59.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.747+0000 7fc72effd700 1 -- 172.21.15.8:0/1751424808 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc734019070 con 0x7fc7380f6530 2023-10-18T20:55:59.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.747+0000 7fc72effd700 1 -- 172.21.15.8:0/1751424808 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc734007e70 con 0x7fc7380f6530 2023-10-18T20:55:59.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.747+0000 7fc72effd700 1 -- 172.21.15.8:0/1751424808 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc734014c00 con 0x7fc7380f6530 2023-10-18T20:55:59.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.747+0000 7fc73f343700 1 -- 172.21.15.8:0/1751424808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73810a480 con 0x7fc7380f6530 2023-10-18T20:55:59.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.747+0000 7fc73f343700 1 -- 172.21.15.8:0/1751424808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73810a9e0 con 0x7fc7380f6530 2023-10-18T20:55:59.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.748+0000 7fc73f343700 1 -- 172.21.15.8:0/1751424808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc738045ad0 con 0x7fc7380f6530 2023-10-18T20:55:59.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.748+0000 7fc72effd700 1 -- 172.21.15.8:0/1751424808 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc734025070 con 0x7fc7380f6530 2023-10-18T20:55:59.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.749+0000 7fc72effd700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc72405c300 0x7fc72405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:55:59.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.749+0000 7fc72effd700 1 -- 172.21.15.8:0/1751424808 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc734076cd0 con 0x7fc7380f6530 2023-10-18T20:55:59.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.749+0000 7fc73db40700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc72405c300 0x7fc72405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:55:59.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.750+0000 7fc73db40700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc72405c300 0x7fc72405e7c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fc728007a30 tx=0x7fc72800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:55:59.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.754+0000 7fc72effd700 1 -- 172.21.15.8:0/1751424808 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc734049950 con 0x7fc7380f6530 2023-10-18T20:55:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.976+0000 7fc73f343700 1 -- 172.21.15.8:0/1751424808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc7380fedd0 con 0x7fc7380f6530 2023-10-18T20:55:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.977+0000 7fc72effd700 1 -- 172.21.15.8:0/1751424808 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1447 (secure 0 0 0) 0x7fc73404cf70 con 0x7fc7380f6530 2023-10-18T20:55:59.979 INFO:teuthology.orchestra.run.smithi008.stdout:e11 2023-10-18T20:55:59.980 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:55:59.980 INFO:teuthology.orchestra.run.smithi008.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:55:59.980 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T20:55:59.980 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:59.980 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T20:55:59.980 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T20:55:59.981 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 11 2023-10-18T20:55:59.981 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T20:55:59.981 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:55:59.981 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:55:59.376097+0000 2023-10-18T20:55:59.981 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T20:55:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T20:55:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T20:55:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T20:55:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T20:55:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T20:55:59.983 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T20:55:59.983 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T20:55:59.983 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:55:59.983 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T20:55:59.983 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T20:55:59.984 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T20:55:59.984 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T20:55:59.984 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T20:55:59.984 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T20:55:59.984 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T20:55:59.984 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T20:55:59.985 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T20:55:59.985 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T20:55:59.985 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T20:55:59.985 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015]] 2023-10-18T20:55:59.985 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 2 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531]] 2023-10-18T20:55:59.986 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145]] 2023-10-18T20:55:59.986 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:59.986 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:55:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.979+0000 7fc73f343700 1 -- 172.21.15.8:0/1751424808 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc72405c300 msgr2=0x7fc72405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.979+0000 7fc73f343700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc72405c300 0x7fc72405e7c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fc728007a30 tx=0x7fc72800b040).stop 2023-10-18T20:55:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.979+0000 7fc73f343700 1 -- 172.21.15.8:0/1751424808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7380f6530 msgr2=0x7fc738108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:55:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.979+0000 7fc73f343700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7380f6530 0x7fc738108f60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc734000c00 tx=0x7fc73400b040).stop 2023-10-18T20:55:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.979+0000 7fc73f343700 1 -- 172.21.15.8:0/1751424808 shutdown_connections 2023-10-18T20:55:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.979+0000 7fc73f343700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fc72405c300 0x7fc72405e7c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.979+0000 7fc73f343700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7380f6530 0x7fc738108f60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.979+0000 7fc73f343700 1 --2- 172.21.15.8:0/1751424808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7380f77d0 0x7fc738109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:55:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.979+0000 7fc73f343700 1 -- 172.21.15.8:0/1751424808 >> 172.21.15.8:0/1751424808 conn(0x7fc7380f1c90 msgr2=0x7fc73806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:55:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.980+0000 7fc73f343700 1 -- 172.21.15.8:0/1751424808 shutdown_connections 2023-10-18T20:55:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:55:59.980+0000 7fc73f343700 1 -- 172.21.15.8:0/1751424808 wait complete. 2023-10-18T20:55:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 11 2023-10-18T20:56:00.003 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:59.372745+0000 mon.smithi008 (mon.0) 517 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-10-18T20:56:00.003 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:59.372773+0000 mon.smithi008 (mon.0) 518 : cluster [INF] Cluster is now healthy 2023-10-18T20:56:00.004 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:59.376016+0000 mon.smithi008 (mon.0) 519 : cluster [DBG] mds.? [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] up:boot 2023-10-18T20:56:00.004 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:59.376344+0000 mon.smithi008 (mon.0) 520 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 1 up:standby 2023-10-18T20:56:00.004 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:59.376485+0000 mon.smithi008 (mon.0) 521 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T20:56:00.004 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:55:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:55:59.379442+0000 mon.smithi008 (mon.0) 522 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 1 up:standby-replay 2023-10-18T20:56:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:59.372745+0000 mon.smithi008 (mon.0) 517 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-10-18T20:56:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:59.372773+0000 mon.smithi008 (mon.0) 518 : cluster [INF] Cluster is now healthy 2023-10-18T20:56:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:59.376016+0000 mon.smithi008 (mon.0) 519 : cluster [DBG] mds.? [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] up:boot 2023-10-18T20:56:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:59.376344+0000 mon.smithi008 (mon.0) 520 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 1 up:standby 2023-10-18T20:56:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:59.376485+0000 mon.smithi008 (mon.0) 521 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T20:56:00.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:55:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:55:59.379442+0000 mon.smithi008 (mon.0) 522 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 1 up:standby-replay 2023-10-18T20:56:00.381 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-10-18T20:56:01.018 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:55:59.977808+0000 mon.smithi060 (mon.1) 14 : audit [DBG] from='client.? 172.21.15.8:0/1751424808' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:56:01.018 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:00.123512+0000 mgr.smithi008.flmjzp (mgr.14164) 209 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 3.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 4.0 KiB/s wr, 16 op/s 2023-10-18T20:56:01.018 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:00.664633+0000 mon.smithi008 (mon.0) 523 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:55:59.977808+0000 mon.smithi060 (mon.1) 14 : audit [DBG] from='client.? 172.21.15.8:0/1751424808' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:56:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:00.123512+0000 mgr.smithi008.flmjzp (mgr.14164) 209 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 3.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 4.0 KiB/s wr, 16 op/s 2023-10-18T20:56:01.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:00.664633+0000 mon.smithi008 (mon.0) 523 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:01.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.769+0000 7fd0cac27700 1 -- 172.21.15.8:0/602461403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0c40f77d0 msgr2=0x7fd0c40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:01.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.769+0000 7fd0cac27700 1 --2- 172.21.15.8:0/602461403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0c40f77d0 0x7fd0c40f7c30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd0b40045a0 tx=0x7fd0b4009b30).stop 2023-10-18T20:56:01.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.769+0000 7fd0cac27700 1 -- 172.21.15.8:0/602461403 shutdown_connections 2023-10-18T20:56:01.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.769+0000 7fd0cac27700 1 --2- 172.21.15.8:0/602461403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0c40f77d0 0x7fd0c40f7c30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:01.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.769+0000 7fd0cac27700 1 --2- 172.21.15.8:0/602461403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0c40f6530 0x7fd0c40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:01.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.769+0000 7fd0cac27700 1 -- 172.21.15.8:0/602461403 >> 172.21.15.8:0/602461403 conn(0x7fd0c40f1c90 msgr2=0x7fd0c40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:01.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.770+0000 7fd0cac27700 1 -- 172.21.15.8:0/602461403 shutdown_connections 2023-10-18T20:56:01.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.770+0000 7fd0cac27700 1 -- 172.21.15.8:0/602461403 wait complete. 2023-10-18T20:56:01.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.770+0000 7fd0cac27700 1 Processor -- start 2023-10-18T20:56:01.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.771+0000 7fd0cac27700 1 -- start start 2023-10-18T20:56:01.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.771+0000 7fd0cac27700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0c40f6530 0x7fd0c4108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:01.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.771+0000 7fd0cac27700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0c40f77d0 0x7fd0c4109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:01.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.771+0000 7fd0cac27700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41099c0 con 0x7fd0c40f6530 2023-10-18T20:56:01.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.771+0000 7fd0cac27700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c4109b00 con 0x7fd0c40f77d0 2023-10-18T20:56:01.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.771+0000 7fd0c9c25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0c40f6530 0x7fd0c4108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:01.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.771+0000 7fd0c9424700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0c40f77d0 0x7fd0c4109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:01.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.771+0000 7fd0c9c25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0c40f6530 0x7fd0c4108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38160/0 (socket says 172.21.15.8:38160) 2023-10-18T20:56:01.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.771+0000 7fd0c9c25700 1 -- 172.21.15.8:0/27221747 learned_addr learned my addr 172.21.15.8:0/27221747 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:01.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.772+0000 7fd0c9424700 1 -- 172.21.15.8:0/27221747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0c40f6530 msgr2=0x7fd0c4108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:01.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.772+0000 7fd0c9424700 1 --2- 172.21.15.8:0/27221747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0c40f6530 0x7fd0c4108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:01.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.772+0000 7fd0c9424700 1 -- 172.21.15.8:0/27221747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b4005040 con 0x7fd0c40f77d0 2023-10-18T20:56:01.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.772+0000 7fd0c9424700 1 --2- 172.21.15.8:0/27221747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0c40f77d0 0x7fd0c4109410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd0b40045a0 tx=0x7fd0b400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:01.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.772+0000 7fd0ba7fc700 1 -- 172.21.15.8:0/27221747 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b400e070 con 0x7fd0c40f77d0 2023-10-18T20:56:01.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.772+0000 7fd0ba7fc700 1 -- 172.21.15.8:0/27221747 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0b401e420 con 0x7fd0c40f77d0 2023-10-18T20:56:01.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.772+0000 7fd0ba7fc700 1 -- 172.21.15.8:0/27221747 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b4019070 con 0x7fd0c40f77d0 2023-10-18T20:56:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.772+0000 7fd0cac27700 1 -- 172.21.15.8:0/27221747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c410a440 con 0x7fd0c40f77d0 2023-10-18T20:56:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.773+0000 7fd0cac27700 1 -- 172.21.15.8:0/27221747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c410a8d0 con 0x7fd0c40f77d0 2023-10-18T20:56:01.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.773+0000 7fd0cac27700 1 -- 172.21.15.8:0/27221747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c4045ad0 con 0x7fd0c40f77d0 2023-10-18T20:56:01.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.774+0000 7fd0ba7fc700 1 -- 172.21.15.8:0/27221747 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd0b401e950 con 0x7fd0c40f77d0 2023-10-18T20:56:01.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.775+0000 7fd0ba7fc700 1 --2- 172.21.15.8:0/27221747 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd0b005c300 0x7fd0b005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:01.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.775+0000 7fd0ba7fc700 1 -- 172.21.15.8:0/27221747 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd0b4077560 con 0x7fd0c40f77d0 2023-10-18T20:56:01.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.775+0000 7fd0c9c25700 1 --2- 172.21.15.8:0/27221747 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd0b005c300 0x7fd0b005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:01.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.776+0000 7fd0c9c25700 1 --2- 172.21.15.8:0/27221747 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd0b005c300 0x7fd0b005e7c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd0c0009fd0 tx=0x7fd0c000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:01.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.779+0000 7fd0ba7fc700 1 -- 172.21.15.8:0/27221747 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd0b404a160 con 0x7fd0c40f77d0 2023-10-18T20:56:01.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.992+0000 7fd0cac27700 1 -- 172.21.15.8:0/27221747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0c4027a00 con 0x7fd0c40f77d0 2023-10-18T20:56:01.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.993+0000 7fd0ba7fc700 1 -- 172.21.15.8:0/27221747 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2952 (secure 0 0 0) 0x7fd0b404d780 con 0x7fd0c40f77d0 2023-10-18T20:56:01.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.995+0000 7fd0cac27700 1 -- 172.21.15.8:0/27221747 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd0b005c300 msgr2=0x7fd0b005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:01.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.995+0000 7fd0cac27700 1 --2- 172.21.15.8:0/27221747 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd0b005c300 0x7fd0b005e7c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd0c0009fd0 tx=0x7fd0c000b040).stop 2023-10-18T20:56:01.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.995+0000 7fd0cac27700 1 -- 172.21.15.8:0/27221747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0c40f77d0 msgr2=0x7fd0c4109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:01.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.995+0000 7fd0cac27700 1 --2- 172.21.15.8:0/27221747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0c40f77d0 0x7fd0c4109410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd0b40045a0 tx=0x7fd0b400b040).stop 2023-10-18T20:56:01.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.995+0000 7fd0cac27700 1 -- 172.21.15.8:0/27221747 shutdown_connections 2023-10-18T20:56:01.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.995+0000 7fd0cac27700 1 --2- 172.21.15.8:0/27221747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0c40f6530 0x7fd0c4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:01.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.995+0000 7fd0cac27700 1 --2- 172.21.15.8:0/27221747 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd0b005c300 0x7fd0b005e7c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:01.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.995+0000 7fd0cac27700 1 --2- 172.21.15.8:0/27221747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0c40f77d0 0x7fd0c4109410 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:01.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.995+0000 7fd0cac27700 1 -- 172.21.15.8:0/27221747 >> 172.21.15.8:0/27221747 conn(0x7fd0c40f1c90 msgr2=0x7fd0c406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:01.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.996+0000 7fd0cac27700 1 -- 172.21.15.8:0/27221747 shutdown_connections 2023-10-18T20:56:01.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:01.996+0000 7fd0cac27700 1 -- 172.21.15.8:0/27221747 wait complete. 2023-10-18T20:56:02.000 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 13 2023-10-18T20:56:02.012 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T20:56:02.021 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:00.751093+0000 mon.smithi008 (mon.0) 524 : cluster [DBG] mds.? [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] up:boot 2023-10-18T20:56:02.021 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:00.751515+0000 mon.smithi008 (mon.0) 525 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 1 up:standby-replay 1 up:standby 2023-10-18T20:56:02.021 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:00.751776+0000 mon.smithi008 (mon.0) 526 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T20:56:02.021 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:00.754426+0000 mon.smithi008 (mon.0) 527 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:56:02.021 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:01.109625+0000 mon.smithi008 (mon.0) 528 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:02.022 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:01.112908+0000 mon.smithi008 (mon.0) 529 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:56:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:00.751093+0000 mon.smithi008 (mon.0) 524 : cluster [DBG] mds.? [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] up:boot 2023-10-18T20:56:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:00.751515+0000 mon.smithi008 (mon.0) 525 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 1 up:standby-replay 1 up:standby 2023-10-18T20:56:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:00.751776+0000 mon.smithi008 (mon.0) 526 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T20:56:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:00.754426+0000 mon.smithi008 (mon.0) 527 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:56:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:01.109625+0000 mon.smithi008 (mon.0) 528 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:01.112908+0000 mon.smithi008 (mon.0) 529 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:56:02.423 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-10-18T20:56:02.980 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:01.993711+0000 mon.smithi060 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.8:0/27221747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T20:56:02.981 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:02.123864+0000 mgr.smithi008.flmjzp (mgr.14164) 210 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 682 B/s rd, 3.7 KiB/s wr, 13 op/s 2023-10-18T20:56:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:01.993711+0000 mon.smithi060 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.8:0/27221747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T20:56:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:02.123864+0000 mgr.smithi008.flmjzp (mgr.14164) 210 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 682 B/s rd, 3.7 KiB/s wr, 13 op/s 2023-10-18T20:56:04.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.041+0000 7fda5cbeb700 1 -- 172.21.15.8:0/1397669015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda58060310 msgr2=0x7fda580f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:04.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.041+0000 7fda5cbeb700 1 --2- 172.21.15.8:0/1397669015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda58060310 0x7fda580f9120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fda48004660 tx=0x7fda48009b30).stop 2023-10-18T20:56:04.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.041+0000 7fda5cbeb700 1 -- 172.21.15.8:0/1397669015 shutdown_connections 2023-10-18T20:56:04.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.041+0000 7fda5cbeb700 1 --2- 172.21.15.8:0/1397669015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda580f96a0 0x7fda580fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:04.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.041+0000 7fda5cbeb700 1 --2- 172.21.15.8:0/1397669015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda58060310 0x7fda580f9120 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:04.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.041+0000 7fda5cbeb700 1 -- 172.21.15.8:0/1397669015 >> 172.21.15.8:0/1397669015 conn(0x7fda580f0ba0 msgr2=0x7fda580f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:04.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.041+0000 7fda5cbeb700 1 -- 172.21.15.8:0/1397669015 shutdown_connections 2023-10-18T20:56:04.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.041+0000 7fda5cbeb700 1 -- 172.21.15.8:0/1397669015 wait complete. 2023-10-18T20:56:04.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.042+0000 7fda5cbeb700 1 Processor -- start 2023-10-18T20:56:04.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.043+0000 7fda5cbeb700 1 -- start start 2023-10-18T20:56:04.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.043+0000 7fda5cbeb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda58060310 0x7fda580f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:04.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.043+0000 7fda5cbeb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda580f96a0 0x7fda580f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:04.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.043+0000 7fda5cbeb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda580f5580 con 0x7fda58060310 2023-10-18T20:56:04.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.043+0000 7fda5cbeb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda580f56c0 con 0x7fda580f96a0 2023-10-18T20:56:04.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.043+0000 7fda577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda58060310 0x7fda580f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:04.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.043+0000 7fda577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda58060310 0x7fda580f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38174/0 (socket says 172.21.15.8:38174) 2023-10-18T20:56:04.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.043+0000 7fda577fe700 1 -- 172.21.15.8:0/2595807465 learned_addr learned my addr 172.21.15.8:0/2595807465 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:04.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda56ffd700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda580f96a0 0x7fda580f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:04.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda577fe700 1 -- 172.21.15.8:0/2595807465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda580f96a0 msgr2=0x7fda580f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:04.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda577fe700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda580f96a0 0x7fda580f5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:04.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda577fe700 1 -- 172.21.15.8:0/2595807465 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48005040 con 0x7fda58060310 2023-10-18T20:56:04.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda56ffd700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda580f96a0 0x7fda580f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T20:56:04.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda577fe700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda58060310 0x7fda580f6ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fda48007a40 tx=0x7fda48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:04.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda3ffff700 1 -- 172.21.15.8:0/2595807465 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda48018070 con 0x7fda58060310 2023-10-18T20:56:04.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda3ffff700 1 -- 172.21.15.8:0/2595807465 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda48013410 con 0x7fda58060310 2023-10-18T20:56:04.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda5cbeb700 1 -- 172.21.15.8:0/2595807465 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda580f5940 con 0x7fda58060310 2023-10-18T20:56:04.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda3ffff700 1 -- 172.21.15.8:0/2595807465 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda4801c620 con 0x7fda58060310 2023-10-18T20:56:04.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.044+0000 7fda5cbeb700 1 -- 172.21.15.8:0/2595807465 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda580f5ea0 con 0x7fda58060310 2023-10-18T20:56:04.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.046+0000 7fda5cbeb700 1 -- 172.21.15.8:0/2595807465 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda58045ad0 con 0x7fda58060310 2023-10-18T20:56:04.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.047+0000 7fda3ffff700 1 -- 172.21.15.8:0/2595807465 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fda4801c890 con 0x7fda58060310 2023-10-18T20:56:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.047+0000 7fda3ffff700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fda4005c2f0 0x7fda4005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.048+0000 7fda3ffff700 1 -- 172.21.15.8:0/2595807465 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fda48078030 con 0x7fda58060310 2023-10-18T20:56:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.048+0000 7fda56ffd700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fda4005c2f0 0x7fda4005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.048+0000 7fda56ffd700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fda4005c2f0 0x7fda4005e7b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fda580600e0 tx=0x7fda4c009040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.050+0000 7fda3ffff700 1 -- 172.21.15.8:0/2595807465 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fda4804ade0 con 0x7fda58060310 2023-10-18T20:56:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:02.757368+0000 mon.smithi008 (mon.0) 530 : cluster [DBG] mds.? [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] up:standby-replay 2023-10-18T20:56:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:02.757420+0000 mon.smithi008 (mon.0) 531 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:56:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:03.226253+0000 mon.smithi008 (mon.0) 532 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:02.757368+0000 mon.smithi008 (mon.0) 530 : cluster [DBG] mds.? [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] up:standby-replay 2023-10-18T20:56:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:02.757420+0000 mon.smithi008 (mon.0) 531 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:56:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:03.226253+0000 mon.smithi008 (mon.0) 532 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:04.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.288+0000 7fda5cbeb700 1 -- 172.21.15.8:0/2595807465 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fda58027a00 con 0x7fda58060310 2023-10-18T20:56:04.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.289+0000 7fda3ffff700 1 -- 172.21.15.8:0/2595807465 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+86 (secure 0 0 0) 0x7fda4804e400 con 0x7fda58060310 2023-10-18T20:56:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 -- 172.21.15.8:0/2595807465 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fda4005c2f0 msgr2=0x7fda4005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fda4005c2f0 0x7fda4005e7b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fda580600e0 tx=0x7fda4c009040).stop 2023-10-18T20:56:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 -- 172.21.15.8:0/2595807465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda58060310 msgr2=0x7fda580f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda58060310 0x7fda580f6ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fda48007a40 tx=0x7fda48009b30).stop 2023-10-18T20:56:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 -- 172.21.15.8:0/2595807465 shutdown_connections 2023-10-18T20:56:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda58060310 0x7fda580f6ba0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fda4005c2f0 0x7fda4005e7b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 --2- 172.21.15.8:0/2595807465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda580f96a0 0x7fda580f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 -- 172.21.15.8:0/2595807465 >> 172.21.15.8:0/2595807465 conn(0x7fda580f0ba0 msgr2=0x7fda580f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 -- 172.21.15.8:0/2595807465 shutdown_connections 2023-10-18T20:56:04.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:04.291+0000 7fda5cbeb700 1 -- 172.21.15.8:0/2595807465 wait complete. 2023-10-18T20:56:04.306 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T20:56:04.729 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-10-18T20:56:04.774 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T20:56:04.842 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:04.124276+0000 mgr.smithi008.flmjzp (mgr.14164) 211 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2023-10-18T20:56:04.842 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:04.289582+0000 mon.smithi008 (mon.0) 533 : audit [DBG] from='client.? 172.21.15.8:0/2595807465' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-10-18T20:56:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.108+0000 7fe72a1ff700 1 -- 172.21.15.8:0/2517098782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7240f9980 msgr2=0x7fe7240f9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.108+0000 7fe72a1ff700 1 --2- 172.21.15.8:0/2517098782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7240f9980 0x7fe7240f9de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fe718004660 tx=0x7fe718009b30).stop 2023-10-18T20:56:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.108+0000 7fe72a1ff700 1 -- 172.21.15.8:0/2517098782 shutdown_connections 2023-10-18T20:56:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.108+0000 7fe72a1ff700 1 --2- 172.21.15.8:0/2517098782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7240f9980 0x7fe7240f9de0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.108+0000 7fe72a1ff700 1 --2- 172.21.15.8:0/2517098782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7240f86e0 0x7fe7240f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.108+0000 7fe72a1ff700 1 -- 172.21.15.8:0/2517098782 >> 172.21.15.8:0/2517098782 conn(0x7fe7240f40e0 msgr2=0x7fe7240f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.108+0000 7fe72a1ff700 1 -- 172.21.15.8:0/2517098782 shutdown_connections 2023-10-18T20:56:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.108+0000 7fe72a1ff700 1 -- 172.21.15.8:0/2517098782 wait complete. 2023-10-18T20:56:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.109+0000 7fe72a1ff700 1 Processor -- start 2023-10-18T20:56:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.109+0000 7fe72a1ff700 1 -- start start 2023-10-18T20:56:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.109+0000 7fe72a1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7240f86e0 0x7fe724108db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.109+0000 7fe72a1ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7240f9980 0x7fe7241092a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:05.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.109+0000 7fe72a1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe724109850 con 0x7fe7240f86e0 2023-10-18T20:56:05.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.109+0000 7fe72a1ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe724109990 con 0x7fe7240f9980 2023-10-18T20:56:05.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe7237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7240f86e0 0x7fe724108db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe7237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7240f86e0 0x7fe724108db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38198/0 (socket says 172.21.15.8:38198) 2023-10-18T20:56:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe7237fe700 1 -- 172.21.15.8:0/1269938494 learned_addr learned my addr 172.21.15.8:0/1269938494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe722ffd700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7240f9980 0x7fe7241092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe7237fe700 1 -- 172.21.15.8:0/1269938494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7240f9980 msgr2=0x7fe7241092a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe7237fe700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7240f9980 0x7fe7241092a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe7237fe700 1 -- 172.21.15.8:0/1269938494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718005040 con 0x7fe7240f86e0 2023-10-18T20:56:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe7237fe700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7240f86e0 0x7fe724108db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fe714002700 tx=0x7fe714009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe70bfff700 1 -- 172.21.15.8:0/1269938494 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe714009320 con 0x7fe7240f86e0 2023-10-18T20:56:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe70bfff700 1 -- 172.21.15.8:0/1269938494 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe71400f040 con 0x7fe7240f86e0 2023-10-18T20:56:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.110+0000 7fe70bfff700 1 -- 172.21.15.8:0/1269938494 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe714014900 con 0x7fe7240f86e0 2023-10-18T20:56:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.111+0000 7fe72a1ff700 1 -- 172.21.15.8:0/1269938494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72410e430 con 0x7fe7240f86e0 2023-10-18T20:56:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.111+0000 7fe72a1ff700 1 -- 172.21.15.8:0/1269938494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72410e9f0 con 0x7fe7240f86e0 2023-10-18T20:56:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.112+0000 7fe72a1ff700 1 -- 172.21.15.8:0/1269938494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe724027a00 con 0x7fe7240f86e0 2023-10-18T20:56:05.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.112+0000 7fe70bfff700 1 -- 172.21.15.8:0/1269938494 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe714009480 con 0x7fe7240f86e0 2023-10-18T20:56:05.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.113+0000 7fe70bfff700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe70c05c360 0x7fe70c05e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:05.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.113+0000 7fe70bfff700 1 -- 172.21.15.8:0/1269938494 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe714076180 con 0x7fe7240f86e0 2023-10-18T20:56:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.113+0000 7fe722ffd700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe70c05c360 0x7fe70c05e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.114+0000 7fe722ffd700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe70c05c360 0x7fe70c05e820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fe718005010 tx=0x7fe718009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.117+0000 7fe70bfff700 1 -- 172.21.15.8:0/1269938494 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe714048ec0 con 0x7fe7240f86e0 2023-10-18T20:56:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:04.124276+0000 mgr.smithi008.flmjzp (mgr.14164) 211 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2023-10-18T20:56:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:04.289582+0000 mon.smithi008 (mon.0) 533 : audit [DBG] from='client.? 172.21.15.8:0/2595807465' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-10-18T20:56:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.289+0000 7fe72a1ff700 1 -- 172.21.15.8:0/1269938494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe724100e70 con 0x7fe7240f86e0 2023-10-18T20:56:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.290+0000 7fe70bfff700 1 -- 172.21.15.8:0/1269938494 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+14002 (secure 0 0 0) 0x7fe71404c4e0 con 0x7fe7240f86e0 2023-10-18T20:56:05.292 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:56:05.293 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":41,"fsid":"e1aaa62c-6df7-11ee-8db6-212e2dc638e7","created":"2023-10-18T20:50:24.656195+0000","modified":"2023-10-18T20:55:48.769640+0000","last_up_change":"2023-10-18T20:54:50.370279+0000","last_in_change":"2023-10-18T20:54:34.143950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-18T20:54:11.909803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-10-18T20:55:45.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-10-18T20:55:46.282925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84acbfd0-21a5-4744-9fba-9b1ae8ac4018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6803","nonce":1892122968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6805","nonce":1892122968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6809","nonce":1892122968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1892122968},{"type":"v1","addr":"172.21.15.8:6807","nonce":1892122968}]},"public_addr":"172.21.15.8:6803/1892122968","cluster_addr":"172.21.15.8:6805/1892122968","heartbeat_back_addr":"172.21.15.8:6809/1892122968","heartbeat_front_addr":"172.21.15.8:6807/1892122968","state":["exists","up"]},{"osd":1,"uuid":"40db6fdb-ab66-473c-b471-ae97389d8be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6811","nonce":3500777529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6813","nonce":3500777529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6817","nonce":3500777529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3500777529},{"type":"v1","addr":"172.21.15.8:6815","nonce":3500777529}]},"public_addr":"172.21.15.8:6811/3500777529","cluster_addr":"172.21.15.8:6813/3500777529","heartbeat_back_addr":"172.21.15.8:6817/3500777529","heartbeat_front_addr":"172.21.15.8:6815/3500777529","state":["exists","up"]},{"osd":2,"uuid":"21ea78f3-f3ad-42dc-b034-a9e350635ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6819","nonce":3366082731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6821","nonce":3366082731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6825","nonce":3366082731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3366082731},{"type":"v1","addr":"172.21.15.8:6823","nonce":3366082731}]},"public_addr":"172.21.15.8:6819/3366082731","cluster_addr":"172.21.15.8:6821/3366082731","heartbeat_back_addr":"172.21.15.8:6825/3366082731","heartbeat_front_addr":"172.21.15.8:6823/3366082731","state":["exists","up"]},{"osd":3,"uuid":"6c8b8dd3-cec0-4acb-a59d-bcdadf4097fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6801","nonce":233749194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6803","nonce":233749194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6807","nonce":233749194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":233749194},{"type":"v1","addr":"172.21.15.60:6805","nonce":233749194}]},"public_addr":"172.21.15.60:6801/233749194","cluster_addr":"172.21.15.60:6803/233749194","heartbeat_back_addr":"172.21.15.60:6807/233749194","heartbeat_front_addr":"172.21.15.60:6805/233749194","state":["exists","up"]},{"osd":4,"uuid":"7469ba83-d780-4657-9add-610badaa3bd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6809","nonce":347739500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6811","nonce":347739500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6815","nonce":347739500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":347739500},{"type":"v1","addr":"172.21.15.60:6813","nonce":347739500}]},"public_addr":"172.21.15.60:6809/347739500","cluster_addr":"172.21.15.60:6811/347739500","heartbeat_back_addr":"172.21.15.60:6815/347739500","heartbeat_front_addr":"172.21.15.60:6813/347739500","state":["exists","up"]},{"osd":5,"uuid":"077c57b2-d346-4723-acd2-348cc46831cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6817","nonce":2728123318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6819","nonce":2728123318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6823","nonce":2728123318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2728123318},{"type":"v1","addr":"172.21.15.60:6821","nonce":2728123318}]},"public_addr":"172.21.15.60:6817/2728123318","cluster_addr":"172.21.15.60:6819/2728123318","heartbeat_back_addr":"172.21.15.60:6823/2728123318","heartbeat_front_addr":"172.21.15.60:6821/2728123318","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:53:22.262127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:53:42.140616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:00.948168+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:16.430237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:32.190357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T20:54:48.411743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/2241689910":"2023-10-19T20:51:22.022313+0000","172.21.15.8:6801/2925059353":"2023-10-19T20:51:22.022313+0000","172.21.15.8:6800/2925059353":"2023-10-19T20:51:22.022313+0000","172.21.15.8:0/3058413829":"2023-10-19T20:51:22.022313+0000","172.21.15.8:0/1911408625":"2023-10-19T20:51:08.069160+0000","172.21.15.8:0/3762975299":"2023-10-19T20:51:08.069160+0000","172.21.15.8:6800/1016712461":"2023-10-19T20:51:08.069160+0000","172.21.15.8:0/1222439770":"2023-10-19T20:50:48.056136+0000","172.21.15.8:6801/4107557235":"2023-10-19T20:50:48.056136+0000","172.21.15.8:6801/1016712461":"2023-10-19T20:51:08.069160+0000","172.21.15.8:6800/4107557235":"2023-10-19T20:50:48.056136+0000","172.21.15.8:0/439064198":"2023-10-19T20:50:48.056136+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T20:56:05.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.292+0000 7fe72a1ff700 1 -- 172.21.15.8:0/1269938494 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe70c05c360 msgr2=0x7fe70c05e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:05.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.292+0000 7fe72a1ff700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe70c05c360 0x7fe70c05e820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fe718005010 tx=0x7fe718009b30).stop 2023-10-18T20:56:05.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.292+0000 7fe72a1ff700 1 -- 172.21.15.8:0/1269938494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7240f86e0 msgr2=0x7fe724108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:05.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.292+0000 7fe72a1ff700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7240f86e0 0x7fe724108db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fe714002700 tx=0x7fe714009d80).stop 2023-10-18T20:56:05.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.293+0000 7fe72a1ff700 1 -- 172.21.15.8:0/1269938494 shutdown_connections 2023-10-18T20:56:05.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.293+0000 7fe72a1ff700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7240f86e0 0x7fe724108db0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.293+0000 7fe72a1ff700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe70c05c360 0x7fe70c05e820 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.293+0000 7fe72a1ff700 1 --2- 172.21.15.8:0/1269938494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7240f9980 0x7fe7241092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.293+0000 7fe72a1ff700 1 -- 172.21.15.8:0/1269938494 >> 172.21.15.8:0/1269938494 conn(0x7fe7240f40e0 msgr2=0x7fe7240fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.293+0000 7fe72a1ff700 1 -- 172.21.15.8:0/1269938494 shutdown_connections 2023-10-18T20:56:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.293+0000 7fe72a1ff700 1 -- 172.21.15.8:0/1269938494 wait complete. 2023-10-18T20:56:05.313 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-18T20:54:11.909803+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-10-18T20:55:45.698601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-10-18T20:55:46.282925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T20:56:05.314 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-18T20:56:05.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.524+0000 7f60abfff700 1 -- 172.21.15.8:0/4257684436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60ac06a3b0 msgr2=0x7f60ac06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:05.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.524+0000 7f60abfff700 1 --2- 172.21.15.8:0/4257684436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60ac06a3b0 0x7f60ac06a830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f60a0004660 tx=0x7f60a0009b30).stop 2023-10-18T20:56:05.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.524+0000 7f60abfff700 1 -- 172.21.15.8:0/4257684436 shutdown_connections 2023-10-18T20:56:05.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.524+0000 7f60abfff700 1 --2- 172.21.15.8:0/4257684436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60ac06a3b0 0x7f60ac06a830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.524+0000 7f60abfff700 1 --2- 172.21.15.8:0/4257684436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60ac06b9c0 0x7f60ac069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.524+0000 7f60abfff700 1 -- 172.21.15.8:0/4257684436 >> 172.21.15.8:0/4257684436 conn(0x7f60ac0f1a50 msgr2=0x7f60ac0f3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:05.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.524+0000 7f60abfff700 1 -- 172.21.15.8:0/4257684436 shutdown_connections 2023-10-18T20:56:05.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.524+0000 7f60abfff700 1 -- 172.21.15.8:0/4257684436 wait complete. 2023-10-18T20:56:05.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.525+0000 7f60abfff700 1 Processor -- start 2023-10-18T20:56:05.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.525+0000 7f60abfff700 1 -- start start 2023-10-18T20:56:05.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.525+0000 7f60abfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60ac06a3b0 0x7f60ac108c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:05.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.525+0000 7f60abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60ac06b9c0 0x7f60ac109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:05.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.525+0000 7f60abfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac109750 con 0x7f60ac06b9c0 2023-10-18T20:56:05.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.525+0000 7f60abfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac109890 con 0x7f60ac06a3b0 2023-10-18T20:56:05.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60aa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60ac06b9c0 0x7f60ac109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:05.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60aa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60ac06b9c0 0x7f60ac109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38214/0 (socket says 172.21.15.8:38214) 2023-10-18T20:56:05.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60aa7fc700 1 -- 172.21.15.8:0/1721728613 learned_addr learned my addr 172.21.15.8:0/1721728613 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:05.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60aaffd700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60ac06a3b0 0x7f60ac108c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:05.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60aa7fc700 1 -- 172.21.15.8:0/1721728613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60ac06a3b0 msgr2=0x7f60ac108c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:05.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60aa7fc700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60ac06a3b0 0x7f60ac108c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60aa7fc700 1 -- 172.21.15.8:0/1721728613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0005040 con 0x7f60ac06b9c0 2023-10-18T20:56:05.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60aa7fc700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60ac06b9c0 0x7f60ac109150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f60a0009990 tx=0x7f60a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:05.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60937fe700 1 -- 172.21.15.8:0/1721728613 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60a0018070 con 0x7f60ac06b9c0 2023-10-18T20:56:05.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60937fe700 1 -- 172.21.15.8:0/1721728613 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60a0013410 con 0x7f60ac06b9c0 2023-10-18T20:56:05.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60937fe700 1 -- 172.21.15.8:0/1721728613 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60a001c3c0 con 0x7f60ac06b9c0 2023-10-18T20:56:05.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.526+0000 7f60abfff700 1 -- 172.21.15.8:0/1721728613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac10e240 con 0x7f60ac06b9c0 2023-10-18T20:56:05.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.527+0000 7f60abfff700 1 -- 172.21.15.8:0/1721728613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac10e7a0 con 0x7f60ac06b9c0 2023-10-18T20:56:05.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.528+0000 7f60abfff700 1 -- 172.21.15.8:0/1721728613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac027a00 con 0x7f60ac06b9c0 2023-10-18T20:56:05.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.529+0000 7f60937fe700 1 -- 172.21.15.8:0/1721728613 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f60a001d420 con 0x7f60ac06b9c0 2023-10-18T20:56:05.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.530+0000 7f60937fe700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f609405c2a0 0x7f609405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:05.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.530+0000 7f60937fe700 1 -- 172.21.15.8:0/1721728613 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f60a0077c00 con 0x7f60ac06b9c0 2023-10-18T20:56:05.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.530+0000 7f60aaffd700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f609405c2a0 0x7f609405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:05.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.531+0000 7f60aaffd700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f609405c2a0 0x7f609405e760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f60ac10a150 tx=0x7f609c00b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:05.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.534+0000 7f60937fe700 1 -- 172.21.15.8:0/1721728613 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f60a004a820 con 0x7f60ac06b9c0 2023-10-18T20:56:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.718+0000 7f60abfff700 1 -- 172.21.15.8:0/1721728613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f60ac100c50 con 0x7f60ac06b9c0 2023-10-18T20:56:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.718+0000 7f60937fe700 1 -- 172.21.15.8:0/1721728613 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v41) v1 ==== 110+0+10 (secure 0 0 0) 0x7f60a004de40 con 0x7f60ac06b9c0 2023-10-18T20:56:05.721 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-18T20:56:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 -- 172.21.15.8:0/1721728613 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f609405c2a0 msgr2=0x7f609405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f609405c2a0 0x7f609405e760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f60ac10a150 tx=0x7f609c00b040).stop 2023-10-18T20:56:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 -- 172.21.15.8:0/1721728613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60ac06b9c0 msgr2=0x7f60ac109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60ac06b9c0 0x7f60ac109150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f60a0009990 tx=0x7f60a0009b30).stop 2023-10-18T20:56:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 -- 172.21.15.8:0/1721728613 shutdown_connections 2023-10-18T20:56:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f609405c2a0 0x7f609405e760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60ac06a3b0 0x7f60ac108c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 --2- 172.21.15.8:0/1721728613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60ac06b9c0 0x7f60ac109150 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 -- 172.21.15.8:0/1721728613 >> 172.21.15.8:0/1721728613 conn(0x7f60ac0f1a50 msgr2=0x7f60ac0fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 -- 172.21.15.8:0/1721728613 shutdown_connections 2023-10-18T20:56:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.720+0000 7f60abfff700 1 -- 172.21.15.8:0/1721728613 wait complete. 2023-10-18T20:56:05.741 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-10-18T20:56:05.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.940+0000 7f5470d9d700 1 -- 172.21.15.8:0/3794672941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f546c05fdf0 msgr2=0x7f546c0f8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:05.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.940+0000 7f5470d9d700 1 --2- 172.21.15.8:0/3794672941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f546c05fdf0 0x7f546c0f8ed0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f545c004660 tx=0x7f545c009b30).stop 2023-10-18T20:56:05.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.940+0000 7f5470d9d700 1 -- 172.21.15.8:0/3794672941 shutdown_connections 2023-10-18T20:56:05.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.940+0000 7f5470d9d700 1 --2- 172.21.15.8:0/3794672941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c0f9450 0x7f546c0fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:56:05.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.940+0000 7f5470d9d700 1 --2- 172.21.15.8:0/3794672941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f546c05fdf0 0x7f546c0f8ed0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.940+0000 7f5470d9d700 1 -- 172.21.15.8:0/3794672941 >> 172.21.15.8:0/3794672941 conn(0x7f546c0f0930 msgr2=0x7f546c0f2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:05.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.941+0000 7f5470d9d700 1 -- 172.21.15.8:0/3794672941 shutdown_connections 2023-10-18T20:56:05.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.941+0000 7f5470d9d700 1 -- 172.21.15.8:0/3794672941 wait complete. 2023-10-18T20:56:05.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.941+0000 7f5470d9d700 1 Processor -- start 2023-10-18T20:56:05.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.941+0000 7f5470d9d700 1 -- start start 2023-10-18T20:56:05.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f5470d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c05fdf0 0x7f546c0f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:05.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f5470d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f546c0f9450 0x7f546c0f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:05.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f5470d9d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0f52c0 con 0x7f546c0f9450 2023-10-18T20:56:05.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f5470d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0f5400 con 0x7f546c05fdf0 2023-10-18T20:56:05.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f546affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f546c0f9450 0x7f546c0f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:05.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f546affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f546c0f9450 0x7f546c0f4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38234/0 (socket says 172.21.15.8:38234) 2023-10-18T20:56:05.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f546affd700 1 -- 172.21.15.8:0/1498661553 learned_addr learned my addr 172.21.15.8:0/1498661553 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:05.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f546b7fe700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c05fdf0 0x7f546c0f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:05.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f546affd700 1 -- 172.21.15.8:0/1498661553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c05fdf0 msgr2=0x7f546c0f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:05.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f546affd700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c05fdf0 0x7f546c0f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:05.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.942+0000 7f546affd700 1 -- 172.21.15.8:0/1498661553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c005040 con 0x7f546c0f9450 2023-10-18T20:56:05.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.943+0000 7f546affd700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f546c0f9450 0x7f546c0f4dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f54600093f0 tx=0x7f5460006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.943+0000 7f5453fff700 1 -- 172.21.15.8:0/1498661553 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5460009ea0 con 0x7f546c0f9450 2023-10-18T20:56:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.943+0000 7f5453fff700 1 -- 172.21.15.8:0/1498661553 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5460013af0 con 0x7f546c0f9450 2023-10-18T20:56:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.943+0000 7f5470d9d700 1 -- 172.21.15.8:0/1498661553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c0f56e0 con 0x7f546c0f9450 2023-10-18T20:56:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.943+0000 7f5453fff700 1 -- 172.21.15.8:0/1498661553 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f546000dad0 con 0x7f546c0f9450 2023-10-18T20:56:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.943+0000 7f5470d9d700 1 -- 172.21.15.8:0/1498661553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c10eba0 con 0x7f546c0f9450 2023-10-18T20:56:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.944+0000 7f5470d9d700 1 -- 172.21.15.8:0/1498661553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546c046330 con 0x7f546c0f9450 2023-10-18T20:56:05.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.945+0000 7f5453fff700 1 -- 172.21.15.8:0/1498661553 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f546001a060 con 0x7f546c0f9450 2023-10-18T20:56:05.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.946+0000 7f5453fff700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f545405c2a0 0x7f545405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:05.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.946+0000 7f5453fff700 1 -- 172.21.15.8:0/1498661553 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f5460075e60 con 0x7f546c0f9450 2023-10-18T20:56:05.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.946+0000 7f546b7fe700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f545405c2a0 0x7f545405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:05.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.946+0000 7f546b7fe700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f545405c2a0 0x7f545405e760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f545c004e30 tx=0x7f545c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:05.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:05.949+0000 7f5453fff700 1 -- 172.21.15.8:0/1498661553 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5460048b40 con 0x7f546c0f9450 2023-10-18T20:56:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.116+0000 7f5470d9d700 1 -- 172.21.15.8:0/1498661553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f546c0feca0 con 0x7f546c0f9450 2023-10-18T20:56:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.116+0000 7f5453fff700 1 -- 172.21.15.8:0/1498661553 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v41) v1 ==== 107+0+11 (secure 0 0 0) 0x7f546004c160 con 0x7f546c0f9450 2023-10-18T20:56:06.119 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-18T20:56:06.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.118+0000 7f5470d9d700 1 -- 172.21.15.8:0/1498661553 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f545405c2a0 msgr2=0x7f545405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:06.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.118+0000 7f5470d9d700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f545405c2a0 0x7f545405e760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f545c004e30 tx=0x7f545c009b30).stop 2023-10-18T20:56:06.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.118+0000 7f5470d9d700 1 -- 172.21.15.8:0/1498661553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f546c0f9450 msgr2=0x7f546c0f4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:06.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.118+0000 7f5470d9d700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f546c0f9450 0x7f546c0f4dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f54600093f0 tx=0x7f5460006ec0).stop 2023-10-18T20:56:06.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.118+0000 7f5470d9d700 1 -- 172.21.15.8:0/1498661553 shutdown_connections 2023-10-18T20:56:06.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.118+0000 7f5470d9d700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f545405c2a0 0x7f545405e760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.118+0000 7f5470d9d700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c05fdf0 0x7f546c0f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.118+0000 7f5470d9d700 1 --2- 172.21.15.8:0/1498661553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f546c0f9450 0x7f546c0f4dd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.118+0000 7f5470d9d700 1 -- 172.21.15.8:0/1498661553 >> 172.21.15.8:0/1498661553 conn(0x7f546c0f0930 msgr2=0x7f546c0f2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.119+0000 7f5470d9d700 1 -- 172.21.15.8:0/1498661553 shutdown_connections 2023-10-18T20:56:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.119+0000 7f5470d9d700 1 -- 172.21.15.8:0/1498661553 wait complete. 2023-10-18T20:56:06.136 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:04.766289+0000 mon.smithi008 (mon.0) 534 : cluster [DBG] mds.? [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] up:standby-replay 2023-10-18T20:56:06.136 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:04.766362+0000 mon.smithi008 (mon.0) 535 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:56:06.136 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:05.290659+0000 mon.smithi008 (mon.0) 536 : audit [DBG] from='client.? 172.21.15.8:0/1269938494' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T20:56:06.136 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:05.677492+0000 mon.smithi008 (mon.0) 537 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:06.137 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:05.681154+0000 mon.smithi008 (mon.0) 538 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:06.137 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:05.718709+0000 mon.smithi008 (mon.0) 539 : audit [DBG] from='client.? 172.21.15.8:0/1721728613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-10-18T20:56:06.138 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-10-18T20:56:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:04.766289+0000 mon.smithi008 (mon.0) 534 : cluster [DBG] mds.? [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] up:standby-replay 2023-10-18T20:56:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:04.766362+0000 mon.smithi008 (mon.0) 535 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:56:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:05.290659+0000 mon.smithi008 (mon.0) 536 : audit [DBG] from='client.? 172.21.15.8:0/1269938494' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T20:56:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:05.677492+0000 mon.smithi008 (mon.0) 537 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:05.681154+0000 mon.smithi008 (mon.0) 538 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:05.718709+0000 mon.smithi008 (mon.0) 539 : audit [DBG] from='client.? 172.21.15.8:0/1721728613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-10-18T20:56:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.336+0000 7f052b7ff700 1 -- 172.21.15.8:0/1384959661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f052406a3b0 msgr2=0x7f052406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.336+0000 7f052b7ff700 1 --2- 172.21.15.8:0/1384959661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f052406a3b0 0x7f052406a830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f0514004660 tx=0x7f0514009b30).stop 2023-10-18T20:56:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.336+0000 7f052b7ff700 1 -- 172.21.15.8:0/1384959661 shutdown_connections 2023-10-18T20:56:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.336+0000 7f052b7ff700 1 --2- 172.21.15.8:0/1384959661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f052406a3b0 0x7f052406a830 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.336+0000 7f052b7ff700 1 --2- 172.21.15.8:0/1384959661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f052406b9c0 0x7f0524069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.336+0000 7f052b7ff700 1 -- 172.21.15.8:0/1384959661 >> 172.21.15.8:0/1384959661 conn(0x7f05240f1bd0 msgr2=0x7f05240f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.336+0000 7f052b7ff700 1 -- 172.21.15.8:0/1384959661 shutdown_connections 2023-10-18T20:56:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.336+0000 7f052b7ff700 1 -- 172.21.15.8:0/1384959661 wait complete. 2023-10-18T20:56:06.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.337+0000 7f052b7ff700 1 Processor -- start 2023-10-18T20:56:06.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.337+0000 7f052b7ff700 1 -- start start 2023-10-18T20:56:06.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.338+0000 7f052b7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f052406a3b0 0x7f0524108e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:06.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.338+0000 7f052b7ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f052406b9c0 0x7f0524109350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:06.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.338+0000 7f052b7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0524109900 con 0x7f052406a3b0 2023-10-18T20:56:06.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.338+0000 7f052b7ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0524109a40 con 0x7f052406b9c0 2023-10-18T20:56:06.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.338+0000 7f052959b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f052406a3b0 0x7f0524108e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:06.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.338+0000 7f052959b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f052406a3b0 0x7f0524108e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38240/0 (socket says 172.21.15.8:38240) 2023-10-18T20:56:06.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.338+0000 7f052959b700 1 -- 172.21.15.8:0/2884923231 learned_addr learned my addr 172.21.15.8:0/2884923231 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.338+0000 7f0528d9a700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f052406b9c0 0x7f0524109350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.338+0000 7f052959b700 1 -- 172.21.15.8:0/2884923231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f052406b9c0 msgr2=0x7f0524109350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.338+0000 7f052959b700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f052406b9c0 0x7f0524109350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.339+0000 7f052959b700 1 -- 172.21.15.8:0/2884923231 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514005040 con 0x7f052406a3b0 2023-10-18T20:56:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.339+0000 7f052959b700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f052406a3b0 0x7f0524108e60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f05200026d0 tx=0x7f0520009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.339+0000 7f0519ffb700 1 -- 172.21.15.8:0/2884923231 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05200079c0 con 0x7f052406a3b0 2023-10-18T20:56:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.339+0000 7f0519ffb700 1 -- 172.21.15.8:0/2884923231 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f052000f040 con 0x7f052406a3b0 2023-10-18T20:56:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.339+0000 7f052b7ff700 1 -- 172.21.15.8:0/2884923231 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052410e4e0 con 0x7f052406a3b0 2023-10-18T20:56:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.339+0000 7f0519ffb700 1 -- 172.21.15.8:0/2884923231 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05200148b0 con 0x7f052406a3b0 2023-10-18T20:56:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.339+0000 7f052b7ff700 1 -- 172.21.15.8:0/2884923231 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052410eaa0 con 0x7f052406a3b0 2023-10-18T20:56:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.340+0000 7f052b7ff700 1 -- 172.21.15.8:0/2884923231 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0524027a00 con 0x7f052406a3b0 2023-10-18T20:56:06.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.341+0000 7f0519ffb700 1 -- 172.21.15.8:0/2884923231 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0520007b20 con 0x7f052406a3b0 2023-10-18T20:56:06.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.342+0000 7f0519ffb700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f051005c2a0 0x7f051005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:06.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.342+0000 7f0519ffb700 1 -- 172.21.15.8:0/2884923231 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0520075de0 con 0x7f052406a3b0 2023-10-18T20:56:06.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.342+0000 7f0528d9a700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f051005c2a0 0x7f051005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:06.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.342+0000 7f0528d9a700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f051005c2a0 0x7f051005e760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f0514005010 tx=0x7f0514009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:06.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.345+0000 7f0519ffb700 1 -- 172.21.15.8:0/2884923231 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0520048b20 con 0x7f052406a3b0 2023-10-18T20:56:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.511+0000 7f052b7ff700 1 -- 172.21.15.8:0/2884923231 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f0524100e30 con 0x7f052406a3b0 2023-10-18T20:56:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.512+0000 7f0519ffb700 1 -- 172.21.15.8:0/2884923231 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v41) v1 ==== 107+0+11 (secure 0 0 0) 0x7f052004c140 con 0x7f052406a3b0 2023-10-18T20:56:06.514 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-18T20:56:06.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.513+0000 7f052b7ff700 1 -- 172.21.15.8:0/2884923231 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f051005c2a0 msgr2=0x7f051005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:06.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.514+0000 7f052b7ff700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f051005c2a0 0x7f051005e760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f0514005010 tx=0x7f0514009b30).stop 2023-10-18T20:56:06.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.514+0000 7f052b7ff700 1 -- 172.21.15.8:0/2884923231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f052406a3b0 msgr2=0x7f0524108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:06.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.514+0000 7f052b7ff700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f052406a3b0 0x7f0524108e60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f05200026d0 tx=0x7f0520009de0).stop 2023-10-18T20:56:06.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.514+0000 7f052b7ff700 1 -- 172.21.15.8:0/2884923231 shutdown_connections 2023-10-18T20:56:06.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.514+0000 7f052b7ff700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f052406a3b0 0x7f0524108e60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.514+0000 7f052b7ff700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f051005c2a0 0x7f051005e760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.514+0000 7f052b7ff700 1 --2- 172.21.15.8:0/2884923231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f052406b9c0 0x7f0524109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.514+0000 7f052b7ff700 1 -- 172.21.15.8:0/2884923231 >> 172.21.15.8:0/2884923231 conn(0x7f05240f1bd0 msgr2=0x7f05240fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:06.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.514+0000 7f052b7ff700 1 -- 172.21.15.8:0/2884923231 shutdown_connections 2023-10-18T20:56:06.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.514+0000 7f052b7ff700 1 -- 172.21.15.8:0/2884923231 wait complete. 2023-10-18T20:56:06.534 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T20:56:06.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.728+0000 7f7fefbff700 1 -- 172.21.15.8:0/321913360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fe80f64d0 msgr2=0x7f7fe80f68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:06.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.728+0000 7f7fefbff700 1 --2- 172.21.15.8:0/321913360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fe80f64d0 0x7f7fe80f68f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f7fe4004660 tx=0x7f7fe4009b30).stop 2023-10-18T20:56:06.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.728+0000 7f7fefbff700 1 -- 172.21.15.8:0/321913360 shutdown_connections 2023-10-18T20:56:06.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.728+0000 7f7fefbff700 1 --2- 172.21.15.8:0/321913360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fe80f7770 0x7f7fe80f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.728+0000 7f7fefbff700 1 --2- 172.21.15.8:0/321913360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fe80f64d0 0x7f7fe80f68f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.728+0000 7f7fefbff700 1 -- 172.21.15.8:0/321913360 >> 172.21.15.8:0/321913360 conn(0x7f7fe80f1c30 msgr2=0x7f7fe80f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:06.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.728+0000 7f7fefbff700 1 -- 172.21.15.8:0/321913360 shutdown_connections 2023-10-18T20:56:06.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.728+0000 7f7fefbff700 1 -- 172.21.15.8:0/321913360 wait complete. 2023-10-18T20:56:06.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.729+0000 7f7fefbff700 1 Processor -- start 2023-10-18T20:56:06.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.729+0000 7f7fefbff700 1 -- start start 2023-10-18T20:56:06.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fefbff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fe80f64d0 0x7f7fe8108d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:06.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fefbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fe80f7770 0x7f7fe8109270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:06.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fefbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8109870 con 0x7f7fe80f7770 2023-10-18T20:56:06.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fefbff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe81099b0 con 0x7f7fe80f64d0 2023-10-18T20:56:06.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fed19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fe80f7770 0x7f7fe8109270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:06.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fed19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fe80f7770 0x7f7fe8109270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38256/0 (socket says 172.21.15.8:38256) 2023-10-18T20:56:06.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fed19a700 1 -- 172.21.15.8:0/743202004 learned_addr learned my addr 172.21.15.8:0/743202004 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:06.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fed99b700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fe80f64d0 0x7f7fe8108d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:06.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fed19a700 1 -- 172.21.15.8:0/743202004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fe80f64d0 msgr2=0x7f7fe8108d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:06.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fed19a700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fe80f64d0 0x7f7fe8108d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fed19a700 1 -- 172.21.15.8:0/743202004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4005040 con 0x7f7fe80f7770 2023-10-18T20:56:06.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.730+0000 7f7fed19a700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fe80f7770 0x7f7fe8109270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f7fd8002700 tx=0x7f7fd8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:06.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.731+0000 7f7fde7fc700 1 -- 172.21.15.8:0/743202004 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd8009320 con 0x7f7fe80f7770 2023-10-18T20:56:06.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.731+0000 7f7fde7fc700 1 -- 172.21.15.8:0/743202004 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fd800f040 con 0x7f7fe80f7770 2023-10-18T20:56:06.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.731+0000 7f7fefbff700 1 -- 172.21.15.8:0/743202004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe810e3c0 con 0x7f7fe80f7770 2023-10-18T20:56:06.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.731+0000 7f7fde7fc700 1 -- 172.21.15.8:0/743202004 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd8014870 con 0x7f7fe80f7770 2023-10-18T20:56:06.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.731+0000 7f7fefbff700 1 -- 172.21.15.8:0/743202004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe810e980 con 0x7f7fe80f7770 2023-10-18T20:56:06.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.732+0000 7f7fefbff700 1 -- 172.21.15.8:0/743202004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe8027a00 con 0x7f7fe80f7770 2023-10-18T20:56:06.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.733+0000 7f7fde7fc700 1 -- 172.21.15.8:0/743202004 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7fd8009480 con 0x7f7fe80f7770 2023-10-18T20:56:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.733+0000 7f7fde7fc700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7fd405c360 0x7f7fd405e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.734+0000 7f7fde7fc700 1 -- 172.21.15.8:0/743202004 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7fd80760a0 con 0x7f7fe80f7770 2023-10-18T20:56:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.734+0000 7f7fed99b700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7fd405c360 0x7f7fd405e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.734+0000 7f7fed99b700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7fd405c360 0x7f7fd405e820 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7fe4005010 tx=0x7f7fe4009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.737+0000 7f7fde7fc700 1 -- 172.21.15.8:0/743202004 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7fd8048de0 con 0x7f7fe80f7770 2023-10-18T20:56:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:06.117045+0000 mon.smithi008 (mon.0) 540 : audit [DBG] from='client.? 172.21.15.8:0/1498661553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-10-18T20:56:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:06.124629+0000 mgr.smithi008.flmjzp (mgr.14164) 212 : cluster [DBG] pgmap v172: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2023-10-18T20:56:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:06.512321+0000 mon.smithi008 (mon.0) 541 : audit [DBG] from='client.? 172.21.15.8:0/2884923231' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-10-18T20:56:06.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.954+0000 7f7fefbff700 1 -- 172.21.15.8:0/743202004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fe80fec60 con 0x7f7fe80f7770 2023-10-18T20:56:06.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.954+0000 7f7fde7fc700 1 -- 172.21.15.8:0/743202004 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2950 (secure 0 0 0) 0x7f7fd804c400 con 0x7f7fe80f7770 2023-10-18T20:56:06.956 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:56:06.956 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T20:55:46.761687+0000","modified":"2023-10-18T20:56:04.757749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14456,"mds_1":24321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi008.lehgco","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.8:6827/3639001015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3639001015},{"type":"v1","addr":"172.21.15.8:6827","nonce":3639001015}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_14472":{"gid":14472,"name":"cephfs.smithi008.mpstiw","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.8:6829/2541768531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2541768531},{"type":"v1","addr":"172.21.15.8:6829","nonce":2541768531}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_24321":{"gid":24321,"name":"cephfs.smithi060.grdzlm","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6825/636466145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":636466145},{"type":"v1","addr":"172.21.15.60:6825","nonce":636466145}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_24333":{"gid":24333,"name":"cephfs.smithi060.rvrncq","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.60:6827/1177007799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1177007799},{"type":"v1","addr":"172.21.15.60:6827","nonce":1177007799}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-18T20:56:06.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.956+0000 7f7fefbff700 1 -- 172.21.15.8:0/743202004 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7fd405c360 msgr2=0x7f7fd405e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:06.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.956+0000 7f7fefbff700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7fd405c360 0x7f7fd405e820 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7fe4005010 tx=0x7f7fe4009b30).stop 2023-10-18T20:56:06.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.956+0000 7f7fefbff700 1 -- 172.21.15.8:0/743202004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fe80f7770 msgr2=0x7f7fe8109270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:06.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.956+0000 7f7fefbff700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fe80f7770 0x7f7fe8109270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f7fd8002700 tx=0x7f7fd8009e00).stop 2023-10-18T20:56:06.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.956+0000 7f7fefbff700 1 -- 172.21.15.8:0/743202004 shutdown_connections 2023-10-18T20:56:06.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.956+0000 7f7fefbff700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7fd405c360 0x7f7fd405e820 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.956+0000 7f7fefbff700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fe80f64d0 0x7f7fe8108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.956+0000 7f7fefbff700 1 --2- 172.21.15.8:0/743202004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fe80f7770 0x7f7fe8109270 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:06.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.956+0000 7f7fefbff700 1 -- 172.21.15.8:0/743202004 >> 172.21.15.8:0/743202004 conn(0x7f7fe80f1c30 msgr2=0x7f7fe806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:06.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.957+0000 7f7fefbff700 1 -- 172.21.15.8:0/743202004 shutdown_connections 2023-10-18T20:56:06.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:06.957+0000 7f7fefbff700 1 -- 172.21.15.8:0/743202004 wait complete. 2023-10-18T20:56:06.961 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2023-10-18T20:56:06.976 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 50} 2023-10-18T20:56:06.976 INFO:teuthology.run_tasks:Running task kclient... 2023-10-18T20:56:07.018 INFO:tasks.kclient:Mounting kernel clients... 2023-10-18T20:56:07.018 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-10-18T20:56:07.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:07.019 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-18T20:56:07.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:07.068 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-18T20:56:07.144 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2023-10-18T20:56:07.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T20:56:07.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:07.148 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-18T20:56:07.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:07.204 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-18T20:56:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:06.117045+0000 mon.smithi008 (mon.0) 540 : audit [DBG] from='client.? 172.21.15.8:0/1498661553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-10-18T20:56:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:06.124629+0000 mgr.smithi008.flmjzp (mgr.14164) 212 : cluster [DBG] pgmap v172: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2023-10-18T20:56:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:06.512321+0000 mon.smithi008 (mon.0) 541 : audit [DBG] from='client.? 172.21.15.8:0/2884923231' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-10-18T20:56:07.286 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2023-10-18T20:56:07.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T20:56:07.289 INFO:tasks.kclient:client.0 config is {} 2023-10-18T20:56:07.289 DEBUG:teuthology.orchestra.run.smithi008:> ceph fs ls 2023-10-18T20:56:07.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.454+0000 7eff72bff700 1 -- 172.21.15.8:0/1813312568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff6c0f8fd0 msgr2=0x7eff6c0f9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:07.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.454+0000 7eff72bff700 1 --2- 172.21.15.8:0/1813312568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff6c0f8fd0 0x7eff6c0f9a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7eff58004660 tx=0x7eff58009b30).stop 2023-10-18T20:56:07.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.454+0000 7eff72bff700 1 -- 172.21.15.8:0/1813312568 shutdown_connections 2023-10-18T20:56:07.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.454+0000 7eff72bff700 1 --2- 172.21.15.8:0/1813312568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff6c0f8fd0 0x7eff6c0f9a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:07.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.454+0000 7eff72bff700 1 --2- 172.21.15.8:0/1813312568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c0f86c0 0x7eff6c0f8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:07.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.454+0000 7eff72bff700 1 -- 172.21.15.8:0/1813312568 >> 172.21.15.8:0/1813312568 conn(0x7eff6c0f40e0 msgr2=0x7eff6c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:07.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.454+0000 7eff72bff700 1 -- 172.21.15.8:0/1813312568 shutdown_connections 2023-10-18T20:56:07.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.455+0000 7eff72bff700 1 -- 172.21.15.8:0/1813312568 wait complete. 2023-10-18T20:56:07.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.455+0000 7eff72bff700 1 Processor -- start 2023-10-18T20:56:07.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.455+0000 7eff72bff700 1 -- start start 2023-10-18T20:56:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff72bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff6c0f86c0 0x7eff6c108e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff72bff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c0f8fd0 0x7eff6c109330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff72bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c1098e0 con 0x7eff6c0f86c0 2023-10-18T20:56:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff72bff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c109a20 con 0x7eff6c0f8fd0 2023-10-18T20:56:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff7099b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff6c0f86c0 0x7eff6c108e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:07.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff7099b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff6c0f86c0 0x7eff6c108e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59770/0 (socket says 172.21.15.8:59770) 2023-10-18T20:56:07.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff7099b700 1 -- 172.21.15.8:0/757185061 learned_addr learned my addr 172.21.15.8:0/757185061 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:07.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff6bfff700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c0f8fd0 0x7eff6c109330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:07.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff7099b700 1 -- 172.21.15.8:0/757185061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c0f8fd0 msgr2=0x7eff6c109330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:07.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff7099b700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c0f8fd0 0x7eff6c109330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:07.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff7099b700 1 -- 172.21.15.8:0/757185061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff58005040 con 0x7eff6c0f86c0 2023-10-18T20:56:07.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.456+0000 7eff6bfff700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c0f8fd0 0x7eff6c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T20:56:07.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.457+0000 7eff7099b700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff6c0f86c0 0x7eff6c108e40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7eff600026d0 tx=0x7eff60009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:07.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.457+0000 7eff697fa700 1 -- 172.21.15.8:0/757185061 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff60009320 con 0x7eff6c0f86c0 2023-10-18T20:56:07.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.457+0000 7eff697fa700 1 -- 172.21.15.8:0/757185061 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff6000f040 con 0x7eff6c0f86c0 2023-10-18T20:56:07.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.457+0000 7eff72bff700 1 -- 172.21.15.8:0/757185061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c10e4c0 con 0x7eff6c0f86c0 2023-10-18T20:56:07.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.457+0000 7eff697fa700 1 -- 172.21.15.8:0/757185061 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff600147e0 con 0x7eff6c0f86c0 2023-10-18T20:56:07.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.457+0000 7eff72bff700 1 -- 172.21.15.8:0/757185061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c10ea80 con 0x7eff6c0f86c0 2023-10-18T20:56:07.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.458+0000 7eff72bff700 1 -- 172.21.15.8:0/757185061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c027a00 con 0x7eff6c0f86c0 2023-10-18T20:56:07.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.459+0000 7eff697fa700 1 -- 172.21.15.8:0/757185061 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7eff60009480 con 0x7eff6c0f86c0 2023-10-18T20:56:07.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.460+0000 7eff697fa700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7eff5c05c2b0 0x7eff5c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:07.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.460+0000 7eff697fa700 1 -- 172.21.15.8:0/757185061 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7eff60076600 con 0x7eff6c0f86c0 2023-10-18T20:56:07.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.460+0000 7eff6bfff700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7eff5c05c2b0 0x7eff5c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:07.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.460+0000 7eff6bfff700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7eff5c05c2b0 0x7eff5c05e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7eff58009d60 tx=0x7eff58009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:07.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.463+0000 7eff697fa700 1 -- 172.21.15.8:0/757185061 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7eff600492c0 con 0x7eff6c0f86c0 2023-10-18T20:56:07.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.668+0000 7eff72bff700 1 -- 172.21.15.8:0/757185061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff6c0586e0 con 0x7eff6c0f86c0 2023-10-18T20:56:07.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.668+0000 7eff697fa700 1 -- 172.21.15.8:0/757185061 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7eff6004c8e0 con 0x7eff6c0f86c0 2023-10-18T20:56:07.670 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-10-18T20:56:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 -- 172.21.15.8:0/757185061 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7eff5c05c2b0 msgr2=0x7eff5c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7eff5c05c2b0 0x7eff5c05e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7eff58009d60 tx=0x7eff58009b30).stop 2023-10-18T20:56:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 -- 172.21.15.8:0/757185061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff6c0f86c0 msgr2=0x7eff6c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff6c0f86c0 0x7eff6c108e40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7eff600026d0 tx=0x7eff60009de0).stop 2023-10-18T20:56:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 -- 172.21.15.8:0/757185061 shutdown_connections 2023-10-18T20:56:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff6c0f86c0 0x7eff6c108e40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7eff5c05c2b0 0x7eff5c05e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 --2- 172.21.15.8:0/757185061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c0f8fd0 0x7eff6c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 -- 172.21.15.8:0/757185061 >> 172.21.15.8:0/757185061 conn(0x7eff6c0f40e0 msgr2=0x7eff6c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 -- 172.21.15.8:0/757185061 shutdown_connections 2023-10-18T20:56:07.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:07.670+0000 7eff72bff700 1 -- 172.21.15.8:0/757185061 wait complete. 2023-10-18T20:56:07.687 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-18T20:56:07.687 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T20:56:07.687 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-10-18T20:56:07.687 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-18T20:56:07.688 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-18T20:56:07.688 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-18T20:56:07.688 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T20:56:07.688 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T20:56:07.689 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-18T20:56:07.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:07.689 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-10-18T20:56:07.737 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T20:56:07.737 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T20:56:07.737 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T20:56:07.738 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-18T20:56:07.738 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-18T20:56:07.738 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-18T20:56:07.738 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T20:56:07.738 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-10-18T20:56:07.739 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-10-18T20:56:07.739 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T20:56:07.739 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-10-18T20:56:07.739 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-10-18T20:56:07.739 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T20:56:07.740 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-10-18T20:56:07.740 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-10-18T20:56:07.740 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-18T20:56:07.740 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 40777sec preferred_lft 40777sec 2023-10-18T20:56:07.740 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-18T20:56:07.740 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-18T20:56:07.741 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T20:56:07.741 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-10-18T20:56:07.741 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-10-18T20:56:07.742 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-18T20:56:07.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:07.743 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-18T20:56:07.743 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-18T20:56:07.743 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2023-10-18T20:56:07.744 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2023-10-18T20:56:07.744 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2023-10-18T20:56:07.744 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-18T20:56:07.745 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-18T20:56:08.092 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:06.954895+0000 mon.smithi008 (mon.0) 542 : audit [DBG] from='client.? 172.21.15.8:0/743202004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T20:56:08.093 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:07.668924+0000 mon.smithi008 (mon.0) 543 : audit [DBG] from='client.? 172.21.15.8:0/757185061' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-18T20:56:08.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:08.190 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T20:56:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:06.954895+0000 mon.smithi008 (mon.0) 542 : audit [DBG] from='client.? 172.21.15.8:0/743202004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T20:56:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:07.668924+0000 mon.smithi008 (mon.0) 543 : audit [DBG] from='client.? 172.21.15.8:0/757185061' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-18T20:56:08.263 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-10-18T20:56:08.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:08.267 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-10-18T20:56:08.334 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-10-18T20:56:08.334 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T20:56:08.334 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-18T20:56:08.334 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-18T20:56:08.334 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T20:56:08.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:08.336 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-18T20:56:08.336 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-18T20:56:08.336 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-18T20:56:08.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-18T20:56:08.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-18T20:56:08.337 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-18T20:56:09.050 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:08.124997+0000 mgr.smithi008.flmjzp (mgr.14164) 213 : cluster [DBG] pgmap v173: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2023-10-18T20:56:09.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:09.054 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-18T20:56:09.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:09.103 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-10-18T20:56:09.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:09.151 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-18T20:56:09.151 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-18T20:56:09.152 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T20:56:09.152 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-18T20:56:09.152 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-18T20:56:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:08.124997+0000 mgr.smithi008.flmjzp (mgr.14164) 213 : cluster [DBG] pgmap v173: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2023-10-18T20:56:09.299 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-18T20:56:09.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:09.300 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-18T20:56:09.300 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-18T20:56:09.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-18T20:56:09.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-18T20:56:09.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-18T20:56:09.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-18T20:56:09.302 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-18T20:56:09.302 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-18T20:56:09.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:09.598 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-18T20:56:09.598 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-18T20:56:09.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-10-18T20:56:09.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2023-10-18T20:56:09.599 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-18T20:56:09.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:09.777 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-18T20:56:09.824 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-18T20:56:09.824 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-18T20:56:09.936 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-18T20:56:09.937 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-18T20:56:09.972 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-18T20:56:09.973 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-18T20:56:09.978 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T20:56:09.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:09.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-18T20:56:10.057 INFO:tasks.kclient:client.1 config is {} 2023-10-18T20:56:10.057 DEBUG:teuthology.orchestra.run.smithi060:> ceph fs ls 2023-10-18T20:56:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.300+0000 7fb56fbff700 1 -- 172.21.15.60:0/1407188218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb56806b9c0 msgr2=0x7fb568069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:10.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.300+0000 7fb56fbff700 1 --2- 172.21.15.60:0/1407188218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb56806b9c0 0x7fb568069ec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb564004660 tx=0x7fb564009b30).stop 2023-10-18T20:56:10.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.300+0000 7fb56fbff700 1 -- 172.21.15.60:0/1407188218 shutdown_connections 2023-10-18T20:56:10.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.300+0000 7fb56fbff700 1 --2- 172.21.15.60:0/1407188218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56806a3b0 0x7fb56806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:10.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.300+0000 7fb56fbff700 1 --2- 172.21.15.60:0/1407188218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb56806b9c0 0x7fb568069ec0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:10.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.300+0000 7fb56fbff700 1 -- 172.21.15.60:0/1407188218 >> 172.21.15.60:0/1407188218 conn(0x7fb5680f1c40 msgr2=0x7fb5680f4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:10.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.300+0000 7fb56fbff700 1 -- 172.21.15.60:0/1407188218 shutdown_connections 2023-10-18T20:56:10.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.300+0000 7fb56fbff700 1 -- 172.21.15.60:0/1407188218 wait complete. 2023-10-18T20:56:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.301+0000 7fb56fbff700 1 Processor -- start 2023-10-18T20:56:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.301+0000 7fb56fbff700 1 -- start start 2023-10-18T20:56:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56fbff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb56806a3b0 0x7fb568108e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56fbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56806b9c0 0x7fb568109320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56fbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5681098d0 con 0x7fb56806b9c0 2023-10-18T20:56:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56fbff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb568109a10 con 0x7fb56806a3b0 2023-10-18T20:56:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56d99b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb56806a3b0 0x7fb568108e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56d99b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb56806a3b0 0x7fb568108e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53534/0 (socket says 172.21.15.60:53534) 2023-10-18T20:56:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56d99b700 1 -- 172.21.15.60:0/2828907540 learned_addr learned my addr 172.21.15.60:0/2828907540 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-18T20:56:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56d99b700 1 -- 172.21.15.60:0/2828907540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56806b9c0 msgr2=0x7fb568109320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56d99b700 1 --2- 172.21.15.60:0/2828907540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56806b9c0 0x7fb568109320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:56:10.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56d99b700 1 -- 172.21.15.60:0/2828907540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564005040 con 0x7fb56806a3b0 2023-10-18T20:56:10.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.302+0000 7fb56d99b700 1 --2- 172.21.15.60:0/2828907540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb56806a3b0 0x7fb568108e30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb564013530 tx=0x7fb56400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:10.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.303+0000 7fb55e7fc700 1 -- 172.21.15.60:0/2828907540 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb564019070 con 0x7fb56806a3b0 2023-10-18T20:56:10.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.303+0000 7fb55e7fc700 1 -- 172.21.15.60:0/2828907540 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb564007e70 con 0x7fb56806a3b0 2023-10-18T20:56:10.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.303+0000 7fb56fbff700 1 -- 172.21.15.60:0/2828907540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56810e450 con 0x7fb56806a3b0 2023-10-18T20:56:10.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.303+0000 7fb55e7fc700 1 -- 172.21.15.60:0/2828907540 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb564014c90 con 0x7fb56806a3b0 2023-10-18T20:56:10.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.303+0000 7fb56fbff700 1 -- 172.21.15.60:0/2828907540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56810ea10 con 0x7fb56806a3b0 2023-10-18T20:56:10.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.304+0000 7fb56fbff700 1 -- 172.21.15.60:0/2828907540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb568027a00 con 0x7fb56806a3b0 2023-10-18T20:56:10.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.304+0000 7fb55e7fc700 1 -- 172.21.15.60:0/2828907540 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb564025070 con 0x7fb56806a3b0 2023-10-18T20:56:10.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.305+0000 7fb55e7fc700 1 --2- 172.21.15.60:0/2828907540 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb55405c2b0 0x7fb55405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:10.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.305+0000 7fb55e7fc700 1 -- 172.21.15.60:0/2828907540 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb564076f40 con 0x7fb56806a3b0 2023-10-18T20:56:10.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.306+0000 7fb56d19a700 1 --2- 172.21.15.60:0/2828907540 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb55405c2b0 0x7fb55405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:10.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.306+0000 7fb56d19a700 1 --2- 172.21.15.60:0/2828907540 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb55405c2b0 0x7fb55405e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb558004b70 tx=0x7fb55800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:10.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.309+0000 7fb55e7fc700 1 -- 172.21.15.60:0/2828907540 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb564049bc0 con 0x7fb56806a3b0 2023-10-18T20:56:10.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.515+0000 7fb56fbff700 1 -- 172.21.15.60:0/2828907540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb5680586e0 con 0x7fb56806a3b0 2023-10-18T20:56:10.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.515+0000 7fb55e7fc700 1 -- 172.21.15.60:0/2828907540 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fb56404d1e0 con 0x7fb56806a3b0 2023-10-18T20:56:10.519 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-10-18T20:56:10.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 -- 172.21.15.60:0/2828907540 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb55405c2b0 msgr2=0x7fb55405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:10.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 --2- 172.21.15.60:0/2828907540 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb55405c2b0 0x7fb55405e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb558004b70 tx=0x7fb55800b040).stop 2023-10-18T20:56:10.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 -- 172.21.15.60:0/2828907540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb56806a3b0 msgr2=0x7fb568108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:10.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 --2- 172.21.15.60:0/2828907540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb56806a3b0 0x7fb568108e30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb564013530 tx=0x7fb56400b040).stop 2023-10-18T20:56:10.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 -- 172.21.15.60:0/2828907540 shutdown_connections 2023-10-18T20:56:10.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 --2- 172.21.15.60:0/2828907540 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fb55405c2b0 0x7fb55405e770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:10.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 --2- 172.21.15.60:0/2828907540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb56806a3b0 0x7fb568108e30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:10.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 --2- 172.21.15.60:0/2828907540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb56806b9c0 0x7fb568109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:56:10.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 -- 172.21.15.60:0/2828907540 >> 172.21.15.60:0/2828907540 conn(0x7fb5680f1c40 msgr2=0x7fb5680fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:10.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 -- 172.21.15.60:0/2828907540 shutdown_connections 2023-10-18T20:56:10.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-18T20:56:10.517+0000 7fb56fbff700 1 -- 172.21.15.60:0/2828907540 wait complete. 2023-10-18T20:56:10.535 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-18T20:56:10.535 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T20:56:10.535 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-18T20:56:10.536 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-18T20:56:10.536 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-18T20:56:10.536 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-18T20:56:10.536 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T20:56:10.537 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T20:56:10.537 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-18T20:56:10.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:10.537 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-18T20:56:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T20:56:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T20:56:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T20:56:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-18T20:56:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-18T20:56:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-18T20:56:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T20:56:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-18T20:56:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-18T20:56:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T20:56:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-18T20:56:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-18T20:56:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T20:56:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-18T20:56:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-18T20:56:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-18T20:56:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 40736sec preferred_lft 40736sec 2023-10-18T20:56:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-18T20:56:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-18T20:56:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T20:56:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-18T20:56:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-18T20:56:10.590 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-18T20:56:10.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:10.591 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-18T20:56:10.591 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-18T20:56:10.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2023-10-18T20:56:10.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2023-10-18T20:56:10.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2023-10-18T20:56:10.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-18T20:56:10.592 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-18T20:56:11.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:11.025 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T20:56:11.100 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-18T20:56:11.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:11.103 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-18T20:56:11.170 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-18T20:56:11.170 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T20:56:11.170 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-18T20:56:11.170 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-18T20:56:11.171 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T20:56:11.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:11.172 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-18T20:56:11.172 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-18T20:56:11.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-18T20:56:11.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-18T20:56:11.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-18T20:56:11.173 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-18T20:56:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:10.125657+0000 mgr.smithi008.flmjzp (mgr.14164) 214 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2023-10-18T20:56:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:10.517503+0000 mon.smithi060 (mon.1) 16 : audit [DBG] from='client.? 172.21.15.60:0/2828907540' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-18T20:56:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:10.125657+0000 mgr.smithi008.flmjzp (mgr.14164) 214 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2023-10-18T20:56:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:10.517503+0000 mon.smithi060 (mon.1) 16 : audit [DBG] from='client.? 172.21.15.60:0/2828907540' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-18T20:56:11.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:11.886 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-18T20:56:11.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:11.935 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2023-10-18T20:56:11.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:11.984 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-18T20:56:11.984 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-18T20:56:11.984 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-18T20:56:11.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-18T20:56:11.985 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-18T20:56:12.135 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-18T20:56:12.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:12.136 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-18T20:56:12.136 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-18T20:56:12.136 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-18T20:56:12.136 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-18T20:56:12.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-18T20:56:12.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-18T20:56:12.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-18T20:56:12.137 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-18T20:56:12.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:12.417 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-18T20:56:12.417 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-18T20:56:12.417 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-18T20:56:12.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2023-10-18T20:56:12.418 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-18T20:56:12.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:12.596 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-10-18T20:56:12.643 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-18T20:56:12.643 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-18T20:56:12.766 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-18T20:56:12.766 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-18T20:56:12.801 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-18T20:56:12.802 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-18T20:56:12.808 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T20:56:12.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T20:56:12.808 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-18T20:56:12.882 INFO:teuthology.run_tasks:Running task print... 2023-10-18T20:56:12.892 INFO:teuthology.task.print:**** done client 2023-10-18T20:56:12.893 INFO:teuthology.run_tasks:Running task parallel... 2023-10-18T20:56:12.923 INFO:teuthology.task.parallel:starting parallel... 2023-10-18T20:56:12.924 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-10-18T20:56:12.938 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-10-18T20:56:12.939 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:56:12.939 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -e sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-10-18T20:56:12.940 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-10-18T20:56:12.940 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-10-18T20:56:12.989 INFO:tasks.workunit:Pulling workunits from ref b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:56:12.989 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-18T20:56:12.990 INFO:tasks.workunit:timeout=3h 2023-10-18T20:56:12.990 INFO:tasks.workunit:cleanup=True 2023-10-18T20:56:12.990 DEBUG:teuthology.orchestra.run.smithi008:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-18T20:56:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-18T20:56:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-18T20:56:13.051 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 40h/64d Inode: 1 Links: 2 2023-10-18T20:56:13.051 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T20:56:13.051 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:cephfs_t:s0 2023-10-18T20:56:13.051 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-10-18T20:56:13.051 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-18 20:55:54.380168277 +0000 2023-10-18T20:56:13.052 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-18 20:56:10.047106237 +0000 2023-10-18T20:56:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-18 20:55:54.380168277 +0000 2023-10-18T20:56:13.052 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-18T20:56:13.052 DEBUG:teuthology.orchestra.run.smithi008:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-18T20:56:13.173 DEBUG:teuthology.orchestra.run.smithi060:> stat -- /home/ubuntu/cephtest/mnt.1 2023-10-18T20:56:13.223 INFO:teuthology.orchestra.run.smithi060.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-10-18T20:56:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-10-18T20:56:13.224 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 75h/117d Inode: 1 Links: 3 2023-10-18T20:56:13.224 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T20:56:13.224 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:cephfs_t:s0 2023-10-18T20:56:13.225 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-10-18T20:56:13.225 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-18 20:56:13.162072876 +0000 2023-10-18T20:56:13.225 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-18 20:56:13.162072876 +0000 2023-10-18T20:56:13.225 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2023-10-18 20:55:54.380168277 +0000 2023-10-18T20:56:13.225 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-10-18T20:56:13.226 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-10-18T20:56:13.305 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:56:13.306 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:56:13.356 INFO:tasks.workunit.client.1.smithi060.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-10-18T20:56:13.363 INFO:tasks.workunit.client.0.smithi008.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-18T20:56:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:12.126302+0000 mgr.smithi008.flmjzp (mgr.14164) 215 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-10-18T20:56:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:12.126302+0000 mgr.smithi008.flmjzp (mgr.14164) 215 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-10-18T20:56:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.385+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/1103416810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd00f99e0 msgr2=0x7f4dd00f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.385+0000 7f4dd4bb2700 1 --2- 172.21.15.8:0/1103416810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd00f99e0 0x7f4dd00f9e40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f4dc4004660 tx=0x7f4dc4009b30).stop 2023-10-18T20:56:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.385+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/1103416810 shutdown_connections 2023-10-18T20:56:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.385+0000 7f4dd4bb2700 1 --2- 172.21.15.8:0/1103416810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd00f99e0 0x7f4dd00f9e40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.385+0000 7f4dd4bb2700 1 --2- 172.21.15.8:0/1103416810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dd00f8740 0x7f4dd00f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:56:14.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.385+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/1103416810 >> 172.21.15.8:0/1103416810 conn(0x7f4dd00f40e0 msgr2=0x7f4dd00f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:14.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.385+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/1103416810 shutdown_connections 2023-10-18T20:56:14.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.385+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/1103416810 wait complete. 2023-10-18T20:56:14.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.386+0000 7f4dd4bb2700 1 Processor -- start 2023-10-18T20:56:14.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.386+0000 7f4dd4bb2700 1 -- start start 2023-10-18T20:56:14.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.386+0000 7f4dd4bb2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dd00f8740 0x7f4dd0108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:14.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.386+0000 7f4dd4bb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd00f99e0 0x7f4dd0109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:14.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.387+0000 7f4dd4bb2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd0109ac0 con 0x7f4dd00f99e0 2023-10-18T20:56:14.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.387+0000 7f4dd4bb2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd010a370 con 0x7f4dd00f8740 2023-10-18T20:56:14.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.387+0000 7f4dceffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd00f99e0 0x7f4dd0109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:14.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.387+0000 7f4dceffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd00f99e0 0x7f4dd0109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59792/0 (socket says 172.21.15.8:59792) 2023-10-18T20:56:14.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.387+0000 7f4dceffd700 1 -- 172.21.15.8:0/3606510981 learned_addr learned my addr 172.21.15.8:0/3606510981 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:14.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.387+0000 7f4dcf7fe700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dd00f8740 0x7f4dd0108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:14.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.387+0000 7f4dceffd700 1 -- 172.21.15.8:0/3606510981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dd00f8740 msgr2=0x7f4dd0108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:14.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.387+0000 7f4dceffd700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dd00f8740 0x7f4dd0108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:14.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.387+0000 7f4dceffd700 1 -- 172.21.15.8:0/3606510981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4005040 con 0x7f4dd00f99e0 2023-10-18T20:56:14.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.387+0000 7f4dceffd700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd00f99e0 0x7f4dd0109480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f4dc4009830 tx=0x7f4dc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:14.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.388+0000 7f4db7fff700 1 -- 172.21.15.8:0/3606510981 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc4018070 con 0x7f4dd00f99e0 2023-10-18T20:56:14.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.388+0000 7f4db7fff700 1 -- 172.21.15.8:0/3606510981 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4dc4013410 con 0x7f4dd00f99e0 2023-10-18T20:56:14.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.388+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/3606510981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd010a5f0 con 0x7f4dd00f99e0 2023-10-18T20:56:14.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.388+0000 7f4db7fff700 1 -- 172.21.15.8:0/3606510981 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc401c400 con 0x7f4dd00f99e0 2023-10-18T20:56:14.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.388+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/3606510981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd010ab50 con 0x7f4dd00f99e0 2023-10-18T20:56:14.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.389+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/3606510981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd0059100 con 0x7f4dd00f99e0 2023-10-18T20:56:14.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.390+0000 7f4db7fff700 1 -- 172.21.15.8:0/3606510981 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4dc401d420 con 0x7f4dd00f99e0 2023-10-18T20:56:14.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.390+0000 7f4db7fff700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4db805c300 0x7f4db805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:14.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.391+0000 7f4db7fff700 1 -- 172.21.15.8:0/3606510981 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4dc4077d60 con 0x7f4dd00f99e0 2023-10-18T20:56:14.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.391+0000 7f4dcf7fe700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4db805c300 0x7f4db805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:14.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.391+0000 7f4dcf7fe700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4db805c300 0x7f4db805e7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f4dc0006fd0 tx=0x7f4dc0008040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:14.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.395+0000 7f4db7fff700 1 -- 172.21.15.8:0/3606510981 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4dc407c070 con 0x7f4dd00f99e0 2023-10-18T20:56:14.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:14.126731+0000 mgr.smithi008.flmjzp (mgr.14164) 216 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 8.8 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 682 B/s wr, 5 op/s 2023-10-18T20:56:14.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.564+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/3606510981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f4dd0100f70 con 0x7f4dd00f99e0 2023-10-18T20:56:14.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.564+0000 7f4db7fff700 1 -- 172.21.15.8:0/3606510981 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v16)=0 v16) v1 ==== 155+0+0 (secure 0 0 0) 0x7f4dc404a9e0 con 0x7f4dd00f99e0 2023-10-18T20:56:14.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/3606510981 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4db805c300 msgr2=0x7f4db805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:14.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4db805c300 0x7f4db805e7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f4dc0006fd0 tx=0x7f4dc0008040).stop 2023-10-18T20:56:14.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/3606510981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd00f99e0 msgr2=0x7f4dd0109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:14.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd00f99e0 0x7f4dd0109480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f4dc4009830 tx=0x7f4dc4009b30).stop 2023-10-18T20:56:14.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/3606510981 shutdown_connections 2023-10-18T20:56:14.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4db805c300 0x7f4db805e7c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:14.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dd00f8740 0x7f4dd0108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:14.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 --2- 172.21.15.8:0/3606510981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd00f99e0 0x7f4dd0109480 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:14.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/3606510981 >> 172.21.15.8:0/3606510981 conn(0x7f4dd00f40e0 msgr2=0x7f4dd00fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:14.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/3606510981 shutdown_connections 2023-10-18T20:56:14.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:14.566+0000 7f4dd4bb2700 1 -- 172.21.15.8:0/3606510981 wait complete. 2023-10-18T20:56:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:14.126731+0000 mgr.smithi008.flmjzp (mgr.14164) 216 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 8.8 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 682 B/s wr, 5 op/s 2023-10-18T20:56:14.993 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -e sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-10-18T20:56:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.365+0000 7f4e9edca700 1 -- 172.21.15.8:0/3978332164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 msgr2=0x7f4e980f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.365+0000 7f4e9edca700 1 --2- 172.21.15.8:0/3978332164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e980f6950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f4e94004660 tx=0x7f4e94009b30).stop 2023-10-18T20:56:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.365+0000 7f4e9edca700 1 -- 172.21.15.8:0/3978332164 shutdown_connections 2023-10-18T20:56:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.365+0000 7f4e9edca700 1 --2- 172.21.15.8:0/3978332164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 0x7f4e980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.365+0000 7f4e9edca700 1 --2- 172.21.15.8:0/3978332164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e980f6950 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:16.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.365+0000 7f4e9edca700 1 -- 172.21.15.8:0/3978332164 >> 172.21.15.8:0/3978332164 conn(0x7f4e980f1c90 msgr2=0x7f4e980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:16.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.365+0000 7f4e9edca700 1 -- 172.21.15.8:0/3978332164 shutdown_connections 2023-10-18T20:56:16.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.365+0000 7f4e9edca700 1 -- 172.21.15.8:0/3978332164 wait complete. 2023-10-18T20:56:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.366+0000 7f4e9edca700 1 Processor -- start 2023-10-18T20:56:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.366+0000 7f4e9edca700 1 -- start start 2023-10-18T20:56:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9edca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9edca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 0x7f4e98069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9edca700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9806a380 con 0x7f4e980f6530 2023-10-18T20:56:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9edca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9806a4c0 con 0x7f4e980f77d0 2023-10-18T20:56:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9ddc8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9ddc8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59808/0 (socket says 172.21.15.8:59808) 2023-10-18T20:56:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9ddc8700 1 -- 172.21.15.8:0/2424616612 learned_addr learned my addr 172.21.15.8:0/2424616612 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9d5c7700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 0x7f4e98069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9ddc8700 1 -- 172.21.15.8:0/2424616612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 msgr2=0x7f4e98069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9ddc8700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 0x7f4e98069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.367+0000 7f4e9ddc8700 1 -- 172.21.15.8:0/2424616612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e94005040 con 0x7f4e980f6530 2023-10-18T20:56:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.368+0000 7f4e9ddc8700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f4e94000c00 tx=0x7f4e9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.368+0000 7f4e8e7fc700 1 -- 172.21.15.8:0/2424616612 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e94019070 con 0x7f4e980f6530 2023-10-18T20:56:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.368+0000 7f4e9edca700 1 -- 172.21.15.8:0/2424616612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9806a740 con 0x7f4e980f6530 2023-10-18T20:56:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.368+0000 7f4e8e7fc700 1 -- 172.21.15.8:0/2424616612 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e94007e70 con 0x7f4e980f6530 2023-10-18T20:56:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.368+0000 7f4e8e7fc700 1 -- 172.21.15.8:0/2424616612 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e94014d00 con 0x7f4e980f6530 2023-10-18T20:56:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.368+0000 7f4e9edca700 1 -- 172.21.15.8:0/2424616612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9806aca0 con 0x7f4e980f6530 2023-10-18T20:56:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.369+0000 7f4e9edca700 1 -- 172.21.15.8:0/2424616612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e98045ad0 con 0x7f4e980f6530 2023-10-18T20:56:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.370+0000 7f4e8e7fc700 1 -- 172.21.15.8:0/2424616612 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4e94025070 con 0x7f4e980f6530 2023-10-18T20:56:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.370+0000 7f4e8e7fc700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e8405c2f0 0x7f4e8405e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.371+0000 7f4e8e7fc700 1 -- 172.21.15.8:0/2424616612 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4e94076ee0 con 0x7f4e980f6530 2023-10-18T20:56:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.371+0000 7f4e9d5c7700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e8405c2f0 0x7f4e8405e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.371+0000 7f4e9d5c7700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e8405c2f0 0x7f4e8405e7b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f4e88007fd0 tx=0x7f4e8800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.374+0000 7f4e8e7fc700 1 -- 172.21.15.8:0/2424616612 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4e94049ae0 con 0x7f4e980f6530 2023-10-18T20:56:16.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.542+0000 7f4e9edca700 1 -- 172.21.15.8:0/2424616612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f4e98027a00 con 0x7f4e980f6530 2023-10-18T20:56:16.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.542+0000 7f4e8e7fc700 1 -- 172.21.15.8:0/2424616612 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v16)=0 v16) v1 ==== 163+0+0 (secure 0 0 0) 0x7f4e9404d100 con 0x7f4e980f6530 2023-10-18T20:56:16.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 -- 172.21.15.8:0/2424616612 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e8405c2f0 msgr2=0x7f4e8405e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:16.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e8405c2f0 0x7f4e8405e7b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f4e88007fd0 tx=0x7f4e8800b040).stop 2023-10-18T20:56:16.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 -- 172.21.15.8:0/2424616612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 msgr2=0x7f4e9806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:16.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f4e94000c00 tx=0x7f4e9400b040).stop 2023-10-18T20:56:16.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 -- 172.21.15.8:0/2424616612 shutdown_connections 2023-10-18T20:56:16.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:16.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f4e8405c2f0 0x7f4e8405e7b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:16.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 --2- 172.21.15.8:0/2424616612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 0x7f4e98069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:16.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 -- 172.21.15.8:0/2424616612 >> 172.21.15.8:0/2424616612 conn(0x7f4e980f1c90 msgr2=0x7f4e980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:16.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 -- 172.21.15.8:0/2424616612 shutdown_connections 2023-10-18T20:56:16.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:16.544+0000 7f4e9edca700 1 -- 172.21.15.8:0/2424616612 wait complete. 2023-10-18T20:56:16.922 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -e sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 -- bash -c 'ceph config set global log_to_journald false --force' 2023-10-18T20:56:17.441 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:16.127143+0000 mgr.smithi008.flmjzp (mgr.14164) 217 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 853 B/s wr, 4 op/s 2023-10-18T20:56:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:16.127143+0000 mgr.smithi008.flmjzp (mgr.14164) 217 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 853 B/s wr, 4 op/s 2023-10-18T20:56:18.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.283+0000 7f61c33bb700 1 -- 172.21.15.8:0/4081645432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61bc0f6530 msgr2=0x7f61bc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:18.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.283+0000 7f61c33bb700 1 --2- 172.21.15.8:0/4081645432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61bc0f6530 0x7f61bc0f6950 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f61b8004660 tx=0x7f61b8009b30).stop 2023-10-18T20:56:18.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.283+0000 7f61c33bb700 1 -- 172.21.15.8:0/4081645432 shutdown_connections 2023-10-18T20:56:18.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.284+0000 7f61c33bb700 1 --2- 172.21.15.8:0/4081645432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61bc0f77d0 0x7f61bc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:18.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.284+0000 7f61c33bb700 1 --2- 172.21.15.8:0/4081645432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61bc0f6530 0x7f61bc0f6950 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:18.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.284+0000 7f61c33bb700 1 -- 172.21.15.8:0/4081645432 >> 172.21.15.8:0/4081645432 conn(0x7f61bc0f1c90 msgr2=0x7f61bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:18.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.284+0000 7f61c33bb700 1 -- 172.21.15.8:0/4081645432 shutdown_connections 2023-10-18T20:56:18.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.284+0000 7f61c33bb700 1 -- 172.21.15.8:0/4081645432 wait complete. 2023-10-18T20:56:18.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.285+0000 7f61c33bb700 1 Processor -- start 2023-10-18T20:56:18.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.285+0000 7f61c33bb700 1 -- start start 2023-10-18T20:56:18.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.285+0000 7f61c33bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61bc0f6530 0x7f61bc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:18.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c33bb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61bc0f77d0 0x7f61bc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:18.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c33bb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc06a380 con 0x7f61bc0f77d0 2023-10-18T20:56:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c33bb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc06a4c0 con 0x7f61bc0f6530 2023-10-18T20:56:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c1bb8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61bc0f77d0 0x7f61bc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c1bb8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61bc0f77d0 0x7f61bc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59544/0 (socket says 172.21.15.8:59544) 2023-10-18T20:56:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c1bb8700 1 -- 172.21.15.8:0/3098836801 learned_addr learned my addr 172.21.15.8:0/3098836801 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c23b9700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61bc0f6530 0x7f61bc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c1bb8700 1 -- 172.21.15.8:0/3098836801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61bc0f6530 msgr2=0x7f61bc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c1bb8700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61bc0f6530 0x7f61bc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c1bb8700 1 -- 172.21.15.8:0/3098836801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b8005040 con 0x7f61bc0f77d0 2023-10-18T20:56:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.286+0000 7f61c1bb8700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61bc0f77d0 0x7f61bc069e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f61ac0026d0 tx=0x7f61ac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.287+0000 7f61b2ffd700 1 -- 172.21.15.8:0/3098836801 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61ac009320 con 0x7f61bc0f77d0 2023-10-18T20:56:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.287+0000 7f61b2ffd700 1 -- 172.21.15.8:0/3098836801 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61ac00f040 con 0x7f61bc0f77d0 2023-10-18T20:56:18.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.287+0000 7f61c33bb700 1 -- 172.21.15.8:0/3098836801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc06a7a0 con 0x7f61bc0f77d0 2023-10-18T20:56:18.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.287+0000 7f61b2ffd700 1 -- 172.21.15.8:0/3098836801 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61ac0147e0 con 0x7f61bc0f77d0 2023-10-18T20:56:18.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.287+0000 7f61c33bb700 1 -- 172.21.15.8:0/3098836801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc10ede0 con 0x7f61bc0f77d0 2023-10-18T20:56:18.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.288+0000 7f61c33bb700 1 -- 172.21.15.8:0/3098836801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc045ad0 con 0x7f61bc0f77d0 2023-10-18T20:56:18.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.289+0000 7f61b2ffd700 1 -- 172.21.15.8:0/3098836801 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f61ac009480 con 0x7f61bc0f77d0 2023-10-18T20:56:18.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.290+0000 7f61b2ffd700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f61a805c2f0 0x7f61a805e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:18.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.290+0000 7f61b2ffd700 1 -- 172.21.15.8:0/3098836801 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f61ac076570 con 0x7f61bc0f77d0 2023-10-18T20:56:18.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.290+0000 7f61c23b9700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f61a805c2f0 0x7f61a805e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:18.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.291+0000 7f61c23b9700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f61a805c2f0 0x7f61a805e7b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f61b8005010 tx=0x7f61b8009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:18.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.294+0000 7f61b2ffd700 1 -- 172.21.15.8:0/3098836801 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f61ac0491f0 con 0x7f61bc0f77d0 2023-10-18T20:56:18.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.465+0000 7f61c33bb700 1 -- 172.21.15.8:0/3098836801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f61bc027a00 con 0x7f61bc0f77d0 2023-10-18T20:56:18.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.469+0000 7f61b2ffd700 1 -- 172.21.15.8:0/3098836801 <== mon.0 v2:172.21.15.8:3300/0 7 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f61ac0491f0 con 0x7f61bc0f77d0 2023-10-18T20:56:18.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.470+0000 7f61b2ffd700 1 -- 172.21.15.8:0/3098836801 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v17)=0 v17) v1 ==== 135+0+0 (secure 0 0 0) 0x7f61ac04c810 con 0x7f61bc0f77d0 2023-10-18T20:56:18.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 -- 172.21.15.8:0/3098836801 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f61a805c2f0 msgr2=0x7f61a805e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:18.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f61a805c2f0 0x7f61a805e7b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f61b8005010 tx=0x7f61b8009b30).stop 2023-10-18T20:56:18.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 -- 172.21.15.8:0/3098836801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61bc0f77d0 msgr2=0x7f61bc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:18.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61bc0f77d0 0x7f61bc069e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f61ac0026d0 tx=0x7f61ac009de0).stop 2023-10-18T20:56:18.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 -- 172.21.15.8:0/3098836801 shutdown_connections 2023-10-18T20:56:18.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f61a805c2f0 0x7f61a805e7b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:18.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61bc0f6530 0x7f61bc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:18.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 --2- 172.21.15.8:0/3098836801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61bc0f77d0 0x7f61bc069e20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:18.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 -- 172.21.15.8:0/3098836801 >> 172.21.15.8:0/3098836801 conn(0x7f61bc0f1c90 msgr2=0x7f61bc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:18.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 -- 172.21.15.8:0/3098836801 shutdown_connections 2023-10-18T20:56:18.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:18.472+0000 7f61c33bb700 1 -- 172.21.15.8:0/3098836801 wait complete. 2023-10-18T20:56:18.852 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -e sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-10-18T20:56:19.453 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:18.127616+0000 mgr.smithi008.flmjzp (mgr.14164) 218 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 4 op/s 2023-10-18T20:56:19.453 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:18.469963+0000 mon.smithi008 (mon.0) 544 : audit [INF] from='client.? 172.21.15.8:0/3098836801' entity='client.admin' 2023-10-18T20:56:19.453 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:18.474072+0000 mon.smithi008 (mon.0) 545 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:56:19.453 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:18.480027+0000 mon.smithi008 (mon.0) 546 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:18.127616+0000 mgr.smithi008.flmjzp (mgr.14164) 218 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 4 op/s 2023-10-18T20:56:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:18.469963+0000 mon.smithi008 (mon.0) 544 : audit [INF] from='client.? 172.21.15.8:0/3098836801' entity='client.admin' 2023-10-18T20:56:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:18.474072+0000 mon.smithi008 (mon.0) 545 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:56:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:18.480027+0000 mon.smithi008 (mon.0) 546 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:20.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.256+0000 7feade7ed700 1 -- 172.21.15.8:0/1175553061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f6530 msgr2=0x7fead80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.256+0000 7feade7ed700 1 --2- 172.21.15.8:0/1175553061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f6530 0x7fead80f6950 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fead4004660 tx=0x7fead4009b30).stop 2023-10-18T20:56:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.256+0000 7feade7ed700 1 -- 172.21.15.8:0/1175553061 shutdown_connections 2023-10-18T20:56:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.256+0000 7feade7ed700 1 --2- 172.21.15.8:0/1175553061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f77d0 0x7fead80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.256+0000 7feade7ed700 1 --2- 172.21.15.8:0/1175553061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f6530 0x7fead80f6950 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.256+0000 7feade7ed700 1 -- 172.21.15.8:0/1175553061 >> 172.21.15.8:0/1175553061 conn(0x7fead80f1c90 msgr2=0x7fead80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.256+0000 7feade7ed700 1 -- 172.21.15.8:0/1175553061 shutdown_connections 2023-10-18T20:56:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.256+0000 7feade7ed700 1 -- 172.21.15.8:0/1175553061 wait complete. 2023-10-18T20:56:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.257+0000 7feade7ed700 1 Processor -- start 2023-10-18T20:56:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.257+0000 7feade7ed700 1 -- start start 2023-10-18T20:56:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feade7ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f6530 0x7fead8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feade7ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f77d0 0x7fead81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feade7ed700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8109a70 con 0x7fead80f6530 2023-10-18T20:56:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feade7ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8109bb0 con 0x7fead80f77d0 2023-10-18T20:56:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feadd7eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f6530 0x7fead8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feadd7eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f6530 0x7fead8108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59554/0 (socket says 172.21.15.8:59554) 2023-10-18T20:56:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feadd7eb700 1 -- 172.21.15.8:0/220340429 learned_addr learned my addr 172.21.15.8:0/220340429 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:20.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feadcfea700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f77d0 0x7fead81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feadd7eb700 1 -- 172.21.15.8:0/220340429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f77d0 msgr2=0x7fead81094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feadd7eb700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f77d0 0x7fead81094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feadd7eb700 1 -- 172.21.15.8:0/220340429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4005040 con 0x7fead80f6530 2023-10-18T20:56:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feadcfea700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f77d0 0x7fead81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T20:56:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.258+0000 7feadd7eb700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f6530 0x7fead8108fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fead4007a70 tx=0x7fead4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.259+0000 7feacdffb700 1 -- 172.21.15.8:0/220340429 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead4018070 con 0x7fead80f6530 2023-10-18T20:56:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.259+0000 7feacdffb700 1 -- 172.21.15.8:0/220340429 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fead401d8e0 con 0x7fead80f6530 2023-10-18T20:56:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.259+0000 7feade7ed700 1 -- 172.21.15.8:0/220340429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead810a4f0 con 0x7fead80f6530 2023-10-18T20:56:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.259+0000 7feacdffb700 1 -- 172.21.15.8:0/220340429 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead401c660 con 0x7fead80f6530 2023-10-18T20:56:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.259+0000 7feade7ed700 1 -- 172.21.15.8:0/220340429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead810aa50 con 0x7fead80f6530 2023-10-18T20:56:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.260+0000 7feade7ed700 1 -- 172.21.15.8:0/220340429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead8045ad0 con 0x7fead80f6530 2023-10-18T20:56:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.261+0000 7feacdffb700 1 -- 172.21.15.8:0/220340429 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fead401da50 con 0x7fead80f6530 2023-10-18T20:56:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.262+0000 7feacdffb700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7feac405c2f0 0x7feac405e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.262+0000 7feacdffb700 1 -- 172.21.15.8:0/220340429 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fead4077f80 con 0x7fead80f6530 2023-10-18T20:56:20.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.262+0000 7feadcfea700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7feac405c2f0 0x7feac405e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:20.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.263+0000 7feadcfea700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7feac405c2f0 0x7feac405e7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7feac80041d0 tx=0x7feac8009040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:20.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.266+0000 7feacdffb700 1 -- 172.21.15.8:0/220340429 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fead404ab80 con 0x7fead80f6530 2023-10-18T20:56:20.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.465+0000 7feade7ed700 1 -- 172.21.15.8:0/220340429 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5", "target": ["mon-mgr", ""]}) v1 -- 0x7fead810ac70 con 0x7feac405c2f0 2023-10-18T20:56:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.471+0000 7feacdffb700 1 -- 172.21.15.8:0/220340429 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fead810ac70 con 0x7feac405c2f0 2023-10-18T20:56:20.474 INFO:teuthology.orchestra.run.smithi008.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:56:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.473+0000 7feade7ed700 1 -- 172.21.15.8:0/220340429 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7feac405c2f0 msgr2=0x7feac405e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.473+0000 7feade7ed700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7feac405c2f0 0x7feac405e7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7feac80041d0 tx=0x7feac8009040).stop 2023-10-18T20:56:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.473+0000 7feade7ed700 1 -- 172.21.15.8:0/220340429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f6530 msgr2=0x7fead8108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.473+0000 7feade7ed700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f6530 0x7fead8108fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fead4007a70 tx=0x7fead4009b30).stop 2023-10-18T20:56:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.473+0000 7feade7ed700 1 -- 172.21.15.8:0/220340429 shutdown_connections 2023-10-18T20:56:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.473+0000 7feade7ed700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f6530 0x7fead8108fd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.473+0000 7feade7ed700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7feac405c2f0 0x7feac405e7b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.473+0000 7feade7ed700 1 --2- 172.21.15.8:0/220340429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f77d0 0x7fead81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.473+0000 7feade7ed700 1 -- 172.21.15.8:0/220340429 >> 172.21.15.8:0/220340429 conn(0x7fead80f1c90 msgr2=0x7fead806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.473+0000 7feade7ed700 1 -- 172.21.15.8:0/220340429 shutdown_connections 2023-10-18T20:56:20.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:20.474+0000 7feade7ed700 1 -- 172.21.15.8:0/220340429 wait complete. 2023-10-18T20:56:20.867 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-10-18T20:56:20.868 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-18T20:56:20.868 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 -e sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; sleep 30 ; done' 2023-10-18T20:56:21.443 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:20.128076+0000 mgr.smithi008.flmjzp (mgr.14164) 219 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 5 op/s 2023-10-18T20:56:21.444 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:20.472555+0000 mon.smithi008 (mon.0) 547 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:21.444 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:20.473122+0000 mon.smithi008 (mon.0) 548 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:56:21.444 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:20.478232+0000 mon.smithi008 (mon.0) 549 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:20.128076+0000 mgr.smithi008.flmjzp (mgr.14164) 219 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 5 op/s 2023-10-18T20:56:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:20.472555+0000 mon.smithi008 (mon.0) 547 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:20.473122+0000 mon.smithi008 (mon.0) 548 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:56:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:20.478232+0000 mon.smithi008 (mon.0) 549 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.417+0000 7fdd7f237700 1 -- 172.21.15.8:0/4001572725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780f77d0 msgr2=0x7fdd780f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.417+0000 7fdd7f237700 1 --2- 172.21.15.8:0/4001572725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780f77d0 0x7fdd780f7c30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fdd68004660 tx=0x7fdd68009b30).stop 2023-10-18T20:56:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.417+0000 7fdd7f237700 1 -- 172.21.15.8:0/4001572725 shutdown_connections 2023-10-18T20:56:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.417+0000 7fdd7f237700 1 --2- 172.21.15.8:0/4001572725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780f77d0 0x7fdd780f7c30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.417+0000 7fdd7f237700 1 --2- 172.21.15.8:0/4001572725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd780f6530 0x7fdd780f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.417+0000 7fdd7f237700 1 -- 172.21.15.8:0/4001572725 >> 172.21.15.8:0/4001572725 conn(0x7fdd780f1c90 msgr2=0x7fdd780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.417+0000 7fdd7f237700 1 -- 172.21.15.8:0/4001572725 shutdown_connections 2023-10-18T20:56:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.417+0000 7fdd7f237700 1 -- 172.21.15.8:0/4001572725 wait complete. 2023-10-18T20:56:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.418+0000 7fdd7f237700 1 Processor -- start 2023-10-18T20:56:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.419+0000 7fdd7f237700 1 -- start start 2023-10-18T20:56:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.419+0000 7fdd7f237700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780f6530 0x7fdd78108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.419+0000 7fdd7f237700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd780f77d0 0x7fdd781093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.419+0000 7fdd7f237700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78109950 con 0x7fdd780f6530 2023-10-18T20:56:22.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.419+0000 7fdd7f237700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78109a90 con 0x7fdd780f77d0 2023-10-18T20:56:22.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.419+0000 7fdd7e235700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780f6530 0x7fdd78108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:22.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.419+0000 7fdd7e235700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780f6530 0x7fdd78108eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59568/0 (socket says 172.21.15.8:59568) 2023-10-18T20:56:22.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.419+0000 7fdd7e235700 1 -- 172.21.15.8:0/4018467691 learned_addr learned my addr 172.21.15.8:0/4018467691 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:22.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.420+0000 7fdd7da34700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd780f77d0 0x7fdd781093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:22.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.420+0000 7fdd7e235700 1 -- 172.21.15.8:0/4018467691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd780f77d0 msgr2=0x7fdd781093a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:22.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.420+0000 7fdd7e235700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd780f77d0 0x7fdd781093a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:22.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.420+0000 7fdd7e235700 1 -- 172.21.15.8:0/4018467691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd68005040 con 0x7fdd780f6530 2023-10-18T20:56:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.420+0000 7fdd7e235700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780f6530 0x7fdd78108eb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fdd7400e7c0 tx=0x7fdd7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.421+0000 7fdd6effd700 1 -- 172.21.15.8:0/4018467691 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd740092e0 con 0x7fdd780f6530 2023-10-18T20:56:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.421+0000 7fdd6effd700 1 -- 172.21.15.8:0/4018467691 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdd7400f040 con 0x7fdd780f6530 2023-10-18T20:56:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.421+0000 7fdd6effd700 1 -- 172.21.15.8:0/4018467691 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd74014810 con 0x7fdd780f6530 2023-10-18T20:56:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.421+0000 7fdd7f237700 1 -- 172.21.15.8:0/4018467691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7810a430 con 0x7fdd780f6530 2023-10-18T20:56:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.421+0000 7fdd7f237700 1 -- 172.21.15.8:0/4018467691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7810a970 con 0x7fdd780f6530 2023-10-18T20:56:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.423+0000 7fdd7f237700 1 -- 172.21.15.8:0/4018467691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd78045ad0 con 0x7fdd780f6530 2023-10-18T20:56:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.423+0000 7fdd6effd700 1 -- 172.21.15.8:0/4018467691 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fdd7401b030 con 0x7fdd780f6530 2023-10-18T20:56:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.425+0000 7fdd6effd700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fdd6405c340 0x7fdd6405e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.425+0000 7fdd6effd700 1 -- 172.21.15.8:0/4018467691 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fdd74075dc0 con 0x7fdd780f6530 2023-10-18T20:56:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.425+0000 7fdd7da34700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fdd6405c340 0x7fdd6405e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.426+0000 7fdd7da34700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fdd6405c340 0x7fdd6405e800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fdd68005010 tx=0x7fdd68016040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:22.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.429+0000 7fdd6effd700 1 -- 172.21.15.8:0/4018467691 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdd74079030 con 0x7fdd780f6530 2023-10-18T20:56:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:20.467944+0000 mgr.smithi008.flmjzp (mgr.14164) 220 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:56:20.468540+0000 mgr.smithi008.flmjzp (mgr.14164) 221 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:56:22.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:56:20.481345+0000 mgr.smithi008.flmjzp (mgr.14164) 222 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:56:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:20.467944+0000 mgr.smithi008.flmjzp (mgr.14164) 220 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:56:20.468540+0000 mgr.smithi008.flmjzp (mgr.14164) 221 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:56:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:56:20.481345+0000 mgr.smithi008.flmjzp (mgr.14164) 222 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T20:56:22.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.807+0000 7fdd7f237700 1 -- 172.21.15.8:0/4018467691 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd780008d0 con 0x7fdd6405c340 2023-10-18T20:56:22.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.808+0000 7fdd6effd700 1 -- 172.21.15.8:0/4018467691 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7fdd780008d0 con 0x7fdd6405c340 2023-10-18T20:56:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.810+0000 7fdd7f237700 1 -- 172.21.15.8:0/4018467691 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fdd6405c340 msgr2=0x7fdd6405e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.810+0000 7fdd7f237700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fdd6405c340 0x7fdd6405e800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fdd68005010 tx=0x7fdd68016040).stop 2023-10-18T20:56:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.810+0000 7fdd7f237700 1 -- 172.21.15.8:0/4018467691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780f6530 msgr2=0x7fdd78108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.810+0000 7fdd7f237700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780f6530 0x7fdd78108eb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fdd7400e7c0 tx=0x7fdd7400b040).stop 2023-10-18T20:56:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.813+0000 7fdd7f237700 1 -- 172.21.15.8:0/4018467691 shutdown_connections 2023-10-18T20:56:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.813+0000 7fdd7f237700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780f6530 0x7fdd78108eb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.813+0000 7fdd7f237700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fdd6405c340 0x7fdd6405e800 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.813+0000 7fdd7f237700 1 --2- 172.21.15.8:0/4018467691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd780f77d0 0x7fdd781093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.813+0000 7fdd7f237700 1 -- 172.21.15.8:0/4018467691 >> 172.21.15.8:0/4018467691 conn(0x7fdd780f1c90 msgr2=0x7fdd780f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.813+0000 7fdd7f237700 1 -- 172.21.15.8:0/4018467691 shutdown_connections 2023-10-18T20:56:22.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.813+0000 7fdd7f237700 1 -- 172.21.15.8:0/4018467691 wait complete. 2023-10-18T20:56:22.830 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T20:56:22.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.993+0000 7f3477fff700 1 -- 172.21.15.8:0/1732036035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34780f6530 msgr2=0x7f34780f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:22.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.993+0000 7f3477fff700 1 --2- 172.21.15.8:0/1732036035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34780f6530 0x7f34780f6950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f3468004660 tx=0x7f3468009b30).stop 2023-10-18T20:56:22.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.993+0000 7f3477fff700 1 -- 172.21.15.8:0/1732036035 shutdown_connections 2023-10-18T20:56:22.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.993+0000 7f3477fff700 1 --2- 172.21.15.8:0/1732036035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34780f77d0 0x7f34780f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:22.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.993+0000 7f3477fff700 1 --2- 172.21.15.8:0/1732036035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34780f6530 0x7f34780f6950 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:22.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.993+0000 7f3477fff700 1 -- 172.21.15.8:0/1732036035 >> 172.21.15.8:0/1732036035 conn(0x7f34780f1c90 msgr2=0x7f34780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:23.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.994+0000 7f3477fff700 1 -- 172.21.15.8:0/1732036035 shutdown_connections 2023-10-18T20:56:23.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.994+0000 7f3477fff700 1 -- 172.21.15.8:0/1732036035 wait complete. 2023-10-18T20:56:23.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.995+0000 7f3477fff700 1 Processor -- start 2023-10-18T20:56:23.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.995+0000 7f3477fff700 1 -- start start 2023-10-18T20:56:23.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f3477fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34780f6530 0x7f34780ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:23.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f3477fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34780f77d0 0x7f34780ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:23.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f3477fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3478100440 con 0x7f34780f6530 2023-10-18T20:56:23.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f3477fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3478100580 con 0x7f34780f77d0 2023-10-18T20:56:23.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f3476ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34780f6530 0x7f34780ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:23.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f3476ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34780f6530 0x7f34780ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59598/0 (socket says 172.21.15.8:59598) 2023-10-18T20:56:23.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f3476ffd700 1 -- 172.21.15.8:0/14035778 learned_addr learned my addr 172.21.15.8:0/14035778 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:23.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f34767fc700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34780f77d0 0x7f34780ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:23.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f3476ffd700 1 -- 172.21.15.8:0/14035778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34780f77d0 msgr2=0x7f34780ffe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:23.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f3476ffd700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34780f77d0 0x7f34780ffe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f3476ffd700 1 -- 172.21.15.8:0/14035778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3468005040 con 0x7f34780f6530 2023-10-18T20:56:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.996+0000 7f34767fc700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34780f77d0 0x7f34780ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T20:56:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.997+0000 7f3476ffd700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34780f6530 0x7f34780ff950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f3468007a60 tx=0x7f3468009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.997+0000 7f345f7fe700 1 -- 172.21.15.8:0/14035778 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3468018070 con 0x7f34780f6530 2023-10-18T20:56:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.997+0000 7f3477fff700 1 -- 172.21.15.8:0/14035778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3478100e90 con 0x7f34780f6530 2023-10-18T20:56:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.997+0000 7f3477fff700 1 -- 172.21.15.8:0/14035778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34781013f0 con 0x7f34780f6530 2023-10-18T20:56:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.997+0000 7f345f7fe700 1 -- 172.21.15.8:0/14035778 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3468009630 con 0x7f34780f6530 2023-10-18T20:56:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.997+0000 7f345f7fe700 1 -- 172.21.15.8:0/14035778 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f346801c540 con 0x7f34780f6530 2023-10-18T20:56:23.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.999+0000 7f3477fff700 1 -- 172.21.15.8:0/14035778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3458004fa0 con 0x7f34780f6530 2023-10-18T20:56:23.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:22.999+0000 7f345f7fe700 1 -- 172.21.15.8:0/14035778 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f346801c6a0 con 0x7f34780f6530 2023-10-18T20:56:23.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.000+0000 7f345f7fe700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f346005c2f0 0x7f346005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:23.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.001+0000 7f345f7fe700 1 -- 172.21.15.8:0/14035778 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3468077a60 con 0x7f34780f6530 2023-10-18T20:56:23.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.001+0000 7f34767fc700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f346005c2f0 0x7f346005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:23.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.001+0000 7f34767fc700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f346005c2f0 0x7f346005e7b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f346c009760 tx=0x7f346c009c60).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.005+0000 7f345f7fe700 1 -- 172.21.15.8:0/14035778 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f346804a7a0 con 0x7f34780f6530 2023-10-18T20:56:23.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.316+0000 7f3477fff700 1 -- 172.21.15.8:0/14035778 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3458000bc0 con 0x7f346005c2f0 2023-10-18T20:56:23.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.317+0000 7f345f7fe700 1 -- 172.21.15.8:0/14035778 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f3458000bc0 con 0x7f346005c2f0 2023-10-18T20:56:23.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 -- 172.21.15.8:0/14035778 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f346005c2f0 msgr2=0x7f346005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:23.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f346005c2f0 0x7f346005e7b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f346c009760 tx=0x7f346c009c60).stop 2023-10-18T20:56:23.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 -- 172.21.15.8:0/14035778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34780f6530 msgr2=0x7f34780ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:23.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34780f6530 0x7f34780ff950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f3468007a60 tx=0x7f3468009b30).stop 2023-10-18T20:56:23.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 -- 172.21.15.8:0/14035778 shutdown_connections 2023-10-18T20:56:23.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34780f6530 0x7f34780ff950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f346005c2f0 0x7f346005e7b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 --2- 172.21.15.8:0/14035778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34780f77d0 0x7f34780ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 -- 172.21.15.8:0/14035778 >> 172.21.15.8:0/14035778 conn(0x7f34780f1c90 msgr2=0x7f347806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:23.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 -- 172.21.15.8:0/14035778 shutdown_connections 2023-10-18T20:56:23.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.319+0000 7f3477fff700 1 -- 172.21.15.8:0/14035778 wait complete. 2023-10-18T20:56:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.479+0000 7fe82df0c700 1 -- 172.21.15.8:0/4121299834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8280f6530 msgr2=0x7fe8280f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.479+0000 7fe82df0c700 1 --2- 172.21.15.8:0/4121299834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8280f6530 0x7fe8280f6950 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fe81c004660 tx=0x7fe81c009b30).stop 2023-10-18T20:56:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.479+0000 7fe82df0c700 1 -- 172.21.15.8:0/4121299834 shutdown_connections 2023-10-18T20:56:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.479+0000 7fe82df0c700 1 --2- 172.21.15.8:0/4121299834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8280f77d0 0x7fe8280f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.479+0000 7fe82df0c700 1 --2- 172.21.15.8:0/4121299834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8280f6530 0x7fe8280f6950 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.479+0000 7fe82df0c700 1 -- 172.21.15.8:0/4121299834 >> 172.21.15.8:0/4121299834 conn(0x7fe8280f1c90 msgr2=0x7fe8280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.480+0000 7fe82df0c700 1 -- 172.21.15.8:0/4121299834 shutdown_connections 2023-10-18T20:56:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.480+0000 7fe82df0c700 1 -- 172.21.15.8:0/4121299834 wait complete. 2023-10-18T20:56:23.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.480+0000 7fe82df0c700 1 Processor -- start 2023-10-18T20:56:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.481+0000 7fe82df0c700 1 -- start start 2023-10-18T20:56:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.481+0000 7fe82df0c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8280f6530 0x7fe82806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.481+0000 7fe82df0c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8280f77d0 0x7fe828069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.481+0000 7fe82df0c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82806a380 con 0x7fe8280f77d0 2023-10-18T20:56:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.481+0000 7fe82df0c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82806a4c0 con 0x7fe8280f6530 2023-10-18T20:56:23.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.481+0000 7fe827fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8280f77d0 0x7fe828069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:23.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.482+0000 7fe827fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8280f77d0 0x7fe828069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59620/0 (socket says 172.21.15.8:59620) 2023-10-18T20:56:23.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.482+0000 7fe827fff700 1 -- 172.21.15.8:0/1380122685 learned_addr learned my addr 172.21.15.8:0/1380122685 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:23.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.482+0000 7fe82cf0a700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8280f6530 0x7fe82806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:23.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.482+0000 7fe827fff700 1 -- 172.21.15.8:0/1380122685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8280f6530 msgr2=0x7fe82806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.482+0000 7fe827fff700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8280f6530 0x7fe82806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.482+0000 7fe827fff700 1 -- 172.21.15.8:0/1380122685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c005040 con 0x7fe8280f77d0 2023-10-18T20:56:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.482+0000 7fe82cf0a700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8280f6530 0x7fe82806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T20:56:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.482+0000 7fe827fff700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8280f77d0 0x7fe828069e20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe8140026d0 tx=0x7fe814009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.482+0000 7fe8257fa700 1 -- 172.21.15.8:0/1380122685 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8140079c0 con 0x7fe8280f77d0 2023-10-18T20:56:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.483+0000 7fe8257fa700 1 -- 172.21.15.8:0/1380122685 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe81400f040 con 0x7fe8280f77d0 2023-10-18T20:56:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.483+0000 7fe8257fa700 1 -- 172.21.15.8:0/1380122685 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe814014980 con 0x7fe8280f77d0 2023-10-18T20:56:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.483+0000 7fe82df0c700 1 -- 172.21.15.8:0/1380122685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82806a7a0 con 0x7fe8280f77d0 2023-10-18T20:56:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.483+0000 7fe82df0c700 1 -- 172.21.15.8:0/1380122685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82810ede0 con 0x7fe8280f77d0 2023-10-18T20:56:23.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:22.128460+0000 mgr.smithi008.flmjzp (mgr.14164) 223 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 4 op/s 2023-10-18T20:56:23.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:22.262428+0000 mon.smithi008 (mon.0) 550 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:56:23.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:22.262774+0000 mon.smithi008 (mon.0) 551 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:56:23.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.484+0000 7fe82df0c700 1 -- 172.21.15.8:0/1380122685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe828045ad0 con 0x7fe8280f77d0 2023-10-18T20:56:23.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.485+0000 7fe8257fa700 1 -- 172.21.15.8:0/1380122685 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe8140090d0 con 0x7fe8280f77d0 2023-10-18T20:56:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.486+0000 7fe8257fa700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe81805c350 0x7fe81805e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.486+0000 7fe8257fa700 1 -- 172.21.15.8:0/1380122685 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe8140762b0 con 0x7fe8280f77d0 2023-10-18T20:56:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.486+0000 7fe82cf0a700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe81805c350 0x7fe81805e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.487+0000 7fe82cf0a700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe81805c350 0x7fe81805e810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fe82806b730 tx=0x7fe81c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:23.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.490+0000 7fe8257fa700 1 -- 172.21.15.8:0/1380122685 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe814048fa0 con 0x7fe8280f77d0 2023-10-18T20:56:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:22.128460+0000 mgr.smithi008.flmjzp (mgr.14164) 223 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 4 op/s 2023-10-18T20:56:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:22.262428+0000 mon.smithi008 (mon.0) 550 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:56:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:22.262774+0000 mon.smithi008 (mon.0) 551 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:56:23.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.804+0000 7fe82df0c700 1 -- 172.21.15.8:0/1380122685 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe828057f10 con 0x7fe81805c350 2023-10-18T20:56:23.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.817+0000 7fe8257fa700 1 -- 172.21.15.8:0/1380122685 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2728 (secure 0 0 0) 0x7fe828057f10 con 0x7fe81805c350 2023-10-18T20:56:23.820 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2023-10-18T20:56:23.820 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (3m) 18s ago 4m 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T20:56:23.821 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (4m) 18s ago 4m 16.2.4 8d91d370c2b8 4b2c6838af84 2023-10-18T20:56:23.821 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (3m) 20s ago 3m 16.2.4 8d91d370c2b8 67dc04156fe1 2023-10-18T20:56:23.821 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (2m) 18s ago 4m 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T20:56:23.821 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (34s) 18s ago 34s 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T20:56:23.821 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (29s) 18s ago 29s 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T20:56:23.822 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (32s) 20s ago 32s 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T20:56:23.822 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (27s) 20s ago 27s 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T20:56:23.822 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:9283 running (5m) 18s ago 5m 16.2.4 8d91d370c2b8 ee1a6b0bd8ee 2023-10-18T20:56:23.822 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (3m) 20s ago 3m 16.2.4 8d91d370c2b8 b685ab58431c 2023-10-18T20:56:23.822 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (5m) 18s ago 5m 16.2.4 8d91d370c2b8 9de89e6e28e5 2023-10-18T20:56:23.823 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (3m) 20s ago 3m 16.2.4 8d91d370c2b8 d7c00f2c13a4 2023-10-18T20:56:23.823 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (4m) 18s ago 4m 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T20:56:23.823 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (3m) 20s ago 3m 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T20:56:23.823 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (3m) 18s ago 3m 16.2.4 8d91d370c2b8 885270808f90 2023-10-18T20:56:23.823 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (2m) 18s ago 2m 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T20:56:23.824 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (2m) 18s ago 2m 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T20:56:23.824 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (2m) 20s ago 2m 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T20:56:23.824 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (116s) 20s ago 116s 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T20:56:23.824 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (100s) 20s ago 100s 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T20:56:23.824 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (2m) 18s ago 3m 2.18.1 de242295e225 0af47d38e46d 2023-10-18T20:56:23.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.820+0000 7fe82df0c700 1 -- 172.21.15.8:0/1380122685 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe81805c350 msgr2=0x7fe81805e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:23.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.820+0000 7fe82df0c700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe81805c350 0x7fe81805e810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fe82806b730 tx=0x7fe81c009b30).stop 2023-10-18T20:56:23.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.820+0000 7fe82df0c700 1 -- 172.21.15.8:0/1380122685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8280f77d0 msgr2=0x7fe828069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:23.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.820+0000 7fe82df0c700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8280f77d0 0x7fe828069e20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe8140026d0 tx=0x7fe814009de0).stop 2023-10-18T20:56:23.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.820+0000 7fe82df0c700 1 -- 172.21.15.8:0/1380122685 shutdown_connections 2023-10-18T20:56:23.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.820+0000 7fe82df0c700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fe81805c350 0x7fe81805e810 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.820+0000 7fe82df0c700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8280f6530 0x7fe82806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.820+0000 7fe82df0c700 1 --2- 172.21.15.8:0/1380122685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8280f77d0 0x7fe828069e20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.820+0000 7fe82df0c700 1 -- 172.21.15.8:0/1380122685 >> 172.21.15.8:0/1380122685 conn(0x7fe8280f1c90 msgr2=0x7fe8280fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:23.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.821+0000 7fe82df0c700 1 -- 172.21.15.8:0/1380122685 shutdown_connections 2023-10-18T20:56:23.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.821+0000 7fe82df0c700 1 -- 172.21.15.8:0/1380122685 wait complete. 2023-10-18T20:56:23.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.981+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1606146919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0540f6530 msgr2=0x7fd0540f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:23.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.981+0000 7fd05b0d5700 1 --2- 172.21.15.8:0/1606146919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0540f6530 0x7fd0540f6950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fd050004660 tx=0x7fd050009b30).stop 2023-10-18T20:56:23.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.981+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1606146919 shutdown_connections 2023-10-18T20:56:23.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.981+0000 7fd05b0d5700 1 --2- 172.21.15.8:0/1606146919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0540f77d0 0x7fd0540f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.981+0000 7fd05b0d5700 1 --2- 172.21.15.8:0/1606146919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0540f6530 0x7fd0540f6950 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.981+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1606146919 >> 172.21.15.8:0/1606146919 conn(0x7fd0540f1c90 msgr2=0x7fd0540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:23.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.982+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1606146919 shutdown_connections 2023-10-18T20:56:23.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.982+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1606146919 wait complete. 2023-10-18T20:56:23.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.983+0000 7fd05b0d5700 1 Processor -- start 2023-10-18T20:56:23.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.983+0000 7fd05b0d5700 1 -- start start 2023-10-18T20:56:23.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.984+0000 7fd05b0d5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0540f6530 0x7fd054106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:23.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.984+0000 7fd05b0d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0540f77d0 0x7fd054107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:23.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.984+0000 7fd05b0d5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054107880 con 0x7fd0540f77d0 2023-10-18T20:56:23.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.984+0000 7fd05b0d5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0541080c0 con 0x7fd0540f6530 2023-10-18T20:56:23.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.984+0000 7fd05a0d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0540f6530 0x7fd054106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:23.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.984+0000 7fd0598d2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0540f77d0 0x7fd054107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:23.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.984+0000 7fd05a0d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0540f6530 0x7fd054106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:37218/0 (socket says 172.21.15.8:37218) 2023-10-18T20:56:23.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.984+0000 7fd05a0d3700 1 -- 172.21.15.8:0/1910133246 learned_addr learned my addr 172.21.15.8:0/1910133246 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:23.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.984+0000 7fd05a0d3700 1 -- 172.21.15.8:0/1910133246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0540f77d0 msgr2=0x7fd054107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:23.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.984+0000 7fd05a0d3700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0540f77d0 0x7fd054107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:23.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.985+0000 7fd05a0d3700 1 -- 172.21.15.8:0/1910133246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050005040 con 0x7fd0540f6530 2023-10-18T20:56:23.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.985+0000 7fd0598d2700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0540f77d0 0x7fd054107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T20:56:23.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.985+0000 7fd05a0d3700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0540f6530 0x7fd054106d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd050009870 tx=0x7fd05000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:23.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.985+0000 7fd04affd700 1 -- 172.21.15.8:0/1910133246 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd050019070 con 0x7fd0540f6530 2023-10-18T20:56:23.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.985+0000 7fd04affd700 1 -- 172.21.15.8:0/1910133246 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd050013380 con 0x7fd0540f6530 2023-10-18T20:56:23.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.985+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1910133246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd054108340 con 0x7fd0540f6530 2023-10-18T20:56:23.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.985+0000 7fd04affd700 1 -- 172.21.15.8:0/1910133246 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05001edf0 con 0x7fd0540f6530 2023-10-18T20:56:23.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.985+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1910133246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd054108820 con 0x7fd0540f6530 2023-10-18T20:56:23.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.987+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1910133246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd054059100 con 0x7fd0540f6530 2023-10-18T20:56:23.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.988+0000 7fd04affd700 1 -- 172.21.15.8:0/1910133246 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd050014420 con 0x7fd0540f6530 2023-10-18T20:56:23.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.989+0000 7fd04affd700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd04005c2f0 0x7fd04005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:23.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.989+0000 7fd04affd700 1 -- 172.21.15.8:0/1910133246 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd0500772e0 con 0x7fd0540f6530 2023-10-18T20:56:23.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.989+0000 7fd0598d2700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd04005c2f0 0x7fd04005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:23.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.990+0000 7fd0598d2700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd04005c2f0 0x7fd04005e7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd054106b20 tx=0x7fd04400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:23.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:23.994+0000 7fd04affd700 1 -- 172.21.15.8:0/1910133246 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd050049f40 con 0x7fd0540f6530 2023-10-18T20:56:24.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.338+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1910133246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0540fecc0 con 0x7fd0540f6530 2023-10-18T20:56:24.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.338+0000 7fd04affd700 1 -- 172.21.15.8:0/1910133246 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7fd05004d560 con 0x7fd0540f6530 2023-10-18T20:56:24.343 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:56:24.343 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T20:56:24.343 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T20:56:24.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:56:24.344 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T20:56:24.344 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T20:56:24.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:56:24.344 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T20:56:24.344 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-10-18T20:56:24.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:56:24.345 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T20:56:24.345 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T20:56:24.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:56:24.346 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T20:56:24.346 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2023-10-18T20:56:24.346 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T20:56:24.346 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:56:24.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1910133246 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd04005c2f0 msgr2=0x7fd04005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:24.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd04005c2f0 0x7fd04005e7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd054106b20 tx=0x7fd04400b040).stop 2023-10-18T20:56:24.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1910133246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0540f6530 msgr2=0x7fd054106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:24.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0540f6530 0x7fd054106d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd050009870 tx=0x7fd05000b040).stop 2023-10-18T20:56:24.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1910133246 shutdown_connections 2023-10-18T20:56:24.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7fd04005c2f0 0x7fd04005e7b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:24.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0540f6530 0x7fd054106d90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:24.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 --2- 172.21.15.8:0/1910133246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0540f77d0 0x7fd054107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:24.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1910133246 >> 172.21.15.8:0/1910133246 conn(0x7fd0540f1c90 msgr2=0x7fd0540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:24.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1910133246 shutdown_connections 2023-10-18T20:56:24.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.342+0000 7fd05b0d5700 1 -- 172.21.15.8:0/1910133246 wait complete. 2023-10-18T20:56:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:22.809677+0000 mgr.smithi008.flmjzp (mgr.14164) 224 : audit [DBG] from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:23.318425+0000 mgr.smithi008.flmjzp (mgr.14164) 225 : audit [DBG] from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:24.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.529+0000 7f21613a3700 1 -- 172.21.15.8:0/1939865094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215c0f99e0 msgr2=0x7f215c0f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:24.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.529+0000 7f21613a3700 1 --2- 172.21.15.8:0/1939865094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215c0f99e0 0x7f215c0f9e40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f2150004660 tx=0x7f2150009b30).stop 2023-10-18T20:56:24.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.529+0000 7f21613a3700 1 -- 172.21.15.8:0/1939865094 shutdown_connections 2023-10-18T20:56:24.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.529+0000 7f21613a3700 1 --2- 172.21.15.8:0/1939865094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215c0f99e0 0x7f215c0f9e40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:24.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.529+0000 7f21613a3700 1 --2- 172.21.15.8:0/1939865094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0f8740 0x7f215c0f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:24.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.529+0000 7f21613a3700 1 -- 172.21.15.8:0/1939865094 >> 172.21.15.8:0/1939865094 conn(0x7f215c0f40e0 msgr2=0x7f215c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:24.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.532+0000 7f21613a3700 1 -- 172.21.15.8:0/1939865094 shutdown_connections 2023-10-18T20:56:24.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.532+0000 7f21613a3700 1 -- 172.21.15.8:0/1939865094 wait complete. 2023-10-18T20:56:24.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.533+0000 7f21613a3700 1 Processor -- start 2023-10-18T20:56:24.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.533+0000 7f21613a3700 1 -- start start 2023-10-18T20:56:24.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.533+0000 7f21613a3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215c0f8740 0x7f215c108e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:24.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.533+0000 7f21613a3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0f99e0 0x7f215c109380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:24.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.534+0000 7f21613a3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c109930 con 0x7f215c0f8740 2023-10-18T20:56:24.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.534+0000 7f21613a3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c109a70 con 0x7f215c0f99e0 2023-10-18T20:56:24.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.534+0000 7f215bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215c0f8740 0x7f215c108e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:24.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.534+0000 7f215bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215c0f8740 0x7f215c108e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59666/0 (socket says 172.21.15.8:59666) 2023-10-18T20:56:24.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.534+0000 7f215bfff700 1 -- 172.21.15.8:0/2217681855 learned_addr learned my addr 172.21.15.8:0/2217681855 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:24.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.534+0000 7f215b7fe700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0f99e0 0x7f215c109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:24.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.534+0000 7f215bfff700 1 -- 172.21.15.8:0/2217681855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0f99e0 msgr2=0x7f215c109380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:24.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.534+0000 7f215bfff700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0f99e0 0x7f215c109380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:24.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.534+0000 7f215bfff700 1 -- 172.21.15.8:0/2217681855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150005040 con 0x7f215c0f8740 2023-10-18T20:56:24.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.534+0000 7f215b7fe700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0f99e0 0x7f215c109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T20:56:24.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.535+0000 7f215bfff700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215c0f8740 0x7f215c108e90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f214c00e7c0 tx=0x7f214c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:24.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.535+0000 7f2158ff9700 1 -- 172.21.15.8:0/2217681855 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f214c0092e0 con 0x7f215c0f8740 2023-10-18T20:56:24.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.535+0000 7f21613a3700 1 -- 172.21.15.8:0/2217681855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c10a410 con 0x7f215c0f8740 2023-10-18T20:56:24.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.535+0000 7f21613a3700 1 -- 172.21.15.8:0/2217681855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c10a950 con 0x7f215c0f8740 2023-10-18T20:56:24.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.536+0000 7f2158ff9700 1 -- 172.21.15.8:0/2217681855 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f214c00f040 con 0x7f215c0f8740 2023-10-18T20:56:24.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.536+0000 7f2158ff9700 1 -- 172.21.15.8:0/2217681855 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f214c0147e0 con 0x7f215c0f8740 2023-10-18T20:56:24.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.536+0000 7f21613a3700 1 -- 172.21.15.8:0/2217681855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c004fa0 con 0x7f215c0f8740 2023-10-18T20:56:24.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.537+0000 7f2158ff9700 1 -- 172.21.15.8:0/2217681855 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f214c01b030 con 0x7f215c0f8740 2023-10-18T20:56:24.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.538+0000 7f2158ff9700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f214405c300 0x7f214405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.538+0000 7f2158ff9700 1 -- 172.21.15.8:0/2217681855 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f214c075f40 con 0x7f215c0f8740 2023-10-18T20:56:24.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.540+0000 7f215b7fe700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f214405c300 0x7f214405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:24.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.540+0000 7f215b7fe700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f214405c300 0x7f214405e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f2150009720 tx=0x7f215000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:24.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.542+0000 7f2158ff9700 1 -- 172.21.15.8:0/2217681855 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f214c048b40 con 0x7f215c0f8740 2023-10-18T20:56:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:22.809677+0000 mgr.smithi008.flmjzp (mgr.14164) 224 : audit [DBG] from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:23.318425+0000 mgr.smithi008.flmjzp (mgr.14164) 225 : audit [DBG] from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:24.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.881+0000 7f21613a3700 1 -- 172.21.15.8:0/2217681855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f213c005e80 con 0x7f215c0f8740 2023-10-18T20:56:24.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.882+0000 7f2158ff9700 1 -- 172.21.15.8:0/2217681855 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1613 (secure 0 0 0) 0x7f214c019020 con 0x7f215c0f8740 2023-10-18T20:56:24.885 INFO:teuthology.orchestra.run.smithi008.stdout:e15 2023-10-18T20:56:24.885 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:56:24.886 INFO:teuthology.orchestra.run.smithi008.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:56:24.886 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T20:56:24.886 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:56:24.886 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T20:56:24.886 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T20:56:24.887 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 15 2023-10-18T20:56:24.887 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T20:56:24.887 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:56:24.887 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:56:04.757749+0000 2023-10-18T20:56:24.887 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T20:56:24.888 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T20:56:24.888 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T20:56:24.888 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T20:56:24.888 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T20:56:24.888 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T20:56:24.889 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T20:56:24.889 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T20:56:24.889 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:56:24.889 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T20:56:24.889 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T20:56:24.889 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T20:56:24.890 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T20:56:24.890 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T20:56:24.890 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T20:56:24.890 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T20:56:24.891 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T20:56:24.891 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T20:56:24.891 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T20:56:24.891 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T20:56:24.891 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015]] 2023-10-18T20:56:24.892 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531]] 2023-10-18T20:56:24.892 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145]] 2023-10-18T20:56:24.892 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799]] 2023-10-18T20:56:24.892 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:56:24.892 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:56:24.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.884+0000 7f21613a3700 1 -- 172.21.15.8:0/2217681855 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f214405c300 msgr2=0x7f214405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:24.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.884+0000 7f21613a3700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f214405c300 0x7f214405e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f2150009720 tx=0x7f215000b040).stop 2023-10-18T20:56:24.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.884+0000 7f21613a3700 1 -- 172.21.15.8:0/2217681855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215c0f8740 msgr2=0x7f215c108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:24.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.884+0000 7f21613a3700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215c0f8740 0x7f215c108e90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f214c00e7c0 tx=0x7f214c00b040).stop 2023-10-18T20:56:24.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.884+0000 7f21613a3700 1 -- 172.21.15.8:0/2217681855 shutdown_connections 2023-10-18T20:56:24.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.884+0000 7f21613a3700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215c0f8740 0x7f215c108e90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:24.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.884+0000 7f21613a3700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f214405c300 0x7f214405e7c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:24.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.884+0000 7f21613a3700 1 --2- 172.21.15.8:0/2217681855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0f99e0 0x7f215c109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:24.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.884+0000 7f21613a3700 1 -- 172.21.15.8:0/2217681855 >> 172.21.15.8:0/2217681855 conn(0x7f215c0f40e0 msgr2=0x7f215c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:24.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.885+0000 7f21613a3700 1 -- 172.21.15.8:0/2217681855 shutdown_connections 2023-10-18T20:56:24.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:24.885+0000 7f21613a3700 1 -- 172.21.15.8:0/2217681855 wait complete. 2023-10-18T20:56:24.896 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2023-10-18T20:56:25.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.097+0000 7f3953fff700 1 -- 172.21.15.8:0/179069448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f395406a3b0 msgr2=0x7f395406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:25.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.097+0000 7f3953fff700 1 --2- 172.21.15.8:0/179069448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f395406a3b0 0x7f395406a830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f3948004660 tx=0x7f3948009b30).stop 2023-10-18T20:56:25.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.097+0000 7f3953fff700 1 -- 172.21.15.8:0/179069448 shutdown_connections 2023-10-18T20:56:25.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.097+0000 7f3953fff700 1 --2- 172.21.15.8:0/179069448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f395406a3b0 0x7f395406a830 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:25.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.097+0000 7f3953fff700 1 --2- 172.21.15.8:0/179069448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f395406b9c0 0x7f3954069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:25.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.097+0000 7f3953fff700 1 -- 172.21.15.8:0/179069448 >> 172.21.15.8:0/179069448 conn(0x7f39540f1c90 msgr2=0x7f39540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:25.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.097+0000 7f3953fff700 1 -- 172.21.15.8:0/179069448 shutdown_connections 2023-10-18T20:56:25.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.098+0000 7f3953fff700 1 -- 172.21.15.8:0/179069448 wait complete. 2023-10-18T20:56:25.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.099+0000 7f3953fff700 1 Processor -- start 2023-10-18T20:56:25.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.099+0000 7f3953fff700 1 -- start start 2023-10-18T20:56:25.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.099+0000 7f3953fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f395406a3b0 0x7f395410d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:25.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.099+0000 7f3953fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f395406b9c0 0x7f395410d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:25.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.099+0000 7f3953fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395410dd80 con 0x7f395406b9c0 2023-10-18T20:56:25.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.099+0000 7f3953fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395410dec0 con 0x7f395406a3b0 2023-10-18T20:56:25.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.100+0000 7f39527fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f395406b9c0 0x7f395410d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:25.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.100+0000 7f39527fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f395406b9c0 0x7f395410d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59694/0 (socket says 172.21.15.8:59694) 2023-10-18T20:56:25.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.100+0000 7f39527fc700 1 -- 172.21.15.8:0/3092625797 learned_addr learned my addr 172.21.15.8:0/3092625797 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:25.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.100+0000 7f3952ffd700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f395406a3b0 0x7f395410d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:25.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.100+0000 7f39527fc700 1 -- 172.21.15.8:0/3092625797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f395406a3b0 msgr2=0x7f395410d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:25.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.100+0000 7f39527fc700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f395406a3b0 0x7f395410d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:25.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.100+0000 7f39527fc700 1 -- 172.21.15.8:0/3092625797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3948005040 con 0x7f395406b9c0 2023-10-18T20:56:25.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.100+0000 7f3952ffd700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f395406a3b0 0x7f395410d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T20:56:25.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.101+0000 7f39527fc700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f395406b9c0 0x7f395410d7d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f3948004320 tx=0x7f394800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:25.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.101+0000 7f393b7fe700 1 -- 172.21.15.8:0/3092625797 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3948019070 con 0x7f395406b9c0 2023-10-18T20:56:25.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.101+0000 7f393b7fe700 1 -- 172.21.15.8:0/3092625797 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f394801e420 con 0x7f395406b9c0 2023-10-18T20:56:25.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.101+0000 7f393b7fe700 1 -- 172.21.15.8:0/3092625797 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3948014660 con 0x7f395406b9c0 2023-10-18T20:56:25.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.101+0000 7f3953fff700 1 -- 172.21.15.8:0/3092625797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395410e800 con 0x7f395406b9c0 2023-10-18T20:56:25.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.102+0000 7f3953fff700 1 -- 172.21.15.8:0/3092625797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395410ece0 con 0x7f395406b9c0 2023-10-18T20:56:25.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.103+0000 7f3953fff700 1 -- 172.21.15.8:0/3092625797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3954045ad0 con 0x7f395406b9c0 2023-10-18T20:56:25.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.103+0000 7f393b7fe700 1 -- 172.21.15.8:0/3092625797 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f394801e590 con 0x7f395406b9c0 2023-10-18T20:56:25.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.104+0000 7f393b7fe700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f393c05c2f0 0x7f393c05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:25.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.104+0000 7f393b7fe700 1 -- 172.21.15.8:0/3092625797 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f39480772d0 con 0x7f395406b9c0 2023-10-18T20:56:25.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.105+0000 7f3952ffd700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f393c05c2f0 0x7f393c05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:25.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.105+0000 7f3952ffd700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f393c05c2f0 0x7f393c05e7b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3944009da0 tx=0x7f394400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:25.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.109+0000 7f393b7fe700 1 -- 172.21.15.8:0/3092625797 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3948049f90 con 0x7f395406b9c0 2023-10-18T20:56:25.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.355+0000 7f3953fff700 1 -- 172.21.15.8:0/3092625797 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f395410ef50 con 0x7f393c05c2f0 2023-10-18T20:56:25.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.356+0000 7f393b7fe700 1 -- 172.21.15.8:0/3092625797 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f395410ef50 con 0x7f393c05c2f0 2023-10-18T20:56:25.359 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:56:25.359 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5", 2023-10-18T20:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T20:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [], 2023-10-18T20:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "", 2023-10-18T20:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 image" 2023-10-18T20:56:25.361 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:56:25.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.358+0000 7f3953fff700 1 -- 172.21.15.8:0/3092625797 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f393c05c2f0 msgr2=0x7f393c05e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:25.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.358+0000 7f3953fff700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f393c05c2f0 0x7f393c05e7b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3944009da0 tx=0x7f394400b040).stop 2023-10-18T20:56:25.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.358+0000 7f3953fff700 1 -- 172.21.15.8:0/3092625797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f395406b9c0 msgr2=0x7f395410d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.358+0000 7f3953fff700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f395406b9c0 0x7f395410d7d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f3948004320 tx=0x7f394800b040).stop 2023-10-18T20:56:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.359+0000 7f3953fff700 1 -- 172.21.15.8:0/3092625797 shutdown_connections 2023-10-18T20:56:25.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.359+0000 7f3953fff700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f393c05c2f0 0x7f393c05e7b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:25.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.359+0000 7f3953fff700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f395406a3b0 0x7f395410d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:25.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.359+0000 7f3953fff700 1 --2- 172.21.15.8:0/3092625797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f395406b9c0 0x7f395410d7d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:25.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.359+0000 7f3953fff700 1 -- 172.21.15.8:0/3092625797 >> 172.21.15.8:0/3092625797 conn(0x7f39540f1c90 msgr2=0x7f39540f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:25.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.359+0000 7f3953fff700 1 -- 172.21.15.8:0/3092625797 shutdown_connections 2023-10-18T20:56:25.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:25.359+0000 7f3953fff700 1 -- 172.21.15.8:0/3092625797 wait complete. 2023-10-18T20:56:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:23.806270+0000 mgr.smithi008.flmjzp (mgr.14164) 226 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:24.128901+0000 mgr.smithi008.flmjzp (mgr.14164) 227 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 5 op/s 2023-10-18T20:56:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:24.340131+0000 mon.smithi060 (mon.1) 17 : audit [DBG] from='client.? 172.21.15.8:0/1910133246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:56:25.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:24.883618+0000 mon.smithi008 (mon.0) 552 : audit [DBG] from='client.? 172.21.15.8:0/2217681855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:56:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:23.806270+0000 mgr.smithi008.flmjzp (mgr.14164) 226 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:24.128901+0000 mgr.smithi008.flmjzp (mgr.14164) 227 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 5 op/s 2023-10-18T20:56:25.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:24.340131+0000 mon.smithi060 (mon.1) 17 : audit [DBG] from='client.? 172.21.15.8:0/1910133246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:56:25.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:24.883618+0000 mon.smithi008 (mon.0) 552 : audit [DBG] from='client.? 172.21.15.8:0/2217681855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:56:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:25.357262+0000 mgr.smithi008.flmjzp (mgr.14164) 228 : audit [DBG] from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:25.357262+0000 mgr.smithi008.flmjzp (mgr.14164) 228 : audit [DBG] from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:26.129291+0000 mgr.smithi008.flmjzp (mgr.14164) 229 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 4 op/s 2023-10-18T20:56:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:26.129291+0000 mgr.smithi008.flmjzp (mgr.14164) 229 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 4 op/s 2023-10-18T20:56:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:28.129685+0000 mgr.smithi008.flmjzp (mgr.14164) 230 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2023-10-18T20:56:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:28.129685+0000 mgr.smithi008.flmjzp (mgr.14164) 230 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2023-10-18T20:56:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:30.130087+0000 mgr.smithi008.flmjzp (mgr.14164) 231 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2023-10-18T20:56:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:30.130087+0000 mgr.smithi008.flmjzp (mgr.14164) 231 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2023-10-18T20:56:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:32.130429+0000 mgr.smithi008.flmjzp (mgr.14164) 232 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:56:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:32.130429+0000 mgr.smithi008.flmjzp (mgr.14164) 232 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:56:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:34.130830+0000 mgr.smithi008.flmjzp (mgr.14164) 233 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:56:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:34.130830+0000 mgr.smithi008.flmjzp (mgr.14164) 233 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:56:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:36.131192+0000 mgr.smithi008.flmjzp (mgr.14164) 234 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T20:56:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:36.131192+0000 mgr.smithi008.flmjzp (mgr.14164) 234 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T20:56:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:38.131582+0000 mgr.smithi008.flmjzp (mgr.14164) 235 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:56:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:38.131582+0000 mgr.smithi008.flmjzp (mgr.14164) 235 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:56:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:40.131999+0000 mgr.smithi008.flmjzp (mgr.14164) 236 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:56:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:40.131999+0000 mgr.smithi008.flmjzp (mgr.14164) 236 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:56:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:42.132366+0000 mgr.smithi008.flmjzp (mgr.14164) 237 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:56:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:42.132366+0000 mgr.smithi008.flmjzp (mgr.14164) 237 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:56:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:44.132761+0000 mgr.smithi008.flmjzp (mgr.14164) 238 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:56:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:44.132761+0000 mgr.smithi008.flmjzp (mgr.14164) 238 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:56:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:46.133111+0000 mgr.smithi008.flmjzp (mgr.14164) 239 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T20:56:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:46.894830+0000 mon.smithi008 (mon.0) 553 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:46.896152+0000 mon.smithi008 (mon.0) 554 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:56:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:46.133111+0000 mgr.smithi008.flmjzp (mgr.14164) 239 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T20:56:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:46.894830+0000 mon.smithi008 (mon.0) 553 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:56:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:46.896152+0000 mon.smithi008 (mon.0) 554 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:56:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:56:46.895262+0000 mgr.smithi008.flmjzp (mgr.14164) 240 : cephadm [INF] Upgrade: Target is version 16.2.14-100-gb4ddd52c (pacific) 2023-10-18T20:56:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:56:46.895340+0000 mgr.smithi008.flmjzp (mgr.14164) 241 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc'] 2023-10-18T20:56:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:56:46.897213+0000 mgr.smithi008.flmjzp (mgr.14164) 242 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi008.flmjzp) 2023-10-18T20:56:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:56:47.242323+0000 mgr.smithi008.flmjzp (mgr.14164) 243 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc on smithi060 2023-10-18T20:56:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:56:46.895262+0000 mgr.smithi008.flmjzp (mgr.14164) 240 : cephadm [INF] Upgrade: Target is version 16.2.14-100-gb4ddd52c (pacific) 2023-10-18T20:56:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:56:46.895340+0000 mgr.smithi008.flmjzp (mgr.14164) 241 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc'] 2023-10-18T20:56:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:56:46.897213+0000 mgr.smithi008.flmjzp (mgr.14164) 242 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi008.flmjzp) 2023-10-18T20:56:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:56:47.242323+0000 mgr.smithi008.flmjzp (mgr.14164) 243 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc on smithi060 2023-10-18T20:56:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:48.133484+0000 mgr.smithi008.flmjzp (mgr.14164) 244 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:56:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:48.133484+0000 mgr.smithi008.flmjzp (mgr.14164) 244 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 9.0 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:56:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:50.133988+0000 mgr.smithi008.flmjzp (mgr.14164) 245 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2023-10-18T20:56:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:50.133988+0000 mgr.smithi008.flmjzp (mgr.14164) 245 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2023-10-18T20:56:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:52.134433+0000 mgr.smithi008.flmjzp (mgr.14164) 246 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-10-18T20:56:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:52.134433+0000 mgr.smithi008.flmjzp (mgr.14164) 246 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-10-18T20:56:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:54.134954+0000 mgr.smithi008.flmjzp (mgr.14164) 247 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-10-18T20:56:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:54.134954+0000 mgr.smithi008.flmjzp (mgr.14164) 247 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-10-18T20:56:55.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.513+0000 7f7f3cc57700 1 -- 172.21.15.8:0/3884194123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f380f96d0 msgr2=0x7f7f380fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.513+0000 7f7f3cc57700 1 --2- 172.21.15.8:0/3884194123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f380f96d0 0x7f7f380fbae0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f7f2c004660 tx=0x7f7f2c009b30).stop 2023-10-18T20:56:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.513+0000 7f7f3cc57700 1 -- 172.21.15.8:0/3884194123 shutdown_connections 2023-10-18T20:56:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.513+0000 7f7f3cc57700 1 --2- 172.21.15.8:0/3884194123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f380f96d0 0x7f7f380fbae0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.513+0000 7f7f3cc57700 1 --2- 172.21.15.8:0/3884194123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f380602d0 0x7f7f380f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.513+0000 7f7f3cc57700 1 -- 172.21.15.8:0/3884194123 >> 172.21.15.8:0/3884194123 conn(0x7f7f380f0b90 msgr2=0x7f7f380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.513+0000 7f7f3cc57700 1 -- 172.21.15.8:0/3884194123 shutdown_connections 2023-10-18T20:56:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.513+0000 7f7f3cc57700 1 -- 172.21.15.8:0/3884194123 wait complete. 2023-10-18T20:56:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.514+0000 7f7f3cc57700 1 Processor -- start 2023-10-18T20:56:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.515+0000 7f7f3cc57700 1 -- start start 2023-10-18T20:56:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.515+0000 7f7f3cc57700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f380602d0 0x7f7f380f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.515+0000 7f7f3cc57700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f380f96d0 0x7f7f380f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.515+0000 7f7f3cc57700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380f55b0 con 0x7f7f380602d0 2023-10-18T20:56:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.515+0000 7f7f3cc57700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380f56f0 con 0x7f7f380f96d0 2023-10-18T20:56:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.516+0000 7f7f377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f380602d0 0x7f7f380f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:55.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.516+0000 7f7f377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f380602d0 0x7f7f380f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55186/0 (socket says 172.21.15.8:55186) 2023-10-18T20:56:55.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.516+0000 7f7f377fe700 1 -- 172.21.15.8:0/615662076 learned_addr learned my addr 172.21.15.8:0/615662076 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:55.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.516+0000 7f7f36ffd700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f380f96d0 0x7f7f380f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:55.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.516+0000 7f7f377fe700 1 -- 172.21.15.8:0/615662076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f380f96d0 msgr2=0x7f7f380f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:55.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.516+0000 7f7f377fe700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f380f96d0 0x7f7f380f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:55.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.516+0000 7f7f377fe700 1 -- 172.21.15.8:0/615662076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c005040 con 0x7f7f380602d0 2023-10-18T20:56:55.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.516+0000 7f7f377fe700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f380602d0 0x7f7f380f6bd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f7f280026d0 tx=0x7f7f28009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:55.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.517+0000 7f7f1ffff700 1 -- 172.21.15.8:0/615662076 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f28009320 con 0x7f7f380602d0 2023-10-18T20:56:55.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.517+0000 7f7f1ffff700 1 -- 172.21.15.8:0/615662076 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7f2800f040 con 0x7f7f380602d0 2023-10-18T20:56:55.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.517+0000 7f7f3cc57700 1 -- 172.21.15.8:0/615662076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f380f59d0 con 0x7f7f380602d0 2023-10-18T20:56:55.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.517+0000 7f7f1ffff700 1 -- 172.21.15.8:0/615662076 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f28014970 con 0x7f7f380602d0 2023-10-18T20:56:55.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.517+0000 7f7f3cc57700 1 -- 172.21.15.8:0/615662076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3810edd0 con 0x7f7f380602d0 2023-10-18T20:56:55.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.518+0000 7f7f3cc57700 1 -- 172.21.15.8:0/615662076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f38045ad0 con 0x7f7f380602d0 2023-10-18T20:56:55.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.519+0000 7f7f1ffff700 1 -- 172.21.15.8:0/615662076 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7f2801b060 con 0x7f7f380602d0 2023-10-18T20:56:55.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.521+0000 7f7f1ffff700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7f2005c2f0 0x7f7f2005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:55.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.521+0000 7f7f1ffff700 1 -- 172.21.15.8:0/615662076 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7f28075e20 con 0x7f7f380602d0 2023-10-18T20:56:55.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.522+0000 7f7f36ffd700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7f2005c2f0 0x7f7f2005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:55.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.522+0000 7f7f36ffd700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7f2005c2f0 0x7f7f2005e7b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f7f2c004e30 tx=0x7f7f2c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:55.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.525+0000 7f7f1ffff700 1 -- 172.21.15.8:0/615662076 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7f28048aa0 con 0x7f7f380602d0 2023-10-18T20:56:55.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.764+0000 7f7f3cc57700 1 -- 172.21.15.8:0/615662076 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f380fee50 con 0x7f7f2005c2f0 2023-10-18T20:56:55.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.766+0000 7f7f1ffff700 1 -- 172.21.15.8:0/615662076 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7f7f380fee50 con 0x7f7f2005c2f0 2023-10-18T20:56:55.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.767+0000 7f7f3cc57700 1 -- 172.21.15.8:0/615662076 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7f2005c2f0 msgr2=0x7f7f2005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:55.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.767+0000 7f7f3cc57700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7f2005c2f0 0x7f7f2005e7b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f7f2c004e30 tx=0x7f7f2c009b30).stop 2023-10-18T20:56:55.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.767+0000 7f7f3cc57700 1 -- 172.21.15.8:0/615662076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f380602d0 msgr2=0x7f7f380f6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:55.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.767+0000 7f7f3cc57700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f380602d0 0x7f7f380f6bd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f7f280026d0 tx=0x7f7f28009de0).stop 2023-10-18T20:56:55.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.768+0000 7f7f3cc57700 1 -- 172.21.15.8:0/615662076 shutdown_connections 2023-10-18T20:56:55.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.768+0000 7f7f3cc57700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f380602d0 0x7f7f380f6bd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:55.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.768+0000 7f7f3cc57700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f7f2005c2f0 0x7f7f2005e7b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:55.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.768+0000 7f7f3cc57700 1 --2- 172.21.15.8:0/615662076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f380f96d0 0x7f7f380f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:55.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.768+0000 7f7f3cc57700 1 -- 172.21.15.8:0/615662076 >> 172.21.15.8:0/615662076 conn(0x7f7f380f0b90 msgr2=0x7f7f380f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:55.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.768+0000 7f7f3cc57700 1 -- 172.21.15.8:0/615662076 shutdown_connections 2023-10-18T20:56:55.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.768+0000 7f7f3cc57700 1 -- 172.21.15.8:0/615662076 wait complete. 2023-10-18T20:56:55.791 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T20:56:55.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.920+0000 7f6f324f9700 1 -- 172.21.15.8:0/3646658634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f2c0f77d0 msgr2=0x7f6f2c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:55.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.920+0000 7f6f324f9700 1 --2- 172.21.15.8:0/3646658634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f2c0f77d0 0x7f6f2c0f7c30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f6f1c004660 tx=0x7f6f1c009b30).stop 2023-10-18T20:56:55.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.920+0000 7f6f324f9700 1 -- 172.21.15.8:0/3646658634 shutdown_connections 2023-10-18T20:56:55.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.920+0000 7f6f324f9700 1 --2- 172.21.15.8:0/3646658634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f2c0f77d0 0x7f6f2c0f7c30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:55.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.920+0000 7f6f324f9700 1 --2- 172.21.15.8:0/3646658634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f2c0f6530 0x7f6f2c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:55.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.920+0000 7f6f324f9700 1 -- 172.21.15.8:0/3646658634 >> 172.21.15.8:0/3646658634 conn(0x7f6f2c0f1c90 msgr2=0x7f6f2c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:55.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.920+0000 7f6f324f9700 1 -- 172.21.15.8:0/3646658634 shutdown_connections 2023-10-18T20:56:55.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.920+0000 7f6f324f9700 1 -- 172.21.15.8:0/3646658634 wait complete. 2023-10-18T20:56:55.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.921+0000 7f6f324f9700 1 Processor -- start 2023-10-18T20:56:55.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.921+0000 7f6f324f9700 1 -- start start 2023-10-18T20:56:55.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.921+0000 7f6f324f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f2c0f6530 0x7f6f2c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:55.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.921+0000 7f6f324f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f2c0f77d0 0x7f6f2c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:55.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.921+0000 7f6f324f9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c107880 con 0x7f6f2c0f6530 2023-10-18T20:56:55.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.921+0000 7f6f324f9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c1080c0 con 0x7f6f2c0f77d0 2023-10-18T20:56:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.921+0000 7f6f314f7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f2c0f6530 0x7f6f2c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.921+0000 7f6f314f7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f2c0f6530 0x7f6f2c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55200/0 (socket says 172.21.15.8:55200) 2023-10-18T20:56:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.921+0000 7f6f314f7700 1 -- 172.21.15.8:0/24923446 learned_addr learned my addr 172.21.15.8:0/24923446 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.922+0000 7f6f30cf6700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f2c0f77d0 0x7f6f2c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.922+0000 7f6f314f7700 1 -- 172.21.15.8:0/24923446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f2c0f77d0 msgr2=0x7f6f2c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.922+0000 7f6f314f7700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f2c0f77d0 0x7f6f2c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.922+0000 7f6f314f7700 1 -- 172.21.15.8:0/24923446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c005040 con 0x7f6f2c0f6530 2023-10-18T20:56:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.922+0000 7f6f30cf6700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f2c0f77d0 0x7f6f2c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T20:56:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.922+0000 7f6f314f7700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f2c0f6530 0x7f6f2c106d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f6f28002700 tx=0x7f6f28009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.922+0000 7f6f21ffb700 1 -- 172.21.15.8:0/24923446 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f28009320 con 0x7f6f2c0f6530 2023-10-18T20:56:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.922+0000 7f6f21ffb700 1 -- 172.21.15.8:0/24923446 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6f2800f040 con 0x7f6f2c0f6530 2023-10-18T20:56:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.922+0000 7f6f324f9700 1 -- 172.21.15.8:0/24923446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2c1083a0 con 0x7f6f2c0f6530 2023-10-18T20:56:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.922+0000 7f6f21ffb700 1 -- 172.21.15.8:0/24923446 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f28014970 con 0x7f6f2c0f6530 2023-10-18T20:56:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.923+0000 7f6f324f9700 1 -- 172.21.15.8:0/24923446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c1088e0 con 0x7f6f2c0f6530 2023-10-18T20:56:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.924+0000 7f6f324f9700 1 -- 172.21.15.8:0/24923446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c059100 con 0x7f6f2c0f6530 2023-10-18T20:56:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.924+0000 7f6f21ffb700 1 -- 172.21.15.8:0/24923446 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6f280077b0 con 0x7f6f2c0f6530 2023-10-18T20:56:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.925+0000 7f6f21ffb700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6f1805c2f0 0x7f6f1805e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.925+0000 7f6f21ffb700 1 -- 172.21.15.8:0/24923446 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f6f28076220 con 0x7f6f2c0f6530 2023-10-18T20:56:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.925+0000 7f6f30cf6700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6f1805c2f0 0x7f6f1805e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.926+0000 7f6f30cf6700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6f1805c2f0 0x7f6f1805e7b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f6f1c005010 tx=0x7f6f1c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:55.929+0000 7f6f21ffb700 1 -- 172.21.15.8:0/24923446 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6f28048e20 con 0x7f6f2c0f6530 2023-10-18T20:56:56.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.129+0000 7f6f324f9700 1 -- 172.21.15.8:0/24923446 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f2c0fedd0 con 0x7f6f1805c2f0 2023-10-18T20:56:56.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.131+0000 7f6f21ffb700 1 -- 172.21.15.8:0/24923446 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7f6f2c0fedd0 con 0x7f6f1805c2f0 2023-10-18T20:56:56.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.133+0000 7f6f324f9700 1 -- 172.21.15.8:0/24923446 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6f1805c2f0 msgr2=0x7f6f1805e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:56.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.133+0000 7f6f324f9700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6f1805c2f0 0x7f6f1805e7b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f6f1c005010 tx=0x7f6f1c009b30).stop 2023-10-18T20:56:56.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.133+0000 7f6f324f9700 1 -- 172.21.15.8:0/24923446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f2c0f6530 msgr2=0x7f6f2c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:56.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.133+0000 7f6f324f9700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f2c0f6530 0x7f6f2c106d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f6f28002700 tx=0x7f6f28009d80).stop 2023-10-18T20:56:56.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.133+0000 7f6f324f9700 1 -- 172.21.15.8:0/24923446 shutdown_connections 2023-10-18T20:56:56.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.133+0000 7f6f324f9700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f2c0f6530 0x7f6f2c106d90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.133+0000 7f6f324f9700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f6f1805c2f0 0x7f6f1805e7b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.133+0000 7f6f324f9700 1 --2- 172.21.15.8:0/24923446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f2c0f77d0 0x7f6f2c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.133+0000 7f6f324f9700 1 -- 172.21.15.8:0/24923446 >> 172.21.15.8:0/24923446 conn(0x7f6f2c0f1c90 msgr2=0x7f6f2c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:56.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.133+0000 7f6f324f9700 1 -- 172.21.15.8:0/24923446 shutdown_connections 2023-10-18T20:56:56.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.134+0000 7f6f324f9700 1 -- 172.21.15.8:0/24923446 wait complete. 2023-10-18T20:56:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.300+0000 7f8aa27a2700 1 -- 172.21.15.8:0/3650417959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0f77d0 msgr2=0x7f8a9c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.300+0000 7f8aa27a2700 1 --2- 172.21.15.8:0/3650417959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0f77d0 0x7f8a9c0f7c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8a8c004660 tx=0x7f8a8c009b30).stop 2023-10-18T20:56:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.300+0000 7f8aa27a2700 1 -- 172.21.15.8:0/3650417959 shutdown_connections 2023-10-18T20:56:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.300+0000 7f8aa27a2700 1 --2- 172.21.15.8:0/3650417959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0f77d0 0x7f8a9c0f7c30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.300+0000 7f8aa27a2700 1 --2- 172.21.15.8:0/3650417959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a9c0f6530 0x7f8a9c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:56:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.300+0000 7f8aa27a2700 1 -- 172.21.15.8:0/3650417959 >> 172.21.15.8:0/3650417959 conn(0x7f8a9c0f1c90 msgr2=0x7f8a9c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.301+0000 7f8aa27a2700 1 -- 172.21.15.8:0/3650417959 shutdown_connections 2023-10-18T20:56:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.301+0000 7f8aa27a2700 1 -- 172.21.15.8:0/3650417959 wait complete. 2023-10-18T20:56:56.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.302+0000 7f8aa27a2700 1 Processor -- start 2023-10-18T20:56:56.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.302+0000 7f8aa27a2700 1 -- start start 2023-10-18T20:56:56.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.302+0000 7f8aa27a2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a9c0f6530 0x7f8a9c108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:56.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.302+0000 7f8aa27a2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0f77d0 0x7f8a9c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:56.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.302+0000 7f8aa27a2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c109b00 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.302+0000 7f8aa27a2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c10a3b0 con 0x7f8a9c0f6530 2023-10-18T20:56:56.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.303+0000 7f8aa0f9f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0f77d0 0x7f8a9c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:56.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.303+0000 7f8aa0f9f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0f77d0 0x7f8a9c1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55220/0 (socket says 172.21.15.8:55220) 2023-10-18T20:56:56.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.303+0000 7f8aa0f9f700 1 -- 172.21.15.8:0/2124863625 learned_addr learned my addr 172.21.15.8:0/2124863625 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:56.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.303+0000 7f8aa17a0700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a9c0f6530 0x7f8a9c108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:56.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.304+0000 7f8aa0f9f700 1 -- 172.21.15.8:0/2124863625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a9c0f6530 msgr2=0x7f8a9c108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:56.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.304+0000 7f8aa0f9f700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a9c0f6530 0x7f8a9c108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.304+0000 7f8aa0f9f700 1 -- 172.21.15.8:0/2124863625 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c005040 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.304+0000 7f8aa0f9f700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0f77d0 0x7f8a9c1094c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f8a8c009830 tx=0x7f8a8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:56.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.304+0000 7f8a91ffb700 1 -- 172.21.15.8:0/2124863625 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a8c018070 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.304+0000 7f8a91ffb700 1 -- 172.21.15.8:0/2124863625 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8a8c01d8e0 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.304+0000 7f8aa27a2700 1 -- 172.21.15.8:0/2124863625 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c10a630 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.304+0000 7f8a91ffb700 1 -- 172.21.15.8:0/2124863625 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a8c01c540 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.304+0000 7f8aa27a2700 1 -- 172.21.15.8:0/2124863625 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c10ab90 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.306+0000 7f8a877fe700 1 -- 172.21.15.8:0/2124863625 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a74004fa0 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.308+0000 7f8a91ffb700 1 -- 172.21.15.8:0/2124863625 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8a8c01da50 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.310+0000 7f8a91ffb700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a8805c300 0x7f8a8805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:56.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.310+0000 7f8a91ffb700 1 -- 172.21.15.8:0/2124863625 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8a8c0780a0 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.310+0000 7f8aa17a0700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a8805c300 0x7f8a8805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:56.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.311+0000 7f8aa17a0700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a8805c300 0x7f8a8805e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f8a9c0f7630 tx=0x7f8a98008040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:56.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.311+0000 7f8a91ffb700 1 -- 172.21.15.8:0/2124863625 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8a8c04ad90 con 0x7f8a9c0f77d0 2023-10-18T20:56:56.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.517+0000 7f8a877fe700 1 -- 172.21.15.8:0/2124863625 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a74000b90 con 0x7f8a8805c300 2023-10-18T20:56:56.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.525+0000 7f8a91ffb700 1 -- 172.21.15.8:0/2124863625 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2684 (secure 0 0 0) 0x7f8a74000b90 con 0x7f8a8805c300 2023-10-18T20:56:56.528 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2023-10-18T20:56:56.528 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (3m) 50s ago 5m 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T20:56:56.529 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (5m) 50s ago 5m 16.2.4 8d91d370c2b8 4b2c6838af84 2023-10-18T20:56:56.529 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (4m) 53s ago 4m 16.2.4 8d91d370c2b8 67dc04156fe1 2023-10-18T20:56:56.529 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (3m) 50s ago 4m 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T20:56:56.529 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (67s) 50s ago 67s 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T20:56:56.529 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (62s) 50s ago 62s 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T20:56:56.530 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (65s) 53s ago 64s 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T20:56:56.530 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (60s) 53s ago 59s 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T20:56:56.530 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:9283 running (6m) 50s ago 6m 16.2.4 8d91d370c2b8 ee1a6b0bd8ee 2023-10-18T20:56:56.530 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (4m) 53s ago 4m 16.2.4 8d91d370c2b8 b685ab58431c 2023-10-18T20:56:56.531 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (6m) 50s ago 6m 16.2.4 8d91d370c2b8 9de89e6e28e5 2023-10-18T20:56:56.531 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (4m) 53s ago 4m 16.2.4 8d91d370c2b8 d7c00f2c13a4 2023-10-18T20:56:56.531 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (4m) 50s ago 4m 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T20:56:56.531 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (3m) 53s ago 3m 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T20:56:56.531 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (3m) 50s ago 3m 16.2.4 8d91d370c2b8 885270808f90 2023-10-18T20:56:56.532 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (3m) 50s ago 3m 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T20:56:56.532 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (3m) 50s ago 3m 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T20:56:56.532 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (2m) 53s ago 2m 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T20:56:56.532 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (2m) 53s ago 2m 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T20:56:56.532 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (2m) 53s ago 2m 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T20:56:56.533 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (3m) 50s ago 4m 2.18.1 de242295e225 0af47d38e46d 2023-10-18T20:56:56.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.528+0000 7f8a877fe700 1 -- 172.21.15.8:0/2124863625 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a8805c300 msgr2=0x7f8a8805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:56.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.528+0000 7f8a877fe700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a8805c300 0x7f8a8805e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f8a9c0f7630 tx=0x7f8a98008040).stop 2023-10-18T20:56:56.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.528+0000 7f8a877fe700 1 -- 172.21.15.8:0/2124863625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0f77d0 msgr2=0x7f8a9c1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:56.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.528+0000 7f8a877fe700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0f77d0 0x7f8a9c1094c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f8a8c009830 tx=0x7f8a8c009b30).stop 2023-10-18T20:56:56.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.528+0000 7f8a877fe700 1 -- 172.21.15.8:0/2124863625 shutdown_connections 2023-10-18T20:56:56.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.528+0000 7f8a877fe700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f8a8805c300 0x7f8a8805e7c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.528+0000 7f8a877fe700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a9c0f6530 0x7f8a9c108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.528+0000 7f8a877fe700 1 --2- 172.21.15.8:0/2124863625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0f77d0 0x7f8a9c1094c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.528+0000 7f8a877fe700 1 -- 172.21.15.8:0/2124863625 >> 172.21.15.8:0/2124863625 conn(0x7f8a9c0f1c90 msgr2=0x7f8a9c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:56.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.528+0000 7f8a877fe700 1 -- 172.21.15.8:0/2124863625 shutdown_connections 2023-10-18T20:56:56.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.529+0000 7f8a877fe700 1 -- 172.21.15.8:0/2124863625 wait complete. 2023-10-18T20:56:56.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.689+0000 7f3969b56700 1 -- 172.21.15.8:0/1244647466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39640f77d0 msgr2=0x7f39640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:56.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.689+0000 7f3969b56700 1 --2- 172.21.15.8:0/1244647466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39640f77d0 0x7f39640f7c30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f3950004660 tx=0x7f3950009b30).stop 2023-10-18T20:56:56.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.689+0000 7f3969b56700 1 -- 172.21.15.8:0/1244647466 shutdown_connections 2023-10-18T20:56:56.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.689+0000 7f3969b56700 1 --2- 172.21.15.8:0/1244647466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39640f77d0 0x7f39640f7c30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.689+0000 7f3969b56700 1 --2- 172.21.15.8:0/1244647466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39640f6530 0x7f39640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.689+0000 7f3969b56700 1 -- 172.21.15.8:0/1244647466 >> 172.21.15.8:0/1244647466 conn(0x7f39640f1c90 msgr2=0x7f39640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:56.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.689+0000 7f3969b56700 1 -- 172.21.15.8:0/1244647466 shutdown_connections 2023-10-18T20:56:56.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.689+0000 7f3969b56700 1 -- 172.21.15.8:0/1244647466 wait complete. 2023-10-18T20:56:56.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.690+0000 7f3969b56700 1 Processor -- start 2023-10-18T20:56:56.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.690+0000 7f3969b56700 1 -- start start 2023-10-18T20:56:56.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.691+0000 7f3969b56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39640f6530 0x7f3964108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:56.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.691+0000 7f3969b56700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39640f77d0 0x7f3964109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:56.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.691+0000 7f3969b56700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39641099b0 con 0x7f39640f77d0 2023-10-18T20:56:56.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.691+0000 7f3969b56700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3964109af0 con 0x7f39640f6530 2023-10-18T20:56:56.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.691+0000 7f3963fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39640f77d0 0x7f3964109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:56.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.691+0000 7f3968b54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39640f6530 0x7f3964108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:56.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.691+0000 7f3968b54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39640f6530 0x7f3964108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:58918/0 (socket says 172.21.15.8:58918) 2023-10-18T20:56:56.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.691+0000 7f3963fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39640f77d0 0x7f3964109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55242/0 (socket says 172.21.15.8:55242) 2023-10-18T20:56:56.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.691+0000 7f3968b54700 1 -- 172.21.15.8:0/69857071 learned_addr learned my addr 172.21.15.8:0/69857071 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:56.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.692+0000 7f3963fff700 1 -- 172.21.15.8:0/69857071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39640f6530 msgr2=0x7f3964108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:56.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.692+0000 7f3963fff700 1 --2- 172.21.15.8:0/69857071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39640f6530 0x7f3964108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:56.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.692+0000 7f3963fff700 1 -- 172.21.15.8:0/69857071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950005040 con 0x7f39640f77d0 2023-10-18T20:56:56.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.692+0000 7f3963fff700 1 --2- 172.21.15.8:0/69857071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39640f77d0 0x7f3964109400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f3950000c00 tx=0x7f3950009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:56.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.692+0000 7f39617fa700 1 -- 172.21.15.8:0/69857071 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3950018070 con 0x7f39640f77d0 2023-10-18T20:56:56.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.692+0000 7f39617fa700 1 -- 172.21.15.8:0/69857071 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3950009630 con 0x7f39640f77d0 2023-10-18T20:56:56.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.692+0000 7f3969b56700 1 -- 172.21.15.8:0/69857071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396410a430 con 0x7f39640f77d0 2023-10-18T20:56:56.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.692+0000 7f39617fa700 1 -- 172.21.15.8:0/69857071 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395001c3c0 con 0x7f39640f77d0 2023-10-18T20:56:56.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.693+0000 7f3969b56700 1 -- 172.21.15.8:0/69857071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396410a990 con 0x7f39640f77d0 2023-10-18T20:56:56.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.694+0000 7f3969b56700 1 -- 172.21.15.8:0/69857071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3964045ad0 con 0x7f39640f77d0 2023-10-18T20:56:56.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.695+0000 7f39617fa700 1 -- 172.21.15.8:0/69857071 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f395001c640 con 0x7f39640f77d0 2023-10-18T20:56:56.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.696+0000 7f39617fa700 1 --2- 172.21.15.8:0/69857071 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f395405c2f0 0x7f395405e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:56.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.696+0000 7f39617fa700 1 -- 172.21.15.8:0/69857071 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3950077bd0 con 0x7f39640f77d0 2023-10-18T20:56:56.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.697+0000 7f3968b54700 1 --2- 172.21.15.8:0/69857071 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f395405c2f0 0x7f395405e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:56.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.697+0000 7f3968b54700 1 --2- 172.21.15.8:0/69857071 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f395405c2f0 0x7f395405e7b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f3958004d00 tx=0x7f395800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:56.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:56.700+0000 7f39617fa700 1 -- 172.21.15.8:0/69857071 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f395004a810 con 0x7f39640f77d0 2023-10-18T20:56:57.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.038+0000 7f3969b56700 1 -- 172.21.15.8:0/69857071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f39640fecc0 con 0x7f39640f77d0 2023-10-18T20:56:57.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.039+0000 7f39617fa700 1 -- 172.21.15.8:0/69857071 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7f395004de30 con 0x7f39640f77d0 2023-10-18T20:56:57.042 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:56:57.042 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T20:56:57.043 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T20:56:57.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:56:57.043 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T20:56:57.043 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T20:56:57.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:56:57.044 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T20:56:57.044 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-10-18T20:56:57.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:56:57.044 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T20:56:57.044 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T20:56:57.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:56:57.045 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T20:56:57.045 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2023-10-18T20:56:57.045 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T20:56:57.045 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:56:57.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 -- 172.21.15.8:0/69857071 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f395405c2f0 msgr2=0x7f395405e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:57.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 --2- 172.21.15.8:0/69857071 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f395405c2f0 0x7f395405e7b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f3958004d00 tx=0x7f395800b040).stop 2023-10-18T20:56:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 -- 172.21.15.8:0/69857071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39640f77d0 msgr2=0x7f3964109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 --2- 172.21.15.8:0/69857071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39640f77d0 0x7f3964109400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f3950000c00 tx=0x7f3950009b30).stop 2023-10-18T20:56:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 -- 172.21.15.8:0/69857071 shutdown_connections 2023-10-18T20:56:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 --2- 172.21.15.8:0/69857071 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f395405c2f0 0x7f395405e7b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 --2- 172.21.15.8:0/69857071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39640f6530 0x7f3964108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 --2- 172.21.15.8:0/69857071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39640f77d0 0x7f3964109400 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 -- 172.21.15.8:0/69857071 >> 172.21.15.8:0/69857071 conn(0x7f39640f1c90 msgr2=0x7f396406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 -- 172.21.15.8:0/69857071 shutdown_connections 2023-10-18T20:56:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.041+0000 7f3969b56700 1 -- 172.21.15.8:0/69857071 wait complete. 2023-10-18T20:56:57.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.215+0000 7ff32a45e700 1 -- 172.21.15.8:0/3188208269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f77d0 msgr2=0x7ff3240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:57.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.215+0000 7ff32a45e700 1 --2- 172.21.15.8:0/3188208269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f77d0 0x7ff3240f7c30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7ff314004660 tx=0x7ff314009b30).stop 2023-10-18T20:56:57.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.215+0000 7ff32a45e700 1 -- 172.21.15.8:0/3188208269 shutdown_connections 2023-10-18T20:56:57.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.215+0000 7ff32a45e700 1 --2- 172.21.15.8:0/3188208269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f77d0 0x7ff3240f7c30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.215+0000 7ff32a45e700 1 --2- 172.21.15.8:0/3188208269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f6530 0x7ff3240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:56:57.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.215+0000 7ff32a45e700 1 -- 172.21.15.8:0/3188208269 >> 172.21.15.8:0/3188208269 conn(0x7ff3240f1cd0 msgr2=0x7ff3240f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:57.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.216+0000 7ff32a45e700 1 -- 172.21.15.8:0/3188208269 shutdown_connections 2023-10-18T20:56:57.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.216+0000 7ff32a45e700 1 -- 172.21.15.8:0/3188208269 wait complete. 2023-10-18T20:56:57.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.216+0000 7ff32a45e700 1 Processor -- start 2023-10-18T20:56:57.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.217+0000 7ff32a45e700 1 -- start start 2023-10-18T20:56:57.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.217+0000 7ff32a45e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f6530 0x7ff32406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:57.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.217+0000 7ff32a45e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f77d0 0x7ff324069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:57.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.217+0000 7ff32a45e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32406a410 con 0x7ff3240f77d0 2023-10-18T20:56:57.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.217+0000 7ff32a45e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32406a550 con 0x7ff3240f6530 2023-10-18T20:56:57.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.218+0000 7ff328c5b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f77d0 0x7ff324069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:57.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.218+0000 7ff328c5b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f77d0 0x7ff324069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40710/0 (socket says 172.21.15.8:40710) 2023-10-18T20:56:57.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.218+0000 7ff328c5b700 1 -- 172.21.15.8:0/548360606 learned_addr learned my addr 172.21.15.8:0/548360606 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:57.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.218+0000 7ff32945c700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f6530 0x7ff32406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:57.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.218+0000 7ff328c5b700 1 -- 172.21.15.8:0/548360606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f6530 msgr2=0x7ff32406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:57.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.218+0000 7ff328c5b700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f6530 0x7ff32406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.218+0000 7ff328c5b700 1 -- 172.21.15.8:0/548360606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314005040 con 0x7ff3240f77d0 2023-10-18T20:56:57.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.218+0000 7ff328c5b700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f77d0 0x7ff324069e20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7ff314009990 tx=0x7ff314009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:57.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.219+0000 7ff319ffb700 1 -- 172.21.15.8:0/548360606 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff314018070 con 0x7ff3240f77d0 2023-10-18T20:56:57.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.219+0000 7ff319ffb700 1 -- 172.21.15.8:0/548360606 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff314009780 con 0x7ff3240f77d0 2023-10-18T20:56:57.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.219+0000 7ff32a45e700 1 -- 172.21.15.8:0/548360606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32406a7d0 con 0x7ff3240f77d0 2023-10-18T20:56:57.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.219+0000 7ff319ffb700 1 -- 172.21.15.8:0/548360606 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff31401c5a0 con 0x7ff3240f77d0 2023-10-18T20:56:57.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.219+0000 7ff32a45e700 1 -- 172.21.15.8:0/548360606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32410ed80 con 0x7ff3240f77d0 2023-10-18T20:56:57.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.220+0000 7ff32a45e700 1 -- 172.21.15.8:0/548360606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff324045ad0 con 0x7ff3240f77d0 2023-10-18T20:56:57.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.224+0000 7ff319ffb700 1 -- 172.21.15.8:0/548360606 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff31401db30 con 0x7ff3240f77d0 2023-10-18T20:56:57.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.225+0000 7ff319ffb700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff31005c2f0 0x7ff31005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:57.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.225+0000 7ff319ffb700 1 -- 172.21.15.8:0/548360606 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff3140784c0 con 0x7ff3240f77d0 2023-10-18T20:56:57.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.225+0000 7ff32945c700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff31005c2f0 0x7ff31005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:57.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.226+0000 7ff319ffb700 1 -- 172.21.15.8:0/548360606 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff31404b1b0 con 0x7ff3240f77d0 2023-10-18T20:56:57.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.226+0000 7ff32945c700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff31005c2f0 0x7ff31005e7b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff32406b730 tx=0x7ff320008040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:55.766859+0000 mgr.smithi008.flmjzp (mgr.14164) 248 : audit [DBG] from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:56.132480+0000 mgr.smithi008.flmjzp (mgr.14164) 249 : audit [DBG] from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:57.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:56.135443+0000 mgr.smithi008.flmjzp (mgr.14164) 250 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2023-10-18T20:56:57.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:57.040343+0000 mon.smithi008 (mon.0) 555 : audit [DBG] from='client.? 172.21.15.8:0/69857071' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:56:57.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.526+0000 7ff32a45e700 1 -- 172.21.15.8:0/548360606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff3240fed60 con 0x7ff3240f77d0 2023-10-18T20:56:57.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.526+0000 7ff319ffb700 1 -- 172.21.15.8:0/548360606 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1613 (secure 0 0 0) 0x7ff31404e7d0 con 0x7ff3240f77d0 2023-10-18T20:56:57.530 INFO:teuthology.orchestra.run.smithi008.stdout:e15 2023-10-18T20:56:57.530 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:56:57.530 INFO:teuthology.orchestra.run.smithi008.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:56:57.531 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T20:56:57.531 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:56:57.531 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T20:56:57.531 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T20:56:57.531 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 15 2023-10-18T20:56:57.532 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T20:56:57.532 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:56:57.532 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:56:04.757749+0000 2023-10-18T20:56:57.532 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T20:56:57.532 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T20:56:57.533 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T20:56:57.533 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T20:56:57.533 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T20:56:57.533 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T20:56:57.533 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T20:56:57.534 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T20:56:57.534 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:56:57.534 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T20:56:57.534 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T20:56:57.534 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T20:56:57.535 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T20:56:57.535 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T20:56:57.535 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T20:56:57.535 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T20:56:57.536 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T20:56:57.537 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T20:56:57.538 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T20:56:57.538 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T20:56:57.538 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015]] 2023-10-18T20:56:57.539 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531]] 2023-10-18T20:56:57.539 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145]] 2023-10-18T20:56:57.540 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799]] 2023-10-18T20:56:57.540 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:56:57.540 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:56:57.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.529+0000 7ff32a45e700 1 -- 172.21.15.8:0/548360606 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff31005c2f0 msgr2=0x7ff31005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:57.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.529+0000 7ff32a45e700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff31005c2f0 0x7ff31005e7b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff32406b730 tx=0x7ff320008040).stop 2023-10-18T20:56:57.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.529+0000 7ff32a45e700 1 -- 172.21.15.8:0/548360606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f77d0 msgr2=0x7ff324069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:57.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.529+0000 7ff32a45e700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f77d0 0x7ff324069e20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7ff314009990 tx=0x7ff314009b30).stop 2023-10-18T20:56:57.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.529+0000 7ff32a45e700 1 -- 172.21.15.8:0/548360606 shutdown_connections 2023-10-18T20:56:57.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.529+0000 7ff32a45e700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7ff31005c2f0 0x7ff31005e7b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.529+0000 7ff32a45e700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f6530 0x7ff32406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.529+0000 7ff32a45e700 1 --2- 172.21.15.8:0/548360606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f77d0 0x7ff324069e20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.529+0000 7ff32a45e700 1 -- 172.21.15.8:0/548360606 >> 172.21.15.8:0/548360606 conn(0x7ff3240f1cd0 msgr2=0x7ff3240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:57.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.530+0000 7ff32a45e700 1 -- 172.21.15.8:0/548360606 shutdown_connections 2023-10-18T20:56:57.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.530+0000 7ff32a45e700 1 -- 172.21.15.8:0/548360606 wait complete. 2023-10-18T20:56:57.545 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2023-10-18T20:56:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:55.766859+0000 mgr.smithi008.flmjzp (mgr.14164) 248 : audit [DBG] from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:56.132480+0000 mgr.smithi008.flmjzp (mgr.14164) 249 : audit [DBG] from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:56.135443+0000 mgr.smithi008.flmjzp (mgr.14164) 250 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2023-10-18T20:56:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:57.040343+0000 mon.smithi008 (mon.0) 555 : audit [DBG] from='client.? 172.21.15.8:0/69857071' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:56:57.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.679+0000 7f2291db7700 1 -- 172.21.15.8:0/3797985832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c0f77d0 msgr2=0x7f228c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:57.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.679+0000 7f2291db7700 1 --2- 172.21.15.8:0/3797985832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c0f77d0 0x7f228c0f7c30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f2278004660 tx=0x7f2278009b30).stop 2023-10-18T20:56:57.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.679+0000 7f2291db7700 1 -- 172.21.15.8:0/3797985832 shutdown_connections 2023-10-18T20:56:57.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.679+0000 7f2291db7700 1 --2- 172.21.15.8:0/3797985832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c0f77d0 0x7f228c0f7c30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.679+0000 7f2291db7700 1 --2- 172.21.15.8:0/3797985832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c0f6530 0x7f228c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.679+0000 7f2291db7700 1 -- 172.21.15.8:0/3797985832 >> 172.21.15.8:0/3797985832 conn(0x7f228c0f1c90 msgr2=0x7f228c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:57.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.679+0000 7f2291db7700 1 -- 172.21.15.8:0/3797985832 shutdown_connections 2023-10-18T20:56:57.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.679+0000 7f2291db7700 1 -- 172.21.15.8:0/3797985832 wait complete. 2023-10-18T20:56:57.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.680+0000 7f2291db7700 1 Processor -- start 2023-10-18T20:56:57.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.681+0000 7f2291db7700 1 -- start start 2023-10-18T20:56:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.681+0000 7f2291db7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c0f6530 0x7f228c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.681+0000 7f2291db7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c0f77d0 0x7f228c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.681+0000 7f2291db7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c109a20 con 0x7f228c0f6530 2023-10-18T20:56:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.681+0000 7f2291db7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c109b60 con 0x7f228c0f77d0 2023-10-18T20:56:57.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.682+0000 7f228bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c0f77d0 0x7f228c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:57.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.682+0000 7f2290db5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c0f6530 0x7f228c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:57.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.682+0000 7f228bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c0f77d0 0x7f228c109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:57872/0 (socket says 172.21.15.8:57872) 2023-10-18T20:56:57.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.682+0000 7f228bfff700 1 -- 172.21.15.8:0/2080638487 learned_addr learned my addr 172.21.15.8:0/2080638487 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:56:57.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.682+0000 7f228bfff700 1 -- 172.21.15.8:0/2080638487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c0f6530 msgr2=0x7f228c108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:57.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.682+0000 7f228bfff700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c0f6530 0x7f228c108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.682+0000 7f228bfff700 1 -- 172.21.15.8:0/2080638487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278005040 con 0x7f228c0f77d0 2023-10-18T20:56:57.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.682+0000 7f2290db5700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c0f6530 0x7f228c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T20:56:57.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.682+0000 7f228bfff700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c0f77d0 0x7f228c109470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2278009990 tx=0x7f2278009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:57.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.683+0000 7f22897fa700 1 -- 172.21.15.8:0/2080638487 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2278018070 con 0x7f228c0f77d0 2023-10-18T20:56:57.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.683+0000 7f22897fa700 1 -- 172.21.15.8:0/2080638487 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2278009630 con 0x7f228c0f77d0 2023-10-18T20:56:57.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.683+0000 7f22897fa700 1 -- 172.21.15.8:0/2080638487 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f227801c3c0 con 0x7f228c0f77d0 2023-10-18T20:56:57.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.683+0000 7f2291db7700 1 -- 172.21.15.8:0/2080638487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c10a4a0 con 0x7f228c0f77d0 2023-10-18T20:56:57.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.683+0000 7f2291db7700 1 -- 172.21.15.8:0/2080638487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c10a9b0 con 0x7f228c0f77d0 2023-10-18T20:56:57.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.685+0000 7f2291db7700 1 -- 172.21.15.8:0/2080638487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c045ad0 con 0x7f228c0f77d0 2023-10-18T20:56:57.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.685+0000 7f22897fa700 1 -- 172.21.15.8:0/2080638487 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f227801d970 con 0x7f228c0f77d0 2023-10-18T20:56:57.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.687+0000 7f22897fa700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f227c05c2f0 0x7f227c05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:56:57.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.687+0000 7f22897fa700 1 -- 172.21.15.8:0/2080638487 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f2278077c50 con 0x7f228c0f77d0 2023-10-18T20:56:57.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.687+0000 7f2290db5700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f227c05c2f0 0x7f227c05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:56:57.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.688+0000 7f2290db5700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f227c05c2f0 0x7f227c05e7b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f228c0f7630 tx=0x7f228000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:56:57.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.694+0000 7f22897fa700 1 -- 172.21.15.8:0/2080638487 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f227804a850 con 0x7f228c0f77d0 2023-10-18T20:56:57.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.897+0000 7f2291db7700 1 -- 172.21.15.8:0/2080638487 --> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f228c0fee30 con 0x7f227c05c2f0 2023-10-18T20:56:57.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.898+0000 7f22897fa700 1 -- 172.21.15.8:0/2080638487 <== mgr.14164 v2:172.21.15.8:6800/2622286163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7f228c0fee30 con 0x7f227c05c2f0 2023-10-18T20:56:57.901 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:56:57.901 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T20:56:57.901 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T20:56:57.901 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [], 2023-10-18T20:56:57.901 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "0/21 ceph daemons upgraded", 2023-10-18T20:56:57.902 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc image on host smithi060" 2023-10-18T20:56:57.902 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:56:57.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 -- 172.21.15.8:0/2080638487 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f227c05c2f0 msgr2=0x7f227c05e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:57.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f227c05c2f0 0x7f227c05e7b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f228c0f7630 tx=0x7f228000b040).stop 2023-10-18T20:56:57.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 -- 172.21.15.8:0/2080638487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c0f77d0 msgr2=0x7f228c109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:56:57.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c0f77d0 0x7f228c109470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2278009990 tx=0x7f2278009b30).stop 2023-10-18T20:56:57.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 -- 172.21.15.8:0/2080638487 shutdown_connections 2023-10-18T20:56:57.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f228c0f6530 0x7f228c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.8:6800/2622286163,v1:172.21.15.8:6801/2622286163] conn(0x7f227c05c2f0 0x7f227c05e7b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 --2- 172.21.15.8:0/2080638487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c0f77d0 0x7f228c109470 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:56:57.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 -- 172.21.15.8:0/2080638487 >> 172.21.15.8:0/2080638487 conn(0x7f228c0f1c90 msgr2=0x7f228c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:56:57.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 -- 172.21.15.8:0/2080638487 shutdown_connections 2023-10-18T20:56:57.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:56:57.900+0000 7f2291db7700 1 -- 172.21.15.8:0/2080638487 wait complete. 2023-10-18T20:56:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:56.519524+0000 mgr.smithi008.flmjzp (mgr.14164) 251 : audit [DBG] from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:57.528044+0000 mon.smithi008 (mon.0) 556 : audit [DBG] from='client.? 172.21.15.8:0/548360606' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:56:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:56.519524+0000 mgr.smithi008.flmjzp (mgr.14164) 251 : audit [DBG] from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:57.528044+0000 mon.smithi008 (mon.0) 556 : audit [DBG] from='client.? 172.21.15.8:0/548360606' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:56:59.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:56:57.899253+0000 mgr.smithi008.flmjzp (mgr.14164) 252 : audit [DBG] from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:59.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:56:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:56:58.135885+0000 mgr.smithi008.flmjzp (mgr.14164) 253 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2023-10-18T20:56:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:56:57.899253+0000 mgr.smithi008.flmjzp (mgr.14164) 252 : audit [DBG] from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:56:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:56:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:56:58.135885+0000 mgr.smithi008.flmjzp (mgr.14164) 253 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2023-10-18T20:57:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:00.136409+0000 mgr.smithi008.flmjzp (mgr.14164) 254 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 5 op/s 2023-10-18T20:57:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:00.136409+0000 mgr.smithi008.flmjzp (mgr.14164) 254 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 5 op/s 2023-10-18T20:57:03.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:02.136869+0000 mgr.smithi008.flmjzp (mgr.14164) 255 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2023-10-18T20:57:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:02.136869+0000 mgr.smithi008.flmjzp (mgr.14164) 255 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2023-10-18T20:57:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:04.137390+0000 mgr.smithi008.flmjzp (mgr.14164) 256 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2023-10-18T20:57:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:04.137390+0000 mgr.smithi008.flmjzp (mgr.14164) 256 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2023-10-18T20:57:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:06.137798+0000 mgr.smithi008.flmjzp (mgr.14164) 257 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-10-18T20:57:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:06.137798+0000 mgr.smithi008.flmjzp (mgr.14164) 257 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-10-18T20:57:09.202 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:08.138247+0000 mgr.smithi008.flmjzp (mgr.14164) 258 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:57:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:08.138247+0000 mgr.smithi008.flmjzp (mgr.14164) 258 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:57:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:10.138757+0000 mgr.smithi008.flmjzp (mgr.14164) 259 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:57:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:10.138757+0000 mgr.smithi008.flmjzp (mgr.14164) 259 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:57:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:12.139186+0000 mgr.smithi008.flmjzp (mgr.14164) 260 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:57:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:12.139186+0000 mgr.smithi008.flmjzp (mgr.14164) 260 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:57:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:14.139705+0000 mgr.smithi008.flmjzp (mgr.14164) 261 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:57:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:14.139705+0000 mgr.smithi008.flmjzp (mgr.14164) 261 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:57:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:16.140136+0000 mgr.smithi008.flmjzp (mgr.14164) 262 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T20:57:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:16.140136+0000 mgr.smithi008.flmjzp (mgr.14164) 262 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T20:57:19.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:18.140625+0000 mgr.smithi008.flmjzp (mgr.14164) 263 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:57:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:18.140625+0000 mgr.smithi008.flmjzp (mgr.14164) 263 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:57:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:20.141140+0000 mgr.smithi008.flmjzp (mgr.14164) 264 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:57:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:57:20.263676+0000 mgr.smithi008.flmjzp (mgr.14164) 265 : cephadm [INF] Upgrade: Updating mgr.smithi060.pgqqwa 2023-10-18T20:57:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:20.268085+0000 mon.smithi008 (mon.0) 557 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:57:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:20.268918+0000 mon.smithi008 (mon.0) 558 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.pgqqwa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:57:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:20.269743+0000 mon.smithi008 (mon.0) 559 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:57:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:20.270467+0000 mon.smithi008 (mon.0) 560 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:57:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:57:20.271056+0000 mgr.smithi008.flmjzp (mgr.14164) 266 : cephadm [INF] Deploying daemon mgr.smithi060.pgqqwa on smithi060 2023-10-18T20:57:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:20.141140+0000 mgr.smithi008.flmjzp (mgr.14164) 264 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:57:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:57:20.263676+0000 mgr.smithi008.flmjzp (mgr.14164) 265 : cephadm [INF] Upgrade: Updating mgr.smithi060.pgqqwa 2023-10-18T20:57:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:20.268085+0000 mon.smithi008 (mon.0) 557 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:57:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:20.268918+0000 mon.smithi008 (mon.0) 558 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.pgqqwa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:57:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:20.269743+0000 mon.smithi008 (mon.0) 559 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:57:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:20.270467+0000 mon.smithi008 (mon.0) 560 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:57:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:57:20.271056+0000 mgr.smithi008.flmjzp (mgr.14164) 266 : cephadm [INF] Deploying daemon mgr.smithi060.pgqqwa on smithi060 2023-10-18T20:57:22.591 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:22.264080+0000 mon.smithi008 (mon.0) 561 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:57:22.591 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:22.264406+0000 mon.smithi008 (mon.0) 562 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:57:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:22.264080+0000 mon.smithi008 (mon.0) 561 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:57:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:22.264406+0000 mon.smithi008 (mon.0) 562 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:57:23.423 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:22.141523+0000 mgr.smithi008.flmjzp (mgr.14164) 267 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:57:23.423 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:23.163686+0000 mon.smithi008 (mon.0) 563 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:57:23.424 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:23.164445+0000 mon.smithi008 (mon.0) 564 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:57:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:22.141523+0000 mgr.smithi008.flmjzp (mgr.14164) 267 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T20:57:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:23.163686+0000 mon.smithi008 (mon.0) 563 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:57:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:23.164445+0000 mon.smithi008 (mon.0) 564 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:57:23.707 INFO:tasks.workunit.client.0.smithi008.stderr:Updating files: 62% (7568/12063) Updating files: 63% (7600/12063) Updating files: 64% (7721/12063) Updating files: 65% (7841/12063) Updating files: 66% (7962/12063) Updating files: 67% (8083/12063) Updating files: 68% (8203/12063) Updating files: 69% (8324/12063) Updating files: 70% (8445/12063) Updating files: 71% (8565/12063) Updating files: 72% (8686/12063) Updating files: 73% (8806/12063) Updating files: 74% (8927/12063) Updating files: 75% (9048/12063) Updating files: 76% (9168/12063) Updating files: 77% (9289/12063) Updating files: 78% (9410/12063) Updating files: 79% (9530/12063) Updating files: 80% (9651/12063) Updating files: 81% (9772/12063) Updating files: 82% (9892/12063) Updating files: 83% (10013/12063) Updating files: 84% (10133/12063) Updating files: 85% (10254/12063) Updating files: 86% (10375/12063) Updating files: 87% (10495/12063) Updating files: 88% (10616/12063) Updating files: 89% (10737/12063) Updating files: 90% (10857/12063) Updating files: 91% (10978/12063) Updating files: 92% (11098/12063) Updating files: 93% (11219/12063) Updating files: 94% (11340/12063) Updating files: 95% (11460/12063) Updating files: 96% (11581/12063) Updating files: 97% (11702/12063) Updating files: 98% (11822/12063) Updating files: 99% (11943/12063) Updating files: 100% (12063/12063) Updating files: 100% (12063/12063), done. 2023-10-18T20:57:24.401 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:24.142036+0000 mgr.smithi008.flmjzp (mgr.14164) 268 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:57:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:24.142036+0000 mgr.smithi008.flmjzp (mgr.14164) 268 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T20:57:25.402 INFO:tasks.workunit.client.0.smithi008.stderr:Note: switching to 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'. 2023-10-18T20:57:25.402 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-18T20:57:25.403 INFO:tasks.workunit.client.0.smithi008.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-18T20:57:25.403 INFO:tasks.workunit.client.0.smithi008.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-18T20:57:25.403 INFO:tasks.workunit.client.0.smithi008.stderr:state without impacting any branches by switching back to a branch. 2023-10-18T20:57:25.403 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-18T20:57:25.403 INFO:tasks.workunit.client.0.smithi008.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-18T20:57:25.404 INFO:tasks.workunit.client.0.smithi008.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-18T20:57:25.404 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-18T20:57:25.404 INFO:tasks.workunit.client.0.smithi008.stderr: git switch -c 2023-10-18T20:57:25.404 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-18T20:57:25.404 INFO:tasks.workunit.client.0.smithi008.stderr:Or undo this operation with: 2023-10-18T20:57:25.405 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-18T20:57:25.405 INFO:tasks.workunit.client.0.smithi008.stderr: git switch - 2023-10-18T20:57:25.405 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-18T20:57:25.405 INFO:tasks.workunit.client.0.smithi008.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-18T20:57:25.405 INFO:tasks.workunit.client.0.smithi008.stderr: 2023-10-18T20:57:25.406 INFO:tasks.workunit.client.0.smithi008.stderr:HEAD is now at b4ddd52ca4a Merge PR #52852 into wip-vshankar-testing-20231016.091648 2023-10-18T20:57:25.422 DEBUG:teuthology.orchestra.run.smithi008:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-18T20:57:25.476 INFO:tasks.workunit.client.0.smithi008.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-18T20:57:25.481 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-18T20:57:25.481 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-18T20:57:26.111 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-18T20:57:26.207 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-18T20:57:26.273 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-18T20:57:26.277 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-18T20:57:26.277 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-18T20:57:26.342 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-18T20:57:26.349 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-18T20:57:26.349 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-18T20:57:26.397 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-10-18T20:57:26.399 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-10-18T20:57:26.400 DEBUG:teuthology.orchestra.run.smithi008:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-10-18T20:57:26.499 INFO:tasks.workunit.client.0.smithi008.stderr:+ mkdir -p fsstress 2023-10-18T20:57:26.502 INFO:tasks.workunit.client.0.smithi008.stderr:+ pushd fsstress 2023-10-18T20:57:26.503 INFO:tasks.workunit.client.0.smithi008.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-10-18T20:57:26.503 INFO:tasks.workunit.client.0.smithi008.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-10-18T20:57:27.635 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:26.142637+0000 mgr.smithi008.flmjzp (mgr.14164) 269 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T20:57:27.635 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:26.246524+0000 mon.smithi008 (mon.0) 565 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:57:27.635 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:26.778111+0000 mon.smithi008 (mon.0) 566 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:57:27.636 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:26.781880+0000 mon.smithi008 (mon.0) 567 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:57:27.636 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:26.785224+0000 mon.smithi008 (mon.0) 568 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr fail", "who": "smithi008.flmjzp"}]: dispatch 2023-10-18T20:57:27.636 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:26.789674+0000 mon.smithi008 (mon.0) 569 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2023-10-18T20:57:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:26.142637+0000 mgr.smithi008.flmjzp (mgr.14164) 269 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 12 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T20:57:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:26.246524+0000 mon.smithi008 (mon.0) 565 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:57:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:26.778111+0000 mon.smithi008 (mon.0) 566 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' 2023-10-18T20:57:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:26.781880+0000 mon.smithi008 (mon.0) 567 : audit [DBG] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:57:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:26.785224+0000 mon.smithi008 (mon.0) 568 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr fail", "who": "smithi008.flmjzp"}]: dispatch 2023-10-18T20:57:27.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:26.789674+0000 mon.smithi008 (mon.0) 569 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2023-10-18T20:57:28.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.053+0000 7ff23757e700 1 -- 172.21.15.8:0/608012030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2300f6530 msgr2=0x7ff2300f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:28.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.053+0000 7ff23757e700 1 --2- 172.21.15.8:0/608012030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2300f6530 0x7ff2300f6950 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7ff22c0045a0 tx=0x7ff22c009b30).stop 2023-10-18T20:57:28.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.053+0000 7ff23757e700 1 -- 172.21.15.8:0/608012030 shutdown_connections 2023-10-18T20:57:28.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.053+0000 7ff23757e700 1 --2- 172.21.15.8:0/608012030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2300f77d0 0x7ff2300f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:28.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.053+0000 7ff23757e700 1 --2- 172.21.15.8:0/608012030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2300f6530 0x7ff2300f6950 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:28.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.053+0000 7ff23757e700 1 -- 172.21.15.8:0/608012030 >> 172.21.15.8:0/608012030 conn(0x7ff2300f1c90 msgr2=0x7ff2300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:28.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.054+0000 7ff23757e700 1 -- 172.21.15.8:0/608012030 shutdown_connections 2023-10-18T20:57:28.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.054+0000 7ff23757e700 1 -- 172.21.15.8:0/608012030 wait complete. 2023-10-18T20:57:28.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.055+0000 7ff23757e700 1 Processor -- start 2023-10-18T20:57:28.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.055+0000 7ff23757e700 1 -- start start 2023-10-18T20:57:28.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.055+0000 7ff23757e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2300f6530 0x7ff230106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:28.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.055+0000 7ff23757e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2300f77d0 0x7ff230107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:28.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.055+0000 7ff23757e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230107880 con 0x7ff2300f77d0 2023-10-18T20:57:28.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.055+0000 7ff23757e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301080c0 con 0x7ff2300f6530 2023-10-18T20:57:28.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.056+0000 7ff235d7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2300f77d0 0x7ff230107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:28.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.056+0000 7ff23657c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2300f6530 0x7ff230106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:28.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.056+0000 7ff235d7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2300f77d0 0x7ff230107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43494/0 (socket says 172.21.15.8:43494) 2023-10-18T20:57:28.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.056+0000 7ff235d7b700 1 -- 172.21.15.8:0/677306823 learned_addr learned my addr 172.21.15.8:0/677306823 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:57:28.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.056+0000 7ff235d7b700 1 -- 172.21.15.8:0/677306823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2300f6530 msgr2=0x7ff230106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:28.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.056+0000 7ff235d7b700 1 --2- 172.21.15.8:0/677306823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2300f6530 0x7ff230106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:28.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.056+0000 7ff235d7b700 1 -- 172.21.15.8:0/677306823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c005040 con 0x7ff2300f77d0 2023-10-18T20:57:28.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.056+0000 7ff235d7b700 1 --2- 172.21.15.8:0/677306823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2300f77d0 0x7ff230107280 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ff22000e7c0 tx=0x7ff22000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:28.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.057+0000 7ff226ffd700 1 -- 172.21.15.8:0/677306823 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2200092e0 con 0x7ff2300f77d0 2023-10-18T20:57:28.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.057+0000 7ff23757e700 1 -- 172.21.15.8:0/677306823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff230108340 con 0x7ff2300f77d0 2023-10-18T20:57:28.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.057+0000 7ff226ffd700 1 -- 172.21.15.8:0/677306823 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff22000f040 con 0x7ff2300f77d0 2023-10-18T20:57:28.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.057+0000 7ff226ffd700 1 -- 172.21.15.8:0/677306823 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff220014920 con 0x7ff2300f77d0 2023-10-18T20:57:28.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.057+0000 7ff23757e700 1 -- 172.21.15.8:0/677306823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff230108880 con 0x7ff2300f77d0 2023-10-18T20:57:28.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.058+0000 7ff226ffd700 1 -- 172.21.15.8:0/677306823 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 35997+0+0 (secure 0 0 0) 0x7ff22001b030 con 0x7ff2300f77d0 2023-10-18T20:57:28.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.058+0000 7ff23757e700 1 -- 172.21.15.8:0/677306823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff230059100 con 0x7ff2300f77d0 2023-10-18T20:57:28.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.058+0000 7ff226ffd700 1 -- 172.21.15.8:0/677306823 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff220040610 con 0x7ff2300f77d0 2023-10-18T20:57:28.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:28.063+0000 7ff226ffd700 1 -- 172.21.15.8:0/677306823 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff220013a10 con 0x7ff2300f77d0 2023-10-18T20:57:28.242 INFO:tasks.workunit.client.0.smithi008.stderr:+ tar xzf ltp-full.tgz 2023-10-18T20:57:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:57:26.782899+0000 mgr.smithi008.flmjzp (mgr.14164) 270 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi008.flmjzp) 2023-10-18T20:57:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:57:26.784864+0000 mgr.smithi008.flmjzp (mgr.14164) 271 : cephadm [INF] Failing over to other MGR 2023-10-18T20:57:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:27.783985+0000 mon.smithi008 (mon.0) 570 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "mgr fail", "who": "smithi008.flmjzp"}]': finished 2023-10-18T20:57:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:27.784065+0000 mon.smithi008 (mon.0) 571 : cluster [DBG] mgrmap e19: smithi060.pgqqwa(active, starting, since 0.998158s) 2023-10-18T20:57:28.733 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:57:26.782899+0000 mgr.smithi008.flmjzp (mgr.14164) 270 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi008.flmjzp) 2023-10-18T20:57:28.734 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:57:26.784864+0000 mgr.smithi008.flmjzp (mgr.14164) 271 : cephadm [INF] Failing over to other MGR 2023-10-18T20:57:28.734 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:27.783985+0000 mon.smithi008 (mon.0) 570 : audit [INF] from='mgr.14164 172.21.15.8:0/1360317314' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "mgr fail", "who": "smithi008.flmjzp"}]': finished 2023-10-18T20:57:28.734 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:27.784065+0000 mon.smithi008 (mon.0) 571 : cluster [DBG] mgrmap e19: smithi060.pgqqwa(active, starting, since 0.998158s) 2023-10-18T20:57:31.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:31.512+0000 7ff226ffd700 1 -- 172.21.15.8:0/677306823 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 20) v1 ==== 38472+0+0 (secure 0 0 0) 0x7ff2200077b0 con 0x7ff2300f77d0 2023-10-18T20:57:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:31.457285+0000 mon.smithi008 (mon.0) 572 : cluster [INF] Active manager daemon smithi060.pgqqwa restarted 2023-10-18T20:57:31.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:31.458031+0000 mon.smithi008 (mon.0) 573 : cluster [INF] Activating manager daemon smithi060.pgqqwa 2023-10-18T20:57:31.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:31.461765+0000 mon.smithi008 (mon.0) 574 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2023-10-18T20:57:31.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.462050+0000 mon.smithi008 (mon.0) 575 : audit [DBG] from='mgr.? 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/crt"}]: dispatch 2023-10-18T20:57:31.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.463786+0000 mon.smithi008 (mon.0) 576 : audit [DBG] from='mgr.? 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:57:31.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.468541+0000 mon.smithi008 (mon.0) 577 : audit [DBG] from='mgr.? 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/key"}]: dispatch 2023-10-18T20:57:31.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.469060+0000 mon.smithi008 (mon.0) 578 : audit [DBG] from='mgr.? 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:57:31.814 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:31.457285+0000 mon.smithi008 (mon.0) 572 : cluster [INF] Active manager daemon smithi060.pgqqwa restarted 2023-10-18T20:57:31.815 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:31.458031+0000 mon.smithi008 (mon.0) 573 : cluster [INF] Activating manager daemon smithi060.pgqqwa 2023-10-18T20:57:31.815 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:31.461765+0000 mon.smithi008 (mon.0) 574 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2023-10-18T20:57:31.815 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.462050+0000 mon.smithi008 (mon.0) 575 : audit [DBG] from='mgr.? 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/crt"}]: dispatch 2023-10-18T20:57:31.815 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.463786+0000 mon.smithi008 (mon.0) 576 : audit [DBG] from='mgr.? 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:57:31.816 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.468541+0000 mon.smithi008 (mon.0) 577 : audit [DBG] from='mgr.? 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/key"}]: dispatch 2023-10-18T20:57:31.816 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.469060+0000 mon.smithi008 (mon.0) 578 : audit [DBG] from='mgr.? 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:57:32.447 INFO:tasks.workunit.client.1.smithi060.stderr:Updating files: 62% (7500/12063) Updating files: 63% (7600/12063) Updating files: 64% (7721/12063) Updating files: 65% (7841/12063) Updating files: 66% (7962/12063) Updating files: 67% (8083/12063) Updating files: 68% (8203/12063) Updating files: 69% (8324/12063) Updating files: 70% (8445/12063) Updating files: 71% (8565/12063) Updating files: 72% (8686/12063) Updating files: 73% (8806/12063) Updating files: 74% (8927/12063) Updating files: 75% (9048/12063) Updating files: 76% (9168/12063) Updating files: 77% (9289/12063) Updating files: 78% (9410/12063) Updating files: 79% (9530/12063) Updating files: 80% (9651/12063) Updating files: 81% (9772/12063) Updating files: 82% (9892/12063) Updating files: 83% (10013/12063) Updating files: 84% (10133/12063) Updating files: 85% (10254/12063) Updating files: 86% (10375/12063) Updating files: 87% (10495/12063) Updating files: 88% (10616/12063) Updating files: 89% (10737/12063) Updating files: 90% (10857/12063) Updating files: 91% (10978/12063) Updating files: 92% (11098/12063) Updating files: 93% (11219/12063) Updating files: 94% (11340/12063) Updating files: 94% (11427/12063) Updating files: 95% (11460/12063) Updating files: 96% (11581/12063) Updating files: 97% (11702/12063) Updating files: 98% (11822/12063) Updating files: 99% (11943/12063) Updating files: 100% (12063/12063) Updating files: 100% (12063/12063), done. 2023-10-18T20:57:32.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.525+0000 7ff226ffd700 1 -- 172.21.15.8:0/677306823 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mgrmap(e 21) v1 ==== 38542+0+0 (secure 0 0 0) 0x7ff22003dc90 con 0x7ff2300f77d0 2023-10-18T20:57:32.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.525+0000 7ff226ffd700 1 --2- 172.21.15.8:0/677306823 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7ff21c00d7b0 0x7ff21c02e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:32.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.525+0000 7ff226ffd700 1 -- 172.21.15.8:0/677306823 --> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff21c005a00 con 0x7ff21c00d7b0 2023-10-18T20:57:32.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.535+0000 7ff23657c700 1 --2- 172.21.15.8:0/677306823 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7ff21c00d7b0 0x7ff21c02e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:32.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.536+0000 7ff23657c700 1 --2- 172.21.15.8:0/677306823 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7ff21c00d7b0 0x7ff21c02e110 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff22c004570 tx=0x7ff22c01a040).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:32.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.539+0000 7ff226ffd700 1 -- 172.21.15.8:0/677306823 <== mgr.14584 v2:172.21.15.60:6828/3545049846 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7ff21c005a00 con 0x7ff21c00d7b0 2023-10-18T20:57:32.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 -- 172.21.15.8:0/677306823 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7ff21c00d7b0 msgr2=0x7ff21c02e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:32.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 --2- 172.21.15.8:0/677306823 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7ff21c00d7b0 0x7ff21c02e110 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff22c004570 tx=0x7ff22c01a040).stop 2023-10-18T20:57:32.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 -- 172.21.15.8:0/677306823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2300f77d0 msgr2=0x7ff230107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:32.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 --2- 172.21.15.8:0/677306823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2300f77d0 0x7ff230107280 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ff22000e7c0 tx=0x7ff22000b040).stop 2023-10-18T20:57:32.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 -- 172.21.15.8:0/677306823 shutdown_connections 2023-10-18T20:57:32.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 --2- 172.21.15.8:0/677306823 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7ff21c00d7b0 0x7ff21c02e110 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:32.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 --2- 172.21.15.8:0/677306823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2300f6530 0x7ff230106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:32.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 --2- 172.21.15.8:0/677306823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2300f77d0 0x7ff230107280 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:32.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 -- 172.21.15.8:0/677306823 >> 172.21.15.8:0/677306823 conn(0x7ff2300f1c90 msgr2=0x7ff2300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:32.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 -- 172.21.15.8:0/677306823 shutdown_connections 2023-10-18T20:57:32.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.542+0000 7ff23757e700 1 -- 172.21.15.8:0/677306823 wait complete. 2023-10-18T20:57:32.569 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T20:57:32.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.780+0000 7f431d680700 1 -- 172.21.15.8:0/243310665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43180fdde0 msgr2=0x7f43180fe240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:32.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.780+0000 7f431d680700 1 --2- 172.21.15.8:0/243310665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43180fdde0 0x7f43180fe240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f430c0045a0 tx=0x7f430c009b30).stop 2023-10-18T20:57:32.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.780+0000 7f431d680700 1 -- 172.21.15.8:0/243310665 shutdown_connections 2023-10-18T20:57:32.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.780+0000 7f431d680700 1 --2- 172.21.15.8:0/243310665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43180fdde0 0x7f43180fe240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:32.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.780+0000 7f431d680700 1 --2- 172.21.15.8:0/243310665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43180fcba0 0x7f43180fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:32.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.780+0000 7f431d680700 1 -- 172.21.15.8:0/243310665 >> 172.21.15.8:0/243310665 conn(0x7f431806bd10 msgr2=0x7f431806e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:32.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.780+0000 7f431d680700 1 -- 172.21.15.8:0/243310665 shutdown_connections 2023-10-18T20:57:32.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.780+0000 7f431d680700 1 -- 172.21.15.8:0/243310665 wait complete. 2023-10-18T20:57:32.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.782+0000 7f431d680700 1 Processor -- start 2023-10-18T20:57:32.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.782+0000 7f431d680700 1 -- start start 2023-10-18T20:57:32.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.782+0000 7f431d680700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43180fcba0 0x7f4318068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:32.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.782+0000 7f431d680700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43180fdde0 0x7f4318069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:32.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.782+0000 7f431d680700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4318069740 con 0x7f43180fcba0 2023-10-18T20:57:32.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.782+0000 7f431d680700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4318116e50 con 0x7f43180fdde0 2023-10-18T20:57:32.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.783+0000 7f43177fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43180fdde0 0x7f4318069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:32.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.783+0000 7f43177fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43180fdde0 0x7f4318069140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:44934/0 (socket says 172.21.15.8:44934) 2023-10-18T20:57:32.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.783+0000 7f43177fe700 1 -- 172.21.15.8:0/1428522179 learned_addr learned my addr 172.21.15.8:0/1428522179 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:57:32.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.783+0000 7f43177fe700 1 -- 172.21.15.8:0/1428522179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43180fcba0 msgr2=0x7f4318068c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:57:32.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.783+0000 7f4317fff700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43180fcba0 0x7f4318068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:32.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.783+0000 7f43177fe700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43180fcba0 0x7f4318068c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:32.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.783+0000 7f43177fe700 1 -- 172.21.15.8:0/1428522179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4308005040 con 0x7f43180fdde0 2023-10-18T20:57:32.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.784+0000 7f4317fff700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43180fcba0 0x7f4318068c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T20:57:32.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.784+0000 7f43177fe700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43180fdde0 0x7f4318069140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f430c009720 tx=0x7f430c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:32.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.784+0000 7f4314ff9700 1 -- 172.21.15.8:0/1428522179 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430c00e070 con 0x7f43180fdde0 2023-10-18T20:57:32.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.784+0000 7f4314ff9700 1 -- 172.21.15.8:0/1428522179 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f430c007ba0 con 0x7f43180fdde0 2023-10-18T20:57:32.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.784+0000 7f431d680700 1 -- 172.21.15.8:0/1428522179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c005040 con 0x7f43180fdde0 2023-10-18T20:57:32.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.784+0000 7f4314ff9700 1 -- 172.21.15.8:0/1428522179 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430c019070 con 0x7f43180fdde0 2023-10-18T20:57:32.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.784+0000 7f431d680700 1 -- 172.21.15.8:0/1428522179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43181173f0 con 0x7f43180fdde0 2023-10-18T20:57:32.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.786+0000 7f431d680700 1 -- 172.21.15.8:0/1428522179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f8004fa0 con 0x7f43180fdde0 2023-10-18T20:57:32.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.786+0000 7f4314ff9700 1 -- 172.21.15.8:0/1428522179 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 21) v1 ==== 38542+0+0 (secure 0 0 0) 0x7f430c025070 con 0x7f43180fdde0 2023-10-18T20:57:32.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.787+0000 7f4314ff9700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f4300032420 0x7f43000348e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:32.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.787+0000 7f4314ff9700 1 -- 172.21.15.8:0/1428522179 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f430c0447d0 con 0x7f43180fdde0 2023-10-18T20:57:32.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.787+0000 7f4317fff700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f4300032420 0x7f43000348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:32.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.788+0000 7f4317fff700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f4300032420 0x7f43000348e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f4308009da0 tx=0x7f4308009b30).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:32.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:32.791+0000 7f4314ff9700 1 -- 172.21.15.8:0/1428522179 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7f430c01b2c0 con 0x7f43180fdde0 2023-10-18T20:57:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:31.514633+0000 mon.smithi008 (mon.0) 579 : cluster [DBG] mgrmap e20: smithi060.pgqqwa(active, starting, since 0.0567806s) 2023-10-18T20:57:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.516441+0000 mon.smithi060 (mon.1) 18 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:57:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.516648+0000 mon.smithi060 (mon.1) 19 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:57:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.516843+0000 mon.smithi060 (mon.1) 20 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T20:57:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.517005+0000 mon.smithi060 (mon.1) 21 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T20:57:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.517152+0000 mon.smithi060 (mon.1) 22 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T20:57:32.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.517303+0000 mon.smithi060 (mon.1) 23 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T20:57:32.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.517469+0000 mon.smithi060 (mon.1) 24 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mgr metadata", "who": "smithi060.pgqqwa", "id": "smithi060.pgqqwa"}]: dispatch 2023-10-18T20:57:32.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.517620+0000 mon.smithi060 (mon.1) 25 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:57:32.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.523876+0000 mon.smithi060 (mon.1) 26 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:57:32.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.524239+0000 mon.smithi060 (mon.1) 27 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:57:32.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.524581+0000 mon.smithi060 (mon.1) 28 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:57:32.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.524933+0000 mon.smithi060 (mon.1) 29 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:57:32.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.525290+0000 mon.smithi060 (mon.1) 30 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:57:32.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.525658+0000 mon.smithi060 (mon.1) 31 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T20:57:32.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.526141+0000 mon.smithi060 (mon.1) 32 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T20:57:32.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.526834+0000 mon.smithi060 (mon.1) 33 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T20:57:32.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:31.619210+0000 mon.smithi008 (mon.0) 580 : cluster [INF] Manager daemon smithi060.pgqqwa is now available 2023-10-18T20:57:32.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.744107+0000 mon.smithi060 (mon.1) 34 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:57:32.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.745939+0000 mon.smithi060 (mon.1) 35 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:57:32.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.772323+0000 mon.smithi008 (mon.0) 581 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:32.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.826067+0000 mon.smithi060 (mon.1) 36 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.pgqqwa/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:57:32.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.826569+0000 mon.smithi008 (mon.0) 582 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.pgqqwa/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:57:32.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.834793+0000 mon.smithi060 (mon.1) 37 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.pgqqwa/trash_purge_schedule"}]: dispatch 2023-10-18T20:57:32.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:31.835242+0000 mon.smithi008 (mon.0) 583 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.pgqqwa/trash_purge_schedule"}]: dispatch 2023-10-18T20:57:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:31.514633+0000 mon.smithi008 (mon.0) 579 : cluster [DBG] mgrmap e20: smithi060.pgqqwa(active, starting, since 0.0567806s) 2023-10-18T20:57:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.516441+0000 mon.smithi060 (mon.1) 18 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:57:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.516648+0000 mon.smithi060 (mon.1) 19 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:57:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.516843+0000 mon.smithi060 (mon.1) 20 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T20:57:32.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.517005+0000 mon.smithi060 (mon.1) 21 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T20:57:32.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.517152+0000 mon.smithi060 (mon.1) 22 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T20:57:32.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.517303+0000 mon.smithi060 (mon.1) 23 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T20:57:32.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.517469+0000 mon.smithi060 (mon.1) 24 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mgr metadata", "who": "smithi060.pgqqwa", "id": "smithi060.pgqqwa"}]: dispatch 2023-10-18T20:57:32.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.517620+0000 mon.smithi060 (mon.1) 25 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:57:32.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.523876+0000 mon.smithi060 (mon.1) 26 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:57:32.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.524239+0000 mon.smithi060 (mon.1) 27 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:57:32.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.524581+0000 mon.smithi060 (mon.1) 28 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:57:32.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.524933+0000 mon.smithi060 (mon.1) 29 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:57:32.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.525290+0000 mon.smithi060 (mon.1) 30 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:57:32.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.525658+0000 mon.smithi060 (mon.1) 31 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T20:57:32.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.526141+0000 mon.smithi060 (mon.1) 32 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T20:57:32.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.526834+0000 mon.smithi060 (mon.1) 33 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T20:57:32.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:31.619210+0000 mon.smithi008 (mon.0) 580 : cluster [INF] Manager daemon smithi060.pgqqwa is now available 2023-10-18T20:57:32.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.744107+0000 mon.smithi060 (mon.1) 34 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:57:32.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.745939+0000 mon.smithi060 (mon.1) 35 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:57:32.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.772323+0000 mon.smithi008 (mon.0) 581 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:32.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.826067+0000 mon.smithi060 (mon.1) 36 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.pgqqwa/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:57:32.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.826569+0000 mon.smithi008 (mon.0) 582 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.pgqqwa/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:57:32.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.834793+0000 mon.smithi060 (mon.1) 37 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.pgqqwa/trash_purge_schedule"}]: dispatch 2023-10-18T20:57:32.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:31.835242+0000 mon.smithi008 (mon.0) 583 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.pgqqwa/trash_purge_schedule"}]: dispatch 2023-10-18T20:57:33.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.138+0000 7f431d680700 1 -- 172.21.15.8:0/1428522179 --> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42f8000bc0 con 0x7f4300032420 2023-10-18T20:57:33.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.141+0000 7f4314ff9700 1 -- 172.21.15.8:0/1428522179 <== mgr.14584 v2:172.21.15.60:6828/3545049846 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f42f8000bc0 con 0x7f4300032420 2023-10-18T20:57:33.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 -- 172.21.15.8:0/1428522179 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f4300032420 msgr2=0x7f43000348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:33.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f4300032420 0x7f43000348e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f4308009da0 tx=0x7f4308009b30).stop 2023-10-18T20:57:33.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 -- 172.21.15.8:0/1428522179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43180fdde0 msgr2=0x7f4318069140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:33.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43180fdde0 0x7f4318069140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f430c009720 tx=0x7f430c00b040).stop 2023-10-18T20:57:33.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 -- 172.21.15.8:0/1428522179 shutdown_connections 2023-10-18T20:57:33.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f4300032420 0x7f43000348e0 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0x7f4308009da0 tx=0x7f4308009b30).stop 2023-10-18T20:57:33.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43180fcba0 0x7f4318068c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:33.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 --2- 172.21.15.8:0/1428522179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43180fdde0 0x7f4318069140 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:33.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 -- 172.21.15.8:0/1428522179 >> 172.21.15.8:0/1428522179 conn(0x7f431806bd10 msgr2=0x7f4318101830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:33.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 -- 172.21.15.8:0/1428522179 shutdown_connections 2023-10-18T20:57:33.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.145+0000 7f431d680700 1 -- 172.21.15.8:0/1428522179 wait complete. 2023-10-18T20:57:33.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.336+0000 7fab7ffff700 1 -- 172.21.15.8:0/3202105224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab800f4800 msgr2=0x7fab800f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:33.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.336+0000 7fab7ffff700 1 --2- 172.21.15.8:0/3202105224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab800f4800 0x7fab800f4c20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fab700099e0 tx=0x7fab70004d10).stop 2023-10-18T20:57:33.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.338+0000 7fab7ffff700 1 -- 172.21.15.8:0/3202105224 shutdown_connections 2023-10-18T20:57:33.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.338+0000 7fab7ffff700 1 --2- 172.21.15.8:0/3202105224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab800f51a0 0x7fab800f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:33.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.338+0000 7fab7ffff700 1 --2- 172.21.15.8:0/3202105224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab800f4800 0x7fab800f4c20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:33.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.338+0000 7fab7ffff700 1 -- 172.21.15.8:0/3202105224 >> 172.21.15.8:0/3202105224 conn(0x7fab800f0320 msgr2=0x7fab800f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:33.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.339+0000 7fab7ffff700 1 -- 172.21.15.8:0/3202105224 shutdown_connections 2023-10-18T20:57:33.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.341+0000 7fab7ffff700 1 -- 172.21.15.8:0/3202105224 wait complete. 2023-10-18T20:57:33.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.342+0000 7fab7ffff700 1 Processor -- start 2023-10-18T20:57:33.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.342+0000 7fab7ffff700 1 -- start start 2023-10-18T20:57:33.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.342+0000 7fab7ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab800f4800 0x7fab800fe180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:33.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.343+0000 7fab7ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab800f51a0 0x7fab800fe670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:33.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.343+0000 7fab7ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab800fec70 con 0x7fab800f51a0 2023-10-18T20:57:33.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.343+0000 7fab7ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab800fedb0 con 0x7fab800f4800 2023-10-18T20:57:33.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.343+0000 7fab7effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab800f4800 0x7fab800fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:33.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.343+0000 7fab7effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab800f4800 0x7fab800fe180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:44956/0 (socket says 172.21.15.8:44956) 2023-10-18T20:57:33.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.343+0000 7fab7effd700 1 -- 172.21.15.8:0/464077831 learned_addr learned my addr 172.21.15.8:0/464077831 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:57:33.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.344+0000 7fab7effd700 1 -- 172.21.15.8:0/464077831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab800f51a0 msgr2=0x7fab800fe670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:57:33.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.344+0000 7fab7effd700 1 --2- 172.21.15.8:0/464077831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab800f51a0 0x7fab800fe670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:57:33.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.344+0000 7fab7effd700 1 -- 172.21.15.8:0/464077831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70009640 con 0x7fab800f4800 2023-10-18T20:57:33.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.344+0000 7fab7effd700 1 --2- 172.21.15.8:0/464077831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab800f4800 0x7fab800fe180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fab700078d0 tx=0x7fab70004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:33.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.345+0000 7fab77fff700 1 -- 172.21.15.8:0/464077831 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab7000e030 con 0x7fab800f4800 2023-10-18T20:57:33.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.345+0000 7fab77fff700 1 -- 172.21.15.8:0/464077831 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fab7001d8e0 con 0x7fab800f4800 2023-10-18T20:57:33.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.345+0000 7fab77fff700 1 -- 172.21.15.8:0/464077831 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab70018070 con 0x7fab800f4800 2023-10-18T20:57:33.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.346+0000 7fab7ffff700 1 -- 172.21.15.8:0/464077831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab800ff6c0 con 0x7fab800f4800 2023-10-18T20:57:33.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.346+0000 7fab7ffff700 1 -- 172.21.15.8:0/464077831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab800ffba0 con 0x7fab800f4800 2023-10-18T20:57:33.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.347+0000 7fab7ffff700 1 -- 172.21.15.8:0/464077831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab80045ad0 con 0x7fab800f4800 2023-10-18T20:57:33.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.349+0000 7fab77fff700 1 -- 172.21.15.8:0/464077831 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 21) v1 ==== 38542+0+0 (secure 0 0 0) 0x7fab7001da50 con 0x7fab800f4800 2023-10-18T20:57:33.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.349+0000 7fab77fff700 1 --2- 172.21.15.8:0/464077831 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fab6c032420 0x7fab6c0348e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:33.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.349+0000 7fab77fff700 1 -- 172.21.15.8:0/464077831 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fab700454d0 con 0x7fab800f4800 2023-10-18T20:57:33.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.350+0000 7fab767fc700 1 --2- 172.21.15.8:0/464077831 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fab6c032420 0x7fab6c0348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:33.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.350+0000 7fab767fc700 1 --2- 172.21.15.8:0/464077831 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fab6c032420 0x7fab6c0348e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fab800f55e0 tx=0x7fab680099e0).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:33.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.354+0000 7fab77fff700 1 -- 172.21.15.8:0/464077831 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7fab7001de10 con 0x7fab800f4800 2023-10-18T20:57:33.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.666+0000 7fab7ffff700 1 -- 172.21.15.8:0/464077831 --> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab800fbd80 con 0x7fab6c032420 2023-10-18T20:57:33.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.677+0000 7fab77fff700 1 -- 172.21.15.8:0/464077831 <== mgr.14584 v2:172.21.15.60:6828/3545049846 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fab800fbd80 con 0x7fab6c032420 2023-10-18T20:57:33.679 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T20:57:33.680 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (4m) 88s ago 5m 9.93M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T20:57:33.680 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (5m) 88s ago 5m 7256k - 16.2.4 8d91d370c2b8 4b2c6838af84 2023-10-18T20:57:33.680 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (4m) 7s ago 4m 7562k - 16.2.4 8d91d370c2b8 67dc04156fe1 2023-10-18T20:57:33.680 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (4m) 88s ago 5m 23.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T20:57:33.680 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (104s) 88s ago 104s 14.8M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T20:57:33.680 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (99s) 88s ago 99s 13.0M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T20:57:33.681 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (102s) 7s ago 101s 17.0M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T20:57:33.681 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (97s) 7s ago 97s 16.0M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T20:57:33.681 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:9283 running (7m) 88s ago 7m 430M - 16.2.4 8d91d370c2b8 ee1a6b0bd8ee 2023-10-18T20:57:33.681 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (10s) 7s ago 4m 38.3M - 16.2.14-100-gb4ddd52c 92842c92b8bd 32f95b673b2b 2023-10-18T20:57:33.681 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (7m) 88s ago 7m 89.8M 2048M 16.2.4 8d91d370c2b8 9de89e6e28e5 2023-10-18T20:57:33.682 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (4m) 7s ago 4m 99.2M 2048M 16.2.4 8d91d370c2b8 d7c00f2c13a4 2023-10-18T20:57:33.682 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (5m) 88s ago 5m 9151k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T20:57:33.682 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (4m) 7s ago 4m 9567k - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T20:57:33.682 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (4m) 88s ago 4m 48.4M 4096M 16.2.4 8d91d370c2b8 885270808f90 2023-10-18T20:57:33.682 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (3m) 88s ago 3m 48.9M 4096M 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T20:57:33.683 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (3m) 88s ago 3m 47.5M 4096M 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T20:57:33.683 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (3m) 7s ago 3m 55.3M 4096M 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T20:57:33.683 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (3m) 7s ago 3m 49.6M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T20:57:33.683 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (2m) 7s ago 2m 50.3M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T20:57:33.683 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (4m) 88s ago 4m 27.8M - 2.18.1 de242295e225 0af47d38e46d 2023-10-18T20:57:33.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.680+0000 7fab7ffff700 1 -- 172.21.15.8:0/464077831 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fab6c032420 msgr2=0x7fab6c0348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:33.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.680+0000 7fab7ffff700 1 --2- 172.21.15.8:0/464077831 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fab6c032420 0x7fab6c0348e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fab800f55e0 tx=0x7fab680099e0).stop 2023-10-18T20:57:33.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.681+0000 7fab7ffff700 1 -- 172.21.15.8:0/464077831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab800f4800 msgr2=0x7fab800fe180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:33.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.681+0000 7fab7ffff700 1 --2- 172.21.15.8:0/464077831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab800f4800 0x7fab800fe180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fab700078d0 tx=0x7fab70004d10).stop 2023-10-18T20:57:33.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.681+0000 7fab7ffff700 1 -- 172.21.15.8:0/464077831 shutdown_connections 2023-10-18T20:57:33.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.681+0000 7fab7ffff700 1 --2- 172.21.15.8:0/464077831 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fab6c032420 0x7fab6c0348e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:33.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.681+0000 7fab7ffff700 1 --2- 172.21.15.8:0/464077831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab800f4800 0x7fab800fe180 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:33.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.681+0000 7fab7ffff700 1 --2- 172.21.15.8:0/464077831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab800f51a0 0x7fab800fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:57:33.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.681+0000 7fab7ffff700 1 -- 172.21.15.8:0/464077831 >> 172.21.15.8:0/464077831 conn(0x7fab800f0320 msgr2=0x7fab800f23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:33.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.681+0000 7fab7ffff700 1 -- 172.21.15.8:0/464077831 shutdown_connections 2023-10-18T20:57:33.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.681+0000 7fab7ffff700 1 -- 172.21.15.8:0/464077831 wait complete. 2023-10-18T20:57:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:32.528107+0000 mon.smithi008 (mon.0) 584 : cluster [DBG] mgrmap e21: smithi060.pgqqwa(active, since 1.07022s) 2023-10-18T20:57:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:32.538565+0000 mgr.smithi060.pgqqwa (mgr.14584) 1 : audit [DBG] from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:57:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:32.541037+0000 mgr.smithi060.pgqqwa (mgr.14584) 2 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 20 MiB data, 63 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:57:33.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.880+0000 7f2880a69700 1 -- 172.21.15.8:0/1286927267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c06b9c0 msgr2=0x7f287c069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:33.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.880+0000 7f2880a69700 1 --2- 172.21.15.8:0/1286927267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c06b9c0 0x7f287c069ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f286c004660 tx=0x7f286c009b30).stop 2023-10-18T20:57:33.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.880+0000 7f2880a69700 1 -- 172.21.15.8:0/1286927267 shutdown_connections 2023-10-18T20:57:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.880+0000 7f2880a69700 1 --2- 172.21.15.8:0/1286927267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f287c06a3b0 0x7f287c06a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:57:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.880+0000 7f2880a69700 1 --2- 172.21.15.8:0/1286927267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c06b9c0 0x7f287c069ec0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.880+0000 7f2880a69700 1 -- 172.21.15.8:0/1286927267 >> 172.21.15.8:0/1286927267 conn(0x7f287c0f1c90 msgr2=0x7f287c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.881+0000 7f2880a69700 1 -- 172.21.15.8:0/1286927267 shutdown_connections 2023-10-18T20:57:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.881+0000 7f2880a69700 1 -- 172.21.15.8:0/1286927267 wait complete. 2023-10-18T20:57:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.882+0000 7f2880a69700 1 Processor -- start 2023-10-18T20:57:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.882+0000 7f2880a69700 1 -- start start 2023-10-18T20:57:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.883+0000 7f2880a69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f287c06a3b0 0x7f287c108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:33.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.883+0000 7f2880a69700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c06b9c0 0x7f287c109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:33.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.883+0000 7f2880a69700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c109aa0 con 0x7f287c06a3b0 2023-10-18T20:57:33.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.883+0000 7f2880a69700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c10a350 con 0x7f287c06b9c0 2023-10-18T20:57:33.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.883+0000 7f287b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f287c06a3b0 0x7f287c108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:33.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.883+0000 7f287affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c06b9c0 0x7f287c109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.883+0000 7f287affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c06b9c0 0x7f287c109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:44978/0 (socket says 172.21.15.8:44978) 2023-10-18T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.883+0000 7f287affd700 1 -- 172.21.15.8:0/2277647846 learned_addr learned my addr 172.21.15.8:0/2277647846 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.884+0000 7f287affd700 1 -- 172.21.15.8:0/2277647846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f287c06a3b0 msgr2=0x7f287c108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.884+0000 7f287affd700 1 --2- 172.21.15.8:0/2277647846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f287c06a3b0 0x7f287c108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.884+0000 7f287affd700 1 -- 172.21.15.8:0/2277647846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c005040 con 0x7f287c06b9c0 2023-10-18T20:57:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.884+0000 7f287affd700 1 --2- 172.21.15.8:0/2277647846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c06b9c0 0x7f287c109460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f287000b410 tx=0x7f2870006ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.885+0000 7f2863fff700 1 -- 172.21.15.8:0/2277647846 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28700125f0 con 0x7f287c06b9c0 2023-10-18T20:57:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.885+0000 7f2863fff700 1 -- 172.21.15.8:0/2277647846 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2870012c10 con 0x7f287c06b9c0 2023-10-18T20:57:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.885+0000 7f2863fff700 1 -- 172.21.15.8:0/2277647846 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2870002b00 con 0x7f287c06b9c0 2023-10-18T20:57:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.885+0000 7f2880a69700 1 -- 172.21.15.8:0/2277647846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c10a630 con 0x7f287c06b9c0 2023-10-18T20:57:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.885+0000 7f2880a69700 1 -- 172.21.15.8:0/2277647846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c10abf0 con 0x7f287c06b9c0 2023-10-18T20:57:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.887+0000 7f2880a69700 1 -- 172.21.15.8:0/2277647846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c059100 con 0x7f287c06b9c0 2023-10-18T20:57:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.888+0000 7f2863fff700 1 -- 172.21.15.8:0/2277647846 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 21) v1 ==== 38542+0+0 (secure 0 0 0) 0x7f2870018020 con 0x7f287c06b9c0 2023-10-18T20:57:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.888+0000 7f2863fff700 1 --2- 172.21.15.8:0/2277647846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f2864032420 0x7f28640348e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.889+0000 7f2863fff700 1 -- 172.21.15.8:0/2277647846 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2870043830 con 0x7f287c06b9c0 2023-10-18T20:57:33.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.889+0000 7f287b7fe700 1 --2- 172.21.15.8:0/2277647846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f2864032420 0x7f28640348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:33.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.890+0000 7f287b7fe700 1 --2- 172.21.15.8:0/2277647846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f2864032420 0x7f28640348e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f286c009490 tx=0x7f286c009b30).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:33.893+0000 7f2863fff700 1 -- 172.21.15.8:0/2277647846 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7f28700022e0 con 0x7f287c06b9c0 2023-10-18T20:57:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:32.528107+0000 mon.smithi008 (mon.0) 584 : cluster [DBG] mgrmap e21: smithi060.pgqqwa(active, since 1.07022s) 2023-10-18T20:57:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:32.538565+0000 mgr.smithi060.pgqqwa (mgr.14584) 1 : audit [DBG] from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:57:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:32.541037+0000 mgr.smithi060.pgqqwa (mgr.14584) 2 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 20 MiB data, 63 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:57:34.125 INFO:tasks.workunit.client.1.smithi060.stderr:Note: switching to 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'. 2023-10-18T20:57:34.126 INFO:tasks.workunit.client.1.smithi060.stderr: 2023-10-18T20:57:34.126 INFO:tasks.workunit.client.1.smithi060.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-18T20:57:34.126 INFO:tasks.workunit.client.1.smithi060.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-18T20:57:34.126 INFO:tasks.workunit.client.1.smithi060.stderr:state without impacting any branches by switching back to a branch. 2023-10-18T20:57:34.127 INFO:tasks.workunit.client.1.smithi060.stderr: 2023-10-18T20:57:34.127 INFO:tasks.workunit.client.1.smithi060.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-18T20:57:34.127 INFO:tasks.workunit.client.1.smithi060.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-18T20:57:34.127 INFO:tasks.workunit.client.1.smithi060.stderr: 2023-10-18T20:57:34.128 INFO:tasks.workunit.client.1.smithi060.stderr: git switch -c 2023-10-18T20:57:34.128 INFO:tasks.workunit.client.1.smithi060.stderr: 2023-10-18T20:57:34.128 INFO:tasks.workunit.client.1.smithi060.stderr:Or undo this operation with: 2023-10-18T20:57:34.128 INFO:tasks.workunit.client.1.smithi060.stderr: 2023-10-18T20:57:34.128 INFO:tasks.workunit.client.1.smithi060.stderr: git switch - 2023-10-18T20:57:34.129 INFO:tasks.workunit.client.1.smithi060.stderr: 2023-10-18T20:57:34.129 INFO:tasks.workunit.client.1.smithi060.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-18T20:57:34.129 INFO:tasks.workunit.client.1.smithi060.stderr: 2023-10-18T20:57:34.129 INFO:tasks.workunit.client.1.smithi060.stderr:HEAD is now at b4ddd52ca4a Merge PR #52852 into wip-vshankar-testing-20231016.091648 2023-10-18T20:57:34.145 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-10-18T20:57:34.202 INFO:tasks.workunit.client.1.smithi060.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-18T20:57:34.207 INFO:tasks.workunit.client.1.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-10-18T20:57:34.207 INFO:tasks.workunit.client.1.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-18T20:57:34.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.339+0000 7f2880a69700 1 -- 172.21.15.8:0/2277647846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f287c045ad0 con 0x7f287c06b9c0 2023-10-18T20:57:34.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.340+0000 7f2863fff700 1 -- 172.21.15.8:0/2277647846 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+697 (secure 0 0 0) 0x7f2870019340 con 0x7f287c06b9c0 2023-10-18T20:57:34.342 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:57:34.342 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T20:57:34.342 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T20:57:34.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:57:34.343 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T20:57:34.343 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T20:57:34.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:57:34.343 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T20:57:34.343 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-10-18T20:57:34.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:57:34.344 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T20:57:34.344 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T20:57:34.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:57:34.344 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T20:57:34.345 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1, 2023-10-18T20:57:34.345 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12 2023-10-18T20:57:34.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T20:57:34.345 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:57:34.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 -- 172.21.15.8:0/2277647846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f2864032420 msgr2=0x7f28640348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:34.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 --2- 172.21.15.8:0/2277647846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f2864032420 0x7f28640348e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f286c009490 tx=0x7f286c009b30).stop 2023-10-18T20:57:34.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 -- 172.21.15.8:0/2277647846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c06b9c0 msgr2=0x7f287c109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:34.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 --2- 172.21.15.8:0/2277647846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c06b9c0 0x7f287c109460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f287000b410 tx=0x7f2870006ef0).stop 2023-10-18T20:57:34.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 -- 172.21.15.8:0/2277647846 shutdown_connections 2023-10-18T20:57:34.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 --2- 172.21.15.8:0/2277647846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f2864032420 0x7f28640348e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:34.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 --2- 172.21.15.8:0/2277647846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f287c06a3b0 0x7f287c108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:34.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 --2- 172.21.15.8:0/2277647846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c06b9c0 0x7f287c109460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:34.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 -- 172.21.15.8:0/2277647846 >> 172.21.15.8:0/2277647846 conn(0x7f287c0f1c90 msgr2=0x7f287c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:34.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 -- 172.21.15.8:0/2277647846 shutdown_connections 2023-10-18T20:57:34.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.342+0000 7f2880a69700 1 -- 172.21.15.8:0/2277647846 wait complete. 2023-10-18T20:57:34.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.562+0000 7f1dfe479700 1 -- 172.21.15.8:0/1752380310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df80fcba0 msgr2=0x7f1df80fcfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:34.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.563+0000 7f1dfe479700 1 --2- 172.21.15.8:0/1752380310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df80fcba0 0x7f1df80fcfc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1de80099e0 tx=0x7f1de8004d10).stop 2023-10-18T20:57:34.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.563+0000 7f1dfe479700 1 -- 172.21.15.8:0/1752380310 shutdown_connections 2023-10-18T20:57:34.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.563+0000 7f1dfe479700 1 --2- 172.21.15.8:0/1752380310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1df80fdde0 0x7f1df80fe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:34.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.563+0000 7f1dfe479700 1 --2- 172.21.15.8:0/1752380310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df80fcba0 0x7f1df80fcfc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:34.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.563+0000 7f1dfe479700 1 -- 172.21.15.8:0/1752380310 >> 172.21.15.8:0/1752380310 conn(0x7f1df806bdd0 msgr2=0x7f1df806e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:34.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.563+0000 7f1dfe479700 1 -- 172.21.15.8:0/1752380310 shutdown_connections 2023-10-18T20:57:34.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.563+0000 7f1dfe479700 1 -- 172.21.15.8:0/1752380310 wait complete. 2023-10-18T20:57:34.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.564+0000 7f1dfe479700 1 Processor -- start 2023-10-18T20:57:34.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.565+0000 7f1dfe479700 1 -- start start 2023-10-18T20:57:34.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.566+0000 7f1dfe479700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1df80fcba0 0x7f1df810d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:34.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.566+0000 7f1dfe479700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df80fdde0 0x7f1df810d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:34.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.566+0000 7f1dfe479700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df810df60 con 0x7f1df80fcba0 2023-10-18T20:57:34.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.566+0000 7f1dfe479700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df810e0a0 con 0x7f1df80fdde0 2023-10-18T20:57:34.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.567+0000 7f1dfcc76700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df80fdde0 0x7f1df810d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:34.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.567+0000 7f1dfcc76700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df80fdde0 0x7f1df810d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:45006/0 (socket says 172.21.15.8:45006) 2023-10-18T20:57:34.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.567+0000 7f1dfd477700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1df80fcba0 0x7f1df810d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:34.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.567+0000 7f1dfcc76700 1 -- 172.21.15.8:0/3031607770 learned_addr learned my addr 172.21.15.8:0/3031607770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:57:34.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.568+0000 7f1dfcc76700 1 -- 172.21.15.8:0/3031607770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1df80fcba0 msgr2=0x7f1df810d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:34.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.568+0000 7f1dfcc76700 1 --2- 172.21.15.8:0/3031607770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1df80fcba0 0x7f1df810d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:34.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.568+0000 7f1dfcc76700 1 -- 172.21.15.8:0/3031607770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8009640 con 0x7f1df80fdde0 2023-10-18T20:57:34.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.568+0000 7f1dfcc76700 1 --2- 172.21.15.8:0/3031607770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df80fdde0 0x7f1df810d9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1dec00c790 tx=0x7f1dec007d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:34.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.569+0000 7f1df5ffb700 1 -- 172.21.15.8:0/3031607770 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dec002590 con 0x7f1df80fdde0 2023-10-18T20:57:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.569+0000 7f1dfe479700 1 -- 172.21.15.8:0/3031607770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df810ea40 con 0x7f1df80fdde0 2023-10-18T20:57:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.569+0000 7f1df5ffb700 1 -- 172.21.15.8:0/3031607770 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1dec002bb0 con 0x7f1df80fdde0 2023-10-18T20:57:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.569+0000 7f1df5ffb700 1 -- 172.21.15.8:0/3031607770 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dec013e10 con 0x7f1df80fdde0 2023-10-18T20:57:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.569+0000 7f1dfe479700 1 -- 172.21.15.8:0/3031607770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df810ef80 con 0x7f1df80fdde0 2023-10-18T20:57:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.571+0000 7f1df5ffb700 1 -- 172.21.15.8:0/3031607770 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 22) v1 ==== 38788+0+0 (secure 0 0 0) 0x7f1dec01a060 con 0x7f1df80fdde0 2023-10-18T20:57:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.571+0000 7f1dfe479700 1 -- 172.21.15.8:0/3031607770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd8004fa0 con 0x7f1df80fdde0 2023-10-18T20:57:34.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.571+0000 7f1df5ffb700 1 --2- 172.21.15.8:0/3031607770 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f1de00326e0 0x7f1de0034ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:34.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.571+0000 7f1df5ffb700 1 -- 172.21.15.8:0/3031607770 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1dec044e30 con 0x7f1df80fdde0 2023-10-18T20:57:34.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.572+0000 7f1dfd477700 1 --2- 172.21.15.8:0/3031607770 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f1de00326e0 0x7f1de0034ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:34.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.573+0000 7f1dfd477700 1 --2- 172.21.15.8:0/3031607770 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f1de00326e0 0x7f1de0034ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1de800b3b0 tx=0x7f1de8004d10).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:34.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.581+0000 7f1df5ffb700 1 -- 172.21.15.8:0/3031607770 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7f1dec010710 con 0x7f1df80fdde0 2023-10-18T20:57:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:33.141362+0000 mgr.smithi060.pgqqwa (mgr.14584) 3 : audit [DBG] from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:57:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:33.522322+0000 mgr.smithi060.pgqqwa (mgr.14584) 4 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 20 MiB data, 63 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:57:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:33.668045+0000 mgr.smithi060.pgqqwa (mgr.14584) 5 : audit [DBG] from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:57:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:34.340324+0000 mon.smithi060 (mon.1) 38 : audit [DBG] from='client.? 172.21.15.8:0/2277647846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:57:34.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:34.407312+0000 mon.smithi008 (mon.0) 585 : cluster [DBG] mgrmap e22: smithi060.pgqqwa(active, since 2s) 2023-10-18T20:57:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.942+0000 7f1dfe479700 1 -- 172.21.15.8:0/3031607770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1dd8005e80 con 0x7f1df80fdde0 2023-10-18T20:57:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.942+0000 7f1df5ffb700 1 -- 172.21.15.8:0/3031607770 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1613 (secure 0 0 0) 0x7f1dec011350 con 0x7f1df80fdde0 2023-10-18T20:57:34.947 INFO:teuthology.orchestra.run.smithi008.stdout:e15 2023-10-18T20:57:34.948 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:57:34.948 INFO:teuthology.orchestra.run.smithi008.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:57:34.948 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T20:57:34.948 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:57:34.948 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T20:57:34.949 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T20:57:34.949 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 15 2023-10-18T20:57:34.949 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T20:57:34.949 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:57:34.950 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:56:04.757749+0000 2023-10-18T20:57:34.950 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T20:57:34.950 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T20:57:34.950 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T20:57:34.950 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T20:57:34.951 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T20:57:34.951 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T20:57:34.951 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T20:57:34.951 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T20:57:34.951 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:57:34.951 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T20:57:34.952 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T20:57:34.952 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T20:57:34.952 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T20:57:34.952 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T20:57:34.952 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T20:57:34.953 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T20:57:34.953 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T20:57:34.953 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T20:57:34.953 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T20:57:34.953 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T20:57:34.953 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015]] 2023-10-18T20:57:34.954 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531]] 2023-10-18T20:57:34.954 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145]] 2023-10-18T20:57:34.954 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799]] 2023-10-18T20:57:34.954 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:57:34.954 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:57:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 -- 172.21.15.8:0/3031607770 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f1de00326e0 msgr2=0x7f1de0034ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 --2- 172.21.15.8:0/3031607770 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f1de00326e0 0x7f1de0034ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1de800b3b0 tx=0x7f1de8004d10).stop 2023-10-18T20:57:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 -- 172.21.15.8:0/3031607770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df80fdde0 msgr2=0x7f1df810d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 --2- 172.21.15.8:0/3031607770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df80fdde0 0x7f1df810d9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1dec00c790 tx=0x7f1dec007d70).stop 2023-10-18T20:57:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 -- 172.21.15.8:0/3031607770 shutdown_connections 2023-10-18T20:57:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 --2- 172.21.15.8:0/3031607770 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f1de00326e0 0x7f1de0034ba0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 --2- 172.21.15.8:0/3031607770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1df80fcba0 0x7f1df810d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 --2- 172.21.15.8:0/3031607770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df80fdde0 0x7f1df810d9b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 -- 172.21.15.8:0/3031607770 >> 172.21.15.8:0/3031607770 conn(0x7f1df806bdd0 msgr2=0x7f1df8101830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 -- 172.21.15.8:0/3031607770 shutdown_connections 2023-10-18T20:57:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:34.946+0000 7f1dfe479700 1 -- 172.21.15.8:0/3031607770 wait complete. 2023-10-18T20:57:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2023-10-18T20:57:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:33.141362+0000 mgr.smithi060.pgqqwa (mgr.14584) 3 : audit [DBG] from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:57:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:33.522322+0000 mgr.smithi060.pgqqwa (mgr.14584) 4 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 20 MiB data, 63 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:57:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:33.668045+0000 mgr.smithi060.pgqqwa (mgr.14584) 5 : audit [DBG] from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:57:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:34.340324+0000 mon.smithi060 (mon.1) 38 : audit [DBG] from='client.? 172.21.15.8:0/2277647846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:57:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:34.407312+0000 mon.smithi008 (mon.0) 585 : cluster [DBG] mgrmap e22: smithi060.pgqqwa(active, since 2s) 2023-10-18T20:57:35.083 INFO:tasks.workunit.client.1.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-18T20:57:35.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.163+0000 7f9152620700 1 -- 172.21.15.8:0/1879165144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c0f9690 msgr2=0x7f914c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.163+0000 7f9152620700 1 --2- 172.21.15.8:0/1879165144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c0f9690 0x7f914c0fbae0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f913c004660 tx=0x7f913c009b30).stop 2023-10-18T20:57:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.164+0000 7f9152620700 1 -- 172.21.15.8:0/1879165144 shutdown_connections 2023-10-18T20:57:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.164+0000 7f9152620700 1 --2- 172.21.15.8:0/1879165144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c0f9690 0x7f914c0fbae0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.164+0000 7f9152620700 1 --2- 172.21.15.8:0/1879165144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f914c060310 0x7f914c0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.164+0000 7f9152620700 1 -- 172.21.15.8:0/1879165144 >> 172.21.15.8:0/1879165144 conn(0x7f914c0f0b90 msgr2=0x7f914c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.164+0000 7f9152620700 1 -- 172.21.15.8:0/1879165144 shutdown_connections 2023-10-18T20:57:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.164+0000 7f9152620700 1 -- 172.21.15.8:0/1879165144 wait complete. 2023-10-18T20:57:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.166+0000 7f9152620700 1 Processor -- start 2023-10-18T20:57:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.166+0000 7f9152620700 1 -- start start 2023-10-18T20:57:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.166+0000 7f9152620700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c060310 0x7f914c10d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.167+0000 7f9152620700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f914c0f9690 0x7f914c10d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:35.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.167+0000 7f9152620700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c10dd80 con 0x7f914c060310 2023-10-18T20:57:35.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.167+0000 7f9152620700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c10dec0 con 0x7f914c0f9690 2023-10-18T20:57:35.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.167+0000 7f915161e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c060310 0x7f914c10d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:35.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.168+0000 7f9150e1d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f914c0f9690 0x7f914c10d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:35.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.168+0000 7f9150e1d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f914c0f9690 0x7f914c10d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:45032/0 (socket says 172.21.15.8:45032) 2023-10-18T20:57:35.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.168+0000 7f9150e1d700 1 -- 172.21.15.8:0/1719186846 learned_addr learned my addr 172.21.15.8:0/1719186846 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:57:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.168+0000 7f9150e1d700 1 -- 172.21.15.8:0/1719186846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c060310 msgr2=0x7f914c10d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.168+0000 7f9150e1d700 1 --2- 172.21.15.8:0/1719186846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c060310 0x7f914c10d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.168+0000 7f9150e1d700 1 -- 172.21.15.8:0/1719186846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c005040 con 0x7f914c0f9690 2023-10-18T20:57:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.168+0000 7f9150e1d700 1 --2- 172.21.15.8:0/1719186846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f914c0f9690 0x7f914c10d7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f913c009870 tx=0x7f913c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:35.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.168+0000 7f9141ffb700 1 -- 172.21.15.8:0/1719186846 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f913c019070 con 0x7f914c0f9690 2023-10-18T20:57:35.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.169+0000 7f9152620700 1 -- 172.21.15.8:0/1719186846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c10e800 con 0x7f914c0f9690 2023-10-18T20:57:35.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.169+0000 7f9152620700 1 -- 172.21.15.8:0/1719186846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c10ece0 con 0x7f914c0f9690 2023-10-18T20:57:35.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.169+0000 7f9141ffb700 1 -- 172.21.15.8:0/1719186846 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f913c013380 con 0x7f914c0f9690 2023-10-18T20:57:35.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.169+0000 7f9141ffb700 1 -- 172.21.15.8:0/1719186846 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f913c01edf0 con 0x7f914c0f9690 2023-10-18T20:57:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.170+0000 7f9141ffb700 1 -- 172.21.15.8:0/1719186846 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 22) v1 ==== 38788+0+0 (secure 0 0 0) 0x7f913c014420 con 0x7f914c0f9690 2023-10-18T20:57:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.171+0000 7f9141ffb700 1 --2- 172.21.15.8:0/1719186846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f9138032680 0x7f9138034b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:57:35.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.171+0000 7f9141ffb700 1 -- 172.21.15.8:0/1719186846 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f913c044e00 con 0x7f914c0f9690 2023-10-18T20:57:35.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.171+0000 7f9152620700 1 -- 172.21.15.8:0/1719186846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c045ad0 con 0x7f914c0f9690 2023-10-18T20:57:35.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.171+0000 7f915161e700 1 --2- 172.21.15.8:0/1719186846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f9138032680 0x7f9138034b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:57:35.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.172+0000 7f915161e700 1 --2- 172.21.15.8:0/1719186846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f9138032680 0x7f9138034b40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9148009fd0 tx=0x7f914800b040).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:57:35.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.181+0000 7f9141ffb700 1 -- 172.21.15.8:0/1719186846 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7f913c014700 con 0x7f914c0f9690 2023-10-18T20:57:35.188 INFO:tasks.workunit.client.1.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-18T20:57:35.258 INFO:tasks.workunit.client.1.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-10-18T20:57:35.262 INFO:tasks.workunit.client.1.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-10-18T20:57:35.262 INFO:tasks.workunit.client.1.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-18T20:57:35.330 INFO:tasks.workunit.client.1.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-10-18T20:57:35.337 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-18T20:57:35.338 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-10-18T20:57:35.386 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-10-18T20:57:35.387 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-10-18T20:57:35.387 DEBUG:teuthology.orchestra.run.smithi060:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-10-18T20:57:35.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.441+0000 7f9152620700 1 -- 172.21.15.8:0/1719186846 --> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f914c0fedd0 con 0x7f9138032680 2023-10-18T20:57:35.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.443+0000 7f9141ffb700 1 -- 172.21.15.8:0/1719186846 <== mgr.14584 v2:172.21.15.60:6828/3545049846 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f914c0fedd0 con 0x7f9138032680 2023-10-18T20:57:35.445 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:57:35.445 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T20:57:35.445 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T20:57:35.445 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T20:57:35.445 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [], 2023-10-18T20:57:35.445 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "1/21 daemons upgraded", 2023-10-18T20:57:35.446 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "", 2023-10-18T20:57:35.446 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T20:57:35.446 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:57:35.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.446+0000 7f9152620700 1 -- 172.21.15.8:0/1719186846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f9138032680 msgr2=0x7f9138034b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:35.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.446+0000 7f9152620700 1 --2- 172.21.15.8:0/1719186846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f9138032680 0x7f9138034b40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9148009fd0 tx=0x7f914800b040).stop 2023-10-18T20:57:35.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.446+0000 7f9152620700 1 -- 172.21.15.8:0/1719186846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f914c0f9690 msgr2=0x7f914c10d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:57:35.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.446+0000 7f9152620700 1 --2- 172.21.15.8:0/1719186846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f914c0f9690 0x7f914c10d7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f913c009870 tx=0x7f913c00b040).stop 2023-10-18T20:57:35.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.446+0000 7f9152620700 1 -- 172.21.15.8:0/1719186846 shutdown_connections 2023-10-18T20:57:35.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.446+0000 7f9152620700 1 --2- 172.21.15.8:0/1719186846 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f9138032680 0x7f9138034b40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.446+0000 7f9152620700 1 --2- 172.21.15.8:0/1719186846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914c060310 0x7f914c10d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.446+0000 7f9152620700 1 --2- 172.21.15.8:0/1719186846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f914c0f9690 0x7f914c10d7d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:57:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.446+0000 7f9152620700 1 -- 172.21.15.8:0/1719186846 >> 172.21.15.8:0/1719186846 conn(0x7f914c0f0b90 msgr2=0x7f914c0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:57:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.447+0000 7f9152620700 1 -- 172.21.15.8:0/1719186846 shutdown_connections 2023-10-18T20:57:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:57:35.447+0000 7f9152620700 1 -- 172.21.15.8:0/1719186846 wait complete. 2023-10-18T20:57:35.496 INFO:tasks.workunit.client.1.smithi060.stderr:+ mkdir -p fsstress 2023-10-18T20:57:35.501 INFO:tasks.workunit.client.1.smithi060.stderr:+ pushd fsstress 2023-10-18T20:57:35.502 INFO:tasks.workunit.client.1.smithi060.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-10-18T20:57:35.502 INFO:tasks.workunit.client.1.smithi060.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-10-18T20:57:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:34.943087+0000 mon.smithi060 (mon.1) 39 : audit [DBG] from='client.? 172.21.15.8:0/3031607770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:57:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:34.943087+0000 mon.smithi060 (mon.1) 39 : audit [DBG] from='client.? 172.21.15.8:0/3031607770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:57:36.630 INFO:tasks.workunit.client.1.smithi060.stderr:+ tar xzf ltp-full.tgz 2023-10-18T20:57:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:35.442923+0000 mgr.smithi060.pgqqwa (mgr.14584) 6 : audit [DBG] from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:57:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:35.522707+0000 mgr.smithi060.pgqqwa (mgr.14584) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 20 MiB data, 63 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:57:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:36.040178+0000 mon.smithi008 (mon.0) 586 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:36.109591+0000 mon.smithi008 (mon.0) 587 : cluster [DBG] Standby manager daemon smithi008.flmjzp started 2023-10-18T20:57:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:36.113851+0000 mon.smithi008 (mon.0) 588 : audit [DBG] from='mgr.? 172.21.15.8:0/2521527924' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi008.flmjzp/crt"}]: dispatch 2023-10-18T20:57:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:36.114764+0000 mon.smithi008 (mon.0) 589 : audit [DBG] from='mgr.? 172.21.15.8:0/2521527924' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:57:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:36.118461+0000 mon.smithi008 (mon.0) 590 : audit [DBG] from='mgr.? 172.21.15.8:0/2521527924' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi008.flmjzp/key"}]: dispatch 2023-10-18T20:57:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:36.118979+0000 mon.smithi008 (mon.0) 591 : audit [DBG] from='mgr.? 172.21.15.8:0/2521527924' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:57:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:35.442923+0000 mgr.smithi060.pgqqwa (mgr.14584) 6 : audit [DBG] from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:57:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:35.522707+0000 mgr.smithi060.pgqqwa (mgr.14584) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 20 MiB data, 63 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:57:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:36.040178+0000 mon.smithi008 (mon.0) 586 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:36.109591+0000 mon.smithi008 (mon.0) 587 : cluster [DBG] Standby manager daemon smithi008.flmjzp started 2023-10-18T20:57:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:36.113851+0000 mon.smithi008 (mon.0) 588 : audit [DBG] from='mgr.? 172.21.15.8:0/2521527924' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi008.flmjzp/crt"}]: dispatch 2023-10-18T20:57:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:36.114764+0000 mon.smithi008 (mon.0) 589 : audit [DBG] from='mgr.? 172.21.15.8:0/2521527924' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:57:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:36.118461+0000 mon.smithi008 (mon.0) 590 : audit [DBG] from='mgr.? 172.21.15.8:0/2521527924' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi008.flmjzp/key"}]: dispatch 2023-10-18T20:57:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:36.118979+0000 mon.smithi008 (mon.0) 591 : audit [DBG] from='mgr.? 172.21.15.8:0/2521527924' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:57:38.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:37.101211+0000 mon.smithi008 (mon.0) 592 : cluster [DBG] mgrmap e23: smithi060.pgqqwa(active, since 5s), standbys: smithi008.flmjzp 2023-10-18T20:57:38.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:37.106078+0000 mon.smithi060 (mon.1) 40 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mgr metadata", "who": "smithi008.flmjzp", "id": "smithi008.flmjzp"}]: dispatch 2023-10-18T20:57:38.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:37.523052+0000 mgr.smithi060.pgqqwa (mgr.14584) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 20 MiB data, 63 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:57:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:37.101211+0000 mon.smithi008 (mon.0) 592 : cluster [DBG] mgrmap e23: smithi060.pgqqwa(active, since 5s), standbys: smithi008.flmjzp 2023-10-18T20:57:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:37.106078+0000 mon.smithi060 (mon.1) 40 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mgr metadata", "who": "smithi008.flmjzp", "id": "smithi008.flmjzp"}]: dispatch 2023-10-18T20:57:38.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:37.523052+0000 mgr.smithi060.pgqqwa (mgr.14584) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 20 MiB data, 63 MiB used, 536 GiB / 536 GiB avail 2023-10-18T20:57:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:38.516250+0000 mon.smithi008 (mon.0) 593 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:39.185268+0000 mon.smithi008 (mon.0) 594 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:39.190539+0000 mon.smithi008 (mon.0) 595 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:39.196142+0000 mon.smithi008 (mon.0) 596 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:39.202744+0000 mon.smithi008 (mon.0) 597 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:39.208594+0000 mon.smithi008 (mon.0) 598 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:38.516250+0000 mon.smithi008 (mon.0) 593 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:39.185268+0000 mon.smithi008 (mon.0) 594 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:39.190539+0000 mon.smithi008 (mon.0) 595 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:39.196142+0000 mon.smithi008 (mon.0) 596 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:39.202744+0000 mon.smithi008 (mon.0) 597 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:39.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:39.208594+0000 mon.smithi008 (mon.0) 598 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:57:39.217670+0000 mgr.smithi060.pgqqwa (mgr.14584) 9 : cephadm [INF] Reconfiguring prometheus.smithi008 (dependencies changed)... 2023-10-18T20:57:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:57:39.241386+0000 mgr.smithi060.pgqqwa (mgr.14584) 10 : cephadm [INF] Reconfiguring daemon prometheus.smithi008 on smithi008 2023-10-18T20:57:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:39.523570+0000 mgr.smithi060.pgqqwa (mgr.14584) 11 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 38 MiB data, 136 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 305 op/s 2023-10-18T20:57:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:57:39.217670+0000 mgr.smithi060.pgqqwa (mgr.14584) 9 : cephadm [INF] Reconfiguring prometheus.smithi008 (dependencies changed)... 2023-10-18T20:57:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:57:39.241386+0000 mgr.smithi060.pgqqwa (mgr.14584) 10 : cephadm [INF] Reconfiguring daemon prometheus.smithi008 on smithi008 2023-10-18T20:57:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:39.523570+0000 mgr.smithi060.pgqqwa (mgr.14584) 11 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 38 MiB data, 136 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 305 op/s 2023-10-18T20:57:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:40.523604+0000 mon.smithi008 (mon.0) 599 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:57:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:40.523604+0000 mon.smithi008 (mon.0) 599 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:57:42.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:41.523994+0000 mgr.smithi060.pgqqwa (mgr.14584) 12 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 38 MiB data, 136 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 237 op/s 2023-10-18T20:57:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:41.523994+0000 mgr.smithi060.pgqqwa (mgr.14584) 12 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 38 MiB data, 136 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 237 op/s 2023-10-18T20:57:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:43.524532+0000 mgr.smithi060.pgqqwa (mgr.14584) 13 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 64 MiB data, 259 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 333 op/s 2023-10-18T20:57:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:43.524532+0000 mgr.smithi060.pgqqwa (mgr.14584) 13 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 64 MiB data, 259 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 333 op/s 2023-10-18T20:57:46.813 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:45.524924+0000 mgr.smithi060.pgqqwa (mgr.14584) 14 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 64 MiB data, 259 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 305 op/s 2023-10-18T20:57:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:45.524924+0000 mgr.smithi060.pgqqwa (mgr.14584) 14 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 64 MiB data, 259 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 305 op/s 2023-10-18T20:57:48.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:47.525405+0000 mgr.smithi060.pgqqwa (mgr.14584) 15 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 64 MiB data, 259 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 305 op/s 2023-10-18T20:57:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:47.525405+0000 mgr.smithi060.pgqqwa (mgr.14584) 15 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 64 MiB data, 259 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 305 op/s 2023-10-18T20:57:50.298 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:49.021743+0000 mon.smithi008 (mon.0) 600 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:50.298 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:49.026342+0000 mon.smithi060 (mon.1) 41 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-10-18T20:57:50.298 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:49.026815+0000 mgr.smithi060.pgqqwa (mgr.14584) 16 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-10-18T20:57:50.299 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:49.027857+0000 mon.smithi060 (mon.1) 42 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi008.front.sepia.ceph.com:9095"}]: dispatch 2023-10-18T20:57:50.299 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:49.028197+0000 mgr.smithi060.pgqqwa (mgr.14584) 17 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi008.front.sepia.ceph.com:9095"}]: dispatch 2023-10-18T20:57:50.299 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:49.032944+0000 mon.smithi008 (mon.0) 601 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:50.299 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:49.035764+0000 mon.smithi060 (mon.1) 43 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:57:50.300 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:49.042571+0000 mon.smithi008 (mon.0) 602 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:50.300 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:57:49.043818+0000 mgr.smithi060.pgqqwa (mgr.14584) 18 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi060.pgqqwa) 2023-10-18T20:57:50.300 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:57:49.044249+0000 mgr.smithi060.pgqqwa (mgr.14584) 19 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi060.pgqqwa) 2023-10-18T20:57:50.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:49.021743+0000 mon.smithi008 (mon.0) 600 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:50.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:49.026342+0000 mon.smithi060 (mon.1) 41 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-10-18T20:57:50.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:49.026815+0000 mgr.smithi060.pgqqwa (mgr.14584) 16 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-10-18T20:57:50.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:49.027857+0000 mon.smithi060 (mon.1) 42 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi008.front.sepia.ceph.com:9095"}]: dispatch 2023-10-18T20:57:50.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:49.028197+0000 mgr.smithi060.pgqqwa (mgr.14584) 17 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi008.front.sepia.ceph.com:9095"}]: dispatch 2023-10-18T20:57:50.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:49.032944+0000 mon.smithi008 (mon.0) 601 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:50.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:49.035764+0000 mon.smithi060 (mon.1) 43 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:57:50.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:49.042571+0000 mon.smithi008 (mon.0) 602 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:50.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:57:49.043818+0000 mgr.smithi060.pgqqwa (mgr.14584) 18 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi060.pgqqwa) 2023-10-18T20:57:50.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:57:49.044249+0000 mgr.smithi060.pgqqwa (mgr.14584) 19 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi060.pgqqwa) 2023-10-18T20:57:51.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:49.526183+0000 mgr.smithi060.pgqqwa (mgr.14584) 20 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 76 MiB data, 308 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 319 op/s 2023-10-18T20:57:51.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:50.339354+0000 mon.smithi008 (mon.0) 603 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:51.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:50.340603+0000 mon.smithi060 (mon.1) 44 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi008.flmjzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:57:51.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:50.340951+0000 mon.smithi008 (mon.0) 604 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi008.flmjzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:57:51.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:50.341886+0000 mon.smithi060 (mon.1) 45 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:57:51.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:57:50.342852+0000 mon.smithi060 (mon.1) 46 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:57:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:49.526183+0000 mgr.smithi060.pgqqwa (mgr.14584) 20 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 76 MiB data, 308 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 319 op/s 2023-10-18T20:57:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:50.339354+0000 mon.smithi008 (mon.0) 603 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:57:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:50.340603+0000 mon.smithi060 (mon.1) 44 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi008.flmjzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:57:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:50.340951+0000 mon.smithi008 (mon.0) 604 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi008.flmjzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:57:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:50.341886+0000 mon.smithi060 (mon.1) 45 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:57:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:57:50.342852+0000 mon.smithi060 (mon.1) 46 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:57:52.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:57:50.334729+0000 mgr.smithi060.pgqqwa (mgr.14584) 21 : cephadm [INF] Upgrade: Updating mgr.smithi008.flmjzp 2023-10-18T20:57:52.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:57:50.343534+0000 mgr.smithi060.pgqqwa (mgr.14584) 22 : cephadm [INF] Deploying daemon mgr.smithi008.flmjzp on smithi008 2023-10-18T20:57:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:57:50.334729+0000 mgr.smithi060.pgqqwa (mgr.14584) 21 : cephadm [INF] Upgrade: Updating mgr.smithi008.flmjzp 2023-10-18T20:57:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:57:50.343534+0000 mgr.smithi060.pgqqwa (mgr.14584) 22 : cephadm [INF] Deploying daemon mgr.smithi008.flmjzp on smithi008 2023-10-18T20:57:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:51.526668+0000 mgr.smithi060.pgqqwa (mgr.14584) 23 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 76 MiB data, 308 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 141 op/s 2023-10-18T20:57:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:51.526668+0000 mgr.smithi060.pgqqwa (mgr.14584) 23 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 76 MiB data, 308 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 141 op/s 2023-10-18T20:57:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:53.527294+0000 mgr.smithi060.pgqqwa (mgr.14584) 24 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 97 MiB data, 362 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.2 MiB/s wr, 305 op/s 2023-10-18T20:57:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:53.527294+0000 mgr.smithi060.pgqqwa (mgr.14584) 24 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 97 MiB data, 362 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.2 MiB/s wr, 305 op/s 2023-10-18T20:57:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:55.527831+0000 mgr.smithi060.pgqqwa (mgr.14584) 25 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 97 MiB data, 362 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 177 op/s 2023-10-18T20:57:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:55.527831+0000 mgr.smithi060.pgqqwa (mgr.14584) 25 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 97 MiB data, 362 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 177 op/s 2023-10-18T20:57:58.596 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:57:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:57.528230+0000 mgr.smithi060.pgqqwa (mgr.14584) 26 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 97 MiB data, 362 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 177 op/s 2023-10-18T20:57:58.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:57:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:57.528230+0000 mgr.smithi060.pgqqwa (mgr.14584) 26 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 97 MiB data, 362 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 177 op/s 2023-10-18T20:58:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:57:59.528664+0000 mgr.smithi060.pgqqwa (mgr.14584) 27 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 137 MiB data, 540 MiB used, 536 GiB / 536 GiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 439 op/s 2023-10-18T20:58:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:57:59.528664+0000 mgr.smithi060.pgqqwa (mgr.14584) 27 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 137 MiB data, 540 MiB used, 536 GiB / 536 GiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 439 op/s 2023-10-18T20:58:02.710 INFO:tasks.workunit.client.0.smithi008.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-10-18T20:58:02.722 INFO:tasks.workunit.client.0.smithi008.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-10-18T20:58:02.722 INFO:tasks.workunit.client.0.smithi008.stderr:+ make 2023-10-18T20:58:02.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:01.529048+0000 mgr.smithi060.pgqqwa (mgr.14584) 28 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 137 MiB data, 540 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 425 op/s 2023-10-18T20:58:02.937 INFO:tasks.workunit.client.0.smithi008.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-10-18T20:58:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:01.529048+0000 mgr.smithi060.pgqqwa (mgr.14584) 28 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 137 MiB data, 540 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 425 op/s 2023-10-18T20:58:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:03.529481+0000 mgr.smithi060.pgqqwa (mgr.14584) 29 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 174 MiB data, 708 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s rd, 8.6 MiB/s wr, 750 op/s 2023-10-18T20:58:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:03.529481+0000 mgr.smithi060.pgqqwa (mgr.14584) 29 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 174 MiB data, 708 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s rd, 8.6 MiB/s wr, 750 op/s 2023-10-18T20:58:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.659+0000 7f5f55568700 1 -- 172.21.15.8:0/3136051734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f500f9690 msgr2=0x7f5f500fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.659+0000 7f5f55568700 1 --2- 172.21.15.8:0/3136051734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f500f9690 0x7f5f500fbae0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f5f44004660 tx=0x7f5f44009b30).stop 2023-10-18T20:58:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.660+0000 7f5f55568700 1 -- 172.21.15.8:0/3136051734 shutdown_connections 2023-10-18T20:58:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.660+0000 7f5f55568700 1 --2- 172.21.15.8:0/3136051734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f500f9690 0x7f5f500fbae0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.660+0000 7f5f55568700 1 --2- 172.21.15.8:0/3136051734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f50060310 0x7f5f500f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.660+0000 7f5f55568700 1 -- 172.21.15.8:0/3136051734 >> 172.21.15.8:0/3136051734 conn(0x7f5f500f0b90 msgr2=0x7f5f500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.660+0000 7f5f55568700 1 -- 172.21.15.8:0/3136051734 shutdown_connections 2023-10-18T20:58:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.660+0000 7f5f55568700 1 -- 172.21.15.8:0/3136051734 wait complete. 2023-10-18T20:58:05.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.661+0000 7f5f55568700 1 Processor -- start 2023-10-18T20:58:05.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.661+0000 7f5f55568700 1 -- start start 2023-10-18T20:58:05.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.662+0000 7f5f55568700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f50060310 0x7f5f50108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:05.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.662+0000 7f5f55568700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f500f9690 0x7f5f50109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:05.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.662+0000 7f5f55568700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f501099b0 con 0x7f5f500f9690 2023-10-18T20:58:05.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.662+0000 7f5f55568700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50109af0 con 0x7f5f50060310 2023-10-18T20:58:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.662+0000 7f5f4f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f500f9690 0x7f5f50109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.662+0000 7f5f4ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f50060310 0x7f5f50108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.662+0000 7f5f4ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f50060310 0x7f5f50108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:48222/0 (socket says 172.21.15.8:48222) 2023-10-18T20:58:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.662+0000 7f5f4ffff700 1 -- 172.21.15.8:0/228752637 learned_addr learned my addr 172.21.15.8:0/228752637 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.663+0000 7f5f4ffff700 1 -- 172.21.15.8:0/228752637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f500f9690 msgr2=0x7f5f50109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.663+0000 7f5f4ffff700 1 --2- 172.21.15.8:0/228752637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f500f9690 0x7f5f50109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.663+0000 7f5f4ffff700 1 -- 172.21.15.8:0/228752637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44005040 con 0x7f5f50060310 2023-10-18T20:58:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.663+0000 7f5f4ffff700 1 --2- 172.21.15.8:0/228752637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f50060310 0x7f5f50108f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5f4000e7f0 tx=0x7f5f4000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.663+0000 7f5f4cff9700 1 -- 172.21.15.8:0/228752637 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f400092e0 con 0x7f5f50060310 2023-10-18T20:58:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.663+0000 7f5f55568700 1 -- 172.21.15.8:0/228752637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5010a490 con 0x7f5f50060310 2023-10-18T20:58:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.663+0000 7f5f4cff9700 1 -- 172.21.15.8:0/228752637 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5f4000f040 con 0x7f5f50060310 2023-10-18T20:58:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.663+0000 7f5f4cff9700 1 -- 172.21.15.8:0/228752637 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f400147e0 con 0x7f5f50060310 2023-10-18T20:58:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.663+0000 7f5f55568700 1 -- 172.21.15.8:0/228752637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5010a9d0 con 0x7f5f50060310 2023-10-18T20:58:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.665+0000 7f5f55568700 1 -- 172.21.15.8:0/228752637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f50045ad0 con 0x7f5f50060310 2023-10-18T20:58:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.665+0000 7f5f4cff9700 1 -- 172.21.15.8:0/228752637 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 74712+0+0 (secure 0 0 0) 0x7f5f4001b030 con 0x7f5f50060310 2023-10-18T20:58:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.666+0000 7f5f4cff9700 1 --2- 172.21.15.8:0/228752637 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f5f3805e9c0 0x7f5f38060e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.666+0000 7f5f4cff9700 1 -- 172.21.15.8:0/228752637 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5f40078e30 con 0x7f5f50060310 2023-10-18T20:58:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.666+0000 7f5f4f7fe700 1 --2- 172.21.15.8:0/228752637 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f5f3805e9c0 0x7f5f38060e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.667+0000 7f5f4f7fe700 1 --2- 172.21.15.8:0/228752637 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f5f3805e9c0 0x7f5f38060e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5f44005010 tx=0x7f5f44016040).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.672+0000 7f5f4cff9700 1 -- 172.21.15.8:0/228752637 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7f5f4004ce60 con 0x7f5f50060310 2023-10-18T20:58:05.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.919+0000 7f5f55568700 1 -- 172.21.15.8:0/228752637 --> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f500f5650 con 0x7f5f3805e9c0 2023-10-18T20:58:05.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.922+0000 7f5f4cff9700 1 -- 172.21.15.8:0/228752637 <== mgr.14584 v2:172.21.15.60:6828/3545049846 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f5f500f5650 con 0x7f5f3805e9c0 2023-10-18T20:58:05.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.925+0000 7f5f55568700 1 -- 172.21.15.8:0/228752637 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f5f3805e9c0 msgr2=0x7f5f38060e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:05.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.925+0000 7f5f55568700 1 --2- 172.21.15.8:0/228752637 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f5f3805e9c0 0x7f5f38060e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5f44005010 tx=0x7f5f44016040).stop 2023-10-18T20:58:05.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.925+0000 7f5f55568700 1 -- 172.21.15.8:0/228752637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f50060310 msgr2=0x7f5f50108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:05.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.925+0000 7f5f55568700 1 --2- 172.21.15.8:0/228752637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f50060310 0x7f5f50108f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5f4000e7f0 tx=0x7f5f4000b040).stop 2023-10-18T20:58:05.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.925+0000 7f5f55568700 1 -- 172.21.15.8:0/228752637 shutdown_connections 2023-10-18T20:58:05.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.925+0000 7f5f55568700 1 --2- 172.21.15.8:0/228752637 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f5f3805e9c0 0x7f5f38060e80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:05.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.925+0000 7f5f55568700 1 --2- 172.21.15.8:0/228752637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f50060310 0x7f5f50108f10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:05.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.925+0000 7f5f55568700 1 --2- 172.21.15.8:0/228752637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f500f9690 0x7f5f50109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:05.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.925+0000 7f5f55568700 1 -- 172.21.15.8:0/228752637 >> 172.21.15.8:0/228752637 conn(0x7f5f500f0b90 msgr2=0x7f5f500f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:05.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.925+0000 7f5f55568700 1 -- 172.21.15.8:0/228752637 shutdown_connections 2023-10-18T20:58:05.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:05.926+0000 7f5f55568700 1 -- 172.21.15.8:0/228752637 wait complete. 2023-10-18T20:58:05.942 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T20:58:06.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.072+0000 7f898359e700 1 -- 172.21.15.8:0/4207660150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89840f6530 msgr2=0x7f89840f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.072+0000 7f898359e700 1 --2- 172.21.15.8:0/4207660150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89840f6530 0x7f89840f6950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f8974004660 tx=0x7f8974009b30).stop 2023-10-18T20:58:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.073+0000 7f898359e700 1 -- 172.21.15.8:0/4207660150 shutdown_connections 2023-10-18T20:58:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.073+0000 7f898359e700 1 --2- 172.21.15.8:0/4207660150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89840f77d0 0x7f89840f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.073+0000 7f898359e700 1 --2- 172.21.15.8:0/4207660150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89840f6530 0x7f89840f6950 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.073+0000 7f898359e700 1 -- 172.21.15.8:0/4207660150 >> 172.21.15.8:0/4207660150 conn(0x7f89840f1c90 msgr2=0x7f89840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:06.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.073+0000 7f898359e700 1 -- 172.21.15.8:0/4207660150 shutdown_connections 2023-10-18T20:58:06.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.073+0000 7f898359e700 1 -- 172.21.15.8:0/4207660150 wait complete. 2023-10-18T20:58:06.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.074+0000 7f898359e700 1 Processor -- start 2023-10-18T20:58:06.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.074+0000 7f898359e700 1 -- start start 2023-10-18T20:58:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.074+0000 7f898359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89840f6530 0x7f8984108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.074+0000 7f898359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89840f77d0 0x7f8984109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.074+0000 7f898359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89841099e0 con 0x7f89840f6530 2023-10-18T20:58:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.074+0000 7f898359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8984109b20 con 0x7f89840f77d0 2023-10-18T20:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.075+0000 7f898259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89840f6530 0x7f8984108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.075+0000 7f8981d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89840f77d0 0x7f8984109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.075+0000 7f898259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89840f6530 0x7f8984108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38228/0 (socket says 172.21.15.8:38228) 2023-10-18T20:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.075+0000 7f8981d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89840f77d0 0x7f8984109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:48234/0 (socket says 172.21.15.8:48234) 2023-10-18T20:58:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.075+0000 7f898259c700 1 -- 172.21.15.8:0/2182473240 learned_addr learned my addr 172.21.15.8:0/2182473240 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.075+0000 7f8981d9b700 1 -- 172.21.15.8:0/2182473240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89840f6530 msgr2=0x7f8984108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.075+0000 7f8981d9b700 1 --2- 172.21.15.8:0/2182473240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89840f6530 0x7f8984108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.075+0000 7f8981d9b700 1 -- 172.21.15.8:0/2182473240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8974005040 con 0x7f89840f77d0 2023-10-18T20:58:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.076+0000 7f8981d9b700 1 --2- 172.21.15.8:0/2182473240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89840f77d0 0x7f8984109430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f897800e7c0 tx=0x7f897800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:06.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.076+0000 7f8972ffd700 1 -- 172.21.15.8:0/2182473240 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89780092e0 con 0x7f89840f77d0 2023-10-18T20:58:06.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.076+0000 7f8972ffd700 1 -- 172.21.15.8:0/2182473240 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f897800f040 con 0x7f89840f77d0 2023-10-18T20:58:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.076+0000 7f8972ffd700 1 -- 172.21.15.8:0/2182473240 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8978014920 con 0x7f89840f77d0 2023-10-18T20:58:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.076+0000 7f898359e700 1 -- 172.21.15.8:0/2182473240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898410a4c0 con 0x7f89840f77d0 2023-10-18T20:58:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.076+0000 7f898359e700 1 -- 172.21.15.8:0/2182473240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898410a9b0 con 0x7f89840f77d0 2023-10-18T20:58:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.078+0000 7f8972ffd700 1 -- 172.21.15.8:0/2182473240 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 74712+0+0 (secure 0 0 0) 0x7f897801b030 con 0x7f89840f77d0 2023-10-18T20:58:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.078+0000 7f898359e700 1 -- 172.21.15.8:0/2182473240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8984045ad0 con 0x7f89840f77d0 2023-10-18T20:58:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.079+0000 7f8972ffd700 1 --2- 172.21.15.8:0/2182473240 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f896c05e9b0 0x7f896c060e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.079+0000 7f8972ffd700 1 -- 172.21.15.8:0/2182473240 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8978078ff0 con 0x7f89840f77d0 2023-10-18T20:58:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.080+0000 7f898259c700 1 --2- 172.21.15.8:0/2182473240 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f896c05e9b0 0x7f896c060e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.080+0000 7f898259c700 1 --2- 172.21.15.8:0/2182473240 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f896c05e9b0 0x7f896c060e70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8974009720 tx=0x7f8974016040).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:06.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.083+0000 7f8972ffd700 1 -- 172.21.15.8:0/2182473240 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7f897804ce90 con 0x7f89840f77d0 2023-10-18T20:58:06.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.327+0000 7f898359e700 1 -- 172.21.15.8:0/2182473240 --> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8984101020 con 0x7f896c05e9b0 2023-10-18T20:58:06.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.329+0000 7f8972ffd700 1 -- 172.21.15.8:0/2182473240 <== mgr.14584 v2:172.21.15.60:6828/3545049846 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f8984101020 con 0x7f896c05e9b0 2023-10-18T20:58:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 -- 172.21.15.8:0/2182473240 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f896c05e9b0 msgr2=0x7f896c060e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 --2- 172.21.15.8:0/2182473240 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f896c05e9b0 0x7f896c060e70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8974009720 tx=0x7f8974016040).stop 2023-10-18T20:58:06.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 -- 172.21.15.8:0/2182473240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89840f77d0 msgr2=0x7f8984109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:06.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 --2- 172.21.15.8:0/2182473240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89840f77d0 0x7f8984109430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f897800e7c0 tx=0x7f897800b040).stop 2023-10-18T20:58:06.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 -- 172.21.15.8:0/2182473240 shutdown_connections 2023-10-18T20:58:06.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 --2- 172.21.15.8:0/2182473240 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f896c05e9b0 0x7f896c060e70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 --2- 172.21.15.8:0/2182473240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89840f6530 0x7f8984108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 --2- 172.21.15.8:0/2182473240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89840f77d0 0x7f8984109430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 -- 172.21.15.8:0/2182473240 >> 172.21.15.8:0/2182473240 conn(0x7f89840f1c90 msgr2=0x7f89840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:06.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 -- 172.21.15.8:0/2182473240 shutdown_connections 2023-10-18T20:58:06.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.331+0000 7f898359e700 1 -- 172.21.15.8:0/2182473240 wait complete. 2023-10-18T20:58:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.505+0000 7fbc94e9f700 1 -- 172.21.15.8:0/743351468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc900f6530 msgr2=0x7fbc900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.505+0000 7fbc94e9f700 1 --2- 172.21.15.8:0/743351468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc900f6530 0x7fbc900f6950 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fbc80004660 tx=0x7fbc80009b30).stop 2023-10-18T20:58:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.505+0000 7fbc94e9f700 1 -- 172.21.15.8:0/743351468 shutdown_connections 2023-10-18T20:58:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.505+0000 7fbc94e9f700 1 --2- 172.21.15.8:0/743351468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900f77d0 0x7fbc900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:58:06.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.505+0000 7fbc94e9f700 1 --2- 172.21.15.8:0/743351468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc900f6530 0x7fbc900f6950 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.505+0000 7fbc94e9f700 1 -- 172.21.15.8:0/743351468 >> 172.21.15.8:0/743351468 conn(0x7fbc900f1c90 msgr2=0x7fbc900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:06.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.505+0000 7fbc94e9f700 1 -- 172.21.15.8:0/743351468 shutdown_connections 2023-10-18T20:58:06.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.505+0000 7fbc94e9f700 1 -- 172.21.15.8:0/743351468 wait complete. 2023-10-18T20:58:06.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.506+0000 7fbc94e9f700 1 Processor -- start 2023-10-18T20:58:06.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.506+0000 7fbc94e9f700 1 -- start start 2023-10-18T20:58:06.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.507+0000 7fbc94e9f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900f6530 0x7fbc90108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:06.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.507+0000 7fbc94e9f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc900f77d0 0x7fbc901094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:06.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.507+0000 7fbc94e9f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90109af0 con 0x7fbc900f6530 2023-10-18T20:58:06.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.507+0000 7fbc94e9f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9010a3a0 con 0x7fbc900f77d0 2023-10-18T20:58:06.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.507+0000 7fbc8effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc900f77d0 0x7fbc901094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.507+0000 7fbc8effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc900f77d0 0x7fbc901094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:48256/0 (socket says 172.21.15.8:48256) 2023-10-18T20:58:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.507+0000 7fbc8effd700 1 -- 172.21.15.8:0/366430275 learned_addr learned my addr 172.21.15.8:0/366430275 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.508+0000 7fbc8f7fe700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900f6530 0x7fbc90108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.508+0000 7fbc8effd700 1 -- 172.21.15.8:0/366430275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900f6530 msgr2=0x7fbc90108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.508+0000 7fbc8effd700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900f6530 0x7fbc90108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.508+0000 7fbc8effd700 1 -- 172.21.15.8:0/366430275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc80005040 con 0x7fbc900f77d0 2023-10-18T20:58:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.508+0000 7fbc8f7fe700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900f6530 0x7fbc90108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T20:58:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.508+0000 7fbc8effd700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc900f77d0 0x7fbc901094b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbc8400b410 tx=0x7fbc84006ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.509+0000 7fbc77fff700 1 -- 172.21.15.8:0/366430275 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc840125f0 con 0x7fbc900f77d0 2023-10-18T20:58:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.509+0000 7fbc77fff700 1 -- 172.21.15.8:0/366430275 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbc84012c10 con 0x7fbc900f77d0 2023-10-18T20:58:06.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.509+0000 7fbc77fff700 1 -- 172.21.15.8:0/366430275 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc84002b00 con 0x7fbc900f77d0 2023-10-18T20:58:06.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.509+0000 7fbc94e9f700 1 -- 172.21.15.8:0/366430275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9010a680 con 0x7fbc900f77d0 2023-10-18T20:58:06.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.509+0000 7fbc94e9f700 1 -- 172.21.15.8:0/366430275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9010ac40 con 0x7fbc900f77d0 2023-10-18T20:58:06.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.510+0000 7fbc94e9f700 1 -- 172.21.15.8:0/366430275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc90059100 con 0x7fbc900f77d0 2023-10-18T20:58:06.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.511+0000 7fbc77fff700 1 -- 172.21.15.8:0/366430275 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 74712+0+0 (secure 0 0 0) 0x7fbc8400f030 con 0x7fbc900f77d0 2023-10-18T20:58:06.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.513+0000 7fbc77fff700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fbc7805e9c0 0x7fbc78060e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:06.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.513+0000 7fbc77fff700 1 -- 172.21.15.8:0/366430275 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbc84079500 con 0x7fbc900f77d0 2023-10-18T20:58:06.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.514+0000 7fbc8f7fe700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fbc7805e9c0 0x7fbc78060e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:06.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.514+0000 7fbc8f7fe700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fbc7805e9c0 0x7fbc78060e80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fbc80004e30 tx=0x7fbc80009b30).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:06.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.517+0000 7fbc77fff700 1 -- 172.21.15.8:0/366430275 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7fbc8404d440 con 0x7fbc900f77d0 2023-10-18T20:58:06.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.727+0000 7fbc94e9f700 1 -- 172.21.15.8:0/366430275 --> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc900fee10 con 0x7fbc7805e9c0 2023-10-18T20:58:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.738+0000 7fbc77fff700 1 -- 172.21.15.8:0/366430275 <== mgr.14584 v2:172.21.15.60:6828/3545049846 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fbc900fee10 con 0x7fbc7805e9c0 2023-10-18T20:58:06.741 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T20:58:06.741 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (4m) 28s ago 6m 9.94M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T20:58:06.741 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (6m) 28s ago 6m 7256k - 16.2.4 8d91d370c2b8 4b2c6838af84 2023-10-18T20:58:06.742 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (5m) 30s ago 5m 7562k - 16.2.4 8d91d370c2b8 67dc04156fe1 2023-10-18T20:58:06.742 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (4m) 28s ago 5m 23.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T20:58:06.742 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (2m) 28s ago 2m 363M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T20:58:06.742 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (2m) 28s ago 2m 63.7M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T20:58:06.742 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (2m) 30s ago 2m 17.6M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T20:58:06.743 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (2m) 30s ago 2m 16.6M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T20:58:06.743 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:9283 running (7m) 28s ago 7m 248M - 16.2.4 8d91d370c2b8 ee1a6b0bd8ee 2023-10-18T20:58:06.743 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (43s) 30s ago 5m 429M - 16.2.14-100-gb4ddd52c 92842c92b8bd 32f95b673b2b 2023-10-18T20:58:06.743 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (7m) 28s ago 7m 103M 2048M 16.2.4 8d91d370c2b8 9de89e6e28e5 2023-10-18T20:58:06.743 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (5m) 30s ago 5m 93.1M 2048M 16.2.4 8d91d370c2b8 d7c00f2c13a4 2023-10-18T20:58:06.744 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (5m) 28s ago 5m 9353k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T20:58:06.744 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (5m) 30s ago 5m 9596k - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T20:58:06.744 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (4m) 28s ago 4m 69.0M 4096M 16.2.4 8d91d370c2b8 885270808f90 2023-10-18T20:58:06.744 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (4m) 28s ago 4m 63.2M 4096M 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T20:58:06.744 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (4m) 28s ago 4m 54.8M 4096M 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T20:58:06.745 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (3m) 30s ago 3m 69.8M 4096M 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T20:58:06.745 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (3m) 30s ago 3m 60.2M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T20:58:06.745 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (3m) 30s ago 3m 69.9M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T20:58:06.745 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 starting - - - - 2023-10-18T20:58:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.741+0000 7fbc94e9f700 1 -- 172.21.15.8:0/366430275 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fbc7805e9c0 msgr2=0x7fbc78060e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.741+0000 7fbc94e9f700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fbc7805e9c0 0x7fbc78060e80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fbc80004e30 tx=0x7fbc80009b30).stop 2023-10-18T20:58:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.741+0000 7fbc94e9f700 1 -- 172.21.15.8:0/366430275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc900f77d0 msgr2=0x7fbc901094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.741+0000 7fbc94e9f700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc900f77d0 0x7fbc901094b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbc8400b410 tx=0x7fbc84006ef0).stop 2023-10-18T20:58:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.741+0000 7fbc94e9f700 1 -- 172.21.15.8:0/366430275 shutdown_connections 2023-10-18T20:58:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.741+0000 7fbc94e9f700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fbc7805e9c0 0x7fbc78060e80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.741+0000 7fbc94e9f700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900f6530 0x7fbc90108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.741+0000 7fbc94e9f700 1 --2- 172.21.15.8:0/366430275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc900f77d0 0x7fbc901094b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.741+0000 7fbc94e9f700 1 -- 172.21.15.8:0/366430275 >> 172.21.15.8:0/366430275 conn(0x7fbc900f1c90 msgr2=0x7fbc9006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:06.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.741+0000 7fbc94e9f700 1 -- 172.21.15.8:0/366430275 shutdown_connections 2023-10-18T20:58:06.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.742+0000 7fbc94e9f700 1 -- 172.21.15.8:0/366430275 wait complete. 2023-10-18T20:58:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:05.529802+0000 mgr.smithi060.pgqqwa (mgr.14584) 30 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 174 MiB data, 708 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 587 op/s 2023-10-18T20:58:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:05.923068+0000 mgr.smithi060.pgqqwa (mgr.14584) 31 : audit [DBG] from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:06.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:05.529802+0000 mgr.smithi060.pgqqwa (mgr.14584) 30 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 174 MiB data, 708 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 587 op/s 2023-10-18T20:58:06.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:05.923068+0000 mgr.smithi060.pgqqwa (mgr.14584) 31 : audit [DBG] from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:07.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.886+0000 7f712b4bb700 1 -- 172.21.15.8:0/1711095192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71240f6530 msgr2=0x7f71240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:07.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.886+0000 7f712b4bb700 1 --2- 172.21.15.8:0/1711095192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71240f6530 0x7f71240f6950 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f7120004660 tx=0x7f7120009b30).stop 2023-10-18T20:58:07.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.886+0000 7f712b4bb700 1 -- 172.21.15.8:0/1711095192 shutdown_connections 2023-10-18T20:58:07.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.886+0000 7f712b4bb700 1 --2- 172.21.15.8:0/1711095192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71240f77d0 0x7f71240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:07.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.886+0000 7f712b4bb700 1 --2- 172.21.15.8:0/1711095192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71240f6530 0x7f71240f6950 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:07.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.886+0000 7f712b4bb700 1 -- 172.21.15.8:0/1711095192 >> 172.21.15.8:0/1711095192 conn(0x7f71240f1c70 msgr2=0x7f71240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:07.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.886+0000 7f712b4bb700 1 -- 172.21.15.8:0/1711095192 shutdown_connections 2023-10-18T20:58:07.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.886+0000 7f712b4bb700 1 -- 172.21.15.8:0/1711095192 wait complete. 2023-10-18T20:58:07.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.887+0000 7f712b4bb700 1 Processor -- start 2023-10-18T20:58:07.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.887+0000 7f712b4bb700 1 -- start start 2023-10-18T20:58:07.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.887+0000 7f712b4bb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71240f6530 0x7f7124106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:07.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.887+0000 7f712b4bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71240f77d0 0x7f71241072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:07.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.887+0000 7f712b4bb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71241078b0 con 0x7f71240f6530 2023-10-18T20:58:07.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.887+0000 7f712b4bb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71241080f0 con 0x7f71240f77d0 2023-10-18T20:58:07.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.888+0000 7f712a4b9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71240f6530 0x7f7124106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:07.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.888+0000 7f712a4b9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71240f6530 0x7f7124106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39928/0 (socket says 172.21.15.8:39928) 2023-10-18T20:58:07.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.888+0000 7f712a4b9700 1 -- 172.21.15.8:0/2891203627 learned_addr learned my addr 172.21.15.8:0/2891203627 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:07.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.888+0000 7f7129cb8700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71240f77d0 0x7f71241072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:07.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.888+0000 7f712a4b9700 1 -- 172.21.15.8:0/2891203627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71240f77d0 msgr2=0x7f71241072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:07.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.888+0000 7f712a4b9700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71240f77d0 0x7f71241072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:07.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.888+0000 7f712a4b9700 1 -- 172.21.15.8:0/2891203627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7120005040 con 0x7f71240f6530 2023-10-18T20:58:07.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.888+0000 7f712a4b9700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71240f6530 0x7f7124106dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f7120014040 tx=0x7f712000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:07.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.888+0000 7f711affd700 1 -- 172.21.15.8:0/2891203627 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7120019070 con 0x7f71240f6530 2023-10-18T20:58:07.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.889+0000 7f711affd700 1 -- 172.21.15.8:0/2891203627 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f712001e420 con 0x7f71240f6530 2023-10-18T20:58:07.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.889+0000 7f712b4bb700 1 -- 172.21.15.8:0/2891203627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7124108370 con 0x7f71240f6530 2023-10-18T20:58:07.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.889+0000 7f711affd700 1 -- 172.21.15.8:0/2891203627 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7120014660 con 0x7f71240f6530 2023-10-18T20:58:07.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.889+0000 7f712b4bb700 1 -- 172.21.15.8:0/2891203627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7124108850 con 0x7f71240f6530 2023-10-18T20:58:07.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.890+0000 7f712b4bb700 1 -- 172.21.15.8:0/2891203627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7124059100 con 0x7f71240f6530 2023-10-18T20:58:07.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.891+0000 7f711affd700 1 -- 172.21.15.8:0/2891203627 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 74712+0+0 (secure 0 0 0) 0x7f712001e9e0 con 0x7f71240f6530 2023-10-18T20:58:07.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.892+0000 7f711affd700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f711005e9b0 0x7f7110060e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:07.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.892+0000 7f711affd700 1 -- 172.21.15.8:0/2891203627 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f712007a520 con 0x7f71240f6530 2023-10-18T20:58:07.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.892+0000 7f7129cb8700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f711005e9b0 0x7f7110060e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:07.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.893+0000 7f7129cb8700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f711005e9b0 0x7f7110060e70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7124106b50 tx=0x7f711400b040).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:07.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:06.897+0000 7f711affd700 1 -- 172.21.15.8:0/2891203627 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7f712004aa70 con 0x7f71240f6530 2023-10-18T20:58:07.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.176+0000 7f712b4bb700 1 -- 172.21.15.8:0/2891203627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f71240fecc0 con 0x7f71240f6530 2023-10-18T20:58:07.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.178+0000 7f711affd700 1 -- 172.21.15.8:0/2891203627 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f712004e090 con 0x7f71240f6530 2023-10-18T20:58:07.184 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:58:07.185 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T20:58:07.185 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T20:58:07.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:58:07.185 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T20:58:07.185 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1, 2023-10-18T20:58:07.186 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2023-10-18T20:58:07.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:58:07.186 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T20:58:07.186 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-10-18T20:58:07.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:58:07.187 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T20:58:07.187 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T20:58:07.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:58:07.187 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T20:58:07.187 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1, 2023-10-18T20:58:07.187 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 13 2023-10-18T20:58:07.188 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T20:58:07.188 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:58:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.184+0000 7f712b4bb700 1 -- 172.21.15.8:0/2891203627 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f711005e9b0 msgr2=0x7f7110060e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.184+0000 7f712b4bb700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f711005e9b0 0x7f7110060e70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7124106b50 tx=0x7f711400b040).stop 2023-10-18T20:58:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.184+0000 7f712b4bb700 1 -- 172.21.15.8:0/2891203627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71240f6530 msgr2=0x7f7124106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.184+0000 7f712b4bb700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71240f6530 0x7f7124106dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f7120014040 tx=0x7f712000b040).stop 2023-10-18T20:58:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.184+0000 7f712b4bb700 1 -- 172.21.15.8:0/2891203627 shutdown_connections 2023-10-18T20:58:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.184+0000 7f712b4bb700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7f711005e9b0 0x7f7110060e70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.184+0000 7f712b4bb700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71240f6530 0x7f7124106dc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.184+0000 7f712b4bb700 1 --2- 172.21.15.8:0/2891203627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71240f77d0 0x7f71241072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:07.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.184+0000 7f712b4bb700 1 -- 172.21.15.8:0/2891203627 >> 172.21.15.8:0/2891203627 conn(0x7f71240f1c70 msgr2=0x7f71240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:07.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.185+0000 7f712b4bb700 1 -- 172.21.15.8:0/2891203627 shutdown_connections 2023-10-18T20:58:07.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.185+0000 7f712b4bb700 1 -- 172.21.15.8:0/2891203627 wait complete. 2023-10-18T20:58:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.447+0000 7fedae7e7700 1 -- 172.21.15.8:0/1273104312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feda80f77d0 msgr2=0x7feda80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.447+0000 7fedae7e7700 1 --2- 172.21.15.8:0/1273104312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feda80f77d0 0x7feda80f7c30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7feda0009a30 tx=0x7feda0004c50).stop 2023-10-18T20:58:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.448+0000 7fedae7e7700 1 -- 172.21.15.8:0/1273104312 shutdown_connections 2023-10-18T20:58:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.448+0000 7fedae7e7700 1 --2- 172.21.15.8:0/1273104312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feda80f77d0 0x7feda80f7c30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.448+0000 7fedae7e7700 1 --2- 172.21.15.8:0/1273104312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feda80f6530 0x7feda80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.448+0000 7fedae7e7700 1 -- 172.21.15.8:0/1273104312 >> 172.21.15.8:0/1273104312 conn(0x7feda80f1c90 msgr2=0x7feda80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.448+0000 7fedae7e7700 1 -- 172.21.15.8:0/1273104312 shutdown_connections 2023-10-18T20:58:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.448+0000 7fedae7e7700 1 -- 172.21.15.8:0/1273104312 wait complete. 2023-10-18T20:58:07.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.449+0000 7fedae7e7700 1 Processor -- start 2023-10-18T20:58:07.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.449+0000 7fedae7e7700 1 -- start start 2023-10-18T20:58:07.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.450+0000 7fedae7e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feda80f6530 0x7feda8109260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:07.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.450+0000 7fedae7e7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feda8109750 0x7feda810a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:07.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.450+0000 7fedae7e7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda8109c20 con 0x7feda80f6530 2023-10-18T20:58:07.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.450+0000 7fedae7e7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda8109d60 con 0x7feda8109750 2023-10-18T20:58:07.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.451+0000 7fedacfe4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feda8109750 0x7feda810a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:07.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.451+0000 7fedacfe4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feda8109750 0x7feda810a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:35322/0 (socket says 172.21.15.8:35322) 2023-10-18T20:58:07.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.451+0000 7fedacfe4700 1 -- 172.21.15.8:0/2841151313 learned_addr learned my addr 172.21.15.8:0/2841151313 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:07.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.452+0000 7fedacfe4700 1 -- 172.21.15.8:0/2841151313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feda80f6530 msgr2=0x7feda8109260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:07.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.452+0000 7fedacfe4700 1 --2- 172.21.15.8:0/2841151313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feda80f6530 0x7feda8109260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:58:07.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.452+0000 7fedacfe4700 1 -- 172.21.15.8:0/2841151313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda0009640 con 0x7feda8109750 2023-10-18T20:58:07.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.453+0000 7fedacfe4700 1 --2- 172.21.15.8:0/2841151313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feda8109750 0x7feda810a640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7feda0009950 tx=0x7feda0004c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:07.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.457+0000 7fed9dffb700 1 -- 172.21.15.8:0/2841151313 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda000e070 con 0x7feda8109750 2023-10-18T20:58:07.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.457+0000 7fed9dffb700 1 -- 172.21.15.8:0/2841151313 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7feda0007da0 con 0x7feda8109750 2023-10-18T20:58:07.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.457+0000 7fed9dffb700 1 -- 172.21.15.8:0/2841151313 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda0019070 con 0x7feda8109750 2023-10-18T20:58:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.457+0000 7fedae7e7700 1 -- 172.21.15.8:0/2841151313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda810ab90 con 0x7feda8109750 2023-10-18T20:58:07.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.458+0000 7fedae7e7700 1 -- 172.21.15.8:0/2841151313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda810b020 con 0x7feda8109750 2023-10-18T20:58:07.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.460+0000 7fed8b7fe700 1 -- 172.21.15.8:0/2841151313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed84004fa0 con 0x7feda8109750 2023-10-18T20:58:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.464+0000 7fed9dffb700 1 -- 172.21.15.8:0/2841151313 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 74712+0+0 (secure 0 0 0) 0x7feda0025060 con 0x7feda8109750 2023-10-18T20:58:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.466+0000 7fed9dffb700 1 --2- 172.21.15.8:0/2841151313 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fed9405ea10 0x7fed94060ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.466+0000 7fed9dffb700 1 -- 172.21.15.8:0/2841151313 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7feda007a6b0 con 0x7feda8109750 2023-10-18T20:58:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.466+0000 7fedad7e5700 1 --2- 172.21.15.8:0/2841151313 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fed9405ea10 0x7fed94060ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.468+0000 7fedad7e5700 1 --2- 172.21.15.8:0/2841151313 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fed9405ea10 0x7fed94060ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fed980043d0 tx=0x7fed98004320).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.482+0000 7fed9dffb700 1 -- 172.21.15.8:0/2841151313 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7feda004e760 con 0x7feda8109750 2023-10-18T20:58:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:06.329913+0000 mgr.smithi060.pgqqwa (mgr.14584) 32 : audit [DBG] from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:06.729585+0000 mgr.smithi060.pgqqwa (mgr.14584) 33 : audit [DBG] from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:07.178919+0000 mon.smithi008 (mon.0) 605 : audit [DBG] from='client.? 172.21.15.8:0/2891203627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:58:07.986 INFO:teuthology.orchestra.run.smithi008.stdout:e16 2023-10-18T20:58:07.987 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:58:07.987 INFO:teuthology.orchestra.run.smithi008.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:58:07.987 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T20:58:07.987 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:58:07.988 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T20:58:07.988 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T20:58:07.988 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 16 2023-10-18T20:58:07.988 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T20:58:07.988 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:58:07.989 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:57:40.516856+0000 2023-10-18T20:58:07.989 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T20:58:07.989 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T20:58:07.989 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T20:58:07.989 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T20:58:07.990 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T20:58:07.990 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T20:58:07.990 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T20:58:07.990 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T20:58:07.990 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:58:07.991 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T20:58:07.991 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T20:58:07.991 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T20:58:07.991 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T20:58:07.991 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T20:58:07.992 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T20:58:07.992 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T20:58:07.992 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T20:58:07.992 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T20:58:07.992 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T20:58:07.993 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T20:58:07.993 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015]] 2023-10-18T20:58:07.993 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531]] 2023-10-18T20:58:07.993 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145]] 2023-10-18T20:58:07.993 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799]] 2023-10-18T20:58:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:58:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:58:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.979+0000 7fed8b7fe700 1 -- 172.21.15.8:0/2841151313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fed84005e80 con 0x7feda8109750 2023-10-18T20:58:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.980+0000 7fed9dffb700 1 -- 172.21.15.8:0/2841151313 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1630 (secure 0 0 0) 0x7feda004e350 con 0x7feda8109750 2023-10-18T20:58:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 -- 172.21.15.8:0/2841151313 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fed9405ea10 msgr2=0x7fed94060ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 --2- 172.21.15.8:0/2841151313 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fed9405ea10 0x7fed94060ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fed980043d0 tx=0x7fed98004320).stop 2023-10-18T20:58:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 -- 172.21.15.8:0/2841151313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feda8109750 msgr2=0x7feda810a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 --2- 172.21.15.8:0/2841151313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feda8109750 0x7feda810a640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7feda0009950 tx=0x7feda0004c50).stop 2023-10-18T20:58:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 -- 172.21.15.8:0/2841151313 shutdown_connections 2023-10-18T20:58:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 --2- 172.21.15.8:0/2841151313 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fed9405ea10 0x7fed94060ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 --2- 172.21.15.8:0/2841151313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feda80f6530 0x7feda8109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:58:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 --2- 172.21.15.8:0/2841151313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feda8109750 0x7feda810a640 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0x7feda0009950 tx=0x7feda0004c50).stop 2023-10-18T20:58:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 -- 172.21.15.8:0/2841151313 >> 172.21.15.8:0/2841151313 conn(0x7feda80f1c90 msgr2=0x7feda80faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 -- 172.21.15.8:0/2841151313 shutdown_connections 2023-10-18T20:58:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:07.986+0000 7fed8b7fe700 1 -- 172.21.15.8:0/2841151313 wait complete. 2023-10-18T20:58:07.998 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 16 2023-10-18T20:58:07.998 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:06.329913+0000 mgr.smithi060.pgqqwa (mgr.14584) 32 : audit [DBG] from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:07.998 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:06.729585+0000 mgr.smithi060.pgqqwa (mgr.14584) 33 : audit [DBG] from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:07.999 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:07.178919+0000 mon.smithi008 (mon.0) 605 : audit [DBG] from='client.? 172.21.15.8:0/2891203627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:58:08.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.240+0000 7fdec375e700 1 -- 172.21.15.8:0/2015203421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdebc0f88e0 msgr2=0x7fdebc0f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:08.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.240+0000 7fdec375e700 1 --2- 172.21.15.8:0/2015203421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdebc0f88e0 0x7fdebc0f8d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fdeb8004660 tx=0x7fdeb8009b30).stop 2023-10-18T20:58:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.241+0000 7fdec375e700 1 -- 172.21.15.8:0/2015203421 shutdown_connections 2023-10-18T20:58:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.241+0000 7fdec375e700 1 --2- 172.21.15.8:0/2015203421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdebc0f9b80 0x7fdebc0f9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.241+0000 7fdec375e700 1 --2- 172.21.15.8:0/2015203421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdebc0f88e0 0x7fdebc0f8d00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.241+0000 7fdec375e700 1 -- 172.21.15.8:0/2015203421 >> 172.21.15.8:0/2015203421 conn(0x7fdebc0f40e0 msgr2=0x7fdebc0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.242+0000 7fdec375e700 1 -- 172.21.15.8:0/2015203421 shutdown_connections 2023-10-18T20:58:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.242+0000 7fdec375e700 1 -- 172.21.15.8:0/2015203421 wait complete. 2023-10-18T20:58:08.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.244+0000 7fdec375e700 1 Processor -- start 2023-10-18T20:58:08.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.244+0000 7fdec375e700 1 -- start start 2023-10-18T20:58:08.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.244+0000 7fdec375e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdebc0f88e0 0x7fdebc06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:08.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.244+0000 7fdec375e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdebc0f9b80 0x7fdebc06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:08.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.244+0000 7fdec375e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc06cdb0 con 0x7fdebc0f9b80 2023-10-18T20:58:08.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.244+0000 7fdec375e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc06cef0 con 0x7fdebc0f88e0 2023-10-18T20:58:08.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.245+0000 7fdec14fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdebc0f88e0 0x7fdebc06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:08.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.245+0000 7fdec14fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdebc0f88e0 0x7fdebc06c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:35334/0 (socket says 172.21.15.8:35334) 2023-10-18T20:58:08.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.245+0000 7fdec14fa700 1 -- 172.21.15.8:0/4131760556 learned_addr learned my addr 172.21.15.8:0/4131760556 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:08.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.245+0000 7fdec14fa700 1 -- 172.21.15.8:0/4131760556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdebc0f9b80 msgr2=0x7fdebc06c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:08.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.245+0000 7fdec14fa700 1 --2- 172.21.15.8:0/4131760556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdebc0f9b80 0x7fdebc06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:58:08.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.245+0000 7fdec14fa700 1 -- 172.21.15.8:0/4131760556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb8005040 con 0x7fdebc0f88e0 2023-10-18T20:58:08.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.246+0000 7fdec14fa700 1 --2- 172.21.15.8:0/4131760556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdebc0f88e0 0x7fdebc06c2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fdeb8014040 tx=0x7fdeb800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:08.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.248+0000 7fdeb1ffb700 1 -- 172.21.15.8:0/4131760556 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeb8019070 con 0x7fdebc0f88e0 2023-10-18T20:58:08.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.248+0000 7fdeb1ffb700 1 -- 172.21.15.8:0/4131760556 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdeb801e420 con 0x7fdebc0f88e0 2023-10-18T20:58:08.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.248+0000 7fdeb1ffb700 1 -- 172.21.15.8:0/4131760556 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeb8014660 con 0x7fdebc0f88e0 2023-10-18T20:58:08.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.248+0000 7fdec375e700 1 -- 172.21.15.8:0/4131760556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdebc06d800 con 0x7fdebc0f88e0 2023-10-18T20:58:08.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.248+0000 7fdec375e700 1 -- 172.21.15.8:0/4131760556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdebc06dce0 con 0x7fdebc0f88e0 2023-10-18T20:58:08.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.250+0000 7fdec375e700 1 -- 172.21.15.8:0/4131760556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdebc045ad0 con 0x7fdebc0f88e0 2023-10-18T20:58:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.251+0000 7fdeb1ffb700 1 -- 172.21.15.8:0/4131760556 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 74712+0+0 (secure 0 0 0) 0x7fdeb801e9e0 con 0x7fdebc0f88e0 2023-10-18T20:58:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.252+0000 7fdeb1ffb700 1 --2- 172.21.15.8:0/4131760556 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fdea805e960 0x7fdea8060e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.253+0000 7fdeb1ffb700 1 -- 172.21.15.8:0/4131760556 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdeb807a460 con 0x7fdebc0f88e0 2023-10-18T20:58:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.254+0000 7fdec0cf9700 1 --2- 172.21.15.8:0/4131760556 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fdea805e960 0x7fdea8060e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:08.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.256+0000 7fdec0cf9700 1 --2- 172.21.15.8:0/4131760556 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fdea805e960 0x7fdea8060e20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fdeac004b70 tx=0x7fdeac00b040).ready entity=mgr.14584 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.265+0000 7fdeb1ffb700 1 -- 172.21.15.8:0/4131760556 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7fdeb804aa30 con 0x7fdebc0f88e0 2023-10-18T20:58:08.653 INFO:tasks.workunit.client.0.smithi008.stderr:++ readlink -f fsstress 2023-10-18T20:58:08.655 INFO:tasks.workunit.client.0.smithi008.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-10-18T20:58:08.655 INFO:tasks.workunit.client.0.smithi008.stderr:+ popd 2023-10-18T20:58:08.656 INFO:tasks.workunit.client.0.smithi008.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-10-18T20:58:08.656 INFO:tasks.workunit.client.0.smithi008.stdout:~/cephtest/mnt.0/client.0/tmp 2023-10-18T20:58:08.657 INFO:tasks.workunit.client.0.smithi008.stderr:+ popd 2023-10-18T20:58:08.657 INFO:tasks.workunit.client.0.smithi008.stderr:++ mktemp -d -p . 2023-10-18T20:58:08.662 INFO:tasks.workunit.client.0.smithi008.stderr:+ T=./tmp.hQJMQ95GxE 2023-10-18T20:58:08.662 INFO:tasks.workunit.client.0.smithi008.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.hQJMQ95GxE -l 1 -n 1000 -p 10 -v 2023-10-18T20:58:08.675 INFO:tasks.workunit.client.0.smithi008.stdout:seed = 1698300331 2023-10-18T20:58:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.684+0000 7fdec375e700 1 -- 172.21.15.8:0/4131760556 --> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdebc06de70 con 0x7fdea805e960 2023-10-18T20:58:08.688 INFO:tasks.workunit.client.0.smithi008.stdout:0/0: unlink - no file 2023-10-18T20:58:08.688 INFO:tasks.workunit.client.0.smithi008.stdout:0/1: write - no filename 2023-10-18T20:58:08.689 INFO:tasks.workunit.client.0.smithi008.stdout:0/2: read - no filename 2023-10-18T20:58:08.689 INFO:tasks.workunit.client.0.smithi008.stdout:0/3: readlink - no filename 2023-10-18T20:58:08.689 INFO:tasks.workunit.client.0.smithi008.stdout:0/4: rename - no filename 2023-10-18T20:58:08.689 INFO:tasks.workunit.client.0.smithi008.stdout:0/5: chown . 12 1 2023-10-18T20:58:08.690 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:58:08.691 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T20:58:08.691 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T20:58:08.691 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T20:58:08.691 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [], 2023-10-18T20:58:08.692 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "1/21 daemons upgraded", 2023-10-18T20:58:08.692 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mgr daemons", 2023-10-18T20:58:08.692 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T20:58:08.692 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:58:08.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.687+0000 7fdeb1ffb700 1 -- 172.21.15.8:0/4131760556 <== mgr.14584 v2:172.21.15.60:6828/3545049846 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fdebc06de70 con 0x7fdea805e960 2023-10-18T20:58:08.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.694+0000 7fdec375e700 1 -- 172.21.15.8:0/4131760556 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fdea805e960 msgr2=0x7fdea8060e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.694+0000 7fdec375e700 1 --2- 172.21.15.8:0/4131760556 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fdea805e960 0x7fdea8060e20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fdeac004b70 tx=0x7fdeac00b040).stop 2023-10-18T20:58:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.694+0000 7fdec375e700 1 -- 172.21.15.8:0/4131760556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdebc0f88e0 msgr2=0x7fdebc06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.694+0000 7fdec375e700 1 --2- 172.21.15.8:0/4131760556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdebc0f88e0 0x7fdebc06c2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fdeb8014040 tx=0x7fdeb800b040).stop 2023-10-18T20:58:08.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.694+0000 7fdec375e700 1 -- 172.21.15.8:0/4131760556 shutdown_connections 2023-10-18T20:58:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.694+0000 7fdec375e700 1 --2- 172.21.15.8:0/4131760556 >> [v2:172.21.15.60:6828/3545049846,v1:172.21.15.60:6829/3545049846] conn(0x7fdea805e960 0x7fdea8060e20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.694+0000 7fdec375e700 1 --2- 172.21.15.8:0/4131760556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdebc0f88e0 0x7fdebc06c2c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.694+0000 7fdec375e700 1 --2- 172.21.15.8:0/4131760556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdebc0f9b80 0x7fdebc06c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:58:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.695+0000 7fdec375e700 1 -- 172.21.15.8:0/4131760556 >> 172.21.15.8:0/4131760556 conn(0x7fdebc0f40e0 msgr2=0x7fdebc0fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.695+0000 7fdec375e700 1 -- 172.21.15.8:0/4131760556 shutdown_connections 2023-10-18T20:58:08.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:08.695+0000 7fdec375e700 1 -- 172.21.15.8:0/4131760556 wait complete. 2023-10-18T20:58:08.721 INFO:tasks.workunit.client.0.smithi008.stdout:0/6: mkdir d0 0 2023-10-18T20:58:08.721 INFO:tasks.workunit.client.0.smithi008.stdout:0/7: chown d0 22931 1 2023-10-18T20:58:08.721 INFO:tasks.workunit.client.0.smithi008.stdout:0/8: chown d0 0 1 2023-10-18T20:58:08.721 INFO:tasks.workunit.client.0.smithi008.stdout:0/9: dread - no filename 2023-10-18T20:58:08.721 INFO:tasks.workunit.client.0.smithi008.stdout:0/10: write - no filename 2023-10-18T20:58:08.722 INFO:tasks.workunit.client.0.smithi008.stdout:0/11: chown d0 1 1 2023-10-18T20:58:08.734 INFO:tasks.workunit.client.0.smithi008.stdout:1/0: creat f0 x:0 0 0 2023-10-18T20:58:08.740 INFO:tasks.workunit.client.0.smithi008.stdout:0/12: creat d0/f1 x:0 0 0 2023-10-18T20:58:08.744 INFO:tasks.workunit.client.0.smithi008.stdout:6/0: dwrite - no filename 2023-10-18T20:58:08.744 INFO:tasks.workunit.client.0.smithi008.stdout:6/1: write - no filename 2023-10-18T20:58:08.744 INFO:tasks.workunit.client.0.smithi008.stdout:6/2: rmdir - no directory 2023-10-18T20:58:08.745 INFO:tasks.workunit.client.0.smithi008.stdout:6/3: readlink - no filename 2023-10-18T20:58:08.745 INFO:tasks.workunit.client.0.smithi008.stdout:6/4: dwrite - no filename 2023-10-18T20:58:08.745 INFO:tasks.workunit.client.0.smithi008.stdout:6/5: rmdir - no directory 2023-10-18T20:58:08.745 INFO:tasks.workunit.client.0.smithi008.stdout:6/6: chown . 19310875 1 2023-10-18T20:58:08.760 INFO:tasks.workunit.client.0.smithi008.stdout:3/0: mkdir d0 0 2023-10-18T20:58:08.774 INFO:tasks.workunit.client.0.smithi008.stdout:6/7: symlink l0 0 2023-10-18T20:58:08.774 INFO:tasks.workunit.client.0.smithi008.stdout:6/8: truncate - no filename 2023-10-18T20:58:08.774 INFO:tasks.workunit.client.0.smithi008.stdout:3/1: mknod d0/c1 0 2023-10-18T20:58:08.778 INFO:tasks.workunit.client.0.smithi008.stdout:7/0: mknod c0 0 2023-10-18T20:58:08.778 INFO:tasks.workunit.client.0.smithi008.stdout:7/1: dread - no filename 2023-10-18T20:58:08.780 INFO:tasks.workunit.client.0.smithi008.stdout:6/9: creat f1 x:0 0 0 2023-10-18T20:58:08.790 INFO:tasks.workunit.client.0.smithi008.stdout:3/2: creat d0/f2 x:0 0 0 2023-10-18T20:58:08.790 INFO:tasks.workunit.client.0.smithi008.stdout:3/3: stat d0/c1 0 2023-10-18T20:58:08.790 INFO:tasks.workunit.client.0.smithi008.stdout:3/4: write d0/f2 [474335,92455] 0 2023-10-18T20:58:08.791 INFO:tasks.workunit.client.0.smithi008.stdout:3/5: chown d0/c1 5545 1 2023-10-18T20:58:08.791 INFO:tasks.workunit.client.0.smithi008.stdout:4/0: truncate - no filename 2023-10-18T20:58:08.791 INFO:tasks.workunit.client.0.smithi008.stdout:4/1: dwrite - no filename 2023-10-18T20:58:08.792 INFO:tasks.workunit.client.0.smithi008.stdout:2/0: symlink l0 0 2023-10-18T20:58:08.792 INFO:tasks.workunit.client.0.smithi008.stdout:2/1: dread - no filename 2023-10-18T20:58:08.792 INFO:tasks.workunit.client.0.smithi008.stdout:2/2: write - no filename 2023-10-18T20:58:08.793 INFO:tasks.workunit.client.0.smithi008.stdout:7/2: mkdir d1 0 2023-10-18T20:58:08.793 INFO:tasks.workunit.client.0.smithi008.stdout:7/3: truncate - no filename 2023-10-18T20:58:08.793 INFO:tasks.workunit.client.0.smithi008.stdout:7/4: fsync - no filename 2023-10-18T20:58:08.803 INFO:tasks.workunit.client.0.smithi008.stdout:6/10: symlink l2 0 2023-10-18T20:58:08.803 INFO:tasks.workunit.client.0.smithi008.stdout:6/11: truncate f1 635194 0 2023-10-18T20:58:08.804 INFO:tasks.workunit.client.0.smithi008.stdout:5/0: readlink - no filename 2023-10-18T20:58:08.805 INFO:tasks.workunit.client.0.smithi008.stdout:4/2: mkdir d0 0 2023-10-18T20:58:08.806 INFO:tasks.workunit.client.0.smithi008.stdout:4/3: write - no filename 2023-10-18T20:58:08.806 INFO:tasks.workunit.client.0.smithi008.stdout:4/4: chown d0 58975466 1 2023-10-18T20:58:08.806 INFO:tasks.workunit.client.0.smithi008.stdout:4/5: unlink - no file 2023-10-18T20:58:08.807 INFO:tasks.workunit.client.0.smithi008.stdout:7/5: mknod d1/c2 0 2023-10-18T20:58:08.811 INFO:tasks.workunit.client.0.smithi008.stdout:6/12: symlink l3 0 2023-10-18T20:58:08.862 INFO:tasks.workunit.client.0.smithi008.stdout:4/6: mknod d0/c1 0 2023-10-18T20:58:08.862 INFO:tasks.workunit.client.0.smithi008.stdout:7/6: mkdir d1/d3 0 2023-10-18T20:58:08.862 INFO:tasks.workunit.client.0.smithi008.stdout:4/7: dwrite - no filename 2023-10-18T20:58:08.867 INFO:tasks.workunit.client.0.smithi008.stdout:6/13: rename l3 to l4 0 2023-10-18T20:58:08.867 INFO:tasks.workunit.client.0.smithi008.stdout:6/14: fdatasync f1 0 2023-10-18T20:58:08.867 INFO:tasks.workunit.client.0.smithi008.stdout:7/7: dread - no filename 2023-10-18T20:58:08.867 INFO:tasks.workunit.client.0.smithi008.stdout:7/8: dwrite - no filename 2023-10-18T20:58:08.867 INFO:tasks.workunit.client.0.smithi008.stdout:8/0: symlink l0 0 2023-10-18T20:58:08.868 INFO:tasks.workunit.client.0.smithi008.stdout:7/9: dwrite - no filename 2023-10-18T20:58:08.868 INFO:tasks.workunit.client.0.smithi008.stdout:7/10: chown d1/d3 8401274 1 2023-10-18T20:58:08.868 INFO:tasks.workunit.client.0.smithi008.stdout:7/11: write - no filename 2023-10-18T20:58:08.870 INFO:tasks.workunit.client.0.smithi008.stdout:8/1: dread - no filename 2023-10-18T20:58:08.870 INFO:tasks.workunit.client.0.smithi008.stdout:8/2: read - no filename 2023-10-18T20:58:08.892 INFO:tasks.workunit.client.0.smithi008.stdout:9/0: write - no filename 2023-10-18T20:58:08.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:07.530246+0000 mgr.smithi060.pgqqwa (mgr.14584) 34 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 174 MiB data, 708 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 587 op/s 2023-10-18T20:58:08.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:07.981615+0000 mon.smithi060 (mon.1) 47 : audit [DBG] from='client.? 172.21.15.8:0/2841151313' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:58:08.938 INFO:tasks.workunit.client.0.smithi008.stdout:0/13: dwrite d0/f1 [0,4194304] 0 2023-10-18T20:58:08.940 INFO:tasks.workunit.client.0.smithi008.stdout:4/8: mknod d0/c2 0 2023-10-18T20:58:08.941 INFO:tasks.workunit.client.0.smithi008.stdout:4/9: chown d0 112156806 1 2023-10-18T20:58:08.945 INFO:tasks.workunit.client.0.smithi008.stdout:7/12: creat d1/f4 x:0 0 0 2023-10-18T20:58:08.945 INFO:tasks.workunit.client.0.smithi008.stdout:7/13: dread - d1/f4 zero size 2023-10-18T20:58:08.952 INFO:tasks.workunit.client.0.smithi008.stdout:8/3: mknod c1 0 2023-10-18T20:58:08.952 INFO:tasks.workunit.client.0.smithi008.stdout:8/4: write - no filename 2023-10-18T20:58:08.952 INFO:tasks.workunit.client.0.smithi008.stdout:8/5: write - no filename 2023-10-18T20:58:08.983 INFO:tasks.workunit.client.0.smithi008.stdout:9/1: creat f0 x:0 0 0 2023-10-18T20:58:08.984 INFO:tasks.workunit.client.0.smithi008.stdout:9/2: truncate f0 978759 0 2023-10-18T20:58:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:07.530246+0000 mgr.smithi060.pgqqwa (mgr.14584) 34 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 174 MiB data, 708 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 587 op/s 2023-10-18T20:58:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:07.981615+0000 mon.smithi060 (mon.1) 47 : audit [DBG] from='client.? 172.21.15.8:0/2841151313' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:58:09.072 INFO:tasks.workunit.client.0.smithi008.stdout:0/14: unlink d0/f1 0 2023-10-18T20:58:09.073 INFO:tasks.workunit.client.0.smithi008.stdout:0/15: dwrite - no filename 2023-10-18T20:58:09.073 INFO:tasks.workunit.client.0.smithi008.stdout:0/16: chown d0 230471 1 2023-10-18T20:58:09.073 INFO:tasks.workunit.client.0.smithi008.stdout:0/17: unlink - no file 2023-10-18T20:58:09.074 INFO:tasks.workunit.client.0.smithi008.stdout:0/18: creat d0/f2 x:0 0 0 2023-10-18T20:58:09.074 INFO:tasks.workunit.client.0.smithi008.stdout:0/19: write d0/f2 [391214,118255] 0 2023-10-18T20:58:09.074 INFO:tasks.workunit.client.0.smithi008.stdout:0/20: creat d0/f3 x:0 0 0 2023-10-18T20:58:09.074 INFO:tasks.workunit.client.0.smithi008.stdout:4/10: mkdir d0/d3 0 2023-10-18T20:58:09.080 INFO:tasks.workunit.client.0.smithi008.stdout:7/14: symlink d1/d3/l5 0 2023-10-18T20:58:09.080 INFO:tasks.workunit.client.0.smithi008.stdout:7/15: write d1/f4 [933038,32907] 0 2023-10-18T20:58:09.080 INFO:tasks.workunit.client.0.smithi008.stdout:7/16: creat d1/f6 x:0 0 0 2023-10-18T20:58:09.174 INFO:tasks.workunit.client.0.smithi008.stdout:8/6: rename c1 to c2 0 2023-10-18T20:58:09.331 INFO:tasks.workunit.client.0.smithi008.stdout:6/15: dwrite f1 [0,4194304] 0 2023-10-18T20:58:09.371 INFO:tasks.workunit.client.0.smithi008.stdout:9/3: mknod c1 0 2023-10-18T20:58:09.386 INFO:tasks.workunit.client.0.smithi008.stdout:9/4: dread f0 [0,4194304] 0 2023-10-18T20:58:09.564 INFO:tasks.workunit.client.0.smithi008.stdout:3/6: dwrite d0/f2 [0,4194304] 0 2023-10-18T20:58:09.809 INFO:tasks.workunit.client.0.smithi008.stdout:1/1: getdents . 0 2023-10-18T20:58:09.814 INFO:tasks.workunit.client.0.smithi008.stdout:6/16: fsync f1 0 2023-10-18T20:58:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:08.687016+0000 mgr.smithi060.pgqqwa (mgr.14584) 35 : audit [DBG] from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:08.687016+0000 mgr.smithi060.pgqqwa (mgr.14584) 35 : audit [DBG] from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:10.218 INFO:tasks.workunit.client.0.smithi008.stdout:4/11: creat d0/d3/f4 x:0 0 0 2023-10-18T20:58:10.245 INFO:tasks.workunit.client.0.smithi008.stdout:7/17: mknod d1/c7 0 2023-10-18T20:58:10.261 INFO:tasks.workunit.client.0.smithi008.stdout:7/18: dread d1/f4 [0,4194304] 0 2023-10-18T20:58:10.270 INFO:tasks.workunit.client.0.smithi008.stdout:4/12: dwrite d0/d3/f4 [0,4194304] 0 2023-10-18T20:58:10.474 INFO:tasks.workunit.client.0.smithi008.stdout:8/7: mknod c3 0 2023-10-18T20:58:10.474 INFO:tasks.workunit.client.0.smithi008.stdout:8/8: chown c3 0 1 2023-10-18T20:58:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:09.530775+0000 mgr.smithi060.pgqqwa (mgr.14584) 36 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 189 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 8.0 MiB/s wr, 701 op/s 2023-10-18T20:58:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:09.530775+0000 mgr.smithi060.pgqqwa (mgr.14584) 36 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 189 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 8.0 MiB/s wr, 701 op/s 2023-10-18T20:58:11.514 INFO:tasks.workunit.client.0.smithi008.stdout:9/5: mkdir d2 0 2023-10-18T20:58:11.514 INFO:tasks.workunit.client.0.smithi008.stdout:9/6: stat d2 0 2023-10-18T20:58:11.862 INFO:tasks.workunit.client.0.smithi008.stdout:3/7: mkdir d0/d3 0 2023-10-18T20:58:11.862 INFO:tasks.workunit.client.0.smithi008.stdout:3/8: fsync d0/f2 0 2023-10-18T20:58:12.328 INFO:tasks.workunit.client.0.smithi008.stdout:1/2: link f0 f1 0 2023-10-18T20:58:12.331 INFO:tasks.workunit.client.0.smithi008.stdout:7/19: creat d1/d3/f8 x:0 0 0 2023-10-18T20:58:12.332 INFO:tasks.workunit.client.0.smithi008.stdout:7/20: rename d1/d3 to d1/d3/d9 22 2023-10-18T20:58:12.335 INFO:tasks.workunit.client.0.smithi008.stdout:8/9: link c2 c4 0 2023-10-18T20:58:12.335 INFO:tasks.workunit.client.0.smithi008.stdout:8/10: write - no filename 2023-10-18T20:58:12.336 INFO:tasks.workunit.client.0.smithi008.stdout:8/11: chown c3 1262975838 1 2023-10-18T20:58:12.365 INFO:tasks.workunit.client.0.smithi008.stdout:9/7: creat d2/f3 x:0 0 0 2023-10-18T20:58:12.367 INFO:tasks.workunit.client.0.smithi008.stdout:1/3: creat f2 x:0 0 0 2023-10-18T20:58:12.368 INFO:tasks.workunit.client.0.smithi008.stdout:1/4: read - f0 zero size 2023-10-18T20:58:12.368 INFO:tasks.workunit.client.0.smithi008.stdout:1/5: fsync f0 0 2023-10-18T20:58:12.368 INFO:tasks.workunit.client.0.smithi008.stdout:6/17: getdents . 0 2023-10-18T20:58:12.369 INFO:tasks.workunit.client.0.smithi008.stdout:6/18: rmdir - no directory 2023-10-18T20:58:12.369 INFO:tasks.workunit.client.0.smithi008.stdout:6/19: chown l4 35860 1 2023-10-18T20:58:12.370 INFO:tasks.workunit.client.0.smithi008.stdout:7/21: link d1/c7 d1/d3/ca 0 2023-10-18T20:58:12.371 INFO:tasks.workunit.client.0.smithi008.stdout:8/12: mkdir d5 0 2023-10-18T20:58:12.371 INFO:tasks.workunit.client.0.smithi008.stdout:8/13: dread - no filename 2023-10-18T20:58:12.372 INFO:tasks.workunit.client.0.smithi008.stdout:3/9: getdents d0 0 2023-10-18T20:58:12.372 INFO:tasks.workunit.client.0.smithi008.stdout:3/10: chown d0/d3 103 1 2023-10-18T20:58:12.375 INFO:tasks.workunit.client.0.smithi008.stdout:6/20: unlink f1 0 2023-10-18T20:58:12.378 INFO:tasks.workunit.client.0.smithi008.stdout:9/8: dread f0 [0,4194304] 0 2023-10-18T20:58:12.382 INFO:tasks.workunit.client.0.smithi008.stdout:8/14: creat d5/f6 x:0 0 0 2023-10-18T20:58:12.383 INFO:tasks.workunit.client.0.smithi008.stdout:6/21: creat f5 x:0 0 0 2023-10-18T20:58:12.385 INFO:tasks.workunit.client.0.smithi008.stdout:8/15: symlink d5/l7 0 2023-10-18T20:58:12.385 INFO:tasks.workunit.client.0.smithi008.stdout:8/16: stat d5/f6 0 2023-10-18T20:58:12.386 INFO:tasks.workunit.client.0.smithi008.stdout:9/9: dread f0 [0,4194304] 0 2023-10-18T20:58:12.388 INFO:tasks.workunit.client.0.smithi008.stdout:9/10: chown d2 283773 1 2023-10-18T20:58:12.388 INFO:tasks.workunit.client.0.smithi008.stdout:8/17: mkdir d5/d8 0 2023-10-18T20:58:12.391 INFO:tasks.workunit.client.0.smithi008.stdout:8/18: creat d5/d8/f9 x:0 0 0 2023-10-18T20:58:12.402 INFO:tasks.workunit.client.0.smithi008.stdout:8/19: rename c4 to d5/d8/ca 0 2023-10-18T20:58:12.428 INFO:tasks.workunit.client.0.smithi008.stdout:4/13: dwrite d0/d3/f4 [4194304,4194304] 0 2023-10-18T20:58:12.432 INFO:tasks.workunit.client.0.smithi008.stdout:1/6: dwrite f2 [0,4194304] 0 2023-10-18T20:58:12.435 INFO:tasks.workunit.client.0.smithi008.stdout:8/20: rename d5/d8/ca to d5/cb 0 2023-10-18T20:58:12.438 INFO:tasks.workunit.client.0.smithi008.stdout:4/14: mknod d0/c5 0 2023-10-18T20:58:12.441 INFO:tasks.workunit.client.0.smithi008.stdout:1/7: mknod c3 0 2023-10-18T20:58:12.442 INFO:tasks.workunit.client.0.smithi008.stdout:1/8: creat f4 x:0 0 0 2023-10-18T20:58:12.442 INFO:tasks.workunit.client.0.smithi008.stdout:1/9: truncate f4 547127 0 2023-10-18T20:58:12.443 INFO:tasks.workunit.client.0.smithi008.stdout:3/11: dwrite d0/f2 [0,4194304] 0 2023-10-18T20:58:12.446 INFO:tasks.workunit.client.0.smithi008.stdout:6/22: dwrite f5 [0,4194304] 0 2023-10-18T20:58:12.446 INFO:tasks.workunit.client.0.smithi008.stdout:8/21: symlink d5/d8/lc 0 2023-10-18T20:58:12.446 INFO:tasks.workunit.client.0.smithi008.stdout:8/22: write d5/f6 [997325,55343] 0 2023-10-18T20:58:12.447 INFO:tasks.workunit.client.0.smithi008.stdout:7/22: dwrite d1/d3/f8 [0,4194304] 0 2023-10-18T20:58:12.448 INFO:tasks.workunit.client.0.smithi008.stdout:4/15: symlink d0/d3/l6 0 2023-10-18T20:58:12.448 INFO:tasks.workunit.client.0.smithi008.stdout:1/10: dread f4 [0,4194304] 0 2023-10-18T20:58:12.449 INFO:tasks.workunit.client.0.smithi008.stdout:9/11: dwrite d2/f3 [0,4194304] 0 2023-10-18T20:58:12.460 INFO:tasks.workunit.client.0.smithi008.stdout:3/12: creat d0/f4 x:0 0 0 2023-10-18T20:58:12.461 INFO:tasks.workunit.client.0.smithi008.stdout:6/23: dread f5 [0,4194304] 0 2023-10-18T20:58:12.463 INFO:tasks.workunit.client.0.smithi008.stdout:8/23: rename l0 to d5/ld 0 2023-10-18T20:58:12.463 INFO:tasks.workunit.client.0.smithi008.stdout:8/24: creat d5/fe x:0 0 0 2023-10-18T20:58:12.473 INFO:tasks.workunit.client.0.smithi008.stdout:3/13: creat d0/d3/f5 x:0 0 0 2023-10-18T20:58:12.473 INFO:tasks.workunit.client.0.smithi008.stdout:3/14: readlink - no filename 2023-10-18T20:58:12.473 INFO:tasks.workunit.client.0.smithi008.stdout:3/15: dread - d0/d3/f5 zero size 2023-10-18T20:58:12.473 INFO:tasks.workunit.client.0.smithi008.stdout:3/16: creat d0/d3/f6 x:0 0 0 2023-10-18T20:58:12.474 INFO:tasks.workunit.client.0.smithi008.stdout:3/17: truncate d0/d3/f6 967212 0 2023-10-18T20:58:12.484 INFO:tasks.workunit.client.0.smithi008.stdout:6/24: mknod c6 0 2023-10-18T20:58:12.484 INFO:tasks.workunit.client.0.smithi008.stdout:6/25: creat f7 x:0 0 0 2023-10-18T20:58:12.484 INFO:tasks.workunit.client.0.smithi008.stdout:8/25: mkdir d5/d8/df 0 2023-10-18T20:58:12.485 INFO:tasks.workunit.client.0.smithi008.stdout:8/26: chown d5/cb 2 1 2023-10-18T20:58:12.485 INFO:tasks.workunit.client.0.smithi008.stdout:1/11: unlink f4 0 2023-10-18T20:58:12.485 INFO:tasks.workunit.client.0.smithi008.stdout:1/12: creat f5 x:0 0 0 2023-10-18T20:58:12.491 INFO:tasks.workunit.client.0.smithi008.stdout:6/26: mknod c8 0 2023-10-18T20:58:12.493 INFO:tasks.workunit.client.0.smithi008.stdout:9/12: read d2/f3 [203759,123101] 0 2023-10-18T20:58:12.495 INFO:tasks.workunit.client.0.smithi008.stdout:8/27: symlink d5/l10 0 2023-10-18T20:58:12.498 INFO:tasks.workunit.client.0.smithi008.stdout:8/28: read d5/f6 [321956,32788] 0 2023-10-18T20:58:12.500 INFO:tasks.workunit.client.0.smithi008.stdout:8/29: write d5/f6 [960503,33443] 0 2023-10-18T20:58:12.503 INFO:tasks.workunit.client.0.smithi008.stdout:6/27: write f5 [1742128,78691] 0 2023-10-18T20:58:12.504 INFO:tasks.workunit.client.0.smithi008.stdout:6/28: stat l4 0 2023-10-18T20:58:12.505 INFO:tasks.workunit.client.0.smithi008.stdout:4/16: dwrite d0/d3/f4 [4194304,4194304] 0 2023-10-18T20:58:12.508 INFO:tasks.workunit.client.0.smithi008.stdout:3/18: getdents d0/d3 0 2023-10-18T20:58:12.509 INFO:tasks.workunit.client.0.smithi008.stdout:3/19: fsync d0/f2 0 2023-10-18T20:58:12.509 INFO:tasks.workunit.client.0.smithi008.stdout:3/20: readlink - no filename 2023-10-18T20:58:12.511 INFO:tasks.workunit.client.0.smithi008.stdout:6/29: symlink l9 0 2023-10-18T20:58:12.513 INFO:tasks.workunit.client.0.smithi008.stdout:1/13: rename f5 to f6 0 2023-10-18T20:58:12.514 INFO:tasks.workunit.client.0.smithi008.stdout:6/30: rename l9 to la 0 2023-10-18T20:58:12.516 INFO:tasks.workunit.client.0.smithi008.stdout:1/14: link c3 c7 0 2023-10-18T20:58:12.516 INFO:tasks.workunit.client.0.smithi008.stdout:1/15: truncate f1 951202 0 2023-10-18T20:58:12.526 INFO:tasks.workunit.client.0.smithi008.stdout:6/31: link l4 lb 0 2023-10-18T20:58:12.528 INFO:tasks.workunit.client.0.smithi008.stdout:1/16: symlink l8 0 2023-10-18T20:58:12.529 INFO:tasks.workunit.client.0.smithi008.stdout:6/32: mkdir dc 0 2023-10-18T20:58:12.529 INFO:tasks.workunit.client.0.smithi008.stdout:6/33: chown dc 221745950 1 2023-10-18T20:58:12.530 INFO:tasks.workunit.client.0.smithi008.stdout:6/34: getdents dc 0 2023-10-18T20:58:12.537 INFO:tasks.workunit.client.0.smithi008.stdout:7/23: dwrite d1/f6 [0,4194304] 0 2023-10-18T20:58:12.537 INFO:tasks.workunit.client.0.smithi008.stdout:7/24: creat d1/d3/fb x:0 0 0 2023-10-18T20:58:12.538 INFO:tasks.workunit.client.0.smithi008.stdout:7/25: write d1/d3/fb [1036529,31574] 0 2023-10-18T20:58:12.538 INFO:tasks.workunit.client.0.smithi008.stdout:7/26: write d1/d3/fb [1967273,126081] 0 2023-10-18T20:58:12.545 INFO:tasks.workunit.client.0.smithi008.stdout:6/35: truncate f5 266570 0 2023-10-18T20:58:12.548 INFO:tasks.workunit.client.0.smithi008.stdout:7/27: link d1/d3/f8 d1/d3/fc 0 2023-10-18T20:58:12.549 INFO:tasks.workunit.client.0.smithi008.stdout:7/28: creat d1/fd x:0 0 0 2023-10-18T20:58:12.551 INFO:tasks.workunit.client.0.smithi008.stdout:1/17: truncate f0 40734 0 2023-10-18T20:58:12.557 INFO:tasks.workunit.client.0.smithi008.stdout:9/13: dwrite f0 [0,4194304] 0 2023-10-18T20:58:12.558 INFO:tasks.workunit.client.0.smithi008.stdout:9/14: chown f0 1 1 2023-10-18T20:58:12.560 INFO:tasks.workunit.client.0.smithi008.stdout:7/29: symlink d1/d3/le 0 2023-10-18T20:58:12.560 INFO:tasks.workunit.client.0.smithi008.stdout:7/30: fdatasync d1/fd 0 2023-10-18T20:58:12.567 INFO:tasks.workunit.client.0.smithi008.stdout:4/17: dwrite d0/d3/f4 [4194304,4194304] 0 2023-10-18T20:58:12.569 INFO:tasks.workunit.client.0.smithi008.stdout:6/36: rmdir dc 0 2023-10-18T20:58:12.570 INFO:tasks.workunit.client.0.smithi008.stdout:6/37: fsync f5 0 2023-10-18T20:58:12.570 INFO:tasks.workunit.client.0.smithi008.stdout:6/38: truncate f5 1291302 0 2023-10-18T20:58:12.571 INFO:tasks.workunit.client.0.smithi008.stdout:6/39: unlink f7 0 2023-10-18T20:58:12.571 INFO:tasks.workunit.client.0.smithi008.stdout:6/40: creat fd x:0 0 0 2023-10-18T20:58:12.571 INFO:tasks.workunit.client.0.smithi008.stdout:6/41: write f5 [2277410,41928] 0 2023-10-18T20:58:12.579 INFO:tasks.workunit.client.0.smithi008.stdout:8/30: dwrite d5/f6 [0,4194304] 0 2023-10-18T20:58:12.629 INFO:tasks.workunit.client.0.smithi008.stdout:8/31: dwrite d5/f6 [0,4194304] 0 2023-10-18T20:58:12.630 INFO:tasks.workunit.client.0.smithi008.stdout:8/32: dread - d5/fe zero size 2023-10-18T20:58:12.630 INFO:tasks.workunit.client.0.smithi008.stdout:8/33: stat d5/l10 0 2023-10-18T20:58:12.647 INFO:tasks.workunit.client.0.smithi008.stdout:4/18: dwrite d0/d3/f4 [0,4194304] 0 2023-10-18T20:58:12.649 INFO:tasks.workunit.client.0.smithi008.stdout:1/18: dwrite f0 [0,4194304] 0 2023-10-18T20:58:12.649 INFO:tasks.workunit.client.0.smithi008.stdout:1/19: fdatasync f2 0 2023-10-18T20:58:12.651 INFO:tasks.workunit.client.0.smithi008.stdout:9/15: dwrite f0 [0,4194304] 0 2023-10-18T20:58:12.672 INFO:tasks.workunit.client.0.smithi008.stdout:1/20: write f0 [1923889,26230] 0 2023-10-18T20:58:12.676 INFO:tasks.workunit.client.0.smithi008.stdout:6/42: dwrite f5 [0,4194304] 0 2023-10-18T20:58:12.676 INFO:tasks.workunit.client.0.smithi008.stdout:6/43: rmdir - no directory 2023-10-18T20:58:12.676 INFO:tasks.workunit.client.0.smithi008.stdout:6/44: creat fe x:0 0 0 2023-10-18T20:58:12.676 INFO:tasks.workunit.client.0.smithi008.stdout:6/45: write fe [820029,63577] 0 2023-10-18T20:58:12.677 INFO:tasks.workunit.client.0.smithi008.stdout:4/19: dread d0/d3/f4 [0,4194304] 0 2023-10-18T20:58:12.677 INFO:tasks.workunit.client.0.smithi008.stdout:4/20: fdatasync d0/d3/f4 0 2023-10-18T20:58:12.677 INFO:tasks.workunit.client.0.smithi008.stdout:4/21: write d0/d3/f4 [9290989,33485] 0 2023-10-18T20:58:12.679 INFO:tasks.workunit.client.0.smithi008.stdout:8/34: dwrite d5/fe [0,4194304] 0 2023-10-18T20:58:12.679 INFO:tasks.workunit.client.0.smithi008.stdout:8/35: creat d5/f11 x:0 0 0 2023-10-18T20:58:12.679 INFO:tasks.workunit.client.0.smithi008.stdout:8/36: creat d5/d8/f12 x:0 0 0 2023-10-18T20:58:12.689 INFO:tasks.workunit.client.0.smithi008.stdout:4/22: rename d0/c1 to d0/d3/c7 0 2023-10-18T20:58:12.694 INFO:tasks.workunit.client.0.smithi008.stdout:9/16: write f0 [1770170,44499] 0 2023-10-18T20:58:12.694 INFO:tasks.workunit.client.0.smithi008.stdout:9/17: write f0 [2918213,1518] 0 2023-10-18T20:58:12.695 INFO:tasks.workunit.client.0.smithi008.stdout:7/31: dwrite d1/f6 [0,4194304] 0 2023-10-18T20:58:12.695 INFO:tasks.workunit.client.0.smithi008.stdout:7/32: fsync d1/d3/fc 0 2023-10-18T20:58:12.710 INFO:tasks.workunit.client.0.smithi008.stdout:4/23: mkdir d0/d3/d8 0 2023-10-18T20:58:12.713 INFO:tasks.workunit.client.0.smithi008.stdout:7/33: truncate d1/d3/f8 2740912 0 2023-10-18T20:58:12.727 INFO:tasks.workunit.client.0.smithi008.stdout:4/24: dread d0/d3/f4 [0,4194304] 0 2023-10-18T20:58:12.730 INFO:tasks.workunit.client.0.smithi008.stdout:4/25: link d0/d3/l6 d0/l9 0 2023-10-18T20:58:12.749 INFO:tasks.workunit.client.0.smithi008.stdout:6/46: dwrite fe [0,4194304] 0 2023-10-18T20:58:12.752 INFO:tasks.workunit.client.0.smithi008.stdout:7/34: dwrite d1/d3/fb [0,4194304] 0 2023-10-18T20:58:12.754 INFO:tasks.workunit.client.0.smithi008.stdout:4/26: write d0/d3/f4 [6703600,70777] 0 2023-10-18T20:58:12.754 INFO:tasks.workunit.client.0.smithi008.stdout:4/27: chown d0/d3/d8 0 1 2023-10-18T20:58:12.765 INFO:tasks.workunit.client.0.smithi008.stdout:6/47: write f5 [2278955,40886] 0 2023-10-18T20:58:12.775 INFO:tasks.workunit.client.0.smithi008.stdout:1/21: dwrite f1 [4194304,4194304] 0 2023-10-18T20:58:12.779 INFO:tasks.workunit.client.0.smithi008.stdout:6/48: read fe [1095548,25264] 0 2023-10-18T20:58:12.780 INFO:tasks.workunit.client.0.smithi008.stdout:6/49: write fe [2324219,103821] 0 2023-10-18T20:58:12.787 INFO:tasks.workunit.client.0.smithi008.stdout:6/50: mkdir df 0 2023-10-18T20:58:12.792 INFO:tasks.workunit.client.0.smithi008.stdout:1/22: truncate f0 6107896 0 2023-10-18T20:58:12.795 INFO:tasks.workunit.client.0.smithi008.stdout:8/37: dwrite d5/fe [0,4194304] 0 2023-10-18T20:58:12.797 INFO:tasks.workunit.client.0.smithi008.stdout:9/18: dwrite f0 [4194304,4194304] 0 2023-10-18T20:58:12.804 INFO:tasks.workunit.client.0.smithi008.stdout:1/23: getdents . 0 2023-10-18T20:58:12.805 INFO:tasks.workunit.client.0.smithi008.stdout:8/38: symlink d5/d8/l13 0 2023-10-18T20:58:12.811 INFO:tasks.workunit.client.0.smithi008.stdout:1/24: mkdir d9 0 2023-10-18T20:58:12.818 INFO:tasks.workunit.client.0.smithi008.stdout:8/39: creat d5/d8/df/f14 x:0 0 0 2023-10-18T20:58:12.818 INFO:tasks.workunit.client.0.smithi008.stdout:8/40: fsync d5/f11 0 2023-10-18T20:58:12.819 INFO:tasks.workunit.client.0.smithi008.stdout:8/41: dread - d5/f11 zero size 2023-10-18T20:58:12.851 INFO:tasks.workunit.client.0.smithi008.stdout:4/28: dwrite d0/d3/f4 [4194304,4194304] 0 2023-10-18T20:58:12.859 INFO:tasks.workunit.client.0.smithi008.stdout:4/29: creat d0/d3/d8/fa x:0 0 0 2023-10-18T20:58:12.862 INFO:tasks.workunit.client.0.smithi008.stdout:9/19: dwrite d2/f3 [0,4194304] 0 2023-10-18T20:58:12.874 INFO:tasks.workunit.client.0.smithi008.stdout:4/30: dread d0/d3/f4 [0,4194304] 0 2023-10-18T20:58:12.882 INFO:tasks.workunit.client.0.smithi008.stdout:9/20: truncate f0 7705544 0 2023-10-18T20:58:12.884 INFO:tasks.workunit.client.0.smithi008.stdout:4/31: link d0/d3/f4 d0/d3/d8/fb 0 2023-10-18T20:58:12.887 INFO:tasks.workunit.client.0.smithi008.stdout:4/32: creat d0/d3/d8/fc x:0 0 0 2023-10-18T20:58:12.893 INFO:tasks.workunit.client.0.smithi008.stdout:1/25: dwrite f0 [0,4194304] 0 2023-10-18T20:58:12.896 INFO:tasks.workunit.client.0.smithi008.stdout:1/26: creat d9/fa x:0 0 0 2023-10-18T20:58:12.897 INFO:tasks.workunit.client.0.smithi008.stdout:1/27: creat d9/fb x:0 0 0 2023-10-18T20:58:12.898 INFO:tasks.workunit.client.0.smithi008.stdout:4/33: write d0/d3/d8/fb [2019637,6620] 0 2023-10-18T20:58:12.901 INFO:tasks.workunit.client.0.smithi008.stdout:1/28: rename d9/fa to d9/fc 0 2023-10-18T20:58:12.903 INFO:tasks.workunit.client.0.smithi008.stdout:4/34: creat d0/fd x:0 0 0 2023-10-18T20:58:12.904 INFO:tasks.workunit.client.0.smithi008.stdout:4/35: truncate d0/d3/d8/fa 598114 0 2023-10-18T20:58:12.906 INFO:tasks.workunit.client.0.smithi008.stdout:4/36: mknod d0/ce 0 2023-10-18T20:58:12.907 INFO:tasks.workunit.client.0.smithi008.stdout:6/51: dwrite f5 [0,4194304] 0 2023-10-18T20:58:12.910 INFO:tasks.workunit.client.0.smithi008.stdout:8/42: dwrite d5/d8/df/f14 [0,4194304] 0 2023-10-18T20:58:12.910 INFO:tasks.workunit.client.0.smithi008.stdout:8/43: creat d5/f15 x:0 0 0 2023-10-18T20:58:12.914 INFO:tasks.workunit.client.0.smithi008.stdout:4/37: mknod d0/cf 0 2023-10-18T20:58:12.917 INFO:tasks.workunit.client.0.smithi008.stdout:1/29: dread f2 [0,4194304] 0 2023-10-18T20:58:12.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:11.531306+0000 mgr.smithi060.pgqqwa (mgr.14584) 37 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 189 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 440 op/s 2023-10-18T20:58:12.924 INFO:tasks.workunit.client.0.smithi008.stdout:9/21: truncate f0 7545707 0 2023-10-18T20:58:12.932 INFO:tasks.workunit.client.0.smithi008.stdout:8/44: dread d5/f6 [0,4194304] 0 2023-10-18T20:58:12.933 INFO:tasks.workunit.client.0.smithi008.stdout:8/45: dread - d5/d8/f12 zero size 2023-10-18T20:58:12.944 INFO:tasks.workunit.client.0.smithi008.stdout:1/30: symlink d9/ld 0 2023-10-18T20:58:12.944 INFO:tasks.workunit.client.0.smithi008.stdout:1/31: fdatasync f2 0 2023-10-18T20:58:12.958 INFO:tasks.workunit.client.0.smithi008.stdout:6/52: dwrite f5 [0,4194304] 0 2023-10-18T20:58:12.958 INFO:tasks.workunit.client.0.smithi008.stdout:6/53: write fe [2899045,121624] 0 2023-10-18T20:58:12.974 INFO:tasks.workunit.client.0.smithi008.stdout:9/22: dwrite f0 [0,4194304] 0 2023-10-18T20:58:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:11.531306+0000 mgr.smithi060.pgqqwa (mgr.14584) 37 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 189 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 440 op/s 2023-10-18T20:58:12.987 INFO:tasks.workunit.client.0.smithi008.stdout:9/23: read d2/f3 [2368231,68330] 0 2023-10-18T20:58:12.988 INFO:tasks.workunit.client.0.smithi008.stdout:9/24: fdatasync d2/f3 0 2023-10-18T20:58:12.995 INFO:tasks.workunit.client.0.smithi008.stdout:8/46: dwrite d5/f11 [0,4194304] 0 2023-10-18T20:58:12.995 INFO:tasks.workunit.client.0.smithi008.stdout:8/47: write d5/d8/f12 [347512,51033] 0 2023-10-18T20:58:12.996 INFO:tasks.workunit.client.0.smithi008.stdout:8/48: creat d5/f16 x:0 0 0 2023-10-18T20:58:13.000 INFO:tasks.workunit.client.0.smithi008.stdout:9/25: write f0 [884325,24386] 0 2023-10-18T20:58:13.008 INFO:tasks.workunit.client.0.smithi008.stdout:9/26: write f0 [5016833,30706] 0 2023-10-18T20:58:13.577 INFO:tasks.workunit.client.1.smithi060.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-10-18T20:58:13.593 INFO:tasks.workunit.client.1.smithi060.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-10-18T20:58:13.594 INFO:tasks.workunit.client.1.smithi060.stderr:+ make 2023-10-18T20:58:13.813 INFO:tasks.workunit.client.1.smithi060.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-10-18T20:58:14.076 INFO:tasks.workunit.client.0.smithi008.stdout:1/32: mkdir d9/de 0 2023-10-18T20:58:14.076 INFO:tasks.workunit.client.0.smithi008.stdout:6/54: link l2 df/l10 0 2023-10-18T20:58:14.077 INFO:tasks.workunit.client.0.smithi008.stdout:6/55: dread - fd zero size 2023-10-18T20:58:14.084 INFO:tasks.workunit.client.0.smithi008.stdout:1/33: write f1 [5845003,58758] 0 2023-10-18T20:58:14.084 INFO:tasks.workunit.client.0.smithi008.stdout:1/34: truncate d9/fb 933139 0 2023-10-18T20:58:14.088 INFO:tasks.workunit.client.0.smithi008.stdout:8/49: unlink d5/cb 0 2023-10-18T20:58:14.091 INFO:tasks.workunit.client.0.smithi008.stdout:6/56: symlink df/l11 0 2023-10-18T20:58:14.092 INFO:tasks.workunit.client.0.smithi008.stdout:6/57: readlink l0 0 2023-10-18T20:58:14.092 INFO:tasks.workunit.client.0.smithi008.stdout:6/58: write fe [4872570,46814] 0 2023-10-18T20:58:14.092 INFO:tasks.workunit.client.0.smithi008.stdout:1/35: mkdir d9/de/df 0 2023-10-18T20:58:14.093 INFO:tasks.workunit.client.0.smithi008.stdout:1/36: fsync d9/fb 0 2023-10-18T20:58:14.094 INFO:tasks.workunit.client.0.smithi008.stdout:6/59: mknod df/c12 0 2023-10-18T20:58:14.098 INFO:tasks.workunit.client.0.smithi008.stdout:8/50: rmdir d5/d8/df 39 2023-10-18T20:58:14.099 INFO:tasks.workunit.client.0.smithi008.stdout:6/60: mkdir df/d13 0 2023-10-18T20:58:14.099 INFO:tasks.workunit.client.0.smithi008.stdout:8/51: mkdir d5/d8/d17 0 2023-10-18T20:58:14.100 INFO:tasks.workunit.client.0.smithi008.stdout:8/52: dread - d5/f16 zero size 2023-10-18T20:58:14.100 INFO:tasks.workunit.client.0.smithi008.stdout:1/37: dread d9/fb [0,4194304] 0 2023-10-18T20:58:14.100 INFO:tasks.workunit.client.0.smithi008.stdout:6/61: symlink df/d13/l14 0 2023-10-18T20:58:14.101 INFO:tasks.workunit.client.0.smithi008.stdout:6/62: mkdir df/d15 0 2023-10-18T20:58:14.102 INFO:tasks.workunit.client.0.smithi008.stdout:6/63: write fd [640283,94852] 0 2023-10-18T20:58:14.103 INFO:tasks.workunit.client.0.smithi008.stdout:6/64: rename fe to df/d15/f16 0 2023-10-18T20:58:14.103 INFO:tasks.workunit.client.0.smithi008.stdout:6/65: chown lb 1197334907 1 2023-10-18T20:58:14.103 INFO:tasks.workunit.client.0.smithi008.stdout:6/66: write fd [1317676,112335] 0 2023-10-18T20:58:14.108 INFO:tasks.workunit.client.0.smithi008.stdout:1/38: write f2 [2131209,122040] 0 2023-10-18T20:58:14.108 INFO:tasks.workunit.client.0.smithi008.stdout:1/39: stat d9/fc 0 2023-10-18T20:58:14.116 INFO:tasks.workunit.client.0.smithi008.stdout:1/40: dread d9/fb [0,4194304] 0 2023-10-18T20:58:14.116 INFO:tasks.workunit.client.0.smithi008.stdout:1/41: write f6 [146819,108707] 0 2023-10-18T20:58:14.117 INFO:tasks.workunit.client.0.smithi008.stdout:1/42: write d9/fb [213020,120446] 0 2023-10-18T20:58:14.119 INFO:tasks.workunit.client.0.smithi008.stdout:1/43: rename f6 to d9/de/df/f10 0 2023-10-18T20:58:14.120 INFO:tasks.workunit.client.0.smithi008.stdout:1/44: write f2 [5087530,84599] 0 2023-10-18T20:58:14.120 INFO:tasks.workunit.client.0.smithi008.stdout:1/45: read - d9/fc zero size 2023-10-18T20:58:14.122 INFO:tasks.workunit.client.1.smithi060.stderr:++ readlink -f fsstress 2023-10-18T20:58:14.124 INFO:tasks.workunit.client.1.smithi060.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-10-18T20:58:14.124 INFO:tasks.workunit.client.1.smithi060.stderr:+ popd 2023-10-18T20:58:14.124 INFO:tasks.workunit.client.1.smithi060.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-10-18T20:58:14.125 INFO:tasks.workunit.client.1.smithi060.stderr:+ popd 2023-10-18T20:58:14.125 INFO:tasks.workunit.client.1.smithi060.stdout:~/cephtest/mnt.1/client.1/tmp 2023-10-18T20:58:14.125 INFO:tasks.workunit.client.1.smithi060.stderr:++ mktemp -d -p . 2023-10-18T20:58:14.128 INFO:tasks.workunit.client.1.smithi060.stderr:+ T=./tmp.4USRT3r95U 2023-10-18T20:58:14.128 INFO:tasks.workunit.client.1.smithi060.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.4USRT3r95U -l 1 -n 1000 -p 10 -v 2023-10-18T20:58:14.135 INFO:tasks.workunit.client.1.smithi060.stdout:seed = 1697795349 2023-10-18T20:58:14.140 INFO:tasks.workunit.client.1.smithi060.stdout:0/0: dwrite - no filename 2023-10-18T20:58:14.140 INFO:tasks.workunit.client.1.smithi060.stdout:0/1: chown . 1 1 2023-10-18T20:58:14.141 INFO:tasks.workunit.client.1.smithi060.stdout:0/2: unlink - no file 2023-10-18T20:58:14.141 INFO:tasks.workunit.client.1.smithi060.stdout:0/3: truncate - no filename 2023-10-18T20:58:14.141 INFO:tasks.workunit.client.1.smithi060.stdout:0/4: fsync - no filename 2023-10-18T20:58:14.142 INFO:tasks.workunit.client.1.smithi060.stdout:4/0: truncate - no filename 2023-10-18T20:58:14.142 INFO:tasks.workunit.client.1.smithi060.stdout:0/5: mkdir d0 0 2023-10-18T20:58:14.142 INFO:tasks.workunit.client.1.smithi060.stdout:1/0: chown . 1690810005 1 2023-10-18T20:58:14.142 INFO:tasks.workunit.client.1.smithi060.stdout:1/1: link - no file 2023-10-18T20:58:14.143 INFO:tasks.workunit.client.1.smithi060.stdout:1/2: unlink - no file 2023-10-18T20:58:14.143 INFO:tasks.workunit.client.1.smithi060.stdout:1/3: unlink - no file 2023-10-18T20:58:14.143 INFO:tasks.workunit.client.1.smithi060.stdout:1/4: read - no filename 2023-10-18T20:58:14.148 INFO:tasks.workunit.client.0.smithi008.stdout:8/53: dwrite d5/d8/f12 [0,4194304] 0 2023-10-18T20:58:14.148 INFO:tasks.workunit.client.0.smithi008.stdout:8/54: creat d5/f18 x:0 0 0 2023-10-18T20:58:14.149 INFO:tasks.workunit.client.0.smithi008.stdout:8/55: chown d5/d8/df/f14 947558 1 2023-10-18T20:58:14.149 INFO:tasks.workunit.client.0.smithi008.stdout:8/56: chown c2 1003874 1 2023-10-18T20:58:14.159 INFO:tasks.workunit.client.0.smithi008.stdout:8/57: creat d5/d8/df/f19 x:0 0 0 2023-10-18T20:58:14.166 INFO:tasks.workunit.client.1.smithi060.stdout:0/6: rmdir d0 0 2023-10-18T20:58:14.166 INFO:tasks.workunit.client.1.smithi060.stdout:0/7: write - no filename 2023-10-18T20:58:14.167 INFO:tasks.workunit.client.1.smithi060.stdout:1/5: symlink l0 0 2023-10-18T20:58:14.174 INFO:tasks.workunit.client.1.smithi060.stdout:0/8: creat f1 x:0 0 0 2023-10-18T20:58:14.175 INFO:tasks.workunit.client.1.smithi060.stdout:1/6: creat f1 x:0 0 0 2023-10-18T20:58:14.175 INFO:tasks.workunit.client.1.smithi060.stdout:0/9: chown f1 38225 1 2023-10-18T20:58:14.175 INFO:tasks.workunit.client.1.smithi060.stdout:0/10: write f1 [196845,43132] 0 2023-10-18T20:58:14.175 INFO:tasks.workunit.client.1.smithi060.stdout:1/7: creat f2 x:0 0 0 2023-10-18T20:58:14.176 INFO:tasks.workunit.client.1.smithi060.stdout:1/8: chown f1 8341091 1 2023-10-18T20:58:14.176 INFO:tasks.workunit.client.1.smithi060.stdout:2/0: mkdir d0 0 2023-10-18T20:58:14.177 INFO:tasks.workunit.client.1.smithi060.stdout:3/0: dwrite - no filename 2023-10-18T20:58:14.177 INFO:tasks.workunit.client.1.smithi060.stdout:2/1: link - no file 2023-10-18T20:58:14.177 INFO:tasks.workunit.client.1.smithi060.stdout:2/2: write - no filename 2023-10-18T20:58:14.178 INFO:tasks.workunit.client.1.smithi060.stdout:3/1: dwrite - no filename 2023-10-18T20:58:14.178 INFO:tasks.workunit.client.1.smithi060.stdout:1/9: mknod c3 0 2023-10-18T20:58:14.178 INFO:tasks.workunit.client.1.smithi060.stdout:1/10: write f2 [737027,8733] 0 2023-10-18T20:58:14.180 INFO:tasks.workunit.client.1.smithi060.stdout:2/3: creat d0/f1 x:0 0 0 2023-10-18T20:58:14.180 INFO:tasks.workunit.client.1.smithi060.stdout:5/0: dread - no filename 2023-10-18T20:58:14.181 INFO:tasks.workunit.client.1.smithi060.stdout:2/4: creat d0/f2 x:0 0 0 2023-10-18T20:58:14.181 INFO:tasks.workunit.client.1.smithi060.stdout:2/5: chown d0/f2 1 1 2023-10-18T20:58:14.181 INFO:tasks.workunit.client.1.smithi060.stdout:3/2: mkdir d0 0 2023-10-18T20:58:14.182 INFO:tasks.workunit.client.1.smithi060.stdout:1/11: mkdir d4 0 2023-10-18T20:58:14.184 INFO:tasks.workunit.client.1.smithi060.stdout:5/1: mkdir d0 0 2023-10-18T20:58:14.185 INFO:tasks.workunit.client.0.smithi008.stdout:6/67: dwrite fd [0,4194304] 0 2023-10-18T20:58:14.186 INFO:tasks.workunit.client.1.smithi060.stdout:2/6: mkdir d0/d3 0 2023-10-18T20:58:14.187 INFO:tasks.workunit.client.1.smithi060.stdout:2/7: dread - d0/f2 zero size 2023-10-18T20:58:14.187 INFO:tasks.workunit.client.1.smithi060.stdout:2/8: chown d0/d3 13623853 1 2023-10-18T20:58:14.187 INFO:tasks.workunit.client.1.smithi060.stdout:2/9: dread - d0/f2 zero size 2023-10-18T20:58:14.187 INFO:tasks.workunit.client.1.smithi060.stdout:2/10: chown d0 19059334 1 2023-10-18T20:58:14.188 INFO:tasks.workunit.client.1.smithi060.stdout:3/3: mknod d0/c1 0 2023-10-18T20:58:14.188 INFO:tasks.workunit.client.1.smithi060.stdout:3/4: read - no filename 2023-10-18T20:58:14.191 INFO:tasks.workunit.client.1.smithi060.stdout:5/2: mknod d0/c1 0 2023-10-18T20:58:14.191 INFO:tasks.workunit.client.1.smithi060.stdout:5/3: read - no filename 2023-10-18T20:58:14.192 INFO:tasks.workunit.client.1.smithi060.stdout:1/12: symlink d4/l5 0 2023-10-18T20:58:14.192 INFO:tasks.workunit.client.1.smithi060.stdout:1/13: write f1 [680467,112716] 0 2023-10-18T20:58:14.193 INFO:tasks.workunit.client.1.smithi060.stdout:6/0: creat f0 x:0 0 0 2023-10-18T20:58:14.193 INFO:tasks.workunit.client.1.smithi060.stdout:6/1: rmdir - no directory 2023-10-18T20:58:14.194 INFO:tasks.workunit.client.1.smithi060.stdout:6/2: creat f1 x:0 0 0 2023-10-18T20:58:14.194 INFO:tasks.workunit.client.1.smithi060.stdout:6/3: write f0 [867696,91093] 0 2023-10-18T20:58:14.194 INFO:tasks.workunit.client.1.smithi060.stdout:6/4: creat f2 x:0 0 0 2023-10-18T20:58:14.195 INFO:tasks.workunit.client.1.smithi060.stdout:2/11: link d0/f1 d0/f4 0 2023-10-18T20:58:14.196 INFO:tasks.workunit.client.1.smithi060.stdout:7/0: mknod c0 0 2023-10-18T20:58:14.196 INFO:tasks.workunit.client.1.smithi060.stdout:3/5: creat d0/f2 x:0 0 0 2023-10-18T20:58:14.197 INFO:tasks.workunit.client.1.smithi060.stdout:5/4: mknod d0/c2 0 2023-10-18T20:58:14.197 INFO:tasks.workunit.client.1.smithi060.stdout:5/5: dread - no filename 2023-10-18T20:58:14.197 INFO:tasks.workunit.client.1.smithi060.stdout:5/6: truncate - no filename 2023-10-18T20:58:14.197 INFO:tasks.workunit.client.1.smithi060.stdout:5/7: fsync - no filename 2023-10-18T20:58:14.198 INFO:tasks.workunit.client.1.smithi060.stdout:5/8: dread - no filename 2023-10-18T20:58:14.198 INFO:tasks.workunit.client.1.smithi060.stdout:5/9: write - no filename 2023-10-18T20:58:14.201 INFO:tasks.workunit.client.1.smithi060.stdout:6/5: mknod c3 0 2023-10-18T20:58:14.201 INFO:tasks.workunit.client.1.smithi060.stdout:8/0: rename - no filename 2023-10-18T20:58:14.201 INFO:tasks.workunit.client.1.smithi060.stdout:8/1: dwrite - no filename 2023-10-18T20:58:14.201 INFO:tasks.workunit.client.1.smithi060.stdout:8/2: rename - no filename 2023-10-18T20:58:14.202 INFO:tasks.workunit.client.1.smithi060.stdout:8/3: truncate - no filename 2023-10-18T20:58:14.202 INFO:tasks.workunit.client.1.smithi060.stdout:8/4: rename - no filename 2023-10-18T20:58:14.202 INFO:tasks.workunit.client.1.smithi060.stdout:8/5: dwrite - no filename 2023-10-18T20:58:14.209 INFO:tasks.workunit.client.1.smithi060.stdout:2/12: rename d0/f4 to d0/d3/f5 0 2023-10-18T20:58:14.214 INFO:tasks.workunit.client.1.smithi060.stdout:3/6: rename d0 to d0/d3 22 2023-10-18T20:58:14.215 INFO:tasks.workunit.client.1.smithi060.stdout:3/7: write d0/f2 [800950,73234] 0 2023-10-18T20:58:14.215 INFO:tasks.workunit.client.1.smithi060.stdout:5/10: mknod d0/c3 0 2023-10-18T20:58:14.215 INFO:tasks.workunit.client.1.smithi060.stdout:8/6: creat f0 x:0 0 0 2023-10-18T20:58:14.216 INFO:tasks.workunit.client.1.smithi060.stdout:8/7: fdatasync f0 0 2023-10-18T20:58:14.216 INFO:tasks.workunit.client.1.smithi060.stdout:7/1: rename c0 to c1 0 2023-10-18T20:58:14.216 INFO:tasks.workunit.client.1.smithi060.stdout:8/8: write f0 [370547,82939] 0 2023-10-18T20:58:14.221 INFO:tasks.workunit.client.1.smithi060.stdout:5/11: creat d0/f4 x:0 0 0 2023-10-18T20:58:14.222 INFO:tasks.workunit.client.1.smithi060.stdout:6/6: mknod c4 0 2023-10-18T20:58:14.222 INFO:tasks.workunit.client.1.smithi060.stdout:5/12: rename d0 to d0/d5 22 2023-10-18T20:58:14.222 INFO:tasks.workunit.client.1.smithi060.stdout:5/13: chown d0/f4 0 1 2023-10-18T20:58:14.222 INFO:tasks.workunit.client.1.smithi060.stdout:7/2: creat f2 x:0 0 0 2023-10-18T20:58:14.223 INFO:tasks.workunit.client.1.smithi060.stdout:7/3: dread - f2 zero size 2023-10-18T20:58:14.235 INFO:tasks.workunit.client.0.smithi008.stdout:8/58: dread d5/f6 [0,4194304] 0 2023-10-18T20:58:14.235 INFO:tasks.workunit.client.1.smithi060.stdout:6/7: mknod c5 0 2023-10-18T20:58:14.236 INFO:tasks.workunit.client.1.smithi060.stdout:6/8: chown c5 19231037 1 2023-10-18T20:58:14.236 INFO:tasks.workunit.client.1.smithi060.stdout:6/9: creat f6 x:0 0 0 2023-10-18T20:58:14.236 INFO:tasks.workunit.client.1.smithi060.stdout:6/10: chown f6 126 1 2023-10-18T20:58:14.237 INFO:tasks.workunit.client.1.smithi060.stdout:9/0: creat f0 x:0 0 0 2023-10-18T20:58:14.237 INFO:tasks.workunit.client.1.smithi060.stdout:9/1: creat f1 x:0 0 0 2023-10-18T20:58:14.237 INFO:tasks.workunit.client.1.smithi060.stdout:9/2: creat f2 x:0 0 0 2023-10-18T20:58:14.247 INFO:tasks.workunit.client.0.smithi008.stdout:8/59: mknod d5/d8/d17/c1a 0 2023-10-18T20:58:14.247 INFO:tasks.workunit.client.0.smithi008.stdout:8/60: stat d5 0 2023-10-18T20:58:14.251 INFO:tasks.workunit.client.1.smithi060.stdout:9/3: mkdir d3 0 2023-10-18T20:58:14.251 INFO:tasks.workunit.client.1.smithi060.stdout:0/11: write f1 [190380,44842] 0 2023-10-18T20:58:14.274 INFO:tasks.workunit.client.1.smithi060.stdout:9/4: creat d3/f4 x:0 0 0 2023-10-18T20:58:14.275 INFO:tasks.workunit.client.1.smithi060.stdout:9/5: chown d3 1324 1 2023-10-18T20:58:14.275 INFO:tasks.workunit.client.1.smithi060.stdout:9/6: dread - d3/f4 zero size 2023-10-18T20:58:14.275 INFO:tasks.workunit.client.1.smithi060.stdout:9/7: chown f0 164170425 1 2023-10-18T20:58:14.276 INFO:tasks.workunit.client.1.smithi060.stdout:0/12: rename f1 to f2 0 2023-10-18T20:58:14.295 INFO:tasks.workunit.client.1.smithi060.stdout:0/13: mkdir d3 0 2023-10-18T20:58:14.315 INFO:tasks.workunit.client.1.smithi060.stdout:0/14: mknod d3/c4 0 2023-10-18T20:58:14.315 INFO:tasks.workunit.client.1.smithi060.stdout:0/15: write f2 [341789,29238] 0 2023-10-18T20:58:14.337 INFO:tasks.workunit.client.1.smithi060.stdout:1/14: write f1 [150973,59575] 0 2023-10-18T20:58:14.359 INFO:tasks.workunit.client.0.smithi008.stdout:2/3: sync 2023-10-18T20:58:14.362 INFO:tasks.workunit.client.0.smithi008.stdout:2/4: getdents . 0 2023-10-18T20:58:14.362 INFO:tasks.workunit.client.0.smithi008.stdout:2/5: read - no filename 2023-10-18T20:58:14.365 INFO:tasks.workunit.client.0.smithi008.stdout:2/6: mkdir d1 0 2023-10-18T20:58:14.365 INFO:tasks.workunit.client.0.smithi008.stdout:2/7: fsync - no filename 2023-10-18T20:58:14.365 INFO:tasks.workunit.client.0.smithi008.stdout:2/8: write - no filename 2023-10-18T20:58:14.366 INFO:tasks.workunit.client.0.smithi008.stdout:2/9: write - no filename 2023-10-18T20:58:14.366 INFO:tasks.workunit.client.0.smithi008.stdout:2/10: dread - no filename 2023-10-18T20:58:14.368 INFO:tasks.workunit.client.0.smithi008.stdout:2/11: mknod d1/c2 0 2023-10-18T20:58:14.371 INFO:tasks.workunit.client.0.smithi008.stdout:2/12: mkdir d1/d3 0 2023-10-18T20:58:14.372 INFO:tasks.workunit.client.0.smithi008.stdout:2/13: dread - no filename 2023-10-18T20:58:14.372 INFO:tasks.workunit.client.0.smithi008.stdout:2/14: chown d1/c2 510944663 1 2023-10-18T20:58:14.373 INFO:tasks.workunit.client.0.smithi008.stdout:2/15: symlink d1/l4 0 2023-10-18T20:58:14.375 INFO:tasks.workunit.client.0.smithi008.stdout:2/16: symlink d1/l5 0 2023-10-18T20:58:14.376 INFO:tasks.workunit.client.0.smithi008.stdout:2/17: dwrite - no filename 2023-10-18T20:58:14.380 INFO:tasks.workunit.client.0.smithi008.stdout:2/18: unlink d1/c2 0 2023-10-18T20:58:14.380 INFO:tasks.workunit.client.0.smithi008.stdout:2/19: truncate - no filename 2023-10-18T20:58:14.381 INFO:tasks.workunit.client.0.smithi008.stdout:2/20: dwrite - no filename 2023-10-18T20:58:14.381 INFO:tasks.workunit.client.0.smithi008.stdout:2/21: dwrite - no filename 2023-10-18T20:58:14.381 INFO:tasks.workunit.client.0.smithi008.stdout:2/22: write - no filename 2023-10-18T20:58:14.381 INFO:tasks.workunit.client.0.smithi008.stdout:2/23: dread - no filename 2023-10-18T20:58:14.383 INFO:tasks.workunit.client.0.smithi008.stdout:2/24: symlink d1/l6 0 2023-10-18T20:58:14.384 INFO:tasks.workunit.client.0.smithi008.stdout:2/25: dread - no filename 2023-10-18T20:58:14.390 INFO:tasks.workunit.client.0.smithi008.stdout:2/26: link l0 d1/l7 0 2023-10-18T20:58:14.390 INFO:tasks.workunit.client.0.smithi008.stdout:2/27: read - no filename 2023-10-18T20:58:14.390 INFO:tasks.workunit.client.0.smithi008.stdout:2/28: truncate - no filename 2023-10-18T20:58:14.391 INFO:tasks.workunit.client.0.smithi008.stdout:2/29: dwrite - no filename 2023-10-18T20:58:14.391 INFO:tasks.workunit.client.0.smithi008.stdout:2/30: read - no filename 2023-10-18T20:58:14.394 INFO:tasks.workunit.client.0.smithi008.stdout:2/31: link d1/l4 d1/d3/l8 0 2023-10-18T20:58:14.395 INFO:tasks.workunit.client.0.smithi008.stdout:2/32: dwrite - no filename 2023-10-18T20:58:14.395 INFO:tasks.workunit.client.0.smithi008.stdout:2/33: write - no filename 2023-10-18T20:58:14.397 INFO:tasks.workunit.client.0.smithi008.stdout:2/34: mknod d1/d3/c9 0 2023-10-18T20:58:14.440 INFO:tasks.workunit.client.1.smithi060.stdout:5/14: dwrite d0/f4 [0,4194304] 0 2023-10-18T20:58:14.447 INFO:tasks.workunit.client.1.smithi060.stdout:8/9: read f0 [36770,83331] 0 2023-10-18T20:58:14.447 INFO:tasks.workunit.client.1.smithi060.stdout:8/10: rmdir - no directory 2023-10-18T20:58:14.448 INFO:tasks.workunit.client.1.smithi060.stdout:8/11: chown f0 3714 1 2023-10-18T20:58:14.478 INFO:tasks.workunit.client.1.smithi060.stdout:5/15: dread d0/f4 [0,4194304] 0 2023-10-18T20:58:14.491 INFO:tasks.workunit.client.0.smithi008.stdout:1/46: dwrite f0 [4194304,4194304] 0 2023-10-18T20:58:14.520 INFO:tasks.workunit.client.1.smithi060.stdout:0/16: dread f2 [0,4194304] 0 2023-10-18T20:58:14.523 INFO:tasks.workunit.client.1.smithi060.stdout:2/13: dwrite d0/d3/f5 [0,4194304] 0 2023-10-18T20:58:14.532 INFO:tasks.workunit.client.0.smithi008.stdout:1/47: dread f2 [0,4194304] 0 2023-10-18T20:58:14.532 INFO:tasks.workunit.client.0.smithi008.stdout:1/48: dread - d9/fc zero size 2023-10-18T20:58:14.544 INFO:tasks.workunit.client.0.smithi008.stdout:1/49: getdents d9/de/df 0 2023-10-18T20:58:14.547 INFO:tasks.workunit.client.0.smithi008.stdout:1/50: creat d9/de/f11 x:0 0 0 2023-10-18T20:58:14.547 INFO:tasks.workunit.client.0.smithi008.stdout:1/51: creat d9/f12 x:0 0 0 2023-10-18T20:58:14.551 INFO:tasks.workunit.client.1.smithi060.stdout:2/14: write d0/f1 [2955461,114996] 0 2023-10-18T20:58:14.551 INFO:tasks.workunit.client.1.smithi060.stdout:2/15: write d0/f1 [1573468,54689] 0 2023-10-18T20:58:14.554 INFO:tasks.workunit.client.0.smithi008.stdout:1/52: symlink d9/de/l13 0 2023-10-18T20:58:14.554 INFO:tasks.workunit.client.0.smithi008.stdout:1/53: fdatasync d9/de/f11 0 2023-10-18T20:58:14.561 INFO:tasks.workunit.client.1.smithi060.stdout:6/11: dread f0 [0,4194304] 0 2023-10-18T20:58:14.562 INFO:tasks.workunit.client.1.smithi060.stdout:6/12: write f1 [400891,19857] 0 2023-10-18T20:58:14.573 INFO:tasks.workunit.client.1.smithi060.stdout:1/15: mkdir d4/d6 0 2023-10-18T20:58:14.590 INFO:tasks.workunit.client.1.smithi060.stdout:7/4: dwrite f2 [0,4194304] 0 2023-10-18T20:58:14.601 INFO:tasks.workunit.client.1.smithi060.stdout:9/8: write d3/f4 [262506,109211] 0 2023-10-18T20:58:14.601 INFO:tasks.workunit.client.1.smithi060.stdout:9/9: truncate f2 1033697 0 2023-10-18T20:58:14.610 INFO:tasks.workunit.client.0.smithi008.stdout:1/54: write f1 [968299,92052] 0 2023-10-18T20:58:14.611 INFO:tasks.workunit.client.0.smithi008.stdout:8/61: dwrite d5/d8/f9 [0,4194304] 0 2023-10-18T20:58:14.611 INFO:tasks.workunit.client.0.smithi008.stdout:8/62: chown d5/f6 9894590 1 2023-10-18T20:58:14.611 INFO:tasks.workunit.client.0.smithi008.stdout:1/55: write d9/de/df/f10 [992680,55828] 0 2023-10-18T20:58:14.617 INFO:tasks.workunit.client.1.smithi060.stdout:6/13: dwrite f6 [0,4194304] 0 2023-10-18T20:58:14.621 INFO:tasks.workunit.client.1.smithi060.stdout:3/8: dwrite d0/f2 [0,4194304] 0 2023-10-18T20:58:14.626 INFO:tasks.workunit.client.1.smithi060.stdout:9/10: dread d3/f4 [0,4194304] 0 2023-10-18T20:58:14.687 INFO:tasks.workunit.client.0.smithi008.stdout:8/63: dwrite d5/f6 [0,4194304] 0 2023-10-18T20:58:14.687 INFO:tasks.workunit.client.0.smithi008.stdout:8/64: creat d5/d8/df/f1b x:0 0 0 2023-10-18T20:58:14.688 INFO:tasks.workunit.client.0.smithi008.stdout:8/65: truncate d5/f16 846391 0 2023-10-18T20:58:14.688 INFO:tasks.workunit.client.1.smithi060.stdout:9/11: dwrite d3/f4 [0,4194304] 0 2023-10-18T20:58:14.688 INFO:tasks.workunit.client.1.smithi060.stdout:9/12: fsync f0 0 2023-10-18T20:58:14.688 INFO:tasks.workunit.client.1.smithi060.stdout:9/13: read - f0 zero size 2023-10-18T20:58:14.710 INFO:tasks.workunit.client.0.smithi008.stdout:8/66: dread d5/f11 [0,4194304] 0 2023-10-18T20:58:14.711 INFO:tasks.workunit.client.0.smithi008.stdout:8/67: write d5/d8/df/f1b [63279,51537] 0 2023-10-18T20:58:14.712 INFO:tasks.workunit.client.0.smithi008.stdout:1/56: symlink d9/de/df/l14 0 2023-10-18T20:58:14.718 INFO:tasks.workunit.client.1.smithi060.stdout:9/14: dwrite d3/f4 [0,4194304] 0 2023-10-18T20:58:14.718 INFO:tasks.workunit.client.1.smithi060.stdout:9/15: chown f2 60538 1 2023-10-18T20:58:14.719 INFO:tasks.workunit.client.1.smithi060.stdout:9/16: creat d3/f5 x:0 0 0 2023-10-18T20:58:14.719 INFO:tasks.workunit.client.1.smithi060.stdout:9/17: creat d3/f6 x:0 0 0 2023-10-18T20:58:14.719 INFO:tasks.workunit.client.1.smithi060.stdout:9/18: truncate f0 935413 0 2023-10-18T20:58:14.719 INFO:tasks.workunit.client.1.smithi060.stdout:9/19: dread - f1 zero size 2023-10-18T20:58:14.735 INFO:tasks.workunit.client.0.smithi008.stdout:8/68: truncate d5/d8/df/f14 3199478 0 2023-10-18T20:58:14.735 INFO:tasks.workunit.client.0.smithi008.stdout:8/69: truncate d5/d8/df/f19 176429 0 2023-10-18T20:58:14.736 INFO:tasks.workunit.client.0.smithi008.stdout:8/70: chown d5/d8/d17 3651315 1 2023-10-18T20:58:14.736 INFO:tasks.workunit.client.0.smithi008.stdout:8/71: creat d5/f1c x:0 0 0 2023-10-18T20:58:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:13.531845+0000 mgr.smithi060.pgqqwa (mgr.14584) 38 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 294 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 15 MiB/s wr, 997 op/s 2023-10-18T20:58:14.738 INFO:tasks.workunit.client.0.smithi008.stdout:1/57: rename d9/f12 to d9/de/f15 0 2023-10-18T20:58:14.751 INFO:tasks.workunit.client.0.smithi008.stdout:8/72: creat d5/d8/d17/f1d x:0 0 0 2023-10-18T20:58:14.751 INFO:tasks.workunit.client.0.smithi008.stdout:8/73: chown d5/d8/d17/f1d 3 1 2023-10-18T20:58:14.751 INFO:tasks.workunit.client.0.smithi008.stdout:8/74: fdatasync d5/d8/df/f19 0 2023-10-18T20:58:14.752 INFO:tasks.workunit.client.0.smithi008.stdout:1/58: mknod d9/de/c16 0 2023-10-18T20:58:14.753 INFO:tasks.workunit.client.0.smithi008.stdout:1/59: write d9/fc [431066,112231] 0 2023-10-18T20:58:14.756 INFO:tasks.workunit.client.0.smithi008.stdout:8/75: symlink d5/d8/d17/l1e 0 2023-10-18T20:58:14.756 INFO:tasks.workunit.client.0.smithi008.stdout:8/76: creat d5/f1f x:0 0 0 2023-10-18T20:58:14.760 INFO:tasks.workunit.client.0.smithi008.stdout:8/77: mknod d5/c20 0 2023-10-18T20:58:14.760 INFO:tasks.workunit.client.0.smithi008.stdout:8/78: rename d5 to d5/d8/d21 22 2023-10-18T20:58:14.760 INFO:tasks.workunit.client.0.smithi008.stdout:8/79: dread - d5/f1f zero size 2023-10-18T20:58:14.761 INFO:tasks.workunit.client.0.smithi008.stdout:8/80: creat d5/d8/df/f22 x:0 0 0 2023-10-18T20:58:14.761 INFO:tasks.workunit.client.0.smithi008.stdout:8/81: creat d5/d8/df/f23 x:0 0 0 2023-10-18T20:58:14.764 INFO:tasks.workunit.client.1.smithi060.stdout:9/20: dwrite f0 [0,4194304] 0 2023-10-18T20:58:14.765 INFO:tasks.workunit.client.1.smithi060.stdout:9/21: creat d3/f7 x:0 0 0 2023-10-18T20:58:14.777 INFO:tasks.workunit.client.0.smithi008.stdout:8/82: mkdir d5/d8/d24 0 2023-10-18T20:58:14.777 INFO:tasks.workunit.client.0.smithi008.stdout:8/83: fdatasync d5/f11 0 2023-10-18T20:58:14.777 INFO:tasks.workunit.client.0.smithi008.stdout:8/84: creat d5/f25 x:0 0 0 2023-10-18T20:58:14.778 INFO:tasks.workunit.client.0.smithi008.stdout:8/85: creat d5/d8/d17/f26 x:0 0 0 2023-10-18T20:58:14.778 INFO:tasks.workunit.client.0.smithi008.stdout:8/86: stat d5/f16 0 2023-10-18T20:58:14.794 INFO:tasks.workunit.client.0.smithi008.stdout:8/87: creat d5/d8/d24/f27 x:0 0 0 2023-10-18T20:58:14.794 INFO:tasks.workunit.client.0.smithi008.stdout:8/88: chown d5/d8/d17 16470 1 2023-10-18T20:58:14.795 INFO:tasks.workunit.client.0.smithi008.stdout:8/89: rename d5/f16 to d5/f28 0 2023-10-18T20:58:14.796 INFO:tasks.workunit.client.0.smithi008.stdout:8/90: creat d5/d8/df/f29 x:0 0 0 2023-10-18T20:58:14.796 INFO:tasks.workunit.client.0.smithi008.stdout:8/91: fdatasync d5/f6 0 2023-10-18T20:58:14.798 INFO:tasks.workunit.client.0.smithi008.stdout:8/92: mkdir d5/d8/d2a 0 2023-10-18T20:58:14.799 INFO:tasks.workunit.client.0.smithi008.stdout:8/93: symlink d5/d8/d17/l2b 0 2023-10-18T20:58:14.800 INFO:tasks.workunit.client.0.smithi008.stdout:8/94: read - d5/f25 zero size 2023-10-18T20:58:14.800 INFO:tasks.workunit.client.0.smithi008.stdout:8/95: creat d5/d8/d24/f2c x:0 0 0 2023-10-18T20:58:14.800 INFO:tasks.workunit.client.0.smithi008.stdout:8/96: chown d5/d8 173 1 2023-10-18T20:58:14.800 INFO:tasks.workunit.client.0.smithi008.stdout:8/97: chown d5/l7 1011262 1 2023-10-18T20:58:14.802 INFO:tasks.workunit.client.0.smithi008.stdout:8/98: symlink d5/d8/df/l2d 0 2023-10-18T20:58:14.803 INFO:tasks.workunit.client.0.smithi008.stdout:8/99: mkdir d5/d8/df/d2e 0 2023-10-18T20:58:14.803 INFO:tasks.workunit.client.0.smithi008.stdout:8/100: fdatasync d5/d8/d17/f26 0 2023-10-18T20:58:14.811 INFO:tasks.workunit.client.0.smithi008.stdout:1/60: dwrite f2 [4194304,4194304] 0 2023-10-18T20:58:14.814 INFO:tasks.workunit.client.0.smithi008.stdout:1/61: mkdir d9/de/df/d17 0 2023-10-18T20:58:14.815 INFO:tasks.workunit.client.0.smithi008.stdout:1/62: fdatasync f2 0 2023-10-18T20:58:14.817 INFO:tasks.workunit.client.0.smithi008.stdout:1/63: mknod d9/de/df/d17/c18 0 2023-10-18T20:58:14.817 INFO:tasks.workunit.client.0.smithi008.stdout:1/64: truncate d9/fc 1017431 0 2023-10-18T20:58:14.817 INFO:tasks.workunit.client.0.smithi008.stdout:1/65: readlink d9/de/l13 0 2023-10-18T20:58:14.819 INFO:tasks.workunit.client.0.smithi008.stdout:1/66: mknod d9/de/c19 0 2023-10-18T20:58:14.820 INFO:tasks.workunit.client.0.smithi008.stdout:1/67: stat f1 0 2023-10-18T20:58:14.822 INFO:tasks.workunit.client.0.smithi008.stdout:1/68: symlink d9/de/df/d17/l1a 0 2023-10-18T20:58:14.853 INFO:tasks.workunit.client.0.smithi008.stdout:1/69: dwrite d9/de/f15 [0,4194304] 0 2023-10-18T20:58:14.857 INFO:tasks.workunit.client.0.smithi008.stdout:1/70: fsync d9/de/df/f10 0 2023-10-18T20:58:14.885 INFO:tasks.workunit.client.0.smithi008.stdout:8/101: dwrite d5/d8/df/f23 [0,4194304] 0 2023-10-18T20:58:14.895 INFO:tasks.workunit.client.0.smithi008.stdout:1/71: symlink d9/de/df/d17/l1b 0 2023-10-18T20:58:14.899 INFO:tasks.workunit.client.0.smithi008.stdout:1/72: unlink d9/de/l13 0 2023-10-18T20:58:14.901 INFO:tasks.workunit.client.0.smithi008.stdout:1/73: getdents d9/de/df/d17 0 2023-10-18T20:58:14.902 INFO:tasks.workunit.client.0.smithi008.stdout:1/74: creat d9/de/f1c x:0 0 0 2023-10-18T20:58:14.902 INFO:tasks.workunit.client.1.smithi060.stdout:5/16: mkdir d0/d6 0 2023-10-18T20:58:14.904 INFO:tasks.workunit.client.0.smithi008.stdout:1/75: rmdir d9/de/df/d17 39 2023-10-18T20:58:14.905 INFO:tasks.workunit.client.0.smithi008.stdout:1/76: creat d9/de/df/f1d x:0 0 0 2023-10-18T20:58:14.911 INFO:tasks.workunit.client.1.smithi060.stdout:5/17: write d0/f4 [2612499,2673] 0 2023-10-18T20:58:14.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:13.531845+0000 mgr.smithi060.pgqqwa (mgr.14584) 38 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 294 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 15 MiB/s wr, 997 op/s 2023-10-18T20:58:14.921 INFO:tasks.workunit.client.1.smithi060.stdout:0/17: creat d3/f5 x:0 0 0 2023-10-18T20:58:14.942 INFO:tasks.workunit.client.1.smithi060.stdout:1/16: mkdir d4/d6/d7 0 2023-10-18T20:58:14.946 INFO:tasks.workunit.client.1.smithi060.stdout:6/14: unlink c5 0 2023-10-18T20:58:14.947 INFO:tasks.workunit.client.1.smithi060.stdout:6/15: unlink f2 0 2023-10-18T20:58:14.948 INFO:tasks.workunit.client.0.smithi008.stdout:1/77: dwrite f1 [0,4194304] 0 2023-10-18T20:58:14.948 INFO:tasks.workunit.client.0.smithi008.stdout:1/78: write d9/de/df/f1d [56564,101363] 0 2023-10-18T20:58:14.949 INFO:tasks.workunit.client.0.smithi008.stdout:1/79: fsync d9/fb 0 2023-10-18T20:58:14.949 INFO:tasks.workunit.client.1.smithi060.stdout:6/16: read f0 [267747,77196] 0 2023-10-18T20:58:14.950 INFO:tasks.workunit.client.0.smithi008.stdout:1/80: read d9/de/df/f10 [657006,31267] 0 2023-10-18T20:58:14.950 INFO:tasks.workunit.client.1.smithi060.stdout:6/17: unlink f6 0 2023-10-18T20:58:14.953 INFO:tasks.workunit.client.1.smithi060.stdout:3/9: symlink d0/l4 0 2023-10-18T20:58:14.953 INFO:tasks.workunit.client.1.smithi060.stdout:3/10: chown d0/c1 33542112 1 2023-10-18T20:58:14.954 INFO:tasks.workunit.client.0.smithi008.stdout:1/81: mkdir d9/de/df/d17/d1e 0 2023-10-18T20:58:14.968 INFO:tasks.workunit.client.1.smithi060.stdout:3/11: dread d0/f2 [0,4194304] 0 2023-10-18T20:58:14.969 INFO:tasks.workunit.client.1.smithi060.stdout:3/12: truncate d0/f2 4778945 0 2023-10-18T20:58:14.969 INFO:tasks.workunit.client.1.smithi060.stdout:9/22: mknod d3/c8 0 2023-10-18T20:58:14.970 INFO:tasks.workunit.client.1.smithi060.stdout:9/23: creat d3/f9 x:0 0 0 2023-10-18T20:58:14.970 INFO:tasks.workunit.client.1.smithi060.stdout:9/24: write f2 [1607356,63071] 0 2023-10-18T20:58:14.970 INFO:tasks.workunit.client.1.smithi060.stdout:9/25: truncate d3/f5 161332 0 2023-10-18T20:58:14.971 INFO:tasks.workunit.client.1.smithi060.stdout:8/12: getdents . 0 2023-10-18T20:58:14.973 INFO:tasks.workunit.client.1.smithi060.stdout:5/18: creat d0/d6/f7 x:0 0 0 2023-10-18T20:58:14.974 INFO:tasks.workunit.client.0.smithi008.stdout:1/82: write d9/de/f15 [365964,89432] 0 2023-10-18T20:58:14.976 INFO:tasks.workunit.client.1.smithi060.stdout:7/5: truncate f2 1407152 0 2023-10-18T20:58:14.977 INFO:tasks.workunit.client.1.smithi060.stdout:7/6: rmdir - no directory 2023-10-18T20:58:14.978 INFO:tasks.workunit.client.0.smithi008.stdout:1/83: symlink d9/l1f 0 2023-10-18T20:58:14.982 INFO:tasks.workunit.client.0.smithi008.stdout:1/84: getdents d9/de 0 2023-10-18T20:58:14.983 INFO:tasks.workunit.client.1.smithi060.stdout:1/17: dwrite f1 [0,4194304] 0 2023-10-18T20:58:14.994 INFO:tasks.workunit.client.1.smithi060.stdout:6/18: link f0 f7 0 2023-10-18T20:58:14.994 INFO:tasks.workunit.client.1.smithi060.stdout:3/13: symlink d0/l5 0 2023-10-18T20:58:14.994 INFO:tasks.workunit.client.1.smithi060.stdout:9/26: link d3/f4 d3/fa 0 2023-10-18T20:58:14.995 INFO:tasks.workunit.client.1.smithi060.stdout:6/19: read f0 [13116,57628] 0 2023-10-18T20:58:14.995 INFO:tasks.workunit.client.1.smithi060.stdout:5/19: mkdir d0/d6/d8 0 2023-10-18T20:58:14.995 INFO:tasks.workunit.client.1.smithi060.stdout:5/20: readlink - no filename 2023-10-18T20:58:14.995 INFO:tasks.workunit.client.1.smithi060.stdout:0/18: rmdir d3 39 2023-10-18T20:58:14.995 INFO:tasks.workunit.client.1.smithi060.stdout:0/19: write d3/f5 [617228,73067] 0 2023-10-18T20:58:14.996 INFO:tasks.workunit.client.1.smithi060.stdout:1/18: creat d4/f8 x:0 0 0 2023-10-18T20:58:14.996 INFO:tasks.workunit.client.1.smithi060.stdout:1/19: fdatasync d4/f8 0 2023-10-18T20:58:14.996 INFO:tasks.workunit.client.1.smithi060.stdout:1/20: chown d4/l5 1015 1 2023-10-18T20:58:15.006 INFO:tasks.workunit.client.1.smithi060.stdout:0/20: link f2 d3/f6 0 2023-10-18T20:58:15.007 INFO:tasks.workunit.client.1.smithi060.stdout:1/21: creat d4/d6/d7/f9 x:0 0 0 2023-10-18T20:58:15.008 INFO:tasks.workunit.client.1.smithi060.stdout:0/21: unlink f2 0 2023-10-18T20:58:15.010 INFO:tasks.workunit.client.1.smithi060.stdout:0/22: creat d3/f7 x:0 0 0 2023-10-18T20:58:15.011 INFO:tasks.workunit.client.1.smithi060.stdout:0/23: mkdir d3/d8 0 2023-10-18T20:58:15.012 INFO:tasks.workunit.client.1.smithi060.stdout:0/24: link d3/f7 d3/d8/f9 0 2023-10-18T20:58:15.014 INFO:tasks.workunit.client.1.smithi060.stdout:8/13: dwrite f0 [0,4194304] 0 2023-10-18T20:58:15.016 INFO:tasks.workunit.client.1.smithi060.stdout:1/22: dread f2 [0,4194304] 0 2023-10-18T20:58:15.016 INFO:tasks.workunit.client.1.smithi060.stdout:1/23: write d4/f8 [726065,38545] 0 2023-10-18T20:58:15.016 INFO:tasks.workunit.client.1.smithi060.stdout:8/14: rename f0 to f1 0 2023-10-18T20:58:15.017 INFO:tasks.workunit.client.1.smithi060.stdout:8/15: fdatasync f1 0 2023-10-18T20:58:15.020 INFO:tasks.workunit.client.1.smithi060.stdout:9/27: read d3/fa [215636,48926] 0 2023-10-18T20:58:15.020 INFO:tasks.workunit.client.1.smithi060.stdout:9/28: chown d3/f6 40984058 1 2023-10-18T20:58:15.020 INFO:tasks.workunit.client.1.smithi060.stdout:9/29: write d3/f9 [619099,15371] 0 2023-10-18T20:58:15.023 INFO:tasks.workunit.client.1.smithi060.stdout:9/30: mknod d3/cb 0 2023-10-18T20:58:15.023 INFO:tasks.workunit.client.1.smithi060.stdout:9/31: creat d3/fc x:0 0 0 2023-10-18T20:58:15.024 INFO:tasks.workunit.client.1.smithi060.stdout:9/32: chown f2 1 1 2023-10-18T20:58:15.024 INFO:tasks.workunit.client.1.smithi060.stdout:9/33: read - d3/fc zero size 2023-10-18T20:58:15.027 INFO:tasks.workunit.client.1.smithi060.stdout:9/34: mkdir d3/dd 0 2023-10-18T20:58:15.044 INFO:tasks.workunit.client.1.smithi060.stdout:9/35: dread f0 [0,4194304] 0 2023-10-18T20:58:15.046 INFO:tasks.workunit.client.1.smithi060.stdout:9/36: creat d3/dd/fe x:0 0 0 2023-10-18T20:58:15.055 INFO:tasks.workunit.client.1.smithi060.stdout:1/24: dwrite d4/d6/d7/f9 [0,4194304] 0 2023-10-18T20:58:15.057 INFO:tasks.workunit.client.1.smithi060.stdout:1/25: mkdir d4/da 0 2023-10-18T20:58:15.068 INFO:tasks.workunit.client.1.smithi060.stdout:1/26: read d4/d6/d7/f9 [1159501,3565] 0 2023-10-18T20:58:15.069 INFO:tasks.workunit.client.1.smithi060.stdout:1/27: mkdir d4/da/db 0 2023-10-18T20:58:15.069 INFO:tasks.workunit.client.1.smithi060.stdout:1/28: fdatasync d4/d6/d7/f9 0 2023-10-18T20:58:15.143 INFO:tasks.workunit.client.1.smithi060.stdout:1/29: read d4/f8 [483833,45455] 0 2023-10-18T20:58:15.148 INFO:tasks.workunit.client.1.smithi060.stdout:1/30: creat d4/da/fc x:0 0 0 2023-10-18T20:58:15.150 INFO:tasks.workunit.client.0.smithi008.stdout:1/85: getdents d9/de/df/d17 0 2023-10-18T20:58:15.152 INFO:tasks.workunit.client.1.smithi060.stdout:3/14: dwrite d0/f2 [0,4194304] 0 2023-10-18T20:58:15.152 INFO:tasks.workunit.client.1.smithi060.stdout:1/31: write f2 [461472,22811] 0 2023-10-18T20:58:15.155 INFO:tasks.workunit.client.0.smithi008.stdout:1/86: mknod d9/de/c20 0 2023-10-18T20:58:15.155 INFO:tasks.workunit.client.0.smithi008.stdout:1/87: readlink d9/de/df/d17/l1a 0 2023-10-18T20:58:15.160 INFO:tasks.workunit.client.0.smithi008.stdout:1/88: symlink d9/de/df/l21 0 2023-10-18T20:58:15.161 INFO:tasks.workunit.client.1.smithi060.stdout:2/16: truncate d0/d3/f5 3866878 0 2023-10-18T20:58:15.162 INFO:tasks.workunit.client.1.smithi060.stdout:7/7: fsync f2 0 2023-10-18T20:58:15.179 INFO:tasks.workunit.client.1.smithi060.stdout:1/32: mkdir d4/da/db/dd 0 2023-10-18T20:58:15.179 INFO:tasks.workunit.client.1.smithi060.stdout:0/25: getdents d3 0 2023-10-18T20:58:15.182 INFO:tasks.workunit.client.1.smithi060.stdout:2/17: mknod d0/c6 0 2023-10-18T20:58:15.183 INFO:tasks.workunit.client.0.smithi008.stdout:1/89: symlink d9/de/df/d17/d1e/l22 0 2023-10-18T20:58:15.184 INFO:tasks.workunit.client.1.smithi060.stdout:7/8: truncate f2 885142 0 2023-10-18T20:58:15.184 INFO:tasks.workunit.client.1.smithi060.stdout:0/26: read d3/f6 [134381,77231] 0 2023-10-18T20:58:15.188 INFO:tasks.workunit.client.1.smithi060.stdout:1/33: fsync f2 0 2023-10-18T20:58:15.193 INFO:tasks.workunit.client.1.smithi060.stdout:1/34: mkdir d4/da/de 0 2023-10-18T20:58:15.193 INFO:tasks.workunit.client.1.smithi060.stdout:1/35: fdatasync f1 0 2023-10-18T20:58:15.195 INFO:tasks.workunit.client.1.smithi060.stdout:0/27: link d3/f7 d3/d8/fa 0 2023-10-18T20:58:15.195 INFO:tasks.workunit.client.1.smithi060.stdout:0/28: readlink - no filename 2023-10-18T20:58:15.195 INFO:tasks.workunit.client.1.smithi060.stdout:2/18: dread d0/f1 [0,4194304] 0 2023-10-18T20:58:15.196 INFO:tasks.workunit.client.0.smithi008.stdout:1/90: dread d9/de/df/f10 [0,4194304] 0 2023-10-18T20:58:15.196 INFO:tasks.workunit.client.1.smithi060.stdout:1/36: mkdir d4/d6/d7/df 0 2023-10-18T20:58:15.197 INFO:tasks.workunit.client.1.smithi060.stdout:2/19: symlink d0/d3/l7 0 2023-10-18T20:58:15.198 INFO:tasks.workunit.client.0.smithi008.stdout:1/91: write d9/de/df/f10 [761770,119784] 0 2023-10-18T20:58:15.199 INFO:tasks.workunit.client.1.smithi060.stdout:2/20: write d0/f1 [3615782,106158] 0 2023-10-18T20:58:15.199 INFO:tasks.workunit.client.1.smithi060.stdout:1/37: creat d4/da/de/f10 x:0 0 0 2023-10-18T20:58:15.200 INFO:tasks.workunit.client.1.smithi060.stdout:7/9: fsync f2 0 2023-10-18T20:58:15.202 INFO:tasks.workunit.client.1.smithi060.stdout:5/21: dwrite d0/f4 [4194304,4194304] 0 2023-10-18T20:58:15.202 INFO:tasks.workunit.client.1.smithi060.stdout:2/21: mkdir d0/d8 0 2023-10-18T20:58:15.202 INFO:tasks.workunit.client.1.smithi060.stdout:2/22: chown d0 12 1 2023-10-18T20:58:15.203 INFO:tasks.workunit.client.1.smithi060.stdout:1/38: getdents d4/da/db 0 2023-10-18T20:58:15.204 INFO:tasks.workunit.client.1.smithi060.stdout:7/10: rename f2 to f3 0 2023-10-18T20:58:15.208 INFO:tasks.workunit.client.1.smithi060.stdout:5/22: mkdir d0/d6/d9 0 2023-10-18T20:58:15.208 INFO:tasks.workunit.client.1.smithi060.stdout:5/23: fsync d0/f4 0 2023-10-18T20:58:15.208 INFO:tasks.workunit.client.1.smithi060.stdout:5/24: write d0/f4 [9241076,4724] 0 2023-10-18T20:58:15.208 INFO:tasks.workunit.client.1.smithi060.stdout:5/25: dread - d0/d6/f7 zero size 2023-10-18T20:58:15.209 INFO:tasks.workunit.client.0.smithi008.stdout:1/92: dread d9/de/df/f1d [0,4194304] 0 2023-10-18T20:58:15.209 INFO:tasks.workunit.client.1.smithi060.stdout:2/23: creat d0/d3/f9 x:0 0 0 2023-10-18T20:58:15.210 INFO:tasks.workunit.client.0.smithi008.stdout:1/93: mknod d9/de/c23 0 2023-10-18T20:58:15.213 INFO:tasks.workunit.client.1.smithi060.stdout:3/15: dwrite d0/f2 [0,4194304] 0 2023-10-18T20:58:15.213 INFO:tasks.workunit.client.1.smithi060.stdout:1/39: dread f2 [0,4194304] 0 2023-10-18T20:58:15.213 INFO:tasks.workunit.client.1.smithi060.stdout:1/40: fsync f1 0 2023-10-18T20:58:15.213 INFO:tasks.workunit.client.1.smithi060.stdout:1/41: stat d4/d6/d7/df 0 2023-10-18T20:58:15.214 INFO:tasks.workunit.client.1.smithi060.stdout:5/26: mkdir d0/da 0 2023-10-18T20:58:15.214 INFO:tasks.workunit.client.1.smithi060.stdout:0/29: getdents d3 0 2023-10-18T20:58:15.215 INFO:tasks.workunit.client.1.smithi060.stdout:1/42: mknod d4/d6/d7/df/c11 0 2023-10-18T20:58:15.215 INFO:tasks.workunit.client.1.smithi060.stdout:5/27: mkdir d0/d6/db 0 2023-10-18T20:58:15.217 INFO:tasks.workunit.client.1.smithi060.stdout:7/11: dread f3 [0,4194304] 0 2023-10-18T20:58:15.219 INFO:tasks.workunit.client.1.smithi060.stdout:3/16: getdents d0 0 2023-10-18T20:58:15.220 INFO:tasks.workunit.client.1.smithi060.stdout:0/30: symlink d3/d8/lb 0 2023-10-18T20:58:15.221 INFO:tasks.workunit.client.0.smithi008.stdout:1/94: dread d9/fc [0,4194304] 0 2023-10-18T20:58:15.221 INFO:tasks.workunit.client.0.smithi008.stdout:1/95: fdatasync d9/de/f11 0 2023-10-18T20:58:15.221 INFO:tasks.workunit.client.0.smithi008.stdout:1/96: write d9/fc [1409380,11468] 0 2023-10-18T20:58:15.221 INFO:tasks.workunit.client.0.smithi008.stdout:1/97: write d9/de/df/f1d [1133346,6952] 0 2023-10-18T20:58:15.222 INFO:tasks.workunit.client.1.smithi060.stdout:1/43: rename l0 to d4/d6/d7/df/l12 0 2023-10-18T20:58:15.222 INFO:tasks.workunit.client.1.smithi060.stdout:3/17: rename d0 to d0/d6 22 2023-10-18T20:58:15.222 INFO:tasks.workunit.client.1.smithi060.stdout:3/18: fsync d0/f2 0 2023-10-18T20:58:15.223 INFO:tasks.workunit.client.1.smithi060.stdout:0/31: creat d3/fc x:0 0 0 2023-10-18T20:58:15.224 INFO:tasks.workunit.client.1.smithi060.stdout:0/32: readlink d3/d8/lb 0 2023-10-18T20:58:15.224 INFO:tasks.workunit.client.0.smithi008.stdout:1/98: creat d9/de/df/d17/f24 x:0 0 0 2023-10-18T20:58:15.228 INFO:tasks.workunit.client.1.smithi060.stdout:7/12: dread f3 [0,4194304] 0 2023-10-18T20:58:15.229 INFO:tasks.workunit.client.1.smithi060.stdout:0/33: mknod d3/cd 0 2023-10-18T20:58:15.230 INFO:tasks.workunit.client.1.smithi060.stdout:8/16: dwrite f1 [4194304,4194304] 0 2023-10-18T20:58:15.231 INFO:tasks.workunit.client.1.smithi060.stdout:5/28: dread d0/f4 [8388608,4194304] 0 2023-10-18T20:58:15.231 INFO:tasks.workunit.client.1.smithi060.stdout:5/29: write d0/d6/f7 [869695,14290] 0 2023-10-18T20:58:15.231 INFO:tasks.workunit.client.0.smithi008.stdout:1/99: getdents d9 0 2023-10-18T20:58:15.237 INFO:tasks.workunit.client.1.smithi060.stdout:3/19: write d0/f2 [772507,41308] 0 2023-10-18T20:58:15.240 INFO:tasks.workunit.client.1.smithi060.stdout:7/13: dread f3 [0,4194304] 0 2023-10-18T20:58:15.240 INFO:tasks.workunit.client.1.smithi060.stdout:7/14: fsync f3 0 2023-10-18T20:58:15.244 INFO:tasks.workunit.client.0.smithi008.stdout:1/100: mkdir d9/de/df/d17/d25 0 2023-10-18T20:58:15.244 INFO:tasks.workunit.client.0.smithi008.stdout:1/101: chown d9/de/df/f1d 5693051 1 2023-10-18T20:58:15.244 INFO:tasks.workunit.client.0.smithi008.stdout:1/102: readlink d9/de/df/d17/l1b 0 2023-10-18T20:58:15.245 INFO:tasks.workunit.client.0.smithi008.stdout:1/103: fdatasync f2 0 2023-10-18T20:58:15.245 INFO:tasks.workunit.client.0.smithi008.stdout:1/104: truncate d9/fb 1720835 0 2023-10-18T20:58:15.245 INFO:tasks.workunit.client.0.smithi008.stdout:1/105: dread - d9/de/f1c zero size 2023-10-18T20:58:15.248 INFO:tasks.workunit.client.1.smithi060.stdout:8/17: mknod c2 0 2023-10-18T20:58:15.249 INFO:tasks.workunit.client.1.smithi060.stdout:8/18: chown c2 1051 1 2023-10-18T20:58:15.249 INFO:tasks.workunit.client.1.smithi060.stdout:8/19: rmdir - no directory 2023-10-18T20:58:15.252 INFO:tasks.workunit.client.1.smithi060.stdout:5/30: link d0/c1 d0/d6/cc 0 2023-10-18T20:58:15.252 INFO:tasks.workunit.client.1.smithi060.stdout:5/31: read d0/f4 [3290471,62945] 0 2023-10-18T20:58:15.252 INFO:tasks.workunit.client.1.smithi060.stdout:5/32: chown d0/c3 700 1 2023-10-18T20:58:15.253 INFO:tasks.workunit.client.1.smithi060.stdout:3/20: symlink d0/l7 0 2023-10-18T20:58:15.260 INFO:tasks.workunit.client.1.smithi060.stdout:3/21: fdatasync d0/f2 0 2023-10-18T20:58:15.264 INFO:tasks.workunit.client.1.smithi060.stdout:3/22: symlink d0/l8 0 2023-10-18T20:58:15.269 INFO:tasks.workunit.client.0.smithi008.stdout:1/106: truncate f2 3303761 0 2023-10-18T20:58:15.271 INFO:tasks.workunit.client.0.smithi008.stdout:1/107: creat d9/de/df/d17/d25/f26 x:0 0 0 2023-10-18T20:58:15.272 INFO:tasks.workunit.client.0.smithi008.stdout:1/108: link d9/de/c19 d9/de/c27 0 2023-10-18T20:58:15.273 INFO:tasks.workunit.client.0.smithi008.stdout:1/109: mknod d9/c28 0 2023-10-18T20:58:15.273 INFO:tasks.workunit.client.0.smithi008.stdout:1/110: fsync f0 0 2023-10-18T20:58:15.273 INFO:tasks.workunit.client.0.smithi008.stdout:1/111: creat d9/de/df/d17/d25/f29 x:0 0 0 2023-10-18T20:58:15.274 INFO:tasks.workunit.client.0.smithi008.stdout:1/112: truncate d9/de/df/f1d 1964552 0 2023-10-18T20:58:15.276 INFO:tasks.workunit.client.0.smithi008.stdout:1/113: symlink d9/de/df/l2a 0 2023-10-18T20:58:15.276 INFO:tasks.workunit.client.0.smithi008.stdout:1/114: fdatasync f2 0 2023-10-18T20:58:15.286 INFO:tasks.workunit.client.1.smithi060.stdout:7/15: dwrite f3 [0,4194304] 0 2023-10-18T20:58:15.287 INFO:tasks.workunit.client.1.smithi060.stdout:7/16: chown c1 6368 1 2023-10-18T20:58:15.289 INFO:tasks.workunit.client.1.smithi060.stdout:5/33: dread d0/d6/f7 [0,4194304] 0 2023-10-18T20:58:15.304 INFO:tasks.workunit.client.1.smithi060.stdout:5/34: mkdir d0/dd 0 2023-10-18T20:58:15.304 INFO:tasks.workunit.client.1.smithi060.stdout:5/35: readlink - no filename 2023-10-18T20:58:15.310 INFO:tasks.workunit.client.1.smithi060.stdout:7/17: getdents . 0 2023-10-18T20:58:15.311 INFO:tasks.workunit.client.1.smithi060.stdout:7/18: getdents . 0 2023-10-18T20:58:15.311 INFO:tasks.workunit.client.1.smithi060.stdout:5/36: mkdir d0/d6/de 0 2023-10-18T20:58:15.311 INFO:tasks.workunit.client.1.smithi060.stdout:5/37: rename d0/d6/de to d0/d6/d8/df 0 2023-10-18T20:58:15.314 INFO:tasks.workunit.client.1.smithi060.stdout:3/23: dwrite d0/f2 [0,4194304] 0 2023-10-18T20:58:15.314 INFO:tasks.workunit.client.1.smithi060.stdout:1/44: dwrite d4/da/fc [0,4194304] 0 2023-10-18T20:58:15.315 INFO:tasks.workunit.client.1.smithi060.stdout:0/34: dwrite d3/fc [0,4194304] 0 2023-10-18T20:58:15.319 INFO:tasks.workunit.client.1.smithi060.stdout:1/45: creat d4/da/db/dd/f13 x:0 0 0 2023-10-18T20:58:15.319 INFO:tasks.workunit.client.1.smithi060.stdout:1/46: getdents d4/da/db 0 2023-10-18T20:58:15.319 INFO:tasks.workunit.client.1.smithi060.stdout:1/47: fdatasync d4/d6/d7/f9 0 2023-10-18T20:58:15.324 INFO:tasks.workunit.client.1.smithi060.stdout:2/24: dwrite d0/f1 [0,4194304] 0 2023-10-18T20:58:15.324 INFO:tasks.workunit.client.1.smithi060.stdout:2/25: dread - d0/f2 zero size 2023-10-18T20:58:15.324 INFO:tasks.workunit.client.1.smithi060.stdout:8/20: dread f1 [0,4194304] 0 2023-10-18T20:58:15.325 INFO:tasks.workunit.client.1.smithi060.stdout:8/21: fdatasync f1 0 2023-10-18T20:58:15.328 INFO:tasks.workunit.client.1.smithi060.stdout:8/22: creat f3 x:0 0 0 2023-10-18T20:58:15.332 INFO:tasks.workunit.client.1.smithi060.stdout:2/26: rename d0/d3/f9 to d0/d8/fa 0 2023-10-18T20:58:15.333 INFO:tasks.workunit.client.1.smithi060.stdout:2/27: truncate d0/d3/f5 4759051 0 2023-10-18T20:58:15.333 INFO:tasks.workunit.client.1.smithi060.stdout:2/28: rename d0 to d0/d3/db 22 2023-10-18T20:58:15.333 INFO:tasks.workunit.client.1.smithi060.stdout:2/29: fsync d0/f2 0 2023-10-18T20:58:15.333 INFO:tasks.workunit.client.1.smithi060.stdout:7/19: write f3 [455622,67006] 0 2023-10-18T20:58:15.334 INFO:tasks.workunit.client.1.smithi060.stdout:2/30: creat d0/d8/fc x:0 0 0 2023-10-18T20:58:15.334 INFO:tasks.workunit.client.1.smithi060.stdout:2/31: write d0/d3/f5 [5739678,107905] 0 2023-10-18T20:58:15.336 INFO:tasks.workunit.client.1.smithi060.stdout:2/32: unlink d0/f1 0 2023-10-18T20:58:15.337 INFO:tasks.workunit.client.1.smithi060.stdout:2/33: write d0/d8/fa [1022592,79681] 0 2023-10-18T20:58:15.337 INFO:tasks.workunit.client.1.smithi060.stdout:2/34: creat d0/d8/fd x:0 0 0 2023-10-18T20:58:15.341 INFO:tasks.workunit.client.1.smithi060.stdout:2/35: mknod d0/d3/ce 0 2023-10-18T20:58:15.341 INFO:tasks.workunit.client.1.smithi060.stdout:2/36: write d0/d8/fa [1200648,68504] 0 2023-10-18T20:58:15.341 INFO:tasks.workunit.client.1.smithi060.stdout:2/37: creat d0/ff x:0 0 0 2023-10-18T20:58:15.342 INFO:tasks.workunit.client.1.smithi060.stdout:2/38: chown d0/c6 150493 1 2023-10-18T20:58:15.347 INFO:tasks.workunit.client.1.smithi060.stdout:8/23: write f1 [1251668,28101] 0 2023-10-18T20:58:15.348 INFO:tasks.workunit.client.1.smithi060.stdout:8/24: unlink c2 0 2023-10-18T20:58:15.350 INFO:tasks.workunit.client.0.smithi008.stdout:1/115: dwrite d9/de/df/f1d [0,4194304] 0 2023-10-18T20:58:15.350 INFO:tasks.workunit.client.0.smithi008.stdout:1/116: fsync d9/de/f1c 0 2023-10-18T20:58:15.352 INFO:tasks.workunit.client.1.smithi060.stdout:5/38: dwrite d0/d6/f7 [0,4194304] 0 2023-10-18T20:58:15.352 INFO:tasks.workunit.client.1.smithi060.stdout:5/39: chown d0/da 432961369 1 2023-10-18T20:58:15.353 INFO:tasks.workunit.client.1.smithi060.stdout:5/40: getdents d0/d6/d9 0 2023-10-18T20:58:15.354 INFO:tasks.workunit.client.1.smithi060.stdout:7/20: truncate f3 2920071 0 2023-10-18T20:58:15.354 INFO:tasks.workunit.client.1.smithi060.stdout:5/41: link d0/d6/cc d0/d6/d8/df/c10 0 2023-10-18T20:58:15.355 INFO:tasks.workunit.client.1.smithi060.stdout:5/42: write d0/f4 [3476468,9964] 0 2023-10-18T20:58:15.359 INFO:tasks.workunit.client.1.smithi060.stdout:3/24: dread d0/f2 [0,4194304] 0 2023-10-18T20:58:15.359 INFO:tasks.workunit.client.1.smithi060.stdout:2/39: rmdir d0 39 2023-10-18T20:58:15.363 INFO:tasks.workunit.client.1.smithi060.stdout:8/25: getdents . 0 2023-10-18T20:58:15.363 INFO:tasks.workunit.client.1.smithi060.stdout:7/21: write f3 [358064,90261] 0 2023-10-18T20:58:15.364 INFO:tasks.workunit.client.1.smithi060.stdout:2/40: rename d0/ff to d0/f10 0 2023-10-18T20:58:15.365 INFO:tasks.workunit.client.1.smithi060.stdout:3/25: link d0/l5 d0/l9 0 2023-10-18T20:58:15.366 INFO:tasks.workunit.client.1.smithi060.stdout:1/48: dwrite d4/da/db/dd/f13 [0,4194304] 0 2023-10-18T20:58:15.370 INFO:tasks.workunit.client.1.smithi060.stdout:8/26: unlink f1 0 2023-10-18T20:58:15.371 INFO:tasks.workunit.client.1.smithi060.stdout:8/27: dread - f3 zero size 2023-10-18T20:58:15.371 INFO:tasks.workunit.client.1.smithi060.stdout:8/28: dread - f3 zero size 2023-10-18T20:58:15.372 INFO:tasks.workunit.client.1.smithi060.stdout:7/22: symlink l4 0 2023-10-18T20:58:15.375 INFO:tasks.workunit.client.1.smithi060.stdout:3/26: creat d0/fa x:0 0 0 2023-10-18T20:58:15.375 INFO:tasks.workunit.client.1.smithi060.stdout:0/35: dwrite d3/d8/f9 [0,4194304] 0 2023-10-18T20:58:15.375 INFO:tasks.workunit.client.1.smithi060.stdout:0/36: truncate d3/f5 1095049 0 2023-10-18T20:58:15.381 INFO:tasks.workunit.client.1.smithi060.stdout:1/49: mkdir d4/d6/d14 0 2023-10-18T20:58:15.382 INFO:tasks.workunit.client.1.smithi060.stdout:8/29: mkdir d4 0 2023-10-18T20:58:15.382 INFO:tasks.workunit.client.1.smithi060.stdout:8/30: write f3 [401525,43741] 0 2023-10-18T20:58:15.382 INFO:tasks.workunit.client.1.smithi060.stdout:8/31: stat f3 0 2023-10-18T20:58:15.383 INFO:tasks.workunit.client.1.smithi060.stdout:7/23: mknod c5 0 2023-10-18T20:58:15.383 INFO:tasks.workunit.client.1.smithi060.stdout:7/24: write f3 [1602323,26731] 0 2023-10-18T20:58:15.383 INFO:tasks.workunit.client.1.smithi060.stdout:7/25: write f3 [1213675,128293] 0 2023-10-18T20:58:15.386 INFO:tasks.workunit.client.1.smithi060.stdout:8/32: creat d4/f5 x:0 0 0 2023-10-18T20:58:15.387 INFO:tasks.workunit.client.1.smithi060.stdout:0/37: creat d3/fe x:0 0 0 2023-10-18T20:58:15.387 INFO:tasks.workunit.client.1.smithi060.stdout:5/43: dread d0/f4 [4194304,4194304] 0 2023-10-18T20:58:15.388 INFO:tasks.workunit.client.0.smithi008.stdout:1/117: dwrite d9/de/df/f1d [0,4194304] 0 2023-10-18T20:58:15.388 INFO:tasks.workunit.client.0.smithi008.stdout:1/118: write d9/de/df/d17/d25/f29 [53976,106888] 0 2023-10-18T20:58:15.390 INFO:tasks.workunit.client.1.smithi060.stdout:1/50: dread d4/f8 [0,4194304] 0 2023-10-18T20:58:15.392 INFO:tasks.workunit.client.1.smithi060.stdout:0/38: write d3/f6 [935621,73876] 0 2023-10-18T20:58:15.392 INFO:tasks.workunit.client.1.smithi060.stdout:0/39: fdatasync d3/f5 0 2023-10-18T20:58:15.392 INFO:tasks.workunit.client.1.smithi060.stdout:2/41: write d0/d3/f5 [4561782,20142] 0 2023-10-18T20:58:15.392 INFO:tasks.workunit.client.1.smithi060.stdout:2/42: dread - d0/d8/fc zero size 2023-10-18T20:58:15.393 INFO:tasks.workunit.client.1.smithi060.stdout:2/43: write d0/f2 [838696,110891] 0 2023-10-18T20:58:15.393 INFO:tasks.workunit.client.1.smithi060.stdout:5/44: creat d0/d6/d8/f11 x:0 0 0 2023-10-18T20:58:15.393 INFO:tasks.workunit.client.1.smithi060.stdout:5/45: chown d0/d6/db 1494103976 1 2023-10-18T20:58:15.394 INFO:tasks.workunit.client.1.smithi060.stdout:5/46: getdents d0/d6/db 0 2023-10-18T20:58:15.394 INFO:tasks.workunit.client.1.smithi060.stdout:1/51: truncate f2 82610 0 2023-10-18T20:58:15.395 INFO:tasks.workunit.client.1.smithi060.stdout:1/52: fsync d4/da/db/dd/f13 0 2023-10-18T20:58:15.395 INFO:tasks.workunit.client.1.smithi060.stdout:1/53: readlink d4/d6/d7/df/l12 0 2023-10-18T20:58:15.395 INFO:tasks.workunit.client.1.smithi060.stdout:1/54: chown d4/da/de 33809646 1 2023-10-18T20:58:15.395 INFO:tasks.workunit.client.0.smithi008.stdout:1/119: fdatasync d9/de/df/d17/d25/f29 0 2023-10-18T20:58:15.395 INFO:tasks.workunit.client.0.smithi008.stdout:1/120: read - d9/de/f11 zero size 2023-10-18T20:58:15.398 INFO:tasks.workunit.client.1.smithi060.stdout:0/40: unlink d3/fe 0 2023-10-18T20:58:15.398 INFO:tasks.workunit.client.1.smithi060.stdout:2/44: creat d0/d8/f11 x:0 0 0 2023-10-18T20:58:15.398 INFO:tasks.workunit.client.1.smithi060.stdout:5/47: mknod d0/d6/db/c12 0 2023-10-18T20:58:15.398 INFO:tasks.workunit.client.1.smithi060.stdout:2/45: write d0/f2 [1016948,18952] 0 2023-10-18T20:58:15.399 INFO:tasks.workunit.client.1.smithi060.stdout:5/48: dread - d0/d6/d8/f11 zero size 2023-10-18T20:58:15.400 INFO:tasks.workunit.client.1.smithi060.stdout:8/33: dread f3 [0,4194304] 0 2023-10-18T20:58:15.401 INFO:tasks.workunit.client.1.smithi060.stdout:1/55: creat d4/d6/d7/df/f15 x:0 0 0 2023-10-18T20:58:15.402 INFO:tasks.workunit.client.1.smithi060.stdout:2/46: creat d0/f12 x:0 0 0 2023-10-18T20:58:15.403 INFO:tasks.workunit.client.1.smithi060.stdout:5/49: symlink d0/d6/l13 0 2023-10-18T20:58:15.403 INFO:tasks.workunit.client.1.smithi060.stdout:5/50: fdatasync d0/d6/f7 0 2023-10-18T20:58:15.403 INFO:tasks.workunit.client.1.smithi060.stdout:5/51: chown d0/d6/d8/f11 41164 1 2023-10-18T20:58:15.407 INFO:tasks.workunit.client.1.smithi060.stdout:8/34: dread f3 [0,4194304] 0 2023-10-18T20:58:15.407 INFO:tasks.workunit.client.1.smithi060.stdout:8/35: creat d4/f6 x:0 0 0 2023-10-18T20:58:15.413 INFO:tasks.workunit.client.1.smithi060.stdout:0/41: read d3/fc [1236381,13849] 0 2023-10-18T20:58:15.413 INFO:tasks.workunit.client.1.smithi060.stdout:5/52: link d0/d6/d8/f11 d0/d6/d9/f14 0 2023-10-18T20:58:15.413 INFO:tasks.workunit.client.1.smithi060.stdout:2/47: link d0/f2 d0/d3/f13 0 2023-10-18T20:58:15.415 INFO:tasks.workunit.client.1.smithi060.stdout:8/36: mknod d4/c7 0 2023-10-18T20:58:15.415 INFO:tasks.workunit.client.1.smithi060.stdout:0/42: creat d3/ff x:0 0 0 2023-10-18T20:58:15.420 INFO:tasks.workunit.client.1.smithi060.stdout:2/48: rename d0/d3/ce to d0/d3/c14 0 2023-10-18T20:58:15.420 INFO:tasks.workunit.client.1.smithi060.stdout:2/49: truncate d0/d8/fc 942447 0 2023-10-18T20:58:15.421 INFO:tasks.workunit.client.1.smithi060.stdout:8/37: creat d4/f8 x:0 0 0 2023-10-18T20:58:15.421 INFO:tasks.workunit.client.1.smithi060.stdout:8/38: stat f3 0 2023-10-18T20:58:15.421 INFO:tasks.workunit.client.1.smithi060.stdout:8/39: fdatasync d4/f5 0 2023-10-18T20:58:15.423 INFO:tasks.workunit.client.1.smithi060.stdout:1/56: dread d4/da/fc [0,4194304] 0 2023-10-18T20:58:15.427 INFO:tasks.workunit.client.1.smithi060.stdout:8/40: mkdir d4/d9 0 2023-10-18T20:58:15.430 INFO:tasks.workunit.client.1.smithi060.stdout:8/41: creat d4/d9/fa x:0 0 0 2023-10-18T20:58:15.431 INFO:tasks.workunit.client.1.smithi060.stdout:8/42: symlink d4/lb 0 2023-10-18T20:58:15.431 INFO:tasks.workunit.client.1.smithi060.stdout:8/43: dread - d4/f6 zero size 2023-10-18T20:58:15.438 INFO:tasks.workunit.client.1.smithi060.stdout:5/53: read d0/d6/f7 [3719756,38083] 0 2023-10-18T20:58:15.440 INFO:tasks.workunit.client.1.smithi060.stdout:5/54: rmdir d0/d6/db 39 2023-10-18T20:58:15.446 INFO:tasks.workunit.client.1.smithi060.stdout:5/55: mknod d0/dd/c15 0 2023-10-18T20:58:15.450 INFO:tasks.workunit.client.0.smithi008.stdout:1/121: dwrite d9/fc [0,4194304] 0 2023-10-18T20:58:15.451 INFO:tasks.workunit.client.1.smithi060.stdout:7/26: dwrite f3 [0,4194304] 0 2023-10-18T20:58:15.454 INFO:tasks.workunit.client.1.smithi060.stdout:8/44: getdents d4 0 2023-10-18T20:58:15.454 INFO:tasks.workunit.client.1.smithi060.stdout:8/45: stat d4/f6 0 2023-10-18T20:58:15.454 INFO:tasks.workunit.client.1.smithi060.stdout:8/46: read - d4/f8 zero size 2023-10-18T20:58:15.455 INFO:tasks.workunit.client.1.smithi060.stdout:0/43: dwrite d3/f5 [0,4194304] 0 2023-10-18T20:58:15.457 INFO:tasks.workunit.client.0.smithi008.stdout:1/122: unlink d9/de/df/d17/l1b 0 2023-10-18T20:58:15.458 INFO:tasks.workunit.client.1.smithi060.stdout:5/56: dread d0/d6/f7 [0,4194304] 0 2023-10-18T20:58:15.459 INFO:tasks.workunit.client.1.smithi060.stdout:7/27: symlink l6 0 2023-10-18T20:58:15.460 INFO:tasks.workunit.client.1.smithi060.stdout:8/47: rmdir d4 39 2023-10-18T20:58:15.461 INFO:tasks.workunit.client.1.smithi060.stdout:7/28: symlink l7 0 2023-10-18T20:58:15.470 INFO:tasks.workunit.client.1.smithi060.stdout:0/44: read d3/d8/fa [1017844,96447] 0 2023-10-18T20:58:15.472 INFO:tasks.workunit.client.1.smithi060.stdout:5/57: dread d0/d6/f7 [0,4194304] 0 2023-10-18T20:58:15.474 INFO:tasks.workunit.client.1.smithi060.stdout:5/58: symlink d0/dd/l16 0 2023-10-18T20:58:15.477 INFO:tasks.workunit.client.1.smithi060.stdout:5/59: unlink d0/d6/l13 0 2023-10-18T20:58:15.483 INFO:tasks.workunit.client.1.smithi060.stdout:0/45: dread d3/f7 [0,4194304] 0 2023-10-18T20:58:15.484 INFO:tasks.workunit.client.1.smithi060.stdout:1/57: write f1 [1559565,59548] 0 2023-10-18T20:58:15.485 INFO:tasks.workunit.client.1.smithi060.stdout:5/60: symlink d0/d6/d8/l17 0 2023-10-18T20:58:15.486 INFO:tasks.workunit.client.1.smithi060.stdout:5/61: chown d0/d6/db/c12 3 1 2023-10-18T20:58:15.487 INFO:tasks.workunit.client.1.smithi060.stdout:0/46: creat d3/d8/f10 x:0 0 0 2023-10-18T20:58:15.488 INFO:tasks.workunit.client.1.smithi060.stdout:0/47: creat d3/d8/f11 x:0 0 0 2023-10-18T20:58:15.489 INFO:tasks.workunit.client.1.smithi060.stdout:1/58: rename d4/l5 to d4/d6/d14/l16 0 2023-10-18T20:58:15.489 INFO:tasks.workunit.client.1.smithi060.stdout:1/59: chown f2 0 1 2023-10-18T20:58:15.491 INFO:tasks.workunit.client.1.smithi060.stdout:0/48: creat d3/f12 x:0 0 0 2023-10-18T20:58:15.493 INFO:tasks.workunit.client.1.smithi060.stdout:0/49: creat d3/f13 x:0 0 0 2023-10-18T20:58:15.495 INFO:tasks.workunit.client.1.smithi060.stdout:0/50: mkdir d3/d8/d14 0 2023-10-18T20:58:15.500 INFO:tasks.workunit.client.0.smithi008.stdout:1/123: dwrite d9/de/df/d17/f24 [0,4194304] 0 2023-10-18T20:58:15.503 INFO:tasks.workunit.client.1.smithi060.stdout:5/62: dread d0/f4 [0,4194304] 0 2023-10-18T20:58:15.503 INFO:tasks.workunit.client.1.smithi060.stdout:2/50: dwrite d0/f12 [0,4194304] 0 2023-10-18T20:58:15.503 INFO:tasks.workunit.client.1.smithi060.stdout:2/51: write d0/f2 [1434351,75341] 0 2023-10-18T20:58:15.503 INFO:tasks.workunit.client.1.smithi060.stdout:5/63: write d0/d6/d9/f14 [356198,125725] 0 2023-10-18T20:58:15.504 INFO:tasks.workunit.client.0.smithi008.stdout:1/124: mknod d9/de/c2b 0 2023-10-18T20:58:15.504 INFO:tasks.workunit.client.0.smithi008.stdout:1/125: stat d9/de/df/f1d 0 2023-10-18T20:58:15.504 INFO:tasks.workunit.client.1.smithi060.stdout:1/60: write d4/da/db/dd/f13 [533127,17132] 0 2023-10-18T20:58:15.506 INFO:tasks.workunit.client.1.smithi060.stdout:2/52: stat d0/d3/c14 0 2023-10-18T20:58:15.507 INFO:tasks.workunit.client.1.smithi060.stdout:8/48: dwrite d4/d9/fa [0,4194304] 0 2023-10-18T20:58:15.508 INFO:tasks.workunit.client.1.smithi060.stdout:5/64: mknod d0/d6/db/c18 0 2023-10-18T20:58:15.509 INFO:tasks.workunit.client.1.smithi060.stdout:7/29: dwrite f3 [0,4194304] 0 2023-10-18T20:58:15.509 INFO:tasks.workunit.client.1.smithi060.stdout:7/30: fdatasync f3 0 2023-10-18T20:58:15.509 INFO:tasks.workunit.client.1.smithi060.stdout:7/31: fdatasync f3 0 2023-10-18T20:58:15.516 INFO:tasks.workunit.client.0.smithi008.stdout:1/126: rmdir d9/de/df 39 2023-10-18T20:58:15.517 INFO:tasks.workunit.client.1.smithi060.stdout:1/61: symlink d4/da/l17 0 2023-10-18T20:58:15.519 INFO:tasks.workunit.client.1.smithi060.stdout:8/49: creat d4/fc x:0 0 0 2023-10-18T20:58:15.520 INFO:tasks.workunit.client.1.smithi060.stdout:8/50: write d4/f5 [828181,96525] 0 2023-10-18T20:58:15.520 INFO:tasks.workunit.client.1.smithi060.stdout:7/32: mknod c8 0 2023-10-18T20:58:15.522 INFO:tasks.workunit.client.1.smithi060.stdout:1/62: symlink d4/l18 0 2023-10-18T20:58:15.522 INFO:tasks.workunit.client.1.smithi060.stdout:2/53: mknod d0/d3/c15 0 2023-10-18T20:58:15.522 INFO:tasks.workunit.client.1.smithi060.stdout:1/63: write d4/da/db/dd/f13 [208516,79796] 0 2023-10-18T20:58:15.523 INFO:tasks.workunit.client.1.smithi060.stdout:7/33: symlink l9 0 2023-10-18T20:58:15.528 INFO:tasks.workunit.client.1.smithi060.stdout:2/54: mkdir d0/d16 0 2023-10-18T20:58:15.529 INFO:tasks.workunit.client.1.smithi060.stdout:1/64: rmdir d4/da/de 39 2023-10-18T20:58:15.529 INFO:tasks.workunit.client.1.smithi060.stdout:1/65: rmdir d4/da/db 39 2023-10-18T20:58:15.529 INFO:tasks.workunit.client.1.smithi060.stdout:7/34: creat fa x:0 0 0 2023-10-18T20:58:15.532 INFO:tasks.workunit.client.1.smithi060.stdout:7/35: rename l9 to lb 0 2023-10-18T20:58:15.543 INFO:tasks.workunit.client.0.smithi008.stdout:1/127: write d9/de/df/f1d [2757328,65410] 0 2023-10-18T20:58:15.545 INFO:tasks.workunit.client.0.smithi008.stdout:1/128: rename d9/de/c27 to d9/de/c2c 0 2023-10-18T20:58:15.546 INFO:tasks.workunit.client.0.smithi008.stdout:1/129: write d9/de/df/f10 [450004,35626] 0 2023-10-18T20:58:15.547 INFO:tasks.workunit.client.0.smithi008.stdout:1/130: creat d9/de/df/d17/d1e/f2d x:0 0 0 2023-10-18T20:58:15.548 INFO:tasks.workunit.client.1.smithi060.stdout:7/36: link f3 fc 0 2023-10-18T20:58:15.548 INFO:tasks.workunit.client.1.smithi060.stdout:7/37: write f3 [4828003,62473] 0 2023-10-18T20:58:15.549 INFO:tasks.workunit.client.0.smithi008.stdout:1/131: getdents d9/de/df/d17 0 2023-10-18T20:58:15.549 INFO:tasks.workunit.client.0.smithi008.stdout:1/132: fdatasync d9/de/df/d17/d1e/f2d 0 2023-10-18T20:58:15.550 INFO:tasks.workunit.client.1.smithi060.stdout:2/55: write d0/f12 [1069980,49694] 0 2023-10-18T20:58:15.550 INFO:tasks.workunit.client.1.smithi060.stdout:2/56: write d0/d3/f13 [1937054,129406] 0 2023-10-18T20:58:15.552 INFO:tasks.workunit.client.1.smithi060.stdout:7/38: symlink ld 0 2023-10-18T20:58:15.554 INFO:tasks.workunit.client.1.smithi060.stdout:2/57: link d0/f12 d0/d3/f17 0 2023-10-18T20:58:15.555 INFO:tasks.workunit.client.1.smithi060.stdout:2/58: symlink d0/d8/l18 0 2023-10-18T20:58:15.559 INFO:tasks.workunit.client.1.smithi060.stdout:5/65: dwrite d0/f4 [4194304,4194304] 0 2023-10-18T20:58:15.560 INFO:tasks.workunit.client.1.smithi060.stdout:5/66: unlink d0/c1 0 2023-10-18T20:58:15.561 INFO:tasks.workunit.client.0.smithi008.stdout:1/133: dread d9/fc [0,4194304] 0 2023-10-18T20:58:15.562 INFO:tasks.workunit.client.1.smithi060.stdout:5/67: rmdir d0/d6/db 39 2023-10-18T20:58:15.562 INFO:tasks.workunit.client.1.smithi060.stdout:5/68: fdatasync d0/d6/f7 0 2023-10-18T20:58:15.563 INFO:tasks.workunit.client.1.smithi060.stdout:0/51: dwrite d3/f7 [0,4194304] 0 2023-10-18T20:58:15.569 INFO:tasks.workunit.client.1.smithi060.stdout:5/69: mknod d0/d6/db/c19 0 2023-10-18T20:58:15.574 INFO:tasks.workunit.client.1.smithi060.stdout:5/70: link d0/d6/cc d0/da/c1a 0 2023-10-18T20:58:15.575 INFO:tasks.workunit.client.1.smithi060.stdout:5/71: creat d0/d6/d8/f1b x:0 0 0 2023-10-18T20:58:15.575 INFO:tasks.workunit.client.1.smithi060.stdout:5/72: write d0/d6/d8/f11 [934065,105817] 0 2023-10-18T20:58:15.575 INFO:tasks.workunit.client.1.smithi060.stdout:5/73: fsync d0/f4 0 2023-10-18T20:58:15.582 INFO:tasks.workunit.client.1.smithi060.stdout:5/74: rmdir d0/dd 39 2023-10-18T20:58:15.582 INFO:tasks.workunit.client.1.smithi060.stdout:8/51: dwrite d4/f6 [0,4194304] 0 2023-10-18T20:58:15.583 INFO:tasks.workunit.client.1.smithi060.stdout:8/52: truncate d4/fc 22550 0 2023-10-18T20:58:15.585 INFO:tasks.workunit.client.1.smithi060.stdout:1/66: dwrite d4/f8 [0,4194304] 0 2023-10-18T20:58:15.588 INFO:tasks.workunit.client.0.smithi008.stdout:1/134: dread d9/de/df/f10 [0,4194304] 0 2023-10-18T20:58:15.592 INFO:tasks.workunit.client.0.smithi008.stdout:1/135: rename d9/de/df/d17/l1a to d9/de/df/d17/l2e 0 2023-10-18T20:58:15.598 INFO:tasks.workunit.client.1.smithi060.stdout:1/67: creat d4/da/de/f19 x:0 0 0 2023-10-18T20:58:15.598 INFO:tasks.workunit.client.1.smithi060.stdout:1/68: chown d4/d6/d14/l16 2 1 2023-10-18T20:58:15.606 INFO:tasks.workunit.client.1.smithi060.stdout:8/53: write d4/d9/fa [2649857,130539] 0 2023-10-18T20:58:15.606 INFO:tasks.workunit.client.1.smithi060.stdout:8/54: write d4/d9/fa [1392285,62799] 0 2023-10-18T20:58:15.606 INFO:tasks.workunit.client.1.smithi060.stdout:8/55: truncate d4/f8 592535 0 2023-10-18T20:58:15.607 INFO:tasks.workunit.client.1.smithi060.stdout:8/56: fsync d4/fc 0 2023-10-18T20:58:15.610 INFO:tasks.workunit.client.1.smithi060.stdout:8/57: symlink d4/d9/ld 0 2023-10-18T20:58:15.611 INFO:tasks.workunit.client.1.smithi060.stdout:1/69: dread d4/f8 [0,4194304] 0 2023-10-18T20:58:15.611 INFO:tasks.workunit.client.1.smithi060.stdout:1/70: stat c3 0 2023-10-18T20:58:15.612 INFO:tasks.workunit.client.1.smithi060.stdout:1/71: chown c3 2373 1 2023-10-18T20:58:15.612 INFO:tasks.workunit.client.1.smithi060.stdout:1/72: dread - d4/da/de/f19 zero size 2023-10-18T20:58:15.612 INFO:tasks.workunit.client.1.smithi060.stdout:8/58: rename d4/f8 to d4/fe 0 2023-10-18T20:58:15.613 INFO:tasks.workunit.client.1.smithi060.stdout:8/59: chown f3 9 1 2023-10-18T20:58:15.613 INFO:tasks.workunit.client.1.smithi060.stdout:1/73: symlink d4/l1a 0 2023-10-18T20:58:15.626 INFO:tasks.workunit.client.1.smithi060.stdout:0/52: dwrite d3/f13 [0,4194304] 0 2023-10-18T20:58:15.626 INFO:tasks.workunit.client.1.smithi060.stdout:0/53: dread - d3/d8/f10 zero size 2023-10-18T20:58:15.627 INFO:tasks.workunit.client.1.smithi060.stdout:7/39: dwrite fa [0,4194304] 0 2023-10-18T20:58:15.628 INFO:tasks.workunit.client.1.smithi060.stdout:1/74: dread d4/da/fc [0,4194304] 0 2023-10-18T20:58:15.628 INFO:tasks.workunit.client.1.smithi060.stdout:1/75: write d4/da/db/dd/f13 [3628865,21755] 0 2023-10-18T20:58:15.630 INFO:tasks.workunit.client.0.smithi008.stdout:1/136: dwrite d9/de/df/f10 [0,4194304] 0 2023-10-18T20:58:15.632 INFO:tasks.workunit.client.0.smithi008.stdout:1/137: unlink d9/de/df/d17/f24 0 2023-10-18T20:58:15.636 INFO:tasks.workunit.client.0.smithi008.stdout:1/138: rename d9/de/df/d17/d25/f26 to d9/f2f 0 2023-10-18T20:58:15.636 INFO:tasks.workunit.client.0.smithi008.stdout:1/139: write f2 [2546513,83320] 0 2023-10-18T20:58:15.637 INFO:tasks.workunit.client.1.smithi060.stdout:1/76: mknod d4/da/db/c1b 0 2023-10-18T20:58:15.637 INFO:tasks.workunit.client.1.smithi060.stdout:1/77: chown d4/l1a 2031042 1 2023-10-18T20:58:15.638 INFO:tasks.workunit.client.1.smithi060.stdout:1/78: chown d4/da/fc 1863 1 2023-10-18T20:58:15.638 INFO:tasks.workunit.client.1.smithi060.stdout:1/79: chown d4/da/db/dd/f13 46 1 2023-10-18T20:58:15.638 INFO:tasks.workunit.client.1.smithi060.stdout:1/80: fsync d4/f8 0 2023-10-18T20:58:15.639 INFO:tasks.workunit.client.0.smithi008.stdout:1/140: mknod d9/de/df/d17/d1e/c30 0 2023-10-18T20:58:15.642 INFO:tasks.workunit.client.1.smithi060.stdout:0/54: dread d3/d8/f9 [0,4194304] 0 2023-10-18T20:58:15.647 INFO:tasks.workunit.client.1.smithi060.stdout:7/40: truncate fa 1611585 0 2023-10-18T20:58:15.648 INFO:tasks.workunit.client.1.smithi060.stdout:1/81: link d4/da/fc d4/da/f1c 0 2023-10-18T20:58:15.650 INFO:tasks.workunit.client.1.smithi060.stdout:5/75: dwrite d0/d6/d8/f11 [0,4194304] 0 2023-10-18T20:58:15.650 INFO:tasks.workunit.client.1.smithi060.stdout:5/76: write d0/f4 [1882321,27951] 0 2023-10-18T20:58:15.650 INFO:tasks.workunit.client.1.smithi060.stdout:7/41: mkdir de 0 2023-10-18T20:58:15.650 INFO:tasks.workunit.client.1.smithi060.stdout:1/82: mknod d4/d6/d7/df/c1d 0 2023-10-18T20:58:15.651 INFO:tasks.workunit.client.1.smithi060.stdout:7/42: write fa [2439153,98914] 0 2023-10-18T20:58:15.654 INFO:tasks.workunit.client.0.smithi008.stdout:1/141: dread d9/de/df/f10 [0,4194304] 0 2023-10-18T20:58:15.657 INFO:tasks.workunit.client.1.smithi060.stdout:1/83: unlink d4/l1a 0 2023-10-18T20:58:15.657 INFO:tasks.workunit.client.1.smithi060.stdout:7/43: rename f3 to de/ff 0 2023-10-18T20:58:15.657 INFO:tasks.workunit.client.1.smithi060.stdout:1/84: dread - d4/da/de/f19 zero size 2023-10-18T20:58:15.658 INFO:tasks.workunit.client.1.smithi060.stdout:1/85: write d4/da/de/f10 [222278,23695] 0 2023-10-18T20:58:15.658 INFO:tasks.workunit.client.1.smithi060.stdout:7/44: mknod de/c10 0 2023-10-18T20:58:15.658 INFO:tasks.workunit.client.1.smithi060.stdout:7/45: chown l7 7012 1 2023-10-18T20:58:15.670 INFO:tasks.workunit.client.1.smithi060.stdout:5/77: read d0/d6/d8/f11 [1092824,15911] 0 2023-10-18T20:58:15.677 INFO:tasks.workunit.client.1.smithi060.stdout:5/78: truncate d0/f4 6206336 0 2023-10-18T20:58:15.678 INFO:tasks.workunit.client.1.smithi060.stdout:0/55: dwrite d3/f5 [0,4194304] 0 2023-10-18T20:58:15.680 INFO:tasks.workunit.client.0.smithi008.stdout:1/142: dread d9/de/df/f1d [0,4194304] 0 2023-10-18T20:58:15.680 INFO:tasks.workunit.client.0.smithi008.stdout:1/143: truncate d9/de/df/d17/d1e/f2d 876632 0 2023-10-18T20:58:15.681 INFO:tasks.workunit.client.1.smithi060.stdout:5/79: mknod d0/dd/c1c 0 2023-10-18T20:58:15.684 INFO:tasks.workunit.client.1.smithi060.stdout:0/56: truncate d3/d8/f9 2569095 0 2023-10-18T20:58:15.684 INFO:tasks.workunit.client.1.smithi060.stdout:0/57: truncate d3/f12 30602 0 2023-10-18T20:58:15.693 INFO:tasks.workunit.client.1.smithi060.stdout:1/86: dwrite d4/da/f1c [0,4194304] 0 2023-10-18T20:58:15.694 INFO:tasks.workunit.client.0.smithi008.stdout:1/144: dread d9/fc [0,4194304] 0 2023-10-18T20:58:15.696 INFO:tasks.workunit.client.1.smithi060.stdout:5/80: link d0/d6/d9/f14 d0/f1d 0 2023-10-18T20:58:15.696 INFO:tasks.workunit.client.1.smithi060.stdout:0/58: rmdir d3/d8 39 2023-10-18T20:58:15.697 INFO:tasks.workunit.client.0.smithi008.stdout:1/145: link d9/de/c20 d9/de/df/d17/d1e/c31 0 2023-10-18T20:58:15.698 INFO:tasks.workunit.client.0.smithi008.stdout:1/146: dread - d9/de/f11 zero size 2023-10-18T20:58:15.699 INFO:tasks.workunit.client.1.smithi060.stdout:5/81: creat d0/d6/f1e x:0 0 0 2023-10-18T20:58:15.702 INFO:tasks.workunit.client.1.smithi060.stdout:5/82: mknod d0/c1f 0 2023-10-18T20:58:15.703 INFO:tasks.workunit.client.1.smithi060.stdout:5/83: fsync d0/f1d 0 2023-10-18T20:58:15.704 INFO:tasks.workunit.client.1.smithi060.stdout:1/87: write d4/da/fc [1353174,98912] 0 2023-10-18T20:58:15.706 INFO:tasks.workunit.client.1.smithi060.stdout:0/59: symlink d3/l15 0 2023-10-18T20:58:15.707 INFO:tasks.workunit.client.1.smithi060.stdout:5/84: rename d0/da to d0/da/d20 22 2023-10-18T20:58:15.708 INFO:tasks.workunit.client.1.smithi060.stdout:5/85: creat d0/d6/d8/f21 x:0 0 0 2023-10-18T20:58:15.710 INFO:tasks.workunit.client.1.smithi060.stdout:1/88: link d4/l18 d4/da/l1e 0 2023-10-18T20:58:15.710 INFO:tasks.workunit.client.1.smithi060.stdout:1/89: write d4/d6/d7/f9 [3461509,100076] 0 2023-10-18T20:58:15.718 INFO:tasks.workunit.client.1.smithi060.stdout:0/60: write d3/f13 [2591906,110109] 0 2023-10-18T20:58:15.718 INFO:tasks.workunit.client.1.smithi060.stdout:5/86: creat d0/d6/db/f22 x:0 0 0 2023-10-18T20:58:15.719 INFO:tasks.workunit.client.0.smithi008.stdout:1/147: creat d9/de/df/d17/d25/f32 x:0 0 0 2023-10-18T20:58:15.720 INFO:tasks.workunit.client.1.smithi060.stdout:0/61: symlink d3/d8/l16 0 2023-10-18T20:58:15.721 INFO:tasks.workunit.client.1.smithi060.stdout:1/90: dread d4/f8 [0,4194304] 0 2023-10-18T20:58:15.725 INFO:tasks.workunit.client.0.smithi008.stdout:1/148: rename d9/de/c2c to d9/de/df/c33 0 2023-10-18T20:58:15.725 INFO:tasks.workunit.client.0.smithi008.stdout:1/149: write d9/de/df/f1d [1314799,16952] 0 2023-10-18T20:58:15.726 INFO:tasks.workunit.client.1.smithi060.stdout:0/62: rmdir d3/d8 39 2023-10-18T20:58:15.727 INFO:tasks.workunit.client.0.smithi008.stdout:1/150: symlink d9/de/df/d17/l34 0 2023-10-18T20:58:15.727 INFO:tasks.workunit.client.0.smithi008.stdout:1/151: chown d9/de/df/d17/d1e/f2d 2012055 1 2023-10-18T20:58:15.727 INFO:tasks.workunit.client.0.smithi008.stdout:1/152: fdatasync d9/de/df/d17/d1e/f2d 0 2023-10-18T20:58:15.727 INFO:tasks.workunit.client.0.smithi008.stdout:1/153: write d9/de/df/d17/d25/f29 [807677,124966] 0 2023-10-18T20:58:15.728 INFO:tasks.workunit.client.1.smithi060.stdout:5/87: dread d0/f1d [0,4194304] 0 2023-10-18T20:58:15.730 INFO:tasks.workunit.client.0.smithi008.stdout:1/154: truncate d9/de/f15 153104 0 2023-10-18T20:58:15.730 INFO:tasks.workunit.client.0.smithi008.stdout:1/155: truncate d9/de/df/f1d 4549477 0 2023-10-18T20:58:15.731 INFO:tasks.workunit.client.1.smithi060.stdout:0/63: write d3/f6 [179240,10394] 0 2023-10-18T20:58:15.731 INFO:tasks.workunit.client.1.smithi060.stdout:0/64: write d3/d8/f11 [211152,11853] 0 2023-10-18T20:58:15.738 INFO:tasks.workunit.client.1.smithi060.stdout:5/88: rmdir d0/d6/d8 39 2023-10-18T20:58:15.738 INFO:tasks.workunit.client.1.smithi060.stdout:5/89: chown d0/d6 69214343 1 2023-10-18T20:58:15.739 INFO:tasks.workunit.client.1.smithi060.stdout:0/65: dread d3/f12 [0,4194304] 0 2023-10-18T20:58:15.743 INFO:tasks.workunit.client.1.smithi060.stdout:5/90: truncate d0/d6/f7 2979065 0 2023-10-18T20:58:15.744 INFO:tasks.workunit.client.1.smithi060.stdout:5/91: write d0/d6/d9/f14 [3315485,3047] 0 2023-10-18T20:58:15.749 INFO:tasks.workunit.client.1.smithi060.stdout:5/92: rename d0/c3 to d0/d6/c23 0 2023-10-18T20:58:15.749 INFO:tasks.workunit.client.1.smithi060.stdout:5/93: write d0/d6/d9/f14 [1704818,53472] 0 2023-10-18T20:58:15.749 INFO:tasks.workunit.client.1.smithi060.stdout:5/94: write d0/f1d [155361,38264] 0 2023-10-18T20:58:15.750 INFO:tasks.workunit.client.1.smithi060.stdout:5/95: readlink d0/dd/l16 0 2023-10-18T20:58:15.752 INFO:tasks.workunit.client.1.smithi060.stdout:5/96: symlink d0/d6/d8/l24 0 2023-10-18T20:58:15.754 INFO:tasks.workunit.client.1.smithi060.stdout:5/97: symlink d0/d6/d8/df/l25 0 2023-10-18T20:58:15.756 INFO:tasks.workunit.client.1.smithi060.stdout:5/98: creat d0/d6/d8/f26 x:0 0 0 2023-10-18T20:58:15.757 INFO:tasks.workunit.client.1.smithi060.stdout:0/66: dread d3/f5 [0,4194304] 0 2023-10-18T20:58:15.759 INFO:tasks.workunit.client.1.smithi060.stdout:0/67: creat d3/f17 x:0 0 0 2023-10-18T20:58:15.761 INFO:tasks.workunit.client.1.smithi060.stdout:1/91: dwrite d4/d6/d7/df/f15 [0,4194304] 0 2023-10-18T20:58:15.761 INFO:tasks.workunit.client.1.smithi060.stdout:1/92: write d4/da/de/f10 [752860,49357] 0 2023-10-18T20:58:15.762 INFO:tasks.workunit.client.1.smithi060.stdout:1/93: chown f1 0 1 2023-10-18T20:58:15.763 INFO:tasks.workunit.client.1.smithi060.stdout:0/68: fdatasync d3/f6 0 2023-10-18T20:58:15.768 INFO:tasks.workunit.client.1.smithi060.stdout:1/94: creat d4/d6/f1f x:0 0 0 2023-10-18T20:58:15.768 INFO:tasks.workunit.client.1.smithi060.stdout:1/95: readlink d4/d6/d14/l16 0 2023-10-18T20:58:15.769 INFO:tasks.workunit.client.1.smithi060.stdout:0/69: symlink d3/d8/d14/l18 0 2023-10-18T20:58:15.769 INFO:tasks.workunit.client.1.smithi060.stdout:0/70: truncate d3/f7 2725611 0 2023-10-18T20:58:15.770 INFO:tasks.workunit.client.1.smithi060.stdout:1/96: getdents d4/d6/d14 0 2023-10-18T20:58:15.771 INFO:tasks.workunit.client.0.smithi008.stdout:1/156: dwrite d9/fb [0,4194304] 0 2023-10-18T20:58:15.775 INFO:tasks.workunit.client.0.smithi008.stdout:1/157: rename d9/de/df/l2a to d9/de/l35 0 2023-10-18T20:58:15.775 INFO:tasks.workunit.client.0.smithi008.stdout:1/158: fdatasync f1 0 2023-10-18T20:58:15.780 INFO:tasks.workunit.client.1.smithi060.stdout:0/71: dread d3/d8/f11 [0,4194304] 0 2023-10-18T20:58:15.787 INFO:tasks.workunit.client.0.smithi008.stdout:1/159: dread f2 [0,4194304] 0 2023-10-18T20:58:15.795 INFO:tasks.workunit.client.0.smithi008.stdout:1/160: write d9/fc [461150,30037] 0 2023-10-18T20:58:15.796 INFO:tasks.workunit.client.0.smithi008.stdout:1/161: link d9/de/df/d17/d1e/l22 d9/de/df/d17/d1e/l36 0 2023-10-18T20:58:15.797 INFO:tasks.workunit.client.0.smithi008.stdout:1/162: chown d9/de/df/d17/d1e/c31 282370951 1 2023-10-18T20:58:15.799 INFO:tasks.workunit.client.1.smithi060.stdout:1/97: dread d4/da/f1c [0,4194304] 0 2023-10-18T20:58:15.801 INFO:tasks.workunit.client.1.smithi060.stdout:1/98: symlink d4/da/l20 0 2023-10-18T20:58:15.801 INFO:tasks.workunit.client.1.smithi060.stdout:1/99: creat d4/d6/d7/f21 x:0 0 0 2023-10-18T20:58:15.801 INFO:tasks.workunit.client.1.smithi060.stdout:1/100: truncate d4/d6/f1f 1041885 0 2023-10-18T20:58:15.804 INFO:tasks.workunit.client.0.smithi008.stdout:1/163: truncate d9/fb 1046449 0 2023-10-18T20:58:15.807 INFO:tasks.workunit.client.0.smithi008.stdout:1/164: mknod d9/de/df/d17/c37 0 2023-10-18T20:58:15.823 INFO:tasks.workunit.client.0.smithi008.stdout:1/165: dread d9/de/df/f10 [0,4194304] 0 2023-10-18T20:58:15.824 INFO:tasks.workunit.client.1.smithi060.stdout:5/99: dwrite d0/f1d [0,4194304] 0 2023-10-18T20:58:15.827 INFO:tasks.workunit.client.1.smithi060.stdout:0/72: dwrite d3/f17 [0,4194304] 0 2023-10-18T20:58:15.827 INFO:tasks.workunit.client.1.smithi060.stdout:0/73: write d3/d8/fa [3182590,92892] 0 2023-10-18T20:58:15.827 INFO:tasks.workunit.client.1.smithi060.stdout:0/74: truncate d3/f17 4531085 0 2023-10-18T20:58:15.827 INFO:tasks.workunit.client.1.smithi060.stdout:0/75: write d3/f6 [46965,75117] 0 2023-10-18T20:58:15.829 INFO:tasks.workunit.client.1.smithi060.stdout:5/100: rmdir d0/d6 39 2023-10-18T20:58:15.830 INFO:tasks.workunit.client.1.smithi060.stdout:5/101: dread - d0/d6/d8/f26 zero size 2023-10-18T20:58:15.833 INFO:tasks.workunit.client.1.smithi060.stdout:5/102: mkdir d0/d6/d8/df/d27 0 2023-10-18T20:58:15.834 INFO:tasks.workunit.client.1.smithi060.stdout:5/103: chown d0/d6/db/c12 1515900 1 2023-10-18T20:58:15.834 INFO:tasks.workunit.client.0.smithi008.stdout:1/166: dread d9/fb [0,4194304] 0 2023-10-18T20:58:15.834 INFO:tasks.workunit.client.0.smithi008.stdout:1/167: dread - d9/f2f zero size 2023-10-18T20:58:15.835 INFO:tasks.workunit.client.1.smithi060.stdout:5/104: creat d0/d6/d8/df/f28 x:0 0 0 2023-10-18T20:58:15.849 INFO:tasks.workunit.client.1.smithi060.stdout:1/101: dwrite d4/da/de/f19 [0,4194304] 0 2023-10-18T20:58:15.849 INFO:tasks.workunit.client.1.smithi060.stdout:1/102: creat d4/d6/f22 x:0 0 0 2023-10-18T20:58:15.857 INFO:tasks.workunit.client.1.smithi060.stdout:5/105: dread d0/f4 [0,4194304] 0 2023-10-18T20:58:15.860 INFO:tasks.workunit.client.1.smithi060.stdout:5/106: symlink d0/da/l29 0 2023-10-18T20:58:15.860 INFO:tasks.workunit.client.1.smithi060.stdout:5/107: fsync d0/d6/d8/f11 0 2023-10-18T20:58:15.863 INFO:tasks.workunit.client.1.smithi060.stdout:1/103: dread d4/d6/f1f [0,4194304] 0 2023-10-18T20:58:15.864 INFO:tasks.workunit.client.1.smithi060.stdout:1/104: chown d4/da/de/f19 0 1 2023-10-18T20:58:15.864 INFO:tasks.workunit.client.1.smithi060.stdout:5/108: mkdir d0/d6/db/d2a 0 2023-10-18T20:58:15.867 INFO:tasks.workunit.client.1.smithi060.stdout:5/109: rename d0/d6/db/c18 to d0/d6/d9/c2b 0 2023-10-18T20:58:15.870 INFO:tasks.workunit.client.1.smithi060.stdout:0/76: dwrite d3/ff [0,4194304] 0 2023-10-18T20:58:15.870 INFO:tasks.workunit.client.1.smithi060.stdout:0/77: chown d3/f13 1614 1 2023-10-18T20:58:15.870 INFO:tasks.workunit.client.1.smithi060.stdout:0/78: fdatasync d3/d8/f11 0 2023-10-18T20:58:15.872 INFO:tasks.workunit.client.1.smithi060.stdout:0/79: creat d3/f19 x:0 0 0 2023-10-18T20:58:15.873 INFO:tasks.workunit.client.1.smithi060.stdout:0/80: creat d3/f1a x:0 0 0 2023-10-18T20:58:15.875 INFO:tasks.workunit.client.1.smithi060.stdout:0/81: mknod d3/c1b 0 2023-10-18T20:58:15.875 INFO:tasks.workunit.client.1.smithi060.stdout:0/82: unlink d3/f7 0 2023-10-18T20:58:15.881 INFO:tasks.workunit.client.1.smithi060.stdout:1/105: dread d4/d6/d7/df/f15 [0,4194304] 0 2023-10-18T20:58:15.881 INFO:tasks.workunit.client.1.smithi060.stdout:1/106: fdatasync d4/d6/d7/f21 0 2023-10-18T20:58:15.881 INFO:tasks.workunit.client.1.smithi060.stdout:1/107: fsync f1 0 2023-10-18T20:58:15.882 INFO:tasks.workunit.client.1.smithi060.stdout:1/108: getdents d4/d6/d14 0 2023-10-18T20:58:15.896 INFO:tasks.workunit.client.1.smithi060.stdout:1/109: mknod d4/c23 0 2023-10-18T20:58:15.897 INFO:tasks.workunit.client.1.smithi060.stdout:1/110: mknod d4/da/de/c24 0 2023-10-18T20:58:15.900 INFO:tasks.workunit.client.1.smithi060.stdout:1/111: unlink d4/da/db/c1b 0 2023-10-18T20:58:15.900 INFO:tasks.workunit.client.1.smithi060.stdout:1/112: truncate d4/d6/f22 234493 0 2023-10-18T20:58:15.900 INFO:tasks.workunit.client.1.smithi060.stdout:1/113: creat d4/da/db/dd/f25 x:0 0 0 2023-10-18T20:58:15.901 INFO:tasks.workunit.client.1.smithi060.stdout:1/114: readlink d4/d6/d7/df/l12 0 2023-10-18T20:58:15.902 INFO:tasks.workunit.client.1.smithi060.stdout:1/115: rename d4/d6/d7/f21 to d4/d6/d7/f26 0 2023-10-18T20:58:15.904 INFO:tasks.workunit.client.0.smithi008.stdout:1/168: dwrite d9/fc [4194304,4194304] 0 2023-10-18T20:58:15.904 INFO:tasks.workunit.client.1.smithi060.stdout:1/116: unlink d4/da/l20 0 2023-10-18T20:58:15.904 INFO:tasks.workunit.client.1.smithi060.stdout:1/117: creat d4/da/de/f27 x:0 0 0 2023-10-18T20:58:15.906 INFO:tasks.workunit.client.1.smithi060.stdout:1/118: mkdir d4/d6/d7/d28 0 2023-10-18T20:58:15.906 INFO:tasks.workunit.client.1.smithi060.stdout:1/119: write d4/d6/f1f [1145467,123502] 0 2023-10-18T20:58:15.908 INFO:tasks.workunit.client.0.smithi008.stdout:5/1: sync 2023-10-18T20:58:15.908 INFO:tasks.workunit.client.0.smithi008.stdout:5/2: fsync - no filename 2023-10-18T20:58:15.908 INFO:tasks.workunit.client.0.smithi008.stdout:5/3: truncate - no filename 2023-10-18T20:58:15.908 INFO:tasks.workunit.client.0.smithi008.stdout:5/4: chown . 0 1 2023-10-18T20:58:15.909 INFO:tasks.workunit.client.0.smithi008.stdout:5/5: read - no filename 2023-10-18T20:58:15.909 INFO:tasks.workunit.client.1.smithi060.stdout:1/120: mknod d4/d6/d7/df/c29 0 2023-10-18T20:58:15.909 INFO:tasks.workunit.client.1.smithi060.stdout:5/110: dwrite d0/d6/f7 [0,4194304] 0 2023-10-18T20:58:15.918 INFO:tasks.workunit.client.0.smithi008.stdout:5/6: mkdir d0 0 2023-10-18T20:58:15.918 INFO:tasks.workunit.client.0.smithi008.stdout:5/7: getdents d0 0 2023-10-18T20:58:15.919 INFO:tasks.workunit.client.0.smithi008.stdout:5/8: stat d0 0 2023-10-18T20:58:15.920 INFO:tasks.workunit.client.0.smithi008.stdout:5/9: mknod d0/c1 0 2023-10-18T20:58:15.920 INFO:tasks.workunit.client.0.smithi008.stdout:5/10: write - no filename 2023-10-18T20:58:15.921 INFO:tasks.workunit.client.0.smithi008.stdout:5/11: mkdir d0/d2 0 2023-10-18T20:58:15.923 INFO:tasks.workunit.client.0.smithi008.stdout:5/12: creat d0/f3 x:0 0 0 2023-10-18T20:58:15.923 INFO:tasks.workunit.client.0.smithi008.stdout:5/13: stat d0/c1 0 2023-10-18T20:58:15.924 INFO:tasks.workunit.client.0.smithi008.stdout:5/14: rename d0 to d0/d2/d4 22 2023-10-18T20:58:15.925 INFO:tasks.workunit.client.0.smithi008.stdout:5/15: link d0/c1 d0/d2/c5 0 2023-10-18T20:58:15.925 INFO:tasks.workunit.client.1.smithi060.stdout:0/83: dwrite d3/f5 [0,4194304] 0 2023-10-18T20:58:15.926 INFO:tasks.workunit.client.1.smithi060.stdout:5/111: dread d0/d6/d8/f11 [0,4194304] 0 2023-10-18T20:58:15.927 INFO:tasks.workunit.client.1.smithi060.stdout:5/112: write d0/d6/d8/f21 [130225,33028] 0 2023-10-18T20:58:15.930 INFO:tasks.workunit.client.1.smithi060.stdout:5/113: rename d0/d6/d8/f26 to d0/f2c 0 2023-10-18T20:58:15.930 INFO:tasks.workunit.client.1.smithi060.stdout:0/84: getdents d3 0 2023-10-18T20:58:15.932 INFO:tasks.workunit.client.1.smithi060.stdout:5/114: link d0/c2 d0/d6/c2d 0 2023-10-18T20:58:15.936 INFO:tasks.workunit.client.1.smithi060.stdout:0/85: rmdir d3/d8/d14 39 2023-10-18T20:58:15.936 INFO:tasks.workunit.client.1.smithi060.stdout:0/86: chown d3/f6 12369 1 2023-10-18T20:58:15.936 INFO:tasks.workunit.client.1.smithi060.stdout:0/87: write d3/f12 [136830,6582] 0 2023-10-18T20:58:15.938 INFO:tasks.workunit.client.1.smithi060.stdout:0/88: creat d3/d8/d14/f1c x:0 0 0 2023-10-18T20:58:15.938 INFO:tasks.workunit.client.1.smithi060.stdout:0/89: getdents d3 0 2023-10-18T20:58:15.938 INFO:tasks.workunit.client.1.smithi060.stdout:0/90: chown d3/fc 0 1 2023-10-18T20:58:15.946 INFO:tasks.workunit.client.1.smithi060.stdout:5/115: dread d0/d6/d9/f14 [0,4194304] 0 2023-10-18T20:58:15.948 INFO:tasks.workunit.client.1.smithi060.stdout:5/116: link d0/c1f d0/d6/d8/df/d27/c2e 0 2023-10-18T20:58:15.949 INFO:tasks.workunit.client.1.smithi060.stdout:5/117: mknod d0/d6/db/d2a/c2f 0 2023-10-18T20:58:15.951 INFO:tasks.workunit.client.0.smithi008.stdout:1/169: dwrite d9/de/df/d17/d25/f29 [0,4194304] 0 2023-10-18T20:58:15.952 INFO:tasks.workunit.client.0.smithi008.stdout:1/170: truncate d9/de/df/f1d 4651912 0 2023-10-18T20:58:15.955 INFO:tasks.workunit.client.1.smithi060.stdout:0/91: dread d3/ff [0,4194304] 0 2023-10-18T20:58:15.955 INFO:tasks.workunit.client.1.smithi060.stdout:0/92: write d3/d8/d14/f1c [974841,129270] 0 2023-10-18T20:58:15.956 INFO:tasks.workunit.client.0.smithi008.stdout:1/171: rename d9/de/df/c33 to d9/de/df/d17/c38 0 2023-10-18T20:58:15.956 INFO:tasks.workunit.client.0.smithi008.stdout:1/172: dread - d9/f2f zero size 2023-10-18T20:58:15.958 INFO:tasks.workunit.client.1.smithi060.stdout:1/121: dwrite f2 [0,4194304] 0 2023-10-18T20:58:15.959 INFO:tasks.workunit.client.0.smithi008.stdout:1/173: mknod d9/de/df/d17/c39 0 2023-10-18T20:58:15.961 INFO:tasks.workunit.client.1.smithi060.stdout:5/118: dread d0/d6/d8/f21 [0,4194304] 0 2023-10-18T20:58:15.961 INFO:tasks.workunit.client.1.smithi060.stdout:5/119: truncate d0/d6/d8/df/f28 262121 0 2023-10-18T20:58:15.961 INFO:tasks.workunit.client.1.smithi060.stdout:5/120: fsync d0/f1d 0 2023-10-18T20:58:15.962 INFO:tasks.workunit.client.1.smithi060.stdout:1/122: unlink d4/da/de/f19 0 2023-10-18T20:58:15.964 INFO:tasks.workunit.client.1.smithi060.stdout:1/123: rename d4/d6/d7/d28 to d4/da/de/d2a 0 2023-10-18T20:58:15.965 INFO:tasks.workunit.client.1.smithi060.stdout:5/121: mkdir d0/d6/d30 0 2023-10-18T20:58:15.965 INFO:tasks.workunit.client.1.smithi060.stdout:5/122: dread - d0/d6/db/f22 zero size 2023-10-18T20:58:15.965 INFO:tasks.workunit.client.1.smithi060.stdout:5/123: truncate d0/d6/d8/f21 803410 0 2023-10-18T20:58:15.966 INFO:tasks.workunit.client.1.smithi060.stdout:5/124: symlink d0/l31 0 2023-10-18T20:58:15.971 INFO:tasks.workunit.client.1.smithi060.stdout:0/93: truncate d3/f13 3916088 0 2023-10-18T20:58:15.971 INFO:tasks.workunit.client.1.smithi060.stdout:0/94: creat d3/d8/d14/f1d x:0 0 0 2023-10-18T20:58:15.971 INFO:tasks.workunit.client.1.smithi060.stdout:0/95: chown d3/f19 863 1 2023-10-18T20:58:16.018 INFO:tasks.workunit.client.1.smithi060.stdout:1/124: dwrite d4/d6/d7/f26 [0,4194304] 0 2023-10-18T20:58:16.024 INFO:tasks.workunit.client.1.smithi060.stdout:1/125: symlink d4/d6/d14/l2b 0 2023-10-18T20:58:16.026 INFO:tasks.workunit.client.1.smithi060.stdout:1/126: rename d4/da/de/f10 to d4/d6/d7/df/f2c 0 2023-10-18T20:58:16.031 INFO:tasks.workunit.client.1.smithi060.stdout:1/127: getdents d4 0 2023-10-18T20:58:16.032 INFO:tasks.workunit.client.0.smithi008.stdout:1/174: dwrite f1 [4194304,4194304] 0 2023-10-18T20:58:16.033 INFO:tasks.workunit.client.0.smithi008.stdout:1/175: write d9/de/df/d17/d25/f32 [586412,83762] 0 2023-10-18T20:58:16.033 INFO:tasks.workunit.client.0.smithi008.stdout:1/176: chown d9/de/c16 403303 1 2023-10-18T20:58:16.033 INFO:tasks.workunit.client.1.smithi060.stdout:5/125: dwrite d0/d6/f1e [0,4194304] 0 2023-10-18T20:58:16.034 INFO:tasks.workunit.client.0.smithi008.stdout:1/177: truncate d9/de/df/f10 3048012 0 2023-10-18T20:58:16.039 INFO:tasks.workunit.client.1.smithi060.stdout:5/126: getdents d0/dd 0 2023-10-18T20:58:16.039 INFO:tasks.workunit.client.1.smithi060.stdout:5/127: write d0/d6/d8/df/f28 [532115,27971] 0 2023-10-18T20:58:16.044 INFO:tasks.workunit.client.1.smithi060.stdout:0/96: dwrite d3/d8/d14/f1c [0,4194304] 0 2023-10-18T20:58:16.048 INFO:tasks.workunit.client.1.smithi060.stdout:0/97: symlink d3/l1e 0 2023-10-18T20:58:16.078 INFO:tasks.workunit.client.1.smithi060.stdout:5/128: dwrite d0/d6/d8/f1b [0,4194304] 0 2023-10-18T20:58:16.080 INFO:tasks.workunit.client.1.smithi060.stdout:5/129: mkdir d0/d6/d8/df/d27/d32 0 2023-10-18T20:58:16.080 INFO:tasks.workunit.client.1.smithi060.stdout:5/130: unlink d0/l31 0 2023-10-18T20:58:16.080 INFO:tasks.workunit.client.1.smithi060.stdout:5/131: fsync d0/d6/d8/f11 0 2023-10-18T20:58:16.172 INFO:tasks.workunit.client.0.smithi008.stdout:0/21: sync 2023-10-18T20:58:16.173 INFO:tasks.workunit.client.0.smithi008.stdout:0/22: creat d0/f4 x:0 0 0 2023-10-18T20:58:16.173 INFO:tasks.workunit.client.0.smithi008.stdout:0/23: read - d0/f3 zero size 2023-10-18T20:58:16.175 INFO:tasks.workunit.client.0.smithi008.stdout:0/24: mkdir d0/d5 0 2023-10-18T20:58:16.178 INFO:tasks.workunit.client.0.smithi008.stdout:0/25: fsync d0/f4 0 2023-10-18T20:58:16.179 INFO:tasks.workunit.client.0.smithi008.stdout:0/26: mknod d0/d5/c6 0 2023-10-18T20:58:16.180 INFO:tasks.workunit.client.0.smithi008.stdout:0/27: rename d0/d5/c6 to d0/c7 0 2023-10-18T20:58:16.181 INFO:tasks.workunit.client.0.smithi008.stdout:0/28: write d0/f2 [1204185,97411] 0 2023-10-18T20:58:16.185 INFO:tasks.workunit.client.0.smithi008.stdout:0/29: getdents d0 0 2023-10-18T20:58:16.185 INFO:tasks.workunit.client.0.smithi008.stdout:0/30: read - d0/f3 zero size 2023-10-18T20:58:16.185 INFO:tasks.workunit.client.0.smithi008.stdout:0/31: readlink - no filename 2023-10-18T20:58:16.186 INFO:tasks.workunit.client.0.smithi008.stdout:0/32: creat d0/f8 x:0 0 0 2023-10-18T20:58:16.190 INFO:tasks.workunit.client.0.smithi008.stdout:0/33: fsync d0/f2 0 2023-10-18T20:58:16.191 INFO:tasks.workunit.client.0.smithi008.stdout:0/34: dread - d0/f3 zero size 2023-10-18T20:58:16.191 INFO:tasks.workunit.client.0.smithi008.stdout:0/35: dread - d0/f3 zero size 2023-10-18T20:58:16.192 INFO:tasks.workunit.client.0.smithi008.stdout:0/36: symlink d0/l9 0 2023-10-18T20:58:16.192 INFO:tasks.workunit.client.0.smithi008.stdout:0/37: dread - d0/f3 zero size 2023-10-18T20:58:16.237 INFO:tasks.workunit.client.0.smithi008.stdout:0/38: dwrite d0/f3 [0,4194304] 0 2023-10-18T20:58:16.238 INFO:tasks.workunit.client.0.smithi008.stdout:0/39: write d0/f8 [282807,50015] 0 2023-10-18T20:58:16.240 INFO:tasks.workunit.client.0.smithi008.stdout:0/40: write d0/f4 [455546,129923] 0 2023-10-18T20:58:16.246 INFO:tasks.workunit.client.0.smithi008.stdout:5/16: sync 2023-10-18T20:58:16.246 INFO:tasks.workunit.client.0.smithi008.stdout:6/68: sync 2023-10-18T20:58:16.246 INFO:tasks.workunit.client.0.smithi008.stdout:3/21: sync 2023-10-18T20:58:16.246 INFO:tasks.workunit.client.0.smithi008.stdout:2/35: sync 2023-10-18T20:58:16.247 INFO:tasks.workunit.client.0.smithi008.stdout:7/35: sync 2023-10-18T20:58:16.247 INFO:tasks.workunit.client.0.smithi008.stdout:2/36: truncate - no filename 2023-10-18T20:58:16.248 INFO:tasks.workunit.client.0.smithi008.stdout:1/178: sync 2023-10-18T20:58:16.248 INFO:tasks.workunit.client.0.smithi008.stdout:1/179: dread - d9/f2f zero size 2023-10-18T20:58:16.248 INFO:tasks.workunit.client.0.smithi008.stdout:9/27: sync 2023-10-18T20:58:16.249 INFO:tasks.workunit.client.0.smithi008.stdout:8/102: sync 2023-10-18T20:58:16.249 INFO:tasks.workunit.client.0.smithi008.stdout:9/28: fsync f0 0 2023-10-18T20:58:16.249 INFO:tasks.workunit.client.0.smithi008.stdout:9/29: fdatasync d2/f3 0 2023-10-18T20:58:16.249 INFO:tasks.workunit.client.0.smithi008.stdout:1/180: write d9/fb [1729744,42316] 0 2023-10-18T20:58:16.249 INFO:tasks.workunit.client.0.smithi008.stdout:4/38: sync 2023-10-18T20:58:16.250 INFO:tasks.workunit.client.0.smithi008.stdout:9/30: write d2/f3 [4966843,71518] 0 2023-10-18T20:58:16.250 INFO:tasks.workunit.client.0.smithi008.stdout:3/22: rename d0/f2 to d0/f7 0 2023-10-18T20:58:16.250 INFO:tasks.workunit.client.0.smithi008.stdout:3/23: write d0/f4 [607548,116149] 0 2023-10-18T20:58:16.251 INFO:tasks.workunit.client.0.smithi008.stdout:2/37: stat d1/l7 0 2023-10-18T20:58:16.252 INFO:tasks.workunit.client.0.smithi008.stdout:7/36: link d1/f4 d1/d3/ff 0 2023-10-18T20:58:16.253 INFO:tasks.workunit.client.0.smithi008.stdout:7/37: write d1/fd [812202,98550] 0 2023-10-18T20:58:16.255 INFO:tasks.workunit.client.0.smithi008.stdout:6/69: creat df/d13/f17 x:0 0 0 2023-10-18T20:58:16.255 INFO:tasks.workunit.client.0.smithi008.stdout:6/70: dread - df/d13/f17 zero size 2023-10-18T20:58:16.256 INFO:tasks.workunit.client.0.smithi008.stdout:8/103: unlink d5/fe 0 2023-10-18T20:58:16.258 INFO:tasks.workunit.client.0.smithi008.stdout:9/31: truncate f0 7162782 0 2023-10-18T20:58:16.261 INFO:tasks.workunit.client.0.smithi008.stdout:3/24: mkdir d0/d3/d8 0 2023-10-18T20:58:16.263 INFO:tasks.workunit.client.0.smithi008.stdout:2/38: mknod d1/d3/ca 0 2023-10-18T20:58:16.263 INFO:tasks.workunit.client.0.smithi008.stdout:2/39: write - no filename 2023-10-18T20:58:16.267 INFO:tasks.workunit.client.0.smithi008.stdout:7/38: write d1/fd [231430,47974] 0 2023-10-18T20:58:16.270 INFO:tasks.workunit.client.0.smithi008.stdout:1/181: read d9/de/df/d17/d25/f29 [667387,113501] 0 2023-10-18T20:58:16.270 INFO:tasks.workunit.client.0.smithi008.stdout:1/182: fdatasync d9/de/f11 0 2023-10-18T20:58:16.271 INFO:tasks.workunit.client.0.smithi008.stdout:8/104: symlink d5/d8/d17/l2f 0 2023-10-18T20:58:16.272 INFO:tasks.workunit.client.0.smithi008.stdout:3/25: creat d0/d3/d8/f9 x:0 0 0 2023-10-18T20:58:16.272 INFO:tasks.workunit.client.0.smithi008.stdout:3/26: write d0/d3/f6 [2000392,4535] 0 2023-10-18T20:58:16.273 INFO:tasks.workunit.client.0.smithi008.stdout:2/40: rename d1/l7 to d1/d3/lb 0 2023-10-18T20:58:16.273 INFO:tasks.workunit.client.0.smithi008.stdout:2/41: dread - no filename 2023-10-18T20:58:16.274 INFO:tasks.workunit.client.0.smithi008.stdout:2/42: fsync - no filename 2023-10-18T20:58:16.277 INFO:tasks.workunit.client.0.smithi008.stdout:1/183: mknod d9/de/df/d17/c3a 0 2023-10-18T20:58:16.279 INFO:tasks.workunit.client.0.smithi008.stdout:3/27: mkdir d0/d3/d8/da 0 2023-10-18T20:58:16.286 INFO:tasks.workunit.client.0.smithi008.stdout:6/71: dread df/d15/f16 [0,4194304] 0 2023-10-18T20:58:16.286 INFO:tasks.workunit.client.0.smithi008.stdout:7/39: getdents d1/d3 0 2023-10-18T20:58:16.300 INFO:tasks.workunit.client.0.smithi008.stdout:3/28: rename d0/d3/d8 to d0/d3/db 0 2023-10-18T20:58:16.302 INFO:tasks.workunit.client.0.smithi008.stdout:3/29: mknod d0/d3/cc 0 2023-10-18T20:58:16.304 INFO:tasks.workunit.client.0.smithi008.stdout:3/30: rmdir d0/d3/db/da 0 2023-10-18T20:58:16.306 INFO:tasks.workunit.client.0.smithi008.stdout:3/31: creat d0/d3/fd x:0 0 0 2023-10-18T20:58:16.306 INFO:tasks.workunit.client.0.smithi008.stdout:3/32: readlink - no filename 2023-10-18T20:58:16.308 INFO:tasks.workunit.client.0.smithi008.stdout:3/33: mkdir d0/d3/de 0 2023-10-18T20:58:16.309 INFO:tasks.workunit.client.0.smithi008.stdout:3/34: truncate d0/f7 2264085 0 2023-10-18T20:58:16.311 INFO:tasks.workunit.client.0.smithi008.stdout:3/35: symlink d0/d3/de/lf 0 2023-10-18T20:58:16.348 INFO:tasks.workunit.client.0.smithi008.stdout:8/105: dwrite d5/f1f [0,4194304] 0 2023-10-18T20:58:16.349 INFO:tasks.workunit.client.0.smithi008.stdout:8/106: write d5/f18 [239862,104697] 0 2023-10-18T20:58:16.350 INFO:tasks.workunit.client.0.smithi008.stdout:8/107: chown d5/f1c 434625598 1 2023-10-18T20:58:16.350 INFO:tasks.workunit.client.0.smithi008.stdout:8/108: truncate d5/f15 879243 0 2023-10-18T20:58:16.350 INFO:tasks.workunit.client.0.smithi008.stdout:8/109: chown d5/d8/d17/l2f 162 1 2023-10-18T20:58:16.351 INFO:tasks.workunit.client.0.smithi008.stdout:0/41: dwrite d0/f8 [0,4194304] 0 2023-10-18T20:58:16.355 INFO:tasks.workunit.client.0.smithi008.stdout:9/32: dwrite f0 [0,4194304] 0 2023-10-18T20:58:16.363 INFO:tasks.workunit.client.0.smithi008.stdout:1/184: dwrite d9/de/df/f1d [4194304,4194304] 0 2023-10-18T20:58:16.365 INFO:tasks.workunit.client.0.smithi008.stdout:7/40: dwrite d1/f4 [0,4194304] 0 2023-10-18T20:58:16.367 INFO:tasks.workunit.client.0.smithi008.stdout:1/185: symlink d9/de/df/d17/d25/l3b 0 2023-10-18T20:58:16.375 INFO:tasks.workunit.client.0.smithi008.stdout:9/33: dread d2/f3 [0,4194304] 0 2023-10-18T20:58:16.379 INFO:tasks.workunit.client.0.smithi008.stdout:6/72: dwrite fd [0,4194304] 0 2023-10-18T20:58:16.379 INFO:tasks.workunit.client.0.smithi008.stdout:8/110: write d5/f1f [3093131,25557] 0 2023-10-18T20:58:16.380 INFO:tasks.workunit.client.0.smithi008.stdout:5/17: dwrite d0/f3 [0,4194304] 0 2023-10-18T20:58:16.381 INFO:tasks.workunit.client.0.smithi008.stdout:7/41: write d1/d3/fc [2390388,111452] 0 2023-10-18T20:58:16.382 INFO:tasks.workunit.client.0.smithi008.stdout:7/42: fsync d1/fd 0 2023-10-18T20:58:16.382 INFO:tasks.workunit.client.0.smithi008.stdout:7/43: chown c0 650343408 1 2023-10-18T20:58:16.382 INFO:tasks.workunit.client.0.smithi008.stdout:0/42: rmdir d0/d5 0 2023-10-18T20:58:16.385 INFO:tasks.workunit.client.0.smithi008.stdout:8/111: symlink d5/d8/df/l30 0 2023-10-18T20:58:16.385 INFO:tasks.workunit.client.0.smithi008.stdout:8/112: write d5/f18 [472569,84912] 0 2023-10-18T20:58:16.386 INFO:tasks.workunit.client.0.smithi008.stdout:8/113: rename d5/d8 to d5/d8/d2a/d31 22 2023-10-18T20:58:16.386 INFO:tasks.workunit.client.0.smithi008.stdout:8/114: stat d5/l7 0 2023-10-18T20:58:16.387 INFO:tasks.workunit.client.0.smithi008.stdout:3/36: dwrite d0/d3/f6 [0,4194304] 0 2023-10-18T20:58:16.387 INFO:tasks.workunit.client.0.smithi008.stdout:3/37: read - d0/d3/fd zero size 2023-10-18T20:58:16.387 INFO:tasks.workunit.client.0.smithi008.stdout:3/38: write d0/d3/db/f9 [298415,113844] 0 2023-10-18T20:58:16.387 INFO:tasks.workunit.client.0.smithi008.stdout:3/39: write d0/f4 [1525469,111499] 0 2023-10-18T20:58:16.388 INFO:tasks.workunit.client.0.smithi008.stdout:5/18: link d0/d2/c5 d0/c6 0 2023-10-18T20:58:16.397 INFO:tasks.workunit.client.0.smithi008.stdout:9/34: dread d2/f3 [0,4194304] 0 2023-10-18T20:58:16.397 INFO:tasks.workunit.client.0.smithi008.stdout:9/35: creat d2/f4 x:0 0 0 2023-10-18T20:58:16.398 INFO:tasks.workunit.client.0.smithi008.stdout:9/36: read - d2/f4 zero size 2023-10-18T20:58:16.398 INFO:tasks.workunit.client.0.smithi008.stdout:9/37: creat d2/f5 x:0 0 0 2023-10-18T20:58:16.398 INFO:tasks.workunit.client.0.smithi008.stdout:9/38: write d2/f4 [273620,21242] 0 2023-10-18T20:58:16.398 INFO:tasks.workunit.client.0.smithi008.stdout:6/73: write f5 [3581240,63085] 0 2023-10-18T20:58:16.398 INFO:tasks.workunit.client.0.smithi008.stdout:6/74: chown fd 149 1 2023-10-18T20:58:16.399 INFO:tasks.workunit.client.0.smithi008.stdout:0/43: unlink d0/f8 0 2023-10-18T20:58:16.399 INFO:tasks.workunit.client.0.smithi008.stdout:0/44: chown d0 141359 1 2023-10-18T20:58:16.403 INFO:tasks.workunit.client.0.smithi008.stdout:1/186: dwrite d9/de/df/f10 [0,4194304] 0 2023-10-18T20:58:16.409 INFO:tasks.workunit.client.0.smithi008.stdout:3/40: creat d0/d3/de/f10 x:0 0 0 2023-10-18T20:58:16.421 INFO:tasks.workunit.client.0.smithi008.stdout:6/75: mkdir df/d18 0 2023-10-18T20:58:16.421 INFO:tasks.workunit.client.0.smithi008.stdout:6/76: fsync fd 0 2023-10-18T20:58:16.421 INFO:tasks.workunit.client.0.smithi008.stdout:7/44: dread d1/d3/fc [0,4194304] 0 2023-10-18T20:58:16.422 INFO:tasks.workunit.client.0.smithi008.stdout:1/187: stat c3 0 2023-10-18T20:58:16.422 INFO:tasks.workunit.client.0.smithi008.stdout:8/115: rmdir d5/d8/df 39 2023-10-18T20:58:16.422 INFO:tasks.workunit.client.0.smithi008.stdout:6/77: mkdir df/d19 0 2023-10-18T20:58:16.422 INFO:tasks.workunit.client.0.smithi008.stdout:0/45: mkdir d0/da 0 2023-10-18T20:58:16.422 INFO:tasks.workunit.client.0.smithi008.stdout:7/45: mknod d1/d3/c10 0 2023-10-18T20:58:16.423 INFO:tasks.workunit.client.0.smithi008.stdout:7/46: stat d1/d3/c10 0 2023-10-18T20:58:16.423 INFO:tasks.workunit.client.0.smithi008.stdout:7/47: chown d1/d3/ca 21 1 2023-10-18T20:58:16.423 INFO:tasks.workunit.client.0.smithi008.stdout:8/116: unlink d5/d8/df/l2d 0 2023-10-18T20:58:16.423 INFO:tasks.workunit.client.0.smithi008.stdout:7/48: chown d1/d3/fc 321198805 1 2023-10-18T20:58:16.424 INFO:tasks.workunit.client.0.smithi008.stdout:5/19: write d0/f3 [1190534,53746] 0 2023-10-18T20:58:16.426 INFO:tasks.workunit.client.0.smithi008.stdout:1/188: mkdir d9/de/df/d17/d1e/d3c 0 2023-10-18T20:58:16.426 INFO:tasks.workunit.client.0.smithi008.stdout:1/189: chown d9/de/df/d17/l34 23253833 1 2023-10-18T20:58:16.432 INFO:tasks.workunit.client.0.smithi008.stdout:5/20: creat d0/d2/f7 x:0 0 0 2023-10-18T20:58:16.433 INFO:tasks.workunit.client.0.smithi008.stdout:5/21: creat d0/f8 x:0 0 0 2023-10-18T20:58:16.437 INFO:tasks.workunit.client.0.smithi008.stdout:5/22: mkdir d0/d2/d9 0 2023-10-18T20:58:16.438 INFO:tasks.workunit.client.0.smithi008.stdout:5/23: readlink - no filename 2023-10-18T20:58:16.438 INFO:tasks.workunit.client.0.smithi008.stdout:5/24: dread - d0/f8 zero size 2023-10-18T20:58:16.439 INFO:tasks.workunit.client.0.smithi008.stdout:6/78: dread df/d15/f16 [0,4194304] 0 2023-10-18T20:58:16.439 INFO:tasks.workunit.client.0.smithi008.stdout:6/79: creat df/d13/f1a x:0 0 0 2023-10-18T20:58:16.439 INFO:tasks.workunit.client.0.smithi008.stdout:6/80: dread - df/d13/f1a zero size 2023-10-18T20:58:16.442 INFO:tasks.workunit.client.0.smithi008.stdout:1/190: rmdir d9/de/df/d17/d1e 39 2023-10-18T20:58:16.443 INFO:tasks.workunit.client.0.smithi008.stdout:1/191: creat d9/de/df/d17/d25/f3d x:0 0 0 2023-10-18T20:58:16.444 INFO:tasks.workunit.client.0.smithi008.stdout:1/192: fdatasync d9/fb 0 2023-10-18T20:58:16.448 INFO:tasks.workunit.client.0.smithi008.stdout:9/39: dwrite f0 [4194304,4194304] 0 2023-10-18T20:58:16.448 INFO:tasks.workunit.client.0.smithi008.stdout:0/46: write d0/f3 [4049194,74639] 0 2023-10-18T20:58:16.448 INFO:tasks.workunit.client.0.smithi008.stdout:0/47: write d0/f3 [389667,17993] 0 2023-10-18T20:58:16.448 INFO:tasks.workunit.client.0.smithi008.stdout:0/48: truncate d0/f4 1038657 0 2023-10-18T20:58:16.449 INFO:tasks.workunit.client.0.smithi008.stdout:0/49: chown d0/da 1004639714 1 2023-10-18T20:58:16.449 INFO:tasks.workunit.client.0.smithi008.stdout:0/50: truncate d0/f2 1739243 0 2023-10-18T20:58:16.450 INFO:tasks.workunit.client.0.smithi008.stdout:6/81: mknod df/d13/c1b 0 2023-10-18T20:58:16.460 INFO:tasks.workunit.client.0.smithi008.stdout:9/40: symlink d2/l6 0 2023-10-18T20:58:16.461 INFO:tasks.workunit.client.0.smithi008.stdout:5/25: getdents d0 0 2023-10-18T20:58:16.461 INFO:tasks.workunit.client.0.smithi008.stdout:5/26: chown d0/c1 138 1 2023-10-18T20:58:16.461 INFO:tasks.workunit.client.0.smithi008.stdout:5/27: getdents d0 0 2023-10-18T20:58:16.461 INFO:tasks.workunit.client.0.smithi008.stdout:5/28: rename d0 to d0/da 22 2023-10-18T20:58:16.463 INFO:tasks.workunit.client.0.smithi008.stdout:0/51: rmdir d0/da 0 2023-10-18T20:58:16.468 INFO:tasks.workunit.client.0.smithi008.stdout:6/82: link fd df/d19/f1c 0 2023-10-18T20:58:16.469 INFO:tasks.workunit.client.0.smithi008.stdout:6/83: dread - df/d13/f1a zero size 2023-10-18T20:58:16.479 INFO:tasks.workunit.client.0.smithi008.stdout:3/41: dwrite d0/d3/fd [0,4194304] 0 2023-10-18T20:58:16.482 INFO:tasks.workunit.client.0.smithi008.stdout:0/52: creat d0/fb x:0 0 0 2023-10-18T20:58:16.482 INFO:tasks.workunit.client.0.smithi008.stdout:5/29: mknod d0/cb 0 2023-10-18T20:58:16.483 INFO:tasks.workunit.client.0.smithi008.stdout:2/43: sync 2023-10-18T20:58:16.483 INFO:tasks.workunit.client.0.smithi008.stdout:4/39: sync 2023-10-18T20:58:16.483 INFO:tasks.workunit.client.0.smithi008.stdout:4/40: chown d0 348790788 1 2023-10-18T20:58:16.487 INFO:tasks.workunit.client.0.smithi008.stdout:6/84: rmdir df/d15 39 2023-10-18T20:58:16.489 INFO:tasks.workunit.client.0.smithi008.stdout:5/30: write d0/f3 [3775423,72708] 0 2023-10-18T20:58:16.490 INFO:tasks.workunit.client.0.smithi008.stdout:2/44: mknod d1/d3/cc 0 2023-10-18T20:58:16.491 INFO:tasks.workunit.client.0.smithi008.stdout:0/53: write d0/f4 [270196,120199] 0 2023-10-18T20:58:16.492 INFO:tasks.workunit.client.0.smithi008.stdout:8/117: dwrite d5/d8/d24/f27 [0,4194304] 0 2023-10-18T20:58:16.492 INFO:tasks.workunit.client.0.smithi008.stdout:1/193: dwrite d9/de/df/d17/d25/f32 [0,4194304] 0 2023-10-18T20:58:16.496 INFO:tasks.workunit.client.0.smithi008.stdout:4/41: rename d0/l9 to d0/d3/l10 0 2023-10-18T20:58:16.497 INFO:tasks.workunit.client.0.smithi008.stdout:4/42: truncate d0/d3/d8/fb 9963546 0 2023-10-18T20:58:16.497 INFO:tasks.workunit.client.0.smithi008.stdout:4/43: write d0/d3/f4 [3715364,14397] 0 2023-10-18T20:58:16.497 INFO:tasks.workunit.client.0.smithi008.stdout:4/44: chown d0/d3/d8/fc 585755 1 2023-10-18T20:58:16.499 INFO:tasks.workunit.client.0.smithi008.stdout:6/85: dread f5 [0,4194304] 0 2023-10-18T20:58:16.503 INFO:tasks.workunit.client.0.smithi008.stdout:0/54: dread d0/f2 [0,4194304] 0 2023-10-18T20:58:16.503 INFO:tasks.workunit.client.0.smithi008.stdout:2/45: mkdir d1/d3/dd 0 2023-10-18T20:58:16.503 INFO:tasks.workunit.client.0.smithi008.stdout:2/46: stat d1/d3/cc 0 2023-10-18T20:58:16.504 INFO:tasks.workunit.client.0.smithi008.stdout:2/47: chown d1/d3/c9 1695566049 1 2023-10-18T20:58:16.504 INFO:tasks.workunit.client.0.smithi008.stdout:2/48: write - no filename 2023-10-18T20:58:16.509 INFO:tasks.workunit.client.0.smithi008.stdout:8/118: link d5/d8/df/f14 d5/d8/f32 0 2023-10-18T20:58:16.514 INFO:tasks.workunit.client.0.smithi008.stdout:1/194: link c3 d9/c3e 0 2023-10-18T20:58:16.521 INFO:tasks.workunit.client.0.smithi008.stdout:9/41: dwrite f0 [4194304,4194304] 0 2023-10-18T20:58:16.521 INFO:tasks.workunit.client.0.smithi008.stdout:2/49: symlink d1/d3/dd/le 0 2023-10-18T20:58:16.522 INFO:tasks.workunit.client.0.smithi008.stdout:8/119: rename d5/d8/d17/l2f to d5/d8/d17/l33 0 2023-10-18T20:58:16.523 INFO:tasks.workunit.client.0.smithi008.stdout:5/31: link d0/c6 d0/d2/d9/cc 0 2023-10-18T20:58:16.524 INFO:tasks.workunit.client.0.smithi008.stdout:4/45: getdents d0/d3/d8 0 2023-10-18T20:58:16.525 INFO:tasks.workunit.client.0.smithi008.stdout:1/195: dread d9/de/f15 [0,4194304] 0 2023-10-18T20:58:16.525 INFO:tasks.workunit.client.0.smithi008.stdout:5/32: dread - d0/d2/f7 zero size 2023-10-18T20:58:16.525 INFO:tasks.workunit.client.0.smithi008.stdout:0/55: symlink d0/lc 0 2023-10-18T20:58:16.536 INFO:tasks.workunit.client.0.smithi008.stdout:9/42: dread d2/f3 [0,4194304] 0 2023-10-18T20:58:16.536 INFO:tasks.workunit.client.0.smithi008.stdout:9/43: write d2/f3 [287197,55050] 0 2023-10-18T20:58:16.536 INFO:tasks.workunit.client.0.smithi008.stdout:9/44: chown d2/l6 53024 1 2023-10-18T20:58:16.536 INFO:tasks.workunit.client.0.smithi008.stdout:9/45: stat c1 0 2023-10-18T20:58:16.537 INFO:tasks.workunit.client.0.smithi008.stdout:2/50: mknod d1/d3/cf 0 2023-10-18T20:58:16.537 INFO:tasks.workunit.client.0.smithi008.stdout:2/51: stat d1 0 2023-10-18T20:58:16.537 INFO:tasks.workunit.client.0.smithi008.stdout:2/52: truncate - no filename 2023-10-18T20:58:16.538 INFO:tasks.workunit.client.0.smithi008.stdout:2/53: readlink d1/d3/dd/le 0 2023-10-18T20:58:16.544 INFO:tasks.workunit.client.0.smithi008.stdout:1/196: link d9/ld d9/de/df/d17/l3f 0 2023-10-18T20:58:16.548 INFO:tasks.workunit.client.0.smithi008.stdout:5/33: write d0/f8 [731358,96272] 0 2023-10-18T20:58:16.552 INFO:tasks.workunit.client.0.smithi008.stdout:8/120: rename d5/d8/d17/l33 to d5/d8/d24/l34 0 2023-10-18T20:58:16.552 INFO:tasks.workunit.client.0.smithi008.stdout:2/54: symlink d1/d3/dd/l10 0 2023-10-18T20:58:16.554 INFO:tasks.workunit.client.0.smithi008.stdout:5/34: mknod d0/d2/d9/cd 0 2023-10-18T20:58:16.557 INFO:tasks.workunit.client.0.smithi008.stdout:4/46: write d0/d3/f4 [7903795,96491] 0 2023-10-18T20:58:16.559 INFO:tasks.workunit.client.0.smithi008.stdout:8/121: creat d5/d8/df/d2e/f35 x:0 0 0 2023-10-18T20:58:16.560 INFO:tasks.workunit.client.0.smithi008.stdout:6/86: dwrite fd [0,4194304] 0 2023-10-18T20:58:16.561 INFO:tasks.workunit.client.0.smithi008.stdout:6/87: fdatasync f5 0 2023-10-18T20:58:16.561 INFO:tasks.workunit.client.0.smithi008.stdout:6/88: fsync df/d19/f1c 0 2023-10-18T20:58:16.561 INFO:tasks.workunit.client.0.smithi008.stdout:6/89: fsync df/d19/f1c 0 2023-10-18T20:58:16.561 INFO:tasks.workunit.client.0.smithi008.stdout:6/90: chown df/c12 11370 1 2023-10-18T20:58:16.566 INFO:tasks.workunit.client.0.smithi008.stdout:0/56: mkdir d0/dd 0 2023-10-18T20:58:16.566 INFO:tasks.workunit.client.0.smithi008.stdout:0/57: stat d0/f4 0 2023-10-18T20:58:16.566 INFO:tasks.workunit.client.0.smithi008.stdout:2/55: link d1/l5 d1/d3/dd/l11 0 2023-10-18T20:58:16.567 INFO:tasks.workunit.client.0.smithi008.stdout:2/56: write - no filename 2023-10-18T20:58:16.569 INFO:tasks.workunit.client.0.smithi008.stdout:4/47: creat d0/d3/d8/f11 x:0 0 0 2023-10-18T20:58:16.575 INFO:tasks.workunit.client.0.smithi008.stdout:0/58: dread d0/f2 [0,4194304] 0 2023-10-18T20:58:16.575 INFO:tasks.workunit.client.0.smithi008.stdout:8/122: mkdir d5/d8/d17/d36 0 2023-10-18T20:58:16.575 INFO:tasks.workunit.client.0.smithi008.stdout:0/59: chown d0/lc 170240780 1 2023-10-18T20:58:16.575 INFO:tasks.workunit.client.0.smithi008.stdout:8/123: unlink d5/d8/df/f22 0 2023-10-18T20:58:16.577 INFO:tasks.workunit.client.0.smithi008.stdout:2/57: mkdir d1/d3/dd/d12 0 2023-10-18T20:58:16.579 INFO:tasks.workunit.client.0.smithi008.stdout:5/35: mkdir d0/de 0 2023-10-18T20:58:16.590 INFO:tasks.workunit.client.0.smithi008.stdout:4/48: link d0/d3/d8/fb d0/f12 0 2023-10-18T20:58:16.590 INFO:tasks.workunit.client.0.smithi008.stdout:4/49: truncate d0/d3/d8/fc 914307 0 2023-10-18T20:58:16.591 INFO:tasks.workunit.client.0.smithi008.stdout:4/50: stat d0/cf 0 2023-10-18T20:58:16.591 INFO:tasks.workunit.client.0.smithi008.stdout:4/51: creat d0/f13 x:0 0 0 2023-10-18T20:58:16.591 INFO:tasks.workunit.client.0.smithi008.stdout:4/52: stat d0/f13 0 2023-10-18T20:58:16.591 INFO:tasks.workunit.client.0.smithi008.stdout:4/53: readlink d0/d3/l6 0 2023-10-18T20:58:16.596 INFO:tasks.workunit.client.0.smithi008.stdout:6/91: dread df/d15/f16 [0,4194304] 0 2023-10-18T20:58:16.599 INFO:tasks.workunit.client.0.smithi008.stdout:9/46: dwrite d2/f4 [0,4194304] 0 2023-10-18T20:58:16.603 INFO:tasks.workunit.client.0.smithi008.stdout:8/124: link d5/d8/df/f14 d5/f37 0 2023-10-18T20:58:16.603 INFO:tasks.workunit.client.0.smithi008.stdout:2/58: rmdir d1/d3/dd/d12 0 2023-10-18T20:58:16.604 INFO:tasks.workunit.client.0.smithi008.stdout:5/36: mkdir d0/d2/d9/df 0 2023-10-18T20:58:16.607 INFO:tasks.workunit.client.0.smithi008.stdout:4/54: unlink d0/ce 0 2023-10-18T20:58:16.607 INFO:tasks.workunit.client.0.smithi008.stdout:4/55: fsync d0/d3/d8/fa 0 2023-10-18T20:58:16.608 INFO:tasks.workunit.client.0.smithi008.stdout:4/56: dread - d0/fd zero size 2023-10-18T20:58:16.608 INFO:tasks.workunit.client.0.smithi008.stdout:6/92: mknod df/d18/c1d 0 2023-10-18T20:58:16.613 INFO:tasks.workunit.client.0.smithi008.stdout:9/47: mkdir d2/d7 0 2023-10-18T20:58:16.613 INFO:tasks.workunit.client.0.smithi008.stdout:9/48: read - d2/f5 zero size 2023-10-18T20:58:16.614 INFO:tasks.workunit.client.0.smithi008.stdout:8/125: symlink d5/d8/d24/l38 0 2023-10-18T20:58:16.626 INFO:tasks.workunit.client.0.smithi008.stdout:4/57: dread d0/d3/d8/fb [0,4194304] 0 2023-10-18T20:58:16.626 INFO:tasks.workunit.client.0.smithi008.stdout:4/58: truncate d0/d3/d8/fc 1756716 0 2023-10-18T20:58:16.628 INFO:tasks.workunit.client.0.smithi008.stdout:2/59: mknod d1/d3/dd/c13 0 2023-10-18T20:58:16.631 INFO:tasks.workunit.client.0.smithi008.stdout:6/93: creat df/f1e x:0 0 0 2023-10-18T20:58:16.633 INFO:tasks.workunit.client.0.smithi008.stdout:9/49: unlink f0 0 2023-10-18T20:58:16.641 INFO:tasks.workunit.client.0.smithi008.stdout:4/59: stat d0/d3/l10 0 2023-10-18T20:58:16.641 INFO:tasks.workunit.client.0.smithi008.stdout:4/60: chown d0/c2 4237 1 2023-10-18T20:58:16.641 INFO:tasks.workunit.client.0.smithi008.stdout:4/61: read d0/d3/f4 [7350650,56233] 0 2023-10-18T20:58:16.641 INFO:tasks.workunit.client.0.smithi008.stdout:4/62: chown d0 8 1 2023-10-18T20:58:16.642 INFO:tasks.workunit.client.0.smithi008.stdout:4/63: fdatasync d0/d3/f4 0 2023-10-18T20:58:16.642 INFO:tasks.workunit.client.0.smithi008.stdout:4/64: readlink d0/d3/l10 0 2023-10-18T20:58:16.642 INFO:tasks.workunit.client.0.smithi008.stdout:8/126: link d5/d8/f12 d5/d8/df/f39 0 2023-10-18T20:58:16.642 INFO:tasks.workunit.client.0.smithi008.stdout:2/60: stat d1/d3/l8 0 2023-10-18T20:58:16.642 INFO:tasks.workunit.client.0.smithi008.stdout:8/127: chown d5/d8/d17/d36 37462 1 2023-10-18T20:58:16.644 INFO:tasks.workunit.client.0.smithi008.stdout:2/61: mknod d1/d3/dd/c14 0 2023-10-18T20:58:16.644 INFO:tasks.workunit.client.0.smithi008.stdout:2/62: dread - no filename 2023-10-18T20:58:16.648 INFO:tasks.workunit.client.0.smithi008.stdout:8/128: creat d5/d8/df/f3a x:0 0 0 2023-10-18T20:58:16.652 INFO:tasks.workunit.client.0.smithi008.stdout:2/63: symlink d1/l15 0 2023-10-18T20:58:16.652 INFO:tasks.workunit.client.0.smithi008.stdout:2/64: chown d1/l15 47 1 2023-10-18T20:58:16.653 INFO:tasks.workunit.client.0.smithi008.stdout:2/65: dread - no filename 2023-10-18T20:58:16.656 INFO:tasks.workunit.client.0.smithi008.stdout:8/129: rename d5/d8/d24/l34 to d5/d8/l3b 0 2023-10-18T20:58:16.657 INFO:tasks.workunit.client.0.smithi008.stdout:9/50: dread d2/f4 [0,4194304] 0 2023-10-18T20:58:16.657 INFO:tasks.workunit.client.0.smithi008.stdout:9/51: chown d2/f4 41925 1 2023-10-18T20:58:16.658 INFO:tasks.workunit.client.0.smithi008.stdout:2/66: link d1/d3/dd/l10 d1/d3/dd/l16 0 2023-10-18T20:58:16.658 INFO:tasks.workunit.client.0.smithi008.stdout:2/67: chown d1/d3 30497092 1 2023-10-18T20:58:16.660 INFO:tasks.workunit.client.0.smithi008.stdout:8/130: symlink d5/d8/df/d2e/l3c 0 2023-10-18T20:58:16.661 INFO:tasks.workunit.client.0.smithi008.stdout:8/131: creat d5/f3d x:0 0 0 2023-10-18T20:58:16.661 INFO:tasks.workunit.client.0.smithi008.stdout:8/132: chown d5/f18 23706544 1 2023-10-18T20:58:16.661 INFO:tasks.workunit.client.0.smithi008.stdout:2/68: rmdir d1/d3 39 2023-10-18T20:58:16.662 INFO:tasks.workunit.client.0.smithi008.stdout:2/69: dread - no filename 2023-10-18T20:58:16.666 INFO:tasks.workunit.client.0.smithi008.stdout:2/70: symlink d1/d3/l17 0 2023-10-18T20:58:16.667 INFO:tasks.workunit.client.0.smithi008.stdout:2/71: chown d1/d3/dd/c13 5 1 2023-10-18T20:58:16.668 INFO:tasks.workunit.client.0.smithi008.stdout:2/72: creat d1/f18 x:0 0 0 2023-10-18T20:58:16.669 INFO:tasks.workunit.client.0.smithi008.stdout:2/73: write d1/f18 [853465,15044] 0 2023-10-18T20:58:16.669 INFO:tasks.workunit.client.0.smithi008.stdout:2/74: creat d1/f19 x:0 0 0 2023-10-18T20:58:16.670 INFO:tasks.workunit.client.0.smithi008.stdout:2/75: chown d1/d3/dd/c13 2255 1 2023-10-18T20:58:16.670 INFO:tasks.workunit.client.0.smithi008.stdout:2/76: creat d1/f1a x:0 0 0 2023-10-18T20:58:16.673 INFO:tasks.workunit.client.0.smithi008.stdout:6/94: dwrite df/d13/f17 [0,4194304] 0 2023-10-18T20:58:16.674 INFO:tasks.workunit.client.0.smithi008.stdout:7/49: sync 2023-10-18T20:58:16.677 INFO:tasks.workunit.client.0.smithi008.stdout:2/77: creat d1/d3/f1b x:0 0 0 2023-10-18T20:58:16.681 INFO:tasks.workunit.client.0.smithi008.stdout:6/95: mknod df/d13/c1f 0 2023-10-18T20:58:16.682 INFO:tasks.workunit.client.0.smithi008.stdout:5/37: dwrite d0/f3 [0,4194304] 0 2023-10-18T20:58:16.685 INFO:tasks.workunit.client.0.smithi008.stdout:8/133: dread d5/d8/f12 [0,4194304] 0 2023-10-18T20:58:16.686 INFO:tasks.workunit.client.0.smithi008.stdout:2/78: mkdir d1/d3/dd/d1c 0 2023-10-18T20:58:16.686 INFO:tasks.workunit.client.0.smithi008.stdout:2/79: dread - d1/f19 zero size 2023-10-18T20:58:16.695 INFO:tasks.workunit.client.0.smithi008.stdout:4/65: dwrite d0/d3/d8/fc [0,4194304] 0 2023-10-18T20:58:16.696 INFO:tasks.workunit.client.0.smithi008.stdout:4/66: creat d0/f14 x:0 0 0 2023-10-18T20:58:16.710 INFO:tasks.workunit.client.0.smithi008.stdout:6/96: stat df/l10 0 2023-10-18T20:58:16.717 INFO:tasks.workunit.client.0.smithi008.stdout:8/134: symlink d5/d8/df/d2e/l3e 0 2023-10-18T20:58:16.718 INFO:tasks.workunit.client.0.smithi008.stdout:2/80: stat d1/d3/dd/l11 0 2023-10-18T20:58:16.723 INFO:tasks.workunit.client.0.smithi008.stdout:6/97: creat df/d19/f20 x:0 0 0 2023-10-18T20:58:16.724 INFO:tasks.workunit.client.0.smithi008.stdout:2/81: mknod d1/d3/c1d 0 2023-10-18T20:58:16.724 INFO:tasks.workunit.client.0.smithi008.stdout:2/82: write d1/f1a [990309,20688] 0 2023-10-18T20:58:16.725 INFO:tasks.workunit.client.0.smithi008.stdout:6/98: truncate df/d15/f16 4499738 0 2023-10-18T20:58:16.725 INFO:tasks.workunit.client.0.smithi008.stdout:6/99: unlink c8 0 2023-10-18T20:58:16.730 INFO:tasks.workunit.client.0.smithi008.stdout:7/50: dwrite d1/d3/fb [0,4194304] 0 2023-10-18T20:58:16.746 INFO:tasks.workunit.client.0.smithi008.stdout:6/100: link df/d13/f17 df/d18/f21 0 2023-10-18T20:58:16.750 INFO:tasks.workunit.client.0.smithi008.stdout:4/67: dwrite d0/f14 [0,4194304] 0 2023-10-18T20:58:16.750 INFO:tasks.workunit.client.0.smithi008.stdout:4/68: read - d0/fd zero size 2023-10-18T20:58:16.750 INFO:tasks.workunit.client.0.smithi008.stdout:4/69: fsync d0/d3/d8/f11 0 2023-10-18T20:58:16.750 INFO:tasks.workunit.client.0.smithi008.stdout:2/83: dread d1/f1a [0,4194304] 0 2023-10-18T20:58:16.751 INFO:tasks.workunit.client.0.smithi008.stdout:5/38: dwrite d0/f3 [0,4194304] 0 2023-10-18T20:58:16.751 INFO:tasks.workunit.client.0.smithi008.stdout:5/39: fdatasync d0/f3 0 2023-10-18T20:58:16.758 INFO:tasks.workunit.client.0.smithi008.stdout:7/51: symlink d1/d3/l11 0 2023-10-18T20:58:16.759 INFO:tasks.workunit.client.0.smithi008.stdout:6/101: mknod df/c22 0 2023-10-18T20:58:16.762 INFO:tasks.workunit.client.0.smithi008.stdout:2/84: creat d1/d3/dd/f1e x:0 0 0 2023-10-18T20:58:16.762 INFO:tasks.workunit.client.0.smithi008.stdout:2/85: fdatasync d1/f18 0 2023-10-18T20:58:16.766 INFO:tasks.workunit.client.0.smithi008.stdout:7/52: mknod d1/d3/c12 0 2023-10-18T20:58:16.767 INFO:tasks.workunit.client.0.smithi008.stdout:7/53: write d1/fd [1040116,72114] 0 2023-10-18T20:58:16.768 INFO:tasks.workunit.client.0.smithi008.stdout:2/86: unlink d1/d3/cc 0 2023-10-18T20:58:16.768 INFO:tasks.workunit.client.0.smithi008.stdout:2/87: read - d1/d3/f1b zero size 2023-10-18T20:58:16.768 INFO:tasks.workunit.client.0.smithi008.stdout:2/88: creat d1/d3/f1f x:0 0 0 2023-10-18T20:58:16.769 INFO:tasks.workunit.client.0.smithi008.stdout:2/89: creat d1/d3/f20 x:0 0 0 2023-10-18T20:58:16.769 INFO:tasks.workunit.client.0.smithi008.stdout:7/54: creat d1/d3/f13 x:0 0 0 2023-10-18T20:58:16.773 INFO:tasks.workunit.client.0.smithi008.stdout:2/90: rename d1/d3/dd/l11 to d1/d3/dd/l21 0 2023-10-18T20:58:16.775 INFO:tasks.workunit.client.0.smithi008.stdout:7/55: link d1/d3/f8 d1/d3/f14 0 2023-10-18T20:58:16.776 INFO:tasks.workunit.client.0.smithi008.stdout:2/91: mknod d1/d3/dd/d1c/c22 0 2023-10-18T20:58:16.777 INFO:tasks.workunit.client.0.smithi008.stdout:7/56: link d1/d3/l5 d1/l15 0 2023-10-18T20:58:16.778 INFO:tasks.workunit.client.0.smithi008.stdout:2/92: symlink d1/d3/dd/d1c/l23 0 2023-10-18T20:58:16.783 INFO:tasks.workunit.client.0.smithi008.stdout:7/57: mknod d1/c16 0 2023-10-18T20:58:16.785 INFO:tasks.workunit.client.0.smithi008.stdout:2/93: write d1/f1a [662265,115571] 0 2023-10-18T20:58:16.785 INFO:tasks.workunit.client.0.smithi008.stdout:2/94: fdatasync d1/d3/f1b 0 2023-10-18T20:58:16.785 INFO:tasks.workunit.client.0.smithi008.stdout:2/95: readlink d1/l6 0 2023-10-18T20:58:16.792 INFO:tasks.workunit.client.0.smithi008.stdout:2/96: fsync d1/f1a 0 2023-10-18T20:58:16.793 INFO:tasks.workunit.client.0.smithi008.stdout:2/97: dread - d1/d3/dd/f1e zero size 2023-10-18T20:58:16.803 INFO:tasks.workunit.client.0.smithi008.stdout:4/70: dwrite d0/f14 [0,4194304] 0 2023-10-18T20:58:16.817 INFO:tasks.workunit.client.0.smithi008.stdout:4/71: rename d0/fd to d0/d3/d8/f15 0 2023-10-18T20:58:16.834 INFO:tasks.workunit.client.0.smithi008.stdout:7/58: dwrite d1/f4 [0,4194304] 0 2023-10-18T20:58:16.834 INFO:tasks.workunit.client.0.smithi008.stdout:7/59: chown d1/d3/c12 188 1 2023-10-18T20:58:16.835 INFO:tasks.workunit.client.0.smithi008.stdout:7/60: creat d1/d3/f17 x:0 0 0 2023-10-18T20:58:16.851 INFO:tasks.workunit.client.0.smithi008.stdout:7/61: unlink d1/d3/ca 0 2023-10-18T20:58:16.851 INFO:tasks.workunit.client.0.smithi008.stdout:7/62: write d1/d3/ff [4887943,50464] 0 2023-10-18T20:58:16.861 INFO:tasks.workunit.client.0.smithi008.stdout:3/42: sync 2023-10-18T20:58:16.881 INFO:tasks.workunit.client.0.smithi008.stdout:2/98: dwrite d1/d3/f1f [0,4194304] 0 2023-10-18T20:58:16.886 INFO:tasks.workunit.client.0.smithi008.stdout:2/99: symlink d1/d3/dd/d1c/l24 0 2023-10-18T20:58:16.886 INFO:tasks.workunit.client.0.smithi008.stdout:2/100: readlink d1/d3/dd/l16 0 2023-10-18T20:58:16.886 INFO:tasks.workunit.client.0.smithi008.stdout:2/101: write d1/d3/f1b [237322,67361] 0 2023-10-18T20:58:16.918 INFO:tasks.workunit.client.0.smithi008.stdout:7/63: dwrite d1/f6 [0,4194304] 0 2023-10-18T20:58:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:15.532167+0000 mgr.smithi060.pgqqwa (mgr.14584) 39 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 294 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.8 MiB/s rd, 12 MiB/s wr, 672 op/s 2023-10-18T20:58:16.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:16.272736+0000 mon.smithi008 (mon.0) 606 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:58:16.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:16.278438+0000 mon.smithi060 (mon.1) 48 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:16.934 INFO:tasks.workunit.client.0.smithi008.stdout:4/72: dwrite d0/d3/d8/f11 [0,4194304] 0 2023-10-18T20:58:16.937 INFO:tasks.workunit.client.0.smithi008.stdout:3/43: dwrite d0/d3/db/f9 [0,4194304] 0 2023-10-18T20:58:16.937 INFO:tasks.workunit.client.0.smithi008.stdout:3/44: stat d0/d3/db/f9 0 2023-10-18T20:58:16.937 INFO:tasks.workunit.client.0.smithi008.stdout:3/45: fdatasync d0/d3/de/f10 0 2023-10-18T20:58:16.937 INFO:tasks.workunit.client.0.smithi008.stdout:3/46: truncate d0/d3/f5 935843 0 2023-10-18T20:58:16.937 INFO:tasks.workunit.client.0.smithi008.stdout:3/47: fsync d0/d3/de/f10 0 2023-10-18T20:58:16.969 INFO:tasks.workunit.client.0.smithi008.stdout:4/73: link d0/d3/d8/f11 d0/d3/f16 0 2023-10-18T20:58:16.969 INFO:tasks.workunit.client.0.smithi008.stdout:4/74: chown d0/c2 3 1 2023-10-18T20:58:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:15.532167+0000 mgr.smithi060.pgqqwa (mgr.14584) 39 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 294 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.8 MiB/s rd, 12 MiB/s wr, 672 op/s 2023-10-18T20:58:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:16.272736+0000 mon.smithi008 (mon.0) 606 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:58:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:16.278438+0000 mon.smithi060 (mon.1) 48 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:16.989 INFO:tasks.workunit.client.0.smithi008.stdout:3/48: read d0/d3/f6 [1442643,123520] 0 2023-10-18T20:58:16.990 INFO:tasks.workunit.client.0.smithi008.stdout:3/49: fsync d0/f4 0 2023-10-18T20:58:16.990 INFO:tasks.workunit.client.0.smithi008.stdout:3/50: chown d0/d3/de/f10 824967 1 2023-10-18T20:58:16.990 INFO:tasks.workunit.client.0.smithi008.stdout:4/75: dread d0/d3/d8/f11 [0,4194304] 0 2023-10-18T20:58:16.993 INFO:tasks.workunit.client.0.smithi008.stdout:7/64: dwrite d1/d3/f14 [0,4194304] 0 2023-10-18T20:58:16.994 INFO:tasks.workunit.client.0.smithi008.stdout:4/76: mkdir d0/d17 0 2023-10-18T20:58:16.996 INFO:tasks.workunit.client.0.smithi008.stdout:7/65: symlink d1/l18 0 2023-10-18T20:58:17.001 INFO:tasks.workunit.client.0.smithi008.stdout:4/77: symlink d0/d17/l18 0 2023-10-18T20:58:17.002 INFO:tasks.workunit.client.0.smithi008.stdout:3/51: write d0/d3/db/f9 [2733376,75271] 0 2023-10-18T20:58:17.004 INFO:tasks.workunit.client.0.smithi008.stdout:4/78: unlink d0/d3/f16 0 2023-10-18T20:58:17.004 INFO:tasks.workunit.client.0.smithi008.stdout:4/79: dread - d0/d3/d8/f15 zero size 2023-10-18T20:58:17.015 INFO:tasks.workunit.client.0.smithi008.stdout:3/52: unlink d0/d3/de/lf 0 2023-10-18T20:58:17.015 INFO:tasks.workunit.client.0.smithi008.stdout:3/53: chown d0/f4 220 1 2023-10-18T20:58:17.018 INFO:tasks.workunit.client.0.smithi008.stdout:3/54: mknod d0/d3/c11 0 2023-10-18T20:58:17.023 INFO:tasks.workunit.client.0.smithi008.stdout:3/55: unlink d0/f4 0 2023-10-18T20:58:17.027 INFO:tasks.workunit.client.0.smithi008.stdout:4/80: dread d0/d3/d8/fc [0,4194304] 0 2023-10-18T20:58:17.035 INFO:tasks.workunit.client.0.smithi008.stdout:3/56: write d0/f7 [1039790,42468] 0 2023-10-18T20:58:17.035 INFO:tasks.workunit.client.0.smithi008.stdout:1/197: sync 2023-10-18T20:58:17.038 INFO:tasks.workunit.client.0.smithi008.stdout:1/198: symlink d9/de/df/d17/l40 0 2023-10-18T20:58:17.039 INFO:tasks.workunit.client.0.smithi008.stdout:3/57: dread d0/d3/f5 [0,4194304] 0 2023-10-18T20:58:17.043 INFO:tasks.workunit.client.0.smithi008.stdout:1/199: mknod d9/de/df/c41 0 2023-10-18T20:58:17.068 INFO:tasks.workunit.client.0.smithi008.stdout:1/200: dread d9/de/df/f10 [0,4194304] 0 2023-10-18T20:58:17.068 INFO:tasks.workunit.client.0.smithi008.stdout:1/201: fsync d9/de/df/d17/d1e/f2d 0 2023-10-18T20:58:17.069 INFO:tasks.workunit.client.0.smithi008.stdout:1/202: stat d9/de/l35 0 2023-10-18T20:58:17.072 INFO:tasks.workunit.client.0.smithi008.stdout:1/203: creat d9/f42 x:0 0 0 2023-10-18T20:58:17.074 INFO:tasks.workunit.client.0.smithi008.stdout:1/204: symlink d9/de/df/d17/d1e/d3c/l43 0 2023-10-18T20:58:17.075 INFO:tasks.workunit.client.0.smithi008.stdout:1/205: truncate f0 3288712 0 2023-10-18T20:58:17.085 INFO:tasks.workunit.client.0.smithi008.stdout:3/58: dwrite d0/d3/de/f10 [0,4194304] 0 2023-10-18T20:58:17.097 INFO:tasks.workunit.client.0.smithi008.stdout:3/59: dread d0/d3/db/f9 [0,4194304] 0 2023-10-18T20:58:17.097 INFO:tasks.workunit.client.0.smithi008.stdout:3/60: write d0/d3/f6 [3763220,107298] 0 2023-10-18T20:58:17.147 INFO:tasks.workunit.client.0.smithi008.stdout:3/61: dwrite d0/d3/f5 [0,4194304] 0 2023-10-18T20:58:17.147 INFO:tasks.workunit.client.0.smithi008.stdout:3/62: write d0/d3/db/f9 [748620,93041] 0 2023-10-18T20:58:17.149 INFO:tasks.workunit.client.0.smithi008.stdout:9/52: sync 2023-10-18T20:58:17.150 INFO:tasks.workunit.client.0.smithi008.stdout:0/60: sync 2023-10-18T20:58:17.150 INFO:tasks.workunit.client.0.smithi008.stdout:9/53: dread - d2/f5 zero size 2023-10-18T20:58:17.150 INFO:tasks.workunit.client.0.smithi008.stdout:6/102: sync 2023-10-18T20:58:17.150 INFO:tasks.workunit.client.0.smithi008.stdout:5/40: sync 2023-10-18T20:58:17.151 INFO:tasks.workunit.client.0.smithi008.stdout:8/135: sync 2023-10-18T20:58:17.181 INFO:tasks.workunit.client.0.smithi008.stdout:3/63: write d0/d3/de/f10 [4263166,24086] 0 2023-10-18T20:58:17.186 INFO:tasks.workunit.client.0.smithi008.stdout:0/61: truncate d0/f2 6660 0 2023-10-18T20:58:17.186 INFO:tasks.workunit.client.0.smithi008.stdout:0/62: write d0/f4 [1872885,49233] 0 2023-10-18T20:58:17.187 INFO:tasks.workunit.client.0.smithi008.stdout:9/54: mkdir d2/d8 0 2023-10-18T20:58:17.188 INFO:tasks.workunit.client.0.smithi008.stdout:6/103: rename df/c22 to df/d15/c23 0 2023-10-18T20:58:17.189 INFO:tasks.workunit.client.0.smithi008.stdout:6/104: dread - df/f1e zero size 2023-10-18T20:58:17.192 INFO:tasks.workunit.client.0.smithi008.stdout:5/41: mknod d0/de/c10 0 2023-10-18T20:58:17.199 INFO:tasks.workunit.client.0.smithi008.stdout:3/64: unlink d0/d3/db/f9 0 2023-10-18T20:58:17.208 INFO:tasks.workunit.client.0.smithi008.stdout:9/55: creat d2/d8/f9 x:0 0 0 2023-10-18T20:58:17.208 INFO:tasks.workunit.client.0.smithi008.stdout:9/56: chown d2/f5 468726568 1 2023-10-18T20:58:17.208 INFO:tasks.workunit.client.0.smithi008.stdout:9/57: dread - d2/f5 zero size 2023-10-18T20:58:17.214 INFO:tasks.workunit.client.0.smithi008.stdout:0/63: rename d0/f4 to d0/fe 0 2023-10-18T20:58:17.214 INFO:tasks.workunit.client.0.smithi008.stdout:0/64: stat d0/fb 0 2023-10-18T20:58:17.225 INFO:tasks.workunit.client.0.smithi008.stdout:9/58: read d2/f4 [183221,85744] 0 2023-10-18T20:58:17.228 INFO:tasks.workunit.client.0.smithi008.stdout:9/59: symlink d2/d7/la 0 2023-10-18T20:58:17.231 INFO:tasks.workunit.client.0.smithi008.stdout:9/60: write d2/f5 [245563,84295] 0 2023-10-18T20:58:17.255 INFO:tasks.workunit.client.0.smithi008.stdout:3/65: dwrite d0/d3/de/f10 [0,4194304] 0 2023-10-18T20:58:17.271 INFO:tasks.workunit.client.0.smithi008.stdout:5/42: write d0/f3 [3095027,25229] 0 2023-10-18T20:58:17.294 INFO:tasks.workunit.client.0.smithi008.stdout:0/65: dwrite d0/fb [0,4194304] 0 2023-10-18T20:58:17.295 INFO:tasks.workunit.client.0.smithi008.stdout:3/66: write d0/d3/de/f10 [3061807,90998] 0 2023-10-18T20:58:17.296 INFO:tasks.workunit.client.0.smithi008.stdout:3/67: write d0/f7 [1335668,22708] 0 2023-10-18T20:58:17.317 INFO:tasks.workunit.client.0.smithi008.stdout:8/136: dwrite d5/f37 [0,4194304] 0 2023-10-18T20:58:17.324 INFO:tasks.workunit.client.0.smithi008.stdout:9/61: dwrite d2/f4 [4194304,4194304] 0 2023-10-18T20:58:17.331 INFO:tasks.workunit.client.0.smithi008.stdout:8/137: rmdir d5/d8/d2a 0 2023-10-18T20:58:17.335 INFO:tasks.workunit.client.0.smithi008.stdout:3/68: read d0/d3/f5 [3850071,17591] 0 2023-10-18T20:58:17.338 INFO:tasks.workunit.client.0.smithi008.stdout:9/62: dread d2/f5 [0,4194304] 0 2023-10-18T20:58:17.338 INFO:tasks.workunit.client.0.smithi008.stdout:9/63: creat d2/fb x:0 0 0 2023-10-18T20:58:17.353 INFO:tasks.workunit.client.0.smithi008.stdout:8/138: symlink d5/d8/d17/l3f 0 2023-10-18T20:58:17.370 INFO:tasks.workunit.client.0.smithi008.stdout:8/139: symlink d5/d8/d24/l40 0 2023-10-18T20:58:17.370 INFO:tasks.workunit.client.0.smithi008.stdout:8/140: fsync d5/f6 0 2023-10-18T20:58:17.370 INFO:tasks.workunit.client.0.smithi008.stdout:8/141: write d5/d8/df/f19 [562174,3127] 0 2023-10-18T20:58:17.370 INFO:tasks.workunit.client.0.smithi008.stdout:8/142: creat d5/d8/f41 x:0 0 0 2023-10-18T20:58:17.372 INFO:tasks.workunit.client.0.smithi008.stdout:5/43: dwrite d0/d2/f7 [0,4194304] 0 2023-10-18T20:58:17.374 INFO:tasks.workunit.client.0.smithi008.stdout:2/102: sync 2023-10-18T20:58:17.378 INFO:tasks.workunit.client.0.smithi008.stdout:8/143: symlink d5/d8/d17/l42 0 2023-10-18T20:58:17.378 INFO:tasks.workunit.client.0.smithi008.stdout:8/144: creat d5/d8/df/d2e/f43 x:0 0 0 2023-10-18T20:58:17.379 INFO:tasks.workunit.client.0.smithi008.stdout:8/145: creat d5/d8/d17/f44 x:0 0 0 2023-10-18T20:58:17.379 INFO:tasks.workunit.client.0.smithi008.stdout:8/146: truncate d5/f37 4801890 0 2023-10-18T20:58:17.383 INFO:tasks.workunit.client.0.smithi008.stdout:5/44: stat d0/c1 0 2023-10-18T20:58:17.384 INFO:tasks.workunit.client.0.smithi008.stdout:0/66: dwrite d0/fe [0,4194304] 0 2023-10-18T20:58:17.386 INFO:tasks.workunit.client.0.smithi008.stdout:2/103: mkdir d1/d3/dd/d25 0 2023-10-18T20:58:17.389 INFO:tasks.workunit.client.0.smithi008.stdout:3/69: dwrite d0/f7 [0,4194304] 0 2023-10-18T20:58:17.401 INFO:tasks.workunit.client.0.smithi008.stdout:8/147: rename d5/d8/df/f14 to d5/f45 0 2023-10-18T20:58:17.401 INFO:tasks.workunit.client.0.smithi008.stdout:8/148: chown d5/d8/df/d2e/f43 1069270 1 2023-10-18T20:58:17.401 INFO:tasks.workunit.client.0.smithi008.stdout:8/149: readlink d5/d8/df/d2e/l3c 0 2023-10-18T20:58:17.410 INFO:tasks.workunit.client.0.smithi008.stdout:0/67: mkdir d0/dd/df 0 2023-10-18T20:58:17.414 INFO:tasks.workunit.client.0.smithi008.stdout:9/64: dwrite d2/d8/f9 [0,4194304] 0 2023-10-18T20:58:17.414 INFO:tasks.workunit.client.0.smithi008.stdout:9/65: fdatasync d2/f3 0 2023-10-18T20:58:17.414 INFO:tasks.workunit.client.0.smithi008.stdout:9/66: fsync d2/fb 0 2023-10-18T20:58:17.421 INFO:tasks.workunit.client.0.smithi008.stdout:2/104: truncate d1/f1a 906642 0 2023-10-18T20:58:17.423 INFO:tasks.workunit.client.0.smithi008.stdout:8/150: creat d5/d8/d17/d36/f46 x:0 0 0 2023-10-18T20:58:17.423 INFO:tasks.workunit.client.0.smithi008.stdout:8/151: creat d5/d8/f47 x:0 0 0 2023-10-18T20:58:17.426 INFO:tasks.workunit.client.0.smithi008.stdout:4/81: sync 2023-10-18T20:58:17.426 INFO:tasks.workunit.client.0.smithi008.stdout:1/206: sync 2023-10-18T20:58:17.427 INFO:tasks.workunit.client.0.smithi008.stdout:5/45: rmdir d0/d2 39 2023-10-18T20:58:17.429 INFO:tasks.workunit.client.0.smithi008.stdout:0/68: mknod d0/dd/df/c10 0 2023-10-18T20:58:17.429 INFO:tasks.workunit.client.0.smithi008.stdout:0/69: unlink d0/fe 0 2023-10-18T20:58:17.430 INFO:tasks.workunit.client.0.smithi008.stdout:7/66: sync 2023-10-18T20:58:17.431 INFO:tasks.workunit.client.0.smithi008.stdout:7/67: fdatasync d1/fd 0 2023-10-18T20:58:17.431 INFO:tasks.workunit.client.0.smithi008.stdout:7/68: dread - d1/d3/f17 zero size 2023-10-18T20:58:17.431 INFO:tasks.workunit.client.0.smithi008.stdout:7/69: write d1/fd [150065,21115] 0 2023-10-18T20:58:17.431 INFO:tasks.workunit.client.0.smithi008.stdout:7/70: fsync d1/f6 0 2023-10-18T20:58:17.431 INFO:tasks.workunit.client.0.smithi008.stdout:7/71: fdatasync d1/d3/ff 0 2023-10-18T20:58:17.437 INFO:tasks.workunit.client.0.smithi008.stdout:9/67: mkdir d2/dc 0 2023-10-18T20:58:17.437 INFO:tasks.workunit.client.0.smithi008.stdout:9/68: write d2/f3 [5914629,77761] 0 2023-10-18T20:58:17.437 INFO:tasks.workunit.client.0.smithi008.stdout:9/69: getdents d2/dc 0 2023-10-18T20:58:17.438 INFO:tasks.workunit.client.0.smithi008.stdout:2/105: mknod d1/d3/dd/d1c/c26 0 2023-10-18T20:58:17.443 INFO:tasks.workunit.client.0.smithi008.stdout:6/105: sync 2023-10-18T20:58:17.444 INFO:tasks.workunit.client.0.smithi008.stdout:6/106: write f5 [1359402,13276] 0 2023-10-18T20:58:17.444 INFO:tasks.workunit.client.0.smithi008.stdout:6/107: creat df/f24 x:0 0 0 2023-10-18T20:58:17.446 INFO:tasks.workunit.client.0.smithi008.stdout:1/207: unlink d9/de/f11 0 2023-10-18T20:58:17.447 INFO:tasks.workunit.client.0.smithi008.stdout:1/208: chown f1 334523 1 2023-10-18T20:58:17.447 INFO:tasks.workunit.client.0.smithi008.stdout:1/209: stat d9/de/df/d17/d1e 0 2023-10-18T20:58:17.447 INFO:tasks.workunit.client.0.smithi008.stdout:1/210: creat d9/de/df/d17/d25/f44 x:0 0 0 2023-10-18T20:58:17.447 INFO:tasks.workunit.client.0.smithi008.stdout:5/46: link d0/f8 d0/d2/d9/f11 0 2023-10-18T20:58:17.449 INFO:tasks.workunit.client.0.smithi008.stdout:4/82: dread d0/d3/d8/fc [0,4194304] 0 2023-10-18T20:58:17.467 INFO:tasks.workunit.client.0.smithi008.stdout:9/70: symlink d2/ld 0 2023-10-18T20:58:17.467 INFO:tasks.workunit.client.0.smithi008.stdout:2/106: creat d1/d3/dd/d25/f27 x:0 0 0 2023-10-18T20:58:17.468 INFO:tasks.workunit.client.0.smithi008.stdout:2/107: truncate d1/d3/dd/f1e 875626 0 2023-10-18T20:58:17.468 INFO:tasks.workunit.client.0.smithi008.stdout:0/70: creat d0/f11 x:0 0 0 2023-10-18T20:58:17.471 INFO:tasks.workunit.client.0.smithi008.stdout:3/70: dwrite d0/f7 [0,4194304] 0 2023-10-18T20:58:17.472 INFO:tasks.workunit.client.0.smithi008.stdout:7/72: dread d1/d3/ff [0,4194304] 0 2023-10-18T20:58:17.478 INFO:tasks.workunit.client.0.smithi008.stdout:6/108: dread df/d13/f17 [0,4194304] 0 2023-10-18T20:58:17.479 INFO:tasks.workunit.client.0.smithi008.stdout:6/109: dread - df/f1e zero size 2023-10-18T20:58:17.483 INFO:tasks.workunit.client.0.smithi008.stdout:1/211: unlink f1 0 2023-10-18T20:58:17.485 INFO:tasks.workunit.client.0.smithi008.stdout:5/47: creat d0/d2/f12 x:0 0 0 2023-10-18T20:58:17.485 INFO:tasks.workunit.client.0.smithi008.stdout:5/48: stat d0/c1 0 2023-10-18T20:58:17.487 INFO:tasks.workunit.client.0.smithi008.stdout:4/83: symlink d0/d3/d8/l19 0 2023-10-18T20:58:17.492 INFO:tasks.workunit.client.0.smithi008.stdout:2/108: creat d1/d3/dd/d1c/f28 x:0 0 0 2023-10-18T20:58:17.493 INFO:tasks.workunit.client.0.smithi008.stdout:0/71: chown d0/c7 378 1 2023-10-18T20:58:17.495 INFO:tasks.workunit.client.0.smithi008.stdout:4/84: read d0/d3/d8/fc [2426243,82545] 0 2023-10-18T20:58:17.495 INFO:tasks.workunit.client.0.smithi008.stdout:4/85: chown d0/f12 123468032 1 2023-10-18T20:58:17.496 INFO:tasks.workunit.client.0.smithi008.stdout:3/71: rename d0/d3/c11 to d0/d3/c12 0 2023-10-18T20:58:17.497 INFO:tasks.workunit.client.0.smithi008.stdout:8/152: dwrite d5/f1c [0,4194304] 0 2023-10-18T20:58:17.498 INFO:tasks.workunit.client.0.smithi008.stdout:8/153: fdatasync d5/f18 0 2023-10-18T20:58:17.501 INFO:tasks.workunit.client.0.smithi008.stdout:6/110: symlink df/d18/l25 0 2023-10-18T20:58:17.505 INFO:tasks.workunit.client.0.smithi008.stdout:5/49: rmdir d0/d2/d9/df 0 2023-10-18T20:58:17.513 INFO:tasks.workunit.client.0.smithi008.stdout:3/72: write d0/d3/fd [56623,107524] 0 2023-10-18T20:58:17.514 INFO:tasks.workunit.client.0.smithi008.stdout:2/109: rename d1/d3/l8 to d1/d3/dd/d1c/l29 0 2023-10-18T20:58:17.514 INFO:tasks.workunit.client.0.smithi008.stdout:2/110: fdatasync d1/d3/f20 0 2023-10-18T20:58:17.515 INFO:tasks.workunit.client.0.smithi008.stdout:2/111: truncate d1/d3/dd/d25/f27 871633 0 2023-10-18T20:58:17.515 INFO:tasks.workunit.client.0.smithi008.stdout:6/111: dread df/d13/f17 [0,4194304] 0 2023-10-18T20:58:17.515 INFO:tasks.workunit.client.0.smithi008.stdout:9/71: rmdir d2 39 2023-10-18T20:58:17.518 INFO:tasks.workunit.client.0.smithi008.stdout:1/212: fsync d9/de/df/d17/d25/f44 0 2023-10-18T20:58:17.530 INFO:tasks.workunit.client.0.smithi008.stdout:4/86: creat d0/d17/f1a x:0 0 0 2023-10-18T20:58:17.530 INFO:tasks.workunit.client.0.smithi008.stdout:4/87: chown d0/d3/d8 9236494 1 2023-10-18T20:58:17.535 INFO:tasks.workunit.client.0.smithi008.stdout:5/50: rmdir d0 39 2023-10-18T20:58:17.544 INFO:tasks.workunit.client.0.smithi008.stdout:2/112: symlink d1/d3/dd/d25/l2a 0 2023-10-18T20:58:17.544 INFO:tasks.workunit.client.0.smithi008.stdout:2/113: stat d1 0 2023-10-18T20:58:17.544 INFO:tasks.workunit.client.0.smithi008.stdout:2/114: creat d1/d3/dd/d25/f2b x:0 0 0 2023-10-18T20:58:17.544 INFO:tasks.workunit.client.0.smithi008.stdout:2/115: dread - d1/d3/dd/d1c/f28 zero size 2023-10-18T20:58:17.545 INFO:tasks.workunit.client.0.smithi008.stdout:6/112: mkdir df/d26 0 2023-10-18T20:58:17.545 INFO:tasks.workunit.client.0.smithi008.stdout:9/72: creat d2/d7/fe x:0 0 0 2023-10-18T20:58:17.547 INFO:tasks.workunit.client.0.smithi008.stdout:0/72: rmdir d0 39 2023-10-18T20:58:17.550 INFO:tasks.workunit.client.0.smithi008.stdout:4/88: symlink d0/l1b 0 2023-10-18T20:58:17.550 INFO:tasks.workunit.client.0.smithi008.stdout:4/89: dread - d0/d17/f1a zero size 2023-10-18T20:58:17.551 INFO:tasks.workunit.client.0.smithi008.stdout:4/90: chown d0/cf 3 1 2023-10-18T20:58:17.551 INFO:tasks.workunit.client.0.smithi008.stdout:4/91: write d0/f14 [4568745,90456] 0 2023-10-18T20:58:17.552 INFO:tasks.workunit.client.0.smithi008.stdout:4/92: creat d0/f1c x:0 0 0 2023-10-18T20:58:17.562 INFO:tasks.workunit.client.0.smithi008.stdout:2/116: truncate d1/d3/f1f 3131778 0 2023-10-18T20:58:17.564 INFO:tasks.workunit.client.0.smithi008.stdout:6/113: mkdir df/d15/d27 0 2023-10-18T20:58:17.564 INFO:tasks.workunit.client.0.smithi008.stdout:9/73: creat d2/ff x:0 0 0 2023-10-18T20:58:17.571 INFO:tasks.workunit.client.0.smithi008.stdout:5/51: mknod d0/c13 0 2023-10-18T20:58:17.571 INFO:tasks.workunit.client.0.smithi008.stdout:7/73: dwrite d1/fd [0,4194304] 0 2023-10-18T20:58:17.571 INFO:tasks.workunit.client.0.smithi008.stdout:7/74: chown d1/c2 962639 1 2023-10-18T20:58:17.571 INFO:tasks.workunit.client.0.smithi008.stdout:7/75: truncate d1/f6 4884075 0 2023-10-18T20:58:17.579 INFO:tasks.workunit.client.0.smithi008.stdout:6/114: creat df/d15/d27/f28 x:0 0 0 2023-10-18T20:58:17.583 INFO:tasks.workunit.client.0.smithi008.stdout:1/213: dwrite d9/de/df/d17/d25/f32 [0,4194304] 0 2023-10-18T20:58:17.591 INFO:tasks.workunit.client.0.smithi008.stdout:7/76: mknod d1/c19 0 2023-10-18T20:58:17.598 INFO:tasks.workunit.client.0.smithi008.stdout:5/52: creat d0/d2/d9/f14 x:0 0 0 2023-10-18T20:58:17.598 INFO:tasks.workunit.client.0.smithi008.stdout:5/53: read - d0/d2/d9/f14 zero size 2023-10-18T20:58:17.598 INFO:tasks.workunit.client.0.smithi008.stdout:5/54: dread - d0/d2/f12 zero size 2023-10-18T20:58:17.599 INFO:tasks.workunit.client.0.smithi008.stdout:5/55: read d0/f3 [2023831,35671] 0 2023-10-18T20:58:17.599 INFO:tasks.workunit.client.0.smithi008.stdout:5/56: write d0/d2/d9/f11 [941246,58327] 0 2023-10-18T20:58:17.600 INFO:tasks.workunit.client.0.smithi008.stdout:3/73: rmdir d0/d3/db 0 2023-10-18T20:58:17.600 INFO:tasks.workunit.client.0.smithi008.stdout:3/74: write d0/d3/f5 [907009,54470] 0 2023-10-18T20:58:17.602 INFO:tasks.workunit.client.0.smithi008.stdout:9/74: getdents d2/d7 0 2023-10-18T20:58:17.603 INFO:tasks.workunit.client.0.smithi008.stdout:9/75: dread - d2/d7/fe zero size 2023-10-18T20:58:17.603 INFO:tasks.workunit.client.0.smithi008.stdout:9/76: truncate d2/fb 328413 0 2023-10-18T20:58:17.606 INFO:tasks.workunit.client.0.smithi008.stdout:4/93: dwrite d0/d3/d8/fb [0,4194304] 0 2023-10-18T20:58:17.607 INFO:tasks.workunit.client.0.smithi008.stdout:6/115: mknod df/d15/d27/c29 0 2023-10-18T20:58:17.613 INFO:tasks.workunit.client.0.smithi008.stdout:7/77: truncate d1/d3/f8 3069013 0 2023-10-18T20:58:17.615 INFO:tasks.workunit.client.0.smithi008.stdout:8/154: dwrite d5/f1c [0,4194304] 0 2023-10-18T20:58:17.616 INFO:tasks.workunit.client.0.smithi008.stdout:8/155: creat d5/d8/d17/f48 x:0 0 0 2023-10-18T20:58:17.619 INFO:tasks.workunit.client.0.smithi008.stdout:0/73: dwrite d0/f2 [0,4194304] 0 2023-10-18T20:58:17.619 INFO:tasks.workunit.client.0.smithi008.stdout:0/74: stat d0/dd/df/c10 0 2023-10-18T20:58:17.621 INFO:tasks.workunit.client.0.smithi008.stdout:3/75: mkdir d0/d3/de/d13 0 2023-10-18T20:58:17.622 INFO:tasks.workunit.client.0.smithi008.stdout:3/76: creat d0/d3/de/f14 x:0 0 0 2023-10-18T20:58:17.624 INFO:tasks.workunit.client.0.smithi008.stdout:4/94: truncate d0/d3/d8/fa 46051 0 2023-10-18T20:58:17.625 INFO:tasks.workunit.client.0.smithi008.stdout:7/78: dread d1/f4 [0,4194304] 0 2023-10-18T20:58:17.627 INFO:tasks.workunit.client.0.smithi008.stdout:6/116: symlink df/l2a 0 2023-10-18T20:58:17.627 INFO:tasks.workunit.client.0.smithi008.stdout:7/79: creat d1/d3/f1a x:0 0 0 2023-10-18T20:58:17.633 INFO:tasks.workunit.client.0.smithi008.stdout:1/214: rmdir d9/de 39 2023-10-18T20:58:17.651 INFO:tasks.workunit.client.0.smithi008.stdout:8/156: mknod d5/d8/d24/c49 0 2023-10-18T20:58:17.652 INFO:tasks.workunit.client.0.smithi008.stdout:0/75: creat d0/dd/df/f12 x:0 0 0 2023-10-18T20:58:17.656 INFO:tasks.workunit.client.0.smithi008.stdout:2/117: dwrite d1/f18 [0,4194304] 0 2023-10-18T20:58:17.656 INFO:tasks.workunit.client.0.smithi008.stdout:3/77: mkdir d0/d3/d15 0 2023-10-18T20:58:17.660 INFO:tasks.workunit.client.0.smithi008.stdout:4/95: rename d0/d3/l6 to d0/l1d 0 2023-10-18T20:58:17.661 INFO:tasks.workunit.client.0.smithi008.stdout:4/96: creat d0/d3/f1e x:0 0 0 2023-10-18T20:58:17.665 INFO:tasks.workunit.client.0.smithi008.stdout:7/80: creat d1/f1b x:0 0 0 2023-10-18T20:58:17.672 INFO:tasks.workunit.client.0.smithi008.stdout:2/118: symlink d1/d3/dd/d25/l2c 0 2023-10-18T20:58:17.672 INFO:tasks.workunit.client.0.smithi008.stdout:2/119: truncate d1/d3/dd/d1c/f28 126459 0 2023-10-18T20:58:17.672 INFO:tasks.workunit.client.0.smithi008.stdout:2/120: dread - d1/d3/f20 zero size 2023-10-18T20:58:17.673 INFO:tasks.workunit.client.0.smithi008.stdout:2/121: write d1/d3/f1b [1164412,78780] 0 2023-10-18T20:58:17.673 INFO:tasks.workunit.client.0.smithi008.stdout:2/122: fdatasync d1/f18 0 2023-10-18T20:58:17.674 INFO:tasks.workunit.client.0.smithi008.stdout:3/78: mknod d0/c16 0 2023-10-18T20:58:17.674 INFO:tasks.workunit.client.0.smithi008.stdout:3/79: creat d0/d3/de/f17 x:0 0 0 2023-10-18T20:58:17.674 INFO:tasks.workunit.client.0.smithi008.stdout:3/80: readlink - no filename 2023-10-18T20:58:17.675 INFO:tasks.workunit.client.0.smithi008.stdout:3/81: read - d0/d3/de/f17 zero size 2023-10-18T20:58:17.675 INFO:tasks.workunit.client.0.smithi008.stdout:3/82: write d0/d3/f6 [3100182,90178] 0 2023-10-18T20:58:17.678 INFO:tasks.workunit.client.0.smithi008.stdout:4/97: unlink d0/d3/d8/fc 0 2023-10-18T20:58:17.684 INFO:tasks.workunit.client.0.smithi008.stdout:5/57: dwrite d0/d2/f7 [4194304,4194304] 0 2023-10-18T20:58:17.687 INFO:tasks.workunit.client.0.smithi008.stdout:7/81: unlink d1/d3/ff 0 2023-10-18T20:58:17.687 INFO:tasks.workunit.client.0.smithi008.stdout:8/157: getdents d5/d8/d24 0 2023-10-18T20:58:17.692 INFO:tasks.workunit.client.0.smithi008.stdout:3/83: symlink d0/d3/de/d13/l18 0 2023-10-18T20:58:17.692 INFO:tasks.workunit.client.0.smithi008.stdout:1/215: dwrite d9/fb [0,4194304] 0 2023-10-18T20:58:17.692 INFO:tasks.workunit.client.0.smithi008.stdout:4/98: mknod d0/d17/c1f 0 2023-10-18T20:58:17.693 INFO:tasks.workunit.client.0.smithi008.stdout:0/76: dread d0/fb [0,4194304] 0 2023-10-18T20:58:17.694 INFO:tasks.workunit.client.0.smithi008.stdout:6/117: dwrite f5 [0,4194304] 0 2023-10-18T20:58:17.706 INFO:tasks.workunit.client.0.smithi008.stdout:5/58: dread d0/f3 [0,4194304] 0 2023-10-18T20:58:17.706 INFO:tasks.workunit.client.0.smithi008.stdout:1/216: dread d9/de/df/f10 [0,4194304] 0 2023-10-18T20:58:17.706 INFO:tasks.workunit.client.0.smithi008.stdout:1/217: write d9/de/f1c [934309,117928] 0 2023-10-18T20:58:17.707 INFO:tasks.workunit.client.0.smithi008.stdout:9/77: truncate d2/f3 4205827 0 2023-10-18T20:58:17.707 INFO:tasks.workunit.client.0.smithi008.stdout:0/77: creat d0/f13 x:0 0 0 2023-10-18T20:58:17.707 INFO:tasks.workunit.client.0.smithi008.stdout:0/78: chown d0 0 1 2023-10-18T20:58:17.708 INFO:tasks.workunit.client.0.smithi008.stdout:8/158: symlink d5/d8/l4a 0 2023-10-18T20:58:17.708 INFO:tasks.workunit.client.0.smithi008.stdout:4/99: symlink d0/d3/d8/l20 0 2023-10-18T20:58:17.711 INFO:tasks.workunit.client.0.smithi008.stdout:9/78: symlink d2/d8/l10 0 2023-10-18T20:58:17.712 INFO:tasks.workunit.client.0.smithi008.stdout:0/79: creat d0/f14 x:0 0 0 2023-10-18T20:58:17.713 INFO:tasks.workunit.client.0.smithi008.stdout:0/80: write d0/f3 [516427,108508] 0 2023-10-18T20:58:17.715 INFO:tasks.workunit.client.0.smithi008.stdout:2/123: dread d1/d3/f1b [0,4194304] 0 2023-10-18T20:58:17.726 INFO:tasks.workunit.client.0.smithi008.stdout:9/79: rmdir d2/d7 39 2023-10-18T20:58:17.726 INFO:tasks.workunit.client.0.smithi008.stdout:4/100: mkdir d0/d3/d21 0 2023-10-18T20:58:17.726 INFO:tasks.workunit.client.0.smithi008.stdout:4/101: dread - d0/d3/d8/f15 zero size 2023-10-18T20:58:17.731 INFO:tasks.workunit.client.0.smithi008.stdout:0/81: link d0/f11 d0/dd/f15 0 2023-10-18T20:58:17.731 INFO:tasks.workunit.client.0.smithi008.stdout:6/118: read df/d19/f1c [1511986,77854] 0 2023-10-18T20:58:17.731 INFO:tasks.workunit.client.0.smithi008.stdout:6/119: readlink df/d13/l14 0 2023-10-18T20:58:17.731 INFO:tasks.workunit.client.0.smithi008.stdout:6/120: chown df/d13/l14 2 1 2023-10-18T20:58:17.732 INFO:tasks.workunit.client.0.smithi008.stdout:6/121: read - df/d13/f1a zero size 2023-10-18T20:58:17.734 INFO:tasks.workunit.client.0.smithi008.stdout:7/82: dread d1/d3/f14 [0,4194304] 0 2023-10-18T20:58:17.734 INFO:tasks.workunit.client.0.smithi008.stdout:4/102: symlink d0/d3/d21/l22 0 2023-10-18T20:58:17.735 INFO:tasks.workunit.client.0.smithi008.stdout:6/122: mknod df/d26/c2b 0 2023-10-18T20:58:17.735 INFO:tasks.workunit.client.0.smithi008.stdout:6/123: chown df/d15 6882947 1 2023-10-18T20:58:17.736 INFO:tasks.workunit.client.0.smithi008.stdout:4/103: link d0/d17/f1a d0/d17/f23 0 2023-10-18T20:58:17.737 INFO:tasks.workunit.client.0.smithi008.stdout:6/124: unlink lb 0 2023-10-18T20:58:17.768 INFO:tasks.workunit.client.0.smithi008.stdout:1/218: dread d9/de/f15 [0,4194304] 0 2023-10-18T20:58:17.768 INFO:tasks.workunit.client.0.smithi008.stdout:1/219: write d9/f2f [275508,96207] 0 2023-10-18T20:58:17.781 INFO:tasks.workunit.client.0.smithi008.stdout:1/220: dread d9/de/df/f10 [0,4194304] 0 2023-10-18T20:58:17.781 INFO:tasks.workunit.client.0.smithi008.stdout:1/221: write f2 [2137119,47214] 0 2023-10-18T20:58:17.782 INFO:tasks.workunit.client.0.smithi008.stdout:1/222: write d9/de/df/d17/d25/f29 [3590953,44536] 0 2023-10-18T20:58:17.782 INFO:tasks.workunit.client.0.smithi008.stdout:1/223: dread - d9/f42 zero size 2023-10-18T20:58:17.783 INFO:tasks.workunit.client.0.smithi008.stdout:1/224: creat d9/de/f45 x:0 0 0 2023-10-18T20:58:17.783 INFO:tasks.workunit.client.0.smithi008.stdout:1/225: read d9/de/df/d17/d25/f29 [2460729,123899] 0 2023-10-18T20:58:17.785 INFO:tasks.workunit.client.0.smithi008.stdout:1/226: rmdir d9/de/df/d17 39 2023-10-18T20:58:17.785 INFO:tasks.workunit.client.0.smithi008.stdout:1/227: read d9/fc [3075812,79954] 0 2023-10-18T20:58:17.787 INFO:tasks.workunit.client.0.smithi008.stdout:1/228: rename d9/de/df/d17/d1e/c31 to d9/de/df/d17/d1e/d3c/c46 0 2023-10-18T20:58:17.787 INFO:tasks.workunit.client.0.smithi008.stdout:1/229: stat d9/de/df/d17/d1e/f2d 0 2023-10-18T20:58:17.789 INFO:tasks.workunit.client.0.smithi008.stdout:1/230: truncate d9/fc 2578942 0 2023-10-18T20:58:17.790 INFO:tasks.workunit.client.0.smithi008.stdout:1/231: chown d9/ld 304452803 1 2023-10-18T20:58:17.792 INFO:tasks.workunit.client.0.smithi008.stdout:1/232: write d9/de/df/d17/d1e/f2d [328120,107167] 0 2023-10-18T20:58:17.792 INFO:tasks.workunit.client.0.smithi008.stdout:1/233: chown d9/de/df/d17/d1e/l22 9 1 2023-10-18T20:58:17.797 INFO:tasks.workunit.client.0.smithi008.stdout:1/234: rename f0 to d9/de/f47 0 2023-10-18T20:58:17.810 INFO:tasks.workunit.client.0.smithi008.stdout:5/59: write d0/d2/f7 [8256613,29948] 0 2023-10-18T20:58:17.824 INFO:tasks.workunit.client.0.smithi008.stdout:5/60: rmdir d0/de 39 2023-10-18T20:58:17.827 INFO:tasks.workunit.client.0.smithi008.stdout:5/61: rename d0/c6 to d0/d2/c15 0 2023-10-18T20:58:17.829 INFO:tasks.workunit.client.0.smithi008.stdout:5/62: rename d0/d2/d9/f14 to d0/d2/f16 0 2023-10-18T20:58:17.831 INFO:tasks.workunit.client.1.smithi060.stdout:8/60: sync 2023-10-18T20:58:17.832 INFO:tasks.workunit.client.1.smithi060.stdout:7/46: sync 2023-10-18T20:58:17.832 INFO:tasks.workunit.client.1.smithi060.stdout:1/128: sync 2023-10-18T20:58:17.832 INFO:tasks.workunit.client.1.smithi060.stdout:6/20: sync 2023-10-18T20:58:17.832 INFO:tasks.workunit.client.1.smithi060.stdout:3/27: sync 2023-10-18T20:58:17.832 INFO:tasks.workunit.client.1.smithi060.stdout:4/1: sync 2023-10-18T20:58:17.833 INFO:tasks.workunit.client.1.smithi060.stdout:2/59: sync 2023-10-18T20:58:17.833 INFO:tasks.workunit.client.1.smithi060.stdout:6/21: chown f7 19799890 1 2023-10-18T20:58:17.833 INFO:tasks.workunit.client.1.smithi060.stdout:3/28: chown d0/l8 15 1 2023-10-18T20:58:17.833 INFO:tasks.workunit.client.1.smithi060.stdout:3/29: chown d0/l8 614 1 2023-10-18T20:58:17.834 INFO:tasks.workunit.client.1.smithi060.stdout:2/60: readlink d0/d8/l18 0 2023-10-18T20:58:17.834 INFO:tasks.workunit.client.1.smithi060.stdout:8/61: fdatasync d4/fc 0 2023-10-18T20:58:17.834 INFO:tasks.workunit.client.1.smithi060.stdout:2/61: truncate d0/d8/fa 1611319 0 2023-10-18T20:58:17.834 INFO:tasks.workunit.client.1.smithi060.stdout:3/30: write d0/fa [717243,70254] 0 2023-10-18T20:58:17.834 INFO:tasks.workunit.client.1.smithi060.stdout:8/62: write d4/d9/fa [1819139,100820] 0 2023-10-18T20:58:17.835 INFO:tasks.workunit.client.1.smithi060.stdout:8/63: chown d4/f5 12 1 2023-10-18T20:58:17.835 INFO:tasks.workunit.client.1.smithi060.stdout:3/31: creat d0/fb x:0 0 0 2023-10-18T20:58:17.835 INFO:tasks.workunit.client.1.smithi060.stdout:3/32: truncate d0/fa 1364045 0 2023-10-18T20:58:17.835 INFO:tasks.workunit.client.1.smithi060.stdout:8/64: read d4/d9/fa [3789581,754] 0 2023-10-18T20:58:17.835 INFO:tasks.workunit.client.1.smithi060.stdout:8/65: creat d4/ff x:0 0 0 2023-10-18T20:58:17.836 INFO:tasks.workunit.client.1.smithi060.stdout:5/132: sync 2023-10-18T20:58:17.836 INFO:tasks.workunit.client.1.smithi060.stdout:0/98: sync 2023-10-18T20:58:17.836 INFO:tasks.workunit.client.1.smithi060.stdout:9/37: sync 2023-10-18T20:58:17.837 INFO:tasks.workunit.client.0.smithi008.stdout:5/63: symlink d0/d2/d9/l17 0 2023-10-18T20:58:17.837 INFO:tasks.workunit.client.0.smithi008.stdout:5/64: fsync d0/f8 0 2023-10-18T20:58:17.837 INFO:tasks.workunit.client.1.smithi060.stdout:7/47: symlink de/l11 0 2023-10-18T20:58:17.839 INFO:tasks.workunit.client.0.smithi008.stdout:5/65: rmdir d0 39 2023-10-18T20:58:17.842 INFO:tasks.workunit.client.1.smithi060.stdout:2/62: dread d0/d3/f13 [0,4194304] 0 2023-10-18T20:58:17.843 INFO:tasks.workunit.client.1.smithi060.stdout:4/2: creat f0 x:0 0 0 2023-10-18T20:58:17.847 INFO:tasks.workunit.client.1.smithi060.stdout:8/66: dread d4/fc [0,4194304] 0 2023-10-18T20:58:17.848 INFO:tasks.workunit.client.1.smithi060.stdout:7/48: mknod de/c12 0 2023-10-18T20:58:17.849 INFO:tasks.workunit.client.0.smithi008.stdout:9/80: dwrite d2/d7/fe [0,4194304] 0 2023-10-18T20:58:17.849 INFO:tasks.workunit.client.1.smithi060.stdout:2/63: creat d0/d16/f19 x:0 0 0 2023-10-18T20:58:17.850 INFO:tasks.workunit.client.1.smithi060.stdout:2/64: write d0/f10 [64858,12517] 0 2023-10-18T20:58:17.850 INFO:tasks.workunit.client.1.smithi060.stdout:2/65: chown d0/d8/fc 15 1 2023-10-18T20:58:17.850 INFO:tasks.workunit.client.1.smithi060.stdout:4/3: rename f0 to f1 0 2023-10-18T20:58:17.851 INFO:tasks.workunit.client.1.smithi060.stdout:7/49: rmdir de 39 2023-10-18T20:58:17.852 INFO:tasks.workunit.client.1.smithi060.stdout:7/50: readlink de/l11 0 2023-10-18T20:58:17.854 INFO:tasks.workunit.client.1.smithi060.stdout:2/66: rename d0/f2 to d0/d16/f1a 0 2023-10-18T20:58:17.855 INFO:tasks.workunit.client.0.smithi008.stdout:9/81: link d2/d7/la d2/l11 0 2023-10-18T20:58:17.860 INFO:tasks.workunit.client.0.smithi008.stdout:9/82: unlink d2/ff 0 2023-10-18T20:58:17.862 INFO:tasks.workunit.client.1.smithi060.stdout:7/51: mknod de/c13 0 2023-10-18T20:58:17.868 INFO:tasks.workunit.client.0.smithi008.stdout:3/84: dwrite d0/d3/fd [0,4194304] 0 2023-10-18T20:58:17.869 INFO:tasks.workunit.client.0.smithi008.stdout:3/85: chown d0/d3 550 1 2023-10-18T20:58:17.869 INFO:tasks.workunit.client.1.smithi060.stdout:2/67: stat d0/d3/l7 0 2023-10-18T20:58:17.870 INFO:tasks.workunit.client.1.smithi060.stdout:2/68: fdatasync d0/d8/f11 0 2023-10-18T20:58:17.870 INFO:tasks.workunit.client.0.smithi008.stdout:3/86: mknod d0/d3/de/c19 0 2023-10-18T20:58:17.871 INFO:tasks.workunit.client.0.smithi008.stdout:3/87: write d0/d3/de/f17 [250415,77124] 0 2023-10-18T20:58:17.871 INFO:tasks.workunit.client.0.smithi008.stdout:3/88: write d0/d3/de/f14 [131945,127064] 0 2023-10-18T20:58:17.876 INFO:tasks.workunit.client.0.smithi008.stdout:9/83: read d2/fb [81396,53638] 0 2023-10-18T20:58:17.876 INFO:tasks.workunit.client.0.smithi008.stdout:9/84: readlink d2/l11 0 2023-10-18T20:58:17.878 INFO:tasks.workunit.client.1.smithi060.stdout:0/99: dread d3/d8/fa [0,4194304] 0 2023-10-18T20:58:17.879 INFO:tasks.workunit.client.1.smithi060.stdout:0/100: dread - d3/f1a zero size 2023-10-18T20:58:17.887 INFO:tasks.workunit.client.1.smithi060.stdout:7/52: write de/ff [1972790,15864] 0 2023-10-18T20:58:17.888 INFO:tasks.workunit.client.1.smithi060.stdout:7/53: readlink l4 0 2023-10-18T20:58:17.889 INFO:tasks.workunit.client.0.smithi008.stdout:7/83: dwrite d1/d3/f14 [0,4194304] 0 2023-10-18T20:58:17.890 INFO:tasks.workunit.client.0.smithi008.stdout:6/125: dread df/d15/f16 [0,4194304] 0 2023-10-18T20:58:17.890 INFO:tasks.workunit.client.0.smithi008.stdout:1/235: dwrite d9/fc [0,4194304] 0 2023-10-18T20:58:17.892 INFO:tasks.workunit.client.1.smithi060.stdout:3/33: dwrite d0/fb [0,4194304] 0 2023-10-18T20:58:17.892 INFO:tasks.workunit.client.1.smithi060.stdout:3/34: creat d0/fc x:0 0 0 2023-10-18T20:58:17.894 INFO:tasks.workunit.client.1.smithi060.stdout:8/67: dwrite f3 [0,4194304] 0 2023-10-18T20:58:17.897 INFO:tasks.workunit.client.0.smithi008.stdout:6/126: getdents df/d15 0 2023-10-18T20:58:17.897 INFO:tasks.workunit.client.0.smithi008.stdout:6/127: fdatasync df/d15/f16 0 2023-10-18T20:58:17.901 INFO:tasks.workunit.client.0.smithi008.stdout:6/128: truncate df/d15/f16 3579729 0 2023-10-18T20:58:17.901 INFO:tasks.workunit.client.0.smithi008.stdout:6/129: chown l0 358820 1 2023-10-18T20:58:17.906 INFO:tasks.workunit.client.1.smithi060.stdout:3/35: write d0/fb [8431,127917] 0 2023-10-18T20:58:17.906 INFO:tasks.workunit.client.1.smithi060.stdout:3/36: chown d0/l4 603 1 2023-10-18T20:58:17.906 INFO:tasks.workunit.client.1.smithi060.stdout:3/37: write d0/fb [1205676,5481] 0 2023-10-18T20:58:17.907 INFO:tasks.workunit.client.1.smithi060.stdout:3/38: truncate d0/fc 249685 0 2023-10-18T20:58:17.908 INFO:tasks.workunit.client.0.smithi008.stdout:6/130: getdents df/d19 0 2023-10-18T20:58:17.908 INFO:tasks.workunit.client.0.smithi008.stdout:6/131: dread - df/d15/d27/f28 zero size 2023-10-18T20:58:17.908 INFO:tasks.workunit.client.1.smithi060.stdout:3/39: write d0/fc [920360,105665] 0 2023-10-18T20:58:17.909 INFO:tasks.workunit.client.1.smithi060.stdout:3/40: creat d0/fd x:0 0 0 2023-10-18T20:58:17.909 INFO:tasks.workunit.client.1.smithi060.stdout:3/41: write d0/fc [1428238,1763] 0 2023-10-18T20:58:17.909 INFO:tasks.workunit.client.1.smithi060.stdout:3/42: write d0/fc [1007584,38569] 0 2023-10-18T20:58:17.909 INFO:tasks.workunit.client.1.smithi060.stdout:3/43: creat d0/fe x:0 0 0 2023-10-18T20:58:17.911 INFO:tasks.workunit.client.0.smithi008.stdout:6/132: rename df/d13/l14 to df/d15/d27/l2c 0 2023-10-18T20:58:17.912 INFO:tasks.workunit.client.0.smithi008.stdout:6/133: creat df/d18/f2d x:0 0 0 2023-10-18T20:58:17.912 INFO:tasks.workunit.client.0.smithi008.stdout:6/134: dread - df/f1e zero size 2023-10-18T20:58:17.912 INFO:tasks.workunit.client.0.smithi008.stdout:6/135: fdatasync df/d19/f20 0 2023-10-18T20:58:17.917 INFO:tasks.workunit.client.1.smithi060.stdout:8/68: mknod d4/c10 0 2023-10-18T20:58:17.918 INFO:tasks.workunit.client.1.smithi060.stdout:3/44: write d0/f2 [229017,57963] 0 2023-10-18T20:58:17.919 INFO:tasks.workunit.client.1.smithi060.stdout:5/133: dwrite d0/d6/db/f22 [0,4194304] 0 2023-10-18T20:58:17.919 INFO:tasks.workunit.client.1.smithi060.stdout:5/134: chown d0/d6/d8/f11 1763462582 1 2023-10-18T20:58:17.927 INFO:tasks.workunit.client.1.smithi060.stdout:5/135: mkdir d0/dd/d33 0 2023-10-18T20:58:17.937 INFO:tasks.workunit.client.1.smithi060.stdout:8/69: dread d4/fe [0,4194304] 0 2023-10-18T20:58:17.939 INFO:tasks.workunit.client.1.smithi060.stdout:9/38: dwrite d3/f7 [0,4194304] 0 2023-10-18T20:58:17.939 INFO:tasks.workunit.client.1.smithi060.stdout:9/39: fdatasync d3/f9 0 2023-10-18T20:58:17.939 INFO:tasks.workunit.client.1.smithi060.stdout:9/40: creat d3/ff x:0 0 0 2023-10-18T20:58:17.941 INFO:tasks.workunit.client.1.smithi060.stdout:4/4: getdents . 0 2023-10-18T20:58:17.944 INFO:tasks.workunit.client.1.smithi060.stdout:8/70: mknod d4/c11 0 2023-10-18T20:58:17.950 INFO:tasks.workunit.client.0.smithi008.stdout:7/84: dread d1/fd [0,4194304] 0 2023-10-18T20:58:17.951 INFO:tasks.workunit.client.0.smithi008.stdout:5/66: dwrite d0/d2/f16 [0,4194304] 0 2023-10-18T20:58:17.951 INFO:tasks.workunit.client.0.smithi008.stdout:5/67: fdatasync d0/d2/d9/f11 0 2023-10-18T20:58:17.953 INFO:tasks.workunit.client.1.smithi060.stdout:4/5: creat f2 x:0 0 0 2023-10-18T20:58:17.958 INFO:tasks.workunit.client.0.smithi008.stdout:9/85: dwrite d2/d8/f9 [4194304,4194304] 0 2023-10-18T20:58:17.958 INFO:tasks.workunit.client.0.smithi008.stdout:9/86: write d2/f4 [732115,121561] 0 2023-10-18T20:58:17.960 INFO:tasks.workunit.client.1.smithi060.stdout:5/136: dread d0/f4 [0,4194304] 0 2023-10-18T20:58:17.961 INFO:tasks.workunit.client.0.smithi008.stdout:3/89: rmdir d0/d3/de 39 2023-10-18T20:58:17.966 INFO:tasks.workunit.client.1.smithi060.stdout:3/45: dread d0/fc [0,4194304] 0 2023-10-18T20:58:17.967 INFO:tasks.workunit.client.1.smithi060.stdout:3/46: chown d0 0 1 2023-10-18T20:58:17.967 INFO:tasks.workunit.client.1.smithi060.stdout:3/47: stat d0/f2 0 2023-10-18T20:58:17.967 INFO:tasks.workunit.client.1.smithi060.stdout:3/48: chown d0/l4 1328409 1 2023-10-18T20:58:17.967 INFO:tasks.workunit.client.1.smithi060.stdout:3/49: dread - d0/fd zero size 2023-10-18T20:58:17.968 INFO:tasks.workunit.client.1.smithi060.stdout:3/50: creat d0/ff x:0 0 0 2023-10-18T20:58:17.968 INFO:tasks.workunit.client.0.smithi008.stdout:2/124: dwrite d1/f18 [0,4194304] 0 2023-10-18T20:58:17.969 INFO:tasks.workunit.client.0.smithi008.stdout:2/125: chown d1/l5 90 1 2023-10-18T20:58:17.969 INFO:tasks.workunit.client.0.smithi008.stdout:9/87: mkdir d2/d7/d12 0 2023-10-18T20:58:17.974 INFO:tasks.workunit.client.0.smithi008.stdout:3/90: rename d0/d3/f6 to d0/d3/d15/f1a 0 2023-10-18T20:58:17.981 INFO:tasks.workunit.client.0.smithi008.stdout:6/136: dwrite df/d18/f2d [0,4194304] 0 2023-10-18T20:58:17.982 INFO:tasks.workunit.client.0.smithi008.stdout:6/137: creat df/f2e x:0 0 0 2023-10-18T20:58:17.988 INFO:tasks.workunit.client.0.smithi008.stdout:1/236: dwrite d9/de/df/d17/d25/f32 [4194304,4194304] 0 2023-10-18T20:58:17.992 INFO:tasks.workunit.client.1.smithi060.stdout:7/54: truncate fc 3209973 0 2023-10-18T20:58:17.992 INFO:tasks.workunit.client.1.smithi060.stdout:3/51: fsync d0/fd 0 2023-10-18T20:58:17.996 INFO:tasks.workunit.client.1.smithi060.stdout:5/137: rename d0/d6/d9/c2b to d0/d6/db/d2a/c34 0 2023-10-18T20:58:17.996 INFO:tasks.workunit.client.1.smithi060.stdout:5/138: chown d0/d6/d30 7374253 1 2023-10-18T20:58:18.002 INFO:tasks.workunit.client.1.smithi060.stdout:4/6: getdents . 0 2023-10-18T20:58:18.003 INFO:tasks.workunit.client.1.smithi060.stdout:8/71: dwrite f3 [0,4194304] 0 2023-10-18T20:58:18.004 INFO:tasks.workunit.client.1.smithi060.stdout:8/72: chown d4/ff 1821830 1 2023-10-18T20:58:18.004 INFO:tasks.workunit.client.1.smithi060.stdout:9/41: dwrite d3/fc [0,4194304] 0 2023-10-18T20:58:18.005 INFO:tasks.workunit.client.0.smithi008.stdout:7/85: dwrite d1/d3/f17 [0,4194304] 0 2023-10-18T20:58:18.006 INFO:tasks.workunit.client.0.smithi008.stdout:7/86: truncate d1/d3/f1a 405735 0 2023-10-18T20:58:18.006 INFO:tasks.workunit.client.0.smithi008.stdout:7/87: stat d1/d3/c12 0 2023-10-18T20:58:18.006 INFO:tasks.workunit.client.0.smithi008.stdout:7/88: readlink d1/d3/l5 0 2023-10-18T20:58:18.006 INFO:tasks.workunit.client.0.smithi008.stdout:7/89: dread - d1/d3/f13 zero size 2023-10-18T20:58:18.007 INFO:tasks.workunit.client.0.smithi008.stdout:7/90: dread - d1/f1b zero size 2023-10-18T20:58:18.007 INFO:tasks.workunit.client.1.smithi060.stdout:7/55: fdatasync fc 0 2023-10-18T20:58:18.043 INFO:tasks.workunit.client.1.smithi060.stdout:4/7: dwrite f2 [0,4194304] 0 2023-10-18T20:58:18.072 INFO:tasks.workunit.client.1.smithi060.stdout:4/8: dwrite f1 [0,4194304] 0 2023-10-18T20:58:18.085 INFO:tasks.workunit.client.1.smithi060.stdout:4/9: dread f2 [0,4194304] 0 2023-10-18T20:58:18.091 INFO:tasks.workunit.client.1.smithi060.stdout:3/52: rename d0/c1 to d0/c10 0 2023-10-18T20:58:18.091 INFO:tasks.workunit.client.1.smithi060.stdout:3/53: truncate d0/fc 1618044 0 2023-10-18T20:58:18.091 INFO:tasks.workunit.client.1.smithi060.stdout:3/54: fdatasync d0/fc 0 2023-10-18T20:58:18.091 INFO:tasks.workunit.client.1.smithi060.stdout:3/55: creat d0/f11 x:0 0 0 2023-10-18T20:58:18.092 INFO:tasks.workunit.client.1.smithi060.stdout:3/56: creat d0/f12 x:0 0 0 2023-10-18T20:58:18.098 INFO:tasks.workunit.client.1.smithi060.stdout:5/139: rmdir d0/d6/d30 0 2023-10-18T20:58:18.098 INFO:tasks.workunit.client.1.smithi060.stdout:5/140: readlink d0/da/l29 0 2023-10-18T20:58:18.098 INFO:tasks.workunit.client.1.smithi060.stdout:4/10: write f1 [3861478,110758] 0 2023-10-18T20:58:18.104 INFO:tasks.workunit.client.1.smithi060.stdout:8/73: rename d4/c7 to d4/d9/c12 0 2023-10-18T20:58:18.104 INFO:tasks.workunit.client.1.smithi060.stdout:8/74: readlink d4/lb 0 2023-10-18T20:58:18.119 INFO:tasks.workunit.client.0.smithi008.stdout:9/88: mknod d2/c13 0 2023-10-18T20:58:18.120 INFO:tasks.workunit.client.0.smithi008.stdout:9/89: chown d2/c13 1251 1 2023-10-18T20:58:18.126 INFO:tasks.workunit.client.1.smithi060.stdout:7/56: dwrite fc [0,4194304] 0 2023-10-18T20:58:18.129 INFO:tasks.workunit.client.0.smithi008.stdout:6/138: rename df/d18/c1d to df/d19/c2f 0 2023-10-18T20:58:18.129 INFO:tasks.workunit.client.0.smithi008.stdout:6/139: dread - df/d15/d27/f28 zero size 2023-10-18T20:58:18.129 INFO:tasks.workunit.client.0.smithi008.stdout:6/140: write df/d19/f1c [2593798,123260] 0 2023-10-18T20:58:18.129 INFO:tasks.workunit.client.0.smithi008.stdout:6/141: read - df/f1e zero size 2023-10-18T20:58:18.130 INFO:tasks.workunit.client.0.smithi008.stdout:1/237: creat d9/de/df/d17/d1e/f48 x:0 0 0 2023-10-18T20:58:18.131 INFO:tasks.workunit.client.1.smithi060.stdout:5/141: symlink d0/d6/d9/l35 0 2023-10-18T20:58:18.131 INFO:tasks.workunit.client.1.smithi060.stdout:5/142: chown d0/d6/f7 42198 1 2023-10-18T20:58:18.131 INFO:tasks.workunit.client.1.smithi060.stdout:4/11: symlink l3 0 2023-10-18T20:58:18.132 INFO:tasks.workunit.client.1.smithi060.stdout:8/75: rename d4/f6 to d4/f13 0 2023-10-18T20:58:18.133 INFO:tasks.workunit.client.1.smithi060.stdout:8/76: chown d4/ff 147547562 1 2023-10-18T20:58:18.133 INFO:tasks.workunit.client.1.smithi060.stdout:8/77: dread - d4/ff zero size 2023-10-18T20:58:18.139 INFO:tasks.workunit.client.1.smithi060.stdout:7/57: mkdir de/d14 0 2023-10-18T20:58:18.139 INFO:tasks.workunit.client.1.smithi060.stdout:7/58: fdatasync de/ff 0 2023-10-18T20:58:18.140 INFO:tasks.workunit.client.1.smithi060.stdout:7/59: fdatasync fc 0 2023-10-18T20:58:18.142 INFO:tasks.workunit.client.1.smithi060.stdout:5/143: rename d0/d6/db/c12 to d0/d6/d8/df/d27/c36 0 2023-10-18T20:58:18.143 INFO:tasks.workunit.client.0.smithi008.stdout:9/90: creat d2/dc/f14 x:0 0 0 2023-10-18T20:58:18.143 INFO:tasks.workunit.client.0.smithi008.stdout:9/91: write d2/dc/f14 [229747,20252] 0 2023-10-18T20:58:18.143 INFO:tasks.workunit.client.0.smithi008.stdout:9/92: unlink d2/fb 0 2023-10-18T20:58:18.143 INFO:tasks.workunit.client.0.smithi008.stdout:9/93: readlink d2/l6 0 2023-10-18T20:58:18.143 INFO:tasks.workunit.client.0.smithi008.stdout:9/94: creat d2/dc/f15 x:0 0 0 2023-10-18T20:58:18.144 INFO:tasks.workunit.client.0.smithi008.stdout:9/95: readlink d2/d8/l10 0 2023-10-18T20:58:18.144 INFO:tasks.workunit.client.0.smithi008.stdout:9/96: read d2/f3 [934976,109701] 0 2023-10-18T20:58:18.144 INFO:tasks.workunit.client.1.smithi060.stdout:4/12: mkdir d4 0 2023-10-18T20:58:18.145 INFO:tasks.workunit.client.1.smithi060.stdout:4/13: chown f1 3409009 1 2023-10-18T20:58:18.145 INFO:tasks.workunit.client.1.smithi060.stdout:8/78: link d4/fe d4/f14 0 2023-10-18T20:58:18.145 INFO:tasks.workunit.client.1.smithi060.stdout:8/79: creat d4/f15 x:0 0 0 2023-10-18T20:58:18.146 INFO:tasks.workunit.client.0.smithi008.stdout:6/142: link df/d15/c23 df/d15/d27/c30 0 2023-10-18T20:58:18.148 INFO:tasks.workunit.client.1.smithi060.stdout:9/42: rename d3/dd to d3/d10 0 2023-10-18T20:58:18.151 INFO:tasks.workunit.client.1.smithi060.stdout:7/60: rename l7 to de/d14/l15 0 2023-10-18T20:58:18.151 INFO:tasks.workunit.client.1.smithi060.stdout:7/61: chown de/l11 1 1 2023-10-18T20:58:18.151 INFO:tasks.workunit.client.1.smithi060.stdout:7/62: write de/ff [4258610,33071] 0 2023-10-18T20:58:18.152 INFO:tasks.workunit.client.0.smithi008.stdout:7/91: getdents d1 0 2023-10-18T20:58:18.153 INFO:tasks.workunit.client.1.smithi060.stdout:5/144: read d0/d6/f7 [1211121,96150] 0 2023-10-18T20:58:18.153 INFO:tasks.workunit.client.1.smithi060.stdout:4/14: mkdir d4/d5 0 2023-10-18T20:58:18.162 INFO:tasks.workunit.client.1.smithi060.stdout:7/63: dread fa [0,4194304] 0 2023-10-18T20:58:18.166 INFO:tasks.workunit.client.0.smithi008.stdout:9/97: truncate d2/d8/f9 103013 0 2023-10-18T20:58:18.166 INFO:tasks.workunit.client.0.smithi008.stdout:6/143: creat df/d26/f31 x:0 0 0 2023-10-18T20:58:18.167 INFO:tasks.workunit.client.0.smithi008.stdout:6/144: truncate df/f2e 783189 0 2023-10-18T20:58:18.167 INFO:tasks.workunit.client.0.smithi008.stdout:1/238: rmdir d9/de/df/d17/d1e 39 2023-10-18T20:58:18.168 INFO:tasks.workunit.client.1.smithi060.stdout:9/43: rename d3/fa to d3/d10/f11 0 2023-10-18T20:58:18.168 INFO:tasks.workunit.client.1.smithi060.stdout:9/44: write d3/f4 [886081,44580] 0 2023-10-18T20:58:18.169 INFO:tasks.workunit.client.1.smithi060.stdout:4/15: mknod d4/c6 0 2023-10-18T20:58:18.171 INFO:tasks.workunit.client.1.smithi060.stdout:8/80: rmdir d4 39 2023-10-18T20:58:18.173 INFO:tasks.workunit.client.0.smithi008.stdout:7/92: mknod d1/d3/c1c 0 2023-10-18T20:58:18.174 INFO:tasks.workunit.client.1.smithi060.stdout:7/64: creat de/d14/f16 x:0 0 0 2023-10-18T20:58:18.174 INFO:tasks.workunit.client.1.smithi060.stdout:7/65: chown de/d14/l15 1791 1 2023-10-18T20:58:18.179 INFO:tasks.workunit.client.0.smithi008.stdout:9/98: creat d2/d7/d12/f16 x:0 0 0 2023-10-18T20:58:18.180 INFO:tasks.workunit.client.1.smithi060.stdout:9/45: symlink d3/l12 0 2023-10-18T20:58:18.183 INFO:tasks.workunit.client.1.smithi060.stdout:4/16: rename f1 to d4/d5/f7 0 2023-10-18T20:58:18.184 INFO:tasks.workunit.client.1.smithi060.stdout:9/46: symlink d3/l13 0 2023-10-18T20:58:18.185 INFO:tasks.workunit.client.0.smithi008.stdout:0/82: sync 2023-10-18T20:58:18.185 INFO:tasks.workunit.client.0.smithi008.stdout:8/159: sync 2023-10-18T20:58:18.185 INFO:tasks.workunit.client.0.smithi008.stdout:4/104: sync 2023-10-18T20:58:18.185 INFO:tasks.workunit.client.0.smithi008.stdout:1/239: mknod d9/de/c49 0 2023-10-18T20:58:18.185 INFO:tasks.workunit.client.0.smithi008.stdout:1/240: chown d9/f42 7 1 2023-10-18T20:58:18.186 INFO:tasks.workunit.client.0.smithi008.stdout:6/145: dread df/d19/f1c [0,4194304] 0 2023-10-18T20:58:18.186 INFO:tasks.workunit.client.0.smithi008.stdout:6/146: truncate df/d15/d27/f28 873480 0 2023-10-18T20:58:18.187 INFO:tasks.workunit.client.1.smithi060.stdout:7/66: dread fa [0,4194304] 0 2023-10-18T20:58:18.187 INFO:tasks.workunit.client.0.smithi008.stdout:0/83: mkdir d0/dd/d16 0 2023-10-18T20:58:18.187 INFO:tasks.workunit.client.0.smithi008.stdout:0/84: fdatasync d0/f13 0 2023-10-18T20:58:18.188 INFO:tasks.workunit.client.1.smithi060.stdout:9/47: truncate f0 1446917 0 2023-10-18T20:58:18.192 INFO:tasks.workunit.client.0.smithi008.stdout:4/105: creat d0/d3/d21/f24 x:0 0 0 2023-10-18T20:58:18.192 INFO:tasks.workunit.client.0.smithi008.stdout:4/106: dread - d0/d17/f23 zero size 2023-10-18T20:58:18.193 INFO:tasks.workunit.client.1.smithi060.stdout:7/67: creat de/f17 x:0 0 0 2023-10-18T20:58:18.194 INFO:tasks.workunit.client.1.smithi060.stdout:9/48: truncate f2 409528 0 2023-10-18T20:58:18.195 INFO:tasks.workunit.client.1.smithi060.stdout:7/68: truncate fc 3769014 0 2023-10-18T20:58:18.195 INFO:tasks.workunit.client.1.smithi060.stdout:7/69: dread - de/d14/f16 zero size 2023-10-18T20:58:18.195 INFO:tasks.workunit.client.1.smithi060.stdout:7/70: dread - de/d14/f16 zero size 2023-10-18T20:58:18.196 INFO:tasks.workunit.client.1.smithi060.stdout:4/17: write f2 [3905680,1019] 0 2023-10-18T20:58:18.197 INFO:tasks.workunit.client.1.smithi060.stdout:4/18: chown d4 1 1 2023-10-18T20:58:18.197 INFO:tasks.workunit.client.1.smithi060.stdout:4/19: write f2 [4446800,77546] 0 2023-10-18T20:58:18.197 INFO:tasks.workunit.client.1.smithi060.stdout:9/49: unlink d3/fc 0 2023-10-18T20:58:18.198 INFO:tasks.workunit.client.0.smithi008.stdout:6/147: rename f5 to df/d19/f32 0 2023-10-18T20:58:18.198 INFO:tasks.workunit.client.0.smithi008.stdout:0/85: mknod d0/dd/df/c17 0 2023-10-18T20:58:18.198 INFO:tasks.workunit.client.0.smithi008.stdout:0/86: dread - d0/f11 zero size 2023-10-18T20:58:18.199 INFO:tasks.workunit.client.0.smithi008.stdout:8/160: dread d5/d8/df/f39 [0,4194304] 0 2023-10-18T20:58:18.199 INFO:tasks.workunit.client.1.smithi060.stdout:7/71: link c8 de/c18 0 2023-10-18T20:58:18.204 INFO:tasks.workunit.client.0.smithi008.stdout:4/107: mknod d0/d17/c25 0 2023-10-18T20:58:18.204 INFO:tasks.workunit.client.0.smithi008.stdout:4/108: creat d0/d3/d8/f26 x:0 0 0 2023-10-18T20:58:18.205 INFO:tasks.workunit.client.1.smithi060.stdout:4/20: symlink d4/l8 0 2023-10-18T20:58:18.205 INFO:tasks.workunit.client.0.smithi008.stdout:6/148: mkdir df/d15/d33 0 2023-10-18T20:58:18.206 INFO:tasks.workunit.client.0.smithi008.stdout:0/87: creat d0/dd/f18 x:0 0 0 2023-10-18T20:58:18.206 INFO:tasks.workunit.client.0.smithi008.stdout:0/88: fdatasync d0/f2 0 2023-10-18T20:58:18.207 INFO:tasks.workunit.client.0.smithi008.stdout:8/161: rename d5/f45 to d5/f4b 0 2023-10-18T20:58:18.209 INFO:tasks.workunit.client.0.smithi008.stdout:0/89: mkdir d0/dd/d19 0 2023-10-18T20:58:18.210 INFO:tasks.workunit.client.0.smithi008.stdout:0/90: chown d0/c7 115639 1 2023-10-18T20:58:18.210 INFO:tasks.workunit.client.0.smithi008.stdout:0/91: dread - d0/dd/f15 zero size 2023-10-18T20:58:18.210 INFO:tasks.workunit.client.0.smithi008.stdout:8/162: symlink d5/d8/df/d2e/l4c 0 2023-10-18T20:58:18.218 INFO:tasks.workunit.client.0.smithi008.stdout:8/163: mkdir d5/d8/d17/d4d 0 2023-10-18T20:58:18.218 INFO:tasks.workunit.client.0.smithi008.stdout:8/164: stat d5/f1c 0 2023-10-18T20:58:18.227 INFO:tasks.workunit.client.1.smithi060.stdout:8/81: dwrite d4/f14 [0,4194304] 0 2023-10-18T20:58:18.239 INFO:tasks.workunit.client.0.smithi008.stdout:1/241: dread d9/de/df/d17/d1e/f2d [0,4194304] 0 2023-10-18T20:58:18.242 INFO:tasks.workunit.client.1.smithi060.stdout:9/50: dwrite d3/f6 [0,4194304] 0 2023-10-18T20:58:18.242 INFO:tasks.workunit.client.1.smithi060.stdout:9/51: truncate d3/f6 4249882 0 2023-10-18T20:58:18.242 INFO:tasks.workunit.client.1.smithi060.stdout:4/21: fsync f2 0 2023-10-18T20:58:18.242 INFO:tasks.workunit.client.1.smithi060.stdout:4/22: write f2 [1175042,36285] 0 2023-10-18T20:58:18.243 INFO:tasks.workunit.client.1.smithi060.stdout:4/23: write d4/d5/f7 [4705225,54836] 0 2023-10-18T20:58:18.243 INFO:tasks.workunit.client.1.smithi060.stdout:4/24: write f2 [1688859,13471] 0 2023-10-18T20:58:18.244 INFO:tasks.workunit.client.1.smithi060.stdout:8/82: mknod d4/d9/c16 0 2023-10-18T20:58:18.245 INFO:tasks.workunit.client.0.smithi008.stdout:1/242: getdents d9/de/df/d17/d1e/d3c 0 2023-10-18T20:58:18.245 INFO:tasks.workunit.client.0.smithi008.stdout:1/243: fsync d9/fc 0 2023-10-18T20:58:18.246 INFO:tasks.workunit.client.0.smithi008.stdout:9/99: read d2/dc/f14 [105207,18592] 0 2023-10-18T20:58:18.249 INFO:tasks.workunit.client.0.smithi008.stdout:1/244: creat d9/de/df/d17/d1e/f4a x:0 0 0 2023-10-18T20:58:18.249 INFO:tasks.workunit.client.0.smithi008.stdout:1/245: write d9/de/df/d17/d25/f29 [554913,20373] 0 2023-10-18T20:58:18.250 INFO:tasks.workunit.client.1.smithi060.stdout:9/52: rename d3/f5 to d3/d10/f14 0 2023-10-18T20:58:18.251 INFO:tasks.workunit.client.1.smithi060.stdout:9/53: truncate f1 121816 0 2023-10-18T20:58:18.252 INFO:tasks.workunit.client.0.smithi008.stdout:1/246: link d9/de/df/l21 d9/de/df/d17/l4b 0 2023-10-18T20:58:18.255 INFO:tasks.workunit.client.1.smithi060.stdout:4/25: mknod d4/c9 0 2023-10-18T20:58:18.255 INFO:tasks.workunit.client.0.smithi008.stdout:7/93: dwrite d1/d3/fb [0,4194304] 0 2023-10-18T20:58:18.255 INFO:tasks.workunit.client.0.smithi008.stdout:7/94: creat d1/d3/f1d x:0 0 0 2023-10-18T20:58:18.258 INFO:tasks.workunit.client.0.smithi008.stdout:1/247: rename d9/de/df/d17/d1e/f48 to d9/de/df/d17/d1e/f4c 0 2023-10-18T20:58:18.265 INFO:tasks.workunit.client.0.smithi008.stdout:9/100: rename d2/d7/d12 to d2/dc/d17 0 2023-10-18T20:58:18.266 INFO:tasks.workunit.client.0.smithi008.stdout:7/95: symlink d1/l1e 0 2023-10-18T20:58:18.281 INFO:tasks.workunit.client.0.smithi008.stdout:9/101: write d2/f4 [7604136,70344] 0 2023-10-18T20:58:18.281 INFO:tasks.workunit.client.0.smithi008.stdout:9/102: fsync d2/d8/f9 0 2023-10-18T20:58:18.282 INFO:tasks.workunit.client.0.smithi008.stdout:4/109: dwrite d0/f13 [0,4194304] 0 2023-10-18T20:58:18.283 INFO:tasks.workunit.client.1.smithi060.stdout:7/72: getdents de 0 2023-10-18T20:58:18.283 INFO:tasks.workunit.client.1.smithi060.stdout:7/73: truncate de/ff 4508603 0 2023-10-18T20:58:18.283 INFO:tasks.workunit.client.1.smithi060.stdout:0/101: sync 2023-10-18T20:58:18.283 INFO:tasks.workunit.client.1.smithi060.stdout:2/69: sync 2023-10-18T20:58:18.283 INFO:tasks.workunit.client.1.smithi060.stdout:6/22: sync 2023-10-18T20:58:18.284 INFO:tasks.workunit.client.1.smithi060.stdout:6/23: unlink c3 0 2023-10-18T20:58:18.284 INFO:tasks.workunit.client.1.smithi060.stdout:6/24: readlink - no filename 2023-10-18T20:58:18.284 INFO:tasks.workunit.client.1.smithi060.stdout:6/25: write f7 [895391,28865] 0 2023-10-18T20:58:18.286 INFO:tasks.workunit.client.0.smithi008.stdout:0/92: dwrite d0/f14 [0,4194304] 0 2023-10-18T20:58:18.287 INFO:tasks.workunit.client.0.smithi008.stdout:0/93: creat d0/dd/f1a x:0 0 0 2023-10-18T20:58:18.287 INFO:tasks.workunit.client.0.smithi008.stdout:0/94: write d0/dd/f1a [53449,113012] 0 2023-10-18T20:58:18.288 INFO:tasks.workunit.client.0.smithi008.stdout:7/96: truncate d1/d3/f14 3237396 0 2023-10-18T20:58:18.288 INFO:tasks.workunit.client.0.smithi008.stdout:1/248: symlink d9/l4d 0 2023-10-18T20:58:18.289 INFO:tasks.workunit.client.1.smithi060.stdout:7/74: dread fc [4194304,4194304] 0 2023-10-18T20:58:18.289 INFO:tasks.workunit.client.1.smithi060.stdout:7/75: dread - de/f17 zero size 2023-10-18T20:58:18.289 INFO:tasks.workunit.client.1.smithi060.stdout:7/76: chown de/d14/f16 846 1 2023-10-18T20:58:18.299 INFO:tasks.workunit.client.0.smithi008.stdout:8/165: dwrite d5/d8/d17/f44 [0,4194304] 0 2023-10-18T20:58:18.301 INFO:tasks.workunit.client.1.smithi060.stdout:1/129: sync 2023-10-18T20:58:18.301 INFO:tasks.workunit.client.1.smithi060.stdout:9/54: dwrite f0 [0,4194304] 0 2023-10-18T20:58:18.302 INFO:tasks.workunit.client.1.smithi060.stdout:3/57: sync 2023-10-18T20:58:18.302 INFO:tasks.workunit.client.1.smithi060.stdout:5/145: sync 2023-10-18T20:58:18.303 INFO:tasks.workunit.client.0.smithi008.stdout:0/95: write d0/f2 [3836340,72486] 0 2023-10-18T20:58:18.303 INFO:tasks.workunit.client.0.smithi008.stdout:0/96: dread - d0/dd/f15 zero size 2023-10-18T20:58:18.304 INFO:tasks.workunit.client.0.smithi008.stdout:0/97: chown d0/dd/df/f12 31 1 2023-10-18T20:58:18.304 INFO:tasks.workunit.client.0.smithi008.stdout:0/98: dread - d0/dd/f18 zero size 2023-10-18T20:58:18.304 INFO:tasks.workunit.client.1.smithi060.stdout:8/83: getdents d4/d9 0 2023-10-18T20:58:18.308 INFO:tasks.workunit.client.1.smithi060.stdout:7/77: unlink de/l11 0 2023-10-18T20:58:18.308 INFO:tasks.workunit.client.1.smithi060.stdout:4/26: dwrite f2 [0,4194304] 0 2023-10-18T20:58:18.308 INFO:tasks.workunit.client.1.smithi060.stdout:4/27: write d4/d5/f7 [5459184,111868] 0 2023-10-18T20:58:18.317 INFO:tasks.workunit.client.1.smithi060.stdout:2/70: getdents d0 0 2023-10-18T20:58:18.320 INFO:tasks.workunit.client.1.smithi060.stdout:5/146: creat d0/d6/d8/df/d27/f37 x:0 0 0 2023-10-18T20:58:18.321 INFO:tasks.workunit.client.0.smithi008.stdout:9/103: mknod d2/dc/d17/c18 0 2023-10-18T20:58:18.321 INFO:tasks.workunit.client.0.smithi008.stdout:9/104: stat d2/l6 0 2023-10-18T20:58:18.321 INFO:tasks.workunit.client.0.smithi008.stdout:9/105: readlink d2/l6 0 2023-10-18T20:58:18.322 INFO:tasks.workunit.client.1.smithi060.stdout:3/58: symlink d0/l13 0 2023-10-18T20:58:18.324 INFO:tasks.workunit.client.1.smithi060.stdout:8/84: symlink d4/d9/l17 0 2023-10-18T20:58:18.325 INFO:tasks.workunit.client.1.smithi060.stdout:4/28: rmdir d4 39 2023-10-18T20:58:18.326 INFO:tasks.workunit.client.1.smithi060.stdout:4/29: chown l3 267156857 1 2023-10-18T20:58:18.326 INFO:tasks.workunit.client.1.smithi060.stdout:7/78: dread de/ff [0,4194304] 0 2023-10-18T20:58:18.326 INFO:tasks.workunit.client.1.smithi060.stdout:7/79: write de/f17 [998922,43387] 0 2023-10-18T20:58:18.327 INFO:tasks.workunit.client.1.smithi060.stdout:7/80: readlink l6 0 2023-10-18T20:58:18.328 INFO:tasks.workunit.client.1.smithi060.stdout:1/130: getdents d4/d6 0 2023-10-18T20:58:18.328 INFO:tasks.workunit.client.1.smithi060.stdout:1/131: readlink d4/da/l1e 0 2023-10-18T20:58:18.330 INFO:tasks.workunit.client.0.smithi008.stdout:5/68: sync 2023-10-18T20:58:18.333 INFO:tasks.workunit.client.1.smithi060.stdout:5/147: mknod d0/d6/db/c38 0 2023-10-18T20:58:18.339 INFO:tasks.workunit.client.1.smithi060.stdout:3/59: mknod d0/c14 0 2023-10-18T20:58:18.339 INFO:tasks.workunit.client.1.smithi060.stdout:3/60: chown d0/fb 45 1 2023-10-18T20:58:18.340 INFO:tasks.workunit.client.1.smithi060.stdout:3/61: chown d0/fd 1827118 1 2023-10-18T20:58:18.340 INFO:tasks.workunit.client.1.smithi060.stdout:3/62: creat d0/f15 x:0 0 0 2023-10-18T20:58:18.340 INFO:tasks.workunit.client.1.smithi060.stdout:3/63: write d0/f12 [684865,74334] 0 2023-10-18T20:58:18.340 INFO:tasks.workunit.client.1.smithi060.stdout:3/64: chown d0/l8 2 1 2023-10-18T20:58:18.341 INFO:tasks.workunit.client.0.smithi008.stdout:8/166: symlink d5/l4e 0 2023-10-18T20:58:18.342 INFO:tasks.workunit.client.1.smithi060.stdout:8/85: mknod d4/c18 0 2023-10-18T20:58:18.342 INFO:tasks.workunit.client.1.smithi060.stdout:4/30: creat d4/fa x:0 0 0 2023-10-18T20:58:18.344 INFO:tasks.workunit.client.0.smithi008.stdout:0/99: unlink d0/l9 0 2023-10-18T20:58:18.347 INFO:tasks.workunit.client.1.smithi060.stdout:0/102: dwrite d3/f17 [4194304,4194304] 0 2023-10-18T20:58:18.353 INFO:tasks.workunit.client.0.smithi008.stdout:9/106: rename d2/d7 to d2/dc/d17/d19 0 2023-10-18T20:58:18.353 INFO:tasks.workunit.client.0.smithi008.stdout:9/107: truncate d2/d8/f9 627258 0 2023-10-18T20:58:18.353 INFO:tasks.workunit.client.0.smithi008.stdout:9/108: chown d2/f3 3 1 2023-10-18T20:58:18.353 INFO:tasks.workunit.client.0.smithi008.stdout:9/109: readlink d2/l6 0 2023-10-18T20:58:18.353 INFO:tasks.workunit.client.0.smithi008.stdout:9/110: write d2/dc/f14 [709503,107363] 0 2023-10-18T20:58:18.357 INFO:tasks.workunit.client.1.smithi060.stdout:3/65: dread d0/fa [0,4194304] 0 2023-10-18T20:58:18.358 INFO:tasks.workunit.client.0.smithi008.stdout:8/167: creat d5/d8/d17/d4d/f4f x:0 0 0 2023-10-18T20:58:18.358 INFO:tasks.workunit.client.0.smithi008.stdout:8/168: truncate d5/f37 5268988 0 2023-10-18T20:58:18.358 INFO:tasks.workunit.client.0.smithi008.stdout:5/69: rmdir d0 39 2023-10-18T20:58:18.359 INFO:tasks.workunit.client.0.smithi008.stdout:5/70: truncate d0/f8 1512587 0 2023-10-18T20:58:18.360 INFO:tasks.workunit.client.0.smithi008.stdout:0/100: unlink d0/dd/df/f12 0 2023-10-18T20:58:18.362 INFO:tasks.workunit.client.1.smithi060.stdout:1/132: getdents d4/d6/d14 0 2023-10-18T20:58:18.363 INFO:tasks.workunit.client.1.smithi060.stdout:5/148: creat d0/d6/d8/df/d27/d32/f39 x:0 0 0 2023-10-18T20:58:18.364 INFO:tasks.workunit.client.0.smithi008.stdout:1/249: dwrite d9/de/f45 [0,4194304] 0 2023-10-18T20:58:18.364 INFO:tasks.workunit.client.1.smithi060.stdout:9/55: dwrite d3/f4 [0,4194304] 0 2023-10-18T20:58:18.370 INFO:tasks.workunit.client.1.smithi060.stdout:4/31: unlink d4/fa 0 2023-10-18T20:58:18.370 INFO:tasks.workunit.client.1.smithi060.stdout:8/86: rename d4/fc to d4/f19 0 2023-10-18T20:58:18.371 INFO:tasks.workunit.client.1.smithi060.stdout:0/103: mknod d3/c1f 0 2023-10-18T20:58:18.371 INFO:tasks.workunit.client.1.smithi060.stdout:0/104: chown d3/d8/d14/f1c 87 1 2023-10-18T20:58:18.371 INFO:tasks.workunit.client.1.smithi060.stdout:0/105: fdatasync d3/f17 0 2023-10-18T20:58:18.372 INFO:tasks.workunit.client.0.smithi008.stdout:0/101: rmdir d0/dd/d16 0 2023-10-18T20:58:18.372 INFO:tasks.workunit.client.0.smithi008.stdout:0/102: chown d0/dd 2 1 2023-10-18T20:58:18.374 INFO:tasks.workunit.client.0.smithi008.stdout:7/97: dwrite d1/f4 [0,4194304] 0 2023-10-18T20:58:18.375 INFO:tasks.workunit.client.0.smithi008.stdout:7/98: stat d1/l1e 0 2023-10-18T20:58:18.376 INFO:tasks.workunit.client.1.smithi060.stdout:1/133: dread f1 [0,4194304] 0 2023-10-18T20:58:18.385 INFO:tasks.workunit.client.0.smithi008.stdout:4/110: dwrite d0/d3/d8/fa [0,4194304] 0 2023-10-18T20:58:18.396 INFO:tasks.workunit.client.0.smithi008.stdout:1/250: read d9/fc [1731840,76288] 0 2023-10-18T20:58:18.396 INFO:tasks.workunit.client.0.smithi008.stdout:1/251: dread - d9/de/df/d17/d25/f44 zero size 2023-10-18T20:58:18.404 INFO:tasks.workunit.client.1.smithi060.stdout:5/149: link d0/d6/d8/df/d27/c36 d0/d6/d8/df/d27/c3a 0 2023-10-18T20:58:18.407 INFO:tasks.workunit.client.0.smithi008.stdout:5/71: dread d0/f8 [0,4194304] 0 2023-10-18T20:58:18.407 INFO:tasks.workunit.client.0.smithi008.stdout:5/72: fdatasync d0/d2/d9/f11 0 2023-10-18T20:58:18.407 INFO:tasks.workunit.client.0.smithi008.stdout:5/73: stat d0/d2/d9 0 2023-10-18T20:58:18.408 INFO:tasks.workunit.client.0.smithi008.stdout:8/169: getdents d5/d8/d17 0 2023-10-18T20:58:18.408 INFO:tasks.workunit.client.0.smithi008.stdout:8/170: stat d5/d8/d17/l3f 0 2023-10-18T20:58:18.409 INFO:tasks.workunit.client.1.smithi060.stdout:4/32: write f2 [2876594,4371] 0 2023-10-18T20:58:18.410 INFO:tasks.workunit.client.1.smithi060.stdout:6/26: dwrite f0 [0,4194304] 0 2023-10-18T20:58:18.415 INFO:tasks.workunit.client.0.smithi008.stdout:0/103: truncate d0/f14 1361869 0 2023-10-18T20:58:18.417 INFO:tasks.workunit.client.1.smithi060.stdout:9/56: symlink d3/d10/l15 0 2023-10-18T20:58:18.417 INFO:tasks.workunit.client.1.smithi060.stdout:8/87: mknod d4/c1a 0 2023-10-18T20:58:18.420 INFO:tasks.workunit.client.1.smithi060.stdout:3/66: dwrite d0/fe [0,4194304] 0 2023-10-18T20:58:18.434 INFO:tasks.workunit.client.1.smithi060.stdout:0/106: creat d3/d8/f20 x:0 0 0 2023-10-18T20:58:18.434 INFO:tasks.workunit.client.1.smithi060.stdout:0/107: truncate d3/f17 9167161 0 2023-10-18T20:58:18.434 INFO:tasks.workunit.client.1.smithi060.stdout:0/108: write d3/fc [1082071,128041] 0 2023-10-18T20:58:18.435 INFO:tasks.workunit.client.0.smithi008.stdout:9/111: dwrite d2/dc/f15 [0,4194304] 0 2023-10-18T20:58:18.438 INFO:tasks.workunit.client.1.smithi060.stdout:1/134: rename d4/da/de/f27 to d4/f2d 0 2023-10-18T20:58:18.440 INFO:tasks.workunit.client.0.smithi008.stdout:7/99: creat d1/f1f x:0 0 0 2023-10-18T20:58:18.440 INFO:tasks.workunit.client.0.smithi008.stdout:7/100: fsync d1/f4 0 2023-10-18T20:58:18.445 INFO:tasks.workunit.client.0.smithi008.stdout:1/252: mknod d9/de/df/d17/d1e/d3c/c4e 0 2023-10-18T20:58:18.445 INFO:tasks.workunit.client.0.smithi008.stdout:1/253: chown d9/l4d 210488 1 2023-10-18T20:58:18.452 INFO:tasks.workunit.client.0.smithi008.stdout:5/74: rmdir d0 39 2023-10-18T20:58:18.453 INFO:tasks.workunit.client.0.smithi008.stdout:8/171: mkdir d5/d8/d24/d50 0 2023-10-18T20:58:18.453 INFO:tasks.workunit.client.0.smithi008.stdout:8/172: fsync d5/d8/df/d2e/f43 0 2023-10-18T20:58:18.455 INFO:tasks.workunit.client.0.smithi008.stdout:0/104: symlink d0/dd/df/l1b 0 2023-10-18T20:58:18.455 INFO:tasks.workunit.client.0.smithi008.stdout:0/105: stat d0/dd/f1a 0 2023-10-18T20:58:18.458 INFO:tasks.workunit.client.1.smithi060.stdout:9/57: dwrite d3/f7 [0,4194304] 0 2023-10-18T20:58:18.469 INFO:tasks.workunit.client.1.smithi060.stdout:1/135: symlink d4/d6/l2e 0 2023-10-18T20:58:18.469 INFO:tasks.workunit.client.1.smithi060.stdout:1/136: fsync d4/d6/f1f 0 2023-10-18T20:58:18.469 INFO:tasks.workunit.client.1.smithi060.stdout:1/137: write d4/d6/d7/df/f2c [1825872,43567] 0 2023-10-18T20:58:18.470 INFO:tasks.workunit.client.1.smithi060.stdout:4/33: dwrite f2 [0,4194304] 0 2023-10-18T20:58:18.471 INFO:tasks.workunit.client.1.smithi060.stdout:5/150: mkdir d0/da/d3b 0 2023-10-18T20:58:18.482 INFO:tasks.workunit.client.1.smithi060.stdout:7/81: sync 2023-10-18T20:58:18.482 INFO:tasks.workunit.client.1.smithi060.stdout:2/71: sync 2023-10-18T20:58:18.483 INFO:tasks.workunit.client.1.smithi060.stdout:7/82: dread - de/d14/f16 zero size 2023-10-18T20:58:18.483 INFO:tasks.workunit.client.1.smithi060.stdout:2/72: creat d0/d8/f1b x:0 0 0 2023-10-18T20:58:18.483 INFO:tasks.workunit.client.1.smithi060.stdout:2/73: truncate d0/d8/fa 2290229 0 2023-10-18T20:58:18.484 INFO:tasks.workunit.client.0.smithi008.stdout:7/101: mkdir d1/d3/d20 0 2023-10-18T20:58:18.487 INFO:tasks.workunit.client.1.smithi060.stdout:2/74: dread d0/d8/fc [0,4194304] 0 2023-10-18T20:58:18.487 INFO:tasks.workunit.client.1.smithi060.stdout:2/75: creat d0/d16/f1c x:0 0 0 2023-10-18T20:58:18.488 INFO:tasks.workunit.client.0.smithi008.stdout:1/254: unlink d9/l1f 0 2023-10-18T20:58:18.488 INFO:tasks.workunit.client.0.smithi008.stdout:1/255: creat d9/f4f x:0 0 0 2023-10-18T20:58:18.488 INFO:tasks.workunit.client.0.smithi008.stdout:1/256: stat d9/de/df/f10 0 2023-10-18T20:58:18.489 INFO:tasks.workunit.client.0.smithi008.stdout:1/257: fdatasync d9/de/f45 0 2023-10-18T20:58:18.490 INFO:tasks.workunit.client.0.smithi008.stdout:3/91: sync 2023-10-18T20:58:18.490 INFO:tasks.workunit.client.0.smithi008.stdout:2/126: sync 2023-10-18T20:58:18.490 INFO:tasks.workunit.client.0.smithi008.stdout:2/127: creat d1/d3/dd/d1c/f2d x:0 0 0 2023-10-18T20:58:18.491 INFO:tasks.workunit.client.1.smithi060.stdout:0/109: dwrite d3/f19 [0,4194304] 0 2023-10-18T20:58:18.491 INFO:tasks.workunit.client.0.smithi008.stdout:8/173: mknod d5/d8/df/c51 0 2023-10-18T20:58:18.492 INFO:tasks.workunit.client.0.smithi008.stdout:8/174: write d5/d8/df/f3a [908186,108206] 0 2023-10-18T20:58:18.492 INFO:tasks.workunit.client.1.smithi060.stdout:3/67: getdents d0 0 2023-10-18T20:58:18.492 INFO:tasks.workunit.client.1.smithi060.stdout:1/138: rmdir d4/d6/d14 39 2023-10-18T20:58:18.492 INFO:tasks.workunit.client.1.smithi060.stdout:5/151: write d0/d6/d8/f1b [2106241,108371] 0 2023-10-18T20:58:18.493 INFO:tasks.workunit.client.0.smithi008.stdout:9/112: truncate d2/d8/f9 346426 0 2023-10-18T20:58:18.493 INFO:tasks.workunit.client.1.smithi060.stdout:4/34: mknod d4/d5/cb 0 2023-10-18T20:58:18.498 INFO:tasks.workunit.client.1.smithi060.stdout:7/83: creat de/f19 x:0 0 0 2023-10-18T20:58:18.498 INFO:tasks.workunit.client.1.smithi060.stdout:7/84: creat de/f1a x:0 0 0 2023-10-18T20:58:18.500 INFO:tasks.workunit.client.0.smithi008.stdout:1/258: rename f2 to d9/de/df/d17/f50 0 2023-10-18T20:58:18.500 INFO:tasks.workunit.client.0.smithi008.stdout:1/259: chown d9/de/df/d17/d25/f29 1 1 2023-10-18T20:58:18.501 INFO:tasks.workunit.client.0.smithi008.stdout:5/75: getdents d0 0 2023-10-18T20:58:18.501 INFO:tasks.workunit.client.0.smithi008.stdout:3/92: mknod d0/d3/d15/c1b 0 2023-10-18T20:58:18.502 INFO:tasks.workunit.client.1.smithi060.stdout:9/58: truncate d3/f4 251998 0 2023-10-18T20:58:18.502 INFO:tasks.workunit.client.1.smithi060.stdout:9/59: readlink d3/l12 0 2023-10-18T20:58:18.505 INFO:tasks.workunit.client.0.smithi008.stdout:8/175: mknod d5/d8/d24/c52 0 2023-10-18T20:58:18.505 INFO:tasks.workunit.client.0.smithi008.stdout:8/176: truncate d5/d8/f41 376373 0 2023-10-18T20:58:18.509 INFO:tasks.workunit.client.0.smithi008.stdout:2/128: rename l0 to d1/d3/dd/l2e 0 2023-10-18T20:58:18.509 INFO:tasks.workunit.client.0.smithi008.stdout:2/129: creat d1/d3/dd/d25/f2f x:0 0 0 2023-10-18T20:58:18.510 INFO:tasks.workunit.client.0.smithi008.stdout:2/130: creat d1/d3/dd/d25/f30 x:0 0 0 2023-10-18T20:58:18.510 INFO:tasks.workunit.client.0.smithi008.stdout:2/131: chown d1/d3/dd/c14 2311232 1 2023-10-18T20:58:18.511 INFO:tasks.workunit.client.0.smithi008.stdout:1/260: truncate d9/de/df/d17/d25/f29 2920484 0 2023-10-18T20:58:18.511 INFO:tasks.workunit.client.0.smithi008.stdout:1/261: creat d9/f51 x:0 0 0 2023-10-18T20:58:18.512 INFO:tasks.workunit.client.0.smithi008.stdout:1/262: dread - d9/de/df/d17/d25/f3d zero size 2023-10-18T20:58:18.512 INFO:tasks.workunit.client.0.smithi008.stdout:1/263: fdatasync d9/f51 0 2023-10-18T20:58:18.512 INFO:tasks.workunit.client.1.smithi060.stdout:0/110: creat d3/f21 x:0 0 0 2023-10-18T20:58:18.512 INFO:tasks.workunit.client.1.smithi060.stdout:3/68: creat d0/f16 x:0 0 0 2023-10-18T20:58:18.513 INFO:tasks.workunit.client.0.smithi008.stdout:9/113: dread d2/dc/f15 [0,4194304] 0 2023-10-18T20:58:18.513 INFO:tasks.workunit.client.0.smithi008.stdout:9/114: truncate d2/f3 4392898 0 2023-10-18T20:58:18.514 INFO:tasks.workunit.client.0.smithi008.stdout:5/76: mknod d0/de/c18 0 2023-10-18T20:58:18.514 INFO:tasks.workunit.client.0.smithi008.stdout:5/77: write d0/d2/f12 [62111,83646] 0 2023-10-18T20:58:18.515 INFO:tasks.workunit.client.1.smithi060.stdout:1/139: mkdir d4/d6/d7/d2f 0 2023-10-18T20:58:18.516 INFO:tasks.workunit.client.0.smithi008.stdout:8/177: mkdir d5/d8/d24/d50/d53 0 2023-10-18T20:58:18.516 INFO:tasks.workunit.client.0.smithi008.stdout:8/178: fdatasync d5/d8/d17/d36/f46 0 2023-10-18T20:58:18.525 INFO:tasks.workunit.client.1.smithi060.stdout:1/140: read d4/f8 [252153,59319] 0 2023-10-18T20:58:18.526 INFO:tasks.workunit.client.0.smithi008.stdout:3/93: rename d0/d3/de/f14 to d0/d3/de/d13/f1c 0 2023-10-18T20:58:18.526 INFO:tasks.workunit.client.0.smithi008.stdout:3/94: chown d0/d3/de/f17 96 1 2023-10-18T20:58:18.527 INFO:tasks.workunit.client.1.smithi060.stdout:5/152: truncate d0/d6/d8/f11 2612518 0 2023-10-18T20:58:18.528 INFO:tasks.workunit.client.1.smithi060.stdout:5/153: creat d0/d6/d8/df/d27/f3c x:0 0 0 2023-10-18T20:58:18.529 INFO:tasks.workunit.client.1.smithi060.stdout:6/27: dwrite f0 [4194304,4194304] 0 2023-10-18T20:58:18.530 INFO:tasks.workunit.client.1.smithi060.stdout:2/76: dwrite d0/d8/f11 [0,4194304] 0 2023-10-18T20:58:18.530 INFO:tasks.workunit.client.1.smithi060.stdout:2/77: write d0/d8/f1b [589410,18483] 0 2023-10-18T20:58:18.531 INFO:tasks.workunit.client.1.smithi060.stdout:2/78: creat d0/d8/f1d x:0 0 0 2023-10-18T20:58:18.531 INFO:tasks.workunit.client.1.smithi060.stdout:4/35: mkdir d4/dc 0 2023-10-18T20:58:18.532 INFO:tasks.workunit.client.0.smithi008.stdout:2/132: symlink d1/d3/dd/l31 0 2023-10-18T20:58:18.536 INFO:tasks.workunit.client.1.smithi060.stdout:1/141: dread d4/d6/d7/df/f15 [0,4194304] 0 2023-10-18T20:58:18.536 INFO:tasks.workunit.client.1.smithi060.stdout:1/142: creat d4/da/db/dd/f30 x:0 0 0 2023-10-18T20:58:18.537 INFO:tasks.workunit.client.1.smithi060.stdout:1/143: write d4/f8 [4606935,125624] 0 2023-10-18T20:58:18.537 INFO:tasks.workunit.client.1.smithi060.stdout:7/85: mkdir de/d14/d1b 0 2023-10-18T20:58:18.537 INFO:tasks.workunit.client.1.smithi060.stdout:9/60: mknod d3/c16 0 2023-10-18T20:58:18.542 INFO:tasks.workunit.client.0.smithi008.stdout:1/264: mkdir d9/de/df/d17/d52 0 2023-10-18T20:58:18.542 INFO:tasks.workunit.client.0.smithi008.stdout:1/265: creat d9/f53 x:0 0 0 2023-10-18T20:58:18.542 INFO:tasks.workunit.client.0.smithi008.stdout:1/266: creat d9/f54 x:0 0 0 2023-10-18T20:58:18.543 INFO:tasks.workunit.client.1.smithi060.stdout:3/69: unlink d0/l7 0 2023-10-18T20:58:18.553 INFO:tasks.workunit.client.0.smithi008.stdout:9/115: mkdir d2/dc/d1a 0 2023-10-18T20:58:18.558 INFO:tasks.workunit.client.1.smithi060.stdout:0/111: creat d3/d8/f22 x:0 0 0 2023-10-18T20:58:18.562 INFO:tasks.workunit.client.1.smithi060.stdout:5/154: creat d0/dd/d33/f3d x:0 0 0 2023-10-18T20:58:18.564 INFO:tasks.workunit.client.0.smithi008.stdout:2/133: truncate d1/d3/f1b 405968 0 2023-10-18T20:58:18.565 INFO:tasks.workunit.client.0.smithi008.stdout:9/116: dread d2/f5 [0,4194304] 0 2023-10-18T20:58:18.566 INFO:tasks.workunit.client.0.smithi008.stdout:9/117: creat d2/f1b x:0 0 0 2023-10-18T20:58:18.570 INFO:tasks.workunit.client.0.smithi008.stdout:3/95: dwrite d0/d3/de/f10 [0,4194304] 0 2023-10-18T20:58:18.578 INFO:tasks.workunit.client.1.smithi060.stdout:7/86: dwrite fc [0,4194304] 0 2023-10-18T20:58:18.578 INFO:tasks.workunit.client.1.smithi060.stdout:7/87: chown de/f19 169 1 2023-10-18T20:58:18.579 INFO:tasks.workunit.client.0.smithi008.stdout:8/179: dwrite d5/d8/d17/f44 [4194304,4194304] 0 2023-10-18T20:58:18.582 INFO:tasks.workunit.client.0.smithi008.stdout:1/267: mkdir d9/de/df/d17/d55 0 2023-10-18T20:58:18.585 INFO:tasks.workunit.client.0.smithi008.stdout:3/96: dread d0/d3/d15/f1a [0,4194304] 0 2023-10-18T20:58:18.585 INFO:tasks.workunit.client.0.smithi008.stdout:3/97: fsync d0/d3/fd 0 2023-10-18T20:58:18.588 INFO:tasks.workunit.client.1.smithi060.stdout:6/28: link f1 f8 0 2023-10-18T20:58:18.591 INFO:tasks.workunit.client.0.smithi008.stdout:8/180: mkdir d5/d8/df/d54 0 2023-10-18T20:58:18.593 INFO:tasks.workunit.client.0.smithi008.stdout:2/134: getdents d1/d3 0 2023-10-18T20:58:18.593 INFO:tasks.workunit.client.1.smithi060.stdout:4/36: mknod d4/dc/cd 0 2023-10-18T20:58:18.595 INFO:tasks.workunit.client.0.smithi008.stdout:8/181: mknod d5/d8/d17/d4d/c55 0 2023-10-18T20:58:18.600 INFO:tasks.workunit.client.0.smithi008.stdout:2/135: symlink d1/l32 0 2023-10-18T20:58:18.602 INFO:tasks.workunit.client.0.smithi008.stdout:8/182: unlink d5/d8/lc 0 2023-10-18T20:58:18.602 INFO:tasks.workunit.client.1.smithi060.stdout:4/37: dread d4/d5/f7 [0,4194304] 0 2023-10-18T20:58:18.603 INFO:tasks.workunit.client.1.smithi060.stdout:9/61: symlink d3/d10/l17 0 2023-10-18T20:58:18.603 INFO:tasks.workunit.client.0.smithi008.stdout:2/136: link d1/l6 d1/d3/l33 0 2023-10-18T20:58:18.604 INFO:tasks.workunit.client.0.smithi008.stdout:2/137: fdatasync d1/d3/dd/d25/f2b 0 2023-10-18T20:58:18.604 INFO:tasks.workunit.client.1.smithi060.stdout:3/70: symlink d0/l17 0 2023-10-18T20:58:18.605 INFO:tasks.workunit.client.1.smithi060.stdout:3/71: read - d0/f15 zero size 2023-10-18T20:58:18.605 INFO:tasks.workunit.client.0.smithi008.stdout:8/183: rename d5/f1c to d5/f56 0 2023-10-18T20:58:18.608 INFO:tasks.workunit.client.0.smithi008.stdout:2/138: mkdir d1/d3/dd/d25/d34 0 2023-10-18T20:58:18.608 INFO:tasks.workunit.client.1.smithi060.stdout:7/88: symlink de/l1c 0 2023-10-18T20:58:18.609 INFO:tasks.workunit.client.1.smithi060.stdout:6/29: mknod c9 0 2023-10-18T20:58:18.611 INFO:tasks.workunit.client.1.smithi060.stdout:8/88: sync 2023-10-18T20:58:18.611 INFO:tasks.workunit.client.1.smithi060.stdout:8/89: fdatasync d4/f19 0 2023-10-18T20:58:18.612 INFO:tasks.workunit.client.1.smithi060.stdout:2/79: mkdir d0/d3/d1e 0 2023-10-18T20:58:18.612 INFO:tasks.workunit.client.1.smithi060.stdout:4/38: mknod d4/ce 0 2023-10-18T20:58:18.612 INFO:tasks.workunit.client.1.smithi060.stdout:2/80: write d0/d8/fd [1020948,81266] 0 2023-10-18T20:58:18.612 INFO:tasks.workunit.client.1.smithi060.stdout:4/39: write d4/d5/f7 [661893,90153] 0 2023-10-18T20:58:18.613 INFO:tasks.workunit.client.1.smithi060.stdout:8/90: getdents d4/d9 0 2023-10-18T20:58:18.613 INFO:tasks.workunit.client.1.smithi060.stdout:8/91: chown d4/d9/c12 112068 1 2023-10-18T20:58:18.616 INFO:tasks.workunit.client.1.smithi060.stdout:8/92: unlink d4/d9/c12 0 2023-10-18T20:58:18.616 INFO:tasks.workunit.client.0.smithi008.stdout:2/139: dread d1/d3/dd/d25/f27 [0,4194304] 0 2023-10-18T20:58:18.618 INFO:tasks.workunit.client.0.smithi008.stdout:8/184: write d5/d8/f12 [3270789,86499] 0 2023-10-18T20:58:18.619 INFO:tasks.workunit.client.0.smithi008.stdout:8/185: chown d5/d8/df/l30 65 1 2023-10-18T20:58:18.620 INFO:tasks.workunit.client.1.smithi060.stdout:2/81: dread d0/d8/fa [0,4194304] 0 2023-10-18T20:58:18.621 INFO:tasks.workunit.client.1.smithi060.stdout:3/72: getdents d0 0 2023-10-18T20:58:18.623 INFO:tasks.workunit.client.1.smithi060.stdout:9/62: dread d3/f7 [0,4194304] 0 2023-10-18T20:58:18.623 INFO:tasks.workunit.client.1.smithi060.stdout:9/63: chown d3 7613 1 2023-10-18T20:58:18.623 INFO:tasks.workunit.client.1.smithi060.stdout:9/64: truncate d3/f9 926340 0 2023-10-18T20:58:18.624 INFO:tasks.workunit.client.1.smithi060.stdout:9/65: fdatasync d3/f4 0 2023-10-18T20:58:18.625 INFO:tasks.workunit.client.1.smithi060.stdout:1/144: sync 2023-10-18T20:58:18.625 INFO:tasks.workunit.client.0.smithi008.stdout:6/149: sync 2023-10-18T20:58:18.625 INFO:tasks.workunit.client.0.smithi008.stdout:6/150: write fd [486113,66595] 0 2023-10-18T20:58:18.626 INFO:tasks.workunit.client.0.smithi008.stdout:6/151: getdents df/d15/d33 0 2023-10-18T20:58:18.628 INFO:tasks.workunit.client.1.smithi060.stdout:8/93: creat d4/d9/f1b x:0 0 0 2023-10-18T20:58:18.630 INFO:tasks.workunit.client.0.smithi008.stdout:2/140: mknod d1/d3/dd/d25/d34/c35 0 2023-10-18T20:58:18.630 INFO:tasks.workunit.client.0.smithi008.stdout:2/141: truncate d1/d3/dd/d25/f2f 123762 0 2023-10-18T20:58:18.633 INFO:tasks.workunit.client.1.smithi060.stdout:4/40: dread f2 [0,4194304] 0 2023-10-18T20:58:18.633 INFO:tasks.workunit.client.1.smithi060.stdout:4/41: write d4/d5/f7 [390495,91113] 0 2023-10-18T20:58:18.634 INFO:tasks.workunit.client.1.smithi060.stdout:3/73: rename d0/f15 to d0/f18 0 2023-10-18T20:58:18.635 INFO:tasks.workunit.client.1.smithi060.stdout:6/30: write f7 [6887970,2451] 0 2023-10-18T20:58:18.638 INFO:tasks.workunit.client.1.smithi060.stdout:9/66: rename f1 to d3/d10/f18 0 2023-10-18T20:58:18.639 INFO:tasks.workunit.client.1.smithi060.stdout:2/82: dread d0/f12 [0,4194304] 0 2023-10-18T20:58:18.639 INFO:tasks.workunit.client.0.smithi008.stdout:8/186: link d5/d8/d24/c49 d5/d8/d17/d4d/c57 0 2023-10-18T20:58:18.640 INFO:tasks.workunit.client.1.smithi060.stdout:8/94: symlink d4/l1c 0 2023-10-18T20:58:18.640 INFO:tasks.workunit.client.1.smithi060.stdout:8/95: chown d4/d9 253 1 2023-10-18T20:58:18.641 INFO:tasks.workunit.client.0.smithi008.stdout:2/142: symlink d1/d3/dd/l36 0 2023-10-18T20:58:18.641 INFO:tasks.workunit.client.0.smithi008.stdout:2/143: dread - d1/f19 zero size 2023-10-18T20:58:18.643 INFO:tasks.workunit.client.1.smithi060.stdout:1/145: dread d4/da/f1c [0,4194304] 0 2023-10-18T20:58:18.643 INFO:tasks.workunit.client.1.smithi060.stdout:1/146: write d4/da/db/dd/f25 [851552,108350] 0 2023-10-18T20:58:18.643 INFO:tasks.workunit.client.1.smithi060.stdout:4/42: mkdir d4/df 0 2023-10-18T20:58:18.644 INFO:tasks.workunit.client.1.smithi060.stdout:4/43: write d4/d5/f7 [6553748,111575] 0 2023-10-18T20:58:18.644 INFO:tasks.workunit.client.1.smithi060.stdout:3/74: rmdir d0 39 2023-10-18T20:58:18.645 INFO:tasks.workunit.client.1.smithi060.stdout:3/75: dread - d0/ff zero size 2023-10-18T20:58:18.645 INFO:tasks.workunit.client.1.smithi060.stdout:7/89: dwrite de/ff [0,4194304] 0 2023-10-18T20:58:18.646 INFO:tasks.workunit.client.0.smithi008.stdout:6/152: read df/d18/f2d [2493151,63846] 0 2023-10-18T20:58:18.647 INFO:tasks.workunit.client.0.smithi008.stdout:8/187: mkdir d5/d8/df/d54/d58 0 2023-10-18T20:58:18.649 INFO:tasks.workunit.client.1.smithi060.stdout:6/31: link f7 fa 0 2023-10-18T20:58:18.655 INFO:tasks.workunit.client.0.smithi008.stdout:2/144: rename d1/d3/dd/d1c/c22 to d1/c37 0 2023-10-18T20:58:18.655 INFO:tasks.workunit.client.0.smithi008.stdout:2/145: creat d1/d3/dd/f38 x:0 0 0 2023-10-18T20:58:18.655 INFO:tasks.workunit.client.0.smithi008.stdout:2/146: readlink d1/d3/dd/l31 0 2023-10-18T20:58:18.656 INFO:tasks.workunit.client.0.smithi008.stdout:2/147: dread - d1/d3/f20 zero size 2023-10-18T20:58:18.656 INFO:tasks.workunit.client.1.smithi060.stdout:9/67: mkdir d3/d10/d19 0 2023-10-18T20:58:18.658 INFO:tasks.workunit.client.1.smithi060.stdout:2/83: symlink d0/d16/l1f 0 2023-10-18T20:58:18.658 INFO:tasks.workunit.client.1.smithi060.stdout:2/84: write d0/d8/f1d [1048067,59944] 0 2023-10-18T20:58:18.659 INFO:tasks.workunit.client.0.smithi008.stdout:6/153: truncate df/d18/f2d 1228275 0 2023-10-18T20:58:18.660 INFO:tasks.workunit.client.0.smithi008.stdout:8/188: rename d5/d8/d17/f48 to d5/d8/d24/f59 0 2023-10-18T20:58:18.660 INFO:tasks.workunit.client.0.smithi008.stdout:8/189: write d5/d8/d17/f1d [12534,72694] 0 2023-10-18T20:58:18.660 INFO:tasks.workunit.client.1.smithi060.stdout:8/96: symlink d4/l1d 0 2023-10-18T20:58:18.661 INFO:tasks.workunit.client.0.smithi008.stdout:8/190: creat d5/d8/f5a x:0 0 0 2023-10-18T20:58:18.661 INFO:tasks.workunit.client.0.smithi008.stdout:8/191: chown d5/l7 59 1 2023-10-18T20:58:18.664 INFO:tasks.workunit.client.1.smithi060.stdout:1/147: mknod d4/d6/d7/df/c31 0 2023-10-18T20:58:18.665 INFO:tasks.workunit.client.0.smithi008.stdout:2/148: mkdir d1/d3/dd/d1c/d39 0 2023-10-18T20:58:18.667 INFO:tasks.workunit.client.1.smithi060.stdout:4/44: unlink f2 0 2023-10-18T20:58:18.668 INFO:tasks.workunit.client.0.smithi008.stdout:8/192: getdents d5/d8/df/d54 0 2023-10-18T20:58:18.670 INFO:tasks.workunit.client.0.smithi008.stdout:2/149: mkdir d1/d3/dd/d1c/d3a 0 2023-10-18T20:58:18.675 INFO:tasks.workunit.client.0.smithi008.stdout:8/193: symlink d5/d8/d24/d50/l5b 0 2023-10-18T20:58:18.675 INFO:tasks.workunit.client.0.smithi008.stdout:8/194: readlink d5/l10 0 2023-10-18T20:58:18.676 INFO:tasks.workunit.client.0.smithi008.stdout:2/150: creat d1/d3/dd/d25/d34/f3b x:0 0 0 2023-10-18T20:58:18.678 INFO:tasks.workunit.client.1.smithi060.stdout:3/76: creat d0/f19 x:0 0 0 2023-10-18T20:58:18.678 INFO:tasks.workunit.client.1.smithi060.stdout:3/77: readlink d0/l13 0 2023-10-18T20:58:18.680 INFO:tasks.workunit.client.0.smithi008.stdout:2/151: rename d1/d3/f1f to d1/d3/dd/d1c/f3c 0 2023-10-18T20:58:18.681 INFO:tasks.workunit.client.1.smithi060.stdout:7/90: mkdir de/d14/d1d 0 2023-10-18T20:58:18.681 INFO:tasks.workunit.client.1.smithi060.stdout:7/91: fdatasync fc 0 2023-10-18T20:58:18.682 INFO:tasks.workunit.client.1.smithi060.stdout:9/68: mknod d3/d10/c1a 0 2023-10-18T20:58:18.684 INFO:tasks.workunit.client.1.smithi060.stdout:2/85: symlink d0/d8/l20 0 2023-10-18T20:58:18.684 INFO:tasks.workunit.client.1.smithi060.stdout:9/69: read d3/d10/f11 [3499,44959] 0 2023-10-18T20:58:18.684 INFO:tasks.workunit.client.1.smithi060.stdout:9/70: write d3/d10/fe [81434,68657] 0 2023-10-18T20:58:18.684 INFO:tasks.workunit.client.1.smithi060.stdout:9/71: fdatasync f0 0 2023-10-18T20:58:18.684 INFO:tasks.workunit.client.1.smithi060.stdout:9/72: readlink d3/l12 0 2023-10-18T20:58:18.685 INFO:tasks.workunit.client.1.smithi060.stdout:9/73: unlink d3/cb 0 2023-10-18T20:58:18.685 INFO:tasks.workunit.client.0.smithi008.stdout:2/152: chown d1/d3/dd/d1c/l24 17 1 2023-10-18T20:58:18.685 INFO:tasks.workunit.client.1.smithi060.stdout:2/86: getdents d0/d3 0 2023-10-18T20:58:18.686 INFO:tasks.workunit.client.1.smithi060.stdout:2/87: getdents d0/d3 0 2023-10-18T20:58:18.687 INFO:tasks.workunit.client.1.smithi060.stdout:9/74: fdatasync d3/d10/fe 0 2023-10-18T20:58:18.688 INFO:tasks.workunit.client.1.smithi060.stdout:9/75: getdents d3/d10/d19 0 2023-10-18T20:58:18.688 INFO:tasks.workunit.client.1.smithi060.stdout:9/76: creat d3/f1b x:0 0 0 2023-10-18T20:58:18.688 INFO:tasks.workunit.client.1.smithi060.stdout:9/77: chown d3/f1b 1 1 2023-10-18T20:58:18.695 INFO:tasks.workunit.client.1.smithi060.stdout:3/78: dread d0/f12 [0,4194304] 0 2023-10-18T20:58:18.695 INFO:tasks.workunit.client.1.smithi060.stdout:2/88: rmdir d0/d3/d1e 0 2023-10-18T20:58:18.696 INFO:tasks.workunit.client.1.smithi060.stdout:7/92: write fc [1894419,82878] 0 2023-10-18T20:58:18.701 INFO:tasks.workunit.client.1.smithi060.stdout:9/78: unlink d3/d10/l15 0 2023-10-18T20:58:18.701 INFO:tasks.workunit.client.1.smithi060.stdout:9/79: chown d3/d10 151006 1 2023-10-18T20:58:18.702 INFO:tasks.workunit.client.1.smithi060.stdout:9/80: readlink d3/l13 0 2023-10-18T20:58:18.702 INFO:tasks.workunit.client.1.smithi060.stdout:9/81: write d3/d10/f18 [697292,12235] 0 2023-10-18T20:58:18.705 INFO:tasks.workunit.client.1.smithi060.stdout:2/89: getdents d0/d16 0 2023-10-18T20:58:18.706 INFO:tasks.workunit.client.1.smithi060.stdout:3/79: dread d0/f2 [0,4194304] 0 2023-10-18T20:58:18.713 INFO:tasks.workunit.client.1.smithi060.stdout:6/32: dwrite f1 [0,4194304] 0 2023-10-18T20:58:18.713 INFO:tasks.workunit.client.1.smithi060.stdout:6/33: creat fb x:0 0 0 2023-10-18T20:58:18.714 INFO:tasks.workunit.client.0.smithi008.stdout:2/153: dread d1/d3/dd/d25/f27 [0,4194304] 0 2023-10-18T20:58:18.719 INFO:tasks.workunit.client.1.smithi060.stdout:8/97: dwrite d4/f19 [0,4194304] 0 2023-10-18T20:58:18.719 INFO:tasks.workunit.client.1.smithi060.stdout:8/98: truncate d4/f5 1541844 0 2023-10-18T20:58:18.724 INFO:tasks.workunit.client.1.smithi060.stdout:9/82: dread d3/d10/f14 [0,4194304] 0 2023-10-18T20:58:18.724 INFO:tasks.workunit.client.1.smithi060.stdout:3/80: mknod d0/c1a 0 2023-10-18T20:58:18.727 INFO:tasks.workunit.client.1.smithi060.stdout:7/93: getdents de/d14 0 2023-10-18T20:58:18.734 INFO:tasks.workunit.client.1.smithi060.stdout:1/148: dwrite d4/da/f1c [0,4194304] 0 2023-10-18T20:58:18.735 INFO:tasks.workunit.client.1.smithi060.stdout:9/83: mkdir d3/d10/d1c 0 2023-10-18T20:58:18.736 INFO:tasks.workunit.client.1.smithi060.stdout:3/81: rename d0/f16 to d0/f1b 0 2023-10-18T20:58:18.742 INFO:tasks.workunit.client.1.smithi060.stdout:9/84: link d3/d10/f11 d3/d10/d1c/f1d 0 2023-10-18T20:58:18.742 INFO:tasks.workunit.client.1.smithi060.stdout:9/85: write d3/f1b [462740,106732] 0 2023-10-18T20:58:18.743 INFO:tasks.workunit.client.1.smithi060.stdout:9/86: stat d3/d10/d19 0 2023-10-18T20:58:18.743 INFO:tasks.workunit.client.1.smithi060.stdout:9/87: stat f2 0 2023-10-18T20:58:18.743 INFO:tasks.workunit.client.1.smithi060.stdout:4/45: dread d4/d5/f7 [4194304,4194304] 0 2023-10-18T20:58:18.745 INFO:tasks.workunit.client.1.smithi060.stdout:4/46: truncate d4/d5/f7 1678856 0 2023-10-18T20:58:18.745 INFO:tasks.workunit.client.1.smithi060.stdout:4/47: creat d4/f10 x:0 0 0 2023-10-18T20:58:18.746 INFO:tasks.workunit.client.1.smithi060.stdout:4/48: write d4/f10 [223758,11113] 0 2023-10-18T20:58:18.747 INFO:tasks.workunit.client.1.smithi060.stdout:0/112: sync 2023-10-18T20:58:18.747 INFO:tasks.workunit.client.1.smithi060.stdout:5/155: sync 2023-10-18T20:58:18.747 INFO:tasks.workunit.client.1.smithi060.stdout:0/113: dread - d3/d8/f22 zero size 2023-10-18T20:58:18.748 INFO:tasks.workunit.client.1.smithi060.stdout:5/156: creat d0/dd/d33/f3e x:0 0 0 2023-10-18T20:58:18.748 INFO:tasks.workunit.client.1.smithi060.stdout:5/157: write d0/d6/d8/f1b [3832967,26293] 0 2023-10-18T20:58:18.749 INFO:tasks.workunit.client.1.smithi060.stdout:0/114: write d3/d8/f11 [708092,35778] 0 2023-10-18T20:58:18.750 INFO:tasks.workunit.client.1.smithi060.stdout:9/88: dread f2 [0,4194304] 0 2023-10-18T20:58:18.754 INFO:tasks.workunit.client.1.smithi060.stdout:5/158: symlink d0/d6/d8/df/l3f 0 2023-10-18T20:58:18.754 INFO:tasks.workunit.client.1.smithi060.stdout:9/89: creat d3/d10/d19/f1e x:0 0 0 2023-10-18T20:58:18.754 INFO:tasks.workunit.client.1.smithi060.stdout:9/90: write d3/d10/d19/f1e [76808,1764] 0 2023-10-18T20:58:18.755 INFO:tasks.workunit.client.1.smithi060.stdout:9/91: fdatasync d3/f9 0 2023-10-18T20:58:18.755 INFO:tasks.workunit.client.1.smithi060.stdout:9/92: write d3/d10/d19/f1e [160127,6848] 0 2023-10-18T20:58:18.762 INFO:tasks.workunit.client.1.smithi060.stdout:4/49: dread d4/f10 [0,4194304] 0 2023-10-18T20:58:18.769 INFO:tasks.workunit.client.1.smithi060.stdout:4/50: dread d4/f10 [0,4194304] 0 2023-10-18T20:58:18.769 INFO:tasks.workunit.client.1.smithi060.stdout:4/51: write d4/f10 [981700,5020] 0 2023-10-18T20:58:18.779 INFO:tasks.workunit.client.0.smithi008.stdout:8/195: dwrite d5/f11 [0,4194304] 0 2023-10-18T20:58:18.781 INFO:tasks.workunit.client.1.smithi060.stdout:4/52: dread d4/f10 [0,4194304] 0 2023-10-18T20:58:18.782 INFO:tasks.workunit.client.0.smithi008.stdout:8/196: unlink d5/f1f 0 2023-10-18T20:58:18.783 INFO:tasks.workunit.client.0.smithi008.stdout:8/197: fdatasync d5/d8/d17/f26 0 2023-10-18T20:58:18.785 INFO:tasks.workunit.client.0.smithi008.stdout:6/154: dwrite df/d26/f31 [0,4194304] 0 2023-10-18T20:58:18.788 INFO:tasks.workunit.client.1.smithi060.stdout:7/94: dread de/f17 [0,4194304] 0 2023-10-18T20:58:18.788 INFO:tasks.workunit.client.1.smithi060.stdout:8/99: dwrite d4/d9/fa [4194304,4194304] 0 2023-10-18T20:58:18.798 INFO:tasks.workunit.client.1.smithi060.stdout:7/95: rename de/c12 to de/d14/d1d/c1e 0 2023-10-18T20:58:18.798 INFO:tasks.workunit.client.1.smithi060.stdout:8/100: mknod d4/d9/c1e 0 2023-10-18T20:58:18.798 INFO:tasks.workunit.client.1.smithi060.stdout:7/96: fsync fc 0 2023-10-18T20:58:18.798 INFO:tasks.workunit.client.1.smithi060.stdout:8/101: fsync d4/f19 0 2023-10-18T20:58:18.799 INFO:tasks.workunit.client.0.smithi008.stdout:6/155: symlink df/d26/l34 0 2023-10-18T20:58:18.799 INFO:tasks.workunit.client.0.smithi008.stdout:6/156: fdatasync df/f1e 0 2023-10-18T20:58:18.800 INFO:tasks.workunit.client.0.smithi008.stdout:6/157: creat df/f35 x:0 0 0 2023-10-18T20:58:18.801 INFO:tasks.workunit.client.1.smithi060.stdout:2/90: dwrite d0/d3/f17 [0,4194304] 0 2023-10-18T20:58:18.801 INFO:tasks.workunit.client.1.smithi060.stdout:2/91: write d0/d3/f5 [6354042,45784] 0 2023-10-18T20:58:18.805 INFO:tasks.workunit.client.1.smithi060.stdout:6/34: truncate f1 4061421 0 2023-10-18T20:58:18.806 INFO:tasks.workunit.client.1.smithi060.stdout:6/35: creat fc x:0 0 0 2023-10-18T20:58:18.806 INFO:tasks.workunit.client.1.smithi060.stdout:6/36: dread - fb zero size 2023-10-18T20:58:18.806 INFO:tasks.workunit.client.1.smithi060.stdout:6/37: fdatasync fb 0 2023-10-18T20:58:18.806 INFO:tasks.workunit.client.1.smithi060.stdout:6/38: write f7 [7384455,29755] 0 2023-10-18T20:58:18.809 INFO:tasks.workunit.client.1.smithi060.stdout:3/82: getdents d0 0 2023-10-18T20:58:18.810 INFO:tasks.workunit.client.1.smithi060.stdout:5/159: dwrite d0/d6/d8/df/f28 [0,4194304] 0 2023-10-18T20:58:18.811 INFO:tasks.workunit.client.0.smithi008.stdout:8/198: rmdir d5/d8/d17/d4d 39 2023-10-18T20:58:18.812 INFO:tasks.workunit.client.1.smithi060.stdout:7/97: dread fa [0,4194304] 0 2023-10-18T20:58:18.812 INFO:tasks.workunit.client.1.smithi060.stdout:7/98: fsync de/f19 0 2023-10-18T20:58:18.812 INFO:tasks.workunit.client.1.smithi060.stdout:7/99: dread - de/d14/f16 zero size 2023-10-18T20:58:18.812 INFO:tasks.workunit.client.1.smithi060.stdout:7/100: chown de/f19 31748 1 2023-10-18T20:58:18.814 INFO:tasks.workunit.client.1.smithi060.stdout:1/149: dwrite d4/da/db/dd/f13 [4194304,4194304] 0 2023-10-18T20:58:18.814 INFO:tasks.workunit.client.1.smithi060.stdout:9/93: dread d3/f7 [0,4194304] 0 2023-10-18T20:58:18.814 INFO:tasks.workunit.client.1.smithi060.stdout:9/94: write d3/d10/fe [731816,57602] 0 2023-10-18T20:58:18.821 INFO:tasks.workunit.client.1.smithi060.stdout:4/53: dread d4/d5/f7 [0,4194304] 0 2023-10-18T20:58:18.822 INFO:tasks.workunit.client.0.smithi008.stdout:6/158: mkdir df/d36 0 2023-10-18T20:58:18.828 INFO:tasks.workunit.client.1.smithi060.stdout:8/102: dwrite d4/d9/f1b [0,4194304] 0 2023-10-18T20:58:18.828 INFO:tasks.workunit.client.1.smithi060.stdout:8/103: fsync d4/f5 0 2023-10-18T20:58:18.828 INFO:tasks.workunit.client.1.smithi060.stdout:3/83: creat d0/f1c x:0 0 0 2023-10-18T20:58:18.829 INFO:tasks.workunit.client.1.smithi060.stdout:3/84: creat d0/f1d x:0 0 0 2023-10-18T20:58:18.829 INFO:tasks.workunit.client.0.smithi008.stdout:6/159: symlink df/d15/d27/l37 0 2023-10-18T20:58:18.829 INFO:tasks.workunit.client.0.smithi008.stdout:6/160: stat df/d19/f1c 0 2023-10-18T20:58:18.830 INFO:tasks.workunit.client.0.smithi008.stdout:4/111: sync 2023-10-18T20:58:18.831 INFO:tasks.workunit.client.0.smithi008.stdout:4/112: creat d0/f27 x:0 0 0 2023-10-18T20:58:18.831 INFO:tasks.workunit.client.1.smithi060.stdout:1/150: write d4/da/f1c [3264431,55664] 0 2023-10-18T20:58:18.834 INFO:tasks.workunit.client.0.smithi008.stdout:8/199: rmdir d5/d8/df 39 2023-10-18T20:58:18.834 INFO:tasks.workunit.client.0.smithi008.stdout:8/200: stat d5/f11 0 2023-10-18T20:58:18.835 INFO:tasks.workunit.client.1.smithi060.stdout:6/39: write f8 [3919797,49786] 0 2023-10-18T20:58:18.835 INFO:tasks.workunit.client.1.smithi060.stdout:5/160: getdents d0/d6/d8/df 0 2023-10-18T20:58:18.836 INFO:tasks.workunit.client.1.smithi060.stdout:7/101: getdents de/d14/d1d 0 2023-10-18T20:58:18.836 INFO:tasks.workunit.client.1.smithi060.stdout:7/102: creat de/f1f x:0 0 0 2023-10-18T20:58:18.836 INFO:tasks.workunit.client.1.smithi060.stdout:7/103: fdatasync de/f17 0 2023-10-18T20:58:18.837 INFO:tasks.workunit.client.0.smithi008.stdout:6/161: mkdir df/d15/d27/d38 0 2023-10-18T20:58:18.838 INFO:tasks.workunit.client.0.smithi008.stdout:6/162: chown l2 6943 1 2023-10-18T20:58:18.838 INFO:tasks.workunit.client.0.smithi008.stdout:6/163: stat df/d15/d27/l37 0 2023-10-18T20:58:18.844 INFO:tasks.workunit.client.0.smithi008.stdout:4/113: symlink d0/d3/l28 0 2023-10-18T20:58:18.846 INFO:tasks.workunit.client.0.smithi008.stdout:8/201: mknod d5/d8/d24/d50/d53/c5c 0 2023-10-18T20:58:18.848 INFO:tasks.workunit.client.0.smithi008.stdout:4/114: mknod d0/d3/c29 0 2023-10-18T20:58:18.848 INFO:tasks.workunit.client.0.smithi008.stdout:4/115: unlink d0/c5 0 2023-10-18T20:58:18.848 INFO:tasks.workunit.client.0.smithi008.stdout:4/116: readlink d0/d3/d21/l22 0 2023-10-18T20:58:18.849 INFO:tasks.workunit.client.0.smithi008.stdout:4/117: chown d0/d3 24437937 1 2023-10-18T20:58:18.849 INFO:tasks.workunit.client.0.smithi008.stdout:4/118: write d0/f27 [923998,18862] 0 2023-10-18T20:58:18.853 INFO:tasks.workunit.client.0.smithi008.stdout:8/202: rename d5/d8/d24/c49 to d5/d8/df/c5d 0 2023-10-18T20:58:18.853 INFO:tasks.workunit.client.0.smithi008.stdout:8/203: fsync d5/f28 0 2023-10-18T20:58:18.861 INFO:tasks.workunit.client.1.smithi060.stdout:2/92: truncate d0/d3/f5 2521908 0 2023-10-18T20:58:18.862 INFO:tasks.workunit.client.0.smithi008.stdout:8/204: creat d5/d8/d24/d50/f5e x:0 0 0 2023-10-18T20:58:18.862 INFO:tasks.workunit.client.0.smithi008.stdout:8/205: readlink d5/d8/d24/l40 0 2023-10-18T20:58:18.863 INFO:tasks.workunit.client.0.smithi008.stdout:4/119: mkdir d0/d3/d8/d2a 0 2023-10-18T20:58:18.863 INFO:tasks.workunit.client.0.smithi008.stdout:8/206: write d5/d8/df/f1b [912021,124240] 0 2023-10-18T20:58:18.868 INFO:tasks.workunit.client.1.smithi060.stdout:4/54: rename d4/d5 to d4/dc/d11 0 2023-10-18T20:58:18.871 INFO:tasks.workunit.client.1.smithi060.stdout:8/104: creat d4/f1f x:0 0 0 2023-10-18T20:58:18.871 INFO:tasks.workunit.client.0.smithi008.stdout:4/120: truncate d0/d3/f4 7585807 0 2023-10-18T20:58:18.871 INFO:tasks.workunit.client.0.smithi008.stdout:4/121: fdatasync d0/d17/f23 0 2023-10-18T20:58:18.878 INFO:tasks.workunit.client.0.smithi008.stdout:8/207: dread d5/f15 [0,4194304] 0 2023-10-18T20:58:18.878 INFO:tasks.workunit.client.0.smithi008.stdout:4/122: truncate d0/d3/d8/fa 616092 0 2023-10-18T20:58:18.882 INFO:tasks.workunit.client.1.smithi060.stdout:6/40: rename f0 to fd 0 2023-10-18T20:58:18.893 INFO:tasks.workunit.client.0.smithi008.stdout:0/106: sync 2023-10-18T20:58:18.893 INFO:tasks.workunit.client.0.smithi008.stdout:0/107: write d0/dd/f18 [827757,4457] 0 2023-10-18T20:58:18.894 INFO:tasks.workunit.client.0.smithi008.stdout:8/208: dread d5/d8/df/f39 [0,4194304] 0 2023-10-18T20:58:18.894 INFO:tasks.workunit.client.0.smithi008.stdout:4/123: rename d0/d3/c29 to d0/d3/d21/c2b 0 2023-10-18T20:58:18.895 INFO:tasks.workunit.client.0.smithi008.stdout:4/124: chown d0/d3/d21 19423053 1 2023-10-18T20:58:18.895 INFO:tasks.workunit.client.0.smithi008.stdout:4/125: chown d0/f1c 1 1 2023-10-18T20:58:18.895 INFO:tasks.workunit.client.0.smithi008.stdout:4/126: creat d0/d3/d21/f2c x:0 0 0 2023-10-18T20:58:18.896 INFO:tasks.workunit.client.1.smithi060.stdout:7/104: mknod de/d14/d1d/c20 0 2023-10-18T20:58:18.896 INFO:tasks.workunit.client.1.smithi060.stdout:9/95: rename d3/d10/d19/f1e to d3/d10/d19/f1f 0 2023-10-18T20:58:18.896 INFO:tasks.workunit.client.1.smithi060.stdout:9/96: creat d3/f20 x:0 0 0 2023-10-18T20:58:18.899 INFO:tasks.workunit.client.1.smithi060.stdout:2/93: mknod d0/d3/c21 0 2023-10-18T20:58:18.899 INFO:tasks.workunit.client.1.smithi060.stdout:2/94: readlink d0/d3/l7 0 2023-10-18T20:58:18.899 INFO:tasks.workunit.client.1.smithi060.stdout:2/95: chown d0/f10 22 1 2023-10-18T20:58:18.899 INFO:tasks.workunit.client.1.smithi060.stdout:2/96: write d0/d16/f19 [245023,52657] 0 2023-10-18T20:58:18.900 INFO:tasks.workunit.client.1.smithi060.stdout:2/97: fsync d0/d8/f1d 0 2023-10-18T20:58:18.900 INFO:tasks.workunit.client.1.smithi060.stdout:2/98: fdatasync d0/d8/fa 0 2023-10-18T20:58:18.900 INFO:tasks.workunit.client.1.smithi060.stdout:1/151: dwrite d4/d6/d7/f9 [0,4194304] 0 2023-10-18T20:58:18.901 INFO:tasks.workunit.client.1.smithi060.stdout:1/152: stat d4/da 0 2023-10-18T20:58:18.901 INFO:tasks.workunit.client.1.smithi060.stdout:1/153: stat d4/da/de/c24 0 2023-10-18T20:58:18.904 INFO:tasks.workunit.client.1.smithi060.stdout:8/105: link d4/l1d d4/l20 0 2023-10-18T20:58:18.905 INFO:tasks.workunit.client.1.smithi060.stdout:8/106: creat d4/d9/f21 x:0 0 0 2023-10-18T20:58:18.905 INFO:tasks.workunit.client.1.smithi060.stdout:8/107: creat d4/f22 x:0 0 0 2023-10-18T20:58:18.908 INFO:tasks.workunit.client.0.smithi008.stdout:8/209: symlink d5/d8/df/l5f 0 2023-10-18T20:58:18.908 INFO:tasks.workunit.client.0.smithi008.stdout:8/210: dread - d5/d8/d17/d36/f46 zero size 2023-10-18T20:58:18.908 INFO:tasks.workunit.client.1.smithi060.stdout:7/105: creat de/d14/d1d/f21 x:0 0 0 2023-10-18T20:58:18.910 INFO:tasks.workunit.client.0.smithi008.stdout:0/108: rename d0/dd/f1a to d0/dd/df/f1c 0 2023-10-18T20:58:18.917 INFO:tasks.workunit.client.0.smithi008.stdout:4/127: mkdir d0/d3/d8/d2a/d2d 0 2023-10-18T20:58:18.918 INFO:tasks.workunit.client.1.smithi060.stdout:5/161: dwrite d0/d6/d8/df/d27/d32/f39 [0,4194304] 0 2023-10-18T20:58:18.918 INFO:tasks.workunit.client.1.smithi060.stdout:8/108: truncate d4/d9/f1b 3653524 0 2023-10-18T20:58:18.918 INFO:tasks.workunit.client.0.smithi008.stdout:6/164: dwrite df/d13/f1a [0,4194304] 0 2023-10-18T20:58:18.919 INFO:tasks.workunit.client.1.smithi060.stdout:7/106: creat de/d14/d1b/f22 x:0 0 0 2023-10-18T20:58:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:17.532473+0000 mgr.smithi060.pgqqwa (mgr.14584) 40 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 294 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.8 MiB/s rd, 12 MiB/s wr, 672 op/s 2023-10-18T20:58:18.921 INFO:tasks.workunit.client.0.smithi008.stdout:8/211: unlink d5/d8/d17/l2b 0 2023-10-18T20:58:18.921 INFO:tasks.workunit.client.0.smithi008.stdout:8/212: chown d5/d8/d17/f26 51133 1 2023-10-18T20:58:18.924 INFO:tasks.workunit.client.1.smithi060.stdout:4/55: dwrite d4/f10 [0,4194304] 0 2023-10-18T20:58:18.924 INFO:tasks.workunit.client.1.smithi060.stdout:4/56: chown l3 84082 1 2023-10-18T20:58:18.925 INFO:tasks.workunit.client.0.smithi008.stdout:4/128: rmdir d0/d3/d8/d2a/d2d 0 2023-10-18T20:58:18.925 INFO:tasks.workunit.client.1.smithi060.stdout:5/162: dread d0/d6/d8/f21 [0,4194304] 0 2023-10-18T20:58:18.925 INFO:tasks.workunit.client.1.smithi060.stdout:5/163: chown d0/d6/d8/df/d27/d32/f39 0 1 2023-10-18T20:58:18.927 INFO:tasks.workunit.client.1.smithi060.stdout:1/154: truncate d4/da/fc 71461 0 2023-10-18T20:58:18.931 INFO:tasks.workunit.client.0.smithi008.stdout:8/213: link d5/d8/df/f23 d5/d8/df/d2e/f60 0 2023-10-18T20:58:18.933 INFO:tasks.workunit.client.0.smithi008.stdout:0/109: read d0/fb [664457,3221] 0 2023-10-18T20:58:18.933 INFO:tasks.workunit.client.1.smithi060.stdout:7/107: symlink de/d14/d1b/l23 0 2023-10-18T20:58:18.934 INFO:tasks.workunit.client.1.smithi060.stdout:7/108: getdents de/d14 0 2023-10-18T20:58:18.937 INFO:tasks.workunit.client.0.smithi008.stdout:8/214: truncate d5/d8/df/f39 214124 0 2023-10-18T20:58:18.937 INFO:tasks.workunit.client.0.smithi008.stdout:0/110: creat d0/f1d x:0 0 0 2023-10-18T20:58:18.937 INFO:tasks.workunit.client.0.smithi008.stdout:0/111: unlink d0/c7 0 2023-10-18T20:58:18.938 INFO:tasks.workunit.client.1.smithi060.stdout:4/57: rename d4/c6 to d4/c12 0 2023-10-18T20:58:18.938 INFO:tasks.workunit.client.1.smithi060.stdout:4/58: write d4/dc/d11/f7 [736762,10918] 0 2023-10-18T20:58:18.941 INFO:tasks.workunit.client.1.smithi060.stdout:5/164: creat d0/d6/db/f40 x:0 0 0 2023-10-18T20:58:18.945 INFO:tasks.workunit.client.1.smithi060.stdout:2/99: getdents d0/d3 0 2023-10-18T20:58:18.945 INFO:tasks.workunit.client.1.smithi060.stdout:2/100: chown d0/d3/l7 873 1 2023-10-18T20:58:18.947 INFO:tasks.workunit.client.1.smithi060.stdout:9/97: dwrite d3/f1b [0,4194304] 0 2023-10-18T20:58:18.948 INFO:tasks.workunit.client.1.smithi060.stdout:4/59: mkdir d4/dc/d11/d13 0 2023-10-18T20:58:18.948 INFO:tasks.workunit.client.1.smithi060.stdout:4/60: unlink d4/l8 0 2023-10-18T20:58:18.950 INFO:tasks.workunit.client.1.smithi060.stdout:5/165: mkdir d0/d6/db/d41 0 2023-10-18T20:58:18.950 INFO:tasks.workunit.client.1.smithi060.stdout:5/166: chown d0/d6/db/d2a/c34 728154679 1 2023-10-18T20:58:18.950 INFO:tasks.workunit.client.1.smithi060.stdout:5/167: truncate d0/dd/d33/f3d 847533 0 2023-10-18T20:58:18.951 INFO:tasks.workunit.client.1.smithi060.stdout:9/98: write d3/d10/f18 [591475,15157] 0 2023-10-18T20:58:18.951 INFO:tasks.workunit.client.1.smithi060.stdout:9/99: unlink d3/f9 0 2023-10-18T20:58:18.951 INFO:tasks.workunit.client.1.smithi060.stdout:9/100: chown d3/d10/d19 27769217 1 2023-10-18T20:58:18.972 INFO:tasks.workunit.client.0.smithi008.stdout:8/215: mknod d5/d8/df/c61 0 2023-10-18T20:58:18.973 INFO:tasks.workunit.client.1.smithi060.stdout:1/155: dwrite d4/d6/d7/f9 [4194304,4194304] 0 2023-10-18T20:58:18.973 INFO:tasks.workunit.client.1.smithi060.stdout:1/156: truncate d4/da/db/dd/f30 626869 0 2023-10-18T20:58:18.979 INFO:tasks.workunit.client.0.smithi008.stdout:8/216: link d5/d8/df/f3a d5/d8/df/d54/f62 0 2023-10-18T20:58:18.981 INFO:tasks.workunit.client.0.smithi008.stdout:8/217: creat d5/d8/d24/f63 x:0 0 0 2023-10-18T20:58:18.981 INFO:tasks.workunit.client.1.smithi060.stdout:4/61: rename l3 to d4/dc/l14 0 2023-10-18T20:58:18.982 INFO:tasks.workunit.client.0.smithi008.stdout:8/218: rmdir d5/d8/df/d54 39 2023-10-18T20:58:18.984 INFO:tasks.workunit.client.0.smithi008.stdout:8/219: creat d5/d8/df/d54/d58/f64 x:0 0 0 2023-10-18T20:58:18.984 INFO:tasks.workunit.client.0.smithi008.stdout:8/220: chown d5/d8/d24/l40 1622899 1 2023-10-18T20:58:18.985 INFO:tasks.workunit.client.0.smithi008.stdout:8/221: write d5/d8/d17/d4d/f4f [506634,27905] 0 2023-10-18T20:58:18.985 INFO:tasks.workunit.client.0.smithi008.stdout:8/222: read - d5/d8/f47 zero size 2023-10-18T20:58:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:17.532473+0000 mgr.smithi060.pgqqwa (mgr.14584) 40 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 294 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.8 MiB/s rd, 12 MiB/s wr, 672 op/s 2023-10-18T20:58:18.987 INFO:tasks.workunit.client.1.smithi060.stdout:7/109: dwrite de/f1f [0,4194304] 0 2023-10-18T20:58:18.988 INFO:tasks.workunit.client.1.smithi060.stdout:7/110: creat de/d14/d1d/f24 x:0 0 0 2023-10-18T20:58:18.992 INFO:tasks.workunit.client.0.smithi008.stdout:6/165: dread df/d26/f31 [0,4194304] 0 2023-10-18T20:58:18.992 INFO:tasks.workunit.client.0.smithi008.stdout:8/223: mknod d5/d8/d24/d50/c65 0 2023-10-18T20:58:19.000 INFO:tasks.workunit.client.1.smithi060.stdout:8/109: rmdir d4/d9 39 2023-10-18T20:58:19.001 INFO:tasks.workunit.client.1.smithi060.stdout:8/110: chown d4/c1a 54278 1 2023-10-18T20:58:19.001 INFO:tasks.workunit.client.1.smithi060.stdout:2/101: dwrite d0/f10 [0,4194304] 0 2023-10-18T20:58:19.004 INFO:tasks.workunit.client.1.smithi060.stdout:1/157: truncate d4/da/db/dd/f13 4862135 0 2023-10-18T20:58:19.005 INFO:tasks.workunit.client.1.smithi060.stdout:9/101: rename d3/f7 to d3/d10/d1c/f21 0 2023-10-18T20:58:19.007 INFO:tasks.workunit.client.1.smithi060.stdout:4/62: mkdir d4/d15 0 2023-10-18T20:58:19.007 INFO:tasks.workunit.client.1.smithi060.stdout:4/63: chown d4/ce 1323913 1 2023-10-18T20:58:19.008 INFO:tasks.workunit.client.1.smithi060.stdout:5/168: dwrite d0/dd/d33/f3d [0,4194304] 0 2023-10-18T20:58:19.011 INFO:tasks.workunit.client.1.smithi060.stdout:7/111: link de/ff de/f25 0 2023-10-18T20:58:19.012 INFO:tasks.workunit.client.1.smithi060.stdout:1/158: dread d4/da/db/dd/f25 [0,4194304] 0 2023-10-18T20:58:19.013 INFO:tasks.workunit.client.0.smithi008.stdout:4/129: dwrite d0/d3/d21/f24 [0,4194304] 0 2023-10-18T20:58:19.013 INFO:tasks.workunit.client.0.smithi008.stdout:4/130: fdatasync d0/d3/d8/f26 0 2023-10-18T20:58:19.013 INFO:tasks.workunit.client.0.smithi008.stdout:4/131: dread - d0/d3/d8/f26 zero size 2023-10-18T20:58:19.013 INFO:tasks.workunit.client.0.smithi008.stdout:4/132: fdatasync d0/d3/d8/f15 0 2023-10-18T20:58:19.014 INFO:tasks.workunit.client.1.smithi060.stdout:2/102: dread d0/d3/f5 [0,4194304] 0 2023-10-18T20:58:19.017 INFO:tasks.workunit.client.0.smithi008.stdout:6/166: write df/d13/f17 [2490943,71577] 0 2023-10-18T20:58:19.020 INFO:tasks.workunit.client.1.smithi060.stdout:8/111: read d4/f14 [2683085,41180] 0 2023-10-18T20:58:19.020 INFO:tasks.workunit.client.1.smithi060.stdout:1/159: unlink d4/d6/d7/df/c31 0 2023-10-18T20:58:19.020 INFO:tasks.workunit.client.1.smithi060.stdout:1/160: readlink d4/l18 0 2023-10-18T20:58:19.020 INFO:tasks.workunit.client.1.smithi060.stdout:2/103: creat d0/f22 x:0 0 0 2023-10-18T20:58:19.020 INFO:tasks.workunit.client.1.smithi060.stdout:1/161: chown d4/da 63 1 2023-10-18T20:58:19.021 INFO:tasks.workunit.client.1.smithi060.stdout:2/104: fdatasync d0/d16/f1c 0 2023-10-18T20:58:19.023 INFO:tasks.workunit.client.1.smithi060.stdout:4/64: truncate d4/dc/d11/f7 1549082 0 2023-10-18T20:58:19.023 INFO:tasks.workunit.client.0.smithi008.stdout:4/133: rmdir d0 39 2023-10-18T20:58:19.027 INFO:tasks.workunit.client.0.smithi008.stdout:4/134: symlink d0/d3/l2e 0 2023-10-18T20:58:19.027 INFO:tasks.workunit.client.1.smithi060.stdout:2/105: symlink d0/d3/l23 0 2023-10-18T20:58:19.028 INFO:tasks.workunit.client.1.smithi060.stdout:2/106: chown d0/d16/l1f 99410776 1 2023-10-18T20:58:19.029 INFO:tasks.workunit.client.0.smithi008.stdout:6/167: dread df/d18/f2d [0,4194304] 0 2023-10-18T20:58:19.030 INFO:tasks.workunit.client.1.smithi060.stdout:9/102: dread f0 [0,4194304] 0 2023-10-18T20:58:19.033 INFO:tasks.workunit.client.1.smithi060.stdout:2/107: write d0/d8/f1d [102485,82133] 0 2023-10-18T20:58:19.034 INFO:tasks.workunit.client.1.smithi060.stdout:1/162: write d4/d6/d7/df/f15 [457522,10666] 0 2023-10-18T20:58:19.034 INFO:tasks.workunit.client.1.smithi060.stdout:1/163: write d4/da/fc [393276,65248] 0 2023-10-18T20:58:19.039 INFO:tasks.workunit.client.0.smithi008.stdout:4/135: creat d0/d3/d8/f2f x:0 0 0 2023-10-18T20:58:19.040 INFO:tasks.workunit.client.0.smithi008.stdout:4/136: write d0/d3/f1e [945683,102895] 0 2023-10-18T20:58:19.040 INFO:tasks.workunit.client.1.smithi060.stdout:8/112: dread f3 [0,4194304] 0 2023-10-18T20:58:19.041 INFO:tasks.workunit.client.1.smithi060.stdout:8/113: dread - d4/f1f zero size 2023-10-18T20:58:19.044 INFO:tasks.workunit.client.1.smithi060.stdout:9/103: getdents d3/d10/d1c 0 2023-10-18T20:58:19.047 INFO:tasks.workunit.client.0.smithi008.stdout:6/168: creat df/d15/d27/d38/f39 x:0 0 0 2023-10-18T20:58:19.047 INFO:tasks.workunit.client.0.smithi008.stdout:6/169: readlink df/d26/l34 0 2023-10-18T20:58:19.047 INFO:tasks.workunit.client.0.smithi008.stdout:4/137: rmdir d0/d3/d21 39 2023-10-18T20:58:19.050 INFO:tasks.workunit.client.0.smithi008.stdout:8/224: dwrite d5/d8/d24/d50/f5e [0,4194304] 0 2023-10-18T20:58:19.050 INFO:tasks.workunit.client.0.smithi008.stdout:8/225: write d5/d8/d17/d4d/f4f [1564098,79367] 0 2023-10-18T20:58:19.050 INFO:tasks.workunit.client.0.smithi008.stdout:8/226: truncate d5/f18 963033 0 2023-10-18T20:58:19.050 INFO:tasks.workunit.client.0.smithi008.stdout:8/227: dread - d5/d8/d17/d36/f46 zero size 2023-10-18T20:58:19.051 INFO:tasks.workunit.client.1.smithi060.stdout:7/112: dread de/f1f [0,4194304] 0 2023-10-18T20:58:19.051 INFO:tasks.workunit.client.1.smithi060.stdout:5/169: dwrite d0/f1d [0,4194304] 0 2023-10-18T20:58:19.052 INFO:tasks.workunit.client.1.smithi060.stdout:5/170: truncate d0/f2c 915607 0 2023-10-18T20:58:19.052 INFO:tasks.workunit.client.1.smithi060.stdout:5/171: fsync d0/d6/d8/df/d27/f3c 0 2023-10-18T20:58:19.052 INFO:tasks.workunit.client.1.smithi060.stdout:2/108: mknod d0/d3/c24 0 2023-10-18T20:58:19.056 INFO:tasks.workunit.client.1.smithi060.stdout:4/65: link d4/dc/d11/f7 d4/dc/d11/d13/f16 0 2023-10-18T20:58:19.056 INFO:tasks.workunit.client.1.smithi060.stdout:8/114: write d4/d9/fa [5656815,127592] 0 2023-10-18T20:58:19.056 INFO:tasks.workunit.client.1.smithi060.stdout:8/115: truncate d4/f15 243258 0 2023-10-18T20:58:19.056 INFO:tasks.workunit.client.1.smithi060.stdout:4/66: write d4/dc/d11/f7 [1270703,104312] 0 2023-10-18T20:58:19.058 INFO:tasks.workunit.client.1.smithi060.stdout:0/115: sync 2023-10-18T20:58:19.058 INFO:tasks.workunit.client.1.smithi060.stdout:6/41: sync 2023-10-18T20:58:19.058 INFO:tasks.workunit.client.1.smithi060.stdout:3/85: sync 2023-10-18T20:58:19.058 INFO:tasks.workunit.client.1.smithi060.stdout:6/42: readlink - no filename 2023-10-18T20:58:19.058 INFO:tasks.workunit.client.1.smithi060.stdout:3/86: creat d0/f1e x:0 0 0 2023-10-18T20:58:19.059 INFO:tasks.workunit.client.1.smithi060.stdout:6/43: creat fe x:0 0 0 2023-10-18T20:58:19.059 INFO:tasks.workunit.client.1.smithi060.stdout:6/44: rmdir - no directory 2023-10-18T20:58:19.059 INFO:tasks.workunit.client.1.smithi060.stdout:3/87: creat d0/f1f x:0 0 0 2023-10-18T20:58:19.060 INFO:tasks.workunit.client.1.smithi060.stdout:7/113: mknod de/d14/d1d/c26 0 2023-10-18T20:58:19.060 INFO:tasks.workunit.client.0.smithi008.stdout:4/138: unlink d0/d3/d8/f2f 0 2023-10-18T20:58:19.060 INFO:tasks.workunit.client.0.smithi008.stdout:4/139: chown d0/d3/d21/c2b 0 1 2023-10-18T20:58:19.061 INFO:tasks.workunit.client.1.smithi060.stdout:2/109: creat d0/d16/f25 x:0 0 0 2023-10-18T20:58:19.065 INFO:tasks.workunit.client.0.smithi008.stdout:4/140: rmdir d0 39 2023-10-18T20:58:19.068 INFO:tasks.workunit.client.1.smithi060.stdout:4/67: creat d4/dc/f17 x:0 0 0 2023-10-18T20:58:19.068 INFO:tasks.workunit.client.1.smithi060.stdout:4/68: readlink d4/dc/l14 0 2023-10-18T20:58:19.068 INFO:tasks.workunit.client.1.smithi060.stdout:4/69: dread - d4/dc/f17 zero size 2023-10-18T20:58:19.068 INFO:tasks.workunit.client.1.smithi060.stdout:4/70: write d4/dc/d11/d13/f16 [572613,36520] 0 2023-10-18T20:58:19.069 INFO:tasks.workunit.client.1.smithi060.stdout:4/71: truncate d4/dc/f17 229052 0 2023-10-18T20:58:19.069 INFO:tasks.workunit.client.1.smithi060.stdout:4/72: write d4/dc/d11/d13/f16 [670726,119602] 0 2023-10-18T20:58:19.069 INFO:tasks.workunit.client.0.smithi008.stdout:4/141: mknod d0/d17/c30 0 2023-10-18T20:58:19.070 INFO:tasks.workunit.client.1.smithi060.stdout:0/116: mknod d3/c23 0 2023-10-18T20:58:19.073 INFO:tasks.workunit.client.1.smithi060.stdout:2/110: read d0/f12 [3522325,31306] 0 2023-10-18T20:58:19.078 INFO:tasks.workunit.client.0.smithi008.stdout:7/102: sync 2023-10-18T20:58:19.078 INFO:tasks.workunit.client.0.smithi008.stdout:7/103: dread - d1/d3/f13 zero size 2023-10-18T20:58:19.079 INFO:tasks.workunit.client.1.smithi060.stdout:2/111: fdatasync d0/d8/f1d 0 2023-10-18T20:58:19.083 INFO:tasks.workunit.client.0.smithi008.stdout:7/104: symlink d1/l21 0 2023-10-18T20:58:19.084 INFO:tasks.workunit.client.0.smithi008.stdout:7/105: stat d1/d3 0 2023-10-18T20:58:19.086 INFO:tasks.workunit.client.1.smithi060.stdout:3/88: rename d0/f12 to d0/f20 0 2023-10-18T20:58:19.086 INFO:tasks.workunit.client.1.smithi060.stdout:3/89: chown d0/fd 2841 1 2023-10-18T20:58:19.086 INFO:tasks.workunit.client.1.smithi060.stdout:3/90: stat d0/f1c 0 2023-10-18T20:58:19.087 INFO:tasks.workunit.client.1.smithi060.stdout:1/164: rename d4/da/db to d4/da/de/d2a/d32 0 2023-10-18T20:58:19.091 INFO:tasks.workunit.client.1.smithi060.stdout:0/117: link d3/f12 d3/f24 0 2023-10-18T20:58:19.092 INFO:tasks.workunit.client.1.smithi060.stdout:0/118: fdatasync d3/d8/d14/f1d 0 2023-10-18T20:58:19.092 INFO:tasks.workunit.client.1.smithi060.stdout:7/114: getdents de/d14/d1b 0 2023-10-18T20:58:19.092 INFO:tasks.workunit.client.1.smithi060.stdout:7/115: getdents de/d14 0 2023-10-18T20:58:19.099 INFO:tasks.workunit.client.1.smithi060.stdout:9/104: rename d3/l13 to d3/d10/l22 0 2023-10-18T20:58:19.101 INFO:tasks.workunit.client.1.smithi060.stdout:1/165: mkdir d4/d6/d33 0 2023-10-18T20:58:19.101 INFO:tasks.workunit.client.1.smithi060.stdout:1/166: fsync d4/f8 0 2023-10-18T20:58:19.102 INFO:tasks.workunit.client.0.smithi008.stdout:7/106: getdents d1/d3 0 2023-10-18T20:58:19.108 INFO:tasks.workunit.client.1.smithi060.stdout:7/116: rename de/f25 to de/f27 0 2023-10-18T20:58:19.108 INFO:tasks.workunit.client.1.smithi060.stdout:9/105: symlink d3/l23 0 2023-10-18T20:58:19.109 INFO:tasks.workunit.client.1.smithi060.stdout:1/167: symlink d4/da/de/l34 0 2023-10-18T20:58:19.111 INFO:tasks.workunit.client.1.smithi060.stdout:5/172: rename d0/d6/d8/df/f28 to d0/d6/f42 0 2023-10-18T20:58:19.112 INFO:tasks.workunit.client.1.smithi060.stdout:7/117: mknod de/d14/c28 0 2023-10-18T20:58:19.114 INFO:tasks.workunit.client.1.smithi060.stdout:8/116: rename d4/f5 to d4/d9/f23 0 2023-10-18T20:58:19.115 INFO:tasks.workunit.client.1.smithi060.stdout:4/73: rename d4 to d4/dc/d11/d18 22 2023-10-18T20:58:19.115 INFO:tasks.workunit.client.1.smithi060.stdout:8/117: fdatasync d4/fe 0 2023-10-18T20:58:19.117 INFO:tasks.workunit.client.1.smithi060.stdout:5/173: mkdir d0/da/d3b/d43 0 2023-10-18T20:58:19.118 INFO:tasks.workunit.client.1.smithi060.stdout:7/118: rmdir de/d14/d1b 39 2023-10-18T20:58:19.122 INFO:tasks.workunit.client.1.smithi060.stdout:2/112: rename d0/d3/f5 to d0/d8/f26 0 2023-10-18T20:58:19.122 INFO:tasks.workunit.client.1.smithi060.stdout:2/113: chown d0/d3/l23 42030 1 2023-10-18T20:58:19.124 INFO:tasks.workunit.client.0.smithi008.stdout:7/107: dread d1/d3/fc [0,4194304] 0 2023-10-18T20:58:19.125 INFO:tasks.workunit.client.1.smithi060.stdout:2/114: write d0/d16/f19 [24856,52909] 0 2023-10-18T20:58:19.127 INFO:tasks.workunit.client.0.smithi008.stdout:7/108: link c0 d1/c22 0 2023-10-18T20:58:19.127 INFO:tasks.workunit.client.0.smithi008.stdout:7/109: dread - d1/f1f zero size 2023-10-18T20:58:19.129 INFO:tasks.workunit.client.1.smithi060.stdout:7/119: rename de/d14/d1b to de/d29 0 2023-10-18T20:58:19.132 INFO:tasks.workunit.client.1.smithi060.stdout:7/120: write de/f17 [690289,26303] 0 2023-10-18T20:58:19.133 INFO:tasks.workunit.client.1.smithi060.stdout:7/121: creat de/d14/d1d/f2a x:0 0 0 2023-10-18T20:58:19.133 INFO:tasks.workunit.client.1.smithi060.stdout:7/122: truncate de/f1a 844067 0 2023-10-18T20:58:19.133 INFO:tasks.workunit.client.1.smithi060.stdout:5/174: getdents d0/d6/d8/df/d27 0 2023-10-18T20:58:19.133 INFO:tasks.workunit.client.1.smithi060.stdout:5/175: getdents d0/da/d3b/d43 0 2023-10-18T20:58:19.134 INFO:tasks.workunit.client.1.smithi060.stdout:8/118: truncate d4/d9/fa 1984723 0 2023-10-18T20:58:19.134 INFO:tasks.workunit.client.1.smithi060.stdout:8/119: stat d4/f19 0 2023-10-18T20:58:19.137 INFO:tasks.workunit.client.0.smithi008.stdout:6/170: dwrite df/d26/f31 [0,4194304] 0 2023-10-18T20:58:19.137 INFO:tasks.workunit.client.0.smithi008.stdout:6/171: dread - df/f35 zero size 2023-10-18T20:58:19.138 INFO:tasks.workunit.client.0.smithi008.stdout:7/110: mknod d1/d3/c23 0 2023-10-18T20:58:19.138 INFO:tasks.workunit.client.1.smithi060.stdout:6/45: dwrite f8 [0,4194304] 0 2023-10-18T20:58:19.140 INFO:tasks.workunit.client.1.smithi060.stdout:9/106: read d3/f1b [2974901,86953] 0 2023-10-18T20:58:19.141 INFO:tasks.workunit.client.1.smithi060.stdout:9/107: unlink d3/l23 0 2023-10-18T20:58:19.141 INFO:tasks.workunit.client.1.smithi060.stdout:2/115: mkdir d0/d3/d27 0 2023-10-18T20:58:19.142 INFO:tasks.workunit.client.0.smithi008.stdout:4/142: dwrite d0/f1c [0,4194304] 0 2023-10-18T20:58:19.143 INFO:tasks.workunit.client.0.smithi008.stdout:6/172: truncate df/d19/f32 3755592 0 2023-10-18T20:58:19.147 INFO:tasks.workunit.client.0.smithi008.stdout:7/111: symlink d1/d3/l24 0 2023-10-18T20:58:19.149 INFO:tasks.workunit.client.1.smithi060.stdout:3/91: dwrite d0/f20 [0,4194304] 0 2023-10-18T20:58:19.152 INFO:tasks.workunit.client.1.smithi060.stdout:7/123: creat de/d29/f2b x:0 0 0 2023-10-18T20:58:19.154 INFO:tasks.workunit.client.1.smithi060.stdout:5/176: creat d0/d6/d8/f44 x:0 0 0 2023-10-18T20:58:19.154 INFO:tasks.workunit.client.1.smithi060.stdout:1/168: dwrite d4/d6/d7/f9 [4194304,4194304] 0 2023-10-18T20:58:19.158 INFO:tasks.workunit.client.1.smithi060.stdout:4/74: truncate d4/dc/d11/f7 659130 0 2023-10-18T20:58:19.164 INFO:tasks.workunit.client.1.smithi060.stdout:6/46: mknod cf 0 2023-10-18T20:58:19.167 INFO:tasks.workunit.client.0.smithi008.stdout:4/143: creat d0/d17/f31 x:0 0 0 2023-10-18T20:58:19.167 INFO:tasks.workunit.client.0.smithi008.stdout:4/144: write d0/d3/f1e [1032636,105013] 0 2023-10-18T20:58:19.167 INFO:tasks.workunit.client.0.smithi008.stdout:6/173: mknod df/d15/d33/c3a 0 2023-10-18T20:58:19.168 INFO:tasks.workunit.client.0.smithi008.stdout:6/174: creat df/f3b x:0 0 0 2023-10-18T20:58:19.168 INFO:tasks.workunit.client.0.smithi008.stdout:6/175: write df/d15/f16 [2821034,116640] 0 2023-10-18T20:58:19.168 INFO:tasks.workunit.client.0.smithi008.stdout:7/112: symlink d1/l25 0 2023-10-18T20:58:19.174 INFO:tasks.workunit.client.1.smithi060.stdout:9/108: creat d3/d10/f24 x:0 0 0 2023-10-18T20:58:19.174 INFO:tasks.workunit.client.1.smithi060.stdout:9/109: dread - d3/ff zero size 2023-10-18T20:58:19.175 INFO:tasks.workunit.client.1.smithi060.stdout:2/116: unlink d0/d16/l1f 0 2023-10-18T20:58:19.176 INFO:tasks.workunit.client.1.smithi060.stdout:2/117: dread - d0/d16/f1c zero size 2023-10-18T20:58:19.176 INFO:tasks.workunit.client.1.smithi060.stdout:2/118: write d0/d8/f1b [1022952,23001] 0 2023-10-18T20:58:19.176 INFO:tasks.workunit.client.1.smithi060.stdout:4/75: read d4/f10 [2176618,114649] 0 2023-10-18T20:58:19.177 INFO:tasks.workunit.client.1.smithi060.stdout:4/76: creat d4/dc/f19 x:0 0 0 2023-10-18T20:58:19.177 INFO:tasks.workunit.client.1.smithi060.stdout:4/77: truncate d4/dc/f17 886175 0 2023-10-18T20:58:19.178 INFO:tasks.workunit.client.1.smithi060.stdout:8/120: dwrite d4/f1f [0,4194304] 0 2023-10-18T20:58:19.179 INFO:tasks.workunit.client.1.smithi060.stdout:6/47: write fa [579237,109018] 0 2023-10-18T20:58:19.179 INFO:tasks.workunit.client.0.smithi008.stdout:6/176: mkdir df/d3c 0 2023-10-18T20:58:19.196 INFO:tasks.workunit.client.1.smithi060.stdout:4/78: dread d4/f10 [0,4194304] 0 2023-10-18T20:58:19.196 INFO:tasks.workunit.client.1.smithi060.stdout:4/79: chown d4/dc/d11/d13/f16 7 1 2023-10-18T20:58:19.197 INFO:tasks.workunit.client.1.smithi060.stdout:3/92: link d0/fa d0/f21 0 2023-10-18T20:58:19.198 INFO:tasks.workunit.client.1.smithi060.stdout:7/124: mkdir de/d2c 0 2023-10-18T20:58:19.199 INFO:tasks.workunit.client.1.smithi060.stdout:5/177: mknod d0/d6/d8/df/d27/d32/c45 0 2023-10-18T20:58:19.200 INFO:tasks.workunit.client.1.smithi060.stdout:1/169: mkdir d4/d6/d7/d35 0 2023-10-18T20:58:19.201 INFO:tasks.workunit.client.1.smithi060.stdout:6/48: dread fa [4194304,4194304] 0 2023-10-18T20:58:19.202 INFO:tasks.workunit.client.1.smithi060.stdout:9/110: mkdir d3/d10/d1c/d25 0 2023-10-18T20:58:19.204 INFO:tasks.workunit.client.1.smithi060.stdout:2/119: link d0/d8/fd d0/d16/f28 0 2023-10-18T20:58:19.213 INFO:tasks.workunit.client.1.smithi060.stdout:8/121: unlink d4/d9/l17 0 2023-10-18T20:58:19.213 INFO:tasks.workunit.client.1.smithi060.stdout:8/122: dread - d4/ff zero size 2023-10-18T20:58:19.215 INFO:tasks.workunit.client.1.smithi060.stdout:4/80: link d4/dc/d11/f7 d4/f1a 0 2023-10-18T20:58:19.215 INFO:tasks.workunit.client.1.smithi060.stdout:4/81: chown d4/f1a 2 1 2023-10-18T20:58:19.216 INFO:tasks.workunit.client.1.smithi060.stdout:3/93: mkdir d0/d22 0 2023-10-18T20:58:19.216 INFO:tasks.workunit.client.1.smithi060.stdout:3/94: dread - d0/f1c zero size 2023-10-18T20:58:19.218 INFO:tasks.workunit.client.1.smithi060.stdout:7/125: creat de/d14/f2d x:0 0 0 2023-10-18T20:58:19.218 INFO:tasks.workunit.client.1.smithi060.stdout:7/126: read - de/d14/f16 zero size 2023-10-18T20:58:19.218 INFO:tasks.workunit.client.1.smithi060.stdout:7/127: dread - de/d14/d1d/f2a zero size 2023-10-18T20:58:19.219 INFO:tasks.workunit.client.1.smithi060.stdout:6/49: mkdir d10 0 2023-10-18T20:58:19.222 INFO:tasks.workunit.client.1.smithi060.stdout:6/50: write fb [869095,7522] 0 2023-10-18T20:58:19.222 INFO:tasks.workunit.client.1.smithi060.stdout:9/111: symlink d3/d10/d1c/l26 0 2023-10-18T20:58:19.224 INFO:tasks.workunit.client.0.smithi008.stdout:6/177: dread df/d15/f16 [0,4194304] 0 2023-10-18T20:58:19.226 INFO:tasks.workunit.client.1.smithi060.stdout:0/119: sync 2023-10-18T20:58:19.229 INFO:tasks.workunit.client.1.smithi060.stdout:7/128: dread de/f17 [0,4194304] 0 2023-10-18T20:58:19.236 INFO:tasks.workunit.client.1.smithi060.stdout:4/82: rename d4/dc/d11/d13/f16 to d4/dc/d11/d13/f1b 0 2023-10-18T20:58:19.236 INFO:tasks.workunit.client.1.smithi060.stdout:3/95: rename d0/l8 to d0/l23 0 2023-10-18T20:58:19.237 INFO:tasks.workunit.client.1.smithi060.stdout:3/96: fdatasync d0/fc 0 2023-10-18T20:58:19.237 INFO:tasks.workunit.client.1.smithi060.stdout:3/97: write d0/f1f [59598,126417] 0 2023-10-18T20:58:19.238 INFO:tasks.workunit.client.1.smithi060.stdout:9/112: symlink d3/d10/d19/l27 0 2023-10-18T20:58:19.238 INFO:tasks.workunit.client.1.smithi060.stdout:9/113: truncate d3/d10/f18 1663426 0 2023-10-18T20:58:19.238 INFO:tasks.workunit.client.1.smithi060.stdout:9/114: fdatasync d3/d10/f18 0 2023-10-18T20:58:19.238 INFO:tasks.workunit.client.0.smithi008.stdout:6/178: mknod df/d15/d27/c3d 0 2023-10-18T20:58:19.239 INFO:tasks.workunit.client.1.smithi060.stdout:2/120: rmdir d0/d16 39 2023-10-18T20:58:19.243 INFO:tasks.workunit.client.0.smithi008.stdout:6/179: creat df/d19/f3e x:0 0 0 2023-10-18T20:58:19.244 INFO:tasks.workunit.client.0.smithi008.stdout:6/180: mkdir df/d18/d3f 0 2023-10-18T20:58:19.245 INFO:tasks.workunit.client.1.smithi060.stdout:3/98: link d0/f19 d0/f24 0 2023-10-18T20:58:19.245 INFO:tasks.workunit.client.1.smithi060.stdout:3/99: dread - d0/f11 zero size 2023-10-18T20:58:19.246 INFO:tasks.workunit.client.1.smithi060.stdout:3/100: readlink d0/l23 0 2023-10-18T20:58:19.246 INFO:tasks.workunit.client.1.smithi060.stdout:7/129: dread de/ff [0,4194304] 0 2023-10-18T20:58:19.248 INFO:tasks.workunit.client.1.smithi060.stdout:2/121: mknod d0/d16/c29 0 2023-10-18T20:58:19.249 INFO:tasks.workunit.client.1.smithi060.stdout:3/101: truncate d0/fc 201900 0 2023-10-18T20:58:19.249 INFO:tasks.workunit.client.1.smithi060.stdout:6/51: dread f8 [0,4194304] 0 2023-10-18T20:58:19.250 INFO:tasks.workunit.client.1.smithi060.stdout:6/52: write fb [1422527,103863] 0 2023-10-18T20:58:19.250 INFO:tasks.workunit.client.1.smithi060.stdout:9/115: dread d3/f4 [0,4194304] 0 2023-10-18T20:58:19.251 INFO:tasks.workunit.client.1.smithi060.stdout:2/122: mkdir d0/d3/d2a 0 2023-10-18T20:58:19.251 INFO:tasks.workunit.client.1.smithi060.stdout:4/83: dread d4/dc/d11/d13/f1b [0,4194304] 0 2023-10-18T20:58:19.252 INFO:tasks.workunit.client.1.smithi060.stdout:2/123: write d0/d8/f1b [930996,1275] 0 2023-10-18T20:58:19.254 INFO:tasks.workunit.client.1.smithi060.stdout:3/102: mknod d0/c25 0 2023-10-18T20:58:19.259 INFO:tasks.workunit.client.1.smithi060.stdout:7/130: write fa [1012965,79212] 0 2023-10-18T20:58:19.259 INFO:tasks.workunit.client.1.smithi060.stdout:6/53: symlink d10/l11 0 2023-10-18T20:58:19.259 INFO:tasks.workunit.client.1.smithi060.stdout:9/116: mkdir d3/d10/d19/d28 0 2023-10-18T20:58:19.259 INFO:tasks.workunit.client.1.smithi060.stdout:9/117: chown d3/l12 42 1 2023-10-18T20:58:19.260 INFO:tasks.workunit.client.1.smithi060.stdout:7/131: creat de/f2e x:0 0 0 2023-10-18T20:58:19.260 INFO:tasks.workunit.client.1.smithi060.stdout:1/170: dwrite d4/f2d [0,4194304] 0 2023-10-18T20:58:19.267 INFO:tasks.workunit.client.1.smithi060.stdout:6/54: symlink d10/l12 0 2023-10-18T20:58:19.267 INFO:tasks.workunit.client.1.smithi060.stdout:6/55: stat f7 0 2023-10-18T20:58:19.267 INFO:tasks.workunit.client.1.smithi060.stdout:9/118: mkdir d3/d10/d19/d28/d29 0 2023-10-18T20:58:19.268 INFO:tasks.workunit.client.0.smithi008.stdout:4/145: dwrite d0/d17/f23 [0,4194304] 0 2023-10-18T20:58:19.268 INFO:tasks.workunit.client.0.smithi008.stdout:4/146: chown d0/d3/d8 10 1 2023-10-18T20:58:19.272 INFO:tasks.workunit.client.0.smithi008.stdout:4/147: write d0/f27 [257626,68476] 0 2023-10-18T20:58:19.273 INFO:tasks.workunit.client.0.smithi008.stdout:4/148: write d0/d3/f4 [5183461,46026] 0 2023-10-18T20:58:19.273 INFO:tasks.workunit.client.0.smithi008.stdout:4/149: write d0/d3/d8/f26 [322291,71064] 0 2023-10-18T20:58:19.274 INFO:tasks.workunit.client.1.smithi060.stdout:7/132: mkdir de/d14/d2f 0 2023-10-18T20:58:19.275 INFO:tasks.workunit.client.1.smithi060.stdout:6/56: creat d10/f13 x:0 0 0 2023-10-18T20:58:19.277 INFO:tasks.workunit.client.1.smithi060.stdout:9/119: mkdir d3/d10/d1c/d2a 0 2023-10-18T20:58:19.277 INFO:tasks.workunit.client.1.smithi060.stdout:8/123: dwrite d4/f14 [0,4194304] 0 2023-10-18T20:58:19.279 INFO:tasks.workunit.client.1.smithi060.stdout:7/133: rmdir de/d2c 0 2023-10-18T20:58:19.280 INFO:tasks.workunit.client.1.smithi060.stdout:7/134: fdatasync de/d14/f16 0 2023-10-18T20:58:19.280 INFO:tasks.workunit.client.0.smithi008.stdout:4/150: link d0/d3/f4 d0/d3/f32 0 2023-10-18T20:58:19.281 INFO:tasks.workunit.client.1.smithi060.stdout:6/57: rename c4 to d10/c14 0 2023-10-18T20:58:19.281 INFO:tasks.workunit.client.1.smithi060.stdout:6/58: rename d10 to d10/d15 22 2023-10-18T20:58:19.282 INFO:tasks.workunit.client.1.smithi060.stdout:8/124: mknod d4/d9/c24 0 2023-10-18T20:58:19.282 INFO:tasks.workunit.client.1.smithi060.stdout:8/125: dread - d4/f22 zero size 2023-10-18T20:58:19.283 INFO:tasks.workunit.client.0.smithi008.stdout:4/151: mknod d0/d3/d8/d2a/c33 0 2023-10-18T20:58:19.289 INFO:tasks.workunit.client.1.smithi060.stdout:1/171: dread d4/d6/d7/df/f15 [0,4194304] 0 2023-10-18T20:58:19.289 INFO:tasks.workunit.client.1.smithi060.stdout:1/172: rename d4 to d4/da/de/d2a/d36 22 2023-10-18T20:58:19.295 INFO:tasks.workunit.client.1.smithi060.stdout:1/173: link d4/l18 d4/l37 0 2023-10-18T20:58:19.309 INFO:tasks.workunit.client.0.smithi008.stdout:7/113: dwrite d1/fd [0,4194304] 0 2023-10-18T20:58:19.311 INFO:tasks.workunit.client.1.smithi060.stdout:1/174: write d4/f2d [1654696,89579] 0 2023-10-18T20:58:19.318 INFO:tasks.workunit.client.1.smithi060.stdout:1/175: mkdir d4/d38 0 2023-10-18T20:58:19.318 INFO:tasks.workunit.client.0.smithi008.stdout:7/114: mknod d1/c26 0 2023-10-18T20:58:19.321 INFO:tasks.workunit.client.1.smithi060.stdout:1/176: truncate d4/d6/f1f 319594 0 2023-10-18T20:58:19.324 INFO:tasks.workunit.client.1.smithi060.stdout:1/177: creat d4/d6/d7/d2f/f39 x:0 0 0 2023-10-18T20:58:19.325 INFO:tasks.workunit.client.1.smithi060.stdout:3/103: dwrite d0/f18 [0,4194304] 0 2023-10-18T20:58:19.328 INFO:tasks.workunit.client.1.smithi060.stdout:4/84: dwrite d4/dc/f17 [0,4194304] 0 2023-10-18T20:58:19.328 INFO:tasks.workunit.client.1.smithi060.stdout:3/104: mkdir d0/d22/d26 0 2023-10-18T20:58:19.328 INFO:tasks.workunit.client.1.smithi060.stdout:3/105: write d0/fb [2111849,99573] 0 2023-10-18T20:58:19.333 INFO:tasks.workunit.client.1.smithi060.stdout:4/85: mknod d4/dc/c1c 0 2023-10-18T20:58:19.333 INFO:tasks.workunit.client.1.smithi060.stdout:4/86: stat d4/df 0 2023-10-18T20:58:19.336 INFO:tasks.workunit.client.1.smithi060.stdout:4/87: mkdir d4/dc/d11/d1d 0 2023-10-18T20:58:19.342 INFO:tasks.workunit.client.0.smithi008.stdout:7/115: write d1/d3/f17 [1425372,55269] 0 2023-10-18T20:58:19.342 INFO:tasks.workunit.client.0.smithi008.stdout:7/116: write d1/f1f [926450,25233] 0 2023-10-18T20:58:19.347 INFO:tasks.workunit.client.0.smithi008.stdout:7/117: rename d1/d3/f8 to d1/d3/f27 0 2023-10-18T20:58:19.347 INFO:tasks.workunit.client.0.smithi008.stdout:7/118: dread - d1/d3/f1d zero size 2023-10-18T20:58:19.350 INFO:tasks.workunit.client.0.smithi008.stdout:7/119: link c0 d1/d3/d20/c28 0 2023-10-18T20:58:19.351 INFO:tasks.workunit.client.0.smithi008.stdout:7/120: write d1/d3/f17 [1564163,89504] 0 2023-10-18T20:58:19.358 INFO:tasks.workunit.client.1.smithi060.stdout:1/178: dread d4/d6/d7/f9 [4194304,4194304] 0 2023-10-18T20:58:19.358 INFO:tasks.workunit.client.1.smithi060.stdout:1/179: stat d4/d6/d7/d35 0 2023-10-18T20:58:19.359 INFO:tasks.workunit.client.1.smithi060.stdout:9/120: rmdir d3/d10 39 2023-10-18T20:58:19.367 INFO:tasks.workunit.client.0.smithi008.stdout:9/118: sync 2023-10-18T20:58:19.368 INFO:tasks.workunit.client.0.smithi008.stdout:9/119: creat d2/dc/f1c x:0 0 0 2023-10-18T20:58:19.374 INFO:tasks.workunit.client.0.smithi008.stdout:5/78: sync 2023-10-18T20:58:19.374 INFO:tasks.workunit.client.0.smithi008.stdout:0/112: sync 2023-10-18T20:58:19.374 INFO:tasks.workunit.client.0.smithi008.stdout:0/113: stat d0 0 2023-10-18T20:58:19.375 INFO:tasks.workunit.client.0.smithi008.stdout:2/154: sync 2023-10-18T20:58:19.375 INFO:tasks.workunit.client.0.smithi008.stdout:2/155: dread - d1/d3/dd/d1c/f2d zero size 2023-10-18T20:58:19.375 INFO:tasks.workunit.client.0.smithi008.stdout:2/156: write d1/d3/dd/d1c/f2d [300335,2631] 0 2023-10-18T20:58:19.375 INFO:tasks.workunit.client.0.smithi008.stdout:2/157: fdatasync d1/d3/f20 0 2023-10-18T20:58:19.375 INFO:tasks.workunit.client.0.smithi008.stdout:2/158: write d1/d3/dd/d25/f2f [744294,117274] 0 2023-10-18T20:58:19.376 INFO:tasks.workunit.client.1.smithi060.stdout:1/180: link d4/da/l1e d4/d6/d7/d2f/l3a 0 2023-10-18T20:58:19.376 INFO:tasks.workunit.client.1.smithi060.stdout:9/121: mkdir d3/d10/d19/d28/d29/d2b 0 2023-10-18T20:58:19.377 INFO:tasks.workunit.client.1.smithi060.stdout:1/181: mknod d4/da/de/c3b 0 2023-10-18T20:58:19.377 INFO:tasks.workunit.client.1.smithi060.stdout:1/182: write d4/da/de/d2a/d32/dd/f30 [1456337,87767] 0 2023-10-18T20:58:19.377 INFO:tasks.workunit.client.0.smithi008.stdout:3/98: sync 2023-10-18T20:58:19.378 INFO:tasks.workunit.client.0.smithi008.stdout:8/228: sync 2023-10-18T20:58:19.378 INFO:tasks.workunit.client.0.smithi008.stdout:1/268: sync 2023-10-18T20:58:19.378 INFO:tasks.workunit.client.0.smithi008.stdout:9/120: mkdir d2/dc/d1a/d1d 0 2023-10-18T20:58:19.378 INFO:tasks.workunit.client.0.smithi008.stdout:9/121: fsync d2/dc/d17/f16 0 2023-10-18T20:58:19.379 INFO:tasks.workunit.client.0.smithi008.stdout:9/122: creat d2/dc/f1e x:0 0 0 2023-10-18T20:58:19.379 INFO:tasks.workunit.client.1.smithi060.stdout:3/106: dread d0/fe [0,4194304] 0 2023-10-18T20:58:19.381 INFO:tasks.workunit.client.1.smithi060.stdout:0/120: dwrite d3/fc [0,4194304] 0 2023-10-18T20:58:19.381 INFO:tasks.workunit.client.1.smithi060.stdout:0/121: creat d3/d8/d14/f25 x:0 0 0 2023-10-18T20:58:19.382 INFO:tasks.workunit.client.1.smithi060.stdout:6/59: dwrite fa [4194304,4194304] 0 2023-10-18T20:58:19.383 INFO:tasks.workunit.client.1.smithi060.stdout:6/60: truncate fb 2367229 0 2023-10-18T20:58:19.385 INFO:tasks.workunit.client.0.smithi008.stdout:5/79: mkdir d0/d2/d19 0 2023-10-18T20:58:19.385 INFO:tasks.workunit.client.0.smithi008.stdout:6/181: dwrite df/d18/f2d [0,4194304] 0 2023-10-18T20:58:19.386 INFO:tasks.workunit.client.0.smithi008.stdout:9/123: chown d2/dc/f14 242672703 1 2023-10-18T20:58:19.386 INFO:tasks.workunit.client.0.smithi008.stdout:9/124: stat d2/f3 0 2023-10-18T20:58:19.391 INFO:tasks.workunit.client.0.smithi008.stdout:3/99: getdents d0/d3/de/d13 0 2023-10-18T20:58:19.392 INFO:tasks.workunit.client.0.smithi008.stdout:9/125: mknod d2/dc/d17/c1f 0 2023-10-18T20:58:19.392 INFO:tasks.workunit.client.0.smithi008.stdout:1/269: creat d9/de/df/f56 x:0 0 0 2023-10-18T20:58:19.392 INFO:tasks.workunit.client.0.smithi008.stdout:3/100: stat d0/d3/d15/f1a 0 2023-10-18T20:58:19.395 INFO:tasks.workunit.client.1.smithi060.stdout:8/126: dwrite d4/d9/fa [0,4194304] 0 2023-10-18T20:58:19.395 INFO:tasks.workunit.client.1.smithi060.stdout:8/127: creat d4/f25 x:0 0 0 2023-10-18T20:58:19.395 INFO:tasks.workunit.client.1.smithi060.stdout:8/128: dread - d4/f22 zero size 2023-10-18T20:58:19.399 INFO:tasks.workunit.client.1.smithi060.stdout:0/122: rename d3/f12 to d3/f26 0 2023-10-18T20:58:19.399 INFO:tasks.workunit.client.1.smithi060.stdout:0/123: chown d3/d8 15 1 2023-10-18T20:58:19.399 INFO:tasks.workunit.client.1.smithi060.stdout:0/124: read - d3/f21 zero size 2023-10-18T20:58:19.400 INFO:tasks.workunit.client.1.smithi060.stdout:0/125: write d3/f17 [8500395,2891] 0 2023-10-18T20:58:19.401 INFO:tasks.workunit.client.0.smithi008.stdout:4/152: dwrite d0/d3/d8/f26 [0,4194304] 0 2023-10-18T20:58:19.401 INFO:tasks.workunit.client.0.smithi008.stdout:8/229: dread d5/d8/d17/f44 [0,4194304] 0 2023-10-18T20:58:19.407 INFO:tasks.workunit.client.0.smithi008.stdout:8/230: creat d5/d8/d17/d36/f66 x:0 0 0 2023-10-18T20:58:19.407 INFO:tasks.workunit.client.0.smithi008.stdout:9/126: symlink d2/dc/d17/d19/l20 0 2023-10-18T20:58:19.413 INFO:tasks.workunit.client.1.smithi060.stdout:4/88: dwrite d4/dc/d11/f7 [0,4194304] 0 2023-10-18T20:58:19.414 INFO:tasks.workunit.client.1.smithi060.stdout:6/61: symlink d10/l16 0 2023-10-18T20:58:19.423 INFO:tasks.workunit.client.0.smithi008.stdout:6/182: dread df/d13/f17 [0,4194304] 0 2023-10-18T20:58:19.428 INFO:tasks.workunit.client.0.smithi008.stdout:0/114: mknod d0/c1e 0 2023-10-18T20:58:19.429 INFO:tasks.workunit.client.0.smithi008.stdout:7/121: dwrite d1/d3/fb [0,4194304] 0 2023-10-18T20:58:19.429 INFO:tasks.workunit.client.0.smithi008.stdout:7/122: write d1/d3/f1a [1104806,101276] 0 2023-10-18T20:58:19.430 INFO:tasks.workunit.client.1.smithi060.stdout:9/122: dwrite d3/d10/f24 [0,4194304] 0 2023-10-18T20:58:19.430 INFO:tasks.workunit.client.0.smithi008.stdout:7/123: creat d1/f29 x:0 0 0 2023-10-18T20:58:19.430 INFO:tasks.workunit.client.0.smithi008.stdout:7/124: dread - d1/d3/f1d zero size 2023-10-18T20:58:19.434 INFO:tasks.workunit.client.0.smithi008.stdout:3/101: dread d0/d3/de/f10 [0,4194304] 0 2023-10-18T20:58:19.435 INFO:tasks.workunit.client.1.smithi060.stdout:1/183: dwrite d4/da/de/d2a/d32/dd/f13 [4194304,4194304] 0 2023-10-18T20:58:19.435 INFO:tasks.workunit.client.0.smithi008.stdout:5/80: dwrite d0/d2/d9/f11 [0,4194304] 0 2023-10-18T20:58:19.436 INFO:tasks.workunit.client.0.smithi008.stdout:5/81: readlink d0/d2/d9/l17 0 2023-10-18T20:58:19.453 INFO:tasks.workunit.client.0.smithi008.stdout:4/153: mknod d0/c34 0 2023-10-18T20:58:19.456 INFO:tasks.workunit.client.0.smithi008.stdout:8/231: creat d5/d8/d17/d4d/f67 x:0 0 0 2023-10-18T20:58:19.457 INFO:tasks.workunit.client.1.smithi060.stdout:3/107: rmdir d0 39 2023-10-18T20:58:19.458 INFO:tasks.workunit.client.1.smithi060.stdout:1/184: dread d4/d6/d7/df/f2c [0,4194304] 0 2023-10-18T20:58:19.466 INFO:tasks.workunit.client.0.smithi008.stdout:9/127: dwrite d2/dc/d17/f16 [0,4194304] 0 2023-10-18T20:58:19.466 INFO:tasks.workunit.client.0.smithi008.stdout:9/128: write d2/f1b [807649,92201] 0 2023-10-18T20:58:19.466 INFO:tasks.workunit.client.0.smithi008.stdout:9/129: unlink c1 0 2023-10-18T20:58:19.467 INFO:tasks.workunit.client.0.smithi008.stdout:9/130: chown d2/dc/d17/f16 855625 1 2023-10-18T20:58:19.467 INFO:tasks.workunit.client.0.smithi008.stdout:9/131: chown d2/dc/f15 316 1 2023-10-18T20:58:19.467 INFO:tasks.workunit.client.0.smithi008.stdout:9/132: write d2/dc/f14 [1750636,67938] 0 2023-10-18T20:58:19.467 INFO:tasks.workunit.client.0.smithi008.stdout:5/82: dread d0/d2/d9/f11 [0,4194304] 0 2023-10-18T20:58:19.471 INFO:tasks.workunit.client.1.smithi060.stdout:2/124: sync 2023-10-18T20:58:19.471 INFO:tasks.workunit.client.1.smithi060.stdout:7/135: sync 2023-10-18T20:58:19.471 INFO:tasks.workunit.client.1.smithi060.stdout:2/125: chown d0/d16/f1c 169 1 2023-10-18T20:58:19.472 INFO:tasks.workunit.client.1.smithi060.stdout:2/126: chown d0/d3/f17 192364207 1 2023-10-18T20:58:19.472 INFO:tasks.workunit.client.1.smithi060.stdout:2/127: fsync d0/d8/fc 0 2023-10-18T20:58:19.472 INFO:tasks.workunit.client.1.smithi060.stdout:2/128: creat d0/d8/f2b x:0 0 0 2023-10-18T20:58:19.472 INFO:tasks.workunit.client.1.smithi060.stdout:2/129: chown d0/d16 740 1 2023-10-18T20:58:19.472 INFO:tasks.workunit.client.1.smithi060.stdout:2/130: chown d0/d3/c14 45831 1 2023-10-18T20:58:19.473 INFO:tasks.workunit.client.1.smithi060.stdout:2/131: stat d0/d3 0 2023-10-18T20:58:19.473 INFO:tasks.workunit.client.1.smithi060.stdout:5/178: sync 2023-10-18T20:58:19.475 INFO:tasks.workunit.client.1.smithi060.stdout:0/126: fsync d3/d8/f10 0 2023-10-18T20:58:19.478 INFO:tasks.workunit.client.1.smithi060.stdout:6/62: mkdir d10/d17 0 2023-10-18T20:58:19.478 INFO:tasks.workunit.client.1.smithi060.stdout:6/63: fsync d10/f13 0 2023-10-18T20:58:19.480 INFO:tasks.workunit.client.1.smithi060.stdout:3/108: read d0/f18 [3348304,74021] 0 2023-10-18T20:58:19.481 INFO:tasks.workunit.client.0.smithi008.stdout:6/183: creat df/d15/f40 x:0 0 0 2023-10-18T20:58:19.481 INFO:tasks.workunit.client.0.smithi008.stdout:6/184: stat df/d36 0 2023-10-18T20:58:19.481 INFO:tasks.workunit.client.0.smithi008.stdout:3/102: dwrite d0/d3/d15/f1a [0,4194304] 0 2023-10-18T20:58:19.482 INFO:tasks.workunit.client.1.smithi060.stdout:3/109: write d0/f1e [402733,128169] 0 2023-10-18T20:58:19.482 INFO:tasks.workunit.client.1.smithi060.stdout:3/110: write d0/f11 [144251,100192] 0 2023-10-18T20:58:19.483 INFO:tasks.workunit.client.0.smithi008.stdout:6/185: write df/f2e [557057,90671] 0 2023-10-18T20:58:19.483 INFO:tasks.workunit.client.0.smithi008.stdout:1/270: rmdir d9/de/df 39 2023-10-18T20:58:19.484 INFO:tasks.workunit.client.0.smithi008.stdout:1/271: read - d9/f54 zero size 2023-10-18T20:58:19.484 INFO:tasks.workunit.client.0.smithi008.stdout:1/272: fdatasync d9/de/df/d17/d25/f44 0 2023-10-18T20:58:19.484 INFO:tasks.workunit.client.0.smithi008.stdout:1/273: truncate d9/f51 6691 0 2023-10-18T20:58:19.484 INFO:tasks.workunit.client.0.smithi008.stdout:9/133: write d2/dc/f15 [219597,47782] 0 2023-10-18T20:58:19.485 INFO:tasks.workunit.client.1.smithi060.stdout:9/123: mknod d3/d10/d19/d28/c2c 0 2023-10-18T20:58:19.487 INFO:tasks.workunit.client.0.smithi008.stdout:7/125: dwrite d1/f6 [0,4194304] 0 2023-10-18T20:58:19.490 INFO:tasks.workunit.client.1.smithi060.stdout:1/185: unlink d4/l37 0 2023-10-18T20:58:19.491 INFO:tasks.workunit.client.1.smithi060.stdout:8/129: getdents d4/d9 0 2023-10-18T20:58:19.493 INFO:tasks.workunit.client.0.smithi008.stdout:4/154: link d0/c2 d0/d3/d21/c35 0 2023-10-18T20:58:19.493 INFO:tasks.workunit.client.1.smithi060.stdout:9/124: dread d3/d10/f18 [0,4194304] 0 2023-10-18T20:58:19.495 INFO:tasks.workunit.client.1.smithi060.stdout:7/136: rename de/f2e to de/d14/f30 0 2023-10-18T20:58:19.499 INFO:tasks.workunit.client.0.smithi008.stdout:8/232: mknod d5/d8/d17/d36/c68 0 2023-10-18T20:58:19.504 INFO:tasks.workunit.client.1.smithi060.stdout:5/179: symlink d0/d6/d8/df/l46 0 2023-10-18T20:58:19.506 INFO:tasks.workunit.client.1.smithi060.stdout:3/111: read d0/fa [46737,105509] 0 2023-10-18T20:58:19.509 INFO:tasks.workunit.client.1.smithi060.stdout:0/127: creat d3/d8/f27 x:0 0 0 2023-10-18T20:58:19.512 INFO:tasks.workunit.client.1.smithi060.stdout:2/132: dwrite d0/d8/f11 [0,4194304] 0 2023-10-18T20:58:19.512 INFO:tasks.workunit.client.1.smithi060.stdout:2/133: write d0/d8/f1b [1636453,59150] 0 2023-10-18T20:58:19.518 INFO:tasks.workunit.client.1.smithi060.stdout:4/89: truncate d4/f1a 3326715 0 2023-10-18T20:58:19.519 INFO:tasks.workunit.client.1.smithi060.stdout:6/64: mkdir d10/d17/d18 0 2023-10-18T20:58:19.519 INFO:tasks.workunit.client.1.smithi060.stdout:6/65: stat fc 0 2023-10-18T20:58:19.520 INFO:tasks.workunit.client.1.smithi060.stdout:6/66: creat d10/f19 x:0 0 0 2023-10-18T20:58:19.520 INFO:tasks.workunit.client.1.smithi060.stdout:6/67: fsync fb 0 2023-10-18T20:58:19.520 INFO:tasks.workunit.client.1.smithi060.stdout:1/186: mknod d4/d6/c3c 0 2023-10-18T20:58:19.521 INFO:tasks.workunit.client.1.smithi060.stdout:1/187: stat d4/d6/d7/df 0 2023-10-18T20:58:19.521 INFO:tasks.workunit.client.0.smithi008.stdout:3/103: symlink d0/d3/l1d 0 2023-10-18T20:58:19.522 INFO:tasks.workunit.client.1.smithi060.stdout:9/125: mkdir d3/d10/d1c/d2a/d2d 0 2023-10-18T20:58:19.523 INFO:tasks.workunit.client.0.smithi008.stdout:6/186: symlink df/l41 0 2023-10-18T20:58:19.525 INFO:tasks.workunit.client.1.smithi060.stdout:8/130: rename d4/c11 to d4/d9/c26 0 2023-10-18T20:58:19.527 INFO:tasks.workunit.client.1.smithi060.stdout:8/131: write d4/d9/f23 [1064502,101711] 0 2023-10-18T20:58:19.527 INFO:tasks.workunit.client.1.smithi060.stdout:7/137: creat de/d29/f31 x:0 0 0 2023-10-18T20:58:19.528 INFO:tasks.workunit.client.0.smithi008.stdout:1/274: mkdir d9/de/df/d17/d25/d57 0 2023-10-18T20:58:19.530 INFO:tasks.workunit.client.1.smithi060.stdout:5/180: mkdir d0/d47 0 2023-10-18T20:58:19.532 INFO:tasks.workunit.client.0.smithi008.stdout:6/187: dread df/d15/d27/f28 [0,4194304] 0 2023-10-18T20:58:19.533 INFO:tasks.workunit.client.0.smithi008.stdout:9/134: truncate d2/f4 4288195 0 2023-10-18T20:58:19.539 INFO:tasks.workunit.client.0.smithi008.stdout:7/126: creat d1/d3/f2a x:0 0 0 2023-10-18T20:58:19.541 INFO:tasks.workunit.client.1.smithi060.stdout:6/68: symlink d10/d17/d18/l1a 0 2023-10-18T20:58:19.542 INFO:tasks.workunit.client.1.smithi060.stdout:6/69: chown c9 841814 1 2023-10-18T20:58:19.542 INFO:tasks.workunit.client.1.smithi060.stdout:6/70: truncate fc 1034415 0 2023-10-18T20:58:19.542 INFO:tasks.workunit.client.1.smithi060.stdout:6/71: truncate fe 197141 0 2023-10-18T20:58:19.543 INFO:tasks.workunit.client.0.smithi008.stdout:9/135: dread d2/d8/f9 [0,4194304] 0 2023-10-18T20:58:19.543 INFO:tasks.workunit.client.1.smithi060.stdout:5/181: dread d0/d6/f42 [0,4194304] 0 2023-10-18T20:58:19.544 INFO:tasks.workunit.client.1.smithi060.stdout:5/182: stat d0/dd/d33 0 2023-10-18T20:58:19.544 INFO:tasks.workunit.client.1.smithi060.stdout:9/126: creat d3/d10/d1c/d2a/d2d/f2e x:0 0 0 2023-10-18T20:58:19.549 INFO:tasks.workunit.client.1.smithi060.stdout:3/112: rename d0/c1a to d0/d22/d26/c27 0 2023-10-18T20:58:19.550 INFO:tasks.workunit.client.1.smithi060.stdout:3/113: readlink d0/l4 0 2023-10-18T20:58:19.550 INFO:tasks.workunit.client.1.smithi060.stdout:3/114: write d0/fd [663262,11165] 0 2023-10-18T20:58:19.553 INFO:tasks.workunit.client.1.smithi060.stdout:8/132: mknod d4/c27 0 2023-10-18T20:58:19.557 INFO:tasks.workunit.client.1.smithi060.stdout:7/138: truncate de/f1f 511568 0 2023-10-18T20:58:19.557 INFO:tasks.workunit.client.1.smithi060.stdout:7/139: chown de/d29/f2b 20252 1 2023-10-18T20:58:19.558 INFO:tasks.workunit.client.1.smithi060.stdout:5/183: mknod d0/d6/db/c48 0 2023-10-18T20:58:19.558 INFO:tasks.workunit.client.1.smithi060.stdout:5/184: chown d0/d6/d8/df/d27/d32/f39 26 1 2023-10-18T20:58:19.560 INFO:tasks.workunit.client.1.smithi060.stdout:9/127: mknod d3/d10/d19/d28/d29/c2f 0 2023-10-18T20:58:19.566 INFO:tasks.workunit.client.0.smithi008.stdout:4/155: rmdir d0/d3/d8/d2a 39 2023-10-18T20:58:19.566 INFO:tasks.workunit.client.0.smithi008.stdout:5/83: truncate d0/f8 540056 0 2023-10-18T20:58:19.569 INFO:tasks.workunit.client.1.smithi060.stdout:4/90: rename d4/f1a to d4/dc/d11/f1e 0 2023-10-18T20:58:19.569 INFO:tasks.workunit.client.1.smithi060.stdout:4/91: chown d4/dc/d11/d13 30582 1 2023-10-18T20:58:19.570 INFO:tasks.workunit.client.0.smithi008.stdout:3/104: creat d0/d3/d15/f1e x:0 0 0 2023-10-18T20:58:19.571 INFO:tasks.workunit.client.0.smithi008.stdout:3/105: fdatasync d0/d3/fd 0 2023-10-18T20:58:19.571 INFO:tasks.workunit.client.0.smithi008.stdout:3/106: rename d0/d3 to d0/d3/d15/d1f 22 2023-10-18T20:58:19.571 INFO:tasks.workunit.client.1.smithi060.stdout:9/128: dread d3/d10/f11 [0,4194304] 0 2023-10-18T20:58:19.572 INFO:tasks.workunit.client.0.smithi008.stdout:5/84: dread d0/d2/f12 [0,4194304] 0 2023-10-18T20:58:19.572 INFO:tasks.workunit.client.1.smithi060.stdout:8/133: symlink d4/d9/l28 0 2023-10-18T20:58:19.573 INFO:tasks.workunit.client.1.smithi060.stdout:8/134: truncate d4/d9/f21 209257 0 2023-10-18T20:58:19.573 INFO:tasks.workunit.client.1.smithi060.stdout:8/135: chown d4/d9/f21 415302 1 2023-10-18T20:58:19.573 INFO:tasks.workunit.client.1.smithi060.stdout:8/136: write d4/f25 [584379,40083] 0 2023-10-18T20:58:19.573 INFO:tasks.workunit.client.1.smithi060.stdout:8/137: truncate d4/d9/f1b 3958771 0 2023-10-18T20:58:19.574 INFO:tasks.workunit.client.0.smithi008.stdout:1/275: truncate d9/de/df/d17/d25/f32 6530924 0 2023-10-18T20:58:19.577 INFO:tasks.workunit.client.1.smithi060.stdout:0/128: dwrite d3/f19 [0,4194304] 0 2023-10-18T20:58:19.577 INFO:tasks.workunit.client.1.smithi060.stdout:2/134: dwrite d0/d3/f13 [0,4194304] 0 2023-10-18T20:58:19.578 INFO:tasks.workunit.client.1.smithi060.stdout:2/135: chown d0/d8 20060 1 2023-10-18T20:58:19.581 INFO:tasks.workunit.client.0.smithi008.stdout:6/188: mknod df/d36/c42 0 2023-10-18T20:58:19.581 INFO:tasks.workunit.client.0.smithi008.stdout:6/189: chown df/d26/l34 4 1 2023-10-18T20:58:19.582 INFO:tasks.workunit.client.0.smithi008.stdout:6/190: write df/d13/f17 [1338513,103274] 0 2023-10-18T20:58:19.582 INFO:tasks.workunit.client.0.smithi008.stdout:7/127: symlink d1/d3/d20/l2b 0 2023-10-18T20:58:19.583 INFO:tasks.workunit.client.1.smithi060.stdout:7/140: symlink de/d14/d2f/l32 0 2023-10-18T20:58:19.588 INFO:tasks.workunit.client.1.smithi060.stdout:8/138: read d4/f15 [11818,61781] 0 2023-10-18T20:58:19.588 INFO:tasks.workunit.client.1.smithi060.stdout:8/139: chown d4/f15 33408034 1 2023-10-18T20:58:19.588 INFO:tasks.workunit.client.1.smithi060.stdout:8/140: stat d4/d9/c1e 0 2023-10-18T20:58:19.589 INFO:tasks.workunit.client.1.smithi060.stdout:8/141: truncate d4/ff 72615 0 2023-10-18T20:58:19.590 INFO:tasks.workunit.client.1.smithi060.stdout:6/72: rename d10/d17/d18 to d10/d1b 0 2023-10-18T20:58:19.596 INFO:tasks.workunit.client.1.smithi060.stdout:6/73: dread fc [0,4194304] 0 2023-10-18T20:58:19.602 INFO:tasks.workunit.client.0.smithi008.stdout:9/136: creat d2/dc/d1a/f21 x:0 0 0 2023-10-18T20:58:19.602 INFO:tasks.workunit.client.0.smithi008.stdout:9/137: readlink d2/dc/d17/d19/l20 0 2023-10-18T20:58:19.603 INFO:tasks.workunit.client.0.smithi008.stdout:9/138: write d2/dc/f15 [305768,51873] 0 2023-10-18T20:58:19.603 INFO:tasks.workunit.client.0.smithi008.stdout:9/139: creat d2/dc/f22 x:0 0 0 2023-10-18T20:58:19.604 INFO:tasks.workunit.client.1.smithi060.stdout:9/129: link d3/d10/d19/d28/d29/c2f d3/d10/d19/d28/d29/c30 0 2023-10-18T20:58:19.604 INFO:tasks.workunit.client.0.smithi008.stdout:9/140: write d2/dc/f14 [1782202,78882] 0 2023-10-18T20:58:19.605 INFO:tasks.workunit.client.0.smithi008.stdout:8/233: getdents d5/d8/d17/d36 0 2023-10-18T20:58:19.605 INFO:tasks.workunit.client.0.smithi008.stdout:8/234: write d5/d8/df/f3a [937168,124762] 0 2023-10-18T20:58:19.607 INFO:tasks.workunit.client.1.smithi060.stdout:3/115: dwrite d0/f24 [0,4194304] 0 2023-10-18T20:58:19.607 INFO:tasks.workunit.client.1.smithi060.stdout:3/116: chown d0/l9 71717 1 2023-10-18T20:58:19.608 INFO:tasks.workunit.client.1.smithi060.stdout:3/117: chown d0/f11 0 1 2023-10-18T20:58:19.608 INFO:tasks.workunit.client.1.smithi060.stdout:3/118: chown d0/f1f 918434 1 2023-10-18T20:58:19.608 INFO:tasks.workunit.client.1.smithi060.stdout:3/119: dread - d0/f1b zero size 2023-10-18T20:58:19.608 INFO:tasks.workunit.client.1.smithi060.stdout:3/120: fsync d0/fb 0 2023-10-18T20:58:19.617 INFO:tasks.workunit.client.0.smithi008.stdout:4/156: unlink d0/d3/l10 0 2023-10-18T20:58:19.617 INFO:tasks.workunit.client.0.smithi008.stdout:3/107: creat d0/d3/de/f20 x:0 0 0 2023-10-18T20:58:19.620 INFO:tasks.workunit.client.0.smithi008.stdout:7/128: mknod d1/d3/c2c 0 2023-10-18T20:58:19.623 INFO:tasks.workunit.client.0.smithi008.stdout:7/129: write d1/d3/f1a [1047696,10163] 0 2023-10-18T20:58:19.624 INFO:tasks.workunit.client.0.smithi008.stdout:1/276: dwrite d9/de/f1c [0,4194304] 0 2023-10-18T20:58:19.628 INFO:tasks.workunit.client.0.smithi008.stdout:9/141: symlink d2/dc/d17/l23 0 2023-10-18T20:58:19.629 INFO:tasks.workunit.client.1.smithi060.stdout:8/142: mknod d4/c29 0 2023-10-18T20:58:19.630 INFO:tasks.workunit.client.0.smithi008.stdout:8/235: mknod d5/d8/df/d54/c69 0 2023-10-18T20:58:19.631 INFO:tasks.workunit.client.0.smithi008.stdout:8/236: write d5/d8/df/f39 [325943,26447] 0 2023-10-18T20:58:19.631 INFO:tasks.workunit.client.0.smithi008.stdout:8/237: creat d5/d8/d24/d50/f6a x:0 0 0 2023-10-18T20:58:19.631 INFO:tasks.workunit.client.0.smithi008.stdout:8/238: read - d5/d8/d17/d36/f66 zero size 2023-10-18T20:58:19.639 INFO:tasks.workunit.client.1.smithi060.stdout:2/136: rename d0/d3/f13 to d0/d8/f2c 0 2023-10-18T20:58:19.649 INFO:tasks.workunit.client.0.smithi008.stdout:1/277: dread d9/fc [0,4194304] 0 2023-10-18T20:58:19.650 INFO:tasks.workunit.client.1.smithi060.stdout:6/74: unlink d10/l11 0 2023-10-18T20:58:19.653 INFO:tasks.workunit.client.1.smithi060.stdout:8/143: dread d4/f13 [0,4194304] 0 2023-10-18T20:58:19.653 INFO:tasks.workunit.client.1.smithi060.stdout:8/144: stat d4/d9/l28 0 2023-10-18T20:58:19.653 INFO:tasks.workunit.client.1.smithi060.stdout:8/145: read d4/ff [28315,103874] 0 2023-10-18T20:58:19.660 INFO:tasks.workunit.client.1.smithi060.stdout:6/75: dread fc [0,4194304] 0 2023-10-18T20:58:19.660 INFO:tasks.workunit.client.0.smithi008.stdout:8/239: dread d5/f4b [0,4194304] 0 2023-10-18T20:58:19.661 INFO:tasks.workunit.client.0.smithi008.stdout:8/240: write d5/d8/d17/d36/f46 [658622,115706] 0 2023-10-18T20:58:19.664 INFO:tasks.workunit.client.0.smithi008.stdout:8/241: read d5/f28 [619789,59184] 0 2023-10-18T20:58:19.684 INFO:tasks.workunit.client.1.smithi060.stdout:2/137: dwrite d0/f22 [0,4194304] 0 2023-10-18T20:58:19.701 INFO:tasks.workunit.client.0.smithi008.stdout:5/85: dwrite d0/d2/f16 [4194304,4194304] 0 2023-10-18T20:58:19.702 INFO:tasks.workunit.client.0.smithi008.stdout:5/86: chown d0/d2/d9/f11 7 1 2023-10-18T20:58:19.713 INFO:tasks.workunit.client.1.smithi060.stdout:6/76: dwrite fa [8388608,4194304] 0 2023-10-18T20:58:19.729 INFO:tasks.workunit.client.1.smithi060.stdout:2/138: dwrite d0/d16/f28 [0,4194304] 0 2023-10-18T20:58:19.736 INFO:tasks.workunit.client.1.smithi060.stdout:2/139: dread d0/d8/fa [0,4194304] 0 2023-10-18T20:58:19.751 INFO:tasks.workunit.client.0.smithi008.stdout:7/130: rmdir d1 39 2023-10-18T20:58:19.758 INFO:tasks.workunit.client.0.smithi008.stdout:6/191: dwrite df/d26/f31 [4194304,4194304] 0 2023-10-18T20:58:19.758 INFO:tasks.workunit.client.0.smithi008.stdout:6/192: stat df/d18/d3f 0 2023-10-18T20:58:19.758 INFO:tasks.workunit.client.0.smithi008.stdout:6/193: readlink df/l2a 0 2023-10-18T20:58:19.758 INFO:tasks.workunit.client.0.smithi008.stdout:6/194: readlink l4 0 2023-10-18T20:58:19.761 INFO:tasks.workunit.client.0.smithi008.stdout:4/157: dread d0/f27 [0,4194304] 0 2023-10-18T20:58:19.767 INFO:tasks.workunit.client.0.smithi008.stdout:7/131: write d1/f1f [132618,62676] 0 2023-10-18T20:58:19.770 INFO:tasks.workunit.client.0.smithi008.stdout:5/87: symlink d0/l1a 0 2023-10-18T20:58:19.770 INFO:tasks.workunit.client.0.smithi008.stdout:5/88: write d0/d2/f12 [988575,53606] 0 2023-10-18T20:58:19.773 INFO:tasks.workunit.client.0.smithi008.stdout:9/142: dwrite d2/f4 [0,4194304] 0 2023-10-18T20:58:19.773 INFO:tasks.workunit.client.0.smithi008.stdout:8/242: dread d5/d8/d24/d50/f5e [0,4194304] 0 2023-10-18T20:58:19.777 INFO:tasks.workunit.client.1.smithi060.stdout:9/130: link f2 d3/d10/d19/d28/f31 0 2023-10-18T20:58:19.801 INFO:tasks.workunit.client.1.smithi060.stdout:3/121: mknod d0/d22/d26/c28 0 2023-10-18T20:58:19.837 INFO:tasks.workunit.client.1.smithi060.stdout:0/129: link d3/f26 d3/d8/f28 0 2023-10-18T20:58:19.838 INFO:tasks.workunit.client.1.smithi060.stdout:0/130: dread - d3/d8/d14/f1d zero size 2023-10-18T20:58:19.843 INFO:tasks.workunit.client.1.smithi060.stdout:7/141: getdents de/d14/d1d 0 2023-10-18T20:58:19.843 INFO:tasks.workunit.client.1.smithi060.stdout:7/142: write de/d29/f2b [244806,115965] 0 2023-10-18T20:58:19.844 INFO:tasks.workunit.client.1.smithi060.stdout:7/143: creat de/d29/f33 x:0 0 0 2023-10-18T20:58:19.844 INFO:tasks.workunit.client.1.smithi060.stdout:7/144: fsync de/f27 0 2023-10-18T20:58:19.845 INFO:tasks.workunit.client.1.smithi060.stdout:8/146: unlink d4/l20 0 2023-10-18T20:58:19.849 INFO:tasks.workunit.client.1.smithi060.stdout:7/145: fdatasync de/d29/f2b 0 2023-10-18T20:58:19.850 INFO:tasks.workunit.client.1.smithi060.stdout:7/146: write de/f1a [759555,20079] 0 2023-10-18T20:58:19.862 INFO:tasks.workunit.client.1.smithi060.stdout:7/147: dread fc [0,4194304] 0 2023-10-18T20:58:19.866 INFO:tasks.workunit.client.1.smithi060.stdout:4/92: sync 2023-10-18T20:58:19.866 INFO:tasks.workunit.client.1.smithi060.stdout:1/188: sync 2023-10-18T20:58:19.866 INFO:tasks.workunit.client.1.smithi060.stdout:5/185: sync 2023-10-18T20:58:19.866 INFO:tasks.workunit.client.1.smithi060.stdout:5/186: stat d0/dd/d33/f3e 0 2023-10-18T20:58:19.867 INFO:tasks.workunit.client.0.smithi008.stdout:6/195: getdents df 0 2023-10-18T20:58:19.871 INFO:tasks.workunit.client.0.smithi008.stdout:4/158: mknod d0/d3/c36 0 2023-10-18T20:58:19.875 INFO:tasks.workunit.client.1.smithi060.stdout:4/93: write d4/dc/d11/f7 [2360959,57516] 0 2023-10-18T20:58:19.876 INFO:tasks.workunit.client.0.smithi008.stdout:7/132: truncate d1/f4 3731228 0 2023-10-18T20:58:19.878 INFO:tasks.workunit.client.1.smithi060.stdout:8/147: dread d4/d9/fa [0,4194304] 0 2023-10-18T20:58:19.879 INFO:tasks.workunit.client.0.smithi008.stdout:5/89: mkdir d0/d2/d19/d1b 0 2023-10-18T20:58:19.887 INFO:tasks.workunit.client.0.smithi008.stdout:6/196: dread df/f2e [0,4194304] 0 2023-10-18T20:58:19.895 INFO:tasks.workunit.client.0.smithi008.stdout:9/143: mknod d2/dc/c24 0 2023-10-18T20:58:19.895 INFO:tasks.workunit.client.1.smithi060.stdout:6/77: getdents d10/d1b 0 2023-10-18T20:58:19.896 INFO:tasks.workunit.client.1.smithi060.stdout:6/78: readlink d10/l16 0 2023-10-18T20:58:19.897 INFO:tasks.workunit.client.0.smithi008.stdout:8/243: creat d5/d8/df/f6b x:0 0 0 2023-10-18T20:58:19.898 INFO:tasks.workunit.client.0.smithi008.stdout:5/90: dread d0/f8 [0,4194304] 0 2023-10-18T20:58:19.898 INFO:tasks.workunit.client.0.smithi008.stdout:5/91: chown d0/f3 914000 1 2023-10-18T20:58:19.899 INFO:tasks.workunit.client.0.smithi008.stdout:5/92: chown d0/f3 819 1 2023-10-18T20:58:19.903 INFO:tasks.workunit.client.0.smithi008.stdout:4/159: creat d0/d3/f37 x:0 0 0 2023-10-18T20:58:19.909 INFO:tasks.workunit.client.0.smithi008.stdout:1/278: rename d9/fb to d9/de/f58 0 2023-10-18T20:58:19.917 INFO:tasks.workunit.client.1.smithi060.stdout:8/148: dwrite d4/d9/fa [0,4194304] 0 2023-10-18T20:58:19.919 INFO:tasks.workunit.client.0.smithi008.stdout:7/133: unlink d1/c26 0 2023-10-18T20:58:19.920 INFO:tasks.workunit.client.0.smithi008.stdout:7/134: read - d1/d3/f1d zero size 2023-10-18T20:58:19.933 INFO:tasks.workunit.client.0.smithi008.stdout:6/197: symlink df/d13/l43 0 2023-10-18T20:58:19.933 INFO:tasks.workunit.client.0.smithi008.stdout:6/198: fsync df/d15/d27/f28 0 2023-10-18T20:58:19.933 INFO:tasks.workunit.client.0.smithi008.stdout:6/199: readlink df/d18/l25 0 2023-10-18T20:58:19.934 INFO:tasks.workunit.client.1.smithi060.stdout:8/149: write d4/f19 [2584034,61389] 0 2023-10-18T20:58:19.936 INFO:tasks.workunit.client.0.smithi008.stdout:8/244: rename d5/d8/d17/d36 to d5/d8/d17/d6c 0 2023-10-18T20:58:19.937 INFO:tasks.workunit.client.0.smithi008.stdout:8/245: creat d5/d8/d17/d4d/f6d x:0 0 0 2023-10-18T20:58:19.937 INFO:tasks.workunit.client.0.smithi008.stdout:8/246: read d5/f18 [508763,7786] 0 2023-10-18T20:58:19.937 INFO:tasks.workunit.client.0.smithi008.stdout:8/247: creat d5/d8/df/d54/d58/f6e x:0 0 0 2023-10-18T20:58:19.941 INFO:tasks.workunit.client.0.smithi008.stdout:5/93: creat d0/f1c x:0 0 0 2023-10-18T20:58:19.941 INFO:tasks.workunit.client.0.smithi008.stdout:5/94: write d0/f8 [693987,114631] 0 2023-10-18T20:58:19.944 INFO:tasks.workunit.client.0.smithi008.stdout:4/160: stat d0/d3/c7 0 2023-10-18T20:58:19.944 INFO:tasks.workunit.client.0.smithi008.stdout:0/115: sync 2023-10-18T20:58:19.944 INFO:tasks.workunit.client.0.smithi008.stdout:0/116: fdatasync d0/f11 0 2023-10-18T20:58:19.944 INFO:tasks.workunit.client.0.smithi008.stdout:2/159: sync 2023-10-18T20:58:19.950 INFO:tasks.workunit.client.0.smithi008.stdout:3/108: sync 2023-10-18T20:58:19.950 INFO:tasks.workunit.client.0.smithi008.stdout:3/109: chown d0/d3/de/f20 280 1 2023-10-18T20:58:19.950 INFO:tasks.workunit.client.0.smithi008.stdout:3/110: truncate d0/d3/de/d13/f1c 641696 0 2023-10-18T20:58:19.951 INFO:tasks.workunit.client.1.smithi060.stdout:2/140: symlink d0/d8/l2d 0 2023-10-18T20:58:19.951 INFO:tasks.workunit.client.1.smithi060.stdout:2/141: chown d0/d3/d27 0 1 2023-10-18T20:58:19.954 INFO:tasks.workunit.client.0.smithi008.stdout:9/144: rename d2/dc/d17/c18 to d2/dc/d17/d19/c25 0 2023-10-18T20:58:19.955 INFO:tasks.workunit.client.0.smithi008.stdout:2/160: dread d1/d3/dd/f1e [0,4194304] 0 2023-10-18T20:58:19.956 INFO:tasks.workunit.client.0.smithi008.stdout:1/279: symlink d9/l59 0 2023-10-18T20:58:19.959 INFO:tasks.workunit.client.0.smithi008.stdout:2/161: truncate d1/f19 1005099 0 2023-10-18T20:58:19.959 INFO:tasks.workunit.client.0.smithi008.stdout:5/95: symlink d0/d2/d9/l1d 0 2023-10-18T20:58:19.966 INFO:tasks.workunit.client.0.smithi008.stdout:7/135: rename d1/c7 to d1/d3/d20/c2d 0 2023-10-18T20:58:19.969 INFO:tasks.workunit.client.0.smithi008.stdout:2/162: creat d1/d3/dd/d1c/d3a/f3d x:0 0 0 2023-10-18T20:58:19.969 INFO:tasks.workunit.client.0.smithi008.stdout:2/163: truncate d1/d3/dd/d1c/d3a/f3d 672300 0 2023-10-18T20:58:19.970 INFO:tasks.workunit.client.0.smithi008.stdout:2/164: creat d1/d3/dd/d1c/f3e x:0 0 0 2023-10-18T20:58:19.974 INFO:tasks.workunit.client.0.smithi008.stdout:0/117: symlink d0/l1f 0 2023-10-18T20:58:19.976 INFO:tasks.workunit.client.0.smithi008.stdout:4/161: dread d0/d3/d21/f24 [0,4194304] 0 2023-10-18T20:58:19.981 INFO:tasks.workunit.client.1.smithi060.stdout:9/131: rename d3/d10/f14 to d3/d10/d1c/d2a/f32 0 2023-10-18T20:58:19.985 INFO:tasks.workunit.client.0.smithi008.stdout:6/200: dwrite df/d13/f17 [0,4194304] 0 2023-10-18T20:58:19.985 INFO:tasks.workunit.client.0.smithi008.stdout:6/201: truncate df/d13/f1a 4965831 0 2023-10-18T20:58:19.992 INFO:tasks.workunit.client.0.smithi008.stdout:3/111: dread d0/f7 [0,4194304] 0 2023-10-18T20:58:20.003 INFO:tasks.workunit.client.0.smithi008.stdout:7/136: dread d1/d3/fb [0,4194304] 0 2023-10-18T20:58:20.019 INFO:tasks.workunit.client.1.smithi060.stdout:2/142: dwrite d0/d8/f1b [0,4194304] 0 2023-10-18T20:58:20.021 INFO:tasks.workunit.client.0.smithi008.stdout:3/112: dread d0/d3/fd [0,4194304] 0 2023-10-18T20:58:20.021 INFO:tasks.workunit.client.0.smithi008.stdout:3/113: readlink d0/d3/l1d 0 2023-10-18T20:58:20.027 INFO:tasks.workunit.client.0.smithi008.stdout:9/145: dwrite d2/dc/f1c [0,4194304] 0 2023-10-18T20:58:20.028 INFO:tasks.workunit.client.0.smithi008.stdout:1/280: dwrite d9/de/f1c [0,4194304] 0 2023-10-18T20:58:20.028 INFO:tasks.workunit.client.0.smithi008.stdout:1/281: chown d9/de/df/d17/d25/l3b 298405674 1 2023-10-18T20:58:20.028 INFO:tasks.workunit.client.0.smithi008.stdout:2/165: creat d1/d3/dd/d1c/d39/f3f x:0 0 0 2023-10-18T20:58:20.029 INFO:tasks.workunit.client.0.smithi008.stdout:1/282: write d9/f42 [68318,72838] 0 2023-10-18T20:58:20.029 INFO:tasks.workunit.client.0.smithi008.stdout:1/283: chown d9/de/df/d17/l34 1 1 2023-10-18T20:58:20.029 INFO:tasks.workunit.client.0.smithi008.stdout:9/146: read d2/f5 [264516,74462] 0 2023-10-18T20:58:20.029 INFO:tasks.workunit.client.0.smithi008.stdout:9/147: creat d2/f26 x:0 0 0 2023-10-18T20:58:20.034 INFO:tasks.workunit.client.1.smithi060.stdout:3/122: unlink d0/f2 0 2023-10-18T20:58:20.034 INFO:tasks.workunit.client.1.smithi060.stdout:3/123: write d0/ff [825510,12549] 0 2023-10-18T20:58:20.034 INFO:tasks.workunit.client.1.smithi060.stdout:3/124: chown d0/f20 229309 1 2023-10-18T20:58:20.034 INFO:tasks.workunit.client.1.smithi060.stdout:3/125: dread - d0/f1d zero size 2023-10-18T20:58:20.034 INFO:tasks.workunit.client.1.smithi060.stdout:3/126: stat d0/fd 0 2023-10-18T20:58:20.035 INFO:tasks.workunit.client.0.smithi008.stdout:0/118: mkdir d0/dd/df/d20 0 2023-10-18T20:58:20.041 INFO:tasks.workunit.client.0.smithi008.stdout:4/162: dwrite d0/d17/f1a [0,4194304] 0 2023-10-18T20:58:20.041 INFO:tasks.workunit.client.0.smithi008.stdout:4/163: truncate d0/d3/d21/f2c 546543 0 2023-10-18T20:58:20.041 INFO:tasks.workunit.client.0.smithi008.stdout:4/164: write d0/f14 [5651639,28912] 0 2023-10-18T20:58:20.042 INFO:tasks.workunit.client.0.smithi008.stdout:4/165: chown d0/d17/f1a 0 1 2023-10-18T20:58:20.042 INFO:tasks.workunit.client.0.smithi008.stdout:4/166: creat d0/d3/f38 x:0 0 0 2023-10-18T20:58:20.042 INFO:tasks.workunit.client.0.smithi008.stdout:4/167: write d0/d3/d8/fa [1094478,95013] 0 2023-10-18T20:58:20.043 INFO:tasks.workunit.client.0.smithi008.stdout:6/202: link df/l10 df/d15/l44 0 2023-10-18T20:58:20.043 INFO:tasks.workunit.client.1.smithi060.stdout:3/127: dread d0/fb [0,4194304] 0 2023-10-18T20:58:20.043 INFO:tasks.workunit.client.1.smithi060.stdout:3/128: unlink d0/l23 0 2023-10-18T20:58:20.043 INFO:tasks.workunit.client.1.smithi060.stdout:7/148: truncate de/ff 3163344 0 2023-10-18T20:58:20.044 INFO:tasks.workunit.client.0.smithi008.stdout:7/137: rmdir d1/d3/d20 39 2023-10-18T20:58:20.044 INFO:tasks.workunit.client.1.smithi060.stdout:1/189: rmdir d4/d6 39 2023-10-18T20:58:20.045 INFO:tasks.workunit.client.1.smithi060.stdout:1/190: read d4/da/de/d2a/d32/dd/f13 [2607541,101730] 0 2023-10-18T20:58:20.046 INFO:tasks.workunit.client.0.smithi008.stdout:3/114: rename d0/d3/d15/f1e to d0/d3/d15/f21 0 2023-10-18T20:58:20.051 INFO:tasks.workunit.client.1.smithi060.stdout:6/79: symlink d10/l1c 0 2023-10-18T20:58:20.051 INFO:tasks.workunit.client.1.smithi060.stdout:6/80: readlink d10/l12 0 2023-10-18T20:58:20.058 INFO:tasks.workunit.client.0.smithi008.stdout:2/166: mkdir d1/d3/d40 0 2023-10-18T20:58:20.059 INFO:tasks.workunit.client.1.smithi060.stdout:8/150: truncate d4/f1f 1019458 0 2023-10-18T20:58:20.060 INFO:tasks.workunit.client.1.smithi060.stdout:6/81: dread f8 [0,4194304] 0 2023-10-18T20:58:20.062 INFO:tasks.workunit.client.0.smithi008.stdout:1/284: symlink d9/de/df/l5a 0 2023-10-18T20:58:20.069 INFO:tasks.workunit.client.1.smithi060.stdout:9/132: rename d3/d10/d19/d28 to d3/d10/d1c/d2a/d33 0 2023-10-18T20:58:20.069 INFO:tasks.workunit.client.0.smithi008.stdout:0/119: mkdir d0/dd/df/d20/d21 0 2023-10-18T20:58:20.073 INFO:tasks.workunit.client.0.smithi008.stdout:8/248: rename d5/d8/df/d54/d58 to d5/d8/df/d6f 0 2023-10-18T20:58:20.076 INFO:tasks.workunit.client.0.smithi008.stdout:2/167: dread d1/d3/dd/d1c/f3c [0,4194304] 0 2023-10-18T20:58:20.078 INFO:tasks.workunit.client.0.smithi008.stdout:4/168: mknod d0/c39 0 2023-10-18T20:58:20.078 INFO:tasks.workunit.client.0.smithi008.stdout:4/169: readlink d0/d3/l2e 0 2023-10-18T20:58:20.078 INFO:tasks.workunit.client.0.smithi008.stdout:6/203: stat l2 0 2023-10-18T20:58:20.080 INFO:tasks.workunit.client.0.smithi008.stdout:3/115: creat d0/d3/de/d13/f22 x:0 0 0 2023-10-18T20:58:20.081 INFO:tasks.workunit.client.0.smithi008.stdout:3/116: chown d0/d3/fd 142 1 2023-10-18T20:58:20.081 INFO:tasks.workunit.client.1.smithi060.stdout:9/133: dread d3/d10/f24 [0,4194304] 0 2023-10-18T20:58:20.082 INFO:tasks.workunit.client.0.smithi008.stdout:1/285: creat d9/de/df/f5b x:0 0 0 2023-10-18T20:58:20.082 INFO:tasks.workunit.client.0.smithi008.stdout:1/286: chown d9/ld 57716228 1 2023-10-18T20:58:20.083 INFO:tasks.workunit.client.0.smithi008.stdout:9/148: rmdir d2/dc/d1a 39 2023-10-18T20:58:20.086 INFO:tasks.workunit.client.0.smithi008.stdout:0/120: truncate d0/fb 186959 0 2023-10-18T20:58:20.087 INFO:tasks.workunit.client.0.smithi008.stdout:8/249: creat d5/f70 x:0 0 0 2023-10-18T20:58:20.091 INFO:tasks.workunit.client.0.smithi008.stdout:5/96: rename d0/l1a to d0/d2/l1e 0 2023-10-18T20:58:20.091 INFO:tasks.workunit.client.0.smithi008.stdout:5/97: readlink d0/d2/d9/l1d 0 2023-10-18T20:58:20.091 INFO:tasks.workunit.client.0.smithi008.stdout:5/98: write d0/f1c [638321,103701] 0 2023-10-18T20:58:20.093 INFO:tasks.workunit.client.0.smithi008.stdout:2/168: mknod d1/d3/d40/c41 0 2023-10-18T20:58:20.095 INFO:tasks.workunit.client.0.smithi008.stdout:2/169: write d1/d3/dd/d1c/d3a/f3d [912700,19636] 0 2023-10-18T20:58:20.095 INFO:tasks.workunit.client.0.smithi008.stdout:7/138: getdents d1 0 2023-10-18T20:58:20.095 INFO:tasks.workunit.client.0.smithi008.stdout:7/139: chown d1/f4 56508457 1 2023-10-18T20:58:20.097 INFO:tasks.workunit.client.0.smithi008.stdout:1/287: creat d9/de/df/d17/d55/f5c x:0 0 0 2023-10-18T20:58:20.099 INFO:tasks.workunit.client.0.smithi008.stdout:9/149: symlink d2/dc/d1a/d1d/l27 0 2023-10-18T20:58:20.104 INFO:tasks.workunit.client.0.smithi008.stdout:4/170: rename d0/d3/f4 to d0/d17/f3a 0 2023-10-18T20:58:20.104 INFO:tasks.workunit.client.0.smithi008.stdout:4/171: chown d0/d3/d8/f11 485250 1 2023-10-18T20:58:20.104 INFO:tasks.workunit.client.0.smithi008.stdout:4/172: write d0/d3/f38 [289854,44944] 0 2023-10-18T20:58:20.104 INFO:tasks.workunit.client.0.smithi008.stdout:4/173: fdatasync d0/f12 0 2023-10-18T20:58:20.106 INFO:tasks.workunit.client.0.smithi008.stdout:4/174: read d0/d3/d21/f2c [108071,57479] 0 2023-10-18T20:58:20.107 INFO:tasks.workunit.client.0.smithi008.stdout:2/170: write d1/d3/dd/d1c/f3c [2581667,52854] 0 2023-10-18T20:58:20.107 INFO:tasks.workunit.client.0.smithi008.stdout:2/171: chown d1/d3/dd/d1c/d39 11 1 2023-10-18T20:58:20.109 INFO:tasks.workunit.client.0.smithi008.stdout:8/250: dread d5/d8/d17/f44 [4194304,4194304] 0 2023-10-18T20:58:20.109 INFO:tasks.workunit.client.0.smithi008.stdout:8/251: truncate d5/d8/d24/f2c 966291 0 2023-10-18T20:58:20.109 INFO:tasks.workunit.client.0.smithi008.stdout:8/252: write d5/d8/d24/f59 [861059,72371] 0 2023-10-18T20:58:20.111 INFO:tasks.workunit.client.0.smithi008.stdout:7/140: symlink d1/d3/l2e 0 2023-10-18T20:58:20.112 INFO:tasks.workunit.client.0.smithi008.stdout:1/288: mknod d9/de/df/d17/d25/d57/c5d 0 2023-10-18T20:58:20.112 INFO:tasks.workunit.client.0.smithi008.stdout:1/289: write d9/de/df/d17/d55/f5c [465353,27907] 0 2023-10-18T20:58:20.112 INFO:tasks.workunit.client.0.smithi008.stdout:0/121: rename d0/c1e to d0/c22 0 2023-10-18T20:58:20.116 INFO:tasks.workunit.client.0.smithi008.stdout:0/122: unlink d0/f13 0 2023-10-18T20:58:20.117 INFO:tasks.workunit.client.0.smithi008.stdout:0/123: write d0/f3 [318219,56791] 0 2023-10-18T20:58:20.117 INFO:tasks.workunit.client.0.smithi008.stdout:0/124: write d0/f3 [1196149,101689] 0 2023-10-18T20:58:20.117 INFO:tasks.workunit.client.0.smithi008.stdout:0/125: write d0/f1d [181954,128111] 0 2023-10-18T20:58:20.117 INFO:tasks.workunit.client.0.smithi008.stdout:9/150: mknod d2/c28 0 2023-10-18T20:58:20.117 INFO:tasks.workunit.client.0.smithi008.stdout:9/151: creat d2/f29 x:0 0 0 2023-10-18T20:58:20.120 INFO:tasks.workunit.client.0.smithi008.stdout:6/204: rename df/c12 to df/d15/c45 0 2023-10-18T20:58:20.121 INFO:tasks.workunit.client.0.smithi008.stdout:8/253: truncate d5/f6 1450529 0 2023-10-18T20:58:20.126 INFO:tasks.workunit.client.0.smithi008.stdout:1/290: rmdir d9/de/df/d17/d1e/d3c 39 2023-10-18T20:58:20.130 INFO:tasks.workunit.client.0.smithi008.stdout:0/126: dread d0/dd/df/f1c [0,4194304] 0 2023-10-18T20:58:20.132 INFO:tasks.workunit.client.0.smithi008.stdout:5/99: link d0/d2/l1e d0/de/l1f 0 2023-10-18T20:58:20.139 INFO:tasks.workunit.client.0.smithi008.stdout:7/141: dread d1/f6 [0,4194304] 0 2023-10-18T20:58:20.150 INFO:tasks.workunit.client.0.smithi008.stdout:9/152: mknod d2/dc/d17/c2a 0 2023-10-18T20:58:20.151 INFO:tasks.workunit.client.0.smithi008.stdout:1/291: unlink d9/c3e 0 2023-10-18T20:58:20.151 INFO:tasks.workunit.client.0.smithi008.stdout:3/117: rename d0/d3/de/d13/f1c to d0/d3/d15/f23 0 2023-10-18T20:58:20.151 INFO:tasks.workunit.client.0.smithi008.stdout:3/118: dread - d0/d3/d15/f21 zero size 2023-10-18T20:58:20.154 INFO:tasks.workunit.client.0.smithi008.stdout:5/100: mkdir d0/d2/d19/d1b/d20 0 2023-10-18T20:58:20.157 INFO:tasks.workunit.client.0.smithi008.stdout:8/254: dwrite d5/d8/d17/f26 [0,4194304] 0 2023-10-18T20:58:20.157 INFO:tasks.workunit.client.0.smithi008.stdout:8/255: read d5/d8/d17/f1d [66470,78953] 0 2023-10-18T20:58:20.163 INFO:tasks.workunit.client.0.smithi008.stdout:9/153: symlink d2/dc/d1a/l2b 0 2023-10-18T20:58:20.174 INFO:tasks.workunit.client.0.smithi008.stdout:2/172: rename d1/l6 to d1/d3/dd/d1c/d3a/l42 0 2023-10-18T20:58:20.174 INFO:tasks.workunit.client.0.smithi008.stdout:2/173: truncate d1/f19 1223339 0 2023-10-18T20:58:20.182 INFO:tasks.workunit.client.0.smithi008.stdout:8/256: creat d5/d8/df/d2e/f71 x:0 0 0 2023-10-18T20:58:20.182 INFO:tasks.workunit.client.0.smithi008.stdout:5/101: write d0/f8 [405792,116856] 0 2023-10-18T20:58:20.183 INFO:tasks.workunit.client.0.smithi008.stdout:2/174: mknod d1/d3/c43 0 2023-10-18T20:58:20.185 INFO:tasks.workunit.client.0.smithi008.stdout:7/142: rename d1/d3/f1a to d1/d3/d20/f2f 0 2023-10-18T20:58:20.186 INFO:tasks.workunit.client.0.smithi008.stdout:8/257: creat d5/d8/df/d54/f72 x:0 0 0 2023-10-18T20:58:20.189 INFO:tasks.workunit.client.0.smithi008.stdout:7/143: mkdir d1/d3/d30 0 2023-10-18T20:58:20.189 INFO:tasks.workunit.client.0.smithi008.stdout:7/144: write d1/d3/fb [4465568,28861] 0 2023-10-18T20:58:20.198 INFO:tasks.workunit.client.0.smithi008.stdout:8/258: link d5/d8/d24/d50/c65 d5/d8/d17/d6c/c73 0 2023-10-18T20:58:20.198 INFO:tasks.workunit.client.0.smithi008.stdout:8/259: truncate d5/d8/f5a 730938 0 2023-10-18T20:58:20.206 INFO:tasks.workunit.client.0.smithi008.stdout:2/175: dread d1/d3/dd/d1c/d3a/f3d [0,4194304] 0 2023-10-18T20:58:20.206 INFO:tasks.workunit.client.0.smithi008.stdout:8/260: write d5/d8/d24/f2c [712119,32920] 0 2023-10-18T20:58:20.206 INFO:tasks.workunit.client.0.smithi008.stdout:8/261: chown d5/d8/d17/d4d/f6d 4547 1 2023-10-18T20:58:20.206 INFO:tasks.workunit.client.0.smithi008.stdout:8/262: fdatasync d5/f25 0 2023-10-18T20:58:20.207 INFO:tasks.workunit.client.0.smithi008.stdout:9/154: dwrite d2/dc/f1e [0,4194304] 0 2023-10-18T20:58:20.212 INFO:tasks.workunit.client.0.smithi008.stdout:3/119: rmdir d0/d3/d15 39 2023-10-18T20:58:20.212 INFO:tasks.workunit.client.0.smithi008.stdout:7/145: dread d1/f6 [0,4194304] 0 2023-10-18T20:58:20.212 INFO:tasks.workunit.client.0.smithi008.stdout:7/146: write d1/d3/f2a [450823,79992] 0 2023-10-18T20:58:20.212 INFO:tasks.workunit.client.0.smithi008.stdout:7/147: chown d1/d3/l2e 136661 1 2023-10-18T20:58:20.214 INFO:tasks.workunit.client.0.smithi008.stdout:8/263: dread d5/f28 [0,4194304] 0 2023-10-18T20:58:20.215 INFO:tasks.workunit.client.0.smithi008.stdout:8/264: read - d5/d8/df/f29 zero size 2023-10-18T20:58:20.215 INFO:tasks.workunit.client.0.smithi008.stdout:8/265: stat d5/d8/f41 0 2023-10-18T20:58:20.215 INFO:tasks.workunit.client.0.smithi008.stdout:8/266: creat d5/d8/d24/d50/f74 x:0 0 0 2023-10-18T20:58:20.216 INFO:tasks.workunit.client.0.smithi008.stdout:8/267: creat d5/d8/df/f75 x:0 0 0 2023-10-18T20:58:20.222 INFO:tasks.workunit.client.0.smithi008.stdout:2/176: symlink d1/d3/dd/d1c/d3a/l44 0 2023-10-18T20:58:20.223 INFO:tasks.workunit.client.0.smithi008.stdout:9/155: symlink d2/dc/l2c 0 2023-10-18T20:58:20.223 INFO:tasks.workunit.client.0.smithi008.stdout:9/156: truncate d2/f26 732539 0 2023-10-18T20:58:20.224 INFO:tasks.workunit.client.0.smithi008.stdout:9/157: write d2/dc/f15 [4253422,28286] 0 2023-10-18T20:58:20.224 INFO:tasks.workunit.client.0.smithi008.stdout:7/148: creat d1/d3/d30/f31 x:0 0 0 2023-10-18T20:58:20.228 INFO:tasks.workunit.client.0.smithi008.stdout:3/120: dread d0/f7 [0,4194304] 0 2023-10-18T20:58:20.229 INFO:tasks.workunit.client.0.smithi008.stdout:0/127: dwrite d0/f14 [0,4194304] 0 2023-10-18T20:58:20.231 INFO:tasks.workunit.client.0.smithi008.stdout:2/177: stat d1/d3/dd/l21 0 2023-10-18T20:58:20.232 INFO:tasks.workunit.client.0.smithi008.stdout:1/292: dwrite d9/de/df/d17/d1e/f4a [0,4194304] 0 2023-10-18T20:58:20.232 INFO:tasks.workunit.client.0.smithi008.stdout:9/158: link d2/dc/d17/l23 d2/dc/d1a/d1d/l2d 0 2023-10-18T20:58:20.232 INFO:tasks.workunit.client.0.smithi008.stdout:1/293: creat d9/de/df/d17/d55/f5e x:0 0 0 2023-10-18T20:58:20.233 INFO:tasks.workunit.client.0.smithi008.stdout:7/149: symlink d1/d3/l32 0 2023-10-18T20:58:20.233 INFO:tasks.workunit.client.0.smithi008.stdout:7/150: chown d1/d3/c10 1230774135 1 2023-10-18T20:58:20.250 INFO:tasks.workunit.client.0.smithi008.stdout:3/121: write d0/d3/fd [797006,44896] 0 2023-10-18T20:58:20.251 INFO:tasks.workunit.client.0.smithi008.stdout:7/151: symlink d1/l33 0 2023-10-18T20:58:20.251 INFO:tasks.workunit.client.0.smithi008.stdout:2/178: dread d1/d3/dd/f1e [0,4194304] 0 2023-10-18T20:58:20.252 INFO:tasks.workunit.client.0.smithi008.stdout:9/159: write d2/dc/f1c [2737382,45447] 0 2023-10-18T20:58:20.252 INFO:tasks.workunit.client.0.smithi008.stdout:9/160: write d2/dc/d1a/f21 [264601,44295] 0 2023-10-18T20:58:20.253 INFO:tasks.workunit.client.0.smithi008.stdout:9/161: write d2/d8/f9 [1153791,126885] 0 2023-10-18T20:58:20.258 INFO:tasks.workunit.client.0.smithi008.stdout:0/128: mknod d0/c23 0 2023-10-18T20:58:20.260 INFO:tasks.workunit.client.0.smithi008.stdout:2/179: rmdir d1 39 2023-10-18T20:58:20.264 INFO:tasks.workunit.client.0.smithi008.stdout:3/122: getdents d0/d3 0 2023-10-18T20:58:20.264 INFO:tasks.workunit.client.0.smithi008.stdout:3/123: write d0/d3/de/f20 [842012,121922] 0 2023-10-18T20:58:20.268 INFO:tasks.workunit.client.0.smithi008.stdout:0/129: rmdir d0/dd 39 2023-10-18T20:58:20.268 INFO:tasks.workunit.client.0.smithi008.stdout:0/130: read d0/f2 [167973,11201] 0 2023-10-18T20:58:20.269 INFO:tasks.workunit.client.0.smithi008.stdout:3/124: rename d0/d3/de/d13/f22 to d0/d3/de/d13/f24 0 2023-10-18T20:58:20.269 INFO:tasks.workunit.client.0.smithi008.stdout:3/125: fdatasync d0/f7 0 2023-10-18T20:58:20.270 INFO:tasks.workunit.client.0.smithi008.stdout:3/126: readlink d0/d3/l1d 0 2023-10-18T20:58:20.274 INFO:tasks.workunit.client.0.smithi008.stdout:3/127: write d0/d3/d15/f23 [122331,26945] 0 2023-10-18T20:58:20.274 INFO:tasks.workunit.client.0.smithi008.stdout:3/128: chown d0/d3/fd 44421551 1 2023-10-18T20:58:20.274 INFO:tasks.workunit.client.0.smithi008.stdout:3/129: chown d0/d3/de/d13 0 1 2023-10-18T20:58:20.274 INFO:tasks.workunit.client.0.smithi008.stdout:0/131: read d0/dd/f18 [394800,23992] 0 2023-10-18T20:58:20.283 INFO:tasks.workunit.client.0.smithi008.stdout:8/268: rmdir d5/d8/df/d2e 39 2023-10-18T20:58:20.284 INFO:tasks.workunit.client.0.smithi008.stdout:1/294: write d9/de/f58 [1109016,70369] 0 2023-10-18T20:58:20.284 INFO:tasks.workunit.client.0.smithi008.stdout:5/102: dwrite d0/f8 [0,4194304] 0 2023-10-18T20:58:20.285 INFO:tasks.workunit.client.0.smithi008.stdout:5/103: creat d0/d2/f21 x:0 0 0 2023-10-18T20:58:20.298 INFO:tasks.workunit.client.0.smithi008.stdout:7/152: getdents d1/d3 0 2023-10-18T20:58:20.298 INFO:tasks.workunit.client.0.smithi008.stdout:7/153: write d1/d3/f13 [293795,23212] 0 2023-10-18T20:58:20.304 INFO:tasks.workunit.client.0.smithi008.stdout:7/154: rename c0 to d1/d3/c34 0 2023-10-18T20:58:20.308 INFO:tasks.workunit.client.0.smithi008.stdout:7/155: mknod d1/d3/c35 0 2023-10-18T20:58:20.310 INFO:tasks.workunit.client.0.smithi008.stdout:5/104: write d0/d2/d9/f11 [1700673,106740] 0 2023-10-18T20:58:20.314 INFO:tasks.workunit.client.0.smithi008.stdout:1/295: dread d9/de/df/d17/d25/f29 [0,4194304] 0 2023-10-18T20:58:20.314 INFO:tasks.workunit.client.0.smithi008.stdout:1/296: write d9/de/df/f56 [377587,3044] 0 2023-10-18T20:58:20.314 INFO:tasks.workunit.client.0.smithi008.stdout:1/297: chown d9/de 25 1 2023-10-18T20:58:20.314 INFO:tasks.workunit.client.0.smithi008.stdout:5/105: creat d0/d2/d19/d1b/d20/f22 x:0 0 0 2023-10-18T20:58:20.320 INFO:tasks.workunit.client.0.smithi008.stdout:0/132: getdents d0 0 2023-10-18T20:58:20.323 INFO:tasks.workunit.client.0.smithi008.stdout:9/162: dwrite d2/f3 [4194304,4194304] 0 2023-10-18T20:58:20.324 INFO:tasks.workunit.client.0.smithi008.stdout:0/133: unlink d0/dd/df/c17 0 2023-10-18T20:58:20.327 INFO:tasks.workunit.client.0.smithi008.stdout:3/130: dwrite d0/d3/de/f10 [0,4194304] 0 2023-10-18T20:58:20.331 INFO:tasks.workunit.client.0.smithi008.stdout:9/163: creat d2/dc/d17/f2e x:0 0 0 2023-10-18T20:58:20.337 INFO:tasks.workunit.client.0.smithi008.stdout:5/106: read d0/d2/f16 [4435641,109517] 0 2023-10-18T20:58:20.338 INFO:tasks.workunit.client.0.smithi008.stdout:5/107: chown d0/d2/d19/d1b/d20 744733 1 2023-10-18T20:58:20.346 INFO:tasks.workunit.client.0.smithi008.stdout:3/131: mknod d0/d3/de/c25 0 2023-10-18T20:58:20.351 INFO:tasks.workunit.client.0.smithi008.stdout:9/164: dread d2/f1b [0,4194304] 0 2023-10-18T20:58:20.351 INFO:tasks.workunit.client.0.smithi008.stdout:9/165: rename d2/dc to d2/dc/d2f 22 2023-10-18T20:58:20.358 INFO:tasks.workunit.client.0.smithi008.stdout:1/298: truncate d9/de/f58 2122623 0 2023-10-18T20:58:20.363 INFO:tasks.workunit.client.0.smithi008.stdout:3/132: symlink d0/d3/de/d13/l26 0 2023-10-18T20:58:20.364 INFO:tasks.workunit.client.0.smithi008.stdout:3/133: readlink d0/d3/de/d13/l26 0 2023-10-18T20:58:20.365 INFO:tasks.workunit.client.0.smithi008.stdout:5/108: unlink d0/d2/f21 0 2023-10-18T20:58:20.373 INFO:tasks.workunit.client.0.smithi008.stdout:3/134: dread d0/d3/d15/f23 [0,4194304] 0 2023-10-18T20:58:20.375 INFO:tasks.workunit.client.0.smithi008.stdout:1/299: rename d9/de/f47 to d9/de/df/d17/f5f 0 2023-10-18T20:58:20.387 INFO:tasks.workunit.client.0.smithi008.stdout:1/300: link d9/de/df/d17/d1e/d3c/c46 d9/de/df/d17/d25/c60 0 2023-10-18T20:58:20.389 INFO:tasks.workunit.client.0.smithi008.stdout:5/109: write d0/d2/f16 [3082638,20946] 0 2023-10-18T20:58:20.393 INFO:tasks.workunit.client.0.smithi008.stdout:1/301: mknod d9/de/df/d17/d25/c61 0 2023-10-18T20:58:20.395 INFO:tasks.workunit.client.0.smithi008.stdout:2/180: dwrite d1/d3/dd/d1c/f3e [0,4194304] 0 2023-10-18T20:58:20.395 INFO:tasks.workunit.client.0.smithi008.stdout:9/166: dread d2/dc/f15 [0,4194304] 0 2023-10-18T20:58:20.397 INFO:tasks.workunit.client.0.smithi008.stdout:8/269: dwrite d5/f15 [0,4194304] 0 2023-10-18T20:58:20.399 INFO:tasks.workunit.client.0.smithi008.stdout:3/135: dread d0/d3/de/f10 [0,4194304] 0 2023-10-18T20:58:20.407 INFO:tasks.workunit.client.0.smithi008.stdout:8/270: mknod d5/d8/df/d54/c76 0 2023-10-18T20:58:20.411 INFO:tasks.workunit.client.0.smithi008.stdout:5/110: dread d0/d2/f7 [4194304,4194304] 0 2023-10-18T20:58:20.412 INFO:tasks.workunit.client.0.smithi008.stdout:3/136: mknod d0/d3/de/c27 0 2023-10-18T20:58:20.413 INFO:tasks.workunit.client.0.smithi008.stdout:3/137: read d0/d3/d15/f23 [541293,36909] 0 2023-10-18T20:58:20.415 INFO:tasks.workunit.client.0.smithi008.stdout:2/181: write d1/d3/dd/d1c/f3e [196033,129468] 0 2023-10-18T20:58:20.416 INFO:tasks.workunit.client.0.smithi008.stdout:2/182: write d1/d3/dd/d25/f30 [139622,40650] 0 2023-10-18T20:58:20.422 INFO:tasks.workunit.client.0.smithi008.stdout:5/111: truncate d0/d2/d9/f11 3661172 0 2023-10-18T20:58:20.426 INFO:tasks.workunit.client.0.smithi008.stdout:3/138: rename d0/d3/de/f17 to d0/d3/de/d13/f28 0 2023-10-18T20:58:20.457 INFO:tasks.workunit.client.0.smithi008.stdout:3/139: fsync d0/d3/de/d13/f28 0 2023-10-18T20:58:20.476 INFO:tasks.workunit.client.0.smithi008.stdout:3/140: dread d0/d3/de/f10 [0,4194304] 0 2023-10-18T20:58:20.477 INFO:tasks.workunit.client.0.smithi008.stdout:3/141: write d0/d3/f5 [330203,123362] 0 2023-10-18T20:58:20.479 INFO:tasks.workunit.client.0.smithi008.stdout:3/142: creat d0/d3/f29 x:0 0 0 2023-10-18T20:58:20.481 INFO:tasks.workunit.client.0.smithi008.stdout:8/271: dwrite d5/d8/d24/f63 [0,4194304] 0 2023-10-18T20:58:20.481 INFO:tasks.workunit.client.0.smithi008.stdout:8/272: readlink d5/d8/d17/l1e 0 2023-10-18T20:58:20.486 INFO:tasks.workunit.client.0.smithi008.stdout:5/112: dwrite d0/f1c [0,4194304] 0 2023-10-18T20:58:20.486 INFO:tasks.workunit.client.0.smithi008.stdout:5/113: chown d0/d2/d9/cc 20437942 1 2023-10-18T20:58:20.486 INFO:tasks.workunit.client.0.smithi008.stdout:5/114: creat d0/d2/f23 x:0 0 0 2023-10-18T20:58:20.486 INFO:tasks.workunit.client.0.smithi008.stdout:5/115: creat d0/d2/d9/f24 x:0 0 0 2023-10-18T20:58:20.487 INFO:tasks.workunit.client.0.smithi008.stdout:5/116: fsync d0/d2/f7 0 2023-10-18T20:58:20.487 INFO:tasks.workunit.client.0.smithi008.stdout:5/117: creat d0/f25 x:0 0 0 2023-10-18T20:58:20.487 INFO:tasks.workunit.client.0.smithi008.stdout:8/273: mkdir d5/d8/d24/d77 0 2023-10-18T20:58:20.506 INFO:tasks.workunit.client.0.smithi008.stdout:8/274: read d5/f11 [1854664,48684] 0 2023-10-18T20:58:20.508 INFO:tasks.workunit.client.0.smithi008.stdout:8/275: mknod d5/d8/df/d54/c78 0 2023-10-18T20:58:20.511 INFO:tasks.workunit.client.0.smithi008.stdout:8/276: truncate d5/d8/df/f19 226840 0 2023-10-18T20:58:20.514 INFO:tasks.workunit.client.0.smithi008.stdout:8/277: rmdir d5/d8/d17/d4d 39 2023-10-18T20:58:20.515 INFO:tasks.workunit.client.0.smithi008.stdout:5/118: dwrite d0/d2/d9/f24 [0,4194304] 0 2023-10-18T20:58:20.515 INFO:tasks.workunit.client.0.smithi008.stdout:5/119: chown d0/d2/f23 12246 1 2023-10-18T20:58:20.518 INFO:tasks.workunit.client.0.smithi008.stdout:8/278: symlink d5/d8/df/d2e/l79 0 2023-10-18T20:58:20.518 INFO:tasks.workunit.client.0.smithi008.stdout:8/279: chown d5/f4b 18 1 2023-10-18T20:58:20.518 INFO:tasks.workunit.client.0.smithi008.stdout:8/280: readlink d5/d8/df/l30 0 2023-10-18T20:58:20.525 INFO:tasks.workunit.client.0.smithi008.stdout:5/120: dread d0/d2/d9/f11 [0,4194304] 0 2023-10-18T20:58:20.534 INFO:tasks.workunit.client.0.smithi008.stdout:8/281: symlink d5/d8/df/d6f/l7a 0 2023-10-18T20:58:20.534 INFO:tasks.workunit.client.0.smithi008.stdout:8/282: truncate d5/f25 760504 0 2023-10-18T20:58:20.534 INFO:tasks.workunit.client.0.smithi008.stdout:5/121: rename d0/d2/f16 to d0/d2/d19/d1b/f26 0 2023-10-18T20:58:20.535 INFO:tasks.workunit.client.0.smithi008.stdout:5/122: rmdir d0/de 39 2023-10-18T20:58:20.535 INFO:tasks.workunit.client.0.smithi008.stdout:5/123: truncate d0/d2/f23 792621 0 2023-10-18T20:58:20.537 INFO:tasks.workunit.client.0.smithi008.stdout:5/124: creat d0/d2/d19/d1b/f27 x:0 0 0 2023-10-18T20:58:20.580 INFO:tasks.workunit.client.0.smithi008.stdout:8/283: dwrite d5/f6 [0,4194304] 0 2023-10-18T20:58:20.581 INFO:tasks.workunit.client.0.smithi008.stdout:8/284: read d5/d8/df/f39 [218988,120729] 0 2023-10-18T20:58:20.586 INFO:tasks.workunit.client.0.smithi008.stdout:8/285: dread d5/d8/d17/f1d [0,4194304] 0 2023-10-18T20:58:20.750 INFO:tasks.workunit.client.0.smithi008.stdout:8/286: creat d5/d8/df/d2e/f7b x:0 0 0 2023-10-18T20:58:20.750 INFO:tasks.workunit.client.0.smithi008.stdout:8/287: stat d5/d8/d17/d6c/f66 0 2023-10-18T20:58:20.762 INFO:tasks.workunit.client.0.smithi008.stdout:8/288: dread d5/d8/d17/f44 [0,4194304] 0 2023-10-18T20:58:20.763 INFO:tasks.workunit.client.0.smithi008.stdout:8/289: creat d5/d8/d17/d4d/f7c x:0 0 0 2023-10-18T20:58:20.763 INFO:tasks.workunit.client.0.smithi008.stdout:8/290: dread - d5/d8/df/d2e/f43 zero size 2023-10-18T20:58:20.763 INFO:tasks.workunit.client.0.smithi008.stdout:8/291: write d5/d8/d17/d4d/f7c [126935,100161] 0 2023-10-18T20:58:20.764 INFO:tasks.workunit.client.0.smithi008.stdout:8/292: mknod d5/d8/df/d54/c7d 0 2023-10-18T20:58:20.764 INFO:tasks.workunit.client.0.smithi008.stdout:8/293: chown d5/f28 10124536 1 2023-10-18T20:58:20.765 INFO:tasks.workunit.client.0.smithi008.stdout:8/294: rmdir d5/d8/d24/d50/d53 39 2023-10-18T20:58:20.780 INFO:tasks.workunit.client.0.smithi008.stdout:8/295: write d5/f6 [69270,113511] 0 2023-10-18T20:58:20.782 INFO:tasks.workunit.client.0.smithi008.stdout:8/296: rmdir d5/d8/d17/d6c 39 2023-10-18T20:58:20.782 INFO:tasks.workunit.client.0.smithi008.stdout:8/297: chown d5/f18 0 1 2023-10-18T20:58:20.782 INFO:tasks.workunit.client.0.smithi008.stdout:8/298: unlink d5/d8/d17/f26 0 2023-10-18T20:58:20.791 INFO:tasks.workunit.client.0.smithi008.stdout:8/299: symlink d5/d8/d24/d77/l7e 0 2023-10-18T20:58:20.793 INFO:tasks.workunit.client.0.smithi008.stdout:8/300: rename d5/f6 to d5/d8/d17/d6c/f7f 0 2023-10-18T20:58:20.795 INFO:tasks.workunit.client.0.smithi008.stdout:8/301: link d5/d8/df/f23 d5/d8/df/f80 0 2023-10-18T20:58:20.795 INFO:tasks.workunit.client.0.smithi008.stdout:8/302: chown d5/d8/df/d2e/f35 203932171 1 2023-10-18T20:58:20.802 INFO:tasks.workunit.client.1.smithi060.stdout:2/143: getdents d0/d3 0 2023-10-18T20:58:20.859 INFO:tasks.workunit.client.1.smithi060.stdout:0/131: symlink d3/d8/l29 0 2023-10-18T20:58:20.859 INFO:tasks.workunit.client.1.smithi060.stdout:0/132: creat d3/d8/d14/f2a x:0 0 0 2023-10-18T20:58:20.873 INFO:tasks.workunit.client.1.smithi060.stdout:3/129: mkdir d0/d22/d26/d29 0 2023-10-18T20:58:20.873 INFO:tasks.workunit.client.1.smithi060.stdout:7/149: creat de/d14/d1d/f34 x:0 0 0 2023-10-18T20:58:20.873 INFO:tasks.workunit.client.1.smithi060.stdout:1/191: symlink d4/l3d 0 2023-10-18T20:58:20.874 INFO:tasks.workunit.client.1.smithi060.stdout:5/187: symlink d0/d6/l49 0 2023-10-18T20:58:20.874 INFO:tasks.workunit.client.1.smithi060.stdout:1/192: chown d4/d6/f1f 20580101 1 2023-10-18T20:58:20.874 INFO:tasks.workunit.client.1.smithi060.stdout:4/94: rmdir d4 39 2023-10-18T20:58:20.874 INFO:tasks.workunit.client.1.smithi060.stdout:8/151: creat d4/d9/f2a x:0 0 0 2023-10-18T20:58:20.874 INFO:tasks.workunit.client.1.smithi060.stdout:5/188: truncate d0/dd/d33/f3e 758220 0 2023-10-18T20:58:20.875 INFO:tasks.workunit.client.1.smithi060.stdout:4/95: fsync d4/dc/d11/f1e 0 2023-10-18T20:58:20.875 INFO:tasks.workunit.client.1.smithi060.stdout:5/189: fdatasync d0/d6/db/f40 0 2023-10-18T20:58:20.875 INFO:tasks.workunit.client.1.smithi060.stdout:6/82: mkdir d10/d1d 0 2023-10-18T20:58:20.875 INFO:tasks.workunit.client.1.smithi060.stdout:2/144: mknod d0/d3/c2e 0 2023-10-18T20:58:20.876 INFO:tasks.workunit.client.1.smithi060.stdout:7/150: mknod de/d29/c35 0 2023-10-18T20:58:20.877 INFO:tasks.workunit.client.0.smithi008.stdout:8/303: dwrite d5/f70 [0,4194304] 0 2023-10-18T20:58:20.878 INFO:tasks.workunit.client.1.smithi060.stdout:1/193: link d4/da/fc d4/d6/f3e 0 2023-10-18T20:58:20.880 INFO:tasks.workunit.client.0.smithi008.stdout:4/175: sync 2023-10-18T20:58:20.891 INFO:tasks.workunit.client.1.smithi060.stdout:3/130: dread d0/f24 [0,4194304] 0 2023-10-18T20:58:20.892 INFO:tasks.workunit.client.1.smithi060.stdout:7/151: dread de/d29/f2b [0,4194304] 0 2023-10-18T20:58:20.892 INFO:tasks.workunit.client.1.smithi060.stdout:7/152: readlink de/l1c 0 2023-10-18T20:58:20.892 INFO:tasks.workunit.client.1.smithi060.stdout:7/153: truncate de/f17 1608281 0 2023-10-18T20:58:20.892 INFO:tasks.workunit.client.1.smithi060.stdout:7/154: chown de/d14/d2f 0 1 2023-10-18T20:58:20.893 INFO:tasks.workunit.client.1.smithi060.stdout:9/134: sync 2023-10-18T20:58:20.901 INFO:tasks.workunit.client.1.smithi060.stdout:7/155: dread de/f1f [0,4194304] 0 2023-10-18T20:58:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:19.533000+0000 mgr.smithi060.pgqqwa (mgr.14584) 41 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 609 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 41 MiB/s rd, 58 MiB/s wr, 859 op/s 2023-10-18T20:58:20.924 INFO:tasks.workunit.client.1.smithi060.stdout:0/133: dwrite d3/f19 [0,4194304] 0 2023-10-18T20:58:20.939 INFO:tasks.workunit.client.1.smithi060.stdout:6/83: dwrite f7 [0,4194304] 0 2023-10-18T20:58:20.939 INFO:tasks.workunit.client.1.smithi060.stdout:6/84: creat d10/f1e x:0 0 0 2023-10-18T20:58:20.951 INFO:tasks.workunit.client.1.smithi060.stdout:1/194: dwrite d4/d6/d7/df/f15 [0,4194304] 0 2023-10-18T20:58:20.952 INFO:tasks.workunit.client.1.smithi060.stdout:1/195: truncate d4/d6/d7/df/f15 4407879 0 2023-10-18T20:58:20.952 INFO:tasks.workunit.client.1.smithi060.stdout:1/196: readlink d4/da/l17 0 2023-10-18T20:58:20.953 INFO:tasks.workunit.client.0.smithi008.stdout:4/176: dwrite d0/d3/f38 [0,4194304] 0 2023-10-18T20:58:20.978 INFO:tasks.workunit.client.1.smithi060.stdout:0/134: dwrite d3/d8/d14/f25 [0,4194304] 0 2023-10-18T20:58:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:19.533000+0000 mgr.smithi060.pgqqwa (mgr.14584) 41 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 609 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 41 MiB/s rd, 58 MiB/s wr, 859 op/s 2023-10-18T20:58:21.017 INFO:tasks.workunit.client.1.smithi060.stdout:0/135: dwrite d3/d8/d14/f2a [0,4194304] 0 2023-10-18T20:58:21.018 INFO:tasks.workunit.client.1.smithi060.stdout:0/136: read d3/f26 [15124,56109] 0 2023-10-18T20:58:21.018 INFO:tasks.workunit.client.1.smithi060.stdout:0/137: creat d3/d8/d14/f2b x:0 0 0 2023-10-18T20:58:21.037 INFO:tasks.workunit.client.1.smithi060.stdout:8/152: mknod d4/d9/c2b 0 2023-10-18T20:58:21.038 INFO:tasks.workunit.client.1.smithi060.stdout:4/96: creat d4/dc/d11/f1f x:0 0 0 2023-10-18T20:58:21.038 INFO:tasks.workunit.client.1.smithi060.stdout:4/97: dread - d4/dc/d11/f1f zero size 2023-10-18T20:58:21.038 INFO:tasks.workunit.client.0.smithi008.stdout:8/304: mknod d5/d8/d17/c81 0 2023-10-18T20:58:21.039 INFO:tasks.workunit.client.1.smithi060.stdout:5/190: symlink d0/d6/d8/df/l4a 0 2023-10-18T20:58:21.044 INFO:tasks.workunit.client.1.smithi060.stdout:2/145: mknod d0/d16/c2f 0 2023-10-18T20:58:21.044 INFO:tasks.workunit.client.1.smithi060.stdout:2/146: fdatasync d0/d16/f1a 0 2023-10-18T20:58:21.044 INFO:tasks.workunit.client.1.smithi060.stdout:3/131: creat d0/f2a x:0 0 0 2023-10-18T20:58:21.044 INFO:tasks.workunit.client.1.smithi060.stdout:3/132: write d0/ff [1473561,69763] 0 2023-10-18T20:58:21.045 INFO:tasks.workunit.client.1.smithi060.stdout:9/135: getdents d3/d10/d1c/d2a/d33/d29 0 2023-10-18T20:58:21.045 INFO:tasks.workunit.client.0.smithi008.stdout:4/177: creat d0/d3/d21/f3b x:0 0 0 2023-10-18T20:58:21.045 INFO:tasks.workunit.client.0.smithi008.stdout:4/178: write d0/d3/d21/f3b [1018177,103993] 0 2023-10-18T20:58:21.046 INFO:tasks.workunit.client.1.smithi060.stdout:7/156: mknod de/d14/c36 0 2023-10-18T20:58:21.047 INFO:tasks.workunit.client.0.smithi008.stdout:4/179: rmdir d0 39 2023-10-18T20:58:21.047 INFO:tasks.workunit.client.1.smithi060.stdout:6/85: mknod d10/c1f 0 2023-10-18T20:58:21.049 INFO:tasks.workunit.client.1.smithi060.stdout:1/197: unlink d4/d6/d7/f9 0 2023-10-18T20:58:21.060 INFO:tasks.workunit.client.1.smithi060.stdout:8/153: rename d4/lb to d4/d9/l2c 0 2023-10-18T20:58:21.060 INFO:tasks.workunit.client.1.smithi060.stdout:9/136: stat d3/d10/d1c/d2a/d33/d29/c2f 0 2023-10-18T20:58:21.069 INFO:tasks.workunit.client.1.smithi060.stdout:7/157: link de/d29/f31 de/d29/f37 0 2023-10-18T20:58:21.069 INFO:tasks.workunit.client.1.smithi060.stdout:1/198: creat d4/da/de/d2a/d32/dd/f3f x:0 0 0 2023-10-18T20:58:21.069 INFO:tasks.workunit.client.1.smithi060.stdout:6/86: rename d10/d1b/l1a to d10/d1d/l20 0 2023-10-18T20:58:21.069 INFO:tasks.workunit.client.1.smithi060.stdout:6/87: readlink d10/l12 0 2023-10-18T20:58:21.070 INFO:tasks.workunit.client.1.smithi060.stdout:1/199: creat d4/d6/d7/df/f40 x:0 0 0 2023-10-18T20:58:21.070 INFO:tasks.workunit.client.1.smithi060.stdout:6/88: write fe [240842,63897] 0 2023-10-18T20:58:21.073 INFO:tasks.workunit.client.1.smithi060.stdout:0/138: dwrite d3/d8/fa [0,4194304] 0 2023-10-18T20:58:21.073 INFO:tasks.workunit.client.1.smithi060.stdout:0/139: chown d3/d8/d14/f1c 67 1 2023-10-18T20:58:21.073 INFO:tasks.workunit.client.1.smithi060.stdout:0/140: truncate d3/ff 4541481 0 2023-10-18T20:58:21.075 INFO:tasks.workunit.client.1.smithi060.stdout:3/133: dread d0/ff [0,4194304] 0 2023-10-18T20:58:21.075 INFO:tasks.workunit.client.1.smithi060.stdout:9/137: dread d3/d10/d1c/f1d [0,4194304] 0 2023-10-18T20:58:21.077 INFO:tasks.workunit.client.1.smithi060.stdout:4/98: rmdir d4/dc/d11 39 2023-10-18T20:58:21.081 INFO:tasks.workunit.client.1.smithi060.stdout:7/158: mkdir de/d38 0 2023-10-18T20:58:21.082 INFO:tasks.workunit.client.1.smithi060.stdout:6/89: creat d10/d1d/f21 x:0 0 0 2023-10-18T20:58:21.084 INFO:tasks.workunit.client.1.smithi060.stdout:0/141: truncate d3/f13 126872 0 2023-10-18T20:58:21.084 INFO:tasks.workunit.client.1.smithi060.stdout:8/154: dread f3 [0,4194304] 0 2023-10-18T20:58:21.084 INFO:tasks.workunit.client.1.smithi060.stdout:0/142: creat d3/d8/d14/f2c x:0 0 0 2023-10-18T20:58:21.084 INFO:tasks.workunit.client.1.smithi060.stdout:8/155: write d4/d9/f2a [593408,2366] 0 2023-10-18T20:58:21.086 INFO:tasks.workunit.client.1.smithi060.stdout:9/138: symlink d3/l34 0 2023-10-18T20:58:21.087 INFO:tasks.workunit.client.1.smithi060.stdout:1/200: dread d4/d6/f3e [0,4194304] 0 2023-10-18T20:58:21.087 INFO:tasks.workunit.client.1.smithi060.stdout:1/201: readlink d4/da/l1e 0 2023-10-18T20:58:21.090 INFO:tasks.workunit.client.1.smithi060.stdout:4/99: rename d4/dc/f17 to d4/dc/d11/d13/f20 0 2023-10-18T20:58:21.090 INFO:tasks.workunit.client.1.smithi060.stdout:7/159: symlink de/d29/l39 0 2023-10-18T20:58:21.092 INFO:tasks.workunit.client.1.smithi060.stdout:0/143: creat d3/d8/f2d x:0 0 0 2023-10-18T20:58:21.095 INFO:tasks.workunit.client.1.smithi060.stdout:7/160: mkdir de/d14/d3a 0 2023-10-18T20:58:21.095 INFO:tasks.workunit.client.1.smithi060.stdout:7/161: truncate fa 2738706 0 2023-10-18T20:58:21.095 INFO:tasks.workunit.client.1.smithi060.stdout:7/162: dread - de/d29/f37 zero size 2023-10-18T20:58:21.095 INFO:tasks.workunit.client.1.smithi060.stdout:7/163: readlink lb 0 2023-10-18T20:58:21.096 INFO:tasks.workunit.client.1.smithi060.stdout:3/134: dread d0/f19 [0,4194304] 0 2023-10-18T20:58:21.097 INFO:tasks.workunit.client.1.smithi060.stdout:7/164: creat de/d14/d3a/f3b x:0 0 0 2023-10-18T20:58:21.098 INFO:tasks.workunit.client.1.smithi060.stdout:0/144: mknod d3/d8/c2e 0 2023-10-18T20:58:21.099 INFO:tasks.workunit.client.1.smithi060.stdout:2/147: dwrite d0/d8/fd [0,4194304] 0 2023-10-18T20:58:21.099 INFO:tasks.workunit.client.1.smithi060.stdout:0/145: mknod d3/c2f 0 2023-10-18T20:58:21.100 INFO:tasks.workunit.client.1.smithi060.stdout:0/146: readlink d3/l1e 0 2023-10-18T20:58:21.100 INFO:tasks.workunit.client.1.smithi060.stdout:0/147: truncate d3/d8/f10 605713 0 2023-10-18T20:58:21.101 INFO:tasks.workunit.client.1.smithi060.stdout:2/148: link d0/f10 d0/d8/f30 0 2023-10-18T20:58:21.103 INFO:tasks.workunit.client.1.smithi060.stdout:9/139: write d3/d10/f24 [3721895,71847] 0 2023-10-18T20:58:21.104 INFO:tasks.workunit.client.1.smithi060.stdout:2/149: rmdir d0/d3 39 2023-10-18T20:58:21.111 INFO:tasks.workunit.client.1.smithi060.stdout:8/156: dread d4/fe [0,4194304] 0 2023-10-18T20:58:21.112 INFO:tasks.workunit.client.1.smithi060.stdout:5/191: dwrite d0/d6/d8/f21 [0,4194304] 0 2023-10-18T20:58:21.113 INFO:tasks.workunit.client.1.smithi060.stdout:2/150: mkdir d0/d3/d2a/d31 0 2023-10-18T20:58:21.115 INFO:tasks.workunit.client.1.smithi060.stdout:3/135: dread d0/f1e [0,4194304] 0 2023-10-18T20:58:21.123 INFO:tasks.workunit.client.1.smithi060.stdout:6/90: getdents d10/d1b 0 2023-10-18T20:58:21.124 INFO:tasks.workunit.client.1.smithi060.stdout:8/157: rename d4/d9/f2a to d4/f2d 0 2023-10-18T20:58:21.124 INFO:tasks.workunit.client.1.smithi060.stdout:6/91: readlink d10/l1c 0 2023-10-18T20:58:21.124 INFO:tasks.workunit.client.1.smithi060.stdout:6/92: read - d10/d1d/f21 zero size 2023-10-18T20:58:21.127 INFO:tasks.workunit.client.0.smithi008.stdout:4/180: dwrite d0/d3/d8/fb [8388608,4194304] 0 2023-10-18T20:58:21.130 INFO:tasks.workunit.client.1.smithi060.stdout:4/100: dread d4/dc/d11/f1e [0,4194304] 0 2023-10-18T20:58:21.132 INFO:tasks.workunit.client.1.smithi060.stdout:3/136: mkdir d0/d22/d26/d2b 0 2023-10-18T20:58:21.134 INFO:tasks.workunit.client.1.smithi060.stdout:7/165: truncate fa 1892037 0 2023-10-18T20:58:21.135 INFO:tasks.workunit.client.1.smithi060.stdout:7/166: write de/d14/f16 [927216,74374] 0 2023-10-18T20:58:21.135 INFO:tasks.workunit.client.1.smithi060.stdout:5/192: rename d0/dd/l16 to d0/d6/d8/df/l4b 0 2023-10-18T20:58:21.135 INFO:tasks.workunit.client.1.smithi060.stdout:5/193: dread - d0/d6/d8/f44 zero size 2023-10-18T20:58:21.136 INFO:tasks.workunit.client.0.smithi008.stdout:4/181: creat d0/d3/d8/d2a/f3c x:0 0 0 2023-10-18T20:58:21.136 INFO:tasks.workunit.client.0.smithi008.stdout:4/182: dread - d0/d3/f37 zero size 2023-10-18T20:58:21.137 INFO:tasks.workunit.client.1.smithi060.stdout:6/93: creat d10/d1b/f22 x:0 0 0 2023-10-18T20:58:21.140 INFO:tasks.workunit.client.0.smithi008.stdout:4/183: rename d0/d3/f32 to d0/d17/f3d 0 2023-10-18T20:58:21.140 INFO:tasks.workunit.client.0.smithi008.stdout:4/184: creat d0/d3/d21/f3e x:0 0 0 2023-10-18T20:58:21.141 INFO:tasks.workunit.client.0.smithi008.stdout:4/185: chown d0/d3/f37 3253992 1 2023-10-18T20:58:21.143 INFO:tasks.workunit.client.1.smithi060.stdout:3/137: mkdir d0/d22/d26/d2c 0 2023-10-18T20:58:21.147 INFO:tasks.workunit.client.0.smithi008.stdout:6/205: sync 2023-10-18T20:58:21.153 INFO:tasks.workunit.client.1.smithi060.stdout:6/94: creat d10/d17/f23 x:0 0 0 2023-10-18T20:58:21.153 INFO:tasks.workunit.client.1.smithi060.stdout:5/194: creat d0/da/d3b/f4c x:0 0 0 2023-10-18T20:58:21.153 INFO:tasks.workunit.client.1.smithi060.stdout:5/195: fsync d0/d6/d9/f14 0 2023-10-18T20:58:21.154 INFO:tasks.workunit.client.1.smithi060.stdout:6/95: write d10/f1e [532170,42565] 0 2023-10-18T20:58:21.154 INFO:tasks.workunit.client.1.smithi060.stdout:6/96: write fe [1057699,58897] 0 2023-10-18T20:58:21.154 INFO:tasks.workunit.client.0.smithi008.stdout:4/186: symlink d0/d3/d8/d2a/l3f 0 2023-10-18T20:58:21.158 INFO:tasks.workunit.client.1.smithi060.stdout:3/138: dread d0/ff [0,4194304] 0 2023-10-18T20:58:21.158 INFO:tasks.workunit.client.1.smithi060.stdout:3/139: fsync d0/f1e 0 2023-10-18T20:58:21.159 INFO:tasks.workunit.client.1.smithi060.stdout:4/101: dread d4/f10 [0,4194304] 0 2023-10-18T20:58:21.161 INFO:tasks.workunit.client.1.smithi060.stdout:6/97: rename fe to d10/d1d/f24 0 2023-10-18T20:58:21.163 INFO:tasks.workunit.client.1.smithi060.stdout:3/140: symlink d0/l2d 0 2023-10-18T20:58:21.173 INFO:tasks.workunit.client.1.smithi060.stdout:4/102: dread d4/dc/d11/d13/f1b [0,4194304] 0 2023-10-18T20:58:21.173 INFO:tasks.workunit.client.1.smithi060.stdout:4/103: fsync d4/dc/d11/d13/f20 0 2023-10-18T20:58:21.174 INFO:tasks.workunit.client.1.smithi060.stdout:4/104: write d4/dc/d11/f7 [651427,98081] 0 2023-10-18T20:58:21.174 INFO:tasks.workunit.client.1.smithi060.stdout:1/202: dwrite d4/f2d [0,4194304] 0 2023-10-18T20:58:21.177 INFO:tasks.workunit.client.1.smithi060.stdout:1/203: mkdir d4/d6/d14/d41 0 2023-10-18T20:58:21.182 INFO:tasks.workunit.client.1.smithi060.stdout:0/148: dwrite d3/f26 [0,4194304] 0 2023-10-18T20:58:21.183 INFO:tasks.workunit.client.1.smithi060.stdout:0/149: fsync d3/d8/f28 0 2023-10-18T20:58:21.184 INFO:tasks.workunit.client.1.smithi060.stdout:1/204: mkdir d4/da/d42 0 2023-10-18T20:58:21.185 INFO:tasks.workunit.client.1.smithi060.stdout:1/205: write d4/da/f1c [1068888,23792] 0 2023-10-18T20:58:21.185 INFO:tasks.workunit.client.1.smithi060.stdout:1/206: chown d4/d6/d7/df 35 1 2023-10-18T20:58:21.185 INFO:tasks.workunit.client.1.smithi060.stdout:1/207: stat d4/da/f1c 0 2023-10-18T20:58:21.185 INFO:tasks.workunit.client.1.smithi060.stdout:1/208: stat d4/d38 0 2023-10-18T20:58:21.201 INFO:tasks.workunit.client.0.smithi008.stdout:7/156: sync 2023-10-18T20:58:21.206 INFO:tasks.workunit.client.0.smithi008.stdout:7/157: mkdir d1/d36 0 2023-10-18T20:58:21.206 INFO:tasks.workunit.client.0.smithi008.stdout:7/158: chown d1/c2 1154674 1 2023-10-18T20:58:21.208 INFO:tasks.workunit.client.1.smithi060.stdout:2/151: dwrite d0/f12 [0,4194304] 0 2023-10-18T20:58:21.211 INFO:tasks.workunit.client.1.smithi060.stdout:9/140: dwrite d3/f1b [0,4194304] 0 2023-10-18T20:58:21.215 INFO:tasks.workunit.client.1.smithi060.stdout:7/167: dwrite de/d14/d3a/f3b [0,4194304] 0 2023-10-18T20:58:21.219 INFO:tasks.workunit.client.1.smithi060.stdout:2/152: creat d0/d3/f32 x:0 0 0 2023-10-18T20:58:21.219 INFO:tasks.workunit.client.1.smithi060.stdout:2/153: write d0/d16/f28 [4592312,59136] 0 2023-10-18T20:58:21.220 INFO:tasks.workunit.client.1.smithi060.stdout:8/158: dwrite d4/f2d [0,4194304] 0 2023-10-18T20:58:21.221 INFO:tasks.workunit.client.1.smithi060.stdout:8/159: write d4/f25 [1107061,49059] 0 2023-10-18T20:58:21.221 INFO:tasks.workunit.client.0.smithi008.stdout:0/134: sync 2023-10-18T20:58:21.221 INFO:tasks.workunit.client.0.smithi008.stdout:1/302: sync 2023-10-18T20:58:21.226 INFO:tasks.workunit.client.1.smithi060.stdout:6/98: getdents d10/d1d 0 2023-10-18T20:58:21.226 INFO:tasks.workunit.client.1.smithi060.stdout:3/141: dread d0/f18 [0,4194304] 0 2023-10-18T20:58:21.229 INFO:tasks.workunit.client.0.smithi008.stdout:1/303: rename d9/de/f1c to d9/de/df/d17/d1e/f62 0 2023-10-18T20:58:21.230 INFO:tasks.workunit.client.0.smithi008.stdout:1/304: write d9/de/df/d17/d25/f29 [1279701,115977] 0 2023-10-18T20:58:21.230 INFO:tasks.workunit.client.0.smithi008.stdout:1/305: dread - d9/de/df/d17/d55/f5e zero size 2023-10-18T20:58:21.230 INFO:tasks.workunit.client.0.smithi008.stdout:1/306: truncate d9/de/df/d17/d1e/f4c 583043 0 2023-10-18T20:58:21.233 INFO:tasks.workunit.client.1.smithi060.stdout:2/154: link d0/f10 d0/d8/f33 0 2023-10-18T20:58:21.234 INFO:tasks.workunit.client.0.smithi008.stdout:0/135: dread d0/dd/df/f1c [0,4194304] 0 2023-10-18T20:58:21.235 INFO:tasks.workunit.client.1.smithi060.stdout:9/141: creat d3/d10/d1c/d2a/d33/d29/d2b/f35 x:0 0 0 2023-10-18T20:58:21.238 INFO:tasks.workunit.client.1.smithi060.stdout:3/142: mknod d0/d22/d26/d2b/c2e 0 2023-10-18T20:58:21.242 INFO:tasks.workunit.client.0.smithi008.stdout:6/206: dwrite df/d15/f40 [0,4194304] 0 2023-10-18T20:58:21.242 INFO:tasks.workunit.client.0.smithi008.stdout:6/207: write df/f3b [209730,22114] 0 2023-10-18T20:58:21.243 INFO:tasks.workunit.client.1.smithi060.stdout:0/150: dwrite d3/f17 [8388608,4194304] 0 2023-10-18T20:58:21.243 INFO:tasks.workunit.client.1.smithi060.stdout:5/196: dwrite d0/d6/f1e [0,4194304] 0 2023-10-18T20:58:21.248 INFO:tasks.workunit.client.0.smithi008.stdout:1/307: rename d9/de/df/d17/f50 to d9/de/df/d17/d25/f63 0 2023-10-18T20:58:21.248 INFO:tasks.workunit.client.0.smithi008.stdout:4/187: dwrite d0/d3/d21/f3e [0,4194304] 0 2023-10-18T20:58:21.253 INFO:tasks.workunit.client.1.smithi060.stdout:6/99: dread fa [0,4194304] 0 2023-10-18T20:58:21.258 INFO:tasks.workunit.client.0.smithi008.stdout:4/188: mkdir d0/d40 0 2023-10-18T20:58:21.259 INFO:tasks.workunit.client.0.smithi008.stdout:4/189: creat d0/d3/f41 x:0 0 0 2023-10-18T20:58:21.272 INFO:tasks.workunit.client.0.smithi008.stdout:7/159: dwrite d1/f1f [0,4194304] 0 2023-10-18T20:58:21.272 INFO:tasks.workunit.client.0.smithi008.stdout:7/160: readlink d1/d3/le 0 2023-10-18T20:58:21.276 INFO:tasks.workunit.client.0.smithi008.stdout:4/190: mkdir d0/d3/d21/d42 0 2023-10-18T20:58:21.279 INFO:tasks.workunit.client.0.smithi008.stdout:1/308: dread d9/f42 [0,4194304] 0 2023-10-18T20:58:21.284 INFO:tasks.workunit.client.1.smithi060.stdout:2/155: symlink d0/l34 0 2023-10-18T20:58:21.284 INFO:tasks.workunit.client.1.smithi060.stdout:2/156: creat d0/d3/f35 x:0 0 0 2023-10-18T20:58:21.291 INFO:tasks.workunit.client.1.smithi060.stdout:9/142: creat d3/d10/d1c/d2a/f36 x:0 0 0 2023-10-18T20:58:21.300 INFO:tasks.workunit.client.0.smithi008.stdout:4/191: link d0/d17/f3a d0/d40/f43 0 2023-10-18T20:58:21.302 INFO:tasks.workunit.client.1.smithi060.stdout:0/151: symlink d3/d8/d14/l30 0 2023-10-18T20:58:21.304 INFO:tasks.workunit.client.1.smithi060.stdout:5/197: creat d0/d6/d8/df/d27/f4d x:0 0 0 2023-10-18T20:58:21.305 INFO:tasks.workunit.client.1.smithi060.stdout:5/198: write d0/da/d3b/f4c [574261,7051] 0 2023-10-18T20:58:21.305 INFO:tasks.workunit.client.1.smithi060.stdout:7/168: dwrite de/f1f [0,4194304] 0 2023-10-18T20:58:21.305 INFO:tasks.workunit.client.1.smithi060.stdout:7/169: chown de/d29/l23 16349343 1 2023-10-18T20:58:21.311 INFO:tasks.workunit.client.0.smithi008.stdout:4/192: symlink d0/d3/d21/l44 0 2023-10-18T20:58:21.314 INFO:tasks.workunit.client.1.smithi060.stdout:6/100: mkdir d10/d25 0 2023-10-18T20:58:21.317 INFO:tasks.workunit.client.0.smithi008.stdout:7/161: write d1/fd [1355276,69389] 0 2023-10-18T20:58:21.317 INFO:tasks.workunit.client.0.smithi008.stdout:7/162: chown d1/d3/c23 3 1 2023-10-18T20:58:21.318 INFO:tasks.workunit.client.0.smithi008.stdout:7/163: stat d1/f29 0 2023-10-18T20:58:21.319 INFO:tasks.workunit.client.1.smithi060.stdout:8/160: dwrite d4/d9/fa [0,4194304] 0 2023-10-18T20:58:21.319 INFO:tasks.workunit.client.1.smithi060.stdout:8/161: creat d4/d9/f2e x:0 0 0 2023-10-18T20:58:21.319 INFO:tasks.workunit.client.0.smithi008.stdout:7/164: creat d1/d3/d30/f37 x:0 0 0 2023-10-18T20:58:21.320 INFO:tasks.workunit.client.0.smithi008.stdout:7/165: readlink d1/l33 0 2023-10-18T20:58:21.320 INFO:tasks.workunit.client.0.smithi008.stdout:0/136: dwrite d0/fb [0,4194304] 0 2023-10-18T20:58:21.321 INFO:tasks.workunit.client.1.smithi060.stdout:2/157: symlink d0/d3/d2a/l36 0 2023-10-18T20:58:21.321 INFO:tasks.workunit.client.1.smithi060.stdout:2/158: dread - d0/d3/f32 zero size 2023-10-18T20:58:21.328 INFO:tasks.workunit.client.1.smithi060.stdout:9/143: symlink d3/d10/d1c/d2a/d33/d29/d2b/l37 0 2023-10-18T20:58:21.330 INFO:tasks.workunit.client.1.smithi060.stdout:5/199: rename d0/d6/d8/f1b to d0/d6/d8/df/f4e 0 2023-10-18T20:58:21.344 INFO:tasks.workunit.client.0.smithi008.stdout:0/137: dread d0/f3 [0,4194304] 0 2023-10-18T20:58:21.344 INFO:tasks.workunit.client.0.smithi008.stdout:0/138: stat d0 0 2023-10-18T20:58:21.344 INFO:tasks.workunit.client.0.smithi008.stdout:0/139: stat d0/dd/f18 0 2023-10-18T20:58:21.351 INFO:tasks.workunit.client.1.smithi060.stdout:8/162: truncate d4/f13 3550556 0 2023-10-18T20:58:21.353 INFO:tasks.workunit.client.0.smithi008.stdout:1/309: dwrite d9/de/df/d17/d1e/f62 [4194304,4194304] 0 2023-10-18T20:58:21.357 INFO:tasks.workunit.client.1.smithi060.stdout:9/144: mknod d3/d10/d1c/d2a/d33/d29/d2b/c38 0 2023-10-18T20:58:21.358 INFO:tasks.workunit.client.1.smithi060.stdout:2/159: write d0/d8/f26 [826964,32925] 0 2023-10-18T20:58:21.362 INFO:tasks.workunit.client.0.smithi008.stdout:7/166: unlink d1/d3/fb 0 2023-10-18T20:58:21.362 INFO:tasks.workunit.client.1.smithi060.stdout:5/200: rmdir d0/d6 39 2023-10-18T20:58:21.364 INFO:tasks.workunit.client.1.smithi060.stdout:6/101: getdents d10/d1b 0 2023-10-18T20:58:21.367 INFO:tasks.workunit.client.1.smithi060.stdout:0/152: dwrite d3/f6 [0,4194304] 0 2023-10-18T20:58:21.369 INFO:tasks.workunit.client.0.smithi008.stdout:0/140: dread d0/f2 [0,4194304] 0 2023-10-18T20:58:21.369 INFO:tasks.workunit.client.0.smithi008.stdout:7/167: mknod d1/d36/c38 0 2023-10-18T20:58:21.374 INFO:tasks.workunit.client.0.smithi008.stdout:4/193: rename d0/d40 to d0/d3/d8/d45 0 2023-10-18T20:58:21.377 INFO:tasks.workunit.client.1.smithi060.stdout:8/163: symlink d4/d9/l2f 0 2023-10-18T20:58:21.377 INFO:tasks.workunit.client.1.smithi060.stdout:7/170: dwrite fa [0,4194304] 0 2023-10-18T20:58:21.379 INFO:tasks.workunit.client.1.smithi060.stdout:9/145: symlink d3/d10/d1c/d2a/l39 0 2023-10-18T20:58:21.381 INFO:tasks.workunit.client.0.smithi008.stdout:0/141: mkdir d0/dd/d19/d24 0 2023-10-18T20:58:21.390 INFO:tasks.workunit.client.1.smithi060.stdout:8/164: dread d4/d9/f1b [0,4194304] 0 2023-10-18T20:58:21.394 INFO:tasks.workunit.client.0.smithi008.stdout:3/143: sync 2023-10-18T20:58:21.394 INFO:tasks.workunit.client.0.smithi008.stdout:3/144: truncate d0/d3/d15/f21 249835 0 2023-10-18T20:58:21.395 INFO:tasks.workunit.client.0.smithi008.stdout:3/145: creat d0/d3/de/d13/f2a x:0 0 0 2023-10-18T20:58:21.395 INFO:tasks.workunit.client.0.smithi008.stdout:1/310: rename d9/de/df/d17/d1e/c30 to d9/c64 0 2023-10-18T20:58:21.397 INFO:tasks.workunit.client.0.smithi008.stdout:4/194: dread d0/d3/d8/fb [8388608,4194304] 0 2023-10-18T20:58:21.397 INFO:tasks.workunit.client.0.smithi008.stdout:4/195: readlink d0/d3/l2e 0 2023-10-18T20:58:21.398 INFO:tasks.workunit.client.0.smithi008.stdout:9/167: sync 2023-10-18T20:58:21.398 INFO:tasks.workunit.client.0.smithi008.stdout:9/168: fsync d2/dc/f1e 0 2023-10-18T20:58:21.398 INFO:tasks.workunit.client.0.smithi008.stdout:2/183: sync 2023-10-18T20:58:21.399 INFO:tasks.workunit.client.0.smithi008.stdout:0/142: mknod d0/dd/df/c25 0 2023-10-18T20:58:21.399 INFO:tasks.workunit.client.1.smithi060.stdout:2/160: rename d0/d16/f1c to d0/d8/f37 0 2023-10-18T20:58:21.399 INFO:tasks.workunit.client.1.smithi060.stdout:5/201: mkdir d0/d6/d8/df/d27/d32/d4f 0 2023-10-18T20:58:21.400 INFO:tasks.workunit.client.1.smithi060.stdout:2/161: truncate d0/d8/fc 1290358 0 2023-10-18T20:58:21.400 INFO:tasks.workunit.client.0.smithi008.stdout:1/311: unlink d9/c28 0 2023-10-18T20:58:21.403 INFO:tasks.workunit.client.0.smithi008.stdout:7/168: rename d1/d3/f13 to d1/f39 0 2023-10-18T20:58:21.404 INFO:tasks.workunit.client.0.smithi008.stdout:9/169: mknod d2/dc/d1a/c30 0 2023-10-18T20:58:21.405 INFO:tasks.workunit.client.0.smithi008.stdout:9/170: readlink d2/dc/d17/d19/la 0 2023-10-18T20:58:21.405 INFO:tasks.workunit.client.0.smithi008.stdout:9/171: readlink d2/dc/d1a/d1d/l2d 0 2023-10-18T20:58:21.405 INFO:tasks.workunit.client.0.smithi008.stdout:9/172: fsync d2/dc/f15 0 2023-10-18T20:58:21.405 INFO:tasks.workunit.client.0.smithi008.stdout:9/173: write d2/dc/d1a/f21 [1289437,99228] 0 2023-10-18T20:58:21.406 INFO:tasks.workunit.client.1.smithi060.stdout:9/146: dread d3/f6 [0,4194304] 0 2023-10-18T20:58:21.407 INFO:tasks.workunit.client.0.smithi008.stdout:0/143: symlink d0/dd/l26 0 2023-10-18T20:58:21.407 INFO:tasks.workunit.client.0.smithi008.stdout:0/144: chown d0/dd 1678278961 1 2023-10-18T20:58:21.407 INFO:tasks.workunit.client.0.smithi008.stdout:9/174: write d2/f26 [453348,74391] 0 2023-10-18T20:58:21.407 INFO:tasks.workunit.client.0.smithi008.stdout:9/175: readlink d2/dc/d17/l23 0 2023-10-18T20:58:21.407 INFO:tasks.workunit.client.0.smithi008.stdout:9/176: truncate d2/f29 106544 0 2023-10-18T20:58:21.408 INFO:tasks.workunit.client.0.smithi008.stdout:1/312: creat d9/de/df/d17/d1e/f65 x:0 0 0 2023-10-18T20:58:21.408 INFO:tasks.workunit.client.1.smithi060.stdout:7/171: write de/f1f [1691415,77987] 0 2023-10-18T20:58:21.409 INFO:tasks.workunit.client.1.smithi060.stdout:7/172: stat de/d14/d3a/f3b 0 2023-10-18T20:58:21.409 INFO:tasks.workunit.client.0.smithi008.stdout:7/169: link d1/d3/c34 d1/c3a 0 2023-10-18T20:58:21.410 INFO:tasks.workunit.client.0.smithi008.stdout:7/170: stat d1/f1b 0 2023-10-18T20:58:21.420 INFO:tasks.workunit.client.0.smithi008.stdout:0/145: creat d0/dd/f27 x:0 0 0 2023-10-18T20:58:21.421 INFO:tasks.workunit.client.0.smithi008.stdout:0/146: truncate d0/dd/f18 1332172 0 2023-10-18T20:58:21.426 INFO:tasks.workunit.client.0.smithi008.stdout:0/147: dread d0/dd/df/f1c [0,4194304] 0 2023-10-18T20:58:21.426 INFO:tasks.workunit.client.0.smithi008.stdout:4/196: write d0/f13 [677217,108028] 0 2023-10-18T20:58:21.430 INFO:tasks.workunit.client.0.smithi008.stdout:7/171: truncate d1/d3/fc 1936214 0 2023-10-18T20:58:21.430 INFO:tasks.workunit.client.0.smithi008.stdout:7/172: chown d1/d3/d30 0 1 2023-10-18T20:58:21.430 INFO:tasks.workunit.client.0.smithi008.stdout:7/173: dread - d1/d3/d30/f37 zero size 2023-10-18T20:58:21.431 INFO:tasks.workunit.client.1.smithi060.stdout:6/102: truncate f7 6911960 0 2023-10-18T20:58:21.434 INFO:tasks.workunit.client.1.smithi060.stdout:5/202: creat d0/da/d3b/d43/f50 x:0 0 0 2023-10-18T20:58:21.436 INFO:tasks.workunit.client.0.smithi008.stdout:5/125: sync 2023-10-18T20:58:21.436 INFO:tasks.workunit.client.0.smithi008.stdout:5/126: dread - d0/f25 zero size 2023-10-18T20:58:21.437 INFO:tasks.workunit.client.0.smithi008.stdout:8/305: sync 2023-10-18T20:58:21.437 INFO:tasks.workunit.client.0.smithi008.stdout:8/306: chown d5/d8/df/c61 803609 1 2023-10-18T20:58:21.438 INFO:tasks.workunit.client.0.smithi008.stdout:6/208: sync 2023-10-18T20:58:21.438 INFO:tasks.workunit.client.0.smithi008.stdout:6/209: creat df/d15/f46 x:0 0 0 2023-10-18T20:58:21.442 INFO:tasks.workunit.client.0.smithi008.stdout:1/313: write d9/de/f45 [2763910,49460] 0 2023-10-18T20:58:21.454 INFO:tasks.workunit.client.1.smithi060.stdout:2/162: rmdir d0/d3/d2a/d31 0 2023-10-18T20:58:21.463 INFO:tasks.workunit.client.0.smithi008.stdout:4/197: link d0/d3/c36 d0/d3/d21/d42/c46 0 2023-10-18T20:58:21.464 INFO:tasks.workunit.client.0.smithi008.stdout:0/148: creat d0/dd/d19/f28 x:0 0 0 2023-10-18T20:58:21.465 INFO:tasks.workunit.client.0.smithi008.stdout:0/149: chown d0/l1f 415958 1 2023-10-18T20:58:21.465 INFO:tasks.workunit.client.0.smithi008.stdout:7/174: mkdir d1/d36/d3b 0 2023-10-18T20:58:21.466 INFO:tasks.workunit.client.1.smithi060.stdout:0/153: rmdir d3 39 2023-10-18T20:58:21.467 INFO:tasks.workunit.client.1.smithi060.stdout:0/154: fdatasync d3/d8/f2d 0 2023-10-18T20:58:21.467 INFO:tasks.workunit.client.1.smithi060.stdout:0/155: write d3/d8/d14/f1d [62858,96350] 0 2023-10-18T20:58:21.468 INFO:tasks.workunit.client.1.smithi060.stdout:9/147: mknod d3/d10/d19/c3a 0 2023-10-18T20:58:21.470 INFO:tasks.workunit.client.0.smithi008.stdout:8/307: symlink d5/d8/df/d2e/l82 0 2023-10-18T20:58:21.470 INFO:tasks.workunit.client.0.smithi008.stdout:8/308: readlink d5/ld 0 2023-10-18T20:58:21.472 INFO:tasks.workunit.client.1.smithi060.stdout:7/173: dwrite de/d14/f2d [0,4194304] 0 2023-10-18T20:58:21.479 INFO:tasks.workunit.client.1.smithi060.stdout:8/165: rmdir d4 39 2023-10-18T20:58:21.488 INFO:tasks.workunit.client.1.smithi060.stdout:6/103: rename d10/f13 to d10/d1d/f26 0 2023-10-18T20:58:21.488 INFO:tasks.workunit.client.0.smithi008.stdout:7/175: write d1/f4 [2551585,95584] 0 2023-10-18T20:58:21.489 INFO:tasks.workunit.client.0.smithi008.stdout:7/176: creat d1/d3/d30/f3c x:0 0 0 2023-10-18T20:58:21.489 INFO:tasks.workunit.client.0.smithi008.stdout:7/177: write d1/f1b [847704,120683] 0 2023-10-18T20:58:21.490 INFO:tasks.workunit.client.1.smithi060.stdout:4/105: sync 2023-10-18T20:58:21.490 INFO:tasks.workunit.client.1.smithi060.stdout:5/203: creat d0/d6/d8/df/f51 x:0 0 0 2023-10-18T20:58:21.491 INFO:tasks.workunit.client.0.smithi008.stdout:6/210: unlink df/f1e 0 2023-10-18T20:58:21.491 INFO:tasks.workunit.client.0.smithi008.stdout:0/150: mkdir d0/dd/d29 0 2023-10-18T20:58:21.492 INFO:tasks.workunit.client.1.smithi060.stdout:0/156: truncate d3/fc 2760582 0 2023-10-18T20:58:21.492 INFO:tasks.workunit.client.0.smithi008.stdout:2/184: dwrite d1/d3/dd/f1e [0,4194304] 0 2023-10-18T20:58:21.493 INFO:tasks.workunit.client.0.smithi008.stdout:5/127: getdents d0/d2/d9 0 2023-10-18T20:58:21.496 INFO:tasks.workunit.client.0.smithi008.stdout:1/314: rename d9/de/df/d17/l3f to d9/de/df/d17/d25/l66 0 2023-10-18T20:58:21.505 INFO:tasks.workunit.client.0.smithi008.stdout:0/151: mkdir d0/dd/df/d2a 0 2023-10-18T20:58:21.507 INFO:tasks.workunit.client.1.smithi060.stdout:7/174: creat de/d14/d2f/f3c x:0 0 0 2023-10-18T20:58:21.509 INFO:tasks.workunit.client.0.smithi008.stdout:6/211: link df/d15/f40 df/d36/f47 0 2023-10-18T20:58:21.509 INFO:tasks.workunit.client.0.smithi008.stdout:6/212: write df/d19/f1c [2831166,85660] 0 2023-10-18T20:58:21.509 INFO:tasks.workunit.client.0.smithi008.stdout:6/213: write df/f35 [710658,27289] 0 2023-10-18T20:58:21.509 INFO:tasks.workunit.client.0.smithi008.stdout:6/214: fdatasync df/d15/f46 0 2023-10-18T20:58:21.510 INFO:tasks.workunit.client.1.smithi060.stdout:9/148: read d3/f1b [537684,28517] 0 2023-10-18T20:58:21.510 INFO:tasks.workunit.client.1.smithi060.stdout:9/149: creat d3/d10/d1c/d2a/f3b x:0 0 0 2023-10-18T20:58:21.514 INFO:tasks.workunit.client.0.smithi008.stdout:2/185: stat d1/l4 0 2023-10-18T20:58:21.514 INFO:tasks.workunit.client.0.smithi008.stdout:2/186: truncate d1/d3/f1b 1066592 0 2023-10-18T20:58:21.515 INFO:tasks.workunit.client.0.smithi008.stdout:2/187: chown d1/c37 3 1 2023-10-18T20:58:21.515 INFO:tasks.workunit.client.1.smithi060.stdout:8/166: truncate d4/d9/f23 146632 0 2023-10-18T20:58:21.516 INFO:tasks.workunit.client.0.smithi008.stdout:9/177: dwrite d2/f4 [0,4194304] 0 2023-10-18T20:58:21.517 INFO:tasks.workunit.client.0.smithi008.stdout:5/128: dread d0/f3 [0,4194304] 0 2023-10-18T20:58:21.517 INFO:tasks.workunit.client.0.smithi008.stdout:5/129: creat d0/f28 x:0 0 0 2023-10-18T20:58:21.518 INFO:tasks.workunit.client.0.smithi008.stdout:7/178: write d1/d3/f2a [142878,71870] 0 2023-10-18T20:58:21.527 INFO:tasks.workunit.client.0.smithi008.stdout:5/130: dread d0/f3 [0,4194304] 0 2023-10-18T20:58:21.529 INFO:tasks.workunit.client.0.smithi008.stdout:4/198: dwrite d0/d3/d8/fa [0,4194304] 0 2023-10-18T20:58:21.532 INFO:tasks.workunit.client.0.smithi008.stdout:5/131: dread d0/d2/f23 [0,4194304] 0 2023-10-18T20:58:21.532 INFO:tasks.workunit.client.0.smithi008.stdout:5/132: dread - d0/d2/d19/d1b/f27 zero size 2023-10-18T20:58:21.551 INFO:tasks.workunit.client.1.smithi060.stdout:3/143: sync 2023-10-18T20:58:21.552 INFO:tasks.workunit.client.1.smithi060.stdout:3/144: readlink d0/l2d 0 2023-10-18T20:58:21.553 INFO:tasks.workunit.client.1.smithi060.stdout:1/209: sync 2023-10-18T20:58:21.553 INFO:tasks.workunit.client.1.smithi060.stdout:1/210: dread - d4/da/de/d2a/d32/dd/f3f zero size 2023-10-18T20:58:21.555 INFO:tasks.workunit.client.1.smithi060.stdout:6/104: dwrite d10/d1d/f24 [0,4194304] 0 2023-10-18T20:58:21.555 INFO:tasks.workunit.client.1.smithi060.stdout:6/105: dread - d10/d1b/f22 zero size 2023-10-18T20:58:21.555 INFO:tasks.workunit.client.1.smithi060.stdout:6/106: dread - d10/d17/f23 zero size 2023-10-18T20:58:21.555 INFO:tasks.workunit.client.1.smithi060.stdout:6/107: chown d10/d17/f23 21074744 1 2023-10-18T20:58:21.556 INFO:tasks.workunit.client.1.smithi060.stdout:6/108: chown d10/l16 18 1 2023-10-18T20:58:21.556 INFO:tasks.workunit.client.1.smithi060.stdout:6/109: write fd [7543728,14927] 0 2023-10-18T20:58:21.556 INFO:tasks.workunit.client.1.smithi060.stdout:6/110: write fb [3213212,86134] 0 2023-10-18T20:58:21.557 INFO:tasks.workunit.client.1.smithi060.stdout:4/106: creat d4/dc/d11/d1d/f21 x:0 0 0 2023-10-18T20:58:21.558 INFO:tasks.workunit.client.0.smithi008.stdout:1/315: truncate d9/de/df/d17/d25/f32 4548252 0 2023-10-18T20:58:21.559 INFO:tasks.workunit.client.0.smithi008.stdout:1/316: write d9/de/df/f5b [312603,13691] 0 2023-10-18T20:58:21.559 INFO:tasks.workunit.client.0.smithi008.stdout:1/317: chown d9/de/df/d17/l4b 3681287 1 2023-10-18T20:58:21.559 INFO:tasks.workunit.client.1.smithi060.stdout:5/204: mknod d0/d6/d8/df/d27/d32/d4f/c52 0 2023-10-18T20:58:21.564 INFO:tasks.workunit.client.0.smithi008.stdout:8/309: rename d5/d8/df/f80 to d5/d8/df/d54/f83 0 2023-10-18T20:58:21.564 INFO:tasks.workunit.client.0.smithi008.stdout:8/310: chown d5/f3d 22102706 1 2023-10-18T20:58:21.568 INFO:tasks.workunit.client.1.smithi060.stdout:1/211: dread d4/f8 [0,4194304] 0 2023-10-18T20:58:21.568 INFO:tasks.workunit.client.1.smithi060.stdout:1/212: chown d4/da/l17 934582228 1 2023-10-18T20:58:21.575 INFO:tasks.workunit.client.0.smithi008.stdout:8/311: read d5/f37 [4044475,126840] 0 2023-10-18T20:58:21.576 INFO:tasks.workunit.client.0.smithi008.stdout:8/312: fdatasync d5/d8/df/d2e/f43 0 2023-10-18T20:58:21.576 INFO:tasks.workunit.client.0.smithi008.stdout:8/313: readlink d5/d8/df/d2e/l3e 0 2023-10-18T20:58:22.141 INFO:tasks.workunit.client.1.smithi060.stdout:7/175: mknod de/c3d 0 2023-10-18T20:58:22.141 INFO:tasks.workunit.client.1.smithi060.stdout:7/176: truncate de/d14/d1d/f2a 219736 0 2023-10-18T20:58:22.144 INFO:tasks.workunit.client.1.smithi060.stdout:9/150: creat d3/d10/f3c x:0 0 0 2023-10-18T20:58:22.146 INFO:tasks.workunit.client.1.smithi060.stdout:8/167: creat d4/f30 x:0 0 0 2023-10-18T20:58:22.146 INFO:tasks.workunit.client.1.smithi060.stdout:8/168: chown d4/d9/f2e 118731 1 2023-10-18T20:58:22.147 INFO:tasks.workunit.client.1.smithi060.stdout:3/145: mkdir d0/d2f 0 2023-10-18T20:58:22.150 INFO:tasks.workunit.client.0.smithi008.stdout:0/152: truncate d0/f1d 128471 0 2023-10-18T20:58:22.152 INFO:tasks.workunit.client.0.smithi008.stdout:6/215: mkdir df/d15/d48 0 2023-10-18T20:58:22.152 INFO:tasks.workunit.client.0.smithi008.stdout:6/216: chown df/d19/f32 165031726 1 2023-10-18T20:58:22.153 INFO:tasks.workunit.client.0.smithi008.stdout:6/217: truncate df/f3b 1025705 0 2023-10-18T20:58:22.153 INFO:tasks.workunit.client.0.smithi008.stdout:6/218: chown df/d19 159125093 1 2023-10-18T20:58:22.153 INFO:tasks.workunit.client.1.smithi060.stdout:6/111: creat d10/d1b/f27 x:0 0 0 2023-10-18T20:58:22.154 INFO:tasks.workunit.client.1.smithi060.stdout:4/107: creat d4/dc/f22 x:0 0 0 2023-10-18T20:58:22.156 INFO:tasks.workunit.client.1.smithi060.stdout:5/205: symlink d0/d6/d8/df/l53 0 2023-10-18T20:58:22.157 INFO:tasks.workunit.client.0.smithi008.stdout:2/188: mkdir d1/d3/dd/d1c/d3a/d45 0 2023-10-18T20:58:22.157 INFO:tasks.workunit.client.0.smithi008.stdout:2/189: dread - d1/d3/dd/d1c/d39/f3f zero size 2023-10-18T20:58:22.157 INFO:tasks.workunit.client.0.smithi008.stdout:9/178: symlink d2/l31 0 2023-10-18T20:58:22.159 INFO:tasks.workunit.client.1.smithi060.stdout:0/157: link d3/d8/f27 d3/d8/f31 0 2023-10-18T20:58:22.159 INFO:tasks.workunit.client.1.smithi060.stdout:0/158: read - d3/d8/f31 zero size 2023-10-18T20:58:22.159 INFO:tasks.workunit.client.0.smithi008.stdout:7/179: mkdir d1/d36/d3d 0 2023-10-18T20:58:22.161 INFO:tasks.workunit.client.1.smithi060.stdout:6/112: dread f8 [0,4194304] 0 2023-10-18T20:58:22.165 INFO:tasks.workunit.client.1.smithi060.stdout:4/108: dread d4/dc/d11/f1e [0,4194304] 0 2023-10-18T20:58:22.165 INFO:tasks.workunit.client.1.smithi060.stdout:1/213: truncate f1 1102609 0 2023-10-18T20:58:22.166 INFO:tasks.workunit.client.0.smithi008.stdout:4/199: symlink d0/d3/d8/l47 0 2023-10-18T20:58:22.167 INFO:tasks.workunit.client.0.smithi008.stdout:5/133: link d0/d2/f23 d0/f29 0 2023-10-18T20:58:22.167 INFO:tasks.workunit.client.0.smithi008.stdout:5/134: creat d0/d2/d19/d1b/f2a x:0 0 0 2023-10-18T20:58:22.167 INFO:tasks.workunit.client.0.smithi008.stdout:5/135: creat d0/d2/d19/d1b/d20/f2b x:0 0 0 2023-10-18T20:58:22.176 INFO:tasks.workunit.client.1.smithi060.stdout:7/177: rename de/d14/f16 to de/d14/d2f/f3e 0 2023-10-18T20:58:22.181 INFO:tasks.workunit.client.0.smithi008.stdout:7/180: write d1/f1f [3337827,84438] 0 2023-10-18T20:58:22.190 INFO:tasks.workunit.client.1.smithi060.stdout:3/146: truncate d0/fa 967938 0 2023-10-18T20:58:22.198 INFO:tasks.workunit.client.1.smithi060.stdout:5/206: symlink d0/d6/db/l54 0 2023-10-18T20:58:22.198 INFO:tasks.workunit.client.1.smithi060.stdout:0/159: mkdir d3/d32 0 2023-10-18T20:58:22.209 INFO:tasks.workunit.client.1.smithi060.stdout:3/147: read d0/fa [680165,44875] 0 2023-10-18T20:58:22.210 INFO:tasks.workunit.client.1.smithi060.stdout:4/109: link d4/dc/d11/d1d/f21 d4/dc/f23 0 2023-10-18T20:58:22.210 INFO:tasks.workunit.client.1.smithi060.stdout:4/110: stat d4/dc/c1c 0 2023-10-18T20:58:22.211 INFO:tasks.workunit.client.1.smithi060.stdout:1/214: mknod d4/d6/d14/d41/c43 0 2023-10-18T20:58:22.213 INFO:tasks.workunit.client.1.smithi060.stdout:9/151: rename d3/d10/l22 to d3/d10/d19/l3d 0 2023-10-18T20:58:22.214 INFO:tasks.workunit.client.0.smithi008.stdout:2/190: dwrite d1/d3/dd/d25/d34/f3b [0,4194304] 0 2023-10-18T20:58:22.215 INFO:tasks.workunit.client.0.smithi008.stdout:2/191: creat d1/d3/dd/d25/d34/f46 x:0 0 0 2023-10-18T20:58:22.216 INFO:tasks.workunit.client.1.smithi060.stdout:8/169: getdents d4 0 2023-10-18T20:58:22.217 INFO:tasks.workunit.client.1.smithi060.stdout:2/163: sync 2023-10-18T20:58:22.218 INFO:tasks.workunit.client.1.smithi060.stdout:2/164: write d0/d8/f1d [1000621,129399] 0 2023-10-18T20:58:22.219 INFO:tasks.workunit.client.0.smithi008.stdout:6/219: mknod df/c49 0 2023-10-18T20:58:22.221 INFO:tasks.workunit.client.1.smithi060.stdout:3/148: symlink d0/d22/d26/d2b/l30 0 2023-10-18T20:58:22.222 INFO:tasks.workunit.client.1.smithi060.stdout:5/207: creat d0/d6/f55 x:0 0 0 2023-10-18T20:58:22.222 INFO:tasks.workunit.client.0.smithi008.stdout:9/179: symlink d2/dc/l32 0 2023-10-18T20:58:22.223 INFO:tasks.workunit.client.0.smithi008.stdout:9/180: fdatasync d2/f4 0 2023-10-18T20:58:22.223 INFO:tasks.workunit.client.1.smithi060.stdout:5/208: write d0/d6/d8/df/d27/f37 [307743,122990] 0 2023-10-18T20:58:22.226 INFO:tasks.workunit.client.1.smithi060.stdout:4/111: creat d4/f24 x:0 0 0 2023-10-18T20:58:22.226 INFO:tasks.workunit.client.1.smithi060.stdout:4/112: write d4/dc/f19 [177587,24574] 0 2023-10-18T20:58:22.227 INFO:tasks.workunit.client.1.smithi060.stdout:4/113: write d4/dc/d11/f7 [3430767,127493] 0 2023-10-18T20:58:22.230 INFO:tasks.workunit.client.1.smithi060.stdout:1/215: symlink d4/da/l44 0 2023-10-18T20:58:22.231 INFO:tasks.workunit.client.1.smithi060.stdout:6/113: rename d10/d1d to d10/d17/d28 0 2023-10-18T20:58:22.235 INFO:tasks.workunit.client.1.smithi060.stdout:1/216: dread d4/d6/f1f [0,4194304] 0 2023-10-18T20:58:22.236 INFO:tasks.workunit.client.1.smithi060.stdout:1/217: fdatasync d4/d6/d7/df/f40 0 2023-10-18T20:58:22.239 INFO:tasks.workunit.client.0.smithi008.stdout:5/136: rename d0/d2/d19/d1b/d20/f22 to d0/d2/d19/f2c 0 2023-10-18T20:58:22.239 INFO:tasks.workunit.client.1.smithi060.stdout:9/152: link d3/d10/fe d3/d10/d1c/d25/f3e 0 2023-10-18T20:58:22.239 INFO:tasks.workunit.client.1.smithi060.stdout:9/153: dread - d3/d10/d1c/d2a/f3b zero size 2023-10-18T20:58:22.240 INFO:tasks.workunit.client.1.smithi060.stdout:8/170: mkdir d4/d9/d31 0 2023-10-18T20:58:22.241 INFO:tasks.workunit.client.1.smithi060.stdout:4/114: dread d4/dc/d11/f1e [0,4194304] 0 2023-10-18T20:58:22.241 INFO:tasks.workunit.client.1.smithi060.stdout:4/115: chown d4/dc/d11/d13 1 1 2023-10-18T20:58:22.242 INFO:tasks.workunit.client.1.smithi060.stdout:2/165: truncate d0/f12 1388225 0 2023-10-18T20:58:22.242 INFO:tasks.workunit.client.1.smithi060.stdout:4/116: chown d4/dc/d11/d13/f20 827575270 1 2023-10-18T20:58:22.242 INFO:tasks.workunit.client.0.smithi008.stdout:1/318: getdents d9 0 2023-10-18T20:58:22.243 INFO:tasks.workunit.client.0.smithi008.stdout:1/319: truncate d9/de/df/d17/d1e/f4c 1336287 0 2023-10-18T20:58:22.244 INFO:tasks.workunit.client.1.smithi060.stdout:5/209: mknod d0/d6/db/d2a/c56 0 2023-10-18T20:58:22.245 INFO:tasks.workunit.client.1.smithi060.stdout:5/210: creat d0/d6/d8/df/f57 x:0 0 0 2023-10-18T20:58:22.245 INFO:tasks.workunit.client.1.smithi060.stdout:5/211: write d0/d6/f55 [229263,7747] 0 2023-10-18T20:58:22.246 INFO:tasks.workunit.client.1.smithi060.stdout:3/149: truncate d0/f19 3817516 0 2023-10-18T20:58:22.246 INFO:tasks.workunit.client.1.smithi060.stdout:3/150: chown d0/ff 572 1 2023-10-18T20:58:22.247 INFO:tasks.workunit.client.1.smithi060.stdout:0/160: rename d3/d8/d14/f25 to d3/f33 0 2023-10-18T20:58:22.247 INFO:tasks.workunit.client.1.smithi060.stdout:0/161: fdatasync d3/d8/d14/f2b 0 2023-10-18T20:58:22.248 INFO:tasks.workunit.client.1.smithi060.stdout:6/114: truncate fa 7166420 0 2023-10-18T20:58:22.251 INFO:tasks.workunit.client.0.smithi008.stdout:9/181: rmdir d2/dc/d17/d19 39 2023-10-18T20:58:22.251 INFO:tasks.workunit.client.0.smithi008.stdout:1/320: rmdir d9/de/df/d17/d1e/d3c 39 2023-10-18T20:58:22.251 INFO:tasks.workunit.client.0.smithi008.stdout:1/321: truncate d9/de/df/f1d 8946365 0 2023-10-18T20:58:22.252 INFO:tasks.workunit.client.1.smithi060.stdout:9/154: dread d3/d10/fe [0,4194304] 0 2023-10-18T20:58:22.256 INFO:tasks.workunit.client.1.smithi060.stdout:2/166: truncate d0/f10 697903 0 2023-10-18T20:58:22.256 INFO:tasks.workunit.client.1.smithi060.stdout:1/218: creat d4/da/de/d2a/f45 x:0 0 0 2023-10-18T20:58:22.256 INFO:tasks.workunit.client.1.smithi060.stdout:4/117: link d4/ce d4/dc/d11/c25 0 2023-10-18T20:58:22.256 INFO:tasks.workunit.client.1.smithi060.stdout:4/118: readlink d4/dc/l14 0 2023-10-18T20:58:22.258 INFO:tasks.workunit.client.1.smithi060.stdout:5/212: symlink d0/d6/d9/l58 0 2023-10-18T20:58:22.259 INFO:tasks.workunit.client.1.smithi060.stdout:3/151: creat d0/d22/d26/d2c/f31 x:0 0 0 2023-10-18T20:58:22.268 INFO:tasks.workunit.client.1.smithi060.stdout:2/167: rename d0/d8/f1d to d0/f38 0 2023-10-18T20:58:22.268 INFO:tasks.workunit.client.1.smithi060.stdout:2/168: chown d0/d3/f35 1712714 1 2023-10-18T20:58:22.269 INFO:tasks.workunit.client.1.smithi060.stdout:0/162: write d3/fc [1670807,23745] 0 2023-10-18T20:58:22.279 INFO:tasks.workunit.client.0.smithi008.stdout:2/192: dwrite d1/d3/dd/d1c/f28 [0,4194304] 0 2023-10-18T20:58:22.280 INFO:tasks.workunit.client.0.smithi008.stdout:2/193: write d1/d3/dd/d25/f2f [1451057,60686] 0 2023-10-18T20:58:22.280 INFO:tasks.workunit.client.0.smithi008.stdout:2/194: fdatasync d1/d3/dd/d1c/f3c 0 2023-10-18T20:58:22.280 INFO:tasks.workunit.client.0.smithi008.stdout:2/195: creat d1/d3/dd/d25/f47 x:0 0 0 2023-10-18T20:58:22.292 INFO:tasks.workunit.client.1.smithi060.stdout:4/119: mknod d4/dc/c26 0 2023-10-18T20:58:22.295 INFO:tasks.workunit.client.1.smithi060.stdout:5/213: unlink d0/d6/f7 0 2023-10-18T20:58:22.295 INFO:tasks.workunit.client.1.smithi060.stdout:5/214: read - d0/d6/d8/df/d27/f4d zero size 2023-10-18T20:58:22.295 INFO:tasks.workunit.client.1.smithi060.stdout:5/215: dread - d0/d6/d8/df/f57 zero size 2023-10-18T20:58:22.297 INFO:tasks.workunit.client.0.smithi008.stdout:2/196: write d1/f19 [124596,79797] 0 2023-10-18T20:58:22.298 INFO:tasks.workunit.client.0.smithi008.stdout:2/197: write d1/d3/dd/d25/d34/f46 [234933,47958] 0 2023-10-18T20:58:22.299 INFO:tasks.workunit.client.1.smithi060.stdout:5/216: creat d0/d6/db/d41/f59 x:0 0 0 2023-10-18T20:58:22.301 INFO:tasks.workunit.client.0.smithi008.stdout:7/181: rename d1/d3/d30 to d1/d36/d3d/d3e 0 2023-10-18T20:58:22.302 INFO:tasks.workunit.client.0.smithi008.stdout:7/182: write d1/f1f [3989610,59006] 0 2023-10-18T20:58:22.303 INFO:tasks.workunit.client.1.smithi060.stdout:3/152: dread d0/fd [0,4194304] 0 2023-10-18T20:58:22.303 INFO:tasks.workunit.client.1.smithi060.stdout:5/217: rename d0/d6/db/d41/f59 to d0/d6/db/d2a/f5a 0 2023-10-18T20:58:22.307 INFO:tasks.workunit.client.0.smithi008.stdout:7/183: unlink d1/c22 0 2023-10-18T20:58:22.307 INFO:tasks.workunit.client.0.smithi008.stdout:7/184: readlink d1/d3/le 0 2023-10-18T20:58:22.309 INFO:tasks.workunit.client.0.smithi008.stdout:7/185: mknod d1/d3/c3f 0 2023-10-18T20:58:22.309 INFO:tasks.workunit.client.0.smithi008.stdout:7/186: fdatasync d1/d36/d3d/d3e/f3c 0 2023-10-18T20:58:22.309 INFO:tasks.workunit.client.0.smithi008.stdout:7/187: fdatasync d1/d3/d20/f2f 0 2023-10-18T20:58:22.311 INFO:tasks.workunit.client.1.smithi060.stdout:3/153: creat d0/d2f/f32 x:0 0 0 2023-10-18T20:58:22.311 INFO:tasks.workunit.client.1.smithi060.stdout:3/154: write d0/fa [185920,46003] 0 2023-10-18T20:58:22.312 INFO:tasks.workunit.client.0.smithi008.stdout:7/188: truncate d1/f1b 276901 0 2023-10-18T20:58:22.312 INFO:tasks.workunit.client.0.smithi008.stdout:7/189: chown d1/d3/c3f 11 1 2023-10-18T20:58:22.314 INFO:tasks.workunit.client.0.smithi008.stdout:7/190: rename d1/d3/l2e to d1/d3/l40 0 2023-10-18T20:58:22.317 INFO:tasks.workunit.client.1.smithi060.stdout:0/163: dread d3/d8/f28 [0,4194304] 0 2023-10-18T20:58:22.317 INFO:tasks.workunit.client.1.smithi060.stdout:0/164: write d3/d8/f31 [854897,121795] 0 2023-10-18T20:58:22.318 INFO:tasks.workunit.client.1.smithi060.stdout:6/115: dwrite d10/d1b/f27 [0,4194304] 0 2023-10-18T20:58:22.323 INFO:tasks.workunit.client.0.smithi008.stdout:7/191: rename d1/fd to d1/d36/d3d/f41 0 2023-10-18T20:58:22.323 INFO:tasks.workunit.client.0.smithi008.stdout:7/192: fsync d1/d3/f1d 0 2023-10-18T20:58:22.326 INFO:tasks.workunit.client.1.smithi060.stdout:2/169: read d0/d3/f17 [1048153,70066] 0 2023-10-18T20:58:22.326 INFO:tasks.workunit.client.1.smithi060.stdout:2/170: fsync d0/d8/f26 0 2023-10-18T20:58:22.326 INFO:tasks.workunit.client.1.smithi060.stdout:2/171: dread - d0/d16/f25 zero size 2023-10-18T20:58:22.334 INFO:tasks.workunit.client.1.smithi060.stdout:6/116: dread f7 [0,4194304] 0 2023-10-18T20:58:22.343 INFO:tasks.workunit.client.1.smithi060.stdout:6/117: write fd [2094495,16360] 0 2023-10-18T20:58:22.346 INFO:tasks.workunit.client.1.smithi060.stdout:1/219: dwrite d4/da/de/d2a/d32/dd/f30 [0,4194304] 0 2023-10-18T20:58:22.347 INFO:tasks.workunit.client.0.smithi008.stdout:9/182: dwrite d2/dc/f22 [0,4194304] 0 2023-10-18T20:58:22.349 INFO:tasks.workunit.client.0.smithi008.stdout:1/322: dwrite d9/de/df/d17/d25/f3d [0,4194304] 0 2023-10-18T20:58:22.349 INFO:tasks.workunit.client.0.smithi008.stdout:1/323: write d9/de/df/d17/d25/f44 [893930,95187] 0 2023-10-18T20:58:22.357 INFO:tasks.workunit.client.1.smithi060.stdout:5/218: write d0/f1d [633801,100523] 0 2023-10-18T20:58:22.358 INFO:tasks.workunit.client.1.smithi060.stdout:5/219: chown d0/d6/d8/df/d27/d32 62089495 1 2023-10-18T20:58:22.360 INFO:tasks.workunit.client.1.smithi060.stdout:0/165: symlink d3/l34 0 2023-10-18T20:58:22.365 INFO:tasks.workunit.client.1.smithi060.stdout:2/172: dwrite d0/d3/f35 [0,4194304] 0 2023-10-18T20:58:22.370 INFO:tasks.workunit.client.1.smithi060.stdout:6/118: mknod d10/d17/c29 0 2023-10-18T20:58:22.370 INFO:tasks.workunit.client.0.smithi008.stdout:9/183: getdents d2/dc/d17/d19 0 2023-10-18T20:58:22.372 INFO:tasks.workunit.client.1.smithi060.stdout:1/220: rename d4/da/de/d2a/d32/dd/f13 to d4/da/de/d2a/f46 0 2023-10-18T20:58:22.376 INFO:tasks.workunit.client.1.smithi060.stdout:0/166: mkdir d3/d32/d35 0 2023-10-18T20:58:22.376 INFO:tasks.workunit.client.1.smithi060.stdout:5/220: dread d0/d6/f42 [0,4194304] 0 2023-10-18T20:58:22.380 INFO:tasks.workunit.client.0.smithi008.stdout:8/314: sync 2023-10-18T20:58:22.384 INFO:tasks.workunit.client.0.smithi008.stdout:3/146: sync 2023-10-18T20:58:22.390 INFO:tasks.workunit.client.1.smithi060.stdout:2/173: link d0/d8/fa d0/d3/d2a/f39 0 2023-10-18T20:58:22.391 INFO:tasks.workunit.client.0.smithi008.stdout:9/184: truncate d2/dc/f22 580965 0 2023-10-18T20:58:22.396 INFO:tasks.workunit.client.0.smithi008.stdout:7/193: dwrite d1/f6 [0,4194304] 0 2023-10-18T20:58:22.396 INFO:tasks.workunit.client.0.smithi008.stdout:8/315: dread d5/d8/f12 [0,4194304] 0 2023-10-18T20:58:22.397 INFO:tasks.workunit.client.0.smithi008.stdout:0/153: dwrite d0/f2 [0,4194304] 0 2023-10-18T20:58:22.399 INFO:tasks.workunit.client.0.smithi008.stdout:3/147: link d0/d3/d15/f21 d0/d3/f2b 0 2023-10-18T20:58:22.417 INFO:tasks.workunit.client.1.smithi060.stdout:6/119: link d10/d17/f23 d10/d1b/f2a 0 2023-10-18T20:58:22.420 INFO:tasks.workunit.client.0.smithi008.stdout:7/194: mknod d1/d36/d3b/c42 0 2023-10-18T20:58:22.428 INFO:tasks.workunit.client.1.smithi060.stdout:1/221: symlink d4/d6/d14/d41/l47 0 2023-10-18T20:58:22.437 INFO:tasks.workunit.client.1.smithi060.stdout:0/167: rename d3/d8/d14/f1d to d3/d32/d35/f36 0 2023-10-18T20:58:22.443 INFO:tasks.workunit.client.0.smithi008.stdout:3/148: truncate d0/d3/f2b 182566 0 2023-10-18T20:58:22.447 INFO:tasks.workunit.client.0.smithi008.stdout:7/195: creat d1/d3/d20/f43 x:0 0 0 2023-10-18T20:58:22.449 INFO:tasks.workunit.client.1.smithi060.stdout:8/171: dwrite d4/f14 [0,4194304] 0 2023-10-18T20:58:22.450 INFO:tasks.workunit.client.1.smithi060.stdout:8/172: getdents d4 0 2023-10-18T20:58:22.450 INFO:tasks.workunit.client.1.smithi060.stdout:0/168: mknod d3/c37 0 2023-10-18T20:58:22.452 INFO:tasks.workunit.client.1.smithi060.stdout:6/120: fdatasync fd 0 2023-10-18T20:58:22.452 INFO:tasks.workunit.client.1.smithi060.stdout:6/121: creat d10/d1b/f2b x:0 0 0 2023-10-18T20:58:22.459 INFO:tasks.workunit.client.0.smithi008.stdout:7/196: write d1/d3/f14 [1357042,117832] 0 2023-10-18T20:58:22.462 INFO:tasks.workunit.client.1.smithi060.stdout:8/173: unlink d4/f15 0 2023-10-18T20:58:22.462 INFO:tasks.workunit.client.1.smithi060.stdout:8/174: getdents d4/d9/d31 0 2023-10-18T20:58:22.464 INFO:tasks.workunit.client.1.smithi060.stdout:2/174: dwrite d0/d8/f37 [0,4194304] 0 2023-10-18T20:58:22.465 INFO:tasks.workunit.client.1.smithi060.stdout:2/175: readlink d0/d3/l23 0 2023-10-18T20:58:22.465 INFO:tasks.workunit.client.0.smithi008.stdout:2/198: dwrite d1/d3/dd/f1e [4194304,4194304] 0 2023-10-18T20:58:22.470 INFO:tasks.workunit.client.1.smithi060.stdout:0/169: rename d3/f19 to d3/d32/f38 0 2023-10-18T20:58:22.471 INFO:tasks.workunit.client.1.smithi060.stdout:9/155: dwrite f0 [0,4194304] 0 2023-10-18T20:58:22.475 INFO:tasks.workunit.client.0.smithi008.stdout:6/220: dwrite df/d19/f32 [0,4194304] 0 2023-10-18T20:58:22.476 INFO:tasks.workunit.client.0.smithi008.stdout:6/221: write df/d15/f16 [3637621,16545] 0 2023-10-18T20:58:22.476 INFO:tasks.workunit.client.0.smithi008.stdout:1/324: dwrite d9/de/df/d17/d1e/f62 [0,4194304] 0 2023-10-18T20:58:22.476 INFO:tasks.workunit.client.0.smithi008.stdout:1/325: fdatasync d9/de/df/d17/d1e/f4a 0 2023-10-18T20:58:22.476 INFO:tasks.workunit.client.0.smithi008.stdout:1/326: fdatasync d9/f42 0 2023-10-18T20:58:22.476 INFO:tasks.workunit.client.0.smithi008.stdout:8/316: dwrite d5/f4b [4194304,4194304] 0 2023-10-18T20:58:22.477 INFO:tasks.workunit.client.0.smithi008.stdout:8/317: read - d5/d8/df/d6f/f6e zero size 2023-10-18T20:58:22.477 INFO:tasks.workunit.client.0.smithi008.stdout:9/185: dwrite d2/dc/f14 [0,4194304] 0 2023-10-18T20:58:22.477 INFO:tasks.workunit.client.0.smithi008.stdout:9/186: readlink d2/dc/d17/d19/l20 0 2023-10-18T20:58:22.477 INFO:tasks.workunit.client.0.smithi008.stdout:9/187: write d2/f5 [783946,85254] 0 2023-10-18T20:58:22.478 INFO:tasks.workunit.client.1.smithi060.stdout:4/120: dwrite d4/dc/d11/d13/f1b [0,4194304] 0 2023-10-18T20:58:22.482 INFO:tasks.workunit.client.0.smithi008.stdout:0/154: truncate d0/f2 2621780 0 2023-10-18T20:58:22.491 INFO:tasks.workunit.client.1.smithi060.stdout:4/121: write d4/dc/d11/d13/f1b [2684070,65525] 0 2023-10-18T20:58:22.492 INFO:tasks.workunit.client.1.smithi060.stdout:4/122: write d4/dc/f19 [371640,53698] 0 2023-10-18T20:58:22.492 INFO:tasks.workunit.client.0.smithi008.stdout:6/222: dread df/f35 [0,4194304] 0 2023-10-18T20:58:22.492 INFO:tasks.workunit.client.0.smithi008.stdout:7/197: symlink d1/d36/d3b/l44 0 2023-10-18T20:58:22.494 INFO:tasks.workunit.client.0.smithi008.stdout:9/188: write d2/f3 [6093584,33470] 0 2023-10-18T20:58:22.494 INFO:tasks.workunit.client.0.smithi008.stdout:3/149: getdents d0/d3/de/d13 0 2023-10-18T20:58:22.496 INFO:tasks.workunit.client.1.smithi060.stdout:3/155: dwrite d0/f2a [0,4194304] 0 2023-10-18T20:58:22.500 INFO:tasks.workunit.client.1.smithi060.stdout:6/122: truncate fa 3696489 0 2023-10-18T20:58:22.501 INFO:tasks.workunit.client.1.smithi060.stdout:0/170: fdatasync d3/d8/f27 0 2023-10-18T20:58:22.502 INFO:tasks.workunit.client.1.smithi060.stdout:1/222: dwrite d4/d6/f22 [0,4194304] 0 2023-10-18T20:58:22.504 INFO:tasks.workunit.client.1.smithi060.stdout:5/221: dwrite d0/d6/db/d2a/f5a [0,4194304] 0 2023-10-18T20:58:22.505 INFO:tasks.workunit.client.1.smithi060.stdout:5/222: write d0/d6/d8/df/f51 [487713,57866] 0 2023-10-18T20:58:22.509 INFO:tasks.workunit.client.0.smithi008.stdout:0/155: dread d0/dd/f18 [0,4194304] 0 2023-10-18T20:58:22.528 INFO:tasks.workunit.client.0.smithi008.stdout:2/199: mkdir d1/d3/dd/d48 0 2023-10-18T20:58:22.529 INFO:tasks.workunit.client.0.smithi008.stdout:2/200: fdatasync d1/d3/dd/f1e 0 2023-10-18T20:58:22.540 INFO:tasks.workunit.client.1.smithi060.stdout:2/176: mknod d0/d8/c3a 0 2023-10-18T20:58:22.540 INFO:tasks.workunit.client.1.smithi060.stdout:9/156: truncate d3/d10/d19/f1f 105328 0 2023-10-18T20:58:22.540 INFO:tasks.workunit.client.1.smithi060.stdout:9/157: chown d3/d10/f18 5058981 1 2023-10-18T20:58:22.541 INFO:tasks.workunit.client.1.smithi060.stdout:9/158: fsync d3/d10/d1c/f21 0 2023-10-18T20:58:22.541 INFO:tasks.workunit.client.1.smithi060.stdout:9/159: truncate d3/d10/f3c 1011786 0 2023-10-18T20:58:22.541 INFO:tasks.workunit.client.0.smithi008.stdout:1/327: stat d9/de/df/d17/d1e/l36 0 2023-10-18T20:58:22.542 INFO:tasks.workunit.client.0.smithi008.stdout:1/328: fdatasync d9/fc 0 2023-10-18T20:58:22.542 INFO:tasks.workunit.client.0.smithi008.stdout:8/318: mkdir d5/d8/d24/d77/d84 0 2023-10-18T20:58:22.542 INFO:tasks.workunit.client.0.smithi008.stdout:8/319: write d5/d8/d17/d6c/f46 [1559757,91579] 0 2023-10-18T20:58:22.545 INFO:tasks.workunit.client.0.smithi008.stdout:9/189: dread d2/f3 [4194304,4194304] 0 2023-10-18T20:58:22.553 INFO:tasks.workunit.client.1.smithi060.stdout:2/177: write d0/d8/f2c [1412461,75040] 0 2023-10-18T20:58:22.553 INFO:tasks.workunit.client.1.smithi060.stdout:2/178: read - d0/d8/f2b zero size 2023-10-18T20:58:22.553 INFO:tasks.workunit.client.1.smithi060.stdout:2/179: write d0/d3/f32 [151575,80096] 0 2023-10-18T20:58:22.553 INFO:tasks.workunit.client.1.smithi060.stdout:2/180: write d0/d8/fa [2469641,58537] 0 2023-10-18T20:58:22.554 INFO:tasks.workunit.client.0.smithi008.stdout:9/190: write d2/f5 [655003,116566] 0 2023-10-18T20:58:22.554 INFO:tasks.workunit.client.0.smithi008.stdout:9/191: stat d2/f3 0 2023-10-18T20:58:22.569 INFO:tasks.workunit.client.1.smithi060.stdout:4/123: dwrite d4/f10 [0,4194304] 0 2023-10-18T20:58:22.581 INFO:tasks.workunit.client.1.smithi060.stdout:4/124: read d4/dc/d11/d13/f20 [2812052,111512] 0 2023-10-18T20:58:22.589 INFO:tasks.workunit.client.1.smithi060.stdout:3/156: link d0/f19 d0/d22/f33 0 2023-10-18T20:58:22.590 INFO:tasks.workunit.client.1.smithi060.stdout:3/157: read d0/fa [12976,77519] 0 2023-10-18T20:58:22.593 INFO:tasks.workunit.client.0.smithi008.stdout:7/198: dwrite d1/f29 [0,4194304] 0 2023-10-18T20:58:22.594 INFO:tasks.workunit.client.0.smithi008.stdout:7/199: write d1/f1f [1287482,49191] 0 2023-10-18T20:58:22.594 INFO:tasks.workunit.client.1.smithi060.stdout:6/123: creat d10/d17/d28/f2c x:0 0 0 2023-10-18T20:58:22.595 INFO:tasks.workunit.client.0.smithi008.stdout:0/156: dwrite d0/dd/d19/f28 [0,4194304] 0 2023-10-18T20:58:22.602 INFO:tasks.workunit.client.1.smithi060.stdout:0/171: symlink d3/d32/l39 0 2023-10-18T20:58:22.604 INFO:tasks.workunit.client.1.smithi060.stdout:1/223: dwrite d4/da/fc [0,4194304] 0 2023-10-18T20:58:22.612 INFO:tasks.workunit.client.0.smithi008.stdout:6/223: rename fd to df/d15/d27/f4a 0 2023-10-18T20:58:22.615 INFO:tasks.workunit.client.0.smithi008.stdout:3/150: mkdir d0/d2c 0 2023-10-18T20:58:22.618 INFO:tasks.workunit.client.1.smithi060.stdout:0/172: dread d3/d8/d14/f2a [0,4194304] 0 2023-10-18T20:58:22.618 INFO:tasks.workunit.client.0.smithi008.stdout:2/201: unlink d1/d3/dd/d25/f2b 0 2023-10-18T20:58:22.622 INFO:tasks.workunit.client.0.smithi008.stdout:1/329: mknod d9/de/df/d17/d55/c67 0 2023-10-18T20:58:22.622 INFO:tasks.workunit.client.0.smithi008.stdout:8/320: mkdir d5/d8/d17/d85 0 2023-10-18T20:58:22.622 INFO:tasks.workunit.client.0.smithi008.stdout:1/330: write d9/f2f [1177183,71766] 0 2023-10-18T20:58:22.624 INFO:tasks.workunit.client.0.smithi008.stdout:9/192: symlink d2/dc/d1a/l33 0 2023-10-18T20:58:22.624 INFO:tasks.workunit.client.0.smithi008.stdout:9/193: fsync d2/f1b 0 2023-10-18T20:58:22.632 INFO:tasks.workunit.client.1.smithi060.stdout:5/223: creat d0/dd/f5b x:0 0 0 2023-10-18T20:58:22.635 INFO:tasks.workunit.client.0.smithi008.stdout:7/200: creat d1/f45 x:0 0 0 2023-10-18T20:58:22.635 INFO:tasks.workunit.client.1.smithi060.stdout:2/181: mknod d0/d3/d2a/c3b 0 2023-10-18T20:58:22.636 INFO:tasks.workunit.client.1.smithi060.stdout:2/182: chown d0/f22 1861764 1 2023-10-18T20:58:22.636 INFO:tasks.workunit.client.1.smithi060.stdout:2/183: truncate d0/f12 1993448 0 2023-10-18T20:58:22.637 INFO:tasks.workunit.client.1.smithi060.stdout:0/173: dread d3/fc [0,4194304] 0 2023-10-18T20:58:22.637 INFO:tasks.workunit.client.1.smithi060.stdout:0/174: fdatasync d3/d8/f28 0 2023-10-18T20:58:22.637 INFO:tasks.workunit.client.1.smithi060.stdout:0/175: dread - d3/f1a zero size 2023-10-18T20:58:22.637 INFO:tasks.workunit.client.1.smithi060.stdout:4/125: mkdir d4/dc/d11/d13/d27 0 2023-10-18T20:58:22.638 INFO:tasks.workunit.client.1.smithi060.stdout:4/126: chown d4/dc 94 1 2023-10-18T20:58:22.639 INFO:tasks.workunit.client.1.smithi060.stdout:3/158: truncate d0/f18 808665 0 2023-10-18T20:58:22.640 INFO:tasks.workunit.client.1.smithi060.stdout:6/124: mknod d10/d1b/c2d 0 2023-10-18T20:58:22.641 INFO:tasks.workunit.client.0.smithi008.stdout:0/157: creat d0/dd/d19/d24/f2b x:0 0 0 2023-10-18T20:58:22.642 INFO:tasks.workunit.client.1.smithi060.stdout:1/224: mkdir d4/d6/d48 0 2023-10-18T20:58:22.644 INFO:tasks.workunit.client.0.smithi008.stdout:6/224: mkdir df/d15/d48/d4b 0 2023-10-18T20:58:22.647 INFO:tasks.workunit.client.1.smithi060.stdout:0/176: rmdir d3/d8 39 2023-10-18T20:58:22.647 INFO:tasks.workunit.client.1.smithi060.stdout:0/177: readlink d3/d8/l29 0 2023-10-18T20:58:22.652 INFO:tasks.workunit.client.0.smithi008.stdout:2/202: unlink d1/d3/dd/l10 0 2023-10-18T20:58:22.652 INFO:tasks.workunit.client.0.smithi008.stdout:8/321: symlink d5/d8/d17/d6c/l86 0 2023-10-18T20:58:22.666 INFO:tasks.workunit.client.1.smithi060.stdout:4/127: mknod d4/c28 0 2023-10-18T20:58:22.667 INFO:tasks.workunit.client.0.smithi008.stdout:1/331: mknod d9/de/df/d17/c68 0 2023-10-18T20:58:22.667 INFO:tasks.workunit.client.0.smithi008.stdout:1/332: write d9/f54 [823935,93190] 0 2023-10-18T20:58:22.667 INFO:tasks.workunit.client.0.smithi008.stdout:1/333: fsync d9/de/f45 0 2023-10-18T20:58:22.667 INFO:tasks.workunit.client.0.smithi008.stdout:1/334: readlink d9/l59 0 2023-10-18T20:58:22.669 INFO:tasks.workunit.client.1.smithi060.stdout:5/224: write d0/d6/db/d2a/f5a [3478909,92158] 0 2023-10-18T20:58:22.669 INFO:tasks.workunit.client.1.smithi060.stdout:3/159: creat d0/d22/d26/d2b/f34 x:0 0 0 2023-10-18T20:58:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:21.533450+0000 mgr.smithi060.pgqqwa (mgr.14584) 42 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 609 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 40 MiB/s rd, 57 MiB/s wr, 745 op/s 2023-10-18T20:58:22.671 INFO:tasks.workunit.client.1.smithi060.stdout:6/125: mkdir d10/d2e 0 2023-10-18T20:58:22.671 INFO:tasks.workunit.client.1.smithi060.stdout:6/126: dread - d10/d1b/f2a zero size 2023-10-18T20:58:22.671 INFO:tasks.workunit.client.1.smithi060.stdout:8/175: truncate d4/f14 547068 0 2023-10-18T20:58:22.672 INFO:tasks.workunit.client.0.smithi008.stdout:7/201: mknod d1/d36/d3d/d3e/c46 0 2023-10-18T20:58:22.673 INFO:tasks.workunit.client.1.smithi060.stdout:6/127: read fb [342994,86061] 0 2023-10-18T20:58:22.675 INFO:tasks.workunit.client.1.smithi060.stdout:1/225: rename d4/d6/d7/df/c29 to d4/d6/d7/d35/c49 0 2023-10-18T20:58:22.677 INFO:tasks.workunit.client.0.smithi008.stdout:2/203: write d1/d3/dd/d25/d34/f3b [835639,60645] 0 2023-10-18T20:58:22.680 INFO:tasks.workunit.client.1.smithi060.stdout:6/128: dread fc [0,4194304] 0 2023-10-18T20:58:22.680 INFO:tasks.workunit.client.1.smithi060.stdout:6/129: write f7 [2246439,77740] 0 2023-10-18T20:58:22.680 INFO:tasks.workunit.client.1.smithi060.stdout:6/130: fsync d10/f1e 0 2023-10-18T20:58:22.681 INFO:tasks.workunit.client.1.smithi060.stdout:4/128: dread d4/dc/d11/f7 [0,4194304] 0 2023-10-18T20:58:22.681 INFO:tasks.workunit.client.1.smithi060.stdout:4/129: chown d4/dc/cd 22796960 1 2023-10-18T20:58:22.682 INFO:tasks.workunit.client.1.smithi060.stdout:2/184: getdents d0/d3/d2a 0 2023-10-18T20:58:22.682 INFO:tasks.workunit.client.0.smithi008.stdout:3/151: dwrite d0/d3/d15/f1a [0,4194304] 0 2023-10-18T20:58:22.682 INFO:tasks.workunit.client.0.smithi008.stdout:9/194: getdents d2/dc/d1a 0 2023-10-18T20:58:22.689 INFO:tasks.workunit.client.0.smithi008.stdout:6/225: mkdir df/d15/d27/d4c 0 2023-10-18T20:58:22.691 INFO:tasks.workunit.client.0.smithi008.stdout:1/335: unlink d9/de/df/d17/d55/f5e 0 2023-10-18T20:58:22.693 INFO:tasks.workunit.client.0.smithi008.stdout:5/137: sync 2023-10-18T20:58:22.693 INFO:tasks.workunit.client.0.smithi008.stdout:0/158: symlink d0/l2c 0 2023-10-18T20:58:22.693 INFO:tasks.workunit.client.0.smithi008.stdout:0/159: chown d0/f3 0 1 2023-10-18T20:58:22.700 INFO:tasks.workunit.client.0.smithi008.stdout:8/322: rmdir d5/d8/d24/d77 39 2023-10-18T20:58:22.700 INFO:tasks.workunit.client.0.smithi008.stdout:4/200: sync 2023-10-18T20:58:22.701 INFO:tasks.workunit.client.0.smithi008.stdout:2/204: mkdir d1/d3/dd/d1c/d3a/d49 0 2023-10-18T20:58:22.701 INFO:tasks.workunit.client.0.smithi008.stdout:2/205: chown d1/d3/ca 440274 1 2023-10-18T20:58:22.701 INFO:tasks.workunit.client.0.smithi008.stdout:3/152: creat d0/d3/de/d13/f2d x:0 0 0 2023-10-18T20:58:22.702 INFO:tasks.workunit.client.0.smithi008.stdout:3/153: creat d0/d3/f2e x:0 0 0 2023-10-18T20:58:22.723 INFO:tasks.workunit.client.0.smithi008.stdout:1/336: mkdir d9/de/df/d17/d69 0 2023-10-18T20:58:22.729 INFO:tasks.workunit.client.0.smithi008.stdout:6/226: read df/d18/f21 [1910409,74005] 0 2023-10-18T20:58:22.730 INFO:tasks.workunit.client.0.smithi008.stdout:6/227: read df/d18/f21 [3774689,32730] 0 2023-10-18T20:58:22.730 INFO:tasks.workunit.client.0.smithi008.stdout:6/228: creat df/d19/f4d x:0 0 0 2023-10-18T20:58:22.733 INFO:tasks.workunit.client.0.smithi008.stdout:5/138: creat d0/d2/d9/f2d x:0 0 0 2023-10-18T20:58:22.739 INFO:tasks.workunit.client.1.smithi060.stdout:5/225: symlink d0/d6/d8/l5c 0 2023-10-18T20:58:22.740 INFO:tasks.workunit.client.1.smithi060.stdout:4/130: dwrite d4/dc/d11/d13/f20 [0,4194304] 0 2023-10-18T20:58:22.740 INFO:tasks.workunit.client.1.smithi060.stdout:3/160: stat d0/d22/d26/c27 0 2023-10-18T20:58:22.741 INFO:tasks.workunit.client.1.smithi060.stdout:3/161: write d0/f18 [1777912,128934] 0 2023-10-18T20:58:22.741 INFO:tasks.workunit.client.1.smithi060.stdout:3/162: write d0/f21 [1541509,85391] 0 2023-10-18T20:58:22.742 INFO:tasks.workunit.client.1.smithi060.stdout:3/163: dread - d0/f1c zero size 2023-10-18T20:58:22.742 INFO:tasks.workunit.client.0.smithi008.stdout:4/201: truncate d0/f13 2251490 0 2023-10-18T20:58:22.743 INFO:tasks.workunit.client.1.smithi060.stdout:2/185: dwrite d0/d3/f17 [0,4194304] 0 2023-10-18T20:58:22.743 INFO:tasks.workunit.client.1.smithi060.stdout:2/186: chown d0/d16 735499 1 2023-10-18T20:58:22.743 INFO:tasks.workunit.client.1.smithi060.stdout:2/187: chown d0/d8/f2c 73472 1 2023-10-18T20:58:22.743 INFO:tasks.workunit.client.1.smithi060.stdout:2/188: write d0/d16/f19 [895292,74112] 0 2023-10-18T20:58:22.745 INFO:tasks.workunit.client.0.smithi008.stdout:3/154: write d0/f7 [1845567,26338] 0 2023-10-18T20:58:22.746 INFO:tasks.workunit.client.0.smithi008.stdout:3/155: stat d0/d3/fd 0 2023-10-18T20:58:22.748 INFO:tasks.workunit.client.0.smithi008.stdout:2/206: rename d1/d3/dd/d25/l2c to d1/d3/dd/d1c/d39/l4a 0 2023-10-18T20:58:22.750 INFO:tasks.workunit.client.1.smithi060.stdout:7/178: sync 2023-10-18T20:58:22.753 INFO:tasks.workunit.client.1.smithi060.stdout:8/176: creat d4/d9/f32 x:0 0 0 2023-10-18T20:58:22.753 INFO:tasks.workunit.client.1.smithi060.stdout:8/177: write d4/d9/f2e [130180,115385] 0 2023-10-18T20:58:22.756 INFO:tasks.workunit.client.1.smithi060.stdout:0/178: write d3/f13 [926487,12284] 0 2023-10-18T20:58:22.756 INFO:tasks.workunit.client.1.smithi060.stdout:0/179: stat d3/f21 0 2023-10-18T20:58:22.756 INFO:tasks.workunit.client.1.smithi060.stdout:0/180: fsync d3/d8/f2d 0 2023-10-18T20:58:22.756 INFO:tasks.workunit.client.1.smithi060.stdout:0/181: chown d3/d8/fa 3489 1 2023-10-18T20:58:22.759 INFO:tasks.workunit.client.0.smithi008.stdout:7/202: dwrite d1/d36/d3d/d3e/f3c [0,4194304] 0 2023-10-18T20:58:22.764 INFO:tasks.workunit.client.1.smithi060.stdout:1/226: creat d4/da/d42/f4a x:0 0 0 2023-10-18T20:58:22.765 INFO:tasks.workunit.client.1.smithi060.stdout:7/179: dread de/f1a [0,4194304] 0 2023-10-18T20:58:22.772 INFO:tasks.workunit.client.1.smithi060.stdout:6/131: mkdir d10/d17/d2f 0 2023-10-18T20:58:22.772 INFO:tasks.workunit.client.1.smithi060.stdout:4/131: truncate d4/dc/d11/d13/f1b 4051616 0 2023-10-18T20:58:22.772 INFO:tasks.workunit.client.1.smithi060.stdout:3/164: symlink d0/d22/d26/d29/l35 0 2023-10-18T20:58:22.777 INFO:tasks.workunit.client.0.smithi008.stdout:0/160: getdents d0/dd 0 2023-10-18T20:58:22.782 INFO:tasks.workunit.client.1.smithi060.stdout:3/165: dread d0/fd [0,4194304] 0 2023-10-18T20:58:22.785 INFO:tasks.workunit.client.0.smithi008.stdout:4/202: mkdir d0/d3/d48 0 2023-10-18T20:58:22.797 INFO:tasks.workunit.client.0.smithi008.stdout:2/207: rmdir d1/d3/d40 39 2023-10-18T20:58:22.798 INFO:tasks.workunit.client.0.smithi008.stdout:2/208: chown d1/f19 32584 1 2023-10-18T20:58:22.804 INFO:tasks.workunit.client.0.smithi008.stdout:1/337: rename d9/f53 to d9/de/df/d17/f6a 0 2023-10-18T20:58:22.808 INFO:tasks.workunit.client.1.smithi060.stdout:2/189: getdents d0 0 2023-10-18T20:58:22.809 INFO:tasks.workunit.client.0.smithi008.stdout:4/203: getdents d0/d3/d21/d42 0 2023-10-18T20:58:22.809 INFO:tasks.workunit.client.0.smithi008.stdout:4/204: chown d0/l1b 20501 1 2023-10-18T20:58:22.809 INFO:tasks.workunit.client.0.smithi008.stdout:4/205: chown d0/d3/d21/f24 1756575 1 2023-10-18T20:58:22.812 INFO:tasks.workunit.client.1.smithi060.stdout:4/132: dread d4/dc/d11/f7 [0,4194304] 0 2023-10-18T20:58:22.816 INFO:tasks.workunit.client.1.smithi060.stdout:0/182: creat d3/d32/f3a x:0 0 0 2023-10-18T20:58:22.817 INFO:tasks.workunit.client.0.smithi008.stdout:6/229: rename l4 to df/l4e 0 2023-10-18T20:58:22.817 INFO:tasks.workunit.client.0.smithi008.stdout:7/203: dwrite d1/d3/d20/f2f [0,4194304] 0 2023-10-18T20:58:22.818 INFO:tasks.workunit.client.0.smithi008.stdout:7/204: write d1/d3/f17 [3014681,23024] 0 2023-10-18T20:58:22.818 INFO:tasks.workunit.client.0.smithi008.stdout:7/205: creat d1/d3/d20/f47 x:0 0 0 2023-10-18T20:58:22.819 INFO:tasks.workunit.client.1.smithi060.stdout:1/227: link d4/d6/d7/d2f/f39 d4/d6/d48/f4b 0 2023-10-18T20:58:22.821 INFO:tasks.workunit.client.1.smithi060.stdout:7/180: dwrite de/d14/d3a/f3b [0,4194304] 0 2023-10-18T20:58:22.821 INFO:tasks.workunit.client.1.smithi060.stdout:7/181: dread - de/d14/d1d/f34 zero size 2023-10-18T20:58:22.824 INFO:tasks.workunit.client.0.smithi008.stdout:1/338: symlink d9/de/df/d17/l6b 0 2023-10-18T20:58:22.825 INFO:tasks.workunit.client.1.smithi060.stdout:9/160: sync 2023-10-18T20:58:22.827 INFO:tasks.workunit.client.1.smithi060.stdout:5/226: dwrite d0/d6/d9/f14 [0,4194304] 0 2023-10-18T20:58:22.827 INFO:tasks.workunit.client.1.smithi060.stdout:5/227: creat d0/d6/db/f5d x:0 0 0 2023-10-18T20:58:22.827 INFO:tasks.workunit.client.1.smithi060.stdout:5/228: truncate d0/d6/db/f5d 606202 0 2023-10-18T20:58:22.830 INFO:tasks.workunit.client.0.smithi008.stdout:4/206: mknod d0/d3/d48/c49 0 2023-10-18T20:58:22.830 INFO:tasks.workunit.client.1.smithi060.stdout:3/166: creat d0/d22/f36 x:0 0 0 2023-10-18T20:58:22.831 INFO:tasks.workunit.client.1.smithi060.stdout:8/178: dwrite f3 [0,4194304] 0 2023-10-18T20:58:22.832 INFO:tasks.workunit.client.0.smithi008.stdout:5/139: dwrite d0/d2/d9/f24 [0,4194304] 0 2023-10-18T20:58:22.833 INFO:tasks.workunit.client.0.smithi008.stdout:5/140: write d0/f28 [911262,34897] 0 2023-10-18T20:58:22.833 INFO:tasks.workunit.client.1.smithi060.stdout:4/133: rmdir d4/dc/d11/d13 39 2023-10-18T20:58:22.835 INFO:tasks.workunit.client.1.smithi060.stdout:3/167: write d0/fd [265183,52742] 0 2023-10-18T20:58:22.838 INFO:tasks.workunit.client.1.smithi060.stdout:0/183: rename d3/d8/f27 to d3/f3b 0 2023-10-18T20:58:22.839 INFO:tasks.workunit.client.1.smithi060.stdout:0/184: write d3/f13 [367116,25142] 0 2023-10-18T20:58:22.840 INFO:tasks.workunit.client.1.smithi060.stdout:1/228: mknod d4/d38/c4c 0 2023-10-18T20:58:22.841 INFO:tasks.workunit.client.0.smithi008.stdout:3/156: rename d0/d3/l1d to d0/d2c/l2f 0 2023-10-18T20:58:22.842 INFO:tasks.workunit.client.0.smithi008.stdout:3/157: chown d0/d3/de/d13/l18 196 1 2023-10-18T20:58:22.842 INFO:tasks.workunit.client.0.smithi008.stdout:3/158: chown d0/d3/de/d13 151402328 1 2023-10-18T20:58:22.842 INFO:tasks.workunit.client.0.smithi008.stdout:3/159: stat d0/d3/de/d13 0 2023-10-18T20:58:22.844 INFO:tasks.workunit.client.1.smithi060.stdout:9/161: rmdir d3/d10/d1c 39 2023-10-18T20:58:22.844 INFO:tasks.workunit.client.0.smithi008.stdout:7/206: getdents d1/d36/d3d/d3e 0 2023-10-18T20:58:22.848 INFO:tasks.workunit.client.1.smithi060.stdout:2/190: getdents d0/d8 0 2023-10-18T20:58:22.849 INFO:tasks.workunit.client.1.smithi060.stdout:8/179: link d4/c29 d4/d9/d31/c33 0 2023-10-18T20:58:22.849 INFO:tasks.workunit.client.0.smithi008.stdout:5/141: mknod d0/d2/d9/c2e 0 2023-10-18T20:58:22.849 INFO:tasks.workunit.client.0.smithi008.stdout:5/142: chown d0/d2/d19/d1b 6936619 1 2023-10-18T20:58:22.850 INFO:tasks.workunit.client.0.smithi008.stdout:6/230: rmdir df/d19 39 2023-10-18T20:58:22.850 INFO:tasks.workunit.client.0.smithi008.stdout:6/231: write df/d19/f20 [979250,23487] 0 2023-10-18T20:58:22.853 INFO:tasks.workunit.client.1.smithi060.stdout:2/191: dread d0/d8/fc [0,4194304] 0 2023-10-18T20:58:22.865 INFO:tasks.workunit.client.1.smithi060.stdout:8/180: dread f3 [0,4194304] 0 2023-10-18T20:58:22.867 INFO:tasks.workunit.client.0.smithi008.stdout:4/207: dread d0/d3/d8/f26 [0,4194304] 0 2023-10-18T20:58:22.867 INFO:tasks.workunit.client.0.smithi008.stdout:4/208: chown d0/d17/c1f 1 1 2023-10-18T20:58:22.875 INFO:tasks.workunit.client.1.smithi060.stdout:7/182: dwrite de/d14/d2f/f3e [0,4194304] 0 2023-10-18T20:58:22.876 INFO:tasks.workunit.client.1.smithi060.stdout:8/181: dread d4/f19 [0,4194304] 0 2023-10-18T20:58:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:21.533450+0000 mgr.smithi060.pgqqwa (mgr.14584) 42 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 609 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 40 MiB/s rd, 57 MiB/s wr, 745 op/s 2023-10-18T20:58:23.099 INFO:tasks.workunit.client.0.smithi008.stdout:3/160: unlink d0/d3/d15/c1b 0 2023-10-18T20:58:23.099 INFO:tasks.workunit.client.0.smithi008.stdout:3/161: readlink d0/d2c/l2f 0 2023-10-18T20:58:23.101 INFO:tasks.workunit.client.1.smithi060.stdout:4/134: rename d4/dc/f23 to d4/dc/f29 0 2023-10-18T20:58:23.101 INFO:tasks.workunit.client.1.smithi060.stdout:3/168: mkdir d0/d37 0 2023-10-18T20:58:23.101 INFO:tasks.workunit.client.1.smithi060.stdout:3/169: truncate d0/f1c 622875 0 2023-10-18T20:58:23.107 INFO:tasks.workunit.client.0.smithi008.stdout:0/161: rename d0/dd/d19/f28 to d0/dd/df/d2a/f2d 0 2023-10-18T20:58:23.109 INFO:tasks.workunit.client.0.smithi008.stdout:7/207: symlink d1/d36/d3b/l48 0 2023-10-18T20:58:23.109 INFO:tasks.workunit.client.0.smithi008.stdout:7/208: stat d1/d36/d3d/d3e 0 2023-10-18T20:58:23.109 INFO:tasks.workunit.client.0.smithi008.stdout:7/209: chown d1/l33 1660852 1 2023-10-18T20:58:23.111 INFO:tasks.workunit.client.0.smithi008.stdout:5/143: dwrite d0/d2/d19/d1b/d20/f2b [0,4194304] 0 2023-10-18T20:58:23.112 INFO:tasks.workunit.client.1.smithi060.stdout:1/229: symlink d4/d6/d14/d41/l4d 0 2023-10-18T20:58:23.112 INFO:tasks.workunit.client.1.smithi060.stdout:1/230: fdatasync d4/da/de/d2a/d32/dd/f25 0 2023-10-18T20:58:23.113 INFO:tasks.workunit.client.1.smithi060.stdout:9/162: symlink d3/d10/l3f 0 2023-10-18T20:58:23.113 INFO:tasks.workunit.client.1.smithi060.stdout:9/163: write d3/d10/f24 [2239644,14327] 0 2023-10-18T20:58:23.114 INFO:tasks.workunit.client.1.smithi060.stdout:8/182: dwrite d4/ff [0,4194304] 0 2023-10-18T20:58:23.116 INFO:tasks.workunit.client.1.smithi060.stdout:6/132: dwrite fd [0,4194304] 0 2023-10-18T20:58:23.117 INFO:tasks.workunit.client.0.smithi008.stdout:1/339: dwrite d9/de/f58 [0,4194304] 0 2023-10-18T20:58:23.117 INFO:tasks.workunit.client.0.smithi008.stdout:1/340: readlink d9/l59 0 2023-10-18T20:58:23.117 INFO:tasks.workunit.client.1.smithi060.stdout:6/133: write d10/d1b/f2a [998224,74203] 0 2023-10-18T20:58:23.118 INFO:tasks.workunit.client.1.smithi060.stdout:6/134: write d10/f19 [141514,112314] 0 2023-10-18T20:58:23.118 INFO:tasks.workunit.client.0.smithi008.stdout:6/232: truncate df/d18/f21 2729510 0 2023-10-18T20:58:23.120 INFO:tasks.workunit.client.1.smithi060.stdout:7/183: mkdir de/d14/d2f/d3f 0 2023-10-18T20:58:23.120 INFO:tasks.workunit.client.1.smithi060.stdout:7/184: write de/d29/f33 [656797,40998] 0 2023-10-18T20:58:23.120 INFO:tasks.workunit.client.1.smithi060.stdout:7/185: chown de/d14/d2f/f3e 48739 1 2023-10-18T20:58:23.121 INFO:tasks.workunit.client.1.smithi060.stdout:7/186: creat de/d14/d1d/f40 x:0 0 0 2023-10-18T20:58:23.121 INFO:tasks.workunit.client.0.smithi008.stdout:3/162: rename d0/d3/de/d13/f2d to d0/d2c/f30 0 2023-10-18T20:58:23.124 INFO:tasks.workunit.client.1.smithi060.stdout:2/192: write d0/f22 [2516956,35805] 0 2023-10-18T20:58:23.129 INFO:tasks.workunit.client.0.smithi008.stdout:4/209: dwrite d0/f12 [8388608,4194304] 0 2023-10-18T20:58:23.134 INFO:tasks.workunit.client.1.smithi060.stdout:5/229: dwrite d0/f4 [0,4194304] 0 2023-10-18T20:58:23.138 INFO:tasks.workunit.client.1.smithi060.stdout:0/185: mkdir d3/d8/d3c 0 2023-10-18T20:58:23.139 INFO:tasks.workunit.client.1.smithi060.stdout:0/186: chown d3/d8/d14 67 1 2023-10-18T20:58:23.140 INFO:tasks.workunit.client.0.smithi008.stdout:7/210: mkdir d1/d36/d3d/d49 0 2023-10-18T20:58:23.140 INFO:tasks.workunit.client.0.smithi008.stdout:7/211: write d1/f39 [1273225,5576] 0 2023-10-18T20:58:23.141 INFO:tasks.workunit.client.1.smithi060.stdout:1/231: creat d4/d6/f4e x:0 0 0 2023-10-18T20:58:23.142 INFO:tasks.workunit.client.1.smithi060.stdout:1/232: creat d4/da/de/d2a/d32/dd/f4f x:0 0 0 2023-10-18T20:58:23.145 INFO:tasks.workunit.client.0.smithi008.stdout:5/144: creat d0/d2/d19/f2f x:0 0 0 2023-10-18T20:58:23.146 INFO:tasks.workunit.client.0.smithi008.stdout:5/145: truncate d0/f29 1318439 0 2023-10-18T20:58:23.148 INFO:tasks.workunit.client.1.smithi060.stdout:8/183: mknod d4/d9/d31/c34 0 2023-10-18T20:58:23.149 INFO:tasks.workunit.client.1.smithi060.stdout:8/184: unlink d4/fe 0 2023-10-18T20:58:23.151 INFO:tasks.workunit.client.0.smithi008.stdout:6/233: rename df/d36/f47 to df/d15/d48/d4b/f4f 0 2023-10-18T20:58:23.151 INFO:tasks.workunit.client.0.smithi008.stdout:6/234: write df/d19/f4d [951842,120431] 0 2023-10-18T20:58:23.152 INFO:tasks.workunit.client.1.smithi060.stdout:6/135: rename d10/d17/d28/f2c to d10/d17/d2f/f30 0 2023-10-18T20:58:23.153 INFO:tasks.workunit.client.0.smithi008.stdout:3/163: link d0/d3/f2b d0/d3/f31 0 2023-10-18T20:58:23.154 INFO:tasks.workunit.client.0.smithi008.stdout:3/164: stat d0/d3/de/d13/f24 0 2023-10-18T20:58:23.154 INFO:tasks.workunit.client.0.smithi008.stdout:3/165: chown d0/d3/de/f10 5 1 2023-10-18T20:58:23.155 INFO:tasks.workunit.client.1.smithi060.stdout:5/230: write d0/f1d [4125050,114728] 0 2023-10-18T20:58:23.160 INFO:tasks.workunit.client.1.smithi060.stdout:1/233: dread d4/d6/f3e [0,4194304] 0 2023-10-18T20:58:23.161 INFO:tasks.workunit.client.1.smithi060.stdout:9/164: dwrite d3/f6 [0,4194304] 0 2023-10-18T20:58:23.162 INFO:tasks.workunit.client.0.smithi008.stdout:4/210: symlink d0/l4a 0 2023-10-18T20:58:23.165 INFO:tasks.workunit.client.1.smithi060.stdout:6/136: dread f8 [0,4194304] 0 2023-10-18T20:58:23.165 INFO:tasks.workunit.client.0.smithi008.stdout:0/162: rmdir d0/dd/df 39 2023-10-18T20:58:23.167 INFO:tasks.workunit.client.0.smithi008.stdout:7/212: creat d1/d36/d3d/d49/f4a x:0 0 0 2023-10-18T20:58:23.168 INFO:tasks.workunit.client.0.smithi008.stdout:7/213: write d1/d36/d3d/f41 [3139505,3211] 0 2023-10-18T20:58:23.168 INFO:tasks.workunit.client.0.smithi008.stdout:7/214: write d1/d3/d20/f47 [108868,115534] 0 2023-10-18T20:58:23.169 INFO:tasks.workunit.client.1.smithi060.stdout:7/187: mkdir de/d14/d41 0 2023-10-18T20:58:23.169 INFO:tasks.workunit.client.1.smithi060.stdout:4/135: rename d4/dc/d11 to d4/dc/d2a 0 2023-10-18T20:58:23.170 INFO:tasks.workunit.client.1.smithi060.stdout:4/136: truncate d4/dc/d2a/f7 4732404 0 2023-10-18T20:58:23.173 INFO:tasks.workunit.client.0.smithi008.stdout:0/163: mknod d0/dd/df/c2e 0 2023-10-18T20:58:23.173 INFO:tasks.workunit.client.0.smithi008.stdout:0/164: write d0/dd/f27 [196370,118420] 0 2023-10-18T20:58:23.174 INFO:tasks.workunit.client.1.smithi060.stdout:0/187: rmdir d3 39 2023-10-18T20:58:23.178 INFO:tasks.workunit.client.1.smithi060.stdout:6/137: read f8 [1242002,110512] 0 2023-10-18T20:58:23.178 INFO:tasks.workunit.client.1.smithi060.stdout:6/138: fsync fb 0 2023-10-18T20:58:23.180 INFO:tasks.workunit.client.1.smithi060.stdout:0/188: write d3/d8/f31 [483271,41357] 0 2023-10-18T20:58:23.180 INFO:tasks.workunit.client.1.smithi060.stdout:0/189: write d3/f6 [4306358,63383] 0 2023-10-18T20:58:23.184 INFO:tasks.workunit.client.0.smithi008.stdout:4/211: dread d0/f13 [0,4194304] 0 2023-10-18T20:58:23.184 INFO:tasks.workunit.client.0.smithi008.stdout:7/215: truncate d1/d3/f2a 163731 0 2023-10-18T20:58:23.189 INFO:tasks.workunit.client.0.smithi008.stdout:1/341: dwrite d9/de/df/d17/f5f [0,4194304] 0 2023-10-18T20:58:23.190 INFO:tasks.workunit.client.1.smithi060.stdout:6/139: dread f8 [0,4194304] 0 2023-10-18T20:58:23.191 INFO:tasks.workunit.client.1.smithi060.stdout:4/137: dread d4/dc/f19 [0,4194304] 0 2023-10-18T20:58:23.191 INFO:tasks.workunit.client.1.smithi060.stdout:4/138: readlink d4/dc/l14 0 2023-10-18T20:58:23.193 INFO:tasks.workunit.client.0.smithi008.stdout:3/166: dwrite d0/d3/f31 [0,4194304] 0 2023-10-18T20:58:23.193 INFO:tasks.workunit.client.0.smithi008.stdout:3/167: truncate d0/d3/de/d13/f2a 996357 0 2023-10-18T20:58:23.193 INFO:tasks.workunit.client.0.smithi008.stdout:3/168: write d0/f7 [39145,40344] 0 2023-10-18T20:58:23.193 INFO:tasks.workunit.client.0.smithi008.stdout:3/169: truncate d0/d3/f29 310458 0 2023-10-18T20:58:23.194 INFO:tasks.workunit.client.0.smithi008.stdout:3/170: readlink d0/d2c/l2f 0 2023-10-18T20:58:23.194 INFO:tasks.workunit.client.0.smithi008.stdout:3/171: chown d0/d3/de/d13/f28 9154180 1 2023-10-18T20:58:23.194 INFO:tasks.workunit.client.0.smithi008.stdout:6/235: getdents df/d15 0 2023-10-18T20:58:23.195 INFO:tasks.workunit.client.0.smithi008.stdout:0/165: mknod d0/dd/c2f 0 2023-10-18T20:58:23.198 INFO:tasks.workunit.client.0.smithi008.stdout:7/216: dread d1/d3/f27 [0,4194304] 0 2023-10-18T20:58:23.198 INFO:tasks.workunit.client.0.smithi008.stdout:5/146: dwrite d0/d2/d19/f2c [0,4194304] 0 2023-10-18T20:58:23.198 INFO:tasks.workunit.client.0.smithi008.stdout:5/147: read d0/d2/f7 [7996785,101692] 0 2023-10-18T20:58:23.198 INFO:tasks.workunit.client.0.smithi008.stdout:5/148: dread - d0/f25 zero size 2023-10-18T20:58:23.199 INFO:tasks.workunit.client.1.smithi060.stdout:9/165: dwrite d3/f6 [0,4194304] 0 2023-10-18T20:58:23.199 INFO:tasks.workunit.client.0.smithi008.stdout:4/212: link d0/d3/d21/d42/c46 d0/d3/c4b 0 2023-10-18T20:58:23.203 INFO:tasks.workunit.client.1.smithi060.stdout:4/139: dread d4/dc/d2a/f7 [0,4194304] 0 2023-10-18T20:58:23.204 INFO:tasks.workunit.client.0.smithi008.stdout:1/342: rmdir d9/de/df/d17/d52 0 2023-10-18T20:58:23.205 INFO:tasks.workunit.client.1.smithi060.stdout:6/140: dread d10/d1b/f2a [0,4194304] 0 2023-10-18T20:58:23.211 INFO:tasks.workunit.client.0.smithi008.stdout:3/172: symlink d0/d3/de/l32 0 2023-10-18T20:58:23.215 INFO:tasks.workunit.client.0.smithi008.stdout:0/166: unlink d0/dd/df/c2e 0 2023-10-18T20:58:23.215 INFO:tasks.workunit.client.0.smithi008.stdout:0/167: getdents d0/dd/df/d20/d21 0 2023-10-18T20:58:23.219 INFO:tasks.workunit.client.0.smithi008.stdout:7/217: dread d1/f29 [0,4194304] 0 2023-10-18T20:58:23.225 INFO:tasks.workunit.client.0.smithi008.stdout:6/236: dread df/d26/f31 [0,4194304] 0 2023-10-18T20:58:23.226 INFO:tasks.workunit.client.1.smithi060.stdout:9/166: write f0 [2903382,96050] 0 2023-10-18T20:58:23.229 INFO:tasks.workunit.client.1.smithi060.stdout:8/185: mkdir d4/d9/d31/d35 0 2023-10-18T20:58:23.230 INFO:tasks.workunit.client.1.smithi060.stdout:8/186: fdatasync f3 0 2023-10-18T20:58:23.233 INFO:tasks.workunit.client.1.smithi060.stdout:2/193: rename d0/d8/f37 to d0/d3/d2a/f3c 0 2023-10-18T20:58:23.234 INFO:tasks.workunit.client.1.smithi060.stdout:2/194: dread - d0/d8/f2b zero size 2023-10-18T20:58:23.234 INFO:tasks.workunit.client.1.smithi060.stdout:5/231: mknod d0/d6/db/d41/c5e 0 2023-10-18T20:58:23.235 INFO:tasks.workunit.client.1.smithi060.stdout:1/234: rename d4/da/f1c to d4/da/f50 0 2023-10-18T20:58:23.236 INFO:tasks.workunit.client.1.smithi060.stdout:7/188: truncate de/d14/f2d 1719264 0 2023-10-18T20:58:23.238 INFO:tasks.workunit.client.1.smithi060.stdout:0/190: creat d3/d8/d14/f3d x:0 0 0 2023-10-18T20:58:23.238 INFO:tasks.workunit.client.1.smithi060.stdout:0/191: creat d3/d8/d14/f3e x:0 0 0 2023-10-18T20:58:23.241 INFO:tasks.workunit.client.1.smithi060.stdout:4/140: mkdir d4/d15/d2b 0 2023-10-18T20:58:23.249 INFO:tasks.workunit.client.1.smithi060.stdout:6/141: mknod d10/d2e/c31 0 2023-10-18T20:58:23.249 INFO:tasks.workunit.client.1.smithi060.stdout:6/142: readlink d10/l12 0 2023-10-18T20:58:23.250 INFO:tasks.workunit.client.1.smithi060.stdout:6/143: chown d10/d17/d28 5757 1 2023-10-18T20:58:23.254 INFO:tasks.workunit.client.1.smithi060.stdout:7/189: write fa [3706848,45028] 0 2023-10-18T20:58:23.256 INFO:tasks.workunit.client.0.smithi008.stdout:5/149: rename d0/d2/c5 to d0/d2/c30 0 2023-10-18T20:58:23.256 INFO:tasks.workunit.client.0.smithi008.stdout:5/150: write d0/f28 [999132,89583] 0 2023-10-18T20:58:23.257 INFO:tasks.workunit.client.1.smithi060.stdout:7/190: read de/d29/f2b [85999,16624] 0 2023-10-18T20:58:23.258 INFO:tasks.workunit.client.0.smithi008.stdout:4/213: mkdir d0/d3/d48/d4c 0 2023-10-18T20:58:23.258 INFO:tasks.workunit.client.0.smithi008.stdout:4/214: fsync d0/d3/d21/f3b 0 2023-10-18T20:58:23.258 INFO:tasks.workunit.client.0.smithi008.stdout:4/215: readlink d0/l1b 0 2023-10-18T20:58:23.258 INFO:tasks.workunit.client.0.smithi008.stdout:4/216: dread - d0/d3/d8/f15 zero size 2023-10-18T20:58:23.263 INFO:tasks.workunit.client.0.smithi008.stdout:2/209: sync 2023-10-18T20:58:23.263 INFO:tasks.workunit.client.0.smithi008.stdout:8/323: sync 2023-10-18T20:58:23.264 INFO:tasks.workunit.client.0.smithi008.stdout:8/324: write d5/d8/f41 [830843,30508] 0 2023-10-18T20:58:23.264 INFO:tasks.workunit.client.0.smithi008.stdout:9/195: sync 2023-10-18T20:58:23.264 INFO:tasks.workunit.client.0.smithi008.stdout:9/196: write d2/f26 [710285,36067] 0 2023-10-18T20:58:23.264 INFO:tasks.workunit.client.0.smithi008.stdout:9/197: chown d2/d8/f9 432 1 2023-10-18T20:58:23.264 INFO:tasks.workunit.client.0.smithi008.stdout:9/198: write d2/dc/d17/f2e [971990,10074] 0 2023-10-18T20:58:23.265 INFO:tasks.workunit.client.0.smithi008.stdout:9/199: fdatasync d2/dc/f1c 0 2023-10-18T20:58:23.265 INFO:tasks.workunit.client.0.smithi008.stdout:0/168: creat d0/dd/d29/f30 x:0 0 0 2023-10-18T20:58:23.267 INFO:tasks.workunit.client.1.smithi060.stdout:8/187: mknod d4/d9/c36 0 2023-10-18T20:58:23.268 INFO:tasks.workunit.client.1.smithi060.stdout:5/232: unlink d0/d6/d8/df/d27/f37 0 2023-10-18T20:58:23.269 INFO:tasks.workunit.client.1.smithi060.stdout:5/233: write d0/d6/d8/df/f51 [1222438,39342] 0 2023-10-18T20:58:23.269 INFO:tasks.workunit.client.1.smithi060.stdout:5/234: chown d0/d6/d8/df/c10 949499274 1 2023-10-18T20:58:23.269 INFO:tasks.workunit.client.1.smithi060.stdout:5/235: chown d0/d6/db/c38 351 1 2023-10-18T20:58:23.269 INFO:tasks.workunit.client.1.smithi060.stdout:5/236: creat d0/f5f x:0 0 0 2023-10-18T20:58:23.270 INFO:tasks.workunit.client.1.smithi060.stdout:5/237: unlink d0/f4 0 2023-10-18T20:58:23.270 INFO:tasks.workunit.client.0.smithi008.stdout:7/218: rename d1/f39 to d1/f4b 0 2023-10-18T20:58:23.271 INFO:tasks.workunit.client.1.smithi060.stdout:4/141: read d4/dc/f19 [299256,10943] 0 2023-10-18T20:58:23.271 INFO:tasks.workunit.client.1.smithi060.stdout:1/235: mkdir d4/da/de/d2a/d32/d51 0 2023-10-18T20:58:23.271 INFO:tasks.workunit.client.1.smithi060.stdout:1/236: creat d4/da/de/f52 x:0 0 0 2023-10-18T20:58:23.272 INFO:tasks.workunit.client.0.smithi008.stdout:6/237: stat df/d19/c2f 0 2023-10-18T20:58:23.272 INFO:tasks.workunit.client.1.smithi060.stdout:1/237: write d4/da/de/d2a/d32/dd/f4f [781392,24658] 0 2023-10-18T20:58:23.273 INFO:tasks.workunit.client.1.smithi060.stdout:1/238: creat d4/da/f53 x:0 0 0 2023-10-18T20:58:23.274 INFO:tasks.workunit.client.1.smithi060.stdout:3/170: sync 2023-10-18T20:58:23.274 INFO:tasks.workunit.client.1.smithi060.stdout:3/171: fdatasync d0/fa 0 2023-10-18T20:58:23.274 INFO:tasks.workunit.client.1.smithi060.stdout:3/172: chown d0/d22/f33 30 1 2023-10-18T20:58:23.275 INFO:tasks.workunit.client.0.smithi008.stdout:5/151: write d0/d2/d9/f24 [1575605,128089] 0 2023-10-18T20:58:23.280 INFO:tasks.workunit.client.1.smithi060.stdout:6/144: link c9 d10/d17/d2f/c32 0 2023-10-18T20:58:23.280 INFO:tasks.workunit.client.0.smithi008.stdout:4/217: link d0/d3/d21/l44 d0/l4d 0 2023-10-18T20:58:23.281 INFO:tasks.workunit.client.1.smithi060.stdout:9/167: dwrite d3/ff [0,4194304] 0 2023-10-18T20:58:23.281 INFO:tasks.workunit.client.0.smithi008.stdout:2/210: dread - d1/d3/dd/d1c/d39/f3f zero size 2023-10-18T20:58:23.292 INFO:tasks.workunit.client.0.smithi008.stdout:9/200: symlink d2/dc/d17/l34 0 2023-10-18T20:58:23.293 INFO:tasks.workunit.client.1.smithi060.stdout:7/191: mkdir de/d14/d2f/d3f/d42 0 2023-10-18T20:58:23.294 INFO:tasks.workunit.client.1.smithi060.stdout:7/192: truncate de/d14/d1d/f2a 826057 0 2023-10-18T20:58:23.294 INFO:tasks.workunit.client.1.smithi060.stdout:7/193: dread - de/d29/f22 zero size 2023-10-18T20:58:23.295 INFO:tasks.workunit.client.0.smithi008.stdout:5/152: write d0/d2/f7 [3696413,58229] 0 2023-10-18T20:58:23.296 INFO:tasks.workunit.client.0.smithi008.stdout:0/169: rename d0/c23 to d0/c31 0 2023-10-18T20:58:23.296 INFO:tasks.workunit.client.0.smithi008.stdout:4/218: dread d0/d3/d21/f24 [0,4194304] 0 2023-10-18T20:58:23.299 INFO:tasks.workunit.client.1.smithi060.stdout:2/195: dwrite d0/d8/f1b [0,4194304] 0 2023-10-18T20:58:23.300 INFO:tasks.workunit.client.0.smithi008.stdout:9/201: dread d2/f5 [0,4194304] 0 2023-10-18T20:58:23.302 INFO:tasks.workunit.client.0.smithi008.stdout:7/219: creat d1/d36/f4c x:0 0 0 2023-10-18T20:58:23.303 INFO:tasks.workunit.client.0.smithi008.stdout:6/238: mkdir df/d15/d33/d50 0 2023-10-18T20:58:23.303 INFO:tasks.workunit.client.0.smithi008.stdout:7/220: truncate d1/d3/f1d 982662 0 2023-10-18T20:58:23.304 INFO:tasks.workunit.client.1.smithi060.stdout:2/196: dread d0/d3/f32 [0,4194304] 0 2023-10-18T20:58:23.309 INFO:tasks.workunit.client.0.smithi008.stdout:9/202: read d2/d8/f9 [249753,92781] 0 2023-10-18T20:58:23.310 INFO:tasks.workunit.client.0.smithi008.stdout:9/203: unlink d2/f29 0 2023-10-18T20:58:23.310 INFO:tasks.workunit.client.0.smithi008.stdout:8/325: rmdir d5/d8/d17/d4d 39 2023-10-18T20:58:23.314 INFO:tasks.workunit.client.0.smithi008.stdout:2/211: write d1/d3/dd/d25/f47 [550607,9599] 0 2023-10-18T20:58:23.314 INFO:tasks.workunit.client.0.smithi008.stdout:5/153: mkdir d0/d2/d19/d1b/d31 0 2023-10-18T20:58:23.315 INFO:tasks.workunit.client.0.smithi008.stdout:0/170: mknod d0/dd/df/d20/d21/c32 0 2023-10-18T20:58:23.315 INFO:tasks.workunit.client.0.smithi008.stdout:0/171: write d0/dd/d29/f30 [300255,58348] 0 2023-10-18T20:58:23.316 INFO:tasks.workunit.client.0.smithi008.stdout:6/239: creat df/d15/d33/f51 x:0 0 0 2023-10-18T20:58:23.317 INFO:tasks.workunit.client.0.smithi008.stdout:6/240: creat df/d15/d27/f52 x:0 0 0 2023-10-18T20:58:23.324 INFO:tasks.workunit.client.1.smithi060.stdout:2/197: dread d0/d16/f28 [0,4194304] 0 2023-10-18T20:58:23.324 INFO:tasks.workunit.client.1.smithi060.stdout:2/198: chown d0/d3/d27 447803 1 2023-10-18T20:58:23.324 INFO:tasks.workunit.client.1.smithi060.stdout:2/199: write d0/d16/f25 [255642,121593] 0 2023-10-18T20:58:23.326 INFO:tasks.workunit.client.1.smithi060.stdout:5/238: mkdir d0/d6/d8/d60 0 2023-10-18T20:58:23.326 INFO:tasks.workunit.client.1.smithi060.stdout:4/142: getdents d4/dc/d2a/d1d 0 2023-10-18T20:58:23.326 INFO:tasks.workunit.client.1.smithi060.stdout:1/239: mknod d4/da/de/c54 0 2023-10-18T20:58:23.327 INFO:tasks.workunit.client.1.smithi060.stdout:1/240: chown d4/d6 161936879 1 2023-10-18T20:58:23.327 INFO:tasks.workunit.client.1.smithi060.stdout:1/241: fsync d4/d6/d7/df/f15 0 2023-10-18T20:58:23.327 INFO:tasks.workunit.client.1.smithi060.stdout:3/173: getdents d0/d22/d26 0 2023-10-18T20:58:23.327 INFO:tasks.workunit.client.1.smithi060.stdout:0/192: link d3/d8/fa d3/d8/f3f 0 2023-10-18T20:58:23.327 INFO:tasks.workunit.client.1.smithi060.stdout:6/145: creat d10/d2e/f33 x:0 0 0 2023-10-18T20:58:23.330 INFO:tasks.workunit.client.0.smithi008.stdout:9/204: truncate d2/dc/d17/f16 1766367 0 2023-10-18T20:58:23.330 INFO:tasks.workunit.client.0.smithi008.stdout:8/326: mknod d5/d8/df/d6f/c87 0 2023-10-18T20:58:23.330 INFO:tasks.workunit.client.0.smithi008.stdout:1/343: dwrite d9/de/df/f1d [4194304,4194304] 0 2023-10-18T20:58:23.334 INFO:tasks.workunit.client.1.smithi060.stdout:5/239: dread d0/f2c [0,4194304] 0 2023-10-18T20:58:23.335 INFO:tasks.workunit.client.0.smithi008.stdout:7/221: dread d1/f29 [0,4194304] 0 2023-10-18T20:58:23.336 INFO:tasks.workunit.client.0.smithi008.stdout:5/154: mknod d0/d2/c32 0 2023-10-18T20:58:23.336 INFO:tasks.workunit.client.0.smithi008.stdout:5/155: creat d0/d2/d19/f33 x:0 0 0 2023-10-18T20:58:23.336 INFO:tasks.workunit.client.1.smithi060.stdout:9/168: getdents d3/d10/d1c/d25 0 2023-10-18T20:58:23.341 INFO:tasks.workunit.client.0.smithi008.stdout:0/172: link d0/dd/df/d2a/f2d d0/dd/df/d2a/f33 0 2023-10-18T20:58:23.342 INFO:tasks.workunit.client.1.smithi060.stdout:7/194: unlink de/d14/l15 0 2023-10-18T20:58:23.342 INFO:tasks.workunit.client.1.smithi060.stdout:7/195: dread - de/d14/d2f/f3c zero size 2023-10-18T20:58:23.344 INFO:tasks.workunit.client.0.smithi008.stdout:4/219: write d0/d3/f38 [2197602,92013] 0 2023-10-18T20:58:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:1/344: write d9/de/df/d17/f5f [2647328,125720] 0 2023-10-18T20:58:23.349 INFO:tasks.workunit.client.1.smithi060.stdout:8/188: mkdir d4/d9/d37 0 2023-10-18T20:58:23.352 INFO:tasks.workunit.client.1.smithi060.stdout:2/200: rename d0/d8/f33 to d0/d8/f3d 0 2023-10-18T20:58:23.358 INFO:tasks.workunit.client.1.smithi060.stdout:9/169: dread d3/d10/d1c/d2a/f32 [0,4194304] 0 2023-10-18T20:58:23.359 INFO:tasks.workunit.client.1.smithi060.stdout:9/170: write d3/d10/d1c/d2a/f3b [81145,43237] 0 2023-10-18T20:58:23.360 INFO:tasks.workunit.client.0.smithi008.stdout:4/220: dread d0/f12 [4194304,4194304] 0 2023-10-18T20:58:23.363 INFO:tasks.workunit.client.0.smithi008.stdout:9/205: dread d2/f4 [0,4194304] 0 2023-10-18T20:58:23.363 INFO:tasks.workunit.client.0.smithi008.stdout:9/206: write d2/f26 [1282343,65188] 0 2023-10-18T20:58:23.366 INFO:tasks.workunit.client.1.smithi060.stdout:8/189: write d4/d9/f1b [2339408,39459] 0 2023-10-18T20:58:23.370 INFO:tasks.workunit.client.1.smithi060.stdout:4/143: rename d4/f24 to d4/dc/d2a/d13/f2c 0 2023-10-18T20:58:23.371 INFO:tasks.workunit.client.1.smithi060.stdout:4/144: chown d4/ce 733190770 1 2023-10-18T20:58:23.371 INFO:tasks.workunit.client.1.smithi060.stdout:4/145: fsync d4/dc/d2a/f1e 0 2023-10-18T20:58:23.373 INFO:tasks.workunit.client.1.smithi060.stdout:2/201: dread d0/d8/fd [0,4194304] 0 2023-10-18T20:58:23.375 INFO:tasks.workunit.client.1.smithi060.stdout:1/242: creat d4/d6/d14/d41/f55 x:0 0 0 2023-10-18T20:58:23.375 INFO:tasks.workunit.client.1.smithi060.stdout:6/146: mkdir d10/d2e/d34 0 2023-10-18T20:58:23.375 INFO:tasks.workunit.client.1.smithi060.stdout:0/193: dwrite d3/d32/f3a [0,4194304] 0 2023-10-18T20:58:23.376 INFO:tasks.workunit.client.1.smithi060.stdout:0/194: creat d3/d8/d14/f40 x:0 0 0 2023-10-18T20:58:23.376 INFO:tasks.workunit.client.1.smithi060.stdout:3/174: dwrite d0/fd [0,4194304] 0 2023-10-18T20:58:23.377 INFO:tasks.workunit.client.1.smithi060.stdout:9/171: rename d3/f6 to d3/d10/d1c/d2a/d2d/f40 0 2023-10-18T20:58:23.378 INFO:tasks.workunit.client.1.smithi060.stdout:9/172: dread - d3/d10/d1c/d2a/f36 zero size 2023-10-18T20:58:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:7/222: unlink d1/f4b 0 2023-10-18T20:58:23.380 INFO:tasks.workunit.client.1.smithi060.stdout:4/146: mkdir d4/dc/d2a/d2d 0 2023-10-18T20:58:23.380 INFO:tasks.workunit.client.1.smithi060.stdout:2/202: symlink d0/d3/d27/l3e 0 2023-10-18T20:58:23.381 INFO:tasks.workunit.client.1.smithi060.stdout:4/147: chown d4/dc 5 1 2023-10-18T20:58:23.381 INFO:tasks.workunit.client.1.smithi060.stdout:2/203: stat d0/d16/f1a 0 2023-10-18T20:58:23.381 INFO:tasks.workunit.client.0.smithi008.stdout:8/327: truncate d5/d8/d24/f59 197105 0 2023-10-18T20:58:23.387 INFO:tasks.workunit.client.0.smithi008.stdout:4/221: truncate d0/d3/d8/f26 2195758 0 2023-10-18T20:58:23.387 INFO:tasks.workunit.client.0.smithi008.stdout:4/222: readlink d0/l4d 0 2023-10-18T20:58:23.387 INFO:tasks.workunit.client.1.smithi060.stdout:1/243: mkdir d4/da/de/d2a/d32/d56 0 2023-10-18T20:58:23.388 INFO:tasks.workunit.client.0.smithi008.stdout:9/207: mknod d2/dc/d1a/c35 0 2023-10-18T20:58:23.388 INFO:tasks.workunit.client.0.smithi008.stdout:9/208: chown d2/ld 1748 1 2023-10-18T20:58:23.390 INFO:tasks.workunit.client.0.smithi008.stdout:7/223: creat d1/d36/d3d/f4d x:0 0 0 2023-10-18T20:58:23.391 INFO:tasks.workunit.client.0.smithi008.stdout:7/224: unlink d1/d3/c3f 0 2023-10-18T20:58:23.392 INFO:tasks.workunit.client.1.smithi060.stdout:6/147: rename d10/f1e to d10/f35 0 2023-10-18T20:58:23.393 INFO:tasks.workunit.client.1.smithi060.stdout:0/195: creat d3/f41 x:0 0 0 2023-10-18T20:58:23.393 INFO:tasks.workunit.client.1.smithi060.stdout:0/196: chown d3/f17 100 1 2023-10-18T20:58:23.395 INFO:tasks.workunit.client.0.smithi008.stdout:1/345: rmdir d9/de/df 39 2023-10-18T20:58:23.395 INFO:tasks.workunit.client.0.smithi008.stdout:1/346: chown d9/de/df/f1d 47 1 2023-10-18T20:58:23.395 INFO:tasks.workunit.client.0.smithi008.stdout:1/347: getdents d9/de/df/d17/d69 0 2023-10-18T20:58:23.396 INFO:tasks.workunit.client.1.smithi060.stdout:3/175: symlink d0/d22/d26/d2c/l38 0 2023-10-18T20:58:23.396 INFO:tasks.workunit.client.1.smithi060.stdout:9/173: mkdir d3/d10/d1c/d2a/d41 0 2023-10-18T20:58:23.396 INFO:tasks.workunit.client.1.smithi060.stdout:3/176: truncate d0/fe 4208147 0 2023-10-18T20:58:23.397 INFO:tasks.workunit.client.1.smithi060.stdout:3/177: chown d0/d22/d26/d29/l35 2032665 1 2023-10-18T20:58:23.397 INFO:tasks.workunit.client.1.smithi060.stdout:4/148: symlink d4/d15/d2b/l2e 0 2023-10-18T20:58:23.397 INFO:tasks.workunit.client.0.smithi008.stdout:4/223: rename d0/d3/d21/l44 to d0/l4e 0 2023-10-18T20:58:23.405 INFO:tasks.workunit.client.1.smithi060.stdout:5/240: dwrite d0/d6/f1e [0,4194304] 0 2023-10-18T20:58:23.406 INFO:tasks.workunit.client.1.smithi060.stdout:0/197: rename d3/ff to d3/d8/d3c/f42 0 2023-10-18T20:58:23.406 INFO:tasks.workunit.client.1.smithi060.stdout:0/198: truncate d3/d8/f2d 425517 0 2023-10-18T20:58:23.409 INFO:tasks.workunit.client.0.smithi008.stdout:9/209: unlink d2/d8/f9 0 2023-10-18T20:58:23.412 INFO:tasks.workunit.client.1.smithi060.stdout:1/244: dread f2 [0,4194304] 0 2023-10-18T20:58:23.412 INFO:tasks.workunit.client.1.smithi060.stdout:1/245: creat d4/da/d42/f57 x:0 0 0 2023-10-18T20:58:23.413 INFO:tasks.workunit.client.1.smithi060.stdout:1/246: readlink d4/d6/d14/d41/l4d 0 2023-10-18T20:58:23.413 INFO:tasks.workunit.client.1.smithi060.stdout:1/247: chown d4/d6/d7/d2f 135986917 1 2023-10-18T20:58:23.415 INFO:tasks.workunit.client.1.smithi060.stdout:4/149: dread d4/dc/f19 [0,4194304] 0 2023-10-18T20:58:23.419 INFO:tasks.workunit.client.1.smithi060.stdout:3/178: dread d0/ff [0,4194304] 0 2023-10-18T20:58:23.419 INFO:tasks.workunit.client.1.smithi060.stdout:3/179: truncate d0/f24 3876149 0 2023-10-18T20:58:23.422 INFO:tasks.workunit.client.1.smithi060.stdout:7/196: dwrite de/d14/d2f/f3e [0,4194304] 0 2023-10-18T20:58:23.422 INFO:tasks.workunit.client.1.smithi060.stdout:7/197: fdatasync de/d14/d1d/f34 0 2023-10-18T20:58:23.422 INFO:tasks.workunit.client.1.smithi060.stdout:3/180: creat d0/d2f/f39 x:0 0 0 2023-10-18T20:58:23.428 INFO:tasks.workunit.client.0.smithi008.stdout:8/328: read d5/d8/d24/f27 [3602076,34939] 0 2023-10-18T20:58:23.428 INFO:tasks.workunit.client.0.smithi008.stdout:5/156: dwrite d0/f1c [0,4194304] 0 2023-10-18T20:58:23.429 INFO:tasks.workunit.client.0.smithi008.stdout:5/157: truncate d0/d2/d19/d1b/f2a 1009343 0 2023-10-18T20:58:23.431 INFO:tasks.workunit.client.0.smithi008.stdout:1/348: symlink d9/de/df/d17/d25/l6c 0 2023-10-18T20:58:23.432 INFO:tasks.workunit.client.1.smithi060.stdout:6/148: write fd [3356549,87945] 0 2023-10-18T20:58:23.433 INFO:tasks.workunit.client.1.smithi060.stdout:6/149: stat d10/l12 0 2023-10-18T20:58:23.433 INFO:tasks.workunit.client.1.smithi060.stdout:8/190: dwrite d4/d9/f32 [0,4194304] 0 2023-10-18T20:58:23.435 INFO:tasks.workunit.client.1.smithi060.stdout:2/204: dwrite d0/d8/fa [0,4194304] 0 2023-10-18T20:58:23.437 INFO:tasks.workunit.client.0.smithi008.stdout:9/210: rename d2/dc/d17/l23 to d2/dc/d1a/d1d/l36 0 2023-10-18T20:58:23.442 INFO:tasks.workunit.client.0.smithi008.stdout:8/329: link d5/d8/df/d2e/f71 d5/d8/d24/d77/f88 0 2023-10-18T20:58:23.444 INFO:tasks.workunit.client.0.smithi008.stdout:1/349: creat d9/de/f6d x:0 0 0 2023-10-18T20:58:23.445 INFO:tasks.workunit.client.1.smithi060.stdout:0/199: link d3/c37 d3/d8/c43 0 2023-10-18T20:58:23.447 INFO:tasks.workunit.client.0.smithi008.stdout:9/211: link d2/dc/f1c d2/dc/d1a/d1d/f37 0 2023-10-18T20:58:23.454 INFO:tasks.workunit.client.0.smithi008.stdout:5/158: dread d0/d2/f7 [4194304,4194304] 0 2023-10-18T20:58:23.455 INFO:tasks.workunit.client.1.smithi060.stdout:6/150: write d10/d17/d28/f24 [2921015,9862] 0 2023-10-18T20:58:23.458 INFO:tasks.workunit.client.1.smithi060.stdout:2/205: rmdir d0 39 2023-10-18T20:58:23.479 INFO:tasks.workunit.client.0.smithi008.stdout:1/350: truncate d9/de/df/d17/d1e/f4c 989422 0 2023-10-18T20:58:23.483 INFO:tasks.workunit.client.0.smithi008.stdout:7/225: dwrite d1/d36/d3d/d3e/f37 [0,4194304] 0 2023-10-18T20:58:23.483 INFO:tasks.workunit.client.0.smithi008.stdout:7/226: truncate d1/d36/d3d/d3e/f31 1030665 0 2023-10-18T20:58:23.483 INFO:tasks.workunit.client.0.smithi008.stdout:7/227: chown d1/d3/d20/c28 601324725 1 2023-10-18T20:58:23.483 INFO:tasks.workunit.client.0.smithi008.stdout:7/228: stat d1/d3/c2c 0 2023-10-18T20:58:23.484 INFO:tasks.workunit.client.0.smithi008.stdout:7/229: creat d1/f4e x:0 0 0 2023-10-18T20:58:23.484 INFO:tasks.workunit.client.0.smithi008.stdout:7/230: stat d1/d3/fc 0 2023-10-18T20:58:23.484 INFO:tasks.workunit.client.0.smithi008.stdout:7/231: readlink d1/d3/l24 0 2023-10-18T20:58:23.484 INFO:tasks.workunit.client.0.smithi008.stdout:7/232: getdents d1/d36/d3d/d3e 0 2023-10-18T20:58:23.486 INFO:tasks.workunit.client.1.smithi060.stdout:8/191: write d4/ff [3900664,17162] 0 2023-10-18T20:58:23.493 INFO:tasks.workunit.client.0.smithi008.stdout:5/159: mkdir d0/d2/d9/d34 0 2023-10-18T20:58:23.503 INFO:tasks.workunit.client.0.smithi008.stdout:4/224: dwrite d0/d3/d8/f15 [0,4194304] 0 2023-10-18T20:58:23.505 INFO:tasks.workunit.client.1.smithi060.stdout:4/150: dwrite d4/dc/d2a/f1f [0,4194304] 0 2023-10-18T20:58:23.505 INFO:tasks.workunit.client.1.smithi060.stdout:4/151: write d4/dc/f29 [455396,20051] 0 2023-10-18T20:58:23.505 INFO:tasks.workunit.client.1.smithi060.stdout:4/152: stat d4/c9 0 2023-10-18T20:58:23.506 INFO:tasks.workunit.client.1.smithi060.stdout:5/241: dwrite d0/d6/d8/df/f51 [0,4194304] 0 2023-10-18T20:58:23.514 INFO:tasks.workunit.client.0.smithi008.stdout:8/330: dwrite d5/f25 [0,4194304] 0 2023-10-18T20:58:23.515 INFO:tasks.workunit.client.1.smithi060.stdout:5/242: dread d0/d6/db/f5d [0,4194304] 0 2023-10-18T20:58:23.518 INFO:tasks.workunit.client.0.smithi008.stdout:3/173: sync 2023-10-18T20:58:23.518 INFO:tasks.workunit.client.0.smithi008.stdout:1/351: rmdir d9/de/df/d17/d1e/d3c 39 2023-10-18T20:58:23.519 INFO:tasks.workunit.client.0.smithi008.stdout:1/352: chown d9/de/df 4100281 1 2023-10-18T20:58:23.519 INFO:tasks.workunit.client.0.smithi008.stdout:3/174: fsync d0/d3/fd 0 2023-10-18T20:58:23.519 INFO:tasks.workunit.client.0.smithi008.stdout:1/353: fsync d9/de/df/d17/d1e/f4a 0 2023-10-18T20:58:23.519 INFO:tasks.workunit.client.0.smithi008.stdout:1/354: fdatasync d9/de/df/d17/d25/f44 0 2023-10-18T20:58:23.520 INFO:tasks.workunit.client.0.smithi008.stdout:1/355: fdatasync d9/de/f45 0 2023-10-18T20:58:23.520 INFO:tasks.workunit.client.1.smithi060.stdout:8/192: chown d4/f25 4034120 1 2023-10-18T20:58:23.522 INFO:tasks.workunit.client.1.smithi060.stdout:4/153: write d4/dc/d2a/f1f [2600826,33938] 0 2023-10-18T20:58:23.522 INFO:tasks.workunit.client.1.smithi060.stdout:3/181: dwrite d0/ff [0,4194304] 0 2023-10-18T20:58:23.524 INFO:tasks.workunit.client.0.smithi008.stdout:3/175: creat d0/d3/f33 x:0 0 0 2023-10-18T20:58:23.531 INFO:tasks.workunit.client.1.smithi060.stdout:0/200: mknod d3/d8/c44 0 2023-10-18T20:58:23.541 INFO:tasks.workunit.client.1.smithi060.stdout:6/151: getdents d10 0 2023-10-18T20:58:23.542 INFO:tasks.workunit.client.1.smithi060.stdout:6/152: readlink d10/l12 0 2023-10-18T20:58:23.542 INFO:tasks.workunit.client.1.smithi060.stdout:6/153: fsync d10/d1b/f2b 0 2023-10-18T20:58:23.542 INFO:tasks.workunit.client.0.smithi008.stdout:8/331: unlink d5/d8/f9 0 2023-10-18T20:58:23.548 INFO:tasks.workunit.client.0.smithi008.stdout:3/176: write d0/d3/f2b [3222953,24202] 0 2023-10-18T20:58:23.550 INFO:tasks.workunit.client.1.smithi060.stdout:8/193: truncate d4/f25 1060894 0 2023-10-18T20:58:23.551 INFO:tasks.workunit.client.0.smithi008.stdout:9/212: dwrite d2/dc/f15 [0,4194304] 0 2023-10-18T20:58:23.556 INFO:tasks.workunit.client.0.smithi008.stdout:1/356: getdents d9/de/df/d17/d1e/d3c 0 2023-10-18T20:58:23.563 INFO:tasks.workunit.client.0.smithi008.stdout:5/160: dwrite d0/d2/d19/f2c [0,4194304] 0 2023-10-18T20:58:23.563 INFO:tasks.workunit.client.0.smithi008.stdout:5/161: fsync d0/f25 0 2023-10-18T20:58:23.565 INFO:tasks.workunit.client.0.smithi008.stdout:4/225: getdents d0/d17 0 2023-10-18T20:58:23.565 INFO:tasks.workunit.client.0.smithi008.stdout:4/226: write d0/f27 [1495360,11818] 0 2023-10-18T20:58:23.568 INFO:tasks.workunit.client.0.smithi008.stdout:8/332: unlink d5/d8/df/l30 0 2023-10-18T20:58:23.568 INFO:tasks.workunit.client.0.smithi008.stdout:8/333: readlink d5/l10 0 2023-10-18T20:58:23.569 INFO:tasks.workunit.client.0.smithi008.stdout:8/334: chown d5/d8/d17/d4d/f6d 448867478 1 2023-10-18T20:58:23.569 INFO:tasks.workunit.client.0.smithi008.stdout:8/335: write d5/d8/f47 [191830,118398] 0 2023-10-18T20:58:23.569 INFO:tasks.workunit.client.0.smithi008.stdout:8/336: unlink d5/d8/d17/f44 0 2023-10-18T20:58:23.569 INFO:tasks.workunit.client.0.smithi008.stdout:8/337: chown d5/d8/df/f29 93301775 1 2023-10-18T20:58:23.570 INFO:tasks.workunit.client.0.smithi008.stdout:8/338: chown d5/d8/d24/d50/l5b 14 1 2023-10-18T20:58:23.570 INFO:tasks.workunit.client.1.smithi060.stdout:4/154: mkdir d4/dc/d2a/d13/d2f 0 2023-10-18T20:58:23.572 INFO:tasks.workunit.client.0.smithi008.stdout:3/177: mknod d0/d3/de/d13/c34 0 2023-10-18T20:58:23.572 INFO:tasks.workunit.client.0.smithi008.stdout:3/178: write d0/d3/fd [5094302,102668] 0 2023-10-18T20:58:23.572 INFO:tasks.workunit.client.0.smithi008.stdout:3/179: dread - d0/d3/f2e zero size 2023-10-18T20:58:23.576 INFO:tasks.workunit.client.1.smithi060.stdout:3/182: link d0/fb d0/d22/d26/d29/f3a 0 2023-10-18T20:58:23.577 INFO:tasks.workunit.client.1.smithi060.stdout:5/243: mkdir d0/da/d61 0 2023-10-18T20:58:23.580 INFO:tasks.workunit.client.0.smithi008.stdout:1/357: unlink c7 0 2023-10-18T20:58:23.582 INFO:tasks.workunit.client.1.smithi060.stdout:9/174: sync 2023-10-18T20:58:23.582 INFO:tasks.workunit.client.1.smithi060.stdout:9/175: read - d3/d10/d1c/d2a/d2d/f2e zero size 2023-10-18T20:58:23.582 INFO:tasks.workunit.client.1.smithi060.stdout:9/176: write d3/d10/d19/f1f [955809,123988] 0 2023-10-18T20:58:23.583 INFO:tasks.workunit.client.0.smithi008.stdout:2/212: sync 2023-10-18T20:58:23.584 INFO:tasks.workunit.client.0.smithi008.stdout:6/241: sync 2023-10-18T20:58:23.584 INFO:tasks.workunit.client.0.smithi008.stdout:0/173: sync 2023-10-18T20:58:23.585 INFO:tasks.workunit.client.1.smithi060.stdout:6/154: dwrite d10/d17/d28/f21 [0,4194304] 0 2023-10-18T20:58:23.585 INFO:tasks.workunit.client.1.smithi060.stdout:6/155: write d10/f35 [1281665,85067] 0 2023-10-18T20:58:23.586 INFO:tasks.workunit.client.1.smithi060.stdout:7/198: sync 2023-10-18T20:58:23.586 INFO:tasks.workunit.client.1.smithi060.stdout:1/248: sync 2023-10-18T20:58:23.586 INFO:tasks.workunit.client.1.smithi060.stdout:7/199: dread - de/d14/d1d/f34 zero size 2023-10-18T20:58:23.587 INFO:tasks.workunit.client.1.smithi060.stdout:8/194: stat d4/c10 0 2023-10-18T20:58:23.589 INFO:tasks.workunit.client.0.smithi008.stdout:5/162: link d0/d2/c32 d0/d2/d9/d34/c35 0 2023-10-18T20:58:23.590 INFO:tasks.workunit.client.0.smithi008.stdout:5/163: chown d0/d2/d9/f24 245251 1 2023-10-18T20:58:23.590 INFO:tasks.workunit.client.0.smithi008.stdout:5/164: creat d0/d2/d19/d1b/d20/f36 x:0 0 0 2023-10-18T20:58:23.594 INFO:tasks.workunit.client.0.smithi008.stdout:1/358: dread d9/f2f [0,4194304] 0 2023-10-18T20:58:23.595 INFO:tasks.workunit.client.0.smithi008.stdout:4/227: creat d0/d17/f4f x:0 0 0 2023-10-18T20:58:23.597 INFO:tasks.workunit.client.1.smithi060.stdout:0/201: mknod d3/d8/c45 0 2023-10-18T20:58:23.601 INFO:tasks.workunit.client.0.smithi008.stdout:6/242: dread df/d13/f17 [0,4194304] 0 2023-10-18T20:58:23.601 INFO:tasks.workunit.client.0.smithi008.stdout:6/243: fdatasync df/d15/d48/d4b/f4f 0 2023-10-18T20:58:23.606 INFO:tasks.workunit.client.1.smithi060.stdout:5/244: mknod d0/d6/d8/df/d27/d32/d4f/c62 0 2023-10-18T20:58:23.607 INFO:tasks.workunit.client.1.smithi060.stdout:5/245: creat d0/da/d3b/d43/f63 x:0 0 0 2023-10-18T20:58:23.608 INFO:tasks.workunit.client.0.smithi008.stdout:9/213: dwrite d2/dc/d1a/d1d/f37 [4194304,4194304] 0 2023-10-18T20:58:23.609 INFO:tasks.workunit.client.0.smithi008.stdout:8/339: link d5/d8/d24/d50/d53/c5c d5/c89 0 2023-10-18T20:58:23.610 INFO:tasks.workunit.client.0.smithi008.stdout:8/340: readlink d5/d8/d24/l40 0 2023-10-18T20:58:23.610 INFO:tasks.workunit.client.0.smithi008.stdout:8/341: creat d5/d8/df/d2e/f8a x:0 0 0 2023-10-18T20:58:23.610 INFO:tasks.workunit.client.0.smithi008.stdout:8/342: stat d5/d8/d17/l1e 0 2023-10-18T20:58:23.610 INFO:tasks.workunit.client.0.smithi008.stdout:8/343: write d5/d8/d24/f2c [107910,16686] 0 2023-10-18T20:58:23.611 INFO:tasks.workunit.client.0.smithi008.stdout:8/344: dread - d5/d8/df/d2e/f8a zero size 2023-10-18T20:58:23.611 INFO:tasks.workunit.client.0.smithi008.stdout:3/180: mkdir d0/d3/de/d13/d35 0 2023-10-18T20:58:23.612 INFO:tasks.workunit.client.1.smithi060.stdout:4/155: dwrite d4/f10 [4194304,4194304] 0 2023-10-18T20:58:23.613 INFO:tasks.workunit.client.0.smithi008.stdout:2/213: creat d1/d3/f4b x:0 0 0 2023-10-18T20:58:23.613 INFO:tasks.workunit.client.0.smithi008.stdout:2/214: chown d1/d3/dd/d25/l2a 15121 1 2023-10-18T20:58:23.614 INFO:tasks.workunit.client.1.smithi060.stdout:9/177: link d3/d10/d1c/d2a/d2d/f40 d3/d10/d1c/d2a/d41/f42 0 2023-10-18T20:58:23.615 INFO:tasks.workunit.client.0.smithi008.stdout:0/174: truncate d0/dd/df/d2a/f33 3450672 0 2023-10-18T20:58:23.616 INFO:tasks.workunit.client.1.smithi060.stdout:9/178: write d3/ff [4335198,55285] 0 2023-10-18T20:58:23.616 INFO:tasks.workunit.client.1.smithi060.stdout:9/179: creat d3/d10/d1c/d2a/d33/d29/d2b/f43 x:0 0 0 2023-10-18T20:58:23.618 INFO:tasks.workunit.client.1.smithi060.stdout:1/249: mkdir d4/d6/d33/d58 0 2023-10-18T20:58:23.619 INFO:tasks.workunit.client.0.smithi008.stdout:5/165: creat d0/d2/d9/d34/f37 x:0 0 0 2023-10-18T20:58:23.627 INFO:tasks.workunit.client.0.smithi008.stdout:1/359: link d9/de/c23 d9/de/c6e 0 2023-10-18T20:58:23.629 INFO:tasks.workunit.client.0.smithi008.stdout:4/228: link d0/f1c d0/d3/d21/d42/f50 0 2023-10-18T20:58:23.637 INFO:tasks.workunit.client.1.smithi060.stdout:0/202: dwrite d3/fc [0,4194304] 0 2023-10-18T20:58:23.638 INFO:tasks.workunit.client.0.smithi008.stdout:6/244: mkdir df/d13/d53 0 2023-10-18T20:58:23.639 INFO:tasks.workunit.client.1.smithi060.stdout:2/206: sync 2023-10-18T20:58:23.640 INFO:tasks.workunit.client.1.smithi060.stdout:3/183: rmdir d0/d22 39 2023-10-18T20:58:23.643 INFO:tasks.workunit.client.0.smithi008.stdout:8/345: rename d5/d8/d24/d50/l5b to d5/d8/d17/l8b 0 2023-10-18T20:58:23.644 INFO:tasks.workunit.client.0.smithi008.stdout:3/181: creat d0/f36 x:0 0 0 2023-10-18T20:58:23.645 INFO:tasks.workunit.client.0.smithi008.stdout:3/182: stat d0/d3/d15/f21 0 2023-10-18T20:58:23.645 INFO:tasks.workunit.client.0.smithi008.stdout:3/183: chown d0/d3/de/d13 1 1 2023-10-18T20:58:23.647 INFO:tasks.workunit.client.1.smithi060.stdout:4/156: symlink d4/dc/d2a/d2d/l30 0 2023-10-18T20:58:23.650 INFO:tasks.workunit.client.0.smithi008.stdout:0/175: mknod d0/c34 0 2023-10-18T20:58:23.650 INFO:tasks.workunit.client.0.smithi008.stdout:0/176: truncate d0/dd/df/d2a/f2d 3885387 0 2023-10-18T20:58:23.650 INFO:tasks.workunit.client.0.smithi008.stdout:1/360: creat d9/de/df/d17/d1e/d3c/f6f x:0 0 0 2023-10-18T20:58:23.652 INFO:tasks.workunit.client.0.smithi008.stdout:2/215: rename d1/d3/dd/d1c/c26 to d1/d3/d40/c4c 0 2023-10-18T20:58:23.662 INFO:tasks.workunit.client.1.smithi060.stdout:9/180: unlink d3/d10/d19/l27 0 2023-10-18T20:58:23.663 INFO:tasks.workunit.client.0.smithi008.stdout:8/346: dread d5/f11 [0,4194304] 0 2023-10-18T20:58:23.663 INFO:tasks.workunit.client.0.smithi008.stdout:8/347: readlink d5/d8/d17/l3f 0 2023-10-18T20:58:23.664 INFO:tasks.workunit.client.0.smithi008.stdout:1/361: unlink d9/de/df/f1d 0 2023-10-18T20:58:23.672 INFO:tasks.workunit.client.0.smithi008.stdout:0/177: write d0/fb [3001957,36635] 0 2023-10-18T20:58:23.673 INFO:tasks.workunit.client.1.smithi060.stdout:3/184: write d0/f2a [4044264,34523] 0 2023-10-18T20:58:23.676 INFO:tasks.workunit.client.0.smithi008.stdout:3/184: fsync d0/f36 0 2023-10-18T20:58:23.677 INFO:tasks.workunit.client.0.smithi008.stdout:3/185: chown d0/d3/de/d13 984773 1 2023-10-18T20:58:23.677 INFO:tasks.workunit.client.0.smithi008.stdout:3/186: chown d0/d3/f31 894405108 1 2023-10-18T20:58:23.677 INFO:tasks.workunit.client.0.smithi008.stdout:3/187: fsync d0/d3/de/d13/f28 0 2023-10-18T20:58:23.678 INFO:tasks.workunit.client.0.smithi008.stdout:9/214: truncate d2/dc/f15 540631 0 2023-10-18T20:58:23.680 INFO:tasks.workunit.client.1.smithi060.stdout:1/250: mkdir d4/d6/d7/df/d59 0 2023-10-18T20:58:23.680 INFO:tasks.workunit.client.1.smithi060.stdout:1/251: dread - d4/d6/d48/f4b zero size 2023-10-18T20:58:23.682 INFO:tasks.workunit.client.0.smithi008.stdout:5/166: rename d0/d2/d9/l1d to d0/d2/d19/d1b/l38 0 2023-10-18T20:58:23.683 INFO:tasks.workunit.client.1.smithi060.stdout:7/200: rmdir de/d14/d2f 39 2023-10-18T20:58:23.685 INFO:tasks.workunit.client.0.smithi008.stdout:4/229: dwrite d0/d3/f41 [0,4194304] 0 2023-10-18T20:58:23.686 INFO:tasks.workunit.client.1.smithi060.stdout:8/195: getdents d4/d9 0 2023-10-18T20:58:23.688 INFO:tasks.workunit.client.1.smithi060.stdout:2/207: rmdir d0/d8 39 2023-10-18T20:58:23.690 INFO:tasks.workunit.client.1.smithi060.stdout:5/246: getdents d0/d6/db/d41 0 2023-10-18T20:58:23.691 INFO:tasks.workunit.client.1.smithi060.stdout:1/252: dread d4/f8 [0,4194304] 0 2023-10-18T20:58:23.692 INFO:tasks.workunit.client.0.smithi008.stdout:8/348: mkdir d5/d8/d24/d50/d53/d8c 0 2023-10-18T20:58:23.693 INFO:tasks.workunit.client.0.smithi008.stdout:1/362: creat d9/de/df/d17/f70 x:0 0 0 2023-10-18T20:58:23.693 INFO:tasks.workunit.client.1.smithi060.stdout:8/196: dread d4/d9/f23 [0,4194304] 0 2023-10-18T20:58:23.694 INFO:tasks.workunit.client.1.smithi060.stdout:8/197: fsync d4/d9/f2e 0 2023-10-18T20:58:23.694 INFO:tasks.workunit.client.1.smithi060.stdout:8/198: write d4/d9/f23 [680229,106418] 0 2023-10-18T20:58:23.695 INFO:tasks.workunit.client.1.smithi060.stdout:2/208: dread d0/d16/f25 [0,4194304] 0 2023-10-18T20:58:23.696 INFO:tasks.workunit.client.1.smithi060.stdout:2/209: write d0/d8/f30 [1598766,80904] 0 2023-10-18T20:58:23.696 INFO:tasks.workunit.client.1.smithi060.stdout:2/210: write d0/d8/f2b [709368,70358] 0 2023-10-18T20:58:23.696 INFO:tasks.workunit.client.1.smithi060.stdout:2/211: chown d0/d16 378513856 1 2023-10-18T20:58:23.696 INFO:tasks.workunit.client.1.smithi060.stdout:4/157: truncate d4/dc/d2a/f1e 3544659 0 2023-10-18T20:58:23.696 INFO:tasks.workunit.client.1.smithi060.stdout:2/212: write d0/d8/f2b [1171403,122016] 0 2023-10-18T20:58:23.697 INFO:tasks.workunit.client.1.smithi060.stdout:2/213: fsync d0/d8/f26 0 2023-10-18T20:58:23.699 INFO:tasks.workunit.client.1.smithi060.stdout:9/181: link d3/d10/c1a d3/d10/c44 0 2023-10-18T20:58:23.700 INFO:tasks.workunit.client.0.smithi008.stdout:3/188: mkdir d0/d3/d37 0 2023-10-18T20:58:23.700 INFO:tasks.workunit.client.0.smithi008.stdout:3/189: dread - d0/d2c/f30 zero size 2023-10-18T20:58:23.700 INFO:tasks.workunit.client.0.smithi008.stdout:3/190: write d0/d3/f2b [5219492,109994] 0 2023-10-18T20:58:23.701 INFO:tasks.workunit.client.0.smithi008.stdout:5/167: link d0/de/c18 d0/d2/d19/d1b/c39 0 2023-10-18T20:58:23.704 INFO:tasks.workunit.client.0.smithi008.stdout:6/245: dwrite df/d18/f2d [0,4194304] 0 2023-10-18T20:58:23.704 INFO:tasks.workunit.client.0.smithi008.stdout:6/246: truncate df/d19/f20 1236122 0 2023-10-18T20:58:23.706 INFO:tasks.workunit.client.1.smithi060.stdout:3/185: unlink d0/d22/d26/d2b/f34 0 2023-10-18T20:58:23.707 INFO:tasks.workunit.client.1.smithi060.stdout:0/203: dwrite d3/fc [4194304,4194304] 0 2023-10-18T20:58:23.708 INFO:tasks.workunit.client.1.smithi060.stdout:0/204: write d3/d8/f11 [397185,73000] 0 2023-10-18T20:58:23.712 INFO:tasks.workunit.client.1.smithi060.stdout:7/201: creat de/d14/d41/f43 x:0 0 0 2023-10-18T20:58:23.712 INFO:tasks.workunit.client.1.smithi060.stdout:7/202: fdatasync de/d14/d41/f43 0 2023-10-18T20:58:23.712 INFO:tasks.workunit.client.1.smithi060.stdout:7/203: readlink l6 0 2023-10-18T20:58:23.713 INFO:tasks.workunit.client.1.smithi060.stdout:7/204: write de/ff [2865221,67776] 0 2023-10-18T20:58:23.713 INFO:tasks.workunit.client.1.smithi060.stdout:7/205: write de/d29/f22 [391779,85384] 0 2023-10-18T20:58:23.717 INFO:tasks.workunit.client.1.smithi060.stdout:5/247: mkdir d0/da/d3b/d64 0 2023-10-18T20:58:23.719 INFO:tasks.workunit.client.1.smithi060.stdout:4/158: write d4/dc/d2a/f7 [1627502,57752] 0 2023-10-18T20:58:23.719 INFO:tasks.workunit.client.1.smithi060.stdout:4/159: chown d4/dc/f19 215258 1 2023-10-18T20:58:23.719 INFO:tasks.workunit.client.1.smithi060.stdout:4/160: read d4/dc/d2a/f7 [2065296,22451] 0 2023-10-18T20:58:23.725 INFO:tasks.workunit.client.0.smithi008.stdout:2/216: dread d1/d3/dd/f1e [4194304,4194304] 0 2023-10-18T20:58:23.728 INFO:tasks.workunit.client.1.smithi060.stdout:1/253: rename d4/da/de/f52 to d4/da/f5a 0 2023-10-18T20:58:23.728 INFO:tasks.workunit.client.1.smithi060.stdout:1/254: creat d4/da/f5b x:0 0 0 2023-10-18T20:58:23.729 INFO:tasks.workunit.client.0.smithi008.stdout:1/363: dread d9/de/df/d17/d25/f29 [0,4194304] 0 2023-10-18T20:58:23.729 INFO:tasks.workunit.client.0.smithi008.stdout:1/364: chown d9/de/c49 22 1 2023-10-18T20:58:23.729 INFO:tasks.workunit.client.0.smithi008.stdout:1/365: chown d9/de/df/f5b 175742827 1 2023-10-18T20:58:23.729 INFO:tasks.workunit.client.0.smithi008.stdout:0/178: dwrite d0/dd/df/d2a/f33 [0,4194304] 0 2023-10-18T20:58:23.730 INFO:tasks.workunit.client.0.smithi008.stdout:6/247: dread df/d19/f1c [0,4194304] 0 2023-10-18T20:58:23.730 INFO:tasks.workunit.client.0.smithi008.stdout:6/248: chown df/d26 3 1 2023-10-18T20:58:23.730 INFO:tasks.workunit.client.0.smithi008.stdout:8/349: mkdir d5/d8/d24/d50/d8d 0 2023-10-18T20:58:23.732 INFO:tasks.workunit.client.1.smithi060.stdout:8/199: chown d4/f30 0 1 2023-10-18T20:58:23.733 INFO:tasks.workunit.client.1.smithi060.stdout:2/214: getdents d0/d16 0 2023-10-18T20:58:23.733 INFO:tasks.workunit.client.1.smithi060.stdout:2/215: write d0/d8/f26 [591597,40160] 0 2023-10-18T20:58:23.734 INFO:tasks.workunit.client.1.smithi060.stdout:8/200: read d4/d9/f21 [108548,91390] 0 2023-10-18T20:58:23.735 INFO:tasks.workunit.client.1.smithi060.stdout:9/182: truncate d3/d10/f18 683781 0 2023-10-18T20:58:23.736 INFO:tasks.workunit.client.0.smithi008.stdout:4/230: read d0/d17/f23 [517439,38144] 0 2023-10-18T20:58:23.736 INFO:tasks.workunit.client.0.smithi008.stdout:4/231: creat d0/d3/d21/f51 x:0 0 0 2023-10-18T20:58:23.742 INFO:tasks.workunit.client.1.smithi060.stdout:1/255: dread f2 [0,4194304] 0 2023-10-18T20:58:23.748 INFO:tasks.workunit.client.1.smithi060.stdout:9/183: dread d3/d10/d1c/d2a/d33/f31 [0,4194304] 0 2023-10-18T20:58:23.748 INFO:tasks.workunit.client.1.smithi060.stdout:9/184: write d3/d10/d1c/d2a/f32 [1171347,76722] 0 2023-10-18T20:58:23.753 INFO:tasks.workunit.client.0.smithi008.stdout:1/366: read d9/de/df/d17/d1e/f4a [508956,86900] 0 2023-10-18T20:58:23.758 INFO:tasks.workunit.client.1.smithi060.stdout:1/256: write d4/d6/f22 [3758235,29199] 0 2023-10-18T20:58:23.758 INFO:tasks.workunit.client.1.smithi060.stdout:1/257: stat d4/da/de/d2a/d32/d51 0 2023-10-18T20:58:23.762 INFO:tasks.workunit.client.1.smithi060.stdout:8/201: dread d4/d9/fa [0,4194304] 0 2023-10-18T20:58:23.770 INFO:tasks.workunit.client.1.smithi060.stdout:3/186: getdents d0/d22/d26/d2c 0 2023-10-18T20:58:23.772 INFO:tasks.workunit.client.1.smithi060.stdout:0/205: creat d3/d32/d35/f46 x:0 0 0 2023-10-18T20:58:23.772 INFO:tasks.workunit.client.0.smithi008.stdout:2/217: truncate d1/f1a 232721 0 2023-10-18T20:58:23.773 INFO:tasks.workunit.client.0.smithi008.stdout:0/179: truncate d0/f2 610520 0 2023-10-18T20:58:23.773 INFO:tasks.workunit.client.0.smithi008.stdout:0/180: chown d0/dd/df/l1b 85 1 2023-10-18T20:58:23.773 INFO:tasks.workunit.client.0.smithi008.stdout:2/218: readlink d1/d3/l33 0 2023-10-18T20:58:23.773 INFO:tasks.workunit.client.1.smithi060.stdout:7/206: symlink de/d29/l44 0 2023-10-18T20:58:23.777 INFO:tasks.workunit.client.1.smithi060.stdout:4/161: mkdir d4/dc/d2a/d31 0 2023-10-18T20:58:23.778 INFO:tasks.workunit.client.0.smithi008.stdout:8/350: symlink d5/d8/d24/d50/d53/l8e 0 2023-10-18T20:58:23.780 INFO:tasks.workunit.client.1.smithi060.stdout:5/248: dwrite d0/d6/d8/df/d27/f4d [0,4194304] 0 2023-10-18T20:58:23.781 INFO:tasks.workunit.client.1.smithi060.stdout:5/249: chown d0/dd/d33 11 1 2023-10-18T20:58:23.781 INFO:tasks.workunit.client.1.smithi060.stdout:5/250: truncate d0/d6/d8/df/d27/f3c 989378 0 2023-10-18T20:58:23.782 INFO:tasks.workunit.client.0.smithi008.stdout:3/191: truncate d0/d3/f31 2796255 0 2023-10-18T20:58:23.782 INFO:tasks.workunit.client.0.smithi008.stdout:8/351: dread - d5/d8/df/d2e/f8a zero size 2023-10-18T20:58:23.792 INFO:tasks.workunit.client.1.smithi060.stdout:3/187: dread d0/ff [0,4194304] 0 2023-10-18T20:58:23.792 INFO:tasks.workunit.client.1.smithi060.stdout:3/188: creat d0/d2f/f3b x:0 0 0 2023-10-18T20:58:23.792 INFO:tasks.workunit.client.1.smithi060.stdout:3/189: truncate d0/d2f/f32 168858 0 2023-10-18T20:58:23.793 INFO:tasks.workunit.client.1.smithi060.stdout:0/206: read d3/d8/d14/f2a [2981816,52461] 0 2023-10-18T20:58:23.802 INFO:tasks.workunit.client.1.smithi060.stdout:4/162: write d4/f10 [6175391,22220] 0 2023-10-18T20:58:23.803 INFO:tasks.workunit.client.1.smithi060.stdout:7/207: dread de/d29/f22 [0,4194304] 0 2023-10-18T20:58:23.803 INFO:tasks.workunit.client.1.smithi060.stdout:5/251: dread d0/dd/d33/f3d [0,4194304] 0 2023-10-18T20:58:23.808 INFO:tasks.workunit.client.1.smithi060.stdout:0/207: read d3/d8/f2d [248472,12745] 0 2023-10-18T20:58:23.808 INFO:tasks.workunit.client.1.smithi060.stdout:0/208: creat d3/d32/d35/f47 x:0 0 0 2023-10-18T20:58:23.808 INFO:tasks.workunit.client.1.smithi060.stdout:0/209: stat d3 0 2023-10-18T20:58:23.808 INFO:tasks.workunit.client.1.smithi060.stdout:0/210: creat d3/f48 x:0 0 0 2023-10-18T20:58:23.813 INFO:tasks.workunit.client.1.smithi060.stdout:6/156: sync 2023-10-18T20:58:23.818 INFO:tasks.workunit.client.0.smithi008.stdout:3/192: dwrite d0/d3/fd [4194304,4194304] 0 2023-10-18T20:58:23.819 INFO:tasks.workunit.client.0.smithi008.stdout:4/232: rename d0/d3/f38 to d0/d3/d8/f52 0 2023-10-18T20:58:23.823 INFO:tasks.workunit.client.0.smithi008.stdout:5/168: getdents d0/d2/d19/d1b 0 2023-10-18T20:58:23.829 INFO:tasks.workunit.client.1.smithi060.stdout:2/216: dwrite d0/d3/f17 [0,4194304] 0 2023-10-18T20:58:23.832 INFO:tasks.workunit.client.1.smithi060.stdout:5/252: write d0/d6/d8/df/d27/d32/f39 [2226637,97967] 0 2023-10-18T20:58:23.832 INFO:tasks.workunit.client.1.smithi060.stdout:5/253: write d0/f1d [2420322,110660] 0 2023-10-18T20:58:23.832 INFO:tasks.workunit.client.1.smithi060.stdout:5/254: creat d0/da/d3b/f65 x:0 0 0 2023-10-18T20:58:23.832 INFO:tasks.workunit.client.1.smithi060.stdout:9/185: dwrite d3/d10/d1c/d2a/f36 [0,4194304] 0 2023-10-18T20:58:23.833 INFO:tasks.workunit.client.1.smithi060.stdout:8/202: stat d4/d9/d31/c33 0 2023-10-18T20:58:23.835 INFO:tasks.workunit.client.0.smithi008.stdout:6/249: dwrite df/d15/d27/f52 [0,4194304] 0 2023-10-18T20:58:23.835 INFO:tasks.workunit.client.0.smithi008.stdout:7/233: sync 2023-10-18T20:58:23.835 INFO:tasks.workunit.client.0.smithi008.stdout:7/234: getdents d1/d36/d3d/d3e 0 2023-10-18T20:58:23.840 INFO:tasks.workunit.client.0.smithi008.stdout:0/181: unlink d0/fb 0 2023-10-18T20:58:23.841 INFO:tasks.workunit.client.1.smithi060.stdout:5/255: dread d0/f2c [0,4194304] 0 2023-10-18T20:58:23.841 INFO:tasks.workunit.client.1.smithi060.stdout:5/256: dread - d0/da/d3b/d43/f50 zero size 2023-10-18T20:58:23.841 INFO:tasks.workunit.client.1.smithi060.stdout:5/257: dread - d0/da/d3b/d43/f63 zero size 2023-10-18T20:58:23.844 INFO:tasks.workunit.client.0.smithi008.stdout:1/367: dwrite d9/de/df/d17/d1e/f65 [0,4194304] 0 2023-10-18T20:58:23.847 INFO:tasks.workunit.client.0.smithi008.stdout:2/219: mkdir d1/d3/dd/d25/d4d 0 2023-10-18T20:58:23.854 INFO:tasks.workunit.client.1.smithi060.stdout:3/190: rename d0/d37 to d0/d3c 0 2023-10-18T20:58:23.854 INFO:tasks.workunit.client.1.smithi060.stdout:2/217: dread d0/d3/d2a/f39 [0,4194304] 0 2023-10-18T20:58:23.856 INFO:tasks.workunit.client.0.smithi008.stdout:8/352: mkdir d5/d8/d24/d8f 0 2023-10-18T20:58:23.859 INFO:tasks.workunit.client.1.smithi060.stdout:7/208: dwrite de/d14/d1d/f21 [0,4194304] 0 2023-10-18T20:58:23.860 INFO:tasks.workunit.client.1.smithi060.stdout:7/209: write de/d14/f30 [396450,109594] 0 2023-10-18T20:58:23.860 INFO:tasks.workunit.client.1.smithi060.stdout:4/163: dwrite d4/dc/d2a/f1f [0,4194304] 0 2023-10-18T20:58:23.865 INFO:tasks.workunit.client.0.smithi008.stdout:4/233: creat d0/d3/d48/d4c/f53 x:0 0 0 2023-10-18T20:58:23.865 INFO:tasks.workunit.client.0.smithi008.stdout:4/234: creat d0/d3/d21/f54 x:0 0 0 2023-10-18T20:58:23.872 INFO:tasks.workunit.client.1.smithi060.stdout:1/258: getdents d4/da 0 2023-10-18T20:58:23.872 INFO:tasks.workunit.client.1.smithi060.stdout:1/259: chown d4 459011824 1 2023-10-18T20:58:23.872 INFO:tasks.workunit.client.1.smithi060.stdout:1/260: creat d4/da/de/d2a/d32/dd/f5c x:0 0 0 2023-10-18T20:58:23.878 INFO:tasks.workunit.client.0.smithi008.stdout:5/169: symlink d0/d2/l3a 0 2023-10-18T20:58:23.880 INFO:tasks.workunit.client.1.smithi060.stdout:9/186: rmdir d3/d10/d1c/d2a/d33/d29 39 2023-10-18T20:58:23.881 INFO:tasks.workunit.client.1.smithi060.stdout:9/187: read d3/f4 [75098,129688] 0 2023-10-18T20:58:23.881 INFO:tasks.workunit.client.1.smithi060.stdout:9/188: readlink d3/d10/l3f 0 2023-10-18T20:58:23.883 INFO:tasks.workunit.client.1.smithi060.stdout:1/261: write d4/d6/d7/df/f15 [1585753,78287] 0 2023-10-18T20:58:23.884 INFO:tasks.workunit.client.1.smithi060.stdout:1/262: dread - d4/d6/d14/d41/f55 zero size 2023-10-18T20:58:23.895 INFO:tasks.workunit.client.1.smithi060.stdout:8/203: rmdir d4/d9 39 2023-10-18T20:58:23.896 INFO:tasks.workunit.client.0.smithi008.stdout:7/235: dread d1/f29 [0,4194304] 0 2023-10-18T20:58:23.897 INFO:tasks.workunit.client.0.smithi008.stdout:5/170: dread d0/d2/f7 [0,4194304] 0 2023-10-18T20:58:23.897 INFO:tasks.workunit.client.0.smithi008.stdout:3/193: dwrite d0/d3/d15/f23 [0,4194304] 0 2023-10-18T20:58:23.897 INFO:tasks.workunit.client.0.smithi008.stdout:5/171: truncate d0/f25 702577 0 2023-10-18T20:58:23.897 INFO:tasks.workunit.client.0.smithi008.stdout:3/194: readlink d0/d3/de/d13/l26 0 2023-10-18T20:58:23.898 INFO:tasks.workunit.client.0.smithi008.stdout:5/172: creat d0/d2/d9/d34/f3b x:0 0 0 2023-10-18T20:58:23.898 INFO:tasks.workunit.client.1.smithi060.stdout:6/157: dwrite d10/d17/d28/f21 [4194304,4194304] 0 2023-10-18T20:58:23.898 INFO:tasks.workunit.client.1.smithi060.stdout:0/211: dwrite d3/d8/f10 [0,4194304] 0 2023-10-18T20:58:23.899 INFO:tasks.workunit.client.0.smithi008.stdout:1/368: creat d9/de/df/d17/d1e/f71 x:0 0 0 2023-10-18T20:58:23.901 INFO:tasks.workunit.client.0.smithi008.stdout:2/220: symlink d1/d3/dd/d1c/d3a/l4e 0 2023-10-18T20:58:23.902 INFO:tasks.workunit.client.0.smithi008.stdout:2/221: chown d1/d3/dd/d1c/d39/f3f 96791 1 2023-10-18T20:58:23.902 INFO:tasks.workunit.client.0.smithi008.stdout:2/222: write d1/d3/f20 [199282,38444] 0 2023-10-18T20:58:23.904 INFO:tasks.workunit.client.0.smithi008.stdout:8/353: mknod d5/d8/d24/d50/d53/c90 0 2023-10-18T20:58:23.905 INFO:tasks.workunit.client.0.smithi008.stdout:2/223: write d1/d3/dd/d25/f2f [1121611,114747] 0 2023-10-18T20:58:23.905 INFO:tasks.workunit.client.0.smithi008.stdout:2/224: creat d1/d3/dd/d1c/d3a/f4f x:0 0 0 2023-10-18T20:58:23.905 INFO:tasks.workunit.client.0.smithi008.stdout:2/225: getdents d1/d3/dd/d1c/d3a/d49 0 2023-10-18T20:58:23.906 INFO:tasks.workunit.client.0.smithi008.stdout:2/226: read d1/d3/dd/d25/d34/f3b [1501806,126120] 0 2023-10-18T20:58:23.906 INFO:tasks.workunit.client.0.smithi008.stdout:2/227: truncate d1/d3/dd/d25/f27 897295 0 2023-10-18T20:58:23.906 INFO:tasks.workunit.client.0.smithi008.stdout:2/228: chown d1/d3/f4b 97 1 2023-10-18T20:58:23.914 INFO:tasks.workunit.client.1.smithi060.stdout:4/164: stat d4/c12 0 2023-10-18T20:58:23.914 INFO:tasks.workunit.client.1.smithi060.stdout:4/165: fsync d4/dc/d2a/d13/f20 0 2023-10-18T20:58:23.915 INFO:tasks.workunit.client.1.smithi060.stdout:4/166: chown d4/dc/d2a/d1d/f21 226633 1 2023-10-18T20:58:23.915 INFO:tasks.workunit.client.1.smithi060.stdout:4/167: chown d4/dc/d2a 0 1 2023-10-18T20:58:23.918 INFO:tasks.workunit.client.0.smithi008.stdout:6/250: dwrite df/d19/f3e [0,4194304] 0 2023-10-18T20:58:23.918 INFO:tasks.workunit.client.1.smithi060.stdout:9/189: mknod d3/d10/c45 0 2023-10-18T20:58:23.919 INFO:tasks.workunit.client.0.smithi008.stdout:0/182: write d0/dd/df/d2a/f33 [422678,117326] 0 2023-10-18T20:58:23.919 INFO:tasks.workunit.client.0.smithi008.stdout:0/183: creat d0/dd/d19/d24/f35 x:0 0 0 2023-10-18T20:58:23.921 INFO:tasks.workunit.client.1.smithi060.stdout:1/263: getdents d4/da/de/d2a/d32 0 2023-10-18T20:58:23.921 INFO:tasks.workunit.client.1.smithi060.stdout:1/264: chown d4/d6/l2e 41944335 1 2023-10-18T20:58:23.923 INFO:tasks.workunit.client.0.smithi008.stdout:3/195: rename d0/d3/de/d13/l18 to d0/d2c/l38 0 2023-10-18T20:58:23.927 INFO:tasks.workunit.client.0.smithi008.stdout:5/173: symlink d0/d2/d9/d34/l3c 0 2023-10-18T20:58:23.928 INFO:tasks.workunit.client.0.smithi008.stdout:1/369: rmdir d9/de/df/d17/d25 39 2023-10-18T20:58:23.931 INFO:tasks.workunit.client.0.smithi008.stdout:8/354: symlink d5/d8/d17/d6c/l91 0 2023-10-18T20:58:23.932 INFO:tasks.workunit.client.1.smithi060.stdout:4/168: dread d4/dc/d2a/f1e [0,4194304] 0 2023-10-18T20:58:23.935 INFO:tasks.workunit.client.0.smithi008.stdout:9/215: sync 2023-10-18T20:58:23.937 INFO:tasks.workunit.client.1.smithi060.stdout:6/158: symlink d10/d25/l36 0 2023-10-18T20:58:23.937 INFO:tasks.workunit.client.1.smithi060.stdout:5/258: getdents d0/d6/d8 0 2023-10-18T20:58:23.937 INFO:tasks.workunit.client.1.smithi060.stdout:5/259: creat d0/dd/d33/f66 x:0 0 0 2023-10-18T20:58:23.938 INFO:tasks.workunit.client.0.smithi008.stdout:7/236: dwrite d1/d36/d3d/d49/f4a [0,4194304] 0 2023-10-18T20:58:23.939 INFO:tasks.workunit.client.0.smithi008.stdout:4/235: link d0/d17/c25 d0/d3/d21/c55 0 2023-10-18T20:58:23.940 INFO:tasks.workunit.client.0.smithi008.stdout:2/229: truncate d1/d3/dd/d1c/f28 3407947 0 2023-10-18T20:58:23.941 INFO:tasks.workunit.client.0.smithi008.stdout:2/230: stat d1/d3/dd/d1c/l23 0 2023-10-18T20:58:23.941 INFO:tasks.workunit.client.0.smithi008.stdout:2/231: chown d1/c37 1 1 2023-10-18T20:58:23.941 INFO:tasks.workunit.client.0.smithi008.stdout:2/232: stat d1/d3 0 2023-10-18T20:58:23.941 INFO:tasks.workunit.client.0.smithi008.stdout:2/233: chown d1/d3/dd/d1c/d3a/d45 1149549 1 2023-10-18T20:58:23.957 INFO:tasks.workunit.client.0.smithi008.stdout:0/184: symlink d0/dd/df/d20/l36 0 2023-10-18T20:58:23.960 INFO:tasks.workunit.client.0.smithi008.stdout:5/174: rename d0/d2/l3a to d0/d2/d19/d1b/d31/l3d 0 2023-10-18T20:58:23.963 INFO:tasks.workunit.client.0.smithi008.stdout:1/370: symlink d9/de/df/d17/d1e/d3c/l72 0 2023-10-18T20:58:23.963 INFO:tasks.workunit.client.0.smithi008.stdout:1/371: readlink d9/de/df/d17/l6b 0 2023-10-18T20:58:23.969 INFO:tasks.workunit.client.0.smithi008.stdout:8/355: rmdir d5/d8/d24/d77/d84 0 2023-10-18T20:58:23.970 INFO:tasks.workunit.client.1.smithi060.stdout:9/190: dwrite d3/d10/d1c/d2a/f36 [0,4194304] 0 2023-10-18T20:58:23.970 INFO:tasks.workunit.client.1.smithi060.stdout:8/204: creat d4/d9/d37/f38 x:0 0 0 2023-10-18T20:58:23.977 INFO:tasks.workunit.client.0.smithi008.stdout:4/236: symlink d0/d3/d8/d45/l56 0 2023-10-18T20:58:23.977 INFO:tasks.workunit.client.0.smithi008.stdout:2/234: creat d1/d3/dd/f50 x:0 0 0 2023-10-18T20:58:23.980 INFO:tasks.workunit.client.0.smithi008.stdout:6/251: getdents df/d26 0 2023-10-18T20:58:23.982 INFO:tasks.workunit.client.0.smithi008.stdout:0/185: mknod d0/c37 0 2023-10-18T20:58:23.982 INFO:tasks.workunit.client.0.smithi008.stdout:0/186: fsync d0/dd/d19/d24/f2b 0 2023-10-18T20:58:23.988 INFO:tasks.workunit.client.1.smithi060.stdout:4/169: unlink d4/c9 0 2023-10-18T20:58:23.989 INFO:tasks.workunit.client.0.smithi008.stdout:8/356: getdents d5/d8/df/d6f 0 2023-10-18T20:58:23.990 INFO:tasks.workunit.client.0.smithi008.stdout:5/175: mknod d0/c3e 0 2023-10-18T20:58:23.990 INFO:tasks.workunit.client.0.smithi008.stdout:5/176: chown d0/d2/d9/d34/f3b 103240193 1 2023-10-18T20:58:23.991 INFO:tasks.workunit.client.0.smithi008.stdout:5/177: fsync d0/d2/d9/f24 0 2023-10-18T20:58:23.991 INFO:tasks.workunit.client.0.smithi008.stdout:4/237: mkdir d0/d3/d21/d57 0 2023-10-18T20:58:23.991 INFO:tasks.workunit.client.0.smithi008.stdout:4/238: stat d0/d3/f37 0 2023-10-18T20:58:23.991 INFO:tasks.workunit.client.0.smithi008.stdout:5/178: truncate d0/d2/d19/f2f 622877 0 2023-10-18T20:58:23.992 INFO:tasks.workunit.client.1.smithi060.stdout:6/159: symlink d10/d17/d2f/l37 0 2023-10-18T20:58:23.992 INFO:tasks.workunit.client.1.smithi060.stdout:6/160: fdatasync d10/d1b/f2b 0 2023-10-18T20:58:23.994 INFO:tasks.workunit.client.0.smithi008.stdout:2/235: unlink d1/d3/f20 0 2023-10-18T20:58:23.998 INFO:tasks.workunit.client.1.smithi060.stdout:5/260: mkdir d0/dd/d33/d67 0 2023-10-18T20:58:23.998 INFO:tasks.workunit.client.1.smithi060.stdout:3/191: rename d0/d2f to d0/d3c/d3d 0 2023-10-18T20:58:24.000 INFO:tasks.workunit.client.0.smithi008.stdout:4/239: truncate d0/d3/d21/f3e 4171617 0 2023-10-18T20:58:24.001 INFO:tasks.workunit.client.1.smithi060.stdout:8/205: write d4/d9/fa [3936422,28055] 0 2023-10-18T20:58:24.001 INFO:tasks.workunit.client.1.smithi060.stdout:1/265: dwrite f1 [0,4194304] 0 2023-10-18T20:58:24.002 INFO:tasks.workunit.client.0.smithi008.stdout:5/179: mkdir d0/d2/d19/d1b/d31/d3f 0 2023-10-18T20:58:24.003 INFO:tasks.workunit.client.1.smithi060.stdout:9/191: unlink d3/d10/d1c/f21 0 2023-10-18T20:58:24.004 INFO:tasks.workunit.client.1.smithi060.stdout:6/161: rmdir d10/d2e/d34 0 2023-10-18T20:58:24.004 INFO:tasks.workunit.client.1.smithi060.stdout:6/162: chown d10/f35 8172 1 2023-10-18T20:58:24.005 INFO:tasks.workunit.client.0.smithi008.stdout:2/236: mknod d1/d3/dd/d1c/d3a/d49/c51 0 2023-10-18T20:58:24.006 INFO:tasks.workunit.client.1.smithi060.stdout:3/192: creat d0/d3c/d3d/f3e x:0 0 0 2023-10-18T20:58:24.007 INFO:tasks.workunit.client.1.smithi060.stdout:3/193: write d0/d22/f36 [5443,74454] 0 2023-10-18T20:58:24.007 INFO:tasks.workunit.client.1.smithi060.stdout:3/194: unlink d0/f19 0 2023-10-18T20:58:24.009 INFO:tasks.workunit.client.1.smithi060.stdout:2/218: rename d0/d16/f25 to d0/d3/d2a/f3f 0 2023-10-18T20:58:24.009 INFO:tasks.workunit.client.0.smithi008.stdout:1/372: dwrite d9/f54 [0,4194304] 0 2023-10-18T20:58:24.011 INFO:tasks.workunit.client.0.smithi008.stdout:8/357: dread d5/d8/df/d54/f83 [0,4194304] 0 2023-10-18T20:58:24.012 INFO:tasks.workunit.client.1.smithi060.stdout:4/170: dread d4/dc/d2a/f1f [0,4194304] 0 2023-10-18T20:58:24.012 INFO:tasks.workunit.client.1.smithi060.stdout:4/171: read - d4/dc/d2a/d13/f2c zero size 2023-10-18T20:58:24.018 INFO:tasks.workunit.client.0.smithi008.stdout:3/196: dwrite d0/d3/d15/f1a [0,4194304] 0 2023-10-18T20:58:24.018 INFO:tasks.workunit.client.0.smithi008.stdout:9/216: dread d2/dc/d17/d19/fe [0,4194304] 0 2023-10-18T20:58:24.018 INFO:tasks.workunit.client.0.smithi008.stdout:9/217: chown d2/dc/d1a/f21 4160555 1 2023-10-18T20:58:24.021 INFO:tasks.workunit.client.0.smithi008.stdout:6/252: rmdir df/d15/d27 39 2023-10-18T20:58:24.021 INFO:tasks.workunit.client.1.smithi060.stdout:4/172: dread d4/dc/f29 [0,4194304] 0 2023-10-18T20:58:24.031 INFO:tasks.workunit.client.1.smithi060.stdout:4/173: dread d4/dc/d2a/f1e [0,4194304] 0 2023-10-18T20:58:24.035 INFO:tasks.workunit.client.1.smithi060.stdout:0/212: sync 2023-10-18T20:58:24.035 INFO:tasks.workunit.client.0.smithi008.stdout:7/237: dwrite d1/d3/fc [0,4194304] 0 2023-10-18T20:58:24.036 INFO:tasks.workunit.client.1.smithi060.stdout:8/206: chown d4/f19 2851 1 2023-10-18T20:58:24.038 INFO:tasks.workunit.client.1.smithi060.stdout:1/266: mknod d4/d6/d7/d35/c5d 0 2023-10-18T20:58:24.038 INFO:tasks.workunit.client.1.smithi060.stdout:1/267: fsync d4/da/de/d2a/d32/dd/f3f 0 2023-10-18T20:58:24.040 INFO:tasks.workunit.client.0.smithi008.stdout:0/187: rmdir d0/dd/d19 39 2023-10-18T20:58:24.040 INFO:tasks.workunit.client.0.smithi008.stdout:5/180: mknod d0/c40 0 2023-10-18T20:58:24.041 INFO:tasks.workunit.client.1.smithi060.stdout:5/261: dwrite d0/dd/f5b [0,4194304] 0 2023-10-18T20:58:24.041 INFO:tasks.workunit.client.1.smithi060.stdout:9/192: mknod d3/c46 0 2023-10-18T20:58:24.042 INFO:tasks.workunit.client.0.smithi008.stdout:2/237: symlink d1/d3/dd/d1c/l52 0 2023-10-18T20:58:24.043 INFO:tasks.workunit.client.0.smithi008.stdout:2/238: chown d1/l15 1932 1 2023-10-18T20:58:24.043 INFO:tasks.workunit.client.0.smithi008.stdout:2/239: chown d1/d3/d40/c41 676 1 2023-10-18T20:58:24.043 INFO:tasks.workunit.client.0.smithi008.stdout:2/240: write d1/d3/dd/d25/d34/f3b [4158374,78102] 0 2023-10-18T20:58:24.043 INFO:tasks.workunit.client.0.smithi008.stdout:2/241: stat d1/d3/f1b 0 2023-10-18T20:58:24.044 INFO:tasks.workunit.client.1.smithi060.stdout:6/163: mknod d10/c38 0 2023-10-18T20:58:24.044 INFO:tasks.workunit.client.1.smithi060.stdout:6/164: readlink d10/d17/d2f/l37 0 2023-10-18T20:58:24.047 INFO:tasks.workunit.client.0.smithi008.stdout:1/373: symlink d9/de/df/l73 0 2023-10-18T20:58:24.050 INFO:tasks.workunit.client.0.smithi008.stdout:3/197: mknod d0/d3/c39 0 2023-10-18T20:58:24.051 INFO:tasks.workunit.client.0.smithi008.stdout:3/198: readlink d0/d2c/l2f 0 2023-10-18T20:58:24.051 INFO:tasks.workunit.client.0.smithi008.stdout:3/199: creat d0/d3/de/d13/f3a x:0 0 0 2023-10-18T20:58:24.054 INFO:tasks.workunit.client.0.smithi008.stdout:6/253: mknod df/d15/d27/c54 0 2023-10-18T20:58:24.055 INFO:tasks.workunit.client.0.smithi008.stdout:6/254: write df/d19/f1c [1901444,8522] 0 2023-10-18T20:58:24.056 INFO:tasks.workunit.client.1.smithi060.stdout:7/210: rename de/c3d to de/d38/c45 0 2023-10-18T20:58:24.057 INFO:tasks.workunit.client.1.smithi060.stdout:4/174: symlink d4/dc/d2a/d13/d27/l32 0 2023-10-18T20:58:24.060 INFO:tasks.workunit.client.0.smithi008.stdout:7/238: mkdir d1/d36/d3b/d4f 0 2023-10-18T20:58:24.060 INFO:tasks.workunit.client.0.smithi008.stdout:7/239: readlink d1/d3/l40 0 2023-10-18T20:58:24.061 INFO:tasks.workunit.client.0.smithi008.stdout:7/240: write d1/d3/f17 [4564658,122466] 0 2023-10-18T20:58:24.062 INFO:tasks.workunit.client.0.smithi008.stdout:4/240: getdents d0/d3 0 2023-10-18T20:58:24.064 INFO:tasks.workunit.client.1.smithi060.stdout:1/268: symlink d4/da/d42/l5e 0 2023-10-18T20:58:24.064 INFO:tasks.workunit.client.1.smithi060.stdout:1/269: truncate d4/da/f5a 579782 0 2023-10-18T20:58:24.064 INFO:tasks.workunit.client.1.smithi060.stdout:1/270: readlink d4/d6/l2e 0 2023-10-18T20:58:24.065 INFO:tasks.workunit.client.1.smithi060.stdout:1/271: stat d4/da/de/d2a/f46 0 2023-10-18T20:58:24.065 INFO:tasks.workunit.client.0.smithi008.stdout:5/181: getdents d0/de 0 2023-10-18T20:58:24.065 INFO:tasks.workunit.client.0.smithi008.stdout:5/182: dread - d0/d2/d9/d34/f37 zero size 2023-10-18T20:58:24.067 INFO:tasks.workunit.client.0.smithi008.stdout:0/188: creat d0/dd/df/d2a/f38 x:0 0 0 2023-10-18T20:58:24.067 INFO:tasks.workunit.client.0.smithi008.stdout:0/189: write d0/dd/f18 [239692,101026] 0 2023-10-18T20:58:24.067 INFO:tasks.workunit.client.0.smithi008.stdout:0/190: creat d0/dd/d29/f39 x:0 0 0 2023-10-18T20:58:24.068 INFO:tasks.workunit.client.1.smithi060.stdout:5/262: creat d0/d6/d8/df/d27/d32/d4f/f68 x:0 0 0 2023-10-18T20:58:24.068 INFO:tasks.workunit.client.1.smithi060.stdout:5/263: stat d0/dd/d33/f3d 0 2023-10-18T20:58:24.072 INFO:tasks.workunit.client.1.smithi060.stdout:9/193: link d3/d10/d1c/f1d d3/d10/d1c/f47 0 2023-10-18T20:58:24.074 INFO:tasks.workunit.client.1.smithi060.stdout:2/219: rename d0/c6 to d0/d8/c40 0 2023-10-18T20:58:24.076 INFO:tasks.workunit.client.1.smithi060.stdout:4/175: mkdir d4/dc/d2a/d13/d33 0 2023-10-18T20:58:24.076 INFO:tasks.workunit.client.1.smithi060.stdout:4/176: write d4/dc/d2a/f7 [3047017,81888] 0 2023-10-18T20:58:24.076 INFO:tasks.workunit.client.1.smithi060.stdout:4/177: write d4/dc/d2a/f7 [3377637,58076] 0 2023-10-18T20:58:24.080 INFO:tasks.workunit.client.0.smithi008.stdout:1/374: symlink d9/de/df/d17/d1e/l74 0 2023-10-18T20:58:24.081 INFO:tasks.workunit.client.0.smithi008.stdout:8/358: rmdir d5/d8/d24/d50 39 2023-10-18T20:58:24.081 INFO:tasks.workunit.client.0.smithi008.stdout:9/218: dwrite d2/f5 [0,4194304] 0 2023-10-18T20:58:24.085 INFO:tasks.workunit.client.0.smithi008.stdout:6/255: link df/d15/f40 df/d15/d33/d50/f55 0 2023-10-18T20:58:24.085 INFO:tasks.workunit.client.1.smithi060.stdout:5/264: creat d0/d47/f69 x:0 0 0 2023-10-18T20:58:24.086 INFO:tasks.workunit.client.0.smithi008.stdout:7/241: creat d1/d36/d3b/f50 x:0 0 0 2023-10-18T20:58:24.088 INFO:tasks.workunit.client.0.smithi008.stdout:9/219: dread d2/dc/f22 [0,4194304] 0 2023-10-18T20:58:24.092 INFO:tasks.workunit.client.0.smithi008.stdout:4/241: mkdir d0/d58 0 2023-10-18T20:58:24.096 INFO:tasks.workunit.client.0.smithi008.stdout:5/183: mkdir d0/d2/d19/d1b/d41 0 2023-10-18T20:58:24.096 INFO:tasks.workunit.client.0.smithi008.stdout:5/184: read - d0/d2/d19/d1b/f27 zero size 2023-10-18T20:58:24.101 INFO:tasks.workunit.client.1.smithi060.stdout:9/194: mkdir d3/d10/d19/d48 0 2023-10-18T20:58:24.101 INFO:tasks.workunit.client.1.smithi060.stdout:2/220: unlink d0/d3/d2a/f3c 0 2023-10-18T20:58:24.101 INFO:tasks.workunit.client.1.smithi060.stdout:2/221: readlink d0/d8/l2d 0 2023-10-18T20:58:24.102 INFO:tasks.workunit.client.0.smithi008.stdout:0/191: mkdir d0/d3a 0 2023-10-18T20:58:24.103 INFO:tasks.workunit.client.1.smithi060.stdout:4/178: rmdir d4/dc/d2a/d13/d27 39 2023-10-18T20:58:24.106 INFO:tasks.workunit.client.1.smithi060.stdout:5/265: creat d0/d6/f6a x:0 0 0 2023-10-18T20:58:24.107 INFO:tasks.workunit.client.1.smithi060.stdout:8/207: dwrite d4/f13 [0,4194304] 0 2023-10-18T20:58:24.108 INFO:tasks.workunit.client.1.smithi060.stdout:8/208: write d4/d9/f21 [892230,110211] 0 2023-10-18T20:58:24.108 INFO:tasks.workunit.client.1.smithi060.stdout:8/209: truncate d4/f30 777685 0 2023-10-18T20:58:24.109 INFO:tasks.workunit.client.0.smithi008.stdout:1/375: write d9/de/df/d17/d1e/f62 [3765843,5224] 0 2023-10-18T20:58:24.112 INFO:tasks.workunit.client.0.smithi008.stdout:8/359: creat d5/d8/d24/d50/d8d/f92 x:0 0 0 2023-10-18T20:58:24.113 INFO:tasks.workunit.client.0.smithi008.stdout:9/220: write d2/f5 [3366864,79773] 0 2023-10-18T20:58:24.114 INFO:tasks.workunit.client.1.smithi060.stdout:4/179: dread d4/f10 [4194304,4194304] 0 2023-10-18T20:58:24.114 INFO:tasks.workunit.client.1.smithi060.stdout:4/180: getdents d4/dc/d2a/d1d 0 2023-10-18T20:58:24.115 INFO:tasks.workunit.client.0.smithi008.stdout:2/242: dwrite d1/d3/dd/f38 [0,4194304] 0 2023-10-18T20:58:24.115 INFO:tasks.workunit.client.0.smithi008.stdout:2/243: fdatasync d1/f18 0 2023-10-18T20:58:24.116 INFO:tasks.workunit.client.1.smithi060.stdout:9/195: rmdir d3/d10/d19/d48 0 2023-10-18T20:58:24.127 INFO:tasks.workunit.client.0.smithi008.stdout:3/200: rmdir d0 39 2023-10-18T20:58:24.134 INFO:tasks.workunit.client.1.smithi060.stdout:2/222: unlink d0/d3/f17 0 2023-10-18T20:58:24.134 INFO:tasks.workunit.client.1.smithi060.stdout:5/266: creat d0/d6/d8/f6b x:0 0 0 2023-10-18T20:58:24.134 INFO:tasks.workunit.client.1.smithi060.stdout:5/267: truncate d0/dd/d33/f66 924847 0 2023-10-18T20:58:24.134 INFO:tasks.workunit.client.1.smithi060.stdout:5/268: truncate d0/d6/f6a 340015 0 2023-10-18T20:58:24.135 INFO:tasks.workunit.client.1.smithi060.stdout:8/210: symlink d4/d9/d37/l39 0 2023-10-18T20:58:24.137 INFO:tasks.workunit.client.0.smithi008.stdout:6/256: symlink df/d18/d3f/l56 0 2023-10-18T20:58:24.139 INFO:tasks.workunit.client.1.smithi060.stdout:0/213: rename d3/d32/d35 to d3/d8/d14/d49 0 2023-10-18T20:58:24.140 INFO:tasks.workunit.client.1.smithi060.stdout:0/214: readlink d3/l15 0 2023-10-18T20:58:24.140 INFO:tasks.workunit.client.0.smithi008.stdout:3/201: dread d0/d3/f31 [0,4194304] 0 2023-10-18T20:58:24.141 INFO:tasks.workunit.client.1.smithi060.stdout:4/181: rmdir d4/dc/d2a/d13/d27 39 2023-10-18T20:58:24.144 INFO:tasks.workunit.client.0.smithi008.stdout:7/242: truncate d1/d36/d3d/f41 337538 0 2023-10-18T20:58:24.144 INFO:tasks.workunit.client.0.smithi008.stdout:4/242: symlink d0/d3/d48/d4c/l59 0 2023-10-18T20:58:24.144 INFO:tasks.workunit.client.0.smithi008.stdout:7/243: read d1/f4 [3022238,20580] 0 2023-10-18T20:58:24.145 INFO:tasks.workunit.client.0.smithi008.stdout:4/243: write d0/d3/d8/d2a/f3c [393335,21638] 0 2023-10-18T20:58:24.147 INFO:tasks.workunit.client.1.smithi060.stdout:2/223: creat d0/d16/f41 x:0 0 0 2023-10-18T20:58:24.152 INFO:tasks.workunit.client.0.smithi008.stdout:5/185: mkdir d0/d2/d19/d1b/d42 0 2023-10-18T20:58:24.153 INFO:tasks.workunit.client.1.smithi060.stdout:7/211: rename de/d14/d2f/d3f/d42 to de/d14/d3a/d46 0 2023-10-18T20:58:24.153 INFO:tasks.workunit.client.1.smithi060.stdout:9/196: dwrite d3/d10/d1c/d2a/f32 [0,4194304] 0 2023-10-18T20:58:24.153 INFO:tasks.workunit.client.1.smithi060.stdout:9/197: unlink d3/d10/d19/f1f 0 2023-10-18T20:58:24.154 INFO:tasks.workunit.client.1.smithi060.stdout:9/198: creat d3/d10/d1c/d2a/d33/d29/d2b/f49 x:0 0 0 2023-10-18T20:58:24.154 INFO:tasks.workunit.client.0.smithi008.stdout:5/186: read d0/f29 [710062,54592] 0 2023-10-18T20:58:24.155 INFO:tasks.workunit.client.0.smithi008.stdout:5/187: chown d0/d2/d9 450 1 2023-10-18T20:58:24.155 INFO:tasks.workunit.client.1.smithi060.stdout:2/224: read d0/d8/f2b [695618,46058] 0 2023-10-18T20:58:24.155 INFO:tasks.workunit.client.1.smithi060.stdout:2/225: truncate d0/d16/f41 44667 0 2023-10-18T20:58:24.156 INFO:tasks.workunit.client.1.smithi060.stdout:0/215: symlink d3/d8/d3c/l4a 0 2023-10-18T20:58:24.157 INFO:tasks.workunit.client.0.smithi008.stdout:1/376: unlink d9/de/c19 0 2023-10-18T20:58:24.157 INFO:tasks.workunit.client.0.smithi008.stdout:1/377: stat d9/de/df/d17/c18 0 2023-10-18T20:58:24.157 INFO:tasks.workunit.client.1.smithi060.stdout:4/182: creat d4/dc/d2a/d13/d2f/f34 x:0 0 0 2023-10-18T20:58:24.158 INFO:tasks.workunit.client.0.smithi008.stdout:8/360: mknod d5/d8/df/d54/c93 0 2023-10-18T20:58:24.161 INFO:tasks.workunit.client.0.smithi008.stdout:2/244: symlink d1/d3/dd/d25/l53 0 2023-10-18T20:58:24.163 INFO:tasks.workunit.client.0.smithi008.stdout:6/257: truncate df/d15/f40 1466972 0 2023-10-18T20:58:24.164 INFO:tasks.workunit.client.0.smithi008.stdout:6/258: chown df/d15/f40 23826 1 2023-10-18T20:58:24.171 INFO:tasks.workunit.client.0.smithi008.stdout:7/244: creat d1/d36/d3b/d4f/f51 x:0 0 0 2023-10-18T20:58:24.171 INFO:tasks.workunit.client.0.smithi008.stdout:3/202: creat d0/d3/de/d13/d35/f3b x:0 0 0 2023-10-18T20:58:24.174 INFO:tasks.workunit.client.0.smithi008.stdout:9/221: dwrite d2/dc/d1a/d1d/f37 [0,4194304] 0 2023-10-18T20:58:24.174 INFO:tasks.workunit.client.1.smithi060.stdout:4/183: dread d4/dc/d2a/f7 [0,4194304] 0 2023-10-18T20:58:24.178 INFO:tasks.workunit.client.0.smithi008.stdout:5/188: dread d0/d2/d9/f11 [0,4194304] 0 2023-10-18T20:58:24.187 INFO:tasks.workunit.client.0.smithi008.stdout:4/244: rename d0/d3/f37 to d0/d3/d21/f5a 0 2023-10-18T20:58:24.187 INFO:tasks.workunit.client.0.smithi008.stdout:1/378: symlink d9/l75 0 2023-10-18T20:58:24.187 INFO:tasks.workunit.client.0.smithi008.stdout:1/379: readlink d9/de/df/d17/l34 0 2023-10-18T20:58:24.188 INFO:tasks.workunit.client.1.smithi060.stdout:3/195: sync 2023-10-18T20:58:24.192 INFO:tasks.workunit.client.0.smithi008.stdout:2/245: unlink d1/d3/dd/d1c/d3a/f4f 0 2023-10-18T20:58:24.196 INFO:tasks.workunit.client.0.smithi008.stdout:6/259: mknod df/d13/c57 0 2023-10-18T20:58:24.196 INFO:tasks.workunit.client.0.smithi008.stdout:3/203: dread d0/d3/d15/f1a [0,4194304] 0 2023-10-18T20:58:24.196 INFO:tasks.workunit.client.0.smithi008.stdout:3/204: chown d0/d3/de/f20 19383 1 2023-10-18T20:58:24.196 INFO:tasks.workunit.client.0.smithi008.stdout:3/205: dread - d0/d3/de/d13/f24 zero size 2023-10-18T20:58:24.206 INFO:tasks.workunit.client.1.smithi060.stdout:1/272: rename d4/da/de/d2a/d32/d51 to d4/da/de/d2a/d32/d56/d5f 0 2023-10-18T20:58:24.207 INFO:tasks.workunit.client.1.smithi060.stdout:7/212: mknod de/c47 0 2023-10-18T20:58:24.207 INFO:tasks.workunit.client.0.smithi008.stdout:7/245: mknod d1/d3/c52 0 2023-10-18T20:58:24.208 INFO:tasks.workunit.client.0.smithi008.stdout:1/380: symlink d9/de/df/d17/d25/d57/l76 0 2023-10-18T20:58:24.208 INFO:tasks.workunit.client.0.smithi008.stdout:8/361: rename d5/d8/df/d6f/l7a to d5/d8/d17/d85/l94 0 2023-10-18T20:58:24.208 INFO:tasks.workunit.client.0.smithi008.stdout:5/189: rename d0 to d0/d43 22 2023-10-18T20:58:24.208 INFO:tasks.workunit.client.0.smithi008.stdout:8/362: fdatasync d5/d8/f12 0 2023-10-18T20:58:24.209 INFO:tasks.workunit.client.1.smithi060.stdout:9/199: creat d3/d10/d1c/d2a/d41/f4a x:0 0 0 2023-10-18T20:58:24.211 INFO:tasks.workunit.client.1.smithi060.stdout:5/269: dwrite d0/d6/db/f40 [0,4194304] 0 2023-10-18T20:58:24.215 INFO:tasks.workunit.client.1.smithi060.stdout:0/216: dwrite d3/d8/f10 [0,4194304] 0 2023-10-18T20:58:24.218 INFO:tasks.workunit.client.0.smithi008.stdout:3/206: symlink d0/d3/de/d13/l3c 0 2023-10-18T20:58:24.219 INFO:tasks.workunit.client.0.smithi008.stdout:3/207: readlink d0/d3/de/d13/l3c 0 2023-10-18T20:58:24.219 INFO:tasks.workunit.client.0.smithi008.stdout:3/208: truncate d0/d3/de/d13/f24 891163 0 2023-10-18T20:58:24.220 INFO:tasks.workunit.client.1.smithi060.stdout:7/213: mknod de/d14/d3a/c48 0 2023-10-18T20:58:24.220 INFO:tasks.workunit.client.0.smithi008.stdout:2/246: unlink d1/d3/dd/d1c/l52 0 2023-10-18T20:58:24.220 INFO:tasks.workunit.client.0.smithi008.stdout:2/247: getdents d1/d3/dd/d25/d4d 0 2023-10-18T20:58:24.221 INFO:tasks.workunit.client.0.smithi008.stdout:2/248: stat d1/d3/dd/f38 0 2023-10-18T20:58:24.221 INFO:tasks.workunit.client.0.smithi008.stdout:6/260: getdents df/d15/d27/d38 0 2023-10-18T20:58:24.222 INFO:tasks.workunit.client.1.smithi060.stdout:9/200: dread d3/d10/f18 [0,4194304] 0 2023-10-18T20:58:24.222 INFO:tasks.workunit.client.1.smithi060.stdout:9/201: readlink d3/d10/d19/l3d 0 2023-10-18T20:58:24.222 INFO:tasks.workunit.client.0.smithi008.stdout:6/261: write df/d15/d27/d38/f39 [90157,111062] 0 2023-10-18T20:58:24.223 INFO:tasks.workunit.client.0.smithi008.stdout:1/381: mkdir d9/de/df/d77 0 2023-10-18T20:58:24.225 INFO:tasks.workunit.client.0.smithi008.stdout:8/363: unlink d5/d8/df/d2e/f60 0 2023-10-18T20:58:24.226 INFO:tasks.workunit.client.0.smithi008.stdout:8/364: readlink d5/d8/d17/l8b 0 2023-10-18T20:58:24.226 INFO:tasks.workunit.client.0.smithi008.stdout:8/365: readlink d5/d8/d24/l40 0 2023-10-18T20:58:24.227 INFO:tasks.workunit.client.1.smithi060.stdout:3/196: mknod d0/d3c/d3d/c3f 0 2023-10-18T20:58:24.231 INFO:tasks.workunit.client.1.smithi060.stdout:7/214: read de/d14/f2d [693803,58252] 0 2023-10-18T20:58:24.231 INFO:tasks.workunit.client.1.smithi060.stdout:7/215: chown de/d14/d2f/f3e 64455980 1 2023-10-18T20:58:24.232 INFO:tasks.workunit.client.0.smithi008.stdout:3/209: symlink d0/d3/d37/l3d 0 2023-10-18T20:58:24.234 INFO:tasks.workunit.client.0.smithi008.stdout:2/249: creat d1/d3/d40/f54 x:0 0 0 2023-10-18T20:58:24.235 INFO:tasks.workunit.client.0.smithi008.stdout:2/250: fdatasync d1/d3/dd/d25/d34/f3b 0 2023-10-18T20:58:24.235 INFO:tasks.workunit.client.1.smithi060.stdout:0/217: dread d3/f33 [0,4194304] 0 2023-10-18T20:58:24.238 INFO:tasks.workunit.client.1.smithi060.stdout:8/211: rename d4/f14 to d4/d9/d31/d35/f3a 0 2023-10-18T20:58:24.238 INFO:tasks.workunit.client.1.smithi060.stdout:9/202: creat d3/d10/d1c/d25/f4b x:0 0 0 2023-10-18T20:58:24.238 INFO:tasks.workunit.client.1.smithi060.stdout:9/203: chown d3/d10/d1c/d2a/d33/d29/d2b/l37 0 1 2023-10-18T20:58:24.239 INFO:tasks.workunit.client.0.smithi008.stdout:8/366: dread d5/d8/d17/f1d [0,4194304] 0 2023-10-18T20:58:24.239 INFO:tasks.workunit.client.0.smithi008.stdout:8/367: readlink d5/d8/d17/l8b 0 2023-10-18T20:58:24.241 INFO:tasks.workunit.client.1.smithi060.stdout:5/270: write d0/dd/f5b [2520737,91073] 0 2023-10-18T20:58:24.242 INFO:tasks.workunit.client.1.smithi060.stdout:1/273: write d4/d6/d7/f26 [359374,27868] 0 2023-10-18T20:58:24.242 INFO:tasks.workunit.client.1.smithi060.stdout:1/274: readlink d4/d6/d14/d41/l4d 0 2023-10-18T20:58:24.242 INFO:tasks.workunit.client.1.smithi060.stdout:1/275: dread - d4/da/f5b zero size 2023-10-18T20:58:24.243 INFO:tasks.workunit.client.0.smithi008.stdout:9/222: dwrite d2/dc/d17/f16 [0,4194304] 0 2023-10-18T20:58:24.243 INFO:tasks.workunit.client.1.smithi060.stdout:6/165: sync 2023-10-18T20:58:24.244 INFO:tasks.workunit.client.1.smithi060.stdout:7/216: mkdir de/d14/d49 0 2023-10-18T20:58:24.247 INFO:tasks.workunit.client.0.smithi008.stdout:6/262: mkdir df/d18/d58 0 2023-10-18T20:58:24.247 INFO:tasks.workunit.client.0.smithi008.stdout:1/382: dread - d9/de/df/d17/f70 zero size 2023-10-18T20:58:24.249 INFO:tasks.workunit.client.0.smithi008.stdout:0/192: truncate d0/dd/f18 256810 0 2023-10-18T20:58:24.249 INFO:tasks.workunit.client.0.smithi008.stdout:0/193: truncate d0/dd/f15 9226 0 2023-10-18T20:58:24.260 INFO:tasks.workunit.client.1.smithi060.stdout:8/212: symlink d4/d9/l3b 0 2023-10-18T20:58:24.264 INFO:tasks.workunit.client.1.smithi060.stdout:1/276: write d4/f2d [1644534,45630] 0 2023-10-18T20:58:24.265 INFO:tasks.workunit.client.1.smithi060.stdout:5/271: symlink d0/dd/l6c 0 2023-10-18T20:58:24.265 INFO:tasks.workunit.client.1.smithi060.stdout:1/277: write d4/d6/d48/f4b [379403,39664] 0 2023-10-18T20:58:24.265 INFO:tasks.workunit.client.1.smithi060.stdout:5/272: write d0/d6/f55 [867608,6868] 0 2023-10-18T20:58:24.265 INFO:tasks.workunit.client.1.smithi060.stdout:1/278: truncate d4/d6/d7/df/f40 202215 0 2023-10-18T20:58:24.265 INFO:tasks.workunit.client.1.smithi060.stdout:5/273: chown d0/da/d3b/d43 5224 1 2023-10-18T20:58:24.266 INFO:tasks.workunit.client.1.smithi060.stdout:1/279: chown d4/da/fc 6102 1 2023-10-18T20:58:24.267 INFO:tasks.workunit.client.0.smithi008.stdout:5/190: dread d0/d2/f7 [4194304,4194304] 0 2023-10-18T20:58:24.267 INFO:tasks.workunit.client.1.smithi060.stdout:4/184: dwrite d4/dc/d2a/f1f [0,4194304] 0 2023-10-18T20:58:24.275 INFO:tasks.workunit.client.0.smithi008.stdout:2/251: dread d1/f18 [0,4194304] 0 2023-10-18T20:58:24.276 INFO:tasks.workunit.client.1.smithi060.stdout:0/218: dread d3/d8/f9 [0,4194304] 0 2023-10-18T20:58:24.277 INFO:tasks.workunit.client.1.smithi060.stdout:0/219: fdatasync d3/d8/f28 0 2023-10-18T20:58:24.278 INFO:tasks.workunit.client.1.smithi060.stdout:6/166: symlink d10/d1b/l39 0 2023-10-18T20:58:24.278 INFO:tasks.workunit.client.1.smithi060.stdout:3/197: rename d0/ff to d0/d3c/f40 0 2023-10-18T20:58:24.278 INFO:tasks.workunit.client.1.smithi060.stdout:6/167: write fd [2872349,56178] 0 2023-10-18T20:58:24.279 INFO:tasks.workunit.client.1.smithi060.stdout:6/168: creat d10/d2e/f3a x:0 0 0 2023-10-18T20:58:24.282 INFO:tasks.workunit.client.1.smithi060.stdout:5/274: mkdir d0/d6/d8/df/d27/d32/d6d 0 2023-10-18T20:58:24.283 INFO:tasks.workunit.client.1.smithi060.stdout:5/275: write d0/d47/f69 [665255,39516] 0 2023-10-18T20:58:24.285 INFO:tasks.workunit.client.0.smithi008.stdout:9/223: symlink d2/d8/l38 0 2023-10-18T20:58:24.287 INFO:tasks.workunit.client.1.smithi060.stdout:0/220: write d3/f26 [981349,88258] 0 2023-10-18T20:58:24.295 INFO:tasks.workunit.client.0.smithi008.stdout:7/246: dwrite d1/d36/d3b/d4f/f51 [0,4194304] 0 2023-10-18T20:58:24.295 INFO:tasks.workunit.client.0.smithi008.stdout:7/247: readlink d1/d3/l40 0 2023-10-18T20:58:24.295 INFO:tasks.workunit.client.0.smithi008.stdout:5/191: rename d0/d2/f12 to d0/d2/d9/f44 0 2023-10-18T20:58:24.296 INFO:tasks.workunit.client.0.smithi008.stdout:5/192: dread - d0/d2/d19/d1b/d20/f36 zero size 2023-10-18T20:58:24.296 INFO:tasks.workunit.client.0.smithi008.stdout:5/193: write d0/d2/d19/f33 [946386,109903] 0 2023-10-18T20:58:24.296 INFO:tasks.workunit.client.0.smithi008.stdout:5/194: read d0/d2/d19/d1b/f26 [1764760,59775] 0 2023-10-18T20:58:24.304 INFO:tasks.workunit.client.0.smithi008.stdout:8/368: getdents d5/d8 0 2023-10-18T20:58:24.305 INFO:tasks.workunit.client.0.smithi008.stdout:3/210: rmdir d0/d3/de/d13/d35 39 2023-10-18T20:58:24.307 INFO:tasks.workunit.client.1.smithi060.stdout:9/204: dwrite d3/d10/f18 [0,4194304] 0 2023-10-18T20:58:24.307 INFO:tasks.workunit.client.1.smithi060.stdout:1/280: dread d4/da/f50 [0,4194304] 0 2023-10-18T20:58:24.311 INFO:tasks.workunit.client.0.smithi008.stdout:8/369: write d5/d8/d24/d50/f74 [662401,94896] 0 2023-10-18T20:58:24.311 INFO:tasks.workunit.client.0.smithi008.stdout:1/383: read d9/de/df/d17/d25/f32 [211038,99327] 0 2023-10-18T20:58:24.329 INFO:tasks.workunit.client.1.smithi060.stdout:0/221: truncate d3/f17 5889564 0 2023-10-18T20:58:24.329 INFO:tasks.workunit.client.1.smithi060.stdout:9/205: mknod d3/d10/d1c/d2a/c4c 0 2023-10-18T20:58:24.330 INFO:tasks.workunit.client.1.smithi060.stdout:6/169: link d10/d17/d28/f21 d10/d17/d28/f3b 0 2023-10-18T20:58:24.331 INFO:tasks.workunit.client.0.smithi008.stdout:6/263: dwrite df/d18/f2d [0,4194304] 0 2023-10-18T20:58:24.332 INFO:tasks.workunit.client.0.smithi008.stdout:6/264: stat df/d18/d3f 0 2023-10-18T20:58:24.333 INFO:tasks.workunit.client.1.smithi060.stdout:2/226: sync 2023-10-18T20:58:24.333 INFO:tasks.workunit.client.1.smithi060.stdout:2/227: chown d0/d16/c2f 9909 1 2023-10-18T20:58:24.334 INFO:tasks.workunit.client.0.smithi008.stdout:2/252: dread d1/d3/dd/d1c/f3c [0,4194304] 0 2023-10-18T20:58:24.341 INFO:tasks.workunit.client.0.smithi008.stdout:9/224: getdents d2/d8 0 2023-10-18T20:58:24.341 INFO:tasks.workunit.client.0.smithi008.stdout:9/225: readlink d2/dc/l32 0 2023-10-18T20:58:24.342 INFO:tasks.workunit.client.0.smithi008.stdout:8/370: rmdir d5/d8/d17/d4d 39 2023-10-18T20:58:24.343 INFO:tasks.workunit.client.1.smithi060.stdout:0/222: unlink d3/d32/f3a 0 2023-10-18T20:58:24.343 INFO:tasks.workunit.client.1.smithi060.stdout:0/223: creat d3/f4b x:0 0 0 2023-10-18T20:58:24.343 INFO:tasks.workunit.client.1.smithi060.stdout:0/224: fsync d3/d8/d3c/f42 0 2023-10-18T20:58:24.345 INFO:tasks.workunit.client.1.smithi060.stdout:9/206: mknod d3/c4d 0 2023-10-18T20:58:24.345 INFO:tasks.workunit.client.1.smithi060.stdout:6/170: mkdir d10/d25/d3c 0 2023-10-18T20:58:24.347 INFO:tasks.workunit.client.0.smithi008.stdout:6/265: link df/d13/c1b df/d18/d58/c59 0 2023-10-18T20:58:24.351 INFO:tasks.workunit.client.1.smithi060.stdout:2/228: truncate d0/d16/f1a 3105654 0 2023-10-18T20:58:24.352 INFO:tasks.workunit.client.1.smithi060.stdout:8/213: dwrite d4/d9/f2e [0,4194304] 0 2023-10-18T20:58:24.352 INFO:tasks.workunit.client.1.smithi060.stdout:1/281: dread d4/d6/d7/df/f15 [0,4194304] 0 2023-10-18T20:58:24.354 INFO:tasks.workunit.client.0.smithi008.stdout:3/211: dread d0/d3/d15/f21 [0,4194304] 0 2023-10-18T20:58:24.355 INFO:tasks.workunit.client.1.smithi060.stdout:4/185: dwrite d4/dc/d2a/f7 [0,4194304] 0 2023-10-18T20:58:24.356 INFO:tasks.workunit.client.0.smithi008.stdout:2/253: truncate d1/d3/dd/d25/d34/f3b 1842336 0 2023-10-18T20:58:24.356 INFO:tasks.workunit.client.0.smithi008.stdout:2/254: write d1/d3/dd/d1c/f3e [4854254,9825] 0 2023-10-18T20:58:24.356 INFO:tasks.workunit.client.0.smithi008.stdout:2/255: creat d1/d3/dd/d1c/f55 x:0 0 0 2023-10-18T20:58:24.357 INFO:tasks.workunit.client.0.smithi008.stdout:0/194: dwrite d0/dd/f27 [0,4194304] 0 2023-10-18T20:58:24.360 INFO:tasks.workunit.client.0.smithi008.stdout:9/226: truncate d2/dc/f1e 1815550 0 2023-10-18T20:58:24.360 INFO:tasks.workunit.client.0.smithi008.stdout:9/227: getdents d2/dc/d17/d19 0 2023-10-18T20:58:24.360 INFO:tasks.workunit.client.1.smithi060.stdout:9/207: unlink d3/d10/d1c/d2a/d33/d29/d2b/f43 0 2023-10-18T20:58:24.366 INFO:tasks.workunit.client.1.smithi060.stdout:6/171: write d10/d17/d28/f3b [6471221,97489] 0 2023-10-18T20:58:24.367 INFO:tasks.workunit.client.0.smithi008.stdout:8/371: mkdir d5/d8/d24/d50/d8d/d95 0 2023-10-18T20:58:24.368 INFO:tasks.workunit.client.0.smithi008.stdout:8/372: stat d5/d8/df/d6f/f64 0 2023-10-18T20:58:24.368 INFO:tasks.workunit.client.0.smithi008.stdout:8/373: write d5/f4b [9403568,119729] 0 2023-10-18T20:58:24.368 INFO:tasks.workunit.client.0.smithi008.stdout:8/374: readlink d5/d8/df/d2e/l3c 0 2023-10-18T20:58:24.372 INFO:tasks.workunit.client.1.smithi060.stdout:1/282: dread d4/da/f50 [0,4194304] 0 2023-10-18T20:58:24.373 INFO:tasks.workunit.client.0.smithi008.stdout:3/212: link d0/d3/de/d13/f28 d0/d3/d37/f3e 0 2023-10-18T20:58:24.374 INFO:tasks.workunit.client.1.smithi060.stdout:3/198: dwrite d0/f24 [4194304,4194304] 0 2023-10-18T20:58:24.374 INFO:tasks.workunit.client.1.smithi060.stdout:3/199: chown d0/d3c/d3d/f3b 0 1 2023-10-18T20:58:24.376 INFO:tasks.workunit.client.1.smithi060.stdout:9/208: write d3/ff [2501567,56607] 0 2023-10-18T20:58:24.381 INFO:tasks.workunit.client.1.smithi060.stdout:2/229: truncate d0/d8/fc 1245401 0 2023-10-18T20:58:24.392 INFO:tasks.workunit.client.0.smithi008.stdout:2/256: mknod d1/d3/dd/d25/d34/c56 0 2023-10-18T20:58:24.399 INFO:tasks.workunit.client.1.smithi060.stdout:4/186: truncate d4/dc/f19 168741 0 2023-10-18T20:58:24.399 INFO:tasks.workunit.client.1.smithi060.stdout:4/187: write d4/dc/d2a/d1d/f21 [1313857,20505] 0 2023-10-18T20:58:24.404 INFO:tasks.workunit.client.1.smithi060.stdout:0/225: rename d3/f4b to d3/d32/f4c 0 2023-10-18T20:58:24.406 INFO:tasks.workunit.client.0.smithi008.stdout:0/195: mknod d0/c3b 0 2023-10-18T20:58:24.406 INFO:tasks.workunit.client.0.smithi008.stdout:0/196: chown d0/dd/df/d20 1274568 1 2023-10-18T20:58:24.406 INFO:tasks.workunit.client.0.smithi008.stdout:0/197: unlink d0/dd/df/l1b 0 2023-10-18T20:58:24.407 INFO:tasks.workunit.client.1.smithi060.stdout:6/172: symlink d10/d25/l3d 0 2023-10-18T20:58:24.407 INFO:tasks.workunit.client.0.smithi008.stdout:0/198: dread - d0/dd/d29/f39 zero size 2023-10-18T20:58:24.408 INFO:tasks.workunit.client.0.smithi008.stdout:6/266: dwrite df/d19/f32 [0,4194304] 0 2023-10-18T20:58:24.416 INFO:tasks.workunit.client.0.smithi008.stdout:0/199: write d0/dd/d29/f30 [158383,34146] 0 2023-10-18T20:58:24.419 INFO:tasks.workunit.client.1.smithi060.stdout:8/214: rename d4/d9/f32 to d4/d9/d37/f3c 0 2023-10-18T20:58:24.420 INFO:tasks.workunit.client.0.smithi008.stdout:8/375: creat d5/d8/d17/f96 x:0 0 0 2023-10-18T20:58:24.424 INFO:tasks.workunit.client.1.smithi060.stdout:6/173: mkdir d10/d3e 0 2023-10-18T20:58:24.425 INFO:tasks.workunit.client.1.smithi060.stdout:6/174: read - d10/d17/d28/f26 zero size 2023-10-18T20:58:24.425 INFO:tasks.workunit.client.1.smithi060.stdout:6/175: write d10/d17/d28/f21 [6467539,82764] 0 2023-10-18T20:58:24.425 INFO:tasks.workunit.client.0.smithi008.stdout:3/213: unlink d0/f36 0 2023-10-18T20:58:24.426 INFO:tasks.workunit.client.0.smithi008.stdout:2/257: mkdir d1/d3/dd/d1c/d3a/d57 0 2023-10-18T20:58:24.428 INFO:tasks.workunit.client.1.smithi060.stdout:9/209: getdents d3/d10/d1c/d25 0 2023-10-18T20:58:24.429 INFO:tasks.workunit.client.1.smithi060.stdout:8/215: chown d4/c1a 62327 1 2023-10-18T20:58:24.435 INFO:tasks.workunit.client.1.smithi060.stdout:1/283: rename d4/c23 to d4/da/de/d2a/d32/c60 0 2023-10-18T20:58:24.435 INFO:tasks.workunit.client.1.smithi060.stdout:1/284: readlink d4/l3d 0 2023-10-18T20:58:24.435 INFO:tasks.workunit.client.1.smithi060.stdout:0/226: symlink d3/d8/l4d 0 2023-10-18T20:58:24.435 INFO:tasks.workunit.client.1.smithi060.stdout:0/227: truncate d3/d8/d14/f3d 970861 0 2023-10-18T20:58:24.436 INFO:tasks.workunit.client.1.smithi060.stdout:0/228: dread - d3/d8/d14/f2c zero size 2023-10-18T20:58:24.436 INFO:tasks.workunit.client.1.smithi060.stdout:0/229: fsync d3/d8/f3f 0 2023-10-18T20:58:24.436 INFO:tasks.workunit.client.1.smithi060.stdout:0/230: chown d3/d8/f9 178797 1 2023-10-18T20:58:24.436 INFO:tasks.workunit.client.1.smithi060.stdout:0/231: chown d3/d8/d14/d49/f36 3 1 2023-10-18T20:58:24.438 INFO:tasks.workunit.client.0.smithi008.stdout:7/248: dwrite d1/d3/f2a [0,4194304] 0 2023-10-18T20:58:24.439 INFO:tasks.workunit.client.1.smithi060.stdout:9/210: creat d3/d10/d19/f4e x:0 0 0 2023-10-18T20:58:24.445 INFO:tasks.workunit.client.1.smithi060.stdout:6/176: rename d10/d17/d28/f3b to d10/d2e/f3f 0 2023-10-18T20:58:24.446 INFO:tasks.workunit.client.1.smithi060.stdout:1/285: symlink d4/d6/d33/d58/l61 0 2023-10-18T20:58:24.446 INFO:tasks.workunit.client.1.smithi060.stdout:6/177: fdatasync d10/f19 0 2023-10-18T20:58:24.446 INFO:tasks.workunit.client.1.smithi060.stdout:1/286: readlink d4/d6/d14/d41/l47 0 2023-10-18T20:58:24.446 INFO:tasks.workunit.client.0.smithi008.stdout:3/214: symlink d0/d3/de/d13/l3f 0 2023-10-18T20:58:24.451 INFO:tasks.workunit.client.1.smithi060.stdout:6/178: rmdir d10/d17/d2f 39 2023-10-18T20:58:24.451 INFO:tasks.workunit.client.1.smithi060.stdout:6/179: write f7 [744806,116798] 0 2023-10-18T20:58:24.458 INFO:tasks.workunit.client.1.smithi060.stdout:9/211: write d3/d10/f18 [351063,45710] 0 2023-10-18T20:58:24.458 INFO:tasks.workunit.client.1.smithi060.stdout:2/230: dwrite d0/d8/f3d [0,4194304] 0 2023-10-18T20:58:24.460 INFO:tasks.workunit.client.0.smithi008.stdout:2/258: dread d1/f1a [0,4194304] 0 2023-10-18T20:58:24.463 INFO:tasks.workunit.client.0.smithi008.stdout:3/215: symlink d0/d3/de/l40 0 2023-10-18T20:58:24.464 INFO:tasks.workunit.client.1.smithi060.stdout:9/212: write f2 [227809,2577] 0 2023-10-18T20:58:24.464 INFO:tasks.workunit.client.1.smithi060.stdout:9/213: write d3/ff [2913528,42855] 0 2023-10-18T20:58:24.466 INFO:tasks.workunit.client.0.smithi008.stdout:3/216: rmdir d0/d3/de 39 2023-10-18T20:58:24.467 INFO:tasks.workunit.client.1.smithi060.stdout:2/231: write d0/d8/f2b [1012439,97330] 0 2023-10-18T20:58:24.475 INFO:tasks.workunit.client.1.smithi060.stdout:2/232: rename d0/d8/f26 to d0/d8/f42 0 2023-10-18T20:58:24.477 INFO:tasks.workunit.client.1.smithi060.stdout:1/287: write d4/da/f50 [995532,124269] 0 2023-10-18T20:58:24.477 INFO:tasks.workunit.client.1.smithi060.stdout:1/288: truncate d4/da/f5b 702404 0 2023-10-18T20:58:24.477 INFO:tasks.workunit.client.1.smithi060.stdout:1/289: write d4/d6/f22 [4416477,119255] 0 2023-10-18T20:58:24.480 INFO:tasks.workunit.client.1.smithi060.stdout:1/290: rmdir d4/da/de/d2a/d32/dd 39 2023-10-18T20:58:24.483 INFO:tasks.workunit.client.1.smithi060.stdout:1/291: creat d4/da/de/d2a/d32/f62 x:0 0 0 2023-10-18T20:58:24.484 INFO:tasks.workunit.client.1.smithi060.stdout:3/200: dwrite d0/d22/d26/d2c/f31 [0,4194304] 0 2023-10-18T20:58:24.492 INFO:tasks.workunit.client.1.smithi060.stdout:0/232: write d3/fc [1967891,93518] 0 2023-10-18T20:58:24.492 INFO:tasks.workunit.client.1.smithi060.stdout:6/180: write d10/f19 [11832,13525] 0 2023-10-18T20:58:24.492 INFO:tasks.workunit.client.1.smithi060.stdout:0/233: truncate d3/d8/f11 747564 0 2023-10-18T20:58:24.493 INFO:tasks.workunit.client.1.smithi060.stdout:3/201: mknod d0/d22/d26/d2b/c41 0 2023-10-18T20:58:24.496 INFO:tasks.workunit.client.0.smithi008.stdout:0/200: dwrite d0/dd/f18 [0,4194304] 0 2023-10-18T20:58:24.497 INFO:tasks.workunit.client.1.smithi060.stdout:8/216: dwrite d4/d9/d31/d35/f3a [0,4194304] 0 2023-10-18T20:58:24.497 INFO:tasks.workunit.client.1.smithi060.stdout:6/181: link d10/l12 d10/d25/d3c/l40 0 2023-10-18T20:58:24.497 INFO:tasks.workunit.client.1.smithi060.stdout:6/182: readlink d10/l16 0 2023-10-18T20:58:24.500 INFO:tasks.workunit.client.0.smithi008.stdout:5/195: dwrite d0/f1c [0,4194304] 0 2023-10-18T20:58:24.501 INFO:tasks.workunit.client.1.smithi060.stdout:2/233: dread d0/d16/f28 [0,4194304] 0 2023-10-18T20:58:24.502 INFO:tasks.workunit.client.1.smithi060.stdout:3/202: mknod d0/d22/d26/d2b/c42 0 2023-10-18T20:58:24.503 INFO:tasks.workunit.client.1.smithi060.stdout:4/188: dwrite d4/dc/f19 [0,4194304] 0 2023-10-18T20:58:24.503 INFO:tasks.workunit.client.1.smithi060.stdout:4/189: chown d4/df 57735922 1 2023-10-18T20:58:24.508 INFO:tasks.workunit.client.1.smithi060.stdout:2/234: truncate d0/d16/f1a 1465442 0 2023-10-18T20:58:24.509 INFO:tasks.workunit.client.1.smithi060.stdout:5/276: sync 2023-10-18T20:58:24.509 INFO:tasks.workunit.client.1.smithi060.stdout:7/217: sync 2023-10-18T20:58:24.509 INFO:tasks.workunit.client.1.smithi060.stdout:7/218: fsync fa 0 2023-10-18T20:58:24.509 INFO:tasks.workunit.client.1.smithi060.stdout:7/219: read de/d14/f30 [409452,103610] 0 2023-10-18T20:58:24.510 INFO:tasks.workunit.client.1.smithi060.stdout:5/277: creat d0/dd/f6e x:0 0 0 2023-10-18T20:58:24.510 INFO:tasks.workunit.client.1.smithi060.stdout:5/278: write d0/f1d [2202338,54988] 0 2023-10-18T20:58:24.517 INFO:tasks.workunit.client.1.smithi060.stdout:9/214: rmdir d3/d10 39 2023-10-18T20:58:24.518 INFO:tasks.workunit.client.1.smithi060.stdout:3/203: dread - d0/f1b zero size 2023-10-18T20:58:24.518 INFO:tasks.workunit.client.1.smithi060.stdout:9/215: dread - d3/d10/d19/f4e zero size 2023-10-18T20:58:24.518 INFO:tasks.workunit.client.1.smithi060.stdout:7/220: mknod de/d14/d2f/c4a 0 2023-10-18T20:58:24.518 INFO:tasks.workunit.client.1.smithi060.stdout:7/221: fsync de/d14/d3a/f3b 0 2023-10-18T20:58:24.518 INFO:tasks.workunit.client.1.smithi060.stdout:5/279: mknod d0/d6/db/c6f 0 2023-10-18T20:58:24.519 INFO:tasks.workunit.client.1.smithi060.stdout:0/234: dread d3/d8/f10 [0,4194304] 0 2023-10-18T20:58:24.519 INFO:tasks.workunit.client.1.smithi060.stdout:7/222: mkdir de/d14/d41/d4b 0 2023-10-18T20:58:24.519 INFO:tasks.workunit.client.1.smithi060.stdout:7/223: dread - de/d14/d2f/f3c zero size 2023-10-18T20:58:24.520 INFO:tasks.workunit.client.1.smithi060.stdout:5/280: rename d0/d6/d8/l24 to d0/d47/l70 0 2023-10-18T20:58:24.520 INFO:tasks.workunit.client.1.smithi060.stdout:5/281: chown d0/d6/d8/df/l3f 926915 1 2023-10-18T20:58:24.521 INFO:tasks.workunit.client.1.smithi060.stdout:6/183: fdatasync d10/d17/d28/f21 0 2023-10-18T20:58:24.522 INFO:tasks.workunit.client.1.smithi060.stdout:6/184: write d10/d17/d28/f21 [9019542,120196] 0 2023-10-18T20:58:24.527 INFO:tasks.workunit.client.1.smithi060.stdout:7/224: dread de/f1a [0,4194304] 0 2023-10-18T20:58:24.527 INFO:tasks.workunit.client.1.smithi060.stdout:7/225: chown de/f19 2226695 1 2023-10-18T20:58:24.528 INFO:tasks.workunit.client.1.smithi060.stdout:7/226: write de/d14/d2f/f3c [396988,48731] 0 2023-10-18T20:58:24.538 INFO:tasks.workunit.client.0.smithi008.stdout:7/249: dwrite d1/d3/f14 [0,4194304] 0 2023-10-18T20:58:24.539 INFO:tasks.workunit.client.0.smithi008.stdout:9/228: dwrite d2/f4 [0,4194304] 0 2023-10-18T20:58:24.544 INFO:tasks.workunit.client.1.smithi060.stdout:7/227: creat de/d14/d2f/d3f/f4c x:0 0 0 2023-10-18T20:58:24.545 INFO:tasks.workunit.client.1.smithi060.stdout:7/228: rmdir de/d14/d2f 39 2023-10-18T20:58:24.546 INFO:tasks.workunit.client.0.smithi008.stdout:7/250: getdents d1/d36/d3b/d4f 0 2023-10-18T20:58:24.551 INFO:tasks.workunit.client.1.smithi060.stdout:7/229: mknod de/d14/d2f/c4d 0 2023-10-18T20:58:24.551 INFO:tasks.workunit.client.1.smithi060.stdout:7/230: truncate de/d29/f33 715328 0 2023-10-18T20:58:24.551 INFO:tasks.workunit.client.1.smithi060.stdout:7/231: readlink de/d14/d2f/l32 0 2023-10-18T20:58:24.551 INFO:tasks.workunit.client.1.smithi060.stdout:7/232: chown de 50512 1 2023-10-18T20:58:24.551 INFO:tasks.workunit.client.1.smithi060.stdout:7/233: readlink l4 0 2023-10-18T20:58:24.552 INFO:tasks.workunit.client.0.smithi008.stdout:5/196: dread d0/d2/d9/f24 [0,4194304] 0 2023-10-18T20:58:24.552 INFO:tasks.workunit.client.1.smithi060.stdout:0/235: dread d3/d8/f31 [0,4194304] 0 2023-10-18T20:58:24.561 INFO:tasks.workunit.client.1.smithi060.stdout:4/190: write d4/dc/f19 [2016764,13536] 0 2023-10-18T20:58:24.561 INFO:tasks.workunit.client.1.smithi060.stdout:1/292: dwrite d4/f2d [0,4194304] 0 2023-10-18T20:58:24.562 INFO:tasks.workunit.client.0.smithi008.stdout:7/251: rename d1/f29 to d1/d3/f53 0 2023-10-18T20:58:24.564 INFO:tasks.workunit.client.1.smithi060.stdout:4/191: write d4/dc/d2a/d1d/f21 [319067,32872] 0 2023-10-18T20:58:24.571 INFO:tasks.workunit.client.0.smithi008.stdout:3/217: dwrite d0/d3/d15/f21 [0,4194304] 0 2023-10-18T20:58:24.576 INFO:tasks.workunit.client.0.smithi008.stdout:9/229: dread d2/dc/f14 [0,4194304] 0 2023-10-18T20:58:24.576 INFO:tasks.workunit.client.0.smithi008.stdout:7/252: write d1/f1b [176208,20851] 0 2023-10-18T20:58:24.577 INFO:tasks.workunit.client.0.smithi008.stdout:7/253: read - d1/f4e zero size 2023-10-18T20:58:24.578 INFO:tasks.workunit.client.1.smithi060.stdout:0/236: symlink d3/d8/d3c/l4e 0 2023-10-18T20:58:24.579 INFO:tasks.workunit.client.1.smithi060.stdout:0/237: readlink d3/d8/d14/l18 0 2023-10-18T20:58:24.579 INFO:tasks.workunit.client.1.smithi060.stdout:8/217: truncate d4/d9/d31/d35/f3a 1476814 0 2023-10-18T20:58:24.579 INFO:tasks.workunit.client.1.smithi060.stdout:8/218: creat d4/d9/d37/f3d x:0 0 0 2023-10-18T20:58:24.579 INFO:tasks.workunit.client.1.smithi060.stdout:1/293: unlink d4/d6/d14/l16 0 2023-10-18T20:58:24.579 INFO:tasks.workunit.client.1.smithi060.stdout:8/219: fdatasync f3 0 2023-10-18T20:58:24.586 INFO:tasks.workunit.client.0.smithi008.stdout:3/218: creat d0/d3/de/d13/d35/f41 x:0 0 0 2023-10-18T20:58:24.589 INFO:tasks.workunit.client.0.smithi008.stdout:0/201: dwrite d0/dd/f15 [0,4194304] 0 2023-10-18T20:58:24.589 INFO:tasks.workunit.client.0.smithi008.stdout:0/202: readlink d0/l2c 0 2023-10-18T20:58:24.589 INFO:tasks.workunit.client.0.smithi008.stdout:0/203: write d0/dd/df/d2a/f33 [1315047,83638] 0 2023-10-18T20:58:24.590 INFO:tasks.workunit.client.1.smithi060.stdout:5/282: dwrite d0/d6/f6a [0,4194304] 0 2023-10-18T20:58:24.590 INFO:tasks.workunit.client.1.smithi060.stdout:2/235: dread d0/d16/f1a [0,4194304] 0 2023-10-18T20:58:24.594 INFO:tasks.workunit.client.0.smithi008.stdout:6/267: dwrite df/d15/f16 [0,4194304] 0 2023-10-18T20:58:24.599 INFO:tasks.workunit.client.1.smithi060.stdout:0/238: dread d3/f33 [0,4194304] 0 2023-10-18T20:58:24.604 INFO:tasks.workunit.client.1.smithi060.stdout:1/294: symlink d4/d6/l63 0 2023-10-18T20:58:24.605 INFO:tasks.workunit.client.1.smithi060.stdout:1/295: readlink d4/da/l17 0 2023-10-18T20:58:24.605 INFO:tasks.workunit.client.0.smithi008.stdout:0/204: creat d0/dd/d19/f3c x:0 0 0 2023-10-18T20:58:24.608 INFO:tasks.workunit.client.1.smithi060.stdout:7/234: dread de/f1f [0,4194304] 0 2023-10-18T20:58:24.608 INFO:tasks.workunit.client.1.smithi060.stdout:7/235: truncate de/f19 731979 0 2023-10-18T20:58:24.612 INFO:tasks.workunit.client.1.smithi060.stdout:9/216: dwrite d3/d10/d1c/d2a/f36 [0,4194304] 0 2023-10-18T20:58:24.612 INFO:tasks.workunit.client.1.smithi060.stdout:8/220: dread d4/f1f [0,4194304] 0 2023-10-18T20:58:24.614 INFO:tasks.workunit.client.1.smithi060.stdout:6/185: dwrite d10/d2e/f3a [0,4194304] 0 2023-10-18T20:58:24.614 INFO:tasks.workunit.client.1.smithi060.stdout:6/186: creat d10/d1b/f41 x:0 0 0 2023-10-18T20:58:24.619 INFO:tasks.workunit.client.1.smithi060.stdout:2/236: mkdir d0/d43 0 2023-10-18T20:58:24.619 INFO:tasks.workunit.client.1.smithi060.stdout:2/237: chown d0/d3/c24 116 1 2023-10-18T20:58:24.625 INFO:tasks.workunit.client.0.smithi008.stdout:9/230: dwrite d2/dc/d17/f16 [0,4194304] 0 2023-10-18T20:58:24.626 INFO:tasks.workunit.client.1.smithi060.stdout:0/239: unlink d3/d8/c43 0 2023-10-18T20:58:24.628 INFO:tasks.workunit.client.1.smithi060.stdout:9/217: rename d3/l34 to d3/l4f 0 2023-10-18T20:58:24.629 INFO:tasks.workunit.client.1.smithi060.stdout:9/218: creat d3/f50 x:0 0 0 2023-10-18T20:58:24.629 INFO:tasks.workunit.client.1.smithi060.stdout:9/219: write d3/ff [807164,65864] 0 2023-10-18T20:58:24.630 INFO:tasks.workunit.client.1.smithi060.stdout:6/187: dread d10/d1b/f2a [0,4194304] 0 2023-10-18T20:58:24.630 INFO:tasks.workunit.client.1.smithi060.stdout:6/188: dread - d10/d1b/f22 zero size 2023-10-18T20:58:24.631 INFO:tasks.workunit.client.1.smithi060.stdout:8/221: truncate d4/f22 116354 0 2023-10-18T20:58:24.631 INFO:tasks.workunit.client.1.smithi060.stdout:8/222: read d4/f19 [1812929,20128] 0 2023-10-18T20:58:24.632 INFO:tasks.workunit.client.1.smithi060.stdout:2/238: dread d0/d16/f19 [0,4194304] 0 2023-10-18T20:58:24.632 INFO:tasks.workunit.client.1.smithi060.stdout:2/239: fdatasync d0/d16/f19 0 2023-10-18T20:58:24.633 INFO:tasks.workunit.client.1.smithi060.stdout:3/204: dwrite d0/f24 [0,4194304] 0 2023-10-18T20:58:24.633 INFO:tasks.workunit.client.1.smithi060.stdout:1/296: fdatasync d4/da/f50 0 2023-10-18T20:58:24.634 INFO:tasks.workunit.client.0.smithi008.stdout:7/254: dread d1/f1b [0,4194304] 0 2023-10-18T20:58:24.636 INFO:tasks.workunit.client.0.smithi008.stdout:7/255: mkdir d1/d3/d20/d54 0 2023-10-18T20:58:24.637 INFO:tasks.workunit.client.0.smithi008.stdout:7/256: truncate d1/f4e 120698 0 2023-10-18T20:58:24.639 INFO:tasks.workunit.client.1.smithi060.stdout:8/223: dread d4/f22 [0,4194304] 0 2023-10-18T20:58:24.641 INFO:tasks.workunit.client.1.smithi060.stdout:0/240: getdents d3/d8/d3c 0 2023-10-18T20:58:24.641 INFO:tasks.workunit.client.1.smithi060.stdout:0/241: readlink d3/d8/d3c/l4a 0 2023-10-18T20:58:24.641 INFO:tasks.workunit.client.1.smithi060.stdout:0/242: fsync d3/f21 0 2023-10-18T20:58:24.642 INFO:tasks.workunit.client.0.smithi008.stdout:6/268: dwrite df/d15/d33/f51 [0,4194304] 0 2023-10-18T20:58:24.642 INFO:tasks.workunit.client.0.smithi008.stdout:6/269: chown df/d15/l44 58905 1 2023-10-18T20:58:24.642 INFO:tasks.workunit.client.0.smithi008.stdout:6/270: readlink df/d26/l34 0 2023-10-18T20:58:24.642 INFO:tasks.workunit.client.0.smithi008.stdout:6/271: chown df/d18/d3f 1363 1 2023-10-18T20:58:24.646 INFO:tasks.workunit.client.1.smithi060.stdout:7/236: dwrite de/d14/d2f/d3f/f4c [0,4194304] 0 2023-10-18T20:58:24.646 INFO:tasks.workunit.client.1.smithi060.stdout:7/237: dread - de/d14/d1d/f34 zero size 2023-10-18T20:58:24.646 INFO:tasks.workunit.client.1.smithi060.stdout:7/238: creat de/d14/d1d/f4e x:0 0 0 2023-10-18T20:58:24.647 INFO:tasks.workunit.client.0.smithi008.stdout:7/257: dread d1/d3/d20/f47 [0,4194304] 0 2023-10-18T20:58:24.647 INFO:tasks.workunit.client.0.smithi008.stdout:7/258: chown d1/d3/d20 1916069 1 2023-10-18T20:58:24.647 INFO:tasks.workunit.client.0.smithi008.stdout:9/231: dread d2/f3 [0,4194304] 0 2023-10-18T20:58:24.648 INFO:tasks.workunit.client.0.smithi008.stdout:5/197: dwrite d0/f29 [0,4194304] 0 2023-10-18T20:58:24.648 INFO:tasks.workunit.client.0.smithi008.stdout:5/198: dread - d0/d2/d9/d34/f3b zero size 2023-10-18T20:58:24.648 INFO:tasks.workunit.client.0.smithi008.stdout:5/199: fsync d0/d2/d19/d1b/f27 0 2023-10-18T20:58:24.649 INFO:tasks.workunit.client.0.smithi008.stdout:5/200: chown d0/cb 129 1 2023-10-18T20:58:24.649 INFO:tasks.workunit.client.0.smithi008.stdout:0/205: write d0/dd/f18 [3050599,28652] 0 2023-10-18T20:58:24.649 INFO:tasks.workunit.client.0.smithi008.stdout:3/219: dwrite d0/d3/de/d13/d35/f41 [0,4194304] 0 2023-10-18T20:58:24.650 INFO:tasks.workunit.client.0.smithi008.stdout:6/272: creat df/d15/d27/d38/f5a x:0 0 0 2023-10-18T20:58:24.653 INFO:tasks.workunit.client.0.smithi008.stdout:9/232: symlink d2/dc/d1a/d1d/l39 0 2023-10-18T20:58:24.653 INFO:tasks.workunit.client.0.smithi008.stdout:9/233: fdatasync d2/dc/d1a/d1d/f37 0 2023-10-18T20:58:24.653 INFO:tasks.workunit.client.0.smithi008.stdout:9/234: write d2/f1b [1609172,84951] 0 2023-10-18T20:58:24.661 INFO:tasks.workunit.client.1.smithi060.stdout:2/240: dread d0/d8/f1b [0,4194304] 0 2023-10-18T20:58:24.665 INFO:tasks.workunit.client.0.smithi008.stdout:9/235: read d2/dc/d17/f16 [885681,58249] 0 2023-10-18T20:58:24.666 INFO:tasks.workunit.client.0.smithi008.stdout:9/236: readlink d2/dc/d1a/d1d/l27 0 2023-10-18T20:58:24.666 INFO:tasks.workunit.client.0.smithi008.stdout:1/384: sync 2023-10-18T20:58:24.667 INFO:tasks.workunit.client.0.smithi008.stdout:4/245: sync 2023-10-18T20:58:24.668 INFO:tasks.workunit.client.0.smithi008.stdout:4/246: write d0/d3/f41 [4502468,774] 0 2023-10-18T20:58:24.668 INFO:tasks.workunit.client.0.smithi008.stdout:4/247: chown d0/d3/d48/d4c/l59 483799733 1 2023-10-18T20:58:24.689 INFO:tasks.workunit.client.1.smithi060.stdout:1/297: dwrite d4/da/f5a [0,4194304] 0 2023-10-18T20:58:24.689 INFO:tasks.workunit.client.1.smithi060.stdout:1/298: readlink d4/d6/d7/d2f/l3a 0 2023-10-18T20:58:24.698 INFO:tasks.workunit.client.1.smithi060.stdout:7/239: dwrite de/f27 [0,4194304] 0 2023-10-18T20:58:24.698 INFO:tasks.workunit.client.1.smithi060.stdout:7/240: write de/d29/f2b [709408,49184] 0 2023-10-18T20:58:24.701 INFO:tasks.workunit.client.0.smithi008.stdout:7/259: creat d1/d36/d3d/d3e/f55 x:0 0 0 2023-10-18T20:58:24.701 INFO:tasks.workunit.client.0.smithi008.stdout:7/260: stat d1/d3/d20/f2f 0 2023-10-18T20:58:24.702 INFO:tasks.workunit.client.0.smithi008.stdout:5/201: mkdir d0/de/d45 0 2023-10-18T20:58:24.737 INFO:tasks.workunit.client.1.smithi060.stdout:8/224: symlink d4/d9/d37/l3e 0 2023-10-18T20:58:24.737 INFO:tasks.workunit.client.1.smithi060.stdout:8/225: dread - d4/d9/d37/f38 zero size 2023-10-18T20:58:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:23.533926+0000 mgr.smithi060.pgqqwa (mgr.14584) 43 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 978 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 97 MiB/s rd, 120 MiB/s wr, 859 op/s 2023-10-18T20:58:24.738 INFO:tasks.workunit.client.0.smithi008.stdout:0/206: creat d0/dd/d19/d24/f3d x:0 0 0 2023-10-18T20:58:24.739 INFO:tasks.workunit.client.0.smithi008.stdout:3/220: getdents d0/d3/de/d13 0 2023-10-18T20:58:24.741 INFO:tasks.workunit.client.0.smithi008.stdout:6/273: rename df/d19/c2f to df/d15/d48/d4b/c5b 0 2023-10-18T20:58:24.742 INFO:tasks.workunit.client.1.smithi060.stdout:9/220: rmdir d3 39 2023-10-18T20:58:24.746 INFO:tasks.workunit.client.0.smithi008.stdout:1/385: chown d9/de/df/d17/d1e 414765066 1 2023-10-18T20:58:24.750 INFO:tasks.workunit.client.1.smithi060.stdout:6/189: rmdir d10/d17 39 2023-10-18T20:58:24.752 INFO:tasks.workunit.client.1.smithi060.stdout:1/299: dwrite d4/da/de/d2a/f46 [0,4194304] 0 2023-10-18T20:58:24.752 INFO:tasks.workunit.client.1.smithi060.stdout:1/300: creat d4/da/d42/f64 x:0 0 0 2023-10-18T20:58:24.753 INFO:tasks.workunit.client.1.smithi060.stdout:3/205: truncate d0/f24 6273033 0 2023-10-18T20:58:24.753 INFO:tasks.workunit.client.1.smithi060.stdout:3/206: chown d0/d22/d26/d2b/c42 651 1 2023-10-18T20:58:24.754 INFO:tasks.workunit.client.1.smithi060.stdout:2/241: creat d0/d43/f44 x:0 0 0 2023-10-18T20:58:24.755 INFO:tasks.workunit.client.0.smithi008.stdout:8/376: sync 2023-10-18T20:58:24.758 INFO:tasks.workunit.client.0.smithi008.stdout:2/259: sync 2023-10-18T20:58:24.787 INFO:tasks.workunit.client.0.smithi008.stdout:9/237: rmdir d2/d8 39 2023-10-18T20:58:24.798 INFO:tasks.workunit.client.0.smithi008.stdout:9/238: dread d2/dc/d1a/f21 [0,4194304] 0 2023-10-18T20:58:24.798 INFO:tasks.workunit.client.0.smithi008.stdout:9/239: write d2/dc/f22 [986525,51815] 0 2023-10-18T20:58:24.808 INFO:tasks.workunit.client.0.smithi008.stdout:7/261: creat d1/d3/f56 x:0 0 0 2023-10-18T20:58:24.811 INFO:tasks.workunit.client.0.smithi008.stdout:5/202: mknod d0/de/c46 0 2023-10-18T20:58:24.811 INFO:tasks.workunit.client.0.smithi008.stdout:5/203: write d0/f1c [4326464,101781] 0 2023-10-18T20:58:24.816 INFO:tasks.workunit.client.0.smithi008.stdout:8/377: symlink d5/d8/df/d2e/l97 0 2023-10-18T20:58:24.818 INFO:tasks.workunit.client.0.smithi008.stdout:2/260: creat d1/d3/dd/f58 x:0 0 0 2023-10-18T20:58:24.818 INFO:tasks.workunit.client.0.smithi008.stdout:2/261: fsync d1/d3/dd/d1c/d3a/f3d 0 2023-10-18T20:58:24.820 INFO:tasks.workunit.client.0.smithi008.stdout:9/240: symlink d2/dc/d17/l3a 0 2023-10-18T20:58:24.822 INFO:tasks.workunit.client.0.smithi008.stdout:5/204: mknod d0/d2/d9/c47 0 2023-10-18T20:58:24.825 INFO:tasks.workunit.client.0.smithi008.stdout:1/386: truncate d9/de/df/d17/d1e/f4c 222857 0 2023-10-18T20:58:24.827 INFO:tasks.workunit.client.1.smithi060.stdout:4/192: sync 2023-10-18T20:58:24.827 INFO:tasks.workunit.client.1.smithi060.stdout:5/283: sync 2023-10-18T20:58:24.829 INFO:tasks.workunit.client.0.smithi008.stdout:8/378: unlink d5/c89 0 2023-10-18T20:58:24.831 INFO:tasks.workunit.client.0.smithi008.stdout:2/262: mkdir d1/d3/dd/d1c/d39/d59 0 2023-10-18T20:58:24.831 INFO:tasks.workunit.client.0.smithi008.stdout:2/263: stat d1/d3/c9 0 2023-10-18T20:58:24.833 INFO:tasks.workunit.client.0.smithi008.stdout:9/241: unlink d2/dc/d17/d19/l20 0 2023-10-18T20:58:24.834 INFO:tasks.workunit.client.1.smithi060.stdout:0/243: getdents d3/d32 0 2023-10-18T20:58:24.838 INFO:tasks.workunit.client.0.smithi008.stdout:5/205: link d0/de/l1f d0/l48 0 2023-10-18T20:58:24.839 INFO:tasks.workunit.client.0.smithi008.stdout:5/206: getdents d0/d2/d19/d1b/d41 0 2023-10-18T20:58:24.839 INFO:tasks.workunit.client.0.smithi008.stdout:5/207: write d0/f28 [1540078,42907] 0 2023-10-18T20:58:24.841 INFO:tasks.workunit.client.1.smithi060.stdout:9/221: creat d3/d10/d1c/d2a/d41/f51 x:0 0 0 2023-10-18T20:58:24.841 INFO:tasks.workunit.client.1.smithi060.stdout:0/244: dread d3/d8/f2d [0,4194304] 0 2023-10-18T20:58:24.842 INFO:tasks.workunit.client.1.smithi060.stdout:0/245: write d3/d8/d14/f2c [951483,96364] 0 2023-10-18T20:58:24.843 INFO:tasks.workunit.client.0.smithi008.stdout:4/248: rename d0/d3/d8 to d0/d17/d5b 0 2023-10-18T20:58:24.844 INFO:tasks.workunit.client.1.smithi060.stdout:6/190: symlink d10/d17/d2f/l42 0 2023-10-18T20:58:24.844 INFO:tasks.workunit.client.1.smithi060.stdout:6/191: dread - d10/d1b/f22 zero size 2023-10-18T20:58:24.846 INFO:tasks.workunit.client.0.smithi008.stdout:1/387: stat d9/de/df/d17/c38 0 2023-10-18T20:58:24.847 INFO:tasks.workunit.client.0.smithi008.stdout:1/388: unlink d9/de/f6d 0 2023-10-18T20:58:24.848 INFO:tasks.workunit.client.1.smithi060.stdout:1/301: creat d4/d6/f65 x:0 0 0 2023-10-18T20:58:24.848 INFO:tasks.workunit.client.1.smithi060.stdout:1/302: chown d4/da/de/d2a/d32/dd/f3f 9 1 2023-10-18T20:58:24.849 INFO:tasks.workunit.client.0.smithi008.stdout:2/264: creat d1/f5a x:0 0 0 2023-10-18T20:58:24.850 INFO:tasks.workunit.client.0.smithi008.stdout:2/265: read d1/d3/dd/d1c/f3c [1435228,109988] 0 2023-10-18T20:58:24.851 INFO:tasks.workunit.client.1.smithi060.stdout:3/207: rmdir d0/d22/d26/d29 39 2023-10-18T20:58:24.855 INFO:tasks.workunit.client.1.smithi060.stdout:1/303: dread d4/da/de/d2a/d32/dd/f25 [0,4194304] 0 2023-10-18T20:58:24.857 INFO:tasks.workunit.client.0.smithi008.stdout:5/208: link d0/d2/d19/d1b/l38 d0/d2/d19/d1b/d31/l49 0 2023-10-18T20:58:24.857 INFO:tasks.workunit.client.0.smithi008.stdout:5/209: chown d0/d2/d19/d1b/f27 2939050 1 2023-10-18T20:58:24.857 INFO:tasks.workunit.client.0.smithi008.stdout:5/210: chown d0/c1 0 1 2023-10-18T20:58:24.857 INFO:tasks.workunit.client.0.smithi008.stdout:3/221: rename d0/d2c to d0/d3/d42 0 2023-10-18T20:58:24.858 INFO:tasks.workunit.client.0.smithi008.stdout:3/222: write d0/d3/f29 [429462,126628] 0 2023-10-18T20:58:24.860 INFO:tasks.workunit.client.1.smithi060.stdout:4/193: rename d4/dc/d2a/d13/f20 to d4/dc/d2a/d13/d33/f35 0 2023-10-18T20:58:24.861 INFO:tasks.workunit.client.0.smithi008.stdout:4/249: rmdir d0/d17/d5b/d2a 39 2023-10-18T20:58:24.864 INFO:tasks.workunit.client.0.smithi008.stdout:2/266: write d1/d3/dd/d1c/f28 [627403,71243] 0 2023-10-18T20:58:24.875 INFO:tasks.workunit.client.1.smithi060.stdout:5/284: creat d0/d6/d8/df/d27/d32/d6d/f71 x:0 0 0 2023-10-18T20:58:24.881 INFO:tasks.workunit.client.1.smithi060.stdout:7/241: sync 2023-10-18T20:58:24.882 INFO:tasks.workunit.client.1.smithi060.stdout:2/242: sync 2023-10-18T20:58:24.882 INFO:tasks.workunit.client.1.smithi060.stdout:7/242: write de/d29/f31 [930005,117355] 0 2023-10-18T20:58:24.882 INFO:tasks.workunit.client.1.smithi060.stdout:8/226: link d4/d9/d37/l3e d4/l3f 0 2023-10-18T20:58:24.882 INFO:tasks.workunit.client.1.smithi060.stdout:9/222: creat d3/d10/d1c/d2a/f52 x:0 0 0 2023-10-18T20:58:24.882 INFO:tasks.workunit.client.1.smithi060.stdout:9/223: truncate d3/d10/d1c/f1d 503732 0 2023-10-18T20:58:24.888 INFO:tasks.workunit.client.1.smithi060.stdout:1/304: symlink d4/da/de/d2a/l66 0 2023-10-18T20:58:24.888 INFO:tasks.workunit.client.1.smithi060.stdout:1/305: stat d4/da/de/d2a/d32/d56 0 2023-10-18T20:58:24.888 INFO:tasks.workunit.client.1.smithi060.stdout:4/194: symlink d4/dc/d2a/d13/d2f/l36 0 2023-10-18T20:58:24.888 INFO:tasks.workunit.client.1.smithi060.stdout:0/246: rmdir d3/d8/d14 39 2023-10-18T20:58:24.888 INFO:tasks.workunit.client.1.smithi060.stdout:0/247: write d3/f26 [4534022,42964] 0 2023-10-18T20:58:24.888 INFO:tasks.workunit.client.1.smithi060.stdout:0/248: fdatasync d3/d8/f9 0 2023-10-18T20:58:24.889 INFO:tasks.workunit.client.0.smithi008.stdout:6/274: rename df/d15/d27/c3d to df/d15/d33/c5c 0 2023-10-18T20:58:24.889 INFO:tasks.workunit.client.0.smithi008.stdout:2/267: mknod d1/d3/dd/d1c/d3a/c5b 0 2023-10-18T20:58:24.891 INFO:tasks.workunit.client.1.smithi060.stdout:4/195: creat d4/d15/f37 x:0 0 0 2023-10-18T20:58:24.892 INFO:tasks.workunit.client.0.smithi008.stdout:7/262: rename d1/d36/d3d/f4d to d1/d3/f57 0 2023-10-18T20:58:24.893 INFO:tasks.workunit.client.1.smithi060.stdout:5/285: dread d0/d6/d8/df/d27/d32/f39 [0,4194304] 0 2023-10-18T20:58:24.896 INFO:tasks.workunit.client.0.smithi008.stdout:6/275: link df/d26/c2b df/d15/c5d 0 2023-10-18T20:58:24.897 INFO:tasks.workunit.client.1.smithi060.stdout:6/192: dwrite d10/d1b/f2b [0,4194304] 0 2023-10-18T20:58:24.898 INFO:tasks.workunit.client.1.smithi060.stdout:5/286: rename d0/d6/db to d0/d6/d8/df/d27/d32/d6d/d72 0 2023-10-18T20:58:24.901 INFO:tasks.workunit.client.1.smithi060.stdout:2/243: dread d0/d3/d2a/f3f [0,4194304] 0 2023-10-18T20:58:24.901 INFO:tasks.workunit.client.1.smithi060.stdout:2/244: write d0/d8/fc [2181241,70151] 0 2023-10-18T20:58:24.903 INFO:tasks.workunit.client.0.smithi008.stdout:9/242: rename d2/dc/d1a/l2b to d2/dc/d1a/d1d/l3b 0 2023-10-18T20:58:24.904 INFO:tasks.workunit.client.1.smithi060.stdout:5/287: mknod d0/dd/d33/c73 0 2023-10-18T20:58:24.904 INFO:tasks.workunit.client.1.smithi060.stdout:5/288: write d0/d6/d8/f6b [810763,86836] 0 2023-10-18T20:58:24.904 INFO:tasks.workunit.client.1.smithi060.stdout:1/306: dread d4/d6/f1f [0,4194304] 0 2023-10-18T20:58:24.910 INFO:tasks.workunit.client.1.smithi060.stdout:0/249: dread d3/f3b [0,4194304] 0 2023-10-18T20:58:24.912 INFO:tasks.workunit.client.1.smithi060.stdout:5/289: rename d0/d6/d8/l5c to d0/da/d3b/d43/l74 0 2023-10-18T20:58:24.912 INFO:tasks.workunit.client.1.smithi060.stdout:5/290: stat d0/d6/d8/df/d27/d32/d6d/d72/d41/c5e 0 2023-10-18T20:58:24.914 INFO:tasks.workunit.client.0.smithi008.stdout:5/211: dwrite d0/d2/f7 [0,4194304] 0 2023-10-18T20:58:24.914 INFO:tasks.workunit.client.0.smithi008.stdout:2/268: dread d1/f18 [0,4194304] 0 2023-10-18T20:58:24.915 INFO:tasks.workunit.client.1.smithi060.stdout:1/307: mkdir d4/da/de/d2a/d32/d56/d67 0 2023-10-18T20:58:24.916 INFO:tasks.workunit.client.1.smithi060.stdout:1/308: truncate d4/d6/f65 371 0 2023-10-18T20:58:24.917 INFO:tasks.workunit.client.1.smithi060.stdout:5/291: creat d0/d6/d8/df/d27/d32/d6d/d72/d41/f75 x:0 0 0 2023-10-18T20:58:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:23.533926+0000 mgr.smithi060.pgqqwa (mgr.14584) 43 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 978 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 97 MiB/s rd, 120 MiB/s wr, 859 op/s 2023-10-18T20:58:24.921 INFO:tasks.workunit.client.0.smithi008.stdout:5/212: creat d0/d2/d19/d1b/d31/f4a x:0 0 0 2023-10-18T20:58:24.922 INFO:tasks.workunit.client.0.smithi008.stdout:5/213: creat d0/d2/d9/f4b x:0 0 0 2023-10-18T20:58:24.922 INFO:tasks.workunit.client.0.smithi008.stdout:2/269: mkdir d1/d3/dd/d25/d5c 0 2023-10-18T20:58:24.923 INFO:tasks.workunit.client.0.smithi008.stdout:2/270: chown d1/d3/dd/d1c 711126761 1 2023-10-18T20:58:24.923 INFO:tasks.workunit.client.1.smithi060.stdout:1/309: truncate d4/da/f50 2112510 0 2023-10-18T20:58:24.924 INFO:tasks.workunit.client.1.smithi060.stdout:2/245: dread d0/d3/d2a/f3f [0,4194304] 0 2023-10-18T20:58:24.925 INFO:tasks.workunit.client.0.smithi008.stdout:9/243: write d2/dc/d1a/d1d/f37 [2992711,8319] 0 2023-10-18T20:58:24.926 INFO:tasks.workunit.client.1.smithi060.stdout:5/292: mkdir d0/dd/d76 0 2023-10-18T20:58:24.939 INFO:tasks.workunit.client.0.smithi008.stdout:3/223: dwrite d0/d3/de/d13/f28 [0,4194304] 0 2023-10-18T20:58:24.939 INFO:tasks.workunit.client.0.smithi008.stdout:3/224: chown d0/d3/d37/f3e 1 1 2023-10-18T20:58:24.940 INFO:tasks.workunit.client.1.smithi060.stdout:0/250: dread d3/d8/d14/f2a [0,4194304] 0 2023-10-18T20:58:24.941 INFO:tasks.workunit.client.1.smithi060.stdout:1/310: getdents d4/d6/d7/d35 0 2023-10-18T20:58:24.941 INFO:tasks.workunit.client.1.smithi060.stdout:4/196: dread d4/dc/d2a/d1d/f21 [0,4194304] 0 2023-10-18T20:58:24.944 INFO:tasks.workunit.client.0.smithi008.stdout:5/214: dread d0/d2/f7 [0,4194304] 0 2023-10-18T20:58:24.945 INFO:tasks.workunit.client.0.smithi008.stdout:9/244: getdents d2/dc/d1a 0 2023-10-18T20:58:24.958 INFO:tasks.workunit.client.1.smithi060.stdout:3/208: dwrite d0/f1e [0,4194304] 0 2023-10-18T20:58:24.959 INFO:tasks.workunit.client.1.smithi060.stdout:8/227: dwrite d4/f22 [0,4194304] 0 2023-10-18T20:58:24.964 INFO:tasks.workunit.client.1.smithi060.stdout:6/193: dwrite fb [0,4194304] 0 2023-10-18T20:58:24.972 INFO:tasks.workunit.client.0.smithi008.stdout:7/263: dread d1/d3/f17 [0,4194304] 0 2023-10-18T20:58:24.972 INFO:tasks.workunit.client.0.smithi008.stdout:7/264: fsync d1/d36/f4c 0 2023-10-18T20:58:24.973 INFO:tasks.workunit.client.1.smithi060.stdout:5/293: mknod d0/d6/d8/df/d27/d32/d6d/d72/d2a/c77 0 2023-10-18T20:58:24.973 INFO:tasks.workunit.client.1.smithi060.stdout:0/251: link d3/f21 d3/f4f 0 2023-10-18T20:58:24.976 INFO:tasks.workunit.client.0.smithi008.stdout:4/250: dwrite d0/d3/f41 [4194304,4194304] 0 2023-10-18T20:58:24.976 INFO:tasks.workunit.client.0.smithi008.stdout:3/225: creat d0/d3/f43 x:0 0 0 2023-10-18T20:58:24.978 INFO:tasks.workunit.client.1.smithi060.stdout:7/243: dwrite de/f19 [0,4194304] 0 2023-10-18T20:58:24.979 INFO:tasks.workunit.client.1.smithi060.stdout:4/197: unlink d4/dc/c1c 0 2023-10-18T20:58:24.980 INFO:tasks.workunit.client.1.smithi060.stdout:8/228: dread d4/d9/d37/f3c [0,4194304] 0 2023-10-18T20:58:24.981 INFO:tasks.workunit.client.1.smithi060.stdout:8/229: chown d4/d9/l3b 6134 1 2023-10-18T20:58:24.981 INFO:tasks.workunit.client.0.smithi008.stdout:5/215: link d0/d2/f23 d0/d2/d19/f4c 0 2023-10-18T20:58:24.983 INFO:tasks.workunit.client.1.smithi060.stdout:1/311: rename c3 to d4/d38/c68 0 2023-10-18T20:58:24.993 INFO:tasks.workunit.client.0.smithi008.stdout:2/271: dwrite d1/f5a [0,4194304] 0 2023-10-18T20:58:24.993 INFO:tasks.workunit.client.0.smithi008.stdout:9/245: creat d2/dc/d1a/d1d/f3c x:0 0 0 2023-10-18T20:58:24.993 INFO:tasks.workunit.client.1.smithi060.stdout:6/194: rmdir d10 39 2023-10-18T20:58:24.994 INFO:tasks.workunit.client.0.smithi008.stdout:5/216: link d0/d2/d19/d1b/d31/l49 d0/d2/d9/l4d 0 2023-10-18T20:58:24.995 INFO:tasks.workunit.client.0.smithi008.stdout:7/265: mknod d1/d36/c58 0 2023-10-18T20:58:24.995 INFO:tasks.workunit.client.1.smithi060.stdout:0/252: truncate d3/d8/f31 617176 0 2023-10-18T20:58:24.995 INFO:tasks.workunit.client.1.smithi060.stdout:8/230: write f3 [619140,71180] 0 2023-10-18T20:58:24.999 INFO:tasks.workunit.client.0.smithi008.stdout:9/246: rmdir d2/dc 39 2023-10-18T20:58:24.999 INFO:tasks.workunit.client.0.smithi008.stdout:9/247: write d2/f5 [2069381,22710] 0 2023-10-18T20:58:25.001 INFO:tasks.workunit.client.1.smithi060.stdout:5/294: truncate d0/da/d3b/f4c 96738 0 2023-10-18T20:58:25.002 INFO:tasks.workunit.client.1.smithi060.stdout:5/295: truncate d0/dd/d33/f3e 1207708 0 2023-10-18T20:58:25.004 INFO:tasks.workunit.client.1.smithi060.stdout:7/244: mknod de/d29/c4f 0 2023-10-18T20:58:25.004 INFO:tasks.workunit.client.1.smithi060.stdout:7/245: write de/d29/f22 [1232313,52538] 0 2023-10-18T20:58:25.004 INFO:tasks.workunit.client.1.smithi060.stdout:7/246: fdatasync de/f19 0 2023-10-18T20:58:25.005 INFO:tasks.workunit.client.1.smithi060.stdout:4/198: symlink d4/dc/d2a/d2d/l38 0 2023-10-18T20:58:25.009 INFO:tasks.workunit.client.0.smithi008.stdout:5/217: rename d0/d2/d19/f4c to d0/d2/d19/d1b/d42/f4e 0 2023-10-18T20:58:25.009 INFO:tasks.workunit.client.0.smithi008.stdout:5/218: fdatasync d0/d2/d9/f11 0 2023-10-18T20:58:25.010 INFO:tasks.workunit.client.0.smithi008.stdout:5/219: chown d0/c3e 3247 1 2023-10-18T20:58:25.010 INFO:tasks.workunit.client.0.smithi008.stdout:7/266: mkdir d1/d36/d3d/d3e/d59 0 2023-10-18T20:58:25.012 INFO:tasks.workunit.client.0.smithi008.stdout:2/272: write d1/d3/dd/f1e [2145945,42011] 0 2023-10-18T20:58:25.012 INFO:tasks.workunit.client.0.smithi008.stdout:7/267: link d1/d36/f4c d1/d36/d3d/f5a 0 2023-10-18T20:58:25.012 INFO:tasks.workunit.client.0.smithi008.stdout:2/273: dread - d1/d3/f4b zero size 2023-10-18T20:58:25.013 INFO:tasks.workunit.client.0.smithi008.stdout:2/274: fdatasync d1/d3/dd/f50 0 2023-10-18T20:58:25.014 INFO:tasks.workunit.client.1.smithi060.stdout:1/312: unlink d4/d6/d14/d41/l4d 0 2023-10-18T20:58:25.018 INFO:tasks.workunit.client.0.smithi008.stdout:7/268: creat d1/d36/d3b/d4f/f5b x:0 0 0 2023-10-18T20:58:25.020 INFO:tasks.workunit.client.1.smithi060.stdout:8/231: creat d4/d9/d31/f40 x:0 0 0 2023-10-18T20:58:25.023 INFO:tasks.workunit.client.1.smithi060.stdout:2/246: dwrite d0/f12 [4194304,4194304] 0 2023-10-18T20:58:25.032 INFO:tasks.workunit.client.0.smithi008.stdout:2/275: rename d1/d3/dd/d1c/d3a/l42 to d1/d3/dd/d1c/d39/d59/l5d 0 2023-10-18T20:58:25.032 INFO:tasks.workunit.client.1.smithi060.stdout:2/247: dread d0/d3/f32 [0,4194304] 0 2023-10-18T20:58:25.036 INFO:tasks.workunit.client.1.smithi060.stdout:5/296: symlink d0/d6/d8/df/l78 0 2023-10-18T20:58:25.038 INFO:tasks.workunit.client.0.smithi008.stdout:7/269: mkdir d1/d36/d3b/d4f/d5c 0 2023-10-18T20:58:25.039 INFO:tasks.workunit.client.1.smithi060.stdout:4/199: mkdir d4/dc/d2a/d39 0 2023-10-18T20:58:25.056 INFO:tasks.workunit.client.1.smithi060.stdout:3/209: rename d0/fa to d0/d22/d26/f43 0 2023-10-18T20:58:25.058 INFO:tasks.workunit.client.1.smithi060.stdout:0/253: dwrite d3/f6 [0,4194304] 0 2023-10-18T20:58:25.059 INFO:tasks.workunit.client.1.smithi060.stdout:0/254: chown d3/d32 244 1 2023-10-18T20:58:25.060 INFO:tasks.workunit.client.0.smithi008.stdout:7/270: mknod d1/d36/d3d/d3e/c5d 0 2023-10-18T20:58:25.068 INFO:tasks.workunit.client.1.smithi060.stdout:1/313: link d4/d38/c4c d4/da/de/d2a/c69 0 2023-10-18T20:58:25.068 INFO:tasks.workunit.client.1.smithi060.stdout:1/314: stat d4/d6/d14/d41/f55 0 2023-10-18T20:58:25.068 INFO:tasks.workunit.client.1.smithi060.stdout:1/315: write d4/da/de/d2a/d32/dd/f3f [886422,43055] 0 2023-10-18T20:58:25.068 INFO:tasks.workunit.client.1.smithi060.stdout:1/316: stat d4/l3d 0 2023-10-18T20:58:25.069 INFO:tasks.workunit.client.0.smithi008.stdout:7/271: truncate d1/d3/f2a 4092604 0 2023-10-18T20:58:25.076 INFO:tasks.workunit.client.0.smithi008.stdout:7/272: stat d1/d3/c34 0 2023-10-18T20:58:25.077 INFO:tasks.workunit.client.0.smithi008.stdout:7/273: readlink d1/l25 0 2023-10-18T20:58:25.077 INFO:tasks.workunit.client.0.smithi008.stdout:7/274: creat d1/d36/d3b/d4f/f5e x:0 0 0 2023-10-18T20:58:25.077 INFO:tasks.workunit.client.0.smithi008.stdout:7/275: stat d1/l33 0 2023-10-18T20:58:25.082 INFO:tasks.workunit.client.1.smithi060.stdout:2/248: mkdir d0/d45 0 2023-10-18T20:58:25.085 INFO:tasks.workunit.client.1.smithi060.stdout:4/200: creat d4/dc/d2a/d13/f3a x:0 0 0 2023-10-18T20:58:25.085 INFO:tasks.workunit.client.0.smithi008.stdout:9/248: dwrite d2/dc/d1a/d1d/f3c [0,4194304] 0 2023-10-18T20:58:25.086 INFO:tasks.workunit.client.0.smithi008.stdout:9/249: truncate d2/f5 4258592 0 2023-10-18T20:58:25.088 INFO:tasks.workunit.client.1.smithi060.stdout:7/247: rename lb to de/d14/d3a/l50 0 2023-10-18T20:58:25.089 INFO:tasks.workunit.client.1.smithi060.stdout:3/210: creat d0/d22/d26/d29/f44 x:0 0 0 2023-10-18T20:58:25.089 INFO:tasks.workunit.client.1.smithi060.stdout:3/211: creat d0/d22/d26/d29/f45 x:0 0 0 2023-10-18T20:58:25.094 INFO:tasks.workunit.client.1.smithi060.stdout:5/297: dwrite d0/d6/d8/df/f4e [0,4194304] 0 2023-10-18T20:58:25.095 INFO:tasks.workunit.client.1.smithi060.stdout:5/298: read d0/d6/d8/df/d27/d32/f39 [293285,81185] 0 2023-10-18T20:58:25.112 INFO:tasks.workunit.client.0.smithi008.stdout:9/250: mkdir d2/dc/d3d 0 2023-10-18T20:58:25.113 INFO:tasks.workunit.client.0.smithi008.stdout:9/251: getdents d2/d8 0 2023-10-18T20:58:25.114 INFO:tasks.workunit.client.0.smithi008.stdout:9/252: symlink d2/dc/d17/l3e 0 2023-10-18T20:58:25.114 INFO:tasks.workunit.client.1.smithi060.stdout:0/255: dwrite d3/d8/d14/d49/f47 [0,4194304] 0 2023-10-18T20:58:25.115 INFO:tasks.workunit.client.1.smithi060.stdout:0/256: stat d3/d32/f4c 0 2023-10-18T20:58:25.116 INFO:tasks.workunit.client.0.smithi008.stdout:2/276: dwrite d1/d3/dd/d1c/d39/f3f [0,4194304] 0 2023-10-18T20:58:25.118 INFO:tasks.workunit.client.1.smithi060.stdout:2/249: creat d0/d3/d27/f46 x:0 0 0 2023-10-18T20:58:25.119 INFO:tasks.workunit.client.0.smithi008.stdout:9/253: rename d2/c13 to d2/dc/c3f 0 2023-10-18T20:58:25.119 INFO:tasks.workunit.client.0.smithi008.stdout:9/254: write d2/dc/f15 [1515045,59472] 0 2023-10-18T20:58:25.119 INFO:tasks.workunit.client.1.smithi060.stdout:4/201: truncate d4/dc/d2a/f1f 2020458 0 2023-10-18T20:58:25.121 INFO:tasks.workunit.client.1.smithi060.stdout:8/232: rename d4/d9/c1e to d4/d9/d37/c41 0 2023-10-18T20:58:25.123 INFO:tasks.workunit.client.0.smithi008.stdout:5/220: dwrite d0/f3 [0,4194304] 0 2023-10-18T20:58:25.123 INFO:tasks.workunit.client.0.smithi008.stdout:5/221: chown d0/d2/d19/d1b/d20/f36 648 1 2023-10-18T20:58:25.130 INFO:tasks.workunit.client.0.smithi008.stdout:2/277: truncate d1/f19 1195512 0 2023-10-18T20:58:25.130 INFO:tasks.workunit.client.0.smithi008.stdout:2/278: chown d1/d3/l33 10 1 2023-10-18T20:58:25.131 INFO:tasks.workunit.client.1.smithi060.stdout:7/248: dwrite de/d14/d1d/f34 [0,4194304] 0 2023-10-18T20:58:25.131 INFO:tasks.workunit.client.1.smithi060.stdout:7/249: write de/d14/d1d/f24 [713379,84083] 0 2023-10-18T20:58:25.131 INFO:tasks.workunit.client.1.smithi060.stdout:7/250: write de/d14/f2d [159181,22614] 0 2023-10-18T20:58:25.132 INFO:tasks.workunit.client.0.smithi008.stdout:9/255: unlink d2/l31 0 2023-10-18T20:58:25.133 INFO:tasks.workunit.client.0.smithi008.stdout:5/222: truncate d0/f1c 1417769 0 2023-10-18T20:58:25.134 INFO:tasks.workunit.client.1.smithi060.stdout:0/257: write d3/d8/d14/f1c [1785036,46695] 0 2023-10-18T20:58:25.135 INFO:tasks.workunit.client.1.smithi060.stdout:2/250: mkdir d0/d8/d47 0 2023-10-18T20:58:25.139 INFO:tasks.workunit.client.1.smithi060.stdout:9/224: sync 2023-10-18T20:58:25.140 INFO:tasks.workunit.client.1.smithi060.stdout:6/195: sync 2023-10-18T20:58:25.140 INFO:tasks.workunit.client.0.smithi008.stdout:9/256: write d2/dc/d17/f2e [741473,116857] 0 2023-10-18T20:58:25.141 INFO:tasks.workunit.client.1.smithi060.stdout:4/202: creat d4/d15/d2b/f3b x:0 0 0 2023-10-18T20:58:25.141 INFO:tasks.workunit.client.1.smithi060.stdout:4/203: chown d4/c12 5605469 1 2023-10-18T20:58:25.142 INFO:tasks.workunit.client.0.smithi008.stdout:5/223: rename d0/cb to d0/c4f 0 2023-10-18T20:58:25.148 INFO:tasks.workunit.client.1.smithi060.stdout:1/317: rename d4/da/de/d2a/d32/f62 to d4/d6/d7/d2f/f6a 0 2023-10-18T20:58:25.149 INFO:tasks.workunit.client.1.smithi060.stdout:8/233: symlink d4/d9/d31/l42 0 2023-10-18T20:58:25.150 INFO:tasks.workunit.client.1.smithi060.stdout:8/234: stat d4/d9/l3b 0 2023-10-18T20:58:25.151 INFO:tasks.workunit.client.1.smithi060.stdout:8/235: write d4/d9/f23 [178595,126474] 0 2023-10-18T20:58:25.155 INFO:tasks.workunit.client.0.smithi008.stdout:9/257: unlink d2/d8/l10 0 2023-10-18T20:58:25.155 INFO:tasks.workunit.client.0.smithi008.stdout:9/258: readlink d2/dc/d1a/l33 0 2023-10-18T20:58:25.155 INFO:tasks.workunit.client.0.smithi008.stdout:7/276: dwrite d1/d3/d20/f47 [0,4194304] 0 2023-10-18T20:58:25.158 INFO:tasks.workunit.client.0.smithi008.stdout:5/224: unlink d0/d2/c15 0 2023-10-18T20:58:25.158 INFO:tasks.workunit.client.0.smithi008.stdout:5/225: truncate d0/d2/d19/f2f 1013942 0 2023-10-18T20:58:25.159 INFO:tasks.workunit.client.1.smithi060.stdout:3/212: unlink d0/fe 0 2023-10-18T20:58:25.166 INFO:tasks.workunit.client.1.smithi060.stdout:7/251: symlink de/d38/l51 0 2023-10-18T20:58:25.169 INFO:tasks.workunit.client.1.smithi060.stdout:5/299: mkdir d0/da/d79 0 2023-10-18T20:58:25.169 INFO:tasks.workunit.client.1.smithi060.stdout:5/300: chown d0/da/d3b 1648105 1 2023-10-18T20:58:25.171 INFO:tasks.workunit.client.1.smithi060.stdout:0/258: link d3/l15 d3/d8/d3c/l50 0 2023-10-18T20:58:25.172 INFO:tasks.workunit.client.1.smithi060.stdout:2/251: symlink d0/l48 0 2023-10-18T20:58:25.173 INFO:tasks.workunit.client.0.smithi008.stdout:9/259: dread d2/dc/d17/d19/fe [0,4194304] 0 2023-10-18T20:58:25.174 INFO:tasks.workunit.client.1.smithi060.stdout:6/196: truncate d10/d17/f23 523552 0 2023-10-18T20:58:25.177 INFO:tasks.workunit.client.1.smithi060.stdout:9/225: rename d3/d10/d1c/d2a/d2d/f40 to d3/d10/d1c/d2a/d33/f53 0 2023-10-18T20:58:25.177 INFO:tasks.workunit.client.1.smithi060.stdout:4/204: dwrite d4/dc/d2a/f1e [0,4194304] 0 2023-10-18T20:58:25.178 INFO:tasks.workunit.client.1.smithi060.stdout:4/205: write d4/f10 [4593905,66222] 0 2023-10-18T20:58:25.179 INFO:tasks.workunit.client.1.smithi060.stdout:1/318: link d4/d6/f65 d4/d6/d7/df/f6b 0 2023-10-18T20:58:25.189 INFO:tasks.workunit.client.1.smithi060.stdout:8/236: symlink d4/d9/d37/l43 0 2023-10-18T20:58:25.190 INFO:tasks.workunit.client.0.smithi008.stdout:7/277: mkdir d1/d3/d20/d5f 0 2023-10-18T20:58:25.191 INFO:tasks.workunit.client.1.smithi060.stdout:7/252: symlink de/l52 0 2023-10-18T20:58:25.192 INFO:tasks.workunit.client.1.smithi060.stdout:7/253: stat de/l52 0 2023-10-18T20:58:25.192 INFO:tasks.workunit.client.0.smithi008.stdout:5/226: getdents d0/d2/d19/d1b/d42 0 2023-10-18T20:58:25.195 INFO:tasks.workunit.client.1.smithi060.stdout:5/301: unlink d0/dd/f6e 0 2023-10-18T20:58:25.195 INFO:tasks.workunit.client.1.smithi060.stdout:5/302: write d0/f2c [1499715,115373] 0 2023-10-18T20:58:25.199 INFO:tasks.workunit.client.0.smithi008.stdout:9/260: mkdir d2/dc/d40 0 2023-10-18T20:58:25.200 INFO:tasks.workunit.client.1.smithi060.stdout:6/197: rmdir d10/d17/d28 39 2023-10-18T20:58:25.200 INFO:tasks.workunit.client.0.smithi008.stdout:5/227: dread d0/d2/d19/f2f [0,4194304] 0 2023-10-18T20:58:25.201 INFO:tasks.workunit.client.1.smithi060.stdout:3/213: rename d0/d22/d26/d2b/c41 to d0/d3c/c46 0 2023-10-18T20:58:25.201 INFO:tasks.workunit.client.1.smithi060.stdout:7/254: dread de/d29/f2b [0,4194304] 0 2023-10-18T20:58:25.202 INFO:tasks.workunit.client.0.smithi008.stdout:2/279: dwrite d1/d3/dd/d1c/f3e [4194304,4194304] 0 2023-10-18T20:58:25.202 INFO:tasks.workunit.client.0.smithi008.stdout:2/280: dread - d1/d3/dd/f58 zero size 2023-10-18T20:58:25.203 INFO:tasks.workunit.client.1.smithi060.stdout:4/206: symlink d4/dc/d2a/l3c 0 2023-10-18T20:58:25.203 INFO:tasks.workunit.client.1.smithi060.stdout:4/207: chown d4/dc/d2a/d13/f3a 44130688 1 2023-10-18T20:58:25.203 INFO:tasks.workunit.client.1.smithi060.stdout:4/208: read d4/dc/f29 [365276,112275] 0 2023-10-18T20:58:25.203 INFO:tasks.workunit.client.1.smithi060.stdout:4/209: fsync d4/dc/d2a/d13/d33/f35 0 2023-10-18T20:58:25.205 INFO:tasks.workunit.client.0.smithi008.stdout:5/228: unlink d0/d2/d19/d1b/d31/l3d 0 2023-10-18T20:58:25.205 INFO:tasks.workunit.client.0.smithi008.stdout:5/229: chown d0/d2/d9/f44 8 1 2023-10-18T20:58:25.206 INFO:tasks.workunit.client.1.smithi060.stdout:8/237: unlink d4/d9/fa 0 2023-10-18T20:58:25.206 INFO:tasks.workunit.client.1.smithi060.stdout:8/238: read d4/ff [2979627,48105] 0 2023-10-18T20:58:25.209 INFO:tasks.workunit.client.0.smithi008.stdout:7/278: dread d1/d3/f14 [0,4194304] 0 2023-10-18T20:58:25.209 INFO:tasks.workunit.client.0.smithi008.stdout:7/279: chown d1/d3/d20/l2b 46990127 1 2023-10-18T20:58:25.209 INFO:tasks.workunit.client.0.smithi008.stdout:5/230: creat d0/d2/d19/d1b/d41/f50 x:0 0 0 2023-10-18T20:58:25.210 INFO:tasks.workunit.client.1.smithi060.stdout:3/214: chown d0/l13 604738 1 2023-10-18T20:58:25.213 INFO:tasks.workunit.client.0.smithi008.stdout:7/280: unlink d1/d36/d3d/f41 0 2023-10-18T20:58:25.214 INFO:tasks.workunit.client.1.smithi060.stdout:0/259: rename d3/d8/c44 to d3/d8/d3c/c51 0 2023-10-18T20:58:25.215 INFO:tasks.workunit.client.1.smithi060.stdout:0/260: dread - d3/d8/f22 zero size 2023-10-18T20:58:25.215 INFO:tasks.workunit.client.1.smithi060.stdout:0/261: chown d3/d8/d14/l18 11927882 1 2023-10-18T20:58:25.215 INFO:tasks.workunit.client.1.smithi060.stdout:4/210: mknod d4/df/c3d 0 2023-10-18T20:58:25.215 INFO:tasks.workunit.client.1.smithi060.stdout:4/211: dread - d4/dc/d2a/d13/f3a zero size 2023-10-18T20:58:25.216 INFO:tasks.workunit.client.0.smithi008.stdout:5/231: symlink d0/d2/d19/d1b/d31/d3f/l51 0 2023-10-18T20:58:25.216 INFO:tasks.workunit.client.0.smithi008.stdout:5/232: readlink d0/d2/l1e 0 2023-10-18T20:58:25.216 INFO:tasks.workunit.client.0.smithi008.stdout:5/233: fsync d0/d2/d19/d1b/d20/f2b 0 2023-10-18T20:58:25.217 INFO:tasks.workunit.client.1.smithi060.stdout:3/215: creat d0/d3c/d3d/f47 x:0 0 0 2023-10-18T20:58:25.219 INFO:tasks.workunit.client.0.smithi008.stdout:7/281: link d1/d3/f27 d1/d36/f60 0 2023-10-18T20:58:25.224 INFO:tasks.workunit.client.1.smithi060.stdout:1/319: dwrite d4/da/de/d2a/d32/dd/f4f [0,4194304] 0 2023-10-18T20:58:25.224 INFO:tasks.workunit.client.1.smithi060.stdout:1/320: chown d4/d6/l63 204 1 2023-10-18T20:58:25.225 INFO:tasks.workunit.client.1.smithi060.stdout:7/255: rmdir de/d14/d41 39 2023-10-18T20:58:25.226 INFO:tasks.workunit.client.0.smithi008.stdout:0/207: sync 2023-10-18T20:58:25.231 INFO:tasks.workunit.client.0.smithi008.stdout:5/234: creat d0/d2/d19/d1b/d42/f52 x:0 0 0 2023-10-18T20:58:25.231 INFO:tasks.workunit.client.0.smithi008.stdout:5/235: write d0/d2/d19/d1b/f26 [5400299,12188] 0 2023-10-18T20:58:25.235 INFO:tasks.workunit.client.1.smithi060.stdout:8/239: dread d4/ff [0,4194304] 0 2023-10-18T20:58:25.235 INFO:tasks.workunit.client.1.smithi060.stdout:8/240: write d4/d9/f23 [29479,121132] 0 2023-10-18T20:58:25.239 INFO:tasks.workunit.client.0.smithi008.stdout:9/261: write d2/dc/d17/d19/fe [3405381,90706] 0 2023-10-18T20:58:25.239 INFO:tasks.workunit.client.0.smithi008.stdout:0/208: mkdir d0/dd/df/d3e 0 2023-10-18T20:58:25.240 INFO:tasks.workunit.client.1.smithi060.stdout:4/212: getdents d4/dc/d2a/d13/d33 0 2023-10-18T20:58:25.240 INFO:tasks.workunit.client.1.smithi060.stdout:4/213: write d4/dc/d2a/d1d/f21 [1792433,77284] 0 2023-10-18T20:58:25.243 INFO:tasks.workunit.client.0.smithi008.stdout:5/236: rmdir d0/d2 39 2023-10-18T20:58:25.245 INFO:tasks.workunit.client.1.smithi060.stdout:3/216: symlink d0/d22/d26/d2b/l48 0 2023-10-18T20:58:25.248 INFO:tasks.workunit.client.1.smithi060.stdout:6/198: dwrite d10/d17/f23 [0,4194304] 0 2023-10-18T20:58:25.253 INFO:tasks.workunit.client.0.smithi008.stdout:5/237: dread d0/d2/d19/f33 [0,4194304] 0 2023-10-18T20:58:25.258 INFO:tasks.workunit.client.1.smithi060.stdout:4/214: symlink d4/dc/d2a/d31/l3e 0 2023-10-18T20:58:25.259 INFO:tasks.workunit.client.1.smithi060.stdout:4/215: creat d4/dc/d2a/d13/f3f x:0 0 0 2023-10-18T20:58:25.259 INFO:tasks.workunit.client.1.smithi060.stdout:4/216: write d4/d15/d2b/f3b [456525,65638] 0 2023-10-18T20:58:25.261 INFO:tasks.workunit.client.0.smithi008.stdout:5/238: mknod d0/d2/d19/d1b/d31/c53 0 2023-10-18T20:58:25.261 INFO:tasks.workunit.client.0.smithi008.stdout:9/262: dread d2/dc/f1e [0,4194304] 0 2023-10-18T20:58:25.263 INFO:tasks.workunit.client.1.smithi060.stdout:6/199: link cf d10/d17/c43 0 2023-10-18T20:58:25.264 INFO:tasks.workunit.client.1.smithi060.stdout:6/200: creat d10/d1b/f44 x:0 0 0 2023-10-18T20:58:25.266 INFO:tasks.workunit.client.1.smithi060.stdout:2/252: rename d0/d3/d2a to d0/d45/d49 0 2023-10-18T20:58:25.266 INFO:tasks.workunit.client.1.smithi060.stdout:8/241: getdents d4/d9 0 2023-10-18T20:58:25.267 INFO:tasks.workunit.client.0.smithi008.stdout:2/281: dwrite d1/d3/dd/d25/d34/f3b [0,4194304] 0 2023-10-18T20:58:25.267 INFO:tasks.workunit.client.0.smithi008.stdout:0/209: dread d0/dd/f15 [0,4194304] 0 2023-10-18T20:58:25.271 INFO:tasks.workunit.client.0.smithi008.stdout:2/282: truncate d1/d3/dd/d25/f27 501491 0 2023-10-18T20:58:25.271 INFO:tasks.workunit.client.0.smithi008.stdout:2/283: readlink d1/d3/dd/d1c/l24 0 2023-10-18T20:58:25.272 INFO:tasks.workunit.client.1.smithi060.stdout:6/201: symlink d10/d25/l45 0 2023-10-18T20:58:25.275 INFO:tasks.workunit.client.0.smithi008.stdout:2/284: read d1/d3/dd/d25/f47 [63630,50492] 0 2023-10-18T20:58:25.275 INFO:tasks.workunit.client.0.smithi008.stdout:2/285: creat d1/d3/dd/d1c/f5e x:0 0 0 2023-10-18T20:58:25.279 INFO:tasks.workunit.client.0.smithi008.stdout:2/286: creat d1/d3/f5f x:0 0 0 2023-10-18T20:58:25.279 INFO:tasks.workunit.client.1.smithi060.stdout:2/253: mkdir d0/d43/d4a 0 2023-10-18T20:58:25.280 INFO:tasks.workunit.client.1.smithi060.stdout:8/242: rmdir d4/d9 39 2023-10-18T20:58:25.280 INFO:tasks.workunit.client.1.smithi060.stdout:0/262: dwrite d3/d8/d14/f2b [0,4194304] 0 2023-10-18T20:58:25.280 INFO:tasks.workunit.client.1.smithi060.stdout:6/202: creat d10/d17/f46 x:0 0 0 2023-10-18T20:58:25.293 INFO:tasks.workunit.client.1.smithi060.stdout:2/254: dread d0/d8/f1b [0,4194304] 0 2023-10-18T20:58:25.293 INFO:tasks.workunit.client.1.smithi060.stdout:2/255: readlink d0/d3/d27/l3e 0 2023-10-18T20:58:25.300 INFO:tasks.workunit.client.1.smithi060.stdout:3/217: dwrite d0/d3c/f40 [0,4194304] 0 2023-10-18T20:58:25.312 INFO:tasks.workunit.client.1.smithi060.stdout:0/263: symlink d3/d8/d14/d49/l52 0 2023-10-18T20:58:25.312 INFO:tasks.workunit.client.1.smithi060.stdout:6/203: mkdir d10/d47 0 2023-10-18T20:58:25.313 INFO:tasks.workunit.client.1.smithi060.stdout:0/264: write d3/f5 [4954141,89238] 0 2023-10-18T20:58:25.313 INFO:tasks.workunit.client.1.smithi060.stdout:0/265: fdatasync d3/f41 0 2023-10-18T20:58:25.313 INFO:tasks.workunit.client.1.smithi060.stdout:0/266: chown d3/d8/l4d 333691 1 2023-10-18T20:58:25.314 INFO:tasks.workunit.client.0.smithi008.stdout:8/379: sync 2023-10-18T20:58:25.314 INFO:tasks.workunit.client.1.smithi060.stdout:2/256: write d0/d8/f11 [3151944,13810] 0 2023-10-18T20:58:25.315 INFO:tasks.workunit.client.1.smithi060.stdout:9/226: rename d3/d10/d1c/d2a/d41 to d3/d10/d19/d54 0 2023-10-18T20:58:25.318 INFO:tasks.workunit.client.0.smithi008.stdout:2/287: fsync d1/d3/dd/d25/f27 0 2023-10-18T20:58:25.319 INFO:tasks.workunit.client.1.smithi060.stdout:8/243: truncate d4/f2d 181778 0 2023-10-18T20:58:25.319 INFO:tasks.workunit.client.1.smithi060.stdout:8/244: chown d4/f30 16167964 1 2023-10-18T20:58:25.323 INFO:tasks.workunit.client.0.smithi008.stdout:0/210: dwrite d0/dd/df/d2a/f33 [4194304,4194304] 0 2023-10-18T20:58:25.323 INFO:tasks.workunit.client.0.smithi008.stdout:0/211: write d0/dd/df/d2a/f38 [923796,12717] 0 2023-10-18T20:58:25.324 INFO:tasks.workunit.client.1.smithi060.stdout:0/267: symlink d3/d8/d3c/l53 0 2023-10-18T20:58:25.324 INFO:tasks.workunit.client.1.smithi060.stdout:0/268: fsync d3/d8/fa 0 2023-10-18T20:58:25.328 INFO:tasks.workunit.client.0.smithi008.stdout:0/212: read d0/f1d [85459,98219] 0 2023-10-18T20:58:25.330 INFO:tasks.workunit.client.1.smithi060.stdout:3/218: dread d0/d22/d26/d2c/f31 [0,4194304] 0 2023-10-18T20:58:25.330 INFO:tasks.workunit.client.1.smithi060.stdout:3/219: chown d0/d22/d26/d2c/l38 9 1 2023-10-18T20:58:25.330 INFO:tasks.workunit.client.1.smithi060.stdout:4/217: dwrite d4/dc/d2a/d13/f3a [0,4194304] 0 2023-10-18T20:58:25.331 INFO:tasks.workunit.client.0.smithi008.stdout:9/263: dwrite d2/dc/f14 [0,4194304] 0 2023-10-18T20:58:25.332 INFO:tasks.workunit.client.0.smithi008.stdout:2/288: dread d1/d3/dd/d1c/d3a/f3d [0,4194304] 0 2023-10-18T20:58:25.333 INFO:tasks.workunit.client.0.smithi008.stdout:8/380: dread d5/d8/df/f1b [0,4194304] 0 2023-10-18T20:58:25.334 INFO:tasks.workunit.client.0.smithi008.stdout:8/381: chown d5/d8/df/d54/c76 2465 1 2023-10-18T20:58:25.334 INFO:tasks.workunit.client.0.smithi008.stdout:8/382: truncate d5/d8/d24/f59 464332 0 2023-10-18T20:58:25.335 INFO:tasks.workunit.client.1.smithi060.stdout:1/321: rename d4/da/fc to d4/da/de/d2a/d32/d56/d67/f6c 0 2023-10-18T20:58:25.337 INFO:tasks.workunit.client.1.smithi060.stdout:9/227: symlink d3/d10/d1c/d2a/d33/d29/d2b/l55 0 2023-10-18T20:58:25.337 INFO:tasks.workunit.client.1.smithi060.stdout:9/228: fsync d3/ff 0 2023-10-18T20:58:25.340 INFO:tasks.workunit.client.0.smithi008.stdout:0/213: mknod d0/c3f 0 2023-10-18T20:58:25.340 INFO:tasks.workunit.client.1.smithi060.stdout:8/245: creat d4/d9/d31/d35/f44 x:0 0 0 2023-10-18T20:58:25.344 INFO:tasks.workunit.client.1.smithi060.stdout:9/229: dread d3/d10/d1c/f1d [0,4194304] 0 2023-10-18T20:58:25.345 INFO:tasks.workunit.client.0.smithi008.stdout:5/239: dwrite d0/d2/d19/d1b/d41/f50 [0,4194304] 0 2023-10-18T20:58:25.345 INFO:tasks.workunit.client.0.smithi008.stdout:5/240: creat d0/d2/d9/f54 x:0 0 0 2023-10-18T20:58:25.346 INFO:tasks.workunit.client.0.smithi008.stdout:5/241: creat d0/d2/d19/d1b/d31/f55 x:0 0 0 2023-10-18T20:58:25.346 INFO:tasks.workunit.client.0.smithi008.stdout:5/242: chown d0/d2/d19/d1b/d41/f50 3446042 1 2023-10-18T20:58:25.357 INFO:tasks.workunit.client.0.smithi008.stdout:2/289: creat d1/d3/dd/d25/d5c/f60 x:0 0 0 2023-10-18T20:58:25.358 INFO:tasks.workunit.client.0.smithi008.stdout:8/383: creat d5/d8/d17/d4d/f98 x:0 0 0 2023-10-18T20:58:25.359 INFO:tasks.workunit.client.0.smithi008.stdout:8/384: getdents d5/d8 0 2023-10-18T20:58:25.366 INFO:tasks.workunit.client.1.smithi060.stdout:5/303: sync 2023-10-18T20:58:25.367 INFO:tasks.workunit.client.1.smithi060.stdout:4/218: fsync d4/dc/d2a/d1d/f21 0 2023-10-18T20:58:25.367 INFO:tasks.workunit.client.1.smithi060.stdout:4/219: chown d4/f10 44 1 2023-10-18T20:58:25.367 INFO:tasks.workunit.client.1.smithi060.stdout:4/220: chown d4/dc/f19 1 1 2023-10-18T20:58:25.368 INFO:tasks.workunit.client.1.smithi060.stdout:4/221: fsync d4/dc/d2a/d1d/f21 0 2023-10-18T20:58:25.370 INFO:tasks.workunit.client.1.smithi060.stdout:6/204: dwrite fa [0,4194304] 0 2023-10-18T20:58:25.371 INFO:tasks.workunit.client.1.smithi060.stdout:6/205: stat d10/d17/d28/f21 0 2023-10-18T20:58:25.372 INFO:tasks.workunit.client.1.smithi060.stdout:3/220: symlink d0/d22/d26/d2b/l49 0 2023-10-18T20:58:25.379 INFO:tasks.workunit.client.1.smithi060.stdout:7/256: rename de/d14/d2f/f3e to de/d14/d41/f53 0 2023-10-18T20:58:25.383 INFO:tasks.workunit.client.1.smithi060.stdout:8/246: rmdir d4 39 2023-10-18T20:58:25.385 INFO:tasks.workunit.client.1.smithi060.stdout:9/230: mkdir d3/d10/d1c/d2a/d33/d29/d56 0 2023-10-18T20:58:25.387 INFO:tasks.workunit.client.1.smithi060.stdout:9/231: write d3/d10/d1c/d25/f3e [569813,35269] 0 2023-10-18T20:58:25.390 INFO:tasks.workunit.client.0.smithi008.stdout:0/214: symlink d0/dd/d19/d24/l40 0 2023-10-18T20:58:25.390 INFO:tasks.workunit.client.1.smithi060.stdout:5/304: creat d0/d6/d8/df/d27/d32/d6d/d72/f7a x:0 0 0 2023-10-18T20:58:25.392 INFO:tasks.workunit.client.1.smithi060.stdout:1/322: getdents d4/d6/d7/d2f 0 2023-10-18T20:58:25.395 INFO:tasks.workunit.client.1.smithi060.stdout:2/257: dwrite d0/d43/f44 [0,4194304] 0 2023-10-18T20:58:25.395 INFO:tasks.workunit.client.1.smithi060.stdout:2/258: readlink d0/d8/l18 0 2023-10-18T20:58:25.399 INFO:tasks.workunit.client.1.smithi060.stdout:7/257: symlink de/d14/d49/l54 0 2023-10-18T20:58:25.401 INFO:tasks.workunit.client.1.smithi060.stdout:1/323: dread d4/da/de/d2a/d32/dd/f25 [0,4194304] 0 2023-10-18T20:58:25.402 INFO:tasks.workunit.client.0.smithi008.stdout:5/243: link d0/f25 d0/d2/d19/d1b/d41/f56 0 2023-10-18T20:58:25.405 INFO:tasks.workunit.client.1.smithi060.stdout:0/269: rename d3/f33 to d3/d8/f54 0 2023-10-18T20:58:25.407 INFO:tasks.workunit.client.0.smithi008.stdout:8/385: creat d5/d8/d24/d50/d53/f99 x:0 0 0 2023-10-18T20:58:25.408 INFO:tasks.workunit.client.1.smithi060.stdout:6/206: read d10/d1b/f2b [3163233,72143] 0 2023-10-18T20:58:25.408 INFO:tasks.workunit.client.1.smithi060.stdout:6/207: dread - d10/d17/f46 zero size 2023-10-18T20:58:25.410 INFO:tasks.workunit.client.0.smithi008.stdout:0/215: rename d0/dd/df/d3e to d0/dd/d19/d41 0 2023-10-18T20:58:25.412 INFO:tasks.workunit.client.1.smithi060.stdout:5/305: dread d0/dd/d33/f3e [0,4194304] 0 2023-10-18T20:58:25.412 INFO:tasks.workunit.client.1.smithi060.stdout:5/306: chown d0/d6/d8/df/c10 1410658025 1 2023-10-18T20:58:25.414 INFO:tasks.workunit.client.1.smithi060.stdout:1/324: mkdir d4/d6/d7/d2f/d6d 0 2023-10-18T20:58:25.415 INFO:tasks.workunit.client.1.smithi060.stdout:1/325: chown d4/d6/d14/d41/c43 19352809 1 2023-10-18T20:58:25.415 INFO:tasks.workunit.client.1.smithi060.stdout:1/326: fdatasync d4/d6/d7/d2f/f39 0 2023-10-18T20:58:25.415 INFO:tasks.workunit.client.0.smithi008.stdout:5/244: creat d0/d2/f57 x:0 0 0 2023-10-18T20:58:25.416 INFO:tasks.workunit.client.1.smithi060.stdout:0/270: getdents d3/d8/d14 0 2023-10-18T20:58:25.417 INFO:tasks.workunit.client.1.smithi060.stdout:4/222: rename d4/df to d4/dc/d40 0 2023-10-18T20:58:25.417 INFO:tasks.workunit.client.1.smithi060.stdout:4/223: chown d4/dc/f19 30474 1 2023-10-18T20:58:25.417 INFO:tasks.workunit.client.1.smithi060.stdout:4/224: readlink d4/dc/l14 0 2023-10-18T20:58:25.417 INFO:tasks.workunit.client.1.smithi060.stdout:4/225: chown d4/dc/cd 3324060 1 2023-10-18T20:58:25.418 INFO:tasks.workunit.client.1.smithi060.stdout:4/226: write d4/d15/f37 [59229,24122] 0 2023-10-18T20:58:25.418 INFO:tasks.workunit.client.0.smithi008.stdout:9/264: dwrite d2/f3 [0,4194304] 0 2023-10-18T20:58:25.418 INFO:tasks.workunit.client.0.smithi008.stdout:9/265: write d2/dc/d1a/d1d/f37 [2832845,14239] 0 2023-10-18T20:58:25.418 INFO:tasks.workunit.client.0.smithi008.stdout:9/266: fdatasync d2/dc/d1a/f21 0 2023-10-18T20:58:25.419 INFO:tasks.workunit.client.1.smithi060.stdout:9/232: rename d3 to d3/d10/d1c/d2a/d33/d29/d57 22 2023-10-18T20:58:25.421 INFO:tasks.workunit.client.0.smithi008.stdout:0/216: dread d0/f1d [0,4194304] 0 2023-10-18T20:58:25.422 INFO:tasks.workunit.client.1.smithi060.stdout:3/221: dwrite d0/d22/d26/d29/f3a [0,4194304] 0 2023-10-18T20:58:25.423 INFO:tasks.workunit.client.1.smithi060.stdout:3/222: chown d0/d3c 20611 1 2023-10-18T20:58:25.425 INFO:tasks.workunit.client.0.smithi008.stdout:5/245: rename d0/de/d45 to d0/d2/d19/d1b/d58 0 2023-10-18T20:58:25.426 INFO:tasks.workunit.client.0.smithi008.stdout:0/217: read d0/dd/df/d2a/f38 [752943,91451] 0 2023-10-18T20:58:25.429 INFO:tasks.workunit.client.1.smithi060.stdout:1/327: write d4/da/de/d2a/d32/dd/f4f [178926,12671] 0 2023-10-18T20:58:25.430 INFO:tasks.workunit.client.1.smithi060.stdout:1/328: chown d4/da/d42/f64 546 1 2023-10-18T20:58:25.430 INFO:tasks.workunit.client.1.smithi060.stdout:1/329: stat d4/da/de/c54 0 2023-10-18T20:58:25.430 INFO:tasks.workunit.client.1.smithi060.stdout:1/330: fsync f1 0 2023-10-18T20:58:25.430 INFO:tasks.workunit.client.1.smithi060.stdout:1/331: write d4/d6/d7/df/f40 [1164506,63472] 0 2023-10-18T20:58:25.430 INFO:tasks.workunit.client.1.smithi060.stdout:1/332: chown d4/d6/d7/d2f/d6d 2349 1 2023-10-18T20:58:25.431 INFO:tasks.workunit.client.1.smithi060.stdout:1/333: write d4/d6/d7/df/f15 [1197931,78584] 0 2023-10-18T20:58:25.436 INFO:tasks.workunit.client.1.smithi060.stdout:5/307: mknod d0/d6/d8/d60/c7b 0 2023-10-18T20:58:25.437 INFO:tasks.workunit.client.1.smithi060.stdout:2/259: rename d0/d8/fa to d0/d8/d47/f4b 0 2023-10-18T20:58:25.437 INFO:tasks.workunit.client.1.smithi060.stdout:5/308: truncate d0/da/d3b/f65 39932 0 2023-10-18T20:58:25.437 INFO:tasks.workunit.client.1.smithi060.stdout:9/233: getdents d3/d10/d1c/d2a/d33/d29/d2b 0 2023-10-18T20:58:25.437 INFO:tasks.workunit.client.1.smithi060.stdout:9/234: dread - d3/f50 zero size 2023-10-18T20:58:25.437 INFO:tasks.workunit.client.1.smithi060.stdout:9/235: truncate f2 1029484 0 2023-10-18T20:58:25.438 INFO:tasks.workunit.client.1.smithi060.stdout:2/260: creat d0/d3/d27/f4c x:0 0 0 2023-10-18T20:58:25.438 INFO:tasks.workunit.client.1.smithi060.stdout:4/227: dread d4/dc/d2a/f1e [0,4194304] 0 2023-10-18T20:58:25.438 INFO:tasks.workunit.client.1.smithi060.stdout:3/223: symlink d0/d22/d26/l4a 0 2023-10-18T20:58:25.439 INFO:tasks.workunit.client.0.smithi008.stdout:9/267: creat d2/dc/d17/d19/f41 x:0 0 0 2023-10-18T20:58:25.439 INFO:tasks.workunit.client.1.smithi060.stdout:6/208: rmdir d10/d17 39 2023-10-18T20:58:25.439 INFO:tasks.workunit.client.1.smithi060.stdout:6/209: dread - d10/d2e/f33 zero size 2023-10-18T20:58:25.440 INFO:tasks.workunit.client.0.smithi008.stdout:5/246: link d0/f29 d0/d2/d19/d1b/d20/f59 0 2023-10-18T20:58:25.441 INFO:tasks.workunit.client.0.smithi008.stdout:0/218: mknod d0/dd/d19/d41/c42 0 2023-10-18T20:58:25.442 INFO:tasks.workunit.client.0.smithi008.stdout:0/219: fsync d0/dd/df/f1c 0 2023-10-18T20:58:25.443 INFO:tasks.workunit.client.0.smithi008.stdout:0/220: readlink d0/dd/d19/d24/l40 0 2023-10-18T20:58:25.443 INFO:tasks.workunit.client.0.smithi008.stdout:0/221: chown d0/dd/df/d2a 426 1 2023-10-18T20:58:25.443 INFO:tasks.workunit.client.0.smithi008.stdout:0/222: write d0/dd/d29/f30 [1307002,52454] 0 2023-10-18T20:58:25.443 INFO:tasks.workunit.client.0.smithi008.stdout:0/223: write d0/dd/d29/f39 [294328,92637] 0 2023-10-18T20:58:25.444 INFO:tasks.workunit.client.1.smithi060.stdout:5/309: dread d0/d6/d8/df/d27/f3c [0,4194304] 0 2023-10-18T20:58:25.444 INFO:tasks.workunit.client.1.smithi060.stdout:5/310: chown d0/d6/d8/df/d27/d32/d6d/d72/d2a/f5a 6388 1 2023-10-18T20:58:25.453 INFO:tasks.workunit.client.0.smithi008.stdout:1/389: sync 2023-10-18T20:58:25.454 INFO:tasks.workunit.client.0.smithi008.stdout:3/226: sync 2023-10-18T20:58:25.454 INFO:tasks.workunit.client.0.smithi008.stdout:4/251: sync 2023-10-18T20:58:25.455 INFO:tasks.workunit.client.0.smithi008.stdout:6/276: sync 2023-10-18T20:58:25.455 INFO:tasks.workunit.client.0.smithi008.stdout:4/252: dread - d0/d3/d21/f54 zero size 2023-10-18T20:58:25.455 INFO:tasks.workunit.client.0.smithi008.stdout:4/253: chown d0/d3/d48/d4c/l59 31 1 2023-10-18T20:58:25.455 INFO:tasks.workunit.client.0.smithi008.stdout:4/254: write d0/f27 [339358,125643] 0 2023-10-18T20:58:25.458 INFO:tasks.workunit.client.0.smithi008.stdout:9/268: mkdir d2/dc/d17/d19/d42 0 2023-10-18T20:58:25.459 INFO:tasks.workunit.client.0.smithi008.stdout:8/386: dwrite d5/d8/d17/f1d [0,4194304] 0 2023-10-18T20:58:25.461 INFO:tasks.workunit.client.1.smithi060.stdout:7/258: rename de/d14/d2f/d3f/f4c to de/d14/d49/f55 0 2023-10-18T20:58:25.461 INFO:tasks.workunit.client.1.smithi060.stdout:7/259: fdatasync de/f27 0 2023-10-18T20:58:25.464 INFO:tasks.workunit.client.1.smithi060.stdout:9/236: mkdir d3/d58 0 2023-10-18T20:58:25.465 INFO:tasks.workunit.client.1.smithi060.stdout:0/271: dwrite d3/d8/d14/d49/f46 [0,4194304] 0 2023-10-18T20:58:25.466 INFO:tasks.workunit.client.0.smithi008.stdout:3/227: creat d0/d3/d15/f44 x:0 0 0 2023-10-18T20:58:25.467 INFO:tasks.workunit.client.1.smithi060.stdout:2/261: mkdir d0/d3/d27/d4d 0 2023-10-18T20:58:25.467 INFO:tasks.workunit.client.1.smithi060.stdout:2/262: chown d0/d43/f44 396340793 1 2023-10-18T20:58:25.468 INFO:tasks.workunit.client.0.smithi008.stdout:0/224: dread d0/dd/f15 [0,4194304] 0 2023-10-18T20:58:25.468 INFO:tasks.workunit.client.0.smithi008.stdout:0/225: fdatasync d0/f3 0 2023-10-18T20:58:25.469 INFO:tasks.workunit.client.1.smithi060.stdout:3/224: chown d0/fc 1375 1 2023-10-18T20:58:25.470 INFO:tasks.workunit.client.1.smithi060.stdout:5/311: mknod d0/d6/d8/df/d27/d32/d6d/c7c 0 2023-10-18T20:58:25.472 INFO:tasks.workunit.client.1.smithi060.stdout:7/260: rename de/d14/d1d/f34 to de/d14/d3a/f56 0 2023-10-18T20:58:25.473 INFO:tasks.workunit.client.0.smithi008.stdout:9/269: mknod d2/dc/d17/c43 0 2023-10-18T20:58:25.474 INFO:tasks.workunit.client.0.smithi008.stdout:8/387: creat d5/d8/df/f9a x:0 0 0 2023-10-18T20:58:25.474 INFO:tasks.workunit.client.0.smithi008.stdout:8/388: write d5/d8/d17/d4d/f7c [403476,86898] 0 2023-10-18T20:58:25.477 INFO:tasks.workunit.client.1.smithi060.stdout:4/228: read d4/dc/d2a/d13/d33/f35 [1622452,54943] 0 2023-10-18T20:58:25.478 INFO:tasks.workunit.client.1.smithi060.stdout:1/334: dwrite d4/da/de/d2a/d32/dd/f5c [0,4194304] 0 2023-10-18T20:58:25.480 INFO:tasks.workunit.client.1.smithi060.stdout:9/237: symlink d3/d10/d19/d54/l59 0 2023-10-18T20:58:25.480 INFO:tasks.workunit.client.1.smithi060.stdout:9/238: truncate d3/d10/d1c/d2a/f3b 541797 0 2023-10-18T20:58:25.481 INFO:tasks.workunit.client.1.smithi060.stdout:9/239: write d3/d10/d1c/d2a/f52 [862110,39947] 0 2023-10-18T20:58:25.481 INFO:tasks.workunit.client.0.smithi008.stdout:0/226: dread d0/dd/f18 [0,4194304] 0 2023-10-18T20:58:25.484 INFO:tasks.workunit.client.0.smithi008.stdout:4/255: dread d0/d17/f3d [4194304,4194304] 0 2023-10-18T20:58:25.484 INFO:tasks.workunit.client.0.smithi008.stdout:1/390: link d9/de/df/d17/d1e/f4c d9/de/df/d17/d55/f78 0 2023-10-18T20:58:25.485 INFO:tasks.workunit.client.0.smithi008.stdout:5/247: getdents d0/d2/d19/d1b/d20 0 2023-10-18T20:58:25.486 INFO:tasks.workunit.client.1.smithi060.stdout:0/272: mkdir d3/d8/d14/d55 0 2023-10-18T20:58:25.486 INFO:tasks.workunit.client.1.smithi060.stdout:7/261: write de/d14/d49/f55 [3522312,111621] 0 2023-10-18T20:58:25.491 INFO:tasks.workunit.client.1.smithi060.stdout:2/263: truncate d0/d16/f19 902989 0 2023-10-18T20:58:25.492 INFO:tasks.workunit.client.1.smithi060.stdout:6/210: dwrite f7 [0,4194304] 0 2023-10-18T20:58:25.492 INFO:tasks.workunit.client.0.smithi008.stdout:3/228: symlink d0/d3/de/d13/d35/l45 0 2023-10-18T20:58:25.493 INFO:tasks.workunit.client.0.smithi008.stdout:3/229: readlink d0/d3/d37/l3d 0 2023-10-18T20:58:25.493 INFO:tasks.workunit.client.1.smithi060.stdout:3/225: chown d0/l17 14220248 1 2023-10-18T20:58:25.495 INFO:tasks.workunit.client.1.smithi060.stdout:5/312: truncate d0/d6/d9/f14 3295388 0 2023-10-18T20:58:25.498 INFO:tasks.workunit.client.0.smithi008.stdout:1/391: dread d9/de/df/d17/d25/f32 [0,4194304] 0 2023-10-18T20:58:25.498 INFO:tasks.workunit.client.0.smithi008.stdout:1/392: truncate d9/de/df/d17/d25/f44 1879458 0 2023-10-18T20:58:25.501 INFO:tasks.workunit.client.1.smithi060.stdout:4/229: creat d4/dc/d40/f41 x:0 0 0 2023-10-18T20:58:25.505 INFO:tasks.workunit.client.0.smithi008.stdout:9/270: truncate d2/dc/d17/f16 652124 0 2023-10-18T20:58:25.505 INFO:tasks.workunit.client.0.smithi008.stdout:9/271: creat d2/dc/d1a/d1d/f44 x:0 0 0 2023-10-18T20:58:25.505 INFO:tasks.workunit.client.0.smithi008.stdout:8/389: symlink d5/d8/d17/l9b 0 2023-10-18T20:58:25.506 INFO:tasks.workunit.client.1.smithi060.stdout:1/335: mkdir d4/da/d6e 0 2023-10-18T20:58:25.507 INFO:tasks.workunit.client.0.smithi008.stdout:0/227: creat d0/dd/d19/d41/f43 x:0 0 0 2023-10-18T20:58:25.508 INFO:tasks.workunit.client.0.smithi008.stdout:0/228: creat d0/dd/d19/d24/f44 x:0 0 0 2023-10-18T20:58:25.508 INFO:tasks.workunit.client.0.smithi008.stdout:0/229: write d0/dd/f18 [2012924,51392] 0 2023-10-18T20:58:25.510 INFO:tasks.workunit.client.0.smithi008.stdout:0/230: write d0/dd/d29/f39 [360274,48749] 0 2023-10-18T20:58:25.510 INFO:tasks.workunit.client.0.smithi008.stdout:0/231: chown d0/l1f 101784 1 2023-10-18T20:58:25.510 INFO:tasks.workunit.client.0.smithi008.stdout:0/232: write d0/dd/df/f1c [864297,58096] 0 2023-10-18T20:58:25.510 INFO:tasks.workunit.client.0.smithi008.stdout:0/233: fsync d0/dd/f27 0 2023-10-18T20:58:25.511 INFO:tasks.workunit.client.1.smithi060.stdout:9/240: mkdir d3/d10/d1c/d5a 0 2023-10-18T20:58:25.516 INFO:tasks.workunit.client.0.smithi008.stdout:5/248: mkdir d0/d2/d19/d1b/d42/d5a 0 2023-10-18T20:58:25.517 INFO:tasks.workunit.client.1.smithi060.stdout:4/230: dread d4/dc/d2a/d1d/f21 [0,4194304] 0 2023-10-18T20:58:25.517 INFO:tasks.workunit.client.1.smithi060.stdout:0/273: symlink d3/d8/d14/d55/l56 0 2023-10-18T20:58:25.525 INFO:tasks.workunit.client.0.smithi008.stdout:1/393: unlink d9/de/df/l14 0 2023-10-18T20:58:25.526 INFO:tasks.workunit.client.0.smithi008.stdout:3/230: rename d0/d3/de/d13/d35/f41 to d0/d3/de/d13/f46 0 2023-10-18T20:58:25.526 INFO:tasks.workunit.client.0.smithi008.stdout:3/231: creat d0/d3/de/d13/d35/f47 x:0 0 0 2023-10-18T20:58:25.531 INFO:tasks.workunit.client.1.smithi060.stdout:3/226: mknod d0/d22/d26/c4b 0 2023-10-18T20:58:25.532 INFO:tasks.workunit.client.1.smithi060.stdout:2/264: truncate d0/d8/f3d 869788 0 2023-10-18T20:58:25.532 INFO:tasks.workunit.client.1.smithi060.stdout:5/313: mkdir d0/d47/d7d 0 2023-10-18T20:58:25.533 INFO:tasks.workunit.client.1.smithi060.stdout:5/314: chown d0/d6/d8/df/d27/d32/d6d/d72/d2a/c77 68 1 2023-10-18T20:58:25.533 INFO:tasks.workunit.client.1.smithi060.stdout:1/336: creat d4/d6/d7/df/d59/f6f x:0 0 0 2023-10-18T20:58:25.534 INFO:tasks.workunit.client.0.smithi008.stdout:9/272: rename d2/dc/d1a/d1d/l2d to d2/dc/d17/l45 0 2023-10-18T20:58:25.534 INFO:tasks.workunit.client.0.smithi008.stdout:9/273: chown d2/dc/d17 141326265 1 2023-10-18T20:58:25.536 INFO:tasks.workunit.client.1.smithi060.stdout:4/231: rename d4/dc/d2a/d2d/l38 to d4/d15/l42 0 2023-10-18T20:58:25.537 INFO:tasks.workunit.client.1.smithi060.stdout:4/232: write d4/dc/d2a/d1d/f21 [125921,2658] 0 2023-10-18T20:58:25.538 INFO:tasks.workunit.client.1.smithi060.stdout:2/265: unlink d0/f22 0 2023-10-18T20:58:25.539 INFO:tasks.workunit.client.1.smithi060.stdout:3/227: creat d0/d22/d26/d2b/f4c x:0 0 0 2023-10-18T20:58:25.539 INFO:tasks.workunit.client.0.smithi008.stdout:4/256: dread d0/d17/f1a [0,4194304] 0 2023-10-18T20:58:25.543 INFO:tasks.workunit.client.1.smithi060.stdout:4/233: link d4/dc/d2a/d13/d2f/f34 d4/f43 0 2023-10-18T20:58:25.544 INFO:tasks.workunit.client.1.smithi060.stdout:4/234: chown d4/c28 0 1 2023-10-18T20:58:25.544 INFO:tasks.workunit.client.1.smithi060.stdout:5/315: dread d0/da/d3b/f65 [0,4194304] 0 2023-10-18T20:58:25.544 INFO:tasks.workunit.client.0.smithi008.stdout:5/249: rename d0/d2/d9/d34/c35 to d0/de/c5b 0 2023-10-18T20:58:25.546 INFO:tasks.workunit.client.0.smithi008.stdout:9/274: mkdir d2/dc/d40/d46 0 2023-10-18T20:58:25.548 INFO:tasks.workunit.client.1.smithi060.stdout:2/266: dread d0/d16/f41 [0,4194304] 0 2023-10-18T20:58:25.551 INFO:tasks.workunit.client.1.smithi060.stdout:0/274: rename d3/d8/fa to d3/d8/f57 0 2023-10-18T20:58:25.552 INFO:tasks.workunit.client.1.smithi060.stdout:3/228: mkdir d0/d3c/d3d/d4d 0 2023-10-18T20:58:25.553 INFO:tasks.workunit.client.0.smithi008.stdout:5/250: rename d0/d2/d9/f11 to d0/d2/d9/d34/f5c 0 2023-10-18T20:58:25.553 INFO:tasks.workunit.client.1.smithi060.stdout:7/262: dwrite de/ff [0,4194304] 0 2023-10-18T20:58:25.554 INFO:tasks.workunit.client.1.smithi060.stdout:6/211: dwrite d10/d1b/f41 [0,4194304] 0 2023-10-18T20:58:25.556 INFO:tasks.workunit.client.1.smithi060.stdout:3/229: write d0/f1f [165088,12261] 0 2023-10-18T20:58:25.560 INFO:tasks.workunit.client.1.smithi060.stdout:0/275: rename d3/d8/d14/d49/f46 to d3/d8/d14/d55/f58 0 2023-10-18T20:58:25.562 INFO:tasks.workunit.client.1.smithi060.stdout:4/235: read d4/dc/d2a/f1e [265402,80692] 0 2023-10-18T20:58:25.562 INFO:tasks.workunit.client.1.smithi060.stdout:4/236: unlink d4/dc/f19 0 2023-10-18T20:58:25.565 INFO:tasks.workunit.client.0.smithi008.stdout:3/232: write d0/d3/d15/f1a [1232302,96974] 0 2023-10-18T20:58:25.574 INFO:tasks.workunit.client.0.smithi008.stdout:1/394: dread d9/de/f45 [0,4194304] 0 2023-10-18T20:58:25.577 INFO:tasks.workunit.client.0.smithi008.stdout:0/234: dwrite d0/dd/df/d2a/f2d [8388608,4194304] 0 2023-10-18T20:58:25.579 INFO:tasks.workunit.client.0.smithi008.stdout:4/257: write d0/d17/f3a [10656954,105301] 0 2023-10-18T20:58:25.579 INFO:tasks.workunit.client.0.smithi008.stdout:4/258: fdatasync d0/d17/d5b/f11 0 2023-10-18T20:58:25.581 INFO:tasks.workunit.client.1.smithi060.stdout:5/316: dread d0/d6/d8/f11 [0,4194304] 0 2023-10-18T20:58:25.582 INFO:tasks.workunit.client.0.smithi008.stdout:8/390: dwrite d5/d8/d24/d50/f5e [0,4194304] 0 2023-10-18T20:58:25.584 INFO:tasks.workunit.client.1.smithi060.stdout:5/317: write d0/f2c [907354,25169] 0 2023-10-18T20:58:25.585 INFO:tasks.workunit.client.1.smithi060.stdout:7/263: dwrite de/d14/d1d/f4e [0,4194304] 0 2023-10-18T20:58:25.585 INFO:tasks.workunit.client.1.smithi060.stdout:8/247: sync 2023-10-18T20:58:25.589 INFO:tasks.workunit.client.1.smithi060.stdout:3/230: creat d0/f4e x:0 0 0 2023-10-18T20:58:25.589 INFO:tasks.workunit.client.1.smithi060.stdout:3/231: chown d0/d3c/f40 7461 1 2023-10-18T20:58:25.590 INFO:tasks.workunit.client.0.smithi008.stdout:3/233: symlink d0/d3/d15/l48 0 2023-10-18T20:58:25.593 INFO:tasks.workunit.client.1.smithi060.stdout:0/276: mknod d3/d8/d14/c59 0 2023-10-18T20:58:25.596 INFO:tasks.workunit.client.1.smithi060.stdout:9/241: dwrite d3/d10/d1c/d2a/d33/d29/d2b/f35 [0,4194304] 0 2023-10-18T20:58:25.597 INFO:tasks.workunit.client.0.smithi008.stdout:1/395: link d9/f54 d9/de/df/d17/d55/f79 0 2023-10-18T20:58:25.607 INFO:tasks.workunit.client.1.smithi060.stdout:5/318: write d0/d6/f42 [4168773,56027] 0 2023-10-18T20:58:25.607 INFO:tasks.workunit.client.1.smithi060.stdout:5/319: fdatasync d0/d6/d8/f21 0 2023-10-18T20:58:25.615 INFO:tasks.workunit.client.0.smithi008.stdout:4/259: truncate d0/d17/d5b/fa 1746202 0 2023-10-18T20:58:25.619 INFO:tasks.workunit.client.1.smithi060.stdout:0/277: rename d3/l1e to d3/l5a 0 2023-10-18T20:58:25.619 INFO:tasks.workunit.client.1.smithi060.stdout:0/278: fsync d3/d8/f54 0 2023-10-18T20:58:25.620 INFO:tasks.workunit.client.1.smithi060.stdout:0/279: readlink d3/d8/d3c/l50 0 2023-10-18T20:58:25.620 INFO:tasks.workunit.client.1.smithi060.stdout:6/212: dwrite d10/d1b/f22 [0,4194304] 0 2023-10-18T20:58:25.626 INFO:tasks.workunit.client.0.smithi008.stdout:8/391: creat d5/d8/d17/d85/f9c x:0 0 0 2023-10-18T20:58:25.629 INFO:tasks.workunit.client.0.smithi008.stdout:5/251: dread d0/f3 [0,4194304] 0 2023-10-18T20:58:25.630 INFO:tasks.workunit.client.0.smithi008.stdout:5/252: fsync d0/d2/d19/d1b/d20/f59 0 2023-10-18T20:58:25.630 INFO:tasks.workunit.client.0.smithi008.stdout:5/253: chown d0/d2/d19/d1b/d31/d3f/l51 28698 1 2023-10-18T20:58:25.630 INFO:tasks.workunit.client.0.smithi008.stdout:5/254: stat d0/c40 0 2023-10-18T20:58:25.633 INFO:tasks.workunit.client.1.smithi060.stdout:6/213: dread f8 [0,4194304] 0 2023-10-18T20:58:25.638 INFO:tasks.workunit.client.0.smithi008.stdout:3/234: link d0/d3/de/f10 d0/d3/de/d13/f49 0 2023-10-18T20:58:25.651 INFO:tasks.workunit.client.1.smithi060.stdout:9/242: mknod d3/d10/d19/c5b 0 2023-10-18T20:58:25.655 INFO:tasks.workunit.client.0.smithi008.stdout:1/396: dwrite d9/de/f45 [0,4194304] 0 2023-10-18T20:58:25.658 INFO:tasks.workunit.client.1.smithi060.stdout:7/264: dwrite de/d14/f2d [0,4194304] 0 2023-10-18T20:58:25.658 INFO:tasks.workunit.client.0.smithi008.stdout:3/235: mkdir d0/d4a 0 2023-10-18T20:58:25.659 INFO:tasks.workunit.client.0.smithi008.stdout:3/236: unlink d0/c16 0 2023-10-18T20:58:25.663 INFO:tasks.workunit.client.1.smithi060.stdout:0/280: creat d3/d8/d14/f5b x:0 0 0 2023-10-18T20:58:25.668 INFO:tasks.workunit.client.0.smithi008.stdout:4/260: dwrite d0/d17/d5b/f26 [0,4194304] 0 2023-10-18T20:58:25.669 INFO:tasks.workunit.client.1.smithi060.stdout:9/243: truncate d3/f1b 1748804 0 2023-10-18T20:58:25.669 INFO:tasks.workunit.client.1.smithi060.stdout:9/244: chown d3/d10/d1c/d2a/f3b 627422 1 2023-10-18T20:58:25.670 INFO:tasks.workunit.client.1.smithi060.stdout:9/245: readlink d3/d10/d1c/d2a/l39 0 2023-10-18T20:58:25.670 INFO:tasks.workunit.client.1.smithi060.stdout:9/246: write d3/d10/fe [410374,96830] 0 2023-10-18T20:58:25.672 INFO:tasks.workunit.client.0.smithi008.stdout:8/392: rename d5/d8/d17 to d5/d8/df/d9d 0 2023-10-18T20:58:25.672 INFO:tasks.workunit.client.1.smithi060.stdout:5/320: mknod d0/d6/c7e 0 2023-10-18T20:58:25.673 INFO:tasks.workunit.client.1.smithi060.stdout:5/321: read - d0/d6/d8/df/d27/d32/d6d/d72/d41/f75 zero size 2023-10-18T20:58:25.676 INFO:tasks.workunit.client.1.smithi060.stdout:0/281: unlink d3/f13 0 2023-10-18T20:58:25.676 INFO:tasks.workunit.client.1.smithi060.stdout:0/282: getdents d3/d32 0 2023-10-18T20:58:25.679 INFO:tasks.workunit.client.1.smithi060.stdout:9/247: creat d3/d10/d1c/d2a/d2d/f5c x:0 0 0 2023-10-18T20:58:25.681 INFO:tasks.workunit.client.1.smithi060.stdout:5/322: creat d0/da/d61/f7f x:0 0 0 2023-10-18T20:58:25.687 INFO:tasks.workunit.client.0.smithi008.stdout:4/261: mknod d0/d17/d5b/d2a/c5c 0 2023-10-18T20:58:25.687 INFO:tasks.workunit.client.0.smithi008.stdout:3/237: rename d0/d3/de/f10 to d0/d4a/f4b 0 2023-10-18T20:58:25.687 INFO:tasks.workunit.client.0.smithi008.stdout:3/238: chown d0/d3/d15/f44 222162 1 2023-10-18T20:58:25.687 INFO:tasks.workunit.client.0.smithi008.stdout:3/239: dread - d0/d3/de/d13/d35/f47 zero size 2023-10-18T20:58:25.688 INFO:tasks.workunit.client.0.smithi008.stdout:3/240: fdatasync d0/d3/de/d13/f46 0 2023-10-18T20:58:25.688 INFO:tasks.workunit.client.0.smithi008.stdout:3/241: write d0/d3/de/d13/d35/f47 [2806,70174] 0 2023-10-18T20:58:25.688 INFO:tasks.workunit.client.0.smithi008.stdout:3/242: fdatasync d0/d3/f31 0 2023-10-18T20:58:25.688 INFO:tasks.workunit.client.0.smithi008.stdout:8/393: symlink d5/d8/d24/l9e 0 2023-10-18T20:58:25.689 INFO:tasks.workunit.client.1.smithi060.stdout:9/248: rename d3/d10/d1c/d2a/d33/d29 to d3/d10/d1c/d5a/d5d 0 2023-10-18T20:58:25.690 INFO:tasks.workunit.client.0.smithi008.stdout:3/243: creat d0/d3/d37/f4c x:0 0 0 2023-10-18T20:58:25.693 INFO:tasks.workunit.client.1.smithi060.stdout:7/265: dread de/d14/d3a/f3b [0,4194304] 0 2023-10-18T20:58:25.694 INFO:tasks.workunit.client.0.smithi008.stdout:0/235: truncate d0/dd/d29/f39 181955 0 2023-10-18T20:58:25.694 INFO:tasks.workunit.client.0.smithi008.stdout:8/394: rename d5/d8/d24/d8f to d5/d8/d24/d9f 0 2023-10-18T20:58:25.696 INFO:tasks.workunit.client.0.smithi008.stdout:9/275: dwrite d2/dc/d1a/d1d/f44 [0,4194304] 0 2023-10-18T20:58:25.697 INFO:tasks.workunit.client.1.smithi060.stdout:9/249: creat d3/f5e x:0 0 0 2023-10-18T20:58:25.697 INFO:tasks.workunit.client.1.smithi060.stdout:9/250: creat d3/f5f x:0 0 0 2023-10-18T20:58:25.699 INFO:tasks.workunit.client.0.smithi008.stdout:3/244: rename d0/d3/de/d13/l26 to d0/d3/l4d 0 2023-10-18T20:58:25.699 INFO:tasks.workunit.client.0.smithi008.stdout:0/236: rmdir d0/dd/df/d20 39 2023-10-18T20:58:25.700 INFO:tasks.workunit.client.0.smithi008.stdout:0/237: read d0/dd/df/d2a/f38 [547239,102826] 0 2023-10-18T20:58:25.700 INFO:tasks.workunit.client.1.smithi060.stdout:7/266: read de/d29/f2b [277578,87452] 0 2023-10-18T20:58:25.702 INFO:tasks.workunit.client.0.smithi008.stdout:4/262: dread d0/f12 [4194304,4194304] 0 2023-10-18T20:58:25.704 INFO:tasks.workunit.client.1.smithi060.stdout:9/251: mknod d3/d10/d1c/d2a/c60 0 2023-10-18T20:58:25.704 INFO:tasks.workunit.client.1.smithi060.stdout:9/252: fdatasync d3/d10/d19/d54/f51 0 2023-10-18T20:58:25.705 INFO:tasks.workunit.client.0.smithi008.stdout:8/395: symlink d5/d8/df/d9d/d85/la0 0 2023-10-18T20:58:25.705 INFO:tasks.workunit.client.1.smithi060.stdout:6/214: dwrite d10/d17/f46 [0,4194304] 0 2023-10-18T20:58:25.711 INFO:tasks.workunit.client.1.smithi060.stdout:5/323: dread d0/d6/d8/df/d27/d32/d6d/d72/f40 [0,4194304] 0 2023-10-18T20:58:25.712 INFO:tasks.workunit.client.1.smithi060.stdout:5/324: truncate d0/d6/d8/f44 715074 0 2023-10-18T20:58:25.712 INFO:tasks.workunit.client.0.smithi008.stdout:1/397: dwrite d9/de/df/d17/d55/f79 [0,4194304] 0 2023-10-18T20:58:25.713 INFO:tasks.workunit.client.1.smithi060.stdout:2/267: sync 2023-10-18T20:58:25.714 INFO:tasks.workunit.client.1.smithi060.stdout:1/337: sync 2023-10-18T20:58:25.715 INFO:tasks.workunit.client.1.smithi060.stdout:7/267: rmdir de/d38 39 2023-10-18T20:58:25.715 INFO:tasks.workunit.client.1.smithi060.stdout:4/237: sync 2023-10-18T20:58:25.716 INFO:tasks.workunit.client.1.smithi060.stdout:4/238: readlink d4/dc/d2a/d31/l3e 0 2023-10-18T20:58:25.720 INFO:tasks.workunit.client.1.smithi060.stdout:6/215: rmdir d10/d17/d28 39 2023-10-18T20:58:25.721 INFO:tasks.workunit.client.0.smithi008.stdout:5/255: dwrite d0/d2/d19/d1b/d41/f56 [0,4194304] 0 2023-10-18T20:58:25.723 INFO:tasks.workunit.client.1.smithi060.stdout:5/325: mknod d0/da/d3b/c80 0 2023-10-18T20:58:25.724 INFO:tasks.workunit.client.1.smithi060.stdout:5/326: write d0/da/d3b/f65 [694889,107357] 0 2023-10-18T20:58:25.726 INFO:tasks.workunit.client.1.smithi060.stdout:0/283: dwrite d3/d8/f2d [0,4194304] 0 2023-10-18T20:58:25.727 INFO:tasks.workunit.client.0.smithi008.stdout:3/245: link d0/d3/f29 d0/d3/de/d13/f4e 0 2023-10-18T20:58:25.728 INFO:tasks.workunit.client.1.smithi060.stdout:1/338: truncate d4/d6/f3e 310361 0 2023-10-18T20:58:25.729 INFO:tasks.workunit.client.1.smithi060.stdout:6/216: symlink d10/d47/l48 0 2023-10-18T20:58:25.731 INFO:tasks.workunit.client.0.smithi008.stdout:9/276: rename d2/dc/d1a/l33 to d2/dc/d3d/l47 0 2023-10-18T20:58:25.731 INFO:tasks.workunit.client.0.smithi008.stdout:9/277: chown d2/dc/d1a/d1d/l27 29363687 1 2023-10-18T20:58:25.745 INFO:tasks.workunit.client.0.smithi008.stdout:0/238: mknod d0/dd/d19/d24/c45 0 2023-10-18T20:58:25.747 INFO:tasks.workunit.client.1.smithi060.stdout:7/268: read fc [2775368,94736] 0 2023-10-18T20:58:25.748 INFO:tasks.workunit.client.0.smithi008.stdout:1/398: read - d9/de/df/d17/f6a zero size 2023-10-18T20:58:25.748 INFO:tasks.workunit.client.1.smithi060.stdout:5/327: mkdir d0/d6/d8/d81 0 2023-10-18T20:58:25.756 INFO:tasks.workunit.client.0.smithi008.stdout:5/256: mknod d0/d2/d19/d1b/d42/d5a/c5d 0 2023-10-18T20:58:25.757 INFO:tasks.workunit.client.0.smithi008.stdout:5/257: creat d0/d2/d19/d1b/d41/f5e x:0 0 0 2023-10-18T20:58:25.757 INFO:tasks.workunit.client.0.smithi008.stdout:5/258: fsync d0/d2/d19/f2f 0 2023-10-18T20:58:25.758 INFO:tasks.workunit.client.0.smithi008.stdout:2/290: sync 2023-10-18T20:58:25.758 INFO:tasks.workunit.client.0.smithi008.stdout:7/282: sync 2023-10-18T20:58:25.761 INFO:tasks.workunit.client.0.smithi008.stdout:9/278: dread d2/dc/f14 [0,4194304] 0 2023-10-18T20:58:25.764 INFO:tasks.workunit.client.1.smithi060.stdout:0/284: creat d3/d8/d3c/f5c x:0 0 0 2023-10-18T20:58:25.765 INFO:tasks.workunit.client.0.smithi008.stdout:4/263: rename d0/d3/d21/f54 to d0/d17/d5b/d2a/f5d 0 2023-10-18T20:58:25.765 INFO:tasks.workunit.client.0.smithi008.stdout:4/264: readlink d0/d3/d21/l22 0 2023-10-18T20:58:25.766 INFO:tasks.workunit.client.1.smithi060.stdout:9/253: dwrite d3/d10/d1c/d2a/d33/f53 [0,4194304] 0 2023-10-18T20:58:25.766 INFO:tasks.workunit.client.1.smithi060.stdout:9/254: creat d3/d10/d1c/d2a/d2d/f61 x:0 0 0 2023-10-18T20:58:25.766 INFO:tasks.workunit.client.1.smithi060.stdout:9/255: readlink d3/d10/d19/d54/l59 0 2023-10-18T20:58:25.767 INFO:tasks.workunit.client.1.smithi060.stdout:2/268: dwrite d0/d3/f32 [0,4194304] 0 2023-10-18T20:58:25.768 INFO:tasks.workunit.client.1.smithi060.stdout:6/217: dread d10/d1b/f2b [0,4194304] 0 2023-10-18T20:58:25.768 INFO:tasks.workunit.client.1.smithi060.stdout:6/218: chown d10/d25/l3d 15889 1 2023-10-18T20:58:25.770 INFO:tasks.workunit.client.1.smithi060.stdout:1/339: creat d4/d6/d7/d2f/f70 x:0 0 0 2023-10-18T20:58:25.777 INFO:tasks.workunit.client.0.smithi008.stdout:3/246: rmdir d0/d3/d15 39 2023-10-18T20:58:25.778 INFO:tasks.workunit.client.0.smithi008.stdout:3/247: chown d0/d3/de/c19 747 1 2023-10-18T20:58:25.778 INFO:tasks.workunit.client.1.smithi060.stdout:3/232: sync 2023-10-18T20:58:25.781 INFO:tasks.workunit.client.1.smithi060.stdout:5/328: mkdir d0/d6/d9/d82 0 2023-10-18T20:58:25.781 INFO:tasks.workunit.client.1.smithi060.stdout:5/329: stat d0/d6/d8/df/d27/d32/d6d/d72/d2a/c77 0 2023-10-18T20:58:25.781 INFO:tasks.workunit.client.1.smithi060.stdout:5/330: dread - d0/da/d3b/d43/f50 zero size 2023-10-18T20:58:25.785 INFO:tasks.workunit.client.0.smithi008.stdout:8/396: dwrite d5/d8/f41 [0,4194304] 0 2023-10-18T20:58:25.786 INFO:tasks.workunit.client.0.smithi008.stdout:2/291: mknod d1/d3/dd/d25/d34/c61 0 2023-10-18T20:58:25.786 INFO:tasks.workunit.client.0.smithi008.stdout:2/292: creat d1/d3/d40/f62 x:0 0 0 2023-10-18T20:58:25.786 INFO:tasks.workunit.client.1.smithi060.stdout:0/285: readlink d3/d8/l16 0 2023-10-18T20:58:25.787 INFO:tasks.workunit.client.1.smithi060.stdout:0/286: fdatasync d3/f48 0 2023-10-18T20:58:25.788 INFO:tasks.workunit.client.1.smithi060.stdout:2/269: write d0/d8/d47/f4b [1233067,7866] 0 2023-10-18T20:58:25.789 INFO:tasks.workunit.client.1.smithi060.stdout:2/270: stat d0/d16 0 2023-10-18T20:58:25.789 INFO:tasks.workunit.client.1.smithi060.stdout:4/239: dwrite d4/dc/d2a/d13/f3a [4194304,4194304] 0 2023-10-18T20:58:25.789 INFO:tasks.workunit.client.1.smithi060.stdout:4/240: stat d4/c28 0 2023-10-18T20:58:25.791 INFO:tasks.workunit.client.0.smithi008.stdout:7/283: mknod d1/d3/c61 0 2023-10-18T20:58:25.792 INFO:tasks.workunit.client.0.smithi008.stdout:7/284: truncate d1/d3/fc 5204610 0 2023-10-18T20:58:25.792 INFO:tasks.workunit.client.0.smithi008.stdout:9/279: creat d2/f48 x:0 0 0 2023-10-18T20:58:25.793 INFO:tasks.workunit.client.0.smithi008.stdout:0/239: rename d0/dd/df/d20/d21/c32 to d0/dd/df/d20/c46 0 2023-10-18T20:58:25.795 INFO:tasks.workunit.client.0.smithi008.stdout:8/397: write d5/d8/df/d9d/d6c/f46 [1008496,112647] 0 2023-10-18T20:58:25.795 INFO:tasks.workunit.client.0.smithi008.stdout:8/398: write d5/d8/df/d2e/f8a [781262,114705] 0 2023-10-18T20:58:25.795 INFO:tasks.workunit.client.0.smithi008.stdout:8/399: write d5/d8/df/d54/f62 [1153306,65127] 0 2023-10-18T20:58:25.796 INFO:tasks.workunit.client.1.smithi060.stdout:2/271: read d0/d8/fc [1318114,91644] 0 2023-10-18T20:58:25.797 INFO:tasks.workunit.client.0.smithi008.stdout:4/265: creat d0/d3/f5e x:0 0 0 2023-10-18T20:58:25.801 INFO:tasks.workunit.client.1.smithi060.stdout:9/256: rename d3/d10/d1c/d2a/d2d/f5c to d3/d10/d1c/d2a/f62 0 2023-10-18T20:58:25.801 INFO:tasks.workunit.client.1.smithi060.stdout:1/340: rmdir d4/da 39 2023-10-18T20:58:25.801 INFO:tasks.workunit.client.1.smithi060.stdout:6/219: write d10/d2e/f3a [1838115,39800] 0 2023-10-18T20:58:25.803 INFO:tasks.workunit.client.1.smithi060.stdout:8/248: sync 2023-10-18T20:58:25.803 INFO:tasks.workunit.client.1.smithi060.stdout:3/233: mknod d0/d22/d26/d2b/c4f 0 2023-10-18T20:58:25.811 INFO:tasks.workunit.client.1.smithi060.stdout:7/269: dwrite de/d14/d1d/f40 [0,4194304] 0 2023-10-18T20:58:25.814 INFO:tasks.workunit.client.0.smithi008.stdout:8/400: dread d5/d8/df/f39 [0,4194304] 0 2023-10-18T20:58:25.814 INFO:tasks.workunit.client.0.smithi008.stdout:8/401: write d5/d8/f47 [1246201,27130] 0 2023-10-18T20:58:25.815 INFO:tasks.workunit.client.0.smithi008.stdout:7/285: symlink d1/l62 0 2023-10-18T20:58:25.815 INFO:tasks.workunit.client.1.smithi060.stdout:0/287: mknod d3/c5d 0 2023-10-18T20:58:25.821 INFO:tasks.workunit.client.0.smithi008.stdout:6/277: sync 2023-10-18T20:58:25.825 INFO:tasks.workunit.client.0.smithi008.stdout:1/399: dwrite d9/de/df/d17/d55/f5c [0,4194304] 0 2023-10-18T20:58:25.833 INFO:tasks.workunit.client.0.smithi008.stdout:9/280: link d2/l11 d2/dc/d17/d19/l49 0 2023-10-18T20:58:25.833 INFO:tasks.workunit.client.0.smithi008.stdout:9/281: truncate d2/dc/f1e 2517519 0 2023-10-18T20:58:25.833 INFO:tasks.workunit.client.0.smithi008.stdout:9/282: write d2/dc/f22 [1956553,63728] 0 2023-10-18T20:58:25.835 INFO:tasks.workunit.client.1.smithi060.stdout:4/241: link d4/dc/d2a/d2d/l30 d4/dc/d2a/d31/l44 0 2023-10-18T20:58:25.836 INFO:tasks.workunit.client.1.smithi060.stdout:1/341: creat d4/d6/d33/f71 x:0 0 0 2023-10-18T20:58:25.836 INFO:tasks.workunit.client.1.smithi060.stdout:1/342: readlink d4/da/d42/l5e 0 2023-10-18T20:58:25.837 INFO:tasks.workunit.client.1.smithi060.stdout:4/242: creat d4/d15/f45 x:0 0 0 2023-10-18T20:58:25.838 INFO:tasks.workunit.client.0.smithi008.stdout:4/266: stat d0/d3/d21/c35 0 2023-10-18T20:58:25.838 INFO:tasks.workunit.client.0.smithi008.stdout:5/259: rename d0/f28 to d0/d2/d19/d1b/d31/d3f/f5f 0 2023-10-18T20:58:25.839 INFO:tasks.workunit.client.0.smithi008.stdout:0/240: mknod d0/c47 0 2023-10-18T20:58:25.839 INFO:tasks.workunit.client.1.smithi060.stdout:6/220: getdents d10/d17 0 2023-10-18T20:58:25.840 INFO:tasks.workunit.client.1.smithi060.stdout:6/221: chown cf 6007546 1 2023-10-18T20:58:25.840 INFO:tasks.workunit.client.1.smithi060.stdout:6/222: fsync d10/d17/f46 0 2023-10-18T20:58:25.842 INFO:tasks.workunit.client.1.smithi060.stdout:3/234: mkdir d0/d22/d50 0 2023-10-18T20:58:25.842 INFO:tasks.workunit.client.1.smithi060.stdout:3/235: readlink d0/d22/d26/d2b/l49 0 2023-10-18T20:58:25.843 INFO:tasks.workunit.client.1.smithi060.stdout:1/343: dread d4/d6/d7/df/f6b [0,4194304] 0 2023-10-18T20:58:25.844 INFO:tasks.workunit.client.0.smithi008.stdout:3/248: dread d0/d3/f2b [0,4194304] 0 2023-10-18T20:58:25.847 INFO:tasks.workunit.client.0.smithi008.stdout:8/402: mknod d5/d8/df/d54/ca1 0 2023-10-18T20:58:25.848 INFO:tasks.workunit.client.0.smithi008.stdout:8/403: write d5/d8/df/d6f/f64 [527988,71255] 0 2023-10-18T20:58:25.848 INFO:tasks.workunit.client.0.smithi008.stdout:2/293: dwrite d1/d3/dd/d1c/f28 [4194304,4194304] 0 2023-10-18T20:58:25.851 INFO:tasks.workunit.client.1.smithi060.stdout:5/331: getdents d0/d6/d8/df/d27/d32/d6d/d72 0 2023-10-18T20:58:25.857 INFO:tasks.workunit.client.1.smithi060.stdout:3/236: dread d0/d3c/f40 [0,4194304] 0 2023-10-18T20:58:25.859 INFO:tasks.workunit.client.0.smithi008.stdout:3/249: dread d0/d3/de/d13/f4e [0,4194304] 0 2023-10-18T20:58:25.865 INFO:tasks.workunit.client.1.smithi060.stdout:7/270: symlink de/d14/d2f/d3f/l57 0 2023-10-18T20:58:25.868 INFO:tasks.workunit.client.1.smithi060.stdout:3/237: write d0/d3c/f40 [3032018,73598] 0 2023-10-18T20:58:25.869 INFO:tasks.workunit.client.0.smithi008.stdout:1/400: creat d9/f7a x:0 0 0 2023-10-18T20:58:25.874 INFO:tasks.workunit.client.1.smithi060.stdout:0/288: rename d3/d8/d14/f1c to d3/d8/d3c/f5e 0 2023-10-18T20:58:25.874 INFO:tasks.workunit.client.1.smithi060.stdout:0/289: write d3/f41 [224560,92507] 0 2023-10-18T20:58:25.879 INFO:tasks.workunit.client.0.smithi008.stdout:5/260: creat d0/d2/d19/d1b/d31/d3f/f60 x:0 0 0 2023-10-18T20:58:25.882 INFO:tasks.workunit.client.1.smithi060.stdout:4/243: creat d4/dc/d2a/d31/f46 x:0 0 0 2023-10-18T20:58:25.882 INFO:tasks.workunit.client.1.smithi060.stdout:4/244: chown d4/dc/d2a/d13/f3f 105 1 2023-10-18T20:58:25.883 INFO:tasks.workunit.client.0.smithi008.stdout:2/294: symlink d1/d3/dd/d1c/d3a/d49/l63 0 2023-10-18T20:58:25.883 INFO:tasks.workunit.client.0.smithi008.stdout:2/295: creat d1/f64 x:0 0 0 2023-10-18T20:58:25.884 INFO:tasks.workunit.client.1.smithi060.stdout:9/257: dwrite d3/f1b [0,4194304] 0 2023-10-18T20:58:25.884 INFO:tasks.workunit.client.1.smithi060.stdout:9/258: creat d3/d10/d1c/d2a/d2d/f63 x:0 0 0 2023-10-18T20:58:25.885 INFO:tasks.workunit.client.0.smithi008.stdout:9/283: dread d2/dc/f1c [0,4194304] 0 2023-10-18T20:58:25.888 INFO:tasks.workunit.client.1.smithi060.stdout:6/223: symlink d10/d25/l49 0 2023-10-18T20:58:25.888 INFO:tasks.workunit.client.1.smithi060.stdout:6/224: creat d10/d1b/f4a x:0 0 0 2023-10-18T20:58:25.889 INFO:tasks.workunit.client.1.smithi060.stdout:2/272: dwrite d0/d3/d27/f46 [0,4194304] 0 2023-10-18T20:58:25.889 INFO:tasks.workunit.client.1.smithi060.stdout:2/273: write d0/d45/d49/f39 [4054093,19262] 0 2023-10-18T20:58:25.897 INFO:tasks.workunit.client.0.smithi008.stdout:7/286: dwrite d1/d36/d3b/f50 [0,4194304] 0 2023-10-18T20:58:25.897 INFO:tasks.workunit.client.0.smithi008.stdout:7/287: write d1/d36/d3d/d3e/f31 [1647331,57626] 0 2023-10-18T20:58:25.898 INFO:tasks.workunit.client.0.smithi008.stdout:5/261: mknod d0/de/c61 0 2023-10-18T20:58:25.898 INFO:tasks.workunit.client.0.smithi008.stdout:5/262: readlink d0/d2/d19/d1b/d31/l49 0 2023-10-18T20:58:25.904 INFO:tasks.workunit.client.1.smithi060.stdout:4/245: dread d4/dc/f29 [0,4194304] 0 2023-10-18T20:58:25.904 INFO:tasks.workunit.client.1.smithi060.stdout:4/246: chown d4/dc/d2a/c25 480 1 2023-10-18T20:58:25.909 INFO:tasks.workunit.client.1.smithi060.stdout:1/344: mknod d4/c72 0 2023-10-18T20:58:25.909 INFO:tasks.workunit.client.1.smithi060.stdout:1/345: chown d4/d6/d7/df/l12 670285 1 2023-10-18T20:58:25.909 INFO:tasks.workunit.client.1.smithi060.stdout:1/346: fdatasync d4/d6/d7/df/f15 0 2023-10-18T20:58:25.910 INFO:tasks.workunit.client.1.smithi060.stdout:1/347: truncate d4/da/f5b 1245652 0 2023-10-18T20:58:25.910 INFO:tasks.workunit.client.1.smithi060.stdout:1/348: write d4/d6/d14/d41/f55 [262968,19751] 0 2023-10-18T20:58:25.911 INFO:tasks.workunit.client.1.smithi060.stdout:7/271: truncate de/d29/f2b 148229 0 2023-10-18T20:58:25.912 INFO:tasks.workunit.client.1.smithi060.stdout:3/238: symlink d0/d22/d26/d2b/l51 0 2023-10-18T20:58:25.913 INFO:tasks.workunit.client.1.smithi060.stdout:3/239: truncate d0/d3c/d3d/f3b 847114 0 2023-10-18T20:58:25.914 INFO:tasks.workunit.client.0.smithi008.stdout:9/284: mkdir d2/dc/d17/d19/d4a 0 2023-10-18T20:58:25.915 INFO:tasks.workunit.client.1.smithi060.stdout:0/290: stat d3/d8/d3c/c51 0 2023-10-18T20:58:25.919 INFO:tasks.workunit.client.0.smithi008.stdout:7/288: unlink d1/l21 0 2023-10-18T20:58:25.919 INFO:tasks.workunit.client.0.smithi008.stdout:2/296: creat d1/d3/dd/f65 x:0 0 0 2023-10-18T20:58:25.920 INFO:tasks.workunit.client.1.smithi060.stdout:9/259: creat d3/d58/f64 x:0 0 0 2023-10-18T20:58:25.920 INFO:tasks.workunit.client.1.smithi060.stdout:9/260: chown d3/d10/d19/d54/l59 35 1 2023-10-18T20:58:25.921 INFO:tasks.workunit.client.0.smithi008.stdout:5/263: mkdir d0/d2/d19/d1b/d41/d62 0 2023-10-18T20:58:25.928 INFO:tasks.workunit.client.0.smithi008.stdout:9/285: creat d2/dc/f4b x:0 0 0 2023-10-18T20:58:25.937 INFO:tasks.workunit.client.0.smithi008.stdout:7/289: symlink d1/d36/d3d/l63 0 2023-10-18T20:58:25.937 INFO:tasks.workunit.client.0.smithi008.stdout:2/297: mknod d1/c66 0 2023-10-18T20:58:25.937 INFO:tasks.workunit.client.0.smithi008.stdout:2/298: chown d1/f1a 5579822 1 2023-10-18T20:58:25.941 INFO:tasks.workunit.client.0.smithi008.stdout:5/264: creat d0/d2/d19/d1b/d58/f63 x:0 0 0 2023-10-18T20:58:25.943 INFO:tasks.workunit.client.1.smithi060.stdout:6/225: rename d10/d1b/f44 to d10/d17/f4b 0 2023-10-18T20:58:25.945 INFO:tasks.workunit.client.0.smithi008.stdout:2/299: link d1/d3/d40/f54 d1/d3/dd/d1c/d3a/d57/f67 0 2023-10-18T20:58:25.947 INFO:tasks.workunit.client.0.smithi008.stdout:0/241: dwrite d0/dd/d19/d24/f44 [0,4194304] 0 2023-10-18T20:58:25.949 INFO:tasks.workunit.client.0.smithi008.stdout:5/265: mkdir d0/d2/d19/d1b/d64 0 2023-10-18T20:58:25.949 INFO:tasks.workunit.client.0.smithi008.stdout:5/266: write d0/d2/d19/d1b/d41/f5e [250304,123581] 0 2023-10-18T20:58:25.950 INFO:tasks.workunit.client.1.smithi060.stdout:2/274: creat d0/f4e x:0 0 0 2023-10-18T20:58:25.958 INFO:tasks.workunit.client.0.smithi008.stdout:3/250: dwrite d0/d3/d15/f44 [0,4194304] 0 2023-10-18T20:58:25.958 INFO:tasks.workunit.client.1.smithi060.stdout:4/247: symlink d4/dc/d2a/l47 0 2023-10-18T20:58:25.960 INFO:tasks.workunit.client.1.smithi060.stdout:5/332: dwrite d0/da/d3b/f65 [0,4194304] 0 2023-10-18T20:58:25.960 INFO:tasks.workunit.client.1.smithi060.stdout:5/333: readlink d0/d6/d8/df/l25 0 2023-10-18T20:58:25.960 INFO:tasks.workunit.client.1.smithi060.stdout:5/334: readlink d0/d6/d8/df/d27/d32/d6d/d72/l54 0 2023-10-18T20:58:25.964 INFO:tasks.workunit.client.1.smithi060.stdout:1/349: mknod d4/d6/d7/df/d59/c73 0 2023-10-18T20:58:25.968 INFO:tasks.workunit.client.1.smithi060.stdout:7/272: truncate de/d14/d1d/f21 1858792 0 2023-10-18T20:58:25.968 INFO:tasks.workunit.client.1.smithi060.stdout:7/273: stat de/f19 0 2023-10-18T20:58:25.972 INFO:tasks.workunit.client.1.smithi060.stdout:8/249: sync 2023-10-18T20:58:25.972 INFO:tasks.workunit.client.1.smithi060.stdout:8/250: write d4/d9/d37/f3d [143678,122017] 0 2023-10-18T20:58:25.977 INFO:tasks.workunit.client.1.smithi060.stdout:3/240: creat d0/d22/f52 x:0 0 0 2023-10-18T20:58:25.981 INFO:tasks.workunit.client.0.smithi008.stdout:8/404: dwrite d5/f11 [0,4194304] 0 2023-10-18T20:58:25.982 INFO:tasks.workunit.client.0.smithi008.stdout:8/405: write d5/d8/df/f39 [145715,17086] 0 2023-10-18T20:58:25.985 INFO:tasks.workunit.client.0.smithi008.stdout:0/242: link d0/f14 d0/dd/df/f48 0 2023-10-18T20:58:25.985 INFO:tasks.workunit.client.0.smithi008.stdout:5/267: rename d0/d2/d19/d1b/d20 to d0/d2/d19/d1b/d58/d65 0 2023-10-18T20:58:25.986 INFO:tasks.workunit.client.0.smithi008.stdout:1/401: dwrite d9/de/df/d17/f5f [0,4194304] 0 2023-10-18T20:58:25.987 INFO:tasks.workunit.client.1.smithi060.stdout:0/291: readlink d3/d8/lb 0 2023-10-18T20:58:25.987 INFO:tasks.workunit.client.1.smithi060.stdout:0/292: fdatasync d3/d8/d14/d49/f47 0 2023-10-18T20:58:25.987 INFO:tasks.workunit.client.1.smithi060.stdout:0/293: unlink d3/f17 0 2023-10-18T20:58:25.987 INFO:tasks.workunit.client.1.smithi060.stdout:0/294: creat d3/d8/d14/f5f x:0 0 0 2023-10-18T20:58:26.002 INFO:tasks.workunit.client.1.smithi060.stdout:2/275: dwrite d0/d8/f3d [0,4194304] 0 2023-10-18T20:58:26.004 INFO:tasks.workunit.client.1.smithi060.stdout:9/261: mkdir d3/d10/d65 0 2023-10-18T20:58:26.010 INFO:tasks.workunit.client.1.smithi060.stdout:6/226: getdents d10/d17 0 2023-10-18T20:58:26.010 INFO:tasks.workunit.client.1.smithi060.stdout:6/227: chown fd 11004 1 2023-10-18T20:58:26.012 INFO:tasks.workunit.client.0.smithi008.stdout:9/286: dwrite d2/dc/d1a/f21 [0,4194304] 0 2023-10-18T20:58:26.014 INFO:tasks.workunit.client.0.smithi008.stdout:7/290: dwrite d1/d36/d3d/d49/f4a [0,4194304] 0 2023-10-18T20:58:26.014 INFO:tasks.workunit.client.0.smithi008.stdout:7/291: fdatasync d1/d3/fc 0 2023-10-18T20:58:26.019 INFO:tasks.workunit.client.1.smithi060.stdout:7/274: dwrite de/d14/d1d/f2a [0,4194304] 0 2023-10-18T20:58:26.021 INFO:tasks.workunit.client.0.smithi008.stdout:3/251: mknod d0/c4f 0 2023-10-18T20:58:26.021 INFO:tasks.workunit.client.1.smithi060.stdout:8/251: mknod d4/d9/d31/c45 0 2023-10-18T20:58:26.027 INFO:tasks.workunit.client.1.smithi060.stdout:3/241: rename d0/f1e to d0/d22/d50/f53 0 2023-10-18T20:58:26.030 INFO:tasks.workunit.client.1.smithi060.stdout:1/350: dwrite d4/da/de/d2a/d32/dd/f25 [0,4194304] 0 2023-10-18T20:58:26.031 INFO:tasks.workunit.client.0.smithi008.stdout:9/287: write d2/dc/d1a/d1d/f44 [2944608,112209] 0 2023-10-18T20:58:26.031 INFO:tasks.workunit.client.0.smithi008.stdout:9/288: creat d2/dc/f4c x:0 0 0 2023-10-18T20:58:26.033 INFO:tasks.workunit.client.0.smithi008.stdout:8/406: getdents d5/d8/d24/d77 0 2023-10-18T20:58:26.034 INFO:tasks.workunit.client.0.smithi008.stdout:8/407: write d5/d8/df/d9d/d6c/f66 [561418,58364] 0 2023-10-18T20:58:26.034 INFO:tasks.workunit.client.0.smithi008.stdout:8/408: write d5/d8/f41 [5207328,97788] 0 2023-10-18T20:58:26.037 INFO:tasks.workunit.client.0.smithi008.stdout:0/243: mknod d0/c49 0 2023-10-18T20:58:26.038 INFO:tasks.workunit.client.0.smithi008.stdout:0/244: fsync d0/dd/d19/d24/f35 0 2023-10-18T20:58:26.041 INFO:tasks.workunit.client.0.smithi008.stdout:5/268: creat d0/d2/d19/d1b/d42/d5a/f66 x:0 0 0 2023-10-18T20:58:26.044 INFO:tasks.workunit.client.1.smithi060.stdout:9/262: link d3/d10/d1c/d2a/d2d/f2e d3/d10/d1c/d2a/d2d/f66 0 2023-10-18T20:58:26.044 INFO:tasks.workunit.client.1.smithi060.stdout:4/248: rmdir d4/dc/d2a/d31 39 2023-10-18T20:58:26.044 INFO:tasks.workunit.client.1.smithi060.stdout:9/263: chown d3/f50 33266903 1 2023-10-18T20:58:26.045 INFO:tasks.workunit.client.1.smithi060.stdout:5/335: getdents d0/da/d3b 0 2023-10-18T20:58:26.045 INFO:tasks.workunit.client.1.smithi060.stdout:5/336: write d0/d6/d8/df/d27/d32/d6d/d72/f5d [1150066,64806] 0 2023-10-18T20:58:26.045 INFO:tasks.workunit.client.1.smithi060.stdout:5/337: readlink d0/d6/d8/df/l53 0 2023-10-18T20:58:26.045 INFO:tasks.workunit.client.1.smithi060.stdout:5/338: chown d0/d6/f1e 5832742 1 2023-10-18T20:58:26.046 INFO:tasks.workunit.client.0.smithi008.stdout:1/402: link d9/de/df/d17/d25/c61 d9/c7b 0 2023-10-18T20:58:26.049 INFO:tasks.workunit.client.1.smithi060.stdout:8/252: mknod d4/d9/d37/c46 0 2023-10-18T20:58:26.050 INFO:tasks.workunit.client.1.smithi060.stdout:8/253: write d4/d9/f21 [1310906,86553] 0 2023-10-18T20:58:26.052 INFO:tasks.workunit.client.0.smithi008.stdout:5/269: dread d0/d2/d19/f2f [0,4194304] 0 2023-10-18T20:58:26.053 INFO:tasks.workunit.client.0.smithi008.stdout:5/270: readlink d0/d2/d19/d1b/d31/d3f/l51 0 2023-10-18T20:58:26.054 INFO:tasks.workunit.client.0.smithi008.stdout:7/292: rename d1/d36/c38 to d1/d3/d20/d54/c64 0 2023-10-18T20:58:26.060 INFO:tasks.workunit.client.1.smithi060.stdout:0/295: rename d3/d8/d3c/f5e to d3/f60 0 2023-10-18T20:58:26.063 INFO:tasks.workunit.client.0.smithi008.stdout:3/252: link d0/d3/de/d13/f49 d0/d3/d37/f50 0 2023-10-18T20:58:26.063 INFO:tasks.workunit.client.0.smithi008.stdout:3/253: chown d0/d3/de/c27 41 1 2023-10-18T20:58:26.065 INFO:tasks.workunit.client.0.smithi008.stdout:5/271: dread d0/f1c [0,4194304] 0 2023-10-18T20:58:26.067 INFO:tasks.workunit.client.1.smithi060.stdout:3/242: link d0/d3c/d3d/f47 d0/d3c/f54 0 2023-10-18T20:58:26.067 INFO:tasks.workunit.client.1.smithi060.stdout:3/243: stat d0/d22/d26/l4a 0 2023-10-18T20:58:26.067 INFO:tasks.workunit.client.1.smithi060.stdout:1/351: mknod d4/c74 0 2023-10-18T20:58:26.068 INFO:tasks.workunit.client.0.smithi008.stdout:8/409: creat d5/d8/d24/fa2 x:0 0 0 2023-10-18T20:58:26.076 INFO:tasks.workunit.client.1.smithi060.stdout:6/228: rename c9 to d10/d25/c4c 0 2023-10-18T20:58:26.082 INFO:tasks.workunit.client.0.smithi008.stdout:0/245: mknod d0/dd/df/d20/c4a 0 2023-10-18T20:58:26.083 INFO:tasks.workunit.client.0.smithi008.stdout:0/246: creat d0/dd/df/d2a/f4b x:0 0 0 2023-10-18T20:58:26.083 INFO:tasks.workunit.client.0.smithi008.stdout:0/247: write d0/f2 [1466443,10771] 0 2023-10-18T20:58:26.083 INFO:tasks.workunit.client.1.smithi060.stdout:2/276: dwrite d0/d8/f3d [0,4194304] 0 2023-10-18T20:58:26.088 INFO:tasks.workunit.client.0.smithi008.stdout:7/293: rename d1/f45 to d1/d3/f65 0 2023-10-18T20:58:26.088 INFO:tasks.workunit.client.0.smithi008.stdout:7/294: creat d1/d3/d20/f66 x:0 0 0 2023-10-18T20:58:26.088 INFO:tasks.workunit.client.0.smithi008.stdout:7/295: truncate d1/d3/f65 1003059 0 2023-10-18T20:58:26.088 INFO:tasks.workunit.client.0.smithi008.stdout:7/296: dread - d1/d36/d3b/d4f/f5e zero size 2023-10-18T20:58:26.089 INFO:tasks.workunit.client.0.smithi008.stdout:3/254: unlink d0/d3/fd 0 2023-10-18T20:58:26.090 INFO:tasks.workunit.client.1.smithi060.stdout:3/244: mknod d0/d22/c55 0 2023-10-18T20:58:26.090 INFO:tasks.workunit.client.1.smithi060.stdout:6/229: creat d10/f4d x:0 0 0 2023-10-18T20:58:26.090 INFO:tasks.workunit.client.1.smithi060.stdout:6/230: fsync d10/d1b/f22 0 2023-10-18T20:58:26.090 INFO:tasks.workunit.client.1.smithi060.stdout:6/231: chown d10/d1b/f27 30175177 1 2023-10-18T20:58:26.090 INFO:tasks.workunit.client.1.smithi060.stdout:0/296: dread d3/f6 [0,4194304] 0 2023-10-18T20:58:26.091 INFO:tasks.workunit.client.1.smithi060.stdout:0/297: dread - d3/f21 zero size 2023-10-18T20:58:26.091 INFO:tasks.workunit.client.1.smithi060.stdout:8/254: dread d4/d9/d37/f3d [0,4194304] 0 2023-10-18T20:58:26.091 INFO:tasks.workunit.client.0.smithi008.stdout:8/410: mkdir d5/d8/df/d6f/da3 0 2023-10-18T20:58:26.092 INFO:tasks.workunit.client.1.smithi060.stdout:2/277: symlink d0/l4f 0 2023-10-18T20:58:26.094 INFO:tasks.workunit.client.1.smithi060.stdout:1/352: rmdir d4/da/d42 39 2023-10-18T20:58:26.096 INFO:tasks.workunit.client.1.smithi060.stdout:3/245: write d0/f2a [591100,96933] 0 2023-10-18T20:58:26.103 INFO:tasks.workunit.client.0.smithi008.stdout:7/297: link d1/d3/l24 d1/l67 0 2023-10-18T20:58:26.103 INFO:tasks.workunit.client.0.smithi008.stdout:7/298: unlink d1/f4 0 2023-10-18T20:58:26.104 INFO:tasks.workunit.client.1.smithi060.stdout:0/298: getdents d3/d8/d14/d55 0 2023-10-18T20:58:26.104 INFO:tasks.workunit.client.1.smithi060.stdout:0/299: chown d3/f60 633351 1 2023-10-18T20:58:26.104 INFO:tasks.workunit.client.1.smithi060.stdout:0/300: stat d3/fc 0 2023-10-18T20:58:26.106 INFO:tasks.workunit.client.1.smithi060.stdout:7/275: dwrite de/d29/f22 [0,4194304] 0 2023-10-18T20:58:26.106 INFO:tasks.workunit.client.0.smithi008.stdout:3/255: rmdir d0/d3/de/d13 39 2023-10-18T20:58:26.106 INFO:tasks.workunit.client.0.smithi008.stdout:3/256: stat d0/d3/d42 0 2023-10-18T20:58:26.109 INFO:tasks.workunit.client.1.smithi060.stdout:8/255: creat d4/f47 x:0 0 0 2023-10-18T20:58:26.109 INFO:tasks.workunit.client.1.smithi060.stdout:2/278: rename d0/d8/l2d to d0/d43/d4a/l50 0 2023-10-18T20:58:26.109 INFO:tasks.workunit.client.1.smithi060.stdout:4/249: dwrite d4/dc/d2a/f1f [0,4194304] 0 2023-10-18T20:58:26.110 INFO:tasks.workunit.client.1.smithi060.stdout:4/250: stat d4 0 2023-10-18T20:58:26.111 INFO:tasks.workunit.client.0.smithi008.stdout:4/267: sync 2023-10-18T20:58:26.111 INFO:tasks.workunit.client.0.smithi008.stdout:5/272: write d0/d2/d19/d1b/d41/f50 [3778732,26641] 0 2023-10-18T20:58:26.114 INFO:tasks.workunit.client.0.smithi008.stdout:7/299: read d1/f4e [79875,119933] 0 2023-10-18T20:58:26.114 INFO:tasks.workunit.client.0.smithi008.stdout:8/411: write d5/f15 [563673,101438] 0 2023-10-18T20:58:26.114 INFO:tasks.workunit.client.0.smithi008.stdout:9/289: dwrite d2/dc/f22 [0,4194304] 0 2023-10-18T20:58:26.118 INFO:tasks.workunit.client.1.smithi060.stdout:5/339: dwrite d0/dd/f5b [4194304,4194304] 0 2023-10-18T20:58:26.118 INFO:tasks.workunit.client.1.smithi060.stdout:6/232: dread d10/d1b/f41 [0,4194304] 0 2023-10-18T20:58:26.118 INFO:tasks.workunit.client.1.smithi060.stdout:6/233: fsync f7 0 2023-10-18T20:58:26.119 INFO:tasks.workunit.client.1.smithi060.stdout:6/234: read d10/f35 [848792,23567] 0 2023-10-18T20:58:26.119 INFO:tasks.workunit.client.1.smithi060.stdout:6/235: creat d10/d2e/f4e x:0 0 0 2023-10-18T20:58:26.123 INFO:tasks.workunit.client.1.smithi060.stdout:1/353: link d4/d6/d7/d2f/f39 d4/da/de/d2a/d32/d56/f75 0 2023-10-18T20:58:26.123 INFO:tasks.workunit.client.1.smithi060.stdout:1/354: stat d4/d6/d33/f71 0 2023-10-18T20:58:26.123 INFO:tasks.workunit.client.1.smithi060.stdout:1/355: fsync d4/d6/d7/d2f/f70 0 2023-10-18T20:58:26.123 INFO:tasks.workunit.client.1.smithi060.stdout:1/356: readlink d4/l18 0 2023-10-18T20:58:26.126 INFO:tasks.workunit.client.0.smithi008.stdout:4/268: creat d0/d17/d5b/f5f x:0 0 0 2023-10-18T20:58:26.127 INFO:tasks.workunit.client.0.smithi008.stdout:1/403: write d9/de/df/d17/d1e/f4c [572488,55740] 0 2023-10-18T20:58:26.128 INFO:tasks.workunit.client.1.smithi060.stdout:4/251: write d4/dc/d2a/f1f [1567999,107103] 0 2023-10-18T20:58:26.128 INFO:tasks.workunit.client.1.smithi060.stdout:4/252: truncate d4/dc/d2a/d31/f46 772140 0 2023-10-18T20:58:26.128 INFO:tasks.workunit.client.1.smithi060.stdout:4/253: creat d4/d15/f48 x:0 0 0 2023-10-18T20:58:26.128 INFO:tasks.workunit.client.1.smithi060.stdout:4/254: chown d4/dc/f22 14 1 2023-10-18T20:58:26.128 INFO:tasks.workunit.client.1.smithi060.stdout:4/255: readlink d4/dc/l14 0 2023-10-18T20:58:26.129 INFO:tasks.workunit.client.1.smithi060.stdout:3/246: link d0/d3c/c46 d0/d22/d26/c56 0 2023-10-18T20:58:26.129 INFO:tasks.workunit.client.1.smithi060.stdout:3/247: creat d0/d3c/d3d/f57 x:0 0 0 2023-10-18T20:58:26.129 INFO:tasks.workunit.client.1.smithi060.stdout:3/248: readlink d0/d22/d26/d2b/l49 0 2023-10-18T20:58:26.129 INFO:tasks.workunit.client.1.smithi060.stdout:0/301: symlink d3/d8/d14/d55/l61 0 2023-10-18T20:58:26.132 INFO:tasks.workunit.client.0.smithi008.stdout:7/300: mknod d1/d36/d3b/d4f/d5c/c68 0 2023-10-18T20:58:26.133 INFO:tasks.workunit.client.0.smithi008.stdout:7/301: chown d1/d36/d3b/d4f/d5c 20319 1 2023-10-18T20:58:26.135 INFO:tasks.workunit.client.1.smithi060.stdout:7/276: truncate de/f19 28121 0 2023-10-18T20:58:26.135 INFO:tasks.workunit.client.0.smithi008.stdout:9/290: stat d2/dc/d3d/l47 0 2023-10-18T20:58:26.141 INFO:tasks.workunit.client.1.smithi060.stdout:6/236: dread fb [0,4194304] 0 2023-10-18T20:58:26.141 INFO:tasks.workunit.client.1.smithi060.stdout:6/237: write d10/d2e/f4e [1042284,26172] 0 2023-10-18T20:58:26.141 INFO:tasks.workunit.client.1.smithi060.stdout:6/238: chown d10/d25/d3c/l40 11335002 1 2023-10-18T20:58:26.142 INFO:tasks.workunit.client.1.smithi060.stdout:8/256: symlink d4/d9/d31/l48 0 2023-10-18T20:58:26.149 INFO:tasks.workunit.client.0.smithi008.stdout:9/291: mkdir d2/d4d 0 2023-10-18T20:58:26.149 INFO:tasks.workunit.client.0.smithi008.stdout:9/292: creat d2/dc/f4e x:0 0 0 2023-10-18T20:58:26.150 INFO:tasks.workunit.client.0.smithi008.stdout:9/293: write d2/f26 [342230,26481] 0 2023-10-18T20:58:26.152 INFO:tasks.workunit.client.0.smithi008.stdout:4/269: rename d0/d17/d5b/f11 to d0/d17/f60 0 2023-10-18T20:58:26.158 INFO:tasks.workunit.client.1.smithi060.stdout:1/357: creat d4/d6/d33/d58/f76 x:0 0 0 2023-10-18T20:58:26.158 INFO:tasks.workunit.client.1.smithi060.stdout:1/358: rename d4/da/de/d2a/d32 to d4/da/de/d2a/d32/d77 22 2023-10-18T20:58:26.165 INFO:tasks.workunit.client.0.smithi008.stdout:5/273: dread d0/d2/d19/f2c [0,4194304] 0 2023-10-18T20:58:26.165 INFO:tasks.workunit.client.0.smithi008.stdout:5/274: write d0/d2/d19/d1b/d41/f50 [377697,20255] 0 2023-10-18T20:58:26.171 INFO:tasks.workunit.client.0.smithi008.stdout:8/412: dwrite d5/d8/df/f1b [0,4194304] 0 2023-10-18T20:58:26.173 INFO:tasks.workunit.client.0.smithi008.stdout:4/270: mknod d0/d17/d5b/d2a/c61 0 2023-10-18T20:58:26.174 INFO:tasks.workunit.client.1.smithi060.stdout:4/256: creat d4/dc/d2a/d39/f49 x:0 0 0 2023-10-18T20:58:26.174 INFO:tasks.workunit.client.1.smithi060.stdout:4/257: chown d4/dc/d40/f41 2310888 1 2023-10-18T20:58:26.177 INFO:tasks.workunit.client.0.smithi008.stdout:6/278: sync 2023-10-18T20:58:26.181 INFO:tasks.workunit.client.0.smithi008.stdout:2/300: sync 2023-10-18T20:58:26.182 INFO:tasks.workunit.client.0.smithi008.stdout:2/301: chown d1/d3/dd/d1c/d39/l4a 0 1 2023-10-18T20:58:26.182 INFO:tasks.workunit.client.0.smithi008.stdout:5/275: truncate d0/d2/d19/d1b/f2a 610186 0 2023-10-18T20:58:26.184 INFO:tasks.workunit.client.1.smithi060.stdout:3/249: symlink d0/d22/d26/d29/l58 0 2023-10-18T20:58:26.186 INFO:tasks.workunit.client.1.smithi060.stdout:0/302: mkdir d3/d32/d62 0 2023-10-18T20:58:26.198 INFO:tasks.workunit.client.1.smithi060.stdout:6/239: creat d10/d25/f4f x:0 0 0 2023-10-18T20:58:26.198 INFO:tasks.workunit.client.1.smithi060.stdout:6/240: creat d10/d2e/f50 x:0 0 0 2023-10-18T20:58:26.199 INFO:tasks.workunit.client.1.smithi060.stdout:6/241: creat d10/f51 x:0 0 0 2023-10-18T20:58:26.204 INFO:tasks.workunit.client.0.smithi008.stdout:4/271: rename d0/l1b to d0/l62 0 2023-10-18T20:58:26.208 INFO:tasks.workunit.client.0.smithi008.stdout:6/279: mkdir df/d15/d5e 0 2023-10-18T20:58:26.211 INFO:tasks.workunit.client.0.smithi008.stdout:5/276: rename d0/d2/d19/d1b/d58/f63 to d0/d2/d19/f67 0 2023-10-18T20:58:26.211 INFO:tasks.workunit.client.0.smithi008.stdout:5/277: readlink d0/d2/d9/l17 0 2023-10-18T20:58:26.212 INFO:tasks.workunit.client.1.smithi060.stdout:1/359: mknod d4/da/de/c78 0 2023-10-18T20:58:26.212 INFO:tasks.workunit.client.1.smithi060.stdout:0/303: truncate d3/f6 351984 0 2023-10-18T20:58:26.212 INFO:tasks.workunit.client.1.smithi060.stdout:0/304: fdatasync d3/d8/f22 0 2023-10-18T20:58:26.214 INFO:tasks.workunit.client.0.smithi008.stdout:6/280: mknod df/d15/d27/c5f 0 2023-10-18T20:58:26.214 INFO:tasks.workunit.client.0.smithi008.stdout:6/281: write df/d18/f21 [486497,1968] 0 2023-10-18T20:58:26.216 INFO:tasks.workunit.client.0.smithi008.stdout:5/278: mkdir d0/d2/d19/d1b/d58/d65/d68 0 2023-10-18T20:58:26.218 INFO:tasks.workunit.client.0.smithi008.stdout:6/282: mknod df/d15/d27/d4c/c60 0 2023-10-18T20:58:26.218 INFO:tasks.workunit.client.0.smithi008.stdout:6/283: truncate df/f2e 1685959 0 2023-10-18T20:58:26.221 INFO:tasks.workunit.client.0.smithi008.stdout:5/279: rename d0/f25 to d0/d2/d19/d1b/d42/d5a/f69 0 2023-10-18T20:58:26.222 INFO:tasks.workunit.client.1.smithi060.stdout:6/242: symlink d10/d25/d3c/l52 0 2023-10-18T20:58:26.222 INFO:tasks.workunit.client.1.smithi060.stdout:6/243: dread - d10/f4d zero size 2023-10-18T20:58:26.223 INFO:tasks.workunit.client.1.smithi060.stdout:8/257: rmdir d4/d9/d37 39 2023-10-18T20:58:26.223 INFO:tasks.workunit.client.0.smithi008.stdout:6/284: creat df/d26/f61 x:0 0 0 2023-10-18T20:58:26.225 INFO:tasks.workunit.client.1.smithi060.stdout:1/360: dread d4/da/de/d2a/d32/d56/d67/f6c [0,4194304] 0 2023-10-18T20:58:26.227 INFO:tasks.workunit.client.0.smithi008.stdout:5/280: mknod d0/d2/d19/d1b/d64/c6a 0 2023-10-18T20:58:26.231 INFO:tasks.workunit.client.0.smithi008.stdout:5/281: creat d0/d2/d19/d1b/f6b x:0 0 0 2023-10-18T20:58:26.233 INFO:tasks.workunit.client.1.smithi060.stdout:1/361: dread d4/da/f5b [0,4194304] 0 2023-10-18T20:58:26.236 INFO:tasks.workunit.client.1.smithi060.stdout:6/244: symlink d10/d25/d3c/l53 0 2023-10-18T20:58:26.237 INFO:tasks.workunit.client.1.smithi060.stdout:6/245: read - d10/f51 zero size 2023-10-18T20:58:26.237 INFO:tasks.workunit.client.1.smithi060.stdout:6/246: chown d10/d17/d28/f26 1 1 2023-10-18T20:58:26.239 INFO:tasks.workunit.client.1.smithi060.stdout:1/362: symlink d4/da/l79 0 2023-10-18T20:58:26.240 INFO:tasks.workunit.client.1.smithi060.stdout:6/247: mkdir d10/d17/d54 0 2023-10-18T20:58:26.241 INFO:tasks.workunit.client.1.smithi060.stdout:6/248: write d10/f35 [556417,114208] 0 2023-10-18T20:58:26.242 INFO:tasks.workunit.client.1.smithi060.stdout:1/363: creat d4/da/de/d2a/d32/f7a x:0 0 0 2023-10-18T20:58:26.245 INFO:tasks.workunit.client.1.smithi060.stdout:6/249: unlink fa 0 2023-10-18T20:58:26.262 INFO:tasks.workunit.client.1.smithi060.stdout:7/277: dwrite de/d14/d3a/f3b [0,4194304] 0 2023-10-18T20:58:26.263 INFO:tasks.workunit.client.1.smithi060.stdout:3/250: dwrite d0/d22/d26/d2b/f4c [0,4194304] 0 2023-10-18T20:58:26.264 INFO:tasks.workunit.client.1.smithi060.stdout:3/251: creat d0/d3c/d3d/f59 x:0 0 0 2023-10-18T20:58:26.264 INFO:tasks.workunit.client.1.smithi060.stdout:3/252: unlink d0/f2a 0 2023-10-18T20:58:26.264 INFO:tasks.workunit.client.1.smithi060.stdout:3/253: stat d0/d3c/d3d/c3f 0 2023-10-18T20:58:26.270 INFO:tasks.workunit.client.1.smithi060.stdout:7/278: mkdir de/d14/d41/d58 0 2023-10-18T20:58:26.274 INFO:tasks.workunit.client.0.smithi008.stdout:3/257: dwrite d0/d3/de/d13/d35/f3b [0,4194304] 0 2023-10-18T20:58:26.279 INFO:tasks.workunit.client.0.smithi008.stdout:6/285: write df/d26/f31 [7898308,12926] 0 2023-10-18T20:58:26.280 INFO:tasks.workunit.client.1.smithi060.stdout:2/279: dwrite d0/f10 [0,4194304] 0 2023-10-18T20:58:26.281 INFO:tasks.workunit.client.0.smithi008.stdout:1/404: write d9/de/df/d17/d55/f79 [1227216,127349] 0 2023-10-18T20:58:26.281 INFO:tasks.workunit.client.0.smithi008.stdout:1/405: truncate d9/de/f15 259626 0 2023-10-18T20:58:26.281 INFO:tasks.workunit.client.0.smithi008.stdout:6/286: creat df/d36/f62 x:0 0 0 2023-10-18T20:58:26.282 INFO:tasks.workunit.client.0.smithi008.stdout:6/287: creat df/d15/d27/f63 x:0 0 0 2023-10-18T20:58:26.283 INFO:tasks.workunit.client.1.smithi060.stdout:7/279: mknod de/d14/d3a/d46/c59 0 2023-10-18T20:58:26.284 INFO:tasks.workunit.client.0.smithi008.stdout:6/288: mkdir df/d13/d53/d64 0 2023-10-18T20:58:26.285 INFO:tasks.workunit.client.1.smithi060.stdout:5/340: dwrite d0/d6/f55 [0,4194304] 0 2023-10-18T20:58:26.286 INFO:tasks.workunit.client.0.smithi008.stdout:6/289: symlink df/d15/d33/d50/l65 0 2023-10-18T20:58:26.286 INFO:tasks.workunit.client.0.smithi008.stdout:6/290: write df/d15/d27/d38/f39 [606184,80124] 0 2023-10-18T20:58:26.288 INFO:tasks.workunit.client.1.smithi060.stdout:5/341: mkdir d0/d6/d9/d82/d83 0 2023-10-18T20:58:26.295 INFO:tasks.workunit.client.0.smithi008.stdout:8/413: dread d5/d8/d24/f63 [0,4194304] 0 2023-10-18T20:58:26.295 INFO:tasks.workunit.client.0.smithi008.stdout:8/414: fsync d5/d8/d24/f27 0 2023-10-18T20:58:26.305 INFO:tasks.workunit.client.1.smithi060.stdout:5/342: mkdir d0/d6/d9/d82/d84 0 2023-10-18T20:58:26.309 INFO:tasks.workunit.client.0.smithi008.stdout:9/294: dwrite d2/f5 [0,4194304] 0 2023-10-18T20:58:26.310 INFO:tasks.workunit.client.1.smithi060.stdout:0/305: dwrite d3/f60 [0,4194304] 0 2023-10-18T20:58:26.310 INFO:tasks.workunit.client.1.smithi060.stdout:0/306: write d3/f26 [5256832,59159] 0 2023-10-18T20:58:26.310 INFO:tasks.workunit.client.1.smithi060.stdout:0/307: write d3/f1a [1012663,93693] 0 2023-10-18T20:58:26.312 INFO:tasks.workunit.client.0.smithi008.stdout:8/415: creat d5/d8/df/d6f/fa4 x:0 0 0 2023-10-18T20:58:26.312 INFO:tasks.workunit.client.0.smithi008.stdout:9/295: link d2/dc/d1a/d1d/l27 d2/d8/l4f 0 2023-10-18T20:58:26.312 INFO:tasks.workunit.client.0.smithi008.stdout:9/296: creat d2/dc/d1a/d1d/f50 x:0 0 0 2023-10-18T20:58:26.312 INFO:tasks.workunit.client.0.smithi008.stdout:9/297: stat d2/dc/d1a/c30 0 2023-10-18T20:58:26.313 INFO:tasks.workunit.client.1.smithi060.stdout:1/364: rename d4/da/de to d4/d6/d7/d2f/d7b 0 2023-10-18T20:58:26.314 INFO:tasks.workunit.client.1.smithi060.stdout:1/365: fdatasync d4/da/f53 0 2023-10-18T20:58:26.314 INFO:tasks.workunit.client.1.smithi060.stdout:1/366: dread - d4/d6/d7/d2f/d7b/d2a/f45 zero size 2023-10-18T20:58:26.314 INFO:tasks.workunit.client.0.smithi008.stdout:9/298: getdents d2/dc/d40 0 2023-10-18T20:58:26.315 INFO:tasks.workunit.client.0.smithi008.stdout:9/299: truncate d2/dc/d17/d19/f41 550254 0 2023-10-18T20:58:26.315 INFO:tasks.workunit.client.0.smithi008.stdout:9/300: write d2/dc/f4c [764873,23638] 0 2023-10-18T20:58:26.315 INFO:tasks.workunit.client.0.smithi008.stdout:6/291: fsync df/d13/f17 0 2023-10-18T20:58:26.315 INFO:tasks.workunit.client.1.smithi060.stdout:5/343: creat d0/d6/d8/df/d27/d32/d6d/d72/f85 x:0 0 0 2023-10-18T20:58:26.316 INFO:tasks.workunit.client.1.smithi060.stdout:5/344: write d0/d6/d8/df/d27/d32/f39 [3341023,128389] 0 2023-10-18T20:58:26.322 INFO:tasks.workunit.client.0.smithi008.stdout:4/272: dwrite d0/d17/d5b/f15 [0,4194304] 0 2023-10-18T20:58:26.323 INFO:tasks.workunit.client.0.smithi008.stdout:9/301: rename d2/dc/f15 to d2/dc/d40/d46/f51 0 2023-10-18T20:58:26.323 INFO:tasks.workunit.client.0.smithi008.stdout:2/302: dwrite d1/f18 [0,4194304] 0 2023-10-18T20:58:26.323 INFO:tasks.workunit.client.0.smithi008.stdout:2/303: read - d1/d3/dd/d1c/f5e zero size 2023-10-18T20:58:26.327 INFO:tasks.workunit.client.1.smithi060.stdout:1/367: dread d4/d6/f65 [0,4194304] 0 2023-10-18T20:58:26.328 INFO:tasks.workunit.client.0.smithi008.stdout:6/292: creat df/d15/d33/d50/f66 x:0 0 0 2023-10-18T20:58:26.329 INFO:tasks.workunit.client.0.smithi008.stdout:6/293: truncate df/d36/f62 866224 0 2023-10-18T20:58:26.329 INFO:tasks.workunit.client.0.smithi008.stdout:6/294: fdatasync df/d26/f61 0 2023-10-18T20:58:26.329 INFO:tasks.workunit.client.1.smithi060.stdout:5/345: truncate d0/d6/f6a 2766462 0 2023-10-18T20:58:26.334 INFO:tasks.workunit.client.0.smithi008.stdout:4/273: symlink d0/d3/l63 0 2023-10-18T20:58:26.334 INFO:tasks.workunit.client.0.smithi008.stdout:4/274: write d0/d17/f3d [12994476,23147] 0 2023-10-18T20:58:26.335 INFO:tasks.workunit.client.1.smithi060.stdout:5/346: getdents d0/d6/d8/df/d27 0 2023-10-18T20:58:26.338 INFO:tasks.workunit.client.0.smithi008.stdout:9/302: mknod d2/dc/c52 0 2023-10-18T20:58:26.341 INFO:tasks.workunit.client.1.smithi060.stdout:2/280: dwrite d0/d8/d47/f4b [0,4194304] 0 2023-10-18T20:58:26.342 INFO:tasks.workunit.client.0.smithi008.stdout:2/304: rename d1/d3/dd/d1c/f5e to d1/d3/dd/d25/d4d/f68 0 2023-10-18T20:58:26.342 INFO:tasks.workunit.client.0.smithi008.stdout:6/295: creat df/d3c/f67 x:0 0 0 2023-10-18T20:58:26.344 INFO:tasks.workunit.client.1.smithi060.stdout:2/281: mknod d0/d8/d47/c51 0 2023-10-18T20:58:26.346 INFO:tasks.workunit.client.0.smithi008.stdout:2/305: symlink d1/d3/dd/d1c/l69 0 2023-10-18T20:58:26.352 INFO:tasks.workunit.client.0.smithi008.stdout:6/296: mkdir df/d18/d68 0 2023-10-18T20:58:26.353 INFO:tasks.workunit.client.0.smithi008.stdout:5/282: dwrite d0/d2/d9/f2d [0,4194304] 0 2023-10-18T20:58:26.353 INFO:tasks.workunit.client.0.smithi008.stdout:4/275: dread d0/d17/d5b/f15 [0,4194304] 0 2023-10-18T20:58:26.356 INFO:tasks.workunit.client.1.smithi060.stdout:5/347: read d0/d6/d8/df/f4e [3838606,30882] 0 2023-10-18T20:58:26.356 INFO:tasks.workunit.client.1.smithi060.stdout:5/348: dread - d0/da/d3b/d43/f63 zero size 2023-10-18T20:58:26.356 INFO:tasks.workunit.client.1.smithi060.stdout:5/349: creat d0/d6/d8/df/d27/d32/d4f/f86 x:0 0 0 2023-10-18T20:58:26.357 INFO:tasks.workunit.client.1.smithi060.stdout:5/350: truncate d0/da/d61/f7f 693066 0 2023-10-18T20:58:26.357 INFO:tasks.workunit.client.1.smithi060.stdout:6/250: dwrite d10/d1b/f2a [0,4194304] 0 2023-10-18T20:58:26.358 INFO:tasks.workunit.client.1.smithi060.stdout:2/282: mknod d0/d3/c52 0 2023-10-18T20:58:26.362 INFO:tasks.workunit.client.1.smithi060.stdout:0/308: write d3/d8/d14/d55/f58 [1894675,125181] 0 2023-10-18T20:58:26.362 INFO:tasks.workunit.client.1.smithi060.stdout:0/309: chown d3/d8/d14/d55/f58 1842580 1 2023-10-18T20:58:26.363 INFO:tasks.workunit.client.1.smithi060.stdout:9/264: sync 2023-10-18T20:58:26.365 INFO:tasks.workunit.client.0.smithi008.stdout:9/303: rename d2/dc/d17/l3e to d2/dc/d40/d46/l53 0 2023-10-18T20:58:26.374 INFO:tasks.workunit.client.1.smithi060.stdout:7/280: dwrite de/d14/d1d/f21 [0,4194304] 0 2023-10-18T20:58:26.374 INFO:tasks.workunit.client.1.smithi060.stdout:7/281: truncate de/d29/f2b 1038806 0 2023-10-18T20:58:26.376 INFO:tasks.workunit.client.0.smithi008.stdout:1/406: dwrite d9/de/df/f56 [0,4194304] 0 2023-10-18T20:58:26.376 INFO:tasks.workunit.client.0.smithi008.stdout:1/407: fsync d9/de/df/d17/d1e/f71 0 2023-10-18T20:58:26.376 INFO:tasks.workunit.client.0.smithi008.stdout:1/408: fsync d9/de/f45 0 2023-10-18T20:58:26.376 INFO:tasks.workunit.client.0.smithi008.stdout:1/409: chown d9/de/df/d17/d25/d57 4612 1 2023-10-18T20:58:26.376 INFO:tasks.workunit.client.0.smithi008.stdout:8/416: dwrite d5/d8/d24/d50/d8d/f92 [0,4194304] 0 2023-10-18T20:58:26.380 INFO:tasks.workunit.client.1.smithi060.stdout:0/310: dread d3/d8/f57 [0,4194304] 0 2023-10-18T20:58:26.380 INFO:tasks.workunit.client.1.smithi060.stdout:0/311: read - d3/d8/d14/f5b zero size 2023-10-18T20:58:26.381 INFO:tasks.workunit.client.1.smithi060.stdout:6/251: write d10/d1b/f2a [258375,18386] 0 2023-10-18T20:58:26.381 INFO:tasks.workunit.client.1.smithi060.stdout:6/252: creat d10/d2e/f55 x:0 0 0 2023-10-18T20:58:26.383 INFO:tasks.workunit.client.1.smithi060.stdout:1/368: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/f30 [4194304,4194304] 0 2023-10-18T20:58:26.386 INFO:tasks.workunit.client.1.smithi060.stdout:5/351: rename d0/d6/d8/df/d27/d32/d6d/d72/c6f to d0/d6/d9/c87 0 2023-10-18T20:58:26.389 INFO:tasks.workunit.client.1.smithi060.stdout:2/283: mkdir d0/d3/d27/d4d/d53 0 2023-10-18T20:58:26.390 INFO:tasks.workunit.client.1.smithi060.stdout:2/284: write d0/d16/f1a [630978,118953] 0 2023-10-18T20:58:26.390 INFO:tasks.workunit.client.1.smithi060.stdout:2/285: chown d0/d3/c2e 47236348 1 2023-10-18T20:58:26.394 INFO:tasks.workunit.client.0.smithi008.stdout:6/297: write df/d15/d27/f52 [3972117,23980] 0 2023-10-18T20:58:26.394 INFO:tasks.workunit.client.0.smithi008.stdout:6/298: creat df/d13/f69 x:0 0 0 2023-10-18T20:58:26.395 INFO:tasks.workunit.client.0.smithi008.stdout:3/258: dwrite d0/d3/f29 [0,4194304] 0 2023-10-18T20:58:26.395 INFO:tasks.workunit.client.0.smithi008.stdout:3/259: fsync d0/d3/de/d13/f24 0 2023-10-18T20:58:26.396 INFO:tasks.workunit.client.1.smithi060.stdout:9/265: creat d3/d10/f67 x:0 0 0 2023-10-18T20:58:26.399 INFO:tasks.workunit.client.0.smithi008.stdout:6/299: write df/d15/d48/d4b/f4f [1458921,94367] 0 2023-10-18T20:58:26.400 INFO:tasks.workunit.client.1.smithi060.stdout:0/312: rmdir d3/d32/d62 0 2023-10-18T20:58:26.400 INFO:tasks.workunit.client.1.smithi060.stdout:0/313: stat d3/f6 0 2023-10-18T20:58:26.400 INFO:tasks.workunit.client.1.smithi060.stdout:6/253: getdents d10/d17/d28 0 2023-10-18T20:58:26.401 INFO:tasks.workunit.client.0.smithi008.stdout:5/283: creat d0/de/f6c x:0 0 0 2023-10-18T20:58:26.401 INFO:tasks.workunit.client.0.smithi008.stdout:5/284: readlink d0/d2/d9/d34/l3c 0 2023-10-18T20:58:26.401 INFO:tasks.workunit.client.0.smithi008.stdout:5/285: write d0/d2/d9/f4b [470438,79420] 0 2023-10-18T20:58:26.402 INFO:tasks.workunit.client.0.smithi008.stdout:9/304: stat d2/dc/d17/d19/la 0 2023-10-18T20:58:26.418 INFO:tasks.workunit.client.1.smithi060.stdout:8/258: sync 2023-10-18T20:58:26.419 INFO:tasks.workunit.client.1.smithi060.stdout:4/258: sync 2023-10-18T20:58:26.423 INFO:tasks.workunit.client.1.smithi060.stdout:0/314: read d3/d32/f38 [4089934,93375] 0 2023-10-18T20:58:26.424 INFO:tasks.workunit.client.0.smithi008.stdout:8/417: creat d5/d8/d24/d77/fa5 x:0 0 0 2023-10-18T20:58:26.426 INFO:tasks.workunit.client.0.smithi008.stdout:4/276: dwrite d0/d3/d21/f3e [0,4194304] 0 2023-10-18T20:58:26.427 INFO:tasks.workunit.client.1.smithi060.stdout:7/282: dwrite de/d29/f37 [0,4194304] 0 2023-10-18T20:58:26.430 INFO:tasks.workunit.client.1.smithi060.stdout:1/369: link d4/d6/d14/d41/c43 d4/d6/d7/d2f/d7b/d2a/d32/dd/c7c 0 2023-10-18T20:58:26.431 INFO:tasks.workunit.client.1.smithi060.stdout:1/370: truncate d4/d6/d7/d2f/f39 1442441 0 2023-10-18T20:58:26.433 INFO:tasks.workunit.client.0.smithi008.stdout:1/410: dwrite d9/de/df/d17/d25/f29 [0,4194304] 0 2023-10-18T20:58:26.434 INFO:tasks.workunit.client.0.smithi008.stdout:0/248: sync 2023-10-18T20:58:26.434 INFO:tasks.workunit.client.0.smithi008.stdout:0/249: stat d0/dd/l26 0 2023-10-18T20:58:26.436 INFO:tasks.workunit.client.0.smithi008.stdout:2/306: getdents d1 0 2023-10-18T20:58:26.436 INFO:tasks.workunit.client.0.smithi008.stdout:2/307: dread - d1/d3/dd/d1c/d3a/d57/f67 zero size 2023-10-18T20:58:26.437 INFO:tasks.workunit.client.1.smithi060.stdout:5/352: unlink d0/d6/c7e 0 2023-10-18T20:58:26.441 INFO:tasks.workunit.client.1.smithi060.stdout:2/286: creat d0/d3/d27/d4d/f54 x:0 0 0 2023-10-18T20:58:26.441 INFO:tasks.workunit.client.1.smithi060.stdout:3/254: sync 2023-10-18T20:58:26.442 INFO:tasks.workunit.client.1.smithi060.stdout:3/255: chown d0/d3c/d3d/c3f 18 1 2023-10-18T20:58:26.442 INFO:tasks.workunit.client.1.smithi060.stdout:3/256: read - d0/d22/d26/d29/f45 zero size 2023-10-18T20:58:26.443 INFO:tasks.workunit.client.1.smithi060.stdout:3/257: fdatasync d0/f4e 0 2023-10-18T20:58:26.443 INFO:tasks.workunit.client.1.smithi060.stdout:9/266: getdents d3/d10/d1c 0 2023-10-18T20:58:26.445 INFO:tasks.workunit.client.1.smithi060.stdout:6/254: rename d10/d1b/f2a to d10/d2e/f56 0 2023-10-18T20:58:26.445 INFO:tasks.workunit.client.0.smithi008.stdout:3/260: mkdir d0/d3/de/d13/d35/d51 0 2023-10-18T20:58:26.446 INFO:tasks.workunit.client.1.smithi060.stdout:8/259: truncate f3 3687337 0 2023-10-18T20:58:26.446 INFO:tasks.workunit.client.1.smithi060.stdout:4/259: mkdir d4/dc/d2a/d1d/d4a 0 2023-10-18T20:58:26.447 INFO:tasks.workunit.client.0.smithi008.stdout:6/300: symlink df/d19/l6a 0 2023-10-18T20:58:26.448 INFO:tasks.workunit.client.1.smithi060.stdout:0/315: creat d3/d8/d14/d49/f63 x:0 0 0 2023-10-18T20:58:26.449 INFO:tasks.workunit.client.1.smithi060.stdout:0/316: chown d3/d8/f9 1513787 1 2023-10-18T20:58:26.449 INFO:tasks.workunit.client.0.smithi008.stdout:5/286: symlink d0/d2/d19/d1b/d41/l6d 0 2023-10-18T20:58:26.449 INFO:tasks.workunit.client.0.smithi008.stdout:5/287: fsync d0/d2/d19/d1b/d31/f55 0 2023-10-18T20:58:26.450 INFO:tasks.workunit.client.0.smithi008.stdout:5/288: chown d0/d2/d9/f54 253823 1 2023-10-18T20:58:26.450 INFO:tasks.workunit.client.0.smithi008.stdout:9/305: creat d2/dc/d1a/f54 x:0 0 0 2023-10-18T20:58:26.450 INFO:tasks.workunit.client.0.smithi008.stdout:9/306: chown d2/dc/d17/c2a 686353 1 2023-10-18T20:58:26.452 INFO:tasks.workunit.client.0.smithi008.stdout:8/418: unlink d5/d8/d24/f27 0 2023-10-18T20:58:26.452 INFO:tasks.workunit.client.0.smithi008.stdout:8/419: fdatasync d5/f4b 0 2023-10-18T20:58:26.452 INFO:tasks.workunit.client.0.smithi008.stdout:8/420: fsync d5/d8/df/d54/f62 0 2023-10-18T20:58:26.453 INFO:tasks.workunit.client.1.smithi060.stdout:5/353: creat d0/dd/f88 x:0 0 0 2023-10-18T20:58:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:1/411: write d9/de/df/d17/d1e/f65 [3735987,118203] 0 2023-10-18T20:58:26.464 INFO:tasks.workunit.client.1.smithi060.stdout:2/287: mkdir d0/d45/d49/d55 0 2023-10-18T20:58:26.465 INFO:tasks.workunit.client.1.smithi060.stdout:9/267: mknod d3/d10/d1c/d2a/c68 0 2023-10-18T20:58:26.465 INFO:tasks.workunit.client.1.smithi060.stdout:9/268: readlink d3/l12 0 2023-10-18T20:58:26.465 INFO:tasks.workunit.client.1.smithi060.stdout:2/288: truncate d0/d8/f42 2935524 0 2023-10-18T20:58:26.465 INFO:tasks.workunit.client.1.smithi060.stdout:2/289: fdatasync d0/d3/d27/f4c 0 2023-10-18T20:58:26.468 INFO:tasks.workunit.client.1.smithi060.stdout:7/283: rename de/d14/d41/d4b to de/d14/d2f/d3f/d5a 0 2023-10-18T20:58:26.474 INFO:tasks.workunit.client.1.smithi060.stdout:8/260: readlink d4/l1c 0 2023-10-18T20:58:26.483 INFO:tasks.workunit.client.0.smithi008.stdout:7/302: sync 2023-10-18T20:58:26.485 INFO:tasks.workunit.client.1.smithi060.stdout:7/284: dread de/f17 [0,4194304] 0 2023-10-18T20:58:26.485 INFO:tasks.workunit.client.1.smithi060.stdout:7/285: fdatasync de/d14/d49/f55 0 2023-10-18T20:58:26.486 INFO:tasks.workunit.client.1.smithi060.stdout:5/354: unlink d0/da/l29 0 2023-10-18T20:58:26.488 INFO:tasks.workunit.client.0.smithi008.stdout:0/250: creat d0/dd/df/f4c x:0 0 0 2023-10-18T20:58:26.488 INFO:tasks.workunit.client.1.smithi060.stdout:5/355: fdatasync d0/d6/d8/df/d27/d32/d4f/f68 0 2023-10-18T20:58:26.490 INFO:tasks.workunit.client.0.smithi008.stdout:2/308: mknod d1/d3/dd/d25/c6a 0 2023-10-18T20:58:26.491 INFO:tasks.workunit.client.0.smithi008.stdout:2/309: write d1/d3/d40/f62 [389473,21713] 0 2023-10-18T20:58:26.492 INFO:tasks.workunit.client.0.smithi008.stdout:3/261: mkdir d0/d3/d42/d52 0 2023-10-18T20:58:26.492 INFO:tasks.workunit.client.0.smithi008.stdout:3/262: fsync d0/d3/f33 0 2023-10-18T20:58:26.494 INFO:tasks.workunit.client.1.smithi060.stdout:7/286: dread de/f17 [0,4194304] 0 2023-10-18T20:58:26.495 INFO:tasks.workunit.client.1.smithi060.stdout:7/287: write de/f27 [4695066,37758] 0 2023-10-18T20:58:26.495 INFO:tasks.workunit.client.1.smithi060.stdout:7/288: chown de/d14/d3a/l50 3568882 1 2023-10-18T20:58:26.495 INFO:tasks.workunit.client.1.smithi060.stdout:7/289: chown de/c18 797141168 1 2023-10-18T20:58:26.496 INFO:tasks.workunit.client.1.smithi060.stdout:3/258: rename d0/d22/d26/d2b/c4f to d0/d22/c5a 0 2023-10-18T20:58:26.503 INFO:tasks.workunit.client.0.smithi008.stdout:6/301: link df/f3b df/d18/d68/f6b 0 2023-10-18T20:58:26.504 INFO:tasks.workunit.client.1.smithi060.stdout:7/290: dread de/f1a [0,4194304] 0 2023-10-18T20:58:26.504 INFO:tasks.workunit.client.1.smithi060.stdout:7/291: read de/f1a [505753,50344] 0 2023-10-18T20:58:26.504 INFO:tasks.workunit.client.1.smithi060.stdout:2/290: getdents d0/d3 0 2023-10-18T20:58:26.512 INFO:tasks.workunit.client.1.smithi060.stdout:1/371: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/f25 [4194304,4194304] 0 2023-10-18T20:58:26.512 INFO:tasks.workunit.client.1.smithi060.stdout:1/372: dread - d4/d6/d7/d2f/f70 zero size 2023-10-18T20:58:26.513 INFO:tasks.workunit.client.1.smithi060.stdout:1/373: creat d4/d6/d33/f7d x:0 0 0 2023-10-18T20:58:26.513 INFO:tasks.workunit.client.1.smithi060.stdout:1/374: stat d4/da/d42 0 2023-10-18T20:58:26.513 INFO:tasks.workunit.client.0.smithi008.stdout:5/289: mkdir d0/d6e 0 2023-10-18T20:58:26.513 INFO:tasks.workunit.client.0.smithi008.stdout:1/412: rename d9/de/df/d17/d25/d57/c5d to d9/de/df/d17/d25/d57/c7c 0 2023-10-18T20:58:26.514 INFO:tasks.workunit.client.0.smithi008.stdout:1/413: readlink d9/de/df/d17/d1e/l36 0 2023-10-18T20:58:26.514 INFO:tasks.workunit.client.0.smithi008.stdout:7/303: mknod d1/d3/d20/c69 0 2023-10-18T20:58:26.514 INFO:tasks.workunit.client.0.smithi008.stdout:7/304: fdatasync d1/d3/f2a 0 2023-10-18T20:58:26.514 INFO:tasks.workunit.client.0.smithi008.stdout:7/305: creat d1/d36/d3d/d49/f6a x:0 0 0 2023-10-18T20:58:26.515 INFO:tasks.workunit.client.1.smithi060.stdout:8/261: rename d4/c1a to d4/d9/c49 0 2023-10-18T20:58:26.515 INFO:tasks.workunit.client.1.smithi060.stdout:8/262: creat d4/d9/d31/d35/f4a x:0 0 0 2023-10-18T20:58:26.527 INFO:tasks.workunit.client.1.smithi060.stdout:7/292: mkdir de/d14/d41/d58/d5b 0 2023-10-18T20:58:26.528 INFO:tasks.workunit.client.1.smithi060.stdout:3/259: symlink d0/d22/d26/l5b 0 2023-10-18T20:58:26.528 INFO:tasks.workunit.client.1.smithi060.stdout:2/291: mkdir d0/d8/d56 0 2023-10-18T20:58:26.528 INFO:tasks.workunit.client.1.smithi060.stdout:2/292: fsync d0/d8/f42 0 2023-10-18T20:58:26.533 INFO:tasks.workunit.client.0.smithi008.stdout:2/310: creat d1/d3/dd/f6b x:0 0 0 2023-10-18T20:58:26.537 INFO:tasks.workunit.client.0.smithi008.stdout:6/302: symlink df/d15/l6c 0 2023-10-18T20:58:26.538 INFO:tasks.workunit.client.0.smithi008.stdout:1/414: mkdir d9/de/df/d17/d1e/d7d 0 2023-10-18T20:58:26.538 INFO:tasks.workunit.client.0.smithi008.stdout:1/415: fdatasync d9/de/f45 0 2023-10-18T20:58:26.538 INFO:tasks.workunit.client.0.smithi008.stdout:1/416: chown d9/de/c23 207878006 1 2023-10-18T20:58:26.538 INFO:tasks.workunit.client.0.smithi008.stdout:1/417: getdents d9/de/df/d17/d1e/d7d 0 2023-10-18T20:58:26.539 INFO:tasks.workunit.client.1.smithi060.stdout:8/263: symlink d4/d9/l4b 0 2023-10-18T20:58:26.540 INFO:tasks.workunit.client.1.smithi060.stdout:3/260: symlink d0/d22/d26/d29/l5c 0 2023-10-18T20:58:26.540 INFO:tasks.workunit.client.1.smithi060.stdout:3/261: truncate d0/f1f 349641 0 2023-10-18T20:58:26.540 INFO:tasks.workunit.client.0.smithi008.stdout:6/303: mknod df/d3c/c6d 0 2023-10-18T20:58:26.541 INFO:tasks.workunit.client.0.smithi008.stdout:6/304: readlink df/d13/l43 0 2023-10-18T20:58:26.545 INFO:tasks.workunit.client.0.smithi008.stdout:6/305: creat df/d18/d68/f6e x:0 0 0 2023-10-18T20:58:26.545 INFO:tasks.workunit.client.0.smithi008.stdout:6/306: chown l0 41 1 2023-10-18T20:58:26.546 INFO:tasks.workunit.client.1.smithi060.stdout:3/262: mknod d0/d22/d26/d2b/c5d 0 2023-10-18T20:58:26.546 INFO:tasks.workunit.client.1.smithi060.stdout:3/263: chown d0/d22/f33 6285 1 2023-10-18T20:58:26.546 INFO:tasks.workunit.client.1.smithi060.stdout:2/293: read d0/d8/f1b [934350,67634] 0 2023-10-18T20:58:26.547 INFO:tasks.workunit.client.1.smithi060.stdout:2/294: creat d0/d3/d27/f57 x:0 0 0 2023-10-18T20:58:26.547 INFO:tasks.workunit.client.1.smithi060.stdout:2/295: chown d0/d3/d27/f46 6 1 2023-10-18T20:58:26.548 INFO:tasks.workunit.client.1.smithi060.stdout:8/264: rename d4/c29 to d4/d9/c4c 0 2023-10-18T20:58:26.548 INFO:tasks.workunit.client.1.smithi060.stdout:8/265: write d4/d9/f1b [364489,67725] 0 2023-10-18T20:58:26.548 INFO:tasks.workunit.client.1.smithi060.stdout:8/266: creat d4/d9/d31/d35/f4d x:0 0 0 2023-10-18T20:58:26.549 INFO:tasks.workunit.client.0.smithi008.stdout:6/307: truncate df/d15/d48/d4b/f4f 1232137 0 2023-10-18T20:58:26.552 INFO:tasks.workunit.client.0.smithi008.stdout:6/308: symlink df/d13/d53/d64/l6f 0 2023-10-18T20:58:26.553 INFO:tasks.workunit.client.1.smithi060.stdout:3/264: mkdir d0/d5e 0 2023-10-18T20:58:26.555 INFO:tasks.workunit.client.0.smithi008.stdout:6/309: getdents df/d26 0 2023-10-18T20:58:26.562 INFO:tasks.workunit.client.0.smithi008.stdout:5/290: dread d0/d2/f7 [4194304,4194304] 0 2023-10-18T20:58:26.565 INFO:tasks.workunit.client.0.smithi008.stdout:5/291: write d0/d2/d19/f2f [1161860,120589] 0 2023-10-18T20:58:26.566 INFO:tasks.workunit.client.0.smithi008.stdout:5/292: readlink d0/d2/d9/d34/l3c 0 2023-10-18T20:58:26.566 INFO:tasks.workunit.client.0.smithi008.stdout:7/306: write d1/d36/d3d/d49/f4a [2854625,13391] 0 2023-10-18T20:58:26.567 INFO:tasks.workunit.client.1.smithi060.stdout:9/269: dwrite d3/d10/d19/d54/f51 [0,4194304] 0 2023-10-18T20:58:26.567 INFO:tasks.workunit.client.1.smithi060.stdout:9/270: read - d3/f5e zero size 2023-10-18T20:58:26.571 INFO:tasks.workunit.client.1.smithi060.stdout:9/271: link d3/d10/d1c/d2a/d2d/f2e d3/d10/f69 0 2023-10-18T20:58:26.579 INFO:tasks.workunit.client.0.smithi008.stdout:7/307: rename d1/f1f to d1/d3/f6b 0 2023-10-18T20:58:26.583 INFO:tasks.workunit.client.0.smithi008.stdout:7/308: readlink d1/d36/d3d/l63 0 2023-10-18T20:58:26.584 INFO:tasks.workunit.client.1.smithi060.stdout:7/293: dread de/d14/f2d [0,4194304] 0 2023-10-18T20:58:26.587 INFO:tasks.workunit.client.1.smithi060.stdout:9/272: creat d3/d10/d1c/f6a x:0 0 0 2023-10-18T20:58:26.587 INFO:tasks.workunit.client.1.smithi060.stdout:9/273: write d3/f20 [930648,79921] 0 2023-10-18T20:58:26.588 INFO:tasks.workunit.client.0.smithi008.stdout:9/307: dwrite d2/f5 [0,4194304] 0 2023-10-18T20:58:26.588 INFO:tasks.workunit.client.1.smithi060.stdout:7/294: mknod de/d14/d41/d58/d5b/c5c 0 2023-10-18T20:58:26.594 INFO:tasks.workunit.client.1.smithi060.stdout:9/274: link d3/c16 d3/d10/c6b 0 2023-10-18T20:58:26.594 INFO:tasks.workunit.client.1.smithi060.stdout:7/295: getdents de/d14/d2f 0 2023-10-18T20:58:26.594 INFO:tasks.workunit.client.1.smithi060.stdout:7/296: readlink de/d38/l51 0 2023-10-18T20:58:26.595 INFO:tasks.workunit.client.0.smithi008.stdout:9/308: creat d2/dc/d17/d19/f55 x:0 0 0 2023-10-18T20:58:26.595 INFO:tasks.workunit.client.0.smithi008.stdout:9/309: chown d2/dc/d17/l45 16775921 1 2023-10-18T20:58:26.596 INFO:tasks.workunit.client.1.smithi060.stdout:8/267: dread d4/f22 [0,4194304] 0 2023-10-18T20:58:26.596 INFO:tasks.workunit.client.1.smithi060.stdout:8/268: read - d4/d9/d31/d35/f4a zero size 2023-10-18T20:58:26.596 INFO:tasks.workunit.client.1.smithi060.stdout:8/269: chown d4/d9/c16 25807 1 2023-10-18T20:58:26.601 INFO:tasks.workunit.client.0.smithi008.stdout:0/251: dwrite d0/dd/df/d2a/f2d [4194304,4194304] 0 2023-10-18T20:58:26.601 INFO:tasks.workunit.client.0.smithi008.stdout:4/277: dwrite d0/d3/d21/f51 [0,4194304] 0 2023-10-18T20:58:26.602 INFO:tasks.workunit.client.0.smithi008.stdout:5/293: dread d0/f29 [0,4194304] 0 2023-10-18T20:58:26.602 INFO:tasks.workunit.client.1.smithi060.stdout:6/255: dwrite d10/f19 [0,4194304] 0 2023-10-18T20:58:26.602 INFO:tasks.workunit.client.1.smithi060.stdout:6/256: chown d10/d17/c43 18 1 2023-10-18T20:58:26.603 INFO:tasks.workunit.client.1.smithi060.stdout:6/257: creat d10/d25/f57 x:0 0 0 2023-10-18T20:58:26.603 INFO:tasks.workunit.client.0.smithi008.stdout:3/263: dwrite d0/d3/f2b [0,4194304] 0 2023-10-18T20:58:26.604 INFO:tasks.workunit.client.1.smithi060.stdout:1/375: dwrite d4/da/f5b [0,4194304] 0 2023-10-18T20:58:26.606 INFO:tasks.workunit.client.0.smithi008.stdout:1/418: getdents d9/de/df/d17/d25/d57 0 2023-10-18T20:58:26.606 INFO:tasks.workunit.client.0.smithi008.stdout:1/419: creat d9/de/df/d17/d1e/d3c/f7e x:0 0 0 2023-10-18T20:58:26.610 INFO:tasks.workunit.client.1.smithi060.stdout:2/296: read d0/d3/f35 [2445398,6292] 0 2023-10-18T20:58:26.611 INFO:tasks.workunit.client.1.smithi060.stdout:5/356: dwrite d0/d6/d8/df/d27/d32/d4f/f86 [0,4194304] 0 2023-10-18T20:58:26.611 INFO:tasks.workunit.client.1.smithi060.stdout:5/357: chown d0/dd 1 1 2023-10-18T20:58:26.611 INFO:tasks.workunit.client.1.smithi060.stdout:9/275: truncate d3/d10/f3c 807801 0 2023-10-18T20:58:26.611 INFO:tasks.workunit.client.1.smithi060.stdout:9/276: fsync d3/d10/d1c/d2a/d33/f31 0 2023-10-18T20:58:26.612 INFO:tasks.workunit.client.1.smithi060.stdout:9/277: chown d3/d10/d19/d54/f51 0 1 2023-10-18T20:58:26.612 INFO:tasks.workunit.client.1.smithi060.stdout:7/297: symlink de/d14/d2f/d3f/l5d 0 2023-10-18T20:58:26.613 INFO:tasks.workunit.client.1.smithi060.stdout:8/270: mkdir d4/d9/d37/d4e 0 2023-10-18T20:58:26.623 INFO:tasks.workunit.client.1.smithi060.stdout:2/297: dread d0/d8/f1b [0,4194304] 0 2023-10-18T20:58:26.625 INFO:tasks.workunit.client.1.smithi060.stdout:3/265: dwrite d0/d22/d26/d29/f44 [0,4194304] 0 2023-10-18T20:58:26.625 INFO:tasks.workunit.client.1.smithi060.stdout:3/266: stat d0/f24 0 2023-10-18T20:58:26.626 INFO:tasks.workunit.client.1.smithi060.stdout:3/267: dread - d0/d3c/d3d/f3e zero size 2023-10-18T20:58:26.627 INFO:tasks.workunit.client.0.smithi008.stdout:6/310: rmdir df/d18 39 2023-10-18T20:58:26.643 INFO:tasks.workunit.client.0.smithi008.stdout:2/311: dwrite d1/d3/dd/f50 [0,4194304] 0 2023-10-18T20:58:26.643 INFO:tasks.workunit.client.0.smithi008.stdout:0/252: mknod d0/d3a/c4d 0 2023-10-18T20:58:26.643 INFO:tasks.workunit.client.0.smithi008.stdout:0/253: write d0/dd/d19/d24/f3d [832612,102881] 0 2023-10-18T20:58:26.644 INFO:tasks.workunit.client.0.smithi008.stdout:0/254: creat d0/dd/d19/f4e x:0 0 0 2023-10-18T20:58:26.644 INFO:tasks.workunit.client.0.smithi008.stdout:5/294: mkdir d0/d2/d19/d1b/d41/d6f 0 2023-10-18T20:58:26.660 INFO:tasks.workunit.client.0.smithi008.stdout:1/420: write d9/de/f45 [2343811,122068] 0 2023-10-18T20:58:26.660 INFO:tasks.workunit.client.0.smithi008.stdout:1/421: fsync d9/de/df/d17/d1e/f71 0 2023-10-18T20:58:26.660 INFO:tasks.workunit.client.0.smithi008.stdout:6/311: write df/d19/f3e [1068288,34178] 0 2023-10-18T20:58:26.660 INFO:tasks.workunit.client.0.smithi008.stdout:6/312: chown df/d15/d33/d50/l65 645955 1 2023-10-18T20:58:26.663 INFO:tasks.workunit.client.0.smithi008.stdout:7/309: dwrite d1/d3/f17 [0,4194304] 0 2023-10-18T20:58:26.664 INFO:tasks.workunit.client.0.smithi008.stdout:4/278: read d0/f14 [1587687,105037] 0 2023-10-18T20:58:26.664 INFO:tasks.workunit.client.0.smithi008.stdout:4/279: creat d0/d3/f64 x:0 0 0 2023-10-18T20:58:26.669 INFO:tasks.workunit.client.1.smithi060.stdout:6/258: link d10/d17/d2f/l37 d10/d2e/l58 0 2023-10-18T20:58:26.676 INFO:tasks.workunit.client.1.smithi060.stdout:1/376: rmdir d4/d38 39 2023-10-18T20:58:26.677 INFO:tasks.workunit.client.1.smithi060.stdout:1/377: truncate d4/d6/d7/df/d59/f6f 67935 0 2023-10-18T20:58:26.677 INFO:tasks.workunit.client.0.smithi008.stdout:0/255: symlink d0/dd/d19/l4f 0 2023-10-18T20:58:26.677 INFO:tasks.workunit.client.0.smithi008.stdout:0/256: chown d0/dd/d19 11 1 2023-10-18T20:58:26.681 INFO:tasks.workunit.client.0.smithi008.stdout:5/295: mkdir d0/d2/d19/d1b/d31/d3f/d70 0 2023-10-18T20:58:26.684 INFO:tasks.workunit.client.1.smithi060.stdout:2/298: dwrite d0/d8/f2b [0,4194304] 0 2023-10-18T20:58:26.685 INFO:tasks.workunit.client.1.smithi060.stdout:2/299: chown d0/d3/d27/d4d/f54 7964873 1 2023-10-18T20:58:26.685 INFO:tasks.workunit.client.0.smithi008.stdout:7/310: link d1/d3/l40 d1/d3/d20/d54/l6c 0 2023-10-18T20:58:26.688 INFO:tasks.workunit.client.1.smithi060.stdout:5/358: mknod d0/da/d3b/c89 0 2023-10-18T20:58:26.688 INFO:tasks.workunit.client.1.smithi060.stdout:5/359: dread - d0/da/d3b/d43/f50 zero size 2023-10-18T20:58:26.690 INFO:tasks.workunit.client.1.smithi060.stdout:9/278: mknod d3/d10/d1c/c6c 0 2023-10-18T20:58:26.691 INFO:tasks.workunit.client.1.smithi060.stdout:9/279: creat d3/f6d x:0 0 0 2023-10-18T20:58:26.695 INFO:tasks.workunit.client.0.smithi008.stdout:2/312: rename d1/d3/dd/d1c/d39/l4a to d1/d3/dd/l6c 0 2023-10-18T20:58:26.696 INFO:tasks.workunit.client.1.smithi060.stdout:7/298: creat de/d14/d41/d58/d5b/f5e x:0 0 0 2023-10-18T20:58:26.698 INFO:tasks.workunit.client.0.smithi008.stdout:0/257: creat d0/dd/d19/d41/f50 x:0 0 0 2023-10-18T20:58:26.699 INFO:tasks.workunit.client.1.smithi060.stdout:8/271: unlink d4/d9/l3b 0 2023-10-18T20:58:26.699 INFO:tasks.workunit.client.0.smithi008.stdout:5/296: stat d0/d2/c30 0 2023-10-18T20:58:26.700 INFO:tasks.workunit.client.0.smithi008.stdout:5/297: fsync d0/d2/d9/f54 0 2023-10-18T20:58:26.707 INFO:tasks.workunit.client.0.smithi008.stdout:7/311: link d1/l25 d1/d3/l6d 0 2023-10-18T20:58:26.707 INFO:tasks.workunit.client.0.smithi008.stdout:7/312: truncate d1/d3/d20/f43 142315 0 2023-10-18T20:58:26.708 INFO:tasks.workunit.client.0.smithi008.stdout:7/313: creat d1/d36/d3b/d4f/f6e x:0 0 0 2023-10-18T20:58:26.709 INFO:tasks.workunit.client.0.smithi008.stdout:4/280: rmdir d0/d17/d5b 39 2023-10-18T20:58:26.713 INFO:tasks.workunit.client.1.smithi060.stdout:8/272: write d4/d9/f2e [4162766,78290] 0 2023-10-18T20:58:26.713 INFO:tasks.workunit.client.1.smithi060.stdout:8/273: dread - d4/d9/d31/d35/f4d zero size 2023-10-18T20:58:26.714 INFO:tasks.workunit.client.0.smithi008.stdout:9/310: dwrite d2/dc/f4e [0,4194304] 0 2023-10-18T20:58:26.714 INFO:tasks.workunit.client.0.smithi008.stdout:9/311: read d2/dc/f1c [3635715,123592] 0 2023-10-18T20:58:26.714 INFO:tasks.workunit.client.0.smithi008.stdout:9/312: dread - d2/dc/d1a/f54 zero size 2023-10-18T20:58:26.715 INFO:tasks.workunit.client.0.smithi008.stdout:6/313: rename df/d15/l44 to df/d15/d5e/l70 0 2023-10-18T20:58:26.717 INFO:tasks.workunit.client.0.smithi008.stdout:0/258: dread d0/dd/df/d2a/f33 [0,4194304] 0 2023-10-18T20:58:26.718 INFO:tasks.workunit.client.1.smithi060.stdout:3/268: mknod d0/d22/d26/c5f 0 2023-10-18T20:58:26.718 INFO:tasks.workunit.client.1.smithi060.stdout:6/259: truncate d10/d2e/f56 4026684 0 2023-10-18T20:58:26.719 INFO:tasks.workunit.client.1.smithi060.stdout:3/269: write d0/d22/d26/f43 [539342,82713] 0 2023-10-18T20:58:26.723 INFO:tasks.workunit.client.1.smithi060.stdout:1/378: truncate d4/d6/d7/d2f/d7b/d2a/f46 6196691 0 2023-10-18T20:58:26.739 INFO:tasks.workunit.client.0.smithi008.stdout:9/313: mkdir d2/dc/d40/d56 0 2023-10-18T20:58:26.742 INFO:tasks.workunit.client.0.smithi008.stdout:4/281: dread d0/d17/f3d [0,4194304] 0 2023-10-18T20:58:26.742 INFO:tasks.workunit.client.1.smithi060.stdout:2/300: truncate d0/d45/d49/f39 2290151 0 2023-10-18T20:58:26.742 INFO:tasks.workunit.client.1.smithi060.stdout:2/301: fdatasync d0/d3/d27/d4d/f54 0 2023-10-18T20:58:26.764 INFO:tasks.workunit.client.0.smithi008.stdout:2/313: dwrite d1/d3/dd/f1e [4194304,4194304] 0 2023-10-18T20:58:26.766 INFO:tasks.workunit.client.1.smithi060.stdout:9/280: creat d3/d10/d19/f6e x:0 0 0 2023-10-18T20:58:26.768 INFO:tasks.workunit.client.0.smithi008.stdout:1/422: dwrite d9/de/df/d17/d1e/d3c/f7e [0,4194304] 0 2023-10-18T20:58:26.769 INFO:tasks.workunit.client.0.smithi008.stdout:1/423: fdatasync d9/de/df/d17/d55/f79 0 2023-10-18T20:58:26.771 INFO:tasks.workunit.client.1.smithi060.stdout:7/299: truncate de/f17 580662 0 2023-10-18T20:58:26.775 INFO:tasks.workunit.client.0.smithi008.stdout:4/282: creat d0/d17/d5b/f65 x:0 0 0 2023-10-18T20:58:26.775 INFO:tasks.workunit.client.0.smithi008.stdout:4/283: chown d0/d3/d21/f51 91653 1 2023-10-18T20:58:26.775 INFO:tasks.workunit.client.0.smithi008.stdout:9/314: getdents d2 0 2023-10-18T20:58:26.776 INFO:tasks.workunit.client.0.smithi008.stdout:9/315: read d2/f3 [6315053,62157] 0 2023-10-18T20:58:26.778 INFO:tasks.workunit.client.0.smithi008.stdout:0/259: dwrite d0/f3 [0,4194304] 0 2023-10-18T20:58:26.778 INFO:tasks.workunit.client.0.smithi008.stdout:0/260: chown d0/dd/f18 1828940409 1 2023-10-18T20:58:26.781 INFO:tasks.workunit.client.0.smithi008.stdout:3/264: dwrite d0/d3/f33 [0,4194304] 0 2023-10-18T20:58:26.782 INFO:tasks.workunit.client.1.smithi060.stdout:6/260: mkdir d10/d2e/d59 0 2023-10-18T20:58:26.783 INFO:tasks.workunit.client.1.smithi060.stdout:3/270: unlink d0/c14 0 2023-10-18T20:58:26.783 INFO:tasks.workunit.client.1.smithi060.stdout:0/317: sync 2023-10-18T20:58:26.783 INFO:tasks.workunit.client.1.smithi060.stdout:4/260: sync 2023-10-18T20:58:26.793 INFO:tasks.workunit.client.0.smithi008.stdout:7/314: dread d1/d3/f2a [0,4194304] 0 2023-10-18T20:58:26.793 INFO:tasks.workunit.client.0.smithi008.stdout:7/315: fsync d1/d36/d3b/d4f/f5b 0 2023-10-18T20:58:26.793 INFO:tasks.workunit.client.0.smithi008.stdout:7/316: stat d1/d3/f17 0 2023-10-18T20:58:26.794 INFO:tasks.workunit.client.1.smithi060.stdout:6/261: read fb [1815173,105687] 0 2023-10-18T20:58:26.794 INFO:tasks.workunit.client.1.smithi060.stdout:6/262: fsync d10/d1b/f22 0 2023-10-18T20:58:26.795 INFO:tasks.workunit.client.0.smithi008.stdout:0/261: creat d0/f51 x:0 0 0 2023-10-18T20:58:26.795 INFO:tasks.workunit.client.0.smithi008.stdout:0/262: fsync d0/dd/d19/d24/f35 0 2023-10-18T20:58:26.795 INFO:tasks.workunit.client.0.smithi008.stdout:4/284: chown d0/d17/f31 31303 1 2023-10-18T20:58:26.796 INFO:tasks.workunit.client.1.smithi060.stdout:6/263: write d10/d2e/f33 [868618,113350] 0 2023-10-18T20:58:26.796 INFO:tasks.workunit.client.1.smithi060.stdout:1/379: truncate d4/d6/d7/f26 3638366 0 2023-10-18T20:58:26.796 INFO:tasks.workunit.client.1.smithi060.stdout:1/380: truncate d4/da/d42/f64 608433 0 2023-10-18T20:58:26.797 INFO:tasks.workunit.client.1.smithi060.stdout:1/381: readlink d4/d6/d7/d2f/d7b/l34 0 2023-10-18T20:58:26.797 INFO:tasks.workunit.client.1.smithi060.stdout:1/382: truncate d4/d6/f4e 46994 0 2023-10-18T20:58:26.797 INFO:tasks.workunit.client.1.smithi060.stdout:1/383: write d4/da/d42/f64 [676242,4826] 0 2023-10-18T20:58:26.801 INFO:tasks.workunit.client.0.smithi008.stdout:1/424: dread d9/de/f15 [0,4194304] 0 2023-10-18T20:58:26.806 INFO:tasks.workunit.client.1.smithi060.stdout:9/281: truncate d3/d10/fe 188263 0 2023-10-18T20:58:26.806 INFO:tasks.workunit.client.1.smithi060.stdout:9/282: chown d3/d58 407880 1 2023-10-18T20:58:26.808 INFO:tasks.workunit.client.0.smithi008.stdout:6/314: dwrite df/d3c/f67 [0,4194304] 0 2023-10-18T20:58:26.809 INFO:tasks.workunit.client.0.smithi008.stdout:6/315: chown df/d15/d48/d4b/f4f 855448 1 2023-10-18T20:58:26.811 INFO:tasks.workunit.client.1.smithi060.stdout:7/300: mkdir de/d14/d2f/d3f/d5a/d5f 0 2023-10-18T20:58:26.811 INFO:tasks.workunit.client.1.smithi060.stdout:7/301: fdatasync de/d14/d41/d58/d5b/f5e 0 2023-10-18T20:58:26.812 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:25.534647+0000 mgr.smithi060.pgqqwa (mgr.14584) 44 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 978 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 93 MiB/s rd, 110 MiB/s wr, 302 op/s 2023-10-18T20:58:26.813 INFO:tasks.workunit.client.1.smithi060.stdout:8/274: getdents d4/d9/d31/d35 0 2023-10-18T20:58:26.825 INFO:tasks.workunit.client.0.smithi008.stdout:2/314: dwrite d1/d3/d40/f62 [0,4194304] 0 2023-10-18T20:58:26.829 INFO:tasks.workunit.client.1.smithi060.stdout:5/360: sync 2023-10-18T20:58:26.829 INFO:tasks.workunit.client.1.smithi060.stdout:3/271: symlink d0/d22/d26/d29/l60 0 2023-10-18T20:58:26.830 INFO:tasks.workunit.client.1.smithi060.stdout:3/272: read - d0/d22/d26/d29/f45 zero size 2023-10-18T20:58:26.832 INFO:tasks.workunit.client.0.smithi008.stdout:3/265: dread d0/d3/f2b [0,4194304] 0 2023-10-18T20:58:26.832 INFO:tasks.workunit.client.0.smithi008.stdout:9/316: dwrite d2/dc/f4c [0,4194304] 0 2023-10-18T20:58:26.837 INFO:tasks.workunit.client.1.smithi060.stdout:9/283: write d3/d10/d1c/d2a/f32 [2471426,46961] 0 2023-10-18T20:58:26.842 INFO:tasks.workunit.client.1.smithi060.stdout:0/318: link d3/d8/f22 d3/d8/d14/d49/f64 0 2023-10-18T20:58:26.844 INFO:tasks.workunit.client.0.smithi008.stdout:3/266: dread d0/d3/de/d13/f24 [0,4194304] 0 2023-10-18T20:58:26.847 INFO:tasks.workunit.client.0.smithi008.stdout:9/317: dread d2/f26 [0,4194304] 0 2023-10-18T20:58:26.847 INFO:tasks.workunit.client.0.smithi008.stdout:9/318: fdatasync d2/f26 0 2023-10-18T20:58:26.847 INFO:tasks.workunit.client.0.smithi008.stdout:9/319: dread - d2/dc/d17/d19/f55 zero size 2023-10-18T20:58:26.847 INFO:tasks.workunit.client.1.smithi060.stdout:4/261: symlink d4/dc/d40/l4b 0 2023-10-18T20:58:26.850 INFO:tasks.workunit.client.0.smithi008.stdout:0/263: rename d0/c31 to d0/dd/d19/c52 0 2023-10-18T20:58:26.853 INFO:tasks.workunit.client.0.smithi008.stdout:5/298: dwrite d0/d2/d19/d1b/f6b [0,4194304] 0 2023-10-18T20:58:26.854 INFO:tasks.workunit.client.0.smithi008.stdout:5/299: creat d0/d2/d9/d34/f71 x:0 0 0 2023-10-18T20:58:26.854 INFO:tasks.workunit.client.0.smithi008.stdout:5/300: truncate d0/d2/d19/d1b/d58/d65/f36 677428 0 2023-10-18T20:58:26.857 INFO:tasks.workunit.client.1.smithi060.stdout:1/384: symlink d4/d6/d7/d2f/d7b/d2a/l7e 0 2023-10-18T20:58:26.857 INFO:tasks.workunit.client.1.smithi060.stdout:1/385: read - d4/d6/d33/f7d zero size 2023-10-18T20:58:26.858 INFO:tasks.workunit.client.1.smithi060.stdout:0/319: dread d3/f1a [0,4194304] 0 2023-10-18T20:58:26.861 INFO:tasks.workunit.client.1.smithi060.stdout:6/264: dwrite d10/d2e/f50 [0,4194304] 0 2023-10-18T20:58:26.861 INFO:tasks.workunit.client.1.smithi060.stdout:6/265: stat d10/d25/l36 0 2023-10-18T20:58:26.861 INFO:tasks.workunit.client.0.smithi008.stdout:4/285: symlink d0/d3/d48/d4c/l66 0 2023-10-18T20:58:26.862 INFO:tasks.workunit.client.0.smithi008.stdout:4/286: creat d0/d3/f67 x:0 0 0 2023-10-18T20:58:26.868 INFO:tasks.workunit.client.0.smithi008.stdout:6/316: dwrite df/d19/f1c [0,4194304] 0 2023-10-18T20:58:26.870 INFO:tasks.workunit.client.1.smithi060.stdout:2/302: getdents d0 0 2023-10-18T20:58:26.871 INFO:tasks.workunit.client.0.smithi008.stdout:8/421: sync 2023-10-18T20:58:26.871 INFO:tasks.workunit.client.0.smithi008.stdout:8/422: dread - d5/d8/df/d9d/d4d/f6d zero size 2023-10-18T20:58:26.872 INFO:tasks.workunit.client.0.smithi008.stdout:1/425: stat d9/de/df/d17/d25/c60 0 2023-10-18T20:58:26.872 INFO:tasks.workunit.client.0.smithi008.stdout:1/426: write d9/de/df/d17/d1e/f2d [1336132,30149] 0 2023-10-18T20:58:26.873 INFO:tasks.workunit.client.1.smithi060.stdout:3/273: dwrite d0/d22/f33 [4194304,4194304] 0 2023-10-18T20:58:26.873 INFO:tasks.workunit.client.1.smithi060.stdout:3/274: stat d0/d22/d26/d29 0 2023-10-18T20:58:26.873 INFO:tasks.workunit.client.1.smithi060.stdout:3/275: dread - d0/d22/f52 zero size 2023-10-18T20:58:26.876 INFO:tasks.workunit.client.0.smithi008.stdout:7/317: dwrite d1/d3/f2a [0,4194304] 0 2023-10-18T20:58:26.883 INFO:tasks.workunit.client.1.smithi060.stdout:7/302: rename de/d14/f2d to de/d14/d2f/d3f/d5a/f60 0 2023-10-18T20:58:26.883 INFO:tasks.workunit.client.1.smithi060.stdout:8/275: rmdir d4/d9/d37 39 2023-10-18T20:58:26.883 INFO:tasks.workunit.client.1.smithi060.stdout:8/276: write d4/f1f [1087246,12384] 0 2023-10-18T20:58:26.883 INFO:tasks.workunit.client.1.smithi060.stdout:5/361: creat d0/f8a x:0 0 0 2023-10-18T20:58:26.884 INFO:tasks.workunit.client.1.smithi060.stdout:8/277: write d4/f47 [1003623,99918] 0 2023-10-18T20:58:26.884 INFO:tasks.workunit.client.1.smithi060.stdout:8/278: read f3 [244268,110040] 0 2023-10-18T20:58:26.885 INFO:tasks.workunit.client.1.smithi060.stdout:4/262: symlink d4/dc/d2a/d13/l4c 0 2023-10-18T20:58:26.885 INFO:tasks.workunit.client.1.smithi060.stdout:4/263: read - d4/d15/f48 zero size 2023-10-18T20:58:26.888 INFO:tasks.workunit.client.1.smithi060.stdout:1/386: creat d4/d38/f7f x:0 0 0 2023-10-18T20:58:26.888 INFO:tasks.workunit.client.1.smithi060.stdout:1/387: write d4/d6/d7/d2f/f6a [221180,44752] 0 2023-10-18T20:58:26.889 INFO:tasks.workunit.client.1.smithi060.stdout:0/320: getdents d3/d8/d14/d55 0 2023-10-18T20:58:26.889 INFO:tasks.workunit.client.1.smithi060.stdout:0/321: stat d3/d8/d14/d49/l52 0 2023-10-18T20:58:26.890 INFO:tasks.workunit.client.1.smithi060.stdout:0/322: write d3/d8/d14/f2c [1567485,92235] 0 2023-10-18T20:58:26.890 INFO:tasks.workunit.client.1.smithi060.stdout:0/323: write d3/d8/d3c/f5c [757697,21556] 0 2023-10-18T20:58:26.890 INFO:tasks.workunit.client.1.smithi060.stdout:0/324: creat d3/d8/d14/f65 x:0 0 0 2023-10-18T20:58:26.890 INFO:tasks.workunit.client.1.smithi060.stdout:0/325: chown d3/c2f 117263 1 2023-10-18T20:58:26.892 INFO:tasks.workunit.client.0.smithi008.stdout:9/320: symlink d2/dc/d17/d19/d4a/l57 0 2023-10-18T20:58:26.893 INFO:tasks.workunit.client.0.smithi008.stdout:3/267: unlink d0/d3/d15/f21 0 2023-10-18T20:58:26.894 INFO:tasks.workunit.client.0.smithi008.stdout:1/427: dread d9/f42 [0,4194304] 0 2023-10-18T20:58:26.897 INFO:tasks.workunit.client.0.smithi008.stdout:0/264: rmdir d0/dd 39 2023-10-18T20:58:26.898 INFO:tasks.workunit.client.1.smithi060.stdout:6/266: link f7 d10/d17/d54/f5a 0 2023-10-18T20:58:26.903 INFO:tasks.workunit.client.1.smithi060.stdout:2/303: symlink d0/d43/d4a/l58 0 2023-10-18T20:58:26.906 INFO:tasks.workunit.client.0.smithi008.stdout:2/315: dwrite d1/f18 [0,4194304] 0 2023-10-18T20:58:26.906 INFO:tasks.workunit.client.1.smithi060.stdout:3/276: creat d0/d22/d26/f61 x:0 0 0 2023-10-18T20:58:26.907 INFO:tasks.workunit.client.0.smithi008.stdout:2/316: write d1/d3/dd/d25/d34/f46 [1139888,81652] 0 2023-10-18T20:58:26.921 INFO:tasks.workunit.client.0.smithi008.stdout:5/301: link d0/d2/d19/d1b/d41/f56 d0/d2/d19/d1b/d58/f72 0 2023-10-18T20:58:26.921 INFO:tasks.workunit.client.0.smithi008.stdout:5/302: write d0/de/f6c [633521,94666] 0 2023-10-18T20:58:26.922 INFO:tasks.workunit.client.1.smithi060.stdout:7/303: dwrite de/d14/d41/f53 [0,4194304] 0 2023-10-18T20:58:26.922 INFO:tasks.workunit.client.1.smithi060.stdout:7/304: fdatasync de/d14/d41/f53 0 2023-10-18T20:58:26.923 INFO:tasks.workunit.client.1.smithi060.stdout:9/284: rename d3/d10/d1c/d2a/d33/c2c to d3/d10/d19/d54/c6f 0 2023-10-18T20:58:26.924 INFO:tasks.workunit.client.1.smithi060.stdout:9/285: write d3/d10/d1c/d2a/d2d/f63 [43085,64929] 0 2023-10-18T20:58:26.931 INFO:tasks.workunit.client.1.smithi060.stdout:8/279: mkdir d4/d9/d4f 0 2023-10-18T20:58:26.931 INFO:tasks.workunit.client.0.smithi008.stdout:4/287: rename d0/d17/d5b/d45/f43 to d0/d17/d5b/f68 0 2023-10-18T20:58:26.932 INFO:tasks.workunit.client.0.smithi008.stdout:6/317: symlink df/d18/d3f/l71 0 2023-10-18T20:58:26.934 INFO:tasks.workunit.client.1.smithi060.stdout:4/264: symlink d4/dc/d2a/d1d/l4d 0 2023-10-18T20:58:26.941 INFO:tasks.workunit.client.1.smithi060.stdout:1/388: mknod d4/d6/d7/c80 0 2023-10-18T20:58:26.941 INFO:tasks.workunit.client.0.smithi008.stdout:4/288: write d0/d3/f1e [603436,64097] 0 2023-10-18T20:58:26.944 INFO:tasks.workunit.client.0.smithi008.stdout:2/317: creat d1/d3/dd/d1c/d3a/d57/f6d x:0 0 0 2023-10-18T20:58:26.952 INFO:tasks.workunit.client.1.smithi060.stdout:2/304: dwrite d0/d8/f2b [4194304,4194304] 0 2023-10-18T20:58:26.952 INFO:tasks.workunit.client.1.smithi060.stdout:2/305: fsync d0/d16/f28 0 2023-10-18T20:58:26.953 INFO:tasks.workunit.client.1.smithi060.stdout:0/326: creat d3/d32/f66 x:0 0 0 2023-10-18T20:58:26.953 INFO:tasks.workunit.client.1.smithi060.stdout:0/327: truncate d3/d8/f9 4942307 0 2023-10-18T20:58:26.953 INFO:tasks.workunit.client.0.smithi008.stdout:5/303: truncate d0/d2/d19/d1b/d58/f72 3186247 0 2023-10-18T20:58:26.954 INFO:tasks.workunit.client.0.smithi008.stdout:5/304: truncate d0/d2/d19/d1b/f2a 1318630 0 2023-10-18T20:58:26.959 INFO:tasks.workunit.client.0.smithi008.stdout:0/265: write d0/f3 [3712847,41447] 0 2023-10-18T20:58:26.960 INFO:tasks.workunit.client.0.smithi008.stdout:7/318: dwrite d1/d36/f60 [4194304,4194304] 0 2023-10-18T20:58:26.960 INFO:tasks.workunit.client.0.smithi008.stdout:3/268: write d0/d3/de/d13/f2a [369633,79744] 0 2023-10-18T20:58:26.960 INFO:tasks.workunit.client.1.smithi060.stdout:1/389: dread d4/da/f50 [0,4194304] 0 2023-10-18T20:58:26.964 INFO:tasks.workunit.client.0.smithi008.stdout:4/289: dread d0/d3/d21/f3b [0,4194304] 0 2023-10-18T20:58:26.967 INFO:tasks.workunit.client.1.smithi060.stdout:3/277: creat d0/d22/d26/d2c/f62 x:0 0 0 2023-10-18T20:58:26.971 INFO:tasks.workunit.client.1.smithi060.stdout:6/267: rename d10/d1b/f27 to d10/d17/f5b 0 2023-10-18T20:58:26.971 INFO:tasks.workunit.client.1.smithi060.stdout:6/268: dread - d10/d25/f4f zero size 2023-10-18T20:58:26.971 INFO:tasks.workunit.client.1.smithi060.stdout:6/269: truncate d10/d2e/f50 4960416 0 2023-10-18T20:58:26.971 INFO:tasks.workunit.client.1.smithi060.stdout:6/270: chown cf 1466605 1 2023-10-18T20:58:26.974 INFO:tasks.workunit.client.1.smithi060.stdout:7/305: dwrite de/ff [0,4194304] 0 2023-10-18T20:58:26.974 INFO:tasks.workunit.client.1.smithi060.stdout:7/306: chown de/c13 20 1 2023-10-18T20:58:26.974 INFO:tasks.workunit.client.0.smithi008.stdout:1/428: dwrite d9/f2f [0,4194304] 0 2023-10-18T20:58:26.975 INFO:tasks.workunit.client.0.smithi008.stdout:1/429: chown d9/de/df/d17/d1e/d3c/c46 428450826 1 2023-10-18T20:58:26.976 INFO:tasks.workunit.client.1.smithi060.stdout:5/362: getdents d0/dd 0 2023-10-18T20:58:26.979 INFO:tasks.workunit.client.1.smithi060.stdout:9/286: dwrite d3/d10/d19/d54/f51 [0,4194304] 0 2023-10-18T20:58:26.982 INFO:tasks.workunit.client.0.smithi008.stdout:6/318: link df/d26/c2b df/d18/d58/c72 0 2023-10-18T20:58:26.982 INFO:tasks.workunit.client.0.smithi008.stdout:6/319: readlink df/l11 0 2023-10-18T20:58:26.982 INFO:tasks.workunit.client.0.smithi008.stdout:6/320: chown df/f24 50400 1 2023-10-18T20:58:26.983 INFO:tasks.workunit.client.0.smithi008.stdout:6/321: chown df/d13/c1b 666993016 1 2023-10-18T20:58:26.983 INFO:tasks.workunit.client.0.smithi008.stdout:6/322: fsync df/d18/d68/f6e 0 2023-10-18T20:58:26.983 INFO:tasks.workunit.client.0.smithi008.stdout:5/305: symlink d0/d2/d9/d34/l73 0 2023-10-18T20:58:26.983 INFO:tasks.workunit.client.0.smithi008.stdout:5/306: dread - d0/d2/d9/d34/f3b zero size 2023-10-18T20:58:26.984 INFO:tasks.workunit.client.0.smithi008.stdout:3/269: write d0/d3/d42/f30 [1026565,126366] 0 2023-10-18T20:58:26.984 INFO:tasks.workunit.client.0.smithi008.stdout:9/321: dwrite d2/dc/d1a/d1d/f50 [0,4194304] 0 2023-10-18T20:58:26.984 INFO:tasks.workunit.client.0.smithi008.stdout:9/322: fsync d2/dc/d17/d19/f55 0 2023-10-18T20:58:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:25.534647+0000 mgr.smithi060.pgqqwa (mgr.14584) 44 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 978 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 93 MiB/s rd, 110 MiB/s wr, 302 op/s 2023-10-18T20:58:27.009 INFO:tasks.workunit.client.1.smithi060.stdout:1/390: mkdir d4/d6/d7/d2f/d7b/d2a/d32/dd/d81 0 2023-10-18T20:58:27.020 INFO:tasks.workunit.client.1.smithi060.stdout:5/363: dwrite d0/d6/d8/df/d27/f3c [0,4194304] 0 2023-10-18T20:58:27.022 INFO:tasks.workunit.client.0.smithi008.stdout:4/290: dwrite d0/d17/d5b/f5f [0,4194304] 0 2023-10-18T20:58:27.024 INFO:tasks.workunit.client.0.smithi008.stdout:0/266: dwrite d0/f1d [0,4194304] 0 2023-10-18T20:58:27.028 INFO:tasks.workunit.client.1.smithi060.stdout:4/265: rename d4/dc/d2a/d1d/d4a to d4/d15/d2b/d4e 0 2023-10-18T20:58:27.028 INFO:tasks.workunit.client.1.smithi060.stdout:6/271: creat d10/d17/d28/f5c x:0 0 0 2023-10-18T20:58:27.029 INFO:tasks.workunit.client.1.smithi060.stdout:6/272: chown d10/d25/d3c/l40 5534263 1 2023-10-18T20:58:27.029 INFO:tasks.workunit.client.1.smithi060.stdout:6/273: fdatasync f1 0 2023-10-18T20:58:27.030 INFO:tasks.workunit.client.0.smithi008.stdout:4/291: dread d0/d17/d5b/f68 [12582912,4194304] 0 2023-10-18T20:58:27.030 INFO:tasks.workunit.client.0.smithi008.stdout:4/292: stat d0/d3/d21/d57 0 2023-10-18T20:58:27.030 INFO:tasks.workunit.client.0.smithi008.stdout:4/293: write d0/d17/f23 [2941170,6352] 0 2023-10-18T20:58:27.030 INFO:tasks.workunit.client.1.smithi060.stdout:4/266: write d4/d15/d2b/f3b [176384,105982] 0 2023-10-18T20:58:27.031 INFO:tasks.workunit.client.1.smithi060.stdout:4/267: readlink d4/dc/d2a/d31/l44 0 2023-10-18T20:58:27.034 INFO:tasks.workunit.client.1.smithi060.stdout:7/307: symlink de/d14/l61 0 2023-10-18T20:58:27.040 INFO:tasks.workunit.client.1.smithi060.stdout:9/287: rename d3/d10/c1a to d3/d10/c70 0 2023-10-18T20:58:27.043 INFO:tasks.workunit.client.1.smithi060.stdout:8/280: symlink d4/l50 0 2023-10-18T20:58:27.046 INFO:tasks.workunit.client.1.smithi060.stdout:0/328: mknod d3/d8/c67 0 2023-10-18T20:58:27.047 INFO:tasks.workunit.client.0.smithi008.stdout:4/294: read d0/d17/d5b/f5f [2125130,117479] 0 2023-10-18T20:58:27.047 INFO:tasks.workunit.client.0.smithi008.stdout:0/267: read d0/dd/df/d2a/f33 [8772887,25155] 0 2023-10-18T20:58:27.048 INFO:tasks.workunit.client.0.smithi008.stdout:4/295: stat d0/d17/d5b/d2a 0 2023-10-18T20:58:27.048 INFO:tasks.workunit.client.0.smithi008.stdout:4/296: readlink d0/l4a 0 2023-10-18T20:58:27.048 INFO:tasks.workunit.client.0.smithi008.stdout:7/319: dwrite d1/d36/d3b/d4f/f51 [0,4194304] 0 2023-10-18T20:58:27.049 INFO:tasks.workunit.client.0.smithi008.stdout:7/320: fsync d1/d36/d3b/d4f/f51 0 2023-10-18T20:58:27.049 INFO:tasks.workunit.client.0.smithi008.stdout:1/430: dwrite d9/de/df/d17/f5f [0,4194304] 0 2023-10-18T20:58:27.050 INFO:tasks.workunit.client.1.smithi060.stdout:1/391: getdents d4/d6/d7/d2f/d7b/d2a/d32 0 2023-10-18T20:58:27.052 INFO:tasks.workunit.client.0.smithi008.stdout:6/323: rmdir df/d15 39 2023-10-18T20:58:27.053 INFO:tasks.workunit.client.0.smithi008.stdout:6/324: write df/d19/f3e [3143284,124106] 0 2023-10-18T20:58:27.072 INFO:tasks.workunit.client.1.smithi060.stdout:1/392: dread d4/da/f5a [0,4194304] 0 2023-10-18T20:58:27.072 INFO:tasks.workunit.client.1.smithi060.stdout:1/393: truncate d4/d38/f7f 275773 0 2023-10-18T20:58:27.073 INFO:tasks.workunit.client.0.smithi008.stdout:1/431: write d9/de/f58 [3500215,121185] 0 2023-10-18T20:58:27.073 INFO:tasks.workunit.client.1.smithi060.stdout:5/364: link d0/dd/l6c d0/d47/d7d/l8b 0 2023-10-18T20:58:27.074 INFO:tasks.workunit.client.0.smithi008.stdout:2/318: rmdir d1/d3 39 2023-10-18T20:58:27.078 INFO:tasks.workunit.client.0.smithi008.stdout:5/307: truncate d0/f8 407997 0 2023-10-18T20:58:27.079 INFO:tasks.workunit.client.1.smithi060.stdout:2/306: rename d0/d8/f1b to d0/d3/f59 0 2023-10-18T20:58:27.082 INFO:tasks.workunit.client.0.smithi008.stdout:2/319: read d1/d3/dd/d25/f2f [651795,636] 0 2023-10-18T20:58:27.082 INFO:tasks.workunit.client.0.smithi008.stdout:2/320: write d1/d3/dd/d1c/f3c [1261622,73116] 0 2023-10-18T20:58:27.084 INFO:tasks.workunit.client.0.smithi008.stdout:3/270: mknod d0/d3/d42/d52/c53 0 2023-10-18T20:58:27.084 INFO:tasks.workunit.client.1.smithi060.stdout:6/274: symlink d10/d3e/l5d 0 2023-10-18T20:58:27.089 INFO:tasks.workunit.client.1.smithi060.stdout:4/268: truncate d4/dc/d2a/d13/d33/f35 1735651 0 2023-10-18T20:58:27.089 INFO:tasks.workunit.client.1.smithi060.stdout:4/269: readlink d4/dc/d2a/d13/l4c 0 2023-10-18T20:58:27.089 INFO:tasks.workunit.client.1.smithi060.stdout:4/270: truncate d4/dc/d2a/d13/f2c 655478 0 2023-10-18T20:58:27.090 INFO:tasks.workunit.client.1.smithi060.stdout:7/308: mknod de/d14/d49/c62 0 2023-10-18T20:58:27.094 INFO:tasks.workunit.client.0.smithi008.stdout:1/432: read d9/de/df/d17/f5f [2331581,38352] 0 2023-10-18T20:58:27.094 INFO:tasks.workunit.client.0.smithi008.stdout:1/433: readlink d9/de/df/d17/d1e/d3c/l72 0 2023-10-18T20:58:27.094 INFO:tasks.workunit.client.0.smithi008.stdout:9/323: link d2/dc/f4c d2/dc/d1a/d1d/f58 0 2023-10-18T20:58:27.095 INFO:tasks.workunit.client.1.smithi060.stdout:9/288: mknod d3/d10/d1c/d5a/d5d/c71 0 2023-10-18T20:58:27.102 INFO:tasks.workunit.client.1.smithi060.stdout:2/307: rename d0/d16/f41 to d0/d3/f5a 0 2023-10-18T20:58:27.102 INFO:tasks.workunit.client.1.smithi060.stdout:2/308: chown d0/d8/f30 6 1 2023-10-18T20:58:27.105 INFO:tasks.workunit.client.0.smithi008.stdout:7/321: dwrite d1/d3/d20/f2f [0,4194304] 0 2023-10-18T20:58:27.105 INFO:tasks.workunit.client.0.smithi008.stdout:7/322: dread - d1/d3/f56 zero size 2023-10-18T20:58:27.108 INFO:tasks.workunit.client.1.smithi060.stdout:4/271: creat d4/dc/d2a/d2d/f4f x:0 0 0 2023-10-18T20:58:27.109 INFO:tasks.workunit.client.1.smithi060.stdout:0/329: dwrite d3/d8/d14/d49/f36 [0,4194304] 0 2023-10-18T20:58:27.109 INFO:tasks.workunit.client.1.smithi060.stdout:0/330: fsync d3/d8/d14/d49/f64 0 2023-10-18T20:58:27.109 INFO:tasks.workunit.client.0.smithi008.stdout:2/321: dread d1/d3/dd/f38 [0,4194304] 0 2023-10-18T20:58:27.110 INFO:tasks.workunit.client.0.smithi008.stdout:2/322: fsync d1/d3/dd/d1c/d3a/d57/f67 0 2023-10-18T20:58:27.120 INFO:tasks.workunit.client.1.smithi060.stdout:4/272: dread d4/dc/d2a/f7 [0,4194304] 0 2023-10-18T20:58:27.125 INFO:tasks.workunit.client.0.smithi008.stdout:7/323: dread d1/d3/f1d [0,4194304] 0 2023-10-18T20:58:27.125 INFO:tasks.workunit.client.0.smithi008.stdout:7/324: chown d1/d3/d20/c2d 3794397 1 2023-10-18T20:58:27.126 INFO:tasks.workunit.client.0.smithi008.stdout:7/325: chown d1/d3/c12 0 1 2023-10-18T20:58:27.126 INFO:tasks.workunit.client.0.smithi008.stdout:7/326: creat d1/d36/d3b/f6f x:0 0 0 2023-10-18T20:58:27.129 INFO:tasks.workunit.client.1.smithi060.stdout:2/309: read d0/d3/d27/f46 [2003217,339] 0 2023-10-18T20:58:27.130 INFO:tasks.workunit.client.1.smithi060.stdout:7/309: creat de/d14/d49/f63 x:0 0 0 2023-10-18T20:58:27.131 INFO:tasks.workunit.client.0.smithi008.stdout:6/325: dwrite df/d15/f16 [0,4194304] 0 2023-10-18T20:58:27.133 INFO:tasks.workunit.client.1.smithi060.stdout:5/365: dwrite d0/d6/d8/df/d27/d32/d4f/f86 [0,4194304] 0 2023-10-18T20:58:27.133 INFO:tasks.workunit.client.1.smithi060.stdout:5/366: chown d0/da 4916360 1 2023-10-18T20:58:27.134 INFO:tasks.workunit.client.1.smithi060.stdout:9/289: creat d3/d10/d1c/d5a/f72 x:0 0 0 2023-10-18T20:58:27.134 INFO:tasks.workunit.client.1.smithi060.stdout:9/290: creat d3/d58/f73 x:0 0 0 2023-10-18T20:58:27.136 INFO:tasks.workunit.client.0.smithi008.stdout:4/297: link d0/l4d d0/d17/d5b/d45/l69 0 2023-10-18T20:58:27.137 INFO:tasks.workunit.client.0.smithi008.stdout:4/298: readlink d0/d17/d5b/l47 0 2023-10-18T20:58:27.137 INFO:tasks.workunit.client.0.smithi008.stdout:4/299: fsync d0/d3/f64 0 2023-10-18T20:58:27.142 INFO:tasks.workunit.client.0.smithi008.stdout:5/308: dwrite d0/f29 [0,4194304] 0 2023-10-18T20:58:27.142 INFO:tasks.workunit.client.0.smithi008.stdout:5/309: stat d0/d2/d9/d34/f37 0 2023-10-18T20:58:27.143 INFO:tasks.workunit.client.1.smithi060.stdout:1/394: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/f25 [4194304,4194304] 0 2023-10-18T20:58:27.143 INFO:tasks.workunit.client.1.smithi060.stdout:1/395: stat d4/d6/d48/f4b 0 2023-10-18T20:58:27.143 INFO:tasks.workunit.client.1.smithi060.stdout:1/396: creat d4/d6/d7/df/d59/f82 x:0 0 0 2023-10-18T20:58:27.143 INFO:tasks.workunit.client.1.smithi060.stdout:1/397: read d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/f6c [225941,29007] 0 2023-10-18T20:58:27.144 INFO:tasks.workunit.client.1.smithi060.stdout:0/331: dwrite d3/d32/f66 [0,4194304] 0 2023-10-18T20:58:27.144 INFO:tasks.workunit.client.1.smithi060.stdout:2/310: dread d0/d8/f2b [4194304,4194304] 0 2023-10-18T20:58:27.145 INFO:tasks.workunit.client.1.smithi060.stdout:3/278: rename d0/d22/d26/d2b/c5d to d0/d22/c63 0 2023-10-18T20:58:27.147 INFO:tasks.workunit.client.1.smithi060.stdout:6/275: rmdir d10/d2e 39 2023-10-18T20:58:27.153 INFO:tasks.workunit.client.1.smithi060.stdout:7/310: truncate de/d14/d1d/f2a 4165725 0 2023-10-18T20:58:27.154 INFO:tasks.workunit.client.1.smithi060.stdout:7/311: readlink de/d14/l61 0 2023-10-18T20:58:27.154 INFO:tasks.workunit.client.1.smithi060.stdout:7/312: creat de/d14/d41/d58/d5b/f64 x:0 0 0 2023-10-18T20:58:27.156 INFO:tasks.workunit.client.0.smithi008.stdout:5/310: dread d0/d2/d19/d1b/d58/d65/f36 [0,4194304] 0 2023-10-18T20:58:27.160 INFO:tasks.workunit.client.0.smithi008.stdout:3/271: chown d0/d3/d15/f23 443 1 2023-10-18T20:58:27.168 INFO:tasks.workunit.client.1.smithi060.stdout:9/291: creat d3/d10/d1c/d25/f74 x:0 0 0 2023-10-18T20:58:27.179 INFO:tasks.workunit.client.1.smithi060.stdout:7/313: write de/d14/d1d/f4e [2806036,113197] 0 2023-10-18T20:58:27.179 INFO:tasks.workunit.client.1.smithi060.stdout:7/314: write fa [4505473,80753] 0 2023-10-18T20:58:27.182 INFO:tasks.workunit.client.1.smithi060.stdout:4/273: dwrite d4/d15/f37 [0,4194304] 0 2023-10-18T20:58:27.182 INFO:tasks.workunit.client.1.smithi060.stdout:4/274: readlink d4/d15/l42 0 2023-10-18T20:58:27.183 INFO:tasks.workunit.client.1.smithi060.stdout:2/311: dwrite d0/d3/f59 [0,4194304] 0 2023-10-18T20:58:27.184 INFO:tasks.workunit.client.1.smithi060.stdout:2/312: creat d0/d3/d27/d4d/f5b x:0 0 0 2023-10-18T20:58:27.184 INFO:tasks.workunit.client.1.smithi060.stdout:2/313: truncate d0/f4e 718921 0 2023-10-18T20:58:27.186 INFO:tasks.workunit.client.1.smithi060.stdout:1/398: write d4/d6/d7/d2f/d7b/d2a/d32/dd/f30 [5849783,14147] 0 2023-10-18T20:58:27.186 INFO:tasks.workunit.client.0.smithi008.stdout:9/324: unlink d2/dc/d1a/d1d/l3b 0 2023-10-18T20:58:27.192 INFO:tasks.workunit.client.1.smithi060.stdout:8/281: rename f3 to d4/d9/d31/d35/f51 0 2023-10-18T20:58:27.196 INFO:tasks.workunit.client.1.smithi060.stdout:6/276: mknod d10/d17/d28/c5e 0 2023-10-18T20:58:27.197 INFO:tasks.workunit.client.1.smithi060.stdout:6/277: fsync d10/d1b/f41 0 2023-10-18T20:58:27.197 INFO:tasks.workunit.client.1.smithi060.stdout:6/278: dread - d10/d1b/f4a zero size 2023-10-18T20:58:27.197 INFO:tasks.workunit.client.1.smithi060.stdout:6/279: readlink d10/l12 0 2023-10-18T20:58:27.197 INFO:tasks.workunit.client.1.smithi060.stdout:6/280: chown d10/c1f 2 1 2023-10-18T20:58:27.202 INFO:tasks.workunit.client.1.smithi060.stdout:9/292: creat d3/d10/d1c/d5a/d5d/f75 x:0 0 0 2023-10-18T20:58:27.203 INFO:tasks.workunit.client.1.smithi060.stdout:7/315: read de/d14/d2f/f3c [317065,58362] 0 2023-10-18T20:58:27.204 INFO:tasks.workunit.client.1.smithi060.stdout:0/332: dwrite d3/d8/d14/f3e [0,4194304] 0 2023-10-18T20:58:27.204 INFO:tasks.workunit.client.1.smithi060.stdout:0/333: write d3/d8/f28 [3919750,116615] 0 2023-10-18T20:58:27.207 INFO:tasks.workunit.client.0.smithi008.stdout:0/268: getdents d0 0 2023-10-18T20:58:27.207 INFO:tasks.workunit.client.0.smithi008.stdout:2/323: mkdir d1/d3/d40/d6e 0 2023-10-18T20:58:27.212 INFO:tasks.workunit.client.0.smithi008.stdout:7/327: rename d1/d36/c58 to d1/d36/c70 0 2023-10-18T20:58:27.213 INFO:tasks.workunit.client.0.smithi008.stdout:6/326: creat df/d15/d27/d4c/f73 x:0 0 0 2023-10-18T20:58:27.214 INFO:tasks.workunit.client.0.smithi008.stdout:4/300: creat d0/d17/f6a x:0 0 0 2023-10-18T20:58:27.215 INFO:tasks.workunit.client.0.smithi008.stdout:4/301: fdatasync d0/d3/f64 0 2023-10-18T20:58:27.215 INFO:tasks.workunit.client.0.smithi008.stdout:5/311: mknod d0/d2/d9/c74 0 2023-10-18T20:58:27.216 INFO:tasks.workunit.client.0.smithi008.stdout:5/312: chown d0 894391 1 2023-10-18T20:58:27.216 INFO:tasks.workunit.client.0.smithi008.stdout:5/313: chown d0/c13 2 1 2023-10-18T20:58:27.217 INFO:tasks.workunit.client.0.smithi008.stdout:3/272: creat d0/f54 x:0 0 0 2023-10-18T20:58:27.218 INFO:tasks.workunit.client.1.smithi060.stdout:4/275: rmdir d4/d15/d2b/d4e 0 2023-10-18T20:58:27.221 INFO:tasks.workunit.client.0.smithi008.stdout:7/328: dread d1/d3/f1d [0,4194304] 0 2023-10-18T20:58:27.224 INFO:tasks.workunit.client.0.smithi008.stdout:9/325: mkdir d2/dc/d17/d19/d42/d59 0 2023-10-18T20:58:27.226 INFO:tasks.workunit.client.0.smithi008.stdout:0/269: symlink d0/dd/df/l53 0 2023-10-18T20:58:27.227 INFO:tasks.workunit.client.1.smithi060.stdout:2/314: creat d0/d3/d27/d4d/d53/f5c x:0 0 0 2023-10-18T20:58:27.229 INFO:tasks.workunit.client.0.smithi008.stdout:2/324: creat d1/d3/dd/f6f x:0 0 0 2023-10-18T20:58:27.234 INFO:tasks.workunit.client.0.smithi008.stdout:6/327: mkdir df/d74 0 2023-10-18T20:58:27.236 INFO:tasks.workunit.client.0.smithi008.stdout:4/302: symlink d0/d17/d5b/d45/l6b 0 2023-10-18T20:58:27.239 INFO:tasks.workunit.client.0.smithi008.stdout:5/314: mkdir d0/d2/d19/d1b/d41/d6f/d75 0 2023-10-18T20:58:27.250 INFO:tasks.workunit.client.0.smithi008.stdout:8/423: sync 2023-10-18T20:58:27.251 INFO:tasks.workunit.client.0.smithi008.stdout:9/326: mkdir d2/dc/d40/d5a 0 2023-10-18T20:58:27.251 INFO:tasks.workunit.client.0.smithi008.stdout:9/327: creat d2/dc/d1a/f5b x:0 0 0 2023-10-18T20:58:27.251 INFO:tasks.workunit.client.0.smithi008.stdout:8/424: write d5/d8/df/f75 [532380,128984] 0 2023-10-18T20:58:27.252 INFO:tasks.workunit.client.0.smithi008.stdout:0/270: rmdir d0/dd/d19/d41 39 2023-10-18T20:58:27.253 INFO:tasks.workunit.client.0.smithi008.stdout:8/425: write d5/d8/df/d9d/d4d/f4f [402905,45128] 0 2023-10-18T20:58:27.257 INFO:tasks.workunit.client.1.smithi060.stdout:1/399: mkdir d4/d38/d83 0 2023-10-18T20:58:27.258 INFO:tasks.workunit.client.0.smithi008.stdout:6/328: getdents df/d15/d48/d4b 0 2023-10-18T20:58:27.258 INFO:tasks.workunit.client.0.smithi008.stdout:6/329: readlink df/l4e 0 2023-10-18T20:58:27.258 INFO:tasks.workunit.client.0.smithi008.stdout:6/330: chown df/d15/d27/d38/f5a 125981 1 2023-10-18T20:58:27.258 INFO:tasks.workunit.client.0.smithi008.stdout:6/331: readlink df/d19/l6a 0 2023-10-18T20:58:27.259 INFO:tasks.workunit.client.0.smithi008.stdout:4/303: rmdir d0/d3/d21/d42 39 2023-10-18T20:58:27.260 INFO:tasks.workunit.client.0.smithi008.stdout:6/332: read df/f35 [14338,114483] 0 2023-10-18T20:58:27.261 INFO:tasks.workunit.client.1.smithi060.stdout:5/367: rename d0/d6/d8/df/d27/d32/d6d/d72/d2a/c77 to d0/d6/d8/df/d27/d32/c8c 0 2023-10-18T20:58:27.273 INFO:tasks.workunit.client.1.smithi060.stdout:8/282: symlink d4/d9/d37/l52 0 2023-10-18T20:58:27.273 INFO:tasks.workunit.client.1.smithi060.stdout:8/283: truncate d4/d9/d37/f38 534856 0 2023-10-18T20:58:27.273 INFO:tasks.workunit.client.1.smithi060.stdout:8/284: chown d4/d9/f23 120 1 2023-10-18T20:58:27.274 INFO:tasks.workunit.client.1.smithi060.stdout:8/285: getdents d4/d9/d4f 0 2023-10-18T20:58:27.274 INFO:tasks.workunit.client.1.smithi060.stdout:8/286: write d4/f1f [2134195,63796] 0 2023-10-18T20:58:27.275 INFO:tasks.workunit.client.0.smithi008.stdout:7/329: dwrite d1/d36/d3d/d3e/f37 [0,4194304] 0 2023-10-18T20:58:27.278 INFO:tasks.workunit.client.1.smithi060.stdout:6/281: symlink d10/d17/d2f/l5f 0 2023-10-18T20:58:27.279 INFO:tasks.workunit.client.1.smithi060.stdout:6/282: fdatasync d10/d2e/f55 0 2023-10-18T20:58:27.281 INFO:tasks.workunit.client.1.smithi060.stdout:9/293: unlink d3/d10/d1c/d2a/d2d/f2e 0 2023-10-18T20:58:27.282 INFO:tasks.workunit.client.0.smithi008.stdout:3/273: unlink d0/d3/de/d13/f4e 0 2023-10-18T20:58:27.283 INFO:tasks.workunit.client.1.smithi060.stdout:7/316: getdents de/d14 0 2023-10-18T20:58:27.286 INFO:tasks.workunit.client.0.smithi008.stdout:5/315: mknod d0/c76 0 2023-10-18T20:58:27.286 INFO:tasks.workunit.client.0.smithi008.stdout:5/316: creat d0/d2/d19/d1b/d31/d3f/f77 x:0 0 0 2023-10-18T20:58:27.286 INFO:tasks.workunit.client.0.smithi008.stdout:5/317: chown d0/d2/d9/d34/f5c 492 1 2023-10-18T20:58:27.286 INFO:tasks.workunit.client.0.smithi008.stdout:5/318: creat d0/d2/d19/d1b/d31/f78 x:0 0 0 2023-10-18T20:58:27.290 INFO:tasks.workunit.client.0.smithi008.stdout:0/271: unlink d0/dd/d19/d24/f2b 0 2023-10-18T20:58:27.291 INFO:tasks.workunit.client.0.smithi008.stdout:0/272: write d0/dd/d19/d24/f3d [929576,113436] 0 2023-10-18T20:58:27.291 INFO:tasks.workunit.client.0.smithi008.stdout:0/273: fdatasync d0/dd/df/d2a/f4b 0 2023-10-18T20:58:27.291 INFO:tasks.workunit.client.0.smithi008.stdout:0/274: fsync d0/dd/f27 0 2023-10-18T20:58:27.294 INFO:tasks.workunit.client.0.smithi008.stdout:4/304: creat d0/d17/f6c x:0 0 0 2023-10-18T20:58:27.296 INFO:tasks.workunit.client.1.smithi060.stdout:7/317: read de/d14/d3a/f56 [1619542,85278] 0 2023-10-18T20:58:27.299 INFO:tasks.workunit.client.0.smithi008.stdout:6/333: creat df/d74/f75 x:0 0 0 2023-10-18T20:58:27.307 INFO:tasks.workunit.client.0.smithi008.stdout:7/330: dread d1/d3/f17 [0,4194304] 0 2023-10-18T20:58:27.307 INFO:tasks.workunit.client.0.smithi008.stdout:7/331: dread - d1/d3/f57 zero size 2023-10-18T20:58:27.320 INFO:tasks.workunit.client.1.smithi060.stdout:0/334: mkdir d3/d8/d14/d49/d68 0 2023-10-18T20:58:27.320 INFO:tasks.workunit.client.1.smithi060.stdout:2/315: rename d0/f38 to d0/f5d 0 2023-10-18T20:58:27.327 INFO:tasks.workunit.client.0.smithi008.stdout:5/319: write d0/d2/d19/d1b/f6b [770257,66693] 0 2023-10-18T20:58:27.327 INFO:tasks.workunit.client.0.smithi008.stdout:5/320: chown d0/d2/d19/d1b/f6b 117 1 2023-10-18T20:58:27.327 INFO:tasks.workunit.client.0.smithi008.stdout:5/321: read - d0/d2/d19/d1b/d31/f4a zero size 2023-10-18T20:58:27.327 INFO:tasks.workunit.client.0.smithi008.stdout:5/322: write d0/d2/d19/d1b/d41/f50 [2291374,103179] 0 2023-10-18T20:58:27.328 INFO:tasks.workunit.client.0.smithi008.stdout:5/323: chown d0/d2/d9/f4b 14604 1 2023-10-18T20:58:27.328 INFO:tasks.workunit.client.0.smithi008.stdout:9/328: getdents d2/dc/d1a 0 2023-10-18T20:58:27.329 INFO:tasks.workunit.client.1.smithi060.stdout:7/318: dread de/d29/f37 [0,4194304] 0 2023-10-18T20:58:27.330 INFO:tasks.workunit.client.1.smithi060.stdout:7/319: readlink de/d14/d2f/d3f/l5d 0 2023-10-18T20:58:27.332 INFO:tasks.workunit.client.1.smithi060.stdout:1/400: mknod d4/d6/d7/df/d59/c84 0 2023-10-18T20:58:27.332 INFO:tasks.workunit.client.1.smithi060.stdout:4/276: rename d4/dc/d2a/d2d/l30 to d4/dc/d2a/d13/d2f/l50 0 2023-10-18T20:58:27.332 INFO:tasks.workunit.client.1.smithi060.stdout:4/277: chown d4/dc/f22 19 1 2023-10-18T20:58:27.333 INFO:tasks.workunit.client.1.smithi060.stdout:4/278: write d4/dc/d2a/d13/f2c [114731,51431] 0 2023-10-18T20:58:27.333 INFO:tasks.workunit.client.1.smithi060.stdout:4/279: truncate d4/dc/d2a/d1d/f21 2319450 0 2023-10-18T20:58:27.340 INFO:tasks.workunit.client.1.smithi060.stdout:5/368: link d0/da/d3b/d43/f50 d0/d47/f8d 0 2023-10-18T20:58:27.352 INFO:tasks.workunit.client.0.smithi008.stdout:3/274: dwrite d0/d3/de/d13/f2a [0,4194304] 0 2023-10-18T20:58:27.352 INFO:tasks.workunit.client.0.smithi008.stdout:3/275: chown d0/d4a/f4b 92 1 2023-10-18T20:58:27.354 INFO:tasks.workunit.client.1.smithi060.stdout:9/294: symlink d3/l76 0 2023-10-18T20:58:27.355 INFO:tasks.workunit.client.0.smithi008.stdout:0/275: mknod d0/dd/df/c54 0 2023-10-18T20:58:27.360 INFO:tasks.workunit.client.1.smithi060.stdout:6/283: dread d10/d2e/f50 [0,4194304] 0 2023-10-18T20:58:27.360 INFO:tasks.workunit.client.1.smithi060.stdout:6/284: readlink d10/l16 0 2023-10-18T20:58:27.365 INFO:tasks.workunit.client.1.smithi060.stdout:0/335: link d3/c5d d3/c69 0 2023-10-18T20:58:27.368 INFO:tasks.workunit.client.1.smithi060.stdout:2/316: mkdir d0/d3/d27/d4d/d5e 0 2023-10-18T20:58:27.373 INFO:tasks.workunit.client.0.smithi008.stdout:9/329: creat d2/dc/d40/f5c x:0 0 0 2023-10-18T20:58:27.374 INFO:tasks.workunit.client.0.smithi008.stdout:2/325: dwrite d1/f1a [0,4194304] 0 2023-10-18T20:58:27.374 INFO:tasks.workunit.client.0.smithi008.stdout:2/326: stat d1/d3/dd/d1c/d39/d59 0 2023-10-18T20:58:27.375 INFO:tasks.workunit.client.1.smithi060.stdout:7/320: mkdir de/d14/d41/d58/d65 0 2023-10-18T20:58:27.375 INFO:tasks.workunit.client.0.smithi008.stdout:2/327: write d1/d3/dd/d1c/f3c [1912956,32704] 0 2023-10-18T20:58:27.376 INFO:tasks.workunit.client.1.smithi060.stdout:2/317: write d0/d8/d47/f4b [790942,57877] 0 2023-10-18T20:58:27.376 INFO:tasks.workunit.client.1.smithi060.stdout:2/318: chown d0/d3/f35 7 1 2023-10-18T20:58:27.377 INFO:tasks.workunit.client.1.smithi060.stdout:6/285: dread d10/d17/d28/f24 [0,4194304] 0 2023-10-18T20:58:27.377 INFO:tasks.workunit.client.1.smithi060.stdout:1/401: mknod d4/d6/d7/df/c85 0 2023-10-18T20:58:27.379 INFO:tasks.workunit.client.0.smithi008.stdout:8/426: dwrite d5/f4b [8388608,4194304] 0 2023-10-18T20:58:27.379 INFO:tasks.workunit.client.0.smithi008.stdout:8/427: dread - d5/d8/df/f6b zero size 2023-10-18T20:58:27.383 INFO:tasks.workunit.client.0.smithi008.stdout:3/276: write d0/d3/f5 [1749082,91168] 0 2023-10-18T20:58:27.384 INFO:tasks.workunit.client.0.smithi008.stdout:0/276: mknod d0/dd/c55 0 2023-10-18T20:58:27.391 INFO:tasks.workunit.client.0.smithi008.stdout:1/434: sync 2023-10-18T20:58:27.393 INFO:tasks.workunit.client.1.smithi060.stdout:3/279: sync 2023-10-18T20:58:27.393 INFO:tasks.workunit.client.0.smithi008.stdout:7/332: dwrite d1/d36/d3d/d3e/f37 [0,4194304] 0 2023-10-18T20:58:27.394 INFO:tasks.workunit.client.0.smithi008.stdout:7/333: stat d1/d36/d3b/d4f/d5c/c68 0 2023-10-18T20:58:27.394 INFO:tasks.workunit.client.0.smithi008.stdout:7/334: read - d1/d36/d3d/d49/f6a zero size 2023-10-18T20:58:27.401 INFO:tasks.workunit.client.0.smithi008.stdout:6/334: dwrite df/d3c/f67 [0,4194304] 0 2023-10-18T20:58:27.402 INFO:tasks.workunit.client.0.smithi008.stdout:6/335: creat df/d15/d33/f76 x:0 0 0 2023-10-18T20:58:27.402 INFO:tasks.workunit.client.0.smithi008.stdout:7/335: dread d1/d3/d20/f43 [0,4194304] 0 2023-10-18T20:58:27.402 INFO:tasks.workunit.client.0.smithi008.stdout:7/336: chown d1/d3/le 8674 1 2023-10-18T20:58:27.423 INFO:tasks.workunit.client.1.smithi060.stdout:9/295: link d3/d10/d1c/d25/f3e d3/d10/d1c/d5a/d5d/f77 0 2023-10-18T20:58:27.424 INFO:tasks.workunit.client.0.smithi008.stdout:4/305: rmdir d0/d17 39 2023-10-18T20:58:27.424 INFO:tasks.workunit.client.0.smithi008.stdout:4/306: write d0/f1c [4403820,50991] 0 2023-10-18T20:58:27.429 INFO:tasks.workunit.client.1.smithi060.stdout:0/336: getdents d3/d8 0 2023-10-18T20:58:27.435 INFO:tasks.workunit.client.1.smithi060.stdout:7/321: truncate de/ff 653684 0 2023-10-18T20:58:27.437 INFO:tasks.workunit.client.1.smithi060.stdout:8/287: rename d4/d9/d31/d35/f3a to d4/f53 0 2023-10-18T20:58:27.440 INFO:tasks.workunit.client.1.smithi060.stdout:1/402: dwrite d4/da/f5a [0,4194304] 0 2023-10-18T20:58:27.440 INFO:tasks.workunit.client.1.smithi060.stdout:1/403: write d4/da/d42/f4a [1028642,16839] 0 2023-10-18T20:58:27.442 INFO:tasks.workunit.client.0.smithi008.stdout:9/330: creat d2/dc/d17/d19/d42/d59/f5d x:0 0 0 2023-10-18T20:58:27.443 INFO:tasks.workunit.client.0.smithi008.stdout:9/331: readlink d2/dc/d17/l3a 0 2023-10-18T20:58:27.443 INFO:tasks.workunit.client.1.smithi060.stdout:2/319: unlink d0/d43/d4a/l58 0 2023-10-18T20:58:27.447 INFO:tasks.workunit.client.1.smithi060.stdout:6/286: truncate d10/d2e/f50 1880605 0 2023-10-18T20:58:27.447 INFO:tasks.workunit.client.1.smithi060.stdout:6/287: truncate d10/d25/f4f 540252 0 2023-10-18T20:58:27.458 INFO:tasks.workunit.client.0.smithi008.stdout:7/337: dwrite d1/d36/d3d/d49/f6a [0,4194304] 0 2023-10-18T20:58:27.459 INFO:tasks.workunit.client.1.smithi060.stdout:0/337: read d3/fc [7066967,60317] 0 2023-10-18T20:58:27.461 INFO:tasks.workunit.client.1.smithi060.stdout:7/322: mknod de/d38/c66 0 2023-10-18T20:58:27.462 INFO:tasks.workunit.client.1.smithi060.stdout:7/323: read - de/d14/d49/f63 zero size 2023-10-18T20:58:27.462 INFO:tasks.workunit.client.1.smithi060.stdout:7/324: fsync de/d29/f33 0 2023-10-18T20:58:27.467 INFO:tasks.workunit.client.1.smithi060.stdout:4/280: rename d4/dc/d2a/d13/f2c to d4/d15/f51 0 2023-10-18T20:58:27.468 INFO:tasks.workunit.client.0.smithi008.stdout:8/428: unlink d5/d8/df/d54/f72 0 2023-10-18T20:58:27.469 INFO:tasks.workunit.client.0.smithi008.stdout:8/429: write d5/d8/f32 [3224121,85377] 0 2023-10-18T20:58:27.469 INFO:tasks.workunit.client.0.smithi008.stdout:8/430: creat d5/fa6 x:0 0 0 2023-10-18T20:58:27.469 INFO:tasks.workunit.client.0.smithi008.stdout:8/431: readlink d5/d8/df/l5f 0 2023-10-18T20:58:27.469 INFO:tasks.workunit.client.0.smithi008.stdout:8/432: write d5/fa6 [185159,11297] 0 2023-10-18T20:58:27.470 INFO:tasks.workunit.client.1.smithi060.stdout:8/288: truncate d4/d9/d37/f3c 3758213 0 2023-10-18T20:58:27.470 INFO:tasks.workunit.client.1.smithi060.stdout:8/289: getdents d4/d9/d4f 0 2023-10-18T20:58:27.470 INFO:tasks.workunit.client.0.smithi008.stdout:0/277: mknod d0/dd/d19/d24/c56 0 2023-10-18T20:58:27.473 INFO:tasks.workunit.client.1.smithi060.stdout:1/404: symlink d4/d6/d7/d2f/d7b/d2a/d32/dd/d81/l86 0 2023-10-18T20:58:27.475 INFO:tasks.workunit.client.1.smithi060.stdout:2/320: unlink d0/d3/l23 0 2023-10-18T20:58:27.475 INFO:tasks.workunit.client.1.smithi060.stdout:2/321: getdents d0/d8/d56 0 2023-10-18T20:58:27.479 INFO:tasks.workunit.client.1.smithi060.stdout:6/288: unlink d10/d17/f5b 0 2023-10-18T20:58:27.479 INFO:tasks.workunit.client.0.smithi008.stdout:1/435: creat d9/de/df/f7f x:0 0 0 2023-10-18T20:58:27.480 INFO:tasks.workunit.client.0.smithi008.stdout:1/436: creat d9/de/f80 x:0 0 0 2023-10-18T20:58:27.480 INFO:tasks.workunit.client.0.smithi008.stdout:1/437: chown d9/l75 1 1 2023-10-18T20:58:27.486 INFO:tasks.workunit.client.1.smithi060.stdout:3/280: link d0/d3c/f54 d0/f64 0 2023-10-18T20:58:27.486 INFO:tasks.workunit.client.1.smithi060.stdout:3/281: read d0/d22/d26/f43 [690714,85757] 0 2023-10-18T20:58:27.486 INFO:tasks.workunit.client.1.smithi060.stdout:3/282: fdatasync d0/d22/d26/d2b/f4c 0 2023-10-18T20:58:27.486 INFO:tasks.workunit.client.1.smithi060.stdout:3/283: fdatasync d0/f1f 0 2023-10-18T20:58:27.491 INFO:tasks.workunit.client.1.smithi060.stdout:9/296: dwrite d3/d10/d19/d54/f42 [0,4194304] 0 2023-10-18T20:58:27.497 INFO:tasks.workunit.client.1.smithi060.stdout:7/325: rename de/d14/d3a/f3b to de/d14/d3a/f67 0 2023-10-18T20:58:27.497 INFO:tasks.workunit.client.1.smithi060.stdout:4/281: rmdir d4/dc/d2a/d1d 39 2023-10-18T20:58:27.497 INFO:tasks.workunit.client.1.smithi060.stdout:5/369: rename d0/d6/l49 to d0/da/d3b/l8e 0 2023-10-18T20:58:27.499 INFO:tasks.workunit.client.0.smithi008.stdout:2/328: rename d1/d3/dd/l16 to d1/d3/dd/d25/d5c/l70 0 2023-10-18T20:58:27.499 INFO:tasks.workunit.client.0.smithi008.stdout:2/329: read - d1/f64 zero size 2023-10-18T20:58:27.500 INFO:tasks.workunit.client.1.smithi060.stdout:8/290: mknod d4/d9/d31/c54 0 2023-10-18T20:58:27.500 INFO:tasks.workunit.client.1.smithi060.stdout:8/291: creat d4/d9/d31/f55 x:0 0 0 2023-10-18T20:58:27.501 INFO:tasks.workunit.client.1.smithi060.stdout:8/292: readlink d4/d9/d37/l43 0 2023-10-18T20:58:27.503 INFO:tasks.workunit.client.0.smithi008.stdout:3/277: dread d0/d3/f31 [0,4194304] 0 2023-10-18T20:58:27.508 INFO:tasks.workunit.client.1.smithi060.stdout:1/405: unlink d4/d6/d7/d2f/d7b/d2a/d32/dd/d81/l86 0 2023-10-18T20:58:27.508 INFO:tasks.workunit.client.1.smithi060.stdout:1/406: chown d4/d6/d7/df/f40 157487045 1 2023-10-18T20:58:27.513 INFO:tasks.workunit.client.1.smithi060.stdout:4/282: creat d4/dc/d2a/d13/d33/f52 x:0 0 0 2023-10-18T20:58:27.518 INFO:tasks.workunit.client.1.smithi060.stdout:8/293: dread d4/d9/d37/f38 [0,4194304] 0 2023-10-18T20:58:27.524 INFO:tasks.workunit.client.0.smithi008.stdout:9/332: dwrite d2/dc/d1a/f54 [0,4194304] 0 2023-10-18T20:58:27.525 INFO:tasks.workunit.client.1.smithi060.stdout:9/297: read d3/d10/d1c/d2a/f36 [2021575,38028] 0 2023-10-18T20:58:27.525 INFO:tasks.workunit.client.1.smithi060.stdout:9/298: creat d3/d10/d1c/d5a/d5d/f78 x:0 0 0 2023-10-18T20:58:27.525 INFO:tasks.workunit.client.1.smithi060.stdout:9/299: fdatasync d3/d10/d1c/d25/f74 0 2023-10-18T20:58:27.526 INFO:tasks.workunit.client.1.smithi060.stdout:1/407: dread d4/da/f50 [0,4194304] 0 2023-10-18T20:58:27.527 INFO:tasks.workunit.client.0.smithi008.stdout:8/433: mknod d5/d8/d24/d50/d53/ca7 0 2023-10-18T20:58:27.533 INFO:tasks.workunit.client.1.smithi060.stdout:5/370: rename d0/d6/d8/f11 to d0/da/d3b/f8f 0 2023-10-18T20:58:27.539 INFO:tasks.workunit.client.0.smithi008.stdout:0/278: truncate d0/dd/df/d2a/f33 8087245 0 2023-10-18T20:58:27.542 INFO:tasks.workunit.client.1.smithi060.stdout:4/283: mkdir d4/dc/d2a/d39/d53 0 2023-10-18T20:58:27.543 INFO:tasks.workunit.client.1.smithi060.stdout:4/284: read d4/dc/d2a/d13/d33/f35 [848103,94621] 0 2023-10-18T20:58:27.543 INFO:tasks.workunit.client.0.smithi008.stdout:1/438: link d9/de/df/d17/d25/d57/l76 d9/de/df/d17/d55/l81 0 2023-10-18T20:58:27.547 INFO:tasks.workunit.client.1.smithi060.stdout:5/371: creat d0/d6/d9/d82/f90 x:0 0 0 2023-10-18T20:58:27.547 INFO:tasks.workunit.client.1.smithi060.stdout:5/372: getdents d0/da/d79 0 2023-10-18T20:58:27.548 INFO:tasks.workunit.client.1.smithi060.stdout:1/408: truncate d4/d6/d7/d2f/f39 1260072 0 2023-10-18T20:58:27.549 INFO:tasks.workunit.client.1.smithi060.stdout:1/409: write d4/da/d42/f57 [168681,98128] 0 2023-10-18T20:58:27.549 INFO:tasks.workunit.client.1.smithi060.stdout:1/410: fdatasync d4/da/f5a 0 2023-10-18T20:58:27.549 INFO:tasks.workunit.client.1.smithi060.stdout:1/411: readlink d4/l18 0 2023-10-18T20:58:27.550 INFO:tasks.workunit.client.1.smithi060.stdout:1/412: stat d4/d6/d7/f26 0 2023-10-18T20:58:27.554 INFO:tasks.workunit.client.1.smithi060.stdout:5/373: mknod d0/da/d3b/d43/c91 0 2023-10-18T20:58:27.559 INFO:tasks.workunit.client.0.smithi008.stdout:1/439: truncate d9/fc 3827617 0 2023-10-18T20:58:27.559 INFO:tasks.workunit.client.1.smithi060.stdout:0/338: dwrite d3/d32/f4c [0,4194304] 0 2023-10-18T20:58:27.561 INFO:tasks.workunit.client.0.smithi008.stdout:1/440: mknod d9/de/df/d77/c82 0 2023-10-18T20:58:27.563 INFO:tasks.workunit.client.0.smithi008.stdout:6/336: rename df/d15/d33 to df/d3c/d77 0 2023-10-18T20:58:27.564 INFO:tasks.workunit.client.1.smithi060.stdout:2/322: dwrite d0/f5d [0,4194304] 0 2023-10-18T20:58:27.565 INFO:tasks.workunit.client.0.smithi008.stdout:1/441: creat d9/de/df/d17/d25/f83 x:0 0 0 2023-10-18T20:58:27.565 INFO:tasks.workunit.client.0.smithi008.stdout:1/442: truncate d9/de/df/d17/d25/f83 360013 0 2023-10-18T20:58:27.565 INFO:tasks.workunit.client.0.smithi008.stdout:1/443: creat d9/de/df/f84 x:0 0 0 2023-10-18T20:58:27.567 INFO:tasks.workunit.client.0.smithi008.stdout:6/337: symlink df/l78 0 2023-10-18T20:58:27.567 INFO:tasks.workunit.client.1.smithi060.stdout:2/323: truncate d0/d3/d27/d4d/f54 657419 0 2023-10-18T20:58:27.568 INFO:tasks.workunit.client.1.smithi060.stdout:2/324: truncate d0/d8/f3d 4219824 0 2023-10-18T20:58:27.570 INFO:tasks.workunit.client.0.smithi008.stdout:8/434: dread d5/fa6 [0,4194304] 0 2023-10-18T20:58:27.570 INFO:tasks.workunit.client.1.smithi060.stdout:6/289: dwrite d10/d2e/f55 [0,4194304] 0 2023-10-18T20:58:27.572 INFO:tasks.workunit.client.0.smithi008.stdout:4/307: rename d0/f1c to d0/d3/d48/d4c/f6d 0 2023-10-18T20:58:27.572 INFO:tasks.workunit.client.0.smithi008.stdout:8/435: write d5/d8/df/d9d/d6c/f66 [1623448,47442] 0 2023-10-18T20:58:27.572 INFO:tasks.workunit.client.0.smithi008.stdout:8/436: fsync d5/d8/df/f75 0 2023-10-18T20:58:27.574 INFO:tasks.workunit.client.1.smithi060.stdout:4/285: dread d4/dc/d2a/d13/f3a [4194304,4194304] 0 2023-10-18T20:58:27.575 INFO:tasks.workunit.client.1.smithi060.stdout:0/339: write d3/f5 [91901,10242] 0 2023-10-18T20:58:27.581 INFO:tasks.workunit.client.0.smithi008.stdout:7/338: dwrite d1/d36/d3b/d4f/f6e [0,4194304] 0 2023-10-18T20:58:27.581 INFO:tasks.workunit.client.0.smithi008.stdout:7/339: readlink d1/d3/l5 0 2023-10-18T20:58:27.584 INFO:tasks.workunit.client.0.smithi008.stdout:2/330: dwrite d1/f1a [0,4194304] 0 2023-10-18T20:58:27.586 INFO:tasks.workunit.client.1.smithi060.stdout:3/284: dwrite d0/f24 [4194304,4194304] 0 2023-10-18T20:58:27.598 INFO:tasks.workunit.client.1.smithi060.stdout:2/325: dread d0/d16/f19 [0,4194304] 0 2023-10-18T20:58:27.600 INFO:tasks.workunit.client.0.smithi008.stdout:4/308: write d0/f12 [3230412,103818] 0 2023-10-18T20:58:27.601 INFO:tasks.workunit.client.0.smithi008.stdout:1/444: mkdir d9/de/df/d85 0 2023-10-18T20:58:27.604 INFO:tasks.workunit.client.0.smithi008.stdout:5/324: sync 2023-10-18T20:58:27.605 INFO:tasks.workunit.client.1.smithi060.stdout:7/326: rename de/d14/d1d to de/d14/d49/d68 0 2023-10-18T20:58:27.605 INFO:tasks.workunit.client.1.smithi060.stdout:7/327: dread - de/d14/d41/d58/d5b/f64 zero size 2023-10-18T20:58:27.611 INFO:tasks.workunit.client.0.smithi008.stdout:6/338: unlink df/d13/c1f 0 2023-10-18T20:58:27.612 INFO:tasks.workunit.client.1.smithi060.stdout:4/286: dread d4/dc/d2a/d1d/f21 [0,4194304] 0 2023-10-18T20:58:27.612 INFO:tasks.workunit.client.1.smithi060.stdout:8/294: dwrite d4/ff [0,4194304] 0 2023-10-18T20:58:27.613 INFO:tasks.workunit.client.1.smithi060.stdout:8/295: truncate d4/d9/d31/f40 733859 0 2023-10-18T20:58:27.613 INFO:tasks.workunit.client.1.smithi060.stdout:8/296: chown d4/d9/d37/f3d 6600 1 2023-10-18T20:58:27.613 INFO:tasks.workunit.client.1.smithi060.stdout:2/326: write d0/f10 [3435373,57999] 0 2023-10-18T20:58:27.614 INFO:tasks.workunit.client.1.smithi060.stdout:2/327: dread - d0/d3/d27/f4c zero size 2023-10-18T20:58:27.614 INFO:tasks.workunit.client.0.smithi008.stdout:8/437: truncate d5/d8/d24/f2c 11036 0 2023-10-18T20:58:27.614 INFO:tasks.workunit.client.0.smithi008.stdout:8/438: chown d5/d8 3311 1 2023-10-18T20:58:27.621 INFO:tasks.workunit.client.0.smithi008.stdout:3/278: rename d0/c1 to d0/d3/de/c55 0 2023-10-18T20:58:27.626 INFO:tasks.workunit.client.1.smithi060.stdout:6/290: dwrite d10/d1b/f4a [0,4194304] 0 2023-10-18T20:58:27.626 INFO:tasks.workunit.client.1.smithi060.stdout:6/291: stat d10/d17/d28 0 2023-10-18T20:58:27.626 INFO:tasks.workunit.client.1.smithi060.stdout:4/287: dread d4/dc/d2a/f7 [0,4194304] 0 2023-10-18T20:58:27.627 INFO:tasks.workunit.client.1.smithi060.stdout:1/413: dwrite d4/d6/d7/d2f/d7b/d2a/f45 [0,4194304] 0 2023-10-18T20:58:27.627 INFO:tasks.workunit.client.1.smithi060.stdout:1/414: read d4/f8 [2195813,16882] 0 2023-10-18T20:58:27.627 INFO:tasks.workunit.client.1.smithi060.stdout:1/415: write d4/da/f53 [940604,53534] 0 2023-10-18T20:58:27.627 INFO:tasks.workunit.client.1.smithi060.stdout:4/288: write d4/d15/f51 [710795,124195] 0 2023-10-18T20:58:27.628 INFO:tasks.workunit.client.1.smithi060.stdout:0/340: symlink d3/d8/d3c/l6a 0 2023-10-18T20:58:27.628 INFO:tasks.workunit.client.1.smithi060.stdout:0/341: dread - d3/d8/f20 zero size 2023-10-18T20:58:27.628 INFO:tasks.workunit.client.1.smithi060.stdout:0/342: chown d3/f3b 6929763 1 2023-10-18T20:58:27.629 INFO:tasks.workunit.client.1.smithi060.stdout:1/416: read d4/d6/d7/d2f/d7b/d2a/d32/d56/f75 [313775,67507] 0 2023-10-18T20:58:27.629 INFO:tasks.workunit.client.1.smithi060.stdout:1/417: readlink d4/d6/l63 0 2023-10-18T20:58:27.629 INFO:tasks.workunit.client.1.smithi060.stdout:1/418: fsync d4/d6/d7/df/f6b 0 2023-10-18T20:58:27.630 INFO:tasks.workunit.client.0.smithi008.stdout:9/333: dwrite d2/dc/d40/d46/f51 [0,4194304] 0 2023-10-18T20:58:27.632 INFO:tasks.workunit.client.1.smithi060.stdout:4/289: write d4/dc/d2a/d31/f46 [345807,120311] 0 2023-10-18T20:58:27.633 INFO:tasks.workunit.client.1.smithi060.stdout:5/374: dwrite d0/d6/d8/df/d27/d32/d4f/f68 [0,4194304] 0 2023-10-18T20:58:27.634 INFO:tasks.workunit.client.1.smithi060.stdout:0/343: dread d3/d8/d14/f3d [0,4194304] 0 2023-10-18T20:58:27.635 INFO:tasks.workunit.client.0.smithi008.stdout:7/340: unlink d1/d36/d3d/d3e/f37 0 2023-10-18T20:58:27.636 INFO:tasks.workunit.client.0.smithi008.stdout:7/341: dread - d1/d36/d3b/d4f/f5b zero size 2023-10-18T20:58:27.636 INFO:tasks.workunit.client.0.smithi008.stdout:7/342: creat d1/d36/d3d/d49/f71 x:0 0 0 2023-10-18T20:58:27.636 INFO:tasks.workunit.client.0.smithi008.stdout:7/343: chown d1/f4e 2442 1 2023-10-18T20:58:27.637 INFO:tasks.workunit.client.1.smithi060.stdout:9/300: rename d3/f5f to d3/d10/d1c/d5a/d5d/f79 0 2023-10-18T20:58:27.639 INFO:tasks.workunit.client.0.smithi008.stdout:2/331: creat d1/d3/dd/f71 x:0 0 0 2023-10-18T20:58:27.643 INFO:tasks.workunit.client.1.smithi060.stdout:0/344: dread d3/d8/d14/f2a [0,4194304] 0 2023-10-18T20:58:27.644 INFO:tasks.workunit.client.1.smithi060.stdout:7/328: symlink de/d38/l69 0 2023-10-18T20:58:27.644 INFO:tasks.workunit.client.1.smithi060.stdout:7/329: getdents de/d14/d41/d58/d65 0 2023-10-18T20:58:27.652 INFO:tasks.workunit.client.1.smithi060.stdout:5/375: write d0/d6/f1e [3288188,118607] 0 2023-10-18T20:58:27.652 INFO:tasks.workunit.client.1.smithi060.stdout:5/376: truncate d0/d6/d8/f6b 1244342 0 2023-10-18T20:58:27.654 INFO:tasks.workunit.client.1.smithi060.stdout:8/297: creat d4/d9/d37/f56 x:0 0 0 2023-10-18T20:58:27.659 INFO:tasks.workunit.client.0.smithi008.stdout:1/445: mknod d9/de/df/d17/d25/d57/c86 0 2023-10-18T20:58:27.659 INFO:tasks.workunit.client.0.smithi008.stdout:1/446: dread - d9/f7a zero size 2023-10-18T20:58:27.660 INFO:tasks.workunit.client.0.smithi008.stdout:1/447: fdatasync d9/de/df/d17/d1e/f2d 0 2023-10-18T20:58:27.662 INFO:tasks.workunit.client.0.smithi008.stdout:6/339: creat df/d18/d3f/f79 x:0 0 0 2023-10-18T20:58:27.668 INFO:tasks.workunit.client.0.smithi008.stdout:8/439: mknod d5/d8/df/d9d/d85/ca8 0 2023-10-18T20:58:27.672 INFO:tasks.workunit.client.1.smithi060.stdout:6/292: mknod d10/d1b/c60 0 2023-10-18T20:58:27.673 INFO:tasks.workunit.client.1.smithi060.stdout:6/293: write d10/d2e/f3a [1996274,95172] 0 2023-10-18T20:58:27.673 INFO:tasks.workunit.client.0.smithi008.stdout:5/325: dwrite d0/d2/f7 [0,4194304] 0 2023-10-18T20:58:27.674 INFO:tasks.workunit.client.0.smithi008.stdout:5/326: fsync d0/d2/d19/d1b/f2a 0 2023-10-18T20:58:27.674 INFO:tasks.workunit.client.0.smithi008.stdout:5/327: write d0/d2/d9/f54 [565554,38490] 0 2023-10-18T20:58:27.674 INFO:tasks.workunit.client.0.smithi008.stdout:5/328: fdatasync d0/d2/d9/d34/f3b 0 2023-10-18T20:58:27.674 INFO:tasks.workunit.client.0.smithi008.stdout:5/329: write d0/d2/d9/f44 [2024868,115247] 0 2023-10-18T20:58:27.674 INFO:tasks.workunit.client.0.smithi008.stdout:0/279: rename d0/dd/d19/d24/c45 to d0/dd/d19/d41/c57 0 2023-10-18T20:58:27.679 INFO:tasks.workunit.client.0.smithi008.stdout:7/344: link d1/d3/f56 d1/d3/d20/d5f/f72 0 2023-10-18T20:58:27.679 INFO:tasks.workunit.client.0.smithi008.stdout:7/345: chown d1/d3/f27 412 1 2023-10-18T20:58:27.680 INFO:tasks.workunit.client.1.smithi060.stdout:3/285: rmdir d0/d22/d26/d29 39 2023-10-18T20:58:27.682 INFO:tasks.workunit.client.0.smithi008.stdout:2/332: mkdir d1/d3/d40/d72 0 2023-10-18T20:58:27.685 INFO:tasks.workunit.client.0.smithi008.stdout:4/309: mkdir d0/d17/d6e 0 2023-10-18T20:58:27.685 INFO:tasks.workunit.client.0.smithi008.stdout:4/310: fsync d0/d3/d21/f5a 0 2023-10-18T20:58:27.685 INFO:tasks.workunit.client.0.smithi008.stdout:4/311: fdatasync d0/d17/d5b/d2a/f5d 0 2023-10-18T20:58:27.686 INFO:tasks.workunit.client.1.smithi060.stdout:1/419: mkdir d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87 0 2023-10-18T20:58:27.686 INFO:tasks.workunit.client.1.smithi060.stdout:6/294: write d10/d1b/f41 [3057410,118452] 0 2023-10-18T20:58:27.686 INFO:tasks.workunit.client.1.smithi060.stdout:6/295: chown fd 212436 1 2023-10-18T20:58:27.692 INFO:tasks.workunit.client.0.smithi008.stdout:5/330: write d0/d2/d19/d1b/d41/f56 [1166790,39425] 0 2023-10-18T20:58:27.692 INFO:tasks.workunit.client.0.smithi008.stdout:6/340: mknod df/d18/c7a 0 2023-10-18T20:58:27.692 INFO:tasks.workunit.client.0.smithi008.stdout:1/448: creat d9/de/df/d17/d25/d57/f87 x:0 0 0 2023-10-18T20:58:27.692 INFO:tasks.workunit.client.0.smithi008.stdout:6/341: creat df/d18/d3f/f7b x:0 0 0 2023-10-18T20:58:27.693 INFO:tasks.workunit.client.0.smithi008.stdout:1/449: truncate d9/de/df/d17/d1e/d3c/f6f 435949 0 2023-10-18T20:58:27.693 INFO:tasks.workunit.client.0.smithi008.stdout:1/450: chown d9/de/df/l73 112153 1 2023-10-18T20:58:27.693 INFO:tasks.workunit.client.1.smithi060.stdout:4/290: creat d4/dc/d2a/f54 x:0 0 0 2023-10-18T20:58:27.700 INFO:tasks.workunit.client.0.smithi008.stdout:0/280: creat d0/dd/d19/d41/f58 x:0 0 0 2023-10-18T20:58:27.700 INFO:tasks.workunit.client.0.smithi008.stdout:0/281: stat d0/dd/d19/d24/f44 0 2023-10-18T20:58:27.700 INFO:tasks.workunit.client.0.smithi008.stdout:0/282: truncate d0/dd/d19/d24/f44 5056457 0 2023-10-18T20:58:27.700 INFO:tasks.workunit.client.0.smithi008.stdout:0/283: creat d0/dd/d29/f59 x:0 0 0 2023-10-18T20:58:27.705 INFO:tasks.workunit.client.0.smithi008.stdout:8/440: mknod d5/d8/df/d6f/ca9 0 2023-10-18T20:58:27.705 INFO:tasks.workunit.client.0.smithi008.stdout:7/346: mkdir d1/d36/d3d/d3e/d59/d73 0 2023-10-18T20:58:27.705 INFO:tasks.workunit.client.0.smithi008.stdout:7/347: dread - d1/d36/d3b/d4f/f5e zero size 2023-10-18T20:58:27.710 INFO:tasks.workunit.client.1.smithi060.stdout:9/301: symlink d3/d10/d65/l7a 0 2023-10-18T20:58:27.712 INFO:tasks.workunit.client.0.smithi008.stdout:5/331: link d0/d2/d19/d1b/d31/d3f/l51 d0/d2/d19/d1b/d58/d65/l79 0 2023-10-18T20:58:27.712 INFO:tasks.workunit.client.0.smithi008.stdout:5/332: chown d0/f29 15633547 1 2023-10-18T20:58:27.713 INFO:tasks.workunit.client.1.smithi060.stdout:0/345: mkdir d3/d8/d14/d49/d6b 0 2023-10-18T20:58:27.715 INFO:tasks.workunit.client.1.smithi060.stdout:7/330: creat de/d14/d41/f6a x:0 0 0 2023-10-18T20:58:27.715 INFO:tasks.workunit.client.1.smithi060.stdout:7/331: chown de/d14/d3a/d46 53760682 1 2023-10-18T20:58:27.716 INFO:tasks.workunit.client.1.smithi060.stdout:7/332: fsync de/d14/d49/d68/f21 0 2023-10-18T20:58:27.717 INFO:tasks.workunit.client.0.smithi008.stdout:8/441: creat d5/d8/df/d9d/d6c/faa x:0 0 0 2023-10-18T20:58:27.717 INFO:tasks.workunit.client.0.smithi008.stdout:8/442: stat d5/d8/df/d2e/l3c 0 2023-10-18T20:58:27.720 INFO:tasks.workunit.client.0.smithi008.stdout:1/451: dread d9/de/df/d17/d1e/f2d [0,4194304] 0 2023-10-18T20:58:27.723 INFO:tasks.workunit.client.0.smithi008.stdout:9/334: dwrite d2/dc/d1a/f5b [0,4194304] 0 2023-10-18T20:58:27.726 INFO:tasks.workunit.client.0.smithi008.stdout:8/443: symlink d5/d8/df/d54/lab 0 2023-10-18T20:58:27.726 INFO:tasks.workunit.client.0.smithi008.stdout:8/444: chown d5/d8/d24/d50 2427 1 2023-10-18T20:58:27.726 INFO:tasks.workunit.client.0.smithi008.stdout:8/445: getdents d5/d8/d24/d9f 0 2023-10-18T20:58:27.735 INFO:tasks.workunit.client.1.smithi060.stdout:5/377: truncate d0/d6/d9/f14 2949290 0 2023-10-18T20:58:27.736 INFO:tasks.workunit.client.0.smithi008.stdout:8/446: mknod d5/d8/d24/d50/d8d/cac 0 2023-10-18T20:58:27.739 INFO:tasks.workunit.client.0.smithi008.stdout:8/447: creat d5/d8/d24/d50/d8d/fad x:0 0 0 2023-10-18T20:58:27.740 INFO:tasks.workunit.client.1.smithi060.stdout:1/420: mknod d4/d38/c88 0 2023-10-18T20:58:27.740 INFO:tasks.workunit.client.0.smithi008.stdout:8/448: write d5/d8/df/d2e/f35 [260097,44144] 0 2023-10-18T20:58:27.740 INFO:tasks.workunit.client.0.smithi008.stdout:8/449: write d5/f18 [1413501,36317] 0 2023-10-18T20:58:27.741 INFO:tasks.workunit.client.0.smithi008.stdout:8/450: chown d5/d8/df/d2e/l3e 239017 1 2023-10-18T20:58:27.741 INFO:tasks.workunit.client.0.smithi008.stdout:6/342: dwrite df/d15/d27/f28 [0,4194304] 0 2023-10-18T20:58:27.745 INFO:tasks.workunit.client.1.smithi060.stdout:6/296: link d10/f51 d10/d1b/f61 0 2023-10-18T20:58:27.746 INFO:tasks.workunit.client.1.smithi060.stdout:0/346: rename d3/f5 to d3/f6c 0 2023-10-18T20:58:27.746 INFO:tasks.workunit.client.1.smithi060.stdout:9/302: rename d3/d10/fe to d3/d58/f7b 0 2023-10-18T20:58:27.746 INFO:tasks.workunit.client.1.smithi060.stdout:0/347: creat d3/d8/d3c/f6d x:0 0 0 2023-10-18T20:58:27.746 INFO:tasks.workunit.client.1.smithi060.stdout:0/348: chown d3/f6 30561440 1 2023-10-18T20:58:27.747 INFO:tasks.workunit.client.1.smithi060.stdout:6/297: truncate d10/f51 243706 0 2023-10-18T20:58:27.747 INFO:tasks.workunit.client.1.smithi060.stdout:3/286: dwrite d0/d22/d26/d29/f3a [4194304,4194304] 0 2023-10-18T20:58:27.747 INFO:tasks.workunit.client.1.smithi060.stdout:7/333: symlink de/d14/d49/l6b 0 2023-10-18T20:58:27.747 INFO:tasks.workunit.client.1.smithi060.stdout:5/378: unlink d0/dd/d33/c73 0 2023-10-18T20:58:27.748 INFO:tasks.workunit.client.1.smithi060.stdout:8/298: mkdir d4/d57 0 2023-10-18T20:58:27.749 INFO:tasks.workunit.client.1.smithi060.stdout:5/379: write d0/d6/d8/df/d27/d32/d6d/d72/f5d [560571,114087] 0 2023-10-18T20:58:27.750 INFO:tasks.workunit.client.1.smithi060.stdout:7/334: read de/f27 [42120,1017] 0 2023-10-18T20:58:27.750 INFO:tasks.workunit.client.1.smithi060.stdout:7/335: write de/f19 [259249,22472] 0 2023-10-18T20:58:27.756 INFO:tasks.workunit.client.0.smithi008.stdout:7/348: dwrite d1/d3/d20/f2f [0,4194304] 0 2023-10-18T20:58:27.759 INFO:tasks.workunit.client.0.smithi008.stdout:6/343: link df/d18/d3f/l56 df/d15/l7c 0 2023-10-18T20:58:27.760 INFO:tasks.workunit.client.0.smithi008.stdout:2/333: write d1/f5a [3881073,126440] 0 2023-10-18T20:58:27.760 INFO:tasks.workunit.client.0.smithi008.stdout:2/334: chown d1/d3/dd/d1c/d3a/d49 5072499 1 2023-10-18T20:58:27.762 INFO:tasks.workunit.client.1.smithi060.stdout:4/291: dwrite d4/f43 [0,4194304] 0 2023-10-18T20:58:27.763 INFO:tasks.workunit.client.1.smithi060.stdout:4/292: dread - d4/dc/d2a/d13/f3f zero size 2023-10-18T20:58:27.766 INFO:tasks.workunit.client.0.smithi008.stdout:3/279: dwrite d0/d3/f2e [0,4194304] 0 2023-10-18T20:58:27.766 INFO:tasks.workunit.client.0.smithi008.stdout:4/312: dread d0/d17/f1a [0,4194304] 0 2023-10-18T20:58:27.767 INFO:tasks.workunit.client.1.smithi060.stdout:1/421: rename d4/d6/c3c to d4/d6/d7/d2f/c89 0 2023-10-18T20:58:27.769 INFO:tasks.workunit.client.0.smithi008.stdout:8/451: dread d5/d8/d24/f63 [0,4194304] 0 2023-10-18T20:58:27.769 INFO:tasks.workunit.client.0.smithi008.stdout:8/452: chown d5/d8/d24/l38 3110561 1 2023-10-18T20:58:27.771 INFO:tasks.workunit.client.0.smithi008.stdout:0/284: rmdir d0/dd/d19/d41 39 2023-10-18T20:58:27.772 INFO:tasks.workunit.client.0.smithi008.stdout:0/285: creat d0/dd/d19/d24/f5a x:0 0 0 2023-10-18T20:58:27.772 INFO:tasks.workunit.client.0.smithi008.stdout:0/286: write d0/dd/d19/d41/f43 [283216,126138] 0 2023-10-18T20:58:27.773 INFO:tasks.workunit.client.0.smithi008.stdout:0/287: chown d0/dd/d19/l4f 30 1 2023-10-18T20:58:27.773 INFO:tasks.workunit.client.0.smithi008.stdout:0/288: creat d0/dd/d29/f5b x:0 0 0 2023-10-18T20:58:27.777 INFO:tasks.workunit.client.0.smithi008.stdout:2/335: symlink d1/d3/dd/d25/d34/l73 0 2023-10-18T20:58:27.778 INFO:tasks.workunit.client.1.smithi060.stdout:6/298: creat d10/d25/d3c/f62 x:0 0 0 2023-10-18T20:58:27.782 INFO:tasks.workunit.client.0.smithi008.stdout:8/453: mkdir d5/d8/df/dae 0 2023-10-18T20:58:27.783 INFO:tasks.workunit.client.1.smithi060.stdout:3/287: truncate d0/fb 8632324 0 2023-10-18T20:58:27.783 INFO:tasks.workunit.client.1.smithi060.stdout:5/380: mknod d0/c92 0 2023-10-18T20:58:27.789 INFO:tasks.workunit.client.0.smithi008.stdout:4/313: dread d0/d3/f41 [4194304,4194304] 0 2023-10-18T20:58:27.789 INFO:tasks.workunit.client.0.smithi008.stdout:4/314: write d0/f13 [1500991,83225] 0 2023-10-18T20:58:27.790 INFO:tasks.workunit.client.0.smithi008.stdout:4/315: write d0/d3/f64 [179897,39790] 0 2023-10-18T20:58:27.790 INFO:tasks.workunit.client.1.smithi060.stdout:7/336: creat de/f6c x:0 0 0 2023-10-18T20:58:27.791 INFO:tasks.workunit.client.1.smithi060.stdout:7/337: write de/d14/d41/d58/d5b/f5e [26810,122475] 0 2023-10-18T20:58:27.794 INFO:tasks.workunit.client.1.smithi060.stdout:9/303: mknod d3/d10/d1c/d2a/d2d/c7c 0 2023-10-18T20:58:27.795 INFO:tasks.workunit.client.1.smithi060.stdout:9/304: chown d3/d10/d1c/d2a/d2d 159141 1 2023-10-18T20:58:27.796 INFO:tasks.workunit.client.1.smithi060.stdout:0/349: dwrite d3/f6 [0,4194304] 0 2023-10-18T20:58:27.797 INFO:tasks.workunit.client.0.smithi008.stdout:5/333: rename d0/d2/d19/d1b to d0/de/d7a 0 2023-10-18T20:58:27.797 INFO:tasks.workunit.client.0.smithi008.stdout:5/334: getdents d0/de/d7a/d31/d3f/d70 0 2023-10-18T20:58:27.797 INFO:tasks.workunit.client.0.smithi008.stdout:5/335: write d0/de/d7a/d31/f4a [832232,7886] 0 2023-10-18T20:58:27.798 INFO:tasks.workunit.client.0.smithi008.stdout:5/336: chown d0/de/d7a/f27 0 1 2023-10-18T20:58:27.806 INFO:tasks.workunit.client.0.smithi008.stdout:0/289: creat d0/d3a/f5c x:0 0 0 2023-10-18T20:58:27.807 INFO:tasks.workunit.client.0.smithi008.stdout:2/336: getdents d1/d3/dd/d1c/d3a/d57 0 2023-10-18T20:58:27.808 INFO:tasks.workunit.client.0.smithi008.stdout:8/454: rmdir d5/d8/df/dae 0 2023-10-18T20:58:27.808 INFO:tasks.workunit.client.0.smithi008.stdout:8/455: readlink d5/l10 0 2023-10-18T20:58:27.808 INFO:tasks.workunit.client.0.smithi008.stdout:8/456: creat d5/d8/df/d6f/faf x:0 0 0 2023-10-18T20:58:27.811 INFO:tasks.workunit.client.0.smithi008.stdout:0/290: symlink d0/dd/d19/l5d 0 2023-10-18T20:58:27.811 INFO:tasks.workunit.client.0.smithi008.stdout:0/291: stat d0/dd/df/c54 0 2023-10-18T20:58:27.813 INFO:tasks.workunit.client.0.smithi008.stdout:1/452: rename d9/de/df/d17/f6a to d9/de/df/d17/d1e/d7d/f88 0 2023-10-18T20:58:27.813 INFO:tasks.workunit.client.0.smithi008.stdout:2/337: creat d1/d3/dd/d1c/f74 x:0 0 0 2023-10-18T20:58:27.821 INFO:tasks.workunit.client.1.smithi060.stdout:4/293: mknod d4/dc/d2a/d13/c55 0 2023-10-18T20:58:27.825 INFO:tasks.workunit.client.1.smithi060.stdout:8/299: rename d4/d9/d31/l48 to d4/d57/l58 0 2023-10-18T20:58:27.825 INFO:tasks.workunit.client.1.smithi060.stdout:6/299: symlink d10/d2e/l63 0 2023-10-18T20:58:27.827 INFO:tasks.workunit.client.0.smithi008.stdout:0/292: mkdir d0/dd/df/d2a/d5e 0 2023-10-18T20:58:27.840 INFO:tasks.workunit.client.0.smithi008.stdout:1/453: read d9/de/df/d17/d55/f5c [3768351,61483] 0 2023-10-18T20:58:27.841 INFO:tasks.workunit.client.0.smithi008.stdout:1/454: write d9/de/df/f84 [800071,69726] 0 2023-10-18T20:58:27.845 INFO:tasks.workunit.client.1.smithi060.stdout:5/381: symlink d0/l93 0 2023-10-18T20:58:27.849 INFO:tasks.workunit.client.1.smithi060.stdout:7/338: getdents de/d14 0 2023-10-18T20:58:27.851 INFO:tasks.workunit.client.0.smithi008.stdout:9/335: rename d2/dc/c24 to d2/dc/d17/d19/d42/d59/c5e 0 2023-10-18T20:58:27.851 INFO:tasks.workunit.client.0.smithi008.stdout:9/336: chown d2/dc/l2c 0 1 2023-10-18T20:58:27.852 INFO:tasks.workunit.client.0.smithi008.stdout:9/337: chown d2/dc/d1a/c30 1080423 1 2023-10-18T20:58:27.852 INFO:tasks.workunit.client.1.smithi060.stdout:9/305: mkdir d3/d10/d1c/d5a/d5d/d7d 0 2023-10-18T20:58:27.853 INFO:tasks.workunit.client.1.smithi060.stdout:1/422: rename f1 to d4/d6/d14/f8a 0 2023-10-18T20:58:27.861 INFO:tasks.workunit.client.0.smithi008.stdout:2/338: write d1/d3/dd/d25/d34/f3b [2492898,116350] 0 2023-10-18T20:58:27.862 INFO:tasks.workunit.client.0.smithi008.stdout:2/339: chown d1/d3/dd/d25/d4d/f68 13 1 2023-10-18T20:58:27.862 INFO:tasks.workunit.client.0.smithi008.stdout:2/340: chown d1/d3/dd/d25/c6a 0 1 2023-10-18T20:58:27.863 INFO:tasks.workunit.client.1.smithi060.stdout:8/300: dread d4/d9/f1b [0,4194304] 0 2023-10-18T20:58:27.863 INFO:tasks.workunit.client.1.smithi060.stdout:1/423: dread d4/d6/d14/d41/f55 [0,4194304] 0 2023-10-18T20:58:27.864 INFO:tasks.workunit.client.1.smithi060.stdout:1/424: symlink d4/da/d42/l8b 2 2023-10-18T20:58:27.868 INFO:tasks.workunit.client.1.smithi060.stdout:7/339: symlink de/d14/d41/d58/d65/l6d 0 2023-10-18T20:58:27.868 INFO:tasks.workunit.client.0.smithi008.stdout:5/337: dwrite d0/de/d7a/f27 [0,4194304] 0 2023-10-18T20:58:27.869 INFO:tasks.workunit.client.0.smithi008.stdout:3/280: rename d0/d3/de/c27 to d0/d3/d42/d52/c56 0 2023-10-18T20:58:27.870 INFO:tasks.workunit.client.0.smithi008.stdout:3/281: stat d0/d3/de/c25 0 2023-10-18T20:58:27.879 INFO:tasks.workunit.client.0.smithi008.stdout:1/455: dread d9/de/df/d17/d1e/f4c [0,4194304] 0 2023-10-18T20:58:27.880 INFO:tasks.workunit.client.0.smithi008.stdout:6/344: dwrite df/d19/f1c [0,4194304] 0 2023-10-18T20:58:27.885 INFO:tasks.workunit.client.1.smithi060.stdout:7/340: symlink de/d14/d2f/l6e 0 2023-10-18T20:58:27.885 INFO:tasks.workunit.client.1.smithi060.stdout:5/382: dread d0/d6/d8/df/d27/d32/d6d/d72/f40 [0,4194304] 0 2023-10-18T20:58:27.890 INFO:tasks.workunit.client.1.smithi060.stdout:3/288: rename d0/c25 to d0/d5e/c65 0 2023-10-18T20:58:27.890 INFO:tasks.workunit.client.1.smithi060.stdout:3/289: truncate d0/d22/f52 298740 0 2023-10-18T20:58:27.890 INFO:tasks.workunit.client.1.smithi060.stdout:3/290: write d0/d3c/f54 [910958,72682] 0 2023-10-18T20:58:27.891 INFO:tasks.workunit.client.1.smithi060.stdout:2/328: sync 2023-10-18T20:58:27.894 INFO:tasks.workunit.client.1.smithi060.stdout:0/350: dwrite d3/d8/d3c/f6d [0,4194304] 0 2023-10-18T20:58:27.895 INFO:tasks.workunit.client.0.smithi008.stdout:3/282: mknod d0/d3/d15/c57 0 2023-10-18T20:58:27.897 INFO:tasks.workunit.client.1.smithi060.stdout:5/383: dread d0/d6/f42 [0,4194304] 0 2023-10-18T20:58:27.898 INFO:tasks.workunit.client.1.smithi060.stdout:5/384: write d0/da/d3b/f4c [183527,115085] 0 2023-10-18T20:58:27.898 INFO:tasks.workunit.client.0.smithi008.stdout:5/338: dread d0/d2/d19/f2f [0,4194304] 0 2023-10-18T20:58:27.898 INFO:tasks.workunit.client.0.smithi008.stdout:5/339: readlink d0/d2/d9/l17 0 2023-10-18T20:58:27.899 INFO:tasks.workunit.client.0.smithi008.stdout:7/349: dwrite d1/d36/d3b/d4f/f5b [0,4194304] 0 2023-10-18T20:58:27.899 INFO:tasks.workunit.client.0.smithi008.stdout:7/350: dread - d1/d3/f56 zero size 2023-10-18T20:58:27.900 INFO:tasks.workunit.client.0.smithi008.stdout:2/341: dread d1/f18 [0,4194304] 0 2023-10-18T20:58:27.900 INFO:tasks.workunit.client.0.smithi008.stdout:2/342: fdatasync d1/d3/dd/d1c/d39/f3f 0 2023-10-18T20:58:27.905 INFO:tasks.workunit.client.1.smithi060.stdout:8/301: rename d4/f22 to d4/d9/d37/d4e/f59 0 2023-10-18T20:58:27.905 INFO:tasks.workunit.client.1.smithi060.stdout:8/302: chown d4/d9/c24 546667 1 2023-10-18T20:58:27.906 INFO:tasks.workunit.client.1.smithi060.stdout:8/303: readlink d4/d9/l2f 0 2023-10-18T20:58:27.909 INFO:tasks.workunit.client.1.smithi060.stdout:4/294: dwrite d4/d15/d2b/f3b [0,4194304] 0 2023-10-18T20:58:27.909 INFO:tasks.workunit.client.1.smithi060.stdout:4/295: chown d4/dc/cd 863 1 2023-10-18T20:58:27.909 INFO:tasks.workunit.client.1.smithi060.stdout:4/296: fdatasync d4/dc/d2a/f1f 0 2023-10-18T20:58:27.909 INFO:tasks.workunit.client.1.smithi060.stdout:4/297: read - d4/dc/d2a/f54 zero size 2023-10-18T20:58:27.910 INFO:tasks.workunit.client.1.smithi060.stdout:4/298: truncate d4/dc/f29 3120465 0 2023-10-18T20:58:27.910 INFO:tasks.workunit.client.1.smithi060.stdout:4/299: creat d4/dc/d2a/d13/f56 x:0 0 0 2023-10-18T20:58:27.911 INFO:tasks.workunit.client.0.smithi008.stdout:4/316: rename d0/c39 to d0/d3/d21/d42/c6f 0 2023-10-18T20:58:27.911 INFO:tasks.workunit.client.0.smithi008.stdout:4/317: truncate d0/d3/d48/d4c/f53 38062 0 2023-10-18T20:58:27.912 INFO:tasks.workunit.client.0.smithi008.stdout:4/318: readlink d0/d17/d5b/d45/l6b 0 2023-10-18T20:58:27.912 INFO:tasks.workunit.client.0.smithi008.stdout:4/319: chown d0/d3/l28 11575 1 2023-10-18T20:58:27.912 INFO:tasks.workunit.client.0.smithi008.stdout:4/320: getdents d0/d3/d21/d57 0 2023-10-18T20:58:27.912 INFO:tasks.workunit.client.0.smithi008.stdout:4/321: truncate d0/d17/d5b/d2a/f3c 1124401 0 2023-10-18T20:58:27.913 INFO:tasks.workunit.client.0.smithi008.stdout:0/293: dwrite d0/dd/d19/f3c [0,4194304] 0 2023-10-18T20:58:27.914 INFO:tasks.workunit.client.1.smithi060.stdout:8/304: dread d4/d9/f1b [0,4194304] 0 2023-10-18T20:58:27.914 INFO:tasks.workunit.client.1.smithi060.stdout:8/305: creat d4/d9/d31/f5a x:0 0 0 2023-10-18T20:58:27.915 INFO:tasks.workunit.client.1.smithi060.stdout:3/291: mknod d0/d22/d26/d29/c66 0 2023-10-18T20:58:27.918 INFO:tasks.workunit.client.1.smithi060.stdout:1/425: dwrite d4/da/f53 [0,4194304] 0 2023-10-18T20:58:27.918 INFO:tasks.workunit.client.1.smithi060.stdout:6/300: dwrite fd [0,4194304] 0 2023-10-18T20:58:27.919 INFO:tasks.workunit.client.1.smithi060.stdout:9/306: dwrite d3/d10/d1c/d5a/d5d/d2b/f35 [0,4194304] 0 2023-10-18T20:58:27.919 INFO:tasks.workunit.client.1.smithi060.stdout:6/301: read d10/d1b/f61 [70484,78386] 0 2023-10-18T20:58:27.924 INFO:tasks.workunit.client.0.smithi008.stdout:9/338: unlink d2/dc/d17/d19/d42/d59/c5e 0 2023-10-18T20:58:27.924 INFO:tasks.workunit.client.0.smithi008.stdout:9/339: chown d2/d8/l4f 2270 1 2023-10-18T20:58:27.931 INFO:tasks.workunit.client.1.smithi060.stdout:0/351: symlink d3/d8/d3c/l6e 0 2023-10-18T20:58:27.931 INFO:tasks.workunit.client.1.smithi060.stdout:0/352: chown d3/l15 0 1 2023-10-18T20:58:27.933 INFO:tasks.workunit.client.0.smithi008.stdout:1/456: mkdir d9/de/df/d17/d1e/d7d/d89 0 2023-10-18T20:58:27.936 INFO:tasks.workunit.client.1.smithi060.stdout:5/385: symlink d0/d6/d9/l94 0 2023-10-18T20:58:27.936 INFO:tasks.workunit.client.1.smithi060.stdout:5/386: read d0/d6/f1e [3418906,28816] 0 2023-10-18T20:58:27.937 INFO:tasks.workunit.client.0.smithi008.stdout:9/340: dread d2/dc/d1a/d1d/f37 [4194304,4194304] 0 2023-10-18T20:58:27.937 INFO:tasks.workunit.client.0.smithi008.stdout:9/341: chown d2/dc/d17/c1f 26298 1 2023-10-18T20:58:27.941 INFO:tasks.workunit.client.1.smithi060.stdout:0/353: write d3/d8/f9 [3307643,14590] 0 2023-10-18T20:58:27.942 INFO:tasks.workunit.client.1.smithi060.stdout:0/354: creat d3/d8/d14/d49/f6f x:0 0 0 2023-10-18T20:58:27.942 INFO:tasks.workunit.client.1.smithi060.stdout:7/341: rename de/d14/d41/d58/d5b/f5e to de/f6f 0 2023-10-18T20:58:27.942 INFO:tasks.workunit.client.1.smithi060.stdout:7/342: fsync de/d14/d49/d68/f24 0 2023-10-18T20:58:27.950 INFO:tasks.workunit.client.0.smithi008.stdout:1/457: write d9/de/df/d17/d25/f3d [336978,6427] 0 2023-10-18T20:58:27.950 INFO:tasks.workunit.client.0.smithi008.stdout:1/458: write d9/de/df/d17/d25/f32 [5068297,22598] 0 2023-10-18T20:58:27.951 INFO:tasks.workunit.client.0.smithi008.stdout:1/459: fsync d9/f51 0 2023-10-18T20:58:27.956 INFO:tasks.workunit.client.0.smithi008.stdout:7/351: mknod d1/d36/d3b/d4f/c74 0 2023-10-18T20:58:27.959 INFO:tasks.workunit.client.0.smithi008.stdout:2/343: creat d1/d3/dd/d1c/d3a/d45/f75 x:0 0 0 2023-10-18T20:58:27.960 INFO:tasks.workunit.client.0.smithi008.stdout:2/344: write d1/d3/dd/d25/d4d/f68 [887408,70961] 0 2023-10-18T20:58:27.960 INFO:tasks.workunit.client.0.smithi008.stdout:6/345: dwrite df/d15/d27/f52 [0,4194304] 0 2023-10-18T20:58:27.962 INFO:tasks.workunit.client.1.smithi060.stdout:8/306: truncate d4/f47 814330 0 2023-10-18T20:58:27.962 INFO:tasks.workunit.client.1.smithi060.stdout:8/307: chown d4/d9/d37/d4e/f59 516301 1 2023-10-18T20:58:27.969 INFO:tasks.workunit.client.0.smithi008.stdout:5/340: rename d0/de/d7a/d31/d3f/l51 to d0/d2/d19/l7b 0 2023-10-18T20:58:27.970 INFO:tasks.workunit.client.0.smithi008.stdout:4/322: symlink d0/d3/d21/l70 0 2023-10-18T20:58:27.971 INFO:tasks.workunit.client.1.smithi060.stdout:1/426: mknod d4/d6/d7/d2f/d7b/d2a/c8c 0 2023-10-18T20:58:27.972 INFO:tasks.workunit.client.0.smithi008.stdout:0/294: mkdir d0/dd/d19/d5f 0 2023-10-18T20:58:27.975 INFO:tasks.workunit.client.1.smithi060.stdout:7/343: dwrite de/d29/f37 [0,4194304] 0 2023-10-18T20:58:27.980 INFO:tasks.workunit.client.1.smithi060.stdout:6/302: creat d10/d17/d2f/f64 x:0 0 0 2023-10-18T20:58:27.980 INFO:tasks.workunit.client.1.smithi060.stdout:6/303: write d10/d1b/f2b [566169,107828] 0 2023-10-18T20:58:27.980 INFO:tasks.workunit.client.1.smithi060.stdout:6/304: write d10/d2e/f33 [1010483,10766] 0 2023-10-18T20:58:27.981 INFO:tasks.workunit.client.1.smithi060.stdout:2/329: getdents d0/d3/d27 0 2023-10-18T20:58:27.982 INFO:tasks.workunit.client.1.smithi060.stdout:2/330: chown d0/d3/f5a 49 1 2023-10-18T20:58:27.982 INFO:tasks.workunit.client.1.smithi060.stdout:2/331: chown d0/d16/f28 21417 1 2023-10-18T20:58:27.982 INFO:tasks.workunit.client.1.smithi060.stdout:7/344: dread de/f17 [0,4194304] 0 2023-10-18T20:58:27.982 INFO:tasks.workunit.client.1.smithi060.stdout:7/345: truncate de/d29/f31 4326934 0 2023-10-18T20:58:27.982 INFO:tasks.workunit.client.1.smithi060.stdout:7/346: read de/f1f [2957740,23179] 0 2023-10-18T20:58:27.983 INFO:tasks.workunit.client.1.smithi060.stdout:5/387: creat d0/d6/d8/df/d27/f95 x:0 0 0 2023-10-18T20:58:27.990 INFO:tasks.workunit.client.1.smithi060.stdout:0/355: rename d3/c4 to d3/c70 0 2023-10-18T20:58:27.991 INFO:tasks.workunit.client.1.smithi060.stdout:0/356: getdents d3/d8/d14/d55 0 2023-10-18T20:58:27.995 INFO:tasks.workunit.client.1.smithi060.stdout:4/300: rename d4/dc/d2a/l47 to d4/dc/d2a/d13/d27/l57 0 2023-10-18T20:58:27.995 INFO:tasks.workunit.client.1.smithi060.stdout:4/301: write d4/dc/d2a/f7 [1182600,56719] 0 2023-10-18T20:58:27.995 INFO:tasks.workunit.client.1.smithi060.stdout:4/302: readlink d4/d15/d2b/l2e 0 2023-10-18T20:58:27.996 INFO:tasks.workunit.client.1.smithi060.stdout:4/303: chown d4/dc/d2a/d1d/l4d 0 1 2023-10-18T20:58:27.996 INFO:tasks.workunit.client.1.smithi060.stdout:4/304: write d4/f10 [7309680,91798] 0 2023-10-18T20:58:27.996 INFO:tasks.workunit.client.1.smithi060.stdout:4/305: dread - d4/dc/f22 zero size 2023-10-18T20:58:27.997 INFO:tasks.workunit.client.1.smithi060.stdout:8/308: symlink d4/d9/d37/l5b 0 2023-10-18T20:58:27.997 INFO:tasks.workunit.client.1.smithi060.stdout:8/309: chown d4/d9/d37/f38 4 1 2023-10-18T20:58:27.997 INFO:tasks.workunit.client.1.smithi060.stdout:8/310: chown d4/d9/d31 120432 1 2023-10-18T20:58:27.998 INFO:tasks.workunit.client.1.smithi060.stdout:5/388: write d0/d6/d8/df/d27/d32/d6d/d72/f40 [2202622,91527] 0 2023-10-18T20:58:27.999 INFO:tasks.workunit.client.1.smithi060.stdout:5/389: fsync d0/d6/f6a 0 2023-10-18T20:58:27.999 INFO:tasks.workunit.client.1.smithi060.stdout:5/390: dread - d0/d47/f8d zero size 2023-10-18T20:58:27.999 INFO:tasks.workunit.client.1.smithi060.stdout:1/427: link d4/d6/d7/d2f/d7b/l34 d4/da/l8d 0 2023-10-18T20:58:28.002 INFO:tasks.workunit.client.1.smithi060.stdout:9/307: getdents d3/d10/d1c/d25 0 2023-10-18T20:58:28.007 INFO:tasks.workunit.client.0.smithi008.stdout:3/283: symlink d0/d3/l58 0 2023-10-18T20:58:28.009 INFO:tasks.workunit.client.1.smithi060.stdout:2/332: link d0/d16/f1a d0/d3/d27/d4d/d5e/f5f 0 2023-10-18T20:58:28.009 INFO:tasks.workunit.client.1.smithi060.stdout:1/428: dread d4/d6/d7/df/d59/f6f [0,4194304] 0 2023-10-18T20:58:28.009 INFO:tasks.workunit.client.1.smithi060.stdout:0/357: creat d3/f71 x:0 0 0 2023-10-18T20:58:28.009 INFO:tasks.workunit.client.1.smithi060.stdout:3/292: rename d0/d3c/d3d/f39 to d0/d5e/f67 0 2023-10-18T20:58:28.009 INFO:tasks.workunit.client.1.smithi060.stdout:3/293: fdatasync d0/d22/d26/d2c/f62 0 2023-10-18T20:58:28.010 INFO:tasks.workunit.client.1.smithi060.stdout:3/294: chown d0/d22/d26/d2b 0 1 2023-10-18T20:58:28.010 INFO:tasks.workunit.client.1.smithi060.stdout:4/306: creat d4/dc/f58 x:0 0 0 2023-10-18T20:58:28.012 INFO:tasks.workunit.client.1.smithi060.stdout:8/311: link d4/d9/d37/l39 d4/d9/d37/d4e/l5c 0 2023-10-18T20:58:28.015 INFO:tasks.workunit.client.0.smithi008.stdout:7/352: creat d1/d36/d3d/d3e/d59/d73/f75 x:0 0 0 2023-10-18T20:58:28.016 INFO:tasks.workunit.client.1.smithi060.stdout:5/391: mkdir d0/d6/d9/d82/d96 0 2023-10-18T20:58:28.017 INFO:tasks.workunit.client.0.smithi008.stdout:6/346: rmdir df/d3c/d77 39 2023-10-18T20:58:28.017 INFO:tasks.workunit.client.0.smithi008.stdout:6/347: read df/d15/f40 [293190,80588] 0 2023-10-18T20:58:28.018 INFO:tasks.workunit.client.1.smithi060.stdout:7/347: dwrite de/d14/d49/f63 [0,4194304] 0 2023-10-18T20:58:28.018 INFO:tasks.workunit.client.1.smithi060.stdout:7/348: dread - de/d14/d41/f6a zero size 2023-10-18T20:58:28.019 INFO:tasks.workunit.client.1.smithi060.stdout:0/358: dread d3/f1a [0,4194304] 0 2023-10-18T20:58:28.021 INFO:tasks.workunit.client.1.smithi060.stdout:1/429: rename d4/d6/d14/d41/f55 to d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f8e 0 2023-10-18T20:58:28.022 INFO:tasks.workunit.client.0.smithi008.stdout:4/323: rmdir d0/d3/d21/d42 39 2023-10-18T20:58:28.022 INFO:tasks.workunit.client.0.smithi008.stdout:4/324: readlink d0/d17/d5b/d2a/l3f 0 2023-10-18T20:58:28.023 INFO:tasks.workunit.client.0.smithi008.stdout:4/325: truncate d0/f12 13418339 0 2023-10-18T20:58:28.023 INFO:tasks.workunit.client.0.smithi008.stdout:4/326: fdatasync d0/d17/d5b/fa 0 2023-10-18T20:58:28.024 INFO:tasks.workunit.client.0.smithi008.stdout:5/341: rename d0/de/d7a to d0/d2/d19/d7c 0 2023-10-18T20:58:28.024 INFO:tasks.workunit.client.0.smithi008.stdout:5/342: dread - d0/d2/d19/d7c/d31/f78 zero size 2023-10-18T20:58:28.024 INFO:tasks.workunit.client.0.smithi008.stdout:5/343: fsync d0/d2/d19/d7c/d31/f55 0 2023-10-18T20:58:28.025 INFO:tasks.workunit.client.1.smithi060.stdout:3/295: link d0/d22/c63 d0/d22/d26/d29/c68 0 2023-10-18T20:58:28.025 INFO:tasks.workunit.client.1.smithi060.stdout:3/296: creat d0/d22/f69 x:0 0 0 2023-10-18T20:58:28.025 INFO:tasks.workunit.client.1.smithi060.stdout:3/297: chown d0/d22/d26/d2c 0 1 2023-10-18T20:58:28.030 INFO:tasks.workunit.client.1.smithi060.stdout:6/305: dwrite f7 [0,4194304] 0 2023-10-18T20:58:28.034 INFO:tasks.workunit.client.0.smithi008.stdout:0/295: rmdir d0/dd 39 2023-10-18T20:58:28.034 INFO:tasks.workunit.client.0.smithi008.stdout:0/296: stat d0/dd/d19/d41/f58 0 2023-10-18T20:58:28.035 INFO:tasks.workunit.client.0.smithi008.stdout:0/297: chown d0/dd/df/f48 0 1 2023-10-18T20:58:28.035 INFO:tasks.workunit.client.0.smithi008.stdout:0/298: read d0/dd/d19/d41/f43 [355352,108735] 0 2023-10-18T20:58:28.035 INFO:tasks.workunit.client.0.smithi008.stdout:5/344: write d0/d2/d19/d7c/f2a [777627,53275] 0 2023-10-18T20:58:28.036 INFO:tasks.workunit.client.1.smithi060.stdout:0/359: write d3/d8/d3c/f42 [1680272,99567] 0 2023-10-18T20:58:28.037 INFO:tasks.workunit.client.0.smithi008.stdout:7/353: mknod d1/d36/d3d/d3e/c76 0 2023-10-18T20:58:28.039 INFO:tasks.workunit.client.1.smithi060.stdout:4/307: link d4/dc/d2a/f1e d4/d15/d2b/f59 0 2023-10-18T20:58:28.039 INFO:tasks.workunit.client.1.smithi060.stdout:6/306: write d10/f35 [132484,60917] 0 2023-10-18T20:58:28.039 INFO:tasks.workunit.client.1.smithi060.stdout:6/307: creat d10/d25/f65 x:0 0 0 2023-10-18T20:58:28.040 INFO:tasks.workunit.client.1.smithi060.stdout:6/308: dread - d10/d25/d3c/f62 zero size 2023-10-18T20:58:28.040 INFO:tasks.workunit.client.1.smithi060.stdout:6/309: fsync d10/f19 0 2023-10-18T20:58:28.040 INFO:tasks.workunit.client.1.smithi060.stdout:8/312: creat d4/d9/d4f/f5d x:0 0 0 2023-10-18T20:58:28.041 INFO:tasks.workunit.client.1.smithi060.stdout:8/313: fsync d4/d9/d31/f40 0 2023-10-18T20:58:28.050 INFO:tasks.workunit.client.1.smithi060.stdout:1/430: rename d4/d6/d7/d2f/d7b/d2a/d32/dd/f3f to d4/d6/f8f 0 2023-10-18T20:58:28.050 INFO:tasks.workunit.client.1.smithi060.stdout:1/431: dread - d4/d6/d7/d2f/f70 zero size 2023-10-18T20:58:28.050 INFO:tasks.workunit.client.1.smithi060.stdout:1/432: write d4/da/d42/f57 [416462,111248] 0 2023-10-18T20:58:28.051 INFO:tasks.workunit.client.1.smithi060.stdout:3/298: dread d0/d22/d50/f53 [0,4194304] 0 2023-10-18T20:58:28.053 INFO:tasks.workunit.client.0.smithi008.stdout:2/345: rename d1/d3/dd/d1c/d39 to d1/d3/dd/d25/d76 0 2023-10-18T20:58:28.054 INFO:tasks.workunit.client.0.smithi008.stdout:5/345: creat d0/d6e/f7d x:0 0 0 2023-10-18T20:58:28.054 INFO:tasks.workunit.client.0.smithi008.stdout:6/348: dread df/d19/f32 [0,4194304] 0 2023-10-18T20:58:28.054 INFO:tasks.workunit.client.0.smithi008.stdout:6/349: truncate df/d3c/d77/d50/f66 525172 0 2023-10-18T20:58:28.054 INFO:tasks.workunit.client.0.smithi008.stdout:6/350: fsync df/d15/f46 0 2023-10-18T20:58:28.061 INFO:tasks.workunit.client.1.smithi060.stdout:1/433: mknod d4/d6/d7/df/d59/c90 0 2023-10-18T20:58:28.064 INFO:tasks.workunit.client.1.smithi060.stdout:3/299: readlink d0/l4 0 2023-10-18T20:58:28.065 INFO:tasks.workunit.client.0.smithi008.stdout:0/299: rename d0/dd/df/f48 to d0/dd/d19/d5f/f60 0 2023-10-18T20:58:28.067 INFO:tasks.workunit.client.1.smithi060.stdout:1/434: creat d4/d38/d83/f91 x:0 0 0 2023-10-18T20:58:28.067 INFO:tasks.workunit.client.1.smithi060.stdout:1/435: chown d4/d6/l2e 44529720 1 2023-10-18T20:58:28.073 INFO:tasks.workunit.client.1.smithi060.stdout:3/300: write d0/f1f [285122,23226] 0 2023-10-18T20:58:28.074 INFO:tasks.workunit.client.0.smithi008.stdout:5/346: stat d0/de/c18 0 2023-10-18T20:58:28.081 INFO:tasks.workunit.client.1.smithi060.stdout:9/308: dwrite d3/d10/d1c/d25/f74 [0,4194304] 0 2023-10-18T20:58:28.082 INFO:tasks.workunit.client.1.smithi060.stdout:9/309: truncate d3/d10/d1c/d5a/d5d/f75 322990 0 2023-10-18T20:58:28.082 INFO:tasks.workunit.client.1.smithi060.stdout:9/310: fdatasync d3/d10/d1c/d25/f3e 0 2023-10-18T20:58:28.082 INFO:tasks.workunit.client.1.smithi060.stdout:9/311: readlink d3/d10/d1c/d2a/l39 0 2023-10-18T20:58:28.087 INFO:tasks.workunit.client.0.smithi008.stdout:0/300: mkdir d0/d3a/d61 0 2023-10-18T20:58:28.089 INFO:tasks.workunit.client.1.smithi060.stdout:6/310: rename d10/d1b to d10/d17/d2f/d66 0 2023-10-18T20:58:28.090 INFO:tasks.workunit.client.0.smithi008.stdout:5/347: rmdir d0/d2/d19/d7c/d41/d6f 39 2023-10-18T20:58:28.091 INFO:tasks.workunit.client.1.smithi060.stdout:9/312: dread d3/d10/d1c/f47 [0,4194304] 0 2023-10-18T20:58:28.092 INFO:tasks.workunit.client.0.smithi008.stdout:0/301: truncate d0/dd/d19/d5f/f60 265753 0 2023-10-18T20:58:28.096 INFO:tasks.workunit.client.0.smithi008.stdout:5/348: creat d0/d2/d19/d7c/d64/f7e x:0 0 0 2023-10-18T20:58:28.099 INFO:tasks.workunit.client.1.smithi060.stdout:2/333: dwrite d0/f4e [0,4194304] 0 2023-10-18T20:58:28.099 INFO:tasks.workunit.client.1.smithi060.stdout:2/334: fdatasync d0/d45/d49/f3f 0 2023-10-18T20:58:28.099 INFO:tasks.workunit.client.1.smithi060.stdout:2/335: write d0/d45/d49/f3f [752393,13751] 0 2023-10-18T20:58:28.105 INFO:tasks.workunit.client.0.smithi008.stdout:0/302: creat d0/dd/df/d20/f62 x:0 0 0 2023-10-18T20:58:28.106 INFO:tasks.workunit.client.0.smithi008.stdout:0/303: creat d0/dd/d29/f63 x:0 0 0 2023-10-18T20:58:28.106 INFO:tasks.workunit.client.0.smithi008.stdout:0/304: read d0/f3 [1204397,86617] 0 2023-10-18T20:58:28.107 INFO:tasks.workunit.client.0.smithi008.stdout:0/305: write d0/dd/d19/d41/f58 [926233,117260] 0 2023-10-18T20:58:28.107 INFO:tasks.workunit.client.1.smithi060.stdout:6/311: mknod d10/c67 0 2023-10-18T20:58:28.108 INFO:tasks.workunit.client.1.smithi060.stdout:8/314: rename d4/d57 to d4/d9/d37/d4e/d5e 0 2023-10-18T20:58:28.108 INFO:tasks.workunit.client.1.smithi060.stdout:6/312: dread - d10/d17/d28/f26 zero size 2023-10-18T20:58:28.108 INFO:tasks.workunit.client.1.smithi060.stdout:8/315: truncate d4/d9/d31/d35/f4a 352445 0 2023-10-18T20:58:28.108 INFO:tasks.workunit.client.1.smithi060.stdout:3/301: dread d0/d22/f33 [0,4194304] 0 2023-10-18T20:58:28.111 INFO:tasks.workunit.client.1.smithi060.stdout:6/313: write d10/f35 [1205390,114682] 0 2023-10-18T20:58:28.112 INFO:tasks.workunit.client.0.smithi008.stdout:4/327: dwrite d0/f14 [0,4194304] 0 2023-10-18T20:58:28.112 INFO:tasks.workunit.client.0.smithi008.stdout:4/328: chown d0/d3/c36 746 1 2023-10-18T20:58:28.112 INFO:tasks.workunit.client.0.smithi008.stdout:6/351: dwrite df/d15/d27/f63 [0,4194304] 0 2023-10-18T20:58:28.114 INFO:tasks.workunit.client.0.smithi008.stdout:0/306: mknod d0/dd/df/d2a/c64 0 2023-10-18T20:58:28.118 INFO:tasks.workunit.client.1.smithi060.stdout:2/336: creat d0/d43/d4a/f60 x:0 0 0 2023-10-18T20:58:28.119 INFO:tasks.workunit.client.0.smithi008.stdout:7/354: dwrite d1/d3/d20/f47 [0,4194304] 0 2023-10-18T20:58:28.123 INFO:tasks.workunit.client.0.smithi008.stdout:2/346: dwrite d1/f5a [0,4194304] 0 2023-10-18T20:58:28.124 INFO:tasks.workunit.client.1.smithi060.stdout:0/360: dwrite d3/d8/d14/d49/f47 [0,4194304] 0 2023-10-18T20:58:28.126 INFO:tasks.workunit.client.1.smithi060.stdout:2/337: dread d0/d3/d27/d4d/d5e/f5f [0,4194304] 0 2023-10-18T20:58:28.126 INFO:tasks.workunit.client.1.smithi060.stdout:6/314: dread d10/f35 [0,4194304] 0 2023-10-18T20:58:28.131 INFO:tasks.workunit.client.1.smithi060.stdout:1/436: rename d4/d6/l2e to d4/d6/d7/df/l92 0 2023-10-18T20:58:28.132 INFO:tasks.workunit.client.0.smithi008.stdout:0/307: creat d0/dd/d19/d41/f65 x:0 0 0 2023-10-18T20:58:28.133 INFO:tasks.workunit.client.1.smithi060.stdout:3/302: link d0/d5e/f67 d0/d3c/d3d/d4d/f6a 0 2023-10-18T20:58:28.137 INFO:tasks.workunit.client.1.smithi060.stdout:2/338: dread d0/d8/f30 [0,4194304] 0 2023-10-18T20:58:28.142 INFO:tasks.workunit.client.1.smithi060.stdout:6/315: write d10/d2e/f55 [3993208,63695] 0 2023-10-18T20:58:28.142 INFO:tasks.workunit.client.1.smithi060.stdout:6/316: creat d10/d17/d28/f68 x:0 0 0 2023-10-18T20:58:28.142 INFO:tasks.workunit.client.1.smithi060.stdout:6/317: write d10/d17/d28/f24 [485426,78604] 0 2023-10-18T20:58:28.143 INFO:tasks.workunit.client.1.smithi060.stdout:6/318: dread - d10/d17/d2f/f30 zero size 2023-10-18T20:58:28.153 INFO:tasks.workunit.client.0.smithi008.stdout:4/329: rmdir d0/d3/d48/d4c 39 2023-10-18T20:58:28.153 INFO:tasks.workunit.client.0.smithi008.stdout:2/347: creat d1/d3/d40/d6e/f77 x:0 0 0 2023-10-18T20:58:28.156 INFO:tasks.workunit.client.0.smithi008.stdout:2/348: stat d1/d3/d40/c4c 0 2023-10-18T20:58:28.156 INFO:tasks.workunit.client.0.smithi008.stdout:2/349: write d1/d3/f4b [879385,18761] 0 2023-10-18T20:58:28.156 INFO:tasks.workunit.client.0.smithi008.stdout:2/350: creat d1/d3/d40/d6e/f78 x:0 0 0 2023-10-18T20:58:28.160 INFO:tasks.workunit.client.1.smithi060.stdout:0/361: creat d3/d8/d14/d49/d68/f72 x:0 0 0 2023-10-18T20:58:28.160 INFO:tasks.workunit.client.0.smithi008.stdout:7/355: dread d1/d3/f65 [0,4194304] 0 2023-10-18T20:58:28.162 INFO:tasks.workunit.client.1.smithi060.stdout:1/437: rename d4/d6/f8f to d4/d6/d7/d2f/d7b/d2a/d32/f93 0 2023-10-18T20:58:28.164 INFO:tasks.workunit.client.0.smithi008.stdout:7/356: creat d1/d36/d3b/f77 x:0 0 0 2023-10-18T20:58:28.164 INFO:tasks.workunit.client.0.smithi008.stdout:7/357: read - d1/d36/d3d/f5a zero size 2023-10-18T20:58:28.166 INFO:tasks.workunit.client.0.smithi008.stdout:2/351: mkdir d1/d3/d79 0 2023-10-18T20:58:28.167 INFO:tasks.workunit.client.1.smithi060.stdout:3/303: mknod d0/d22/d26/c6b 0 2023-10-18T20:58:28.172 INFO:tasks.workunit.client.0.smithi008.stdout:2/352: symlink d1/d3/l7a 0 2023-10-18T20:58:28.173 INFO:tasks.workunit.client.0.smithi008.stdout:2/353: rename d1/d3/dd/d25/d34 to d1/d3/dd/d25/d34/d7b 22 2023-10-18T20:58:28.178 INFO:tasks.workunit.client.1.smithi060.stdout:2/339: rename d0/d16/c2f to d0/d3/c61 0 2023-10-18T20:58:28.185 INFO:tasks.workunit.client.1.smithi060.stdout:1/438: symlink d4/d6/d7/d2f/d7b/d2a/l94 0 2023-10-18T20:58:28.186 INFO:tasks.workunit.client.1.smithi060.stdout:1/439: fsync d4/f2d 0 2023-10-18T20:58:28.192 INFO:tasks.workunit.client.1.smithi060.stdout:6/319: dwrite d10/d2e/f50 [0,4194304] 0 2023-10-18T20:58:28.193 INFO:tasks.workunit.client.1.smithi060.stdout:6/320: write d10/d2e/f4e [1914192,52278] 0 2023-10-18T20:58:28.193 INFO:tasks.workunit.client.0.smithi008.stdout:4/330: dwrite d0/d3/d21/f3b [0,4194304] 0 2023-10-18T20:58:28.196 INFO:tasks.workunit.client.0.smithi008.stdout:6/352: dwrite df/d19/f3e [4194304,4194304] 0 2023-10-18T20:58:28.207 INFO:tasks.workunit.client.0.smithi008.stdout:2/354: dread d1/d3/dd/d25/f47 [0,4194304] 0 2023-10-18T20:58:28.207 INFO:tasks.workunit.client.0.smithi008.stdout:6/353: getdents df/d3c 0 2023-10-18T20:58:28.211 INFO:tasks.workunit.client.1.smithi060.stdout:6/321: rmdir d10/d2e/d59 0 2023-10-18T20:58:28.211 INFO:tasks.workunit.client.0.smithi008.stdout:2/355: rmdir d1 39 2023-10-18T20:58:28.211 INFO:tasks.workunit.client.0.smithi008.stdout:2/356: write d1/d3/dd/d1c/f2d [768063,13504] 0 2023-10-18T20:58:28.212 INFO:tasks.workunit.client.0.smithi008.stdout:2/357: getdents d1/d3/d79 0 2023-10-18T20:58:28.212 INFO:tasks.workunit.client.0.smithi008.stdout:4/331: write d0/d3/d21/f24 [3621894,45881] 0 2023-10-18T20:58:28.214 INFO:tasks.workunit.client.1.smithi060.stdout:0/362: dwrite d3/d8/f28 [0,4194304] 0 2023-10-18T20:58:28.214 INFO:tasks.workunit.client.1.smithi060.stdout:0/363: chown d3/d8/l29 1 1 2023-10-18T20:58:28.214 INFO:tasks.workunit.client.1.smithi060.stdout:0/364: write d3/f71 [403683,55810] 0 2023-10-18T20:58:28.215 INFO:tasks.workunit.client.1.smithi060.stdout:3/304: rmdir d0 39 2023-10-18T20:58:28.217 INFO:tasks.workunit.client.1.smithi060.stdout:7/349: sync 2023-10-18T20:58:28.217 INFO:tasks.workunit.client.1.smithi060.stdout:4/308: sync 2023-10-18T20:58:28.218 INFO:tasks.workunit.client.1.smithi060.stdout:8/316: sync 2023-10-18T20:58:28.219 INFO:tasks.workunit.client.1.smithi060.stdout:9/313: sync 2023-10-18T20:58:28.220 INFO:tasks.workunit.client.1.smithi060.stdout:5/392: sync 2023-10-18T20:58:28.222 INFO:tasks.workunit.client.0.smithi008.stdout:6/354: truncate df/f2e 405814 0 2023-10-18T20:58:28.222 INFO:tasks.workunit.client.0.smithi008.stdout:6/355: readlink df/d18/l25 0 2023-10-18T20:58:28.222 INFO:tasks.workunit.client.0.smithi008.stdout:6/356: write df/d15/f40 [1930275,4814] 0 2023-10-18T20:58:28.223 INFO:tasks.workunit.client.0.smithi008.stdout:7/358: dwrite d1/d36/d3b/d4f/f5e [0,4194304] 0 2023-10-18T20:58:28.224 INFO:tasks.workunit.client.0.smithi008.stdout:7/359: chown d1/d36/d3d/f5a 6414747 1 2023-10-18T20:58:28.228 INFO:tasks.workunit.client.1.smithi060.stdout:8/317: dread d4/f1f [0,4194304] 0 2023-10-18T20:58:28.230 INFO:tasks.workunit.client.1.smithi060.stdout:8/318: write d4/f1f [2109206,43695] 0 2023-10-18T20:58:28.234 INFO:tasks.workunit.client.1.smithi060.stdout:1/440: dwrite d4/d6/f1f [0,4194304] 0 2023-10-18T20:58:28.234 INFO:tasks.workunit.client.1.smithi060.stdout:1/441: dread - d4/d6/d7/df/d59/f82 zero size 2023-10-18T20:58:28.235 INFO:tasks.workunit.client.1.smithi060.stdout:1/442: stat d4/d6/f22 0 2023-10-18T20:58:28.235 INFO:tasks.workunit.client.1.smithi060.stdout:1/443: write d4/d6/d33/d58/f76 [138431,95119] 0 2023-10-18T20:58:28.241 INFO:tasks.workunit.client.1.smithi060.stdout:7/350: write de/d14/d3a/f67 [1072416,35885] 0 2023-10-18T20:58:28.241 INFO:tasks.workunit.client.1.smithi060.stdout:7/351: dread - de/f6c zero size 2023-10-18T20:58:28.241 INFO:tasks.workunit.client.1.smithi060.stdout:7/352: readlink de/d14/d3a/l50 0 2023-10-18T20:58:28.242 INFO:tasks.workunit.client.1.smithi060.stdout:7/353: chown de/d14/d2f/d3f/d5a/d5f 0 1 2023-10-18T20:58:28.242 INFO:tasks.workunit.client.1.smithi060.stdout:7/354: write de/d14/d41/d58/d5b/f64 [894913,71455] 0 2023-10-18T20:58:28.242 INFO:tasks.workunit.client.1.smithi060.stdout:2/340: dwrite d0/d8/f11 [4194304,4194304] 0 2023-10-18T20:58:28.273 INFO:tasks.workunit.client.1.smithi060.stdout:3/305: dwrite d0/d22/d26/d2c/f62 [0,4194304] 0 2023-10-18T20:58:28.280 INFO:tasks.workunit.client.1.smithi060.stdout:1/444: dwrite d4/d6/d7/df/f40 [0,4194304] 0 2023-10-18T20:58:28.280 INFO:tasks.workunit.client.1.smithi060.stdout:2/341: dwrite d0/d16/f1a [0,4194304] 0 2023-10-18T20:58:28.285 INFO:tasks.workunit.client.1.smithi060.stdout:3/306: write d0/f24 [6501398,79549] 0 2023-10-18T20:58:28.286 INFO:tasks.workunit.client.1.smithi060.stdout:1/445: dread d4/d6/f65 [0,4194304] 0 2023-10-18T20:58:28.286 INFO:tasks.workunit.client.1.smithi060.stdout:1/446: stat d4/d6/d7/d2f/d7b/d2a/d32/dd 0 2023-10-18T20:58:28.308 INFO:tasks.workunit.client.1.smithi060.stdout:6/322: rename cf to d10/d17/d2f/c69 0 2023-10-18T20:58:28.308 INFO:tasks.workunit.client.1.smithi060.stdout:6/323: write d10/d17/d2f/d66/f61 [851093,80580] 0 2023-10-18T20:58:28.311 INFO:tasks.workunit.client.0.smithi008.stdout:2/358: unlink d1/f64 0 2023-10-18T20:58:28.311 INFO:tasks.workunit.client.1.smithi060.stdout:0/365: symlink d3/l73 0 2023-10-18T20:58:28.313 INFO:tasks.workunit.client.1.smithi060.stdout:4/309: mknod d4/dc/d2a/d1d/c5a 0 2023-10-18T20:58:28.314 INFO:tasks.workunit.client.0.smithi008.stdout:4/332: link d0/d17/d5b/d2a/c33 d0/d3/d48/d4c/c71 0 2023-10-18T20:58:28.315 INFO:tasks.workunit.client.0.smithi008.stdout:4/333: write d0/d17/d5b/d2a/f3c [1980624,66813] 0 2023-10-18T20:58:28.315 INFO:tasks.workunit.client.0.smithi008.stdout:4/334: write d0/d3/d21/f2c [1221943,85340] 0 2023-10-18T20:58:28.316 INFO:tasks.workunit.client.1.smithi060.stdout:9/314: symlink d3/d10/d1c/d5a/l7e 0 2023-10-18T20:58:28.316 INFO:tasks.workunit.client.1.smithi060.stdout:5/393: mknod d0/d6/d8/df/d27/c97 0 2023-10-18T20:58:28.317 INFO:tasks.workunit.client.1.smithi060.stdout:8/319: symlink d4/d9/d4f/l5f 0 2023-10-18T20:58:28.322 INFO:tasks.workunit.client.0.smithi008.stdout:6/357: creat df/d15/d48/d4b/f7d x:0 0 0 2023-10-18T20:58:28.322 INFO:tasks.workunit.client.0.smithi008.stdout:7/360: mkdir d1/d3/d20/d5f/d78 0 2023-10-18T20:58:28.323 INFO:tasks.workunit.client.1.smithi060.stdout:3/307: dwrite d0/fb [4194304,4194304] 0 2023-10-18T20:58:28.324 INFO:tasks.workunit.client.1.smithi060.stdout:3/308: chown d0/d3c/d3d/f57 15115 1 2023-10-18T20:58:28.325 INFO:tasks.workunit.client.1.smithi060.stdout:7/355: rmdir de/d14/d41/d58/d65 39 2023-10-18T20:58:28.333 INFO:tasks.workunit.client.1.smithi060.stdout:7/356: dread de/f6f [0,4194304] 0 2023-10-18T20:58:28.335 INFO:tasks.workunit.client.0.smithi008.stdout:6/358: dread df/d15/d27/f28 [0,4194304] 0 2023-10-18T20:58:28.346 INFO:tasks.workunit.client.0.smithi008.stdout:2/359: symlink d1/d3/dd/d1c/l7c 0 2023-10-18T20:58:28.348 INFO:tasks.workunit.client.1.smithi060.stdout:2/342: mkdir d0/d3/d27/d62 0 2023-10-18T20:58:28.348 INFO:tasks.workunit.client.1.smithi060.stdout:2/343: write d0/d8/f3d [1942307,120330] 0 2023-10-18T20:58:28.348 INFO:tasks.workunit.client.1.smithi060.stdout:2/344: read - d0/d3/d27/f4c zero size 2023-10-18T20:58:28.349 INFO:tasks.workunit.client.1.smithi060.stdout:1/447: rename d4/d6/d7/df/d59/c84 to d4/d38/c95 0 2023-10-18T20:58:28.350 INFO:tasks.workunit.client.0.smithi008.stdout:6/359: mkdir df/d18/d7e 0 2023-10-18T20:58:28.353 INFO:tasks.workunit.client.1.smithi060.stdout:6/324: mknod d10/d47/c6a 0 2023-10-18T20:58:28.353 INFO:tasks.workunit.client.1.smithi060.stdout:6/325: truncate d10/d17/f4b 132000 0 2023-10-18T20:58:28.357 INFO:tasks.workunit.client.1.smithi060.stdout:0/366: mkdir d3/d8/d14/d55/d74 0 2023-10-18T20:58:28.358 INFO:tasks.workunit.client.1.smithi060.stdout:4/310: mkdir d4/dc/d2a/d5b 0 2023-10-18T20:58:28.358 INFO:tasks.workunit.client.1.smithi060.stdout:0/367: chown d3/f6c 17547651 1 2023-10-18T20:58:28.358 INFO:tasks.workunit.client.1.smithi060.stdout:4/311: write d4/dc/d2a/d13/d33/f35 [2449445,128994] 0 2023-10-18T20:58:28.360 INFO:tasks.workunit.client.1.smithi060.stdout:8/320: creat d4/d9/d37/d4e/d5e/f60 x:0 0 0 2023-10-18T20:58:28.361 INFO:tasks.workunit.client.1.smithi060.stdout:9/315: dwrite d3/d10/d19/d54/f42 [0,4194304] 0 2023-10-18T20:58:28.362 INFO:tasks.workunit.client.1.smithi060.stdout:9/316: readlink d3/d10/d1c/d5a/l7e 0 2023-10-18T20:58:28.362 INFO:tasks.workunit.client.1.smithi060.stdout:3/309: creat d0/d3c/f6c x:0 0 0 2023-10-18T20:58:28.363 INFO:tasks.workunit.client.0.smithi008.stdout:7/361: rename d1/d36/d3d/d49 to d1/d36/d3b/d79 0 2023-10-18T20:58:28.364 INFO:tasks.workunit.client.1.smithi060.stdout:7/357: truncate de/d14/d41/f53 3912974 0 2023-10-18T20:58:28.365 INFO:tasks.workunit.client.0.smithi008.stdout:8/457: sync 2023-10-18T20:58:28.370 INFO:tasks.workunit.client.1.smithi060.stdout:2/345: rename d0/d8/f3d to d0/d3/d27/d4d/f63 0 2023-10-18T20:58:28.372 INFO:tasks.workunit.client.0.smithi008.stdout:8/458: creat d5/d8/df/d9d/d4d/fb0 x:0 0 0 2023-10-18T20:58:28.373 INFO:tasks.workunit.client.0.smithi008.stdout:8/459: chown d5/d8/df/d9d/d6c/l86 85942 1 2023-10-18T20:58:28.374 INFO:tasks.workunit.client.1.smithi060.stdout:1/448: creat d4/d6/d7/d2f/d7b/d2a/d32/dd/d81/f96 x:0 0 0 2023-10-18T20:58:28.375 INFO:tasks.workunit.client.1.smithi060.stdout:6/326: truncate d10/f19 96404 0 2023-10-18T20:58:28.376 INFO:tasks.workunit.client.1.smithi060.stdout:6/327: read d10/d25/f4f [344865,28653] 0 2023-10-18T20:58:28.377 INFO:tasks.workunit.client.1.smithi060.stdout:6/328: creat d10/d25/d3c/f6b x:0 0 0 2023-10-18T20:58:28.377 INFO:tasks.workunit.client.1.smithi060.stdout:6/329: fdatasync d10/d17/f4b 0 2023-10-18T20:58:28.377 INFO:tasks.workunit.client.0.smithi008.stdout:8/460: unlink d5/d8/f5a 0 2023-10-18T20:58:28.379 INFO:tasks.workunit.client.0.smithi008.stdout:7/362: dread d1/d3/d20/f47 [0,4194304] 0 2023-10-18T20:58:28.384 INFO:tasks.workunit.client.0.smithi008.stdout:8/461: mkdir d5/d8/df/d9d/d85/db1 0 2023-10-18T20:58:28.384 INFO:tasks.workunit.client.1.smithi060.stdout:5/394: getdents d0/d6/d8/df/d27/d32 0 2023-10-18T20:58:28.384 INFO:tasks.workunit.client.1.smithi060.stdout:0/368: write d3/d8/d14/d49/f36 [562643,127825] 0 2023-10-18T20:58:28.385 INFO:tasks.workunit.client.1.smithi060.stdout:8/321: creat d4/d9/d37/d4e/f61 x:0 0 0 2023-10-18T20:58:28.385 INFO:tasks.workunit.client.1.smithi060.stdout:1/449: dread d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f8e [0,4194304] 0 2023-10-18T20:58:28.385 INFO:tasks.workunit.client.1.smithi060.stdout:1/450: write d4/d6/f4e [702274,129353] 0 2023-10-18T20:58:28.385 INFO:tasks.workunit.client.1.smithi060.stdout:1/451: chown d4/d38/c68 2233864 1 2023-10-18T20:58:28.386 INFO:tasks.workunit.client.1.smithi060.stdout:7/358: dread de/d14/d3a/f56 [0,4194304] 0 2023-10-18T20:58:28.386 INFO:tasks.workunit.client.1.smithi060.stdout:7/359: readlink de/d14/d49/l54 0 2023-10-18T20:58:28.387 INFO:tasks.workunit.client.1.smithi060.stdout:9/317: creat d3/d10/d1c/d5a/d5d/d7d/f7f x:0 0 0 2023-10-18T20:58:28.395 INFO:tasks.workunit.client.0.smithi008.stdout:8/462: mknod d5/d8/cb2 0 2023-10-18T20:58:28.396 INFO:tasks.workunit.client.0.smithi008.stdout:8/463: dread - d5/d8/df/d9d/d4d/f6d zero size 2023-10-18T20:58:28.396 INFO:tasks.workunit.client.0.smithi008.stdout:8/464: truncate d5/d8/d24/d50/d53/f99 350957 0 2023-10-18T20:58:28.402 INFO:tasks.workunit.client.1.smithi060.stdout:3/310: creat d0/d22/d26/f6d x:0 0 0 2023-10-18T20:58:28.402 INFO:tasks.workunit.client.1.smithi060.stdout:2/346: mknod d0/d8/c64 0 2023-10-18T20:58:28.405 INFO:tasks.workunit.client.0.smithi008.stdout:7/363: read d1/d36/f60 [3952002,23461] 0 2023-10-18T20:58:28.405 INFO:tasks.workunit.client.0.smithi008.stdout:7/364: write d1/f4e [89270,83821] 0 2023-10-18T20:58:28.406 INFO:tasks.workunit.client.0.smithi008.stdout:7/365: stat d1/d36/d3d/d3e/c46 0 2023-10-18T20:58:28.406 INFO:tasks.workunit.client.0.smithi008.stdout:7/366: chown d1/d3/l24 488474126 1 2023-10-18T20:58:28.406 INFO:tasks.workunit.client.0.smithi008.stdout:4/335: dwrite d0/f13 [0,4194304] 0 2023-10-18T20:58:28.408 INFO:tasks.workunit.client.0.smithi008.stdout:7/367: truncate d1/d3/d20/f2f 1793944 0 2023-10-18T20:58:28.409 INFO:tasks.workunit.client.1.smithi060.stdout:8/322: symlink d4/d9/l62 0 2023-10-18T20:58:28.409 INFO:tasks.workunit.client.1.smithi060.stdout:1/452: creat d4/d6/d7/d35/f97 x:0 0 0 2023-10-18T20:58:28.410 INFO:tasks.workunit.client.1.smithi060.stdout:7/360: creat de/d38/f70 x:0 0 0 2023-10-18T20:58:28.413 INFO:tasks.workunit.client.1.smithi060.stdout:9/318: mkdir d3/d10/d1c/d2a/d80 0 2023-10-18T20:58:28.414 INFO:tasks.workunit.client.1.smithi060.stdout:9/319: chown d3/d10/d1c 3532 1 2023-10-18T20:58:28.414 INFO:tasks.workunit.client.1.smithi060.stdout:9/320: chown d3/d10/f18 32 1 2023-10-18T20:58:28.414 INFO:tasks.workunit.client.1.smithi060.stdout:6/330: dread d10/d2e/f4e [0,4194304] 0 2023-10-18T20:58:28.417 INFO:tasks.workunit.client.0.smithi008.stdout:4/336: link d0/d17/d5b/f65 d0/d3/d48/f72 0 2023-10-18T20:58:28.418 INFO:tasks.workunit.client.0.smithi008.stdout:7/368: symlink d1/d36/d3b/l7a 0 2023-10-18T20:58:28.419 INFO:tasks.workunit.client.0.smithi008.stdout:8/465: read d5/d8/df/d54/f83 [3802804,55233] 0 2023-10-18T20:58:28.420 INFO:tasks.workunit.client.1.smithi060.stdout:3/311: symlink d0/d3c/d3d/l6e 0 2023-10-18T20:58:28.421 INFO:tasks.workunit.client.1.smithi060.stdout:2/347: link d0/d45/d49/f3f d0/f65 0 2023-10-18T20:58:28.422 INFO:tasks.workunit.client.0.smithi008.stdout:4/337: mkdir d0/d3/d48/d73 0 2023-10-18T20:58:28.422 INFO:tasks.workunit.client.0.smithi008.stdout:4/338: fdatasync d0/d17/f31 0 2023-10-18T20:58:28.429 INFO:tasks.workunit.client.1.smithi060.stdout:8/323: unlink d4/d9/d31/d35/f4a 0 2023-10-18T20:58:28.430 INFO:tasks.workunit.client.0.smithi008.stdout:8/466: mknod d5/d8/d24/cb3 0 2023-10-18T20:58:28.430 INFO:tasks.workunit.client.0.smithi008.stdout:8/467: truncate d5/d8/d24/d77/f88 333327 0 2023-10-18T20:58:28.430 INFO:tasks.workunit.client.1.smithi060.stdout:4/312: dwrite d4/dc/f58 [0,4194304] 0 2023-10-18T20:58:28.432 INFO:tasks.workunit.client.0.smithi008.stdout:2/360: dwrite d1/d3/dd/f58 [0,4194304] 0 2023-10-18T20:58:28.432 INFO:tasks.workunit.client.0.smithi008.stdout:2/361: truncate d1/d3/dd/d1c/f74 414395 0 2023-10-18T20:58:28.433 INFO:tasks.workunit.client.1.smithi060.stdout:4/313: write d4/dc/d2a/d2d/f4f [407684,83733] 0 2023-10-18T20:58:28.433 INFO:tasks.workunit.client.1.smithi060.stdout:6/331: link fd d10/d2e/f6c 0 2023-10-18T20:58:28.434 INFO:tasks.workunit.client.1.smithi060.stdout:6/332: dread - d10/d17/d28/f68 zero size 2023-10-18T20:58:28.434 INFO:tasks.workunit.client.0.smithi008.stdout:2/362: fsync d1/d3/dd/f38 0 2023-10-18T20:58:28.435 INFO:tasks.workunit.client.1.smithi060.stdout:7/361: dread de/d14/d49/d68/f21 [0,4194304] 0 2023-10-18T20:58:28.437 INFO:tasks.workunit.client.0.smithi008.stdout:4/339: mkdir d0/d74 0 2023-10-18T20:58:28.437 INFO:tasks.workunit.client.0.smithi008.stdout:4/340: dread - d0/d17/f31 zero size 2023-10-18T20:58:28.438 INFO:tasks.workunit.client.0.smithi008.stdout:4/341: chown d0/d17/d6e 36 1 2023-10-18T20:58:28.438 INFO:tasks.workunit.client.1.smithi060.stdout:2/348: dread d0/d8/f42 [0,4194304] 0 2023-10-18T20:58:28.439 INFO:tasks.workunit.client.0.smithi008.stdout:8/468: mkdir d5/d8/d24/d50/d53/d8c/db4 0 2023-10-18T20:58:28.439 INFO:tasks.workunit.client.1.smithi060.stdout:3/312: stat d0/c10 0 2023-10-18T20:58:28.440 INFO:tasks.workunit.client.1.smithi060.stdout:5/395: dwrite d0/d6/d9/d82/f90 [0,4194304] 0 2023-10-18T20:58:28.446 INFO:tasks.workunit.client.0.smithi008.stdout:7/369: dread d1/d36/f60 [4194304,4194304] 0 2023-10-18T20:58:28.446 INFO:tasks.workunit.client.0.smithi008.stdout:7/370: write d1/d36/d3b/f6f [683363,78] 0 2023-10-18T20:58:28.447 INFO:tasks.workunit.client.0.smithi008.stdout:7/371: fsync d1/d3/d20/d5f/f72 0 2023-10-18T20:58:28.455 INFO:tasks.workunit.client.1.smithi060.stdout:8/324: unlink d4/f2d 0 2023-10-18T20:58:28.457 INFO:tasks.workunit.client.0.smithi008.stdout:2/363: rmdir d1/d3/dd/d1c/d3a 39 2023-10-18T20:58:28.457 INFO:tasks.workunit.client.0.smithi008.stdout:2/364: write d1/d3/dd/d25/d34/f46 [1793888,100383] 0 2023-10-18T20:58:28.457 INFO:tasks.workunit.client.1.smithi060.stdout:0/369: dwrite d3/d8/f54 [0,4194304] 0 2023-10-18T20:58:28.458 INFO:tasks.workunit.client.1.smithi060.stdout:4/314: link d4/dc/d2a/d31/l3e d4/dc/d2a/d2d/l5c 0 2023-10-18T20:58:28.466 INFO:tasks.workunit.client.1.smithi060.stdout:8/325: write d4/d9/d37/f3c [2330406,114970] 0 2023-10-18T20:58:28.466 INFO:tasks.workunit.client.1.smithi060.stdout:8/326: stat d4/d9/d31/d35/f4d 0 2023-10-18T20:58:28.466 INFO:tasks.workunit.client.1.smithi060.stdout:8/327: truncate d4/d9/d4f/f5d 810642 0 2023-10-18T20:58:28.467 INFO:tasks.workunit.client.1.smithi060.stdout:8/328: creat d4/d9/d4f/f63 x:0 0 0 2023-10-18T20:58:28.467 INFO:tasks.workunit.client.1.smithi060.stdout:8/329: chown d4/d9/d37/d4e/d5e/f60 3 1 2023-10-18T20:58:28.467 INFO:tasks.workunit.client.1.smithi060.stdout:8/330: write d4/d9/d37/f3c [1597833,119673] 0 2023-10-18T20:58:28.467 INFO:tasks.workunit.client.1.smithi060.stdout:8/331: chown d4/d9/ld 429657573 1 2023-10-18T20:58:28.467 INFO:tasks.workunit.client.1.smithi060.stdout:8/332: chown d4/d9/d37/d4e/d5e/l58 1626753839 1 2023-10-18T20:58:28.471 INFO:tasks.workunit.client.0.smithi008.stdout:4/342: symlink d0/d3/l75 0 2023-10-18T20:58:28.473 INFO:tasks.workunit.client.1.smithi060.stdout:6/333: rename d10/d17/d2f/d66/l39 to d10/d25/l6d 0 2023-10-18T20:58:28.474 INFO:tasks.workunit.client.1.smithi060.stdout:6/334: write d10/d17/d2f/f30 [178864,31132] 0 2023-10-18T20:58:28.476 INFO:tasks.workunit.client.0.smithi008.stdout:7/372: mkdir d1/d36/d3d/d3e/d59/d73/d7b 0 2023-10-18T20:58:28.477 INFO:tasks.workunit.client.0.smithi008.stdout:7/373: chown d1/c16 659763 1 2023-10-18T20:58:28.477 INFO:tasks.workunit.client.0.smithi008.stdout:7/374: chown d1/f6 1073298 1 2023-10-18T20:58:28.478 INFO:tasks.workunit.client.1.smithi060.stdout:7/362: creat de/d14/d2f/f71 x:0 0 0 2023-10-18T20:58:28.479 INFO:tasks.workunit.client.1.smithi060.stdout:7/363: truncate de/d14/d2f/f71 527474 0 2023-10-18T20:58:28.479 INFO:tasks.workunit.client.0.smithi008.stdout:2/365: creat d1/d3/d79/f7d x:0 0 0 2023-10-18T20:58:28.485 INFO:tasks.workunit.client.0.smithi008.stdout:2/366: mkdir d1/d3/d40/d6e/d7e 0 2023-10-18T20:58:28.486 INFO:tasks.workunit.client.1.smithi060.stdout:2/349: symlink d0/d8/l66 0 2023-10-18T20:58:28.487 INFO:tasks.workunit.client.1.smithi060.stdout:2/350: write d0/f12 [8416003,123304] 0 2023-10-18T20:58:28.488 INFO:tasks.workunit.client.0.smithi008.stdout:8/469: rename d5/d8/df/d6f to d5/d8/df/d9d/d4d/db5 0 2023-10-18T20:58:28.494 INFO:tasks.workunit.client.0.smithi008.stdout:2/367: mknod d1/d3/dd/d25/d4d/c7f 0 2023-10-18T20:58:28.498 INFO:tasks.workunit.client.0.smithi008.stdout:7/375: rename d1/d3/c23 to d1/d36/c7c 0 2023-10-18T20:58:28.498 INFO:tasks.workunit.client.0.smithi008.stdout:7/376: chown d1/d3/d20/f66 1978733 1 2023-10-18T20:58:28.499 INFO:tasks.workunit.client.1.smithi060.stdout:0/370: creat d3/d8/d14/d49/d6b/f75 x:0 0 0 2023-10-18T20:58:28.503 INFO:tasks.workunit.client.0.smithi008.stdout:2/368: truncate d1/d3/dd/f38 3813065 0 2023-10-18T20:58:28.507 INFO:tasks.workunit.client.0.smithi008.stdout:7/377: rename d1/d3/c61 to d1/d36/d3d/d3e/c7d 0 2023-10-18T20:58:28.507 INFO:tasks.workunit.client.0.smithi008.stdout:7/378: write d1/d3/f1d [1700814,21332] 0 2023-10-18T20:58:28.507 INFO:tasks.workunit.client.0.smithi008.stdout:7/379: fsync d1/d3/f53 0 2023-10-18T20:58:28.507 INFO:tasks.workunit.client.0.smithi008.stdout:2/369: truncate d1/d3/dd/f58 1428362 0 2023-10-18T20:58:28.511 INFO:tasks.workunit.client.1.smithi060.stdout:2/351: dread d0/f5d [0,4194304] 0 2023-10-18T20:58:28.515 INFO:tasks.workunit.client.0.smithi008.stdout:2/370: creat d1/d3/dd/d1c/d3a/f80 x:0 0 0 2023-10-18T20:58:28.519 INFO:tasks.workunit.client.1.smithi060.stdout:4/315: link d4/dc/d2a/d13/d2f/f34 d4/dc/d2a/d5b/f5d 0 2023-10-18T20:58:28.519 INFO:tasks.workunit.client.1.smithi060.stdout:4/316: creat d4/dc/f5e x:0 0 0 2023-10-18T20:58:28.522 INFO:tasks.workunit.client.1.smithi060.stdout:8/333: link d4/d9/l28 d4/d9/d31/d35/l64 0 2023-10-18T20:58:28.524 INFO:tasks.workunit.client.1.smithi060.stdout:3/313: rename d0/d22/d26/d29/f44 to d0/d22/d26/d2b/f6f 0 2023-10-18T20:58:28.524 INFO:tasks.workunit.client.1.smithi060.stdout:5/396: rename d0 to d0/da/d61/d98 22 2023-10-18T20:58:28.524 INFO:tasks.workunit.client.1.smithi060.stdout:3/314: write d0/d22/d26/f43 [545818,62006] 0 2023-10-18T20:58:28.524 INFO:tasks.workunit.client.1.smithi060.stdout:3/315: chown d0/d3c/d3d/c3f 25 1 2023-10-18T20:58:28.538 INFO:tasks.workunit.client.1.smithi060.stdout:2/352: creat d0/f67 x:0 0 0 2023-10-18T20:58:28.538 INFO:tasks.workunit.client.1.smithi060.stdout:2/353: fdatasync d0/f4e 0 2023-10-18T20:58:28.539 INFO:tasks.workunit.client.1.smithi060.stdout:0/371: dread d3/d32/f38 [0,4194304] 0 2023-10-18T20:58:28.541 INFO:tasks.workunit.client.1.smithi060.stdout:4/317: mkdir d4/dc/d2a/d39/d53/d5f 0 2023-10-18T20:58:28.552 INFO:tasks.workunit.client.0.smithi008.stdout:4/343: dwrite d0/d3/f67 [0,4194304] 0 2023-10-18T20:58:28.562 INFO:tasks.workunit.client.1.smithi060.stdout:6/335: dwrite f8 [0,4194304] 0 2023-10-18T20:58:28.562 INFO:tasks.workunit.client.1.smithi060.stdout:6/336: truncate d10/d17/d2f/f64 973519 0 2023-10-18T20:58:28.562 INFO:tasks.workunit.client.1.smithi060.stdout:6/337: chown d10/d25/d3c/f6b 5355748 1 2023-10-18T20:58:28.563 INFO:tasks.workunit.client.1.smithi060.stdout:6/338: fdatasync d10/d25/f65 0 2023-10-18T20:58:28.563 INFO:tasks.workunit.client.1.smithi060.stdout:6/339: dread - d10/d25/d3c/f6b zero size 2023-10-18T20:58:28.563 INFO:tasks.workunit.client.1.smithi060.stdout:8/334: rename d4/d9/d31/f55 to d4/d9/d37/d4e/f65 0 2023-10-18T20:58:28.564 INFO:tasks.workunit.client.1.smithi060.stdout:3/316: creat d0/d22/f70 x:0 0 0 2023-10-18T20:58:28.564 INFO:tasks.workunit.client.1.smithi060.stdout:8/335: creat d4/d9/d31/f66 x:0 0 0 2023-10-18T20:58:28.564 INFO:tasks.workunit.client.1.smithi060.stdout:1/453: sync 2023-10-18T20:58:28.564 INFO:tasks.workunit.client.1.smithi060.stdout:1/454: chown d4/d6/d48/f4b 2974255 1 2023-10-18T20:58:28.565 INFO:tasks.workunit.client.1.smithi060.stdout:6/340: symlink d10/d17/l6e 0 2023-10-18T20:58:28.565 INFO:tasks.workunit.client.0.smithi008.stdout:8/470: dwrite d5/d8/df/d9d/d6c/f66 [0,4194304] 0 2023-10-18T20:58:28.566 INFO:tasks.workunit.client.0.smithi008.stdout:4/344: mkdir d0/d76 0 2023-10-18T20:58:28.566 INFO:tasks.workunit.client.1.smithi060.stdout:3/317: rmdir d0/d22/d26/d29 39 2023-10-18T20:58:28.567 INFO:tasks.workunit.client.0.smithi008.stdout:2/371: write d1/d3/dd/d1c/f3e [5621509,101018] 0 2023-10-18T20:58:28.570 INFO:tasks.workunit.client.1.smithi060.stdout:3/318: symlink d0/d3c/d3d/l71 0 2023-10-18T20:58:28.570 INFO:tasks.workunit.client.1.smithi060.stdout:6/341: mkdir d10/d6f 0 2023-10-18T20:58:28.570 INFO:tasks.workunit.client.1.smithi060.stdout:3/319: readlink d0/d3c/d3d/l6e 0 2023-10-18T20:58:28.571 INFO:tasks.workunit.client.1.smithi060.stdout:3/320: write d0/d3c/d3d/d4d/f6a [249159,39351] 0 2023-10-18T20:58:28.573 INFO:tasks.workunit.client.0.smithi008.stdout:8/471: rename d5/l7 to d5/d8/df/d9d/lb6 0 2023-10-18T20:58:28.575 INFO:tasks.workunit.client.0.smithi008.stdout:2/372: rmdir d1/d3/dd/d25/d4d 39 2023-10-18T20:58:28.576 INFO:tasks.workunit.client.0.smithi008.stdout:8/472: mkdir d5/d8/d24/d50/d53/d8c/db4/db7 0 2023-10-18T20:58:28.578 INFO:tasks.workunit.client.1.smithi060.stdout:6/342: mkdir d10/d17/d70 0 2023-10-18T20:58:28.579 INFO:tasks.workunit.client.0.smithi008.stdout:2/373: readlink d1/d3/dd/l2e 0 2023-10-18T20:58:28.579 INFO:tasks.workunit.client.0.smithi008.stdout:2/374: truncate d1/d3/dd/d1c/d3a/f80 762127 0 2023-10-18T20:58:28.579 INFO:tasks.workunit.client.0.smithi008.stdout:2/375: chown d1/d3/dd/f1e 0 1 2023-10-18T20:58:28.579 INFO:tasks.workunit.client.0.smithi008.stdout:2/376: chown d1 14066 1 2023-10-18T20:58:28.580 INFO:tasks.workunit.client.1.smithi060.stdout:8/336: dread d4/d9/f23 [0,4194304] 0 2023-10-18T20:58:28.580 INFO:tasks.workunit.client.1.smithi060.stdout:3/321: rmdir d0/d22/d26/d29 39 2023-10-18T20:58:28.581 INFO:tasks.workunit.client.0.smithi008.stdout:2/377: creat d1/d3/dd/d25/d34/f81 x:0 0 0 2023-10-18T20:58:28.582 INFO:tasks.workunit.client.0.smithi008.stdout:2/378: readlink d1/d3/dd/d1c/l7c 0 2023-10-18T20:58:28.583 INFO:tasks.workunit.client.1.smithi060.stdout:3/322: getdents d0/d22/d26/d2b 0 2023-10-18T20:58:28.585 INFO:tasks.workunit.client.0.smithi008.stdout:2/379: mknod d1/d3/dd/d1c/d3a/c82 0 2023-10-18T20:58:28.587 INFO:tasks.workunit.client.0.smithi008.stdout:2/380: mkdir d1/d3/dd/d1c/d3a/d45/d83 0 2023-10-18T20:58:28.587 INFO:tasks.workunit.client.0.smithi008.stdout:2/381: chown d1/d3/dd/d1c/d3a/d57/f67 2041 1 2023-10-18T20:58:28.590 INFO:tasks.workunit.client.0.smithi008.stdout:4/345: write d0/d17/f60 [789813,30613] 0 2023-10-18T20:58:28.591 INFO:tasks.workunit.client.0.smithi008.stdout:4/346: truncate d0/d17/f6c 991775 0 2023-10-18T20:58:28.591 INFO:tasks.workunit.client.0.smithi008.stdout:2/382: truncate d1/d3/dd/d25/f2f 1343386 0 2023-10-18T20:58:28.592 INFO:tasks.workunit.client.0.smithi008.stdout:2/383: dread - d1/d3/d40/d6e/f77 zero size 2023-10-18T20:58:28.595 INFO:tasks.workunit.client.0.smithi008.stdout:2/384: rename d1/d3/dd/d25/d34/f3b to d1/d3/dd/d1c/d3a/d45/f84 0 2023-10-18T20:58:28.596 INFO:tasks.workunit.client.1.smithi060.stdout:3/323: dread d0/f64 [0,4194304] 0 2023-10-18T20:58:28.597 INFO:tasks.workunit.client.1.smithi060.stdout:5/397: dwrite d0/da/d3b/d43/f63 [0,4194304] 0 2023-10-18T20:58:28.597 INFO:tasks.workunit.client.1.smithi060.stdout:3/324: write d0/d22/f33 [7667825,21076] 0 2023-10-18T20:58:28.597 INFO:tasks.workunit.client.1.smithi060.stdout:0/372: dwrite d3/f3b [0,4194304] 0 2023-10-18T20:58:28.600 INFO:tasks.workunit.client.1.smithi060.stdout:1/455: dread d4/d6/d7/df/f40 [0,4194304] 0 2023-10-18T20:58:28.600 INFO:tasks.workunit.client.1.smithi060.stdout:8/337: dread d4/d9/f2e [0,4194304] 0 2023-10-18T20:58:28.600 INFO:tasks.workunit.client.1.smithi060.stdout:1/456: stat d4/da/d42 0 2023-10-18T20:58:28.601 INFO:tasks.workunit.client.1.smithi060.stdout:5/398: mkdir d0/d6/d9/d82/d83/d99 0 2023-10-18T20:58:28.602 INFO:tasks.workunit.client.0.smithi008.stdout:7/380: dwrite d1/d36/d3b/f50 [0,4194304] 0 2023-10-18T20:58:28.603 INFO:tasks.workunit.client.0.smithi008.stdout:7/381: creat d1/d36/f7e x:0 0 0 2023-10-18T20:58:28.603 INFO:tasks.workunit.client.1.smithi060.stdout:3/325: creat d0/f72 x:0 0 0 2023-10-18T20:58:28.603 INFO:tasks.workunit.client.1.smithi060.stdout:2/354: dwrite d0/d16/f19 [0,4194304] 0 2023-10-18T20:58:28.604 INFO:tasks.workunit.client.0.smithi008.stdout:8/473: dread d5/d8/df/d9d/d6c/f66 [0,4194304] 0 2023-10-18T20:58:28.604 INFO:tasks.workunit.client.0.smithi008.stdout:8/474: fsync d5/d8/d24/f2c 0 2023-10-18T20:58:28.605 INFO:tasks.workunit.client.0.smithi008.stdout:8/475: creat d5/d8/df/d9d/d4d/fb8 x:0 0 0 2023-10-18T20:58:28.605 INFO:tasks.workunit.client.0.smithi008.stdout:8/476: read d5/d8/df/f23 [2229369,13536] 0 2023-10-18T20:58:28.606 INFO:tasks.workunit.client.1.smithi060.stdout:4/318: dwrite d4/dc/d2a/d2d/f4f [0,4194304] 0 2023-10-18T20:58:28.606 INFO:tasks.workunit.client.1.smithi060.stdout:6/343: dread d10/d2e/f50 [0,4194304] 0 2023-10-18T20:58:28.610 INFO:tasks.workunit.client.0.smithi008.stdout:9/342: sync 2023-10-18T20:58:28.610 INFO:tasks.workunit.client.0.smithi008.stdout:9/343: readlink d2/l6 0 2023-10-18T20:58:28.618 INFO:tasks.workunit.client.1.smithi060.stdout:9/321: sync 2023-10-18T20:58:28.632 INFO:tasks.workunit.client.1.smithi060.stdout:0/373: getdents d3/d8/d14/d55 0 2023-10-18T20:58:28.633 INFO:tasks.workunit.client.1.smithi060.stdout:7/364: sync 2023-10-18T20:58:28.639 INFO:tasks.workunit.client.1.smithi060.stdout:8/338: symlink d4/d9/d37/d4e/l67 0 2023-10-18T20:58:28.649 INFO:tasks.workunit.client.0.smithi008.stdout:4/347: dwrite d0/d17/d5b/f68 [0,4194304] 0 2023-10-18T20:58:28.649 INFO:tasks.workunit.client.0.smithi008.stdout:4/348: creat d0/d3/f77 x:0 0 0 2023-10-18T20:58:28.650 INFO:tasks.workunit.client.0.smithi008.stdout:7/382: mkdir d1/d3/d20/d5f/d7f 0 2023-10-18T20:58:28.654 INFO:tasks.workunit.client.1.smithi060.stdout:1/457: rename d4/d6/d14/d41/c43 to d4/d6/d7/d2f/d7b/d2a/c98 0 2023-10-18T20:58:28.654 INFO:tasks.workunit.client.1.smithi060.stdout:3/326: chown d0/l9 4495 1 2023-10-18T20:58:28.655 INFO:tasks.workunit.client.1.smithi060.stdout:6/344: link d10/d17/d54/f5a d10/d3e/f71 0 2023-10-18T20:58:28.656 INFO:tasks.workunit.client.1.smithi060.stdout:7/365: mkdir de/d29/d72 0 2023-10-18T20:58:28.656 INFO:tasks.workunit.client.1.smithi060.stdout:7/366: chown de/ff 111554132 1 2023-10-18T20:58:28.657 INFO:tasks.workunit.client.1.smithi060.stdout:7/367: readlink de/d14/l61 0 2023-10-18T20:58:28.660 INFO:tasks.workunit.client.0.smithi008.stdout:8/477: truncate d5/d8/d24/d77/f88 268101 0 2023-10-18T20:58:28.660 INFO:tasks.workunit.client.0.smithi008.stdout:8/478: chown d5/d8/df/d9d/d6c 5 1 2023-10-18T20:58:28.660 INFO:tasks.workunit.client.1.smithi060.stdout:4/319: dwrite d4/d15/d2b/f59 [4194304,4194304] 0 2023-10-18T20:58:28.661 INFO:tasks.workunit.client.0.smithi008.stdout:0/308: sync 2023-10-18T20:58:28.661 INFO:tasks.workunit.client.0.smithi008.stdout:0/309: creat d0/dd/d19/d24/f66 x:0 0 0 2023-10-18T20:58:28.662 INFO:tasks.workunit.client.0.smithi008.stdout:5/349: sync 2023-10-18T20:58:28.662 INFO:tasks.workunit.client.0.smithi008.stdout:3/284: sync 2023-10-18T20:58:28.663 INFO:tasks.workunit.client.1.smithi060.stdout:9/322: write d3/f1b [2041191,26570] 0 2023-10-18T20:58:28.666 INFO:tasks.workunit.client.1.smithi060.stdout:7/368: mkdir de/d14/d3a/d46/d73 0 2023-10-18T20:58:28.666 INFO:tasks.workunit.client.1.smithi060.stdout:7/369: readlink de/d14/d2f/d3f/l57 0 2023-10-18T20:58:28.667 INFO:tasks.workunit.client.1.smithi060.stdout:7/370: creat de/d14/d41/d58/d5b/f74 x:0 0 0 2023-10-18T20:58:28.668 INFO:tasks.workunit.client.1.smithi060.stdout:8/339: dread d4/ff [0,4194304] 0 2023-10-18T20:58:28.668 INFO:tasks.workunit.client.1.smithi060.stdout:8/340: chown d4/d9/d37/f38 242642 1 2023-10-18T20:58:28.670 INFO:tasks.workunit.client.0.smithi008.stdout:7/383: creat d1/d36/d3d/d3e/d59/d73/d7b/f80 x:0 0 0 2023-10-18T20:58:28.670 INFO:tasks.workunit.client.0.smithi008.stdout:4/349: mkdir d0/d17/d78 0 2023-10-18T20:58:28.670 INFO:tasks.workunit.client.0.smithi008.stdout:4/350: truncate d0/d3/d48/f72 779299 0 2023-10-18T20:58:28.674 INFO:tasks.workunit.client.1.smithi060.stdout:2/355: dwrite d0/d3/d27/d4d/d5e/f5f [0,4194304] 0 2023-10-18T20:58:28.675 INFO:tasks.workunit.client.1.smithi060.stdout:9/323: creat d3/d10/d65/f81 x:0 0 0 2023-10-18T20:58:28.677 INFO:tasks.workunit.client.1.smithi060.stdout:1/458: write d4/d6/d7/d2f/d7b/d2a/d32/dd/f30 [1805637,32469] 0 2023-10-18T20:58:28.677 INFO:tasks.workunit.client.1.smithi060.stdout:1/459: write d4/d6/f3e [640080,68549] 0 2023-10-18T20:58:28.679 INFO:tasks.workunit.client.0.smithi008.stdout:9/344: dread d2/dc/f22 [0,4194304] 0 2023-10-18T20:58:28.680 INFO:tasks.workunit.client.0.smithi008.stdout:5/350: creat d0/d2/d19/d7c/d41/d6f/f7f x:0 0 0 2023-10-18T20:58:28.684 INFO:tasks.workunit.client.0.smithi008.stdout:2/385: dwrite d1/d3/dd/f6b [0,4194304] 0 2023-10-18T20:58:28.685 INFO:tasks.workunit.client.0.smithi008.stdout:6/360: sync 2023-10-18T20:58:28.686 INFO:tasks.workunit.client.0.smithi008.stdout:6/361: read df/f35 [271721,71022] 0 2023-10-18T20:58:28.686 INFO:tasks.workunit.client.1.smithi060.stdout:9/324: symlink d3/d10/d1c/d5a/d5d/d2b/l82 0 2023-10-18T20:58:28.688 INFO:tasks.workunit.client.0.smithi008.stdout:7/384: symlink d1/d36/d3d/d3e/d59/d73/d7b/l81 0 2023-10-18T20:58:28.690 INFO:tasks.workunit.client.0.smithi008.stdout:7/385: creat d1/d3/f82 x:0 0 0 2023-10-18T20:58:28.690 INFO:tasks.workunit.client.0.smithi008.stdout:1/460: sync 2023-10-18T20:58:28.691 INFO:tasks.workunit.client.1.smithi060.stdout:1/460: rename d4/d6/f3e to d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f99 0 2023-10-18T20:58:28.692 INFO:tasks.workunit.client.0.smithi008.stdout:5/351: mkdir d0/d2/d19/d7c/d31/d80 0 2023-10-18T20:58:28.692 INFO:tasks.workunit.client.0.smithi008.stdout:5/352: read d0/d2/d19/d7c/f6b [3930849,98643] 0 2023-10-18T20:58:28.692 INFO:tasks.workunit.client.0.smithi008.stdout:5/353: chown d0/d2/d19/d7c/d31/f78 24404868 1 2023-10-18T20:58:28.693 INFO:tasks.workunit.client.1.smithi060.stdout:9/325: creat d3/d10/d1c/d2a/d33/f83 x:0 0 0 2023-10-18T20:58:28.700 INFO:tasks.workunit.client.1.smithi060.stdout:6/345: dread d10/d2e/f4e [0,4194304] 0 2023-10-18T20:58:28.702 INFO:tasks.workunit.client.1.smithi060.stdout:1/461: symlink d4/d6/d7/d2f/d7b/l9a 0 2023-10-18T20:58:28.703 INFO:tasks.workunit.client.0.smithi008.stdout:3/285: link d0/d3/f33 d0/f59 0 2023-10-18T20:58:28.704 INFO:tasks.workunit.client.0.smithi008.stdout:2/386: truncate d1/f5a 1190017 0 2023-10-18T20:58:28.705 INFO:tasks.workunit.client.0.smithi008.stdout:6/362: mknod df/d74/c7f 0 2023-10-18T20:58:28.705 INFO:tasks.workunit.client.1.smithi060.stdout:6/346: truncate d10/d17/d28/f24 3896771 0 2023-10-18T20:58:28.711 INFO:tasks.workunit.client.0.smithi008.stdout:7/386: mknod d1/c83 0 2023-10-18T20:58:28.711 INFO:tasks.workunit.client.1.smithi060.stdout:1/462: symlink d4/d6/d7/d2f/d7b/d2a/d32/d56/d5f/l9b 0 2023-10-18T20:58:28.714 INFO:tasks.workunit.client.1.smithi060.stdout:8/341: dread d4/f1f [0,4194304] 0 2023-10-18T20:58:28.714 INFO:tasks.workunit.client.1.smithi060.stdout:8/342: chown d4/d9/c4c 2 1 2023-10-18T20:58:28.714 INFO:tasks.workunit.client.1.smithi060.stdout:8/343: dread - d4/d9/d4f/f63 zero size 2023-10-18T20:58:28.715 INFO:tasks.workunit.client.1.smithi060.stdout:8/344: chown d4/d9/d31/d35/f44 2650 1 2023-10-18T20:58:28.715 INFO:tasks.workunit.client.1.smithi060.stdout:8/345: stat d4/d9/d37/d4e/l67 0 2023-10-18T20:58:28.715 INFO:tasks.workunit.client.1.smithi060.stdout:8/346: write d4/f47 [1402780,112436] 0 2023-10-18T20:58:28.716 INFO:tasks.workunit.client.0.smithi008.stdout:1/461: chown d9/de/df/d17/l40 641989 1 2023-10-18T20:58:28.716 INFO:tasks.workunit.client.0.smithi008.stdout:1/462: chown d9/de/c49 8670 1 2023-10-18T20:58:28.717 INFO:tasks.workunit.client.1.smithi060.stdout:6/347: dread d10/d2e/f4e [0,4194304] 0 2023-10-18T20:58:28.717 INFO:tasks.workunit.client.1.smithi060.stdout:6/348: creat d10/f72 x:0 0 0 2023-10-18T20:58:28.718 INFO:tasks.workunit.client.1.smithi060.stdout:6/349: dread - d10/d25/f65 zero size 2023-10-18T20:58:28.718 INFO:tasks.workunit.client.1.smithi060.stdout:6/350: dread - d10/d17/d28/f26 zero size 2023-10-18T20:58:28.720 INFO:tasks.workunit.client.0.smithi008.stdout:7/387: creat d1/d36/d3b/d4f/d5c/f84 x:0 0 0 2023-10-18T20:58:28.722 INFO:tasks.workunit.client.1.smithi060.stdout:7/371: getdents de/d14/d3a/d46 0 2023-10-18T20:58:28.722 INFO:tasks.workunit.client.1.smithi060.stdout:7/372: readlink de/d14/d41/d58/d65/l6d 0 2023-10-18T20:58:28.723 INFO:tasks.workunit.client.1.smithi060.stdout:7/373: write de/d14/f30 [551879,47223] 0 2023-10-18T20:58:28.723 INFO:tasks.workunit.client.1.smithi060.stdout:7/374: creat de/d14/d41/d58/d5b/f75 x:0 0 0 2023-10-18T20:58:28.727 INFO:tasks.workunit.client.0.smithi008.stdout:1/463: mknod d9/de/df/d17/d1e/d7d/c8a 0 2023-10-18T20:58:28.727 INFO:tasks.workunit.client.0.smithi008.stdout:1/464: write d9/de/df/f5b [1047686,23174] 0 2023-10-18T20:58:28.729 INFO:tasks.workunit.client.0.smithi008.stdout:3/286: mknod d0/d3/d37/c5a 0 2023-10-18T20:58:28.733 INFO:tasks.workunit.client.0.smithi008.stdout:5/354: write d0/f3 [3439102,49217] 0 2023-10-18T20:58:28.733 INFO:tasks.workunit.client.0.smithi008.stdout:1/465: symlink d9/de/df/l8b 0 2023-10-18T20:58:28.733 INFO:tasks.workunit.client.0.smithi008.stdout:1/466: fsync d9/de/df/d17/f70 0 2023-10-18T20:58:28.733 INFO:tasks.workunit.client.0.smithi008.stdout:1/467: write d9/f54 [2825227,111515] 0 2023-10-18T20:58:28.734 INFO:tasks.workunit.client.0.smithi008.stdout:8/479: dwrite d5/d8/df/f39 [0,4194304] 0 2023-10-18T20:58:28.735 INFO:tasks.workunit.client.0.smithi008.stdout:3/287: creat d0/d4a/f5b x:0 0 0 2023-10-18T20:58:28.735 INFO:tasks.workunit.client.0.smithi008.stdout:3/288: stat d0/d3/de/d13/l3c 0 2023-10-18T20:58:28.736 INFO:tasks.workunit.client.1.smithi060.stdout:8/347: rmdir d4/d9/d37 39 2023-10-18T20:58:28.739 INFO:tasks.workunit.client.0.smithi008.stdout:8/480: truncate d5/f37 10347408 0 2023-10-18T20:58:28.741 INFO:tasks.workunit.client.1.smithi060.stdout:2/356: dwrite d0/d16/f28 [0,4194304] 0 2023-10-18T20:58:28.742 INFO:tasks.workunit.client.0.smithi008.stdout:3/289: rename d0/d3/d37/f3e to d0/d3/d42/f5c 0 2023-10-18T20:58:28.744 INFO:tasks.workunit.client.0.smithi008.stdout:3/290: write d0/d3/f43 [809183,104688] 0 2023-10-18T20:58:28.744 INFO:tasks.workunit.client.0.smithi008.stdout:3/291: creat d0/d3/d37/f5d x:0 0 0 2023-10-18T20:58:28.750 INFO:tasks.workunit.client.0.smithi008.stdout:3/292: chown d0/d3/l4d 48454006 1 2023-10-18T20:58:28.750 INFO:tasks.workunit.client.0.smithi008.stdout:3/293: readlink d0/d3/de/l32 0 2023-10-18T20:58:28.751 INFO:tasks.workunit.client.1.smithi060.stdout:7/375: mkdir de/d14/d2f/d3f/d76 0 2023-10-18T20:58:28.751 INFO:tasks.workunit.client.1.smithi060.stdout:6/351: getdents d10/d25 0 2023-10-18T20:58:28.753 INFO:tasks.workunit.client.1.smithi060.stdout:4/320: dwrite d4/d15/d2b/f3b [0,4194304] 0 2023-10-18T20:58:28.760 INFO:tasks.workunit.client.1.smithi060.stdout:2/357: rmdir d0/d8 39 2023-10-18T20:58:28.760 INFO:tasks.workunit.client.1.smithi060.stdout:2/358: chown d0/f5d 34 1 2023-10-18T20:58:28.760 INFO:tasks.workunit.client.1.smithi060.stdout:2/359: dread - d0/d3/d27/d4d/d53/f5c zero size 2023-10-18T20:58:28.761 INFO:tasks.workunit.client.1.smithi060.stdout:7/376: rename de/d14/d3a/f67 to de/d29/f77 0 2023-10-18T20:58:28.761 INFO:tasks.workunit.client.1.smithi060.stdout:7/377: chown de/d14/d41 15394919 1 2023-10-18T20:58:28.761 INFO:tasks.workunit.client.1.smithi060.stdout:7/378: truncate de/f1a 1090752 0 2023-10-18T20:58:28.762 INFO:tasks.workunit.client.1.smithi060.stdout:7/379: dread - de/d14/d41/d58/d5b/f74 zero size 2023-10-18T20:58:28.762 INFO:tasks.workunit.client.1.smithi060.stdout:7/380: fdatasync de/f19 0 2023-10-18T20:58:28.762 INFO:tasks.workunit.client.1.smithi060.stdout:7/381: write fc [220653,25669] 0 2023-10-18T20:58:28.762 INFO:tasks.workunit.client.1.smithi060.stdout:7/382: write de/f6f [704136,128222] 0 2023-10-18T20:58:28.767 INFO:tasks.workunit.client.1.smithi060.stdout:8/348: rmdir d4/d9/d4f 39 2023-10-18T20:58:28.768 INFO:tasks.workunit.client.1.smithi060.stdout:8/349: write d4/d9/d31/d35/f4d [531065,123990] 0 2023-10-18T20:58:28.772 INFO:tasks.workunit.client.0.smithi008.stdout:4/351: dwrite d0/d17/f31 [0,4194304] 0 2023-10-18T20:58:28.772 INFO:tasks.workunit.client.0.smithi008.stdout:4/352: write d0/d3/d21/f24 [1177961,5743] 0 2023-10-18T20:58:28.772 INFO:tasks.workunit.client.0.smithi008.stdout:3/294: mknod d0/d3/de/d13/c5e 0 2023-10-18T20:58:28.777 INFO:tasks.workunit.client.1.smithi060.stdout:4/321: read d4/dc/d2a/f7 [7050098,34068] 0 2023-10-18T20:58:28.777 INFO:tasks.workunit.client.1.smithi060.stdout:2/360: mkdir d0/d43/d68 0 2023-10-18T20:58:28.781 INFO:tasks.workunit.client.1.smithi060.stdout:0/374: dwrite d3/d8/d14/d49/f64 [0,4194304] 0 2023-10-18T20:58:28.781 INFO:tasks.workunit.client.1.smithi060.stdout:0/375: readlink d3/l15 0 2023-10-18T20:58:28.783 INFO:tasks.workunit.client.1.smithi060.stdout:3/327: dwrite d0/d22/d50/f53 [4194304,4194304] 0 2023-10-18T20:58:28.784 INFO:tasks.workunit.client.0.smithi008.stdout:9/345: dwrite d2/dc/d17/d19/f55 [0,4194304] 0 2023-10-18T20:58:28.787 INFO:tasks.workunit.client.0.smithi008.stdout:9/346: write d2/dc/f4b [277434,117757] 0 2023-10-18T20:58:28.787 INFO:tasks.workunit.client.0.smithi008.stdout:8/481: read d5/f25 [3313320,66650] 0 2023-10-18T20:58:28.787 INFO:tasks.workunit.client.0.smithi008.stdout:8/482: write d5/d8/d24/f2c [660603,109542] 0 2023-10-18T20:58:28.788 INFO:tasks.workunit.client.1.smithi060.stdout:7/383: mkdir de/d38/d78 0 2023-10-18T20:58:28.788 INFO:tasks.workunit.client.1.smithi060.stdout:7/384: write de/d38/f70 [53026,108200] 0 2023-10-18T20:58:28.791 INFO:tasks.workunit.client.1.smithi060.stdout:4/322: mknod d4/dc/d40/c60 0 2023-10-18T20:58:28.799 INFO:tasks.workunit.client.1.smithi060.stdout:7/385: fdatasync fc 0 2023-10-18T20:58:28.802 INFO:tasks.workunit.client.1.smithi060.stdout:1/463: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/f5c [0,4194304] 0 2023-10-18T20:58:28.802 INFO:tasks.workunit.client.1.smithi060.stdout:1/464: truncate d4/d6/d33/f71 181078 0 2023-10-18T20:58:28.803 INFO:tasks.workunit.client.1.smithi060.stdout:1/465: stat d4/d6/d7/d2f/d6d 0 2023-10-18T20:58:28.806 INFO:tasks.workunit.client.0.smithi008.stdout:2/387: dwrite d1/d3/dd/d1c/d3a/d45/f84 [0,4194304] 0 2023-10-18T20:58:28.808 INFO:tasks.workunit.client.0.smithi008.stdout:2/388: dread - d1/d3/dd/d1c/f55 zero size 2023-10-18T20:58:28.831 INFO:tasks.workunit.client.0.smithi008.stdout:8/483: rename d5/d8/d24/d77/l7e to d5/d8/df/d2e/lb9 0 2023-10-18T20:58:28.838 INFO:tasks.workunit.client.0.smithi008.stdout:9/347: symlink d2/dc/d40/l5f 0 2023-10-18T20:58:28.838 INFO:tasks.workunit.client.0.smithi008.stdout:9/348: write d2/f26 [632072,5381] 0 2023-10-18T20:58:28.845 INFO:tasks.workunit.client.0.smithi008.stdout:2/389: chown d1/d3/dd/le 26483668 1 2023-10-18T20:58:28.846 INFO:tasks.workunit.client.0.smithi008.stdout:7/388: dwrite d1/d36/d3d/f5a [0,4194304] 0 2023-10-18T20:58:28.851 INFO:tasks.workunit.client.0.smithi008.stdout:8/484: mkdir d5/d8/df/d9d/d4d/dba 0 2023-10-18T20:58:28.854 INFO:tasks.workunit.client.0.smithi008.stdout:2/390: mkdir d1/d3/dd/d25/d76/d59/d85 0 2023-10-18T20:58:28.855 INFO:tasks.workunit.client.0.smithi008.stdout:2/391: write d1/d3/dd/d25/f47 [715665,28947] 0 2023-10-18T20:58:28.855 INFO:tasks.workunit.client.0.smithi008.stdout:2/392: chown d1/d3/dd/d1c/d3a/d49/l63 0 1 2023-10-18T20:58:28.855 INFO:tasks.workunit.client.1.smithi060.stdout:8/350: dwrite d4/d9/d37/f3c [0,4194304] 0 2023-10-18T20:58:28.858 INFO:tasks.workunit.client.1.smithi060.stdout:3/328: rename d0/d3c/d3d/c3f to d0/d22/d26/c73 0 2023-10-18T20:58:28.858 INFO:tasks.workunit.client.1.smithi060.stdout:3/329: read d0/f24 [4253419,22379] 0 2023-10-18T20:58:28.858 INFO:tasks.workunit.client.1.smithi060.stdout:6/352: dwrite d10/f72 [0,4194304] 0 2023-10-18T20:58:28.860 INFO:tasks.workunit.client.1.smithi060.stdout:4/323: unlink d4/d15/d2b/f3b 0 2023-10-18T20:58:28.861 INFO:tasks.workunit.client.1.smithi060.stdout:4/324: write d4/dc/d2a/d13/d2f/f34 [4770006,99497] 0 2023-10-18T20:58:28.861 INFO:tasks.workunit.client.1.smithi060.stdout:4/325: write d4/dc/d2a/d13/f56 [512427,19714] 0 2023-10-18T20:58:28.863 INFO:tasks.workunit.client.0.smithi008.stdout:2/393: creat d1/d3/d40/f86 x:0 0 0 2023-10-18T20:58:28.863 INFO:tasks.workunit.client.1.smithi060.stdout:7/386: mknod de/c79 0 2023-10-18T20:58:28.864 INFO:tasks.workunit.client.1.smithi060.stdout:7/387: creat de/d14/d41/d58/d5b/f7a x:0 0 0 2023-10-18T20:58:28.864 INFO:tasks.workunit.client.1.smithi060.stdout:2/361: dwrite d0/f65 [0,4194304] 0 2023-10-18T20:58:28.865 INFO:tasks.workunit.client.1.smithi060.stdout:0/376: rmdir d3/d8/d14/d49 39 2023-10-18T20:58:28.867 INFO:tasks.workunit.client.0.smithi008.stdout:6/363: dwrite df/d26/f61 [0,4194304] 0 2023-10-18T20:58:28.870 INFO:tasks.workunit.client.1.smithi060.stdout:3/330: creat d0/d22/d26/d2c/f74 x:0 0 0 2023-10-18T20:58:28.871 INFO:tasks.workunit.client.0.smithi008.stdout:4/353: dwrite d0/d17/d5b/fb [8388608,4194304] 0 2023-10-18T20:58:28.874 INFO:tasks.workunit.client.0.smithi008.stdout:3/295: dwrite d0/d3/de/f20 [0,4194304] 0 2023-10-18T20:58:28.882 INFO:tasks.workunit.client.1.smithi060.stdout:5/399: sync 2023-10-18T20:58:28.883 INFO:tasks.workunit.client.0.smithi008.stdout:8/485: write d5/d8/d24/f59 [785292,27527] 0 2023-10-18T20:58:28.887 INFO:tasks.workunit.client.1.smithi060.stdout:7/388: dread de/f6f [0,4194304] 0 2023-10-18T20:58:28.888 INFO:tasks.workunit.client.0.smithi008.stdout:6/364: mknod df/d36/c80 0 2023-10-18T20:58:28.893 INFO:tasks.workunit.client.0.smithi008.stdout:5/355: dwrite d0/d2/d19/d7c/d42/f52 [0,4194304] 0 2023-10-18T20:58:28.897 INFO:tasks.workunit.client.0.smithi008.stdout:9/349: dwrite d2/dc/f1c [4194304,4194304] 0 2023-10-18T20:58:28.897 INFO:tasks.workunit.client.0.smithi008.stdout:2/394: dread d1/d3/dd/f1e [4194304,4194304] 0 2023-10-18T20:58:28.907 INFO:tasks.workunit.client.0.smithi008.stdout:4/354: creat d0/d3/d21/d42/f79 x:0 0 0 2023-10-18T20:58:28.909 INFO:tasks.workunit.client.0.smithi008.stdout:2/395: dread d1/d3/dd/d25/f2f [0,4194304] 0 2023-10-18T20:58:28.909 INFO:tasks.workunit.client.0.smithi008.stdout:2/396: chown d1/d3/dd/f58 0 1 2023-10-18T20:58:28.911 INFO:tasks.workunit.client.1.smithi060.stdout:1/466: getdents d4/d38 0 2023-10-18T20:58:28.911 INFO:tasks.workunit.client.1.smithi060.stdout:1/467: getdents d4/d6/d7/d2f/d6d 0 2023-10-18T20:58:28.912 INFO:tasks.workunit.client.0.smithi008.stdout:3/296: write d0/d3/de/f20 [2209677,120322] 0 2023-10-18T20:58:28.913 INFO:tasks.workunit.client.1.smithi060.stdout:9/326: sync 2023-10-18T20:58:28.914 INFO:tasks.workunit.client.1.smithi060.stdout:8/351: dwrite d4/d9/d37/d4e/f61 [0,4194304] 0 2023-10-18T20:58:28.915 INFO:tasks.workunit.client.1.smithi060.stdout:8/352: chown d4/d9/d31/f40 112587 1 2023-10-18T20:58:28.916 INFO:tasks.workunit.client.1.smithi060.stdout:4/326: read d4/d15/f37 [1519482,65961] 0 2023-10-18T20:58:28.917 INFO:tasks.workunit.client.1.smithi060.stdout:4/327: truncate d4/d15/f48 1046443 0 2023-10-18T20:58:28.917 INFO:tasks.workunit.client.1.smithi060.stdout:6/353: dwrite fd [0,4194304] 0 2023-10-18T20:58:28.922 INFO:tasks.workunit.client.1.smithi060.stdout:0/377: rename d3/d8/d14/d49 to d3/d8/d14/d55/d74/d76 0 2023-10-18T20:58:28.923 INFO:tasks.workunit.client.1.smithi060.stdout:0/378: chown d3/f26 228442271 1 2023-10-18T20:58:28.923 INFO:tasks.workunit.client.1.smithi060.stdout:0/379: dread - d3/d8/f20 zero size 2023-10-18T20:58:28.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:27.537354+0000 mgr.smithi060.pgqqwa (mgr.14584) 45 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 978 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 93 MiB/s rd, 110 MiB/s wr, 302 op/s 2023-10-18T20:58:28.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:28.035560+0000 mon.smithi008 (mon.0) 607 : cluster [DBG] Standby manager daemon smithi008.flmjzp restarted 2023-10-18T20:58:28.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:28.035693+0000 mon.smithi008 (mon.0) 608 : cluster [DBG] Standby manager daemon smithi008.flmjzp started 2023-10-18T20:58:28.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:28.044631+0000 mon.smithi008 (mon.0) 609 : audit [DBG] from='mgr.? 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi008.flmjzp/crt"}]: dispatch 2023-10-18T20:58:28.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:28.046501+0000 mon.smithi008 (mon.0) 610 : audit [DBG] from='mgr.? 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:58:28.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:28.063739+0000 mon.smithi008 (mon.0) 611 : audit [DBG] from='mgr.? 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi008.flmjzp/key"}]: dispatch 2023-10-18T20:58:28.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:28.069596+0000 mon.smithi008 (mon.0) 612 : audit [DBG] from='mgr.? 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:58:28.927 INFO:tasks.workunit.client.1.smithi060.stdout:3/331: symlink d0/d22/l75 0 2023-10-18T20:58:28.929 INFO:tasks.workunit.client.0.smithi008.stdout:2/397: dread d1/d3/dd/d1c/d3a/d45/f84 [0,4194304] 0 2023-10-18T20:58:28.930 INFO:tasks.workunit.client.1.smithi060.stdout:5/400: creat d0/da/f9a x:0 0 0 2023-10-18T20:58:28.930 INFO:tasks.workunit.client.1.smithi060.stdout:5/401: write d0/da/d3b/f8f [2756392,125913] 0 2023-10-18T20:58:28.931 INFO:tasks.workunit.client.1.smithi060.stdout:7/389: rmdir de/d14/d2f/d3f/d5a 39 2023-10-18T20:58:28.934 INFO:tasks.workunit.client.1.smithi060.stdout:6/354: write d10/d17/d2f/d66/f4a [3579403,44274] 0 2023-10-18T20:58:28.934 INFO:tasks.workunit.client.1.smithi060.stdout:6/355: truncate d10/d2e/f56 4717031 0 2023-10-18T20:58:28.936 INFO:tasks.workunit.client.0.smithi008.stdout:8/486: mkdir d5/d8/d24/d9f/dbb 0 2023-10-18T20:58:28.940 INFO:tasks.workunit.client.0.smithi008.stdout:9/350: link d2/dc/c52 d2/dc/d17/d19/d42/d59/c60 0 2023-10-18T20:58:28.940 INFO:tasks.workunit.client.0.smithi008.stdout:9/351: stat d2/dc/d1a/d1d/f50 0 2023-10-18T20:58:28.941 INFO:tasks.workunit.client.1.smithi060.stdout:5/402: mknod d0/d6/d9/d82/d83/d99/c9b 0 2023-10-18T20:58:28.941 INFO:tasks.workunit.client.1.smithi060.stdout:5/403: readlink d0/d6/d9/l94 0 2023-10-18T20:58:28.941 INFO:tasks.workunit.client.1.smithi060.stdout:5/404: write d0/d6/d9/f14 [597553,125000] 0 2023-10-18T20:58:28.942 INFO:tasks.workunit.client.1.smithi060.stdout:2/362: dwrite d0/f65 [0,4194304] 0 2023-10-18T20:58:28.943 INFO:tasks.workunit.client.1.smithi060.stdout:7/390: mkdir de/d14/d2f/d7b 0 2023-10-18T20:58:28.944 INFO:tasks.workunit.client.0.smithi008.stdout:3/297: mkdir d0/d5f 0 2023-10-18T20:58:28.945 INFO:tasks.workunit.client.1.smithi060.stdout:9/327: getdents d3/d10/d1c 0 2023-10-18T20:58:28.947 INFO:tasks.workunit.client.0.smithi008.stdout:7/389: dwrite d1/d36/f4c [0,4194304] 0 2023-10-18T20:58:28.947 INFO:tasks.workunit.client.0.smithi008.stdout:7/390: write d1/f1b [424192,53916] 0 2023-10-18T20:58:28.948 INFO:tasks.workunit.client.0.smithi008.stdout:6/365: getdents df/d15/d27 0 2023-10-18T20:58:28.948 INFO:tasks.workunit.client.0.smithi008.stdout:7/391: read d1/d3/d20/f43 [93719,4991] 0 2023-10-18T20:58:28.948 INFO:tasks.workunit.client.0.smithi008.stdout:7/392: chown d1/f4e 3 1 2023-10-18T20:58:28.950 INFO:tasks.workunit.client.1.smithi060.stdout:8/353: mknod d4/c68 0 2023-10-18T20:58:28.953 INFO:tasks.workunit.client.0.smithi008.stdout:8/487: creat d5/d8/df/d9d/d85/db1/fbc x:0 0 0 2023-10-18T20:58:28.964 INFO:tasks.workunit.client.1.smithi060.stdout:3/332: rename d0/d22/d26/d29/l5c to d0/l76 0 2023-10-18T20:58:28.964 INFO:tasks.workunit.client.1.smithi060.stdout:2/363: link d0/d8/c64 d0/d3/d27/d4d/c69 0 2023-10-18T20:58:28.965 INFO:tasks.workunit.client.1.smithi060.stdout:2/364: write d0/d3/d27/f4c [548442,82995] 0 2023-10-18T20:58:28.966 INFO:tasks.workunit.client.0.smithi008.stdout:8/488: write d5/d8/df/f75 [135767,66735] 0 2023-10-18T20:58:28.967 INFO:tasks.workunit.client.0.smithi008.stdout:8/489: truncate d5/d8/df/f75 1594744 0 2023-10-18T20:58:28.973 INFO:tasks.workunit.client.1.smithi060.stdout:7/391: symlink de/d14/d2f/d3f/d76/l7c 0 2023-10-18T20:58:28.974 INFO:tasks.workunit.client.1.smithi060.stdout:7/392: fdatasync de/d14/d41/d58/d5b/f7a 0 2023-10-18T20:58:28.976 INFO:tasks.workunit.client.1.smithi060.stdout:1/468: dwrite d4/d38/f7f [0,4194304] 0 2023-10-18T20:58:28.978 INFO:tasks.workunit.client.0.smithi008.stdout:4/355: rmdir d0/d3/d21 39 2023-10-18T20:58:28.978 INFO:tasks.workunit.client.0.smithi008.stdout:7/393: symlink d1/d3/d20/l85 0 2023-10-18T20:58:28.979 INFO:tasks.workunit.client.0.smithi008.stdout:7/394: chown d1/d3/d20 107 1 2023-10-18T20:58:28.983 INFO:tasks.workunit.client.0.smithi008.stdout:2/398: dwrite d1/d3/dd/d25/d34/f46 [0,4194304] 0 2023-10-18T20:58:28.985 INFO:tasks.workunit.client.1.smithi060.stdout:8/354: creat d4/d9/f69 x:0 0 0 2023-10-18T20:58:28.986 INFO:tasks.workunit.client.1.smithi060.stdout:8/355: write d4/d9/d37/f56 [576738,99354] 0 2023-10-18T20:58:28.986 INFO:tasks.workunit.client.1.smithi060.stdout:8/356: chown d4/d9/d37/d4e/f61 3 1 2023-10-18T20:58:28.987 INFO:tasks.workunit.client.1.smithi060.stdout:8/357: fdatasync d4/d9/d4f/f5d 0 2023-10-18T20:58:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:27.537354+0000 mgr.smithi060.pgqqwa (mgr.14584) 45 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 978 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 93 MiB/s rd, 110 MiB/s wr, 302 op/s 2023-10-18T20:58:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:28.035560+0000 mon.smithi008 (mon.0) 607 : cluster [DBG] Standby manager daemon smithi008.flmjzp restarted 2023-10-18T20:58:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:28.035693+0000 mon.smithi008 (mon.0) 608 : cluster [DBG] Standby manager daemon smithi008.flmjzp started 2023-10-18T20:58:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:28.044631+0000 mon.smithi008 (mon.0) 609 : audit [DBG] from='mgr.? 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi008.flmjzp/crt"}]: dispatch 2023-10-18T20:58:28.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:28.046501+0000 mon.smithi008 (mon.0) 610 : audit [DBG] from='mgr.? 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:58:28.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:28.063739+0000 mon.smithi008 (mon.0) 611 : audit [DBG] from='mgr.? 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi008.flmjzp/key"}]: dispatch 2023-10-18T20:58:28.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:28.069596+0000 mon.smithi008 (mon.0) 612 : audit [DBG] from='mgr.? 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:58:28.989 INFO:tasks.workunit.client.1.smithi060.stdout:7/393: dread de/f19 [0,4194304] 0 2023-10-18T20:58:28.992 INFO:tasks.workunit.client.0.smithi008.stdout:9/352: rename d2/dc/d17/d19/d42 to d2/dc/d1a/d61 0 2023-10-18T20:58:28.992 INFO:tasks.workunit.client.0.smithi008.stdout:9/353: chown d2/dc/f1e 6728 1 2023-10-18T20:58:28.995 INFO:tasks.workunit.client.0.smithi008.stdout:5/356: dwrite d0/f1c [0,4194304] 0 2023-10-18T20:58:28.996 INFO:tasks.workunit.client.0.smithi008.stdout:7/395: creat d1/d3/d20/d5f/d78/f86 x:0 0 0 2023-10-18T20:58:28.996 INFO:tasks.workunit.client.0.smithi008.stdout:7/396: chown d1/d36/d3d/d3e/f31 1037787 1 2023-10-18T20:58:28.996 INFO:tasks.workunit.client.0.smithi008.stdout:7/397: unlink d1/f4e 0 2023-10-18T20:58:28.997 INFO:tasks.workunit.client.0.smithi008.stdout:7/398: dread - d1/d3/d20/d5f/f72 zero size 2023-10-18T20:58:28.997 INFO:tasks.workunit.client.1.smithi060.stdout:4/328: dwrite d4/dc/d2a/d13/d2f/f34 [0,4194304] 0 2023-10-18T20:58:28.998 INFO:tasks.workunit.client.1.smithi060.stdout:1/469: rmdir d4/d6/d48 39 2023-10-18T20:58:28.998 INFO:tasks.workunit.client.1.smithi060.stdout:1/470: fsync d4/d6/d7/df/d59/f82 0 2023-10-18T20:58:29.001 INFO:tasks.workunit.client.1.smithi060.stdout:9/328: dwrite d3/d10/d1c/d5a/d5d/f77 [0,4194304] 0 2023-10-18T20:58:29.001 INFO:tasks.workunit.client.1.smithi060.stdout:9/329: chown d3/d10/d1c/l26 6249517 1 2023-10-18T20:58:29.004 INFO:tasks.workunit.client.0.smithi008.stdout:8/490: rmdir d5/d8/d24/d50/d8d 39 2023-10-18T20:58:29.005 INFO:tasks.workunit.client.1.smithi060.stdout:8/358: symlink d4/d9/d31/l6a 0 2023-10-18T20:58:29.005 INFO:tasks.workunit.client.1.smithi060.stdout:8/359: creat d4/d9/f6b x:0 0 0 2023-10-18T20:58:29.009 INFO:tasks.workunit.client.0.smithi008.stdout:2/399: dread d1/f1a [0,4194304] 0 2023-10-18T20:58:29.009 INFO:tasks.workunit.client.0.smithi008.stdout:2/400: write d1/f19 [2059211,36082] 0 2023-10-18T20:58:29.009 INFO:tasks.workunit.client.0.smithi008.stdout:2/401: chown d1/d3/dd/d25/d34/c56 235 1 2023-10-18T20:58:29.012 INFO:tasks.workunit.client.1.smithi060.stdout:7/394: dread fc [0,4194304] 0 2023-10-18T20:58:29.012 INFO:tasks.workunit.client.1.smithi060.stdout:7/395: dread - de/d14/d41/d58/d5b/f7a zero size 2023-10-18T20:58:29.013 INFO:tasks.workunit.client.1.smithi060.stdout:7/396: write de/d14/d2f/f71 [778458,9259] 0 2023-10-18T20:58:29.013 INFO:tasks.workunit.client.1.smithi060.stdout:7/397: chown de/d29/f2b 5757 1 2023-10-18T20:58:29.013 INFO:tasks.workunit.client.1.smithi060.stdout:7/398: write de/d14/d2f/f3c [724263,4233] 0 2023-10-18T20:58:29.014 INFO:tasks.workunit.client.1.smithi060.stdout:3/333: write d0/f20 [811801,91178] 0 2023-10-18T20:58:29.015 INFO:tasks.workunit.client.1.smithi060.stdout:5/405: rename d0/d6/d8/df/d27/d32/d6d/d72/f5d to d0/da/f9c 0 2023-10-18T20:58:29.016 INFO:tasks.workunit.client.0.smithi008.stdout:4/356: rename d0/d3/d21/d42/c46 to d0/d17/c7a 0 2023-10-18T20:58:29.016 INFO:tasks.workunit.client.0.smithi008.stdout:5/357: rmdir d0/d2/d19/d7c/d41/d6f 39 2023-10-18T20:58:29.016 INFO:tasks.workunit.client.0.smithi008.stdout:5/358: creat d0/d2/d19/f81 x:0 0 0 2023-10-18T20:58:29.016 INFO:tasks.workunit.client.0.smithi008.stdout:5/359: readlink d0/de/l1f 0 2023-10-18T20:58:29.019 INFO:tasks.workunit.client.0.smithi008.stdout:7/399: mkdir d1/d36/d3b/d4f/d87 0 2023-10-18T20:58:29.019 INFO:tasks.workunit.client.1.smithi060.stdout:7/399: mkdir de/d14/d49/d68/d7d 0 2023-10-18T20:58:29.022 INFO:tasks.workunit.client.1.smithi060.stdout:1/471: read d4/d6/d14/f8a [3203473,40971] 0 2023-10-18T20:58:29.024 INFO:tasks.workunit.client.0.smithi008.stdout:4/357: write d0/d3/d21/f2c [775796,44251] 0 2023-10-18T20:58:29.032 INFO:tasks.workunit.client.1.smithi060.stdout:2/365: dwrite d0/d3/f32 [0,4194304] 0 2023-10-18T20:58:29.035 INFO:tasks.workunit.client.0.smithi008.stdout:6/366: dwrite df/d19/f20 [0,4194304] 0 2023-10-18T20:58:29.039 INFO:tasks.workunit.client.1.smithi060.stdout:9/330: symlink d3/d10/d1c/d2a/d2d/l84 0 2023-10-18T20:58:29.039 INFO:tasks.workunit.client.1.smithi060.stdout:1/472: creat d4/f9c x:0 0 0 2023-10-18T20:58:29.039 INFO:tasks.workunit.client.1.smithi060.stdout:1/473: chown d4/d6/d33/d58 63 1 2023-10-18T20:58:29.040 INFO:tasks.workunit.client.1.smithi060.stdout:9/331: creat d3/d10/d1c/d2a/d33/f85 x:0 0 0 2023-10-18T20:58:29.043 INFO:tasks.workunit.client.0.smithi008.stdout:2/402: link d1/d3/dd/d1c/d3a/c82 d1/d3/dd/d25/d76/d59/d85/c87 0 2023-10-18T20:58:29.043 INFO:tasks.workunit.client.0.smithi008.stdout:5/360: mkdir d0/d2/d19/d7c/d31/d82 0 2023-10-18T20:58:29.043 INFO:tasks.workunit.client.0.smithi008.stdout:7/400: write d1/d36/d3b/d4f/f51 [838879,28039] 0 2023-10-18T20:58:29.048 INFO:tasks.workunit.client.1.smithi060.stdout:1/474: dread d4/da/f50 [0,4194304] 0 2023-10-18T20:58:29.050 INFO:tasks.workunit.client.1.smithi060.stdout:7/400: dread de/d14/d49/f63 [0,4194304] 0 2023-10-18T20:58:29.053 INFO:tasks.workunit.client.0.smithi008.stdout:3/298: dwrite d0/d3/de/d13/f46 [4194304,4194304] 0 2023-10-18T20:58:29.055 INFO:tasks.workunit.client.0.smithi008.stdout:7/401: write d1/f6 [4689981,126895] 0 2023-10-18T20:58:29.055 INFO:tasks.workunit.client.0.smithi008.stdout:7/402: chown d1/d3/d20/d5f 93 1 2023-10-18T20:58:29.055 INFO:tasks.workunit.client.0.smithi008.stdout:7/403: read d1/d3/d20/f43 [33090,45834] 0 2023-10-18T20:58:29.056 INFO:tasks.workunit.client.0.smithi008.stdout:7/404: truncate d1/d36/d3d/d3e/f31 1851297 0 2023-10-18T20:58:29.057 INFO:tasks.workunit.client.1.smithi060.stdout:5/406: dwrite d0/d6/d8/df/d27/f4d [0,4194304] 0 2023-10-18T20:58:29.062 INFO:tasks.workunit.client.0.smithi008.stdout:4/358: dread d0/d17/d5b/f52 [0,4194304] 0 2023-10-18T20:58:29.062 INFO:tasks.workunit.client.0.smithi008.stdout:9/354: dwrite d2/dc/d1a/f5b [0,4194304] 0 2023-10-18T20:58:29.066 INFO:tasks.workunit.client.1.smithi060.stdout:3/334: dwrite d0/d22/f52 [0,4194304] 0 2023-10-18T20:58:29.067 INFO:tasks.workunit.client.0.smithi008.stdout:6/367: mkdir df/d15/d48/d81 0 2023-10-18T20:58:29.067 INFO:tasks.workunit.client.0.smithi008.stdout:6/368: dread - df/f24 zero size 2023-10-18T20:58:29.067 INFO:tasks.workunit.client.0.smithi008.stdout:6/369: read - df/d18/d3f/f7b zero size 2023-10-18T20:58:29.068 INFO:tasks.workunit.client.0.smithi008.stdout:6/370: stat df/d18/f21 0 2023-10-18T20:58:29.068 INFO:tasks.workunit.client.0.smithi008.stdout:2/403: dread d1/d3/dd/f50 [0,4194304] 0 2023-10-18T20:58:29.068 INFO:tasks.workunit.client.1.smithi060.stdout:2/366: symlink d0/d3/d27/d4d/l6a 0 2023-10-18T20:58:29.069 INFO:tasks.workunit.client.0.smithi008.stdout:8/491: dwrite d5/d8/df/d2e/f43 [0,4194304] 0 2023-10-18T20:58:29.078 INFO:tasks.workunit.client.1.smithi060.stdout:9/332: symlink d3/d10/d19/l86 0 2023-10-18T20:58:29.079 INFO:tasks.workunit.client.0.smithi008.stdout:3/299: symlink d0/d3/de/d13/l60 0 2023-10-18T20:58:29.079 INFO:tasks.workunit.client.0.smithi008.stdout:3/300: creat d0/d3/d37/f61 x:0 0 0 2023-10-18T20:58:29.079 INFO:tasks.workunit.client.1.smithi060.stdout:1/475: rmdir d4/d6/d7/d2f/d7b/d2a/d32/d56/d67 39 2023-10-18T20:58:29.082 INFO:tasks.workunit.client.0.smithi008.stdout:8/492: dread d5/d8/df/f1b [0,4194304] 0 2023-10-18T20:58:29.083 INFO:tasks.workunit.client.1.smithi060.stdout:7/401: rename de/d14/d2f/d3f/d76 to de/d14/d49/d68/d7d/d7e 0 2023-10-18T20:58:29.083 INFO:tasks.workunit.client.1.smithi060.stdout:7/402: read de/f17 [537371,81032] 0 2023-10-18T20:58:29.083 INFO:tasks.workunit.client.1.smithi060.stdout:7/403: write de/ff [1213246,126250] 0 2023-10-18T20:58:29.088 INFO:tasks.workunit.client.1.smithi060.stdout:3/335: fsync d0/f1d 0 2023-10-18T20:58:29.089 INFO:tasks.workunit.client.1.smithi060.stdout:3/336: write d0/d22/f36 [334033,129601] 0 2023-10-18T20:58:29.090 INFO:tasks.workunit.client.1.smithi060.stdout:2/367: symlink d0/d3/d27/d4d/l6b 0 2023-10-18T20:58:29.090 INFO:tasks.workunit.client.1.smithi060.stdout:2/368: chown d0/l34 1338374 1 2023-10-18T20:58:29.096 INFO:tasks.workunit.client.0.smithi008.stdout:3/301: dread d0/d4a/f4b [0,4194304] 0 2023-10-18T20:58:29.098 INFO:tasks.workunit.client.0.smithi008.stdout:7/405: link d1/d36/d3b/f77 d1/d36/d3d/d3e/d59/d73/f88 0 2023-10-18T20:58:29.098 INFO:tasks.workunit.client.0.smithi008.stdout:7/406: chown d1/d3/f2a 780853 1 2023-10-18T20:58:29.099 INFO:tasks.workunit.client.1.smithi060.stdout:6/356: sync 2023-10-18T20:58:29.099 INFO:tasks.workunit.client.1.smithi060.stdout:4/329: sync 2023-10-18T20:58:29.099 INFO:tasks.workunit.client.1.smithi060.stdout:9/333: symlink d3/l87 0 2023-10-18T20:58:29.099 INFO:tasks.workunit.client.1.smithi060.stdout:0/380: sync 2023-10-18T20:58:29.100 INFO:tasks.workunit.client.1.smithi060.stdout:0/381: creat d3/d8/d14/f77 x:0 0 0 2023-10-18T20:58:29.100 INFO:tasks.workunit.client.1.smithi060.stdout:0/382: readlink d3/d8/d3c/l4a 0 2023-10-18T20:58:29.100 INFO:tasks.workunit.client.0.smithi008.stdout:4/359: truncate d0/f27 733084 0 2023-10-18T20:58:29.101 INFO:tasks.workunit.client.1.smithi060.stdout:1/476: truncate d4/d6/d7/d2f/d7b/d2a/f46 2563409 0 2023-10-18T20:58:29.101 INFO:tasks.workunit.client.1.smithi060.stdout:1/477: fsync d4/f2d 0 2023-10-18T20:58:29.101 INFO:tasks.workunit.client.1.smithi060.stdout:1/478: write d4/f9c [100453,76380] 0 2023-10-18T20:58:29.102 INFO:tasks.workunit.client.1.smithi060.stdout:5/407: rename d0/d6/d9/l58 to d0/d6/d8/l9d 0 2023-10-18T20:58:29.102 INFO:tasks.workunit.client.1.smithi060.stdout:5/408: creat d0/dd/d33/f9e x:0 0 0 2023-10-18T20:58:29.103 INFO:tasks.workunit.client.0.smithi008.stdout:6/371: link l2 df/d15/d27/d4c/l82 0 2023-10-18T20:58:29.103 INFO:tasks.workunit.client.1.smithi060.stdout:3/337: unlink d0/d3c/f6c 0 2023-10-18T20:58:29.103 INFO:tasks.workunit.client.0.smithi008.stdout:2/404: symlink d1/d3/dd/d25/d76/d59/d85/l88 0 2023-10-18T20:58:29.104 INFO:tasks.workunit.client.0.smithi008.stdout:2/405: chown d1/d3/dd/d25/d34/f81 12204 1 2023-10-18T20:58:29.105 INFO:tasks.workunit.client.1.smithi060.stdout:2/369: mkdir d0/d3/d27/d62/d6c 0 2023-10-18T20:58:29.108 INFO:tasks.workunit.client.1.smithi060.stdout:9/334: truncate d3/d10/d1c/d25/f3e 945421 0 2023-10-18T20:58:29.115 INFO:tasks.workunit.client.0.smithi008.stdout:1/468: sync 2023-10-18T20:58:29.115 INFO:tasks.workunit.client.0.smithi008.stdout:0/310: sync 2023-10-18T20:58:29.115 INFO:tasks.workunit.client.0.smithi008.stdout:1/469: write d9/de/df/d17/f5f [2667104,51097] 0 2023-10-18T20:58:29.122 INFO:tasks.workunit.client.0.smithi008.stdout:8/493: mknod d5/d8/cbd 0 2023-10-18T20:58:29.124 INFO:tasks.workunit.client.1.smithi060.stdout:8/360: sync 2023-10-18T20:58:29.125 INFO:tasks.workunit.client.1.smithi060.stdout:0/383: getdents d3/d8/d14/d55/d74/d76 0 2023-10-18T20:58:29.125 INFO:tasks.workunit.client.1.smithi060.stdout:8/361: write d4/d9/d37/f56 [1330600,104957] 0 2023-10-18T20:58:29.125 INFO:tasks.workunit.client.1.smithi060.stdout:6/357: dread d10/d17/f46 [0,4194304] 0 2023-10-18T20:58:29.126 INFO:tasks.workunit.client.1.smithi060.stdout:5/409: symlink d0/dd/d76/l9f 0 2023-10-18T20:58:29.128 INFO:tasks.workunit.client.0.smithi008.stdout:3/302: rename d0/d3/d37/f5d to d0/f62 0 2023-10-18T20:58:29.130 INFO:tasks.workunit.client.1.smithi060.stdout:7/404: rename de/f6c to de/d14/d2f/d3f/d5a/f7f 0 2023-10-18T20:58:29.130 INFO:tasks.workunit.client.1.smithi060.stdout:7/405: write de/d14/d41/d58/d5b/f74 [329306,7229] 0 2023-10-18T20:58:29.131 INFO:tasks.workunit.client.0.smithi008.stdout:4/360: getdents d0/d17/d5b 0 2023-10-18T20:58:29.133 INFO:tasks.workunit.client.1.smithi060.stdout:3/338: creat d0/d22/d26/d2b/f77 x:0 0 0 2023-10-18T20:58:29.135 INFO:tasks.workunit.client.0.smithi008.stdout:6/372: mknod df/d18/d58/c83 0 2023-10-18T20:58:29.136 INFO:tasks.workunit.client.1.smithi060.stdout:2/370: mknod d0/d3/c6d 0 2023-10-18T20:58:29.136 INFO:tasks.workunit.client.1.smithi060.stdout:2/371: dread - d0/d3/d27/d4d/d53/f5c zero size 2023-10-18T20:58:29.136 INFO:tasks.workunit.client.1.smithi060.stdout:2/372: chown d0/d3/d27/d4d 613 1 2023-10-18T20:58:29.136 INFO:tasks.workunit.client.1.smithi060.stdout:2/373: chown d0/d8/f2c 1085854 1 2023-10-18T20:58:29.137 INFO:tasks.workunit.client.1.smithi060.stdout:2/374: write d0/d8/fc [1385463,78557] 0 2023-10-18T20:58:29.137 INFO:tasks.workunit.client.1.smithi060.stdout:2/375: fsync d0/f65 0 2023-10-18T20:58:29.138 INFO:tasks.workunit.client.1.smithi060.stdout:9/335: rmdir d3/d10/d1c/d5a/d5d/d2b 39 2023-10-18T20:58:29.138 INFO:tasks.workunit.client.0.smithi008.stdout:6/373: fsync df/f3b 0 2023-10-18T20:58:29.138 INFO:tasks.workunit.client.0.smithi008.stdout:6/374: truncate df/d19/f4d 2065645 0 2023-10-18T20:58:29.139 INFO:tasks.workunit.client.0.smithi008.stdout:6/375: creat df/d36/f84 x:0 0 0 2023-10-18T20:58:29.141 INFO:tasks.workunit.client.0.smithi008.stdout:2/406: rename d1/d3/dd/d1c/d3a/l4e to d1/d3/dd/d1c/d3a/l89 0 2023-10-18T20:58:29.141 INFO:tasks.workunit.client.0.smithi008.stdout:2/407: read d1/d3/dd/d1c/f3c [1262125,6926] 0 2023-10-18T20:58:29.142 INFO:tasks.workunit.client.1.smithi060.stdout:8/362: symlink d4/d9/d37/d4e/l6c 0 2023-10-18T20:58:29.142 INFO:tasks.workunit.client.1.smithi060.stdout:8/363: chown d4/d9/d37/d4e/l6c 591 1 2023-10-18T20:58:29.145 INFO:tasks.workunit.client.1.smithi060.stdout:6/358: creat d10/d2e/f73 x:0 0 0 2023-10-18T20:58:29.147 INFO:tasks.workunit.client.0.smithi008.stdout:3/303: symlink d0/d3/de/d13/d35/d51/l63 0 2023-10-18T20:58:29.147 INFO:tasks.workunit.client.0.smithi008.stdout:3/304: write d0/d3/de/d13/d35/f47 [284321,16053] 0 2023-10-18T20:58:29.150 INFO:tasks.workunit.client.1.smithi060.stdout:3/339: write d0/d22/d50/f53 [5095958,119233] 0 2023-10-18T20:58:29.152 INFO:tasks.workunit.client.0.smithi008.stdout:1/470: rename d9/de/df/d17/d1e/d3c/c4e to d9/de/df/d17/d55/c8c 0 2023-10-18T20:58:29.153 INFO:tasks.workunit.client.0.smithi008.stdout:1/471: fsync d9/de/df/d17/f70 0 2023-10-18T20:58:29.153 INFO:tasks.workunit.client.0.smithi008.stdout:1/472: truncate d9/de/df/f84 1162680 0 2023-10-18T20:58:29.153 INFO:tasks.workunit.client.0.smithi008.stdout:1/473: truncate d9/f51 947144 0 2023-10-18T20:58:29.153 INFO:tasks.workunit.client.0.smithi008.stdout:1/474: fdatasync d9/de/df/f7f 0 2023-10-18T20:58:29.154 INFO:tasks.workunit.client.1.smithi060.stdout:0/384: rename d3/d8/l16 to d3/d8/d14/d55/l78 0 2023-10-18T20:58:29.155 INFO:tasks.workunit.client.0.smithi008.stdout:4/361: truncate d0/d3/d21/f51 502867 0 2023-10-18T20:58:29.156 INFO:tasks.workunit.client.0.smithi008.stdout:4/362: creat d0/d3/f7b x:0 0 0 2023-10-18T20:58:29.156 INFO:tasks.workunit.client.0.smithi008.stdout:4/363: write d0/d3/f7b [269485,119403] 0 2023-10-18T20:58:29.156 INFO:tasks.workunit.client.0.smithi008.stdout:4/364: fdatasync d0/d3/d21/f2c 0 2023-10-18T20:58:29.157 INFO:tasks.workunit.client.0.smithi008.stdout:4/365: chown d0/d3/f1e 843270 1 2023-10-18T20:58:29.163 INFO:tasks.workunit.client.0.smithi008.stdout:7/407: dwrite d1/f6 [4194304,4194304] 0 2023-10-18T20:58:29.163 INFO:tasks.workunit.client.0.smithi008.stdout:7/408: creat d1/d3/d20/f89 x:0 0 0 2023-10-18T20:58:29.163 INFO:tasks.workunit.client.0.smithi008.stdout:7/409: chown d1/d3/f57 8 1 2023-10-18T20:58:29.163 INFO:tasks.workunit.client.0.smithi008.stdout:7/410: truncate d1/d3/f65 1970631 0 2023-10-18T20:58:29.164 INFO:tasks.workunit.client.1.smithi060.stdout:2/376: getdents d0/d8/d47 0 2023-10-18T20:58:29.164 INFO:tasks.workunit.client.1.smithi060.stdout:8/364: rmdir d4/d9/d4f 39 2023-10-18T20:58:29.165 INFO:tasks.workunit.client.1.smithi060.stdout:9/336: rename d3/d10/d1c/d5a/f72 to d3/d10/d1c/d5a/d5d/f88 0 2023-10-18T20:58:29.172 INFO:tasks.workunit.client.1.smithi060.stdout:5/410: dread d0/f1d [0,4194304] 0 2023-10-18T20:58:29.174 INFO:tasks.workunit.client.1.smithi060.stdout:3/340: write d0/d22/d26/d2c/f62 [3643500,53205] 0 2023-10-18T20:58:29.178 INFO:tasks.workunit.client.1.smithi060.stdout:7/406: dread de/d29/f31 [0,4194304] 0 2023-10-18T20:58:29.178 INFO:tasks.workunit.client.1.smithi060.stdout:7/407: write de/d29/f77 [364698,50695] 0 2023-10-18T20:58:29.178 INFO:tasks.workunit.client.1.smithi060.stdout:7/408: chown de/d29/f37 27606 1 2023-10-18T20:58:29.178 INFO:tasks.workunit.client.1.smithi060.stdout:7/409: write de/f1f [4969844,61921] 0 2023-10-18T20:58:29.178 INFO:tasks.workunit.client.1.smithi060.stdout:7/410: readlink l6 0 2023-10-18T20:58:29.179 INFO:tasks.workunit.client.1.smithi060.stdout:0/385: creat d3/d8/d14/d55/d74/d76/d6b/f79 x:0 0 0 2023-10-18T20:58:29.179 INFO:tasks.workunit.client.1.smithi060.stdout:0/386: fdatasync d3/f41 0 2023-10-18T20:58:29.180 INFO:tasks.workunit.client.1.smithi060.stdout:8/365: symlink d4/d9/d37/d4e/d5e/l6d 0 2023-10-18T20:58:29.180 INFO:tasks.workunit.client.0.smithi008.stdout:6/376: truncate df/d19/f32 3415672 0 2023-10-18T20:58:29.180 INFO:tasks.workunit.client.0.smithi008.stdout:2/408: symlink d1/d3/dd/d1c/d3a/d45/d83/l8a 0 2023-10-18T20:58:29.180 INFO:tasks.workunit.client.0.smithi008.stdout:2/409: write d1/d3/dd/d1c/f28 [3015629,124869] 0 2023-10-18T20:58:29.181 INFO:tasks.workunit.client.0.smithi008.stdout:2/410: read - d1/d3/d40/d6e/f78 zero size 2023-10-18T20:58:29.181 INFO:tasks.workunit.client.0.smithi008.stdout:2/411: truncate d1/d3/d40/d6e/f77 982457 0 2023-10-18T20:58:29.182 INFO:tasks.workunit.client.1.smithi060.stdout:4/330: dwrite d4/dc/d2a/f7 [4194304,4194304] 0 2023-10-18T20:58:29.191 INFO:tasks.workunit.client.1.smithi060.stdout:3/341: link d0/d3c/d3d/l71 d0/d22/d26/d2c/l78 0 2023-10-18T20:58:29.191 INFO:tasks.workunit.client.1.smithi060.stdout:6/359: rename d10/d2e/f6c to d10/d3e/f74 0 2023-10-18T20:58:29.191 INFO:tasks.workunit.client.1.smithi060.stdout:6/360: chown d10/d17/d2f/d66/f4a 110362243 1 2023-10-18T20:58:29.194 INFO:tasks.workunit.client.1.smithi060.stdout:7/411: symlink de/d14/d41/d58/d5b/l80 0 2023-10-18T20:58:29.195 INFO:tasks.workunit.client.0.smithi008.stdout:6/377: write df/d3c/f67 [2275603,81122] 0 2023-10-18T20:58:29.196 INFO:tasks.workunit.client.1.smithi060.stdout:4/331: symlink d4/d15/d2b/l61 0 2023-10-18T20:58:29.197 INFO:tasks.workunit.client.0.smithi008.stdout:1/475: unlink d9/de/df/d17/d25/f3d 0 2023-10-18T20:58:29.197 INFO:tasks.workunit.client.0.smithi008.stdout:4/366: rename d0/c34 to d0/d17/d5b/d2a/c7c 0 2023-10-18T20:58:29.201 INFO:tasks.workunit.client.0.smithi008.stdout:3/305: dwrite d0/d3/f2e [4194304,4194304] 0 2023-10-18T20:58:29.201 INFO:tasks.workunit.client.0.smithi008.stdout:3/306: chown d0/d4a 921204 1 2023-10-18T20:58:29.201 INFO:tasks.workunit.client.0.smithi008.stdout:3/307: chown d0/d3/d15/f1a 471104 1 2023-10-18T20:58:29.202 INFO:tasks.workunit.client.0.smithi008.stdout:7/411: creat d1/d36/d3d/d3e/d59/f8a x:0 0 0 2023-10-18T20:58:29.203 INFO:tasks.workunit.client.1.smithi060.stdout:1/479: dwrite d4/d6/f1f [4194304,4194304] 0 2023-10-18T20:58:29.203 INFO:tasks.workunit.client.1.smithi060.stdout:1/480: write d4/d6/d7/d2f/d7b/d2a/d32/f7a [12158,26528] 0 2023-10-18T20:58:29.206 INFO:tasks.workunit.client.0.smithi008.stdout:4/367: rename d0/l4a to d0/d17/d5b/l7d 0 2023-10-18T20:58:29.208 INFO:tasks.workunit.client.1.smithi060.stdout:0/387: rename d3/d8/d14/d55/d74/d76/l52 to d3/d8/d14/d55/d74/d76/d68/l7a 0 2023-10-18T20:58:29.213 INFO:tasks.workunit.client.1.smithi060.stdout:3/342: mkdir d0/d22/d26/d79 0 2023-10-18T20:58:29.213 INFO:tasks.workunit.client.1.smithi060.stdout:3/343: fdatasync d0/d22/d26/d2b/f6f 0 2023-10-18T20:58:29.220 INFO:tasks.workunit.client.0.smithi008.stdout:7/412: mkdir d1/d3/d8b 0 2023-10-18T20:58:29.220 INFO:tasks.workunit.client.0.smithi008.stdout:3/308: dread d0/d3/f31 [0,4194304] 0 2023-10-18T20:58:29.220 INFO:tasks.workunit.client.0.smithi008.stdout:3/309: chown d0/d3/f33 4 1 2023-10-18T20:58:29.221 INFO:tasks.workunit.client.0.smithi008.stdout:3/310: chown d0/d3/d15 23394 1 2023-10-18T20:58:29.223 INFO:tasks.workunit.client.0.smithi008.stdout:4/368: dread d0/d3/d21/f51 [0,4194304] 0 2023-10-18T20:58:29.234 INFO:tasks.workunit.client.1.smithi060.stdout:7/412: symlink de/d29/l81 0 2023-10-18T20:58:29.234 INFO:tasks.workunit.client.1.smithi060.stdout:7/413: write de/d14/d49/d68/f40 [4841408,66985] 0 2023-10-18T20:58:29.235 INFO:tasks.workunit.client.1.smithi060.stdout:5/411: dwrite d0/da/d3b/f8f [0,4194304] 0 2023-10-18T20:58:29.236 INFO:tasks.workunit.client.0.smithi008.stdout:7/413: mknod d1/d3/d20/c8c 0 2023-10-18T20:58:29.236 INFO:tasks.workunit.client.0.smithi008.stdout:7/414: chown d1/d3/c35 19 1 2023-10-18T20:58:29.236 INFO:tasks.workunit.client.0.smithi008.stdout:7/415: fsync d1/d3/d20/f43 0 2023-10-18T20:58:29.237 INFO:tasks.workunit.client.1.smithi060.stdout:4/332: mknod d4/dc/d40/c62 0 2023-10-18T20:58:29.240 INFO:tasks.workunit.client.0.smithi008.stdout:0/311: dwrite d0/dd/d19/d24/f35 [0,4194304] 0 2023-10-18T20:58:29.242 INFO:tasks.workunit.client.0.smithi008.stdout:6/378: dread df/f3b [0,4194304] 0 2023-10-18T20:58:29.243 INFO:tasks.workunit.client.1.smithi060.stdout:1/481: creat d4/d6/d7/d2f/d6d/f9d x:0 0 0 2023-10-18T20:58:29.244 INFO:tasks.workunit.client.1.smithi060.stdout:1/482: truncate d4/d6/d33/f7d 222414 0 2023-10-18T20:58:29.246 INFO:tasks.workunit.client.1.smithi060.stdout:3/344: rmdir d0/d3c 39 2023-10-18T20:58:29.246 INFO:tasks.workunit.client.1.smithi060.stdout:3/345: fdatasync d0/f64 0 2023-10-18T20:58:29.251 INFO:tasks.workunit.client.1.smithi060.stdout:6/361: rmdir d10/d2e 39 2023-10-18T20:58:29.252 INFO:tasks.workunit.client.0.smithi008.stdout:6/379: symlink df/d15/d48/l85 0 2023-10-18T20:58:29.257 INFO:tasks.workunit.client.1.smithi060.stdout:5/412: mkdir d0/d47/d7d/da0 0 2023-10-18T20:58:29.258 INFO:tasks.workunit.client.1.smithi060.stdout:6/362: dread fc [0,4194304] 0 2023-10-18T20:58:29.258 INFO:tasks.workunit.client.1.smithi060.stdout:4/333: link d4/dc/d40/c62 d4/dc/d2a/d13/c63 0 2023-10-18T20:58:29.269 INFO:tasks.workunit.client.1.smithi060.stdout:1/483: mkdir d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e 0 2023-10-18T20:58:29.271 INFO:tasks.workunit.client.1.smithi060.stdout:3/346: creat d0/d3c/d3d/f7a x:0 0 0 2023-10-18T20:58:29.272 INFO:tasks.workunit.client.1.smithi060.stdout:4/334: symlink d4/d15/l64 0 2023-10-18T20:58:29.273 INFO:tasks.workunit.client.1.smithi060.stdout:4/335: stat d4/d15/f45 0 2023-10-18T20:58:29.273 INFO:tasks.workunit.client.1.smithi060.stdout:4/336: chown d4/dc/d2a/d13/f56 34421722 1 2023-10-18T20:58:29.274 INFO:tasks.workunit.client.1.smithi060.stdout:1/484: mknod d4/d6/d7/df/c9f 0 2023-10-18T20:58:29.274 INFO:tasks.workunit.client.1.smithi060.stdout:1/485: chown d4/d6/d33/f7d 121 1 2023-10-18T20:58:29.274 INFO:tasks.workunit.client.1.smithi060.stdout:1/486: stat d4/d6/d7/d2f/d7b/d2a/l66 0 2023-10-18T20:58:29.275 INFO:tasks.workunit.client.1.smithi060.stdout:1/487: readlink d4/d6/d7/df/l12 0 2023-10-18T20:58:29.275 INFO:tasks.workunit.client.1.smithi060.stdout:2/377: dwrite d0/d3/f59 [4194304,4194304] 0 2023-10-18T20:58:29.276 INFO:tasks.workunit.client.0.smithi008.stdout:4/369: dread d0/d17/d5b/d2a/f3c [0,4194304] 0 2023-10-18T20:58:29.276 INFO:tasks.workunit.client.0.smithi008.stdout:2/412: dwrite d1/f1a [0,4194304] 0 2023-10-18T20:58:29.276 INFO:tasks.workunit.client.0.smithi008.stdout:2/413: readlink d1/d3/dd/d1c/l24 0 2023-10-18T20:58:29.282 INFO:tasks.workunit.client.0.smithi008.stdout:6/380: write df/f2e [971433,2604] 0 2023-10-18T20:58:29.284 INFO:tasks.workunit.client.1.smithi060.stdout:4/337: mkdir d4/dc/d2a/d39/d53/d65 0 2023-10-18T20:58:29.289 INFO:tasks.workunit.client.0.smithi008.stdout:0/312: dwrite d0/dd/d29/f63 [0,4194304] 0 2023-10-18T20:58:29.293 INFO:tasks.workunit.client.0.smithi008.stdout:4/370: creat d0/d17/d6e/f7e x:0 0 0 2023-10-18T20:58:29.301 INFO:tasks.workunit.client.0.smithi008.stdout:2/414: chown d1/d3/dd/l21 246 1 2023-10-18T20:58:29.301 INFO:tasks.workunit.client.0.smithi008.stdout:2/415: truncate d1/d3/dd/d1c/d3a/d45/f84 5166286 0 2023-10-18T20:58:29.302 INFO:tasks.workunit.client.0.smithi008.stdout:2/416: write d1/d3/dd/d25/f27 [826169,121747] 0 2023-10-18T20:58:29.303 INFO:tasks.workunit.client.0.smithi008.stdout:0/313: symlink d0/dd/d29/l67 0 2023-10-18T20:58:29.303 INFO:tasks.workunit.client.0.smithi008.stdout:0/314: chown d0/dd/d19/f4e 32895447 1 2023-10-18T20:58:29.304 INFO:tasks.workunit.client.0.smithi008.stdout:0/315: truncate d0/d3a/f5c 757886 0 2023-10-18T20:58:29.304 INFO:tasks.workunit.client.0.smithi008.stdout:7/416: dwrite d1/d36/d3b/d79/f6a [4194304,4194304] 0 2023-10-18T20:58:29.305 INFO:tasks.workunit.client.0.smithi008.stdout:4/371: creat d0/d3/d48/d4c/f7f x:0 0 0 2023-10-18T20:58:29.306 INFO:tasks.workunit.client.1.smithi060.stdout:7/414: dwrite de/d14/d41/d58/d5b/f75 [0,4194304] 0 2023-10-18T20:58:29.306 INFO:tasks.workunit.client.1.smithi060.stdout:7/415: stat de/d29/c4f 0 2023-10-18T20:58:29.306 INFO:tasks.workunit.client.1.smithi060.stdout:7/416: write de/d29/f2b [1596626,41024] 0 2023-10-18T20:58:29.307 INFO:tasks.workunit.client.1.smithi060.stdout:3/347: rmdir d0/d22 39 2023-10-18T20:58:29.307 INFO:tasks.workunit.client.0.smithi008.stdout:2/417: mknod d1/d3/dd/d1c/d3a/d45/d83/c8b 0 2023-10-18T20:58:29.310 INFO:tasks.workunit.client.1.smithi060.stdout:0/388: dwrite d3/f48 [0,4194304] 0 2023-10-18T20:58:29.311 INFO:tasks.workunit.client.1.smithi060.stdout:0/389: stat d3/c1b 0 2023-10-18T20:58:29.313 INFO:tasks.workunit.client.0.smithi008.stdout:3/311: dwrite d0/d3/f43 [0,4194304] 0 2023-10-18T20:58:29.313 INFO:tasks.workunit.client.0.smithi008.stdout:3/312: stat d0/f7 0 2023-10-18T20:58:29.313 INFO:tasks.workunit.client.0.smithi008.stdout:3/313: dread - d0/d3/de/d13/f3a zero size 2023-10-18T20:58:29.313 INFO:tasks.workunit.client.0.smithi008.stdout:3/314: truncate d0/d3/de/d13/f24 892015 0 2023-10-18T20:58:29.313 INFO:tasks.workunit.client.0.smithi008.stdout:3/315: chown d0/f62 6653 1 2023-10-18T20:58:29.314 INFO:tasks.workunit.client.1.smithi060.stdout:7/417: rmdir de/d14/d41/d58 39 2023-10-18T20:58:29.315 INFO:tasks.workunit.client.0.smithi008.stdout:7/417: creat d1/d3/d20/d5f/d7f/f8d x:0 0 0 2023-10-18T20:58:29.317 INFO:tasks.workunit.client.0.smithi008.stdout:7/418: rename d1/d36/d3d/d3e to d1/d36/d3d/d3e/d59/d8e 22 2023-10-18T20:58:29.317 INFO:tasks.workunit.client.0.smithi008.stdout:7/419: read d1/d3/f6b [458248,79367] 0 2023-10-18T20:58:29.322 INFO:tasks.workunit.client.0.smithi008.stdout:4/372: mknod d0/d3/c80 0 2023-10-18T20:58:29.322 INFO:tasks.workunit.client.0.smithi008.stdout:4/373: truncate d0/f27 1636811 0 2023-10-18T20:58:29.324 INFO:tasks.workunit.client.0.smithi008.stdout:2/418: creat d1/f8c x:0 0 0 2023-10-18T20:58:29.324 INFO:tasks.workunit.client.0.smithi008.stdout:2/419: chown d1/d3/dd/d25/f30 259495898 1 2023-10-18T20:58:29.324 INFO:tasks.workunit.client.0.smithi008.stdout:2/420: write d1/d3/dd/d25/d5c/f60 [926896,111898] 0 2023-10-18T20:58:29.325 INFO:tasks.workunit.client.0.smithi008.stdout:0/316: getdents d0/dd/d19/d41 0 2023-10-18T20:58:29.326 INFO:tasks.workunit.client.1.smithi060.stdout:0/390: mknod d3/d8/d14/c7b 0 2023-10-18T20:58:29.326 INFO:tasks.workunit.client.0.smithi008.stdout:0/317: read d0/dd/d29/f39 [102495,113261] 0 2023-10-18T20:58:29.328 INFO:tasks.workunit.client.1.smithi060.stdout:7/418: rmdir de/d14/d49/d68/d7d 39 2023-10-18T20:58:29.328 INFO:tasks.workunit.client.1.smithi060.stdout:7/419: dread - de/d14/d41/d58/d5b/f7a zero size 2023-10-18T20:58:29.329 INFO:tasks.workunit.client.1.smithi060.stdout:6/363: dwrite d10/d17/d28/f24 [0,4194304] 0 2023-10-18T20:58:29.329 INFO:tasks.workunit.client.1.smithi060.stdout:6/364: fsync d10/d17/d2f/d66/f2b 0 2023-10-18T20:58:29.329 INFO:tasks.workunit.client.1.smithi060.stdout:6/365: write d10/d25/d3c/f62 [733881,13852] 0 2023-10-18T20:58:29.330 INFO:tasks.workunit.client.1.smithi060.stdout:6/366: chown d10/d25/l3d 10474 1 2023-10-18T20:58:29.330 INFO:tasks.workunit.client.1.smithi060.stdout:5/413: dwrite d0/d6/d9/d82/f90 [0,4194304] 0 2023-10-18T20:58:29.336 INFO:tasks.workunit.client.1.smithi060.stdout:0/391: rename d3/d8/d14/d55/d74/d76/f6f to d3/d8/d14/f7c 0 2023-10-18T20:58:29.336 INFO:tasks.workunit.client.1.smithi060.stdout:0/392: write d3/d8/d14/f3d [1854240,30978] 0 2023-10-18T20:58:29.336 INFO:tasks.workunit.client.1.smithi060.stdout:7/420: creat de/d14/d3a/d46/d73/f82 x:0 0 0 2023-10-18T20:58:29.339 INFO:tasks.workunit.client.1.smithi060.stdout:6/367: unlink d10/c14 0 2023-10-18T20:58:29.342 INFO:tasks.workunit.client.1.smithi060.stdout:5/414: truncate d0/d6/d8/df/d27/d32/f39 1493383 0 2023-10-18T20:58:29.343 INFO:tasks.workunit.client.1.smithi060.stdout:2/378: dwrite d0/d3/f32 [4194304,4194304] 0 2023-10-18T20:58:29.343 INFO:tasks.workunit.client.1.smithi060.stdout:2/379: write d0/d8/fc [2583048,78985] 0 2023-10-18T20:58:29.347 INFO:tasks.workunit.client.1.smithi060.stdout:7/421: symlink de/d14/d49/d68/l83 0 2023-10-18T20:58:29.349 INFO:tasks.workunit.client.1.smithi060.stdout:4/338: dwrite d4/d15/f51 [0,4194304] 0 2023-10-18T20:58:29.349 INFO:tasks.workunit.client.1.smithi060.stdout:4/339: getdents d4/dc/d2a/d39/d53/d65 0 2023-10-18T20:58:29.349 INFO:tasks.workunit.client.1.smithi060.stdout:6/368: mkdir d10/d2e/d75 0 2023-10-18T20:58:29.351 INFO:tasks.workunit.client.0.smithi008.stdout:3/316: truncate d0/d3/f2e 3292021 0 2023-10-18T20:58:29.352 INFO:tasks.workunit.client.1.smithi060.stdout:5/415: symlink d0/d6/d8/d81/la1 0 2023-10-18T20:58:29.352 INFO:tasks.workunit.client.1.smithi060.stdout:3/348: dwrite d0/d3c/d3d/f3b [0,4194304] 0 2023-10-18T20:58:29.353 INFO:tasks.workunit.client.1.smithi060.stdout:0/393: dread d3/f26 [0,4194304] 0 2023-10-18T20:58:29.353 INFO:tasks.workunit.client.0.smithi008.stdout:6/381: dwrite df/d74/f75 [0,4194304] 0 2023-10-18T20:58:29.354 INFO:tasks.workunit.client.0.smithi008.stdout:6/382: fsync df/d19/f4d 0 2023-10-18T20:58:29.354 INFO:tasks.workunit.client.0.smithi008.stdout:6/383: creat df/d74/f86 x:0 0 0 2023-10-18T20:58:29.356 INFO:tasks.workunit.client.0.smithi008.stdout:7/420: read d1/d36/d3b/d4f/f5b [1452917,11174] 0 2023-10-18T20:58:29.357 INFO:tasks.workunit.client.1.smithi060.stdout:2/380: rename d0/d8/d56 to d0/d45/d49/d6e 0 2023-10-18T20:58:29.358 INFO:tasks.workunit.client.1.smithi060.stdout:2/381: fdatasync d0/d45/d49/f3f 0 2023-10-18T20:58:29.358 INFO:tasks.workunit.client.1.smithi060.stdout:2/382: unlink d0/d43/d4a/f60 0 2023-10-18T20:58:29.363 INFO:tasks.workunit.client.0.smithi008.stdout:4/374: mknod d0/d3/d21/d57/c81 0 2023-10-18T20:58:29.364 INFO:tasks.workunit.client.1.smithi060.stdout:6/369: dread f8 [0,4194304] 0 2023-10-18T20:58:29.366 INFO:tasks.workunit.client.0.smithi008.stdout:5/361: sync 2023-10-18T20:58:29.367 INFO:tasks.workunit.client.0.smithi008.stdout:5/362: readlink d0/d2/d9/l17 0 2023-10-18T20:58:29.368 INFO:tasks.workunit.client.1.smithi060.stdout:7/422: mkdir de/d29/d72/d84 0 2023-10-18T20:58:29.368 INFO:tasks.workunit.client.1.smithi060.stdout:7/423: fdatasync de/d29/f77 0 2023-10-18T20:58:29.368 INFO:tasks.workunit.client.0.smithi008.stdout:2/421: chown d1/d3/dd/d48 0 1 2023-10-18T20:58:29.368 INFO:tasks.workunit.client.0.smithi008.stdout:3/317: write d0/d3/de/d13/f46 [1717089,86959] 0 2023-10-18T20:58:29.370 INFO:tasks.workunit.client.1.smithi060.stdout:4/340: symlink d4/d15/d2b/l66 0 2023-10-18T20:58:29.370 INFO:tasks.workunit.client.1.smithi060.stdout:4/341: fdatasync d4/dc/d2a/d39/f49 0 2023-10-18T20:58:29.371 INFO:tasks.workunit.client.0.smithi008.stdout:3/318: write d0/d3/d42/f30 [437184,42967] 0 2023-10-18T20:58:29.374 INFO:tasks.workunit.client.0.smithi008.stdout:6/384: rename df/d15/d27/d4c/l82 to df/d15/d27/d4c/l87 0 2023-10-18T20:58:29.375 INFO:tasks.workunit.client.0.smithi008.stdout:7/421: mknod d1/d3/d20/d54/c8f 0 2023-10-18T20:58:29.384 INFO:tasks.workunit.client.0.smithi008.stdout:3/319: dread d0/d3/f43 [0,4194304] 0 2023-10-18T20:58:29.384 INFO:tasks.workunit.client.0.smithi008.stdout:0/318: dwrite d0/dd/d19/d24/f5a [0,4194304] 0 2023-10-18T20:58:29.384 INFO:tasks.workunit.client.0.smithi008.stdout:3/320: chown d0/d3/de/d13/c5e 1 1 2023-10-18T20:58:29.401 INFO:tasks.workunit.client.0.smithi008.stdout:3/321: write d0/d3/f33 [2936847,43440] 0 2023-10-18T20:58:29.404 INFO:tasks.workunit.client.0.smithi008.stdout:4/375: mkdir d0/d3/d48/d82 0 2023-10-18T20:58:29.406 INFO:tasks.workunit.client.0.smithi008.stdout:5/363: unlink d0/d2/d9/d34/f37 0 2023-10-18T20:58:29.407 INFO:tasks.workunit.client.1.smithi060.stdout:6/370: dwrite d10/d2e/f3a [0,4194304] 0 2023-10-18T20:58:29.407 INFO:tasks.workunit.client.1.smithi060.stdout:6/371: dread - d10/d17/d28/f5c zero size 2023-10-18T20:58:29.408 INFO:tasks.workunit.client.0.smithi008.stdout:5/364: write d0/d6e/f7d [742356,88033] 0 2023-10-18T20:58:29.408 INFO:tasks.workunit.client.0.smithi008.stdout:5/365: fsync d0/d2/d19/d7c/d58/d65/f36 0 2023-10-18T20:58:29.408 INFO:tasks.workunit.client.0.smithi008.stdout:5/366: chown d0/f8 107631 1 2023-10-18T20:58:29.410 INFO:tasks.workunit.client.0.smithi008.stdout:6/385: rename df/d15/d27/l2c to df/d18/l88 0 2023-10-18T20:58:29.412 INFO:tasks.workunit.client.0.smithi008.stdout:6/386: read df/d15/d27/d38/f39 [318820,78964] 0 2023-10-18T20:58:29.413 INFO:tasks.workunit.client.0.smithi008.stdout:6/387: unlink df/d13/c1b 0 2023-10-18T20:58:29.413 INFO:tasks.workunit.client.0.smithi008.stdout:7/422: mkdir d1/d36/d3b/d4f/d5c/d90 0 2023-10-18T20:58:29.414 INFO:tasks.workunit.client.1.smithi060.stdout:5/416: truncate d0/dd/d33/f3d 223049 0 2023-10-18T20:58:29.414 INFO:tasks.workunit.client.1.smithi060.stdout:5/417: unlink d0/dd/d33/f66 0 2023-10-18T20:58:29.415 INFO:tasks.workunit.client.1.smithi060.stdout:3/349: getdents d0/d22/d26/d29 0 2023-10-18T20:58:29.415 INFO:tasks.workunit.client.1.smithi060.stdout:3/350: creat d0/d3c/d3d/f7b x:0 0 0 2023-10-18T20:58:29.418 INFO:tasks.workunit.client.1.smithi060.stdout:0/394: unlink d3/d8/d3c/f42 0 2023-10-18T20:58:29.422 INFO:tasks.workunit.client.1.smithi060.stdout:1/488: sync 2023-10-18T20:58:29.423 INFO:tasks.workunit.client.1.smithi060.stdout:9/337: sync 2023-10-18T20:58:29.423 INFO:tasks.workunit.client.1.smithi060.stdout:8/366: sync 2023-10-18T20:58:29.423 INFO:tasks.workunit.client.1.smithi060.stdout:9/338: creat d3/d10/d1c/d5a/d5d/d7d/f89 x:0 0 0 2023-10-18T20:58:29.423 INFO:tasks.workunit.client.1.smithi060.stdout:9/339: fdatasync d3/d10/d1c/d5a/d5d/d7d/f7f 0 2023-10-18T20:58:29.431 INFO:tasks.workunit.client.0.smithi008.stdout:3/322: mkdir d0/d4a/d64 0 2023-10-18T20:58:29.431 INFO:tasks.workunit.client.0.smithi008.stdout:3/323: unlink d0/d3/d15/f1a 0 2023-10-18T20:58:29.431 INFO:tasks.workunit.client.0.smithi008.stdout:3/324: dread - d0/f62 zero size 2023-10-18T20:58:29.431 INFO:tasks.workunit.client.0.smithi008.stdout:3/325: stat d0/d4a/d64 0 2023-10-18T20:58:29.432 INFO:tasks.workunit.client.1.smithi060.stdout:2/383: rename d0/d3/l7 to d0/l6f 0 2023-10-18T20:58:29.433 INFO:tasks.workunit.client.1.smithi060.stdout:2/384: fdatasync d0/d3/d27/d4d/f63 0 2023-10-18T20:58:29.433 INFO:tasks.workunit.client.1.smithi060.stdout:6/372: rmdir d10/d3e 39 2023-10-18T20:58:29.433 INFO:tasks.workunit.client.1.smithi060.stdout:4/342: creat d4/dc/d2a/d13/d27/f67 x:0 0 0 2023-10-18T20:58:29.433 INFO:tasks.workunit.client.1.smithi060.stdout:6/373: write d10/f19 [340409,84459] 0 2023-10-18T20:58:29.438 INFO:tasks.workunit.client.0.smithi008.stdout:5/367: link d0/d2/d19/d7c/d41/f5e d0/d2/d19/d7c/d42/d5a/f83 0 2023-10-18T20:58:29.439 INFO:tasks.workunit.client.1.smithi060.stdout:8/367: write d4/ff [1468699,23097] 0 2023-10-18T20:58:29.441 INFO:tasks.workunit.client.1.smithi060.stdout:5/418: write d0/d6/d8/df/d27/f3c [3120515,77368] 0 2023-10-18T20:58:29.441 INFO:tasks.workunit.client.1.smithi060.stdout:5/419: creat d0/d6/d8/df/d27/d32/d4f/fa2 x:0 0 0 2023-10-18T20:58:29.442 INFO:tasks.workunit.client.1.smithi060.stdout:4/343: dread d4/d15/f48 [0,4194304] 0 2023-10-18T20:58:29.442 INFO:tasks.workunit.client.1.smithi060.stdout:4/344: chown d4/dc/d2a/d31/l3e 3843503 1 2023-10-18T20:58:29.442 INFO:tasks.workunit.client.1.smithi060.stdout:4/345: truncate d4/dc/d2a/d5b/f5d 5247567 0 2023-10-18T20:58:29.443 INFO:tasks.workunit.client.1.smithi060.stdout:3/351: symlink d0/d5e/l7c 0 2023-10-18T20:58:29.447 INFO:tasks.workunit.client.1.smithi060.stdout:0/395: mknod d3/d8/c7d 0 2023-10-18T20:58:29.454 INFO:tasks.workunit.client.1.smithi060.stdout:9/340: mknod d3/d10/d1c/d2a/d80/c8a 0 2023-10-18T20:58:29.456 INFO:tasks.workunit.client.0.smithi008.stdout:3/326: dread d0/d3/de/d13/f28 [0,4194304] 0 2023-10-18T20:58:29.457 INFO:tasks.workunit.client.1.smithi060.stdout:2/385: creat d0/d8/f70 x:0 0 0 2023-10-18T20:58:29.459 INFO:tasks.workunit.client.1.smithi060.stdout:7/424: rename de/d14/d49/d68/f4e to de/d29/d72/f85 0 2023-10-18T20:58:29.459 INFO:tasks.workunit.client.0.smithi008.stdout:4/376: dwrite d0/d17/f3d [12582912,4194304] 0 2023-10-18T20:58:29.460 INFO:tasks.workunit.client.0.smithi008.stdout:4/377: fsync d0/d3/f77 0 2023-10-18T20:58:29.460 INFO:tasks.workunit.client.0.smithi008.stdout:4/378: stat d0/d17/d5b/f26 0 2023-10-18T20:58:29.462 INFO:tasks.workunit.client.1.smithi060.stdout:6/374: mkdir d10/d3e/d76 0 2023-10-18T20:58:29.462 INFO:tasks.workunit.client.1.smithi060.stdout:8/368: mkdir d4/d9/d37/d4e/d6e 0 2023-10-18T20:58:29.464 INFO:tasks.workunit.client.1.smithi060.stdout:1/489: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/f5c [0,4194304] 0 2023-10-18T20:58:29.464 INFO:tasks.workunit.client.1.smithi060.stdout:5/420: mknod d0/d6/d9/d82/ca3 0 2023-10-18T20:58:29.466 INFO:tasks.workunit.client.0.smithi008.stdout:6/388: mknod df/d13/d53/d64/c89 0 2023-10-18T20:58:29.467 INFO:tasks.workunit.client.0.smithi008.stdout:1/476: sync 2023-10-18T20:58:29.467 INFO:tasks.workunit.client.0.smithi008.stdout:1/477: write d9/de/df/d17/d1e/d3c/f6f [1295318,58532] 0 2023-10-18T20:58:29.467 INFO:tasks.workunit.client.0.smithi008.stdout:1/478: creat d9/de/df/f8d x:0 0 0 2023-10-18T20:58:29.468 INFO:tasks.workunit.client.1.smithi060.stdout:4/346: mkdir d4/dc/d2a/d13/d27/d68 0 2023-10-18T20:58:29.468 INFO:tasks.workunit.client.1.smithi060.stdout:0/396: mknod d3/d8/d14/d55/c7e 0 2023-10-18T20:58:29.470 INFO:tasks.workunit.client.0.smithi008.stdout:9/355: sync 2023-10-18T20:58:29.470 INFO:tasks.workunit.client.0.smithi008.stdout:9/356: readlink d2/l6 0 2023-10-18T20:58:29.473 INFO:tasks.workunit.client.0.smithi008.stdout:8/494: sync 2023-10-18T20:58:29.473 INFO:tasks.workunit.client.0.smithi008.stdout:8/495: fdatasync d5/d8/d24/d77/f88 0 2023-10-18T20:58:29.474 INFO:tasks.workunit.client.0.smithi008.stdout:0/319: rmdir d0/dd/d29 39 2023-10-18T20:58:29.477 INFO:tasks.workunit.client.1.smithi060.stdout:5/421: mkdir d0/d6/d8/da4 0 2023-10-18T20:58:29.477 INFO:tasks.workunit.client.1.smithi060.stdout:1/490: mkdir d4/d38/da0 0 2023-10-18T20:58:29.477 INFO:tasks.workunit.client.1.smithi060.stdout:8/369: mkdir d4/d9/d31/d6f 0 2023-10-18T20:58:29.478 INFO:tasks.workunit.client.1.smithi060.stdout:8/370: fsync d4/d9/d31/d35/f44 0 2023-10-18T20:58:29.478 INFO:tasks.workunit.client.1.smithi060.stdout:8/371: write d4/f53 [2217965,46544] 0 2023-10-18T20:58:29.478 INFO:tasks.workunit.client.1.smithi060.stdout:4/347: mkdir d4/dc/d2a/d2d/d69 0 2023-10-18T20:58:29.478 INFO:tasks.workunit.client.1.smithi060.stdout:4/348: read - d4/dc/f5e zero size 2023-10-18T20:58:29.480 INFO:tasks.workunit.client.0.smithi008.stdout:5/368: dread d0/d6e/f7d [0,4194304] 0 2023-10-18T20:58:29.480 INFO:tasks.workunit.client.0.smithi008.stdout:3/327: dread d0/d3/de/f20 [0,4194304] 0 2023-10-18T20:58:29.480 INFO:tasks.workunit.client.0.smithi008.stdout:3/328: fdatasync d0/d3/de/d13/f46 0 2023-10-18T20:58:29.480 INFO:tasks.workunit.client.0.smithi008.stdout:3/329: chown d0/d3/d42/l38 2 1 2023-10-18T20:58:29.480 INFO:tasks.workunit.client.0.smithi008.stdout:3/330: readlink d0/d3/d15/l48 0 2023-10-18T20:58:29.481 INFO:tasks.workunit.client.1.smithi060.stdout:2/386: truncate d0/d3/d27/f46 1808390 0 2023-10-18T20:58:29.481 INFO:tasks.workunit.client.1.smithi060.stdout:2/387: creat d0/f71 x:0 0 0 2023-10-18T20:58:29.481 INFO:tasks.workunit.client.1.smithi060.stdout:2/388: fsync d0/f5d 0 2023-10-18T20:58:29.481 INFO:tasks.workunit.client.1.smithi060.stdout:2/389: truncate d0/d8/fd 5366493 0 2023-10-18T20:58:29.481 INFO:tasks.workunit.client.1.smithi060.stdout:2/390: stat d0/d3/d27/d4d/l6b 0 2023-10-18T20:58:29.482 INFO:tasks.workunit.client.1.smithi060.stdout:6/375: getdents d10/d17 0 2023-10-18T20:58:29.483 INFO:tasks.workunit.client.0.smithi008.stdout:3/331: rename d0 to d0/d5f/d65 22 2023-10-18T20:58:29.483 INFO:tasks.workunit.client.0.smithi008.stdout:4/379: truncate d0/d17/d5b/d2a/f3c 330717 0 2023-10-18T20:58:29.483 INFO:tasks.workunit.client.0.smithi008.stdout:4/380: stat d0/d3/f1e 0 2023-10-18T20:58:29.483 INFO:tasks.workunit.client.0.smithi008.stdout:6/389: mknod df/c8a 0 2023-10-18T20:58:29.484 INFO:tasks.workunit.client.0.smithi008.stdout:3/332: fdatasync d0/d3/d15/f44 0 2023-10-18T20:58:29.484 INFO:tasks.workunit.client.0.smithi008.stdout:3/333: creat d0/d4a/f66 x:0 0 0 2023-10-18T20:58:29.487 INFO:tasks.workunit.client.0.smithi008.stdout:8/496: unlink d5/f18 0 2023-10-18T20:58:29.488 INFO:tasks.workunit.client.1.smithi060.stdout:4/349: creat d4/f6a x:0 0 0 2023-10-18T20:58:29.488 INFO:tasks.workunit.client.1.smithi060.stdout:8/372: mknod d4/d9/d4f/c70 0 2023-10-18T20:58:29.488 INFO:tasks.workunit.client.1.smithi060.stdout:8/373: getdents d4/d9/d31/d6f 0 2023-10-18T20:58:29.491 INFO:tasks.workunit.client.0.smithi008.stdout:4/381: unlink d0/d3/f5e 0 2023-10-18T20:58:29.494 INFO:tasks.workunit.client.0.smithi008.stdout:0/320: getdents d0/dd/d19/d24 0 2023-10-18T20:58:29.496 INFO:tasks.workunit.client.1.smithi060.stdout:8/374: creat d4/d9/d4f/f71 x:0 0 0 2023-10-18T20:58:29.496 INFO:tasks.workunit.client.1.smithi060.stdout:8/375: chown d4/d9/c49 454936370 1 2023-10-18T20:58:29.497 INFO:tasks.workunit.client.1.smithi060.stdout:1/491: dread d4/d6/d7/d2f/f6a [0,4194304] 0 2023-10-18T20:58:29.497 INFO:tasks.workunit.client.1.smithi060.stdout:1/492: write d4/d6/d7/d2f/f70 [1044461,9043] 0 2023-10-18T20:58:29.497 INFO:tasks.workunit.client.1.smithi060.stdout:1/493: truncate d4/d6/f1f 9192660 0 2023-10-18T20:58:29.498 INFO:tasks.workunit.client.0.smithi008.stdout:8/497: mkdir d5/d8/d24/d50/dbe 0 2023-10-18T20:58:29.498 INFO:tasks.workunit.client.0.smithi008.stdout:8/498: fsync d5/d8/df/f9a 0 2023-10-18T20:58:29.499 INFO:tasks.workunit.client.1.smithi060.stdout:6/376: dread d10/d17/d2f/d66/f4a [0,4194304] 0 2023-10-18T20:58:29.501 INFO:tasks.workunit.client.1.smithi060.stdout:8/376: symlink d4/d9/d31/d6f/l72 0 2023-10-18T20:58:29.502 INFO:tasks.workunit.client.0.smithi008.stdout:0/321: mknod d0/dd/d19/d5f/c68 0 2023-10-18T20:58:29.502 INFO:tasks.workunit.client.0.smithi008.stdout:0/322: dread - d0/dd/d29/f5b zero size 2023-10-18T20:58:29.502 INFO:tasks.workunit.client.0.smithi008.stdout:0/323: stat d0/dd/f15 0 2023-10-18T20:58:29.503 INFO:tasks.workunit.client.1.smithi060.stdout:1/494: mknod d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/ca1 0 2023-10-18T20:58:29.504 INFO:tasks.workunit.client.1.smithi060.stdout:6/377: mkdir d10/d2e/d75/d77 0 2023-10-18T20:58:29.504 INFO:tasks.workunit.client.0.smithi008.stdout:9/357: dread d2/dc/f4e [0,4194304] 0 2023-10-18T20:58:29.509 INFO:tasks.workunit.client.0.smithi008.stdout:5/369: dread d0/d2/d19/d7c/d58/d65/f59 [0,4194304] 0 2023-10-18T20:58:29.509 INFO:tasks.workunit.client.0.smithi008.stdout:5/370: write d0/d2/d19/d7c/f6b [4029421,34405] 0 2023-10-18T20:58:29.509 INFO:tasks.workunit.client.0.smithi008.stdout:5/371: truncate d0/d2/d19/d7c/f2a 2288427 0 2023-10-18T20:58:29.510 INFO:tasks.workunit.client.1.smithi060.stdout:8/377: mknod d4/d9/d37/d4e/d5e/c73 0 2023-10-18T20:58:29.510 INFO:tasks.workunit.client.1.smithi060.stdout:1/495: truncate d4/da/f53 1586949 0 2023-10-18T20:58:29.511 INFO:tasks.workunit.client.1.smithi060.stdout:1/496: truncate d4/d6/d7/d2f/d7b/d2a/d32/dd/f4f 4276668 0 2023-10-18T20:58:29.513 INFO:tasks.workunit.client.1.smithi060.stdout:8/378: mkdir d4/d9/d4f/d74 0 2023-10-18T20:58:29.514 INFO:tasks.workunit.client.1.smithi060.stdout:8/379: stat d4/d9/d37/l39 0 2023-10-18T20:58:29.516 INFO:tasks.workunit.client.0.smithi008.stdout:0/324: symlink d0/dd/df/d2a/l69 0 2023-10-18T20:58:29.518 INFO:tasks.workunit.client.1.smithi060.stdout:6/378: dread d10/d2e/f4e [0,4194304] 0 2023-10-18T20:58:29.520 INFO:tasks.workunit.client.1.smithi060.stdout:6/379: rename d10/d25/l36 to d10/d25/l78 0 2023-10-18T20:58:29.522 INFO:tasks.workunit.client.1.smithi060.stdout:0/397: write d3/d8/d14/f3d [1651398,78224] 0 2023-10-18T20:58:29.522 INFO:tasks.workunit.client.1.smithi060.stdout:0/398: readlink d3/d8/d3c/l4a 0 2023-10-18T20:58:29.525 INFO:tasks.workunit.client.1.smithi060.stdout:0/399: mkdir d3/d8/d14/d55/d74/d76/d68/d7f 0 2023-10-18T20:58:29.525 INFO:tasks.workunit.client.1.smithi060.stdout:0/400: chown d3/c1b 5217 1 2023-10-18T20:58:29.526 INFO:tasks.workunit.client.1.smithi060.stdout:8/380: fsync d4/ff 0 2023-10-18T20:58:29.526 INFO:tasks.workunit.client.1.smithi060.stdout:8/381: unlink d4/d9/l2c 0 2023-10-18T20:58:29.526 INFO:tasks.workunit.client.1.smithi060.stdout:8/382: readlink d4/l1c 0 2023-10-18T20:58:29.527 INFO:tasks.workunit.client.1.smithi060.stdout:8/383: write d4/d9/d4f/f5d [1059744,48073] 0 2023-10-18T20:58:29.528 INFO:tasks.workunit.client.1.smithi060.stdout:6/380: dread d10/d2e/f33 [0,4194304] 0 2023-10-18T20:58:29.530 INFO:tasks.workunit.client.0.smithi008.stdout:5/372: write d0/d2/f7 [4003452,78639] 0 2023-10-18T20:58:29.538 INFO:tasks.workunit.client.1.smithi060.stdout:4/350: rmdir d4/dc/d2a/d13/d27 39 2023-10-18T20:58:29.541 INFO:tasks.workunit.client.0.smithi008.stdout:4/382: dread d0/d17/f3a [8388608,4194304] 0 2023-10-18T20:58:29.542 INFO:tasks.workunit.client.0.smithi008.stdout:1/479: dread d9/de/df/d17/d25/f29 [0,4194304] 0 2023-10-18T20:58:29.545 INFO:tasks.workunit.client.0.smithi008.stdout:7/423: dwrite d1/d3/f1d [0,4194304] 0 2023-10-18T20:58:29.548 INFO:tasks.workunit.client.1.smithi060.stdout:2/391: fsync d0/f71 0 2023-10-18T20:58:29.549 INFO:tasks.workunit.client.1.smithi060.stdout:0/401: mkdir d3/d80 0 2023-10-18T20:58:29.549 INFO:tasks.workunit.client.1.smithi060.stdout:0/402: creat d3/f81 x:0 0 0 2023-10-18T20:58:29.549 INFO:tasks.workunit.client.1.smithi060.stdout:0/403: fsync d3/d8/f2d 0 2023-10-18T20:58:29.549 INFO:tasks.workunit.client.1.smithi060.stdout:0/404: chown d3/d8/d14/d55/d74/d76/d68 106 1 2023-10-18T20:58:29.554 INFO:tasks.workunit.client.0.smithi008.stdout:6/390: dwrite df/d15/d27/f4a [0,4194304] 0 2023-10-18T20:58:29.556 INFO:tasks.workunit.client.1.smithi060.stdout:3/352: dwrite d0/f4e [0,4194304] 0 2023-10-18T20:58:29.556 INFO:tasks.workunit.client.1.smithi060.stdout:3/353: readlink d0/d22/d26/d2b/l49 0 2023-10-18T20:58:29.560 INFO:tasks.workunit.client.1.smithi060.stdout:7/425: dwrite de/d14/d2f/f3c [0,4194304] 0 2023-10-18T20:58:29.561 INFO:tasks.workunit.client.1.smithi060.stdout:7/426: write de/d14/d49/d68/f40 [4913801,52091] 0 2023-10-18T20:58:29.563 INFO:tasks.workunit.client.0.smithi008.stdout:9/358: dread d2/dc/f4c [0,4194304] 0 2023-10-18T20:58:29.563 INFO:tasks.workunit.client.0.smithi008.stdout:1/480: rename d9/de/df/d17/d25/f29 to d9/de/df/d17/d1e/d7d/d89/f8e 0 2023-10-18T20:58:29.564 INFO:tasks.workunit.client.0.smithi008.stdout:3/334: dwrite d0/f54 [0,4194304] 0 2023-10-18T20:58:29.564 INFO:tasks.workunit.client.0.smithi008.stdout:0/325: write d0/dd/d19/d24/f5a [3636980,115351] 0 2023-10-18T20:58:29.564 INFO:tasks.workunit.client.0.smithi008.stdout:0/326: truncate d0/dd/d19/d24/f35 4325200 0 2023-10-18T20:58:29.565 INFO:tasks.workunit.client.1.smithi060.stdout:7/427: write de/f6f [132356,83357] 0 2023-10-18T20:58:29.565 INFO:tasks.workunit.client.1.smithi060.stdout:7/428: fdatasync de/d14/d41/d58/d5b/f74 0 2023-10-18T20:58:29.566 INFO:tasks.workunit.client.1.smithi060.stdout:8/384: link d4/d9/d37/f3c d4/d9/d31/d6f/f75 0 2023-10-18T20:58:29.566 INFO:tasks.workunit.client.1.smithi060.stdout:6/381: mkdir d10/d17/d2f/d66/d79 0 2023-10-18T20:58:29.567 INFO:tasks.workunit.client.1.smithi060.stdout:6/382: write d10/d17/f4b [859577,107959] 0 2023-10-18T20:58:29.567 INFO:tasks.workunit.client.1.smithi060.stdout:6/383: chown d10/d2e/f50 8794 1 2023-10-18T20:58:29.567 INFO:tasks.workunit.client.1.smithi060.stdout:6/384: chown d10/d17/d70 4093 1 2023-10-18T20:58:29.567 INFO:tasks.workunit.client.1.smithi060.stdout:1/497: dread d4/d6/f1f [4194304,4194304] 0 2023-10-18T20:58:29.572 INFO:tasks.workunit.client.0.smithi008.stdout:7/424: rmdir d1/d36/d3b/d4f/d5c/d90 0 2023-10-18T20:58:29.572 INFO:tasks.workunit.client.0.smithi008.stdout:7/425: truncate d1/d36/d3d/d3e/f55 674527 0 2023-10-18T20:58:29.573 INFO:tasks.workunit.client.0.smithi008.stdout:7/426: truncate d1/d3/f1d 4915685 0 2023-10-18T20:58:29.573 INFO:tasks.workunit.client.0.smithi008.stdout:8/499: dwrite d5/d8/df/d2e/f8a [0,4194304] 0 2023-10-18T20:58:29.573 INFO:tasks.workunit.client.0.smithi008.stdout:8/500: fdatasync d5/d8/df/d9d/d4d/f7c 0 2023-10-18T20:58:29.575 INFO:tasks.workunit.client.1.smithi060.stdout:2/392: symlink d0/d43/d4a/l72 0 2023-10-18T20:58:29.575 INFO:tasks.workunit.client.1.smithi060.stdout:0/405: creat d3/d80/f82 x:0 0 0 2023-10-18T20:58:29.576 INFO:tasks.workunit.client.1.smithi060.stdout:4/351: unlink d4/c12 0 2023-10-18T20:58:29.576 INFO:tasks.workunit.client.1.smithi060.stdout:2/393: write d0/d8/d47/f4b [2078912,39544] 0 2023-10-18T20:58:29.577 INFO:tasks.workunit.client.1.smithi060.stdout:9/341: dwrite d3/d10/d19/f4e [0,4194304] 0 2023-10-18T20:58:29.584 INFO:tasks.workunit.client.0.smithi008.stdout:9/359: rmdir d2/dc/d1a 39 2023-10-18T20:58:29.584 INFO:tasks.workunit.client.0.smithi008.stdout:3/335: truncate d0/d3/de/d13/d35/f3b 568575 0 2023-10-18T20:58:29.585 INFO:tasks.workunit.client.0.smithi008.stdout:1/481: truncate d9/de/f15 1175086 0 2023-10-18T20:58:29.585 INFO:tasks.workunit.client.0.smithi008.stdout:1/482: stat d9/de/df/d17/d25/d57/f87 0 2023-10-18T20:58:29.591 INFO:tasks.workunit.client.1.smithi060.stdout:8/385: rename d4/c10 to d4/d9/d4f/d74/c76 0 2023-10-18T20:58:29.591 INFO:tasks.workunit.client.1.smithi060.stdout:8/386: chown d4/d9/d37/c46 654 1 2023-10-18T20:58:29.593 INFO:tasks.workunit.client.1.smithi060.stdout:1/498: mknod d4/d6/d33/ca2 0 2023-10-18T20:58:29.595 INFO:tasks.workunit.client.0.smithi008.stdout:4/383: dwrite d0/d17/f23 [0,4194304] 0 2023-10-18T20:58:29.596 INFO:tasks.workunit.client.0.smithi008.stdout:6/391: dread df/d74/f75 [0,4194304] 0 2023-10-18T20:58:29.596 INFO:tasks.workunit.client.0.smithi008.stdout:6/392: chown l0 162309 1 2023-10-18T20:58:29.598 INFO:tasks.workunit.client.1.smithi060.stdout:6/385: mkdir d10/d17/d7a 0 2023-10-18T20:58:29.607 INFO:tasks.workunit.client.1.smithi060.stdout:3/354: dwrite d0/d22/d26/d29/f45 [0,4194304] 0 2023-10-18T20:58:29.608 INFO:tasks.workunit.client.1.smithi060.stdout:3/355: chown d0/d22/d50 38 1 2023-10-18T20:58:29.620 INFO:tasks.workunit.client.0.smithi008.stdout:9/360: dread d2/dc/d17/d19/f55 [0,4194304] 0 2023-10-18T20:58:29.620 INFO:tasks.workunit.client.1.smithi060.stdout:7/429: dwrite de/d14/d41/d58/d5b/f7a [0,4194304] 0 2023-10-18T20:58:29.625 INFO:tasks.workunit.client.0.smithi008.stdout:2/422: sync 2023-10-18T20:58:29.637 INFO:tasks.workunit.client.0.smithi008.stdout:7/427: symlink d1/d3/d20/d5f/d7f/l91 0 2023-10-18T20:58:29.637 INFO:tasks.workunit.client.0.smithi008.stdout:2/423: write d1/d3/f4b [205990,127121] 0 2023-10-18T20:58:29.637 INFO:tasks.workunit.client.0.smithi008.stdout:8/501: mkdir d5/d8/d24/d50/d53/d8c/db4/db7/dbf 0 2023-10-18T20:58:29.640 INFO:tasks.workunit.client.0.smithi008.stdout:9/361: write d2/dc/d40/d46/f51 [2977895,60715] 0 2023-10-18T20:58:29.641 INFO:tasks.workunit.client.1.smithi060.stdout:0/406: getdents d3/d8 0 2023-10-18T20:58:29.641 INFO:tasks.workunit.client.0.smithi008.stdout:3/336: getdents d0/d3/de/d13/d35/d51 0 2023-10-18T20:58:29.642 INFO:tasks.workunit.client.0.smithi008.stdout:4/384: mkdir d0/d58/d83 0 2023-10-18T20:58:29.642 INFO:tasks.workunit.client.1.smithi060.stdout:4/352: creat d4/dc/d2a/d13/d27/d68/f6b x:0 0 0 2023-10-18T20:58:29.643 INFO:tasks.workunit.client.0.smithi008.stdout:6/393: mknod df/d15/d48/d81/c8b 0 2023-10-18T20:58:29.643 INFO:tasks.workunit.client.1.smithi060.stdout:2/394: truncate d0/d3/f32 687825 0 2023-10-18T20:58:29.649 INFO:tasks.workunit.client.0.smithi008.stdout:9/362: link d2/dc/f1c d2/dc/d1a/d61/f62 0 2023-10-18T20:58:29.649 INFO:tasks.workunit.client.0.smithi008.stdout:9/363: chown d2/dc/d1a/f54 80 1 2023-10-18T20:58:29.649 INFO:tasks.workunit.client.0.smithi008.stdout:9/364: stat d2/d8/l38 0 2023-10-18T20:58:29.653 INFO:tasks.workunit.client.1.smithi060.stdout:9/342: truncate d3/d10/d19/d54/f42 652700 0 2023-10-18T20:58:29.654 INFO:tasks.workunit.client.1.smithi060.stdout:8/387: symlink d4/d9/d37/d4e/d5e/l77 0 2023-10-18T20:58:29.654 INFO:tasks.workunit.client.0.smithi008.stdout:1/483: mkdir d9/de/df/d17/d69/d8f 0 2023-10-18T20:58:29.655 INFO:tasks.workunit.client.1.smithi060.stdout:1/499: mknod d4/d6/d7/d2f/d7b/d2a/ca3 0 2023-10-18T20:58:29.655 INFO:tasks.workunit.client.1.smithi060.stdout:1/500: truncate d4/d6/d7/df/d59/f6f 256828 0 2023-10-18T20:58:29.656 INFO:tasks.workunit.client.1.smithi060.stdout:6/386: rename d10/d17/d28/c5e to d10/c7b 0 2023-10-18T20:58:29.656 INFO:tasks.workunit.client.1.smithi060.stdout:6/387: fsync d10/d17/d28/f68 0 2023-10-18T20:58:29.657 INFO:tasks.workunit.client.1.smithi060.stdout:6/388: chown d10/d17/d28/f24 0 1 2023-10-18T20:58:29.657 INFO:tasks.workunit.client.1.smithi060.stdout:6/389: chown d10/d25/l49 3 1 2023-10-18T20:58:29.661 INFO:tasks.workunit.client.0.smithi008.stdout:3/337: symlink d0/d3/l67 0 2023-10-18T20:58:29.673 INFO:tasks.workunit.client.0.smithi008.stdout:1/484: mkdir d9/de/df/d17/d1e/d3c/d90 0 2023-10-18T20:58:29.675 INFO:tasks.workunit.client.1.smithi060.stdout:3/356: creat d0/d22/d26/d29/f7d x:0 0 0 2023-10-18T20:58:29.680 INFO:tasks.workunit.client.0.smithi008.stdout:3/338: rename d0/d3/d37/f50 to d0/d3/d42/f68 0 2023-10-18T20:58:29.681 INFO:tasks.workunit.client.0.smithi008.stdout:0/327: dwrite d0/dd/d19/d24/f3d [0,4194304] 0 2023-10-18T20:58:29.681 INFO:tasks.workunit.client.0.smithi008.stdout:0/328: chown d0/dd/d19/d24/l40 61037110 1 2023-10-18T20:58:29.681 INFO:tasks.workunit.client.0.smithi008.stdout:0/329: rename d0 to d0/dd/df/d2a/d6a 22 2023-10-18T20:58:29.681 INFO:tasks.workunit.client.0.smithi008.stdout:0/330: fdatasync d0/dd/d19/d24/f35 0 2023-10-18T20:58:29.682 INFO:tasks.workunit.client.0.smithi008.stdout:0/331: write d0/dd/df/d2a/f4b [939167,72165] 0 2023-10-18T20:58:29.683 INFO:tasks.workunit.client.0.smithi008.stdout:1/485: stat d9/de/df/d17/c18 0 2023-10-18T20:58:29.684 INFO:tasks.workunit.client.0.smithi008.stdout:3/339: write d0/d3/de/d13/f24 [98483,84746] 0 2023-10-18T20:58:29.689 INFO:tasks.workunit.client.1.smithi060.stdout:7/430: dwrite de/f27 [0,4194304] 0 2023-10-18T20:58:29.696 INFO:tasks.workunit.client.1.smithi060.stdout:7/431: dread de/d14/d49/d68/f24 [0,4194304] 0 2023-10-18T20:58:29.700 INFO:tasks.workunit.client.0.smithi008.stdout:7/428: dread d1/d36/d3b/d79/f6a [0,4194304] 0 2023-10-18T20:58:29.700 INFO:tasks.workunit.client.0.smithi008.stdout:7/429: stat d1/d3/l11 0 2023-10-18T20:58:29.706 INFO:tasks.workunit.client.0.smithi008.stdout:6/394: write df/d19/f3e [5516820,89690] 0 2023-10-18T20:58:29.706 INFO:tasks.workunit.client.0.smithi008.stdout:2/424: dwrite d1/d3/dd/d1c/d3a/d57/f67 [0,4194304] 0 2023-10-18T20:58:29.718 INFO:tasks.workunit.client.1.smithi060.stdout:8/388: dwrite d4/d9/f69 [0,4194304] 0 2023-10-18T20:58:29.720 INFO:tasks.workunit.client.0.smithi008.stdout:8/502: dwrite d5/d8/df/f75 [0,4194304] 0 2023-10-18T20:58:29.721 INFO:tasks.workunit.client.0.smithi008.stdout:9/365: dwrite d2/f5 [0,4194304] 0 2023-10-18T20:58:29.723 INFO:tasks.workunit.client.1.smithi060.stdout:5/422: sync 2023-10-18T20:58:29.731 INFO:tasks.workunit.client.1.smithi060.stdout:0/407: truncate d3/fc 7383858 0 2023-10-18T20:58:29.731 INFO:tasks.workunit.client.0.smithi008.stdout:0/332: creat d0/dd/d19/d41/f6b x:0 0 0 2023-10-18T20:58:29.732 INFO:tasks.workunit.client.1.smithi060.stdout:4/353: truncate d4/dc/f58 3215011 0 2023-10-18T20:58:29.733 INFO:tasks.workunit.client.1.smithi060.stdout:4/354: readlink d4/d15/d2b/l66 0 2023-10-18T20:58:29.734 INFO:tasks.workunit.client.1.smithi060.stdout:4/355: creat d4/dc/f6c x:0 0 0 2023-10-18T20:58:29.734 INFO:tasks.workunit.client.1.smithi060.stdout:2/395: mkdir d0/d8/d47/d73 0 2023-10-18T20:58:29.735 INFO:tasks.workunit.client.1.smithi060.stdout:4/356: creat d4/dc/d2a/d13/d27/d68/f6d x:0 0 0 2023-10-18T20:58:29.735 INFO:tasks.workunit.client.0.smithi008.stdout:3/340: mknod d0/d4a/d64/c69 0 2023-10-18T20:58:29.736 INFO:tasks.workunit.client.1.smithi060.stdout:1/501: mkdir d4/d6/d7/d2f/d7b/d2a/d32/dd/da4 0 2023-10-18T20:58:29.736 INFO:tasks.workunit.client.1.smithi060.stdout:1/502: truncate d4/d6/d7/d2f/d7b/d2a/d32/dd/f4f 5187520 0 2023-10-18T20:58:29.736 INFO:tasks.workunit.client.1.smithi060.stdout:1/503: readlink d4/d6/d33/d58/l61 0 2023-10-18T20:58:29.736 INFO:tasks.workunit.client.1.smithi060.stdout:1/504: write d4/d6/d7/d2f/f39 [1669763,11307] 0 2023-10-18T20:58:29.737 INFO:tasks.workunit.client.0.smithi008.stdout:7/430: creat d1/d36/d3b/d79/f92 x:0 0 0 2023-10-18T20:58:29.737 INFO:tasks.workunit.client.0.smithi008.stdout:7/431: write d1/d3/d20/d5f/f72 [520421,125782] 0 2023-10-18T20:58:29.741 INFO:tasks.workunit.client.1.smithi060.stdout:9/343: rename d3/d10/f24 to d3/d10/d1c/d5a/f8b 0 2023-10-18T20:58:29.741 INFO:tasks.workunit.client.1.smithi060.stdout:6/390: symlink d10/d17/d70/l7c 0 2023-10-18T20:58:29.741 INFO:tasks.workunit.client.1.smithi060.stdout:6/391: fsync d10/d17/d2f/d66/f2b 0 2023-10-18T20:58:29.742 INFO:tasks.workunit.client.1.smithi060.stdout:6/392: chown d10/d3e/l5d 1860 1 2023-10-18T20:58:29.742 INFO:tasks.workunit.client.1.smithi060.stdout:6/393: fdatasync d10/d3e/f71 0 2023-10-18T20:58:29.743 INFO:tasks.workunit.client.1.smithi060.stdout:3/357: mknod d0/d22/d26/d2c/c7e 0 2023-10-18T20:58:29.752 INFO:tasks.workunit.client.0.smithi008.stdout:6/395: symlink df/d36/l8c 0 2023-10-18T20:58:29.752 INFO:tasks.workunit.client.0.smithi008.stdout:6/396: fdatasync df/d26/f61 0 2023-10-18T20:58:29.753 INFO:tasks.workunit.client.1.smithi060.stdout:1/505: dread d4/d6/d7/df/f2c [0,4194304] 0 2023-10-18T20:58:29.753 INFO:tasks.workunit.client.1.smithi060.stdout:5/423: dread d0/d6/d8/df/d27/f4d [0,4194304] 0 2023-10-18T20:58:29.753 INFO:tasks.workunit.client.1.smithi060.stdout:5/424: write d0/d6/d8/df/f57 [684555,60006] 0 2023-10-18T20:58:29.753 INFO:tasks.workunit.client.1.smithi060.stdout:5/425: dread - d0/d6/d8/df/d27/d32/d6d/d72/f7a zero size 2023-10-18T20:58:29.754 INFO:tasks.workunit.client.1.smithi060.stdout:5/426: stat d0/d6/d8/df/f57 0 2023-10-18T20:58:29.754 INFO:tasks.workunit.client.1.smithi060.stdout:5/427: readlink d0/d6/d8/df/l53 0 2023-10-18T20:58:29.754 INFO:tasks.workunit.client.1.smithi060.stdout:5/428: write d0/f8a [73799,97137] 0 2023-10-18T20:58:29.754 INFO:tasks.workunit.client.1.smithi060.stdout:5/429: write d0/d6/d8/f6b [1336668,10749] 0 2023-10-18T20:58:29.755 INFO:tasks.workunit.client.1.smithi060.stdout:9/344: read d3/d58/f7b [11865,22437] 0 2023-10-18T20:58:29.759 INFO:tasks.workunit.client.0.smithi008.stdout:2/425: creat d1/d3/dd/d25/d76/f8d x:0 0 0 2023-10-18T20:58:29.767 INFO:tasks.workunit.client.1.smithi060.stdout:6/394: dread d10/d17/d54/f5a [0,4194304] 0 2023-10-18T20:58:29.767 INFO:tasks.workunit.client.1.smithi060.stdout:6/395: fdatasync d10/d17/d2f/d66/f41 0 2023-10-18T20:58:29.768 INFO:tasks.workunit.client.1.smithi060.stdout:6/396: readlink d10/d25/l49 0 2023-10-18T20:58:29.768 INFO:tasks.workunit.client.1.smithi060.stdout:8/389: stat d4/d9/c4c 0 2023-10-18T20:58:29.768 INFO:tasks.workunit.client.1.smithi060.stdout:6/397: creat d10/d17/d2f/f7d x:0 0 0 2023-10-18T20:58:29.769 INFO:tasks.workunit.client.1.smithi060.stdout:6/398: write d10/d17/d2f/d66/f4a [3249879,23130] 0 2023-10-18T20:58:29.771 INFO:tasks.workunit.client.1.smithi060.stdout:6/399: read d10/d17/d2f/f64 [793512,59413] 0 2023-10-18T20:58:29.774 INFO:tasks.workunit.client.1.smithi060.stdout:1/506: dread d4/da/f5a [0,4194304] 0 2023-10-18T20:58:29.774 INFO:tasks.workunit.client.1.smithi060.stdout:1/507: fdatasync d4/da/f5b 0 2023-10-18T20:58:29.774 INFO:tasks.workunit.client.1.smithi060.stdout:1/508: creat d4/d6/d14/d41/fa5 x:0 0 0 2023-10-18T20:58:29.775 INFO:tasks.workunit.client.0.smithi008.stdout:3/341: dwrite d0/f62 [0,4194304] 0 2023-10-18T20:58:29.782 INFO:tasks.workunit.client.1.smithi060.stdout:2/396: creat d0/d3/d27/d4d/d5e/f74 x:0 0 0 2023-10-18T20:58:29.787 INFO:tasks.workunit.client.1.smithi060.stdout:0/408: rename d3/d8/d14/d55/f58 to d3/d8/d14/d55/d74/d76/f83 0 2023-10-18T20:58:29.787 INFO:tasks.workunit.client.1.smithi060.stdout:7/432: getdents de/d14/d41/d58/d5b 0 2023-10-18T20:58:29.790 INFO:tasks.workunit.client.1.smithi060.stdout:9/345: symlink d3/d10/d65/l8c 0 2023-10-18T20:58:29.791 INFO:tasks.workunit.client.1.smithi060.stdout:9/346: creat d3/d10/d1c/d5a/f8d x:0 0 0 2023-10-18T20:58:29.793 INFO:tasks.workunit.client.1.smithi060.stdout:4/357: creat d4/d15/f6e x:0 0 0 2023-10-18T20:58:29.795 INFO:tasks.workunit.client.1.smithi060.stdout:2/397: dread d0/d8/fd [4194304,4194304] 0 2023-10-18T20:58:29.796 INFO:tasks.workunit.client.1.smithi060.stdout:2/398: dread - d0/d3/d27/d4d/d53/f5c zero size 2023-10-18T20:58:29.796 INFO:tasks.workunit.client.1.smithi060.stdout:2/399: chown d0/d3/d27/d4d/d5e/f74 290 1 2023-10-18T20:58:29.798 INFO:tasks.workunit.client.1.smithi060.stdout:6/400: symlink d10/d17/d2f/d66/d79/l7e 0 2023-10-18T20:58:29.798 INFO:tasks.workunit.client.1.smithi060.stdout:8/390: symlink d4/d9/d31/d6f/l78 0 2023-10-18T20:58:29.798 INFO:tasks.workunit.client.1.smithi060.stdout:8/391: fsync d4/d9/f21 0 2023-10-18T20:58:29.803 INFO:tasks.workunit.client.1.smithi060.stdout:3/358: dwrite d0/f1b [0,4194304] 0 2023-10-18T20:58:29.805 INFO:tasks.workunit.client.0.smithi008.stdout:1/486: rename d9/l59 to d9/de/df/d17/d69/l91 0 2023-10-18T20:58:29.809 INFO:tasks.workunit.client.1.smithi060.stdout:1/509: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/fa6 x:0 0 0 2023-10-18T20:58:29.809 INFO:tasks.workunit.client.1.smithi060.stdout:1/510: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f8e 65307049 1 2023-10-18T20:58:29.810 INFO:tasks.workunit.client.1.smithi060.stdout:0/409: read d3/d8/f28 [2450400,75068] 0 2023-10-18T20:58:29.811 INFO:tasks.workunit.client.0.smithi008.stdout:1/487: dread d9/de/df/d17/d1e/f4c [0,4194304] 0 2023-10-18T20:58:29.812 INFO:tasks.workunit.client.0.smithi008.stdout:1/488: chown d9/de/df/d17/d69/l91 1 1 2023-10-18T20:58:29.818 INFO:tasks.workunit.client.1.smithi060.stdout:1/511: dread d4/d6/d33/d58/f76 [0,4194304] 0 2023-10-18T20:58:29.818 INFO:tasks.workunit.client.1.smithi060.stdout:1/512: write d4/d6/d7/d2f/d7b/d2a/d32/dd/d81/f96 [233597,33645] 0 2023-10-18T20:58:29.818 INFO:tasks.workunit.client.1.smithi060.stdout:1/513: fdatasync d4/d6/d14/f8a 0 2023-10-18T20:58:29.820 INFO:tasks.workunit.client.1.smithi060.stdout:9/347: mknod d3/d10/c8e 0 2023-10-18T20:58:29.820 INFO:tasks.workunit.client.1.smithi060.stdout:9/348: truncate d3/d10/d19/d54/f4a 753590 0 2023-10-18T20:58:29.821 INFO:tasks.workunit.client.0.smithi008.stdout:8/503: mkdir d5/d8/d24/d50/d53/dc0 0 2023-10-18T20:58:29.822 INFO:tasks.workunit.client.1.smithi060.stdout:2/400: link d0/f10 d0/d3/d27/d62/d6c/f75 0 2023-10-18T20:58:29.822 INFO:tasks.workunit.client.1.smithi060.stdout:2/401: read d0/f10 [942825,49144] 0 2023-10-18T20:58:29.823 INFO:tasks.workunit.client.0.smithi008.stdout:9/366: unlink d2/d8/l4f 0 2023-10-18T20:58:29.824 INFO:tasks.workunit.client.0.smithi008.stdout:5/373: sync 2023-10-18T20:58:29.826 INFO:tasks.workunit.client.1.smithi060.stdout:8/392: rename d4/d9/f69 to d4/d9/f79 0 2023-10-18T20:58:29.826 INFO:tasks.workunit.client.1.smithi060.stdout:8/393: fsync d4/f1f 0 2023-10-18T20:58:29.827 INFO:tasks.workunit.client.0.smithi008.stdout:0/333: symlink d0/l6c 0 2023-10-18T20:58:29.828 INFO:tasks.workunit.client.0.smithi008.stdout:7/432: creat d1/d3/d8b/f93 x:0 0 0 2023-10-18T20:58:29.830 INFO:tasks.workunit.client.1.smithi060.stdout:0/410: getdents d3/d8/d14/d55/d74 0 2023-10-18T20:58:29.831 INFO:tasks.workunit.client.1.smithi060.stdout:0/411: chown d3/d8/d3c/l4e 1798455 1 2023-10-18T20:58:29.833 INFO:tasks.workunit.client.0.smithi008.stdout:2/426: mknod d1/d3/dd/d1c/d3a/d49/c8e 0 2023-10-18T20:58:29.835 INFO:tasks.workunit.client.0.smithi008.stdout:3/342: creat d0/d4a/d64/f6a x:0 0 0 2023-10-18T20:58:29.837 INFO:tasks.workunit.client.0.smithi008.stdout:8/504: creat d5/d8/df/d9d/d4d/db5/fc1 x:0 0 0 2023-10-18T20:58:29.837 INFO:tasks.workunit.client.0.smithi008.stdout:8/505: creat d5/d8/df/d9d/d85/db1/fc2 x:0 0 0 2023-10-18T20:58:29.838 INFO:tasks.workunit.client.0.smithi008.stdout:8/506: fsync d5/d8/df/d9d/d4d/f4f 0 2023-10-18T20:58:29.838 INFO:tasks.workunit.client.0.smithi008.stdout:8/507: chown d5/d8/d24/d50/f6a 10382 1 2023-10-18T20:58:29.839 INFO:tasks.workunit.client.1.smithi060.stdout:2/402: unlink d0/d8/f42 0 2023-10-18T20:58:29.840 INFO:tasks.workunit.client.1.smithi060.stdout:2/403: truncate d0/d3/f5a 623631 0 2023-10-18T20:58:29.840 INFO:tasks.workunit.client.1.smithi060.stdout:2/404: chown d0/d16/f28 1706036206 1 2023-10-18T20:58:29.840 INFO:tasks.workunit.client.0.smithi008.stdout:9/367: truncate d2/dc/d1a/f5b 1615857 0 2023-10-18T20:58:29.841 INFO:tasks.workunit.client.0.smithi008.stdout:9/368: truncate d2/dc/d1a/f54 4731373 0 2023-10-18T20:58:29.842 INFO:tasks.workunit.client.0.smithi008.stdout:5/374: creat d0/d2/d19/d7c/d42/f84 x:0 0 0 2023-10-18T20:58:29.842 INFO:tasks.workunit.client.0.smithi008.stdout:5/375: readlink d0/d2/d19/d7c/d41/l6d 0 2023-10-18T20:58:29.843 INFO:tasks.workunit.client.1.smithi060.stdout:8/394: link d4/c68 d4/d9/d37/d4e/d6e/c7a 0 2023-10-18T20:58:29.847 INFO:tasks.workunit.client.1.smithi060.stdout:0/412: creat d3/d8/d14/d55/d74/d76/d68/f84 x:0 0 0 2023-10-18T20:58:29.848 INFO:tasks.workunit.client.1.smithi060.stdout:0/413: write d3/d8/f22 [4697824,62807] 0 2023-10-18T20:58:29.848 INFO:tasks.workunit.client.1.smithi060.stdout:0/414: truncate d3/d8/d14/d55/d74/d76/f63 586147 0 2023-10-18T20:58:29.852 INFO:tasks.workunit.client.0.smithi008.stdout:7/433: mknod d1/d3/d20/d5f/d78/c94 0 2023-10-18T20:58:29.852 INFO:tasks.workunit.client.0.smithi008.stdout:7/434: fsync d1/d36/d3d/d3e/f31 0 2023-10-18T20:58:29.853 INFO:tasks.workunit.client.1.smithi060.stdout:5/430: rename d0/dd/d33 to d0/da/d79/da5 0 2023-10-18T20:58:29.854 INFO:tasks.workunit.client.0.smithi008.stdout:9/369: dread d2/dc/d1a/d1d/f58 [0,4194304] 0 2023-10-18T20:58:29.854 INFO:tasks.workunit.client.0.smithi008.stdout:9/370: creat d2/dc/d1a/d1d/f63 x:0 0 0 2023-10-18T20:58:29.857 INFO:tasks.workunit.client.0.smithi008.stdout:3/343: creat d0/d3/d42/d52/f6b x:0 0 0 2023-10-18T20:58:29.860 INFO:tasks.workunit.client.1.smithi060.stdout:0/415: getdents d3/d8/d14/d55/d74/d76 0 2023-10-18T20:58:29.862 INFO:tasks.workunit.client.1.smithi060.stdout:5/431: link d0/da/d3b/c89 d0/d6/d8/df/d27/d32/d6d/d72/d41/ca6 0 2023-10-18T20:58:29.866 INFO:tasks.workunit.client.1.smithi060.stdout:0/416: rename d3/f24 to d3/d8/d14/d55/d74/f85 0 2023-10-18T20:58:29.867 INFO:tasks.workunit.client.1.smithi060.stdout:9/349: dread d3/d10/d1c/d2a/f52 [0,4194304] 0 2023-10-18T20:58:29.867 INFO:tasks.workunit.client.1.smithi060.stdout:7/433: dwrite de/d29/f37 [0,4194304] 0 2023-10-18T20:58:29.867 INFO:tasks.workunit.client.1.smithi060.stdout:7/434: fsync de/d14/d2f/f3c 0 2023-10-18T20:58:29.868 INFO:tasks.workunit.client.0.smithi008.stdout:3/344: rmdir d0/d3/de/d13/d35/d51 39 2023-10-18T20:58:29.868 INFO:tasks.workunit.client.0.smithi008.stdout:3/345: dread - d0/d4a/f5b zero size 2023-10-18T20:58:29.868 INFO:tasks.workunit.client.0.smithi008.stdout:8/508: dread d5/d8/df/d2e/f8a [0,4194304] 0 2023-10-18T20:58:29.874 INFO:tasks.workunit.client.1.smithi060.stdout:7/435: rename de/d29/l23 to de/d29/d72/d84/l86 0 2023-10-18T20:58:29.875 INFO:tasks.workunit.client.0.smithi008.stdout:8/509: symlink d5/d8/d24/d50/d8d/d95/lc3 0 2023-10-18T20:58:29.875 INFO:tasks.workunit.client.0.smithi008.stdout:8/510: readlink d5/d8/df/d9d/l3f 0 2023-10-18T20:58:29.881 INFO:tasks.workunit.client.0.smithi008.stdout:8/511: mkdir d5/d8/d24/d50/d8d/d95/dc4 0 2023-10-18T20:58:29.883 INFO:tasks.workunit.client.1.smithi060.stdout:4/358: dwrite d4/dc/d2a/d13/d33/f52 [0,4194304] 0 2023-10-18T20:58:29.883 INFO:tasks.workunit.client.1.smithi060.stdout:4/359: chown d4/d15/d2b/l61 15761 1 2023-10-18T20:58:29.884 INFO:tasks.workunit.client.0.smithi008.stdout:8/512: symlink d5/d8/d24/d50/d8d/lc5 0 2023-10-18T20:58:29.884 INFO:tasks.workunit.client.0.smithi008.stdout:8/513: fdatasync d5/d8/df/d9d/f1d 0 2023-10-18T20:58:29.884 INFO:tasks.workunit.client.0.smithi008.stdout:8/514: chown d5/d8/df/d9d/c1a 202012 1 2023-10-18T20:58:29.884 INFO:tasks.workunit.client.1.smithi060.stdout:5/432: dread d0/d6/d8/df/d27/d32/d4f/f86 [0,4194304] 0 2023-10-18T20:58:29.885 INFO:tasks.workunit.client.0.smithi008.stdout:8/515: rmdir d5/d8/df/d9d/d85 39 2023-10-18T20:58:29.885 INFO:tasks.workunit.client.0.smithi008.stdout:8/516: creat d5/d8/df/d9d/d6c/fc6 x:0 0 0 2023-10-18T20:58:29.887 INFO:tasks.workunit.client.1.smithi060.stdout:1/514: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/f5c [0,4194304] 0 2023-10-18T20:58:29.887 INFO:tasks.workunit.client.1.smithi060.stdout:8/395: dread d4/d9/f79 [0,4194304] 0 2023-10-18T20:58:29.888 INFO:tasks.workunit.client.1.smithi060.stdout:8/396: write d4/f1f [2684229,16286] 0 2023-10-18T20:58:29.894 INFO:tasks.workunit.client.1.smithi060.stdout:2/405: dwrite d0/d3/d27/f4c [0,4194304] 0 2023-10-18T20:58:29.894 INFO:tasks.workunit.client.1.smithi060.stdout:4/360: symlink d4/dc/d2a/d31/l6f 0 2023-10-18T20:58:29.894 INFO:tasks.workunit.client.1.smithi060.stdout:4/361: chown d4/dc/d2a/d13/c63 3 1 2023-10-18T20:58:29.894 INFO:tasks.workunit.client.1.smithi060.stdout:4/362: stat d4/d15/f37 0 2023-10-18T20:58:29.895 INFO:tasks.workunit.client.1.smithi060.stdout:4/363: write d4/f10 [5439995,38028] 0 2023-10-18T20:58:29.900 INFO:tasks.workunit.client.0.smithi008.stdout:3/346: write d0/d3/d42/f5c [2158435,114143] 0 2023-10-18T20:58:29.909 INFO:tasks.workunit.client.1.smithi060.stdout:6/401: dwrite d10/d17/d2f/f64 [0,4194304] 0 2023-10-18T20:58:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:28.649683+0000 mon.smithi008 (mon.0) 613 : cluster [DBG] mgrmap e24: smithi060.pgqqwa(active, since 57s), standbys: smithi008.flmjzp 2023-10-18T20:58:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.059400+0000 mon.smithi008 (mon.0) 614 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:58:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.062839+0000 mon.smithi060 (mon.1) 49 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:58:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.063783+0000 mon.smithi060 (mon.1) 50 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:58:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:29.064894+0000 mgr.smithi060.pgqqwa (mgr.14584) 46 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:58:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.071980+0000 mon.smithi008 (mon.0) 615 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:58:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.077666+0000 mon.smithi060 (mon.1) 51 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:29.080403+0000 mgr.smithi060.pgqqwa (mgr.14584) 47 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi060.pgqqwa) 2023-10-18T20:58:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:29.080761+0000 mgr.smithi060.pgqqwa (mgr.14584) 48 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi060.pgqqwa) 2023-10-18T20:58:29.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:29.083331+0000 mgr.smithi060.pgqqwa (mgr.14584) 49 : cephadm [INF] Failing over to other MGR 2023-10-18T20:58:29.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.083645+0000 mon.smithi060 (mon.1) 52 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mgr fail", "who": "smithi060.pgqqwa"}]: dispatch 2023-10-18T20:58:29.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.084132+0000 mon.smithi008 (mon.0) 616 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mgr fail", "who": "smithi060.pgqqwa"}]: dispatch 2023-10-18T20:58:29.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:29.088405+0000 mon.smithi008 (mon.0) 617 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2023-10-18T20:58:29.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.092105+0000 mon.smithi060 (mon.1) 53 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-10-18T20:58:29.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.092582+0000 mon.smithi008 (mon.0) 618 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-10-18T20:58:29.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.094116+0000 mon.smithi060 (mon.1) 54 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-10-18T20:58:29.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:29.094636+0000 mon.smithi008 (mon.0) 619 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-10-18T20:58:29.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:29.487317+0000 mon.smithi008 (mon.0) 620 : cluster [DBG] Standby manager daemon smithi060.pgqqwa started 2023-10-18T20:58:29.925 INFO:tasks.workunit.client.0.smithi008.stdout:9/371: write d2/f4 [3176189,3347] 0 2023-10-18T20:58:29.925 INFO:tasks.workunit.client.0.smithi008.stdout:9/372: chown d2/dc/d1a/c30 0 1 2023-10-18T20:58:29.925 INFO:tasks.workunit.client.0.smithi008.stdout:2/427: dwrite d1/f18 [0,4194304] 0 2023-10-18T20:58:29.926 INFO:tasks.workunit.client.0.smithi008.stdout:2/428: chown d1/d3/l7a 46086 1 2023-10-18T20:58:29.927 INFO:tasks.workunit.client.1.smithi060.stdout:0/417: dwrite d3/f6 [0,4194304] 0 2023-10-18T20:58:29.928 INFO:tasks.workunit.client.1.smithi060.stdout:0/418: write d3/d80/f82 [389583,1718] 0 2023-10-18T20:58:29.928 INFO:tasks.workunit.client.1.smithi060.stdout:0/419: truncate d3/f81 521353 0 2023-10-18T20:58:29.929 INFO:tasks.workunit.client.0.smithi008.stdout:5/376: dwrite d0/d2/d9/f4b [0,4194304] 0 2023-10-18T20:58:29.930 INFO:tasks.workunit.client.0.smithi008.stdout:5/377: dread - d0/d2/d9/d34/f71 zero size 2023-10-18T20:58:29.933 INFO:tasks.workunit.client.1.smithi060.stdout:7/436: dread de/d14/d49/f63 [0,4194304] 0 2023-10-18T20:58:29.933 INFO:tasks.workunit.client.1.smithi060.stdout:9/350: dwrite d3/d10/f69 [0,4194304] 0 2023-10-18T20:58:29.942 INFO:tasks.workunit.client.1.smithi060.stdout:7/437: dread de/d14/d41/d58/d5b/f64 [0,4194304] 0 2023-10-18T20:58:29.948 INFO:tasks.workunit.client.0.smithi008.stdout:8/517: dwrite d5/f15 [0,4194304] 0 2023-10-18T20:58:29.948 INFO:tasks.workunit.client.0.smithi008.stdout:8/518: truncate d5/d8/df/d2e/f7b 497695 0 2023-10-18T20:58:29.964 INFO:tasks.workunit.client.0.smithi008.stdout:2/429: dwrite d1/d3/dd/d1c/d3a/f80 [0,4194304] 0 2023-10-18T20:58:29.975 INFO:tasks.workunit.client.1.smithi060.stdout:7/438: dwrite de/f6f [0,4194304] 0 2023-10-18T20:58:29.983 INFO:tasks.workunit.client.1.smithi060.stdout:5/433: symlink d0/d6/d8/df/d27/la7 0 2023-10-18T20:58:29.983 INFO:tasks.workunit.client.0.smithi008.stdout:9/373: mkdir d2/d64 0 2023-10-18T20:58:29.984 INFO:tasks.workunit.client.1.smithi060.stdout:1/515: mkdir d4/d6/d48/da7 0 2023-10-18T20:58:29.987 INFO:tasks.workunit.client.1.smithi060.stdout:2/406: mknod d0/d43/d4a/c76 0 2023-10-18T20:58:29.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:28.649683+0000 mon.smithi008 (mon.0) 613 : cluster [DBG] mgrmap e24: smithi060.pgqqwa(active, since 57s), standbys: smithi008.flmjzp 2023-10-18T20:58:29.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.059400+0000 mon.smithi008 (mon.0) 614 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:58:29.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.062839+0000 mon.smithi060 (mon.1) 49 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:58:29.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.063783+0000 mon.smithi060 (mon.1) 50 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:58:29.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:29.064894+0000 mgr.smithi060.pgqqwa (mgr.14584) 46 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:58:29.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.071980+0000 mon.smithi008 (mon.0) 615 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' 2023-10-18T20:58:29.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.077666+0000 mon.smithi060 (mon.1) 51 : audit [DBG] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:29.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:29.080403+0000 mgr.smithi060.pgqqwa (mgr.14584) 47 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi060.pgqqwa) 2023-10-18T20:58:29.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:29.080761+0000 mgr.smithi060.pgqqwa (mgr.14584) 48 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi060.pgqqwa) 2023-10-18T20:58:29.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:29.083331+0000 mgr.smithi060.pgqqwa (mgr.14584) 49 : cephadm [INF] Failing over to other MGR 2023-10-18T20:58:29.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.083645+0000 mon.smithi060 (mon.1) 52 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mgr fail", "who": "smithi060.pgqqwa"}]: dispatch 2023-10-18T20:58:29.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.084132+0000 mon.smithi008 (mon.0) 616 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "mgr fail", "who": "smithi060.pgqqwa"}]: dispatch 2023-10-18T20:58:29.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:29.088405+0000 mon.smithi008 (mon.0) 617 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2023-10-18T20:58:29.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.092105+0000 mon.smithi060 (mon.1) 53 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-10-18T20:58:29.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.092582+0000 mon.smithi008 (mon.0) 618 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-10-18T20:58:29.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.094116+0000 mon.smithi060 (mon.1) 54 : audit [INF] from='mgr.14584 172.21.15.60:0/655206492' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-10-18T20:58:29.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:29.094636+0000 mon.smithi008 (mon.0) 619 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-10-18T20:58:29.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:29.487317+0000 mon.smithi008 (mon.0) 620 : cluster [DBG] Standby manager daemon smithi060.pgqqwa started 2023-10-18T20:58:29.994 INFO:tasks.workunit.client.1.smithi060.stdout:2/407: write d0/f10 [4625861,71282] 0 2023-10-18T20:58:29.994 INFO:tasks.workunit.client.1.smithi060.stdout:4/364: mkdir d4/dc/d2a/d31/d70 0 2023-10-18T20:58:29.995 INFO:tasks.workunit.client.0.smithi008.stdout:5/378: symlink d0/d2/d19/d7c/d41/l85 0 2023-10-18T20:58:29.995 INFO:tasks.workunit.client.0.smithi008.stdout:5/379: write d0/d2/d19/d7c/f6b [3188153,110676] 0 2023-10-18T20:58:29.995 INFO:tasks.workunit.client.0.smithi008.stdout:8/519: creat d5/d8/df/d9d/fc7 x:0 0 0 2023-10-18T20:58:29.996 INFO:tasks.workunit.client.0.smithi008.stdout:8/520: fsync d5/f37 0 2023-10-18T20:58:29.996 INFO:tasks.workunit.client.0.smithi008.stdout:8/521: stat d5/l4e 0 2023-10-18T20:58:29.996 INFO:tasks.workunit.client.0.smithi008.stdout:8/522: fsync d5/f37 0 2023-10-18T20:58:29.997 INFO:tasks.workunit.client.1.smithi060.stdout:0/420: mkdir d3/d32/d86 0 2023-10-18T20:58:29.998 INFO:tasks.workunit.client.0.smithi008.stdout:4/385: sync 2023-10-18T20:58:29.998 INFO:tasks.workunit.client.0.smithi008.stdout:4/386: truncate d0/d17/d5b/f68 17009786 0 2023-10-18T20:58:30.000 INFO:tasks.workunit.client.0.smithi008.stdout:2/430: mknod d1/d3/dd/d1c/d3a/d49/c8f 0 2023-10-18T20:58:30.007 INFO:tasks.workunit.client.0.smithi008.stdout:5/380: mkdir d0/d86 0 2023-10-18T20:58:30.007 INFO:tasks.workunit.client.0.smithi008.stdout:5/381: dread - d0/d2/d9/d34/f3b zero size 2023-10-18T20:58:30.009 INFO:tasks.workunit.client.0.smithi008.stdout:8/523: rename d5/f70 to d5/d8/df/d9d/d6c/fc8 0 2023-10-18T20:58:30.011 INFO:tasks.workunit.client.0.smithi008.stdout:4/387: mkdir d0/d3/d21/d84 0 2023-10-18T20:58:30.014 INFO:tasks.workunit.client.0.smithi008.stdout:2/431: creat d1/d3/dd/d25/d76/d59/d85/f90 x:0 0 0 2023-10-18T20:58:30.015 INFO:tasks.workunit.client.0.smithi008.stdout:5/382: symlink d0/d2/d19/d7c/d42/d5a/l87 0 2023-10-18T20:58:30.015 INFO:tasks.workunit.client.0.smithi008.stdout:5/383: dread - d0/d2/f57 zero size 2023-10-18T20:58:30.016 INFO:tasks.workunit.client.0.smithi008.stdout:5/384: write d0/f8 [336781,122566] 0 2023-10-18T20:58:30.016 INFO:tasks.workunit.client.0.smithi008.stdout:5/385: write d0/d2/d19/d7c/f26 [2869032,129445] 0 2023-10-18T20:58:30.016 INFO:tasks.workunit.client.0.smithi008.stdout:4/388: rmdir d0/d3/d48 39 2023-10-18T20:58:30.017 INFO:tasks.workunit.client.1.smithi060.stdout:9/351: mkdir d3/d10/d19/d54/d8f 0 2023-10-18T20:58:30.018 INFO:tasks.workunit.client.1.smithi060.stdout:7/439: dwrite de/d14/d2f/d3f/d5a/f60 [4194304,4194304] 0 2023-10-18T20:58:30.019 INFO:tasks.workunit.client.0.smithi008.stdout:2/432: mknod d1/d3/c91 0 2023-10-18T20:58:30.022 INFO:tasks.workunit.client.1.smithi060.stdout:5/434: rename d0/d6/d8/df/l4a to d0/d6/d8/df/d27/d32/la8 0 2023-10-18T20:58:30.022 INFO:tasks.workunit.client.1.smithi060.stdout:1/516: truncate f2 1378393 0 2023-10-18T20:58:30.033 INFO:tasks.workunit.client.1.smithi060.stdout:8/397: sync 2023-10-18T20:58:30.034 INFO:tasks.workunit.client.1.smithi060.stdout:3/359: sync 2023-10-18T20:58:30.034 INFO:tasks.workunit.client.1.smithi060.stdout:4/365: stat d4/dc/d2a/d31/l3e 0 2023-10-18T20:58:30.034 INFO:tasks.workunit.client.1.smithi060.stdout:8/398: write d4/d9/d31/f40 [863306,108133] 0 2023-10-18T20:58:30.034 INFO:tasks.workunit.client.1.smithi060.stdout:8/399: chown d4/l3f 87557 1 2023-10-18T20:58:30.035 INFO:tasks.workunit.client.1.smithi060.stdout:6/402: getdents d10 0 2023-10-18T20:58:30.037 INFO:tasks.workunit.client.1.smithi060.stdout:9/352: write d3/d10/d1c/d25/f74 [868538,54721] 0 2023-10-18T20:58:30.038 INFO:tasks.workunit.client.1.smithi060.stdout:7/440: creat de/d14/d2f/f87 x:0 0 0 2023-10-18T20:58:30.039 INFO:tasks.workunit.client.1.smithi060.stdout:5/435: creat d0/da/d3b/d64/fa9 x:0 0 0 2023-10-18T20:58:30.039 INFO:tasks.workunit.client.1.smithi060.stdout:1/517: unlink d4/d6/l63 0 2023-10-18T20:58:30.040 INFO:tasks.workunit.client.1.smithi060.stdout:3/360: link d0/f4e d0/d3c/d3d/f7f 0 2023-10-18T20:58:30.040 INFO:tasks.workunit.client.1.smithi060.stdout:3/361: readlink d0/l4 0 2023-10-18T20:58:30.041 INFO:tasks.workunit.client.1.smithi060.stdout:4/366: symlink d4/dc/d2a/d31/l71 0 2023-10-18T20:58:30.043 INFO:tasks.workunit.client.1.smithi060.stdout:9/353: fdatasync d3/d10/d1c/d2a/d2d/f61 0 2023-10-18T20:58:30.043 INFO:tasks.workunit.client.1.smithi060.stdout:9/354: truncate d3/f20 1875608 0 2023-10-18T20:58:30.045 INFO:tasks.workunit.client.1.smithi060.stdout:6/403: rename d10/d2e/f50 to d10/d25/f7f 0 2023-10-18T20:58:30.045 INFO:tasks.workunit.client.1.smithi060.stdout:3/362: link d0/d22/f69 d0/d22/d26/d2b/f80 0 2023-10-18T20:58:30.045 INFO:tasks.workunit.client.1.smithi060.stdout:3/363: chown d0/d22/d26/d2b/f6f 16233 1 2023-10-18T20:58:30.046 INFO:tasks.workunit.client.1.smithi060.stdout:3/364: write d0/f20 [428905,70058] 0 2023-10-18T20:58:30.046 INFO:tasks.workunit.client.1.smithi060.stdout:3/365: fdatasync d0/d3c/d3d/f7b 0 2023-10-18T20:58:30.048 INFO:tasks.workunit.client.1.smithi060.stdout:7/441: unlink de/d29/d72/d84/l86 0 2023-10-18T20:58:30.048 INFO:tasks.workunit.client.1.smithi060.stdout:7/442: chown de/d29/f33 12 1 2023-10-18T20:58:30.049 INFO:tasks.workunit.client.1.smithi060.stdout:6/404: symlink d10/d25/l80 0 2023-10-18T20:58:30.051 INFO:tasks.workunit.client.1.smithi060.stdout:9/355: rename d3/d10/d1c/d2a/d2d/f61 to d3/d10/d19/f90 0 2023-10-18T20:58:30.051 INFO:tasks.workunit.client.1.smithi060.stdout:9/356: read - d3/d10/d1c/d2a/d33/f85 zero size 2023-10-18T20:58:30.051 INFO:tasks.workunit.client.1.smithi060.stdout:2/408: dwrite d0/f12 [0,4194304] 0 2023-10-18T20:58:30.052 INFO:tasks.workunit.client.1.smithi060.stdout:2/409: write d0/d3/d27/f57 [707496,72020] 0 2023-10-18T20:58:30.052 INFO:tasks.workunit.client.1.smithi060.stdout:2/410: write d0/f67 [633612,91951] 0 2023-10-18T20:58:30.052 INFO:tasks.workunit.client.1.smithi060.stdout:2/411: creat d0/d3/d27/d4d/d53/f77 x:0 0 0 2023-10-18T20:58:30.055 INFO:tasks.workunit.client.1.smithi060.stdout:5/436: dread d0/d6/d8/df/f57 [0,4194304] 0 2023-10-18T20:58:30.055 INFO:tasks.workunit.client.1.smithi060.stdout:6/405: mkdir d10/d2e/d75/d81 0 2023-10-18T20:58:30.055 INFO:tasks.workunit.client.1.smithi060.stdout:6/406: write d10/f35 [602813,13332] 0 2023-10-18T20:58:30.056 INFO:tasks.workunit.client.0.smithi008.stdout:6/397: sync 2023-10-18T20:58:30.056 INFO:tasks.workunit.client.0.smithi008.stdout:6/398: write df/d13/f1a [5254310,19587] 0 2023-10-18T20:58:30.056 INFO:tasks.workunit.client.0.smithi008.stdout:6/399: write df/d15/f46 [470871,78873] 0 2023-10-18T20:58:30.057 INFO:tasks.workunit.client.0.smithi008.stdout:6/400: dread - df/d15/d27/d4c/f73 zero size 2023-10-18T20:58:30.057 INFO:tasks.workunit.client.0.smithi008.stdout:6/401: fsync df/d15/d27/d4c/f73 0 2023-10-18T20:58:30.062 INFO:tasks.workunit.client.0.smithi008.stdout:5/386: write d0/f29 [2323570,93328] 0 2023-10-18T20:58:30.063 INFO:tasks.workunit.client.0.smithi008.stdout:5/387: stat d0/d2/d19/d7c/f27 0 2023-10-18T20:58:30.063 INFO:tasks.workunit.client.0.smithi008.stdout:5/388: truncate d0/f8 1415394 0 2023-10-18T20:58:30.066 INFO:tasks.workunit.client.1.smithi060.stdout:6/407: rename d10/d25/f65 to d10/d17/f82 0 2023-10-18T20:58:30.067 INFO:tasks.workunit.client.1.smithi060.stdout:8/400: read d4/d9/d37/f3c [3124713,105648] 0 2023-10-18T20:58:30.069 INFO:tasks.workunit.client.1.smithi060.stdout:7/443: dread de/f1a [0,4194304] 0 2023-10-18T20:58:30.079 INFO:tasks.workunit.client.1.smithi060.stdout:3/366: dread d0/d22/f52 [0,4194304] 0 2023-10-18T20:58:30.080 INFO:tasks.workunit.client.1.smithi060.stdout:3/367: write d0/d22/d26/d2c/f74 [757255,91737] 0 2023-10-18T20:58:30.082 INFO:tasks.workunit.client.0.smithi008.stdout:4/389: dread d0/d17/f60 [0,4194304] 0 2023-10-18T20:58:30.083 INFO:tasks.workunit.client.1.smithi060.stdout:9/357: getdents d3/d10/d19 0 2023-10-18T20:58:30.084 INFO:tasks.workunit.client.0.smithi008.stdout:8/524: dwrite d5/d8/df/d9d/f96 [0,4194304] 0 2023-10-18T20:58:30.093 INFO:tasks.workunit.client.1.smithi060.stdout:6/408: dread d10/d2e/f3f [0,4194304] 0 2023-10-18T20:58:30.094 INFO:tasks.workunit.client.1.smithi060.stdout:0/421: dwrite d3/f81 [0,4194304] 0 2023-10-18T20:58:30.095 INFO:tasks.workunit.client.0.smithi008.stdout:4/390: truncate d0/d17/d5b/f68 10899279 0 2023-10-18T20:58:30.103 INFO:tasks.workunit.client.1.smithi060.stdout:9/358: rmdir d3/d10/d1c/d2a/d2d 39 2023-10-18T20:58:30.103 INFO:tasks.workunit.client.1.smithi060.stdout:3/368: mknod d0/d22/d50/c81 0 2023-10-18T20:58:30.103 INFO:tasks.workunit.client.1.smithi060.stdout:3/369: fdatasync d0/d3c/d3d/f7f 0 2023-10-18T20:58:30.112 INFO:tasks.workunit.client.1.smithi060.stdout:7/444: dread de/d14/d41/f53 [0,4194304] 0 2023-10-18T20:58:30.113 INFO:tasks.workunit.client.1.smithi060.stdout:6/409: symlink d10/d2e/d75/d77/l83 0 2023-10-18T20:58:30.113 INFO:tasks.workunit.client.1.smithi060.stdout:6/410: truncate d10/d2e/f3a 4609653 0 2023-10-18T20:58:30.113 INFO:tasks.workunit.client.0.smithi008.stdout:8/525: dread d5/d8/df/d2e/f43 [0,4194304] 0 2023-10-18T20:58:30.116 INFO:tasks.workunit.client.1.smithi060.stdout:0/422: mkdir d3/d8/d3c/d87 0 2023-10-18T20:58:30.116 INFO:tasks.workunit.client.1.smithi060.stdout:9/359: mknod d3/d10/d1c/d2a/d80/c91 0 2023-10-18T20:58:30.127 INFO:tasks.workunit.client.1.smithi060.stdout:3/370: write d0/d22/d50/f53 [2097900,80190] 0 2023-10-18T20:58:30.129 INFO:tasks.workunit.client.1.smithi060.stdout:1/518: dwrite d4/d6/f4e [0,4194304] 0 2023-10-18T20:58:30.130 INFO:tasks.workunit.client.1.smithi060.stdout:6/411: dread d10/d25/d3c/f62 [0,4194304] 0 2023-10-18T20:58:30.131 INFO:tasks.workunit.client.1.smithi060.stdout:2/412: dwrite d0/d43/f44 [0,4194304] 0 2023-10-18T20:58:30.132 INFO:tasks.workunit.client.1.smithi060.stdout:9/360: mknod d3/d58/c92 0 2023-10-18T20:58:30.137 INFO:tasks.workunit.client.1.smithi060.stdout:6/412: unlink d10/d17/d2f/d66/c60 0 2023-10-18T20:58:30.138 INFO:tasks.workunit.client.1.smithi060.stdout:6/413: write d10/d17/d2f/d66/f61 [1599421,69204] 0 2023-10-18T20:58:30.139 INFO:tasks.workunit.client.1.smithi060.stdout:6/414: mknod d10/d2e/d75/d77/c84 0 2023-10-18T20:58:30.139 INFO:tasks.workunit.client.1.smithi060.stdout:6/415: readlink d10/d17/l6e 0 2023-10-18T20:58:30.152 INFO:tasks.workunit.client.0.smithi008.stdout:6/402: dwrite df/d15/d27/f4a [0,4194304] 0 2023-10-18T20:58:30.153 INFO:tasks.workunit.client.0.smithi008.stdout:6/403: write df/d3c/d77/f76 [742951,27392] 0 2023-10-18T20:58:30.153 INFO:tasks.workunit.client.1.smithi060.stdout:1/519: dread d4/d6/f1f [4194304,4194304] 0 2023-10-18T20:58:30.154 INFO:tasks.workunit.client.0.smithi008.stdout:6/404: mknod df/d36/c8d 0 2023-10-18T20:58:30.155 INFO:tasks.workunit.client.0.smithi008.stdout:6/405: creat df/d18/d3f/f8e x:0 0 0 2023-10-18T20:58:30.157 INFO:tasks.workunit.client.0.smithi008.stdout:6/406: unlink df/d3c/c6d 0 2023-10-18T20:58:30.158 INFO:tasks.workunit.client.0.smithi008.stdout:6/407: creat df/d13/f8f x:0 0 0 2023-10-18T20:58:30.158 INFO:tasks.workunit.client.0.smithi008.stdout:6/408: chown df/d36/f84 15544 1 2023-10-18T20:58:30.158 INFO:tasks.workunit.client.0.smithi008.stdout:6/409: readlink df/d15/d5e/l70 0 2023-10-18T20:58:30.160 INFO:tasks.workunit.client.0.smithi008.stdout:6/410: symlink df/d18/d3f/l90 0 2023-10-18T20:58:30.160 INFO:tasks.workunit.client.0.smithi008.stdout:6/411: stat df/d19/f4d 0 2023-10-18T20:58:30.161 INFO:tasks.workunit.client.0.smithi008.stdout:6/412: symlink df/d15/d48/d4b/l91 0 2023-10-18T20:58:30.163 INFO:tasks.workunit.client.0.smithi008.stdout:6/413: symlink df/l92 0 2023-10-18T20:58:30.163 INFO:tasks.workunit.client.0.smithi008.stdout:6/414: creat df/d18/d3f/f93 x:0 0 0 2023-10-18T20:58:30.166 INFO:tasks.workunit.client.1.smithi060.stdout:8/401: dread d4/f47 [0,4194304] 0 2023-10-18T20:58:30.170 INFO:tasks.workunit.client.0.smithi008.stdout:5/389: dwrite d0/d2/f7 [4194304,4194304] 0 2023-10-18T20:58:30.170 INFO:tasks.workunit.client.0.smithi008.stdout:5/390: readlink d0/d2/d19/d7c/d41/l6d 0 2023-10-18T20:58:30.171 INFO:tasks.workunit.client.1.smithi060.stdout:8/402: mkdir d4/d9/d37/d4e/d6e/d7b 0 2023-10-18T20:58:30.174 INFO:tasks.workunit.client.0.smithi008.stdout:6/415: write df/f2e [364008,90976] 0 2023-10-18T20:58:30.174 INFO:tasks.workunit.client.0.smithi008.stdout:6/416: fdatasync df/d13/f69 0 2023-10-18T20:58:30.175 INFO:tasks.workunit.client.0.smithi008.stdout:5/391: mkdir d0/d2/d9/d88 0 2023-10-18T20:58:30.175 INFO:tasks.workunit.client.1.smithi060.stdout:8/403: write d4/d9/d31/f66 [175310,108838] 0 2023-10-18T20:58:30.176 INFO:tasks.workunit.client.1.smithi060.stdout:0/423: read d3/d8/f31 [726477,21972] 0 2023-10-18T20:58:30.177 INFO:tasks.workunit.client.0.smithi008.stdout:5/392: mkdir d0/d2/d19/d7c/d31/d80/d89 0 2023-10-18T20:58:30.177 INFO:tasks.workunit.client.1.smithi060.stdout:0/424: write d3/d8/d14/d55/d74/d76/d6b/f79 [977211,121254] 0 2023-10-18T20:58:30.177 INFO:tasks.workunit.client.1.smithi060.stdout:0/425: chown d3/d8/d14/f2b 698113 1 2023-10-18T20:58:30.178 INFO:tasks.workunit.client.1.smithi060.stdout:5/437: dwrite d0/d6/d8/df/d27/d32/f39 [0,4194304] 0 2023-10-18T20:58:30.178 INFO:tasks.workunit.client.1.smithi060.stdout:5/438: chown d0/dd/f5b 132 1 2023-10-18T20:58:30.181 INFO:tasks.workunit.client.1.smithi060.stdout:6/416: read d10/d3e/f74 [4128346,27389] 0 2023-10-18T20:58:30.181 INFO:tasks.workunit.client.1.smithi060.stdout:6/417: write d10/d3e/f74 [1119565,102754] 0 2023-10-18T20:58:30.181 INFO:tasks.workunit.client.1.smithi060.stdout:6/418: write d10/d2e/f56 [2933207,129163] 0 2023-10-18T20:58:30.185 INFO:tasks.workunit.client.1.smithi060.stdout:8/404: rename d4/d9/d37/d4e/l6c to d4/d9/d37/d4e/d5e/l7c 0 2023-10-18T20:58:30.187 INFO:tasks.workunit.client.0.smithi008.stdout:5/393: mknod d0/d2/d19/d7c/d31/d3f/d70/c8a 0 2023-10-18T20:58:30.192 INFO:tasks.workunit.client.1.smithi060.stdout:0/426: creat d3/d8/d14/d55/f88 x:0 0 0 2023-10-18T20:58:30.192 INFO:tasks.workunit.client.1.smithi060.stdout:0/427: unlink d3/l15 0 2023-10-18T20:58:30.194 INFO:tasks.workunit.client.1.smithi060.stdout:5/439: creat d0/d6/d9/d82/d83/d99/faa x:0 0 0 2023-10-18T20:58:30.195 INFO:tasks.workunit.client.1.smithi060.stdout:3/371: dread d0/d22/d26/d2c/f31 [0,4194304] 0 2023-10-18T20:58:30.195 INFO:tasks.workunit.client.1.smithi060.stdout:9/361: dwrite d3/d10/f67 [0,4194304] 0 2023-10-18T20:58:30.197 INFO:tasks.workunit.client.0.smithi008.stdout:5/394: rename d0/d2/d19/d7c/d42/d5a/f83 to d0/d2/d19/d7c/d31/d3f/d70/f8b 0 2023-10-18T20:58:30.198 INFO:tasks.workunit.client.0.smithi008.stdout:5/395: stat d0/d2/d19/d7c/d64 0 2023-10-18T20:58:30.209 INFO:tasks.workunit.client.1.smithi060.stdout:6/419: symlink d10/d3e/l85 0 2023-10-18T20:58:30.221 INFO:tasks.workunit.client.1.smithi060.stdout:8/405: dread d4/f13 [0,4194304] 0 2023-10-18T20:58:30.221 INFO:tasks.workunit.client.1.smithi060.stdout:2/413: dwrite d0/f5d [0,4194304] 0 2023-10-18T20:58:30.222 INFO:tasks.workunit.client.1.smithi060.stdout:0/428: dread d3/f48 [0,4194304] 0 2023-10-18T20:58:30.222 INFO:tasks.workunit.client.1.smithi060.stdout:7/445: dwrite de/d29/f77 [0,4194304] 0 2023-10-18T20:58:30.225 INFO:tasks.workunit.client.0.smithi008.stdout:1/489: sync 2023-10-18T20:58:30.226 INFO:tasks.workunit.client.1.smithi060.stdout:5/440: dread d0/d6/d8/df/d27/f4d [0,4194304] 0 2023-10-18T20:58:30.227 INFO:tasks.workunit.client.0.smithi008.stdout:1/490: rmdir d9/de/df/d17 39 2023-10-18T20:58:30.227 INFO:tasks.workunit.client.0.smithi008.stdout:1/491: chown d9/c64 59 1 2023-10-18T20:58:30.238 INFO:tasks.workunit.client.1.smithi060.stdout:4/367: sync 2023-10-18T20:58:30.238 INFO:tasks.workunit.client.1.smithi060.stdout:4/368: fdatasync d4/dc/d2a/d39/f49 0 2023-10-18T20:58:30.239 INFO:tasks.workunit.client.1.smithi060.stdout:3/372: rmdir d0/d22/d26/d2b 39 2023-10-18T20:58:30.239 INFO:tasks.workunit.client.1.smithi060.stdout:9/362: rmdir d3/d10/d19/d54 39 2023-10-18T20:58:30.239 INFO:tasks.workunit.client.1.smithi060.stdout:2/414: dread d0/d16/f19 [0,4194304] 0 2023-10-18T20:58:30.240 INFO:tasks.workunit.client.0.smithi008.stdout:6/417: dwrite df/f35 [0,4194304] 0 2023-10-18T20:58:30.242 INFO:tasks.workunit.client.1.smithi060.stdout:0/429: truncate d3/d8/f9 3347930 0 2023-10-18T20:58:30.245 INFO:tasks.workunit.client.1.smithi060.stdout:7/446: mkdir de/d14/d49/d68/d88 0 2023-10-18T20:58:30.246 INFO:tasks.workunit.client.1.smithi060.stdout:4/369: unlink d4/dc/d2a/f1e 0 2023-10-18T20:58:30.246 INFO:tasks.workunit.client.1.smithi060.stdout:4/370: fdatasync d4/f10 0 2023-10-18T20:58:30.246 INFO:tasks.workunit.client.1.smithi060.stdout:4/371: fdatasync d4/dc/d40/f41 0 2023-10-18T20:58:30.247 INFO:tasks.workunit.client.1.smithi060.stdout:3/373: mkdir d0/d3c/d3d/d82 0 2023-10-18T20:58:30.248 INFO:tasks.workunit.client.1.smithi060.stdout:9/363: link d3/d10/d19/d54/c6f d3/d10/d1c/d2a/d33/c93 0 2023-10-18T20:58:30.248 INFO:tasks.workunit.client.1.smithi060.stdout:9/364: chown d3/d10/d1c/d2a/l39 16 1 2023-10-18T20:58:30.252 INFO:tasks.workunit.client.1.smithi060.stdout:2/415: rename d0/d8/fc to d0/f78 0 2023-10-18T20:58:30.255 INFO:tasks.workunit.client.1.smithi060.stdout:3/374: link d0/d22/d26/d2c/f74 d0/d22/d26/d2c/f83 0 2023-10-18T20:58:30.257 INFO:tasks.workunit.client.0.smithi008.stdout:6/418: mknod df/d18/d58/c94 0 2023-10-18T20:58:30.257 INFO:tasks.workunit.client.0.smithi008.stdout:6/419: write df/d15/d27/d38/f39 [973739,115175] 0 2023-10-18T20:58:30.259 INFO:tasks.workunit.client.1.smithi060.stdout:0/430: rmdir d3/d8/d14/d55/d74/d76/d68 39 2023-10-18T20:58:30.263 INFO:tasks.workunit.client.0.smithi008.stdout:6/420: write df/d36/f62 [292100,100541] 0 2023-10-18T20:58:30.264 INFO:tasks.workunit.client.0.smithi008.stdout:6/421: write df/d18/d3f/f7b [994144,19277] 0 2023-10-18T20:58:30.265 INFO:tasks.workunit.client.1.smithi060.stdout:0/431: unlink d3/d8/d14/d55/l78 0 2023-10-18T20:58:30.269 INFO:tasks.workunit.client.1.smithi060.stdout:0/432: truncate d3/d8/d14/f2c 804006 0 2023-10-18T20:58:30.269 INFO:tasks.workunit.client.1.smithi060.stdout:0/433: creat d3/d8/d14/f89 x:0 0 0 2023-10-18T20:58:30.279 INFO:tasks.workunit.client.1.smithi060.stdout:0/434: getdents d3 0 2023-10-18T20:58:30.290 INFO:tasks.workunit.client.0.smithi008.stdout:1/492: write d9/de/f15 [652297,53606] 0 2023-10-18T20:58:30.293 INFO:tasks.workunit.client.1.smithi060.stdout:7/447: read de/d14/d41/d58/d5b/f7a [2369138,106484] 0 2023-10-18T20:58:30.293 INFO:tasks.workunit.client.1.smithi060.stdout:7/448: read - de/d14/d41/f6a zero size 2023-10-18T20:58:30.293 INFO:tasks.workunit.client.1.smithi060.stdout:7/449: chown de/d14/d41 1751277 1 2023-10-18T20:58:30.294 INFO:tasks.workunit.client.1.smithi060.stdout:3/375: getdents d0/d3c/d3d 0 2023-10-18T20:58:30.294 INFO:tasks.workunit.client.1.smithi060.stdout:3/376: getdents d0/d22/d26/d79 0 2023-10-18T20:58:30.297 INFO:tasks.workunit.client.0.smithi008.stdout:1/493: symlink d9/l92 0 2023-10-18T20:58:30.300 INFO:tasks.workunit.client.1.smithi060.stdout:7/450: symlink de/d14/d3a/d46/d73/l89 0 2023-10-18T20:58:30.300 INFO:tasks.workunit.client.1.smithi060.stdout:7/451: chown de/d38/l69 118 1 2023-10-18T20:58:30.303 INFO:tasks.workunit.client.1.smithi060.stdout:3/377: dread d0/d22/d26/d2c/f74 [0,4194304] 0 2023-10-18T20:58:30.304 INFO:tasks.workunit.client.1.smithi060.stdout:7/452: mknod de/d29/c8a 0 2023-10-18T20:58:30.311 INFO:tasks.workunit.client.1.smithi060.stdout:3/378: mknod d0/d22/d26/d79/c84 0 2023-10-18T20:58:30.311 INFO:tasks.workunit.client.1.smithi060.stdout:7/453: mknod de/d14/d2f/d3f/d5a/c8b 0 2023-10-18T20:58:30.311 INFO:tasks.workunit.client.1.smithi060.stdout:7/454: readlink de/d29/l81 0 2023-10-18T20:58:30.311 INFO:tasks.workunit.client.1.smithi060.stdout:7/455: chown de/d14/d41/d58/d5b/f64 31094 1 2023-10-18T20:58:30.311 INFO:tasks.workunit.client.1.smithi060.stdout:7/456: getdents de/d14/d2f/d3f/d5a/d5f 0 2023-10-18T20:58:30.312 INFO:tasks.workunit.client.1.smithi060.stdout:3/379: rmdir d0/d22/d26/d79 39 2023-10-18T20:58:30.313 INFO:tasks.workunit.client.1.smithi060.stdout:7/457: symlink de/d14/d2f/d3f/d5a/l8c 0 2023-10-18T20:58:30.315 INFO:tasks.workunit.client.1.smithi060.stdout:3/380: truncate d0/fb 4556905 0 2023-10-18T20:58:30.318 INFO:tasks.workunit.client.1.smithi060.stdout:7/458: rename de/d29/f33 to de/d38/d78/f8d 0 2023-10-18T20:58:30.321 INFO:tasks.workunit.client.0.smithi008.stdout:1/494: dread d9/de/df/f5b [0,4194304] 0 2023-10-18T20:58:30.324 INFO:tasks.workunit.client.1.smithi060.stdout:3/381: rmdir d0/d22/d26/d2b 39 2023-10-18T20:58:30.327 INFO:tasks.workunit.client.0.smithi008.stdout:5/396: dwrite d0/d2/d19/d7c/d42/d5a/f66 [0,4194304] 0 2023-10-18T20:58:30.327 INFO:tasks.workunit.client.1.smithi060.stdout:8/406: dwrite d4/d9/d31/f5a [0,4194304] 0 2023-10-18T20:58:30.329 INFO:tasks.workunit.client.1.smithi060.stdout:7/459: dread de/d38/d78/f8d [0,4194304] 0 2023-10-18T20:58:30.332 INFO:tasks.workunit.client.1.smithi060.stdout:5/441: dwrite d0/da/d3b/f8f [0,4194304] 0 2023-10-18T20:58:30.333 INFO:tasks.workunit.client.1.smithi060.stdout:5/442: fdatasync d0/d6/d8/df/d27/d32/d4f/f86 0 2023-10-18T20:58:30.333 INFO:tasks.workunit.client.0.smithi008.stdout:1/495: link d9/de/df/d17/d69/l91 d9/de/df/d17/d1e/d7d/l93 0 2023-10-18T20:58:30.336 INFO:tasks.workunit.client.0.smithi008.stdout:5/397: dread d0/d2/d9/d34/f5c [0,4194304] 0 2023-10-18T20:58:30.339 INFO:tasks.workunit.client.1.smithi060.stdout:9/365: dwrite d3/d10/d1c/d5a/d5d/d2b/f49 [0,4194304] 0 2023-10-18T20:58:30.342 INFO:tasks.workunit.client.1.smithi060.stdout:0/435: dwrite d3/d8/d14/f2a [0,4194304] 0 2023-10-18T20:58:30.342 INFO:tasks.workunit.client.1.smithi060.stdout:8/407: creat d4/d9/d37/d4e/d6e/d7b/f7d x:0 0 0 2023-10-18T20:58:30.343 INFO:tasks.workunit.client.1.smithi060.stdout:0/436: readlink d3/d8/l29 0 2023-10-18T20:58:30.343 INFO:tasks.workunit.client.1.smithi060.stdout:7/460: symlink de/d14/d49/d68/l8e 0 2023-10-18T20:58:30.346 INFO:tasks.workunit.client.1.smithi060.stdout:6/420: dwrite d10/d17/f23 [0,4194304] 0 2023-10-18T20:58:30.346 INFO:tasks.workunit.client.0.smithi008.stdout:5/398: truncate d0/d2/d19/d7c/d41/f56 2036223 0 2023-10-18T20:58:30.346 INFO:tasks.workunit.client.0.smithi008.stdout:5/399: chown d0/d2/d19/d7c/f27 19334961 1 2023-10-18T20:58:30.355 INFO:tasks.workunit.client.0.smithi008.stdout:5/400: link d0/d2/d19/d7c/d41/d6f/f7f d0/d86/f8c 0 2023-10-18T20:58:30.355 INFO:tasks.workunit.client.0.smithi008.stdout:5/401: chown d0/d2/d19/d7c/d58/d65/f59 0 1 2023-10-18T20:58:30.356 INFO:tasks.workunit.client.0.smithi008.stdout:1/496: dread d9/de/f58 [0,4194304] 0 2023-10-18T20:58:30.357 INFO:tasks.workunit.client.1.smithi060.stdout:9/366: creat d3/d10/d1c/d5a/d5d/d2b/f94 x:0 0 0 2023-10-18T20:58:30.359 INFO:tasks.workunit.client.1.smithi060.stdout:0/437: creat d3/d8/d14/d55/d74/d76/f8a x:0 0 0 2023-10-18T20:58:30.362 INFO:tasks.workunit.client.1.smithi060.stdout:7/461: unlink de/d14/d2f/l32 0 2023-10-18T20:58:30.363 INFO:tasks.workunit.client.0.smithi008.stdout:5/402: mkdir d0/d2/d19/d7c/d31/d8d 0 2023-10-18T20:58:30.370 INFO:tasks.workunit.client.1.smithi060.stdout:6/421: unlink d10/f19 0 2023-10-18T20:58:30.370 INFO:tasks.workunit.client.1.smithi060.stdout:6/422: fsync fd 0 2023-10-18T20:58:30.374 INFO:tasks.workunit.client.1.smithi060.stdout:0/438: rename d3/l73 to d3/d80/l8b 0 2023-10-18T20:58:30.379 INFO:tasks.workunit.client.1.smithi060.stdout:2/416: dwrite d0/d3/f59 [4194304,4194304] 0 2023-10-18T20:58:30.386 INFO:tasks.workunit.client.1.smithi060.stdout:6/423: creat d10/d3e/d76/f86 x:0 0 0 2023-10-18T20:58:30.386 INFO:tasks.workunit.client.1.smithi060.stdout:6/424: chown d10/d47/c6a 8 1 2023-10-18T20:58:30.387 INFO:tasks.workunit.client.1.smithi060.stdout:6/425: write f1 [4821503,126942] 0 2023-10-18T20:58:30.397 INFO:tasks.workunit.client.1.smithi060.stdout:0/439: rename d3/d8/d14/f2a to d3/d32/d86/f8c 0 2023-10-18T20:58:30.405 INFO:tasks.workunit.client.1.smithi060.stdout:8/408: dwrite d4/f13 [0,4194304] 0 2023-10-18T20:58:30.405 INFO:tasks.workunit.client.1.smithi060.stdout:8/409: fdatasync d4/d9/d37/d4e/f61 0 2023-10-18T20:58:30.405 INFO:tasks.workunit.client.1.smithi060.stdout:8/410: chown d4/d9/d4f/f71 0 1 2023-10-18T20:58:30.406 INFO:tasks.workunit.client.0.smithi008.stdout:6/422: dwrite df/d3c/d77/f76 [0,4194304] 0 2023-10-18T20:58:30.407 INFO:tasks.workunit.client.0.smithi008.stdout:6/423: fdatasync df/f2e 0 2023-10-18T20:58:30.410 INFO:tasks.workunit.client.1.smithi060.stdout:5/443: dwrite d0/d6/d8/df/f51 [4194304,4194304] 0 2023-10-18T20:58:30.412 INFO:tasks.workunit.client.1.smithi060.stdout:7/462: rename de/d14/d41/d58 to de/d14/d2f/d8f 0 2023-10-18T20:58:30.412 INFO:tasks.workunit.client.1.smithi060.stdout:7/463: dread - de/d14/d3a/d46/d73/f82 zero size 2023-10-18T20:58:30.413 INFO:tasks.workunit.client.1.smithi060.stdout:7/464: getdents de/d14/d2f/d8f/d5b 0 2023-10-18T20:58:30.413 INFO:tasks.workunit.client.1.smithi060.stdout:7/465: readlink de/d14/d49/l54 0 2023-10-18T20:58:30.413 INFO:tasks.workunit.client.1.smithi060.stdout:7/466: chown de/d29/c35 233 1 2023-10-18T20:58:30.413 INFO:tasks.workunit.client.0.smithi008.stdout:1/497: dwrite d9/de/df/d17/d25/d57/f87 [0,4194304] 0 2023-10-18T20:58:30.414 INFO:tasks.workunit.client.1.smithi060.stdout:0/440: mkdir d3/d8/d14/d55/d74/d76/d68/d7f/d8d 0 2023-10-18T20:58:30.415 INFO:tasks.workunit.client.1.smithi060.stdout:3/382: dwrite d0/d3c/f40 [0,4194304] 0 2023-10-18T20:58:30.421 INFO:tasks.workunit.client.1.smithi060.stdout:8/411: symlink d4/d9/d31/d6f/l7e 0 2023-10-18T20:58:30.434 INFO:tasks.workunit.client.0.smithi008.stdout:5/403: dwrite d0/d2/d19/d7c/f6b [0,4194304] 0 2023-10-18T20:58:30.436 INFO:tasks.workunit.client.1.smithi060.stdout:3/383: dread d0/d3c/d3d/f3b [0,4194304] 0 2023-10-18T20:58:30.442 INFO:tasks.workunit.client.1.smithi060.stdout:3/384: read d0/d3c/d3d/d4d/f6a [187872,99779] 0 2023-10-18T20:58:30.444 INFO:tasks.workunit.client.1.smithi060.stdout:5/444: mknod d0/dd/d76/cab 0 2023-10-18T20:58:30.444 INFO:tasks.workunit.client.1.smithi060.stdout:2/417: rename d0/d3/d27/d62 to d0/d45/d49/d6e/d79 0 2023-10-18T20:58:30.444 INFO:tasks.workunit.client.1.smithi060.stdout:0/441: symlink d3/d8/d14/d55/d74/l8e 0 2023-10-18T20:58:30.445 INFO:tasks.workunit.client.0.smithi008.stdout:5/404: rename d0/d2/d19/d7c/c39 to d0/d2/d19/d7c/d64/c8e 0 2023-10-18T20:58:30.445 INFO:tasks.workunit.client.1.smithi060.stdout:1/520: sync 2023-10-18T20:58:30.447 INFO:tasks.workunit.client.1.smithi060.stdout:4/372: sync 2023-10-18T20:58:30.447 INFO:tasks.workunit.client.1.smithi060.stdout:4/373: chown d4/dc/d2a/d13/d2f/l50 815230 1 2023-10-18T20:58:30.448 INFO:tasks.workunit.client.1.smithi060.stdout:2/418: rename d0/l4f to d0/d3/d27/d4d/d5e/l7a 0 2023-10-18T20:58:30.453 INFO:tasks.workunit.client.0.smithi008.stdout:5/405: mknod d0/d2/d19/d7c/d31/d3f/c8f 0 2023-10-18T20:58:30.454 INFO:tasks.workunit.client.1.smithi060.stdout:1/521: creat d4/d6/d7/d2f/d7b/d2a/d32/dd/fa8 x:0 0 0 2023-10-18T20:58:30.454 INFO:tasks.workunit.client.1.smithi060.stdout:1/522: write d4/d6/d33/f71 [459523,128057] 0 2023-10-18T20:58:30.455 INFO:tasks.workunit.client.1.smithi060.stdout:2/419: mkdir d0/d3/d27/d7b 0 2023-10-18T20:58:30.455 INFO:tasks.workunit.client.0.smithi008.stdout:0/334: sync 2023-10-18T20:58:30.455 INFO:tasks.workunit.client.0.smithi008.stdout:0/335: fdatasync d0/dd/df/d2a/f38 0 2023-10-18T20:58:30.456 INFO:tasks.workunit.client.1.smithi060.stdout:1/523: read d4/d6/d33/d58/f76 [15053,54524] 0 2023-10-18T20:58:30.463 INFO:tasks.workunit.client.1.smithi060.stdout:6/426: rename d10/l16 to d10/d17/d70/l87 0 2023-10-18T20:58:30.463 INFO:tasks.workunit.client.1.smithi060.stdout:1/524: mkdir d4/d6/d33/da9 0 2023-10-18T20:58:30.463 INFO:tasks.workunit.client.1.smithi060.stdout:1/525: fdatasync d4/da/d42/f64 0 2023-10-18T20:58:30.470 INFO:tasks.workunit.client.1.smithi060.stdout:3/385: dread d0/fb [0,4194304] 0 2023-10-18T20:58:30.470 INFO:tasks.workunit.client.1.smithi060.stdout:3/386: stat d0/f20 0 2023-10-18T20:58:30.470 INFO:tasks.workunit.client.1.smithi060.stdout:3/387: chown d0/d3c/d3d/l71 100406 1 2023-10-18T20:58:30.474 INFO:tasks.workunit.client.1.smithi060.stdout:3/388: symlink d0/d3c/d3d/l85 0 2023-10-18T20:58:30.474 INFO:tasks.workunit.client.1.smithi060.stdout:7/467: rename de/d14/d2f/d3f/d5a/f60 to de/d29/d72/f90 0 2023-10-18T20:58:30.474 INFO:tasks.workunit.client.1.smithi060.stdout:7/468: creat de/d14/d2f/d3f/f91 x:0 0 0 2023-10-18T20:58:30.475 INFO:tasks.workunit.client.1.smithi060.stdout:3/389: getdents d0/d3c/d3d/d82 0 2023-10-18T20:58:30.475 INFO:tasks.workunit.client.0.smithi008.stdout:3/347: sync 2023-10-18T20:58:30.476 INFO:tasks.workunit.client.0.smithi008.stdout:7/435: sync 2023-10-18T20:58:30.476 INFO:tasks.workunit.client.0.smithi008.stdout:3/348: fdatasync d0/d3/d42/f68 0 2023-10-18T20:58:30.476 INFO:tasks.workunit.client.0.smithi008.stdout:3/349: readlink d0/d3/d15/l48 0 2023-10-18T20:58:30.476 INFO:tasks.workunit.client.0.smithi008.stdout:7/436: readlink d1/d3/l40 0 2023-10-18T20:58:30.477 INFO:tasks.workunit.client.1.smithi060.stdout:5/445: write d0/d6/d8/df/d27/d32/d4f/f68 [225309,105127] 0 2023-10-18T20:58:30.480 INFO:tasks.workunit.client.1.smithi060.stdout:4/374: dread d4/dc/d2a/d13/f1b [0,4194304] 0 2023-10-18T20:58:30.484 INFO:tasks.workunit.client.1.smithi060.stdout:0/442: write d3/d32/f66 [1751400,31610] 0 2023-10-18T20:58:30.486 INFO:tasks.workunit.client.1.smithi060.stdout:9/367: dwrite d3/d10/d19/d54/f4a [0,4194304] 0 2023-10-18T20:58:30.488 INFO:tasks.workunit.client.0.smithi008.stdout:0/336: write d0/dd/d19/f3c [3567273,65656] 0 2023-10-18T20:58:30.489 INFO:tasks.workunit.client.0.smithi008.stdout:6/424: dwrite df/d18/d3f/f79 [0,4194304] 0 2023-10-18T20:58:30.491 INFO:tasks.workunit.client.1.smithi060.stdout:7/469: symlink de/d38/d78/l92 0 2023-10-18T20:58:30.495 INFO:tasks.workunit.client.1.smithi060.stdout:3/390: mknod d0/d22/d26/d79/c86 0 2023-10-18T20:58:30.496 INFO:tasks.workunit.client.1.smithi060.stdout:3/391: truncate d0/d3c/d3d/f3e 285502 0 2023-10-18T20:58:30.496 INFO:tasks.workunit.client.1.smithi060.stdout:3/392: chown d0/d3c/d3d/f7f 388 1 2023-10-18T20:58:30.501 INFO:tasks.workunit.client.1.smithi060.stdout:5/446: unlink d0/d47/f69 0 2023-10-18T20:58:30.506 INFO:tasks.workunit.client.0.smithi008.stdout:0/337: symlink d0/dd/df/d20/l6d 0 2023-10-18T20:58:30.506 INFO:tasks.workunit.client.1.smithi060.stdout:4/375: symlink d4/dc/d40/l72 0 2023-10-18T20:58:30.512 INFO:tasks.workunit.client.0.smithi008.stdout:6/425: creat df/d15/d48/d81/f95 x:0 0 0 2023-10-18T20:58:30.512 INFO:tasks.workunit.client.0.smithi008.stdout:6/426: creat df/d15/d48/d81/f96 x:0 0 0 2023-10-18T20:58:30.515 INFO:tasks.workunit.client.1.smithi060.stdout:7/470: stat de/d14/d3a/l50 0 2023-10-18T20:58:30.515 INFO:tasks.workunit.client.1.smithi060.stdout:0/443: chown d3/d8/d3c/l4a 41 1 2023-10-18T20:58:30.515 INFO:tasks.workunit.client.1.smithi060.stdout:7/471: read de/f1f [1791260,118131] 0 2023-10-18T20:58:30.516 INFO:tasks.workunit.client.1.smithi060.stdout:8/412: rename d4/c27 to d4/d9/d31/d35/c7f 0 2023-10-18T20:58:30.517 INFO:tasks.workunit.client.0.smithi008.stdout:7/437: rmdir d1/d3/d20 39 2023-10-18T20:58:30.517 INFO:tasks.workunit.client.0.smithi008.stdout:7/438: write d1/d3/f57 [782397,85340] 0 2023-10-18T20:58:30.518 INFO:tasks.workunit.client.0.smithi008.stdout:7/439: fdatasync d1/d3/f65 0 2023-10-18T20:58:30.518 INFO:tasks.workunit.client.0.smithi008.stdout:7/440: stat d1/d36/d3d/d3e 0 2023-10-18T20:58:30.522 INFO:tasks.workunit.client.0.smithi008.stdout:0/338: truncate d0/dd/f15 2638863 0 2023-10-18T20:58:30.531 INFO:tasks.workunit.client.0.smithi008.stdout:5/406: dwrite d0/d2/d9/d34/f71 [0,4194304] 0 2023-10-18T20:58:30.532 INFO:tasks.workunit.client.1.smithi060.stdout:0/444: dread d3/f3b [0,4194304] 0 2023-10-18T20:58:30.533 INFO:tasks.workunit.client.1.smithi060.stdout:0/445: creat d3/d8/d14/d55/f8f x:0 0 0 2023-10-18T20:58:30.533 INFO:tasks.workunit.client.1.smithi060.stdout:0/446: creat d3/d80/f90 x:0 0 0 2023-10-18T20:58:30.533 INFO:tasks.workunit.client.1.smithi060.stdout:0/447: fsync d3/f60 0 2023-10-18T20:58:30.533 INFO:tasks.workunit.client.1.smithi060.stdout:5/447: truncate d0/da/d3b/d43/f63 1399620 0 2023-10-18T20:58:30.533 INFO:tasks.workunit.client.1.smithi060.stdout:5/448: write d0/d6/d8/df/d27/d32/d6d/d72/f7a [412124,69559] 0 2023-10-18T20:58:30.534 INFO:tasks.workunit.client.1.smithi060.stdout:5/449: write d0/d6/d8/df/f4e [893935,7719] 0 2023-10-18T20:58:30.536 INFO:tasks.workunit.client.1.smithi060.stdout:8/413: rmdir d4/d9/d31 39 2023-10-18T20:58:30.542 INFO:tasks.workunit.client.1.smithi060.stdout:6/427: dwrite d10/d17/d2f/d66/f41 [4194304,4194304] 0 2023-10-18T20:58:30.544 INFO:tasks.workunit.client.0.smithi008.stdout:6/427: link df/d15/d27/c29 df/d15/d48/c97 0 2023-10-18T20:58:30.546 INFO:tasks.workunit.client.1.smithi060.stdout:9/368: rename d3/f6d to d3/d58/f95 0 2023-10-18T20:58:30.557 INFO:tasks.workunit.client.1.smithi060.stdout:5/450: dread d0/d6/f55 [0,4194304] 0 2023-10-18T20:58:30.559 INFO:tasks.workunit.client.0.smithi008.stdout:1/498: dwrite d9/de/df/d17/d1e/f65 [0,4194304] 0 2023-10-18T20:58:30.560 INFO:tasks.workunit.client.0.smithi008.stdout:1/499: write d9/de/df/d17/d25/d57/f87 [4666074,1802] 0 2023-10-18T20:58:30.560 INFO:tasks.workunit.client.1.smithi060.stdout:2/420: dwrite d0/d3/f5a [0,4194304] 0 2023-10-18T20:58:30.564 INFO:tasks.workunit.client.1.smithi060.stdout:3/393: link d0/l2d d0/d22/d26/d2b/l87 0 2023-10-18T20:58:30.564 INFO:tasks.workunit.client.1.smithi060.stdout:3/394: readlink d0/l17 0 2023-10-18T20:58:30.565 INFO:tasks.workunit.client.1.smithi060.stdout:3/395: chown d0/d3c/d3d/f3e 2 1 2023-10-18T20:58:30.566 INFO:tasks.workunit.client.0.smithi008.stdout:0/339: creat d0/dd/d19/f6e x:0 0 0 2023-10-18T20:58:30.566 INFO:tasks.workunit.client.0.smithi008.stdout:0/340: creat d0/dd/df/d2a/f6f x:0 0 0 2023-10-18T20:58:30.569 INFO:tasks.workunit.client.0.smithi008.stdout:7/441: dwrite d1/d3/d20/d5f/d7f/f8d [0,4194304] 0 2023-10-18T20:58:30.570 INFO:tasks.workunit.client.0.smithi008.stdout:7/442: chown d1/d3/d20/d5f/d78/c94 224448 1 2023-10-18T20:58:30.570 INFO:tasks.workunit.client.0.smithi008.stdout:7/443: dread - d1/d3/f82 zero size 2023-10-18T20:58:30.572 INFO:tasks.workunit.client.1.smithi060.stdout:8/414: unlink d4/d9/f21 0 2023-10-18T20:58:30.574 INFO:tasks.workunit.client.0.smithi008.stdout:5/407: link d0/c40 d0/d2/d19/d7c/d58/c90 0 2023-10-18T20:58:30.582 INFO:tasks.workunit.client.1.smithi060.stdout:6/428: creat d10/d17/d70/f88 x:0 0 0 2023-10-18T20:58:30.582 INFO:tasks.workunit.client.1.smithi060.stdout:5/451: mknod d0/d6/d8/df/d27/d32/d6d/d72/d41/cac 0 2023-10-18T20:58:30.582 INFO:tasks.workunit.client.1.smithi060.stdout:6/429: dread - d10/d25/d3c/f6b zero size 2023-10-18T20:58:30.583 INFO:tasks.workunit.client.1.smithi060.stdout:6/430: dread - d10/d25/d3c/f6b zero size 2023-10-18T20:58:30.583 INFO:tasks.workunit.client.1.smithi060.stdout:9/369: dread d3/ff [0,4194304] 0 2023-10-18T20:58:30.583 INFO:tasks.workunit.client.1.smithi060.stdout:1/526: dwrite d4/d6/d7/d2f/d7b/d2a/f45 [0,4194304] 0 2023-10-18T20:58:30.584 INFO:tasks.workunit.client.0.smithi008.stdout:1/500: rmdir d9/de/df/d77 39 2023-10-18T20:58:30.585 INFO:tasks.workunit.client.1.smithi060.stdout:3/396: symlink d0/d3c/d3d/d82/l88 0 2023-10-18T20:58:30.590 INFO:tasks.workunit.client.1.smithi060.stdout:0/448: mkdir d3/d8/d3c/d87/d91 0 2023-10-18T20:58:30.590 INFO:tasks.workunit.client.1.smithi060.stdout:0/449: truncate d3/d8/d14/f5b 295653 0 2023-10-18T20:58:30.590 INFO:tasks.workunit.client.1.smithi060.stdout:8/415: mknod d4/d9/d4f/d74/c80 0 2023-10-18T20:58:30.591 INFO:tasks.workunit.client.1.smithi060.stdout:4/376: dwrite d4/dc/d2a/d5b/f5d [0,4194304] 0 2023-10-18T20:58:30.592 INFO:tasks.workunit.client.0.smithi008.stdout:6/428: dwrite df/d18/d3f/f7b [0,4194304] 0 2023-10-18T20:58:30.594 INFO:tasks.workunit.client.1.smithi060.stdout:5/452: unlink d0/d6/d8/df/l53 0 2023-10-18T20:58:30.600 INFO:tasks.workunit.client.0.smithi008.stdout:4/391: sync 2023-10-18T20:58:30.601 INFO:tasks.workunit.client.0.smithi008.stdout:8/526: sync 2023-10-18T20:58:30.601 INFO:tasks.workunit.client.0.smithi008.stdout:8/527: fdatasync d5/d8/d24/d50/d53/f99 0 2023-10-18T20:58:30.603 INFO:tasks.workunit.client.0.smithi008.stdout:0/341: mknod d0/dd/d19/d41/c70 0 2023-10-18T20:58:30.607 INFO:tasks.workunit.client.0.smithi008.stdout:2/433: sync 2023-10-18T20:58:30.608 INFO:tasks.workunit.client.0.smithi008.stdout:9/374: sync 2023-10-18T20:58:30.608 INFO:tasks.workunit.client.1.smithi060.stdout:5/453: dread d0/da/d61/f7f [0,4194304] 0 2023-10-18T20:58:30.609 INFO:tasks.workunit.client.1.smithi060.stdout:9/370: truncate d3/d10/d19/d54/f42 293980 0 2023-10-18T20:58:30.609 INFO:tasks.workunit.client.1.smithi060.stdout:5/454: truncate d0/d6/d9/d82/d83/d99/faa 833970 0 2023-10-18T20:58:30.610 INFO:tasks.workunit.client.0.smithi008.stdout:7/444: symlink d1/d3/d8b/l95 0 2023-10-18T20:58:30.613 INFO:tasks.workunit.client.0.smithi008.stdout:7/445: write d1/d36/d3d/d3e/d59/d73/f75 [422363,130285] 0 2023-10-18T20:58:30.613 INFO:tasks.workunit.client.0.smithi008.stdout:7/446: write d1/d3/d20/d5f/f72 [1471899,46498] 0 2023-10-18T20:58:30.613 INFO:tasks.workunit.client.0.smithi008.stdout:7/447: fdatasync d1/d3/f2a 0 2023-10-18T20:58:30.613 INFO:tasks.workunit.client.0.smithi008.stdout:5/408: mkdir d0/d2/d19/d7c/d31/d80/d91 0 2023-10-18T20:58:30.614 INFO:tasks.workunit.client.0.smithi008.stdout:5/409: write d0/d2/d9/d34/f3b [858073,3337] 0 2023-10-18T20:58:30.614 INFO:tasks.workunit.client.0.smithi008.stdout:1/501: rmdir d9/de/df/d17/d55 39 2023-10-18T20:58:30.615 INFO:tasks.workunit.client.1.smithi060.stdout:6/431: write d10/d17/d28/f24 [3211208,120958] 0 2023-10-18T20:58:30.615 INFO:tasks.workunit.client.1.smithi060.stdout:6/432: write d10/d25/d3c/f6b [739816,129055] 0 2023-10-18T20:58:30.618 INFO:tasks.workunit.client.1.smithi060.stdout:2/421: dwrite d0/d3/f32 [0,4194304] 0 2023-10-18T20:58:30.619 INFO:tasks.workunit.client.1.smithi060.stdout:2/422: truncate d0/d3/d27/d4d/d5e/f74 789767 0 2023-10-18T20:58:30.625 INFO:tasks.workunit.client.0.smithi008.stdout:8/528: dread d5/d8/df/f19 [0,4194304] 0 2023-10-18T20:58:30.626 INFO:tasks.workunit.client.0.smithi008.stdout:6/429: symlink df/d18/d68/l98 0 2023-10-18T20:58:30.629 INFO:tasks.workunit.client.1.smithi060.stdout:1/527: mkdir d4/d6/d7/d2f/d7b/d2a/d32/d56/daa 0 2023-10-18T20:58:30.630 INFO:tasks.workunit.client.1.smithi060.stdout:6/433: dread d10/d2e/f3f [0,4194304] 0 2023-10-18T20:58:30.630 INFO:tasks.workunit.client.1.smithi060.stdout:6/434: chown d10/d17/d2f/d66/f61 34345982 1 2023-10-18T20:58:30.630 INFO:tasks.workunit.client.1.smithi060.stdout:6/435: chown d10/d47 2130396 1 2023-10-18T20:58:30.631 INFO:tasks.workunit.client.0.smithi008.stdout:4/392: rename d0/d3/d21/d57/c81 to d0/d17/d6e/c85 0 2023-10-18T20:58:30.631 INFO:tasks.workunit.client.0.smithi008.stdout:0/342: rename d0/dd/d19 to d0/dd/d19/d5f/d71 22 2023-10-18T20:58:30.631 INFO:tasks.workunit.client.0.smithi008.stdout:0/343: read - d0/dd/d19/f6e zero size 2023-10-18T20:58:30.647 INFO:tasks.workunit.client.0.smithi008.stdout:9/375: creat d2/dc/d1a/d61/d59/f65 x:0 0 0 2023-10-18T20:58:30.647 INFO:tasks.workunit.client.1.smithi060.stdout:3/397: truncate d0/d22/d50/f53 5739396 0 2023-10-18T20:58:30.647 INFO:tasks.workunit.client.0.smithi008.stdout:9/376: creat d2/dc/d1a/d61/d59/f66 x:0 0 0 2023-10-18T20:58:30.648 INFO:tasks.workunit.client.0.smithi008.stdout:7/448: truncate d1/d36/f60 3930342 0 2023-10-18T20:58:30.649 INFO:tasks.workunit.client.0.smithi008.stdout:5/410: getdents d0/d2/d19/d7c/d31/d3f/d70 0 2023-10-18T20:58:30.650 INFO:tasks.workunit.client.1.smithi060.stdout:0/450: rmdir d3/d8 39 2023-10-18T20:58:30.654 INFO:tasks.workunit.client.0.smithi008.stdout:6/430: write df/d15/d27/f63 [2935739,1899] 0 2023-10-18T20:58:30.654 INFO:tasks.workunit.client.0.smithi008.stdout:6/431: chown df/d15/d48/d4b/l91 29815 1 2023-10-18T20:58:30.656 INFO:tasks.workunit.client.1.smithi060.stdout:5/455: rename d0/d6/d8/df/d27/d32/d6d/d72/d2a/c56 to d0/d6/d9/d82/d83/cad 0 2023-10-18T20:58:30.658 INFO:tasks.workunit.client.0.smithi008.stdout:1/502: dread d9/de/df/d17/d1e/f62 [4194304,4194304] 0 2023-10-18T20:58:30.658 INFO:tasks.workunit.client.0.smithi008.stdout:8/529: mkdir d5/d8/d24/d50/d53/d8c/dc9 0 2023-10-18T20:58:30.658 INFO:tasks.workunit.client.0.smithi008.stdout:8/530: dread - d5/d8/d24/d50/f6a zero size 2023-10-18T20:58:30.658 INFO:tasks.workunit.client.0.smithi008.stdout:8/531: chown d5/d8/df/d9d/d4d/db5/ca9 76 1 2023-10-18T20:58:30.659 INFO:tasks.workunit.client.0.smithi008.stdout:4/393: rmdir d0/d3/d48 39 2023-10-18T20:58:30.660 INFO:tasks.workunit.client.1.smithi060.stdout:5/456: read - d0/dd/f88 zero size 2023-10-18T20:58:30.660 INFO:tasks.workunit.client.1.smithi060.stdout:9/371: dread d3/d10/d1c/d2a/d2d/f63 [0,4194304] 0 2023-10-18T20:58:30.660 INFO:tasks.workunit.client.1.smithi060.stdout:8/416: dwrite d4/d9/f2e [0,4194304] 0 2023-10-18T20:58:30.660 INFO:tasks.workunit.client.1.smithi060.stdout:8/417: write d4/d9/f23 [1244962,3211] 0 2023-10-18T20:58:30.661 INFO:tasks.workunit.client.0.smithi008.stdout:2/434: dwrite d1/d3/dd/d1c/d3a/f80 [0,4194304] 0 2023-10-18T20:58:30.668 INFO:tasks.workunit.client.0.smithi008.stdout:0/344: creat d0/dd/d29/f72 x:0 0 0 2023-10-18T20:58:30.669 INFO:tasks.workunit.client.1.smithi060.stdout:1/528: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/fab x:0 0 0 2023-10-18T20:58:30.670 INFO:tasks.workunit.client.0.smithi008.stdout:9/377: creat d2/d4d/f67 x:0 0 0 2023-10-18T20:58:30.670 INFO:tasks.workunit.client.0.smithi008.stdout:7/449: mknod d1/d3/c96 0 2023-10-18T20:58:30.670 INFO:tasks.workunit.client.0.smithi008.stdout:7/450: dread - d1/d36/d3d/d3e/d59/d73/d7b/f80 zero size 2023-10-18T20:58:30.671 INFO:tasks.workunit.client.0.smithi008.stdout:5/411: creat d0/d2/d19/d7c/f92 x:0 0 0 2023-10-18T20:58:30.671 INFO:tasks.workunit.client.0.smithi008.stdout:5/412: chown d0/d2/d9/c74 58036253 1 2023-10-18T20:58:30.671 INFO:tasks.workunit.client.0.smithi008.stdout:1/503: mkdir d9/de/df/d17/d25/d94 0 2023-10-18T20:58:30.676 INFO:tasks.workunit.client.1.smithi060.stdout:4/377: dwrite d4/dc/d2a/d31/f46 [0,4194304] 0 2023-10-18T20:58:30.690 INFO:tasks.workunit.client.1.smithi060.stdout:5/457: dread d0/d6/d8/df/d27/f3c [0,4194304] 0 2023-10-18T20:58:30.691 INFO:tasks.workunit.client.1.smithi060.stdout:8/418: write d4/f53 [669602,53353] 0 2023-10-18T20:58:30.694 INFO:tasks.workunit.client.1.smithi060.stdout:6/436: mknod d10/d17/d2f/d66/c89 0 2023-10-18T20:58:30.696 INFO:tasks.workunit.client.0.smithi008.stdout:8/532: creat d5/d8/df/d9d/d4d/db5/da3/fca x:0 0 0 2023-10-18T20:58:30.698 INFO:tasks.workunit.client.1.smithi060.stdout:0/451: creat d3/d8/d14/d55/d74/d76/d68/f92 x:0 0 0 2023-10-18T20:58:30.703 INFO:tasks.workunit.client.0.smithi008.stdout:4/394: symlink d0/d17/d5b/d45/l86 0 2023-10-18T20:58:30.703 INFO:tasks.workunit.client.0.smithi008.stdout:4/395: write d0/d3/f41 [9332673,106847] 0 2023-10-18T20:58:30.704 INFO:tasks.workunit.client.0.smithi008.stdout:4/396: creat d0/d17/d6e/f87 x:0 0 0 2023-10-18T20:58:30.712 INFO:tasks.workunit.client.1.smithi060.stdout:2/423: rename d0/d16/f1a to d0/d3/d27/d4d/d5e/f7c 0 2023-10-18T20:58:30.712 INFO:tasks.workunit.client.1.smithi060.stdout:2/424: fdatasync d0/d3/d27/d4d/d5e/f74 0 2023-10-18T20:58:30.712 INFO:tasks.workunit.client.1.smithi060.stdout:2/425: creat d0/d3/d27/d4d/f7d x:0 0 0 2023-10-18T20:58:30.717 INFO:tasks.workunit.client.1.smithi060.stdout:4/378: dwrite d4/dc/d2a/d5b/f5d [4194304,4194304] 0 2023-10-18T20:58:30.717 INFO:tasks.workunit.client.1.smithi060.stdout:7/472: sync 2023-10-18T20:58:30.717 INFO:tasks.workunit.client.1.smithi060.stdout:4/379: chown d4/dc/d2a/d2d/f4f 17995082 1 2023-10-18T20:58:30.717 INFO:tasks.workunit.client.1.smithi060.stdout:4/380: creat d4/d15/f73 x:0 0 0 2023-10-18T20:58:30.723 INFO:tasks.workunit.client.1.smithi060.stdout:1/529: mknod d4/d6/d7/cac 0 2023-10-18T20:58:30.724 INFO:tasks.workunit.client.1.smithi060.stdout:1/530: write d4/f9c [922107,49669] 0 2023-10-18T20:58:30.725 INFO:tasks.workunit.client.1.smithi060.stdout:6/437: dread d10/d17/d2f/d66/f22 [0,4194304] 0 2023-10-18T20:58:30.725 INFO:tasks.workunit.client.1.smithi060.stdout:6/438: fdatasync fc 0 2023-10-18T20:58:30.729 INFO:tasks.workunit.client.0.smithi008.stdout:7/451: unlink d1/d36/d3d/d3e/d59/d73/f88 0 2023-10-18T20:58:30.732 INFO:tasks.workunit.client.0.smithi008.stdout:7/452: stat d1/d3/d20/d5f/d7f 0 2023-10-18T20:58:30.732 INFO:tasks.workunit.client.0.smithi008.stdout:7/453: chown d1/d36/d3b/d4f 23 1 2023-10-18T20:58:30.732 INFO:tasks.workunit.client.0.smithi008.stdout:7/454: write d1/d3/d8b/f93 [522724,58203] 0 2023-10-18T20:58:30.732 INFO:tasks.workunit.client.0.smithi008.stdout:7/455: read - d1/d36/d3b/d4f/d5c/f84 zero size 2023-10-18T20:58:30.735 INFO:tasks.workunit.client.0.smithi008.stdout:1/504: dread d9/de/df/f56 [0,4194304] 0 2023-10-18T20:58:30.735 INFO:tasks.workunit.client.0.smithi008.stdout:1/505: chown d9/de/df/d17/d25/c60 18461 1 2023-10-18T20:58:30.739 INFO:tasks.workunit.client.0.smithi008.stdout:5/413: rename d0/d2/d9/cc to d0/c93 0 2023-10-18T20:58:30.753 INFO:tasks.workunit.client.0.smithi008.stdout:6/432: dwrite df/d3c/f67 [0,4194304] 0 2023-10-18T20:58:30.754 INFO:tasks.workunit.client.0.smithi008.stdout:8/533: creat d5/d8/d24/d50/d8d/d95/dc4/fcb x:0 0 0 2023-10-18T20:58:30.755 INFO:tasks.workunit.client.0.smithi008.stdout:8/534: fsync d5/d8/d24/d50/f74 0 2023-10-18T20:58:30.758 INFO:tasks.workunit.client.0.smithi008.stdout:0/345: dwrite d0/dd/d19/d24/f66 [0,4194304] 0 2023-10-18T20:58:30.759 INFO:tasks.workunit.client.0.smithi008.stdout:4/397: creat d0/d3/d48/f88 x:0 0 0 2023-10-18T20:58:30.759 INFO:tasks.workunit.client.1.smithi060.stdout:5/458: creat d0/d6/d8/df/fae x:0 0 0 2023-10-18T20:58:30.760 INFO:tasks.workunit.client.1.smithi060.stdout:8/419: mkdir d4/d9/d4f/d74/d81 0 2023-10-18T20:58:30.760 INFO:tasks.workunit.client.1.smithi060.stdout:0/452: rmdir d3/d8/d3c/d87 39 2023-10-18T20:58:30.767 INFO:tasks.workunit.client.0.smithi008.stdout:1/506: rmdir d9/de/df/d17/d69/d8f 0 2023-10-18T20:58:30.769 INFO:tasks.workunit.client.1.smithi060.stdout:2/426: link d0/d8/d47/f4b d0/d45/d49/f7e 0 2023-10-18T20:58:30.770 INFO:tasks.workunit.client.0.smithi008.stdout:6/433: creat df/d3c/d77/f99 x:0 0 0 2023-10-18T20:58:30.777 INFO:tasks.workunit.client.1.smithi060.stdout:4/381: dwrite d4/dc/d2a/d13/f3f [0,4194304] 0 2023-10-18T20:58:30.781 INFO:tasks.workunit.client.1.smithi060.stdout:0/453: dread d3/d8/d14/f3d [0,4194304] 0 2023-10-18T20:58:30.782 INFO:tasks.workunit.client.1.smithi060.stdout:6/439: getdents d10/d2e/d75 0 2023-10-18T20:58:30.782 INFO:tasks.workunit.client.1.smithi060.stdout:6/440: readlink d10/d17/d28/l20 0 2023-10-18T20:58:30.784 INFO:tasks.workunit.client.0.smithi008.stdout:7/456: dread d1/d36/d3b/d79/f6a [4194304,4194304] 0 2023-10-18T20:58:30.785 INFO:tasks.workunit.client.0.smithi008.stdout:7/457: fdatasync d1/d3/d20/f89 0 2023-10-18T20:58:30.788 INFO:tasks.workunit.client.0.smithi008.stdout:0/346: rename d0/dd/l26 to d0/d3a/l73 0 2023-10-18T20:58:30.791 INFO:tasks.workunit.client.1.smithi060.stdout:8/420: creat d4/d9/d31/d35/f82 x:0 0 0 2023-10-18T20:58:30.791 INFO:tasks.workunit.client.1.smithi060.stdout:2/427: mkdir d0/d16/d7f 0 2023-10-18T20:58:30.795 INFO:tasks.workunit.client.1.smithi060.stdout:8/421: write d4/f53 [1252649,43803] 0 2023-10-18T20:58:30.799 INFO:tasks.workunit.client.0.smithi008.stdout:9/378: dwrite d2/dc/d17/f2e [0,4194304] 0 2023-10-18T20:58:30.800 INFO:tasks.workunit.client.0.smithi008.stdout:4/398: dread d0/d3/f41 [4194304,4194304] 0 2023-10-18T20:58:30.803 INFO:tasks.workunit.client.0.smithi008.stdout:6/434: write df/d3c/d77/f76 [2998182,31168] 0 2023-10-18T20:58:30.803 INFO:tasks.workunit.client.0.smithi008.stdout:6/435: creat df/d18/d3f/f9a x:0 0 0 2023-10-18T20:58:30.810 INFO:tasks.workunit.client.1.smithi060.stdout:1/531: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/f4f [0,4194304] 0 2023-10-18T20:58:30.817 INFO:tasks.workunit.client.1.smithi060.stdout:5/459: dwrite d0/d6/d8/df/d27/d32/d6d/d72/f85 [0,4194304] 0 2023-10-18T20:58:30.818 INFO:tasks.workunit.client.0.smithi008.stdout:7/458: dread d1/d36/d3b/d79/f4a [0,4194304] 0 2023-10-18T20:58:30.818 INFO:tasks.workunit.client.0.smithi008.stdout:7/459: fdatasync d1/d3/d20/f2f 0 2023-10-18T20:58:30.818 INFO:tasks.workunit.client.0.smithi008.stdout:7/460: fsync d1/d36/d3b/d4f/f51 0 2023-10-18T20:58:30.823 INFO:tasks.workunit.client.1.smithi060.stdout:2/428: symlink d0/d3/d27/l80 0 2023-10-18T20:58:30.823 INFO:tasks.workunit.client.1.smithi060.stdout:7/473: dwrite de/f1f [0,4194304] 0 2023-10-18T20:58:30.823 INFO:tasks.workunit.client.1.smithi060.stdout:0/454: link d3/d8/f11 d3/d8/d14/d55/d74/d76/f93 0 2023-10-18T20:58:30.824 INFO:tasks.workunit.client.1.smithi060.stdout:0/455: stat d3/f4f 0 2023-10-18T20:58:30.826 INFO:tasks.workunit.client.0.smithi008.stdout:1/507: mkdir d9/de/df/d17/d1e/d3c/d90/d95 0 2023-10-18T20:58:30.826 INFO:tasks.workunit.client.0.smithi008.stdout:1/508: chown d9/de/df/d77/c82 159007 1 2023-10-18T20:58:30.826 INFO:tasks.workunit.client.0.smithi008.stdout:1/509: fsync d9/de/f45 0 2023-10-18T20:58:30.827 INFO:tasks.workunit.client.0.smithi008.stdout:0/347: unlink d0/dd/d19/f4e 0 2023-10-18T20:58:30.827 INFO:tasks.workunit.client.0.smithi008.stdout:0/348: chown d0/dd/df/f1c 2306 1 2023-10-18T20:58:30.827 INFO:tasks.workunit.client.0.smithi008.stdout:0/349: dread - d0/f51 zero size 2023-10-18T20:58:30.827 INFO:tasks.workunit.client.0.smithi008.stdout:0/350: chown d0/dd/df/f4c 14 1 2023-10-18T20:58:30.828 INFO:tasks.workunit.client.0.smithi008.stdout:6/436: dread df/d13/f17 [0,4194304] 0 2023-10-18T20:58:30.835 INFO:tasks.workunit.client.1.smithi060.stdout:2/429: dread d0/f78 [0,4194304] 0 2023-10-18T20:58:30.843 INFO:tasks.workunit.client.0.smithi008.stdout:5/414: dwrite d0/d2/d19/d7c/d31/d3f/d70/f8b [0,4194304] 0 2023-10-18T20:58:30.845 INFO:tasks.workunit.client.1.smithi060.stdout:4/382: dwrite d4/dc/d2a/d13/d2f/f34 [8388608,4194304] 0 2023-10-18T20:58:30.846 INFO:tasks.workunit.client.0.smithi008.stdout:7/461: write d1/d36/d3d/f5a [3542903,57599] 0 2023-10-18T20:58:30.846 INFO:tasks.workunit.client.0.smithi008.stdout:7/462: stat d1/d36/d3d/l63 0 2023-10-18T20:58:30.848 INFO:tasks.workunit.client.1.smithi060.stdout:8/422: creat d4/d9/f83 x:0 0 0 2023-10-18T20:58:30.849 INFO:tasks.workunit.client.1.smithi060.stdout:8/423: dread - d4/d9/f83 zero size 2023-10-18T20:58:30.849 INFO:tasks.workunit.client.1.smithi060.stdout:8/424: creat d4/d9/d31/d35/f84 x:0 0 0 2023-10-18T20:58:30.858 INFO:tasks.workunit.client.1.smithi060.stdout:1/532: dwrite d4/d38/d83/f91 [0,4194304] 0 2023-10-18T20:58:30.859 INFO:tasks.workunit.client.1.smithi060.stdout:1/533: chown d4/d6/d7/d2f/d7b/c54 8 1 2023-10-18T20:58:30.866 INFO:tasks.workunit.client.1.smithi060.stdout:4/383: dread d4/dc/d2a/d2d/f4f [0,4194304] 0 2023-10-18T20:58:30.867 INFO:tasks.workunit.client.0.smithi008.stdout:4/399: rename d0/d17/f3a to d0/d58/d83/f89 0 2023-10-18T20:58:30.871 INFO:tasks.workunit.client.0.smithi008.stdout:0/351: mkdir d0/d3a/d61/d74 0 2023-10-18T20:58:30.871 INFO:tasks.workunit.client.0.smithi008.stdout:0/352: dread - d0/dd/d19/d41/f6b zero size 2023-10-18T20:58:30.872 INFO:tasks.workunit.client.1.smithi060.stdout:5/460: symlink d0/da/d79/laf 0 2023-10-18T20:58:30.872 INFO:tasks.workunit.client.1.smithi060.stdout:5/461: readlink d0/da/d3b/d43/l74 0 2023-10-18T20:58:30.875 INFO:tasks.workunit.client.0.smithi008.stdout:6/437: symlink df/d18/d7e/l9b 0 2023-10-18T20:58:30.875 INFO:tasks.workunit.client.0.smithi008.stdout:6/438: fsync df/d13/f1a 0 2023-10-18T20:58:30.875 INFO:tasks.workunit.client.1.smithi060.stdout:7/474: symlink de/d14/l93 0 2023-10-18T20:58:30.877 INFO:tasks.workunit.client.0.smithi008.stdout:5/415: rename d0/d2/d19/d7c/f26 to d0/d2/d19/d7c/d58/d65/f94 0 2023-10-18T20:58:30.878 INFO:tasks.workunit.client.1.smithi060.stdout:0/456: truncate d3/d32/f38 1951496 0 2023-10-18T20:58:30.880 INFO:tasks.workunit.client.0.smithi008.stdout:1/510: dwrite d9/de/df/d17/d55/f78 [0,4194304] 0 2023-10-18T20:58:30.881 INFO:tasks.workunit.client.0.smithi008.stdout:4/400: mkdir d0/d74/d8a 0 2023-10-18T20:58:30.882 INFO:tasks.workunit.client.0.smithi008.stdout:0/353: symlink d0/dd/d29/l75 0 2023-10-18T20:58:30.882 INFO:tasks.workunit.client.0.smithi008.stdout:0/354: creat d0/dd/d19/f76 x:0 0 0 2023-10-18T20:58:30.883 INFO:tasks.workunit.client.0.smithi008.stdout:0/355: creat d0/dd/df/d20/f77 x:0 0 0 2023-10-18T20:58:30.883 INFO:tasks.workunit.client.0.smithi008.stdout:0/356: fdatasync d0/dd/df/f4c 0 2023-10-18T20:58:30.884 INFO:tasks.workunit.client.1.smithi060.stdout:2/430: mkdir d0/d16/d81 0 2023-10-18T20:58:30.885 INFO:tasks.workunit.client.0.smithi008.stdout:9/379: dwrite d2/f3 [8388608,4194304] 0 2023-10-18T20:58:30.886 INFO:tasks.workunit.client.0.smithi008.stdout:5/416: rename d0/d2/d9/f4b to d0/d2/d19/d7c/f95 0 2023-10-18T20:58:30.891 INFO:tasks.workunit.client.0.smithi008.stdout:7/463: dwrite d1/d3/d20/d5f/d7f/f8d [0,4194304] 0 2023-10-18T20:58:30.891 INFO:tasks.workunit.client.1.smithi060.stdout:8/425: mknod d4/d9/d37/d4e/d6e/c85 0 2023-10-18T20:58:30.892 INFO:tasks.workunit.client.1.smithi060.stdout:8/426: chown d4/d9/d37/c41 29 1 2023-10-18T20:58:30.892 INFO:tasks.workunit.client.0.smithi008.stdout:1/511: symlink d9/de/df/d85/l96 0 2023-10-18T20:58:30.899 INFO:tasks.workunit.client.1.smithi060.stdout:3/398: sync 2023-10-18T20:58:30.901 INFO:tasks.workunit.client.1.smithi060.stdout:9/372: sync 2023-10-18T20:58:30.904 INFO:tasks.workunit.client.0.smithi008.stdout:6/439: write df/d74/f75 [3887409,17831] 0 2023-10-18T20:58:30.910 INFO:tasks.workunit.client.0.smithi008.stdout:3/350: sync 2023-10-18T20:58:30.914 INFO:tasks.workunit.client.1.smithi060.stdout:6/441: sync 2023-10-18T20:58:30.914 INFO:tasks.workunit.client.1.smithi060.stdout:6/442: truncate d10/d17/f82 491270 0 2023-10-18T20:58:30.914 INFO:tasks.workunit.client.1.smithi060.stdout:6/443: stat d10/f35 0 2023-10-18T20:58:30.915 INFO:tasks.workunit.client.0.smithi008.stdout:0/357: link d0/dd/df/c25 d0/dd/d19/d5f/c78 0 2023-10-18T20:58:30.915 INFO:tasks.workunit.client.0.smithi008.stdout:0/358: creat d0/dd/d19/f79 x:0 0 0 2023-10-18T20:58:30.923 INFO:tasks.workunit.client.0.smithi008.stdout:1/512: dread d9/de/df/d17/d1e/f62 [0,4194304] 0 2023-10-18T20:58:30.923 INFO:tasks.workunit.client.0.smithi008.stdout:1/513: read d9/de/df/d17/d55/f5c [2610251,103325] 0 2023-10-18T20:58:30.923 INFO:tasks.workunit.client.0.smithi008.stdout:1/514: chown d9/c64 108 1 2023-10-18T20:58:30.924 INFO:tasks.workunit.client.1.smithi060.stdout:4/384: rmdir d4/dc/d2a/d31 39 2023-10-18T20:58:30.924 INFO:tasks.workunit.client.1.smithi060.stdout:1/534: rename d4/f9c to d4/d6/d7/d2f/d7b/d2a/d32/d56/fad 0 2023-10-18T20:58:30.925 INFO:tasks.workunit.client.1.smithi060.stdout:4/385: stat d4/dc/d2a/d1d 0 2023-10-18T20:58:30.925 INFO:tasks.workunit.client.1.smithi060.stdout:1/535: chown d4/d6/d7/f26 50544 1 2023-10-18T20:58:30.925 INFO:tasks.workunit.client.1.smithi060.stdout:1/536: truncate d4/d6/d14/d41/fa5 600465 0 2023-10-18T20:58:30.925 INFO:tasks.workunit.client.1.smithi060.stdout:4/386: creat d4/dc/d2a/d2d/f74 x:0 0 0 2023-10-18T20:58:30.925 INFO:tasks.workunit.client.1.smithi060.stdout:7/475: creat de/d14/d2f/d3f/d5a/f94 x:0 0 0 2023-10-18T20:58:30.926 INFO:tasks.workunit.client.1.smithi060.stdout:6/444: dread d10/d2e/f4e [0,4194304] 0 2023-10-18T20:58:30.927 INFO:tasks.workunit.client.1.smithi060.stdout:6/445: creat d10/d17/d2f/f8a x:0 0 0 2023-10-18T20:58:30.927 INFO:tasks.workunit.client.1.smithi060.stdout:6/446: readlink d10/d25/l45 0 2023-10-18T20:58:30.927 INFO:tasks.workunit.client.1.smithi060.stdout:6/447: dread - d10/d17/d2f/f7d zero size 2023-10-18T20:58:30.931 INFO:tasks.workunit.client.1.smithi060.stdout:5/462: dwrite d0/d6/d9/f14 [4194304,4194304] 0 2023-10-18T20:58:30.931 INFO:tasks.workunit.client.1.smithi060.stdout:5/463: readlink d0/d6/d8/df/d27/la7 0 2023-10-18T20:58:30.932 INFO:tasks.workunit.client.0.smithi008.stdout:9/380: creat d2/dc/d17/d19/d4a/f68 x:0 0 0 2023-10-18T20:58:30.933 INFO:tasks.workunit.client.1.smithi060.stdout:2/431: unlink d0/f71 0 2023-10-18T20:58:30.938 INFO:tasks.workunit.client.1.smithi060.stdout:8/427: dwrite d4/f25 [0,4194304] 0 2023-10-18T20:58:30.940 INFO:tasks.workunit.client.0.smithi008.stdout:6/440: rename df/d19/f32 to df/d15/d27/d38/f9c 0 2023-10-18T20:58:30.941 INFO:tasks.workunit.client.1.smithi060.stdout:3/399: stat d0/l5 0 2023-10-18T20:58:30.947 INFO:tasks.workunit.client.1.smithi060.stdout:9/373: creat d3/d10/d19/d54/d8f/f96 x:0 0 0 2023-10-18T20:58:30.948 INFO:tasks.workunit.client.1.smithi060.stdout:4/387: mknod d4/dc/d2a/d2d/c75 0 2023-10-18T20:58:30.948 INFO:tasks.workunit.client.1.smithi060.stdout:7/476: creat de/d14/d2f/d8f/d5b/f95 x:0 0 0 2023-10-18T20:58:30.948 INFO:tasks.workunit.client.1.smithi060.stdout:4/388: fdatasync d4/dc/d2a/d13/d33/f52 0 2023-10-18T20:58:30.948 INFO:tasks.workunit.client.1.smithi060.stdout:7/477: chown de/d14/c28 2158 1 2023-10-18T20:58:30.948 INFO:tasks.workunit.client.1.smithi060.stdout:7/478: chown de/l52 1309 1 2023-10-18T20:58:30.949 INFO:tasks.workunit.client.1.smithi060.stdout:1/537: mknod d4/d6/d7/d2f/cae 0 2023-10-18T20:58:30.951 INFO:tasks.workunit.client.0.smithi008.stdout:6/441: symlink df/d13/d53/d64/l9d 0 2023-10-18T20:58:30.952 INFO:tasks.workunit.client.1.smithi060.stdout:6/448: mkdir d10/d2e/d75/d81/d8b 0 2023-10-18T20:58:30.952 INFO:tasks.workunit.client.1.smithi060.stdout:6/449: read d10/d17/d54/f5a [3515961,114494] 0 2023-10-18T20:58:30.952 INFO:tasks.workunit.client.1.smithi060.stdout:6/450: write d10/d17/d70/f88 [829216,23026] 0 2023-10-18T20:58:30.953 INFO:tasks.workunit.client.1.smithi060.stdout:5/464: symlink d0/d6/d8/df/d27/d32/d6d/d72/d2a/lb0 0 2023-10-18T20:58:30.953 INFO:tasks.workunit.client.1.smithi060.stdout:2/432: mknod d0/d3/c82 0 2023-10-18T20:58:30.959 INFO:tasks.workunit.client.0.smithi008.stdout:1/515: dread d9/de/df/d17/d55/f78 [0,4194304] 0 2023-10-18T20:58:30.959 INFO:tasks.workunit.client.0.smithi008.stdout:7/464: dwrite d1/d3/f57 [0,4194304] 0 2023-10-18T20:58:30.959 INFO:tasks.workunit.client.0.smithi008.stdout:7/465: chown d1/d3/l6d 995861487 1 2023-10-18T20:58:30.964 INFO:tasks.workunit.client.1.smithi060.stdout:4/389: mkdir d4/dc/d2a/d39/d53/d76 0 2023-10-18T20:58:30.964 INFO:tasks.workunit.client.1.smithi060.stdout:4/390: read - d4/d15/f73 zero size 2023-10-18T20:58:30.964 INFO:tasks.workunit.client.1.smithi060.stdout:1/538: getdents d4/d6/d14 0 2023-10-18T20:58:30.966 INFO:tasks.workunit.client.1.smithi060.stdout:3/400: getdents d0/d3c/d3d/d82 0 2023-10-18T20:58:30.966 INFO:tasks.workunit.client.1.smithi060.stdout:3/401: write d0/f24 [4672485,77519] 0 2023-10-18T20:58:30.967 INFO:tasks.workunit.client.0.smithi008.stdout:3/351: dread d0/d3/f2b [0,4194304] 0 2023-10-18T20:58:30.972 INFO:tasks.workunit.client.0.smithi008.stdout:6/442: read df/d18/d3f/f7b [3161904,113662] 0 2023-10-18T20:58:30.972 INFO:tasks.workunit.client.1.smithi060.stdout:5/465: mkdir d0/d6/d9/db1 0 2023-10-18T20:58:30.974 INFO:tasks.workunit.client.0.smithi008.stdout:5/417: dwrite d0/d2/f23 [0,4194304] 0 2023-10-18T20:58:30.975 INFO:tasks.workunit.client.0.smithi008.stdout:5/418: dread - d0/d2/d19/d7c/d41/d6f/f7f zero size 2023-10-18T20:58:30.975 INFO:tasks.workunit.client.0.smithi008.stdout:5/419: chown d0/de/c18 6253053 1 2023-10-18T20:58:30.975 INFO:tasks.workunit.client.0.smithi008.stdout:5/420: chown d0/d2/d19/d7c/d42/f84 6 1 2023-10-18T20:58:30.975 INFO:tasks.workunit.client.1.smithi060.stdout:2/433: truncate d0/d8/f2c 2425366 0 2023-10-18T20:58:30.977 INFO:tasks.workunit.client.0.smithi008.stdout:1/516: symlink d9/de/df/d17/d1e/d3c/l97 0 2023-10-18T20:58:30.982 INFO:tasks.workunit.client.1.smithi060.stdout:3/402: symlink d0/d22/d26/d2b/l89 0 2023-10-18T20:58:30.982 INFO:tasks.workunit.client.1.smithi060.stdout:4/391: dread d4/dc/d2a/d1d/f21 [0,4194304] 0 2023-10-18T20:58:30.982 INFO:tasks.workunit.client.1.smithi060.stdout:4/392: truncate d4/d15/f45 193759 0 2023-10-18T20:58:30.983 INFO:tasks.workunit.client.1.smithi060.stdout:4/393: chown d4/dc/d40/l4b 1683 1 2023-10-18T20:58:30.983 INFO:tasks.workunit.client.0.smithi008.stdout:0/359: write d0/f11 [2628769,34190] 0 2023-10-18T20:58:30.983 INFO:tasks.workunit.client.0.smithi008.stdout:7/466: symlink d1/d3/l97 0 2023-10-18T20:58:30.984 INFO:tasks.workunit.client.0.smithi008.stdout:7/467: read - d1/d36/d3d/d3e/d59/d73/d7b/f80 zero size 2023-10-18T20:58:30.985 INFO:tasks.workunit.client.0.smithi008.stdout:3/352: unlink d0/d3/de/l40 0 2023-10-18T20:58:30.985 INFO:tasks.workunit.client.0.smithi008.stdout:3/353: fdatasync d0/d3/f2b 0 2023-10-18T20:58:30.992 INFO:tasks.workunit.client.1.smithi060.stdout:1/539: dread d4/d6/d7/d2f/d7b/d2a/d32/dd/f5c [0,4194304] 0 2023-10-18T20:58:30.992 INFO:tasks.workunit.client.0.smithi008.stdout:6/443: unlink df/d18/f2d 0 2023-10-18T20:58:30.993 INFO:tasks.workunit.client.0.smithi008.stdout:6/444: creat df/d74/f9e x:0 0 0 2023-10-18T20:58:30.994 INFO:tasks.workunit.client.1.smithi060.stdout:2/434: mknod d0/d43/c83 0 2023-10-18T20:58:30.995 INFO:tasks.workunit.client.1.smithi060.stdout:4/394: truncate d4/d15/f51 3898080 0 2023-10-18T20:58:30.995 INFO:tasks.workunit.client.1.smithi060.stdout:4/395: getdents d4/dc/d2a/d2d/d69 0 2023-10-18T20:58:30.996 INFO:tasks.workunit.client.0.smithi008.stdout:5/421: mknod d0/d2/d19/d7c/d41/d6f/d75/c96 0 2023-10-18T20:58:30.997 INFO:tasks.workunit.client.0.smithi008.stdout:1/517: link d9/de/df/d17/d25/d57/c7c d9/de/df/d85/c98 0 2023-10-18T20:58:31.000 INFO:tasks.workunit.client.0.smithi008.stdout:7/468: rename d1/d36/d3d/d3e/c7d to d1/d3/c98 0 2023-10-18T20:58:31.001 INFO:tasks.workunit.client.0.smithi008.stdout:7/469: chown d1/d36/d3b/d4f/f6e 33912211 1 2023-10-18T20:58:31.001 INFO:tasks.workunit.client.0.smithi008.stdout:7/470: chown d1/d3/d20/d5f/d78/f86 3673 1 2023-10-18T20:58:31.001 INFO:tasks.workunit.client.0.smithi008.stdout:7/471: dread - d1/d3/f82 zero size 2023-10-18T20:58:31.002 INFO:tasks.workunit.client.0.smithi008.stdout:3/354: mknod d0/d3/de/d13/d35/c6c 0 2023-10-18T20:58:31.003 INFO:tasks.workunit.client.1.smithi060.stdout:1/540: mkdir d4/d6/d7/d2f/d7b/d2a/d32/d56/daf 0 2023-10-18T20:58:31.004 INFO:tasks.workunit.client.0.smithi008.stdout:6/445: symlink df/d15/d27/l9f 0 2023-10-18T20:58:31.004 INFO:tasks.workunit.client.0.smithi008.stdout:6/446: chown df/d18/d68 15377989 1 2023-10-18T20:58:31.005 INFO:tasks.workunit.client.0.smithi008.stdout:5/422: rename d0/d2/d19/f2c to d0/d6e/f97 0 2023-10-18T20:58:31.006 INFO:tasks.workunit.client.1.smithi060.stdout:7/479: write fc [3901002,124703] 0 2023-10-18T20:58:31.006 INFO:tasks.workunit.client.1.smithi060.stdout:7/480: fdatasync de/d14/d3a/f56 0 2023-10-18T20:58:31.006 INFO:tasks.workunit.client.1.smithi060.stdout:9/374: dwrite d3/d10/d19/d54/f4a [0,4194304] 0 2023-10-18T20:58:31.007 INFO:tasks.workunit.client.0.smithi008.stdout:1/518: write d9/de/df/d17/d55/f78 [114999,11857] 0 2023-10-18T20:58:31.008 INFO:tasks.workunit.client.0.smithi008.stdout:1/519: readlink d9/de/df/d17/d1e/d3c/l72 0 2023-10-18T20:58:31.008 INFO:tasks.workunit.client.0.smithi008.stdout:1/520: dread - d9/f7a zero size 2023-10-18T20:58:31.008 INFO:tasks.workunit.client.0.smithi008.stdout:1/521: read d9/de/df/d17/d1e/f2d [42625,69720] 0 2023-10-18T20:58:31.008 INFO:tasks.workunit.client.0.smithi008.stdout:1/522: chown d9/de/df/d17/d25/d94 1 1 2023-10-18T20:58:31.009 INFO:tasks.workunit.client.1.smithi060.stdout:8/428: dwrite d4/f53 [0,4194304] 0 2023-10-18T20:58:31.009 INFO:tasks.workunit.client.1.smithi060.stdout:8/429: fsync d4/d9/d31/d35/f51 0 2023-10-18T20:58:31.009 INFO:tasks.workunit.client.1.smithi060.stdout:8/430: creat d4/d9/d4f/f86 x:0 0 0 2023-10-18T20:58:31.009 INFO:tasks.workunit.client.1.smithi060.stdout:8/431: write d4/d9/d37/d4e/d5e/f60 [762130,92861] 0 2023-10-18T20:58:31.010 INFO:tasks.workunit.client.0.smithi008.stdout:7/472: mknod d1/d36/d3b/d4f/d87/c99 0 2023-10-18T20:58:31.010 INFO:tasks.workunit.client.1.smithi060.stdout:7/481: mknod de/d14/d2f/d8f/d65/c96 0 2023-10-18T20:58:31.011 INFO:tasks.workunit.client.0.smithi008.stdout:6/447: symlink df/d15/d48/d4b/la0 0 2023-10-18T20:58:31.012 INFO:tasks.workunit.client.0.smithi008.stdout:5/423: rmdir d0/d2/d19/d7c/d41 39 2023-10-18T20:58:31.017 INFO:tasks.workunit.client.0.smithi008.stdout:1/523: creat d9/de/df/d17/d1e/d3c/d90/f99 x:0 0 0 2023-10-18T20:58:31.018 INFO:tasks.workunit.client.0.smithi008.stdout:7/473: truncate d1/d36/d3b/f50 2089010 0 2023-10-18T20:58:31.018 INFO:tasks.workunit.client.0.smithi008.stdout:6/448: rmdir df/d19 39 2023-10-18T20:58:31.018 INFO:tasks.workunit.client.1.smithi060.stdout:9/375: getdents d3/d10/d65 0 2023-10-18T20:58:31.022 INFO:tasks.workunit.client.1.smithi060.stdout:2/435: write d0/d8/fd [166295,2345] 0 2023-10-18T20:58:31.023 INFO:tasks.workunit.client.1.smithi060.stdout:3/403: dwrite d0/d22/d26/d2b/f4c [0,4194304] 0 2023-10-18T20:58:31.023 INFO:tasks.workunit.client.0.smithi008.stdout:5/424: link d0/d2/d19/d7c/d58/d65/f94 d0/d6e/f98 0 2023-10-18T20:58:31.024 INFO:tasks.workunit.client.0.smithi008.stdout:1/524: mkdir d9/de/df/d17/d1e/d9a 0 2023-10-18T20:58:31.026 INFO:tasks.workunit.client.0.smithi008.stdout:7/474: creat d1/d3/d20/d5f/d7f/f9a x:0 0 0 2023-10-18T20:58:31.028 INFO:tasks.workunit.client.0.smithi008.stdout:6/449: rename df/l10 to df/d26/la1 0 2023-10-18T20:58:31.029 INFO:tasks.workunit.client.0.smithi008.stdout:6/450: chown df/d15/d27/d4c/c60 511 1 2023-10-18T20:58:31.030 INFO:tasks.workunit.client.1.smithi060.stdout:3/404: mknod d0/d3c/c8a 0 2023-10-18T20:58:31.031 INFO:tasks.workunit.client.1.smithi060.stdout:3/405: dread - d0/d22/d26/d2b/f77 zero size 2023-10-18T20:58:31.036 INFO:tasks.workunit.client.0.smithi008.stdout:1/525: link d9/de/df/d17/d25/d57/c86 d9/de/df/d17/d1e/d3c/d90/c9b 0 2023-10-18T20:58:31.036 INFO:tasks.workunit.client.0.smithi008.stdout:6/451: mkdir df/d3c/da2 0 2023-10-18T20:58:31.037 INFO:tasks.workunit.client.0.smithi008.stdout:1/526: dread - d9/f4f zero size 2023-10-18T20:58:31.037 INFO:tasks.workunit.client.1.smithi060.stdout:3/406: truncate d0/f11 449759 0 2023-10-18T20:58:31.039 INFO:tasks.workunit.client.1.smithi060.stdout:2/436: read d0/d3/d27/f4c [3311936,106714] 0 2023-10-18T20:58:31.043 INFO:tasks.workunit.client.0.smithi008.stdout:5/425: unlink d0/d2/d19/d7c/d42/f84 0 2023-10-18T20:58:31.043 INFO:tasks.workunit.client.0.smithi008.stdout:5/426: fdatasync d0/d2/d19/d7c/d58/d65/f2b 0 2023-10-18T20:58:31.043 INFO:tasks.workunit.client.0.smithi008.stdout:1/527: write d9/de/df/d17/d25/d57/f87 [4291913,49059] 0 2023-10-18T20:58:31.044 INFO:tasks.workunit.client.1.smithi060.stdout:3/407: mknod d0/d3c/c8b 0 2023-10-18T20:58:31.044 INFO:tasks.workunit.client.1.smithi060.stdout:2/437: mknod d0/d45/d49/d6e/d79/d6c/c84 0 2023-10-18T20:58:31.044 INFO:tasks.workunit.client.0.smithi008.stdout:6/452: creat df/d15/d27/fa3 x:0 0 0 2023-10-18T20:58:31.047 INFO:tasks.workunit.client.1.smithi060.stdout:3/408: mkdir d0/d22/d26/d8c 0 2023-10-18T20:58:31.048 INFO:tasks.workunit.client.0.smithi008.stdout:3/355: dwrite d0/d3/f5 [0,4194304] 0 2023-10-18T20:58:31.049 INFO:tasks.workunit.client.1.smithi060.stdout:2/438: mkdir d0/d16/d85 0 2023-10-18T20:58:31.056 INFO:tasks.workunit.client.0.smithi008.stdout:6/453: dread df/d15/d48/d4b/f4f [0,4194304] 0 2023-10-18T20:58:31.056 INFO:tasks.workunit.client.0.smithi008.stdout:6/454: fsync df/d18/d68/f6e 0 2023-10-18T20:58:31.057 INFO:tasks.workunit.client.0.smithi008.stdout:6/455: fsync df/d15/d27/d38/f5a 0 2023-10-18T20:58:31.057 INFO:tasks.workunit.client.0.smithi008.stdout:6/456: chown df/d13/d53/d64/c89 97472 1 2023-10-18T20:58:31.057 INFO:tasks.workunit.client.0.smithi008.stdout:6/457: write df/d74/f75 [4220730,15947] 0 2023-10-18T20:58:31.057 INFO:tasks.workunit.client.0.smithi008.stdout:6/458: write df/d15/d27/d38/f5a [746988,13829] 0 2023-10-18T20:58:31.057 INFO:tasks.workunit.client.0.smithi008.stdout:6/459: dread - df/d13/f8f zero size 2023-10-18T20:58:31.058 INFO:tasks.workunit.client.0.smithi008.stdout:6/460: getdents df/d15/d27/d4c 0 2023-10-18T20:58:31.082 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.079580+0000 mon.smithi008 (mon.0) 621 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd='[{"prefix": "mgr fail", "who": "smithi060.pgqqwa"}]': finished 2023-10-18T20:58:31.082 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:30.079667+0000 mon.smithi008 (mon.0) 622 : cluster [DBG] mgrmap e25: smithi008.flmjzp(active, starting, since 0.994745s), standbys: smithi060.pgqqwa 2023-10-18T20:58:31.082 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.089325+0000 mon.smithi008 (mon.0) 623 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:58:31.083 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.096752+0000 mon.smithi008 (mon.0) 624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:58:31.083 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.096959+0000 mon.smithi008 (mon.0) 625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T20:58:31.083 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.097290+0000 mon.smithi008 (mon.0) 626 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T20:58:31.083 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.097691+0000 mon.smithi008 (mon.0) 627 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T20:58:31.083 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.097943+0000 mon.smithi008 (mon.0) 628 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T20:58:31.084 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.107160+0000 mon.smithi008 (mon.0) 629 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr metadata", "who": "smithi008.flmjzp", "id": "smithi008.flmjzp"}]: dispatch 2023-10-18T20:58:31.084 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.107999+0000 mon.smithi008 (mon.0) 630 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr metadata", "who": "smithi060.pgqqwa", "id": "smithi060.pgqqwa"}]: dispatch 2023-10-18T20:58:31.084 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.115117+0000 mon.smithi008 (mon.0) 631 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-10-18T20:58:31.084 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:30.115571+0000 mon.smithi008 (mon.0) 632 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-10-18T20:58:31.110 INFO:tasks.workunit.client.0.smithi008.stdout:9/381: dwrite d2/f1b [0,4194304] 0 2023-10-18T20:58:31.121 INFO:tasks.workunit.client.1.smithi060.stdout:5/466: rename d0/d6/d8/df/d27/d32/d6d/d72 to d0/d6/d9/d82/d84/db2 0 2023-10-18T20:58:31.121 INFO:tasks.workunit.client.0.smithi008.stdout:5/427: dread d0/d2/d19/d7c/d42/d5a/f69 [0,4194304] 0 2023-10-18T20:58:31.133 INFO:tasks.workunit.client.1.smithi060.stdout:1/541: rename d4/d6/d7/d2f/d7b/c24 to d4/d6/d33/da9/cb0 0 2023-10-18T20:58:31.134 INFO:tasks.workunit.client.0.smithi008.stdout:7/475: dwrite d1/d3/f65 [0,4194304] 0 2023-10-18T20:58:31.134 INFO:tasks.workunit.client.0.smithi008.stdout:7/476: creat d1/d36/d3d/d3e/d59/f9b x:0 0 0 2023-10-18T20:58:31.134 INFO:tasks.workunit.client.0.smithi008.stdout:7/477: chown d1/d36/d3d/d3e/d59 20305 1 2023-10-18T20:58:31.134 INFO:tasks.workunit.client.0.smithi008.stdout:7/478: fsync d1/d3/d20/d5f/f72 0 2023-10-18T20:58:31.135 INFO:tasks.workunit.client.0.smithi008.stdout:7/479: fsync d1/d36/d3b/f77 0 2023-10-18T20:58:31.135 INFO:tasks.workunit.client.0.smithi008.stdout:7/480: chown d1/d3/l24 962 1 2023-10-18T20:58:31.135 INFO:tasks.workunit.client.0.smithi008.stdout:7/481: chown d1/d3/d8b/l95 4 1 2023-10-18T20:58:31.139 INFO:tasks.workunit.client.1.smithi060.stdout:4/396: dwrite d4/dc/d2a/d13/d27/f67 [0,4194304] 0 2023-10-18T20:58:31.139 INFO:tasks.workunit.client.1.smithi060.stdout:4/397: dread - d4/dc/d2a/d13/d27/d68/f6b zero size 2023-10-18T20:58:31.143 INFO:tasks.workunit.client.0.smithi008.stdout:3/356: dwrite d0/d3/f29 [4194304,4194304] 0 2023-10-18T20:58:31.143 INFO:tasks.workunit.client.0.smithi008.stdout:9/382: write d2/dc/f22 [1047144,36593] 0 2023-10-18T20:58:31.143 INFO:tasks.workunit.client.0.smithi008.stdout:5/428: dread d0/d2/f23 [0,4194304] 0 2023-10-18T20:58:31.146 INFO:tasks.workunit.client.0.smithi008.stdout:6/461: dwrite df/d18/d3f/f8e [0,4194304] 0 2023-10-18T20:58:31.146 INFO:tasks.workunit.client.0.smithi008.stdout:6/462: readlink df/d3c/d77/d50/l65 0 2023-10-18T20:58:31.147 INFO:tasks.workunit.client.1.smithi060.stdout:5/467: dread d0/d6/d9/d82/d84/db2/f85 [0,4194304] 0 2023-10-18T20:58:31.148 INFO:tasks.workunit.client.1.smithi060.stdout:5/468: read d0/da/d3b/f4c [84521,122624] 0 2023-10-18T20:58:31.151 INFO:tasks.workunit.client.1.smithi060.stdout:1/542: dread d4/d38/f7f [0,4194304] 0 2023-10-18T20:58:31.152 INFO:tasks.workunit.client.1.smithi060.stdout:1/543: truncate d4/d6/f65 843817 0 2023-10-18T20:58:31.160 INFO:tasks.workunit.client.1.smithi060.stdout:5/469: dread d0/f8a [0,4194304] 0 2023-10-18T20:58:31.161 INFO:tasks.workunit.client.1.smithi060.stdout:5/470: chown d0/d6/d8/df/d27/d32/d6d 1 1 2023-10-18T20:58:31.173 INFO:tasks.workunit.client.0.smithi008.stdout:2/435: sync 2023-10-18T20:58:31.179 INFO:tasks.workunit.client.1.smithi060.stdout:8/432: rename d4/d9/d31/d6f/l78 to d4/d9/d31/d35/l87 0 2023-10-18T20:58:31.182 INFO:tasks.workunit.client.0.smithi008.stdout:7/482: rename d1/d3/l24 to d1/d36/d3b/d79/l9c 0 2023-10-18T20:58:31.187 INFO:tasks.workunit.client.0.smithi008.stdout:9/383: read d2/dc/d17/f2e [2932577,32045] 0 2023-10-18T20:58:31.187 INFO:tasks.workunit.client.0.smithi008.stdout:2/436: dread d1/d3/f1b [0,4194304] 0 2023-10-18T20:58:31.188 INFO:tasks.workunit.client.1.smithi060.stdout:4/398: mknod d4/d15/c77 0 2023-10-18T20:58:31.188 INFO:tasks.workunit.client.1.smithi060.stdout:4/399: readlink d4/d15/d2b/l66 0 2023-10-18T20:58:31.196 INFO:tasks.workunit.client.0.smithi008.stdout:6/463: mknod df/d18/d3f/ca4 0 2023-10-18T20:58:31.200 INFO:tasks.workunit.client.0.smithi008.stdout:9/384: creat d2/d64/f69 x:0 0 0 2023-10-18T20:58:31.202 INFO:tasks.workunit.client.0.smithi008.stdout:5/429: rmdir d0/d2/d9/d34 39 2023-10-18T20:58:31.204 INFO:tasks.workunit.client.1.smithi060.stdout:7/482: rename de/d14/d2f/d3f/d5a/f7f to de/d14/f97 0 2023-10-18T20:58:31.205 INFO:tasks.workunit.client.0.smithi008.stdout:7/483: write d1/d3/d20/f47 [2669117,116486] 0 2023-10-18T20:58:31.206 INFO:tasks.workunit.client.0.smithi008.stdout:7/484: chown d1/d36/d3b/d79 130484357 1 2023-10-18T20:58:31.206 INFO:tasks.workunit.client.0.smithi008.stdout:6/464: symlink df/d36/la5 0 2023-10-18T20:58:31.206 INFO:tasks.workunit.client.0.smithi008.stdout:6/465: write df/d18/d3f/f93 [203226,101887] 0 2023-10-18T20:58:31.207 INFO:tasks.workunit.client.0.smithi008.stdout:6/466: chown df/d19 9817894 1 2023-10-18T20:58:31.207 INFO:tasks.workunit.client.1.smithi060.stdout:1/544: getdents d4/d6/d7/d35 0 2023-10-18T20:58:31.207 INFO:tasks.workunit.client.1.smithi060.stdout:1/545: fdatasync d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f8e 0 2023-10-18T20:58:31.209 INFO:tasks.workunit.client.0.smithi008.stdout:9/385: rename d2/dc/d17/d19/la to d2/dc/d40/d46/l6a 0 2023-10-18T20:58:31.211 INFO:tasks.workunit.client.1.smithi060.stdout:3/409: rename d0/d22/d26/c4b to d0/d3c/c8d 0 2023-10-18T20:58:31.214 INFO:tasks.workunit.client.0.smithi008.stdout:5/430: creat d0/d2/d19/d7c/d58/d65/f99 x:0 0 0 2023-10-18T20:58:31.214 INFO:tasks.workunit.client.0.smithi008.stdout:5/431: truncate d0/f8 2101939 0 2023-10-18T20:58:31.214 INFO:tasks.workunit.client.0.smithi008.stdout:5/432: dread - d0/d2/d19/f81 zero size 2023-10-18T20:58:31.214 INFO:tasks.workunit.client.0.smithi008.stdout:5/433: write d0/d2/d19/f33 [1754014,6076] 0 2023-10-18T20:58:31.215 INFO:tasks.workunit.client.1.smithi060.stdout:7/483: truncate de/d29/d72/f90 4283152 0 2023-10-18T20:58:31.215 INFO:tasks.workunit.client.1.smithi060.stdout:4/400: read d4/dc/d2a/d13/f3f [3507644,52203] 0 2023-10-18T20:58:31.217 INFO:tasks.workunit.client.0.smithi008.stdout:3/357: dwrite d0/d3/de/d13/f46 [8388608,4194304] 0 2023-10-18T20:58:31.217 INFO:tasks.workunit.client.0.smithi008.stdout:3/358: stat d0/d3/de/d13 0 2023-10-18T20:58:31.218 INFO:tasks.workunit.client.1.smithi060.stdout:1/546: creat d4/d6/d7/d2f/d7b/d2a/d32/fb1 x:0 0 0 2023-10-18T20:58:31.225 INFO:tasks.workunit.client.1.smithi060.stdout:2/439: rename d0/d43/c83 to d0/d16/c86 0 2023-10-18T20:58:31.225 INFO:tasks.workunit.client.1.smithi060.stdout:2/440: dread - d0/d3/d27/d4d/f5b zero size 2023-10-18T20:58:31.225 INFO:tasks.workunit.client.1.smithi060.stdout:2/441: chown d0/d16/c86 1 1 2023-10-18T20:58:31.227 INFO:tasks.workunit.client.0.smithi008.stdout:5/434: mkdir d0/d2/d19/d7c/d31/d3f/d9a 0 2023-10-18T20:58:31.228 INFO:tasks.workunit.client.1.smithi060.stdout:8/433: dwrite d4/d9/f79 [4194304,4194304] 0 2023-10-18T20:58:31.228 INFO:tasks.workunit.client.0.smithi008.stdout:7/485: mknod d1/d36/d3d/c9d 0 2023-10-18T20:58:31.229 INFO:tasks.workunit.client.1.smithi060.stdout:7/484: link de/c47 de/d14/d49/d68/d88/c98 0 2023-10-18T20:58:31.229 INFO:tasks.workunit.client.1.smithi060.stdout:0/457: sync 2023-10-18T20:58:31.230 INFO:tasks.workunit.client.1.smithi060.stdout:8/434: read d4/d9/d37/f56 [549892,108192] 0 2023-10-18T20:58:31.230 INFO:tasks.workunit.client.1.smithi060.stdout:8/435: write d4/d9/d4f/f86 [968149,30811] 0 2023-10-18T20:58:31.234 INFO:tasks.workunit.client.1.smithi060.stdout:4/401: mknod d4/dc/d2a/d39/c78 0 2023-10-18T20:58:31.234 INFO:tasks.workunit.client.1.smithi060.stdout:4/402: dread - d4/f6a zero size 2023-10-18T20:58:31.235 INFO:tasks.workunit.client.1.smithi060.stdout:4/403: write d4/dc/d2a/f54 [831694,37952] 0 2023-10-18T20:58:31.236 INFO:tasks.workunit.client.1.smithi060.stdout:1/547: mknod d4/d6/d7/d2f/d7b/cb2 0 2023-10-18T20:58:31.238 INFO:tasks.workunit.client.0.smithi008.stdout:6/467: write df/d15/f16 [367818,102486] 0 2023-10-18T20:58:31.240 INFO:tasks.workunit.client.1.smithi060.stdout:3/410: rename d0/d3c/d3d/f57 to d0/d3c/d3d/d4d/f8e 0 2023-10-18T20:58:31.243 INFO:tasks.workunit.client.0.smithi008.stdout:3/359: symlink d0/d4a/l6d 0 2023-10-18T20:58:31.243 INFO:tasks.workunit.client.0.smithi008.stdout:3/360: stat d0/d4a/d64/f6a 0 2023-10-18T20:58:31.245 INFO:tasks.workunit.client.1.smithi060.stdout:1/548: dread d4/d6/f65 [0,4194304] 0 2023-10-18T20:58:31.245 INFO:tasks.workunit.client.1.smithi060.stdout:7/485: mknod de/d29/c99 0 2023-10-18T20:58:31.246 INFO:tasks.workunit.client.0.smithi008.stdout:5/435: rename d0/d2/d19/d7c/d41 to d0/d2/d9/d9b 0 2023-10-18T20:58:31.247 INFO:tasks.workunit.client.0.smithi008.stdout:5/436: write d0/d2/d19/d7c/d42/f52 [5235129,69582] 0 2023-10-18T20:58:31.256 INFO:tasks.workunit.client.1.smithi060.stdout:0/458: symlink d3/d8/d14/d55/d74/d76/d68/d7f/l94 0 2023-10-18T20:58:31.257 INFO:tasks.workunit.client.1.smithi060.stdout:8/436: mkdir d4/d9/d88 0 2023-10-18T20:58:31.257 INFO:tasks.workunit.client.1.smithi060.stdout:4/404: dread d4/dc/d2a/d13/d33/f52 [0,4194304] 0 2023-10-18T20:58:31.264 INFO:tasks.workunit.client.0.smithi008.stdout:2/437: dwrite d1/d3/dd/d25/d76/f8d [0,4194304] 0 2023-10-18T20:58:31.268 INFO:tasks.workunit.client.0.smithi008.stdout:8/535: sync 2023-10-18T20:58:31.277 INFO:tasks.workunit.client.1.smithi060.stdout:3/411: dread d0/d3c/f40 [0,4194304] 0 2023-10-18T20:58:31.281 INFO:tasks.workunit.client.0.smithi008.stdout:5/437: symlink d0/de/l9c 0 2023-10-18T20:58:31.283 INFO:tasks.workunit.client.1.smithi060.stdout:7/486: rename de/d14/d49/l6b to de/d14/l9a 0 2023-10-18T20:58:31.283 INFO:tasks.workunit.client.1.smithi060.stdout:7/487: truncate de/d14/d2f/d8f/d5b/f95 1030679 0 2023-10-18T20:58:31.287 INFO:tasks.workunit.client.1.smithi060.stdout:8/437: creat d4/d9/d37/d4e/d5e/f89 x:0 0 0 2023-10-18T20:58:31.289 INFO:tasks.workunit.client.1.smithi060.stdout:3/412: chown d0/fd 995 1 2023-10-18T20:58:31.290 INFO:tasks.workunit.client.1.smithi060.stdout:3/413: write d0/d3c/d3d/d4d/f8e [1046180,121991] 0 2023-10-18T20:58:31.290 INFO:tasks.workunit.client.1.smithi060.stdout:3/414: stat d0/d22/d26/d79/c84 0 2023-10-18T20:58:31.291 INFO:tasks.workunit.client.0.smithi008.stdout:6/468: rmdir df/d15/d27/d38 39 2023-10-18T20:58:31.291 INFO:tasks.workunit.client.0.smithi008.stdout:3/361: getdents d0/d4a/d64 0 2023-10-18T20:58:31.294 INFO:tasks.workunit.client.1.smithi060.stdout:1/549: rmdir d4/d6/d7/df 39 2023-10-18T20:58:31.294 INFO:tasks.workunit.client.1.smithi060.stdout:1/550: fdatasync d4/d6/d7/d2f/d7b/d2a/d32/dd/f5c 0 2023-10-18T20:58:31.296 INFO:tasks.workunit.client.1.smithi060.stdout:2/442: dwrite d0/f12 [0,4194304] 0 2023-10-18T20:58:31.296 INFO:tasks.workunit.client.1.smithi060.stdout:2/443: chown d0/d8/f30 454141777 1 2023-10-18T20:58:31.296 INFO:tasks.workunit.client.1.smithi060.stdout:7/488: truncate de/d29/d72/f85 1135320 0 2023-10-18T20:58:31.297 INFO:tasks.workunit.client.1.smithi060.stdout:7/489: write de/d38/f70 [453797,57985] 0 2023-10-18T20:58:31.297 INFO:tasks.workunit.client.0.smithi008.stdout:6/469: getdents df/d36 0 2023-10-18T20:58:31.298 INFO:tasks.workunit.client.0.smithi008.stdout:7/486: dwrite d1/d36/d3b/d79/f4a [0,4194304] 0 2023-10-18T20:58:31.298 INFO:tasks.workunit.client.0.smithi008.stdout:7/487: fsync d1/d3/d8b/f93 0 2023-10-18T20:58:31.298 INFO:tasks.workunit.client.0.smithi008.stdout:7/488: chown d1/d3/d20/d54/c64 43652746 1 2023-10-18T20:58:31.299 INFO:tasks.workunit.client.0.smithi008.stdout:7/489: stat d1/d3/d20/d54/c8f 0 2023-10-18T20:58:31.299 INFO:tasks.workunit.client.1.smithi060.stdout:8/438: creat d4/d9/d37/f8a x:0 0 0 2023-10-18T20:58:31.302 INFO:tasks.workunit.client.0.smithi008.stdout:5/438: read d0/d2/d9/d9b/f5e [4110848,69131] 0 2023-10-18T20:58:31.302 INFO:tasks.workunit.client.0.smithi008.stdout:3/362: rmdir d0/d3/de 39 2023-10-18T20:58:31.303 INFO:tasks.workunit.client.0.smithi008.stdout:2/438: dread d1/d3/dd/f6b [0,4194304] 0 2023-10-18T20:58:31.303 INFO:tasks.workunit.client.0.smithi008.stdout:9/386: dwrite d2/dc/d1a/d1d/f50 [4194304,4194304] 0 2023-10-18T20:58:31.304 INFO:tasks.workunit.client.0.smithi008.stdout:6/470: symlink df/d3c/da2/la6 0 2023-10-18T20:58:31.308 INFO:tasks.workunit.client.1.smithi060.stdout:3/415: symlink d0/d3c/l8f 0 2023-10-18T20:58:31.309 INFO:tasks.workunit.client.0.smithi008.stdout:7/490: symlink d1/d36/d3b/d4f/d87/l9e 0 2023-10-18T20:58:31.309 INFO:tasks.workunit.client.0.smithi008.stdout:7/491: chown d1/d3/d20/d5f/f72 292794381 1 2023-10-18T20:58:31.309 INFO:tasks.workunit.client.1.smithi060.stdout:1/551: link d4/d6/d7/d2f/f70 d4/d6/d48/da7/fb3 0 2023-10-18T20:58:31.309 INFO:tasks.workunit.client.1.smithi060.stdout:1/552: chown d4/d6/d33 1 1 2023-10-18T20:58:31.310 INFO:tasks.workunit.client.1.smithi060.stdout:1/553: creat d4/d6/fb4 x:0 0 0 2023-10-18T20:58:31.311 INFO:tasks.workunit.client.0.smithi008.stdout:3/363: rename d0/d3/de/f20 to d0/d4a/d64/f6e 0 2023-10-18T20:58:31.312 INFO:tasks.workunit.client.0.smithi008.stdout:2/439: getdents d1/d3/dd/d25/d4d 0 2023-10-18T20:58:31.313 INFO:tasks.workunit.client.0.smithi008.stdout:2/440: write d1/d3/dd/d1c/f55 [354824,104225] 0 2023-10-18T20:58:31.313 INFO:tasks.workunit.client.0.smithi008.stdout:2/441: stat d1/d3/dd/d25/d34/f81 0 2023-10-18T20:58:31.314 INFO:tasks.workunit.client.0.smithi008.stdout:7/492: link d1/d36/d3d/l63 d1/d36/d3d/d3e/d59/l9f 0 2023-10-18T20:58:31.317 INFO:tasks.workunit.client.0.smithi008.stdout:2/442: mknod d1/d3/dd/d1c/d3a/c92 0 2023-10-18T20:58:31.320 INFO:tasks.workunit.client.0.smithi008.stdout:2/443: symlink d1/d3/dd/d1c/d3a/d45/l93 0 2023-10-18T20:58:31.321 INFO:tasks.workunit.client.1.smithi060.stdout:3/416: truncate d0/d22/f52 1591390 0 2023-10-18T20:58:31.321 INFO:tasks.workunit.client.1.smithi060.stdout:3/417: chown d0/d22/d26/d29/c66 331302242 1 2023-10-18T20:58:31.322 INFO:tasks.workunit.client.1.smithi060.stdout:1/554: symlink d4/d6/d7/d2f/d7b/d2a/d32/lb5 0 2023-10-18T20:58:31.322 INFO:tasks.workunit.client.1.smithi060.stdout:2/444: getdents d0/d43 0 2023-10-18T20:58:31.323 INFO:tasks.workunit.client.1.smithi060.stdout:0/459: dwrite d3/d8/d14/d55/d74/d76/f8a [0,4194304] 0 2023-10-18T20:58:31.324 INFO:tasks.workunit.client.1.smithi060.stdout:1/555: truncate d4/da/f5b 1689728 0 2023-10-18T20:58:31.326 INFO:tasks.workunit.client.0.smithi008.stdout:2/444: mknod d1/d3/d40/d6e/d7e/c94 0 2023-10-18T20:58:31.326 INFO:tasks.workunit.client.0.smithi008.stdout:2/445: dread - d1/d3/dd/f65 zero size 2023-10-18T20:58:31.326 INFO:tasks.workunit.client.0.smithi008.stdout:2/446: stat d1/d3/dd/d1c/d3a/d45/d83/l8a 0 2023-10-18T20:58:31.330 INFO:tasks.workunit.client.0.smithi008.stdout:2/447: mknod d1/d3/dd/d25/d76/d59/c95 0 2023-10-18T20:58:31.330 INFO:tasks.workunit.client.0.smithi008.stdout:7/493: dread d1/d36/d3b/f6f [0,4194304] 0 2023-10-18T20:58:31.331 INFO:tasks.workunit.client.1.smithi060.stdout:2/445: mkdir d0/d8/d87 0 2023-10-18T20:58:31.331 INFO:tasks.workunit.client.1.smithi060.stdout:0/460: mknod d3/d8/d14/d55/d74/d76/d68/d7f/c95 0 2023-10-18T20:58:31.333 INFO:tasks.workunit.client.0.smithi008.stdout:2/448: chown d1/d3/dd/c13 3 1 2023-10-18T20:58:31.335 INFO:tasks.workunit.client.1.smithi060.stdout:1/556: symlink d4/da/lb6 0 2023-10-18T20:58:31.335 INFO:tasks.workunit.client.1.smithi060.stdout:2/446: symlink d0/d8/d87/l88 0 2023-10-18T20:58:31.336 INFO:tasks.workunit.client.1.smithi060.stdout:2/447: stat d0/d45/d49/d6e/d79 0 2023-10-18T20:58:31.338 INFO:tasks.workunit.client.0.smithi008.stdout:7/494: read d1/d3/d20/f2f [36314,62589] 0 2023-10-18T20:58:31.339 INFO:tasks.workunit.client.0.smithi008.stdout:7/495: truncate d1/d36/d3d/d3e/d59/d73/d7b/f80 917742 0 2023-10-18T20:58:31.340 INFO:tasks.workunit.client.1.smithi060.stdout:4/405: dwrite d4/dc/d2a/d13/d27/d68/f6d [0,4194304] 0 2023-10-18T20:58:31.341 INFO:tasks.workunit.client.0.smithi008.stdout:5/439: dread d0/d2/d9/f24 [0,4194304] 0 2023-10-18T20:58:31.341 INFO:tasks.workunit.client.1.smithi060.stdout:4/406: write d4/dc/d2a/d13/d27/d68/f6b [559924,123728] 0 2023-10-18T20:58:31.342 INFO:tasks.workunit.client.1.smithi060.stdout:4/407: chown d4/dc/d2a/d13/f1b 197 1 2023-10-18T20:58:31.342 INFO:tasks.workunit.client.1.smithi060.stdout:1/557: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/d5f/fb7 x:0 0 0 2023-10-18T20:58:31.350 INFO:tasks.workunit.client.1.smithi060.stdout:2/448: link d0/d8/f70 d0/d3/f89 0 2023-10-18T20:58:31.354 INFO:tasks.workunit.client.0.smithi008.stdout:5/440: mknod d0/d2/d19/d7c/d31/d3f/d9a/c9d 0 2023-10-18T20:58:31.354 INFO:tasks.workunit.client.0.smithi008.stdout:5/441: write d0/d2/d19/d7c/f6b [4880637,119321] 0 2023-10-18T20:58:31.355 INFO:tasks.workunit.client.1.smithi060.stdout:0/461: symlink d3/d8/d3c/l96 0 2023-10-18T20:58:31.356 INFO:tasks.workunit.client.0.smithi008.stdout:3/364: write d0/d3/de/d13/f46 [7645858,81626] 0 2023-10-18T20:58:31.357 INFO:tasks.workunit.client.0.smithi008.stdout:8/536: dwrite d5/d8/df/d9d/d4d/db5/f64 [0,4194304] 0 2023-10-18T20:58:31.364 INFO:tasks.workunit.client.0.smithi008.stdout:4/401: sync 2023-10-18T20:58:31.367 INFO:tasks.workunit.client.0.smithi008.stdout:1/528: sync 2023-10-18T20:58:31.368 INFO:tasks.workunit.client.0.smithi008.stdout:0/360: sync 2023-10-18T20:58:31.374 INFO:tasks.workunit.client.1.smithi060.stdout:6/451: sync 2023-10-18T20:58:31.374 INFO:tasks.workunit.client.1.smithi060.stdout:6/452: fdatasync d10/f4d 0 2023-10-18T20:58:31.374 INFO:tasks.workunit.client.1.smithi060.stdout:6/453: read - d10/d17/d2f/f8a zero size 2023-10-18T20:58:31.374 INFO:tasks.workunit.client.1.smithi060.stdout:5/471: sync 2023-10-18T20:58:31.377 INFO:tasks.workunit.client.0.smithi008.stdout:2/449: dread d1/d3/d40/d6e/f77 [0,4194304] 0 2023-10-18T20:58:31.377 INFO:tasks.workunit.client.0.smithi008.stdout:7/496: rmdir d1/d3 39 2023-10-18T20:58:31.378 INFO:tasks.workunit.client.1.smithi060.stdout:3/418: dwrite d0/d22/d26/d29/f3a [4194304,4194304] 0 2023-10-18T20:58:31.383 INFO:tasks.workunit.client.1.smithi060.stdout:8/439: dwrite d4/d9/f1b [0,4194304] 0 2023-10-18T20:58:31.383 INFO:tasks.workunit.client.1.smithi060.stdout:8/440: fdatasync d4/d9/f23 0 2023-10-18T20:58:31.383 INFO:tasks.workunit.client.1.smithi060.stdout:9/376: sync 2023-10-18T20:58:31.383 INFO:tasks.workunit.client.1.smithi060.stdout:9/377: creat d3/d10/d1c/d5a/f97 x:0 0 0 2023-10-18T20:58:31.384 INFO:tasks.workunit.client.1.smithi060.stdout:9/378: read - d3/d58/f64 zero size 2023-10-18T20:58:31.384 INFO:tasks.workunit.client.1.smithi060.stdout:4/408: truncate d4/f43 1422697 0 2023-10-18T20:58:31.385 INFO:tasks.workunit.client.1.smithi060.stdout:4/409: dread - d4/dc/f6c zero size 2023-10-18T20:58:31.385 INFO:tasks.workunit.client.1.smithi060.stdout:1/558: creat d4/d6/d7/df/d59/fb8 x:0 0 0 2023-10-18T20:58:31.386 INFO:tasks.workunit.client.1.smithi060.stdout:1/559: chown d4/d6/f1f 346105 1 2023-10-18T20:58:31.386 INFO:tasks.workunit.client.1.smithi060.stdout:1/560: write d4/d6/fb4 [621470,49936] 0 2023-10-18T20:58:31.387 INFO:tasks.workunit.client.0.smithi008.stdout:5/442: rename d0/d2/d19/d7c/d31/d80/d89 to d0/d86/d9e 0 2023-10-18T20:58:31.390 INFO:tasks.workunit.client.1.smithi060.stdout:0/462: link d3/d8/f11 d3/d8/d14/d55/f97 0 2023-10-18T20:58:31.405 INFO:tasks.workunit.client.0.smithi008.stdout:8/537: mkdir d5/d8/df/d9d/d85/db1/dcc 0 2023-10-18T20:58:31.407 INFO:tasks.workunit.client.1.smithi060.stdout:8/441: write d4/d9/f2e [1463400,111194] 0 2023-10-18T20:58:31.407 INFO:tasks.workunit.client.0.smithi008.stdout:1/529: creat d9/de/df/d17/d1e/d9a/f9c x:0 0 0 2023-10-18T20:58:31.407 INFO:tasks.workunit.client.0.smithi008.stdout:1/530: write d9/de/df/d17/d1e/f4c [1140096,17980] 0 2023-10-18T20:58:31.409 INFO:tasks.workunit.client.1.smithi060.stdout:5/472: link d0/d6/d8/df/d27/d32/d6d/c7c d0/d47/d7d/da0/cb3 0 2023-10-18T20:58:31.409 INFO:tasks.workunit.client.1.smithi060.stdout:4/410: mknod d4/dc/c79 0 2023-10-18T20:58:31.410 INFO:tasks.workunit.client.1.smithi060.stdout:4/411: chown d4/ce 0 1 2023-10-18T20:58:31.410 INFO:tasks.workunit.client.1.smithi060.stdout:4/412: truncate d4/dc/d2a/d39/f49 157874 0 2023-10-18T20:58:31.411 INFO:tasks.workunit.client.1.smithi060.stdout:0/463: truncate d3/d8/f2d 317568 0 2023-10-18T20:58:31.413 INFO:tasks.workunit.client.1.smithi060.stdout:6/454: rmdir d10/d17/d70 39 2023-10-18T20:58:31.414 INFO:tasks.workunit.client.0.smithi008.stdout:3/365: rename d0/d5f to d0/d3/d37/d6f 0 2023-10-18T20:58:31.414 INFO:tasks.workunit.client.0.smithi008.stdout:3/366: readlink d0/d3/de/d13/l3f 0 2023-10-18T20:58:31.416 INFO:tasks.workunit.client.0.smithi008.stdout:6/471: dwrite df/d15/d48/d4b/f4f [0,4194304] 0 2023-10-18T20:58:31.417 INFO:tasks.workunit.client.1.smithi060.stdout:1/561: dread d4/d6/d7/d2f/d7b/d2a/d32/dd/f25 [0,4194304] 0 2023-10-18T20:58:31.419 INFO:tasks.workunit.client.1.smithi060.stdout:9/379: getdents d3/d10/d1c/d5a/d5d/d7d 0 2023-10-18T20:58:31.419 INFO:tasks.workunit.client.0.smithi008.stdout:1/531: creat d9/de/df/d17/d55/f9d x:0 0 0 2023-10-18T20:58:31.425 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.079580+0000 mon.smithi008 (mon.0) 621 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd='[{"prefix": "mgr fail", "who": "smithi060.pgqqwa"}]': finished 2023-10-18T20:58:31.426 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:30.079667+0000 mon.smithi008 (mon.0) 622 : cluster [DBG] mgrmap e25: smithi008.flmjzp(active, starting, since 0.994745s), standbys: smithi060.pgqqwa 2023-10-18T20:58:31.426 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.089325+0000 mon.smithi008 (mon.0) 623 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:58:31.426 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.096752+0000 mon.smithi008 (mon.0) 624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:58:31.426 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.096959+0000 mon.smithi008 (mon.0) 625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T20:58:31.426 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.097290+0000 mon.smithi008 (mon.0) 626 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T20:58:31.427 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.097691+0000 mon.smithi008 (mon.0) 627 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T20:58:31.427 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.097943+0000 mon.smithi008 (mon.0) 628 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T20:58:31.427 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.107160+0000 mon.smithi008 (mon.0) 629 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr metadata", "who": "smithi008.flmjzp", "id": "smithi008.flmjzp"}]: dispatch 2023-10-18T20:58:31.427 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.107999+0000 mon.smithi008 (mon.0) 630 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr metadata", "who": "smithi060.pgqqwa", "id": "smithi060.pgqqwa"}]: dispatch 2023-10-18T20:58:31.427 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.115117+0000 mon.smithi008 (mon.0) 631 : audit [INF] from='mgr.14584 ' entity='mgr.smithi060.pgqqwa' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-10-18T20:58:31.428 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:30.115571+0000 mon.smithi008 (mon.0) 632 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-10-18T20:58:31.428 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.116395+0000 mon.smithi008 (mon.0) 633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T20:58:31.428 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.117109+0000 mon.smithi008 (mon.0) 634 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T20:58:31.428 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.117701+0000 mon.smithi008 (mon.0) 635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T20:58:31.429 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.117972+0000 mon.smithi008 (mon.0) 636 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:58:31.429 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.118291+0000 mon.smithi008 (mon.0) 637 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:58:31.429 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.118595+0000 mon.smithi008 (mon.0) 638 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:58:31.429 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.118909+0000 mon.smithi008 (mon.0) 639 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:58:31.429 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.121736+0000 mon.smithi008 (mon.0) 640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:58:31.430 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.124501+0000 mon.smithi008 (mon.0) 641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:58:31.430 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:30.142600+0000 mon.smithi008 (mon.0) 642 : cluster [INF] Manager daemon smithi008.flmjzp is now available 2023-10-18T20:58:31.430 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:30.162194+0000 mgr.smithi008.flmjzp (mgr.14640) 1 : cephadm [INF] inventory: adjusted host smithi060 addr 'smithi060' -> '172.21.15.60' 2023-10-18T20:58:31.430 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.173275+0000 mon.smithi008 (mon.0) 643 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:31.430 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.385856+0000 mon.smithi008 (mon.0) 644 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:31.431 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.396525+0000 mon.smithi008 (mon.0) 645 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:31.431 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.509556+0000 mon.smithi008 (mon.0) 646 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:58:31.431 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:30.538567+0000 mon.smithi008 (mon.0) 647 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:58:31.431 INFO:tasks.workunit.client.0.smithi008.stdout:2/450: getdents d1/d3/dd/d25/d76 0 2023-10-18T20:58:31.432 INFO:tasks.workunit.client.0.smithi008.stdout:3/367: mknod d0/d3/d37/d6f/c70 0 2023-10-18T20:58:31.432 INFO:tasks.workunit.client.1.smithi060.stdout:3/419: read d0/d22/d26/d29/f45 [3879136,2145] 0 2023-10-18T20:58:31.432 INFO:tasks.workunit.client.1.smithi060.stdout:5/473: link d0/d6/d8/df/d27/la7 d0/d6/d9/d82/lb4 0 2023-10-18T20:58:31.433 INFO:tasks.workunit.client.1.smithi060.stdout:5/474: write d0/d6/f1e [2903270,91007] 0 2023-10-18T20:58:31.433 INFO:tasks.workunit.client.1.smithi060.stdout:5/475: chown d0/d6/d8/f6b 1 1 2023-10-18T20:58:31.433 INFO:tasks.workunit.client.1.smithi060.stdout:8/442: dread d4/f30 [0,4194304] 0 2023-10-18T20:58:31.435 INFO:tasks.workunit.client.0.smithi008.stdout:4/402: rename d0/d3/f7b to d0/f8b 0 2023-10-18T20:58:31.437 INFO:tasks.workunit.client.0.smithi008.stdout:0/361: dwrite d0/dd/d29/f39 [0,4194304] 0 2023-10-18T20:58:31.445 INFO:tasks.workunit.client.0.smithi008.stdout:6/472: rename df/d26/la1 to df/d18/la7 0 2023-10-18T20:58:31.446 INFO:tasks.workunit.client.0.smithi008.stdout:6/473: dread - df/d15/d27/d4c/f73 zero size 2023-10-18T20:58:31.446 INFO:tasks.workunit.client.0.smithi008.stdout:6/474: chown df/d18/d58/c94 394871 1 2023-10-18T20:58:31.446 INFO:tasks.workunit.client.0.smithi008.stdout:6/475: chown df/d18/d3f/l71 0 1 2023-10-18T20:58:31.446 INFO:tasks.workunit.client.0.smithi008.stdout:6/476: chown df/l78 14156 1 2023-10-18T20:58:31.446 INFO:tasks.workunit.client.0.smithi008.stdout:6/477: write df/d18/d3f/f7b [1509265,109969] 0 2023-10-18T20:58:31.447 INFO:tasks.workunit.client.1.smithi060.stdout:5/476: mknod d0/d6/d9/d82/d84/db2/cb5 0 2023-10-18T20:58:31.447 INFO:tasks.workunit.client.1.smithi060.stdout:5/477: dread - d0/d6/d9/d82/d84/db2/d41/f75 zero size 2023-10-18T20:58:31.448 INFO:tasks.workunit.client.1.smithi060.stdout:5/478: mkdir d0/d6/d8/df/d27/d32/d6d/db6 0 2023-10-18T20:58:31.448 INFO:tasks.workunit.client.1.smithi060.stdout:8/443: mknod d4/d9/d4f/d74/d81/c8b 0 2023-10-18T20:58:31.454 INFO:tasks.workunit.client.0.smithi008.stdout:6/478: creat df/d15/d48/fa8 x:0 0 0 2023-10-18T20:58:31.457 INFO:tasks.workunit.client.1.smithi060.stdout:2/449: dwrite d0/d8/f2b [8388608,4194304] 0 2023-10-18T20:58:31.457 INFO:tasks.workunit.client.1.smithi060.stdout:5/479: mknod d0/d6/d9/d82/d83/d99/cb7 0 2023-10-18T20:58:31.458 INFO:tasks.workunit.client.0.smithi008.stdout:9/387: dwrite d2/dc/d1a/d61/d59/f66 [0,4194304] 0 2023-10-18T20:58:31.463 INFO:tasks.workunit.client.0.smithi008.stdout:4/403: rename d0/d3/c80 to d0/d3/d21/c8c 0 2023-10-18T20:58:31.463 INFO:tasks.workunit.client.0.smithi008.stdout:4/404: chown d0/d17/d5b 918075247 1 2023-10-18T20:58:31.465 INFO:tasks.workunit.client.0.smithi008.stdout:4/405: read d0/d17/d5b/f65 [508659,34116] 0 2023-10-18T20:58:31.466 INFO:tasks.workunit.client.0.smithi008.stdout:4/406: fsync d0/f13 0 2023-10-18T20:58:31.466 INFO:tasks.workunit.client.0.smithi008.stdout:4/407: write d0/d3/d21/f5a [649762,110304] 0 2023-10-18T20:58:31.466 INFO:tasks.workunit.client.0.smithi008.stdout:4/408: stat d0/cf 0 2023-10-18T20:58:31.466 INFO:tasks.workunit.client.0.smithi008.stdout:4/409: chown d0 5 1 2023-10-18T20:58:31.468 INFO:tasks.workunit.client.1.smithi060.stdout:8/444: creat d4/d9/d31/d6f/f8c x:0 0 0 2023-10-18T20:58:31.468 INFO:tasks.workunit.client.1.smithi060.stdout:8/445: stat d4/d9/d37/d4e/d6e/c85 0 2023-10-18T20:58:31.469 INFO:tasks.workunit.client.1.smithi060.stdout:8/446: stat d4/f13 0 2023-10-18T20:58:31.469 INFO:tasks.workunit.client.1.smithi060.stdout:8/447: fsync d4/d9/d37/f3c 0 2023-10-18T20:58:31.473 INFO:tasks.workunit.client.0.smithi008.stdout:2/451: write d1/d3/d40/f62 [3836739,127676] 0 2023-10-18T20:58:31.479 INFO:tasks.workunit.client.0.smithi008.stdout:6/479: rename df/d15/d27/d38 to df/d3c/d77/da9 0 2023-10-18T20:58:31.480 INFO:tasks.workunit.client.0.smithi008.stdout:6/480: readlink df/d18/d68/l98 0 2023-10-18T20:58:31.483 INFO:tasks.workunit.client.1.smithi060.stdout:2/450: dread d0/d8/f2b [0,4194304] 0 2023-10-18T20:58:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.116395+0000 mon.smithi008 (mon.0) 633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T20:58:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.117109+0000 mon.smithi008 (mon.0) 634 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T20:58:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.117701+0000 mon.smithi008 (mon.0) 635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T20:58:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.117972+0000 mon.smithi008 (mon.0) 636 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:58:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.118291+0000 mon.smithi008 (mon.0) 637 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T20:58:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.118595+0000 mon.smithi008 (mon.0) 638 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T20:58:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.118909+0000 mon.smithi008 (mon.0) 639 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T20:58:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.121736+0000 mon.smithi008 (mon.0) 640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T20:58:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.124501+0000 mon.smithi008 (mon.0) 641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T20:58:31.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:30.142600+0000 mon.smithi008 (mon.0) 642 : cluster [INF] Manager daemon smithi008.flmjzp is now available 2023-10-18T20:58:31.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:30.162194+0000 mgr.smithi008.flmjzp (mgr.14640) 1 : cephadm [INF] inventory: adjusted host smithi060 addr 'smithi060' -> '172.21.15.60' 2023-10-18T20:58:31.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.173275+0000 mon.smithi008 (mon.0) 643 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:31.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.385856+0000 mon.smithi008 (mon.0) 644 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:31.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.396525+0000 mon.smithi008 (mon.0) 645 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:31.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.509556+0000 mon.smithi008 (mon.0) 646 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/mirror_snapshot_schedule"}]: dispatch 2023-10-18T20:58:31.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:30.538567+0000 mon.smithi008 (mon.0) 647 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi008.flmjzp/trash_purge_schedule"}]: dispatch 2023-10-18T20:58:31.491 INFO:tasks.workunit.client.0.smithi008.stdout:4/410: getdents d0/d3/d48/d4c 0 2023-10-18T20:58:31.492 INFO:tasks.workunit.client.0.smithi008.stdout:9/388: dread d2/dc/d40/d46/f51 [0,4194304] 0 2023-10-18T20:58:31.492 INFO:tasks.workunit.client.1.smithi060.stdout:9/380: dread d3/d10/d1c/d2a/d2d/f66 [0,4194304] 0 2023-10-18T20:58:31.495 INFO:tasks.workunit.client.1.smithi060.stdout:8/448: rename d4/d9/d37/c46 to d4/d9/d4f/d74/d81/c8d 0 2023-10-18T20:58:31.495 INFO:tasks.workunit.client.1.smithi060.stdout:8/449: truncate d4/d9/d31/f66 886738 0 2023-10-18T20:58:31.501 INFO:tasks.workunit.client.0.smithi008.stdout:4/411: rmdir d0/d74/d8a 0 2023-10-18T20:58:31.502 INFO:tasks.workunit.client.0.smithi008.stdout:4/412: read d0/d17/d5b/f5f [3557185,87235] 0 2023-10-18T20:58:31.502 INFO:tasks.workunit.client.0.smithi008.stdout:1/532: dwrite d9/f2f [0,4194304] 0 2023-10-18T20:58:31.502 INFO:tasks.workunit.client.0.smithi008.stdout:1/533: creat d9/de/df/d17/d1e/d3c/d90/f9e x:0 0 0 2023-10-18T20:58:31.503 INFO:tasks.workunit.client.1.smithi060.stdout:0/464: dwrite d3/f6c [0,4194304] 0 2023-10-18T20:58:31.503 INFO:tasks.workunit.client.1.smithi060.stdout:2/451: rename d0/d8/f70 to d0/d8/f8a 0 2023-10-18T20:58:31.506 INFO:tasks.workunit.client.0.smithi008.stdout:9/389: symlink d2/dc/d3d/l6b 0 2023-10-18T20:58:31.509 INFO:tasks.workunit.client.1.smithi060.stdout:9/381: symlink d3/d10/d1c/d5a/d5d/l98 0 2023-10-18T20:58:31.509 INFO:tasks.workunit.client.1.smithi060.stdout:9/382: chown d3/d10/d1c/d25/f74 1 1 2023-10-18T20:58:31.524 INFO:tasks.workunit.client.1.smithi060.stdout:6/455: dwrite d10/d17/d2f/d66/f22 [0,4194304] 0 2023-10-18T20:58:31.524 INFO:tasks.workunit.client.1.smithi060.stdout:6/456: chown d10/c1f 11663 1 2023-10-18T20:58:31.524 INFO:tasks.workunit.client.1.smithi060.stdout:6/457: chown d10/d17/d70/f88 152 1 2023-10-18T20:58:31.525 INFO:tasks.workunit.client.0.smithi008.stdout:4/413: mknod d0/d17/d6e/c8d 0 2023-10-18T20:58:31.527 INFO:tasks.workunit.client.1.smithi060.stdout:2/452: truncate d0/d8/d47/f4b 1240977 0 2023-10-18T20:58:31.528 INFO:tasks.workunit.client.1.smithi060.stdout:8/450: rename d4/d9/d37/d4e/f61 to d4/d9/d31/f8e 0 2023-10-18T20:58:31.528 INFO:tasks.workunit.client.0.smithi008.stdout:1/534: link d9/c7b d9/c9f 0 2023-10-18T20:58:31.531 INFO:tasks.workunit.client.0.smithi008.stdout:4/414: rename d0/d3/d48/d4c to d0/d58/d8e 0 2023-10-18T20:58:31.532 INFO:tasks.workunit.client.1.smithi060.stdout:2/453: mknod d0/d8/c8b 0 2023-10-18T20:58:31.534 INFO:tasks.workunit.client.1.smithi060.stdout:3/420: dwrite d0/d22/f69 [0,4194304] 0 2023-10-18T20:58:31.534 INFO:tasks.workunit.client.1.smithi060.stdout:3/421: truncate d0/d22/f70 249070 0 2023-10-18T20:58:31.535 INFO:tasks.workunit.client.1.smithi060.stdout:3/422: chown d0/d3c/d3d/f7a 92868625 1 2023-10-18T20:58:31.535 INFO:tasks.workunit.client.0.smithi008.stdout:1/535: rename d9/de/df/d17/d1e/d3c/d90/c9b to d9/de/df/d17/d1e/d3c/d90/ca0 0 2023-10-18T20:58:31.535 INFO:tasks.workunit.client.0.smithi008.stdout:1/536: write d9/de/df/d17/d55/f9d [517966,7899] 0 2023-10-18T20:58:31.536 INFO:tasks.workunit.client.0.smithi008.stdout:8/538: dwrite d5/d8/df/d9d/d6c/f66 [0,4194304] 0 2023-10-18T20:58:31.537 INFO:tasks.workunit.client.0.smithi008.stdout:8/539: creat d5/d8/df/d9d/d4d/db5/da3/fcd x:0 0 0 2023-10-18T20:58:31.537 INFO:tasks.workunit.client.0.smithi008.stdout:8/540: fdatasync d5/d8/df/d9d/d6c/f7f 0 2023-10-18T20:58:31.537 INFO:tasks.workunit.client.0.smithi008.stdout:8/541: stat d5/d8/f41 0 2023-10-18T20:58:31.538 INFO:tasks.workunit.client.0.smithi008.stdout:8/542: chown d5/d8/df/f19 290682013 1 2023-10-18T20:58:31.538 INFO:tasks.workunit.client.0.smithi008.stdout:8/543: write d5/d8/df/f29 [452122,83982] 0 2023-10-18T20:58:31.538 INFO:tasks.workunit.client.0.smithi008.stdout:8/544: stat d5/d8/df/d9d/d85/db1/fc2 0 2023-10-18T20:58:31.540 INFO:tasks.workunit.client.1.smithi060.stdout:0/465: dread d3/d8/d14/f3e [0,4194304] 0 2023-10-18T20:58:31.540 INFO:tasks.workunit.client.1.smithi060.stdout:8/451: mkdir d4/d9/d8f 0 2023-10-18T20:58:31.543 INFO:tasks.workunit.client.0.smithi008.stdout:7/497: dwrite d1/f6 [4194304,4194304] 0 2023-10-18T20:58:31.543 INFO:tasks.workunit.client.1.smithi060.stdout:2/454: symlink d0/d43/d68/l8c 0 2023-10-18T20:58:31.544 INFO:tasks.workunit.client.1.smithi060.stdout:2/455: fsync d0/f78 0 2023-10-18T20:58:31.544 INFO:tasks.workunit.client.1.smithi060.stdout:2/456: getdents d0/d3/d27/d7b 0 2023-10-18T20:58:31.545 INFO:tasks.workunit.client.0.smithi008.stdout:0/362: dread d0/dd/d19/d24/f44 [0,4194304] 0 2023-10-18T20:58:31.545 INFO:tasks.workunit.client.0.smithi008.stdout:0/363: chown d0/f51 2011907 1 2023-10-18T20:58:31.545 INFO:tasks.workunit.client.0.smithi008.stdout:0/364: creat d0/dd/d29/f7a x:0 0 0 2023-10-18T20:58:31.545 INFO:tasks.workunit.client.0.smithi008.stdout:5/443: dwrite d0/d2/d19/d7c/f95 [0,4194304] 0 2023-10-18T20:58:31.545 INFO:tasks.workunit.client.0.smithi008.stdout:5/444: truncate d0/d2/d19/d7c/d58/d65/f99 109184 0 2023-10-18T20:58:31.550 INFO:tasks.workunit.client.1.smithi060.stdout:4/413: dwrite d4/f10 [4194304,4194304] 0 2023-10-18T20:58:31.550 INFO:tasks.workunit.client.1.smithi060.stdout:6/458: dread d10/d17/d2f/f64 [0,4194304] 0 2023-10-18T20:58:31.550 INFO:tasks.workunit.client.1.smithi060.stdout:6/459: fdatasync d10/d25/f57 0 2023-10-18T20:58:31.552 INFO:tasks.workunit.client.1.smithi060.stdout:3/423: mknod d0/d22/c90 0 2023-10-18T20:58:31.552 INFO:tasks.workunit.client.1.smithi060.stdout:3/424: write d0/d22/f36 [883386,95337] 0 2023-10-18T20:58:31.554 INFO:tasks.workunit.client.0.smithi008.stdout:1/537: mknod d9/de/df/d17/d1e/d3c/d90/d95/ca1 0 2023-10-18T20:58:31.556 INFO:tasks.workunit.client.1.smithi060.stdout:5/480: dwrite d0/d6/d9/d82/d84/db2/f40 [0,4194304] 0 2023-10-18T20:58:31.557 INFO:tasks.workunit.client.1.smithi060.stdout:0/466: unlink d3/c23 0 2023-10-18T20:58:31.557 INFO:tasks.workunit.client.1.smithi060.stdout:0/467: chown d3/d8/f28 2812980 1 2023-10-18T20:58:31.558 INFO:tasks.workunit.client.0.smithi008.stdout:2/452: dwrite d1/d3/dd/d25/d34/f46 [0,4194304] 0 2023-10-18T20:58:31.562 INFO:tasks.workunit.client.0.smithi008.stdout:8/545: mkdir d5/d8/df/dce 0 2023-10-18T20:58:31.567 INFO:tasks.workunit.client.1.smithi060.stdout:8/452: mkdir d4/d9/d88/d90 0 2023-10-18T20:58:31.568 INFO:tasks.workunit.client.1.smithi060.stdout:6/460: mkdir d10/d2e/d75/d77/d8c 0 2023-10-18T20:58:31.569 INFO:tasks.workunit.client.1.smithi060.stdout:9/383: dwrite d3/d10/d1c/d2a/d33/f85 [0,4194304] 0 2023-10-18T20:58:31.569 INFO:tasks.workunit.client.1.smithi060.stdout:4/414: dread d4/dc/f29 [0,4194304] 0 2023-10-18T20:58:31.570 INFO:tasks.workunit.client.1.smithi060.stdout:9/384: write d3/d10/d1c/f6a [978449,126896] 0 2023-10-18T20:58:31.570 INFO:tasks.workunit.client.1.smithi060.stdout:4/415: chown d4/dc/d2a/d39 64171310 1 2023-10-18T20:58:31.570 INFO:tasks.workunit.client.1.smithi060.stdout:9/385: stat d3/d10 0 2023-10-18T20:58:31.571 INFO:tasks.workunit.client.1.smithi060.stdout:2/457: rename d0/d3/d27/d4d/d53/f5c to d0/d8/d87/f8d 0 2023-10-18T20:58:31.582 INFO:tasks.workunit.client.1.smithi060.stdout:7/490: sync 2023-10-18T20:58:31.582 INFO:tasks.workunit.client.1.smithi060.stdout:7/491: truncate de/d14/d2f/d8f/d5b/f75 5118268 0 2023-10-18T20:58:31.595 INFO:tasks.workunit.client.0.smithi008.stdout:8/546: write d5/d8/d24/d50/f5e [506963,61967] 0 2023-10-18T20:58:31.595 INFO:tasks.workunit.client.0.smithi008.stdout:8/547: chown d5/d8/df/d9d/d6c/f46 147821619 1 2023-10-18T20:58:31.597 INFO:tasks.workunit.client.0.smithi008.stdout:0/365: rmdir d0/d3a/d61/d74 0 2023-10-18T20:58:31.599 INFO:tasks.workunit.client.1.smithi060.stdout:3/425: truncate d0/f20 538192 0 2023-10-18T20:58:31.600 INFO:tasks.workunit.client.1.smithi060.stdout:3/426: chown d0/d22/d26/d8c 254880 1 2023-10-18T20:58:31.600 INFO:tasks.workunit.client.1.smithi060.stdout:5/481: mkdir d0/d6/d9/d82/d84/db2/db8 0 2023-10-18T20:58:31.600 INFO:tasks.workunit.client.1.smithi060.stdout:9/386: dread d3/d10/d19/d54/f4a [0,4194304] 0 2023-10-18T20:58:31.603 INFO:tasks.workunit.client.1.smithi060.stdout:6/461: truncate d10/f72 39377 0 2023-10-18T20:58:31.605 INFO:tasks.workunit.client.1.smithi060.stdout:2/458: truncate d0/d3/d27/d4d/d5e/f5f 1697929 0 2023-10-18T20:58:31.606 INFO:tasks.workunit.client.1.smithi060.stdout:8/453: rename d4/d9/d37/d4e/d5e/c73 to d4/d9/d31/c91 0 2023-10-18T20:58:31.610 INFO:tasks.workunit.client.0.smithi008.stdout:1/538: stat d9/de/df/d17/c3a 0 2023-10-18T20:58:31.612 INFO:tasks.workunit.client.0.smithi008.stdout:2/453: creat d1/d3/dd/d1c/f96 x:0 0 0 2023-10-18T20:58:31.615 INFO:tasks.workunit.client.0.smithi008.stdout:4/415: rename d0/d3/d48 to d0/d3/d21/d57/d8f 0 2023-10-18T20:58:31.621 INFO:tasks.workunit.client.0.smithi008.stdout:0/366: link d0/dd/df/d2a/c64 d0/dd/d19/d5f/c7b 0 2023-10-18T20:58:31.623 INFO:tasks.workunit.client.1.smithi060.stdout:7/492: symlink de/d14/d3a/l9b 0 2023-10-18T20:58:31.623 INFO:tasks.workunit.client.1.smithi060.stdout:5/482: rmdir d0/d6/d9/d82/d84/db2 39 2023-10-18T20:58:31.623 INFO:tasks.workunit.client.1.smithi060.stdout:5/483: chown d0/d6/d8/d81/la1 1221200533 1 2023-10-18T20:58:31.626 INFO:tasks.workunit.client.0.smithi008.stdout:7/498: dwrite d1/d3/d20/d5f/d78/f86 [0,4194304] 0 2023-10-18T20:58:31.627 INFO:tasks.workunit.client.0.smithi008.stdout:5/445: truncate d0/d2/d19/d7c/f95 1958252 0 2023-10-18T20:58:31.627 INFO:tasks.workunit.client.0.smithi008.stdout:5/446: chown d0/d2/d19/d7c/d58/d65/f94 1896310 1 2023-10-18T20:58:31.627 INFO:tasks.workunit.client.0.smithi008.stdout:5/447: fsync d0/d2/d19/d7c/d58/d65/f36 0 2023-10-18T20:58:31.632 INFO:tasks.workunit.client.0.smithi008.stdout:1/539: mknod d9/de/ca2 0 2023-10-18T20:58:31.633 INFO:tasks.workunit.client.1.smithi060.stdout:2/459: truncate d0/d45/d49/d6e/d79/d6c/f75 4009556 0 2023-10-18T20:58:31.635 INFO:tasks.workunit.client.1.smithi060.stdout:4/416: dwrite d4/dc/d2a/d31/f46 [0,4194304] 0 2023-10-18T20:58:31.641 INFO:tasks.workunit.client.0.smithi008.stdout:4/416: symlink d0/d58/d83/l90 0 2023-10-18T20:58:31.641 INFO:tasks.workunit.client.0.smithi008.stdout:4/417: fdatasync d0/d58/d8e/f6d 0 2023-10-18T20:58:31.642 INFO:tasks.workunit.client.1.smithi060.stdout:1/562: dwrite f2 [0,4194304] 0 2023-10-18T20:58:31.645 INFO:tasks.workunit.client.1.smithi060.stdout:7/493: mkdir de/d29/d9c 0 2023-10-18T20:58:31.649 INFO:tasks.workunit.client.1.smithi060.stdout:5/484: symlink d0/d6/d8/df/lb9 0 2023-10-18T20:58:31.650 INFO:tasks.workunit.client.1.smithi060.stdout:5/485: truncate d0/da/d3b/f65 4296405 0 2023-10-18T20:58:31.650 INFO:tasks.workunit.client.1.smithi060.stdout:5/486: chown d0/d6/d8/df/d27/d32/d6d/c7c 6 1 2023-10-18T20:58:31.651 INFO:tasks.workunit.client.0.smithi008.stdout:8/548: getdents d5/d8/d24 0 2023-10-18T20:58:31.651 INFO:tasks.workunit.client.0.smithi008.stdout:8/549: creat d5/d8/df/d9d/d85/db1/fcf x:0 0 0 2023-10-18T20:58:31.651 INFO:tasks.workunit.client.0.smithi008.stdout:8/550: dread - d5/d8/d24/d50/f6a zero size 2023-10-18T20:58:31.652 INFO:tasks.workunit.client.0.smithi008.stdout:7/499: getdents d1/d36/d3d 0 2023-10-18T20:58:31.655 INFO:tasks.workunit.client.0.smithi008.stdout:5/448: mknod d0/d2/d19/d7c/d31/d8d/c9f 0 2023-10-18T20:58:31.657 INFO:tasks.workunit.client.0.smithi008.stdout:1/540: read d9/fc [1822690,112758] 0 2023-10-18T20:58:31.658 INFO:tasks.workunit.client.0.smithi008.stdout:1/541: creat d9/de/df/d17/d1e/d3c/fa3 x:0 0 0 2023-10-18T20:58:31.659 INFO:tasks.workunit.client.0.smithi008.stdout:1/542: chown d9/de/df/d17/d25/d57/f87 0 1 2023-10-18T20:58:31.660 INFO:tasks.workunit.client.0.smithi008.stdout:1/543: write d9/de/df/d17/d25/f83 [151305,84745] 0 2023-10-18T20:58:31.660 INFO:tasks.workunit.client.0.smithi008.stdout:1/544: dread - d9/de/df/f8d zero size 2023-10-18T20:58:31.673 INFO:tasks.workunit.client.1.smithi060.stdout:2/460: creat d0/d43/f8e x:0 0 0 2023-10-18T20:58:31.673 INFO:tasks.workunit.client.1.smithi060.stdout:2/461: chown d0/d45/d49/d6e 249417021 1 2023-10-18T20:58:31.674 INFO:tasks.workunit.client.1.smithi060.stdout:4/417: symlink d4/dc/d2a/d1d/l7a 0 2023-10-18T20:58:31.677 INFO:tasks.workunit.client.0.smithi008.stdout:5/449: symlink d0/d2/d19/d7c/d31/d80/la0 0 2023-10-18T20:58:31.689 INFO:tasks.workunit.client.1.smithi060.stdout:9/387: rename d3/d10 to d3/d99 0 2023-10-18T20:58:31.690 INFO:tasks.workunit.client.1.smithi060.stdout:6/462: dwrite d10/d17/d70/f88 [0,4194304] 0 2023-10-18T20:58:31.693 INFO:tasks.workunit.client.1.smithi060.stdout:8/454: dwrite d4/d9/d37/d4e/f59 [0,4194304] 0 2023-10-18T20:58:31.693 INFO:tasks.workunit.client.1.smithi060.stdout:8/455: write d4/d9/d4f/f71 [10465,6008] 0 2023-10-18T20:58:31.693 INFO:tasks.workunit.client.1.smithi060.stdout:3/427: dwrite d0/d3c/f40 [0,4194304] 0 2023-10-18T20:58:31.694 INFO:tasks.workunit.client.1.smithi060.stdout:3/428: chown d0/d3c/d3d/l71 7 1 2023-10-18T20:58:31.694 INFO:tasks.workunit.client.1.smithi060.stdout:3/429: truncate d0/f20 1384592 0 2023-10-18T20:58:31.695 INFO:tasks.workunit.client.1.smithi060.stdout:2/462: dread d0/d3/d27/d4d/d5e/f74 [0,4194304] 0 2023-10-18T20:58:31.695 INFO:tasks.workunit.client.1.smithi060.stdout:2/463: readlink d0/d8/l66 0 2023-10-18T20:58:31.695 INFO:tasks.workunit.client.1.smithi060.stdout:2/464: write d0/f67 [1592143,6766] 0 2023-10-18T20:58:31.698 INFO:tasks.workunit.client.0.smithi008.stdout:0/367: rename d0/dd/d29 to d0/d7c 0 2023-10-18T20:58:31.700 INFO:tasks.workunit.client.1.smithi060.stdout:4/418: rmdir d4/dc/d2a/d31/d70 0 2023-10-18T20:58:31.701 INFO:tasks.workunit.client.0.smithi008.stdout:7/500: dread d1/d3/f14 [0,4194304] 0 2023-10-18T20:58:31.704 INFO:tasks.workunit.client.0.smithi008.stdout:2/454: dwrite d1/d3/f5f [0,4194304] 0 2023-10-18T20:58:31.709 INFO:tasks.workunit.client.1.smithi060.stdout:6/463: creat d10/d25/f8d x:0 0 0 2023-10-18T20:58:31.709 INFO:tasks.workunit.client.1.smithi060.stdout:6/464: fdatasync d10/d17/d28/f24 0 2023-10-18T20:58:31.712 INFO:tasks.workunit.client.1.smithi060.stdout:8/456: truncate d4/d9/d37/f38 333657 0 2023-10-18T20:58:31.712 INFO:tasks.workunit.client.1.smithi060.stdout:8/457: truncate d4/d9/f6b 900759 0 2023-10-18T20:58:31.713 INFO:tasks.workunit.client.1.smithi060.stdout:8/458: creat d4/d9/d4f/f92 x:0 0 0 2023-10-18T20:58:31.715 INFO:tasks.workunit.client.1.smithi060.stdout:7/494: dread de/d14/d3a/f56 [0,4194304] 0 2023-10-18T20:58:31.716 INFO:tasks.workunit.client.1.smithi060.stdout:1/563: dwrite d4/d6/d7/d2f/f6a [0,4194304] 0 2023-10-18T20:58:31.718 INFO:tasks.workunit.client.1.smithi060.stdout:3/430: getdents d0/d3c/d3d/d4d 0 2023-10-18T20:58:31.718 INFO:tasks.workunit.client.1.smithi060.stdout:2/465: creat d0/d16/d85/f8f x:0 0 0 2023-10-18T20:58:31.721 INFO:tasks.workunit.client.0.smithi008.stdout:7/501: write d1/d36/d3d/d3e/f55 [487071,88080] 0 2023-10-18T20:58:31.721 INFO:tasks.workunit.client.0.smithi008.stdout:7/502: write d1/d36/d3b/d4f/f51 [4602403,111892] 0 2023-10-18T20:58:31.722 INFO:tasks.workunit.client.1.smithi060.stdout:6/465: mknod d10/d47/c8e 0 2023-10-18T20:58:31.724 INFO:tasks.workunit.client.1.smithi060.stdout:4/419: mknod d4/dc/d2a/d5b/c7b 0 2023-10-18T20:58:31.727 INFO:tasks.workunit.client.1.smithi060.stdout:1/564: dread d4/da/f53 [0,4194304] 0 2023-10-18T20:58:31.728 INFO:tasks.workunit.client.1.smithi060.stdout:1/565: dread - d4/d6/d7/d2f/d7b/d2a/d32/fb1 zero size 2023-10-18T20:58:31.729 INFO:tasks.workunit.client.1.smithi060.stdout:2/466: write d0/d3/d27/d4d/f54 [305570,20409] 0 2023-10-18T20:58:31.734 INFO:tasks.workunit.client.0.smithi008.stdout:1/545: dwrite d9/de/df/d17/d55/f5c [0,4194304] 0 2023-10-18T20:58:31.734 INFO:tasks.workunit.client.0.smithi008.stdout:1/546: stat d9/de/df/d17/d1e/d9a 0 2023-10-18T20:58:31.738 INFO:tasks.workunit.client.0.smithi008.stdout:8/551: rmdir d5/d8/df 39 2023-10-18T20:58:31.738 INFO:tasks.workunit.client.0.smithi008.stdout:4/418: dwrite d0/d17/d5b/fb [4194304,4194304] 0 2023-10-18T20:58:31.739 INFO:tasks.workunit.client.1.smithi060.stdout:5/487: dwrite d0/da/d79/da5/f9e [0,4194304] 0 2023-10-18T20:58:31.739 INFO:tasks.workunit.client.1.smithi060.stdout:5/488: write d0/f5f [97074,97505] 0 2023-10-18T20:58:31.739 INFO:tasks.workunit.client.1.smithi060.stdout:5/489: fdatasync d0/f8a 0 2023-10-18T20:58:31.740 INFO:tasks.workunit.client.1.smithi060.stdout:7/495: mknod de/d14/d41/c9d 0 2023-10-18T20:58:31.745 INFO:tasks.workunit.client.1.smithi060.stdout:3/431: symlink d0/d22/d26/d8c/l91 0 2023-10-18T20:58:31.746 INFO:tasks.workunit.client.1.smithi060.stdout:6/466: creat d10/d2e/d75/d77/d8c/f8f x:0 0 0 2023-10-18T20:58:31.747 INFO:tasks.workunit.client.0.smithi008.stdout:8/552: write d5/d8/f32 [8715849,113025] 0 2023-10-18T20:58:31.747 INFO:tasks.workunit.client.0.smithi008.stdout:8/553: fdatasync d5/d8/d24/d50/f74 0 2023-10-18T20:58:31.748 INFO:tasks.workunit.client.0.smithi008.stdout:8/554: truncate d5/d8/d24/d50/f6a 690973 0 2023-10-18T20:58:31.752 INFO:tasks.workunit.client.1.smithi060.stdout:9/388: dwrite d3/d99/f67 [0,4194304] 0 2023-10-18T20:58:31.754 INFO:tasks.workunit.client.0.smithi008.stdout:2/455: creat d1/d3/dd/d25/d76/d59/f97 x:0 0 0 2023-10-18T20:58:31.754 INFO:tasks.workunit.client.0.smithi008.stdout:2/456: truncate d1/d3/dd/f71 340092 0 2023-10-18T20:58:31.755 INFO:tasks.workunit.client.0.smithi008.stdout:2/457: write d1/d3/dd/d25/d76/d59/d85/f90 [119944,94588] 0 2023-10-18T20:58:31.761 INFO:tasks.workunit.client.0.smithi008.stdout:7/503: symlink d1/d36/la0 0 2023-10-18T20:58:31.763 INFO:tasks.workunit.client.1.smithi060.stdout:2/467: dread d0/d43/f44 [0,4194304] 0 2023-10-18T20:58:31.766 INFO:tasks.workunit.client.0.smithi008.stdout:0/368: dwrite d0/dd/df/d2a/f33 [0,4194304] 0 2023-10-18T20:58:31.766 INFO:tasks.workunit.client.0.smithi008.stdout:0/369: chown d0/dd/d19/d5f/c78 1740 1 2023-10-18T20:58:31.767 INFO:tasks.workunit.client.1.smithi060.stdout:5/490: rename d0/d6/d8/d60 to d0/d6/d8/df/d27/d32/d6d/dba 0 2023-10-18T20:58:31.767 INFO:tasks.workunit.client.1.smithi060.stdout:5/491: fdatasync d0/d6/d8/df/d27/f4d 0 2023-10-18T20:58:31.768 INFO:tasks.workunit.client.1.smithi060.stdout:5/492: write d0/d6/d8/f44 [1486839,53235] 0 2023-10-18T20:58:31.768 INFO:tasks.workunit.client.1.smithi060.stdout:7/496: mkdir de/d14/d2f/d8f/d5b/d9e 0 2023-10-18T20:58:31.773 INFO:tasks.workunit.client.1.smithi060.stdout:3/432: link d0/f1d d0/d22/d26/d2b/f92 0 2023-10-18T20:58:31.783 INFO:tasks.workunit.client.0.smithi008.stdout:2/458: write d1/d3/f5f [2480663,63722] 0 2023-10-18T20:58:31.787 INFO:tasks.workunit.client.0.smithi008.stdout:5/450: rmdir d0/d2 39 2023-10-18T20:58:31.793 INFO:tasks.workunit.client.0.smithi008.stdout:6/481: sync 2023-10-18T20:58:31.793 INFO:tasks.workunit.client.0.smithi008.stdout:3/368: sync 2023-10-18T20:58:31.793 INFO:tasks.workunit.client.0.smithi008.stdout:3/369: dread - d0/d4a/f66 zero size 2023-10-18T20:58:31.794 INFO:tasks.workunit.client.0.smithi008.stdout:6/482: read df/d36/f62 [380117,5251] 0 2023-10-18T20:58:31.794 INFO:tasks.workunit.client.0.smithi008.stdout:3/370: fdatasync d0/d4a/f5b 0 2023-10-18T20:58:31.794 INFO:tasks.workunit.client.0.smithi008.stdout:9/390: sync 2023-10-18T20:58:31.795 INFO:tasks.workunit.client.0.smithi008.stdout:9/391: stat d2/d4d/f67 0 2023-10-18T20:58:31.795 INFO:tasks.workunit.client.0.smithi008.stdout:8/555: symlink d5/d8/d24/d50/d53/d8c/db4/db7/dbf/ld0 0 2023-10-18T20:58:31.795 INFO:tasks.workunit.client.0.smithi008.stdout:8/556: fsync d5/d8/f12 0 2023-10-18T20:58:31.796 INFO:tasks.workunit.client.1.smithi060.stdout:3/433: write d0/d22/d26/d2b/f80 [725335,55821] 0 2023-10-18T20:58:31.797 INFO:tasks.workunit.client.1.smithi060.stdout:5/493: dread d0/d6/d8/df/d27/d32/d4f/f86 [0,4194304] 0 2023-10-18T20:58:31.797 INFO:tasks.workunit.client.1.smithi060.stdout:5/494: creat d0/da/d61/fbb x:0 0 0 2023-10-18T20:58:31.798 INFO:tasks.workunit.client.1.smithi060.stdout:5/495: chown d0/d6/d8/df/d27/f3c 8576 1 2023-10-18T20:58:31.798 INFO:tasks.workunit.client.0.smithi008.stdout:3/371: write d0/d3/de/d13/d35/f47 [51321,63539] 0 2023-10-18T20:58:31.798 INFO:tasks.workunit.client.0.smithi008.stdout:3/372: dread - d0/d4a/f66 zero size 2023-10-18T20:58:31.799 INFO:tasks.workunit.client.0.smithi008.stdout:7/504: mknod d1/d36/d3b/ca1 0 2023-10-18T20:58:31.799 INFO:tasks.workunit.client.0.smithi008.stdout:7/505: fdatasync d1/d3/d20/d5f/d78/f86 0 2023-10-18T20:58:31.804 INFO:tasks.workunit.client.1.smithi060.stdout:8/459: dwrite d4/d9/d31/f40 [0,4194304] 0 2023-10-18T20:58:31.805 INFO:tasks.workunit.client.1.smithi060.stdout:8/460: dread - d4/d9/d37/d4e/d6e/d7b/f7d zero size 2023-10-18T20:58:31.805 INFO:tasks.workunit.client.1.smithi060.stdout:4/420: dwrite d4/f43 [0,4194304] 0 2023-10-18T20:58:31.809 INFO:tasks.workunit.client.0.smithi008.stdout:2/459: read d1/f18 [4141808,116521] 0 2023-10-18T20:58:31.810 INFO:tasks.workunit.client.1.smithi060.stdout:6/467: symlink d10/d17/d2f/l90 0 2023-10-18T20:58:31.810 INFO:tasks.workunit.client.1.smithi060.stdout:6/468: truncate d10/d17/d2f/d66/f61 2199711 0 2023-10-18T20:58:31.810 INFO:tasks.workunit.client.1.smithi060.stdout:1/566: rmdir d4/d6/d7/d2f/d7b/d2a/d32/dd/d81 39 2023-10-18T20:58:31.811 INFO:tasks.workunit.client.1.smithi060.stdout:9/389: rename d3/d99/d1c/d2a/d2d/f66 to d3/d99/d1c/d5a/d5d/f9a 0 2023-10-18T20:58:31.814 INFO:tasks.workunit.client.0.smithi008.stdout:5/451: link d0/d2/d19/d7c/d31/d3f/f60 d0/d2/d9/d9b/d6f/d75/fa1 0 2023-10-18T20:58:31.814 INFO:tasks.workunit.client.0.smithi008.stdout:9/392: rename d2/dc/d17/d19/c25 to d2/dc/d40/d5a/c6c 0 2023-10-18T20:58:31.814 INFO:tasks.workunit.client.0.smithi008.stdout:8/557: mkdir d5/d8/d24/d50/dd1 0 2023-10-18T20:58:31.815 INFO:tasks.workunit.client.0.smithi008.stdout:8/558: chown d5/d8/df/d9d/d6c/f7f 3348529 1 2023-10-18T20:58:31.815 INFO:tasks.workunit.client.0.smithi008.stdout:8/559: write d5/d8/df/d9d/d6c/f7f [3891300,93955] 0 2023-10-18T20:58:31.815 INFO:tasks.workunit.client.0.smithi008.stdout:8/560: write d5/d8/df/d9d/d85/db1/fc2 [956040,10727] 0 2023-10-18T20:58:31.816 INFO:tasks.workunit.client.0.smithi008.stdout:4/419: dwrite d0/d17/f60 [0,4194304] 0 2023-10-18T20:58:31.816 INFO:tasks.workunit.client.0.smithi008.stdout:7/506: mkdir d1/d3/d20/d5f/d78/da2 0 2023-10-18T20:58:31.816 INFO:tasks.workunit.client.0.smithi008.stdout:7/507: fsync d1/d36/d3b/f50 0 2023-10-18T20:58:31.818 INFO:tasks.workunit.client.1.smithi060.stdout:7/497: mknod de/d14/c9f 0 2023-10-18T20:58:31.819 INFO:tasks.workunit.client.1.smithi060.stdout:5/496: symlink d0/d6/d8/df/d27/lbc 0 2023-10-18T20:58:31.821 INFO:tasks.workunit.client.0.smithi008.stdout:7/508: mkdir d1/d36/d3d/da3 0 2023-10-18T20:58:31.821 INFO:tasks.workunit.client.0.smithi008.stdout:5/452: creat d0/d2/fa2 x:0 0 0 2023-10-18T20:58:31.825 INFO:tasks.workunit.client.0.smithi008.stdout:7/509: read d1/d3/d20/d5f/f72 [1298707,57261] 0 2023-10-18T20:58:31.825 INFO:tasks.workunit.client.0.smithi008.stdout:7/510: fdatasync d1/d36/d3d/f5a 0 2023-10-18T20:58:31.825 INFO:tasks.workunit.client.1.smithi060.stdout:1/567: creat d4/d6/d7/d2f/d7b/fb9 x:0 0 0 2023-10-18T20:58:31.825 INFO:tasks.workunit.client.1.smithi060.stdout:3/434: creat d0/d22/d26/d79/f93 x:0 0 0 2023-10-18T20:58:31.826 INFO:tasks.workunit.client.1.smithi060.stdout:8/461: dread d4/d9/d37/f56 [0,4194304] 0 2023-10-18T20:58:31.827 INFO:tasks.workunit.client.1.smithi060.stdout:8/462: chown d4/d9/d37/c41 23 1 2023-10-18T20:58:31.828 INFO:tasks.workunit.client.1.smithi060.stdout:2/468: rename d0/d3/d27/f46 to d0/d3/d27/d4d/d5e/f90 0 2023-10-18T20:58:31.828 INFO:tasks.workunit.client.1.smithi060.stdout:2/469: fsync d0/f4e 0 2023-10-18T20:58:31.828 INFO:tasks.workunit.client.1.smithi060.stdout:2/470: write d0/d8/f30 [3175233,5435] 0 2023-10-18T20:58:31.833 INFO:tasks.workunit.client.0.smithi008.stdout:7/511: truncate d1/d36/d3d/d3e/f3c 2545533 0 2023-10-18T20:58:31.834 INFO:tasks.workunit.client.0.smithi008.stdout:1/547: dwrite d9/de/df/d17/d55/f78 [0,4194304] 0 2023-10-18T20:58:31.840 INFO:tasks.workunit.client.1.smithi060.stdout:0/468: sync 2023-10-18T20:58:31.846 INFO:tasks.workunit.client.0.smithi008.stdout:4/420: read d0/d17/f23 [2884930,99114] 0 2023-10-18T20:58:31.851 INFO:tasks.workunit.client.1.smithi060.stdout:2/471: creat d0/d45/d49/d6e/f91 x:0 0 0 2023-10-18T20:58:31.852 INFO:tasks.workunit.client.1.smithi060.stdout:1/568: dread d4/d6/d33/d58/f76 [0,4194304] 0 2023-10-18T20:58:31.852 INFO:tasks.workunit.client.1.smithi060.stdout:1/569: read - d4/d6/d7/d2f/d7b/d2a/d32/d56/d5f/fb7 zero size 2023-10-18T20:58:31.870 INFO:tasks.workunit.client.1.smithi060.stdout:7/498: write de/f6f [3462237,25637] 0 2023-10-18T20:58:31.874 INFO:tasks.workunit.client.1.smithi060.stdout:6/469: rename d10/d17/f4b to d10/d47/f91 0 2023-10-18T20:58:31.874 INFO:tasks.workunit.client.1.smithi060.stdout:6/470: chown d10/d17/l6e 129 1 2023-10-18T20:58:31.878 INFO:tasks.workunit.client.1.smithi060.stdout:0/469: mkdir d3/d8/d14/d55/d74/d76/d68/d98 0 2023-10-18T20:58:31.884 INFO:tasks.workunit.client.1.smithi060.stdout:2/472: dread d0/d3/d27/d4d/d5e/f5f [0,4194304] 0 2023-10-18T20:58:31.894 INFO:tasks.workunit.client.1.smithi060.stdout:1/570: rename f2 to d4/d6/d7/d2f/fba 0 2023-10-18T20:58:31.895 INFO:tasks.workunit.client.1.smithi060.stdout:1/571: write d4/da/f5b [2452082,94429] 0 2023-10-18T20:58:31.900 INFO:tasks.workunit.client.1.smithi060.stdout:7/499: rmdir de/d14/d2f/d8f/d5b 39 2023-10-18T20:58:31.901 INFO:tasks.workunit.client.0.smithi008.stdout:3/373: dwrite d0/d3/d42/f68 [0,4194304] 0 2023-10-18T20:58:31.901 INFO:tasks.workunit.client.0.smithi008.stdout:3/374: creat d0/d3/d42/d52/f71 x:0 0 0 2023-10-18T20:58:31.903 INFO:tasks.workunit.client.1.smithi060.stdout:7/500: write de/d14/d2f/f71 [140870,22721] 0 2023-10-18T20:58:31.903 INFO:tasks.workunit.client.1.smithi060.stdout:7/501: chown de/d14/d2f/f71 4 1 2023-10-18T20:58:31.905 INFO:tasks.workunit.client.0.smithi008.stdout:5/453: dwrite d0/d2/f57 [0,4194304] 0 2023-10-18T20:58:31.906 INFO:tasks.workunit.client.1.smithi060.stdout:5/497: dwrite d0/da/d3b/f4c [0,4194304] 0 2023-10-18T20:58:31.907 INFO:tasks.workunit.client.1.smithi060.stdout:5/498: chown d0/d47/d7d/l8b 33919 1 2023-10-18T20:58:31.907 INFO:tasks.workunit.client.0.smithi008.stdout:5/454: write d0/d2/d19/d7c/d58/d65/f94 [5705269,119926] 0 2023-10-18T20:58:31.907 INFO:tasks.workunit.client.0.smithi008.stdout:5/455: truncate d0/d2/d9/d9b/d6f/d75/fa1 28582 0 2023-10-18T20:58:31.908 INFO:tasks.workunit.client.0.smithi008.stdout:9/393: dread d2/dc/d1a/d61/d59/f66 [0,4194304] 0 2023-10-18T20:58:31.908 INFO:tasks.workunit.client.0.smithi008.stdout:9/394: creat d2/dc/f6d x:0 0 0 2023-10-18T20:58:31.913 INFO:tasks.workunit.client.0.smithi008.stdout:2/460: dwrite d1/d3/dd/d1c/f74 [0,4194304] 0 2023-10-18T20:58:31.913 INFO:tasks.workunit.client.0.smithi008.stdout:2/461: readlink d1/d3/dd/l2e 0 2023-10-18T20:58:31.916 INFO:tasks.workunit.client.1.smithi060.stdout:8/463: dwrite d4/f19 [4194304,4194304] 0 2023-10-18T20:58:31.916 INFO:tasks.workunit.client.1.smithi060.stdout:9/390: dread d3/d99/d1c/d5a/d5d/f9a [0,4194304] 0 2023-10-18T20:58:31.917 INFO:tasks.workunit.client.1.smithi060.stdout:1/572: symlink d4/d38/lbb 0 2023-10-18T20:58:31.920 INFO:tasks.workunit.client.0.smithi008.stdout:3/375: link d0/d4a/f5b d0/d4a/d64/f72 0 2023-10-18T20:58:31.921 INFO:tasks.workunit.client.1.smithi060.stdout:4/421: dwrite d4/dc/d2a/d13/d27/f67 [0,4194304] 0 2023-10-18T20:58:31.921 INFO:tasks.workunit.client.1.smithi060.stdout:4/422: write d4/dc/d2a/f54 [1865593,103458] 0 2023-10-18T20:58:31.921 INFO:tasks.workunit.client.1.smithi060.stdout:4/423: creat d4/d15/f7c x:0 0 0 2023-10-18T20:58:31.921 INFO:tasks.workunit.client.1.smithi060.stdout:4/424: readlink d4/dc/d2a/d13/d2f/l50 0 2023-10-18T20:58:31.921 INFO:tasks.workunit.client.1.smithi060.stdout:4/425: fsync d4/dc/d2a/d13/d2f/f34 0 2023-10-18T20:58:31.923 INFO:tasks.workunit.client.1.smithi060.stdout:9/391: dread d3/d99/d1c/d2a/d2d/f63 [0,4194304] 0 2023-10-18T20:58:31.923 INFO:tasks.workunit.client.1.smithi060.stdout:7/502: mkdir de/d14/d2f/d8f/d5b/d9e/da0 0 2023-10-18T20:58:31.926 INFO:tasks.workunit.client.1.smithi060.stdout:9/392: dread - d3/d99/d1c/d5a/d5d/d7d/f7f zero size 2023-10-18T20:58:31.930 INFO:tasks.workunit.client.0.smithi008.stdout:2/462: unlink d1/d3/dd/d25/l53 0 2023-10-18T20:58:31.933 INFO:tasks.workunit.client.1.smithi060.stdout:3/435: dwrite d0/d5e/f67 [0,4194304] 0 2023-10-18T20:58:31.934 INFO:tasks.workunit.client.0.smithi008.stdout:1/548: dwrite d9/de/df/d17/d1e/d7d/f88 [0,4194304] 0 2023-10-18T20:58:31.934 INFO:tasks.workunit.client.0.smithi008.stdout:1/549: creat d9/de/df/d17/d1e/d9a/fa4 x:0 0 0 2023-10-18T20:58:31.940 INFO:tasks.workunit.client.0.smithi008.stdout:2/463: symlink d1/d3/dd/d25/d5c/l98 0 2023-10-18T20:58:31.941 INFO:tasks.workunit.client.1.smithi060.stdout:6/471: rename d10/d17/d2f/d66 to d10/d47/d92 0 2023-10-18T20:58:31.944 INFO:tasks.workunit.client.1.smithi060.stdout:3/436: write d0/f21 [210497,46509] 0 2023-10-18T20:58:31.944 INFO:tasks.workunit.client.1.smithi060.stdout:3/437: truncate d0/d3c/d3d/f32 863502 0 2023-10-18T20:58:31.945 INFO:tasks.workunit.client.0.smithi008.stdout:1/550: mknod d9/de/df/d77/ca5 0 2023-10-18T20:58:31.949 INFO:tasks.workunit.client.1.smithi060.stdout:6/472: read d10/d47/f91 [150287,44830] 0 2023-10-18T20:58:31.949 INFO:tasks.workunit.client.1.smithi060.stdout:6/473: read - d10/d2e/d75/d77/d8c/f8f zero size 2023-10-18T20:58:31.952 INFO:tasks.workunit.client.0.smithi008.stdout:0/370: dwrite d0/dd/df/f4c [0,4194304] 0 2023-10-18T20:58:31.952 INFO:tasks.workunit.client.0.smithi008.stdout:0/371: truncate d0/dd/f15 2964990 0 2023-10-18T20:58:31.952 INFO:tasks.workunit.client.0.smithi008.stdout:0/372: fsync d0/dd/df/d20/f62 0 2023-10-18T20:58:31.953 INFO:tasks.workunit.client.0.smithi008.stdout:4/421: dread d0/d17/d5b/f52 [0,4194304] 0 2023-10-18T20:58:31.953 INFO:tasks.workunit.client.0.smithi008.stdout:6/483: dwrite df/d3c/d77/d50/f66 [0,4194304] 0 2023-10-18T20:58:31.953 INFO:tasks.workunit.client.0.smithi008.stdout:6/484: write df/d13/f8f [3581,66631] 0 2023-10-18T20:58:31.953 INFO:tasks.workunit.client.0.smithi008.stdout:3/376: write d0/f62 [886545,10401] 0 2023-10-18T20:58:31.954 INFO:tasks.workunit.client.0.smithi008.stdout:8/561: dread d5/d8/df/d9d/d6c/f7f [0,4194304] 0 2023-10-18T20:58:31.954 INFO:tasks.workunit.client.0.smithi008.stdout:8/562: dread - d5/d8/df/d9d/d4d/f67 zero size 2023-10-18T20:58:31.955 INFO:tasks.workunit.client.0.smithi008.stdout:8/563: truncate d5/d8/d24/d50/d8d/d95/dc4/fcb 734811 0 2023-10-18T20:58:31.958 INFO:tasks.workunit.client.1.smithi060.stdout:1/573: read d4/d6/d7/d2f/d7b/d2a/d32/dd/f4f [300904,99729] 0 2023-10-18T20:58:31.961 INFO:tasks.workunit.client.0.smithi008.stdout:1/551: rmdir d9/de/df/d17 39 2023-10-18T20:58:31.962 INFO:tasks.workunit.client.0.smithi008.stdout:1/552: write d9/de/df/d17/d1e/f62 [1369656,59461] 0 2023-10-18T20:58:31.962 INFO:tasks.workunit.client.0.smithi008.stdout:2/464: mknod d1/d3/dd/d25/d4d/c99 0 2023-10-18T20:58:31.962 INFO:tasks.workunit.client.0.smithi008.stdout:2/465: chown d1/d3/d40/d6e/f77 81151985 1 2023-10-18T20:58:31.962 INFO:tasks.workunit.client.0.smithi008.stdout:2/466: readlink d1/d3/dd/d1c/d3a/l89 0 2023-10-18T20:58:31.963 INFO:tasks.workunit.client.0.smithi008.stdout:2/467: write d1/d3/f5f [2336975,81618] 0 2023-10-18T20:58:31.963 INFO:tasks.workunit.client.1.smithi060.stdout:2/473: rename d0/d3/f5a to d0/d45/f92 0 2023-10-18T20:58:31.964 INFO:tasks.workunit.client.1.smithi060.stdout:3/438: mknod d0/d5e/c94 0 2023-10-18T20:58:31.966 INFO:tasks.workunit.client.0.smithi008.stdout:4/422: dread d0/f8b [0,4194304] 0 2023-10-18T20:58:31.967 INFO:tasks.workunit.client.1.smithi060.stdout:5/499: dwrite d0/d6/d9/d82/d84/db2/f85 [0,4194304] 0 2023-10-18T20:58:31.974 INFO:tasks.workunit.client.1.smithi060.stdout:1/574: creat d4/d6/d7/d35/fbc x:0 0 0 2023-10-18T20:58:31.974 INFO:tasks.workunit.client.1.smithi060.stdout:1/575: write d4/da/d42/f4a [1063567,77227] 0 2023-10-18T20:58:31.974 INFO:tasks.workunit.client.1.smithi060.stdout:1/576: fdatasync d4/d6/f22 0 2023-10-18T20:58:31.975 INFO:tasks.workunit.client.1.smithi060.stdout:1/577: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/fad 345047205 1 2023-10-18T20:58:31.977 INFO:tasks.workunit.client.1.smithi060.stdout:2/474: symlink d0/d8/d47/d73/l93 0 2023-10-18T20:58:31.978 INFO:tasks.workunit.client.1.smithi060.stdout:9/393: rename d3/d99/d1c/d2a/d80/c91 to d3/d99/d19/d54/d8f/c9b 0 2023-10-18T20:58:31.982 INFO:tasks.workunit.client.1.smithi060.stdout:3/439: mkdir d0/d3c/d3d/d4d/d95 0 2023-10-18T20:58:31.991 INFO:tasks.workunit.client.1.smithi060.stdout:7/503: dwrite de/d14/f97 [0,4194304] 0 2023-10-18T20:58:31.991 INFO:tasks.workunit.client.1.smithi060.stdout:8/464: dwrite d4/d9/d31/d35/f84 [0,4194304] 0 2023-10-18T20:58:32.000 INFO:tasks.workunit.client.1.smithi060.stdout:5/500: symlink d0/d6/d8/df/d27/lbd 0 2023-10-18T20:58:32.000 INFO:tasks.workunit.client.1.smithi060.stdout:5/501: chown d0/da/d79/da5/f3e 6224 1 2023-10-18T20:58:32.000 INFO:tasks.workunit.client.1.smithi060.stdout:2/475: creat d0/d45/d49/d6e/d79/d6c/f94 x:0 0 0 2023-10-18T20:58:32.000 INFO:tasks.workunit.client.1.smithi060.stdout:5/502: truncate d0/d6/d9/d82/d84/db2/d41/f75 773009 0 2023-10-18T20:58:32.001 INFO:tasks.workunit.client.1.smithi060.stdout:5/503: stat d0/da/d79 0 2023-10-18T20:58:32.001 INFO:tasks.workunit.client.1.smithi060.stdout:6/474: rename d10/d17/d2f/l42 to d10/d2e/d75/d77/d8c/l93 0 2023-10-18T20:58:32.001 INFO:tasks.workunit.client.1.smithi060.stdout:6/475: write f7 [3912229,22696] 0 2023-10-18T20:58:32.008 INFO:tasks.workunit.client.0.smithi008.stdout:8/564: unlink d5/d8/df/d2e/lb9 0 2023-10-18T20:58:32.012 INFO:tasks.workunit.client.1.smithi060.stdout:7/504: mknod de/d14/d2f/d3f/d5a/ca1 0 2023-10-18T20:58:32.012 INFO:tasks.workunit.client.1.smithi060.stdout:7/505: creat de/fa2 x:0 0 0 2023-10-18T20:58:32.013 INFO:tasks.workunit.client.0.smithi008.stdout:5/456: dwrite d0/d2/d9/d34/f5c [0,4194304] 0 2023-10-18T20:58:32.019 INFO:tasks.workunit.client.1.smithi060.stdout:9/394: write d3/d99/d1c/d5a/d5d/d2b/f49 [3908983,125004] 0 2023-10-18T20:58:32.023 INFO:tasks.workunit.client.0.smithi008.stdout:1/553: mkdir d9/de/df/d17/d25/d57/da6 0 2023-10-18T20:58:32.036 INFO:tasks.workunit.client.0.smithi008.stdout:1/554: dread d9/de/df/d17/d55/f9d [0,4194304] 0 2023-10-18T20:58:32.037 INFO:tasks.workunit.client.0.smithi008.stdout:6/485: read df/d15/d27/f4a [3755107,115839] 0 2023-10-18T20:58:32.037 INFO:tasks.workunit.client.0.smithi008.stdout:6/486: write df/d3c/d77/da9/f5a [1783965,130212] 0 2023-10-18T20:58:32.042 INFO:tasks.workunit.client.1.smithi060.stdout:3/440: dwrite d0/f1d [0,4194304] 0 2023-10-18T20:58:32.042 INFO:tasks.workunit.client.1.smithi060.stdout:3/441: dread - d0/d22/d26/d2b/f77 zero size 2023-10-18T20:58:32.044 INFO:tasks.workunit.client.0.smithi008.stdout:1/555: dread d9/f51 [0,4194304] 0 2023-10-18T20:58:32.048 INFO:tasks.workunit.client.0.smithi008.stdout:2/468: symlink d1/d3/d40/d6e/l9a 0 2023-10-18T20:58:32.048 INFO:tasks.workunit.client.0.smithi008.stdout:2/469: unlink d1/d3/dd/d25/c6a 0 2023-10-18T20:58:32.056 INFO:tasks.workunit.client.1.smithi060.stdout:8/465: unlink d4/d9/d37/l5b 0 2023-10-18T20:58:32.058 INFO:tasks.workunit.client.1.smithi060.stdout:5/504: rmdir d0/d6/d9/d82/d84/db2/d2a 39 2023-10-18T20:58:32.061 INFO:tasks.workunit.client.0.smithi008.stdout:8/565: symlink d5/d8/df/d9d/d85/db1/dcc/ld2 0 2023-10-18T20:58:32.062 INFO:tasks.workunit.client.1.smithi060.stdout:3/442: write d0/f1b [3895802,15290] 0 2023-10-18T20:58:32.064 INFO:tasks.workunit.client.0.smithi008.stdout:4/423: dwrite d0/d58/d8e/f6d [0,4194304] 0 2023-10-18T20:58:32.064 INFO:tasks.workunit.client.0.smithi008.stdout:8/566: write d5/d8/df/d54/f62 [556725,28824] 0 2023-10-18T20:58:32.065 INFO:tasks.workunit.client.0.smithi008.stdout:0/373: dwrite d0/dd/f27 [4194304,4194304] 0 2023-10-18T20:58:32.065 INFO:tasks.workunit.client.0.smithi008.stdout:0/374: write d0/dd/df/d2a/f33 [8439126,47016] 0 2023-10-18T20:58:32.066 INFO:tasks.workunit.client.0.smithi008.stdout:0/375: fdatasync d0/dd/df/d20/f62 0 2023-10-18T20:58:32.066 INFO:tasks.workunit.client.0.smithi008.stdout:0/376: write d0/dd/d19/f3c [1917423,84735] 0 2023-10-18T20:58:32.068 INFO:tasks.workunit.client.1.smithi060.stdout:2/476: mknod d0/d45/d49/d6e/c95 0 2023-10-18T20:58:32.069 INFO:tasks.workunit.client.0.smithi008.stdout:5/457: unlink d0/d2/d19/d7c/f27 0 2023-10-18T20:58:32.071 INFO:tasks.workunit.client.1.smithi060.stdout:6/476: dwrite d10/d2e/f73 [0,4194304] 0 2023-10-18T20:58:32.071 INFO:tasks.workunit.client.1.smithi060.stdout:1/578: rename d4/d6/f4e to d4/d6/d48/fbd 0 2023-10-18T20:58:32.075 INFO:tasks.workunit.client.0.smithi008.stdout:1/556: dwrite d9/de/df/f5b [0,4194304] 0 2023-10-18T20:58:32.076 INFO:tasks.workunit.client.1.smithi060.stdout:5/505: dread d0/d6/d9/d82/d84/db2/f85 [0,4194304] 0 2023-10-18T20:58:32.076 INFO:tasks.workunit.client.1.smithi060.stdout:5/506: chown d0/d47/l70 60 1 2023-10-18T20:58:32.076 INFO:tasks.workunit.client.1.smithi060.stdout:5/507: readlink d0/d6/d8/df/d27/lbc 0 2023-10-18T20:58:32.079 INFO:tasks.workunit.client.0.smithi008.stdout:6/487: mkdir df/d13/daa 0 2023-10-18T20:58:32.079 INFO:tasks.workunit.client.0.smithi008.stdout:6/488: chown df/d15/d48/d81 2 1 2023-10-18T20:58:32.080 INFO:tasks.workunit.client.0.smithi008.stdout:6/489: chown df/d3c/d77/d50 11 1 2023-10-18T20:58:32.080 INFO:tasks.workunit.client.0.smithi008.stdout:6/490: fdatasync df/d15/f40 0 2023-10-18T20:58:32.080 INFO:tasks.workunit.client.1.smithi060.stdout:8/466: dread d4/d9/d37/d4e/f59 [0,4194304] 0 2023-10-18T20:58:32.081 INFO:tasks.workunit.client.1.smithi060.stdout:7/506: mkdir de/d14/d49/da3 0 2023-10-18T20:58:32.081 INFO:tasks.workunit.client.1.smithi060.stdout:7/507: chown de/d14/d2f/d8f/d5b/d9e/da0 910598 1 2023-10-18T20:58:32.082 INFO:tasks.workunit.client.1.smithi060.stdout:9/395: symlink d3/d99/d19/l9c 0 2023-10-18T20:58:32.086 INFO:tasks.workunit.client.1.smithi060.stdout:3/443: rmdir d0/d22/d26/d2b 39 2023-10-18T20:58:32.087 INFO:tasks.workunit.client.1.smithi060.stdout:2/477: unlink d0/d3/d27/d4d/d5e/f7c 0 2023-10-18T20:58:32.088 INFO:tasks.workunit.client.1.smithi060.stdout:2/478: dread - d0/d3/d27/d4d/f7d zero size 2023-10-18T20:58:32.095 INFO:tasks.workunit.client.0.smithi008.stdout:8/567: rmdir d5/d8/df/d9d/d6c 39 2023-10-18T20:58:32.095 INFO:tasks.workunit.client.0.smithi008.stdout:4/424: symlink d0/d58/l91 0 2023-10-18T20:58:32.095 INFO:tasks.workunit.client.0.smithi008.stdout:0/377: mkdir d0/dd/df/d2a/d5e/d7d 0 2023-10-18T20:58:32.095 INFO:tasks.workunit.client.0.smithi008.stdout:4/425: chown d0/d17/f6a 750016 1 2023-10-18T20:58:32.096 INFO:tasks.workunit.client.0.smithi008.stdout:4/426: write d0/d3/f77 [515699,32075] 0 2023-10-18T20:58:32.096 INFO:tasks.workunit.client.0.smithi008.stdout:2/470: mknod d1/d3/dd/d25/d4d/c9b 0 2023-10-18T20:58:32.108 INFO:tasks.workunit.client.1.smithi060.stdout:6/477: creat d10/d17/d7a/f94 x:0 0 0 2023-10-18T20:58:32.110 INFO:tasks.workunit.client.0.smithi008.stdout:4/427: write d0/d3/f67 [2281401,101136] 0 2023-10-18T20:58:32.114 INFO:tasks.workunit.client.1.smithi060.stdout:0/470: sync 2023-10-18T20:58:32.114 INFO:tasks.workunit.client.1.smithi060.stdout:4/426: sync 2023-10-18T20:58:32.114 INFO:tasks.workunit.client.1.smithi060.stdout:0/471: chown d3/d8/c7d 47282916 1 2023-10-18T20:58:32.115 INFO:tasks.workunit.client.1.smithi060.stdout:4/427: dread - d4/dc/f5e zero size 2023-10-18T20:58:32.115 INFO:tasks.workunit.client.1.smithi060.stdout:0/472: read - d3/d8/d14/d55/f88 zero size 2023-10-18T20:58:32.115 INFO:tasks.workunit.client.1.smithi060.stdout:4/428: stat d4/dc/d2a/d13/d2f/f34 0 2023-10-18T20:58:32.115 INFO:tasks.workunit.client.1.smithi060.stdout:4/429: chown d4/dc/d2a/d13 28044 1 2023-10-18T20:58:32.115 INFO:tasks.workunit.client.1.smithi060.stdout:4/430: fdatasync d4/d15/f37 0 2023-10-18T20:58:32.116 INFO:tasks.workunit.client.1.smithi060.stdout:4/431: read - d4/d15/f7c zero size 2023-10-18T20:58:32.116 INFO:tasks.workunit.client.1.smithi060.stdout:4/432: chown d4/dc/c26 5021 1 2023-10-18T20:58:32.117 INFO:tasks.workunit.client.1.smithi060.stdout:1/579: unlink d4/d38/d83/f91 0 2023-10-18T20:58:32.121 INFO:tasks.workunit.client.0.smithi008.stdout:5/458: mknod d0/d2/d19/d7c/d31/d80/ca3 0 2023-10-18T20:58:32.123 INFO:tasks.workunit.client.1.smithi060.stdout:5/508: creat d0/da/d3b/fbe x:0 0 0 2023-10-18T20:58:32.124 INFO:tasks.workunit.client.1.smithi060.stdout:8/467: mkdir d4/d9/d93 0 2023-10-18T20:58:32.124 INFO:tasks.workunit.client.1.smithi060.stdout:8/468: write d4/f19 [9367571,41922] 0 2023-10-18T20:58:32.124 INFO:tasks.workunit.client.1.smithi060.stdout:7/508: rmdir de/d38/d78 39 2023-10-18T20:58:32.129 INFO:tasks.workunit.client.0.smithi008.stdout:1/557: mkdir d9/de/df/d17/d25/d94/da7 0 2023-10-18T20:58:32.129 INFO:tasks.workunit.client.0.smithi008.stdout:1/558: unlink d9/de/df/f8d 0 2023-10-18T20:58:32.129 INFO:tasks.workunit.client.0.smithi008.stdout:1/559: fdatasync d9/de/df/d17/d1e/f4c 0 2023-10-18T20:58:32.130 INFO:tasks.workunit.client.1.smithi060.stdout:9/396: symlink d3/d99/d65/l9d 0 2023-10-18T20:58:32.131 INFO:tasks.workunit.client.1.smithi060.stdout:3/444: rmdir d0/d22/d26 39 2023-10-18T20:58:32.131 INFO:tasks.workunit.client.0.smithi008.stdout:9/395: sync 2023-10-18T20:58:32.131 INFO:tasks.workunit.client.0.smithi008.stdout:7/512: sync 2023-10-18T20:58:32.134 INFO:tasks.workunit.client.1.smithi060.stdout:5/509: dread d0/f5f [0,4194304] 0 2023-10-18T20:58:32.134 INFO:tasks.workunit.client.1.smithi060.stdout:5/510: stat d0/d6 0 2023-10-18T20:58:32.135 INFO:tasks.workunit.client.0.smithi008.stdout:6/491: creat df/d15/fab x:0 0 0 2023-10-18T20:58:32.135 INFO:tasks.workunit.client.0.smithi008.stdout:6/492: fsync df/d19/f1c 0 2023-10-18T20:58:32.135 INFO:tasks.workunit.client.0.smithi008.stdout:6/493: chown df/d19 843586 1 2023-10-18T20:58:32.136 INFO:tasks.workunit.client.1.smithi060.stdout:5/511: write d0/d6/d8/df/fae [851338,90297] 0 2023-10-18T20:58:32.136 INFO:tasks.workunit.client.1.smithi060.stdout:5/512: creat d0/d6/d8/df/d27/fbf x:0 0 0 2023-10-18T20:58:32.138 INFO:tasks.workunit.client.1.smithi060.stdout:6/478: rename d10/c38 to d10/c95 0 2023-10-18T20:58:32.138 INFO:tasks.workunit.client.1.smithi060.stdout:0/473: creat d3/d8/d14/d55/d74/d76/d68/d7f/f99 x:0 0 0 2023-10-18T20:58:32.139 INFO:tasks.workunit.client.0.smithi008.stdout:2/471: symlink d1/d3/dd/d25/d76/d59/l9c 0 2023-10-18T20:58:32.140 INFO:tasks.workunit.client.0.smithi008.stdout:1/560: dread d9/de/f15 [0,4194304] 0 2023-10-18T20:58:32.141 INFO:tasks.workunit.client.1.smithi060.stdout:4/433: mknod d4/dc/d2a/d39/d53/d65/c7d 0 2023-10-18T20:58:32.141 INFO:tasks.workunit.client.1.smithi060.stdout:4/434: readlink d4/dc/d2a/d13/d27/l57 0 2023-10-18T20:58:32.144 INFO:tasks.workunit.client.0.smithi008.stdout:8/568: getdents d5/d8/df/d9d 0 2023-10-18T20:58:32.145 INFO:tasks.workunit.client.1.smithi060.stdout:1/580: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/d5f/fbe x:0 0 0 2023-10-18T20:58:32.145 INFO:tasks.workunit.client.1.smithi060.stdout:1/581: write d4/d6/d33/d58/f76 [1224399,47329] 0 2023-10-18T20:58:32.146 INFO:tasks.workunit.client.1.smithi060.stdout:1/582: chown d4/d6/d7/d2f/cae 41524801 1 2023-10-18T20:58:32.150 INFO:tasks.workunit.client.0.smithi008.stdout:5/459: truncate d0/d2/d19/d7c/d42/d5a/f66 207000 0 2023-10-18T20:58:32.151 INFO:tasks.workunit.client.1.smithi060.stdout:7/509: symlink de/d14/d2f/d3f/la4 0 2023-10-18T20:58:32.156 INFO:tasks.workunit.client.1.smithi060.stdout:9/397: mkdir d3/d99/d1c/d5a/d5d/d2b/d9e 0 2023-10-18T20:58:32.158 INFO:tasks.workunit.client.0.smithi008.stdout:7/513: mknod d1/ca4 0 2023-10-18T20:58:32.158 INFO:tasks.workunit.client.0.smithi008.stdout:7/514: chown d1/d36/la0 1876371092 1 2023-10-18T20:58:32.161 INFO:tasks.workunit.client.0.smithi008.stdout:9/396: truncate d2/dc/d40/d46/f51 1024844 0 2023-10-18T20:58:32.161 INFO:tasks.workunit.client.0.smithi008.stdout:6/494: creat df/d18/d7e/fac x:0 0 0 2023-10-18T20:58:32.162 INFO:tasks.workunit.client.0.smithi008.stdout:6/495: chown df/d19/l6a 1811230824 1 2023-10-18T20:58:32.162 INFO:tasks.workunit.client.1.smithi060.stdout:3/445: link d0/fd d0/d22/f96 0 2023-10-18T20:58:32.164 INFO:tasks.workunit.client.1.smithi060.stdout:3/446: write d0/f1b [1559512,71949] 0 2023-10-18T20:58:32.164 INFO:tasks.workunit.client.0.smithi008.stdout:2/472: rename d1/c66 to d1/d3/d40/c9d 0 2023-10-18T20:58:32.164 INFO:tasks.workunit.client.1.smithi060.stdout:0/474: mkdir d3/d8/d14/d55/d9a 0 2023-10-18T20:58:32.167 INFO:tasks.workunit.client.0.smithi008.stdout:3/377: sync 2023-10-18T20:58:32.168 INFO:tasks.workunit.client.0.smithi008.stdout:5/460: mkdir d0/d2/d19/d7c/d31/d3f/d70/da4 0 2023-10-18T20:58:32.171 INFO:tasks.workunit.client.1.smithi060.stdout:7/510: rmdir de/d14/d2f/d8f/d5b/d9e 39 2023-10-18T20:58:32.177 INFO:tasks.workunit.client.0.smithi008.stdout:6/496: symlink df/d13/d53/lad 0 2023-10-18T20:58:32.185 INFO:tasks.workunit.client.1.smithi060.stdout:6/479: getdents d10/d25/d3c 0 2023-10-18T20:58:32.186 INFO:tasks.workunit.client.0.smithi008.stdout:5/461: creat d0/d2/d19/d7c/d58/d65/d68/fa5 x:0 0 0 2023-10-18T20:58:32.190 INFO:tasks.workunit.client.1.smithi060.stdout:3/447: write d0/fb [1122058,84694] 0 2023-10-18T20:58:32.190 INFO:tasks.workunit.client.1.smithi060.stdout:3/448: fdatasync d0/d3c/d3d/f7b 0 2023-10-18T20:58:32.190 INFO:tasks.workunit.client.0.smithi008.stdout:9/397: rmdir d2/d64 39 2023-10-18T20:58:32.191 INFO:tasks.workunit.client.1.smithi060.stdout:7/511: creat de/d14/d2f/d8f/d65/fa5 x:0 0 0 2023-10-18T20:58:32.192 INFO:tasks.workunit.client.1.smithi060.stdout:9/398: dread d3/d99/f69 [0,4194304] 0 2023-10-18T20:58:32.192 INFO:tasks.workunit.client.1.smithi060.stdout:9/399: fdatasync d3/d99/d1c/d2a/f36 0 2023-10-18T20:58:32.192 INFO:tasks.workunit.client.1.smithi060.stdout:9/400: chown d3/c4d 243186242 1 2023-10-18T20:58:32.193 INFO:tasks.workunit.client.0.smithi008.stdout:5/462: creat d0/d2/d9/d9b/d6f/d75/fa6 x:0 0 0 2023-10-18T20:58:32.195 INFO:tasks.workunit.client.1.smithi060.stdout:6/480: dread d10/f72 [0,4194304] 0 2023-10-18T20:58:32.195 INFO:tasks.workunit.client.1.smithi060.stdout:6/481: truncate d10/d47/d92/f22 4566370 0 2023-10-18T20:58:32.197 INFO:tasks.workunit.client.0.smithi008.stdout:9/398: unlink d2/dc/d40/d46/l6a 0 2023-10-18T20:58:32.197 INFO:tasks.workunit.client.0.smithi008.stdout:9/399: fdatasync d2/dc/d1a/d61/f62 0 2023-10-18T20:58:32.197 INFO:tasks.workunit.client.1.smithi060.stdout:3/449: rename d0/d3c/d3d/f3e to d0/d3c/d3d/d4d/f97 0 2023-10-18T20:58:32.198 INFO:tasks.workunit.client.0.smithi008.stdout:8/569: write d5/d8/f41 [1560984,18558] 0 2023-10-18T20:58:32.199 INFO:tasks.workunit.client.0.smithi008.stdout:8/570: write d5/d8/d24/d50/f5e [3614397,23372] 0 2023-10-18T20:58:32.199 INFO:tasks.workunit.client.0.smithi008.stdout:7/515: dread d1/d36/d3d/f5a [0,4194304] 0 2023-10-18T20:58:32.200 INFO:tasks.workunit.client.0.smithi008.stdout:5/463: rename d0/d86/d9e to d0/d2/d19/d7c/da7 0 2023-10-18T20:58:32.200 INFO:tasks.workunit.client.0.smithi008.stdout:6/497: dread df/d18/d68/f6b [0,4194304] 0 2023-10-18T20:58:32.202 INFO:tasks.workunit.client.0.smithi008.stdout:4/428: dwrite d0/d3/f64 [0,4194304] 0 2023-10-18T20:58:32.203 INFO:tasks.workunit.client.0.smithi008.stdout:2/473: dread d1/d3/dd/d1c/f55 [0,4194304] 0 2023-10-18T20:58:32.203 INFO:tasks.workunit.client.0.smithi008.stdout:9/400: truncate d2/dc/d17/d19/fe 3937732 0 2023-10-18T20:58:32.204 INFO:tasks.workunit.client.1.smithi060.stdout:0/475: rmdir d3/d8/d14/d55/d74/d76/d68 39 2023-10-18T20:58:32.204 INFO:tasks.workunit.client.1.smithi060.stdout:0/476: chown d3/d8/d3c/d87/d91 2183265 1 2023-10-18T20:58:32.205 INFO:tasks.workunit.client.1.smithi060.stdout:0/477: dread - d3/d8/d14/d55/d74/d76/d68/d7f/f99 zero size 2023-10-18T20:58:32.207 INFO:tasks.workunit.client.0.smithi008.stdout:8/571: symlink d5/d8/d24/d50/d53/d8c/dc9/ld3 0 2023-10-18T20:58:32.216 INFO:tasks.workunit.client.1.smithi060.stdout:4/435: dwrite d4/dc/f58 [0,4194304] 0 2023-10-18T20:58:32.216 INFO:tasks.workunit.client.1.smithi060.stdout:6/482: truncate d10/d17/d54/f5a 2165466 0 2023-10-18T20:58:32.217 INFO:tasks.workunit.client.1.smithi060.stdout:9/401: mkdir d3/d99/d9f 0 2023-10-18T20:58:32.217 INFO:tasks.workunit.client.0.smithi008.stdout:7/516: mkdir d1/d3/d8b/da5 0 2023-10-18T20:58:32.217 INFO:tasks.workunit.client.0.smithi008.stdout:7/517: fsync d1/d3/f82 0 2023-10-18T20:58:32.221 INFO:tasks.workunit.client.0.smithi008.stdout:9/401: symlink d2/l6e 0 2023-10-18T20:58:32.222 INFO:tasks.workunit.client.0.smithi008.stdout:5/464: read d0/d2/d19/d7c/d58/d65/f2b [1615187,111946] 0 2023-10-18T20:58:32.223 INFO:tasks.workunit.client.1.smithi060.stdout:3/450: creat d0/d3c/d3d/f98 x:0 0 0 2023-10-18T20:58:32.223 INFO:tasks.workunit.client.1.smithi060.stdout:5/513: dread d0/da/d3b/f4c [0,4194304] 0 2023-10-18T20:58:32.227 INFO:tasks.workunit.client.0.smithi008.stdout:9/402: mkdir d2/dc/d40/d6f 0 2023-10-18T20:58:32.229 INFO:tasks.workunit.client.1.smithi060.stdout:0/478: dread d3/f71 [0,4194304] 0 2023-10-18T20:58:32.230 INFO:tasks.workunit.client.1.smithi060.stdout:4/436: mkdir d4/dc/d2a/d7e 0 2023-10-18T20:58:32.231 INFO:tasks.workunit.client.0.smithi008.stdout:6/498: read df/d15/d27/f52 [3812772,100090] 0 2023-10-18T20:58:32.232 INFO:tasks.workunit.client.0.smithi008.stdout:7/518: rmdir d1/d36/d3d/d3e/d59/d73/d7b 39 2023-10-18T20:58:32.232 INFO:tasks.workunit.client.1.smithi060.stdout:9/402: mkdir d3/d99/d1c/d2a/d80/da0 0 2023-10-18T20:58:32.233 INFO:tasks.workunit.client.1.smithi060.stdout:9/403: readlink d3/d99/d65/l9d 0 2023-10-18T20:58:32.233 INFO:tasks.workunit.client.1.smithi060.stdout:9/404: dread - d3/d99/d1c/d5a/d5d/f88 zero size 2023-10-18T20:58:32.233 INFO:tasks.workunit.client.1.smithi060.stdout:4/437: creat d4/dc/d2a/d39/f7f x:0 0 0 2023-10-18T20:58:32.233 INFO:tasks.workunit.client.1.smithi060.stdout:4/438: chown d4/dc/d2a/d31/l6f 466752 1 2023-10-18T20:58:32.233 INFO:tasks.workunit.client.1.smithi060.stdout:3/451: dread d0/d3c/d3d/f47 [0,4194304] 0 2023-10-18T20:58:32.239 INFO:tasks.workunit.client.1.smithi060.stdout:1/583: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/f5c [0,4194304] 0 2023-10-18T20:58:32.242 INFO:tasks.workunit.client.0.smithi008.stdout:3/378: dread d0/d3/f29 [0,4194304] 0 2023-10-18T20:58:32.244 INFO:tasks.workunit.client.1.smithi060.stdout:4/439: write d4/dc/d2a/d13/d33/f35 [1948982,96191] 0 2023-10-18T20:58:32.244 INFO:tasks.workunit.client.1.smithi060.stdout:4/440: fdatasync d4/d15/f45 0 2023-10-18T20:58:32.245 INFO:tasks.workunit.client.0.smithi008.stdout:3/379: stat d0/d3/de/d13/c5e 0 2023-10-18T20:58:32.245 INFO:tasks.workunit.client.0.smithi008.stdout:9/403: write d2/dc/d1a/f54 [325600,75205] 0 2023-10-18T20:58:32.249 INFO:tasks.workunit.client.1.smithi060.stdout:3/452: rmdir d0/d22/d50 39 2023-10-18T20:58:32.250 INFO:tasks.workunit.client.1.smithi060.stdout:3/453: getdents d0/d22/d26/d2c 0 2023-10-18T20:58:32.250 INFO:tasks.workunit.client.1.smithi060.stdout:1/584: rename d4/d6/d7/d2f/d7b/d2a/d32/f93 to d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/fbf 0 2023-10-18T20:58:32.261 INFO:tasks.workunit.client.0.smithi008.stdout:1/561: dwrite d9/de/df/d17/d55/f78 [0,4194304] 0 2023-10-18T20:58:32.261 INFO:tasks.workunit.client.0.smithi008.stdout:9/404: dread d2/dc/d1a/f21 [0,4194304] 0 2023-10-18T20:58:32.262 INFO:tasks.workunit.client.0.smithi008.stdout:9/405: read d2/dc/f4b [200692,10783] 0 2023-10-18T20:58:32.264 INFO:tasks.workunit.client.0.smithi008.stdout:9/406: rmdir d2/dc/d17 39 2023-10-18T20:58:32.268 INFO:tasks.workunit.client.0.smithi008.stdout:1/562: truncate d9/de/df/d17/d1e/d3c/f6f 708045 0 2023-10-18T20:58:32.268 INFO:tasks.workunit.client.0.smithi008.stdout:9/407: creat d2/dc/d3d/f70 x:0 0 0 2023-10-18T20:58:32.268 INFO:tasks.workunit.client.0.smithi008.stdout:9/408: dread - d2/dc/d3d/f70 zero size 2023-10-18T20:58:32.268 INFO:tasks.workunit.client.0.smithi008.stdout:9/409: write d2/dc/d40/f5c [274428,85380] 0 2023-10-18T20:58:32.269 INFO:tasks.workunit.client.0.smithi008.stdout:1/563: write d9/f54 [5021140,128684] 0 2023-10-18T20:58:32.269 INFO:tasks.workunit.client.0.smithi008.stdout:1/564: truncate d9/de/df/d17/d1e/d3c/fa3 227404 0 2023-10-18T20:58:32.269 INFO:tasks.workunit.client.0.smithi008.stdout:1/565: fdatasync d9/f7a 0 2023-10-18T20:58:32.269 INFO:tasks.workunit.client.0.smithi008.stdout:1/566: fsync d9/de/f80 0 2023-10-18T20:58:32.270 INFO:tasks.workunit.client.1.smithi060.stdout:8/469: dwrite d4/ff [0,4194304] 0 2023-10-18T20:58:32.276 INFO:tasks.workunit.client.0.smithi008.stdout:1/567: mkdir d9/de/df/d17/d55/da8 0 2023-10-18T20:58:32.276 INFO:tasks.workunit.client.0.smithi008.stdout:1/568: write d9/de/df/d17/d25/f32 [5577345,35644] 0 2023-10-18T20:58:32.283 INFO:tasks.workunit.client.0.smithi008.stdout:3/380: read d0/f54 [2981124,118700] 0 2023-10-18T20:58:32.283 INFO:tasks.workunit.client.0.smithi008.stdout:3/381: readlink d0/d3/de/l32 0 2023-10-18T20:58:32.284 INFO:tasks.workunit.client.0.smithi008.stdout:3/382: dread - d0/d3/d42/d52/f6b zero size 2023-10-18T20:58:32.284 INFO:tasks.workunit.client.0.smithi008.stdout:3/383: creat d0/d3/d42/d52/f73 x:0 0 0 2023-10-18T20:58:32.284 INFO:tasks.workunit.client.0.smithi008.stdout:3/384: fsync d0/f62 0 2023-10-18T20:58:32.287 INFO:tasks.workunit.client.0.smithi008.stdout:3/385: truncate d0/f54 975030 0 2023-10-18T20:58:32.290 INFO:tasks.workunit.client.0.smithi008.stdout:3/386: truncate d0/d4a/d64/f6e 2552612 0 2023-10-18T20:58:32.291 INFO:tasks.workunit.client.0.smithi008.stdout:9/410: dread d2/dc/d17/f16 [0,4194304] 0 2023-10-18T20:58:32.291 INFO:tasks.workunit.client.0.smithi008.stdout:9/411: fdatasync d2/dc/d17/d19/f55 0 2023-10-18T20:58:32.297 INFO:tasks.workunit.client.1.smithi060.stdout:7/512: rmdir de/d14/d2f 39 2023-10-18T20:58:32.298 INFO:tasks.workunit.client.1.smithi060.stdout:7/513: readlink de/l1c 0 2023-10-18T20:58:32.299 INFO:tasks.workunit.client.1.smithi060.stdout:0/479: dwrite d3/fc [4194304,4194304] 0 2023-10-18T20:58:32.301 INFO:tasks.workunit.client.1.smithi060.stdout:7/514: symlink de/d14/d2f/d3f/d5a/d5f/la6 0 2023-10-18T20:58:32.308 INFO:tasks.workunit.client.1.smithi060.stdout:7/515: symlink de/d14/d49/la7 0 2023-10-18T20:58:32.313 INFO:tasks.workunit.client.0.smithi008.stdout:8/572: rename d5/d8/d24 to d5/d8/df/d9d/d4d/dba/dd4 0 2023-10-18T20:58:32.315 INFO:tasks.workunit.client.0.smithi008.stdout:4/429: dwrite d0/d3/d21/f3e [0,4194304] 0 2023-10-18T20:58:32.317 INFO:tasks.workunit.client.1.smithi060.stdout:6/483: dwrite d10/d2e/f3f [4194304,4194304] 0 2023-10-18T20:58:32.320 INFO:tasks.workunit.client.1.smithi060.stdout:6/484: write fb [2342249,52787] 0 2023-10-18T20:58:32.321 INFO:tasks.workunit.client.1.smithi060.stdout:7/516: creat de/d29/d72/fa8 x:0 0 0 2023-10-18T20:58:32.321 INFO:tasks.workunit.client.0.smithi008.stdout:8/573: rename d5/d8/df/d2e/l97 to d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/ld5 0 2023-10-18T20:58:32.321 INFO:tasks.workunit.client.1.smithi060.stdout:7/517: write de/d14/d49/f55 [4382090,9128] 0 2023-10-18T20:58:32.324 INFO:tasks.workunit.client.1.smithi060.stdout:5/514: dwrite d0/f8a [0,4194304] 0 2023-10-18T20:58:32.325 INFO:tasks.workunit.client.0.smithi008.stdout:8/574: creat d5/d8/df/d9d/d4d/dba/dd4/fd6 x:0 0 0 2023-10-18T20:58:32.326 INFO:tasks.workunit.client.0.smithi008.stdout:8/575: truncate d5/d8/df/d9d/d6c/f7f 5071893 0 2023-10-18T20:58:32.327 INFO:tasks.workunit.client.1.smithi060.stdout:0/480: read d3/d8/f10 [218388,129531] 0 2023-10-18T20:58:32.327 INFO:tasks.workunit.client.1.smithi060.stdout:0/481: write d3/f60 [5202558,26838] 0 2023-10-18T20:58:32.328 INFO:tasks.workunit.client.1.smithi060.stdout:7/518: creat de/d14/d2f/d8f/d65/fa9 x:0 0 0 2023-10-18T20:58:32.328 INFO:tasks.workunit.client.1.smithi060.stdout:7/519: dread - de/fa2 zero size 2023-10-18T20:58:32.329 INFO:tasks.workunit.client.1.smithi060.stdout:7/520: write de/f27 [3029491,97724] 0 2023-10-18T20:58:32.329 INFO:tasks.workunit.client.1.smithi060.stdout:7/521: creat de/d14/d3a/d46/d73/faa x:0 0 0 2023-10-18T20:58:32.331 INFO:tasks.workunit.client.0.smithi008.stdout:8/576: rename d5/d8/df/d9d/l8b to d5/d8/df/dce/ld7 0 2023-10-18T20:58:32.333 INFO:tasks.workunit.client.1.smithi060.stdout:0/482: link d3/d8/d14/d55/l56 d3/d8/d14/l9b 0 2023-10-18T20:58:32.336 INFO:tasks.workunit.client.1.smithi060.stdout:7/522: mkdir de/d14/d3a/d46/dab 0 2023-10-18T20:58:32.336 INFO:tasks.workunit.client.1.smithi060.stdout:7/523: dread - de/d14/d2f/d3f/d5a/f94 zero size 2023-10-18T20:58:32.338 INFO:tasks.workunit.client.1.smithi060.stdout:0/483: unlink d3/d8/d14/f65 0 2023-10-18T20:58:32.338 INFO:tasks.workunit.client.0.smithi008.stdout:2/474: dwrite d1/d3/dd/d25/d76/f3f [0,4194304] 0 2023-10-18T20:58:32.342 INFO:tasks.workunit.client.1.smithi060.stdout:7/524: dread de/d14/d49/d68/f40 [4194304,4194304] 0 2023-10-18T20:58:32.344 INFO:tasks.workunit.client.1.smithi060.stdout:0/484: rmdir d3/d8/d14/d55/d74/d76 39 2023-10-18T20:58:32.346 INFO:tasks.workunit.client.1.smithi060.stdout:7/525: mkdir de/d14/d2f/d8f/d5b/d9e/dac 0 2023-10-18T20:58:32.346 INFO:tasks.workunit.client.1.smithi060.stdout:7/526: creat de/d38/fad x:0 0 0 2023-10-18T20:58:32.347 INFO:tasks.workunit.client.1.smithi060.stdout:0/485: creat d3/d8/d14/d55/d74/d76/d68/d7f/d8d/f9c x:0 0 0 2023-10-18T20:58:32.349 INFO:tasks.workunit.client.1.smithi060.stdout:0/486: rmdir d3/d8/d14/d55/d74 39 2023-10-18T20:58:32.350 INFO:tasks.workunit.client.0.smithi008.stdout:3/387: dwrite d0/d3/f33 [0,4194304] 0 2023-10-18T20:58:32.350 INFO:tasks.workunit.client.0.smithi008.stdout:3/388: chown d0/d3/f31 373 1 2023-10-18T20:58:32.352 INFO:tasks.workunit.client.0.smithi008.stdout:3/389: mkdir d0/d3/d37/d74 0 2023-10-18T20:58:32.354 INFO:tasks.workunit.client.0.smithi008.stdout:3/390: creat d0/d3/de/d13/f75 x:0 0 0 2023-10-18T20:58:32.363 INFO:tasks.workunit.client.1.smithi060.stdout:3/454: dwrite d0/d22/f52 [0,4194304] 0 2023-10-18T20:58:32.364 INFO:tasks.workunit.client.1.smithi060.stdout:9/405: dwrite d3/d99/d1c/d5a/d5d/d2b/f49 [4194304,4194304] 0 2023-10-18T20:58:32.364 INFO:tasks.workunit.client.1.smithi060.stdout:9/406: dread - d3/d99/d1c/d5a/d5d/f88 zero size 2023-10-18T20:58:32.364 INFO:tasks.workunit.client.0.smithi008.stdout:2/475: dread d1/d3/d40/d6e/f77 [0,4194304] 0 2023-10-18T20:58:32.365 INFO:tasks.workunit.client.1.smithi060.stdout:6/485: dread d10/d25/d3c/f62 [0,4194304] 0 2023-10-18T20:58:32.365 INFO:tasks.workunit.client.1.smithi060.stdout:6/486: readlink d10/l1c 0 2023-10-18T20:58:32.371 INFO:tasks.workunit.client.1.smithi060.stdout:6/487: symlink d10/d17/d70/l96 0 2023-10-18T20:58:32.372 INFO:tasks.workunit.client.1.smithi060.stdout:6/488: truncate d10/d17/d28/f5c 995324 0 2023-10-18T20:58:32.372 INFO:tasks.workunit.client.1.smithi060.stdout:3/455: truncate d0/f1d 3238117 0 2023-10-18T20:58:32.373 INFO:tasks.workunit.client.1.smithi060.stdout:3/456: mknod d0/d22/c99 0 2023-10-18T20:58:32.375 INFO:tasks.workunit.client.1.smithi060.stdout:4/441: dwrite d4/dc/d2a/d13/f56 [0,4194304] 0 2023-10-18T20:58:32.379 INFO:tasks.workunit.client.1.smithi060.stdout:3/457: rename d0/f1f to d0/d22/d26/d29/f9a 0 2023-10-18T20:58:32.379 INFO:tasks.workunit.client.1.smithi060.stdout:3/458: stat d0/d22/d26/d2b/f80 0 2023-10-18T20:58:32.387 INFO:tasks.workunit.client.0.smithi008.stdout:6/499: dwrite df/d15/d27/f28 [0,4194304] 0 2023-10-18T20:58:32.387 INFO:tasks.workunit.client.0.smithi008.stdout:6/500: write df/d15/d27/f63 [1710028,33602] 0 2023-10-18T20:58:32.393 INFO:tasks.workunit.client.0.smithi008.stdout:5/465: dwrite d0/d2/d9/d9b/d6f/d75/fa1 [0,4194304] 0 2023-10-18T20:58:32.393 INFO:tasks.workunit.client.0.smithi008.stdout:5/466: fsync d0/d2/d19/d7c/d42/d5a/f69 0 2023-10-18T20:58:32.395 INFO:tasks.workunit.client.1.smithi060.stdout:2/479: sync 2023-10-18T20:58:32.400 INFO:tasks.workunit.client.1.smithi060.stdout:3/459: write d0/d3c/f40 [3814409,115400] 0 2023-10-18T20:58:32.402 INFO:tasks.workunit.client.1.smithi060.stdout:9/407: dread f0 [0,4194304] 0 2023-10-18T20:58:32.412 INFO:tasks.workunit.client.1.smithi060.stdout:0/487: dread d3/d8/d14/d55/d74/f85 [0,4194304] 0 2023-10-18T20:58:32.413 INFO:tasks.workunit.client.1.smithi060.stdout:5/515: dwrite d0/d6/d8/df/d27/fbf [0,4194304] 0 2023-10-18T20:58:32.414 INFO:tasks.workunit.client.1.smithi060.stdout:4/442: dread d4/dc/d2a/d13/d33/f35 [0,4194304] 0 2023-10-18T20:58:32.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:31.131071+0000 mon.smithi008 (mon.0) 648 : cluster [DBG] mgrmap e26: smithi008.flmjzp(active, since 2s), standbys: smithi060.pgqqwa 2023-10-18T20:58:32.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:31.152930+0000 mgr.smithi008.flmjzp (mgr.14640) 2 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail 2023-10-18T20:58:32.431 INFO:tasks.workunit.client.0.smithi008.stdout:2/476: dwrite d1/d3/dd/d1c/f74 [4194304,4194304] 0 2023-10-18T20:58:32.431 INFO:tasks.workunit.client.0.smithi008.stdout:2/477: write d1/d3/dd/f65 [555971,19948] 0 2023-10-18T20:58:32.431 INFO:tasks.workunit.client.0.smithi008.stdout:2/478: truncate d1/d3/dd/d25/f27 1820939 0 2023-10-18T20:58:32.432 INFO:tasks.workunit.client.0.smithi008.stdout:2/479: truncate d1/d3/dd/d1c/f96 946079 0 2023-10-18T20:58:32.432 INFO:tasks.workunit.client.0.smithi008.stdout:9/412: dwrite d2/dc/d17/d19/fe [4194304,4194304] 0 2023-10-18T20:58:32.435 INFO:tasks.workunit.client.0.smithi008.stdout:3/391: dwrite d0/d3/f5 [0,4194304] 0 2023-10-18T20:58:32.437 INFO:tasks.workunit.client.1.smithi060.stdout:7/527: dwrite de/f6f [0,4194304] 0 2023-10-18T20:58:32.441 INFO:tasks.workunit.client.1.smithi060.stdout:6/489: dwrite d10/d17/d28/f21 [4194304,4194304] 0 2023-10-18T20:58:32.445 INFO:tasks.workunit.client.1.smithi060.stdout:3/460: creat d0/d22/d50/f9b x:0 0 0 2023-10-18T20:58:32.446 INFO:tasks.workunit.client.0.smithi008.stdout:6/501: mknod df/d15/d5e/cae 0 2023-10-18T20:58:32.446 INFO:tasks.workunit.client.0.smithi008.stdout:6/502: chown df/d18/d68/f6b 77699 1 2023-10-18T20:58:32.449 INFO:tasks.workunit.client.1.smithi060.stdout:2/480: dread d0/d3/f32 [0,4194304] 0 2023-10-18T20:58:32.454 INFO:tasks.workunit.client.1.smithi060.stdout:9/408: rename d3/d99/d1c/d5a/d5d/d2b/f35 to d3/fa1 0 2023-10-18T20:58:32.455 INFO:tasks.workunit.client.1.smithi060.stdout:4/443: mkdir d4/dc/d40/d80 0 2023-10-18T20:58:32.455 INFO:tasks.workunit.client.1.smithi060.stdout:9/409: readlink d3/d99/d1c/d2a/d2d/l84 0 2023-10-18T20:58:32.455 INFO:tasks.workunit.client.1.smithi060.stdout:6/490: unlink d10/d2e/d75/d77/c84 0 2023-10-18T20:58:32.456 INFO:tasks.workunit.client.1.smithi060.stdout:6/491: getdents d10/d2e/d75 0 2023-10-18T20:58:32.456 INFO:tasks.workunit.client.1.smithi060.stdout:6/492: stat d10/d25/f7f 0 2023-10-18T20:58:32.458 INFO:tasks.workunit.client.0.smithi008.stdout:5/467: creat d0/d2/d19/d7c/d31/d3f/d70/fa8 x:0 0 0 2023-10-18T20:58:32.459 INFO:tasks.workunit.client.1.smithi060.stdout:3/461: mknod d0/d3c/d3d/d4d/d95/c9c 0 2023-10-18T20:58:32.459 INFO:tasks.workunit.client.1.smithi060.stdout:3/462: truncate d0/d22/d26/d2c/f83 1231181 0 2023-10-18T20:58:32.464 INFO:tasks.workunit.client.1.smithi060.stdout:9/410: dread d3/d99/d1c/d2a/d33/f53 [0,4194304] 0 2023-10-18T20:58:32.464 INFO:tasks.workunit.client.1.smithi060.stdout:9/411: read - d3/d99/d19/f6e zero size 2023-10-18T20:58:32.464 INFO:tasks.workunit.client.1.smithi060.stdout:9/412: write d3/d99/d1c/d5a/d5d/d7d/f7f [488286,13821] 0 2023-10-18T20:58:32.465 INFO:tasks.workunit.client.1.smithi060.stdout:9/413: fdatasync d3/d99/d1c/d2a/d33/f31 0 2023-10-18T20:58:32.465 INFO:tasks.workunit.client.1.smithi060.stdout:9/414: dread - d3/d99/d1c/d2a/d33/f83 zero size 2023-10-18T20:58:32.465 INFO:tasks.workunit.client.1.smithi060.stdout:5/516: rename d0/d6/d9/d82/d84/db2/d2a/lb0 to d0/da/d3b/d43/lc0 0 2023-10-18T20:58:32.466 INFO:tasks.workunit.client.1.smithi060.stdout:3/463: symlink d0/d3c/l9d 0 2023-10-18T20:58:32.467 INFO:tasks.workunit.client.1.smithi060.stdout:2/481: mkdir d0/d3/d27/d4d/d5e/d96 0 2023-10-18T20:58:32.467 INFO:tasks.workunit.client.1.smithi060.stdout:2/482: fdatasync d0/d3/f32 0 2023-10-18T20:58:32.467 INFO:tasks.workunit.client.1.smithi060.stdout:2/483: read d0/d3/f35 [4583,23398] 0 2023-10-18T20:58:32.467 INFO:tasks.workunit.client.1.smithi060.stdout:2/484: fdatasync d0/d8/f8a 0 2023-10-18T20:58:32.468 INFO:tasks.workunit.client.0.smithi008.stdout:9/413: symlink d2/d8/l71 0 2023-10-18T20:58:32.469 INFO:tasks.workunit.client.1.smithi060.stdout:4/444: dread d4/dc/f29 [0,4194304] 0 2023-10-18T20:58:32.469 INFO:tasks.workunit.client.1.smithi060.stdout:4/445: dread - d4/d15/f7c zero size 2023-10-18T20:58:32.469 INFO:tasks.workunit.client.1.smithi060.stdout:3/464: truncate d0/f20 498511 0 2023-10-18T20:58:32.472 INFO:tasks.workunit.client.1.smithi060.stdout:5/517: link d0/dd/c1c d0/d6/d9/d82/d96/cc1 0 2023-10-18T20:58:32.473 INFO:tasks.workunit.client.1.smithi060.stdout:5/518: chown d0/da/d79/da5/d67 255147858 1 2023-10-18T20:58:32.473 INFO:tasks.workunit.client.1.smithi060.stdout:5/519: write d0/d6/d9/d82/d84/db2/f7a [521867,8354] 0 2023-10-18T20:58:32.473 INFO:tasks.workunit.client.0.smithi008.stdout:3/392: mknod d0/d3/d37/c76 0 2023-10-18T20:58:32.474 INFO:tasks.workunit.client.0.smithi008.stdout:3/393: readlink d0/d3/de/d13/d35/l45 0 2023-10-18T20:58:32.475 INFO:tasks.workunit.client.1.smithi060.stdout:2/485: creat d0/f97 x:0 0 0 2023-10-18T20:58:32.476 INFO:tasks.workunit.client.1.smithi060.stdout:9/415: dread d3/d99/d1c/d2a/d33/f53 [0,4194304] 0 2023-10-18T20:58:32.476 INFO:tasks.workunit.client.1.smithi060.stdout:9/416: write f2 [1162474,30469] 0 2023-10-18T20:58:32.477 INFO:tasks.workunit.client.0.smithi008.stdout:5/468: mkdir d0/da9 0 2023-10-18T20:58:32.479 INFO:tasks.workunit.client.1.smithi060.stdout:4/446: symlink d4/dc/d40/l81 0 2023-10-18T20:58:32.480 INFO:tasks.workunit.client.0.smithi008.stdout:6/503: dread df/d15/f40 [0,4194304] 0 2023-10-18T20:58:32.483 INFO:tasks.workunit.client.1.smithi060.stdout:0/488: dwrite d3/d8/d14/f2b [0,4194304] 0 2023-10-18T20:58:32.484 INFO:tasks.workunit.client.1.smithi060.stdout:0/489: truncate d3/d8/f11 1297532 0 2023-10-18T20:58:32.484 INFO:tasks.workunit.client.1.smithi060.stdout:0/490: truncate d3/d8/d14/d55/d74/d76/d6b/f75 681969 0 2023-10-18T20:58:32.485 INFO:tasks.workunit.client.1.smithi060.stdout:2/486: creat d0/d8/d47/f98 x:0 0 0 2023-10-18T20:58:32.485 INFO:tasks.workunit.client.1.smithi060.stdout:2/487: chown d0 359484 1 2023-10-18T20:58:32.485 INFO:tasks.workunit.client.1.smithi060.stdout:2/488: write d0/d3/d27/f4c [781418,28476] 0 2023-10-18T20:58:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:31.131071+0000 mon.smithi008 (mon.0) 648 : cluster [DBG] mgrmap e26: smithi008.flmjzp(active, since 2s), standbys: smithi060.pgqqwa 2023-10-18T20:58:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:31.152930+0000 mgr.smithi008.flmjzp (mgr.14640) 2 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail 2023-10-18T20:58:32.493 INFO:tasks.workunit.client.1.smithi060.stdout:4/447: mkdir d4/dc/d2a/d39/d82 0 2023-10-18T20:58:32.494 INFO:tasks.workunit.client.1.smithi060.stdout:4/448: chown d4/dc/d2a/d1d/f21 30 1 2023-10-18T20:58:32.494 INFO:tasks.workunit.client.1.smithi060.stdout:4/449: write d4/dc/d2a/d39/f7f [869255,53045] 0 2023-10-18T20:58:32.494 INFO:tasks.workunit.client.1.smithi060.stdout:4/450: getdents d4/dc/d2a/d39/d53/d76 0 2023-10-18T20:58:32.495 INFO:tasks.workunit.client.0.smithi008.stdout:2/480: mknod d1/d3/dd/c9e 0 2023-10-18T20:58:32.495 INFO:tasks.workunit.client.0.smithi008.stdout:2/481: fsync d1/d3/d40/d6e/f78 0 2023-10-18T20:58:32.497 INFO:tasks.workunit.client.0.smithi008.stdout:6/504: dread df/d3c/f67 [0,4194304] 0 2023-10-18T20:58:32.497 INFO:tasks.workunit.client.0.smithi008.stdout:3/394: rename d0/d3/de/d13/c34 to d0/c77 0 2023-10-18T20:58:32.498 INFO:tasks.workunit.client.0.smithi008.stdout:3/395: dread - d0/d4a/f5b zero size 2023-10-18T20:58:32.498 INFO:tasks.workunit.client.0.smithi008.stdout:3/396: creat d0/d3/d37/f78 x:0 0 0 2023-10-18T20:58:32.498 INFO:tasks.workunit.client.0.smithi008.stdout:3/397: truncate d0/f59 4329832 0 2023-10-18T20:58:32.499 INFO:tasks.workunit.client.0.smithi008.stdout:3/398: truncate d0/d3/f33 5047831 0 2023-10-18T20:58:32.499 INFO:tasks.workunit.client.1.smithi060.stdout:6/493: write f8 [3058635,7949] 0 2023-10-18T20:58:32.499 INFO:tasks.workunit.client.1.smithi060.stdout:6/494: write d10/d3e/d76/f86 [166957,72756] 0 2023-10-18T20:58:32.501 INFO:tasks.workunit.client.1.smithi060.stdout:7/528: dwrite de/d14/d2f/d8f/d65/fa9 [0,4194304] 0 2023-10-18T20:58:32.505 INFO:tasks.workunit.client.0.smithi008.stdout:1/569: truncate d9/de/df/d17/d1e/d3c/f6f 687022 0 2023-10-18T20:58:32.505 INFO:tasks.workunit.client.1.smithi060.stdout:0/491: dread d3/d8/d14/d55/d74/d76/f64 [0,4194304] 0 2023-10-18T20:58:32.506 INFO:tasks.workunit.client.1.smithi060.stdout:2/489: truncate d0/d3/f59 1170016 0 2023-10-18T20:58:32.506 INFO:tasks.workunit.client.1.smithi060.stdout:2/490: creat d0/d8/d47/f99 x:0 0 0 2023-10-18T20:58:32.506 INFO:tasks.workunit.client.0.smithi008.stdout:2/482: symlink d1/d3/dd/d25/d76/l9f 0 2023-10-18T20:58:32.510 INFO:tasks.workunit.client.0.smithi008.stdout:5/469: getdents d0/d6e 0 2023-10-18T20:58:32.513 INFO:tasks.workunit.client.0.smithi008.stdout:6/505: dread df/d18/d3f/f7b [0,4194304] 0 2023-10-18T20:58:32.514 INFO:tasks.workunit.client.0.smithi008.stdout:6/506: write df/d18/f21 [2312030,91526] 0 2023-10-18T20:58:32.514 INFO:tasks.workunit.client.0.smithi008.stdout:1/570: truncate d9/de/df/d17/d1e/d7d/d89/f8e 1576559 0 2023-10-18T20:58:32.516 INFO:tasks.workunit.client.0.smithi008.stdout:2/483: rename d1/d3/dd/d25/d76/l9f to d1/d3/la0 0 2023-10-18T20:58:32.522 INFO:tasks.workunit.client.0.smithi008.stdout:9/414: dwrite d2/dc/d1a/d1d/f50 [8388608,4194304] 0 2023-10-18T20:58:32.523 INFO:tasks.workunit.client.0.smithi008.stdout:3/399: getdents d0 0 2023-10-18T20:58:32.524 INFO:tasks.workunit.client.0.smithi008.stdout:5/470: mkdir d0/d2/d9/daa 0 2023-10-18T20:58:32.526 INFO:tasks.workunit.client.1.smithi060.stdout:0/492: write d3/f60 [2332372,50630] 0 2023-10-18T20:58:32.526 INFO:tasks.workunit.client.1.smithi060.stdout:0/493: readlink d3/d8/d14/d55/d74/d76/d68/d7f/l94 0 2023-10-18T20:58:32.526 INFO:tasks.workunit.client.1.smithi060.stdout:0/494: truncate d3/f21 833543 0 2023-10-18T20:58:32.526 INFO:tasks.workunit.client.1.smithi060.stdout:0/495: stat d3/d8/d14 0 2023-10-18T20:58:32.529 INFO:tasks.workunit.client.0.smithi008.stdout:0/378: sync 2023-10-18T20:58:32.530 INFO:tasks.workunit.client.0.smithi008.stdout:0/379: fsync d0/dd/d19/d41/f58 0 2023-10-18T20:58:32.530 INFO:tasks.workunit.client.0.smithi008.stdout:0/380: fsync d0/dd/d19/f76 0 2023-10-18T20:58:32.530 INFO:tasks.workunit.client.0.smithi008.stdout:6/507: mknod df/d15/d48/d81/caf 0 2023-10-18T20:58:32.531 INFO:tasks.workunit.client.0.smithi008.stdout:6/508: write df/d18/f21 [1430689,92043] 0 2023-10-18T20:58:32.531 INFO:tasks.workunit.client.0.smithi008.stdout:6/509: creat df/d15/d48/fb0 x:0 0 0 2023-10-18T20:58:32.531 INFO:tasks.workunit.client.0.smithi008.stdout:6/510: write df/d15/f16 [3054288,70406] 0 2023-10-18T20:58:32.534 INFO:tasks.workunit.client.0.smithi008.stdout:2/484: symlink d1/la1 0 2023-10-18T20:58:32.536 INFO:tasks.workunit.client.0.smithi008.stdout:9/415: symlink d2/dc/d1a/d61/d59/l72 0 2023-10-18T20:58:32.537 INFO:tasks.workunit.client.0.smithi008.stdout:9/416: chown d2/dc/d17/l45 7319 1 2023-10-18T20:58:32.537 INFO:tasks.workunit.client.0.smithi008.stdout:9/417: creat d2/dc/d3d/f73 x:0 0 0 2023-10-18T20:58:32.537 INFO:tasks.workunit.client.0.smithi008.stdout:9/418: readlink d2/d8/l38 0 2023-10-18T20:58:32.538 INFO:tasks.workunit.client.0.smithi008.stdout:5/471: creat d0/d2/d9/d88/fab x:0 0 0 2023-10-18T20:58:32.540 INFO:tasks.workunit.client.0.smithi008.stdout:0/381: rename d0/dd/d19/d5f/c78 to d0/d3a/c7e 0 2023-10-18T20:58:32.540 INFO:tasks.workunit.client.0.smithi008.stdout:0/382: write d0/d3a/f5c [874427,85935] 0 2023-10-18T20:58:32.541 INFO:tasks.workunit.client.0.smithi008.stdout:0/383: fsync d0/dd/d19/d41/f43 0 2023-10-18T20:58:32.541 INFO:tasks.workunit.client.1.smithi060.stdout:7/529: truncate de/d14/d2f/d8f/d5b/f7a 2805298 0 2023-10-18T20:58:32.547 INFO:tasks.workunit.client.1.smithi060.stdout:4/451: getdents d4/dc/d2a/d13/d2f 0 2023-10-18T20:58:32.549 INFO:tasks.workunit.client.0.smithi008.stdout:6/511: mknod df/d3c/da2/cb1 0 2023-10-18T20:58:32.552 INFO:tasks.workunit.client.0.smithi008.stdout:2/485: creat d1/d3/dd/d25/d4d/fa2 x:0 0 0 2023-10-18T20:58:32.554 INFO:tasks.workunit.client.1.smithi060.stdout:2/491: mknod d0/d3/c9a 0 2023-10-18T20:58:32.554 INFO:tasks.workunit.client.1.smithi060.stdout:2/492: chown d0/d8/c64 0 1 2023-10-18T20:58:32.554 INFO:tasks.workunit.client.1.smithi060.stdout:7/530: dread de/f1a [0,4194304] 0 2023-10-18T20:58:32.555 INFO:tasks.workunit.client.1.smithi060.stdout:3/465: link d0/f20 d0/d22/d26/d29/f9e 0 2023-10-18T20:58:32.555 INFO:tasks.workunit.client.1.smithi060.stdout:3/466: creat d0/d22/d50/f9f x:0 0 0 2023-10-18T20:58:32.556 INFO:tasks.workunit.client.1.smithi060.stdout:3/467: chown d0/d22/d26/d8c/l91 829286581 1 2023-10-18T20:58:32.556 INFO:tasks.workunit.client.1.smithi060.stdout:3/468: dread - d0/d22/d26/d2b/f77 zero size 2023-10-18T20:58:32.557 INFO:tasks.workunit.client.0.smithi008.stdout:9/419: mknod d2/dc/d40/d46/c74 0 2023-10-18T20:58:32.558 INFO:tasks.workunit.client.0.smithi008.stdout:5/472: unlink d0/de/c46 0 2023-10-18T20:58:32.561 INFO:tasks.workunit.client.1.smithi060.stdout:0/496: truncate d3/d8/d14/d55/d74/f85 3745647 0 2023-10-18T20:58:32.561 INFO:tasks.workunit.client.1.smithi060.stdout:0/497: chown d3/d32/f38 2 1 2023-10-18T20:58:32.561 INFO:tasks.workunit.client.1.smithi060.stdout:0/498: chown d3/d8/d14/f2b 0 1 2023-10-18T20:58:32.562 INFO:tasks.workunit.client.1.smithi060.stdout:0/499: readlink d3/d8/d14/d55/d74/d76/d68/l7a 0 2023-10-18T20:58:32.562 INFO:tasks.workunit.client.1.smithi060.stdout:0/500: write d3/d80/f90 [608260,44717] 0 2023-10-18T20:58:32.562 INFO:tasks.workunit.client.1.smithi060.stdout:0/501: fdatasync d3/d8/d14/f5b 0 2023-10-18T20:58:32.563 INFO:tasks.workunit.client.1.smithi060.stdout:0/502: fdatasync d3/d8/f22 0 2023-10-18T20:58:32.563 INFO:tasks.workunit.client.1.smithi060.stdout:4/452: mkdir d4/dc/d2a/d83 0 2023-10-18T20:58:32.563 INFO:tasks.workunit.client.1.smithi060.stdout:4/453: truncate d4/dc/d2a/d13/d27/d68/f6b 1471188 0 2023-10-18T20:58:32.567 INFO:tasks.workunit.client.0.smithi008.stdout:9/420: creat d2/dc/d1a/d61/f75 x:0 0 0 2023-10-18T20:58:32.568 INFO:tasks.workunit.client.1.smithi060.stdout:2/493: symlink d0/d43/d68/l9b 0 2023-10-18T20:58:32.568 INFO:tasks.workunit.client.0.smithi008.stdout:9/421: fdatasync d2/f4 0 2023-10-18T20:58:32.570 INFO:tasks.workunit.client.0.smithi008.stdout:9/422: creat d2/dc/d17/f76 x:0 0 0 2023-10-18T20:58:32.572 INFO:tasks.workunit.client.1.smithi060.stdout:4/454: unlink d4/dc/d2a/d13/d33/f52 0 2023-10-18T20:58:32.572 INFO:tasks.workunit.client.1.smithi060.stdout:4/455: truncate d4/dc/d2a/d39/f49 317329 0 2023-10-18T20:58:32.572 INFO:tasks.workunit.client.1.smithi060.stdout:4/456: readlink d4/dc/d2a/d13/d27/l32 0 2023-10-18T20:58:32.572 INFO:tasks.workunit.client.1.smithi060.stdout:4/457: creat d4/d15/f84 x:0 0 0 2023-10-18T20:58:32.576 INFO:tasks.workunit.client.1.smithi060.stdout:7/531: write de/d29/f77 [2686499,87643] 0 2023-10-18T20:58:32.576 INFO:tasks.workunit.client.0.smithi008.stdout:5/473: rmdir d0/d2/d9/d9b/d6f/d75 39 2023-10-18T20:58:32.577 INFO:tasks.workunit.client.1.smithi060.stdout:2/494: truncate d0/f65 348291 0 2023-10-18T20:58:32.578 INFO:tasks.workunit.client.0.smithi008.stdout:3/400: dwrite d0/d3/d42/f30 [0,4194304] 0 2023-10-18T20:58:32.582 INFO:tasks.workunit.client.0.smithi008.stdout:5/474: rename d0/d2/d19/d7c/d42/d5a/f66 to d0/d2/d9/d9b/d62/fac 0 2023-10-18T20:58:32.583 INFO:tasks.workunit.client.0.smithi008.stdout:1/571: dwrite d9/de/df/d17/d55/f5c [0,4194304] 0 2023-10-18T20:58:32.583 INFO:tasks.workunit.client.0.smithi008.stdout:1/572: fsync d9/de/df/d17/d55/f9d 0 2023-10-18T20:58:32.584 INFO:tasks.workunit.client.1.smithi060.stdout:7/532: creat de/d29/d72/d84/fae x:0 0 0 2023-10-18T20:58:32.587 INFO:tasks.workunit.client.1.smithi060.stdout:2/495: link d0/d8/d47/f98 d0/d16/d7f/f9c 0 2023-10-18T20:58:32.590 INFO:tasks.workunit.client.0.smithi008.stdout:3/401: unlink d0/d3/f29 0 2023-10-18T20:58:32.590 INFO:tasks.workunit.client.0.smithi008.stdout:3/402: write d0/d3/de/d13/f24 [976431,93993] 0 2023-10-18T20:58:32.591 INFO:tasks.workunit.client.1.smithi060.stdout:0/503: write d3/f48 [546878,63626] 0 2023-10-18T20:58:32.593 INFO:tasks.workunit.client.0.smithi008.stdout:9/423: getdents d2/d4d 0 2023-10-18T20:58:32.594 INFO:tasks.workunit.client.0.smithi008.stdout:9/424: creat d2/dc/d17/f77 x:0 0 0 2023-10-18T20:58:32.599 INFO:tasks.workunit.client.1.smithi060.stdout:3/469: dread d0/d22/d26/d2c/f62 [0,4194304] 0 2023-10-18T20:58:32.604 INFO:tasks.workunit.client.1.smithi060.stdout:7/533: rmdir de/d14/d2f/d8f/d5b/d9e/da0 0 2023-10-18T20:58:32.607 INFO:tasks.workunit.client.1.smithi060.stdout:2/496: mknod d0/d3/d27/d4d/d53/c9d 0 2023-10-18T20:58:32.608 INFO:tasks.workunit.client.0.smithi008.stdout:0/384: dwrite d0/dd/f18 [0,4194304] 0 2023-10-18T20:58:32.608 INFO:tasks.workunit.client.0.smithi008.stdout:0/385: readlink d0/lc 0 2023-10-18T20:58:32.608 INFO:tasks.workunit.client.0.smithi008.stdout:0/386: write d0/dd/d19/f6e [961084,24817] 0 2023-10-18T20:58:32.610 INFO:tasks.workunit.client.0.smithi008.stdout:3/403: mknod d0/d3/d37/d74/c79 0 2023-10-18T20:58:32.611 INFO:tasks.workunit.client.1.smithi060.stdout:3/470: mkdir d0/d22/d26/d2c/da0 0 2023-10-18T20:58:32.614 INFO:tasks.workunit.client.1.smithi060.stdout:8/470: sync 2023-10-18T20:58:32.614 INFO:tasks.workunit.client.1.smithi060.stdout:8/471: write d4/d9/d31/d35/f44 [209622,97899] 0 2023-10-18T20:58:32.614 INFO:tasks.workunit.client.1.smithi060.stdout:1/585: sync 2023-10-18T20:58:32.615 INFO:tasks.workunit.client.1.smithi060.stdout:8/472: unlink d4/d9/ld 0 2023-10-18T20:58:32.616 INFO:tasks.workunit.client.1.smithi060.stdout:8/473: readlink d4/d9/d37/d4e/d5e/l58 0 2023-10-18T20:58:32.619 INFO:tasks.workunit.client.1.smithi060.stdout:7/534: unlink de/c79 0 2023-10-18T20:58:32.620 INFO:tasks.workunit.client.0.smithi008.stdout:9/425: mknod d2/dc/d40/d56/c78 0 2023-10-18T20:58:32.620 INFO:tasks.workunit.client.0.smithi008.stdout:5/475: getdents d0/d2/d19/d7c/d31/d3f/d70 0 2023-10-18T20:58:32.620 INFO:tasks.workunit.client.0.smithi008.stdout:6/512: dwrite df/d19/f20 [4194304,4194304] 0 2023-10-18T20:58:32.623 INFO:tasks.workunit.client.1.smithi060.stdout:2/497: getdents d0/d45/d49 0 2023-10-18T20:58:32.623 INFO:tasks.workunit.client.0.smithi008.stdout:2/486: dwrite d1/d3/dd/f65 [0,4194304] 0 2023-10-18T20:58:32.629 INFO:tasks.workunit.client.0.smithi008.stdout:3/404: mknod d0/d3/de/d13/c7a 0 2023-10-18T20:58:32.635 INFO:tasks.workunit.client.1.smithi060.stdout:6/495: sync 2023-10-18T20:58:32.636 INFO:tasks.workunit.client.1.smithi060.stdout:5/520: sync 2023-10-18T20:58:32.636 INFO:tasks.workunit.client.1.smithi060.stdout:5/521: chown d0/d6/d9/d82/d84/db2/c19 3279410 1 2023-10-18T20:58:32.636 INFO:tasks.workunit.client.1.smithi060.stdout:9/417: sync 2023-10-18T20:58:32.639 INFO:tasks.workunit.client.0.smithi008.stdout:7/519: sync 2023-10-18T20:58:32.639 INFO:tasks.workunit.client.0.smithi008.stdout:7/520: read - d1/d3/d20/f89 zero size 2023-10-18T20:58:32.641 INFO:tasks.workunit.client.0.smithi008.stdout:5/476: mkdir d0/d2/d19/d7c/d31/d82/dad 0 2023-10-18T20:58:32.642 INFO:tasks.workunit.client.1.smithi060.stdout:3/471: symlink d0/d3c/d3d/d4d/d95/la1 0 2023-10-18T20:58:32.643 INFO:tasks.workunit.client.0.smithi008.stdout:6/513: mkdir df/d15/d27/d4c/db2 0 2023-10-18T20:58:32.649 INFO:tasks.workunit.client.1.smithi060.stdout:1/586: unlink d4/da/l79 0 2023-10-18T20:58:32.649 INFO:tasks.workunit.client.1.smithi060.stdout:1/587: readlink d4/d6/d33/d58/l61 0 2023-10-18T20:58:32.650 INFO:tasks.workunit.client.1.smithi060.stdout:8/474: creat d4/d9/d4f/d74/d81/f94 x:0 0 0 2023-10-18T20:58:32.650 INFO:tasks.workunit.client.0.smithi008.stdout:2/487: unlink d1/l32 0 2023-10-18T20:58:32.653 INFO:tasks.workunit.client.1.smithi060.stdout:6/496: rmdir d10/d17/d54 39 2023-10-18T20:58:32.654 INFO:tasks.workunit.client.1.smithi060.stdout:6/497: readlink d10/d17/d28/l20 0 2023-10-18T20:58:32.654 INFO:tasks.workunit.client.1.smithi060.stdout:4/458: dwrite d4/d15/f73 [0,4194304] 0 2023-10-18T20:58:32.655 INFO:tasks.workunit.client.1.smithi060.stdout:5/522: write d0/d6/d8/df/d27/d32/d4f/f86 [782904,5087] 0 2023-10-18T20:58:32.655 INFO:tasks.workunit.client.1.smithi060.stdout:5/523: chown d0/d6/d8/f44 645031226 1 2023-10-18T20:58:32.656 INFO:tasks.workunit.client.0.smithi008.stdout:3/405: symlink d0/l7b 0 2023-10-18T20:58:32.656 INFO:tasks.workunit.client.0.smithi008.stdout:1/573: dwrite d9/de/df/d17/d55/f78 [0,4194304] 0 2023-10-18T20:58:32.656 INFO:tasks.workunit.client.0.smithi008.stdout:1/574: write d9/de/df/d17/d1e/d3c/d90/f9e [463903,21049] 0 2023-10-18T20:58:32.656 INFO:tasks.workunit.client.0.smithi008.stdout:9/426: unlink d2/dc/d17/d19/d4a/l57 0 2023-10-18T20:58:32.657 INFO:tasks.workunit.client.1.smithi060.stdout:8/475: creat d4/d9/d37/d4e/d6e/f95 x:0 0 0 2023-10-18T20:58:32.657 INFO:tasks.workunit.client.0.smithi008.stdout:7/521: unlink d1/d36/f60 0 2023-10-18T20:58:32.657 INFO:tasks.workunit.client.0.smithi008.stdout:7/522: read - d1/d36/d3d/d3e/d59/f9b zero size 2023-10-18T20:58:32.658 INFO:tasks.workunit.client.1.smithi060.stdout:6/498: creat d10/d17/f97 x:0 0 0 2023-10-18T20:58:32.660 INFO:tasks.workunit.client.0.smithi008.stdout:6/514: truncate df/d74/f75 2421610 0 2023-10-18T20:58:32.664 INFO:tasks.workunit.client.1.smithi060.stdout:0/504: write d3/d8/f11 [1875831,22499] 0 2023-10-18T20:58:32.664 INFO:tasks.workunit.client.1.smithi060.stdout:0/505: readlink d3/l5a 0 2023-10-18T20:58:32.665 INFO:tasks.workunit.client.0.smithi008.stdout:9/427: creat d2/dc/d1a/f79 x:0 0 0 2023-10-18T20:58:32.667 INFO:tasks.workunit.client.0.smithi008.stdout:3/406: write d0/d3/d42/f68 [3770179,96511] 0 2023-10-18T20:58:32.670 INFO:tasks.workunit.client.1.smithi060.stdout:5/524: symlink d0/da/d61/lc2 0 2023-10-18T20:58:32.675 INFO:tasks.workunit.client.1.smithi060.stdout:6/499: creat d10/d6f/f98 x:0 0 0 2023-10-18T20:58:32.675 INFO:tasks.workunit.client.1.smithi060.stdout:6/500: write d10/d25/f8d [194601,1763] 0 2023-10-18T20:58:32.676 INFO:tasks.workunit.client.1.smithi060.stdout:4/459: dread d4/d15/f48 [0,4194304] 0 2023-10-18T20:58:32.676 INFO:tasks.workunit.client.1.smithi060.stdout:4/460: write d4/f6a [255214,100594] 0 2023-10-18T20:58:32.680 INFO:tasks.workunit.client.0.smithi008.stdout:1/575: link d9/de/df/d17/c37 d9/de/df/d17/d69/ca9 0 2023-10-18T20:58:32.680 INFO:tasks.workunit.client.1.smithi060.stdout:4/461: stat d4/dc/d2a/d13/c63 0 2023-10-18T20:58:32.681 INFO:tasks.workunit.client.1.smithi060.stdout:4/462: unlink d4/f10 0 2023-10-18T20:58:32.681 INFO:tasks.workunit.client.0.smithi008.stdout:9/428: mknod d2/d4d/c7a 0 2023-10-18T20:58:32.681 INFO:tasks.workunit.client.1.smithi060.stdout:4/463: truncate d4/dc/d2a/d39/f7f 1351972 0 2023-10-18T20:58:32.682 INFO:tasks.workunit.client.0.smithi008.stdout:9/429: fsync d2/f5 0 2023-10-18T20:58:32.682 INFO:tasks.workunit.client.0.smithi008.stdout:9/430: write d2/dc/d1a/d1d/f58 [4382884,99293] 0 2023-10-18T20:58:32.682 INFO:tasks.workunit.client.0.smithi008.stdout:9/431: chown d2/l11 454 1 2023-10-18T20:58:32.683 INFO:tasks.workunit.client.0.smithi008.stdout:9/432: unlink d2/dc/d1a/d1d/f50 0 2023-10-18T20:58:32.683 INFO:tasks.workunit.client.0.smithi008.stdout:9/433: dread - d2/dc/d17/f77 zero size 2023-10-18T20:58:32.684 INFO:tasks.workunit.client.1.smithi060.stdout:0/506: rmdir d3/d8/d14/d55 39 2023-10-18T20:58:32.684 INFO:tasks.workunit.client.1.smithi060.stdout:0/507: chown d3/f26 353136 1 2023-10-18T20:58:32.687 INFO:tasks.workunit.client.0.smithi008.stdout:7/523: rename d1/d36/d3b to d1/da6 0 2023-10-18T20:58:32.689 INFO:tasks.workunit.client.1.smithi060.stdout:5/525: mknod d0/d6/cc3 0 2023-10-18T20:58:32.691 INFO:tasks.workunit.client.0.smithi008.stdout:6/515: rmdir df/d15/d48/d4b 39 2023-10-18T20:58:32.691 INFO:tasks.workunit.client.0.smithi008.stdout:6/516: write df/d19/f1c [3052690,100432] 0 2023-10-18T20:58:32.692 INFO:tasks.workunit.client.0.smithi008.stdout:2/488: dread d1/f18 [0,4194304] 0 2023-10-18T20:58:32.692 INFO:tasks.workunit.client.0.smithi008.stdout:2/489: fdatasync d1/f8c 0 2023-10-18T20:58:32.696 INFO:tasks.workunit.client.1.smithi060.stdout:7/535: dwrite de/d14/f97 [0,4194304] 0 2023-10-18T20:58:32.696 INFO:tasks.workunit.client.0.smithi008.stdout:1/576: creat d9/de/df/d17/d25/d94/faa x:0 0 0 2023-10-18T20:58:32.698 INFO:tasks.workunit.client.1.smithi060.stdout:0/508: truncate d3/fc 6758754 0 2023-10-18T20:58:32.698 INFO:tasks.workunit.client.1.smithi060.stdout:4/464: unlink d4/dc/d40/f41 0 2023-10-18T20:58:32.706 INFO:tasks.workunit.client.1.smithi060.stdout:2/498: dwrite d0/d45/d49/f39 [0,4194304] 0 2023-10-18T20:58:32.709 INFO:tasks.workunit.client.1.smithi060.stdout:5/526: rmdir d0/d6/d8/da4 0 2023-10-18T20:58:32.709 INFO:tasks.workunit.client.1.smithi060.stdout:8/476: dread d4/d9/d37/f3c [0,4194304] 0 2023-10-18T20:58:32.710 INFO:tasks.workunit.client.1.smithi060.stdout:0/509: truncate d3/d8/d14/d55/d74/d76/f64 830233 0 2023-10-18T20:58:32.710 INFO:tasks.workunit.client.0.smithi008.stdout:9/434: mkdir d2/dc/d17/d7b 0 2023-10-18T20:58:32.712 INFO:tasks.workunit.client.1.smithi060.stdout:6/501: dread d10/d2e/f73 [0,4194304] 0 2023-10-18T20:58:32.712 INFO:tasks.workunit.client.1.smithi060.stdout:6/502: truncate d10/d2e/f3a 4895483 0 2023-10-18T20:58:32.712 INFO:tasks.workunit.client.1.smithi060.stdout:4/465: truncate d4/dc/d2a/d13/f3a 6231031 0 2023-10-18T20:58:32.713 INFO:tasks.workunit.client.1.smithi060.stdout:2/499: mkdir d0/d3/d9e 0 2023-10-18T20:58:32.713 INFO:tasks.workunit.client.0.smithi008.stdout:3/407: dread d0/d3/f43 [0,4194304] 0 2023-10-18T20:58:32.715 INFO:tasks.workunit.client.0.smithi008.stdout:1/577: rmdir d9/de/df/d17/d25/d57 39 2023-10-18T20:58:32.715 INFO:tasks.workunit.client.0.smithi008.stdout:1/578: dread - d9/de/df/d17/d1e/d9a/f9c zero size 2023-10-18T20:58:32.715 INFO:tasks.workunit.client.1.smithi060.stdout:5/527: truncate d0/d6/f6a 2197615 0 2023-10-18T20:58:32.715 INFO:tasks.workunit.client.1.smithi060.stdout:5/528: chown d0/d6/d9/d82/d84/db2/d41/cac 7933 1 2023-10-18T20:58:32.717 INFO:tasks.workunit.client.0.smithi008.stdout:9/435: rename d2/dc/d1a/d61/f62 to d2/dc/d1a/d1d/f7c 0 2023-10-18T20:58:32.719 INFO:tasks.workunit.client.1.smithi060.stdout:8/477: mknod d4/d9/d31/c96 0 2023-10-18T20:58:32.719 INFO:tasks.workunit.client.1.smithi060.stdout:8/478: chown d4/f47 2406 1 2023-10-18T20:58:32.719 INFO:tasks.workunit.client.0.smithi008.stdout:4/430: sync 2023-10-18T20:58:32.720 INFO:tasks.workunit.client.0.smithi008.stdout:8/577: sync 2023-10-18T20:58:32.720 INFO:tasks.workunit.client.0.smithi008.stdout:4/431: getdents d0/d3/d21/d84 0 2023-10-18T20:58:32.726 INFO:tasks.workunit.client.1.smithi060.stdout:6/503: read d10/d25/f8d [88157,49891] 0 2023-10-18T20:58:32.727 INFO:tasks.workunit.client.0.smithi008.stdout:3/408: creat d0/d4a/d64/f7c x:0 0 0 2023-10-18T20:58:32.728 INFO:tasks.workunit.client.1.smithi060.stdout:0/510: symlink d3/d80/l9d 0 2023-10-18T20:58:32.729 INFO:tasks.workunit.client.1.smithi060.stdout:0/511: creat d3/d80/f9e x:0 0 0 2023-10-18T20:58:32.730 INFO:tasks.workunit.client.0.smithi008.stdout:9/436: link d2/f3 d2/d4d/f7d 0 2023-10-18T20:58:32.731 INFO:tasks.workunit.client.0.smithi008.stdout:9/437: stat d2/dc/d17/c43 0 2023-10-18T20:58:32.731 INFO:tasks.workunit.client.1.smithi060.stdout:9/418: dwrite d3/d99/d1c/d25/f74 [0,4194304] 0 2023-10-18T20:58:32.731 INFO:tasks.workunit.client.1.smithi060.stdout:9/419: stat d3/d99/d19/d54/d8f/f96 0 2023-10-18T20:58:32.731 INFO:tasks.workunit.client.1.smithi060.stdout:9/420: write d3/d99/d1c/f47 [1058194,9756] 0 2023-10-18T20:58:32.732 INFO:tasks.workunit.client.0.smithi008.stdout:8/578: mknod d5/d8/df/d9d/d4d/dba/dd4/d50/d53/d8c/db4/cd8 0 2023-10-18T20:58:32.738 INFO:tasks.workunit.client.1.smithi060.stdout:4/466: symlink d4/l85 0 2023-10-18T20:58:32.738 INFO:tasks.workunit.client.1.smithi060.stdout:4/467: truncate d4/d15/f45 694878 0 2023-10-18T20:58:32.738 INFO:tasks.workunit.client.1.smithi060.stdout:2/500: rename d0/d8/d47/c51 to d0/d8/c9f 0 2023-10-18T20:58:32.739 INFO:tasks.workunit.client.0.smithi008.stdout:3/409: mkdir d0/d3/de/d13/d7d 0 2023-10-18T20:58:32.739 INFO:tasks.workunit.client.0.smithi008.stdout:3/410: write d0/d3/d42/d52/f73 [831176,80794] 0 2023-10-18T20:58:32.739 INFO:tasks.workunit.client.0.smithi008.stdout:3/411: creat d0/d4a/d64/f7e x:0 0 0 2023-10-18T20:58:32.739 INFO:tasks.workunit.client.0.smithi008.stdout:9/438: mknod d2/dc/c7e 0 2023-10-18T20:58:32.740 INFO:tasks.workunit.client.1.smithi060.stdout:4/468: write d4/d15/f73 [5009896,85270] 0 2023-10-18T20:58:32.740 INFO:tasks.workunit.client.1.smithi060.stdout:4/469: truncate d4/dc/d2a/d13/d27/d68/f6b 2020656 0 2023-10-18T20:58:32.741 INFO:tasks.workunit.client.1.smithi060.stdout:5/529: symlink d0/d6/d8/d81/lc4 0 2023-10-18T20:58:32.741 INFO:tasks.workunit.client.0.smithi008.stdout:8/579: getdents d5/d8/df/d9d/d4d/db5 0 2023-10-18T20:58:32.741 INFO:tasks.workunit.client.0.smithi008.stdout:4/432: dread d0/d3/f1e [0,4194304] 0 2023-10-18T20:58:32.741 INFO:tasks.workunit.client.0.smithi008.stdout:8/580: chown d5/d8/df/d9d/d6c/fc8 105063426 1 2023-10-18T20:58:32.743 INFO:tasks.workunit.client.0.smithi008.stdout:5/477: dwrite d0/d2/d19/d7c/d31/f4a [0,4194304] 0 2023-10-18T20:58:32.744 INFO:tasks.workunit.client.0.smithi008.stdout:5/478: chown d0/d2/d9/d34 6107 1 2023-10-18T20:58:32.744 INFO:tasks.workunit.client.0.smithi008.stdout:5/479: readlink d0/d2/d19/d7c/d42/d5a/l87 0 2023-10-18T20:58:32.752 INFO:tasks.workunit.client.0.smithi008.stdout:2/490: dwrite d1/d3/f5f [4194304,4194304] 0 2023-10-18T20:58:32.753 INFO:tasks.workunit.client.1.smithi060.stdout:4/470: read d4/dc/d2a/d39/f7f [69982,16642] 0 2023-10-18T20:58:32.754 INFO:tasks.workunit.client.1.smithi060.stdout:4/471: creat d4/d15/d2b/f86 x:0 0 0 2023-10-18T20:58:32.755 INFO:tasks.workunit.client.1.smithi060.stdout:7/536: dwrite de/d14/d2f/f71 [0,4194304] 0 2023-10-18T20:58:32.756 INFO:tasks.workunit.client.1.smithi060.stdout:8/479: truncate d4/d9/f1b 2193032 0 2023-10-18T20:58:32.762 INFO:tasks.workunit.client.1.smithi060.stdout:6/504: dread d10/d17/d28/f24 [0,4194304] 0 2023-10-18T20:58:32.762 INFO:tasks.workunit.client.1.smithi060.stdout:1/588: dwrite d4/d6/d7/d2f/d7b/d2a/d32/d56/fa6 [0,4194304] 0 2023-10-18T20:58:32.763 INFO:tasks.workunit.client.1.smithi060.stdout:6/505: write d10/f72 [1056494,95803] 0 2023-10-18T20:58:32.768 INFO:tasks.workunit.client.0.smithi008.stdout:8/581: mknod d5/d8/df/d9d/d4d/dba/dd4/cd9 0 2023-10-18T20:58:32.769 INFO:tasks.workunit.client.0.smithi008.stdout:9/439: creat d2/f7f x:0 0 0 2023-10-18T20:58:32.776 INFO:tasks.workunit.client.0.smithi008.stdout:3/412: dread d0/d3/d42/f30 [0,4194304] 0 2023-10-18T20:58:32.777 INFO:tasks.workunit.client.0.smithi008.stdout:4/433: dread d0/f12 [0,4194304] 0 2023-10-18T20:58:32.777 INFO:tasks.workunit.client.1.smithi060.stdout:9/421: symlink d3/d99/d1c/d5a/d5d/d56/la2 0 2023-10-18T20:58:32.778 INFO:tasks.workunit.client.0.smithi008.stdout:8/582: truncate d5/d8/f12 3017609 0 2023-10-18T20:58:32.779 INFO:tasks.workunit.client.1.smithi060.stdout:0/512: read d3/f4f [718436,122435] 0 2023-10-18T20:58:32.780 INFO:tasks.workunit.client.1.smithi060.stdout:0/513: read d3/f48 [1424247,21688] 0 2023-10-18T20:58:32.781 INFO:tasks.workunit.client.0.smithi008.stdout:8/583: rmdir d5/d8/df/d9d/d85/db1 39 2023-10-18T20:58:32.782 INFO:tasks.workunit.client.1.smithi060.stdout:5/530: symlink d0/d6/d9/d82/d84/lc5 0 2023-10-18T20:58:32.786 INFO:tasks.workunit.client.0.smithi008.stdout:8/584: link d5/d8/df/d9d/d4d/dba/dd4/fa2 d5/d8/df/d9d/d4d/dba/dd4/d50/d53/d8c/db4/db7/fda 0 2023-10-18T20:58:32.790 INFO:tasks.workunit.client.0.smithi008.stdout:8/585: mknod d5/d8/df/d9d/d4d/dba/cdb 0 2023-10-18T20:58:32.790 INFO:tasks.workunit.client.0.smithi008.stdout:8/586: fdatasync d5/d8/df/f6b 0 2023-10-18T20:58:32.790 INFO:tasks.workunit.client.0.smithi008.stdout:8/587: chown d5/d8/df/d9d/d4d/dba 653 1 2023-10-18T20:58:32.794 INFO:tasks.workunit.client.0.smithi008.stdout:8/588: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d53/d8c/db4/fdc x:0 0 0 2023-10-18T20:58:32.797 INFO:tasks.workunit.client.0.smithi008.stdout:9/440: write d2/dc/f1e [445537,89055] 0 2023-10-18T20:58:32.798 INFO:tasks.workunit.client.0.smithi008.stdout:9/441: truncate d2/dc/f4b 1007132 0 2023-10-18T20:58:32.801 INFO:tasks.workunit.client.0.smithi008.stdout:1/579: write d9/de/df/d17/d55/f5c [2754268,88327] 0 2023-10-18T20:58:32.806 INFO:tasks.workunit.client.0.smithi008.stdout:8/589: dread d5/d8/df/d9d/d4d/dba/dd4/f59 [0,4194304] 0 2023-10-18T20:58:32.807 INFO:tasks.workunit.client.1.smithi060.stdout:1/589: link d4/d6/d7/df/d59/f6f d4/d6/d7/d35/fc0 0 2023-10-18T20:58:32.808 INFO:tasks.workunit.client.0.smithi008.stdout:8/590: truncate d5/f28 796343 0 2023-10-18T20:58:32.809 INFO:tasks.workunit.client.1.smithi060.stdout:9/422: unlink d3/d99/d1c/d5a/d5d/l98 0 2023-10-18T20:58:32.809 INFO:tasks.workunit.client.1.smithi060.stdout:8/480: getdents d4/d9 0 2023-10-18T20:58:32.810 INFO:tasks.workunit.client.1.smithi060.stdout:6/506: dread d10/d17/d28/f24 [0,4194304] 0 2023-10-18T20:58:32.811 INFO:tasks.workunit.client.0.smithi008.stdout:8/591: symlink d5/d8/df/d9d/d85/ldd 0 2023-10-18T20:58:32.812 INFO:tasks.workunit.client.0.smithi008.stdout:8/592: read d5/d8/df/d9d/d4d/dba/dd4/f59 [475933,112091] 0 2023-10-18T20:58:32.815 INFO:tasks.workunit.client.0.smithi008.stdout:4/434: dread d0/d3/d21/d42/f50 [0,4194304] 0 2023-10-18T20:58:32.815 INFO:tasks.workunit.client.0.smithi008.stdout:4/435: truncate d0/d58/d8e/f53 999490 0 2023-10-18T20:58:32.817 INFO:tasks.workunit.client.1.smithi060.stdout:9/423: symlink d3/d99/d19/d54/d8f/la3 0 2023-10-18T20:58:32.817 INFO:tasks.workunit.client.1.smithi060.stdout:9/424: rename d3/d99 to d3/d99/d1c/d5a/d5d/d7d/da4 22 2023-10-18T20:58:32.818 INFO:tasks.workunit.client.1.smithi060.stdout:6/507: symlink d10/d2e/l99 0 2023-10-18T20:58:32.818 INFO:tasks.workunit.client.1.smithi060.stdout:6/508: write d10/d17/f46 [5187749,1558] 0 2023-10-18T20:58:32.818 INFO:tasks.workunit.client.1.smithi060.stdout:8/481: rmdir d4/d9 39 2023-10-18T20:58:32.824 INFO:tasks.workunit.client.0.smithi008.stdout:8/593: getdents d5/d8/df/d9d/d4d/dba/dd4/d77 0 2023-10-18T20:58:32.826 INFO:tasks.workunit.client.0.smithi008.stdout:4/436: rename d0/d3/d21/f24 to d0/d17/d5b/d45/f92 0 2023-10-18T20:58:32.831 INFO:tasks.workunit.client.1.smithi060.stdout:5/531: write d0/d6/f55 [129244,102378] 0 2023-10-18T20:58:32.832 INFO:tasks.workunit.client.0.smithi008.stdout:7/524: dwrite d1/d36/d3d/f5a [0,4194304] 0 2023-10-18T20:58:32.832 INFO:tasks.workunit.client.0.smithi008.stdout:6/517: dwrite df/d15/d48/d4b/f4f [0,4194304] 0 2023-10-18T20:58:32.835 INFO:tasks.workunit.client.0.smithi008.stdout:8/594: rmdir d5/d8/df/d9d/d4d/dba/dd4/d50/d8d 39 2023-10-18T20:58:32.838 INFO:tasks.workunit.client.1.smithi060.stdout:6/509: symlink d10/d47/d92/d79/l9a 0 2023-10-18T20:58:32.839 INFO:tasks.workunit.client.1.smithi060.stdout:1/590: dread d4/d6/d7/df/f2c [0,4194304] 0 2023-10-18T20:58:32.844 INFO:tasks.workunit.client.1.smithi060.stdout:7/537: dwrite de/fa2 [0,4194304] 0 2023-10-18T20:58:32.845 INFO:tasks.workunit.client.0.smithi008.stdout:7/525: symlink d1/da6/d4f/d87/la7 0 2023-10-18T20:58:32.845 INFO:tasks.workunit.client.0.smithi008.stdout:7/526: readlink d1/d3/d20/l85 0 2023-10-18T20:58:32.853 INFO:tasks.workunit.client.0.smithi008.stdout:6/518: truncate df/d18/d3f/f7b 1190026 0 2023-10-18T20:58:32.853 INFO:tasks.workunit.client.0.smithi008.stdout:6/519: chown df 48 1 2023-10-18T20:58:32.854 INFO:tasks.workunit.client.1.smithi060.stdout:8/482: getdents d4/d9/d37 0 2023-10-18T20:58:32.854 INFO:tasks.workunit.client.1.smithi060.stdout:8/483: stat d4/d9/d4f/d74 0 2023-10-18T20:58:32.855 INFO:tasks.workunit.client.0.smithi008.stdout:8/595: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/fde x:0 0 0 2023-10-18T20:58:32.858 INFO:tasks.workunit.client.1.smithi060.stdout:6/510: creat d10/d2e/d75/d81/d8b/f9b x:0 0 0 2023-10-18T20:58:32.858 INFO:tasks.workunit.client.1.smithi060.stdout:6/511: creat d10/d17/f9c x:0 0 0 2023-10-18T20:58:32.862 INFO:tasks.workunit.client.1.smithi060.stdout:1/591: getdents d4/d6/d48 0 2023-10-18T20:58:32.864 INFO:tasks.workunit.client.1.smithi060.stdout:5/532: dread d0/d6/d8/df/f4e [0,4194304] 0 2023-10-18T20:58:32.865 INFO:tasks.workunit.client.1.smithi060.stdout:5/533: write d0/d6/f55 [5170898,103706] 0 2023-10-18T20:58:32.865 INFO:tasks.workunit.client.1.smithi060.stdout:5/534: write d0/f5f [1057301,18257] 0 2023-10-18T20:58:32.866 INFO:tasks.workunit.client.1.smithi060.stdout:0/514: dwrite d3/f6 [4194304,4194304] 0 2023-10-18T20:58:32.867 INFO:tasks.workunit.client.1.smithi060.stdout:5/535: creat d0/da/d3b/fc6 x:0 0 0 2023-10-18T20:58:32.869 INFO:tasks.workunit.client.1.smithi060.stdout:4/472: dwrite d4/dc/d2a/d2d/f4f [0,4194304] 0 2023-10-18T20:58:32.869 INFO:tasks.workunit.client.0.smithi008.stdout:7/527: creat d1/da6/d4f/fa8 x:0 0 0 2023-10-18T20:58:32.870 INFO:tasks.workunit.client.0.smithi008.stdout:2/491: dwrite d1/d3/dd/d25/f27 [0,4194304] 0 2023-10-18T20:58:32.873 INFO:tasks.workunit.client.0.smithi008.stdout:8/596: mknod d5/d8/df/d9d/d4d/cdf 0 2023-10-18T20:58:32.873 INFO:tasks.workunit.client.0.smithi008.stdout:8/597: write d5/d8/df/d9d/d4d/dba/dd4/d77/f88 [480338,78850] 0 2023-10-18T20:58:32.873 INFO:tasks.workunit.client.0.smithi008.stdout:8/598: chown d5/d8/df/d9d/d4d/dba/dd4/f63 5419464 1 2023-10-18T20:58:32.875 INFO:tasks.workunit.client.1.smithi060.stdout:7/538: write de/d29/f37 [2623694,18111] 0 2023-10-18T20:58:32.875 INFO:tasks.workunit.client.1.smithi060.stdout:7/539: chown de/d29/l81 35383 1 2023-10-18T20:58:32.875 INFO:tasks.workunit.client.1.smithi060.stdout:7/540: fdatasync de/f27 0 2023-10-18T20:58:32.875 INFO:tasks.workunit.client.1.smithi060.stdout:7/541: write de/d29/d72/f85 [1695469,76823] 0 2023-10-18T20:58:32.876 INFO:tasks.workunit.client.1.smithi060.stdout:7/542: dread - de/d14/d3a/d46/d73/faa zero size 2023-10-18T20:58:32.879 INFO:tasks.workunit.client.0.smithi008.stdout:3/413: dwrite d0/d4a/f5b [0,4194304] 0 2023-10-18T20:58:32.885 INFO:tasks.workunit.client.0.smithi008.stdout:5/480: dwrite d0/d2/d19/d7c/d42/f4e [4194304,4194304] 0 2023-10-18T20:58:32.886 INFO:tasks.workunit.client.0.smithi008.stdout:5/481: write d0/d2/d19/d7c/d31/d3f/f5f [1059625,34584] 0 2023-10-18T20:58:32.887 INFO:tasks.workunit.client.0.smithi008.stdout:5/482: chown d0/d2/d9 65121309 1 2023-10-18T20:58:32.887 INFO:tasks.workunit.client.1.smithi060.stdout:9/425: dwrite d3/d99/d1c/d25/f4b [0,4194304] 0 2023-10-18T20:58:32.891 INFO:tasks.workunit.client.0.smithi008.stdout:9/442: dwrite d2/dc/f22 [4194304,4194304] 0 2023-10-18T20:58:32.891 INFO:tasks.workunit.client.0.smithi008.stdout:9/443: chown d2/dc/d1a/d1d/f44 33 1 2023-10-18T20:58:32.893 INFO:tasks.workunit.client.0.smithi008.stdout:4/437: rmdir d0/d3/d21/d84 0 2023-10-18T20:58:32.893 INFO:tasks.workunit.client.0.smithi008.stdout:9/444: write d2/dc/d40/f5c [562359,63860] 0 2023-10-18T20:58:32.894 INFO:tasks.workunit.client.0.smithi008.stdout:1/580: dwrite d9/de/df/d17/d1e/d3c/f7e [0,4194304] 0 2023-10-18T20:58:32.895 INFO:tasks.workunit.client.0.smithi008.stdout:7/528: creat d1/d36/d3d/da3/fa9 x:0 0 0 2023-10-18T20:58:32.897 INFO:tasks.workunit.client.1.smithi060.stdout:6/512: rename d10/f35 to d10/d47/d92/f9d 0 2023-10-18T20:58:32.900 INFO:tasks.workunit.client.0.smithi008.stdout:4/438: dread d0/f14 [4194304,4194304] 0 2023-10-18T20:58:32.900 INFO:tasks.workunit.client.1.smithi060.stdout:1/592: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/daa/fc1 x:0 0 0 2023-10-18T20:58:32.901 INFO:tasks.workunit.client.0.smithi008.stdout:2/492: mkdir d1/d3/dd/d1c/d3a/d49/da3 0 2023-10-18T20:58:32.903 INFO:tasks.workunit.client.0.smithi008.stdout:8/599: truncate d5/d8/df/d9d/d4d/dba/dd4/d50/f6a 668460 0 2023-10-18T20:58:32.903 INFO:tasks.workunit.client.0.smithi008.stdout:8/600: chown d5/d8/df/d2e/l3c 23572680 1 2023-10-18T20:58:32.903 INFO:tasks.workunit.client.0.smithi008.stdout:8/601: chown d5/d8/df/d9d/d4d/f6d 9 1 2023-10-18T20:58:32.903 INFO:tasks.workunit.client.0.smithi008.stdout:8/602: fdatasync d5/d8/df/d9d/d6c/f7f 0 2023-10-18T20:58:32.904 INFO:tasks.workunit.client.0.smithi008.stdout:8/603: truncate d5/d8/df/d9d/d85/db1/fc2 1932731 0 2023-10-18T20:58:32.904 INFO:tasks.workunit.client.0.smithi008.stdout:7/529: dread d1/d3/f1d [4194304,4194304] 0 2023-10-18T20:58:32.904 INFO:tasks.workunit.client.1.smithi060.stdout:0/515: mknod d3/d8/d14/d55/d74/d76/d68/d98/c9f 0 2023-10-18T20:58:32.905 INFO:tasks.workunit.client.1.smithi060.stdout:5/536: symlink d0/d6/d9/d82/d84/db2/d41/lc7 0 2023-10-18T20:58:32.906 INFO:tasks.workunit.client.0.smithi008.stdout:3/414: unlink d0/d3/d42/d52/f71 0 2023-10-18T20:58:32.906 INFO:tasks.workunit.client.0.smithi008.stdout:3/415: write d0/d4a/d64/f7c [455424,49994] 0 2023-10-18T20:58:32.923 INFO:tasks.workunit.client.1.smithi060.stdout:4/473: creat d4/dc/d2a/d13/f87 x:0 0 0 2023-10-18T20:58:32.924 INFO:tasks.workunit.client.1.smithi060.stdout:4/474: read - d4/d15/d2b/f86 zero size 2023-10-18T20:58:32.933 INFO:tasks.workunit.client.0.smithi008.stdout:8/604: dread d5/d8/df/d9d/d4d/dba/dd4/d77/f88 [0,4194304] 0 2023-10-18T20:58:32.946 INFO:tasks.workunit.client.1.smithi060.stdout:7/543: creat de/d14/d2f/d8f/faf x:0 0 0 2023-10-18T20:58:32.946 INFO:tasks.workunit.client.1.smithi060.stdout:7/544: fsync de/f19 0 2023-10-18T20:58:32.946 INFO:tasks.workunit.client.1.smithi060.stdout:4/475: write d4/dc/d2a/d13/d27/f67 [3120561,91203] 0 2023-10-18T20:58:32.961 INFO:tasks.workunit.client.1.smithi060.stdout:3/472: sync 2023-10-18T20:58:32.964 INFO:tasks.workunit.client.1.smithi060.stdout:6/513: dwrite d10/d17/d28/f26 [0,4194304] 0 2023-10-18T20:58:32.964 INFO:tasks.workunit.client.1.smithi060.stdout:6/514: creat d10/d2e/d75/d81/d8b/f9e x:0 0 0 2023-10-18T20:58:32.964 INFO:tasks.workunit.client.1.smithi060.stdout:6/515: write d10/d2e/d75/d81/d8b/f9b [888202,96267] 0 2023-10-18T20:58:32.964 INFO:tasks.workunit.client.1.smithi060.stdout:6/516: stat d10/d3e/d76/f86 0 2023-10-18T20:58:32.964 INFO:tasks.workunit.client.1.smithi060.stdout:6/517: dread - d10/d17/d2f/f8a zero size 2023-10-18T20:58:33.003 INFO:tasks.workunit.client.1.smithi060.stdout:9/426: mkdir d3/d99/d19/d54/da5 0 2023-10-18T20:58:33.011 INFO:tasks.workunit.client.1.smithi060.stdout:0/516: mkdir d3/d8/d14/d55/d74/da0 0 2023-10-18T20:58:33.011 INFO:tasks.workunit.client.1.smithi060.stdout:2/501: sync 2023-10-18T20:58:33.011 INFO:tasks.workunit.client.1.smithi060.stdout:7/545: creat de/d14/d3a/d46/fb0 x:0 0 0 2023-10-18T20:58:33.012 INFO:tasks.workunit.client.0.smithi008.stdout:3/416: dwrite d0/d3/de/d13/f28 [0,4194304] 0 2023-10-18T20:58:33.012 INFO:tasks.workunit.client.0.smithi008.stdout:1/581: truncate d9/f54 2811111 0 2023-10-18T20:58:33.012 INFO:tasks.workunit.client.0.smithi008.stdout:0/387: sync 2023-10-18T20:58:33.013 INFO:tasks.workunit.client.0.smithi008.stdout:4/439: creat d0/d17/d5b/d2a/f93 x:0 0 0 2023-10-18T20:58:33.013 INFO:tasks.workunit.client.0.smithi008.stdout:4/440: chown d0/d58/d8e 2 1 2023-10-18T20:58:33.013 INFO:tasks.workunit.client.0.smithi008.stdout:4/441: creat d0/d17/d5b/d2a/f94 x:0 0 0 2023-10-18T20:58:33.013 INFO:tasks.workunit.client.1.smithi060.stdout:4/476: rename d4/d15/f73 to d4/dc/d2a/d5b/f88 0 2023-10-18T20:58:33.014 INFO:tasks.workunit.client.0.smithi008.stdout:7/530: getdents d1/d36/d3d 0 2023-10-18T20:58:33.016 INFO:tasks.workunit.client.0.smithi008.stdout:3/417: dread d0/d3/f43 [0,4194304] 0 2023-10-18T20:58:33.018 INFO:tasks.workunit.client.1.smithi060.stdout:3/473: symlink d0/d5e/la2 0 2023-10-18T20:58:33.026 INFO:tasks.workunit.client.0.smithi008.stdout:8/605: mkdir d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0 0 2023-10-18T20:58:33.027 INFO:tasks.workunit.client.1.smithi060.stdout:6/518: mkdir d10/d9f 0 2023-10-18T20:58:33.027 INFO:tasks.workunit.client.1.smithi060.stdout:9/427: creat d3/d99/d19/d54/d8f/fa6 x:0 0 0 2023-10-18T20:58:33.028 INFO:tasks.workunit.client.0.smithi008.stdout:5/483: unlink d0/d2/d19/d7c/d58/d65/f59 0 2023-10-18T20:58:33.030 INFO:tasks.workunit.client.1.smithi060.stdout:0/517: mknod d3/d8/d14/d55/ca1 0 2023-10-18T20:58:33.030 INFO:tasks.workunit.client.1.smithi060.stdout:0/518: chown d3/d8/d14/d55/d74/d76/d68/f92 455611 1 2023-10-18T20:58:33.031 INFO:tasks.workunit.client.1.smithi060.stdout:5/537: mkdir d0/da/dc8 0 2023-10-18T20:58:33.031 INFO:tasks.workunit.client.0.smithi008.stdout:9/445: rmdir d2/dc/d1a/d1d 39 2023-10-18T20:58:33.035 INFO:tasks.workunit.client.1.smithi060.stdout:2/502: symlink d0/d16/d81/la0 0 2023-10-18T20:58:33.036 INFO:tasks.workunit.client.0.smithi008.stdout:1/582: creat d9/de/df/d17/d1e/d7d/fab x:0 0 0 2023-10-18T20:58:33.037 INFO:tasks.workunit.client.1.smithi060.stdout:7/546: mkdir de/d29/d9c/db1 0 2023-10-18T20:58:33.038 INFO:tasks.workunit.client.0.smithi008.stdout:0/388: truncate d0/dd/df/d2a/f2d 5494422 0 2023-10-18T20:58:33.039 INFO:tasks.workunit.client.1.smithi060.stdout:4/477: mkdir d4/dc/d2a/d2d/d69/d89 0 2023-10-18T20:58:33.041 INFO:tasks.workunit.client.1.smithi060.stdout:9/428: creat d3/d99/d1c/d5a/d5d/d56/fa7 x:0 0 0 2023-10-18T20:58:33.041 INFO:tasks.workunit.client.1.smithi060.stdout:9/429: truncate d3/d58/f95 47087 0 2023-10-18T20:58:33.042 INFO:tasks.workunit.client.0.smithi008.stdout:4/442: stat d0/d3/c4b 0 2023-10-18T20:58:33.043 INFO:tasks.workunit.client.0.smithi008.stdout:2/493: getdents d1/d3/dd/d25 0 2023-10-18T20:58:33.046 INFO:tasks.workunit.client.1.smithi060.stdout:0/519: rename d3/d8/d14/d55/f97 to d3/d8/d14/d55/d74/d76/fa2 0 2023-10-18T20:58:33.053 INFO:tasks.workunit.client.0.smithi008.stdout:7/531: symlink d1/d3/d20/laa 0 2023-10-18T20:58:33.059 INFO:tasks.workunit.client.0.smithi008.stdout:0/389: dread d0/dd/d19/d24/f3d [0,4194304] 0 2023-10-18T20:58:33.059 INFO:tasks.workunit.client.1.smithi060.stdout:2/503: mkdir d0/d16/d81/da1 0 2023-10-18T20:58:33.060 INFO:tasks.workunit.client.1.smithi060.stdout:2/504: stat d0/d43 0 2023-10-18T20:58:33.060 INFO:tasks.workunit.client.1.smithi060.stdout:1/593: rmdir d4/d38/d83 0 2023-10-18T20:58:33.060 INFO:tasks.workunit.client.1.smithi060.stdout:9/430: creat d3/d99/d1c/d2a/d80/fa8 x:0 0 0 2023-10-18T20:58:33.061 INFO:tasks.workunit.client.0.smithi008.stdout:5/484: creat d0/d86/fae x:0 0 0 2023-10-18T20:58:33.061 INFO:tasks.workunit.client.1.smithi060.stdout:0/520: read d3/d8/f2d [72289,16202] 0 2023-10-18T20:58:33.062 INFO:tasks.workunit.client.1.smithi060.stdout:5/538: rename d0/da/d3b/c80 to d0/da/dc8/cc9 0 2023-10-18T20:58:33.065 INFO:tasks.workunit.client.0.smithi008.stdout:1/583: creat d9/de/df/d17/d25/d57/fac x:0 0 0 2023-10-18T20:58:33.070 INFO:tasks.workunit.client.1.smithi060.stdout:2/505: creat d0/d3/d27/d4d/d5e/fa2 x:0 0 0 2023-10-18T20:58:33.070 INFO:tasks.workunit.client.0.smithi008.stdout:7/532: rename d1/d3/d20/d5f/d78/f86 to d1/d36/d3d/fab 0 2023-10-18T20:58:33.074 INFO:tasks.workunit.client.0.smithi008.stdout:2/494: dread d1/d3/f5f [0,4194304] 0 2023-10-18T20:58:33.080 INFO:tasks.workunit.client.0.smithi008.stdout:3/418: link d0/d3/c39 d0/d3/de/d13/d35/d51/c7f 0 2023-10-18T20:58:33.081 INFO:tasks.workunit.client.0.smithi008.stdout:0/390: mkdir d0/d7c/d7f 0 2023-10-18T20:58:33.083 INFO:tasks.workunit.client.0.smithi008.stdout:5/485: creat d0/d2/d19/d7c/d31/d3f/d70/da4/faf x:0 0 0 2023-10-18T20:58:33.085 INFO:tasks.workunit.client.1.smithi060.stdout:2/506: mknod d0/d45/d49/d6e/d79/ca3 0 2023-10-18T20:58:33.085 INFO:tasks.workunit.client.1.smithi060.stdout:2/507: chown d0/d3/d27/d4d/f7d 873697546 1 2023-10-18T20:58:33.085 INFO:tasks.workunit.client.1.smithi060.stdout:2/508: read - d0/d3/d27/d4d/d53/f77 zero size 2023-10-18T20:58:33.087 INFO:tasks.workunit.client.1.smithi060.stdout:5/539: dread d0/d6/d9/d82/d84/db2/f22 [0,4194304] 0 2023-10-18T20:58:33.087 INFO:tasks.workunit.client.1.smithi060.stdout:4/478: rename d4/dc/c26 to d4/dc/d2a/d39/d53/d76/c8a 0 2023-10-18T20:58:33.088 INFO:tasks.workunit.client.1.smithi060.stdout:4/479: fdatasync d4/dc/d2a/f1f 0 2023-10-18T20:58:33.088 INFO:tasks.workunit.client.0.smithi008.stdout:1/584: creat d9/de/df/d17/d1e/fad x:0 0 0 2023-10-18T20:58:33.088 INFO:tasks.workunit.client.0.smithi008.stdout:4/443: dread d0/f12 [0,4194304] 0 2023-10-18T20:58:33.089 INFO:tasks.workunit.client.0.smithi008.stdout:1/585: write d9/de/df/d17/d25/d94/faa [739202,94822] 0 2023-10-18T20:58:33.092 INFO:tasks.workunit.client.1.smithi060.stdout:0/521: getdents d3/d8/d14 0 2023-10-18T20:58:33.092 INFO:tasks.workunit.client.0.smithi008.stdout:7/533: creat d1/d36/fac x:0 0 0 2023-10-18T20:58:33.094 INFO:tasks.workunit.client.1.smithi060.stdout:2/509: symlink d0/d3/d27/d7b/la4 0 2023-10-18T20:58:33.097 INFO:tasks.workunit.client.1.smithi060.stdout:3/474: dwrite d0/d22/d26/d2b/f77 [0,4194304] 0 2023-10-18T20:58:33.098 INFO:tasks.workunit.client.1.smithi060.stdout:6/519: dwrite d10/d6f/f98 [0,4194304] 0 2023-10-18T20:58:33.098 INFO:tasks.workunit.client.1.smithi060.stdout:6/520: fsync d10/d3e/f71 0 2023-10-18T20:58:33.098 INFO:tasks.workunit.client.1.smithi060.stdout:6/521: creat d10/d17/d2f/fa0 x:0 0 0 2023-10-18T20:58:33.099 INFO:tasks.workunit.client.0.smithi008.stdout:6/520: sync 2023-10-18T20:58:33.099 INFO:tasks.workunit.client.0.smithi008.stdout:6/521: dread - df/d18/d3f/f9a zero size 2023-10-18T20:58:33.100 INFO:tasks.workunit.client.0.smithi008.stdout:6/522: fdatasync df/d15/d48/d81/f95 0 2023-10-18T20:58:33.100 INFO:tasks.workunit.client.1.smithi060.stdout:7/547: dwrite de/d29/f77 [0,4194304] 0 2023-10-18T20:58:33.100 INFO:tasks.workunit.client.1.smithi060.stdout:4/480: symlink d4/d15/l8b 0 2023-10-18T20:58:33.102 INFO:tasks.workunit.client.0.smithi008.stdout:2/495: dread d1/d3/dd/d25/d4d/f68 [0,4194304] 0 2023-10-18T20:58:33.103 INFO:tasks.workunit.client.0.smithi008.stdout:5/486: symlink d0/d2/d19/d7c/d42/lb0 0 2023-10-18T20:58:33.105 INFO:tasks.workunit.client.0.smithi008.stdout:5/487: creat d0/d2/d19/d7c/d58/d65/d68/fb1 x:0 0 0 2023-10-18T20:58:33.105 INFO:tasks.workunit.client.1.smithi060.stdout:5/540: rename d0/d6/d8/df/d27/d32/d4f/c62 to d0/da/d79/cca 0 2023-10-18T20:58:33.105 INFO:tasks.workunit.client.1.smithi060.stdout:5/541: write d0/dd/f88 [827932,130637] 0 2023-10-18T20:58:33.106 INFO:tasks.workunit.client.1.smithi060.stdout:5/542: chown d0/da/d79/da5/f3e 1 1 2023-10-18T20:58:33.106 INFO:tasks.workunit.client.1.smithi060.stdout:5/543: fsync d0/da/d3b/fc6 0 2023-10-18T20:58:33.108 INFO:tasks.workunit.client.1.smithi060.stdout:0/522: symlink d3/d8/d14/d55/d74/d76/la3 0 2023-10-18T20:58:33.109 INFO:tasks.workunit.client.0.smithi008.stdout:4/444: unlink d0/d3/d21/l22 0 2023-10-18T20:58:33.110 INFO:tasks.workunit.client.0.smithi008.stdout:0/391: dread d0/dd/d19/d5f/f60 [0,4194304] 0 2023-10-18T20:58:33.112 INFO:tasks.workunit.client.0.smithi008.stdout:1/586: creat d9/de/df/d17/d55/da8/fae x:0 0 0 2023-10-18T20:58:33.112 INFO:tasks.workunit.client.0.smithi008.stdout:7/534: creat d1/d36/d3d/d3e/d59/d73/d7b/fad x:0 0 0 2023-10-18T20:58:33.118 INFO:tasks.workunit.client.1.smithi060.stdout:4/481: write d4/dc/d2a/d13/d27/d68/f6d [3969871,19225] 0 2023-10-18T20:58:33.118 INFO:tasks.workunit.client.0.smithi008.stdout:8/606: dwrite d5/f4b [0,4194304] 0 2023-10-18T20:58:33.118 INFO:tasks.workunit.client.0.smithi008.stdout:6/523: read df/d3c/f67 [1191575,41139] 0 2023-10-18T20:58:33.119 INFO:tasks.workunit.client.0.smithi008.stdout:6/524: dread - df/d15/d27/d4c/f73 zero size 2023-10-18T20:58:33.119 INFO:tasks.workunit.client.1.smithi060.stdout:8/484: sync 2023-10-18T20:58:33.119 INFO:tasks.workunit.client.1.smithi060.stdout:8/485: chown d4/d9/d37/f3d 33729 1 2023-10-18T20:58:33.120 INFO:tasks.workunit.client.0.smithi008.stdout:8/607: write d5/d8/df/d9d/d4d/f7c [167237,90853] 0 2023-10-18T20:58:33.123 INFO:tasks.workunit.client.0.smithi008.stdout:2/496: rename d1/d3/dd/d1c/d3a/l44 to d1/d3/dd/d48/la4 0 2023-10-18T20:58:33.127 INFO:tasks.workunit.client.0.smithi008.stdout:1/587: dread d9/de/f15 [0,4194304] 0 2023-10-18T20:58:33.127 INFO:tasks.workunit.client.0.smithi008.stdout:7/535: write d1/da6/d79/f6a [1506622,2159] 0 2023-10-18T20:58:33.129 INFO:tasks.workunit.client.0.smithi008.stdout:0/392: dread d0/dd/d19/d5f/f60 [0,4194304] 0 2023-10-18T20:58:33.130 INFO:tasks.workunit.client.0.smithi008.stdout:5/488: symlink d0/d2/d9/daa/lb2 0 2023-10-18T20:58:33.130 INFO:tasks.workunit.client.0.smithi008.stdout:0/393: chown d0/f14 40494534 1 2023-10-18T20:58:33.130 INFO:tasks.workunit.client.0.smithi008.stdout:0/394: chown d0/d3a/f5c 343 1 2023-10-18T20:58:33.130 INFO:tasks.workunit.client.0.smithi008.stdout:0/395: fsync d0/dd/f18 0 2023-10-18T20:58:33.130 INFO:tasks.workunit.client.0.smithi008.stdout:5/489: creat d0/d2/d19/d7c/d31/d3f/d70/da4/fb3 x:0 0 0 2023-10-18T20:58:33.131 INFO:tasks.workunit.client.0.smithi008.stdout:0/396: creat d0/dd/df/d2a/f80 x:0 0 0 2023-10-18T20:58:33.131 INFO:tasks.workunit.client.0.smithi008.stdout:0/397: truncate d0/f51 18591 0 2023-10-18T20:58:33.133 INFO:tasks.workunit.client.1.smithi060.stdout:6/522: symlink d10/d2e/d75/d81/la1 0 2023-10-18T20:58:33.135 INFO:tasks.workunit.client.1.smithi060.stdout:3/475: write d0/f18 [1408910,52178] 0 2023-10-18T20:58:33.136 INFO:tasks.workunit.client.0.smithi008.stdout:8/608: fdatasync d5/d8/df/d9d/d4d/f7c 0 2023-10-18T20:58:33.136 INFO:tasks.workunit.client.0.smithi008.stdout:1/588: creat d9/de/df/d77/faf x:0 0 0 2023-10-18T20:58:33.137 INFO:tasks.workunit.client.1.smithi060.stdout:1/594: dwrite d4/d6/d7/d2f/d7b/fb9 [0,4194304] 0 2023-10-18T20:58:33.138 INFO:tasks.workunit.client.1.smithi060.stdout:1/595: dread - d4/d6/d7/d2f/d7b/d2a/d32/fb1 zero size 2023-10-18T20:58:33.138 INFO:tasks.workunit.client.1.smithi060.stdout:7/548: symlink de/d14/lb2 0 2023-10-18T20:58:33.139 INFO:tasks.workunit.client.0.smithi008.stdout:7/536: getdents d1/da6/d4f/d5c 0 2023-10-18T20:58:33.139 INFO:tasks.workunit.client.1.smithi060.stdout:5/544: creat d0/da/d79/da5/fcb x:0 0 0 2023-10-18T20:58:33.141 INFO:tasks.workunit.client.1.smithi060.stdout:2/510: rename d0/d3/d27/d4d/d53/c9d to d0/d3/d27/d7b/ca5 0 2023-10-18T20:58:33.143 INFO:tasks.workunit.client.1.smithi060.stdout:9/431: dwrite d3/d99/d19/d54/f42 [0,4194304] 0 2023-10-18T20:58:33.149 INFO:tasks.workunit.client.0.smithi008.stdout:0/398: write d0/d3a/f5c [291328,120485] 0 2023-10-18T20:58:33.150 INFO:tasks.workunit.client.0.smithi008.stdout:3/419: dwrite d0/d4a/f5b [4194304,4194304] 0 2023-10-18T20:58:33.153 INFO:tasks.workunit.client.0.smithi008.stdout:9/446: dwrite d2/dc/d17/d19/fe [0,4194304] 0 2023-10-18T20:58:33.159 INFO:tasks.workunit.client.0.smithi008.stdout:4/445: write d0/f13 [557702,8261] 0 2023-10-18T20:58:33.164 INFO:tasks.workunit.client.1.smithi060.stdout:4/482: truncate d4/dc/d2a/d13/f3f 2937223 0 2023-10-18T20:58:33.164 INFO:tasks.workunit.client.1.smithi060.stdout:4/483: creat d4/dc/d2a/d39/f8c x:0 0 0 2023-10-18T20:58:33.165 INFO:tasks.workunit.client.1.smithi060.stdout:1/596: write d4/d6/d7/d2f/d7b/d2a/f45 [3263580,121934] 0 2023-10-18T20:58:33.165 INFO:tasks.workunit.client.1.smithi060.stdout:1/597: fsync d4/da/d42/f4a 0 2023-10-18T20:58:33.165 INFO:tasks.workunit.client.1.smithi060.stdout:1/598: creat d4/d6/d33/d58/fc2 x:0 0 0 2023-10-18T20:58:33.166 INFO:tasks.workunit.client.1.smithi060.stdout:1/599: write d4/d6/d33/f7d [735655,75333] 0 2023-10-18T20:58:33.176 INFO:tasks.workunit.client.0.smithi008.stdout:5/490: mkdir d0/d2/d19/d7c/d42/d5a/db4 0 2023-10-18T20:58:33.176 INFO:tasks.workunit.client.0.smithi008.stdout:2/497: rmdir d1/d3/d79 39 2023-10-18T20:58:33.177 INFO:tasks.workunit.client.0.smithi008.stdout:8/609: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/fe1 x:0 0 0 2023-10-18T20:58:33.177 INFO:tasks.workunit.client.0.smithi008.stdout:8/610: dread - d5/d8/df/d9d/d4d/db5/faf zero size 2023-10-18T20:58:33.177 INFO:tasks.workunit.client.1.smithi060.stdout:6/523: rmdir d10/d47/d92 39 2023-10-18T20:58:33.178 INFO:tasks.workunit.client.1.smithi060.stdout:8/486: truncate d4/d9/f2e 1524913 0 2023-10-18T20:58:33.179 INFO:tasks.workunit.client.1.smithi060.stdout:3/476: creat d0/d22/d26/fa3 x:0 0 0 2023-10-18T20:58:33.185 INFO:tasks.workunit.client.0.smithi008.stdout:1/589: creat d9/de/fb0 x:0 0 0 2023-10-18T20:58:33.189 INFO:tasks.workunit.client.0.smithi008.stdout:0/399: creat d0/d7c/f81 x:0 0 0 2023-10-18T20:58:33.189 INFO:tasks.workunit.client.0.smithi008.stdout:0/400: write d0/dd/d19/d41/f65 [797675,43033] 0 2023-10-18T20:58:33.189 INFO:tasks.workunit.client.0.smithi008.stdout:0/401: chown d0/dd/df/d20/l6d 1325674 1 2023-10-18T20:58:33.190 INFO:tasks.workunit.client.0.smithi008.stdout:0/402: truncate d0/f51 971651 0 2023-10-18T20:58:33.190 INFO:tasks.workunit.client.0.smithi008.stdout:0/403: write d0/dd/df/f1c [1476620,9302] 0 2023-10-18T20:58:33.192 INFO:tasks.workunit.client.0.smithi008.stdout:6/525: dwrite df/d18/d3f/f7b [0,4194304] 0 2023-10-18T20:58:33.192 INFO:tasks.workunit.client.0.smithi008.stdout:6/526: creat df/d3c/d77/fb3 x:0 0 0 2023-10-18T20:58:33.196 INFO:tasks.workunit.client.1.smithi060.stdout:9/432: dwrite d3/d99/d19/d54/f4a [4194304,4194304] 0 2023-10-18T20:58:33.197 INFO:tasks.workunit.client.1.smithi060.stdout:9/433: truncate d3/d99/d1c/d5a/d5d/d7d/f7f 785556 0 2023-10-18T20:58:33.197 INFO:tasks.workunit.client.1.smithi060.stdout:9/434: truncate d3/d99/d1c/d5a/d5d/f75 436477 0 2023-10-18T20:58:33.198 INFO:tasks.workunit.client.0.smithi008.stdout:9/447: creat d2/dc/d40/d6f/f80 x:0 0 0 2023-10-18T20:58:33.198 INFO:tasks.workunit.client.0.smithi008.stdout:9/448: dread - d2/dc/f6d zero size 2023-10-18T20:58:33.199 INFO:tasks.workunit.client.0.smithi008.stdout:3/420: mkdir d0/d4a/d64/d80 0 2023-10-18T20:58:33.199 INFO:tasks.workunit.client.0.smithi008.stdout:9/449: stat d2/dc/d17/c2a 0 2023-10-18T20:58:33.199 INFO:tasks.workunit.client.0.smithi008.stdout:9/450: chown d2/dc/d1a/f5b 42918132 1 2023-10-18T20:58:33.199 INFO:tasks.workunit.client.0.smithi008.stdout:9/451: creat d2/dc/d17/d19/d4a/f81 x:0 0 0 2023-10-18T20:58:33.199 INFO:tasks.workunit.client.0.smithi008.stdout:9/452: fdatasync d2/f1b 0 2023-10-18T20:58:33.199 INFO:tasks.workunit.client.0.smithi008.stdout:9/453: getdents d2/dc/d17/d7b 0 2023-10-18T20:58:33.200 INFO:tasks.workunit.client.0.smithi008.stdout:4/446: mkdir d0/d3/d21/d57/d8f/d95 0 2023-10-18T20:58:33.200 INFO:tasks.workunit.client.0.smithi008.stdout:4/447: truncate d0/d3/d21/f51 1336061 0 2023-10-18T20:58:33.201 INFO:tasks.workunit.client.1.smithi060.stdout:5/545: creat d0/d47/d7d/fcc x:0 0 0 2023-10-18T20:58:33.201 INFO:tasks.workunit.client.1.smithi060.stdout:5/546: rename d0/d6/d8 to d0/d6/d8/dcd 22 2023-10-18T20:58:33.201 INFO:tasks.workunit.client.1.smithi060.stdout:0/523: getdents d3 0 2023-10-18T20:58:33.202 INFO:tasks.workunit.client.1.smithi060.stdout:7/549: mknod de/d14/d49/d68/d88/cb3 0 2023-10-18T20:58:33.202 INFO:tasks.workunit.client.1.smithi060.stdout:3/477: dread d0/d22/f69 [0,4194304] 0 2023-10-18T20:58:33.202 INFO:tasks.workunit.client.1.smithi060.stdout:7/550: fdatasync de/d14/d2f/f3c 0 2023-10-18T20:58:33.202 INFO:tasks.workunit.client.1.smithi060.stdout:7/551: creat de/d14/d49/fb4 x:0 0 0 2023-10-18T20:58:33.202 INFO:tasks.workunit.client.1.smithi060.stdout:7/552: chown de/d14/d3a/d46/d73/f82 0 1 2023-10-18T20:58:33.203 INFO:tasks.workunit.client.1.smithi060.stdout:7/553: write de/d14/d49/d68/f2a [4698958,63756] 0 2023-10-18T20:58:33.203 INFO:tasks.workunit.client.0.smithi008.stdout:5/491: mknod d0/d2/d19/d7c/d58/cb5 0 2023-10-18T20:58:33.209 INFO:tasks.workunit.client.0.smithi008.stdout:2/498: symlink d1/d3/la5 0 2023-10-18T20:58:33.210 INFO:tasks.workunit.client.0.smithi008.stdout:2/499: creat d1/d3/dd/d25/d76/d59/fa6 x:0 0 0 2023-10-18T20:58:33.210 INFO:tasks.workunit.client.0.smithi008.stdout:2/500: truncate d1/d3/d40/d6e/f78 879324 0 2023-10-18T20:58:33.214 INFO:tasks.workunit.client.0.smithi008.stdout:6/527: dread df/d15/d48/d4b/f4f [0,4194304] 0 2023-10-18T20:58:33.215 INFO:tasks.workunit.client.1.smithi060.stdout:5/547: dread d0/da/d79/da5/f3e [0,4194304] 0 2023-10-18T20:58:33.217 INFO:tasks.workunit.client.1.smithi060.stdout:2/511: dwrite d0/d3/d27/f4c [0,4194304] 0 2023-10-18T20:58:33.218 INFO:tasks.workunit.client.0.smithi008.stdout:8/611: rename d5/d8/df/d2e/l4c to d5/d8/df/d9d/d4d/dba/dd4/le2 0 2023-10-18T20:58:33.220 INFO:tasks.workunit.client.0.smithi008.stdout:8/612: read d5/d8/df/d9d/d4d/f7c [46420,35113] 0 2023-10-18T20:58:33.220 INFO:tasks.workunit.client.0.smithi008.stdout:5/492: dread d0/d2/d19/d7c/d31/d3f/d70/f8b [0,4194304] 0 2023-10-18T20:58:33.220 INFO:tasks.workunit.client.0.smithi008.stdout:5/493: dread - d0/d2/d19/d7c/d58/d65/d68/fb1 zero size 2023-10-18T20:58:33.221 INFO:tasks.workunit.client.0.smithi008.stdout:0/404: symlink d0/dd/df/d2a/d5e/d7d/l82 0 2023-10-18T20:58:33.222 INFO:tasks.workunit.client.0.smithi008.stdout:0/405: unlink d0/dd/d19/f76 0 2023-10-18T20:58:33.223 INFO:tasks.workunit.client.1.smithi060.stdout:1/600: creat d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/fc3 x:0 0 0 2023-10-18T20:58:33.226 INFO:tasks.workunit.client.1.smithi060.stdout:8/487: symlink d4/d9/d31/d35/l97 0 2023-10-18T20:58:33.226 INFO:tasks.workunit.client.1.smithi060.stdout:9/435: symlink d3/d99/d19/d54/da5/la9 0 2023-10-18T20:58:33.226 INFO:tasks.workunit.client.1.smithi060.stdout:8/488: chown d4/d9/d4f/d74/d81/c8d 54 1 2023-10-18T20:58:33.228 INFO:tasks.workunit.client.1.smithi060.stdout:3/478: link d0/d3c/c8a d0/d22/d50/ca4 0 2023-10-18T20:58:33.232 INFO:tasks.workunit.client.0.smithi008.stdout:3/421: mknod d0/d3/de/d13/c81 0 2023-10-18T20:58:33.236 INFO:tasks.workunit.client.0.smithi008.stdout:4/448: unlink d0/d3/c36 0 2023-10-18T20:58:33.237 INFO:tasks.workunit.client.0.smithi008.stdout:4/449: dread - d0/d17/d5b/d2a/f94 zero size 2023-10-18T20:58:33.237 INFO:tasks.workunit.client.0.smithi008.stdout:4/450: chown d0/d17/d5b/d2a/l3f 3 1 2023-10-18T20:58:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:32.112644+0000 mgr.smithi008.flmjzp (mgr.14640) 3 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail 2023-10-18T20:58:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:32.143599+0000 mon.smithi008 (mon.0) 649 : cluster [DBG] mgrmap e27: smithi008.flmjzp(active, since 3s), standbys: smithi060.pgqqwa 2023-10-18T20:58:33.239 INFO:tasks.workunit.client.1.smithi060.stdout:1/601: creat d4/da/d42/fc4 x:0 0 0 2023-10-18T20:58:33.240 INFO:tasks.workunit.client.0.smithi008.stdout:2/501: getdents d1/d3/d79 0 2023-10-18T20:58:33.242 INFO:tasks.workunit.client.1.smithi060.stdout:9/436: unlink d3/d99/d19/d54/l59 0 2023-10-18T20:58:33.243 INFO:tasks.workunit.client.1.smithi060.stdout:9/437: write d3/f50 [47076,112787] 0 2023-10-18T20:58:33.243 INFO:tasks.workunit.client.1.smithi060.stdout:9/438: fdatasync d3/d58/f95 0 2023-10-18T20:58:33.243 INFO:tasks.workunit.client.0.smithi008.stdout:6/528: getdents df/d3c/d77/d50 0 2023-10-18T20:58:33.243 INFO:tasks.workunit.client.0.smithi008.stdout:7/537: dwrite d1/da6/d4f/f5e [0,4194304] 0 2023-10-18T20:58:33.247 INFO:tasks.workunit.client.1.smithi060.stdout:8/489: symlink d4/d9/d37/d4e/d5e/l98 0 2023-10-18T20:58:33.247 INFO:tasks.workunit.client.0.smithi008.stdout:3/422: dread d0/d4a/d64/f6e [0,4194304] 0 2023-10-18T20:58:33.249 INFO:tasks.workunit.client.0.smithi008.stdout:1/590: getdents d9/de 0 2023-10-18T20:58:33.251 INFO:tasks.workunit.client.0.smithi008.stdout:8/613: link d5/d8/df/d9d/d4d/dba/dd4/d50/c65 d5/d8/df/d9d/d85/db1/ce3 0 2023-10-18T20:58:33.252 INFO:tasks.workunit.client.0.smithi008.stdout:8/614: readlink d5/d8/df/d9d/d4d/dba/dd4/l9e 0 2023-10-18T20:58:33.262 INFO:tasks.workunit.client.1.smithi060.stdout:2/512: rmdir d0/d8/d47 39 2023-10-18T20:58:33.266 INFO:tasks.workunit.client.1.smithi060.stdout:9/439: creat d3/d99/faa x:0 0 0 2023-10-18T20:58:33.266 INFO:tasks.workunit.client.1.smithi060.stdout:9/440: getdents d3/d99/d1c/d5a/d5d/d7d 0 2023-10-18T20:58:33.267 INFO:tasks.workunit.client.1.smithi060.stdout:6/524: dwrite d10/d17/d28/f24 [4194304,4194304] 0 2023-10-18T20:58:33.267 INFO:tasks.workunit.client.1.smithi060.stdout:3/479: rmdir d0/d22/d26/d79 39 2023-10-18T20:58:33.268 INFO:tasks.workunit.client.1.smithi060.stdout:3/480: write d0/f20 [1222899,120350] 0 2023-10-18T20:58:33.268 INFO:tasks.workunit.client.1.smithi060.stdout:3/481: stat d0/d22/d26/d29/f9e 0 2023-10-18T20:58:33.268 INFO:tasks.workunit.client.1.smithi060.stdout:3/482: chown d0/d22/d26/d2c 389 1 2023-10-18T20:58:33.269 INFO:tasks.workunit.client.0.smithi008.stdout:5/494: creat d0/d2/d19/d7c/d64/fb6 x:0 0 0 2023-10-18T20:58:33.272 INFO:tasks.workunit.client.1.smithi060.stdout:9/441: link d3/d99/l3f d3/d99/d9f/lab 0 2023-10-18T20:58:33.280 INFO:tasks.workunit.client.1.smithi060.stdout:4/484: dwrite d4/dc/d2a/d13/d27/f67 [0,4194304] 0 2023-10-18T20:58:33.285 INFO:tasks.workunit.client.1.smithi060.stdout:7/554: dwrite de/d14/d49/d68/f24 [0,4194304] 0 2023-10-18T20:58:33.286 INFO:tasks.workunit.client.1.smithi060.stdout:7/555: dread - de/d14/d2f/d8f/faf zero size 2023-10-18T20:58:33.286 INFO:tasks.workunit.client.1.smithi060.stdout:7/556: write fa [1714339,16674] 0 2023-10-18T20:58:33.286 INFO:tasks.workunit.client.1.smithi060.stdout:7/557: readlink l4 0 2023-10-18T20:58:33.286 INFO:tasks.workunit.client.1.smithi060.stdout:7/558: fdatasync de/d14/d2f/f3c 0 2023-10-18T20:58:33.287 INFO:tasks.workunit.client.1.smithi060.stdout:3/483: mknod d0/d22/d26/d2c/da0/ca5 0 2023-10-18T20:58:33.292 INFO:tasks.workunit.client.0.smithi008.stdout:0/406: creat d0/dd/d19/d5f/f83 x:0 0 0 2023-10-18T20:58:33.292 INFO:tasks.workunit.client.0.smithi008.stdout:0/407: truncate d0/dd/df/d20/f77 280819 0 2023-10-18T20:58:33.292 INFO:tasks.workunit.client.0.smithi008.stdout:9/454: rmdir d2/dc/d40/d46 39 2023-10-18T20:58:33.292 INFO:tasks.workunit.client.0.smithi008.stdout:9/455: readlink d2/dc/l2c 0 2023-10-18T20:58:33.293 INFO:tasks.workunit.client.0.smithi008.stdout:9/456: chown d2/dc/d17/l45 102988 1 2023-10-18T20:58:33.293 INFO:tasks.workunit.client.0.smithi008.stdout:9/457: dread - d2/dc/d17/d19/d4a/f68 zero size 2023-10-18T20:58:33.293 INFO:tasks.workunit.client.0.smithi008.stdout:1/591: rmdir d9 39 2023-10-18T20:58:33.296 INFO:tasks.workunit.client.0.smithi008.stdout:7/538: rmdir d1/d3/d20 39 2023-10-18T20:58:33.297 INFO:tasks.workunit.client.0.smithi008.stdout:6/529: creat df/d3c/da2/fb4 x:0 0 0 2023-10-18T20:58:33.297 INFO:tasks.workunit.client.0.smithi008.stdout:8/615: write d5/f4b [5749025,130925] 0 2023-10-18T20:58:33.298 INFO:tasks.workunit.client.0.smithi008.stdout:4/451: creat d0/d76/f96 x:0 0 0 2023-10-18T20:58:33.299 INFO:tasks.workunit.client.1.smithi060.stdout:5/548: dread d0/d6/d8/df/d27/d32/d4f/f68 [0,4194304] 0 2023-10-18T20:58:33.299 INFO:tasks.workunit.client.1.smithi060.stdout:9/442: creat d3/d99/d9f/fac x:0 0 0 2023-10-18T20:58:33.299 INFO:tasks.workunit.client.1.smithi060.stdout:2/513: rmdir d0/d16 39 2023-10-18T20:58:33.299 INFO:tasks.workunit.client.1.smithi060.stdout:2/514: chown d0/d45/d49/d6e/d79/ca3 45666914 1 2023-10-18T20:58:33.303 INFO:tasks.workunit.client.0.smithi008.stdout:7/539: mkdir d1/d36/d3d/da3/dae 0 2023-10-18T20:58:33.303 INFO:tasks.workunit.client.0.smithi008.stdout:7/540: chown d1/d3/c1c 106785630 1 2023-10-18T20:58:33.307 INFO:tasks.workunit.client.1.smithi060.stdout:8/490: write d4/d9/d31/f8e [252497,44533] 0 2023-10-18T20:58:33.308 INFO:tasks.workunit.client.1.smithi060.stdout:8/491: creat d4/d9/d37/d4e/d5e/f99 x:0 0 0 2023-10-18T20:58:33.308 INFO:tasks.workunit.client.1.smithi060.stdout:8/492: fdatasync d4/d9/d4f/f63 0 2023-10-18T20:58:33.309 INFO:tasks.workunit.client.0.smithi008.stdout:8/616: mknod d5/d8/df/d9d/d85/db1/dcc/ce4 0 2023-10-18T20:58:33.311 INFO:tasks.workunit.client.0.smithi008.stdout:5/495: dread d0/d2/d9/d34/f5c [0,4194304] 0 2023-10-18T20:58:33.311 INFO:tasks.workunit.client.0.smithi008.stdout:5/496: fsync d0/d2/fa2 0 2023-10-18T20:58:33.312 INFO:tasks.workunit.client.0.smithi008.stdout:5/497: chown d0/d2/d19/d7c/d58/f72 1780542 1 2023-10-18T20:58:33.312 INFO:tasks.workunit.client.1.smithi060.stdout:1/602: dwrite d4/d6/d33/f71 [0,4194304] 0 2023-10-18T20:58:33.313 INFO:tasks.workunit.client.1.smithi060.stdout:0/524: dwrite d3/d8/d14/f3e [0,4194304] 0 2023-10-18T20:58:33.314 INFO:tasks.workunit.client.1.smithi060.stdout:0/525: write d3/d8/d14/f5f [385911,72992] 0 2023-10-18T20:58:33.314 INFO:tasks.workunit.client.0.smithi008.stdout:6/530: write df/d19/f4d [676464,115199] 0 2023-10-18T20:58:33.315 INFO:tasks.workunit.client.0.smithi008.stdout:6/531: chown df/d15/d27/f63 1067 1 2023-10-18T20:58:33.315 INFO:tasks.workunit.client.0.smithi008.stdout:6/532: fsync df/d3c/d77/da9/f5a 0 2023-10-18T20:58:33.315 INFO:tasks.workunit.client.0.smithi008.stdout:6/533: truncate df/d18/d68/f6e 290535 0 2023-10-18T20:58:33.315 INFO:tasks.workunit.client.0.smithi008.stdout:6/534: creat df/d15/d27/fb5 x:0 0 0 2023-10-18T20:58:33.315 INFO:tasks.workunit.client.0.smithi008.stdout:6/535: readlink df/d19/l6a 0 2023-10-18T20:58:33.316 INFO:tasks.workunit.client.1.smithi060.stdout:7/559: mkdir de/d14/d49/d68/d7d/d7e/db5 0 2023-10-18T20:58:33.316 INFO:tasks.workunit.client.1.smithi060.stdout:7/560: creat de/d14/d3a/fb6 x:0 0 0 2023-10-18T20:58:33.320 INFO:tasks.workunit.client.1.smithi060.stdout:5/549: write d0/d6/d8/df/d27/fbf [51886,35751] 0 2023-10-18T20:58:33.325 INFO:tasks.workunit.client.0.smithi008.stdout:0/408: dread d0/d7c/f39 [0,4194304] 0 2023-10-18T20:58:33.325 INFO:tasks.workunit.client.0.smithi008.stdout:3/423: dwrite d0/f59 [4194304,4194304] 0 2023-10-18T20:58:33.325 INFO:tasks.workunit.client.0.smithi008.stdout:3/424: dread - d0/d3/d37/f61 zero size 2023-10-18T20:58:33.326 INFO:tasks.workunit.client.0.smithi008.stdout:3/425: fdatasync d0/f54 0 2023-10-18T20:58:33.329 INFO:tasks.workunit.client.1.smithi060.stdout:6/525: getdents d10/d25 0 2023-10-18T20:58:33.329 INFO:tasks.workunit.client.1.smithi060.stdout:6/526: readlink d10/d25/l3d 0 2023-10-18T20:58:33.329 INFO:tasks.workunit.client.1.smithi060.stdout:6/527: fdatasync d10/d47/d92/f9d 0 2023-10-18T20:58:33.329 INFO:tasks.workunit.client.1.smithi060.stdout:6/528: write d10/d25/d3c/f62 [1772233,112524] 0 2023-10-18T20:58:33.329 INFO:tasks.workunit.client.1.smithi060.stdout:6/529: creat d10/d2e/d75/d77/d8c/fa2 x:0 0 0 2023-10-18T20:58:33.330 INFO:tasks.workunit.client.1.smithi060.stdout:6/530: chown d10/d17/d2f/fa0 18 1 2023-10-18T20:58:33.330 INFO:tasks.workunit.client.1.smithi060.stdout:6/531: chown d10/d47/d92/d79/l9a 0 1 2023-10-18T20:58:33.337 INFO:tasks.workunit.client.1.smithi060.stdout:7/561: dread de/d14/d2f/d8f/d65/fa9 [0,4194304] 0 2023-10-18T20:58:33.337 INFO:tasks.workunit.client.1.smithi060.stdout:7/562: fsync de/d14/d41/f53 0 2023-10-18T20:58:33.337 INFO:tasks.workunit.client.1.smithi060.stdout:7/563: write de/d14/d3a/d46/fb0 [878681,4389] 0 2023-10-18T20:58:33.338 INFO:tasks.workunit.client.1.smithi060.stdout:1/603: dread d4/d6/d33/d58/f76 [0,4194304] 0 2023-10-18T20:58:33.338 INFO:tasks.workunit.client.1.smithi060.stdout:1/604: stat d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/ca1 0 2023-10-18T20:58:33.339 INFO:tasks.workunit.client.1.smithi060.stdout:1/605: fsync d4/d6/d7/d2f/d7b/d2a/d32/d56/f75 0 2023-10-18T20:58:33.341 INFO:tasks.workunit.client.1.smithi060.stdout:3/484: creat d0/d22/d26/d2c/fa6 x:0 0 0 2023-10-18T20:58:33.342 INFO:tasks.workunit.client.1.smithi060.stdout:8/493: write d4/f53 [3932540,24009] 0 2023-10-18T20:58:33.342 INFO:tasks.workunit.client.1.smithi060.stdout:8/494: readlink d4/l50 0 2023-10-18T20:58:33.342 INFO:tasks.workunit.client.1.smithi060.stdout:8/495: chown d4/d9/d37/d4e/d6e/f95 11 1 2023-10-18T20:58:33.342 INFO:tasks.workunit.client.1.smithi060.stdout:8/496: truncate d4/d9/d31/d6f/f8c 716462 0 2023-10-18T20:58:33.343 INFO:tasks.workunit.client.0.smithi008.stdout:7/541: mkdir d1/d36/d3d/d3e/d59/d73/d7b/daf 0 2023-10-18T20:58:33.343 INFO:tasks.workunit.client.0.smithi008.stdout:8/617: symlink d5/d8/le5 0 2023-10-18T20:58:33.343 INFO:tasks.workunit.client.0.smithi008.stdout:3/426: dread d0/f54 [0,4194304] 0 2023-10-18T20:58:33.359 INFO:tasks.workunit.client.0.smithi008.stdout:2/502: dwrite d1/d3/dd/d1c/f74 [8388608,4194304] 0 2023-10-18T20:58:33.359 INFO:tasks.workunit.client.0.smithi008.stdout:2/503: fsync d1/f1a 0 2023-10-18T20:58:33.364 INFO:tasks.workunit.client.1.smithi060.stdout:2/515: creat d0/d3/d27/d4d/d5e/d96/fa6 x:0 0 0 2023-10-18T20:58:33.364 INFO:tasks.workunit.client.1.smithi060.stdout:9/443: creat d3/d99/d1c/d5a/d5d/d7d/fad x:0 0 0 2023-10-18T20:58:33.370 INFO:tasks.workunit.client.1.smithi060.stdout:4/485: dwrite d4/dc/d2a/d13/d27/f67 [0,4194304] 0 2023-10-18T20:58:33.374 INFO:tasks.workunit.client.0.smithi008.stdout:6/536: creat df/fb6 x:0 0 0 2023-10-18T20:58:33.374 INFO:tasks.workunit.client.0.smithi008.stdout:6/537: write df/d18/d68/f6e [640326,37534] 0 2023-10-18T20:58:33.374 INFO:tasks.workunit.client.0.smithi008.stdout:4/452: truncate d0/d3/d21/f2c 701023 0 2023-10-18T20:58:33.377 INFO:tasks.workunit.client.0.smithi008.stdout:3/427: rename d0/d3/de/d13/d35/d51/c7f to d0/d4a/c82 0 2023-10-18T20:58:33.381 INFO:tasks.workunit.client.0.smithi008.stdout:7/542: write d1/d36/d3d/d3e/d59/d73/f75 [23309,76769] 0 2023-10-18T20:58:33.382 INFO:tasks.workunit.client.0.smithi008.stdout:7/543: truncate d1/da6/d79/f92 887755 0 2023-10-18T20:58:33.383 INFO:tasks.workunit.client.1.smithi060.stdout:4/486: write d4/dc/d2a/d1d/f21 [681565,118448] 0 2023-10-18T20:58:33.387 INFO:tasks.workunit.client.0.smithi008.stdout:1/592: dwrite d9/de/df/d17/d1e/d3c/f6f [0,4194304] 0 2023-10-18T20:58:33.388 INFO:tasks.workunit.client.0.smithi008.stdout:1/593: fsync d9/de/df/d17/d1e/f4c 0 2023-10-18T20:58:33.391 INFO:tasks.workunit.client.0.smithi008.stdout:2/504: unlink d1/d3/dd/l6c 0 2023-10-18T20:58:33.391 INFO:tasks.workunit.client.1.smithi060.stdout:0/526: creat d3/d8/d3c/d87/fa4 x:0 0 0 2023-10-18T20:58:33.404 INFO:tasks.workunit.client.0.smithi008.stdout:9/458: dwrite d2/dc/d1a/d1d/f7c [0,4194304] 0 2023-10-18T20:58:33.404 INFO:tasks.workunit.client.0.smithi008.stdout:9/459: chown d2/dc/f22 71 1 2023-10-18T20:58:33.404 INFO:tasks.workunit.client.0.smithi008.stdout:9/460: dread - d2/dc/f6d zero size 2023-10-18T20:58:33.405 INFO:tasks.workunit.client.1.smithi060.stdout:5/550: dwrite d0/d6/d8/df/f57 [0,4194304] 0 2023-10-18T20:58:33.407 INFO:tasks.workunit.client.0.smithi008.stdout:6/538: dread df/d15/d27/f52 [0,4194304] 0 2023-10-18T20:58:33.410 INFO:tasks.workunit.client.0.smithi008.stdout:5/498: dwrite d0/d2/d19/d7c/d58/d65/f36 [0,4194304] 0 2023-10-18T20:58:33.410 INFO:tasks.workunit.client.0.smithi008.stdout:5/499: fdatasync d0/d86/f8c 0 2023-10-18T20:58:33.410 INFO:tasks.workunit.client.0.smithi008.stdout:5/500: fsync d0/d2/d9/d88/fab 0 2023-10-18T20:58:33.416 INFO:tasks.workunit.client.0.smithi008.stdout:0/409: dwrite d0/f1d [0,4194304] 0 2023-10-18T20:58:33.416 INFO:tasks.workunit.client.0.smithi008.stdout:3/428: write d0/d3/d42/f30 [3013847,36234] 0 2023-10-18T20:58:33.416 INFO:tasks.workunit.client.0.smithi008.stdout:3/429: write d0/d4a/f66 [795126,109053] 0 2023-10-18T20:58:33.416 INFO:tasks.workunit.client.0.smithi008.stdout:3/430: chown d0/c77 0 1 2023-10-18T20:58:33.417 INFO:tasks.workunit.client.0.smithi008.stdout:3/431: creat d0/d4a/d64/f83 x:0 0 0 2023-10-18T20:58:33.417 INFO:tasks.workunit.client.0.smithi008.stdout:3/432: chown d0/d3/de/d13/l3c 2134474860 1 2023-10-18T20:58:33.417 INFO:tasks.workunit.client.0.smithi008.stdout:3/433: write d0/d3/d42/f30 [801192,73971] 0 2023-10-18T20:58:33.417 INFO:tasks.workunit.client.0.smithi008.stdout:0/410: creat d0/d3a/f84 x:0 0 0 2023-10-18T20:58:33.417 INFO:tasks.workunit.client.0.smithi008.stdout:1/594: creat d9/de/df/d17/d69/fb1 x:0 0 0 2023-10-18T20:58:33.421 INFO:tasks.workunit.client.1.smithi060.stdout:6/532: unlink d10/d25/l3d 0 2023-10-18T20:58:33.422 INFO:tasks.workunit.client.1.smithi060.stdout:7/564: rename de/f1a to de/d14/d3a/d46/fb7 0 2023-10-18T20:58:33.425 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:32.112644+0000 mgr.smithi008.flmjzp (mgr.14640) 3 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail 2023-10-18T20:58:33.425 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:32.143599+0000 mon.smithi008 (mon.0) 649 : cluster [DBG] mgrmap e27: smithi008.flmjzp(active, since 3s), standbys: smithi060.pgqqwa 2023-10-18T20:58:33.435 INFO:tasks.workunit.client.1.smithi060.stdout:1/606: link d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/fc3 d4/d6/d33/d58/fc5 0 2023-10-18T20:58:33.435 INFO:tasks.workunit.client.1.smithi060.stdout:1/607: fsync d4/d6/d7/d2f/d7b/d2a/d32/d56/f75 0 2023-10-18T20:58:33.435 INFO:tasks.workunit.client.0.smithi008.stdout:8/618: dwrite d5/f15 [0,4194304] 0 2023-10-18T20:58:33.436 INFO:tasks.workunit.client.0.smithi008.stdout:8/619: write d5/d8/df/d54/f62 [1315018,122535] 0 2023-10-18T20:58:33.436 INFO:tasks.workunit.client.0.smithi008.stdout:2/505: unlink d1/d3/dd/d1c/d3a/f80 0 2023-10-18T20:58:33.436 INFO:tasks.workunit.client.1.smithi060.stdout:6/533: dread f1 [0,4194304] 0 2023-10-18T20:58:33.437 INFO:tasks.workunit.client.0.smithi008.stdout:6/539: symlink df/d15/d48/d81/lb7 0 2023-10-18T20:58:33.437 INFO:tasks.workunit.client.0.smithi008.stdout:6/540: creat df/d15/d27/fb8 x:0 0 0 2023-10-18T20:58:33.438 INFO:tasks.workunit.client.0.smithi008.stdout:6/541: write df/d18/d68/f6e [648162,44856] 0 2023-10-18T20:58:33.438 INFO:tasks.workunit.client.0.smithi008.stdout:6/542: readlink df/d13/d53/lad 0 2023-10-18T20:58:33.441 INFO:tasks.workunit.client.0.smithi008.stdout:8/620: dread d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/dc4/fcb [0,4194304] 0 2023-10-18T20:58:33.447 INFO:tasks.workunit.client.1.smithi060.stdout:8/497: mkdir d4/d9/d37/d9a 0 2023-10-18T20:58:33.451 INFO:tasks.workunit.client.1.smithi060.stdout:2/516: truncate d0/f78 300430 0 2023-10-18T20:58:33.452 INFO:tasks.workunit.client.0.smithi008.stdout:5/501: creat d0/d2/d9/d9b/d62/fb7 x:0 0 0 2023-10-18T20:58:33.452 INFO:tasks.workunit.client.0.smithi008.stdout:5/502: truncate d0/d2/fa2 885330 0 2023-10-18T20:58:33.454 INFO:tasks.workunit.client.1.smithi060.stdout:9/444: symlink d3/d99/d65/lae 0 2023-10-18T20:58:33.454 INFO:tasks.workunit.client.1.smithi060.stdout:9/445: fdatasync d3/d58/f95 0 2023-10-18T20:58:33.463 INFO:tasks.workunit.client.0.smithi008.stdout:3/434: rmdir d0/d3/de 39 2023-10-18T20:58:33.465 INFO:tasks.workunit.client.0.smithi008.stdout:1/595: link d9/de/df/d17/d25/f32 d9/de/df/d17/d25/d94/da7/fb2 0 2023-10-18T20:58:33.473 INFO:tasks.workunit.client.0.smithi008.stdout:6/543: mkdir df/d18/d68/db9 0 2023-10-18T20:58:33.474 INFO:tasks.workunit.client.0.smithi008.stdout:6/544: fdatasync df/d13/f69 0 2023-10-18T20:58:33.475 INFO:tasks.workunit.client.0.smithi008.stdout:8/621: rename d5/d8/df/d9d/d4d/c55 to d5/d8/df/d9d/d4d/db5/ce6 0 2023-10-18T20:58:33.475 INFO:tasks.workunit.client.0.smithi008.stdout:9/461: dwrite d2/f5 [0,4194304] 0 2023-10-18T20:58:33.477 INFO:tasks.workunit.client.0.smithi008.stdout:5/503: creat d0/d2/d9/d9b/d6f/d75/fb8 x:0 0 0 2023-10-18T20:58:33.479 INFO:tasks.workunit.client.0.smithi008.stdout:3/435: mkdir d0/d84 0 2023-10-18T20:58:33.479 INFO:tasks.workunit.client.0.smithi008.stdout:3/436: write d0/f54 [12014,34102] 0 2023-10-18T20:58:33.479 INFO:tasks.workunit.client.0.smithi008.stdout:3/437: chown d0/d3/d37/d74/c79 13112 1 2023-10-18T20:58:33.485 INFO:tasks.workunit.client.1.smithi060.stdout:5/551: link d0/da/d79/da5/f9e d0/d6/d9/d82/d84/db2/d2a/fce 0 2023-10-18T20:58:33.490 INFO:tasks.workunit.client.0.smithi008.stdout:1/596: link d9/de/df/d85/l96 d9/de/df/d17/d1e/lb3 0 2023-10-18T20:58:33.495 INFO:tasks.workunit.client.0.smithi008.stdout:8/622: unlink d5/d8/df/d9d/d4d/dba/dd4/d50/d53/ca7 0 2023-10-18T20:58:33.495 INFO:tasks.workunit.client.0.smithi008.stdout:8/623: fsync d5/d8/df/d9d/d4d/db5/da3/fca 0 2023-10-18T20:58:33.498 INFO:tasks.workunit.client.0.smithi008.stdout:7/544: dwrite d1/da6/d4f/f5e [0,4194304] 0 2023-10-18T20:58:33.498 INFO:tasks.workunit.client.0.smithi008.stdout:7/545: read - d1/d3/d20/f66 zero size 2023-10-18T20:58:33.498 INFO:tasks.workunit.client.0.smithi008.stdout:6/545: rename df/d26/c2b to df/d19/cba 0 2023-10-18T20:58:33.501 INFO:tasks.workunit.client.0.smithi008.stdout:5/504: mknod d0/d2/d19/d7c/d31/d8d/cb9 0 2023-10-18T20:58:33.505 INFO:tasks.workunit.client.0.smithi008.stdout:3/438: unlink d0/d3/de/d13/f2a 0 2023-10-18T20:58:33.509 INFO:tasks.workunit.client.0.smithi008.stdout:0/411: dwrite d0/d3a/f84 [0,4194304] 0 2023-10-18T20:58:33.510 INFO:tasks.workunit.client.0.smithi008.stdout:0/412: getdents d0/d7c/d7f 0 2023-10-18T20:58:33.510 INFO:tasks.workunit.client.0.smithi008.stdout:8/624: truncate d5/d8/df/d9d/f1d 466616 0 2023-10-18T20:58:33.510 INFO:tasks.workunit.client.0.smithi008.stdout:1/597: rename d9/de/df/d17/d1e/f2d to d9/de/df/d17/d1e/fb4 0 2023-10-18T20:58:33.517 INFO:tasks.workunit.client.1.smithi060.stdout:7/565: unlink de/d14/d49/d68/f24 0 2023-10-18T20:58:33.517 INFO:tasks.workunit.client.1.smithi060.stdout:7/566: unlink de/d14/d49/d68/c1e 0 2023-10-18T20:58:33.518 INFO:tasks.workunit.client.0.smithi008.stdout:5/505: mkdir d0/d2/d9/d9b/dba 0 2023-10-18T20:58:33.520 INFO:tasks.workunit.client.1.smithi060.stdout:6/534: rename fb to d10/d47/fa3 0 2023-10-18T20:58:33.524 INFO:tasks.workunit.client.1.smithi060.stdout:8/498: rmdir d4/d9/d37/d9a 0 2023-10-18T20:58:33.526 INFO:tasks.workunit.client.1.smithi060.stdout:8/499: creat d4/d9/d37/d4e/d5e/f9b x:0 0 0 2023-10-18T20:58:33.527 INFO:tasks.workunit.client.1.smithi060.stdout:8/500: dread - d4/d9/f83 zero size 2023-10-18T20:58:33.527 INFO:tasks.workunit.client.1.smithi060.stdout:8/501: write d4/d9/d37/f56 [2245559,21380] 0 2023-10-18T20:58:33.527 INFO:tasks.workunit.client.1.smithi060.stdout:8/502: chown d4/d9/f6b 321774014 1 2023-10-18T20:58:33.527 INFO:tasks.workunit.client.1.smithi060.stdout:8/503: fdatasync d4/d9/d31/d35/f84 0 2023-10-18T20:58:33.528 INFO:tasks.workunit.client.1.smithi060.stdout:2/517: creat d0/d3/fa7 x:0 0 0 2023-10-18T20:58:33.529 INFO:tasks.workunit.client.1.smithi060.stdout:5/552: creat d0/dd/fcf x:0 0 0 2023-10-18T20:58:33.531 INFO:tasks.workunit.client.1.smithi060.stdout:0/527: dwrite d3/f3b [0,4194304] 0 2023-10-18T20:58:33.534 INFO:tasks.workunit.client.0.smithi008.stdout:4/453: dwrite d0/d3/f41 [4194304,4194304] 0 2023-10-18T20:58:33.544 INFO:tasks.workunit.client.0.smithi008.stdout:2/506: dwrite d1/d3/d79/f7d [0,4194304] 0 2023-10-18T20:58:33.548 INFO:tasks.workunit.client.0.smithi008.stdout:0/413: mkdir d0/dd/df/d20/d21/d85 0 2023-10-18T20:58:33.550 INFO:tasks.workunit.client.1.smithi060.stdout:1/608: dwrite d4/d6/d7/d2f/d7b/fb9 [4194304,4194304] 0 2023-10-18T20:58:33.550 INFO:tasks.workunit.client.1.smithi060.stdout:1/609: readlink d4/l3d 0 2023-10-18T20:58:33.555 INFO:tasks.workunit.client.0.smithi008.stdout:1/598: unlink d9/de/df/d17/d55/f9d 0 2023-10-18T20:58:33.555 INFO:tasks.workunit.client.0.smithi008.stdout:1/599: dread - d9/de/df/f7f zero size 2023-10-18T20:58:33.560 INFO:tasks.workunit.client.0.smithi008.stdout:6/546: mknod df/d18/d58/cbb 0 2023-10-18T20:58:33.560 INFO:tasks.workunit.client.0.smithi008.stdout:2/507: write d1/d3/dd/f38 [2705778,5680] 0 2023-10-18T20:58:33.560 INFO:tasks.workunit.client.0.smithi008.stdout:2/508: fsync d1/d3/dd/d1c/f96 0 2023-10-18T20:58:33.560 INFO:tasks.workunit.client.0.smithi008.stdout:7/546: dwrite d1/d3/f2a [0,4194304] 0 2023-10-18T20:58:33.561 INFO:tasks.workunit.client.0.smithi008.stdout:7/547: creat d1/d36/d3d/d3e/fb0 x:0 0 0 2023-10-18T20:58:33.563 INFO:tasks.workunit.client.1.smithi060.stdout:7/567: symlink de/d14/d2f/d3f/lb8 0 2023-10-18T20:58:33.564 INFO:tasks.workunit.client.1.smithi060.stdout:6/535: creat d10/d47/d92/d79/fa4 x:0 0 0 2023-10-18T20:58:33.564 INFO:tasks.workunit.client.1.smithi060.stdout:6/536: write d10/d3e/f74 [16346,111255] 0 2023-10-18T20:58:33.564 INFO:tasks.workunit.client.1.smithi060.stdout:6/537: fsync d10/d25/d3c/f62 0 2023-10-18T20:58:33.564 INFO:tasks.workunit.client.1.smithi060.stdout:6/538: write d10/d25/f8d [405269,102720] 0 2023-10-18T20:58:33.574 INFO:tasks.workunit.client.1.smithi060.stdout:8/504: dwrite d4/f25 [0,4194304] 0 2023-10-18T20:58:33.574 INFO:tasks.workunit.client.1.smithi060.stdout:8/505: write d4/d9/d37/d4e/d5e/f9b [227576,120579] 0 2023-10-18T20:58:33.578 INFO:tasks.workunit.client.1.smithi060.stdout:7/568: dread de/f17 [0,4194304] 0 2023-10-18T20:58:33.587 INFO:tasks.workunit.client.0.smithi008.stdout:6/547: dread df/d19/f20 [0,4194304] 0 2023-10-18T20:58:33.587 INFO:tasks.workunit.client.0.smithi008.stdout:6/548: read - df/d15/d48/fa8 zero size 2023-10-18T20:58:33.587 INFO:tasks.workunit.client.0.smithi008.stdout:6/549: write df/d13/f8f [723037,4707] 0 2023-10-18T20:58:33.590 INFO:tasks.workunit.client.1.smithi060.stdout:2/518: mkdir d0/d43/da8 0 2023-10-18T20:58:33.591 INFO:tasks.workunit.client.0.smithi008.stdout:5/506: symlink d0/d2/d19/d7c/d31/d3f/d9a/lbb 0 2023-10-18T20:58:33.591 INFO:tasks.workunit.client.1.smithi060.stdout:9/446: rmdir d3/d99/d9f 39 2023-10-18T20:58:33.593 INFO:tasks.workunit.client.0.smithi008.stdout:3/439: truncate d0/d3/d42/f30 2696862 0 2023-10-18T20:58:33.594 INFO:tasks.workunit.client.1.smithi060.stdout:5/553: creat d0/d6/d9/db1/fd0 x:0 0 0 2023-10-18T20:58:33.595 INFO:tasks.workunit.client.1.smithi060.stdout:5/554: write d0/d6/d8/df/d27/f95 [509816,46621] 0 2023-10-18T20:58:33.595 INFO:tasks.workunit.client.1.smithi060.stdout:5/555: write d0/d6/d9/d82/d84/db2/f7a [1552678,71579] 0 2023-10-18T20:58:33.596 INFO:tasks.workunit.client.1.smithi060.stdout:5/556: write d0/d6/f1e [4756807,58391] 0 2023-10-18T20:58:33.596 INFO:tasks.workunit.client.1.smithi060.stdout:5/557: fsync d0/d6/f42 0 2023-10-18T20:58:33.600 INFO:tasks.workunit.client.1.smithi060.stdout:0/528: creat d3/d8/d14/d55/d74/d76/d68/d98/fa5 x:0 0 0 2023-10-18T20:58:33.600 INFO:tasks.workunit.client.0.smithi008.stdout:4/454: rmdir d0/d17 39 2023-10-18T20:58:33.601 INFO:tasks.workunit.client.0.smithi008.stdout:4/455: chown d0/d3/d21/d57/d8f/d73 973761 1 2023-10-18T20:58:33.608 INFO:tasks.workunit.client.1.smithi060.stdout:8/506: rename d4/d9/d31/d35/f51 to d4/d9/d8f/f9c 0 2023-10-18T20:58:33.609 INFO:tasks.workunit.client.1.smithi060.stdout:8/507: chown d4/d9/d37/d4e/d5e/l58 1534 1 2023-10-18T20:58:33.609 INFO:tasks.workunit.client.1.smithi060.stdout:8/508: creat d4/d9/d31/d35/f9d x:0 0 0 2023-10-18T20:58:33.609 INFO:tasks.workunit.client.1.smithi060.stdout:8/509: chown d4/d9/d4f/f5d 1534 1 2023-10-18T20:58:33.612 INFO:tasks.workunit.client.0.smithi008.stdout:0/414: creat d0/dd/d19/d24/f86 x:0 0 0 2023-10-18T20:58:33.612 INFO:tasks.workunit.client.0.smithi008.stdout:0/415: truncate d0/dd/d19/f79 408855 0 2023-10-18T20:58:33.612 INFO:tasks.workunit.client.0.smithi008.stdout:0/416: truncate d0/dd/d19/d41/f43 1161266 0 2023-10-18T20:58:33.613 INFO:tasks.workunit.client.0.smithi008.stdout:0/417: dread - d0/d7c/f81 zero size 2023-10-18T20:58:33.614 INFO:tasks.workunit.client.1.smithi060.stdout:7/569: truncate de/d14/d3a/f56 573403 0 2023-10-18T20:58:33.618 INFO:tasks.workunit.client.1.smithi060.stdout:9/447: creat d3/d99/d1c/d2a/d2d/faf x:0 0 0 2023-10-18T20:58:33.619 INFO:tasks.workunit.client.1.smithi060.stdout:9/448: dread - d3/d99/d1c/d5a/d5d/f78 zero size 2023-10-18T20:58:33.619 INFO:tasks.workunit.client.1.smithi060.stdout:9/449: chown d3/d99/d1c/d2a/f36 71 1 2023-10-18T20:58:33.619 INFO:tasks.workunit.client.1.smithi060.stdout:9/450: truncate d3/d99/d19/f90 638523 0 2023-10-18T20:58:33.623 INFO:tasks.workunit.client.1.smithi060.stdout:4/487: sync 2023-10-18T20:58:33.625 INFO:tasks.workunit.client.1.smithi060.stdout:3/485: sync 2023-10-18T20:58:33.625 INFO:tasks.workunit.client.1.smithi060.stdout:3/486: dread - d0/d22/d26/d79/f93 zero size 2023-10-18T20:58:33.627 INFO:tasks.workunit.client.0.smithi008.stdout:7/548: truncate d1/f6 4537587 0 2023-10-18T20:58:33.628 INFO:tasks.workunit.client.0.smithi008.stdout:6/550: symlink df/d15/d27/lbc 0 2023-10-18T20:58:33.629 INFO:tasks.workunit.client.0.smithi008.stdout:5/507: creat d0/fbc x:0 0 0 2023-10-18T20:58:33.629 INFO:tasks.workunit.client.0.smithi008.stdout:5/508: chown d0/d2/d19/d7c/d64/f7e 3524 1 2023-10-18T20:58:33.632 INFO:tasks.workunit.client.1.smithi060.stdout:0/529: dread d3/d8/d14/d55/d74/d76/f47 [0,4194304] 0 2023-10-18T20:58:33.633 INFO:tasks.workunit.client.0.smithi008.stdout:5/509: write d0/d2/d19/d7c/d31/f78 [123056,121935] 0 2023-10-18T20:58:33.633 INFO:tasks.workunit.client.0.smithi008.stdout:3/440: symlink d0/d3/de/d13/l85 0 2023-10-18T20:58:33.635 INFO:tasks.workunit.client.0.smithi008.stdout:1/600: dwrite d9/de/df/d17/d1e/d9a/fa4 [0,4194304] 0 2023-10-18T20:58:33.635 INFO:tasks.workunit.client.0.smithi008.stdout:1/601: chown d9/de/df/d17/d1e/d7d/d89/f8e 633735 1 2023-10-18T20:58:33.636 INFO:tasks.workunit.client.0.smithi008.stdout:1/602: creat d9/de/df/d17/d55/fb5 x:0 0 0 2023-10-18T20:58:33.636 INFO:tasks.workunit.client.1.smithi060.stdout:1/610: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/fc3 [0,4194304] 0 2023-10-18T20:58:33.636 INFO:tasks.workunit.client.1.smithi060.stdout:1/611: fdatasync d4/d6/d7/f26 0 2023-10-18T20:58:33.637 INFO:tasks.workunit.client.1.smithi060.stdout:1/612: fdatasync d4/da/d42/f4a 0 2023-10-18T20:58:33.637 INFO:tasks.workunit.client.0.smithi008.stdout:1/603: creat d9/de/df/d17/d1e/d3c/fb6 x:0 0 0 2023-10-18T20:58:33.637 INFO:tasks.workunit.client.0.smithi008.stdout:0/418: dread d0/dd/df/d2a/f4b [0,4194304] 0 2023-10-18T20:58:33.638 INFO:tasks.workunit.client.0.smithi008.stdout:0/419: readlink d0/l1f 0 2023-10-18T20:58:33.639 INFO:tasks.workunit.client.1.smithi060.stdout:8/510: creat d4/d9/d93/f9e x:0 0 0 2023-10-18T20:58:33.639 INFO:tasks.workunit.client.1.smithi060.stdout:8/511: fsync d4/d9/d37/d4e/d5e/f99 0 2023-10-18T20:58:33.642 INFO:tasks.workunit.client.0.smithi008.stdout:5/510: dread d0/d6e/f7d [0,4194304] 0 2023-10-18T20:58:33.643 INFO:tasks.workunit.client.0.smithi008.stdout:5/511: write d0/d2/d9/d9b/d6f/d75/fb8 [164201,20448] 0 2023-10-18T20:58:33.643 INFO:tasks.workunit.client.0.smithi008.stdout:4/456: creat d0/d74/f97 x:0 0 0 2023-10-18T20:58:33.643 INFO:tasks.workunit.client.0.smithi008.stdout:4/457: chown d0/f8b 12944042 1 2023-10-18T20:58:33.645 INFO:tasks.workunit.client.0.smithi008.stdout:8/625: dwrite d5/d8/df/d9d/d4d/f4f [0,4194304] 0 2023-10-18T20:58:33.663 INFO:tasks.workunit.client.0.smithi008.stdout:6/551: stat df/d15/d27/c30 0 2023-10-18T20:58:33.664 INFO:tasks.workunit.client.1.smithi060.stdout:5/558: dwrite d0/f8a [0,4194304] 0 2023-10-18T20:58:33.665 INFO:tasks.workunit.client.1.smithi060.stdout:7/570: link de/d38/c66 de/d14/d3a/d46/d73/cb9 0 2023-10-18T20:58:33.673 INFO:tasks.workunit.client.1.smithi060.stdout:9/451: rename d3/d99/d19/d54/d8f/la3 to d3/d99/d19/d54/da5/lb0 0 2023-10-18T20:58:33.678 INFO:tasks.workunit.client.1.smithi060.stdout:4/488: write d4/dc/f58 [843834,33310] 0 2023-10-18T20:58:33.678 INFO:tasks.workunit.client.1.smithi060.stdout:4/489: stat d4/d15/d2b 0 2023-10-18T20:58:33.679 INFO:tasks.workunit.client.0.smithi008.stdout:2/509: dwrite d1/d3/dd/d1c/f3c [0,4194304] 0 2023-10-18T20:58:33.679 INFO:tasks.workunit.client.0.smithi008.stdout:3/441: truncate d0/d3/d42/f68 3596506 0 2023-10-18T20:58:33.679 INFO:tasks.workunit.client.0.smithi008.stdout:3/442: truncate d0/d4a/d64/f7e 569475 0 2023-10-18T20:58:33.680 INFO:tasks.workunit.client.0.smithi008.stdout:2/510: truncate d1/d3/d40/d6e/f77 1547733 0 2023-10-18T20:58:33.681 INFO:tasks.workunit.client.0.smithi008.stdout:7/549: dread d1/d3/f1d [0,4194304] 0 2023-10-18T20:58:33.682 INFO:tasks.workunit.client.0.smithi008.stdout:7/550: readlink d1/l25 0 2023-10-18T20:58:33.682 INFO:tasks.workunit.client.1.smithi060.stdout:3/487: creat d0/d3c/fa7 x:0 0 0 2023-10-18T20:58:33.695 INFO:tasks.workunit.client.0.smithi008.stdout:4/458: truncate d0/d17/d5b/d2a/f3c 27634 0 2023-10-18T20:58:33.695 INFO:tasks.workunit.client.1.smithi060.stdout:2/519: dwrite d0/f5d [0,4194304] 0 2023-10-18T20:58:33.696 INFO:tasks.workunit.client.1.smithi060.stdout:2/520: dread - d0/d8/d47/f99 zero size 2023-10-18T20:58:33.698 INFO:tasks.workunit.client.1.smithi060.stdout:0/530: creat d3/d8/d14/d55/d74/fa6 x:0 0 0 2023-10-18T20:58:33.699 INFO:tasks.workunit.client.1.smithi060.stdout:0/531: creat d3/d80/fa7 x:0 0 0 2023-10-18T20:58:33.703 INFO:tasks.workunit.client.0.smithi008.stdout:8/626: mknod d5/d8/df/d9d/d4d/dba/dd4/d50/d53/d8c/dc9/ce7 0 2023-10-18T20:58:33.706 INFO:tasks.workunit.client.0.smithi008.stdout:3/443: link d0/d3/de/d13/c81 d0/d3/de/c86 0 2023-10-18T20:58:33.707 INFO:tasks.workunit.client.1.smithi060.stdout:5/559: getdents d0/d6/d8/d81 0 2023-10-18T20:58:33.708 INFO:tasks.workunit.client.1.smithi060.stdout:5/560: readlink d0/d6/d9/l94 0 2023-10-18T20:58:33.711 INFO:tasks.workunit.client.0.smithi008.stdout:2/511: link d1/d3/f5f d1/d3/dd/d1c/d3a/d49/fa7 0 2023-10-18T20:58:33.712 INFO:tasks.workunit.client.1.smithi060.stdout:7/571: creat de/d14/d49/da3/fba x:0 0 0 2023-10-18T20:58:33.713 INFO:tasks.workunit.client.1.smithi060.stdout:7/572: fsync de/d14/d2f/d8f/d5b/f75 0 2023-10-18T20:58:33.714 INFO:tasks.workunit.client.0.smithi008.stdout:7/551: rename d1/d3/d20/f47 to d1/da6/d4f/d5c/fb1 0 2023-10-18T20:58:33.716 INFO:tasks.workunit.client.1.smithi060.stdout:9/452: creat d3/d99/d1c/d2a/d33/fb1 x:0 0 0 2023-10-18T20:58:33.717 INFO:tasks.workunit.client.0.smithi008.stdout:0/420: dwrite d0/f1d [0,4194304] 0 2023-10-18T20:58:33.717 INFO:tasks.workunit.client.0.smithi008.stdout:0/421: chown d0/dd/c55 0 1 2023-10-18T20:58:33.718 INFO:tasks.workunit.client.0.smithi008.stdout:1/604: dwrite d9/de/fb0 [0,4194304] 0 2023-10-18T20:58:33.718 INFO:tasks.workunit.client.0.smithi008.stdout:1/605: fsync d9/f42 0 2023-10-18T20:58:33.718 INFO:tasks.workunit.client.0.smithi008.stdout:1/606: fdatasync d9/de/df/f5b 0 2023-10-18T20:58:33.719 INFO:tasks.workunit.client.0.smithi008.stdout:4/459: rmdir d0/d17/d5b 39 2023-10-18T20:58:33.719 INFO:tasks.workunit.client.0.smithi008.stdout:4/460: stat d0/d3/d21 0 2023-10-18T20:58:33.719 INFO:tasks.workunit.client.0.smithi008.stdout:4/461: write d0/d17/d5b/d2a/f93 [108140,57762] 0 2023-10-18T20:58:33.719 INFO:tasks.workunit.client.0.smithi008.stdout:4/462: fsync d0/d17/d5b/d2a/f94 0 2023-10-18T20:58:33.720 INFO:tasks.workunit.client.0.smithi008.stdout:5/512: dwrite d0/d2/fa2 [0,4194304] 0 2023-10-18T20:58:33.720 INFO:tasks.workunit.client.1.smithi060.stdout:1/613: dwrite d4/d38/f7f [0,4194304] 0 2023-10-18T20:58:33.721 INFO:tasks.workunit.client.1.smithi060.stdout:1/614: creat d4/d6/d7/df/d59/fc6 x:0 0 0 2023-10-18T20:58:33.721 INFO:tasks.workunit.client.1.smithi060.stdout:1/615: truncate d4/d6/d33/d58/fc2 258159 0 2023-10-18T20:58:33.722 INFO:tasks.workunit.client.0.smithi008.stdout:8/627: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/fe8 x:0 0 0 2023-10-18T20:58:33.722 INFO:tasks.workunit.client.0.smithi008.stdout:6/552: getdents df/d13 0 2023-10-18T20:58:33.722 INFO:tasks.workunit.client.0.smithi008.stdout:6/553: creat df/d3c/da2/fbd x:0 0 0 2023-10-18T20:58:33.723 INFO:tasks.workunit.client.1.smithi060.stdout:2/521: rmdir d0/d3/d27/d7b 39 2023-10-18T20:58:33.724 INFO:tasks.workunit.client.0.smithi008.stdout:2/512: rename d1/d3/d40/d6e/d7e/c94 to d1/d3/dd/d25/d76/d59/d85/ca8 0 2023-10-18T20:58:33.726 INFO:tasks.workunit.client.1.smithi060.stdout:0/532: rename d3/d8/d14/d55/ca1 to d3/d32/d86/ca8 0 2023-10-18T20:58:33.727 INFO:tasks.workunit.client.1.smithi060.stdout:5/561: mkdir d0/d6/d9/d82/d84/db2/d2a/dd1 0 2023-10-18T20:58:33.728 INFO:tasks.workunit.client.0.smithi008.stdout:7/552: symlink d1/d3/d8b/da5/lb2 0 2023-10-18T20:58:33.732 INFO:tasks.workunit.client.1.smithi060.stdout:7/573: link de/d14/d2f/d3f/l5d de/d14/d3a/d46/dab/lbb 0 2023-10-18T20:58:33.732 INFO:tasks.workunit.client.1.smithi060.stdout:7/574: write de/d38/d78/f8d [1637184,42501] 0 2023-10-18T20:58:33.734 INFO:tasks.workunit.client.1.smithi060.stdout:8/512: dwrite d4/f47 [0,4194304] 0 2023-10-18T20:58:33.736 INFO:tasks.workunit.client.1.smithi060.stdout:9/453: creat d3/d99/d1c/d5a/fb2 x:0 0 0 2023-10-18T20:58:33.736 INFO:tasks.workunit.client.1.smithi060.stdout:9/454: chown d3/d99/d65/l7a 171412153 1 2023-10-18T20:58:33.736 INFO:tasks.workunit.client.1.smithi060.stdout:9/455: dread - d3/d58/f73 zero size 2023-10-18T20:58:33.742 INFO:tasks.workunit.client.0.smithi008.stdout:0/422: dread d0/dd/d19/d24/f35 [0,4194304] 0 2023-10-18T20:58:33.747 INFO:tasks.workunit.client.1.smithi060.stdout:2/522: dread d0/d8/f30 [0,4194304] 0 2023-10-18T20:58:33.747 INFO:tasks.workunit.client.1.smithi060.stdout:4/490: dwrite d4/dc/d2a/d13/d27/f67 [0,4194304] 0 2023-10-18T20:58:33.753 INFO:tasks.workunit.client.0.smithi008.stdout:1/607: symlink d9/de/df/lb7 0 2023-10-18T20:58:33.753 INFO:tasks.workunit.client.1.smithi060.stdout:4/491: chown d4/ce 131502 1 2023-10-18T20:58:33.759 INFO:tasks.workunit.client.1.smithi060.stdout:3/488: rmdir d0/d22/d26 39 2023-10-18T20:58:33.760 INFO:tasks.workunit.client.0.smithi008.stdout:0/423: write d0/dd/df/d2a/f2d [3790918,107306] 0 2023-10-18T20:58:33.761 INFO:tasks.workunit.client.1.smithi060.stdout:5/562: dread d0/d6/d8/df/d27/f4d [0,4194304] 0 2023-10-18T20:58:33.766 INFO:tasks.workunit.client.0.smithi008.stdout:5/513: truncate d0/d2/d19/d7c/d42/f52 1325615 0 2023-10-18T20:58:33.770 INFO:tasks.workunit.client.0.smithi008.stdout:8/628: rmdir d5/d8/df 39 2023-10-18T20:58:33.771 INFO:tasks.workunit.client.0.smithi008.stdout:8/629: dread - d5/d8/df/f9a zero size 2023-10-18T20:58:33.771 INFO:tasks.workunit.client.0.smithi008.stdout:8/630: fsync d5/d8/df/d9d/d4d/dba/dd4/d50/d53/f99 0 2023-10-18T20:58:33.778 INFO:tasks.workunit.client.1.smithi060.stdout:1/616: symlink d4/d6/d7/d2f/d7b/d2a/d32/d56/daf/lc7 0 2023-10-18T20:58:33.778 INFO:tasks.workunit.client.1.smithi060.stdout:1/617: fdatasync d4/d6/d7/d2f/f70 0 2023-10-18T20:58:33.779 INFO:tasks.workunit.client.1.smithi060.stdout:1/618: write d4/d6/d7/df/f15 [5239842,66550] 0 2023-10-18T20:58:33.779 INFO:tasks.workunit.client.0.smithi008.stdout:2/513: dread d1/f5a [0,4194304] 0 2023-10-18T20:58:33.780 INFO:tasks.workunit.client.0.smithi008.stdout:0/424: dread d0/dd/d19/d24/f5a [0,4194304] 0 2023-10-18T20:58:33.780 INFO:tasks.workunit.client.0.smithi008.stdout:0/425: readlink d0/lc 0 2023-10-18T20:58:33.780 INFO:tasks.workunit.client.0.smithi008.stdout:2/514: write d1/d3/dd/d25/d76/f3f [4678540,96645] 0 2023-10-18T20:58:33.781 INFO:tasks.workunit.client.0.smithi008.stdout:3/444: rmdir d0/d3/d15 39 2023-10-18T20:58:33.783 INFO:tasks.workunit.client.1.smithi060.stdout:0/533: rename d3/d8/d14/d55/d74/d76/f93 to d3/d8/d3c/d87/d91/fa9 0 2023-10-18T20:58:33.783 INFO:tasks.workunit.client.0.smithi008.stdout:7/553: creat d1/da6/d4f/d87/fb3 x:0 0 0 2023-10-18T20:58:33.784 INFO:tasks.workunit.client.0.smithi008.stdout:7/554: truncate d1/da6/f6f 705024 0 2023-10-18T20:58:33.784 INFO:tasks.workunit.client.0.smithi008.stdout:2/515: write d1/d3/dd/d1c/f96 [91276,118542] 0 2023-10-18T20:58:33.784 INFO:tasks.workunit.client.0.smithi008.stdout:7/555: chown d1/ca4 380433 1 2023-10-18T20:58:33.785 INFO:tasks.workunit.client.0.smithi008.stdout:7/556: write d1/d3/d20/d5f/d7f/f9a [826568,48171] 0 2023-10-18T20:58:33.787 INFO:tasks.workunit.client.0.smithi008.stdout:1/608: mkdir d9/de/df/d17/d1e/db8 0 2023-10-18T20:58:33.792 INFO:tasks.workunit.client.0.smithi008.stdout:4/463: dwrite d0/d17/f23 [0,4194304] 0 2023-10-18T20:58:33.793 INFO:tasks.workunit.client.0.smithi008.stdout:4/464: fdatasync d0/d17/d5b/f68 0 2023-10-18T20:58:33.793 INFO:tasks.workunit.client.0.smithi008.stdout:4/465: chown d0/f8b 171240 1 2023-10-18T20:58:33.803 INFO:tasks.workunit.client.1.smithi060.stdout:2/523: mknod d0/d3/d27/d4d/ca9 0 2023-10-18T20:58:33.803 INFO:tasks.workunit.client.1.smithi060.stdout:2/524: unlink d0/d8/l20 0 2023-10-18T20:58:33.803 INFO:tasks.workunit.client.0.smithi008.stdout:0/426: mkdir d0/dd/d19/d41/d87 0 2023-10-18T20:58:33.804 INFO:tasks.workunit.client.0.smithi008.stdout:0/427: write d0/d7c/f63 [4856988,119269] 0 2023-10-18T20:58:33.805 INFO:tasks.workunit.client.1.smithi060.stdout:3/489: mknod d0/d22/d26/d8c/ca8 0 2023-10-18T20:58:33.805 INFO:tasks.workunit.client.1.smithi060.stdout:9/456: dwrite d3/d99/d1c/d2a/f62 [0,4194304] 0 2023-10-18T20:58:33.807 INFO:tasks.workunit.client.0.smithi008.stdout:1/609: unlink d9/de/df/d17/d69/fb1 0 2023-10-18T20:58:33.813 INFO:tasks.workunit.client.0.smithi008.stdout:6/554: dwrite df/d15/f40 [4194304,4194304] 0 2023-10-18T20:58:33.813 INFO:tasks.workunit.client.1.smithi060.stdout:5/563: symlink d0/d6/d9/d82/d84/db2/d2a/dd1/ld2 0 2023-10-18T20:58:33.814 INFO:tasks.workunit.client.1.smithi060.stdout:5/564: getdents d0/d6/d8/df/d27/d32/d6d/db6 0 2023-10-18T20:58:33.818 INFO:tasks.workunit.client.1.smithi060.stdout:7/575: dwrite de/d14/d49/fb4 [0,4194304] 0 2023-10-18T20:58:33.823 INFO:tasks.workunit.client.0.smithi008.stdout:4/466: dread d0/d3/f1e [0,4194304] 0 2023-10-18T20:58:33.832 INFO:tasks.workunit.client.1.smithi060.stdout:5/565: write d0/d6/d8/df/f51 [2947005,14884] 0 2023-10-18T20:58:33.832 INFO:tasks.workunit.client.1.smithi060.stdout:5/566: dread - d0/da/d3b/d43/f50 zero size 2023-10-18T20:58:33.897 INFO:tasks.workunit.client.1.smithi060.stdout:1/619: symlink d4/d6/d7/lc8 0 2023-10-18T20:58:33.900 INFO:tasks.workunit.client.0.smithi008.stdout:2/516: dwrite d1/d3/dd/d25/d34/f81 [0,4194304] 0 2023-10-18T20:58:33.900 INFO:tasks.workunit.client.0.smithi008.stdout:2/517: truncate d1/f19 2994417 0 2023-10-18T20:58:33.901 INFO:tasks.workunit.client.0.smithi008.stdout:2/518: stat d1/d3/c91 0 2023-10-18T20:58:33.901 INFO:tasks.workunit.client.1.smithi060.stdout:8/513: rename d4/d9/d8f to d4/d9/d31/d35/d9f 0 2023-10-18T20:58:33.903 INFO:tasks.workunit.client.0.smithi008.stdout:0/428: rmdir d0/dd/d19/d41/d87 0 2023-10-18T20:58:33.904 INFO:tasks.workunit.client.0.smithi008.stdout:0/429: write d0/d7c/f59 [254126,26906] 0 2023-10-18T20:58:33.904 INFO:tasks.workunit.client.1.smithi060.stdout:0/534: mkdir d3/d8/d3c/d87/d91/daa 0 2023-10-18T20:58:33.906 INFO:tasks.workunit.client.0.smithi008.stdout:3/445: dwrite d0/d3/f2e [0,4194304] 0 2023-10-18T20:58:33.908 INFO:tasks.workunit.client.0.smithi008.stdout:1/610: dwrite d9/de/df/d17/d1e/d7d/fab [0,4194304] 0 2023-10-18T20:58:33.908 INFO:tasks.workunit.client.1.smithi060.stdout:6/539: sync 2023-10-18T20:58:33.915 INFO:tasks.workunit.client.0.smithi008.stdout:7/557: truncate d1/d3/f2a 970877 0 2023-10-18T20:58:33.915 INFO:tasks.workunit.client.0.smithi008.stdout:7/558: fdatasync d1/d3/d20/d5f/f72 0 2023-10-18T20:58:33.922 INFO:tasks.workunit.client.0.smithi008.stdout:6/555: dwrite df/d19/f1c [4194304,4194304] 0 2023-10-18T20:58:33.925 INFO:tasks.workunit.client.1.smithi060.stdout:9/457: link d3/l76 d3/d99/d1c/lb3 0 2023-10-18T20:58:33.927 INFO:tasks.workunit.client.0.smithi008.stdout:2/519: dread d1/f1a [0,4194304] 0 2023-10-18T20:58:33.929 INFO:tasks.workunit.client.1.smithi060.stdout:7/576: link de/d14/d3a/l9b de/d29/d9c/lbc 0 2023-10-18T20:58:33.932 INFO:tasks.workunit.client.1.smithi060.stdout:5/567: symlink d0/da/d3b/d43/ld3 0 2023-10-18T20:58:33.934 INFO:tasks.workunit.client.1.smithi060.stdout:2/525: dread d0/d3/d27/d4d/d5e/f74 [0,4194304] 0 2023-10-18T20:58:33.935 INFO:tasks.workunit.client.0.smithi008.stdout:4/467: dwrite d0/d3/d21/d57/d8f/f72 [0,4194304] 0 2023-10-18T20:58:33.947 INFO:tasks.workunit.client.0.smithi008.stdout:2/520: dread d1/f19 [0,4194304] 0 2023-10-18T20:58:33.947 INFO:tasks.workunit.client.0.smithi008.stdout:2/521: unlink d1/la1 0 2023-10-18T20:58:33.948 INFO:tasks.workunit.client.1.smithi060.stdout:1/620: symlink d4/d6/d7/d2f/d7b/d2a/d32/dd/d81/lc9 0 2023-10-18T20:58:33.949 INFO:tasks.workunit.client.1.smithi060.stdout:0/535: dwrite d3/d8/f2d [0,4194304] 0 2023-10-18T20:58:33.950 INFO:tasks.workunit.client.1.smithi060.stdout:0/536: dread - d3/d8/d14/d55/d74/fa6 zero size 2023-10-18T20:58:33.953 INFO:tasks.workunit.client.1.smithi060.stdout:8/514: truncate d4/d9/d31/f40 2421100 0 2023-10-18T20:58:33.954 INFO:tasks.workunit.client.1.smithi060.stdout:0/537: read d3/d8/f22 [621822,26446] 0 2023-10-18T20:58:33.955 INFO:tasks.workunit.client.1.smithi060.stdout:6/540: creat d10/d2e/d75/d77/fa5 x:0 0 0 2023-10-18T20:58:33.956 INFO:tasks.workunit.client.1.smithi060.stdout:7/577: link de/d14/d2f/c4d de/d14/d49/d68/d88/cbd 0 2023-10-18T20:58:33.958 INFO:tasks.workunit.client.1.smithi060.stdout:2/526: symlink d0/d16/d81/da1/laa 0 2023-10-18T20:58:33.959 INFO:tasks.workunit.client.1.smithi060.stdout:5/568: creat d0/d6/d9/fd4 x:0 0 0 2023-10-18T20:58:33.960 INFO:tasks.workunit.client.1.smithi060.stdout:5/569: creat d0/d6/d9/fd5 x:0 0 0 2023-10-18T20:58:33.962 INFO:tasks.workunit.client.1.smithi060.stdout:4/492: sync 2023-10-18T20:58:33.965 INFO:tasks.workunit.client.0.smithi008.stdout:7/559: dwrite d1/d3/d20/d5f/f72 [0,4194304] 0 2023-10-18T20:58:33.965 INFO:tasks.workunit.client.1.smithi060.stdout:0/538: rmdir d3/d8/d14/d55/d74/da0 0 2023-10-18T20:58:33.967 INFO:tasks.workunit.client.1.smithi060.stdout:1/621: write d4/d6/d7/d2f/d7b/fb9 [5388495,66968] 0 2023-10-18T20:58:33.968 INFO:tasks.workunit.client.1.smithi060.stdout:3/490: sync 2023-10-18T20:58:33.968 INFO:tasks.workunit.client.0.smithi008.stdout:2/522: dread d1/d3/dd/d25/d76/f8d [0,4194304] 0 2023-10-18T20:58:33.969 INFO:tasks.workunit.client.1.smithi060.stdout:9/458: dwrite d3/d99/d1c/d5a/d5d/d2b/f94 [0,4194304] 0 2023-10-18T20:58:33.971 INFO:tasks.workunit.client.1.smithi060.stdout:8/515: dread d4/d9/f79 [0,4194304] 0 2023-10-18T20:58:33.971 INFO:tasks.workunit.client.1.smithi060.stdout:8/516: readlink d4/d9/l28 0 2023-10-18T20:58:33.972 INFO:tasks.workunit.client.1.smithi060.stdout:2/527: creat d0/d16/d81/da1/fab x:0 0 0 2023-10-18T20:58:33.972 INFO:tasks.workunit.client.1.smithi060.stdout:2/528: fdatasync d0/d3/d27/d4d/f63 0 2023-10-18T20:58:33.975 INFO:tasks.workunit.client.1.smithi060.stdout:5/570: creat d0/d6/d8/df/d27/d32/fd6 x:0 0 0 2023-10-18T20:58:33.976 INFO:tasks.workunit.client.1.smithi060.stdout:4/493: mkdir d4/dc/d2a/d39/d53/d65/d8d 0 2023-10-18T20:58:33.979 INFO:tasks.workunit.client.1.smithi060.stdout:6/541: dread fd [0,4194304] 0 2023-10-18T20:58:33.980 INFO:tasks.workunit.client.1.smithi060.stdout:6/542: readlink d10/d17/d70/l96 0 2023-10-18T20:58:33.980 INFO:tasks.workunit.client.1.smithi060.stdout:0/539: creat d3/d8/d3c/fab x:0 0 0 2023-10-18T20:58:33.981 INFO:tasks.workunit.client.0.smithi008.stdout:0/430: truncate d0/dd/d19/d24/f5a 536141 0 2023-10-18T20:58:33.981 INFO:tasks.workunit.client.0.smithi008.stdout:0/431: truncate d0/dd/df/d2a/f80 857443 0 2023-10-18T20:58:33.983 INFO:tasks.workunit.client.0.smithi008.stdout:3/446: unlink d0/d4a/f66 0 2023-10-18T20:58:33.983 INFO:tasks.workunit.client.0.smithi008.stdout:3/447: unlink d0/d4a/f4b 0 2023-10-18T20:58:33.983 INFO:tasks.workunit.client.0.smithi008.stdout:3/448: chown d0/d3/d37 208 1 2023-10-18T20:58:33.985 INFO:tasks.workunit.client.1.smithi060.stdout:9/459: truncate d3/d99/d1c/d2a/f36 2769900 0 2023-10-18T20:58:33.993 INFO:tasks.workunit.client.1.smithi060.stdout:3/491: dread d0/d22/d50/f53 [0,4194304] 0 2023-10-18T20:58:33.993 INFO:tasks.workunit.client.1.smithi060.stdout:7/578: getdents de/d14/d3a 0 2023-10-18T20:58:33.995 INFO:tasks.workunit.client.0.smithi008.stdout:1/611: rmdir d9/de/df/d17/d25 39 2023-10-18T20:58:33.999 INFO:tasks.workunit.client.1.smithi060.stdout:8/517: truncate d4/f47 4019204 0 2023-10-18T20:58:34.003 INFO:tasks.workunit.client.1.smithi060.stdout:5/571: mkdir d0/dd/dd7 0 2023-10-18T20:58:34.005 INFO:tasks.workunit.client.1.smithi060.stdout:6/543: rename d10/d17/d2f/c69 to d10/d17/d2f/ca6 0 2023-10-18T20:58:34.007 INFO:tasks.workunit.client.1.smithi060.stdout:0/540: mkdir d3/d8/dac 0 2023-10-18T20:58:34.009 INFO:tasks.workunit.client.0.smithi008.stdout:6/556: mkdir df/d15/d48/dbe 0 2023-10-18T20:58:34.014 INFO:tasks.workunit.client.0.smithi008.stdout:1/612: write d9/de/df/d17/d1e/d9a/fa4 [3828160,32386] 0 2023-10-18T20:58:34.014 INFO:tasks.workunit.client.0.smithi008.stdout:1/613: fdatasync d9/de/df/d17/d55/da8/fae 0 2023-10-18T20:58:34.015 INFO:tasks.workunit.client.1.smithi060.stdout:0/541: rename d3/d8/d3c/d87/d91 to d3/d8/d14/d55/dad 0 2023-10-18T20:58:34.015 INFO:tasks.workunit.client.1.smithi060.stdout:0/542: stat d3/d8/f22 0 2023-10-18T20:58:34.016 INFO:tasks.workunit.client.1.smithi060.stdout:5/572: mknod d0/da/cd8 0 2023-10-18T20:58:34.016 INFO:tasks.workunit.client.0.smithi008.stdout:1/614: read - d9/de/df/d17/d25/d57/fac zero size 2023-10-18T20:58:34.016 INFO:tasks.workunit.client.0.smithi008.stdout:4/468: creat d0/d17/f98 x:0 0 0 2023-10-18T20:58:34.022 INFO:tasks.workunit.client.1.smithi060.stdout:1/622: getdents d4/da 0 2023-10-18T20:58:34.029 INFO:tasks.workunit.client.0.smithi008.stdout:2/523: rename d1/d3/dd/d25/d4d/c99 to d1/d3/dd/d1c/d3a/ca9 0 2023-10-18T20:58:34.032 INFO:tasks.workunit.client.0.smithi008.stdout:1/615: dread d9/de/df/d17/d55/f78 [0,4194304] 0 2023-10-18T20:58:34.033 INFO:tasks.workunit.client.1.smithi060.stdout:7/579: dread de/d29/f77 [0,4194304] 0 2023-10-18T20:58:34.034 INFO:tasks.workunit.client.1.smithi060.stdout:7/580: creat de/d14/d49/da3/fbe x:0 0 0 2023-10-18T20:58:34.034 INFO:tasks.workunit.client.1.smithi060.stdout:7/581: chown de/d14/d2f/d8f/d5b/f74 217448738 1 2023-10-18T20:58:34.051 INFO:tasks.workunit.client.0.smithi008.stdout:3/449: mknod d0/d3/c87 0 2023-10-18T20:58:34.051 INFO:tasks.workunit.client.0.smithi008.stdout:3/450: fdatasync d0/d3/de/d13/f28 0 2023-10-18T20:58:34.051 INFO:tasks.workunit.client.0.smithi008.stdout:3/451: write d0/d3/de/d13/f24 [1226038,14943] 0 2023-10-18T20:58:34.055 INFO:tasks.workunit.client.0.smithi008.stdout:9/462: sync 2023-10-18T20:58:34.055 INFO:tasks.workunit.client.0.smithi008.stdout:9/463: chown d2/dc/f4c 179839321 1 2023-10-18T20:58:34.061 INFO:tasks.workunit.client.1.smithi060.stdout:4/494: dwrite d4/dc/d2a/f54 [0,4194304] 0 2023-10-18T20:58:34.062 INFO:tasks.workunit.client.0.smithi008.stdout:5/514: sync 2023-10-18T20:58:34.063 INFO:tasks.workunit.client.0.smithi008.stdout:8/631: sync 2023-10-18T20:58:34.063 INFO:tasks.workunit.client.0.smithi008.stdout:8/632: chown d5/d8/df/d54/ca1 182460 1 2023-10-18T20:58:34.063 INFO:tasks.workunit.client.0.smithi008.stdout:8/633: chown d5/d8/df/d9d/d4d/dba/dd4/f63 102633368 1 2023-10-18T20:58:34.064 INFO:tasks.workunit.client.0.smithi008.stdout:9/464: truncate d2/f5 4200032 0 2023-10-18T20:58:34.064 INFO:tasks.workunit.client.0.smithi008.stdout:6/557: rename df/d74 to df/d15/d27/dbf 0 2023-10-18T20:58:34.067 INFO:tasks.workunit.client.0.smithi008.stdout:2/524: write d1/d3/dd/d1c/f74 [11469816,130186] 0 2023-10-18T20:58:34.067 INFO:tasks.workunit.client.0.smithi008.stdout:2/525: chown d1/d3/f1b 0 1 2023-10-18T20:58:34.069 INFO:tasks.workunit.client.0.smithi008.stdout:5/515: mknod d0/d86/cbd 0 2023-10-18T20:58:34.069 INFO:tasks.workunit.client.0.smithi008.stdout:5/516: stat d0/d2/d19/d7c/d64/c6a 0 2023-10-18T20:58:34.072 INFO:tasks.workunit.client.0.smithi008.stdout:9/465: creat d2/dc/d1a/d1d/f82 x:0 0 0 2023-10-18T20:58:34.072 INFO:tasks.workunit.client.0.smithi008.stdout:9/466: dread - d2/dc/d17/f77 zero size 2023-10-18T20:58:34.073 INFO:tasks.workunit.client.1.smithi060.stdout:8/518: dwrite d4/d9/f2e [0,4194304] 0 2023-10-18T20:58:34.076 INFO:tasks.workunit.client.0.smithi008.stdout:4/469: rename d0/d17/d78 to d0/d17/d5b/d99 0 2023-10-18T20:58:34.077 INFO:tasks.workunit.client.0.smithi008.stdout:2/526: mkdir d1/d3/dd/d1c/d3a/d45/daa 0 2023-10-18T20:58:34.079 INFO:tasks.workunit.client.0.smithi008.stdout:8/634: truncate d5/f28 700955 0 2023-10-18T20:58:34.080 INFO:tasks.workunit.client.0.smithi008.stdout:8/635: write d5/d8/df/d9d/d4d/dba/dd4/d50/d53/d8c/db4/fdc [255287,58541] 0 2023-10-18T20:58:34.083 INFO:tasks.workunit.client.1.smithi060.stdout:1/623: dwrite d4/da/f53 [0,4194304] 0 2023-10-18T20:58:34.093 INFO:tasks.workunit.client.0.smithi008.stdout:5/517: creat d0/d2/d19/d7c/d31/d3f/d70/fbe x:0 0 0 2023-10-18T20:58:34.094 INFO:tasks.workunit.client.0.smithi008.stdout:6/558: write df/d13/f1a [1024404,40119] 0 2023-10-18T20:58:34.094 INFO:tasks.workunit.client.0.smithi008.stdout:6/559: creat df/d15/fc0 x:0 0 0 2023-10-18T20:58:34.098 INFO:tasks.workunit.client.1.smithi060.stdout:7/582: dwrite de/d14/d2f/d8f/d65/fa9 [4194304,4194304] 0 2023-10-18T20:58:34.118 INFO:tasks.workunit.client.0.smithi008.stdout:4/470: dread d0/f12 [4194304,4194304] 0 2023-10-18T20:58:34.123 INFO:tasks.workunit.client.0.smithi008.stdout:9/467: creat d2/d8/f83 x:0 0 0 2023-10-18T20:58:34.123 INFO:tasks.workunit.client.0.smithi008.stdout:2/527: rename d1/d3/d40/d6e/l9a to d1/lab 0 2023-10-18T20:58:34.123 INFO:tasks.workunit.client.0.smithi008.stdout:2/528: chown d1/d3/dd/d25/d4d/c9b 54041362 1 2023-10-18T20:58:34.123 INFO:tasks.workunit.client.0.smithi008.stdout:9/468: creat d2/d8/f84 x:0 0 0 2023-10-18T20:58:34.124 INFO:tasks.workunit.client.0.smithi008.stdout:9/469: chown d2/dc/f6d 7 1 2023-10-18T20:58:34.124 INFO:tasks.workunit.client.1.smithi060.stdout:3/492: dwrite d0/d22/f70 [0,4194304] 0 2023-10-18T20:58:34.128 INFO:tasks.workunit.client.1.smithi060.stdout:7/583: rename de/d14/d2f/d8f/d65/fa5 to de/d38/d78/fbf 0 2023-10-18T20:58:34.129 INFO:tasks.workunit.client.0.smithi008.stdout:8/636: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d53/dc0/fe9 x:0 0 0 2023-10-18T20:58:34.129 INFO:tasks.workunit.client.0.smithi008.stdout:8/637: chown d5/d8/df/d9d/d85/db1/ce3 5101 1 2023-10-18T20:58:34.129 INFO:tasks.workunit.client.0.smithi008.stdout:8/638: stat d5/d8/df/d9d/d4d/db5/f64 0 2023-10-18T20:58:34.131 INFO:tasks.workunit.client.1.smithi060.stdout:1/624: rmdir d4/d6/d7/d2f/d7b/d2a/d32/dd/da4 39 2023-10-18T20:58:34.138 INFO:tasks.workunit.client.1.smithi060.stdout:5/573: dread d0/da/d79/da5/f9e [0,4194304] 0 2023-10-18T20:58:34.139 INFO:tasks.workunit.client.0.smithi008.stdout:4/471: link d0/d17/f6c d0/d58/d8e/f9a 0 2023-10-18T20:58:34.139 INFO:tasks.workunit.client.1.smithi060.stdout:3/493: mknod d0/d22/d26/d29/ca9 0 2023-10-18T20:58:34.141 INFO:tasks.workunit.client.1.smithi060.stdout:7/584: rename de/d14/d2f/d3f/l57 to de/d29/d9c/lc0 0 2023-10-18T20:58:34.142 INFO:tasks.workunit.client.1.smithi060.stdout:7/585: chown de/d29/d9c 339930 1 2023-10-18T20:58:34.143 INFO:tasks.workunit.client.0.smithi008.stdout:9/470: write d2/dc/d1a/d1d/f58 [1836463,38947] 0 2023-10-18T20:58:34.143 INFO:tasks.workunit.client.0.smithi008.stdout:9/471: chown d2/dc/d40/d46/l53 2 1 2023-10-18T20:58:34.144 INFO:tasks.workunit.client.0.smithi008.stdout:8/639: rmdir d5/d8/df/d9d/d4d/dba/dd4/d50 39 2023-10-18T20:58:34.144 INFO:tasks.workunit.client.0.smithi008.stdout:8/640: chown d5/d8/df/d9d/d4d/db5/da3/fcd 117736 1 2023-10-18T20:58:34.144 INFO:tasks.workunit.client.0.smithi008.stdout:8/641: readlink d5/ld 0 2023-10-18T20:58:34.145 INFO:tasks.workunit.client.1.smithi060.stdout:1/625: truncate d4/d6/d7/f26 2107491 0 2023-10-18T20:58:34.148 INFO:tasks.workunit.client.1.smithi060.stdout:2/529: dwrite d0/d3/d27/d4d/d5e/f5f [0,4194304] 0 2023-10-18T20:58:34.148 INFO:tasks.workunit.client.1.smithi060.stdout:5/574: link d0/d6/d8/df/l78 d0/da/d3b/ld9 0 2023-10-18T20:58:34.148 INFO:tasks.workunit.client.0.smithi008.stdout:4/472: chown d0/d3/l63 15 1 2023-10-18T20:58:34.149 INFO:tasks.workunit.client.1.smithi060.stdout:3/494: mknod d0/d3c/d3d/d4d/caa 0 2023-10-18T20:58:34.150 INFO:tasks.workunit.client.1.smithi060.stdout:9/460: dwrite d3/d58/f64 [0,4194304] 0 2023-10-18T20:58:34.151 INFO:tasks.workunit.client.0.smithi008.stdout:2/529: mkdir d1/d3/dd/dac 0 2023-10-18T20:58:34.152 INFO:tasks.workunit.client.0.smithi008.stdout:2/530: write d1/f19 [3627945,22070] 0 2023-10-18T20:58:34.155 INFO:tasks.workunit.client.0.smithi008.stdout:8/642: dread d5/d8/df/f19 [0,4194304] 0 2023-10-18T20:58:34.155 INFO:tasks.workunit.client.0.smithi008.stdout:8/643: fsync d5/d8/df/d9d/d4d/dba/dd4/d77/fa5 0 2023-10-18T20:58:34.155 INFO:tasks.workunit.client.0.smithi008.stdout:8/644: read d5/d8/df/d9d/d4d/dba/dd4/d50/f5e [4032001,15070] 0 2023-10-18T20:58:34.156 INFO:tasks.workunit.client.1.smithi060.stdout:2/530: write d0/d45/d49/f3f [180726,77883] 0 2023-10-18T20:58:34.156 INFO:tasks.workunit.client.1.smithi060.stdout:2/531: write d0/d3/d27/f57 [1220825,5966] 0 2023-10-18T20:58:34.158 INFO:tasks.workunit.client.1.smithi060.stdout:1/626: mknod d4/d6/d7/d2f/d7b/d2a/d32/d56/d5f/cca 0 2023-10-18T20:58:34.160 INFO:tasks.workunit.client.1.smithi060.stdout:1/627: write d4/d6/d7/df/d59/fb8 [499092,24793] 0 2023-10-18T20:58:34.161 INFO:tasks.workunit.client.1.smithi060.stdout:1/628: dread - d4/da/d42/fc4 zero size 2023-10-18T20:58:34.161 INFO:tasks.workunit.client.1.smithi060.stdout:1/629: stat d4/da/f50 0 2023-10-18T20:58:34.162 INFO:tasks.workunit.client.0.smithi008.stdout:2/531: rmdir d1/d3/dd/d1c/d3a/d57 39 2023-10-18T20:58:34.162 INFO:tasks.workunit.client.0.smithi008.stdout:2/532: read d1/f18 [931784,17904] 0 2023-10-18T20:58:34.163 INFO:tasks.workunit.client.0.smithi008.stdout:8/645: creat d5/d8/df/d9d/d4d/dba/dd4/d50/fea x:0 0 0 2023-10-18T20:58:34.163 INFO:tasks.workunit.client.0.smithi008.stdout:9/472: rename d2/l11 to d2/dc/d17/d19/l85 0 2023-10-18T20:58:34.163 INFO:tasks.workunit.client.0.smithi008.stdout:9/473: readlink d2/dc/d17/l3a 0 2023-10-18T20:58:34.164 INFO:tasks.workunit.client.0.smithi008.stdout:8/646: mkdir d5/d8/df/d9d/d4d/dba/dd4/d50/d53/d8c/db4/db7/deb 0 2023-10-18T20:58:34.172 INFO:tasks.workunit.client.0.smithi008.stdout:4/473: write d0/d17/d5b/fa [889413,105402] 0 2023-10-18T20:58:34.174 INFO:tasks.workunit.client.0.smithi008.stdout:4/474: mknod d0/d17/d5b/c9b 0 2023-10-18T20:58:34.175 INFO:tasks.workunit.client.0.smithi008.stdout:4/475: mknod d0/c9c 0 2023-10-18T20:58:34.176 INFO:tasks.workunit.client.1.smithi060.stdout:1/630: write d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/fbf [69984,54740] 0 2023-10-18T20:58:34.176 INFO:tasks.workunit.client.1.smithi060.stdout:1/631: stat d4/d6/d7/d2f/d7b/d2a/d32/d56/daa/fc1 0 2023-10-18T20:58:34.176 INFO:tasks.workunit.client.1.smithi060.stdout:9/461: rename d3/ff to d3/d99/d1c/d5a/d5d/d56/fb4 0 2023-10-18T20:58:34.176 INFO:tasks.workunit.client.1.smithi060.stdout:1/632: creat d4/d6/d7/d2f/d7b/d2a/d32/fcb x:0 0 0 2023-10-18T20:58:34.177 INFO:tasks.workunit.client.1.smithi060.stdout:6/544: dwrite d10/f4d [0,4194304] 0 2023-10-18T20:58:34.177 INFO:tasks.workunit.client.1.smithi060.stdout:6/545: write d10/d2e/d75/d77/fa5 [238827,31605] 0 2023-10-18T20:58:34.178 INFO:tasks.workunit.client.0.smithi008.stdout:1/616: dwrite d9/de/df/d17/f70 [0,4194304] 0 2023-10-18T20:58:34.178 INFO:tasks.workunit.client.0.smithi008.stdout:1/617: chown d9/de/df/d17/d1e/d3c/fa3 62844 1 2023-10-18T20:58:34.178 INFO:tasks.workunit.client.0.smithi008.stdout:1/618: dread - d9/de/df/d17/d1e/d3c/d90/f99 zero size 2023-10-18T20:58:34.178 INFO:tasks.workunit.client.0.smithi008.stdout:1/619: write d9/f7a [1012007,99608] 0 2023-10-18T20:58:34.181 INFO:tasks.workunit.client.0.smithi008.stdout:1/620: mknod d9/de/df/d17/d55/cb9 0 2023-10-18T20:58:34.182 INFO:tasks.workunit.client.0.smithi008.stdout:1/621: truncate d9/de/df/d17/d1e/d3c/d90/f99 385092 0 2023-10-18T20:58:34.182 INFO:tasks.workunit.client.0.smithi008.stdout:1/622: creat d9/de/df/d77/fba x:0 0 0 2023-10-18T20:58:34.182 INFO:tasks.workunit.client.0.smithi008.stdout:1/623: fsync d9/de/f80 0 2023-10-18T20:58:34.182 INFO:tasks.workunit.client.0.smithi008.stdout:1/624: write d9/de/f45 [2669925,112795] 0 2023-10-18T20:58:34.182 INFO:tasks.workunit.client.0.smithi008.stdout:1/625: creat d9/de/df/fbb x:0 0 0 2023-10-18T20:58:34.186 INFO:tasks.workunit.client.1.smithi060.stdout:8/519: dwrite d4/d9/d37/f3c [0,4194304] 0 2023-10-18T20:58:34.187 INFO:tasks.workunit.client.1.smithi060.stdout:8/520: readlink d4/d9/l62 0 2023-10-18T20:58:34.193 INFO:tasks.workunit.client.0.smithi008.stdout:2/533: dread d1/d3/dd/f50 [0,4194304] 0 2023-10-18T20:58:34.194 INFO:tasks.workunit.client.1.smithi060.stdout:0/543: dwrite d3/d8/d14/d55/d74/d76/d68/f92 [0,4194304] 0 2023-10-18T20:58:34.194 INFO:tasks.workunit.client.1.smithi060.stdout:0/544: fsync d3/d8/d14/f2b 0 2023-10-18T20:58:34.196 INFO:tasks.workunit.client.0.smithi008.stdout:3/452: dwrite d0/d3/de/d13/d35/f3b [0,4194304] 0 2023-10-18T20:58:34.199 INFO:tasks.workunit.client.0.smithi008.stdout:6/560: dwrite df/d15/d48/fa8 [0,4194304] 0 2023-10-18T20:58:34.206 INFO:tasks.workunit.client.1.smithi060.stdout:7/586: dwrite fc [0,4194304] 0 2023-10-18T20:58:34.206 INFO:tasks.workunit.client.1.smithi060.stdout:7/587: chown de/d14/d3a/d46/d73/faa 46589957 1 2023-10-18T20:58:34.207 INFO:tasks.workunit.client.0.smithi008.stdout:3/453: mkdir d0/d3/d42/d88 0 2023-10-18T20:58:34.217 INFO:tasks.workunit.client.1.smithi060.stdout:2/532: dwrite d0/d3/d27/d4d/f5b [0,4194304] 0 2023-10-18T20:58:34.217 INFO:tasks.workunit.client.1.smithi060.stdout:2/533: readlink d0/d8/d87/l88 0 2023-10-18T20:58:34.220 INFO:tasks.workunit.client.1.smithi060.stdout:0/545: dread d3/d32/d86/f8c [0,4194304] 0 2023-10-18T20:58:34.220 INFO:tasks.workunit.client.1.smithi060.stdout:0/546: fsync d3/d80/f90 0 2023-10-18T20:58:34.222 INFO:tasks.workunit.client.0.smithi008.stdout:3/454: creat d0/d3/d37/d74/f89 x:0 0 0 2023-10-18T20:58:34.230 INFO:tasks.workunit.client.1.smithi060.stdout:6/546: dwrite d10/d17/d70/f88 [0,4194304] 0 2023-10-18T20:58:34.231 INFO:tasks.workunit.client.1.smithi060.stdout:6/547: chown d10/d25/d3c 37565496 1 2023-10-18T20:58:34.232 INFO:tasks.workunit.client.1.smithi060.stdout:9/462: rmdir d3/d99/d1c/d5a/d5d 39 2023-10-18T20:58:34.235 INFO:tasks.workunit.client.0.smithi008.stdout:6/561: dread df/d15/f40 [4194304,4194304] 0 2023-10-18T20:58:34.236 INFO:tasks.workunit.client.1.smithi060.stdout:7/588: mknod de/d14/d41/cc1 0 2023-10-18T20:58:34.236 INFO:tasks.workunit.client.0.smithi008.stdout:6/562: read df/d15/f46 [218996,107857] 0 2023-10-18T20:58:34.238 INFO:tasks.workunit.client.1.smithi060.stdout:3/495: dwrite d0/d22/d26/d2c/fa6 [0,4194304] 0 2023-10-18T20:58:34.239 INFO:tasks.workunit.client.0.smithi008.stdout:9/474: dwrite d2/dc/d3d/f73 [0,4194304] 0 2023-10-18T20:58:34.239 INFO:tasks.workunit.client.0.smithi008.stdout:9/475: dread - d2/dc/f6d zero size 2023-10-18T20:58:34.239 INFO:tasks.workunit.client.0.smithi008.stdout:9/476: write d2/d8/f83 [1040007,53482] 0 2023-10-18T20:58:34.240 INFO:tasks.workunit.client.0.smithi008.stdout:9/477: write d2/f26 [1900156,42503] 0 2023-10-18T20:58:34.240 INFO:tasks.workunit.client.0.smithi008.stdout:9/478: stat d2/dc/d1a/d61/d59/f66 0 2023-10-18T20:58:34.240 INFO:tasks.workunit.client.1.smithi060.stdout:8/521: dwrite d4/d9/d31/f5a [0,4194304] 0 2023-10-18T20:58:34.241 INFO:tasks.workunit.client.1.smithi060.stdout:8/522: write d4/d9/d31/f66 [1038405,111521] 0 2023-10-18T20:58:34.241 INFO:tasks.workunit.client.1.smithi060.stdout:8/523: chown d4/d9/d4f/d74/c80 3526 1 2023-10-18T20:58:34.241 INFO:tasks.workunit.client.1.smithi060.stdout:8/524: unlink d4/d9/d31/d35/l97 0 2023-10-18T20:58:34.244 INFO:tasks.workunit.client.0.smithi008.stdout:8/647: rename d5/d8/df/d9d/d4d/dba/dd4/d50/d53 to d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec 0 2023-10-18T20:58:34.245 INFO:tasks.workunit.client.1.smithi060.stdout:1/633: dwrite d4/d38/f7f [0,4194304] 0 2023-10-18T20:58:34.246 INFO:tasks.workunit.client.1.smithi060.stdout:1/634: write d4/d6/d33/f7d [1415567,9982] 0 2023-10-18T20:58:34.246 INFO:tasks.workunit.client.1.smithi060.stdout:1/635: stat d4/d6/d7/c80 0 2023-10-18T20:58:34.252 INFO:tasks.workunit.client.1.smithi060.stdout:9/463: read d3/f20 [533433,114901] 0 2023-10-18T20:58:34.252 INFO:tasks.workunit.client.1.smithi060.stdout:9/464: creat d3/d99/d1c/d2a/d33/fb5 x:0 0 0 2023-10-18T20:58:34.252 INFO:tasks.workunit.client.1.smithi060.stdout:9/465: chown d3/f5e 0 1 2023-10-18T20:58:34.258 INFO:tasks.workunit.client.0.smithi008.stdout:9/479: symlink d2/dc/d40/l86 0 2023-10-18T20:58:34.260 INFO:tasks.workunit.client.0.smithi008.stdout:3/455: symlink d0/d3/de/d13/d35/l8a 0 2023-10-18T20:58:34.260 INFO:tasks.workunit.client.0.smithi008.stdout:3/456: readlink d0/l7b 0 2023-10-18T20:58:34.262 INFO:tasks.workunit.client.1.smithi060.stdout:7/589: rename de/f6f to de/d14/d49/d68/d7d/d7e/fc2 0 2023-10-18T20:58:34.262 INFO:tasks.workunit.client.1.smithi060.stdout:7/590: chown de/d14/c28 0 1 2023-10-18T20:58:34.265 INFO:tasks.workunit.client.1.smithi060.stdout:8/525: dread d4/d9/d37/f3d [0,4194304] 0 2023-10-18T20:58:34.266 INFO:tasks.workunit.client.0.smithi008.stdout:4/476: rename d0/d76/f96 to d0/d3/d21/d57/d8f/d82/f9d 0 2023-10-18T20:58:34.267 INFO:tasks.workunit.client.1.smithi060.stdout:8/526: dread - d4/d9/d37/d4e/d6e/f95 zero size 2023-10-18T20:58:34.267 INFO:tasks.workunit.client.0.smithi008.stdout:9/480: mknod d2/dc/d40/d5a/c87 0 2023-10-18T20:58:34.268 INFO:tasks.workunit.client.0.smithi008.stdout:9/481: read - d2/dc/d17/d19/d4a/f81 zero size 2023-10-18T20:58:34.268 INFO:tasks.workunit.client.1.smithi060.stdout:9/466: dread d3/d99/d1c/d2a/d33/f31 [0,4194304] 0 2023-10-18T20:58:34.269 INFO:tasks.workunit.client.0.smithi008.stdout:3/457: symlink d0/d3/d42/l8b 0 2023-10-18T20:58:34.270 INFO:tasks.workunit.client.1.smithi060.stdout:9/467: write d3/d99/d19/f6e [170671,101526] 0 2023-10-18T20:58:34.270 INFO:tasks.workunit.client.1.smithi060.stdout:9/468: read - d3/d99/d1c/d5a/d5d/f79 zero size 2023-10-18T20:58:34.286 INFO:tasks.workunit.client.0.smithi008.stdout:8/648: dread d5/d8/f41 [0,4194304] 0 2023-10-18T20:58:34.286 INFO:tasks.workunit.client.0.smithi008.stdout:8/649: fsync d5/f37 0 2023-10-18T20:58:34.286 INFO:tasks.workunit.client.0.smithi008.stdout:8/650: chown d5/d8/df/d9d/d85/ca8 34369 1 2023-10-18T20:58:34.286 INFO:tasks.workunit.client.0.smithi008.stdout:8/651: creat d5/d8/df/d9d/d4d/dba/dd4/fed x:0 0 0 2023-10-18T20:58:34.287 INFO:tasks.workunit.client.0.smithi008.stdout:8/652: truncate d5/d8/df/f9a 906796 0 2023-10-18T20:58:34.288 INFO:tasks.workunit.client.1.smithi060.stdout:8/527: dread d4/d9/d31/f8e [0,4194304] 0 2023-10-18T20:58:34.288 INFO:tasks.workunit.client.1.smithi060.stdout:8/528: fdatasync d4/d9/d37/d4e/d5e/f89 0 2023-10-18T20:58:34.291 INFO:tasks.workunit.client.1.smithi060.stdout:7/591: symlink de/d14/d2f/d3f/d5a/lc3 0 2023-10-18T20:58:34.291 INFO:tasks.workunit.client.1.smithi060.stdout:6/548: truncate d10/f4d 1533326 0 2023-10-18T20:58:34.292 INFO:tasks.workunit.client.1.smithi060.stdout:9/469: mkdir d3/d99/d19/d54/da5/db6 0 2023-10-18T20:58:34.292 INFO:tasks.workunit.client.1.smithi060.stdout:9/470: creat d3/d99/d1c/d2a/d80/fb7 x:0 0 0 2023-10-18T20:58:34.293 INFO:tasks.workunit.client.0.smithi008.stdout:3/458: dread d0/d3/d15/f44 [0,4194304] 0 2023-10-18T20:58:34.293 INFO:tasks.workunit.client.0.smithi008.stdout:3/459: write d0/d3/d37/f61 [529473,88310] 0 2023-10-18T20:58:34.294 INFO:tasks.workunit.client.0.smithi008.stdout:3/460: stat d0/d3/d37/c76 0 2023-10-18T20:58:34.294 INFO:tasks.workunit.client.0.smithi008.stdout:3/461: write d0/d4a/d64/f6a [217386,41133] 0 2023-10-18T20:58:34.294 INFO:tasks.workunit.client.0.smithi008.stdout:3/462: dread - d0/d3/d42/d52/f6b zero size 2023-10-18T20:58:34.295 INFO:tasks.workunit.client.1.smithi060.stdout:0/547: dwrite d3/d8/d14/d55/d74/d76/f47 [0,4194304] 0 2023-10-18T20:58:34.296 INFO:tasks.workunit.client.1.smithi060.stdout:0/548: chown d3/c69 400344 1 2023-10-18T20:58:34.296 INFO:tasks.workunit.client.1.smithi060.stdout:8/529: creat d4/d9/d31/d35/d9f/fa0 x:0 0 0 2023-10-18T20:58:34.296 INFO:tasks.workunit.client.1.smithi060.stdout:8/530: chown d4/d9/d37/d4e/d6e/c7a 581599 1 2023-10-18T20:58:34.296 INFO:tasks.workunit.client.1.smithi060.stdout:8/531: creat d4/d9/d37/d4e/d6e/d7b/fa1 x:0 0 0 2023-10-18T20:58:34.298 INFO:tasks.workunit.client.1.smithi060.stdout:8/532: read d4/f1f [2160501,81409] 0 2023-10-18T20:58:34.302 INFO:tasks.workunit.client.0.smithi008.stdout:3/463: symlink d0/d3/de/d13/d35/d51/l8c 0 2023-10-18T20:58:34.306 INFO:tasks.workunit.client.1.smithi060.stdout:6/549: unlink d10/d17/f23 0 2023-10-18T20:58:34.307 INFO:tasks.workunit.client.1.smithi060.stdout:6/550: fdatasync d10/d17/f97 0 2023-10-18T20:58:34.307 INFO:tasks.workunit.client.1.smithi060.stdout:6/551: write d10/d25/f4f [1190828,67681] 0 2023-10-18T20:58:34.307 INFO:tasks.workunit.client.1.smithi060.stdout:6/552: readlink d10/d25/l49 0 2023-10-18T20:58:34.308 INFO:tasks.workunit.client.1.smithi060.stdout:7/592: link de/d14/l61 de/d14/d49/d68/d88/lc4 0 2023-10-18T20:58:34.308 INFO:tasks.workunit.client.1.smithi060.stdout:7/593: truncate de/d14/d2f/d3f/d5a/f94 33354 0 2023-10-18T20:58:34.308 INFO:tasks.workunit.client.0.smithi008.stdout:3/464: creat d0/d3/de/d13/d35/d51/f8d x:0 0 0 2023-10-18T20:58:34.311 INFO:tasks.workunit.client.0.smithi008.stdout:3/465: rename d0/d3/d37/l3d to d0/d3/de/d13/d35/d51/l8e 0 2023-10-18T20:58:34.311 INFO:tasks.workunit.client.1.smithi060.stdout:0/549: readlink d3/d8/d3c/l6a 0 2023-10-18T20:58:34.312 INFO:tasks.workunit.client.1.smithi060.stdout:9/471: rmdir d3/d99/d19/d54/da5/db6 0 2023-10-18T20:58:34.317 INFO:tasks.workunit.client.1.smithi060.stdout:6/553: link d10/d3e/l85 d10/d2e/d75/d81/la7 0 2023-10-18T20:58:34.318 INFO:tasks.workunit.client.0.smithi008.stdout:3/466: symlink d0/d3/l8f 0 2023-10-18T20:58:34.320 INFO:tasks.workunit.client.1.smithi060.stdout:2/534: dwrite d0/d8/f2b [8388608,4194304] 0 2023-10-18T20:58:34.320 INFO:tasks.workunit.client.1.smithi060.stdout:2/535: creat d0/d16/d81/da1/fac x:0 0 0 2023-10-18T20:58:34.321 INFO:tasks.workunit.client.1.smithi060.stdout:0/550: truncate d3/d8/d14/d55/d74/d76/d6b/f75 511328 0 2023-10-18T20:58:34.321 INFO:tasks.workunit.client.1.smithi060.stdout:9/472: mknod d3/d99/d1c/d5a/d5d/d2b/d9e/cb8 0 2023-10-18T20:58:34.323 INFO:tasks.workunit.client.1.smithi060.stdout:6/554: rename d10/d17/d2f/f8a to d10/d2e/d75/d77/fa8 0 2023-10-18T20:58:34.323 INFO:tasks.workunit.client.1.smithi060.stdout:6/555: chown d10/d2e/d75/d77/d8c/f8f 37 1 2023-10-18T20:58:34.324 INFO:tasks.workunit.client.0.smithi008.stdout:3/467: creat d0/d84/f90 x:0 0 0 2023-10-18T20:58:34.325 INFO:tasks.workunit.client.0.smithi008.stdout:6/563: dwrite df/d3c/d77/da9/f5a [0,4194304] 0 2023-10-18T20:58:34.332 INFO:tasks.workunit.client.1.smithi060.stdout:1/636: dwrite d4/d6/d7/df/f40 [0,4194304] 0 2023-10-18T20:58:34.333 INFO:tasks.workunit.client.1.smithi060.stdout:2/536: symlink d0/d3/d27/d4d/d5e/d96/lad 0 2023-10-18T20:58:34.334 INFO:tasks.workunit.client.1.smithi060.stdout:4/495: sync 2023-10-18T20:58:34.334 INFO:tasks.workunit.client.1.smithi060.stdout:4/496: creat d4/d15/f8e x:0 0 0 2023-10-18T20:58:34.336 INFO:tasks.workunit.client.0.smithi008.stdout:6/564: mknod df/d18/d58/cc1 0 2023-10-18T20:58:34.338 INFO:tasks.workunit.client.0.smithi008.stdout:9/482: dwrite d2/dc/d17/d19/f41 [0,4194304] 0 2023-10-18T20:58:34.340 INFO:tasks.workunit.client.0.smithi008.stdout:3/468: write d0/d3/f5 [2949,91437] 0 2023-10-18T20:58:34.341 INFO:tasks.workunit.client.0.smithi008.stdout:4/477: dwrite d0/d58/d8e/f53 [0,4194304] 0 2023-10-18T20:58:34.343 INFO:tasks.workunit.client.1.smithi060.stdout:6/556: rename d10/d9f to d10/d6f/da9 0 2023-10-18T20:58:34.344 INFO:tasks.workunit.client.1.smithi060.stdout:6/557: fsync d10/d17/f82 0 2023-10-18T20:58:34.344 INFO:tasks.workunit.client.1.smithi060.stdout:1/637: creat d4/d6/d33/fcc x:0 0 0 2023-10-18T20:58:34.344 INFO:tasks.workunit.client.1.smithi060.stdout:1/638: fdatasync d4/d6/fb4 0 2023-10-18T20:58:34.344 INFO:tasks.workunit.client.1.smithi060.stdout:2/537: mkdir d0/d45/d49/d55/dae 0 2023-10-18T20:58:34.345 INFO:tasks.workunit.client.1.smithi060.stdout:9/473: write d3/d99/d1c/d2a/d33/f85 [2136164,103396] 0 2023-10-18T20:58:34.345 INFO:tasks.workunit.client.1.smithi060.stdout:9/474: read - d3/d99/faa zero size 2023-10-18T20:58:34.348 INFO:tasks.workunit.client.1.smithi060.stdout:0/551: rmdir d3/d8/d3c/d87 39 2023-10-18T20:58:34.351 INFO:tasks.workunit.client.1.smithi060.stdout:7/594: getdents de/d14/d2f/d3f/d5a 0 2023-10-18T20:58:34.360 INFO:tasks.workunit.client.1.smithi060.stdout:1/639: write d4/da/f5a [1048101,47961] 0 2023-10-18T20:58:34.360 INFO:tasks.workunit.client.1.smithi060.stdout:1/640: fdatasync d4/d6/d7/d2f/d7b/d2a/f46 0 2023-10-18T20:58:34.366 INFO:tasks.workunit.client.0.smithi008.stdout:4/478: rename d0/d3/d21/l70 to d0/d3/d21/l9e 0 2023-10-18T20:58:34.367 INFO:tasks.workunit.client.0.smithi008.stdout:4/479: chown d0/d3 2517071 1 2023-10-18T20:58:34.367 INFO:tasks.workunit.client.1.smithi060.stdout:5/575: sync 2023-10-18T20:58:34.368 INFO:tasks.workunit.client.0.smithi008.stdout:4/480: creat d0/d17/d6e/f9f x:0 0 0 2023-10-18T20:58:34.368 INFO:tasks.workunit.client.0.smithi008.stdout:4/481: write d0/d17/f98 [346725,123292] 0 2023-10-18T20:58:34.369 INFO:tasks.workunit.client.1.smithi060.stdout:6/558: symlink d10/d25/laa 0 2023-10-18T20:58:34.370 INFO:tasks.workunit.client.1.smithi060.stdout:6/559: readlink d10/d25/l80 0 2023-10-18T20:58:34.385 INFO:tasks.workunit.client.1.smithi060.stdout:2/538: rename d0/d3/d27/d4d/f54 to d0/d16/d7f/faf 0 2023-10-18T20:58:34.389 INFO:tasks.workunit.client.0.smithi008.stdout:6/565: dwrite df/d15/d27/f4a [8388608,4194304] 0 2023-10-18T20:58:34.390 INFO:tasks.workunit.client.0.smithi008.stdout:6/566: fsync df/d18/d3f/f7b 0 2023-10-18T20:58:34.390 INFO:tasks.workunit.client.0.smithi008.stdout:6/567: readlink df/d13/d53/lad 0 2023-10-18T20:58:34.390 INFO:tasks.workunit.client.0.smithi008.stdout:4/482: truncate d0/d17/d5b/fb 9840546 0 2023-10-18T20:58:34.392 INFO:tasks.workunit.client.0.smithi008.stdout:4/483: fsync d0/d3/d21/d42/f50 0 2023-10-18T20:58:34.393 INFO:tasks.workunit.client.0.smithi008.stdout:4/484: write d0/d3/d21/f5a [1750582,37886] 0 2023-10-18T20:58:34.393 INFO:tasks.workunit.client.0.smithi008.stdout:4/485: dread - d0/d17/d6e/f9f zero size 2023-10-18T20:58:34.396 INFO:tasks.workunit.client.1.smithi060.stdout:0/552: symlink d3/d32/lae 0 2023-10-18T20:58:34.396 INFO:tasks.workunit.client.1.smithi060.stdout:6/560: mkdir d10/d47/d92/dab 0 2023-10-18T20:58:34.396 INFO:tasks.workunit.client.1.smithi060.stdout:6/561: fsync f7 0 2023-10-18T20:58:34.398 INFO:tasks.workunit.client.1.smithi060.stdout:4/497: rename d4/d15/d2b/l61 to d4/dc/d2a/d39/l8f 0 2023-10-18T20:58:34.404 INFO:tasks.workunit.client.0.smithi008.stdout:9/483: dread d2/dc/f22 [4194304,4194304] 0 2023-10-18T20:58:34.404 INFO:tasks.workunit.client.1.smithi060.stdout:9/475: mkdir d3/d99/d1c/d2a/d2d/db9 0 2023-10-18T20:58:34.404 INFO:tasks.workunit.client.1.smithi060.stdout:0/553: rmdir d3/d8/d14/d55 39 2023-10-18T20:58:34.405 INFO:tasks.workunit.client.1.smithi060.stdout:0/554: write d3/d8/d14/d55/dad/fa9 [2446739,119673] 0 2023-10-18T20:58:34.407 INFO:tasks.workunit.client.0.smithi008.stdout:6/568: write df/f3b [799775,125781] 0 2023-10-18T20:58:34.407 INFO:tasks.workunit.client.0.smithi008.stdout:6/569: write df/d3c/da2/fb4 [301302,39582] 0 2023-10-18T20:58:34.409 INFO:tasks.workunit.client.1.smithi060.stdout:9/476: rename d3/d99/d1c/d2a/d33/f31 to d3/d99/d1c/d5a/d5d/d2b/fba 0 2023-10-18T20:58:34.410 INFO:tasks.workunit.client.1.smithi060.stdout:9/477: stat d3/d58/f95 0 2023-10-18T20:58:34.410 INFO:tasks.workunit.client.1.smithi060.stdout:9/478: readlink d3/l76 0 2023-10-18T20:58:34.410 INFO:tasks.workunit.client.0.smithi008.stdout:4/486: truncate d0/d17/f60 3649853 0 2023-10-18T20:58:34.411 INFO:tasks.workunit.client.0.smithi008.stdout:6/570: symlink df/d18/d7e/lc2 0 2023-10-18T20:58:34.414 INFO:tasks.workunit.client.0.smithi008.stdout:4/487: creat d0/d3/d21/d42/fa0 x:0 0 0 2023-10-18T20:58:34.415 INFO:tasks.workunit.client.1.smithi060.stdout:9/479: truncate d3/d99/f11 948636 0 2023-10-18T20:58:34.421 INFO:tasks.workunit.client.0.smithi008.stdout:6/571: creat df/d13/d53/d64/fc3 x:0 0 0 2023-10-18T20:58:34.425 INFO:tasks.workunit.client.0.smithi008.stdout:4/488: rename d0/d3/d21/f51 to d0/d76/fa1 0 2023-10-18T20:58:34.426 INFO:tasks.workunit.client.1.smithi060.stdout:7/595: dwrite de/d14/d41/f6a [0,4194304] 0 2023-10-18T20:58:34.429 INFO:tasks.workunit.client.1.smithi060.stdout:9/480: rename d3/d99/d65/l9d to d3/d99/lbb 0 2023-10-18T20:58:34.431 INFO:tasks.workunit.client.1.smithi060.stdout:5/576: dwrite d0/d6/d8/f44 [0,4194304] 0 2023-10-18T20:58:34.433 INFO:tasks.workunit.client.1.smithi060.stdout:7/596: truncate de/d29/f31 4015481 0 2023-10-18T20:58:34.434 INFO:tasks.workunit.client.1.smithi060.stdout:9/481: creat d3/d99/d1c/d2a/d2d/fbc x:0 0 0 2023-10-18T20:58:34.435 INFO:tasks.workunit.client.1.smithi060.stdout:9/482: chown d3/d99/c70 0 1 2023-10-18T20:58:34.435 INFO:tasks.workunit.client.1.smithi060.stdout:9/483: readlink d3/d99/d9f/lab 0 2023-10-18T20:58:34.436 INFO:tasks.workunit.client.1.smithi060.stdout:5/577: rmdir d0/d6/d9/d82/d84 39 2023-10-18T20:58:34.437 INFO:tasks.workunit.client.1.smithi060.stdout:5/578: write d0/da/f9a [713261,102030] 0 2023-10-18T20:58:34.438 INFO:tasks.workunit.client.1.smithi060.stdout:9/484: creat d3/d99/d1c/d25/fbd x:0 0 0 2023-10-18T20:58:34.439 INFO:tasks.workunit.client.1.smithi060.stdout:5/579: write d0/da/d3b/f8f [8874587,51289] 0 2023-10-18T20:58:34.448 INFO:tasks.workunit.client.1.smithi060.stdout:7/597: rmdir de/d14/d3a/d46/d73 39 2023-10-18T20:58:34.448 INFO:tasks.workunit.client.1.smithi060.stdout:7/598: stat c1 0 2023-10-18T20:58:34.448 INFO:tasks.workunit.client.1.smithi060.stdout:7/599: write de/d14/d2f/d3f/d5a/f94 [803636,23544] 0 2023-10-18T20:58:34.449 INFO:tasks.workunit.client.1.smithi060.stdout:9/485: getdents d3/d99/d1c/d5a/d5d 0 2023-10-18T20:58:34.450 INFO:tasks.workunit.client.1.smithi060.stdout:9/486: write d3/f1b [2947764,38671] 0 2023-10-18T20:58:34.452 INFO:tasks.workunit.client.1.smithi060.stdout:7/600: mknod de/d14/cc5 0 2023-10-18T20:58:34.458 INFO:tasks.workunit.client.1.smithi060.stdout:7/601: mkdir de/d14/d41/dc6 0 2023-10-18T20:58:34.461 INFO:tasks.workunit.client.0.smithi008.stdout:3/469: dwrite d0/d3/d42/f30 [0,4194304] 0 2023-10-18T20:58:34.462 INFO:tasks.workunit.client.0.smithi008.stdout:3/470: readlink d0/d3/de/l32 0 2023-10-18T20:58:34.462 INFO:tasks.workunit.client.0.smithi008.stdout:3/471: stat d0/d3/d42 0 2023-10-18T20:58:34.463 INFO:tasks.workunit.client.0.smithi008.stdout:9/484: dwrite d2/dc/f1c [0,4194304] 0 2023-10-18T20:58:34.463 INFO:tasks.workunit.client.0.smithi008.stdout:4/489: dread d0/d17/f98 [0,4194304] 0 2023-10-18T20:58:34.470 INFO:tasks.workunit.client.0.smithi008.stdout:3/472: creat d0/d3/d42/d88/f91 x:0 0 0 2023-10-18T20:58:34.474 INFO:tasks.workunit.client.0.smithi008.stdout:3/473: symlink d0/d4a/d64/l92 0 2023-10-18T20:58:34.480 INFO:tasks.workunit.client.0.smithi008.stdout:9/485: rmdir d2/dc/d3d 39 2023-10-18T20:58:34.481 INFO:tasks.workunit.client.0.smithi008.stdout:9/486: write d2/dc/d1a/d1d/f58 [2157959,2788] 0 2023-10-18T20:58:34.481 INFO:tasks.workunit.client.0.smithi008.stdout:9/487: chown d2/dc/d40/d6f 44469151 1 2023-10-18T20:58:34.482 INFO:tasks.workunit.client.1.smithi060.stdout:1/641: dwrite d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f8e [0,4194304] 0 2023-10-18T20:58:34.482 INFO:tasks.workunit.client.0.smithi008.stdout:3/474: link d0/d3/d37/d74/f89 d0/d3/d37/d6f/f93 0 2023-10-18T20:58:34.490 INFO:tasks.workunit.client.1.smithi060.stdout:2/539: dwrite d0/d16/d81/da1/fab [0,4194304] 0 2023-10-18T20:58:34.491 INFO:tasks.workunit.client.1.smithi060.stdout:5/580: dread d0/d6/d9/d82/d84/db2/f40 [0,4194304] 0 2023-10-18T20:58:34.492 INFO:tasks.workunit.client.1.smithi060.stdout:5/581: chown d0/d6/d8/df/c10 293 1 2023-10-18T20:58:34.492 INFO:tasks.workunit.client.1.smithi060.stdout:9/487: write d3/d99/d1c/d2a/d33/f53 [3137025,37020] 0 2023-10-18T20:58:34.493 INFO:tasks.workunit.client.0.smithi008.stdout:3/475: rename d0/d3/f2b to d0/d3/d42/d52/f94 0 2023-10-18T20:58:34.502 INFO:tasks.workunit.client.0.smithi008.stdout:0/432: sync 2023-10-18T20:58:34.502 INFO:tasks.workunit.client.0.smithi008.stdout:3/476: symlink d0/d3/d37/d6f/l95 0 2023-10-18T20:58:34.502 INFO:tasks.workunit.client.0.smithi008.stdout:7/560: sync 2023-10-18T20:58:34.502 INFO:tasks.workunit.client.0.smithi008.stdout:9/488: getdents d2/d8 0 2023-10-18T20:58:34.503 INFO:tasks.workunit.client.0.smithi008.stdout:7/561: write d1/d36/d3d/d3e/d59/d73/d7b/fad [929512,14759] 0 2023-10-18T20:58:34.503 INFO:tasks.workunit.client.0.smithi008.stdout:9/489: symlink d2/dc/d17/d7b/l88 0 2023-10-18T20:58:34.504 INFO:tasks.workunit.client.0.smithi008.stdout:7/562: mknod d1/d36/d3d/d3e/d59/d73/d7b/daf/cb4 0 2023-10-18T20:58:34.505 INFO:tasks.workunit.client.1.smithi060.stdout:7/602: getdents de/d14/d41 0 2023-10-18T20:58:34.505 INFO:tasks.workunit.client.1.smithi060.stdout:7/603: read - de/d14/d2f/d8f/faf zero size 2023-10-18T20:58:34.505 INFO:tasks.workunit.client.1.smithi060.stdout:1/642: mknod d4/da/d6e/ccd 0 2023-10-18T20:58:34.506 INFO:tasks.workunit.client.1.smithi060.stdout:1/643: chown d4/d6/d48/f4b 27 1 2023-10-18T20:58:34.506 INFO:tasks.workunit.client.0.smithi008.stdout:9/490: symlink d2/dc/d1a/l89 0 2023-10-18T20:58:34.507 INFO:tasks.workunit.client.0.smithi008.stdout:9/491: creat d2/dc/d1a/d61/f8a x:0 0 0 2023-10-18T20:58:34.507 INFO:tasks.workunit.client.1.smithi060.stdout:2/540: rmdir d0/d3/d27/d7b 39 2023-10-18T20:58:34.508 INFO:tasks.workunit.client.0.smithi008.stdout:7/563: getdents d1/da6 0 2023-10-18T20:58:34.509 INFO:tasks.workunit.client.1.smithi060.stdout:5/582: rmdir d0/da/dc8 39 2023-10-18T20:58:34.509 INFO:tasks.workunit.client.0.smithi008.stdout:6/572: dwrite df/d15/d27/dbf/f86 [0,4194304] 0 2023-10-18T20:58:34.510 INFO:tasks.workunit.client.1.smithi060.stdout:6/562: dwrite d10/f4d [0,4194304] 0 2023-10-18T20:58:34.510 INFO:tasks.workunit.client.1.smithi060.stdout:6/563: chown d10/d25 213207 1 2023-10-18T20:58:34.513 INFO:tasks.workunit.client.1.smithi060.stdout:9/488: rmdir d3/d99/d1c 39 2023-10-18T20:58:34.514 INFO:tasks.workunit.client.1.smithi060.stdout:5/583: mknod d0/da/d3b/d64/cda 0 2023-10-18T20:58:34.515 INFO:tasks.workunit.client.0.smithi008.stdout:0/433: dread d0/d3a/f84 [0,4194304] 0 2023-10-18T20:58:34.516 INFO:tasks.workunit.client.0.smithi008.stdout:0/434: truncate d0/dd/df/d2a/f80 948480 0 2023-10-18T20:58:34.518 INFO:tasks.workunit.client.1.smithi060.stdout:6/564: rename d10/d17/d2f/ca6 to d10/d25/cac 0 2023-10-18T20:58:34.519 INFO:tasks.workunit.client.0.smithi008.stdout:3/477: read d0/f59 [3793518,46497] 0 2023-10-18T20:58:34.524 INFO:tasks.workunit.client.1.smithi060.stdout:0/555: dwrite d3/f3b [0,4194304] 0 2023-10-18T20:58:34.524 INFO:tasks.workunit.client.1.smithi060.stdout:5/584: link d0/d6/d8/l9d d0/d6/d8/df/d27/d32/d4f/ldb 0 2023-10-18T20:58:34.524 INFO:tasks.workunit.client.1.smithi060.stdout:0/556: unlink d3/d8/c2e 0 2023-10-18T20:58:34.525 INFO:tasks.workunit.client.1.smithi060.stdout:0/557: mknod d3/d8/d14/d55/d74/d76/d68/d7f/caf 0 2023-10-18T20:58:34.525 INFO:tasks.workunit.client.0.smithi008.stdout:6/573: creat df/d36/fc4 x:0 0 0 2023-10-18T20:58:34.528 INFO:tasks.workunit.client.0.smithi008.stdout:0/435: unlink d0/f11 0 2023-10-18T20:58:34.530 INFO:tasks.workunit.client.1.smithi060.stdout:0/558: link d3/d8/c7d d3/d8/d14/d55/d74/d76/d68/d7f/d8d/cb0 0 2023-10-18T20:58:34.530 INFO:tasks.workunit.client.0.smithi008.stdout:3/478: getdents d0/d3/de 0 2023-10-18T20:58:34.532 INFO:tasks.workunit.client.0.smithi008.stdout:0/436: truncate d0/dd/d19/d41/f58 931998 0 2023-10-18T20:58:34.532 INFO:tasks.workunit.client.0.smithi008.stdout:0/437: chown d0/d7c/f72 386 1 2023-10-18T20:58:34.535 INFO:tasks.workunit.client.1.smithi060.stdout:0/559: rename d3/d8/d14/d55/c7e to d3/d32/d86/cb1 0 2023-10-18T20:58:34.538 INFO:tasks.workunit.client.0.smithi008.stdout:3/479: rename d0/d3/de/d13/f28 to d0/d3/d37/d6f/f96 0 2023-10-18T20:58:34.540 INFO:tasks.workunit.client.0.smithi008.stdout:6/574: dread df/d18/d3f/f7b [0,4194304] 0 2023-10-18T20:58:34.541 INFO:tasks.workunit.client.0.smithi008.stdout:6/575: stat df/d15/d27/c30 0 2023-10-18T20:58:34.541 INFO:tasks.workunit.client.0.smithi008.stdout:6/576: read - df/d13/f69 zero size 2023-10-18T20:58:34.541 INFO:tasks.workunit.client.0.smithi008.stdout:3/480: link d0/d3/d42/d88/f91 d0/d3/f97 0 2023-10-18T20:58:34.541 INFO:tasks.workunit.client.0.smithi008.stdout:3/481: creat d0/d3/d42/d52/f98 x:0 0 0 2023-10-18T20:58:34.545 INFO:tasks.workunit.client.1.smithi060.stdout:4/498: dwrite d4/dc/f22 [0,4194304] 0 2023-10-18T20:58:34.545 INFO:tasks.workunit.client.1.smithi060.stdout:4/499: dread - d4/dc/d2a/d39/f8c zero size 2023-10-18T20:58:34.545 INFO:tasks.workunit.client.1.smithi060.stdout:4/500: readlink d4/d15/d2b/l66 0 2023-10-18T20:58:34.553 INFO:tasks.workunit.client.1.smithi060.stdout:4/501: getdents d4/dc/d2a/d39/d53/d65 0 2023-10-18T20:58:34.553 INFO:tasks.workunit.client.1.smithi060.stdout:5/585: dread d0/d6/d8/f44 [0,4194304] 0 2023-10-18T20:58:34.558 INFO:tasks.workunit.client.1.smithi060.stdout:0/560: dread d3/f6c [0,4194304] 0 2023-10-18T20:58:34.559 INFO:tasks.workunit.client.1.smithi060.stdout:4/502: creat d4/dc/d2a/d2d/d69/d89/f90 x:0 0 0 2023-10-18T20:58:34.560 INFO:tasks.workunit.client.0.smithi008.stdout:7/564: write d1/d36/f4c [1640926,45996] 0 2023-10-18T20:58:34.560 INFO:tasks.workunit.client.1.smithi060.stdout:6/565: write d10/d2e/f3f [2528467,12267] 0 2023-10-18T20:58:34.561 INFO:tasks.workunit.client.1.smithi060.stdout:5/586: unlink d0/l93 0 2023-10-18T20:58:34.561 INFO:tasks.workunit.client.1.smithi060.stdout:6/566: write d10/d17/d2f/f7d [773412,13542] 0 2023-10-18T20:58:34.561 INFO:tasks.workunit.client.1.smithi060.stdout:6/567: chown d10/d25/cac 44 1 2023-10-18T20:58:34.561 INFO:tasks.workunit.client.1.smithi060.stdout:6/568: chown d10/d17/d28/f21 11408 1 2023-10-18T20:58:34.562 INFO:tasks.workunit.client.0.smithi008.stdout:0/438: write d0/d7c/f39 [1970226,43147] 0 2023-10-18T20:58:34.562 INFO:tasks.workunit.client.1.smithi060.stdout:0/561: truncate d3/f4f 530113 0 2023-10-18T20:58:34.563 INFO:tasks.workunit.client.1.smithi060.stdout:4/503: mkdir d4/d91 0 2023-10-18T20:58:34.563 INFO:tasks.workunit.client.1.smithi060.stdout:0/562: dread - d3/d8/d14/f89 zero size 2023-10-18T20:58:34.567 INFO:tasks.workunit.client.1.smithi060.stdout:1/644: dread d4/d6/d14/f8a [0,4194304] 0 2023-10-18T20:58:34.568 INFO:tasks.workunit.client.1.smithi060.stdout:3/496: sync 2023-10-18T20:58:34.570 INFO:tasks.workunit.client.0.smithi008.stdout:7/565: rmdir d1/d3/d8b/da5 39 2023-10-18T20:58:34.571 INFO:tasks.workunit.client.1.smithi060.stdout:8/533: sync 2023-10-18T20:58:34.572 INFO:tasks.workunit.client.1.smithi060.stdout:5/587: symlink d0/ldc 0 2023-10-18T20:58:34.572 INFO:tasks.workunit.client.1.smithi060.stdout:9/489: read d3/d99/f69 [1960707,40358] 0 2023-10-18T20:58:34.573 INFO:tasks.workunit.client.0.smithi008.stdout:7/566: mkdir d1/da6/d79/db5 0 2023-10-18T20:58:34.573 INFO:tasks.workunit.client.0.smithi008.stdout:7/567: stat d1/d3/d20/d5f/d78 0 2023-10-18T20:58:34.574 INFO:tasks.workunit.client.1.smithi060.stdout:0/563: dread d3/d80/f90 [0,4194304] 0 2023-10-18T20:58:34.578 INFO:tasks.workunit.client.0.smithi008.stdout:7/568: creat d1/da6/d79/db5/fb6 x:0 0 0 2023-10-18T20:58:34.579 INFO:tasks.workunit.client.1.smithi060.stdout:6/569: creat d10/d3e/fad x:0 0 0 2023-10-18T20:58:34.579 INFO:tasks.workunit.client.1.smithi060.stdout:4/504: unlink d4/dc/d2a/d13/f1b 0 2023-10-18T20:58:34.579 INFO:tasks.workunit.client.1.smithi060.stdout:4/505: truncate d4/d15/f8e 450270 0 2023-10-18T20:58:34.579 INFO:tasks.workunit.client.1.smithi060.stdout:0/564: creat d3/d8/d14/d55/d74/fb2 x:0 0 0 2023-10-18T20:58:34.581 INFO:tasks.workunit.client.1.smithi060.stdout:3/497: creat d0/d22/d26/d29/fab x:0 0 0 2023-10-18T20:58:34.581 INFO:tasks.workunit.client.1.smithi060.stdout:3/498: creat d0/d22/d50/fac x:0 0 0 2023-10-18T20:58:34.581 INFO:tasks.workunit.client.1.smithi060.stdout:3/499: fsync d0/f4e 0 2023-10-18T20:58:34.581 INFO:tasks.workunit.client.1.smithi060.stdout:9/490: symlink d3/d99/d1c/d5a/d5d/d7d/lbe 0 2023-10-18T20:58:34.587 INFO:tasks.workunit.client.1.smithi060.stdout:2/541: dwrite d0/d16/d7f/faf [0,4194304] 0 2023-10-18T20:58:34.587 INFO:tasks.workunit.client.1.smithi060.stdout:3/500: mknod d0/d22/d26/d2c/cad 0 2023-10-18T20:58:34.588 INFO:tasks.workunit.client.1.smithi060.stdout:3/501: chown d0/d22/d50/ca4 4879 1 2023-10-18T20:58:34.590 INFO:tasks.workunit.client.1.smithi060.stdout:3/502: mkdir d0/d22/d26/d29/dae 0 2023-10-18T20:58:34.594 INFO:tasks.workunit.client.1.smithi060.stdout:3/503: link d0/d3c/d3d/d4d/d95/c9c d0/d22/d26/d29/caf 0 2023-10-18T20:58:34.594 INFO:tasks.workunit.client.1.smithi060.stdout:9/491: write d3/d99/d1c/d5a/d5d/d2b/fba [527528,81606] 0 2023-10-18T20:58:34.595 INFO:tasks.workunit.client.1.smithi060.stdout:9/492: chown d3/d99/d19/l9c 240 1 2023-10-18T20:58:34.595 INFO:tasks.workunit.client.1.smithi060.stdout:9/493: chown d3/d99/d65/l7a 1566 1 2023-10-18T20:58:34.595 INFO:tasks.workunit.client.1.smithi060.stdout:9/494: dread - d3/d58/f73 zero size 2023-10-18T20:58:34.596 INFO:tasks.workunit.client.1.smithi060.stdout:9/495: fsync d3/d99/d1c/d5a/d5d/d56/fb4 0 2023-10-18T20:58:34.596 INFO:tasks.workunit.client.1.smithi060.stdout:1/645: dread d4/da/f53 [0,4194304] 0 2023-10-18T20:58:34.601 INFO:tasks.workunit.client.1.smithi060.stdout:8/534: read d4/d9/d37/d4e/f59 [1291185,118886] 0 2023-10-18T20:58:34.601 INFO:tasks.workunit.client.0.smithi008.stdout:7/569: dread d1/da6/d4f/f5b [0,4194304] 0 2023-10-18T20:58:34.602 INFO:tasks.workunit.client.0.smithi008.stdout:7/570: dread - d1/da6/d4f/fa8 zero size 2023-10-18T20:58:34.602 INFO:tasks.workunit.client.1.smithi060.stdout:5/588: rmdir d0/d6/d8/df 39 2023-10-18T20:58:34.603 INFO:tasks.workunit.client.0.smithi008.stdout:8/653: sync 2023-10-18T20:58:34.603 INFO:tasks.workunit.client.0.smithi008.stdout:2/534: sync 2023-10-18T20:58:34.603 INFO:tasks.workunit.client.0.smithi008.stdout:2/535: fdatasync d1/d3/dd/d25/f27 0 2023-10-18T20:58:34.603 INFO:tasks.workunit.client.0.smithi008.stdout:2/536: fdatasync d1/d3/f1b 0 2023-10-18T20:58:34.604 INFO:tasks.workunit.client.0.smithi008.stdout:1/626: sync 2023-10-18T20:58:34.605 INFO:tasks.workunit.client.0.smithi008.stdout:5/518: sync 2023-10-18T20:58:34.610 INFO:tasks.workunit.client.1.smithi060.stdout:3/504: creat d0/d22/d26/fb0 x:0 0 0 2023-10-18T20:58:34.610 INFO:tasks.workunit.client.0.smithi008.stdout:8/654: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/dc0/fee x:0 0 0 2023-10-18T20:58:34.613 INFO:tasks.workunit.client.0.smithi008.stdout:8/655: fdatasync d5/d8/df/f23 0 2023-10-18T20:58:34.613 INFO:tasks.workunit.client.0.smithi008.stdout:8/656: chown d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/ld5 55324526 1 2023-10-18T20:58:34.613 INFO:tasks.workunit.client.0.smithi008.stdout:2/537: unlink d1/d3/dd/d25/d76/f8d 0 2023-10-18T20:58:34.615 INFO:tasks.workunit.client.0.smithi008.stdout:1/627: mkdir d9/de/df/d17/d1e/d9a/dbc 0 2023-10-18T20:58:34.617 INFO:tasks.workunit.client.1.smithi060.stdout:9/496: symlink d3/d58/lbf 0 2023-10-18T20:58:34.617 INFO:tasks.workunit.client.0.smithi008.stdout:5/519: getdents d0/d2/d19/d7c/d58/d65 0 2023-10-18T20:58:34.618 INFO:tasks.workunit.client.1.smithi060.stdout:0/565: write d3/f3b [2119367,6835] 0 2023-10-18T20:58:34.618 INFO:tasks.workunit.client.1.smithi060.stdout:0/566: write d3/d80/f9e [488366,89556] 0 2023-10-18T20:58:34.620 INFO:tasks.workunit.client.0.smithi008.stdout:6/577: dwrite df/d13/d53/d64/fc3 [0,4194304] 0 2023-10-18T20:58:34.621 INFO:tasks.workunit.client.1.smithi060.stdout:7/604: dwrite de/d38/fad [0,4194304] 0 2023-10-18T20:58:34.621 INFO:tasks.workunit.client.1.smithi060.stdout:1/646: link d4/d6/d48/f4b d4/d6/d7/d2f/d7b/d2a/d32/fce 0 2023-10-18T20:58:34.621 INFO:tasks.workunit.client.1.smithi060.stdout:1/647: fdatasync d4/d6/d48/da7/fb3 0 2023-10-18T20:58:34.621 INFO:tasks.workunit.client.1.smithi060.stdout:8/535: creat d4/d9/d37/fa2 x:0 0 0 2023-10-18T20:58:34.625 INFO:tasks.workunit.client.1.smithi060.stdout:3/505: rename d0/d3c/l8f to d0/d22/d26/d2c/da0/lb1 0 2023-10-18T20:58:34.626 INFO:tasks.workunit.client.1.smithi060.stdout:4/506: dread d4/dc/d2a/d13/d2f/f34 [0,4194304] 0 2023-10-18T20:58:34.626 INFO:tasks.workunit.client.1.smithi060.stdout:9/497: mknod d3/d99/d1c/d2a/d80/cc0 0 2023-10-18T20:58:34.628 INFO:tasks.workunit.client.0.smithi008.stdout:2/538: truncate d1/f18 1522598 0 2023-10-18T20:58:34.628 INFO:tasks.workunit.client.0.smithi008.stdout:0/439: dwrite d0/dd/d19/f6e [0,4194304] 0 2023-10-18T20:58:34.628 INFO:tasks.workunit.client.0.smithi008.stdout:0/440: write d0/dd/df/d20/f77 [1274651,35524] 0 2023-10-18T20:58:34.629 INFO:tasks.workunit.client.0.smithi008.stdout:9/492: dwrite d2/d8/f84 [0,4194304] 0 2023-10-18T20:58:34.630 INFO:tasks.workunit.client.0.smithi008.stdout:1/628: symlink d9/de/df/d17/d1e/d3c/d90/d95/lbd 0 2023-10-18T20:58:34.639 INFO:tasks.workunit.client.1.smithi060.stdout:6/570: dwrite d10/d17/f46 [0,4194304] 0 2023-10-18T20:58:34.639 INFO:tasks.workunit.client.1.smithi060.stdout:2/542: write d0/d8/f2c [3020069,109085] 0 2023-10-18T20:58:34.639 INFO:tasks.workunit.client.1.smithi060.stdout:2/543: dread - d0/d45/d49/d6e/f91 zero size 2023-10-18T20:58:34.640 INFO:tasks.workunit.client.1.smithi060.stdout:0/567: getdents d3/d32/d86 0 2023-10-18T20:58:34.640 INFO:tasks.workunit.client.1.smithi060.stdout:0/568: dread - d3/d8/d14/d55/d74/d76/d68/d98/fa5 zero size 2023-10-18T20:58:34.640 INFO:tasks.workunit.client.1.smithi060.stdout:0/569: write d3/d32/f38 [2536670,80191] 0 2023-10-18T20:58:34.641 INFO:tasks.workunit.client.1.smithi060.stdout:4/507: mknod d4/dc/d2a/d31/c92 0 2023-10-18T20:58:34.641 INFO:tasks.workunit.client.1.smithi060.stdout:3/506: dread d0/d3c/f54 [0,4194304] 0 2023-10-18T20:58:34.645 INFO:tasks.workunit.client.0.smithi008.stdout:3/482: dwrite d0/f59 [8388608,4194304] 0 2023-10-18T20:58:34.649 INFO:tasks.workunit.client.0.smithi008.stdout:2/539: rmdir d1/d3/dd/d1c/d3a/d49/da3 0 2023-10-18T20:58:34.653 INFO:tasks.workunit.client.1.smithi060.stdout:9/498: creat d3/d99/d1c/d2a/d2d/db9/fc1 x:0 0 0 2023-10-18T20:58:34.657 INFO:tasks.workunit.client.1.smithi060.stdout:6/571: mkdir d10/d17/dae 0 2023-10-18T20:58:34.658 INFO:tasks.workunit.client.1.smithi060.stdout:6/572: creat d10/d6f/faf x:0 0 0 2023-10-18T20:58:34.658 INFO:tasks.workunit.client.1.smithi060.stdout:6/573: chown d10/d17/f9c 72601 1 2023-10-18T20:58:34.659 INFO:tasks.workunit.client.0.smithi008.stdout:5/520: rmdir d0/d2/d19/d7c 39 2023-10-18T20:58:34.659 INFO:tasks.workunit.client.0.smithi008.stdout:5/521: dread - d0/d2/d9/d9b/d6f/d75/fa6 zero size 2023-10-18T20:58:34.659 INFO:tasks.workunit.client.0.smithi008.stdout:5/522: chown d0/d2/d19/d7c/d31/d80/la0 692230873 1 2023-10-18T20:58:34.660 INFO:tasks.workunit.client.0.smithi008.stdout:1/629: write d9/de/df/f10 [867933,93175] 0 2023-10-18T20:58:34.662 INFO:tasks.workunit.client.1.smithi060.stdout:3/507: creat d0/d3c/d3d/d82/fb2 x:0 0 0 2023-10-18T20:58:34.663 INFO:tasks.workunit.client.1.smithi060.stdout:7/605: write de/d14/d49/d68/f21 [4120485,59997] 0 2023-10-18T20:58:34.663 INFO:tasks.workunit.client.1.smithi060.stdout:7/606: write de/d29/d72/fa8 [830648,86310] 0 2023-10-18T20:58:34.664 INFO:tasks.workunit.client.0.smithi008.stdout:1/630: write d9/de/df/d17/d1e/fad [208396,9529] 0 2023-10-18T20:58:34.664 INFO:tasks.workunit.client.0.smithi008.stdout:9/493: dread d2/f5 [0,4194304] 0 2023-10-18T20:58:34.665 INFO:tasks.workunit.client.0.smithi008.stdout:8/657: dwrite d5/d8/df/d2e/f35 [0,4194304] 0 2023-10-18T20:58:34.665 INFO:tasks.workunit.client.0.smithi008.stdout:8/658: write d5/d8/df/d9d/d4d/f67 [844145,4726] 0 2023-10-18T20:58:34.669 INFO:tasks.workunit.client.0.smithi008.stdout:3/483: creat d0/d3/d42/f99 x:0 0 0 2023-10-18T20:58:34.675 INFO:tasks.workunit.client.1.smithi060.stdout:8/536: rename d4/d9/d37/d4e/d5e to d4/d9/d31/d35/d9f/da3 0 2023-10-18T20:58:34.676 INFO:tasks.workunit.client.1.smithi060.stdout:5/589: dwrite d0/d6/d9/db1/fd0 [0,4194304] 0 2023-10-18T20:58:34.684 INFO:tasks.workunit.client.1.smithi060.stdout:1/648: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/f4f [0,4194304] 0 2023-10-18T20:58:34.684 INFO:tasks.workunit.client.1.smithi060.stdout:1/649: read - d4/d6/d7/d35/f97 zero size 2023-10-18T20:58:34.698 INFO:tasks.workunit.client.0.smithi008.stdout:6/578: dwrite df/d3c/d77/d50/f55 [4194304,4194304] 0 2023-10-18T20:58:34.699 INFO:tasks.workunit.client.1.smithi060.stdout:7/607: dread de/d14/d2f/d8f/d5b/f75 [0,4194304] 0 2023-10-18T20:58:34.700 INFO:tasks.workunit.client.1.smithi060.stdout:3/508: mkdir d0/d22/d26/d79/db3 0 2023-10-18T20:58:34.702 INFO:tasks.workunit.client.0.smithi008.stdout:2/540: mkdir d1/d3/dd/d25/d76/dad 0 2023-10-18T20:58:34.703 INFO:tasks.workunit.client.0.smithi008.stdout:9/494: rename d2/dc/l2c to d2/dc/d40/d56/l8b 0 2023-10-18T20:58:34.703 INFO:tasks.workunit.client.1.smithi060.stdout:8/537: symlink d4/d9/d31/d6f/la4 0 2023-10-18T20:58:34.721 INFO:tasks.workunit.client.0.smithi008.stdout:7/571: dwrite d1/d3/f2a [0,4194304] 0 2023-10-18T20:58:34.721 INFO:tasks.workunit.client.0.smithi008.stdout:7/572: fdatasync d1/d3/d20/d5f/d7f/f8d 0 2023-10-18T20:58:34.723 INFO:tasks.workunit.client.0.smithi008.stdout:7/573: read d1/d3/d20/d5f/d7f/f9a [516626,14039] 0 2023-10-18T20:58:34.733 INFO:tasks.workunit.client.0.smithi008.stdout:8/659: dwrite d5/d8/df/d54/f83 [0,4194304] 0 2023-10-18T20:58:34.745 INFO:tasks.workunit.client.1.smithi060.stdout:8/538: dread d4/f25 [0,4194304] 0 2023-10-18T20:58:34.748 INFO:tasks.workunit.client.0.smithi008.stdout:1/631: dwrite d9/de/df/d17/d1e/d3c/fa3 [0,4194304] 0 2023-10-18T20:58:34.749 INFO:tasks.workunit.client.0.smithi008.stdout:1/632: truncate d9/de/df/f56 5018769 0 2023-10-18T20:58:34.750 INFO:tasks.workunit.client.1.smithi060.stdout:2/544: dwrite d0/d45/d49/d6e/f91 [0,4194304] 0 2023-10-18T20:58:34.750 INFO:tasks.workunit.client.1.smithi060.stdout:1/650: dwrite d4/d6/d7/d2f/d7b/d2a/d32/d56/fad [0,4194304] 0 2023-10-18T20:58:34.769 INFO:tasks.workunit.client.0.smithi008.stdout:3/484: mknod d0/d3/d42/d52/c9a 0 2023-10-18T20:58:34.772 INFO:tasks.workunit.client.0.smithi008.stdout:2/541: symlink d1/d3/dd/d25/d76/d59/d85/lae 0 2023-10-18T20:58:34.776 INFO:tasks.workunit.client.0.smithi008.stdout:5/523: dwrite d0/d2/d19/d7c/d31/d3f/d70/da4/fb3 [0,4194304] 0 2023-10-18T20:58:34.784 INFO:tasks.workunit.client.1.smithi060.stdout:3/509: creat d0/d22/d26/d79/fb4 x:0 0 0 2023-10-18T20:58:34.784 INFO:tasks.workunit.client.1.smithi060.stdout:3/510: dread - d0/d3c/d3d/d82/fb2 zero size 2023-10-18T20:58:34.784 INFO:tasks.workunit.client.1.smithi060.stdout:3/511: write d0/d3c/d3d/f98 [268001,63473] 0 2023-10-18T20:58:34.785 INFO:tasks.workunit.client.0.smithi008.stdout:9/495: dwrite d2/dc/d17/f77 [0,4194304] 0 2023-10-18T20:58:34.809 INFO:tasks.workunit.client.1.smithi060.stdout:7/608: dwrite de/d14/d49/f63 [0,4194304] 0 2023-10-18T20:58:34.811 INFO:tasks.workunit.client.1.smithi060.stdout:2/545: dwrite d0/d43/f44 [0,4194304] 0 2023-10-18T20:58:34.811 INFO:tasks.workunit.client.1.smithi060.stdout:2/546: fsync d0/d45/f92 0 2023-10-18T20:58:34.811 INFO:tasks.workunit.client.1.smithi060.stdout:2/547: chown d0/d3/d27/d4d/d5e/f5f 1189714 1 2023-10-18T20:58:34.815 INFO:tasks.workunit.client.1.smithi060.stdout:8/539: dwrite d4/f30 [0,4194304] 0 2023-10-18T20:58:34.816 INFO:tasks.workunit.client.1.smithi060.stdout:8/540: chown d4/d9/d4f/d74/d81/f94 21021 1 2023-10-18T20:58:34.818 INFO:tasks.workunit.client.0.smithi008.stdout:7/574: creat d1/d36/d3d/fb7 x:0 0 0 2023-10-18T20:58:34.819 INFO:tasks.workunit.client.1.smithi060.stdout:3/512: dread d0/d3c/d3d/f7f [0,4194304] 0 2023-10-18T20:58:34.819 INFO:tasks.workunit.client.1.smithi060.stdout:3/513: fdatasync d0/d3c/d3d/f7f 0 2023-10-18T20:58:34.819 INFO:tasks.workunit.client.1.smithi060.stdout:3/514: readlink d0/l4 0 2023-10-18T20:58:34.819 INFO:tasks.workunit.client.0.smithi008.stdout:7/575: read d1/d36/d3d/d3e/d59/d73/d7b/f80 [435504,90484] 0 2023-10-18T20:58:34.825 INFO:tasks.workunit.client.0.smithi008.stdout:8/660: creat d5/d8/df/d9d/d85/db1/fef x:0 0 0 2023-10-18T20:58:34.825 INFO:tasks.workunit.client.0.smithi008.stdout:8/661: stat d5/d8/cbd 0 2023-10-18T20:58:34.832 INFO:tasks.workunit.client.0.smithi008.stdout:8/662: read d5/d8/f41 [4516778,47551] 0 2023-10-18T20:58:34.852 INFO:tasks.workunit.client.0.smithi008.stdout:1/633: stat d9/de/c23 0 2023-10-18T20:58:34.852 INFO:tasks.workunit.client.0.smithi008.stdout:1/634: chown d9/de/df/d85/c98 10314235 1 2023-10-18T20:58:34.858 INFO:tasks.workunit.client.1.smithi060.stdout:0/570: rename d3/d8/d14/d55/d74/d76/f83 to d3/d8/d14/d55/d74/d76/d6b/fb3 0 2023-10-18T20:58:34.858 INFO:tasks.workunit.client.1.smithi060.stdout:0/571: write d3/f4f [228304,38580] 0 2023-10-18T20:58:34.882 INFO:tasks.workunit.client.0.smithi008.stdout:8/663: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/f99 [0,4194304] 0 2023-10-18T20:58:34.900 INFO:tasks.workunit.client.1.smithi060.stdout:1/651: symlink d4/d38/da0/lcf 0 2023-10-18T20:58:34.901 INFO:tasks.workunit.client.1.smithi060.stdout:1/652: dread - d4/d6/d7/d2f/d7b/d2a/d32/d56/daa/fc1 zero size 2023-10-18T20:58:34.902 INFO:tasks.workunit.client.1.smithi060.stdout:1/653: read - d4/d6/d7/d35/f97 zero size 2023-10-18T20:58:34.902 INFO:tasks.workunit.client.1.smithi060.stdout:1/654: readlink d4/d6/d7/df/l12 0 2023-10-18T20:58:34.915 INFO:tasks.workunit.client.0.smithi008.stdout:3/485: creat d0/d3/de/d13/f9b x:0 0 0 2023-10-18T20:58:34.916 INFO:tasks.workunit.client.0.smithi008.stdout:6/579: rmdir df/d3c/da2 39 2023-10-18T20:58:34.920 INFO:tasks.workunit.client.0.smithi008.stdout:2/542: creat d1/d3/dd/d1c/d3a/d49/faf x:0 0 0 2023-10-18T20:58:34.928 INFO:tasks.workunit.client.0.smithi008.stdout:8/664: dwrite d5/f3d [0,4194304] 0 2023-10-18T20:58:34.928 INFO:tasks.workunit.client.0.smithi008.stdout:8/665: dread - d5/d8/df/d9d/d4d/db5/fc1 zero size 2023-10-18T20:58:34.928 INFO:tasks.workunit.client.0.smithi008.stdout:8/666: fsync d5/d8/df/d9d/d4d/db5/da3/fcd 0 2023-10-18T20:58:34.928 INFO:tasks.workunit.client.0.smithi008.stdout:8/667: fdatasync d5/d8/df/f3a 0 2023-10-18T20:58:34.928 INFO:tasks.workunit.client.0.smithi008.stdout:8/668: truncate d5/d8/df/d9d/d4d/db5/f64 4206793 0 2023-10-18T20:58:34.930 INFO:tasks.workunit.client.0.smithi008.stdout:5/524: mknod d0/d2/d19/d7c/d42/cbf 0 2023-10-18T20:58:34.930 INFO:tasks.workunit.client.0.smithi008.stdout:5/525: chown d0/d2/d19/d7c/d31/d3f/d70 631 1 2023-10-18T20:58:34.931 INFO:tasks.workunit.client.0.smithi008.stdout:5/526: fdatasync d0/f29 0 2023-10-18T20:58:34.934 INFO:tasks.workunit.client.1.smithi060.stdout:7/609: link de/f17 de/d14/d49/d68/d7d/d7e/db5/fc7 0 2023-10-18T20:58:34.940 INFO:tasks.workunit.client.0.smithi008.stdout:2/543: dread d1/d3/dd/d1c/f3c [0,4194304] 0 2023-10-18T20:58:34.946 INFO:tasks.workunit.client.0.smithi008.stdout:2/544: read d1/d3/dd/f58 [86180,31723] 0 2023-10-18T20:58:34.970 INFO:tasks.workunit.client.1.smithi060.stdout:2/548: creat d0/d43/d68/fb0 x:0 0 0 2023-10-18T20:58:34.979 INFO:tasks.workunit.client.0.smithi008.stdout:9/496: symlink d2/dc/d40/l8c 0 2023-10-18T20:58:34.992 INFO:tasks.workunit.client.1.smithi060.stdout:0/572: creat d3/fb4 x:0 0 0 2023-10-18T20:58:34.993 INFO:tasks.workunit.client.1.smithi060.stdout:0/573: fdatasync d3/d8/d14/f89 0 2023-10-18T20:58:34.993 INFO:tasks.workunit.client.1.smithi060.stdout:1/655: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/fd0 x:0 0 0 2023-10-18T20:58:34.994 INFO:tasks.workunit.client.1.smithi060.stdout:1/656: write d4/d6/d7/df/d59/f82 [552004,50970] 0 2023-10-18T20:58:34.996 INFO:tasks.workunit.client.1.smithi060.stdout:2/549: link d0/d8/d87/l88 d0/d3/d27/d7b/lb1 0 2023-10-18T20:58:34.996 INFO:tasks.workunit.client.1.smithi060.stdout:2/550: truncate d0/d8/d47/f99 701925 0 2023-10-18T20:58:34.997 INFO:tasks.workunit.client.1.smithi060.stdout:0/574: mkdir d3/d80/db5 0 2023-10-18T20:58:34.997 INFO:tasks.workunit.client.1.smithi060.stdout:1/657: write d4/d6/d7/d2f/d7b/d2a/d32/d56/f75 [1075890,78106] 0 2023-10-18T20:58:35.002 INFO:tasks.workunit.client.1.smithi060.stdout:0/575: mknod d3/d8/d14/d55/d74/d76/d68/cb6 0 2023-10-18T20:58:35.003 INFO:tasks.workunit.client.1.smithi060.stdout:0/576: truncate d3/d8/d14/f89 437146 0 2023-10-18T20:58:35.003 INFO:tasks.workunit.client.1.smithi060.stdout:1/658: mknod d4/d6/d7/d2f/d7b/d2a/d32/d56/daf/cd1 0 2023-10-18T20:58:35.014 INFO:tasks.workunit.client.0.smithi008.stdout:9/497: dread d2/f4 [0,4194304] 0 2023-10-18T20:58:35.015 INFO:tasks.workunit.client.1.smithi060.stdout:1/659: write d4/d6/d7/d2f/d7b/d2a/f46 [2200125,36291] 0 2023-10-18T20:58:35.016 INFO:tasks.workunit.client.1.smithi060.stdout:1/660: read d4/d6/d14/f8a [1348751,25054] 0 2023-10-18T20:58:35.043 INFO:tasks.workunit.client.1.smithi060.stdout:2/551: dwrite d0/d3/d27/d4d/f5b [0,4194304] 0 2023-10-18T20:58:35.053 INFO:tasks.workunit.client.1.smithi060.stdout:4/508: rename d4/dc/c79 to d4/dc/d2a/d39/d53/d65/d8d/c93 0 2023-10-18T20:58:35.058 INFO:tasks.workunit.client.1.smithi060.stdout:7/610: dread de/f17 [0,4194304] 0 2023-10-18T20:58:35.058 INFO:tasks.workunit.client.1.smithi060.stdout:7/611: chown de/d14/d3a/fb6 35 1 2023-10-18T20:58:35.058 INFO:tasks.workunit.client.1.smithi060.stdout:7/612: write de/d14/d41/f43 [304975,27623] 0 2023-10-18T20:58:35.059 INFO:tasks.workunit.client.1.smithi060.stdout:7/613: chown de/d29/l39 858270 1 2023-10-18T20:58:35.060 INFO:tasks.workunit.client.1.smithi060.stdout:2/552: symlink d0/d45/d49/lb2 0 2023-10-18T20:58:35.061 INFO:tasks.workunit.client.1.smithi060.stdout:2/553: write d0/f78 [1340047,73550] 0 2023-10-18T20:58:35.061 INFO:tasks.workunit.client.1.smithi060.stdout:2/554: creat d0/d43/d68/fb3 x:0 0 0 2023-10-18T20:58:35.062 INFO:tasks.workunit.client.1.smithi060.stdout:9/499: rename d3/d99/d1c/d5a/d5d/d2b to d3/d99/d1c/d2a/d80/da0/dc2 0 2023-10-18T20:58:35.066 INFO:tasks.workunit.client.0.smithi008.stdout:4/490: sync 2023-10-18T20:58:35.069 INFO:tasks.workunit.client.1.smithi060.stdout:7/614: mkdir de/d14/d2f/d3f/d5a/dc8 0 2023-10-18T20:58:35.072 INFO:tasks.workunit.client.1.smithi060.stdout:2/555: symlink d0/d3/d9e/lb4 0 2023-10-18T20:58:35.075 INFO:tasks.workunit.client.1.smithi060.stdout:9/500: creat d3/d99/d19/d54/fc3 x:0 0 0 2023-10-18T20:58:35.076 INFO:tasks.workunit.client.1.smithi060.stdout:6/574: rename d10/d17/d28/l20 to d10/d6f/lb0 0 2023-10-18T20:58:35.080 INFO:tasks.workunit.client.1.smithi060.stdout:9/501: symlink d3/d99/d1c/d25/lc4 0 2023-10-18T20:58:35.081 INFO:tasks.workunit.client.1.smithi060.stdout:9/502: readlink d3/d99/d1c/d5a/d5d/d7d/lbe 0 2023-10-18T20:58:35.081 INFO:tasks.workunit.client.1.smithi060.stdout:5/590: rename d0/dd/l6c to d0/da/d79/da5/d67/ldd 0 2023-10-18T20:58:35.082 INFO:tasks.workunit.client.0.smithi008.stdout:0/441: sync 2023-10-18T20:58:35.090 INFO:tasks.workunit.client.1.smithi060.stdout:9/503: rmdir d3/d99/d19 39 2023-10-18T20:58:35.090 INFO:tasks.workunit.client.1.smithi060.stdout:5/591: getdents d0/dd/d76 0 2023-10-18T20:58:35.091 INFO:tasks.workunit.client.1.smithi060.stdout:5/592: fdatasync d0/d47/f8d 0 2023-10-18T20:58:35.093 INFO:tasks.workunit.client.1.smithi060.stdout:1/661: dwrite d4/da/d42/f57 [0,4194304] 0 2023-10-18T20:58:35.100 INFO:tasks.workunit.client.1.smithi060.stdout:4/509: rename d4/dc/d2a/d13/d2f/l36 to d4/dc/d2a/d39/d82/l94 0 2023-10-18T20:58:35.101 INFO:tasks.workunit.client.1.smithi060.stdout:5/593: unlink d0/d6/d9/d82/d84/db2/d2a/dd1/ld2 0 2023-10-18T20:58:35.103 INFO:tasks.workunit.client.1.smithi060.stdout:5/594: symlink d0/da/d3b/d43/lde 0 2023-10-18T20:58:35.103 INFO:tasks.workunit.client.1.smithi060.stdout:5/595: fdatasync d0/da/d3b/f4c 0 2023-10-18T20:58:35.110 INFO:tasks.workunit.client.1.smithi060.stdout:9/504: rename d3/d58/f73 to d3/d99/d1c/d2a/d80/fc5 0 2023-10-18T20:58:35.116 INFO:tasks.workunit.client.1.smithi060.stdout:7/615: write de/d14/d2f/f71 [3681715,13790] 0 2023-10-18T20:58:35.116 INFO:tasks.workunit.client.1.smithi060.stdout:3/515: creat d0/d3c/d3d/fb5 x:0 0 0 2023-10-18T20:58:35.117 INFO:tasks.workunit.client.1.smithi060.stdout:9/505: creat d3/d99/d1c/d2a/fc6 x:0 0 0 2023-10-18T20:58:35.120 INFO:tasks.workunit.client.1.smithi060.stdout:3/516: creat d0/d22/d26/d8c/fb6 x:0 0 0 2023-10-18T20:58:35.120 INFO:tasks.workunit.client.1.smithi060.stdout:3/517: creat d0/d3c/d3d/fb7 x:0 0 0 2023-10-18T20:58:35.123 INFO:tasks.workunit.client.1.smithi060.stdout:3/518: unlink d0/d22/d26/d2c/fa6 0 2023-10-18T20:58:35.123 INFO:tasks.workunit.client.1.smithi060.stdout:3/519: creat d0/d22/d26/fb8 x:0 0 0 2023-10-18T20:58:35.125 INFO:tasks.workunit.client.1.smithi060.stdout:4/510: dread d4/dc/d2a/d39/f49 [0,4194304] 0 2023-10-18T20:58:35.125 INFO:tasks.workunit.client.1.smithi060.stdout:4/511: chown d4/dc/d2a/d31/f46 9141 1 2023-10-18T20:58:35.125 INFO:tasks.workunit.client.1.smithi060.stdout:4/512: stat d4/dc/d2a/d31 0 2023-10-18T20:58:35.125 INFO:tasks.workunit.client.1.smithi060.stdout:1/662: dread d4/da/f53 [0,4194304] 0 2023-10-18T20:58:35.128 INFO:tasks.workunit.client.1.smithi060.stdout:1/663: write d4/d6/d14/d41/fa5 [287966,5691] 0 2023-10-18T20:58:35.129 INFO:tasks.workunit.client.1.smithi060.stdout:4/513: mknod d4/dc/d2a/d39/d53/c95 0 2023-10-18T20:58:35.130 INFO:tasks.workunit.client.1.smithi060.stdout:4/514: creat d4/dc/d2a/d2d/f96 x:0 0 0 2023-10-18T20:58:35.131 INFO:tasks.workunit.client.1.smithi060.stdout:1/664: rename d4/d6/d7/d2f/d7b/d2a/l7e to d4/da/d42/ld2 0 2023-10-18T20:58:35.131 INFO:tasks.workunit.client.1.smithi060.stdout:1/665: readlink d4/d6/d7/d2f/d7b/d2a/d32/d56/d5f/l9b 0 2023-10-18T20:58:35.147 INFO:tasks.workunit.client.1.smithi060.stdout:6/575: dwrite d10/d3e/fad [0,4194304] 0 2023-10-18T20:58:35.154 INFO:tasks.workunit.client.1.smithi060.stdout:8/541: sync 2023-10-18T20:58:35.155 INFO:tasks.workunit.client.1.smithi060.stdout:8/542: write d4/d9/d4f/f63 [980598,35312] 0 2023-10-18T20:58:35.160 INFO:tasks.workunit.client.1.smithi060.stdout:9/506: read d3/d99/d1c/d25/f4b [936193,92870] 0 2023-10-18T20:58:35.162 INFO:tasks.workunit.client.1.smithi060.stdout:5/596: dwrite d0/d6/f55 [4194304,4194304] 0 2023-10-18T20:58:35.164 INFO:tasks.workunit.client.1.smithi060.stdout:6/576: rename d10/d6f/da9 to d10/d17/d54/db1 0 2023-10-18T20:58:35.165 INFO:tasks.workunit.client.1.smithi060.stdout:6/577: chown d10/l12 22184 1 2023-10-18T20:58:35.168 INFO:tasks.workunit.client.1.smithi060.stdout:9/507: mknod d3/d58/cc7 0 2023-10-18T20:58:35.168 INFO:tasks.workunit.client.1.smithi060.stdout:9/508: creat d3/d99/d1c/d2a/fc8 x:0 0 0 2023-10-18T20:58:35.179 INFO:tasks.workunit.client.1.smithi060.stdout:9/509: dread d3/d99/f3c [0,4194304] 0 2023-10-18T20:58:35.188 INFO:tasks.workunit.client.1.smithi060.stdout:8/543: rename d4/d9/d37/d4e/f65 to d4/d9/d31/d35/d9f/da3/fa5 0 2023-10-18T20:58:35.188 INFO:tasks.workunit.client.1.smithi060.stdout:8/544: write d4/f25 [4662446,93947] 0 2023-10-18T20:58:35.189 INFO:tasks.workunit.client.1.smithi060.stdout:8/545: stat d4/d9/d31/d35/d9f/da3/fa5 0 2023-10-18T20:58:35.192 INFO:tasks.workunit.client.1.smithi060.stdout:8/546: mkdir d4/d9/d31/da6 0 2023-10-18T20:58:35.201 INFO:tasks.workunit.client.1.smithi060.stdout:8/547: write d4/d9/d37/f38 [449884,20188] 0 2023-10-18T20:58:35.201 INFO:tasks.workunit.client.1.smithi060.stdout:1/666: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/f30 [4194304,4194304] 0 2023-10-18T20:58:35.201 INFO:tasks.workunit.client.1.smithi060.stdout:1/667: fsync d4/d6/d33/d58/f76 0 2023-10-18T20:58:35.202 INFO:tasks.workunit.client.1.smithi060.stdout:1/668: rename d4/d6/d7/d2f/d7b/fb9 to d4/d6/d7/d2f/d7b/d2a/d32/dd/fd3 0 2023-10-18T20:58:35.202 INFO:tasks.workunit.client.1.smithi060.stdout:1/669: readlink d4/d6/d7/lc8 0 2023-10-18T20:58:35.203 INFO:tasks.workunit.client.1.smithi060.stdout:1/670: truncate d4/d6/d48/da7/fb3 587573 0 2023-10-18T20:58:35.204 INFO:tasks.workunit.client.1.smithi060.stdout:7/616: dwrite de/d14/d2f/d8f/faf [0,4194304] 0 2023-10-18T20:58:35.205 INFO:tasks.workunit.client.1.smithi060.stdout:7/617: write de/d14/d49/d68/d7d/d7e/db5/fc7 [412411,54423] 0 2023-10-18T20:58:35.207 INFO:tasks.workunit.client.1.smithi060.stdout:1/671: mknod d4/d6/d7/d2f/d7b/cd4 0 2023-10-18T20:58:35.220 INFO:tasks.workunit.client.1.smithi060.stdout:1/672: getdents d4/d6/d7/d2f/d7b/d2a/d32/d56/d5f 0 2023-10-18T20:58:35.220 INFO:tasks.workunit.client.1.smithi060.stdout:7/618: getdents de/d38 0 2023-10-18T20:58:35.222 INFO:tasks.workunit.client.1.smithi060.stdout:7/619: mknod de/d38/cc9 0 2023-10-18T20:58:35.222 INFO:tasks.workunit.client.1.smithi060.stdout:7/620: chown c8 257991365 1 2023-10-18T20:58:35.223 INFO:tasks.workunit.client.1.smithi060.stdout:7/621: truncate de/d14/d2f/d8f/d5b/f74 863325 0 2023-10-18T20:58:35.223 INFO:tasks.workunit.client.1.smithi060.stdout:1/673: write d4/da/d42/f64 [303915,109640] 0 2023-10-18T20:58:35.225 INFO:tasks.workunit.client.1.smithi060.stdout:7/622: mkdir de/d14/d2f/dca 0 2023-10-18T20:58:35.230 INFO:tasks.workunit.client.1.smithi060.stdout:1/674: rename d4/d6/d7/d2f/d7b/d2a/d32/d56/d5f to d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5 0 2023-10-18T20:58:35.233 INFO:tasks.workunit.client.1.smithi060.stdout:1/675: mknod d4/d6/d7/d2f/d7b/d2a/d32/d56/daa/cd6 0 2023-10-18T20:58:35.237 INFO:tasks.workunit.client.1.smithi060.stdout:8/548: dread d4/f30 [0,4194304] 0 2023-10-18T20:58:35.247 INFO:tasks.workunit.client.1.smithi060.stdout:1/676: rmdir d4/d6/d33/da9 39 2023-10-18T20:58:35.252 INFO:tasks.workunit.client.1.smithi060.stdout:4/515: dwrite d4/d15/f45 [0,4194304] 0 2023-10-18T20:58:35.253 INFO:tasks.workunit.client.1.smithi060.stdout:6/578: dwrite d10/d2e/d75/d77/fa5 [0,4194304] 0 2023-10-18T20:58:35.253 INFO:tasks.workunit.client.1.smithi060.stdout:6/579: fsync d10/d47/d92/f61 0 2023-10-18T20:58:35.255 INFO:tasks.workunit.client.1.smithi060.stdout:5/597: dwrite d0/d6/d8/df/d27/d32/d4f/f68 [4194304,4194304] 0 2023-10-18T20:58:35.264 INFO:tasks.workunit.client.1.smithi060.stdout:8/549: link d4/d9/f83 d4/fa7 0 2023-10-18T20:58:35.267 INFO:tasks.workunit.client.1.smithi060.stdout:9/510: dwrite d3/d99/d1c/d2a/f32 [4194304,4194304] 0 2023-10-18T20:58:35.267 INFO:tasks.workunit.client.1.smithi060.stdout:9/511: truncate d3/d99/d9f/fac 737983 0 2023-10-18T20:58:35.267 INFO:tasks.workunit.client.1.smithi060.stdout:9/512: chown d3/d99/d1c/d2a/c60 5042054 1 2023-10-18T20:58:35.268 INFO:tasks.workunit.client.1.smithi060.stdout:9/513: write d3/d99/d1c/d25/f4b [1516335,58997] 0 2023-10-18T20:58:35.277 INFO:tasks.workunit.client.1.smithi060.stdout:6/580: creat d10/d2e/d75/d81/fb2 x:0 0 0 2023-10-18T20:58:35.279 INFO:tasks.workunit.client.1.smithi060.stdout:5/598: link d0/da/d3b/d64/cda d0/d6/d8/df/d27/d32/d6d/dba/cdf 0 2023-10-18T20:58:35.279 INFO:tasks.workunit.client.1.smithi060.stdout:5/599: chown d0/d6/d9/f14 74273 1 2023-10-18T20:58:35.284 INFO:tasks.workunit.client.1.smithi060.stdout:8/550: mknod d4/d9/d4f/d74/d81/ca8 0 2023-10-18T20:58:35.284 INFO:tasks.workunit.client.1.smithi060.stdout:8/551: chown d4/d9/d4f/d74/d81 5346 1 2023-10-18T20:58:35.285 INFO:tasks.workunit.client.1.smithi060.stdout:8/552: fdatasync d4/d9/f83 0 2023-10-18T20:58:35.285 INFO:tasks.workunit.client.1.smithi060.stdout:9/514: rmdir d3/d99/d1c/d2a/d80/da0 39 2023-10-18T20:58:35.287 INFO:tasks.workunit.client.1.smithi060.stdout:6/581: rename d10/d25/d3c/f6b to d10/d17/dae/fb3 0 2023-10-18T20:58:35.287 INFO:tasks.workunit.client.1.smithi060.stdout:6/582: stat d10/d47/d92/c89 0 2023-10-18T20:58:35.287 INFO:tasks.workunit.client.1.smithi060.stdout:6/583: creat d10/d17/d7a/fb4 x:0 0 0 2023-10-18T20:58:35.288 INFO:tasks.workunit.client.1.smithi060.stdout:8/553: symlink d4/d9/d31/la9 0 2023-10-18T20:58:35.292 INFO:tasks.workunit.client.1.smithi060.stdout:9/515: mknod d3/d99/d19/cc9 0 2023-10-18T20:58:35.292 INFO:tasks.workunit.client.1.smithi060.stdout:9/516: readlink d3/d58/lbf 0 2023-10-18T20:58:35.294 INFO:tasks.workunit.client.1.smithi060.stdout:6/584: truncate f7 1898759 0 2023-10-18T20:58:35.295 INFO:tasks.workunit.client.1.smithi060.stdout:5/600: rename d0/da/d3b/f65 to d0/d6/d8/df/d27/d32/d4f/fe0 0 2023-10-18T20:58:35.297 INFO:tasks.workunit.client.1.smithi060.stdout:6/585: truncate d10/d25/f7f 3978967 0 2023-10-18T20:58:35.298 INFO:tasks.workunit.client.1.smithi060.stdout:5/601: creat d0/dd/dd7/fe1 x:0 0 0 2023-10-18T20:58:35.307 INFO:tasks.workunit.client.1.smithi060.stdout:0/577: sync 2023-10-18T20:58:35.308 INFO:tasks.workunit.client.1.smithi060.stdout:0/578: chown d3/d8/d14/d55/dad/daa 4765 1 2023-10-18T20:58:35.308 INFO:tasks.workunit.client.1.smithi060.stdout:6/586: rename d10/d25/laa to d10/d17/lb5 0 2023-10-18T20:58:35.308 INFO:tasks.workunit.client.1.smithi060.stdout:5/602: truncate d0/da/d3b/f4c 992341 0 2023-10-18T20:58:35.309 INFO:tasks.workunit.client.1.smithi060.stdout:5/603: chown d0/d6/d9/d82/d84/db2/l54 2777 1 2023-10-18T20:58:35.309 INFO:tasks.workunit.client.1.smithi060.stdout:6/587: rename d10/d17/d28/f21 to d10/d2e/d75/d77/d8c/fb6 0 2023-10-18T20:58:35.310 INFO:tasks.workunit.client.1.smithi060.stdout:6/588: creat d10/d17/dae/fb7 x:0 0 0 2023-10-18T20:58:35.311 INFO:tasks.workunit.client.1.smithi060.stdout:6/589: creat d10/d25/fb8 x:0 0 0 2023-10-18T20:58:35.314 INFO:tasks.workunit.client.1.smithi060.stdout:9/517: dread d3/d99/d1c/d5a/d5d/d56/fb4 [0,4194304] 0 2023-10-18T20:58:35.321 INFO:tasks.workunit.client.1.smithi060.stdout:7/623: dwrite de/f19 [0,4194304] 0 2023-10-18T20:58:35.339 INFO:tasks.workunit.client.1.smithi060.stdout:9/518: dread d3/d99/d1c/d2a/f32 [4194304,4194304] 0 2023-10-18T20:58:35.345 INFO:tasks.workunit.client.1.smithi060.stdout:9/519: mknod d3/d99/d19/d54/d8f/cca 0 2023-10-18T20:58:35.346 INFO:tasks.workunit.client.1.smithi060.stdout:1/677: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/fc3 [4194304,4194304] 0 2023-10-18T20:58:35.346 INFO:tasks.workunit.client.1.smithi060.stdout:1/678: chown d4/da/d6e 7699583 1 2023-10-18T20:58:35.353 INFO:tasks.workunit.client.1.smithi060.stdout:9/520: creat d3/d99/d19/d54/da5/fcb x:0 0 0 2023-10-18T20:58:35.354 INFO:tasks.workunit.client.1.smithi060.stdout:9/521: fdatasync d3/d99/d1c/d5a/d5d/f79 0 2023-10-18T20:58:35.355 INFO:tasks.workunit.client.1.smithi060.stdout:0/579: dread d3/f6c [0,4194304] 0 2023-10-18T20:58:35.358 INFO:tasks.workunit.client.1.smithi060.stdout:1/679: symlink d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/ld7 0 2023-10-18T20:58:35.358 INFO:tasks.workunit.client.1.smithi060.stdout:1/680: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/ld7 12992857 1 2023-10-18T20:58:35.362 INFO:tasks.workunit.client.1.smithi060.stdout:4/516: dwrite d4/dc/d2a/d2d/f4f [0,4194304] 0 2023-10-18T20:58:35.362 INFO:tasks.workunit.client.1.smithi060.stdout:4/517: fsync d4/d15/f37 0 2023-10-18T20:58:35.366 INFO:tasks.workunit.client.1.smithi060.stdout:7/624: dread de/d38/fad [0,4194304] 0 2023-10-18T20:58:35.372 INFO:tasks.workunit.client.1.smithi060.stdout:1/681: dread d4/d6/f65 [0,4194304] 0 2023-10-18T20:58:35.373 INFO:tasks.workunit.client.1.smithi060.stdout:0/580: dread d3/d8/d3c/f5c [0,4194304] 0 2023-10-18T20:58:35.374 INFO:tasks.workunit.client.1.smithi060.stdout:4/518: creat d4/dc/d2a/d31/f97 x:0 0 0 2023-10-18T20:58:35.374 INFO:tasks.workunit.client.1.smithi060.stdout:4/519: chown d4/d15/d2b/f59 1 1 2023-10-18T20:58:35.376 INFO:tasks.workunit.client.1.smithi060.stdout:5/604: dwrite d0/d6/d9/d82/d84/db2/f7a [0,4194304] 0 2023-10-18T20:58:35.378 INFO:tasks.workunit.client.1.smithi060.stdout:0/581: rmdir d3/d8/d14/d55/d74/d76/d68 39 2023-10-18T20:58:35.378 INFO:tasks.workunit.client.1.smithi060.stdout:8/554: dwrite d4/d9/d31/f8e [0,4194304] 0 2023-10-18T20:58:35.379 INFO:tasks.workunit.client.1.smithi060.stdout:8/555: chown d4/d9/f23 3069206 1 2023-10-18T20:58:35.379 INFO:tasks.workunit.client.1.smithi060.stdout:8/556: dread - d4/d9/d37/d4e/d6e/f95 zero size 2023-10-18T20:58:35.379 INFO:tasks.workunit.client.1.smithi060.stdout:8/557: fdatasync d4/ff 0 2023-10-18T20:58:35.380 INFO:tasks.workunit.client.1.smithi060.stdout:5/605: mknod d0/d47/ce2 0 2023-10-18T20:58:35.385 INFO:tasks.workunit.client.1.smithi060.stdout:5/606: getdents d0 0 2023-10-18T20:58:35.385 INFO:tasks.workunit.client.1.smithi060.stdout:5/607: chown d0/d6/d9/d82/d84/db2/d41/ca6 124677 1 2023-10-18T20:58:35.386 INFO:tasks.workunit.client.1.smithi060.stdout:0/582: rmdir d3/d8/d3c 39 2023-10-18T20:58:35.387 INFO:tasks.workunit.client.1.smithi060.stdout:4/520: dread d4/d15/f8e [0,4194304] 0 2023-10-18T20:58:35.387 INFO:tasks.workunit.client.1.smithi060.stdout:5/608: creat d0/d6/fe3 x:0 0 0 2023-10-18T20:58:35.388 INFO:tasks.workunit.client.1.smithi060.stdout:0/583: creat d3/d32/d86/fb7 x:0 0 0 2023-10-18T20:58:35.390 INFO:tasks.workunit.client.1.smithi060.stdout:4/521: rename d4/dc/d2a/d39/c78 to d4/dc/d2a/d2d/d69/d89/c98 0 2023-10-18T20:58:35.391 INFO:tasks.workunit.client.1.smithi060.stdout:0/584: getdents d3/d8/d14/d55/d74 0 2023-10-18T20:58:35.392 INFO:tasks.workunit.client.1.smithi060.stdout:1/682: dread d4/d6/d7/d2f/d7b/d2a/d32/d56/f75 [0,4194304] 0 2023-10-18T20:58:35.392 INFO:tasks.workunit.client.1.smithi060.stdout:7/625: write de/d29/d72/f90 [2477238,34059] 0 2023-10-18T20:58:35.393 INFO:tasks.workunit.client.1.smithi060.stdout:6/590: dwrite d10/d2e/d75/d81/fb2 [0,4194304] 0 2023-10-18T20:58:35.393 INFO:tasks.workunit.client.1.smithi060.stdout:5/609: rename d0/d6/d8/df/d27/d32 to d0/da/dc8/de4 0 2023-10-18T20:58:35.400 INFO:tasks.workunit.client.1.smithi060.stdout:1/683: mknod d4/d6/d7/d2f/d7b/d2a/cd8 0 2023-10-18T20:58:35.401 INFO:tasks.workunit.client.1.smithi060.stdout:6/591: link d10/d2e/d75/d81/la1 d10/d17/d7a/lb9 0 2023-10-18T20:58:35.401 INFO:tasks.workunit.client.1.smithi060.stdout:6/592: chown d10/d47/d92 1950 1 2023-10-18T20:58:35.405 INFO:tasks.workunit.client.1.smithi060.stdout:1/684: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/fd9 x:0 0 0 2023-10-18T20:58:35.406 INFO:tasks.workunit.client.1.smithi060.stdout:6/593: mkdir d10/d17/d70/dba 0 2023-10-18T20:58:35.407 INFO:tasks.workunit.client.1.smithi060.stdout:3/520: sync 2023-10-18T20:58:35.408 INFO:tasks.workunit.client.1.smithi060.stdout:2/556: sync 2023-10-18T20:58:35.412 INFO:tasks.workunit.client.1.smithi060.stdout:1/685: mkdir d4/d6/d7/d2f/d7b/dda 0 2023-10-18T20:58:35.412 INFO:tasks.workunit.client.1.smithi060.stdout:1/686: readlink d4/l18 0 2023-10-18T20:58:35.413 INFO:tasks.workunit.client.1.smithi060.stdout:6/594: symlink d10/d17/d70/dba/lbb 0 2023-10-18T20:58:35.414 INFO:tasks.workunit.client.1.smithi060.stdout:3/521: creat d0/d22/d26/d2b/fb9 x:0 0 0 2023-10-18T20:58:35.416 INFO:tasks.workunit.client.1.smithi060.stdout:2/557: rename d0/d8/d47/f99 to d0/d45/fb5 0 2023-10-18T20:58:35.416 INFO:tasks.workunit.client.1.smithi060.stdout:2/558: dread - d0/f97 zero size 2023-10-18T20:58:35.418 INFO:tasks.workunit.client.1.smithi060.stdout:1/687: mknod d4/d6/d7/d2f/d7b/d2a/d32/cdb 0 2023-10-18T20:58:35.418 INFO:tasks.workunit.client.1.smithi060.stdout:3/522: truncate d0/f11 740817 0 2023-10-18T20:58:35.418 INFO:tasks.workunit.client.1.smithi060.stdout:3/523: truncate d0/d3c/d3d/f98 867912 0 2023-10-18T20:58:35.422 INFO:tasks.workunit.client.1.smithi060.stdout:2/559: rename d0/d3/c24 to d0/d8/cb6 0 2023-10-18T20:58:35.472 INFO:tasks.workunit.client.1.smithi060.stdout:6/595: dwrite d10/d47/f91 [0,4194304] 0 2023-10-18T20:58:35.477 INFO:tasks.workunit.client.1.smithi060.stdout:7/626: dwrite de/d14/d2f/d8f/d65/fa9 [4194304,4194304] 0 2023-10-18T20:58:35.477 INFO:tasks.workunit.client.1.smithi060.stdout:8/558: dwrite d4/d9/d37/fa2 [0,4194304] 0 2023-10-18T20:58:35.479 INFO:tasks.workunit.client.1.smithi060.stdout:7/627: write de/d38/d78/fbf [392931,80798] 0 2023-10-18T20:58:35.482 INFO:tasks.workunit.client.1.smithi060.stdout:6/596: dread d10/d17/f82 [0,4194304] 0 2023-10-18T20:58:35.501 INFO:tasks.workunit.client.1.smithi060.stdout:0/585: dwrite d3/d8/f3f [0,4194304] 0 2023-10-18T20:58:35.501 INFO:tasks.workunit.client.1.smithi060.stdout:0/586: write d3/d8/d3c/f5c [1658582,77348] 0 2023-10-18T20:58:35.502 INFO:tasks.workunit.client.1.smithi060.stdout:5/610: dwrite d0/d6/d9/fd5 [0,4194304] 0 2023-10-18T20:58:35.524 INFO:tasks.workunit.client.1.smithi060.stdout:6/597: dwrite f7 [0,4194304] 0 2023-10-18T20:58:35.538 INFO:tasks.workunit.client.1.smithi060.stdout:0/587: dwrite d3/d8/d14/d55/d74/d76/f8a [4194304,4194304] 0 2023-10-18T20:58:35.538 INFO:tasks.workunit.client.1.smithi060.stdout:0/588: write d3/d80/fa7 [184056,39978] 0 2023-10-18T20:58:35.539 INFO:tasks.workunit.client.1.smithi060.stdout:6/598: read d10/d2e/d75/d77/d8c/fb6 [5114330,105547] 0 2023-10-18T20:58:35.541 INFO:tasks.workunit.client.1.smithi060.stdout:6/599: symlink d10/d17/d2f/lbc 0 2023-10-18T20:58:35.544 INFO:tasks.workunit.client.1.smithi060.stdout:6/600: write d10/d2e/f56 [5347981,4419] 0 2023-10-18T20:58:35.545 INFO:tasks.workunit.client.1.smithi060.stdout:6/601: chown d10/d2e/f3f 10 1 2023-10-18T20:58:35.546 INFO:tasks.workunit.client.1.smithi060.stdout:6/602: creat d10/d17/d54/db1/fbd x:0 0 0 2023-10-18T20:58:35.546 INFO:tasks.workunit.client.1.smithi060.stdout:6/603: dread - d10/d17/f97 zero size 2023-10-18T20:58:35.556 INFO:tasks.workunit.client.1.smithi060.stdout:5/611: write d0/d6/f1e [4633139,56082] 0 2023-10-18T20:58:35.558 INFO:tasks.workunit.client.1.smithi060.stdout:5/612: mknod d0/da/d79/da5/ce5 0 2023-10-18T20:58:35.561 INFO:tasks.workunit.client.1.smithi060.stdout:5/613: getdents d0/d6/d9/d82/d84/db2 0 2023-10-18T20:58:35.563 INFO:tasks.workunit.client.1.smithi060.stdout:6/604: dread d10/d47/d92/f61 [0,4194304] 0 2023-10-18T20:58:35.564 INFO:tasks.workunit.client.1.smithi060.stdout:6/605: write d10/d17/f82 [531214,35592] 0 2023-10-18T20:58:35.564 INFO:tasks.workunit.client.1.smithi060.stdout:6/606: read d10/d2e/f3f [6425811,276] 0 2023-10-18T20:58:35.564 INFO:tasks.workunit.client.1.smithi060.stdout:6/607: truncate d10/d17/d2f/fa0 613535 0 2023-10-18T20:58:35.566 INFO:tasks.workunit.client.1.smithi060.stdout:7/628: dwrite de/d14/d49/d68/d7d/d7e/fc2 [0,4194304] 0 2023-10-18T20:58:35.599 INFO:tasks.workunit.client.1.smithi060.stdout:0/589: dwrite d3/d8/d14/d55/d74/d76/f8a [0,4194304] 0 2023-10-18T20:58:35.602 INFO:tasks.workunit.client.1.smithi060.stdout:0/590: write d3/d8/d14/f5f [369323,79309] 0 2023-10-18T20:58:35.602 INFO:tasks.workunit.client.1.smithi060.stdout:0/591: read d3/f1a [1080214,59251] 0 2023-10-18T20:58:35.602 INFO:tasks.workunit.client.1.smithi060.stdout:0/592: fsync d3/fc 0 2023-10-18T20:58:35.603 INFO:tasks.workunit.client.1.smithi060.stdout:0/593: truncate d3/fb4 493596 0 2023-10-18T20:58:35.610 INFO:tasks.workunit.client.1.smithi060.stdout:6/608: dwrite d10/d25/f8d [0,4194304] 0 2023-10-18T20:58:35.610 INFO:tasks.workunit.client.1.smithi060.stdout:0/594: dread d3/d8/d14/f89 [0,4194304] 0 2023-10-18T20:58:35.613 INFO:tasks.workunit.client.1.smithi060.stdout:0/595: getdents d3/d8/d3c 0 2023-10-18T20:58:35.613 INFO:tasks.workunit.client.1.smithi060.stdout:0/596: readlink d3/d8/d14/d55/l61 0 2023-10-18T20:58:35.613 INFO:tasks.workunit.client.1.smithi060.stdout:0/597: readlink d3/d8/d3c/l53 0 2023-10-18T20:58:35.622 INFO:tasks.workunit.client.1.smithi060.stdout:8/559: dwrite d4/d9/d4f/f86 [0,4194304] 0 2023-10-18T20:58:35.623 INFO:tasks.workunit.client.1.smithi060.stdout:5/614: dread d0/f5f [0,4194304] 0 2023-10-18T20:58:35.627 INFO:tasks.workunit.client.1.smithi060.stdout:5/615: mknod d0/d6/d9/d82/d84/db2/db8/ce6 0 2023-10-18T20:58:35.628 INFO:tasks.workunit.client.1.smithi060.stdout:5/616: mkdir d0/da/d79/da5/d67/de7 0 2023-10-18T20:58:35.629 INFO:tasks.workunit.client.1.smithi060.stdout:0/598: dread d3/d80/fa7 [0,4194304] 0 2023-10-18T20:58:35.634 INFO:tasks.workunit.client.1.smithi060.stdout:0/599: rename d3/d8/d14/d55/d74/f85 to d3/d8/d14/d55/dad/daa/fb8 0 2023-10-18T20:58:35.644 INFO:tasks.workunit.client.1.smithi060.stdout:7/629: dwrite de/d14/d41/f6a [0,4194304] 0 2023-10-18T20:58:35.649 INFO:tasks.workunit.client.1.smithi060.stdout:9/522: sync 2023-10-18T20:58:35.649 INFO:tasks.workunit.client.1.smithi060.stdout:4/522: sync 2023-10-18T20:58:35.650 INFO:tasks.workunit.client.1.smithi060.stdout:1/688: sync 2023-10-18T20:58:35.650 INFO:tasks.workunit.client.1.smithi060.stdout:9/523: chown d3/d99/d1c/d2a/f52 1 1 2023-10-18T20:58:35.650 INFO:tasks.workunit.client.1.smithi060.stdout:4/523: fdatasync d4/dc/d2a/f1f 0 2023-10-18T20:58:35.651 INFO:tasks.workunit.client.1.smithi060.stdout:8/560: write d4/f30 [399883,19957] 0 2023-10-18T20:58:35.651 INFO:tasks.workunit.client.1.smithi060.stdout:8/561: chown d4/d9/f23 0 1 2023-10-18T20:58:35.655 INFO:tasks.workunit.client.1.smithi060.stdout:7/630: symlink de/d14/d2f/d8f/d5b/d9e/lcb 0 2023-10-18T20:58:35.655 INFO:tasks.workunit.client.1.smithi060.stdout:1/689: symlink d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/ldc 0 2023-10-18T20:58:35.655 INFO:tasks.workunit.client.1.smithi060.stdout:4/524: truncate d4/d15/d2b/f59 9299261 0 2023-10-18T20:58:35.656 INFO:tasks.workunit.client.1.smithi060.stdout:4/525: write d4/dc/d2a/f1f [2239335,35940] 0 2023-10-18T20:58:35.656 INFO:tasks.workunit.client.1.smithi060.stdout:9/524: symlink d3/d99/d1c/d5a/d5d/d56/lcc 0 2023-10-18T20:58:35.661 INFO:tasks.workunit.client.1.smithi060.stdout:1/690: link d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/fab d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/fdd 0 2023-10-18T20:58:35.662 INFO:tasks.workunit.client.1.smithi060.stdout:1/691: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/fb7 5533 1 2023-10-18T20:58:35.662 INFO:tasks.workunit.client.1.smithi060.stdout:1/692: fdatasync d4/d6/d48/fbd 0 2023-10-18T20:58:35.662 INFO:tasks.workunit.client.1.smithi060.stdout:6/609: dwrite d10/d17/d2f/fa0 [0,4194304] 0 2023-10-18T20:58:35.662 INFO:tasks.workunit.client.1.smithi060.stdout:6/610: dread - d10/d25/f57 zero size 2023-10-18T20:58:35.663 INFO:tasks.workunit.client.1.smithi060.stdout:4/526: mkdir d4/dc/d2a/d39/d53/d76/d99 0 2023-10-18T20:58:35.663 INFO:tasks.workunit.client.1.smithi060.stdout:4/527: chown d4/dc/d2a/d5b 0 1 2023-10-18T20:58:35.664 INFO:tasks.workunit.client.1.smithi060.stdout:8/562: link d4/d9/d4f/d74/c76 d4/d9/d31/d35/d9f/da3/caa 0 2023-10-18T20:58:35.664 INFO:tasks.workunit.client.1.smithi060.stdout:9/525: getdents d3/d99/d1c/d2a/d33 0 2023-10-18T20:58:35.664 INFO:tasks.workunit.client.1.smithi060.stdout:9/526: creat d3/d99/d19/d54/fcd x:0 0 0 2023-10-18T20:58:35.664 INFO:tasks.workunit.client.1.smithi060.stdout:9/527: dread - d3/d99/d19/d54/fcd zero size 2023-10-18T20:58:35.665 INFO:tasks.workunit.client.1.smithi060.stdout:6/611: stat d10/d2e/d75/d81/la7 0 2023-10-18T20:58:35.667 INFO:tasks.workunit.client.1.smithi060.stdout:1/693: creat d4/d6/d7/d2f/d7b/d2a/d32/dd/fde x:0 0 0 2023-10-18T20:58:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:34.113084+0000 mgr.smithi008.flmjzp (mgr.14640) 4 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail 2023-10-18T20:58:35.671 INFO:tasks.workunit.client.1.smithi060.stdout:4/528: creat d4/dc/d2a/f9a x:0 0 0 2023-10-18T20:58:35.671 INFO:tasks.workunit.client.1.smithi060.stdout:4/529: creat d4/dc/d2a/d13/f9b x:0 0 0 2023-10-18T20:58:35.671 INFO:tasks.workunit.client.1.smithi060.stdout:8/563: mknod d4/d9/d88/cab 0 2023-10-18T20:58:35.675 INFO:tasks.workunit.client.1.smithi060.stdout:6/612: link d10/d25/c4c d10/d2e/d75/d77/cbe 0 2023-10-18T20:58:35.675 INFO:tasks.workunit.client.1.smithi060.stdout:6/613: fsync d10/d2e/d75/d77/d8c/fa2 0 2023-10-18T20:58:35.676 INFO:tasks.workunit.client.1.smithi060.stdout:9/528: rmdir d3/d99/d1c/d5a/d5d/d56 39 2023-10-18T20:58:35.676 INFO:tasks.workunit.client.1.smithi060.stdout:9/529: dread - d3/d99/d1c/d2a/d2d/db9/fc1 zero size 2023-10-18T20:58:35.677 INFO:tasks.workunit.client.1.smithi060.stdout:4/530: creat d4/dc/d2a/d13/d27/f9c x:0 0 0 2023-10-18T20:58:35.677 INFO:tasks.workunit.client.1.smithi060.stdout:4/531: getdents d4/dc/d2a/d39/d53/d76/d99 0 2023-10-18T20:58:35.678 INFO:tasks.workunit.client.1.smithi060.stdout:5/617: dwrite d0/da/d3b/fc6 [0,4194304] 0 2023-10-18T20:58:35.678 INFO:tasks.workunit.client.1.smithi060.stdout:6/614: mkdir d10/d17/dae/dbf 0 2023-10-18T20:58:35.679 INFO:tasks.workunit.client.1.smithi060.stdout:7/631: dread fc [0,4194304] 0 2023-10-18T20:58:35.679 INFO:tasks.workunit.client.1.smithi060.stdout:2/560: sync 2023-10-18T20:58:35.679 INFO:tasks.workunit.client.1.smithi060.stdout:3/524: sync 2023-10-18T20:58:35.680 INFO:tasks.workunit.client.1.smithi060.stdout:0/600: dwrite d3/d32/d86/fb7 [0,4194304] 0 2023-10-18T20:58:35.689 INFO:tasks.workunit.client.1.smithi060.stdout:6/615: symlink d10/d17/d2f/lc0 0 2023-10-18T20:58:35.690 INFO:tasks.workunit.client.1.smithi060.stdout:7/632: symlink de/lcc 0 2023-10-18T20:58:35.691 INFO:tasks.workunit.client.1.smithi060.stdout:1/694: dread d4/d6/d7/df/f40 [0,4194304] 0 2023-10-18T20:58:35.692 INFO:tasks.workunit.client.1.smithi060.stdout:1/695: write d4/d6/d7/d2f/d7b/d2a/d32/d56/daa/fc1 [827033,4889] 0 2023-10-18T20:58:35.692 INFO:tasks.workunit.client.1.smithi060.stdout:1/696: getdents d4/d6/d14 0 2023-10-18T20:58:35.692 INFO:tasks.workunit.client.1.smithi060.stdout:1/697: chown d4 145573418 1 2023-10-18T20:58:35.693 INFO:tasks.workunit.client.1.smithi060.stdout:2/561: link d0/d3/c6d d0/cb7 0 2023-10-18T20:58:35.698 INFO:tasks.workunit.client.1.smithi060.stdout:0/601: rename d3/d8/d14/d55/d74/d76/d68/d98/c9f to d3/d8/d14/d55/d74/cb9 0 2023-10-18T20:58:35.699 INFO:tasks.workunit.client.1.smithi060.stdout:5/618: rmdir d0/dd/dd7 39 2023-10-18T20:58:35.701 INFO:tasks.workunit.client.1.smithi060.stdout:7/633: creat de/d14/d2f/d8f/d5b/d9e/dac/fcd x:0 0 0 2023-10-18T20:58:35.702 INFO:tasks.workunit.client.1.smithi060.stdout:3/525: dread d0/d3c/d3d/f32 [0,4194304] 0 2023-10-18T20:58:35.711 INFO:tasks.workunit.client.1.smithi060.stdout:0/602: mkdir d3/d8/d3c/d87/dba 0 2023-10-18T20:58:35.713 INFO:tasks.workunit.client.1.smithi060.stdout:5/619: getdents d0/d6/d8 0 2023-10-18T20:58:35.719 INFO:tasks.workunit.client.1.smithi060.stdout:2/562: rename d0/d3/f59 to d0/d3/d27/d4d/d5e/d96/fb8 0 2023-10-18T20:58:35.719 INFO:tasks.workunit.client.1.smithi060.stdout:2/563: fsync d0/d43/f8e 0 2023-10-18T20:58:35.719 INFO:tasks.workunit.client.1.smithi060.stdout:1/698: getdents d4/d6/d33 0 2023-10-18T20:58:35.720 INFO:tasks.workunit.client.1.smithi060.stdout:7/634: creat de/d14/d49/d68/d7d/d7e/db5/fce x:0 0 0 2023-10-18T20:58:35.720 INFO:tasks.workunit.client.1.smithi060.stdout:7/635: write de/d29/f77 [4328793,12854] 0 2023-10-18T20:58:35.720 INFO:tasks.workunit.client.1.smithi060.stdout:7/636: write de/d29/d72/fa8 [1264459,50620] 0 2023-10-18T20:58:35.720 INFO:tasks.workunit.client.1.smithi060.stdout:7/637: write de/d14/d2f/f87 [692582,76550] 0 2023-10-18T20:58:35.723 INFO:tasks.workunit.client.1.smithi060.stdout:5/620: mknod d0/d6/d9/db1/ce8 0 2023-10-18T20:58:35.726 INFO:tasks.workunit.client.1.smithi060.stdout:1/699: rename d4/d6/d7/lc8 to d4/da/ldf 0 2023-10-18T20:58:35.727 INFO:tasks.workunit.client.1.smithi060.stdout:7/638: mknod de/d14/d49/d68/d88/ccf 0 2023-10-18T20:58:35.728 INFO:tasks.workunit.client.1.smithi060.stdout:1/700: unlink d4/da/l1e 0 2023-10-18T20:58:35.732 INFO:tasks.workunit.client.1.smithi060.stdout:9/530: dwrite d3/d99/d1c/d2a/d80/fb7 [0,4194304] 0 2023-10-18T20:58:35.733 INFO:tasks.workunit.client.1.smithi060.stdout:3/526: write d0/d22/f33 [1454614,53101] 0 2023-10-18T20:58:35.733 INFO:tasks.workunit.client.1.smithi060.stdout:8/564: dwrite d4/d9/f1b [0,4194304] 0 2023-10-18T20:58:35.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:34.113084+0000 mgr.smithi008.flmjzp (mgr.14640) 4 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail 2023-10-18T20:58:35.740 INFO:tasks.workunit.client.1.smithi060.stdout:7/639: creat de/d14/fd0 x:0 0 0 2023-10-18T20:58:35.740 INFO:tasks.workunit.client.1.smithi060.stdout:1/701: rename d4/da/d6e to d4/da/de0 0 2023-10-18T20:58:35.744 INFO:tasks.workunit.client.1.smithi060.stdout:8/565: rename d4/f53 to d4/d9/d31/da6/fac 0 2023-10-18T20:58:35.745 INFO:tasks.workunit.client.1.smithi060.stdout:5/621: dread d0/d6/f42 [0,4194304] 0 2023-10-18T20:58:35.746 INFO:tasks.workunit.client.1.smithi060.stdout:3/527: rmdir d0/d22/d26/d8c 39 2023-10-18T20:58:35.748 INFO:tasks.workunit.client.1.smithi060.stdout:1/702: rename d4/d6/d7/d2f/f39 to d4/d6/d7/d2f/fe1 0 2023-10-18T20:58:35.748 INFO:tasks.workunit.client.1.smithi060.stdout:8/566: truncate d4/d9/d37/f56 649164 0 2023-10-18T20:58:35.748 INFO:tasks.workunit.client.1.smithi060.stdout:8/567: chown d4/c68 25475 1 2023-10-18T20:58:35.749 INFO:tasks.workunit.client.1.smithi060.stdout:0/603: dwrite d3/d8/d14/f89 [0,4194304] 0 2023-10-18T20:58:35.749 INFO:tasks.workunit.client.1.smithi060.stdout:5/622: creat d0/d6/d9/d82/fe9 x:0 0 0 2023-10-18T20:58:35.749 INFO:tasks.workunit.client.1.smithi060.stdout:5/623: stat d0/d6/d8/df/f51 0 2023-10-18T20:58:35.750 INFO:tasks.workunit.client.1.smithi060.stdout:5/624: creat d0/da/d3b/fea x:0 0 0 2023-10-18T20:58:35.750 INFO:tasks.workunit.client.1.smithi060.stdout:5/625: truncate d0/d47/d7d/fcc 992057 0 2023-10-18T20:58:35.750 INFO:tasks.workunit.client.1.smithi060.stdout:3/528: creat d0/d22/d26/d8c/fba x:0 0 0 2023-10-18T20:58:35.754 INFO:tasks.workunit.client.1.smithi060.stdout:8/568: write d4/d9/d4f/f63 [287250,76299] 0 2023-10-18T20:58:35.755 INFO:tasks.workunit.client.1.smithi060.stdout:1/703: mkdir d4/d6/d7/d2f/d7b/de2 0 2023-10-18T20:58:35.755 INFO:tasks.workunit.client.1.smithi060.stdout:1/704: fdatasync d4/d6/d7/d2f/d7b/d2a/d32/dd/fde 0 2023-10-18T20:58:35.755 INFO:tasks.workunit.client.1.smithi060.stdout:1/705: chown d4/d6/f22 3 1 2023-10-18T20:58:35.755 INFO:tasks.workunit.client.1.smithi060.stdout:1/706: write d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/f6c [1139744,38148] 0 2023-10-18T20:58:35.755 INFO:tasks.workunit.client.1.smithi060.stdout:0/604: mknod d3/d8/cbb 0 2023-10-18T20:58:35.764 INFO:tasks.workunit.client.1.smithi060.stdout:5/626: getdents d0/d6/d9/d82/d84/db2/d2a 0 2023-10-18T20:58:35.767 INFO:tasks.workunit.client.1.smithi060.stdout:7/640: dread de/d14/f30 [0,4194304] 0 2023-10-18T20:58:35.767 INFO:tasks.workunit.client.1.smithi060.stdout:3/529: rename d0/d3c/f54 to d0/d22/d26/d8c/fbb 0 2023-10-18T20:58:35.768 INFO:tasks.workunit.client.1.smithi060.stdout:8/569: mknod d4/d9/d4f/d74/cad 0 2023-10-18T20:58:35.768 INFO:tasks.workunit.client.1.smithi060.stdout:8/570: fsync d4/d9/d4f/f92 0 2023-10-18T20:58:35.773 INFO:tasks.workunit.client.1.smithi060.stdout:1/707: link d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/cca d4/d6/d7/d2f/d7b/d2a/d32/dd/ce3 0 2023-10-18T20:58:35.777 INFO:tasks.workunit.client.1.smithi060.stdout:9/531: dwrite d3/fa1 [0,4194304] 0 2023-10-18T20:58:35.782 INFO:tasks.workunit.client.1.smithi060.stdout:0/605: mkdir d3/d8/d14/d55/d74/d76/d68/d7f/d8d/dbc 0 2023-10-18T20:58:35.784 INFO:tasks.workunit.client.1.smithi060.stdout:7/641: rename de/d14/d2f/d8f/faf to de/d14/d2f/d8f/d5b/d9e/fd1 0 2023-10-18T20:58:35.786 INFO:tasks.workunit.client.1.smithi060.stdout:1/708: creat d4/d6/d7/d2f/d7b/d2a/d32/fe4 x:0 0 0 2023-10-18T20:58:35.790 INFO:tasks.workunit.client.1.smithi060.stdout:0/606: dread d3/d8/f22 [0,4194304] 0 2023-10-18T20:58:35.795 INFO:tasks.workunit.client.1.smithi060.stdout:5/627: rmdir d0/d6/d9/d82 39 2023-10-18T20:58:35.798 INFO:tasks.workunit.client.1.smithi060.stdout:8/571: rename d4/d9/d31/d35/c7f to d4/d9/d4f/d74/cae 0 2023-10-18T20:58:35.798 INFO:tasks.workunit.client.1.smithi060.stdout:8/572: dread - d4/d9/d31/d35/f9d zero size 2023-10-18T20:58:35.799 INFO:tasks.workunit.client.1.smithi060.stdout:7/642: mkdir de/d14/dd2 0 2023-10-18T20:58:35.800 INFO:tasks.workunit.client.1.smithi060.stdout:3/530: getdents d0/d22/d50 0 2023-10-18T20:58:35.801 INFO:tasks.workunit.client.1.smithi060.stdout:1/709: getdents d4/d38/da0 0 2023-10-18T20:58:35.810 INFO:tasks.workunit.client.1.smithi060.stdout:4/532: sync 2023-10-18T20:58:35.810 INFO:tasks.workunit.client.1.smithi060.stdout:4/533: chown d4/dc/d2a/d13/f87 7549 1 2023-10-18T20:58:35.810 INFO:tasks.workunit.client.1.smithi060.stdout:4/534: write d4/dc/d2a/d13/f9b [304741,3522] 0 2023-10-18T20:58:35.811 INFO:tasks.workunit.client.1.smithi060.stdout:0/607: mkdir d3/d8/d3c/dbd 0 2023-10-18T20:58:35.812 INFO:tasks.workunit.client.1.smithi060.stdout:6/616: sync 2023-10-18T20:58:35.812 INFO:tasks.workunit.client.1.smithi060.stdout:2/564: sync 2023-10-18T20:58:35.813 INFO:tasks.workunit.client.1.smithi060.stdout:6/617: write d10/d47/d92/f4a [3409271,36530] 0 2023-10-18T20:58:35.813 INFO:tasks.workunit.client.1.smithi060.stdout:9/532: getdents d3/d99/d1c/d2a/d2d 0 2023-10-18T20:58:35.813 INFO:tasks.workunit.client.1.smithi060.stdout:9/533: write d3/d99/d1c/d2a/d80/da0/dc2/fba [1361217,25300] 0 2023-10-18T20:58:35.813 INFO:tasks.workunit.client.1.smithi060.stdout:9/534: write d3/d99/d1c/d2a/d80/fb7 [4481713,24233] 0 2023-10-18T20:58:35.813 INFO:tasks.workunit.client.1.smithi060.stdout:9/535: chown d3/d99/d1c/d25/f4b 7 1 2023-10-18T20:58:35.814 INFO:tasks.workunit.client.1.smithi060.stdout:8/573: rmdir d4/d9/d4f/d74 39 2023-10-18T20:58:35.814 INFO:tasks.workunit.client.1.smithi060.stdout:7/643: mkdir de/d14/d2f/dd3 0 2023-10-18T20:58:35.814 INFO:tasks.workunit.client.1.smithi060.stdout:7/644: write de/d14/fd0 [876988,98323] 0 2023-10-18T20:58:35.815 INFO:tasks.workunit.client.1.smithi060.stdout:7/645: fsync de/d14/d3a/d46/fb0 0 2023-10-18T20:58:35.818 INFO:tasks.workunit.client.1.smithi060.stdout:9/536: write d3/d99/d1c/d2a/f3b [200619,92784] 0 2023-10-18T20:58:35.818 INFO:tasks.workunit.client.1.smithi060.stdout:0/608: symlink d3/d8/d14/d55/d9a/lbe 0 2023-10-18T20:58:35.819 INFO:tasks.workunit.client.1.smithi060.stdout:3/531: mkdir d0/d5e/dbc 0 2023-10-18T20:58:35.819 INFO:tasks.workunit.client.1.smithi060.stdout:3/532: fsync d0/f18 0 2023-10-18T20:58:35.819 INFO:tasks.workunit.client.1.smithi060.stdout:1/710: mkdir d4/d38/de5 0 2023-10-18T20:58:35.820 INFO:tasks.workunit.client.1.smithi060.stdout:8/574: unlink d4/d9/d37/f38 0 2023-10-18T20:58:35.820 INFO:tasks.workunit.client.1.smithi060.stdout:6/618: unlink d10/d2e/d75/d81/d8b/f9e 0 2023-10-18T20:58:35.820 INFO:tasks.workunit.client.1.smithi060.stdout:6/619: creat d10/d25/fc1 x:0 0 0 2023-10-18T20:58:35.821 INFO:tasks.workunit.client.1.smithi060.stdout:0/609: rename d3/f4f to d3/d8/d3c/fbf 0 2023-10-18T20:58:35.821 INFO:tasks.workunit.client.1.smithi060.stdout:0/610: dread - d3/d8/d14/d55/f88 zero size 2023-10-18T20:58:35.824 INFO:tasks.workunit.client.1.smithi060.stdout:1/711: mkdir d4/d6/d7/d2f/d7b/d2a/de6 0 2023-10-18T20:58:35.825 INFO:tasks.workunit.client.1.smithi060.stdout:8/575: rmdir d4/d9/d4f 39 2023-10-18T20:58:35.825 INFO:tasks.workunit.client.1.smithi060.stdout:5/628: dwrite d0/d47/f8d [0,4194304] 0 2023-10-18T20:58:35.827 INFO:tasks.workunit.client.1.smithi060.stdout:6/620: fsync d10/d2e/d75/d77/d8c/fb6 0 2023-10-18T20:58:35.830 INFO:tasks.workunit.client.1.smithi060.stdout:7/646: read de/d14/d41/f6a [1913967,104449] 0 2023-10-18T20:58:35.831 INFO:tasks.workunit.client.1.smithi060.stdout:4/535: read d4/dc/d2a/d31/f46 [2304799,126330] 0 2023-10-18T20:58:35.831 INFO:tasks.workunit.client.1.smithi060.stdout:4/536: read - d4/d15/f6e zero size 2023-10-18T20:58:35.831 INFO:tasks.workunit.client.1.smithi060.stdout:0/611: creat d3/d8/d14/d55/d74/d76/d68/fc0 x:0 0 0 2023-10-18T20:58:35.832 INFO:tasks.workunit.client.1.smithi060.stdout:0/612: dread - d3/d8/d14/d55/d74/d76/d68/d7f/f99 zero size 2023-10-18T20:58:35.832 INFO:tasks.workunit.client.1.smithi060.stdout:0/613: chown d3/d8/d14/d55/d74/d76/f36 7906 1 2023-10-18T20:58:35.839 INFO:tasks.workunit.client.1.smithi060.stdout:4/537: unlink d4/dc/d2a/d13/d2f/l50 0 2023-10-18T20:58:35.841 INFO:tasks.workunit.client.1.smithi060.stdout:8/576: mknod d4/caf 0 2023-10-18T20:58:35.848 INFO:tasks.workunit.client.1.smithi060.stdout:0/614: dread d3/f21 [0,4194304] 0 2023-10-18T20:58:35.848 INFO:tasks.workunit.client.1.smithi060.stdout:0/615: getdents d3/d8/d3c/dbd 0 2023-10-18T20:58:35.849 INFO:tasks.workunit.client.1.smithi060.stdout:6/621: write d10/d17/d2f/f64 [1915929,32530] 0 2023-10-18T20:58:35.849 INFO:tasks.workunit.client.1.smithi060.stdout:6/622: creat d10/d6f/fc2 x:0 0 0 2023-10-18T20:58:35.849 INFO:tasks.workunit.client.1.smithi060.stdout:6/623: chown d10/d25/d3c 51115753 1 2023-10-18T20:58:35.864 INFO:tasks.workunit.client.1.smithi060.stdout:7/647: dread de/f19 [0,4194304] 0 2023-10-18T20:58:35.864 INFO:tasks.workunit.client.1.smithi060.stdout:0/616: dread d3/d8/d14/d55/d74/d76/d6b/f75 [0,4194304] 0 2023-10-18T20:58:35.865 INFO:tasks.workunit.client.1.smithi060.stdout:8/577: write d4/d9/d37/fa2 [2743729,46658] 0 2023-10-18T20:58:35.866 INFO:tasks.workunit.client.1.smithi060.stdout:9/537: dwrite d3/d99/d1c/d5a/d5d/d7d/f89 [0,4194304] 0 2023-10-18T20:58:35.866 INFO:tasks.workunit.client.1.smithi060.stdout:9/538: read - d3/d99/d19/d54/fcd zero size 2023-10-18T20:58:35.875 INFO:tasks.workunit.client.1.smithi060.stdout:4/538: dread d4/d15/f37 [0,4194304] 0 2023-10-18T20:58:35.876 INFO:tasks.workunit.client.1.smithi060.stdout:2/565: dwrite d0/f78 [0,4194304] 0 2023-10-18T20:58:35.876 INFO:tasks.workunit.client.1.smithi060.stdout:2/566: dread - d0/d8/f8a zero size 2023-10-18T20:58:35.886 INFO:tasks.workunit.client.1.smithi060.stdout:1/712: dwrite d4/d6/d7/d2f/d6d/f9d [0,4194304] 0 2023-10-18T20:58:35.888 INFO:tasks.workunit.client.1.smithi060.stdout:1/713: write d4/d6/d7/d2f/d7b/d2a/d32/d56/f75 [1336039,112626] 0 2023-10-18T20:58:35.902 INFO:tasks.workunit.client.1.smithi060.stdout:0/617: dwrite d3/fb4 [0,4194304] 0 2023-10-18T20:58:35.904 INFO:tasks.workunit.client.1.smithi060.stdout:1/714: dread d4/d6/d7/d2f/d7b/d2a/d32/dd/fd3 [4194304,4194304] 0 2023-10-18T20:58:35.905 INFO:tasks.workunit.client.1.smithi060.stdout:1/715: write d4/d6/d7/df/f6b [1296116,110761] 0 2023-10-18T20:58:35.930 INFO:tasks.workunit.client.1.smithi060.stdout:1/716: dread d4/f2d [0,4194304] 0 2023-10-18T20:58:35.930 INFO:tasks.workunit.client.1.smithi060.stdout:1/717: write d4/d6/d7/d2f/d7b/d2a/f46 [1150884,30325] 0 2023-10-18T20:58:35.936 INFO:tasks.workunit.client.1.smithi060.stdout:2/567: dwrite d0/d16/d7f/faf [4194304,4194304] 0 2023-10-18T20:58:35.937 INFO:tasks.workunit.client.1.smithi060.stdout:2/568: readlink d0/d16/d81/da1/laa 0 2023-10-18T20:58:35.937 INFO:tasks.workunit.client.1.smithi060.stdout:2/569: dread - d0/f97 zero size 2023-10-18T20:58:36.086 INFO:tasks.workunit.client.1.smithi060.stdout:3/533: write d0/f11 [884232,108645] 0 2023-10-18T20:58:36.087 INFO:tasks.workunit.client.1.smithi060.stdout:5/629: write d0/da/d79/da5/f3d [1005518,78684] 0 2023-10-18T20:58:36.087 INFO:tasks.workunit.client.1.smithi060.stdout:5/630: stat d0/dd/f5b 0 2023-10-18T20:58:36.088 INFO:tasks.workunit.client.1.smithi060.stdout:5/631: stat d0/d6/d8/df 0 2023-10-18T20:58:36.092 INFO:tasks.workunit.client.1.smithi060.stdout:7/648: creat de/d14/d3a/d46/fd4 x:0 0 0 2023-10-18T20:58:36.097 INFO:tasks.workunit.client.1.smithi060.stdout:9/539: getdents d3/d99/d1c/d5a/d5d/d56 0 2023-10-18T20:58:36.097 INFO:tasks.workunit.client.1.smithi060.stdout:9/540: fdatasync d3/d99/d1c/d5a/d5d/f75 0 2023-10-18T20:58:36.102 INFO:tasks.workunit.client.1.smithi060.stdout:4/539: rename d4/dc/d40/l81 to d4/dc/d2a/d5b/l9d 0 2023-10-18T20:58:36.106 INFO:tasks.workunit.client.1.smithi060.stdout:1/718: getdents d4/d38 0 2023-10-18T20:58:36.111 INFO:tasks.workunit.client.1.smithi060.stdout:2/570: symlink d0/d3/d27/d4d/d5e/d96/lb9 0 2023-10-18T20:58:36.112 INFO:tasks.workunit.client.1.smithi060.stdout:3/534: creat d0/d22/d26/d2c/fbd x:0 0 0 2023-10-18T20:58:36.113 INFO:tasks.workunit.client.1.smithi060.stdout:5/632: truncate d0/d6/d8/f44 2041492 0 2023-10-18T20:58:36.117 INFO:tasks.workunit.client.1.smithi060.stdout:6/624: rmdir d10/d17/d7a 39 2023-10-18T20:58:36.118 INFO:tasks.workunit.client.1.smithi060.stdout:7/649: link de/d14/d49/d68/c26 de/d14/d49/da3/cd5 0 2023-10-18T20:58:36.123 INFO:tasks.workunit.client.1.smithi060.stdout:8/578: getdents d4/d9/d37/d4e/d6e/d7b 0 2023-10-18T20:58:36.123 INFO:tasks.workunit.client.1.smithi060.stdout:1/719: unlink d4/d6/d7/d2f/d7b/d2a/f45 0 2023-10-18T20:58:36.124 INFO:tasks.workunit.client.1.smithi060.stdout:1/720: truncate d4/d6/d7/d35/f97 810738 0 2023-10-18T20:58:36.124 INFO:tasks.workunit.client.1.smithi060.stdout:3/535: rename d0/d5e/c65 to d0/d22/d26/cbe 0 2023-10-18T20:58:36.125 INFO:tasks.workunit.client.1.smithi060.stdout:2/571: mknod d0/d8/cba 0 2023-10-18T20:58:36.125 INFO:tasks.workunit.client.1.smithi060.stdout:5/633: mkdir d0/d6/d9/d82/d83/deb 0 2023-10-18T20:58:36.125 INFO:tasks.workunit.client.1.smithi060.stdout:5/634: readlink d0/d6/d8/d81/la1 0 2023-10-18T20:58:36.125 INFO:tasks.workunit.client.1.smithi060.stdout:5/635: stat d0/d6/f1e 0 2023-10-18T20:58:36.127 INFO:tasks.workunit.client.1.smithi060.stdout:6/625: symlink d10/d3e/lc3 0 2023-10-18T20:58:36.127 INFO:tasks.workunit.client.1.smithi060.stdout:6/626: read - d10/d2e/d75/d77/fa8 zero size 2023-10-18T20:58:36.127 INFO:tasks.workunit.client.1.smithi060.stdout:6/627: chown d10/d47/d92/d79 226570354 1 2023-10-18T20:58:36.128 INFO:tasks.workunit.client.1.smithi060.stdout:0/618: rmdir d3/d8/d3c/dbd 0 2023-10-18T20:58:36.134 INFO:tasks.workunit.client.1.smithi060.stdout:3/536: rename d0/fb to d0/d5e/dbc/fbf 0 2023-10-18T20:58:36.135 INFO:tasks.workunit.client.1.smithi060.stdout:5/636: truncate d0/d6/f55 4162538 0 2023-10-18T20:58:36.135 INFO:tasks.workunit.client.1.smithi060.stdout:5/637: fdatasync d0/d6/d9/d82/d84/db2/d2a/fce 0 2023-10-18T20:58:36.135 INFO:tasks.workunit.client.1.smithi060.stdout:2/572: unlink d0/d43/d68/fb3 0 2023-10-18T20:58:36.135 INFO:tasks.workunit.client.1.smithi060.stdout:7/650: rename de/d14/d2f/d3f/f91 to de/d29/d9c/db1/fd6 0 2023-10-18T20:58:36.136 INFO:tasks.workunit.client.1.smithi060.stdout:7/651: fdatasync de/d38/d78/f8d 0 2023-10-18T20:58:36.136 INFO:tasks.workunit.client.1.smithi060.stdout:6/628: rmdir d10/d2e/d75/d77/d8c 39 2023-10-18T20:58:36.136 INFO:tasks.workunit.client.1.smithi060.stdout:6/629: write d10/d17/d28/f68 [697141,19182] 0 2023-10-18T20:58:36.137 INFO:tasks.workunit.client.1.smithi060.stdout:7/652: chown de/d14/d49/d68/d88/lc4 425 1 2023-10-18T20:58:36.137 INFO:tasks.workunit.client.1.smithi060.stdout:7/653: write de/d14/d3a/f56 [423454,114586] 0 2023-10-18T20:58:36.137 INFO:tasks.workunit.client.1.smithi060.stdout:2/573: creat d0/d45/d49/d55/dae/fbb x:0 0 0 2023-10-18T20:58:36.140 INFO:tasks.workunit.client.1.smithi060.stdout:5/638: rename d0/d6/d8/df/d27/c2e to d0/d6/d9/d82/d84/db2/d2a/cec 0 2023-10-18T20:58:36.140 INFO:tasks.workunit.client.1.smithi060.stdout:5/639: read d0/d6/d8/df/f4e [3733320,107068] 0 2023-10-18T20:58:36.151 INFO:tasks.workunit.client.1.smithi060.stdout:7/654: rmdir de/d14/d49/d68 39 2023-10-18T20:58:36.152 INFO:tasks.workunit.client.1.smithi060.stdout:3/537: read d0/f1d [1696539,50755] 0 2023-10-18T20:58:36.152 INFO:tasks.workunit.client.1.smithi060.stdout:5/640: creat d0/da/dc8/de4/fed x:0 0 0 2023-10-18T20:58:36.152 INFO:tasks.workunit.client.1.smithi060.stdout:5/641: write d0/da/dc8/de4/d6d/f71 [800511,61857] 0 2023-10-18T20:58:36.154 INFO:tasks.workunit.client.1.smithi060.stdout:7/655: symlink de/d29/d9c/ld7 0 2023-10-18T20:58:36.171 INFO:tasks.workunit.client.1.smithi060.stdout:3/538: rename d0/d3c/d3d/d4d/d95/c9c to d0/d22/d26/d29/dae/cc0 0 2023-10-18T20:58:36.171 INFO:tasks.workunit.client.1.smithi060.stdout:8/579: write d4/f47 [2814619,24563] 0 2023-10-18T20:58:36.171 INFO:tasks.workunit.client.1.smithi060.stdout:6/630: rename d10/d2e/d75/d77 to d10/d2e/d75/dc4 0 2023-10-18T20:58:36.172 INFO:tasks.workunit.client.1.smithi060.stdout:3/539: write d0/d22/d26/d29/f9a [924699,39956] 0 2023-10-18T20:58:36.172 INFO:tasks.workunit.client.1.smithi060.stdout:3/540: chown d0/d22/d26/d2c/l38 24 1 2023-10-18T20:58:36.172 INFO:tasks.workunit.client.1.smithi060.stdout:3/541: creat d0/d22/d26/fc1 x:0 0 0 2023-10-18T20:58:36.173 INFO:tasks.workunit.client.1.smithi060.stdout:1/721: write d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f8e [1618415,89048] 0 2023-10-18T20:58:36.175 INFO:tasks.workunit.client.1.smithi060.stdout:5/642: rename d0/d47/ce2 to d0/d6/d8/df/cee 0 2023-10-18T20:58:36.192 INFO:tasks.workunit.client.1.smithi060.stdout:7/656: write de/d38/fad [4159924,51967] 0 2023-10-18T20:58:36.197 INFO:tasks.workunit.client.1.smithi060.stdout:8/580: dread d4/d9/d37/f3d [0,4194304] 0 2023-10-18T20:58:36.199 INFO:tasks.workunit.client.1.smithi060.stdout:2/574: dwrite d0/d3/d27/d4d/f7d [0,4194304] 0 2023-10-18T20:58:36.199 INFO:tasks.workunit.client.1.smithi060.stdout:2/575: chown d0/d8/l18 1902 1 2023-10-18T20:58:36.208 INFO:tasks.workunit.client.1.smithi060.stdout:2/576: unlink d0/d45/d49/d6e/d79/d6c/f94 0 2023-10-18T20:58:36.210 INFO:tasks.workunit.client.1.smithi060.stdout:2/577: truncate d0/d3/f32 4674736 0 2023-10-18T20:58:36.222 INFO:tasks.workunit.client.1.smithi060.stdout:0/619: dwrite d3/d32/d86/fb7 [4194304,4194304] 0 2023-10-18T20:58:36.227 INFO:tasks.workunit.client.1.smithi060.stdout:0/620: mknod d3/d80/db5/cc1 0 2023-10-18T20:58:36.229 INFO:tasks.workunit.client.1.smithi060.stdout:0/621: mknod d3/d8/d14/d55/d74/d76/d68/d7f/d8d/dbc/cc2 0 2023-10-18T20:58:36.233 INFO:tasks.workunit.client.1.smithi060.stdout:0/622: mkdir d3/d8/d14/d55/dad/daa/dc3 0 2023-10-18T20:58:36.233 INFO:tasks.workunit.client.1.smithi060.stdout:0/623: stat d3/fb4 0 2023-10-18T20:58:36.234 INFO:tasks.workunit.client.1.smithi060.stdout:0/624: symlink d3/d8/d14/lc4 0 2023-10-18T20:58:36.237 INFO:tasks.workunit.client.1.smithi060.stdout:0/625: mknod d3/d80/db5/cc5 0 2023-10-18T20:58:36.237 INFO:tasks.workunit.client.1.smithi060.stdout:0/626: stat d3/d8/d14/d55/dad 0 2023-10-18T20:58:36.242 INFO:tasks.workunit.client.1.smithi060.stdout:0/627: creat d3/d8/d14/d55/d74/d76/d6b/fc6 x:0 0 0 2023-10-18T20:58:36.242 INFO:tasks.workunit.client.1.smithi060.stdout:0/628: write d3/d80/fa7 [1268384,83943] 0 2023-10-18T20:58:36.253 INFO:tasks.workunit.client.1.smithi060.stdout:2/578: write d0/f4e [3763349,68243] 0 2023-10-18T20:58:36.253 INFO:tasks.workunit.client.1.smithi060.stdout:2/579: chown d0/d43 9 1 2023-10-18T20:58:36.255 INFO:tasks.workunit.client.1.smithi060.stdout:2/580: rmdir d0/d45/d49/d6e/d79 39 2023-10-18T20:58:36.255 INFO:tasks.workunit.client.1.smithi060.stdout:2/581: dread - d0/d3/f89 zero size 2023-10-18T20:58:36.256 INFO:tasks.workunit.client.1.smithi060.stdout:2/582: unlink d0/d43/d4a/c76 0 2023-10-18T20:58:36.259 INFO:tasks.workunit.client.1.smithi060.stdout:8/581: dread d4/d9/d31/f40 [0,4194304] 0 2023-10-18T20:58:36.262 INFO:tasks.workunit.client.1.smithi060.stdout:5/643: dwrite d0/da/d3b/d43/f50 [4194304,4194304] 0 2023-10-18T20:58:36.268 INFO:tasks.workunit.client.1.smithi060.stdout:2/583: truncate d0/d43/f44 2583297 0 2023-10-18T20:58:36.273 INFO:tasks.workunit.client.1.smithi060.stdout:5/644: unlink d0/d6/d9/d82/fe9 0 2023-10-18T20:58:36.274 INFO:tasks.workunit.client.1.smithi060.stdout:5/645: chown d0/da/d79/da5/f3e 121 1 2023-10-18T20:58:36.274 INFO:tasks.workunit.client.1.smithi060.stdout:5/646: fdatasync d0/d6/f1e 0 2023-10-18T20:58:36.274 INFO:tasks.workunit.client.1.smithi060.stdout:5/647: fdatasync d0/da/f9c 0 2023-10-18T20:58:36.274 INFO:tasks.workunit.client.1.smithi060.stdout:5/648: readlink d0/d6/d8/df/d27/lbd 0 2023-10-18T20:58:36.296 INFO:tasks.workunit.client.1.smithi060.stdout:5/649: dread d0/d6/d8/df/d27/f3c [0,4194304] 0 2023-10-18T20:58:36.297 INFO:tasks.workunit.client.1.smithi060.stdout:5/650: creat d0/da/d61/fef x:0 0 0 2023-10-18T20:58:36.297 INFO:tasks.workunit.client.1.smithi060.stdout:5/651: fsync d0/da/dc8/de4/d4f/fa2 0 2023-10-18T20:58:36.306 INFO:tasks.workunit.client.1.smithi060.stdout:0/629: dwrite d3/d8/d14/d55/d74/d76/f63 [0,4194304] 0 2023-10-18T20:58:36.310 INFO:tasks.workunit.client.1.smithi060.stdout:0/630: unlink d3/d32/d86/ca8 0 2023-10-18T20:58:36.311 INFO:tasks.workunit.client.1.smithi060.stdout:0/631: fsync d3/d8/d14/d55/dad/daa/fb8 0 2023-10-18T20:58:36.311 INFO:tasks.workunit.client.1.smithi060.stdout:1/722: dwrite d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f99 [0,4194304] 0 2023-10-18T20:58:36.312 INFO:tasks.workunit.client.1.smithi060.stdout:0/632: rename d3/d8/d3c/f5c to d3/d8/d14/fc7 0 2023-10-18T20:58:36.318 INFO:tasks.workunit.client.1.smithi060.stdout:0/633: write d3/d8/d14/d55/d74/d76/d6b/fb3 [4903010,91248] 0 2023-10-18T20:58:36.318 INFO:tasks.workunit.client.1.smithi060.stdout:0/634: read d3/d8/d14/d55/d74/d76/d6b/fb3 [470394,25562] 0 2023-10-18T20:58:36.318 INFO:tasks.workunit.client.1.smithi060.stdout:3/542: dwrite d0/d22/d26/f61 [0,4194304] 0 2023-10-18T20:58:36.319 INFO:tasks.workunit.client.1.smithi060.stdout:3/543: getdents d0/d22 0 2023-10-18T20:58:36.343 INFO:tasks.workunit.client.1.smithi060.stdout:7/657: dwrite de/d29/f37 [0,4194304] 0 2023-10-18T20:58:36.350 INFO:tasks.workunit.client.1.smithi060.stdout:0/635: dread d3/d32/d86/f8c [0,4194304] 0 2023-10-18T20:58:36.350 INFO:tasks.workunit.client.1.smithi060.stdout:0/636: stat d3/d8/d14/d55/dad/daa/fb8 0 2023-10-18T20:58:36.352 INFO:tasks.workunit.client.1.smithi060.stdout:0/637: rename d3/d8/d14/d55/d74/d76/d68/f84 to d3/d8/d14/d55/d74/d76/d68/d7f/fc8 0 2023-10-18T20:58:36.352 INFO:tasks.workunit.client.1.smithi060.stdout:0/638: truncate d3/d8/d14/d55/f88 47262 0 2023-10-18T20:58:36.355 INFO:tasks.workunit.client.1.smithi060.stdout:9/541: sync 2023-10-18T20:58:36.358 INFO:tasks.workunit.client.1.smithi060.stdout:4/540: sync 2023-10-18T20:58:36.359 INFO:tasks.workunit.client.1.smithi060.stdout:2/584: dwrite d0/d8/f8a [0,4194304] 0 2023-10-18T20:58:36.359 INFO:tasks.workunit.client.1.smithi060.stdout:0/639: stat d3/c37 0 2023-10-18T20:58:36.362 INFO:tasks.workunit.client.1.smithi060.stdout:2/585: unlink d0/d3/d27/d4d/d5e/f5f 0 2023-10-18T20:58:36.362 INFO:tasks.workunit.client.1.smithi060.stdout:9/542: creat d3/d99/d1c/d2a/d80/da0/dc2/d9e/fce x:0 0 0 2023-10-18T20:58:36.363 INFO:tasks.workunit.client.1.smithi060.stdout:0/640: symlink d3/lc9 0 2023-10-18T20:58:36.366 INFO:tasks.workunit.client.1.smithi060.stdout:9/543: mknod d3/d99/d19/d54/da5/ccf 0 2023-10-18T20:58:36.368 INFO:tasks.workunit.client.1.smithi060.stdout:2/586: symlink d0/d45/d49/lbc 0 2023-10-18T20:58:36.369 INFO:tasks.workunit.client.1.smithi060.stdout:9/544: unlink d3/d99/d1c/d25/fbd 0 2023-10-18T20:58:36.369 INFO:tasks.workunit.client.1.smithi060.stdout:9/545: stat d3/d99/d1c/d2a/d2d/db9 0 2023-10-18T20:58:36.369 INFO:tasks.workunit.client.1.smithi060.stdout:9/546: unlink d3/d99/d19/d54/fcd 0 2023-10-18T20:58:36.369 INFO:tasks.workunit.client.1.smithi060.stdout:2/587: getdents d0/d3/d27 0 2023-10-18T20:58:36.387 INFO:tasks.workunit.client.1.smithi060.stdout:9/547: rename d3/d99/d9f to d3/d99/d1c/d5a/d5d/d56/dd0 0 2023-10-18T20:58:36.387 INFO:tasks.workunit.client.1.smithi060.stdout:2/588: truncate d0/d45/d49/d6e/f91 18101 0 2023-10-18T20:58:36.391 INFO:tasks.workunit.client.1.smithi060.stdout:4/541: dread d4/dc/d2a/d13/d27/f67 [0,4194304] 0 2023-10-18T20:58:36.392 INFO:tasks.workunit.client.1.smithi060.stdout:2/589: rename d0/d3/f32 to d0/d16/d85/fbd 0 2023-10-18T20:58:36.392 INFO:tasks.workunit.client.1.smithi060.stdout:4/542: chown d4/dc/d2a/d13/d27 233327 1 2023-10-18T20:58:36.394 INFO:tasks.workunit.client.1.smithi060.stdout:8/582: dwrite d4/d9/d37/f3c [4194304,4194304] 0 2023-10-18T20:58:36.395 INFO:tasks.workunit.client.1.smithi060.stdout:6/631: sync 2023-10-18T20:58:36.397 INFO:tasks.workunit.client.1.smithi060.stdout:2/590: mknod d0/d3/d27/d4d/d53/cbe 0 2023-10-18T20:58:36.399 INFO:tasks.workunit.client.1.smithi060.stdout:4/543: mkdir d4/dc/d2a/d13/d27/d68/d9e 0 2023-10-18T20:58:36.405 INFO:tasks.workunit.client.1.smithi060.stdout:2/591: mkdir d0/d45/d49/d55/dbf 0 2023-10-18T20:58:36.429 INFO:tasks.workunit.client.1.smithi060.stdout:3/544: dwrite d0/f18 [0,4194304] 0 2023-10-18T20:58:36.430 INFO:tasks.workunit.client.1.smithi060.stdout:2/592: dread d0/f4e [0,4194304] 0 2023-10-18T20:58:36.430 INFO:tasks.workunit.client.1.smithi060.stdout:2/593: read - d0/d3/d27/d4d/d53/f77 zero size 2023-10-18T20:58:36.432 INFO:tasks.workunit.client.1.smithi060.stdout:2/594: creat d0/d43/da8/fc0 x:0 0 0 2023-10-18T20:58:36.433 INFO:tasks.workunit.client.1.smithi060.stdout:2/595: creat d0/d45/d49/d6e/d79/d6c/fc1 x:0 0 0 2023-10-18T20:58:36.433 INFO:tasks.workunit.client.1.smithi060.stdout:2/596: stat d0/d43/f8e 0 2023-10-18T20:58:36.439 INFO:tasks.workunit.client.1.smithi060.stdout:6/632: dread d10/d17/d54/f5a [0,4194304] 0 2023-10-18T20:58:36.440 INFO:tasks.workunit.client.1.smithi060.stdout:6/633: rmdir d10/d17/d7a 39 2023-10-18T20:58:36.441 INFO:tasks.workunit.client.1.smithi060.stdout:6/634: creat d10/d25/fc5 x:0 0 0 2023-10-18T20:58:36.442 INFO:tasks.workunit.client.1.smithi060.stdout:2/597: dread d0/d8/fd [4194304,4194304] 0 2023-10-18T20:58:36.444 INFO:tasks.workunit.client.1.smithi060.stdout:7/658: dwrite de/d14/d2f/d8f/d65/fa9 [0,4194304] 0 2023-10-18T20:58:36.444 INFO:tasks.workunit.client.1.smithi060.stdout:7/659: write de/d14/d49/d68/d7d/d7e/db5/fce [665558,69583] 0 2023-10-18T20:58:36.445 INFO:tasks.workunit.client.1.smithi060.stdout:6/635: mknod d10/d17/d54/db1/cc6 0 2023-10-18T20:58:36.446 INFO:tasks.workunit.client.1.smithi060.stdout:2/598: mkdir d0/d3/d9e/dc2 0 2023-10-18T20:58:36.446 INFO:tasks.workunit.client.1.smithi060.stdout:6/636: chown d10/d2e/d75/d81 125822 1 2023-10-18T20:58:36.448 INFO:tasks.workunit.client.1.smithi060.stdout:6/637: unlink d10/d2e/d75/dc4/d8c/fa2 0 2023-10-18T20:58:36.451 INFO:tasks.workunit.client.1.smithi060.stdout:6/638: mkdir d10/d2e/d75/dc7 0 2023-10-18T20:58:36.451 INFO:tasks.workunit.client.1.smithi060.stdout:2/599: truncate d0/d3/d27/d4d/f5b 4147449 0 2023-10-18T20:58:36.455 INFO:tasks.workunit.client.1.smithi060.stdout:1/723: dwrite d4/d6/d14/d41/fa5 [0,4194304] 0 2023-10-18T20:58:36.455 INFO:tasks.workunit.client.1.smithi060.stdout:1/724: stat d4/d6/d7/df/d59/fb8 0 2023-10-18T20:58:36.455 INFO:tasks.workunit.client.1.smithi060.stdout:1/725: fsync d4/d6/d7/df/f6b 0 2023-10-18T20:58:36.455 INFO:tasks.workunit.client.1.smithi060.stdout:1/726: creat d4/d6/d14/d41/fe7 x:0 0 0 2023-10-18T20:58:36.456 INFO:tasks.workunit.client.1.smithi060.stdout:6/639: mknod d10/d17/d28/cc8 0 2023-10-18T20:58:36.461 INFO:tasks.workunit.client.1.smithi060.stdout:8/583: dread d4/d9/d31/da6/fac [0,4194304] 0 2023-10-18T20:58:36.470 INFO:tasks.workunit.client.1.smithi060.stdout:1/727: rename d4/d6/d7/d2f/d7b/d2a/d32/d56/daf to d4/d6/d7/d2f/d7b/de8 0 2023-10-18T20:58:36.481 INFO:tasks.workunit.client.1.smithi060.stdout:6/640: write fd [3621338,125940] 0 2023-10-18T20:58:36.490 INFO:tasks.workunit.client.1.smithi060.stdout:6/641: unlink d10/d17/d2f/f30 0 2023-10-18T20:58:36.491 INFO:tasks.workunit.client.1.smithi060.stdout:6/642: write d10/d2e/f3f [3746762,87187] 0 2023-10-18T20:58:36.491 INFO:tasks.workunit.client.1.smithi060.stdout:6/643: write d10/d47/d92/d79/fa4 [147973,108246] 0 2023-10-18T20:58:36.491 INFO:tasks.workunit.client.1.smithi060.stdout:6/644: read - d10/d25/fc5 zero size 2023-10-18T20:58:36.493 INFO:tasks.workunit.client.1.smithi060.stdout:1/728: dread d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f99 [0,4194304] 0 2023-10-18T20:58:36.497 INFO:tasks.workunit.client.1.smithi060.stdout:1/729: mkdir d4/da/de0/de9 0 2023-10-18T20:58:36.497 INFO:tasks.workunit.client.1.smithi060.stdout:1/730: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/fea x:0 0 0 2023-10-18T20:58:36.497 INFO:tasks.workunit.client.1.smithi060.stdout:1/731: fsync d4/d6/d14/d41/fa5 0 2023-10-18T20:58:36.498 INFO:tasks.workunit.client.1.smithi060.stdout:6/645: stat d10/d25/cac 0 2023-10-18T20:58:36.500 INFO:tasks.workunit.client.1.smithi060.stdout:0/641: dwrite d3/d80/fa7 [0,4194304] 0 2023-10-18T20:58:36.502 INFO:tasks.workunit.client.1.smithi060.stdout:2/600: getdents d0/d45/d49 0 2023-10-18T20:58:36.507 INFO:tasks.workunit.client.1.smithi060.stdout:1/732: rename d4/d6/d48/da7 to d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/deb 0 2023-10-18T20:58:36.508 INFO:tasks.workunit.client.1.smithi060.stdout:6/646: getdents d10/d2e 0 2023-10-18T20:58:36.512 INFO:tasks.workunit.client.1.smithi060.stdout:9/548: dwrite d3/d99/f18 [0,4194304] 0 2023-10-18T20:58:36.512 INFO:tasks.workunit.client.1.smithi060.stdout:9/549: chown d3/d99/d19/d54/da5/fcb 360793342 1 2023-10-18T20:58:36.512 INFO:tasks.workunit.client.1.smithi060.stdout:9/550: truncate d3/d99/d19/f6e 675412 0 2023-10-18T20:58:36.524 INFO:tasks.workunit.client.1.smithi060.stdout:7/660: dwrite de/d38/d78/f8d [0,4194304] 0 2023-10-18T20:58:36.524 INFO:tasks.workunit.client.1.smithi060.stdout:7/661: stat de/d14/d3a 0 2023-10-18T20:58:36.524 INFO:tasks.workunit.client.1.smithi060.stdout:7/662: write de/d29/d72/f85 [871996,82493] 0 2023-10-18T20:58:36.527 INFO:tasks.workunit.client.1.smithi060.stdout:2/601: symlink d0/d16/d81/lc3 0 2023-10-18T20:58:36.527 INFO:tasks.workunit.client.1.smithi060.stdout:1/733: truncate d4/d6/d7/df/d59/f6f 158345 0 2023-10-18T20:58:36.527 INFO:tasks.workunit.client.1.smithi060.stdout:8/584: dwrite d4/d9/d31/f8e [4194304,4194304] 0 2023-10-18T20:58:36.528 INFO:tasks.workunit.client.1.smithi060.stdout:8/585: read - d4/fa7 zero size 2023-10-18T20:58:36.528 INFO:tasks.workunit.client.1.smithi060.stdout:0/642: rename d3/d8/lb to d3/d8/dac/lca 0 2023-10-18T20:58:36.529 INFO:tasks.workunit.client.1.smithi060.stdout:6/647: mkdir d10/d2e/d75/d81/d8b/dc9 0 2023-10-18T20:58:36.529 INFO:tasks.workunit.client.1.smithi060.stdout:6/648: creat d10/d2e/d75/d81/fca x:0 0 0 2023-10-18T20:58:36.530 INFO:tasks.workunit.client.1.smithi060.stdout:4/544: dwrite d4/dc/d2a/d13/f87 [0,4194304] 0 2023-10-18T20:58:36.538 INFO:tasks.workunit.client.1.smithi060.stdout:8/586: mknod d4/d9/d31/cb0 0 2023-10-18T20:58:36.539 INFO:tasks.workunit.client.1.smithi060.stdout:0/643: creat d3/d8/d14/d55/d9a/fcb x:0 0 0 2023-10-18T20:58:36.541 INFO:tasks.workunit.client.1.smithi060.stdout:6/649: symlink d10/d17/d54/db1/lcb 0 2023-10-18T20:58:36.541 INFO:tasks.workunit.client.1.smithi060.stdout:6/650: chown d10/d17/d54/db1/fbd 0 1 2023-10-18T20:58:36.543 INFO:tasks.workunit.client.1.smithi060.stdout:3/545: dwrite d0/d22/d26/d2c/fbd [0,4194304] 0 2023-10-18T20:58:36.545 INFO:tasks.workunit.client.1.smithi060.stdout:1/734: rename d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/l9b to d4/d38/da0/lec 0 2023-10-18T20:58:36.545 INFO:tasks.workunit.client.1.smithi060.stdout:4/545: mkdir d4/d15/d2b/d9f 0 2023-10-18T20:58:36.545 INFO:tasks.workunit.client.1.smithi060.stdout:9/551: rmdir d3/d99/d19/d54/da5 39 2023-10-18T20:58:36.545 INFO:tasks.workunit.client.1.smithi060.stdout:9/552: truncate d3/d99/d1c/d5a/f97 842425 0 2023-10-18T20:58:36.546 INFO:tasks.workunit.client.1.smithi060.stdout:8/587: creat d4/d9/fb1 x:0 0 0 2023-10-18T20:58:36.546 INFO:tasks.workunit.client.1.smithi060.stdout:8/588: dread - d4/d9/d31/d35/d9f/da3/f89 zero size 2023-10-18T20:58:36.546 INFO:tasks.workunit.client.1.smithi060.stdout:8/589: read d4/d9/d37/fa2 [216699,40488] 0 2023-10-18T20:58:36.552 INFO:tasks.workunit.client.1.smithi060.stdout:6/651: creat d10/d47/fcc x:0 0 0 2023-10-18T20:58:36.552 INFO:tasks.workunit.client.1.smithi060.stdout:6/652: fsync d10/d17/d2f/f64 0 2023-10-18T20:58:36.553 INFO:tasks.workunit.client.1.smithi060.stdout:3/546: unlink d0/d22/d26/d2b/f92 0 2023-10-18T20:58:36.554 INFO:tasks.workunit.client.1.smithi060.stdout:3/547: write d0/d22/d26/fb8 [531854,17268] 0 2023-10-18T20:58:36.554 INFO:tasks.workunit.client.1.smithi060.stdout:4/546: write d4/dc/d2a/d31/f46 [804680,79700] 0 2023-10-18T20:58:36.558 INFO:tasks.workunit.client.1.smithi060.stdout:9/553: link d3/d99/d1c/c6c d3/d99/d19/d54/d8f/cd1 0 2023-10-18T20:58:36.558 INFO:tasks.workunit.client.1.smithi060.stdout:9/554: chown d3/fa1 96460925 1 2023-10-18T20:58:36.558 INFO:tasks.workunit.client.1.smithi060.stdout:9/555: readlink d3/d99/d1c/d2a/l39 0 2023-10-18T20:58:36.559 INFO:tasks.workunit.client.1.smithi060.stdout:9/556: creat d3/d99/d1c/d2a/d80/da0/dc2/d9e/fd2 x:0 0 0 2023-10-18T20:58:36.559 INFO:tasks.workunit.client.1.smithi060.stdout:9/557: readlink d3/l76 0 2023-10-18T20:58:36.559 INFO:tasks.workunit.client.1.smithi060.stdout:9/558: write d3/d99/d1c/d5a/d5d/d56/fb4 [4613082,85287] 0 2023-10-18T20:58:36.560 INFO:tasks.workunit.client.1.smithi060.stdout:0/644: rename d3/d8/d14/d55/d74/d76/d68/d98/fa5 to d3/d8/dac/fcc 0 2023-10-18T20:58:36.560 INFO:tasks.workunit.client.1.smithi060.stdout:0/645: chown d3/d8/d14/d55/d74/d76/d68/d7f/caf 95252958 1 2023-10-18T20:58:36.562 INFO:tasks.workunit.client.1.smithi060.stdout:3/548: rename d0/d22/d26/d2b/c2e to d0/d22/d26/cc2 0 2023-10-18T20:58:36.563 INFO:tasks.workunit.client.1.smithi060.stdout:0/646: getdents d3/d32/d86 0 2023-10-18T20:58:36.565 INFO:tasks.workunit.client.1.smithi060.stdout:9/559: rename d3/d99/d19/f6e to d3/d99/d1c/d2a/d2d/db9/fd3 0 2023-10-18T20:58:36.570 INFO:tasks.workunit.client.1.smithi060.stdout:3/549: rename d0/d3c/d3d/d82/l88 to d0/d22/d26/d79/db3/lc3 0 2023-10-18T20:58:36.572 INFO:tasks.workunit.client.1.smithi060.stdout:3/550: write d0/d22/d26/d29/fab [321386,75021] 0 2023-10-18T20:58:36.572 INFO:tasks.workunit.client.1.smithi060.stdout:0/647: rename d3/d8/f11 to d3/d8/dac/fcd 0 2023-10-18T20:58:36.573 INFO:tasks.workunit.client.1.smithi060.stdout:3/551: mknod d0/d22/cc4 0 2023-10-18T20:58:36.575 INFO:tasks.workunit.client.1.smithi060.stdout:3/552: creat d0/d3c/d3d/d4d/fc5 x:0 0 0 2023-10-18T20:58:36.575 INFO:tasks.workunit.client.1.smithi060.stdout:3/553: write d0/d22/d26/d29/f7d [45936,10233] 0 2023-10-18T20:58:36.577 INFO:tasks.workunit.client.1.smithi060.stdout:3/554: unlink d0/l17 0 2023-10-18T20:58:36.580 INFO:tasks.workunit.client.1.smithi060.stdout:3/555: getdents d0/d3c/d3d 0 2023-10-18T20:58:36.586 INFO:tasks.workunit.client.1.smithi060.stdout:4/547: dread d4/dc/f58 [0,4194304] 0 2023-10-18T20:58:36.586 INFO:tasks.workunit.client.1.smithi060.stdout:4/548: chown d4/dc/d2a/d39/d53/d76/d99 366 1 2023-10-18T20:58:36.587 INFO:tasks.workunit.client.1.smithi060.stdout:4/549: stat d4/dc/d2a/d13/d27/d68/f6d 0 2023-10-18T20:58:36.591 INFO:tasks.workunit.client.1.smithi060.stdout:3/556: dread d0/d3c/d3d/f98 [0,4194304] 0 2023-10-18T20:58:36.597 INFO:tasks.workunit.client.1.smithi060.stdout:2/602: dwrite d0/d8/d47/f98 [0,4194304] 0 2023-10-18T20:58:36.602 INFO:tasks.workunit.client.1.smithi060.stdout:1/735: dread d4/d6/d7/d2f/f6a [0,4194304] 0 2023-10-18T20:58:36.605 INFO:tasks.workunit.client.1.smithi060.stdout:1/736: rename d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/fd9 to d4/d6/d7/d2f/d7b/d2a/d32/dd/fed 0 2023-10-18T20:58:36.607 INFO:tasks.workunit.client.1.smithi060.stdout:1/737: symlink d4/d6/d7/d2f/d7b/d2a/lee 0 2023-10-18T20:58:36.608 INFO:tasks.workunit.client.1.smithi060.stdout:1/738: stat d4/d6/d7/df/l12 0 2023-10-18T20:58:36.618 INFO:tasks.workunit.client.1.smithi060.stdout:5/652: sync 2023-10-18T20:58:36.620 INFO:tasks.workunit.client.1.smithi060.stdout:9/560: dread d3/d99/d1c/d5a/d5d/d56/fb4 [0,4194304] 0 2023-10-18T20:58:36.622 INFO:tasks.workunit.client.1.smithi060.stdout:9/561: creat d3/d99/d1c/d5a/d5d/d56/fd4 x:0 0 0 2023-10-18T20:58:36.623 INFO:tasks.workunit.client.1.smithi060.stdout:9/562: mknod d3/d99/d1c/d2a/d33/cd5 0 2023-10-18T20:58:36.624 INFO:tasks.workunit.client.1.smithi060.stdout:9/563: chown d3/d58/lbf 9225812 1 2023-10-18T20:58:36.625 INFO:tasks.workunit.client.1.smithi060.stdout:9/564: truncate d3/d99/d1c/d2a/d80/da0/dc2/fba 930391 0 2023-10-18T20:58:36.626 INFO:tasks.workunit.client.1.smithi060.stdout:9/565: chown d3/l12 736414228 1 2023-10-18T20:58:36.626 INFO:tasks.workunit.client.1.smithi060.stdout:9/566: dread - d3/d99/d1c/d2a/d80/da0/dc2/d9e/fce zero size 2023-10-18T20:58:36.635 INFO:tasks.workunit.client.1.smithi060.stdout:4/550: dread d4/dc/d2a/d13/f3f [0,4194304] 0 2023-10-18T20:58:36.637 INFO:tasks.workunit.client.1.smithi060.stdout:4/551: rename d4/d15/f37 to d4/dc/d2a/d5b/fa0 0 2023-10-18T20:58:36.637 INFO:tasks.workunit.client.1.smithi060.stdout:4/552: stat d4/dc/d2a/d13/f3f 0 2023-10-18T20:58:36.639 INFO:tasks.workunit.client.1.smithi060.stdout:7/663: dwrite de/f17 [0,4194304] 0 2023-10-18T20:58:36.639 INFO:tasks.workunit.client.1.smithi060.stdout:4/553: link d4/dc/d2a/d13/d33/f35 d4/dc/d2a/d39/d53/d65/d8d/fa1 0 2023-10-18T20:58:36.642 INFO:tasks.workunit.client.1.smithi060.stdout:4/554: rename d4/dc/d2a/l3c to d4/dc/d2a/d13/d33/la2 0 2023-10-18T20:58:36.642 INFO:tasks.workunit.client.1.smithi060.stdout:7/664: mknod de/d14/d2f/d8f/cd8 0 2023-10-18T20:58:36.648 INFO:tasks.workunit.client.1.smithi060.stdout:4/555: symlink d4/d15/d2b/la3 0 2023-10-18T20:58:36.648 INFO:tasks.workunit.client.1.smithi060.stdout:4/556: stat d4/dc/d2a/d13/c55 0 2023-10-18T20:58:36.648 INFO:tasks.workunit.client.1.smithi060.stdout:4/557: truncate d4/d15/d2b/f86 85864 0 2023-10-18T20:58:36.648 INFO:tasks.workunit.client.1.smithi060.stdout:4/558: stat d4/d15/f6e 0 2023-10-18T20:58:36.656 INFO:tasks.workunit.client.1.smithi060.stdout:4/559: dread d4/d15/d2b/f86 [0,4194304] 0 2023-10-18T20:58:36.657 INFO:tasks.workunit.client.1.smithi060.stdout:4/560: mknod d4/dc/ca4 0 2023-10-18T20:58:36.658 INFO:tasks.workunit.client.1.smithi060.stdout:4/561: dread - d4/dc/d2a/d31/f97 zero size 2023-10-18T20:58:36.671 INFO:tasks.workunit.client.1.smithi060.stdout:1/739: dread d4/d6/d7/df/f15 [0,4194304] 0 2023-10-18T20:58:36.672 INFO:tasks.workunit.client.1.smithi060.stdout:3/557: dwrite d0/f72 [0,4194304] 0 2023-10-18T20:58:36.677 INFO:tasks.workunit.client.1.smithi060.stdout:6/653: dwrite d10/d25/fc5 [0,4194304] 0 2023-10-18T20:58:36.680 INFO:tasks.workunit.client.1.smithi060.stdout:0/648: link d3/d8/dac/fcd d3/d8/d14/d55/d74/fce 0 2023-10-18T20:58:36.682 INFO:tasks.workunit.client.1.smithi060.stdout:2/603: dwrite d0/d3/d27/d4d/d5e/d96/fb8 [0,4194304] 0 2023-10-18T20:58:36.682 INFO:tasks.workunit.client.1.smithi060.stdout:2/604: chown d0/d45/fb5 78 1 2023-10-18T20:58:36.682 INFO:tasks.workunit.client.1.smithi060.stdout:5/653: dwrite d0/d6/d9/d82/d84/db2/d2a/fce [4194304,4194304] 0 2023-10-18T20:58:36.688 INFO:tasks.workunit.client.1.smithi060.stdout:6/654: rename d10/d6f/f98 to d10/d17/d7a/fcd 0 2023-10-18T20:58:36.689 INFO:tasks.workunit.client.1.smithi060.stdout:0/649: mkdir d3/d8/d14/d55/d9a/dcf 0 2023-10-18T20:58:36.689 INFO:tasks.workunit.client.1.smithi060.stdout:0/650: readlink d3/d8/d14/l18 0 2023-10-18T20:58:36.690 INFO:tasks.workunit.client.1.smithi060.stdout:2/605: symlink d0/d16/d7f/lc4 0 2023-10-18T20:58:36.691 INFO:tasks.workunit.client.1.smithi060.stdout:2/606: truncate d0/d45/d49/d6e/d79/d6c/fc1 447553 0 2023-10-18T20:58:36.692 INFO:tasks.workunit.client.1.smithi060.stdout:5/654: getdents d0/d6/d9/d82/d84/db2/d41 0 2023-10-18T20:58:36.694 INFO:tasks.workunit.client.1.smithi060.stdout:6/655: rename d10/d17/f46 to d10/d17/d70/dba/fce 0 2023-10-18T20:58:36.696 INFO:tasks.workunit.client.1.smithi060.stdout:0/651: creat d3/d8/d14/d55/d74/d76/d68/d7f/d8d/fd0 x:0 0 0 2023-10-18T20:58:36.697 INFO:tasks.workunit.client.1.smithi060.stdout:5/655: symlink d0/da/dc8/de4/d6d/dba/lf0 0 2023-10-18T20:58:36.698 INFO:tasks.workunit.client.1.smithi060.stdout:6/656: creat d10/d2e/d75/dc7/fcf x:0 0 0 2023-10-18T20:58:36.698 INFO:tasks.workunit.client.1.smithi060.stdout:6/657: chown d10/d2e/l99 0 1 2023-10-18T20:58:36.698 INFO:tasks.workunit.client.1.smithi060.stdout:6/658: creat d10/d17/dae/fd0 x:0 0 0 2023-10-18T20:58:36.700 INFO:tasks.workunit.client.1.smithi060.stdout:2/607: rename d0/f97 to d0/d3/d27/d7b/fc5 0 2023-10-18T20:58:36.701 INFO:tasks.workunit.client.1.smithi060.stdout:5/656: symlink d0/da/d79/lf1 0 2023-10-18T20:58:36.703 INFO:tasks.workunit.client.1.smithi060.stdout:6/659: truncate d10/d3e/f71 2704470 0 2023-10-18T20:58:36.704 INFO:tasks.workunit.client.1.smithi060.stdout:2/608: symlink d0/d3/d27/d4d/lc6 0 2023-10-18T20:58:36.705 INFO:tasks.workunit.client.1.smithi060.stdout:5/657: mkdir d0/d47/df2 0 2023-10-18T20:58:36.705 INFO:tasks.workunit.client.1.smithi060.stdout:5/658: chown d0/d47/d7d/da0 6804512 1 2023-10-18T20:58:36.707 INFO:tasks.workunit.client.1.smithi060.stdout:3/558: read d0/d22/d26/d2c/fbd [1711634,20284] 0 2023-10-18T20:58:36.708 INFO:tasks.workunit.client.1.smithi060.stdout:6/660: rename d10/d25/f7f to d10/d17/d70/fd1 0 2023-10-18T20:58:36.708 INFO:tasks.workunit.client.1.smithi060.stdout:6/661: dread - d10/d2e/d75/dc4/d8c/f8f zero size 2023-10-18T20:58:36.709 INFO:tasks.workunit.client.1.smithi060.stdout:5/659: mknod d0/dd/d76/cf3 0 2023-10-18T20:58:36.714 INFO:tasks.workunit.client.1.smithi060.stdout:2/609: rename d0/l48 to d0/d16/d7f/lc7 0 2023-10-18T20:58:36.719 INFO:tasks.workunit.client.1.smithi060.stdout:3/559: rename d0/d22/d26/d8c/fba to d0/d22/d26/d79/db3/fc6 0 2023-10-18T20:58:36.720 INFO:tasks.workunit.client.1.smithi060.stdout:2/610: mkdir d0/d16/dc8 0 2023-10-18T20:58:36.720 INFO:tasks.workunit.client.1.smithi060.stdout:2/611: stat d0/d3/d9e/dc2 0 2023-10-18T20:58:36.725 INFO:tasks.workunit.client.1.smithi060.stdout:2/612: rename d0/d43 to d0/d45/dc9 0 2023-10-18T20:58:36.734 INFO:tasks.workunit.client.1.smithi060.stdout:4/562: dwrite d4/dc/d2a/d39/f8c [0,4194304] 0 2023-10-18T20:58:36.734 INFO:tasks.workunit.client.1.smithi060.stdout:4/563: readlink d4/dc/d2a/d13/d27/l32 0 2023-10-18T20:58:36.734 INFO:tasks.workunit.client.1.smithi060.stdout:4/564: write d4/dc/d2a/d13/f9b [767627,87853] 0 2023-10-18T20:58:36.735 INFO:tasks.workunit.client.1.smithi060.stdout:4/565: write d4/dc/d2a/d5b/fa0 [4802926,126799] 0 2023-10-18T20:58:36.735 INFO:tasks.workunit.client.1.smithi060.stdout:6/662: dread d10/d2e/f33 [0,4194304] 0 2023-10-18T20:58:36.745 INFO:tasks.workunit.client.1.smithi060.stdout:6/663: link d10/d17/d2f/lc0 d10/d47/d92/d79/ld2 0 2023-10-18T20:58:36.745 INFO:tasks.workunit.client.1.smithi060.stdout:6/664: truncate d10/d17/d28/f5c 1187299 0 2023-10-18T20:58:36.745 INFO:tasks.workunit.client.1.smithi060.stdout:6/665: fdatasync d10/d2e/d75/d81/d8b/f9b 0 2023-10-18T20:58:36.745 INFO:tasks.workunit.client.1.smithi060.stdout:6/666: readlink d10/d2e/d75/dc4/d8c/l93 0 2023-10-18T20:58:36.746 INFO:tasks.workunit.client.1.smithi060.stdout:6/667: read f8 [1445730,94849] 0 2023-10-18T20:58:36.746 INFO:tasks.workunit.client.1.smithi060.stdout:6/668: chown d10/d17/d2f/lc0 2449 1 2023-10-18T20:58:36.747 INFO:tasks.workunit.client.1.smithi060.stdout:4/566: unlink d4/dc/d2a/d31/l3e 0 2023-10-18T20:58:36.749 INFO:tasks.workunit.client.1.smithi060.stdout:6/669: mknod d10/d17/d7a/cd3 0 2023-10-18T20:58:36.752 INFO:tasks.workunit.client.1.smithi060.stdout:1/740: dwrite d4/f8 [0,4194304] 0 2023-10-18T20:58:36.752 INFO:tasks.workunit.client.1.smithi060.stdout:0/652: dwrite d3/d8/d14/d55/d74/d76/d68/fc0 [0,4194304] 0 2023-10-18T20:58:36.757 INFO:tasks.workunit.client.1.smithi060.stdout:0/653: mkdir d3/d8/d14/d55/d74/d76/d68/d7f/dd1 0 2023-10-18T20:58:36.757 INFO:tasks.workunit.client.1.smithi060.stdout:0/654: chown d3/d8/d14/d55/d74/d76/d68/d98 1753 1 2023-10-18T20:58:36.757 INFO:tasks.workunit.client.1.smithi060.stdout:0/655: chown d3 1645 1 2023-10-18T20:58:36.757 INFO:tasks.workunit.client.1.smithi060.stdout:3/560: dread d0/d22/f52 [0,4194304] 0 2023-10-18T20:58:36.757 INFO:tasks.workunit.client.1.smithi060.stdout:0/656: creat d3/fd2 x:0 0 0 2023-10-18T20:58:36.758 INFO:tasks.workunit.client.1.smithi060.stdout:6/670: rename d10/d2e/d75/dc4/d8c to d10/d17/d54/dd4 0 2023-10-18T20:58:36.760 INFO:tasks.workunit.client.1.smithi060.stdout:5/660: dwrite d0/da/f9a [0,4194304] 0 2023-10-18T20:58:36.761 INFO:tasks.workunit.client.1.smithi060.stdout:6/671: mkdir d10/d25/d3c/dd5 0 2023-10-18T20:58:36.761 INFO:tasks.workunit.client.1.smithi060.stdout:5/661: write d0/d6/f1e [5524783,111684] 0 2023-10-18T20:58:36.761 INFO:tasks.workunit.client.1.smithi060.stdout:6/672: write d10/d17/d54/dd4/f8f [5217,8958] 0 2023-10-18T20:58:36.761 INFO:tasks.workunit.client.1.smithi060.stdout:5/662: fsync d0/dd/fcf 0 2023-10-18T20:58:36.762 INFO:tasks.workunit.client.1.smithi060.stdout:6/673: chown d10/d17/d2f/l90 141029 1 2023-10-18T20:58:36.762 INFO:tasks.workunit.client.1.smithi060.stdout:5/663: creat d0/da/dc8/de4/ff4 x:0 0 0 2023-10-18T20:58:36.762 INFO:tasks.workunit.client.1.smithi060.stdout:0/657: rename d3/d8/c7d to d3/d8/cd3 0 2023-10-18T20:58:36.765 INFO:tasks.workunit.client.1.smithi060.stdout:6/674: mkdir d10/d25/d3c/dd5/dd6 0 2023-10-18T20:58:36.775 INFO:tasks.workunit.client.1.smithi060.stdout:1/741: dread d4/d6/d7/f26 [0,4194304] 0 2023-10-18T20:58:36.776 INFO:tasks.workunit.client.1.smithi060.stdout:1/742: fsync d4/d6/d7/df/d59/f82 0 2023-10-18T20:58:36.777 INFO:tasks.workunit.client.1.smithi060.stdout:5/664: mkdir d0/da/d3b/d64/df5 0 2023-10-18T20:58:36.778 INFO:tasks.workunit.client.1.smithi060.stdout:6/675: getdents d10 0 2023-10-18T20:58:36.778 INFO:tasks.workunit.client.1.smithi060.stdout:4/567: dread d4/dc/d2a/d39/d53/d65/d8d/fa1 [0,4194304] 0 2023-10-18T20:58:36.779 INFO:tasks.workunit.client.1.smithi060.stdout:5/665: creat d0/da/ff6 x:0 0 0 2023-10-18T20:58:36.792 INFO:tasks.workunit.client.1.smithi060.stdout:5/666: rename d0/d6/d8/df/f51 to d0/da/d79/ff7 0 2023-10-18T20:58:36.796 INFO:tasks.workunit.client.1.smithi060.stdout:4/568: mkdir d4/dc/d2a/d31/da5 0 2023-10-18T20:58:36.796 INFO:tasks.workunit.client.1.smithi060.stdout:3/561: dread d0/d22/d26/d2b/f4c [0,4194304] 0 2023-10-18T20:58:36.797 INFO:tasks.workunit.client.1.smithi060.stdout:1/743: read d4/d6/d48/fbd [3253525,114638] 0 2023-10-18T20:58:36.797 INFO:tasks.workunit.client.1.smithi060.stdout:5/667: write d0/d6/d8/df/d27/fbf [1387727,84993] 0 2023-10-18T20:58:36.809 INFO:tasks.workunit.client.1.smithi060.stdout:0/658: dwrite d3/d8/d14/d55/f88 [0,4194304] 0 2023-10-18T20:58:36.809 INFO:tasks.workunit.client.1.smithi060.stdout:0/659: stat d3/d8/d14/f3d 0 2023-10-18T20:58:36.811 INFO:tasks.workunit.client.1.smithi060.stdout:5/668: truncate d0/da/dc8/de4/f39 155707 0 2023-10-18T20:58:36.811 INFO:tasks.workunit.client.1.smithi060.stdout:4/569: dread d4/dc/d2a/d31/f46 [0,4194304] 0 2023-10-18T20:58:36.811 INFO:tasks.workunit.client.1.smithi060.stdout:4/570: fsync d4/dc/d2a/d1d/f21 0 2023-10-18T20:58:36.811 INFO:tasks.workunit.client.1.smithi060.stdout:4/571: fsync d4/dc/d2a/d13/d33/f35 0 2023-10-18T20:58:36.812 INFO:tasks.workunit.client.1.smithi060.stdout:1/744: unlink d4/d6/d7/d2f/d7b/d2a/d32/dd/f30 0 2023-10-18T20:58:36.815 INFO:tasks.workunit.client.1.smithi060.stdout:0/660: creat d3/d8/fd4 x:0 0 0 2023-10-18T20:58:36.815 INFO:tasks.workunit.client.1.smithi060.stdout:0/661: fdatasync d3/d8/d14/d55/d74/fce 0 2023-10-18T20:58:36.818 INFO:tasks.workunit.client.1.smithi060.stdout:3/562: dread d0/d5e/dbc/fbf [0,4194304] 0 2023-10-18T20:58:36.823 INFO:tasks.workunit.client.1.smithi060.stdout:5/669: mknod d0/da/dc8/de4/d6d/cf8 0 2023-10-18T20:58:36.824 INFO:tasks.workunit.client.1.smithi060.stdout:5/670: fsync d0/da/f9c 0 2023-10-18T20:58:36.824 INFO:tasks.workunit.client.1.smithi060.stdout:1/745: symlink d4/da/de0/lef 0 2023-10-18T20:58:36.825 INFO:tasks.workunit.client.1.smithi060.stdout:1/746: write d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/fea [473824,51348] 0 2023-10-18T20:58:36.825 INFO:tasks.workunit.client.1.smithi060.stdout:4/572: creat d4/dc/d2a/d39/fa6 x:0 0 0 2023-10-18T20:58:36.827 INFO:tasks.workunit.client.1.smithi060.stdout:4/573: mkdir d4/dc/d2a/d39/d53/d76/da7 0 2023-10-18T20:58:36.828 INFO:tasks.workunit.client.1.smithi060.stdout:4/574: mkdir d4/dc/d40/da8 0 2023-10-18T20:58:36.829 INFO:tasks.workunit.client.1.smithi060.stdout:4/575: symlink d4/d91/la9 0 2023-10-18T20:58:36.831 INFO:tasks.workunit.client.1.smithi060.stdout:4/576: creat d4/d15/d2b/d9f/faa x:0 0 0 2023-10-18T20:58:36.831 INFO:tasks.workunit.client.1.smithi060.stdout:4/577: write d4/dc/f6c [306543,76196] 0 2023-10-18T20:58:36.831 INFO:tasks.workunit.client.1.smithi060.stdout:4/578: fsync d4/d15/f48 0 2023-10-18T20:58:36.843 INFO:tasks.workunit.client.1.smithi060.stdout:5/671: dread d0/d6/d9/fd5 [0,4194304] 0 2023-10-18T20:58:36.846 INFO:tasks.workunit.client.1.smithi060.stdout:5/672: rename d0/d6/d9/d82/d84/db2/d2a/dd1 to d0/d6/d9/d82/d83/deb/df9 0 2023-10-18T20:58:36.857 INFO:tasks.workunit.client.1.smithi060.stdout:1/747: write d4/d6/d7/d2f/d6d/f9d [4019815,23049] 0 2023-10-18T20:58:36.870 INFO:tasks.workunit.client.1.smithi060.stdout:1/748: getdents d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5 0 2023-10-18T20:58:36.870 INFO:tasks.workunit.client.1.smithi060.stdout:3/563: dread d0/d22/d26/fb8 [0,4194304] 0 2023-10-18T20:58:36.871 INFO:tasks.workunit.client.1.smithi060.stdout:3/564: fsync d0/d22/f33 0 2023-10-18T20:58:36.876 INFO:tasks.workunit.client.1.smithi060.stdout:3/565: rename d0/d3c/d3d/f32 to d0/d22/d26/d2c/da0/fc7 0 2023-10-18T20:58:36.876 INFO:tasks.workunit.client.1.smithi060.stdout:3/566: write d0/d22/d26/d29/f45 [208659,28943] 0 2023-10-18T20:58:36.888 INFO:tasks.workunit.client.1.smithi060.stdout:0/662: dwrite d3/d8/d14/d55/d74/d76/d68/d7f/fc8 [0,4194304] 0 2023-10-18T20:58:36.904 INFO:tasks.workunit.client.1.smithi060.stdout:5/673: dwrite d0/da/dc8/de4/d6d/f71 [0,4194304] 0 2023-10-18T20:58:36.904 INFO:tasks.workunit.client.1.smithi060.stdout:0/663: symlink d3/d8/d14/d55/d9a/ld5 0 2023-10-18T20:58:36.904 INFO:tasks.workunit.client.1.smithi060.stdout:0/664: creat d3/d8/d14/d55/d9a/dcf/fd6 x:0 0 0 2023-10-18T20:58:36.906 INFO:tasks.workunit.client.1.smithi060.stdout:0/665: mkdir d3/d8/d3c/d87/dba/dd7 0 2023-10-18T20:58:36.907 INFO:tasks.workunit.client.1.smithi060.stdout:0/666: fsync d3/d8/d3c/f6d 0 2023-10-18T20:58:36.907 INFO:tasks.workunit.client.1.smithi060.stdout:9/567: sync 2023-10-18T20:58:36.907 INFO:tasks.workunit.client.1.smithi060.stdout:7/665: sync 2023-10-18T20:58:36.908 INFO:tasks.workunit.client.1.smithi060.stdout:8/590: sync 2023-10-18T20:58:36.910 INFO:tasks.workunit.client.1.smithi060.stdout:9/568: creat d3/d99/d65/fd6 x:0 0 0 2023-10-18T20:58:36.910 INFO:tasks.workunit.client.1.smithi060.stdout:7/666: write de/d14/d3a/d46/d73/f82 [978954,98205] 0 2023-10-18T20:58:36.910 INFO:tasks.workunit.client.1.smithi060.stdout:7/667: getdents de/d14/d41/dc6 0 2023-10-18T20:58:36.910 INFO:tasks.workunit.client.1.smithi060.stdout:9/569: creat d3/d99/d1c/d5a/d5d/d56/fd7 x:0 0 0 2023-10-18T20:58:36.911 INFO:tasks.workunit.client.1.smithi060.stdout:8/591: mknod d4/d9/d88/cb2 0 2023-10-18T20:58:36.911 INFO:tasks.workunit.client.1.smithi060.stdout:8/592: write d4/d9/d4f/f92 [145938,78834] 0 2023-10-18T20:58:36.913 INFO:tasks.workunit.client.1.smithi060.stdout:9/570: mkdir d3/d99/d1c/d25/dd8 0 2023-10-18T20:58:36.914 INFO:tasks.workunit.client.1.smithi060.stdout:9/571: chown d3/d99/d19/d54/c6f 64285699 1 2023-10-18T20:58:36.914 INFO:tasks.workunit.client.1.smithi060.stdout:9/572: dread - d3/d99/d1c/d2a/d2d/faf zero size 2023-10-18T20:58:36.914 INFO:tasks.workunit.client.1.smithi060.stdout:4/579: dwrite d4/dc/d2a/d1d/f21 [0,4194304] 0 2023-10-18T20:58:36.914 INFO:tasks.workunit.client.1.smithi060.stdout:8/593: chown d4/d9/d31/cb0 6 1 2023-10-18T20:58:36.915 INFO:tasks.workunit.client.1.smithi060.stdout:4/580: creat d4/dc/d2a/d39/d53/d76/da7/fab x:0 0 0 2023-10-18T20:58:36.915 INFO:tasks.workunit.client.1.smithi060.stdout:7/668: creat de/d14/d49/fd9 x:0 0 0 2023-10-18T20:58:36.916 INFO:tasks.workunit.client.1.smithi060.stdout:7/669: truncate de/d29/d72/f85 1940659 0 2023-10-18T20:58:36.917 INFO:tasks.workunit.client.1.smithi060.stdout:4/581: symlink d4/dc/d2a/d13/d27/d68/d9e/lac 0 2023-10-18T20:58:36.918 INFO:tasks.workunit.client.1.smithi060.stdout:4/582: chown d4/dc/f29 120459 1 2023-10-18T20:58:36.918 INFO:tasks.workunit.client.1.smithi060.stdout:7/670: getdents de/d14/d49/da3 0 2023-10-18T20:58:36.919 INFO:tasks.workunit.client.1.smithi060.stdout:4/583: symlink d4/dc/d2a/d39/d53/d65/lad 0 2023-10-18T20:58:36.920 INFO:tasks.workunit.client.1.smithi060.stdout:7/671: mknod de/d14/d2f/dd3/cda 0 2023-10-18T20:58:36.941 INFO:tasks.workunit.client.1.smithi060.stdout:9/573: dread d3/f20 [0,4194304] 0 2023-10-18T20:58:36.942 INFO:tasks.workunit.client.1.smithi060.stdout:3/567: dwrite d0/d22/d26/fa3 [0,4194304] 0 2023-10-18T20:58:36.945 INFO:tasks.workunit.client.1.smithi060.stdout:9/574: rename d3/d99/f11 to d3/d99/d19/d54/d8f/fd9 0 2023-10-18T20:58:36.945 INFO:tasks.workunit.client.1.smithi060.stdout:9/575: chown d3/d99/d1c/d2a/d80/da0/dc2/d9e/fce 2 1 2023-10-18T20:58:36.951 INFO:tasks.workunit.client.1.smithi060.stdout:3/568: rename d0/d22/d50/c81 to d0/d5e/dbc/cc8 0 2023-10-18T20:58:36.952 INFO:tasks.workunit.client.1.smithi060.stdout:9/576: truncate d3/d99/d1c/d2a/d80/fb7 4034061 0 2023-10-18T20:58:36.952 INFO:tasks.workunit.client.1.smithi060.stdout:9/577: creat d3/d99/d1c/d25/fda x:0 0 0 2023-10-18T20:58:36.952 INFO:tasks.workunit.client.1.smithi060.stdout:9/578: chown d3/d99/d1c/d5a/d5d/d56/fd7 236889125 1 2023-10-18T20:58:36.954 INFO:tasks.workunit.client.1.smithi060.stdout:3/569: mkdir d0/d3c/d3d/d4d/d95/dc9 0 2023-10-18T20:58:36.960 INFO:tasks.workunit.client.1.smithi060.stdout:3/570: rename d0/d22/d26/d79/f93 to d0/d22/d26/d79/fca 0 2023-10-18T20:58:36.972 INFO:tasks.workunit.client.1.smithi060.stdout:4/584: dread d4/dc/d2a/d39/f7f [0,4194304] 0 2023-10-18T20:58:36.974 INFO:tasks.workunit.client.1.smithi060.stdout:1/749: dwrite d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f8e [0,4194304] 0 2023-10-18T20:58:36.974 INFO:tasks.workunit.client.1.smithi060.stdout:1/750: write d4/d6/d7/df/d59/fc6 [646204,76444] 0 2023-10-18T20:58:36.976 INFO:tasks.workunit.client.1.smithi060.stdout:4/585: mkdir d4/d15/dae 0 2023-10-18T20:58:36.988 INFO:tasks.workunit.client.1.smithi060.stdout:0/667: dwrite d3/d8/d14/d55/d74/d76/d68/f72 [0,4194304] 0 2023-10-18T20:58:36.989 INFO:tasks.workunit.client.1.smithi060.stdout:0/668: chown d3/d8/d14/d55/d74/d76/d68/d7f/l94 198 1 2023-10-18T20:58:36.994 INFO:tasks.workunit.client.1.smithi060.stdout:4/586: unlink d4/c28 0 2023-10-18T20:58:36.994 INFO:tasks.workunit.client.1.smithi060.stdout:4/587: dread - d4/d15/d2b/d9f/faa zero size 2023-10-18T20:58:36.994 INFO:tasks.workunit.client.1.smithi060.stdout:5/674: dwrite d0/d6/d9/f14 [0,4194304] 0 2023-10-18T20:58:36.999 INFO:tasks.workunit.client.1.smithi060.stdout:5/675: mknod d0/da/d3b/d64/df5/cfa 0 2023-10-18T20:58:37.000 INFO:tasks.workunit.client.1.smithi060.stdout:4/588: getdents d4/d15 0 2023-10-18T20:58:37.005 INFO:tasks.workunit.client.1.smithi060.stdout:4/589: mkdir d4/dc/d40/d80/daf 0 2023-10-18T20:58:37.005 INFO:tasks.workunit.client.1.smithi060.stdout:4/590: chown d4/d15/d2b/f59 43949 1 2023-10-18T20:58:37.005 INFO:tasks.workunit.client.1.smithi060.stdout:4/591: stat d4/d15/d2b/f86 0 2023-10-18T20:58:37.022 INFO:tasks.workunit.client.1.smithi060.stdout:6/676: sync 2023-10-18T20:58:37.022 INFO:tasks.workunit.client.1.smithi060.stdout:6/677: fdatasync d10/d47/d92/f41 0 2023-10-18T20:58:37.022 INFO:tasks.workunit.client.1.smithi060.stdout:2/613: sync 2023-10-18T20:58:37.030 INFO:tasks.workunit.client.1.smithi060.stdout:0/669: read d3/f81 [2065695,17164] 0 2023-10-18T20:58:37.030 INFO:tasks.workunit.client.1.smithi060.stdout:3/571: dwrite d0/d22/d26/d29/f3a [0,4194304] 0 2023-10-18T20:58:37.031 INFO:tasks.workunit.client.1.smithi060.stdout:7/672: dwrite de/d29/f2b [0,4194304] 0 2023-10-18T20:58:37.031 INFO:tasks.workunit.client.1.smithi060.stdout:5/676: dread d0/d6/f1e [0,4194304] 0 2023-10-18T20:58:37.031 INFO:tasks.workunit.client.1.smithi060.stdout:8/594: dwrite d4/d9/d31/d35/d9f/da3/f60 [0,4194304] 0 2023-10-18T20:58:37.031 INFO:tasks.workunit.client.1.smithi060.stdout:8/595: truncate d4/fa7 556590 0 2023-10-18T20:58:37.032 INFO:tasks.workunit.client.1.smithi060.stdout:8/596: readlink d4/d9/d31/d6f/la4 0 2023-10-18T20:58:37.032 INFO:tasks.workunit.client.1.smithi060.stdout:8/597: chown d4/ff 29562 1 2023-10-18T20:58:37.032 INFO:tasks.workunit.client.1.smithi060.stdout:7/673: symlink de/d14/d41/ldb 0 2023-10-18T20:58:37.032 INFO:tasks.workunit.client.1.smithi060.stdout:7/674: read de/d14/d49/f55 [3957473,55981] 0 2023-10-18T20:58:37.033 INFO:tasks.workunit.client.1.smithi060.stdout:7/675: chown de/d14/d49/d68/l8e 1417455069 1 2023-10-18T20:58:37.033 INFO:tasks.workunit.client.1.smithi060.stdout:5/677: mknod d0/da/d79/da5/d67/cfb 0 2023-10-18T20:58:37.033 INFO:tasks.workunit.client.1.smithi060.stdout:2/614: symlink d0/d45/dc9/d68/lca 0 2023-10-18T20:58:37.033 INFO:tasks.workunit.client.1.smithi060.stdout:8/598: symlink d4/d9/d31/d35/d9f/da3/lb3 0 2023-10-18T20:58:37.036 INFO:tasks.workunit.client.1.smithi060.stdout:7/676: mknod de/d14/d2f/d8f/d5b/d9e/dac/cdc 0 2023-10-18T20:58:37.041 INFO:tasks.workunit.client.1.smithi060.stdout:4/592: dread d4/d15/f48 [0,4194304] 0 2023-10-18T20:58:37.041 INFO:tasks.workunit.client.1.smithi060.stdout:4/593: chown d4/dc/d2a/d39/d53/d65 75 1 2023-10-18T20:58:37.042 INFO:tasks.workunit.client.1.smithi060.stdout:7/677: rmdir de/d29/d72 39 2023-10-18T20:58:37.047 INFO:tasks.workunit.client.1.smithi060.stdout:7/678: symlink de/d14/d3a/d46/d73/ldd 0 2023-10-18T20:58:37.049 INFO:tasks.workunit.client.1.smithi060.stdout:7/679: write de/d14/d2f/d8f/d5b/f75 [4571507,63041] 0 2023-10-18T20:58:37.052 INFO:tasks.workunit.client.1.smithi060.stdout:0/670: write d3/d32/d86/f8c [4168776,42650] 0 2023-10-18T20:58:37.053 INFO:tasks.workunit.client.1.smithi060.stdout:6/678: dread d10/d2e/f73 [0,4194304] 0 2023-10-18T20:58:37.059 INFO:tasks.workunit.client.1.smithi060.stdout:1/751: dwrite d4/d6/d7/d35/fc0 [0,4194304] 0 2023-10-18T20:58:37.059 INFO:tasks.workunit.client.1.smithi060.stdout:2/615: dread d0/d16/d7f/faf [4194304,4194304] 0 2023-10-18T20:58:37.059 INFO:tasks.workunit.client.1.smithi060.stdout:1/752: chown d4/d6/d7/df/f40 17401648 1 2023-10-18T20:58:37.059 INFO:tasks.workunit.client.1.smithi060.stdout:1/753: write d4/da/d42/fc4 [992336,72803] 0 2023-10-18T20:58:37.060 INFO:tasks.workunit.client.1.smithi060.stdout:1/754: fsync d4/d6/f1f 0 2023-10-18T20:58:37.060 INFO:tasks.workunit.client.1.smithi060.stdout:7/680: creat de/d14/d2f/d3f/fde x:0 0 0 2023-10-18T20:58:37.061 INFO:tasks.workunit.client.1.smithi060.stdout:4/594: rmdir d4/dc/d2a/d2d/d69 39 2023-10-18T20:58:37.062 INFO:tasks.workunit.client.1.smithi060.stdout:0/671: rmdir d3/d8/d14/d55/d74/d76/d68/d7f/dd1 0 2023-10-18T20:58:37.070 INFO:tasks.workunit.client.1.smithi060.stdout:1/755: rename d4/d6/d33/fcc to d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/ff0 0 2023-10-18T20:58:37.074 INFO:tasks.workunit.client.1.smithi060.stdout:2/616: getdents d0/d3/d27/d4d/d5e/d96 0 2023-10-18T20:58:37.074 INFO:tasks.workunit.client.1.smithi060.stdout:0/672: link d3/d80/fa7 d3/d8/d14/d55/d74/d76/d68/d7f/fd8 0 2023-10-18T20:58:37.075 INFO:tasks.workunit.client.1.smithi060.stdout:4/595: link d4/dc/d2a/d2d/c75 d4/dc/d2a/d39/d82/cb0 0 2023-10-18T20:58:37.086 INFO:tasks.workunit.client.1.smithi060.stdout:2/617: creat d0/d8/d87/fcb x:0 0 0 2023-10-18T20:58:37.093 INFO:tasks.workunit.client.1.smithi060.stdout:4/596: rename d4/dc/d2a/d13/d2f to d4/dc/d2a/d83/db1 0 2023-10-18T20:58:37.093 INFO:tasks.workunit.client.1.smithi060.stdout:2/618: creat d0/d8/d47/fcc x:0 0 0 2023-10-18T20:58:37.093 INFO:tasks.workunit.client.1.smithi060.stdout:5/678: dwrite d0/d6/d9/d82/d84/db2/d2a/f5a [0,4194304] 0 2023-10-18T20:58:37.094 INFO:tasks.workunit.client.1.smithi060.stdout:2/619: write d0/f67 [839908,86477] 0 2023-10-18T20:58:37.094 INFO:tasks.workunit.client.1.smithi060.stdout:2/620: write d0/f65 [689114,8722] 0 2023-10-18T20:58:37.095 INFO:tasks.workunit.client.1.smithi060.stdout:2/621: creat d0/d8/d87/fcd x:0 0 0 2023-10-18T20:58:37.099 INFO:tasks.workunit.client.1.smithi060.stdout:7/681: read de/d14/d2f/f87 [550247,18819] 0 2023-10-18T20:58:37.101 INFO:tasks.workunit.client.1.smithi060.stdout:4/597: dread d4/f6a [0,4194304] 0 2023-10-18T20:58:37.107 INFO:tasks.workunit.client.1.smithi060.stdout:7/682: creat de/d14/d49/d68/d88/fdf x:0 0 0 2023-10-18T20:58:37.109 INFO:tasks.workunit.client.1.smithi060.stdout:2/622: dread d0/d45/fb5 [0,4194304] 0 2023-10-18T20:58:37.110 INFO:tasks.workunit.client.1.smithi060.stdout:4/598: link d4/dc/d2a/d2d/f74 d4/dc/d2a/fb2 0 2023-10-18T20:58:37.114 INFO:tasks.workunit.client.1.smithi060.stdout:8/599: dwrite d4/d9/d31/d35/d9f/da3/f89 [0,4194304] 0 2023-10-18T20:58:37.114 INFO:tasks.workunit.client.1.smithi060.stdout:8/600: write d4/d9/d31/da6/fac [602149,107246] 0 2023-10-18T20:58:37.121 INFO:tasks.workunit.client.1.smithi060.stdout:8/601: mkdir d4/d9/db4 0 2023-10-18T20:58:37.121 INFO:tasks.workunit.client.1.smithi060.stdout:5/679: read d0/d6/d8/f44 [465383,33599] 0 2023-10-18T20:58:37.122 INFO:tasks.workunit.client.1.smithi060.stdout:8/602: write d4/d9/d31/da6/fac [4813876,41855] 0 2023-10-18T20:58:37.122 INFO:tasks.workunit.client.1.smithi060.stdout:8/603: creat d4/d9/d93/fb5 x:0 0 0 2023-10-18T20:58:37.122 INFO:tasks.workunit.client.1.smithi060.stdout:8/604: creat d4/d9/d31/d6f/fb6 x:0 0 0 2023-10-18T20:58:37.125 INFO:tasks.workunit.client.1.smithi060.stdout:5/680: link d0/da/d3b/fbe d0/ffc 0 2023-10-18T20:58:37.129 INFO:tasks.workunit.client.1.smithi060.stdout:7/683: dread de/d29/f22 [0,4194304] 0 2023-10-18T20:58:37.129 INFO:tasks.workunit.client.1.smithi060.stdout:5/681: creat d0/dd/ffd x:0 0 0 2023-10-18T20:58:37.130 INFO:tasks.workunit.client.1.smithi060.stdout:4/599: dread d4/f6a [0,4194304] 0 2023-10-18T20:58:37.143 INFO:tasks.workunit.client.1.smithi060.stdout:6/679: dwrite d10/d17/f82 [0,4194304] 0 2023-10-18T20:58:37.144 INFO:tasks.workunit.client.1.smithi060.stdout:6/680: stat d10/d2e/d75/d81/d8b/dc9 0 2023-10-18T20:58:37.144 INFO:tasks.workunit.client.1.smithi060.stdout:6/681: fsync d10/d6f/faf 0 2023-10-18T20:58:37.162 INFO:tasks.workunit.client.1.smithi060.stdout:0/673: dwrite d3/d8/d14/f5f [0,4194304] 0 2023-10-18T20:58:37.163 INFO:tasks.workunit.client.1.smithi060.stdout:4/600: write d4/dc/d2a/d83/db1/f34 [1655093,117392] 0 2023-10-18T20:58:37.179 INFO:tasks.workunit.client.1.smithi060.stdout:5/682: write d0/d6/d9/d82/d84/db2/f85 [1534874,14313] 0 2023-10-18T20:58:37.184 INFO:tasks.workunit.client.1.smithi060.stdout:0/674: write d3/d8/f9 [100547,14899] 0 2023-10-18T20:58:37.188 INFO:tasks.workunit.client.1.smithi060.stdout:2/623: dwrite d0/d16/d7f/f9c [0,4194304] 0 2023-10-18T20:58:37.190 INFO:tasks.workunit.client.1.smithi060.stdout:2/624: chown d0/d3/c21 1869085499 1 2023-10-18T20:58:37.192 INFO:tasks.workunit.client.1.smithi060.stdout:0/675: mkdir d3/d80/dd9 0 2023-10-18T20:58:37.193 INFO:tasks.workunit.client.1.smithi060.stdout:0/676: chown d3/d8/d3c/fab 678 1 2023-10-18T20:58:37.195 INFO:tasks.workunit.client.1.smithi060.stdout:7/684: dwrite de/d14/d49/f55 [0,4194304] 0 2023-10-18T20:58:37.219 INFO:tasks.workunit.client.1.smithi060.stdout:9/579: sync 2023-10-18T20:58:37.220 INFO:tasks.workunit.client.1.smithi060.stdout:9/580: write d3/d99/d1c/d2a/f52 [1194798,13216] 0 2023-10-18T20:58:37.221 INFO:tasks.workunit.client.1.smithi060.stdout:0/677: write d3/d8/f2d [1015429,45359] 0 2023-10-18T20:58:37.223 INFO:tasks.workunit.client.1.smithi060.stdout:7/685: write de/d14/d49/f63 [4027831,91578] 0 2023-10-18T20:58:37.223 INFO:tasks.workunit.client.1.smithi060.stdout:7/686: write de/d14/d2f/f87 [253884,62440] 0 2023-10-18T20:58:37.223 INFO:tasks.workunit.client.1.smithi060.stdout:7/687: chown de/f1f 0 1 2023-10-18T20:58:37.223 INFO:tasks.workunit.client.1.smithi060.stdout:7/688: fsync de/d14/d2f/d8f/d5b/d9e/fd1 0 2023-10-18T20:58:37.224 INFO:tasks.workunit.client.1.smithi060.stdout:7/689: write de/d14/d2f/f71 [1156651,81921] 0 2023-10-18T20:58:37.226 INFO:tasks.workunit.client.1.smithi060.stdout:0/678: unlink d3/f81 0 2023-10-18T20:58:37.226 INFO:tasks.workunit.client.1.smithi060.stdout:2/625: write d0/d8/d47/f98 [242250,39855] 0 2023-10-18T20:58:37.227 INFO:tasks.workunit.client.1.smithi060.stdout:5/683: dwrite d0/da/dc8/de4/fd6 [0,4194304] 0 2023-10-18T20:58:37.230 INFO:tasks.workunit.client.1.smithi060.stdout:0/679: creat d3/d8/d14/d55/fda x:0 0 0 2023-10-18T20:58:37.230 INFO:tasks.workunit.client.1.smithi060.stdout:0/680: fsync d3/d8/d14/f7c 0 2023-10-18T20:58:37.231 INFO:tasks.workunit.client.1.smithi060.stdout:0/681: chown d3/d8/d14/d55/d74/l8e 3 1 2023-10-18T20:58:37.231 INFO:tasks.workunit.client.1.smithi060.stdout:2/626: rmdir d0/d3/d27/d4d/d5e/d96 39 2023-10-18T20:58:37.231 INFO:tasks.workunit.client.1.smithi060.stdout:2/627: truncate d0/d16/d85/fbd 4886398 0 2023-10-18T20:58:37.234 INFO:tasks.workunit.client.1.smithi060.stdout:2/628: mkdir d0/d3/d9e/dce 0 2023-10-18T20:58:37.236 INFO:tasks.workunit.client.1.smithi060.stdout:2/629: rename d0/d3/d27/f4c to d0/d45/dc9/d4a/fcf 0 2023-10-18T20:58:37.238 INFO:tasks.workunit.client.1.smithi060.stdout:7/690: dread de/d14/d2f/d3f/d5a/f94 [0,4194304] 0 2023-10-18T20:58:37.239 INFO:tasks.workunit.client.1.smithi060.stdout:4/601: dwrite d4/dc/d2a/d31/f46 [0,4194304] 0 2023-10-18T20:58:37.239 INFO:tasks.workunit.client.1.smithi060.stdout:2/630: mknod d0/d45/d49/d55/cd0 0 2023-10-18T20:58:37.242 INFO:tasks.workunit.client.1.smithi060.stdout:9/581: dread d3/f1b [0,4194304] 0 2023-10-18T20:58:37.242 INFO:tasks.workunit.client.1.smithi060.stdout:7/691: rename c8 to de/d29/ce0 0 2023-10-18T20:58:37.244 INFO:tasks.workunit.client.1.smithi060.stdout:9/582: getdents d3 0 2023-10-18T20:58:37.246 INFO:tasks.workunit.client.1.smithi060.stdout:2/631: rename d0/d3/d27/d4d/lc6 to d0/ld1 0 2023-10-18T20:58:37.246 INFO:tasks.workunit.client.1.smithi060.stdout:2/632: read - d0/d3/d27/d4d/d5e/d96/fa6 zero size 2023-10-18T20:58:37.247 INFO:tasks.workunit.client.1.smithi060.stdout:7/692: link de/d14/d3a/d46/fb0 de/d14/dd2/fe1 0 2023-10-18T20:58:37.248 INFO:tasks.workunit.client.1.smithi060.stdout:2/633: creat d0/d3/d9e/dc2/fd2 x:0 0 0 2023-10-18T20:58:37.248 INFO:tasks.workunit.client.1.smithi060.stdout:2/634: fdatasync d0/d3/d27/d4d/d5e/d96/fb8 0 2023-10-18T20:58:37.250 INFO:tasks.workunit.client.1.smithi060.stdout:7/693: write de/d14/d3a/d46/d73/f82 [58675,95329] 0 2023-10-18T20:58:37.250 INFO:tasks.workunit.client.1.smithi060.stdout:7/694: fsync de/d14/d3a/d46/fd4 0 2023-10-18T20:58:37.251 INFO:tasks.workunit.client.1.smithi060.stdout:7/695: creat de/d14/d49/d68/d7d/fe2 x:0 0 0 2023-10-18T20:58:37.253 INFO:tasks.workunit.client.1.smithi060.stdout:7/696: stat de/d14/d49/d68/d88/c98 0 2023-10-18T20:58:37.268 INFO:tasks.workunit.client.1.smithi060.stdout:0/682: write d3/d8/d14/f2b [1184030,57300] 0 2023-10-18T20:58:37.268 INFO:tasks.workunit.client.1.smithi060.stdout:0/683: write d3/d8/d14/f77 [107037,113757] 0 2023-10-18T20:58:37.283 INFO:tasks.workunit.client.1.smithi060.stdout:5/684: dwrite d0/da/f9a [0,4194304] 0 2023-10-18T20:58:37.283 INFO:tasks.workunit.client.1.smithi060.stdout:5/685: readlink d0/da/d79/da5/d67/ldd 0 2023-10-18T20:58:37.285 INFO:tasks.workunit.client.1.smithi060.stdout:5/686: creat d0/da/d79/ffe x:0 0 0 2023-10-18T20:58:37.285 INFO:tasks.workunit.client.1.smithi060.stdout:5/687: stat d0/da/d3b/d43/ld3 0 2023-10-18T20:58:37.296 INFO:tasks.workunit.client.1.smithi060.stdout:7/697: dread de/d14/d49/d68/d7d/d7e/db5/fc7 [0,4194304] 0 2023-10-18T20:58:37.296 INFO:tasks.workunit.client.1.smithi060.stdout:7/698: fsync de/d14/d2f/d8f/d5b/d9e/dac/fcd 0 2023-10-18T20:58:37.297 INFO:tasks.workunit.client.1.smithi060.stdout:7/699: fsync de/d14/d49/fb4 0 2023-10-18T20:58:37.298 INFO:tasks.workunit.client.1.smithi060.stdout:7/700: unlink de/d14/d41/cc1 0 2023-10-18T20:58:37.300 INFO:tasks.workunit.client.1.smithi060.stdout:7/701: link de/d14/d49/la7 de/d14/d49/d68/d7d/le3 0 2023-10-18T20:58:37.301 INFO:tasks.workunit.client.1.smithi060.stdout:9/583: dwrite d3/d99/d1c/d5a/d5d/d7d/f89 [4194304,4194304] 0 2023-10-18T20:58:37.306 INFO:tasks.workunit.client.1.smithi060.stdout:7/702: creat de/d14/d2f/d3f/d5a/d5f/fe4 x:0 0 0 2023-10-18T20:58:37.309 INFO:tasks.workunit.client.1.smithi060.stdout:0/684: dread d3/d8/dac/fcd [0,4194304] 0 2023-10-18T20:58:37.310 INFO:tasks.workunit.client.1.smithi060.stdout:9/584: rename d3/fa1 to d3/d99/d1c/d2a/fdb 0 2023-10-18T20:58:37.310 INFO:tasks.workunit.client.1.smithi060.stdout:5/688: write d0/d6/d9/db1/fd0 [3917077,11369] 0 2023-10-18T20:58:37.316 INFO:tasks.workunit.client.1.smithi060.stdout:4/602: dwrite d4/dc/f58 [4194304,4194304] 0 2023-10-18T20:58:37.318 INFO:tasks.workunit.client.1.smithi060.stdout:5/689: mknod d0/d6/d8/df/cff 0 2023-10-18T20:58:37.319 INFO:tasks.workunit.client.1.smithi060.stdout:5/690: fdatasync d0/d6/d9/d82/f90 0 2023-10-18T20:58:37.321 INFO:tasks.workunit.client.1.smithi060.stdout:4/603: unlink d4/dc/d2a/d1d/f21 0 2023-10-18T20:58:37.332 INFO:tasks.workunit.client.1.smithi060.stdout:5/691: mkdir d0/da/d79/da5/d67/d100 0 2023-10-18T20:58:37.332 INFO:tasks.workunit.client.1.smithi060.stdout:4/604: symlink d4/dc/d2a/d39/d53/d76/lb3 0 2023-10-18T20:58:37.333 INFO:tasks.workunit.client.1.smithi060.stdout:4/605: write d4/dc/f6c [603390,105556] 0 2023-10-18T20:58:37.337 INFO:tasks.workunit.client.1.smithi060.stdout:5/692: creat d0/d6/d8/d81/f101 x:0 0 0 2023-10-18T20:58:37.337 INFO:tasks.workunit.client.1.smithi060.stdout:5/693: fdatasync d0/d6/d8/df/d27/f3c 0 2023-10-18T20:58:37.340 INFO:tasks.workunit.client.1.smithi060.stdout:5/694: mkdir d0/da/d3b/d102 0 2023-10-18T20:58:37.340 INFO:tasks.workunit.client.1.smithi060.stdout:5/695: chown d0/da/d3b/ld9 52149 1 2023-10-18T20:58:37.341 INFO:tasks.workunit.client.1.smithi060.stdout:2/635: dwrite d0/d3/f35 [0,4194304] 0 2023-10-18T20:58:37.350 INFO:tasks.workunit.client.1.smithi060.stdout:2/636: truncate d0/d16/f28 4371606 0 2023-10-18T20:58:37.351 INFO:tasks.workunit.client.1.smithi060.stdout:2/637: rename d0/d8/d87/fcd to d0/d16/d81/fd3 0 2023-10-18T20:58:37.354 INFO:tasks.workunit.client.1.smithi060.stdout:3/572: sync 2023-10-18T20:58:37.354 INFO:tasks.workunit.client.1.smithi060.stdout:3/573: readlink d0/d22/d26/d2b/l89 0 2023-10-18T20:58:37.355 INFO:tasks.workunit.client.1.smithi060.stdout:1/756: sync 2023-10-18T20:58:37.355 INFO:tasks.workunit.client.1.smithi060.stdout:1/757: fdatasync d4/d6/d7/d2f/fba 0 2023-10-18T20:58:37.356 INFO:tasks.workunit.client.1.smithi060.stdout:1/758: truncate d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/fd0 89000 0 2023-10-18T20:58:37.356 INFO:tasks.workunit.client.1.smithi060.stdout:1/759: fdatasync d4/d6/d7/d35/fbc 0 2023-10-18T20:58:37.356 INFO:tasks.workunit.client.1.smithi060.stdout:6/682: sync 2023-10-18T20:58:37.356 INFO:tasks.workunit.client.1.smithi060.stdout:8/605: sync 2023-10-18T20:58:37.357 INFO:tasks.workunit.client.1.smithi060.stdout:8/606: chown d4/d9/d31/l6a 341 1 2023-10-18T20:58:37.357 INFO:tasks.workunit.client.1.smithi060.stdout:2/638: truncate d0/d16/d7f/faf 5961219 0 2023-10-18T20:58:37.358 INFO:tasks.workunit.client.1.smithi060.stdout:3/574: truncate d0/d22/d26/d2c/fbd 3129501 0 2023-10-18T20:58:37.359 INFO:tasks.workunit.client.1.smithi060.stdout:3/575: write d0/d22/d26/d2b/f6f [5208135,112027] 0 2023-10-18T20:58:37.359 INFO:tasks.workunit.client.1.smithi060.stdout:1/760: write d4/d6/d7/df/d59/fb8 [105404,27944] 0 2023-10-18T20:58:37.359 INFO:tasks.workunit.client.1.smithi060.stdout:1/761: truncate d4/da/f50 4754230 0 2023-10-18T20:58:37.359 INFO:tasks.workunit.client.1.smithi060.stdout:1/762: fdatasync d4/d6/d7/d2f/d7b/d2a/d32/dd/fa8 0 2023-10-18T20:58:37.360 INFO:tasks.workunit.client.1.smithi060.stdout:1/763: creat d4/d6/d7/d2f/d6d/ff1 x:0 0 0 2023-10-18T20:58:37.360 INFO:tasks.workunit.client.1.smithi060.stdout:3/576: write d0/d22/d26/d29/f45 [2676941,56063] 0 2023-10-18T20:58:37.360 INFO:tasks.workunit.client.1.smithi060.stdout:3/577: read - d0/d3c/d3d/f59 zero size 2023-10-18T20:58:37.367 INFO:tasks.workunit.client.1.smithi060.stdout:6/683: symlink d10/d25/d3c/ld7 0 2023-10-18T20:58:37.368 INFO:tasks.workunit.client.1.smithi060.stdout:6/684: truncate d10/d47/d92/f4a 4822033 0 2023-10-18T20:58:37.368 INFO:tasks.workunit.client.1.smithi060.stdout:2/639: truncate d0/d8/d47/f98 3488844 0 2023-10-18T20:58:37.372 INFO:tasks.workunit.client.1.smithi060.stdout:8/607: truncate d4/d9/d31/d35/f4d 603805 0 2023-10-18T20:58:37.372 INFO:tasks.workunit.client.1.smithi060.stdout:8/608: readlink d4/d9/d31/d35/d9f/da3/l98 0 2023-10-18T20:58:37.373 INFO:tasks.workunit.client.1.smithi060.stdout:3/578: creat d0/d3c/d3d/d4d/d95/fcb x:0 0 0 2023-10-18T20:58:37.375 INFO:tasks.workunit.client.1.smithi060.stdout:2/640: link d0/d45/d49/d55/dae/fbb d0/fd4 0 2023-10-18T20:58:37.380 INFO:tasks.workunit.client.1.smithi060.stdout:3/579: creat d0/d22/d26/d29/dae/fcc x:0 0 0 2023-10-18T20:58:37.383 INFO:tasks.workunit.client.1.smithi060.stdout:3/580: symlink d0/d22/d26/d2b/lcd 0 2023-10-18T20:58:37.390 INFO:tasks.workunit.client.1.smithi060.stdout:3/581: mknod d0/d22/d26/d2c/da0/cce 0 2023-10-18T20:58:37.390 INFO:tasks.workunit.client.1.smithi060.stdout:3/582: stat d0/d3c/d3d/l85 0 2023-10-18T20:58:37.395 INFO:tasks.workunit.client.1.smithi060.stdout:3/583: mknod d0/d5e/ccf 0 2023-10-18T20:58:37.397 INFO:tasks.workunit.client.1.smithi060.stdout:1/764: dread d4/d6/d7/d35/fc0 [0,4194304] 0 2023-10-18T20:58:37.398 INFO:tasks.workunit.client.1.smithi060.stdout:3/584: rename d0/d22/d26/d79/db3/fc6 to d0/d3c/d3d/d4d/d95/dc9/fd0 0 2023-10-18T20:58:37.398 INFO:tasks.workunit.client.1.smithi060.stdout:3/585: readlink d0/d22/d26/l4a 0 2023-10-18T20:58:37.399 INFO:tasks.workunit.client.1.smithi060.stdout:3/586: mknod d0/d22/cd1 0 2023-10-18T20:58:37.400 INFO:tasks.workunit.client.1.smithi060.stdout:7/703: dwrite de/d38/fad [4194304,4194304] 0 2023-10-18T20:58:37.400 INFO:tasks.workunit.client.1.smithi060.stdout:7/704: creat de/d14/d3a/d46/fe5 x:0 0 0 2023-10-18T20:58:37.406 INFO:tasks.workunit.client.1.smithi060.stdout:1/765: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/ff2 x:0 0 0 2023-10-18T20:58:37.411 INFO:tasks.workunit.client.1.smithi060.stdout:6/685: dread d10/d2e/f4e [0,4194304] 0 2023-10-18T20:58:37.412 INFO:tasks.workunit.client.1.smithi060.stdout:6/686: getdents d10/d3e 0 2023-10-18T20:58:37.414 INFO:tasks.workunit.client.1.smithi060.stdout:0/685: dwrite d3/d8/d14/f40 [0,4194304] 0 2023-10-18T20:58:37.414 INFO:tasks.workunit.client.1.smithi060.stdout:0/686: creat d3/d8/d14/d55/d9a/dcf/fdb x:0 0 0 2023-10-18T20:58:37.444 INFO:tasks.workunit.client.1.smithi060.stdout:8/609: dwrite d4/d9/d37/d4e/d6e/f95 [0,4194304] 0 2023-10-18T20:58:37.448 INFO:tasks.workunit.client.1.smithi060.stdout:5/696: dwrite d0/d6/d8/df/d27/f3c [0,4194304] 0 2023-10-18T20:58:37.448 INFO:tasks.workunit.client.1.smithi060.stdout:5/697: write d0/d6/d9/d82/d83/d99/faa [1322774,77868] 0 2023-10-18T20:58:37.450 INFO:tasks.workunit.client.1.smithi060.stdout:4/606: dwrite d4/dc/d2a/d2d/f4f [0,4194304] 0 2023-10-18T20:58:37.452 INFO:tasks.workunit.client.1.smithi060.stdout:8/610: symlink d4/d9/d93/lb7 0 2023-10-18T20:58:37.453 INFO:tasks.workunit.client.1.smithi060.stdout:5/698: creat d0/d6/d9/d82/f103 x:0 0 0 2023-10-18T20:58:37.456 INFO:tasks.workunit.client.1.smithi060.stdout:5/699: rename d0/d6/d9/d82/d96/cc1 to d0/da/dc8/de4/d6d/db6/c104 0 2023-10-18T20:58:37.470 INFO:tasks.workunit.client.1.smithi060.stdout:8/611: write d4/d9/d37/f3c [116512,45763] 0 2023-10-18T20:58:37.474 INFO:tasks.workunit.client.1.smithi060.stdout:2/641: dwrite d0/d16/d85/f8f [0,4194304] 0 2023-10-18T20:58:37.474 INFO:tasks.workunit.client.1.smithi060.stdout:2/642: creat d0/d8/d47/fd5 x:0 0 0 2023-10-18T20:58:37.474 INFO:tasks.workunit.client.1.smithi060.stdout:2/643: getdents d0/d3/d9e/dce 0 2023-10-18T20:58:37.474 INFO:tasks.workunit.client.1.smithi060.stdout:2/644: creat d0/d3/d27/d4d/d53/fd6 x:0 0 0 2023-10-18T20:58:37.475 INFO:tasks.workunit.client.1.smithi060.stdout:6/687: dwrite d10/d17/d7a/fcd [0,4194304] 0 2023-10-18T20:58:37.488 INFO:tasks.workunit.client.1.smithi060.stdout:0/687: dwrite d3/d8/d14/d55/d74/fb2 [0,4194304] 0 2023-10-18T20:58:37.498 INFO:tasks.workunit.client.1.smithi060.stdout:3/587: dwrite d0/d22/d26/f61 [0,4194304] 0 2023-10-18T20:58:37.503 INFO:tasks.workunit.client.1.smithi060.stdout:0/688: dread d3/d32/d86/f8c [0,4194304] 0 2023-10-18T20:58:37.518 INFO:tasks.workunit.client.1.smithi060.stdout:3/588: dread d0/d3c/d3d/d4d/f6a [0,4194304] 0 2023-10-18T20:58:37.552 INFO:tasks.workunit.client.1.smithi060.stdout:0/689: dwrite d3/d8/d14/d55/d74/d76/d68/f92 [4194304,4194304] 0 2023-10-18T20:58:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:36.113558+0000 mgr.smithi008.flmjzp (mgr.14640) 5 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail 2023-10-18T20:58:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:36.113558+0000 mgr.smithi008.flmjzp (mgr.14640) 5 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail 2023-10-18T20:58:38.503 INFO:tasks.workunit.client.1.smithi060.stdout:4/607: truncate d4/dc/d2a/d13/d27/f67 2838032 0 2023-10-18T20:58:38.507 INFO:tasks.workunit.client.1.smithi060.stdout:8/612: truncate d4/ff 2985625 0 2023-10-18T20:58:38.518 INFO:tasks.workunit.client.1.smithi060.stdout:5/700: write d0/da/d79/da5/f3e [1515319,44549] 0 2023-10-18T20:58:38.524 INFO:tasks.workunit.client.1.smithi060.stdout:6/688: symlink d10/d17/d7a/ld8 0 2023-10-18T20:58:38.534 INFO:tasks.workunit.client.1.smithi060.stdout:3/589: mknod d0/d22/d26/d2c/da0/cd2 0 2023-10-18T20:58:38.534 INFO:tasks.workunit.client.1.smithi060.stdout:3/590: creat d0/d22/d26/d2c/fd3 x:0 0 0 2023-10-18T20:58:38.538 INFO:tasks.workunit.client.1.smithi060.stdout:0/690: creat d3/d8/d14/d55/dad/daa/fdc x:0 0 0 2023-10-18T20:58:38.538 INFO:tasks.workunit.client.1.smithi060.stdout:0/691: write d3/d8/d14/d55/d9a/dcf/fdb [535628,77645] 0 2023-10-18T20:58:38.538 INFO:tasks.workunit.client.1.smithi060.stdout:0/692: fdatasync d3/d8/d14/f40 0 2023-10-18T20:58:38.540 INFO:tasks.workunit.client.1.smithi060.stdout:4/608: creat d4/dc/d2a/d39/d53/d76/d99/fb4 x:0 0 0 2023-10-18T20:58:38.548 INFO:tasks.workunit.client.1.smithi060.stdout:2/645: rmdir d0 39 2023-10-18T20:58:38.550 INFO:tasks.workunit.client.1.smithi060.stdout:6/689: creat d10/d17/d70/fd9 x:0 0 0 2023-10-18T20:58:38.554 INFO:tasks.workunit.client.1.smithi060.stdout:0/693: link d3/d8/d14/d55/d9a/dcf/fd6 d3/d8/d14/d55/d74/d76/d68/fdd 0 2023-10-18T20:58:38.555 INFO:tasks.workunit.client.1.smithi060.stdout:3/591: dread d0/d22/f96 [0,4194304] 0 2023-10-18T20:58:38.555 INFO:tasks.workunit.client.1.smithi060.stdout:3/592: readlink d0/d22/d26/d79/db3/lc3 0 2023-10-18T20:58:38.557 INFO:tasks.workunit.client.1.smithi060.stdout:2/646: link d0/d45/dc9/d68/l9b d0/d3/d9e/dce/ld7 0 2023-10-18T20:58:38.559 INFO:tasks.workunit.client.1.smithi060.stdout:6/690: creat d10/d17/d7a/fda x:0 0 0 2023-10-18T20:58:38.559 INFO:tasks.workunit.client.1.smithi060.stdout:6/691: chown d10/d47/d92/f22 1 1 2023-10-18T20:58:38.561 INFO:tasks.workunit.client.1.smithi060.stdout:3/593: creat d0/d5e/fd4 x:0 0 0 2023-10-18T20:58:38.563 INFO:tasks.workunit.client.1.smithi060.stdout:4/609: rmdir d4/dc/d2a/d13 39 2023-10-18T20:58:38.563 INFO:tasks.workunit.client.1.smithi060.stdout:4/610: truncate d4/dc/d2a/d13/f9b 1837523 0 2023-10-18T20:58:38.564 INFO:tasks.workunit.client.1.smithi060.stdout:2/647: unlink d0/d8/d47/fd5 0 2023-10-18T20:58:38.571 INFO:tasks.workunit.client.1.smithi060.stdout:0/694: getdents d3/d8/d14/d55/d9a 0 2023-10-18T20:58:38.576 INFO:tasks.workunit.client.1.smithi060.stdout:4/611: link d4/dc/d2a/d31/f46 d4/dc/d2a/d39/d53/fb5 0 2023-10-18T20:58:38.577 INFO:tasks.workunit.client.1.smithi060.stdout:2/648: creat d0/d16/d7f/fd8 x:0 0 0 2023-10-18T20:58:38.577 INFO:tasks.workunit.client.1.smithi060.stdout:3/594: rmdir d0/d22/d26/d29/dae 39 2023-10-18T20:58:38.577 INFO:tasks.workunit.client.1.smithi060.stdout:3/595: creat d0/d22/d50/fd5 x:0 0 0 2023-10-18T20:58:38.577 INFO:tasks.workunit.client.1.smithi060.stdout:3/596: fsync d0/d22/d26/f43 0 2023-10-18T20:58:38.578 INFO:tasks.workunit.client.1.smithi060.stdout:5/701: dwrite d0/d6/d9/db1/fd0 [0,4194304] 0 2023-10-18T20:58:38.578 INFO:tasks.workunit.client.1.smithi060.stdout:5/702: readlink d0/da/dc8/de4/la8 0 2023-10-18T20:58:38.586 INFO:tasks.workunit.client.1.smithi060.stdout:3/597: link d0/d5e/ccf d0/d3c/d3d/d4d/d95/dc9/cd6 0 2023-10-18T20:58:38.598 INFO:tasks.workunit.client.1.smithi060.stdout:2/649: dread d0/d3/d27/d4d/f7d [0,4194304] 0 2023-10-18T20:58:38.615 INFO:tasks.workunit.client.1.smithi060.stdout:5/703: dread d0/d6/d8/f21 [0,4194304] 0 2023-10-18T20:58:38.616 INFO:tasks.workunit.client.1.smithi060.stdout:5/704: mkdir d0/dd/d76/d105 0 2023-10-18T20:58:38.617 INFO:tasks.workunit.client.1.smithi060.stdout:5/705: getdents d0/d6/d8/df/d27 0 2023-10-18T20:58:38.621 INFO:tasks.workunit.client.1.smithi060.stdout:5/706: mkdir d0/d47/d7d/da0/d106 0 2023-10-18T20:58:38.621 INFO:tasks.workunit.client.1.smithi060.stdout:5/707: chown d0/d6/d8/d81/f101 24600 1 2023-10-18T20:58:38.622 INFO:tasks.workunit.client.1.smithi060.stdout:2/650: write d0/d8/f2b [4268249,32224] 0 2023-10-18T20:58:38.623 INFO:tasks.workunit.client.1.smithi060.stdout:2/651: link d0/d3/d27/l80 d0/d8/ld9 0 2023-10-18T20:58:38.623 INFO:tasks.workunit.client.1.smithi060.stdout:2/652: chown d0/d45/d49/f3f 3 1 2023-10-18T20:58:38.624 INFO:tasks.workunit.client.1.smithi060.stdout:2/653: mknod d0/d45/d49/d55/cda 0 2023-10-18T20:58:38.625 INFO:tasks.workunit.client.1.smithi060.stdout:2/654: mknod d0/d3/cdb 0 2023-10-18T20:58:38.626 INFO:tasks.workunit.client.1.smithi060.stdout:2/655: link d0/d3/c2e d0/d3/cdc 0 2023-10-18T20:58:38.627 INFO:tasks.workunit.client.1.smithi060.stdout:2/656: write d0/d45/dc9/da8/fc0 [126159,79233] 0 2023-10-18T20:58:38.628 INFO:tasks.workunit.client.1.smithi060.stdout:2/657: unlink d0/f4e 0 2023-10-18T20:58:38.630 INFO:tasks.workunit.client.1.smithi060.stdout:2/658: mkdir d0/d16/d81/da1/ddd 0 2023-10-18T20:58:38.640 INFO:tasks.workunit.client.1.smithi060.stdout:5/708: dread d0/d6/d9/d82/d84/db2/d2a/f5a [0,4194304] 0 2023-10-18T20:58:38.642 INFO:tasks.workunit.client.1.smithi060.stdout:5/709: creat d0/d6/d8/df/f107 x:0 0 0 2023-10-18T20:58:38.642 INFO:tasks.workunit.client.1.smithi060.stdout:5/710: readlink d0/d47/l70 0 2023-10-18T20:58:38.644 INFO:tasks.workunit.client.1.smithi060.stdout:5/711: write d0/d6/d9/d82/d84/db2/d41/f75 [316809,13327] 0 2023-10-18T20:58:38.645 INFO:tasks.workunit.client.1.smithi060.stdout:5/712: mknod d0/d6/d8/c108 0 2023-10-18T20:58:38.652 INFO:tasks.workunit.client.1.smithi060.stdout:6/692: dwrite d10/d17/d2f/fa0 [0,4194304] 0 2023-10-18T20:58:38.652 INFO:tasks.workunit.client.1.smithi060.stdout:6/693: fsync d10/d17/d7a/fda 0 2023-10-18T20:58:38.653 INFO:tasks.workunit.client.1.smithi060.stdout:6/694: chown d10/d2e/l63 982786 1 2023-10-18T20:58:38.656 INFO:tasks.workunit.client.1.smithi060.stdout:6/695: symlink d10/d2e/d75/d81/d8b/ldb 0 2023-10-18T20:58:38.657 INFO:tasks.workunit.client.1.smithi060.stdout:6/696: dread - d10/d17/f97 zero size 2023-10-18T20:58:38.666 INFO:tasks.workunit.client.1.smithi060.stdout:4/612: dwrite d4/dc/d2a/d5b/fa0 [0,4194304] 0 2023-10-18T20:58:38.671 INFO:tasks.workunit.client.1.smithi060.stdout:4/613: dread d4/f6a [0,4194304] 0 2023-10-18T20:58:38.677 INFO:tasks.workunit.client.1.smithi060.stdout:0/695: dwrite d3/d80/f9e [0,4194304] 0 2023-10-18T20:58:38.677 INFO:tasks.workunit.client.1.smithi060.stdout:0/696: chown d3 28354095 1 2023-10-18T20:58:38.678 INFO:tasks.workunit.client.1.smithi060.stdout:0/697: fsync d3/d8/f28 0 2023-10-18T20:58:38.684 INFO:tasks.workunit.client.1.smithi060.stdout:0/698: unlink d3/d8/d14/d55/d74/fb2 0 2023-10-18T20:58:38.684 INFO:tasks.workunit.client.1.smithi060.stdout:0/699: write d3/d8/d14/d55/d74/d76/f36 [2843359,115935] 0 2023-10-18T20:58:38.697 INFO:tasks.workunit.client.1.smithi060.stdout:5/713: write d0/d6/d9/db1/fd0 [1575261,109349] 0 2023-10-18T20:58:38.706 INFO:tasks.workunit.client.1.smithi060.stdout:2/659: dread d0/d16/d81/da1/fab [0,4194304] 0 2023-10-18T20:58:38.707 INFO:tasks.workunit.client.1.smithi060.stdout:0/700: dread d3/d8/d14/f77 [0,4194304] 0 2023-10-18T20:58:38.707 INFO:tasks.workunit.client.1.smithi060.stdout:0/701: symlink d3/d8/d3c/d87/lde 0 2023-10-18T20:58:38.711 INFO:tasks.workunit.client.1.smithi060.stdout:3/598: dwrite d0/d22/d26/d2c/f74 [0,4194304] 0 2023-10-18T20:58:38.712 INFO:tasks.workunit.client.1.smithi060.stdout:6/697: dwrite d10/d47/d92/f22 [0,4194304] 0 2023-10-18T20:58:38.714 INFO:tasks.workunit.client.1.smithi060.stdout:2/660: dread d0/d3/d27/d4d/d5e/f74 [0,4194304] 0 2023-10-18T20:58:38.714 INFO:tasks.workunit.client.1.smithi060.stdout:3/599: rename d0/d22/d26/d79/c84 to d0/d3c/d3d/d4d/d95/dc9/cd7 0 2023-10-18T20:58:38.715 INFO:tasks.workunit.client.1.smithi060.stdout:3/600: fdatasync d0/d22/d26/d29/f7d 0 2023-10-18T20:58:38.715 INFO:tasks.workunit.client.1.smithi060.stdout:3/601: dread - d0/d22/d26/fb0 zero size 2023-10-18T20:58:38.718 INFO:tasks.workunit.client.1.smithi060.stdout:0/702: dread d3/d8/d3c/fbf [0,4194304] 0 2023-10-18T20:58:38.720 INFO:tasks.workunit.client.1.smithi060.stdout:3/602: mknod d0/d22/d26/d29/cd8 0 2023-10-18T20:58:38.721 INFO:tasks.workunit.client.1.smithi060.stdout:3/603: chown d0/d22/d26/d2c/l38 72 1 2023-10-18T20:58:38.721 INFO:tasks.workunit.client.1.smithi060.stdout:3/604: chown d0/f64 10175623 1 2023-10-18T20:58:38.721 INFO:tasks.workunit.client.1.smithi060.stdout:3/605: truncate d0/d3c/d3d/fb5 943482 0 2023-10-18T20:58:38.721 INFO:tasks.workunit.client.1.smithi060.stdout:0/703: mknod d3/d8/d3c/cdf 0 2023-10-18T20:58:38.724 INFO:tasks.workunit.client.1.smithi060.stdout:3/606: rename d0/d3c/d3d/f98 to d0/d3c/d3d/fd9 0 2023-10-18T20:58:38.724 INFO:tasks.workunit.client.1.smithi060.stdout:3/607: creat d0/d22/d50/fda x:0 0 0 2023-10-18T20:58:38.730 INFO:tasks.workunit.client.1.smithi060.stdout:3/608: dread - d0/d3c/d3d/f59 zero size 2023-10-18T20:58:38.730 INFO:tasks.workunit.client.1.smithi060.stdout:0/704: symlink d3/d8/d14/d55/d74/d76/d68/d7f/d8d/dbc/le0 0 2023-10-18T20:58:38.768 INFO:tasks.workunit.client.1.smithi060.stdout:6/698: dread d10/d47/d92/f41 [4194304,4194304] 0 2023-10-18T20:58:38.768 INFO:tasks.workunit.client.1.smithi060.stdout:6/699: stat d10/d17/d70/dba/lbb 0 2023-10-18T20:58:38.768 INFO:tasks.workunit.client.1.smithi060.stdout:2/661: dwrite d0/d45/d49/f7e [0,4194304] 0 2023-10-18T20:58:38.768 INFO:tasks.workunit.client.1.smithi060.stdout:2/662: truncate d0/d16/d7f/fd8 884962 0 2023-10-18T20:58:38.769 INFO:tasks.workunit.client.1.smithi060.stdout:2/663: fsync d0/d16/d85/fbd 0 2023-10-18T20:58:38.769 INFO:tasks.workunit.client.1.smithi060.stdout:2/664: creat d0/d8/d47/d73/fde x:0 0 0 2023-10-18T20:58:38.771 INFO:tasks.workunit.client.1.smithi060.stdout:2/665: creat d0/d8/d47/fdf x:0 0 0 2023-10-18T20:58:38.771 INFO:tasks.workunit.client.1.smithi060.stdout:2/666: read d0/d8/d47/f98 [1159845,125541] 0 2023-10-18T20:58:38.772 INFO:tasks.workunit.client.1.smithi060.stdout:2/667: creat d0/d3/d27/fe0 x:0 0 0 2023-10-18T20:58:38.790 INFO:tasks.workunit.client.1.smithi060.stdout:3/609: dwrite d0/d3c/d3d/f3b [4194304,4194304] 0 2023-10-18T20:58:38.790 INFO:tasks.workunit.client.1.smithi060.stdout:3/610: write d0/d22/d26/d79/fca [847609,10946] 0 2023-10-18T20:58:38.795 INFO:tasks.workunit.client.1.smithi060.stdout:2/668: write d0/d16/d81/da1/fab [3449410,88175] 0 2023-10-18T20:58:38.795 INFO:tasks.workunit.client.1.smithi060.stdout:2/669: fsync d0/d3/d27/f57 0 2023-10-18T20:58:38.795 INFO:tasks.workunit.client.1.smithi060.stdout:2/670: write d0/d16/d85/fbd [5240290,28988] 0 2023-10-18T20:58:38.795 INFO:tasks.workunit.client.1.smithi060.stdout:5/714: dwrite d0/d6/d9/db1/fd0 [0,4194304] 0 2023-10-18T20:58:38.796 INFO:tasks.workunit.client.1.smithi060.stdout:2/671: mkdir d0/d45/dc9/d68/de1 0 2023-10-18T20:58:38.796 INFO:tasks.workunit.client.1.smithi060.stdout:2/672: truncate d0/d8/d47/fdf 806488 0 2023-10-18T20:58:38.797 INFO:tasks.workunit.client.1.smithi060.stdout:5/715: creat d0/d6/d9/d82/d84/db2/db8/f109 x:0 0 0 2023-10-18T20:58:38.798 INFO:tasks.workunit.client.1.smithi060.stdout:5/716: write d0/d6/d8/f44 [2984280,110744] 0 2023-10-18T20:58:38.798 INFO:tasks.workunit.client.1.smithi060.stdout:5/717: dread - d0/da/d3b/d64/fa9 zero size 2023-10-18T20:58:38.799 INFO:tasks.workunit.client.1.smithi060.stdout:5/718: mknod d0/d6/d9/d82/d84/db2/db8/c10a 0 2023-10-18T20:58:38.799 INFO:tasks.workunit.client.1.smithi060.stdout:5/719: write d0/d6/d9/d82/d84/db2/db8/f109 [179514,67477] 0 2023-10-18T20:58:38.811 INFO:tasks.workunit.client.1.smithi060.stdout:6/700: dwrite d10/d17/d28/f24 [0,4194304] 0 2023-10-18T20:58:38.813 INFO:tasks.workunit.client.1.smithi060.stdout:6/701: getdents d10/d25 0 2023-10-18T20:58:38.813 INFO:tasks.workunit.client.1.smithi060.stdout:5/720: getdents d0/d6/d9/d82/d84/db2/db8 0 2023-10-18T20:58:38.814 INFO:tasks.workunit.client.1.smithi060.stdout:5/721: chown d0/da/d3b/fc6 718417893 1 2023-10-18T20:58:38.815 INFO:tasks.workunit.client.1.smithi060.stdout:6/702: rename d10/d25/d3c/l40 to d10/d25/d3c/dd5/dd6/ldc 0 2023-10-18T20:58:38.815 INFO:tasks.workunit.client.1.smithi060.stdout:6/703: fsync d10/d2e/d75/dc7/fcf 0 2023-10-18T20:58:38.820 INFO:tasks.workunit.client.1.smithi060.stdout:6/704: unlink d10/d2e/d75/dc4/l83 0 2023-10-18T20:58:38.824 INFO:tasks.workunit.client.1.smithi060.stdout:6/705: stat d10/d47/fa3 0 2023-10-18T20:58:38.837 INFO:tasks.workunit.client.0.smithi008.stdout:4/491: unlink d0/d17/d5b/l47 0 2023-10-18T20:58:38.856 INFO:tasks.workunit.client.0.smithi008.stdout:6/580: unlink df/d19/f20 0 2023-10-18T20:58:38.857 INFO:tasks.workunit.client.0.smithi008.stdout:6/581: truncate df/d15/d27/fb5 527915 0 2023-10-18T20:58:38.857 INFO:tasks.workunit.client.1.smithi060.stdout:3/611: dwrite d0/d22/d50/fd5 [0,4194304] 0 2023-10-18T20:58:38.858 INFO:tasks.workunit.client.1.smithi060.stdout:3/612: dread - d0/d5e/fd4 zero size 2023-10-18T20:58:38.860 INFO:tasks.workunit.client.0.smithi008.stdout:9/498: creat d2/dc/d3d/f8d x:0 0 0 2023-10-18T20:58:38.862 INFO:tasks.workunit.client.0.smithi008.stdout:8/669: mkdir d5/d8/df/df0 0 2023-10-18T20:58:38.863 INFO:tasks.workunit.client.0.smithi008.stdout:9/499: mknod d2/d64/c8e 0 2023-10-18T20:58:38.864 INFO:tasks.workunit.client.0.smithi008.stdout:9/500: chown d2/dc/l32 4607179 1 2023-10-18T20:58:38.864 INFO:tasks.workunit.client.0.smithi008.stdout:9/501: readlink d2/ld 0 2023-10-18T20:58:38.864 INFO:tasks.workunit.client.0.smithi008.stdout:9/502: dread - d2/dc/d1a/d61/d59/f5d zero size 2023-10-18T20:58:38.865 INFO:tasks.workunit.client.0.smithi008.stdout:1/635: mknod d9/de/df/d17/d1e/d3c/d90/cbe 0 2023-10-18T20:58:38.865 INFO:tasks.workunit.client.0.smithi008.stdout:1/636: chown d9/de/df/d17/d55/cb9 0 1 2023-10-18T20:58:38.867 INFO:tasks.workunit.client.0.smithi008.stdout:3/486: symlink d0/d3/d42/d52/l9c 0 2023-10-18T20:58:38.867 INFO:tasks.workunit.client.0.smithi008.stdout:3/487: chown d0/d3/de/d13/d35/l8a 13258725 1 2023-10-18T20:58:38.870 INFO:tasks.workunit.client.1.smithi060.stdout:2/673: dwrite d0/d8/f2c [0,4194304] 0 2023-10-18T20:58:38.870 INFO:tasks.workunit.client.1.smithi060.stdout:2/674: dread - d0/fd4 zero size 2023-10-18T20:58:38.870 INFO:tasks.workunit.client.0.smithi008.stdout:0/442: creat d0/dd/d19/d24/f88 x:0 0 0 2023-10-18T20:58:38.876 INFO:tasks.workunit.client.1.smithi060.stdout:9/585: sync 2023-10-18T20:58:38.876 INFO:tasks.workunit.client.1.smithi060.stdout:1/766: sync 2023-10-18T20:58:38.877 INFO:tasks.workunit.client.1.smithi060.stdout:7/705: sync 2023-10-18T20:58:38.877 INFO:tasks.workunit.client.1.smithi060.stdout:3/613: dread d0/f24 [4194304,4194304] 0 2023-10-18T20:58:38.879 INFO:tasks.workunit.client.1.smithi060.stdout:6/706: dread d10/d47/f91 [0,4194304] 0 2023-10-18T20:58:38.879 INFO:tasks.workunit.client.0.smithi008.stdout:5/527: mkdir d0/d2/d19/d7c/d31/d3f/d70/dc0 0 2023-10-18T20:58:38.880 INFO:tasks.workunit.client.0.smithi008.stdout:8/670: unlink d5/d8/df/d2e/f8a 0 2023-10-18T20:58:38.880 INFO:tasks.workunit.client.0.smithi008.stdout:6/582: read df/d15/d27/f28 [1652720,21044] 0 2023-10-18T20:58:38.880 INFO:tasks.workunit.client.0.smithi008.stdout:8/671: fsync d5/d8/df/d9d/d4d/dba/dd4/fa2 0 2023-10-18T20:58:38.881 INFO:tasks.workunit.client.1.smithi060.stdout:3/614: symlink d0/d22/d26/d2b/ldb 0 2023-10-18T20:58:38.881 INFO:tasks.workunit.client.1.smithi060.stdout:3/615: creat d0/d22/d26/d29/fdc x:0 0 0 2023-10-18T20:58:38.882 INFO:tasks.workunit.client.1.smithi060.stdout:3/616: chown d0/d22/d26/fc1 199588944 1 2023-10-18T20:58:38.883 INFO:tasks.workunit.client.0.smithi008.stdout:9/503: symlink d2/dc/d17/d7b/l8f 0 2023-10-18T20:58:38.883 INFO:tasks.workunit.client.0.smithi008.stdout:9/504: fsync d2/dc/d40/d6f/f80 0 2023-10-18T20:58:38.883 INFO:tasks.workunit.client.0.smithi008.stdout:7/576: rmdir d1/d36/d3d/d3e/d59/d73 39 2023-10-18T20:58:38.883 INFO:tasks.workunit.client.0.smithi008.stdout:2/545: creat d1/d3/dd/d1c/d3a/d45/d83/fb0 x:0 0 0 2023-10-18T20:58:38.885 INFO:tasks.workunit.client.0.smithi008.stdout:0/443: dread - d0/dd/df/d2a/f6f zero size 2023-10-18T20:58:38.885 INFO:tasks.workunit.client.0.smithi008.stdout:0/444: read d0/dd/d19/d24/f5a [209199,6096] 0 2023-10-18T20:58:38.886 INFO:tasks.workunit.client.1.smithi060.stdout:7/706: rename de/d29/d9c/ld7 to de/le6 0 2023-10-18T20:58:38.886 INFO:tasks.workunit.client.1.smithi060.stdout:7/707: chown de/d14/d2f/d8f/d5b/d9e 118903342 1 2023-10-18T20:58:38.887 INFO:tasks.workunit.client.1.smithi060.stdout:2/675: creat d0/d16/dc8/fe2 x:0 0 0 2023-10-18T20:58:38.888 INFO:tasks.workunit.client.0.smithi008.stdout:9/505: mkdir d2/d64/d90 0 2023-10-18T20:58:38.892 INFO:tasks.workunit.client.1.smithi060.stdout:5/722: dwrite d0/d47/f8d [0,4194304] 0 2023-10-18T20:58:38.893 INFO:tasks.workunit.client.1.smithi060.stdout:5/723: dread - d0/da/d3b/fbe zero size 2023-10-18T20:58:38.893 INFO:tasks.workunit.client.0.smithi008.stdout:6/583: symlink df/d13/d53/d64/lc5 0 2023-10-18T20:58:38.893 INFO:tasks.workunit.client.0.smithi008.stdout:6/584: symlink df/d13/d53/d64/lc6 0 2023-10-18T20:58:38.893 INFO:tasks.workunit.client.0.smithi008.stdout:6/585: chown df/d13/d53/d64/c89 11491 1 2023-10-18T20:58:38.894 INFO:tasks.workunit.client.0.smithi008.stdout:6/586: dread - df/d15/d48/d81/f96 zero size 2023-10-18T20:58:38.894 INFO:tasks.workunit.client.0.smithi008.stdout:6/587: truncate df/d15/f16 4797576 0 2023-10-18T20:58:38.898 INFO:tasks.workunit.client.1.smithi060.stdout:3/617: truncate d0/f4e 1681938 0 2023-10-18T20:58:38.908 INFO:tasks.workunit.client.0.smithi008.stdout:2/546: read d1/d3/dd/d25/d76/f3f [3368500,96640] 0 2023-10-18T20:58:38.911 INFO:tasks.workunit.client.0.smithi008.stdout:2/547: symlink d1/lb1 0 2023-10-18T20:58:38.914 INFO:tasks.workunit.client.1.smithi060.stdout:7/708: rename l4 to de/d14/d49/d68/d7d/le7 0 2023-10-18T20:58:38.914 INFO:tasks.workunit.client.1.smithi060.stdout:2/676: fsync d0/d8/fd 0 2023-10-18T20:58:38.914 INFO:tasks.workunit.client.1.smithi060.stdout:7/709: chown de/d29/d9c/db1/fd6 64147252 1 2023-10-18T20:58:38.914 INFO:tasks.workunit.client.1.smithi060.stdout:7/710: truncate de/d29/d9c/db1/fd6 890030 0 2023-10-18T20:58:38.915 INFO:tasks.workunit.client.1.smithi060.stdout:2/677: truncate d0/d3/d27/d4d/d5e/fa2 819877 0 2023-10-18T20:58:38.915 INFO:tasks.workunit.client.1.smithi060.stdout:5/724: rename d0/da/dc8/de4/c8c to d0/da/dc8/de4/c10b 0 2023-10-18T20:58:38.915 INFO:tasks.workunit.client.1.smithi060.stdout:5/725: fdatasync d0/f5f 0 2023-10-18T20:58:38.915 INFO:tasks.workunit.client.1.smithi060.stdout:2/678: fsync d0/d8/d47/f4b 0 2023-10-18T20:58:38.916 INFO:tasks.workunit.client.0.smithi008.stdout:7/577: creat d1/d36/d3d/d3e/d59/d73/fb8 x:0 0 0 2023-10-18T20:58:38.916 INFO:tasks.workunit.client.0.smithi008.stdout:5/528: dread d0/f1c [0,4194304] 0 2023-10-18T20:58:38.916 INFO:tasks.workunit.client.1.smithi060.stdout:3/618: symlink d0/d22/d26/d2c/ldd 0 2023-10-18T20:58:38.917 INFO:tasks.workunit.client.0.smithi008.stdout:1/637: dwrite d9/de/df/d77/faf [0,4194304] 0 2023-10-18T20:58:38.917 INFO:tasks.workunit.client.0.smithi008.stdout:1/638: readlink d9/de/df/d85/l96 0 2023-10-18T20:58:38.917 INFO:tasks.workunit.client.0.smithi008.stdout:7/578: getdents d1/da6/d4f/d87 0 2023-10-18T20:58:38.918 INFO:tasks.workunit.client.0.smithi008.stdout:5/529: mkdir d0/d6e/dc1 0 2023-10-18T20:58:38.921 INFO:tasks.workunit.client.0.smithi008.stdout:7/579: mknod d1/d3/d20/d5f/d7f/cb9 0 2023-10-18T20:58:38.923 INFO:tasks.workunit.client.0.smithi008.stdout:7/580: unlink d1/d3/d20/c69 0 2023-10-18T20:58:38.927 INFO:tasks.workunit.client.1.smithi060.stdout:1/767: dwrite d4/da/d42/f64 [0,4194304] 0 2023-10-18T20:58:38.929 INFO:tasks.workunit.client.1.smithi060.stdout:7/711: mknod de/d14/d49/d68/d88/ce8 0 2023-10-18T20:58:38.929 INFO:tasks.workunit.client.1.smithi060.stdout:7/712: dread - de/d14/d2f/d3f/d5a/d5f/fe4 zero size 2023-10-18T20:58:38.929 INFO:tasks.workunit.client.1.smithi060.stdout:7/713: chown de/d14/d49/d68/f40 17214330 1 2023-10-18T20:58:38.930 INFO:tasks.workunit.client.0.smithi008.stdout:7/581: mkdir d1/d3/d20/d5f/dba 0 2023-10-18T20:58:38.930 INFO:tasks.workunit.client.0.smithi008.stdout:2/548: rmdir d1/d3/d40/d72 0 2023-10-18T20:58:38.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.927+0000 7f17ff59e700 1 -- 172.21.15.8:0/1876909086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f8097750 msgr2=0x7f17f8099ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:38.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.927+0000 7f17ff59e700 1 --2- 172.21.15.8:0/1876909086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f8097750 0x7f17f8099ba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f17e8008b50 tx=0x7f17e800df40).stop 2023-10-18T20:58:38.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.928+0000 7f17ff59e700 1 -- 172.21.15.8:0/1876909086 shutdown_connections 2023-10-18T20:58:38.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.928+0000 7f17ff59e700 1 --2- 172.21.15.8:0/1876909086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f8097750 0x7f17f8099ba0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:38.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.928+0000 7f17ff59e700 1 --2- 172.21.15.8:0/1876909086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f8006630 0x7f17f80971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:38.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.928+0000 7f17ff59e700 1 -- 172.21.15.8:0/1876909086 >> 172.21.15.8:0/1876909086 conn(0x7f17f808ec30 msgr2=0x7f17f8091070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:38.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.928+0000 7f17ff59e700 1 -- 172.21.15.8:0/1876909086 shutdown_connections 2023-10-18T20:58:38.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.928+0000 7f17ff59e700 1 -- 172.21.15.8:0/1876909086 wait complete. 2023-10-18T20:58:38.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.930+0000 7f17ff59e700 1 Processor -- start 2023-10-18T20:58:38.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.930+0000 7f17ff59e700 1 -- start start 2023-10-18T20:58:38.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.931+0000 7f17ff59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f8006630 0x7f17f80b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:38.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.931+0000 7f17ff59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f8097750 0x7f17f80b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:38.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.931+0000 7f17ff59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80b45d0 con 0x7f17f8006630 2023-10-18T20:58:38.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.931+0000 7f17ff59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80b4710 con 0x7f17f8097750 2023-10-18T20:58:38.937 INFO:tasks.workunit.client.0.smithi008.stdout:2/549: truncate d1/d3/dd/d1c/d3a/d45/f84 1681247 0 2023-10-18T20:58:38.937 INFO:tasks.workunit.client.0.smithi008.stdout:2/550: chown d1/d3/dd/d1c/d3a/d45/d83/c8b 22 1 2023-10-18T20:58:38.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.932+0000 7f17fdd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f8097750 0x7f17f80b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:38.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.932+0000 7f17fe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f8006630 0x7f17f80b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:38.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.932+0000 7f17fe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f8006630 0x7f17f80b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50970/0 (socket says 172.21.15.8:50970) 2023-10-18T20:58:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.932+0000 7f17fe59c700 1 -- 172.21.15.8:0/695216697 learned_addr learned my addr 172.21.15.8:0/695216697 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.933+0000 7f17fe59c700 1 -- 172.21.15.8:0/695216697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f8097750 msgr2=0x7f17f80b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.933+0000 7f17fe59c700 1 --2- 172.21.15.8:0/695216697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f8097750 0x7f17f80b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.933+0000 7f17fe59c700 1 -- 172.21.15.8:0/695216697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8005040 con 0x7f17f8006630 2023-10-18T20:58:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.934+0000 7f17fe59c700 1 --2- 172.21.15.8:0/695216697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f8006630 0x7f17f80b3b30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f17f000e7f0 tx=0x7f17f000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:38.940 INFO:tasks.workunit.client.1.smithi060.stdout:2/679: mkdir d0/d16/d85/de3 0 2023-10-18T20:58:38.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.935+0000 7f17f6ffd700 1 -- 172.21.15.8:0/695216697 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17f00092e0 con 0x7f17f8006630 2023-10-18T20:58:38.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.935+0000 7f17f6ffd700 1 -- 172.21.15.8:0/695216697 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f17f000f040 con 0x7f17f8006630 2023-10-18T20:58:38.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.935+0000 7f17f6ffd700 1 -- 172.21.15.8:0/695216697 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17f00147e0 con 0x7f17f8006630 2023-10-18T20:58:38.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.936+0000 7f17ff59e700 1 -- 172.21.15.8:0/695216697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f80b91b0 con 0x7f17f8006630 2023-10-18T20:58:38.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.936+0000 7f17ff59e700 1 -- 172.21.15.8:0/695216697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f80b9770 con 0x7f17f8006630 2023-10-18T20:58:38.942 INFO:tasks.workunit.client.0.smithi008.stdout:7/582: dread d1/da6/f6f [0,4194304] 0 2023-10-18T20:58:38.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.938+0000 7f17ff59e700 1 -- 172.21.15.8:0/695216697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f809ab70 con 0x7f17f8006630 2023-10-18T20:58:38.945 INFO:tasks.workunit.client.1.smithi060.stdout:1/768: mknod d4/da/de0/de9/cf3 0 2023-10-18T20:58:38.945 INFO:tasks.workunit.client.0.smithi008.stdout:3/488: link d0/d3/de/d13/l3c d0/d3/d42/l9d 0 2023-10-18T20:58:38.945 INFO:tasks.workunit.client.0.smithi008.stdout:3/489: write d0/d3/d42/d52/f6b [648367,69835] 0 2023-10-18T20:58:38.946 INFO:tasks.workunit.client.0.smithi008.stdout:3/490: write d0/d3/de/d13/d35/f47 [391914,72492] 0 2023-10-18T20:58:38.947 INFO:tasks.workunit.client.0.smithi008.stdout:3/491: fdatasync d0/d3/de/d13/d35/d51/f8d 0 2023-10-18T20:58:38.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.940+0000 7f17f6ffd700 1 -- 172.21.15.8:0/695216697 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 77192+0+0 (secure 0 0 0) 0x7f17f001b030 con 0x7f17f8006630 2023-10-18T20:58:38.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.942+0000 7f17f6ffd700 1 --2- 172.21.15.8:0/695216697 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17ec061020 0x7f17ec0634e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:38.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.942+0000 7f17f6ffd700 1 -- 172.21.15.8:0/695216697 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f17f007bea0 con 0x7f17f8006630 2023-10-18T20:58:38.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.944+0000 7f17fdd9b700 1 --2- 172.21.15.8:0/695216697 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17ec061020 0x7f17ec0634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:38.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.946+0000 7f17fdd9b700 1 --2- 172.21.15.8:0/695216697 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17ec061020 0x7f17ec0634e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f17e8004aa0 tx=0x7f17e800f040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:38.950 INFO:tasks.workunit.client.0.smithi008.stdout:2/551: dread d1/d3/dd/d1c/f55 [0,4194304] 0 2023-10-18T20:58:38.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:38.948+0000 7f17f6ffd700 1 -- 172.21.15.8:0/695216697 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7f17f004fd70 con 0x7f17f8006630 2023-10-18T20:58:38.952 INFO:tasks.workunit.client.0.smithi008.stdout:2/552: mkdir d1/d3/dd/d25/db2 0 2023-10-18T20:58:38.952 INFO:tasks.workunit.client.1.smithi060.stdout:9/586: dwrite d3/d99/d1c/d2a/d33/fb1 [0,4194304] 0 2023-10-18T20:58:38.953 INFO:tasks.workunit.client.0.smithi008.stdout:7/583: mknod d1/d3/d20/d5f/cbb 0 2023-10-18T20:58:38.954 INFO:tasks.workunit.client.1.smithi060.stdout:7/714: getdents de/d14/d3a/d46/d73 0 2023-10-18T20:58:38.954 INFO:tasks.workunit.client.0.smithi008.stdout:7/584: fsync d1/d3/d20/d5f/f72 0 2023-10-18T20:58:38.954 INFO:tasks.workunit.client.0.smithi008.stdout:7/585: write d1/d36/d3d/da3/fa9 [498921,126220] 0 2023-10-18T20:58:38.954 INFO:tasks.workunit.client.0.smithi008.stdout:2/553: mkdir d1/d3/d40/d6e/d7e/db3 0 2023-10-18T20:58:38.956 INFO:tasks.workunit.client.0.smithi008.stdout:7/586: creat d1/d3/d20/d5f/d7f/fbc x:0 0 0 2023-10-18T20:58:38.956 INFO:tasks.workunit.client.0.smithi008.stdout:7/587: creat d1/d36/d3d/d3e/d59/d73/fbd x:0 0 0 2023-10-18T20:58:38.956 INFO:tasks.workunit.client.0.smithi008.stdout:7/588: readlink d1/d3/d20/l2b 0 2023-10-18T20:58:38.956 INFO:tasks.workunit.client.0.smithi008.stdout:7/589: chown d1/d36/d3d/fb7 0 1 2023-10-18T20:58:38.957 INFO:tasks.workunit.client.0.smithi008.stdout:2/554: mknod d1/d3/dd/d25/d5c/cb4 0 2023-10-18T20:58:38.959 INFO:tasks.workunit.client.0.smithi008.stdout:7/590: mkdir d1/d3/d20/dbe 0 2023-10-18T20:58:38.960 INFO:tasks.workunit.client.0.smithi008.stdout:2/555: mknod d1/d3/d40/d6e/d7e/cb5 0 2023-10-18T20:58:38.960 INFO:tasks.workunit.client.0.smithi008.stdout:7/591: getdents d1/d3/d20/d54 0 2023-10-18T20:58:38.960 INFO:tasks.workunit.client.0.smithi008.stdout:7/592: dread - d1/d36/d3d/d3e/d59/d73/fb8 zero size 2023-10-18T20:58:38.961 INFO:tasks.workunit.client.0.smithi008.stdout:7/593: write d1/d3/d20/f43 [400323,81806] 0 2023-10-18T20:58:38.971 INFO:tasks.workunit.client.1.smithi060.stdout:7/715: truncate de/d29/d72/f90 648898 0 2023-10-18T20:58:38.972 INFO:tasks.workunit.client.1.smithi060.stdout:7/716: dread - de/d14/d49/da3/fba zero size 2023-10-18T20:58:38.977 INFO:tasks.workunit.client.0.smithi008.stdout:1/639: rmdir d9/de/df/d17/d1e/d9a 39 2023-10-18T20:58:38.981 INFO:tasks.workunit.client.1.smithi060.stdout:9/587: write d3/f4 [673415,36229] 0 2023-10-18T20:58:38.995 INFO:tasks.workunit.client.0.smithi008.stdout:8/672: dwrite d5/d8/df/d9d/d85/db1/fcf [0,4194304] 0 2023-10-18T20:58:38.995 INFO:tasks.workunit.client.0.smithi008.stdout:6/588: dwrite df/d19/f1c [0,4194304] 0 2023-10-18T20:58:39.001 INFO:tasks.workunit.client.0.smithi008.stdout:7/594: dread d1/da6/d4f/f51 [0,4194304] 0 2023-10-18T20:58:39.002 INFO:tasks.workunit.client.0.smithi008.stdout:7/595: write d1/d36/d3d/d3e/d59/f8a [679915,53117] 0 2023-10-18T20:58:39.006 INFO:tasks.workunit.client.1.smithi060.stdout:3/619: dwrite d0/d3c/d3d/d4d/f8e [0,4194304] 0 2023-10-18T20:58:39.011 INFO:tasks.workunit.client.1.smithi060.stdout:2/680: dread d0/d8/f8a [0,4194304] 0 2023-10-18T20:58:39.011 INFO:tasks.workunit.client.1.smithi060.stdout:1/769: dwrite d4/d6/f22 [0,4194304] 0 2023-10-18T20:58:39.025 INFO:tasks.workunit.client.1.smithi060.stdout:2/681: mknod d0/d45/d49/d55/dbf/ce4 0 2023-10-18T20:58:39.033 INFO:tasks.workunit.client.0.smithi008.stdout:0/445: dwrite d0/dd/d19/d24/f3d [0,4194304] 0 2023-10-18T20:58:39.035 INFO:tasks.workunit.client.0.smithi008.stdout:0/446: mkdir d0/dd/d19/d5f/d89 0 2023-10-18T20:58:39.038 INFO:tasks.workunit.client.0.smithi008.stdout:0/447: mkdir d0/d7c/d7f/d8a 0 2023-10-18T20:58:39.038 INFO:tasks.workunit.client.0.smithi008.stdout:2/556: dwrite d1/d3/dd/d1c/f3e [0,4194304] 0 2023-10-18T20:58:39.039 INFO:tasks.workunit.client.1.smithi060.stdout:1/770: mknod d4/d6/d7/d2f/d7b/d2a/d32/d56/daa/cf4 0 2023-10-18T20:58:39.039 INFO:tasks.workunit.client.1.smithi060.stdout:3/620: getdents d0/d3c 0 2023-10-18T20:58:39.059 INFO:tasks.workunit.client.1.smithi060.stdout:2/682: mkdir d0/d3/d27/d4d/d53/de5 0 2023-10-18T20:58:39.079 INFO:tasks.workunit.client.0.smithi008.stdout:3/492: dwrite d0/d3/d42/d52/f6b [0,4194304] 0 2023-10-18T20:58:39.080 INFO:tasks.workunit.client.0.smithi008.stdout:3/493: write d0/f62 [3557734,63407] 0 2023-10-18T20:58:39.080 INFO:tasks.workunit.client.0.smithi008.stdout:3/494: write d0/d84/f90 [659961,77135] 0 2023-10-18T20:58:39.082 INFO:tasks.workunit.client.1.smithi060.stdout:1/771: creat d4/d6/d7/d2f/ff5 x:0 0 0 2023-10-18T20:58:39.084 INFO:tasks.workunit.client.1.smithi060.stdout:7/717: dwrite de/d14/dd2/fe1 [0,4194304] 0 2023-10-18T20:58:39.085 INFO:tasks.workunit.client.1.smithi060.stdout:3/621: symlink d0/d3c/lde 0 2023-10-18T20:58:39.086 INFO:tasks.workunit.client.0.smithi008.stdout:3/495: creat d0/d3/de/f9e x:0 0 0 2023-10-18T20:58:39.087 INFO:tasks.workunit.client.1.smithi060.stdout:2/683: mkdir d0/d45/dc9/de6 0 2023-10-18T20:58:39.087 INFO:tasks.workunit.client.1.smithi060.stdout:2/684: write d0/d16/d81/fd3 [149684,94751] 0 2023-10-18T20:58:39.089 INFO:tasks.workunit.client.1.smithi060.stdout:1/772: truncate d4/d6/d7/df/f40 710364 0 2023-10-18T20:58:39.090 INFO:tasks.workunit.client.0.smithi008.stdout:3/496: read d0/d4a/d64/f7e [563245,29104] 0 2023-10-18T20:58:39.091 INFO:tasks.workunit.client.1.smithi060.stdout:7/718: symlink de/d14/d2f/d8f/d5b/le9 0 2023-10-18T20:58:39.093 INFO:tasks.workunit.client.1.smithi060.stdout:2/685: link d0/d45/d49/c3b d0/d3/d27/d4d/d53/ce7 0 2023-10-18T20:58:39.094 INFO:tasks.workunit.client.1.smithi060.stdout:1/773: symlink d4/d6/d7/d2f/d7b/d2a/d32/dd/lf6 0 2023-10-18T20:58:39.097 INFO:tasks.workunit.client.1.smithi060.stdout:3/622: rename d0/d3c/c46 to d0/d22/d26/d2b/cdf 0 2023-10-18T20:58:39.097 INFO:tasks.workunit.client.1.smithi060.stdout:3/623: fsync d0/f24 0 2023-10-18T20:58:39.098 INFO:tasks.workunit.client.1.smithi060.stdout:2/686: mknod d0/d3/d27/d4d/d53/de5/ce8 0 2023-10-18T20:58:39.099 INFO:tasks.workunit.client.1.smithi060.stdout:1/774: symlink d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/lf7 0 2023-10-18T20:58:39.105 INFO:tasks.workunit.client.0.smithi008.stdout:7/596: dwrite d1/da6/d79/f4a [0,4194304] 0 2023-10-18T20:58:39.105 INFO:tasks.workunit.client.0.smithi008.stdout:7/597: readlink d1/d3/le 0 2023-10-18T20:58:39.107 INFO:tasks.workunit.client.1.smithi060.stdout:1/775: mkdir d4/d6/d7/d2f/d7b/dda/df8 0 2023-10-18T20:58:39.108 INFO:tasks.workunit.client.1.smithi060.stdout:3/624: rename d0/d22/d26/d2b/l51 to d0/d3c/d3d/d4d/d95/dc9/le0 0 2023-10-18T20:58:39.110 INFO:tasks.workunit.client.1.smithi060.stdout:3/625: stat d0/d22/d26/d2c/da0/lb1 0 2023-10-18T20:58:39.110 INFO:tasks.workunit.client.1.smithi060.stdout:3/626: creat d0/d3c/d3d/d82/fe1 x:0 0 0 2023-10-18T20:58:39.110 INFO:tasks.workunit.client.1.smithi060.stdout:7/719: dread de/d14/d49/d68/f21 [0,4194304] 0 2023-10-18T20:58:39.117 INFO:tasks.workunit.client.1.smithi060.stdout:9/588: dwrite d3/d99/d1c/d5a/d5d/f78 [0,4194304] 0 2023-10-18T20:58:39.118 INFO:tasks.workunit.client.0.smithi008.stdout:2/557: dwrite d1/d3/dd/d1c/f96 [0,4194304] 0 2023-10-18T20:58:39.118 INFO:tasks.workunit.client.0.smithi008.stdout:2/558: fsync d1/d3/dd/d25/d76/d59/fa6 0 2023-10-18T20:58:39.119 INFO:tasks.workunit.client.0.smithi008.stdout:2/559: chown d1/d3/dd/f6f 121 1 2023-10-18T20:58:39.119 INFO:tasks.workunit.client.0.smithi008.stdout:2/560: chown d1/d3/dd/d1c/f3c 1130612289 1 2023-10-18T20:58:39.120 INFO:tasks.workunit.client.0.smithi008.stdout:2/561: write d1/d3/dd/d1c/d3a/d45/f75 [785501,34719] 0 2023-10-18T20:58:39.121 INFO:tasks.workunit.client.0.smithi008.stdout:2/562: mknod d1/d3/dd/d25/d76/d59/d85/cb6 0 2023-10-18T20:58:39.122 INFO:tasks.workunit.client.0.smithi008.stdout:1/640: dwrite d9/de/df/d17/d25/d57/f87 [0,4194304] 0 2023-10-18T20:58:39.123 INFO:tasks.workunit.client.1.smithi060.stdout:7/720: write de/d38/fad [5513538,2886] 0 2023-10-18T20:58:39.123 INFO:tasks.workunit.client.1.smithi060.stdout:7/721: readlink de/d14/l61 0 2023-10-18T20:58:39.124 INFO:tasks.workunit.client.0.smithi008.stdout:8/673: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/f99 [0,4194304] 0 2023-10-18T20:58:39.124 INFO:tasks.workunit.client.0.smithi008.stdout:6/589: dwrite df/d36/f62 [0,4194304] 0 2023-10-18T20:58:39.125 INFO:tasks.workunit.client.1.smithi060.stdout:1/776: write d4/d6/f1f [7610086,29791] 0 2023-10-18T20:58:39.125 INFO:tasks.workunit.client.1.smithi060.stdout:1/777: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/fd0 20 1 2023-10-18T20:58:39.125 INFO:tasks.workunit.client.1.smithi060.stdout:1/778: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/ff0 0 1 2023-10-18T20:58:39.127 INFO:tasks.workunit.client.1.smithi060.stdout:9/589: link d3/d99/d65/lae d3/d99/d1c/d2a/d80/da0/ldc 0 2023-10-18T20:58:39.128 INFO:tasks.workunit.client.0.smithi008.stdout:0/448: dwrite d0/d7c/f81 [0,4194304] 0 2023-10-18T20:58:39.133 INFO:tasks.workunit.client.1.smithi060.stdout:3/627: dread d0/d22/d26/d2c/f31 [0,4194304] 0 2023-10-18T20:58:39.136 INFO:tasks.workunit.client.1.smithi060.stdout:1/779: symlink d4/da/de0/de9/lf9 0 2023-10-18T20:58:39.141 INFO:tasks.workunit.client.1.smithi060.stdout:7/722: dread de/d14/d2f/f87 [0,4194304] 0 2023-10-18T20:58:39.141 INFO:tasks.workunit.client.1.smithi060.stdout:7/723: write de/d14/d2f/d8f/d5b/f7a [777146,104597] 0 2023-10-18T20:58:39.142 INFO:tasks.workunit.client.1.smithi060.stdout:1/780: read d4/d6/d7/df/f6b [325038,107702] 0 2023-10-18T20:58:39.143 INFO:tasks.workunit.client.1.smithi060.stdout:9/590: mkdir d3/d99/d1c/d2a/d80/da0/ddd 0 2023-10-18T20:58:39.143 INFO:tasks.workunit.client.1.smithi060.stdout:9/591: chown d3/d58/f7b 462732 1 2023-10-18T20:58:39.143 INFO:tasks.workunit.client.1.smithi060.stdout:9/592: write d3/d99/d65/f81 [227904,122883] 0 2023-10-18T20:58:39.144 INFO:tasks.workunit.client.1.smithi060.stdout:9/593: write d3/d99/d1c/d2a/d33/f85 [3013526,70119] 0 2023-10-18T20:58:39.144 INFO:tasks.workunit.client.1.smithi060.stdout:9/594: dread - d3/d99/d1c/d5a/d5d/d7d/fad zero size 2023-10-18T20:58:39.145 INFO:tasks.workunit.client.0.smithi008.stdout:7/598: write d1/da6/d79/f4a [2240588,111781] 0 2023-10-18T20:58:39.145 INFO:tasks.workunit.client.0.smithi008.stdout:7/599: write d1/da6/d79/f71 [114982,24160] 0 2023-10-18T20:58:39.146 INFO:tasks.workunit.client.0.smithi008.stdout:1/641: dread d9/f54 [0,4194304] 0 2023-10-18T20:58:39.150 INFO:tasks.workunit.client.1.smithi060.stdout:3/628: creat d0/d22/d26/d79/db3/fe2 x:0 0 0 2023-10-18T20:58:39.150 INFO:tasks.workunit.client.1.smithi060.stdout:3/629: fsync d0/d22/f36 0 2023-10-18T20:58:39.153 INFO:tasks.workunit.client.0.smithi008.stdout:3/497: dwrite d0/d3/de/d13/f49 [0,4194304] 0 2023-10-18T20:58:39.160 INFO:tasks.workunit.client.0.smithi008.stdout:7/600: dread d1/d3/d20/d5f/d7f/f9a [0,4194304] 0 2023-10-18T20:58:39.160 INFO:tasks.workunit.client.0.smithi008.stdout:7/601: write d1/d3/d20/d5f/f72 [4979387,61761] 0 2023-10-18T20:58:39.161 INFO:tasks.workunit.client.0.smithi008.stdout:7/602: getdents d1/d3/d20/d5f/d78/da2 0 2023-10-18T20:58:39.162 INFO:tasks.workunit.client.1.smithi060.stdout:7/724: unlink de/d29/f22 0 2023-10-18T20:58:39.163 INFO:tasks.workunit.client.1.smithi060.stdout:1/781: creat d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/ffa x:0 0 0 2023-10-18T20:58:39.166 INFO:tasks.workunit.client.1.smithi060.stdout:7/725: link de/d14/d3a/c48 de/d14/d2f/cea 0 2023-10-18T20:58:39.168 INFO:tasks.workunit.client.1.smithi060.stdout:7/726: symlink de/d14/d3a/d46/dab/leb 0 2023-10-18T20:58:39.176 INFO:tasks.workunit.client.1.smithi060.stdout:7/727: creat de/d14/d2f/d7b/fec x:0 0 0 2023-10-18T20:58:39.177 INFO:tasks.workunit.client.1.smithi060.stdout:7/728: stat de/d14/d49/d68/d7d 0 2023-10-18T20:58:39.177 INFO:tasks.workunit.client.1.smithi060.stdout:1/782: write d4/d6/d7/d2f/d7b/d2a/d32/dd/f4f [1403346,112901] 0 2023-10-18T20:58:39.177 INFO:tasks.workunit.client.1.smithi060.stdout:1/783: fdatasync d4/d38/f7f 0 2023-10-18T20:58:39.182 INFO:tasks.workunit.client.1.smithi060.stdout:1/784: mknod d4/d38/cfb 0 2023-10-18T20:58:39.185 INFO:tasks.workunit.client.1.smithi060.stdout:1/785: rename d4/da/l17 to d4/d6/d33/lfc 0 2023-10-18T20:58:39.191 INFO:tasks.workunit.client.1.smithi060.stdout:9/595: dwrite d3/d99/d1c/d5a/f8b [0,4194304] 0 2023-10-18T20:58:39.197 INFO:tasks.workunit.client.1.smithi060.stdout:9/596: rename f0 to d3/d99/d1c/d25/fde 0 2023-10-18T20:58:39.231 INFO:tasks.workunit.client.0.smithi008.stdout:2/563: mknod d1/d3/dd/d25/db2/cb7 0 2023-10-18T20:58:39.232 INFO:tasks.workunit.client.1.smithi060.stdout:9/597: dread d3/d99/d1c/d5a/d5d/d7d/f89 [4194304,4194304] 0 2023-10-18T20:58:39.232 INFO:tasks.workunit.client.1.smithi060.stdout:9/598: write d3/d99/d1c/d25/f4b [3397033,126581] 0 2023-10-18T20:58:39.233 INFO:tasks.workunit.client.1.smithi060.stdout:9/599: chown d3/d99/f3c 66374071 1 2023-10-18T20:58:39.234 INFO:tasks.workunit.client.0.smithi008.stdout:8/674: rename c3 to d5/d8/df/d9d/d6c/cf1 0 2023-10-18T20:58:39.234 INFO:tasks.workunit.client.0.smithi008.stdout:8/675: fdatasync d5/d8/df/d2e/f7b 0 2023-10-18T20:58:39.234 INFO:tasks.workunit.client.1.smithi060.stdout:7/729: dwrite de/d29/d72/fa8 [0,4194304] 0 2023-10-18T20:58:39.235 INFO:tasks.workunit.client.1.smithi060.stdout:7/730: creat de/d14/fed x:0 0 0 2023-10-18T20:58:39.235 INFO:tasks.workunit.client.1.smithi060.stdout:7/731: chown de/d14/d49/d68/d7d/d7e/fc2 1853984 1 2023-10-18T20:58:39.235 INFO:tasks.workunit.client.1.smithi060.stdout:7/732: rename de to de/d14/d2f/d8f/dee 22 2023-10-18T20:58:39.235 INFO:tasks.workunit.client.1.smithi060.stdout:9/600: symlink d3/d99/d1c/d5a/ldf 0 2023-10-18T20:58:39.236 INFO:tasks.workunit.client.1.smithi060.stdout:1/786: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/fde [0,4194304] 0 2023-10-18T20:58:39.236 INFO:tasks.workunit.client.0.smithi008.stdout:6/590: mknod df/d18/d68/cc7 0 2023-10-18T20:58:39.237 INFO:tasks.workunit.client.0.smithi008.stdout:6/591: chown df/d18/d3f/f79 33003144 1 2023-10-18T20:58:39.237 INFO:tasks.workunit.client.0.smithi008.stdout:0/449: truncate d0/dd/d19/d24/f3d 173586 0 2023-10-18T20:58:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:37.883816+0000 mon.smithi008 (mon.0) 650 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:39.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:38.114175+0000 mgr.smithi008.flmjzp (mgr.14640) 6 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 2.5 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 124 MiB/s rd, 161 MiB/s wr, 245 op/s 2023-10-18T20:58:39.238 INFO:tasks.workunit.client.1.smithi060.stdout:9/601: mkdir d3/d99/d1c/d2a/d80/da0/dc2/de0 0 2023-10-18T20:58:39.238 INFO:tasks.workunit.client.1.smithi060.stdout:9/602: dread - d3/d99/d65/fd6 zero size 2023-10-18T20:58:39.243 INFO:tasks.workunit.client.0.smithi008.stdout:7/603: symlink d1/d36/d3d/lbf 0 2023-10-18T20:58:39.243 INFO:tasks.workunit.client.0.smithi008.stdout:7/604: write d1/d36/d3d/d3e/fb0 [293935,71544] 0 2023-10-18T20:58:39.243 INFO:tasks.workunit.client.0.smithi008.stdout:7/605: chown d1/da6/d4f/f51 339554888 1 2023-10-18T20:58:39.244 INFO:tasks.workunit.client.0.smithi008.stdout:3/498: unlink d0/d4a/d64/f6a 0 2023-10-18T20:58:39.249 INFO:tasks.workunit.client.0.smithi008.stdout:7/606: dread d1/d36/d3d/da3/fa9 [0,4194304] 0 2023-10-18T20:58:39.251 INFO:tasks.workunit.client.0.smithi008.stdout:2/564: getdents d1/d3/dd/d25 0 2023-10-18T20:58:39.254 INFO:tasks.workunit.client.0.smithi008.stdout:8/676: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/dc9/ff2 x:0 0 0 2023-10-18T20:58:39.254 INFO:tasks.workunit.client.0.smithi008.stdout:8/677: dread - d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/fe8 zero size 2023-10-18T20:58:39.258 INFO:tasks.workunit.client.0.smithi008.stdout:0/450: creat d0/dd/f8b x:0 0 0 2023-10-18T20:58:39.258 INFO:tasks.workunit.client.0.smithi008.stdout:0/451: chown d0/dd/df/d2a/f80 16382136 1 2023-10-18T20:58:39.260 INFO:tasks.workunit.client.0.smithi008.stdout:6/592: creat df/d13/d53/fc8 x:0 0 0 2023-10-18T20:58:39.261 INFO:tasks.workunit.client.0.smithi008.stdout:3/499: symlink d0/d3/de/d13/l9f 0 2023-10-18T20:58:39.261 INFO:tasks.workunit.client.0.smithi008.stdout:0/452: fsync d0/dd/f27 0 2023-10-18T20:58:39.262 INFO:tasks.workunit.client.0.smithi008.stdout:6/593: mknod df/cc9 0 2023-10-18T20:58:39.262 INFO:tasks.workunit.client.0.smithi008.stdout:6/594: chown df/d15/d27/c29 7776455 1 2023-10-18T20:58:39.263 INFO:tasks.workunit.client.1.smithi060.stdout:7/733: read de/d14/d41/f53 [1125863,41521] 0 2023-10-18T20:58:39.265 INFO:tasks.workunit.client.0.smithi008.stdout:6/595: rmdir df/d18/d58 39 2023-10-18T20:58:39.265 INFO:tasks.workunit.client.0.smithi008.stdout:6/596: chown df/d15/f46 0 1 2023-10-18T20:58:39.267 INFO:tasks.workunit.client.1.smithi060.stdout:7/734: creat de/d14/d49/d68/fef x:0 0 0 2023-10-18T20:58:39.271 INFO:tasks.workunit.client.0.smithi008.stdout:7/607: dread d1/d3/f1d [0,4194304] 0 2023-10-18T20:58:39.271 INFO:tasks.workunit.client.0.smithi008.stdout:3/500: write d0/d3/de/d13/f75 [784353,113756] 0 2023-10-18T20:58:39.279 INFO:tasks.workunit.client.0.smithi008.stdout:0/453: creat d0/f8c x:0 0 0 2023-10-18T20:58:39.283 INFO:tasks.workunit.client.1.smithi060.stdout:7/735: rmdir de/d14 39 2023-10-18T20:58:39.284 INFO:tasks.workunit.client.1.smithi060.stdout:7/736: dread - de/d14/d3a/d46/fd4 zero size 2023-10-18T20:58:39.288 INFO:tasks.workunit.client.1.smithi060.stdout:9/603: dwrite d3/d99/d1c/d2a/d80/da0/dc2/d9e/fce [0,4194304] 0 2023-10-18T20:58:39.288 INFO:tasks.workunit.client.1.smithi060.stdout:9/604: fsync d3/d58/f7b 0 2023-10-18T20:58:39.288 INFO:tasks.workunit.client.1.smithi060.stdout:9/605: fsync f2 0 2023-10-18T20:58:39.288 INFO:tasks.workunit.client.1.smithi060.stdout:9/606: fsync d3/d99/d19/f90 0 2023-10-18T20:58:39.290 INFO:tasks.workunit.client.1.smithi060.stdout:9/607: getdents d3/d99/d1c/d2a/d80/da0 0 2023-10-18T20:58:39.292 INFO:tasks.workunit.client.0.smithi008.stdout:0/454: creat d0/dd/d19/f8d x:0 0 0 2023-10-18T20:58:39.299 INFO:tasks.workunit.client.1.smithi060.stdout:7/737: dread de/f1f [0,4194304] 0 2023-10-18T20:58:39.300 INFO:tasks.workunit.client.1.smithi060.stdout:7/738: truncate de/d29/d72/f90 1018032 0 2023-10-18T20:58:39.307 INFO:tasks.workunit.client.1.smithi060.stdout:7/739: creat de/d14/d2f/d8f/d5b/d9e/ff0 x:0 0 0 2023-10-18T20:58:39.307 INFO:tasks.workunit.client.1.smithi060.stdout:7/740: dread - de/d14/d49/d68/d7d/fe2 zero size 2023-10-18T20:58:39.309 INFO:tasks.workunit.client.1.smithi060.stdout:7/741: creat de/d14/d49/ff1 x:0 0 0 2023-10-18T20:58:39.309 INFO:tasks.workunit.client.1.smithi060.stdout:7/742: dread - de/d14/d3a/d46/d73/faa zero size 2023-10-18T20:58:39.310 INFO:tasks.workunit.client.1.smithi060.stdout:7/743: dread - de/d29/d72/d84/fae zero size 2023-10-18T20:58:39.310 INFO:tasks.workunit.client.1.smithi060.stdout:7/744: write de/d29/d72/d84/fae [1029022,28112] 0 2023-10-18T20:58:39.310 INFO:tasks.workunit.client.1.smithi060.stdout:7/745: read - de/d14/d2f/d8f/d5b/d9e/dac/fcd zero size 2023-10-18T20:58:39.310 INFO:tasks.workunit.client.1.smithi060.stdout:7/746: chown l6 443 1 2023-10-18T20:58:39.310 INFO:tasks.workunit.client.1.smithi060.stdout:7/747: write de/d14/d3a/d46/d73/f82 [1257497,112484] 0 2023-10-18T20:58:39.311 INFO:tasks.workunit.client.1.smithi060.stdout:7/748: symlink de/d14/d41/lf2 0 2023-10-18T20:58:39.313 INFO:tasks.workunit.client.1.smithi060.stdout:7/749: symlink de/d14/d49/d68/d7d/d7e/db5/lf3 0 2023-10-18T20:58:39.313 INFO:tasks.workunit.client.1.smithi060.stdout:9/608: dread d3/d99/d19/f4e [0,4194304] 0 2023-10-18T20:58:39.314 INFO:tasks.workunit.client.1.smithi060.stdout:9/609: write d3/d99/d1c/d5a/d5d/d56/fa7 [341554,81510] 0 2023-10-18T20:58:39.314 INFO:tasks.workunit.client.1.smithi060.stdout:9/610: write d3/d99/d65/fd6 [1024028,55703] 0 2023-10-18T20:58:39.315 INFO:tasks.workunit.client.1.smithi060.stdout:8/613: sync 2023-10-18T20:58:39.315 INFO:tasks.workunit.client.1.smithi060.stdout:8/614: readlink d4/l3f 0 2023-10-18T20:58:39.315 INFO:tasks.workunit.client.1.smithi060.stdout:8/615: write d4/d9/d31/d35/d9f/da3/fa5 [548683,57693] 0 2023-10-18T20:58:39.316 INFO:tasks.workunit.client.1.smithi060.stdout:7/750: creat de/d14/d49/da3/ff4 x:0 0 0 2023-10-18T20:58:39.316 INFO:tasks.workunit.client.1.smithi060.stdout:9/611: truncate d3/d99/d1c/d2a/d80/fb7 1473812 0 2023-10-18T20:58:39.316 INFO:tasks.workunit.client.1.smithi060.stdout:8/616: truncate d4/d9/f79 4132701 0 2023-10-18T20:58:39.316 INFO:tasks.workunit.client.1.smithi060.stdout:8/617: chown d4/d9/d31/d35/d9f 6942 1 2023-10-18T20:58:39.318 INFO:tasks.workunit.client.1.smithi060.stdout:7/751: mknod de/d14/d2f/dca/cf5 0 2023-10-18T20:58:39.319 INFO:tasks.workunit.client.1.smithi060.stdout:9/612: symlink d3/d99/d19/d54/d8f/le1 0 2023-10-18T20:58:39.322 INFO:tasks.workunit.client.1.smithi060.stdout:8/618: mkdir d4/d9/d4f/d74/d81/db8 0 2023-10-18T20:58:39.322 INFO:tasks.workunit.client.1.smithi060.stdout:8/619: write d4/d9/d37/d4e/d6e/d7b/f7d [480219,62857] 0 2023-10-18T20:58:39.323 INFO:tasks.workunit.client.0.smithi008.stdout:2/565: dwrite d1/d3/dd/f38 [0,4194304] 0 2023-10-18T20:58:39.325 INFO:tasks.workunit.client.1.smithi060.stdout:9/613: mkdir d3/d99/d1c/d25/de2 0 2023-10-18T20:58:39.328 INFO:tasks.workunit.client.1.smithi060.stdout:9/614: link d3/d99/d1c/d5a/d5d/f88 d3/d99/d19/d54/d8f/fe3 0 2023-10-18T20:58:39.336 INFO:tasks.workunit.client.1.smithi060.stdout:9/615: unlink d3/d99/d1c/d5a/ldf 0 2023-10-18T20:58:39.337 INFO:tasks.workunit.client.1.smithi060.stdout:9/616: chown d3/d99/d1c/d2a/d33/f83 356784 1 2023-10-18T20:58:39.348 INFO:tasks.workunit.client.1.smithi060.stdout:7/752: dread de/d14/d2f/d8f/d5b/f75 [0,4194304] 0 2023-10-18T20:58:39.348 INFO:tasks.workunit.client.1.smithi060.stdout:7/753: stat de/d14/fed 0 2023-10-18T20:58:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.349+0000 7f17ff59e700 1 -- 172.21.15.8:0/695216697 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17f80b9e60 con 0x7f17ec061020 2023-10-18T20:58:39.357 INFO:tasks.workunit.client.0.smithi008.stdout:7/608: dread d1/da6/d4f/f5e [0,4194304] 0 2023-10-18T20:58:39.359 INFO:tasks.workunit.client.0.smithi008.stdout:8/678: dwrite d5/d8/df/d9d/d4d/f4f [4194304,4194304] 0 2023-10-18T20:58:39.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.353+0000 7f17f6ffd700 1 -- 172.21.15.8:0/695216697 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f17f80b9e60 con 0x7f17ec061020 2023-10-18T20:58:39.362 INFO:tasks.workunit.client.0.smithi008.stdout:8/679: link d5/d8/df/l5f d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/lf3 0 2023-10-18T20:58:39.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.360+0000 7f17ff59e700 1 -- 172.21.15.8:0/695216697 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17ec061020 msgr2=0x7f17ec0634e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:39.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.361+0000 7f17ff59e700 1 --2- 172.21.15.8:0/695216697 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17ec061020 0x7f17ec0634e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f17e8004aa0 tx=0x7f17e800f040).stop 2023-10-18T20:58:39.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.361+0000 7f17ff59e700 1 -- 172.21.15.8:0/695216697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f8006630 msgr2=0x7f17f80b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:39.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.361+0000 7f17ff59e700 1 --2- 172.21.15.8:0/695216697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f8006630 0x7f17f80b3b30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f17f000e7f0 tx=0x7f17f000b040).stop 2023-10-18T20:58:39.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.361+0000 7f17ff59e700 1 -- 172.21.15.8:0/695216697 shutdown_connections 2023-10-18T20:58:39.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.361+0000 7f17ff59e700 1 --2- 172.21.15.8:0/695216697 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17ec061020 0x7f17ec0634e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.361+0000 7f17ff59e700 1 --2- 172.21.15.8:0/695216697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f8006630 0x7f17f80b3b30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.361+0000 7f17ff59e700 1 --2- 172.21.15.8:0/695216697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f8097750 0x7f17f80b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.361+0000 7f17ff59e700 1 -- 172.21.15.8:0/695216697 >> 172.21.15.8:0/695216697 conn(0x7f17f808ec30 msgr2=0x7f17f8091020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:39.367 INFO:tasks.workunit.client.1.smithi060.stdout:9/617: dread d3/d99/d65/f81 [0,4194304] 0 2023-10-18T20:58:39.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.362+0000 7f17ff59e700 1 -- 172.21.15.8:0/695216697 shutdown_connections 2023-10-18T20:58:39.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.362+0000 7f17ff59e700 1 -- 172.21.15.8:0/695216697 wait complete. 2023-10-18T20:58:39.368 INFO:tasks.workunit.client.1.smithi060.stdout:9/618: symlink d3/d99/d1c/d2a/d80/da0/dc2/d9e/le4 0 2023-10-18T20:58:39.368 INFO:tasks.workunit.client.0.smithi008.stdout:8/680: creat d5/d8/df/d9d/d85/ff4 x:0 0 0 2023-10-18T20:58:39.368 INFO:tasks.workunit.client.0.smithi008.stdout:8/681: chown d5/d8/df/d9d/d4d/dba/dd4/f59 2050008373 1 2023-10-18T20:58:39.369 INFO:tasks.workunit.client.0.smithi008.stdout:8/682: dread - d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/fe8 zero size 2023-10-18T20:58:39.371 INFO:tasks.workunit.client.0.smithi008.stdout:8/683: mkdir d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/df5 0 2023-10-18T20:58:39.374 INFO:tasks.workunit.client.1.smithi060.stdout:9/619: rmdir d3/d99/d1c/d25/de2 0 2023-10-18T20:58:39.374 INFO:tasks.workunit.client.0.smithi008.stdout:3/501: dwrite d0/d84/f90 [0,4194304] 0 2023-10-18T20:58:39.375 INFO:tasks.workunit.client.0.smithi008.stdout:3/502: stat d0/d4a/d64/f7c 0 2023-10-18T20:58:39.377 INFO:tasks.workunit.client.0.smithi008.stdout:3/503: mknod d0/d3/d42/d88/ca0 0 2023-10-18T20:58:39.377 INFO:tasks.workunit.client.0.smithi008.stdout:3/504: chown d0/d3/l8f 27 1 2023-10-18T20:58:39.378 INFO:tasks.workunit.client.1.smithi060.stdout:9/620: mknod d3/d99/d1c/d2a/d2d/db9/ce5 0 2023-10-18T20:58:39.378 INFO:tasks.workunit.client.1.smithi060.stdout:9/621: write d3/d99/d1c/d2a/d33/fb5 [591055,19193] 0 2023-10-18T20:58:39.380 INFO:tasks.workunit.client.1.smithi060.stdout:9/622: symlink d3/d99/d19/le6 0 2023-10-18T20:58:39.381 INFO:tasks.workunit.client.0.smithi008.stdout:0/455: write d0/dd/d19/d24/f66 [3322429,88510] 0 2023-10-18T20:58:39.384 INFO:tasks.workunit.client.1.smithi060.stdout:8/620: dwrite d4/d9/d31/da6/fac [0,4194304] 0 2023-10-18T20:58:39.384 INFO:tasks.workunit.client.1.smithi060.stdout:8/621: unlink d4/d9/d37/l3e 0 2023-10-18T20:58:39.385 INFO:tasks.workunit.client.1.smithi060.stdout:8/622: creat d4/d9/d31/d35/d9f/fb9 x:0 0 0 2023-10-18T20:58:39.385 INFO:tasks.workunit.client.1.smithi060.stdout:8/623: chown d4/d9/d31/d35/d9f/da3/l58 84401 1 2023-10-18T20:58:39.386 INFO:tasks.workunit.client.0.smithi008.stdout:3/505: rename d0/d3/d42/l9d to d0/d3/de/d13/la1 0 2023-10-18T20:58:39.386 INFO:tasks.workunit.client.0.smithi008.stdout:3/506: write d0/f54 [1353605,60248] 0 2023-10-18T20:58:39.389 INFO:tasks.workunit.client.0.smithi008.stdout:3/507: mkdir d0/d3/d37/d74/da2 0 2023-10-18T20:58:39.390 INFO:tasks.workunit.client.0.smithi008.stdout:7/609: dread d1/d3/f27 [0,4194304] 0 2023-10-18T20:58:39.390 INFO:tasks.workunit.client.0.smithi008.stdout:7/610: stat d1/d3/d20/c8c 0 2023-10-18T20:58:39.390 INFO:tasks.workunit.client.0.smithi008.stdout:6/597: dwrite df/d18/d7e/fac [0,4194304] 0 2023-10-18T20:58:39.396 INFO:tasks.workunit.client.0.smithi008.stdout:3/508: link d0/d3/d15/f44 d0/d3/fa3 0 2023-10-18T20:58:39.397 INFO:tasks.workunit.client.0.smithi008.stdout:6/598: mknod df/d18/d7e/cca 0 2023-10-18T20:58:39.398 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T20:58:39.400 INFO:tasks.workunit.client.1.smithi060.stdout:8/624: mknod d4/d9/d31/d35/d9f/da3/cba 0 2023-10-18T20:58:39.416 INFO:tasks.workunit.client.1.smithi060.stdout:8/625: rmdir d4/d9/d31/d6f 39 2023-10-18T20:58:39.431 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:37.883816+0000 mon.smithi008 (mon.0) 650 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:39.431 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:38.114175+0000 mgr.smithi008.flmjzp (mgr.14640) 6 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 2.5 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 124 MiB/s rd, 161 MiB/s wr, 245 op/s 2023-10-18T20:58:39.431 INFO:tasks.workunit.client.0.smithi008.stdout:2/566: dwrite d1/d3/dd/f38 [0,4194304] 0 2023-10-18T20:58:39.440 INFO:tasks.workunit.client.1.smithi060.stdout:7/754: dwrite de/d14/d2f/d3f/fde [0,4194304] 0 2023-10-18T20:58:39.440 INFO:tasks.workunit.client.1.smithi060.stdout:7/755: stat de/d14/d2f/d8f/d5b/d9e/fd1 0 2023-10-18T20:58:39.446 INFO:tasks.workunit.client.1.smithi060.stdout:9/623: dwrite d3/d99/d19/d54/d8f/fe3 [0,4194304] 0 2023-10-18T20:58:39.447 INFO:tasks.workunit.client.0.smithi008.stdout:2/567: dread d1/d3/dd/f58 [0,4194304] 0 2023-10-18T20:58:39.447 INFO:tasks.workunit.client.0.smithi008.stdout:2/568: chown d1/d3/dd/d1c/f3e 1 1 2023-10-18T20:58:39.450 INFO:tasks.workunit.client.0.smithi008.stdout:2/569: creat d1/d3/dd/d25/d76/d59/d85/fb8 x:0 0 0 2023-10-18T20:58:39.454 INFO:tasks.workunit.client.0.smithi008.stdout:2/570: mkdir d1/d3/dd/d25/d76/d59/d85/db9 0 2023-10-18T20:58:39.458 INFO:tasks.workunit.client.1.smithi060.stdout:7/756: dread de/d29/d72/d84/fae [0,4194304] 0 2023-10-18T20:58:39.459 INFO:tasks.workunit.client.1.smithi060.stdout:7/757: getdents de/d14/dd2 0 2023-10-18T20:58:39.461 INFO:tasks.workunit.client.0.smithi008.stdout:8/684: dwrite d5/d8/df/d2e/f35 [0,4194304] 0 2023-10-18T20:58:39.465 INFO:tasks.workunit.client.0.smithi008.stdout:0/456: dwrite d0/d7c/f59 [0,4194304] 0 2023-10-18T20:58:39.472 INFO:tasks.workunit.client.0.smithi008.stdout:3/509: dwrite d0/f54 [0,4194304] 0 2023-10-18T20:58:39.473 INFO:tasks.workunit.client.1.smithi060.stdout:8/626: dwrite d4/d9/d31/d35/d9f/da3/f99 [0,4194304] 0 2023-10-18T20:58:39.474 INFO:tasks.workunit.client.0.smithi008.stdout:3/510: chown d0/d3/de/d13/l60 24914 1 2023-10-18T20:58:39.474 INFO:tasks.workunit.client.0.smithi008.stdout:2/571: dread d1/d3/dd/d1c/f28 [4194304,4194304] 0 2023-10-18T20:58:39.474 INFO:tasks.workunit.client.0.smithi008.stdout:7/611: dwrite d1/d3/d20/f43 [0,4194304] 0 2023-10-18T20:58:39.477 INFO:tasks.workunit.client.0.smithi008.stdout:2/572: mkdir d1/d3/dd/d25/d76/d59/d85/dba 0 2023-10-18T20:58:39.490 INFO:tasks.workunit.client.1.smithi060.stdout:8/627: symlink d4/d9/d93/lbb 0 2023-10-18T20:58:39.523 INFO:tasks.workunit.client.0.smithi008.stdout:3/511: dwrite d0/f54 [4194304,4194304] 0 2023-10-18T20:58:39.524 INFO:tasks.workunit.client.0.smithi008.stdout:3/512: stat d0/d3/de/d13/f9b 0 2023-10-18T20:58:39.526 INFO:tasks.workunit.client.0.smithi008.stdout:3/513: unlink d0/d3/f31 0 2023-10-18T20:58:39.526 INFO:tasks.workunit.client.0.smithi008.stdout:3/514: dread - d0/d3/d37/d74/f89 zero size 2023-10-18T20:58:39.529 INFO:tasks.workunit.client.1.smithi060.stdout:8/628: mknod d4/d9/db4/cbc 0 2023-10-18T20:58:39.529 INFO:tasks.workunit.client.0.smithi008.stdout:3/515: creat d0/d3/d37/d74/fa4 x:0 0 0 2023-10-18T20:58:39.548 INFO:tasks.workunit.client.1.smithi060.stdout:8/629: dread d4/d9/d37/fa2 [0,4194304] 0 2023-10-18T20:58:39.552 INFO:tasks.workunit.client.1.smithi060.stdout:8/630: mkdir d4/d9/d31/d6f/dbd 0 2023-10-18T20:58:39.552 INFO:tasks.workunit.client.1.smithi060.stdout:8/631: fdatasync d4/d9/d37/fa2 0 2023-10-18T20:58:39.555 INFO:tasks.workunit.client.1.smithi060.stdout:8/632: rmdir d4/d9/d31/d35/d9f 39 2023-10-18T20:58:39.555 INFO:tasks.workunit.client.1.smithi060.stdout:8/633: readlink d4/d9/d31/d6f/la4 0 2023-10-18T20:58:39.556 INFO:tasks.workunit.client.0.smithi008.stdout:0/457: dwrite d0/d7c/f63 [4194304,4194304] 0 2023-10-18T20:58:39.556 INFO:tasks.workunit.client.0.smithi008.stdout:0/458: read d0/dd/df/d2a/f2d [3918572,15436] 0 2023-10-18T20:58:39.557 INFO:tasks.workunit.client.0.smithi008.stdout:0/459: fsync d0/f3 0 2023-10-18T20:58:39.557 INFO:tasks.workunit.client.0.smithi008.stdout:0/460: chown d0/l1f 2520203 1 2023-10-18T20:58:39.557 INFO:tasks.workunit.client.1.smithi060.stdout:8/634: creat d4/d9/d31/fbe x:0 0 0 2023-10-18T20:58:39.561 INFO:tasks.workunit.client.1.smithi060.stdout:8/635: creat d4/d9/d4f/fbf x:0 0 0 2023-10-18T20:58:39.562 INFO:tasks.workunit.client.1.smithi060.stdout:8/636: write d4/d9/d31/d35/f44 [1201049,43558] 0 2023-10-18T20:58:39.564 INFO:tasks.workunit.client.1.smithi060.stdout:8/637: creat d4/d9/d31/d35/d9f/fc0 x:0 0 0 2023-10-18T20:58:39.565 INFO:tasks.workunit.client.1.smithi060.stdout:8/638: truncate d4/d9/d37/f8a 155436 0 2023-10-18T20:58:39.565 INFO:tasks.workunit.client.0.smithi008.stdout:0/461: creat d0/d3a/f8e x:0 0 0 2023-10-18T20:58:39.567 INFO:tasks.workunit.client.1.smithi060.stdout:8/639: link d4/f13 d4/d9/d31/d35/d9f/fc1 0 2023-10-18T20:58:39.567 INFO:tasks.workunit.client.1.smithi060.stdout:8/640: fsync d4/d9/d31/d35/d9f/da3/fa5 0 2023-10-18T20:58:39.567 INFO:tasks.workunit.client.1.smithi060.stdout:8/641: chown d4/d9/d31/c45 2017739 1 2023-10-18T20:58:39.570 INFO:tasks.workunit.client.0.smithi008.stdout:0/462: rmdir d0/dd/d19/d41 39 2023-10-18T20:58:39.571 INFO:tasks.workunit.client.1.smithi060.stdout:4/614: sync 2023-10-18T20:58:39.572 INFO:tasks.workunit.client.1.smithi060.stdout:4/615: write d4/f6a [1239266,68389] 0 2023-10-18T20:58:39.575 INFO:tasks.workunit.client.1.smithi060.stdout:4/616: symlink d4/dc/d2a/d31/da5/lb6 0 2023-10-18T20:58:39.576 INFO:tasks.workunit.client.1.smithi060.stdout:4/617: write d4/f43 [5160002,25723] 0 2023-10-18T20:58:39.581 INFO:tasks.workunit.client.1.smithi060.stdout:9/624: dwrite d3/f5e [0,4194304] 0 2023-10-18T20:58:39.583 INFO:tasks.workunit.client.0.smithi008.stdout:8/685: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/fda [0,4194304] 0 2023-10-18T20:58:39.587 INFO:tasks.workunit.client.1.smithi060.stdout:4/618: rename d4/d15/f84 to d4/dc/d2a/d39/fb7 0 2023-10-18T20:58:39.587 INFO:tasks.workunit.client.0.smithi008.stdout:8/686: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/ff6 x:0 0 0 2023-10-18T20:58:39.588 INFO:tasks.workunit.client.0.smithi008.stdout:8/687: readlink d5/d8/df/d9d/d6c/l86 0 2023-10-18T20:58:39.589 INFO:tasks.workunit.client.0.smithi008.stdout:7/612: dwrite d1/d36/d3d/da3/fa9 [0,4194304] 0 2023-10-18T20:58:39.592 INFO:tasks.workunit.client.0.smithi008.stdout:8/688: rename d5/d8/df/d9d/d6c/fc6 to d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/dbf/ff7 0 2023-10-18T20:58:39.597 INFO:tasks.workunit.client.1.smithi060.stdout:9/625: truncate d3/d99/f69 1851791 0 2023-10-18T20:58:39.597 INFO:tasks.workunit.client.1.smithi060.stdout:9/626: readlink d3/d99/d19/l3d 0 2023-10-18T20:58:39.597 INFO:tasks.workunit.client.0.smithi008.stdout:7/613: creat d1/d3/fc0 x:0 0 0 2023-10-18T20:58:39.598 INFO:tasks.workunit.client.0.smithi008.stdout:3/516: dwrite d0/d3/d42/d52/f98 [0,4194304] 0 2023-10-18T20:58:39.600 INFO:tasks.workunit.client.1.smithi060.stdout:4/619: creat d4/dc/d40/da8/fb8 x:0 0 0 2023-10-18T20:58:39.602 INFO:tasks.workunit.client.0.smithi008.stdout:7/614: truncate d1/d3/d20/d5f/d7f/f8d 774119 0 2023-10-18T20:58:39.602 INFO:tasks.workunit.client.0.smithi008.stdout:7/615: write d1/d3/d8b/f93 [113269,80519] 0 2023-10-18T20:58:39.602 INFO:tasks.workunit.client.0.smithi008.stdout:7/616: stat d1/d36/f7e 0 2023-10-18T20:58:39.605 INFO:tasks.workunit.client.0.smithi008.stdout:7/617: unlink d1/d3/d20/d5f/d7f/l91 0 2023-10-18T20:58:39.605 INFO:tasks.workunit.client.0.smithi008.stdout:7/618: creat d1/d3/fc1 x:0 0 0 2023-10-18T20:58:39.611 INFO:tasks.workunit.client.1.smithi060.stdout:9/627: read d3/d99/d1c/d25/f74 [1604997,28578] 0 2023-10-18T20:58:39.611 INFO:tasks.workunit.client.1.smithi060.stdout:9/628: fdatasync d3/d99/d1c/d2a/f3b 0 2023-10-18T20:58:39.612 INFO:tasks.workunit.client.0.smithi008.stdout:0/463: dread d0/d3a/f84 [0,4194304] 0 2023-10-18T20:58:39.612 INFO:tasks.workunit.client.0.smithi008.stdout:7/619: truncate d1/da6/f77 61694 0 2023-10-18T20:58:39.613 INFO:tasks.workunit.client.0.smithi008.stdout:3/517: dread d0/d4a/d64/f7c [0,4194304] 0 2023-10-18T20:58:39.613 INFO:tasks.workunit.client.0.smithi008.stdout:3/518: symlink d0/d3/de/d13/d7d/la5 0 2023-10-18T20:58:39.613 INFO:tasks.workunit.client.0.smithi008.stdout:3/519: readlink d0/d3/de/d13/l9f 0 2023-10-18T20:58:39.613 INFO:tasks.workunit.client.0.smithi008.stdout:2/573: dwrite d1/d3/dd/d1c/f55 [0,4194304] 0 2023-10-18T20:58:39.613 INFO:tasks.workunit.client.0.smithi008.stdout:2/574: fdatasync d1/d3/dd/f50 0 2023-10-18T20:58:39.615 INFO:tasks.workunit.client.1.smithi060.stdout:9/629: creat d3/d99/d1c/d5a/fe7 x:0 0 0 2023-10-18T20:58:39.618 INFO:tasks.workunit.client.0.smithi008.stdout:3/520: mkdir d0/d3/d37/da6 0 2023-10-18T20:58:39.619 INFO:tasks.workunit.client.1.smithi060.stdout:9/630: read d3/d99/d1c/f6a [725730,35328] 0 2023-10-18T20:58:39.619 INFO:tasks.workunit.client.1.smithi060.stdout:4/620: dread d4/d15/f51 [0,4194304] 0 2023-10-18T20:58:39.622 INFO:tasks.workunit.client.0.smithi008.stdout:2/575: link d1/d3/dd/d1c/d3a/d45/d83/l8a d1/d3/dd/d25/db2/lbb 0 2023-10-18T20:58:39.622 INFO:tasks.workunit.client.0.smithi008.stdout:2/576: chown d1/d3/dd/d25/d76/d59/d85/cb6 1018965144 1 2023-10-18T20:58:39.623 INFO:tasks.workunit.client.1.smithi060.stdout:9/631: symlink d3/d99/d19/le8 0 2023-10-18T20:58:39.624 INFO:tasks.workunit.client.1.smithi060.stdout:4/621: rmdir d4/dc 39 2023-10-18T20:58:39.624 INFO:tasks.workunit.client.1.smithi060.stdout:9/632: mknod d3/d99/d19/d54/d8f/ce9 0 2023-10-18T20:58:39.625 INFO:tasks.workunit.client.1.smithi060.stdout:4/622: creat d4/dc/d2a/d5b/fb9 x:0 0 0 2023-10-18T20:58:39.629 INFO:tasks.workunit.client.1.smithi060.stdout:6/707: sync 2023-10-18T20:58:39.629 INFO:tasks.workunit.client.1.smithi060.stdout:0/705: sync 2023-10-18T20:58:39.630 INFO:tasks.workunit.client.1.smithi060.stdout:9/633: unlink d3/d99/d1c/d5a/d5d/d56/fa7 0 2023-10-18T20:58:39.630 INFO:tasks.workunit.client.1.smithi060.stdout:9/634: rename d3/d99/d1c/d2a/d80/da0/dc2/d9e/cb8 to d3/d99/d19/cea 0 2023-10-18T20:58:39.631 INFO:tasks.workunit.client.0.smithi008.stdout:7/620: read d1/d3/f17 [3218135,70660] 0 2023-10-18T20:58:39.631 INFO:tasks.workunit.client.0.smithi008.stdout:7/621: creat d1/d36/d3d/d3e/d59/d73/fc2 x:0 0 0 2023-10-18T20:58:39.632 INFO:tasks.workunit.client.1.smithi060.stdout:9/635: link d3/d99/d19/d54/d8f/c9b d3/d99/d1c/d2a/d80/da0/dc2/d9e/ceb 0 2023-10-18T20:58:39.634 INFO:tasks.workunit.client.0.smithi008.stdout:0/464: rename d0/dd/df/d20 to d0/d7c/d7f/d8a/d8f 0 2023-10-18T20:58:39.634 INFO:tasks.workunit.client.0.smithi008.stdout:0/465: write d0/f8c [445811,42125] 0 2023-10-18T20:58:39.635 INFO:tasks.workunit.client.1.smithi060.stdout:9/636: symlink d3/d99/d1c/d2a/lec 0 2023-10-18T20:58:39.636 INFO:tasks.workunit.client.1.smithi060.stdout:8/642: dwrite d4/d9/d4f/d74/d81/f94 [0,4194304] 0 2023-10-18T20:58:39.636 INFO:tasks.workunit.client.1.smithi060.stdout:8/643: fsync d4/d9/d31/d35/f4d 0 2023-10-18T20:58:39.638 INFO:tasks.workunit.client.0.smithi008.stdout:0/466: mkdir d0/d90 0 2023-10-18T20:58:39.638 INFO:tasks.workunit.client.0.smithi008.stdout:0/467: readlink d0/l1f 0 2023-10-18T20:58:39.638 INFO:tasks.workunit.client.0.smithi008.stdout:0/468: write d0/d7c/f7a [418409,93082] 0 2023-10-18T20:58:39.639 INFO:tasks.workunit.client.0.smithi008.stdout:0/469: symlink d0/d3a/l91 0 2023-10-18T20:58:39.641 INFO:tasks.workunit.client.0.smithi008.stdout:0/470: write d0/dd/df/d2a/f2d [501763,103840] 0 2023-10-18T20:58:39.641 INFO:tasks.workunit.client.0.smithi008.stdout:0/471: fdatasync d0/dd/d19/d24/f35 0 2023-10-18T20:58:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.639+0000 7fb596eee700 1 -- 172.21.15.8:0/3996951369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5900f66e0 msgr2=0x7fb5900f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.639+0000 7fb596eee700 1 --2- 172.21.15.8:0/3996951369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5900f66e0 0x7fb5900f6b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb578004660 tx=0x7fb578009b30).stop 2023-10-18T20:58:39.644 INFO:tasks.workunit.client.0.smithi008.stdout:0/472: rename d0/dd/f18 to d0/d7c/f92 0 2023-10-18T20:58:39.644 INFO:tasks.workunit.client.0.smithi008.stdout:0/473: dread - d0/dd/f8b zero size 2023-10-18T20:58:39.644 INFO:tasks.workunit.client.0.smithi008.stdout:0/474: fdatasync d0/dd/df/d2a/f80 0 2023-10-18T20:58:39.645 INFO:tasks.workunit.client.1.smithi060.stdout:9/637: dread d3/d58/f95 [0,4194304] 0 2023-10-18T20:58:39.645 INFO:tasks.workunit.client.1.smithi060.stdout:9/638: stat d3/d99/d1c/d2a/c60 0 2023-10-18T20:58:39.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.640+0000 7fb596eee700 1 -- 172.21.15.8:0/3996951369 shutdown_connections 2023-10-18T20:58:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.640+0000 7fb596eee700 1 --2- 172.21.15.8:0/3996951369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5900f7980 0x7fb5900f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:58:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.640+0000 7fb596eee700 1 --2- 172.21.15.8:0/3996951369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5900f66e0 0x7fb5900f6b00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.640+0000 7fb596eee700 1 -- 172.21.15.8:0/3996951369 >> 172.21.15.8:0/3996951369 conn(0x7fb5900f1e40 msgr2=0x7fb5900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.640+0000 7fb596eee700 1 -- 172.21.15.8:0/3996951369 shutdown_connections 2023-10-18T20:58:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.640+0000 7fb596eee700 1 -- 172.21.15.8:0/3996951369 wait complete. 2023-10-18T20:58:39.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.642+0000 7fb596eee700 1 Processor -- start 2023-10-18T20:58:39.647 INFO:tasks.workunit.client.0.smithi008.stdout:0/475: creat d0/d7c/f93 x:0 0 0 2023-10-18T20:58:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.643+0000 7fb596eee700 1 -- start start 2023-10-18T20:58:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.643+0000 7fb596eee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5900f66e0 0x7fb590104d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.643+0000 7fb596eee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5900f7980 0x7fb590105260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.643+0000 7fb596eee700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901058f0 con 0x7fb5900f7980 2023-10-18T20:58:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.643+0000 7fb596eee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59010b400 con 0x7fb5900f66e0 2023-10-18T20:58:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.644+0000 7fb587fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5900f7980 0x7fb590105260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.644+0000 7fb587fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5900f7980 0x7fb590105260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50990/0 (socket says 172.21.15.8:50990) 2023-10-18T20:58:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.644+0000 7fb587fff700 1 -- 172.21.15.8:0/2037323871 learned_addr learned my addr 172.21.15.8:0/2037323871 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.644+0000 7fb594c8a700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5900f66e0 0x7fb590104d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.645+0000 7fb587fff700 1 -- 172.21.15.8:0/2037323871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5900f66e0 msgr2=0x7fb590104d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.645+0000 7fb587fff700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5900f66e0 0x7fb590104d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.645+0000 7fb587fff700 1 -- 172.21.15.8:0/2037323871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb578005040 con 0x7fb5900f7980 2023-10-18T20:58:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.645+0000 7fb587fff700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5900f7980 0x7fb590105260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fb58000b790 tx=0x7fb5800092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.647+0000 7fb58dffb700 1 -- 172.21.15.8:0/2037323871 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb58000d680 con 0x7fb5900f7980 2023-10-18T20:58:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.647+0000 7fb58dffb700 1 -- 172.21.15.8:0/2037323871 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb58000dca0 con 0x7fb5900f7980 2023-10-18T20:58:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.647+0000 7fb58dffb700 1 -- 172.21.15.8:0/2037323871 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb580010d80 con 0x7fb5900f7980 2023-10-18T20:58:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.648+0000 7fb596eee700 1 -- 172.21.15.8:0/2037323871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59010b5f0 con 0x7fb5900f7980 2023-10-18T20:58:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.649+0000 7fb596eee700 1 -- 172.21.15.8:0/2037323871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59010bbb0 con 0x7fb5900f7980 2023-10-18T20:58:39.654 INFO:tasks.workunit.client.0.smithi008.stdout:3/521: dread d0/d3/d15/f44 [0,4194304] 0 2023-10-18T20:58:39.655 INFO:tasks.workunit.client.0.smithi008.stdout:3/522: stat d0/d3/de/d13/c7a 0 2023-10-18T20:58:39.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.653+0000 7fb596eee700 1 -- 172.21.15.8:0/2037323871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590045ad0 con 0x7fb5900f7980 2023-10-18T20:58:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.656+0000 7fb58dffb700 1 -- 172.21.15.8:0/2037323871 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 77192+0+0 (secure 0 0 0) 0x7fb58000f070 con 0x7fb5900f7980 2023-10-18T20:58:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.658+0000 7fb58dffb700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb57c060fb0 0x7fb57c063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:39.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.658+0000 7fb58dffb700 1 -- 172.21.15.8:0/2037323871 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb58007c030 con 0x7fb5900f7980 2023-10-18T20:58:39.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.660+0000 7fb594c8a700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb57c060fb0 0x7fb57c063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:39.664 INFO:tasks.workunit.client.0.smithi008.stdout:0/476: dread d0/dd/df/d2a/f38 [0,4194304] 0 2023-10-18T20:58:39.664 INFO:tasks.workunit.client.0.smithi008.stdout:0/477: readlink d0/dd/df/l53 0 2023-10-18T20:58:39.666 INFO:tasks.workunit.client.1.smithi060.stdout:8/644: write d4/f13 [3206794,1467] 0 2023-10-18T20:58:39.669 INFO:tasks.workunit.client.1.smithi060.stdout:6/708: dwrite d10/d47/f91 [0,4194304] 0 2023-10-18T20:58:39.669 INFO:tasks.workunit.client.1.smithi060.stdout:6/709: readlink d10/d2e/l63 0 2023-10-18T20:58:39.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.667+0000 7fb594c8a700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb57c060fb0 0x7fb57c063470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb578009490 tx=0x7fb578009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:39.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:39.667+0000 7fb58dffb700 1 -- 172.21.15.8:0/2037323871 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7fb58004c4a0 con 0x7fb5900f7980 2023-10-18T20:58:39.671 INFO:tasks.workunit.client.1.smithi060.stdout:2/687: sync 2023-10-18T20:58:39.671 INFO:tasks.workunit.client.1.smithi060.stdout:3/630: sync 2023-10-18T20:58:39.671 INFO:tasks.workunit.client.1.smithi060.stdout:3/631: readlink d0/l2d 0 2023-10-18T20:58:39.672 INFO:tasks.workunit.client.1.smithi060.stdout:5/726: sync 2023-10-18T20:58:39.672 INFO:tasks.workunit.client.1.smithi060.stdout:5/727: fdatasync d0/da/d61/fbb 0 2023-10-18T20:58:39.673 INFO:tasks.workunit.client.1.smithi060.stdout:8/645: fdatasync d4/d9/d31/d35/d9f/fc1 0 2023-10-18T20:58:39.673 INFO:tasks.workunit.client.1.smithi060.stdout:8/646: truncate d4/d9/f1b 4626174 0 2023-10-18T20:58:39.673 INFO:tasks.workunit.client.1.smithi060.stdout:8/647: fsync d4/d9/d31/d35/d9f/da3/f9b 0 2023-10-18T20:58:39.674 INFO:tasks.workunit.client.1.smithi060.stdout:6/710: stat d10/d2e/d75/d81/la1 0 2023-10-18T20:58:39.675 INFO:tasks.workunit.client.1.smithi060.stdout:3/632: truncate d0/d5e/dbc/fbf 5360737 0 2023-10-18T20:58:39.676 INFO:tasks.workunit.client.1.smithi060.stdout:3/633: write d0/d3c/d3d/f7b [400238,122168] 0 2023-10-18T20:58:39.676 INFO:tasks.workunit.client.1.smithi060.stdout:3/634: creat d0/d22/d26/d2c/fe3 x:0 0 0 2023-10-18T20:58:39.676 INFO:tasks.workunit.client.1.smithi060.stdout:6/711: stat d10/d6f/lb0 0 2023-10-18T20:58:39.682 INFO:tasks.workunit.client.0.smithi008.stdout:0/478: rename d0/dd/d19/d41 to d0/dd/df/d2a/d94 0 2023-10-18T20:58:39.685 INFO:tasks.workunit.client.0.smithi008.stdout:3/523: dread d0/f62 [0,4194304] 0 2023-10-18T20:58:39.689 INFO:tasks.workunit.client.0.smithi008.stdout:0/479: creat d0/dd/df/d2a/d94/f95 x:0 0 0 2023-10-18T20:58:39.689 INFO:tasks.workunit.client.0.smithi008.stdout:8/689: dwrite d5/f11 [0,4194304] 0 2023-10-18T20:58:39.689 INFO:tasks.workunit.client.0.smithi008.stdout:3/524: truncate d0/d3/fa3 2212643 0 2023-10-18T20:58:39.690 INFO:tasks.workunit.client.1.smithi060.stdout:8/648: write d4/d9/d31/d35/f84 [3263054,92243] 0 2023-10-18T20:58:39.691 INFO:tasks.workunit.client.1.smithi060.stdout:6/712: creat d10/d17/d2f/fdd x:0 0 0 2023-10-18T20:58:39.693 INFO:tasks.workunit.client.1.smithi060.stdout:6/713: rmdir d10/d17/d70/dba 39 2023-10-18T20:58:39.694 INFO:tasks.workunit.client.1.smithi060.stdout:6/714: fsync d10/d47/fa3 0 2023-10-18T20:58:39.698 INFO:tasks.workunit.client.1.smithi060.stdout:6/715: write d10/d25/d3c/f62 [1693456,8298] 0 2023-10-18T20:58:39.703 INFO:tasks.workunit.client.1.smithi060.stdout:3/635: dread d0/fd [0,4194304] 0 2023-10-18T20:58:39.703 INFO:tasks.workunit.client.1.smithi060.stdout:6/716: rmdir d10/d17/d54/dd4 39 2023-10-18T20:58:39.703 INFO:tasks.workunit.client.1.smithi060.stdout:6/717: write d10/d2e/d75/d81/fca [227300,64306] 0 2023-10-18T20:58:39.705 INFO:tasks.workunit.client.1.smithi060.stdout:2/688: write d0/d3/f35 [3587214,95811] 0 2023-10-18T20:58:39.708 INFO:tasks.workunit.client.1.smithi060.stdout:3/636: mkdir d0/d22/d26/d29/dae/de4 0 2023-10-18T20:58:39.708 INFO:tasks.workunit.client.1.smithi060.stdout:3/637: read - d0/d3c/d3d/d4d/d95/fcb zero size 2023-10-18T20:58:39.708 INFO:tasks.workunit.client.1.smithi060.stdout:8/649: write d4/d9/f2e [70821,128688] 0 2023-10-18T20:58:39.709 INFO:tasks.workunit.client.1.smithi060.stdout:6/718: truncate d10/d2e/d75/d81/fb2 782257 0 2023-10-18T20:58:39.711 INFO:tasks.workunit.client.1.smithi060.stdout:2/689: creat d0/d3/d27/d4d/d53/fe9 x:0 0 0 2023-10-18T20:58:39.716 INFO:tasks.workunit.client.0.smithi008.stdout:8/690: write d5/f37 [3241529,9145] 0 2023-10-18T20:58:39.717 INFO:tasks.workunit.client.0.smithi008.stdout:3/525: read d0/d4a/d64/f72 [5869580,88918] 0 2023-10-18T20:58:39.717 INFO:tasks.workunit.client.0.smithi008.stdout:3/526: chown d0/d3/d42/l38 65371 1 2023-10-18T20:58:39.724 INFO:tasks.workunit.client.0.smithi008.stdout:0/480: dread d0/dd/d19/d24/f44 [0,4194304] 0 2023-10-18T20:58:39.724 INFO:tasks.workunit.client.0.smithi008.stdout:0/481: chown d0/dd/d19/f6e 162035626 1 2023-10-18T20:58:39.727 INFO:tasks.workunit.client.0.smithi008.stdout:0/482: unlink d0/dd/df/d2a/d94/f58 0 2023-10-18T20:58:39.727 INFO:tasks.workunit.client.0.smithi008.stdout:0/483: write d0/d7c/d7f/d8a/d8f/f62 [499379,47686] 0 2023-10-18T20:58:39.729 INFO:tasks.workunit.client.0.smithi008.stdout:0/484: symlink d0/dd/d19/l96 0 2023-10-18T20:58:39.730 INFO:tasks.workunit.client.0.smithi008.stdout:0/485: write d0/dd/d19/d24/f3d [1126501,57080] 0 2023-10-18T20:58:39.732 INFO:tasks.workunit.client.0.smithi008.stdout:0/486: read d0/dd/df/f1c [475034,94630] 0 2023-10-18T20:58:39.746 INFO:tasks.workunit.client.0.smithi008.stdout:8/691: write d5/f11 [3024117,95958] 0 2023-10-18T20:58:39.748 INFO:tasks.workunit.client.0.smithi008.stdout:3/527: write d0/d3/d15/f23 [1654398,120171] 0 2023-10-18T20:58:39.751 INFO:tasks.workunit.client.0.smithi008.stdout:8/692: rename d5/d8/df/d9d/d6c/fc8 to d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/df5/ff8 0 2023-10-18T20:58:39.751 INFO:tasks.workunit.client.0.smithi008.stdout:8/693: dread - d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/fe1 zero size 2023-10-18T20:58:39.753 INFO:tasks.workunit.client.1.smithi060.stdout:5/728: dwrite d0/da/d3b/d43/f50 [0,4194304] 0 2023-10-18T20:58:39.760 INFO:tasks.workunit.client.1.smithi060.stdout:5/729: write d0/d6/d8/f6b [123742,16363] 0 2023-10-18T20:58:39.771 INFO:tasks.workunit.client.0.smithi008.stdout:3/528: dread d0/f62 [0,4194304] 0 2023-10-18T20:58:39.773 INFO:tasks.workunit.client.1.smithi060.stdout:2/690: dwrite d0/d3/d27/d4d/f7d [0,4194304] 0 2023-10-18T20:58:39.777 INFO:tasks.workunit.client.0.smithi008.stdout:3/529: link d0/d3/de/d13/d35/d51/l63 d0/d3/d37/d6f/la7 0 2023-10-18T20:58:39.799 INFO:tasks.workunit.client.1.smithi060.stdout:3/638: symlink d0/d5e/dbc/le5 0 2023-10-18T20:58:39.799 INFO:tasks.workunit.client.1.smithi060.stdout:3/639: read - d0/d22/d26/d2c/fd3 zero size 2023-10-18T20:58:39.805 INFO:tasks.workunit.client.1.smithi060.stdout:8/650: link d4/d9/d31/d35/d9f/da3/l98 d4/d9/d37/d4e/d6e/d7b/lc2 0 2023-10-18T20:58:39.819 INFO:tasks.workunit.client.1.smithi060.stdout:6/719: creat d10/d25/fde x:0 0 0 2023-10-18T20:58:39.820 INFO:tasks.workunit.client.0.smithi008.stdout:3/530: rmdir d0/d3/d42/d88 39 2023-10-18T20:58:39.820 INFO:tasks.workunit.client.0.smithi008.stdout:3/531: write d0/d3/de/d13/f75 [1632488,86655] 0 2023-10-18T20:58:39.821 INFO:tasks.workunit.client.0.smithi008.stdout:3/532: write d0/f62 [5087556,26165] 0 2023-10-18T20:58:39.821 INFO:tasks.workunit.client.0.smithi008.stdout:3/533: stat d0/d3/de/c19 0 2023-10-18T20:58:39.822 INFO:tasks.workunit.client.0.smithi008.stdout:8/694: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/f92 [0,4194304] 0 2023-10-18T20:58:39.822 INFO:tasks.workunit.client.0.smithi008.stdout:8/695: readlink d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/lf3 0 2023-10-18T20:58:39.823 INFO:tasks.workunit.client.0.smithi008.stdout:8/696: symlink d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/lf9 0 2023-10-18T20:58:39.823 INFO:tasks.workunit.client.0.smithi008.stdout:8/697: chown d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/dc9/ce7 94299385 1 2023-10-18T20:58:39.831 INFO:tasks.workunit.client.1.smithi060.stdout:8/651: dread d4/d9/d31/d35/d9f/da3/f89 [0,4194304] 0 2023-10-18T20:58:39.836 INFO:tasks.workunit.client.1.smithi060.stdout:8/652: dread d4/d9/d4f/f71 [0,4194304] 0 2023-10-18T20:58:39.840 INFO:tasks.workunit.client.0.smithi008.stdout:3/534: dread d0/d3/de/d13/d35/f47 [0,4194304] 0 2023-10-18T20:58:39.841 INFO:tasks.workunit.client.0.smithi008.stdout:3/535: mknod d0/d3/d37/d74/da2/ca8 0 2023-10-18T20:58:39.843 INFO:tasks.workunit.client.0.smithi008.stdout:3/536: fdatasync d0/d3/d37/f4c 0 2023-10-18T20:58:39.849 INFO:tasks.workunit.client.0.smithi008.stdout:3/537: mkdir d0/d3/da9 0 2023-10-18T20:58:39.849 INFO:tasks.workunit.client.0.smithi008.stdout:3/538: creat d0/d4a/d64/d80/faa x:0 0 0 2023-10-18T20:58:39.850 INFO:tasks.workunit.client.0.smithi008.stdout:3/539: truncate d0/d3/d37/d74/fa4 536116 0 2023-10-18T20:58:39.850 INFO:tasks.workunit.client.0.smithi008.stdout:3/540: chown d0/d3/d42/d52/f73 16905719 1 2023-10-18T20:58:39.866 INFO:tasks.workunit.client.0.smithi008.stdout:3/541: rmdir d0/d3/d37 39 2023-10-18T20:58:39.866 INFO:tasks.workunit.client.0.smithi008.stdout:3/542: dread - d0/d4a/d64/d80/faa zero size 2023-10-18T20:58:39.868 INFO:tasks.workunit.client.0.smithi008.stdout:3/543: unlink d0/l7b 0 2023-10-18T20:58:39.872 INFO:tasks.workunit.client.0.smithi008.stdout:3/544: symlink d0/d3/de/d13/d35/lab 0 2023-10-18T20:58:39.878 INFO:tasks.workunit.client.1.smithi060.stdout:5/730: link d0/da/d61/f7f d0/dd/dd7/f10c 0 2023-10-18T20:58:39.892 INFO:tasks.workunit.client.1.smithi060.stdout:3/640: getdents d0/d22/d26 0 2023-10-18T20:58:39.893 INFO:tasks.workunit.client.1.smithi060.stdout:3/641: write d0/d22/d26/d8c/fb6 [282368,17963] 0 2023-10-18T20:58:39.893 INFO:tasks.workunit.client.0.smithi008.stdout:3/545: dread d0/d3/f2e [0,4194304] 0 2023-10-18T20:58:39.894 INFO:tasks.workunit.client.1.smithi060.stdout:8/653: creat d4/d9/d4f/d74/fc3 x:0 0 0 2023-10-18T20:58:39.894 INFO:tasks.workunit.client.1.smithi060.stdout:8/654: chown d4/d9/d31/d35/f44 2 1 2023-10-18T20:58:39.894 INFO:tasks.workunit.client.1.smithi060.stdout:8/655: creat d4/d9/d4f/d74/d81/fc4 x:0 0 0 2023-10-18T20:58:39.894 INFO:tasks.workunit.client.1.smithi060.stdout:5/731: creat d0/da/f10d x:0 0 0 2023-10-18T20:58:39.895 INFO:tasks.workunit.client.0.smithi008.stdout:3/546: creat d0/fac x:0 0 0 2023-10-18T20:58:39.898 INFO:tasks.workunit.client.1.smithi060.stdout:8/656: link d4/d9/d31/c54 d4/d9/d88/cc5 0 2023-10-18T20:58:39.899 INFO:tasks.workunit.client.0.smithi008.stdout:3/547: rmdir d0/d84 39 2023-10-18T20:58:39.900 INFO:tasks.workunit.client.1.smithi060.stdout:8/657: creat d4/fc6 x:0 0 0 2023-10-18T20:58:39.903 INFO:tasks.workunit.client.1.smithi060.stdout:8/658: rename d4/d9/d4f/f86 to d4/d9/d31/d35/d9f/da3/fc7 0 2023-10-18T20:58:39.906 INFO:tasks.workunit.client.1.smithi060.stdout:1/787: sync 2023-10-18T20:58:39.907 INFO:tasks.workunit.client.1.smithi060.stdout:7/758: sync 2023-10-18T20:58:39.907 INFO:tasks.workunit.client.1.smithi060.stdout:1/788: chown d4/d6/d7/d2f/d7b/d2a/ca3 993 1 2023-10-18T20:58:39.913 INFO:tasks.workunit.client.1.smithi060.stdout:8/659: truncate d4/d9/d37/d4e/d6e/d7b/f7d 454338 0 2023-10-18T20:58:39.914 INFO:tasks.workunit.client.1.smithi060.stdout:1/789: symlink d4/d6/d7/d2f/d7b/dda/df8/lfd 0 2023-10-18T20:58:39.916 INFO:tasks.workunit.client.1.smithi060.stdout:0/706: sync 2023-10-18T20:58:39.917 INFO:tasks.workunit.client.1.smithi060.stdout:4/623: sync 2023-10-18T20:58:39.917 INFO:tasks.workunit.client.1.smithi060.stdout:9/639: sync 2023-10-18T20:58:39.917 INFO:tasks.workunit.client.1.smithi060.stdout:4/624: readlink d4/dc/d2a/d13/d27/d68/d9e/lac 0 2023-10-18T20:58:39.917 INFO:tasks.workunit.client.1.smithi060.stdout:9/640: chown d3/d99/d1c/d5a/fb2 952 1 2023-10-18T20:58:39.917 INFO:tasks.workunit.client.1.smithi060.stdout:9/641: dread - d3/d99/d1c/d5a/fb2 zero size 2023-10-18T20:58:39.918 INFO:tasks.workunit.client.1.smithi060.stdout:4/625: write d4/dc/d2a/d2d/d69/d89/f90 [1020126,19247] 0 2023-10-18T20:58:39.919 INFO:tasks.workunit.client.1.smithi060.stdout:2/691: unlink d0/ld1 0 2023-10-18T20:58:39.920 INFO:tasks.workunit.client.1.smithi060.stdout:7/759: dread de/d14/f97 [0,4194304] 0 2023-10-18T20:58:39.922 INFO:tasks.workunit.client.1.smithi060.stdout:2/692: symlink d0/d16/d81/da1/ddd/lea 0 2023-10-18T20:58:39.924 INFO:tasks.workunit.client.1.smithi060.stdout:7/760: creat de/d14/d2f/d8f/ff6 x:0 0 0 2023-10-18T20:58:39.928 INFO:tasks.workunit.client.1.smithi060.stdout:1/790: getdents d4/d6/d7/d2f/d7b/d2a/d32/dd 0 2023-10-18T20:58:39.928 INFO:tasks.workunit.client.1.smithi060.stdout:1/791: chown d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/lf7 88205 1 2023-10-18T20:58:39.930 INFO:tasks.workunit.client.0.smithi008.stdout:8/698: dwrite d5/d8/f41 [0,4194304] 0 2023-10-18T20:58:39.931 INFO:tasks.workunit.client.1.smithi060.stdout:7/761: getdents de/d29/d72 0 2023-10-18T20:58:39.931 INFO:tasks.workunit.client.1.smithi060.stdout:7/762: chown de/d14/d2f/d3f/d5a/d5f/la6 82496 1 2023-10-18T20:58:39.931 INFO:tasks.workunit.client.1.smithi060.stdout:7/763: write de/d14/d49/d68/d7d/d7e/db5/fce [754912,46034] 0 2023-10-18T20:58:39.932 INFO:tasks.workunit.client.1.smithi060.stdout:7/764: write de/d14/d2f/d8f/d5b/f64 [1556304,115195] 0 2023-10-18T20:58:39.932 INFO:tasks.workunit.client.1.smithi060.stdout:7/765: write de/d14/d2f/d8f/d5b/f95 [1911194,91967] 0 2023-10-18T20:58:39.932 INFO:tasks.workunit.client.1.smithi060.stdout:7/766: write de/d14/d2f/d8f/ff6 [571177,124529] 0 2023-10-18T20:58:39.934 INFO:tasks.workunit.client.1.smithi060.stdout:9/642: write d3/d99/d1c/d5a/d5d/d7d/f89 [3877315,59717] 0 2023-10-18T20:58:39.942 INFO:tasks.workunit.client.1.smithi060.stdout:9/643: unlink d3/d99/d1c/d2a/d80/da0/dc2/fba 0 2023-10-18T20:58:39.949 INFO:tasks.workunit.client.1.smithi060.stdout:9/644: rmdir d3/d99/d1c/d25/dd8 0 2023-10-18T20:58:39.950 INFO:tasks.workunit.client.1.smithi060.stdout:1/792: dread d4/d6/d7/d2f/d7b/d2a/d32/dd/f25 [4194304,4194304] 0 2023-10-18T20:58:39.956 INFO:tasks.workunit.client.0.smithi008.stdout:3/548: dread d0/d3/de/d13/f49 [0,4194304] 0 2023-10-18T20:58:39.956 INFO:tasks.workunit.client.0.smithi008.stdout:3/549: fdatasync d0/fac 0 2023-10-18T20:58:39.959 INFO:tasks.workunit.client.1.smithi060.stdout:1/793: creat d4/d6/d7/d2f/d7b/ffe x:0 0 0 2023-10-18T20:58:39.960 INFO:tasks.workunit.client.1.smithi060.stdout:3/642: dwrite d0/d22/d26/fb0 [0,4194304] 0 2023-10-18T20:58:39.960 INFO:tasks.workunit.client.1.smithi060.stdout:3/643: dread - d0/d22/d26/fc1 zero size 2023-10-18T20:58:39.960 INFO:tasks.workunit.client.1.smithi060.stdout:4/626: write d4/dc/d2a/d39/d53/fb5 [2971274,11702] 0 2023-10-18T20:58:39.963 INFO:tasks.workunit.client.1.smithi060.stdout:9/645: dread d3/d99/d1c/f47 [0,4194304] 0 2023-10-18T20:58:39.966 INFO:tasks.workunit.client.1.smithi060.stdout:4/627: rename d4/dc/d2a/d13/f3f to d4/dc/d2a/d13/d33/fba 0 2023-10-18T20:58:39.966 INFO:tasks.workunit.client.1.smithi060.stdout:4/628: creat d4/dc/d2a/d39/d53/d76/d99/fbb x:0 0 0 2023-10-18T20:58:39.967 INFO:tasks.workunit.client.1.smithi060.stdout:4/629: chown d4/dc/d2a/d39/d53/d76/d99/fb4 129449 1 2023-10-18T20:58:39.968 INFO:tasks.workunit.client.1.smithi060.stdout:9/646: getdents d3/d99 0 2023-10-18T20:58:39.968 INFO:tasks.workunit.client.1.smithi060.stdout:9/647: write d3/d99/d1c/d5a/fb2 [419683,13379] 0 2023-10-18T20:58:39.971 INFO:tasks.workunit.client.1.smithi060.stdout:4/630: link d4/dc/d2a/d39/f7f d4/dc/d40/da8/fbc 0 2023-10-18T20:58:39.980 INFO:tasks.workunit.client.1.smithi060.stdout:3/644: write d0/d3c/d3d/d4d/f6a [1281328,80009] 0 2023-10-18T20:58:39.980 INFO:tasks.workunit.client.1.smithi060.stdout:7/767: dwrite de/d14/d2f/d8f/d65/fa9 [0,4194304] 0 2023-10-18T20:58:39.980 INFO:tasks.workunit.client.1.smithi060.stdout:3/645: readlink d0/d22/d26/d29/l58 0 2023-10-18T20:58:39.984 INFO:tasks.workunit.client.1.smithi060.stdout:3/646: rename d0/d3c/d3d/d4d/fc5 to d0/d22/d26/d29/dae/de4/fe6 0 2023-10-18T20:58:39.993 INFO:tasks.workunit.client.1.smithi060.stdout:3/647: write d0/d22/d26/d8c/fb6 [5799,8572] 0 2023-10-18T20:58:39.993 INFO:tasks.workunit.client.1.smithi060.stdout:3/648: write d0/d3c/d3d/d82/fb2 [245542,117517] 0 2023-10-18T20:58:39.994 INFO:tasks.workunit.client.1.smithi060.stdout:0/707: dwrite d3/fb4 [4194304,4194304] 0 2023-10-18T20:58:39.994 INFO:tasks.workunit.client.1.smithi060.stdout:4/631: read d4/dc/d2a/d5b/fa0 [3419051,48860] 0 2023-10-18T20:58:39.996 INFO:tasks.workunit.client.1.smithi060.stdout:7/768: read de/d14/dd2/fe1 [1676868,52364] 0 2023-10-18T20:58:39.996 INFO:tasks.workunit.client.1.smithi060.stdout:7/769: read - de/d14/d49/d68/d7d/fe2 zero size 2023-10-18T20:58:39.996 INFO:tasks.workunit.client.1.smithi060.stdout:7/770: write de/d14/d2f/f71 [1066109,58346] 0 2023-10-18T20:58:39.997 INFO:tasks.workunit.client.1.smithi060.stdout:2/693: dwrite d0/d3/d27/d4d/d53/f77 [0,4194304] 0 2023-10-18T20:58:39.997 INFO:tasks.workunit.client.1.smithi060.stdout:2/694: fdatasync d0/d45/d49/d6e/f91 0 2023-10-18T20:58:40.008 INFO:tasks.workunit.client.1.smithi060.stdout:4/632: mkdir d4/dc/d2a/d13/dbd 0 2023-10-18T20:58:40.011 INFO:tasks.workunit.client.0.smithi008.stdout:3/550: dwrite d0/d3/de/d13/f3a [0,4194304] 0 2023-10-18T20:58:40.012 INFO:tasks.workunit.client.0.smithi008.stdout:3/551: truncate d0/d3/d37/d6f/f93 189507 0 2023-10-18T20:58:40.013 INFO:tasks.workunit.client.1.smithi060.stdout:7/771: creat de/d29/d9c/ff7 x:0 0 0 2023-10-18T20:58:40.013 INFO:tasks.workunit.client.1.smithi060.stdout:7/772: truncate de/d14/d2f/d3f/fde 4247241 0 2023-10-18T20:58:40.014 INFO:tasks.workunit.client.1.smithi060.stdout:2/695: mknod d0/d45/ceb 0 2023-10-18T20:58:40.014 INFO:tasks.workunit.client.1.smithi060.stdout:2/696: write d0/d16/f19 [4240094,43036] 0 2023-10-18T20:58:40.014 INFO:tasks.workunit.client.1.smithi060.stdout:2/697: stat d0/d3/d27/d4d/d53/f77 0 2023-10-18T20:58:40.015 INFO:tasks.workunit.client.0.smithi008.stdout:3/552: mkdir d0/d84/dad 0 2023-10-18T20:58:40.019 INFO:tasks.workunit.client.1.smithi060.stdout:4/633: link d4/dc/d2a/d13/f3a d4/d15/fbe 0 2023-10-18T20:58:40.023 INFO:tasks.workunit.client.1.smithi060.stdout:2/698: write d0/d3/d27/d4d/d5e/f90 [1151929,47585] 0 2023-10-18T20:58:40.026 INFO:tasks.workunit.client.1.smithi060.stdout:7/773: getdents de/d14/d49/da3 0 2023-10-18T20:58:40.029 INFO:tasks.workunit.client.1.smithi060.stdout:9/648: dread d3/d99/d1c/d25/fde [0,4194304] 0 2023-10-18T20:58:40.031 INFO:tasks.workunit.client.1.smithi060.stdout:2/699: creat d0/d45/d49/d55/dbf/fec x:0 0 0 2023-10-18T20:58:40.031 INFO:tasks.workunit.client.1.smithi060.stdout:7/774: creat de/d14/d49/d68/d7d/d7e/db5/ff8 x:0 0 0 2023-10-18T20:58:40.031 INFO:tasks.workunit.client.1.smithi060.stdout:2/700: write d0/d45/dc9/d4a/fcf [4696914,68003] 0 2023-10-18T20:58:40.033 INFO:tasks.workunit.client.1.smithi060.stdout:0/708: write d3/d8/d14/d55/f88 [3173065,82201] 0 2023-10-18T20:58:40.034 INFO:tasks.workunit.client.1.smithi060.stdout:1/794: dwrite d4/d6/d7/d35/fc0 [0,4194304] 0 2023-10-18T20:58:40.037 INFO:tasks.workunit.client.0.smithi008.stdout:3/553: dread d0/d3/de/d13/f24 [0,4194304] 0 2023-10-18T20:58:40.040 INFO:tasks.workunit.client.1.smithi060.stdout:2/701: stat d0/d3/d27/l80 0 2023-10-18T20:58:40.043 INFO:tasks.workunit.client.0.smithi008.stdout:3/554: mkdir d0/d3/d42/d88/dae 0 2023-10-18T20:58:40.044 INFO:tasks.workunit.client.0.smithi008.stdout:3/555: chown d0/d4a/d64 12207 1 2023-10-18T20:58:40.044 INFO:tasks.workunit.client.0.smithi008.stdout:3/556: chown d0/d3/de/d13/d35/f47 2011024 1 2023-10-18T20:58:40.044 INFO:tasks.workunit.client.0.smithi008.stdout:3/557: truncate d0/f54 9250480 0 2023-10-18T20:58:40.045 INFO:tasks.workunit.client.1.smithi060.stdout:0/709: mknod d3/d8/d14/d55/d74/d76/d68/d7f/d8d/dbc/ce1 0 2023-10-18T20:58:40.045 INFO:tasks.workunit.client.1.smithi060.stdout:0/710: write d3/fd2 [358637,50902] 0 2023-10-18T20:58:40.045 INFO:tasks.workunit.client.1.smithi060.stdout:1/795: creat d4/d6/d48/fff x:0 0 0 2023-10-18T20:58:40.046 INFO:tasks.workunit.client.0.smithi008.stdout:3/558: creat d0/d3/de/d13/d7d/faf x:0 0 0 2023-10-18T20:58:40.046 INFO:tasks.workunit.client.1.smithi060.stdout:2/702: rmdir d0/d3/d27/d4d 39 2023-10-18T20:58:40.047 INFO:tasks.workunit.client.0.smithi008.stdout:3/559: creat d0/d3/d42/fb0 x:0 0 0 2023-10-18T20:58:40.049 INFO:tasks.workunit.client.1.smithi060.stdout:6/720: sync 2023-10-18T20:58:40.049 INFO:tasks.workunit.client.0.smithi008.stdout:3/560: unlink d0/d3/de/d13/d35/d51/l8c 0 2023-10-18T20:58:40.050 INFO:tasks.workunit.client.0.smithi008.stdout:3/561: write d0/d3/d37/d74/f89 [510558,74816] 0 2023-10-18T20:58:40.050 INFO:tasks.workunit.client.0.smithi008.stdout:3/562: creat d0/fb1 x:0 0 0 2023-10-18T20:58:40.051 INFO:tasks.workunit.client.1.smithi060.stdout:1/796: mkdir d4/d6/d7/d2f/d7b/de2/d100 0 2023-10-18T20:58:40.051 INFO:tasks.workunit.client.1.smithi060.stdout:1/797: write d4/d6/d7/d2f/fba [4872901,111196] 0 2023-10-18T20:58:40.052 INFO:tasks.workunit.client.1.smithi060.stdout:2/703: mkdir d0/d16/ded 0 2023-10-18T20:58:40.053 INFO:tasks.workunit.client.1.smithi060.stdout:6/721: mknod d10/d2e/cdf 0 2023-10-18T20:58:40.054 INFO:tasks.workunit.client.0.smithi008.stdout:3/563: mkdir d0/db2 0 2023-10-18T20:58:40.054 INFO:tasks.workunit.client.0.smithi008.stdout:3/564: write d0/fb1 [914443,114074] 0 2023-10-18T20:58:40.055 INFO:tasks.workunit.client.0.smithi008.stdout:3/565: chown d0/d3/de/c19 1165597256 1 2023-10-18T20:58:40.055 INFO:tasks.workunit.client.0.smithi008.stdout:3/566: chown d0/d3/c12 2229 1 2023-10-18T20:58:40.055 INFO:tasks.workunit.client.0.smithi008.stdout:3/567: write d0/d3/f33 [2639075,127717] 0 2023-10-18T20:58:40.055 INFO:tasks.workunit.client.0.smithi008.stdout:3/568: read - d0/d3/d42/fb0 zero size 2023-10-18T20:58:40.056 INFO:tasks.workunit.client.0.smithi008.stdout:3/569: symlink d0/d4a/d64/d80/lb3 0 2023-10-18T20:58:40.056 INFO:tasks.workunit.client.1.smithi060.stdout:1/798: creat d4/d6/f101 x:0 0 0 2023-10-18T20:58:40.056 INFO:tasks.workunit.client.1.smithi060.stdout:3/649: dwrite d0/fc [0,4194304] 0 2023-10-18T20:58:40.058 INFO:tasks.workunit.client.1.smithi060.stdout:6/722: creat d10/d17/dae/dbf/fe0 x:0 0 0 2023-10-18T20:58:40.058 INFO:tasks.workunit.client.1.smithi060.stdout:2/704: mknod d0/d16/d85/cee 0 2023-10-18T20:58:40.058 INFO:tasks.workunit.client.1.smithi060.stdout:4/634: dread d4/d15/fbe [0,4194304] 0 2023-10-18T20:58:40.059 INFO:tasks.workunit.client.0.smithi008.stdout:3/570: symlink d0/d3/de/d13/lb4 0 2023-10-18T20:58:40.059 INFO:tasks.workunit.client.0.smithi008.stdout:3/571: write d0/d3/d37/d74/fa4 [642597,120227] 0 2023-10-18T20:58:40.060 INFO:tasks.workunit.client.1.smithi060.stdout:6/723: mkdir d10/d17/d54/de1 0 2023-10-18T20:58:40.060 INFO:tasks.workunit.client.1.smithi060.stdout:6/724: chown f7 140 1 2023-10-18T20:58:40.061 INFO:tasks.workunit.client.1.smithi060.stdout:6/725: write d10/d25/f4f [1233224,125856] 0 2023-10-18T20:58:40.061 INFO:tasks.workunit.client.1.smithi060.stdout:6/726: stat d10/d2e/d75/d81/la7 0 2023-10-18T20:58:40.062 INFO:tasks.workunit.client.1.smithi060.stdout:6/727: write d10/d17/d2f/fa0 [4912941,43418] 0 2023-10-18T20:58:40.062 INFO:tasks.workunit.client.1.smithi060.stdout:6/728: fdatasync d10/d17/d70/fd9 0 2023-10-18T20:58:40.062 INFO:tasks.workunit.client.1.smithi060.stdout:2/705: creat d0/d3/d9e/dce/fef x:0 0 0 2023-10-18T20:58:40.063 INFO:tasks.workunit.client.1.smithi060.stdout:4/635: mknod d4/dc/d2a/d13/d33/cbf 0 2023-10-18T20:58:40.067 INFO:tasks.workunit.client.0.smithi008.stdout:3/572: mkdir d0/d3/de/d13/d35/db5 0 2023-10-18T20:58:40.067 INFO:tasks.workunit.client.0.smithi008.stdout:3/573: readlink d0/d3/d42/l38 0 2023-10-18T20:58:40.069 INFO:tasks.workunit.client.1.smithi060.stdout:2/706: truncate d0/d3/f89 414551 0 2023-10-18T20:58:40.074 INFO:tasks.workunit.client.1.smithi060.stdout:6/729: creat d10/d25/d3c/dd5/dd6/fe2 x:0 0 0 2023-10-18T20:58:40.074 INFO:tasks.workunit.client.1.smithi060.stdout:2/707: readlink d0/d45/dc9/d4a/l50 0 2023-10-18T20:58:40.078 INFO:tasks.workunit.client.1.smithi060.stdout:1/799: dread d4/d6/d33/f71 [0,4194304] 0 2023-10-18T20:58:40.082 INFO:tasks.workunit.client.1.smithi060.stdout:4/636: dread d4/d15/f8e [0,4194304] 0 2023-10-18T20:58:40.082 INFO:tasks.workunit.client.1.smithi060.stdout:4/637: fsync d4/dc/d2a/d2d/f74 0 2023-10-18T20:58:40.084 INFO:tasks.workunit.client.0.smithi008.stdout:3/574: dread d0/d4a/f5b [0,4194304] 0 2023-10-18T20:58:40.089 INFO:tasks.workunit.client.1.smithi060.stdout:7/775: dread de/d14/d2f/d3f/fde [0,4194304] 0 2023-10-18T20:58:40.091 INFO:tasks.workunit.client.1.smithi060.stdout:4/638: link d4/dc/d2a/d13/d33/cbf d4/dc/d2a/d83/db1/cc0 0 2023-10-18T20:58:40.092 INFO:tasks.workunit.client.0.smithi008.stdout:3/575: truncate d0/d3/f2e 2333788 0 2023-10-18T20:58:40.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.087+0000 7fb596eee700 1 -- 172.21.15.8:0/2037323871 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5900fbe40 con 0x7fb57c060fb0 2023-10-18T20:58:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.090+0000 7fb58dffb700 1 -- 172.21.15.8:0/2037323871 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fb5900fbe40 con 0x7fb57c060fb0 2023-10-18T20:58:40.094 INFO:tasks.workunit.client.0.smithi008.stdout:3/576: creat d0/d3/da9/fb6 x:0 0 0 2023-10-18T20:58:40.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.093+0000 7fb596eee700 1 -- 172.21.15.8:0/2037323871 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb57c060fb0 msgr2=0x7fb57c063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:40.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.093+0000 7fb596eee700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb57c060fb0 0x7fb57c063470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb578009490 tx=0x7fb578009b30).stop 2023-10-18T20:58:40.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.093+0000 7fb596eee700 1 -- 172.21.15.8:0/2037323871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5900f7980 msgr2=0x7fb590105260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:40.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.093+0000 7fb596eee700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5900f7980 0x7fb590105260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fb58000b790 tx=0x7fb5800092d0).stop 2023-10-18T20:58:40.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.094+0000 7fb596eee700 1 -- 172.21.15.8:0/2037323871 shutdown_connections 2023-10-18T20:58:40.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.094+0000 7fb596eee700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb57c060fb0 0x7fb57c063470 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:40.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.094+0000 7fb596eee700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5900f66e0 0x7fb590104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:40.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.094+0000 7fb596eee700 1 --2- 172.21.15.8:0/2037323871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5900f7980 0x7fb590105260 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:40.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.094+0000 7fb596eee700 1 -- 172.21.15.8:0/2037323871 >> 172.21.15.8:0/2037323871 conn(0x7fb5900f1e40 msgr2=0x7fb59006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:40.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.094+0000 7fb596eee700 1 -- 172.21.15.8:0/2037323871 shutdown_connections 2023-10-18T20:58:40.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.094+0000 7fb596eee700 1 -- 172.21.15.8:0/2037323871 wait complete. 2023-10-18T20:58:40.100 INFO:tasks.workunit.client.1.smithi060.stdout:5/732: sync 2023-10-18T20:58:40.100 INFO:tasks.workunit.client.1.smithi060.stdout:8/660: sync 2023-10-18T20:58:40.100 INFO:tasks.workunit.client.1.smithi060.stdout:1/800: rmdir d4/d6/d7/df/d59 39 2023-10-18T20:58:40.101 INFO:tasks.workunit.client.1.smithi060.stdout:4/639: mkdir d4/d91/dc1 0 2023-10-18T20:58:40.101 INFO:tasks.workunit.client.1.smithi060.stdout:1/801: symlink d4/da/de0/de9/l102 0 2023-10-18T20:58:40.101 INFO:tasks.workunit.client.1.smithi060.stdout:1/802: write d4/d6/d7/d2f/d7b/d2a/d32/dd/f5c [4500201,48367] 0 2023-10-18T20:58:40.102 INFO:tasks.workunit.client.1.smithi060.stdout:9/649: dwrite d3/d99/d19/d54/d8f/fe3 [0,4194304] 0 2023-10-18T20:58:40.105 INFO:tasks.workunit.client.0.smithi008.stdout:3/577: unlink d0/d3/d37/c76 0 2023-10-18T20:58:40.106 INFO:tasks.workunit.client.1.smithi060.stdout:1/803: mkdir d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/d103 0 2023-10-18T20:58:40.106 INFO:tasks.workunit.client.1.smithi060.stdout:1/804: readlink d4/da/de0/de9/lf9 0 2023-10-18T20:58:40.107 INFO:tasks.workunit.client.1.smithi060.stdout:1/805: creat d4/d6/d7/d2f/d6d/f104 x:0 0 0 2023-10-18T20:58:40.108 INFO:tasks.workunit.client.1.smithi060.stdout:1/806: chown d4/d6/d7/d2f/d7b/c78 14148 1 2023-10-18T20:58:40.108 INFO:tasks.workunit.client.1.smithi060.stdout:9/650: creat d3/d99/d1c/d2a/d80/da0/dc2/de0/fed x:0 0 0 2023-10-18T20:58:40.108 INFO:tasks.workunit.client.1.smithi060.stdout:9/651: truncate d3/d99/d1c/d2a/d80/da0/dc2/d9e/fce 4305429 0 2023-10-18T20:58:40.109 INFO:tasks.workunit.client.0.smithi008.stdout:3/578: creat d0/d3/d37/d74/da2/fb7 x:0 0 0 2023-10-18T20:58:40.110 INFO:tasks.workunit.client.1.smithi060.stdout:1/807: mkdir d4/d6/d7/df/d105 0 2023-10-18T20:58:40.110 INFO:tasks.workunit.client.0.smithi008.stdout:3/579: chown d0/d3/d37/f78 48851 1 2023-10-18T20:58:40.111 INFO:tasks.workunit.client.1.smithi060.stdout:2/708: write d0/f5d [3826992,121557] 0 2023-10-18T20:58:40.111 INFO:tasks.workunit.client.1.smithi060.stdout:2/709: chown d0/d8/d87/fcb 52 1 2023-10-18T20:58:40.114 INFO:tasks.workunit.client.1.smithi060.stdout:1/808: getdents d4/d6/d33 0 2023-10-18T20:58:40.119 INFO:tasks.workunit.client.1.smithi060.stdout:1/809: mkdir d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d106 0 2023-10-18T20:58:40.119 INFO:tasks.workunit.client.1.smithi060.stdout:1/810: chown d4/c72 939424 1 2023-10-18T20:58:40.131 INFO:tasks.workunit.client.1.smithi060.stdout:7/776: dread de/f19 [0,4194304] 0 2023-10-18T20:58:40.135 INFO:tasks.workunit.client.1.smithi060.stdout:4/640: dread d4/dc/f58 [0,4194304] 0 2023-10-18T20:58:40.135 INFO:tasks.workunit.client.1.smithi060.stdout:4/641: readlink d4/d15/l8b 0 2023-10-18T20:58:40.136 INFO:tasks.workunit.client.1.smithi060.stdout:4/642: fsync d4/dc/d2a/d31/f46 0 2023-10-18T20:58:40.136 INFO:tasks.workunit.client.1.smithi060.stdout:4/643: chown d4/dc/d2a/d13/dbd 106 1 2023-10-18T20:58:40.138 INFO:tasks.workunit.client.1.smithi060.stdout:4/644: mknod d4/dc/cc2 0 2023-10-18T20:58:40.142 INFO:tasks.workunit.client.1.smithi060.stdout:4/645: unlink d4/dc/d2a/d31/l6f 0 2023-10-18T20:58:40.154 INFO:tasks.workunit.client.1.smithi060.stdout:4/646: link d4/dc/d2a/d1d/l7a d4/lc3 0 2023-10-18T20:58:40.154 INFO:tasks.workunit.client.1.smithi060.stdout:4/647: fsync d4/dc/d2a/d2d/f74 0 2023-10-18T20:58:40.156 INFO:tasks.workunit.client.1.smithi060.stdout:6/730: dwrite d10/d17/d2f/fdd [0,4194304] 0 2023-10-18T20:58:40.156 INFO:tasks.workunit.client.1.smithi060.stdout:6/731: fdatasync d10/d17/d28/f5c 0 2023-10-18T20:58:40.156 INFO:tasks.workunit.client.1.smithi060.stdout:4/648: mkdir d4/d91/dc1/dc4 0 2023-10-18T20:58:40.161 INFO:tasks.workunit.client.1.smithi060.stdout:6/732: mknod d10/d17/dae/dbf/ce3 0 2023-10-18T20:58:40.162 INFO:tasks.workunit.client.1.smithi060.stdout:6/733: truncate d10/d2e/d75/d81/d8b/f9b 1114938 0 2023-10-18T20:58:40.171 INFO:tasks.workunit.client.1.smithi060.stdout:3/650: dwrite d0/d22/d26/f43 [0,4194304] 0 2023-10-18T20:58:40.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:39.352785+0000 mgr.smithi008.flmjzp (mgr.14640) 7 : audit [DBG] from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:40.176 INFO:tasks.workunit.client.1.smithi060.stdout:9/652: dread d3/d99/d1c/d5a/d5d/f9a [0,4194304] 0 2023-10-18T20:58:40.176 INFO:tasks.workunit.client.1.smithi060.stdout:3/651: mkdir d0/d3c/d3d/d4d/d95/de7 0 2023-10-18T20:58:40.176 INFO:tasks.workunit.client.1.smithi060.stdout:3/652: fdatasync d0/f4e 0 2023-10-18T20:58:40.178 INFO:tasks.workunit.client.1.smithi060.stdout:2/710: dwrite d0/d16/d81/da1/fac [0,4194304] 0 2023-10-18T20:58:40.179 INFO:tasks.workunit.client.1.smithi060.stdout:2/711: read d0/d3/f35 [1387472,93111] 0 2023-10-18T20:58:40.179 INFO:tasks.workunit.client.1.smithi060.stdout:2/712: chown d0/d45/d49/f3f 4 1 2023-10-18T20:58:40.179 INFO:tasks.workunit.client.1.smithi060.stdout:9/653: rename d3/d99/d1c/d2a/d2d/db9/ce5 to d3/d99/d1c/d2a/d33/cee 0 2023-10-18T20:58:40.181 INFO:tasks.workunit.client.1.smithi060.stdout:3/653: mknod d0/d22/d26/d2c/ce8 0 2023-10-18T20:58:40.181 INFO:tasks.workunit.client.1.smithi060.stdout:3/654: fdatasync d0/d22/d26/d29/fab 0 2023-10-18T20:58:40.186 INFO:tasks.workunit.client.1.smithi060.stdout:3/655: creat d0/d22/d26/d2c/da0/fe9 x:0 0 0 2023-10-18T20:58:40.190 INFO:tasks.workunit.client.1.smithi060.stdout:6/734: write d10/d2e/d75/dc4/fa5 [2313273,89890] 0 2023-10-18T20:58:40.190 INFO:tasks.workunit.client.1.smithi060.stdout:6/735: read fd [499845,105675] 0 2023-10-18T20:58:40.190 INFO:tasks.workunit.client.1.smithi060.stdout:6/736: fdatasync d10/d17/dae/fd0 0 2023-10-18T20:58:40.195 INFO:tasks.workunit.client.1.smithi060.stdout:6/737: rename d10/d17/d70/dba/lbb to d10/d17/d70/le4 0 2023-10-18T20:58:40.195 INFO:tasks.workunit.client.1.smithi060.stdout:6/738: fdatasync d10/d25/f8d 0 2023-10-18T20:58:40.195 INFO:tasks.workunit.client.1.smithi060.stdout:6/739: truncate fc 2030349 0 2023-10-18T20:58:40.197 INFO:tasks.workunit.client.0.smithi008.stdout:3/580: dwrite d0/d3/d42/d88/f91 [0,4194304] 0 2023-10-18T20:58:40.198 INFO:tasks.workunit.client.0.smithi008.stdout:3/581: chown d0/d3/d37/d6f/l95 24435 1 2023-10-18T20:58:40.199 INFO:tasks.workunit.client.1.smithi060.stdout:8/661: dwrite d4/fc6 [0,4194304] 0 2023-10-18T20:58:40.199 INFO:tasks.workunit.client.1.smithi060.stdout:5/733: dwrite d0/da/d79/da5/f9e [8388608,4194304] 0 2023-10-18T20:58:40.202 INFO:tasks.workunit.client.1.smithi060.stdout:5/734: write d0/ffc [231286,62984] 0 2023-10-18T20:58:40.202 INFO:tasks.workunit.client.1.smithi060.stdout:1/811: dwrite d4/d6/d7/d2f/d7b/d2a/d32/fce [0,4194304] 0 2023-10-18T20:58:40.205 INFO:tasks.workunit.client.1.smithi060.stdout:5/735: write d0/da/d79/da5/f3e [829227,81839] 0 2023-10-18T20:58:40.214 INFO:tasks.workunit.client.1.smithi060.stdout:8/662: unlink d4/d9/d31/d35/f84 0 2023-10-18T20:58:40.215 INFO:tasks.workunit.client.1.smithi060.stdout:8/663: stat d4/d9/d31/d35/d9f/da3/cba 0 2023-10-18T20:58:40.216 INFO:tasks.workunit.client.1.smithi060.stdout:4/649: dwrite d4/f6a [0,4194304] 0 2023-10-18T20:58:40.216 INFO:tasks.workunit.client.1.smithi060.stdout:4/650: chown d4/d15/c77 6582389 1 2023-10-18T20:58:40.219 INFO:tasks.workunit.client.1.smithi060.stdout:1/812: symlink d4/d6/d7/d35/l107 0 2023-10-18T20:58:40.221 INFO:tasks.workunit.client.0.smithi008.stdout:3/582: rmdir d0/d3/de 39 2023-10-18T20:58:40.228 INFO:tasks.workunit.client.1.smithi060.stdout:4/651: symlink d4/dc/d2a/d13/d27/lc5 0 2023-10-18T20:58:40.228 INFO:tasks.workunit.client.1.smithi060.stdout:4/652: creat d4/dc/d2a/d2d/d69/d89/fc6 x:0 0 0 2023-10-18T20:58:40.233 INFO:tasks.workunit.client.1.smithi060.stdout:1/813: rename d4/d6/d7/d2f/d7b/d2a/d32/dd/f4f to d4/d6/d33/d58/f108 0 2023-10-18T20:58:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:39.352785+0000 mgr.smithi008.flmjzp (mgr.14640) 7 : audit [DBG] from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:40.246 INFO:tasks.workunit.client.1.smithi060.stdout:1/814: dread d4/d6/d7/d2f/fba [4194304,4194304] 0 2023-10-18T20:58:40.247 INFO:tasks.workunit.client.1.smithi060.stdout:1/815: mknod d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/c109 0 2023-10-18T20:58:40.248 INFO:tasks.workunit.client.1.smithi060.stdout:1/816: dread - d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/fdd zero size 2023-10-18T20:58:40.250 INFO:tasks.workunit.client.0.smithi008.stdout:3/583: dread d0/d3/f43 [0,4194304] 0 2023-10-18T20:58:40.252 INFO:tasks.workunit.client.1.smithi060.stdout:3/656: dwrite d0/d22/d26/f43 [0,4194304] 0 2023-10-18T20:58:40.252 INFO:tasks.workunit.client.0.smithi008.stdout:3/584: link d0/d3/de/l32 d0/d3/d42/lb8 0 2023-10-18T20:58:40.253 INFO:tasks.workunit.client.0.smithi008.stdout:3/585: creat d0/d3/da9/fb9 x:0 0 0 2023-10-18T20:58:40.253 INFO:tasks.workunit.client.0.smithi008.stdout:3/586: write d0/d4a/d64/f83 [635991,98550] 0 2023-10-18T20:58:40.253 INFO:tasks.workunit.client.1.smithi060.stdout:5/736: dwrite d0/d6/d8/df/d27/f3c [0,4194304] 0 2023-10-18T20:58:40.253 INFO:tasks.workunit.client.1.smithi060.stdout:5/737: truncate d0/d6/d9/d82/d84/db2/d2a/f5a 4676634 0 2023-10-18T20:58:40.254 INFO:tasks.workunit.client.1.smithi060.stdout:5/738: chown d0/d6/d8/d81/lc4 3735 1 2023-10-18T20:58:40.254 INFO:tasks.workunit.client.1.smithi060.stdout:5/739: stat d0/d6/d9/d82/d84/db2/d41/lc7 0 2023-10-18T20:58:40.254 INFO:tasks.workunit.client.1.smithi060.stdout:5/740: fsync d0/da/dc8/de4/d4f/fa2 0 2023-10-18T20:58:40.255 INFO:tasks.workunit.client.0.smithi008.stdout:3/587: symlink d0/d3/d37/d74/lba 0 2023-10-18T20:58:40.255 INFO:tasks.workunit.client.0.smithi008.stdout:3/588: mkdir d0/d84/dad/dbb 0 2023-10-18T20:58:40.256 INFO:tasks.workunit.client.1.smithi060.stdout:1/817: dread d4/d6/d7/d35/f97 [0,4194304] 0 2023-10-18T20:58:40.258 INFO:tasks.workunit.client.1.smithi060.stdout:3/657: link d0/d5e/dbc/cc8 d0/d22/d26/d2b/cea 0 2023-10-18T20:58:40.261 INFO:tasks.workunit.client.1.smithi060.stdout:5/741: rmdir d0/d6/d9/d82/d84 39 2023-10-18T20:58:40.261 INFO:tasks.workunit.client.1.smithi060.stdout:1/818: link d4/d6/d7/d2f/d7b/d2a/d32/fe4 d4/d6/d7/d2f/d7b/d2a/d32/d56/f10a 0 2023-10-18T20:58:40.262 INFO:tasks.workunit.client.1.smithi060.stdout:3/658: mknod d0/d22/d26/d79/ceb 0 2023-10-18T20:58:40.265 INFO:tasks.workunit.client.1.smithi060.stdout:3/659: creat d0/d22/d26/d2c/fec x:0 0 0 2023-10-18T20:58:40.265 INFO:tasks.workunit.client.1.smithi060.stdout:3/660: write d0/d22/d26/d8c/fb6 [1253580,12588] 0 2023-10-18T20:58:40.268 INFO:tasks.workunit.client.1.smithi060.stdout:8/664: dread d4/d9/f79 [0,4194304] 0 2023-10-18T20:58:40.269 INFO:tasks.workunit.client.1.smithi060.stdout:8/665: fdatasync d4/d9/d31/f66 0 2023-10-18T20:58:40.269 INFO:tasks.workunit.client.1.smithi060.stdout:8/666: write d4/d9/f83 [640569,64866] 0 2023-10-18T20:58:40.269 INFO:tasks.workunit.client.1.smithi060.stdout:1/819: rmdir d4/d6/d14/d41 39 2023-10-18T20:58:40.271 INFO:tasks.workunit.client.1.smithi060.stdout:3/661: write d0/d22/d26/d8c/fbb [225302,87165] 0 2023-10-18T20:58:40.277 INFO:tasks.workunit.client.1.smithi060.stdout:4/653: dwrite d4/dc/d2a/d39/d53/d65/d8d/fa1 [0,4194304] 0 2023-10-18T20:58:40.279 INFO:tasks.workunit.client.1.smithi060.stdout:1/820: link d4/da/de0/de9/l102 d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/l10b 0 2023-10-18T20:58:40.284 INFO:tasks.workunit.client.0.smithi008.stdout:3/589: dread d0/f54 [0,4194304] 0 2023-10-18T20:58:40.289 INFO:tasks.workunit.client.1.smithi060.stdout:4/654: write d4/dc/d2a/d39/f8c [3865686,69835] 0 2023-10-18T20:58:40.290 INFO:tasks.workunit.client.0.smithi008.stdout:3/590: symlink d0/d3/d42/d88/lbc 0 2023-10-18T20:58:40.290 INFO:tasks.workunit.client.0.smithi008.stdout:3/591: chown d0/d3/d15/c57 81 1 2023-10-18T20:58:40.290 INFO:tasks.workunit.client.0.smithi008.stdout:3/592: chown d0/d3/de/d13/d35/d51/f8d 606 1 2023-10-18T20:58:40.292 INFO:tasks.workunit.client.0.smithi008.stdout:3/593: symlink d0/d3/da9/lbd 0 2023-10-18T20:58:40.292 INFO:tasks.workunit.client.0.smithi008.stdout:3/594: write d0/d3/d42/f99 [430770,23816] 0 2023-10-18T20:58:40.295 INFO:tasks.workunit.client.0.smithi008.stdout:3/595: creat d0/d3/de/d13/d35/d51/fbe x:0 0 0 2023-10-18T20:58:40.296 INFO:tasks.workunit.client.1.smithi060.stdout:8/667: dread d4/f19 [4194304,4194304] 0 2023-10-18T20:58:40.311 INFO:tasks.workunit.client.1.smithi060.stdout:8/668: write d4/fc6 [696313,130218] 0 2023-10-18T20:58:40.317 INFO:tasks.workunit.client.0.smithi008.stdout:3/596: write d0/d3/d42/f30 [1501100,14479] 0 2023-10-18T20:58:40.318 INFO:tasks.workunit.client.1.smithi060.stdout:8/669: getdents d4/d9/d37/d4e/d6e/d7b 0 2023-10-18T20:58:40.319 INFO:tasks.workunit.client.0.smithi008.stdout:3/597: rename d0/d3/de/d13/d7d to d0/d3/de/d13/d35/dbf 0 2023-10-18T20:58:40.321 INFO:tasks.workunit.client.1.smithi060.stdout:5/742: dwrite d0/d6/d8/df/f4e [0,4194304] 0 2023-10-18T20:58:40.322 INFO:tasks.workunit.client.1.smithi060.stdout:4/655: read d4/dc/f6c [81039,58347] 0 2023-10-18T20:58:40.322 INFO:tasks.workunit.client.1.smithi060.stdout:4/656: write d4/dc/d2a/d39/d53/fb5 [910448,87728] 0 2023-10-18T20:58:40.322 INFO:tasks.workunit.client.1.smithi060.stdout:4/657: read - d4/dc/d2a/d2d/f74 zero size 2023-10-18T20:58:40.326 INFO:tasks.workunit.client.1.smithi060.stdout:8/670: creat d4/d9/db4/fc8 x:0 0 0 2023-10-18T20:58:40.328 INFO:tasks.workunit.client.0.smithi008.stdout:3/598: write d0/d3/de/d13/f75 [1294417,51122] 0 2023-10-18T20:58:40.330 INFO:tasks.workunit.client.1.smithi060.stdout:5/743: mkdir d0/d47/df2/d10e 0 2023-10-18T20:58:40.331 INFO:tasks.workunit.client.0.smithi008.stdout:3/599: write d0/d3/d37/f61 [440089,83856] 0 2023-10-18T20:58:40.336 INFO:tasks.workunit.client.1.smithi060.stdout:0/711: sync 2023-10-18T20:58:40.336 INFO:tasks.workunit.client.1.smithi060.stdout:7/777: sync 2023-10-18T20:58:40.336 INFO:tasks.workunit.client.1.smithi060.stdout:9/654: sync 2023-10-18T20:58:40.336 INFO:tasks.workunit.client.1.smithi060.stdout:2/713: sync 2023-10-18T20:58:40.336 INFO:tasks.workunit.client.1.smithi060.stdout:4/658: mkdir d4/dc/d2a/d2d/dc7 0 2023-10-18T20:58:40.337 INFO:tasks.workunit.client.1.smithi060.stdout:6/740: sync 2023-10-18T20:58:40.337 INFO:tasks.workunit.client.1.smithi060.stdout:5/744: rename d0/da/d79 to d0/dd/d76/d10f 0 2023-10-18T20:58:40.337 INFO:tasks.workunit.client.1.smithi060.stdout:5/745: chown d0/d6/d9/d82/d96 12138 1 2023-10-18T20:58:40.338 INFO:tasks.workunit.client.0.smithi008.stdout:3/600: rename d0/d3/de/d13/d35/db5 to d0/dc0 0 2023-10-18T20:58:40.338 INFO:tasks.workunit.client.1.smithi060.stdout:8/671: dread d4/d9/d31/d35/d9f/da3/f9b [0,4194304] 0 2023-10-18T20:58:40.338 INFO:tasks.workunit.client.1.smithi060.stdout:9/655: symlink d3/d99/d1c/d2a/d80/da0/ddd/lef 0 2023-10-18T20:58:40.339 INFO:tasks.workunit.client.0.smithi008.stdout:3/601: getdents d0/d3 0 2023-10-18T20:58:40.340 INFO:tasks.workunit.client.1.smithi060.stdout:3/662: dwrite d0/d3c/d3d/d82/fe1 [0,4194304] 0 2023-10-18T20:58:40.342 INFO:tasks.workunit.client.1.smithi060.stdout:1/821: dwrite d4/d6/d7/d2f/d6d/f9d [0,4194304] 0 2023-10-18T20:58:40.342 INFO:tasks.workunit.client.1.smithi060.stdout:1/822: chown d4/d6/d7/df/f6b 56810189 1 2023-10-18T20:58:40.344 INFO:tasks.workunit.client.1.smithi060.stdout:2/714: creat d0/d3/d27/d4d/d5e/d96/ff0 x:0 0 0 2023-10-18T20:58:40.344 INFO:tasks.workunit.client.1.smithi060.stdout:4/659: mkdir d4/dc/d2a/d13/d27/d68/dc8 0 2023-10-18T20:58:40.344 INFO:tasks.workunit.client.1.smithi060.stdout:2/715: readlink d0/d45/dc9/d4a/l50 0 2023-10-18T20:58:40.344 INFO:tasks.workunit.client.1.smithi060.stdout:4/660: stat d4/dc/d2a/d39/d53/d76/da7/fab 0 2023-10-18T20:58:40.345 INFO:tasks.workunit.client.1.smithi060.stdout:4/661: fsync d4/dc/d2a/f54 0 2023-10-18T20:58:40.345 INFO:tasks.workunit.client.1.smithi060.stdout:2/716: write d0/d16/d81/da1/fab [4886811,118172] 0 2023-10-18T20:58:40.345 INFO:tasks.workunit.client.1.smithi060.stdout:6/741: symlink d10/d2e/d75/d81/le5 0 2023-10-18T20:58:40.345 INFO:tasks.workunit.client.1.smithi060.stdout:6/742: truncate d10/d17/dae/fd0 999028 0 2023-10-18T20:58:40.346 INFO:tasks.workunit.client.1.smithi060.stdout:0/712: dread d3/fd2 [0,4194304] 0 2023-10-18T20:58:40.346 INFO:tasks.workunit.client.1.smithi060.stdout:0/713: stat d3/d8/f31 0 2023-10-18T20:58:40.346 INFO:tasks.workunit.client.1.smithi060.stdout:4/662: write d4/dc/d2a/d13/f9b [1251293,50735] 0 2023-10-18T20:58:40.348 INFO:tasks.workunit.client.1.smithi060.stdout:9/656: mkdir d3/d99/d19/d54/df0 0 2023-10-18T20:58:40.349 INFO:tasks.workunit.client.1.smithi060.stdout:2/717: chown d0/d8/c3a 566315 1 2023-10-18T20:58:40.350 INFO:tasks.workunit.client.1.smithi060.stdout:7/778: write de/f1f [2679348,80680] 0 2023-10-18T20:58:40.350 INFO:tasks.workunit.client.1.smithi060.stdout:7/779: chown de/d14/d49/d68/c26 6520740 1 2023-10-18T20:58:40.350 INFO:tasks.workunit.client.1.smithi060.stdout:7/780: fdatasync de/f19 0 2023-10-18T20:58:40.351 INFO:tasks.workunit.client.1.smithi060.stdout:6/743: symlink d10/d17/d7a/le6 0 2023-10-18T20:58:40.354 INFO:tasks.workunit.client.1.smithi060.stdout:4/663: rmdir d4/dc/d40/d80 39 2023-10-18T20:58:40.354 INFO:tasks.workunit.client.1.smithi060.stdout:1/823: getdents d4/d6/d7/d2f/d7b/d2a/d32/dd/da4 0 2023-10-18T20:58:40.354 INFO:tasks.workunit.client.1.smithi060.stdout:1/824: write d4/d6/d7/df/d59/fc6 [1087004,98270] 0 2023-10-18T20:58:40.354 INFO:tasks.workunit.client.1.smithi060.stdout:1/825: fsync d4/d6/d7/d2f/f6a 0 2023-10-18T20:58:40.357 INFO:tasks.workunit.client.1.smithi060.stdout:2/718: mknod d0/d3/d27/d4d/cf1 0 2023-10-18T20:58:40.357 INFO:tasks.workunit.client.1.smithi060.stdout:7/781: creat de/d14/d2f/d3f/d5a/dc8/ff9 x:0 0 0 2023-10-18T20:58:40.361 INFO:tasks.workunit.client.1.smithi060.stdout:6/744: creat d10/d2e/fe7 x:0 0 0 2023-10-18T20:58:40.362 INFO:tasks.workunit.client.1.smithi060.stdout:6/745: stat d10/d2e/d75/d81 0 2023-10-18T20:58:40.366 INFO:tasks.workunit.client.1.smithi060.stdout:1/826: symlink d4/d6/d7/df/d59/l10c 0 2023-10-18T20:58:40.366 INFO:tasks.workunit.client.1.smithi060.stdout:2/719: readlink d0/d8/l18 0 2023-10-18T20:58:40.366 INFO:tasks.workunit.client.1.smithi060.stdout:1/827: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f10d x:0 0 0 2023-10-18T20:58:40.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.365+0000 7f0d10a49700 1 -- 172.21.15.8:0/1957508086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d0c0f66e0 msgr2=0x7f0d0c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:40.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.365+0000 7f0d10a49700 1 --2- 172.21.15.8:0/1957508086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d0c0f66e0 0x7f0d0c0f6b40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f0cfc004660 tx=0x7f0cfc009b30).stop 2023-10-18T20:58:40.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.365+0000 7f0d10a49700 1 -- 172.21.15.8:0/1957508086 shutdown_connections 2023-10-18T20:58:40.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.365+0000 7f0d10a49700 1 --2- 172.21.15.8:0/1957508086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d0c0f66e0 0x7f0d0c0f6b40 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0x7f0cfc004660 tx=0x7f0cfc009b30).stop 2023-10-18T20:58:40.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.365+0000 7f0d10a49700 1 --2- 172.21.15.8:0/1957508086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d0c0f5440 0x7f0d0c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:40.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.365+0000 7f0d10a49700 1 -- 172.21.15.8:0/1957508086 >> 172.21.15.8:0/1957508086 conn(0x7f0d0c0f0ba0 msgr2=0x7f0d0c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:40.370 INFO:tasks.workunit.client.1.smithi060.stdout:1/828: write d4/d6/d7/d2f/d7b/d2a/d32/d56/fa6 [5061174,31296] 0 2023-10-18T20:58:40.370 INFO:tasks.workunit.client.1.smithi060.stdout:0/714: rename d3/d8/d14/d55/d74/d76/d68/d98 to d3/d8/d3c/d87/de2 0 2023-10-18T20:58:40.370 INFO:tasks.workunit.client.1.smithi060.stdout:0/715: creat d3/d8/d14/d55/dad/daa/fe3 x:0 0 0 2023-10-18T20:58:40.370 INFO:tasks.workunit.client.1.smithi060.stdout:7/782: creat de/d14/d49/d68/d7d/d7e/ffa x:0 0 0 2023-10-18T20:58:40.370 INFO:tasks.workunit.client.1.smithi060.stdout:2/720: symlink d0/d3/d27/d4d/d53/de5/lf2 0 2023-10-18T20:58:40.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.367+0000 7f0d10a49700 1 -- 172.21.15.8:0/1957508086 shutdown_connections 2023-10-18T20:58:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.367+0000 7f0d10a49700 1 -- 172.21.15.8:0/1957508086 wait complete. 2023-10-18T20:58:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.369+0000 7f0d10a49700 1 Processor -- start 2023-10-18T20:58:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.369+0000 7f0d10a49700 1 -- start start 2023-10-18T20:58:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.370+0000 7f0d10a49700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d0c0f5440 0x7f0d0c104c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:40.374 INFO:tasks.workunit.client.1.smithi060.stdout:3/663: write d0/d22/d26/d2c/f74 [726960,354] 0 2023-10-18T20:58:40.374 INFO:tasks.workunit.client.1.smithi060.stdout:3/664: readlink d0/d3c/d3d/d4d/d95/la1 0 2023-10-18T20:58:40.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.371+0000 7f0d10a49700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d0c105120 0x7f0d0c106060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:40.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.371+0000 7f0d10a49700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c1055f0 con 0x7f0d0c0f5440 2023-10-18T20:58:40.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.371+0000 7f0d10a49700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c105730 con 0x7f0d0c105120 2023-10-18T20:58:40.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.371+0000 7f0d0ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d0c0f5440 0x7f0d0c104c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:40.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.371+0000 7f0d0ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d0c0f5440 0x7f0d0c104c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51008/0 (socket says 172.21.15.8:51008) 2023-10-18T20:58:40.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.371+0000 7f0d0ad9d700 1 -- 172.21.15.8:0/3767968045 learned_addr learned my addr 172.21.15.8:0/3767968045 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:40.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.372+0000 7f0d0a59c700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d0c105120 0x7f0d0c106060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.373+0000 7f0d0a59c700 1 -- 172.21.15.8:0/3767968045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d0c0f5440 msgr2=0x7f0d0c104c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.373+0000 7f0d0a59c700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d0c0f5440 0x7f0d0c104c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.373+0000 7f0d0a59c700 1 -- 172.21.15.8:0/3767968045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc005040 con 0x7f0d0c105120 2023-10-18T20:58:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.373+0000 7f0d0a59c700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d0c105120 0x7f0d0c106060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0d0c0f6170 tx=0x7f0cfc009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:40.380 INFO:tasks.workunit.client.1.smithi060.stdout:5/746: dread d0/f1d [0,4194304] 0 2023-10-18T20:58:40.380 INFO:tasks.workunit.client.1.smithi060.stdout:5/747: chown d0/f8a 2 1 2023-10-18T20:58:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.374+0000 7f0cf37fe700 1 -- 172.21.15.8:0/3767968045 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cfc013380 con 0x7f0d0c105120 2023-10-18T20:58:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.374+0000 7f0d10a49700 1 -- 172.21.15.8:0/3767968045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0c106550 con 0x7f0d0c105120 2023-10-18T20:58:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.374+0000 7f0d10a49700 1 -- 172.21.15.8:0/3767968045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0c106a30 con 0x7f0d0c105120 2023-10-18T20:58:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.374+0000 7f0cf37fe700 1 -- 172.21.15.8:0/3767968045 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0cfc009320 con 0x7f0d0c105120 2023-10-18T20:58:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.374+0000 7f0cf37fe700 1 -- 172.21.15.8:0/3767968045 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cfc014d20 con 0x7f0d0c105120 2023-10-18T20:58:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.376+0000 7f0d10a49700 1 -- 172.21.15.8:0/3767968045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec004fa0 con 0x7f0d0c105120 2023-10-18T20:58:40.384 INFO:tasks.workunit.client.1.smithi060.stdout:1/829: dread d4/d6/d7/df/f6b [0,4194304] 0 2023-10-18T20:58:40.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.382+0000 7f0cf37fe700 1 -- 172.21.15.8:0/3767968045 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 27) v1 ==== 77192+0+0 (secure 0 0 0) 0x7f0cfc014420 con 0x7f0d0c105120 2023-10-18T20:58:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.383+0000 7f0cf37fe700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0cf4061050 0x7f0cf4063510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.383+0000 7f0cf37fe700 1 -- 172.21.15.8:0/3767968045 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0cfc07d6a0 con 0x7f0d0c105120 2023-10-18T20:58:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.384+0000 7f0d0ad9d700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0cf4061050 0x7f0cf4063510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:40.388 INFO:tasks.workunit.client.1.smithi060.stdout:4/664: write d4/d15/f45 [1898270,72009] 0 2023-10-18T20:58:40.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.385+0000 7f0d0ad9d700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0cf4061050 0x7f0cf4063510 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f0d0c1049c0 tx=0x7f0d0000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:40.393 INFO:tasks.workunit.client.1.smithi060.stdout:0/716: creat d3/d8/d14/d55/d74/fe4 x:0 0 0 2023-10-18T20:58:40.393 INFO:tasks.workunit.client.1.smithi060.stdout:3/665: rmdir d0/d3c/d3d/d4d 39 2023-10-18T20:58:40.393 INFO:tasks.workunit.client.1.smithi060.stdout:7/783: getdents de/d14/d2f/d8f/d65 0 2023-10-18T20:58:40.393 INFO:tasks.workunit.client.1.smithi060.stdout:1/830: creat d4/da/de0/de9/f10e x:0 0 0 2023-10-18T20:58:40.395 INFO:tasks.workunit.client.1.smithi060.stdout:5/748: creat d0/dd/d76/f110 x:0 0 0 2023-10-18T20:58:40.395 INFO:tasks.workunit.client.1.smithi060.stdout:7/784: mknod de/d14/d3a/d46/d73/cfb 0 2023-10-18T20:58:40.396 INFO:tasks.workunit.client.1.smithi060.stdout:7/785: truncate de/d14/f30 1634513 0 2023-10-18T20:58:40.398 INFO:tasks.workunit.client.1.smithi060.stdout:7/786: symlink de/lfc 0 2023-10-18T20:58:40.401 INFO:tasks.workunit.client.1.smithi060.stdout:1/831: mknod d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/deb/c10f 0 2023-10-18T20:58:40.404 INFO:tasks.workunit.client.0.smithi008.stdout:3/602: dwrite d0/d3/de/d13/f49 [0,4194304] 0 2023-10-18T20:58:40.404 INFO:tasks.workunit.client.1.smithi060.stdout:7/787: rename de/d29/c8a to de/d14/d3a/d46/d73/cfd 0 2023-10-18T20:58:40.409 INFO:tasks.workunit.client.1.smithi060.stdout:0/717: dread d3/d8/dac/fcd [0,4194304] 0 2023-10-18T20:58:40.413 INFO:tasks.workunit.client.1.smithi060.stdout:7/788: creat de/d14/d2f/dd3/ffe x:0 0 0 2023-10-18T20:58:40.413 INFO:tasks.workunit.client.1.smithi060.stdout:7/789: fdatasync de/ff 0 2023-10-18T20:58:40.413 INFO:tasks.workunit.client.1.smithi060.stdout:7/790: fdatasync de/d14/d3a/d46/d73/f82 0 2023-10-18T20:58:40.413 INFO:tasks.workunit.client.1.smithi060.stdout:5/749: read d0/d6/f6a [791324,72414] 0 2023-10-18T20:58:40.416 INFO:tasks.workunit.client.1.smithi060.stdout:1/832: rename d4/d38/da0 to d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/deb/d110 0 2023-10-18T20:58:40.416 INFO:tasks.workunit.client.1.smithi060.stdout:1/833: creat d4/d6/d7/d2f/d7b/d2a/d32/f111 x:0 0 0 2023-10-18T20:58:40.416 INFO:tasks.workunit.client.1.smithi060.stdout:1/834: readlink d4/da/lb6 0 2023-10-18T20:58:40.417 INFO:tasks.workunit.client.0.smithi008.stdout:3/603: rmdir d0/d3/d42/d88 39 2023-10-18T20:58:40.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.414+0000 7f0cf37fe700 1 -- 172.21.15.8:0/3767968045 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7f0cfc04da50 con 0x7f0d0c105120 2023-10-18T20:58:40.418 INFO:tasks.workunit.client.1.smithi060.stdout:0/718: mkdir d3/de5 0 2023-10-18T20:58:40.418 INFO:tasks.workunit.client.1.smithi060.stdout:4/665: dread d4/dc/d2a/d13/d33/f35 [0,4194304] 0 2023-10-18T20:58:40.418 INFO:tasks.workunit.client.0.smithi008.stdout:3/604: write d0/d3/de/d13/d35/d51/f8d [726013,128649] 0 2023-10-18T20:58:40.419 INFO:tasks.workunit.client.0.smithi008.stdout:3/605: getdents d0/d3/de 0 2023-10-18T20:58:40.419 INFO:tasks.workunit.client.1.smithi060.stdout:5/750: unlink d0/da/f9a 0 2023-10-18T20:58:40.422 INFO:tasks.workunit.client.0.smithi008.stdout:3/606: link d0/d3/d42/d52/l9c d0/d3/de/d13/d35/dbf/lc1 0 2023-10-18T20:58:40.422 INFO:tasks.workunit.client.0.smithi008.stdout:3/607: fsync d0/d3/da9/fb6 0 2023-10-18T20:58:40.423 INFO:tasks.workunit.client.1.smithi060.stdout:1/835: mkdir d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/d112 0 2023-10-18T20:58:40.424 INFO:tasks.workunit.client.1.smithi060.stdout:1/836: readlink d4/d6/d33/d58/l61 0 2023-10-18T20:58:40.424 INFO:tasks.workunit.client.1.smithi060.stdout:1/837: fsync d4/d6/d7/d2f/d7b/d2a/d32/fe4 0 2023-10-18T20:58:40.426 INFO:tasks.workunit.client.1.smithi060.stdout:8/672: dwrite d4/d9/f79 [0,4194304] 0 2023-10-18T20:58:40.426 INFO:tasks.workunit.client.1.smithi060.stdout:4/666: mknod d4/dc/d2a/d13/d33/cc9 0 2023-10-18T20:58:40.426 INFO:tasks.workunit.client.1.smithi060.stdout:0/719: creat d3/d8/d3c/d87/dba/fe6 x:0 0 0 2023-10-18T20:58:40.428 INFO:tasks.workunit.client.1.smithi060.stdout:5/751: symlink d0/d6/d8/l111 0 2023-10-18T20:58:40.428 INFO:tasks.workunit.client.1.smithi060.stdout:6/746: dwrite d10/d47/f91 [0,4194304] 0 2023-10-18T20:58:40.428 INFO:tasks.workunit.client.1.smithi060.stdout:6/747: readlink d10/d25/l78 0 2023-10-18T20:58:40.428 INFO:tasks.workunit.client.1.smithi060.stdout:6/748: write d10/d2e/f3f [7490183,9642] 0 2023-10-18T20:58:40.429 INFO:tasks.workunit.client.1.smithi060.stdout:6/749: dread - d10/d2e/d75/dc4/fa8 zero size 2023-10-18T20:58:40.429 INFO:tasks.workunit.client.1.smithi060.stdout:2/721: dwrite d0/d8/d87/fcb [0,4194304] 0 2023-10-18T20:58:40.431 INFO:tasks.workunit.client.1.smithi060.stdout:8/673: symlink d4/d9/d93/lc9 0 2023-10-18T20:58:40.433 INFO:tasks.workunit.client.1.smithi060.stdout:7/791: rmdir de/d14/d2f/d3f/d5a/dc8 39 2023-10-18T20:58:40.433 INFO:tasks.workunit.client.1.smithi060.stdout:5/752: mkdir d0/dd/d76/d112 0 2023-10-18T20:58:40.436 INFO:tasks.workunit.client.1.smithi060.stdout:4/667: dread d4/dc/d2a/d39/f7f [0,4194304] 0 2023-10-18T20:58:40.436 INFO:tasks.workunit.client.1.smithi060.stdout:4/668: stat d4/dc/d2a/d39/d53/d76/da7/fab 0 2023-10-18T20:58:40.446 INFO:tasks.workunit.client.1.smithi060.stdout:6/750: link d10/d17/d2f/f7d d10/d47/d92/fe8 0 2023-10-18T20:58:40.447 INFO:tasks.workunit.client.1.smithi060.stdout:0/720: dread d3/d8/f28 [0,4194304] 0 2023-10-18T20:58:40.454 INFO:tasks.workunit.client.1.smithi060.stdout:2/722: symlink d0/d3/d9e/dc2/lf3 0 2023-10-18T20:58:40.458 INFO:tasks.workunit.client.1.smithi060.stdout:6/751: write d10/d47/f91 [1863513,23520] 0 2023-10-18T20:58:40.459 INFO:tasks.workunit.client.1.smithi060.stdout:3/666: dwrite d0/f11 [0,4194304] 0 2023-10-18T20:58:40.459 INFO:tasks.workunit.client.1.smithi060.stdout:3/667: truncate d0/d22/d26/d29/f9e 2097481 0 2023-10-18T20:58:40.459 INFO:tasks.workunit.client.1.smithi060.stdout:3/668: fsync d0/d22/d26/d29/fdc 0 2023-10-18T20:58:40.462 INFO:tasks.workunit.client.1.smithi060.stdout:4/669: rename d4/d91/dc1 to d4/dc/d2a/d39/d53/d76/da7/dca 0 2023-10-18T20:58:40.475 INFO:tasks.workunit.client.1.smithi060.stdout:0/721: getdents d3/d8/d3c/d87 0 2023-10-18T20:58:40.475 INFO:tasks.workunit.client.1.smithi060.stdout:2/723: creat d0/d16/d85/ff4 x:0 0 0 2023-10-18T20:58:40.475 INFO:tasks.workunit.client.1.smithi060.stdout:2/724: write d0/d45/d49/d55/dae/fbb [106386,61864] 0 2023-10-18T20:58:40.476 INFO:tasks.workunit.client.1.smithi060.stdout:2/725: truncate d0/d3/d27/d4d/f5b 4692057 0 2023-10-18T20:58:40.478 INFO:tasks.workunit.client.1.smithi060.stdout:6/752: rmdir d10/d47/d92/d79 39 2023-10-18T20:58:40.479 INFO:tasks.workunit.client.1.smithi060.stdout:4/670: creat d4/dc/d2a/d13/d27/d68/dc8/fcb x:0 0 0 2023-10-18T20:58:40.479 INFO:tasks.workunit.client.1.smithi060.stdout:1/838: dread d4/d6/d7/f26 [0,4194304] 0 2023-10-18T20:58:40.483 INFO:tasks.workunit.client.1.smithi060.stdout:6/753: symlink d10/d2e/d75/dc7/le9 0 2023-10-18T20:58:40.484 INFO:tasks.workunit.client.1.smithi060.stdout:6/754: write d10/d17/d2f/f64 [4891283,93415] 0 2023-10-18T20:58:40.490 INFO:tasks.workunit.client.1.smithi060.stdout:2/726: mkdir d0/d3/d27/d4d/d5e/df5 0 2023-10-18T20:58:40.491 INFO:tasks.workunit.client.1.smithi060.stdout:2/727: chown d0/d8/f2c 21 1 2023-10-18T20:58:40.506 INFO:tasks.workunit.client.1.smithi060.stdout:8/674: dwrite d4/d9/d4f/d74/d81/f94 [0,4194304] 0 2023-10-18T20:58:40.509 INFO:tasks.workunit.client.1.smithi060.stdout:1/839: write d4/d6/f22 [2907188,65632] 0 2023-10-18T20:58:40.509 INFO:tasks.workunit.client.1.smithi060.stdout:1/840: write d4/d6/d7/d2f/ff5 [293354,60497] 0 2023-10-18T20:58:40.522 INFO:tasks.workunit.client.1.smithi060.stdout:3/669: dwrite d0/d22/d26/d79/db3/fe2 [0,4194304] 0 2023-10-18T20:58:40.527 INFO:tasks.workunit.client.0.smithi008.stdout:3/608: dwrite d0/d3/d42/d52/f98 [0,4194304] 0 2023-10-18T20:58:40.531 INFO:tasks.workunit.client.1.smithi060.stdout:2/728: dread d0/d45/f92 [0,4194304] 0 2023-10-18T20:58:40.532 INFO:tasks.workunit.client.1.smithi060.stdout:2/729: chown d0/d3/d27 171 1 2023-10-18T20:58:40.532 INFO:tasks.workunit.client.1.smithi060.stdout:2/730: fdatasync d0/d45/dc9/d4a/fcf 0 2023-10-18T20:58:40.532 INFO:tasks.workunit.client.1.smithi060.stdout:6/755: dread d10/d17/d2f/fa0 [0,4194304] 0 2023-10-18T20:58:40.534 INFO:tasks.workunit.client.1.smithi060.stdout:2/731: link d0/d3/d27/d7b/lb1 d0/d16/d81/lf6 0 2023-10-18T20:58:40.534 INFO:tasks.workunit.client.1.smithi060.stdout:4/671: dread d4/dc/d2a/d39/d53/fb5 [0,4194304] 0 2023-10-18T20:58:40.534 INFO:tasks.workunit.client.1.smithi060.stdout:4/672: getdents d4/dc/d2a/d39/d53/d5f 0 2023-10-18T20:58:40.539 INFO:tasks.workunit.client.0.smithi008.stdout:3/609: link d0/d3/d42/d52/c53 d0/d3/d37/cc2 0 2023-10-18T20:58:40.540 INFO:tasks.workunit.client.0.smithi008.stdout:3/610: read d0/d4a/d64/f6e [2064118,86894] 0 2023-10-18T20:58:40.540 INFO:tasks.workunit.client.0.smithi008.stdout:3/611: write d0/d84/f90 [5052745,77380] 0 2023-10-18T20:58:40.541 INFO:tasks.workunit.client.1.smithi060.stdout:4/673: mknod d4/dc/ccc 0 2023-10-18T20:58:40.541 INFO:tasks.workunit.client.1.smithi060.stdout:7/792: dwrite de/f19 [0,4194304] 0 2023-10-18T20:58:40.543 INFO:tasks.workunit.client.0.smithi008.stdout:3/612: symlink d0/d84/dad/dbb/lc3 0 2023-10-18T20:58:40.548 INFO:tasks.workunit.client.1.smithi060.stdout:5/753: dwrite d0/da/dc8/de4/f39 [0,4194304] 0 2023-10-18T20:58:40.548 INFO:tasks.workunit.client.1.smithi060.stdout:5/754: chown d0/d47 251986032 1 2023-10-18T20:58:40.548 INFO:tasks.workunit.client.1.smithi060.stdout:5/755: chown d0/d6/d9/d82/d83/deb/df9 504187031 1 2023-10-18T20:58:40.548 INFO:tasks.workunit.client.1.smithi060.stdout:5/756: getdents d0/dd/d76/d105 0 2023-10-18T20:58:40.550 INFO:tasks.workunit.client.1.smithi060.stdout:4/674: mkdir d4/dc/d2a/d39/d53/d76/da7/dca/dcd 0 2023-10-18T20:58:40.551 INFO:tasks.workunit.client.1.smithi060.stdout:4/675: rename d4 to d4/dc/d2a/d83/dce 22 2023-10-18T20:58:40.551 INFO:tasks.workunit.client.1.smithi060.stdout:2/732: dread d0/d3/f89 [0,4194304] 0 2023-10-18T20:58:40.554 INFO:tasks.workunit.client.1.smithi060.stdout:7/793: mkdir de/d14/dd2/dff 0 2023-10-18T20:58:40.558 INFO:tasks.workunit.client.1.smithi060.stdout:4/676: creat d4/dc/d2a/d13/dbd/fcf x:0 0 0 2023-10-18T20:58:40.559 INFO:tasks.workunit.client.1.smithi060.stdout:3/670: dread d0/d22/d26/fb0 [0,4194304] 0 2023-10-18T20:58:40.564 INFO:tasks.workunit.client.0.smithi008.stdout:3/613: fsync d0/d84/f90 0 2023-10-18T20:58:40.564 INFO:tasks.workunit.client.1.smithi060.stdout:4/677: creat d4/dc/d2a/d7e/fd0 x:0 0 0 2023-10-18T20:58:40.568 INFO:tasks.workunit.client.0.smithi008.stdout:3/614: mkdir d0/d84/dad/dc4 0 2023-10-18T20:58:40.573 INFO:tasks.workunit.client.0.smithi008.stdout:3/615: creat d0/d3/d42/d88/fc5 x:0 0 0 2023-10-18T20:58:40.574 INFO:tasks.workunit.client.1.smithi060.stdout:7/794: dread de/d14/dd2/fe1 [0,4194304] 0 2023-10-18T20:58:40.574 INFO:tasks.workunit.client.1.smithi060.stdout:7/795: stat de/d14/d2f/d8f/d5b/l80 0 2023-10-18T20:58:40.574 INFO:tasks.workunit.client.1.smithi060.stdout:7/796: chown de/d14/d2f/d3f/d5a/c8b 61620 1 2023-10-18T20:58:40.575 INFO:tasks.workunit.client.0.smithi008.stdout:3/616: mknod d0/d3/da9/cc6 0 2023-10-18T20:58:40.575 INFO:tasks.workunit.client.1.smithi060.stdout:5/757: write d0/f8a [1703566,42286] 0 2023-10-18T20:58:40.576 INFO:tasks.workunit.client.0.smithi008.stdout:3/617: creat d0/d3/de/d13/d35/fc7 x:0 0 0 2023-10-18T20:58:40.577 INFO:tasks.workunit.client.1.smithi060.stdout:3/671: unlink d0/d3c/d3d/f47 0 2023-10-18T20:58:40.577 INFO:tasks.workunit.client.1.smithi060.stdout:4/678: creat d4/dc/d2a/d2d/d69/fd1 x:0 0 0 2023-10-18T20:58:40.577 INFO:tasks.workunit.client.1.smithi060.stdout:6/756: write fc [2291109,83695] 0 2023-10-18T20:58:40.578 INFO:tasks.workunit.client.1.smithi060.stdout:1/841: dwrite d4/d6/d7/df/f2c [0,4194304] 0 2023-10-18T20:58:40.578 INFO:tasks.workunit.client.1.smithi060.stdout:1/842: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/f6c 904 1 2023-10-18T20:58:40.578 INFO:tasks.workunit.client.1.smithi060.stdout:1/843: write d4/d6/f1f [7676675,80377] 0 2023-10-18T20:58:40.578 INFO:tasks.workunit.client.1.smithi060.stdout:1/844: fdatasync d4/d6/d7/d2f/d7b/d2a/d32/f111 0 2023-10-18T20:58:40.581 INFO:tasks.workunit.client.1.smithi060.stdout:9/657: sync 2023-10-18T20:58:40.582 INFO:tasks.workunit.client.1.smithi060.stdout:9/658: fsync d3/d99/f69 0 2023-10-18T20:58:40.583 INFO:tasks.workunit.client.1.smithi060.stdout:7/797: rename de/d14/d49/d68/d7d/le7 to de/d29/d72/d84/l100 0 2023-10-18T20:58:40.583 INFO:tasks.workunit.client.1.smithi060.stdout:9/659: creat d3/d99/d1c/d5a/ff1 x:0 0 0 2023-10-18T20:58:40.583 INFO:tasks.workunit.client.1.smithi060.stdout:9/660: dread - d3/d99/d1c/d5a/f8d zero size 2023-10-18T20:58:40.584 INFO:tasks.workunit.client.1.smithi060.stdout:8/675: dwrite d4/d9/d4f/d74/d81/f94 [0,4194304] 0 2023-10-18T20:58:40.585 INFO:tasks.workunit.client.1.smithi060.stdout:5/758: link d0/da/d3b/d43/lde d0/d6/d9/d82/d84/l113 0 2023-10-18T20:58:40.585 INFO:tasks.workunit.client.0.smithi008.stdout:3/618: dread d0/d4a/d64/f7e [0,4194304] 0 2023-10-18T20:58:40.586 INFO:tasks.workunit.client.1.smithi060.stdout:3/672: link d0/d22/d26/d29/fdc d0/d5e/fed 0 2023-10-18T20:58:40.586 INFO:tasks.workunit.client.1.smithi060.stdout:3/673: truncate d0/d3c/d3d/f7b 692186 0 2023-10-18T20:58:40.587 INFO:tasks.workunit.client.1.smithi060.stdout:4/679: creat d4/dc/d2a/d83/db1/fd2 x:0 0 0 2023-10-18T20:58:40.588 INFO:tasks.workunit.client.1.smithi060.stdout:4/680: write d4/dc/d2a/d39/fb7 [1005208,8774] 0 2023-10-18T20:58:40.590 INFO:tasks.workunit.client.1.smithi060.stdout:1/845: symlink d4/d6/d7/d2f/d7b/de8/l113 0 2023-10-18T20:58:40.592 INFO:tasks.workunit.client.1.smithi060.stdout:6/757: write d10/d47/d92/f61 [1634947,95894] 0 2023-10-18T20:58:40.596 INFO:tasks.workunit.client.1.smithi060.stdout:7/798: truncate de/d14/d49/d68/d7d/d7e/fc2 130172 0 2023-10-18T20:58:40.596 INFO:tasks.workunit.client.1.smithi060.stdout:7/799: write de/d14/d2f/d8f/d5b/f7a [2179250,22156] 0 2023-10-18T20:58:40.596 INFO:tasks.workunit.client.1.smithi060.stdout:7/800: chown de/d14/d2f/l6e 6417085 1 2023-10-18T20:58:40.597 INFO:tasks.workunit.client.1.smithi060.stdout:9/661: symlink d3/d99/d1c/d2a/d2d/lf2 0 2023-10-18T20:58:40.603 INFO:tasks.workunit.client.0.smithi008.stdout:3/619: dread d0/d3/d42/d52/f6b [0,4194304] 0 2023-10-18T20:58:40.604 INFO:tasks.workunit.client.1.smithi060.stdout:3/674: symlink d0/d22/d26/d2c/lee 0 2023-10-18T20:58:40.615 INFO:tasks.workunit.client.1.smithi060.stdout:4/681: mknod d4/dc/d2a/d13/cd3 0 2023-10-18T20:58:40.615 INFO:tasks.workunit.client.1.smithi060.stdout:1/846: link d4/d6/d7/d2f/d7b/d2a/d32/dd/fde d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/d112/f114 0 2023-10-18T20:58:40.615 INFO:tasks.workunit.client.1.smithi060.stdout:1/847: fdatasync d4/da/f5a 0 2023-10-18T20:58:40.616 INFO:tasks.workunit.client.1.smithi060.stdout:7/801: mkdir de/d14/d2f/d3f/d5a/d101 0 2023-10-18T20:58:40.616 INFO:tasks.workunit.client.1.smithi060.stdout:3/675: mkdir d0/d22/d26/d2b/def 0 2023-10-18T20:58:40.616 INFO:tasks.workunit.client.1.smithi060.stdout:7/802: stat de/d14/d49/d68/d7d/d7e/db5/fc7 0 2023-10-18T20:58:40.616 INFO:tasks.workunit.client.1.smithi060.stdout:7/803: chown de/d14/d2f/d8f/d5b/f74 0 1 2023-10-18T20:58:40.617 INFO:tasks.workunit.client.1.smithi060.stdout:3/676: write d0/d22/d26/fa3 [4611998,60090] 0 2023-10-18T20:58:40.617 INFO:tasks.workunit.client.1.smithi060.stdout:3/677: truncate d0/f21 4246199 0 2023-10-18T20:58:40.617 INFO:tasks.workunit.client.1.smithi060.stdout:7/804: creat de/d29/d9c/f102 x:0 0 0 2023-10-18T20:58:40.628 INFO:tasks.workunit.client.1.smithi060.stdout:7/805: write de/d14/d49/fb4 [2763576,96605] 0 2023-10-18T20:58:40.628 INFO:tasks.workunit.client.1.smithi060.stdout:7/806: dread - de/d14/d49/d68/d7d/d7e/db5/ff8 zero size 2023-10-18T20:58:40.631 INFO:tasks.workunit.client.1.smithi060.stdout:8/676: write d4/d9/d31/f8e [3086088,80664] 0 2023-10-18T20:58:40.631 INFO:tasks.workunit.client.1.smithi060.stdout:8/677: chown d4/f19 169 1 2023-10-18T20:58:40.632 INFO:tasks.workunit.client.1.smithi060.stdout:8/678: truncate d4/d9/d4f/f71 176131 0 2023-10-18T20:58:40.632 INFO:tasks.workunit.client.1.smithi060.stdout:0/722: sync 2023-10-18T20:58:40.632 INFO:tasks.workunit.client.1.smithi060.stdout:8/679: write d4/d9/f2e [1841714,114564] 0 2023-10-18T20:58:40.632 INFO:tasks.workunit.client.1.smithi060.stdout:4/682: symlink d4/d91/ld4 0 2023-10-18T20:58:40.637 INFO:tasks.workunit.client.1.smithi060.stdout:7/807: symlink de/d14/d49/d68/d7d/l103 0 2023-10-18T20:58:40.639 INFO:tasks.workunit.client.1.smithi060.stdout:0/723: dread d3/d8/f28 [0,4194304] 0 2023-10-18T20:58:40.639 INFO:tasks.workunit.client.1.smithi060.stdout:0/724: dread - d3/d8/d14/d55/dad/daa/fe3 zero size 2023-10-18T20:58:40.640 INFO:tasks.workunit.client.1.smithi060.stdout:8/680: link d4/d9/d37/l52 d4/d9/db4/lca 0 2023-10-18T20:58:40.641 INFO:tasks.workunit.client.1.smithi060.stdout:3/678: symlink d0/d3c/lf0 0 2023-10-18T20:58:40.642 INFO:tasks.workunit.client.1.smithi060.stdout:1/848: dread d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/f6c [0,4194304] 0 2023-10-18T20:58:40.642 INFO:tasks.workunit.client.1.smithi060.stdout:1/849: fdatasync d4/d6/d7/d35/fbc 0 2023-10-18T20:58:40.642 INFO:tasks.workunit.client.1.smithi060.stdout:1/850: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/fdd 28151 1 2023-10-18T20:58:40.645 INFO:tasks.workunit.client.1.smithi060.stdout:7/808: symlink de/d14/d3a/d46/d73/l104 0 2023-10-18T20:58:40.645 INFO:tasks.workunit.client.1.smithi060.stdout:7/809: write de/d14/d49/d68/d7d/d7e/db5/ff8 [898089,91016] 0 2023-10-18T20:58:40.645 INFO:tasks.workunit.client.1.smithi060.stdout:7/810: readlink de/lcc 0 2023-10-18T20:58:40.646 INFO:tasks.workunit.client.1.smithi060.stdout:7/811: stat de/d29/c35 0 2023-10-18T20:58:40.647 INFO:tasks.workunit.client.1.smithi060.stdout:0/725: symlink d3/d8/d14/d55/le7 0 2023-10-18T20:58:40.647 INFO:tasks.workunit.client.1.smithi060.stdout:8/681: mkdir d4/d9/d37/d4e/d6e/dcb 0 2023-10-18T20:58:40.647 INFO:tasks.workunit.client.1.smithi060.stdout:0/726: fdatasync d3/d8/d14/d55/d74/d76/d68/d7f/fd8 0 2023-10-18T20:58:40.648 INFO:tasks.workunit.client.1.smithi060.stdout:8/682: fsync d4/d9/f83 0 2023-10-18T20:58:40.648 INFO:tasks.workunit.client.1.smithi060.stdout:8/683: fsync d4/d9/d37/d4e/f59 0 2023-10-18T20:58:40.648 INFO:tasks.workunit.client.1.smithi060.stdout:7/812: mkdir de/d14/d2f/d8f/d5b/d9e/d105 0 2023-10-18T20:58:40.652 INFO:tasks.workunit.client.1.smithi060.stdout:2/733: dwrite d0/d8/d47/fdf [0,4194304] 0 2023-10-18T20:58:40.654 INFO:tasks.workunit.client.1.smithi060.stdout:3/679: rmdir d0/d22/d26/d79 39 2023-10-18T20:58:40.654 INFO:tasks.workunit.client.1.smithi060.stdout:0/727: mknod d3/d80/dd9/ce8 0 2023-10-18T20:58:40.664 INFO:tasks.workunit.client.1.smithi060.stdout:2/734: link d0/d45/d49/f39 d0/d16/d85/de3/ff7 0 2023-10-18T20:58:40.665 INFO:tasks.workunit.client.1.smithi060.stdout:0/728: creat d3/d8/d14/d55/dad/daa/dc3/fe9 x:0 0 0 2023-10-18T20:58:40.667 INFO:tasks.workunit.client.1.smithi060.stdout:8/684: read d4/d9/d31/f66 [389159,69383] 0 2023-10-18T20:58:40.669 INFO:tasks.workunit.client.1.smithi060.stdout:0/729: getdents d3/d8/d14/d55/d74/d76/d68/d7f/d8d 0 2023-10-18T20:58:40.669 INFO:tasks.workunit.client.1.smithi060.stdout:0/730: chown d3/d8/f3f 143907258 1 2023-10-18T20:58:40.673 INFO:tasks.workunit.client.1.smithi060.stdout:8/685: read d4/d9/d37/f3d [99242,40174] 0 2023-10-18T20:58:40.676 INFO:tasks.workunit.client.1.smithi060.stdout:6/758: dwrite d10/f4d [4194304,4194304] 0 2023-10-18T20:58:40.696 INFO:tasks.workunit.client.1.smithi060.stdout:7/813: fsync de/d14/d49/d68/d7d/d7e/db5/ff8 0 2023-10-18T20:58:40.703 INFO:tasks.workunit.client.1.smithi060.stdout:9/662: dwrite d3/d99/d1c/d2a/d80/da0/dc2/d9e/fce [4194304,4194304] 0 2023-10-18T20:58:40.716 INFO:tasks.workunit.client.1.smithi060.stdout:8/686: dread d4/d9/d31/d35/d9f/fc1 [0,4194304] 0 2023-10-18T20:58:40.717 INFO:tasks.workunit.client.1.smithi060.stdout:2/735: dread d0/d45/dc9/d4a/fcf [0,4194304] 0 2023-10-18T20:58:40.717 INFO:tasks.workunit.client.1.smithi060.stdout:1/851: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/fbf [0,4194304] 0 2023-10-18T20:58:40.718 INFO:tasks.workunit.client.1.smithi060.stdout:1/852: creat d4/d6/d7/d35/f115 x:0 0 0 2023-10-18T20:58:40.719 INFO:tasks.workunit.client.1.smithi060.stdout:1/853: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/fd0 4576208 1 2023-10-18T20:58:40.722 INFO:tasks.workunit.client.1.smithi060.stdout:4/683: dwrite d4/f6a [0,4194304] 0 2023-10-18T20:58:40.727 INFO:tasks.workunit.client.1.smithi060.stdout:8/687: dread d4/d9/d31/d35/d9f/da3/f9b [0,4194304] 0 2023-10-18T20:58:40.730 INFO:tasks.workunit.client.1.smithi060.stdout:1/854: creat d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/deb/d110/f116 x:0 0 0 2023-10-18T20:58:40.731 INFO:tasks.workunit.client.1.smithi060.stdout:4/684: creat d4/dc/d2a/d13/fd5 x:0 0 0 2023-10-18T20:58:40.734 INFO:tasks.workunit.client.1.smithi060.stdout:8/688: link d4/d9/d93/lb7 d4/d9/d31/lcc 0 2023-10-18T20:58:40.735 INFO:tasks.workunit.client.1.smithi060.stdout:8/689: stat d4/d9/d31/c33 0 2023-10-18T20:58:40.736 INFO:tasks.workunit.client.1.smithi060.stdout:1/855: creat d4/d6/d7/d2f/d7b/dda/df8/f117 x:0 0 0 2023-10-18T20:58:40.736 INFO:tasks.workunit.client.1.smithi060.stdout:1/856: dread - d4/d6/d7/d2f/d7b/d2a/d32/dd/fed zero size 2023-10-18T20:58:40.737 INFO:tasks.workunit.client.1.smithi060.stdout:4/685: write d4/dc/d2a/d2d/f96 [335820,105392] 0 2023-10-18T20:58:40.739 INFO:tasks.workunit.client.1.smithi060.stdout:3/680: dwrite d0/d22/f70 [4194304,4194304] 0 2023-10-18T20:58:40.740 INFO:tasks.workunit.client.1.smithi060.stdout:8/690: symlink d4/d9/d37/d4e/d6e/dcb/lcd 0 2023-10-18T20:58:40.740 INFO:tasks.workunit.client.1.smithi060.stdout:1/857: unlink d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/deb/c10f 0 2023-10-18T20:58:40.740 INFO:tasks.workunit.client.1.smithi060.stdout:2/736: write d0/d8/d47/f4b [2763283,70905] 0 2023-10-18T20:58:40.741 INFO:tasks.workunit.client.1.smithi060.stdout:2/737: readlink d0/d45/dc9/d4a/l72 0 2023-10-18T20:58:40.742 INFO:tasks.workunit.client.1.smithi060.stdout:6/759: dwrite d10/d2e/f33 [0,4194304] 0 2023-10-18T20:58:40.742 INFO:tasks.workunit.client.1.smithi060.stdout:6/760: fsync d10/d6f/faf 0 2023-10-18T20:58:40.742 INFO:tasks.workunit.client.1.smithi060.stdout:6/761: write d10/d2e/d75/dc7/fcf [622341,77862] 0 2023-10-18T20:58:40.743 INFO:tasks.workunit.client.1.smithi060.stdout:4/686: mkdir d4/dc/d2a/d39/d53/d76/da7/dca/dd6 0 2023-10-18T20:58:40.744 INFO:tasks.workunit.client.1.smithi060.stdout:7/814: dwrite de/d38/fad [4194304,4194304] 0 2023-10-18T20:58:40.747 INFO:tasks.workunit.client.1.smithi060.stdout:6/762: write fd [3441665,121071] 0 2023-10-18T20:58:40.748 INFO:tasks.workunit.client.1.smithi060.stdout:8/691: rmdir d4/d9/d37/d4e/d6e/d7b 39 2023-10-18T20:58:40.748 INFO:tasks.workunit.client.1.smithi060.stdout:1/858: truncate d4/d6/d33/f71 3532035 0 2023-10-18T20:58:40.748 INFO:tasks.workunit.client.1.smithi060.stdout:1/859: fsync d4/d6/d7/d2f/d7b/ffe 0 2023-10-18T20:58:40.748 INFO:tasks.workunit.client.1.smithi060.stdout:5/759: dwrite d0/f8a [0,4194304] 0 2023-10-18T20:58:40.749 INFO:tasks.workunit.client.1.smithi060.stdout:5/760: write d0/d6/d8/d81/f101 [557536,127548] 0 2023-10-18T20:58:40.750 INFO:tasks.workunit.client.1.smithi060.stdout:2/738: truncate d0/d3/d27/d4d/f7d 1395451 0 2023-10-18T20:58:40.750 INFO:tasks.workunit.client.1.smithi060.stdout:2/739: readlink d0/d45/d49/lb2 0 2023-10-18T20:58:40.755 INFO:tasks.workunit.client.1.smithi060.stdout:8/692: dread d4/d9/d31/d35/d9f/da3/fa5 [0,4194304] 0 2023-10-18T20:58:40.755 INFO:tasks.workunit.client.1.smithi060.stdout:8/693: fdatasync d4/d9/d31/d35/d9f/fa0 0 2023-10-18T20:58:40.759 INFO:tasks.workunit.client.1.smithi060.stdout:9/663: dwrite d3/d99/d1c/d2a/d33/fb5 [0,4194304] 0 2023-10-18T20:58:40.761 INFO:tasks.workunit.client.1.smithi060.stdout:7/815: mkdir de/d14/d49/d68/d106 0 2023-10-18T20:58:40.761 INFO:tasks.workunit.client.1.smithi060.stdout:7/816: chown de/d14/d49/da3/cd5 33208357 1 2023-10-18T20:58:40.763 INFO:tasks.workunit.client.1.smithi060.stdout:5/761: rename d0/da/d61/lc2 to d0/d6/d9/d82/d84/db2/d41/l114 0 2023-10-18T20:58:40.770 INFO:tasks.workunit.client.1.smithi060.stdout:6/763: dread d10/d17/d2f/fa0 [0,4194304] 0 2023-10-18T20:58:40.770 INFO:tasks.workunit.client.1.smithi060.stdout:9/664: dread d3/d99/d1c/f1d [0,4194304] 0 2023-10-18T20:58:40.771 INFO:tasks.workunit.client.1.smithi060.stdout:6/764: write d10/d25/fde [302969,119787] 0 2023-10-18T20:58:40.771 INFO:tasks.workunit.client.1.smithi060.stdout:6/765: write d10/d47/f91 [3907820,88366] 0 2023-10-18T20:58:40.774 INFO:tasks.workunit.client.1.smithi060.stdout:2/740: mknod d0/d45/d49/d55/dbf/cf8 0 2023-10-18T20:58:40.783 INFO:tasks.workunit.client.1.smithi060.stdout:7/817: creat de/d14/d2f/d8f/d5b/f107 x:0 0 0 2023-10-18T20:58:40.784 INFO:tasks.workunit.client.1.smithi060.stdout:7/818: write de/d14/dd2/fe1 [83026,121486] 0 2023-10-18T20:58:40.784 INFO:tasks.workunit.client.1.smithi060.stdout:7/819: stat de/d14/d2f/d8f/cd8 0 2023-10-18T20:58:40.784 INFO:tasks.workunit.client.1.smithi060.stdout:5/762: link d0/da/dc8/de4/f39 d0/d47/d7d/da0/d106/f115 0 2023-10-18T20:58:40.785 INFO:tasks.workunit.client.1.smithi060.stdout:9/665: mknod d3/d99/d1c/d2a/d80/cf3 0 2023-10-18T20:58:40.785 INFO:tasks.workunit.client.1.smithi060.stdout:6/766: getdents d10/d17/d54 0 2023-10-18T20:58:40.785 INFO:tasks.workunit.client.1.smithi060.stdout:6/767: chown d10/l1c 4944173 1 2023-10-18T20:58:40.786 INFO:tasks.workunit.client.1.smithi060.stdout:1/860: dwrite d4/d6/d7/d2f/d7b/d2a/d32/fe4 [0,4194304] 0 2023-10-18T20:58:40.787 INFO:tasks.workunit.client.1.smithi060.stdout:1/861: stat d4/d6/d7/d2f/d7b/d2a/l94 0 2023-10-18T20:58:40.787 INFO:tasks.workunit.client.1.smithi060.stdout:1/862: write d4/d6/d7/d2f/d7b/d2a/d32/dd/f25 [8451728,6851] 0 2023-10-18T20:58:40.787 INFO:tasks.workunit.client.1.smithi060.stdout:1/863: chown d4/d6/d7/d2f/d7b/d2a/d32/f7a 28878 1 2023-10-18T20:58:40.788 INFO:tasks.workunit.client.1.smithi060.stdout:2/741: symlink d0/d16/d85/lf9 0 2023-10-18T20:58:40.788 INFO:tasks.workunit.client.1.smithi060.stdout:2/742: truncate d0/d45/dc9/d68/fb0 929826 0 2023-10-18T20:58:40.791 INFO:tasks.workunit.client.1.smithi060.stdout:7/820: mknod de/d14/d49/d68/d88/c108 0 2023-10-18T20:58:40.791 INFO:tasks.workunit.client.1.smithi060.stdout:7/821: write de/d38/fad [8887312,69174] 0 2023-10-18T20:58:40.793 INFO:tasks.workunit.client.1.smithi060.stdout:5/763: link d0/d6/d9/d82/d83/d99/cb7 d0/da/dc8/de4/d6d/dba/c116 0 2023-10-18T20:58:40.795 INFO:tasks.workunit.client.1.smithi060.stdout:9/666: dread d3/d99/d1c/d2a/f52 [0,4194304] 0 2023-10-18T20:58:40.796 INFO:tasks.workunit.client.1.smithi060.stdout:9/667: chown d3/d99/d19/l3d 208012050 1 2023-10-18T20:58:40.797 INFO:tasks.workunit.client.1.smithi060.stdout:8/694: dwrite d4/d9/d4f/f63 [0,4194304] 0 2023-10-18T20:58:40.800 INFO:tasks.workunit.client.1.smithi060.stdout:1/864: rename d4/d38/cfb to d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/c118 0 2023-10-18T20:58:40.801 INFO:tasks.workunit.client.1.smithi060.stdout:2/743: symlink d0/d16/d7f/lfa 0 2023-10-18T20:58:40.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.801+0000 7f0d10a49700 1 -- 172.21.15.8:0/3767968045 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cec000b90 con 0x7f0cf4061050 2023-10-18T20:58:40.807 INFO:tasks.workunit.client.1.smithi060.stdout:8/695: dread d4/d9/d31/d35/d9f/da3/f9b [0,4194304] 0 2023-10-18T20:58:40.813 INFO:tasks.workunit.client.1.smithi060.stdout:7/822: symlink de/d14/d2f/d3f/d5a/d101/l109 0 2023-10-18T20:58:40.813 INFO:tasks.workunit.client.1.smithi060.stdout:7/823: chown de/d14/d3a/d46/d73 115480747 1 2023-10-18T20:58:40.814 INFO:tasks.workunit.client.1.smithi060.stdout:9/668: link d3/d99/d19/cc9 d3/d99/d1c/d5a/d5d/cf4 0 2023-10-18T20:58:40.814 INFO:tasks.workunit.client.1.smithi060.stdout:9/669: write d3/d99/d19/d54/f42 [2889728,60397] 0 2023-10-18T20:58:40.815 INFO:tasks.workunit.client.1.smithi060.stdout:9/670: dread - d3/d99/d1c/d2a/d80/da0/dc2/d9e/fd2 zero size 2023-10-18T20:58:40.815 INFO:tasks.workunit.client.1.smithi060.stdout:6/768: rmdir d10/d17/d28 39 2023-10-18T20:58:40.816 INFO:tasks.workunit.client.1.smithi060.stdout:5/764: dread d0/d6/f1e [0,4194304] 0 2023-10-18T20:58:40.816 INFO:tasks.workunit.client.1.smithi060.stdout:1/865: mknod d4/d6/d7/d2f/d7b/d2a/d32/d56/daa/c119 0 2023-10-18T20:58:40.817 INFO:tasks.workunit.client.1.smithi060.stdout:8/696: dread d4/d9/d37/d4e/d6e/d7b/f7d [0,4194304] 0 2023-10-18T20:58:40.819 INFO:tasks.workunit.client.1.smithi060.stdout:2/744: rename d0/d45/d49/d6e/f91 to d0/d3/d27/d7b/ffb 0 2023-10-18T20:58:40.820 INFO:tasks.workunit.client.1.smithi060.stdout:2/745: write d0/d3/f35 [3338319,22616] 0 2023-10-18T20:58:40.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.817+0000 7f0cf37fe700 1 -- 172.21.15.8:0/3767968045 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0cec000b90 con 0x7f0cf4061050 2023-10-18T20:58:40.821 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T20:58:40.821 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (5m) 0s ago 6m 12.6M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T20:58:40.821 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (6m) 0s ago 6m 7256k - 16.2.4 8d91d370c2b8 4b2c6838af84 2023-10-18T20:58:40.821 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (5m) 2s ago 5m 7562k - 16.2.4 8d91d370c2b8 67dc04156fe1 2023-10-18T20:58:40.822 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (5m) 0s ago 6m 24.2M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T20:58:40.822 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (2m) 0s ago 2m 3589M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T20:58:40.822 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (2m) 0s ago 2m 473M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T20:58:40.823 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (2m) 2s ago 2m 843M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T20:58:40.823 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (2m) 2s ago 2m 175M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T20:58:40.823 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (30s) 0s ago 8m 427M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T20:58:40.823 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (78s) 2s ago 5m 64.6M - 16.2.14-100-gb4ddd52c 92842c92b8bd 32f95b673b2b 2023-10-18T20:58:40.823 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (8m) 0s ago 8m 95.4M 2048M 16.2.4 8d91d370c2b8 9de89e6e28e5 2023-10-18T20:58:40.824 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (5m) 2s ago 5m 78.2M 2048M 16.2.4 8d91d370c2b8 d7c00f2c13a4 2023-10-18T20:58:40.824 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (6m) 0s ago 6m 9407k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T20:58:40.824 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (5m) 2s ago 5m 9857k - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T20:58:40.825 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (5m) 0s ago 5m 470M 4096M 16.2.4 8d91d370c2b8 885270808f90 2023-10-18T20:58:40.825 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (5m) 0s ago 5m 480M 4096M 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T20:58:40.825 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (4m) 0s ago 4m 422M 4096M 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T20:58:40.825 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (4m) 2s ago 4m 614M 4096M 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T20:58:40.826 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (4m) 2s ago 4m 493M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T20:58:40.826 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (3m) 2s ago 3m 560M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T20:58:40.826 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (52s) 0s ago 6m 43.6M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T20:58:40.827 INFO:tasks.workunit.client.1.smithi060.stdout:7/824: truncate fa 308319 0 2023-10-18T20:58:40.828 INFO:tasks.workunit.client.1.smithi060.stdout:5/765: mknod d0/da/d3b/d64/df5/c117 0 2023-10-18T20:58:40.828 INFO:tasks.workunit.client.1.smithi060.stdout:5/766: write d0/d6/d9/d82/d83/d99/faa [1801866,123970] 0 2023-10-18T20:58:40.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.820+0000 7f0d10a49700 1 -- 172.21.15.8:0/3767968045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0cf4061050 msgr2=0x7f0cf4063510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:40.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.820+0000 7f0d10a49700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0cf4061050 0x7f0cf4063510 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f0d0c1049c0 tx=0x7f0d0000b040).stop 2023-10-18T20:58:40.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.820+0000 7f0d10a49700 1 -- 172.21.15.8:0/3767968045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d0c105120 msgr2=0x7f0d0c106060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:40.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.820+0000 7f0d10a49700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d0c105120 0x7f0d0c106060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0d0c0f6170 tx=0x7f0cfc009b30).stop 2023-10-18T20:58:40.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.820+0000 7f0d10a49700 1 -- 172.21.15.8:0/3767968045 shutdown_connections 2023-10-18T20:58:40.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.820+0000 7f0d10a49700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0cf4061050 0x7f0cf4063510 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:40.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.820+0000 7f0d10a49700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d0c0f5440 0x7f0d0c104c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:40.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.820+0000 7f0d10a49700 1 --2- 172.21.15.8:0/3767968045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d0c105120 0x7f0d0c106060 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:40.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.820+0000 7f0d10a49700 1 -- 172.21.15.8:0/3767968045 >> 172.21.15.8:0/3767968045 conn(0x7f0d0c0f0ba0 msgr2=0x7f0d0c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:40.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.821+0000 7f0d10a49700 1 -- 172.21.15.8:0/3767968045 shutdown_connections 2023-10-18T20:58:40.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:40.821+0000 7f0d10a49700 1 -- 172.21.15.8:0/3767968045 wait complete. 2023-10-18T20:58:40.831 INFO:tasks.workunit.client.1.smithi060.stdout:2/746: creat d0/d45/dc9/d68/de1/ffc x:0 0 0 2023-10-18T20:58:40.834 INFO:tasks.workunit.client.1.smithi060.stdout:9/671: getdents d3/d99/d65 0 2023-10-18T20:58:40.834 INFO:tasks.workunit.client.1.smithi060.stdout:9/672: chown d3/d99/d1c/d2a 0 1 2023-10-18T20:58:40.839 INFO:tasks.workunit.client.1.smithi060.stdout:6/769: rename d10/d25/d3c/dd5 to d10/d17/d54/db1/dea 0 2023-10-18T20:58:40.840 INFO:tasks.workunit.client.1.smithi060.stdout:2/747: creat d0/d45/d49/d55/dae/ffd x:0 0 0 2023-10-18T20:58:40.840 INFO:tasks.workunit.client.1.smithi060.stdout:2/748: stat d0/d45/d49/d55/cd0 0 2023-10-18T20:58:40.841 INFO:tasks.workunit.client.1.smithi060.stdout:2/749: dread - d0/d3/d27/d4d/d5e/d96/ff0 zero size 2023-10-18T20:58:40.841 INFO:tasks.workunit.client.1.smithi060.stdout:2/750: write d0/d8/d47/fcc [16569,117024] 0 2023-10-18T20:58:40.841 INFO:tasks.workunit.client.1.smithi060.stdout:8/697: dread d4/d9/d37/f8a [0,4194304] 0 2023-10-18T20:58:40.842 INFO:tasks.workunit.client.1.smithi060.stdout:9/673: symlink d3/d99/d1c/d2a/d2d/db9/lf5 0 2023-10-18T20:58:40.852 INFO:tasks.workunit.client.1.smithi060.stdout:1/866: dwrite d4/da/f50 [0,4194304] 0 2023-10-18T20:58:40.859 INFO:tasks.workunit.client.1.smithi060.stdout:1/867: mknod d4/d38/c11a 0 2023-10-18T20:58:40.865 INFO:tasks.workunit.client.1.smithi060.stdout:1/868: rmdir d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e 39 2023-10-18T20:58:40.875 INFO:tasks.workunit.client.1.smithi060.stdout:6/770: read d10/d17/d2f/fdd [1814291,16015] 0 2023-10-18T20:58:40.877 INFO:tasks.workunit.client.1.smithi060.stdout:5/767: dwrite d0/d6/fe3 [0,4194304] 0 2023-10-18T20:58:40.877 INFO:tasks.workunit.client.1.smithi060.stdout:5/768: chown d0/da/d3b/l8e 0 1 2023-10-18T20:58:40.880 INFO:tasks.workunit.client.1.smithi060.stdout:9/674: dwrite d3/d99/d65/f81 [0,4194304] 0 2023-10-18T20:58:40.880 INFO:tasks.workunit.client.1.smithi060.stdout:9/675: chown d3 406954278 1 2023-10-18T20:58:40.881 INFO:tasks.workunit.client.1.smithi060.stdout:9/676: readlink d3/d99/d1c/d2a/d80/da0/dc2/l37 0 2023-10-18T20:58:40.881 INFO:tasks.workunit.client.1.smithi060.stdout:9/677: creat d3/d99/d1c/d2a/d80/ff6 x:0 0 0 2023-10-18T20:58:40.888 INFO:tasks.workunit.client.1.smithi060.stdout:8/698: dwrite d4/d9/d4f/f63 [0,4194304] 0 2023-10-18T20:58:40.888 INFO:tasks.workunit.client.1.smithi060.stdout:1/869: mkdir d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d11b 0 2023-10-18T20:58:40.893 INFO:tasks.workunit.client.1.smithi060.stdout:9/678: mknod d3/d99/d1c/d25/cf7 0 2023-10-18T20:58:40.893 INFO:tasks.workunit.client.1.smithi060.stdout:9/679: chown d3/d99/d1c/l26 268363054 1 2023-10-18T20:58:40.894 INFO:tasks.workunit.client.1.smithi060.stdout:8/699: creat d4/d9/d37/fce x:0 0 0 2023-10-18T20:58:40.896 INFO:tasks.workunit.client.1.smithi060.stdout:1/870: rename d4/da/de0/de9/f10e to d4/d38/de5/f11c 0 2023-10-18T20:58:40.897 INFO:tasks.workunit.client.1.smithi060.stdout:1/871: read d4/d6/f65 [1173554,47227] 0 2023-10-18T20:58:40.901 INFO:tasks.workunit.client.1.smithi060.stdout:9/680: mkdir d3/df8 0 2023-10-18T20:58:40.902 INFO:tasks.workunit.client.1.smithi060.stdout:9/681: creat d3/d99/d19/d54/ff9 x:0 0 0 2023-10-18T20:58:40.903 INFO:tasks.workunit.client.1.smithi060.stdout:9/682: symlink d3/d99/d1c/lfa 0 2023-10-18T20:58:40.903 INFO:tasks.workunit.client.1.smithi060.stdout:9/683: truncate d3/d99/d19/d54/d8f/fa6 587567 0 2023-10-18T20:58:40.913 INFO:tasks.workunit.client.1.smithi060.stdout:9/684: rmdir d3/d99/d19/d54 39 2023-10-18T20:58:40.914 INFO:tasks.workunit.client.1.smithi060.stdout:9/685: unlink d3/d99/d1c/d2a/d80/da0/dc2/l82 0 2023-10-18T20:58:40.916 INFO:tasks.workunit.client.1.smithi060.stdout:9/686: mkdir d3/d99/d65/dfb 0 2023-10-18T20:58:40.917 INFO:tasks.workunit.client.1.smithi060.stdout:9/687: unlink d3/d99/f18 0 2023-10-18T20:58:40.921 INFO:tasks.workunit.client.1.smithi060.stdout:9/688: truncate d3/d99/d19/d54/f51 149314 0 2023-10-18T20:58:40.922 INFO:tasks.workunit.client.1.smithi060.stdout:9/689: mkdir d3/d99/d1c/d2a/d2d/dfc 0 2023-10-18T20:58:40.936 INFO:tasks.workunit.client.0.smithi008.stdout:5/530: sync 2023-10-18T20:58:40.937 INFO:tasks.workunit.client.0.smithi008.stdout:9/506: sync 2023-10-18T20:58:40.937 INFO:tasks.workunit.client.0.smithi008.stdout:0/487: sync 2023-10-18T20:58:40.937 INFO:tasks.workunit.client.0.smithi008.stdout:0/488: stat d0/d7c/d7f/d8a/d8f/l36 0 2023-10-18T20:58:40.937 INFO:tasks.workunit.client.0.smithi008.stdout:0/489: getdents d0/d7c/d7f/d8a/d8f/d21/d85 0 2023-10-18T20:58:40.937 INFO:tasks.workunit.client.0.smithi008.stdout:0/490: write d0/dd/df/f1c [206295,38938] 0 2023-10-18T20:58:40.938 INFO:tasks.workunit.client.0.smithi008.stdout:4/492: sync 2023-10-18T20:58:40.938 INFO:tasks.workunit.client.0.smithi008.stdout:2/577: sync 2023-10-18T20:58:40.939 INFO:tasks.workunit.client.0.smithi008.stdout:7/622: sync 2023-10-18T20:58:40.939 INFO:tasks.workunit.client.0.smithi008.stdout:2/578: stat d1/d3/dd/d25/d76/d59/c95 0 2023-10-18T20:58:40.939 INFO:tasks.workunit.client.0.smithi008.stdout:1/642: sync 2023-10-18T20:58:40.940 INFO:tasks.workunit.client.0.smithi008.stdout:7/623: unlink d1/d3/d20/l2b 0 2023-10-18T20:58:40.940 INFO:tasks.workunit.client.0.smithi008.stdout:7/624: chown d1/d3/fc0 1 1 2023-10-18T20:58:40.940 INFO:tasks.workunit.client.0.smithi008.stdout:7/625: write d1/d36/d3d/d3e/fb0 [1277255,93401] 0 2023-10-18T20:58:40.941 INFO:tasks.workunit.client.0.smithi008.stdout:3/620: sync 2023-10-18T20:58:40.941 INFO:tasks.workunit.client.0.smithi008.stdout:8/699: sync 2023-10-18T20:58:40.941 INFO:tasks.workunit.client.0.smithi008.stdout:6/599: sync 2023-10-18T20:58:40.941 INFO:tasks.workunit.client.0.smithi008.stdout:6/600: stat df/d18/d7e 0 2023-10-18T20:58:40.945 INFO:tasks.workunit.client.0.smithi008.stdout:0/491: read d0/dd/d19/d5f/f60 [116048,104973] 0 2023-10-18T20:58:40.945 INFO:tasks.workunit.client.0.smithi008.stdout:5/531: rename d0/d2/d19/d7c/d42/d5a/l87 to d0/d2/d19/d7c/lc2 0 2023-10-18T20:58:40.945 INFO:tasks.workunit.client.0.smithi008.stdout:5/532: fsync d0/d2/f23 0 2023-10-18T20:58:40.945 INFO:tasks.workunit.client.0.smithi008.stdout:5/533: write d0/d2/d19/f33 [2119048,45952] 0 2023-10-18T20:58:40.947 INFO:tasks.workunit.client.1.smithi060.stdout:6/771: dwrite fc [0,4194304] 0 2023-10-18T20:58:40.950 INFO:tasks.workunit.client.1.smithi060.stdout:5/769: dwrite d0/d6/d9/d82/d84/db2/d41/f75 [0,4194304] 0 2023-10-18T20:58:40.951 INFO:tasks.workunit.client.1.smithi060.stdout:6/772: getdents d10/d17/d54/dd4 0 2023-10-18T20:58:40.951 INFO:tasks.workunit.client.1.smithi060.stdout:6/773: chown d10/d17/c43 2741 1 2023-10-18T20:58:40.953 INFO:tasks.workunit.client.1.smithi060.stdout:6/774: rename d10/d47/d92/fe8 to d10/d17/feb 0 2023-10-18T20:58:40.962 INFO:tasks.workunit.client.1.smithi060.stdout:1/872: dwrite d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/f6c [0,4194304] 0 2023-10-18T20:58:40.962 INFO:tasks.workunit.client.1.smithi060.stdout:1/873: fsync d4/d6/f22 0 2023-10-18T20:58:40.962 INFO:tasks.workunit.client.1.smithi060.stdout:1/874: creat d4/d6/d48/f11d x:0 0 0 2023-10-18T20:58:40.964 INFO:tasks.workunit.client.0.smithi008.stdout:5/534: rename d0/d2/fa2 to d0/d2/d9/daa/fc3 0 2023-10-18T20:58:40.965 INFO:tasks.workunit.client.0.smithi008.stdout:4/493: creat d0/d3/d21/fa2 x:0 0 0 2023-10-18T20:58:40.965 INFO:tasks.workunit.client.0.smithi008.stdout:3/621: symlink d0/d3/d37/da6/lc8 0 2023-10-18T20:58:40.965 INFO:tasks.workunit.client.0.smithi008.stdout:3/622: creat d0/d3/de/d13/d35/fc9 x:0 0 0 2023-10-18T20:58:40.966 INFO:tasks.workunit.client.0.smithi008.stdout:3/623: write d0/d3/d42/f99 [503834,110199] 0 2023-10-18T20:58:40.966 INFO:tasks.workunit.client.0.smithi008.stdout:2/579: unlink d1/d3/dd/d25/d34/f81 0 2023-10-18T20:58:40.966 INFO:tasks.workunit.client.0.smithi008.stdout:2/580: fdatasync d1/d3/d40/d6e/f78 0 2023-10-18T20:58:40.967 INFO:tasks.workunit.client.0.smithi008.stdout:6/601: chown df/d18/d58/c83 0 1 2023-10-18T20:58:40.967 INFO:tasks.workunit.client.0.smithi008.stdout:6/602: read - df/f24 zero size 2023-10-18T20:58:40.968 INFO:tasks.workunit.client.0.smithi008.stdout:5/535: mknod d0/d2/d19/d7c/d31/d80/d91/cc4 0 2023-10-18T20:58:40.969 INFO:tasks.workunit.client.0.smithi008.stdout:5/536: write d0/d2/d9/d88/fab [554056,10125] 0 2023-10-18T20:58:40.973 INFO:tasks.workunit.client.0.smithi008.stdout:3/624: symlink d0/d3/de/d13/d35/d51/lca 0 2023-10-18T20:58:40.974 INFO:tasks.workunit.client.0.smithi008.stdout:4/494: rename d0/d3/l75 to d0/d17/d5b/d99/la3 0 2023-10-18T20:58:40.974 INFO:tasks.workunit.client.0.smithi008.stdout:6/603: mkdir df/d13/daa/dcb 0 2023-10-18T20:58:40.976 INFO:tasks.workunit.client.1.smithi060.stdout:6/775: mknod d10/d25/cec 0 2023-10-18T20:58:40.978 INFO:tasks.workunit.client.0.smithi008.stdout:5/537: unlink d0/d2/d19/d7c/d31/c53 0 2023-10-18T20:58:40.981 INFO:tasks.workunit.client.0.smithi008.stdout:2/581: rename d1/d3/dd/c13 to d1/d3/d40/d6e/d7e/cbc 0 2023-10-18T20:58:40.981 INFO:tasks.workunit.client.0.smithi008.stdout:2/582: write d1/d3/dd/d25/d5c/f60 [1784272,124067] 0 2023-10-18T20:58:40.981 INFO:tasks.workunit.client.0.smithi008.stdout:6/604: getdents df/d15/d27/dbf 0 2023-10-18T20:58:40.986 INFO:tasks.workunit.client.0.smithi008.stdout:5/538: unlink d0/d2/d9/d34/f71 0 2023-10-18T20:58:40.986 INFO:tasks.workunit.client.0.smithi008.stdout:5/539: chown d0/d2 41132 1 2023-10-18T20:58:40.988 INFO:tasks.workunit.client.0.smithi008.stdout:5/540: creat d0/d2/d19/d7c/d31/d82/fc5 x:0 0 0 2023-10-18T20:58:40.989 INFO:tasks.workunit.client.1.smithi060.stdout:8/700: dwrite d4/d9/d31/d35/d9f/fb9 [0,4194304] 0 2023-10-18T20:58:40.996 INFO:tasks.workunit.client.0.smithi008.stdout:5/541: symlink d0/de/lc6 0 2023-10-18T20:58:41.005 INFO:tasks.workunit.client.0.smithi008.stdout:5/542: link d0/d2/d19/d7c/d31/d3f/d70/f8b d0/d2/d19/fc7 0 2023-10-18T20:58:41.005 INFO:tasks.workunit.client.0.smithi008.stdout:5/543: fdatasync d0/d2/d19/d7c/d58/d65/f2b 0 2023-10-18T20:58:41.008 INFO:tasks.workunit.client.0.smithi008.stdout:9/507: dwrite d2/dc/f1e [0,4194304] 0 2023-10-18T20:58:41.008 INFO:tasks.workunit.client.0.smithi008.stdout:9/508: dread - d2/dc/d1a/d1d/f63 zero size 2023-10-18T20:58:41.008 INFO:tasks.workunit.client.0.smithi008.stdout:9/509: getdents d2/d8 0 2023-10-18T20:58:41.032 INFO:tasks.workunit.client.0.smithi008.stdout:1/643: dwrite d9/f42 [0,4194304] 0 2023-10-18T20:58:41.033 INFO:tasks.workunit.client.0.smithi008.stdout:6/605: dread df/d3c/d77/f76 [0,4194304] 0 2023-10-18T20:58:41.033 INFO:tasks.workunit.client.0.smithi008.stdout:9/510: write d2/dc/d17/d19/fe [7407850,123713] 0 2023-10-18T20:58:41.039 INFO:tasks.workunit.client.0.smithi008.stdout:6/606: creat df/d36/fcc x:0 0 0 2023-10-18T20:58:41.039 INFO:tasks.workunit.client.0.smithi008.stdout:6/607: stat df/d36/fcc 0 2023-10-18T20:58:41.039 INFO:tasks.workunit.client.0.smithi008.stdout:6/608: write df/d18/d3f/f9a [849688,37169] 0 2023-10-18T20:58:41.040 INFO:tasks.workunit.client.0.smithi008.stdout:6/609: fsync df/d19/f4d 0 2023-10-18T20:58:41.044 INFO:tasks.workunit.client.1.smithi060.stdout:8/701: dread d4/d9/d4f/f71 [0,4194304] 0 2023-10-18T20:58:41.044 INFO:tasks.workunit.client.1.smithi060.stdout:8/702: chown d4/d9/db4/lca 1652466 1 2023-10-18T20:58:41.045 INFO:tasks.workunit.client.0.smithi008.stdout:2/583: rename d1/d3/dd/d25/d76/d59/c95 to d1/d3/dd/d48/cbd 0 2023-10-18T20:58:41.046 INFO:tasks.workunit.client.0.smithi008.stdout:9/511: rmdir d2/d4d 39 2023-10-18T20:58:41.048 INFO:tasks.workunit.client.0.smithi008.stdout:0/492: dwrite d0/dd/d19/d24/f66 [0,4194304] 0 2023-10-18T20:58:41.048 INFO:tasks.workunit.client.0.smithi008.stdout:0/493: creat d0/dd/d19/d24/f97 x:0 0 0 2023-10-18T20:58:41.049 INFO:tasks.workunit.client.1.smithi060.stdout:8/703: getdents d4/d9/d37 0 2023-10-18T20:58:41.049 INFO:tasks.workunit.client.0.smithi008.stdout:3/625: rename d0/d3/d37/d6f/f96 to d0/d3/d15/fcb 0 2023-10-18T20:58:41.049 INFO:tasks.workunit.client.0.smithi008.stdout:2/584: mknod d1/cbe 0 2023-10-18T20:58:41.050 INFO:tasks.workunit.client.0.smithi008.stdout:4/495: dwrite d0/d3/d21/d57/d8f/f88 [0,4194304] 0 2023-10-18T20:58:41.050 INFO:tasks.workunit.client.0.smithi008.stdout:5/544: read d0/d2/d9/daa/fc3 [489969,76275] 0 2023-10-18T20:58:41.050 INFO:tasks.workunit.client.0.smithi008.stdout:4/496: write d0/d17/d5b/d2a/f5d [393163,106687] 0 2023-10-18T20:58:41.050 INFO:tasks.workunit.client.0.smithi008.stdout:4/497: readlink d0/d17/d5b/d45/l86 0 2023-10-18T20:58:41.051 INFO:tasks.workunit.client.1.smithi060.stdout:9/690: dwrite d3/d99/d1c/d2a/d33/f53 [0,4194304] 0 2023-10-18T20:58:41.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.052+0000 7fe6888c4700 1 -- 172.21.15.8:0/2746194631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe68406a3b0 msgr2=0x7fe68406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:41.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.052+0000 7fe6888c4700 1 --2- 172.21.15.8:0/2746194631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe68406a3b0 0x7fe68406a830 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fe66c004660 tx=0x7fe66c009b30).stop 2023-10-18T20:58:41.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.052+0000 7fe6888c4700 1 -- 172.21.15.8:0/2746194631 shutdown_connections 2023-10-18T20:58:41.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.052+0000 7fe6888c4700 1 --2- 172.21.15.8:0/2746194631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe68406a3b0 0x7fe68406a830 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0x7fe66c004660 tx=0x7fe66c009b30).stop 2023-10-18T20:58:41.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.052+0000 7fe6888c4700 1 --2- 172.21.15.8:0/2746194631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe68406b9c0 0x7fe684069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:41.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.052+0000 7fe6888c4700 1 -- 172.21.15.8:0/2746194631 >> 172.21.15.8:0/2746194631 conn(0x7fe6840f1c90 msgr2=0x7fe6840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:41.056 INFO:tasks.workunit.client.0.smithi008.stdout:8/700: dwrite d5/d8/df/f9a [0,4194304] 0 2023-10-18T20:58:41.057 INFO:tasks.workunit.client.0.smithi008.stdout:7/626: dwrite d1/d36/d3d/d3e/d59/d73/d7b/fad [0,4194304] 0 2023-10-18T20:58:41.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.053+0000 7fe6888c4700 1 -- 172.21.15.8:0/2746194631 shutdown_connections 2023-10-18T20:58:41.057 INFO:tasks.workunit.client.0.smithi008.stdout:1/644: dread d9/de/df/f5b [0,4194304] 0 2023-10-18T20:58:41.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.053+0000 7fe6888c4700 1 -- 172.21.15.8:0/2746194631 wait complete. 2023-10-18T20:58:41.058 INFO:tasks.workunit.client.0.smithi008.stdout:2/585: dread d1/d3/f1b [0,4194304] 0 2023-10-18T20:58:41.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.054+0000 7fe6888c4700 1 Processor -- start 2023-10-18T20:58:41.059 INFO:tasks.workunit.client.0.smithi008.stdout:9/512: creat d2/dc/d40/f91 x:0 0 0 2023-10-18T20:58:41.060 INFO:tasks.workunit.client.0.smithi008.stdout:9/513: chown d2/dc/d1a/d1d/l36 3799 1 2023-10-18T20:58:41.060 INFO:tasks.workunit.client.0.smithi008.stdout:9/514: readlink d2/dc/d17/l45 0 2023-10-18T20:58:41.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.055+0000 7fe6888c4700 1 -- start start 2023-10-18T20:58:41.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.058+0000 7fe6888c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe68406b9c0 0x7fe684068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:41.062 INFO:tasks.workunit.client.1.smithi060.stdout:6/776: dwrite d10/d2e/d75/dc4/fa8 [0,4194304] 0 2023-10-18T20:58:41.062 INFO:tasks.workunit.client.1.smithi060.stdout:1/875: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/d81/f96 [0,4194304] 0 2023-10-18T20:58:41.062 INFO:tasks.workunit.client.1.smithi060.stdout:1/876: chown d4/d6/d7/df/c9f 32615 1 2023-10-18T20:58:41.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.058+0000 7fe6888c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6840693a0 0x7fe684117050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:41.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.058+0000 7fe6888c4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684069870 con 0x7fe6840693a0 2023-10-18T20:58:41.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.058+0000 7fe6888c4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840699b0 con 0x7fe68406b9c0 2023-10-18T20:58:41.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.060+0000 7fe682ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6840693a0 0x7fe684117050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:41.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.060+0000 7fe682ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6840693a0 0x7fe684117050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51032/0 (socket says 172.21.15.8:51032) 2023-10-18T20:58:41.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.060+0000 7fe682ffd700 1 -- 172.21.15.8:0/1407389579 learned_addr learned my addr 172.21.15.8:0/1407389579 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:41.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.060+0000 7fe6837fe700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe68406b9c0 0x7fe684068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:41.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.061+0000 7fe682ffd700 1 -- 172.21.15.8:0/1407389579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe68406b9c0 msgr2=0x7fe684068eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:41.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.061+0000 7fe682ffd700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe68406b9c0 0x7fe684068eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:41.065 INFO:tasks.workunit.client.0.smithi008.stdout:3/626: mkdir d0/d84/dcc 0 2023-10-18T20:58:41.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.061+0000 7fe682ffd700 1 -- 172.21.15.8:0/1407389579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c005040 con 0x7fe6840693a0 2023-10-18T20:58:41.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.063+0000 7fe6837fe700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe68406b9c0 0x7fe684068eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T20:58:41.066 INFO:tasks.workunit.client.0.smithi008.stdout:0/494: rename d0/d7c/f93 to d0/dd/d19/d24/f98 0 2023-10-18T20:58:41.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.066+0000 7fe682ffd700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6840693a0 0x7fe684117050 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fe66c000c00 tx=0x7fe66c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:41.070 INFO:tasks.workunit.client.1.smithi060.stdout:6/777: rename d10/d2e/l58 to d10/d2e/d75/led 0 2023-10-18T20:58:41.070 INFO:tasks.workunit.client.1.smithi060.stdout:6/778: chown d10/d47/d92/f4a 165664355 1 2023-10-18T20:58:41.071 INFO:tasks.workunit.client.1.smithi060.stdout:6/779: chown d10/d25 0 1 2023-10-18T20:58:41.072 INFO:tasks.workunit.client.0.smithi008.stdout:5/545: mknod d0/d2/d19/d7c/d58/cc8 0 2023-10-18T20:58:41.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.071+0000 7fe67bfff700 1 -- 172.21.15.8:0/1407389579 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe66c019070 con 0x7fe6840693a0 2023-10-18T20:58:41.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.071+0000 7fe67bfff700 1 -- 172.21.15.8:0/1407389579 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe66c01d8d0 con 0x7fe6840693a0 2023-10-18T20:58:41.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.071+0000 7fe67bfff700 1 -- 172.21.15.8:0/1407389579 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe66c012560 con 0x7fe6840693a0 2023-10-18T20:58:41.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.072+0000 7fe6888c4700 1 -- 172.21.15.8:0/1407389579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe684117600 con 0x7fe6840693a0 2023-10-18T20:58:41.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.074+0000 7fe6888c4700 1 -- 172.21.15.8:0/1407389579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe684117b60 con 0x7fe6840693a0 2023-10-18T20:58:41.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.076+0000 7fe6888c4700 1 -- 172.21.15.8:0/1407389579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe684045ad0 con 0x7fe6840693a0 2023-10-18T20:58:41.080 INFO:tasks.workunit.client.1.smithi060.stdout:6/780: symlink d10/d17/d54/db1/dea/dd6/lee 0 2023-10-18T20:58:41.081 INFO:tasks.workunit.client.0.smithi008.stdout:8/701: mkdir d5/d8/df/dce/dfa 0 2023-10-18T20:58:41.082 INFO:tasks.workunit.client.0.smithi008.stdout:8/702: chown d5/d8/df/d9d/d4d/dba/dd4/d77 581215 1 2023-10-18T20:58:41.082 INFO:tasks.workunit.client.0.smithi008.stdout:6/610: rmdir df/d36 39 2023-10-18T20:58:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.078+0000 7fe67bfff700 1 -- 172.21.15.8:0/1407389579 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 77192+0+0 (secure 0 0 0) 0x7fe66c024030 con 0x7fe6840693a0 2023-10-18T20:58:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.079+0000 7fe67bfff700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe670061000 0x7fe6700634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.080+0000 7fe6837fe700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe670061000 0x7fe6700634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:41.084 INFO:tasks.workunit.client.0.smithi008.stdout:8/703: symlink d5/d8/df/d54/lfb 0 2023-10-18T20:58:41.084 INFO:tasks.workunit.client.0.smithi008.stdout:8/704: chown d5/d8/le5 3 1 2023-10-18T20:58:41.084 INFO:tasks.workunit.client.0.smithi008.stdout:8/705: write d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/fe1 [992483,58490] 0 2023-10-18T20:58:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.081+0000 7fe67bfff700 1 -- 172.21.15.8:0/1407389579 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe66c050020 con 0x7fe6840693a0 2023-10-18T20:58:41.085 INFO:tasks.workunit.client.0.smithi008.stdout:6/611: rmdir df/d3c/da2 39 2023-10-18T20:58:41.086 INFO:tasks.workunit.client.1.smithi060.stdout:3/681: sync 2023-10-18T20:58:41.086 INFO:tasks.workunit.client.1.smithi060.stdout:4/687: sync 2023-10-18T20:58:41.087 INFO:tasks.workunit.client.1.smithi060.stdout:4/688: readlink d4/dc/d2a/d1d/l7a 0 2023-10-18T20:58:41.087 INFO:tasks.workunit.client.1.smithi060.stdout:3/682: write d0/d22/d26/d2c/f74 [3381990,94982] 0 2023-10-18T20:58:41.087 INFO:tasks.workunit.client.1.smithi060.stdout:3/683: creat d0/d22/d26/d29/ff1 x:0 0 0 2023-10-18T20:58:41.090 INFO:tasks.workunit.client.1.smithi060.stdout:6/781: rename d10/d17/d2f/l5f to d10/d25/d3c/lef 0 2023-10-18T20:58:41.091 INFO:tasks.workunit.client.1.smithi060.stdout:6/782: stat d10/d2e/c31 0 2023-10-18T20:58:41.091 INFO:tasks.workunit.client.1.smithi060.stdout:4/689: mknod d4/dc/d2a/d83/db1/cd7 0 2023-10-18T20:58:41.091 INFO:tasks.workunit.client.1.smithi060.stdout:4/690: chown d4/dc/d40/c62 640 1 2023-10-18T20:58:41.092 INFO:tasks.workunit.client.1.smithi060.stdout:4/691: write d4/dc/d2a/d2d/d69/d89/fc6 [913122,77913] 0 2023-10-18T20:58:41.093 INFO:tasks.workunit.client.0.smithi008.stdout:6/612: mkdir df/d18/d3f/dcd 0 2023-10-18T20:58:41.093 INFO:tasks.workunit.client.0.smithi008.stdout:6/613: write df/d18/d68/f6e [842991,49538] 0 2023-10-18T20:58:41.096 INFO:tasks.workunit.client.0.smithi008.stdout:0/495: dread d0/d7c/f81 [0,4194304] 0 2023-10-18T20:58:41.096 INFO:tasks.workunit.client.0.smithi008.stdout:0/496: read d0/dd/d19/d5f/f60 [14970,30126] 0 2023-10-18T20:58:41.097 INFO:tasks.workunit.client.0.smithi008.stdout:5/546: dread d0/d2/d19/d7c/d58/f72 [0,4194304] 0 2023-10-18T20:58:41.098 INFO:tasks.workunit.client.1.smithi060.stdout:6/783: dread d10/d17/d2f/f7d [0,4194304] 0 2023-10-18T20:58:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.095+0000 7fe6837fe700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe670061000 0x7fe6700634c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fe684068c20 tx=0x7fe67c009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:41.100 INFO:tasks.workunit.client.0.smithi008.stdout:4/498: write d0/d58/d8e/f53 [1676336,77646] 0 2023-10-18T20:58:41.100 INFO:tasks.workunit.client.0.smithi008.stdout:4/499: chown d0/d17/f60 789112 1 2023-10-18T20:58:41.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.098+0000 7fe67bfff700 1 -- 172.21.15.8:0/1407389579 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7fe66c04dfc0 con 0x7fe6840693a0 2023-10-18T20:58:41.103 INFO:tasks.workunit.client.1.smithi060.stdout:1/877: dread d4/d6/d7/d2f/d7b/d2a/d32/d56/f10a [0,4194304] 0 2023-10-18T20:58:41.103 INFO:tasks.workunit.client.1.smithi060.stdout:1/878: fdatasync d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/ff2 0 2023-10-18T20:58:41.107 INFO:tasks.workunit.client.1.smithi060.stdout:3/684: dread d0/d3c/d3d/d4d/f6a [0,4194304] 0 2023-10-18T20:58:41.107 INFO:tasks.workunit.client.1.smithi060.stdout:3/685: chown d0/d22/d26/d2c/c7e 29 1 2023-10-18T20:58:41.108 INFO:tasks.workunit.client.0.smithi008.stdout:5/547: rmdir d0/d6e/dc1 0 2023-10-18T20:58:41.110 INFO:tasks.workunit.client.0.smithi008.stdout:4/500: link d0/d58/d83/l90 d0/d3/d21/d57/d8f/la4 0 2023-10-18T20:58:41.111 INFO:tasks.workunit.client.1.smithi060.stdout:1/879: rename d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/f10d to d4/d38/de5/f11e 0 2023-10-18T20:58:41.111 INFO:tasks.workunit.client.1.smithi060.stdout:1/880: chown d4/d6/d7/d2f/cae 22719648 1 2023-10-18T20:58:41.114 INFO:tasks.workunit.client.0.smithi008.stdout:0/497: dread d0/dd/df/d2a/d94/f43 [0,4194304] 0 2023-10-18T20:58:41.114 INFO:tasks.workunit.client.0.smithi008.stdout:0/498: stat d0/d7c 0 2023-10-18T20:58:41.116 INFO:tasks.workunit.client.1.smithi060.stdout:3/686: truncate d0/d22/d26/fb0 590739 0 2023-10-18T20:58:41.117 INFO:tasks.workunit.client.0.smithi008.stdout:5/548: mkdir d0/d2/d19/d7c/d31/d3f/dc9 0 2023-10-18T20:58:41.117 INFO:tasks.workunit.client.0.smithi008.stdout:3/627: rmdir d0/d4a/d64 39 2023-10-18T20:58:41.120 INFO:tasks.workunit.client.0.smithi008.stdout:0/499: truncate d0/d7c/f81 2113325 0 2023-10-18T20:58:41.120 INFO:tasks.workunit.client.0.smithi008.stdout:3/628: truncate d0/f62 1457379 0 2023-10-18T20:58:41.135 INFO:tasks.workunit.client.0.smithi008.stdout:8/706: dread d5/f28 [0,4194304] 0 2023-10-18T20:58:41.135 INFO:tasks.workunit.client.0.smithi008.stdout:4/501: write d0/d3/d21/f3e [3516914,120305] 0 2023-10-18T20:58:41.137 INFO:tasks.workunit.client.0.smithi008.stdout:0/500: dread d0/dd/d19/d5f/f60 [0,4194304] 0 2023-10-18T20:58:41.138 INFO:tasks.workunit.client.0.smithi008.stdout:0/501: readlink d0/l6c 0 2023-10-18T20:58:41.140 INFO:tasks.workunit.client.0.smithi008.stdout:4/502: creat d0/d3/fa5 x:0 0 0 2023-10-18T20:58:41.141 INFO:tasks.workunit.client.1.smithi060.stdout:1/881: rename d4/d6/d14 to d4/d38/d11f 0 2023-10-18T20:58:41.143 INFO:tasks.workunit.client.0.smithi008.stdout:0/502: read d0/f2 [938985,49348] 0 2023-10-18T20:58:41.144 INFO:tasks.workunit.client.0.smithi008.stdout:8/707: dread d5/fa6 [0,4194304] 0 2023-10-18T20:58:41.145 INFO:tasks.workunit.client.0.smithi008.stdout:4/503: creat d0/d17/d5b/fa6 x:0 0 0 2023-10-18T20:58:41.145 INFO:tasks.workunit.client.0.smithi008.stdout:4/504: write d0/d17/d5b/f52 [944563,94345] 0 2023-10-18T20:58:41.146 INFO:tasks.workunit.client.0.smithi008.stdout:0/503: rmdir d0/d7c/d7f/d8a/d8f/d21 39 2023-10-18T20:58:41.146 INFO:tasks.workunit.client.0.smithi008.stdout:0/504: fsync d0/dd/d19/d24/f3d 0 2023-10-18T20:58:41.146 INFO:tasks.workunit.client.0.smithi008.stdout:0/505: dread - d0/dd/f8b zero size 2023-10-18T20:58:41.147 INFO:tasks.workunit.client.0.smithi008.stdout:8/708: rmdir d5/d8/df/d9d/d4d/dba/dd4/d77 39 2023-10-18T20:58:41.149 INFO:tasks.workunit.client.1.smithi060.stdout:0/731: sync 2023-10-18T20:58:41.149 INFO:tasks.workunit.client.1.smithi060.stdout:3/687: truncate d0/d22/f52 1191715 0 2023-10-18T20:58:41.149 INFO:tasks.workunit.client.1.smithi060.stdout:0/732: dread - d3/d8/d14/d55/f8f zero size 2023-10-18T20:58:41.153 INFO:tasks.workunit.client.1.smithi060.stdout:1/882: creat d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/d112/f120 x:0 0 0 2023-10-18T20:58:41.153 INFO:tasks.workunit.client.1.smithi060.stdout:1/883: fdatasync d4/d38/f7f 0 2023-10-18T20:58:41.153 INFO:tasks.workunit.client.1.smithi060.stdout:1/884: truncate d4/d6/d7/d2f/d7b/d2a/d32/dd/fed 850236 0 2023-10-18T20:58:41.155 INFO:tasks.workunit.client.1.smithi060.stdout:3/688: write d0/f1d [4215188,81346] 0 2023-10-18T20:58:41.156 INFO:tasks.workunit.client.1.smithi060.stdout:3/689: write d0/d3c/d3d/fb7 [229461,46135] 0 2023-10-18T20:58:41.158 INFO:tasks.workunit.client.1.smithi060.stdout:0/733: mkdir d3/d8/d14/d55/dad/daa/dea 0 2023-10-18T20:58:41.161 INFO:tasks.workunit.client.1.smithi060.stdout:1/885: symlink d4/da/d42/l121 0 2023-10-18T20:58:41.162 INFO:tasks.workunit.client.0.smithi008.stdout:0/506: dread d0/d7c/f7a [0,4194304] 0 2023-10-18T20:58:41.173 INFO:tasks.workunit.client.1.smithi060.stdout:0/734: rename d3/d8/d14/d55/dad/daa/fe3 to d3/d8/d14/d55/d74/d76/d68/d7f/feb 0 2023-10-18T20:58:41.176 INFO:tasks.workunit.client.1.smithi060.stdout:1/886: symlink d4/d6/d48/l122 0 2023-10-18T20:58:41.178 INFO:tasks.workunit.client.1.smithi060.stdout:3/690: getdents d0/d5e 0 2023-10-18T20:58:41.181 INFO:tasks.workunit.client.1.smithi060.stdout:0/735: truncate d3/d8/d14/d55/d74/d76/d68/d7f/fd8 3932663 0 2023-10-18T20:58:41.182 INFO:tasks.workunit.client.1.smithi060.stdout:1/887: symlink d4/d38/d11f/d41/l123 0 2023-10-18T20:58:41.183 INFO:tasks.workunit.client.1.smithi060.stdout:3/691: rmdir d0/d22/d26/d79/db3 39 2023-10-18T20:58:41.183 INFO:tasks.workunit.client.1.smithi060.stdout:0/736: write d3/d8/d14/f5b [1269035,7905] 0 2023-10-18T20:58:41.183 INFO:tasks.workunit.client.1.smithi060.stdout:3/692: creat d0/d22/d26/d29/ff2 x:0 0 0 2023-10-18T20:58:41.184 INFO:tasks.workunit.client.1.smithi060.stdout:3/693: chown d0/d3c/d3d/l6e 653701 1 2023-10-18T20:58:41.185 INFO:tasks.workunit.client.0.smithi008.stdout:1/645: dwrite d9/f42 [0,4194304] 0 2023-10-18T20:58:41.186 INFO:tasks.workunit.client.0.smithi008.stdout:1/646: creat d9/de/df/d17/d1e/d9a/fbf x:0 0 0 2023-10-18T20:58:41.192 INFO:tasks.workunit.client.1.smithi060.stdout:1/888: mkdir d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/d124 0 2023-10-18T20:58:41.193 INFO:tasks.workunit.client.1.smithi060.stdout:1/889: fdatasync d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/fab 0 2023-10-18T20:58:41.193 INFO:tasks.workunit.client.0.smithi008.stdout:9/515: rename d2/dc/d1a/d61 to d2/dc/d40/d6f/d92 0 2023-10-18T20:58:41.194 INFO:tasks.workunit.client.0.smithi008.stdout:3/629: rename d0/d3/de/d13/f9b to d0/d84/fcd 0 2023-10-18T20:58:41.195 INFO:tasks.workunit.client.1.smithi060.stdout:6/784: dwrite d10/d3e/f74 [0,4194304] 0 2023-10-18T20:58:41.195 INFO:tasks.workunit.client.1.smithi060.stdout:0/737: mkdir d3/d8/d14/dec 0 2023-10-18T20:58:41.199 INFO:tasks.workunit.client.1.smithi060.stdout:3/694: mknod d0/d5e/dbc/cf3 0 2023-10-18T20:58:41.199 INFO:tasks.workunit.client.1.smithi060.stdout:1/890: mknod d4/c125 0 2023-10-18T20:58:41.199 INFO:tasks.workunit.client.1.smithi060.stdout:1/891: chown d4/da/d42/f57 43 1 2023-10-18T20:58:41.200 INFO:tasks.workunit.client.1.smithi060.stdout:1/892: fdatasync d4/d6/d7/df/f6b 0 2023-10-18T20:58:41.200 INFO:tasks.workunit.client.1.smithi060.stdout:1/893: stat d4/d6/d7/d2f/d7b/d2a/d32/d56/f75 0 2023-10-18T20:58:41.202 INFO:tasks.workunit.client.0.smithi008.stdout:9/516: unlink d2/dc/d40/f91 0 2023-10-18T20:58:41.203 INFO:tasks.workunit.client.0.smithi008.stdout:9/517: write d2/dc/d1a/f54 [5178795,95051] 0 2023-10-18T20:58:41.204 INFO:tasks.workunit.client.1.smithi060.stdout:8/704: dwrite d4/d9/d31/d35/d9f/fc1 [0,4194304] 0 2023-10-18T20:58:41.205 INFO:tasks.workunit.client.1.smithi060.stdout:8/705: readlink d4/d9/d31/d35/l64 0 2023-10-18T20:58:41.207 INFO:tasks.workunit.client.0.smithi008.stdout:9/518: mknod d2/dc/d40/c93 0 2023-10-18T20:58:41.207 INFO:tasks.workunit.client.0.smithi008.stdout:9/519: write d2/dc/d3d/f70 [312084,100973] 0 2023-10-18T20:58:41.208 INFO:tasks.workunit.client.1.smithi060.stdout:4/692: dwrite d4/dc/f6c [0,4194304] 0 2023-10-18T20:58:41.213 INFO:tasks.workunit.client.1.smithi060.stdout:8/706: mknod d4/d9/d37/ccf 0 2023-10-18T20:58:41.213 INFO:tasks.workunit.client.1.smithi060.stdout:8/707: chown d4/d9/d37/d4e/l5c 31296833 1 2023-10-18T20:58:41.222 INFO:tasks.workunit.client.1.smithi060.stdout:9/691: dwrite d3/d99/d1c/d2a/d80/fb7 [0,4194304] 0 2023-10-18T20:58:41.226 INFO:tasks.workunit.client.1.smithi060.stdout:8/708: mknod d4/d9/cd0 0 2023-10-18T20:58:41.227 INFO:tasks.workunit.client.1.smithi060.stdout:4/693: symlink d4/dc/d2a/d13/ld8 0 2023-10-18T20:58:41.227 INFO:tasks.workunit.client.0.smithi008.stdout:7/627: dwrite d1/d3/f57 [0,4194304] 0 2023-10-18T20:58:41.231 INFO:tasks.workunit.client.0.smithi008.stdout:2/586: dwrite d1/d3/f4b [0,4194304] 0 2023-10-18T20:58:41.231 INFO:tasks.workunit.client.0.smithi008.stdout:0/507: rename d0/dd/df/d2a to d0/dd/d19/d5f/d99 0 2023-10-18T20:58:41.232 INFO:tasks.workunit.client.0.smithi008.stdout:0/508: dread - d0/d7c/f72 zero size 2023-10-18T20:58:41.232 INFO:tasks.workunit.client.1.smithi060.stdout:7/825: sync 2023-10-18T20:58:41.233 INFO:tasks.workunit.client.1.smithi060.stdout:7/826: chown ld 15 1 2023-10-18T20:58:41.233 INFO:tasks.workunit.client.1.smithi060.stdout:7/827: stat l6 0 2023-10-18T20:58:41.233 INFO:tasks.workunit.client.1.smithi060.stdout:7/828: chown de/d14/d2f/d3f/d5a/l8c 49077124 1 2023-10-18T20:58:41.233 INFO:tasks.workunit.client.1.smithi060.stdout:5/770: sync 2023-10-18T20:58:41.233 INFO:tasks.workunit.client.1.smithi060.stdout:2/751: sync 2023-10-18T20:58:41.237 INFO:tasks.workunit.client.0.smithi008.stdout:3/630: write d0/d3/d42/f68 [1841195,69307] 0 2023-10-18T20:58:41.238 INFO:tasks.workunit.client.0.smithi008.stdout:3/631: creat d0/fce x:0 0 0 2023-10-18T20:58:41.238 INFO:tasks.workunit.client.0.smithi008.stdout:3/632: chown d0/f54 1 1 2023-10-18T20:58:41.238 INFO:tasks.workunit.client.0.smithi008.stdout:6/614: dwrite df/d15/d27/f28 [0,4194304] 0 2023-10-18T20:58:41.238 INFO:tasks.workunit.client.0.smithi008.stdout:6/615: write df/d36/f62 [4282780,129539] 0 2023-10-18T20:58:41.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:39.968017+0000 mon.smithi008 (mon.0) 651 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:41.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:40.090866+0000 mgr.smithi008.flmjzp (mgr.14640) 8 : audit [DBG] from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:41.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:40.114649+0000 mgr.smithi008.flmjzp (mgr.14640) 9 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 2.5 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 96 MiB/s rd, 125 MiB/s wr, 190 op/s 2023-10-18T20:58:41.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:40.890592+0000 mon.smithi008 (mon.0) 652 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:58:41.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:40.892490+0000 mon.smithi008 (mon.0) 653 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:58:41.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:40.898719+0000 mon.smithi008 (mon.0) 654 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:41.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:40.906800+0000 mon.smithi008 (mon.0) 655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:41.241 INFO:tasks.workunit.client.1.smithi060.stdout:9/692: unlink d3/f50 0 2023-10-18T20:58:41.241 INFO:tasks.workunit.client.1.smithi060.stdout:8/709: creat d4/d9/d88/fd1 x:0 0 0 2023-10-18T20:58:41.243 INFO:tasks.workunit.client.0.smithi008.stdout:7/628: mkdir d1/d36/d3d/dc3 0 2023-10-18T20:58:41.248 INFO:tasks.workunit.client.0.smithi008.stdout:2/587: mknod d1/d3/dd/d25/d5c/cbf 0 2023-10-18T20:58:41.254 INFO:tasks.workunit.client.1.smithi060.stdout:5/771: rename d0/d6/d9/d82/d84/db2/d41/cac to d0/da/dc8/de4/d6d/db6/c118 0 2023-10-18T20:58:41.255 INFO:tasks.workunit.client.1.smithi060.stdout:5/772: readlink d0/d6/d8/d81/lc4 0 2023-10-18T20:58:41.258 INFO:tasks.workunit.client.0.smithi008.stdout:3/633: symlink d0/d3/de/d13/d35/lcf 0 2023-10-18T20:58:41.259 INFO:tasks.workunit.client.0.smithi008.stdout:3/634: dread - d0/fac zero size 2023-10-18T20:58:41.259 INFO:tasks.workunit.client.0.smithi008.stdout:3/635: dread - d0/d3/de/d13/d35/d51/fbe zero size 2023-10-18T20:58:41.260 INFO:tasks.workunit.client.1.smithi060.stdout:2/752: link d0/d3/d27/d7b/ffb d0/d8/d47/ffe 0 2023-10-18T20:58:41.264 INFO:tasks.workunit.client.0.smithi008.stdout:6/616: creat df/d15/d27/d4c/fce x:0 0 0 2023-10-18T20:58:41.264 INFO:tasks.workunit.client.0.smithi008.stdout:6/617: dread - df/d3c/da2/fbd zero size 2023-10-18T20:58:41.274 INFO:tasks.workunit.client.0.smithi008.stdout:0/509: write d0/dd/d19/d5f/d99/f33 [4331816,23084] 0 2023-10-18T20:58:41.275 INFO:tasks.workunit.client.0.smithi008.stdout:3/636: symlink d0/d3/ld0 0 2023-10-18T20:58:41.275 INFO:tasks.workunit.client.0.smithi008.stdout:3/637: chown d0/d3/d42/d52/c9a 1282688 1 2023-10-18T20:58:41.275 INFO:tasks.workunit.client.0.smithi008.stdout:7/629: rename d1/l25 to d1/d3/d20/lc4 0 2023-10-18T20:58:41.279 INFO:tasks.workunit.client.0.smithi008.stdout:5/549: dwrite d0/f8 [4194304,4194304] 0 2023-10-18T20:58:41.281 INFO:tasks.workunit.client.1.smithi060.stdout:4/694: write d4/dc/d2a/d13/f9b [7485,44369] 0 2023-10-18T20:58:41.281 INFO:tasks.workunit.client.1.smithi060.stdout:9/693: unlink d3/d99/d1c/d5a/d5d/f77 0 2023-10-18T20:58:41.281 INFO:tasks.workunit.client.1.smithi060.stdout:4/695: symlink d4/dc/d2a/d2d/dc7/ld9 0 2023-10-18T20:58:41.282 INFO:tasks.workunit.client.1.smithi060.stdout:4/696: mknod d4/dc/d2a/d13/d27/d68/d9e/cda 0 2023-10-18T20:58:41.287 INFO:tasks.workunit.client.0.smithi008.stdout:3/638: unlink d0/d3/de/d13/d35/lab 0 2023-10-18T20:58:41.295 INFO:tasks.workunit.client.0.smithi008.stdout:0/510: dread d0/d3a/f5c [0,4194304] 0 2023-10-18T20:58:41.295 INFO:tasks.workunit.client.0.smithi008.stdout:0/511: chown d0/d3a/l73 11390 1 2023-10-18T20:58:41.296 INFO:tasks.workunit.client.0.smithi008.stdout:0/512: readlink d0/dd/d19/l5d 0 2023-10-18T20:58:41.305 INFO:tasks.workunit.client.0.smithi008.stdout:7/630: creat d1/da6/d4f/fc5 x:0 0 0 2023-10-18T20:58:41.315 INFO:tasks.workunit.client.0.smithi008.stdout:8/709: dwrite d5/d8/df/d9d/d4d/dba/dd4/fed [0,4194304] 0 2023-10-18T20:58:41.321 INFO:tasks.workunit.client.0.smithi008.stdout:5/550: mknod d0/d2/d9/d9b/d6f/d75/cca 0 2023-10-18T20:58:41.331 INFO:tasks.workunit.client.0.smithi008.stdout:3/639: mknod d0/d3/d15/cd1 0 2023-10-18T20:58:41.331 INFO:tasks.workunit.client.0.smithi008.stdout:3/640: chown d0/d84/dad/dbb 255313 1 2023-10-18T20:58:41.334 INFO:tasks.workunit.client.0.smithi008.stdout:8/710: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/ffc x:0 0 0 2023-10-18T20:58:41.334 INFO:tasks.workunit.client.0.smithi008.stdout:5/551: mknod d0/de/ccb 0 2023-10-18T20:58:41.334 INFO:tasks.workunit.client.0.smithi008.stdout:5/552: truncate d0/fbc 435454 0 2023-10-18T20:58:41.335 INFO:tasks.workunit.client.0.smithi008.stdout:3/641: creat d0/d4a/fd2 x:0 0 0 2023-10-18T20:58:41.338 INFO:tasks.workunit.client.0.smithi008.stdout:8/711: rename d5/d8/df/d9d/d85/ca8 to d5/d8/df/d9d/d4d/dba/dd4/d77/cfd 0 2023-10-18T20:58:41.339 INFO:tasks.workunit.client.0.smithi008.stdout:8/712: fsync d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/fdc 0 2023-10-18T20:58:41.339 INFO:tasks.workunit.client.1.smithi060.stdout:2/753: dread d0/d16/d85/de3/ff7 [0,4194304] 0 2023-10-18T20:58:41.340 INFO:tasks.workunit.client.1.smithi060.stdout:0/738: dwrite d3/f21 [0,4194304] 0 2023-10-18T20:58:41.340 INFO:tasks.workunit.client.1.smithi060.stdout:3/695: dwrite d0/d22/d26/d2c/fd3 [0,4194304] 0 2023-10-18T20:58:41.345 INFO:tasks.workunit.client.1.smithi060.stdout:2/754: rename d0/d3/c9a to d0/d45/dc9/d4a/cff 0 2023-10-18T20:58:41.347 INFO:tasks.workunit.client.0.smithi008.stdout:5/553: unlink d0/d2/d19/d7c/d31/d8d/c9f 0 2023-10-18T20:58:41.347 INFO:tasks.workunit.client.0.smithi008.stdout:5/554: chown d0/d2/d19/d7c/f6b 158692834 1 2023-10-18T20:58:41.347 INFO:tasks.workunit.client.0.smithi008.stdout:5/555: chown d0/d2/d19/d7c/d31/d80/d91/cc4 415 1 2023-10-18T20:58:41.348 INFO:tasks.workunit.client.0.smithi008.stdout:5/556: chown d0/d2/d19/d7c/d31/d80/la0 69 1 2023-10-18T20:58:41.348 INFO:tasks.workunit.client.0.smithi008.stdout:3/642: creat d0/d4a/d64/fd3 x:0 0 0 2023-10-18T20:58:41.348 INFO:tasks.workunit.client.0.smithi008.stdout:3/643: dread - d0/d3/de/f9e zero size 2023-10-18T20:58:41.349 INFO:tasks.workunit.client.0.smithi008.stdout:8/713: creat d5/d8/df/d54/ffe x:0 0 0 2023-10-18T20:58:41.349 INFO:tasks.workunit.client.1.smithi060.stdout:0/739: mknod d3/d8/d14/d55/d9a/dcf/ced 0 2023-10-18T20:58:41.349 INFO:tasks.workunit.client.1.smithi060.stdout:0/740: readlink d3/d32/l39 0 2023-10-18T20:58:41.349 INFO:tasks.workunit.client.1.smithi060.stdout:3/696: symlink d0/d22/d26/lf4 0 2023-10-18T20:58:41.351 INFO:tasks.workunit.client.1.smithi060.stdout:1/894: dwrite d4/d6/d7/d2f/d7b/d2a/f46 [0,4194304] 0 2023-10-18T20:58:41.352 INFO:tasks.workunit.client.0.smithi008.stdout:8/714: link d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/l8e d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/lff 0 2023-10-18T20:58:41.352 INFO:tasks.workunit.client.0.smithi008.stdout:3/644: creat d0/d3/d42/d52/fd4 x:0 0 0 2023-10-18T20:58:41.352 INFO:tasks.workunit.client.1.smithi060.stdout:1/895: creat d4/d6/d7/d35/f126 x:0 0 0 2023-10-18T20:58:41.352 INFO:tasks.workunit.client.1.smithi060.stdout:1/896: truncate d4/d6/d7/d2f/d6d/f104 1006554 0 2023-10-18T20:58:41.353 INFO:tasks.workunit.client.1.smithi060.stdout:3/697: mknod d0/d22/d26/cf5 0 2023-10-18T20:58:41.355 INFO:tasks.workunit.client.1.smithi060.stdout:4/697: dread d4/d15/d2b/f59 [0,4194304] 0 2023-10-18T20:58:41.356 INFO:tasks.workunit.client.1.smithi060.stdout:6/785: dwrite d10/d47/d92/d79/fa4 [0,4194304] 0 2023-10-18T20:58:41.357 INFO:tasks.workunit.client.0.smithi008.stdout:4/505: dwrite d0/d17/d5b/f15 [0,4194304] 0 2023-10-18T20:58:41.358 INFO:tasks.workunit.client.0.smithi008.stdout:1/647: dwrite d9/de/df/d17/d1e/f71 [0,4194304] 0 2023-10-18T20:58:41.362 INFO:tasks.workunit.client.0.smithi008.stdout:8/715: link d5/d8/df/d9d/d85/db1/dcc/ce4 d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/c100 0 2023-10-18T20:58:41.362 INFO:tasks.workunit.client.1.smithi060.stdout:8/710: dwrite d4/d9/d37/d4e/d6e/d7b/fa1 [0,4194304] 0 2023-10-18T20:58:41.362 INFO:tasks.workunit.client.1.smithi060.stdout:8/711: chown d4/d9/d93/lc9 29113950 1 2023-10-18T20:58:41.363 INFO:tasks.workunit.client.1.smithi060.stdout:3/698: link d0/d22/f70 d0/d22/d26/d79/ff6 0 2023-10-18T20:58:41.371 INFO:tasks.workunit.client.1.smithi060.stdout:4/698: write d4/dc/d2a/d5b/f5d [4760626,28385] 0 2023-10-18T20:58:41.371 INFO:tasks.workunit.client.1.smithi060.stdout:4/699: write d4/dc/d2a/d2d/d69/fd1 [16000,111073] 0 2023-10-18T20:58:41.373 INFO:tasks.workunit.client.0.smithi008.stdout:4/506: mknod d0/ca7 0 2023-10-18T20:58:41.376 INFO:tasks.workunit.client.1.smithi060.stdout:7/829: dwrite de/d14/d49/d68/d7d/d7e/db5/fce [0,4194304] 0 2023-10-18T20:58:41.376 INFO:tasks.workunit.client.1.smithi060.stdout:6/786: creat d10/d2e/d75/ff0 x:0 0 0 2023-10-18T20:58:41.377 INFO:tasks.workunit.client.1.smithi060.stdout:8/712: unlink d4/d9/d31/d35/d9f/da3/f89 0 2023-10-18T20:58:41.377 INFO:tasks.workunit.client.1.smithi060.stdout:5/773: dwrite d0/dd/d76/d10f/da5/f3d [0,4194304] 0 2023-10-18T20:58:41.378 INFO:tasks.workunit.client.1.smithi060.stdout:3/699: rename d0/d3c/d3d/d82/fb2 to d0/d22/d26/d29/dae/de4/ff7 0 2023-10-18T20:58:41.384 INFO:tasks.workunit.client.1.smithi060.stdout:4/700: stat d4/dc/d2a/d13/d33/la2 0 2023-10-18T20:58:41.385 INFO:tasks.workunit.client.0.smithi008.stdout:1/648: mkdir d9/de/df/d17/d1e/dc0 0 2023-10-18T20:58:41.385 INFO:tasks.workunit.client.0.smithi008.stdout:8/716: mknod d5/d8/c101 0 2023-10-18T20:58:41.386 INFO:tasks.workunit.client.0.smithi008.stdout:0/513: dwrite d0/dd/d19/f3c [0,4194304] 0 2023-10-18T20:58:41.386 INFO:tasks.workunit.client.0.smithi008.stdout:1/649: stat d9/de/df/d77 0 2023-10-18T20:58:41.388 INFO:tasks.workunit.client.0.smithi008.stdout:3/645: getdents d0/d3/d37 0 2023-10-18T20:58:41.388 INFO:tasks.workunit.client.0.smithi008.stdout:3/646: fdatasync d0/d3/d37/f4c 0 2023-10-18T20:58:41.390 INFO:tasks.workunit.client.1.smithi060.stdout:8/713: creat d4/d9/d37/d4e/d6e/fd2 x:0 0 0 2023-10-18T20:58:41.392 INFO:tasks.workunit.client.0.smithi008.stdout:8/717: mknod d5/d8/c102 0 2023-10-18T20:58:41.393 INFO:tasks.workunit.client.0.smithi008.stdout:8/718: readlink d5/d8/df/l5f 0 2023-10-18T20:58:41.393 INFO:tasks.workunit.client.0.smithi008.stdout:8/719: chown d5/d8/df/d9d/d4d/dba/dd4/d77 18752 1 2023-10-18T20:58:41.393 INFO:tasks.workunit.client.0.smithi008.stdout:6/618: dwrite df/d15/d27/f4a [4194304,4194304] 0 2023-10-18T20:58:41.401 INFO:tasks.workunit.client.1.smithi060.stdout:6/787: dread d10/d3e/d76/f86 [0,4194304] 0 2023-10-18T20:58:41.409 INFO:tasks.workunit.client.1.smithi060.stdout:9/694: dwrite d3/d99/d1c/d2a/d2d/faf [0,4194304] 0 2023-10-18T20:58:41.409 INFO:tasks.workunit.client.1.smithi060.stdout:9/695: chown d3/d99/f3c 7 1 2023-10-18T20:58:41.409 INFO:tasks.workunit.client.1.smithi060.stdout:9/696: fdatasync d3/d99/d1c/d2a/d33/fb1 0 2023-10-18T20:58:41.414 INFO:tasks.workunit.client.1.smithi060.stdout:1/897: dwrite d4/d6/d7/df/f15 [4194304,4194304] 0 2023-10-18T20:58:41.415 INFO:tasks.workunit.client.1.smithi060.stdout:1/898: stat d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/fea 0 2023-10-18T20:58:41.415 INFO:tasks.workunit.client.1.smithi060.stdout:0/741: rmdir d3 39 2023-10-18T20:58:41.416 INFO:tasks.workunit.client.1.smithi060.stdout:0/742: readlink d3/d8/l4d 0 2023-10-18T20:58:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:39.968017+0000 mon.smithi008 (mon.0) 651 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:40.090866+0000 mgr.smithi008.flmjzp (mgr.14640) 8 : audit [DBG] from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:40.114649+0000 mgr.smithi008.flmjzp (mgr.14640) 9 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 2.5 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 96 MiB/s rd, 125 MiB/s wr, 190 op/s 2023-10-18T20:58:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:40.890592+0000 mon.smithi008 (mon.0) 652 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:58:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:40.892490+0000 mon.smithi008 (mon.0) 653 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:58:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:40.898719+0000 mon.smithi008 (mon.0) 654 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:40.906800+0000 mon.smithi008 (mon.0) 655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:41.422 INFO:tasks.workunit.client.0.smithi008.stdout:7/631: dwrite d1/d3/f65 [0,4194304] 0 2023-10-18T20:58:41.423 INFO:tasks.workunit.client.0.smithi008.stdout:7/632: dread - d1/d3/d20/f66 zero size 2023-10-18T20:58:41.426 INFO:tasks.workunit.client.0.smithi008.stdout:5/557: dwrite d0/d2/d19/d7c/f2a [0,4194304] 0 2023-10-18T20:58:41.426 INFO:tasks.workunit.client.0.smithi008.stdout:5/558: readlink d0/d2/d19/l7b 0 2023-10-18T20:58:41.427 INFO:tasks.workunit.client.1.smithi060.stdout:2/755: dwrite d0/d3/d27/d4d/d53/fe9 [0,4194304] 0 2023-10-18T20:58:41.428 INFO:tasks.workunit.client.0.smithi008.stdout:7/633: creat d1/d36/d3d/da3/dae/fc6 x:0 0 0 2023-10-18T20:58:41.441 INFO:tasks.workunit.client.0.smithi008.stdout:2/588: dwrite d1/d3/dd/d1c/d3a/d45/f84 [0,4194304] 0 2023-10-18T20:58:41.448 INFO:tasks.workunit.client.0.smithi008.stdout:5/559: dread d0/d2/f7 [4194304,4194304] 0 2023-10-18T20:58:41.451 INFO:tasks.workunit.client.0.smithi008.stdout:2/589: link d1/d3/dd/d48/cbd d1/d3/dd/d25/d4d/cc0 0 2023-10-18T20:58:41.453 INFO:tasks.workunit.client.1.smithi060.stdout:5/774: creat d0/d47/df2/d10e/f119 x:0 0 0 2023-10-18T20:58:41.453 INFO:tasks.workunit.client.1.smithi060.stdout:4/701: mkdir d4/dc/d2a/d39/d53/d65/ddb 0 2023-10-18T20:58:41.453 INFO:tasks.workunit.client.1.smithi060.stdout:0/743: symlink d3/d8/d14/d55/d74/d76/d6b/lee 0 2023-10-18T20:58:41.454 INFO:tasks.workunit.client.0.smithi008.stdout:5/560: creat d0/d2/d9/d9b/d62/fcc x:0 0 0 2023-10-18T20:58:41.454 INFO:tasks.workunit.client.0.smithi008.stdout:1/650: dwrite d9/de/df/d17/d1e/d9a/f9c [0,4194304] 0 2023-10-18T20:58:41.455 INFO:tasks.workunit.client.0.smithi008.stdout:8/720: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/fdc [0,4194304] 0 2023-10-18T20:58:41.455 INFO:tasks.workunit.client.0.smithi008.stdout:8/721: truncate d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/f99 4458926 0 2023-10-18T20:58:41.456 INFO:tasks.workunit.client.0.smithi008.stdout:8/722: fdatasync d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/fe1 0 2023-10-18T20:58:41.456 INFO:tasks.workunit.client.0.smithi008.stdout:8/723: fdatasync d5/d8/df/d9d/d6c/f46 0 2023-10-18T20:58:41.456 INFO:tasks.workunit.client.1.smithi060.stdout:1/899: rmdir d4/da/de0 39 2023-10-18T20:58:41.457 INFO:tasks.workunit.client.1.smithi060.stdout:1/900: truncate d4/d6/d7/f26 2549827 0 2023-10-18T20:58:41.458 INFO:tasks.workunit.client.1.smithi060.stdout:2/756: rename d0/d8/d47/d73/fde to d0/d8/d47/d73/f100 0 2023-10-18T20:58:41.458 INFO:tasks.workunit.client.1.smithi060.stdout:0/744: creat d3/fef x:0 0 0 2023-10-18T20:58:41.458 INFO:tasks.workunit.client.1.smithi060.stdout:0/745: fdatasync d3/d8/d14/d55/d74/d76/d68/d7f/fd8 0 2023-10-18T20:58:41.459 INFO:tasks.workunit.client.1.smithi060.stdout:3/700: creat d0/d5e/ff8 x:0 0 0 2023-10-18T20:58:41.459 INFO:tasks.workunit.client.1.smithi060.stdout:8/714: symlink d4/d9/d37/d4e/d6e/dcb/ld3 0 2023-10-18T20:58:41.459 INFO:tasks.workunit.client.1.smithi060.stdout:8/715: creat d4/d9/db4/fd4 x:0 0 0 2023-10-18T20:58:41.459 INFO:tasks.workunit.client.1.smithi060.stdout:8/716: chown d4/d9/db4/fc8 8160 1 2023-10-18T20:58:41.461 INFO:tasks.workunit.client.1.smithi060.stdout:5/775: symlink d0/d47/d7d/l11a 0 2023-10-18T20:58:41.461 INFO:tasks.workunit.client.1.smithi060.stdout:5/776: chown d0/d6/f6a 25089 1 2023-10-18T20:58:41.462 INFO:tasks.workunit.client.1.smithi060.stdout:2/757: creat d0/d45/d49/d55/f101 x:0 0 0 2023-10-18T20:58:41.462 INFO:tasks.workunit.client.1.smithi060.stdout:0/746: creat d3/d8/d3c/ff0 x:0 0 0 2023-10-18T20:58:41.468 INFO:tasks.workunit.client.1.smithi060.stdout:8/717: link d4/d9/d31/f66 d4/d9/d31/da6/fd5 0 2023-10-18T20:58:41.468 INFO:tasks.workunit.client.0.smithi008.stdout:5/561: mkdir d0/da9/dcd 0 2023-10-18T20:58:41.469 INFO:tasks.workunit.client.1.smithi060.stdout:5/777: symlink d0/d6/d9/d82/d84/db2/l11b 0 2023-10-18T20:58:41.469 INFO:tasks.workunit.client.1.smithi060.stdout:5/778: creat d0/da/d61/f11c x:0 0 0 2023-10-18T20:58:41.471 INFO:tasks.workunit.client.1.smithi060.stdout:3/701: mknod d0/cf9 0 2023-10-18T20:58:41.472 INFO:tasks.workunit.client.1.smithi060.stdout:3/702: write d0/d22/d26/d2c/f74 [5072806,9278] 0 2023-10-18T20:58:41.474 INFO:tasks.workunit.client.1.smithi060.stdout:8/718: symlink d4/d9/d4f/d74/d81/db8/ld6 0 2023-10-18T20:58:41.475 INFO:tasks.workunit.client.1.smithi060.stdout:5/779: mkdir d0/dd/d76/d10f/da5/d11d 0 2023-10-18T20:58:41.489 INFO:tasks.workunit.client.0.smithi008.stdout:5/562: unlink d0/c76 0 2023-10-18T20:58:41.489 INFO:tasks.workunit.client.0.smithi008.stdout:2/590: write d1/f5a [1127083,97521] 0 2023-10-18T20:58:41.503 INFO:tasks.workunit.client.1.smithi060.stdout:2/758: dread d0/d8/d47/fdf [0,4194304] 0 2023-10-18T20:58:41.505 INFO:tasks.workunit.client.1.smithi060.stdout:2/759: truncate d0/d45/dc9/da8/fc0 49119 0 2023-10-18T20:58:41.506 INFO:tasks.workunit.client.1.smithi060.stdout:3/703: dread d0/d22/d26/d79/ff6 [4194304,4194304] 0 2023-10-18T20:58:41.506 INFO:tasks.workunit.client.1.smithi060.stdout:3/704: truncate d0/d22/d26/d79/fb4 453859 0 2023-10-18T20:58:41.507 INFO:tasks.workunit.client.0.smithi008.stdout:5/563: creat d0/d2/d19/d7c/d31/d3f/d9a/fce x:0 0 0 2023-10-18T20:58:41.507 INFO:tasks.workunit.client.0.smithi008.stdout:5/564: truncate d0/de/f6c 1723602 0 2023-10-18T20:58:41.507 INFO:tasks.workunit.client.1.smithi060.stdout:3/705: dread - d0/d22/d26/d29/ff2 zero size 2023-10-18T20:58:41.513 INFO:tasks.workunit.client.0.smithi008.stdout:0/514: rename d0/d7c/d7f to d0/d7c/d9a 0 2023-10-18T20:58:41.513 INFO:tasks.workunit.client.0.smithi008.stdout:5/565: creat d0/d2/d19/d7c/d31/d80/fcf x:0 0 0 2023-10-18T20:58:41.514 INFO:tasks.workunit.client.0.smithi008.stdout:0/515: fsync d0/dd/d19/d5f/d99/f80 0 2023-10-18T20:58:41.514 INFO:tasks.workunit.client.0.smithi008.stdout:2/591: dread d1/d3/f4b [0,4194304] 0 2023-10-18T20:58:41.516 INFO:tasks.workunit.client.1.smithi060.stdout:2/760: mkdir d0/d45/dc9/d102 0 2023-10-18T20:58:41.525 INFO:tasks.workunit.client.0.smithi008.stdout:2/592: truncate d1/d3/dd/f50 2426790 0 2023-10-18T20:58:41.525 INFO:tasks.workunit.client.0.smithi008.stdout:6/619: rename df/d18 to df/d3c/da2/dcf 0 2023-10-18T20:58:41.525 INFO:tasks.workunit.client.0.smithi008.stdout:6/620: chown df/d3c 1006103 1 2023-10-18T20:58:41.526 INFO:tasks.workunit.client.0.smithi008.stdout:6/621: chown df/d15/d27/d4c/l87 188 1 2023-10-18T20:58:41.531 INFO:tasks.workunit.client.0.smithi008.stdout:0/516: dread d0/dd/f15 [0,4194304] 0 2023-10-18T20:58:41.535 INFO:tasks.workunit.client.0.smithi008.stdout:2/593: dread d1/d3/dd/f71 [0,4194304] 0 2023-10-18T20:58:41.535 INFO:tasks.workunit.client.1.smithi060.stdout:9/697: dwrite d3/d99/d1c/d25/f74 [4194304,4194304] 0 2023-10-18T20:58:41.538 INFO:tasks.workunit.client.1.smithi060.stdout:9/698: mkdir d3/d99/d1c/d2a/d80/da0/dc2/d9e/dfd 0 2023-10-18T20:58:41.538 INFO:tasks.workunit.client.1.smithi060.stdout:9/699: write d3/d99/d1c/d5a/d5d/f9a [2174648,126984] 0 2023-10-18T20:58:41.538 INFO:tasks.workunit.client.0.smithi008.stdout:6/622: rename df/d3c/da2/dcf/d68/cc7 to df/d3c/d77/da9/cd0 0 2023-10-18T20:58:41.540 INFO:tasks.workunit.client.1.smithi060.stdout:9/700: rename d3/d99/c44 to d3/d99/d1c/d2a/d80/da0/dc2/d9e/dfd/cfe 0 2023-10-18T20:58:41.543 INFO:tasks.workunit.client.0.smithi008.stdout:8/724: rename d5/f37 to d5/d8/df/d9d/d4d/dba/f103 0 2023-10-18T20:58:41.543 INFO:tasks.workunit.client.0.smithi008.stdout:8/725: chown d5/d8/df/d9d/d4d/dba/dd4/d50/f5e 0 1 2023-10-18T20:58:41.543 INFO:tasks.workunit.client.0.smithi008.stdout:8/726: chown d5/d8/df/d54/c69 170343742 1 2023-10-18T20:58:41.550 INFO:tasks.workunit.client.1.smithi060.stdout:8/719: write d4/d9/d4f/f63 [1770113,41116] 0 2023-10-18T20:58:41.551 INFO:tasks.workunit.client.0.smithi008.stdout:6/623: mkdir df/dd1 0 2023-10-18T20:58:41.551 INFO:tasks.workunit.client.0.smithi008.stdout:6/624: fdatasync df/d15/d27/f28 0 2023-10-18T20:58:41.551 INFO:tasks.workunit.client.0.smithi008.stdout:6/625: write df/d3c/d77/f99 [816412,11492] 0 2023-10-18T20:58:41.552 INFO:tasks.workunit.client.1.smithi060.stdout:8/720: truncate d4/d9/d31/d35/d9f/da3/f99 3357690 0 2023-10-18T20:58:41.552 INFO:tasks.workunit.client.1.smithi060.stdout:8/721: readlink d4/d9/d31/d35/d9f/da3/l77 0 2023-10-18T20:58:41.554 INFO:tasks.workunit.client.1.smithi060.stdout:8/722: rename d4/d9/d31/f40 to d4/d9/db4/fd7 0 2023-10-18T20:58:41.556 INFO:tasks.workunit.client.1.smithi060.stdout:5/780: dwrite d0/d6/d9/f14 [0,4194304] 0 2023-10-18T20:58:41.557 INFO:tasks.workunit.client.1.smithi060.stdout:5/781: chown d0/d6/d8/d81/f101 646 1 2023-10-18T20:58:41.557 INFO:tasks.workunit.client.1.smithi060.stdout:5/782: creat d0/d6/d8/d81/f11e x:0 0 0 2023-10-18T20:58:41.557 INFO:tasks.workunit.client.1.smithi060.stdout:5/783: chown d0/d6/d9/d82/d83/cad 4963 1 2023-10-18T20:58:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.554+0000 7fe6888c4700 1 -- 172.21.15.8:0/1407389579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe6841052b0 con 0x7fe6840693a0 2023-10-18T20:58:41.558 INFO:tasks.workunit.client.1.smithi060.stdout:6/788: dwrite d10/d17/d54/db1/fbd [0,4194304] 0 2023-10-18T20:58:41.558 INFO:tasks.workunit.client.1.smithi060.stdout:6/789: readlink d10/d17/d2f/lc0 0 2023-10-18T20:58:41.560 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:58:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T20:58:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T20:58:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:58:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T20:58:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T20:58:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:58:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T20:58:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-10-18T20:58:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:58:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T20:58:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T20:58:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:58:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T20:58:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2, 2023-10-18T20:58:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12 2023-10-18T20:58:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T20:58:41.564 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:58:41.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.555+0000 7fe67bfff700 1 -- 172.21.15.8:0/1407389579 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+697 (secure 0 0 0) 0x7fe66c02c070 con 0x7fe6840693a0 2023-10-18T20:58:41.564 INFO:tasks.workunit.client.0.smithi008.stdout:5/566: rename d0/d2/f57 to d0/d2/d19/d7c/d31/d3f/d70/fd0 0 2023-10-18T20:58:41.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.559+0000 7fe6888c4700 1 -- 172.21.15.8:0/1407389579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe670061000 msgr2=0x7fe6700634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:41.565 INFO:tasks.workunit.client.1.smithi060.stdout:7/830: dwrite de/d14/d49/d68/d7d/d7e/db5/fce [4194304,4194304] 0 2023-10-18T20:58:41.566 INFO:tasks.workunit.client.1.smithi060.stdout:0/747: dread d3/d8/d14/d55/d74/d76/d68/f92 [4194304,4194304] 0 2023-10-18T20:58:41.566 INFO:tasks.workunit.client.1.smithi060.stdout:0/748: chown d3/c37 632300 1 2023-10-18T20:58:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.559+0000 7fe6888c4700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe670061000 0x7fe6700634c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fe684068c20 tx=0x7fe67c009040).stop 2023-10-18T20:58:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.559+0000 7fe6888c4700 1 -- 172.21.15.8:0/1407389579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6840693a0 msgr2=0x7fe684117050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.559+0000 7fe6888c4700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6840693a0 0x7fe684117050 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fe66c000c00 tx=0x7fe66c009b30).stop 2023-10-18T20:58:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.559+0000 7fe6888c4700 1 -- 172.21.15.8:0/1407389579 shutdown_connections 2023-10-18T20:58:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.560+0000 7fe6888c4700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe670061000 0x7fe6700634c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:41.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.560+0000 7fe6888c4700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe68406b9c0 0x7fe684068eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:41.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.560+0000 7fe6888c4700 1 --2- 172.21.15.8:0/1407389579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6840693a0 0x7fe684117050 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:41.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.560+0000 7fe6888c4700 1 -- 172.21.15.8:0/1407389579 >> 172.21.15.8:0/1407389579 conn(0x7fe6840f1c90 msgr2=0x7fe6840f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:41.568 INFO:tasks.workunit.client.0.smithi008.stdout:1/651: dwrite d9/f54 [0,4194304] 0 2023-10-18T20:58:41.569 INFO:tasks.workunit.client.0.smithi008.stdout:1/652: stat d9/de/df/d17/d1e/d3c/d90/cbe 0 2023-10-18T20:58:41.569 INFO:tasks.workunit.client.0.smithi008.stdout:6/626: creat df/d3c/fd2 x:0 0 0 2023-10-18T20:58:41.569 INFO:tasks.workunit.client.0.smithi008.stdout:6/627: truncate df/d3c/da2/dcf/d3f/f8e 4533233 0 2023-10-18T20:58:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.565+0000 7fe6888c4700 1 -- 172.21.15.8:0/1407389579 shutdown_connections 2023-10-18T20:58:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.565+0000 7fe6888c4700 1 -- 172.21.15.8:0/1407389579 wait complete. 2023-10-18T20:58:41.570 INFO:tasks.workunit.client.0.smithi008.stdout:1/653: write d9/de/df/d17/d1e/d3c/d90/f99 [274871,53948] 0 2023-10-18T20:58:41.570 INFO:tasks.workunit.client.0.smithi008.stdout:1/654: truncate d9/de/df/d17/d1e/d3c/d90/f99 1055670 0 2023-10-18T20:58:41.571 INFO:tasks.workunit.client.0.smithi008.stdout:6/628: read df/d3c/da2/fb4 [222798,76860] 0 2023-10-18T20:58:41.571 INFO:tasks.workunit.client.1.smithi060.stdout:5/784: creat d0/d6/f11f x:0 0 0 2023-10-18T20:58:41.572 INFO:tasks.workunit.client.1.smithi060.stdout:9/701: dread d3/d99/f69 [0,4194304] 0 2023-10-18T20:58:41.572 INFO:tasks.workunit.client.1.smithi060.stdout:6/790: mknod d10/d17/d7a/cf1 0 2023-10-18T20:58:41.572 INFO:tasks.workunit.client.1.smithi060.stdout:8/723: getdents d4/d9/d31/d35/d9f 0 2023-10-18T20:58:41.572 INFO:tasks.workunit.client.1.smithi060.stdout:7/831: unlink de/d14/d3a/d46/d73/cfb 0 2023-10-18T20:58:41.573 INFO:tasks.workunit.client.1.smithi060.stdout:7/832: chown de/d14/d3a/l50 104 1 2023-10-18T20:58:41.574 INFO:tasks.workunit.client.1.smithi060.stdout:9/702: rmdir d3/d99/d1c/d2a/d2d 39 2023-10-18T20:58:41.579 INFO:tasks.workunit.client.0.smithi008.stdout:0/517: rename d0/lc to d0/d7c/d9a/d8a/d8f/d21/l9b 0 2023-10-18T20:58:41.582 INFO:tasks.workunit.client.1.smithi060.stdout:7/833: rmdir de/d14/d41 39 2023-10-18T20:58:41.582 INFO:tasks.workunit.client.1.smithi060.stdout:7/834: creat de/d14/d2f/dd3/f10a x:0 0 0 2023-10-18T20:58:41.582 INFO:tasks.workunit.client.1.smithi060.stdout:9/703: creat d3/d99/d1c/d2a/d2d/fff x:0 0 0 2023-10-18T20:58:41.589 INFO:tasks.workunit.client.1.smithi060.stdout:1/901: dwrite d4/d6/d48/fff [0,4194304] 0 2023-10-18T20:58:41.589 INFO:tasks.workunit.client.1.smithi060.stdout:1/902: chown d4/d6/d7/d2f/d7b/d2a/d32/dd/f5c 78003428 1 2023-10-18T20:58:41.590 INFO:tasks.workunit.client.1.smithi060.stdout:2/761: dwrite d0/d45/dc9/f8e [0,4194304] 0 2023-10-18T20:58:41.591 INFO:tasks.workunit.client.1.smithi060.stdout:5/785: dread d0/d6/d9/d82/d84/db2/f22 [0,4194304] 0 2023-10-18T20:58:41.594 INFO:tasks.workunit.client.1.smithi060.stdout:1/903: creat d4/d6/d7/d2f/d7b/dda/f127 x:0 0 0 2023-10-18T20:58:41.594 INFO:tasks.workunit.client.0.smithi008.stdout:6/629: link df/d15/d48/d4b/c5b df/d13/d53/d64/cd3 0 2023-10-18T20:58:41.595 INFO:tasks.workunit.client.0.smithi008.stdout:1/655: mkdir d9/de/df/d17/d25/dc1 0 2023-10-18T20:58:41.595 INFO:tasks.workunit.client.1.smithi060.stdout:2/762: creat d0/d3/d9e/f103 x:0 0 0 2023-10-18T20:58:41.598 INFO:tasks.workunit.client.1.smithi060.stdout:1/904: unlink d4/f8 0 2023-10-18T20:58:41.598 INFO:tasks.workunit.client.1.smithi060.stdout:5/786: creat d0/d47/d7d/da0/f120 x:0 0 0 2023-10-18T20:58:41.598 INFO:tasks.workunit.client.1.smithi060.stdout:1/905: fsync d4/d6/d7/d2f/fba 0 2023-10-18T20:58:41.599 INFO:tasks.workunit.client.1.smithi060.stdout:4/702: dwrite d4/dc/d2a/d39/d53/d65/d8d/fa1 [0,4194304] 0 2023-10-18T20:58:41.599 INFO:tasks.workunit.client.1.smithi060.stdout:4/703: creat d4/dc/d2a/d39/fdc x:0 0 0 2023-10-18T20:58:41.601 INFO:tasks.workunit.client.0.smithi008.stdout:1/656: mknod d9/de/df/d17/d1e/d9a/cc2 0 2023-10-18T20:58:41.602 INFO:tasks.workunit.client.0.smithi008.stdout:0/518: mknod d0/dd/d19/c9c 0 2023-10-18T20:58:41.602 INFO:tasks.workunit.client.0.smithi008.stdout:6/630: rmdir df/d3c/da2 39 2023-10-18T20:58:41.602 INFO:tasks.workunit.client.0.smithi008.stdout:6/631: fsync df/d3c/da2/fbd 0 2023-10-18T20:58:41.603 INFO:tasks.workunit.client.1.smithi060.stdout:1/906: mknod d4/d6/c128 0 2023-10-18T20:58:41.603 INFO:tasks.workunit.client.1.smithi060.stdout:6/791: dread d10/f51 [0,4194304] 0 2023-10-18T20:58:41.603 INFO:tasks.workunit.client.0.smithi008.stdout:6/632: creat df/d13/d53/fd4 x:0 0 0 2023-10-18T20:58:41.604 INFO:tasks.workunit.client.1.smithi060.stdout:3/706: dwrite d0/d22/d26/d8c/fbb [0,4194304] 0 2023-10-18T20:58:41.604 INFO:tasks.workunit.client.1.smithi060.stdout:3/707: readlink d0/d22/l75 0 2023-10-18T20:58:41.605 INFO:tasks.workunit.client.1.smithi060.stdout:6/792: mkdir d10/d25/df2 0 2023-10-18T20:58:41.608 INFO:tasks.workunit.client.1.smithi060.stdout:6/793: mkdir d10/d17/dae/df3 0 2023-10-18T20:58:41.611 INFO:tasks.workunit.client.0.smithi008.stdout:8/727: rename d5/d8/df/d54 to d5/d8/df/d9d/d85/db1/dcc/d104 0 2023-10-18T20:58:41.611 INFO:tasks.workunit.client.0.smithi008.stdout:1/657: mkdir d9/de/df/dc3 0 2023-10-18T20:58:41.618 INFO:tasks.workunit.client.0.smithi008.stdout:0/519: dread d0/f1d [0,4194304] 0 2023-10-18T20:58:41.618 INFO:tasks.workunit.client.0.smithi008.stdout:0/520: dread - d0/dd/d19/d5f/d99/d94/f50 zero size 2023-10-18T20:58:41.620 INFO:tasks.workunit.client.0.smithi008.stdout:1/658: mkdir d9/de/df/d17/d25/d94/dc4 0 2023-10-18T20:58:41.632 INFO:tasks.workunit.client.0.smithi008.stdout:1/659: truncate d9/f42 4151185 0 2023-10-18T20:58:41.632 INFO:tasks.workunit.client.0.smithi008.stdout:1/660: chown d9/de/df/l5a 41 1 2023-10-18T20:58:41.635 INFO:tasks.workunit.client.1.smithi060.stdout:1/907: dread d4/d6/d7/df/f40 [0,4194304] 0 2023-10-18T20:58:41.637 INFO:tasks.workunit.client.1.smithi060.stdout:1/908: symlink d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/l129 0 2023-10-18T20:58:41.639 INFO:tasks.workunit.client.1.smithi060.stdout:1/909: link d4/d6/d7/d2f/d7b/d2a/l66 d4/d6/d7/df/d59/l12a 0 2023-10-18T20:58:41.642 INFO:tasks.workunit.client.1.smithi060.stdout:1/910: link d4/d6/d7/d2f/d7b/cd4 d4/d6/d7/d2f/d7b/d2a/d32/d56/c12b 0 2023-10-18T20:58:41.646 INFO:tasks.workunit.client.1.smithi060.stdout:1/911: mkdir d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/d12c 0 2023-10-18T20:58:41.648 INFO:tasks.workunit.client.1.smithi060.stdout:1/912: write d4/d6/d7/f26 [1300893,77229] 0 2023-10-18T20:58:41.650 INFO:tasks.workunit.client.1.smithi060.stdout:1/913: creat d4/d38/d11f/f12d x:0 0 0 2023-10-18T20:58:41.653 INFO:tasks.workunit.client.0.smithi008.stdout:6/633: write df/d3c/d77/d50/f55 [495219,15457] 0 2023-10-18T20:58:41.654 INFO:tasks.workunit.client.1.smithi060.stdout:2/763: read d0/d8/f8a [384882,36961] 0 2023-10-18T20:58:41.657 INFO:tasks.workunit.client.1.smithi060.stdout:3/708: dwrite d0/d22/d26/d2c/fec [0,4194304] 0 2023-10-18T20:58:41.660 INFO:tasks.workunit.client.0.smithi008.stdout:9/520: sync 2023-10-18T20:58:41.661 INFO:tasks.workunit.client.0.smithi008.stdout:1/661: dread d9/f54 [0,4194304] 0 2023-10-18T20:58:41.662 INFO:tasks.workunit.client.0.smithi008.stdout:0/521: rmdir d0/d7c/d9a/d8a/d8f 39 2023-10-18T20:58:41.663 INFO:tasks.workunit.client.1.smithi060.stdout:2/764: unlink d0/d45/dc9/d68/l8c 0 2023-10-18T20:58:41.663 INFO:tasks.workunit.client.1.smithi060.stdout:2/765: readlink d0/d45/d49/lbc 0 2023-10-18T20:58:41.673 INFO:tasks.workunit.client.1.smithi060.stdout:6/794: dread d10/d17/d54/f5a [0,4194304] 0 2023-10-18T20:58:41.673 INFO:tasks.workunit.client.1.smithi060.stdout:6/795: creat d10/d17/d7a/ff4 x:0 0 0 2023-10-18T20:58:41.675 INFO:tasks.workunit.client.0.smithi008.stdout:5/567: dwrite d0/d2/d19/d7c/d31/f78 [0,4194304] 0 2023-10-18T20:58:41.675 INFO:tasks.workunit.client.0.smithi008.stdout:5/568: fsync d0/d86/f8c 0 2023-10-18T20:58:41.677 INFO:tasks.workunit.client.0.smithi008.stdout:6/634: getdents df/d15/d48 0 2023-10-18T20:58:41.678 INFO:tasks.workunit.client.1.smithi060.stdout:6/796: symlink d10/d17/d54/dd4/lf5 0 2023-10-18T20:58:41.680 INFO:tasks.workunit.client.1.smithi060.stdout:6/797: symlink d10/d17/d54/db1/dea/dd6/lf6 0 2023-10-18T20:58:41.681 INFO:tasks.workunit.client.1.smithi060.stdout:2/766: dread d0/d16/d7f/fd8 [0,4194304] 0 2023-10-18T20:58:41.682 INFO:tasks.workunit.client.1.smithi060.stdout:6/798: symlink d10/d2e/lf7 0 2023-10-18T20:58:41.683 INFO:tasks.workunit.client.1.smithi060.stdout:2/767: mkdir d0/d3/d27/d7b/d104 0 2023-10-18T20:58:41.685 INFO:tasks.workunit.client.1.smithi060.stdout:6/799: creat d10/d17/d54/db1/dea/dd6/ff8 x:0 0 0 2023-10-18T20:58:41.686 INFO:tasks.workunit.client.1.smithi060.stdout:6/800: creat d10/d17/dae/ff9 x:0 0 0 2023-10-18T20:58:41.687 INFO:tasks.workunit.client.1.smithi060.stdout:6/801: chown d10/d47/d92/f2b 15922 1 2023-10-18T20:58:41.687 INFO:tasks.workunit.client.1.smithi060.stdout:2/768: unlink d0/d8/c64 0 2023-10-18T20:58:41.689 INFO:tasks.workunit.client.0.smithi008.stdout:8/728: getdents d5/d8/df/d9d/d85/db1/dcc 0 2023-10-18T20:58:41.689 INFO:tasks.workunit.client.1.smithi060.stdout:8/724: dwrite d4/d9/fb1 [0,4194304] 0 2023-10-18T20:58:41.691 INFO:tasks.workunit.client.1.smithi060.stdout:6/802: creat d10/d47/d92/dab/ffa x:0 0 0 2023-10-18T20:58:41.691 INFO:tasks.workunit.client.1.smithi060.stdout:6/803: readlink d10/d17/d54/dd4/lf5 0 2023-10-18T20:58:41.691 INFO:tasks.workunit.client.1.smithi060.stdout:2/769: symlink d0/d3/d9e/dc2/l105 0 2023-10-18T20:58:41.695 INFO:tasks.workunit.client.0.smithi008.stdout:1/662: mknod d9/de/df/cc5 0 2023-10-18T20:58:41.695 INFO:tasks.workunit.client.0.smithi008.stdout:1/663: write d9/de/df/f10 [3861614,6346] 0 2023-10-18T20:58:41.695 INFO:tasks.workunit.client.0.smithi008.stdout:0/522: creat d0/dd/d19/d5f/d99/d94/f9d x:0 0 0 2023-10-18T20:58:41.698 INFO:tasks.workunit.client.0.smithi008.stdout:5/569: mkdir d0/d2/d19/d7c/d31/d8d/dd1 0 2023-10-18T20:58:41.698 INFO:tasks.workunit.client.0.smithi008.stdout:5/570: getdents d0/da9/dcd 0 2023-10-18T20:58:41.699 INFO:tasks.workunit.client.0.smithi008.stdout:5/571: write d0/d2/d9/d9b/f50 [561889,84261] 0 2023-10-18T20:58:41.699 INFO:tasks.workunit.client.0.smithi008.stdout:5/572: write d0/d2/d19/d7c/d64/fb6 [876052,32690] 0 2023-10-18T20:58:41.699 INFO:tasks.workunit.client.0.smithi008.stdout:5/573: chown d0/d2/d19/d7c/d31/d3f/d9a 29099402 1 2023-10-18T20:58:41.700 INFO:tasks.workunit.client.1.smithi060.stdout:6/804: rename d10/d25/l80 to d10/d25/lfb 0 2023-10-18T20:58:41.700 INFO:tasks.workunit.client.1.smithi060.stdout:2/770: getdents d0/d3/d9e/dce 0 2023-10-18T20:58:41.700 INFO:tasks.workunit.client.1.smithi060.stdout:0/749: dwrite d3/d80/f82 [0,4194304] 0 2023-10-18T20:58:41.703 INFO:tasks.workunit.client.1.smithi060.stdout:6/805: unlink d10/d17/feb 0 2023-10-18T20:58:41.704 INFO:tasks.workunit.client.0.smithi008.stdout:1/664: mkdir d9/de/df/d17/d25/d94/dc4/dc6 0 2023-10-18T20:58:41.704 INFO:tasks.workunit.client.0.smithi008.stdout:8/729: truncate d5/d8/df/f39 2777867 0 2023-10-18T20:58:41.704 INFO:tasks.workunit.client.0.smithi008.stdout:1/665: creat d9/de/df/d17/d1e/d9a/fc7 x:0 0 0 2023-10-18T20:58:41.706 INFO:tasks.workunit.client.0.smithi008.stdout:0/523: rename d0/dd/d19/d5f/c68 to d0/d7c/d9a/d8a/d8f/d21/c9e 0 2023-10-18T20:58:41.707 INFO:tasks.workunit.client.1.smithi060.stdout:2/771: rename d0/cb7 to d0/d16/d81/da1/c106 0 2023-10-18T20:58:41.707 INFO:tasks.workunit.client.1.smithi060.stdout:2/772: readlink d0/d16/d7f/lc4 0 2023-10-18T20:58:41.707 INFO:tasks.workunit.client.1.smithi060.stdout:2/773: chown d0/d16/d85/de3 110 1 2023-10-18T20:58:41.707 INFO:tasks.workunit.client.1.smithi060.stdout:2/774: read - d0/d16/d85/ff4 zero size 2023-10-18T20:58:41.708 INFO:tasks.workunit.client.0.smithi008.stdout:0/524: write d0/dd/d19/d5f/d99/d94/f65 [1366261,5362] 0 2023-10-18T20:58:41.709 INFO:tasks.workunit.client.0.smithi008.stdout:0/525: fdatasync d0/dd/f15 0 2023-10-18T20:58:41.709 INFO:tasks.workunit.client.0.smithi008.stdout:0/526: write d0/dd/df/f1c [1645344,9439] 0 2023-10-18T20:58:41.711 INFO:tasks.workunit.client.0.smithi008.stdout:8/730: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/deb/f105 x:0 0 0 2023-10-18T20:58:41.711 INFO:tasks.workunit.client.0.smithi008.stdout:1/666: getdents d9/de/df/d85 0 2023-10-18T20:58:41.712 INFO:tasks.workunit.client.0.smithi008.stdout:1/667: chown d9/de/df/d17/c38 60 1 2023-10-18T20:58:41.712 INFO:tasks.workunit.client.1.smithi060.stdout:8/725: write d4/ff [1261450,27576] 0 2023-10-18T20:58:41.714 INFO:tasks.workunit.client.1.smithi060.stdout:4/704: dwrite d4/dc/d2a/d39/f49 [0,4194304] 0 2023-10-18T20:58:41.716 INFO:tasks.workunit.client.0.smithi008.stdout:0/527: dread d0/f51 [0,4194304] 0 2023-10-18T20:58:41.719 INFO:tasks.workunit.client.0.smithi008.stdout:0/528: creat d0/dd/d19/d5f/d99/d5e/d7d/f9f x:0 0 0 2023-10-18T20:58:41.720 INFO:tasks.workunit.client.0.smithi008.stdout:0/529: chown d0/dd/d19/d24/f3d 21 1 2023-10-18T20:58:41.720 INFO:tasks.workunit.client.0.smithi008.stdout:0/530: chown d0/dd/d19/d5f/d99/f33 13310 1 2023-10-18T20:58:41.720 INFO:tasks.workunit.client.0.smithi008.stdout:0/531: dread - d0/dd/d19/d24/f88 zero size 2023-10-18T20:58:41.720 INFO:tasks.workunit.client.1.smithi060.stdout:7/835: dwrite de/d14/d49/d68/d7d/d7e/db5/fce [4194304,4194304] 0 2023-10-18T20:58:41.722 INFO:tasks.workunit.client.0.smithi008.stdout:5/574: dread d0/d2/d19/d7c/d31/d3f/d70/f8b [0,4194304] 0 2023-10-18T20:58:41.723 INFO:tasks.workunit.client.0.smithi008.stdout:8/731: dread d5/d8/df/d9d/d4d/f7c [0,4194304] 0 2023-10-18T20:58:41.731 INFO:tasks.workunit.client.1.smithi060.stdout:6/806: symlink d10/d17/d2f/lfc 0 2023-10-18T20:58:41.731 INFO:tasks.workunit.client.1.smithi060.stdout:2/775: mkdir d0/d8/d87/d107 0 2023-10-18T20:58:41.734 INFO:tasks.workunit.client.0.smithi008.stdout:7/634: sync 2023-10-18T20:58:41.734 INFO:tasks.workunit.client.0.smithi008.stdout:2/594: sync 2023-10-18T20:58:41.734 INFO:tasks.workunit.client.0.smithi008.stdout:2/595: chown d1/d3/dd/d25/d4d/cc0 0 1 2023-10-18T20:58:41.735 INFO:tasks.workunit.client.0.smithi008.stdout:2/596: readlink d1/d3/la5 0 2023-10-18T20:58:41.735 INFO:tasks.workunit.client.0.smithi008.stdout:4/507: sync 2023-10-18T20:58:41.735 INFO:tasks.workunit.client.0.smithi008.stdout:2/597: truncate d1/d3/dd/d25/d76/f3f 5628899 0 2023-10-18T20:58:41.735 INFO:tasks.workunit.client.0.smithi008.stdout:3/647: sync 2023-10-18T20:58:41.736 INFO:tasks.workunit.client.0.smithi008.stdout:3/648: read d0/d3/d37/d74/fa4 [494409,46902] 0 2023-10-18T20:58:41.736 INFO:tasks.workunit.client.0.smithi008.stdout:7/635: creat d1/d36/d3d/d3e/d59/d73/d7b/fc7 x:0 0 0 2023-10-18T20:58:41.741 INFO:tasks.workunit.client.0.smithi008.stdout:4/508: rename d0/d17/d5b/f26 to d0/d58/d83/fa8 0 2023-10-18T20:58:41.741 INFO:tasks.workunit.client.0.smithi008.stdout:4/509: fdatasync d0/f13 0 2023-10-18T20:58:41.741 INFO:tasks.workunit.client.1.smithi060.stdout:8/726: mkdir d4/d9/d31/d35/d9f/da3/dd8 0 2023-10-18T20:58:41.744 INFO:tasks.workunit.client.0.smithi008.stdout:0/532: write d0/dd/d19/d5f/d99/f80 [808182,82578] 0 2023-10-18T20:58:41.744 INFO:tasks.workunit.client.1.smithi060.stdout:0/750: dread d3/d8/d14/f89 [0,4194304] 0 2023-10-18T20:58:41.745 INFO:tasks.workunit.client.0.smithi008.stdout:2/598: link d1/d3/c9 d1/d3/d40/d6e/d7e/cc1 0 2023-10-18T20:58:41.746 INFO:tasks.workunit.client.1.smithi060.stdout:9/704: dwrite d3/d99/d19/d54/d8f/fd9 [0,4194304] 0 2023-10-18T20:58:41.747 INFO:tasks.workunit.client.1.smithi060.stdout:4/705: link d4/dc/d2a/d39/f8c d4/dc/d2a/d2d/d69/d89/fdd 0 2023-10-18T20:58:41.748 INFO:tasks.workunit.client.1.smithi060.stdout:4/706: getdents d4/dc/d2a/d39/d53/d76/da7/dca/dd6 0 2023-10-18T20:58:41.752 INFO:tasks.workunit.client.1.smithi060.stdout:5/787: dwrite d0/f8a [0,4194304] 0 2023-10-18T20:58:41.752 INFO:tasks.workunit.client.1.smithi060.stdout:7/836: rmdir de/d14/d49/d68/d7d 39 2023-10-18T20:58:41.753 INFO:tasks.workunit.client.1.smithi060.stdout:5/788: read - d0/d47/df2/d10e/f119 zero size 2023-10-18T20:58:41.753 INFO:tasks.workunit.client.1.smithi060.stdout:6/807: mknod d10/d17/d54/db1/cfd 0 2023-10-18T20:58:41.753 INFO:tasks.workunit.client.1.smithi060.stdout:6/808: chown d10/d47/f91 164446 1 2023-10-18T20:58:41.753 INFO:tasks.workunit.client.1.smithi060.stdout:6/809: fdatasync d10/d47/f91 0 2023-10-18T20:58:41.760 INFO:tasks.workunit.client.1.smithi060.stdout:9/705: mknod d3/d99/d1c/d25/c100 0 2023-10-18T20:58:41.772 INFO:tasks.workunit.client.1.smithi060.stdout:4/707: symlink d4/d15/d2b/lde 0 2023-10-18T20:58:41.772 INFO:tasks.workunit.client.1.smithi060.stdout:6/810: mkdir d10/d47/d92/dab/dfe 0 2023-10-18T20:58:41.772 INFO:tasks.workunit.client.1.smithi060.stdout:7/837: mknod de/d14/d49/d68/d106/c10b 0 2023-10-18T20:58:41.774 INFO:tasks.workunit.client.1.smithi060.stdout:9/706: symlink d3/d99/d1c/d2a/d33/l101 0 2023-10-18T20:58:41.776 INFO:tasks.workunit.client.0.smithi008.stdout:4/510: read d0/d3/d21/d42/f50 [3763963,94736] 0 2023-10-18T20:58:41.776 INFO:tasks.workunit.client.0.smithi008.stdout:7/636: creat d1/da6/d79/db5/fc8 x:0 0 0 2023-10-18T20:58:41.776 INFO:tasks.workunit.client.0.smithi008.stdout:2/599: link d1/d3/dd/d1c/l23 d1/d3/dd/d25/d76/d59/d85/db9/lc2 0 2023-10-18T20:58:41.777 INFO:tasks.workunit.client.1.smithi060.stdout:7/838: mkdir de/d14/d2f/d3f/d10c 0 2023-10-18T20:58:41.778 INFO:tasks.workunit.client.1.smithi060.stdout:3/709: dwrite d0/d22/d26/fa3 [0,4194304] 0 2023-10-18T20:58:41.778 INFO:tasks.workunit.client.1.smithi060.stdout:2/776: rename d0/d45/dc9/d68 to d0/d3/d27/d108 0 2023-10-18T20:58:41.779 INFO:tasks.workunit.client.1.smithi060.stdout:2/777: write d0/d16/dc8/fe2 [730,13989] 0 2023-10-18T20:58:41.779 INFO:tasks.workunit.client.0.smithi008.stdout:3/649: getdents d0/d3/d42/d52 0 2023-10-18T20:58:41.779 INFO:tasks.workunit.client.1.smithi060.stdout:9/707: unlink d3/d99/f69 0 2023-10-18T20:58:41.780 INFO:tasks.workunit.client.0.smithi008.stdout:7/637: mkdir d1/da6/d4f/dc9 0 2023-10-18T20:58:41.783 INFO:tasks.workunit.client.0.smithi008.stdout:2/600: creat d1/d3/dd/d25/d76/d59/d85/db9/fc3 x:0 0 0 2023-10-18T20:58:41.784 INFO:tasks.workunit.client.1.smithi060.stdout:7/839: link de/f19 de/d14/d41/f10d 0 2023-10-18T20:58:41.790 INFO:tasks.workunit.client.0.smithi008.stdout:7/638: mknod d1/da6/d4f/d87/cca 0 2023-10-18T20:58:41.792 INFO:tasks.workunit.client.1.smithi060.stdout:3/710: rename d0/d5e/f67 to d0/d22/d26/d29/dae/de4/ffa 0 2023-10-18T20:58:41.792 INFO:tasks.workunit.client.1.smithi060.stdout:3/711: truncate d0/d22/d50/f9b 686517 0 2023-10-18T20:58:41.793 INFO:tasks.workunit.client.1.smithi060.stdout:9/708: creat d3/d99/d1c/d2a/d80/da0/dc2/d9e/dfd/f102 x:0 0 0 2023-10-18T20:58:41.793 INFO:tasks.workunit.client.1.smithi060.stdout:9/709: fsync d3/d99/d1c/d2a/d80/fc5 0 2023-10-18T20:58:41.799 INFO:tasks.workunit.client.1.smithi060.stdout:7/840: mkdir de/d14/d2f/d3f/d10c/d10e 0 2023-10-18T20:58:41.802 INFO:tasks.workunit.client.0.smithi008.stdout:7/639: mkdir d1/da6/d79/db5/dcb 0 2023-10-18T20:58:41.803 INFO:tasks.workunit.client.0.smithi008.stdout:7/640: fsync d1/da6/d4f/d5c/f84 0 2023-10-18T20:58:41.803 INFO:tasks.workunit.client.0.smithi008.stdout:7/641: stat d1/d3/d20/d5f 0 2023-10-18T20:58:41.803 INFO:tasks.workunit.client.0.smithi008.stdout:7/642: chown d1/da6/l44 573048 1 2023-10-18T20:58:41.803 INFO:tasks.workunit.client.0.smithi008.stdout:7/643: dread - d1/d3/d20/f66 zero size 2023-10-18T20:58:41.803 INFO:tasks.workunit.client.0.smithi008.stdout:7/644: readlink d1/l67 0 2023-10-18T20:58:41.805 INFO:tasks.workunit.client.1.smithi060.stdout:2/778: link d0/d3/d27/d4d/d5e/d96/ff0 d0/d45/d49/d6e/d79/d6c/f109 0 2023-10-18T20:58:41.807 INFO:tasks.workunit.client.1.smithi060.stdout:9/710: creat d3/d99/d1c/d5a/d5d/f103 x:0 0 0 2023-10-18T20:58:41.808 INFO:tasks.workunit.client.1.smithi060.stdout:1/914: dwrite d4/d6/d7/d2f/d7b/d2a/d32/d56/f10a [0,4194304] 0 2023-10-18T20:58:41.810 INFO:tasks.workunit.client.0.smithi008.stdout:7/645: mkdir d1/d3/d20/d5f/dba/dcc 0 2023-10-18T20:58:41.811 INFO:tasks.workunit.client.0.smithi008.stdout:7/646: chown d1/d3/d20/d5f/dba 207131 1 2023-10-18T20:58:41.812 INFO:tasks.workunit.client.1.smithi060.stdout:6/811: write d10/d17/d70/f88 [1639289,119956] 0 2023-10-18T20:58:41.824 INFO:tasks.workunit.client.1.smithi060.stdout:7/841: creat de/d14/d3a/f10f x:0 0 0 2023-10-18T20:58:41.837 INFO:tasks.workunit.client.0.smithi008.stdout:1/668: dwrite d9/de/df/d17/d1e/d9a/fa4 [0,4194304] 0 2023-10-18T20:58:41.841 INFO:tasks.workunit.client.0.smithi008.stdout:0/533: read d0/dd/df/f4c [3000955,63335] 0 2023-10-18T20:58:41.841 INFO:tasks.workunit.client.0.smithi008.stdout:0/534: dread - d0/dd/d19/f8d zero size 2023-10-18T20:58:41.841 INFO:tasks.workunit.client.0.smithi008.stdout:0/535: creat d0/fa0 x:0 0 0 2023-10-18T20:58:41.842 INFO:tasks.workunit.client.0.smithi008.stdout:0/536: write d0/dd/d19/d5f/d99/d94/f95 [270063,59829] 0 2023-10-18T20:58:41.842 INFO:tasks.workunit.client.0.smithi008.stdout:0/537: creat d0/d3a/fa1 x:0 0 0 2023-10-18T20:58:41.843 INFO:tasks.workunit.client.1.smithi060.stdout:3/712: dread d0/f11 [0,4194304] 0 2023-10-18T20:58:41.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.841+0000 7fce2e8ec700 1 -- 172.21.15.8:0/2362547205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce200945d0 msgr2=0x7fce200949f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:41.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.841+0000 7fce2e8ec700 1 --2- 172.21.15.8:0/2362547205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce200945d0 0x7fce200949f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fce24004660 tx=0x7fce24009b30).stop 2023-10-18T20:58:41.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.841+0000 7fce2e8ec700 1 -- 172.21.15.8:0/2362547205 shutdown_connections 2023-10-18T20:58:41.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.841+0000 7fce2e8ec700 1 --2- 172.21.15.8:0/2362547205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce20095870 0x7fce20095cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:41.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.841+0000 7fce2e8ec700 1 --2- 172.21.15.8:0/2362547205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce200945d0 0x7fce200949f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:41.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.841+0000 7fce2e8ec700 1 -- 172.21.15.8:0/2362547205 >> 172.21.15.8:0/2362547205 conn(0x7fce2008fd30 msgr2=0x7fce20092150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:41.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.841+0000 7fce2e8ec700 1 -- 172.21.15.8:0/2362547205 shutdown_connections 2023-10-18T20:58:41.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.841+0000 7fce2e8ec700 1 -- 172.21.15.8:0/2362547205 wait complete. 2023-10-18T20:58:41.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.843+0000 7fce2e8ec700 1 Processor -- start 2023-10-18T20:58:41.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.843+0000 7fce2e8ec700 1 -- start start 2023-10-18T20:58:41.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.844+0000 7fce2e8ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce20095870 0x7fce200a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:41.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.844+0000 7fce2e8ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce200a5450 0x7fce200aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:41.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.844+0000 7fce2e8ec700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200a5920 con 0x7fce200a5450 2023-10-18T20:58:41.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.844+0000 7fce2e8ec700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200a5a60 con 0x7fce20095870 2023-10-18T20:58:41.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.844+0000 7fce2d0e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce200a5450 0x7fce200aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:41.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.844+0000 7fce2d0e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce200a5450 0x7fce200aa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51054/0 (socket says 172.21.15.8:51054) 2023-10-18T20:58:41.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.844+0000 7fce2d0e9700 1 -- 172.21.15.8:0/570294736 learned_addr learned my addr 172.21.15.8:0/570294736 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:41.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.845+0000 7fce2d0e9700 1 -- 172.21.15.8:0/570294736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce20095870 msgr2=0x7fce200a4f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:58:41.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.845+0000 7fce2d0e9700 1 --2- 172.21.15.8:0/570294736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce20095870 0x7fce200a4f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:58:41.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.845+0000 7fce2d0e9700 1 -- 172.21.15.8:0/570294736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce24005040 con 0x7fce200a5450 2023-10-18T20:58:41.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.845+0000 7fce2d0e9700 1 --2- 172.21.15.8:0/570294736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce200a5450 0x7fce200aa520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fce18004f70 tx=0x7fce18009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:41.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.846+0000 7fce1e7fc700 1 -- 172.21.15.8:0/570294736 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce18018070 con 0x7fce200a5450 2023-10-18T20:58:41.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.846+0000 7fce1e7fc700 1 -- 172.21.15.8:0/570294736 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fce18002d10 con 0x7fce200a5450 2023-10-18T20:58:41.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.846+0000 7fce1e7fc700 1 -- 172.21.15.8:0/570294736 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce18007a10 con 0x7fce200a5450 2023-10-18T20:58:41.852 INFO:tasks.workunit.client.1.smithi060.stdout:3/713: mkdir d0/d22/d26/dfb 0 2023-10-18T20:58:41.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.846+0000 7fce2e8ec700 1 -- 172.21.15.8:0/570294736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce20006a70 con 0x7fce200a5450 2023-10-18T20:58:41.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.846+0000 7fce2e8ec700 1 -- 172.21.15.8:0/570294736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce20006f80 con 0x7fce200a5450 2023-10-18T20:58:41.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.850+0000 7fce2e8ec700 1 -- 172.21.15.8:0/570294736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce20005180 con 0x7fce200a5450 2023-10-18T20:58:41.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.852+0000 7fce1e7fc700 1 -- 172.21.15.8:0/570294736 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 77192+0+0 (secure 0 0 0) 0x7fce18007c80 con 0x7fce200a5450 2023-10-18T20:58:41.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.854+0000 7fce1e7fc700 1 --2- 172.21.15.8:0/570294736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce14060fb0 0x7fce14063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:41.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.854+0000 7fce1e7fc700 1 -- 172.21.15.8:0/570294736 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fce180242f0 con 0x7fce200a5450 2023-10-18T20:58:41.857 INFO:tasks.workunit.client.1.smithi060.stdout:3/714: chown d0/f1c 82840 1 2023-10-18T20:58:41.857 INFO:tasks.workunit.client.1.smithi060.stdout:3/715: write d0/d22/d26/d29/fdc [436133,13717] 0 2023-10-18T20:58:41.858 INFO:tasks.workunit.client.0.smithi008.stdout:7/647: dread d1/d36/d3d/f5a [0,4194304] 0 2023-10-18T20:58:41.858 INFO:tasks.workunit.client.0.smithi008.stdout:7/648: chown d1/da6/d4f/d87 6 1 2023-10-18T20:58:41.859 INFO:tasks.workunit.client.0.smithi008.stdout:7/649: stat d1/d36/d3d/d3e/d59/d73/d7b/daf/cb4 0 2023-10-18T20:58:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.856+0000 7fce2d8ea700 1 --2- 172.21.15.8:0/570294736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce14060fb0 0x7fce14063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.857+0000 7fce2d8ea700 1 --2- 172.21.15.8:0/570294736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce14060fb0 0x7fce14063470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fce24000c00 tx=0x7fce24009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:41.861 INFO:tasks.workunit.client.1.smithi060.stdout:1/915: write d4/d6/d7/df/d59/f6f [503360,119790] 0 2023-10-18T20:58:41.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:41.861+0000 7fce1e7fc700 1 -- 172.21.15.8:0/570294736 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7fce18055c80 con 0x7fce200a5450 2023-10-18T20:58:41.869 INFO:tasks.workunit.client.1.smithi060.stdout:8/727: dwrite d4/d9/d88/fd1 [0,4194304] 0 2023-10-18T20:58:41.874 INFO:tasks.workunit.client.0.smithi008.stdout:7/650: rename d1/d36/d3d/d3e/d59/f8a to d1/da6/d4f/dc9/fcd 0 2023-10-18T20:58:41.877 INFO:tasks.workunit.client.1.smithi060.stdout:1/916: symlink d4/d6/d7/df/l12e 0 2023-10-18T20:58:41.883 INFO:tasks.workunit.client.1.smithi060.stdout:8/728: mkdir d4/d9/d37/d4e/dd9 0 2023-10-18T20:58:41.888 INFO:tasks.workunit.client.0.smithi008.stdout:2/601: truncate d1/d3/dd/d25/d76/f3f 5429796 0 2023-10-18T20:58:41.890 INFO:tasks.workunit.client.1.smithi060.stdout:8/729: rmdir d4/d9/d4f/d74 39 2023-10-18T20:58:41.891 INFO:tasks.workunit.client.0.smithi008.stdout:2/602: creat d1/d3/dd/d25/d76/d59/fc4 x:0 0 0 2023-10-18T20:58:41.905 INFO:tasks.workunit.client.0.smithi008.stdout:1/669: dread d9/f42 [0,4194304] 0 2023-10-18T20:58:41.906 INFO:tasks.workunit.client.0.smithi008.stdout:2/603: unlink d1/d3/dd/d25/d4d/fa2 0 2023-10-18T20:58:41.906 INFO:tasks.workunit.client.0.smithi008.stdout:8/732: dwrite d5/d8/df/d9d/fc7 [0,4194304] 0 2023-10-18T20:58:41.917 INFO:tasks.workunit.client.0.smithi008.stdout:6/635: dwrite df/d15/d27/fb5 [0,4194304] 0 2023-10-18T20:58:41.917 INFO:tasks.workunit.client.0.smithi008.stdout:4/511: dwrite d0/d17/d5b/d2a/f5d [0,4194304] 0 2023-10-18T20:58:41.918 INFO:tasks.workunit.client.1.smithi060.stdout:4/708: dwrite d4/dc/d2a/d13/d27/f9c [0,4194304] 0 2023-10-18T20:58:41.918 INFO:tasks.workunit.client.1.smithi060.stdout:1/917: dread d4/d6/d7/d2f/d6d/f9d [0,4194304] 0 2023-10-18T20:58:41.918 INFO:tasks.workunit.client.1.smithi060.stdout:5/789: dwrite d0/dd/d76/d10f/da5/f9e [12582912,4194304] 0 2023-10-18T20:58:41.919 INFO:tasks.workunit.client.1.smithi060.stdout:5/790: chown d0/da/cd8 49624 1 2023-10-18T20:58:41.919 INFO:tasks.workunit.client.1.smithi060.stdout:5/791: write d0/dd/d76/d10f/ffe [227950,119053] 0 2023-10-18T20:58:41.920 INFO:tasks.workunit.client.0.smithi008.stdout:2/604: mknod d1/d3/d40/d6e/d7e/db3/cc5 0 2023-10-18T20:58:41.921 INFO:tasks.workunit.client.1.smithi060.stdout:0/751: dwrite d3/d32/f38 [0,4194304] 0 2023-10-18T20:58:41.922 INFO:tasks.workunit.client.1.smithi060.stdout:0/752: write d3/d8/d3c/ff0 [769011,76999] 0 2023-10-18T20:58:41.922 INFO:tasks.workunit.client.1.smithi060.stdout:0/753: write d3/d8/d14/d55/d74/d76/d68/fdd [534448,123838] 0 2023-10-18T20:58:41.924 INFO:tasks.workunit.client.0.smithi008.stdout:8/733: truncate d5/d8/df/d9d/d4d/f67 810587 0 2023-10-18T20:58:41.924 INFO:tasks.workunit.client.0.smithi008.stdout:8/734: chown d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/dc0 200105274 1 2023-10-18T20:58:41.930 INFO:tasks.workunit.client.0.smithi008.stdout:6/636: link df/l11 df/d15/d48/dbe/ld5 0 2023-10-18T20:58:41.930 INFO:tasks.workunit.client.0.smithi008.stdout:0/538: dwrite d0/d7c/f7a [0,4194304] 0 2023-10-18T20:58:41.931 INFO:tasks.workunit.client.0.smithi008.stdout:0/539: rename d0/d7c/d9a to d0/d7c/d9a/da2 22 2023-10-18T20:58:41.931 INFO:tasks.workunit.client.0.smithi008.stdout:0/540: write d0/d7c/f59 [4718982,7064] 0 2023-10-18T20:58:41.931 INFO:tasks.workunit.client.0.smithi008.stdout:2/605: symlink d1/d3/dd/d25/d5c/lc6 0 2023-10-18T20:58:41.935 INFO:tasks.workunit.client.1.smithi060.stdout:8/730: write d4/d9/d31/f5a [736606,85115] 0 2023-10-18T20:58:41.936 INFO:tasks.workunit.client.1.smithi060.stdout:0/754: rename d3/d8/d14/d55/dad/daa to d3/de5/df1 0 2023-10-18T20:58:41.936 INFO:tasks.workunit.client.0.smithi008.stdout:8/735: symlink d5/d8/df/df0/l106 0 2023-10-18T20:58:41.937 INFO:tasks.workunit.client.0.smithi008.stdout:3/650: dwrite d0/d3/d42/f99 [0,4194304] 0 2023-10-18T20:58:41.937 INFO:tasks.workunit.client.0.smithi008.stdout:3/651: write d0/d3/d42/d52/f98 [4447990,28139] 0 2023-10-18T20:58:41.938 INFO:tasks.workunit.client.0.smithi008.stdout:3/652: write d0/d3/d37/d74/fa4 [1646638,7267] 0 2023-10-18T20:58:41.938 INFO:tasks.workunit.client.0.smithi008.stdout:3/653: chown d0/d3/de/d13/lb4 20 1 2023-10-18T20:58:41.940 INFO:tasks.workunit.client.0.smithi008.stdout:4/512: dread d0/d3/f77 [0,4194304] 0 2023-10-18T20:58:41.945 INFO:tasks.workunit.client.1.smithi060.stdout:1/918: read d4/d6/d7/df/f40 [211021,105410] 0 2023-10-18T20:58:41.945 INFO:tasks.workunit.client.1.smithi060.stdout:1/919: fdatasync d4/d6/d48/fff 0 2023-10-18T20:58:41.947 INFO:tasks.workunit.client.1.smithi060.stdout:9/711: dwrite d3/d99/d1c/d5a/fe7 [0,4194304] 0 2023-10-18T20:58:41.947 INFO:tasks.workunit.client.1.smithi060.stdout:5/792: write d0/da/dc8/de4/fd6 [3231407,83767] 0 2023-10-18T20:58:41.947 INFO:tasks.workunit.client.1.smithi060.stdout:5/793: chown d0/d6/d8/df/d27/f3c 841791806 1 2023-10-18T20:58:41.953 INFO:tasks.workunit.client.0.smithi008.stdout:3/654: write d0/d3/d37/d74/f89 [421446,67735] 0 2023-10-18T20:58:41.955 INFO:tasks.workunit.client.1.smithi060.stdout:0/755: rmdir d3/d8/d14/d55/d9a 39 2023-10-18T20:58:41.960 INFO:tasks.workunit.client.1.smithi060.stdout:9/712: rmdir d3/d99/d65/dfb 0 2023-10-18T20:58:41.963 INFO:tasks.workunit.client.1.smithi060.stdout:5/794: unlink d0/da/d3b/d64/fa9 0 2023-10-18T20:58:41.964 INFO:tasks.workunit.client.1.smithi060.stdout:3/716: dwrite d0/d22/d26/d29/ff2 [0,4194304] 0 2023-10-18T20:58:41.964 INFO:tasks.workunit.client.1.smithi060.stdout:3/717: truncate d0/d3c/d3d/d4d/d95/dc9/fd0 185953 0 2023-10-18T20:58:41.966 INFO:tasks.workunit.client.1.smithi060.stdout:9/713: getdents d3/d99/d19 0 2023-10-18T20:58:41.969 INFO:tasks.workunit.client.0.smithi008.stdout:2/606: mkdir d1/d3/dd/d1c/dc7 0 2023-10-18T20:58:41.971 INFO:tasks.workunit.client.0.smithi008.stdout:6/637: dread df/d26/f31 [4194304,4194304] 0 2023-10-18T20:58:41.974 INFO:tasks.workunit.client.1.smithi060.stdout:2/779: dwrite d0/d3/d27/d4d/d53/f77 [4194304,4194304] 0 2023-10-18T20:58:41.974 INFO:tasks.workunit.client.1.smithi060.stdout:7/842: dwrite de/d14/d2f/dd3/ffe [0,4194304] 0 2023-10-18T20:58:41.974 INFO:tasks.workunit.client.1.smithi060.stdout:7/843: creat de/d14/d49/d68/d7d/d7e/f110 x:0 0 0 2023-10-18T20:58:41.974 INFO:tasks.workunit.client.1.smithi060.stdout:5/795: link d0/da/d3b/fea d0/dd/d76/d10f/f121 0 2023-10-18T20:58:41.975 INFO:tasks.workunit.client.1.smithi060.stdout:5/796: fsync d0/da/f9c 0 2023-10-18T20:58:41.975 INFO:tasks.workunit.client.1.smithi060.stdout:5/797: chown d0/d6/d8/df 90 1 2023-10-18T20:58:41.976 INFO:tasks.workunit.client.0.smithi008.stdout:8/736: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/dc0/f107 x:0 0 0 2023-10-18T20:58:41.977 INFO:tasks.workunit.client.1.smithi060.stdout:9/714: unlink d3/d99/d1c/d2a/d80/fa8 0 2023-10-18T20:58:41.983 INFO:tasks.workunit.client.0.smithi008.stdout:1/670: dwrite d9/de/df/d17/d1e/f62 [0,4194304] 0 2023-10-18T20:58:41.985 INFO:tasks.workunit.client.1.smithi060.stdout:0/756: rmdir d3/de5/df1 39 2023-10-18T20:58:41.989 INFO:tasks.workunit.client.0.smithi008.stdout:3/655: link d0/d3/d42/lb8 d0/d3/d37/d6f/ld5 0 2023-10-18T20:58:41.989 INFO:tasks.workunit.client.0.smithi008.stdout:6/638: mkdir df/d3c/d77/dd6 0 2023-10-18T20:58:41.989 INFO:tasks.workunit.client.0.smithi008.stdout:2/607: getdents d1/d3/d40/d6e/d7e 0 2023-10-18T20:58:41.989 INFO:tasks.workunit.client.0.smithi008.stdout:2/608: readlink d1/d3/dd/d1c/l7c 0 2023-10-18T20:58:41.991 INFO:tasks.workunit.client.0.smithi008.stdout:8/737: symlink d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/dc0/l108 0 2023-10-18T20:58:41.993 INFO:tasks.workunit.client.0.smithi008.stdout:6/639: mkdir df/d3c/da2/dcf/d58/dd7 0 2023-10-18T20:58:41.994 INFO:tasks.workunit.client.1.smithi060.stdout:5/798: dread d0/da/d3b/d43/f63 [0,4194304] 0 2023-10-18T20:58:41.996 INFO:tasks.workunit.client.0.smithi008.stdout:8/738: rename d5/d8/df/d9d/d4d/dba/dd4/fa2 to d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/dc4/f109 0 2023-10-18T20:58:41.999 INFO:tasks.workunit.client.0.smithi008.stdout:6/640: mkdir df/d3c/d77/dd6/dd8 0 2023-10-18T20:58:41.999 INFO:tasks.workunit.client.0.smithi008.stdout:2/609: mknod d1/d3/dd/cc8 0 2023-10-18T20:58:42.000 INFO:tasks.workunit.client.1.smithi060.stdout:3/718: dread d0/f4e [0,4194304] 0 2023-10-18T20:58:42.002 INFO:tasks.workunit.client.1.smithi060.stdout:4/709: dwrite d4/dc/d2a/d39/d53/d76/da7/fab [0,4194304] 0 2023-10-18T20:58:42.002 INFO:tasks.workunit.client.1.smithi060.stdout:4/710: readlink d4/dc/d2a/d39/d53/d76/lb3 0 2023-10-18T20:58:42.006 INFO:tasks.workunit.client.1.smithi060.stdout:2/780: symlink d0/d3/d27/d4d/d53/de5/l10a 0 2023-10-18T20:58:42.007 INFO:tasks.workunit.client.1.smithi060.stdout:2/781: write d0/d45/d49/d55/dbf/fec [285161,56460] 0 2023-10-18T20:58:42.008 INFO:tasks.workunit.client.0.smithi008.stdout:4/513: write d0/d3/f64 [273677,109650] 0 2023-10-18T20:58:42.010 INFO:tasks.workunit.client.0.smithi008.stdout:4/514: creat d0/d74/fa9 x:0 0 0 2023-10-18T20:58:42.012 INFO:tasks.workunit.client.0.smithi008.stdout:4/515: rename d0/d17/d6e/f7e to d0/d17/d5b/faa 0 2023-10-18T20:58:42.012 INFO:tasks.workunit.client.0.smithi008.stdout:4/516: truncate d0/d3/d21/f3e 4266135 0 2023-10-18T20:58:42.014 INFO:tasks.workunit.client.1.smithi060.stdout:7/844: mknod de/d14/d49/d68/d88/c111 0 2023-10-18T20:58:42.015 INFO:tasks.workunit.client.1.smithi060.stdout:7/845: chown ld 21 1 2023-10-18T20:58:42.015 INFO:tasks.workunit.client.1.smithi060.stdout:9/715: link d3/l4f d3/d99/d1c/d5a/l104 0 2023-10-18T20:58:42.015 INFO:tasks.workunit.client.0.smithi008.stdout:4/517: creat d0/d17/fab x:0 0 0 2023-10-18T20:58:42.016 INFO:tasks.workunit.client.0.smithi008.stdout:4/518: unlink d0/d17/d5b/f65 0 2023-10-18T20:58:42.018 INFO:tasks.workunit.client.1.smithi060.stdout:8/731: dwrite d4/d9/d37/d4e/d6e/f95 [0,4194304] 0 2023-10-18T20:58:42.020 INFO:tasks.workunit.client.0.smithi008.stdout:2/610: dread d1/d3/dd/d25/f47 [0,4194304] 0 2023-10-18T20:58:42.020 INFO:tasks.workunit.client.0.smithi008.stdout:2/611: creat d1/d3/dd/d25/d76/d59/fc9 x:0 0 0 2023-10-18T20:58:42.021 INFO:tasks.workunit.client.0.smithi008.stdout:2/612: truncate d1/d3/dd/d25/d76/d59/f97 597903 0 2023-10-18T20:58:42.021 INFO:tasks.workunit.client.0.smithi008.stdout:9/521: sync 2023-10-18T20:58:42.021 INFO:tasks.workunit.client.0.smithi008.stdout:5/575: sync 2023-10-18T20:58:42.021 INFO:tasks.workunit.client.1.smithi060.stdout:5/799: symlink d0/dd/d76/d105/l122 0 2023-10-18T20:58:42.026 INFO:tasks.workunit.client.1.smithi060.stdout:7/846: rename de/d14/d2f/d3f/l5d to de/l112 0 2023-10-18T20:58:42.026 INFO:tasks.workunit.client.1.smithi060.stdout:7/847: dread - de/d14/d49/d68/d88/fdf zero size 2023-10-18T20:58:42.033 INFO:tasks.workunit.client.0.smithi008.stdout:1/671: dread d9/de/df/d17/d1e/d3c/fa3 [0,4194304] 0 2023-10-18T20:58:42.034 INFO:tasks.workunit.client.0.smithi008.stdout:4/519: unlink d0/d17/d6e/f87 0 2023-10-18T20:58:42.038 INFO:tasks.workunit.client.0.smithi008.stdout:4/520: symlink d0/lac 0 2023-10-18T20:58:42.039 INFO:tasks.workunit.client.1.smithi060.stdout:3/719: read d0/d3c/d3d/d82/fe1 [717187,98649] 0 2023-10-18T20:58:42.039 INFO:tasks.workunit.client.1.smithi060.stdout:3/720: chown d0/d22/d26/d8c/fbb 1925 1 2023-10-18T20:58:42.042 INFO:tasks.workunit.client.0.smithi008.stdout:1/672: symlink d9/de/df/d17/d1e/d3c/lc8 0 2023-10-18T20:58:42.042 INFO:tasks.workunit.client.0.smithi008.stdout:2/613: dread d1/d3/dd/d1c/d3a/d49/fa7 [4194304,4194304] 0 2023-10-18T20:58:42.045 INFO:tasks.workunit.client.0.smithi008.stdout:4/521: truncate d0/d58/d8e/f6d 2881107 0 2023-10-18T20:58:42.046 INFO:tasks.workunit.client.0.smithi008.stdout:4/522: rmdir d0/d17/d5b/d45 39 2023-10-18T20:58:42.050 INFO:tasks.workunit.client.1.smithi060.stdout:8/732: rename d4/d9/d31/l6a to d4/d9/d31/lda 0 2023-10-18T20:58:42.055 INFO:tasks.workunit.client.1.smithi060.stdout:5/800: creat d0/da/f123 x:0 0 0 2023-10-18T20:58:42.055 INFO:tasks.workunit.client.1.smithi060.stdout:3/721: dread d0/fc [0,4194304] 0 2023-10-18T20:58:42.055 INFO:tasks.workunit.client.1.smithi060.stdout:3/722: stat d0/f72 0 2023-10-18T20:58:42.057 INFO:tasks.workunit.client.1.smithi060.stdout:7/848: rename de/d14/d49/d68/l83 to de/d14/d49/d68/d88/l113 0 2023-10-18T20:58:42.057 INFO:tasks.workunit.client.1.smithi060.stdout:7/849: chown de/d14/d2f/dd3 0 1 2023-10-18T20:58:42.059 INFO:tasks.workunit.client.1.smithi060.stdout:8/733: mkdir d4/d9/d31/d35/d9f/da3/ddb 0 2023-10-18T20:58:42.060 INFO:tasks.workunit.client.1.smithi060.stdout:7/850: mkdir de/d14/d2f/d3f/d5a/d5f/d114 0 2023-10-18T20:58:42.061 INFO:tasks.workunit.client.1.smithi060.stdout:8/734: mknod d4/d9/d37/d4e/dd9/cdc 0 2023-10-18T20:58:42.062 INFO:tasks.workunit.client.0.smithi008.stdout:5/576: dread d0/d2/f23 [4194304,4194304] 0 2023-10-18T20:58:42.062 INFO:tasks.workunit.client.1.smithi060.stdout:7/851: symlink de/d14/d49/d68/d7d/d7e/l115 0 2023-10-18T20:58:42.063 INFO:tasks.workunit.client.0.smithi008.stdout:5/577: creat d0/d2/d9/d9b/dba/fd2 x:0 0 0 2023-10-18T20:58:42.063 INFO:tasks.workunit.client.0.smithi008.stdout:5/578: dread - d0/d2/d19/d7c/f92 zero size 2023-10-18T20:58:42.064 INFO:tasks.workunit.client.1.smithi060.stdout:8/735: creat d4/d9/d4f/d74/d81/fdd x:0 0 0 2023-10-18T20:58:42.064 INFO:tasks.workunit.client.1.smithi060.stdout:8/736: fsync d4/d9/d31/f8e 0 2023-10-18T20:58:42.066 INFO:tasks.workunit.client.1.smithi060.stdout:8/737: symlink d4/d9/d88/d90/lde 0 2023-10-18T20:58:42.067 INFO:tasks.workunit.client.0.smithi008.stdout:0/541: dwrite d0/f1d [0,4194304] 0 2023-10-18T20:58:42.067 INFO:tasks.workunit.client.0.smithi008.stdout:2/614: dread d1/d3/dd/f6b [0,4194304] 0 2023-10-18T20:58:42.067 INFO:tasks.workunit.client.0.smithi008.stdout:2/615: fsync d1/d3/dd/f1e 0 2023-10-18T20:58:42.068 INFO:tasks.workunit.client.1.smithi060.stdout:8/738: chown d4/d9/d31/d35/d9f/fb9 268280 1 2023-10-18T20:58:42.070 INFO:tasks.workunit.client.0.smithi008.stdout:5/579: mknod d0/d2/d19/d7c/d64/cd3 0 2023-10-18T20:58:42.070 INFO:tasks.workunit.client.1.smithi060.stdout:4/711: dread d4/dc/f29 [0,4194304] 0 2023-10-18T20:58:42.075 INFO:tasks.workunit.client.1.smithi060.stdout:4/712: mkdir d4/dc/d2a/d13/dbd/ddf 0 2023-10-18T20:58:42.079 INFO:tasks.workunit.client.1.smithi060.stdout:4/713: symlink d4/dc/d2a/d39/d53/d76/da7/le0 0 2023-10-18T20:58:42.081 INFO:tasks.workunit.client.1.smithi060.stdout:2/782: dread d0/d8/f2b [8388608,4194304] 0 2023-10-18T20:58:42.082 INFO:tasks.workunit.client.0.smithi008.stdout:1/673: write d9/de/df/f56 [27768,26990] 0 2023-10-18T20:58:42.085 INFO:tasks.workunit.client.0.smithi008.stdout:9/522: rename d2/dc/d40/d6f/d92/f8a to d2/dc/d40/d6f/d92/d59/f94 0 2023-10-18T20:58:42.086 INFO:tasks.workunit.client.0.smithi008.stdout:9/523: chown d2/dc/d40/d6f/d92 26104 1 2023-10-18T20:58:42.086 INFO:tasks.workunit.client.0.smithi008.stdout:9/524: dread - d2/dc/d17/d19/d4a/f81 zero size 2023-10-18T20:58:42.086 INFO:tasks.workunit.client.0.smithi008.stdout:9/525: chown d2/d64/d90 2616 1 2023-10-18T20:58:42.086 INFO:tasks.workunit.client.0.smithi008.stdout:1/674: symlink d9/de/df/d17/d25/d57/da6/lc9 0 2023-10-18T20:58:42.087 INFO:tasks.workunit.client.0.smithi008.stdout:9/526: creat d2/dc/d40/d5a/f95 x:0 0 0 2023-10-18T20:58:42.090 INFO:tasks.workunit.client.0.smithi008.stdout:0/542: rename d0/dd/c55 to d0/d7c/d9a/ca3 0 2023-10-18T20:58:42.094 INFO:tasks.workunit.client.0.smithi008.stdout:9/527: creat d2/dc/f96 x:0 0 0 2023-10-18T20:58:42.095 INFO:tasks.workunit.client.0.smithi008.stdout:1/675: creat d9/de/df/d17/d1e/d7d/fca x:0 0 0 2023-10-18T20:58:42.095 INFO:tasks.workunit.client.0.smithi008.stdout:1/676: fdatasync d9/de/df/d17/d25/d57/f87 0 2023-10-18T20:58:42.097 INFO:tasks.workunit.client.0.smithi008.stdout:6/641: dwrite df/d13/d53/fd4 [0,4194304] 0 2023-10-18T20:58:42.103 INFO:tasks.workunit.client.0.smithi008.stdout:5/580: rename d0/d2/d19/d7c/d58/d65/f36 to d0/d2/d19/d7c/d31/d3f/d9a/fd4 0 2023-10-18T20:58:42.103 INFO:tasks.workunit.client.0.smithi008.stdout:5/581: dread - d0/d2/d19/d7c/f92 zero size 2023-10-18T20:58:42.104 INFO:tasks.workunit.client.0.smithi008.stdout:9/528: creat d2/dc/d1a/f97 x:0 0 0 2023-10-18T20:58:42.105 INFO:tasks.workunit.client.0.smithi008.stdout:9/529: chown d2/dc/d40/d46/f51 685 1 2023-10-18T20:58:42.105 INFO:tasks.workunit.client.0.smithi008.stdout:9/530: chown d2/dc/d17/d19/l85 29054 1 2023-10-18T20:58:42.105 INFO:tasks.workunit.client.0.smithi008.stdout:9/531: creat d2/dc/d3d/f98 x:0 0 0 2023-10-18T20:58:42.108 INFO:tasks.workunit.client.1.smithi060.stdout:0/757: dwrite d3/f60 [0,4194304] 0 2023-10-18T20:58:42.110 INFO:tasks.workunit.client.0.smithi008.stdout:1/677: creat d9/de/df/d17/d25/d94/da7/fcb x:0 0 0 2023-10-18T20:58:42.125 INFO:tasks.workunit.client.0.smithi008.stdout:9/532: truncate d2/dc/f1c 4284677 0 2023-10-18T20:58:42.126 INFO:tasks.workunit.client.0.smithi008.stdout:1/678: truncate d9/de/df/d17/d1e/f71 2707757 0 2023-10-18T20:58:42.127 INFO:tasks.workunit.client.0.smithi008.stdout:5/582: dread d0/d2/d19/d7c/d31/f4a [0,4194304] 0 2023-10-18T20:58:42.128 INFO:tasks.workunit.client.0.smithi008.stdout:1/679: creat d9/fcc x:0 0 0 2023-10-18T20:58:42.129 INFO:tasks.workunit.client.1.smithi060.stdout:2/783: dread d0/d16/d85/de3/ff7 [0,4194304] 0 2023-10-18T20:58:42.133 INFO:tasks.workunit.client.1.smithi060.stdout:2/784: creat d0/d16/d85/de3/f10b x:0 0 0 2023-10-18T20:58:42.133 INFO:tasks.workunit.client.0.smithi008.stdout:5/583: creat d0/d2/d19/d7c/d58/d65/fd5 x:0 0 0 2023-10-18T20:58:42.133 INFO:tasks.workunit.client.0.smithi008.stdout:5/584: chown d0/d2/d19/d7c/d31/d80/d91/cc4 2929 1 2023-10-18T20:58:42.133 INFO:tasks.workunit.client.0.smithi008.stdout:5/585: stat d0/d2/d9/cd 0 2023-10-18T20:58:42.139 INFO:tasks.workunit.client.1.smithi060.stdout:2/785: rename d0/d45/dc9/d4a/l72 to d0/d45/dc9/d4a/l10c 0 2023-10-18T20:58:42.139 INFO:tasks.workunit.client.1.smithi060.stdout:5/801: dwrite d0/da/dc8/de4/d6d/f71 [0,4194304] 0 2023-10-18T20:58:42.145 INFO:tasks.workunit.client.1.smithi060.stdout:7/852: dwrite de/d29/d72/d84/fae [0,4194304] 0 2023-10-18T20:58:42.152 INFO:tasks.workunit.client.1.smithi060.stdout:7/853: rename de/d14/dd2 to de/d14/d3a/d46/dab/d116 0 2023-10-18T20:58:42.152 INFO:tasks.workunit.client.1.smithi060.stdout:7/854: write de/d29/d9c/ff7 [161363,29739] 0 2023-10-18T20:58:42.153 INFO:tasks.workunit.client.0.smithi008.stdout:4/523: dwrite d0/d17/d5b/fa [0,4194304] 0 2023-10-18T20:58:42.154 INFO:tasks.workunit.client.0.smithi008.stdout:4/524: chown d0/f27 5407 1 2023-10-18T20:58:42.156 INFO:tasks.workunit.client.1.smithi060.stdout:3/723: dwrite d0/d22/f33 [4194304,4194304] 0 2023-10-18T20:58:42.159 INFO:tasks.workunit.client.1.smithi060.stdout:0/758: dread d3/d8/d14/d55/d74/d76/f63 [0,4194304] 0 2023-10-18T20:58:42.159 INFO:tasks.workunit.client.1.smithi060.stdout:2/786: unlink d0/d45/dc9/d4a/l10c 0 2023-10-18T20:58:42.162 INFO:tasks.workunit.client.1.smithi060.stdout:7/855: creat de/d14/d41/dc6/f117 x:0 0 0 2023-10-18T20:58:42.163 INFO:tasks.workunit.client.1.smithi060.stdout:7/856: write de/d14/d49/d68/d7d/d7e/db5/fc7 [5080547,61573] 0 2023-10-18T20:58:42.166 INFO:tasks.workunit.client.1.smithi060.stdout:3/724: unlink d0/d22/d26/d2c/da0/cd2 0 2023-10-18T20:58:42.166 INFO:tasks.workunit.client.1.smithi060.stdout:3/725: creat d0/d3c/d3d/d4d/d95/ffc x:0 0 0 2023-10-18T20:58:42.166 INFO:tasks.workunit.client.1.smithi060.stdout:3/726: chown d0/d22/d26/fa3 260434214 1 2023-10-18T20:58:42.167 INFO:tasks.workunit.client.1.smithi060.stdout:3/727: truncate d0/d22/d26/d2c/fe3 654612 0 2023-10-18T20:58:42.167 INFO:tasks.workunit.client.0.smithi008.stdout:4/525: mknod d0/d17/d5b/cad 0 2023-10-18T20:58:42.168 INFO:tasks.workunit.client.0.smithi008.stdout:4/526: fdatasync d0/d17/d5b/fb 0 2023-10-18T20:58:42.169 INFO:tasks.workunit.client.0.smithi008.stdout:4/527: mknod d0/d3/d21/d57/cae 0 2023-10-18T20:58:42.170 INFO:tasks.workunit.client.0.smithi008.stdout:0/543: dwrite d0/dd/d19/f8d [0,4194304] 0 2023-10-18T20:58:42.170 INFO:tasks.workunit.client.0.smithi008.stdout:0/544: fdatasync d0/d7c/f7a 0 2023-10-18T20:58:42.171 INFO:tasks.workunit.client.1.smithi060.stdout:0/759: creat d3/d8/d3c/d87/dba/ff2 x:0 0 0 2023-10-18T20:58:42.171 INFO:tasks.workunit.client.1.smithi060.stdout:0/760: fsync d3/d8/d14/d55/d74/fe4 0 2023-10-18T20:58:42.181 INFO:tasks.workunit.client.0.smithi008.stdout:1/680: getdents d9/de/df/d17/d25/d57/da6 0 2023-10-18T20:58:42.181 INFO:tasks.workunit.client.1.smithi060.stdout:7/857: link de/d29/d9c/f102 de/d29/d72/d84/f118 0 2023-10-18T20:58:42.182 INFO:tasks.workunit.client.0.smithi008.stdout:7/651: sync 2023-10-18T20:58:42.183 INFO:tasks.workunit.client.1.smithi060.stdout:4/714: read d4/dc/d2a/d13/d27/f9c [1394613,89118] 0 2023-10-18T20:58:42.183 INFO:tasks.workunit.client.0.smithi008.stdout:9/533: getdents d2/dc 0 2023-10-18T20:58:42.184 INFO:tasks.workunit.client.1.smithi060.stdout:8/739: dwrite d4/d9/d31/d35/f9d [0,4194304] 0 2023-10-18T20:58:42.184 INFO:tasks.workunit.client.1.smithi060.stdout:8/740: write d4/d9/d4f/f63 [3544190,58447] 0 2023-10-18T20:58:42.187 INFO:tasks.workunit.client.0.smithi008.stdout:0/545: link d0/dd/d19/d5f/d99/f38 d0/dd/d19/d5f/d99/d5e/fa4 0 2023-10-18T20:58:42.189 INFO:tasks.workunit.client.1.smithi060.stdout:9/716: dwrite d3/d99/d1c/d5a/f97 [0,4194304] 0 2023-10-18T20:58:42.189 INFO:tasks.workunit.client.1.smithi060.stdout:9/717: fdatasync d3/d99/d1c/d2a/d80/da0/dc2/d9e/fce 0 2023-10-18T20:58:42.190 INFO:tasks.workunit.client.1.smithi060.stdout:9/718: creat d3/d99/d1c/d2a/d80/da0/dc2/de0/f105 x:0 0 0 2023-10-18T20:58:42.191 INFO:tasks.workunit.client.1.smithi060.stdout:8/741: mkdir d4/d9/d37/d4e/dd9/ddf 0 2023-10-18T20:58:42.192 INFO:tasks.workunit.client.0.smithi008.stdout:1/681: truncate d9/de/df/d17/d55/f78 1672308 0 2023-10-18T20:58:42.192 INFO:tasks.workunit.client.0.smithi008.stdout:1/682: chown d9/de/df/d17/d1e/fad 758 1 2023-10-18T20:58:42.193 INFO:tasks.workunit.client.0.smithi008.stdout:7/652: link d1/d3/d20/d54/c64 d1/d3/d20/d54/cce 0 2023-10-18T20:58:42.193 INFO:tasks.workunit.client.0.smithi008.stdout:7/653: chown d1/da6/d79/l9c 40 1 2023-10-18T20:58:42.195 INFO:tasks.workunit.client.0.smithi008.stdout:9/534: mkdir d2/dc/d3d/d99 0 2023-10-18T20:58:42.198 INFO:tasks.workunit.client.1.smithi060.stdout:9/719: truncate d3/d99/d19/d54/d8f/fd9 71048 0 2023-10-18T20:58:42.198 INFO:tasks.workunit.client.1.smithi060.stdout:8/742: link d4/d9/d4f/d74/d81/fdd d4/d9/d31/d35/d9f/fe0 0 2023-10-18T20:58:42.198 INFO:tasks.workunit.client.0.smithi008.stdout:4/528: getdents d0/d3 0 2023-10-18T20:58:42.199 INFO:tasks.workunit.client.0.smithi008.stdout:6/642: dwrite df/d15/d48/d4b/f4f [0,4194304] 0 2023-10-18T20:58:42.204 INFO:tasks.workunit.client.0.smithi008.stdout:0/546: mkdir d0/d7c/d9a/d8a/d8f/da5 0 2023-10-18T20:58:42.206 INFO:tasks.workunit.client.1.smithi060.stdout:3/728: dread d0/d22/d26/d29/f45 [0,4194304] 0 2023-10-18T20:58:42.210 INFO:tasks.workunit.client.1.smithi060.stdout:3/729: getdents d0 0 2023-10-18T20:58:42.211 INFO:tasks.workunit.client.1.smithi060.stdout:3/730: truncate d0/d22/d26/d79/fca 1665403 0 2023-10-18T20:58:42.211 INFO:tasks.workunit.client.1.smithi060.stdout:3/731: readlink d0/l4 0 2023-10-18T20:58:42.211 INFO:tasks.workunit.client.1.smithi060.stdout:3/732: creat d0/d5e/ffd x:0 0 0 2023-10-18T20:58:42.211 INFO:tasks.workunit.client.1.smithi060.stdout:3/733: readlink d0/d22/d26/d2c/da0/lb1 0 2023-10-18T20:58:42.215 INFO:tasks.workunit.client.0.smithi008.stdout:1/683: mknod d9/de/df/d17/d1e/ccd 0 2023-10-18T20:58:42.215 INFO:tasks.workunit.client.0.smithi008.stdout:7/654: getdents d1/da6/d4f/d87 0 2023-10-18T20:58:42.217 INFO:tasks.workunit.client.1.smithi060.stdout:3/734: rename d0/f4e to d0/d3c/d3d/ffe 0 2023-10-18T20:58:42.221 INFO:tasks.workunit.client.1.smithi060.stdout:9/720: write d3/d99/d1c/d2a/fdb [1935232,90430] 0 2023-10-18T20:58:42.221 INFO:tasks.workunit.client.1.smithi060.stdout:5/802: dwrite d0/da/d3b/f4c [0,4194304] 0 2023-10-18T20:58:42.221 INFO:tasks.workunit.client.1.smithi060.stdout:5/803: fsync d0/dd/d76/d10f/ff7 0 2023-10-18T20:58:42.223 INFO:tasks.workunit.client.0.smithi008.stdout:9/535: write d2/dc/f1c [4586021,94757] 0 2023-10-18T20:58:42.227 INFO:tasks.workunit.client.0.smithi008.stdout:7/655: dread d1/da6/d79/f92 [0,4194304] 0 2023-10-18T20:58:42.227 INFO:tasks.workunit.client.0.smithi008.stdout:5/586: dwrite d0/d2/d9/daa/fc3 [0,4194304] 0 2023-10-18T20:58:42.229 INFO:tasks.workunit.client.0.smithi008.stdout:7/656: readlink d1/d36/d3d/l63 0 2023-10-18T20:58:42.229 INFO:tasks.workunit.client.0.smithi008.stdout:7/657: chown d1/da6/d79/f4a 807884393 1 2023-10-18T20:58:42.229 INFO:tasks.workunit.client.0.smithi008.stdout:7/658: chown d1/da6/d79 4332 1 2023-10-18T20:58:42.230 INFO:tasks.workunit.client.0.smithi008.stdout:7/659: chown d1/d3/c96 301 1 2023-10-18T20:58:42.237 INFO:tasks.workunit.client.1.smithi060.stdout:3/735: write d0/d22/d26/fa3 [4064285,34072] 0 2023-10-18T20:58:42.238 INFO:tasks.workunit.client.0.smithi008.stdout:4/529: rmdir d0/d17/d5b/d45 39 2023-10-18T20:58:42.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:40.805509+0000 mgr.smithi008.flmjzp (mgr.14640) 10 : audit [DBG] from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:42.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:40.893825+0000 mgr.smithi008.flmjzp (mgr.14640) 11 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:58:42.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:41.556399+0000 mon.smithi008 (mon.0) 656 : audit [DBG] from='client.? 172.21.15.8:0/1407389579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:58:42.245 INFO:tasks.workunit.client.0.smithi008.stdout:6/643: creat df/d13/daa/fd9 x:0 0 0 2023-10-18T20:58:42.245 INFO:tasks.workunit.client.1.smithi060.stdout:9/721: getdents d3/d99/d1c/d25 0 2023-10-18T20:58:42.248 INFO:tasks.workunit.client.1.smithi060.stdout:3/736: mkdir d0/d22/dff 0 2023-10-18T20:58:42.249 INFO:tasks.workunit.client.1.smithi060.stdout:9/722: mknod d3/d99/d1c/d25/c106 0 2023-10-18T20:58:42.249 INFO:tasks.workunit.client.0.smithi008.stdout:0/547: mknod d0/d7c/d9a/d8a/d8f/d21/d85/ca6 0 2023-10-18T20:58:42.252 INFO:tasks.workunit.client.1.smithi060.stdout:3/737: creat d0/d22/d26/dfb/f100 x:0 0 0 2023-10-18T20:58:42.252 INFO:tasks.workunit.client.1.smithi060.stdout:3/738: stat d0/d5e/ff8 0 2023-10-18T20:58:42.252 INFO:tasks.workunit.client.1.smithi060.stdout:3/739: fdatasync d0/d22/d50/fac 0 2023-10-18T20:58:42.253 INFO:tasks.workunit.client.1.smithi060.stdout:9/723: mkdir d3/d99/d1c/d5a/d107 0 2023-10-18T20:58:42.258 INFO:tasks.workunit.client.0.smithi008.stdout:1/684: mknod d9/de/df/d17/d1e/dc0/cce 0 2023-10-18T20:58:42.262 INFO:tasks.workunit.client.0.smithi008.stdout:9/536: mkdir d2/dc/d17/d19/d4a/d9a 0 2023-10-18T20:58:42.265 INFO:tasks.workunit.client.1.smithi060.stdout:0/761: dwrite d3/d8/d14/f77 [0,4194304] 0 2023-10-18T20:58:42.266 INFO:tasks.workunit.client.1.smithi060.stdout:2/787: dwrite d0/d45/fb5 [0,4194304] 0 2023-10-18T20:58:42.271 INFO:tasks.workunit.client.1.smithi060.stdout:0/762: truncate d3/f3b 591221 0 2023-10-18T20:58:42.271 INFO:tasks.workunit.client.1.smithi060.stdout:0/763: fdatasync d3/d8/d14/d55/d9a/dcf/fdb 0 2023-10-18T20:58:42.275 INFO:tasks.workunit.client.1.smithi060.stdout:3/740: dread d0/d22/d26/d8c/fb6 [0,4194304] 0 2023-10-18T20:58:42.276 INFO:tasks.workunit.client.0.smithi008.stdout:7/660: dread d1/d36/f4c [0,4194304] 0 2023-10-18T20:58:42.279 INFO:tasks.workunit.client.0.smithi008.stdout:7/661: write d1/da6/d79/f92 [1912572,51763] 0 2023-10-18T20:58:42.280 INFO:tasks.workunit.client.0.smithi008.stdout:7/662: write d1/d36/d3d/f5a [5113996,61439] 0 2023-10-18T20:58:42.280 INFO:tasks.workunit.client.0.smithi008.stdout:5/587: symlink d0/d2/d9/d34/ld6 0 2023-10-18T20:58:42.280 INFO:tasks.workunit.client.0.smithi008.stdout:5/588: fdatasync d0/d2/d19/d7c/f92 0 2023-10-18T20:58:42.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.277+0000 7fce2e8ec700 1 -- 172.21.15.8:0/570294736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fce2009cd60 con 0x7fce200a5450 2023-10-18T20:58:42.281 INFO:tasks.workunit.client.1.smithi060.stdout:0/764: getdents d3/d8/d14/d55/d74/d76/d68 0 2023-10-18T20:58:42.281 INFO:tasks.workunit.client.1.smithi060.stdout:2/788: rmdir d0/d8/d47/d73 39 2023-10-18T20:58:42.282 INFO:tasks.workunit.client.0.smithi008.stdout:6/644: symlink df/d3c/d77/da9/lda 0 2023-10-18T20:58:42.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.280+0000 7fce1e7fc700 1 -- 172.21.15.8:0/570294736 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1630 (secure 0 0 0) 0x7fce18055e20 con 0x7fce200a5450 2023-10-18T20:58:42.284 INFO:teuthology.orchestra.run.smithi008.stdout:e16 2023-10-18T20:58:42.285 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:58:42.285 INFO:teuthology.orchestra.run.smithi008.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:58:42.285 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T20:58:42.285 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:58:42.285 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T20:58:42.286 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T20:58:42.286 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 16 2023-10-18T20:58:42.286 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T20:58:42.286 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:58:42.286 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:57:40.516856+0000 2023-10-18T20:58:42.287 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T20:58:42.287 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T20:58:42.287 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T20:58:42.287 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T20:58:42.287 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T20:58:42.288 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T20:58:42.288 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T20:58:42.288 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T20:58:42.288 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:58:42.288 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T20:58:42.289 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T20:58:42.289 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T20:58:42.289 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T20:58:42.289 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T20:58:42.289 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T20:58:42.290 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T20:58:42.290 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T20:58:42.290 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T20:58:42.290 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T20:58:42.291 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T20:58:42.291 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015]] 2023-10-18T20:58:42.291 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531]] 2023-10-18T20:58:42.291 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145]] 2023-10-18T20:58:42.292 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799]] 2023-10-18T20:58:42.292 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:58:42.292 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:58:42.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.285+0000 7fce2e8ec700 1 -- 172.21.15.8:0/570294736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce14060fb0 msgr2=0x7fce14063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:42.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.285+0000 7fce2e8ec700 1 --2- 172.21.15.8:0/570294736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce14060fb0 0x7fce14063470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fce24000c00 tx=0x7fce24009b30).stop 2023-10-18T20:58:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.285+0000 7fce2e8ec700 1 -- 172.21.15.8:0/570294736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce200a5450 msgr2=0x7fce200aa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.285+0000 7fce2e8ec700 1 --2- 172.21.15.8:0/570294736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce200a5450 0x7fce200aa520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fce18004f70 tx=0x7fce18009de0).stop 2023-10-18T20:58:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.285+0000 7fce2e8ec700 1 -- 172.21.15.8:0/570294736 shutdown_connections 2023-10-18T20:58:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.285+0000 7fce2e8ec700 1 --2- 172.21.15.8:0/570294736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce14060fb0 0x7fce14063470 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.285+0000 7fce2e8ec700 1 --2- 172.21.15.8:0/570294736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce20095870 0x7fce200a4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:58:42.295 INFO:tasks.workunit.client.1.smithi060.stdout:0/765: unlink d3/d8/d14/d55/d74/d76/d68/d7f/d8d/dbc/cc2 0 2023-10-18T20:58:42.295 INFO:tasks.workunit.client.1.smithi060.stdout:0/766: write d3/d8/f20 [268612,45267] 0 2023-10-18T20:58:42.295 INFO:tasks.workunit.client.1.smithi060.stdout:2/789: write d0/d45/d49/d6e/d79/d6c/fc1 [165221,21971] 0 2023-10-18T20:58:42.296 INFO:tasks.workunit.client.1.smithi060.stdout:2/790: write d0/d3/f35 [855777,97249] 0 2023-10-18T20:58:42.296 INFO:tasks.workunit.client.1.smithi060.stdout:6/812: sync 2023-10-18T20:58:42.296 INFO:tasks.workunit.client.0.smithi008.stdout:9/537: creat d2/dc/d17/d19/d4a/f9b x:0 0 0 2023-10-18T20:58:42.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.285+0000 7fce2e8ec700 1 --2- 172.21.15.8:0/570294736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce200a5450 0x7fce200aa520 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:42.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.285+0000 7fce2e8ec700 1 -- 172.21.15.8:0/570294736 >> 172.21.15.8:0/570294736 conn(0x7fce2008fd30 msgr2=0x7fce200992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:42.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.285+0000 7fce2e8ec700 1 -- 172.21.15.8:0/570294736 shutdown_connections 2023-10-18T20:58:42.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.286+0000 7fce2e8ec700 1 -- 172.21.15.8:0/570294736 wait complete. 2023-10-18T20:58:42.298 INFO:tasks.workunit.client.0.smithi008.stdout:5/589: symlink d0/d2/d19/d7c/d31/d3f/dc9/ld7 0 2023-10-18T20:58:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 16 2023-10-18T20:58:42.299 INFO:tasks.workunit.client.0.smithi008.stdout:6/645: creat df/d3c/da2/dcf/d68/fdb x:0 0 0 2023-10-18T20:58:42.300 INFO:tasks.workunit.client.1.smithi060.stdout:7/858: dwrite fa [0,4194304] 0 2023-10-18T20:58:42.300 INFO:tasks.workunit.client.0.smithi008.stdout:5/590: creat d0/d2/d19/d7c/d31/d3f/d70/dc0/fd8 x:0 0 0 2023-10-18T20:58:42.303 INFO:tasks.workunit.client.1.smithi060.stdout:2/791: unlink d0/d8/d47/fdf 0 2023-10-18T20:58:42.307 INFO:tasks.workunit.client.0.smithi008.stdout:5/591: mknod d0/d2/cd9 0 2023-10-18T20:58:42.308 INFO:tasks.workunit.client.0.smithi008.stdout:6/646: getdents df/d13/d53 0 2023-10-18T20:58:42.310 INFO:tasks.workunit.client.1.smithi060.stdout:7/859: truncate de/d14/d2f/d8f/d5b/f74 1557299 0 2023-10-18T20:58:42.312 INFO:tasks.workunit.client.1.smithi060.stdout:2/792: symlink d0/d16/d81/da1/l10d 0 2023-10-18T20:58:42.312 INFO:tasks.workunit.client.0.smithi008.stdout:5/592: mkdir d0/da9/dda 0 2023-10-18T20:58:42.313 INFO:tasks.workunit.client.1.smithi060.stdout:7/860: mknod de/d14/d3a/d46/d73/c119 0 2023-10-18T20:58:42.313 INFO:tasks.workunit.client.1.smithi060.stdout:7/861: chown de/d38/d78/fbf 59241733 1 2023-10-18T20:58:42.314 INFO:tasks.workunit.client.1.smithi060.stdout:7/862: readlink de/d14/d3a/d46/d73/l89 0 2023-10-18T20:58:42.314 INFO:tasks.workunit.client.1.smithi060.stdout:2/793: stat d0/d8/cba 0 2023-10-18T20:58:42.314 INFO:tasks.workunit.client.1.smithi060.stdout:2/794: dread - d0/d16/d85/ff4 zero size 2023-10-18T20:58:42.316 INFO:tasks.workunit.client.1.smithi060.stdout:7/863: unlink de/d14/d2f/d7b/fec 0 2023-10-18T20:58:42.318 INFO:tasks.workunit.client.1.smithi060.stdout:7/864: symlink de/d29/l11a 0 2023-10-18T20:58:42.321 INFO:tasks.workunit.client.1.smithi060.stdout:9/724: dread d3/d99/d1c/d2a/d80/da0/dc2/f49 [4194304,4194304] 0 2023-10-18T20:58:42.321 INFO:tasks.workunit.client.1.smithi060.stdout:7/865: creat de/d14/d3a/d46/f11b x:0 0 0 2023-10-18T20:58:42.324 INFO:tasks.workunit.client.1.smithi060.stdout:9/725: truncate d3/d99/d1c/d2a/d80/da0/dc2/f94 2314285 0 2023-10-18T20:58:42.330 INFO:tasks.workunit.client.1.smithi060.stdout:7/866: creat de/d38/f11c x:0 0 0 2023-10-18T20:58:42.331 INFO:tasks.workunit.client.1.smithi060.stdout:7/867: dread - de/d14/d3a/fb6 zero size 2023-10-18T20:58:42.341 INFO:tasks.workunit.client.0.smithi008.stdout:6/647: symlink df/d3c/da2/dcf/d58/ldc 0 2023-10-18T20:58:42.341 INFO:tasks.workunit.client.0.smithi008.stdout:1/685: mknod d9/de/df/d17/ccf 0 2023-10-18T20:58:42.344 INFO:tasks.workunit.client.0.smithi008.stdout:6/648: stat df/d15/d48/d4b/c5b 0 2023-10-18T20:58:42.344 INFO:tasks.workunit.client.0.smithi008.stdout:6/649: write df/d15/d48/d4b/f7d [746179,31150] 0 2023-10-18T20:58:42.344 INFO:tasks.workunit.client.0.smithi008.stdout:6/650: chown df/f24 374 1 2023-10-18T20:58:42.352 INFO:tasks.workunit.client.1.smithi060.stdout:4/715: dwrite d4/dc/d2a/fb2 [0,4194304] 0 2023-10-18T20:58:42.353 INFO:tasks.workunit.client.0.smithi008.stdout:1/686: creat d9/de/df/d17/d55/da8/fd0 x:0 0 0 2023-10-18T20:58:42.354 INFO:tasks.workunit.client.0.smithi008.stdout:6/651: truncate df/d3c/da2/dcf/d7e/fac 596638 0 2023-10-18T20:58:42.354 INFO:tasks.workunit.client.0.smithi008.stdout:6/652: chown df/l92 420079 1 2023-10-18T20:58:42.358 INFO:tasks.workunit.client.1.smithi060.stdout:4/716: symlink d4/dc/d2a/d13/d33/le1 0 2023-10-18T20:58:42.362 INFO:tasks.workunit.client.0.smithi008.stdout:8/739: sync 2023-10-18T20:58:42.362 INFO:tasks.workunit.client.0.smithi008.stdout:8/740: fsync d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/fe8 0 2023-10-18T20:58:42.362 INFO:tasks.workunit.client.1.smithi060.stdout:9/726: dread d3/d99/d1c/d2a/d80/da0/dc2/f94 [0,4194304] 0 2023-10-18T20:58:42.363 INFO:tasks.workunit.client.1.smithi060.stdout:4/717: getdents d4/dc/d2a/d5b 0 2023-10-18T20:58:42.363 INFO:tasks.workunit.client.1.smithi060.stdout:9/727: write d3/d99/d1c/d2a/d2d/fbc [473977,122815] 0 2023-10-18T20:58:42.364 INFO:tasks.workunit.client.0.smithi008.stdout:3/656: sync 2023-10-18T20:58:42.364 INFO:tasks.workunit.client.0.smithi008.stdout:3/657: truncate d0/d4a/d64/fd3 45774 0 2023-10-18T20:58:42.364 INFO:tasks.workunit.client.0.smithi008.stdout:1/687: creat d9/de/df/d17/d1e/fd1 x:0 0 0 2023-10-18T20:58:42.364 INFO:tasks.workunit.client.0.smithi008.stdout:1/688: read - d9/de/df/d17/d1e/fd1 zero size 2023-10-18T20:58:42.365 INFO:tasks.workunit.client.0.smithi008.stdout:6/653: mknod df/d3c/d77/dd6/cdd 0 2023-10-18T20:58:42.365 INFO:tasks.workunit.client.1.smithi060.stdout:6/813: dwrite d10/d17/d54/dd4/f8f [0,4194304] 0 2023-10-18T20:58:42.365 INFO:tasks.workunit.client.1.smithi060.stdout:6/814: truncate d10/d17/dae/dbf/fe0 940250 0 2023-10-18T20:58:42.366 INFO:tasks.workunit.client.1.smithi060.stdout:9/728: mknod d3/d99/d1c/d2a/d80/da0/c108 0 2023-10-18T20:58:42.367 INFO:tasks.workunit.client.0.smithi008.stdout:8/741: mkdir d5/d8/df/d9d/d4d/db5/da3/d10a 0 2023-10-18T20:58:42.368 INFO:tasks.workunit.client.1.smithi060.stdout:7/868: dread de/d14/d2f/f71 [0,4194304] 0 2023-10-18T20:58:42.368 INFO:tasks.workunit.client.1.smithi060.stdout:7/869: truncate de/d38/d78/fbf 1031615 0 2023-10-18T20:58:42.368 INFO:tasks.workunit.client.1.smithi060.stdout:7/870: chown de/d14/d2f/d3f/d5a/lc3 48 1 2023-10-18T20:58:42.368 INFO:tasks.workunit.client.1.smithi060.stdout:7/871: write de/d14/d3a/f56 [1188573,47763] 0 2023-10-18T20:58:42.369 INFO:tasks.workunit.client.0.smithi008.stdout:8/742: write d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/dbf/ff7 [484776,84778] 0 2023-10-18T20:58:42.369 INFO:tasks.workunit.client.0.smithi008.stdout:8/743: fsync d5/d8/df/d9d/d4d/f98 0 2023-10-18T20:58:42.369 INFO:tasks.workunit.client.0.smithi008.stdout:8/744: chown d5/d8/df/d9d/l42 271082885 1 2023-10-18T20:58:42.370 INFO:tasks.workunit.client.0.smithi008.stdout:6/654: write df/d3c/da2/dcf/d68/f6b [1027303,103767] 0 2023-10-18T20:58:42.370 INFO:tasks.workunit.client.0.smithi008.stdout:6/655: getdents df/d15/d27/dbf 0 2023-10-18T20:58:42.370 INFO:tasks.workunit.client.0.smithi008.stdout:6/656: chown df/d15/d27/c29 20747999 1 2023-10-18T20:58:42.371 INFO:tasks.workunit.client.1.smithi060.stdout:6/815: rename d10/d2e/l63 to d10/d17/d7a/lff 0 2023-10-18T20:58:42.373 INFO:tasks.workunit.client.1.smithi060.stdout:1/920: sync 2023-10-18T20:58:42.374 INFO:tasks.workunit.client.1.smithi060.stdout:1/921: stat d4/d6/d7/d2f/d6d 0 2023-10-18T20:58:42.374 INFO:tasks.workunit.client.1.smithi060.stdout:1/922: getdents d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d106 0 2023-10-18T20:58:42.374 INFO:tasks.workunit.client.1.smithi060.stdout:1/923: write d4/d6/d7/df/d59/fc6 [1502490,119543] 0 2023-10-18T20:58:42.375 INFO:tasks.workunit.client.0.smithi008.stdout:3/658: dread d0/d4a/d64/fd3 [0,4194304] 0 2023-10-18T20:58:42.376 INFO:tasks.workunit.client.0.smithi008.stdout:3/659: write d0/d4a/d64/fd3 [521675,65700] 0 2023-10-18T20:58:42.376 INFO:tasks.workunit.client.0.smithi008.stdout:3/660: fdatasync d0/d3/f5 0 2023-10-18T20:58:42.376 INFO:tasks.workunit.client.0.smithi008.stdout:3/661: readlink d0/d3/de/d13/d35/dbf/la5 0 2023-10-18T20:58:42.378 INFO:tasks.workunit.client.1.smithi060.stdout:7/872: symlink de/d38/d78/l11d 0 2023-10-18T20:58:42.378 INFO:tasks.workunit.client.1.smithi060.stdout:6/816: mknod d10/d2e/d75/d81/d8b/dc9/c100 0 2023-10-18T20:58:42.379 INFO:tasks.workunit.client.1.smithi060.stdout:7/873: chown de/d29/f2b 414752 1 2023-10-18T20:58:42.379 INFO:tasks.workunit.client.1.smithi060.stdout:6/817: chown d10/d2e/d75/d81/d8b 53 1 2023-10-18T20:58:42.382 INFO:tasks.workunit.client.0.smithi008.stdout:7/663: dread d1/d36/f4c [0,4194304] 0 2023-10-18T20:58:42.401 INFO:tasks.workunit.client.1.smithi060.stdout:2/795: dwrite d0/d8/f8a [0,4194304] 0 2023-10-18T20:58:42.403 INFO:tasks.workunit.client.1.smithi060.stdout:2/796: write d0/d3/f35 [3370082,77814] 0 2023-10-18T20:58:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:40.805509+0000 mgr.smithi008.flmjzp (mgr.14640) 10 : audit [DBG] from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:40.893825+0000 mgr.smithi008.flmjzp (mgr.14640) 11 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:58:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:41.556399+0000 mon.smithi008 (mon.0) 656 : audit [DBG] from='client.? 172.21.15.8:0/1407389579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:58:42.434 INFO:tasks.workunit.client.1.smithi060.stdout:1/924: dwrite d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/fb7 [0,4194304] 0 2023-10-18T20:58:42.436 INFO:tasks.workunit.client.1.smithi060.stdout:1/925: truncate d4/d6/d7/d2f/d6d/f9d 2552502 0 2023-10-18T20:58:42.436 INFO:tasks.workunit.client.1.smithi060.stdout:1/926: write d4/d6/fb4 [1672725,124006] 0 2023-10-18T20:58:42.450 INFO:tasks.workunit.client.1.smithi060.stdout:1/927: creat d4/d6/d7/df/f12f x:0 0 0 2023-10-18T20:58:42.461 INFO:tasks.workunit.client.0.smithi008.stdout:0/548: dwrite d0/dd/d19/d24/f3d [0,4194304] 0 2023-10-18T20:58:42.463 INFO:tasks.workunit.client.0.smithi008.stdout:1/689: symlink d9/de/df/d17/d1e/d9a/dbc/ld2 0 2023-10-18T20:58:42.463 INFO:tasks.workunit.client.0.smithi008.stdout:8/745: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/f10b x:0 0 0 2023-10-18T20:58:42.463 INFO:tasks.workunit.client.0.smithi008.stdout:3/662: unlink d0/d3/d42/f68 0 2023-10-18T20:58:42.464 INFO:tasks.workunit.client.0.smithi008.stdout:3/663: readlink d0/d3/de/l32 0 2023-10-18T20:58:42.464 INFO:tasks.workunit.client.0.smithi008.stdout:2/616: sync 2023-10-18T20:58:42.464 INFO:tasks.workunit.client.0.smithi008.stdout:7/664: creat d1/d36/fcf x:0 0 0 2023-10-18T20:58:42.465 INFO:tasks.workunit.client.0.smithi008.stdout:2/617: readlink d1/d3/dd/d25/db2/lbb 0 2023-10-18T20:58:42.467 INFO:tasks.workunit.client.0.smithi008.stdout:8/746: getdents d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec 0 2023-10-18T20:58:42.469 INFO:tasks.workunit.client.0.smithi008.stdout:3/664: unlink d0/d3/d37/da6/lc8 0 2023-10-18T20:58:42.469 INFO:tasks.workunit.client.1.smithi060.stdout:0/767: dwrite d3/d8/f10 [0,4194304] 0 2023-10-18T20:58:42.470 INFO:tasks.workunit.client.1.smithi060.stdout:1/928: dread d4/da/f50 [0,4194304] 0 2023-10-18T20:58:42.470 INFO:tasks.workunit.client.1.smithi060.stdout:1/929: creat d4/d6/f130 x:0 0 0 2023-10-18T20:58:42.470 INFO:tasks.workunit.client.1.smithi060.stdout:1/930: fdatasync d4/d6/d7/d2f/d7b/ffe 0 2023-10-18T20:58:42.470 INFO:tasks.workunit.client.1.smithi060.stdout:0/768: fsync d3/f21 0 2023-10-18T20:58:42.471 INFO:tasks.workunit.client.0.smithi008.stdout:7/665: creat d1/da6/fd0 x:0 0 0 2023-10-18T20:58:42.471 INFO:tasks.workunit.client.0.smithi008.stdout:7/666: write d1/da6/d4f/fc5 [107820,66011] 0 2023-10-18T20:58:42.475 INFO:tasks.workunit.client.0.smithi008.stdout:9/538: dwrite d2/dc/d1a/d1d/f82 [0,4194304] 0 2023-10-18T20:58:42.482 INFO:tasks.workunit.client.1.smithi060.stdout:3/741: dwrite d0/d3c/d3d/d4d/f6a [0,4194304] 0 2023-10-18T20:58:42.482 INFO:tasks.workunit.client.1.smithi060.stdout:0/769: truncate d3/d8/d14/d55/d74/d76/f36 2061886 0 2023-10-18T20:58:42.487 INFO:tasks.workunit.client.1.smithi060.stdout:4/718: dwrite d4/dc/d2a/d5b/fa0 [0,4194304] 0 2023-10-18T20:58:42.487 INFO:tasks.workunit.client.1.smithi060.stdout:2/797: dwrite d0/d16/d85/ff4 [0,4194304] 0 2023-10-18T20:58:42.489 INFO:tasks.workunit.client.1.smithi060.stdout:2/798: mknod d0/d45/dc9/de6/c10e 0 2023-10-18T20:58:42.490 INFO:tasks.workunit.client.0.smithi008.stdout:4/530: mknod d0/caf 0 2023-10-18T20:58:42.490 INFO:tasks.workunit.client.1.smithi060.stdout:7/874: dwrite de/d14/d49/d68/f40 [0,4194304] 0 2023-10-18T20:58:42.491 INFO:tasks.workunit.client.1.smithi060.stdout:7/875: fsync de/d29/d72/d84/fae 0 2023-10-18T20:58:42.491 INFO:tasks.workunit.client.0.smithi008.stdout:2/618: symlink d1/d3/dd/d25/d76/lca 0 2023-10-18T20:58:42.492 INFO:tasks.workunit.client.0.smithi008.stdout:6/657: dwrite df/d15/d27/d4c/fce [0,4194304] 0 2023-10-18T20:58:42.492 INFO:tasks.workunit.client.1.smithi060.stdout:7/876: creat de/d14/d49/d68/d106/f11e x:0 0 0 2023-10-18T20:58:42.493 INFO:tasks.workunit.client.1.smithi060.stdout:7/877: dread - de/d14/d49/d68/d7d/d7e/ffa zero size 2023-10-18T20:58:42.493 INFO:tasks.workunit.client.1.smithi060.stdout:2/799: link d0/d8/d47/d73/f100 d0/d16/d81/da1/ddd/f10f 0 2023-10-18T20:58:42.493 INFO:tasks.workunit.client.1.smithi060.stdout:2/800: readlink d0/d3/d9e/lb4 0 2023-10-18T20:58:42.496 INFO:tasks.workunit.client.0.smithi008.stdout:8/747: creat d5/d8/df/d9d/d4d/dba/dd4/f10c x:0 0 0 2023-10-18T20:58:42.516 INFO:tasks.workunit.client.0.smithi008.stdout:2/619: write d1/d3/f1b [894330,41736] 0 2023-10-18T20:58:42.516 INFO:tasks.workunit.client.0.smithi008.stdout:2/620: stat d1/d3/dd/d25/d34/f46 0 2023-10-18T20:58:42.516 INFO:tasks.workunit.client.0.smithi008.stdout:7/667: rename d1/l67 to d1/d3/d20/dbe/ld1 0 2023-10-18T20:58:42.517 INFO:tasks.workunit.client.0.smithi008.stdout:7/668: chown d1/d3/d20/d5f/dba 793 1 2023-10-18T20:58:42.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.524+0000 7f2e7fb07700 1 -- 172.21.15.8:0/1548712220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e78060310 msgr2=0x7f2e780f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:42.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.524+0000 7f2e7fb07700 1 --2- 172.21.15.8:0/1548712220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e78060310 0x7f2e780f9140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f2e74004660 tx=0x7f2e74009b30).stop 2023-10-18T20:58:42.529 INFO:tasks.workunit.client.0.smithi008.stdout:4/531: dread d0/d17/f31 [0,4194304] 0 2023-10-18T20:58:42.530 INFO:tasks.workunit.client.0.smithi008.stdout:4/532: write d0/d58/d8e/f6d [611550,49073] 0 2023-10-18T20:58:42.530 INFO:tasks.workunit.client.0.smithi008.stdout:4/533: chown d0/d3/d21/c2b 26 1 2023-10-18T20:58:42.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.526+0000 7f2e7fb07700 1 -- 172.21.15.8:0/1548712220 shutdown_connections 2023-10-18T20:58:42.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.526+0000 7f2e7fb07700 1 --2- 172.21.15.8:0/1548712220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e780f96c0 0x7f2e780fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:42.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.526+0000 7f2e7fb07700 1 --2- 172.21.15.8:0/1548712220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e78060310 0x7f2e780f9140 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:42.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.526+0000 7f2e7fb07700 1 -- 172.21.15.8:0/1548712220 >> 172.21.15.8:0/1548712220 conn(0x7f2e780f0bc0 msgr2=0x7f2e780f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:42.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.527+0000 7f2e7fb07700 1 -- 172.21.15.8:0/1548712220 shutdown_connections 2023-10-18T20:58:42.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.527+0000 7f2e7fb07700 1 -- 172.21.15.8:0/1548712220 wait complete. 2023-10-18T20:58:42.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.528+0000 7f2e7fb07700 1 Processor -- start 2023-10-18T20:58:42.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.529+0000 7f2e7fb07700 1 -- start start 2023-10-18T20:58:42.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.530+0000 7f2e7fb07700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e78060310 0x7f2e7810f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:42.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.531+0000 7f2e7fb07700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e780f96c0 0x7f2e7810faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:42.534 INFO:tasks.workunit.client.1.smithi060.stdout:0/770: dread d3/d8/f10 [0,4194304] 0 2023-10-18T20:58:42.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.531+0000 7f2e7fb07700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e781100a0 con 0x7f2e78060310 2023-10-18T20:58:42.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.531+0000 7f2e7fb07700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e781101e0 con 0x7f2e780f96c0 2023-10-18T20:58:42.535 INFO:tasks.workunit.client.0.smithi008.stdout:6/658: mknod df/d3c/da2/dcf/d3f/cde 0 2023-10-18T20:58:42.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.531+0000 7f2e7d8a3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e78060310 0x7f2e7810f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:42.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.531+0000 7f2e7d8a3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e78060310 0x7f2e7810f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51066/0 (socket says 172.21.15.8:51066) 2023-10-18T20:58:42.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.532+0000 7f2e7d8a3700 1 -- 172.21.15.8:0/3583777921 learned_addr learned my addr 172.21.15.8:0/3583777921 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:58:42.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.532+0000 7f2e7d0a2700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e780f96c0 0x7f2e7810faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:42.537 INFO:tasks.workunit.client.1.smithi060.stdout:0/771: unlink d3/f3b 0 2023-10-18T20:58:42.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.534+0000 7f2e7d8a3700 1 -- 172.21.15.8:0/3583777921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e780f96c0 msgr2=0x7f2e7810faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:42.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.534+0000 7f2e7d8a3700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e780f96c0 0x7f2e7810faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:42.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.534+0000 7f2e7d8a3700 1 -- 172.21.15.8:0/3583777921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e74005040 con 0x7f2e78060310 2023-10-18T20:58:42.539 INFO:tasks.workunit.client.0.smithi008.stdout:8/748: symlink d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/l10d 0 2023-10-18T20:58:42.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.534+0000 7f2e7d8a3700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e78060310 0x7f2e7810f600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f2e74009f50 tx=0x7f2e74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:42.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.535+0000 7f2e6e7fc700 1 -- 172.21.15.8:0/3583777921 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e74018070 con 0x7f2e78060310 2023-10-18T20:58:42.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.535+0000 7f2e6e7fc700 1 -- 172.21.15.8:0/3583777921 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2e74009630 con 0x7f2e78060310 2023-10-18T20:58:42.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.535+0000 7f2e6e7fc700 1 -- 172.21.15.8:0/3583777921 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e7401c3c0 con 0x7f2e78060310 2023-10-18T20:58:42.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.535+0000 7f2e7fb07700 1 -- 172.21.15.8:0/3583777921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e78110ac0 con 0x7f2e78060310 2023-10-18T20:58:42.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.535+0000 7f2e7fb07700 1 -- 172.21.15.8:0/3583777921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e78111080 con 0x7f2e78060310 2023-10-18T20:58:42.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.537+0000 7f2e7fb07700 1 -- 172.21.15.8:0/3583777921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e78045ad0 con 0x7f2e78060310 2023-10-18T20:58:42.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.541+0000 7f2e6e7fc700 1 -- 172.21.15.8:0/3583777921 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 77192+0+0 (secure 0 0 0) 0x7f2e7401d420 con 0x7f2e78060310 2023-10-18T20:58:42.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.542+0000 7f2e6e7fc700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e64061020 0x7f2e640634e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:58:42.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.543+0000 7f2e6e7fc700 1 -- 172.21.15.8:0/3583777921 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f2e7407dfd0 con 0x7f2e78060310 2023-10-18T20:58:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.544+0000 7f2e7d0a2700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e64061020 0x7f2e640634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:58:42.547 INFO:tasks.workunit.client.1.smithi060.stdout:2/801: dread d0/d8/d47/ffe [0,4194304] 0 2023-10-18T20:58:42.548 INFO:tasks.workunit.client.1.smithi060.stdout:2/802: fdatasync d0/f78 0 2023-10-18T20:58:42.549 INFO:tasks.workunit.client.1.smithi060.stdout:2/803: readlink d0/d16/d81/lc3 0 2023-10-18T20:58:42.549 INFO:tasks.workunit.client.1.smithi060.stdout:2/804: stat d0/d3/d27/d4d/d5e/d96/fb8 0 2023-10-18T20:58:42.549 INFO:tasks.workunit.client.1.smithi060.stdout:2/805: readlink d0/d3/d27/l3e 0 2023-10-18T20:58:42.549 INFO:tasks.workunit.client.1.smithi060.stdout:2/806: chown d0/d16/d85/fbd 29972795 1 2023-10-18T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.549+0000 7f2e7d0a2700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e64061020 0x7f2e640634e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2e780600e0 tx=0x7f2e6800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.552+0000 7f2e6e7fc700 1 -- 172.21.15.8:0/3583777921 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162422 (secure 0 0 0) 0x7f2e74051e70 con 0x7f2e78060310 2023-10-18T20:58:42.559 INFO:tasks.workunit.client.1.smithi060.stdout:0/772: rename d3/f1a to d3/d8/d3c/d87/ff3 0 2023-10-18T20:58:42.560 INFO:tasks.workunit.client.1.smithi060.stdout:3/742: dwrite d0/d3c/d3d/d4d/f97 [0,4194304] 0 2023-10-18T20:58:42.560 INFO:tasks.workunit.client.1.smithi060.stdout:0/773: truncate d3/d32/d86/fb7 695452 0 2023-10-18T20:58:42.560 INFO:tasks.workunit.client.1.smithi060.stdout:7/878: write de/d14/d2f/d8f/d5b/f75 [3504419,94200] 0 2023-10-18T20:58:42.561 INFO:tasks.workunit.client.1.smithi060.stdout:3/743: creat d0/d22/f101 x:0 0 0 2023-10-18T20:58:42.563 INFO:tasks.workunit.client.1.smithi060.stdout:0/774: creat d3/d8/d14/dec/ff4 x:0 0 0 2023-10-18T20:58:42.576 INFO:tasks.workunit.client.0.smithi008.stdout:8/749: dread d5/d8/f12 [0,4194304] 0 2023-10-18T20:58:42.576 INFO:tasks.workunit.client.0.smithi008.stdout:8/750: fdatasync d5/d8/f32 0 2023-10-18T20:58:42.582 INFO:tasks.workunit.client.0.smithi008.stdout:8/751: creat d5/d8/df/d9d/d4d/f10e x:0 0 0 2023-10-18T20:58:42.584 INFO:tasks.workunit.client.1.smithi060.stdout:4/719: dwrite d4/dc/d2a/f9a [0,4194304] 0 2023-10-18T20:58:42.584 INFO:tasks.workunit.client.1.smithi060.stdout:1/931: dwrite d4/d6/d48/fbd [0,4194304] 0 2023-10-18T20:58:42.585 INFO:tasks.workunit.client.0.smithi008.stdout:5/593: dwrite d0/fbc [0,4194304] 0 2023-10-18T20:58:42.587 INFO:tasks.workunit.client.0.smithi008.stdout:5/594: write d0/d2/d19/d7c/d31/d3f/d70/dc0/fd8 [758994,104469] 0 2023-10-18T20:58:42.588 INFO:tasks.workunit.client.0.smithi008.stdout:0/549: dwrite d0/dd/d19/d5f/d99/f33 [0,4194304] 0 2023-10-18T20:58:42.591 INFO:tasks.workunit.client.0.smithi008.stdout:2/621: rename d1/d3/dd/d1c/d3a/d45/f75 to d1/d3/dd/d25/d76/d59/fcb 0 2023-10-18T20:58:42.591 INFO:tasks.workunit.client.0.smithi008.stdout:2/622: chown d1/d3/dd/d25/d76/d59/d85/db9/lc2 626 1 2023-10-18T20:58:42.592 INFO:tasks.workunit.client.0.smithi008.stdout:2/623: chown d1/d3/c91 304 1 2023-10-18T20:58:42.592 INFO:tasks.workunit.client.0.smithi008.stdout:8/752: mknod d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/dc4/c10f 0 2023-10-18T20:58:42.592 INFO:tasks.workunit.client.0.smithi008.stdout:8/753: read - d5/d8/df/d9d/d4d/f98 zero size 2023-10-18T20:58:42.593 INFO:tasks.workunit.client.1.smithi060.stdout:1/932: dread d4/d6/d7/d2f/d6d/f104 [0,4194304] 0 2023-10-18T20:58:42.597 INFO:tasks.workunit.client.1.smithi060.stdout:3/744: dwrite d0/d3c/d3d/f7a [0,4194304] 0 2023-10-18T20:58:42.597 INFO:tasks.workunit.client.1.smithi060.stdout:3/745: chown d0/d22/d26/d79 536505682 1 2023-10-18T20:58:42.598 INFO:tasks.workunit.client.0.smithi008.stdout:1/690: dwrite d9/fcc [0,4194304] 0 2023-10-18T20:58:42.598 INFO:tasks.workunit.client.1.smithi060.stdout:2/807: write d0/d3/d27/f57 [396092,67179] 0 2023-10-18T20:58:42.602 INFO:tasks.workunit.client.0.smithi008.stdout:3/665: dwrite d0/d3/de/d13/d35/d51/fbe [0,4194304] 0 2023-10-18T20:58:42.602 INFO:tasks.workunit.client.0.smithi008.stdout:5/595: mkdir d0/d2/d19/d7c/d31/d3f/d70/dc0/ddb 0 2023-10-18T20:58:42.602 INFO:tasks.workunit.client.0.smithi008.stdout:5/596: write d0/d86/f8c [603266,64644] 0 2023-10-18T20:58:42.605 INFO:tasks.workunit.client.0.smithi008.stdout:0/550: mkdir d0/dd/d19/d5f/d89/da7 0 2023-10-18T20:58:42.606 INFO:tasks.workunit.client.1.smithi060.stdout:1/933: creat d4/d6/d7/f131 x:0 0 0 2023-10-18T20:58:42.607 INFO:tasks.workunit.client.0.smithi008.stdout:7/669: rename d1/d3/fc1 to d1/d3/d20/fd2 0 2023-10-18T20:58:42.608 INFO:tasks.workunit.client.1.smithi060.stdout:2/808: write d0/d45/d49/d55/dbf/fec [100800,75341] 0 2023-10-18T20:58:42.613 INFO:tasks.workunit.client.0.smithi008.stdout:2/624: rmdir d1/d3/d40/d6e/d7e 39 2023-10-18T20:58:42.614 INFO:tasks.workunit.client.0.smithi008.stdout:0/551: read d0/dd/d19/d5f/d99/d94/f43 [153039,25870] 0 2023-10-18T20:58:42.615 INFO:tasks.workunit.client.0.smithi008.stdout:1/691: mkdir d9/de/df/d85/dd3 0 2023-10-18T20:58:42.615 INFO:tasks.workunit.client.0.smithi008.stdout:1/692: dread - d9/de/df/d17/d55/fb5 zero size 2023-10-18T20:58:42.617 INFO:tasks.workunit.client.0.smithi008.stdout:3/666: symlink d0/d84/ld6 0 2023-10-18T20:58:42.617 INFO:tasks.workunit.client.1.smithi060.stdout:3/746: link d0/d22/d26/d79/fb4 d0/f102 0 2023-10-18T20:58:42.618 INFO:tasks.workunit.client.1.smithi060.stdout:4/720: mkdir d4/dc/de2 0 2023-10-18T20:58:42.618 INFO:tasks.workunit.client.1.smithi060.stdout:4/721: stat d4/d15 0 2023-10-18T20:58:42.619 INFO:tasks.workunit.client.1.smithi060.stdout:2/809: write d0/d16/d7f/fd8 [307306,42600] 0 2023-10-18T20:58:42.619 INFO:tasks.workunit.client.1.smithi060.stdout:2/810: chown d0/d45/d49/d55/cda 15 1 2023-10-18T20:58:42.619 INFO:tasks.workunit.client.1.smithi060.stdout:3/747: truncate d0/d3c/d3d/d4d/d95/dc9/fd0 270341 0 2023-10-18T20:58:42.620 INFO:tasks.workunit.client.0.smithi008.stdout:8/754: symlink d5/d8/df/dce/dfa/l110 0 2023-10-18T20:58:42.620 INFO:tasks.workunit.client.0.smithi008.stdout:8/755: write d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/fad [509178,46200] 0 2023-10-18T20:58:42.621 INFO:tasks.workunit.client.1.smithi060.stdout:2/811: readlink d0/d3/d27/d4d/l6b 0 2023-10-18T20:58:42.624 INFO:tasks.workunit.client.1.smithi060.stdout:4/722: rename d4/dc/f22 to d4/dc/d2a/d5b/fe3 0 2023-10-18T20:58:42.624 INFO:tasks.workunit.client.1.smithi060.stdout:4/723: write d4/dc/d2a/d31/f97 [72949,15130] 0 2023-10-18T20:58:42.625 INFO:tasks.workunit.client.1.smithi060.stdout:2/812: chown d0/d3/d27/d4d/f5b 317118 1 2023-10-18T20:58:42.626 INFO:tasks.workunit.client.0.smithi008.stdout:7/670: creat d1/d36/d3d/d3e/d59/fd3 x:0 0 0 2023-10-18T20:58:42.626 INFO:tasks.workunit.client.0.smithi008.stdout:1/693: mkdir d9/dd4 0 2023-10-18T20:58:42.628 INFO:tasks.workunit.client.0.smithi008.stdout:8/756: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/f111 x:0 0 0 2023-10-18T20:58:42.628 INFO:tasks.workunit.client.0.smithi008.stdout:8/757: truncate d5/d8/df/d9d/d85/db1/fbc 842798 0 2023-10-18T20:58:42.629 INFO:tasks.workunit.client.1.smithi060.stdout:3/748: rename d0/d3c/c8b to d0/d22/d26/d8c/c103 0 2023-10-18T20:58:42.629 INFO:tasks.workunit.client.1.smithi060.stdout:3/749: chown d0/d22/d26/f61 1 1 2023-10-18T20:58:42.629 INFO:tasks.workunit.client.1.smithi060.stdout:3/750: chown d0/d22/c99 660991 1 2023-10-18T20:58:42.635 INFO:tasks.workunit.client.0.smithi008.stdout:1/694: mknod d9/de/df/d17/d55/da8/cd5 0 2023-10-18T20:58:42.635 INFO:tasks.workunit.client.0.smithi008.stdout:1/695: chown d9/de/df/d17/d1e/db8 29342074 1 2023-10-18T20:58:42.636 INFO:tasks.workunit.client.0.smithi008.stdout:2/625: write d1/d3/dd/f38 [2070591,84293] 0 2023-10-18T20:58:42.636 INFO:tasks.workunit.client.0.smithi008.stdout:4/534: dwrite d0/f8b [0,4194304] 0 2023-10-18T20:58:42.636 INFO:tasks.workunit.client.0.smithi008.stdout:7/671: unlink d1/l18 0 2023-10-18T20:58:42.637 INFO:tasks.workunit.client.0.smithi008.stdout:0/552: dread d0/dd/d19/d5f/f60 [0,4194304] 0 2023-10-18T20:58:42.637 INFO:tasks.workunit.client.0.smithi008.stdout:0/553: fdatasync d0/dd/d19/d5f/d99/d94/f95 0 2023-10-18T20:58:42.639 INFO:tasks.workunit.client.1.smithi060.stdout:2/813: dread d0/d16/d81/fd3 [0,4194304] 0 2023-10-18T20:58:42.641 INFO:tasks.workunit.client.1.smithi060.stdout:2/814: mkdir d0/d45/dc9/d102/d110 0 2023-10-18T20:58:42.642 INFO:tasks.workunit.client.1.smithi060.stdout:2/815: fsync d0/d3/d27/d108/fb0 0 2023-10-18T20:58:42.648 INFO:tasks.workunit.client.0.smithi008.stdout:0/554: creat d0/dd/d19/fa8 x:0 0 0 2023-10-18T20:58:42.648 INFO:tasks.workunit.client.0.smithi008.stdout:2/626: mknod d1/d3/dd/d1c/ccc 0 2023-10-18T20:58:42.648 INFO:tasks.workunit.client.0.smithi008.stdout:2/627: chown d1/d3/dd/d1c/d3a/d45 23090 1 2023-10-18T20:58:42.648 INFO:tasks.workunit.client.0.smithi008.stdout:2/628: write d1/d3/dd/f38 [3997280,46342] 0 2023-10-18T20:58:42.658 INFO:tasks.workunit.client.0.smithi008.stdout:0/555: symlink d0/d7c/d9a/la9 0 2023-10-18T20:58:42.658 INFO:tasks.workunit.client.0.smithi008.stdout:0/556: chown d0/c34 41 1 2023-10-18T20:58:42.663 INFO:tasks.workunit.client.1.smithi060.stdout:0/775: dwrite d3/d8/d14/d55/d74/d76/d6b/f79 [0,4194304] 0 2023-10-18T20:58:42.664 INFO:tasks.workunit.client.1.smithi060.stdout:7/879: dwrite de/d14/d2f/d3f/fde [0,4194304] 0 2023-10-18T20:58:42.664 INFO:tasks.workunit.client.1.smithi060.stdout:7/880: dread - de/d14/d49/d68/fef zero size 2023-10-18T20:58:42.664 INFO:tasks.workunit.client.1.smithi060.stdout:2/816: mkdir d0/d45/d49/d55/dbf/d111 0 2023-10-18T20:58:42.665 INFO:tasks.workunit.client.0.smithi008.stdout:0/557: truncate d0/dd/d19/d5f/f60 726658 0 2023-10-18T20:58:42.669 INFO:tasks.workunit.client.0.smithi008.stdout:0/558: write d0/d7c/f92 [4742230,111066] 0 2023-10-18T20:58:42.669 INFO:tasks.workunit.client.0.smithi008.stdout:0/559: write d0/d3a/f8e [531487,72758] 0 2023-10-18T20:58:42.677 INFO:tasks.workunit.client.1.smithi060.stdout:0/776: write d3/d8/d14/f5f [5137041,18251] 0 2023-10-18T20:58:42.678 INFO:tasks.workunit.client.1.smithi060.stdout:0/777: creat d3/ff5 x:0 0 0 2023-10-18T20:58:42.680 INFO:tasks.workunit.client.1.smithi060.stdout:7/881: rename de/d14/fd0 to de/f11f 0 2023-10-18T20:58:42.684 INFO:tasks.workunit.client.0.smithi008.stdout:6/659: dwrite df/d15/d48/d4b/f7d [0,4194304] 0 2023-10-18T20:58:42.704 INFO:tasks.workunit.client.1.smithi060.stdout:0/778: dread d3/de5/df1/fb8 [0,4194304] 0 2023-10-18T20:58:42.718 INFO:tasks.workunit.client.1.smithi060.stdout:0/779: rename d3/d80/f90 to d3/de5/df1/dea/ff6 0 2023-10-18T20:58:42.723 INFO:tasks.workunit.client.1.smithi060.stdout:0/780: mknod d3/d80/db5/cf7 0 2023-10-18T20:58:42.724 INFO:tasks.workunit.client.1.smithi060.stdout:2/817: dread d0/d16/d81/da1/fab [0,4194304] 0 2023-10-18T20:58:42.725 INFO:tasks.workunit.client.1.smithi060.stdout:5/804: sync 2023-10-18T20:58:42.725 INFO:tasks.workunit.client.1.smithi060.stdout:5/805: stat d0/d6/d8/df/l25 0 2023-10-18T20:58:42.725 INFO:tasks.workunit.client.1.smithi060.stdout:8/743: sync 2023-10-18T20:58:42.726 INFO:tasks.workunit.client.0.smithi008.stdout:6/660: dread df/d3c/d77/da9/f5a [0,4194304] 0 2023-10-18T20:58:42.728 INFO:tasks.workunit.client.0.smithi008.stdout:7/672: dwrite d1/d36/d3d/d3e/d59/f9b [0,4194304] 0 2023-10-18T20:58:42.729 INFO:tasks.workunit.client.0.smithi008.stdout:7/673: readlink d1/d3/l5 0 2023-10-18T20:58:42.731 INFO:tasks.workunit.client.1.smithi060.stdout:4/724: fsync d4/dc/d2a/d5b/fe3 0 2023-10-18T20:58:42.731 INFO:tasks.workunit.client.1.smithi060.stdout:4/725: dread - d4/dc/d2a/d39/fdc zero size 2023-10-18T20:58:42.734 INFO:tasks.workunit.client.0.smithi008.stdout:6/661: creat df/d3c/da2/dcf/d3f/fdf x:0 0 0 2023-10-18T20:58:42.734 INFO:tasks.workunit.client.0.smithi008.stdout:6/662: fsync df/d3c/da2/fb4 0 2023-10-18T20:58:42.734 INFO:tasks.workunit.client.0.smithi008.stdout:6/663: fsync df/d13/d53/fd4 0 2023-10-18T20:58:42.734 INFO:tasks.workunit.client.0.smithi008.stdout:6/664: truncate df/d15/d27/dbf/f9e 255707 0 2023-10-18T20:58:42.734 INFO:tasks.workunit.client.0.smithi008.stdout:5/597: dwrite d0/d6e/f7d [0,4194304] 0 2023-10-18T20:58:42.735 INFO:tasks.workunit.client.1.smithi060.stdout:2/818: creat d0/d3/d27/d108/f112 x:0 0 0 2023-10-18T20:58:42.735 INFO:tasks.workunit.client.1.smithi060.stdout:2/819: readlink d0/d45/dc9/d4a/l50 0 2023-10-18T20:58:42.739 INFO:tasks.workunit.client.1.smithi060.stdout:5/806: rmdir d0/d6 39 2023-10-18T20:58:42.746 INFO:tasks.workunit.client.1.smithi060.stdout:6/818: sync 2023-10-18T20:58:42.747 INFO:tasks.workunit.client.0.smithi008.stdout:7/674: symlink d1/da6/d4f/d87/ld4 0 2023-10-18T20:58:42.747 INFO:tasks.workunit.client.0.smithi008.stdout:7/675: readlink d1/l1e 0 2023-10-18T20:58:42.747 INFO:tasks.workunit.client.0.smithi008.stdout:5/598: getdents d0/d2/d19/d7c/d58/d65/d68 0 2023-10-18T20:58:42.747 INFO:tasks.workunit.client.0.smithi008.stdout:5/599: creat d0/d2/d19/d7c/d31/d82/fdc x:0 0 0 2023-10-18T20:58:42.748 INFO:tasks.workunit.client.0.smithi008.stdout:6/665: rmdir df/d15/d48 39 2023-10-18T20:58:42.748 INFO:tasks.workunit.client.0.smithi008.stdout:6/666: write df/f24 [862209,22990] 0 2023-10-18T20:58:42.748 INFO:tasks.workunit.client.0.smithi008.stdout:6/667: chown df/d3c/da2/dcf/d68/l98 1509 1 2023-10-18T20:58:42.748 INFO:tasks.workunit.client.0.smithi008.stdout:6/668: write df/f35 [5112784,3029] 0 2023-10-18T20:58:42.748 INFO:tasks.workunit.client.0.smithi008.stdout:6/669: truncate df/d15/d48/d81/f95 58673 0 2023-10-18T20:58:42.749 INFO:tasks.workunit.client.1.smithi060.stdout:8/744: dread d4/d9/d37/d4e/d6e/d7b/f7d [0,4194304] 0 2023-10-18T20:58:42.750 INFO:tasks.workunit.client.0.smithi008.stdout:8/758: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/f6a [0,4194304] 0 2023-10-18T20:58:42.750 INFO:tasks.workunit.client.0.smithi008.stdout:8/759: write d5/d8/df/d9d/d4d/dba/dd4/d50/f5e [3555428,28992] 0 2023-10-18T20:58:42.750 INFO:tasks.workunit.client.0.smithi008.stdout:8/760: stat d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/lc3 0 2023-10-18T20:58:42.750 INFO:tasks.workunit.client.0.smithi008.stdout:3/667: dwrite d0/d3/d37/d6f/f93 [0,4194304] 0 2023-10-18T20:58:42.755 INFO:tasks.workunit.client.0.smithi008.stdout:0/560: dwrite d0/dd/d19/fa8 [0,4194304] 0 2023-10-18T20:58:42.757 INFO:tasks.workunit.client.0.smithi008.stdout:6/670: link df/l78 df/d15/d48/dbe/le0 0 2023-10-18T20:58:42.760 INFO:tasks.workunit.client.1.smithi060.stdout:2/820: dread d0/d8/d87/fcb [0,4194304] 0 2023-10-18T20:58:42.763 INFO:tasks.workunit.client.0.smithi008.stdout:3/668: dread d0/d4a/d64/f83 [0,4194304] 0 2023-10-18T20:58:42.765 INFO:tasks.workunit.client.1.smithi060.stdout:8/745: creat d4/d9/d31/da6/fe1 x:0 0 0 2023-10-18T20:58:42.769 INFO:tasks.workunit.client.0.smithi008.stdout:4/535: dwrite d0/d17/d5b/d2a/f93 [0,4194304] 0 2023-10-18T20:58:42.769 INFO:tasks.workunit.client.0.smithi008.stdout:4/536: write d0/d58/d8e/f6d [2579102,6901] 0 2023-10-18T20:58:42.770 INFO:tasks.workunit.client.1.smithi060.stdout:6/819: truncate d10/d25/f4f 332814 0 2023-10-18T20:58:42.770 INFO:tasks.workunit.client.1.smithi060.stdout:2/821: unlink d0/d3/d27/d4d/d5e/f74 0 2023-10-18T20:58:42.772 INFO:tasks.workunit.client.0.smithi008.stdout:8/761: unlink d5/f4b 0 2023-10-18T20:58:42.773 INFO:tasks.workunit.client.0.smithi008.stdout:5/600: dread d0/f29 [4194304,4194304] 0 2023-10-18T20:58:42.773 INFO:tasks.workunit.client.0.smithi008.stdout:8/762: truncate d5/d8/df/d9d/d4d/f98 979933 0 2023-10-18T20:58:42.773 INFO:tasks.workunit.client.0.smithi008.stdout:5/601: fsync d0/f1c 0 2023-10-18T20:58:42.774 INFO:tasks.workunit.client.0.smithi008.stdout:5/602: chown d0/d2/d9/l17 0 1 2023-10-18T20:58:42.774 INFO:tasks.workunit.client.0.smithi008.stdout:5/603: write d0/d2/f23 [9326029,62320] 0 2023-10-18T20:58:42.774 INFO:tasks.workunit.client.0.smithi008.stdout:6/671: read df/d15/f16 [3040984,21576] 0 2023-10-18T20:58:42.775 INFO:tasks.workunit.client.0.smithi008.stdout:2/629: dwrite d1/d3/dd/d1c/f55 [0,4194304] 0 2023-10-18T20:58:42.775 INFO:tasks.workunit.client.0.smithi008.stdout:3/669: mknod d0/d3/d37/cd7 0 2023-10-18T20:58:42.775 INFO:tasks.workunit.client.1.smithi060.stdout:2/822: symlink d0/d3/d9e/dc2/l113 0 2023-10-18T20:58:42.778 INFO:tasks.workunit.client.1.smithi060.stdout:4/726: dread d4/dc/d2a/d31/f97 [0,4194304] 0 2023-10-18T20:58:42.779 INFO:tasks.workunit.client.0.smithi008.stdout:4/537: rename d0/d58/d8e/f7f to d0/d3/d21/d57/d8f/d73/fb0 0 2023-10-18T20:58:42.779 INFO:tasks.workunit.client.1.smithi060.stdout:2/823: mkdir d0/d3/d9e/d114 0 2023-10-18T20:58:42.782 INFO:tasks.workunit.client.0.smithi008.stdout:8/763: mknod d5/d8/df/d9d/d6c/c112 0 2023-10-18T20:58:42.782 INFO:tasks.workunit.client.0.smithi008.stdout:6/672: mknod df/d26/ce1 0 2023-10-18T20:58:42.782 INFO:tasks.workunit.client.0.smithi008.stdout:6/673: chown df/l78 96010129 1 2023-10-18T20:58:42.785 INFO:tasks.workunit.client.1.smithi060.stdout:4/727: rename d4/d91/ld4 to d4/dc/d2a/d31/le4 0 2023-10-18T20:58:42.786 INFO:tasks.workunit.client.1.smithi060.stdout:4/728: chown d4/dc/d2a/d13/d33/cbf 24 1 2023-10-18T20:58:42.786 INFO:tasks.workunit.client.0.smithi008.stdout:5/604: symlink d0/d2/d9/d34/ldd 0 2023-10-18T20:58:42.792 INFO:tasks.workunit.client.1.smithi060.stdout:4/729: rmdir d4/dc/d2a/d2d/d69/d89 39 2023-10-18T20:58:42.792 INFO:tasks.workunit.client.1.smithi060.stdout:3/751: dwrite d0/d22/d50/f53 [0,4194304] 0 2023-10-18T20:58:42.799 INFO:tasks.workunit.client.0.smithi008.stdout:4/538: rename d0/d3/f64 to d0/d3/d21/d57/d8f/d82/fb1 0 2023-10-18T20:58:42.799 INFO:tasks.workunit.client.0.smithi008.stdout:3/670: rename d0/d3/de/d13/d35/d51 to d0/d3/de/d13/d35/d51/dd8 22 2023-10-18T20:58:42.799 INFO:tasks.workunit.client.0.smithi008.stdout:4/539: dread - d0/d74/fa9 zero size 2023-10-18T20:58:42.800 INFO:tasks.workunit.client.1.smithi060.stdout:3/752: link d0/f1c d0/d22/d26/d8c/f104 0 2023-10-18T20:58:42.800 INFO:tasks.workunit.client.1.smithi060.stdout:7/882: dwrite de/d14/fed [0,4194304] 0 2023-10-18T20:58:42.801 INFO:tasks.workunit.client.1.smithi060.stdout:7/883: chown de/d14/d3a/d46/dab 601 1 2023-10-18T20:58:42.802 INFO:tasks.workunit.client.1.smithi060.stdout:6/820: dread d10/d3e/f71 [0,4194304] 0 2023-10-18T20:58:42.802 INFO:tasks.workunit.client.1.smithi060.stdout:6/821: truncate d10/d47/f91 4221904 0 2023-10-18T20:58:42.803 INFO:tasks.workunit.client.1.smithi060.stdout:6/822: stat d10/d47/d92/d79 0 2023-10-18T20:58:42.803 INFO:tasks.workunit.client.1.smithi060.stdout:6/823: write d10/d17/d7a/f94 [668299,94714] 0 2023-10-18T20:58:42.805 INFO:tasks.workunit.client.0.smithi008.stdout:9/539: sync 2023-10-18T20:58:42.806 INFO:tasks.workunit.client.0.smithi008.stdout:9/540: write d2/dc/d17/d19/d4a/f9b [277968,51793] 0 2023-10-18T20:58:42.807 INFO:tasks.workunit.client.0.smithi008.stdout:6/674: getdents df/d3c/d77 0 2023-10-18T20:58:42.808 INFO:tasks.workunit.client.0.smithi008.stdout:6/675: chown df/d15/f46 146 1 2023-10-18T20:58:42.808 INFO:tasks.workunit.client.0.smithi008.stdout:9/541: truncate d2/dc/d40/d6f/d92/d59/f66 4477531 0 2023-10-18T20:58:42.808 INFO:tasks.workunit.client.0.smithi008.stdout:6/676: truncate df/d3c/d77/da9/f5a 4293757 0 2023-10-18T20:58:42.809 INFO:tasks.workunit.client.1.smithi060.stdout:7/884: link de/d38/f11c de/d14/d49/d68/d7d/d7e/db5/f120 0 2023-10-18T20:58:42.818 INFO:tasks.workunit.client.1.smithi060.stdout:6/824: rename d10/d17/dae/fd0 to d10/d47/d92/d79/f101 0 2023-10-18T20:58:42.821 INFO:tasks.workunit.client.0.smithi008.stdout:7/676: dread d1/da6/d4f/f5e [0,4194304] 0 2023-10-18T20:58:42.823 INFO:tasks.workunit.client.0.smithi008.stdout:8/764: dread d5/d8/df/f39 [0,4194304] 0 2023-10-18T20:58:42.831 INFO:tasks.workunit.client.1.smithi060.stdout:2/824: dread d0/f10 [0,4194304] 0 2023-10-18T20:58:42.832 INFO:tasks.workunit.client.1.smithi060.stdout:7/885: read de/d14/d2f/d8f/d5b/d9e/fd1 [820631,56370] 0 2023-10-18T20:58:42.834 INFO:tasks.workunit.client.1.smithi060.stdout:2/825: symlink d0/d45/d49/d6e/d79/d6c/l115 0 2023-10-18T20:58:42.837 INFO:tasks.workunit.client.1.smithi060.stdout:0/781: dwrite d3/ff5 [0,4194304] 0 2023-10-18T20:58:42.840 INFO:tasks.workunit.client.1.smithi060.stdout:9/729: sync 2023-10-18T20:58:42.847 INFO:tasks.workunit.client.1.smithi060.stdout:7/886: mknod de/d14/d2f/d3f/c121 0 2023-10-18T20:58:42.848 INFO:tasks.workunit.client.1.smithi060.stdout:0/782: creat d3/d8/d14/ff8 x:0 0 0 2023-10-18T20:58:42.851 INFO:tasks.workunit.client.0.smithi008.stdout:8/765: rename d5/d8/df/d9d/d4d/dba/dd4/d50/fea to d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/f113 0 2023-10-18T20:58:42.855 INFO:tasks.workunit.client.1.smithi060.stdout:3/753: dread d0/d22/d26/d79/ff6 [0,4194304] 0 2023-10-18T20:58:42.858 INFO:tasks.workunit.client.1.smithi060.stdout:6/825: dread d10/d17/d28/f26 [0,4194304] 0 2023-10-18T20:58:42.859 INFO:tasks.workunit.client.1.smithi060.stdout:5/807: dwrite d0/d6/f11f [0,4194304] 0 2023-10-18T20:58:42.878 INFO:tasks.workunit.client.0.smithi008.stdout:2/630: dwrite d1/d3/d40/d6e/f78 [0,4194304] 0 2023-10-18T20:58:42.884 INFO:tasks.workunit.client.0.smithi008.stdout:7/677: rmdir d1/d36/d3d/d3e/d59 39 2023-10-18T20:58:42.894 INFO:tasks.workunit.client.0.smithi008.stdout:8/766: dread d5/f15 [0,4194304] 0 2023-10-18T20:58:42.898 INFO:tasks.workunit.client.1.smithi060.stdout:4/730: write d4/d15/d2b/f59 [7191321,29614] 0 2023-10-18T20:58:42.898 INFO:tasks.workunit.client.1.smithi060.stdout:4/731: chown d4/dc/d2a/d31/f46 37106056 1 2023-10-18T20:58:42.899 INFO:tasks.workunit.client.0.smithi008.stdout:7/678: dread d1/d36/d3d/d3e/f31 [0,4194304] 0 2023-10-18T20:58:42.899 INFO:tasks.workunit.client.1.smithi060.stdout:8/746: dwrite d4/d9/f83 [0,4194304] 0 2023-10-18T20:58:42.900 INFO:tasks.workunit.client.1.smithi060.stdout:8/747: fsync d4/d9/d31/d35/d9f/da3/fa5 0 2023-10-18T20:58:42.900 INFO:tasks.workunit.client.1.smithi060.stdout:8/748: read - d4/d9/d31/d35/f82 zero size 2023-10-18T20:58:42.901 INFO:tasks.workunit.client.1.smithi060.stdout:6/826: write d10/d17/d54/f5a [3731700,74777] 0 2023-10-18T20:58:42.902 INFO:tasks.workunit.client.0.smithi008.stdout:2/631: write d1/d3/f4b [3535146,85800] 0 2023-10-18T20:58:42.903 INFO:tasks.workunit.client.0.smithi008.stdout:9/542: write d2/dc/f22 [7783302,30222] 0 2023-10-18T20:58:42.904 INFO:tasks.workunit.client.0.smithi008.stdout:6/677: symlink df/d15/d27/le2 0 2023-10-18T20:58:42.906 INFO:tasks.workunit.client.0.smithi008.stdout:2/632: truncate d1/f18 1210526 0 2023-10-18T20:58:42.909 INFO:tasks.workunit.client.0.smithi008.stdout:9/543: symlink d2/d64/l9c 0 2023-10-18T20:58:42.909 INFO:tasks.workunit.client.0.smithi008.stdout:8/767: getdents d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95 0 2023-10-18T20:58:42.909 INFO:tasks.workunit.client.0.smithi008.stdout:6/678: mknod df/d3c/da2/dcf/d3f/dcd/ce3 0 2023-10-18T20:58:42.910 INFO:tasks.workunit.client.1.smithi060.stdout:8/749: mknod d4/d9/d37/d4e/d6e/ce2 0 2023-10-18T20:58:42.910 INFO:tasks.workunit.client.1.smithi060.stdout:6/827: mkdir d10/d17/d28/d102 0 2023-10-18T20:58:42.910 INFO:tasks.workunit.client.1.smithi060.stdout:6/828: chown d10/d25/cec 265172360 1 2023-10-18T20:58:42.913 INFO:tasks.workunit.client.0.smithi008.stdout:9/544: getdents d2/dc/d40/d6f/d92 0 2023-10-18T20:58:42.914 INFO:tasks.workunit.client.0.smithi008.stdout:6/679: creat df/d15/d5e/fe4 x:0 0 0 2023-10-18T20:58:42.916 INFO:tasks.workunit.client.0.smithi008.stdout:8/768: symlink d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/dbf/l114 0 2023-10-18T20:58:42.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.918+0000 7f2e7fb07700 1 -- 172.21.15.8:0/3583777921 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e78062420 con 0x7f2e64061020 2023-10-18T20:58:42.921 INFO:tasks.workunit.client.0.smithi008.stdout:9/545: unlink d2/f3 0 2023-10-18T20:58:42.922 INFO:tasks.workunit.client.0.smithi008.stdout:2/633: dread d1/d3/dd/d25/f47 [0,4194304] 0 2023-10-18T20:58:42.922 INFO:tasks.workunit.client.0.smithi008.stdout:6/680: symlink df/d3c/d77/d50/le5 0 2023-10-18T20:58:42.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.921+0000 7f2e6e7fc700 1 -- 172.21.15.8:0/3583777921 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f2e6800f040 con 0x7f2e64061020 2023-10-18T20:58:42.926 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:58:42.926 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T20:58:42.926 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T20:58:42.927 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T20:58:42.927 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T20:58:42.927 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T20:58:42.927 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T20:58:42.927 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "2/21 daemons upgraded", 2023-10-18T20:58:42.928 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mgr daemons", 2023-10-18T20:58:42.928 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T20:58:42.928 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:58:42.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.924+0000 7f2e7fb07700 1 -- 172.21.15.8:0/3583777921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e64061020 msgr2=0x7f2e640634e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:42.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.924+0000 7f2e7fb07700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e64061020 0x7f2e640634e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2e780600e0 tx=0x7f2e6800b040).stop 2023-10-18T20:58:42.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.924+0000 7f2e7fb07700 1 -- 172.21.15.8:0/3583777921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e78060310 msgr2=0x7f2e7810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:58:42.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.924+0000 7f2e7fb07700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e78060310 0x7f2e7810f600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f2e74009f50 tx=0x7f2e74009b30).stop 2023-10-18T20:58:42.930 INFO:tasks.workunit.client.0.smithi008.stdout:8/769: creat d5/d8/df/d9d/d4d/dba/dd4/d50/f115 x:0 0 0 2023-10-18T20:58:42.930 INFO:tasks.workunit.client.0.smithi008.stdout:9/546: symlink d2/dc/d1a/d1d/l9d 0 2023-10-18T20:58:42.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.924+0000 7f2e7fb07700 1 -- 172.21.15.8:0/3583777921 shutdown_connections 2023-10-18T20:58:42.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.924+0000 7f2e7fb07700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e64061020 0x7f2e640634e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:42.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.924+0000 7f2e7fb07700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e78060310 0x7f2e7810f600 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:42.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.924+0000 7f2e7fb07700 1 --2- 172.21.15.8:0/3583777921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e780f96c0 0x7f2e7810faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:58:42.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.924+0000 7f2e7fb07700 1 -- 172.21.15.8:0/3583777921 >> 172.21.15.8:0/3583777921 conn(0x7f2e780f0bc0 msgr2=0x7f2e780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:58:42.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.925+0000 7f2e7fb07700 1 -- 172.21.15.8:0/3583777921 shutdown_connections 2023-10-18T20:58:42.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:58:42.925+0000 7f2e7fb07700 1 -- 172.21.15.8:0/3583777921 wait complete. 2023-10-18T20:58:42.933 INFO:tasks.workunit.client.0.smithi008.stdout:2/634: rename d1/d3/dd/d25/d76/lca to d1/d3/dd/d25/d5c/lcd 0 2023-10-18T20:58:42.933 INFO:tasks.workunit.client.0.smithi008.stdout:2/635: chown d1/d3/d40/d6e/d7e/cb5 0 1 2023-10-18T20:58:42.934 INFO:tasks.workunit.client.0.smithi008.stdout:5/605: dwrite d0/d2/d19/d7c/d64/f7e [0,4194304] 0 2023-10-18T20:58:42.937 INFO:tasks.workunit.client.0.smithi008.stdout:8/770: rename d5/d8/df/d9d/d4d/db5/c87 to d5/c116 0 2023-10-18T20:58:42.938 INFO:tasks.workunit.client.0.smithi008.stdout:9/547: creat d2/dc/d40/d6f/d92/f9e x:0 0 0 2023-10-18T20:58:42.938 INFO:tasks.workunit.client.0.smithi008.stdout:6/681: creat df/dd1/fe6 x:0 0 0 2023-10-18T20:58:42.941 INFO:tasks.workunit.client.0.smithi008.stdout:5/606: symlink d0/d2/d19/d7c/d58/d65/lde 0 2023-10-18T20:58:42.943 INFO:tasks.workunit.client.1.smithi060.stdout:4/732: read d4/dc/f58 [6531764,12018] 0 2023-10-18T20:58:42.947 INFO:tasks.workunit.client.1.smithi060.stdout:8/750: read d4/d9/f79 [2797770,50439] 0 2023-10-18T20:58:42.947 INFO:tasks.workunit.client.1.smithi060.stdout:2/826: dwrite d0/d45/dc9/d4a/fcf [0,4194304] 0 2023-10-18T20:58:42.950 INFO:tasks.workunit.client.1.smithi060.stdout:4/733: getdents d4/d15/d2b 0 2023-10-18T20:58:42.950 INFO:tasks.workunit.client.1.smithi060.stdout:8/751: mkdir d4/d9/d37/d4e/d6e/de3 0 2023-10-18T20:58:42.951 INFO:tasks.workunit.client.1.smithi060.stdout:4/734: mkdir d4/dc/d2a/d39/d53/d76/da7/dca/de5 0 2023-10-18T20:58:42.951 INFO:tasks.workunit.client.1.smithi060.stdout:4/735: write d4/d15/d2b/f86 [734114,95355] 0 2023-10-18T20:58:42.956 INFO:tasks.workunit.client.1.smithi060.stdout:4/736: getdents d4/d15 0 2023-10-18T20:58:42.956 INFO:tasks.workunit.client.1.smithi060.stdout:8/752: truncate d4/f30 3841806 0 2023-10-18T20:58:42.957 INFO:tasks.workunit.client.0.smithi008.stdout:5/607: dread d0/d2/d19/f33 [0,4194304] 0 2023-10-18T20:58:42.959 INFO:tasks.workunit.client.1.smithi060.stdout:3/754: dwrite d0/d5e/fd4 [0,4194304] 0 2023-10-18T20:58:42.959 INFO:tasks.workunit.client.1.smithi060.stdout:8/753: link d4/d9/d4f/d74/c76 d4/d9/d31/d6f/dbd/ce4 0 2023-10-18T20:58:42.959 INFO:tasks.workunit.client.1.smithi060.stdout:3/755: dread - d0/d22/d26/d29/dae/de4/fe6 zero size 2023-10-18T20:58:42.960 INFO:tasks.workunit.client.0.smithi008.stdout:6/682: link df/d3c/d77/da9/cd0 df/d3c/da2/dcf/d3f/ce7 0 2023-10-18T20:58:42.960 INFO:tasks.workunit.client.0.smithi008.stdout:6/683: chown df/d15/d48/d81/f96 2066 1 2023-10-18T20:58:42.960 INFO:tasks.workunit.client.0.smithi008.stdout:8/771: mkdir d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/d117 0 2023-10-18T20:58:42.961 INFO:tasks.workunit.client.1.smithi060.stdout:8/754: mkdir d4/d9/d4f/d74/de5 0 2023-10-18T20:58:42.961 INFO:tasks.workunit.client.1.smithi060.stdout:8/755: creat d4/d9/d88/fe6 x:0 0 0 2023-10-18T20:58:42.961 INFO:tasks.workunit.client.1.smithi060.stdout:8/756: chown d4/d9/d31/d35/d9f 26 1 2023-10-18T20:58:42.962 INFO:tasks.workunit.client.1.smithi060.stdout:8/757: truncate d4/ff 3931774 0 2023-10-18T20:58:42.962 INFO:tasks.workunit.client.1.smithi060.stdout:1/934: sync 2023-10-18T20:58:42.963 INFO:tasks.workunit.client.1.smithi060.stdout:1/935: readlink d4/d38/d11f/l2b 0 2023-10-18T20:58:42.963 INFO:tasks.workunit.client.1.smithi060.stdout:3/756: symlink d0/d22/d26/d29/dae/de4/l105 0 2023-10-18T20:58:42.963 INFO:tasks.workunit.client.0.smithi008.stdout:5/608: write d0/d2/d9/f54 [100560,33703] 0 2023-10-18T20:58:42.964 INFO:tasks.workunit.client.1.smithi060.stdout:8/758: symlink d4/d9/d31/d35/d9f/da3/ddb/le7 0 2023-10-18T20:58:42.965 INFO:tasks.workunit.client.0.smithi008.stdout:3/671: dwrite d0/d3/de/d13/d35/d51/fbe [0,4194304] 0 2023-10-18T20:58:42.965 INFO:tasks.workunit.client.1.smithi060.stdout:3/757: mkdir d0/d22/d26/d106 0 2023-10-18T20:58:42.967 INFO:tasks.workunit.client.0.smithi008.stdout:4/540: dwrite d0/d17/d5b/d2a/f3c [0,4194304] 0 2023-10-18T20:58:42.968 INFO:tasks.workunit.client.0.smithi008.stdout:4/541: fsync d0/d17/d5b/d45/f92 0 2023-10-18T20:58:42.968 INFO:tasks.workunit.client.0.smithi008.stdout:4/542: dread - d0/d17/d5b/faa zero size 2023-10-18T20:58:42.968 INFO:tasks.workunit.client.0.smithi008.stdout:8/772: truncate d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/dbf/ff7 238530 0 2023-10-18T20:58:42.969 INFO:tasks.workunit.client.0.smithi008.stdout:6/684: unlink df/d15/d48/d4b/c5b 0 2023-10-18T20:58:42.971 INFO:tasks.workunit.client.1.smithi060.stdout:3/758: write d0/d3c/d3d/fb5 [305124,10731] 0 2023-10-18T20:58:42.971 INFO:tasks.workunit.client.1.smithi060.stdout:3/759: dread - d0/d22/d26/fc1 zero size 2023-10-18T20:58:42.971 INFO:tasks.workunit.client.1.smithi060.stdout:3/760: chown d0/d3c/d3d/f59 198490925 1 2023-10-18T20:58:42.972 INFO:tasks.workunit.client.0.smithi008.stdout:5/609: creat d0/d2/d19/d7c/d31/d3f/fdf x:0 0 0 2023-10-18T20:58:42.975 INFO:tasks.workunit.client.1.smithi060.stdout:3/761: symlink d0/d22/d26/d29/dae/de4/l107 0 2023-10-18T20:58:42.976 INFO:tasks.workunit.client.1.smithi060.stdout:3/762: chown d0/d22/d26/c5f 97 1 2023-10-18T20:58:42.976 INFO:tasks.workunit.client.0.smithi008.stdout:3/672: unlink d0/d3/fa3 0 2023-10-18T20:58:42.976 INFO:tasks.workunit.client.0.smithi008.stdout:3/673: write d0/d3/da9/fb6 [326591,52223] 0 2023-10-18T20:58:42.977 INFO:tasks.workunit.client.0.smithi008.stdout:3/674: truncate d0/d3/de/d13/d35/dbf/faf 1036904 0 2023-10-18T20:58:42.977 INFO:tasks.workunit.client.0.smithi008.stdout:3/675: fsync d0/d3/de/d13/f75 0 2023-10-18T20:58:42.977 INFO:tasks.workunit.client.0.smithi008.stdout:3/676: truncate d0/d84/fcd 862446 0 2023-10-18T20:58:42.980 INFO:tasks.workunit.client.0.smithi008.stdout:4/543: chown d0/d17/c30 13347225 1 2023-10-18T20:58:42.983 INFO:tasks.workunit.client.0.smithi008.stdout:5/610: dread d0/d2/d9/d9b/d62/fac [0,4194304] 0 2023-10-18T20:58:42.984 INFO:tasks.workunit.client.0.smithi008.stdout:3/677: mknod d0/d3/d42/d88/dae/cd9 0 2023-10-18T20:58:42.984 INFO:tasks.workunit.client.0.smithi008.stdout:3/678: write d0/d3/de/d13/f24 [989989,67964] 0 2023-10-18T20:58:42.994 INFO:tasks.workunit.client.1.smithi060.stdout:5/808: dwrite d0/f2c [0,4194304] 0 2023-10-18T20:58:42.995 INFO:tasks.workunit.client.1.smithi060.stdout:4/737: write d4/d15/f48 [898449,123530] 0 2023-10-18T20:58:42.997 INFO:tasks.workunit.client.1.smithi060.stdout:4/738: truncate d4/dc/f5e 803611 0 2023-10-18T20:58:42.998 INFO:tasks.workunit.client.1.smithi060.stdout:4/739: read d4/d15/f45 [2749264,97306] 0 2023-10-18T20:58:42.998 INFO:tasks.workunit.client.1.smithi060.stdout:4/740: fdatasync d4/dc/d2a/d5b/fa0 0 2023-10-18T20:58:42.999 INFO:tasks.workunit.client.1.smithi060.stdout:0/783: dwrite d3/d80/fa7 [0,4194304] 0 2023-10-18T20:58:43.002 INFO:tasks.workunit.client.1.smithi060.stdout:4/741: rename d4/d15/f51 to d4/dc/d40/d80/daf/fe6 0 2023-10-18T20:58:43.003 INFO:tasks.workunit.client.1.smithi060.stdout:7/887: write de/d38/d78/fbf [1021858,7531] 0 2023-10-18T20:58:43.007 INFO:tasks.workunit.client.1.smithi060.stdout:0/784: chown d3/d8/d3c/d87/dba 2891 1 2023-10-18T20:58:43.007 INFO:tasks.workunit.client.1.smithi060.stdout:0/785: chown d3/d80/l8b 0 1 2023-10-18T20:58:43.010 INFO:tasks.workunit.client.1.smithi060.stdout:4/742: symlink d4/dc/d2a/d39/d53/d65/d8d/le7 0 2023-10-18T20:58:43.013 INFO:tasks.workunit.client.1.smithi060.stdout:6/829: dwrite d10/d17/d28/f68 [0,4194304] 0 2023-10-18T20:58:43.013 INFO:tasks.workunit.client.1.smithi060.stdout:7/888: symlink de/d14/d49/da3/l122 0 2023-10-18T20:58:43.014 INFO:tasks.workunit.client.1.smithi060.stdout:0/786: unlink d3/d8/d14/d55/d74/d76/fa2 0 2023-10-18T20:58:43.018 INFO:tasks.workunit.client.0.smithi008.stdout:7/679: dwrite d1/da6/d4f/dc9/fcd [0,4194304] 0 2023-10-18T20:58:43.018 INFO:tasks.workunit.client.0.smithi008.stdout:9/548: dread d2/dc/f4e [0,4194304] 0 2023-10-18T20:58:43.018 INFO:tasks.workunit.client.0.smithi008.stdout:9/549: dread - d2/dc/d3d/f8d zero size 2023-10-18T20:58:43.019 INFO:tasks.workunit.client.1.smithi060.stdout:7/889: creat de/d29/d9c/db1/f123 x:0 0 0 2023-10-18T20:58:43.019 INFO:tasks.workunit.client.1.smithi060.stdout:6/830: mkdir d10/d47/d92/dab/dfe/d103 0 2023-10-18T20:58:43.021 INFO:tasks.workunit.client.0.smithi008.stdout:6/685: dread df/d3c/da2/dcf/d3f/f8e [0,4194304] 0 2023-10-18T20:58:43.022 INFO:tasks.workunit.client.1.smithi060.stdout:0/787: creat d3/de5/df1/dc3/ff9 x:0 0 0 2023-10-18T20:58:43.023 INFO:tasks.workunit.client.1.smithi060.stdout:7/890: mknod de/d14/d2f/d8f/d5b/c124 0 2023-10-18T20:58:43.023 INFO:tasks.workunit.client.1.smithi060.stdout:7/891: fsync de/d14/d49/d68/d7d/d7e/db5/fc7 0 2023-10-18T20:58:43.023 INFO:tasks.workunit.client.1.smithi060.stdout:6/831: link d10/d2e/f4e d10/d47/f104 0 2023-10-18T20:58:43.026 INFO:tasks.workunit.client.1.smithi060.stdout:0/788: creat d3/d8/d14/d55/d74/ffa x:0 0 0 2023-10-18T20:58:43.029 INFO:tasks.workunit.client.0.smithi008.stdout:4/544: write d0/d58/d83/f89 [2486851,73328] 0 2023-10-18T20:58:43.029 INFO:tasks.workunit.client.1.smithi060.stdout:7/892: unlink de/d14/d2f/dd3/f10a 0 2023-10-18T20:58:43.030 INFO:tasks.workunit.client.1.smithi060.stdout:7/893: read - de/d14/d49/d68/d88/fdf zero size 2023-10-18T20:58:43.031 INFO:tasks.workunit.client.1.smithi060.stdout:6/832: unlink d10/d2e/d75/dc4/fa8 0 2023-10-18T20:58:43.031 INFO:tasks.workunit.client.1.smithi060.stdout:6/833: truncate d10/d3e/f71 5088274 0 2023-10-18T20:58:43.031 INFO:tasks.workunit.client.1.smithi060.stdout:6/834: chown d10/d17/d7a/lff 250 1 2023-10-18T20:58:43.031 INFO:tasks.workunit.client.1.smithi060.stdout:6/835: stat d10/d47/d92/f61 0 2023-10-18T20:58:43.032 INFO:tasks.workunit.client.1.smithi060.stdout:6/836: chown d10/d17/d28 0 1 2023-10-18T20:58:43.032 INFO:tasks.workunit.client.0.smithi008.stdout:1/696: sync 2023-10-18T20:58:43.032 INFO:tasks.workunit.client.0.smithi008.stdout:1/697: write d9/de/fb0 [4989339,5209] 0 2023-10-18T20:58:43.033 INFO:tasks.workunit.client.1.smithi060.stdout:0/789: creat d3/de5/ffb x:0 0 0 2023-10-18T20:58:43.034 INFO:tasks.workunit.client.1.smithi060.stdout:7/894: mkdir de/d14/d41/d125 0 2023-10-18T20:58:43.035 INFO:tasks.workunit.client.1.smithi060.stdout:7/895: creat de/d14/d49/f126 x:0 0 0 2023-10-18T20:58:43.035 INFO:tasks.workunit.client.1.smithi060.stdout:7/896: dread - de/d14/d49/d68/fef zero size 2023-10-18T20:58:43.037 INFO:tasks.workunit.client.1.smithi060.stdout:1/936: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/fd3 [8388608,4194304] 0 2023-10-18T20:58:43.038 INFO:tasks.workunit.client.1.smithi060.stdout:2/827: dwrite d0/d45/dc9/f44 [0,4194304] 0 2023-10-18T20:58:43.040 INFO:tasks.workunit.client.0.smithi008.stdout:8/773: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/dc9/ff2 [0,4194304] 0 2023-10-18T20:58:43.043 INFO:tasks.workunit.client.1.smithi060.stdout:1/937: link d4/d6/f130 d4/d6/d7/d2f/f132 0 2023-10-18T20:58:43.044 INFO:tasks.workunit.client.1.smithi060.stdout:1/938: dread - d4/d6/d7/d2f/f132 zero size 2023-10-18T20:58:43.044 INFO:tasks.workunit.client.1.smithi060.stdout:1/939: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/daa 5429 1 2023-10-18T20:58:43.044 INFO:tasks.workunit.client.1.smithi060.stdout:2/828: unlink d0/d16/d81/da1/c106 0 2023-10-18T20:58:43.047 INFO:tasks.workunit.client.1.smithi060.stdout:3/763: write d0/d3c/d3d/d4d/f8e [82730,62938] 0 2023-10-18T20:58:43.047 INFO:tasks.workunit.client.1.smithi060.stdout:3/764: dread - d0/d5e/ff8 zero size 2023-10-18T20:58:43.048 INFO:tasks.workunit.client.0.smithi008.stdout:7/680: symlink d1/d36/d3d/d3e/d59/ld5 0 2023-10-18T20:58:43.048 INFO:tasks.workunit.client.0.smithi008.stdout:6/686: symlink df/le8 0 2023-10-18T20:58:43.048 INFO:tasks.workunit.client.0.smithi008.stdout:9/550: getdents d2/dc/d40/d6f/d92 0 2023-10-18T20:58:43.048 INFO:tasks.workunit.client.0.smithi008.stdout:9/551: dread - d2/d4d/f67 zero size 2023-10-18T20:58:43.051 INFO:tasks.workunit.client.1.smithi060.stdout:8/759: dwrite d4/d9/d37/f3d [0,4194304] 0 2023-10-18T20:58:43.051 INFO:tasks.workunit.client.1.smithi060.stdout:8/760: chown d4/d9/d4f/f92 22937374 1 2023-10-18T20:58:43.051 INFO:tasks.workunit.client.1.smithi060.stdout:5/809: dread d0/d6/f11f [0,4194304] 0 2023-10-18T20:58:43.052 INFO:tasks.workunit.client.1.smithi060.stdout:5/810: stat d0/da/dc8/de4/d6d 0 2023-10-18T20:58:43.056 INFO:tasks.workunit.client.0.smithi008.stdout:1/698: symlink d9/ld6 0 2023-10-18T20:58:43.056 INFO:tasks.workunit.client.0.smithi008.stdout:7/681: symlink d1/da6/d4f/ld6 0 2023-10-18T20:58:43.056 INFO:tasks.workunit.client.0.smithi008.stdout:6/687: getdents df/d3c/da2/dcf/d7e 0 2023-10-18T20:58:43.058 INFO:tasks.workunit.client.0.smithi008.stdout:6/688: creat df/d26/fe9 x:0 0 0 2023-10-18T20:58:43.058 INFO:tasks.workunit.client.0.smithi008.stdout:6/689: dread - df/dd1/fe6 zero size 2023-10-18T20:58:43.059 INFO:tasks.workunit.client.1.smithi060.stdout:2/829: creat d0/d45/dc9/d102/f116 x:0 0 0 2023-10-18T20:58:43.061 INFO:tasks.workunit.client.1.smithi060.stdout:2/830: symlink d0/d16/ded/l117 0 2023-10-18T20:58:43.061 INFO:tasks.workunit.client.1.smithi060.stdout:8/761: mkdir d4/d9/d4f/d74/d81/de8 0 2023-10-18T20:58:43.062 INFO:tasks.workunit.client.1.smithi060.stdout:2/831: readlink d0/d3/d27/d4d/d5e/d96/lad 0 2023-10-18T20:58:43.063 INFO:tasks.workunit.client.1.smithi060.stdout:8/762: rmdir d4/d9/d4f/d74/d81/de8 0 2023-10-18T20:58:43.067 INFO:tasks.workunit.client.1.smithi060.stdout:6/837: write d10/d47/d92/f22 [2734969,13079] 0 2023-10-18T20:58:43.069 INFO:tasks.workunit.client.0.smithi008.stdout:9/552: write d2/dc/f1c [1641708,126286] 0 2023-10-18T20:58:43.072 INFO:tasks.workunit.client.1.smithi060.stdout:3/765: dread d0/d3c/d3d/d82/fe1 [0,4194304] 0 2023-10-18T20:58:43.072 INFO:tasks.workunit.client.1.smithi060.stdout:3/766: chown d0/f102 10491652 1 2023-10-18T20:58:43.077 INFO:tasks.workunit.client.1.smithi060.stdout:6/838: rename d10/d47/f104 to d10/d3e/d76/f105 0 2023-10-18T20:58:43.077 INFO:tasks.workunit.client.1.smithi060.stdout:8/763: mkdir d4/d9/d31/d35/d9f/da3/ddb/de9 0 2023-10-18T20:58:43.078 INFO:tasks.workunit.client.1.smithi060.stdout:6/839: chown d10/d17/d2f/fa0 7985 1 2023-10-18T20:58:43.078 INFO:tasks.workunit.client.1.smithi060.stdout:6/840: fsync d10/d17/d28/f68 0 2023-10-18T20:58:43.082 INFO:tasks.workunit.client.1.smithi060.stdout:3/767: mknod d0/d3c/d3d/d4d/d95/c108 0 2023-10-18T20:58:43.082 INFO:tasks.workunit.client.1.smithi060.stdout:3/768: unlink d0/d3c/d3d/l85 0 2023-10-18T20:58:43.082 INFO:tasks.workunit.client.1.smithi060.stdout:0/790: write d3/ff5 [1518702,10690] 0 2023-10-18T20:58:43.082 INFO:tasks.workunit.client.1.smithi060.stdout:0/791: truncate d3/d8/d14/d55/d74/d76/d68/d7f/d8d/fd0 907006 0 2023-10-18T20:58:43.083 INFO:tasks.workunit.client.1.smithi060.stdout:8/764: mknod d4/d9/d37/d4e/d6e/dcb/cea 0 2023-10-18T20:58:43.083 INFO:tasks.workunit.client.0.smithi008.stdout:3/679: dwrite d0/d84/fcd [0,4194304] 0 2023-10-18T20:58:43.084 INFO:tasks.workunit.client.1.smithi060.stdout:6/841: mkdir d10/d2e/d75/dc7/d106 0 2023-10-18T20:58:43.096 INFO:tasks.workunit.client.1.smithi060.stdout:3/769: link d0/d5e/l7c d0/d22/d26/d2c/l109 0 2023-10-18T20:58:43.096 INFO:tasks.workunit.client.1.smithi060.stdout:0/792: link d3/de5/ffb d3/d8/d14/d55/d74/d76/d68/d7f/d8d/dbc/ffc 0 2023-10-18T20:58:43.096 INFO:tasks.workunit.client.1.smithi060.stdout:0/793: truncate d3/d80/f82 4556801 0 2023-10-18T20:58:43.096 INFO:tasks.workunit.client.1.smithi060.stdout:8/765: link d4/d9/d4f/l5f d4/d9/d4f/d74/d81/db8/leb 0 2023-10-18T20:58:43.097 INFO:tasks.workunit.client.0.smithi008.stdout:1/699: write d9/de/df/d17/d1e/d7d/f88 [535025,18246] 0 2023-10-18T20:58:43.099 INFO:tasks.workunit.client.1.smithi060.stdout:1/940: dwrite d4/d6/d7/d2f/d7b/d2a/d32/dd/fde [0,4194304] 0 2023-10-18T20:58:43.100 INFO:tasks.workunit.client.1.smithi060.stdout:1/941: fdatasync d4/d6/d7/df/d59/f82 0 2023-10-18T20:58:43.100 INFO:tasks.workunit.client.0.smithi008.stdout:7/682: dread d1/d3/d20/d5f/f72 [4194304,4194304] 0 2023-10-18T20:58:43.101 INFO:tasks.workunit.client.1.smithi060.stdout:1/942: creat d4/da/d42/f133 x:0 0 0 2023-10-18T20:58:43.101 INFO:tasks.workunit.client.1.smithi060.stdout:4/743: dwrite d4/dc/d2a/d5b/f5d [4194304,4194304] 0 2023-10-18T20:58:43.102 INFO:tasks.workunit.client.1.smithi060.stdout:4/744: fdatasync d4/dc/d2a/d39/d53/d76/d99/fb4 0 2023-10-18T20:58:43.102 INFO:tasks.workunit.client.0.smithi008.stdout:7/683: creat d1/da6/d79/db5/fd7 x:0 0 0 2023-10-18T20:58:43.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:42.117084+0000 mgr.smithi008.flmjzp (mgr.14640) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 2.9 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 142 MiB/s rd, 173 MiB/s wr, 259 op/s 2023-10-18T20:58:43.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:42.281973+0000 mon.smithi008 (mon.0) 657 : audit [DBG] from='client.? 172.21.15.8:0/570294736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:58:43.111 INFO:tasks.workunit.client.0.smithi008.stdout:6/690: write df/d15/d48/d81/f95 [881710,27050] 0 2023-10-18T20:58:43.117 INFO:tasks.workunit.client.0.smithi008.stdout:1/700: dread d9/de/df/d17/d1e/d3c/f6f [0,4194304] 0 2023-10-18T20:58:43.117 INFO:tasks.workunit.client.1.smithi060.stdout:2/832: dread d0/d8/f11 [4194304,4194304] 0 2023-10-18T20:58:43.117 INFO:tasks.workunit.client.1.smithi060.stdout:2/833: write d0/f10 [2871506,105359] 0 2023-10-18T20:58:43.118 INFO:tasks.workunit.client.1.smithi060.stdout:7/897: dwrite de/d14/d49/d68/d7d/d7e/fc2 [0,4194304] 0 2023-10-18T20:58:43.119 INFO:tasks.workunit.client.0.smithi008.stdout:7/684: dread d1/d36/d3d/f5a [0,4194304] 0 2023-10-18T20:58:43.120 INFO:tasks.workunit.client.0.smithi008.stdout:7/685: write d1/d36/d3d/fab [4773701,86058] 0 2023-10-18T20:58:43.120 INFO:tasks.workunit.client.0.smithi008.stdout:7/686: chown d1/d36/d3d/d3e/d59/d73/f75 16655 1 2023-10-18T20:58:43.124 INFO:tasks.workunit.client.0.smithi008.stdout:6/691: creat df/d15/d27/d4c/db2/fea x:0 0 0 2023-10-18T20:58:43.124 INFO:tasks.workunit.client.0.smithi008.stdout:6/692: readlink df/d3c/da2/dcf/d7e/lc2 0 2023-10-18T20:58:43.137 INFO:tasks.workunit.client.0.smithi008.stdout:7/687: link d1/d3/d20/f2f d1/da6/d4f/dc9/fd8 0 2023-10-18T20:58:43.140 INFO:tasks.workunit.client.1.smithi060.stdout:7/898: dread de/d14/d49/d68/d7d/d7e/db5/fce [0,4194304] 0 2023-10-18T20:58:43.140 INFO:tasks.workunit.client.1.smithi060.stdout:7/899: chown de/d14/d2f/d3f 3 1 2023-10-18T20:58:43.141 INFO:tasks.workunit.client.1.smithi060.stdout:6/842: rmdir d10/d17/d54/de1 0 2023-10-18T20:58:43.142 INFO:tasks.workunit.client.0.smithi008.stdout:6/693: creat df/d13/daa/dcb/feb x:0 0 0 2023-10-18T20:58:43.143 INFO:tasks.workunit.client.0.smithi008.stdout:6/694: chown df/d19/f4d 33371988 1 2023-10-18T20:58:43.143 INFO:tasks.workunit.client.1.smithi060.stdout:0/794: mknod d3/d32/d86/cfd 0 2023-10-18T20:58:43.143 INFO:tasks.workunit.client.1.smithi060.stdout:0/795: creat d3/d8/d3c/d87/dba/ffe x:0 0 0 2023-10-18T20:58:43.144 INFO:tasks.workunit.client.1.smithi060.stdout:8/766: link d4/d9/d4f/d74/d81/fdd d4/d9/d31/d6f/dbd/fec 0 2023-10-18T20:58:43.144 INFO:tasks.workunit.client.1.smithi060.stdout:8/767: chown d4/d9/l28 167569794 1 2023-10-18T20:58:43.146 INFO:tasks.workunit.client.0.smithi008.stdout:9/553: dwrite d2/dc/f14 [0,4194304] 0 2023-10-18T20:58:43.147 INFO:tasks.workunit.client.1.smithi060.stdout:5/811: dwrite d0/da/d3b/d43/f50 [4194304,4194304] 0 2023-10-18T20:58:43.148 INFO:tasks.workunit.client.0.smithi008.stdout:7/688: mknod d1/d3/d20/d5f/d7f/cd9 0 2023-10-18T20:58:43.150 INFO:tasks.workunit.client.0.smithi008.stdout:9/554: creat d2/dc/d17/d7b/f9f x:0 0 0 2023-10-18T20:58:43.153 INFO:tasks.workunit.client.0.smithi008.stdout:9/555: mkdir d2/d8/da0 0 2023-10-18T20:58:43.153 INFO:tasks.workunit.client.0.smithi008.stdout:9/556: write d2/dc/d40/d6f/d92/d59/f5d [1045070,105851] 0 2023-10-18T20:58:43.155 INFO:tasks.workunit.client.1.smithi060.stdout:3/770: dwrite d0/d5e/ffd [0,4194304] 0 2023-10-18T20:58:43.157 INFO:tasks.workunit.client.0.smithi008.stdout:9/557: mknod d2/dc/d1a/d1d/ca1 0 2023-10-18T20:58:43.165 INFO:tasks.workunit.client.0.smithi008.stdout:7/689: dread d1/d3/fc [0,4194304] 0 2023-10-18T20:58:43.168 INFO:tasks.workunit.client.0.smithi008.stdout:7/690: getdents d1/d36/d3d/d3e/d59 0 2023-10-18T20:58:43.172 INFO:tasks.workunit.client.1.smithi060.stdout:9/730: sync 2023-10-18T20:58:43.173 INFO:tasks.workunit.client.0.smithi008.stdout:3/680: dwrite d0/d3/d37/d74/da2/fb7 [0,4194304] 0 2023-10-18T20:58:43.174 INFO:tasks.workunit.client.0.smithi008.stdout:3/681: stat d0/d3/d37 0 2023-10-18T20:58:43.176 INFO:tasks.workunit.client.1.smithi060.stdout:4/745: mkdir d4/dc/d2a/d13/d27/d68/dc8/de8 0 2023-10-18T20:58:43.180 INFO:tasks.workunit.client.0.smithi008.stdout:3/682: mknod d0/d3/de/d13/d35/dbf/cda 0 2023-10-18T20:58:43.180 INFO:tasks.workunit.client.0.smithi008.stdout:1/701: dwrite d9/de/df/d17/d1e/f71 [0,4194304] 0 2023-10-18T20:58:43.182 INFO:tasks.workunit.client.1.smithi060.stdout:7/900: symlink de/d14/d2f/d8f/d5b/d9e/dac/l127 0 2023-10-18T20:58:43.182 INFO:tasks.workunit.client.1.smithi060.stdout:7/901: chown de/d14/d2f/d8f/d65 1609230 1 2023-10-18T20:58:43.183 INFO:tasks.workunit.client.1.smithi060.stdout:6/843: symlink d10/d17/dae/dbf/l107 0 2023-10-18T20:58:43.183 INFO:tasks.workunit.client.0.smithi008.stdout:3/683: truncate d0/d3/de/d13/d35/d51/fbe 2197688 0 2023-10-18T20:58:43.184 INFO:tasks.workunit.client.0.smithi008.stdout:3/684: chown d0/d4a/fd2 10295 1 2023-10-18T20:58:43.185 INFO:tasks.workunit.client.1.smithi060.stdout:0/796: mknod d3/d8/d14/d55/d74/d76/d68/d7f/cff 0 2023-10-18T20:58:43.188 INFO:tasks.workunit.client.1.smithi060.stdout:8/768: getdents d4/d9 0 2023-10-18T20:58:43.190 INFO:tasks.workunit.client.0.smithi008.stdout:3/685: mknod d0/d3/cdb 0 2023-10-18T20:58:43.190 INFO:tasks.workunit.client.0.smithi008.stdout:3/686: chown d0/d3/f2e 0 1 2023-10-18T20:58:43.192 INFO:tasks.workunit.client.1.smithi060.stdout:2/834: dwrite d0/d45/dc9/f44 [0,4194304] 0 2023-10-18T20:58:43.195 INFO:tasks.workunit.client.1.smithi060.stdout:3/771: chown d0/d3c/c8d 20637 1 2023-10-18T20:58:43.195 INFO:tasks.workunit.client.1.smithi060.stdout:9/731: rename d3/d99/d1c/d2a/d33/f85 to d3/d99/d1c/d2a/d2d/db9/f109 0 2023-10-18T20:58:43.200 INFO:tasks.workunit.client.0.smithi008.stdout:3/687: mknod d0/d84/cdc 0 2023-10-18T20:58:43.202 INFO:tasks.workunit.client.1.smithi060.stdout:2/835: dread d0/d16/d7f/fd8 [0,4194304] 0 2023-10-18T20:58:43.207 INFO:tasks.workunit.client.0.smithi008.stdout:6/695: rename df/d13 to df/d3c/da2/dcf/d58/dec 0 2023-10-18T20:58:43.211 INFO:tasks.workunit.client.1.smithi060.stdout:1/943: rmdir d4/d6 39 2023-10-18T20:58:43.211 INFO:tasks.workunit.client.1.smithi060.stdout:4/746: creat d4/dc/d2a/d39/d53/d65/fe9 x:0 0 0 2023-10-18T20:58:43.211 INFO:tasks.workunit.client.1.smithi060.stdout:4/747: fsync d4/dc/f5e 0 2023-10-18T20:58:43.212 INFO:tasks.workunit.client.1.smithi060.stdout:7/902: creat de/d14/d49/d68/d7d/f128 x:0 0 0 2023-10-18T20:58:43.212 INFO:tasks.workunit.client.1.smithi060.stdout:7/903: read - de/d14/d2f/d3f/d5a/d5f/fe4 zero size 2023-10-18T20:58:43.217 INFO:tasks.workunit.client.1.smithi060.stdout:6/844: link d10/d17/d7a/cf1 d10/d25/d3c/c108 0 2023-10-18T20:58:43.217 INFO:tasks.workunit.client.1.smithi060.stdout:6/845: fsync d10/d17/d28/f24 0 2023-10-18T20:58:43.218 INFO:tasks.workunit.client.1.smithi060.stdout:5/812: rmdir d0/da/d3b/d43 39 2023-10-18T20:58:43.223 INFO:tasks.workunit.client.1.smithi060.stdout:5/813: chown d0/d47 123438453 1 2023-10-18T20:58:43.225 INFO:tasks.workunit.client.1.smithi060.stdout:8/769: unlink d4/d9/d37/d4e/d6e/d7b/fa1 0 2023-10-18T20:58:43.225 INFO:tasks.workunit.client.1.smithi060.stdout:3/772: symlink d0/d3c/d3d/d4d/l10a 0 2023-10-18T20:58:43.225 INFO:tasks.workunit.client.1.smithi060.stdout:9/732: link d3/d99/d19/d54/da5/ccf d3/d99/d1c/c10a 0 2023-10-18T20:58:43.225 INFO:tasks.workunit.client.1.smithi060.stdout:6/846: link d10/l12 d10/d25/l109 0 2023-10-18T20:58:43.225 INFO:tasks.workunit.client.1.smithi060.stdout:6/847: chown d10/d17/d7a/f94 15158 1 2023-10-18T20:58:43.226 INFO:tasks.workunit.client.1.smithi060.stdout:0/797: creat d3/d8/dac/f100 x:0 0 0 2023-10-18T20:58:43.226 INFO:tasks.workunit.client.1.smithi060.stdout:5/814: creat d0/dd/d76/d10f/da5/d67/de7/f124 x:0 0 0 2023-10-18T20:58:43.226 INFO:tasks.workunit.client.1.smithi060.stdout:5/815: chown d0/d6/d8/f44 270902633 1 2023-10-18T20:58:43.229 INFO:tasks.workunit.client.1.smithi060.stdout:8/770: dread d4/d9/d37/f56 [0,4194304] 0 2023-10-18T20:58:43.230 INFO:tasks.workunit.client.1.smithi060.stdout:3/773: rmdir d0/d22/d26 39 2023-10-18T20:58:43.230 INFO:tasks.workunit.client.0.smithi008.stdout:6/696: rename df/d15/d5e to df/d15/d48/ded 0 2023-10-18T20:58:43.230 INFO:tasks.workunit.client.0.smithi008.stdout:6/697: write df/d15/d27/f63 [840623,69237] 0 2023-10-18T20:58:43.231 INFO:tasks.workunit.client.0.smithi008.stdout:6/698: chown df/dd1/fe6 490 1 2023-10-18T20:58:43.233 INFO:tasks.workunit.client.0.smithi008.stdout:9/558: rename d2/dc/d40/d6f/d92/f9e to d2/dc/d17/d7b/fa2 0 2023-10-18T20:58:43.233 INFO:tasks.workunit.client.0.smithi008.stdout:9/559: chown d2/ld 2597648 1 2023-10-18T20:58:43.235 INFO:tasks.workunit.client.1.smithi060.stdout:9/733: link d3/d99/d65/f81 d3/d99/d1c/d2a/d2d/f10b 0 2023-10-18T20:58:43.235 INFO:tasks.workunit.client.1.smithi060.stdout:5/816: mknod d0/d6/d8/df/d27/c125 0 2023-10-18T20:58:43.236 INFO:tasks.workunit.client.1.smithi060.stdout:5/817: write d0/da/d3b/fea [588542,6047] 0 2023-10-18T20:58:43.236 INFO:tasks.workunit.client.1.smithi060.stdout:8/771: rmdir d4/d9 39 2023-10-18T20:58:43.236 INFO:tasks.workunit.client.1.smithi060.stdout:5/818: mkdir d0/dd/dd7/d126 0 2023-10-18T20:58:43.236 INFO:tasks.workunit.client.1.smithi060.stdout:5/819: truncate d0/da/d3b/fea 604807 0 2023-10-18T20:58:43.236 INFO:tasks.workunit.client.1.smithi060.stdout:5/820: chown d0/da/dc8/de4/c45 3 1 2023-10-18T20:58:43.237 INFO:tasks.workunit.client.1.smithi060.stdout:8/772: write d4/d9/d88/fe6 [1040442,11216] 0 2023-10-18T20:58:43.237 INFO:tasks.workunit.client.1.smithi060.stdout:5/821: symlink d0/d47/df2/l127 0 2023-10-18T20:58:43.237 INFO:tasks.workunit.client.1.smithi060.stdout:5/822: stat d0/dd/f5b 0 2023-10-18T20:58:43.237 INFO:tasks.workunit.client.1.smithi060.stdout:8/773: mkdir d4/d9/d88/ded 0 2023-10-18T20:58:43.238 INFO:tasks.workunit.client.1.smithi060.stdout:8/774: write d4/d9/d4f/d74/d81/fc4 [549865,112008] 0 2023-10-18T20:58:43.238 INFO:tasks.workunit.client.1.smithi060.stdout:8/775: stat d4/f25 0 2023-10-18T20:58:43.238 INFO:tasks.workunit.client.1.smithi060.stdout:8/776: chown d4/d9/d37/d4e/d6e/d7b/f7d 6 1 2023-10-18T20:58:43.239 INFO:tasks.workunit.client.1.smithi060.stdout:8/777: unlink d4/d9/d31/da6/fe1 0 2023-10-18T20:58:43.242 INFO:tasks.workunit.client.0.smithi008.stdout:6/699: unlink df/d3c/da2/dcf/d58/dec/d53/d64/lc5 0 2023-10-18T20:58:43.243 INFO:tasks.workunit.client.0.smithi008.stdout:6/700: chown df/d15/d27/dbf 7742 1 2023-10-18T20:58:43.249 INFO:tasks.workunit.client.0.smithi008.stdout:6/701: mkdir df/d3c/da2/dcf/d3f/dcd/dee 0 2023-10-18T20:58:43.251 INFO:tasks.workunit.client.1.smithi060.stdout:3/774: dread d0/f102 [0,4194304] 0 2023-10-18T20:58:43.255 INFO:tasks.workunit.client.1.smithi060.stdout:3/775: symlink d0/d22/d26/d106/l10b 0 2023-10-18T20:58:43.256 INFO:tasks.workunit.client.1.smithi060.stdout:3/776: link d0/d3c/d3d/f7b d0/d22/d26/d29/dae/f10c 0 2023-10-18T20:58:43.257 INFO:tasks.workunit.client.0.smithi008.stdout:6/702: symlink df/d15/d48/dbe/lef 0 2023-10-18T20:58:43.259 INFO:tasks.workunit.client.0.smithi008.stdout:6/703: symlink df/d3c/lf0 0 2023-10-18T20:58:43.262 INFO:tasks.workunit.client.1.smithi060.stdout:4/748: write d4/dc/d2a/d13/d33/f35 [2298206,115662] 0 2023-10-18T20:58:43.262 INFO:tasks.workunit.client.1.smithi060.stdout:4/749: dread - d4/d15/f6e zero size 2023-10-18T20:58:43.262 INFO:tasks.workunit.client.1.smithi060.stdout:4/750: chown d4/dc/d2a/d39/d53/d65/d8d/c93 0 1 2023-10-18T20:58:43.263 INFO:tasks.workunit.client.0.smithi008.stdout:6/704: creat df/d3c/d77/da9/ff1 x:0 0 0 2023-10-18T20:58:43.265 INFO:tasks.workunit.client.0.smithi008.stdout:6/705: unlink df/d3c/da2/la6 0 2023-10-18T20:58:43.271 INFO:tasks.workunit.client.0.smithi008.stdout:6/706: symlink df/d3c/d77/dd6/dd8/lf2 0 2023-10-18T20:58:43.280 INFO:tasks.workunit.client.0.smithi008.stdout:6/707: link df/d3c/d77/da9/cd0 df/d3c/da2/dcf/d58/dec/daa/dcb/cf3 0 2023-10-18T20:58:43.286 INFO:tasks.workunit.client.1.smithi060.stdout:7/904: dread de/d14/d49/d68/f21 [0,4194304] 0 2023-10-18T20:58:43.290 INFO:tasks.workunit.client.1.smithi060.stdout:1/944: dwrite d4/d6/d7/df/d59/fb8 [0,4194304] 0 2023-10-18T20:58:43.290 INFO:tasks.workunit.client.1.smithi060.stdout:1/945: fsync d4/d6/d48/f11d 0 2023-10-18T20:58:43.290 INFO:tasks.workunit.client.1.smithi060.stdout:1/946: chown d4/d6 52424 1 2023-10-18T20:58:43.290 INFO:tasks.workunit.client.1.smithi060.stdout:1/947: stat d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/ca1 0 2023-10-18T20:58:43.298 INFO:tasks.workunit.client.1.smithi060.stdout:0/798: dread d3/d8/f3f [0,4194304] 0 2023-10-18T20:58:43.303 INFO:tasks.workunit.client.1.smithi060.stdout:9/734: dwrite d3/d99/d1c/d25/f74 [4194304,4194304] 0 2023-10-18T20:58:43.304 INFO:tasks.workunit.client.1.smithi060.stdout:9/735: chown d3/d99/d1c/d25/cf7 3964 1 2023-10-18T20:58:43.305 INFO:tasks.workunit.client.0.smithi008.stdout:9/560: dwrite d2/dc/f1e [4194304,4194304] 0 2023-10-18T20:58:43.305 INFO:tasks.workunit.client.0.smithi008.stdout:9/561: write d2/dc/d17/d19/d4a/f68 [676096,32756] 0 2023-10-18T20:58:43.310 INFO:tasks.workunit.client.1.smithi060.stdout:3/777: dread d0/d22/d26/d2c/f62 [0,4194304] 0 2023-10-18T20:58:43.311 INFO:tasks.workunit.client.1.smithi060.stdout:1/948: write d4/d6/d7/d2f/d7b/d2a/d32/dd/fd3 [2462581,130515] 0 2023-10-18T20:58:43.313 INFO:tasks.workunit.client.1.smithi060.stdout:0/799: mknod d3/d8/d14/dec/c101 0 2023-10-18T20:58:43.313 INFO:tasks.workunit.client.0.smithi008.stdout:9/562: unlink d2/d64/c8e 0 2023-10-18T20:58:43.313 INFO:tasks.workunit.client.0.smithi008.stdout:7/691: dwrite d1/d3/f27 [0,4194304] 0 2023-10-18T20:58:43.314 INFO:tasks.workunit.client.0.smithi008.stdout:7/692: chown d1/d3/d20/d5f/d7f/cd9 6526 1 2023-10-18T20:58:43.314 INFO:tasks.workunit.client.0.smithi008.stdout:7/693: creat d1/d3/d20/d5f/d7f/fda x:0 0 0 2023-10-18T20:58:43.315 INFO:tasks.workunit.client.1.smithi060.stdout:9/736: rmdir d3/d99/d1c/d2a/d80/da0/dc2/d9e 39 2023-10-18T20:58:43.315 INFO:tasks.workunit.client.1.smithi060.stdout:9/737: chown d3/d99/d1c/d2a/d80/da0/c108 10612 1 2023-10-18T20:58:43.315 INFO:tasks.workunit.client.1.smithi060.stdout:9/738: write d3/d99/d1c/d2a/f36 [2435842,96046] 0 2023-10-18T20:58:43.315 INFO:tasks.workunit.client.1.smithi060.stdout:9/739: write d3/d58/f95 [716227,11659] 0 2023-10-18T20:58:43.315 INFO:tasks.workunit.client.1.smithi060.stdout:3/778: mkdir d0/d22/d26/d2c/da0/d10d 0 2023-10-18T20:58:43.316 INFO:tasks.workunit.client.0.smithi008.stdout:9/563: unlink d2/dc/d1a/f79 0 2023-10-18T20:58:43.317 INFO:tasks.workunit.client.0.smithi008.stdout:9/564: write d2/dc/d17/d7b/fa2 [43123,51056] 0 2023-10-18T20:58:43.318 INFO:tasks.workunit.client.1.smithi060.stdout:1/949: mkdir d4/da/de0/d134 0 2023-10-18T20:58:43.318 INFO:tasks.workunit.client.1.smithi060.stdout:9/740: symlink d3/d99/d1c/d2a/d80/da0/dc2/d9e/dfd/l10c 0 2023-10-18T20:58:43.319 INFO:tasks.workunit.client.0.smithi008.stdout:7/694: link d1/d36/c70 d1/d36/d3d/d3e/d59/d73/d7b/daf/cdb 0 2023-10-18T20:58:43.319 INFO:tasks.workunit.client.1.smithi060.stdout:8/778: write d4/d9/d31/d35/d9f/fb9 [251770,56923] 0 2023-10-18T20:58:43.320 INFO:tasks.workunit.client.1.smithi060.stdout:7/905: dread de/d38/fad [0,4194304] 0 2023-10-18T20:58:43.321 INFO:tasks.workunit.client.1.smithi060.stdout:4/751: dwrite d4/dc/d2a/d83/db1/f34 [0,4194304] 0 2023-10-18T20:58:43.321 INFO:tasks.workunit.client.1.smithi060.stdout:3/779: getdents d0/d22/d26/d29/dae 0 2023-10-18T20:58:43.325 INFO:tasks.workunit.client.1.smithi060.stdout:8/779: mknod d4/d9/d37/d4e/d6e/d7b/cee 0 2023-10-18T20:58:43.325 INFO:tasks.workunit.client.1.smithi060.stdout:8/780: write d4/d9/d31/d35/d9f/fa0 [211065,80184] 0 2023-10-18T20:58:43.326 INFO:tasks.workunit.client.1.smithi060.stdout:5/823: dwrite d0/da/d3b/fbe [0,4194304] 0 2023-10-18T20:58:43.326 INFO:tasks.workunit.client.1.smithi060.stdout:5/824: chown d0/d47/df2/d10e/f119 110 1 2023-10-18T20:58:43.328 INFO:tasks.workunit.client.1.smithi060.stdout:7/906: rename de/d14/d2f/d3f/d5a/ca1 to de/d14/d3a/d46/dab/d116/c129 0 2023-10-18T20:58:43.331 INFO:tasks.workunit.client.1.smithi060.stdout:3/780: mknod d0/d3c/d3d/d4d/c10e 0 2023-10-18T20:58:43.331 INFO:tasks.workunit.client.1.smithi060.stdout:4/752: creat d4/d15/d2b/fea x:0 0 0 2023-10-18T20:58:43.334 INFO:tasks.workunit.client.1.smithi060.stdout:8/781: unlink d4/d9/d88/fd1 0 2023-10-18T20:58:43.334 INFO:tasks.workunit.client.1.smithi060.stdout:8/782: fdatasync d4/d9/d31/d6f/f8c 0 2023-10-18T20:58:43.334 INFO:tasks.workunit.client.1.smithi060.stdout:8/783: chown d4/d9/d31/d35/f9d 598605 1 2023-10-18T20:58:43.334 INFO:tasks.workunit.client.1.smithi060.stdout:8/784: stat d4/d9/d4f/d74/d81/db8 0 2023-10-18T20:58:43.335 INFO:tasks.workunit.client.1.smithi060.stdout:8/785: write d4/d9/d31/d35/d9f/fc0 [6153,74917] 0 2023-10-18T20:58:43.335 INFO:tasks.workunit.client.1.smithi060.stdout:8/786: dread - d4/d9/d37/d4e/d6e/fd2 zero size 2023-10-18T20:58:43.335 INFO:tasks.workunit.client.1.smithi060.stdout:0/800: write d3/d80/f82 [2534540,14440] 0 2023-10-18T20:58:43.336 INFO:tasks.workunit.client.1.smithi060.stdout:3/781: read d0/d22/f52 [50220,53426] 0 2023-10-18T20:58:43.336 INFO:tasks.workunit.client.1.smithi060.stdout:3/782: creat d0/d22/d50/f10f x:0 0 0 2023-10-18T20:58:43.336 INFO:tasks.workunit.client.1.smithi060.stdout:7/907: unlink de/f19 0 2023-10-18T20:58:43.344 INFO:tasks.workunit.client.1.smithi060.stdout:8/787: link d4/d9/cd0 d4/d9/d31/d35/d9f/da3/ddb/de9/cef 0 2023-10-18T20:58:43.345 INFO:tasks.workunit.client.1.smithi060.stdout:3/783: mknod d0/d3c/d3d/d4d/d95/c110 0 2023-10-18T20:58:43.345 INFO:tasks.workunit.client.1.smithi060.stdout:3/784: chown d0/d22/d26/d2c/da0/cce 0 1 2023-10-18T20:58:43.345 INFO:tasks.workunit.client.1.smithi060.stdout:4/753: write d4/dc/d40/d80/daf/fe6 [1087559,33199] 0 2023-10-18T20:58:43.346 INFO:tasks.workunit.client.1.smithi060.stdout:9/741: dread d3/d99/d1c/d5a/d5d/f88 [0,4194304] 0 2023-10-18T20:58:43.348 INFO:tasks.workunit.client.1.smithi060.stdout:9/742: write d3/d58/f95 [475239,27469] 0 2023-10-18T20:58:43.348 INFO:tasks.workunit.client.1.smithi060.stdout:9/743: truncate d3/d99/d1c/d2a/d2d/fbc 1364730 0 2023-10-18T20:58:43.352 INFO:tasks.workunit.client.0.smithi008.stdout:6/708: dwrite df/d3c/da2/fbd [0,4194304] 0 2023-10-18T20:58:43.352 INFO:tasks.workunit.client.0.smithi008.stdout:9/565: dread d2/dc/d17/d19/d4a/f68 [0,4194304] 0 2023-10-18T20:58:43.354 INFO:tasks.workunit.client.1.smithi060.stdout:7/908: rename de/d14/d2f/d3f/d10c to de/d14/d49/d12a 0 2023-10-18T20:58:43.356 INFO:tasks.workunit.client.1.smithi060.stdout:5/825: dread d0/d6/d8/df/d27/f3c [0,4194304] 0 2023-10-18T20:58:43.359 INFO:tasks.workunit.client.1.smithi060.stdout:9/744: link d3/d99/d1c/d2a/d80/da0/dc2/d9e/dfd/f102 d3/d99/d1c/d2a/d80/da0/ddd/f10d 0 2023-10-18T20:58:43.362 INFO:tasks.workunit.client.1.smithi060.stdout:9/745: rename d3/d99/d1c/d5a/d5d/f88 to d3/d99/d1c/d5a/d5d/d56/dd0/f10e 0 2023-10-18T20:58:43.369 INFO:tasks.workunit.client.1.smithi060.stdout:3/785: dread d0/d22/d26/d29/ff2 [0,4194304] 0 2023-10-18T20:58:43.370 INFO:tasks.workunit.client.1.smithi060.stdout:9/746: truncate d3/d99/d1c/d2a/d2d/db9/f109 2635956 0 2023-10-18T20:58:43.371 INFO:tasks.workunit.client.1.smithi060.stdout:0/801: dread d3/d8/d14/d55/d74/d76/f8a [4194304,4194304] 0 2023-10-18T20:58:43.375 INFO:tasks.workunit.client.1.smithi060.stdout:9/747: mknod d3/d99/d1c/d2a/d2d/db9/c10f 0 2023-10-18T20:58:43.375 INFO:tasks.workunit.client.1.smithi060.stdout:9/748: chown d3/d99/d19/cc9 0 1 2023-10-18T20:58:43.376 INFO:tasks.workunit.client.1.smithi060.stdout:9/749: readlink d3/d99/d19/l3d 0 2023-10-18T20:58:43.376 INFO:tasks.workunit.client.1.smithi060.stdout:8/788: write d4/d9/d31/da6/fac [238975,91421] 0 2023-10-18T20:58:43.381 INFO:tasks.workunit.client.0.smithi008.stdout:2/636: sync 2023-10-18T20:58:43.381 INFO:tasks.workunit.client.0.smithi008.stdout:0/561: sync 2023-10-18T20:58:43.381 INFO:tasks.workunit.client.0.smithi008.stdout:2/637: chown d1/d3/dd/d1c/d3a/d57/f6d 127 1 2023-10-18T20:58:43.381 INFO:tasks.workunit.client.0.smithi008.stdout:0/562: write d0/dd/f8b [251393,39772] 0 2023-10-18T20:58:43.382 INFO:tasks.workunit.client.0.smithi008.stdout:0/563: readlink d0/dd/d19/l96 0 2023-10-18T20:58:43.382 INFO:tasks.workunit.client.0.smithi008.stdout:0/564: fdatasync d0/f14 0 2023-10-18T20:58:43.382 INFO:tasks.workunit.client.0.smithi008.stdout:0/565: truncate d0/d7c/f59 4826543 0 2023-10-18T20:58:43.383 INFO:tasks.workunit.client.0.smithi008.stdout:7/695: dwrite d1/d3/d20/d5f/d7f/fda [0,4194304] 0 2023-10-18T20:58:43.385 INFO:tasks.workunit.client.1.smithi060.stdout:5/826: dread d0/da/dc8/de4/f39 [0,4194304] 0 2023-10-18T20:58:43.386 INFO:tasks.workunit.client.0.smithi008.stdout:6/709: rmdir df/d3c/da2/dcf/d68 39 2023-10-18T20:58:43.386 INFO:tasks.workunit.client.0.smithi008.stdout:2/638: write d1/d3/dd/d25/d5c/f60 [1650051,54222] 0 2023-10-18T20:58:43.388 INFO:tasks.workunit.client.1.smithi060.stdout:9/750: dread d3/d99/d1c/d2a/d2d/db9/fd3 [0,4194304] 0 2023-10-18T20:58:43.389 INFO:tasks.workunit.client.1.smithi060.stdout:8/789: rename d4/d9/d37/ccf to d4/d9/d37/d4e/d6e/cf0 0 2023-10-18T20:58:43.389 INFO:tasks.workunit.client.1.smithi060.stdout:8/790: write d4/d9/d88/fe6 [2021691,101279] 0 2023-10-18T20:58:43.391 INFO:tasks.workunit.client.1.smithi060.stdout:5/827: symlink d0/dd/d76/d10f/da5/d67/d100/l128 0 2023-10-18T20:58:43.395 INFO:tasks.workunit.client.1.smithi060.stdout:8/791: unlink d4/d9/d93/fb5 0 2023-10-18T20:58:43.396 INFO:tasks.workunit.client.0.smithi008.stdout:0/566: creat d0/dd/df/faa x:0 0 0 2023-10-18T20:58:43.396 INFO:tasks.workunit.client.0.smithi008.stdout:0/567: rename d0 to d0/d7c/dab 22 2023-10-18T20:58:43.399 INFO:tasks.workunit.client.1.smithi060.stdout:9/751: rename d3/d99/d19/c3a to d3/d99/d19/d54/c110 0 2023-10-18T20:58:43.400 INFO:tasks.workunit.client.1.smithi060.stdout:5/828: mkdir d0/dd/dd7/d129 0 2023-10-18T20:58:43.400 INFO:tasks.workunit.client.1.smithi060.stdout:0/802: write d3/d8/d14/f40 [1691612,35381] 0 2023-10-18T20:58:43.401 INFO:tasks.workunit.client.1.smithi060.stdout:9/752: symlink d3/d99/d1c/d2a/d80/da0/dc2/d9e/l111 0 2023-10-18T20:58:43.401 INFO:tasks.workunit.client.0.smithi008.stdout:6/710: mknod df/d15/d48/d4b/cf4 0 2023-10-18T20:58:43.402 INFO:tasks.workunit.client.0.smithi008.stdout:6/711: write df/d3c/da2/dcf/d3f/fdf [543968,25440] 0 2023-10-18T20:58:43.405 INFO:tasks.workunit.client.0.smithi008.stdout:2/639: mkdir d1/d3/dd/d25/d76/d59/dce 0 2023-10-18T20:58:43.409 INFO:tasks.workunit.client.1.smithi060.stdout:0/803: link d3/d8/d14/d55/d74/d76/d68/d7f/d8d/dbc/le0 d3/d32/d86/l102 0 2023-10-18T20:58:43.411 INFO:tasks.workunit.client.0.smithi008.stdout:6/712: dread df/d3c/da2/fb4 [0,4194304] 0 2023-10-18T20:58:43.413 INFO:tasks.workunit.client.1.smithi060.stdout:9/753: mkdir d3/d99/d1c/d2a/d80/d112 0 2023-10-18T20:58:43.414 INFO:tasks.workunit.client.1.smithi060.stdout:1/950: dwrite d4/d6/d7/df/d59/fc6 [0,4194304] 0 2023-10-18T20:58:43.417 INFO:tasks.workunit.client.0.smithi008.stdout:8/774: sync 2023-10-18T20:58:43.417 INFO:tasks.workunit.client.0.smithi008.stdout:5/611: sync 2023-10-18T20:58:43.417 INFO:tasks.workunit.client.0.smithi008.stdout:4/545: sync 2023-10-18T20:58:43.417 INFO:tasks.workunit.client.0.smithi008.stdout:4/546: truncate d0/f27 2371307 0 2023-10-18T20:58:43.418 INFO:tasks.workunit.client.0.smithi008.stdout:4/547: chown d0/d3/d21/d57/d8f/la4 625 1 2023-10-18T20:58:43.419 INFO:tasks.workunit.client.0.smithi008.stdout:8/775: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/dc4/f118 x:0 0 0 2023-10-18T20:58:43.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:42.117084+0000 mgr.smithi008.flmjzp (mgr.14640) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 2.9 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 142 MiB/s rd, 173 MiB/s wr, 259 op/s 2023-10-18T20:58:43.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:42.281973+0000 mon.smithi008 (mon.0) 657 : audit [DBG] from='client.? 172.21.15.8:0/570294736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:58:43.423 INFO:tasks.workunit.client.0.smithi008.stdout:8/776: write d5/d8/df/d9d/d4d/db5/f6e [556990,17504] 0 2023-10-18T20:58:43.424 INFO:tasks.workunit.client.0.smithi008.stdout:4/548: symlink d0/d17/d5b/d99/lb2 0 2023-10-18T20:58:43.424 INFO:tasks.workunit.client.0.smithi008.stdout:8/777: creat d5/d8/f119 x:0 0 0 2023-10-18T20:58:43.424 INFO:tasks.workunit.client.0.smithi008.stdout:4/549: symlink d0/d17/d5b/d45/lb3 0 2023-10-18T20:58:43.425 INFO:tasks.workunit.client.1.smithi060.stdout:9/754: creat d3/d99/d1c/f113 x:0 0 0 2023-10-18T20:58:43.425 INFO:tasks.workunit.client.1.smithi060.stdout:9/755: creat d3/d99/d1c/d2a/f114 x:0 0 0 2023-10-18T20:58:43.425 INFO:tasks.workunit.client.0.smithi008.stdout:8/778: fdatasync d5/d8/df/d9d/d4d/dba/f103 0 2023-10-18T20:58:43.428 INFO:tasks.workunit.client.0.smithi008.stdout:8/779: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/f11a x:0 0 0 2023-10-18T20:58:43.430 INFO:tasks.workunit.client.1.smithi060.stdout:5/829: dread d0/d6/d8/df/f57 [0,4194304] 0 2023-10-18T20:58:43.431 INFO:tasks.workunit.client.0.smithi008.stdout:8/780: symlink d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/dbf/l11b 0 2023-10-18T20:58:43.431 INFO:tasks.workunit.client.0.smithi008.stdout:8/781: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/f11c x:0 0 0 2023-10-18T20:58:43.433 INFO:tasks.workunit.client.1.smithi060.stdout:5/830: creat d0/d6/d9/db1/f12a x:0 0 0 2023-10-18T20:58:43.433 INFO:tasks.workunit.client.1.smithi060.stdout:5/831: rmdir d0/d6/d9/d82/d84/db2/d41 39 2023-10-18T20:58:43.435 INFO:tasks.workunit.client.0.smithi008.stdout:3/688: sync 2023-10-18T20:58:43.435 INFO:tasks.workunit.client.0.smithi008.stdout:3/689: read - d0/fac zero size 2023-10-18T20:58:43.436 INFO:tasks.workunit.client.1.smithi060.stdout:5/832: link d0/dd/fcf d0/dd/d76/d10f/da5/f12b 0 2023-10-18T20:58:43.436 INFO:tasks.workunit.client.0.smithi008.stdout:1/702: sync 2023-10-18T20:58:43.436 INFO:tasks.workunit.client.0.smithi008.stdout:1/703: creat d9/de/df/d17/d25/d94/da7/fd7 x:0 0 0 2023-10-18T20:58:43.443 INFO:tasks.workunit.client.0.smithi008.stdout:1/704: mknod d9/de/df/d85/dd3/cd8 0 2023-10-18T20:58:43.445 INFO:tasks.workunit.client.0.smithi008.stdout:3/690: getdents d0/d4a 0 2023-10-18T20:58:43.446 INFO:tasks.workunit.client.0.smithi008.stdout:3/691: fdatasync d0/d3/de/d13/d35/d51/f8d 0 2023-10-18T20:58:43.450 INFO:tasks.workunit.client.0.smithi008.stdout:3/692: mknod d0/d3/d37/cdd 0 2023-10-18T20:58:43.450 INFO:tasks.workunit.client.0.smithi008.stdout:3/693: fdatasync d0/d3/f97 0 2023-10-18T20:58:43.451 INFO:tasks.workunit.client.0.smithi008.stdout:3/694: truncate d0/d3/d42/d52/f6b 4347936 0 2023-10-18T20:58:43.451 INFO:tasks.workunit.client.0.smithi008.stdout:3/695: chown d0/d4a/d64/f83 3399896 1 2023-10-18T20:58:43.451 INFO:tasks.workunit.client.0.smithi008.stdout:3/696: truncate d0/d3/d42/d52/fd4 18349 0 2023-10-18T20:58:43.451 INFO:tasks.workunit.client.0.smithi008.stdout:3/697: chown d0/d3/d37/d6f/c70 2 1 2023-10-18T20:58:43.451 INFO:tasks.workunit.client.0.smithi008.stdout:4/550: dread d0/f13 [0,4194304] 0 2023-10-18T20:58:43.458 INFO:tasks.workunit.client.1.smithi060.stdout:7/909: dwrite de/d14/d2f/d3f/fde [4194304,4194304] 0 2023-10-18T20:58:43.458 INFO:tasks.workunit.client.1.smithi060.stdout:7/910: write de/d14/f30 [2403407,50591] 0 2023-10-18T20:58:43.463 INFO:tasks.workunit.client.0.smithi008.stdout:2/640: dwrite d1/d3/dd/f38 [0,4194304] 0 2023-10-18T20:58:43.463 INFO:tasks.workunit.client.0.smithi008.stdout:2/641: write d1/d3/dd/d25/f2f [202967,21392] 0 2023-10-18T20:58:43.464 INFO:tasks.workunit.client.1.smithi060.stdout:8/792: dwrite d4/d9/f6b [0,4194304] 0 2023-10-18T20:58:43.473 INFO:tasks.workunit.client.0.smithi008.stdout:1/705: mknod d9/de/df/d17/cd9 0 2023-10-18T20:58:43.474 INFO:tasks.workunit.client.0.smithi008.stdout:1/706: creat d9/fda x:0 0 0 2023-10-18T20:58:43.474 INFO:tasks.workunit.client.0.smithi008.stdout:1/707: dread - d9/de/df/d17/d1e/d9a/fbf zero size 2023-10-18T20:58:43.475 INFO:tasks.workunit.client.0.smithi008.stdout:8/782: getdents d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/dc4 0 2023-10-18T20:58:43.476 INFO:tasks.workunit.client.1.smithi060.stdout:7/911: dread de/d14/d2f/d8f/d5b/f74 [0,4194304] 0 2023-10-18T20:58:43.481 INFO:tasks.workunit.client.1.smithi060.stdout:8/793: dread d4/d9/d31/d35/d9f/fc0 [0,4194304] 0 2023-10-18T20:58:43.483 INFO:tasks.workunit.client.0.smithi008.stdout:1/708: truncate d9/de/df/d17/d25/d94/da7/fb2 2399713 0 2023-10-18T20:58:43.484 INFO:tasks.workunit.client.0.smithi008.stdout:1/709: write d9/fcc [4244220,77655] 0 2023-10-18T20:58:43.484 INFO:tasks.workunit.client.1.smithi060.stdout:8/794: rename d4/d9/d31/f8e to d4/d9/d31/d6f/dbd/ff1 0 2023-10-18T20:58:43.485 INFO:tasks.workunit.client.0.smithi008.stdout:8/783: creat d5/d8/df/d2e/f11d x:0 0 0 2023-10-18T20:58:43.486 INFO:tasks.workunit.client.0.smithi008.stdout:7/696: dwrite d1/da6/d4f/f5b [0,4194304] 0 2023-10-18T20:58:43.487 INFO:tasks.workunit.client.0.smithi008.stdout:7/697: chown d1/d3/d20/f43 25 1 2023-10-18T20:58:43.488 INFO:tasks.workunit.client.1.smithi060.stdout:5/833: dread d0/f2c [0,4194304] 0 2023-10-18T20:58:43.489 INFO:tasks.workunit.client.1.smithi060.stdout:5/834: truncate d0/da/ff6 659857 0 2023-10-18T20:58:43.489 INFO:tasks.workunit.client.1.smithi060.stdout:5/835: write d0/d6/d9/d82/f103 [49924,29782] 0 2023-10-18T20:58:43.489 INFO:tasks.workunit.client.1.smithi060.stdout:8/795: creat d4/d9/d31/d35/d9f/da3/ddb/ff2 x:0 0 0 2023-10-18T20:58:43.490 INFO:tasks.workunit.client.1.smithi060.stdout:8/796: fdatasync d4/d9/d31/d6f/dbd/fec 0 2023-10-18T20:58:43.490 INFO:tasks.workunit.client.1.smithi060.stdout:7/912: dread de/d29/d9c/db1/fd6 [0,4194304] 0 2023-10-18T20:58:43.490 INFO:tasks.workunit.client.1.smithi060.stdout:8/797: getdents d4/d9/d37/d4e/d6e/d7b 0 2023-10-18T20:58:43.495 INFO:tasks.workunit.client.1.smithi060.stdout:7/913: read de/d14/d41/f6a [2331275,40652] 0 2023-10-18T20:58:43.497 INFO:tasks.workunit.client.0.smithi008.stdout:7/698: getdents d1/d3/d20/d5f/d78 0 2023-10-18T20:58:43.498 INFO:tasks.workunit.client.0.smithi008.stdout:7/699: dread - d1/d3/fc0 zero size 2023-10-18T20:58:43.499 INFO:tasks.workunit.client.0.smithi008.stdout:1/710: mkdir d9/de/df/d17/ddb 0 2023-10-18T20:58:43.499 INFO:tasks.workunit.client.0.smithi008.stdout:8/784: dread d5/d8/df/f39 [0,4194304] 0 2023-10-18T20:58:43.500 INFO:tasks.workunit.client.0.smithi008.stdout:8/785: dread - d5/d8/f119 zero size 2023-10-18T20:58:43.505 INFO:tasks.workunit.client.1.smithi060.stdout:9/756: dwrite d3/d99/d65/fd6 [0,4194304] 0 2023-10-18T20:58:43.505 INFO:tasks.workunit.client.1.smithi060.stdout:0/804: dwrite d3/d8/f28 [0,4194304] 0 2023-10-18T20:58:43.510 INFO:tasks.workunit.client.1.smithi060.stdout:5/836: dread d0/da/dc8/de4/d6d/f71 [0,4194304] 0 2023-10-18T20:58:43.510 INFO:tasks.workunit.client.1.smithi060.stdout:5/837: chown d0/da/d3b/d64 1082782 1 2023-10-18T20:58:43.510 INFO:tasks.workunit.client.1.smithi060.stdout:5/838: chown d0/d6/d9/d82/d96 0 1 2023-10-18T20:58:43.514 INFO:tasks.workunit.client.0.smithi008.stdout:8/786: getdents d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/dbf 0 2023-10-18T20:58:43.514 INFO:tasks.workunit.client.0.smithi008.stdout:4/551: rename d0/d74 to d0/d58/d8e/db4 0 2023-10-18T20:58:43.515 INFO:tasks.workunit.client.0.smithi008.stdout:8/787: chown d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/dc4/f109 51 1 2023-10-18T20:58:43.516 INFO:tasks.workunit.client.1.smithi060.stdout:9/757: creat d3/d99/d1c/d5a/d107/f115 x:0 0 0 2023-10-18T20:58:43.516 INFO:tasks.workunit.client.1.smithi060.stdout:9/758: chown d3/d99/d1c/d2a/l39 121400681 1 2023-10-18T20:58:43.516 INFO:tasks.workunit.client.1.smithi060.stdout:9/759: truncate d3/d99/d1c/d2a/d80/ff6 806508 0 2023-10-18T20:58:43.516 INFO:tasks.workunit.client.1.smithi060.stdout:9/760: read d3/f1b [3172354,19979] 0 2023-10-18T20:58:43.517 INFO:tasks.workunit.client.1.smithi060.stdout:9/761: truncate d3/d99/d1c/d2a/f36 2653917 0 2023-10-18T20:58:43.525 INFO:tasks.workunit.client.1.smithi060.stdout:7/914: write de/d29/f37 [570320,55141] 0 2023-10-18T20:58:43.526 INFO:tasks.workunit.client.1.smithi060.stdout:7/915: write de/d14/d49/da3/fba [67151,7153] 0 2023-10-18T20:58:43.527 INFO:tasks.workunit.client.1.smithi060.stdout:5/839: dread d0/d47/d7d/fcc [0,4194304] 0 2023-10-18T20:58:43.527 INFO:tasks.workunit.client.1.smithi060.stdout:5/840: write d0/da/d61/fbb [59377,21861] 0 2023-10-18T20:58:43.530 INFO:tasks.workunit.client.1.smithi060.stdout:5/841: unlink d0/dd/d76/d10f/da5/f12b 0 2023-10-18T20:58:43.531 INFO:tasks.workunit.client.0.smithi008.stdout:6/713: dwrite df/d15/f16 [4194304,4194304] 0 2023-10-18T20:58:43.531 INFO:tasks.workunit.client.0.smithi008.stdout:6/714: fsync df/d3c/da2/dcf/d58/dec/f17 0 2023-10-18T20:58:43.533 INFO:tasks.workunit.client.0.smithi008.stdout:2/642: rename d1/d3/dd/dac to d1/d3/d40/d6e/d7e/db3/dcf 0 2023-10-18T20:58:43.539 INFO:tasks.workunit.client.0.smithi008.stdout:5/612: dwrite d0/d2/d19/f33 [0,4194304] 0 2023-10-18T20:58:43.539 INFO:tasks.workunit.client.0.smithi008.stdout:5/613: dread - d0/d2/d19/d7c/d58/d65/d68/fa5 zero size 2023-10-18T20:58:43.540 INFO:tasks.workunit.client.0.smithi008.stdout:5/614: write d0/d2/d19/d7c/d58/d65/f2b [1317908,61849] 0 2023-10-18T20:58:43.544 INFO:tasks.workunit.client.1.smithi060.stdout:2/836: sync 2023-10-18T20:58:43.544 INFO:tasks.workunit.client.1.smithi060.stdout:2/837: stat d0/d45/d49/d55/f101 0 2023-10-18T20:58:43.545 INFO:tasks.workunit.client.1.smithi060.stdout:2/838: write d0/d45/d49/d55/dbf/fec [475714,126285] 0 2023-10-18T20:58:43.547 INFO:tasks.workunit.client.1.smithi060.stdout:6/848: sync 2023-10-18T20:58:43.548 INFO:tasks.workunit.client.1.smithi060.stdout:5/842: dread d0/da/ff6 [0,4194304] 0 2023-10-18T20:58:43.549 INFO:tasks.workunit.client.0.smithi008.stdout:3/698: dwrite d0/d3/da9/fb6 [0,4194304] 0 2023-10-18T20:58:43.549 INFO:tasks.workunit.client.1.smithi060.stdout:2/839: creat d0/d16/ded/f118 x:0 0 0 2023-10-18T20:58:43.550 INFO:tasks.workunit.client.1.smithi060.stdout:9/762: rename d3/d99/d1c/d2a to d3/d99/d1c/d116 0 2023-10-18T20:58:43.551 INFO:tasks.workunit.client.1.smithi060.stdout:2/840: mkdir d0/d8/d87/d107/d119 0 2023-10-18T20:58:43.553 INFO:tasks.workunit.client.1.smithi060.stdout:9/763: link f2 d3/d99/d1c/d5a/d5d/d56/f117 0 2023-10-18T20:58:43.554 INFO:tasks.workunit.client.1.smithi060.stdout:9/764: write d3/d99/d1c/d5a/d5d/d7d/f89 [2091934,40499] 0 2023-10-18T20:58:43.562 INFO:tasks.workunit.client.0.smithi008.stdout:2/643: read d1/f1a [1288074,20500] 0 2023-10-18T20:58:43.562 INFO:tasks.workunit.client.0.smithi008.stdout:2/644: chown d1/d3/dd/f58 37 1 2023-10-18T20:58:43.569 INFO:tasks.workunit.client.0.smithi008.stdout:1/711: dwrite d9/de/f80 [0,4194304] 0 2023-10-18T20:58:43.572 INFO:tasks.workunit.client.1.smithi060.stdout:2/841: rename d0/d3/d27/d4d/d53/f77 to d0/d45/d49/f11a 0 2023-10-18T20:58:43.572 INFO:tasks.workunit.client.1.smithi060.stdout:9/765: mkdir d3/d99/d1c/d116/d80/da0/ddd/d118 0 2023-10-18T20:58:43.572 INFO:tasks.workunit.client.1.smithi060.stdout:9/766: rename d3/d99/d1c/d116/d2d/fff to d3/d99/d1c/d116/d80/da0/dc2/de0/f119 0 2023-10-18T20:58:43.573 INFO:tasks.workunit.client.0.smithi008.stdout:2/645: getdents d1/d3/dd/d1c/d3a/d49 0 2023-10-18T20:58:43.573 INFO:tasks.workunit.client.1.smithi060.stdout:6/849: write d10/d25/fc5 [2398086,18318] 0 2023-10-18T20:58:43.574 INFO:tasks.workunit.client.1.smithi060.stdout:9/767: symlink d3/d58/l11a 0 2023-10-18T20:58:43.574 INFO:tasks.workunit.client.1.smithi060.stdout:6/850: creat d10/d25/df2/f10a x:0 0 0 2023-10-18T20:58:43.577 INFO:tasks.workunit.client.0.smithi008.stdout:5/615: dread d0/d2/d9/d9b/f56 [0,4194304] 0 2023-10-18T20:58:43.578 INFO:tasks.workunit.client.0.smithi008.stdout:2/646: mknod d1/d3/dd/d25/d76/d59/d85/dba/cd0 0 2023-10-18T20:58:43.578 INFO:tasks.workunit.client.1.smithi060.stdout:9/768: symlink d3/d99/d1c/d5a/d5d/d56/l11b 0 2023-10-18T20:58:43.578 INFO:tasks.workunit.client.1.smithi060.stdout:6/851: truncate d10/d17/d28/f68 532372 0 2023-10-18T20:58:43.579 INFO:tasks.workunit.client.1.smithi060.stdout:6/852: mkdir d10/d17/d70/dba/d10b 0 2023-10-18T20:58:43.581 INFO:tasks.workunit.client.0.smithi008.stdout:5/616: rename d0/d2/d19/d7c/f2a to d0/d2/d19/d7c/d42/fe0 0 2023-10-18T20:58:43.587 INFO:tasks.workunit.client.0.smithi008.stdout:8/788: dwrite d5/d8/df/d2e/f35 [0,4194304] 0 2023-10-18T20:58:43.587 INFO:tasks.workunit.client.0.smithi008.stdout:8/789: readlink d5/d8/df/d9d/d85/db1/dcc/d104/lfb 0 2023-10-18T20:58:43.588 INFO:tasks.workunit.client.1.smithi060.stdout:6/853: link f8 d10/d17/dae/df3/f10c 0 2023-10-18T20:58:43.588 INFO:tasks.workunit.client.0.smithi008.stdout:8/790: creat d5/d8/df/d2e/f11e x:0 0 0 2023-10-18T20:58:43.588 INFO:tasks.workunit.client.0.smithi008.stdout:8/791: read - d5/d8/df/d2e/f11d zero size 2023-10-18T20:58:43.589 INFO:tasks.workunit.client.0.smithi008.stdout:2/647: link d1/d3/dd/d1c/f55 d1/d3/dd/d48/fd1 0 2023-10-18T20:58:43.589 INFO:tasks.workunit.client.0.smithi008.stdout:2/648: write d1/d3/dd/d25/d76/d59/fcb [1262760,29975] 0 2023-10-18T20:58:43.590 INFO:tasks.workunit.client.0.smithi008.stdout:2/649: truncate d1/d3/dd/f58 1763336 0 2023-10-18T20:58:43.592 INFO:tasks.workunit.client.0.smithi008.stdout:5/617: mkdir d0/da9/dda/de1 0 2023-10-18T20:58:43.592 INFO:tasks.workunit.client.1.smithi060.stdout:8/798: dwrite d4/d9/fb1 [0,4194304] 0 2023-10-18T20:58:43.594 INFO:tasks.workunit.client.0.smithi008.stdout:8/792: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/f11f x:0 0 0 2023-10-18T20:58:43.599 INFO:tasks.workunit.client.0.smithi008.stdout:2/650: creat d1/d3/dd/d25/d5c/fd2 x:0 0 0 2023-10-18T20:58:43.599 INFO:tasks.workunit.client.0.smithi008.stdout:5/618: symlink d0/da9/dcd/le2 0 2023-10-18T20:58:43.599 INFO:tasks.workunit.client.0.smithi008.stdout:8/793: truncate d5/d8/df/f23 985651 0 2023-10-18T20:58:43.599 INFO:tasks.workunit.client.0.smithi008.stdout:8/794: fdatasync d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/deb/f105 0 2023-10-18T20:58:43.600 INFO:tasks.workunit.client.1.smithi060.stdout:8/799: link d4/d9/d31/d6f/dbd/ce4 d4/d9/d31/da6/cf3 0 2023-10-18T20:58:43.600 INFO:tasks.workunit.client.0.smithi008.stdout:5/619: creat d0/d2/d19/d7c/d31/d82/fe3 x:0 0 0 2023-10-18T20:58:43.601 INFO:tasks.workunit.client.0.smithi008.stdout:5/620: write d0/d2/d19/d7c/d31/d80/fcf [791859,78109] 0 2023-10-18T20:58:43.601 INFO:tasks.workunit.client.0.smithi008.stdout:5/621: creat d0/d2/d9/d9b/d62/fe4 x:0 0 0 2023-10-18T20:58:43.602 INFO:tasks.workunit.client.0.smithi008.stdout:2/651: creat d1/d3/fd3 x:0 0 0 2023-10-18T20:58:43.603 INFO:tasks.workunit.client.0.smithi008.stdout:8/795: getdents d5/d8/df/dce/dfa 0 2023-10-18T20:58:43.609 INFO:tasks.workunit.client.0.smithi008.stdout:8/796: dread d5/fa6 [0,4194304] 0 2023-10-18T20:58:43.609 INFO:tasks.workunit.client.0.smithi008.stdout:8/797: truncate d5/d8/df/d9d/d85/db1/dcc/d104/ffe 986865 0 2023-10-18T20:58:43.610 INFO:tasks.workunit.client.0.smithi008.stdout:5/622: mknod d0/d2/d9/d9b/dba/ce5 0 2023-10-18T20:58:43.614 INFO:tasks.workunit.client.1.smithi060.stdout:0/805: dwrite d3/d8/fd4 [0,4194304] 0 2023-10-18T20:58:43.616 INFO:tasks.workunit.client.1.smithi060.stdout:4/754: sync 2023-10-18T20:58:43.622 INFO:tasks.workunit.client.1.smithi060.stdout:8/800: dread d4/d9/d31/d6f/f75 [4194304,4194304] 0 2023-10-18T20:58:43.626 INFO:tasks.workunit.client.0.smithi008.stdout:7/700: dwrite d1/d3/d20/f43 [0,4194304] 0 2023-10-18T20:58:43.626 INFO:tasks.workunit.client.1.smithi060.stdout:4/755: creat d4/dc/d2a/d39/d53/d76/da7/dca/dc4/feb x:0 0 0 2023-10-18T20:58:43.629 INFO:tasks.workunit.client.1.smithi060.stdout:0/806: symlink d3/d8/d14/l103 0 2023-10-18T20:58:43.631 INFO:tasks.workunit.client.1.smithi060.stdout:4/756: mknod d4/dc/d2a/d39/d53/d76/da7/dca/de5/cec 0 2023-10-18T20:58:43.632 INFO:tasks.workunit.client.1.smithi060.stdout:4/757: write d4/dc/d2a/d39/d53/d76/d99/fb4 [723860,8627] 0 2023-10-18T20:58:43.633 INFO:tasks.workunit.client.1.smithi060.stdout:0/807: symlink d3/d80/dd9/l104 0 2023-10-18T20:58:43.635 INFO:tasks.workunit.client.1.smithi060.stdout:8/801: rmdir d4/d9/d31/d35/d9f/da3 39 2023-10-18T20:58:43.636 INFO:tasks.workunit.client.0.smithi008.stdout:5/623: dread d0/d2/d9/d9b/f56 [0,4194304] 0 2023-10-18T20:58:43.636 INFO:tasks.workunit.client.1.smithi060.stdout:4/758: mknod d4/dc/d40/da8/ced 0 2023-10-18T20:58:43.641 INFO:tasks.workunit.client.1.smithi060.stdout:5/843: dwrite d0/d6/d8/df/f107 [0,4194304] 0 2023-10-18T20:58:43.642 INFO:tasks.workunit.client.1.smithi060.stdout:7/916: dwrite de/d14/d2f/d3f/d5a/f94 [0,4194304] 0 2023-10-18T20:58:43.644 INFO:tasks.workunit.client.0.smithi008.stdout:4/552: dwrite d0/d17/d5b/faa [0,4194304] 0 2023-10-18T20:58:43.645 INFO:tasks.workunit.client.1.smithi060.stdout:0/808: link d3/d8/f9 d3/d8/d14/d55/f105 0 2023-10-18T20:58:43.645 INFO:tasks.workunit.client.1.smithi060.stdout:0/809: chown d3/f26 5 1 2023-10-18T20:58:43.650 INFO:tasks.workunit.client.0.smithi008.stdout:6/715: mknod df/d3c/da2/dcf/d58/dec/cf5 0 2023-10-18T20:58:43.651 INFO:tasks.workunit.client.1.smithi060.stdout:7/917: mkdir de/d14/d3a/d46/d12b 0 2023-10-18T20:58:43.654 INFO:tasks.workunit.client.0.smithi008.stdout:4/553: creat d0/d3/fb5 x:0 0 0 2023-10-18T20:58:43.656 INFO:tasks.workunit.client.0.smithi008.stdout:5/624: write d0/d2/d19/d7c/f95 [1613862,45402] 0 2023-10-18T20:58:43.656 INFO:tasks.workunit.client.0.smithi008.stdout:5/625: dread - d0/d2/d19/d7c/d31/d3f/f77 zero size 2023-10-18T20:58:43.658 INFO:tasks.workunit.client.0.smithi008.stdout:6/716: rename df/d36/c8d to df/d15/d48/cf6 0 2023-10-18T20:58:43.658 INFO:tasks.workunit.client.0.smithi008.stdout:6/717: chown df/d15/d48/ded/cae 137 1 2023-10-18T20:58:43.673 INFO:tasks.workunit.client.1.smithi060.stdout:4/759: write d4/dc/d2a/d2d/f74 [1032991,86223] 0 2023-10-18T20:58:43.682 INFO:tasks.workunit.client.1.smithi060.stdout:2/842: dwrite d0/d45/d49/f11a [8388608,4194304] 0 2023-10-18T20:58:43.689 INFO:tasks.workunit.client.1.smithi060.stdout:2/843: chown d0/d3/d27/d4d/l6a 488 1 2023-10-18T20:58:43.689 INFO:tasks.workunit.client.0.smithi008.stdout:8/798: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95/dc4/f118 [0,4194304] 0 2023-10-18T20:58:43.690 INFO:tasks.workunit.client.1.smithi060.stdout:7/918: write de/d29/d72/d84/fae [3225187,78164] 0 2023-10-18T20:58:43.691 INFO:tasks.workunit.client.1.smithi060.stdout:7/919: fsync de/d14/d2f/d8f/d5b/f7a 0 2023-10-18T20:58:43.691 INFO:tasks.workunit.client.1.smithi060.stdout:7/920: chown de/d14/d2f/d3f/d5a/d101 411 1 2023-10-18T20:58:43.694 INFO:tasks.workunit.client.1.smithi060.stdout:3/786: sync 2023-10-18T20:58:43.695 INFO:tasks.workunit.client.1.smithi060.stdout:2/844: getdents d0/d45/dc9/da8 0 2023-10-18T20:58:43.695 INFO:tasks.workunit.client.1.smithi060.stdout:2/845: write d0/f10 [2498536,60532] 0 2023-10-18T20:58:43.696 INFO:tasks.workunit.client.1.smithi060.stdout:4/760: link d4/dc/cd d4/dc/d2a/d39/d53/d76/da7/dca/dcd/cee 0 2023-10-18T20:58:43.696 INFO:tasks.workunit.client.1.smithi060.stdout:3/787: write d0/d3c/fa7 [818775,11634] 0 2023-10-18T20:58:43.697 INFO:tasks.workunit.client.1.smithi060.stdout:2/846: chown d0/d3/d27/d4d/c69 15846488 1 2023-10-18T20:58:43.697 INFO:tasks.workunit.client.1.smithi060.stdout:1/951: sync 2023-10-18T20:58:43.697 INFO:tasks.workunit.client.0.smithi008.stdout:2/652: dwrite d1/d3/dd/d25/d76/d59/d85/fb8 [0,4194304] 0 2023-10-18T20:58:43.701 INFO:tasks.workunit.client.1.smithi060.stdout:3/788: symlink d0/d22/d26/d79/l111 0 2023-10-18T20:58:43.702 INFO:tasks.workunit.client.1.smithi060.stdout:8/802: dwrite d4/d9/f1b [0,4194304] 0 2023-10-18T20:58:43.702 INFO:tasks.workunit.client.1.smithi060.stdout:8/803: stat d4/d9/l4b 0 2023-10-18T20:58:43.705 INFO:tasks.workunit.client.1.smithi060.stdout:5/844: dwrite d0/d6/d9/f14 [0,4194304] 0 2023-10-18T20:58:43.706 INFO:tasks.workunit.client.1.smithi060.stdout:1/952: symlink d4/d6/d7/d2f/d7b/d2a/l135 0 2023-10-18T20:58:43.706 INFO:tasks.workunit.client.1.smithi060.stdout:2/847: symlink d0/d45/d49/d6e/l11b 0 2023-10-18T20:58:43.707 INFO:tasks.workunit.client.1.smithi060.stdout:1/953: write d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/ff0 [796398,7107] 0 2023-10-18T20:58:43.707 INFO:tasks.workunit.client.1.smithi060.stdout:2/848: creat d0/d16/ded/f11c x:0 0 0 2023-10-18T20:58:43.707 INFO:tasks.workunit.client.1.smithi060.stdout:1/954: fdatasync d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/ff2 0 2023-10-18T20:58:43.707 INFO:tasks.workunit.client.1.smithi060.stdout:1/955: write d4/d6/d7/d2f/d7b/d2a/d32/f7a [587257,75309] 0 2023-10-18T20:58:43.707 INFO:tasks.workunit.client.1.smithi060.stdout:4/761: rmdir d4/dc/d2a/d13/dbd 39 2023-10-18T20:58:43.708 INFO:tasks.workunit.client.1.smithi060.stdout:4/762: stat d4/dc/d40/d80 0 2023-10-18T20:58:43.708 INFO:tasks.workunit.client.1.smithi060.stdout:8/804: mknod d4/d9/d88/cf4 0 2023-10-18T20:58:43.709 INFO:tasks.workunit.client.1.smithi060.stdout:5/845: creat d0/d6/d9/d82/d84/db2/db8/f12c x:0 0 0 2023-10-18T20:58:43.712 INFO:tasks.workunit.client.0.smithi008.stdout:8/799: creat d5/d8/df/df0/f120 x:0 0 0 2023-10-18T20:58:43.715 INFO:tasks.workunit.client.1.smithi060.stdout:6/854: dwrite d10/d17/d28/f68 [0,4194304] 0 2023-10-18T20:58:43.715 INFO:tasks.workunit.client.1.smithi060.stdout:8/805: getdents d4/d9/d31/d35 0 2023-10-18T20:58:43.716 INFO:tasks.workunit.client.1.smithi060.stdout:2/849: rename d0/d3/cdc to d0/d3/d27/d4d/c11d 0 2023-10-18T20:58:43.716 INFO:tasks.workunit.client.1.smithi060.stdout:2/850: chown d0/d3/cdb 314 1 2023-10-18T20:58:43.716 INFO:tasks.workunit.client.1.smithi060.stdout:8/806: symlink d4/d9/d31/d35/d9f/lf5 0 2023-10-18T20:58:43.717 INFO:tasks.workunit.client.1.smithi060.stdout:2/851: mknod d0/d3/d9e/dce/c11e 0 2023-10-18T20:58:43.717 INFO:tasks.workunit.client.1.smithi060.stdout:2/852: dread - d0/d3/d9e/dc2/fd2 zero size 2023-10-18T20:58:43.721 INFO:tasks.workunit.client.1.smithi060.stdout:1/956: rename d4/d6/d7/df/f6b to d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d11b/f136 0 2023-10-18T20:58:43.722 INFO:tasks.workunit.client.0.smithi008.stdout:5/626: write d0/d2/d19/d7c/d42/fe0 [647618,11639] 0 2023-10-18T20:58:43.726 INFO:tasks.workunit.client.0.smithi008.stdout:1/712: truncate d9/de/df/d17/d25/d94/da7/fb2 668889 0 2023-10-18T20:58:43.732 INFO:tasks.workunit.client.0.smithi008.stdout:4/554: dwrite d0/d3/d21/fa2 [0,4194304] 0 2023-10-18T20:58:43.736 INFO:tasks.workunit.client.1.smithi060.stdout:9/769: dwrite d3/d99/d1c/d116/d2d/db9/fd3 [0,4194304] 0 2023-10-18T20:58:43.736 INFO:tasks.workunit.client.1.smithi060.stdout:0/810: dread d3/f48 [0,4194304] 0 2023-10-18T20:58:43.737 INFO:tasks.workunit.client.0.smithi008.stdout:2/653: truncate d1/d3/dd/d25/d76/f3f 3580755 0 2023-10-18T20:58:43.737 INFO:tasks.workunit.client.0.smithi008.stdout:8/800: rmdir d5/d8/df/d9d/d85/db1/dcc/d104 39 2023-10-18T20:58:43.738 INFO:tasks.workunit.client.0.smithi008.stdout:8/801: chown d5/f3d 23047740 1 2023-10-18T20:58:43.738 INFO:tasks.workunit.client.0.smithi008.stdout:8/802: fsync d5/d8/df/d9d/f96 0 2023-10-18T20:58:43.738 INFO:tasks.workunit.client.0.smithi008.stdout:7/701: dwrite d1/d3/f6b [0,4194304] 0 2023-10-18T20:58:43.746 INFO:tasks.workunit.client.0.smithi008.stdout:5/627: mkdir d0/d2/de6 0 2023-10-18T20:58:43.747 INFO:tasks.workunit.client.0.smithi008.stdout:9/566: sync 2023-10-18T20:58:43.748 INFO:tasks.workunit.client.1.smithi060.stdout:2/853: rmdir d0/d16/ded 39 2023-10-18T20:58:43.748 INFO:tasks.workunit.client.1.smithi060.stdout:2/854: write d0/d8/d47/fcc [822041,42082] 0 2023-10-18T20:58:43.748 INFO:tasks.workunit.client.1.smithi060.stdout:6/855: write d10/d17/f82 [1497531,32180] 0 2023-10-18T20:58:43.748 INFO:tasks.workunit.client.1.smithi060.stdout:9/770: symlink d3/d99/d1c/l11c 0 2023-10-18T20:58:43.750 INFO:tasks.workunit.client.1.smithi060.stdout:0/811: mknod d3/d8/d3c/d87/de2/c106 0 2023-10-18T20:58:43.750 INFO:tasks.workunit.client.1.smithi060.stdout:5/846: write d0/d6/d9/fd5 [3484367,18994] 0 2023-10-18T20:58:43.751 INFO:tasks.workunit.client.1.smithi060.stdout:0/812: write d3/d32/d86/f8c [2853482,33709] 0 2023-10-18T20:58:43.751 INFO:tasks.workunit.client.1.smithi060.stdout:6/856: symlink d10/d17/d54/db1/l10d 0 2023-10-18T20:58:43.751 INFO:tasks.workunit.client.1.smithi060.stdout:8/807: dread d4/d9/d4f/d74/d81/fc4 [0,4194304] 0 2023-10-18T20:58:43.755 INFO:tasks.workunit.client.1.smithi060.stdout:5/847: symlink d0/d6/d8/df/l12d 0 2023-10-18T20:58:43.755 INFO:tasks.workunit.client.1.smithi060.stdout:9/771: rename d3/d99/d1c/d116/d33 to d3/d99/d19/d54/d11d 0 2023-10-18T20:58:43.755 INFO:tasks.workunit.client.1.smithi060.stdout:5/848: getdents d0/dd/d76/d112 0 2023-10-18T20:58:43.756 INFO:tasks.workunit.client.1.smithi060.stdout:9/772: dread - d3/d99/d1c/d116/f114 zero size 2023-10-18T20:58:43.758 INFO:tasks.workunit.client.0.smithi008.stdout:6/718: dwrite df/f2e [0,4194304] 0 2023-10-18T20:58:43.758 INFO:tasks.workunit.client.0.smithi008.stdout:1/713: getdents d9/de/df/d17/d25/d57 0 2023-10-18T20:58:43.759 INFO:tasks.workunit.client.1.smithi060.stdout:9/773: write d3/d99/f3c [680856,119460] 0 2023-10-18T20:58:43.759 INFO:tasks.workunit.client.1.smithi060.stdout:3/789: dwrite d0/d22/d26/d2c/fe3 [0,4194304] 0 2023-10-18T20:58:43.759 INFO:tasks.workunit.client.1.smithi060.stdout:6/857: mknod d10/d17/d70/c10e 0 2023-10-18T20:58:43.760 INFO:tasks.workunit.client.1.smithi060.stdout:6/858: fdatasync d10/d25/fde 0 2023-10-18T20:58:43.760 INFO:tasks.workunit.client.1.smithi060.stdout:4/763: dwrite d4/dc/d2a/f54 [0,4194304] 0 2023-10-18T20:58:43.761 INFO:tasks.workunit.client.0.smithi008.stdout:4/555: creat d0/d17/d5b/d99/fb6 x:0 0 0 2023-10-18T20:58:43.762 INFO:tasks.workunit.client.1.smithi060.stdout:4/764: write d4/d15/d2b/fea [909242,62284] 0 2023-10-18T20:58:43.762 INFO:tasks.workunit.client.1.smithi060.stdout:4/765: write d4/dc/d2a/d13/fd5 [865145,113714] 0 2023-10-18T20:58:43.763 INFO:tasks.workunit.client.1.smithi060.stdout:4/766: write d4/dc/d2a/d7e/fd0 [940324,85485] 0 2023-10-18T20:58:43.763 INFO:tasks.workunit.client.1.smithi060.stdout:4/767: readlink d4/dc/d2a/d13/d27/d68/d9e/lac 0 2023-10-18T20:58:43.763 INFO:tasks.workunit.client.1.smithi060.stdout:4/768: stat d4/dc/d2a/d83/db1/fd2 0 2023-10-18T20:58:43.763 INFO:tasks.workunit.client.1.smithi060.stdout:4/769: readlink d4/dc/d2a/d39/d82/l94 0 2023-10-18T20:58:43.764 INFO:tasks.workunit.client.1.smithi060.stdout:4/770: read - d4/dc/d2a/d39/fa6 zero size 2023-10-18T20:58:43.764 INFO:tasks.workunit.client.0.smithi008.stdout:2/654: unlink d1/d3/dd/f38 0 2023-10-18T20:58:43.765 INFO:tasks.workunit.client.1.smithi060.stdout:3/790: mknod d0/d22/d26/d2b/c112 0 2023-10-18T20:58:43.766 INFO:tasks.workunit.client.1.smithi060.stdout:6/859: truncate d10/d2e/d75/dc4/fa5 2454503 0 2023-10-18T20:58:43.766 INFO:tasks.workunit.client.1.smithi060.stdout:6/860: mknod d10/d17/d70/dba/d10b/c10f 0 2023-10-18T20:58:43.766 INFO:tasks.workunit.client.1.smithi060.stdout:6/861: creat d10/d25/df2/f110 x:0 0 0 2023-10-18T20:58:43.767 INFO:tasks.workunit.client.0.smithi008.stdout:5/628: mkdir d0/d2/d9/d9b/de7 0 2023-10-18T20:58:43.767 INFO:tasks.workunit.client.0.smithi008.stdout:9/567: getdents d2/d8 0 2023-10-18T20:58:43.768 INFO:tasks.workunit.client.1.smithi060.stdout:6/862: truncate fc 1807738 0 2023-10-18T20:58:43.776 INFO:tasks.workunit.client.0.smithi008.stdout:6/719: unlink df/d3c/d77/c5c 0 2023-10-18T20:58:43.776 INFO:tasks.workunit.client.1.smithi060.stdout:4/771: unlink d4/dc/d2a/d2d/f96 0 2023-10-18T20:58:43.776 INFO:tasks.workunit.client.1.smithi060.stdout:4/772: readlink d4/d15/d2b/l2e 0 2023-10-18T20:58:43.777 INFO:tasks.workunit.client.1.smithi060.stdout:4/773: stat d4/d15/d2b/l66 0 2023-10-18T20:58:43.777 INFO:tasks.workunit.client.1.smithi060.stdout:4/774: write d4/dc/d2a/d5b/fb9 [287843,4931] 0 2023-10-18T20:58:43.777 INFO:tasks.workunit.client.1.smithi060.stdout:4/775: chown d4/d15/d2b/d9f/faa 28290234 1 2023-10-18T20:58:43.777 INFO:tasks.workunit.client.1.smithi060.stdout:4/776: chown d4/dc/d2a/d2d/d69/d89/c98 834616779 1 2023-10-18T20:58:43.778 INFO:tasks.workunit.client.1.smithi060.stdout:8/808: write d4/d9/d4f/d74/d81/f94 [2558510,7522] 0 2023-10-18T20:58:43.778 INFO:tasks.workunit.client.0.smithi008.stdout:1/714: rename d9/de/df/c41 to d9/de/df/d17/d1e/db8/cdc 0 2023-10-18T20:58:43.778 INFO:tasks.workunit.client.1.smithi060.stdout:5/849: dread d0/d6/d9/d82/d84/db2/d2a/f5a [0,4194304] 0 2023-10-18T20:58:43.779 INFO:tasks.workunit.client.0.smithi008.stdout:4/556: mknod d0/d17/d6e/cb7 0 2023-10-18T20:58:43.780 INFO:tasks.workunit.client.0.smithi008.stdout:4/557: chown d0/d17/f4f 0 1 2023-10-18T20:58:43.780 INFO:tasks.workunit.client.0.smithi008.stdout:4/558: chown d0/d17/f23 7 1 2023-10-18T20:58:43.780 INFO:tasks.workunit.client.0.smithi008.stdout:4/559: chown d0/d58/d8e/db4 376 1 2023-10-18T20:58:43.781 INFO:tasks.workunit.client.1.smithi060.stdout:8/809: link d4/d9/d31/d35/d9f/da3/l98 d4/d9/d4f/lf6 0 2023-10-18T20:58:43.781 INFO:tasks.workunit.client.1.smithi060.stdout:5/850: rename d0/d6/d8/l17 to d0/da/d3b/l12e 0 2023-10-18T20:58:43.782 INFO:tasks.workunit.client.0.smithi008.stdout:5/629: creat d0/d2/d9/d34/fe8 x:0 0 0 2023-10-18T20:58:43.784 INFO:tasks.workunit.client.1.smithi060.stdout:4/777: write d4/dc/d2a/d2d/d69/d89/f90 [649745,26787] 0 2023-10-18T20:58:43.787 INFO:tasks.workunit.client.0.smithi008.stdout:0/568: sync 2023-10-18T20:58:43.787 INFO:tasks.workunit.client.0.smithi008.stdout:0/569: write d0/dd/d19/d5f/d99/f33 [4561503,31343] 0 2023-10-18T20:58:43.788 INFO:tasks.workunit.client.1.smithi060.stdout:8/810: creat d4/d9/d31/d35/d9f/da3/dd8/ff7 x:0 0 0 2023-10-18T20:58:43.789 INFO:tasks.workunit.client.1.smithi060.stdout:8/811: fdatasync d4/d9/d31/d35/d9f/da3/f9b 0 2023-10-18T20:58:43.789 INFO:tasks.workunit.client.1.smithi060.stdout:4/778: rmdir d4/dc/d2a/d1d 39 2023-10-18T20:58:43.789 INFO:tasks.workunit.client.0.smithi008.stdout:9/568: link d2/d4d/f7d d2/dc/d40/d5a/fa3 0 2023-10-18T20:58:43.791 INFO:tasks.workunit.client.0.smithi008.stdout:6/720: symlink df/d3c/da2/dcf/d58/dec/lf7 0 2023-10-18T20:58:43.792 INFO:tasks.workunit.client.0.smithi008.stdout:6/721: chown df/d15/d48/d4b/f4f 243884 1 2023-10-18T20:58:43.793 INFO:tasks.workunit.client.1.smithi060.stdout:8/812: mknod d4/d9/d31/d35/d9f/da3/dd8/cf8 0 2023-10-18T20:58:43.793 INFO:tasks.workunit.client.1.smithi060.stdout:4/779: symlink d4/dc/d2a/d39/d53/d76/lef 0 2023-10-18T20:58:43.793 INFO:tasks.workunit.client.1.smithi060.stdout:4/780: fdatasync d4/dc/d2a/d39/d53/d76/d99/fbb 0 2023-10-18T20:58:43.795 INFO:tasks.workunit.client.0.smithi008.stdout:0/570: mkdir d0/dd/d19/d5f/d89/da7/dac 0 2023-10-18T20:58:43.799 INFO:tasks.workunit.client.1.smithi060.stdout:3/791: dread d0/f1d [0,4194304] 0 2023-10-18T20:58:43.802 INFO:tasks.workunit.client.0.smithi008.stdout:1/715: write d9/de/df/d17/f70 [2168867,16789] 0 2023-10-18T20:58:43.802 INFO:tasks.workunit.client.0.smithi008.stdout:9/569: mkdir d2/dc/d3d/d99/da4 0 2023-10-18T20:58:43.802 INFO:tasks.workunit.client.0.smithi008.stdout:9/570: readlink d2/dc/d17/l3a 0 2023-10-18T20:58:43.807 INFO:tasks.workunit.client.1.smithi060.stdout:4/781: symlink d4/dc/d2a/d13/lf0 0 2023-10-18T20:58:43.807 INFO:tasks.workunit.client.1.smithi060.stdout:8/813: rename d4/d9/d4f/f5d to d4/d9/d31/d35/d9f/da3/ddb/de9/ff9 0 2023-10-18T20:58:43.813 INFO:tasks.workunit.client.0.smithi008.stdout:6/722: link df/d15/d27/d4c/f73 df/d26/ff8 0 2023-10-18T20:58:43.819 INFO:tasks.workunit.client.1.smithi060.stdout:3/792: creat d0/d22/d26/d79/f113 x:0 0 0 2023-10-18T20:58:43.820 INFO:tasks.workunit.client.1.smithi060.stdout:9/774: write d3/d99/d19/d54/f4a [3245830,100037] 0 2023-10-18T20:58:43.820 INFO:tasks.workunit.client.1.smithi060.stdout:9/775: creat d3/d99/d1c/d5a/d107/f11e x:0 0 0 2023-10-18T20:58:43.823 INFO:tasks.workunit.client.0.smithi008.stdout:1/716: creat d9/de/df/d17/d55/fdd x:0 0 0 2023-10-18T20:58:43.829 INFO:tasks.workunit.client.0.smithi008.stdout:9/571: mknod d2/dc/d17/d7b/ca5 0 2023-10-18T20:58:43.829 INFO:tasks.workunit.client.0.smithi008.stdout:9/572: dread - d2/f7f zero size 2023-10-18T20:58:43.830 INFO:tasks.workunit.client.1.smithi060.stdout:3/793: mknod d0/d22/d26/d2c/c114 0 2023-10-18T20:58:43.830 INFO:tasks.workunit.client.1.smithi060.stdout:4/782: rmdir d4/dc/d2a/d13/dbd/ddf 0 2023-10-18T20:58:43.834 INFO:tasks.workunit.client.1.smithi060.stdout:4/783: truncate d4/d15/d2b/f86 329351 0 2023-10-18T20:58:43.834 INFO:tasks.workunit.client.1.smithi060.stdout:4/784: chown d4/dc/d2a/d1d 127780016 1 2023-10-18T20:58:43.841 INFO:tasks.workunit.client.1.smithi060.stdout:3/794: rename d0/d3c/l9d to d0/d22/d26/d29/dae/de4/l115 0 2023-10-18T20:58:43.841 INFO:tasks.workunit.client.1.smithi060.stdout:3/795: fsync d0/d22/d26/fb8 0 2023-10-18T20:58:43.849 INFO:tasks.workunit.client.1.smithi060.stdout:0/813: dread d3/f26 [0,4194304] 0 2023-10-18T20:58:43.850 INFO:tasks.workunit.client.1.smithi060.stdout:0/814: fdatasync d3/d8/d14/d55/d74/d76/d68/fc0 0 2023-10-18T20:58:43.850 INFO:tasks.workunit.client.1.smithi060.stdout:4/785: rmdir d4/dc/d2a/d39/d53/d65/ddb 0 2023-10-18T20:58:43.857 INFO:tasks.workunit.client.1.smithi060.stdout:3/796: rmdir d0/d3c 39 2023-10-18T20:58:43.859 INFO:tasks.workunit.client.1.smithi060.stdout:0/815: unlink d3/d8/d14/d55/d74/l8e 0 2023-10-18T20:58:43.860 INFO:tasks.workunit.client.1.smithi060.stdout:4/786: truncate d4/dc/d2a/d5b/fa0 2015508 0 2023-10-18T20:58:43.860 INFO:tasks.workunit.client.1.smithi060.stdout:0/816: write d3/de5/df1/dc3/fe9 [230896,100740] 0 2023-10-18T20:58:43.860 INFO:tasks.workunit.client.1.smithi060.stdout:0/817: read d3/d8/d14/f40 [483901,99190] 0 2023-10-18T20:58:43.862 INFO:tasks.workunit.client.0.smithi008.stdout:9/573: link d2/dc/f6d d2/dc/d17/d19/d4a/d9a/fa6 0 2023-10-18T20:58:43.862 INFO:tasks.workunit.client.0.smithi008.stdout:3/699: sync 2023-10-18T20:58:43.862 INFO:tasks.workunit.client.0.smithi008.stdout:3/700: chown d0/d3/de/d13/d35/l45 528438 1 2023-10-18T20:58:43.863 INFO:tasks.workunit.client.1.smithi060.stdout:4/787: rename d4/dc/f6c to d4/dc/d2a/d39/d53/d5f/ff1 0 2023-10-18T20:58:43.863 INFO:tasks.workunit.client.1.smithi060.stdout:4/788: fdatasync d4/dc/d2a/d13/d27/d68/dc8/fcb 0 2023-10-18T20:58:43.864 INFO:tasks.workunit.client.1.smithi060.stdout:3/797: symlink d0/d22/d26/d8c/l116 0 2023-10-18T20:58:43.864 INFO:tasks.workunit.client.1.smithi060.stdout:3/798: chown d0/d5e/ff8 17996931 1 2023-10-18T20:58:43.864 INFO:tasks.workunit.client.1.smithi060.stdout:6/863: dwrite d10/d6f/fc2 [0,4194304] 0 2023-10-18T20:58:43.866 INFO:tasks.workunit.client.1.smithi060.stdout:1/957: dwrite d4/d6/d7/df/d59/f82 [0,4194304] 0 2023-10-18T20:58:43.867 INFO:tasks.workunit.client.1.smithi060.stdout:1/958: dread - d4/d38/d11f/d41/fe7 zero size 2023-10-18T20:58:43.867 INFO:tasks.workunit.client.1.smithi060.stdout:1/959: fsync d4/d6/d7/d2f/d7b/d2a/d32/dd/f5c 0 2023-10-18T20:58:43.869 INFO:tasks.workunit.client.1.smithi060.stdout:4/789: creat d4/dc/d2a/d5b/ff2 x:0 0 0 2023-10-18T20:58:43.870 INFO:tasks.workunit.client.1.smithi060.stdout:5/851: dwrite d0/d6/fe3 [0,4194304] 0 2023-10-18T20:58:43.871 INFO:tasks.workunit.client.0.smithi008.stdout:2/655: dread d1/d3/dd/d25/d76/d59/fcb [0,4194304] 0 2023-10-18T20:58:43.876 INFO:tasks.workunit.client.1.smithi060.stdout:4/790: rename d4/dc/d2a/d39/d53/d65/fe9 to d4/dc/d40/da8/ff3 0 2023-10-18T20:58:43.877 INFO:tasks.workunit.client.1.smithi060.stdout:3/799: read d0/d3c/f40 [2029881,119409] 0 2023-10-18T20:58:43.878 INFO:tasks.workunit.client.1.smithi060.stdout:4/791: symlink d4/dc/d2a/d39/d53/d76/da7/lf4 0 2023-10-18T20:58:43.881 INFO:tasks.workunit.client.1.smithi060.stdout:2/855: dwrite d0/d3/d27/d4d/f5b [0,4194304] 0 2023-10-18T20:58:43.881 INFO:tasks.workunit.client.1.smithi060.stdout:2/856: write d0/d45/dc9/da8/fc0 [980109,82967] 0 2023-10-18T20:58:43.883 INFO:tasks.workunit.client.0.smithi008.stdout:5/630: rename d0/d2/d19/d7c/d31/d3f/d70/da4/fb3 to d0/d86/fe9 0 2023-10-18T20:58:43.883 INFO:tasks.workunit.client.0.smithi008.stdout:5/631: chown d0/d2/d19/d7c/d42/d5a 1014 1 2023-10-18T20:58:43.886 INFO:tasks.workunit.client.0.smithi008.stdout:9/574: unlink d2/dc/d1a/d1d/l36 0 2023-10-18T20:58:43.893 INFO:tasks.workunit.client.0.smithi008.stdout:3/701: mknod d0/d3/d37/da6/cde 0 2023-10-18T20:58:43.895 INFO:tasks.workunit.client.1.smithi060.stdout:8/814: dwrite d4/d9/d37/f3c [4194304,4194304] 0 2023-10-18T20:58:43.897 INFO:tasks.workunit.client.1.smithi060.stdout:8/815: write d4/d9/d31/d35/d9f/fa0 [23213,100142] 0 2023-10-18T20:58:43.900 INFO:tasks.workunit.client.1.smithi060.stdout:4/792: dread d4/dc/d2a/d2d/d69/fd1 [0,4194304] 0 2023-10-18T20:58:43.904 INFO:tasks.workunit.client.1.smithi060.stdout:8/816: rename d4/d9/d37/d4e/d6e to d4/d9/d31/d6f/dfa 0 2023-10-18T20:58:43.904 INFO:tasks.workunit.client.1.smithi060.stdout:8/817: fsync d4/d9/f2e 0 2023-10-18T20:58:43.904 INFO:tasks.workunit.client.1.smithi060.stdout:3/800: dread d0/d22/f52 [0,4194304] 0 2023-10-18T20:58:43.905 INFO:tasks.workunit.client.0.smithi008.stdout:8/803: dwrite d5/d8/df/f1b [0,4194304] 0 2023-10-18T20:58:43.906 INFO:tasks.workunit.client.0.smithi008.stdout:8/804: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/dc9/f121 x:0 0 0 2023-10-18T20:58:43.906 INFO:tasks.workunit.client.0.smithi008.stdout:8/805: dread - d5/d8/df/d9d/d4d/dba/dd4/f10c zero size 2023-10-18T20:58:43.907 INFO:tasks.workunit.client.0.smithi008.stdout:0/571: rename d0/f8c to d0/d7c/d9a/d8a/d8f/d21/fad 0 2023-10-18T20:58:43.907 INFO:tasks.workunit.client.0.smithi008.stdout:9/575: mkdir d2/dc/d1a/d1d/da7 0 2023-10-18T20:58:43.917 INFO:tasks.workunit.client.1.smithi060.stdout:2/857: write d0/d8/f8a [57976,107141] 0 2023-10-18T20:58:43.918 INFO:tasks.workunit.client.1.smithi060.stdout:2/858: truncate d0/d45/d49/d55/dbf/fec 708094 0 2023-10-18T20:58:43.918 INFO:tasks.workunit.client.0.smithi008.stdout:2/656: rename d1/d3/dd/d25/d5c/fd2 to d1/d3/dd/d25/d76/fd4 0 2023-10-18T20:58:43.920 INFO:tasks.workunit.client.1.smithi060.stdout:2/859: rename d0/d8/d87/d107/d119 to d0/d16/dc8/d11f 0 2023-10-18T20:58:43.921 INFO:tasks.workunit.client.1.smithi060.stdout:2/860: write d0/d3/d27/d7b/ffb [570304,9092] 0 2023-10-18T20:58:43.925 INFO:tasks.workunit.client.1.smithi060.stdout:2/861: chown d0/d8/d87/d107 11893963 1 2023-10-18T20:58:43.926 INFO:tasks.workunit.client.1.smithi060.stdout:2/862: truncate d0/d3/d27/fe0 877853 0 2023-10-18T20:58:43.926 INFO:tasks.workunit.client.1.smithi060.stdout:2/863: dread - d0/d3/d27/d4d/d53/fd6 zero size 2023-10-18T20:58:43.926 INFO:tasks.workunit.client.1.smithi060.stdout:7/921: sync 2023-10-18T20:58:43.927 INFO:tasks.workunit.client.1.smithi060.stdout:7/922: write de/d14/d2f/d8f/d5b/d9e/fd1 [1134406,41401] 0 2023-10-18T20:58:43.927 INFO:tasks.workunit.client.0.smithi008.stdout:0/572: creat d0/d7c/d9a/d8a/fae x:0 0 0 2023-10-18T20:58:43.928 INFO:tasks.workunit.client.0.smithi008.stdout:6/723: write df/d3c/da2/dcf/d3f/f8e [3471980,18494] 0 2023-10-18T20:58:43.928 INFO:tasks.workunit.client.0.smithi008.stdout:6/724: chown df/d3c/da2/dcf/d3f/ce7 2697 1 2023-10-18T20:58:43.928 INFO:tasks.workunit.client.1.smithi060.stdout:4/793: dread d4/dc/f29 [0,4194304] 0 2023-10-18T20:58:43.929 INFO:tasks.workunit.client.1.smithi060.stdout:4/794: dread - d4/dc/d2a/d39/d53/d76/da7/dca/dc4/feb zero size 2023-10-18T20:58:43.932 INFO:tasks.workunit.client.0.smithi008.stdout:9/576: creat d2/d64/d90/fa8 x:0 0 0 2023-10-18T20:58:43.933 INFO:tasks.workunit.client.1.smithi060.stdout:6/864: dread d10/d17/d54/dd4/f8f [0,4194304] 0 2023-10-18T20:58:43.934 INFO:tasks.workunit.client.1.smithi060.stdout:7/923: creat de/d14/d49/d68/d7d/d7e/db5/f12c x:0 0 0 2023-10-18T20:58:43.934 INFO:tasks.workunit.client.1.smithi060.stdout:6/865: write d10/d47/f91 [1737612,6922] 0 2023-10-18T20:58:43.934 INFO:tasks.workunit.client.1.smithi060.stdout:6/866: write d10/d2e/d75/ff0 [1038835,121120] 0 2023-10-18T20:58:43.934 INFO:tasks.workunit.client.1.smithi060.stdout:4/795: write d4/dc/d2a/fb2 [777094,107172] 0 2023-10-18T20:58:43.935 INFO:tasks.workunit.client.1.smithi060.stdout:6/867: truncate d10/d17/d54/db1/fbd 4850107 0 2023-10-18T20:58:43.935 INFO:tasks.workunit.client.1.smithi060.stdout:6/868: creat d10/d2e/f111 x:0 0 0 2023-10-18T20:58:43.935 INFO:tasks.workunit.client.1.smithi060.stdout:9/776: dwrite d3/d99/d1c/d5a/d5d/d56/dd0/fac [0,4194304] 0 2023-10-18T20:58:43.940 INFO:tasks.workunit.client.1.smithi060.stdout:1/960: dread d4/d6/d7/d2f/ff5 [0,4194304] 0 2023-10-18T20:58:43.940 INFO:tasks.workunit.client.1.smithi060.stdout:1/961: fsync d4/d6/d33/d58/f76 0 2023-10-18T20:58:43.945 INFO:tasks.workunit.client.1.smithi060.stdout:7/924: creat de/d14/d41/dc6/f12d x:0 0 0 2023-10-18T20:58:43.945 INFO:tasks.workunit.client.1.smithi060.stdout:7/925: stat de/d14/d2f/f71 0 2023-10-18T20:58:43.945 INFO:tasks.workunit.client.0.smithi008.stdout:4/560: dwrite d0/d58/d8e/f6d [0,4194304] 0 2023-10-18T20:58:43.946 INFO:tasks.workunit.client.0.smithi008.stdout:2/657: creat d1/d3/d79/fd5 x:0 0 0 2023-10-18T20:58:43.948 INFO:tasks.workunit.client.1.smithi060.stdout:4/796: mknod d4/dc/d2a/d39/d53/d76/da7/dca/dc4/cf5 0 2023-10-18T20:58:43.948 INFO:tasks.workunit.client.1.smithi060.stdout:4/797: fsync d4/dc/d40/da8/ff3 0 2023-10-18T20:58:43.949 INFO:tasks.workunit.client.1.smithi060.stdout:9/777: mknod d3/d99/d1c/d116/d2d/db9/c11f 0 2023-10-18T20:58:43.949 INFO:tasks.workunit.client.1.smithi060.stdout:9/778: chown d3/d99/d65/f81 748311 1 2023-10-18T20:58:43.953 INFO:tasks.workunit.client.0.smithi008.stdout:2/658: mknod d1/d3/dd/d1c/d3a/d45/d83/cd6 0 2023-10-18T20:58:43.955 INFO:tasks.workunit.client.1.smithi060.stdout:0/818: dwrite d3/ff5 [0,4194304] 0 2023-10-18T20:58:43.956 INFO:tasks.workunit.client.1.smithi060.stdout:7/926: rename de/fa2 to de/d29/d9c/db1/f12e 0 2023-10-18T20:58:43.958 INFO:tasks.workunit.client.1.smithi060.stdout:7/927: dread - de/d14/d3a/f10f zero size 2023-10-18T20:58:43.958 INFO:tasks.workunit.client.1.smithi060.stdout:7/928: chown de/d29/d9c/db1/fd6 6 1 2023-10-18T20:58:43.959 INFO:tasks.workunit.client.1.smithi060.stdout:7/929: creat de/d14/d3a/f12f x:0 0 0 2023-10-18T20:58:43.960 INFO:tasks.workunit.client.1.smithi060.stdout:1/962: mkdir d4/d6/d7/d2f/d7b/d2a/d32/dd/d81/d137 0 2023-10-18T20:58:43.961 INFO:tasks.workunit.client.0.smithi008.stdout:0/573: rmdir d0/dd 39 2023-10-18T20:58:43.964 INFO:tasks.workunit.client.1.smithi060.stdout:0/819: dread d3/d8/d14/f5b [0,4194304] 0 2023-10-18T20:58:43.968 INFO:tasks.workunit.client.1.smithi060.stdout:7/930: mkdir de/d29/d72/d84/d130 0 2023-10-18T20:58:43.968 INFO:tasks.workunit.client.1.smithi060.stdout:7/931: read - de/d14/d49/d68/d106/f11e zero size 2023-10-18T20:58:43.969 INFO:tasks.workunit.client.1.smithi060.stdout:7/932: write de/d14/d49/d68/d7d/d7e/f110 [934787,100690] 0 2023-10-18T20:58:43.969 INFO:tasks.workunit.client.0.smithi008.stdout:2/659: unlink d1/d3/dd/d1c/f74 0 2023-10-18T20:58:43.969 INFO:tasks.workunit.client.0.smithi008.stdout:2/660: truncate d1/d3/dd/d1c/d3a/d57/f67 4765141 0 2023-10-18T20:58:43.970 INFO:tasks.workunit.client.0.smithi008.stdout:2/661: unlink d1/d3/dd/f65 0 2023-10-18T20:58:43.970 INFO:tasks.workunit.client.0.smithi008.stdout:2/662: write d1/d3/d79/fd5 [492614,7316] 0 2023-10-18T20:58:43.971 INFO:tasks.workunit.client.0.smithi008.stdout:0/574: creat d0/dd/df/faf x:0 0 0 2023-10-18T20:58:43.971 INFO:tasks.workunit.client.0.smithi008.stdout:0/575: write d0/dd/d19/d5f/f83 [674162,59524] 0 2023-10-18T20:58:43.971 INFO:tasks.workunit.client.1.smithi060.stdout:0/820: mkdir d3/de5/d107 0 2023-10-18T20:58:43.971 INFO:tasks.workunit.client.1.smithi060.stdout:0/821: write d3/d8/d3c/ff0 [1085245,27955] 0 2023-10-18T20:58:43.972 INFO:tasks.workunit.client.1.smithi060.stdout:0/822: readlink d3/d8/d3c/l6e 0 2023-10-18T20:58:43.972 INFO:tasks.workunit.client.1.smithi060.stdout:4/798: creat d4/dc/d2a/d13/d27/d68/d9e/ff6 x:0 0 0 2023-10-18T20:58:43.972 INFO:tasks.workunit.client.1.smithi060.stdout:4/799: creat d4/d15/d2b/d9f/ff7 x:0 0 0 2023-10-18T20:58:43.974 INFO:tasks.workunit.client.1.smithi060.stdout:0/823: mknod d3/d8/d14/dec/c108 0 2023-10-18T20:58:43.974 INFO:tasks.workunit.client.1.smithi060.stdout:4/800: rmdir d4/dc/d2a/d39/d53/d5f 39 2023-10-18T20:58:43.974 INFO:tasks.workunit.client.1.smithi060.stdout:4/801: write d4/d15/d2b/d9f/faa [448007,119613] 0 2023-10-18T20:58:43.975 INFO:tasks.workunit.client.1.smithi060.stdout:4/802: chown d4/dc/d2a/d2d/c75 259646 1 2023-10-18T20:58:43.975 INFO:tasks.workunit.client.1.smithi060.stdout:7/933: write de/d14/d41/f43 [1298154,54053] 0 2023-10-18T20:58:43.975 INFO:tasks.workunit.client.1.smithi060.stdout:7/934: write de/d14/d2f/d8f/d5b/f7a [987833,37826] 0 2023-10-18T20:58:43.975 INFO:tasks.workunit.client.1.smithi060.stdout:7/935: fsync de/d14/d3a/fb6 0 2023-10-18T20:58:43.982 INFO:tasks.workunit.client.1.smithi060.stdout:4/803: mknod d4/d15/d2b/cf8 0 2023-10-18T20:58:43.983 INFO:tasks.workunit.client.1.smithi060.stdout:4/804: stat d4/dc/d2a/f1f 0 2023-10-18T20:58:43.984 INFO:tasks.workunit.client.1.smithi060.stdout:1/963: read d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/d112/f114 [1443045,36950] 0 2023-10-18T20:58:43.988 INFO:tasks.workunit.client.0.smithi008.stdout:2/663: getdents d1/d3/dd/d1c/d3a 0 2023-10-18T20:58:43.990 INFO:tasks.workunit.client.0.smithi008.stdout:8/806: rename d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/d95 to d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/d117/d122 0 2023-10-18T20:58:43.993 INFO:tasks.workunit.client.1.smithi060.stdout:4/805: rename d4/f43 to d4/dc/d2a/d2d/d69/d89/ff9 0 2023-10-18T20:58:43.993 INFO:tasks.workunit.client.1.smithi060.stdout:9/779: write d3/d99/d1c/d5a/d5d/d56/dd0/fac [548218,77333] 0 2023-10-18T20:58:43.997 INFO:tasks.workunit.client.0.smithi008.stdout:8/807: mkdir d5/d8/df/d9d/d85/db1/d123 0 2023-10-18T20:58:44.003 INFO:tasks.workunit.client.1.smithi060.stdout:7/936: rmdir de 39 2023-10-18T20:58:44.003 INFO:tasks.workunit.client.1.smithi060.stdout:9/780: rmdir d3/d99/d1c/d116/d2d/db9 39 2023-10-18T20:58:44.006 INFO:tasks.workunit.client.1.smithi060.stdout:7/937: creat de/d14/d49/d68/d106/f131 x:0 0 0 2023-10-18T20:58:44.006 INFO:tasks.workunit.client.1.smithi060.stdout:9/781: read d3/d99/d1c/d5a/d5d/f75 [230507,114503] 0 2023-10-18T20:58:44.007 INFO:tasks.workunit.client.1.smithi060.stdout:7/938: rmdir de/d14/d3a/d46/d73 39 2023-10-18T20:58:44.008 INFO:tasks.workunit.client.0.smithi008.stdout:3/702: read d0/f59 [5093863,111034] 0 2023-10-18T20:58:44.008 INFO:tasks.workunit.client.0.smithi008.stdout:3/703: chown d0/d3/d37/cc2 841712922 1 2023-10-18T20:58:44.009 INFO:tasks.workunit.client.1.smithi060.stdout:9/782: rmdir d3/d99/d1c/d116/d80 39 2023-10-18T20:58:44.009 INFO:tasks.workunit.client.1.smithi060.stdout:9/783: stat d3/d99/d1c/d116/d80/da0/dc2/f49 0 2023-10-18T20:58:44.010 INFO:tasks.workunit.client.0.smithi008.stdout:5/632: dwrite d0/d2/d19/d7c/d42/d5a/f69 [0,4194304] 0 2023-10-18T20:58:44.012 INFO:tasks.workunit.client.1.smithi060.stdout:7/939: symlink de/d14/d2f/d3f/d5a/d5f/d114/l132 0 2023-10-18T20:58:44.013 INFO:tasks.workunit.client.0.smithi008.stdout:4/561: rename d0/d3/f77 to d0/d3/d21/d57/d8f/d82/fb8 0 2023-10-18T20:58:44.014 INFO:tasks.workunit.client.1.smithi060.stdout:9/784: rename d3/d99/d1c/d5a/d5d/c71 to d3/d99/d1c/d116/d80/da0/ddd/c120 0 2023-10-18T20:58:44.019 INFO:tasks.workunit.client.0.smithi008.stdout:3/704: symlink d0/d3/d37/ldf 0 2023-10-18T20:58:44.019 INFO:tasks.workunit.client.1.smithi060.stdout:7/940: creat de/d14/d2f/d8f/d5b/f133 x:0 0 0 2023-10-18T20:58:44.024 INFO:tasks.workunit.client.1.smithi060.stdout:7/941: creat de/d14/d2f/d3f/d5a/dc8/f134 x:0 0 0 2023-10-18T20:58:44.027 INFO:tasks.workunit.client.1.smithi060.stdout:7/942: symlink de/d29/l135 0 2023-10-18T20:58:44.027 INFO:tasks.workunit.client.1.smithi060.stdout:7/943: stat de/d38/l51 0 2023-10-18T20:58:44.034 INFO:tasks.workunit.client.0.smithi008.stdout:4/562: symlink d0/d3/d21/d42/lb9 0 2023-10-18T20:58:44.036 INFO:tasks.workunit.client.1.smithi060.stdout:0/824: write d3/d8/d3c/f6d [2646918,14260] 0 2023-10-18T20:58:44.036 INFO:tasks.workunit.client.1.smithi060.stdout:0/825: dread - d3/fef zero size 2023-10-18T20:58:44.037 INFO:tasks.workunit.client.1.smithi060.stdout:2/864: dwrite d0/d16/d85/f8f [0,4194304] 0 2023-10-18T20:58:44.039 INFO:tasks.workunit.client.0.smithi008.stdout:9/577: dwrite d2/dc/d40/d6f/f80 [0,4194304] 0 2023-10-18T20:58:44.040 INFO:tasks.workunit.client.0.smithi008.stdout:9/578: readlink d2/dc/d40/l5f 0 2023-10-18T20:58:44.040 INFO:tasks.workunit.client.1.smithi060.stdout:3/801: dwrite d0/d3c/d3d/fb7 [0,4194304] 0 2023-10-18T20:58:44.041 INFO:tasks.workunit.client.1.smithi060.stdout:3/802: readlink d0/l5 0 2023-10-18T20:58:44.041 INFO:tasks.workunit.client.1.smithi060.stdout:3/803: creat d0/d22/d26/d79/f117 x:0 0 0 2023-10-18T20:58:44.052 INFO:tasks.workunit.client.1.smithi060.stdout:2/865: unlink d0/d3/c82 0 2023-10-18T20:58:44.053 INFO:tasks.workunit.client.1.smithi060.stdout:2/866: read d0/d8/fd [893577,111474] 0 2023-10-18T20:58:44.053 INFO:tasks.workunit.client.1.smithi060.stdout:2/867: chown d0/d3/d9e/dc2/l105 5460 1 2023-10-18T20:58:44.058 INFO:tasks.workunit.client.1.smithi060.stdout:2/868: mknod d0/d3/d27/c120 0 2023-10-18T20:58:44.060 INFO:tasks.workunit.client.1.smithi060.stdout:2/869: stat d0/d8/c40 0 2023-10-18T20:58:44.063 INFO:tasks.workunit.client.0.smithi008.stdout:8/808: dwrite d5/d8/df/d9d/d6c/faa [0,4194304] 0 2023-10-18T20:58:44.065 INFO:tasks.workunit.client.1.smithi060.stdout:4/806: dwrite d4/dc/d2a/d2d/f4f [0,4194304] 0 2023-10-18T20:58:44.068 INFO:tasks.workunit.client.0.smithi008.stdout:8/809: symlink d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/df5/l124 0 2023-10-18T20:58:44.077 INFO:tasks.workunit.client.1.smithi060.stdout:3/804: read d0/d22/d26/f61 [2911448,94585] 0 2023-10-18T20:58:44.077 INFO:tasks.workunit.client.1.smithi060.stdout:3/805: chown d0/d22/d26/d79/f117 135 1 2023-10-18T20:58:44.082 INFO:tasks.workunit.client.0.smithi008.stdout:6/725: dwrite df/f3b [0,4194304] 0 2023-10-18T20:58:44.082 INFO:tasks.workunit.client.0.smithi008.stdout:6/726: stat df/d36/la5 0 2023-10-18T20:58:44.082 INFO:tasks.workunit.client.0.smithi008.stdout:6/727: dread - df/d3c/da2/dcf/d58/dec/daa/fd9 zero size 2023-10-18T20:58:44.082 INFO:tasks.workunit.client.1.smithi060.stdout:4/807: write d4/dc/d2a/d39/f7f [960945,79809] 0 2023-10-18T20:58:44.083 INFO:tasks.workunit.client.1.smithi060.stdout:4/808: dread - d4/d15/d2b/d9f/ff7 zero size 2023-10-18T20:58:44.083 INFO:tasks.workunit.client.1.smithi060.stdout:4/809: creat d4/dc/d2a/d13/ffa x:0 0 0 2023-10-18T20:58:44.086 INFO:tasks.workunit.client.0.smithi008.stdout:8/810: rename d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/dbf to d5/d8/df/dce/dfa/d125 0 2023-10-18T20:58:44.086 INFO:tasks.workunit.client.0.smithi008.stdout:8/811: fsync d5/d8/df/d2e/f11d 0 2023-10-18T20:58:44.087 INFO:tasks.workunit.client.0.smithi008.stdout:8/812: fdatasync d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/fda 0 2023-10-18T20:58:44.087 INFO:tasks.workunit.client.1.smithi060.stdout:3/806: rename d0/f20 to d0/d22/d26/d29/dae/de4/f118 0 2023-10-18T20:58:44.090 INFO:tasks.workunit.client.1.smithi060.stdout:1/964: dwrite d4/d6/d7/d35/fc0 [0,4194304] 0 2023-10-18T20:58:44.093 INFO:tasks.workunit.client.1.smithi060.stdout:1/965: symlink d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/l138 0 2023-10-18T20:58:44.094 INFO:tasks.workunit.client.0.smithi008.stdout:6/728: mknod df/d3c/da2/dcf/d68/cf9 0 2023-10-18T20:58:44.095 INFO:tasks.workunit.client.1.smithi060.stdout:0/826: dwrite d3/d8/d14/d55/d74/d76/d68/fdd [0,4194304] 0 2023-10-18T20:58:44.095 INFO:tasks.workunit.client.0.smithi008.stdout:2/664: dwrite d1/d3/d40/d6e/f78 [0,4194304] 0 2023-10-18T20:58:44.097 INFO:tasks.workunit.client.1.smithi060.stdout:0/827: creat d3/d32/d86/f109 x:0 0 0 2023-10-18T20:58:44.099 INFO:tasks.workunit.client.1.smithi060.stdout:9/785: dwrite d3/d99/d1c/d5a/d5d/d56/dd0/fac [4194304,4194304] 0 2023-10-18T20:58:44.099 INFO:tasks.workunit.client.1.smithi060.stdout:9/786: fdatasync d3/d58/f7b 0 2023-10-18T20:58:44.100 INFO:tasks.workunit.client.0.smithi008.stdout:4/563: dwrite d0/d17/f6c [0,4194304] 0 2023-10-18T20:58:44.103 INFO:tasks.workunit.client.0.smithi008.stdout:8/813: symlink d5/d8/df/d9d/d6c/l126 0 2023-10-18T20:58:44.104 INFO:tasks.workunit.client.0.smithi008.stdout:8/814: chown d5/d8/df/d9d/d85/db1/dcc/d104/c93 126 1 2023-10-18T20:58:44.105 INFO:tasks.workunit.client.1.smithi060.stdout:4/810: dread d4/dc/d2a/d13/d27/d68/f6b [0,4194304] 0 2023-10-18T20:58:44.105 INFO:tasks.workunit.client.1.smithi060.stdout:9/787: symlink d3/d99/d1c/d116/d80/da0/dc2/de0/l121 0 2023-10-18T20:58:44.105 INFO:tasks.workunit.client.0.smithi008.stdout:2/665: mknod d1/d3/dd/d25/d76/d59/d85/dba/cd7 0 2023-10-18T20:58:44.106 INFO:tasks.workunit.client.0.smithi008.stdout:2/666: chown d1/d3/dd/d25/d76/fd4 1 1 2023-10-18T20:58:44.107 INFO:tasks.workunit.client.0.smithi008.stdout:2/667: readlink d1/d3/l33 0 2023-10-18T20:58:44.107 INFO:tasks.workunit.client.0.smithi008.stdout:0/576: dwrite d0/dd/d19/f8d [0,4194304] 0 2023-10-18T20:58:44.107 INFO:tasks.workunit.client.0.smithi008.stdout:3/705: dwrite d0/d4a/fd2 [0,4194304] 0 2023-10-18T20:58:44.108 INFO:tasks.workunit.client.1.smithi060.stdout:3/807: dread d0/d5e/fd4 [0,4194304] 0 2023-10-18T20:58:44.112 INFO:tasks.workunit.client.0.smithi008.stdout:5/633: dwrite d0/d6e/f7d [0,4194304] 0 2023-10-18T20:58:44.114 INFO:tasks.workunit.client.1.smithi060.stdout:3/808: creat d0/d3c/d3d/d4d/d95/dc9/f119 x:0 0 0 2023-10-18T20:58:44.119 INFO:tasks.workunit.client.0.smithi008.stdout:8/815: creat d5/d8/df/d9d/d85/db1/dcc/d104/f127 x:0 0 0 2023-10-18T20:58:44.120 INFO:tasks.workunit.client.1.smithi060.stdout:5/852: sync 2023-10-18T20:58:44.121 INFO:tasks.workunit.client.1.smithi060.stdout:2/870: dwrite d0/d16/d85/de3/f10b [0,4194304] 0 2023-10-18T20:58:44.122 INFO:tasks.workunit.client.1.smithi060.stdout:2/871: fdatasync d0/f5d 0 2023-10-18T20:58:44.122 INFO:tasks.workunit.client.0.smithi008.stdout:6/729: dread df/d3c/da2/dcf/f21 [0,4194304] 0 2023-10-18T20:58:44.123 INFO:tasks.workunit.client.0.smithi008.stdout:4/564: dread d0/f14 [0,4194304] 0 2023-10-18T20:58:44.124 INFO:tasks.workunit.client.1.smithi060.stdout:5/853: unlink d0/da/d3b/d43/ld3 0 2023-10-18T20:58:44.124 INFO:tasks.workunit.client.0.smithi008.stdout:4/565: stat d0/f27 0 2023-10-18T20:58:44.124 INFO:tasks.workunit.client.0.smithi008.stdout:4/566: unlink d0/d17/d6e/f9f 0 2023-10-18T20:58:44.124 INFO:tasks.workunit.client.0.smithi008.stdout:4/567: chown d0/d17/d5b/f5f 1614317 1 2023-10-18T20:58:44.125 INFO:tasks.workunit.client.0.smithi008.stdout:6/730: write df/d15/d27/f52 [5109260,75831] 0 2023-10-18T20:58:44.126 INFO:tasks.workunit.client.0.smithi008.stdout:6/731: chown df/d3c/da2/dcf/d58/dec/d53/d64 74856 1 2023-10-18T20:58:44.126 INFO:tasks.workunit.client.0.smithi008.stdout:6/732: write df/d3c/d77/fb3 [135990,112431] 0 2023-10-18T20:58:44.126 INFO:tasks.workunit.client.0.smithi008.stdout:6/733: write df/d15/fab [312170,93489] 0 2023-10-18T20:58:44.128 INFO:tasks.workunit.client.0.smithi008.stdout:0/577: mkdir d0/d7c/d9a/d8a/db0 0 2023-10-18T20:58:44.129 INFO:tasks.workunit.client.1.smithi060.stdout:5/854: link d0/da/dc8/de4/d6d/cf8 d0/da/c12f 0 2023-10-18T20:58:44.131 INFO:tasks.workunit.client.0.smithi008.stdout:7/702: sync 2023-10-18T20:58:44.132 INFO:tasks.workunit.client.0.smithi008.stdout:9/579: truncate d2/dc/d40/d6f/f80 541596 0 2023-10-18T20:58:44.135 INFO:tasks.workunit.client.1.smithi060.stdout:3/809: write d0/f11 [2166815,17403] 0 2023-10-18T20:58:44.135 INFO:tasks.workunit.client.1.smithi060.stdout:4/811: read d4/dc/d2a/d13/f56 [824374,122497] 0 2023-10-18T20:58:44.135 INFO:tasks.workunit.client.1.smithi060.stdout:4/812: write d4/d15/d2b/f86 [976455,16916] 0 2023-10-18T20:58:44.137 INFO:tasks.workunit.client.0.smithi008.stdout:3/706: mkdir d0/d3/de/d13/d35/dbf/de0 0 2023-10-18T20:58:44.138 INFO:tasks.workunit.client.0.smithi008.stdout:3/707: dread - d0/d3/d37/f78 zero size 2023-10-18T20:58:44.138 INFO:tasks.workunit.client.0.smithi008.stdout:3/708: read d0/d3/d42/f30 [841876,74898] 0 2023-10-18T20:58:44.148 INFO:tasks.workunit.client.0.smithi008.stdout:5/634: dread d0/d2/d19/d7c/d42/f4e [0,4194304] 0 2023-10-18T20:58:44.148 INFO:tasks.workunit.client.0.smithi008.stdout:8/816: dread d5/d8/df/f19 [0,4194304] 0 2023-10-18T20:58:44.155 INFO:tasks.workunit.client.1.smithi060.stdout:5/855: dread d0/d6/d8/df/f107 [0,4194304] 0 2023-10-18T20:58:44.157 INFO:tasks.workunit.client.1.smithi060.stdout:0/828: dwrite d3/d8/d14/d55/d74/d76/d68/d7f/fc8 [0,4194304] 0 2023-10-18T20:58:44.159 INFO:tasks.workunit.client.0.smithi008.stdout:3/709: dread d0/d3/f97 [0,4194304] 0 2023-10-18T20:58:44.159 INFO:tasks.workunit.client.0.smithi008.stdout:3/710: getdents d0/db2 0 2023-10-18T20:58:44.159 INFO:tasks.workunit.client.0.smithi008.stdout:3/711: chown d0/dc0 49804 1 2023-10-18T20:58:44.162 INFO:tasks.workunit.client.0.smithi008.stdout:5/635: dread d0/d6e/f7d [0,4194304] 0 2023-10-18T20:58:44.165 INFO:tasks.workunit.client.1.smithi060.stdout:5/856: mknod d0/da/dc8/de4/d6d/db6/c130 0 2023-10-18T20:58:44.167 INFO:tasks.workunit.client.1.smithi060.stdout:0/829: creat d3/d8/d14/d55/dad/f10a x:0 0 0 2023-10-18T20:58:44.167 INFO:tasks.workunit.client.1.smithi060.stdout:4/813: read d4/dc/d2a/d13/f3a [1755351,103439] 0 2023-10-18T20:58:44.167 INFO:tasks.workunit.client.1.smithi060.stdout:4/814: unlink d4/dc/d40/c60 0 2023-10-18T20:58:44.168 INFO:tasks.workunit.client.1.smithi060.stdout:4/815: write d4/dc/d2a/d13/f9b [187043,15215] 0 2023-10-18T20:58:44.168 INFO:tasks.workunit.client.0.smithi008.stdout:4/568: symlink d0/d76/lba 0 2023-10-18T20:58:44.169 INFO:tasks.workunit.client.0.smithi008.stdout:1/717: sync 2023-10-18T20:58:44.169 INFO:tasks.workunit.client.0.smithi008.stdout:0/578: link d0/d7c/f81 d0/d7c/d9a/d8a/db0/fb1 0 2023-10-18T20:58:44.169 INFO:tasks.workunit.client.0.smithi008.stdout:9/580: creat d2/dc/d40/d6f/d92/d59/fa9 x:0 0 0 2023-10-18T20:58:44.169 INFO:tasks.workunit.client.0.smithi008.stdout:1/718: write d9/de/df/d17/d25/f63 [3553873,130091] 0 2023-10-18T20:58:44.170 INFO:tasks.workunit.client.0.smithi008.stdout:7/703: rename d1/d3/l97 to d1/d36/d3d/dc3/ldc 0 2023-10-18T20:58:44.171 INFO:tasks.workunit.client.1.smithi060.stdout:0/830: getdents d3/d8/d14/d55/d9a/dcf 0 2023-10-18T20:58:44.171 INFO:tasks.workunit.client.0.smithi008.stdout:2/668: dwrite d1/d3/d40/f86 [0,4194304] 0 2023-10-18T20:58:44.173 INFO:tasks.workunit.client.0.smithi008.stdout:8/817: creat d5/d8/df/d9d/d4d/db5/da3/d10a/f128 x:0 0 0 2023-10-18T20:58:44.173 INFO:tasks.workunit.client.0.smithi008.stdout:3/712: creat d0/db2/fe1 x:0 0 0 2023-10-18T20:58:44.174 INFO:tasks.workunit.client.0.smithi008.stdout:5/636: mknod d0/d2/d9/d9b/d62/cea 0 2023-10-18T20:58:44.174 INFO:tasks.workunit.client.0.smithi008.stdout:4/569: mknod d0/d58/d8e/cbb 0 2023-10-18T20:58:44.174 INFO:tasks.workunit.client.0.smithi008.stdout:5/637: dread - d0/d2/d19/d7c/d31/d3f/d70/fa8 zero size 2023-10-18T20:58:44.178 INFO:tasks.workunit.client.0.smithi008.stdout:2/669: dread d1/d3/f1b [0,4194304] 0 2023-10-18T20:58:44.178 INFO:tasks.workunit.client.0.smithi008.stdout:6/734: symlink df/d3c/da2/dcf/d58/dec/d53/d64/lfa 0 2023-10-18T20:58:44.179 INFO:tasks.workunit.client.0.smithi008.stdout:6/735: stat df/f24 0 2023-10-18T20:58:44.179 INFO:tasks.workunit.client.0.smithi008.stdout:6/736: read - df/dd1/fe6 zero size 2023-10-18T20:58:44.179 INFO:tasks.workunit.client.0.smithi008.stdout:0/579: creat d0/d7c/d9a/d8a/d8f/fb2 x:0 0 0 2023-10-18T20:58:44.181 INFO:tasks.workunit.client.0.smithi008.stdout:0/580: write d0/f51 [58025,109359] 0 2023-10-18T20:58:44.181 INFO:tasks.workunit.client.0.smithi008.stdout:9/581: mknod d2/dc/d17/d19/d4a/d9a/caa 0 2023-10-18T20:58:44.182 INFO:tasks.workunit.client.0.smithi008.stdout:1/719: symlink d9/de/df/d17/d1e/d7d/d89/lde 0 2023-10-18T20:58:44.183 INFO:tasks.workunit.client.0.smithi008.stdout:7/704: mkdir d1/d3/d20/d5f/dba/ddd 0 2023-10-18T20:58:44.183 INFO:tasks.workunit.client.0.smithi008.stdout:7/705: truncate d1/d3/d20/f89 988882 0 2023-10-18T20:58:44.184 INFO:tasks.workunit.client.1.smithi060.stdout:5/857: dread d0/d6/d9/d82/d84/db2/d2a/f5a [0,4194304] 0 2023-10-18T20:58:44.185 INFO:tasks.workunit.client.0.smithi008.stdout:8/818: read d5/d8/df/f75 [4083262,123483] 0 2023-10-18T20:58:44.185 INFO:tasks.workunit.client.0.smithi008.stdout:3/713: creat d0/d3/d37/d6f/fe2 x:0 0 0 2023-10-18T20:58:44.185 INFO:tasks.workunit.client.0.smithi008.stdout:3/714: write d0/fac [352653,47171] 0 2023-10-18T20:58:44.186 INFO:tasks.workunit.client.0.smithi008.stdout:3/715: stat d0/d3/d42/d88/dae 0 2023-10-18T20:58:44.186 INFO:tasks.workunit.client.0.smithi008.stdout:3/716: creat d0/d3/d37/d74/fe3 x:0 0 0 2023-10-18T20:58:44.186 INFO:tasks.workunit.client.0.smithi008.stdout:4/570: symlink d0/d3/d21/d42/lbc 0 2023-10-18T20:58:44.188 INFO:tasks.workunit.client.0.smithi008.stdout:2/670: rename d1/d3/dd/d25/d76/d59/fcb to d1/d3/d40/d6e/fd8 0 2023-10-18T20:58:44.188 INFO:tasks.workunit.client.1.smithi060.stdout:5/858: link d0/ldc d0/da/dc8/de4/d6d/l131 0 2023-10-18T20:58:44.188 INFO:tasks.workunit.client.1.smithi060.stdout:5/859: truncate d0/d6/f1e 6452309 0 2023-10-18T20:58:44.189 INFO:tasks.workunit.client.1.smithi060.stdout:5/860: unlink d0/da/d3b/d43/f50 0 2023-10-18T20:58:44.189 INFO:tasks.workunit.client.0.smithi008.stdout:6/737: creat df/d15/d27/ffb x:0 0 0 2023-10-18T20:58:44.189 INFO:tasks.workunit.client.0.smithi008.stdout:6/738: fsync df/d3c/da2/dcf/d58/dec/daa/dcb/feb 0 2023-10-18T20:58:44.195 INFO:tasks.workunit.client.0.smithi008.stdout:0/581: mkdir d0/d7c/d9a/d8a/db0/db3 0 2023-10-18T20:58:44.195 INFO:tasks.workunit.client.0.smithi008.stdout:9/582: fdatasync d2/dc/d40/d5a/f95 0 2023-10-18T20:58:44.196 INFO:tasks.workunit.client.0.smithi008.stdout:0/582: write d0/dd/df/f4c [5116417,70868] 0 2023-10-18T20:58:44.196 INFO:tasks.workunit.client.0.smithi008.stdout:9/583: creat d2/dc/d17/d19/d4a/fab x:0 0 0 2023-10-18T20:58:44.196 INFO:tasks.workunit.client.0.smithi008.stdout:9/584: fsync d2/dc/d17/d7b/fa2 0 2023-10-18T20:58:44.196 INFO:tasks.workunit.client.0.smithi008.stdout:9/585: truncate d2/dc/d1a/d1d/f7c 5111759 0 2023-10-18T20:58:44.198 INFO:tasks.workunit.client.0.smithi008.stdout:1/720: truncate d9/de/df/d17/d1e/d7d/fab 870476 0 2023-10-18T20:58:44.201 INFO:tasks.workunit.client.0.smithi008.stdout:8/819: rmdir d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec 39 2023-10-18T20:58:44.201 INFO:tasks.workunit.client.0.smithi008.stdout:3/717: creat d0/d3/de/fe4 x:0 0 0 2023-10-18T20:58:44.201 INFO:tasks.workunit.client.0.smithi008.stdout:3/718: chown d0/d3/f33 5705 1 2023-10-18T20:58:44.201 INFO:tasks.workunit.client.0.smithi008.stdout:3/719: chown d0/d4a/d64/l92 1935322 1 2023-10-18T20:58:44.202 INFO:tasks.workunit.client.0.smithi008.stdout:2/671: mknod d1/d3/dd/d1c/cd9 0 2023-10-18T20:58:44.204 INFO:tasks.workunit.client.0.smithi008.stdout:6/739: creat df/d15/d48/d81/ffc x:0 0 0 2023-10-18T20:58:44.205 INFO:tasks.workunit.client.0.smithi008.stdout:4/571: dread d0/d76/fa1 [0,4194304] 0 2023-10-18T20:58:44.217 INFO:tasks.workunit.client.0.smithi008.stdout:6/740: dread df/d15/d48/d4b/f7d [0,4194304] 0 2023-10-18T20:58:44.218 INFO:tasks.workunit.client.0.smithi008.stdout:9/586: link d2/dc/d17/d7b/fa2 d2/dc/d1a/fac 0 2023-10-18T20:58:44.218 INFO:tasks.workunit.client.0.smithi008.stdout:9/587: dread - d2/d64/d90/fa8 zero size 2023-10-18T20:58:44.218 INFO:tasks.workunit.client.0.smithi008.stdout:2/672: creat d1/d3/dd/d1c/d3a/d45/fda x:0 0 0 2023-10-18T20:58:44.218 INFO:tasks.workunit.client.0.smithi008.stdout:4/572: rename d0/d3/d21/c2b to d0/d3/d21/d57/d8f/cbd 0 2023-10-18T20:58:44.219 INFO:tasks.workunit.client.0.smithi008.stdout:1/721: mknod d9/de/df/d17/d25/cdf 0 2023-10-18T20:58:44.221 INFO:tasks.workunit.client.0.smithi008.stdout:0/583: rename d0/dd/d19/l4f to d0/dd/d19/lb4 0 2023-10-18T20:58:44.223 INFO:tasks.workunit.client.0.smithi008.stdout:6/741: rename df/d3c/da2/dcf/d58/c83 to df/d15/cfd 0 2023-10-18T20:58:44.223 INFO:tasks.workunit.client.0.smithi008.stdout:6/742: readlink df/d15/d27/d4c/l87 0 2023-10-18T20:58:44.224 INFO:tasks.workunit.client.0.smithi008.stdout:6/743: chown df/d15/d48/fb0 0 1 2023-10-18T20:58:44.224 INFO:tasks.workunit.client.0.smithi008.stdout:6/744: dread - df/d15/d27/d4c/db2/fea zero size 2023-10-18T20:58:44.224 INFO:tasks.workunit.client.0.smithi008.stdout:6/745: chown df/d3c/d77/da9/cd0 945110 1 2023-10-18T20:58:44.224 INFO:tasks.workunit.client.0.smithi008.stdout:6/746: fdatasync df/d15/d48/ded/fe4 0 2023-10-18T20:58:44.225 INFO:tasks.workunit.client.0.smithi008.stdout:4/573: unlink d0/d58/d8e/db4/fa9 0 2023-10-18T20:58:44.227 INFO:tasks.workunit.client.0.smithi008.stdout:6/747: rename df/d3c/da2/dcf/d58 to df/d3c/da2/dcf/d58/dfe 22 2023-10-18T20:58:44.232 INFO:tasks.workunit.client.0.smithi008.stdout:6/748: mkdir df/d3c/da2/dff 0 2023-10-18T20:58:44.238 INFO:tasks.workunit.client.0.smithi008.stdout:4/574: rmdir d0/d17/d5b 39 2023-10-18T20:58:44.239 INFO:tasks.workunit.client.0.smithi008.stdout:5/638: read d0/d2/d19/d7c/d42/f52 [1313709,105912] 0 2023-10-18T20:58:44.242 INFO:tasks.workunit.client.0.smithi008.stdout:6/749: symlink df/d36/l100 0 2023-10-18T20:58:44.242 INFO:tasks.workunit.client.0.smithi008.stdout:6/750: truncate df/d26/ff8 61604 0 2023-10-18T20:58:44.243 INFO:tasks.workunit.client.0.smithi008.stdout:4/575: mknod d0/d17/d5b/cbe 0 2023-10-18T20:58:44.245 INFO:tasks.workunit.client.0.smithi008.stdout:4/576: mkdir d0/d58/dbf 0 2023-10-18T20:58:44.245 INFO:tasks.workunit.client.1.smithi060.stdout:4/816: dwrite d4/dc/d2a/d83/db1/f34 [4194304,4194304] 0 2023-10-18T20:58:44.246 INFO:tasks.workunit.client.1.smithi060.stdout:3/810: dwrite d0/d22/f70 [4194304,4194304] 0 2023-10-18T20:58:44.246 INFO:tasks.workunit.client.1.smithi060.stdout:4/817: creat d4/dc/d2a/d5b/ffb x:0 0 0 2023-10-18T20:58:44.246 INFO:tasks.workunit.client.1.smithi060.stdout:4/818: write d4/dc/d2a/d2d/d69/fd1 [1146042,33056] 0 2023-10-18T20:58:44.248 INFO:tasks.workunit.client.1.smithi060.stdout:4/819: mknod d4/dc/d40/da8/cfc 0 2023-10-18T20:58:44.249 INFO:tasks.workunit.client.0.smithi008.stdout:6/751: rmdir df/dd1 39 2023-10-18T20:58:44.249 INFO:tasks.workunit.client.0.smithi008.stdout:6/752: fdatasync df/d15/d27/d4c/db2/fea 0 2023-10-18T20:58:44.253 INFO:tasks.workunit.client.0.smithi008.stdout:7/706: dwrite d1/d36/d3d/d3e/fb0 [0,4194304] 0 2023-10-18T20:58:44.263 INFO:tasks.workunit.client.1.smithi060.stdout:4/820: link d4/dc/d2a/d5b/f5d d4/d15/ffd 0 2023-10-18T20:58:44.270 INFO:tasks.workunit.client.1.smithi060.stdout:4/821: rename d4/dc/d2a/d13/c63 to d4/dc/d2a/cfe 0 2023-10-18T20:58:44.270 INFO:tasks.workunit.client.1.smithi060.stdout:4/822: write d4/dc/d2a/d13/d27/d68/f6d [4159137,39632] 0 2023-10-18T20:58:44.272 INFO:tasks.workunit.client.0.smithi008.stdout:2/673: dread d1/d3/dd/d48/fd1 [0,4194304] 0 2023-10-18T20:58:44.272 INFO:tasks.workunit.client.0.smithi008.stdout:3/720: dwrite d0/d3/d42/d52/fd4 [0,4194304] 0 2023-10-18T20:58:44.273 INFO:tasks.workunit.client.1.smithi060.stdout:5/861: dwrite d0/da/dc8/de4/ff4 [0,4194304] 0 2023-10-18T20:58:44.274 INFO:tasks.workunit.client.1.smithi060.stdout:5/862: fdatasync d0/da/d3b/f4c 0 2023-10-18T20:58:44.274 INFO:tasks.workunit.client.1.smithi060.stdout:0/831: dwrite d3/d8/d14/d55/d74/d76/d6b/fb3 [4194304,4194304] 0 2023-10-18T20:58:44.275 INFO:tasks.workunit.client.1.smithi060.stdout:0/832: dread - d3/de5/df1/dc3/ff9 zero size 2023-10-18T20:58:44.279 INFO:tasks.workunit.client.0.smithi008.stdout:8/820: dwrite d5/d8/df/d9d/d85/db1/fcf [4194304,4194304] 0 2023-10-18T20:58:44.280 INFO:tasks.workunit.client.0.smithi008.stdout:0/584: rmdir d0/d7c/d9a/d8a 39 2023-10-18T20:58:44.280 INFO:tasks.workunit.client.0.smithi008.stdout:9/588: truncate d2/dc/d1a/d1d/f7c 2274665 0 2023-10-18T20:58:44.280 INFO:tasks.workunit.client.0.smithi008.stdout:9/589: write d2/dc/d17/f16 [1483846,67408] 0 2023-10-18T20:58:44.291 INFO:tasks.workunit.client.1.smithi060.stdout:5/863: getdents d0/d6/d9/d82/d83 0 2023-10-18T20:58:44.291 INFO:tasks.workunit.client.0.smithi008.stdout:2/674: rename d1/d3/d40/f86 to d1/d3/dd/d25/d76/d59/fdb 0 2023-10-18T20:58:44.292 INFO:tasks.workunit.client.0.smithi008.stdout:2/675: getdents d1/d3/dd/d25 0 2023-10-18T20:58:44.292 INFO:tasks.workunit.client.0.smithi008.stdout:2/676: read - d1/d3/dd/d1c/d3a/d49/faf zero size 2023-10-18T20:58:44.292 INFO:tasks.workunit.client.0.smithi008.stdout:2/677: creat d1/d3/dd/d25/d76/d59/d85/db9/fdc x:0 0 0 2023-10-18T20:58:44.293 INFO:tasks.workunit.client.0.smithi008.stdout:3/721: creat d0/d4a/fe5 x:0 0 0 2023-10-18T20:58:44.293 INFO:tasks.workunit.client.0.smithi008.stdout:3/722: truncate d0/d3/d37/d74/fe3 189827 0 2023-10-18T20:58:44.296 INFO:tasks.workunit.client.1.smithi060.stdout:0/833: mknod d3/d8/d14/d55/d74/d76/d68/d7f/c10b 0 2023-10-18T20:58:44.296 INFO:tasks.workunit.client.1.smithi060.stdout:0/834: creat d3/d8/d14/d55/d74/f10c x:0 0 0 2023-10-18T20:58:44.298 INFO:tasks.workunit.client.0.smithi008.stdout:8/821: rename d5/d8/df/d9d/d4d/db5/f64 to d5/d8/df/d9d/d4d/db5/f129 0 2023-10-18T20:58:44.299 INFO:tasks.workunit.client.0.smithi008.stdout:8/822: fdatasync d5/d8/df/d9d/d4d/db5/fc1 0 2023-10-18T20:58:44.299 INFO:tasks.workunit.client.0.smithi008.stdout:0/585: unlink d0/l1f 0 2023-10-18T20:58:44.301 INFO:tasks.workunit.client.1.smithi060.stdout:0/835: unlink d3/d8/d14/d55/d74/d76/d68/d7f/d8d/f9c 0 2023-10-18T20:58:44.302 INFO:tasks.workunit.client.1.smithi060.stdout:5/864: symlink d0/d6/l132 0 2023-10-18T20:58:44.305 INFO:tasks.workunit.client.0.smithi008.stdout:2/678: rename d1/d3/dd/d1c/d3a/d49/fa7 to d1/d3/dd/d25/d4d/fdd 0 2023-10-18T20:58:44.306 INFO:tasks.workunit.client.0.smithi008.stdout:8/823: mknod d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/c12a 0 2023-10-18T20:58:44.306 INFO:tasks.workunit.client.0.smithi008.stdout:3/723: dread d0/d3/de/d13/f75 [0,4194304] 0 2023-10-18T20:58:44.309 INFO:tasks.workunit.client.0.smithi008.stdout:0/586: symlink d0/d3a/lb5 0 2023-10-18T20:58:44.309 INFO:tasks.workunit.client.0.smithi008.stdout:0/587: write d0/dd/d19/d5f/d99/d94/f43 [1538990,4389] 0 2023-10-18T20:58:44.309 INFO:tasks.workunit.client.0.smithi008.stdout:0/588: write d0/dd/f8b [623544,20274] 0 2023-10-18T20:58:44.310 INFO:tasks.workunit.client.1.smithi060.stdout:0/836: link d3/d8/d14/d55/d74/d76/d68/d7f/c10b d3/d8/d3c/d87/c10d 0 2023-10-18T20:58:44.312 INFO:tasks.workunit.client.0.smithi008.stdout:2/679: mknod d1/d3/dd/d25/d76/cde 0 2023-10-18T20:58:44.312 INFO:tasks.workunit.client.0.smithi008.stdout:5/639: dwrite d0/d2/d19/d7c/d31/d3f/f5f [0,4194304] 0 2023-10-18T20:58:44.312 INFO:tasks.workunit.client.0.smithi008.stdout:5/640: dread - d0/d2/d19/d7c/d58/d65/fd5 zero size 2023-10-18T20:58:44.313 INFO:tasks.workunit.client.0.smithi008.stdout:6/753: dwrite df/d3c/da2/dcf/d68/fdb [0,4194304] 0 2023-10-18T20:58:44.314 INFO:tasks.workunit.client.0.smithi008.stdout:0/589: mknod d0/cb6 0 2023-10-18T20:58:44.314 INFO:tasks.workunit.client.0.smithi008.stdout:0/590: chown d0/dd/d19/d5f/d99/d94 1 1 2023-10-18T20:58:44.315 INFO:tasks.workunit.client.0.smithi008.stdout:0/591: fsync d0/dd/d19/f3c 0 2023-10-18T20:58:44.315 INFO:tasks.workunit.client.1.smithi060.stdout:5/865: creat d0/d6/d9/d82/d83/d99/f133 x:0 0 0 2023-10-18T20:58:44.315 INFO:tasks.workunit.client.1.smithi060.stdout:5/866: stat d0/f1d 0 2023-10-18T20:58:44.317 INFO:tasks.workunit.client.0.smithi008.stdout:5/641: creat d0/d6e/feb x:0 0 0 2023-10-18T20:58:44.318 INFO:tasks.workunit.client.1.smithi060.stdout:0/837: write d3/d8/f57 [4665889,43347] 0 2023-10-18T20:58:44.318 INFO:tasks.workunit.client.1.smithi060.stdout:0/838: chown d3/d8/d3c/d87/lde 51320 1 2023-10-18T20:58:44.318 INFO:tasks.workunit.client.1.smithi060.stdout:0/839: stat d3/d8/d3c/l4a 0 2023-10-18T20:58:44.319 INFO:tasks.workunit.client.0.smithi008.stdout:0/592: mkdir d0/dd/d19/d5f/d99/d5e/d7d/db7 0 2023-10-18T20:58:44.321 INFO:tasks.workunit.client.0.smithi008.stdout:5/642: mkdir d0/dec 0 2023-10-18T20:58:44.322 INFO:tasks.workunit.client.0.smithi008.stdout:5/643: truncate d0/d86/f8c 1500804 0 2023-10-18T20:58:44.322 INFO:tasks.workunit.client.0.smithi008.stdout:5/644: chown d0/d2/d19/d7c/d64/c6a 0 1 2023-10-18T20:58:44.323 INFO:tasks.workunit.client.0.smithi008.stdout:0/593: truncate d0/dd/d19/fa8 3177 0 2023-10-18T20:58:44.323 INFO:tasks.workunit.client.0.smithi008.stdout:0/594: read - d0/dd/d19/d5f/d99/d5e/d7d/f9f zero size 2023-10-18T20:58:44.324 INFO:tasks.workunit.client.0.smithi008.stdout:5/645: stat d0/d2/d19/l7b 0 2023-10-18T20:58:44.324 INFO:tasks.workunit.client.0.smithi008.stdout:5/646: dread - d0/d2/d9/d9b/d6f/d75/fa6 zero size 2023-10-18T20:58:44.326 INFO:tasks.workunit.client.1.smithi060.stdout:3/811: dwrite d0/d22/d26/d79/db3/fe2 [0,4194304] 0 2023-10-18T20:58:44.328 INFO:tasks.workunit.client.0.smithi008.stdout:8/824: write d5/d8/df/d9d/d4d/dba/dd4/f63 [1319507,92550] 0 2023-10-18T20:58:44.328 INFO:tasks.workunit.client.0.smithi008.stdout:0/595: rename d0/f3 to d0/dd/d19/d24/fb8 0 2023-10-18T20:58:44.329 INFO:tasks.workunit.client.1.smithi060.stdout:0/840: unlink d3/d8/d14/d55/d74/d76/d6b/fc6 0 2023-10-18T20:58:44.329 INFO:tasks.workunit.client.1.smithi060.stdout:0/841: write d3/de5/df1/fdc [345575,61775] 0 2023-10-18T20:58:44.329 INFO:tasks.workunit.client.1.smithi060.stdout:0/842: creat d3/d8/d14/f10e x:0 0 0 2023-10-18T20:58:44.329 INFO:tasks.workunit.client.1.smithi060.stdout:0/843: chown d3/d8/d14/d55/d74/d76/d68/d7f 117 1 2023-10-18T20:58:44.331 INFO:tasks.workunit.client.1.smithi060.stdout:4/823: getdents d4/dc/d40/da8 0 2023-10-18T20:58:44.331 INFO:tasks.workunit.client.1.smithi060.stdout:4/824: chown d4/dc/d2a/d13/d27/d68/d9e/lac 1754 1 2023-10-18T20:58:44.331 INFO:tasks.workunit.client.0.smithi008.stdout:5/647: symlink d0/d2/d19/d7c/d42/d5a/led 0 2023-10-18T20:58:44.332 INFO:tasks.workunit.client.0.smithi008.stdout:5/648: chown d0/da9/dcd 2674 1 2023-10-18T20:58:44.332 INFO:tasks.workunit.client.0.smithi008.stdout:1/722: dwrite d9/de/df/d17/d25/f63 [0,4194304] 0 2023-10-18T20:58:44.332 INFO:tasks.workunit.client.0.smithi008.stdout:3/724: dread d0/d3/de/d13/d35/f3b [0,4194304] 0 2023-10-18T20:58:44.342 INFO:tasks.workunit.client.0.smithi008.stdout:0/596: rmdir d0/dd/d19/d24 39 2023-10-18T20:58:44.348 INFO:tasks.workunit.client.0.smithi008.stdout:3/725: read d0/d3/d42/d52/f98 [1355867,13300] 0 2023-10-18T20:58:44.348 INFO:tasks.workunit.client.0.smithi008.stdout:9/590: dwrite d2/dc/f6d [0,4194304] 0 2023-10-18T20:58:44.348 INFO:tasks.workunit.client.0.smithi008.stdout:9/591: chown d2/d4d/c7a 5 1 2023-10-18T20:58:44.351 INFO:tasks.workunit.client.0.smithi008.stdout:4/577: dwrite d0/d17/f4f [0,4194304] 0 2023-10-18T20:58:44.353 INFO:tasks.workunit.client.1.smithi060.stdout:8/818: sync 2023-10-18T20:58:44.354 INFO:tasks.workunit.client.0.smithi008.stdout:0/597: symlink d0/d7c/lb9 0 2023-10-18T20:58:44.355 INFO:tasks.workunit.client.1.smithi060.stdout:5/867: write d0/d6/d8/df/f4e [648809,51120] 0 2023-10-18T20:58:44.356 INFO:tasks.workunit.client.1.smithi060.stdout:5/868: write d0/d6/d9/fd5 [3045689,87959] 0 2023-10-18T20:58:44.356 INFO:tasks.workunit.client.1.smithi060.stdout:4/825: link d4/dc/d40/da8/ced d4/dc/d2a/d5b/cff 0 2023-10-18T20:58:44.357 INFO:tasks.workunit.client.0.smithi008.stdout:2/680: dread d1/d3/d40/d6e/fd8 [0,4194304] 0 2023-10-18T20:58:44.357 INFO:tasks.workunit.client.0.smithi008.stdout:2/681: dread - d1/d3/dd/d25/d76/fd4 zero size 2023-10-18T20:58:44.365 INFO:tasks.workunit.client.0.smithi008.stdout:1/723: rmdir d9/de/df/d17/d25/d94 39 2023-10-18T20:58:44.365 INFO:tasks.workunit.client.0.smithi008.stdout:3/726: symlink d0/d3/de/le6 0 2023-10-18T20:58:44.368 INFO:tasks.workunit.client.1.smithi060.stdout:5/869: symlink d0/dd/dd7/l134 0 2023-10-18T20:58:44.370 INFO:tasks.workunit.client.1.smithi060.stdout:4/826: link d4/dc/d2a/d39/d53/d65/d8d/fa1 d4/dc/d2a/d83/f100 0 2023-10-18T20:58:44.371 INFO:tasks.workunit.client.0.smithi008.stdout:0/598: creat d0/dd/d19/d5f/d89/da7/fba x:0 0 0 2023-10-18T20:58:44.372 INFO:tasks.workunit.client.1.smithi060.stdout:8/819: symlink d4/lfb 0 2023-10-18T20:58:44.372 INFO:tasks.workunit.client.0.smithi008.stdout:2/682: rename d1/d3/dd/d25/d76/d59/d85/db9/lc2 to d1/d3/dd/d1c/d3a/ldf 0 2023-10-18T20:58:44.373 INFO:tasks.workunit.client.0.smithi008.stdout:1/724: mknod d9/de/df/d17/d25/d94/dc4/dc6/ce0 0 2023-10-18T20:58:44.374 INFO:tasks.workunit.client.1.smithi060.stdout:5/870: rename d0/d6/d9/d82/d84/db2/f40 to d0/da/dc8/de4/f135 0 2023-10-18T20:58:44.374 INFO:tasks.workunit.client.0.smithi008.stdout:8/825: dwrite d5/d8/df/f6b [0,4194304] 0 2023-10-18T20:58:44.377 INFO:tasks.workunit.client.1.smithi060.stdout:8/820: rename d4/d9/d93/lbb to d4/d9/d37/d4e/dd9/ddf/lfc 0 2023-10-18T20:58:44.380 INFO:tasks.workunit.client.1.smithi060.stdout:8/821: unlink d4/f19 0 2023-10-18T20:58:44.380 INFO:tasks.workunit.client.1.smithi060.stdout:8/822: fdatasync d4/d9/d4f/f63 0 2023-10-18T20:58:44.383 INFO:tasks.workunit.client.1.smithi060.stdout:8/823: rename d4/d9/d93/f9e to d4/d9/d31/d6f/dfa/dcb/ffd 0 2023-10-18T20:58:44.384 INFO:tasks.workunit.client.0.smithi008.stdout:4/578: write d0/d17/d5b/faa [525261,113874] 0 2023-10-18T20:58:44.384 INFO:tasks.workunit.client.0.smithi008.stdout:4/579: fsync d0/d3/d21/d42/f79 0 2023-10-18T20:58:44.386 INFO:tasks.workunit.client.0.smithi008.stdout:9/592: write d2/dc/d40/d6f/d92/d59/f66 [4868358,91487] 0 2023-10-18T20:58:44.387 INFO:tasks.workunit.client.1.smithi060.stdout:5/871: write d0/f2c [264096,38502] 0 2023-10-18T20:58:44.389 INFO:tasks.workunit.client.0.smithi008.stdout:6/754: dwrite df/d3c/da2/dcf/d58/dec/f69 [0,4194304] 0 2023-10-18T20:58:44.390 INFO:tasks.workunit.client.0.smithi008.stdout:6/755: write df/d3c/da2/dcf/f21 [3503051,80667] 0 2023-10-18T20:58:44.390 INFO:tasks.workunit.client.1.smithi060.stdout:5/872: unlink d0/da/dc8/de4/d6d/l131 0 2023-10-18T20:58:44.391 INFO:tasks.workunit.client.0.smithi008.stdout:3/727: rename d0/d84/dcc to d0/d84/dad/dbb/de7 0 2023-10-18T20:58:44.392 INFO:tasks.workunit.client.0.smithi008.stdout:2/683: mkdir d1/d3/d40/de0 0 2023-10-18T20:58:44.393 INFO:tasks.workunit.client.0.smithi008.stdout:2/684: stat d1/d3/dd/d1c/d3a/d57/f6d 0 2023-10-18T20:58:44.395 INFO:tasks.workunit.client.1.smithi060.stdout:5/873: rename d0/d6/d8/df to d0/da/dc8/de4/d4f/d136 0 2023-10-18T20:58:44.397 INFO:tasks.workunit.client.0.smithi008.stdout:8/826: symlink d5/d8/df/d9d/d85/db1/dcc/d104/l12b 0 2023-10-18T20:58:44.398 INFO:tasks.workunit.client.0.smithi008.stdout:1/725: unlink d9/de/c6e 0 2023-10-18T20:58:44.398 INFO:tasks.workunit.client.0.smithi008.stdout:1/726: dread - d9/de/df/d17/d55/fdd zero size 2023-10-18T20:58:44.399 INFO:tasks.workunit.client.1.smithi060.stdout:5/874: mkdir d0/da/dc8/de4/d4f/d137 0 2023-10-18T20:58:44.399 INFO:tasks.workunit.client.1.smithi060.stdout:5/875: chown d0/dd/d76/d10f/da5/d67/de7/f124 5 1 2023-10-18T20:58:44.399 INFO:tasks.workunit.client.0.smithi008.stdout:1/727: write d9/de/df/f10 [5156589,19379] 0 2023-10-18T20:58:44.400 INFO:tasks.workunit.client.1.smithi060.stdout:8/824: dread d4/d9/d31/d6f/f8c [0,4194304] 0 2023-10-18T20:58:44.400 INFO:tasks.workunit.client.1.smithi060.stdout:8/825: chown d4/d9/d4f/fbf 389798 1 2023-10-18T20:58:44.400 INFO:tasks.workunit.client.0.smithi008.stdout:4/580: symlink d0/d58/dbf/lc0 0 2023-10-18T20:58:44.401 INFO:tasks.workunit.client.1.smithi060.stdout:5/876: unlink d0/da/dc8/de4/d4f/d136/d27/lbd 0 2023-10-18T20:58:44.401 INFO:tasks.workunit.client.0.smithi008.stdout:6/756: symlink df/d15/d48/d4b/l101 0 2023-10-18T20:58:44.403 INFO:tasks.workunit.client.1.smithi060.stdout:8/826: rename d4/d9/d31/d35/d9f/da3/f9b to d4/d9/d31/d35/d9f/da3/ddb/de9/ffe 0 2023-10-18T20:58:44.405 INFO:tasks.workunit.client.0.smithi008.stdout:2/685: mkdir d1/d3/dd/d1c/d3a/d45/de1 0 2023-10-18T20:58:44.408 INFO:tasks.workunit.client.1.smithi060.stdout:8/827: symlink d4/d9/d37/lff 0 2023-10-18T20:58:44.409 INFO:tasks.workunit.client.1.smithi060.stdout:8/828: read - d4/d9/d31/d6f/fb6 zero size 2023-10-18T20:58:44.417 INFO:tasks.workunit.client.0.smithi008.stdout:4/581: stat d0/l4d 0 2023-10-18T20:58:44.417 INFO:tasks.workunit.client.0.smithi008.stdout:1/728: creat d9/de/df/fe1 x:0 0 0 2023-10-18T20:58:44.417 INFO:tasks.workunit.client.0.smithi008.stdout:1/729: dread - d9/de/df/d17/d25/d94/da7/fcb zero size 2023-10-18T20:58:44.417 INFO:tasks.workunit.client.0.smithi008.stdout:2/686: mkdir d1/d3/dd/d25/db2/de2 0 2023-10-18T20:58:44.418 INFO:tasks.workunit.client.0.smithi008.stdout:2/687: stat d1/d3/dd/d1c/d3a/d49/l63 0 2023-10-18T20:58:44.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:42.920854+0000 mgr.smithi008.flmjzp (mgr.14640) 13 : audit [DBG] from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:44.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:43.110793+0000 mon.smithi008 (mon.0) 658 : cluster [DBG] Standby manager daemon smithi060.pgqqwa restarted 2023-10-18T20:58:44.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:43.110929+0000 mon.smithi008 (mon.0) 659 : cluster [DBG] Standby manager daemon smithi060.pgqqwa started 2023-10-18T20:58:44.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:43.129208+0000 mon.smithi060 (mon.1) 55 : audit [DBG] from='mgr.? 172.21.15.60:0/3670975963' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/crt"}]: dispatch 2023-10-18T20:58:44.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:43.134653+0000 mon.smithi060 (mon.1) 56 : audit [DBG] from='mgr.? 172.21.15.60:0/3670975963' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:58:44.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:43.140668+0000 mon.smithi060 (mon.1) 57 : audit [DBG] from='mgr.? 172.21.15.60:0/3670975963' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/key"}]: dispatch 2023-10-18T20:58:44.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:43.142514+0000 mon.smithi060 (mon.1) 58 : audit [DBG] from='mgr.? 172.21.15.60:0/3670975963' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:58:44.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:43.252432+0000 mgr.smithi008.flmjzp (mgr.14640) 14 : cephadm [INF] Upgrade: Updating mgr.smithi060.pgqqwa 2023-10-18T20:58:44.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:43.252940+0000 mon.smithi008 (mon.0) 660 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.pgqqwa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:58:44.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:43.254587+0000 mon.smithi008 (mon.0) 661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:58:44.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:43.255977+0000 mon.smithi008 (mon.0) 662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:58:44.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:43.257213+0000 mgr.smithi008.flmjzp (mgr.14640) 15 : cephadm [INF] Deploying daemon mgr.smithi060.pgqqwa on smithi060 2023-10-18T20:58:44.428 INFO:tasks.workunit.client.0.smithi008.stdout:3/728: rename d0/db2 to d0/d84/dad/dbb/de8 0 2023-10-18T20:58:44.428 INFO:tasks.workunit.client.0.smithi008.stdout:1/730: mkdir d9/de/df/d17/d25/d94/dc4/dc6/de2 0 2023-10-18T20:58:44.428 INFO:tasks.workunit.client.0.smithi008.stdout:1/731: chown d9/de/ca2 23 1 2023-10-18T20:58:44.428 INFO:tasks.workunit.client.0.smithi008.stdout:1/732: read - d9/de/df/d17/d25/d94/da7/fd7 zero size 2023-10-18T20:58:44.428 INFO:tasks.workunit.client.0.smithi008.stdout:1/733: write d9/de/fb0 [5316650,78568] 0 2023-10-18T20:58:44.431 INFO:tasks.workunit.client.0.smithi008.stdout:5/649: dwrite d0/d2/d19/d7c/d31/d3f/d9a/fce [0,4194304] 0 2023-10-18T20:58:44.432 INFO:tasks.workunit.client.0.smithi008.stdout:9/593: dread d2/dc/d17/f77 [0,4194304] 0 2023-10-18T20:58:44.432 INFO:tasks.workunit.client.0.smithi008.stdout:9/594: readlink d2/d64/l9c 0 2023-10-18T20:58:44.432 INFO:tasks.workunit.client.0.smithi008.stdout:1/734: symlink d9/de/df/d17/d25/d94/da7/le3 0 2023-10-18T20:58:44.437 INFO:tasks.workunit.client.0.smithi008.stdout:8/827: dread d5/d8/df/d9d/d4d/db5/f129 [0,4194304] 0 2023-10-18T20:58:44.437 INFO:tasks.workunit.client.0.smithi008.stdout:8/828: chown d5/d8/df/f19 7903277 1 2023-10-18T20:58:44.440 INFO:tasks.workunit.client.0.smithi008.stdout:0/599: dwrite d0/dd/d19/d5f/d99/f80 [0,4194304] 0 2023-10-18T20:58:44.441 INFO:tasks.workunit.client.0.smithi008.stdout:0/600: fsync d0/dd/df/f4c 0 2023-10-18T20:58:44.442 INFO:tasks.workunit.client.0.smithi008.stdout:5/650: unlink d0/d2/d9/d9b/l6d 0 2023-10-18T20:58:44.452 INFO:tasks.workunit.client.1.smithi060.stdout:6/869: sync 2023-10-18T20:58:44.457 INFO:tasks.workunit.client.1.smithi060.stdout:6/870: mkdir d10/d17/d54/dd4/d112 0 2023-10-18T20:58:44.464 INFO:tasks.workunit.client.0.smithi008.stdout:9/595: link d2/l6 d2/dc/d17/d7b/lad 0 2023-10-18T20:58:44.464 INFO:tasks.workunit.client.0.smithi008.stdout:9/596: dread - d2/d64/f69 zero size 2023-10-18T20:58:44.465 INFO:tasks.workunit.client.0.smithi008.stdout:8/829: mkdir d5/d8/df/d12c 0 2023-10-18T20:58:44.465 INFO:tasks.workunit.client.0.smithi008.stdout:3/729: rmdir d0/d84/dad/dbb/de7 0 2023-10-18T20:58:44.465 INFO:tasks.workunit.client.0.smithi008.stdout:8/830: write d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/fad [709447,79441] 0 2023-10-18T20:58:44.466 INFO:tasks.workunit.client.0.smithi008.stdout:3/730: truncate d0/d3/de/d13/d35/d51/f8d 1628440 0 2023-10-18T20:58:44.466 INFO:tasks.workunit.client.0.smithi008.stdout:8/831: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/f12d x:0 0 0 2023-10-18T20:58:44.466 INFO:tasks.workunit.client.0.smithi008.stdout:8/832: truncate d5/d8/df/d9d/d85/db1/fef 337960 0 2023-10-18T20:58:44.466 INFO:tasks.workunit.client.0.smithi008.stdout:8/833: write d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/f12d [710568,27743] 0 2023-10-18T20:58:44.467 INFO:tasks.workunit.client.1.smithi060.stdout:0/844: dwrite d3/d32/d86/fb7 [0,4194304] 0 2023-10-18T20:58:44.467 INFO:tasks.workunit.client.0.smithi008.stdout:4/582: read d0/d3/f41 [6761358,66420] 0 2023-10-18T20:58:44.468 INFO:tasks.workunit.client.1.smithi060.stdout:0/845: read d3/d8/f2d [2344773,115988] 0 2023-10-18T20:58:44.469 INFO:tasks.workunit.client.0.smithi008.stdout:9/597: mknod d2/d8/cae 0 2023-10-18T20:58:44.471 INFO:tasks.workunit.client.0.smithi008.stdout:3/731: mkdir d0/d3/de/d13/d35/dbf/de9 0 2023-10-18T20:58:44.471 INFO:tasks.workunit.client.0.smithi008.stdout:4/583: stat d0/l1d 0 2023-10-18T20:58:44.472 INFO:tasks.workunit.client.0.smithi008.stdout:8/834: mkdir d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/d12e 0 2023-10-18T20:58:44.473 INFO:tasks.workunit.client.0.smithi008.stdout:3/732: creat d0/d3/de/d13/d35/dbf/fea x:0 0 0 2023-10-18T20:58:44.475 INFO:tasks.workunit.client.1.smithi060.stdout:6/871: rmdir d10/d17/d70 39 2023-10-18T20:58:44.476 INFO:tasks.workunit.client.0.smithi008.stdout:3/733: link d0/d3/de/d13/d35/dbf/cda d0/d3/d37/ceb 0 2023-10-18T20:58:44.477 INFO:tasks.workunit.client.1.smithi060.stdout:4/827: dwrite d4/dc/d2a/d2d/f74 [0,4194304] 0 2023-10-18T20:58:44.477 INFO:tasks.workunit.client.1.smithi060.stdout:4/828: write d4/dc/d2a/d39/d53/d76/d99/fbb [124372,41781] 0 2023-10-18T20:58:44.478 INFO:tasks.workunit.client.1.smithi060.stdout:8/829: dwrite d4/d9/d31/d6f/dfa/f95 [4194304,4194304] 0 2023-10-18T20:58:44.478 INFO:tasks.workunit.client.1.smithi060.stdout:0/846: truncate d3/d8/d14/f89 2014579 0 2023-10-18T20:58:44.480 INFO:tasks.workunit.client.0.smithi008.stdout:3/734: creat d0/dc0/fec x:0 0 0 2023-10-18T20:58:44.481 INFO:tasks.workunit.client.0.smithi008.stdout:3/735: chown d0/d4a/d64/f7e 13 1 2023-10-18T20:58:44.484 INFO:tasks.workunit.client.1.smithi060.stdout:4/829: mknod d4/dc/d2a/d13/d27/d68/dc8/de8/c101 0 2023-10-18T20:58:44.484 INFO:tasks.workunit.client.1.smithi060.stdout:4/830: write d4/dc/d2a/d39/fa6 [358538,104224] 0 2023-10-18T20:58:44.486 INFO:tasks.workunit.client.0.smithi008.stdout:6/757: dwrite df/d3c/d77/fb3 [0,4194304] 0 2023-10-18T20:58:44.486 INFO:tasks.workunit.client.1.smithi060.stdout:5/877: dwrite d0/d6/d9/db1/f12a [0,4194304] 0 2023-10-18T20:58:44.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:42.920854+0000 mgr.smithi008.flmjzp (mgr.14640) 13 : audit [DBG] from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:58:44.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:43.110793+0000 mon.smithi008 (mon.0) 658 : cluster [DBG] Standby manager daemon smithi060.pgqqwa restarted 2023-10-18T20:58:44.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:43.110929+0000 mon.smithi008 (mon.0) 659 : cluster [DBG] Standby manager daemon smithi060.pgqqwa started 2023-10-18T20:58:44.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:43.129208+0000 mon.smithi060 (mon.1) 55 : audit [DBG] from='mgr.? 172.21.15.60:0/3670975963' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/crt"}]: dispatch 2023-10-18T20:58:44.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:43.134653+0000 mon.smithi060 (mon.1) 56 : audit [DBG] from='mgr.? 172.21.15.60:0/3670975963' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:58:44.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:43.140668+0000 mon.smithi060 (mon.1) 57 : audit [DBG] from='mgr.? 172.21.15.60:0/3670975963' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/key"}]: dispatch 2023-10-18T20:58:44.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:43.142514+0000 mon.smithi060 (mon.1) 58 : audit [DBG] from='mgr.? 172.21.15.60:0/3670975963' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:58:44.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:43.252432+0000 mgr.smithi008.flmjzp (mgr.14640) 14 : cephadm [INF] Upgrade: Updating mgr.smithi060.pgqqwa 2023-10-18T20:58:44.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:43.252940+0000 mon.smithi008 (mon.0) 660 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.pgqqwa", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T20:58:44.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:43.254587+0000 mon.smithi008 (mon.0) 661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T20:58:44.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:43.255977+0000 mon.smithi008 (mon.0) 662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:58:44.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:43.257213+0000 mgr.smithi008.flmjzp (mgr.14640) 15 : cephadm [INF] Deploying daemon mgr.smithi060.pgqqwa on smithi060 2023-10-18T20:58:44.501 INFO:tasks.workunit.client.0.smithi008.stdout:6/758: creat df/d3c/da2/dcf/d58/dd7/f102 x:0 0 0 2023-10-18T20:58:44.503 INFO:tasks.workunit.client.1.smithi060.stdout:5/878: dread d0/da/ff6 [0,4194304] 0 2023-10-18T20:58:44.504 INFO:tasks.workunit.client.1.smithi060.stdout:5/879: fsync d0/da/dc8/de4/fd6 0 2023-10-18T20:58:44.504 INFO:tasks.workunit.client.1.smithi060.stdout:4/831: symlink d4/dc/d2a/d2d/d69/l102 0 2023-10-18T20:58:44.504 INFO:tasks.workunit.client.1.smithi060.stdout:4/832: chown d4/dc/d2a/d39/d53/d76/d99/fb4 1 1 2023-10-18T20:58:44.505 INFO:tasks.workunit.client.1.smithi060.stdout:4/833: write d4/dc/d2a/d39/f7f [265268,105007] 0 2023-10-18T20:58:44.505 INFO:tasks.workunit.client.0.smithi008.stdout:2/688: dwrite d1/d3/d40/d6e/fd8 [0,4194304] 0 2023-10-18T20:58:44.508 INFO:tasks.workunit.client.1.smithi060.stdout:8/830: dread d4/d9/d31/d35/d9f/da3/fc7 [0,4194304] 0 2023-10-18T20:58:44.514 INFO:tasks.workunit.client.1.smithi060.stdout:4/834: creat d4/dc/d2a/d39/d82/f103 x:0 0 0 2023-10-18T20:58:44.514 INFO:tasks.workunit.client.0.smithi008.stdout:2/689: read d1/d3/dd/d1c/f2d [247538,100219] 0 2023-10-18T20:58:44.514 INFO:tasks.workunit.client.0.smithi008.stdout:6/759: mknod df/d3c/da2/dcf/d58/dec/d53/c103 0 2023-10-18T20:58:44.516 INFO:tasks.workunit.client.1.smithi060.stdout:8/831: mknod d4/d9/d37/d4e/c100 0 2023-10-18T20:58:44.516 INFO:tasks.workunit.client.1.smithi060.stdout:0/847: write d3/f6 [1551238,102933] 0 2023-10-18T20:58:44.518 INFO:tasks.workunit.client.1.smithi060.stdout:4/835: mkdir d4/d104 0 2023-10-18T20:58:44.520 INFO:tasks.workunit.client.0.smithi008.stdout:4/584: write d0/d17/d5b/d2a/f3c [3174405,68210] 0 2023-10-18T20:58:44.522 INFO:tasks.workunit.client.1.smithi060.stdout:5/880: dread d0/d6/d8/f44 [0,4194304] 0 2023-10-18T20:58:44.524 INFO:tasks.workunit.client.1.smithi060.stdout:5/881: creat d0/d6/d8/d81/f138 x:0 0 0 2023-10-18T20:58:44.524 INFO:tasks.workunit.client.1.smithi060.stdout:6/872: dwrite f8 [4194304,4194304] 0 2023-10-18T20:58:44.525 INFO:tasks.workunit.client.0.smithi008.stdout:3/736: dread d0/d3/d42/f30 [0,4194304] 0 2023-10-18T20:58:44.528 INFO:tasks.workunit.client.1.smithi060.stdout:0/848: dread d3/f60 [4194304,4194304] 0 2023-10-18T20:58:44.529 INFO:tasks.workunit.client.1.smithi060.stdout:5/882: symlink d0/dd/d76/d112/l139 0 2023-10-18T20:58:44.530 INFO:tasks.workunit.client.0.smithi008.stdout:9/598: dread d2/dc/d1a/d1d/f44 [0,4194304] 0 2023-10-18T20:58:44.530 INFO:tasks.workunit.client.1.smithi060.stdout:6/873: mknod d10/d17/d54/dd4/c113 0 2023-10-18T20:58:44.531 INFO:tasks.workunit.client.1.smithi060.stdout:6/874: chown d10/d2e/f4e 54 1 2023-10-18T20:58:44.531 INFO:tasks.workunit.client.1.smithi060.stdout:6/875: readlink d10/d17/d7a/ld8 0 2023-10-18T20:58:44.531 INFO:tasks.workunit.client.1.smithi060.stdout:6/876: chown d10/d17/dae/dbf/l107 0 1 2023-10-18T20:58:44.532 INFO:tasks.workunit.client.1.smithi060.stdout:0/849: rename d3/d8/d14/d55/d74/d76/d68/d7f/f99 to d3/d8/d14/d55/d74/d76/f10f 0 2023-10-18T20:58:44.533 INFO:tasks.workunit.client.1.smithi060.stdout:5/883: mkdir d0/da/dc8/de4/d4f/d13a 0 2023-10-18T20:58:44.533 INFO:tasks.workunit.client.1.smithi060.stdout:5/884: chown d0/d6/d9/d82/d84/db2/l54 15879890 1 2023-10-18T20:58:44.535 INFO:tasks.workunit.client.1.smithi060.stdout:5/885: truncate d0/d6/d9/d82/d84/db2/d2a/f5a 3792726 0 2023-10-18T20:58:44.537 INFO:tasks.workunit.client.1.smithi060.stdout:0/850: getdents d3/d8/d3c/d87/dba 0 2023-10-18T20:58:44.539 INFO:tasks.workunit.client.1.smithi060.stdout:5/886: dread - d0/dd/fcf zero size 2023-10-18T20:58:44.539 INFO:tasks.workunit.client.1.smithi060.stdout:0/851: readlink d3/d8/d14/d55/le7 0 2023-10-18T20:58:44.540 INFO:tasks.workunit.client.1.smithi060.stdout:0/852: mknod d3/de5/d107/c110 0 2023-10-18T20:58:44.541 INFO:tasks.workunit.client.0.smithi008.stdout:9/599: creat d2/dc/d40/d5a/faf x:0 0 0 2023-10-18T20:58:44.542 INFO:tasks.workunit.client.0.smithi008.stdout:4/585: symlink d0/d17/d6e/lc1 0 2023-10-18T20:58:44.542 INFO:tasks.workunit.client.0.smithi008.stdout:3/737: getdents d0/d3/d42/d88 0 2023-10-18T20:58:44.545 INFO:tasks.workunit.client.0.smithi008.stdout:1/735: dwrite d9/de/df/d17/d1e/fb4 [0,4194304] 0 2023-10-18T20:58:44.545 INFO:tasks.workunit.client.0.smithi008.stdout:8/835: dread d5/d8/df/d9d/d85/db1/fc2 [0,4194304] 0 2023-10-18T20:58:44.546 INFO:tasks.workunit.client.0.smithi008.stdout:1/736: creat d9/de/df/d17/d55/da8/fe4 x:0 0 0 2023-10-18T20:58:44.548 INFO:tasks.workunit.client.1.smithi060.stdout:4/836: read d4/dc/d2a/d2d/d69/d89/ff9 [5282992,126742] 0 2023-10-18T20:58:44.552 INFO:tasks.workunit.client.0.smithi008.stdout:9/600: creat d2/d8/da0/fb0 x:0 0 0 2023-10-18T20:58:44.553 INFO:tasks.workunit.client.0.smithi008.stdout:4/586: mknod d0/d17/d5b/cc2 0 2023-10-18T20:58:44.555 INFO:tasks.workunit.client.1.smithi060.stdout:5/887: write d0/d6/d9/d82/d83/d99/faa [554153,99783] 0 2023-10-18T20:58:44.555 INFO:tasks.workunit.client.1.smithi060.stdout:6/877: dread d10/d3e/f74 [0,4194304] 0 2023-10-18T20:58:44.555 INFO:tasks.workunit.client.0.smithi008.stdout:8/836: dread d5/f28 [0,4194304] 0 2023-10-18T20:58:44.555 INFO:tasks.workunit.client.0.smithi008.stdout:3/738: link d0/d3/l4d d0/d3/d37/led 0 2023-10-18T20:58:44.556 INFO:tasks.workunit.client.0.smithi008.stdout:8/837: write d5/d8/df/d9d/d4d/f6d [145646,99625] 0 2023-10-18T20:58:44.556 INFO:tasks.workunit.client.0.smithi008.stdout:8/838: creat d5/d8/df/d9d/d4d/f12f x:0 0 0 2023-10-18T20:58:44.558 INFO:tasks.workunit.client.0.smithi008.stdout:5/651: dwrite d0/d2/d19/d7c/d31/f4a [0,4194304] 0 2023-10-18T20:58:44.559 INFO:tasks.workunit.client.1.smithi060.stdout:1/966: sync 2023-10-18T20:58:44.559 INFO:tasks.workunit.client.1.smithi060.stdout:2/872: sync 2023-10-18T20:58:44.559 INFO:tasks.workunit.client.1.smithi060.stdout:2/873: stat d0/d16/d7f/f9c 0 2023-10-18T20:58:44.560 INFO:tasks.workunit.client.1.smithi060.stdout:2/874: creat d0/d16/d85/de3/f121 x:0 0 0 2023-10-18T20:58:44.560 INFO:tasks.workunit.client.1.smithi060.stdout:1/967: write d4/d38/de5/f11e [263571,128956] 0 2023-10-18T20:58:44.560 INFO:tasks.workunit.client.1.smithi060.stdout:1/968: write d4/d6/d7/f26 [341955,60439] 0 2023-10-18T20:58:44.561 INFO:tasks.workunit.client.1.smithi060.stdout:7/944: sync 2023-10-18T20:58:44.561 INFO:tasks.workunit.client.1.smithi060.stdout:9/788: sync 2023-10-18T20:58:44.561 INFO:tasks.workunit.client.1.smithi060.stdout:3/812: sync 2023-10-18T20:58:44.562 INFO:tasks.workunit.client.0.smithi008.stdout:7/707: sync 2023-10-18T20:58:44.565 INFO:tasks.workunit.client.1.smithi060.stdout:4/837: write d4/dc/d2a/d13/d27/f67 [203569,54939] 0 2023-10-18T20:58:44.566 INFO:tasks.workunit.client.1.smithi060.stdout:4/838: read - d4/d15/f6e zero size 2023-10-18T20:58:44.566 INFO:tasks.workunit.client.1.smithi060.stdout:5/888: symlink d0/dd/d76/d10f/da5/d67/l13b 0 2023-10-18T20:58:44.568 INFO:tasks.workunit.client.0.smithi008.stdout:1/737: symlink d9/de/df/d85/dd3/le5 0 2023-10-18T20:58:44.569 INFO:tasks.workunit.client.0.smithi008.stdout:4/587: symlink d0/d3/d21/d57/d8f/lc3 0 2023-10-18T20:58:44.570 INFO:tasks.workunit.client.1.smithi060.stdout:9/789: mkdir d3/d99/d1c/d116/d80/d122 0 2023-10-18T20:58:44.570 INFO:tasks.workunit.client.1.smithi060.stdout:7/945: creat de/d14/d2f/d3f/d5a/f136 x:0 0 0 2023-10-18T20:58:44.570 INFO:tasks.workunit.client.0.smithi008.stdout:0/601: dwrite d0/d7c/f7a [0,4194304] 0 2023-10-18T20:58:44.572 INFO:tasks.workunit.client.0.smithi008.stdout:9/601: dread d2/f1b [0,4194304] 0 2023-10-18T20:58:44.572 INFO:tasks.workunit.client.0.smithi008.stdout:9/602: read - d2/dc/d1a/d1d/f63 zero size 2023-10-18T20:58:44.573 INFO:tasks.workunit.client.1.smithi060.stdout:4/839: creat d4/dc/f105 x:0 0 0 2023-10-18T20:58:44.575 INFO:tasks.workunit.client.1.smithi060.stdout:9/790: creat d3/d99/d1c/d116/d80/da0/f123 x:0 0 0 2023-10-18T20:58:44.575 INFO:tasks.workunit.client.1.smithi060.stdout:9/791: chown d3/d99/d1c/d5a/l7e 62416 1 2023-10-18T20:58:44.576 INFO:tasks.workunit.client.0.smithi008.stdout:3/739: mknod d0/d84/dad/dbb/cee 0 2023-10-18T20:58:44.576 INFO:tasks.workunit.client.1.smithi060.stdout:7/946: mkdir de/d29/d72/d84/d137 0 2023-10-18T20:58:44.577 INFO:tasks.workunit.client.1.smithi060.stdout:3/813: getdents d0/d22/d26/d2b 0 2023-10-18T20:58:44.578 INFO:tasks.workunit.client.0.smithi008.stdout:8/839: creat d5/d8/df/d9d/d4d/dba/dd4/d9f/f130 x:0 0 0 2023-10-18T20:58:44.578 INFO:tasks.workunit.client.0.smithi008.stdout:5/652: dread d0/d2/d19/d7c/d31/d3f/f60 [0,4194304] 0 2023-10-18T20:58:44.579 INFO:tasks.workunit.client.0.smithi008.stdout:8/840: write d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7/f11a [227471,59765] 0 2023-10-18T20:58:44.580 INFO:tasks.workunit.client.1.smithi060.stdout:6/878: dread d10/d47/d92/f22 [0,4194304] 0 2023-10-18T20:58:44.580 INFO:tasks.workunit.client.1.smithi060.stdout:6/879: fdatasync d10/f72 0 2023-10-18T20:58:44.580 INFO:tasks.workunit.client.0.smithi008.stdout:6/760: dwrite df/f3b [4194304,4194304] 0 2023-10-18T20:58:44.580 INFO:tasks.workunit.client.0.smithi008.stdout:6/761: fdatasync df/d15/d48/d81/f96 0 2023-10-18T20:58:44.581 INFO:tasks.workunit.client.0.smithi008.stdout:6/762: creat df/d3c/f104 x:0 0 0 2023-10-18T20:58:44.582 INFO:tasks.workunit.client.1.smithi060.stdout:4/840: creat d4/dc/d2a/d13/d27/d68/dc8/de8/f106 x:0 0 0 2023-10-18T20:58:44.582 INFO:tasks.workunit.client.1.smithi060.stdout:4/841: chown d4/dc/d2a/d31/le4 6 1 2023-10-18T20:58:44.584 INFO:tasks.workunit.client.0.smithi008.stdout:9/603: dread d2/dc/d1a/f5b [0,4194304] 0 2023-10-18T20:58:44.585 INFO:tasks.workunit.client.0.smithi008.stdout:9/604: read - d2/dc/d3d/f98 zero size 2023-10-18T20:58:44.585 INFO:tasks.workunit.client.0.smithi008.stdout:9/605: dread - d2/f48 zero size 2023-10-18T20:58:44.585 INFO:tasks.workunit.client.0.smithi008.stdout:9/606: getdents d2/dc 0 2023-10-18T20:58:44.585 INFO:tasks.workunit.client.0.smithi008.stdout:9/607: chown d2/dc/f4c 484869402 1 2023-10-18T20:58:44.586 INFO:tasks.workunit.client.1.smithi060.stdout:3/814: mknod d0/c11a 0 2023-10-18T20:58:44.586 INFO:tasks.workunit.client.1.smithi060.stdout:3/815: stat d0/d3c/d3d/d4d/l10a 0 2023-10-18T20:58:44.587 INFO:tasks.workunit.client.1.smithi060.stdout:9/792: creat d3/d99/d19/d54/d11d/f124 x:0 0 0 2023-10-18T20:58:44.587 INFO:tasks.workunit.client.1.smithi060.stdout:9/793: read d3/d99/d1c/d116/d2d/f63 [50651,5493] 0 2023-10-18T20:58:44.587 INFO:tasks.workunit.client.1.smithi060.stdout:9/794: creat d3/d99/d1c/d5a/d107/f125 x:0 0 0 2023-10-18T20:58:44.587 INFO:tasks.workunit.client.1.smithi060.stdout:6/880: symlink d10/d2e/d75/d81/d8b/dc9/l114 0 2023-10-18T20:58:44.589 INFO:tasks.workunit.client.1.smithi060.stdout:4/842: rename d4/d15/fbe to d4/dc/d2a/d39/d53/d65/f107 0 2023-10-18T20:58:44.591 INFO:tasks.workunit.client.1.smithi060.stdout:5/889: dread d0/da/d3b/f4c [0,4194304] 0 2023-10-18T20:58:44.591 INFO:tasks.workunit.client.1.smithi060.stdout:1/969: write d4/d6/d7/d2f/d7b/d2a/d32/dd/f25 [8236731,31331] 0 2023-10-18T20:58:44.592 INFO:tasks.workunit.client.0.smithi008.stdout:1/738: symlink d9/de/df/d17/d25/d57/le6 0 2023-10-18T20:58:44.594 INFO:tasks.workunit.client.1.smithi060.stdout:3/816: mknod d0/d22/d26/d2c/da0/d10d/c11b 0 2023-10-18T20:58:44.595 INFO:tasks.workunit.client.0.smithi008.stdout:0/602: rename d0/cb6 to d0/d7c/d9a/d8a/cbb 0 2023-10-18T20:58:44.595 INFO:tasks.workunit.client.0.smithi008.stdout:0/603: dread - d0/d7c/f5b zero size 2023-10-18T20:58:44.597 INFO:tasks.workunit.client.0.smithi008.stdout:3/740: rename d0/d3/de/d13/d35 to d0/d3/de/d13/d35/dbf/de9/def 22 2023-10-18T20:58:44.597 INFO:tasks.workunit.client.0.smithi008.stdout:3/741: write d0/f59 [73956,103049] 0 2023-10-18T20:58:44.599 INFO:tasks.workunit.client.1.smithi060.stdout:5/890: link d0/d6/d9/d82/d84/lc5 d0/da/d3b/d64/l13c 0 2023-10-18T20:58:44.599 INFO:tasks.workunit.client.1.smithi060.stdout:1/970: getdents d4/d6/d7/d2f/d7b/dda/df8 0 2023-10-18T20:58:44.599 INFO:tasks.workunit.client.1.smithi060.stdout:1/971: readlink d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/dd5/l10b 0 2023-10-18T20:58:44.599 INFO:tasks.workunit.client.1.smithi060.stdout:5/891: dread - d0/da/dc8/de4/fed zero size 2023-10-18T20:58:44.600 INFO:tasks.workunit.client.1.smithi060.stdout:5/892: read d0/da/dc8/de4/d4f/d136/f4e [3793446,65438] 0 2023-10-18T20:58:44.600 INFO:tasks.workunit.client.1.smithi060.stdout:5/893: write d0/da/d3b/d43/f63 [1801746,117955] 0 2023-10-18T20:58:44.600 INFO:tasks.workunit.client.1.smithi060.stdout:5/894: write d0/d6/d8/f44 [413819,88764] 0 2023-10-18T20:58:44.601 INFO:tasks.workunit.client.0.smithi008.stdout:8/841: symlink d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/l131 0 2023-10-18T20:58:44.601 INFO:tasks.workunit.client.0.smithi008.stdout:8/842: fdatasync d5/d8/df/d9d/f1d 0 2023-10-18T20:58:44.606 INFO:tasks.workunit.client.1.smithi060.stdout:4/843: rename d4/dc/d2a/d31/l44 to d4/dc/d2a/d1d/l108 0 2023-10-18T20:58:44.606 INFO:tasks.workunit.client.1.smithi060.stdout:1/972: creat d4/d6/d7/d2f/d7b/d2a/d32/dd/d81/d137/f139 x:0 0 0 2023-10-18T20:58:44.606 INFO:tasks.workunit.client.1.smithi060.stdout:1/973: write d4/d6/d7/d2f/d7b/dda/df8/f117 [341955,81562] 0 2023-10-18T20:58:44.607 INFO:tasks.workunit.client.1.smithi060.stdout:4/844: truncate d4/dc/d2a/d13/d27/d68/dc8/de8/f106 290470 0 2023-10-18T20:58:44.607 INFO:tasks.workunit.client.1.smithi060.stdout:3/817: truncate d0/d22/d26/d2c/fbd 603604 0 2023-10-18T20:58:44.611 INFO:tasks.workunit.client.1.smithi060.stdout:3/818: mkdir d0/d22/d26/d2c/da0/d11c 0 2023-10-18T20:58:44.613 INFO:tasks.workunit.client.0.smithi008.stdout:2/690: dwrite d1/d3/dd/d1c/f3e [4194304,4194304] 0 2023-10-18T20:58:44.613 INFO:tasks.workunit.client.1.smithi060.stdout:5/895: getdents d0/da/dc8/de4/d4f/d136 0 2023-10-18T20:58:44.613 INFO:tasks.workunit.client.1.smithi060.stdout:1/974: mknod d4/d6/d33/d58/c13a 0 2023-10-18T20:58:44.618 INFO:tasks.workunit.client.0.smithi008.stdout:3/742: creat d0/d3/de/d13/d35/dbf/de9/ff0 x:0 0 0 2023-10-18T20:58:44.619 INFO:tasks.workunit.client.1.smithi060.stdout:3/819: truncate d0/d22/f69 2009691 0 2023-10-18T20:58:44.620 INFO:tasks.workunit.client.1.smithi060.stdout:5/896: rmdir d0/da/dc8/de4 39 2023-10-18T20:58:44.620 INFO:tasks.workunit.client.1.smithi060.stdout:3/820: truncate d0/d22/d26/fb0 169735 0 2023-10-18T20:58:44.620 INFO:tasks.workunit.client.1.smithi060.stdout:3/821: chown d0/d22/d26/d2c/f83 6 1 2023-10-18T20:58:44.620 INFO:tasks.workunit.client.1.smithi060.stdout:3/822: creat d0/d22/d26/d2c/f11d x:0 0 0 2023-10-18T20:58:44.622 INFO:tasks.workunit.client.0.smithi008.stdout:7/708: dread d1/d36/d3d/fab [0,4194304] 0 2023-10-18T20:58:44.622 INFO:tasks.workunit.client.0.smithi008.stdout:7/709: chown d1/d36/d3d/d3e/d59/ld5 21773 1 2023-10-18T20:58:44.623 INFO:tasks.workunit.client.1.smithi060.stdout:1/975: creat d4/d6/d48/f13b x:0 0 0 2023-10-18T20:58:44.623 INFO:tasks.workunit.client.1.smithi060.stdout:1/976: readlink d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/l129 0 2023-10-18T20:58:44.624 INFO:tasks.workunit.client.0.smithi008.stdout:5/653: rename d0/f1c to d0/dec/fee 0 2023-10-18T20:58:44.624 INFO:tasks.workunit.client.0.smithi008.stdout:5/654: fdatasync d0/d2/d9/d9b/d6f/d75/fa6 0 2023-10-18T20:58:44.627 INFO:tasks.workunit.client.0.smithi008.stdout:6/763: read df/d3c/d77/f51 [26276,81421] 0 2023-10-18T20:58:44.629 INFO:tasks.workunit.client.0.smithi008.stdout:8/843: link d5/l10 d5/d8/df/d9d/d4d/dba/dd4/d50/l132 0 2023-10-18T20:58:44.634 INFO:tasks.workunit.client.0.smithi008.stdout:2/691: mknod d1/d3/d40/ce3 0 2023-10-18T20:58:44.636 INFO:tasks.workunit.client.0.smithi008.stdout:3/743: mkdir d0/d3/d42/d52/df1 0 2023-10-18T20:58:44.639 INFO:tasks.workunit.client.1.smithi060.stdout:2/875: read d0/d16/d85/fbd [87500,62669] 0 2023-10-18T20:58:44.643 INFO:tasks.workunit.client.0.smithi008.stdout:5/655: write d0/d2/d19/d7c/d31/d3f/f60 [1968633,120011] 0 2023-10-18T20:58:44.644 INFO:tasks.workunit.client.1.smithi060.stdout:2/876: fsync d0/d45/d49/d55/dae/fbb 0 2023-10-18T20:58:44.650 INFO:tasks.workunit.client.0.smithi008.stdout:1/739: rename d9/de/df/d17/d1e/fad to d9/de/df/d77/fe7 0 2023-10-18T20:58:44.655 INFO:tasks.workunit.client.0.smithi008.stdout:2/692: symlink d1/d3/dd/d25/d76/d59/d85/dba/le4 0 2023-10-18T20:58:44.655 INFO:tasks.workunit.client.0.smithi008.stdout:2/693: chown d1/cbe 126849904 1 2023-10-18T20:58:44.658 INFO:tasks.workunit.client.1.smithi060.stdout:0/853: dwrite d3/d80/f82 [0,4194304] 0 2023-10-18T20:58:44.663 INFO:tasks.workunit.client.0.smithi008.stdout:3/744: unlink d0/d3/d15/l48 0 2023-10-18T20:58:44.663 INFO:tasks.workunit.client.0.smithi008.stdout:0/604: dwrite d0/dd/f15 [0,4194304] 0 2023-10-18T20:58:44.663 INFO:tasks.workunit.client.0.smithi008.stdout:3/745: readlink d0/d3/de/d13/l60 0 2023-10-18T20:58:44.665 INFO:tasks.workunit.client.1.smithi060.stdout:0/854: rename d3/d8/d14/d55/l61 to d3/d8/d14/d55/d74/d76/d68/d7f/d8d/dbc/l111 0 2023-10-18T20:58:44.672 INFO:tasks.workunit.client.1.smithi060.stdout:4/845: write d4/d15/ffd [1669810,31192] 0 2023-10-18T20:58:44.673 INFO:tasks.workunit.client.0.smithi008.stdout:5/656: creat d0/d2/d19/d7c/fef x:0 0 0 2023-10-18T20:58:44.673 INFO:tasks.workunit.client.0.smithi008.stdout:5/657: chown d0/de/lc6 192074 1 2023-10-18T20:58:44.676 INFO:tasks.workunit.client.1.smithi060.stdout:4/846: chown d4/dc/d2a/d13/fd5 1 1 2023-10-18T20:58:44.676 INFO:tasks.workunit.client.1.smithi060.stdout:7/947: dwrite de/d14/d3a/d46/fb7 [0,4194304] 0 2023-10-18T20:58:44.676 INFO:tasks.workunit.client.1.smithi060.stdout:7/948: dread - de/d14/d49/d68/d106/f11e zero size 2023-10-18T20:58:44.677 INFO:tasks.workunit.client.1.smithi060.stdout:7/949: fsync de/d14/d49/d68/d7d/d7e/db5/f120 0 2023-10-18T20:58:44.677 INFO:tasks.workunit.client.1.smithi060.stdout:0/855: link d3/d8/d3c/d87/dba/ff2 d3/d8/d14/d55/d74/d76/d68/f112 0 2023-10-18T20:58:44.678 INFO:tasks.workunit.client.1.smithi060.stdout:1/977: dread d4/d6/d7/d2f/d7b/d2a/d32/dd/fde [0,4194304] 0 2023-10-18T20:58:44.678 INFO:tasks.workunit.client.1.smithi060.stdout:1/978: chown d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/ffa 14566384 1 2023-10-18T20:58:44.678 INFO:tasks.workunit.client.0.smithi008.stdout:1/740: symlink d9/de/le8 0 2023-10-18T20:58:44.679 INFO:tasks.workunit.client.0.smithi008.stdout:2/694: creat d1/d3/dd/d25/fe5 x:0 0 0 2023-10-18T20:58:44.679 INFO:tasks.workunit.client.1.smithi060.stdout:3/823: dwrite d0/d22/d26/d8c/fbb [4194304,4194304] 0 2023-10-18T20:58:44.684 INFO:tasks.workunit.client.0.smithi008.stdout:0/605: link d0/c47 d0/d7c/d9a/d8a/d8f/d21/d85/cbc 0 2023-10-18T20:58:44.689 INFO:tasks.workunit.client.0.smithi008.stdout:0/606: chown d0/d3a/l91 0 1 2023-10-18T20:58:44.690 INFO:tasks.workunit.client.1.smithi060.stdout:3/824: mkdir d0/d22/d26/dfb/d11e 0 2023-10-18T20:58:44.692 INFO:tasks.workunit.client.0.smithi008.stdout:5/658: mknod d0/d2/d19/d7c/d31/d80/d91/cf0 0 2023-10-18T20:58:44.692 INFO:tasks.workunit.client.0.smithi008.stdout:5/659: dread - d0/d2/d19/d7c/d31/f55 zero size 2023-10-18T20:58:44.692 INFO:tasks.workunit.client.1.smithi060.stdout:3/825: symlink d0/d5e/l11f 0 2023-10-18T20:58:44.693 INFO:tasks.workunit.client.0.smithi008.stdout:6/764: dread df/d15/f16 [0,4194304] 0 2023-10-18T20:58:44.699 INFO:tasks.workunit.client.0.smithi008.stdout:2/695: dread d1/d3/dd/d25/f2f [0,4194304] 0 2023-10-18T20:58:44.699 INFO:tasks.workunit.client.0.smithi008.stdout:4/588: dwrite d0/d3/d21/d42/f79 [0,4194304] 0 2023-10-18T20:58:44.699 INFO:tasks.workunit.client.1.smithi060.stdout:3/826: getdents d0/d22/d26/d2c/da0 0 2023-10-18T20:58:44.701 INFO:tasks.workunit.client.1.smithi060.stdout:3/827: rmdir d0/d3c/d3d/d4d 39 2023-10-18T20:58:44.701 INFO:tasks.workunit.client.1.smithi060.stdout:3/828: chown d0/d22/d26/d2b/cdf 8 1 2023-10-18T20:58:44.701 INFO:tasks.workunit.client.1.smithi060.stdout:3/829: chown d0/d22/d26/d2c/l38 34010175 1 2023-10-18T20:58:44.702 INFO:tasks.workunit.client.0.smithi008.stdout:1/741: symlink d9/de/df/d17/d25/d94/le9 0 2023-10-18T20:58:44.703 INFO:tasks.workunit.client.0.smithi008.stdout:1/742: write d9/de/df/d17/d55/fb5 [304568,40185] 0 2023-10-18T20:58:44.703 INFO:tasks.workunit.client.0.smithi008.stdout:1/743: fdatasync d9/f7a 0 2023-10-18T20:58:44.703 INFO:tasks.workunit.client.1.smithi060.stdout:3/830: creat d0/d3c/d3d/d4d/f120 x:0 0 0 2023-10-18T20:58:44.704 INFO:tasks.workunit.client.0.smithi008.stdout:0/607: creat d0/dd/fbd x:0 0 0 2023-10-18T20:58:44.705 INFO:tasks.workunit.client.1.smithi060.stdout:8/832: dwrite d4/f30 [0,4194304] 0 2023-10-18T20:58:44.705 INFO:tasks.workunit.client.1.smithi060.stdout:8/833: fsync d4/d9/d37/fce 0 2023-10-18T20:58:44.705 INFO:tasks.workunit.client.1.smithi060.stdout:8/834: chown d4/d9/d31/d35/d9f/da3/dd8/ff7 58900 1 2023-10-18T20:58:44.706 INFO:tasks.workunit.client.1.smithi060.stdout:8/835: mkdir d4/d9/d31/d35/d9f/d101 0 2023-10-18T20:58:44.708 INFO:tasks.workunit.client.0.smithi008.stdout:5/660: getdents d0/d86 0 2023-10-18T20:58:44.708 INFO:tasks.workunit.client.0.smithi008.stdout:5/661: getdents d0/d2/d19/d7c/d31/d82/dad 0 2023-10-18T20:58:44.709 INFO:tasks.workunit.client.0.smithi008.stdout:5/662: write d0/d2/d9/f24 [4648242,106160] 0 2023-10-18T20:58:44.709 INFO:tasks.workunit.client.0.smithi008.stdout:5/663: chown d0/d2/d9/d9b/d6f/d75/fb8 565 1 2023-10-18T20:58:44.712 INFO:tasks.workunit.client.1.smithi060.stdout:3/831: read d0/d22/d26/d29/dae/de4/ff7 [16875,96303] 0 2023-10-18T20:58:44.715 INFO:tasks.workunit.client.1.smithi060.stdout:0/856: dread d3/d8/d14/d55/d74/fce [0,4194304] 0 2023-10-18T20:58:44.717 INFO:tasks.workunit.client.0.smithi008.stdout:6/765: rename df/l78 to df/d3c/da2/dcf/d3f/dcd/l105 0 2023-10-18T20:58:44.720 INFO:tasks.workunit.client.1.smithi060.stdout:7/950: read fc [252123,64925] 0 2023-10-18T20:58:44.722 INFO:tasks.workunit.client.1.smithi060.stdout:6/881: dwrite d10/d47/d92/d79/fa4 [0,4194304] 0 2023-10-18T20:58:44.724 INFO:tasks.workunit.client.0.smithi008.stdout:7/710: dwrite d1/d3/d20/d5f/d7f/f8d [0,4194304] 0 2023-10-18T20:58:44.725 INFO:tasks.workunit.client.1.smithi060.stdout:5/897: dwrite d0/d6/d8/f6b [0,4194304] 0 2023-10-18T20:58:44.728 INFO:tasks.workunit.client.0.smithi008.stdout:8/844: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/ffc [0,4194304] 0 2023-10-18T20:58:44.728 INFO:tasks.workunit.client.0.smithi008.stdout:2/696: creat d1/d3/dd/d25/d4d/fe6 x:0 0 0 2023-10-18T20:58:44.730 INFO:tasks.workunit.client.0.smithi008.stdout:4/589: creat d0/d58/d8e/db4/fc4 x:0 0 0 2023-10-18T20:58:44.732 INFO:tasks.workunit.client.0.smithi008.stdout:3/746: dwrite d0/d4a/d64/fd3 [0,4194304] 0 2023-10-18T20:58:44.732 INFO:tasks.workunit.client.0.smithi008.stdout:3/747: chown d0/d3/d15/f44 243 1 2023-10-18T20:58:44.733 INFO:tasks.workunit.client.1.smithi060.stdout:2/877: dwrite d0/d16/ded/f11c [0,4194304] 0 2023-10-18T20:58:44.734 INFO:tasks.workunit.client.1.smithi060.stdout:9/795: dwrite d3/d99/d19/d54/d11d/f83 [0,4194304] 0 2023-10-18T20:58:44.739 INFO:tasks.workunit.client.0.smithi008.stdout:5/664: write d0/d2/d9/f44 [1748720,28268] 0 2023-10-18T20:58:44.739 INFO:tasks.workunit.client.0.smithi008.stdout:1/744: mknod d9/de/df/d17/d25/d94/cea 0 2023-10-18T20:58:44.740 INFO:tasks.workunit.client.0.smithi008.stdout:9/608: dwrite d2/dc/f22 [0,4194304] 0 2023-10-18T20:58:44.742 INFO:tasks.workunit.client.1.smithi060.stdout:8/836: write d4/f13 [2933322,82344] 0 2023-10-18T20:58:44.746 INFO:tasks.workunit.client.1.smithi060.stdout:9/796: dread d3/d58/f95 [0,4194304] 0 2023-10-18T20:58:44.747 INFO:tasks.workunit.client.0.smithi008.stdout:4/590: dread d0/d58/d83/f89 [0,4194304] 0 2023-10-18T20:58:44.749 INFO:tasks.workunit.client.0.smithi008.stdout:6/766: rename df/d15/d27/d4c/c60 to df/d15/d48/d81/c106 0 2023-10-18T20:58:44.749 INFO:tasks.workunit.client.0.smithi008.stdout:6/767: fdatasync df/d3c/da2/dcf/d58/dec/f8f 0 2023-10-18T20:58:44.753 INFO:tasks.workunit.client.1.smithi060.stdout:0/857: dread d3/d8/d14/f5f [0,4194304] 0 2023-10-18T20:58:44.761 INFO:tasks.workunit.client.1.smithi060.stdout:1/979: dwrite d4/d6/d7/df/f15 [4194304,4194304] 0 2023-10-18T20:58:44.765 INFO:tasks.workunit.client.0.smithi008.stdout:8/845: unlink d5/d8/df/d9d/f96 0 2023-10-18T20:58:44.765 INFO:tasks.workunit.client.0.smithi008.stdout:8/846: chown d5/d8/df/d2e/l3c 225062895 1 2023-10-18T20:58:44.769 INFO:tasks.workunit.client.0.smithi008.stdout:3/748: mkdir d0/d3/de/d13/d35/dbf/de9/df2 0 2023-10-18T20:58:44.770 INFO:tasks.workunit.client.0.smithi008.stdout:5/665: symlink d0/da9/lf1 0 2023-10-18T20:58:44.771 INFO:tasks.workunit.client.0.smithi008.stdout:1/745: symlink d9/de/df/d17/d25/d94/da7/leb 0 2023-10-18T20:58:44.774 INFO:tasks.workunit.client.0.smithi008.stdout:9/609: mkdir d2/d8/db1 0 2023-10-18T20:58:44.781 INFO:tasks.workunit.client.0.smithi008.stdout:7/711: rename d1/da6/d4f/d87/ld4 to d1/d3/lde 0 2023-10-18T20:58:44.782 INFO:tasks.workunit.client.0.smithi008.stdout:7/712: truncate d1/d3/d20/f66 524535 0 2023-10-18T20:58:44.782 INFO:tasks.workunit.client.0.smithi008.stdout:3/749: mknod d0/d3/d42/d88/dae/cf3 0 2023-10-18T20:58:44.782 INFO:tasks.workunit.client.0.smithi008.stdout:2/697: dread d1/d3/dd/d25/d76/d59/f97 [0,4194304] 0 2023-10-18T20:58:44.786 INFO:tasks.workunit.client.0.smithi008.stdout:5/666: truncate d0/d2/d19/d7c/d31/d3f/d9a/fce 3055745 0 2023-10-18T20:58:44.786 INFO:tasks.workunit.client.0.smithi008.stdout:5/667: chown d0/d2/d9/f2d 1 1 2023-10-18T20:58:44.787 INFO:tasks.workunit.client.0.smithi008.stdout:9/610: mkdir d2/dc/d17/d19/d4a/db2 0 2023-10-18T20:58:44.787 INFO:tasks.workunit.client.0.smithi008.stdout:9/611: read d2/dc/d1a/fac [81010,43631] 0 2023-10-18T20:58:44.787 INFO:tasks.workunit.client.0.smithi008.stdout:9/612: dread - d2/dc/d17/d19/d4a/fab zero size 2023-10-18T20:58:44.788 INFO:tasks.workunit.client.0.smithi008.stdout:6/768: rename df/d3c/f67 to df/d15/d48/f107 0 2023-10-18T20:58:44.789 INFO:tasks.workunit.client.0.smithi008.stdout:7/713: getdents d1/d36/d3d/d3e/d59/d73/d7b/daf 0 2023-10-18T20:58:44.789 INFO:tasks.workunit.client.0.smithi008.stdout:7/714: chown d1/da6/l44 192 1 2023-10-18T20:58:44.793 INFO:tasks.workunit.client.0.smithi008.stdout:2/698: symlink d1/d3/d79/le7 0 2023-10-18T20:58:44.793 INFO:tasks.workunit.client.0.smithi008.stdout:2/699: chown d1/d3/dd/d1c/d3a/d57/f67 14 1 2023-10-18T20:58:44.794 INFO:tasks.workunit.client.0.smithi008.stdout:9/613: getdents d2/dc/d17/d19/d4a/d9a 0 2023-10-18T20:58:44.795 INFO:tasks.workunit.client.1.smithi060.stdout:5/898: mknod d0/d6/d9/d82/d84/db2/d41/c13d 0 2023-10-18T20:58:44.795 INFO:tasks.workunit.client.1.smithi060.stdout:5/899: truncate d0/dd/fcf 284168 0 2023-10-18T20:58:44.800 INFO:tasks.workunit.client.0.smithi008.stdout:7/715: mkdir d1/d3/d20/ddf 0 2023-10-18T20:58:44.801 INFO:tasks.workunit.client.0.smithi008.stdout:1/746: rename d9/de/df/d17/d25/d57/da6 to d9/de/df/d17/d1e/d7d/d89/dec 0 2023-10-18T20:58:44.802 INFO:tasks.workunit.client.1.smithi060.stdout:8/837: dwrite d4/fc6 [0,4194304] 0 2023-10-18T20:58:44.805 INFO:tasks.workunit.client.0.smithi008.stdout:4/591: dread d0/d17/d5b/f68 [4194304,4194304] 0 2023-10-18T20:58:44.808 INFO:tasks.workunit.client.1.smithi060.stdout:9/797: dwrite d3/f4 [0,4194304] 0 2023-10-18T20:58:44.814 INFO:tasks.workunit.client.0.smithi008.stdout:9/614: stat d2/dc/d17/d7b/lad 0 2023-10-18T20:58:44.814 INFO:tasks.workunit.client.0.smithi008.stdout:9/615: read - d2/d64/d90/fa8 zero size 2023-10-18T20:58:44.819 INFO:tasks.workunit.client.1.smithi060.stdout:4/847: dwrite d4/dc/d40/da8/fbc [0,4194304] 0 2023-10-18T20:58:44.821 INFO:tasks.workunit.client.0.smithi008.stdout:3/750: rename d0/d3/c12 to d0/d3/de/cf4 0 2023-10-18T20:58:44.822 INFO:tasks.workunit.client.0.smithi008.stdout:6/769: dread df/d3c/da2/dcf/d3f/f8e [0,4194304] 0 2023-10-18T20:58:44.822 INFO:tasks.workunit.client.0.smithi008.stdout:6/770: stat df/d3c/da2/dcf/d58/dec/daa/dcb/feb 0 2023-10-18T20:58:44.823 INFO:tasks.workunit.client.0.smithi008.stdout:8/847: dwrite d5/f3d [0,4194304] 0 2023-10-18T20:58:44.823 INFO:tasks.workunit.client.0.smithi008.stdout:8/848: chown d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/dc0/l108 367 1 2023-10-18T20:58:44.824 INFO:tasks.workunit.client.0.smithi008.stdout:8/849: unlink d5/f11 0 2023-10-18T20:58:44.825 INFO:tasks.workunit.client.1.smithi060.stdout:4/848: read d4/dc/d2a/d39/fb7 [342691,107713] 0 2023-10-18T20:58:44.828 INFO:tasks.workunit.client.0.smithi008.stdout:4/592: getdents d0/d3/d21 0 2023-10-18T20:58:44.828 INFO:tasks.workunit.client.0.smithi008.stdout:4/593: chown d0/c9c 0 1 2023-10-18T20:58:44.838 INFO:tasks.workunit.client.0.smithi008.stdout:7/716: dread d1/d3/f53 [0,4194304] 0 2023-10-18T20:58:44.847 INFO:tasks.workunit.client.0.smithi008.stdout:5/668: rename d0/d2/cd9 to d0/d2/d9/daa/cf2 0 2023-10-18T20:58:44.847 INFO:tasks.workunit.client.0.smithi008.stdout:8/850: mknod d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/c133 0 2023-10-18T20:58:44.847 INFO:tasks.workunit.client.0.smithi008.stdout:5/669: write d0/d6e/feb [602122,56223] 0 2023-10-18T20:58:44.848 INFO:tasks.workunit.client.0.smithi008.stdout:8/851: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/f134 x:0 0 0 2023-10-18T20:58:44.848 INFO:tasks.workunit.client.0.smithi008.stdout:8/852: chown d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/dc9/ld3 93560 1 2023-10-18T20:58:44.848 INFO:tasks.workunit.client.0.smithi008.stdout:8/853: fsync d5/d8/df/d9d/d4d/dba/dd4/d50/f6a 0 2023-10-18T20:58:44.848 INFO:tasks.workunit.client.0.smithi008.stdout:3/751: dread d0/d4a/d64/f83 [0,4194304] 0 2023-10-18T20:58:44.848 INFO:tasks.workunit.client.0.smithi008.stdout:1/747: dread d9/de/df/f10 [0,4194304] 0 2023-10-18T20:58:44.849 INFO:tasks.workunit.client.0.smithi008.stdout:3/752: write d0/d3/d42/d52/f6b [4393618,88369] 0 2023-10-18T20:58:44.849 INFO:tasks.workunit.client.1.smithi060.stdout:2/878: creat d0/d45/dc9/da8/f122 x:0 0 0 2023-10-18T20:58:44.886 INFO:tasks.workunit.client.0.smithi008.stdout:4/594: creat d0/d3/d21/d57/d8f/d73/fc5 x:0 0 0 2023-10-18T20:58:44.889 INFO:tasks.workunit.client.0.smithi008.stdout:2/700: rename d1/d3/dd/d48 to d1/d3/dd/d1c/d3a/d45/d83/de8 0 2023-10-18T20:58:44.891 INFO:tasks.workunit.client.0.smithi008.stdout:3/753: mkdir d0/d3/d37/d74/df5 0 2023-10-18T20:58:44.891 INFO:tasks.workunit.client.0.smithi008.stdout:3/754: fdatasync d0/d3/d37/d74/fe3 0 2023-10-18T20:58:44.891 INFO:tasks.workunit.client.0.smithi008.stdout:3/755: chown d0/d3/cdb 15801 1 2023-10-18T20:58:44.891 INFO:tasks.workunit.client.0.smithi008.stdout:3/756: chown d0/d4a/d64/f7e 109088684 1 2023-10-18T20:58:44.892 INFO:tasks.workunit.client.0.smithi008.stdout:3/757: fdatasync d0/d3/d42/fb0 0 2023-10-18T20:58:44.892 INFO:tasks.workunit.client.0.smithi008.stdout:3/758: getdents d0/d3/de/d13/d35/dbf/de9/df2 0 2023-10-18T20:58:44.892 INFO:tasks.workunit.client.0.smithi008.stdout:6/771: dwrite df/d3c/da2/dcf/d58/dec/daa/dcb/feb [0,4194304] 0 2023-10-18T20:58:44.895 INFO:tasks.workunit.client.0.smithi008.stdout:2/701: link d1/d3/dd/d1c/d3a/f3d d1/d3/dd/d1c/d3a/d49/fe9 0 2023-10-18T20:58:44.895 INFO:tasks.workunit.client.0.smithi008.stdout:2/702: dread - d1/d3/dd/f6f zero size 2023-10-18T20:58:44.897 INFO:tasks.workunit.client.0.smithi008.stdout:3/759: mkdir d0/d4a/d64/df6 0 2023-10-18T20:58:44.901 INFO:tasks.workunit.client.0.smithi008.stdout:3/760: write d0/d3/d42/d52/f73 [122125,80508] 0 2023-10-18T20:58:44.901 INFO:tasks.workunit.client.0.smithi008.stdout:3/761: chown d0/d4a 32246 1 2023-10-18T20:58:44.908 INFO:tasks.workunit.client.0.smithi008.stdout:1/748: dwrite d9/de/df/d17/d1e/d3c/d90/f99 [0,4194304] 0 2023-10-18T20:58:44.908 INFO:tasks.workunit.client.0.smithi008.stdout:1/749: chown d9/de/df/d17/d55/f79 916079376 1 2023-10-18T20:58:44.910 INFO:tasks.workunit.client.0.smithi008.stdout:9/616: dwrite d2/dc/d1a/f97 [0,4194304] 0 2023-10-18T20:58:44.911 INFO:tasks.workunit.client.0.smithi008.stdout:9/617: creat d2/dc/d17/d19/d4a/fb3 x:0 0 0 2023-10-18T20:58:44.911 INFO:tasks.workunit.client.0.smithi008.stdout:1/750: truncate d9/de/f45 2406013 0 2023-10-18T20:58:44.912 INFO:tasks.workunit.client.0.smithi008.stdout:9/618: truncate d2/dc/d17/d19/d4a/f81 222151 0 2023-10-18T20:58:44.930 INFO:tasks.workunit.client.1.smithi060.stdout:7/951: rmdir de/d14/d49/d68/d7d 39 2023-10-18T20:58:44.933 INFO:tasks.workunit.client.0.smithi008.stdout:1/751: dread d9/de/df/d17/f5f [0,4194304] 0 2023-10-18T20:58:44.933 INFO:tasks.workunit.client.0.smithi008.stdout:1/752: chown d9/fcc 2019430 1 2023-10-18T20:58:44.946 INFO:tasks.workunit.client.0.smithi008.stdout:2/703: dread d1/d3/dd/d1c/f3e [4194304,4194304] 0 2023-10-18T20:58:44.946 INFO:tasks.workunit.client.0.smithi008.stdout:2/704: chown d1/d3/dd/d1c/d3a/d45/d83/c8b 2409998 1 2023-10-18T20:58:44.946 INFO:tasks.workunit.client.0.smithi008.stdout:2/705: readlink d1/d3/dd/l2e 0 2023-10-18T20:58:44.947 INFO:tasks.workunit.client.0.smithi008.stdout:8/854: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/ffc [0,4194304] 0 2023-10-18T20:58:44.947 INFO:tasks.workunit.client.0.smithi008.stdout:9/619: dread d2/dc/d17/d19/fe [4194304,4194304] 0 2023-10-18T20:58:44.947 INFO:tasks.workunit.client.0.smithi008.stdout:8/855: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/dc0/f135 x:0 0 0 2023-10-18T20:58:44.947 INFO:tasks.workunit.client.0.smithi008.stdout:8/856: dread - d5/d8/df/d9d/d4d/db5/faf zero size 2023-10-18T20:58:44.948 INFO:tasks.workunit.client.0.smithi008.stdout:9/620: write d2/dc/d17/f76 [233212,93403] 0 2023-10-18T20:58:44.957 INFO:tasks.workunit.client.0.smithi008.stdout:5/670: dwrite d0/d2/d19/d7c/d31/d3f/d70/dc0/fd8 [0,4194304] 0 2023-10-18T20:58:44.970 INFO:tasks.workunit.client.0.smithi008.stdout:3/762: rmdir d0/d84 39 2023-10-18T20:58:44.970 INFO:tasks.workunit.client.0.smithi008.stdout:8/857: write d5/d8/f41 [895247,82926] 0 2023-10-18T20:58:44.971 INFO:tasks.workunit.client.0.smithi008.stdout:9/621: write d2/dc/d17/f77 [1385187,71849] 0 2023-10-18T20:58:44.971 INFO:tasks.workunit.client.0.smithi008.stdout:8/858: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/f136 x:0 0 0 2023-10-18T20:58:44.973 INFO:tasks.workunit.client.0.smithi008.stdout:3/763: mkdir d0/d3/d42/d52/df7 0 2023-10-18T20:58:44.973 INFO:tasks.workunit.client.0.smithi008.stdout:3/764: fdatasync d0/d3/f43 0 2023-10-18T20:58:44.976 INFO:tasks.workunit.client.0.smithi008.stdout:9/622: mknod d2/dc/d17/d7b/cb4 0 2023-10-18T20:58:44.977 INFO:tasks.workunit.client.0.smithi008.stdout:9/623: fdatasync d2/f1b 0 2023-10-18T20:58:44.977 INFO:tasks.workunit.client.0.smithi008.stdout:4/595: mkdir d0/d17/dc6 0 2023-10-18T20:58:44.978 INFO:tasks.workunit.client.0.smithi008.stdout:3/765: creat d0/d3/de/d13/ff8 x:0 0 0 2023-10-18T20:58:44.979 INFO:tasks.workunit.client.0.smithi008.stdout:3/766: fsync d0/d3/de/d13/f24 0 2023-10-18T20:58:44.979 INFO:tasks.workunit.client.0.smithi008.stdout:3/767: dread - d0/d3/d42/d88/fc5 zero size 2023-10-18T20:58:44.979 INFO:tasks.workunit.client.0.smithi008.stdout:3/768: unlink d0/fb1 0 2023-10-18T20:58:44.980 INFO:tasks.workunit.client.0.smithi008.stdout:3/769: creat d0/d3/de/d13/d35/ff9 x:0 0 0 2023-10-18T20:58:44.980 INFO:tasks.workunit.client.0.smithi008.stdout:9/624: link d2/dc/c52 d2/dc/d17/d7b/cb5 0 2023-10-18T20:58:44.995 INFO:tasks.workunit.client.1.smithi060.stdout:0/858: mknod d3/de5/d107/c113 0 2023-10-18T20:58:44.996 INFO:tasks.workunit.client.0.smithi008.stdout:2/706: dwrite d1/d3/dd/d25/d76/d59/fc4 [0,4194304] 0 2023-10-18T20:58:44.998 INFO:tasks.workunit.client.1.smithi060.stdout:1/980: symlink d4/d6/d7/d2f/d6d/l13c 0 2023-10-18T20:58:44.998 INFO:tasks.workunit.client.1.smithi060.stdout:1/981: fdatasync d4/da/f53 0 2023-10-18T20:58:44.998 INFO:tasks.workunit.client.0.smithi008.stdout:9/625: mknod d2/dc/d17/d19/d4a/d9a/cb6 0 2023-10-18T20:58:44.998 INFO:tasks.workunit.client.0.smithi008.stdout:9/626: creat d2/dc/d1a/fb7 x:0 0 0 2023-10-18T20:58:45.000 INFO:tasks.workunit.client.1.smithi060.stdout:5/900: rename d0/da/dc8/de4/d4f/fe0 to d0/d6/d9/db1/f13e 0 2023-10-18T20:58:45.001 INFO:tasks.workunit.client.1.smithi060.stdout:8/838: symlink d4/d9/db4/l102 0 2023-10-18T20:58:45.001 INFO:tasks.workunit.client.0.smithi008.stdout:6/772: rename df/d3c/da2 to df/d15/d48/ded/d108 0 2023-10-18T20:58:45.001 INFO:tasks.workunit.client.0.smithi008.stdout:6/773: readlink df/l92 0 2023-10-18T20:58:45.002 INFO:tasks.workunit.client.1.smithi060.stdout:9/798: symlink d3/d99/d1c/d5a/d5d/d7d/l126 0 2023-10-18T20:58:45.004 INFO:tasks.workunit.client.0.smithi008.stdout:2/707: creat d1/d3/dd/d1c/d3a/d57/fea x:0 0 0 2023-10-18T20:58:45.009 INFO:tasks.workunit.client.0.smithi008.stdout:6/774: rename df/d15/d27/f28 to df/d15/d48/ded/d108/dcf/f109 0 2023-10-18T20:58:45.009 INFO:tasks.workunit.client.1.smithi060.stdout:3/832: symlink d0/d3c/d3d/d4d/d95/l121 0 2023-10-18T20:58:45.011 INFO:tasks.workunit.client.1.smithi060.stdout:2/879: mkdir d0/d45/dc9/d102/d123 0 2023-10-18T20:58:45.011 INFO:tasks.workunit.client.1.smithi060.stdout:2/880: truncate d0/d45/d49/d55/dae/ffd 329558 0 2023-10-18T20:58:45.019 INFO:tasks.workunit.client.1.smithi060.stdout:6/882: rmdir d10/d17/d2f 39 2023-10-18T20:58:45.019 INFO:tasks.workunit.client.1.smithi060.stdout:7/952: creat de/d38/f138 x:0 0 0 2023-10-18T20:58:45.020 INFO:tasks.workunit.client.1.smithi060.stdout:6/883: creat d10/d3e/d76/f115 x:0 0 0 2023-10-18T20:58:45.020 INFO:tasks.workunit.client.1.smithi060.stdout:6/884: creat d10/d17/d54/db1/dea/dd6/f116 x:0 0 0 2023-10-18T20:58:45.020 INFO:tasks.workunit.client.1.smithi060.stdout:0/859: creat d3/de5/df1/f114 x:0 0 0 2023-10-18T20:58:45.021 INFO:tasks.workunit.client.1.smithi060.stdout:1/982: symlink d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d106/l13d 0 2023-10-18T20:58:45.022 INFO:tasks.workunit.client.1.smithi060.stdout:5/901: dread - d0/d47/df2/d10e/f119 zero size 2023-10-18T20:58:45.023 INFO:tasks.workunit.client.1.smithi060.stdout:8/839: creat d4/d9/d4f/d74/f103 x:0 0 0 2023-10-18T20:58:45.023 INFO:tasks.workunit.client.1.smithi060.stdout:3/833: getdents d0/d22/d26/d106 0 2023-10-18T20:58:45.024 INFO:tasks.workunit.client.0.smithi008.stdout:8/859: dread d5/d8/df/d9d/d85/db1/dcc/d104/f62 [0,4194304] 0 2023-10-18T20:58:45.025 INFO:tasks.workunit.client.1.smithi060.stdout:2/881: link d0/f78 d0/d45/dc9/d102/f124 0 2023-10-18T20:58:45.037 INFO:tasks.workunit.client.0.smithi008.stdout:2/708: write d1/f18 [1441246,30099] 0 2023-10-18T20:58:45.043 INFO:tasks.workunit.client.1.smithi060.stdout:3/834: read d0/f21 [176493,56250] 0 2023-10-18T20:58:45.044 INFO:tasks.workunit.client.1.smithi060.stdout:6/885: getdents d10/d47 0 2023-10-18T20:58:45.044 INFO:tasks.workunit.client.1.smithi060.stdout:7/953: mknod de/d14/d2f/dca/c139 0 2023-10-18T20:58:45.045 INFO:tasks.workunit.client.1.smithi060.stdout:7/954: stat de/d14/d3a/d46/d12b 0 2023-10-18T20:58:45.045 INFO:tasks.workunit.client.1.smithi060.stdout:1/983: unlink d4/d6/d7/d2f/d7b/d2a/ca3 0 2023-10-18T20:58:45.045 INFO:tasks.workunit.client.1.smithi060.stdout:0/860: rename d3/d32/d86/l102 to d3/d8/dac/l115 0 2023-10-18T20:58:45.045 INFO:tasks.workunit.client.1.smithi060.stdout:7/955: truncate de/d14/d49/d68/d88/fdf 527214 0 2023-10-18T20:58:45.046 INFO:tasks.workunit.client.1.smithi060.stdout:8/840: symlink d4/d9/d31/d35/d9f/l104 0 2023-10-18T20:58:45.052 INFO:tasks.workunit.client.0.smithi008.stdout:5/671: dwrite d0/d86/fae [0,4194304] 0 2023-10-18T20:58:45.052 INFO:tasks.workunit.client.0.smithi008.stdout:5/672: creat d0/d2/d19/d7c/d31/d3f/d9a/ff3 x:0 0 0 2023-10-18T20:58:45.053 INFO:tasks.workunit.client.0.smithi008.stdout:5/673: fdatasync d0/d2/d19/fc7 0 2023-10-18T20:58:45.053 INFO:tasks.workunit.client.1.smithi060.stdout:2/882: unlink d0/d16/d81/da1/ddd/f10f 0 2023-10-18T20:58:45.054 INFO:tasks.workunit.client.1.smithi060.stdout:1/984: mknod d4/d6/d7/d2f/d7b/c13e 0 2023-10-18T20:58:45.054 INFO:tasks.workunit.client.1.smithi060.stdout:6/886: creat d10/d2e/f117 x:0 0 0 2023-10-18T20:58:45.054 INFO:tasks.workunit.client.1.smithi060.stdout:0/861: symlink d3/d8/d14/dec/l116 0 2023-10-18T20:58:45.054 INFO:tasks.workunit.client.1.smithi060.stdout:0/862: chown d3/d32/d86/f109 5092 1 2023-10-18T20:58:45.054 INFO:tasks.workunit.client.1.smithi060.stdout:0/863: fdatasync d3/d8/d14/d55/d9a/fcb 0 2023-10-18T20:58:45.055 INFO:tasks.workunit.client.1.smithi060.stdout:0/864: write d3/d8/d3c/d87/dba/fe6 [56156,107927] 0 2023-10-18T20:58:45.058 INFO:tasks.workunit.client.0.smithi008.stdout:4/596: dwrite d0/d3/fa5 [0,4194304] 0 2023-10-18T20:58:45.061 INFO:tasks.workunit.client.1.smithi060.stdout:3/835: symlink d0/d3c/l122 0 2023-10-18T20:58:45.061 INFO:tasks.workunit.client.1.smithi060.stdout:2/883: creat d0/d45/dc9/f125 x:0 0 0 2023-10-18T20:58:45.064 INFO:tasks.workunit.client.1.smithi060.stdout:1/985: mknod d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/c13f 0 2023-10-18T20:58:45.069 INFO:tasks.workunit.client.1.smithi060.stdout:0/865: rename d3/d8/d14/d55/d9a/dcf/fd6 to d3/d80/dd9/f117 0 2023-10-18T20:58:45.070 INFO:tasks.workunit.client.0.smithi008.stdout:4/597: truncate d0/d3/d21/d57/d8f/f88 1985092 0 2023-10-18T20:58:45.070 INFO:tasks.workunit.client.0.smithi008.stdout:5/674: write d0/d6e/f97 [2444894,105086] 0 2023-10-18T20:58:45.071 INFO:tasks.workunit.client.1.smithi060.stdout:2/884: symlink d0/d45/d49/d6e/l126 0 2023-10-18T20:58:45.072 INFO:tasks.workunit.client.0.smithi008.stdout:4/598: mkdir d0/d58/dc7 0 2023-10-18T20:58:45.073 INFO:tasks.workunit.client.0.smithi008.stdout:4/599: chown d0/d58/dc7 179191625 1 2023-10-18T20:58:45.073 INFO:tasks.workunit.client.0.smithi008.stdout:4/600: write d0/f12 [973681,122311] 0 2023-10-18T20:58:45.073 INFO:tasks.workunit.client.0.smithi008.stdout:2/709: write d1/d3/dd/d1c/d3a/d45/f84 [1677745,113034] 0 2023-10-18T20:58:45.076 INFO:tasks.workunit.client.0.smithi008.stdout:5/675: symlink d0/d2/d19/d7c/d42/d5a/lf4 0 2023-10-18T20:58:45.076 INFO:tasks.workunit.client.0.smithi008.stdout:8/860: rename d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/dc0 to d5/d8/df/d9d/d85/db1/d137 0 2023-10-18T20:58:45.077 INFO:tasks.workunit.client.1.smithi060.stdout:1/986: mknod d4/da/c140 0 2023-10-18T20:58:45.077 INFO:tasks.workunit.client.1.smithi060.stdout:0/866: creat d3/f118 x:0 0 0 2023-10-18T20:58:45.077 INFO:tasks.workunit.client.1.smithi060.stdout:1/987: fdatasync d4/d6/d33/d58/fc5 0 2023-10-18T20:58:45.079 INFO:tasks.workunit.client.1.smithi060.stdout:2/885: mknod d0/d3/d27/d4d/d5e/c127 0 2023-10-18T20:58:45.081 INFO:tasks.workunit.client.1.smithi060.stdout:0/867: link d3/d8/d14/d55/d74/d76/d68/f72 d3/d80/f119 0 2023-10-18T20:58:45.081 INFO:tasks.workunit.client.1.smithi060.stdout:3/836: write d0/d3c/d3d/fd9 [548466,108421] 0 2023-10-18T20:58:45.081 INFO:tasks.workunit.client.1.smithi060.stdout:3/837: fdatasync d0/f1c 0 2023-10-18T20:58:45.082 INFO:tasks.workunit.client.0.smithi008.stdout:8/861: dread d5/d8/df/d9d/d4d/f6d [0,4194304] 0 2023-10-18T20:58:45.084 INFO:tasks.workunit.client.0.smithi008.stdout:3/770: dwrite d0/d3/de/d13/d35/fc9 [0,4194304] 0 2023-10-18T20:58:45.084 INFO:tasks.workunit.client.0.smithi008.stdout:3/771: truncate d0/d3/d42/f99 4389666 0 2023-10-18T20:58:45.085 INFO:tasks.workunit.client.1.smithi060.stdout:1/988: creat d4/d38/d11f/d41/f141 x:0 0 0 2023-10-18T20:58:45.086 INFO:tasks.workunit.client.1.smithi060.stdout:1/989: fdatasync d4/d6/d7/df/f12f 0 2023-10-18T20:58:45.086 INFO:tasks.workunit.client.1.smithi060.stdout:2/886: mknod d0/d3/d27/d4d/d53/de5/c128 0 2023-10-18T20:58:45.086 INFO:tasks.workunit.client.1.smithi060.stdout:2/887: readlink d0/d3/d27/d4d/d53/de5/l10a 0 2023-10-18T20:58:45.086 INFO:tasks.workunit.client.1.smithi060.stdout:3/838: rmdir d0/d22/d26 39 2023-10-18T20:58:45.087 INFO:tasks.workunit.client.1.smithi060.stdout:2/888: mkdir d0/d45/d129 0 2023-10-18T20:58:45.087 INFO:tasks.workunit.client.1.smithi060.stdout:5/902: dwrite d0/f1d [0,4194304] 0 2023-10-18T20:58:45.087 INFO:tasks.workunit.client.1.smithi060.stdout:5/903: truncate d0/d6/d8/d81/f11e 144919 0 2023-10-18T20:58:45.094 INFO:tasks.workunit.client.0.smithi008.stdout:4/601: rename d0/d17/d5b/c9b to d0/d3/d21/d57/d8f/d82/cc8 0 2023-10-18T20:58:45.096 INFO:tasks.workunit.client.0.smithi008.stdout:8/862: creat d5/d8/df/d9d/d4d/db5/f138 x:0 0 0 2023-10-18T20:58:45.098 INFO:tasks.workunit.client.1.smithi060.stdout:3/839: mkdir d0/d3c/d3d/d4d/d95/d123 0 2023-10-18T20:58:45.099 INFO:tasks.workunit.client.1.smithi060.stdout:2/889: truncate d0/d3/d27/d4d/f5b 4106940 0 2023-10-18T20:58:45.099 INFO:tasks.workunit.client.1.smithi060.stdout:3/840: stat d0/d3c/c8a 0 2023-10-18T20:58:45.101 INFO:tasks.workunit.client.1.smithi060.stdout:2/890: mknod d0/d3/d27/d4d/d5e/df5/c12a 0 2023-10-18T20:58:45.101 INFO:tasks.workunit.client.1.smithi060.stdout:2/891: chown d0/d3/d27/l3e 358402 1 2023-10-18T20:58:45.102 INFO:tasks.workunit.client.1.smithi060.stdout:3/841: mknod d0/d22/c124 0 2023-10-18T20:58:45.104 INFO:tasks.workunit.client.0.smithi008.stdout:6/775: dwrite df/d15/d48/ded/d108/dcf/f21 [0,4194304] 0 2023-10-18T20:58:45.104 INFO:tasks.workunit.client.0.smithi008.stdout:4/602: link d0/d3/c4b d0/d58/dbf/cc9 0 2023-10-18T20:58:45.105 INFO:tasks.workunit.client.1.smithi060.stdout:2/892: rmdir d0/d45/d49/d55/dbf/d111 0 2023-10-18T20:58:45.106 INFO:tasks.workunit.client.1.smithi060.stdout:3/842: creat d0/d22/dff/f125 x:0 0 0 2023-10-18T20:58:45.108 INFO:tasks.workunit.client.1.smithi060.stdout:2/893: rename d0/d16/d85/ff4 to d0/d16/d7f/f12b 0 2023-10-18T20:58:45.114 INFO:tasks.workunit.client.1.smithi060.stdout:2/894: rmdir d0/d16/d81/da1 39 2023-10-18T20:58:45.116 INFO:tasks.workunit.client.1.smithi060.stdout:2/895: rmdir d0/d45/d49/d55 39 2023-10-18T20:58:45.122 INFO:tasks.workunit.client.0.smithi008.stdout:4/603: creat d0/d58/dbf/fca x:0 0 0 2023-10-18T20:58:45.129 INFO:tasks.workunit.client.0.smithi008.stdout:4/604: symlink d0/d17/lcb 0 2023-10-18T20:58:45.131 INFO:tasks.workunit.client.1.smithi060.stdout:5/904: read d0/da/d3b/f8f [4060920,38314] 0 2023-10-18T20:58:45.134 INFO:tasks.workunit.client.0.smithi008.stdout:4/605: creat d0/d17/d5b/fcc x:0 0 0 2023-10-18T20:58:45.139 INFO:tasks.workunit.client.1.smithi060.stdout:0/868: dwrite d3/d8/d3c/d87/dba/ff2 [0,4194304] 0 2023-10-18T20:58:45.139 INFO:tasks.workunit.client.1.smithi060.stdout:0/869: readlink d3/d8/d14/dec/l116 0 2023-10-18T20:58:45.139 INFO:tasks.workunit.client.1.smithi060.stdout:0/870: truncate d3/f71 1275280 0 2023-10-18T20:58:45.140 INFO:tasks.workunit.client.1.smithi060.stdout:0/871: creat d3/d8/d3c/f11a x:0 0 0 2023-10-18T20:58:45.140 INFO:tasks.workunit.client.0.smithi008.stdout:2/710: dwrite d1/d3/dd/d25/f30 [0,4194304] 0 2023-10-18T20:58:45.141 INFO:tasks.workunit.client.0.smithi008.stdout:2/711: chown d1/d3/dd/d1c/d3a/d45/d83/de8/la4 859 1 2023-10-18T20:58:45.142 INFO:tasks.workunit.client.0.smithi008.stdout:6/776: write df/d15/d27/dbf/f9e [845153,71114] 0 2023-10-18T20:58:45.142 INFO:tasks.workunit.client.0.smithi008.stdout:6/777: fsync df/d15/d48/ded/d108/dcf/d3f/f7b 0 2023-10-18T20:58:45.142 INFO:tasks.workunit.client.0.smithi008.stdout:6/778: fdatasync df/d15/d27/f4a 0 2023-10-18T20:58:45.143 INFO:tasks.workunit.client.0.smithi008.stdout:5/676: dwrite d0/d6e/feb [0,4194304] 0 2023-10-18T20:58:45.144 INFO:tasks.workunit.client.1.smithi060.stdout:5/905: creat d0/dd/d76/d10f/da5/d11d/f13f x:0 0 0 2023-10-18T20:58:45.146 INFO:tasks.workunit.client.1.smithi060.stdout:5/906: write d0/da/ff6 [1392536,95450] 0 2023-10-18T20:58:45.146 INFO:tasks.workunit.client.1.smithi060.stdout:5/907: chown d0/da/dc8/cc9 451039644 1 2023-10-18T20:58:45.148 INFO:tasks.workunit.client.0.smithi008.stdout:6/779: mkdir df/d15/d48/ded/d108/dcf/d3f/dcd/d10a 0 2023-10-18T20:58:45.149 INFO:tasks.workunit.client.0.smithi008.stdout:5/677: mkdir d0/d2/d19/d7c/d31/d82/df5 0 2023-10-18T20:58:45.151 INFO:tasks.workunit.client.1.smithi060.stdout:0/872: getdents d3/d8/d14/d55/d74/d76/d68/d7f/d8d 0 2023-10-18T20:58:45.152 INFO:tasks.workunit.client.1.smithi060.stdout:0/873: creat d3/de5/df1/f11b x:0 0 0 2023-10-18T20:58:45.152 INFO:tasks.workunit.client.1.smithi060.stdout:0/874: write d3/d8/d3c/d87/dba/fe6 [149397,14696] 0 2023-10-18T20:58:45.153 INFO:tasks.workunit.client.0.smithi008.stdout:4/606: symlink d0/d17/lcd 0 2023-10-18T20:58:45.153 INFO:tasks.workunit.client.0.smithi008.stdout:5/678: rmdir d0/d2/d19 39 2023-10-18T20:58:45.153 INFO:tasks.workunit.client.1.smithi060.stdout:0/875: getdents d3/de5/d107 0 2023-10-18T20:58:45.154 INFO:tasks.workunit.client.0.smithi008.stdout:2/712: read d1/d3/dd/d1c/d3a/d49/fe9 [530117,809] 0 2023-10-18T20:58:45.155 INFO:tasks.workunit.client.1.smithi060.stdout:1/990: dwrite d4/d6/f1f [0,4194304] 0 2023-10-18T20:58:45.155 INFO:tasks.workunit.client.0.smithi008.stdout:2/713: creat d1/d3/d40/de0/feb x:0 0 0 2023-10-18T20:58:45.156 INFO:tasks.workunit.client.1.smithi060.stdout:0/876: creat d3/d8/d14/d55/d74/d76/d6b/f11c x:0 0 0 2023-10-18T20:58:45.158 INFO:tasks.workunit.client.0.smithi008.stdout:5/679: rmdir d0/d2/d19/d7c/d31/d80 39 2023-10-18T20:58:45.159 INFO:tasks.workunit.client.0.smithi008.stdout:5/680: fsync d0/d2/d19/d7c/d64/f7e 0 2023-10-18T20:58:45.159 INFO:tasks.workunit.client.0.smithi008.stdout:5/681: dread - d0/d2/d19/d7c/d58/d65/fd5 zero size 2023-10-18T20:58:45.159 INFO:tasks.workunit.client.0.smithi008.stdout:3/772: dwrite d0/f54 [4194304,4194304] 0 2023-10-18T20:58:45.161 INFO:tasks.workunit.client.0.smithi008.stdout:3/773: getdents d0/d3/d37/d74/da2 0 2023-10-18T20:58:45.161 INFO:tasks.workunit.client.0.smithi008.stdout:3/774: creat d0/d3/d37/d6f/ffa x:0 0 0 2023-10-18T20:58:45.172 INFO:tasks.workunit.client.1.smithi060.stdout:5/908: read d0/dd/d76/d10f/da5/f3d [2801139,58954] 0 2023-10-18T20:58:45.173 INFO:tasks.workunit.client.1.smithi060.stdout:3/843: dwrite d0/d22/d50/f9f [0,4194304] 0 2023-10-18T20:58:45.173 INFO:tasks.workunit.client.1.smithi060.stdout:1/991: dread d4/da/f5b [0,4194304] 0 2023-10-18T20:58:45.173 INFO:tasks.workunit.client.1.smithi060.stdout:1/992: write d4/d6/fb4 [1719723,68538] 0 2023-10-18T20:58:45.173 INFO:tasks.workunit.client.1.smithi060.stdout:1/993: chown d4/d6/d7/d2f/d7b/d2a/d32/dd/da4/fc3 1 1 2023-10-18T20:58:45.174 INFO:tasks.workunit.client.1.smithi060.stdout:1/994: chown d4/d6/d7/d2f/d7b/d2a/d32/d56/d67/d87/d9e/deb/d110 957122 1 2023-10-18T20:58:45.174 INFO:tasks.workunit.client.1.smithi060.stdout:0/877: fsync d3/d8/d3c/d87/dba/fe6 0 2023-10-18T20:58:45.174 INFO:tasks.workunit.client.1.smithi060.stdout:0/878: truncate d3/d8/d14/f40 4529081 0 2023-10-18T20:58:45.187 INFO:tasks.workunit.client.0.smithi008.stdout:4/607: read d0/d58/d8e/f6d [1049745,16289] 0 2023-10-18T20:58:45.189 INFO:tasks.workunit.client.0.smithi008.stdout:4/608: getdents d0/d17/d5b/d99 0 2023-10-18T20:58:45.190 INFO:tasks.workunit.client.0.smithi008.stdout:4/609: fsync d0/d17/f1a 0 2023-10-18T20:58:45.190 INFO:tasks.workunit.client.0.smithi008.stdout:4/610: read d0/d17/d5b/d45/f92 [3411387,49392] 0 2023-10-18T20:58:45.191 INFO:tasks.workunit.client.1.smithi060.stdout:3/844: mknod d0/d22/d26/d2b/def/c126 0 2023-10-18T20:58:45.192 INFO:tasks.workunit.client.1.smithi060.stdout:1/995: rename d4/d6/d7/d2f/d7b/ffe to d4/d6/d7/d2f/d7b/d2a/d32/d56/f142 0 2023-10-18T20:58:45.196 INFO:tasks.workunit.client.0.smithi008.stdout:4/611: rename d0/d3/d21/d57/d8f/d73/fc5 to d0/fce 0 2023-10-18T20:58:45.199 INFO:tasks.workunit.client.1.smithi060.stdout:0/879: mkdir d3/d8/d14/d55/d74/d76/d68/d7f/d8d/dbc/d11d 0 2023-10-18T20:58:45.200 INFO:tasks.workunit.client.0.smithi008.stdout:4/612: symlink d0/d3/d21/d57/d8f/d95/lcf 0 2023-10-18T20:58:45.202 INFO:tasks.workunit.client.0.smithi008.stdout:3/775: dwrite d0/d3/de/d13/d35/fc7 [0,4194304] 0 2023-10-18T20:58:45.205 INFO:tasks.workunit.client.1.smithi060.stdout:0/880: creat d3/d80/db5/f11e x:0 0 0 2023-10-18T20:58:45.205 INFO:tasks.workunit.client.1.smithi060.stdout:3/845: dread d0/d22/d26/d29/fdc [0,4194304] 0 2023-10-18T20:58:45.208 INFO:tasks.workunit.client.0.smithi008.stdout:3/776: stat d0/d3/d37/led 0 2023-10-18T20:58:45.209 INFO:tasks.workunit.client.1.smithi060.stdout:0/881: chown d3/d8/f20 15141695 1 2023-10-18T20:58:45.213 INFO:tasks.workunit.client.0.smithi008.stdout:8/863: dwrite d5/d8/df/f39 [0,4194304] 0 2023-10-18T20:58:45.216 INFO:tasks.workunit.client.0.smithi008.stdout:8/864: mkdir d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/d139 0 2023-10-18T20:58:45.218 INFO:tasks.workunit.client.0.smithi008.stdout:4/613: write d0/d3/d21/f3b [2456180,91333] 0 2023-10-18T20:58:45.222 INFO:tasks.workunit.client.1.smithi060.stdout:0/882: rename d3/d8/d14 to d3/d8/d11f 0 2023-10-18T20:58:45.222 INFO:tasks.workunit.client.1.smithi060.stdout:3/846: write d0/fd [3230634,73663] 0 2023-10-18T20:58:45.222 INFO:tasks.workunit.client.1.smithi060.stdout:4/849: sync 2023-10-18T20:58:45.222 INFO:tasks.workunit.client.1.smithi060.stdout:1/996: dread d4/d6/d7/d2f/fe1 [0,4194304] 0 2023-10-18T20:58:45.223 INFO:tasks.workunit.client.1.smithi060.stdout:1/997: creat d4/da/de0/de9/f143 x:0 0 0 2023-10-18T20:58:45.225 INFO:tasks.workunit.client.0.smithi008.stdout:5/682: dwrite d0/d2/d19/d7c/d58/d65/fd5 [0,4194304] 0 2023-10-18T20:58:45.227 INFO:tasks.workunit.client.1.smithi060.stdout:0/883: creat d3/d8/d11f/d55/d74/d76/d6b/f120 x:0 0 0 2023-10-18T20:58:45.227 INFO:tasks.workunit.client.1.smithi060.stdout:3/847: creat d0/d22/d26/f127 x:0 0 0 2023-10-18T20:58:45.228 INFO:tasks.workunit.client.1.smithi060.stdout:4/850: creat d4/dc/d2a/d2d/f109 x:0 0 0 2023-10-18T20:58:45.230 INFO:tasks.workunit.client.1.smithi060.stdout:4/851: mknod d4/dc/d40/d80/c10a 0 2023-10-18T20:58:45.231 INFO:tasks.workunit.client.0.smithi008.stdout:4/614: dread d0/d17/d5b/d2a/f3c [0,4194304] 0 2023-10-18T20:58:45.231 INFO:tasks.workunit.client.0.smithi008.stdout:4/615: chown d0/d3/f67 11042643 1 2023-10-18T20:58:45.234 INFO:tasks.workunit.client.1.smithi060.stdout:4/852: mknod d4/dc/d2a/d39/d53/d76/d99/c10b 0 2023-10-18T20:58:45.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:44.068033+0000 mon.smithi008 (mon.0) 663 : cluster [DBG] mgrmap e28: smithi008.flmjzp(active, since 14s), standbys: smithi060.pgqqwa 2023-10-18T20:58:45.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:44.120690+0000 mgr.smithi008.flmjzp (mgr.14640) 16 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 2.9 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 129 MiB/s rd, 158 MiB/s wr, 237 op/s 2023-10-18T20:58:45.241 INFO:tasks.workunit.client.0.smithi008.stdout:2/714: dwrite d1/d3/dd/d25/d34/f46 [0,4194304] 0 2023-10-18T20:58:45.241 INFO:tasks.workunit.client.0.smithi008.stdout:2/715: write d1/d3/f4b [4985002,89434] 0 2023-10-18T20:58:45.244 INFO:tasks.workunit.client.0.smithi008.stdout:8/865: rmdir d5/d8/df/d9d/d4d/db5 39 2023-10-18T20:58:45.246 INFO:tasks.workunit.client.1.smithi060.stdout:1/998: dread d4/d6/d7/d2f/d7b/d2a/d32/fe4 [0,4194304] 0 2023-10-18T20:58:45.247 INFO:tasks.workunit.client.0.smithi008.stdout:8/866: truncate d5/d8/df/d2e/f71 486356 0 2023-10-18T20:58:45.247 INFO:tasks.workunit.client.0.smithi008.stdout:8/867: unlink d5/d8/df/d9d/l1e 0 2023-10-18T20:58:45.248 INFO:tasks.workunit.client.0.smithi008.stdout:8/868: readlink d5/d8/l4a 0 2023-10-18T20:58:45.249 INFO:tasks.workunit.client.1.smithi060.stdout:0/884: write d3/f6c [2204395,10652] 0 2023-10-18T20:58:45.264 INFO:tasks.workunit.client.0.smithi008.stdout:8/869: mknod d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/dc9/c13a 0 2023-10-18T20:58:45.264 INFO:tasks.workunit.client.0.smithi008.stdout:8/870: write d5/f25 [1404101,25272] 0 2023-10-18T20:58:45.271 INFO:tasks.workunit.client.0.smithi008.stdout:4/616: write d0/d58/d8e/f9a [2080704,13652] 0 2023-10-18T20:58:45.271 INFO:tasks.workunit.client.0.smithi008.stdout:4/617: chown d0/d3/d21/c35 105 1 2023-10-18T20:58:45.271 INFO:tasks.workunit.client.0.smithi008.stdout:4/618: chown d0/d3/d21/d57/d8f/f72 1318269 1 2023-10-18T20:58:45.275 INFO:tasks.workunit.client.1.smithi060.stdout:0/885: dread d3/d8/d11f/f40 [0,4194304] 0 2023-10-18T20:58:45.277 INFO:tasks.workunit.client.0.smithi008.stdout:4/619: getdents d0/d58/d83 0 2023-10-18T20:58:45.277 INFO:tasks.workunit.client.0.smithi008.stdout:4/620: rename d0/d17/d5b to d0/d17/d5b/d45/dd0 22 2023-10-18T20:58:45.277 INFO:tasks.workunit.client.0.smithi008.stdout:4/621: fdatasync d0/d3/fa5 0 2023-10-18T20:58:45.278 INFO:tasks.workunit.client.1.smithi060.stdout:0/886: creat d3/d8/d11f/d55/d74/d76/f121 x:0 0 0 2023-10-18T20:58:45.279 INFO:tasks.workunit.client.1.smithi060.stdout:0/887: symlink d3/de5/df1/dea/l122 0 2023-10-18T20:58:45.280 INFO:tasks.workunit.client.1.smithi060.stdout:0/888: read d3/d8/d3c/d87/dba/fe6 [8000,81753] 0 2023-10-18T20:58:45.281 INFO:tasks.workunit.client.0.smithi008.stdout:0/608: sync 2023-10-18T20:58:45.281 INFO:tasks.workunit.client.0.smithi008.stdout:4/622: creat d0/d3/d21/d57/d8f/d95/fd1 x:0 0 0 2023-10-18T20:58:45.284 INFO:tasks.workunit.client.0.smithi008.stdout:4/623: unlink d0/d58/d8e/l66 0 2023-10-18T20:58:45.284 INFO:tasks.workunit.client.1.smithi060.stdout:0/889: creat d3/d8/d11f/d55/d9a/f123 x:0 0 0 2023-10-18T20:58:45.285 INFO:tasks.workunit.client.0.smithi008.stdout:3/777: dwrite d0/f59 [4194304,4194304] 0 2023-10-18T20:58:45.285 INFO:tasks.workunit.client.1.smithi060.stdout:1/999: write d4/d38/d11f/d41/fa5 [895589,58931] 0 2023-10-18T20:58:45.287 INFO:tasks.workunit.client.1.smithi060.stdout:5/909: dwrite d0/da/dc8/de4/fd6 [4194304,4194304] 0 2023-10-18T20:58:45.287 INFO:tasks.workunit.client.0.smithi008.stdout:4/624: unlink d0/d3/c4b 0 2023-10-18T20:58:45.288 INFO:tasks.workunit.client.0.smithi008.stdout:3/778: creat d0/d3/d42/d52/ffb x:0 0 0 2023-10-18T20:58:45.290 INFO:tasks.workunit.client.0.smithi008.stdout:3/779: creat d0/d4a/d64/d80/ffc x:0 0 0 2023-10-18T20:58:45.290 INFO:tasks.workunit.client.1.smithi060.stdout:3/848: dwrite d0/d5e/dbc/fbf [4194304,4194304] 0 2023-10-18T20:58:45.291 INFO:tasks.workunit.client.1.smithi060.stdout:3/849: readlink d0/d22/d26/d79/l111 0 2023-10-18T20:58:45.291 INFO:tasks.workunit.client.1.smithi060.stdout:4/853: dwrite d4/dc/d2a/d13/d33/f35 [4194304,4194304] 0 2023-10-18T20:58:45.292 INFO:tasks.workunit.client.1.smithi060.stdout:5/910: creat d0/da/d3b/d64/f140 x:0 0 0 2023-10-18T20:58:45.292 INFO:tasks.workunit.client.0.smithi008.stdout:3/780: read d0/f54 [8388724,48292] 0 2023-10-18T20:58:45.293 INFO:tasks.workunit.client.0.smithi008.stdout:5/683: dwrite d0/d2/d19/d7c/d31/d3f/d70/fa8 [0,4194304] 0 2023-10-18T20:58:45.293 INFO:tasks.workunit.client.0.smithi008.stdout:3/781: chown d0/d3/de/d13/d35/fc9 242483 1 2023-10-18T20:58:45.293 INFO:tasks.workunit.client.0.smithi008.stdout:3/782: chown d0/d4a/d64/f83 18 1 2023-10-18T20:58:45.293 INFO:tasks.workunit.client.0.smithi008.stdout:3/783: dread - d0/d4a/fe5 zero size 2023-10-18T20:58:45.293 INFO:tasks.workunit.client.0.smithi008.stdout:5/684: write d0/d2/d19/d7c/f95 [2396562,123848] 0 2023-10-18T20:58:45.294 INFO:tasks.workunit.client.0.smithi008.stdout:5/685: dread - d0/d2/d19/d7c/d31/d82/fdc zero size 2023-10-18T20:58:45.294 INFO:tasks.workunit.client.1.smithi060.stdout:0/890: dread d3/de5/df1/dea/ff6 [0,4194304] 0 2023-10-18T20:58:45.294 INFO:tasks.workunit.client.1.smithi060.stdout:0/891: write d3/d8/dac/f100 [461675,4352] 0 2023-10-18T20:58:45.295 INFO:tasks.workunit.client.1.smithi060.stdout:0/892: write d3/d8/d3c/d87/dba/fe6 [566811,47480] 0 2023-10-18T20:58:45.295 INFO:tasks.workunit.client.1.smithi060.stdout:0/893: write d3/f6c [2572531,68104] 0 2023-10-18T20:58:45.295 INFO:tasks.workunit.client.0.smithi008.stdout:2/716: dwrite d1/f1a [4194304,4194304] 0 2023-10-18T20:58:45.296 INFO:tasks.workunit.client.1.smithi060.stdout:4/854: symlink d4/d104/l10c 0 2023-10-18T20:58:45.296 INFO:tasks.workunit.client.1.smithi060.stdout:4/855: chown d4/dc/d2a/d2d/dc7 71252994 1 2023-10-18T20:58:45.296 INFO:tasks.workunit.client.1.smithi060.stdout:4/856: chown d4/dc/d2a/d5b/f88 1937392 1 2023-10-18T20:58:45.296 INFO:tasks.workunit.client.1.smithi060.stdout:5/911: getdents d0 0 2023-10-18T20:58:45.297 INFO:tasks.workunit.client.1.smithi060.stdout:0/894: write d3/d8/d11f/d55/d74/d76/f121 [848648,93873] 0 2023-10-18T20:58:45.297 INFO:tasks.workunit.client.0.smithi008.stdout:5/686: symlink d0/d2/d19/d7c/d31/d82/df5/lf6 0 2023-10-18T20:58:45.297 INFO:tasks.workunit.client.0.smithi008.stdout:5/687: read - d0/d2/d9/d9b/dba/fd2 zero size 2023-10-18T20:58:45.298 INFO:tasks.workunit.client.0.smithi008.stdout:5/688: dread - d0/d2/d19/d7c/d31/d3f/d70/fbe zero size 2023-10-18T20:58:45.299 INFO:tasks.workunit.client.0.smithi008.stdout:0/609: write d0/dd/d19/f6e [2808017,77091] 0 2023-10-18T20:58:45.300 INFO:tasks.workunit.client.1.smithi060.stdout:0/895: chown d3/d8/l29 48579565 1 2023-10-18T20:58:45.302 INFO:tasks.workunit.client.1.smithi060.stdout:4/857: rename d4/dc/d2a/d39/d53/d76/d99/c10b to d4/d91/c10d 0 2023-10-18T20:58:45.303 INFO:tasks.workunit.client.1.smithi060.stdout:5/912: truncate d0/da/dc8/de4/f135 1503028 0 2023-10-18T20:58:45.303 INFO:tasks.workunit.client.1.smithi060.stdout:4/858: write d4/dc/d2a/d5b/fb9 [1148475,60457] 0 2023-10-18T20:58:45.303 INFO:tasks.workunit.client.1.smithi060.stdout:4/859: fsync d4/d15/f6e 0 2023-10-18T20:58:45.303 INFO:tasks.workunit.client.1.smithi060.stdout:5/913: write d0/d47/df2/d10e/f119 [1296,83148] 0 2023-10-18T20:58:45.304 INFO:tasks.workunit.client.0.smithi008.stdout:0/610: read d0/d7c/d9a/d8a/d8f/f77 [575818,25047] 0 2023-10-18T20:58:45.306 INFO:tasks.workunit.client.1.smithi060.stdout:0/896: unlink d3/d8/d11f/dec/l116 0 2023-10-18T20:58:45.306 INFO:tasks.workunit.client.1.smithi060.stdout:0/897: dread - d3/d8/d11f/d55/d74/d76/d6b/f120 zero size 2023-10-18T20:58:45.307 INFO:tasks.workunit.client.1.smithi060.stdout:4/860: creat d4/d15/d2b/f10e x:0 0 0 2023-10-18T20:58:45.318 INFO:tasks.workunit.client.1.smithi060.stdout:4/861: dread d4/dc/d2a/d13/d27/d68/dc8/de8/f106 [0,4194304] 0 2023-10-18T20:58:45.320 INFO:tasks.workunit.client.0.smithi008.stdout:3/784: getdents d0/d3/d37/d6f 0 2023-10-18T20:58:45.320 INFO:tasks.workunit.client.1.smithi060.stdout:4/862: stat d4/dc/d2a/d31/le4 0 2023-10-18T20:58:45.321 INFO:tasks.workunit.client.0.smithi008.stdout:3/785: write d0/d3/de/fe4 [923448,96022] 0 2023-10-18T20:58:45.321 INFO:tasks.workunit.client.0.smithi008.stdout:2/717: dread d1/d3/dd/d25/d76/d59/fdb [0,4194304] 0 2023-10-18T20:58:45.321 INFO:tasks.workunit.client.0.smithi008.stdout:2/718: creat d1/d3/dd/d25/d76/d59/d85/db9/fec x:0 0 0 2023-10-18T20:58:45.323 INFO:tasks.workunit.client.1.smithi060.stdout:4/863: unlink d4/dc/d2a/d83/db1/cd7 0 2023-10-18T20:58:45.323 INFO:tasks.workunit.client.1.smithi060.stdout:4/864: write d4/dc/d2a/d5b/ff2 [381231,12271] 0 2023-10-18T20:58:45.326 INFO:tasks.workunit.client.0.smithi008.stdout:0/611: unlink d0/d7c/d9a/d8a/d8f/l36 0 2023-10-18T20:58:45.327 INFO:tasks.workunit.client.0.smithi008.stdout:0/612: fsync d0/dd/d19/d5f/d99/f80 0 2023-10-18T20:58:45.328 INFO:tasks.workunit.client.0.smithi008.stdout:7/717: sync 2023-10-18T20:58:45.329 INFO:tasks.workunit.client.0.smithi008.stdout:6/780: sync 2023-10-18T20:58:45.329 INFO:tasks.workunit.client.1.smithi060.stdout:4/865: creat d4/dc/d2a/d2d/d69/f10f x:0 0 0 2023-10-18T20:58:45.330 INFO:tasks.workunit.client.1.smithi060.stdout:4/866: fsync d4/dc/d2a/d39/d53/d76/d99/fbb 0 2023-10-18T20:58:45.330 INFO:tasks.workunit.client.1.smithi060.stdout:4/867: chown d4/dc/d2a/d13/d27/d68 97 1 2023-10-18T20:58:45.330 INFO:tasks.workunit.client.1.smithi060.stdout:0/898: write d3/f60 [1179111,85267] 0 2023-10-18T20:58:45.330 INFO:tasks.workunit.client.1.smithi060.stdout:0/899: chown d3/d32/d86 17 1 2023-10-18T20:58:45.330 INFO:tasks.workunit.client.1.smithi060.stdout:0/900: read d3/f48 [1861448,1129] 0 2023-10-18T20:58:45.331 INFO:tasks.workunit.client.1.smithi060.stdout:0/901: readlink d3/d8/d11f/d55/d74/d76/d68/l7a 0 2023-10-18T20:58:45.333 INFO:tasks.workunit.client.1.smithi060.stdout:0/902: mkdir d3/d8/d11f/d55/d124 0 2023-10-18T20:58:45.334 INFO:tasks.workunit.client.0.smithi008.stdout:2/719: link d1/d3/dd/d1c/d3a/d45/fda d1/d3/dd/d1c/d3a/d45/daa/fed 0 2023-10-18T20:58:45.334 INFO:tasks.workunit.client.0.smithi008.stdout:1/753: sync 2023-10-18T20:58:45.336 INFO:tasks.workunit.client.0.smithi008.stdout:9/627: sync 2023-10-18T20:58:45.336 INFO:tasks.workunit.client.0.smithi008.stdout:9/628: dread - d2/dc/d40/d6f/d92/d59/f65 zero size 2023-10-18T20:58:45.337 INFO:tasks.workunit.client.0.smithi008.stdout:5/689: write d0/de/f6c [2457804,93865] 0 2023-10-18T20:58:45.337 INFO:tasks.workunit.client.0.smithi008.stdout:5/690: dread - d0/d2/d19/d7c/d31/d82/fe3 zero size 2023-10-18T20:58:45.337 INFO:tasks.workunit.client.0.smithi008.stdout:0/613: unlink d0/dd/d19/f3c 0 2023-10-18T20:58:45.338 INFO:tasks.workunit.client.1.smithi060.stdout:4/868: rmdir d4/d15/d2b/d9f 39 2023-10-18T20:58:45.338 INFO:tasks.workunit.client.1.smithi060.stdout:0/903: symlink d3/d8/d3c/d87/dba/l125 0 2023-10-18T20:58:45.340 INFO:tasks.workunit.client.0.smithi008.stdout:7/718: creat d1/d36/d3d/d3e/d59/d73/d7b/daf/fe0 x:0 0 0 2023-10-18T20:58:45.342 INFO:tasks.workunit.client.0.smithi008.stdout:2/720: rename d1/d3/dd/d1c/d3a/d57/fea to d1/fee 0 2023-10-18T20:58:45.342 INFO:tasks.workunit.client.0.smithi008.stdout:2/721: creat d1/d3/d40/de0/fef x:0 0 0 2023-10-18T20:58:45.343 INFO:tasks.workunit.client.1.smithi060.stdout:0/904: rename d3/d8/c45 to d3/d8/d3c/d87/c126 0 2023-10-18T20:58:45.343 INFO:tasks.workunit.client.1.smithi060.stdout:0/905: fdatasync d3/f26 0 2023-10-18T20:58:45.344 INFO:tasks.workunit.client.0.smithi008.stdout:4/625: dwrite d0/d3/f41 [8388608,4194304] 0 2023-10-18T20:58:45.344 INFO:tasks.workunit.client.0.smithi008.stdout:4/626: write d0/d3/d21/d57/d8f/d95/fd1 [659898,123199] 0 2023-10-18T20:58:45.344 INFO:tasks.workunit.client.0.smithi008.stdout:9/629: creat d2/dc/d40/d56/fb8 x:0 0 0 2023-10-18T20:58:45.345 INFO:tasks.workunit.client.0.smithi008.stdout:9/630: creat d2/dc/d40/d6f/d92/d59/fb9 x:0 0 0 2023-10-18T20:58:45.345 INFO:tasks.workunit.client.0.smithi008.stdout:5/691: creat d0/ff7 x:0 0 0 2023-10-18T20:58:45.348 INFO:tasks.workunit.client.0.smithi008.stdout:0/614: dread d0/d7c/f30 [0,4194304] 0 2023-10-18T20:58:45.349 INFO:tasks.workunit.client.0.smithi008.stdout:0/615: fdatasync d0/dd/d19/d5f/d99/f38 0 2023-10-18T20:58:45.350 INFO:tasks.workunit.client.1.smithi060.stdout:0/906: dread d3/d8/d11f/d55/d74/d76/d68/d7f/d8d/fd0 [0,4194304] 0 2023-10-18T20:58:45.351 INFO:tasks.workunit.client.0.smithi008.stdout:7/719: creat d1/d36/d3d/dc3/fe1 x:0 0 0 2023-10-18T20:58:45.352 INFO:tasks.workunit.client.0.smithi008.stdout:7/720: write d1/d3/d20/d5f/d7f/f9a [1419131,102752] 0 2023-10-18T20:58:45.352 INFO:tasks.workunit.client.0.smithi008.stdout:7/721: chown d1/d3/c98 256 1 2023-10-18T20:58:45.352 INFO:tasks.workunit.client.0.smithi008.stdout:1/754: write d9/fcc [3040285,118560] 0 2023-10-18T20:58:45.352 INFO:tasks.workunit.client.0.smithi008.stdout:3/786: write d0/d3/f97 [2482443,63748] 0 2023-10-18T20:58:45.353 INFO:tasks.workunit.client.0.smithi008.stdout:4/627: mkdir d0/d58/d8e/dd2 0 2023-10-18T20:58:45.353 INFO:tasks.workunit.client.0.smithi008.stdout:3/787: dread - d0/d3/de/d13/ff8 zero size 2023-10-18T20:58:45.353 INFO:tasks.workunit.client.0.smithi008.stdout:9/631: mknod d2/dc/d1a/d1d/cba 0 2023-10-18T20:58:45.355 INFO:tasks.workunit.client.0.smithi008.stdout:5/692: truncate d0/d2/d19/d7c/f6b 3581995 0 2023-10-18T20:58:45.356 INFO:tasks.workunit.client.0.smithi008.stdout:5/693: write d0/d2/d19/d7c/d31/d3f/fdf [211078,13903] 0 2023-10-18T20:58:45.356 INFO:tasks.workunit.client.0.smithi008.stdout:5/694: chown d0/de/c5b 64 1 2023-10-18T20:58:45.361 INFO:tasks.workunit.client.0.smithi008.stdout:6/781: dread df/d3c/d77/da9/f5a [0,4194304] 0 2023-10-18T20:58:45.361 INFO:tasks.workunit.client.0.smithi008.stdout:8/871: dwrite d5/d8/df/d9d/d85/db1/fef [0,4194304] 0 2023-10-18T20:58:45.361 INFO:tasks.workunit.client.0.smithi008.stdout:8/872: stat d5/d8/df/d9d/d4d/db5/da3/fca 0 2023-10-18T20:58:45.361 INFO:tasks.workunit.client.0.smithi008.stdout:8/873: write d5/d8/df/dce/dfa/d125/ff7 [1214663,107602] 0 2023-10-18T20:58:45.362 INFO:tasks.workunit.client.0.smithi008.stdout:0/616: creat d0/dd/d19/d5f/d99/d5e/d7d/db7/fbe x:0 0 0 2023-10-18T20:58:45.362 INFO:tasks.workunit.client.0.smithi008.stdout:0/617: dread - d0/fa0 zero size 2023-10-18T20:58:45.362 INFO:tasks.workunit.client.0.smithi008.stdout:7/722: mknod d1/d36/d3d/dc3/ce2 0 2023-10-18T20:58:45.363 INFO:tasks.workunit.client.0.smithi008.stdout:1/755: rename d9/de/df/d17/d1e/d7d/fab to d9/de/df/d17/d1e/d9a/fed 0 2023-10-18T20:58:45.363 INFO:tasks.workunit.client.0.smithi008.stdout:4/628: symlink d0/d17/d5b/d45/ld3 0 2023-10-18T20:58:45.363 INFO:tasks.workunit.client.0.smithi008.stdout:4/629: fsync d0/d58/d8e/f6d 0 2023-10-18T20:58:45.367 INFO:tasks.workunit.client.0.smithi008.stdout:5/695: mknod d0/d2/d19/d7c/d31/d82/cf8 0 2023-10-18T20:58:45.367 INFO:tasks.workunit.client.0.smithi008.stdout:5/696: fsync d0/d2/d9/d9b/d6f/d75/fa6 0 2023-10-18T20:58:45.368 INFO:tasks.workunit.client.0.smithi008.stdout:5/697: fsync d0/d2/d9/d9b/d6f/d75/fa1 0 2023-10-18T20:58:45.368 INFO:tasks.workunit.client.0.smithi008.stdout:5/698: stat d0/d2/d9/d34/f3b 0 2023-10-18T20:58:45.368 INFO:tasks.workunit.client.0.smithi008.stdout:5/699: chown d0/d2/d9/d9b/d62/cea 181073 1 2023-10-18T20:58:45.373 INFO:tasks.workunit.client.0.smithi008.stdout:0/618: link d0/c47 d0/dd/d19/d24/cbf 0 2023-10-18T20:58:45.373 INFO:tasks.workunit.client.0.smithi008.stdout:4/630: creat d0/d17/d6e/fd4 x:0 0 0 2023-10-18T20:58:45.373 INFO:tasks.workunit.client.0.smithi008.stdout:4/631: chown d0/d76/lba 3 1 2023-10-18T20:58:45.373 INFO:tasks.workunit.client.0.smithi008.stdout:4/632: write d0/d17/f6c [2021569,91320] 0 2023-10-18T20:58:45.374 INFO:tasks.workunit.client.0.smithi008.stdout:4/633: chown d0/d17/f98 1961 1 2023-10-18T20:58:45.374 INFO:tasks.workunit.client.0.smithi008.stdout:4/634: read d0/d58/d83/f89 [313903,70097] 0 2023-10-18T20:58:45.374 INFO:tasks.workunit.client.0.smithi008.stdout:3/788: rename d0/d3/de/le6 to d0/d4a/d64/lfd 0 2023-10-18T20:58:45.375 INFO:tasks.workunit.client.0.smithi008.stdout:9/632: dread d2/dc/d1a/d1d/f82 [0,4194304] 0 2023-10-18T20:58:45.375 INFO:tasks.workunit.client.0.smithi008.stdout:3/789: truncate d0/f59 3263664 0 2023-10-18T20:58:45.375 INFO:tasks.workunit.client.0.smithi008.stdout:6/782: dread df/d15/d48/ded/d108/dcf/d7e/fac [0,4194304] 0 2023-10-18T20:58:45.376 INFO:tasks.workunit.client.0.smithi008.stdout:9/633: symlink d2/d8/da0/lbb 0 2023-10-18T20:58:45.376 INFO:tasks.workunit.client.0.smithi008.stdout:4/635: link d0/d58/d8e/db4/fc4 d0/d17/d5b/fd5 0 2023-10-18T20:58:45.376 INFO:tasks.workunit.client.0.smithi008.stdout:4/636: read d0/d58/d8e/f6d [2085173,34654] 0 2023-10-18T20:58:45.377 INFO:tasks.workunit.client.0.smithi008.stdout:9/634: write d2/dc/f1c [855092,97671] 0 2023-10-18T20:58:45.377 INFO:tasks.workunit.client.0.smithi008.stdout:9/635: dread - d2/dc/d40/d6f/d92/d59/f65 zero size 2023-10-18T20:58:45.377 INFO:tasks.workunit.client.0.smithi008.stdout:9/636: stat d2/dc/d17/d19/d4a/db2 0 2023-10-18T20:58:45.377 INFO:tasks.workunit.client.0.smithi008.stdout:9/637: truncate d2/dc/d17/d19/d4a/fab 845106 0 2023-10-18T20:58:45.377 INFO:tasks.workunit.client.0.smithi008.stdout:9/638: mkdir d2/dc/d40/dbc 0 2023-10-18T20:58:45.378 INFO:tasks.workunit.client.0.smithi008.stdout:9/639: truncate d2/dc/d1a/d1d/f63 234688 0 2023-10-18T20:58:45.378 INFO:tasks.workunit.client.0.smithi008.stdout:9/640: fsync d2/dc/f22 0 2023-10-18T20:58:45.379 INFO:tasks.workunit.client.1.smithi060.stdout:5/914: dwrite d0/d6/d9/d82/d84/db2/db8/f12c [0,4194304] 0 2023-10-18T20:58:45.383 INFO:tasks.workunit.client.1.smithi060.stdout:5/915: mknod d0/d6/d9/d82/c141 0 2023-10-18T20:58:45.389 INFO:tasks.workunit.client.1.smithi060.stdout:5/916: rename d0/dd/fcf to d0/d6/d9/d82/d84/db2/d2a/f142 0 2023-10-18T20:58:45.395 INFO:tasks.workunit.client.1.smithi060.stdout:0/907: dread d3/d8/d11f/f2c [0,4194304] 0 2023-10-18T20:58:45.398 INFO:tasks.workunit.client.1.smithi060.stdout:0/908: creat d3/d8/d11f/d55/f127 x:0 0 0 2023-10-18T20:58:45.398 INFO:tasks.workunit.client.1.smithi060.stdout:0/909: dread - d3/d80/db5/f11e zero size 2023-10-18T20:58:45.399 INFO:tasks.workunit.client.1.smithi060.stdout:0/910: chown d3/d8/d3c 7116160 1 2023-10-18T20:58:45.399 INFO:tasks.workunit.client.1.smithi060.stdout:0/911: stat d3/de5/d107 0 2023-10-18T20:58:45.399 INFO:tasks.workunit.client.1.smithi060.stdout:0/912: stat d3/f41 0 2023-10-18T20:58:45.399 INFO:tasks.workunit.client.1.smithi060.stdout:0/913: chown d3/d8/d11f/d55/d74/d76/d6b/f79 7416 1 2023-10-18T20:58:45.400 INFO:tasks.workunit.client.1.smithi060.stdout:0/914: truncate d3/d8/d11f/ff8 141867 0 2023-10-18T20:58:45.400 INFO:tasks.workunit.client.0.smithi008.stdout:4/637: fsync d0/d17/d5b/fd5 0 2023-10-18T20:58:45.407 INFO:tasks.workunit.client.1.smithi060.stdout:4/869: dwrite d4/dc/d2a/d39/d53/fb5 [0,4194304] 0 2023-10-18T20:58:45.418 INFO:tasks.workunit.client.0.smithi008.stdout:8/874: rename d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/db4/db7 to d5/d8/df/d2e/d13b 0 2023-10-18T20:58:45.420 INFO:tasks.workunit.client.1.smithi060.stdout:4/870: dread d4/dc/d2a/d2d/d69/d89/fdd [0,4194304] 0 2023-10-18T20:58:45.420 INFO:tasks.workunit.client.0.smithi008.stdout:6/783: rename df/l2a to df/d19/l10b 0 2023-10-18T20:58:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:44.068033+0000 mon.smithi008 (mon.0) 663 : cluster [DBG] mgrmap e28: smithi008.flmjzp(active, since 14s), standbys: smithi060.pgqqwa 2023-10-18T20:58:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:44.120690+0000 mgr.smithi008.flmjzp (mgr.14640) 16 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 2.9 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 129 MiB/s rd, 158 MiB/s wr, 237 op/s 2023-10-18T20:58:45.425 INFO:tasks.workunit.client.0.smithi008.stdout:4/638: rename d0/d58/d83/fa8 to d0/d3/d21/d57/fd6 0 2023-10-18T20:58:45.425 INFO:tasks.workunit.client.0.smithi008.stdout:6/784: rmdir df/d15/d48/ded/d108/dcf/d58/dec/d53/d64 39 2023-10-18T20:58:45.426 INFO:tasks.workunit.client.1.smithi060.stdout:4/871: unlink d4/d15/f8e 0 2023-10-18T20:58:45.427 INFO:tasks.workunit.client.0.smithi008.stdout:6/785: mkdir df/d15/d10c 0 2023-10-18T20:58:45.428 INFO:tasks.workunit.client.1.smithi060.stdout:4/872: mkdir d4/dc/d2a/d2d/d69/d89/d110 0 2023-10-18T20:58:45.428 INFO:tasks.workunit.client.0.smithi008.stdout:6/786: mkdir df/d15/d48/ded/d108/dcf/d58/dec/d10d 0 2023-10-18T20:58:45.428 INFO:tasks.workunit.client.0.smithi008.stdout:6/787: truncate df/f24 1322684 0 2023-10-18T20:58:45.429 INFO:tasks.workunit.client.0.smithi008.stdout:4/639: rmdir d0 39 2023-10-18T20:58:45.430 INFO:tasks.workunit.client.1.smithi060.stdout:4/873: stat d4/dc/ca4 0 2023-10-18T20:58:45.430 INFO:tasks.workunit.client.1.smithi060.stdout:4/874: chown d4/dc/d2a/d31/f97 114 1 2023-10-18T20:58:45.445 INFO:tasks.workunit.client.1.smithi060.stdout:9/799: sync 2023-10-18T20:58:45.446 INFO:tasks.workunit.client.0.smithi008.stdout:0/619: dwrite d0/dd/fbd [0,4194304] 0 2023-10-18T20:58:45.446 INFO:tasks.workunit.client.0.smithi008.stdout:0/620: read d0/f51 [386999,34649] 0 2023-10-18T20:58:45.457 INFO:tasks.workunit.client.1.smithi060.stdout:9/800: mkdir d3/d99/d1c/d116/d80/d127 0 2023-10-18T20:58:45.457 INFO:tasks.workunit.client.1.smithi060.stdout:9/801: fdatasync d3/d99/d1c/d5a/d5d/d56/fb4 0 2023-10-18T20:58:45.457 INFO:tasks.workunit.client.0.smithi008.stdout:9/641: dread d2/d4d/f7d [0,4194304] 0 2023-10-18T20:58:45.458 INFO:tasks.workunit.client.0.smithi008.stdout:3/790: dwrite d0/d3/d42/fb0 [0,4194304] 0 2023-10-18T20:58:45.458 INFO:tasks.workunit.client.0.smithi008.stdout:3/791: truncate d0/f59 3581886 0 2023-10-18T20:58:45.459 INFO:tasks.workunit.client.0.smithi008.stdout:4/640: write d0/d17/d5b/f68 [8586637,104030] 0 2023-10-18T20:58:45.462 INFO:tasks.workunit.client.1.smithi060.stdout:9/802: symlink d3/d99/d1c/d5a/l128 0 2023-10-18T20:58:45.462 INFO:tasks.workunit.client.1.smithi060.stdout:9/803: write d3/d99/d1c/d116/d80/da0/dc2/d9e/dfd/f102 [1004668,81899] 0 2023-10-18T20:58:45.463 INFO:tasks.workunit.client.0.smithi008.stdout:4/641: write d0/d3/d21/d57/d8f/d73/fb0 [679321,10042] 0 2023-10-18T20:58:45.464 INFO:tasks.workunit.client.0.smithi008.stdout:4/642: rename d0/d3/d21/d57/d8f/d95 to d0/d3/d21/d57/d8f/d95/dd7 22 2023-10-18T20:58:45.464 INFO:tasks.workunit.client.0.smithi008.stdout:4/643: stat d0/d3/l28 0 2023-10-18T20:58:45.464 INFO:tasks.workunit.client.0.smithi008.stdout:4/644: readlink d0/l1d 0 2023-10-18T20:58:45.464 INFO:tasks.workunit.client.0.smithi008.stdout:1/756: dwrite d9/de/df/fbb [0,4194304] 0 2023-10-18T20:58:45.465 INFO:tasks.workunit.client.0.smithi008.stdout:3/792: symlink d0/d3/d37/da6/lfe 0 2023-10-18T20:58:45.466 INFO:tasks.workunit.client.1.smithi060.stdout:9/804: mknod d3/d99/d19/d54/c129 0 2023-10-18T20:58:45.466 INFO:tasks.workunit.client.1.smithi060.stdout:9/805: write d3/d99/d19/d54/d11d/f124 [943221,41733] 0 2023-10-18T20:58:45.466 INFO:tasks.workunit.client.1.smithi060.stdout:9/806: chown d3/d99/d1c 830 1 2023-10-18T20:58:45.466 INFO:tasks.workunit.client.1.smithi060.stdout:9/807: write d3/d99/d1c/f1d [4417319,24039] 0 2023-10-18T20:58:45.468 INFO:tasks.workunit.client.0.smithi008.stdout:1/757: creat d9/de/df/d17/d1e/d3c/d90/d95/fee x:0 0 0 2023-10-18T20:58:45.468 INFO:tasks.workunit.client.0.smithi008.stdout:1/758: write d9/de/df/d17/d1e/d9a/fbf [106973,22107] 0 2023-10-18T20:58:45.470 INFO:tasks.workunit.client.0.smithi008.stdout:3/793: getdents d0/d3/de/d13/d35/dbf 0 2023-10-18T20:58:45.471 INFO:tasks.workunit.client.1.smithi060.stdout:9/808: creat d3/d99/d1c/d25/f12a x:0 0 0 2023-10-18T20:58:45.476 INFO:tasks.workunit.client.1.smithi060.stdout:9/809: mknod d3/d99/d19/d54/d8f/c12b 0 2023-10-18T20:58:45.476 INFO:tasks.workunit.client.1.smithi060.stdout:9/810: readlink d3/l12 0 2023-10-18T20:58:45.476 INFO:tasks.workunit.client.1.smithi060.stdout:9/811: write d3/d99/d1c/d25/f4b [4802244,11508] 0 2023-10-18T20:58:45.477 INFO:tasks.workunit.client.1.smithi060.stdout:9/812: chown d3/d99/d65/lae 367 1 2023-10-18T20:58:45.477 INFO:tasks.workunit.client.1.smithi060.stdout:9/813: stat d3/d99/d19/d54/d8f/cca 0 2023-10-18T20:58:45.479 INFO:tasks.workunit.client.0.smithi008.stdout:0/621: dread d0/dd/d19/d5f/d99/f2d [0,4194304] 0 2023-10-18T20:58:45.482 INFO:tasks.workunit.client.0.smithi008.stdout:0/622: mknod d0/dd/d19/d5f/d99/d94/cc0 0 2023-10-18T20:58:45.482 INFO:tasks.workunit.client.0.smithi008.stdout:0/623: truncate d0/d3a/f84 4506643 0 2023-10-18T20:58:45.483 INFO:tasks.workunit.client.0.smithi008.stdout:7/723: dwrite d1/d3/f65 [0,4194304] 0 2023-10-18T20:58:45.488 INFO:tasks.workunit.client.0.smithi008.stdout:6/788: dwrite df/d15/d48/ded/d108/dcf/d68/f6e [0,4194304] 0 2023-10-18T20:58:45.495 INFO:tasks.workunit.client.0.smithi008.stdout:6/789: rename df/d36/l100 to df/d15/d48/ded/d108/dcf/d3f/l10e 0 2023-10-18T20:58:45.495 INFO:tasks.workunit.client.0.smithi008.stdout:6/790: readlink df/l11 0 2023-10-18T20:58:45.503 INFO:tasks.workunit.client.1.smithi060.stdout:4/875: dwrite d4/dc/d2a/d13/d27/d68/dc8/fcb [0,4194304] 0 2023-10-18T20:58:45.503 INFO:tasks.workunit.client.1.smithi060.stdout:4/876: write d4/dc/d2a/d2d/f109 [530875,106110] 0 2023-10-18T20:58:45.514 INFO:tasks.workunit.client.1.smithi060.stdout:4/877: rename d4/dc/cc2 to d4/dc/de2/c111 0 2023-10-18T20:58:45.517 INFO:tasks.workunit.client.1.smithi060.stdout:4/878: symlink d4/dc/d2a/d39/d53/d5f/l112 0 2023-10-18T20:58:45.517 INFO:tasks.workunit.client.1.smithi060.stdout:4/879: rename d4/dc/d2a to d4/dc/d2a/d5b/d113 22 2023-10-18T20:58:45.525 INFO:tasks.workunit.client.0.smithi008.stdout:3/794: dread d0/d4a/d64/f7c [0,4194304] 0 2023-10-18T20:58:45.525 INFO:tasks.workunit.client.0.smithi008.stdout:3/795: unlink d0/d3/d37/da6/lfe 0 2023-10-18T20:58:45.531 INFO:tasks.workunit.client.0.smithi008.stdout:6/791: write df/d3c/d77/da9/f9c [2225621,115359] 0 2023-10-18T20:58:45.531 INFO:tasks.workunit.client.0.smithi008.stdout:6/792: fsync df/d15/d48/ded/d108/dcf/d58/dec/daa/fd9 0 2023-10-18T20:58:45.531 INFO:tasks.workunit.client.0.smithi008.stdout:6/793: chown df/d15/cfd 9854 1 2023-10-18T20:58:45.538 INFO:tasks.workunit.client.0.smithi008.stdout:6/794: dread df/d15/d48/ded/d108/dcf/d7e/fac [0,4194304] 0 2023-10-18T20:58:45.538 INFO:tasks.workunit.client.0.smithi008.stdout:6/795: truncate df/d15/d27/ffb 142020 0 2023-10-18T20:58:45.543 INFO:tasks.workunit.client.0.smithi008.stdout:3/796: mknod d0/d84/dad/dc4/cff 0 2023-10-18T20:58:45.543 INFO:tasks.workunit.client.0.smithi008.stdout:3/797: dread - d0/d4a/d64/d80/faa zero size 2023-10-18T20:58:45.545 INFO:tasks.workunit.client.1.smithi060.stdout:9/814: dwrite d3/d99/d19/f4e [0,4194304] 0 2023-10-18T20:58:45.546 INFO:tasks.workunit.client.0.smithi008.stdout:3/798: link d0/d84/dad/dbb/cee d0/d3/d42/d52/df7/c100 0 2023-10-18T20:58:45.546 INFO:tasks.workunit.client.0.smithi008.stdout:6/796: dread df/d3c/d77/f99 [0,4194304] 0 2023-10-18T20:58:45.547 INFO:tasks.workunit.client.1.smithi060.stdout:9/815: rmdir d3/d99/d1c/d116/d80/da0/ddd/d118 0 2023-10-18T20:58:45.547 INFO:tasks.workunit.client.0.smithi008.stdout:4/645: dwrite d0/d3/d21/d57/fd6 [4194304,4194304] 0 2023-10-18T20:58:45.548 INFO:tasks.workunit.client.0.smithi008.stdout:3/799: symlink d0/d84/dad/dbb/l101 0 2023-10-18T20:58:45.549 INFO:tasks.workunit.client.0.smithi008.stdout:3/800: truncate d0/d3/d42/fb0 1569189 0 2023-10-18T20:58:45.551 INFO:tasks.workunit.client.0.smithi008.stdout:7/724: dwrite d1/d3/f56 [0,4194304] 0 2023-10-18T20:58:45.551 INFO:tasks.workunit.client.0.smithi008.stdout:7/725: fdatasync d1/d36/f4c 0 2023-10-18T20:58:45.554 INFO:tasks.workunit.client.0.smithi008.stdout:1/759: dwrite d9/de/df/d17/d55/f78 [0,4194304] 0 2023-10-18T20:58:45.560 INFO:tasks.workunit.client.0.smithi008.stdout:3/801: mknod d0/d3/d42/d88/dae/c102 0 2023-10-18T20:58:45.560 INFO:tasks.workunit.client.0.smithi008.stdout:3/802: readlink d0/d3/de/d13/d35/d51/l63 0 2023-10-18T20:58:45.560 INFO:tasks.workunit.client.0.smithi008.stdout:0/624: read d0/dd/d19/d24/f66 [2088588,2167] 0 2023-10-18T20:58:45.564 INFO:tasks.workunit.client.0.smithi008.stdout:9/642: dwrite d2/dc/d40/d6f/d92/d59/f5d [0,4194304] 0 2023-10-18T20:58:45.564 INFO:tasks.workunit.client.0.smithi008.stdout:9/643: readlink d2/dc/d40/d6f/d92/d59/l72 0 2023-10-18T20:58:45.564 INFO:tasks.workunit.client.0.smithi008.stdout:9/644: write d2/dc/d1a/d1d/f3c [4637104,25855] 0 2023-10-18T20:58:45.565 INFO:tasks.workunit.client.0.smithi008.stdout:9/645: dread - d2/dc/d40/d6f/d92/f75 zero size 2023-10-18T20:58:45.565 INFO:tasks.workunit.client.0.smithi008.stdout:7/726: read d1/da6/f50 [1137719,89109] 0 2023-10-18T20:58:45.565 INFO:tasks.workunit.client.0.smithi008.stdout:6/797: read df/d15/d27/f4a [4642014,68237] 0 2023-10-18T20:58:45.570 INFO:tasks.workunit.client.0.smithi008.stdout:0/625: getdents d0/dd/d19/d24 0 2023-10-18T20:58:45.575 INFO:tasks.workunit.client.0.smithi008.stdout:7/727: mknod d1/d3/d20/d5f/d78/ce3 0 2023-10-18T20:58:45.575 INFO:tasks.workunit.client.0.smithi008.stdout:7/728: stat d1/d3/d20/c8c 0 2023-10-18T20:58:45.575 INFO:tasks.workunit.client.0.smithi008.stdout:7/729: getdents d1/d3/d20/d5f/d78/da2 0 2023-10-18T20:58:45.576 INFO:tasks.workunit.client.0.smithi008.stdout:7/730: read d1/f1b [190961,121247] 0 2023-10-18T20:58:45.582 INFO:tasks.workunit.client.1.smithi060.stdout:4/880: dwrite d4/dc/d2a/d13/f56 [0,4194304] 0 2023-10-18T20:58:45.585 INFO:tasks.workunit.client.0.smithi008.stdout:3/803: write d0/d84/fcd [301503,82500] 0 2023-10-18T20:58:45.589 INFO:tasks.workunit.client.1.smithi060.stdout:4/881: link d4/dc/d2a/d39/d53/d65/d8d/le7 d4/dc/d2a/d1d/l114 0 2023-10-18T20:58:45.591 INFO:tasks.workunit.client.0.smithi008.stdout:4/646: truncate d0/f12 4939320 0 2023-10-18T20:58:45.592 INFO:tasks.workunit.client.1.smithi060.stdout:4/882: mkdir d4/dc/d2a/d5b/d115 0 2023-10-18T20:58:45.593 INFO:tasks.workunit.client.1.smithi060.stdout:4/883: truncate d4/dc/d2a/d39/fdc 908836 0 2023-10-18T20:58:45.593 INFO:tasks.workunit.client.1.smithi060.stdout:4/884: fsync d4/dc/d2a/d39/d53/d76/d99/fb4 0 2023-10-18T20:58:45.594 INFO:tasks.workunit.client.0.smithi008.stdout:5/700: sync 2023-10-18T20:58:45.594 INFO:tasks.workunit.client.0.smithi008.stdout:8/875: sync 2023-10-18T20:58:45.594 INFO:tasks.workunit.client.0.smithi008.stdout:2/722: sync 2023-10-18T20:58:45.594 INFO:tasks.workunit.client.0.smithi008.stdout:5/701: chown d0/d2/d9/d9b/d62/fe4 0 1 2023-10-18T20:58:45.595 INFO:tasks.workunit.client.0.smithi008.stdout:5/702: write d0/d6e/f98 [1755500,20281] 0 2023-10-18T20:58:45.595 INFO:tasks.workunit.client.0.smithi008.stdout:8/876: rename d5/d8/df/d9d/d85/db1/d137/l108 to d5/d8/df/d9d/d4d/db5/l13c 0 2023-10-18T20:58:45.597 INFO:tasks.workunit.client.0.smithi008.stdout:2/723: mknod d1/d3/dd/d1c/d3a/d45/cf0 0 2023-10-18T20:58:45.599 INFO:tasks.workunit.client.1.smithi060.stdout:4/885: mkdir d4/dc/d2a/d13/d27/d68/dc8/de8/d116 0 2023-10-18T20:58:45.601 INFO:tasks.workunit.client.0.smithi008.stdout:8/877: mknod d5/d8/df/d2e/d13b/d117/d122/c13d 0 2023-10-18T20:58:45.601 INFO:tasks.workunit.client.0.smithi008.stdout:8/878: dread - d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec/d8c/dc9/f121 zero size 2023-10-18T20:58:45.602 INFO:tasks.workunit.client.0.smithi008.stdout:3/804: dread d0/d4a/d64/f7c [0,4194304] 0 2023-10-18T20:58:45.602 INFO:tasks.workunit.client.0.smithi008.stdout:3/805: fdatasync d0/f59 0 2023-10-18T20:58:45.603 INFO:tasks.workunit.client.0.smithi008.stdout:3/806: write d0/d3/de/d13/d35/dbf/fea [853677,115142] 0 2023-10-18T20:58:45.607 INFO:tasks.workunit.client.0.smithi008.stdout:8/879: mknod d5/d8/df/d9d/d4d/dba/c13e 0 2023-10-18T20:58:45.607 INFO:tasks.workunit.client.0.smithi008.stdout:8/880: write d5/d8/df/d9d/d4d/dba/dd4/d50/f5e [2193559,118726] 0 2023-10-18T20:58:45.619 INFO:tasks.workunit.client.1.smithi060.stdout:7/956: sync 2023-10-18T20:58:45.619 INFO:tasks.workunit.client.1.smithi060.stdout:7/957: chown de/d14/d3a/d46/c59 1 1 2023-10-18T20:58:45.623 INFO:tasks.workunit.client.1.smithi060.stdout:4/886: dread d4/dc/d2a/f1f [0,4194304] 0 2023-10-18T20:58:45.623 INFO:tasks.workunit.client.1.smithi060.stdout:9/816: dwrite d3/d99/d1c/d116/d80/da0/f123 [0,4194304] 0 2023-10-18T20:58:45.624 INFO:tasks.workunit.client.0.smithi008.stdout:4/647: read d0/d17/d5b/d2a/f93 [3499525,29583] 0 2023-10-18T20:58:45.625 INFO:tasks.workunit.client.0.smithi008.stdout:6/798: dwrite df/d26/fe9 [0,4194304] 0 2023-10-18T20:58:45.625 INFO:tasks.workunit.client.0.smithi008.stdout:9/646: dwrite d2/dc/d1a/f97 [0,4194304] 0 2023-10-18T20:58:45.629 INFO:tasks.workunit.client.0.smithi008.stdout:4/648: read d0/d76/fa1 [14118,58075] 0 2023-10-18T20:58:45.631 INFO:tasks.workunit.client.1.smithi060.stdout:9/817: rename d3/d99/d1c/d116/d80/da0/dc2/de0/f119 to d3/d99/d1c/d116/d80/da0/dc2/d9e/dfd/f12c 0 2023-10-18T20:58:45.632 INFO:tasks.workunit.client.0.smithi008.stdout:4/649: symlink d0/d58/ld8 0 2023-10-18T20:58:45.632 INFO:tasks.workunit.client.0.smithi008.stdout:0/626: dwrite d0/dd/f15 [0,4194304] 0 2023-10-18T20:58:45.633 INFO:tasks.workunit.client.0.smithi008.stdout:4/650: fsync d0/d3/d21/d42/f79 0 2023-10-18T20:58:45.633 INFO:tasks.workunit.client.0.smithi008.stdout:4/651: chown d0/c2 1202242739 1 2023-10-18T20:58:45.633 INFO:tasks.workunit.client.0.smithi008.stdout:4/652: dread - d0/d3/d21/d42/fa0 zero size 2023-10-18T20:58:45.634 INFO:tasks.workunit.client.1.smithi060.stdout:9/818: unlink d3/d99/d1c/d116/d80/cc0 0 2023-10-18T20:58:45.635 INFO:tasks.workunit.client.0.smithi008.stdout:4/653: rmdir d0/d3/d21/d57/d8f 39 2023-10-18T20:58:45.642 INFO:tasks.workunit.client.0.smithi008.stdout:0/627: getdents d0/d3a 0 2023-10-18T20:58:45.647 INFO:tasks.workunit.client.1.smithi060.stdout:4/887: dread d4/dc/d2a/f7 [0,4194304] 0 2023-10-18T20:58:45.656 INFO:tasks.workunit.client.1.smithi060.stdout:4/888: unlink d4/dc/d2a/d13/d33/cbf 0 2023-10-18T20:58:45.656 INFO:tasks.workunit.client.1.smithi060.stdout:4/889: fsync d4/dc/d2a/d2d/f74 0 2023-10-18T20:58:45.664 INFO:tasks.workunit.client.0.smithi008.stdout:4/654: dread d0/d17/d5b/fb [4194304,4194304] 0 2023-10-18T20:58:45.667 INFO:tasks.workunit.client.0.smithi008.stdout:8/881: fsync d5/d8/df/d9d/d4d/dba/dd4/d50/f5e 0 2023-10-18T20:58:45.667 INFO:tasks.workunit.client.0.smithi008.stdout:3/807: dread d0/d3/d37/d74/f89 [0,4194304] 0 2023-10-18T20:58:45.667 INFO:tasks.workunit.client.0.smithi008.stdout:5/703: dwrite d0/d2/f7 [0,4194304] 0 2023-10-18T20:58:45.667 INFO:tasks.workunit.client.0.smithi008.stdout:8/882: dread - d5/d8/df/d9d/d4d/db5/da3/d10a/f128 zero size 2023-10-18T20:58:45.667 INFO:tasks.workunit.client.0.smithi008.stdout:2/724: dwrite d1/d3/dd/f71 [0,4194304] 0 2023-10-18T20:58:45.670 INFO:tasks.workunit.client.0.smithi008.stdout:4/655: creat d0/d3/d21/fd9 x:0 0 0 2023-10-18T20:58:45.673 INFO:tasks.workunit.client.0.smithi008.stdout:5/704: rename d0/d2/d19/d7c/d31/d3f/f5f to d0/d2/d9/ff9 0 2023-10-18T20:58:45.675 INFO:tasks.workunit.client.1.smithi060.stdout:6/887: sync 2023-10-18T20:58:45.676 INFO:tasks.workunit.client.1.smithi060.stdout:8/841: sync 2023-10-18T20:58:45.676 INFO:tasks.workunit.client.1.smithi060.stdout:2/896: sync 2023-10-18T20:58:45.676 INFO:tasks.workunit.client.1.smithi060.stdout:8/842: write d4/d9/d4f/d74/d81/f94 [2685436,117859] 0 2023-10-18T20:58:45.677 INFO:tasks.workunit.client.0.smithi008.stdout:8/883: unlink d5/d8/df/d9d/d85/db1/dcc/d104/lab 0 2023-10-18T20:58:45.677 INFO:tasks.workunit.client.0.smithi008.stdout:4/656: creat d0/d17/d5b/d99/fda x:0 0 0 2023-10-18T20:58:45.680 INFO:tasks.workunit.client.1.smithi060.stdout:2/897: rename d0/d16/d81/da1/fab to d0/d16/d7f/f12c 0 2023-10-18T20:58:45.680 INFO:tasks.workunit.client.1.smithi060.stdout:2/898: truncate d0/d3/d9e/dce/fef 711738 0 2023-10-18T20:58:45.681 INFO:tasks.workunit.client.1.smithi060.stdout:2/899: chown d0/d16/d81/da1/ddd/lea 96737 1 2023-10-18T20:58:45.681 INFO:tasks.workunit.client.1.smithi060.stdout:6/888: creat d10/d2e/d75/dc7/d106/f118 x:0 0 0 2023-10-18T20:58:45.683 INFO:tasks.workunit.client.0.smithi008.stdout:8/884: creat d5/d8/df/dce/dfa/d125/f13f x:0 0 0 2023-10-18T20:58:45.684 INFO:tasks.workunit.client.0.smithi008.stdout:5/705: dread d0/d2/d9/d9b/d6f/d75/fb8 [0,4194304] 0 2023-10-18T20:58:45.684 INFO:tasks.workunit.client.0.smithi008.stdout:5/706: chown d0/d2/d9/d34/f3b 906574148 1 2023-10-18T20:58:45.685 INFO:tasks.workunit.client.0.smithi008.stdout:5/707: readlink d0/de/l9c 0 2023-10-18T20:58:45.685 INFO:tasks.workunit.client.0.smithi008.stdout:6/799: dwrite df/d36/f62 [0,4194304] 0 2023-10-18T20:58:45.686 INFO:tasks.workunit.client.1.smithi060.stdout:6/889: rename d10/d25/l78 to d10/d47/d92/dab/l119 0 2023-10-18T20:58:45.686 INFO:tasks.workunit.client.1.smithi060.stdout:8/843: rmdir d4/d9/d4f/d74/d81 39 2023-10-18T20:58:45.686 INFO:tasks.workunit.client.0.smithi008.stdout:8/885: rename d5/d8/df/f3a to d5/d8/df/d9d/d85/db1/dcc/f140 0 2023-10-18T20:58:45.688 INFO:tasks.workunit.client.0.smithi008.stdout:5/708: mkdir d0/d2/d9/d88/dfa 0 2023-10-18T20:58:45.689 INFO:tasks.workunit.client.1.smithi060.stdout:6/890: creat d10/d2e/d75/d81/d8b/f11a x:0 0 0 2023-10-18T20:58:45.689 INFO:tasks.workunit.client.1.smithi060.stdout:7/958: dwrite de/d14/d49/fb4 [0,4194304] 0 2023-10-18T20:58:45.689 INFO:tasks.workunit.client.1.smithi060.stdout:7/959: truncate de/d14/d2f/dd3/ffe 3515372 0 2023-10-18T20:58:45.690 INFO:tasks.workunit.client.0.smithi008.stdout:6/800: rmdir df/d15/d48/ded/d108/dcf/d58/dd7 39 2023-10-18T20:58:45.693 INFO:tasks.workunit.client.1.smithi060.stdout:7/960: rmdir de/d14/d49/d12a/d10e 0 2023-10-18T20:58:45.697 INFO:tasks.workunit.client.0.smithi008.stdout:9/647: dwrite d2/dc/d17/f2e [0,4194304] 0 2023-10-18T20:58:45.703 INFO:tasks.workunit.client.1.smithi060.stdout:7/961: creat de/d14/d2f/dd3/f13a x:0 0 0 2023-10-18T20:58:45.703 INFO:tasks.workunit.client.1.smithi060.stdout:7/962: getdents de/d29/d72 0 2023-10-18T20:58:45.703 INFO:tasks.workunit.client.1.smithi060.stdout:4/890: dwrite d4/dc/d2a/d13/dbd/fcf [0,4194304] 0 2023-10-18T20:58:45.704 INFO:tasks.workunit.client.0.smithi008.stdout:3/808: dread d0/d3/de/d13/d35/fc9 [0,4194304] 0 2023-10-18T20:58:45.704 INFO:tasks.workunit.client.0.smithi008.stdout:3/809: stat d0/d3/d37/d74/da2/fb7 0 2023-10-18T20:58:45.704 INFO:tasks.workunit.client.0.smithi008.stdout:3/810: getdents d0/d3/d37/d74/da2 0 2023-10-18T20:58:45.705 INFO:tasks.workunit.client.1.smithi060.stdout:9/819: dwrite d3/d99/d1c/d5a/d5d/d56/fd4 [0,4194304] 0 2023-10-18T20:58:45.705 INFO:tasks.workunit.client.1.smithi060.stdout:9/820: write d3/d58/f95 [87556,11525] 0 2023-10-18T20:58:45.705 INFO:tasks.workunit.client.0.smithi008.stdout:3/811: write d0/d3/f5 [1972448,130328] 0 2023-10-18T20:58:45.709 INFO:tasks.workunit.client.0.smithi008.stdout:6/801: read df/f3b [5506731,60799] 0 2023-10-18T20:58:45.709 INFO:tasks.workunit.client.0.smithi008.stdout:6/802: dread - df/d36/f84 zero size 2023-10-18T20:58:45.710 INFO:tasks.workunit.client.1.smithi060.stdout:7/963: mkdir de/d14/d49/d68/d88/d13b 0 2023-10-18T20:58:45.710 INFO:tasks.workunit.client.0.smithi008.stdout:5/709: dread d0/d2/d19/d7c/d58/d65/f99 [0,4194304] 0 2023-10-18T20:58:45.711 INFO:tasks.workunit.client.1.smithi060.stdout:9/821: link d3/d99/c6b d3/d99/d19/d54/d8f/c12d 0 2023-10-18T20:58:45.711 INFO:tasks.workunit.client.1.smithi060.stdout:9/822: fdatasync d3/d99/d1c/d5a/d5d/d56/dd0/f10e 0 2023-10-18T20:58:45.711 INFO:tasks.workunit.client.1.smithi060.stdout:9/823: chown d3/d99/d1c/d116/d80/d122 788 1 2023-10-18T20:58:45.714 INFO:tasks.workunit.client.1.smithi060.stdout:9/824: mkdir d3/d99/d1c/d116/d80/d127/d12e 0 2023-10-18T20:58:45.714 INFO:tasks.workunit.client.1.smithi060.stdout:9/825: creat d3/d99/d1c/d5a/d5d/f12f x:0 0 0 2023-10-18T20:58:45.715 INFO:tasks.workunit.client.1.smithi060.stdout:9/826: write d3/d99/d1c/d5a/d5d/d7d/fad [454273,65704] 0 2023-10-18T20:58:45.715 INFO:tasks.workunit.client.1.smithi060.stdout:9/827: write d3/d99/d1c/d116/d80/da0/dc2/de0/fed [487148,92592] 0 2023-10-18T20:58:45.722 INFO:tasks.workunit.client.1.smithi060.stdout:9/828: creat d3/d99/d1c/d116/d80/da0/dc2/d9e/f130 x:0 0 0 2023-10-18T20:58:45.722 INFO:tasks.workunit.client.0.smithi008.stdout:3/812: dread d0/d3/d42/d88/f91 [0,4194304] 0 2023-10-18T20:58:45.723 INFO:tasks.workunit.client.0.smithi008.stdout:8/886: dread d5/d8/f41 [4194304,4194304] 0 2023-10-18T20:58:45.726 INFO:tasks.workunit.client.0.smithi008.stdout:5/710: truncate d0/d2/d9/d88/fab 319545 0 2023-10-18T20:58:45.727 INFO:tasks.workunit.client.1.smithi060.stdout:9/829: rename d3/d99/d1c/d5a/d5d/d7d to d3/d99/d1c/d116/d80/da0/dc2/d9e/d131 0 2023-10-18T20:58:45.728 INFO:tasks.workunit.client.0.smithi008.stdout:3/813: chown d0/d3/de/d13/c81 385221 1 2023-10-18T20:58:45.728 INFO:tasks.workunit.client.0.smithi008.stdout:8/887: mknod d5/d8/df/d9d/d4d/dba/dd4/d9f/dbb/c141 0 2023-10-18T20:58:45.729 INFO:tasks.workunit.client.0.smithi008.stdout:3/814: getdents d0/d3/de/d13/d35/dbf 0 2023-10-18T20:58:45.730 INFO:tasks.workunit.client.1.smithi060.stdout:9/830: stat d3/d99/d1c/f6a 0 2023-10-18T20:58:45.734 INFO:tasks.workunit.client.0.smithi008.stdout:0/628: dwrite d0/dd/d19/d24/f97 [0,4194304] 0 2023-10-18T20:58:45.737 INFO:tasks.workunit.client.0.smithi008.stdout:6/803: rename df/d15/d48/ded/d108/dcf/d58/dec/d53/d64/l9d to df/d19/l10f 0 2023-10-18T20:58:45.739 INFO:tasks.workunit.client.1.smithi060.stdout:6/891: write d10/d2e/f3a [3982167,4013] 0 2023-10-18T20:58:45.739 INFO:tasks.workunit.client.1.smithi060.stdout:6/892: fsync d10/d6f/faf 0 2023-10-18T20:58:45.739 INFO:tasks.workunit.client.1.smithi060.stdout:2/900: dwrite d0/d3/d27/d108/de1/ffc [0,4194304] 0 2023-10-18T20:58:45.740 INFO:tasks.workunit.client.0.smithi008.stdout:1/760: sync 2023-10-18T20:58:45.742 INFO:tasks.workunit.client.0.smithi008.stdout:5/711: mkdir d0/d2/d9/d34/dfb 0 2023-10-18T20:58:45.751 INFO:tasks.workunit.client.1.smithi060.stdout:2/901: dread d0/d16/d7f/fd8 [0,4194304] 0 2023-10-18T20:58:45.752 INFO:tasks.workunit.client.1.smithi060.stdout:8/844: dwrite d4/d9/fb1 [0,4194304] 0 2023-10-18T20:58:45.753 INFO:tasks.workunit.client.0.smithi008.stdout:6/804: rename df/d15/d48/ded/d108/dcf/d68/cf9 to df/d3c/c110 0 2023-10-18T20:58:45.754 INFO:tasks.workunit.client.1.smithi060.stdout:2/902: truncate d0/d3/d27/d4d/d53/fe9 3147300 0 2023-10-18T20:58:45.754 INFO:tasks.workunit.client.1.smithi060.stdout:2/903: creat d0/d45/dc9/da8/f12d x:0 0 0 2023-10-18T20:58:45.755 INFO:tasks.workunit.client.0.smithi008.stdout:1/761: truncate d9/de/df/d17/d1e/d7d/d89/f8e 1262968 0 2023-10-18T20:58:45.759 INFO:tasks.workunit.client.0.smithi008.stdout:3/815: dread d0/d3/d42/f99 [0,4194304] 0 2023-10-18T20:58:45.760 INFO:tasks.workunit.client.0.smithi008.stdout:2/725: dwrite d1/d3/fd3 [0,4194304] 0 2023-10-18T20:58:45.760 INFO:tasks.workunit.client.0.smithi008.stdout:2/726: stat d1/d3/dd/l21 0 2023-10-18T20:58:45.761 INFO:tasks.workunit.client.0.smithi008.stdout:5/712: creat d0/d2/d9/d34/dfb/ffc x:0 0 0 2023-10-18T20:58:45.761 INFO:tasks.workunit.client.0.smithi008.stdout:6/805: creat df/d15/d48/ded/f111 x:0 0 0 2023-10-18T20:58:45.761 INFO:tasks.workunit.client.0.smithi008.stdout:6/806: write df/d19/f4d [2650271,75320] 0 2023-10-18T20:58:45.762 INFO:tasks.workunit.client.1.smithi060.stdout:8/845: symlink d4/d9/d31/d6f/dfa/de3/l105 0 2023-10-18T20:58:45.762 INFO:tasks.workunit.client.1.smithi060.stdout:8/846: fdatasync d4/d9/d31/d35/d9f/f9c 0 2023-10-18T20:58:45.763 INFO:tasks.workunit.client.1.smithi060.stdout:8/847: chown d4/d9/c26 312673868 1 2023-10-18T20:58:45.763 INFO:tasks.workunit.client.1.smithi060.stdout:8/848: truncate d4/d9/d31/d35/d9f/da3/dd8/ff7 69299 0 2023-10-18T20:58:45.766 INFO:tasks.workunit.client.0.smithi008.stdout:1/762: creat d9/de/df/d17/d1e/dc0/fef x:0 0 0 2023-10-18T20:58:45.770 INFO:tasks.workunit.client.1.smithi060.stdout:2/904: rename d0/d3/d27/d4d/d5e/c127 to d0/d3/d27/c12e 0 2023-10-18T20:58:45.770 INFO:tasks.workunit.client.1.smithi060.stdout:2/905: truncate d0/d16/d7f/fd8 1188512 0 2023-10-18T20:58:45.772 INFO:tasks.workunit.client.1.smithi060.stdout:8/849: link d4/d9/d88/cc5 d4/d9/d31/d6f/dbd/c106 0 2023-10-18T20:58:45.773 INFO:tasks.workunit.client.0.smithi008.stdout:2/727: symlink d1/d3/dd/d1c/lf1 0 2023-10-18T20:58:45.777 INFO:tasks.workunit.client.1.smithi060.stdout:2/906: rename d0/d3/d27/d108/de1 to d0/d45/d49/d6e/d79/d12f 0 2023-10-18T20:58:45.777 INFO:tasks.workunit.client.1.smithi060.stdout:2/907: truncate d0/d3/d9e/dc2/fd2 416341 0 2023-10-18T20:58:45.777 INFO:tasks.workunit.client.0.smithi008.stdout:3/816: dread d0/d3/d42/fb0 [0,4194304] 0 2023-10-18T20:58:45.778 INFO:tasks.workunit.client.1.smithi060.stdout:8/850: chown d4/caf 11082 1 2023-10-18T20:58:45.778 INFO:tasks.workunit.client.1.smithi060.stdout:6/893: write d10/d2e/f73 [1872230,119632] 0 2023-10-18T20:58:45.782 INFO:tasks.workunit.client.1.smithi060.stdout:2/908: mkdir d0/d16/d85/d130 0 2023-10-18T20:58:45.783 INFO:tasks.workunit.client.1.smithi060.stdout:2/909: write d0/d45/dc9/d102/f124 [4647565,28976] 0 2023-10-18T20:58:45.783 INFO:tasks.workunit.client.0.smithi008.stdout:5/713: rename d0/d2/d9/d9b/d62/fcc to d0/d2/d9/daa/ffd 0 2023-10-18T20:58:45.784 INFO:tasks.workunit.client.0.smithi008.stdout:7/731: sync 2023-10-18T20:58:45.795 INFO:tasks.workunit.client.1.smithi060.stdout:6/894: mkdir d10/d17/d28/d11b 0 2023-10-18T20:58:45.795 INFO:tasks.workunit.client.1.smithi060.stdout:2/910: link d0/d3/c2e d0/d3/d9e/dc2/c131 0 2023-10-18T20:58:45.795 INFO:tasks.workunit.client.1.smithi060.stdout:3/850: sync 2023-10-18T20:58:45.795 INFO:tasks.workunit.client.1.smithi060.stdout:0/915: sync 2023-10-18T20:58:45.795 INFO:tasks.workunit.client.1.smithi060.stdout:5/917: sync 2023-10-18T20:58:45.796 INFO:tasks.workunit.client.1.smithi060.stdout:3/851: write d0/d22/d50/fda [906533,54360] 0 2023-10-18T20:58:45.798 INFO:tasks.workunit.client.1.smithi060.stdout:6/895: rename d10/d2e/d75/d81/d8b/dc9/l114 to d10/d17/d54/dd4/l11c 0 2023-10-18T20:58:45.798 INFO:tasks.workunit.client.1.smithi060.stdout:3/852: mknod d0/d22/d26/dfb/c128 0 2023-10-18T20:58:45.798 INFO:tasks.workunit.client.1.smithi060.stdout:3/853: dread - d0/d3c/d3d/d4d/f120 zero size 2023-10-18T20:58:45.798 INFO:tasks.workunit.client.1.smithi060.stdout:6/896: creat d10/d2e/d75/dc7/f11d x:0 0 0 2023-10-18T20:58:45.799 INFO:tasks.workunit.client.1.smithi060.stdout:6/897: readlink d10/d17/d54/db1/dea/dd6/ldc 0 2023-10-18T20:58:45.801 INFO:tasks.workunit.client.1.smithi060.stdout:6/898: mkdir d10/d2e/d11e 0 2023-10-18T20:58:45.808 INFO:tasks.workunit.client.1.smithi060.stdout:5/918: rename d0/d6/d9/d82/d83/d99/cb7 to d0/d47/c143 0 2023-10-18T20:58:45.809 INFO:tasks.workunit.client.1.smithi060.stdout:3/854: rmdir d0/d3c/d3d/d4d/d95/dc9 39 2023-10-18T20:58:45.813 INFO:tasks.workunit.client.1.smithi060.stdout:5/919: symlink d0/dd/dd7/d126/l144 0 2023-10-18T20:58:45.815 INFO:tasks.workunit.client.1.smithi060.stdout:3/855: mkdir d0/d3c/d3d/d82/d129 0 2023-10-18T20:58:45.816 INFO:tasks.workunit.client.1.smithi060.stdout:0/916: dread d3/d8/d11f/f77 [0,4194304] 0 2023-10-18T20:58:45.816 INFO:tasks.workunit.client.1.smithi060.stdout:0/917: write d3/d8/d11f/d55/d74/ffa [608695,83236] 0 2023-10-18T20:58:45.830 INFO:tasks.workunit.client.1.smithi060.stdout:5/920: rename d0/d6/d8/c108 to d0/d47/d7d/da0/c145 0 2023-10-18T20:58:45.831 INFO:tasks.workunit.client.1.smithi060.stdout:3/856: symlink d0/d5e/l12a 0 2023-10-18T20:58:45.831 INFO:tasks.workunit.client.1.smithi060.stdout:5/921: stat d0/da/dc8/de4/d4f/d136/f107 0 2023-10-18T20:58:45.832 INFO:tasks.workunit.client.1.smithi060.stdout:3/857: creat d0/d22/d26/dfb/d11e/f12b x:0 0 0 2023-10-18T20:58:45.834 INFO:tasks.workunit.client.1.smithi060.stdout:3/858: mknod d0/d3c/d3d/d4d/d95/c12c 0 2023-10-18T20:58:45.836 INFO:tasks.workunit.client.1.smithi060.stdout:0/918: dread d3/d8/d11f/d55/d9a/dcf/fdb [0,4194304] 0 2023-10-18T20:58:45.838 INFO:tasks.workunit.client.1.smithi060.stdout:0/919: mkdir d3/d80/db5/d128 0 2023-10-18T20:58:45.867 INFO:tasks.workunit.client.0.smithi008.stdout:4/657: dwrite d0/d58/d8e/f6d [0,4194304] 0 2023-10-18T20:58:45.873 INFO:tasks.workunit.client.1.smithi060.stdout:0/920: dread d3/d8/d11f/d55/d74/d76/f64 [0,4194304] 0 2023-10-18T20:58:45.877 INFO:tasks.workunit.client.1.smithi060.stdout:0/921: symlink d3/l129 0 2023-10-18T20:58:45.882 INFO:tasks.workunit.client.0.smithi008.stdout:4/658: symlink d0/d17/ldb 0 2023-10-18T20:58:45.885 INFO:tasks.workunit.client.1.smithi060.stdout:8/851: dwrite d4/d9/d31/f66 [0,4194304] 0 2023-10-18T20:58:45.887 INFO:tasks.workunit.client.0.smithi008.stdout:4/659: creat d0/d3/d21/d57/d8f/fdc x:0 0 0 2023-10-18T20:58:45.887 INFO:tasks.workunit.client.0.smithi008.stdout:4/660: chown d0/d17/d5b/d45/l56 561 1 2023-10-18T20:58:45.888 INFO:tasks.workunit.client.0.smithi008.stdout:8/888: dwrite d5/d8/df/d2e/d13b/d117/d122/dc4/f109 [0,4194304] 0 2023-10-18T20:58:45.888 INFO:tasks.workunit.client.0.smithi008.stdout:5/714: write d0/d2/d19/d7c/d58/f72 [2576180,107261] 0 2023-10-18T20:58:45.889 INFO:tasks.workunit.client.0.smithi008.stdout:5/715: chown d0/fbc 1123 1 2023-10-18T20:58:45.890 INFO:tasks.workunit.client.0.smithi008.stdout:6/807: dwrite df/d15/f46 [0,4194304] 0 2023-10-18T20:58:45.891 INFO:tasks.workunit.client.1.smithi060.stdout:9/831: dwrite d3/d58/f64 [0,4194304] 0 2023-10-18T20:58:45.895 INFO:tasks.workunit.client.1.smithi060.stdout:5/922: dread d0/f2c [0,4194304] 0 2023-10-18T20:58:45.898 INFO:tasks.workunit.client.0.smithi008.stdout:4/661: symlink d0/d3/ldd 0 2023-10-18T20:58:45.899 INFO:tasks.workunit.client.1.smithi060.stdout:8/852: rename d4/d9/d31/d6f/f75 to d4/d9/d4f/f107 0 2023-10-18T20:58:45.901 INFO:tasks.workunit.client.0.smithi008.stdout:5/716: creat d0/d2/ffe x:0 0 0 2023-10-18T20:58:45.904 INFO:tasks.workunit.client.0.smithi008.stdout:6/808: link df/d15/d27/f63 df/d3c/d77/dd6/dd8/f112 0 2023-10-18T20:58:45.904 INFO:tasks.workunit.client.0.smithi008.stdout:6/809: truncate df/d15/d27/ffb 461444 0 2023-10-18T20:58:45.904 INFO:tasks.workunit.client.0.smithi008.stdout:0/629: dwrite d0/d7c/d9a/d8a/d8f/f62 [0,4194304] 0 2023-10-18T20:58:45.904 INFO:tasks.workunit.client.0.smithi008.stdout:0/630: chown d0/d90 0 1 2023-10-18T20:58:45.905 INFO:tasks.workunit.client.0.smithi008.stdout:0/631: write d0/f2 [847585,11810] 0 2023-10-18T20:58:45.905 INFO:tasks.workunit.client.0.smithi008.stdout:0/632: unlink d0/d7c/d9a/d8a/d8f/l6d 0 2023-10-18T20:58:45.905 INFO:tasks.workunit.client.0.smithi008.stdout:0/633: write d0/dd/d19/d5f/d99/f38 [218705,43095] 0 2023-10-18T20:58:45.905 INFO:tasks.workunit.client.0.smithi008.stdout:0/634: dread - d0/d7c/d9a/d8a/fae zero size 2023-10-18T20:58:45.906 INFO:tasks.workunit.client.1.smithi060.stdout:8/853: creat d4/f108 x:0 0 0 2023-10-18T20:58:45.906 INFO:tasks.workunit.client.1.smithi060.stdout:8/854: dread - d4/d9/d37/fce zero size 2023-10-18T20:58:45.907 INFO:tasks.workunit.client.1.smithi060.stdout:8/855: symlink d4/d9/d88/l109 0 2023-10-18T20:58:45.909 INFO:tasks.workunit.client.1.smithi060.stdout:8/856: link d4/d9/d88/cb2 d4/d9/d88/d90/c10a 0 2023-10-18T20:58:45.910 INFO:tasks.workunit.client.0.smithi008.stdout:3/817: dwrite d0/d4a/f5b [0,4194304] 0 2023-10-18T20:58:45.911 INFO:tasks.workunit.client.1.smithi060.stdout:8/857: creat d4/d9/d88/d90/f10b x:0 0 0 2023-10-18T20:58:45.911 INFO:tasks.workunit.client.1.smithi060.stdout:8/858: fdatasync d4/d9/d31/d35/d9f/da3/dd8/ff7 0 2023-10-18T20:58:45.912 INFO:tasks.workunit.client.0.smithi008.stdout:5/717: mknod d0/d2/d19/d7c/d42/d5a/db4/cff 0 2023-10-18T20:58:45.912 INFO:tasks.workunit.client.1.smithi060.stdout:8/859: creat d4/d9/d31/d35/d9f/da3/f10c x:0 0 0 2023-10-18T20:58:45.914 INFO:tasks.workunit.client.0.smithi008.stdout:4/662: dread d0/d17/f31 [0,4194304] 0 2023-10-18T20:58:45.921 INFO:tasks.workunit.client.0.smithi008.stdout:5/718: mkdir d0/da9/dda/d100 0 2023-10-18T20:58:45.924 INFO:tasks.workunit.client.1.smithi060.stdout:9/832: write d3/d99/d1c/d116/d80/fb7 [650657,119425] 0 2023-10-18T20:58:45.925 INFO:tasks.workunit.client.1.smithi060.stdout:4/891: dwrite d4/dc/d2a/d13/d27/d68/d9e/ff6 [0,4194304] 0 2023-10-18T20:58:45.926 INFO:tasks.workunit.client.1.smithi060.stdout:8/860: dread d4/d9/f23 [0,4194304] 0 2023-10-18T20:58:45.927 INFO:tasks.workunit.client.1.smithi060.stdout:6/899: dwrite d10/d17/d7a/ff4 [0,4194304] 0 2023-10-18T20:58:45.928 INFO:tasks.workunit.client.1.smithi060.stdout:9/833: mknod d3/d99/d1c/d116/d80/d127/d12e/c132 0 2023-10-18T20:58:45.928 INFO:tasks.workunit.client.1.smithi060.stdout:9/834: chown d3/d99/d1c/d25/c100 10 1 2023-10-18T20:58:45.929 INFO:tasks.workunit.client.0.smithi008.stdout:3/818: rmdir d0/d3/d42 39 2023-10-18T20:58:45.930 INFO:tasks.workunit.client.0.smithi008.stdout:4/663: dread d0/d17/f3d [0,4194304] 0 2023-10-18T20:58:45.935 INFO:tasks.workunit.client.0.smithi008.stdout:5/719: symlink d0/d2/d19/d7c/d58/l101 0 2023-10-18T20:58:45.935 INFO:tasks.workunit.client.0.smithi008.stdout:5/720: readlink d0/l48 0 2023-10-18T20:58:45.935 INFO:tasks.workunit.client.0.smithi008.stdout:5/721: fsync d0/d2/d9/d9b/d6f/d75/fb8 0 2023-10-18T20:58:45.935 INFO:tasks.workunit.client.0.smithi008.stdout:6/810: write df/d3c/d77/fb3 [2313279,101045] 0 2023-10-18T20:58:45.935 INFO:tasks.workunit.client.0.smithi008.stdout:6/811: dread - df/d15/d48/ded/d108/dcf/d58/dec/d53/fc8 zero size 2023-10-18T20:58:45.936 INFO:tasks.workunit.client.0.smithi008.stdout:6/812: creat df/d15/d27/f113 x:0 0 0 2023-10-18T20:58:45.937 INFO:tasks.workunit.client.1.smithi060.stdout:4/892: symlink d4/dc/d2a/d2d/l117 0 2023-10-18T20:58:45.939 INFO:tasks.workunit.client.0.smithi008.stdout:7/732: dwrite d1/d3/f27 [0,4194304] 0 2023-10-18T20:58:45.939 INFO:tasks.workunit.client.0.smithi008.stdout:2/728: dwrite d1/d3/dd/d25/d76/d59/fa6 [0,4194304] 0 2023-10-18T20:58:45.939 INFO:tasks.workunit.client.0.smithi008.stdout:2/729: chown d1/d3/l33 42384914 1 2023-10-18T20:58:45.940 INFO:tasks.workunit.client.1.smithi060.stdout:9/835: dread d3/d99/d19/d54/d11d/f124 [0,4194304] 0 2023-10-18T20:58:45.942 INFO:tasks.workunit.client.1.smithi060.stdout:9/836: mknod d3/d99/d1c/d116/d80/da0/dc2/d9e/d131/c133 0 2023-10-18T20:58:45.945 INFO:tasks.workunit.client.0.smithi008.stdout:3/819: mkdir d0/d3/d42/d88/d103 0 2023-10-18T20:58:45.945 INFO:tasks.workunit.client.0.smithi008.stdout:3/820: chown d0/d3/d42/f30 2630873 1 2023-10-18T20:58:45.945 INFO:tasks.workunit.client.0.smithi008.stdout:3/821: rename d0/d3/d37/da6 to d0/d3/d37/da6/d104 22 2023-10-18T20:58:45.946 INFO:tasks.workunit.client.1.smithi060.stdout:9/837: read d3/d99/d1c/d116/d2d/db9/f109 [1225517,118612] 0 2023-10-18T20:58:45.951 INFO:tasks.workunit.client.1.smithi060.stdout:9/838: dread d3/d99/d1c/d116/d80/da0/dc2/d9e/d131/fad [0,4194304] 0 2023-10-18T20:58:45.951 INFO:tasks.workunit.client.1.smithi060.stdout:5/923: dwrite d0/dd/d76/f110 [0,4194304] 0 2023-10-18T20:58:45.954 INFO:tasks.workunit.client.0.smithi008.stdout:5/722: creat d0/d2/d9/d88/dfa/f102 x:0 0 0 2023-10-18T20:58:45.954 INFO:tasks.workunit.client.0.smithi008.stdout:5/723: dread - d0/d2/ffe zero size 2023-10-18T20:58:45.955 INFO:tasks.workunit.client.0.smithi008.stdout:7/733: symlink d1/da6/d79/db5/le4 0 2023-10-18T20:58:45.956 INFO:tasks.workunit.client.1.smithi060.stdout:0/922: dwrite d3/d8/d11f/d55/d74/fce [0,4194304] 0 2023-10-18T20:58:45.957 INFO:tasks.workunit.client.0.smithi008.stdout:5/724: mkdir d0/d103 0 2023-10-18T20:58:45.957 INFO:tasks.workunit.client.1.smithi060.stdout:8/861: write d4/fc6 [1813801,118757] 0 2023-10-18T20:58:45.957 INFO:tasks.workunit.client.1.smithi060.stdout:9/839: link d3/d99/d1c/d116/c60 d3/d99/d19/d54/d8f/c134 0 2023-10-18T20:58:45.958 INFO:tasks.workunit.client.1.smithi060.stdout:9/840: fdatasync d3/d99/d1c/f1d 0 2023-10-18T20:58:45.958 INFO:tasks.workunit.client.0.smithi008.stdout:5/725: mknod d0/d2/d19/d7c/c104 0 2023-10-18T20:58:45.958 INFO:tasks.workunit.client.0.smithi008.stdout:5/726: fsync d0/d2/d9/d9b/d62/fe4 0 2023-10-18T20:58:45.960 INFO:tasks.workunit.client.0.smithi008.stdout:5/727: creat d0/dec/f105 x:0 0 0 2023-10-18T20:58:45.961 INFO:tasks.workunit.client.0.smithi008.stdout:5/728: creat d0/d2/d9/d88/dfa/f106 x:0 0 0 2023-10-18T20:58:45.961 INFO:tasks.workunit.client.1.smithi060.stdout:0/923: creat d3/d8/f12a x:0 0 0 2023-10-18T20:58:45.963 INFO:tasks.workunit.client.0.smithi008.stdout:7/734: dread d1/d3/d20/f66 [0,4194304] 0 2023-10-18T20:58:45.972 INFO:tasks.workunit.client.0.smithi008.stdout:4/664: write d0/f27 [2146886,50605] 0 2023-10-18T20:58:45.972 INFO:tasks.workunit.client.0.smithi008.stdout:7/735: rmdir d1/d3/d20/d5f/d78 39 2023-10-18T20:58:45.977 INFO:tasks.workunit.client.1.smithi060.stdout:8/862: mkdir d4/d10d 0 2023-10-18T20:58:45.985 INFO:tasks.workunit.client.1.smithi060.stdout:4/893: dread d4/dc/d2a/d39/f49 [0,4194304] 0 2023-10-18T20:58:45.990 INFO:tasks.workunit.client.1.smithi060.stdout:8/863: rmdir d4/d9/d31/d6f/dfa/dcb 39 2023-10-18T20:58:45.993 INFO:tasks.workunit.client.0.smithi008.stdout:9/648: sync 2023-10-18T20:58:45.993 INFO:tasks.workunit.client.0.smithi008.stdout:1/763: sync 2023-10-18T20:58:45.994 INFO:tasks.workunit.client.1.smithi060.stdout:4/894: truncate d4/dc/d2a/d13/f87 1147363 0 2023-10-18T20:58:45.995 INFO:tasks.workunit.client.1.smithi060.stdout:4/895: creat d4/dc/d2a/d13/d27/d68/d9e/f118 x:0 0 0 2023-10-18T20:58:45.995 INFO:tasks.workunit.client.1.smithi060.stdout:4/896: write d4/dc/d2a/d13/ffa [961655,53432] 0 2023-10-18T20:58:45.995 INFO:tasks.workunit.client.0.smithi008.stdout:1/764: getdents d9/de/df/d17/d25/d57 0 2023-10-18T20:58:45.996 INFO:tasks.workunit.client.0.smithi008.stdout:1/765: write d9/de/df/d17/d1e/d3c/fb6 [328298,113390] 0 2023-10-18T20:58:45.996 INFO:tasks.workunit.client.1.smithi060.stdout:8/864: creat d4/d9/d4f/d74/d81/f10e x:0 0 0 2023-10-18T20:58:45.997 INFO:tasks.workunit.client.1.smithi060.stdout:8/865: chown d4/d9/d31/da6/fac 16 1 2023-10-18T20:58:46.007 INFO:tasks.workunit.client.0.smithi008.stdout:1/766: rmdir d9/de/df/d17/d69 39 2023-10-18T20:58:46.008 INFO:tasks.workunit.client.1.smithi060.stdout:4/897: creat d4/dc/d2a/d2d/d69/d89/d110/f119 x:0 0 0 2023-10-18T20:58:46.008 INFO:tasks.workunit.client.0.smithi008.stdout:4/665: dread d0/f8b [0,4194304] 0 2023-10-18T20:58:46.010 INFO:tasks.workunit.client.0.smithi008.stdout:1/767: unlink d9/de/c23 0 2023-10-18T20:58:46.011 INFO:tasks.workunit.client.0.smithi008.stdout:4/666: mknod d0/d3/d21/d57/d8f/cde 0 2023-10-18T20:58:46.011 INFO:tasks.workunit.client.0.smithi008.stdout:4/667: truncate d0/f12 5361066 0 2023-10-18T20:58:46.013 INFO:tasks.workunit.client.0.smithi008.stdout:6/813: dwrite df/d26/fe9 [0,4194304] 0 2023-10-18T20:58:46.016 INFO:tasks.workunit.client.0.smithi008.stdout:4/668: unlink d0/d3/d21/d57/d8f/d82/fb8 0 2023-10-18T20:58:46.017 INFO:tasks.workunit.client.0.smithi008.stdout:4/669: chown d0/d17/d5b/d2a/f3c 58 1 2023-10-18T20:58:46.017 INFO:tasks.workunit.client.1.smithi060.stdout:4/898: link d4/d15/f48 d4/dc/d2a/d13/f11a 0 2023-10-18T20:58:46.018 INFO:tasks.workunit.client.0.smithi008.stdout:4/670: truncate d0/f8b 1618882 0 2023-10-18T20:58:46.018 INFO:tasks.workunit.client.0.smithi008.stdout:4/671: truncate d0/d17/d5b/fa6 351860 0 2023-10-18T20:58:46.021 INFO:tasks.workunit.client.1.smithi060.stdout:6/900: dwrite d10/d3e/f74 [4194304,4194304] 0 2023-10-18T20:58:46.025 INFO:tasks.workunit.client.1.smithi060.stdout:9/841: dwrite d3/d99/d1c/d116/d80/da0/dc2/de0/f105 [0,4194304] 0 2023-10-18T20:58:46.027 INFO:tasks.workunit.client.1.smithi060.stdout:5/924: dwrite d0/dd/d76/d10f/ff7 [0,4194304] 0 2023-10-18T20:58:46.027 INFO:tasks.workunit.client.1.smithi060.stdout:5/925: stat d0/d47/df2/d10e 0 2023-10-18T20:58:46.027 INFO:tasks.workunit.client.1.smithi060.stdout:5/926: readlink d0/dd/d76/d10f/da5/d67/ldd 0 2023-10-18T20:58:46.027 INFO:tasks.workunit.client.1.smithi060.stdout:5/927: write d0/da/f10d [329109,118418] 0 2023-10-18T20:58:46.028 INFO:tasks.workunit.client.1.smithi060.stdout:5/928: dread - d0/d6/d9/fd4 zero size 2023-10-18T20:58:46.028 INFO:tasks.workunit.client.1.smithi060.stdout:5/929: getdents d0/da/dc8/de4/d4f/d13a 0 2023-10-18T20:58:46.028 INFO:tasks.workunit.client.1.smithi060.stdout:5/930: write d0/d47/d7d/da0/f120 [143585,62552] 0 2023-10-18T20:58:46.033 INFO:tasks.workunit.client.1.smithi060.stdout:9/842: dread d3/d99/d19/f90 [0,4194304] 0 2023-10-18T20:58:46.033 INFO:tasks.workunit.client.1.smithi060.stdout:9/843: readlink d3/d99/d1c/d5a/d5d/d56/dd0/lab 0 2023-10-18T20:58:46.036 INFO:tasks.workunit.client.0.smithi008.stdout:5/729: rename d0/d2/d9/d88 to d0/d2/d19/d7c/d31/d80/d107 0 2023-10-18T20:58:46.037 INFO:tasks.workunit.client.1.smithi060.stdout:6/901: write d10/d17/d28/f68 [1053861,52400] 0 2023-10-18T20:58:46.038 INFO:tasks.workunit.client.1.smithi060.stdout:6/902: dread - d10/d17/f97 zero size 2023-10-18T20:58:46.041 INFO:tasks.workunit.client.0.smithi008.stdout:5/730: mknod d0/d2/d19/d7c/d31/d80/d91/c108 0 2023-10-18T20:58:46.045 INFO:tasks.workunit.client.0.smithi008.stdout:9/649: rename d2/dc/d1a/f21 to d2/dc/d40/d6f/d92/d59/fbd 0 2023-10-18T20:58:46.045 INFO:tasks.workunit.client.0.smithi008.stdout:9/650: dread - d2/dc/d17/d19/d4a/fb3 zero size 2023-10-18T20:58:46.046 INFO:tasks.workunit.client.0.smithi008.stdout:5/731: mkdir d0/de/d109 0 2023-10-18T20:58:46.049 INFO:tasks.workunit.client.0.smithi008.stdout:3/822: dwrite d0/d84/f90 [0,4194304] 0 2023-10-18T20:58:46.049 INFO:tasks.workunit.client.0.smithi008.stdout:3/823: fsync d0/d3/de/d13/d35/d51/fbe 0 2023-10-18T20:58:46.050 INFO:tasks.workunit.client.0.smithi008.stdout:2/730: dwrite d1/d3/dd/f58 [0,4194304] 0 2023-10-18T20:58:46.052 INFO:tasks.workunit.client.1.smithi060.stdout:9/844: write d3/d58/f64 [3287514,25801] 0 2023-10-18T20:58:46.052 INFO:tasks.workunit.client.0.smithi008.stdout:4/672: dread d0/f27 [0,4194304] 0 2023-10-18T20:58:46.052 INFO:tasks.workunit.client.0.smithi008.stdout:3/824: mkdir d0/d4a/d64/df6/d105 0 2023-10-18T20:58:46.055 INFO:tasks.workunit.client.0.smithi008.stdout:1/768: rename d9/de/df/d77/c82 to d9/de/df/d17/cf0 0 2023-10-18T20:58:46.056 INFO:tasks.workunit.client.1.smithi060.stdout:5/931: dread d0/da/dc8/de4/f135 [0,4194304] 0 2023-10-18T20:58:46.057 INFO:tasks.workunit.client.0.smithi008.stdout:4/673: mknod d0/d58/d83/cdf 0 2023-10-18T20:58:46.057 INFO:tasks.workunit.client.0.smithi008.stdout:4/674: creat d0/d17/d5b/d99/fe0 x:0 0 0 2023-10-18T20:58:46.057 INFO:tasks.workunit.client.0.smithi008.stdout:1/769: mkdir d9/df1 0 2023-10-18T20:58:46.058 INFO:tasks.workunit.client.0.smithi008.stdout:4/675: creat d0/d17/d5b/d99/fe1 x:0 0 0 2023-10-18T20:58:46.061 INFO:tasks.workunit.client.0.smithi008.stdout:1/770: creat d9/de/df/d17/d69/ff2 x:0 0 0 2023-10-18T20:58:46.064 INFO:tasks.workunit.client.1.smithi060.stdout:8/866: dwrite d4/d9/d4f/f92 [0,4194304] 0 2023-10-18T20:58:46.064 INFO:tasks.workunit.client.1.smithi060.stdout:8/867: truncate d4/d9/d31/d35/d9f/da3/ddb/de9/ffe 928404 0 2023-10-18T20:58:46.066 INFO:tasks.workunit.client.0.smithi008.stdout:4/676: creat d0/d58/d8e/dd2/fe2 x:0 0 0 2023-10-18T20:58:46.071 INFO:tasks.workunit.client.1.smithi060.stdout:9/845: creat d3/d99/d1c/f135 x:0 0 0 2023-10-18T20:58:46.073 INFO:tasks.workunit.client.0.smithi008.stdout:4/677: link d0/d17/d5b/fb d0/d17/d5b/d45/fe3 0 2023-10-18T20:58:46.075 INFO:tasks.workunit.client.1.smithi060.stdout:0/924: dwrite d3/d32/f38 [0,4194304] 0 2023-10-18T20:58:46.078 INFO:tasks.workunit.client.1.smithi060.stdout:9/846: truncate d3/d99/d19/d54/d11d/fb5 3517603 0 2023-10-18T20:58:46.078 INFO:tasks.workunit.client.1.smithi060.stdout:9/847: stat d3/d99/d65/l7a 0 2023-10-18T20:58:46.079 INFO:tasks.workunit.client.0.smithi008.stdout:4/678: symlink d0/d58/d83/le4 0 2023-10-18T20:58:46.081 INFO:tasks.workunit.client.0.smithi008.stdout:1/771: dread d9/de/df/d77/fe7 [0,4194304] 0 2023-10-18T20:58:46.082 INFO:tasks.workunit.client.0.smithi008.stdout:1/772: creat d9/de/df/d17/d1e/d3c/d90/d95/ff3 x:0 0 0 2023-10-18T20:58:46.084 INFO:tasks.workunit.client.1.smithi060.stdout:7/964: sync 2023-10-18T20:58:46.085 INFO:tasks.workunit.client.1.smithi060.stdout:4/899: dwrite d4/dc/d40/da8/fb8 [0,4194304] 0 2023-10-18T20:58:46.085 INFO:tasks.workunit.client.1.smithi060.stdout:4/900: stat d4/dc/d2a/d5b/ff2 0 2023-10-18T20:58:46.085 INFO:tasks.workunit.client.1.smithi060.stdout:4/901: creat d4/dc/d2a/d5b/f11b x:0 0 0 2023-10-18T20:58:46.088 INFO:tasks.workunit.client.0.smithi008.stdout:7/736: dwrite d1/d3/f57 [0,4194304] 0 2023-10-18T20:58:46.092 INFO:tasks.workunit.client.0.smithi008.stdout:6/814: dwrite df/d15/d48/fa8 [0,4194304] 0 2023-10-18T20:58:46.094 INFO:tasks.workunit.client.0.smithi008.stdout:9/651: dwrite d2/dc/f4b [0,4194304] 0 2023-10-18T20:58:46.095 INFO:tasks.workunit.client.0.smithi008.stdout:2/731: rmdir d1/d3/dd 39 2023-10-18T20:58:46.095 INFO:tasks.workunit.client.0.smithi008.stdout:2/732: read d1/f5a [329795,81367] 0 2023-10-18T20:58:46.097 INFO:tasks.workunit.client.0.smithi008.stdout:4/679: mknod d0/d58/dc7/ce5 0 2023-10-18T20:58:46.098 INFO:tasks.workunit.client.0.smithi008.stdout:4/680: dread - d0/d17/d5b/d99/fda zero size 2023-10-18T20:58:46.098 INFO:tasks.workunit.client.0.smithi008.stdout:1/773: rmdir d9/de/df/d85 39 2023-10-18T20:58:46.101 INFO:tasks.workunit.client.1.smithi060.stdout:9/848: dread d3/d99/d1c/d116/d80/da0/dc2/de0/f105 [0,4194304] 0 2023-10-18T20:58:46.102 INFO:tasks.workunit.client.1.smithi060.stdout:9/849: write d3/d99/d1c/d116/f3b [1426958,19156] 0 2023-10-18T20:58:46.102 INFO:tasks.workunit.client.1.smithi060.stdout:9/850: chown d3/d99/d1c/d25/f4b 191862 1 2023-10-18T20:58:46.102 INFO:tasks.workunit.client.0.smithi008.stdout:4/681: dread - d0/d58/dbf/fca zero size 2023-10-18T20:58:46.103 INFO:tasks.workunit.client.1.smithi060.stdout:0/925: mknod d3/d32/d86/c12b 0 2023-10-18T20:58:46.103 INFO:tasks.workunit.client.1.smithi060.stdout:8/868: rmdir d4/d9/d31/d35/d9f/da3/dd8 39 2023-10-18T20:58:46.110 INFO:tasks.workunit.client.1.smithi060.stdout:7/965: mknod de/d14/d3a/d46/dab/d116/c13c 0 2023-10-18T20:58:46.112 INFO:tasks.workunit.client.1.smithi060.stdout:8/869: mkdir d4/d9/d31/d35/d9f/da3/dd8/d10f 0 2023-10-18T20:58:46.116 INFO:tasks.workunit.client.1.smithi060.stdout:8/870: mkdir d4/d9/d4f/d74/de5/d110 0 2023-10-18T20:58:46.116 INFO:tasks.workunit.client.1.smithi060.stdout:8/871: truncate d4/d9/d4f/f71 679733 0 2023-10-18T20:58:46.116 INFO:tasks.workunit.client.1.smithi060.stdout:8/872: readlink d4/d9/d31/la9 0 2023-10-18T20:58:46.117 INFO:tasks.workunit.client.0.smithi008.stdout:6/815: dread df/d15/d48/ded/d108/dcf/f109 [0,4194304] 0 2023-10-18T20:58:46.120 INFO:tasks.workunit.client.1.smithi060.stdout:8/873: symlink d4/d9/d4f/d74/l111 0 2023-10-18T20:58:46.122 INFO:tasks.workunit.client.0.smithi008.stdout:6/816: rmdir df/d15/d48/ded/d108/dcf/d58/dec 39 2023-10-18T20:58:46.123 INFO:tasks.workunit.client.1.smithi060.stdout:8/874: mkdir d4/d9/d31/d35/d9f/da3/dd8/d10f/d112 0 2023-10-18T20:58:46.123 INFO:tasks.workunit.client.0.smithi008.stdout:9/652: write d2/f5 [3994924,64702] 0 2023-10-18T20:58:46.124 INFO:tasks.workunit.client.0.smithi008.stdout:9/653: chown d2/d4d/f7d 14 1 2023-10-18T20:58:46.135 INFO:tasks.workunit.client.1.smithi060.stdout:6/903: dwrite d10/d2e/fe7 [0,4194304] 0 2023-10-18T20:58:46.142 INFO:tasks.workunit.client.0.smithi008.stdout:6/817: symlink df/d3c/d77/dd6/l114 0 2023-10-18T20:58:46.143 INFO:tasks.workunit.client.1.smithi060.stdout:6/904: symlink d10/d17/dae/dbf/l11f 0 2023-10-18T20:58:46.144 INFO:tasks.workunit.client.1.smithi060.stdout:5/932: dwrite d0/dd/d76/d10f/ff7 [4194304,4194304] 0 2023-10-18T20:58:46.144 INFO:tasks.workunit.client.0.smithi008.stdout:8/889: sync 2023-10-18T20:58:46.145 INFO:tasks.workunit.client.0.smithi008.stdout:8/890: write d5/d8/df/d9d/d6c/f7f [3430121,77940] 0 2023-10-18T20:58:46.145 INFO:tasks.workunit.client.0.smithi008.stdout:8/891: dread - d5/d8/df/d9d/d4d/dba/dd4/d50/f115 zero size 2023-10-18T20:58:46.147 INFO:tasks.workunit.client.0.smithi008.stdout:9/654: creat d2/dc/d40/d6f/d92/fbe x:0 0 0 2023-10-18T20:58:46.147 INFO:tasks.workunit.client.0.smithi008.stdout:0/635: sync 2023-10-18T20:58:46.150 INFO:tasks.workunit.client.1.smithi060.stdout:6/905: rename d10/d17/d54/db1/dea to d10/d17/d70/dba/d10b/d120 0 2023-10-18T20:58:46.150 INFO:tasks.workunit.client.1.smithi060.stdout:6/906: write d10/d2e/f56 [6049569,61585] 0 2023-10-18T20:58:46.153 INFO:tasks.workunit.client.1.smithi060.stdout:6/907: mknod d10/d47/c121 0 2023-10-18T20:58:46.153 INFO:tasks.workunit.client.1.smithi060.stdout:5/933: dread d0/da/d3b/fea [0,4194304] 0 2023-10-18T20:58:46.154 INFO:tasks.workunit.client.1.smithi060.stdout:5/934: chown d0/d6/d8/d81/f138 115556 1 2023-10-18T20:58:46.154 INFO:tasks.workunit.client.1.smithi060.stdout:5/935: fsync d0/dd/d76/d10f/ff7 0 2023-10-18T20:58:46.154 INFO:tasks.workunit.client.0.smithi008.stdout:6/818: mkdir df/d115 0 2023-10-18T20:58:46.155 INFO:tasks.workunit.client.1.smithi060.stdout:8/875: dread d4/d9/d31/d6f/dbd/ff1 [4194304,4194304] 0 2023-10-18T20:58:46.157 INFO:tasks.workunit.client.0.smithi008.stdout:7/737: dwrite d1/da6/d4f/d87/fb3 [0,4194304] 0 2023-10-18T20:58:46.158 INFO:tasks.workunit.client.1.smithi060.stdout:6/908: rmdir d10/d3e 39 2023-10-18T20:58:46.159 INFO:tasks.workunit.client.1.smithi060.stdout:5/936: mknod d0/c146 0 2023-10-18T20:58:46.159 INFO:tasks.workunit.client.0.smithi008.stdout:8/892: symlink d5/d8/df/d2e/d13b/d117/d122/l142 0 2023-10-18T20:58:46.160 INFO:tasks.workunit.client.0.smithi008.stdout:9/655: creat d2/dc/fbf x:0 0 0 2023-10-18T20:58:46.160 INFO:tasks.workunit.client.0.smithi008.stdout:9/656: stat d2/dc/d40/f5c 0 2023-10-18T20:58:46.160 INFO:tasks.workunit.client.1.smithi060.stdout:4/902: dwrite d4/d15/f6e [0,4194304] 0 2023-10-18T20:58:46.162 INFO:tasks.workunit.client.0.smithi008.stdout:7/738: mkdir d1/d36/d3d/d3e/d59/d73/d7b/daf/de5 0 2023-10-18T20:58:46.162 INFO:tasks.workunit.client.1.smithi060.stdout:8/876: rename d4/d9/d31/d35/d9f/da3/fa5 to d4/d9/d88/f113 0 2023-10-18T20:58:46.166 INFO:tasks.workunit.client.1.smithi060.stdout:6/909: unlink d10/d25/c4c 0 2023-10-18T20:58:46.166 INFO:tasks.workunit.client.1.smithi060.stdout:6/910: truncate d10/d17/dae/ff9 25794 0 2023-10-18T20:58:46.166 INFO:tasks.workunit.client.1.smithi060.stdout:5/937: symlink d0/d6/d9/d82/d84/l147 0 2023-10-18T20:58:46.166 INFO:tasks.workunit.client.1.smithi060.stdout:5/938: fsync d0/d6/d9/db1/fd0 0 2023-10-18T20:58:46.166 INFO:tasks.workunit.client.1.smithi060.stdout:6/911: write d10/d2e/f4e [2785226,16595] 0 2023-10-18T20:58:46.167 INFO:tasks.workunit.client.0.smithi008.stdout:8/893: rename d5/d8/df/d9d/l9b to d5/d8/df/d2e/d13b/deb/l143 0 2023-10-18T20:58:46.167 INFO:tasks.workunit.client.0.smithi008.stdout:5/732: dwrite d0/d2/d9/f2d [0,4194304] 0 2023-10-18T20:58:46.168 INFO:tasks.workunit.client.0.smithi008.stdout:0/636: dread d0/dd/d19/f79 [0,4194304] 0 2023-10-18T20:58:46.168 INFO:tasks.workunit.client.0.smithi008.stdout:8/894: write d5/d8/f32 [9608068,59664] 0 2023-10-18T20:58:46.168 INFO:tasks.workunit.client.0.smithi008.stdout:9/657: mknod d2/dc/d1a/d1d/cc0 0 2023-10-18T20:58:46.168 INFO:tasks.workunit.client.0.smithi008.stdout:0/637: getdents d0/d7c/d9a/d8a/db0 0 2023-10-18T20:58:46.168 INFO:tasks.workunit.client.0.smithi008.stdout:2/733: write d1/d3/d40/f54 [4055512,75876] 0 2023-10-18T20:58:46.171 INFO:tasks.workunit.client.0.smithi008.stdout:1/774: dwrite d9/de/f80 [0,4194304] 0 2023-10-18T20:58:46.172 INFO:tasks.workunit.client.0.smithi008.stdout:1/775: write d9/de/df/d17/d25/d57/fac [649595,41986] 0 2023-10-18T20:58:46.173 INFO:tasks.workunit.client.0.smithi008.stdout:8/895: creat d5/d8/df/d9d/d85/db1/f144 x:0 0 0 2023-10-18T20:58:46.173 INFO:tasks.workunit.client.0.smithi008.stdout:8/896: fsync d5/d8/df/f1b 0 2023-10-18T20:58:46.173 INFO:tasks.workunit.client.0.smithi008.stdout:6/819: write df/d15/d48/ded/d108/fbd [1884706,75975] 0 2023-10-18T20:58:46.175 INFO:tasks.workunit.client.1.smithi060.stdout:7/966: dwrite de/d14/d2f/d8f/d5b/f133 [0,4194304] 0 2023-10-18T20:58:46.177 INFO:tasks.workunit.client.1.smithi060.stdout:0/926: dwrite d3/d32/f66 [4194304,4194304] 0 2023-10-18T20:58:46.178 INFO:tasks.workunit.client.1.smithi060.stdout:0/927: dread - d3/d8/d11f/d55/f127 zero size 2023-10-18T20:58:46.178 INFO:tasks.workunit.client.0.smithi008.stdout:0/638: mknod d0/d3a/d61/cc1 0 2023-10-18T20:58:46.179 INFO:tasks.workunit.client.0.smithi008.stdout:2/734: creat d1/d3/dd/ff2 x:0 0 0 2023-10-18T20:58:46.179 INFO:tasks.workunit.client.0.smithi008.stdout:2/735: read d1/d3/dd/d1c/d3a/d45/f84 [984193,18182] 0 2023-10-18T20:58:46.181 INFO:tasks.workunit.client.1.smithi060.stdout:5/939: symlink d0/d6/d9/d82/d84/l148 0 2023-10-18T20:58:46.182 INFO:tasks.workunit.client.0.smithi008.stdout:2/736: mkdir d1/d3/dd/df3 0 2023-10-18T20:58:46.186 INFO:tasks.workunit.client.1.smithi060.stdout:9/851: dwrite d3/d99/d1c/f135 [0,4194304] 0 2023-10-18T20:58:46.191 INFO:tasks.workunit.client.1.smithi060.stdout:2/911: sync 2023-10-18T20:58:46.192 INFO:tasks.workunit.client.1.smithi060.stdout:2/912: write d0/d16/d85/de3/f121 [965455,41142] 0 2023-10-18T20:58:46.192 INFO:tasks.workunit.client.0.smithi008.stdout:8/897: read d5/d8/df/d9d/d85/db1/dcc/d104/ffe [858508,56350] 0 2023-10-18T20:58:46.193 INFO:tasks.workunit.client.1.smithi060.stdout:9/852: dread d3/d99/d1c/d116/d80/ff6 [0,4194304] 0 2023-10-18T20:58:46.193 INFO:tasks.workunit.client.1.smithi060.stdout:3/859: sync 2023-10-18T20:58:46.194 INFO:tasks.workunit.client.1.smithi060.stdout:3/860: stat d0/d3c/d3d 0 2023-10-18T20:58:46.195 INFO:tasks.workunit.client.0.smithi008.stdout:8/898: symlink d5/d8/l145 0 2023-10-18T20:58:46.203 INFO:tasks.workunit.client.0.smithi008.stdout:0/639: dread d0/d7c/f81 [0,4194304] 0 2023-10-18T20:58:46.205 INFO:tasks.workunit.client.0.smithi008.stdout:0/640: creat d0/dd/df/fc2 x:0 0 0 2023-10-18T20:58:46.205 INFO:tasks.workunit.client.1.smithi060.stdout:7/967: creat de/d14/d2f/d3f/d5a/d5f/d114/f13d x:0 0 0 2023-10-18T20:58:46.210 INFO:tasks.workunit.client.0.smithi008.stdout:0/641: mknod d0/d7c/d9a/d8a/d8f/da5/cc3 0 2023-10-18T20:58:46.210 INFO:tasks.workunit.client.0.smithi008.stdout:0/642: fdatasync d0/dd/d19/d5f/d89/da7/fba 0 2023-10-18T20:58:46.214 INFO:tasks.workunit.client.0.smithi008.stdout:0/643: creat d0/d3a/d61/fc4 x:0 0 0 2023-10-18T20:58:46.218 INFO:tasks.workunit.client.0.smithi008.stdout:0/644: mknod d0/dd/d19/d24/cc5 0 2023-10-18T20:58:46.219 INFO:tasks.workunit.client.1.smithi060.stdout:5/940: rmdir d0/d6/d9/d82/d84/db2/d41 39 2023-10-18T20:58:46.220 INFO:tasks.workunit.client.1.smithi060.stdout:2/913: truncate d0/d8/d87/fcb 1576085 0 2023-10-18T20:58:46.220 INFO:tasks.workunit.client.1.smithi060.stdout:2/914: chown d0/fd4 9380735 1 2023-10-18T20:58:46.220 INFO:tasks.workunit.client.0.smithi008.stdout:0/645: symlink d0/d7c/d9a/d8a/d8f/da5/lc6 0 2023-10-18T20:58:46.222 INFO:tasks.workunit.client.1.smithi060.stdout:4/903: rename d4/dc/d2a/d2d to d4/dc/d2a/d31/da5/d11c 0 2023-10-18T20:58:46.222 INFO:tasks.workunit.client.1.smithi060.stdout:4/904: fdatasync d4/dc/d2a/d13/f9b 0 2023-10-18T20:58:46.223 INFO:tasks.workunit.client.1.smithi060.stdout:4/905: write d4/dc/d2a/f1f [156839,117860] 0 2023-10-18T20:58:46.223 INFO:tasks.workunit.client.0.smithi008.stdout:1/776: dread d9/de/df/d17/d1e/d3c/f7e [0,4194304] 0 2023-10-18T20:58:46.228 INFO:tasks.workunit.client.1.smithi060.stdout:5/941: unlink d0/da/dc8/de4/d4f/c52 0 2023-10-18T20:58:46.229 INFO:tasks.workunit.client.1.smithi060.stdout:5/942: write d0/dd/d76/d10f/da5/d11d/f13f [424374,108605] 0 2023-10-18T20:58:46.229 INFO:tasks.workunit.client.1.smithi060.stdout:4/906: creat d4/dc/d2a/d39/d53/d76/da7/dca/de5/f11d x:0 0 0 2023-10-18T20:58:46.229 INFO:tasks.workunit.client.1.smithi060.stdout:4/907: readlink d4/dc/d2a/d31/da5/d11c/dc7/ld9 0 2023-10-18T20:58:46.229 INFO:tasks.workunit.client.1.smithi060.stdout:4/908: mkdir d4/dc/d2a/d13/d27/d68/d9e/d11e 0 2023-10-18T20:58:46.232 INFO:tasks.workunit.client.0.smithi008.stdout:2/737: write d1/d3/dd/d1c/f55 [512378,89652] 0 2023-10-18T20:58:46.234 INFO:tasks.workunit.client.0.smithi008.stdout:0/646: symlink d0/d7c/d9a/d8a/d8f/da5/lc7 0 2023-10-18T20:58:46.238 INFO:tasks.workunit.client.0.smithi008.stdout:4/682: dwrite d0/d17/d5b/f68 [0,4194304] 0 2023-10-18T20:58:46.243 INFO:tasks.workunit.client.0.smithi008.stdout:6/820: dread df/d15/d48/ded/d108/dcf/d58/dec/f69 [0,4194304] 0 2023-10-18T20:58:46.245 INFO:tasks.workunit.client.0.smithi008.stdout:7/739: dwrite d1/d3/d20/d5f/d7f/fbc [0,4194304] 0 2023-10-18T20:58:46.245 INFO:tasks.workunit.client.0.smithi008.stdout:7/740: write d1/d3/d8b/f93 [1197922,103956] 0 2023-10-18T20:58:46.255 INFO:tasks.workunit.client.0.smithi008.stdout:1/777: symlink d9/de/df/d17/d55/lf4 0 2023-10-18T20:58:46.259 INFO:tasks.workunit.client.1.smithi060.stdout:8/877: dwrite d4/d9/db4/fd7 [0,4194304] 0 2023-10-18T20:58:46.259 INFO:tasks.workunit.client.1.smithi060.stdout:8/878: fdatasync d4/d9/d31/fbe 0 2023-10-18T20:58:46.259 INFO:tasks.workunit.client.1.smithi060.stdout:8/879: write d4/f108 [497673,54525] 0 2023-10-18T20:58:46.260 INFO:tasks.workunit.client.1.smithi060.stdout:8/880: stat d4/d9/db4/l102 0 2023-10-18T20:58:46.260 INFO:tasks.workunit.client.0.smithi008.stdout:0/647: creat d0/dd/fc8 x:0 0 0 2023-10-18T20:58:46.264 INFO:tasks.workunit.client.0.smithi008.stdout:4/683: unlink d0/d3/d21/c8c 0 2023-10-18T20:58:46.265 INFO:tasks.workunit.client.0.smithi008.stdout:4/684: chown d0/d17/d5b/d45/lb3 840 1 2023-10-18T20:58:46.265 INFO:tasks.workunit.client.0.smithi008.stdout:4/685: write d0/f27 [1082098,11961] 0 2023-10-18T20:58:46.273 INFO:tasks.workunit.client.1.smithi060.stdout:5/943: write d0/d47/d7d/da0/d106/f115 [1108250,115493] 0 2023-10-18T20:58:46.274 INFO:tasks.workunit.client.1.smithi060.stdout:5/944: write d0/d47/d7d/da0/d106/f115 [2685319,2488] 0 2023-10-18T20:58:46.286 INFO:tasks.workunit.client.0.smithi008.stdout:2/738: rmdir d1/d3/dd/d25/d4d 39 2023-10-18T20:58:46.287 INFO:tasks.workunit.client.0.smithi008.stdout:0/648: dread d0/d7c/f81 [0,4194304] 0 2023-10-18T20:58:46.312 INFO:tasks.workunit.client.0.smithi008.stdout:8/899: dwrite d5/d8/df/d9d/d4d/f7c [0,4194304] 0 2023-10-18T20:58:46.312 INFO:tasks.workunit.client.0.smithi008.stdout:8/900: creat d5/d8/df/d9d/d4d/f146 x:0 0 0 2023-10-18T20:58:46.318 INFO:tasks.workunit.client.0.smithi008.stdout:6/821: truncate df/d15/f16 479122 0 2023-10-18T20:58:46.318 INFO:tasks.workunit.client.0.smithi008.stdout:6/822: write df/d15/d48/ded/d108/dcf/d58/dd7/f102 [382475,14623] 0 2023-10-18T20:58:46.318 INFO:tasks.workunit.client.0.smithi008.stdout:6/823: chown df/d15/d48/ded/d108/dcf/d68 1697 1 2023-10-18T20:58:46.323 INFO:tasks.workunit.client.0.smithi008.stdout:4/686: creat d0/d58/d8e/fe6 x:0 0 0 2023-10-18T20:58:46.323 INFO:tasks.workunit.client.0.smithi008.stdout:4/687: truncate d0/d17/d5b/d99/fda 436919 0 2023-10-18T20:58:46.327 INFO:tasks.workunit.client.0.smithi008.stdout:2/739: creat d1/d3/dd/df3/ff4 x:0 0 0 2023-10-18T20:58:46.329 INFO:tasks.workunit.client.1.smithi060.stdout:8/881: dread d4/d9/d4f/f63 [0,4194304] 0 2023-10-18T20:58:46.333 INFO:tasks.workunit.client.1.smithi060.stdout:8/882: mkdir d4/d9/d31/d35/d114 0 2023-10-18T20:58:46.333 INFO:tasks.workunit.client.1.smithi060.stdout:8/883: write d4/d9/db4/fc8 [506268,71722] 0 2023-10-18T20:58:46.335 INFO:tasks.workunit.client.1.smithi060.stdout:3/861: dwrite d0/d3c/d3d/d4d/f97 [0,4194304] 0 2023-10-18T20:58:46.336 INFO:tasks.workunit.client.0.smithi008.stdout:0/649: rename d0/dd/d19/d24/fb8 to d0/dd/df/fc9 0 2023-10-18T20:58:46.337 INFO:tasks.workunit.client.1.smithi060.stdout:8/884: link d4/d9/d4f/lf6 d4/d9/d31/d35/d114/l115 0 2023-10-18T20:58:46.338 INFO:tasks.workunit.client.0.smithi008.stdout:1/778: dwrite d9/de/df/d77/faf [0,4194304] 0 2023-10-18T20:58:46.341 INFO:tasks.workunit.client.1.smithi060.stdout:7/968: dwrite de/d29/f37 [0,4194304] 0 2023-10-18T20:58:46.341 INFO:tasks.workunit.client.1.smithi060.stdout:7/969: chown de/d29/d72 746 1 2023-10-18T20:58:46.341 INFO:tasks.workunit.client.1.smithi060.stdout:7/970: truncate de/d14/d49/d68/d7d/fe2 68711 0 2023-10-18T20:58:46.342 INFO:tasks.workunit.client.1.smithi060.stdout:7/971: chown de/d29/d72/f85 5945687 1 2023-10-18T20:58:46.344 INFO:tasks.workunit.client.0.smithi008.stdout:8/901: symlink d5/d8/df/d9d/d4d/db5/da3/l147 0 2023-10-18T20:58:46.344 INFO:tasks.workunit.client.0.smithi008.stdout:4/688: creat d0/d58/fe7 x:0 0 0 2023-10-18T20:58:46.349 INFO:tasks.workunit.client.1.smithi060.stdout:3/862: creat d0/d22/d26/d2b/f12d x:0 0 0 2023-10-18T20:58:46.350 INFO:tasks.workunit.client.1.smithi060.stdout:2/915: dwrite d0/d3/d27/d108/fb0 [0,4194304] 0 2023-10-18T20:58:46.350 INFO:tasks.workunit.client.1.smithi060.stdout:8/885: mknod d4/d9/db4/c116 0 2023-10-18T20:58:46.350 INFO:tasks.workunit.client.1.smithi060.stdout:7/972: rename de/d14/d49/da3/ff4 to de/d14/d2f/d3f/d5a/dc8/f13e 0 2023-10-18T20:58:46.350 INFO:tasks.workunit.client.1.smithi060.stdout:0/928: dwrite d3/d8/f10 [4194304,4194304] 0 2023-10-18T20:58:46.351 INFO:tasks.workunit.client.0.smithi008.stdout:7/741: dwrite d1/d36/f7e [0,4194304] 0 2023-10-18T20:58:46.353 INFO:tasks.workunit.client.0.smithi008.stdout:0/650: mknod d0/dd/cca 0 2023-10-18T20:58:46.353 INFO:tasks.workunit.client.0.smithi008.stdout:0/651: chown d0/d3a/f8e 443504647 1 2023-10-18T20:58:46.354 INFO:tasks.workunit.client.1.smithi060.stdout:2/916: rmdir d0/d16/dc8/d11f 0 2023-10-18T20:58:46.354 INFO:tasks.workunit.client.1.smithi060.stdout:7/973: mkdir de/d14/d2f/d7b/d13f 0 2023-10-18T20:58:46.354 INFO:tasks.workunit.client.1.smithi060.stdout:7/974: readlink de/d14/d2f/l6e 0 2023-10-18T20:58:46.356 INFO:tasks.workunit.client.1.smithi060.stdout:0/929: rename d3/d80/db5/cc5 to d3/d80/c12c 0 2023-10-18T20:58:46.356 INFO:tasks.workunit.client.0.smithi008.stdout:8/902: dread d5/d8/df/f29 [0,4194304] 0 2023-10-18T20:58:46.361 INFO:tasks.workunit.client.0.smithi008.stdout:1/779: dread d9/de/df/d17/d1e/f4a [0,4194304] 0 2023-10-18T20:58:46.369 INFO:tasks.workunit.client.0.smithi008.stdout:8/903: dread d5/d8/df/dce/dfa/d125/ff7 [0,4194304] 0 2023-10-18T20:58:46.370 INFO:tasks.workunit.client.0.smithi008.stdout:0/652: creat d0/dd/d19/d5f/d89/da7/dac/fcb x:0 0 0 2023-10-18T20:58:46.371 INFO:tasks.workunit.client.0.smithi008.stdout:1/780: mknod d9/de/df/d17/ddb/cf5 0 2023-10-18T20:58:46.373 INFO:tasks.workunit.client.1.smithi060.stdout:8/886: dread d4/d9/f6b [0,4194304] 0 2023-10-18T20:58:46.380 INFO:tasks.workunit.client.1.smithi060.stdout:8/887: creat d4/d9/d37/d4e/dd9/f117 x:0 0 0 2023-10-18T20:58:46.380 INFO:tasks.workunit.client.1.smithi060.stdout:8/888: getdents d4/d9/d31/d35 0 2023-10-18T20:58:46.381 INFO:tasks.workunit.client.1.smithi060.stdout:8/889: chown d4/d9/d88/cf4 375 1 2023-10-18T20:58:46.383 INFO:tasks.workunit.client.1.smithi060.stdout:9/853: dwrite d3/d99/d19/d54/d11d/fb5 [0,4194304] 0 2023-10-18T20:58:46.384 INFO:tasks.workunit.client.1.smithi060.stdout:9/854: dread - d3/d99/d1c/d5a/d5d/d56/fd7 zero size 2023-10-18T20:58:46.384 INFO:tasks.workunit.client.1.smithi060.stdout:5/945: dwrite d0/dd/d76/d10f/ff7 [0,4194304] 0 2023-10-18T20:58:46.386 INFO:tasks.workunit.client.0.smithi008.stdout:4/689: read d0/d17/f23 [2506583,75816] 0 2023-10-18T20:58:46.386 INFO:tasks.workunit.client.1.smithi060.stdout:9/855: creat d3/d99/d1c/d116/d80/f136 x:0 0 0 2023-10-18T20:58:46.387 INFO:tasks.workunit.client.1.smithi060.stdout:9/856: truncate d3/d99/d1c/d25/fde 3895364 0 2023-10-18T20:58:46.389 INFO:tasks.workunit.client.1.smithi060.stdout:9/857: rmdir d3/d99/d1c/d116 39 2023-10-18T20:58:46.403 INFO:tasks.workunit.client.0.smithi008.stdout:4/690: dread d0/d58/d8e/f53 [0,4194304] 0 2023-10-18T20:58:46.404 INFO:tasks.workunit.client.0.smithi008.stdout:4/691: chown d0/d3/d21/l9e 0 1 2023-10-18T20:58:46.408 INFO:tasks.workunit.client.1.smithi060.stdout:8/890: dread d4/d9/d31/d35/f44 [0,4194304] 0 2023-10-18T20:58:46.411 INFO:tasks.workunit.client.1.smithi060.stdout:8/891: creat d4/d9/d31/d6f/dfa/d7b/f118 x:0 0 0 2023-10-18T20:58:46.413 INFO:tasks.workunit.client.1.smithi060.stdout:8/892: chown d4/f47 1 1 2023-10-18T20:58:46.417 INFO:tasks.workunit.client.1.smithi060.stdout:8/893: rename d4/d9/d4f/f63 to d4/d9/d31/d35/d9f/da3/ddb/f119 0 2023-10-18T20:58:46.418 INFO:tasks.workunit.client.1.smithi060.stdout:8/894: chown d4/d9/d31/d35/d9f/da3/fc7 21557108 1 2023-10-18T20:58:46.418 INFO:tasks.workunit.client.1.smithi060.stdout:8/895: chown d4/d9/d93/lc9 388236 1 2023-10-18T20:58:46.418 INFO:tasks.workunit.client.1.smithi060.stdout:8/896: fdatasync d4/d9/d4f/d74/d81/f10e 0 2023-10-18T20:58:46.418 INFO:tasks.workunit.client.1.smithi060.stdout:8/897: chown d4/d9/d31/d35/d9f/da3/l7c 1 1 2023-10-18T20:58:46.418 INFO:tasks.workunit.client.1.smithi060.stdout:8/898: creat d4/d9/d31/da6/f11a x:0 0 0 2023-10-18T20:58:46.419 INFO:tasks.workunit.client.1.smithi060.stdout:8/899: stat d4/d9/d31/d6f/f8c 0 2023-10-18T20:58:46.419 INFO:tasks.workunit.client.1.smithi060.stdout:8/900: dread - d4/d9/d4f/d74/d81/f10e zero size 2023-10-18T20:58:46.423 INFO:tasks.workunit.client.0.smithi008.stdout:0/653: rmdir d0/d7c/d9a/d8a/d8f/da5 39 2023-10-18T20:58:46.423 INFO:tasks.workunit.client.0.smithi008.stdout:0/654: write d0/dd/d19/d5f/d99/f4b [1534131,38931] 0 2023-10-18T20:58:46.424 INFO:tasks.workunit.client.0.smithi008.stdout:3/825: sync 2023-10-18T20:58:46.429 INFO:tasks.workunit.client.0.smithi008.stdout:3/826: read d0/f59 [3451830,120237] 0 2023-10-18T20:58:46.430 INFO:tasks.workunit.client.0.smithi008.stdout:0/655: mknod d0/dd/ccc 0 2023-10-18T20:58:46.431 INFO:tasks.workunit.client.0.smithi008.stdout:3/827: mknod d0/d4a/d64/df6/d105/c106 0 2023-10-18T20:58:46.438 INFO:tasks.workunit.client.1.smithi060.stdout:9/858: dwrite d3/d99/d1c/d116/fc8 [0,4194304] 0 2023-10-18T20:58:46.438 INFO:tasks.workunit.client.1.smithi060.stdout:9/859: stat d3/d99 0 2023-10-18T20:58:46.439 INFO:tasks.workunit.client.1.smithi060.stdout:8/901: dread d4/d9/d37/f3c [0,4194304] 0 2023-10-18T20:58:46.439 INFO:tasks.workunit.client.1.smithi060.stdout:8/902: chown d4/d9/d4f/d74/d81/ca8 39981 1 2023-10-18T20:58:46.440 INFO:tasks.workunit.client.1.smithi060.stdout:9/860: creat d3/d99/d1c/d116/d2d/dfc/f137 x:0 0 0 2023-10-18T20:58:46.440 INFO:tasks.workunit.client.1.smithi060.stdout:9/861: fsync d3/d99/d19/d54/f42 0 2023-10-18T20:58:46.441 INFO:tasks.workunit.client.0.smithi008.stdout:1/781: dwrite d9/de/df/d77/fe7 [0,4194304] 0 2023-10-18T20:58:46.442 INFO:tasks.workunit.client.1.smithi060.stdout:9/862: readlink d3/d99/d1c/d116/l39 0 2023-10-18T20:58:46.442 INFO:tasks.workunit.client.1.smithi060.stdout:2/917: dwrite d0/d16/f19 [0,4194304] 0 2023-10-18T20:58:46.442 INFO:tasks.workunit.client.1.smithi060.stdout:2/918: readlink d0/d16/ded/l117 0 2023-10-18T20:58:46.443 INFO:tasks.workunit.client.0.smithi008.stdout:7/742: dwrite d1/d3/d20/d5f/d7f/f8d [4194304,4194304] 0 2023-10-18T20:58:46.444 INFO:tasks.workunit.client.0.smithi008.stdout:7/743: stat d1/d36/d3d/da3 0 2023-10-18T20:58:46.445 INFO:tasks.workunit.client.1.smithi060.stdout:8/903: symlink d4/d9/d31/d6f/dfa/l11b 0 2023-10-18T20:58:46.446 INFO:tasks.workunit.client.0.smithi008.stdout:6/824: rename df/d15/d27 to df/d15/d48/d81/d116 0 2023-10-18T20:58:46.447 INFO:tasks.workunit.client.0.smithi008.stdout:8/904: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/ff6 [0,4194304] 0 2023-10-18T20:58:46.447 INFO:tasks.workunit.client.1.smithi060.stdout:9/863: rmdir d3/d99/d1c/d116/d80/d127/d12e 39 2023-10-18T20:58:46.450 INFO:tasks.workunit.client.0.smithi008.stdout:1/782: creat d9/de/df/d17/d25/d57/ff6 x:0 0 0 2023-10-18T20:58:46.450 INFO:tasks.workunit.client.0.smithi008.stdout:1/783: stat d9/de/df/f7f 0 2023-10-18T20:58:46.450 INFO:tasks.workunit.client.0.smithi008.stdout:1/784: truncate d9/de/df/d17/d1e/f4c 4671038 0 2023-10-18T20:58:46.456 INFO:tasks.workunit.client.0.smithi008.stdout:7/744: creat d1/d36/d3d/d3e/d59/fe6 x:0 0 0 2023-10-18T20:58:46.456 INFO:tasks.workunit.client.0.smithi008.stdout:8/905: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/f148 x:0 0 0 2023-10-18T20:58:46.463 INFO:tasks.workunit.client.0.smithi008.stdout:2/740: rename d1/d3/dd/l36 to d1/d3/dd/d25/d5c/lf5 0 2023-10-18T20:58:46.463 INFO:tasks.workunit.client.0.smithi008.stdout:1/785: rmdir d9/de/df/d17/d25/d94 39 2023-10-18T20:58:46.466 INFO:tasks.workunit.client.1.smithi060.stdout:2/919: rmdir d0/d16/dc8 39 2023-10-18T20:58:46.466 INFO:tasks.workunit.client.0.smithi008.stdout:8/906: rmdir d5/d8/df/d2e/d13b/d12e 0 2023-10-18T20:58:46.468 INFO:tasks.workunit.client.0.smithi008.stdout:1/786: mkdir d9/df7 0 2023-10-18T20:58:46.469 INFO:tasks.workunit.client.1.smithi060.stdout:2/920: creat d0/d3/d9e/dc2/f132 x:0 0 0 2023-10-18T20:58:46.470 INFO:tasks.workunit.client.0.smithi008.stdout:2/741: dread d1/d3/dd/d1c/d3a/d57/f67 [4194304,4194304] 0 2023-10-18T20:58:46.478 INFO:tasks.workunit.client.0.smithi008.stdout:8/907: dread d5/d8/df/d2e/f7b [0,4194304] 0 2023-10-18T20:58:46.479 INFO:tasks.workunit.client.1.smithi060.stdout:2/921: chown d0/d45/d49/d6e 661767573 1 2023-10-18T20:58:46.480 INFO:tasks.workunit.client.1.smithi060.stdout:2/922: chown d0/d45/d49/d55/dae 0 1 2023-10-18T20:58:46.480 INFO:tasks.workunit.client.1.smithi060.stdout:8/904: write d4/d9/d37/f3d [2636881,21774] 0 2023-10-18T20:58:46.485 INFO:tasks.workunit.client.1.smithi060.stdout:3/863: dwrite d0/d3c/d3d/d4d/f6a [4194304,4194304] 0 2023-10-18T20:58:46.485 INFO:tasks.workunit.client.1.smithi060.stdout:0/930: dwrite d3/d8/f54 [0,4194304] 0 2023-10-18T20:58:46.486 INFO:tasks.workunit.client.1.smithi060.stdout:8/905: mkdir d4/d9/d31/d6f/dbd/d11c 0 2023-10-18T20:58:46.486 INFO:tasks.workunit.client.1.smithi060.stdout:0/931: creat d3/d80/db5/f12d x:0 0 0 2023-10-18T20:58:46.486 INFO:tasks.workunit.client.1.smithi060.stdout:0/932: chown d3/d8/d11f/d55/d74/d76/d68/d7f/d8d/dbc/ce1 1 1 2023-10-18T20:58:46.487 INFO:tasks.workunit.client.1.smithi060.stdout:5/946: dwrite d0/d6/d9/d82/d84/db2/db8/f109 [0,4194304] 0 2023-10-18T20:58:46.489 INFO:tasks.workunit.client.0.smithi008.stdout:4/692: dwrite d0/d3/d21/d57/d8f/fdc [0,4194304] 0 2023-10-18T20:58:46.490 INFO:tasks.workunit.client.0.smithi008.stdout:8/908: link d5/d8/df/d2e/d13b/d117/d122/dc4/f109 d5/d8/df/df0/f149 0 2023-10-18T20:58:46.490 INFO:tasks.workunit.client.0.smithi008.stdout:8/909: write d5/d8/df/d2e/d13b/d117/d122/dc4/fcb [1330675,8152] 0 2023-10-18T20:58:46.491 INFO:tasks.workunit.client.0.smithi008.stdout:8/910: chown d5/d8/df/d9d/d4d/f67 706503 1 2023-10-18T20:58:46.491 INFO:tasks.workunit.client.0.smithi008.stdout:2/742: link d1/d3/fd3 d1/d3/dd/d1c/d3a/d45/de1/ff6 0 2023-10-18T20:58:46.491 INFO:tasks.workunit.client.1.smithi060.stdout:8/906: mknod d4/d9/d37/d4e/dd9/ddf/c11d 0 2023-10-18T20:58:46.492 INFO:tasks.workunit.client.1.smithi060.stdout:8/907: truncate d4/d9/d4f/d74/d81/f94 4975352 0 2023-10-18T20:58:46.492 INFO:tasks.workunit.client.0.smithi008.stdout:3/828: dread d0/d4a/fd2 [0,4194304] 0 2023-10-18T20:58:46.493 INFO:tasks.workunit.client.1.smithi060.stdout:5/947: read d0/da/d61/f7f [678544,73169] 0 2023-10-18T20:58:46.493 INFO:tasks.workunit.client.1.smithi060.stdout:5/948: fdatasync d0/da/dc8/de4/f135 0 2023-10-18T20:58:46.494 INFO:tasks.workunit.client.1.smithi060.stdout:3/864: mkdir d0/d3c/d3d/d4d/d95/d123/d12e 0 2023-10-18T20:58:46.494 INFO:tasks.workunit.client.1.smithi060.stdout:3/865: fsync d0/d22/d26/d29/dae/de4/ff7 0 2023-10-18T20:58:46.494 INFO:tasks.workunit.client.1.smithi060.stdout:0/933: mknod d3/d8/d11f/d55/d74/d76/d6b/c12e 0 2023-10-18T20:58:46.500 INFO:tasks.workunit.client.0.smithi008.stdout:9/658: sync 2023-10-18T20:58:46.501 INFO:tasks.workunit.client.0.smithi008.stdout:6/825: getdents df/d15 0 2023-10-18T20:58:46.501 INFO:tasks.workunit.client.0.smithi008.stdout:5/733: sync 2023-10-18T20:58:46.501 INFO:tasks.workunit.client.0.smithi008.stdout:4/693: mkdir d0/d3/d21/d57/d8f/d82/de8 0 2023-10-18T20:58:46.502 INFO:tasks.workunit.client.0.smithi008.stdout:2/743: rename d1/d3/dd/d1c/d3a/f3d to d1/d3/dd/d25/d76/d59/dce/ff7 0 2023-10-18T20:58:46.503 INFO:tasks.workunit.client.0.smithi008.stdout:6/826: creat df/d15/d48/d81/d116/d4c/f117 x:0 0 0 2023-10-18T20:58:46.506 INFO:tasks.workunit.client.0.smithi008.stdout:5/734: mknod d0/d2/de6/c10a 0 2023-10-18T20:58:46.510 INFO:tasks.workunit.client.0.smithi008.stdout:2/744: unlink d1/d3/dd/d25/d76/d59/d85/fb8 0 2023-10-18T20:58:46.511 INFO:tasks.workunit.client.1.smithi060.stdout:5/949: creat d0/da/dc8/f149 x:0 0 0 2023-10-18T20:58:46.511 INFO:tasks.workunit.client.1.smithi060.stdout:5/950: stat d0/da/dc8/de4/d6d/db6 0 2023-10-18T20:58:46.512 INFO:tasks.workunit.client.0.smithi008.stdout:6/827: link df/d15/d48/ded/d108/dcf/d58/cc1 df/d15/d48/d81/c118 0 2023-10-18T20:58:46.512 INFO:tasks.workunit.client.0.smithi008.stdout:6/828: getdents df/d15/d48/ded/d108/dcf/d7e 0 2023-10-18T20:58:46.517 INFO:tasks.workunit.client.0.smithi008.stdout:5/735: creat d0/d2/d9/f10b x:0 0 0 2023-10-18T20:58:46.517 INFO:tasks.workunit.client.0.smithi008.stdout:4/694: getdents d0/d3 0 2023-10-18T20:58:46.518 INFO:tasks.workunit.client.1.smithi060.stdout:3/866: rmdir d0/d22 39 2023-10-18T20:58:46.519 INFO:tasks.workunit.client.1.smithi060.stdout:3/867: read - d0/d22/d26/d29/dae/fcc zero size 2023-10-18T20:58:46.519 INFO:tasks.workunit.client.0.smithi008.stdout:9/659: write d2/dc/d1a/f5b [650030,66183] 0 2023-10-18T20:58:46.521 INFO:tasks.workunit.client.0.smithi008.stdout:9/660: read d2/dc/f1c [638541,97524] 0 2023-10-18T20:58:46.522 INFO:tasks.workunit.client.0.smithi008.stdout:2/745: rmdir d1/d3/dd/d25/db2/de2 0 2023-10-18T20:58:46.527 INFO:tasks.workunit.client.1.smithi060.stdout:0/934: write d3/d8/d11f/f3e [738319,7146] 0 2023-10-18T20:58:46.529 INFO:tasks.workunit.client.0.smithi008.stdout:0/656: dwrite d0/d7c/d9a/d8a/d8f/f77 [0,4194304] 0 2023-10-18T20:58:46.530 INFO:tasks.workunit.client.1.smithi060.stdout:7/975: dwrite de/d14/d49/da3/fbe [0,4194304] 0 2023-10-18T20:58:46.532 INFO:tasks.workunit.client.1.smithi060.stdout:5/951: mkdir d0/dd/dd7/d129/d14a 0 2023-10-18T20:58:46.532 INFO:tasks.workunit.client.1.smithi060.stdout:5/952: fsync d0/da/dc8/de4/d4f/f68 0 2023-10-18T20:58:46.532 INFO:tasks.workunit.client.0.smithi008.stdout:8/911: dread d5/d8/df/d9d/d4d/dba/dd4/d50/f6a [0,4194304] 0 2023-10-18T20:58:46.534 INFO:tasks.workunit.client.1.smithi060.stdout:4/909: sync 2023-10-18T20:58:46.534 INFO:tasks.workunit.client.1.smithi060.stdout:3/868: creat d0/d22/d26/d29/dae/f12f x:0 0 0 2023-10-18T20:58:46.535 INFO:tasks.workunit.client.1.smithi060.stdout:6/912: sync 2023-10-18T20:58:46.535 INFO:tasks.workunit.client.1.smithi060.stdout:3/869: truncate d0/d3c/d3d/d4d/d95/ffc 917891 0 2023-10-18T20:58:46.536 INFO:tasks.workunit.client.1.smithi060.stdout:9/864: dwrite d3/d99/d1c/d116/d80/da0/dc2/d9e/dfd/f12c [0,4194304] 0 2023-10-18T20:58:46.536 INFO:tasks.workunit.client.1.smithi060.stdout:9/865: chown d3/d99/d19/d54/f42 349 1 2023-10-18T20:58:46.537 INFO:tasks.workunit.client.0.smithi008.stdout:9/661: rename d2/dc/d40/d5a to d2/dc/d40/d5a/dc1 22 2023-10-18T20:58:46.538 INFO:tasks.workunit.client.0.smithi008.stdout:7/745: dwrite d1/d36/d3d/da3/fa9 [0,4194304] 0 2023-10-18T20:58:46.539 INFO:tasks.workunit.client.1.smithi060.stdout:0/935: rename d3/d8/d3c/l6e to d3/d8/d11f/d55/d74/d76/d6b/l12f 0 2023-10-18T20:58:46.543 INFO:tasks.workunit.client.0.smithi008.stdout:9/662: unlink d2/dc/d40/d6f/d92/d59/f5d 0 2023-10-18T20:58:46.544 INFO:tasks.workunit.client.1.smithi060.stdout:7/976: link de/d29/l39 de/d14/d49/da3/l140 0 2023-10-18T20:58:46.544 INFO:tasks.workunit.client.1.smithi060.stdout:6/913: mkdir d10/d17/d70/dba/d10b/d120/dd6/d122 0 2023-10-18T20:58:46.545 INFO:tasks.workunit.client.1.smithi060.stdout:6/914: fdatasync d10/d25/fc5 0 2023-10-18T20:58:46.546 INFO:tasks.workunit.client.0.smithi008.stdout:2/746: rename d1/d3/dd/d1c/d3a/d45/l93 to d1/d3/dd/d25/d76/d59/d85/lf8 0 2023-10-18T20:58:46.549 INFO:tasks.workunit.client.1.smithi060.stdout:0/936: readlink d3/d8/l4d 0 2023-10-18T20:58:46.549 INFO:tasks.workunit.client.1.smithi060.stdout:9/866: unlink d3/d99/l17 0 2023-10-18T20:58:46.550 INFO:tasks.workunit.client.1.smithi060.stdout:9/867: dread - d3/d99/d1c/d116/d80/fc5 zero size 2023-10-18T20:58:46.550 INFO:tasks.workunit.client.1.smithi060.stdout:9/868: chown d3/d99/d1c/d5a/f8d 1160 1 2023-10-18T20:58:46.551 INFO:tasks.workunit.client.1.smithi060.stdout:7/977: creat de/d14/d41/f141 x:0 0 0 2023-10-18T20:58:46.551 INFO:tasks.workunit.client.0.smithi008.stdout:7/746: mkdir d1/d3/d20/de7 0 2023-10-18T20:58:46.552 INFO:tasks.workunit.client.1.smithi060.stdout:6/915: symlink d10/d17/d28/l123 0 2023-10-18T20:58:46.557 INFO:tasks.workunit.client.1.smithi060.stdout:0/937: unlink d3/fd2 0 2023-10-18T20:58:46.558 INFO:tasks.workunit.client.1.smithi060.stdout:5/953: dread d0/d47/d7d/da0/f120 [0,4194304] 0 2023-10-18T20:58:46.558 INFO:tasks.workunit.client.1.smithi060.stdout:5/954: fsync d0/da/d3b/fbe 0 2023-10-18T20:58:46.558 INFO:tasks.workunit.client.1.smithi060.stdout:5/955: chown d0/d6/f11f 43028104 1 2023-10-18T20:58:46.558 INFO:tasks.workunit.client.1.smithi060.stdout:7/978: creat de/d29/d72/f142 x:0 0 0 2023-10-18T20:58:46.558 INFO:tasks.workunit.client.1.smithi060.stdout:7/979: truncate de/d14/d2f/d3f/d5a/d5f/fe4 290473 0 2023-10-18T20:58:46.561 INFO:tasks.workunit.client.1.smithi060.stdout:5/956: creat d0/d47/f14b x:0 0 0 2023-10-18T20:58:46.564 INFO:tasks.workunit.client.1.smithi060.stdout:6/916: creat d10/d2e/d11e/f124 x:0 0 0 2023-10-18T20:58:46.567 INFO:tasks.workunit.client.0.smithi008.stdout:9/663: mkdir d2/d4d/dc2 0 2023-10-18T20:58:46.570 INFO:tasks.workunit.client.0.smithi008.stdout:4/695: dwrite d0/d3/d21/f5a [0,4194304] 0 2023-10-18T20:58:46.570 INFO:tasks.workunit.client.0.smithi008.stdout:4/696: chown d0/d3/fb5 42296269 1 2023-10-18T20:58:46.574 INFO:tasks.workunit.client.0.smithi008.stdout:0/657: rename d0/dd/df/l53 to d0/dd/d19/d5f/d99/d94/lcd 0 2023-10-18T20:58:46.574 INFO:tasks.workunit.client.0.smithi008.stdout:0/658: chown d0/dd/d19/d5f/d99/f2d 234857 1 2023-10-18T20:58:46.574 INFO:tasks.workunit.client.0.smithi008.stdout:0/659: read d0/dd/d19/d5f/d99/f38 [499368,67777] 0 2023-10-18T20:58:46.584 INFO:tasks.workunit.client.0.smithi008.stdout:6/829: dread df/d15/d48/d81/d116/f63 [0,4194304] 0 2023-10-18T20:58:46.585 INFO:tasks.workunit.client.1.smithi060.stdout:0/938: read d3/d8/d11f/d55/d74/d76/d68/f92 [3405304,121348] 0 2023-10-18T20:58:46.586 INFO:tasks.workunit.client.0.smithi008.stdout:3/829: dwrite d0/d3/d37/f4c [0,4194304] 0 2023-10-18T20:58:46.588 INFO:tasks.workunit.client.0.smithi008.stdout:9/664: unlink d2/dc/d40/d6f/f80 0 2023-10-18T20:58:46.588 INFO:tasks.workunit.client.0.smithi008.stdout:9/665: chown d2/dc/d40/d46 61 1 2023-10-18T20:58:46.593 INFO:tasks.workunit.client.0.smithi008.stdout:2/747: rename d1/d3/dd/d25/d76/fd4 to d1/d3/d40/d6e/d7e/db3/ff9 0 2023-10-18T20:58:46.593 INFO:tasks.workunit.client.0.smithi008.stdout:2/748: chown d1/d3/dd/ff2 17 1 2023-10-18T20:58:46.594 INFO:tasks.workunit.client.0.smithi008.stdout:6/830: mkdir df/d15/d48/ded/d108/dcf/d68/db9/d119 0 2023-10-18T20:58:46.607 INFO:tasks.workunit.client.1.smithi060.stdout:2/923: dwrite d0/d16/d85/de3/f10b [0,4194304] 0 2023-10-18T20:58:46.608 INFO:tasks.workunit.client.0.smithi008.stdout:3/830: getdents d0/d4a/d64/d80 0 2023-10-18T20:58:46.611 INFO:tasks.workunit.client.1.smithi060.stdout:2/924: getdents d0/d16/d81/da1 0 2023-10-18T20:58:46.613 INFO:tasks.workunit.client.1.smithi060.stdout:2/925: mknod d0/d3/d9e/c133 0 2023-10-18T20:58:46.616 INFO:tasks.workunit.client.1.smithi060.stdout:2/926: mknod d0/d45/dc9/de6/c134 0 2023-10-18T20:58:46.616 INFO:tasks.workunit.client.1.smithi060.stdout:2/927: write d0/d3/d27/d4d/d5e/d96/fa6 [21439,32741] 0 2023-10-18T20:58:46.616 INFO:tasks.workunit.client.1.smithi060.stdout:2/928: write d0/f65 [1715211,38277] 0 2023-10-18T20:58:46.618 INFO:tasks.workunit.client.1.smithi060.stdout:2/929: symlink d0/d3/l135 0 2023-10-18T20:58:46.618 INFO:tasks.workunit.client.1.smithi060.stdout:2/930: fdatasync d0/d45/fb5 0 2023-10-18T20:58:46.620 INFO:tasks.workunit.client.1.smithi060.stdout:2/931: mknod d0/d45/d49/d6e/c136 0 2023-10-18T20:58:46.621 INFO:tasks.workunit.client.0.smithi008.stdout:0/660: rmdir d0/d7c 39 2023-10-18T20:58:46.621 INFO:tasks.workunit.client.0.smithi008.stdout:0/661: fdatasync d0/d7c/f63 0 2023-10-18T20:58:46.623 INFO:tasks.workunit.client.1.smithi060.stdout:2/932: read d0/d8/d47/fcc [740345,83731] 0 2023-10-18T20:58:46.625 INFO:tasks.workunit.client.1.smithi060.stdout:2/933: mknod d0/d45/d129/c137 0 2023-10-18T20:58:46.625 INFO:tasks.workunit.client.0.smithi008.stdout:3/831: dread d0/d4a/f5b [0,4194304] 0 2023-10-18T20:58:46.626 INFO:tasks.workunit.client.0.smithi008.stdout:3/832: dread - d0/d3/d37/f78 zero size 2023-10-18T20:58:46.629 INFO:tasks.workunit.client.1.smithi060.stdout:2/934: mknod d0/d45/d49/c138 0 2023-10-18T20:58:46.630 INFO:tasks.workunit.client.0.smithi008.stdout:3/833: unlink d0/d4a/d64/fd3 0 2023-10-18T20:58:46.630 INFO:tasks.workunit.client.0.smithi008.stdout:3/834: dread - d0/d3/de/d13/ff8 zero size 2023-10-18T20:58:46.641 INFO:tasks.workunit.client.1.smithi060.stdout:2/935: dread d0/d45/d49/d55/dae/fbb [0,4194304] 0 2023-10-18T20:58:46.642 INFO:tasks.workunit.client.0.smithi008.stdout:3/835: getdents d0/d3/da9 0 2023-10-18T20:58:46.644 INFO:tasks.workunit.client.0.smithi008.stdout:0/662: write d0/dd/d19/d5f/d99/f80 [4044187,51947] 0 2023-10-18T20:58:46.645 INFO:tasks.workunit.client.0.smithi008.stdout:3/836: getdents d0/d3/d37/da6 0 2023-10-18T20:58:46.646 INFO:tasks.workunit.client.1.smithi060.stdout:7/980: dwrite de/d14/d49/d68/d106/f131 [0,4194304] 0 2023-10-18T20:58:46.646 INFO:tasks.workunit.client.1.smithi060.stdout:5/957: dwrite d0/da/dc8/de4/d4f/f68 [4194304,4194304] 0 2023-10-18T20:58:46.647 INFO:tasks.workunit.client.1.smithi060.stdout:7/981: truncate de/d14/d2f/d3f/d5a/f136 515832 0 2023-10-18T20:58:46.648 INFO:tasks.workunit.client.0.smithi008.stdout:3/837: symlink d0/l107 0 2023-10-18T20:58:46.649 INFO:tasks.workunit.client.1.smithi060.stdout:5/958: unlink d0/dd/d76/d10f/da5/d67/cfb 0 2023-10-18T20:58:46.650 INFO:tasks.workunit.client.1.smithi060.stdout:7/982: symlink de/d14/d49/d68/l143 0 2023-10-18T20:58:46.652 INFO:tasks.workunit.client.0.smithi008.stdout:0/663: truncate d0/d7c/d9a/d8a/d8f/f62 1989425 0 2023-10-18T20:58:46.654 INFO:tasks.workunit.client.0.smithi008.stdout:3/838: link d0/d3/cc d0/d4a/c108 0 2023-10-18T20:58:46.657 INFO:tasks.workunit.client.1.smithi060.stdout:7/983: fsync de/d14/d41/f10d 0 2023-10-18T20:58:46.658 INFO:tasks.workunit.client.1.smithi060.stdout:7/984: getdents de/d14/d41/d125 0 2023-10-18T20:58:46.658 INFO:tasks.workunit.client.1.smithi060.stdout:7/985: fsync de/d14/d49/d68/fef 0 2023-10-18T20:58:46.658 INFO:tasks.workunit.client.0.smithi008.stdout:0/664: mkdir d0/d7c/d9a/dce 0 2023-10-18T20:58:46.659 INFO:tasks.workunit.client.1.smithi060.stdout:7/986: creat de/d29/d9c/db1/f144 x:0 0 0 2023-10-18T20:58:46.660 INFO:tasks.workunit.client.1.smithi060.stdout:7/987: chown de/d14/d3a/d46/d73 266120 1 2023-10-18T20:58:46.662 INFO:tasks.workunit.client.0.smithi008.stdout:8/912: dwrite d5/d8/df/d9d/d85/db1/d137/f135 [0,4194304] 0 2023-10-18T20:58:46.662 INFO:tasks.workunit.client.0.smithi008.stdout:5/736: dwrite d0/d86/f8c [0,4194304] 0 2023-10-18T20:58:46.662 INFO:tasks.workunit.client.0.smithi008.stdout:5/737: fdatasync d0/d86/fe9 0 2023-10-18T20:58:46.668 INFO:tasks.workunit.client.0.smithi008.stdout:3/839: unlink d0/d3/c39 0 2023-10-18T20:58:46.674 INFO:tasks.workunit.client.0.smithi008.stdout:6/831: dwrite df/d15/d48/ded/d108/dcf/d68/f6e [4194304,4194304] 0 2023-10-18T20:58:46.674 INFO:tasks.workunit.client.0.smithi008.stdout:6/832: truncate df/d15/d48/ded/d108/dcf/d3f/f93 1249984 0 2023-10-18T20:58:46.679 INFO:tasks.workunit.client.0.smithi008.stdout:1/787: dwrite d9/de/df/d17/d25/d57/fac [0,4194304] 0 2023-10-18T20:58:46.682 INFO:tasks.workunit.client.0.smithi008.stdout:8/913: write d5/f15 [1525536,19915] 0 2023-10-18T20:58:46.682 INFO:tasks.workunit.client.0.smithi008.stdout:8/914: write d5/d8/df/f29 [615151,198] 0 2023-10-18T20:58:46.686 INFO:tasks.workunit.client.0.smithi008.stdout:0/665: symlink d0/dd/d19/lcf 0 2023-10-18T20:58:46.686 INFO:tasks.workunit.client.0.smithi008.stdout:0/666: write d0/d3a/f5c [169218,75609] 0 2023-10-18T20:58:46.686 INFO:tasks.workunit.client.0.smithi008.stdout:5/738: mknod d0/d2/d19/d7c/d31/c10c 0 2023-10-18T20:58:46.687 INFO:tasks.workunit.client.0.smithi008.stdout:5/739: creat d0/d2/f10d x:0 0 0 2023-10-18T20:58:46.687 INFO:tasks.workunit.client.0.smithi008.stdout:5/740: getdents d0/d2/d19/d7c/da7 0 2023-10-18T20:58:46.687 INFO:tasks.workunit.client.1.smithi060.stdout:7/988: dread de/d29/f31 [0,4194304] 0 2023-10-18T20:58:46.688 INFO:tasks.workunit.client.1.smithi060.stdout:7/989: read - de/d14/d49/ff1 zero size 2023-10-18T20:58:46.688 INFO:tasks.workunit.client.1.smithi060.stdout:3/870: dwrite d0/d22/d26/d8c/fbb [4194304,4194304] 0 2023-10-18T20:58:46.689 INFO:tasks.workunit.client.1.smithi060.stdout:3/871: fsync d0/d22/d26/d79/f113 0 2023-10-18T20:58:46.689 INFO:tasks.workunit.client.1.smithi060.stdout:3/872: write d0/fd [4134190,95934] 0 2023-10-18T20:58:46.689 INFO:tasks.workunit.client.1.smithi060.stdout:6/917: dwrite d10/d25/fc5 [0,4194304] 0 2023-10-18T20:58:46.692 INFO:tasks.workunit.client.1.smithi060.stdout:3/873: truncate d0/f1d 3709281 0 2023-10-18T20:58:46.692 INFO:tasks.workunit.client.0.smithi008.stdout:4/697: dwrite d0/d58/d8e/db4/fc4 [0,4194304] 0 2023-10-18T20:58:46.696 INFO:tasks.workunit.client.1.smithi060.stdout:6/918: rename d10/f51 to d10/d17/d54/f125 0 2023-10-18T20:58:46.700 INFO:tasks.workunit.client.0.smithi008.stdout:6/833: unlink df/d15/d48/d81/d116/l9f 0 2023-10-18T20:58:46.703 INFO:tasks.workunit.client.0.smithi008.stdout:6/834: dread - df/d15/d48/d81/f96 zero size 2023-10-18T20:58:46.704 INFO:tasks.workunit.client.0.smithi008.stdout:6/835: stat df/d15/d48/ded/d108/dcf/d58/dec/daa/dcb 0 2023-10-18T20:58:46.704 INFO:tasks.workunit.client.0.smithi008.stdout:6/836: stat df/d15/fc0 0 2023-10-18T20:58:46.705 INFO:tasks.workunit.client.1.smithi060.stdout:5/959: write d0/d6/d9/d82/d84/db2/d2a/fce [14726631,84552] 0 2023-10-18T20:58:46.705 INFO:tasks.workunit.client.1.smithi060.stdout:5/960: chown d0/dd/d76/d10f/da5/d67/ldd 2994 1 2023-10-18T20:58:46.705 INFO:tasks.workunit.client.1.smithi060.stdout:3/874: truncate d0/d22/d26/d29/dae/de4/f118 1831348 0 2023-10-18T20:58:46.706 INFO:tasks.workunit.client.1.smithi060.stdout:3/875: dread - d0/d22/d26/f6d zero size 2023-10-18T20:58:46.708 INFO:tasks.workunit.client.1.smithi060.stdout:2/936: dwrite d0/d8/f8a [0,4194304] 0 2023-10-18T20:58:46.712 INFO:tasks.workunit.client.1.smithi060.stdout:8/908: dwrite d4/f13 [4194304,4194304] 0 2023-10-18T20:58:46.713 INFO:tasks.workunit.client.0.smithi008.stdout:0/667: getdents d0/d7c/d9a/d8a/d8f 0 2023-10-18T20:58:46.715 INFO:tasks.workunit.client.0.smithi008.stdout:5/741: creat d0/d86/f10e x:0 0 0 2023-10-18T20:58:46.715 INFO:tasks.workunit.client.0.smithi008.stdout:5/742: stat d0/d2/d19/l7b 0 2023-10-18T20:58:46.716 INFO:tasks.workunit.client.1.smithi060.stdout:8/909: rmdir d4/d9/d31/d35/d9f/da3/dd8/d10f/d112 0 2023-10-18T20:58:46.725 INFO:tasks.workunit.client.0.smithi008.stdout:4/698: symlink d0/d17/d5b/d45/le9 0 2023-10-18T20:58:46.725 INFO:tasks.workunit.client.0.smithi008.stdout:4/699: fsync d0/d58/d8e/dd2/fe2 0 2023-10-18T20:58:46.730 INFO:tasks.workunit.client.1.smithi060.stdout:8/910: rename d4/f25 to d4/d9/d31/d35/d9f/da3/dd8/f11e 0 2023-10-18T20:58:46.732 INFO:tasks.workunit.client.0.smithi008.stdout:1/788: dwrite d9/de/df/d17/d55/f79 [0,4194304] 0 2023-10-18T20:58:46.737 INFO:tasks.workunit.client.1.smithi060.stdout:9/869: dwrite d3/d99/d1c/d5a/f97 [0,4194304] 0 2023-10-18T20:58:46.738 INFO:tasks.workunit.client.1.smithi060.stdout:9/870: mkdir d3/d99/d19/d138 0 2023-10-18T20:58:46.739 INFO:tasks.workunit.client.1.smithi060.stdout:9/871: creat d3/d99/d1c/d25/f139 x:0 0 0 2023-10-18T20:58:46.739 INFO:tasks.workunit.client.1.smithi060.stdout:9/872: write d3/d99/d1c/f113 [96384,115593] 0 2023-10-18T20:58:46.739 INFO:tasks.workunit.client.1.smithi060.stdout:6/919: dread d10/d17/d54/dd4/fb6 [4194304,4194304] 0 2023-10-18T20:58:46.740 INFO:tasks.workunit.client.0.smithi008.stdout:7/747: rename d1/d3/d20 to d1/d36/d3d/da3/de8 0 2023-10-18T20:58:46.740 INFO:tasks.workunit.client.0.smithi008.stdout:7/748: getdents d1/d36/d3d/da3/de8/de7 0 2023-10-18T20:58:46.741 INFO:tasks.workunit.client.0.smithi008.stdout:7/749: write d1/d36/d3d/da3/de8/d5f/d7f/f9a [1785032,13616] 0 2023-10-18T20:58:46.741 INFO:tasks.workunit.client.1.smithi060.stdout:9/873: mknod d3/d99/d19/d138/c13a 0 2023-10-18T20:58:46.744 INFO:tasks.workunit.client.0.smithi008.stdout:3/840: dwrite d0/f54 [8388608,4194304] 0 2023-10-18T20:58:46.749 INFO:tasks.workunit.client.1.smithi060.stdout:9/874: rename d3/d99/d1c/d116/d2d/db9/fd3 to d3/d99/d1c/d116/d80/da0/dc2/d9e/f13b 0 2023-10-18T20:58:46.749 INFO:tasks.workunit.client.1.smithi060.stdout:9/875: fsync d3/f20 0 2023-10-18T20:58:46.749 INFO:tasks.workunit.client.1.smithi060.stdout:6/920: rmdir d10/d25 39 2023-10-18T20:58:46.754 INFO:tasks.workunit.client.1.smithi060.stdout:5/961: dread d0/d6/f6a [0,4194304] 0 2023-10-18T20:58:46.757 INFO:tasks.workunit.client.1.smithi060.stdout:5/962: mkdir d0/d6/d9/d82/d83/deb/d14c 0 2023-10-18T20:58:46.758 INFO:tasks.workunit.client.1.smithi060.stdout:5/963: chown d0/d6/d8/f6b 582556907 1 2023-10-18T20:58:46.760 INFO:tasks.workunit.client.1.smithi060.stdout:5/964: creat d0/d6/d9/f14d x:0 0 0 2023-10-18T20:58:46.762 INFO:tasks.workunit.client.1.smithi060.stdout:5/965: symlink d0/da/dc8/de4/d4f/d136/l14e 0 2023-10-18T20:58:46.764 INFO:tasks.workunit.client.1.smithi060.stdout:7/990: dwrite de/ff [0,4194304] 0 2023-10-18T20:58:46.764 INFO:tasks.workunit.client.1.smithi060.stdout:7/991: stat de/d14/d3a/d46/d73/l89 0 2023-10-18T20:58:46.767 INFO:tasks.workunit.client.1.smithi060.stdout:2/937: dwrite d0/d45/dc9/f8e [0,4194304] 0 2023-10-18T20:58:46.772 INFO:tasks.workunit.client.1.smithi060.stdout:7/992: link de/d14/l93 de/d14/d49/l145 0 2023-10-18T20:58:46.772 INFO:tasks.workunit.client.1.smithi060.stdout:7/993: write de/d38/f138 [755147,28644] 0 2023-10-18T20:58:46.772 INFO:tasks.workunit.client.1.smithi060.stdout:6/921: dread d10/d17/d28/f26 [0,4194304] 0 2023-10-18T20:58:46.773 INFO:tasks.workunit.client.1.smithi060.stdout:7/994: mknod de/d29/d9c/c146 0 2023-10-18T20:58:46.774 INFO:tasks.workunit.client.1.smithi060.stdout:6/922: rename d10/d25/df2/f110 to d10/d17/d28/d11b/f126 0 2023-10-18T20:58:46.775 INFO:tasks.workunit.client.0.smithi008.stdout:5/743: mknod d0/d2/d19/d7c/d31/d80/d91/c10f 0 2023-10-18T20:58:46.775 INFO:tasks.workunit.client.1.smithi060.stdout:7/995: creat de/d14/d2f/d7b/f147 x:0 0 0 2023-10-18T20:58:46.775 INFO:tasks.workunit.client.1.smithi060.stdout:7/996: getdents de/d14/d3a/d46/dab/d116/dff 0 2023-10-18T20:58:46.777 INFO:tasks.workunit.client.1.smithi060.stdout:6/923: rmdir d10/d47/d92/dab/dfe 39 2023-10-18T20:58:46.778 INFO:tasks.workunit.client.1.smithi060.stdout:7/997: symlink de/d14/d49/d68/d7d/d7e/db5/l148 0 2023-10-18T20:58:46.779 INFO:tasks.workunit.client.1.smithi060.stdout:6/924: stat d10/d17/d2f/f7d 0 2023-10-18T20:58:46.781 INFO:tasks.workunit.client.1.smithi060.stdout:6/925: creat d10/d17/d70/dba/d10b/f127 x:0 0 0 2023-10-18T20:58:46.785 INFO:tasks.workunit.client.0.smithi008.stdout:8/915: dwrite d5/d8/df/d9d/d4d/dba/dd4/d77/fa5 [0,4194304] 0 2023-10-18T20:58:46.787 INFO:tasks.workunit.client.0.smithi008.stdout:9/666: rename d2/d8/cae to d2/dc/d17/d7b/cc3 0 2023-10-18T20:58:46.791 INFO:tasks.workunit.client.0.smithi008.stdout:5/744: dread d0/d2/d19/fc7 [0,4194304] 0 2023-10-18T20:58:46.797 INFO:tasks.workunit.client.1.smithi060.stdout:7/998: write de/d29/d72/fa8 [1547560,49153] 0 2023-10-18T20:58:46.816 INFO:tasks.workunit.client.0.smithi008.stdout:8/916: creat d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/df5/f14a x:0 0 0 2023-10-18T20:58:46.824 INFO:tasks.workunit.client.0.smithi008.stdout:7/750: dwrite d1/d36/d3d/fab [0,4194304] 0 2023-10-18T20:58:46.828 INFO:tasks.workunit.client.0.smithi008.stdout:3/841: write d0/d3/d42/fb0 [268699,27237] 0 2023-10-18T20:58:46.828 INFO:tasks.workunit.client.0.smithi008.stdout:3/842: stat d0/d3/d37/ldf 0 2023-10-18T20:58:46.828 INFO:tasks.workunit.client.0.smithi008.stdout:3/843: chown d0/d3/d37/ldf 7449 1 2023-10-18T20:58:46.831 INFO:tasks.workunit.client.0.smithi008.stdout:2/749: rename d1/d3/d40/d6e/d7e/cc1 to d1/d3/dd/d1c/d3a/d45/de1/cfa 0 2023-10-18T20:58:46.831 INFO:tasks.workunit.client.0.smithi008.stdout:5/745: mknod d0/d2/de6/c110 0 2023-10-18T20:58:46.832 INFO:tasks.workunit.client.0.smithi008.stdout:5/746: stat d0/d2/d19/d7c/d58/d65/f94 0 2023-10-18T20:58:46.836 INFO:tasks.workunit.client.0.smithi008.stdout:1/789: rmdir d9/de/df/d17/d1e/d9a 39 2023-10-18T20:58:46.837 INFO:tasks.workunit.client.0.smithi008.stdout:1/790: write d9/de/df/d17/d1e/d3c/fb6 [1123855,62464] 0 2023-10-18T20:58:46.842 INFO:tasks.workunit.client.0.smithi008.stdout:0/668: dread d0/dd/f27 [0,4194304] 0 2023-10-18T20:58:46.842 INFO:tasks.workunit.client.0.smithi008.stdout:0/669: fsync d0/dd/d19/d5f/d99/d94/f50 0 2023-10-18T20:58:46.842 INFO:tasks.workunit.client.0.smithi008.stdout:0/670: fdatasync d0/dd/df/faa 0 2023-10-18T20:58:46.843 INFO:tasks.workunit.client.0.smithi008.stdout:0/671: write d0/dd/f8b [1690184,10233] 0 2023-10-18T20:58:46.843 INFO:tasks.workunit.client.0.smithi008.stdout:0/672: chown d0/d7c/d9a/d8a/d8f/d21/fad 2 1 2023-10-18T20:58:46.844 INFO:tasks.workunit.client.1.smithi060.stdout:7/999: write de/d14/f97 [4115536,105100] 0 2023-10-18T20:58:46.844 INFO:tasks.workunit.client.1.smithi060.stdout:8/911: dwrite d4/d9/d31/d6f/dfa/d7b/f118 [0,4194304] 0 2023-10-18T20:58:46.844 INFO:tasks.workunit.client.1.smithi060.stdout:3/876: dwrite d0/d3c/d3d/f7b [0,4194304] 0 2023-10-18T20:58:46.845 INFO:tasks.workunit.client.1.smithi060.stdout:8/912: chown d4/d9/d4f/d74/d81/db8/ld6 7 1 2023-10-18T20:58:46.845 INFO:tasks.workunit.client.1.smithi060.stdout:3/877: creat d0/d22/d26/f130 x:0 0 0 2023-10-18T20:58:46.845 INFO:tasks.workunit.client.1.smithi060.stdout:3/878: write d0/d22/d26/d2c/f62 [3531519,92210] 0 2023-10-18T20:58:46.845 INFO:tasks.workunit.client.1.smithi060.stdout:3/879: fdatasync d0/d22/f70 0 2023-10-18T20:58:46.846 INFO:tasks.workunit.client.0.smithi008.stdout:5/747: write d0/f8 [803267,16855] 0 2023-10-18T20:58:46.846 INFO:tasks.workunit.client.1.smithi060.stdout:5/966: dwrite d0/d6/d9/f14d [0,4194304] 0 2023-10-18T20:58:46.848 INFO:tasks.workunit.client.0.smithi008.stdout:6/837: dwrite df/d3c/d77/fb3 [0,4194304] 0 2023-10-18T20:58:46.850 INFO:tasks.workunit.client.1.smithi060.stdout:2/938: dwrite d0/d45/d49/d55/dae/fbb [0,4194304] 0 2023-10-18T20:58:46.850 INFO:tasks.workunit.client.1.smithi060.stdout:2/939: read d0/d45/d49/d6e/d79/d6c/f75 [1209999,65847] 0 2023-10-18T20:58:46.853 INFO:tasks.workunit.client.1.smithi060.stdout:3/880: rmdir d0/d22/d26/d29 39 2023-10-18T20:58:46.854 INFO:tasks.workunit.client.1.smithi060.stdout:3/881: write d0/d22/d26/f6d [299602,92311] 0 2023-10-18T20:58:46.854 INFO:tasks.workunit.client.0.smithi008.stdout:4/700: dwrite d0/d3/d21/d57/d8f/d95/fd1 [0,4194304] 0 2023-10-18T20:58:46.854 INFO:tasks.workunit.client.0.smithi008.stdout:4/701: readlink d0/d3/d21/d57/d8f/la4 0 2023-10-18T20:58:46.856 INFO:tasks.workunit.client.1.smithi060.stdout:5/967: mknod d0/da/dc8/de4/d4f/d137/c14f 0 2023-10-18T20:58:46.860 INFO:tasks.workunit.client.1.smithi060.stdout:2/940: getdents d0/d45/d49/d6e 0 2023-10-18T20:58:46.861 INFO:tasks.workunit.client.1.smithi060.stdout:2/941: unlink d0/d45/dc9/d4a/cff 0 2023-10-18T20:58:46.861 INFO:tasks.workunit.client.1.smithi060.stdout:3/882: truncate d0/d22/d26/f61 3420464 0 2023-10-18T20:58:46.863 INFO:tasks.workunit.client.0.smithi008.stdout:3/844: symlink d0/d3/d37/d74/df5/l109 0 2023-10-18T20:58:46.864 INFO:tasks.workunit.client.0.smithi008.stdout:7/751: creat d1/d36/d3d/da3/de8/d5f/d78/fe9 x:0 0 0 2023-10-18T20:58:46.875 INFO:tasks.workunit.client.1.smithi060.stdout:6/926: dwrite d10/d17/d70/dba/d10b/d120/dd6/f116 [0,4194304] 0 2023-10-18T20:58:46.875 INFO:tasks.workunit.client.1.smithi060.stdout:6/927: chown d10/d25/d3c/l53 39257 1 2023-10-18T20:58:46.875 INFO:tasks.workunit.client.1.smithi060.stdout:6/928: write d10/d17/dae/ff9 [552601,12403] 0 2023-10-18T20:58:46.876 INFO:tasks.workunit.client.1.smithi060.stdout:6/929: fsync d10/d17/d2f/fa0 0 2023-10-18T20:58:46.878 INFO:tasks.workunit.client.0.smithi008.stdout:6/838: creat df/d3c/d77/f11a x:0 0 0 2023-10-18T20:58:46.879 INFO:tasks.workunit.client.1.smithi060.stdout:3/883: unlink d0/f64 0 2023-10-18T20:58:46.884 INFO:tasks.workunit.client.1.smithi060.stdout:5/968: dread d0/d6/d9/d82/d84/db2/f22 [0,4194304] 0 2023-10-18T20:58:46.886 INFO:tasks.workunit.client.1.smithi060.stdout:6/930: rmdir d10/d47/d92/d79 39 2023-10-18T20:58:46.891 INFO:tasks.workunit.client.0.smithi008.stdout:4/702: read d0/d17/d5b/fa6 [311891,37664] 0 2023-10-18T20:58:46.893 INFO:tasks.workunit.client.1.smithi060.stdout:3/884: getdents d0/d22/d26/d79/db3 0 2023-10-18T20:58:46.894 INFO:tasks.workunit.client.1.smithi060.stdout:3/885: truncate d0/d22/d26/d79/f113 371408 0 2023-10-18T20:58:46.894 INFO:tasks.workunit.client.1.smithi060.stdout:3/886: fdatasync d0/d22/d26/d29/dae/f10c 0 2023-10-18T20:58:46.894 INFO:tasks.workunit.client.1.smithi060.stdout:5/969: getdents d0/d6 0 2023-10-18T20:58:46.895 INFO:tasks.workunit.client.0.smithi008.stdout:6/839: truncate df/f35 2082736 0 2023-10-18T20:58:46.895 INFO:tasks.workunit.client.1.smithi060.stdout:6/931: mkdir d10/d128 0 2023-10-18T20:58:46.896 INFO:tasks.workunit.client.0.smithi008.stdout:3/845: write d0/d3/d37/d74/da2/fb7 [2663479,53063] 0 2023-10-18T20:58:46.896 INFO:tasks.workunit.client.0.smithi008.stdout:3/846: fdatasync d0/d3/de/d13/d35/ff9 0 2023-10-18T20:58:46.897 INFO:tasks.workunit.client.0.smithi008.stdout:6/840: unlink df/d15/d48/d81/lb7 0 2023-10-18T20:58:46.898 INFO:tasks.workunit.client.0.smithi008.stdout:3/847: write d0/d3/de/d13/f49 [500857,44465] 0 2023-10-18T20:58:46.898 INFO:tasks.workunit.client.0.smithi008.stdout:3/848: fdatasync d0/d3/d42/d52/f98 0 2023-10-18T20:58:46.899 INFO:tasks.workunit.client.0.smithi008.stdout:3/849: chown d0/d3/l8f 1693954393 1 2023-10-18T20:58:46.900 INFO:tasks.workunit.client.0.smithi008.stdout:1/791: dwrite d9/f2f [0,4194304] 0 2023-10-18T20:58:46.903 INFO:tasks.workunit.client.0.smithi008.stdout:8/917: rename d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/dec to d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/d14b 0 2023-10-18T20:58:46.904 INFO:tasks.workunit.client.0.smithi008.stdout:3/850: creat d0/d84/dad/dbb/de8/f10a x:0 0 0 2023-10-18T20:58:46.906 INFO:tasks.workunit.client.0.smithi008.stdout:1/792: unlink d9/de/df/d17/d1e/d3c/d90/d95/ca1 0 2023-10-18T20:58:46.907 INFO:tasks.workunit.client.0.smithi008.stdout:4/703: rename d0/d58/l91 to d0/d3/d21/d57/d8f/d95/lea 0 2023-10-18T20:58:46.908 INFO:tasks.workunit.client.1.smithi060.stdout:2/942: dread d0/d45/d49/f7e [0,4194304] 0 2023-10-18T20:58:46.909 INFO:tasks.workunit.client.1.smithi060.stdout:2/943: symlink d0/d16/ded/l139 0 2023-10-18T20:58:46.909 INFO:tasks.workunit.client.0.smithi008.stdout:3/851: mknod d0/d3/de/d13/d35/dbf/de9/df2/c10b 0 2023-10-18T20:58:46.912 INFO:tasks.workunit.client.1.smithi060.stdout:8/913: dwrite d4/d9/d31/d6f/f8c [0,4194304] 0 2023-10-18T20:58:46.914 INFO:tasks.workunit.client.1.smithi060.stdout:8/914: getdents d4/d9/d37/d4e 0 2023-10-18T20:58:46.915 INFO:tasks.workunit.client.0.smithi008.stdout:1/793: creat d9/de/df/d17/d1e/db8/ff8 x:0 0 0 2023-10-18T20:58:46.915 INFO:tasks.workunit.client.0.smithi008.stdout:6/841: write df/d15/d48/ded/d108/dcf/d58/dec/f17 [3690987,129741] 0 2023-10-18T20:58:46.916 INFO:tasks.workunit.client.0.smithi008.stdout:3/852: creat d0/d4a/d64/df6/f10c x:0 0 0 2023-10-18T20:58:46.916 INFO:tasks.workunit.client.1.smithi060.stdout:8/915: creat d4/d9/d31/d6f/dfa/d7b/f11f x:0 0 0 2023-10-18T20:58:46.916 INFO:tasks.workunit.client.0.smithi008.stdout:6/842: creat df/dd1/f11b x:0 0 0 2023-10-18T20:58:46.917 INFO:tasks.workunit.client.0.smithi008.stdout:6/843: creat df/d3c/d77/f11c x:0 0 0 2023-10-18T20:58:46.918 INFO:tasks.workunit.client.1.smithi060.stdout:8/916: creat d4/d9/d31/d6f/dfa/de3/f120 x:0 0 0 2023-10-18T20:58:46.918 INFO:tasks.workunit.client.0.smithi008.stdout:3/853: creat d0/d3/d42/d88/dae/f10d x:0 0 0 2023-10-18T20:58:46.919 INFO:tasks.workunit.client.0.smithi008.stdout:3/854: chown d0/d3/d37/ldf 497 1 2023-10-18T20:58:46.919 INFO:tasks.workunit.client.0.smithi008.stdout:3/855: chown d0/d3/d37/c5a 12 1 2023-10-18T20:58:46.919 INFO:tasks.workunit.client.0.smithi008.stdout:3/856: chown d0/d3/de/d13/d35 39735 1 2023-10-18T20:58:46.922 INFO:tasks.workunit.client.1.smithi060.stdout:2/944: dread d0/d45/d49/d6e/d79/d6c/fc1 [0,4194304] 0 2023-10-18T20:58:46.922 INFO:tasks.workunit.client.1.smithi060.stdout:2/945: chown d0/d16/ded 666 1 2023-10-18T20:58:46.923 INFO:tasks.workunit.client.1.smithi060.stdout:8/917: mknod d4/d9/d93/c121 0 2023-10-18T20:58:46.923 INFO:tasks.workunit.client.0.smithi008.stdout:6/844: link df/d15/d48/ded/d108/dcf/d3f/dcd/ce3 df/d15/d48/dbe/c11d 0 2023-10-18T20:58:46.923 INFO:tasks.workunit.client.0.smithi008.stdout:3/857: creat d0/d3/d42/d88/d103/f10e x:0 0 0 2023-10-18T20:58:46.924 INFO:tasks.workunit.client.0.smithi008.stdout:3/858: chown d0/d4a/d64/df6/f10c 6 1 2023-10-18T20:58:46.938 INFO:tasks.workunit.client.0.smithi008.stdout:6/845: rmdir df/d36 39 2023-10-18T20:58:46.942 INFO:tasks.workunit.client.0.smithi008.stdout:6/846: mknod df/d15/d48/ded/d108/dcf/d58/dd7/c11e 0 2023-10-18T20:58:46.942 INFO:tasks.workunit.client.0.smithi008.stdout:6/847: chown df/d15/d48/ded/d108/dcf/d7e/lc2 118366 1 2023-10-18T20:58:46.942 INFO:tasks.workunit.client.0.smithi008.stdout:6/848: fdatasync df/d15/d48/ded/d108/dcf/d58/dec/daa/fd9 0 2023-10-18T20:58:46.942 INFO:tasks.workunit.client.0.smithi008.stdout:6/849: write df/d15/f16 [795385,33264] 0 2023-10-18T20:58:46.945 INFO:tasks.workunit.client.0.smithi008.stdout:6/850: symlink df/d15/d48/ded/d108/dcf/d3f/dcd/d10a/l11f 0 2023-10-18T20:58:46.946 INFO:tasks.workunit.client.0.smithi008.stdout:6/851: readlink la 0 2023-10-18T20:58:46.950 INFO:tasks.workunit.client.0.smithi008.stdout:6/852: mkdir df/d36/d120 0 2023-10-18T20:58:46.950 INFO:tasks.workunit.client.1.smithi060.stdout:2/946: dread d0/d8/f11 [0,4194304] 0 2023-10-18T20:58:46.951 INFO:tasks.workunit.client.0.smithi008.stdout:5/748: dwrite d0/ff7 [0,4194304] 0 2023-10-18T20:58:46.958 INFO:tasks.workunit.client.1.smithi060.stdout:8/918: dread d4/d9/f83 [0,4194304] 0 2023-10-18T20:58:46.961 INFO:tasks.workunit.client.1.smithi060.stdout:8/919: write d4/d9/d31/d6f/dfa/d7b/f7d [308200,47258] 0 2023-10-18T20:58:46.962 INFO:tasks.workunit.client.1.smithi060.stdout:4/910: sync 2023-10-18T20:58:46.963 INFO:tasks.workunit.client.1.smithi060.stdout:0/939: sync 2023-10-18T20:58:46.963 INFO:tasks.workunit.client.1.smithi060.stdout:0/940: chown d3/d8/f3f 40821450 1 2023-10-18T20:58:46.964 INFO:tasks.workunit.client.0.smithi008.stdout:1/794: dwrite d9/de/df/d17/d1e/d3c/f6f [0,4194304] 0 2023-10-18T20:58:46.964 INFO:tasks.workunit.client.0.smithi008.stdout:1/795: write d9/de/df/d17/d1e/d7d/fca [748214,80649] 0 2023-10-18T20:58:46.964 INFO:tasks.workunit.client.0.smithi008.stdout:1/796: creat d9/de/df/d17/d25/d94/da7/ff9 x:0 0 0 2023-10-18T20:58:46.970 INFO:tasks.workunit.client.1.smithi060.stdout:9/876: sync 2023-10-18T20:58:46.970 INFO:tasks.workunit.client.1.smithi060.stdout:9/877: fsync d3/d99/d1c/d25/f12a 0 2023-10-18T20:58:46.970 INFO:tasks.workunit.client.1.smithi060.stdout:0/941: symlink d3/de5/d107/l130 0 2023-10-18T20:58:46.971 INFO:tasks.workunit.client.1.smithi060.stdout:0/942: truncate d3/d32/f4c 4416316 0 2023-10-18T20:58:46.974 INFO:tasks.workunit.client.1.smithi060.stdout:9/878: mknod d3/d99/d1c/d116/d80/da0/dc2/d9e/c13c 0 2023-10-18T20:58:46.974 INFO:tasks.workunit.client.1.smithi060.stdout:9/879: chown d3/d99/d1c/d116/d80/da0/dc2/d9e 74149 1 2023-10-18T20:58:46.975 INFO:tasks.workunit.client.1.smithi060.stdout:0/943: mknod d3/d8/dac/c131 0 2023-10-18T20:58:46.975 INFO:tasks.workunit.client.1.smithi060.stdout:0/944: dread - d3/d8/d11f/d55/d9a/fcb zero size 2023-10-18T20:58:46.977 INFO:tasks.workunit.client.1.smithi060.stdout:0/945: creat d3/d80/db5/f132 x:0 0 0 2023-10-18T20:58:46.978 INFO:tasks.workunit.client.1.smithi060.stdout:9/880: mknod d3/d99/d1c/d116/d80/da0/ddd/c13d 0 2023-10-18T20:58:46.991 INFO:tasks.workunit.client.0.smithi008.stdout:1/797: dread d9/de/df/d17/d55/f79 [0,4194304] 0 2023-10-18T20:58:46.993 INFO:tasks.workunit.client.0.smithi008.stdout:6/853: chown df/d15/d48/ded/d108/dcf/d58/c59 616367 1 2023-10-18T20:58:46.993 INFO:tasks.workunit.client.0.smithi008.stdout:6/854: chown df/d15/d48/d81/d116/d4c/l87 19749 1 2023-10-18T20:58:46.999 INFO:tasks.workunit.client.0.smithi008.stdout:5/749: truncate d0/d2/d19/d7c/d31/f4a 3517730 0 2023-10-18T20:58:47.010 INFO:tasks.workunit.client.0.smithi008.stdout:8/918: dwrite d5/d8/df/d9d/d85/db1/fef [0,4194304] 0 2023-10-18T20:58:47.015 INFO:tasks.workunit.client.0.smithi008.stdout:0/673: dwrite d0/dd/d19/d5f/d99/d5e/d7d/f9f [0,4194304] 0 2023-10-18T20:58:47.015 INFO:tasks.workunit.client.0.smithi008.stdout:0/674: readlink d0/d7c/lb9 0 2023-10-18T20:58:47.016 INFO:tasks.workunit.client.1.smithi060.stdout:3/887: dwrite d0/d3c/d3d/ffe [0,4194304] 0 2023-10-18T20:58:47.016 INFO:tasks.workunit.client.1.smithi060.stdout:3/888: stat d0/d22/f33 0 2023-10-18T20:58:47.019 INFO:tasks.workunit.client.1.smithi060.stdout:5/970: dwrite d0/da/d3b/d43/f63 [0,4194304] 0 2023-10-18T20:58:47.019 INFO:tasks.workunit.client.1.smithi060.stdout:5/971: dread - d0/da/dc8/de4/d4f/fa2 zero size 2023-10-18T20:58:47.021 INFO:tasks.workunit.client.0.smithi008.stdout:6/855: rename df/d15/d48/d81/ffc to df/d26/f121 0 2023-10-18T20:58:47.021 INFO:tasks.workunit.client.0.smithi008.stdout:6/856: dread - df/d15/d48/ded/d108/dcf/d58/dec/daa/fd9 zero size 2023-10-18T20:58:47.025 INFO:tasks.workunit.client.1.smithi060.stdout:3/889: link d0/d22/d26/d29/dae/f12f d0/d3c/f131 0 2023-10-18T20:58:47.025 INFO:tasks.workunit.client.1.smithi060.stdout:3/890: write d0/d22/d26/d29/dae/de4/ff7 [1241553,32641] 0 2023-10-18T20:58:47.026 INFO:tasks.workunit.client.1.smithi060.stdout:5/972: mkdir d0/d6/d9/d82/d96/d150 0 2023-10-18T20:58:47.030 INFO:tasks.workunit.client.1.smithi060.stdout:5/973: truncate d0/d6/d8/f44 1955929 0 2023-10-18T20:58:47.030 INFO:tasks.workunit.client.1.smithi060.stdout:5/974: fdatasync d0/d6/f11f 0 2023-10-18T20:58:47.031 INFO:tasks.workunit.client.1.smithi060.stdout:8/920: dwrite d4/ff [0,4194304] 0 2023-10-18T20:58:47.031 INFO:tasks.workunit.client.1.smithi060.stdout:8/921: write d4/d9/d4f/d74/d81/f94 [3726380,31426] 0 2023-10-18T20:58:47.031 INFO:tasks.workunit.client.1.smithi060.stdout:8/922: chown d4/d9/d4f/d74/l111 2167 1 2023-10-18T20:58:47.033 INFO:tasks.workunit.client.0.smithi008.stdout:0/675: rmdir d0/d7c/d9a/d8a/db0/db3 0 2023-10-18T20:58:47.033 INFO:tasks.workunit.client.0.smithi008.stdout:0/676: chown d0/dd/d19/d5f 1388 1 2023-10-18T20:58:47.037 INFO:tasks.workunit.client.1.smithi060.stdout:4/911: dwrite d4/d15/ffd [0,4194304] 0 2023-10-18T20:58:47.038 INFO:tasks.workunit.client.1.smithi060.stdout:4/912: write d4/dc/d2a/d31/da5/d11c/d69/d89/d110/f119 [721074,5634] 0 2023-10-18T20:58:47.038 INFO:tasks.workunit.client.1.smithi060.stdout:5/975: creat d0/d6/d9/d82/d96/f151 x:0 0 0 2023-10-18T20:58:47.038 INFO:tasks.workunit.client.1.smithi060.stdout:5/976: fsync d0/da/dc8/de4/ff4 0 2023-10-18T20:58:47.039 INFO:tasks.workunit.client.0.smithi008.stdout:5/750: dread d0/d86/f8c [0,4194304] 0 2023-10-18T20:58:47.039 INFO:tasks.workunit.client.0.smithi008.stdout:4/704: dwrite d0/d17/f98 [0,4194304] 0 2023-10-18T20:58:47.039 INFO:tasks.workunit.client.0.smithi008.stdout:3/859: dwrite d0/d3/d42/d88/fc5 [0,4194304] 0 2023-10-18T20:58:47.041 INFO:tasks.workunit.client.1.smithi060.stdout:4/913: creat d4/dc/d2a/d39/d53/f11f x:0 0 0 2023-10-18T20:58:47.045 INFO:tasks.workunit.client.0.smithi008.stdout:6/857: creat df/d15/d48/ded/d108/dcf/d68/db9/d119/f122 x:0 0 0 2023-10-18T20:58:47.045 INFO:tasks.workunit.client.0.smithi008.stdout:1/798: truncate d9/de/df/d17/d25/f32 786203 0 2023-10-18T20:58:47.045 INFO:tasks.workunit.client.0.smithi008.stdout:6/858: fsync df/d3c/d77/dd6/dd8/f112 0 2023-10-18T20:58:47.046 INFO:tasks.workunit.client.1.smithi060.stdout:5/977: rename d0/d6/c2d to d0/dd/dd7/d126/c152 0 2023-10-18T20:58:47.046 INFO:tasks.workunit.client.0.smithi008.stdout:6/859: creat df/d15/d48/d81/d116/d4c/f123 x:0 0 0 2023-10-18T20:58:47.047 INFO:tasks.workunit.client.1.smithi060.stdout:9/881: getdents d3/d99/d1c/d116/d80/da0/ddd 0 2023-10-18T20:58:47.050 INFO:tasks.workunit.client.0.smithi008.stdout:0/677: symlink d0/dd/d19/d5f/d89/da7/dac/ld0 0 2023-10-18T20:58:47.050 INFO:tasks.workunit.client.0.smithi008.stdout:0/678: fsync d0/dd/f27 0 2023-10-18T20:58:47.050 INFO:tasks.workunit.client.0.smithi008.stdout:0/679: fsync d0/dd/d19/d5f/d99/f80 0 2023-10-18T20:58:47.053 INFO:tasks.workunit.client.1.smithi060.stdout:4/914: unlink d4/dc/ca4 0 2023-10-18T20:58:47.053 INFO:tasks.workunit.client.1.smithi060.stdout:4/915: write d4/dc/d2a/d31/da5/d11c/d69/d89/fc6 [1828971,20930] 0 2023-10-18T20:58:47.053 INFO:tasks.workunit.client.1.smithi060.stdout:2/947: dwrite d0/d16/dc8/fe2 [0,4194304] 0 2023-10-18T20:58:47.054 INFO:tasks.workunit.client.1.smithi060.stdout:5/978: write d0/da/dc8/de4/d4f/d136/d27/f95 [440671,65046] 0 2023-10-18T20:58:47.059 INFO:tasks.workunit.client.0.smithi008.stdout:1/799: write d9/de/df/d17/d25/d94/faa [113053,78598] 0 2023-10-18T20:58:47.060 INFO:tasks.workunit.client.0.smithi008.stdout:4/705: rename d0/d17/d5b/d2a/f3c to d0/d58/feb 0 2023-10-18T20:58:47.066 INFO:tasks.workunit.client.1.smithi060.stdout:4/916: creat d4/dc/d2a/f120 x:0 0 0 2023-10-18T20:58:47.066 INFO:tasks.workunit.client.1.smithi060.stdout:0/946: dwrite d3/de5/df1/dc3/ff9 [0,4194304] 0 2023-10-18T20:58:47.066 INFO:tasks.workunit.client.1.smithi060.stdout:5/979: mknod d0/da/dc8/de4/d4f/d136/c153 0 2023-10-18T20:58:47.067 INFO:tasks.workunit.client.0.smithi008.stdout:8/919: dwrite d5/fa6 [0,4194304] 0 2023-10-18T20:58:47.073 INFO:tasks.workunit.client.0.smithi008.stdout:2/750: dwrite d1/d3/dd/d25/d76/d59/f97 [0,4194304] 0 2023-10-18T20:58:47.073 INFO:tasks.workunit.client.1.smithi060.stdout:5/980: rename d0/da/c12f to d0/da/dc8/de4/d4f/d137/c154 0 2023-10-18T20:58:47.074 INFO:tasks.workunit.client.1.smithi060.stdout:5/981: chown d0/da/d3b/l8e 7 1 2023-10-18T20:58:47.077 INFO:tasks.workunit.client.1.smithi060.stdout:6/932: dwrite d10/d17/d70/fd1 [0,4194304] 0 2023-10-18T20:58:47.077 INFO:tasks.workunit.client.1.smithi060.stdout:8/923: dread d4/d9/d31/d6f/dbd/ff1 [0,4194304] 0 2023-10-18T20:58:47.077 INFO:tasks.workunit.client.1.smithi060.stdout:5/982: symlink d0/da/d3b/d102/l155 0 2023-10-18T20:58:47.078 INFO:tasks.workunit.client.0.smithi008.stdout:3/860: symlink d0/d3/d37/l10f 0 2023-10-18T20:58:47.078 INFO:tasks.workunit.client.0.smithi008.stdout:3/861: write d0/d4a/d64/d80/ffc [62855,63946] 0 2023-10-18T20:58:47.078 INFO:tasks.workunit.client.0.smithi008.stdout:3/862: chown d0/d84/fcd 10 1 2023-10-18T20:58:47.079 INFO:tasks.workunit.client.1.smithi060.stdout:9/882: dread d3/d99/d1c/d116/d80/da0/dc2/d9e/fce [0,4194304] 0 2023-10-18T20:58:47.080 INFO:tasks.workunit.client.0.smithi008.stdout:4/706: dread d0/d17/d5b/faa [0,4194304] 0 2023-10-18T20:58:47.081 INFO:tasks.workunit.client.1.smithi060.stdout:2/948: dread d0/d16/d85/fbd [0,4194304] 0 2023-10-18T20:58:47.084 INFO:tasks.workunit.client.1.smithi060.stdout:6/933: rename d10/d2e/d75/d81/d8b/f11a to d10/d25/df2/f129 0 2023-10-18T20:58:47.085 INFO:tasks.workunit.client.1.smithi060.stdout:8/924: getdents d4/d9/d31/d35/d114 0 2023-10-18T20:58:47.085 INFO:tasks.workunit.client.1.smithi060.stdout:6/934: truncate d10/d17/d28/f5c 1609054 0 2023-10-18T20:58:47.085 INFO:tasks.workunit.client.1.smithi060.stdout:6/935: readlink d10/d17/d2f/lfc 0 2023-10-18T20:58:47.085 INFO:tasks.workunit.client.1.smithi060.stdout:6/936: stat d10/d2e/d75/d81/la1 0 2023-10-18T20:58:47.085 INFO:tasks.workunit.client.1.smithi060.stdout:6/937: creat d10/d2e/d75/dc7/f12a x:0 0 0 2023-10-18T20:58:47.086 INFO:tasks.workunit.client.1.smithi060.stdout:6/938: readlink d10/d17/d70/dba/d10b/d120/dd6/lf6 0 2023-10-18T20:58:47.092 INFO:tasks.workunit.client.1.smithi060.stdout:2/949: rename d0/d3/d27/d7b/fc5 to d0/d45/d49/d6e/d79/d6c/f13a 0 2023-10-18T20:58:47.095 INFO:tasks.workunit.client.0.smithi008.stdout:6/860: truncate df/d3c/d77/d50/f55 162729 0 2023-10-18T20:58:47.099 INFO:tasks.workunit.client.0.smithi008.stdout:1/800: link d9/de/df/fbb d9/de/df/d17/d69/ffa 0 2023-10-18T20:58:47.101 INFO:tasks.workunit.client.1.smithi060.stdout:6/939: creat d10/d17/d70/dba/d10b/d120/dd6/f12b x:0 0 0 2023-10-18T20:58:47.102 INFO:tasks.workunit.client.0.smithi008.stdout:8/920: symlink d5/d8/df/d9d/d4d/l14c 0 2023-10-18T20:58:47.108 INFO:tasks.workunit.client.0.smithi008.stdout:5/751: dwrite d0/d2/d19/d7c/d31/d3f/d9a/ff3 [0,4194304] 0 2023-10-18T20:58:47.108 INFO:tasks.workunit.client.0.smithi008.stdout:5/752: chown d0/d2/d19/d7c/d31/d80/d107/dfa 10744 1 2023-10-18T20:58:47.109 INFO:tasks.workunit.client.1.smithi060.stdout:3/891: dwrite d0/d22/d26/f127 [0,4194304] 0 2023-10-18T20:58:47.109 INFO:tasks.workunit.client.1.smithi060.stdout:3/892: chown d0/d22/d26/dfb/d11e 114574 1 2023-10-18T20:58:47.110 INFO:tasks.workunit.client.0.smithi008.stdout:2/751: link d1/d3/dd/d1c/d3a/d49/faf d1/d3/d40/d6e/d7e/ffb 0 2023-10-18T20:58:47.112 INFO:tasks.workunit.client.0.smithi008.stdout:1/801: mknod d9/de/df/d17/d25/dc1/cfb 0 2023-10-18T20:58:47.112 INFO:tasks.workunit.client.0.smithi008.stdout:1/802: chown d9/de/df/d17/d55/da8/fae 31455088 1 2023-10-18T20:58:47.114 INFO:tasks.workunit.client.0.smithi008.stdout:8/921: rename d5/d8/df/d9d/d4d/dba/dd4/f10c to d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/f14d 0 2023-10-18T20:58:47.117 INFO:tasks.workunit.client.1.smithi060.stdout:9/883: write d3/d99/d1c/d25/f74 [5007059,26520] 0 2023-10-18T20:58:47.119 INFO:tasks.workunit.client.1.smithi060.stdout:2/950: rmdir d0/d3/d9e/dce 39 2023-10-18T20:58:47.119 INFO:tasks.workunit.client.1.smithi060.stdout:2/951: stat d0/d45/d49/d6e/d79/d6c/c84 0 2023-10-18T20:58:47.119 INFO:tasks.workunit.client.1.smithi060.stdout:2/952: write d0/d45/dc9/da8/f122 [264779,1161] 0 2023-10-18T20:58:47.120 INFO:tasks.workunit.client.0.smithi008.stdout:5/753: mkdir d0/d2/d19/d7c/d31/d82/df5/d111 0 2023-10-18T20:58:47.121 INFO:tasks.workunit.client.0.smithi008.stdout:1/803: getdents d9/de/df/d17 0 2023-10-18T20:58:47.121 INFO:tasks.workunit.client.1.smithi060.stdout:6/940: creat d10/d17/d28/d102/f12c x:0 0 0 2023-10-18T20:58:47.125 INFO:tasks.workunit.client.1.smithi060.stdout:3/893: mkdir d0/d22/d26/d29/d132 0 2023-10-18T20:58:47.127 INFO:tasks.workunit.client.1.smithi060.stdout:9/884: mknod d3/d99/d19/d54/c13e 0 2023-10-18T20:58:47.129 INFO:tasks.workunit.client.1.smithi060.stdout:0/947: dread d3/d8/d11f/d55/f105 [0,4194304] 0 2023-10-18T20:58:47.130 INFO:tasks.workunit.client.0.smithi008.stdout:2/752: rename d1/d3/dd/d25/f30 to d1/d3/dd/d1c/d3a/d45/ffc 0 2023-10-18T20:58:47.130 INFO:tasks.workunit.client.0.smithi008.stdout:5/754: symlink d0/d2/d19/d7c/l112 0 2023-10-18T20:58:47.131 INFO:tasks.workunit.client.0.smithi008.stdout:8/922: dread d5/d8/df/d9d/d4d/f98 [0,4194304] 0 2023-10-18T20:58:47.131 INFO:tasks.workunit.client.1.smithi060.stdout:2/953: readlink d0/d8/l66 0 2023-10-18T20:58:47.131 INFO:tasks.workunit.client.1.smithi060.stdout:6/941: unlink d10/d25/fc5 0 2023-10-18T20:58:47.132 INFO:tasks.workunit.client.0.smithi008.stdout:1/804: rmdir d9/de/df/d17/d25/d94/dc4/dc6/de2 0 2023-10-18T20:58:47.133 INFO:tasks.workunit.client.0.smithi008.stdout:1/805: dread - d9/de/df/fe1 zero size 2023-10-18T20:58:47.133 INFO:tasks.workunit.client.0.smithi008.stdout:1/806: fsync d9/f7a 0 2023-10-18T20:58:47.134 INFO:tasks.workunit.client.1.smithi060.stdout:3/894: mkdir d0/d22/d26/d106/d133 0 2023-10-18T20:58:47.136 INFO:tasks.workunit.client.1.smithi060.stdout:0/948: truncate d3/de5/df1/dc3/fe9 35639 0 2023-10-18T20:58:47.136 INFO:tasks.workunit.client.1.smithi060.stdout:0/949: fdatasync d3/d8/d3c/ff0 0 2023-10-18T20:58:47.136 INFO:tasks.workunit.client.1.smithi060.stdout:0/950: write d3/d8/d11f/d55/d9a/f123 [511869,79170] 0 2023-10-18T20:58:47.137 INFO:tasks.workunit.client.1.smithi060.stdout:6/942: creat d10/d128/f12d x:0 0 0 2023-10-18T20:58:47.138 INFO:tasks.workunit.client.1.smithi060.stdout:0/951: truncate d3/d80/f9e 3712648 0 2023-10-18T20:58:47.139 INFO:tasks.workunit.client.1.smithi060.stdout:0/952: read - d3/d80/db5/f132 zero size 2023-10-18T20:58:47.141 INFO:tasks.workunit.client.1.smithi060.stdout:6/943: truncate d10/d3e/d76/f105 2499997 0 2023-10-18T20:58:47.141 INFO:tasks.workunit.client.1.smithi060.stdout:6/944: fsync d10/d17/d54/f5a 0 2023-10-18T20:58:47.143 INFO:tasks.workunit.client.0.smithi008.stdout:8/923: mknod d5/d8/df/d2e/d13b/deb/c14e 0 2023-10-18T20:58:47.143 INFO:tasks.workunit.client.0.smithi008.stdout:8/924: chown d5/d8/f12 2691 1 2023-10-18T20:58:47.144 INFO:tasks.workunit.client.0.smithi008.stdout:8/925: readlink d5/d8/df/d2e/l3e 0 2023-10-18T20:58:47.144 INFO:tasks.workunit.client.0.smithi008.stdout:4/707: write d0/d3/d21/d57/d8f/d95/fd1 [3398148,103027] 0 2023-10-18T20:58:47.144 INFO:tasks.workunit.client.0.smithi008.stdout:4/708: creat d0/d58/d8e/fec x:0 0 0 2023-10-18T20:58:47.144 INFO:tasks.workunit.client.0.smithi008.stdout:7/752: dwrite d1/d36/d3d/d3e/f3c [0,4194304] 0 2023-10-18T20:58:47.145 INFO:tasks.workunit.client.0.smithi008.stdout:7/753: dread - d1/da6/d79/db5/fc8 zero size 2023-10-18T20:58:47.145 INFO:tasks.workunit.client.1.smithi060.stdout:2/954: rename d0/d45/dc9/da8 to d0/d45/dc9/d102/d13b 0 2023-10-18T20:58:47.145 INFO:tasks.workunit.client.1.smithi060.stdout:2/955: fsync d0/d45/fb5 0 2023-10-18T20:58:47.146 INFO:tasks.workunit.client.0.smithi008.stdout:1/807: mkdir d9/de/df/d17/d1e/d7d/d89/dec/dfc 0 2023-10-18T20:58:47.146 INFO:tasks.workunit.client.0.smithi008.stdout:1/808: fdatasync d9/de/df/d17/d1e/d7d/d89/f8e 0 2023-10-18T20:58:47.147 INFO:tasks.workunit.client.1.smithi060.stdout:0/953: unlink d3/d8/d11f/d55/d74/d76/d68/d7f/l94 0 2023-10-18T20:58:47.147 INFO:tasks.workunit.client.1.smithi060.stdout:0/954: dread - d3/d8/f12a zero size 2023-10-18T20:58:47.147 INFO:tasks.workunit.client.1.smithi060.stdout:2/956: truncate d0/d45/d49/d6e/d79/d6c/fc1 354304 0 2023-10-18T20:58:47.151 INFO:tasks.workunit.client.1.smithi060.stdout:0/955: unlink d3/d8/d11f/f3e 0 2023-10-18T20:58:47.151 INFO:tasks.workunit.client.1.smithi060.stdout:0/956: unlink d3/d8/d11f/f77 0 2023-10-18T20:58:47.157 INFO:tasks.workunit.client.1.smithi060.stdout:2/957: creat d0/d16/d81/f13c x:0 0 0 2023-10-18T20:58:47.164 INFO:tasks.workunit.client.0.smithi008.stdout:5/755: dread d0/d2/d19/d7c/d58/d65/fd5 [0,4194304] 0 2023-10-18T20:58:47.166 INFO:tasks.workunit.client.0.smithi008.stdout:3/863: dwrite d0/d3/d37/d6f/fe2 [0,4194304] 0 2023-10-18T20:58:47.167 INFO:tasks.workunit.client.0.smithi008.stdout:3/864: chown d0/d84/fcd 1 1 2023-10-18T20:58:47.173 INFO:tasks.workunit.client.1.smithi060.stdout:6/945: dread d10/d17/d2f/fa0 [0,4194304] 0 2023-10-18T20:58:47.174 INFO:tasks.workunit.client.1.smithi060.stdout:6/946: fdatasync d10/d17/d54/f5a 0 2023-10-18T20:58:47.178 INFO:tasks.workunit.client.1.smithi060.stdout:4/917: dwrite d4/dc/d2a/d31/f46 [0,4194304] 0 2023-10-18T20:58:47.182 INFO:tasks.workunit.client.0.smithi008.stdout:5/756: write d0/d2/d19/d7c/d31/d3f/d9a/ff3 [3260020,465] 0 2023-10-18T20:58:47.182 INFO:tasks.workunit.client.0.smithi008.stdout:5/757: stat d0/d2/d19/d7c/d64/cd3 0 2023-10-18T20:58:47.183 INFO:tasks.workunit.client.0.smithi008.stdout:5/758: truncate d0/d2/d19/d7c/d31/d3f/fdf 564852 0 2023-10-18T20:58:47.183 INFO:tasks.workunit.client.1.smithi060.stdout:4/918: mkdir d4/dc/de2/d121 0 2023-10-18T20:58:47.188 INFO:tasks.workunit.client.0.smithi008.stdout:4/709: mknod d0/d58/ced 0 2023-10-18T20:58:47.189 INFO:tasks.workunit.client.0.smithi008.stdout:7/754: mkdir d1/da6/d79/dea 0 2023-10-18T20:58:47.193 INFO:tasks.workunit.client.0.smithi008.stdout:1/809: getdents d9/de/df/d17/d1e/d3c/d90 0 2023-10-18T20:58:47.204 INFO:tasks.workunit.client.1.smithi060.stdout:9/885: dwrite d3/d99/d1c/d5a/d107/f115 [0,4194304] 0 2023-10-18T20:58:47.206 INFO:tasks.workunit.client.1.smithi060.stdout:9/886: getdents d3/d99/d1c/d116/d2d 0 2023-10-18T20:58:47.208 INFO:tasks.workunit.client.1.smithi060.stdout:8/925: dwrite d4/d9/d31/d6f/fb6 [0,4194304] 0 2023-10-18T20:58:47.212 INFO:tasks.workunit.client.0.smithi008.stdout:3/865: symlink d0/d3/de/d13/d35/dbf/de9/l110 0 2023-10-18T20:58:47.215 INFO:tasks.workunit.client.0.smithi008.stdout:8/926: write d5/d8/df/f9a [1023917,105593] 0 2023-10-18T20:58:47.216 INFO:tasks.workunit.client.0.smithi008.stdout:8/927: chown d5/d8/df/d9d/d85/db1 47388 1 2023-10-18T20:58:47.216 INFO:tasks.workunit.client.0.smithi008.stdout:0/680: dwrite d0/d7c/d9a/d8a/fae [0,4194304] 0 2023-10-18T20:58:47.216 INFO:tasks.workunit.client.0.smithi008.stdout:2/753: dwrite d1/d3/d79/fd5 [0,4194304] 0 2023-10-18T20:58:47.221 INFO:tasks.workunit.client.1.smithi060.stdout:6/947: dread f8 [0,4194304] 0 2023-10-18T20:58:47.225 INFO:tasks.workunit.client.1.smithi060.stdout:8/926: rmdir d4/d9/d37/d4e/dd9/ddf 39 2023-10-18T20:58:47.230 INFO:tasks.workunit.client.1.smithi060.stdout:6/948: rename d10/d47/d92/d79/l7e to d10/d47/d92/dab/dfe/l12e 0 2023-10-18T20:58:47.230 INFO:tasks.workunit.client.1.smithi060.stdout:8/927: unlink d4/d9/d31/d35/f9d 0 2023-10-18T20:58:47.230 INFO:tasks.workunit.client.1.smithi060.stdout:8/928: fsync d4/d9/d88/f113 0 2023-10-18T20:58:47.231 INFO:tasks.workunit.client.1.smithi060.stdout:8/929: chown d4/d9/d4f/d74/d81/db8/leb 3443 1 2023-10-18T20:58:47.231 INFO:tasks.workunit.client.1.smithi060.stdout:8/930: mknod d4/d9/d31/d35/d9f/da3/ddb/c122 0 2023-10-18T20:58:47.232 INFO:tasks.workunit.client.1.smithi060.stdout:8/931: chown d4/d9/d37/lff 9 1 2023-10-18T20:58:47.235 INFO:tasks.workunit.client.1.smithi060.stdout:8/932: rename d4/d9/d31/d35/d9f/da3/fc7 to d4/d9/d37/d4e/dd9/f123 0 2023-10-18T20:58:47.235 INFO:tasks.workunit.client.1.smithi060.stdout:8/933: mknod d4/d9/d37/c124 0 2023-10-18T20:58:47.236 INFO:tasks.workunit.client.1.smithi060.stdout:8/934: dread - d4/d9/d37/fce zero size 2023-10-18T20:58:47.236 INFO:tasks.workunit.client.1.smithi060.stdout:8/935: write d4/d9/d31/d6f/dfa/fd2 [920287,93612] 0 2023-10-18T20:58:47.240 INFO:tasks.workunit.client.0.smithi008.stdout:3/866: dread d0/d3/d42/f30 [0,4194304] 0 2023-10-18T20:58:47.241 INFO:tasks.workunit.client.0.smithi008.stdout:3/867: write d0/d4a/d64/f6e [1099577,123574] 0 2023-10-18T20:58:47.243 INFO:tasks.workunit.client.0.smithi008.stdout:9/667: sync 2023-10-18T20:58:47.249 INFO:tasks.workunit.client.0.smithi008.stdout:8/928: dread d5/d8/df/d9d/d6c/faa [0,4194304] 0 2023-10-18T20:58:47.249 INFO:tasks.workunit.client.0.smithi008.stdout:8/929: readlink d5/d8/df/d9d/l3f 0 2023-10-18T20:58:47.250 INFO:tasks.workunit.client.1.smithi060.stdout:2/958: dwrite d0/d8/d47/fcc [0,4194304] 0 2023-10-18T20:58:47.251 INFO:tasks.workunit.client.1.smithi060.stdout:6/949: dread d10/d17/d54/f125 [0,4194304] 0 2023-10-18T20:58:47.255 INFO:tasks.workunit.client.0.smithi008.stdout:5/759: mkdir d0/d113 0 2023-10-18T20:58:47.255 INFO:tasks.workunit.client.0.smithi008.stdout:4/710: dwrite d0/d58/feb [0,4194304] 0 2023-10-18T20:58:47.255 INFO:tasks.workunit.client.1.smithi060.stdout:2/959: creat d0/d45/d49/d6e/d79/f13d x:0 0 0 2023-10-18T20:58:47.256 INFO:tasks.workunit.client.0.smithi008.stdout:2/754: dwrite d1/d3/dd/d1c/d3a/d45/f84 [0,4194304] 0 2023-10-18T20:58:47.256 INFO:tasks.workunit.client.0.smithi008.stdout:2/755: dread - d1/d3/dd/d25/d76/d59/d85/db9/fec zero size 2023-10-18T20:58:47.259 INFO:tasks.workunit.client.1.smithi060.stdout:6/950: read d10/d17/dae/dbf/fe0 [114143,110789] 0 2023-10-18T20:58:47.262 INFO:tasks.workunit.client.0.smithi008.stdout:4/711: dread d0/d17/d5b/fa6 [0,4194304] 0 2023-10-18T20:58:47.263 INFO:tasks.workunit.client.1.smithi060.stdout:8/936: dread d4/fa7 [0,4194304] 0 2023-10-18T20:58:47.265 INFO:tasks.workunit.client.1.smithi060.stdout:8/937: getdents d4/d9/d4f/d74/de5 0 2023-10-18T20:58:47.267 INFO:tasks.workunit.client.1.smithi060.stdout:8/938: symlink d4/d9/d31/d6f/dfa/l125 0 2023-10-18T20:58:47.268 INFO:tasks.workunit.client.1.smithi060.stdout:8/939: fsync d4/d9/d88/fe6 0 2023-10-18T20:58:47.276 INFO:tasks.workunit.client.1.smithi060.stdout:6/951: dread d10/d2e/f73 [0,4194304] 0 2023-10-18T20:58:47.278 INFO:tasks.workunit.client.1.smithi060.stdout:8/940: dread d4/d9/f23 [0,4194304] 0 2023-10-18T20:58:47.282 INFO:tasks.workunit.client.1.smithi060.stdout:6/952: getdents d10/d17/d28/d102 0 2023-10-18T20:58:47.282 INFO:tasks.workunit.client.1.smithi060.stdout:0/957: dwrite d3/f21 [4194304,4194304] 0 2023-10-18T20:58:47.283 INFO:tasks.workunit.client.1.smithi060.stdout:0/958: write d3/f118 [510858,109429] 0 2023-10-18T20:58:47.283 INFO:tasks.workunit.client.1.smithi060.stdout:9/887: dwrite d3/d99/d65/f81 [4194304,4194304] 0 2023-10-18T20:58:47.284 INFO:tasks.workunit.client.1.smithi060.stdout:8/941: mknod d4/d9/d4f/d74/de5/c126 0 2023-10-18T20:58:47.284 INFO:tasks.workunit.client.0.smithi008.stdout:0/681: symlink d0/dd/d19/d5f/d89/ld1 0 2023-10-18T20:58:47.284 INFO:tasks.workunit.client.0.smithi008.stdout:0/682: stat d0/dd/d19/d5f/d89 0 2023-10-18T20:58:47.285 INFO:tasks.workunit.client.0.smithi008.stdout:0/683: fsync d0/d7c/f39 0 2023-10-18T20:58:47.285 INFO:tasks.workunit.client.0.smithi008.stdout:5/760: dread d0/d2/d9/f24 [0,4194304] 0 2023-10-18T20:58:47.289 INFO:tasks.workunit.client.0.smithi008.stdout:6/861: dwrite df/d15/d48/d4b/f4f [0,4194304] 0 2023-10-18T20:58:47.290 INFO:tasks.workunit.client.0.smithi008.stdout:2/756: dread d1/f1a [0,4194304] 0 2023-10-18T20:58:47.291 INFO:tasks.workunit.client.1.smithi060.stdout:4/919: dwrite d4/dc/d2a/d31/da5/d11c/d69/d89/fc6 [0,4194304] 0 2023-10-18T20:58:47.291 INFO:tasks.workunit.client.1.smithi060.stdout:4/920: stat d4/d91 0 2023-10-18T20:58:47.291 INFO:tasks.workunit.client.1.smithi060.stdout:4/921: stat d4/dc/d2a/d13/d33/le1 0 2023-10-18T20:58:47.292 INFO:tasks.workunit.client.1.smithi060.stdout:0/959: dread d3/d8/d11f/d55/d9a/dcf/fdb [0,4194304] 0 2023-10-18T20:58:47.292 INFO:tasks.workunit.client.1.smithi060.stdout:6/953: dread d10/d2e/d75/dc7/fcf [0,4194304] 0 2023-10-18T20:58:47.293 INFO:tasks.workunit.client.1.smithi060.stdout:6/954: chown d10/d17/d28/f68 4 1 2023-10-18T20:58:47.293 INFO:tasks.workunit.client.1.smithi060.stdout:9/888: unlink d3/d99/d1c/d116/d2d/f10b 0 2023-10-18T20:58:47.298 INFO:tasks.workunit.client.0.smithi008.stdout:3/868: mknod d0/d3/da9/c111 0 2023-10-18T20:58:47.304 INFO:tasks.workunit.client.1.smithi060.stdout:4/922: mknod d4/dc/d2a/d13/d27/d68/dc8/c122 0 2023-10-18T20:58:47.304 INFO:tasks.workunit.client.1.smithi060.stdout:6/955: creat d10/d2e/d75/dc4/f12f x:0 0 0 2023-10-18T20:58:47.305 INFO:tasks.workunit.client.1.smithi060.stdout:6/956: fdatasync d10/d17/d2f/f7d 0 2023-10-18T20:58:47.305 INFO:tasks.workunit.client.1.smithi060.stdout:6/957: truncate d10/d25/f4f 453376 0 2023-10-18T20:58:47.305 INFO:tasks.workunit.client.1.smithi060.stdout:9/889: rename d3/c4d to d3/d99/d1c/d116/d80/d122/c13f 0 2023-10-18T20:58:47.306 INFO:tasks.workunit.client.0.smithi008.stdout:3/869: dread d0/fac [0,4194304] 0 2023-10-18T20:58:47.306 INFO:tasks.workunit.client.0.smithi008.stdout:4/712: dwrite d0/d17/d5b/d2a/f94 [0,4194304] 0 2023-10-18T20:58:47.309 INFO:tasks.workunit.client.1.smithi060.stdout:0/960: getdents d3/de5 0 2023-10-18T20:58:47.309 INFO:tasks.workunit.client.1.smithi060.stdout:6/958: creat d10/d2e/d75/d81/f130 x:0 0 0 2023-10-18T20:58:47.311 INFO:tasks.workunit.client.1.smithi060.stdout:4/923: mkdir d4/dc/d123 0 2023-10-18T20:58:47.312 INFO:tasks.workunit.client.0.smithi008.stdout:5/761: mkdir d0/d2/d19/d7c/da7/d114 0 2023-10-18T20:58:47.313 INFO:tasks.workunit.client.1.smithi060.stdout:0/961: rename d3/d8/d11f/dec to d3/d8/d11f/d55/dad/d133 0 2023-10-18T20:58:47.314 INFO:tasks.workunit.client.1.smithi060.stdout:4/924: getdents d4/d15/d2b/d9f 0 2023-10-18T20:58:47.317 INFO:tasks.workunit.client.1.smithi060.stdout:4/925: rename d4/dc/d2a/d13/ld8 to d4/dc/d2a/d39/l124 0 2023-10-18T20:58:47.322 INFO:tasks.workunit.client.1.smithi060.stdout:6/959: dread d10/d2e/d75/dc7/fcf [0,4194304] 0 2023-10-18T20:58:47.322 INFO:tasks.workunit.client.1.smithi060.stdout:6/960: chown d10/d2e/d11e/f124 1 1 2023-10-18T20:58:47.322 INFO:tasks.workunit.client.1.smithi060.stdout:6/961: chown d10/d2e/lf7 3048 1 2023-10-18T20:58:47.323 INFO:tasks.workunit.client.1.smithi060.stdout:6/962: stat d10/d47/d92/f61 0 2023-10-18T20:58:47.323 INFO:tasks.workunit.client.0.smithi008.stdout:7/755: creat d1/d36/d3d/da3/de8/feb x:0 0 0 2023-10-18T20:58:47.323 INFO:tasks.workunit.client.0.smithi008.stdout:7/756: creat d1/d36/d3d/d3e/d59/fec x:0 0 0 2023-10-18T20:58:47.324 INFO:tasks.workunit.client.1.smithi060.stdout:6/963: symlink d10/d3e/l131 0 2023-10-18T20:58:47.324 INFO:tasks.workunit.client.1.smithi060.stdout:6/964: readlink d10/d17/d54/dd4/l11c 0 2023-10-18T20:58:47.325 INFO:tasks.workunit.client.1.smithi060.stdout:6/965: mknod d10/d17/d70/dba/c132 0 2023-10-18T20:58:47.328 INFO:tasks.workunit.client.1.smithi060.stdout:6/966: mknod d10/d17/d28/c133 0 2023-10-18T20:58:47.330 INFO:tasks.workunit.client.0.smithi008.stdout:6/862: symlink df/d19/l124 0 2023-10-18T20:58:47.330 INFO:tasks.workunit.client.0.smithi008.stdout:6/863: truncate df/d15/d48/ded/d108/dcf/d3f/fdf 969280 0 2023-10-18T20:58:47.336 INFO:tasks.workunit.client.0.smithi008.stdout:9/668: link d2/dc/d40/l86 d2/dc/d40/d5a/lc4 0 2023-10-18T20:58:47.338 INFO:tasks.workunit.client.0.smithi008.stdout:9/669: creat d2/dc/d40/d6f/d92/fc5 x:0 0 0 2023-10-18T20:58:47.338 INFO:tasks.workunit.client.0.smithi008.stdout:9/670: chown d2/dc/d40 2 1 2023-10-18T20:58:47.338 INFO:tasks.workunit.client.0.smithi008.stdout:9/671: truncate d2/dc/d40/d6f/d92/d59/f65 898127 0 2023-10-18T20:58:47.339 INFO:tasks.workunit.client.1.smithi060.stdout:4/926: write d4/dc/d40/da8/fbc [427413,64885] 0 2023-10-18T20:58:47.339 INFO:tasks.workunit.client.1.smithi060.stdout:4/927: stat d4/dc/d2a/d13/c55 0 2023-10-18T20:58:47.339 INFO:tasks.workunit.client.1.smithi060.stdout:4/928: fsync d4/dc/d2a/d31/f46 0 2023-10-18T20:58:47.340 INFO:tasks.workunit.client.1.smithi060.stdout:4/929: truncate d4/dc/d2a/d13/f56 4081191 0 2023-10-18T20:58:47.341 INFO:tasks.workunit.client.0.smithi008.stdout:3/870: creat d0/d3/f112 x:0 0 0 2023-10-18T20:58:47.343 INFO:tasks.workunit.client.1.smithi060.stdout:4/930: truncate d4/dc/d40/d80/daf/fe6 3286716 0 2023-10-18T20:58:47.347 INFO:tasks.workunit.client.1.smithi060.stdout:4/931: mknod d4/dc/d2a/d13/d27/d68/d9e/c125 0 2023-10-18T20:58:47.349 INFO:tasks.workunit.client.0.smithi008.stdout:6/864: creat df/d15/d48/ded/d108/dcf/d58/dec/daa/dcb/f125 x:0 0 0 2023-10-18T20:58:47.350 INFO:tasks.workunit.client.0.smithi008.stdout:6/865: readlink df/d15/d48/ded/d108/dcf/d3f/dcd/l105 0 2023-10-18T20:58:47.350 INFO:tasks.workunit.client.0.smithi008.stdout:6/866: dread - df/d15/d48/ded/d108/dcf/d58/dec/daa/dcb/f125 zero size 2023-10-18T20:58:47.350 INFO:tasks.workunit.client.0.smithi008.stdout:6/867: chown df 11 1 2023-10-18T20:58:47.350 INFO:tasks.workunit.client.0.smithi008.stdout:6/868: write df/d15/d48/d81/d116/fb8 [179933,109983] 0 2023-10-18T20:58:47.357 INFO:tasks.workunit.client.0.smithi008.stdout:6/869: mkdir df/d15/d48/ded/d108/dcf/d58/dec/d10d/d126 0 2023-10-18T20:58:47.357 INFO:tasks.workunit.client.0.smithi008.stdout:6/870: write df/d15/fc0 [707048,82633] 0 2023-10-18T20:58:47.359 INFO:tasks.workunit.client.0.smithi008.stdout:4/713: dwrite d0/d3/d21/f3e [0,4194304] 0 2023-10-18T20:58:47.366 INFO:tasks.workunit.client.0.smithi008.stdout:4/714: mknod d0/d58/d8e/dd2/cee 0 2023-10-18T20:58:47.371 INFO:tasks.workunit.client.1.smithi060.stdout:0/962: dwrite d3/d8/d11f/d55/d74/d76/f10f [0,4194304] 0 2023-10-18T20:58:47.371 INFO:tasks.workunit.client.1.smithi060.stdout:8/942: dwrite d4/d9/d31/d35/d9f/da3/ddb/de9/ff9 [0,4194304] 0 2023-10-18T20:58:47.375 INFO:tasks.workunit.client.1.smithi060.stdout:0/963: mkdir d3/d8/d11f/d55/d74/d76/d68/d134 0 2023-10-18T20:58:47.378 INFO:tasks.workunit.client.0.smithi008.stdout:1/810: dwrite d9/de/f45 [0,4194304] 0 2023-10-18T20:58:47.379 INFO:tasks.workunit.client.0.smithi008.stdout:1/811: write d9/de/df/fe1 [955216,107823] 0 2023-10-18T20:58:47.379 INFO:tasks.workunit.client.0.smithi008.stdout:6/871: write df/d36/f62 [569045,113422] 0 2023-10-18T20:58:47.383 INFO:tasks.workunit.client.1.smithi060.stdout:6/967: dwrite d10/d17/d70/dba/d10b/d120/dd6/f116 [0,4194304] 0 2023-10-18T20:58:47.383 INFO:tasks.workunit.client.0.smithi008.stdout:6/872: truncate df/d15/d48/d81/d116/ffb 943242 0 2023-10-18T20:58:47.383 INFO:tasks.workunit.client.0.smithi008.stdout:4/715: creat d0/d58/dc7/fef x:0 0 0 2023-10-18T20:58:47.387 INFO:tasks.workunit.client.0.smithi008.stdout:7/757: dwrite d1/f6 [0,4194304] 0 2023-10-18T20:58:47.388 INFO:tasks.workunit.client.1.smithi060.stdout:8/943: mknod d4/d10d/c127 0 2023-10-18T20:58:47.390 INFO:tasks.workunit.client.0.smithi008.stdout:6/873: creat df/d15/d48/d81/d116/dbf/f127 x:0 0 0 2023-10-18T20:58:47.390 INFO:tasks.workunit.client.0.smithi008.stdout:6/874: fdatasync df/d15/d48/ded/d108/dcf/d58/dec/f69 0 2023-10-18T20:58:47.390 INFO:tasks.workunit.client.0.smithi008.stdout:6/875: chown df/d15/d48/d81/d116/fb8 4 1 2023-10-18T20:58:47.390 INFO:tasks.workunit.client.0.smithi008.stdout:6/876: dread - df/d15/d48/fb0 zero size 2023-10-18T20:58:47.391 INFO:tasks.workunit.client.0.smithi008.stdout:6/877: dread - df/d3c/fd2 zero size 2023-10-18T20:58:47.391 INFO:tasks.workunit.client.0.smithi008.stdout:6/878: chown df/d15/d48/ded/d108/dcf/d58/cbb 397033 1 2023-10-18T20:58:47.391 INFO:tasks.workunit.client.1.smithi060.stdout:0/964: rename d3/d8/d11f/d55/d74/d76/d68/f112 to d3/de5/f135 0 2023-10-18T20:58:47.394 INFO:tasks.workunit.client.0.smithi008.stdout:0/684: symlink d0/dd/d19/d5f/d99/ld2 0 2023-10-18T20:58:47.395 INFO:tasks.workunit.client.0.smithi008.stdout:0/685: fsync d0/d7c/f30 0 2023-10-18T20:58:47.395 INFO:tasks.workunit.client.1.smithi060.stdout:8/944: creat d4/d9/d31/d35/d9f/da3/ddb/f128 x:0 0 0 2023-10-18T20:58:47.396 INFO:tasks.workunit.client.1.smithi060.stdout:6/968: mkdir d10/d6f/d134 0 2023-10-18T20:58:47.399 INFO:tasks.workunit.client.1.smithi060.stdout:8/945: symlink d4/d9/d31/d35/d9f/da3/ddb/l129 0 2023-10-18T20:58:47.399 INFO:tasks.workunit.client.1.smithi060.stdout:8/946: stat d4/d9/d88 0 2023-10-18T20:58:47.399 INFO:tasks.workunit.client.1.smithi060.stdout:8/947: creat d4/d9/db4/f12a x:0 0 0 2023-10-18T20:58:47.400 INFO:tasks.workunit.client.0.smithi008.stdout:6/879: mkdir df/d15/d10c/d128 0 2023-10-18T20:58:47.402 INFO:tasks.workunit.client.1.smithi060.stdout:6/969: rename f1 to d10/d2e/d75/d81/d8b/dc9/f135 0 2023-10-18T20:58:47.404 INFO:tasks.workunit.client.0.smithi008.stdout:5/762: mknod d0/d2/c115 0 2023-10-18T20:58:47.404 INFO:tasks.workunit.client.1.smithi060.stdout:8/948: mknod d4/d9/d4f/d74/d81/db8/c12b 0 2023-10-18T20:58:47.405 INFO:tasks.workunit.client.1.smithi060.stdout:8/949: chown d4/d9/d88/ded 15840 1 2023-10-18T20:58:47.406 INFO:tasks.workunit.client.0.smithi008.stdout:1/812: dread d9/de/df/d17/d55/f78 [0,4194304] 0 2023-10-18T20:58:47.406 INFO:tasks.workunit.client.0.smithi008.stdout:1/813: fsync d9/de/df/d17/d1e/f71 0 2023-10-18T20:58:47.406 INFO:tasks.workunit.client.0.smithi008.stdout:1/814: dread - d9/de/df/f7f zero size 2023-10-18T20:58:47.407 INFO:tasks.workunit.client.0.smithi008.stdout:1/815: write d9/de/df/d17/d55/fdd [522285,41748] 0 2023-10-18T20:58:47.407 INFO:tasks.workunit.client.0.smithi008.stdout:2/757: mknod d1/d3/dd/d25/d76/cfd 0 2023-10-18T20:58:47.407 INFO:tasks.workunit.client.0.smithi008.stdout:2/758: unlink d1/d3/dd/d25/d76/d59/d85/ca8 0 2023-10-18T20:58:47.407 INFO:tasks.workunit.client.0.smithi008.stdout:2/759: write d1/d3/dd/d25/d76/d59/d85/db9/fec [123357,55228] 0 2023-10-18T20:58:47.408 INFO:tasks.workunit.client.0.smithi008.stdout:4/716: write d0/d58/d83/f89 [1727766,91336] 0 2023-10-18T20:58:47.409 INFO:tasks.workunit.client.1.smithi060.stdout:6/970: creat d10/d17/d70/dba/d10b/d120/dd6/d122/f136 x:0 0 0 2023-10-18T20:58:47.409 INFO:tasks.workunit.client.1.smithi060.stdout:8/950: mkdir d4/d9/d31/d6f/dfa/d12c 0 2023-10-18T20:58:47.409 INFO:tasks.workunit.client.0.smithi008.stdout:9/672: dwrite d2/dc/d17/f2e [0,4194304] 0 2023-10-18T20:58:47.410 INFO:tasks.workunit.client.0.smithi008.stdout:9/673: truncate d2/f7f 501265 0 2023-10-18T20:58:47.410 INFO:tasks.workunit.client.1.smithi060.stdout:4/932: dwrite d4/dc/d2a/d13/d27/f67 [0,4194304] 0 2023-10-18T20:58:47.410 INFO:tasks.workunit.client.1.smithi060.stdout:4/933: chown d4/dc/d2a/d83/f100 1259 1 2023-10-18T20:58:47.410 INFO:tasks.workunit.client.1.smithi060.stdout:4/934: chown d4/dc/d2a/d39/f8c 2334 1 2023-10-18T20:58:47.413 INFO:tasks.workunit.client.0.smithi008.stdout:6/880: fdatasync df/d15/fc0 0 2023-10-18T20:58:47.414 INFO:tasks.workunit.client.1.smithi060.stdout:0/965: dread d3/d8/d11f/d55/d74/d76/d6b/f79 [0,4194304] 0 2023-10-18T20:58:47.414 INFO:tasks.workunit.client.1.smithi060.stdout:0/966: unlink d3/d8/d11f/f2b 0 2023-10-18T20:58:47.415 INFO:tasks.workunit.client.0.smithi008.stdout:0/686: symlink d0/d3a/d61/ld3 0 2023-10-18T20:58:47.416 INFO:tasks.workunit.client.1.smithi060.stdout:8/951: rmdir d4/d9 39 2023-10-18T20:58:47.416 INFO:tasks.workunit.client.1.smithi060.stdout:4/935: symlink d4/dc/d40/l126 0 2023-10-18T20:58:47.419 INFO:tasks.workunit.client.0.smithi008.stdout:5/763: mknod d0/d6e/c116 0 2023-10-18T20:58:47.435 INFO:tasks.workunit.client.0.smithi008.stdout:1/816: dread d9/fc [0,4194304] 0 2023-10-18T20:58:47.435 INFO:tasks.workunit.client.0.smithi008.stdout:4/717: write d0/d17/f98 [2606918,10711] 0 2023-10-18T20:58:47.437 INFO:tasks.workunit.client.1.smithi060.stdout:0/967: mkdir d3/d8/d11f/d55/d74/d76/d68/d134/d136 0 2023-10-18T20:58:47.438 INFO:tasks.workunit.client.1.smithi060.stdout:0/968: fdatasync d3/d8/d11f/f40 0 2023-10-18T20:58:47.438 INFO:tasks.workunit.client.1.smithi060.stdout:0/969: chown d3/d8/d11f/d55/d74/d76/d68/d134 63868 1 2023-10-18T20:58:47.441 INFO:tasks.workunit.client.1.smithi060.stdout:5/983: sync 2023-10-18T20:58:47.443 INFO:tasks.workunit.client.0.smithi008.stdout:5/764: write d0/d2/d19/d7c/d64/f7e [991117,84962] 0 2023-10-18T20:58:47.445 INFO:tasks.workunit.client.0.smithi008.stdout:1/817: mknod d9/de/df/d17/d55/da8/cfd 0 2023-10-18T20:58:47.446 INFO:tasks.workunit.client.0.smithi008.stdout:1/818: chown d9/f7a 2722 1 2023-10-18T20:58:47.449 INFO:tasks.workunit.client.0.smithi008.stdout:0/687: mknod d0/dd/d19/cd4 0 2023-10-18T20:58:47.451 INFO:tasks.workunit.client.1.smithi060.stdout:8/952: rmdir d4/d9/d93 39 2023-10-18T20:58:47.458 INFO:tasks.workunit.client.1.smithi060.stdout:4/936: rmdir d4/dc/d2a/d13 39 2023-10-18T20:58:47.462 INFO:tasks.workunit.client.1.smithi060.stdout:8/953: mknod d4/d9/d37/d4e/dd9/c12d 0 2023-10-18T20:58:47.462 INFO:tasks.workunit.client.1.smithi060.stdout:4/937: fsync d4/dc/d2a/d83/db1/f34 0 2023-10-18T20:58:47.464 INFO:tasks.workunit.client.0.smithi008.stdout:8/930: mknod d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/d14b/d8c/db4/c14f 0 2023-10-18T20:58:47.464 INFO:tasks.workunit.client.0.smithi008.stdout:8/931: read d5/d8/df/d9d/d6c/f7f [2366690,42153] 0 2023-10-18T20:58:47.466 INFO:tasks.workunit.client.0.smithi008.stdout:3/871: rmdir d0/d4a/d64 39 2023-10-18T20:58:47.466 INFO:tasks.workunit.client.0.smithi008.stdout:3/872: chown d0/d4a/d64/d80/faa 1527464 1 2023-10-18T20:58:47.466 INFO:tasks.workunit.client.0.smithi008.stdout:3/873: truncate d0/d3/d42/d52/ffb 503966 0 2023-10-18T20:58:47.469 INFO:tasks.workunit.client.0.smithi008.stdout:8/932: mknod d5/d8/df/d2e/c150 0 2023-10-18T20:58:47.469 INFO:tasks.workunit.client.0.smithi008.stdout:8/933: write d5/d8/df/d9d/d4d/dba/dd4/f2c [1673640,47228] 0 2023-10-18T20:58:47.471 INFO:tasks.workunit.client.1.smithi060.stdout:4/938: creat d4/dc/d2a/d31/da5/d11c/d69/d89/f127 x:0 0 0 2023-10-18T20:58:47.471 INFO:tasks.workunit.client.1.smithi060.stdout:4/939: fsync d4/dc/d2a/d31/da5/d11c/d69/d89/fc6 0 2023-10-18T20:58:47.471 INFO:tasks.workunit.client.1.smithi060.stdout:4/940: read - d4/d15/f7c zero size 2023-10-18T20:58:47.473 INFO:tasks.workunit.client.0.smithi008.stdout:2/760: rename d1/d3/dd/d1c/d3a/d45/daa/fed to d1/d3/dd/d25/d76/d59/d85/ffe 0 2023-10-18T20:58:47.473 INFO:tasks.workunit.client.0.smithi008.stdout:2/761: fsync d1/d3/dd/d25/d4d/fdd 0 2023-10-18T20:58:47.473 INFO:tasks.workunit.client.0.smithi008.stdout:2/762: fsync d1/d3/dd/d1c/f2d 0 2023-10-18T20:58:47.474 INFO:tasks.workunit.client.0.smithi008.stdout:8/934: creat d5/d8/df/d9d/d85/db1/d137/f151 x:0 0 0 2023-10-18T20:58:47.481 INFO:tasks.workunit.client.0.smithi008.stdout:3/874: rename d0/d3/c87 to d0/d3/d37/d74/df5/c113 0 2023-10-18T20:58:47.482 INFO:tasks.workunit.client.0.smithi008.stdout:3/875: truncate d0/d84/dad/dbb/de8/fe1 89907 0 2023-10-18T20:58:47.485 INFO:tasks.workunit.client.0.smithi008.stdout:5/765: write d0/d2/d19/f33 [3298335,50469] 0 2023-10-18T20:58:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:46.121270+0000 mgr.smithi008.flmjzp (mgr.14640) 17 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 2.9 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 129 MiB/s rd, 158 MiB/s wr, 237 op/s 2023-10-18T20:58:47.490 INFO:tasks.workunit.client.0.smithi008.stdout:7/758: dwrite d1/d3/f56 [4194304,4194304] 0 2023-10-18T20:58:47.497 INFO:tasks.workunit.client.0.smithi008.stdout:4/718: dwrite d0/d17/d5b/f52 [4194304,4194304] 0 2023-10-18T20:58:47.497 INFO:tasks.workunit.client.0.smithi008.stdout:4/719: dread - d0/fce zero size 2023-10-18T20:58:47.497 INFO:tasks.workunit.client.0.smithi008.stdout:4/720: chown d0/d3/d21/c35 24433504 1 2023-10-18T20:58:47.497 INFO:tasks.workunit.client.0.smithi008.stdout:4/721: readlink d0/d17/lcb 0 2023-10-18T20:58:47.497 INFO:tasks.workunit.client.0.smithi008.stdout:4/722: getdents d0/d3 0 2023-10-18T20:58:47.498 INFO:tasks.workunit.client.0.smithi008.stdout:9/674: dwrite d2/dc/d1a/d1d/f37 [0,4194304] 0 2023-10-18T20:58:47.498 INFO:tasks.workunit.client.0.smithi008.stdout:9/675: stat d2/dc/d40 0 2023-10-18T20:58:47.498 INFO:tasks.workunit.client.0.smithi008.stdout:9/676: write d2/dc/fbf [24391,34025] 0 2023-10-18T20:58:47.520 INFO:tasks.workunit.client.0.smithi008.stdout:7/759: write d1/da6/d4f/f5e [1853042,43425] 0 2023-10-18T20:58:47.526 INFO:tasks.workunit.client.1.smithi060.stdout:5/984: dwrite d0/dd/d76/d10f/da5/f3d [0,4194304] 0 2023-10-18T20:58:47.526 INFO:tasks.workunit.client.1.smithi060.stdout:5/985: write d0/d6/d8/d81/f101 [1006867,32903] 0 2023-10-18T20:58:47.526 INFO:tasks.workunit.client.1.smithi060.stdout:0/970: dwrite d3/de5/ffb [0,4194304] 0 2023-10-18T20:58:47.527 INFO:tasks.workunit.client.0.smithi008.stdout:7/760: mkdir d1/d36/d3d/da3/de8/d5f/dba/ded 0 2023-10-18T20:58:47.532 INFO:tasks.workunit.client.0.smithi008.stdout:3/876: read d0/d3/d37/d6f/fe2 [4119972,24537] 0 2023-10-18T20:58:47.532 INFO:tasks.workunit.client.1.smithi060.stdout:6/971: dwrite d10/d47/d92/f22 [4194304,4194304] 0 2023-10-18T20:58:47.533 INFO:tasks.workunit.client.1.smithi060.stdout:6/972: creat d10/d2e/d75/dc7/f137 x:0 0 0 2023-10-18T20:58:47.533 INFO:tasks.workunit.client.1.smithi060.stdout:6/973: chown d10/d3e/l85 1970 1 2023-10-18T20:58:47.533 INFO:tasks.workunit.client.0.smithi008.stdout:7/761: unlink d1/d3/l32 0 2023-10-18T20:58:47.537 INFO:tasks.workunit.client.0.smithi008.stdout:3/877: creat d0/d84/f114 x:0 0 0 2023-10-18T20:58:47.537 INFO:tasks.workunit.client.0.smithi008.stdout:3/878: chown d0/d3/d37/cdd 0 1 2023-10-18T20:58:47.538 INFO:tasks.workunit.client.0.smithi008.stdout:7/762: symlink d1/d36/d3d/d3e/d59/d73/lee 0 2023-10-18T20:58:47.538 INFO:tasks.workunit.client.0.smithi008.stdout:7/763: write d1/d36/d3d/da3/fa9 [5201866,123404] 0 2023-10-18T20:58:47.541 INFO:tasks.workunit.client.0.smithi008.stdout:3/879: truncate d0/d3/de/d13/f49 3323782 0 2023-10-18T20:58:47.545 INFO:tasks.workunit.client.0.smithi008.stdout:0/688: dwrite d0/dd/d19/d5f/d99/d94/f6b [0,4194304] 0 2023-10-18T20:58:47.545 INFO:tasks.workunit.client.0.smithi008.stdout:0/689: write d0/f2 [1332599,78736] 0 2023-10-18T20:58:47.545 INFO:tasks.workunit.client.0.smithi008.stdout:0/690: fdatasync d0/d3a/d61/fc4 0 2023-10-18T20:58:47.553 INFO:tasks.workunit.client.0.smithi008.stdout:7/764: mknod d1/da6/d4f/d87/cef 0 2023-10-18T20:58:47.553 INFO:tasks.workunit.client.0.smithi008.stdout:7/765: chown d1/da6/d79/db5/le4 16 1 2023-10-18T20:58:47.553 INFO:tasks.workunit.client.0.smithi008.stdout:7/766: fdatasync d1/d3/fc0 0 2023-10-18T20:58:47.553 INFO:tasks.workunit.client.0.smithi008.stdout:7/767: write d1/d36/d3d/d3e/d59/fec [530699,116558] 0 2023-10-18T20:58:47.554 INFO:tasks.workunit.client.0.smithi008.stdout:7/768: stat d1/da6/d4f/d5c/fb1 0 2023-10-18T20:58:47.554 INFO:tasks.workunit.client.0.smithi008.stdout:7/769: dread - d1/d36/d3d/d3e/d59/fd3 zero size 2023-10-18T20:58:47.555 INFO:tasks.workunit.client.0.smithi008.stdout:1/819: dwrite d9/de/df/d17/f70 [4194304,4194304] 0 2023-10-18T20:58:47.556 INFO:tasks.workunit.client.0.smithi008.stdout:3/880: symlink d0/d3/d15/l115 0 2023-10-18T20:58:47.556 INFO:tasks.workunit.client.0.smithi008.stdout:1/820: creat d9/de/df/d17/d69/ffe x:0 0 0 2023-10-18T20:58:47.556 INFO:tasks.workunit.client.0.smithi008.stdout:3/881: creat d0/d3/d37/d74/f116 x:0 0 0 2023-10-18T20:58:47.566 INFO:tasks.workunit.client.1.smithi060.stdout:4/941: dwrite d4/dc/d2a/d13/d27/d68/d9e/f118 [0,4194304] 0 2023-10-18T20:58:47.568 INFO:tasks.workunit.client.0.smithi008.stdout:2/763: dwrite d1/f1a [0,4194304] 0 2023-10-18T20:58:47.568 INFO:tasks.workunit.client.0.smithi008.stdout:2/764: chown d1/d3/dd/d1c/d3a/d45/d83/de8/la4 110 1 2023-10-18T20:58:47.570 INFO:tasks.workunit.client.1.smithi060.stdout:0/971: dread d3/d8/d11f/d55/d74/d76/f8a [4194304,4194304] 0 2023-10-18T20:58:47.571 INFO:tasks.workunit.client.0.smithi008.stdout:1/821: dread d9/fc [0,4194304] 0 2023-10-18T20:58:47.571 INFO:tasks.workunit.client.0.smithi008.stdout:5/766: dwrite d0/d2/d19/d7c/d31/d82/fc5 [0,4194304] 0 2023-10-18T20:58:47.572 INFO:tasks.workunit.client.0.smithi008.stdout:5/767: unlink d0/d2/d19/d7c/d31/c10c 0 2023-10-18T20:58:47.573 INFO:tasks.workunit.client.0.smithi008.stdout:3/882: symlink d0/d3/de/d13/d35/l117 0 2023-10-18T20:58:47.573 INFO:tasks.workunit.client.0.smithi008.stdout:3/883: fdatasync d0/d3/d15/f44 0 2023-10-18T20:58:47.574 INFO:tasks.workunit.client.0.smithi008.stdout:3/884: chown d0/d3/de/d13/d35/lcf 8864430 1 2023-10-18T20:58:47.575 INFO:tasks.workunit.client.0.smithi008.stdout:9/677: dwrite d2/dc/d1a/d1d/f58 [0,4194304] 0 2023-10-18T20:58:47.576 INFO:tasks.workunit.client.1.smithi060.stdout:5/986: dwrite d0/dd/d76/d10f/ffe [0,4194304] 0 2023-10-18T20:58:47.577 INFO:tasks.workunit.client.1.smithi060.stdout:5/987: write d0/da/d3b/d64/f140 [706405,10812] 0 2023-10-18T20:58:47.577 INFO:tasks.workunit.client.1.smithi060.stdout:5/988: chown d0/c1f 22054 1 2023-10-18T20:58:47.577 INFO:tasks.workunit.client.1.smithi060.stdout:6/974: dwrite d10/d2e/d75/d81/d8b/f9b [0,4194304] 0 2023-10-18T20:58:47.577 INFO:tasks.workunit.client.1.smithi060.stdout:6/975: write d10/d3e/d76/f115 [846614,2810] 0 2023-10-18T20:58:47.578 INFO:tasks.workunit.client.1.smithi060.stdout:6/976: write d10/d3e/d76/f86 [1026395,107792] 0 2023-10-18T20:58:47.578 INFO:tasks.workunit.client.1.smithi060.stdout:6/977: truncate d10/d17/dae/fb7 62612 0 2023-10-18T20:58:47.579 INFO:tasks.workunit.client.1.smithi060.stdout:4/942: mknod d4/dc/d2a/d31/da5/d11c/c128 0 2023-10-18T20:58:47.579 INFO:tasks.workunit.client.1.smithi060.stdout:4/943: write d4/d15/d2b/f59 [2707912,128818] 0 2023-10-18T20:58:47.590 INFO:tasks.workunit.client.1.smithi060.stdout:6/978: creat d10/d17/d54/dd4/d112/f138 x:0 0 0 2023-10-18T20:58:47.591 INFO:tasks.workunit.client.1.smithi060.stdout:6/979: fsync d10/f72 0 2023-10-18T20:58:47.591 INFO:tasks.workunit.client.1.smithi060.stdout:6/980: fdatasync d10/d25/f4f 0 2023-10-18T20:58:47.592 INFO:tasks.workunit.client.1.smithi060.stdout:6/981: chown d10/d17/d28/f68 3932 1 2023-10-18T20:58:47.592 INFO:tasks.workunit.client.1.smithi060.stdout:0/972: read d3/d8/d11f/f5f [1534101,12238] 0 2023-10-18T20:58:47.592 INFO:tasks.workunit.client.1.smithi060.stdout:0/973: chown d3/d8/d11f/d55/d9a/dcf 6649 1 2023-10-18T20:58:47.597 INFO:tasks.workunit.client.1.smithi060.stdout:4/944: link d4/dc/d2a/d39/d53/d76/c8a d4/dc/c129 0 2023-10-18T20:58:47.598 INFO:tasks.workunit.client.1.smithi060.stdout:4/945: creat d4/dc/d2a/d31/da5/d11c/d69/d89/f12a x:0 0 0 2023-10-18T20:58:47.598 INFO:tasks.workunit.client.1.smithi060.stdout:5/989: dread d0/da/d3b/f4c [0,4194304] 0 2023-10-18T20:58:47.605 INFO:tasks.workunit.client.1.smithi060.stdout:6/982: creat d10/d25/df2/f139 x:0 0 0 2023-10-18T20:58:47.605 INFO:tasks.workunit.client.1.smithi060.stdout:0/974: symlink d3/d32/l137 0 2023-10-18T20:58:47.608 INFO:tasks.workunit.client.1.smithi060.stdout:6/983: rename d10/d17/d70/dba/d10b/d120/dd6/f12b to d10/d17/d70/dba/d10b/d120/dd6/f13a 0 2023-10-18T20:58:47.608 INFO:tasks.workunit.client.1.smithi060.stdout:0/975: mknod d3/d8/d11f/d55/d74/d76/d68/d134/c138 0 2023-10-18T20:58:47.610 INFO:tasks.workunit.client.1.smithi060.stdout:4/946: dread d4/dc/d2a/d13/d27/d68/f6b [0,4194304] 0 2023-10-18T20:58:47.611 INFO:tasks.workunit.client.1.smithi060.stdout:4/947: stat d4/dc/d2a/d83/db1 0 2023-10-18T20:58:47.616 INFO:tasks.workunit.client.1.smithi060.stdout:6/984: getdents d10/d17/d28 0 2023-10-18T20:58:47.617 INFO:tasks.workunit.client.1.smithi060.stdout:6/985: write d10/d47/d92/f41 [1140916,48148] 0 2023-10-18T20:58:47.617 INFO:tasks.workunit.client.1.smithi060.stdout:6/986: stat d10/d17/d54/dd4/lf5 0 2023-10-18T20:58:47.621 INFO:tasks.workunit.client.0.smithi008.stdout:2/765: creat d1/d3/dd/d25/d76/d59/d85/fff x:0 0 0 2023-10-18T20:58:47.622 INFO:tasks.workunit.client.0.smithi008.stdout:2/766: write d1/d3/dd/d1c/f55 [459010,115477] 0 2023-10-18T20:58:47.622 INFO:tasks.workunit.client.1.smithi060.stdout:0/976: link d3/fc d3/de5/df1/f139 0 2023-10-18T20:58:47.623 INFO:tasks.workunit.client.1.smithi060.stdout:4/948: mknod d4/dc/d2a/d13/d27/d68/c12b 0 2023-10-18T20:58:47.629 INFO:tasks.workunit.client.0.smithi008.stdout:7/770: dwrite d1/d36/d3d/da3/de8/d5f/f72 [0,4194304] 0 2023-10-18T20:58:47.629 INFO:tasks.workunit.client.0.smithi008.stdout:0/691: rmdir d0/dd 39 2023-10-18T20:58:47.630 INFO:tasks.workunit.client.1.smithi060.stdout:6/987: symlink d10/d17/l13b 0 2023-10-18T20:58:47.644 INFO:tasks.workunit.client.0.smithi008.stdout:5/768: symlink d0/d2/d19/d7c/da7/d114/l117 0 2023-10-18T20:58:47.645 INFO:tasks.workunit.client.0.smithi008.stdout:3/885: creat d0/d84/dad/f118 x:0 0 0 2023-10-18T20:58:47.645 INFO:tasks.workunit.client.0.smithi008.stdout:9/678: symlink d2/dc/d40/lc6 0 2023-10-18T20:58:47.645 INFO:tasks.workunit.client.0.smithi008.stdout:3/886: readlink d0/d3/de/d13/d35/d51/l63 0 2023-10-18T20:58:47.645 INFO:tasks.workunit.client.0.smithi008.stdout:9/679: fdatasync d2/f1b 0 2023-10-18T20:58:47.647 INFO:tasks.workunit.client.1.smithi060.stdout:5/990: dread d0/d47/d7d/da0/f120 [0,4194304] 0 2023-10-18T20:58:47.649 INFO:tasks.workunit.client.0.smithi008.stdout:9/680: creat d2/dc/d40/d6f/d92/fc7 x:0 0 0 2023-10-18T20:58:47.649 INFO:tasks.workunit.client.0.smithi008.stdout:2/767: unlink d1/d3/dd/d25/d76/d59/l9c 0 2023-10-18T20:58:47.649 INFO:tasks.workunit.client.0.smithi008.stdout:7/771: rename d1/da6/l7a to d1/da6/d79/lf0 0 2023-10-18T20:58:47.649 INFO:tasks.workunit.client.0.smithi008.stdout:7/772: chown d1/d36/d3d/da3/de8/lc4 131 1 2023-10-18T20:58:47.652 INFO:tasks.workunit.client.0.smithi008.stdout:2/768: truncate d1/d3/dd/d25/d4d/f68 250727 0 2023-10-18T20:58:47.653 INFO:tasks.workunit.client.0.smithi008.stdout:8/935: dwrite d5/d8/df/d2e/f71 [0,4194304] 0 2023-10-18T20:58:47.657 INFO:tasks.workunit.client.1.smithi060.stdout:3/895: sync 2023-10-18T20:58:47.657 INFO:tasks.workunit.client.1.smithi060.stdout:2/960: sync 2023-10-18T20:58:47.657 INFO:tasks.workunit.client.1.smithi060.stdout:9/890: sync 2023-10-18T20:58:47.658 INFO:tasks.workunit.client.0.smithi008.stdout:5/769: rename d0/d2/d19/d7c/d58/d65/f99 to d0/d2/d9/d9b/dba/f118 0 2023-10-18T20:58:47.658 INFO:tasks.workunit.client.1.smithi060.stdout:2/961: write d0/d3/d9e/f103 [455445,103744] 0 2023-10-18T20:58:47.659 INFO:tasks.workunit.client.1.smithi060.stdout:3/896: creat d0/d22/d50/f134 x:0 0 0 2023-10-18T20:58:47.659 INFO:tasks.workunit.client.1.smithi060.stdout:9/891: truncate d3/d99/d1c/d5a/f8d 291143 0 2023-10-18T20:58:47.659 INFO:tasks.workunit.client.1.smithi060.stdout:3/897: truncate d0/d3c/d3d/f59 1047247 0 2023-10-18T20:58:47.663 INFO:tasks.workunit.client.1.smithi060.stdout:0/977: link d3/d8/d11f/d55/d74/d76/d6b/f120 d3/d8/d11f/d55/d74/d76/f13a 0 2023-10-18T20:58:47.664 INFO:tasks.workunit.client.1.smithi060.stdout:3/898: write d0/d22/f36 [1884587,39061] 0 2023-10-18T20:58:47.664 INFO:tasks.workunit.client.1.smithi060.stdout:3/899: fsync d0/d22/d26/f61 0 2023-10-18T20:58:47.669 INFO:tasks.workunit.client.1.smithi060.stdout:5/991: getdents d0/d6/d9/db1 0 2023-10-18T20:58:47.669 INFO:tasks.workunit.client.1.smithi060.stdout:5/992: truncate d0/d6/d8/d81/f11e 1112839 0 2023-10-18T20:58:47.669 INFO:tasks.workunit.client.1.smithi060.stdout:2/962: rename d0/d16/d85/de3/f121 to d0/d3/d27/d108/f13e 0 2023-10-18T20:58:47.670 INFO:tasks.workunit.client.1.smithi060.stdout:2/963: fdatasync d0/d3/d9e/dc2/fd2 0 2023-10-18T20:58:47.670 INFO:tasks.workunit.client.1.smithi060.stdout:2/964: chown d0/d45/d49/d6e/l126 363 1 2023-10-18T20:58:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:46.121270+0000 mgr.smithi008.flmjzp (mgr.14640) 17 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 2.9 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 129 MiB/s rd, 158 MiB/s wr, 237 op/s 2023-10-18T20:58:47.671 INFO:tasks.workunit.client.1.smithi060.stdout:4/949: dread d4/dc/d2a/d13/d27/d68/d9e/ff6 [0,4194304] 0 2023-10-18T20:58:47.671 INFO:tasks.workunit.client.1.smithi060.stdout:4/950: write d4/dc/f105 [851202,30765] 0 2023-10-18T20:58:47.672 INFO:tasks.workunit.client.1.smithi060.stdout:4/951: chown d4/dc/d2a/d39/d53 64232 1 2023-10-18T20:58:47.672 INFO:tasks.workunit.client.0.smithi008.stdout:8/936: unlink d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/d14b/d8c/db4/c133 0 2023-10-18T20:58:47.673 INFO:tasks.workunit.client.0.smithi008.stdout:8/937: chown d5/d8/df/d9d/d4d/dba/dd4/d50/dbe/f136 202109 1 2023-10-18T20:58:47.673 INFO:tasks.workunit.client.0.smithi008.stdout:8/938: chown d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/d14b/d8c/db4/c12a 101 1 2023-10-18T20:58:47.674 INFO:tasks.workunit.client.0.smithi008.stdout:7/773: write d1/d36/d3d/d3e/d59/f9b [2297772,99754] 0 2023-10-18T20:58:47.674 INFO:tasks.workunit.client.0.smithi008.stdout:7/774: read d1/da6/d4f/fc5 [147217,14583] 0 2023-10-18T20:58:47.674 INFO:tasks.workunit.client.0.smithi008.stdout:7/775: getdents d1/d36/d3d/da3/de8/d5f/dba/ded 0 2023-10-18T20:58:47.674 INFO:tasks.workunit.client.0.smithi008.stdout:7/776: readlink d1/d36/d3d/d3e/d59/d73/lee 0 2023-10-18T20:58:47.675 INFO:tasks.workunit.client.0.smithi008.stdout:7/777: chown d1/d36/d3d/da3/de8/d5f/dba/ddd 14 1 2023-10-18T20:58:47.677 INFO:tasks.workunit.client.1.smithi060.stdout:3/900: getdents d0/d3c/d3d/d4d/d95/dc9 0 2023-10-18T20:58:47.679 INFO:tasks.workunit.client.0.smithi008.stdout:8/939: creat d5/d8/df/d9d/d85/db1/dcc/f152 x:0 0 0 2023-10-18T20:58:47.679 INFO:tasks.workunit.client.1.smithi060.stdout:2/965: dread d0/d45/d49/d55/dae/ffd [0,4194304] 0 2023-10-18T20:58:47.680 INFO:tasks.workunit.client.1.smithi060.stdout:2/966: truncate d0/d8/f2c 5182423 0 2023-10-18T20:58:47.680 INFO:tasks.workunit.client.0.smithi008.stdout:5/770: symlink d0/de/d109/l119 0 2023-10-18T20:58:47.680 INFO:tasks.workunit.client.0.smithi008.stdout:5/771: chown d0/d2/d19/d7c/d31/d3f/d70/dc0 0 1 2023-10-18T20:58:47.685 INFO:tasks.workunit.client.0.smithi008.stdout:8/940: rename d5/d8/df/d2e/l3c to d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/d14b/d8c/db4/l153 0 2023-10-18T20:58:47.685 INFO:tasks.workunit.client.0.smithi008.stdout:8/941: write d5/d8/df/d9d/d4d/f146 [856481,24387] 0 2023-10-18T20:58:47.685 INFO:tasks.workunit.client.0.smithi008.stdout:8/942: dread - d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/f148 zero size 2023-10-18T20:58:47.687 INFO:tasks.workunit.client.0.smithi008.stdout:9/681: write d2/dc/f1c [2313187,44364] 0 2023-10-18T20:58:47.688 INFO:tasks.workunit.client.0.smithi008.stdout:9/682: readlink d2/dc/d17/d7b/l8f 0 2023-10-18T20:58:47.688 INFO:tasks.workunit.client.0.smithi008.stdout:9/683: creat d2/dc/d40/d6f/d92/fc8 x:0 0 0 2023-10-18T20:58:47.688 INFO:tasks.workunit.client.0.smithi008.stdout:0/692: dwrite d0/dd/d19/d5f/d99/f33 [0,4194304] 0 2023-10-18T20:58:47.689 INFO:tasks.workunit.client.0.smithi008.stdout:5/772: truncate d0/d2/d9/d9b/f56 3614431 0 2023-10-18T20:58:47.689 INFO:tasks.workunit.client.0.smithi008.stdout:5/773: readlink d0/de/l9c 0 2023-10-18T20:58:47.689 INFO:tasks.workunit.client.0.smithi008.stdout:3/887: write d0/d3/de/d13/d35/fc9 [1795576,13927] 0 2023-10-18T20:58:47.694 INFO:tasks.workunit.client.1.smithi060.stdout:2/967: mkdir d0/d45/d49/d13f 0 2023-10-18T20:58:47.695 INFO:tasks.workunit.client.1.smithi060.stdout:2/968: chown d0/d16/d81/lc3 63858 1 2023-10-18T20:58:47.700 INFO:tasks.workunit.client.1.smithi060.stdout:4/952: dread d4/dc/d2a/d13/d33/f35 [0,4194304] 0 2023-10-18T20:58:47.701 INFO:tasks.workunit.client.1.smithi060.stdout:2/969: mknod d0/d3/d9e/dc2/c140 0 2023-10-18T20:58:47.701 INFO:tasks.workunit.client.0.smithi008.stdout:8/943: rename d5/d8/df/d9d/d85/db1/dcc/d104/f62 to d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/f154 0 2023-10-18T20:58:47.701 INFO:tasks.workunit.client.0.smithi008.stdout:8/944: creat d5/d8/df/d9d/d85/f155 x:0 0 0 2023-10-18T20:58:47.702 INFO:tasks.workunit.client.1.smithi060.stdout:2/970: mkdir d0/d3/d27/d141 0 2023-10-18T20:58:47.702 INFO:tasks.workunit.client.1.smithi060.stdout:2/971: chown d0/d45 92 1 2023-10-18T20:58:47.703 INFO:tasks.workunit.client.1.smithi060.stdout:2/972: read - d0/d3/d27/d108/f112 zero size 2023-10-18T20:58:47.705 INFO:tasks.workunit.client.0.smithi008.stdout:7/778: write d1/d36/f7e [1885300,107468] 0 2023-10-18T20:58:47.706 INFO:tasks.workunit.client.1.smithi060.stdout:0/978: dread d3/d8/f2d [0,4194304] 0 2023-10-18T20:58:47.706 INFO:tasks.workunit.client.1.smithi060.stdout:2/973: creat d0/d45/f142 x:0 0 0 2023-10-18T20:58:47.706 INFO:tasks.workunit.client.1.smithi060.stdout:2/974: readlink d0/d45/dc9/d4a/l50 0 2023-10-18T20:58:47.707 INFO:tasks.workunit.client.0.smithi008.stdout:0/693: creat d0/d7c/d9a/d8a/d8f/fd5 x:0 0 0 2023-10-18T20:58:47.709 INFO:tasks.workunit.client.1.smithi060.stdout:2/975: unlink d0/d45/dc9/f8e 0 2023-10-18T20:58:47.710 INFO:tasks.workunit.client.0.smithi008.stdout:3/888: unlink d0/d3/f97 0 2023-10-18T20:58:47.710 INFO:tasks.workunit.client.0.smithi008.stdout:7/779: mknod d1/d36/d3d/da3/de8/d5f/dba/ddd/cf1 0 2023-10-18T20:58:47.711 INFO:tasks.workunit.client.0.smithi008.stdout:3/889: stat d0/d3/de/d13/d35/dbf/de9/df2 0 2023-10-18T20:58:47.712 INFO:tasks.workunit.client.0.smithi008.stdout:0/694: unlink d0/dd/df/c25 0 2023-10-18T20:58:47.716 INFO:tasks.workunit.client.0.smithi008.stdout:7/780: mkdir d1/d36/d3d/da3/de8/dbe/df2 0 2023-10-18T20:58:47.716 INFO:tasks.workunit.client.0.smithi008.stdout:7/781: truncate d1/d36/d3d/d3e/d59/d73/fbd 141790 0 2023-10-18T20:58:47.723 INFO:tasks.workunit.client.1.smithi060.stdout:6/988: dwrite d10/d2e/d75/d81/f130 [0,4194304] 0 2023-10-18T20:58:47.724 INFO:tasks.workunit.client.0.smithi008.stdout:9/684: dread d2/dc/d17/d19/f41 [0,4194304] 0 2023-10-18T20:58:47.726 INFO:tasks.workunit.client.1.smithi060.stdout:2/976: creat d0/d8/f143 x:0 0 0 2023-10-18T20:58:47.726 INFO:tasks.workunit.client.1.smithi060.stdout:2/977: write d0/d16/d81/f13c [841590,92255] 0 2023-10-18T20:58:47.727 INFO:tasks.workunit.client.1.smithi060.stdout:2/978: creat d0/d45/f144 x:0 0 0 2023-10-18T20:58:47.727 INFO:tasks.workunit.client.1.smithi060.stdout:2/979: chown d0/d3/d9e/dc2/lf3 13 1 2023-10-18T20:58:47.728 INFO:tasks.workunit.client.0.smithi008.stdout:0/695: creat d0/dd/fd6 x:0 0 0 2023-10-18T20:58:47.728 INFO:tasks.workunit.client.0.smithi008.stdout:3/890: mknod d0/d3/da9/c119 0 2023-10-18T20:58:47.729 INFO:tasks.workunit.client.0.smithi008.stdout:3/891: chown d0/d3/de/d13/d35/dbf/de9 1 1 2023-10-18T20:58:47.729 INFO:tasks.workunit.client.0.smithi008.stdout:3/892: chown d0/d3/d42/d52/f73 30617 1 2023-10-18T20:58:47.729 INFO:tasks.workunit.client.0.smithi008.stdout:3/893: write d0/d3/d42/d88/dae/f10d [962125,57130] 0 2023-10-18T20:58:47.730 INFO:tasks.workunit.client.1.smithi060.stdout:0/979: dread d3/fc [0,4194304] 0 2023-10-18T20:58:47.730 INFO:tasks.workunit.client.1.smithi060.stdout:0/980: write d3/d8/d11f/f3d [339999,102931] 0 2023-10-18T20:58:47.732 INFO:tasks.workunit.client.1.smithi060.stdout:0/981: rename d3/d8/d11f/d55/fda to d3/d8/d11f/d55/d74/d76/d68/d7f/f13b 0 2023-10-18T20:58:47.732 INFO:tasks.workunit.client.1.smithi060.stdout:0/982: creat d3/d8/dac/f13c x:0 0 0 2023-10-18T20:58:47.736 INFO:tasks.workunit.client.1.smithi060.stdout:0/983: link d3/d8/d3c/d87/ff3 d3/d80/db5/d128/f13d 0 2023-10-18T20:58:47.737 INFO:tasks.workunit.client.1.smithi060.stdout:2/980: write d0/d45/dc9/d102/d13b/fc0 [690578,102519] 0 2023-10-18T20:58:47.741 INFO:tasks.workunit.client.0.smithi008.stdout:7/782: dread d1/d3/f53 [0,4194304] 0 2023-10-18T20:58:47.745 INFO:tasks.workunit.client.0.smithi008.stdout:7/783: mknod d1/d36/d3d/da3/cf3 0 2023-10-18T20:58:47.745 INFO:tasks.workunit.client.0.smithi008.stdout:7/784: getdents d1/d36/d3d/da3/de8/d5f/dba/ded 0 2023-10-18T20:58:47.746 INFO:tasks.workunit.client.1.smithi060.stdout:0/984: symlink d3/d8/d3c/d87/dba/l13e 0 2023-10-18T20:58:47.747 INFO:tasks.workunit.client.0.smithi008.stdout:6/881: sync 2023-10-18T20:58:47.747 INFO:tasks.workunit.client.1.smithi060.stdout:0/985: fsync d3/d8/d11f/d55/d9a/fcb 0 2023-10-18T20:58:47.748 INFO:tasks.workunit.client.1.smithi060.stdout:0/986: read d3/d8/d11f/f40 [3341841,54219] 0 2023-10-18T20:58:47.748 INFO:tasks.workunit.client.1.smithi060.stdout:0/987: truncate d3/d8/d11f/d55/d74/d76/f121 1750483 0 2023-10-18T20:58:47.748 INFO:tasks.workunit.client.1.smithi060.stdout:2/981: truncate d0/f5d 752524 0 2023-10-18T20:58:47.752 INFO:tasks.workunit.client.1.smithi060.stdout:2/982: mkdir d0/d45/d49/d6e/d145 0 2023-10-18T20:58:47.756 INFO:tasks.workunit.client.0.smithi008.stdout:4/723: sync 2023-10-18T20:58:47.756 INFO:tasks.workunit.client.0.smithi008.stdout:4/724: stat d0/d17/d5b/f68 0 2023-10-18T20:58:47.759 INFO:tasks.workunit.client.0.smithi008.stdout:9/685: getdents d2/dc/d3d 0 2023-10-18T20:58:47.759 INFO:tasks.workunit.client.0.smithi008.stdout:6/882: mknod df/d3c/d77/da9/c129 0 2023-10-18T20:58:47.759 INFO:tasks.workunit.client.0.smithi008.stdout:6/883: fdatasync df/d15/d48/ded/d108/dcf/d58/dec/f8f 0 2023-10-18T20:58:47.759 INFO:tasks.workunit.client.0.smithi008.stdout:9/686: truncate d2/dc/d17/d7b/fa2 784156 0 2023-10-18T20:58:47.760 INFO:tasks.workunit.client.0.smithi008.stdout:6/884: chown df/d19/cba 18 1 2023-10-18T20:58:47.760 INFO:tasks.workunit.client.0.smithi008.stdout:6/885: chown df/d3c/d77/f11c 9389 1 2023-10-18T20:58:47.760 INFO:tasks.workunit.client.0.smithi008.stdout:6/886: chown df/d15/d48/d81/d116/dbf 5247408 1 2023-10-18T20:58:47.760 INFO:tasks.workunit.client.0.smithi008.stdout:6/887: fdatasync df/d15/d48/d81/d116/dbf/f75 0 2023-10-18T20:58:47.760 INFO:tasks.workunit.client.0.smithi008.stdout:6/888: unlink df/d15/d48/d81/d116/lbc 0 2023-10-18T20:58:47.761 INFO:tasks.workunit.client.0.smithi008.stdout:6/889: write df/d3c/fd2 [144992,106266] 0 2023-10-18T20:58:47.761 INFO:tasks.workunit.client.1.smithi060.stdout:6/989: dread d10/d17/d28/f26 [0,4194304] 0 2023-10-18T20:58:47.762 INFO:tasks.workunit.client.0.smithi008.stdout:9/687: mkdir d2/dc/d40/dbc/dc9 0 2023-10-18T20:58:47.762 INFO:tasks.workunit.client.0.smithi008.stdout:9/688: truncate d2/dc/d17/d19/d4a/fb3 555690 0 2023-10-18T20:58:47.765 INFO:tasks.workunit.client.1.smithi060.stdout:2/983: creat d0/d45/dc9/d102/d123/f146 x:0 0 0 2023-10-18T20:58:47.766 INFO:tasks.workunit.client.0.smithi008.stdout:7/785: dread d1/d36/d3d/d3e/f55 [0,4194304] 0 2023-10-18T20:58:47.766 INFO:tasks.workunit.client.0.smithi008.stdout:7/786: getdents d1/d36/d3d/da3/de8/dbe/df2 0 2023-10-18T20:58:47.769 INFO:tasks.workunit.client.0.smithi008.stdout:9/689: dread d2/dc/d40/d6f/d92/d59/f65 [0,4194304] 0 2023-10-18T20:58:47.769 INFO:tasks.workunit.client.0.smithi008.stdout:9/690: unlink d2/dc/d1a/c35 0 2023-10-18T20:58:47.769 INFO:tasks.workunit.client.0.smithi008.stdout:9/691: creat d2/d8/da0/fca x:0 0 0 2023-10-18T20:58:47.770 INFO:tasks.workunit.client.0.smithi008.stdout:9/692: chown d2/d8/l71 473 1 2023-10-18T20:58:47.772 INFO:tasks.workunit.client.0.smithi008.stdout:2/769: dwrite d1/d3/dd/d1c/d3a/d45/d83/de8/fd1 [0,4194304] 0 2023-10-18T20:58:47.775 INFO:tasks.workunit.client.0.smithi008.stdout:6/890: rmdir df/d15/d48 39 2023-10-18T20:58:47.775 INFO:tasks.workunit.client.0.smithi008.stdout:6/891: chown df/d15/d48/ded/d108/dcf/d7e 20 1 2023-10-18T20:58:47.779 INFO:tasks.workunit.client.1.smithi060.stdout:9/892: dwrite d3/d99/d1c/f6a [0,4194304] 0 2023-10-18T20:58:47.779 INFO:tasks.workunit.client.1.smithi060.stdout:6/990: dread fc [0,4194304] 0 2023-10-18T20:58:47.781 INFO:tasks.workunit.client.1.smithi060.stdout:2/984: rename d0/d45/f144 to d0/d45/d49/d13f/f147 0 2023-10-18T20:58:47.783 INFO:tasks.workunit.client.0.smithi008.stdout:8/945: dwrite d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/f10b [0,4194304] 0 2023-10-18T20:58:47.783 INFO:tasks.workunit.client.0.smithi008.stdout:8/946: fsync d5/d8/df/d2e/d13b/deb/f105 0 2023-10-18T20:58:47.784 INFO:tasks.workunit.client.0.smithi008.stdout:8/947: chown d5/d8/df/d9d/d4d/dba/dd4/d9f/dbb/c141 68 1 2023-10-18T20:58:47.795 INFO:tasks.workunit.client.0.smithi008.stdout:2/770: creat d1/d3/dd/d1c/f100 x:0 0 0 2023-10-18T20:58:47.795 INFO:tasks.workunit.client.0.smithi008.stdout:6/892: mknod df/d19/c12a 0 2023-10-18T20:58:47.796 INFO:tasks.workunit.client.1.smithi060.stdout:4/953: write d4/dc/d2a/d13/f87 [737819,85510] 0 2023-10-18T20:58:47.801 INFO:tasks.workunit.client.0.smithi008.stdout:8/948: mkdir d5/d8/df/d2e/d13b/d117/d156 0 2023-10-18T20:58:47.804 INFO:tasks.workunit.client.1.smithi060.stdout:2/985: dread d0/d16/d85/de3/f10b [0,4194304] 0 2023-10-18T20:58:47.805 INFO:tasks.workunit.client.1.smithi060.stdout:2/986: fdatasync d0/d3/d27/d108/fb0 0 2023-10-18T20:58:47.805 INFO:tasks.workunit.client.1.smithi060.stdout:2/987: chown d0/d8/d87/f8d 4885378 1 2023-10-18T20:58:47.805 INFO:tasks.workunit.client.1.smithi060.stdout:3/901: dwrite d0/d22/d26/d2c/da0/fc7 [0,4194304] 0 2023-10-18T20:58:47.806 INFO:tasks.workunit.client.1.smithi060.stdout:3/902: fdatasync d0/fc 0 2023-10-18T20:58:47.806 INFO:tasks.workunit.client.0.smithi008.stdout:2/771: mkdir d1/d3/dd/d1c/d3a/d45/daa/d101 0 2023-10-18T20:58:47.809 INFO:tasks.workunit.client.1.smithi060.stdout:6/991: mknod d10/d47/c13c 0 2023-10-18T20:58:47.810 INFO:tasks.workunit.client.0.smithi008.stdout:8/949: unlink d5/d8/df/f29 0 2023-10-18T20:58:47.810 INFO:tasks.workunit.client.0.smithi008.stdout:6/893: truncate df/d15/d48/d81/d116/d4c/fce 33322 0 2023-10-18T20:58:47.810 INFO:tasks.workunit.client.0.smithi008.stdout:6/894: chown df/d15/d48/d81/d116/fb5 93 1 2023-10-18T20:58:47.811 INFO:tasks.workunit.client.1.smithi060.stdout:4/954: symlink d4/dc/d2a/d31/da5/d11c/dc7/l12c 0 2023-10-18T20:58:47.815 INFO:tasks.workunit.client.1.smithi060.stdout:2/988: read d0/d3/d9e/dce/fef [197024,69490] 0 2023-10-18T20:58:47.816 INFO:tasks.workunit.client.1.smithi060.stdout:3/903: symlink d0/d3c/d3d/d4d/d95/d123/l135 0 2023-10-18T20:58:47.816 INFO:tasks.workunit.client.1.smithi060.stdout:4/955: mkdir d4/dc/d2a/d39/d12d 0 2023-10-18T20:58:47.817 INFO:tasks.workunit.client.1.smithi060.stdout:6/992: getdents d10/d17/d70/dba/d10b 0 2023-10-18T20:58:47.818 INFO:tasks.workunit.client.0.smithi008.stdout:8/950: mkdir d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/df5/d157 0 2023-10-18T20:58:47.818 INFO:tasks.workunit.client.1.smithi060.stdout:9/893: dread d3/d99/d1c/d116/d2d/faf [0,4194304] 0 2023-10-18T20:58:47.819 INFO:tasks.workunit.client.1.smithi060.stdout:9/894: creat d3/d99/d1c/f140 x:0 0 0 2023-10-18T20:58:47.819 INFO:tasks.workunit.client.1.smithi060.stdout:9/895: fdatasync d3/d99/d1c/d116/d80/ff6 0 2023-10-18T20:58:47.820 INFO:tasks.workunit.client.1.smithi060.stdout:4/956: write d4/dc/f105 [406818,3840] 0 2023-10-18T20:58:47.823 INFO:tasks.workunit.client.1.smithi060.stdout:3/904: dread d0/d22/d26/d79/f113 [0,4194304] 0 2023-10-18T20:58:47.823 INFO:tasks.workunit.client.1.smithi060.stdout:3/905: readlink d0/d22/d26/d2c/ldd 0 2023-10-18T20:58:47.825 INFO:tasks.workunit.client.1.smithi060.stdout:9/896: symlink d3/d99/d19/d54/l141 0 2023-10-18T20:58:47.825 INFO:tasks.workunit.client.1.smithi060.stdout:9/897: creat d3/d99/d1c/d116/d2d/dfc/f142 x:0 0 0 2023-10-18T20:58:47.826 INFO:tasks.workunit.client.1.smithi060.stdout:8/954: sync 2023-10-18T20:58:47.826 INFO:tasks.workunit.client.1.smithi060.stdout:8/955: stat d4/d9/l4b 0 2023-10-18T20:58:47.832 INFO:tasks.workunit.client.1.smithi060.stdout:8/956: mknod d4/d9/d31/d6f/dfa/d12c/c12e 0 2023-10-18T20:58:47.833 INFO:tasks.workunit.client.1.smithi060.stdout:4/957: rename d4/dc/d2a/d39/d53/d76/d99 to d4/dc/d2a/d39/d12e 0 2023-10-18T20:58:47.833 INFO:tasks.workunit.client.1.smithi060.stdout:4/958: write d4/dc/d2a/f7 [6206519,78312] 0 2023-10-18T20:58:47.833 INFO:tasks.workunit.client.1.smithi060.stdout:4/959: chown d4/dc/d2a/d31/da5/d11c/d69/d89 2168 1 2023-10-18T20:58:47.834 INFO:tasks.workunit.client.1.smithi060.stdout:8/957: link d4/d9/d37/c41 d4/d9/d31/d35/c12f 0 2023-10-18T20:58:47.834 INFO:tasks.workunit.client.1.smithi060.stdout:8/958: fdatasync d4/d9/d31/d6f/dfa/d7b/f7d 0 2023-10-18T20:58:47.835 INFO:tasks.workunit.client.1.smithi060.stdout:8/959: mkdir d4/d9/d31/d35/d9f/da3/ddb/d130 0 2023-10-18T20:58:47.835 INFO:tasks.workunit.client.1.smithi060.stdout:8/960: chown d4/d9/d31/d35/d9f/da3/cba 72233465 1 2023-10-18T20:58:47.836 INFO:tasks.workunit.client.1.smithi060.stdout:8/961: chown d4/d9/d4f/d74/de5 14 1 2023-10-18T20:58:47.836 INFO:tasks.workunit.client.1.smithi060.stdout:8/962: chown d4/d9/d37/d4e/dd9 13833 1 2023-10-18T20:58:47.848 INFO:tasks.workunit.client.1.smithi060.stdout:4/960: dread d4/dc/d2a/d13/d33/f35 [4194304,4194304] 0 2023-10-18T20:58:47.850 INFO:tasks.workunit.client.1.smithi060.stdout:4/961: mkdir d4/dc/d2a/d83/db1/d12f 0 2023-10-18T20:58:47.850 INFO:tasks.workunit.client.1.smithi060.stdout:4/962: creat d4/d15/d2b/f130 x:0 0 0 2023-10-18T20:58:47.851 INFO:tasks.workunit.client.1.smithi060.stdout:4/963: mknod d4/dc/d2a/d39/d53/d65/d8d/c131 0 2023-10-18T20:58:47.852 INFO:tasks.workunit.client.1.smithi060.stdout:4/964: rmdir d4/dc/d40/da8 39 2023-10-18T20:58:47.853 INFO:tasks.workunit.client.1.smithi060.stdout:4/965: stat d4/dc/d2a/d31/da5/d11c/d69/d89/ff9 0 2023-10-18T20:58:47.853 INFO:tasks.workunit.client.1.smithi060.stdout:4/966: creat d4/dc/d2a/d39/d53/d76/da7/f132 x:0 0 0 2023-10-18T20:58:47.875 INFO:tasks.workunit.client.0.smithi008.stdout:6/895: mknod df/d15/d48/ded/d108/dcf/d58/c12b 0 2023-10-18T20:58:47.882 INFO:tasks.workunit.client.0.smithi008.stdout:7/787: dwrite d1/da6/d79/db5/fd7 [0,4194304] 0 2023-10-18T20:58:47.885 INFO:tasks.workunit.client.1.smithi060.stdout:2/989: write d0/d45/fb5 [1932728,119288] 0 2023-10-18T20:58:47.886 INFO:tasks.workunit.client.0.smithi008.stdout:8/951: rmdir d5/d8/df/dce/dfa/d125 39 2023-10-18T20:58:47.886 INFO:tasks.workunit.client.0.smithi008.stdout:8/952: creat d5/d8/df/d9d/d4d/f158 x:0 0 0 2023-10-18T20:58:47.890 INFO:tasks.workunit.client.1.smithi060.stdout:3/906: dread d0/d3c/d3d/d4d/f97 [0,4194304] 0 2023-10-18T20:58:47.892 INFO:tasks.workunit.client.0.smithi008.stdout:0/696: dwrite d0/dd/df/f1c [0,4194304] 0 2023-10-18T20:58:47.892 INFO:tasks.workunit.client.1.smithi060.stdout:3/907: mkdir d0/d22/d26/d79/db3/d136 0 2023-10-18T20:58:47.892 INFO:tasks.workunit.client.1.smithi060.stdout:3/908: chown d0/d3c/lde 14651 1 2023-10-18T20:58:47.894 INFO:tasks.workunit.client.0.smithi008.stdout:4/725: dwrite d0/d3/d21/fa2 [0,4194304] 0 2023-10-18T20:58:47.895 INFO:tasks.workunit.client.0.smithi008.stdout:4/726: write d0/d3/d21/d42/f50 [4892512,118848] 0 2023-10-18T20:58:47.895 INFO:tasks.workunit.client.0.smithi008.stdout:4/727: chown d0/d58/d83 1 1 2023-10-18T20:58:47.896 INFO:tasks.workunit.client.1.smithi060.stdout:3/909: rename d0/d3c/d3d/d4d/d95/ffc to d0/d3c/d3d/d82/f137 0 2023-10-18T20:58:47.897 INFO:tasks.workunit.client.1.smithi060.stdout:3/910: symlink d0/d22/d26/d2b/l138 0 2023-10-18T20:58:47.901 INFO:tasks.workunit.client.0.smithi008.stdout:0/697: rename d0/dd/d19/d24/f86 to d0/d7c/d9a/d8a/d8f/da5/fd7 0 2023-10-18T20:58:47.903 INFO:tasks.workunit.client.0.smithi008.stdout:3/894: dwrite d0/f59 [0,4194304] 0 2023-10-18T20:58:47.905 INFO:tasks.workunit.client.0.smithi008.stdout:3/895: mkdir d0/d4a/d64/d80/d11a 0 2023-10-18T20:58:47.911 INFO:tasks.workunit.client.1.smithi060.stdout:9/898: dread d3/d99/d1c/d5a/d5d/f78 [0,4194304] 0 2023-10-18T20:58:47.912 INFO:tasks.workunit.client.1.smithi060.stdout:9/899: write d3/d99/d19/d54/ff9 [257262,13920] 0 2023-10-18T20:58:47.912 INFO:tasks.workunit.client.1.smithi060.stdout:9/900: write d3/d99/d1c/d116/d2d/dfc/f142 [772333,95116] 0 2023-10-18T20:58:47.912 INFO:tasks.workunit.client.1.smithi060.stdout:9/901: dread - d3/d99/d1c/d116/d2d/dfc/f137 zero size 2023-10-18T20:58:47.913 INFO:tasks.workunit.client.1.smithi060.stdout:9/902: chown d3/d99/d1c/d5a/d5d/d56/fd7 65792 1 2023-10-18T20:58:47.918 INFO:tasks.workunit.client.1.smithi060.stdout:8/963: write d4/f30 [1509730,70085] 0 2023-10-18T20:58:47.918 INFO:tasks.workunit.client.1.smithi060.stdout:8/964: stat d4/d9/d31/f66 0 2023-10-18T20:58:47.918 INFO:tasks.workunit.client.1.smithi060.stdout:8/965: fsync d4/d9/d31/d6f/f8c 0 2023-10-18T20:58:47.922 INFO:tasks.workunit.client.0.smithi008.stdout:8/953: write d5/d8/df/d9d/d4d/f4f [8285331,126634] 0 2023-10-18T20:58:47.924 INFO:tasks.workunit.client.1.smithi060.stdout:8/966: truncate d4/d9/d31/d6f/dbd/ff1 7124671 0 2023-10-18T20:58:47.926 INFO:tasks.workunit.client.0.smithi008.stdout:2/772: dwrite d1/f18 [0,4194304] 0 2023-10-18T20:58:47.927 INFO:tasks.workunit.client.0.smithi008.stdout:2/773: write d1/d3/dd/d1c/f100 [142376,24171] 0 2023-10-18T20:58:47.927 INFO:tasks.workunit.client.0.smithi008.stdout:2/774: chown d1/d3/dd/d25/d5c/cbf 113020442 1 2023-10-18T20:58:47.927 INFO:tasks.workunit.client.0.smithi008.stdout:2/775: fsync d1/d3/dd/f50 0 2023-10-18T20:58:47.933 INFO:tasks.workunit.client.0.smithi008.stdout:8/954: dread d5/d8/df/d9d/d85/db1/dcc/d104/ffe [0,4194304] 0 2023-10-18T20:58:47.933 INFO:tasks.workunit.client.0.smithi008.stdout:8/955: fsync d5/d8/df/d9d/d6c/f46 0 2023-10-18T20:58:47.934 INFO:tasks.workunit.client.0.smithi008.stdout:1/822: sync 2023-10-18T20:58:47.934 INFO:tasks.workunit.client.0.smithi008.stdout:1/823: fsync d9/fda 0 2023-10-18T20:58:47.936 INFO:tasks.workunit.client.0.smithi008.stdout:1/824: truncate d9/de/df/fe1 1012901 0 2023-10-18T20:58:47.936 INFO:tasks.workunit.client.0.smithi008.stdout:1/825: chown d9/de/df/f7f 348 1 2023-10-18T20:58:47.940 INFO:tasks.workunit.client.1.smithi060.stdout:4/967: dwrite d4/dc/d2a/d83/f100 [0,4194304] 0 2023-10-18T20:58:47.941 INFO:tasks.workunit.client.1.smithi060.stdout:4/968: write d4/dc/d2a/d13/d27/d68/f6d [1851557,35837] 0 2023-10-18T20:58:47.941 INFO:tasks.workunit.client.1.smithi060.stdout:6/993: dwrite d10/d17/d54/db1/fbd [0,4194304] 0 2023-10-18T20:58:47.941 INFO:tasks.workunit.client.1.smithi060.stdout:4/969: chown d4/dc/d2a/d39/d53/d76/da7/fab 4 1 2023-10-18T20:58:47.942 INFO:tasks.workunit.client.1.smithi060.stdout:9/903: dread d3/d58/f7b [0,4194304] 0 2023-10-18T20:58:47.942 INFO:tasks.workunit.client.0.smithi008.stdout:0/698: dread d0/d7c/d9a/d8a/fae [0,4194304] 0 2023-10-18T20:58:47.942 INFO:tasks.workunit.client.0.smithi008.stdout:0/699: chown d0/c49 21846772 1 2023-10-18T20:58:47.943 INFO:tasks.workunit.client.0.smithi008.stdout:0/700: write d0/d7c/f5b [453511,52097] 0 2023-10-18T20:58:47.944 INFO:tasks.workunit.client.0.smithi008.stdout:1/826: creat d9/de/df/dc3/fff x:0 0 0 2023-10-18T20:58:47.946 INFO:tasks.workunit.client.0.smithi008.stdout:0/701: truncate d0/dd/df/f1c 3449912 0 2023-10-18T20:58:47.947 INFO:tasks.workunit.client.0.smithi008.stdout:1/827: truncate d9/fc 634684 0 2023-10-18T20:58:47.948 INFO:tasks.workunit.client.0.smithi008.stdout:1/828: chown d9/de/df/d17/d1e/d3c/c46 396 1 2023-10-18T20:58:47.948 INFO:tasks.workunit.client.0.smithi008.stdout:1/829: readlink d9/de/df/d17/d1e/d3c/l43 0 2023-10-18T20:58:47.948 INFO:tasks.workunit.client.0.smithi008.stdout:1/830: chown d9/de/fb0 0 1 2023-10-18T20:58:47.949 INFO:tasks.workunit.client.0.smithi008.stdout:1/831: truncate d9/de/df/dc3/fff 893701 0 2023-10-18T20:58:47.949 INFO:tasks.workunit.client.0.smithi008.stdout:1/832: chown d9/de/f15 955652454 1 2023-10-18T20:58:47.951 INFO:tasks.workunit.client.0.smithi008.stdout:8/956: dread d5/d8/df/d9d/d4d/db5/f6e [0,4194304] 0 2023-10-18T20:58:47.953 INFO:tasks.workunit.client.0.smithi008.stdout:6/896: dwrite df/d3c/d77/f11c [0,4194304] 0 2023-10-18T20:58:47.954 INFO:tasks.workunit.client.0.smithi008.stdout:6/897: write df/d15/d48/ded/fe4 [87135,123769] 0 2023-10-18T20:58:47.954 INFO:tasks.workunit.client.0.smithi008.stdout:6/898: write df/d15/d48/ded/d108/dcf/d58/dec/daa/fd9 [357700,28359] 0 2023-10-18T20:58:47.955 INFO:tasks.workunit.client.1.smithi060.stdout:3/911: dwrite d0/d22/d50/f134 [0,4194304] 0 2023-10-18T20:58:47.955 INFO:tasks.workunit.client.1.smithi060.stdout:6/994: rename d10/l12 to d10/d128/l13d 0 2023-10-18T20:58:47.955 INFO:tasks.workunit.client.0.smithi008.stdout:1/833: creat d9/de/df/d17/d1e/d7d/d89/f100 x:0 0 0 2023-10-18T20:58:47.956 INFO:tasks.workunit.client.0.smithi008.stdout:1/834: chown d9/de/df/d17/d55/lf4 75 1 2023-10-18T20:58:47.956 INFO:tasks.workunit.client.0.smithi008.stdout:7/788: dwrite d1/d36/d3d/d3e/d59/d73/d7b/fc7 [0,4194304] 0 2023-10-18T20:58:47.957 INFO:tasks.workunit.client.1.smithi060.stdout:8/967: dread d4/d9/d31/d35/d9f/da3/f60 [0,4194304] 0 2023-10-18T20:58:47.958 INFO:tasks.workunit.client.1.smithi060.stdout:8/968: symlink d4/d9/d31/d35/d9f/l131 0 2023-10-18T20:58:47.959 INFO:tasks.workunit.client.0.smithi008.stdout:0/702: rename d0/d3a/f84 to d0/d90/fd8 0 2023-10-18T20:58:47.960 INFO:tasks.workunit.client.1.smithi060.stdout:8/969: mknod d4/d9/d31/d6f/dbd/c132 0 2023-10-18T20:58:47.962 INFO:tasks.workunit.client.1.smithi060.stdout:6/995: rename d10/d2e/d75/d81/d8b to d10/d13e 0 2023-10-18T20:58:47.962 INFO:tasks.workunit.client.1.smithi060.stdout:6/996: truncate d10/d47/fcc 122261 0 2023-10-18T20:58:47.963 INFO:tasks.workunit.client.1.smithi060.stdout:6/997: truncate d10/d17/d7a/fb4 579964 0 2023-10-18T20:58:47.964 INFO:tasks.workunit.client.1.smithi060.stdout:8/970: rename d4/d9/d4f/f92 to d4/d9/d88/ded/f133 0 2023-10-18T20:58:47.964 INFO:tasks.workunit.client.1.smithi060.stdout:6/998: creat d10/d13e/dc9/f13f x:0 0 0 2023-10-18T20:58:47.966 INFO:tasks.workunit.client.1.smithi060.stdout:8/971: mkdir d4/d9/d31/d35/d9f/da3/ddb/de9/d134 0 2023-10-18T20:58:47.966 INFO:tasks.workunit.client.0.smithi008.stdout:4/728: dwrite d0/d17/d5b/d99/fb6 [0,4194304] 0 2023-10-18T20:58:47.967 INFO:tasks.workunit.client.1.smithi060.stdout:8/972: stat d4/d9/d31/d35/d9f/da3/caa 0 2023-10-18T20:58:47.968 INFO:tasks.workunit.client.1.smithi060.stdout:9/904: write d3/d99/d19/d54/d11d/f53 [2715348,96191] 0 2023-10-18T20:58:47.968 INFO:tasks.workunit.client.1.smithi060.stdout:3/912: write d0/d22/d26/d29/f9a [731684,27606] 0 2023-10-18T20:58:47.969 INFO:tasks.workunit.client.1.smithi060.stdout:9/905: getdents d3/d99/d1c/d116/d80/d112 0 2023-10-18T20:58:47.969 INFO:tasks.workunit.client.1.smithi060.stdout:9/906: creat d3/d99/d1c/d116/d80/da0/dc2/d9e/f143 x:0 0 0 2023-10-18T20:58:47.969 INFO:tasks.workunit.client.1.smithi060.stdout:3/913: mkdir d0/d3c/d3d/d82/d129/d139 0 2023-10-18T20:58:47.970 INFO:tasks.workunit.client.1.smithi060.stdout:3/914: chown d0/d3c/f40 41 1 2023-10-18T20:58:47.970 INFO:tasks.workunit.client.1.smithi060.stdout:8/973: rename d4/d9/d31/d6f/dfa/l11b to d4/l135 0 2023-10-18T20:58:47.972 INFO:tasks.workunit.client.1.smithi060.stdout:9/907: getdents d3/d99/d1c/d116/d80/da0/dc2/d9e/d131 0 2023-10-18T20:58:47.975 INFO:tasks.workunit.client.1.smithi060.stdout:8/974: creat d4/d9/d4f/d74/de5/d110/f136 x:0 0 0 2023-10-18T20:58:47.975 INFO:tasks.workunit.client.1.smithi060.stdout:9/908: getdents d3 0 2023-10-18T20:58:47.980 INFO:tasks.workunit.client.0.smithi008.stdout:6/899: symlink df/d15/d48/ded/d108/dcf/d58/dec/daa/l12c 0 2023-10-18T20:58:47.981 INFO:tasks.workunit.client.0.smithi008.stdout:6/900: creat df/d15/d48/d81/d116/dbf/f12d x:0 0 0 2023-10-18T20:58:47.986 INFO:tasks.workunit.client.0.smithi008.stdout:1/835: creat d9/df1/f101 x:0 0 0 2023-10-18T20:58:47.986 INFO:tasks.workunit.client.0.smithi008.stdout:1/836: fdatasync d9/f7a 0 2023-10-18T20:58:47.986 INFO:tasks.workunit.client.0.smithi008.stdout:1/837: truncate d9/de/df/d17/d55/fb5 967819 0 2023-10-18T20:58:47.987 INFO:tasks.workunit.client.1.smithi060.stdout:8/975: mkdir d4/d9/d31/d35/d9f/da3/dd8/d10f/d137 0 2023-10-18T20:58:47.987 INFO:tasks.workunit.client.1.smithi060.stdout:9/909: mknod d3/d99/d1c/d116/d80/da0/dc2/d9e/c144 0 2023-10-18T20:58:47.987 INFO:tasks.workunit.client.1.smithi060.stdout:9/910: write d3/d99/d19/f90 [1637091,17951] 0 2023-10-18T20:58:47.987 INFO:tasks.workunit.client.1.smithi060.stdout:9/911: write d3/d99/d1c/d116/d2d/dfc/f137 [762598,118825] 0 2023-10-18T20:58:47.988 INFO:tasks.workunit.client.1.smithi060.stdout:9/912: fdatasync d3/d99/d1c/d5a/fe7 0 2023-10-18T20:58:47.988 INFO:tasks.workunit.client.1.smithi060.stdout:9/913: chown d3/d99/d19/le8 97553 1 2023-10-18T20:58:47.988 INFO:tasks.workunit.client.1.smithi060.stdout:2/990: dwrite d0/d16/d81/f13c [0,4194304] 0 2023-10-18T20:58:47.988 INFO:tasks.workunit.client.1.smithi060.stdout:2/991: chown d0/d3/d9e/dc2/f132 1 1 2023-10-18T20:58:47.988 INFO:tasks.workunit.client.1.smithi060.stdout:2/992: creat d0/d45/d49/d55/dae/f148 x:0 0 0 2023-10-18T20:58:47.991 INFO:tasks.workunit.client.1.smithi060.stdout:2/993: creat d0/d45/d129/f149 x:0 0 0 2023-10-18T20:58:47.996 INFO:tasks.workunit.client.0.smithi008.stdout:7/789: mknod d1/d36/d3d/d3e/d59/d73/d7b/daf/cf4 0 2023-10-18T20:58:47.996 INFO:tasks.workunit.client.0.smithi008.stdout:8/957: rename d5/d8/df/d9d/d4d/dba/dd4/fd6 to d5/d8/df/df0/f159 0 2023-10-18T20:58:47.998 INFO:tasks.workunit.client.0.smithi008.stdout:4/729: dread d0/d17/d5b/d99/fda [0,4194304] 0 2023-10-18T20:58:47.998 INFO:tasks.workunit.client.0.smithi008.stdout:3/896: dwrite d0/d3/d37/d6f/ffa [0,4194304] 0 2023-10-18T20:58:48.005 INFO:tasks.workunit.client.0.smithi008.stdout:1/838: mknod d9/de/df/d17/ddb/c102 0 2023-10-18T20:58:48.006 INFO:tasks.workunit.client.0.smithi008.stdout:2/776: dwrite d1/d3/dd/f6b [0,4194304] 0 2023-10-18T20:58:48.010 INFO:tasks.workunit.client.0.smithi008.stdout:0/703: getdents d0/dd/df 0 2023-10-18T20:58:48.011 INFO:tasks.workunit.client.0.smithi008.stdout:7/790: link d1/da6/fd0 d1/da6/ff5 0 2023-10-18T20:58:48.012 INFO:tasks.workunit.client.0.smithi008.stdout:7/791: fsync d1/da6/d79/f71 0 2023-10-18T20:58:48.016 INFO:tasks.workunit.client.0.smithi008.stdout:8/958: link d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/l131 d5/d8/df/dce/dfa/d125/l15a 0 2023-10-18T20:58:48.016 INFO:tasks.workunit.client.0.smithi008.stdout:8/959: chown d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/d139 0 1 2023-10-18T20:58:48.017 INFO:tasks.workunit.client.1.smithi060.stdout:4/970: dwrite d4/dc/d40/d80/daf/fe6 [0,4194304] 0 2023-10-18T20:58:48.017 INFO:tasks.workunit.client.0.smithi008.stdout:0/704: dread d0/f51 [0,4194304] 0 2023-10-18T20:58:48.017 INFO:tasks.workunit.client.0.smithi008.stdout:0/705: write d0/dd/d19/d24/f98 [95314,56635] 0 2023-10-18T20:58:48.022 INFO:tasks.workunit.client.1.smithi060.stdout:9/914: dread d3/d99/d1c/d5a/d5d/d56/dd0/f10e [0,4194304] 0 2023-10-18T20:58:48.023 INFO:tasks.workunit.client.0.smithi008.stdout:5/774: sync 2023-10-18T20:58:48.024 INFO:tasks.workunit.client.0.smithi008.stdout:2/777: dread d1/d3/dd/d1c/d3a/d57/f67 [0,4194304] 0 2023-10-18T20:58:48.024 INFO:tasks.workunit.client.1.smithi060.stdout:6/999: dwrite d10/d2e/d75/dc7/d106/f118 [0,4194304] 0 2023-10-18T20:58:48.025 INFO:tasks.workunit.client.1.smithi060.stdout:9/915: mknod d3/d99/d1c/d116/d80/d127/c145 0 2023-10-18T20:58:48.025 INFO:tasks.workunit.client.1.smithi060.stdout:9/916: fsync d3/d99/d1c/d116/d80/da0/dc2/d9e/dfd/f102 0 2023-10-18T20:58:48.027 INFO:tasks.workunit.client.1.smithi060.stdout:9/917: symlink d3/d99/d1c/d116/d80/d112/l146 0 2023-10-18T20:58:48.028 INFO:tasks.workunit.client.1.smithi060.stdout:9/918: truncate d3/d99/d1c/f140 272966 0 2023-10-18T20:58:48.029 INFO:tasks.workunit.client.0.smithi008.stdout:4/730: rename d0/d17/d6e/cb7 to d0/d17/d6e/cf0 0 2023-10-18T20:58:48.030 INFO:tasks.workunit.client.0.smithi008.stdout:3/897: readlink d0/d3/de/d13/l3f 0 2023-10-18T20:58:48.034 INFO:tasks.workunit.client.0.smithi008.stdout:8/960: dread d5/fa6 [0,4194304] 0 2023-10-18T20:58:48.035 INFO:tasks.workunit.client.0.smithi008.stdout:5/775: dread d0/d2/d19/d7c/d31/d80/fcf [0,4194304] 0 2023-10-18T20:58:48.036 INFO:tasks.workunit.client.1.smithi060.stdout:9/919: rename d3/d58 to d3/d99/d1c/d116/d80/da0/d147 0 2023-10-18T20:58:48.036 INFO:tasks.workunit.client.1.smithi060.stdout:9/920: chown d3/d99/d19/d54/d8f 1132 1 2023-10-18T20:58:48.041 INFO:tasks.workunit.client.0.smithi008.stdout:9/693: sync 2023-10-18T20:58:48.045 INFO:tasks.workunit.client.0.smithi008.stdout:7/792: creat d1/d36/d3d/d3e/ff6 x:0 0 0 2023-10-18T20:58:48.046 INFO:tasks.workunit.client.1.smithi060.stdout:9/921: rename d3/d99/d19/d54/c129 to d3/d99/d19/d54/df0/c148 0 2023-10-18T20:58:48.047 INFO:tasks.workunit.client.0.smithi008.stdout:4/731: link d0/d58/d8e/c71 d0/d3/d21/d57/d8f/d95/cf1 0 2023-10-18T20:58:48.048 INFO:tasks.workunit.client.0.smithi008.stdout:0/706: dread d0/dd/df/f4c [0,4194304] 0 2023-10-18T20:58:48.050 INFO:tasks.workunit.client.0.smithi008.stdout:2/778: dread d1/f1a [0,4194304] 0 2023-10-18T20:58:48.051 INFO:tasks.workunit.client.0.smithi008.stdout:6/901: dwrite df/d15/d48/d81/f96 [0,4194304] 0 2023-10-18T20:58:48.051 INFO:tasks.workunit.client.0.smithi008.stdout:3/898: creat d0/d3/de/d13/d35/dbf/de0/f11b x:0 0 0 2023-10-18T20:58:48.053 INFO:tasks.workunit.client.1.smithi060.stdout:2/994: dwrite d0/d3/f89 [4194304,4194304] 0 2023-10-18T20:58:48.055 INFO:tasks.workunit.client.1.smithi060.stdout:9/922: rename f2 to d3/d99/d19/f149 0 2023-10-18T20:58:48.056 INFO:tasks.workunit.client.1.smithi060.stdout:9/923: chown d3/d99/d1c/d116/c60 163 1 2023-10-18T20:58:48.057 INFO:tasks.workunit.client.0.smithi008.stdout:1/839: getdents d9/de/df/d17/d25/d94/da7 0 2023-10-18T20:58:48.057 INFO:tasks.workunit.client.0.smithi008.stdout:5/776: mknod d0/d2/d19/d7c/d31/d3f/d70/da4/c11a 0 2023-10-18T20:58:48.058 INFO:tasks.workunit.client.1.smithi060.stdout:0/988: sync 2023-10-18T20:58:48.058 INFO:tasks.workunit.client.1.smithi060.stdout:5/993: sync 2023-10-18T20:58:48.059 INFO:tasks.workunit.client.0.smithi008.stdout:9/694: truncate d2/f1b 2357068 0 2023-10-18T20:58:48.059 INFO:tasks.workunit.client.0.smithi008.stdout:9/695: getdents d2/dc/d3d/d99/da4 0 2023-10-18T20:58:48.059 INFO:tasks.workunit.client.0.smithi008.stdout:9/696: chown d2/d8/da0 26 1 2023-10-18T20:58:48.065 INFO:tasks.workunit.client.0.smithi008.stdout:4/732: rmdir d0/d3/d21/d57/d8f/d82/de8 0 2023-10-18T20:58:48.065 INFO:tasks.workunit.client.0.smithi008.stdout:0/707: mkdir d0/dd/df/dd9 0 2023-10-18T20:58:48.066 INFO:tasks.workunit.client.1.smithi060.stdout:2/995: creat d0/d3/d27/f14a x:0 0 0 2023-10-18T20:58:48.066 INFO:tasks.workunit.client.0.smithi008.stdout:6/902: write df/d3c/d77/fb3 [2481153,11148] 0 2023-10-18T20:58:48.066 INFO:tasks.workunit.client.0.smithi008.stdout:6/903: chown df/d15/d48/ded/d108/dcf/d58/dec/d10d 1 1 2023-10-18T20:58:48.068 INFO:tasks.workunit.client.1.smithi060.stdout:9/924: rename d3/d99/d1c/d116/d80/da0/dc2/d9e/d131/l126 to d3/d99/d1c/d116/d80/d112/l14a 0 2023-10-18T20:58:48.069 INFO:tasks.workunit.client.1.smithi060.stdout:0/989: mknod d3/d8/d3c/d87/c13f 0 2023-10-18T20:58:48.071 INFO:tasks.workunit.client.1.smithi060.stdout:2/996: link d0/d3/d27/l80 d0/d16/d85/l14b 0 2023-10-18T20:58:48.072 INFO:tasks.workunit.client.1.smithi060.stdout:2/997: truncate d0/d45/d49/d6e/d79/d6c/f75 4985299 0 2023-10-18T20:58:48.072 INFO:tasks.workunit.client.1.smithi060.stdout:9/925: write d3/d99/d1c/f140 [46604,37221] 0 2023-10-18T20:58:48.072 INFO:tasks.workunit.client.0.smithi008.stdout:3/899: mkdir d0/d3/de/d13/d35/dbf/de9/d11c 0 2023-10-18T20:58:48.072 INFO:tasks.workunit.client.0.smithi008.stdout:3/900: dread - d0/d3/da9/fb9 zero size 2023-10-18T20:58:48.072 INFO:tasks.workunit.client.0.smithi008.stdout:3/901: readlink d0/d3/de/d13/l9f 0 2023-10-18T20:58:48.073 INFO:tasks.workunit.client.0.smithi008.stdout:3/902: creat d0/d3/de/d13/d35/f11d x:0 0 0 2023-10-18T20:58:48.077 INFO:tasks.workunit.client.1.smithi060.stdout:0/990: link d3/d8/d3c/l6a d3/d8/d11f/d55/d74/d76/d68/d7f/d8d/l140 0 2023-10-18T20:58:48.077 INFO:tasks.workunit.client.1.smithi060.stdout:0/991: truncate d3/d8/d11f/d55/d74/d76/d68/f92 9316573 0 2023-10-18T20:58:48.078 INFO:tasks.workunit.client.1.smithi060.stdout:0/992: read d3/d8/d11f/d55/d74/d76/d6b/fb3 [1387582,65566] 0 2023-10-18T20:58:48.080 INFO:tasks.workunit.client.1.smithi060.stdout:2/998: rename d0/d45/d49/f7e to d0/d8/d47/d73/f14c 0 2023-10-18T20:58:48.080 INFO:tasks.workunit.client.1.smithi060.stdout:9/926: truncate d3/d99/d1c/d5a/f97 1237670 0 2023-10-18T20:58:48.082 INFO:tasks.workunit.client.1.smithi060.stdout:9/927: symlink d3/d99/d19/d54/df0/l14b 0 2023-10-18T20:58:48.083 INFO:tasks.workunit.client.0.smithi008.stdout:2/779: rmdir d1/d3/dd/d25/d76 39 2023-10-18T20:58:48.083 INFO:tasks.workunit.client.0.smithi008.stdout:2/780: dread - d1/d3/dd/ff2 zero size 2023-10-18T20:58:48.084 INFO:tasks.workunit.client.0.smithi008.stdout:2/781: chown d1/d3/l7a 1693727 1 2023-10-18T20:58:48.084 INFO:tasks.workunit.client.1.smithi060.stdout:5/994: dread d0/d6/d9/d82/d84/db2/db8/f12c [0,4194304] 0 2023-10-18T20:58:48.085 INFO:tasks.workunit.client.0.smithi008.stdout:1/840: creat d9/de/df/d17/d1e/d9a/dbc/f103 x:0 0 0 2023-10-18T20:58:48.086 INFO:tasks.workunit.client.1.smithi060.stdout:2/999: rename d0/d16/ded/f11c to d0/d45/f14d 0 2023-10-18T20:58:48.087 INFO:tasks.workunit.client.1.smithi060.stdout:9/928: mkdir d3/d99/d1c/d116/d80/da0/dc2/de0/d14c 0 2023-10-18T20:58:48.087 INFO:tasks.workunit.client.1.smithi060.stdout:9/929: stat d3/d99/d1c/d116/d80/da0/dc2/d9e/dfd/l10c 0 2023-10-18T20:58:48.087 INFO:tasks.workunit.client.0.smithi008.stdout:9/697: creat d2/dc/d1a/d1d/fcb x:0 0 0 2023-10-18T20:58:48.088 INFO:tasks.workunit.client.0.smithi008.stdout:9/698: fsync d2/dc/d40/d6f/d92/d59/fbd 0 2023-10-18T20:58:48.088 INFO:tasks.workunit.client.0.smithi008.stdout:5/777: rmdir d0/d2/d19/d7c/d31/d3f/d70 39 2023-10-18T20:58:48.088 INFO:tasks.workunit.client.0.smithi008.stdout:9/699: write d2/dc/d17/d7b/f9f [82900,116566] 0 2023-10-18T20:58:48.089 INFO:tasks.workunit.client.1.smithi060.stdout:9/930: creat d3/d99/d1c/d116/d80/da0/dc2/d9e/d131/f14d x:0 0 0 2023-10-18T20:58:48.091 INFO:tasks.workunit.client.0.smithi008.stdout:0/708: rename d0/dd/d19/f79 to d0/dd/df/dd9/fda 0 2023-10-18T20:58:48.092 INFO:tasks.workunit.client.0.smithi008.stdout:0/709: fsync d0/dd/d19/d24/f88 0 2023-10-18T20:58:48.092 INFO:tasks.workunit.client.0.smithi008.stdout:3/903: dread d0/d3/f5 [0,4194304] 0 2023-10-18T20:58:48.093 INFO:tasks.workunit.client.1.smithi060.stdout:9/931: mkdir d3/d99/d1c/d116/d80/da0/d14e 0 2023-10-18T20:58:48.094 INFO:tasks.workunit.client.0.smithi008.stdout:6/904: link df/d15/d48/d81/d116/d4c/db2/fea df/d15/d48/ded/d108/dcf/d58/dec/daa/dcb/f12e 0 2023-10-18T20:58:48.097 INFO:tasks.workunit.client.0.smithi008.stdout:2/782: mkdir d1/d3/dd/d25/d76/d59/d85/dba/d102 0 2023-10-18T20:58:48.099 INFO:tasks.workunit.client.0.smithi008.stdout:1/841: creat d9/de/df/d85/f104 x:0 0 0 2023-10-18T20:58:48.103 INFO:tasks.workunit.client.1.smithi060.stdout:0/993: read d3/d8/d11f/d55/d74/d76/d68/d7f/d8d/dbc/ffc [2565331,51047] 0 2023-10-18T20:58:48.106 INFO:tasks.workunit.client.1.smithi060.stdout:9/932: mkdir d3/d99/d1c/d116/d80/da0/dc2/d9e/d131/d14f 0 2023-10-18T20:58:48.106 INFO:tasks.workunit.client.0.smithi008.stdout:5/778: symlink d0/da9/l11b 0 2023-10-18T20:58:48.106 INFO:tasks.workunit.client.0.smithi008.stdout:5/779: write d0/d2/d19/f81 [214984,62479] 0 2023-10-18T20:58:48.106 INFO:tasks.workunit.client.0.smithi008.stdout:5/780: stat d0/d2/d19/d7c/d31/d80 0 2023-10-18T20:58:48.107 INFO:tasks.workunit.client.0.smithi008.stdout:2/783: dread d1/d3/d40/d6e/f77 [0,4194304] 0 2023-10-18T20:58:48.107 INFO:tasks.workunit.client.0.smithi008.stdout:2/784: fdatasync d1/d3/dd/d1c/d3a/d45/de1/ff6 0 2023-10-18T20:58:48.107 INFO:tasks.workunit.client.1.smithi060.stdout:9/933: rmdir d3/d99/d1c/d116/d80/da0 39 2023-10-18T20:58:48.108 INFO:tasks.workunit.client.0.smithi008.stdout:9/700: truncate d2/dc/d1a/fac 81073 0 2023-10-18T20:58:48.108 INFO:tasks.workunit.client.1.smithi060.stdout:5/995: dread d0/dd/d76/d10f/ff7 [4194304,4194304] 0 2023-10-18T20:58:48.111 INFO:tasks.workunit.client.1.smithi060.stdout:5/996: mkdir d0/d6/d9/d82/d156 0 2023-10-18T20:58:48.111 INFO:tasks.workunit.client.1.smithi060.stdout:5/997: write d0/da/d3b/f4c [4688180,13363] 0 2023-10-18T20:58:48.112 INFO:tasks.workunit.client.0.smithi008.stdout:0/710: symlink d0/dd/d19/d5f/d89/da7/dac/ldb 0 2023-10-18T20:58:48.113 INFO:tasks.workunit.client.1.smithi060.stdout:9/934: read d3/d99/d1c/d5a/fb2 [376531,21881] 0 2023-10-18T20:58:48.113 INFO:tasks.workunit.client.1.smithi060.stdout:9/935: write d3/d99/d1c/d116/f36 [2530089,129642] 0 2023-10-18T20:58:48.113 INFO:tasks.workunit.client.1.smithi060.stdout:9/936: readlink d3/d99/d1c/d5a/l104 0 2023-10-18T20:58:48.114 INFO:tasks.workunit.client.1.smithi060.stdout:9/937: dread - d3/d99/faa zero size 2023-10-18T20:58:48.114 INFO:tasks.workunit.client.1.smithi060.stdout:9/938: chown d3/d99/lbb 3133 1 2023-10-18T20:58:48.115 INFO:tasks.workunit.client.1.smithi060.stdout:3/915: dwrite d0/d22/f69 [0,4194304] 0 2023-10-18T20:58:48.115 INFO:tasks.workunit.client.0.smithi008.stdout:6/905: mknod df/d15/d48/ded/d108/dcf/d68/db9/c12f 0 2023-10-18T20:58:48.115 INFO:tasks.workunit.client.0.smithi008.stdout:6/906: dread - df/d15/d48/ded/d108/dcf/d58/dec/daa/dcb/f125 zero size 2023-10-18T20:58:48.115 INFO:tasks.workunit.client.0.smithi008.stdout:6/907: fsync df/d15/f16 0 2023-10-18T20:58:48.116 INFO:tasks.workunit.client.0.smithi008.stdout:0/711: symlink d0/d3a/ldc 0 2023-10-18T20:58:48.116 INFO:tasks.workunit.client.0.smithi008.stdout:0/712: stat d0/dd/d19/d5f/d99/d5e 0 2023-10-18T20:58:48.116 INFO:tasks.workunit.client.0.smithi008.stdout:0/713: chown d0/c37 0 1 2023-10-18T20:58:48.117 INFO:tasks.workunit.client.0.smithi008.stdout:6/908: symlink df/d3c/d77/dd6/dd8/l130 0 2023-10-18T20:58:48.118 INFO:tasks.workunit.client.0.smithi008.stdout:6/909: dread - df/d15/d48/ded/d108/dcf/d58/dec/d53/fc8 zero size 2023-10-18T20:58:48.122 INFO:tasks.workunit.client.1.smithi060.stdout:3/916: symlink d0/d22/d26/d29/l13a 0 2023-10-18T20:58:48.122 INFO:tasks.workunit.client.0.smithi008.stdout:6/910: mknod df/d15/d48/c131 0 2023-10-18T20:58:48.126 INFO:tasks.workunit.client.0.smithi008.stdout:4/733: dwrite d0/f12 [4194304,4194304] 0 2023-10-18T20:58:48.126 INFO:tasks.workunit.client.0.smithi008.stdout:4/734: truncate d0/d17/f6a 743647 0 2023-10-18T20:58:48.130 INFO:tasks.workunit.client.1.smithi060.stdout:0/994: dread d3/de5/df1/f139 [0,4194304] 0 2023-10-18T20:58:48.131 INFO:tasks.workunit.client.0.smithi008.stdout:4/735: truncate d0/d3/fa5 858860 0 2023-10-18T20:58:48.131 INFO:tasks.workunit.client.0.smithi008.stdout:4/736: write d0/d58/d8e/db4/f97 [445516,107825] 0 2023-10-18T20:58:48.136 INFO:tasks.workunit.client.0.smithi008.stdout:7/793: dwrite d1/d36/d3d/d3e/d59/d73/fbd [0,4194304] 0 2023-10-18T20:58:48.138 INFO:tasks.workunit.client.1.smithi060.stdout:9/939: dread d3/d99/d1c/d116/d80/da0/dc2/d9e/fce [4194304,4194304] 0 2023-10-18T20:58:48.140 INFO:tasks.workunit.client.1.smithi060.stdout:9/940: creat d3/d99/d1c/d116/d80/d127/f150 x:0 0 0 2023-10-18T20:58:48.150 INFO:tasks.workunit.client.1.smithi060.stdout:3/917: write d0/d22/d26/d2c/fd3 [466442,62662] 0 2023-10-18T20:58:48.150 INFO:tasks.workunit.client.1.smithi060.stdout:9/941: unlink d3/d99/d1c/f113 0 2023-10-18T20:58:48.151 INFO:tasks.workunit.client.1.smithi060.stdout:3/918: chown d0/d3c/d3d/d4d/caa 6072 1 2023-10-18T20:58:48.154 INFO:tasks.workunit.client.0.smithi008.stdout:3/904: dwrite d0/d3/d42/d88/d103/f10e [0,4194304] 0 2023-10-18T20:58:48.160 INFO:tasks.workunit.client.1.smithi060.stdout:9/942: creat d3/f151 x:0 0 0 2023-10-18T20:58:48.161 INFO:tasks.workunit.client.1.smithi060.stdout:0/995: dread d3/d8/f54 [0,4194304] 0 2023-10-18T20:58:48.162 INFO:tasks.workunit.client.0.smithi008.stdout:3/905: truncate d0/d3/d15/fcb 2924563 0 2023-10-18T20:58:48.163 INFO:tasks.workunit.client.1.smithi060.stdout:0/996: truncate d3/d8/dac/fcc 990910 0 2023-10-18T20:58:48.164 INFO:tasks.workunit.client.1.smithi060.stdout:3/919: creat d0/d22/d26/d106/d133/f13b x:0 0 0 2023-10-18T20:58:48.164 INFO:tasks.workunit.client.1.smithi060.stdout:3/920: chown d0/f1d 7047632 1 2023-10-18T20:58:48.164 INFO:tasks.workunit.client.1.smithi060.stdout:9/943: creat d3/d99/d19/d54/da5/f152 x:0 0 0 2023-10-18T20:58:48.168 INFO:tasks.workunit.client.0.smithi008.stdout:3/906: stat d0/d3/de/d13/la1 0 2023-10-18T20:58:48.168 INFO:tasks.workunit.client.0.smithi008.stdout:3/907: creat d0/f11e x:0 0 0 2023-10-18T20:58:48.169 INFO:tasks.workunit.client.0.smithi008.stdout:3/908: write d0/d4a/d64/f7e [1290096,93202] 0 2023-10-18T20:58:48.169 INFO:tasks.workunit.client.0.smithi008.stdout:3/909: chown d0/d3/de/d13/d35/dbf/de9/df2 634 1 2023-10-18T20:58:48.170 INFO:tasks.workunit.client.0.smithi008.stdout:3/910: fsync d0/d3/de/d13/d35/f47 0 2023-10-18T20:58:48.176 INFO:tasks.workunit.client.1.smithi060.stdout:3/921: write d0/d22/d26/d79/f113 [181659,24456] 0 2023-10-18T20:58:48.177 INFO:tasks.workunit.client.1.smithi060.stdout:3/922: dread - d0/d22/d26/d2b/f12d zero size 2023-10-18T20:58:48.178 INFO:tasks.workunit.client.0.smithi008.stdout:9/701: write d2/dc/d40/d6f/d92/d59/fbd [3654413,32021] 0 2023-10-18T20:58:48.182 INFO:tasks.workunit.client.0.smithi008.stdout:6/911: dwrite df/d15/d48/ded/d108/dcf/d58/dec/d53/fc8 [0,4194304] 0 2023-10-18T20:58:48.183 INFO:tasks.workunit.client.1.smithi060.stdout:3/923: link d0/d22/d26/cc2 d0/d22/d26/d29/dae/de4/c13c 0 2023-10-18T20:58:48.184 INFO:tasks.workunit.client.1.smithi060.stdout:3/924: dread - d0/d22/d26/d106/d133/f13b zero size 2023-10-18T20:58:48.184 INFO:tasks.workunit.client.1.smithi060.stdout:0/997: dread d3/d32/d86/f8c [0,4194304] 0 2023-10-18T20:58:48.185 INFO:tasks.workunit.client.1.smithi060.stdout:5/998: dwrite d0/dd/f88 [0,4194304] 0 2023-10-18T20:58:48.185 INFO:tasks.workunit.client.1.smithi060.stdout:5/999: stat d0/da/d61/fbb 0 2023-10-18T20:58:48.189 INFO:tasks.workunit.client.0.smithi008.stdout:3/911: dread d0/d3/de/d13/d35/d51/fbe [0,4194304] 0 2023-10-18T20:58:48.189 INFO:tasks.workunit.client.0.smithi008.stdout:3/912: fsync d0/d3/d42/d88/f91 0 2023-10-18T20:58:48.190 INFO:tasks.workunit.client.0.smithi008.stdout:3/913: truncate d0/d3/de/d13/d35/dbf/de9/ff0 795807 0 2023-10-18T20:58:48.190 INFO:tasks.workunit.client.0.smithi008.stdout:3/914: rmdir d0/d84/dad/dbb 39 2023-10-18T20:58:48.191 INFO:tasks.workunit.client.0.smithi008.stdout:5/781: dwrite d0/d6e/f7d [4194304,4194304] 0 2023-10-18T20:58:48.191 INFO:tasks.workunit.client.0.smithi008.stdout:5/782: fsync d0/d2/d19/d7c/d31/d82/fe3 0 2023-10-18T20:58:48.192 INFO:tasks.workunit.client.1.smithi060.stdout:0/998: mknod d3/d8/d11f/d55/d74/c141 0 2023-10-18T20:58:48.192 INFO:tasks.workunit.client.1.smithi060.stdout:3/925: truncate d0/fd 3416236 0 2023-10-18T20:58:48.192 INFO:tasks.workunit.client.0.smithi008.stdout:0/714: dwrite d0/dd/d19/d24/f88 [0,4194304] 0 2023-10-18T20:58:48.193 INFO:tasks.workunit.client.0.smithi008.stdout:0/715: chown d0/d7c/d9a/d8a/d8f/f62 0 1 2023-10-18T20:58:48.194 INFO:tasks.workunit.client.0.smithi008.stdout:4/737: dwrite d0/d17/d5b/d45/fe3 [0,4194304] 0 2023-10-18T20:58:48.195 INFO:tasks.workunit.client.0.smithi008.stdout:4/738: chown d0/d3/d21 123 1 2023-10-18T20:58:48.196 INFO:tasks.workunit.client.0.smithi008.stdout:5/783: rename d0/d2/d9/d9b/d6f/d75/fa1 to d0/d2/d9/d9b/f11c 0 2023-10-18T20:58:48.196 INFO:tasks.workunit.client.0.smithi008.stdout:5/784: dread - d0/d2/d19/d7c/d58/d65/d68/fb1 zero size 2023-10-18T20:58:48.198 INFO:tasks.workunit.client.1.smithi060.stdout:3/926: rename d0/d3c/d3d/d4d/f6a to d0/d3c/d3d/f13d 0 2023-10-18T20:58:48.198 INFO:tasks.workunit.client.0.smithi008.stdout:0/716: fdatasync d0/d3a/f5c 0 2023-10-18T20:58:48.212 INFO:tasks.workunit.client.0.smithi008.stdout:7/794: dwrite d1/d36/d3d/d3e/d59/d73/f75 [0,4194304] 0 2023-10-18T20:58:48.224 INFO:tasks.workunit.client.0.smithi008.stdout:3/915: dread d0/d3/de/d13/d35/fc7 [0,4194304] 0 2023-10-18T20:58:48.239 INFO:tasks.workunit.client.0.smithi008.stdout:4/739: write d0/f8b [650839,111929] 0 2023-10-18T20:58:48.262 INFO:tasks.workunit.client.0.smithi008.stdout:5/785: dwrite d0/dec/f105 [0,4194304] 0 2023-10-18T20:58:48.263 INFO:tasks.workunit.client.0.smithi008.stdout:6/912: dwrite df/d3c/d77/f76 [4194304,4194304] 0 2023-10-18T20:58:48.263 INFO:tasks.workunit.client.0.smithi008.stdout:6/913: creat df/dd1/f132 x:0 0 0 2023-10-18T20:58:48.264 INFO:tasks.workunit.client.1.smithi060.stdout:3/927: dwrite d0/d22/d50/f9f [0,4194304] 0 2023-10-18T20:58:48.265 INFO:tasks.workunit.client.1.smithi060.stdout:3/928: fsync d0/d3c/d3d/ffe 0 2023-10-18T20:58:48.267 INFO:tasks.workunit.client.0.smithi008.stdout:4/740: dread d0/d17/d5b/f68 [4194304,4194304] 0 2023-10-18T20:58:48.268 INFO:tasks.workunit.client.0.smithi008.stdout:4/741: chown d0/d17/d5b/fa6 15968 1 2023-10-18T20:58:48.268 INFO:tasks.workunit.client.0.smithi008.stdout:6/914: symlink df/d36/l133 0 2023-10-18T20:58:48.269 INFO:tasks.workunit.client.1.smithi060.stdout:3/929: unlink d0/d22/d26/d2c/lee 0 2023-10-18T20:58:48.269 INFO:tasks.workunit.client.1.smithi060.stdout:3/930: write d0/d3c/d3d/d4d/d95/fcb [1000268,70517] 0 2023-10-18T20:58:48.269 INFO:tasks.workunit.client.1.smithi060.stdout:3/931: write d0/d22/d26/f43 [1266942,50126] 0 2023-10-18T20:58:48.269 INFO:tasks.workunit.client.1.smithi060.stdout:0/999: dwrite d3/d8/d11f/d55/d9a/fcb [0,4194304] 0 2023-10-18T20:58:48.270 INFO:tasks.workunit.client.0.smithi008.stdout:4/742: symlink d0/d3/d21/d57/d8f/lf2 0 2023-10-18T20:58:48.271 INFO:tasks.workunit.client.0.smithi008.stdout:4/743: stat d0/d17/d5b/d45/f92 0 2023-10-18T20:58:48.280 INFO:tasks.workunit.client.0.smithi008.stdout:6/915: dread df/d15/d48/ded/d108/dcf/d3f/f93 [0,4194304] 0 2023-10-18T20:58:48.281 INFO:tasks.workunit.client.0.smithi008.stdout:6/916: creat df/dd1/f134 x:0 0 0 2023-10-18T20:58:48.281 INFO:tasks.workunit.client.0.smithi008.stdout:4/744: rename d0/d17/lcb to d0/d3/d21/d57/d8f/d95/lf3 0 2023-10-18T20:58:48.286 INFO:tasks.workunit.client.0.smithi008.stdout:0/717: dwrite d0/d7c/f30 [0,4194304] 0 2023-10-18T20:58:48.286 INFO:tasks.workunit.client.0.smithi008.stdout:9/702: dwrite d2/f7f [0,4194304] 0 2023-10-18T20:58:48.287 INFO:tasks.workunit.client.0.smithi008.stdout:6/917: creat df/d19/f135 x:0 0 0 2023-10-18T20:58:48.288 INFO:tasks.workunit.client.0.smithi008.stdout:6/918: chown df/d15/d48/d81/d116/c30 1467 1 2023-10-18T20:58:48.288 INFO:tasks.workunit.client.1.smithi060.stdout:3/932: dread d0/d22/d26/d2b/f4c [0,4194304] 0 2023-10-18T20:58:48.288 INFO:tasks.workunit.client.1.smithi060.stdout:3/933: stat d0/d3c/d3d/d82/d129 0 2023-10-18T20:58:48.290 INFO:tasks.workunit.client.1.smithi060.stdout:3/934: mkdir d0/d13e 0 2023-10-18T20:58:48.292 INFO:tasks.workunit.client.0.smithi008.stdout:0/718: creat d0/d7c/d9a/d8a/fdd x:0 0 0 2023-10-18T20:58:48.292 INFO:tasks.workunit.client.0.smithi008.stdout:9/703: creat d2/dc/d40/d5a/fcc x:0 0 0 2023-10-18T20:58:48.292 INFO:tasks.workunit.client.0.smithi008.stdout:9/704: readlink d2/dc/d3d/l47 0 2023-10-18T20:58:48.294 INFO:tasks.workunit.client.0.smithi008.stdout:4/745: rmdir d0/d17/d5b/d2a 39 2023-10-18T20:58:48.297 INFO:tasks.workunit.client.0.smithi008.stdout:0/719: creat d0/d7c/d9a/d8a/d8f/d21/fde x:0 0 0 2023-10-18T20:58:48.297 INFO:tasks.workunit.client.0.smithi008.stdout:9/705: creat d2/d8/db1/fcd x:0 0 0 2023-10-18T20:58:48.299 INFO:tasks.workunit.client.0.smithi008.stdout:4/746: dread d0/d17/d5b/fa6 [0,4194304] 0 2023-10-18T20:58:48.301 INFO:tasks.workunit.client.0.smithi008.stdout:8/961: sync 2023-10-18T20:58:48.301 INFO:tasks.workunit.client.0.smithi008.stdout:3/916: dwrite d0/d3/f5 [0,4194304] 0 2023-10-18T20:58:48.305 INFO:tasks.workunit.client.0.smithi008.stdout:9/706: mkdir d2/dc/d40/dce 0 2023-10-18T20:58:48.305 INFO:tasks.workunit.client.0.smithi008.stdout:6/919: symlink df/d15/d48/ded/d108/dcf/d58/l136 0 2023-10-18T20:58:48.306 INFO:tasks.workunit.client.0.smithi008.stdout:4/747: symlink d0/d17/dc6/lf4 0 2023-10-18T20:58:48.306 INFO:tasks.workunit.client.0.smithi008.stdout:7/795: dwrite d1/d36/d3d/d3e/d59/d73/f75 [0,4194304] 0 2023-10-18T20:58:48.307 INFO:tasks.workunit.client.0.smithi008.stdout:6/920: unlink df/d15/d48/d81/d116/f52 0 2023-10-18T20:58:48.307 INFO:tasks.workunit.client.0.smithi008.stdout:7/796: write d1/d36/d3d/d3e/d59/fec [1337587,61214] 0 2023-10-18T20:58:48.307 INFO:tasks.workunit.client.1.smithi060.stdout:4/971: sync 2023-10-18T20:58:48.307 INFO:tasks.workunit.client.1.smithi060.stdout:8/976: sync 2023-10-18T20:58:48.308 INFO:tasks.workunit.client.0.smithi008.stdout:3/917: creat d0/d3/d42/d52/df1/f11f x:0 0 0 2023-10-18T20:58:48.308 INFO:tasks.workunit.client.0.smithi008.stdout:3/918: dread - d0/d3/de/f9e zero size 2023-10-18T20:58:48.310 INFO:tasks.workunit.client.1.smithi060.stdout:8/977: write d4/d9/d31/d35/d9f/da3/dd8/ff7 [825933,87671] 0 2023-10-18T20:58:48.326 INFO:tasks.workunit.client.0.smithi008.stdout:6/921: truncate df/d26/f61 3858949 0 2023-10-18T20:58:48.327 INFO:tasks.workunit.client.0.smithi008.stdout:7/797: mknod d1/d36/d3d/da3/de8/d5f/d78/da2/cf7 0 2023-10-18T20:58:48.331 INFO:tasks.workunit.client.0.smithi008.stdout:8/962: dread d5/d8/df/d9d/d4d/dba/dd4/d50/f6a [0,4194304] 0 2023-10-18T20:58:48.332 INFO:tasks.workunit.client.0.smithi008.stdout:8/963: write d5/d8/df/d2e/d13b/d117/d122/dc4/f109 [4934326,40995] 0 2023-10-18T20:58:48.336 INFO:tasks.workunit.client.0.smithi008.stdout:6/922: stat df/d15/d48/ded/d108/dcf/d3f/dcd/ce3 0 2023-10-18T20:58:48.343 INFO:tasks.workunit.client.0.smithi008.stdout:8/964: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/f15b x:0 0 0 2023-10-18T20:58:48.343 INFO:tasks.workunit.client.0.smithi008.stdout:7/798: rename d1/d36/d3d/da3/de8/d54/c8f to d1/d36/d3d/da3/de8/d5f/d7f/cf8 0 2023-10-18T20:58:48.352 INFO:tasks.workunit.client.0.smithi008.stdout:0/720: dwrite d0/dd/d19/d5f/d99/d94/f95 [0,4194304] 0 2023-10-18T20:58:48.352 INFO:tasks.workunit.client.0.smithi008.stdout:0/721: chown d0/dd/d19/d5f/d99/d94/f9d 0 1 2023-10-18T20:58:48.359 INFO:tasks.workunit.client.0.smithi008.stdout:9/707: dwrite d2/dc/f22 [0,4194304] 0 2023-10-18T20:58:48.365 INFO:tasks.workunit.client.0.smithi008.stdout:9/708: rename d2/dc/d1a/fac to d2/dc/d40/dce/fcf 0 2023-10-18T20:58:48.367 INFO:tasks.workunit.client.0.smithi008.stdout:6/923: dread df/d26/fe9 [0,4194304] 0 2023-10-18T20:58:48.368 INFO:tasks.workunit.client.0.smithi008.stdout:9/709: creat d2/dc/d3d/d99/da4/fd0 x:0 0 0 2023-10-18T20:58:48.368 INFO:tasks.workunit.client.0.smithi008.stdout:9/710: write d2/dc/d3d/f70 [1337520,76182] 0 2023-10-18T20:58:48.369 INFO:tasks.workunit.client.0.smithi008.stdout:9/711: chown d2/dc/d3d/l6b 681 1 2023-10-18T20:58:48.371 INFO:tasks.workunit.client.0.smithi008.stdout:6/924: mknod df/d15/d48/d81/d116/d4c/c137 0 2023-10-18T20:58:48.375 INFO:tasks.workunit.client.0.smithi008.stdout:9/712: rmdir d2/d8/db1 39 2023-10-18T20:58:48.381 INFO:tasks.workunit.client.0.smithi008.stdout:9/713: write d2/dc/d17/f76 [149366,72889] 0 2023-10-18T20:58:48.382 INFO:tasks.workunit.client.0.smithi008.stdout:9/714: write d2/dc/d40/d6f/d92/fc8 [563224,94480] 0 2023-10-18T20:58:48.383 INFO:tasks.workunit.client.0.smithi008.stdout:9/715: fsync d2/dc/d17/d19/d4a/f9b 0 2023-10-18T20:58:48.384 INFO:tasks.workunit.client.0.smithi008.stdout:9/716: creat d2/dc/d40/d6f/d92/fd1 x:0 0 0 2023-10-18T20:58:48.384 INFO:tasks.workunit.client.0.smithi008.stdout:9/717: dread - d2/dc/d3d/f8d zero size 2023-10-18T20:58:48.384 INFO:tasks.workunit.client.0.smithi008.stdout:9/718: creat d2/dc/d1a/d1d/fd2 x:0 0 0 2023-10-18T20:58:48.387 INFO:tasks.workunit.client.1.smithi060.stdout:4/972: dwrite d4/d15/f48 [0,4194304] 0 2023-10-18T20:58:48.388 INFO:tasks.workunit.client.1.smithi060.stdout:4/973: fsync d4/dc/d2a/d39/d82/f103 0 2023-10-18T20:58:48.388 INFO:tasks.workunit.client.1.smithi060.stdout:4/974: write d4/dc/d2a/d31/da5/d11c/d69/d89/f127 [100080,61934] 0 2023-10-18T20:58:48.391 INFO:tasks.workunit.client.0.smithi008.stdout:4/748: dwrite d0/d17/d5b/f68 [0,4194304] 0 2023-10-18T20:58:48.395 INFO:tasks.workunit.client.1.smithi060.stdout:4/975: creat d4/d15/d2b/d9f/f133 x:0 0 0 2023-10-18T20:58:48.395 INFO:tasks.workunit.client.0.smithi008.stdout:4/749: creat d0/d17/d5b/d45/ff5 x:0 0 0 2023-10-18T20:58:48.396 INFO:tasks.workunit.client.0.smithi008.stdout:4/750: dread - d0/d17/d6e/fd4 zero size 2023-10-18T20:58:48.396 INFO:tasks.workunit.client.0.smithi008.stdout:3/919: dwrite d0/d3/d42/d88/dae/f10d [0,4194304] 0 2023-10-18T20:58:48.401 INFO:tasks.workunit.client.1.smithi060.stdout:8/978: dwrite d4/d9/d37/f3d [0,4194304] 0 2023-10-18T20:58:48.403 INFO:tasks.workunit.client.1.smithi060.stdout:8/979: read - d4/d9/db4/f12a zero size 2023-10-18T20:58:48.407 INFO:tasks.workunit.client.0.smithi008.stdout:4/751: mknod d0/d3/d21/d57/d8f/cf6 0 2023-10-18T20:58:48.412 INFO:tasks.workunit.client.0.smithi008.stdout:4/752: rmdir d0/d17/d6e 39 2023-10-18T20:58:48.413 INFO:tasks.workunit.client.0.smithi008.stdout:0/722: dwrite d0/dd/d19/f8d [0,4194304] 0 2023-10-18T20:58:48.416 INFO:tasks.workunit.client.1.smithi060.stdout:4/976: dread d4/dc/d2a/d31/f46 [0,4194304] 0 2023-10-18T20:58:48.418 INFO:tasks.workunit.client.0.smithi008.stdout:7/799: dwrite d1/d36/d3d/d3e/d59/d73/fb8 [0,4194304] 0 2023-10-18T20:58:48.419 INFO:tasks.workunit.client.0.smithi008.stdout:7/800: readlink d1/d36/d3d/l63 0 2023-10-18T20:58:48.422 INFO:tasks.workunit.client.0.smithi008.stdout:7/801: stat d1/d36/d3d/da3/de8/d54/cce 0 2023-10-18T20:58:48.423 INFO:tasks.workunit.client.1.smithi060.stdout:4/977: truncate d4/dc/d2a/d13/d27/d68/f6d 3925428 0 2023-10-18T20:58:48.423 INFO:tasks.workunit.client.1.smithi060.stdout:4/978: fdatasync d4/d15/d2b/f86 0 2023-10-18T20:58:48.424 INFO:tasks.workunit.client.1.smithi060.stdout:4/979: write d4/dc/d40/da8/ff3 [130449,54560] 0 2023-10-18T20:58:48.433 INFO:tasks.workunit.client.0.smithi008.stdout:0/723: dread d0/d7c/f92 [0,4194304] 0 2023-10-18T20:58:48.433 INFO:tasks.workunit.client.0.smithi008.stdout:0/724: truncate d0/dd/d19/d5f/f60 872792 0 2023-10-18T20:58:48.434 INFO:tasks.workunit.client.0.smithi008.stdout:3/920: dwrite d0/d4a/d64/d80/ffc [0,4194304] 0 2023-10-18T20:58:48.434 INFO:tasks.workunit.client.0.smithi008.stdout:3/921: fdatasync d0/d3/d42/d52/df1/f11f 0 2023-10-18T20:58:48.436 INFO:tasks.workunit.client.0.smithi008.stdout:8/965: dwrite d5/d8/df/d9d/d85/db1/fcf [4194304,4194304] 0 2023-10-18T20:58:48.442 INFO:tasks.workunit.client.0.smithi008.stdout:0/725: creat d0/dd/d19/d24/fdf x:0 0 0 2023-10-18T20:58:48.442 INFO:tasks.workunit.client.0.smithi008.stdout:9/719: rename d2/dc/d40/d6f/d92 to d2/d8/db1/dd3 0 2023-10-18T20:58:48.443 INFO:tasks.workunit.client.0.smithi008.stdout:8/966: mknod d5/d8/df/d9d/d6c/c15c 0 2023-10-18T20:58:48.443 INFO:tasks.workunit.client.0.smithi008.stdout:3/922: chown d0/d3/de/d13/c5e 2 1 2023-10-18T20:58:48.444 INFO:tasks.workunit.client.0.smithi008.stdout:3/923: creat d0/d84/f120 x:0 0 0 2023-10-18T20:58:48.444 INFO:tasks.workunit.client.0.smithi008.stdout:3/924: dread - d0/d4a/d64/df6/f10c zero size 2023-10-18T20:58:48.445 INFO:tasks.workunit.client.0.smithi008.stdout:8/967: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/f15d x:0 0 0 2023-10-18T20:58:48.449 INFO:tasks.workunit.client.0.smithi008.stdout:8/968: link d5/d8/df/dce/dfa/d125/l114 d5/d8/df/d9d/d4d/dba/dd4/d9f/l15e 0 2023-10-18T20:58:48.457 INFO:tasks.workunit.client.1.smithi060.stdout:8/980: dwrite d4/d9/d31/d35/d9f/da3/ddb/ff2 [0,4194304] 0 2023-10-18T20:58:48.459 INFO:tasks.workunit.client.0.smithi008.stdout:1/842: sync 2023-10-18T20:58:48.460 INFO:tasks.workunit.client.0.smithi008.stdout:2/785: sync 2023-10-18T20:58:48.460 INFO:tasks.workunit.client.0.smithi008.stdout:1/843: truncate d9/de/df/d17/d25/d57/ff6 399051 0 2023-10-18T20:58:48.460 INFO:tasks.workunit.client.0.smithi008.stdout:5/786: sync 2023-10-18T20:58:48.461 INFO:tasks.workunit.client.0.smithi008.stdout:2/786: write d1/d3/dd/d25/d76/d59/fc9 [463810,101562] 0 2023-10-18T20:58:48.461 INFO:tasks.workunit.client.0.smithi008.stdout:2/787: chown d1/d3/dd/d25/d76/d59/l5d 443 1 2023-10-18T20:58:48.461 INFO:tasks.workunit.client.0.smithi008.stdout:2/788: write d1/d3/dd/d25/d76/d59/fc9 [1549652,107423] 0 2023-10-18T20:58:48.462 INFO:tasks.workunit.client.0.smithi008.stdout:0/726: dread d0/dd/d19/d24/f88 [0,4194304] 0 2023-10-18T20:58:48.465 INFO:tasks.workunit.client.0.smithi008.stdout:6/925: dwrite df/d15/d48/d81/d116/d4c/fce [0,4194304] 0 2023-10-18T20:58:48.467 INFO:tasks.workunit.client.0.smithi008.stdout:1/844: rename d9/de/df/d17/d25/d57/le6 to d9/de/df/d17/d25/d94/dc4/dc6/l105 0 2023-10-18T20:58:48.468 INFO:tasks.workunit.client.0.smithi008.stdout:0/727: mknod d0/d7c/d9a/d8a/db0/ce0 0 2023-10-18T20:58:48.469 INFO:tasks.workunit.client.1.smithi060.stdout:8/981: symlink d4/d9/d31/l138 0 2023-10-18T20:58:48.471 INFO:tasks.workunit.client.0.smithi008.stdout:5/787: rename d0/d2/d9/d9b/d62/cea to d0/d2/d19/d7c/d31/d3f/d70/da4/c11d 0 2023-10-18T20:58:48.473 INFO:tasks.workunit.client.0.smithi008.stdout:1/845: symlink d9/de/df/d17/d25/d94/da7/l106 0 2023-10-18T20:58:48.473 INFO:tasks.workunit.client.0.smithi008.stdout:1/846: read - d9/de/df/d17/d1e/d9a/fc7 zero size 2023-10-18T20:58:48.473 INFO:tasks.workunit.client.0.smithi008.stdout:1/847: dread - d9/de/df/d17/d1e/d7d/d89/f100 zero size 2023-10-18T20:58:48.474 INFO:tasks.workunit.client.0.smithi008.stdout:0/728: truncate d0/dd/d19/d24/f97 3440826 0 2023-10-18T20:58:48.476 INFO:tasks.workunit.client.0.smithi008.stdout:6/926: rename df/f3b to df/dd1/f138 0 2023-10-18T20:58:48.476 INFO:tasks.workunit.client.0.smithi008.stdout:6/927: fdatasync df/d36/fcc 0 2023-10-18T20:58:48.476 INFO:tasks.workunit.client.0.smithi008.stdout:7/802: dwrite d1/d36/d3d/d3e/d59/d73/fbd [0,4194304] 0 2023-10-18T20:58:48.477 INFO:tasks.workunit.client.0.smithi008.stdout:7/803: chown d1/da6/fd0 25951 1 2023-10-18T20:58:48.477 INFO:tasks.workunit.client.0.smithi008.stdout:7/804: chown d1/l15 0 1 2023-10-18T20:58:48.478 INFO:tasks.workunit.client.1.smithi060.stdout:4/980: dwrite d4/dc/d2a/d39/fdc [0,4194304] 0 2023-10-18T20:58:48.479 INFO:tasks.workunit.client.1.smithi060.stdout:8/982: dread d4/d9/d31/d35/d9f/da3/ddb/de9/ffe [0,4194304] 0 2023-10-18T20:58:48.479 INFO:tasks.workunit.client.1.smithi060.stdout:4/981: write d4/dc/d2a/d31/f97 [195004,25315] 0 2023-10-18T20:58:48.479 INFO:tasks.workunit.client.0.smithi008.stdout:1/848: mknod d9/de/df/d17/d1e/d9a/c107 0 2023-10-18T20:58:48.479 INFO:tasks.workunit.client.0.smithi008.stdout:9/720: dread d2/dc/d1a/d1d/f3c [0,4194304] 0 2023-10-18T20:58:48.480 INFO:tasks.workunit.client.0.smithi008.stdout:1/849: creat d9/de/df/d17/d55/da8/f108 x:0 0 0 2023-10-18T20:58:48.485 INFO:tasks.workunit.client.1.smithi060.stdout:4/982: rename d4/dc/d2a/d39/d53/d65/d8d to d4/dc/d2a/d31/da5/d11c/d134 0 2023-10-18T20:58:48.487 INFO:tasks.workunit.client.1.smithi060.stdout:4/983: mkdir d4/dc/d2a/d39/d53/d5f/d135 0 2023-10-18T20:58:48.490 INFO:tasks.workunit.client.1.smithi060.stdout:4/984: symlink d4/d15/d2b/l136 0 2023-10-18T20:58:48.490 INFO:tasks.workunit.client.1.smithi060.stdout:9/944: sync 2023-10-18T20:58:48.490 INFO:tasks.workunit.client.1.smithi060.stdout:9/945: getdents d3/d99/d1c/d116/d80/da0/dc2/de0/d14c 0 2023-10-18T20:58:48.497 INFO:tasks.workunit.client.1.smithi060.stdout:9/946: mkdir d3/d99/d1c/d116/d80/da0/d153 0 2023-10-18T20:58:48.497 INFO:tasks.workunit.client.1.smithi060.stdout:9/947: creat d3/d99/d1c/d116/d80/da0/dc2/d9e/d131/f154 x:0 0 0 2023-10-18T20:58:48.500 INFO:tasks.workunit.client.0.smithi008.stdout:0/729: mknod d0/d7c/d9a/ce1 0 2023-10-18T20:58:48.500 INFO:tasks.workunit.client.0.smithi008.stdout:9/721: link d2/d4d/f7d d2/dc/d3d/d99/fd4 0 2023-10-18T20:58:48.500 INFO:tasks.workunit.client.0.smithi008.stdout:9/722: write d2/dc/f4c [5441355,40496] 0 2023-10-18T20:58:48.501 INFO:tasks.workunit.client.0.smithi008.stdout:6/928: symlink df/d15/d48/d81/d116/dbf/l139 0 2023-10-18T20:58:48.501 INFO:tasks.workunit.client.0.smithi008.stdout:5/788: creat d0/d2/d19/d7c/d58/d65/d68/f11e x:0 0 0 2023-10-18T20:58:48.502 INFO:tasks.workunit.client.0.smithi008.stdout:9/723: symlink d2/dc/d1a/d1d/da7/ld5 0 2023-10-18T20:58:48.502 INFO:tasks.workunit.client.0.smithi008.stdout:9/724: fdatasync d2/d8/db1/dd3/d59/f66 0 2023-10-18T20:58:48.503 INFO:tasks.workunit.client.0.smithi008.stdout:9/725: write d2/dc/d1a/d1d/fcb [437033,39599] 0 2023-10-18T20:58:48.503 INFO:tasks.workunit.client.0.smithi008.stdout:2/789: dread d1/d3/d79/fd5 [0,4194304] 0 2023-10-18T20:58:48.504 INFO:tasks.workunit.client.1.smithi060.stdout:3/935: sync 2023-10-18T20:58:48.505 INFO:tasks.workunit.client.0.smithi008.stdout:3/925: write d0/d3/d15/fcb [1756761,99959] 0 2023-10-18T20:58:48.507 INFO:tasks.workunit.client.0.smithi008.stdout:3/926: creat d0/d3/d37/da6/f121 x:0 0 0 2023-10-18T20:58:48.507 INFO:tasks.workunit.client.0.smithi008.stdout:3/927: readlink d0/d3/de/d13/d35/dbf/la5 0 2023-10-18T20:58:48.522 INFO:tasks.workunit.client.1.smithi060.stdout:4/985: dread d4/dc/d2a/d13/f3a [0,4194304] 0 2023-10-18T20:58:48.522 INFO:tasks.workunit.client.1.smithi060.stdout:4/986: chown d4/dc/d2a/d39/d53/d76/da7/dca/dcd/cee 300344090 1 2023-10-18T20:58:48.525 INFO:tasks.workunit.client.1.smithi060.stdout:4/987: creat d4/d15/dae/f137 x:0 0 0 2023-10-18T20:58:48.526 INFO:tasks.workunit.client.0.smithi008.stdout:7/805: write d1/d3/f56 [8325345,67366] 0 2023-10-18T20:58:48.527 INFO:tasks.workunit.client.1.smithi060.stdout:3/936: dread d0/d22/f70 [0,4194304] 0 2023-10-18T20:58:48.528 INFO:tasks.workunit.client.1.smithi060.stdout:3/937: fsync d0/d22/d26/d2b/f80 0 2023-10-18T20:58:48.528 INFO:tasks.workunit.client.1.smithi060.stdout:3/938: creat d0/d22/dff/f13f x:0 0 0 2023-10-18T20:58:48.529 INFO:tasks.workunit.client.1.smithi060.stdout:3/939: chown d0/d22/d26/d79/c86 1996 1 2023-10-18T20:58:48.533 INFO:tasks.workunit.client.1.smithi060.stdout:4/988: truncate d4/dc/d2a/d31/da5/d11c/d69/d89/fc6 1383837 0 2023-10-18T20:58:48.534 INFO:tasks.workunit.client.0.smithi008.stdout:5/789: write d0/d2/d19/d7c/d31/d3f/d9a/fd4 [3209593,54154] 0 2023-10-18T20:58:48.538 INFO:tasks.workunit.client.1.smithi060.stdout:3/940: mkdir d0/d22/dff/d140 0 2023-10-18T20:58:48.539 INFO:tasks.workunit.client.0.smithi008.stdout:4/753: dwrite d0/d3/d21/d57/d8f/f88 [0,4194304] 0 2023-10-18T20:58:48.539 INFO:tasks.workunit.client.0.smithi008.stdout:4/754: creat d0/d17/d5b/d99/ff7 x:0 0 0 2023-10-18T20:58:48.543 INFO:tasks.workunit.client.1.smithi060.stdout:4/989: mkdir d4/dc/d123/d138 0 2023-10-18T20:58:48.543 INFO:tasks.workunit.client.1.smithi060.stdout:4/990: readlink d4/dc/d2a/d1d/l114 0 2023-10-18T20:58:48.544 INFO:tasks.workunit.client.0.smithi008.stdout:2/790: dread d1/d3/dd/f1e [4194304,4194304] 0 2023-10-18T20:58:48.544 INFO:tasks.workunit.client.0.smithi008.stdout:2/791: chown d1/d3/dd/d1c/f96 662 1 2023-10-18T20:58:48.547 INFO:tasks.workunit.client.0.smithi008.stdout:9/726: dread d2/dc/d17/f2e [0,4194304] 0 2023-10-18T20:58:48.551 INFO:tasks.workunit.client.1.smithi060.stdout:3/941: dread d0/d22/d26/fb0 [0,4194304] 0 2023-10-18T20:58:48.552 INFO:tasks.workunit.client.0.smithi008.stdout:7/806: read d1/d36/d3d/da3/de8/d5f/d7f/fda [1331927,17509] 0 2023-10-18T20:58:48.552 INFO:tasks.workunit.client.0.smithi008.stdout:7/807: fsync d1/da6/d79/f92 0 2023-10-18T20:58:48.553 INFO:tasks.workunit.client.0.smithi008.stdout:4/755: symlink d0/d17/d5b/lf8 0 2023-10-18T20:58:48.553 INFO:tasks.workunit.client.1.smithi060.stdout:3/942: mknod d0/d22/d26/d2b/c141 0 2023-10-18T20:58:48.554 INFO:tasks.workunit.client.1.smithi060.stdout:3/943: write d0/d22/d26/d8c/f104 [1449561,70361] 0 2023-10-18T20:58:48.554 INFO:tasks.workunit.client.1.smithi060.stdout:3/944: chown d0/d22/d26/fc1 63 1 2023-10-18T20:58:48.554 INFO:tasks.workunit.client.1.smithi060.stdout:3/945: write d0/d22/d50/fda [1239874,22297] 0 2023-10-18T20:58:48.555 INFO:tasks.workunit.client.0.smithi008.stdout:2/792: mkdir d1/d3/dd/d25/d76/d59/d103 0 2023-10-18T20:58:48.559 INFO:tasks.workunit.client.1.smithi060.stdout:9/948: dwrite d3/d99/d1c/d116/fc6 [0,4194304] 0 2023-10-18T20:58:48.560 INFO:tasks.workunit.client.1.smithi060.stdout:9/949: chown d3/d99/d1c/d116/d80/d112 0 1 2023-10-18T20:58:48.560 INFO:tasks.workunit.client.1.smithi060.stdout:9/950: read d3/d99/d1c/d5a/d5d/f9a [393945,54678] 0 2023-10-18T20:58:48.561 INFO:tasks.workunit.client.0.smithi008.stdout:6/929: dwrite df/d15/d48/d81/d116/fa3 [0,4194304] 0 2023-10-18T20:58:48.561 INFO:tasks.workunit.client.0.smithi008.stdout:6/930: stat df/d15/f46 0 2023-10-18T20:58:48.563 INFO:tasks.workunit.client.1.smithi060.stdout:8/983: dwrite d4/d9/db4/fc8 [0,4194304] 0 2023-10-18T20:58:48.566 INFO:tasks.workunit.client.1.smithi060.stdout:9/951: link d3/d99/d1c/d116/d80/f136 d3/d99/d1c/d116/d80/da0/dc2/d9e/dfd/f155 0 2023-10-18T20:58:48.566 INFO:tasks.workunit.client.1.smithi060.stdout:9/952: creat d3/d99/d1c/d116/d80/da0/dc2/d9e/d131/f156 x:0 0 0 2023-10-18T20:58:48.567 INFO:tasks.workunit.client.0.smithi008.stdout:3/928: dread d0/d3/d37/d74/f89 [0,4194304] 0 2023-10-18T20:58:48.569 INFO:tasks.workunit.client.0.smithi008.stdout:7/808: mkdir d1/da6/d4f/d87/df9 0 2023-10-18T20:58:48.569 INFO:tasks.workunit.client.0.smithi008.stdout:4/756: symlink d0/d3/lf9 0 2023-10-18T20:58:48.570 INFO:tasks.workunit.client.0.smithi008.stdout:8/969: dwrite d5/d8/df/d9d/d4d/db5/f138 [0,4194304] 0 2023-10-18T20:58:48.574 INFO:tasks.workunit.client.1.smithi060.stdout:4/991: dread d4/dc/d2a/d83/f100 [0,4194304] 0 2023-10-18T20:58:48.578 INFO:tasks.workunit.client.0.smithi008.stdout:5/790: rename d0/d2/d9/d9b/d6f to d0/d2/d9/d9b/de7/d11f 0 2023-10-18T20:58:48.578 INFO:tasks.workunit.client.0.smithi008.stdout:5/791: unlink d0/d2/d19/d7c/d31/f78 0 2023-10-18T20:58:48.578 INFO:tasks.workunit.client.0.smithi008.stdout:5/792: chown d0/d2/d19/d7c/d31/d3f/d70/fd0 57480795 1 2023-10-18T20:58:48.579 INFO:tasks.workunit.client.0.smithi008.stdout:5/793: chown d0/de/c5b 48890 1 2023-10-18T20:58:48.579 INFO:tasks.workunit.client.0.smithi008.stdout:5/794: stat d0/d2/d19/d7c/d42/f4e 0 2023-10-18T20:58:48.579 INFO:tasks.workunit.client.1.smithi060.stdout:4/992: symlink d4/l139 0 2023-10-18T20:58:48.587 INFO:tasks.workunit.client.0.smithi008.stdout:3/929: write d0/d3/de/d13/d35/fc7 [3191975,91798] 0 2023-10-18T20:58:48.589 INFO:tasks.workunit.client.0.smithi008.stdout:6/931: unlink df/d15/d48/ded/d108/dcf/d68/db9/d119/f122 0 2023-10-18T20:58:48.590 INFO:tasks.workunit.client.0.smithi008.stdout:7/809: link d1/d3/le d1/d36/d3d/d3e/lfa 0 2023-10-18T20:58:48.590 INFO:tasks.workunit.client.0.smithi008.stdout:6/932: chown df/d15/d48/d81/c106 5073 1 2023-10-18T20:58:48.592 INFO:tasks.workunit.client.0.smithi008.stdout:0/730: dwrite d0/dd/d19/d5f/d99/d94/f50 [0,4194304] 0 2023-10-18T20:58:48.592 INFO:tasks.workunit.client.0.smithi008.stdout:0/731: chown d0/dd/d19/d5f/d99/f6f 42353 1 2023-10-18T20:58:48.592 INFO:tasks.workunit.client.0.smithi008.stdout:0/732: chown d0/dd/d19/d5f/d99/f33 337183449 1 2023-10-18T20:58:48.593 INFO:tasks.workunit.client.0.smithi008.stdout:4/757: creat d0/d3/d21/d57/ffa x:0 0 0 2023-10-18T20:58:48.594 INFO:tasks.workunit.client.0.smithi008.stdout:9/727: rename d2/d8/db1/dd3/fc7 to d2/dc/d3d/d99/fd6 0 2023-10-18T20:58:48.594 INFO:tasks.workunit.client.0.smithi008.stdout:9/728: truncate d2/d8/db1/dd3/fc5 389724 0 2023-10-18T20:58:48.605 INFO:tasks.workunit.client.0.smithi008.stdout:7/810: dread d1/da6/d4f/d87/fb3 [0,4194304] 0 2023-10-18T20:58:48.611 INFO:tasks.workunit.client.0.smithi008.stdout:1/850: dwrite d9/de/df/d17/d1e/f65 [0,4194304] 0 2023-10-18T20:58:48.612 INFO:tasks.workunit.client.0.smithi008.stdout:3/930: unlink d0/d3/d42/f30 0 2023-10-18T20:58:48.614 INFO:tasks.workunit.client.0.smithi008.stdout:6/933: symlink df/d15/d48/d81/d116/d4c/l13a 0 2023-10-18T20:58:48.615 INFO:tasks.workunit.client.0.smithi008.stdout:6/934: chown df/d3c/d77/da9 121873267 1 2023-10-18T20:58:48.622 INFO:tasks.workunit.client.0.smithi008.stdout:0/733: mknod d0/d7c/d9a/dce/ce2 0 2023-10-18T20:58:48.623 INFO:tasks.workunit.client.0.smithi008.stdout:9/729: symlink d2/d8/da0/ld7 0 2023-10-18T20:58:48.623 INFO:tasks.workunit.client.0.smithi008.stdout:0/734: chown d0/d7c/d9a/d8a/d8f/da5 5 1 2023-10-18T20:58:48.623 INFO:tasks.workunit.client.0.smithi008.stdout:9/730: stat d2/dc/d1a/d1d/da7 0 2023-10-18T20:58:48.627 INFO:tasks.workunit.client.0.smithi008.stdout:8/970: dwrite d5/d8/df/d9d/d4d/dba/dd4/d9f/f130 [0,4194304] 0 2023-10-18T20:58:48.627 INFO:tasks.workunit.client.0.smithi008.stdout:3/931: mknod d0/d3/d37/d74/da2/c122 0 2023-10-18T20:58:48.627 INFO:tasks.workunit.client.0.smithi008.stdout:6/935: rename df/d15/d48/d81/d116/f113 to df/d3c/d77/da9/f13b 0 2023-10-18T20:58:48.627 INFO:tasks.workunit.client.0.smithi008.stdout:6/936: chown df/d15/d48/ded/d108/dff 386526 1 2023-10-18T20:58:48.628 INFO:tasks.workunit.client.0.smithi008.stdout:6/937: creat df/d3c/d77/da9/f13c x:0 0 0 2023-10-18T20:58:48.628 INFO:tasks.workunit.client.0.smithi008.stdout:6/938: chown df/l11 62734 1 2023-10-18T20:58:48.628 INFO:tasks.workunit.client.0.smithi008.stdout:6/939: creat df/d15/d48/d81/d116/d4c/f13d x:0 0 0 2023-10-18T20:58:48.629 INFO:tasks.workunit.client.0.smithi008.stdout:3/932: write d0/d3/de/d13/d35/d51/f8d [21119,36083] 0 2023-10-18T20:58:48.640 INFO:tasks.workunit.client.0.smithi008.stdout:4/758: dwrite d0/d17/f60 [0,4194304] 0 2023-10-18T20:58:48.641 INFO:tasks.workunit.client.0.smithi008.stdout:4/759: dread - d0/d3/fb5 zero size 2023-10-18T20:58:48.652 INFO:tasks.workunit.client.1.smithi060.stdout:3/946: dwrite d0/d3c/f40 [0,4194304] 0 2023-10-18T20:58:48.667 INFO:tasks.workunit.client.0.smithi008.stdout:7/811: dwrite d1/da6/f6f [0,4194304] 0 2023-10-18T20:58:48.671 INFO:tasks.workunit.client.0.smithi008.stdout:5/795: dwrite d0/fbc [0,4194304] 0 2023-10-18T20:58:48.678 INFO:tasks.workunit.client.0.smithi008.stdout:8/971: getdents d5/d8/df/d9d/d4d/db5/da3/d10a 0 2023-10-18T20:58:48.683 INFO:tasks.workunit.client.0.smithi008.stdout:0/735: dread d0/d3a/f8e [0,4194304] 0 2023-10-18T20:58:48.686 INFO:tasks.workunit.client.0.smithi008.stdout:9/731: dwrite d2/d4d/f67 [0,4194304] 0 2023-10-18T20:58:48.686 INFO:tasks.workunit.client.0.smithi008.stdout:9/732: chown d2/dc/d17/d19/d4a/d9a/cb6 503937 1 2023-10-18T20:58:48.689 INFO:tasks.workunit.client.1.smithi060.stdout:8/984: dwrite d4/d9/d37/d4e/dd9/f123 [0,4194304] 0 2023-10-18T20:58:48.689 INFO:tasks.workunit.client.0.smithi008.stdout:6/940: symlink df/d15/l13e 0 2023-10-18T20:58:48.699 INFO:tasks.workunit.client.0.smithi008.stdout:4/760: mkdir d0/d17/d6e/dfb 0 2023-10-18T20:58:48.700 INFO:tasks.workunit.client.0.smithi008.stdout:7/812: link d1/l1e d1/da6/d4f/lfb 0 2023-10-18T20:58:48.700 INFO:tasks.workunit.client.0.smithi008.stdout:4/761: write d0/d17/fab [115247,48813] 0 2023-10-18T20:58:48.703 INFO:tasks.workunit.client.0.smithi008.stdout:8/972: link d5/d8/df/d2e/d13b/d117/d122/dc4/f118 d5/d8/df/d9d/d4d/db5/f15f 0 2023-10-18T20:58:48.705 INFO:tasks.workunit.client.0.smithi008.stdout:9/733: symlink d2/d8/da0/ld8 0 2023-10-18T20:58:48.709 INFO:tasks.workunit.client.0.smithi008.stdout:3/933: rename d0/d84/dad/dbb to d0/d3/de/d13/d35/dbf/de0/d123 0 2023-10-18T20:58:48.717 INFO:tasks.workunit.client.1.smithi060.stdout:3/947: dwrite d0/d22/d26/d29/dae/de4/f118 [0,4194304] 0 2023-10-18T20:58:48.717 INFO:tasks.workunit.client.1.smithi060.stdout:3/948: creat d0/d22/d26/dfb/f142 x:0 0 0 2023-10-18T20:58:48.718 INFO:tasks.workunit.client.0.smithi008.stdout:7/813: dread d1/d36/d3d/da3/de8/f43 [0,4194304] 0 2023-10-18T20:58:48.725 INFO:tasks.workunit.client.1.smithi060.stdout:3/949: creat d0/d22/d26/d2c/da0/f143 x:0 0 0 2023-10-18T20:58:48.727 INFO:tasks.workunit.client.0.smithi008.stdout:4/762: link d0/d3/d21/d57/d8f/d95/lcf d0/d58/d8e/lfc 0 2023-10-18T20:58:48.727 INFO:tasks.workunit.client.0.smithi008.stdout:4/763: write d0/d58/d8e/fec [1027891,79847] 0 2023-10-18T20:58:48.740 INFO:tasks.workunit.client.1.smithi060.stdout:4/993: dwrite d4/dc/d2a/d39/d53/d65/f107 [0,4194304] 0 2023-10-18T20:58:48.748 INFO:tasks.workunit.client.1.smithi060.stdout:4/994: creat d4/dc/d2a/d13/d33/f13a x:0 0 0 2023-10-18T20:58:48.748 INFO:tasks.workunit.client.1.smithi060.stdout:4/995: creat d4/dc/d2a/d39/d53/d76/da7/dca/de5/f13b x:0 0 0 2023-10-18T20:58:48.752 INFO:tasks.workunit.client.0.smithi008.stdout:9/734: dwrite d2/f5 [0,4194304] 0 2023-10-18T20:58:48.755 INFO:tasks.workunit.client.1.smithi060.stdout:4/996: mknod d4/dc/c13c 0 2023-10-18T20:58:48.759 INFO:tasks.workunit.client.0.smithi008.stdout:9/735: rmdir d2/dc/d40/d56 39 2023-10-18T20:58:48.760 INFO:tasks.workunit.client.0.smithi008.stdout:9/736: fdatasync d2/dc/d3d/f70 0 2023-10-18T20:58:48.760 INFO:tasks.workunit.client.0.smithi008.stdout:9/737: write d2/dc/d3d/f98 [62411,93642] 0 2023-10-18T20:58:48.761 INFO:tasks.workunit.client.1.smithi060.stdout:3/950: read d0/d22/d26/d29/dae/de4/ffa [2734929,50665] 0 2023-10-18T20:58:48.761 INFO:tasks.workunit.client.1.smithi060.stdout:8/985: dwrite d4/d9/d31/fbe [0,4194304] 0 2023-10-18T20:58:48.764 INFO:tasks.workunit.client.0.smithi008.stdout:0/736: dwrite d0/dd/d19/d24/fdf [0,4194304] 0 2023-10-18T20:58:48.766 INFO:tasks.workunit.client.0.smithi008.stdout:5/796: dwrite d0/f29 [0,4194304] 0 2023-10-18T20:58:48.768 INFO:tasks.workunit.client.0.smithi008.stdout:3/934: dwrite d0/d3/f43 [0,4194304] 0 2023-10-18T20:58:48.769 INFO:tasks.workunit.client.0.smithi008.stdout:3/935: fsync d0/dc0/fec 0 2023-10-18T20:58:48.771 INFO:tasks.workunit.client.1.smithi060.stdout:3/951: creat d0/d22/f144 x:0 0 0 2023-10-18T20:58:48.773 INFO:tasks.workunit.client.0.smithi008.stdout:7/814: dwrite d1/da6/d79/f71 [0,4194304] 0 2023-10-18T20:58:48.774 INFO:tasks.workunit.client.0.smithi008.stdout:7/815: truncate d1/d3/fc0 738517 0 2023-10-18T20:58:48.776 INFO:tasks.workunit.client.1.smithi060.stdout:9/953: sync 2023-10-18T20:58:48.777 INFO:tasks.workunit.client.1.smithi060.stdout:9/954: chown d3/d99/d1c/d116/d80/da0/dc2/d9e/d131 138281 1 2023-10-18T20:58:48.779 INFO:tasks.workunit.client.1.smithi060.stdout:9/955: creat d3/df8/f157 x:0 0 0 2023-10-18T20:58:48.779 INFO:tasks.workunit.client.1.smithi060.stdout:9/956: creat d3/d99/d1c/d116/d80/d127/f158 x:0 0 0 2023-10-18T20:58:48.782 INFO:tasks.workunit.client.1.smithi060.stdout:8/986: dread d4/d9/d4f/f71 [0,4194304] 0 2023-10-18T20:58:48.783 INFO:tasks.workunit.client.1.smithi060.stdout:9/957: mkdir d3/d99/d1c/d116/d80/da0/dc2/d9e/d131/d14f/d159 0 2023-10-18T20:58:48.783 INFO:tasks.workunit.client.1.smithi060.stdout:9/958: dread - d3/d99/d1c/d116/d80/da0/dc2/d9e/d131/f14d zero size 2023-10-18T20:58:48.784 INFO:tasks.workunit.client.0.smithi008.stdout:9/738: write d2/dc/d3d/d99/fd4 [7940179,75079] 0 2023-10-18T20:58:48.784 INFO:tasks.workunit.client.1.smithi060.stdout:9/959: creat d3/d99/d1c/d116/d80/da0/dc2/d9e/f15a x:0 0 0 2023-10-18T20:58:48.786 INFO:tasks.workunit.client.0.smithi008.stdout:5/797: creat d0/d2/d19/d7c/d42/f120 x:0 0 0 2023-10-18T20:58:48.787 INFO:tasks.workunit.client.0.smithi008.stdout:3/936: mkdir d0/d3/da9/d124 0 2023-10-18T20:58:48.788 INFO:tasks.workunit.client.0.smithi008.stdout:3/937: creat d0/d3/f125 x:0 0 0 2023-10-18T20:58:48.789 INFO:tasks.workunit.client.0.smithi008.stdout:0/737: write d0/dd/f27 [4058719,105665] 0 2023-10-18T20:58:48.791 INFO:tasks.workunit.client.0.smithi008.stdout:7/816: unlink d1/d36/d3d/da3/de8/d5f/d7f/cd9 0 2023-10-18T20:58:48.791 INFO:tasks.workunit.client.0.smithi008.stdout:7/817: chown d1/d36/d3d/da3/de8/d5f/f72 116 1 2023-10-18T20:58:48.796 INFO:tasks.workunit.client.0.smithi008.stdout:5/798: mknod d0/d103/c121 0 2023-10-18T20:58:48.800 INFO:tasks.workunit.client.0.smithi008.stdout:7/818: creat d1/da6/d4f/d87/ffc x:0 0 0 2023-10-18T20:58:48.801 INFO:tasks.workunit.client.1.smithi060.stdout:8/987: dread d4/d9/d37/d4e/f59 [0,4194304] 0 2023-10-18T20:58:48.802 INFO:tasks.workunit.client.0.smithi008.stdout:3/938: rmdir d0/d3/d15 39 2023-10-18T20:58:48.803 INFO:tasks.workunit.client.1.smithi060.stdout:8/988: symlink d4/d9/d31/d6f/dfa/d12c/l139 0 2023-10-18T20:58:48.805 INFO:tasks.workunit.client.0.smithi008.stdout:5/799: mkdir d0/d2/d122 0 2023-10-18T20:58:48.805 INFO:tasks.workunit.client.0.smithi008.stdout:5/800: write d0/d86/fe9 [4588425,794] 0 2023-10-18T20:58:48.805 INFO:tasks.workunit.client.1.smithi060.stdout:8/989: symlink d4/d9/d31/d6f/dfa/de3/l13a 0 2023-10-18T20:58:48.806 INFO:tasks.workunit.client.1.smithi060.stdout:8/990: creat d4/d9/d37/d4e/f13b x:0 0 0 2023-10-18T20:58:48.807 INFO:tasks.workunit.client.0.smithi008.stdout:0/738: getdents d0 0 2023-10-18T20:58:48.807 INFO:tasks.workunit.client.0.smithi008.stdout:0/739: write d0/d7c/d9a/d8a/d8f/da5/fd7 [321354,74712] 0 2023-10-18T20:58:48.807 INFO:tasks.workunit.client.0.smithi008.stdout:0/740: creat d0/dd/d19/d24/fe3 x:0 0 0 2023-10-18T20:58:48.808 INFO:tasks.workunit.client.0.smithi008.stdout:7/819: mknod d1/da6/d4f/d87/cfd 0 2023-10-18T20:58:48.808 INFO:tasks.workunit.client.1.smithi060.stdout:8/991: creat d4/d9/d88/ded/f13c x:0 0 0 2023-10-18T20:58:48.809 INFO:tasks.workunit.client.1.smithi060.stdout:8/992: creat d4/d9/d31/d35/d9f/da3/dd8/d10f/d137/f13d x:0 0 0 2023-10-18T20:58:48.811 INFO:tasks.workunit.client.0.smithi008.stdout:2/793: sync 2023-10-18T20:58:48.813 INFO:tasks.workunit.client.1.smithi060.stdout:8/993: rename d4/d9/d31/d6f/dfa/d7b/f118 to d4/d9/d31/d6f/dfa/d12c/f13e 0 2023-10-18T20:58:48.815 INFO:tasks.workunit.client.0.smithi008.stdout:3/939: mknod d0/d3/de/d13/d35/dbf/de0/d123/de8/c126 0 2023-10-18T20:58:48.816 INFO:tasks.workunit.client.0.smithi008.stdout:5/801: mknod d0/d2/d19/d7c/d31/d8d/c123 0 2023-10-18T20:58:48.818 INFO:tasks.workunit.client.1.smithi060.stdout:8/994: symlink d4/d9/d31/d35/d9f/da3/l13f 0 2023-10-18T20:58:48.819 INFO:tasks.workunit.client.0.smithi008.stdout:0/741: symlink d0/d7c/d9a/d8a/le4 0 2023-10-18T20:58:48.820 INFO:tasks.workunit.client.0.smithi008.stdout:5/802: mknod d0/de/c124 0 2023-10-18T20:58:48.820 INFO:tasks.workunit.client.0.smithi008.stdout:5/803: stat d0/f3 0 2023-10-18T20:58:48.820 INFO:tasks.workunit.client.0.smithi008.stdout:5/804: chown d0/d2/d19/d7c/d58/d65/d68/f11e 45754 1 2023-10-18T20:58:48.821 INFO:tasks.workunit.client.0.smithi008.stdout:5/805: stat d0/d2/d19/d7c/d31/d3f/d70/da4/c11a 0 2023-10-18T20:58:48.824 INFO:tasks.workunit.client.0.smithi008.stdout:5/806: creat d0/d2/d19/d7c/d31/d80/f125 x:0 0 0 2023-10-18T20:58:48.825 INFO:tasks.workunit.client.0.smithi008.stdout:5/807: fdatasync d0/d2/d19/d7c/d31/d3f/fdf 0 2023-10-18T20:58:48.825 INFO:tasks.workunit.client.0.smithi008.stdout:0/742: mkdir d0/dd/d19/d24/de5 0 2023-10-18T20:58:48.831 INFO:tasks.workunit.client.0.smithi008.stdout:5/808: mkdir d0/d2/d9/d34/dfb/d126 0 2023-10-18T20:58:48.832 INFO:tasks.workunit.client.0.smithi008.stdout:7/820: dread d1/d3/f17 [0,4194304] 0 2023-10-18T20:58:48.832 INFO:tasks.workunit.client.0.smithi008.stdout:5/809: dread - d0/d2/d19/f67 zero size 2023-10-18T20:58:48.837 INFO:tasks.workunit.client.1.smithi060.stdout:4/997: dwrite d4/dc/d2a/d13/d27/f67 [0,4194304] 0 2023-10-18T20:58:48.839 INFO:tasks.workunit.client.1.smithi060.stdout:4/998: mknod d4/dc/d2a/d1d/c13d 0 2023-10-18T20:58:48.842 INFO:tasks.workunit.client.1.smithi060.stdout:4/999: creat d4/dc/de2/f13e x:0 0 0 2023-10-18T20:58:48.843 INFO:tasks.workunit.client.0.smithi008.stdout:5/810: rename d0/d2/de6 to d0/d127 0 2023-10-18T20:58:48.843 INFO:tasks.workunit.client.0.smithi008.stdout:0/743: dread d0/dd/d19/d5f/d99/f4b [0,4194304] 0 2023-10-18T20:58:48.848 INFO:tasks.workunit.client.1.smithi060.stdout:3/952: dwrite d0/d3c/d3d/f7b [0,4194304] 0 2023-10-18T20:58:48.848 INFO:tasks.workunit.client.0.smithi008.stdout:0/744: truncate d0/dd/df/f4c 1975782 0 2023-10-18T20:58:48.848 INFO:tasks.workunit.client.0.smithi008.stdout:0/745: fsync d0/d7c/d9a/d8a/d8f/fb2 0 2023-10-18T20:58:48.849 INFO:tasks.workunit.client.0.smithi008.stdout:0/746: write d0/dd/df/fc9 [1115434,68770] 0 2023-10-18T20:58:48.849 INFO:tasks.workunit.client.0.smithi008.stdout:9/739: dwrite d2/dc/d17/d7b/fa2 [0,4194304] 0 2023-10-18T20:58:48.850 INFO:tasks.workunit.client.0.smithi008.stdout:9/740: fdatasync d2/f7f 0 2023-10-18T20:58:48.851 INFO:tasks.workunit.client.1.smithi060.stdout:9/960: dwrite d3/d99/d1c/d116/d80/da0/ddd/f10d [0,4194304] 0 2023-10-18T20:58:48.851 INFO:tasks.workunit.client.1.smithi060.stdout:9/961: write d3/df8/f157 [1048123,100215] 0 2023-10-18T20:58:48.852 INFO:tasks.workunit.client.0.smithi008.stdout:0/747: mkdir d0/d7c/d9a/d8a/d8f/da5/de6 0 2023-10-18T20:58:48.854 INFO:tasks.workunit.client.0.smithi008.stdout:9/741: symlink d2/dc/d40/ld9 0 2023-10-18T20:58:48.854 INFO:tasks.workunit.client.0.smithi008.stdout:9/742: write d2/d8/db1/dd3/d59/fbd [4060106,64600] 0 2023-10-18T20:58:48.859 INFO:tasks.workunit.client.1.smithi060.stdout:9/962: link d3/d99/d1c/d5a/d5d/d56/dd0/lab d3/d99/l15b 0 2023-10-18T20:58:48.862 INFO:tasks.workunit.client.1.smithi060.stdout:9/963: mknod d3/d99/d1c/d116/d2d/c15c 0 2023-10-18T20:58:48.865 INFO:tasks.workunit.client.1.smithi060.stdout:9/964: creat d3/d99/d1c/d116/d80/d112/f15d x:0 0 0 2023-10-18T20:58:48.867 INFO:tasks.workunit.client.1.smithi060.stdout:8/995: dwrite d4/d9/f6b [0,4194304] 0 2023-10-18T20:58:48.869 INFO:tasks.workunit.client.0.smithi008.stdout:0/748: rmdir d0/dd/d19/d5f/d99 39 2023-10-18T20:58:48.869 INFO:tasks.workunit.client.0.smithi008.stdout:0/749: truncate d0/d7c/d9a/d8a/fdd 741109 0 2023-10-18T20:58:48.870 INFO:tasks.workunit.client.0.smithi008.stdout:7/821: write d1/d36/d3d/d3e/fb0 [1006111,71668] 0 2023-10-18T20:58:48.871 INFO:tasks.workunit.client.1.smithi060.stdout:8/996: rename d4/d9/d4f/d74/f103 to d4/d9/d31/d6f/dbd/d11c/f140 0 2023-10-18T20:58:48.873 INFO:tasks.workunit.client.0.smithi008.stdout:7/822: mknod d1/da6/d79/db5/cfe 0 2023-10-18T20:58:48.876 INFO:tasks.workunit.client.0.smithi008.stdout:6/941: dwrite df/d15/d48/d81/d116/d4c/f73 [0,4194304] 0 2023-10-18T20:58:48.876 INFO:tasks.workunit.client.0.smithi008.stdout:6/942: write df/d15/d48/d81/d116/dbf/f75 [907907,916] 0 2023-10-18T20:58:48.882 INFO:tasks.workunit.client.1.smithi060.stdout:8/997: unlink d4/d9/d4f/d74/d81/fdd 0 2023-10-18T20:58:48.884 INFO:tasks.workunit.client.1.smithi060.stdout:3/953: dread d0/d3c/d3d/f7a [0,4194304] 0 2023-10-18T20:58:48.884 INFO:tasks.workunit.client.1.smithi060.stdout:3/954: dread - d0/d3c/d3d/d4d/f120 zero size 2023-10-18T20:58:48.887 INFO:tasks.workunit.client.0.smithi008.stdout:3/940: dwrite d0/d3/d42/d88/fc5 [4194304,4194304] 0 2023-10-18T20:58:48.888 INFO:tasks.workunit.client.1.smithi060.stdout:8/998: symlink d4/d9/d31/d6f/l141 0 2023-10-18T20:58:48.892 INFO:tasks.workunit.client.0.smithi008.stdout:5/811: rmdir d0/d2/d9/d34/dfb 39 2023-10-18T20:58:48.892 INFO:tasks.workunit.client.1.smithi060.stdout:8/999: mknod d4/d9/d31/d35/d9f/da3/ddb/d130/c142 0 2023-10-18T20:58:48.900 INFO:tasks.workunit.client.0.smithi008.stdout:6/943: write df/d15/d48/ded/d108/dcf/d58/dec/f69 [979162,68094] 0 2023-10-18T20:58:48.909 INFO:tasks.workunit.client.0.smithi008.stdout:6/944: mkdir df/d15/d13f 0 2023-10-18T20:58:48.910 INFO:tasks.workunit.client.0.smithi008.stdout:5/812: mknod d0/d2/d19/c128 0 2023-10-18T20:58:48.910 INFO:tasks.workunit.client.0.smithi008.stdout:5/813: chown d0/da9/lf1 589 1 2023-10-18T20:58:48.911 INFO:tasks.workunit.client.1.smithi060.stdout:3/955: write d0/d22/d26/d2c/fbd [938728,115587] 0 2023-10-18T20:58:48.912 INFO:tasks.workunit.client.0.smithi008.stdout:6/945: stat df/d26/f61 0 2023-10-18T20:58:48.912 INFO:tasks.workunit.client.0.smithi008.stdout:6/946: write df/d15/d48/ded/d108/dcf/d58/dd7/f102 [786016,62463] 0 2023-10-18T20:58:48.913 INFO:tasks.workunit.client.0.smithi008.stdout:6/947: readlink df/d15/d48/d4b/l91 0 2023-10-18T20:58:48.913 INFO:tasks.workunit.client.0.smithi008.stdout:6/948: dread - df/d3c/d77/da9/ff1 zero size 2023-10-18T20:58:48.915 INFO:tasks.workunit.client.0.smithi008.stdout:6/949: mknod df/d15/d48/ded/d108/dcf/d7e/c140 0 2023-10-18T20:58:48.916 INFO:tasks.workunit.client.1.smithi060.stdout:3/956: unlink d0/d5e/fd4 0 2023-10-18T20:58:48.916 INFO:tasks.workunit.client.1.smithi060.stdout:3/957: readlink d0/d22/d26/d2c/ldd 0 2023-10-18T20:58:48.916 INFO:tasks.workunit.client.1.smithi060.stdout:3/958: fdatasync d0/d22/d26/d2c/da0/f143 0 2023-10-18T20:58:48.917 INFO:tasks.workunit.client.0.smithi008.stdout:6/950: mknod df/d15/d48/d81/d116/dbf/c141 0 2023-10-18T20:58:48.919 INFO:tasks.workunit.client.0.smithi008.stdout:6/951: unlink df/d15/d48/d81/d116/d4c/c137 0 2023-10-18T20:58:48.921 INFO:tasks.workunit.client.0.smithi008.stdout:2/794: dwrite d1/d3/dd/d25/d76/d59/d85/fff [0,4194304] 0 2023-10-18T20:58:48.925 INFO:tasks.workunit.client.0.smithi008.stdout:1/851: sync 2023-10-18T20:58:48.927 INFO:tasks.workunit.client.1.smithi060.stdout:9/965: dwrite d3/d99/d19/d54/d11d/f53 [0,4194304] 0 2023-10-18T20:58:48.928 INFO:tasks.workunit.client.0.smithi008.stdout:9/743: dwrite d2/dc/f4b [0,4194304] 0 2023-10-18T20:58:48.930 INFO:tasks.workunit.client.1.smithi060.stdout:9/966: mknod d3/d99/d1c/d116/d2d/db9/c15e 0 2023-10-18T20:58:48.932 INFO:tasks.workunit.client.0.smithi008.stdout:2/795: truncate d1/d3/dd/d1c/d3a/d45/de1/ff6 1670169 0 2023-10-18T20:58:48.932 INFO:tasks.workunit.client.0.smithi008.stdout:1/852: creat d9/dd4/f109 x:0 0 0 2023-10-18T20:58:48.932 INFO:tasks.workunit.client.0.smithi008.stdout:1/853: fdatasync d9/f2f 0 2023-10-18T20:58:48.934 INFO:tasks.workunit.client.1.smithi060.stdout:9/967: rename d3/d99/d1c/d5a/l104 to d3/d99/d1c/d116/d80/da0/dc2/l15f 0 2023-10-18T20:58:48.934 INFO:tasks.workunit.client.0.smithi008.stdout:1/854: mkdir d9/de/df/d17/ddb/d10a 0 2023-10-18T20:58:48.935 INFO:tasks.workunit.client.1.smithi060.stdout:9/968: write d3/d99/d19/d54/ff9 [999817,114498] 0 2023-10-18T20:58:48.935 INFO:tasks.workunit.client.0.smithi008.stdout:3/941: dread d0/d84/f90 [0,4194304] 0 2023-10-18T20:58:48.936 INFO:tasks.workunit.client.0.smithi008.stdout:2/796: mkdir d1/d3/d40/d6e/d7e/db3/d104 0 2023-10-18T20:58:48.937 INFO:tasks.workunit.client.1.smithi060.stdout:9/969: rmdir d3/d99/d1c/d116/d80/da0 39 2023-10-18T20:58:48.937 INFO:tasks.workunit.client.1.smithi060.stdout:9/970: fsync d3/d99/d1c/d116/d80/fb7 0 2023-10-18T20:58:48.937 INFO:tasks.workunit.client.1.smithi060.stdout:9/971: write d3/d99/d19/d54/da5/f152 [58498,50825] 0 2023-10-18T20:58:48.938 INFO:tasks.workunit.client.0.smithi008.stdout:1/855: getdents d9/de/df/d17/d25/d94/dc4/dc6 0 2023-10-18T20:58:48.939 INFO:tasks.workunit.client.0.smithi008.stdout:3/942: link d0/f7 d0/d84/dad/f127 0 2023-10-18T20:58:48.944 INFO:tasks.workunit.client.1.smithi060.stdout:3/959: write d0/d22/d26/d29/dae/f10c [3753887,125540] 0 2023-10-18T20:58:48.944 INFO:tasks.workunit.client.0.smithi008.stdout:1/856: mkdir d9/de/d10b 0 2023-10-18T20:58:48.948 INFO:tasks.workunit.client.0.smithi008.stdout:3/943: creat d0/d3/d42/d88/f128 x:0 0 0 2023-10-18T20:58:48.958 INFO:tasks.workunit.client.0.smithi008.stdout:1/857: mknod d9/de/df/d85/c10c 0 2023-10-18T20:58:48.958 INFO:tasks.workunit.client.0.smithi008.stdout:1/858: fsync d9/de/df/d17/d55/f79 0 2023-10-18T20:58:48.959 INFO:tasks.workunit.client.0.smithi008.stdout:1/859: chown d9/de/df/l73 54090799 1 2023-10-18T20:58:48.959 INFO:tasks.workunit.client.0.smithi008.stdout:2/797: rmdir d1/d3/dd/d1c/d3a 39 2023-10-18T20:58:48.960 INFO:tasks.workunit.client.0.smithi008.stdout:4/764: sync 2023-10-18T20:58:48.960 INFO:tasks.workunit.client.0.smithi008.stdout:0/750: dwrite d0/f14 [0,4194304] 0 2023-10-18T20:58:48.962 INFO:tasks.workunit.client.0.smithi008.stdout:8/973: sync 2023-10-18T20:58:48.963 INFO:tasks.workunit.client.0.smithi008.stdout:3/944: creat d0/d3/da9/f129 x:0 0 0 2023-10-18T20:58:48.966 INFO:tasks.workunit.client.0.smithi008.stdout:1/860: mkdir d9/de/df/d17/d1e/dc0/d10d 0 2023-10-18T20:58:48.966 INFO:tasks.workunit.client.0.smithi008.stdout:2/798: mknod d1/d3/dd/d25/c105 0 2023-10-18T20:58:48.966 INFO:tasks.workunit.client.0.smithi008.stdout:1/861: getdents d9/de/df/d17/d1e/d7d/d89/dec/dfc 0 2023-10-18T20:58:48.966 INFO:tasks.workunit.client.0.smithi008.stdout:6/952: dwrite df/d15/d48/ded/d108/dcf/d3f/f7b [0,4194304] 0 2023-10-18T20:58:48.969 INFO:tasks.workunit.client.0.smithi008.stdout:5/814: dwrite d0/d2/d19/d7c/d31/d82/fc5 [4194304,4194304] 0 2023-10-18T20:58:48.971 INFO:tasks.workunit.client.0.smithi008.stdout:4/765: link d0/d3/d21/fd9 d0/d58/d8e/ffd 0 2023-10-18T20:58:48.971 INFO:tasks.workunit.client.0.smithi008.stdout:4/766: stat d0/d17/d6e 0 2023-10-18T20:58:48.974 INFO:tasks.workunit.client.0.smithi008.stdout:0/751: mkdir d0/dd/d19/d5f/d89/da7/de7 0 2023-10-18T20:58:48.974 INFO:tasks.workunit.client.0.smithi008.stdout:3/945: creat d0/d3/d37/f12a x:0 0 0 2023-10-18T20:58:48.974 INFO:tasks.workunit.client.0.smithi008.stdout:0/752: fsync d0/d90/fd8 0 2023-10-18T20:58:48.974 INFO:tasks.workunit.client.0.smithi008.stdout:0/753: readlink d0/dd/d19/l5d 0 2023-10-18T20:58:48.975 INFO:tasks.workunit.client.0.smithi008.stdout:7/823: dwrite d1/d3/f2a [0,4194304] 0 2023-10-18T20:58:48.976 INFO:tasks.workunit.client.0.smithi008.stdout:5/815: dread d0/d2/d19/f81 [0,4194304] 0 2023-10-18T20:58:48.977 INFO:tasks.workunit.client.0.smithi008.stdout:6/953: dread df/d15/d48/ded/d108/dcf/d3f/fdf [0,4194304] 0 2023-10-18T20:58:48.986 INFO:tasks.workunit.client.0.smithi008.stdout:7/824: dread d1/d36/d3d/d3e/f31 [0,4194304] 0 2023-10-18T20:58:48.996 INFO:tasks.workunit.client.0.smithi008.stdout:5/816: dread d0/d2/d9/d34/f3b [0,4194304] 0 2023-10-18T20:58:49.004 INFO:tasks.workunit.client.0.smithi008.stdout:3/946: mknod d0/d3/de/d13/d35/dbf/de0/d123/c12b 0 2023-10-18T20:58:49.007 INFO:tasks.workunit.client.0.smithi008.stdout:0/754: rename d0/dd/d19/d5f/d99/f38 to d0/d7c/d9a/dce/fe8 0 2023-10-18T20:58:49.008 INFO:tasks.workunit.client.0.smithi008.stdout:2/799: dwrite d1/d3/dd/d1c/f96 [0,4194304] 0 2023-10-18T20:58:49.008 INFO:tasks.workunit.client.0.smithi008.stdout:2/800: truncate d1/d3/dd/d25/fe5 459339 0 2023-10-18T20:58:49.008 INFO:tasks.workunit.client.0.smithi008.stdout:6/954: mknod df/d36/c142 0 2023-10-18T20:58:49.010 INFO:tasks.workunit.client.0.smithi008.stdout:7/825: truncate d1/da6/d4f/f5e 867766 0 2023-10-18T20:58:49.010 INFO:tasks.workunit.client.0.smithi008.stdout:7/826: fdatasync d1/da6/d79/db5/fd7 0 2023-10-18T20:58:49.010 INFO:tasks.workunit.client.0.smithi008.stdout:7/827: fdatasync d1/d36/d3d/d3e/f31 0 2023-10-18T20:58:49.011 INFO:tasks.workunit.client.0.smithi008.stdout:7/828: stat d1/da6/d4f/fc5 0 2023-10-18T20:58:49.011 INFO:tasks.workunit.client.0.smithi008.stdout:7/829: readlink d1/da6/d4f/lfb 0 2023-10-18T20:58:49.013 INFO:tasks.workunit.client.0.smithi008.stdout:7/830: chown d1/d36/d3d/d3e/d59/fe6 17957 1 2023-10-18T20:58:49.013 INFO:tasks.workunit.client.0.smithi008.stdout:7/831: creat d1/da6/fff x:0 0 0 2023-10-18T20:58:49.014 INFO:tasks.workunit.client.0.smithi008.stdout:1/862: rmdir d9/de/df/d17/d25/d57 39 2023-10-18T20:58:49.015 INFO:tasks.workunit.client.0.smithi008.stdout:0/755: stat d0/dd/d19/lb4 0 2023-10-18T20:58:49.015 INFO:tasks.workunit.client.0.smithi008.stdout:0/756: chown d0/dd/d19/d5f/d99/c64 257174726 1 2023-10-18T20:58:49.015 INFO:tasks.workunit.client.0.smithi008.stdout:6/955: link df/d15/d48/ded/d108/dcf/d7e/l9b df/d15/d48/ded/d108/dcf/d3f/dcd/l143 0 2023-10-18T20:58:49.015 INFO:tasks.workunit.client.0.smithi008.stdout:6/956: stat df/d15/d48/d81/c8b 0 2023-10-18T20:58:49.016 INFO:tasks.workunit.client.0.smithi008.stdout:4/767: dwrite d0/d17/d5b/f5f [0,4194304] 0 2023-10-18T20:58:49.017 INFO:tasks.workunit.client.0.smithi008.stdout:3/947: dread d0/d4a/d64/f83 [0,4194304] 0 2023-10-18T20:58:49.018 INFO:tasks.workunit.client.0.smithi008.stdout:5/817: dread d0/ff7 [0,4194304] 0 2023-10-18T20:58:49.019 INFO:tasks.workunit.client.0.smithi008.stdout:7/832: rename d1/da6/d79/l9c to d1/d36/d3d/d3e/l100 0 2023-10-18T20:58:49.019 INFO:tasks.workunit.client.0.smithi008.stdout:7/833: stat d1/d3/c35 0 2023-10-18T20:58:49.020 INFO:tasks.workunit.client.0.smithi008.stdout:1/863: unlink d9/de/df/d17/d25/d94/dc4/dc6/ce0 0 2023-10-18T20:58:49.020 INFO:tasks.workunit.client.0.smithi008.stdout:0/757: creat d0/d3a/d61/fe9 x:0 0 0 2023-10-18T20:58:49.020 INFO:tasks.workunit.client.0.smithi008.stdout:1/864: creat d9/de/df/d17/d1e/dc0/f10e x:0 0 0 2023-10-18T20:58:49.022 INFO:tasks.workunit.client.0.smithi008.stdout:5/818: creat d0/d2/d19/d7c/d31/d3f/d70/dc0/ddb/f129 x:0 0 0 2023-10-18T20:58:49.022 INFO:tasks.workunit.client.0.smithi008.stdout:5/819: write d0/d2/d19/d7c/d42/d5a/f69 [4330653,62032] 0 2023-10-18T20:58:49.023 INFO:tasks.workunit.client.0.smithi008.stdout:7/834: mknod d1/d36/d3d/d3e/d59/d73/d7b/daf/de5/c101 0 2023-10-18T20:58:49.025 INFO:tasks.workunit.client.0.smithi008.stdout:5/820: creat d0/da9/dda/de1/f12a x:0 0 0 2023-10-18T20:58:49.025 INFO:tasks.workunit.client.0.smithi008.stdout:5/821: read d0/d2/d19/f81 [225771,110753] 0 2023-10-18T20:58:49.026 INFO:tasks.workunit.client.0.smithi008.stdout:5/822: readlink d0/d2/l1e 0 2023-10-18T20:58:49.026 INFO:tasks.workunit.client.0.smithi008.stdout:7/835: creat d1/d36/d3d/da3/de8/d5f/dba/dcc/f102 x:0 0 0 2023-10-18T20:58:49.027 INFO:tasks.workunit.client.1.smithi060.stdout:9/972: dwrite d3/d99/d1c/d116/d80/da0/dc2/f94 [0,4194304] 0 2023-10-18T20:58:49.027 INFO:tasks.workunit.client.1.smithi060.stdout:9/973: readlink d3/d99/d1c/d116/d80/da0/ddd/lef 0 2023-10-18T20:58:49.030 INFO:tasks.workunit.client.1.smithi060.stdout:9/974: mkdir d3/d99/d1c/d116/d2d/d160 0 2023-10-18T20:58:49.030 INFO:tasks.workunit.client.0.smithi008.stdout:0/758: mkdir d0/dd/dea 0 2023-10-18T20:58:49.031 INFO:tasks.workunit.client.0.smithi008.stdout:0/759: chown d0/dd/d19/c52 39434434 1 2023-10-18T20:58:49.031 INFO:tasks.workunit.client.0.smithi008.stdout:0/760: fdatasync d0/d3a/f8e 0 2023-10-18T20:58:49.031 INFO:tasks.workunit.client.0.smithi008.stdout:5/823: creat d0/d2/d19/d7c/d31/d3f/d70/f12b x:0 0 0 2023-10-18T20:58:49.034 INFO:tasks.workunit.client.0.smithi008.stdout:0/761: creat d0/dd/df/feb x:0 0 0 2023-10-18T20:58:49.039 INFO:tasks.workunit.client.1.smithi060.stdout:9/975: dread d3/d99/d1c/d25/f3e [0,4194304] 0 2023-10-18T20:58:49.039 INFO:tasks.workunit.client.1.smithi060.stdout:9/976: dread - d3/d99/d1c/d116/d80/da0/dc2/d9e/f143 zero size 2023-10-18T20:58:49.040 INFO:tasks.workunit.client.0.smithi008.stdout:0/762: rename d0/dd/df/fc9 to d0/d7c/d9a/d8a/fec 0 2023-10-18T20:58:49.040 INFO:tasks.workunit.client.0.smithi008.stdout:0/763: truncate d0/dd/df/dd9/fda 468260 0 2023-10-18T20:58:49.041 INFO:tasks.workunit.client.0.smithi008.stdout:1/865: write d9/de/df/d17/d55/f79 [1777740,69063] 0 2023-10-18T20:58:49.041 INFO:tasks.workunit.client.0.smithi008.stdout:1/866: creat d9/de/df/d17/d55/f10f x:0 0 0 2023-10-18T20:58:49.041 INFO:tasks.workunit.client.0.smithi008.stdout:1/867: write d9/de/df/d17/d1e/d9a/fbf [148432,62517] 0 2023-10-18T20:58:49.042 INFO:tasks.workunit.client.0.smithi008.stdout:1/868: unlink d9/de/f58 0 2023-10-18T20:58:49.042 INFO:tasks.workunit.client.0.smithi008.stdout:1/869: write d9/de/df/d17/d1e/fd1 [60155,85487] 0 2023-10-18T20:58:49.042 INFO:tasks.workunit.client.1.smithi060.stdout:9/977: creat d3/d99/d19/d54/f161 x:0 0 0 2023-10-18T20:58:49.044 INFO:tasks.workunit.client.0.smithi008.stdout:0/764: unlink d0/d7c/d9a/d8a/d8f/d21/d85/ca6 0 2023-10-18T20:58:49.049 INFO:tasks.workunit.client.1.smithi060.stdout:3/960: dwrite d0/d22/d26/d79/fb4 [0,4194304] 0 2023-10-18T20:58:49.051 INFO:tasks.workunit.client.1.smithi060.stdout:3/961: rename d0/d3c/f40 to d0/d3c/d3d/d4d/d95/d123/d12e/f145 0 2023-10-18T20:58:49.054 INFO:tasks.workunit.client.1.smithi060.stdout:3/962: truncate d0/d3c/d3d/d4d/f8e 1545628 0 2023-10-18T20:58:49.055 INFO:tasks.workunit.client.1.smithi060.stdout:3/963: stat d0/d22/d26/d2b/l30 0 2023-10-18T20:58:49.055 INFO:tasks.workunit.client.0.smithi008.stdout:0/765: creat d0/dd/d19/d5f/d99/d5e/d7d/fed x:0 0 0 2023-10-18T20:58:49.056 INFO:tasks.workunit.client.1.smithi060.stdout:3/964: symlink d0/d5e/dbc/l146 0 2023-10-18T20:58:49.057 INFO:tasks.workunit.client.1.smithi060.stdout:3/965: link d0/d22/d26/d2c/l109 d0/d22/dff/l147 0 2023-10-18T20:58:49.057 INFO:tasks.workunit.client.1.smithi060.stdout:3/966: chown d0/d5e/ff8 2106814 1 2023-10-18T20:58:49.058 INFO:tasks.workunit.client.0.smithi008.stdout:1/870: dread d9/de/df/f56 [0,4194304] 0 2023-10-18T20:58:49.059 INFO:tasks.workunit.client.0.smithi008.stdout:1/871: fdatasync d9/de/df/d17/d1e/d9a/fa4 0 2023-10-18T20:58:49.059 INFO:tasks.workunit.client.1.smithi060.stdout:3/967: link d0/f1c d0/d22/d26/d2c/da0/f148 0 2023-10-18T20:58:49.060 INFO:tasks.workunit.client.1.smithi060.stdout:3/968: creat d0/d22/d26/d2b/f149 x:0 0 0 2023-10-18T20:58:49.060 INFO:tasks.workunit.client.1.smithi060.stdout:3/969: readlink d0/d5e/l12a 0 2023-10-18T20:58:49.060 INFO:tasks.workunit.client.0.smithi008.stdout:0/766: link d0/dd/d19/d5f/d89/da7/fba d0/dd/d19/d5f/d99/d94/fee 0 2023-10-18T20:58:49.062 INFO:tasks.workunit.client.1.smithi060.stdout:3/970: truncate d0/d22/d26/d79/fca 1438716 0 2023-10-18T20:58:49.063 INFO:tasks.workunit.client.1.smithi060.stdout:3/971: symlink d0/d22/d26/d29/d132/l14a 0 2023-10-18T20:58:49.066 INFO:tasks.workunit.client.1.smithi060.stdout:3/972: rename d0/d22/d26/d2b/lcd to d0/d3c/d3d/d82/d129/l14b 0 2023-10-18T20:58:49.066 INFO:tasks.workunit.client.1.smithi060.stdout:3/973: creat d0/d22/d26/f14c x:0 0 0 2023-10-18T20:58:49.071 INFO:tasks.workunit.client.0.smithi008.stdout:1/872: mkdir d9/de/d110 0 2023-10-18T20:58:49.071 INFO:tasks.workunit.client.0.smithi008.stdout:1/873: chown d9/ld 598 1 2023-10-18T20:58:49.071 INFO:tasks.workunit.client.1.smithi060.stdout:3/974: creat d0/d5e/f14d x:0 0 0 2023-10-18T20:58:49.072 INFO:tasks.workunit.client.0.smithi008.stdout:2/801: write d1/d3/d79/f7d [2030464,107966] 0 2023-10-18T20:58:49.073 INFO:tasks.workunit.client.1.smithi060.stdout:3/975: creat d0/d22/d26/d79/f14e x:0 0 0 2023-10-18T20:58:49.076 INFO:tasks.workunit.client.0.smithi008.stdout:3/948: dread d0/d3/d15/fcb [0,4194304] 0 2023-10-18T20:58:49.077 INFO:tasks.workunit.client.0.smithi008.stdout:3/949: read d0/f7 [1601283,9762] 0 2023-10-18T20:58:49.082 INFO:tasks.workunit.client.1.smithi060.stdout:9/978: write d3/d99/d1c/d25/fde [1337422,87841] 0 2023-10-18T20:58:49.086 INFO:tasks.workunit.client.0.smithi008.stdout:2/802: dread d1/d3/dd/d25/f2f [0,4194304] 0 2023-10-18T20:58:49.087 INFO:tasks.workunit.client.0.smithi008.stdout:7/836: rmdir d1/da6 39 2023-10-18T20:58:49.093 INFO:tasks.workunit.client.0.smithi008.stdout:6/957: dwrite df/d3c/f104 [0,4194304] 0 2023-10-18T20:58:49.097 INFO:tasks.workunit.client.0.smithi008.stdout:2/803: rename d1/d3/dd/d25/l2a to d1/d3/d40/d6e/d7e/db3/dcf/l106 0 2023-10-18T20:58:49.098 INFO:tasks.workunit.client.0.smithi008.stdout:7/837: mkdir d1/d36/d3d/da3/de8/d103 0 2023-10-18T20:58:49.098 INFO:tasks.workunit.client.0.smithi008.stdout:4/768: dwrite d0/d17/d5b/d99/fb6 [0,4194304] 0 2023-10-18T20:58:49.109 INFO:tasks.workunit.client.0.smithi008.stdout:2/804: creat d1/d3/dd/d25/f107 x:0 0 0 2023-10-18T20:58:49.112 INFO:tasks.workunit.client.0.smithi008.stdout:7/838: creat d1/d36/d3d/da3/de8/d5f/d7f/f104 x:0 0 0 2023-10-18T20:58:49.118 INFO:tasks.workunit.client.0.smithi008.stdout:2/805: write d1/d3/d40/d6e/f77 [246567,50249] 0 2023-10-18T20:58:49.124 INFO:tasks.workunit.client.0.smithi008.stdout:0/767: dread d0/dd/d19/d24/f44 [0,4194304] 0 2023-10-18T20:58:49.126 INFO:tasks.workunit.client.0.smithi008.stdout:7/839: creat d1/d36/d3d/da3/de8/d5f/dba/ddd/f105 x:0 0 0 2023-10-18T20:58:49.136 INFO:tasks.workunit.client.0.smithi008.stdout:2/806: mknod d1/d3/dd/d1c/d3a/d45/de1/c108 0 2023-10-18T20:58:49.139 INFO:tasks.workunit.client.0.smithi008.stdout:5/824: write d0/d2/d19/d7c/f6b [1370083,20550] 0 2023-10-18T20:58:49.139 INFO:tasks.workunit.client.0.smithi008.stdout:5/825: fsync d0/d2/d19/d7c/f92 0 2023-10-18T20:58:49.140 INFO:tasks.workunit.client.0.smithi008.stdout:5/826: chown d0/d2/d9/d9b/de7/d11f/d75/fa6 16362442 1 2023-10-18T20:58:49.140 INFO:tasks.workunit.client.0.smithi008.stdout:5/827: truncate d0/d2/d19/d7c/d31/d80/d107/fab 764677 0 2023-10-18T20:58:49.140 INFO:tasks.workunit.client.0.smithi008.stdout:0/768: creat d0/dd/d19/d5f/d99/d5e/d7d/db7/fef x:0 0 0 2023-10-18T20:58:49.141 INFO:tasks.workunit.client.1.smithi060.stdout:9/979: dwrite d3/d99/d1c/d25/f3e [0,4194304] 0 2023-10-18T20:58:49.141 INFO:tasks.workunit.client.1.smithi060.stdout:9/980: chown d3/d99/d1c/d116/f114 68867953 1 2023-10-18T20:58:49.141 INFO:tasks.workunit.client.1.smithi060.stdout:9/981: write d3/d99/d1c/d25/f74 [2119253,70956] 0 2023-10-18T20:58:49.142 INFO:tasks.workunit.client.1.smithi060.stdout:9/982: chown d3/d99/d1c/d116/fc8 258272 1 2023-10-18T20:58:49.142 INFO:tasks.workunit.client.0.smithi008.stdout:7/840: rename d1/c3a to d1/da6/d79/dea/c106 0 2023-10-18T20:58:49.145 INFO:tasks.workunit.client.1.smithi060.stdout:9/983: mknod d3/d99/d19/c162 0 2023-10-18T20:58:49.147 INFO:tasks.workunit.client.0.smithi008.stdout:0/769: mkdir d0/d7c/df0 0 2023-10-18T20:58:49.148 INFO:tasks.workunit.client.0.smithi008.stdout:0/770: write d0/dd/d19/d5f/d99/d94/fee [912043,63060] 0 2023-10-18T20:58:49.148 INFO:tasks.workunit.client.0.smithi008.stdout:3/950: read d0/d3/f33 [1115514,123768] 0 2023-10-18T20:58:49.148 INFO:tasks.workunit.client.1.smithi060.stdout:9/984: mkdir d3/d99/d1c/d116/d80/da0/d14e/d163 0 2023-10-18T20:58:49.150 INFO:tasks.workunit.client.0.smithi008.stdout:1/874: dwrite d9/de/df/d17/d55/da8/f108 [0,4194304] 0 2023-10-18T20:58:49.151 INFO:tasks.workunit.client.1.smithi060.stdout:3/976: dwrite d0/d22/d26/d2c/fec [4194304,4194304] 0 2023-10-18T20:58:49.151 INFO:tasks.workunit.client.1.smithi060.stdout:3/977: fsync d0/d3c/fa7 0 2023-10-18T20:58:49.152 INFO:tasks.workunit.client.1.smithi060.stdout:9/985: rename d3/d99/d1c/d116/d80/da0/ddd/f10d to d3/d99/f164 0 2023-10-18T20:58:49.154 INFO:tasks.workunit.client.0.smithi008.stdout:9/744: sync 2023-10-18T20:58:49.154 INFO:tasks.workunit.client.0.smithi008.stdout:8/974: sync 2023-10-18T20:58:49.154 INFO:tasks.workunit.client.0.smithi008.stdout:8/975: rename d5/d8/df/d9d to d5/d8/df/d9d/d85/db1/d123/d160 22 2023-10-18T20:58:49.155 INFO:tasks.workunit.client.0.smithi008.stdout:3/951: symlink d0/d3/d37/d6f/l12c 0 2023-10-18T20:58:49.155 INFO:tasks.workunit.client.1.smithi060.stdout:3/978: unlink d0/d22/d26/d2c/l109 0 2023-10-18T20:58:49.156 INFO:tasks.workunit.client.0.smithi008.stdout:6/958: dwrite df/d36/fcc [0,4194304] 0 2023-10-18T20:58:49.159 INFO:tasks.workunit.client.0.smithi008.stdout:9/745: mknod d2/dc/d3d/d99/cda 0 2023-10-18T20:58:49.160 INFO:tasks.workunit.client.1.smithi060.stdout:9/986: link d3/d99/lbb d3/d99/d1c/d116/d80/da0/d147/l165 0 2023-10-18T20:58:49.163 INFO:tasks.workunit.client.0.smithi008.stdout:8/976: unlink d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/df5/ff8 0 2023-10-18T20:58:49.163 INFO:tasks.workunit.client.0.smithi008.stdout:8/977: fdatasync d5/d8/df/d9d/d4d/db5/f129 0 2023-10-18T20:58:49.164 INFO:tasks.workunit.client.0.smithi008.stdout:8/978: chown d5/d8/df/d9d/d4d/db5/f129 2404686 1 2023-10-18T20:58:49.164 INFO:tasks.workunit.client.0.smithi008.stdout:8/979: creat d5/d8/df/d9d/d85/db1/dcc/f161 x:0 0 0 2023-10-18T20:58:49.164 INFO:tasks.workunit.client.0.smithi008.stdout:3/952: write d0/d3/d42/d88/f91 [741864,118936] 0 2023-10-18T20:58:49.165 INFO:tasks.workunit.client.1.smithi060.stdout:9/987: truncate d3/d99/d1c/d116/d80/da0/d147/f95 640218 0 2023-10-18T20:58:49.167 INFO:tasks.workunit.client.1.smithi060.stdout:3/979: dread d0/d22/d26/d8c/fb6 [0,4194304] 0 2023-10-18T20:58:49.168 INFO:tasks.workunit.client.0.smithi008.stdout:1/875: dread d9/de/df/d17/d1e/f65 [0,4194304] 0 2023-10-18T20:58:49.168 INFO:tasks.workunit.client.0.smithi008.stdout:1/876: dread - d9/de/df/d77/fba zero size 2023-10-18T20:58:49.169 INFO:tasks.workunit.client.0.smithi008.stdout:9/746: mkdir d2/dc/d3d/d99/da4/ddb 0 2023-10-18T20:58:49.169 INFO:tasks.workunit.client.0.smithi008.stdout:5/828: dread d0/ff7 [0,4194304] 0 2023-10-18T20:58:49.169 INFO:tasks.workunit.client.0.smithi008.stdout:5/829: creat d0/d2/d19/d7c/d31/d3f/d70/dc0/f12c x:0 0 0 2023-10-18T20:58:49.169 INFO:tasks.workunit.client.0.smithi008.stdout:5/830: creat d0/da9/dda/de1/f12d x:0 0 0 2023-10-18T20:58:49.170 INFO:tasks.workunit.client.0.smithi008.stdout:4/769: dwrite d0/d17/d5b/fd5 [0,4194304] 0 2023-10-18T20:58:49.170 INFO:tasks.workunit.client.1.smithi060.stdout:9/988: link d3/d99/d1c/d5a/d5d/d56/fb4 d3/d99/d1c/d116/d80/da0/dc2/de0/f166 0 2023-10-18T20:58:49.171 INFO:tasks.workunit.client.1.smithi060.stdout:3/980: rename d0/d3c/d3d/d4d/d95/l121 to d0/d3c/d3d/d4d/d95/dc9/l14f 0 2023-10-18T20:58:49.174 INFO:tasks.workunit.client.0.smithi008.stdout:8/980: rename d5/d8/df/d9d/d4d/dba/dd4/d50/l132 to d5/d8/df/d9d/d85/db1/l162 0 2023-10-18T20:58:49.175 INFO:tasks.workunit.client.0.smithi008.stdout:3/953: symlink d0/d84/l12d 0 2023-10-18T20:58:49.175 INFO:tasks.workunit.client.0.smithi008.stdout:1/877: mkdir d9/de/df/dc3/d111 0 2023-10-18T20:58:49.175 INFO:tasks.workunit.client.0.smithi008.stdout:3/954: chown d0/d3/de/d13/f24 3 1 2023-10-18T20:58:49.175 INFO:tasks.workunit.client.0.smithi008.stdout:3/955: chown d0/d3/d42/d52/df1/f11f 1278670 1 2023-10-18T20:58:49.187 INFO:tasks.workunit.client.0.smithi008.stdout:4/770: mknod d0/d17/d5b/cfe 0 2023-10-18T20:58:49.191 INFO:tasks.workunit.client.0.smithi008.stdout:8/981: symlink d5/d8/df/d9d/d4d/dba/dd4/d77/l163 0 2023-10-18T20:58:49.191 INFO:tasks.workunit.client.0.smithi008.stdout:3/956: creat d0/d4a/d64/df6/f12e x:0 0 0 2023-10-18T20:58:49.194 INFO:tasks.workunit.client.1.smithi060.stdout:3/981: write d0/d22/d26/d2c/da0/fc7 [1931987,19595] 0 2023-10-18T20:58:49.195 INFO:tasks.workunit.client.0.smithi008.stdout:3/957: truncate d0/d3/f2e 2294405 0 2023-10-18T20:58:49.197 INFO:tasks.workunit.client.1.smithi060.stdout:3/982: rmdir d0/d22/d26/d106/d133 39 2023-10-18T20:58:49.198 INFO:tasks.workunit.client.1.smithi060.stdout:3/983: chown d0/d22/d26/f130 59696475 1 2023-10-18T20:58:49.198 INFO:tasks.workunit.client.0.smithi008.stdout:8/982: truncate d5/d8/df/d9d/d85/db1/fbc 937963 0 2023-10-18T20:58:49.198 INFO:tasks.workunit.client.0.smithi008.stdout:4/771: truncate d0/d17/d5b/d2a/f93 2391356 0 2023-10-18T20:58:49.199 INFO:tasks.workunit.client.0.smithi008.stdout:8/983: creat d5/d8/df/d9d/d85/f164 x:0 0 0 2023-10-18T20:58:49.199 INFO:tasks.workunit.client.1.smithi060.stdout:3/984: mkdir d0/d22/d26/d2b/def/d150 0 2023-10-18T20:58:49.199 INFO:tasks.workunit.client.0.smithi008.stdout:6/959: dread df/d15/d48/d81/d116/fa3 [0,4194304] 0 2023-10-18T20:58:49.200 INFO:tasks.workunit.client.0.smithi008.stdout:6/960: readlink df/d15/d48/ded/d108/dcf/l88 0 2023-10-18T20:58:49.203 INFO:tasks.workunit.client.0.smithi008.stdout:9/747: rename d2/d64 to d2/dc/d40/d46/ddc 0 2023-10-18T20:58:49.203 INFO:tasks.workunit.client.0.smithi008.stdout:9/748: chown d2/dc/d17/f76 4 1 2023-10-18T20:58:49.203 INFO:tasks.workunit.client.0.smithi008.stdout:3/958: creat d0/d3/de/d13/d35/dbf/de9/df2/f12f x:0 0 0 2023-10-18T20:58:49.204 INFO:tasks.workunit.client.1.smithi060.stdout:3/985: dread - d0/d22/d26/d2c/f11d zero size 2023-10-18T20:58:49.204 INFO:tasks.workunit.client.1.smithi060.stdout:3/986: write d0/fd [1718087,80921] 0 2023-10-18T20:58:49.204 INFO:tasks.workunit.client.1.smithi060.stdout:3/987: write d0/d22/d50/fac [126509,56289] 0 2023-10-18T20:58:49.206 INFO:tasks.workunit.client.0.smithi008.stdout:6/961: rmdir df/d15/d48/ded/d108/dcf/d58/dec/daa 39 2023-10-18T20:58:49.209 INFO:tasks.workunit.client.0.smithi008.stdout:1/878: write d9/de/df/d17/d55/fdd [97862,114643] 0 2023-10-18T20:58:49.209 INFO:tasks.workunit.client.0.smithi008.stdout:1/879: dread - d9/de/df/d17/d69/ffe zero size 2023-10-18T20:58:49.209 INFO:tasks.workunit.client.0.smithi008.stdout:1/880: truncate d9/de/df/d17/d1e/d3c/d90/f9e 895075 0 2023-10-18T20:58:49.210 INFO:tasks.workunit.client.0.smithi008.stdout:9/749: symlink d2/dc/d3d/d99/da4/ldd 0 2023-10-18T20:58:49.210 INFO:tasks.workunit.client.0.smithi008.stdout:3/959: mknod d0/d3/d37/d74/da2/c130 0 2023-10-18T20:58:49.210 INFO:tasks.workunit.client.0.smithi008.stdout:3/960: chown d0/d3/d15/f44 447758998 1 2023-10-18T20:58:49.221 INFO:tasks.workunit.client.0.smithi008.stdout:1/881: link d9/de/df/d17/d55/da8/fae d9/de/df/d17/d1e/d3c/d90/f112 0 2023-10-18T20:58:49.222 INFO:tasks.workunit.client.0.smithi008.stdout:7/841: dwrite d1/d3/f14 [0,4194304] 0 2023-10-18T20:58:49.223 INFO:tasks.workunit.client.0.smithi008.stdout:7/842: creat d1/d36/d3d/d3e/d59/f107 x:0 0 0 2023-10-18T20:58:49.224 INFO:tasks.workunit.client.0.smithi008.stdout:9/750: unlink d2/dc/f4e 0 2023-10-18T20:58:49.226 INFO:tasks.workunit.client.0.smithi008.stdout:3/961: mkdir d0/d3/d42/d88/dae/d131 0 2023-10-18T20:58:49.228 INFO:tasks.workunit.client.1.smithi060.stdout:9/989: dwrite d3/d99/d1c/d5a/d5d/d56/dd0/fac [0,4194304] 0 2023-10-18T20:58:49.229 INFO:tasks.workunit.client.1.smithi060.stdout:9/990: mkdir d3/d99/d1c/d25/d167 0 2023-10-18T20:58:49.229 INFO:tasks.workunit.client.1.smithi060.stdout:9/991: chown d3/d99/d19/l86 7 1 2023-10-18T20:58:49.233 INFO:tasks.workunit.client.0.smithi008.stdout:2/807: dwrite d1/d3/f1b [0,4194304] 0 2023-10-18T20:58:49.258 INFO:tasks.workunit.client.0.smithi008.stdout:1/882: truncate d9/de/df/d17/d1e/d9a/f9c 1262706 0 2023-10-18T20:58:49.265 INFO:tasks.workunit.client.0.smithi008.stdout:9/751: symlink d2/dc/d1a/d1d/da7/lde 0 2023-10-18T20:58:49.265 INFO:tasks.workunit.client.0.smithi008.stdout:9/752: stat d2/dc/d17/d19/d4a/d9a 0 2023-10-18T20:58:49.265 INFO:tasks.workunit.client.0.smithi008.stdout:9/753: truncate d2/dc/d17/d19/d4a/f81 1038613 0 2023-10-18T20:58:49.266 INFO:tasks.workunit.client.0.smithi008.stdout:3/962: symlink d0/dc0/l132 0 2023-10-18T20:58:49.270 INFO:tasks.workunit.client.1.smithi060.stdout:3/988: dwrite d0/d22/d26/d2b/f4c [4194304,4194304] 0 2023-10-18T20:58:49.271 INFO:tasks.workunit.client.0.smithi008.stdout:2/808: dread d1/d3/dd/d1c/f96 [0,4194304] 0 2023-10-18T20:58:49.271 INFO:tasks.workunit.client.0.smithi008.stdout:2/809: getdents d1/d3/d40/d6e/d7e/db3/d104 0 2023-10-18T20:58:49.271 INFO:tasks.workunit.client.0.smithi008.stdout:2/810: chown d1/d3/dd/d25/d34/f46 0 1 2023-10-18T20:58:49.271 INFO:tasks.workunit.client.0.smithi008.stdout:1/883: getdents d9/de/df/d17/d1e/d9a/dbc 0 2023-10-18T20:58:49.272 INFO:tasks.workunit.client.0.smithi008.stdout:1/884: fsync d9/de/df/d17/d25/d94/da7/fb2 0 2023-10-18T20:58:49.275 INFO:tasks.workunit.client.0.smithi008.stdout:9/754: creat d2/d4d/fdf x:0 0 0 2023-10-18T20:58:49.276 INFO:tasks.workunit.client.0.smithi008.stdout:1/885: link d9/de/df/d17/d1e/fb4 d9/de/df/d17/d1e/dc0/d10d/f113 0 2023-10-18T20:58:49.276 INFO:tasks.workunit.client.0.smithi008.stdout:1/886: dread - d9/de/df/f7f zero size 2023-10-18T20:58:49.280 INFO:tasks.workunit.client.0.smithi008.stdout:6/962: dwrite df/d15/d48/d4b/f4f [0,4194304] 0 2023-10-18T20:58:49.280 INFO:tasks.workunit.client.0.smithi008.stdout:6/963: creat df/d19/f144 x:0 0 0 2023-10-18T20:58:49.281 INFO:tasks.workunit.client.0.smithi008.stdout:1/887: truncate d9/de/df/d77/faf 761893 0 2023-10-18T20:58:49.282 INFO:tasks.workunit.client.0.smithi008.stdout:9/755: symlink d2/dc/d40/d5a/le0 0 2023-10-18T20:58:49.288 INFO:tasks.workunit.client.1.smithi060.stdout:3/989: write d0/d22/d50/f9f [2267706,93766] 0 2023-10-18T20:58:49.292 INFO:tasks.workunit.client.0.smithi008.stdout:5/831: rename d0/d2/d19/d7c/d31/d3f to d0/d2/d9/d9b/d12e 0 2023-10-18T20:58:49.292 INFO:tasks.workunit.client.0.smithi008.stdout:4/772: rename d0/d58/d8e to d0/d58/d8e/dff 22 2023-10-18T20:58:49.292 INFO:tasks.workunit.client.0.smithi008.stdout:5/832: dread - d0/d2/d9/daa/ffd zero size 2023-10-18T20:58:49.293 INFO:tasks.workunit.client.0.smithi008.stdout:4/773: creat d0/d58/f100 x:0 0 0 2023-10-18T20:58:49.295 INFO:tasks.workunit.client.0.smithi008.stdout:6/964: getdents df/d3c/d77/dd6/dd8 0 2023-10-18T20:58:49.296 INFO:tasks.workunit.client.0.smithi008.stdout:1/888: mknod d9/de/df/d17/d25/d94/da7/c114 0 2023-10-18T20:58:49.297 INFO:tasks.workunit.client.0.smithi008.stdout:1/889: creat d9/de/df/d17/d55/da8/f115 x:0 0 0 2023-10-18T20:58:49.301 INFO:tasks.workunit.client.0.smithi008.stdout:4/774: mkdir d0/d17/d6e/dfb/d101 0 2023-10-18T20:58:49.305 INFO:tasks.workunit.client.0.smithi008.stdout:1/890: mkdir d9/de/df/d17/d116 0 2023-10-18T20:58:49.316 INFO:tasks.workunit.client.0.smithi008.stdout:3/963: dwrite d0/d3/d42/d88/d103/f10e [0,4194304] 0 2023-10-18T20:58:49.321 INFO:tasks.workunit.client.0.smithi008.stdout:0/771: sync 2023-10-18T20:58:49.321 INFO:tasks.workunit.client.0.smithi008.stdout:6/965: dread df/d15/d48/d81/d116/d4c/f73 [0,4194304] 0 2023-10-18T20:58:49.321 INFO:tasks.workunit.client.0.smithi008.stdout:6/966: truncate df/d15/d48/d81/d116/ffb 1418310 0 2023-10-18T20:58:49.322 INFO:tasks.workunit.client.0.smithi008.stdout:8/984: rename d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/d14b/d8c/db4 to d5/d8/df/d9d/d4d/dba/dd4/d50/d165 0 2023-10-18T20:58:49.326 INFO:tasks.workunit.client.0.smithi008.stdout:8/985: stat d5/d8/df/d9d/d6c/l86 0 2023-10-18T20:58:49.326 INFO:tasks.workunit.client.0.smithi008.stdout:6/967: creat df/d15/d48/ded/d108/dcf/d58/f145 x:0 0 0 2023-10-18T20:58:49.327 INFO:tasks.workunit.client.0.smithi008.stdout:6/968: dread - df/dd1/f134 zero size 2023-10-18T20:58:49.329 INFO:tasks.workunit.client.0.smithi008.stdout:3/964: mkdir d0/d3/de/d13/d35/dbf/de0/d123/de8/d133 0 2023-10-18T20:58:49.330 INFO:tasks.workunit.client.0.smithi008.stdout:6/969: mkdir df/d15/d13f/d146 0 2023-10-18T20:58:49.335 INFO:tasks.workunit.client.0.smithi008.stdout:7/843: rename d1/l62 to d1/d36/d3d/l108 0 2023-10-18T20:58:49.335 INFO:tasks.workunit.client.0.smithi008.stdout:6/970: unlink df/d15/d48/ded/d108/dcf/c7a 0 2023-10-18T20:58:49.335 INFO:tasks.workunit.client.0.smithi008.stdout:2/811: rename d1/f8c to d1/d3/dd/d25/d5c/f109 0 2023-10-18T20:58:49.335 INFO:tasks.workunit.client.0.smithi008.stdout:2/812: chown d1/d3/dd/d25/d76/d59/d85/lae 10 1 2023-10-18T20:58:49.336 INFO:tasks.workunit.client.0.smithi008.stdout:2/813: write d1/d3/dd/d25/d4d/fdd [2077681,54915] 0 2023-10-18T20:58:49.336 INFO:tasks.workunit.client.0.smithi008.stdout:2/814: mkdir d1/d3/dd/d1c/d3a/d45/d83/de8/d10a 0 2023-10-18T20:58:49.336 INFO:tasks.workunit.client.0.smithi008.stdout:2/815: chown d1/d3/dd/d25/d34/c35 52 1 2023-10-18T20:58:49.337 INFO:tasks.workunit.client.0.smithi008.stdout:2/816: creat d1/d3/dd/d25/d76/dad/f10b x:0 0 0 2023-10-18T20:58:49.356 INFO:tasks.workunit.client.0.smithi008.stdout:5/833: dwrite d0/d6e/f97 [0,4194304] 0 2023-10-18T20:58:49.356 INFO:tasks.workunit.client.0.smithi008.stdout:5/834: write d0/d6e/f98 [1495815,65697] 0 2023-10-18T20:58:49.358 INFO:tasks.workunit.client.0.smithi008.stdout:2/817: dread d1/d3/d79/f7d [0,4194304] 0 2023-10-18T20:58:49.369 INFO:tasks.workunit.client.0.smithi008.stdout:2/818: symlink d1/d3/dd/d1c/d3a/d45/d83/l10c 0 2023-10-18T20:58:49.370 INFO:tasks.workunit.client.1.smithi060.stdout:3/990: dwrite d0/d22/d26/d29/f7d [0,4194304] 0 2023-10-18T20:58:49.370 INFO:tasks.workunit.client.1.smithi060.stdout:3/991: readlink d0/d5e/la2 0 2023-10-18T20:58:49.373 INFO:tasks.workunit.client.0.smithi008.stdout:0/772: dwrite d0/dd/d19/d24/f5a [0,4194304] 0 2023-10-18T20:58:49.373 INFO:tasks.workunit.client.0.smithi008.stdout:0/773: fdatasync d0/dd/d19/d24/f88 0 2023-10-18T20:58:49.374 INFO:tasks.workunit.client.0.smithi008.stdout:6/971: write df/d15/d48/d81/f96 [2550592,78295] 0 2023-10-18T20:58:49.380 INFO:tasks.workunit.client.1.smithi060.stdout:3/992: mkdir d0/d22/d50/d151 0 2023-10-18T20:58:49.380 INFO:tasks.workunit.client.0.smithi008.stdout:3/965: write d0/d3/d37/d6f/ffa [3447486,120297] 0 2023-10-18T20:58:49.381 INFO:tasks.workunit.client.0.smithi008.stdout:0/774: symlink d0/dd/d19/d5f/d89/da7/lf1 0 2023-10-18T20:58:49.381 INFO:tasks.workunit.client.0.smithi008.stdout:9/756: dwrite d2/f5 [0,4194304] 0 2023-10-18T20:58:49.381 INFO:tasks.workunit.client.0.smithi008.stdout:9/757: readlink d2/dc/d17/d7b/l88 0 2023-10-18T20:58:49.386 INFO:tasks.workunit.client.0.smithi008.stdout:7/844: dread d1/d3/f17 [0,4194304] 0 2023-10-18T20:58:49.386 INFO:tasks.workunit.client.0.smithi008.stdout:0/775: mknod d0/dd/d19/d5f/d99/cf2 0 2023-10-18T20:58:49.388 INFO:tasks.workunit.client.0.smithi008.stdout:4/775: dwrite d0/d3/d21/f5a [0,4194304] 0 2023-10-18T20:58:49.389 INFO:tasks.workunit.client.1.smithi060.stdout:3/993: unlink d0/cf9 0 2023-10-18T20:58:49.390 INFO:tasks.workunit.client.0.smithi008.stdout:1/891: dwrite d9/de/df/d17/d1e/f62 [8388608,4194304] 0 2023-10-18T20:58:49.394 INFO:tasks.workunit.client.0.smithi008.stdout:2/819: dread d1/d3/dd/f50 [0,4194304] 0 2023-10-18T20:58:49.399 INFO:tasks.workunit.client.0.smithi008.stdout:9/758: symlink d2/dc/d3d/le1 0 2023-10-18T20:58:49.399 INFO:tasks.workunit.client.0.smithi008.stdout:6/972: write df/d15/d48/ded/d108/dcf/d58/dec/daa/dcb/feb [963575,52190] 0 2023-10-18T20:58:49.400 INFO:tasks.workunit.client.0.smithi008.stdout:6/973: chown df/d15/d48/ded/d108/dcf/d58/dec/f8f 0 1 2023-10-18T20:58:49.400 INFO:tasks.workunit.client.0.smithi008.stdout:0/776: creat d0/d7c/d9a/d8a/d8f/da5/de6/ff3 x:0 0 0 2023-10-18T20:58:49.400 INFO:tasks.workunit.client.0.smithi008.stdout:6/974: write df/d15/d48/ded/d108/dcf/d58/dec/daa/fd9 [488671,113328] 0 2023-10-18T20:58:49.401 INFO:tasks.workunit.client.0.smithi008.stdout:7/845: mkdir d1/d36/d3d/da3/de8/d5f/dba/dcc/d109 0 2023-10-18T20:58:49.401 INFO:tasks.workunit.client.0.smithi008.stdout:1/892: mkdir d9/df7/d117 0 2023-10-18T20:58:49.401 INFO:tasks.workunit.client.0.smithi008.stdout:8/986: dwrite d5/d8/df/d9d/d4d/f98 [0,4194304] 0 2023-10-18T20:58:49.401 INFO:tasks.workunit.client.0.smithi008.stdout:2/820: mknod d1/d3/dd/d25/d5c/c10d 0 2023-10-18T20:58:49.403 INFO:tasks.workunit.client.0.smithi008.stdout:9/759: creat d2/dc/d40/d46/fe2 x:0 0 0 2023-10-18T20:58:49.404 INFO:tasks.workunit.client.0.smithi008.stdout:9/760: chown d2/dc/d17/d19/d4a 79237086 1 2023-10-18T20:58:49.404 INFO:tasks.workunit.client.0.smithi008.stdout:9/761: chown d2/dc/d40/d46/ddc/d90/fa8 85 1 2023-10-18T20:58:49.404 INFO:tasks.workunit.client.0.smithi008.stdout:9/762: readlink d2/dc/d40/d56/l8b 0 2023-10-18T20:58:49.407 INFO:tasks.workunit.client.0.smithi008.stdout:2/821: creat d1/d3/d40/d6e/d7e/db3/f10e x:0 0 0 2023-10-18T20:58:49.407 INFO:tasks.workunit.client.0.smithi008.stdout:1/893: symlink d9/de/d10b/l118 0 2023-10-18T20:58:49.407 INFO:tasks.workunit.client.0.smithi008.stdout:6/975: truncate df/d15/d48/d81/d116/f63 3808156 0 2023-10-18T20:58:49.408 INFO:tasks.workunit.client.1.smithi060.stdout:3/994: dread d0/d22/d50/f134 [0,4194304] 0 2023-10-18T20:58:49.410 INFO:tasks.workunit.client.0.smithi008.stdout:1/894: mknod d9/df7/c119 0 2023-10-18T20:58:49.412 INFO:tasks.workunit.client.0.smithi008.stdout:1/895: symlink d9/de/l11a 0 2023-10-18T20:58:49.412 INFO:tasks.workunit.client.0.smithi008.stdout:1/896: write d9/de/df/d17/d25/f83 [241796,118280] 0 2023-10-18T20:58:49.412 INFO:tasks.workunit.client.0.smithi008.stdout:1/897: creat d9/de/df/d17/d69/f11b x:0 0 0 2023-10-18T20:58:49.414 INFO:tasks.workunit.client.1.smithi060.stdout:3/995: symlink d0/d3c/d3d/d4d/l152 0 2023-10-18T20:58:49.414 INFO:tasks.workunit.client.0.smithi008.stdout:1/898: symlink d9/de/df/d17/d1e/db8/l11c 0 2023-10-18T20:58:49.414 INFO:tasks.workunit.client.0.smithi008.stdout:1/899: chown d9/de/df/d17/d25/f32 979308 1 2023-10-18T20:58:49.422 INFO:tasks.workunit.client.1.smithi060.stdout:3/996: rename d0/d22/d26/d79/db3/d136 to d0/d22/d26/d106/d153 0 2023-10-18T20:58:49.433 INFO:tasks.workunit.client.0.smithi008.stdout:1/900: mknod d9/de/df/d17/d25/d94/dc4/c11d 0 2023-10-18T20:58:49.433 INFO:tasks.workunit.client.0.smithi008.stdout:3/966: dread d0/d3/de/fe4 [0,4194304] 0 2023-10-18T20:58:49.434 INFO:tasks.workunit.client.0.smithi008.stdout:3/967: creat d0/d3/d42/d88/d103/f134 x:0 0 0 2023-10-18T20:58:49.448 INFO:tasks.workunit.client.0.smithi008.stdout:1/901: truncate d9/de/df/d17/d1e/d9a/f9c 1734267 0 2023-10-18T20:58:49.453 INFO:tasks.workunit.client.0.smithi008.stdout:3/968: write d0/d3/f5 [2463091,100477] 0 2023-10-18T20:58:49.468 INFO:tasks.workunit.client.0.smithi008.stdout:5/835: dwrite d0/d2/d19/d7c/d42/d5a/f69 [0,4194304] 0 2023-10-18T20:58:49.469 INFO:tasks.workunit.client.0.smithi008.stdout:3/969: mkdir d0/d3/de/d13/d35/dbf/de0/d123/de8/d135 0 2023-10-18T20:58:49.469 INFO:tasks.workunit.client.0.smithi008.stdout:3/970: readlink d0/d3/de/d13/l9f 0 2023-10-18T20:58:49.473 INFO:tasks.workunit.client.0.smithi008.stdout:5/836: mkdir d0/dec/d12f 0 2023-10-18T20:58:49.473 INFO:tasks.workunit.client.0.smithi008.stdout:5/837: creat d0/dec/f130 x:0 0 0 2023-10-18T20:58:49.474 INFO:tasks.workunit.client.0.smithi008.stdout:3/971: stat d0/d4a/f5b 0 2023-10-18T20:58:49.474 INFO:tasks.workunit.client.0.smithi008.stdout:0/777: dwrite d0/d7c/f7a [0,4194304] 0 2023-10-18T20:58:49.477 INFO:tasks.workunit.client.0.smithi008.stdout:5/838: rename d0/dec/fee to d0/d2/d19/d7c/d31/d82/df5/d111/f131 0 2023-10-18T20:58:49.479 INFO:tasks.workunit.client.0.smithi008.stdout:3/972: mknod d0/d4a/d64/d80/d11a/c136 0 2023-10-18T20:58:49.481 INFO:tasks.workunit.client.0.smithi008.stdout:6/976: dread df/d15/d48/ded/d108/fbd [0,4194304] 0 2023-10-18T20:58:49.483 INFO:tasks.workunit.client.0.smithi008.stdout:8/987: dwrite d5/d8/df/d9d/d4d/dba/f103 [8388608,4194304] 0 2023-10-18T20:58:49.483 INFO:tasks.workunit.client.0.smithi008.stdout:4/776: dwrite d0/d17/d5b/f52 [0,4194304] 0 2023-10-18T20:58:49.483 INFO:tasks.workunit.client.0.smithi008.stdout:8/988: chown d5/d8/df/d9d/d4d/dba/dd4/d50/dd1/f154 659 1 2023-10-18T20:58:49.483 INFO:tasks.workunit.client.0.smithi008.stdout:8/989: getdents d5/d8/df/d9d/d85/db1/d123 0 2023-10-18T20:58:49.484 INFO:tasks.workunit.client.0.smithi008.stdout:8/990: read - d5/d8/df/d9d/d4d/db5/da3/fca zero size 2023-10-18T20:58:49.484 INFO:tasks.workunit.client.0.smithi008.stdout:5/839: link d0/d6e/f7d d0/d2/d9/d9b/d12e/dc9/f132 0 2023-10-18T20:58:49.484 INFO:tasks.workunit.client.0.smithi008.stdout:0/778: mknod d0/dd/cf4 0 2023-10-18T20:58:49.485 INFO:tasks.workunit.client.0.smithi008.stdout:6/977: creat df/d15/d48/ded/d108/dcf/d58/dec/daa/f147 x:0 0 0 2023-10-18T20:58:49.487 INFO:tasks.workunit.client.0.smithi008.stdout:7/846: dwrite d1/da6/d4f/f5b [0,4194304] 0 2023-10-18T20:58:49.488 INFO:tasks.workunit.client.0.smithi008.stdout:7/847: readlink d1/d36/d3d/da3/de8/lc4 0 2023-10-18T20:58:49.491 INFO:tasks.workunit.client.0.smithi008.stdout:2/822: dwrite d1/d3/dd/d1c/d3a/d45/fda [0,4194304] 0 2023-10-18T20:58:49.492 INFO:tasks.workunit.client.0.smithi008.stdout:2/823: readlink d1/d3/dd/d25/d5c/lc6 0 2023-10-18T20:58:49.492 INFO:tasks.workunit.client.0.smithi008.stdout:8/991: symlink d5/d8/df/d2e/d13b/d117/d122/dc4/l166 0 2023-10-18T20:58:49.495 INFO:tasks.workunit.client.0.smithi008.stdout:0/779: mkdir d0/dd/d19/d5f/d89/df5 0 2023-10-18T20:58:49.497 INFO:tasks.workunit.client.1.smithi060.stdout:3/997: dwrite d0/d22/f96 [0,4194304] 0 2023-10-18T20:58:49.498 INFO:tasks.workunit.client.1.smithi060.stdout:3/998: creat d0/d3c/d3d/d82/f154 x:0 0 0 2023-10-18T20:58:49.499 INFO:tasks.workunit.client.0.smithi008.stdout:1/902: dwrite d9/de/df/d17/d55/fb5 [0,4194304] 0 2023-10-18T20:58:49.500 INFO:tasks.workunit.client.1.smithi060.stdout:3/999: symlink d0/d22/d26/d29/l155 0 2023-10-18T20:58:49.504 INFO:tasks.workunit.client.0.smithi008.stdout:3/973: rename d0/d4a/d64/df6 to d0/d84/dad/dc4/d137 0 2023-10-18T20:58:49.505 INFO:tasks.workunit.client.0.smithi008.stdout:2/824: dread d1/d3/f4b [4194304,4194304] 0 2023-10-18T20:58:49.506 INFO:tasks.workunit.client.0.smithi008.stdout:2/825: chown d1 0 1 2023-10-18T20:58:49.507 INFO:tasks.workunit.client.0.smithi008.stdout:2/826: fsync d1/d3/dd/d25/d76/d59/fc9 0 2023-10-18T20:58:49.507 INFO:tasks.workunit.client.0.smithi008.stdout:2/827: chown d1/d3/dd/d1c/f2d 51 1 2023-10-18T20:58:49.511 INFO:tasks.workunit.client.1.smithi060.stdout:9/992: sync 2023-10-18T20:58:49.511 INFO:tasks.workunit.client.1.smithi060.stdout:9/993: stat d3/d99/d19/d54/ff9 0 2023-10-18T20:58:49.513 INFO:tasks.workunit.client.1.smithi060.stdout:9/994: unlink d3/d99/d1c/d116/d80/da0/ddd/lef 0 2023-10-18T20:58:49.514 INFO:tasks.workunit.client.1.smithi060.stdout:9/995: chown d3/d99/d19/d54/df0 0 1 2023-10-18T20:58:49.514 INFO:tasks.workunit.client.0.smithi008.stdout:1/903: write d9/de/df/d17/d25/d57/f87 [2565301,15943] 0 2023-10-18T20:58:49.515 INFO:tasks.workunit.client.0.smithi008.stdout:0/780: truncate d0/dd/d19/d5f/d99/d94/fee 68539 0 2023-10-18T20:58:49.515 INFO:tasks.workunit.client.0.smithi008.stdout:8/992: write d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/d14b/f99 [3407025,38261] 0 2023-10-18T20:58:49.516 INFO:tasks.workunit.client.0.smithi008.stdout:0/781: getdents d0/dd/d19/d5f/d89/da7/de7 0 2023-10-18T20:58:49.516 INFO:tasks.workunit.client.0.smithi008.stdout:3/974: mknod d0/d3/de/d13/d35/dbf/c138 0 2023-10-18T20:58:49.516 INFO:tasks.workunit.client.0.smithi008.stdout:8/993: write d5/d8/df/d9d/d4d/db5/fc1 [222952,71901] 0 2023-10-18T20:58:49.517 INFO:tasks.workunit.client.0.smithi008.stdout:4/777: rename d0/d58/d8e/fe6 to d0/d3/d21/d57/d8f/d82/f102 0 2023-10-18T20:58:49.517 INFO:tasks.workunit.client.0.smithi008.stdout:4/778: stat d0/d58/d8e/f6d 0 2023-10-18T20:58:49.518 INFO:tasks.workunit.client.0.smithi008.stdout:0/782: readlink d0/d3a/l91 0 2023-10-18T20:58:49.518 INFO:tasks.workunit.client.0.smithi008.stdout:0/783: chown d0/dd/d19/d5f/d89 7 1 2023-10-18T20:58:49.519 INFO:tasks.workunit.client.0.smithi008.stdout:2/828: truncate d1/d3/dd/d1c/d3a/d49/fe9 91610 0 2023-10-18T20:58:49.519 INFO:tasks.workunit.client.0.smithi008.stdout:0/784: write d0/d7c/d9a/d8a/d8f/fb2 [1001178,89895] 0 2023-10-18T20:58:49.520 INFO:tasks.workunit.client.0.smithi008.stdout:0/785: write d0/dd/df/f4c [2656599,9363] 0 2023-10-18T20:58:49.520 INFO:tasks.workunit.client.0.smithi008.stdout:0/786: write d0/dd/d19/d5f/d99/f80 [2596343,77636] 0 2023-10-18T20:58:49.524 INFO:tasks.workunit.client.0.smithi008.stdout:1/904: rename d9/de/df/d17/d1e/d9a/fc7 to d9/de/df/d17/d25/d57/f11e 0 2023-10-18T20:58:49.527 INFO:tasks.workunit.client.0.smithi008.stdout:4/779: rmdir d0/d58/dbf 39 2023-10-18T20:58:49.529 INFO:tasks.workunit.client.1.smithi060.stdout:9/996: rmdir d3/d99/d1c/d116/d80 39 2023-10-18T20:58:49.530 INFO:tasks.workunit.client.1.smithi060.stdout:9/997: getdents d3/d99/d1c/d116/d80/da0/d147 0 2023-10-18T20:58:49.530 INFO:tasks.workunit.client.0.smithi008.stdout:2/829: unlink d1/d3/c1d 0 2023-10-18T20:58:49.537 INFO:tasks.workunit.client.0.smithi008.stdout:3/975: link d0/d3/d42/d52/f6b d0/d4a/f139 0 2023-10-18T20:58:49.538 INFO:tasks.workunit.client.0.smithi008.stdout:0/787: creat d0/d7c/df0/ff6 x:0 0 0 2023-10-18T20:58:49.539 INFO:tasks.workunit.client.0.smithi008.stdout:6/978: dwrite df/d15/d48/ded/d108/dcf/d58/dec/daa/dcb/feb [0,4194304] 0 2023-10-18T20:58:49.544 INFO:tasks.workunit.client.0.smithi008.stdout:1/905: read d9/de/df/d17/d1e/d3c/d90/f9e [91343,8819] 0 2023-10-18T20:58:49.545 INFO:tasks.workunit.client.0.smithi008.stdout:1/906: dread - d9/de/df/d17/d69/ffe zero size 2023-10-18T20:58:49.545 INFO:tasks.workunit.client.1.smithi060.stdout:9/998: write d3/d99/d1c/d116/d80/da0/d147/f7b [2595079,35039] 0 2023-10-18T20:58:49.545 INFO:tasks.workunit.client.1.smithi060.stdout:9/999: chown d3/d99/d1c/d5a/d5d/f75 0 1 2023-10-18T20:58:49.546 INFO:tasks.workunit.client.0.smithi008.stdout:4/780: creat d0/d17/d6e/f103 x:0 0 0 2023-10-18T20:58:49.546 INFO:tasks.workunit.client.0.smithi008.stdout:2/830: mknod d1/d3/d40/c10f 0 2023-10-18T20:58:49.547 INFO:tasks.workunit.client.0.smithi008.stdout:3/976: mknod d0/d3/de/d13/d35/dbf/de0/d123/de8/d135/c13a 0 2023-10-18T20:58:49.556 INFO:tasks.workunit.client.0.smithi008.stdout:4/781: creat d0/d3/d21/d57/d8f/d95/f104 x:0 0 0 2023-10-18T20:58:49.557 INFO:tasks.workunit.client.0.smithi008.stdout:1/907: read d9/de/df/d17/d1e/d3c/f6f [2056926,11285] 0 2023-10-18T20:58:49.558 INFO:tasks.workunit.client.0.smithi008.stdout:3/977: symlink d0/d3/da9/l13b 0 2023-10-18T20:58:49.558 INFO:tasks.workunit.client.0.smithi008.stdout:3/978: write d0/d3/d42/d88/f91 [2608255,71925] 0 2023-10-18T20:58:49.559 INFO:tasks.workunit.client.0.smithi008.stdout:1/908: read d9/de/df/dc3/fff [384150,94082] 0 2023-10-18T20:58:49.562 INFO:tasks.workunit.client.1.smithi060.stderr:+ rm -rf -- ./tmp.4USRT3r95U 2023-10-18T20:58:49.563 INFO:tasks.workunit.client.0.smithi008.stdout:4/782: dread d0/d17/d5b/d99/fda [0,4194304] 0 2023-10-18T20:58:49.565 INFO:tasks.workunit.client.0.smithi008.stdout:3/979: link d0/d3/d37/d74/da2/ca8 d0/d3/d37/d6f/c13c 0 2023-10-18T20:58:49.568 INFO:tasks.workunit.client.0.smithi008.stdout:4/783: creat d0/d3/d21/d57/d8f/d95/f105 x:0 0 0 2023-10-18T20:58:49.568 INFO:tasks.workunit.client.0.smithi008.stdout:4/784: creat d0/d17/d5b/f106 x:0 0 0 2023-10-18T20:58:49.569 INFO:tasks.workunit.client.0.smithi008.stdout:3/980: creat d0/d3/d42/d52/df7/f13d x:0 0 0 2023-10-18T20:58:49.569 INFO:tasks.workunit.client.0.smithi008.stdout:3/981: readlink d0/dc0/l132 0 2023-10-18T20:58:49.570 INFO:tasks.workunit.client.0.smithi008.stdout:0/788: rename d0/d3a to d0/d7c/d9a/d8a/d8f/d21/df7 0 2023-10-18T20:58:49.571 INFO:tasks.workunit.client.0.smithi008.stdout:3/982: read d0/d4a/d64/f7c [367663,61424] 0 2023-10-18T20:58:49.573 INFO:tasks.workunit.client.0.smithi008.stdout:3/983: write d0/d4a/d64/f83 [400368,129941] 0 2023-10-18T20:58:49.574 INFO:tasks.workunit.client.0.smithi008.stdout:4/785: unlink d0/f12 0 2023-10-18T20:58:49.576 INFO:tasks.workunit.client.0.smithi008.stdout:2/831: rename d1/d3/dd/d1c/d3a/d45/d83/de8 to d1/d3/dd/d25/d76/d59/d85/d110 0 2023-10-18T20:58:49.576 INFO:tasks.workunit.client.0.smithi008.stdout:2/832: dread - d1/d3/dd/d1c/d3a/d49/faf zero size 2023-10-18T20:58:49.577 INFO:tasks.workunit.client.0.smithi008.stdout:0/789: truncate d0/dd/d19/d5f/d99/f2d 2119129 0 2023-10-18T20:58:49.577 INFO:tasks.workunit.client.0.smithi008.stdout:0/790: chown d0/c49 112968504 1 2023-10-18T20:58:49.577 INFO:tasks.workunit.client.0.smithi008.stdout:3/984: symlink d0/d3/de/d13/d35/dbf/de0/d123/de8/l13e 0 2023-10-18T20:58:49.578 INFO:tasks.workunit.client.0.smithi008.stdout:4/786: mknod d0/d58/d8e/dd2/c107 0 2023-10-18T20:58:49.580 INFO:tasks.workunit.client.0.smithi008.stdout:1/909: rename d9/f4f to d9/de/df/d17/d25/f11f 0 2023-10-18T20:58:49.580 INFO:tasks.workunit.client.0.smithi008.stdout:1/910: read d9/de/df/d17/d25/f44 [939459,104077] 0 2023-10-18T20:58:49.581 INFO:tasks.workunit.client.0.smithi008.stdout:0/791: mknod d0/d7c/d9a/d8a/cf8 0 2023-10-18T20:58:49.589 INFO:tasks.workunit.client.0.smithi008.stdout:4/787: symlink d0/d3/d21/d57/d8f/l108 0 2023-10-18T20:58:49.589 INFO:tasks.workunit.client.0.smithi008.stdout:4/788: stat d0/d58/feb 0 2023-10-18T20:58:49.590 INFO:tasks.workunit.client.0.smithi008.stdout:3/985: rename d0/d3/d15/fcb to d0/f13f 0 2023-10-18T20:58:49.590 INFO:tasks.workunit.client.0.smithi008.stdout:3/986: dread - d0/d4a/d64/d80/faa zero size 2023-10-18T20:58:49.591 INFO:tasks.workunit.client.0.smithi008.stdout:3/987: write d0/d3/de/d13/d35/f11d [326882,78922] 0 2023-10-18T20:58:49.591 INFO:tasks.workunit.client.0.smithi008.stdout:3/988: write d0/d3/d37/f4c [4769250,9916] 0 2023-10-18T20:58:49.591 INFO:tasks.workunit.client.0.smithi008.stdout:3/989: dread - d0/d3/d37/d74/f116 zero size 2023-10-18T20:58:49.592 INFO:tasks.workunit.client.0.smithi008.stdout:0/792: mkdir d0/d90/df9 0 2023-10-18T20:58:49.592 INFO:tasks.workunit.client.0.smithi008.stdout:4/789: mknod d0/d17/d6e/dfb/c109 0 2023-10-18T20:58:49.594 INFO:tasks.workunit.client.0.smithi008.stdout:0/793: creat d0/d90/ffa x:0 0 0 2023-10-18T20:58:49.594 INFO:tasks.workunit.client.0.smithi008.stdout:0/794: chown d0 998293 1 2023-10-18T20:58:49.597 INFO:tasks.workunit.client.0.smithi008.stdout:2/833: dread d1/f18 [0,4194304] 0 2023-10-18T20:58:49.597 INFO:tasks.workunit.client.0.smithi008.stdout:2/834: creat d1/d3/d40/d6e/d7e/db3/f111 x:0 0 0 2023-10-18T20:58:49.598 INFO:tasks.workunit.client.0.smithi008.stdout:2/835: chown d1/d3/dd/l21 83089 1 2023-10-18T20:58:49.605 INFO:tasks.workunit.client.0.smithi008.stdout:0/795: truncate d0/dd/d19/d5f/d99/d5e/fa4 120753 0 2023-10-18T20:58:49.606 INFO:tasks.workunit.client.0.smithi008.stdout:4/790: dread d0/d17/f6a [0,4194304] 0 2023-10-18T20:58:49.609 INFO:tasks.workunit.client.0.smithi008.stdout:2/836: symlink d1/d3/dd/d1c/d3a/d49/l112 0 2023-10-18T20:58:49.611 INFO:tasks.workunit.client.0.smithi008.stdout:4/791: unlink d0/d17/d5b/fa6 0 2023-10-18T20:58:49.611 INFO:tasks.workunit.client.0.smithi008.stdout:4/792: read - d0/d58/fe7 zero size 2023-10-18T20:58:49.611 INFO:tasks.workunit.client.0.smithi008.stdout:4/793: fsync d0/d17/d5b/fcc 0 2023-10-18T20:58:49.611 INFO:tasks.workunit.client.0.smithi008.stdout:4/794: chown d0/d17/d6e/dfb/d101 8721 1 2023-10-18T20:58:49.614 INFO:tasks.workunit.client.0.smithi008.stdout:2/837: mkdir d1/d3/dd/d1c/d3a/d45/daa/d101/d113 0 2023-10-18T20:58:49.615 INFO:tasks.workunit.client.0.smithi008.stdout:4/795: creat d0/d17/d6e/dfb/f10a x:0 0 0 2023-10-18T20:58:49.617 INFO:tasks.workunit.client.0.smithi008.stdout:0/796: symlink d0/dd/lfb 0 2023-10-18T20:58:49.617 INFO:tasks.workunit.client.0.smithi008.stdout:0/797: dread - d0/d7c/d9a/d8a/d8f/d21/df7/d61/fe9 zero size 2023-10-18T20:58:49.620 INFO:tasks.workunit.client.0.smithi008.stdout:2/838: creat d1/d3/d40/d6e/f114 x:0 0 0 2023-10-18T20:58:49.621 INFO:tasks.workunit.client.0.smithi008.stdout:6/979: dwrite df/d26/f61 [0,4194304] 0 2023-10-18T20:58:49.625 INFO:tasks.workunit.client.0.smithi008.stdout:2/839: rename d1/d3/dd/d25/c105 to d1/d3/d40/d6e/d7e/c115 0 2023-10-18T20:58:49.631 INFO:tasks.workunit.client.0.smithi008.stdout:2/840: truncate d1/d3/dd/d25/d76/d59/fa6 1255669 0 2023-10-18T20:58:49.632 INFO:tasks.workunit.client.0.smithi008.stdout:6/980: dread df/d15/d48/d81/d116/dbf/f9e [0,4194304] 0 2023-10-18T20:58:49.635 INFO:tasks.workunit.client.0.smithi008.stdout:2/841: getdents d1/d3/dd/d1c/d3a/d45/de1 0 2023-10-18T20:58:49.635 INFO:tasks.workunit.client.0.smithi008.stdout:2/842: readlink d1/d3/dd/d25/d76/d59/l5d 0 2023-10-18T20:58:49.636 INFO:tasks.workunit.client.0.smithi008.stdout:2/843: rmdir d1/d3/d40/d6e/d7e/db3/dcf 39 2023-10-18T20:58:49.639 INFO:tasks.workunit.client.0.smithi008.stdout:3/990: dread d0/d3/de/d13/f46 [8388608,4194304] 0 2023-10-18T20:58:49.639 INFO:tasks.workunit.client.0.smithi008.stdout:3/991: unlink d0/l107 0 2023-10-18T20:58:49.646 INFO:tasks.workunit.client.0.smithi008.stdout:1/911: dwrite d9/de/df/d77/faf [0,4194304] 0 2023-10-18T20:58:49.646 INFO:tasks.workunit.client.0.smithi008.stdout:1/912: dread - d9/de/df/d17/d1e/d7d/d89/f100 zero size 2023-10-18T20:58:49.652 INFO:tasks.workunit.client.0.smithi008.stdout:6/981: dread df/d15/d48/f107 [0,4194304] 0 2023-10-18T20:58:49.653 INFO:tasks.workunit.client.0.smithi008.stdout:6/982: write df/d15/d48/d81/f95 [1405297,46254] 0 2023-10-18T20:58:49.653 INFO:tasks.workunit.client.0.smithi008.stdout:3/992: mknod d0/c140 0 2023-10-18T20:58:49.653 INFO:tasks.workunit.client.0.smithi008.stdout:3/993: truncate d0/d3/d37/d74/fe3 448470 0 2023-10-18T20:58:49.653 INFO:tasks.workunit.client.0.smithi008.stdout:3/994: fdatasync d0/d84/dad/f118 0 2023-10-18T20:58:49.660 INFO:tasks.workunit.client.0.smithi008.stdout:1/913: symlink d9/de/df/d17/l120 0 2023-10-18T20:58:49.662 INFO:tasks.workunit.client.0.smithi008.stdout:2/844: write d1/d3/dd/d1c/f3e [7455773,81330] 0 2023-10-18T20:58:49.662 INFO:tasks.workunit.client.0.smithi008.stdout:2/845: truncate d1/d3/dd/f6f 902412 0 2023-10-18T20:58:49.662 INFO:tasks.workunit.client.0.smithi008.stdout:6/983: mkdir df/d15/d10c/d128/d148 0 2023-10-18T20:58:49.662 INFO:tasks.workunit.client.0.smithi008.stdout:6/984: fsync df/d26/f61 0 2023-10-18T20:58:49.663 INFO:tasks.workunit.client.0.smithi008.stdout:1/914: mknod d9/de/df/c121 0 2023-10-18T20:58:49.663 INFO:tasks.workunit.client.0.smithi008.stdout:1/915: fsync d9/de/df/d85/f104 0 2023-10-18T20:58:49.665 INFO:tasks.workunit.client.0.smithi008.stdout:2/846: creat d1/d3/dd/d25/db2/f116 x:0 0 0 2023-10-18T20:58:49.665 INFO:tasks.workunit.client.0.smithi008.stdout:2/847: dread - d1/d3/d40/d6e/d7e/ffb zero size 2023-10-18T20:58:49.672 INFO:tasks.workunit.client.0.smithi008.stdout:6/985: creat df/d15/d48/ded/d108/dcf/d58/dec/d53/d64/f149 x:0 0 0 2023-10-18T20:58:49.673 INFO:tasks.workunit.client.0.smithi008.stdout:3/995: dread d0/d3/d37/f4c [0,4194304] 0 2023-10-18T20:58:49.678 INFO:tasks.workunit.client.0.smithi008.stdout:9/763: sync 2023-10-18T20:58:49.678 INFO:tasks.workunit.client.0.smithi008.stdout:9/764: write d2/dc/d1a/f5b [2303321,27766] 0 2023-10-18T20:58:49.678 INFO:tasks.workunit.client.0.smithi008.stdout:9/765: chown d2/d8/db1/dd3/fc5 13922 1 2023-10-18T20:58:49.680 INFO:tasks.workunit.client.0.smithi008.stdout:1/916: rename d9/de/df/d85/c98 to d9/de/df/d17/d25/dc1/c122 0 2023-10-18T20:58:49.683 INFO:tasks.workunit.client.0.smithi008.stdout:6/986: getdents df/d15/d48/ded/d108/dcf/d68/db9 0 2023-10-18T20:58:49.683 INFO:tasks.workunit.client.0.smithi008.stdout:6/987: fdatasync df/d3c/d77/da9/ff1 0 2023-10-18T20:58:49.684 INFO:tasks.workunit.client.0.smithi008.stdout:3/996: truncate d0/d4a/f139 2298206 0 2023-10-18T20:58:49.684 INFO:tasks.workunit.client.0.smithi008.stdout:3/997: chown d0/d4a/d64/f7c 11825217 1 2023-10-18T20:58:49.687 INFO:tasks.workunit.client.0.smithi008.stdout:9/766: chown d2/dc/d40/d5a/fa3 215 1 2023-10-18T20:58:49.687 INFO:tasks.workunit.client.0.smithi008.stdout:6/988: creat df/d15/d48/ded/d108/dcf/d58/dec/f14a x:0 0 0 2023-10-18T20:58:49.689 INFO:tasks.workunit.client.0.smithi008.stdout:6/989: mknod df/dd1/c14b 0 2023-10-18T20:58:49.698 INFO:tasks.workunit.client.0.smithi008.stdout:6/990: mknod df/d15/d48/d81/d116/d4c/db2/c14c 0 2023-10-18T20:58:49.699 INFO:tasks.workunit.client.0.smithi008.stdout:6/991: chown df/d15/d48/d81/c106 14254992 1 2023-10-18T20:58:49.703 INFO:tasks.workunit.client.0.smithi008.stdout:6/992: mknod df/d15/d10c/d128/c14d 0 2023-10-18T20:58:49.706 INFO:tasks.workunit.client.0.smithi008.stdout:6/993: creat df/d3c/d77/dd6/f14e x:0 0 0 2023-10-18T20:58:49.708 INFO:tasks.workunit.client.0.smithi008.stdout:6/994: mknod df/d15/d48/ded/d108/dcf/c14f 0 2023-10-18T20:58:49.716 INFO:tasks.workunit.client.0.smithi008.stdout:1/917: dread d9/de/df/d17/d1e/f4a [0,4194304] 0 2023-10-18T20:58:49.719 INFO:tasks.workunit.client.0.smithi008.stdout:4/796: dwrite d0/d17/f23 [0,4194304] 0 2023-10-18T20:58:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:48.121863+0000 mgr.smithi008.flmjzp (mgr.14640) 18 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 219 MiB/s rd, 275 MiB/s wr, 397 op/s 2023-10-18T20:58:49.747 INFO:tasks.workunit.client.0.smithi008.stdout:3/998: dwrite d0/d84/f90 [0,4194304] 0 2023-10-18T20:58:49.747 INFO:tasks.workunit.client.0.smithi008.stdout:3/999: chown d0/d3/de/d13/d35/dbf/de0/d123/de8/fe1 212 1 2023-10-18T20:58:49.776 INFO:tasks.workunit.client.0.smithi008.stdout:4/797: dread d0/d17/d5b/d99/fb6 [0,4194304] 0 2023-10-18T20:58:49.777 INFO:tasks.workunit.client.0.smithi008.stdout:1/918: dwrite d9/de/df/d17/d1e/db8/ff8 [0,4194304] 0 2023-10-18T20:58:49.777 INFO:tasks.workunit.client.0.smithi008.stdout:1/919: fsync d9/de/df/d17/d25/f63 0 2023-10-18T20:58:49.778 INFO:tasks.workunit.client.0.smithi008.stdout:2/848: dwrite d1/d3/dd/d1c/d3a/d45/fda [0,4194304] 0 2023-10-18T20:58:49.780 INFO:tasks.workunit.client.0.smithi008.stdout:9/767: dwrite d2/dc/d40/d5a/fcc [0,4194304] 0 2023-10-18T20:58:49.781 INFO:tasks.workunit.client.0.smithi008.stdout:9/768: write d2/dc/d3d/d99/fd6 [234040,4755] 0 2023-10-18T20:58:49.787 INFO:tasks.workunit.client.0.smithi008.stdout:2/849: truncate d1/d3/dd/d25/d4d/fdd 2303987 0 2023-10-18T20:58:49.792 INFO:tasks.workunit.client.0.smithi008.stdout:2/850: creat d1/d3/dd/d25/d34/f117 x:0 0 0 2023-10-18T20:58:49.795 INFO:tasks.workunit.client.0.smithi008.stdout:2/851: link d1/d3/dd/d25/d5c/f60 d1/d3/d40/d6e/d7e/db3/d104/f118 0 2023-10-18T20:58:49.795 INFO:tasks.workunit.client.0.smithi008.stdout:2/852: truncate d1/d3/dd/d1c/f2d 1775237 0 2023-10-18T20:58:49.800 INFO:tasks.workunit.client.0.smithi008.stdout:2/853: symlink d1/d3/dd/d1c/d3a/d45/daa/l119 0 2023-10-18T20:58:49.803 INFO:tasks.workunit.client.0.smithi008.stdout:2/854: truncate d1/d3/dd/d25/d76/d59/f97 3539731 0 2023-10-18T20:58:49.805 INFO:tasks.workunit.client.0.smithi008.stdout:2/855: truncate d1/d3/d40/d6e/fd8 2294663 0 2023-10-18T20:58:49.810 INFO:tasks.workunit.client.0.smithi008.stdout:6/995: dwrite df/d36/f84 [0,4194304] 0 2023-10-18T20:58:49.811 INFO:tasks.workunit.client.0.smithi008.stdout:2/856: rmdir d1/d3/dd/d25/d76/d59/d85/dba/d102 0 2023-10-18T20:58:49.819 INFO:tasks.workunit.client.0.smithi008.stdout:5/840: sync 2023-10-18T20:58:49.819 INFO:tasks.workunit.client.0.smithi008.stdout:5/841: fdatasync d0/d2/d19/f81 0 2023-10-18T20:58:49.823 INFO:tasks.workunit.client.0.smithi008.stdout:2/857: mkdir d1/d3/dd/d25/d11a 0 2023-10-18T20:58:49.823 INFO:tasks.workunit.client.0.smithi008.stdout:6/996: mkdir df/d15/d48/ded/d108/d150 0 2023-10-18T20:58:49.829 INFO:tasks.workunit.client.0.smithi008.stdout:5/842: symlink d0/d2/d19/d7c/d31/d8d/l133 0 2023-10-18T20:58:49.830 INFO:tasks.workunit.client.0.smithi008.stdout:5/843: truncate d0/d2/d9/d9b/d12e/d70/dc0/ddb/f129 958620 0 2023-10-18T20:58:49.830 INFO:tasks.workunit.client.0.smithi008.stdout:2/858: creat d1/d3/d40/d6e/d7e/db3/d104/f11b x:0 0 0 2023-10-18T20:58:49.852 INFO:tasks.workunit.client.0.smithi008.stdout:2/859: dread d1/d3/dd/f6b [0,4194304] 0 2023-10-18T20:58:49.853 INFO:tasks.workunit.client.0.smithi008.stdout:2/860: chown d1/d3/dd/d25/d34/f46 57141 1 2023-10-18T20:58:49.853 INFO:tasks.workunit.client.0.smithi008.stdout:2/861: write d1/d3/dd/d25/d76/d59/dce/ff7 [546456,81869] 0 2023-10-18T20:58:49.857 INFO:tasks.workunit.client.0.smithi008.stdout:2/862: rename d1/d3/dd/d25/d76/d59/dce to d1/d3/dd/d25/db2/d11c 0 2023-10-18T20:58:49.863 INFO:tasks.workunit.client.0.smithi008.stdout:8/994: sync 2023-10-18T20:58:49.863 INFO:tasks.workunit.client.0.smithi008.stdout:7/848: sync 2023-10-18T20:58:49.867 INFO:tasks.workunit.client.0.smithi008.stdout:0/798: sync 2023-10-18T20:58:49.868 INFO:tasks.workunit.client.0.smithi008.stdout:2/863: mkdir d1/d3/dd/d25/d11d 0 2023-10-18T20:58:49.868 INFO:tasks.workunit.client.0.smithi008.stdout:2/864: getdents d1/d3/dd/d1c/dc7 0 2023-10-18T20:58:49.868 INFO:tasks.workunit.client.0.smithi008.stdout:7/849: mkdir d1/d36/d3d/da3/de8/d5f/d7f/d10a 0 2023-10-18T20:58:49.868 INFO:tasks.workunit.client.0.smithi008.stdout:8/995: truncate d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/d14b/d8c/dc9/ff2 1489052 0 2023-10-18T20:58:49.869 INFO:tasks.workunit.client.0.smithi008.stdout:8/996: write d5/d8/df/d9d/d85/f155 [461900,117587] 0 2023-10-18T20:58:49.869 INFO:tasks.workunit.client.0.smithi008.stdout:0/799: mknod d0/d7c/d9a/d8a/d8f/d21/df7/d61/cfc 0 2023-10-18T20:58:49.873 INFO:tasks.workunit.client.0.smithi008.stdout:8/997: creat d5/d8/df/d9d/d4d/dba/dd4/d50/d8d/de0/d14b/d8c/dc9/f167 x:0 0 0 2023-10-18T20:58:49.873 INFO:tasks.workunit.client.0.smithi008.stdout:0/800: link d0/dd/d19/d5f/d99/d94/c70 d0/dd/d19/d24/de5/cfd 0 2023-10-18T20:58:49.874 INFO:tasks.workunit.client.0.smithi008.stdout:2/865: rmdir d1/d3/dd/d1c/d3a/d49 39 2023-10-18T20:58:49.875 INFO:tasks.workunit.client.0.smithi008.stdout:8/998: mkdir d5/d8/df/d9d/d85/d168 0 2023-10-18T20:58:49.877 INFO:tasks.workunit.client.0.smithi008.stdout:8/999: write d5/d8/df/d9d/d85/db1/dcc/f140 [1872976,98979] 0 2023-10-18T20:58:49.878 INFO:tasks.workunit.client.0.smithi008.stdout:0/801: link d0/d7c/f5b d0/dd/d19/d5f/d89/da7/dac/ffe 0 2023-10-18T20:58:49.878 INFO:tasks.workunit.client.0.smithi008.stdout:0/802: write d0/dd/f27 [3223824,109601] 0 2023-10-18T20:58:49.881 INFO:tasks.workunit.client.0.smithi008.stdout:0/803: rename d0/dd/d19/d5f/d99/f2d to d0/dd/d19/d5f/d89/da7/de7/fff 0 2023-10-18T20:58:49.882 INFO:tasks.workunit.client.0.smithi008.stdout:2/866: rmdir d1 39 2023-10-18T20:58:49.883 INFO:tasks.workunit.client.0.smithi008.stdout:9/769: dwrite d2/dc/d17/d19/d4a/fab [0,4194304] 0 2023-10-18T20:58:49.884 INFO:tasks.workunit.client.0.smithi008.stdout:0/804: rename d0/dd/f15 to d0/d7c/d9a/dce/f100 0 2023-10-18T20:58:49.885 INFO:tasks.workunit.client.0.smithi008.stdout:0/805: stat d0/dd/d19/d24/de5 0 2023-10-18T20:58:49.885 INFO:tasks.workunit.client.0.smithi008.stdout:0/806: readlink d0/d7c/d9a/d8a/d8f/da5/lc6 0 2023-10-18T20:58:49.885 INFO:tasks.workunit.client.0.smithi008.stdout:0/807: fsync d0/d7c/d9a/d8a/d8f/f62 0 2023-10-18T20:58:49.888 INFO:tasks.workunit.client.0.smithi008.stdout:9/770: getdents d2/dc/d17/d19 0 2023-10-18T20:58:49.891 INFO:tasks.workunit.client.0.smithi008.stdout:5/844: dwrite d0/d2/d19/d7c/d58/d65/fd5 [0,4194304] 0 2023-10-18T20:58:49.895 INFO:tasks.workunit.client.0.smithi008.stdout:4/798: dwrite d0/d58/d8e/f53 [0,4194304] 0 2023-10-18T20:58:49.897 INFO:tasks.workunit.client.0.smithi008.stdout:9/771: mkdir d2/dc/d40/dce/de3 0 2023-10-18T20:58:49.899 INFO:tasks.workunit.client.0.smithi008.stdout:2/867: write d1/d3/dd/f6b [2046162,127510] 0 2023-10-18T20:58:49.900 INFO:tasks.workunit.client.0.smithi008.stdout:9/772: rename d2/dc/d17/d19/d4a/d9a/fa6 to d2/dc/d17/d19/fe4 0 2023-10-18T20:58:49.900 INFO:tasks.workunit.client.0.smithi008.stdout:9/773: chown d2/dc/d40/d46/f51 984307 1 2023-10-18T20:58:49.901 INFO:tasks.workunit.client.0.smithi008.stdout:4/799: mknod d0/d17/c10b 0 2023-10-18T20:58:49.901 INFO:tasks.workunit.client.0.smithi008.stdout:4/800: chown d0/l4d 86 1 2023-10-18T20:58:49.903 INFO:tasks.workunit.client.0.smithi008.stdout:4/801: mknod d0/d17/d5b/d2a/c10c 0 2023-10-18T20:58:49.903 INFO:tasks.workunit.client.0.smithi008.stdout:4/802: fsync d0/d58/d8e/db4/f97 0 2023-10-18T20:58:49.907 INFO:tasks.workunit.client.0.smithi008.stdout:4/803: mknod d0/c10d 0 2023-10-18T20:58:49.914 INFO:tasks.workunit.client.0.smithi008.stdout:4/804: symlink d0/d17/d5b/d45/l10e 0 2023-10-18T20:58:49.915 INFO:tasks.workunit.client.0.smithi008.stdout:1/920: dwrite d9/de/df/d17/f5f [0,4194304] 0 2023-10-18T20:58:49.915 INFO:tasks.workunit.client.0.smithi008.stdout:1/921: creat d9/de/df/d17/d1e/d7d/d89/f123 x:0 0 0 2023-10-18T20:58:49.915 INFO:tasks.workunit.client.0.smithi008.stdout:1/922: creat d9/de/df/d85/f124 x:0 0 0 2023-10-18T20:58:49.916 INFO:tasks.workunit.client.0.smithi008.stdout:6/997: dwrite df/d15/d48/d81/d116/dbf/f86 [4194304,4194304] 0 2023-10-18T20:58:49.916 INFO:tasks.workunit.client.0.smithi008.stdout:6/998: readlink df/d19/l10f 0 2023-10-18T20:58:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:48.121863+0000 mgr.smithi008.flmjzp (mgr.14640) 18 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 219 MiB/s rd, 275 MiB/s wr, 397 op/s 2023-10-18T20:58:49.921 INFO:tasks.workunit.client.0.smithi008.stdout:4/805: symlink d0/d3/d21/d57/d8f/l10f 0 2023-10-18T20:58:49.921 INFO:tasks.workunit.client.0.smithi008.stdout:4/806: fsync d0/d3/d21/d42/fa0 0 2023-10-18T20:58:49.922 INFO:tasks.workunit.client.0.smithi008.stdout:5/845: write d0/d2/d19/d7c/d31/d80/d107/fab [127286,72991] 0 2023-10-18T20:58:49.925 INFO:tasks.workunit.client.0.smithi008.stdout:6/999: unlink df/dd1/f134 0 2023-10-18T20:58:49.930 INFO:tasks.workunit.client.0.smithi008.stdout:4/807: rename d0/f27 to d0/d17/d5b/d2a/f110 0 2023-10-18T20:58:49.930 INFO:tasks.workunit.client.0.smithi008.stdout:5/846: mkdir d0/de/d134 0 2023-10-18T20:58:49.930 INFO:tasks.workunit.client.0.smithi008.stdout:1/923: truncate d9/de/df/d17/d1e/d9a/fed 810434 0 2023-10-18T20:58:49.931 INFO:tasks.workunit.client.0.smithi008.stdout:5/847: link d0/d2/d19/d7c/l38 d0/d2/l135 0 2023-10-18T20:58:49.936 INFO:tasks.workunit.client.0.smithi008.stdout:1/924: creat d9/de/df/d17/d1e/d7d/d89/dec/f125 x:0 0 0 2023-10-18T20:58:49.936 INFO:tasks.workunit.client.0.smithi008.stdout:1/925: read - d9/de/df/d17/d1e/d3c/d90/d95/fee zero size 2023-10-18T20:58:49.936 INFO:tasks.workunit.client.0.smithi008.stdout:1/926: fdatasync d9/de/df/d85/f124 0 2023-10-18T20:58:49.937 INFO:tasks.workunit.client.0.smithi008.stdout:1/927: getdents d9/de/df/d17/d25 0 2023-10-18T20:58:49.938 INFO:tasks.workunit.client.0.smithi008.stdout:1/928: getdents d9/de/df/d17/d116 0 2023-10-18T20:58:49.938 INFO:tasks.workunit.client.0.smithi008.stdout:4/808: dread d0/d17/f98 [0,4194304] 0 2023-10-18T20:58:49.940 INFO:tasks.workunit.client.0.smithi008.stdout:1/929: rename d9/de/df/d17/d25/c60 to d9/df7/d117/c126 0 2023-10-18T20:58:49.941 INFO:tasks.workunit.client.0.smithi008.stdout:4/809: truncate d0/d17/f60 1636796 0 2023-10-18T20:58:49.941 INFO:tasks.workunit.client.0.smithi008.stdout:4/810: write d0/d3/fa5 [1323870,3597] 0 2023-10-18T20:58:49.942 INFO:tasks.workunit.client.0.smithi008.stdout:4/811: readlink d0/d58/ld8 0 2023-10-18T20:58:49.943 INFO:tasks.workunit.client.0.smithi008.stdout:4/812: rename d0/d58/d8e/f9a to d0/d17/d6e/dfb/d101/f111 0 2023-10-18T20:58:49.944 INFO:tasks.workunit.client.0.smithi008.stdout:4/813: chown d0/caf 215 1 2023-10-18T20:58:49.944 INFO:tasks.workunit.client.0.smithi008.stdout:4/814: mkdir d0/d3/d21/d57/d8f/d95/d112 0 2023-10-18T20:58:49.945 INFO:tasks.workunit.client.0.smithi008.stdout:4/815: chown d0/d17/c10b 0 1 2023-10-18T20:58:49.953 INFO:tasks.workunit.client.0.smithi008.stdout:4/816: rename d0/d58/d8e/fec to d0/d58/d8e/dd2/f113 0 2023-10-18T20:58:49.955 INFO:tasks.workunit.client.0.smithi008.stdout:4/817: symlink d0/d3/d21/d57/d8f/d73/l114 0 2023-10-18T20:58:49.955 INFO:tasks.workunit.client.0.smithi008.stdout:4/818: write d0/d3/d21/d57/d8f/d95/f105 [117637,83163] 0 2023-10-18T20:58:49.956 INFO:tasks.workunit.client.0.smithi008.stdout:4/819: creat d0/d17/f115 x:0 0 0 2023-10-18T20:58:49.957 INFO:tasks.workunit.client.0.smithi008.stdout:4/820: mknod d0/d76/c116 0 2023-10-18T20:58:49.957 INFO:tasks.workunit.client.0.smithi008.stdout:4/821: chown d0/d58/d8e/dd2/f113 135 1 2023-10-18T20:58:49.958 INFO:tasks.workunit.client.0.smithi008.stdout:4/822: truncate d0/d3/d21/d57/d8f/fdc 1229843 0 2023-10-18T20:58:49.959 INFO:tasks.workunit.client.0.smithi008.stdout:4/823: chown d0/d3/f1e 248 1 2023-10-18T20:58:49.959 INFO:tasks.workunit.client.0.smithi008.stdout:4/824: fdatasync d0/d3/d21/d57/d8f/f72 0 2023-10-18T20:58:49.961 INFO:tasks.workunit.client.0.smithi008.stdout:2/868: dwrite d1/d3/d40/f54 [0,4194304] 0 2023-10-18T20:58:49.962 INFO:tasks.workunit.client.0.smithi008.stdout:2/869: mkdir d1/d3/dd/d25/d76/d59/d11e 0 2023-10-18T20:58:49.964 INFO:tasks.workunit.client.0.smithi008.stdout:2/870: truncate d1/d3/dd/d25/f27 3855931 0 2023-10-18T20:58:49.967 INFO:tasks.workunit.client.0.smithi008.stdout:1/930: write d9/de/df/d17/d1e/f4c [1562287,31376] 0 2023-10-18T20:58:49.968 INFO:tasks.workunit.client.0.smithi008.stdout:2/871: truncate d1/d3/dd/d25/d4d/f68 1141522 0 2023-10-18T20:58:49.968 INFO:tasks.workunit.client.0.smithi008.stdout:2/872: truncate d1/d3/dd/d1c/d3a/d57/f6d 44030 0 2023-10-18T20:58:49.975 INFO:tasks.workunit.client.0.smithi008.stdout:2/873: mknod d1/d3/dd/d25/d76/dad/c11f 0 2023-10-18T20:58:49.981 INFO:tasks.workunit.client.0.smithi008.stdout:1/931: mknod d9/de/df/d17/d25/dc1/c127 0 2023-10-18T20:58:49.990 INFO:tasks.workunit.client.0.smithi008.stdout:1/932: dread d9/de/df/f84 [0,4194304] 0 2023-10-18T20:58:49.992 INFO:tasks.workunit.client.0.smithi008.stdout:1/933: creat d9/de/df/d17/d25/d94/dc4/f128 x:0 0 0 2023-10-18T20:58:49.993 INFO:tasks.workunit.client.0.smithi008.stdout:2/874: dread d1/d3/dd/d1c/d3a/d57/f67 [0,4194304] 0 2023-10-18T20:58:49.995 INFO:tasks.workunit.client.0.smithi008.stdout:1/934: mknod d9/de/df/d17/d1e/d9a/dbc/c129 0 2023-10-18T20:58:49.995 INFO:tasks.workunit.client.0.smithi008.stdout:1/935: write d9/fc [1300948,43859] 0 2023-10-18T20:58:49.995 INFO:tasks.workunit.client.0.smithi008.stdout:1/936: write d9/de/df/d17/d25/d94/da7/fd7 [40928,100907] 0 2023-10-18T20:58:49.996 INFO:tasks.workunit.client.0.smithi008.stdout:1/937: fsync d9/de/df/d17/f5f 0 2023-10-18T20:58:49.996 INFO:tasks.workunit.client.0.smithi008.stdout:2/875: mknod d1/d3/dd/d1c/dc7/c120 0 2023-10-18T20:58:49.996 INFO:tasks.workunit.client.0.smithi008.stdout:2/876: chown d1/d3/dd/d25/d11a 3773 1 2023-10-18T20:58:49.996 INFO:tasks.workunit.client.0.smithi008.stdout:2/877: dread - d1/d3/dd/d1c/d3a/d45/d83/fb0 zero size 2023-10-18T20:58:49.998 INFO:tasks.workunit.client.0.smithi008.stdout:1/938: mknod d9/de/df/d17/d1e/d3c/d90/d95/c12a 0 2023-10-18T20:58:49.998 INFO:tasks.workunit.client.0.smithi008.stdout:1/939: symlink d9/de/df/d17/d1e/d3c/d90/d95/l12b 0 2023-10-18T20:58:49.998 INFO:tasks.workunit.client.0.smithi008.stdout:1/940: rename d9/de to d9/de/df/d17/d1e/d7d/d89/dec/d12c 22 2023-10-18T20:58:49.999 INFO:tasks.workunit.client.0.smithi008.stdout:1/941: write d9/de/df/d17/d25/d94/dc4/f128 [591599,61123] 0 2023-10-18T20:58:49.999 INFO:tasks.workunit.client.0.smithi008.stdout:1/942: chown d9/de/df/d17/d1e/d9a/c107 7233 1 2023-10-18T20:58:50.024 INFO:tasks.workunit.client.0.smithi008.stdout:1/943: dread d9/de/df/d17/d1e/f71 [0,4194304] 0 2023-10-18T20:58:50.025 INFO:tasks.workunit.client.0.smithi008.stdout:1/944: symlink d9/de/df/d17/d25/d94/da7/l12d 0 2023-10-18T20:58:50.028 INFO:tasks.workunit.client.0.smithi008.stdout:1/945: symlink d9/de/df/d17/d55/da8/l12e 0 2023-10-18T20:58:50.028 INFO:tasks.workunit.client.0.smithi008.stdout:1/946: fdatasync d9/de/df/d17/d69/ffe 0 2023-10-18T20:58:50.030 INFO:tasks.workunit.client.0.smithi008.stdout:1/947: unlink d9/de/df/d17/d1e/d7d/c8a 0 2023-10-18T20:58:50.033 INFO:tasks.workunit.client.0.smithi008.stdout:1/948: rename d9/de/df/d17/c38 to d9/de/df/d17/d1e/d7d/d89/c12f 0 2023-10-18T20:58:50.033 INFO:tasks.workunit.client.0.smithi008.stdout:1/949: write d9/de/df/d17/d25/f44 [2062423,1613] 0 2023-10-18T20:58:50.041 INFO:tasks.workunit.client.0.smithi008.stdout:2/878: dwrite d1/d3/d40/d6e/fd8 [0,4194304] 0 2023-10-18T20:58:50.042 INFO:tasks.workunit.client.0.smithi008.stdout:2/879: chown d1/d3/dd/f50 8284 1 2023-10-18T20:58:50.042 INFO:tasks.workunit.client.0.smithi008.stdout:2/880: symlink d1/d3/dd/d25/d76/d59/d85/d110/d10a/l121 0 2023-10-18T20:58:50.044 INFO:tasks.workunit.client.0.smithi008.stdout:1/950: dread d9/de/df/d17/d1e/f65 [0,4194304] 0 2023-10-18T20:58:50.044 INFO:tasks.workunit.client.0.smithi008.stdout:1/951: fdatasync d9/de/df/f5b 0 2023-10-18T20:58:50.044 INFO:tasks.workunit.client.0.smithi008.stdout:1/952: write d9/fda [79489,47260] 0 2023-10-18T20:58:50.045 INFO:tasks.workunit.client.0.smithi008.stdout:1/953: write d9/de/df/d17/d25/f32 [215741,74794] 0 2023-10-18T20:58:50.084 INFO:tasks.workunit.client.0.smithi008.stdout:2/881: dwrite d1/d3/d40/f62 [0,4194304] 0 2023-10-18T20:58:50.095 INFO:tasks.workunit.client.0.smithi008.stdout:2/882: write d1/d3/dd/d1c/d3a/d45/ffc [81274,95548] 0 2023-10-18T20:58:50.099 INFO:tasks.workunit.client.0.smithi008.stdout:2/883: read d1/d3/fd3 [751075,20282] 0 2023-10-18T20:58:50.107 INFO:tasks.workunit.client.0.smithi008.stdout:2/884: dread d1/d3/dd/d25/d76/d59/fa6 [0,4194304] 0 2023-10-18T20:58:50.108 INFO:tasks.workunit.client.0.smithi008.stdout:2/885: write d1/d3/dd/d25/d76/d59/fa6 [1490823,125326] 0 2023-10-18T20:58:50.108 INFO:tasks.workunit.client.0.smithi008.stdout:2/886: write d1/d3/dd/d25/d5c/f60 [2784558,104593] 0 2023-10-18T20:58:50.124 INFO:tasks.workunit.client.0.smithi008.stdout:7/850: sync 2023-10-18T20:58:50.147 INFO:tasks.workunit.client.0.smithi008.stdout:2/887: dwrite d1/d3/dd/d25/d76/d59/d85/f90 [0,4194304] 0 2023-10-18T20:58:50.147 INFO:tasks.workunit.client.0.smithi008.stdout:2/888: write d1/d3/dd/d25/d76/f3f [3597763,56653] 0 2023-10-18T20:58:50.154 INFO:tasks.workunit.client.0.smithi008.stdout:2/889: rmdir d1/d3/dd/d25/d76/d59 39 2023-10-18T20:58:50.155 INFO:tasks.workunit.client.0.smithi008.stdout:2/890: readlink d1/d3/la0 0 2023-10-18T20:58:50.156 INFO:tasks.workunit.client.0.smithi008.stdout:2/891: mknod d1/d3/dd/d1c/dc7/c122 0 2023-10-18T20:58:50.156 INFO:tasks.workunit.client.0.smithi008.stdout:2/892: truncate d1/d3/dd/d25/d76/d59/d85/db9/fec 919880 0 2023-10-18T20:58:50.157 INFO:tasks.workunit.client.0.smithi008.stdout:2/893: chown d1/d3/dd/d25/d76/d59/d103 29 1 2023-10-18T20:58:50.157 INFO:tasks.workunit.client.0.smithi008.stdout:2/894: readlink d1/d3/l33 0 2023-10-18T20:58:50.157 INFO:tasks.workunit.client.0.smithi008.stdout:2/895: symlink d1/d3/d40/d6e/d7e/db3/l123 0 2023-10-18T20:58:50.158 INFO:tasks.workunit.client.0.smithi008.stdout:2/896: creat d1/d3/d40/de0/f124 x:0 0 0 2023-10-18T20:58:50.162 INFO:tasks.workunit.client.0.smithi008.stdout:7/851: dwrite d1/d36/d3d/da3/de8/f43 [0,4194304] 0 2023-10-18T20:58:50.175 INFO:tasks.workunit.client.0.smithi008.stdout:7/852: read d1/da6/d79/f71 [2240002,44632] 0 2023-10-18T20:58:50.234 INFO:tasks.workunit.client.0.smithi008.stdout:2/897: dwrite d1/d3/dd/d25/d34/f117 [0,4194304] 0 2023-10-18T20:58:50.236 INFO:tasks.workunit.client.0.smithi008.stdout:7/853: dwrite d1/f1b [0,4194304] 0 2023-10-18T20:58:50.236 INFO:tasks.workunit.client.0.smithi008.stdout:7/854: fsync d1/d36/d3d/d3e/d59/fd3 0 2023-10-18T20:58:50.240 INFO:tasks.workunit.client.0.smithi008.stdout:7/855: mknod d1/da6/d4f/dc9/c10b 0 2023-10-18T20:58:50.248 INFO:tasks.workunit.client.0.smithi008.stdout:2/898: dread d1/d3/dd/d25/d34/f46 [0,4194304] 0 2023-10-18T20:58:50.248 INFO:tasks.workunit.client.0.smithi008.stdout:2/899: read - d1/d3/dd/d25/d5c/f109 zero size 2023-10-18T20:58:50.249 INFO:tasks.workunit.client.0.smithi008.stdout:2/900: chown d1/d3/d40/de0 644104643 1 2023-10-18T20:58:50.249 INFO:tasks.workunit.client.0.smithi008.stdout:2/901: chown d1/d3/dd/d25/d76/d59/fc4 2 1 2023-10-18T20:58:50.249 INFO:tasks.workunit.client.0.smithi008.stdout:2/902: creat d1/d3/dd/d25/f125 x:0 0 0 2023-10-18T20:58:50.250 INFO:tasks.workunit.client.0.smithi008.stdout:0/808: sync 2023-10-18T20:58:50.250 INFO:tasks.workunit.client.0.smithi008.stdout:1/954: sync 2023-10-18T20:58:50.250 INFO:tasks.workunit.client.0.smithi008.stdout:5/848: sync 2023-10-18T20:58:50.251 INFO:tasks.workunit.client.0.smithi008.stdout:4/825: sync 2023-10-18T20:58:50.251 INFO:tasks.workunit.client.0.smithi008.stdout:9/774: sync 2023-10-18T20:58:50.251 INFO:tasks.workunit.client.0.smithi008.stdout:0/809: chown d0/d7c/d9a/d8a/d8f/da5/lc6 186398 1 2023-10-18T20:58:50.252 INFO:tasks.workunit.client.0.smithi008.stdout:9/775: fsync d2/d8/da0/fb0 0 2023-10-18T20:58:50.252 INFO:tasks.workunit.client.0.smithi008.stdout:9/776: truncate d2/d8/da0/fb0 790862 0 2023-10-18T20:58:50.253 INFO:tasks.workunit.client.0.smithi008.stdout:2/903: write d1/f19 [2796263,40337] 0 2023-10-18T20:58:50.253 INFO:tasks.workunit.client.0.smithi008.stdout:1/955: mkdir d9/de/df/d85/dd3/d130 0 2023-10-18T20:58:50.253 INFO:tasks.workunit.client.0.smithi008.stdout:4/826: symlink d0/d58/d8e/dd2/l117 0 2023-10-18T20:58:50.255 INFO:tasks.workunit.client.0.smithi008.stdout:7/856: dread d1/da6/d79/f4a [0,4194304] 0 2023-10-18T20:58:50.256 INFO:tasks.workunit.client.0.smithi008.stdout:0/810: rename d0/d7c/f5b to d0/dd/d19/d24/f101 0 2023-10-18T20:58:50.257 INFO:tasks.workunit.client.0.smithi008.stdout:2/904: rmdir d1/d3/dd/d25/d76/dad 39 2023-10-18T20:58:50.259 INFO:tasks.workunit.client.0.smithi008.stdout:1/956: rmdir d9/de/df/d17/d25/d94/da7 39 2023-10-18T20:58:50.260 INFO:tasks.workunit.client.0.smithi008.stdout:4/827: dread d0/d58/d8e/dd2/f113 [0,4194304] 0 2023-10-18T20:58:50.260 INFO:tasks.workunit.client.0.smithi008.stdout:4/828: chown d0/d58/d8e/ffd 3620530 1 2023-10-18T20:58:50.264 INFO:tasks.workunit.client.0.smithi008.stdout:2/905: unlink d1/d3/d79/f7d 0 2023-10-18T20:58:50.268 INFO:tasks.workunit.client.0.smithi008.stdout:5/849: dread d0/d2/d9/d9b/de7/d11f/f7f [0,4194304] 0 2023-10-18T20:58:50.269 INFO:tasks.workunit.client.0.smithi008.stdout:9/777: rename d2/dc/d1a/d1d/fd2 to d2/dc/d40/d5a/fe5 0 2023-10-18T20:58:50.270 INFO:tasks.workunit.client.0.smithi008.stdout:4/829: mknod d0/d3/d21/d42/c118 0 2023-10-18T20:58:50.271 INFO:tasks.workunit.client.0.smithi008.stdout:2/906: creat d1/d3/dd/d25/d4d/f126 x:0 0 0 2023-10-18T20:58:50.273 INFO:tasks.workunit.client.0.smithi008.stdout:5/850: mkdir d0/da9/dda/d100/d136 0 2023-10-18T20:58:50.274 INFO:tasks.workunit.client.0.smithi008.stdout:9/778: mkdir d2/dc/d17/d7b/de6 0 2023-10-18T20:58:50.274 INFO:tasks.workunit.client.0.smithi008.stdout:9/779: chown d2/dc/d17/f2e 26481847 1 2023-10-18T20:58:50.274 INFO:tasks.workunit.client.0.smithi008.stdout:9/780: chown d2/d4d/f7d 91 1 2023-10-18T20:58:50.275 INFO:tasks.workunit.client.0.smithi008.stdout:9/781: write d2/dc/d3d/f8d [433759,78972] 0 2023-10-18T20:58:50.275 INFO:tasks.workunit.client.0.smithi008.stdout:9/782: write d2/f48 [128225,42537] 0 2023-10-18T20:58:50.275 INFO:tasks.workunit.client.0.smithi008.stdout:4/830: mknod d0/d3/d21/c119 0 2023-10-18T20:58:50.276 INFO:tasks.workunit.client.0.smithi008.stdout:2/907: getdents d1/d3/dd/d25/d76/d59/d85/db9 0 2023-10-18T20:58:50.276 INFO:tasks.workunit.client.0.smithi008.stdout:0/811: dread d0/d7c/d9a/d8a/fec [0,4194304] 0 2023-10-18T20:58:50.276 INFO:tasks.workunit.client.0.smithi008.stdout:0/812: write d0/dd/d19/d5f/f83 [1572824,123645] 0 2023-10-18T20:58:50.278 INFO:tasks.workunit.client.0.smithi008.stdout:9/783: rename d2/dc/f1e to d2/dc/d1a/d1d/fe7 0 2023-10-18T20:58:50.279 INFO:tasks.workunit.client.0.smithi008.stdout:0/813: creat d0/d7c/d9a/d8a/d8f/d21/df7/d61/f102 x:0 0 0 2023-10-18T20:58:50.280 INFO:tasks.workunit.client.0.smithi008.stdout:9/784: symlink d2/d8/db1/le8 0 2023-10-18T20:58:50.282 INFO:tasks.workunit.client.0.smithi008.stdout:4/831: dread d0/d76/fa1 [0,4194304] 0 2023-10-18T20:58:50.282 INFO:tasks.workunit.client.0.smithi008.stdout:9/785: creat d2/dc/d17/d19/d4a/fe9 x:0 0 0 2023-10-18T20:58:50.284 INFO:tasks.workunit.client.0.smithi008.stdout:4/832: creat d0/d17/dc6/f11a x:0 0 0 2023-10-18T20:58:50.286 INFO:tasks.workunit.client.0.smithi008.stdout:9/786: creat d2/d8/db1/fea x:0 0 0 2023-10-18T20:58:50.286 INFO:tasks.workunit.client.0.smithi008.stdout:4/833: mknod d0/d58/d8e/dd2/c11b 0 2023-10-18T20:58:50.287 INFO:tasks.workunit.client.0.smithi008.stdout:4/834: creat d0/d17/f11c x:0 0 0 2023-10-18T20:58:50.288 INFO:tasks.workunit.client.0.smithi008.stdout:4/835: creat d0/f11d x:0 0 0 2023-10-18T20:58:50.291 INFO:tasks.workunit.client.0.smithi008.stdout:4/836: mkdir d0/d3/d21/d57/d11e 0 2023-10-18T20:58:50.300 INFO:tasks.workunit.client.0.smithi008.stdout:4/837: rmdir d0/d3/d21/d57/d8f/d95 39 2023-10-18T20:58:50.301 INFO:tasks.workunit.client.0.smithi008.stdout:2/908: dread d1/d3/dd/f6b [0,4194304] 0 2023-10-18T20:58:50.301 INFO:tasks.workunit.client.0.smithi008.stdout:2/909: creat d1/d3/d40/d6e/d7e/db3/d104/f127 x:0 0 0 2023-10-18T20:58:50.303 INFO:tasks.workunit.client.0.smithi008.stdout:0/814: write d0/dd/d19/d24/f35 [44499,88392] 0 2023-10-18T20:58:50.306 INFO:tasks.workunit.client.0.smithi008.stdout:4/838: rename d0/d17/d5b/f68 to d0/d17/d5b/f11f 0 2023-10-18T20:58:50.312 INFO:tasks.workunit.client.0.smithi008.stdout:0/815: rename d0/c22 to d0/d90/c103 0 2023-10-18T20:58:50.312 INFO:tasks.workunit.client.0.smithi008.stdout:0/816: chown d0/dd/d19/fa8 16714452 1 2023-10-18T20:58:50.318 INFO:tasks.workunit.client.0.smithi008.stdout:4/839: link d0/d17/d5b/d45/le9 d0/d17/d5b/l120 0 2023-10-18T20:58:50.324 INFO:tasks.workunit.client.0.smithi008.stdout:9/787: write d2/dc/f14 [351370,65362] 0 2023-10-18T20:58:50.325 INFO:tasks.workunit.client.0.smithi008.stdout:2/910: write d1/d3/dd/d25/d4d/f68 [299012,37694] 0 2023-10-18T20:58:50.325 INFO:tasks.workunit.client.0.smithi008.stdout:1/957: dread d9/de/df/d17/d1e/d7d/f88 [0,4194304] 0 2023-10-18T20:58:50.326 INFO:tasks.workunit.client.0.smithi008.stdout:9/788: creat d2/dc/d40/dce/de3/feb x:0 0 0 2023-10-18T20:58:50.327 INFO:tasks.workunit.client.0.smithi008.stdout:9/789: creat d2/dc/d40/dce/de3/fec x:0 0 0 2023-10-18T20:58:50.327 INFO:tasks.workunit.client.0.smithi008.stdout:2/911: rmdir d1/d3/dd/d1c/d3a/d45/de1 39 2023-10-18T20:58:50.327 INFO:tasks.workunit.client.0.smithi008.stdout:2/912: write d1/d3/dd/d25/d4d/f68 [1973777,62143] 0 2023-10-18T20:58:50.327 INFO:tasks.workunit.client.0.smithi008.stdout:2/913: creat d1/d3/d79/f128 x:0 0 0 2023-10-18T20:58:50.328 INFO:tasks.workunit.client.0.smithi008.stdout:1/958: stat d9/de/df/d17/d25/l3b 0 2023-10-18T20:58:50.328 INFO:tasks.workunit.client.0.smithi008.stdout:1/959: chown d9/de/df/d85/dd3/d130 16546124 1 2023-10-18T20:58:50.328 INFO:tasks.workunit.client.0.smithi008.stdout:1/960: write d9/de/df/d85/f104 [132675,88618] 0 2023-10-18T20:58:50.329 INFO:tasks.workunit.client.0.smithi008.stdout:7/857: dwrite d1/da6/d79/f92 [0,4194304] 0 2023-10-18T20:58:50.330 INFO:tasks.workunit.client.0.smithi008.stdout:2/914: symlink d1/d3/dd/d25/d76/d59/d85/d110/l129 0 2023-10-18T20:58:50.331 INFO:tasks.workunit.client.0.smithi008.stdout:1/961: rename d9/de/df/d17/d1e/d9a/fed to d9/de/df/d17/d25/d94/dc4/f131 0 2023-10-18T20:58:50.331 INFO:tasks.workunit.client.0.smithi008.stdout:1/962: readlink d9/l92 0 2023-10-18T20:58:50.334 INFO:tasks.workunit.client.0.smithi008.stdout:7/858: symlink d1/d3/d8b/l10c 0 2023-10-18T20:58:50.335 INFO:tasks.workunit.client.0.smithi008.stdout:2/915: mknod d1/d3/dd/d25/d11a/c12a 0 2023-10-18T20:58:50.335 INFO:tasks.workunit.client.0.smithi008.stdout:2/916: getdents d1/d3/dd/d1c/d3a/d45/de1 0 2023-10-18T20:58:50.338 INFO:tasks.workunit.client.0.smithi008.stdout:2/917: getdents d1/d3/dd/d25/d76/d59/d85 0 2023-10-18T20:58:50.338 INFO:tasks.workunit.client.0.smithi008.stdout:1/963: rmdir d9/df1 39 2023-10-18T20:58:50.339 INFO:tasks.workunit.client.0.smithi008.stdout:1/964: chown d9/de/df/d17/d1e/db8/l11c 182985322 1 2023-10-18T20:58:50.339 INFO:tasks.workunit.client.0.smithi008.stdout:1/965: chown d9/fda 3 1 2023-10-18T20:58:50.339 INFO:tasks.workunit.client.0.smithi008.stdout:5/851: dwrite d0/d2/d19/d7c/d42/d5a/f69 [4194304,4194304] 0 2023-10-18T20:58:50.341 INFO:tasks.workunit.client.0.smithi008.stdout:2/918: symlink d1/d3/dd/d1c/l12b 0 2023-10-18T20:58:50.342 INFO:tasks.workunit.client.0.smithi008.stdout:1/966: creat d9/de/df/d85/dd3/d130/f132 x:0 0 0 2023-10-18T20:58:50.344 INFO:tasks.workunit.client.0.smithi008.stdout:5/852: mknod d0/d103/c137 0 2023-10-18T20:58:50.346 INFO:tasks.workunit.client.0.smithi008.stdout:1/967: creat d9/de/df/d17/d1e/d9a/f133 x:0 0 0 2023-10-18T20:58:50.349 INFO:tasks.workunit.client.0.smithi008.stdout:4/840: dread d0/d17/d6e/dfb/d101/f111 [0,4194304] 0 2023-10-18T20:58:50.356 INFO:tasks.workunit.client.0.smithi008.stdout:1/968: creat d9/de/df/d17/d25/f134 x:0 0 0 2023-10-18T20:58:50.356 INFO:tasks.workunit.client.0.smithi008.stdout:4/841: mknod d0/d3/d21/c121 0 2023-10-18T20:58:50.359 INFO:tasks.workunit.client.0.smithi008.stdout:1/969: mknod d9/de/d110/c135 0 2023-10-18T20:58:50.369 INFO:tasks.workunit.client.0.smithi008.stdout:0/817: dwrite d0/d7c/f72 [0,4194304] 0 2023-10-18T20:58:50.377 INFO:tasks.workunit.client.0.smithi008.stdout:9/790: dwrite d2/d8/db1/dd3/fbe [0,4194304] 0 2023-10-18T20:58:50.377 INFO:tasks.workunit.client.0.smithi008.stdout:2/919: dread d1/d3/dd/d1c/f2d [0,4194304] 0 2023-10-18T20:58:50.378 INFO:tasks.workunit.client.0.smithi008.stdout:2/920: chown d1/d3/dd/df3 3 1 2023-10-18T20:58:50.378 INFO:tasks.workunit.client.0.smithi008.stdout:9/791: write d2/dc/d40/d5a/f95 [1001534,67890] 0 2023-10-18T20:58:50.378 INFO:tasks.workunit.client.0.smithi008.stdout:0/818: link d0/dd/d19/d5f/d99/d94/f43 d0/d7c/d9a/d8a/d8f/f104 0 2023-10-18T20:58:50.379 INFO:tasks.workunit.client.0.smithi008.stdout:0/819: chown d0/dd/d19/d5f/d89/ld1 31846 1 2023-10-18T20:58:50.380 INFO:tasks.workunit.client.0.smithi008.stdout:1/970: dread d9/de/df/d17/d25/d57/f87 [0,4194304] 0 2023-10-18T20:58:50.381 INFO:tasks.workunit.client.0.smithi008.stdout:1/971: truncate d9/de/df/d17/d25/d57/f87 4890317 0 2023-10-18T20:58:50.381 INFO:tasks.workunit.client.0.smithi008.stdout:1/972: fdatasync d9/de/df/d17/d55/f5c 0 2023-10-18T20:58:50.387 INFO:tasks.workunit.client.0.smithi008.stdout:0/820: symlink d0/dd/d19/d5f/d89/da7/de7/l105 0 2023-10-18T20:58:50.390 INFO:tasks.workunit.client.0.smithi008.stdout:0/821: mknod d0/dd/c106 0 2023-10-18T20:58:50.391 INFO:tasks.workunit.client.0.smithi008.stdout:2/921: dread d1/d3/dd/d25/d4d/f68 [0,4194304] 0 2023-10-18T20:58:50.391 INFO:tasks.workunit.client.0.smithi008.stdout:0/822: mknod d0/dd/d19/d5f/d89/c107 0 2023-10-18T20:58:50.393 INFO:tasks.workunit.client.0.smithi008.stdout:0/823: symlink d0/dd/df/l108 0 2023-10-18T20:58:50.395 INFO:tasks.workunit.client.0.smithi008.stdout:0/824: rename d0/c3f to d0/d7c/d9a/d8a/d8f/d21/c109 0 2023-10-18T20:58:50.395 INFO:tasks.workunit.client.0.smithi008.stdout:0/825: write d0/dd/d19/d5f/d99/d94/f65 [1604556,62317] 0 2023-10-18T20:58:50.396 INFO:tasks.workunit.client.0.smithi008.stdout:7/859: dwrite d1/d3/fc0 [0,4194304] 0 2023-10-18T20:58:50.396 INFO:tasks.workunit.client.0.smithi008.stdout:5/853: dwrite d0/d2/d9/f54 [0,4194304] 0 2023-10-18T20:58:50.399 INFO:tasks.workunit.client.0.smithi008.stdout:1/973: truncate d9/de/df/d17/d25/d57/f87 797658 0 2023-10-18T20:58:50.399 INFO:tasks.workunit.client.0.smithi008.stdout:0/826: symlink d0/dd/d19/d5f/d89/da7/l10a 0 2023-10-18T20:58:50.407 INFO:tasks.workunit.client.0.smithi008.stdout:7/860: mknod d1/d36/d3d/da3/de8/c10d 0 2023-10-18T20:58:50.407 INFO:tasks.workunit.client.0.smithi008.stdout:1/974: creat d9/df1/f136 x:0 0 0 2023-10-18T20:58:50.407 INFO:tasks.workunit.client.0.smithi008.stdout:1/975: stat d9/de/df/d85/dd3/le5 0 2023-10-18T20:58:50.408 INFO:tasks.workunit.client.0.smithi008.stdout:0/827: creat d0/f10b x:0 0 0 2023-10-18T20:58:50.411 INFO:tasks.workunit.client.0.smithi008.stdout:2/922: write d1/d3/dd/d1c/f55 [469835,93211] 0 2023-10-18T20:58:50.417 INFO:tasks.workunit.client.0.smithi008.stdout:2/923: symlink d1/d3/dd/d1c/d3a/d45/daa/l12c 0 2023-10-18T20:58:50.421 INFO:tasks.workunit.client.0.smithi008.stdout:0/828: getdents d0/dd/d19/d5f/d99/d5e/d7d 0 2023-10-18T20:58:50.421 INFO:tasks.workunit.client.0.smithi008.stdout:0/829: creat d0/d7c/d9a/d8a/d8f/d21/df7/d61/f10c x:0 0 0 2023-10-18T20:58:50.430 INFO:tasks.workunit.client.0.smithi008.stdout:7/861: dread d1/da6/d79/f92 [0,4194304] 0 2023-10-18T20:58:50.460 INFO:tasks.workunit.client.0.smithi008.stdout:7/862: dread d1/d3/f56 [0,4194304] 0 2023-10-18T20:58:50.471 INFO:tasks.workunit.client.0.smithi008.stdout:7/863: dread d1/d3/d8b/f93 [0,4194304] 0 2023-10-18T20:58:50.473 INFO:tasks.workunit.client.0.smithi008.stdout:7/864: symlink d1/d36/d3d/da3/de8/d54/l10e 0 2023-10-18T20:58:50.473 INFO:tasks.workunit.client.0.smithi008.stdout:7/865: chown d1/d36/d3d/d3e 9505475 1 2023-10-18T20:58:50.476 INFO:tasks.workunit.client.0.smithi008.stdout:7/866: mknod d1/da6/c10f 0 2023-10-18T20:58:50.481 INFO:tasks.workunit.client.0.smithi008.stdout:7/867: link d1/d36/d3d/d3e/d59/f9b d1/d36/d3d/d3e/d59/d73/f110 0 2023-10-18T20:58:50.491 INFO:tasks.workunit.client.0.smithi008.stdout:1/976: dwrite d9/de/df/d17/d1e/d9a/f9c [0,4194304] 0 2023-10-18T20:58:50.493 INFO:tasks.workunit.client.0.smithi008.stdout:5/854: dwrite d0/d2/d9/d9b/f50 [0,4194304] 0 2023-10-18T20:58:50.494 INFO:tasks.workunit.client.0.smithi008.stdout:2/924: dwrite d1/d3/dd/d25/d4d/fdd [0,4194304] 0 2023-10-18T20:58:50.494 INFO:tasks.workunit.client.0.smithi008.stdout:5/855: write d0/d2/d19/d7c/d31/d82/fe3 [396072,73376] 0 2023-10-18T20:58:50.494 INFO:tasks.workunit.client.0.smithi008.stdout:0/830: dwrite d0/dd/d19/d24/f97 [0,4194304] 0 2023-10-18T20:58:50.495 INFO:tasks.workunit.client.0.smithi008.stdout:0/831: read - d0/dd/d19/d24/fe3 zero size 2023-10-18T20:58:50.495 INFO:tasks.workunit.client.0.smithi008.stdout:0/832: readlink d0/d7c/d9a/d8a/d8f/d21/l9b 0 2023-10-18T20:58:50.495 INFO:tasks.workunit.client.0.smithi008.stdout:0/833: fsync d0/dd/df/feb 0 2023-10-18T20:58:50.496 INFO:tasks.workunit.client.0.smithi008.stdout:0/834: write d0/d7c/d9a/d8a/d8f/d21/df7/d61/fe9 [824920,14402] 0 2023-10-18T20:58:50.496 INFO:tasks.workunit.client.0.smithi008.stdout:0/835: write d0/dd/d19/d5f/d99/d94/f95 [4482951,108838] 0 2023-10-18T20:58:50.496 INFO:tasks.workunit.client.0.smithi008.stdout:7/868: write d1/d36/d3d/da3/de8/d5f/d7f/fbc [1403312,17475] 0 2023-10-18T20:58:50.501 INFO:tasks.workunit.client.0.smithi008.stdout:2/925: symlink d1/d3/dd/d1c/dc7/l12d 0 2023-10-18T20:58:50.502 INFO:tasks.workunit.client.0.smithi008.stdout:2/926: chown d1/d3/dd/d1c/d3a/d45/f84 864880 1 2023-10-18T20:58:50.502 INFO:tasks.workunit.client.0.smithi008.stdout:2/927: read - d1/d3/dd/ff2 zero size 2023-10-18T20:58:50.503 INFO:tasks.workunit.client.0.smithi008.stdout:5/856: truncate d0/d2/d9/f44 903150 0 2023-10-18T20:58:50.503 INFO:tasks.workunit.client.0.smithi008.stdout:5/857: fsync d0/d2/d19/d7c/f6b 0 2023-10-18T20:58:50.504 INFO:tasks.workunit.client.0.smithi008.stdout:0/836: mknod d0/dd/d19/d5f/d99/d5e/d7d/db7/c10d 0 2023-10-18T20:58:50.506 INFO:tasks.workunit.client.0.smithi008.stdout:0/837: creat d0/d7c/d9a/d8a/d8f/d21/df7/d61/f10e x:0 0 0 2023-10-18T20:58:50.512 INFO:tasks.workunit.client.0.smithi008.stdout:2/928: link d1/d3/f1b d1/d3/dd/d25/db2/d11c/f12e 0 2023-10-18T20:58:50.518 INFO:tasks.workunit.client.0.smithi008.stdout:7/869: dread d1/d36/d3d/d3e/fb0 [0,4194304] 0 2023-10-18T20:58:50.518 INFO:tasks.workunit.client.0.smithi008.stdout:7/870: truncate d1/d36/d3d/d3e/d59/d73/fc2 437581 0 2023-10-18T20:58:50.533 INFO:tasks.workunit.client.0.smithi008.stdout:2/929: dread d1/d3/dd/d25/db2/d11c/f12e [0,4194304] 0 2023-10-18T20:58:50.534 INFO:tasks.workunit.client.0.smithi008.stdout:7/871: rename d1/da6/d79/db5 to d1/d36/d3d/d3e/d59/d73/d7b/daf/d111 0 2023-10-18T20:58:50.535 INFO:tasks.workunit.client.0.smithi008.stdout:2/930: getdents d1/d3/d40/d6e/d7e 0 2023-10-18T20:58:50.537 INFO:tasks.workunit.client.0.smithi008.stdout:7/872: truncate d1/d36/d3d/d3e/d59/d73/f110 2116185 0 2023-10-18T20:58:50.537 INFO:tasks.workunit.client.0.smithi008.stdout:7/873: dread - d1/d36/d3d/d3e/d59/d73/d7b/daf/d111/fb6 zero size 2023-10-18T20:58:50.545 INFO:tasks.workunit.client.0.smithi008.stdout:2/931: dread d1/d3/dd/d25/db2/d11c/f12e [0,4194304] 0 2023-10-18T20:58:50.551 INFO:tasks.workunit.client.0.smithi008.stdout:7/874: dread d1/d36/d3d/d3e/fb0 [0,4194304] 0 2023-10-18T20:58:50.552 INFO:tasks.workunit.client.0.smithi008.stdout:7/875: chown d1/d36/d3d/da3/de8/d5f/d78/ce3 6441 1 2023-10-18T20:58:50.552 INFO:tasks.workunit.client.0.smithi008.stdout:7/876: creat d1/d36/d3d/da3/de8/f112 x:0 0 0 2023-10-18T20:58:50.552 INFO:tasks.workunit.client.0.smithi008.stdout:7/877: stat d1/da6/f77 0 2023-10-18T20:58:50.554 INFO:tasks.workunit.client.0.smithi008.stdout:7/878: creat d1/f113 x:0 0 0 2023-10-18T20:58:50.555 INFO:tasks.workunit.client.0.smithi008.stdout:7/879: chown d1/da6/l44 727390064 1 2023-10-18T20:58:50.556 INFO:tasks.workunit.client.0.smithi008.stdout:7/880: creat d1/d36/d3d/da3/de8/d5f/dba/ded/f114 x:0 0 0 2023-10-18T20:58:50.559 INFO:tasks.workunit.client.0.smithi008.stdout:0/838: dwrite d0/dd/d19/d5f/d99/d94/f9d [0,4194304] 0 2023-10-18T20:58:50.559 INFO:tasks.workunit.client.0.smithi008.stdout:0/839: dread - d0/dd/df/fc2 zero size 2023-10-18T20:58:50.560 INFO:tasks.workunit.client.0.smithi008.stdout:0/840: creat d0/d7c/d9a/d8a/d8f/f10f x:0 0 0 2023-10-18T20:58:50.560 INFO:tasks.workunit.client.0.smithi008.stdout:0/841: chown d0/d7c/d9a/d8a/d8f/d21/d85/cbc 44 1 2023-10-18T20:58:50.560 INFO:tasks.workunit.client.0.smithi008.stdout:7/881: mkdir d1/d36/d3d/d115 0 2023-10-18T20:58:50.561 INFO:tasks.workunit.client.0.smithi008.stdout:2/932: dread d1/d3/d40/d6e/f78 [0,4194304] 0 2023-10-18T20:58:50.561 INFO:tasks.workunit.client.0.smithi008.stdout:2/933: fsync d1/d3/d79/f128 0 2023-10-18T20:58:50.574 INFO:tasks.workunit.client.0.smithi008.stdout:2/934: dread d1/d3/dd/d25/d76/d59/fc4 [0,4194304] 0 2023-10-18T20:58:50.575 INFO:tasks.workunit.client.0.smithi008.stdout:2/935: write d1/d3/d40/d6e/d7e/db3/f10e [891393,80107] 0 2023-10-18T20:58:50.575 INFO:tasks.workunit.client.0.smithi008.stdout:2/936: chown d1/c37 525361 1 2023-10-18T20:58:50.575 INFO:tasks.workunit.client.0.smithi008.stdout:2/937: chown d1/d3/dd/le 24385 1 2023-10-18T20:58:50.575 INFO:tasks.workunit.client.0.smithi008.stdout:2/938: fsync d1/d3/dd/d25/f125 0 2023-10-18T20:58:50.580 INFO:tasks.workunit.client.0.smithi008.stdout:7/882: rename d1/d36/d3d/da3 to d1/d36/d3d/d3e/d59/d116 0 2023-10-18T20:58:50.582 INFO:tasks.workunit.client.0.smithi008.stdout:2/939: rename d1/d3/dd/d25/d4d/c7f to d1/d3/dd/d25/db2/c12f 0 2023-10-18T20:58:50.582 INFO:tasks.workunit.client.0.smithi008.stdout:2/940: dread - d1/d3/dd/d25/d76/d59/d85/db9/fc3 zero size 2023-10-18T20:58:50.582 INFO:tasks.workunit.client.0.smithi008.stdout:2/941: chown d1/d3/dd/d25/f107 1682 1 2023-10-18T20:58:50.591 INFO:tasks.workunit.client.0.smithi008.stdout:7/883: dread d1/da6/d4f/dc9/fd8 [0,4194304] 0 2023-10-18T20:58:50.594 INFO:tasks.workunit.client.0.smithi008.stdout:7/884: rename d1/da6/d4f/f51 to d1/d36/d3d/d3e/d59/d116/de8/d5f/d7f/d10a/f117 0 2023-10-18T20:58:50.596 INFO:tasks.workunit.client.0.smithi008.stdout:7/885: link d1/d36/d3d/d3e/d59/d73/d7b/daf/d111/le4 d1/d36/d3d/d3e/d59/d116/l118 0 2023-10-18T20:58:50.602 INFO:tasks.workunit.client.0.smithi008.stdout:7/886: dread d1/da6/d4f/dc9/fd8 [0,4194304] 0 2023-10-18T20:58:50.603 INFO:tasks.workunit.client.0.smithi008.stdout:7/887: write d1/da6/d4f/fa8 [5803,74009] 0 2023-10-18T20:58:50.605 INFO:tasks.workunit.client.0.smithi008.stdout:7/888: mkdir d1/d36/d3d/d3e/d59/d116/de8/dbe/df2/d119 0 2023-10-18T20:58:50.605 INFO:tasks.workunit.client.0.smithi008.stdout:7/889: fsync d1/d3/f6b 0 2023-10-18T20:58:50.614 INFO:tasks.workunit.client.0.smithi008.stdout:7/890: dread d1/d36/d3d/f5a [0,4194304] 0 2023-10-18T20:58:50.615 INFO:tasks.workunit.client.0.smithi008.stdout:9/792: sync 2023-10-18T20:58:50.615 INFO:tasks.workunit.client.0.smithi008.stdout:4/842: sync 2023-10-18T20:58:50.617 INFO:tasks.workunit.client.0.smithi008.stdout:7/891: getdents d1/d36/d3d/d3e/d59/d116/de8/d5f/d7f 0 2023-10-18T20:58:50.617 INFO:tasks.workunit.client.0.smithi008.stdout:7/892: readlink d1/d36/d3d/d3e/d59/d116/de8/d54/l10e 0 2023-10-18T20:58:50.624 INFO:tasks.workunit.client.0.smithi008.stdout:4/843: link d0/d3/d21/fa2 d0/d3/d21/d57/d8f/d95/f122 0 2023-10-18T20:58:50.624 INFO:tasks.workunit.client.0.smithi008.stdout:4/844: stat d0/d3/d21/d42/lbc 0 2023-10-18T20:58:50.624 INFO:tasks.workunit.client.0.smithi008.stdout:4/845: truncate d0/d58/d8e/f6d 5606817 0 2023-10-18T20:58:50.625 INFO:tasks.workunit.client.0.smithi008.stdout:9/793: dread d2/dc/d3d/f70 [0,4194304] 0 2023-10-18T20:58:50.626 INFO:tasks.workunit.client.0.smithi008.stdout:9/794: truncate d2/d8/db1/dd3/d59/fa9 25755 0 2023-10-18T20:58:50.628 INFO:tasks.workunit.client.0.smithi008.stdout:9/795: mknod d2/dc/d40/d46/ddc/d90/ced 0 2023-10-18T20:58:50.628 INFO:tasks.workunit.client.0.smithi008.stdout:9/796: chown d2/dc/d17 372013101 1 2023-10-18T20:58:50.629 INFO:tasks.workunit.client.0.smithi008.stdout:9/797: mkdir d2/dc/d40/dbc/dc9/dee 0 2023-10-18T20:58:50.635 INFO:tasks.workunit.client.0.smithi008.stdout:4/846: rmdir d0/d3 39 2023-10-18T20:58:50.637 INFO:tasks.workunit.client.0.smithi008.stdout:4/847: mknod d0/d58/d8e/dd2/c123 0 2023-10-18T20:58:50.638 INFO:tasks.workunit.client.0.smithi008.stdout:4/848: write d0/f13 [190535,129987] 0 2023-10-18T20:58:50.638 INFO:tasks.workunit.client.0.smithi008.stdout:4/849: write d0/d58/d8e/dd2/f113 [1680111,17379] 0 2023-10-18T20:58:50.638 INFO:tasks.workunit.client.0.smithi008.stdout:4/850: stat d0/d17/d5b/f5f 0 2023-10-18T20:58:50.639 INFO:tasks.workunit.client.0.smithi008.stdout:4/851: mknod d0/d58/d8e/db4/c124 0 2023-10-18T20:58:50.642 INFO:tasks.workunit.client.0.smithi008.stdout:7/893: dread d1/d36/d3d/d3e/d59/d116/de8/d5f/f72 [4194304,4194304] 0 2023-10-18T20:58:50.642 INFO:tasks.workunit.client.0.smithi008.stdout:2/942: dwrite d1/d3/dd/f50 [0,4194304] 0 2023-10-18T20:58:50.644 INFO:tasks.workunit.client.0.smithi008.stdout:7/894: link d1/d36/d3d/d3e/d59/d116/de8/d5f/dba/ddd/cf1 d1/d36/d3d/d3e/d59/d116/de8/d103/c11a 0 2023-10-18T20:58:50.652 INFO:tasks.workunit.client.0.smithi008.stdout:1/977: sync 2023-10-18T20:58:50.652 INFO:tasks.workunit.client.0.smithi008.stdout:1/978: stat d9/de/df/d17/d55/da8/fd0 0 2023-10-18T20:58:50.653 INFO:tasks.workunit.client.0.smithi008.stdout:1/979: chown d9/de/df/d17/d1e/f71 36423 1 2023-10-18T20:58:50.655 INFO:tasks.workunit.client.0.smithi008.stdout:7/895: rename d1/d36/d3d/d3e/d59/d116/de8/d54/cce to d1/d36/d3d/d3e/d59/d116/de8/d5f/d7f/c11b 0 2023-10-18T20:58:50.655 INFO:tasks.workunit.client.0.smithi008.stdout:7/896: fsync d1/d3/f17 0 2023-10-18T20:58:50.656 INFO:tasks.workunit.client.0.smithi008.stdout:7/897: stat d1/da6/d4f/d87/cef 0 2023-10-18T20:58:50.656 INFO:tasks.workunit.client.0.smithi008.stdout:7/898: readlink d1/d36/la0 0 2023-10-18T20:58:50.656 INFO:tasks.workunit.client.0.smithi008.stdout:4/852: dread d0/d17/d5b/d45/f92 [0,4194304] 0 2023-10-18T20:58:50.663 INFO:tasks.workunit.client.0.smithi008.stdout:7/899: unlink d1/da6/d4f/d5c/c68 0 2023-10-18T20:58:50.672 INFO:tasks.workunit.client.0.smithi008.stdout:4/853: dread d0/d3/f41 [0,4194304] 0 2023-10-18T20:58:50.673 INFO:tasks.workunit.client.0.smithi008.stdout:4/854: creat d0/d3/d21/d42/f125 x:0 0 0 2023-10-18T20:58:50.675 INFO:tasks.workunit.client.0.smithi008.stdout:4/855: symlink d0/d3/d21/d57/d8f/l126 0 2023-10-18T20:58:50.675 INFO:tasks.workunit.client.0.smithi008.stdout:4/856: chown d0/d3/d21/fa2 303 1 2023-10-18T20:58:50.678 INFO:tasks.workunit.client.0.smithi008.stdout:9/798: dwrite d2/dc/d17/f76 [0,4194304] 0 2023-10-18T20:58:50.679 INFO:tasks.workunit.client.0.smithi008.stdout:9/799: fsync d2/f1b 0 2023-10-18T20:58:50.681 INFO:tasks.workunit.client.0.smithi008.stdout:9/800: getdents d2/dc/d40/d6f 0 2023-10-18T20:58:50.687 INFO:tasks.workunit.client.0.smithi008.stdout:9/801: rename d2/dc/d3d/d99/da4/ddb to d2/dc/d40/d56/def 0 2023-10-18T20:58:50.693 INFO:tasks.workunit.client.0.smithi008.stdout:9/802: link d2/d8/da0/fb0 d2/dc/ff0 0 2023-10-18T20:58:50.695 INFO:tasks.workunit.client.0.smithi008.stdout:9/803: getdents d2/dc/d1a/d1d/da7 0 2023-10-18T20:58:50.695 INFO:tasks.workunit.client.0.smithi008.stdout:9/804: stat d2/dc/f6d 0 2023-10-18T20:58:50.697 INFO:tasks.workunit.client.0.smithi008.stdout:9/805: stat d2/dc/d17/d7b/cc3 0 2023-10-18T20:58:50.699 INFO:tasks.workunit.client.0.smithi008.stdout:9/806: read d2/dc/d17/d19/d4a/f81 [992635,53769] 0 2023-10-18T20:58:50.699 INFO:tasks.workunit.client.0.smithi008.stdout:9/807: creat d2/dc/d40/ff1 x:0 0 0 2023-10-18T20:58:50.700 INFO:tasks.workunit.client.0.smithi008.stdout:9/808: readlink d2/dc/d3d/l47 0 2023-10-18T20:58:50.703 INFO:tasks.workunit.client.0.smithi008.stdout:9/809: creat d2/d4d/dc2/ff2 x:0 0 0 2023-10-18T20:58:50.703 INFO:tasks.workunit.client.0.smithi008.stdout:9/810: getdents d2/dc/d40/d56/def 0 2023-10-18T20:58:50.708 INFO:tasks.workunit.client.0.smithi008.stdout:9/811: link d2/dc/d17/f77 d2/d4d/dc2/ff3 0 2023-10-18T20:58:50.710 INFO:tasks.workunit.client.0.smithi008.stdout:1/980: dwrite d9/de/df/d17/d1e/f4a [0,4194304] 0 2023-10-18T20:58:50.714 INFO:tasks.workunit.client.0.smithi008.stdout:1/981: symlink d9/de/d10b/l137 0 2023-10-18T20:58:50.717 INFO:tasks.workunit.client.0.smithi008.stdout:9/812: rename d2/dc/d40/d5a/c6c to d2/dc/d17/d19/d4a/cf4 0 2023-10-18T20:58:50.717 INFO:tasks.workunit.client.0.smithi008.stdout:9/813: chown d2/dc/d40/d5a/lc4 241061941 1 2023-10-18T20:58:50.721 INFO:tasks.workunit.client.0.smithi008.stdout:1/982: dread d9/de/df/d17/d1e/d9a/fbf [0,4194304] 0 2023-10-18T20:58:50.722 INFO:tasks.workunit.client.0.smithi008.stdout:4/857: dread d0/d3/d21/fa2 [0,4194304] 0 2023-10-18T20:58:50.723 INFO:tasks.workunit.client.0.smithi008.stdout:2/943: dwrite d1/d3/dd/d25/db2/d11c/ff7 [0,4194304] 0 2023-10-18T20:58:50.724 INFO:tasks.workunit.client.0.smithi008.stdout:1/983: rmdir d9/de/df/d17 39 2023-10-18T20:58:50.726 INFO:tasks.workunit.client.0.smithi008.stdout:2/944: truncate d1/d3/dd/d25/d76/d59/f97 1172119 0 2023-10-18T20:58:50.726 INFO:tasks.workunit.client.0.smithi008.stdout:2/945: readlink d1/d3/dd/d25/d76/d59/d85/lae 0 2023-10-18T20:58:50.726 INFO:tasks.workunit.client.0.smithi008.stdout:2/946: truncate d1/d3/dd/d25/d76/d59/d85/db9/fc3 693521 0 2023-10-18T20:58:50.728 INFO:tasks.workunit.client.0.smithi008.stdout:4/858: link d0/d3/f67 d0/d58/dbf/f127 0 2023-10-18T20:58:50.728 INFO:tasks.workunit.client.0.smithi008.stdout:7/900: dwrite d1/da6/d79/f71 [0,4194304] 0 2023-10-18T20:58:50.728 INFO:tasks.workunit.client.0.smithi008.stdout:7/901: truncate d1/d36/d3d/dc3/fe1 1037492 0 2023-10-18T20:58:50.729 INFO:tasks.workunit.client.0.smithi008.stdout:7/902: chown d1/d36/c7c 585801538 1 2023-10-18T20:58:50.729 INFO:tasks.workunit.client.0.smithi008.stdout:2/947: mknod d1/d3/dd/d25/d76/d59/d103/c130 0 2023-10-18T20:58:50.731 INFO:tasks.workunit.client.0.smithi008.stdout:9/814: write d2/dc/f4c [2162930,26503] 0 2023-10-18T20:58:50.735 INFO:tasks.workunit.client.0.smithi008.stdout:2/948: rmdir d1/d3/dd/d25/d76/d59/d11e 0 2023-10-18T20:58:50.735 INFO:tasks.workunit.client.0.smithi008.stdout:2/949: chown d1/d3/dd/d25/d76/d59/d85/ffe 107115 1 2023-10-18T20:58:50.736 INFO:tasks.workunit.client.0.smithi008.stdout:2/950: truncate d1/d3/d40/de0/feb 992924 0 2023-10-18T20:58:50.736 INFO:tasks.workunit.client.0.smithi008.stdout:2/951: write d1/d3/d40/d6e/d7e/db3/d104/f11b [625145,74414] 0 2023-10-18T20:58:50.745 INFO:tasks.workunit.client.0.smithi008.stdout:9/815: rmdir d2/dc/d40/d46/ddc 39 2023-10-18T20:58:50.748 INFO:tasks.workunit.client.0.smithi008.stdout:2/952: link d1/d3/dd/d1c/f3e d1/d3/d40/d6e/d7e/f131 0 2023-10-18T20:58:50.752 INFO:tasks.workunit.client.0.smithi008.stdout:4/859: write d0/d17/f6a [843634,24391] 0 2023-10-18T20:58:50.753 INFO:tasks.workunit.client.0.smithi008.stdout:5/858: sync 2023-10-18T20:58:50.755 INFO:tasks.workunit.client.0.smithi008.stdout:4/860: symlink d0/d3/d21/d57/d11e/l128 0 2023-10-18T20:58:50.756 INFO:tasks.workunit.client.0.smithi008.stdout:4/861: write d0/d17/f11c [818904,71506] 0 2023-10-18T20:58:50.757 INFO:tasks.workunit.client.0.smithi008.stdout:4/862: creat d0/d17/d5b/d99/f129 x:0 0 0 2023-10-18T20:58:50.758 INFO:tasks.workunit.client.0.smithi008.stdout:9/816: dread d2/f5 [0,4194304] 0 2023-10-18T20:58:50.758 INFO:tasks.workunit.client.0.smithi008.stdout:9/817: truncate d2/dc/d1a/f54 6062370 0 2023-10-18T20:58:50.759 INFO:tasks.workunit.client.0.smithi008.stdout:9/818: chown d2/dc/d40/d5a 44 1 2023-10-18T20:58:50.759 INFO:tasks.workunit.client.0.smithi008.stdout:5/859: rmdir d0/d2/d9/d34/dfb/d126 0 2023-10-18T20:58:50.760 INFO:tasks.workunit.client.0.smithi008.stdout:1/984: dwrite d9/de/df/d17/d1e/d9a/f133 [0,4194304] 0 2023-10-18T20:58:50.768 INFO:tasks.workunit.client.0.smithi008.stdout:2/953: dread d1/d3/d40/f62 [0,4194304] 0 2023-10-18T20:58:50.769 INFO:tasks.workunit.client.0.smithi008.stdout:2/954: readlink d1/l4 0 2023-10-18T20:58:50.769 INFO:tasks.workunit.client.0.smithi008.stdout:5/860: getdents d0/d2/d19/d7c/d58/d65/d68 0 2023-10-18T20:58:50.769 INFO:tasks.workunit.client.0.smithi008.stdout:1/985: rename d9/de/df/d17/d25/dc1/cfb to d9/de/df/d85/dd3/c138 0 2023-10-18T20:58:50.770 INFO:tasks.workunit.client.0.smithi008.stdout:1/986: creat d9/de/df/d17/d1e/d7d/d89/f139 x:0 0 0 2023-10-18T20:58:50.770 INFO:tasks.workunit.client.0.smithi008.stdout:5/861: symlink d0/da9/dda/de1/l138 0 2023-10-18T20:58:50.776 INFO:tasks.workunit.client.0.smithi008.stdout:5/862: rmdir d0/d2/d19/d7c/d31/d80 39 2023-10-18T20:58:50.776 INFO:tasks.workunit.client.0.smithi008.stdout:5/863: chown d0/d2/d9/f44 10 1 2023-10-18T20:58:50.783 INFO:tasks.workunit.client.0.smithi008.stdout:1/987: dread d9/de/df/d17/d25/f32 [0,4194304] 0 2023-10-18T20:58:50.788 INFO:tasks.workunit.client.0.smithi008.stdout:1/988: rmdir d9/de/df/d17/d25/d94 39 2023-10-18T20:58:50.790 INFO:tasks.workunit.client.0.smithi008.stdout:1/989: symlink d9/de/df/d17/d1e/d3c/l13a 0 2023-10-18T20:58:50.790 INFO:tasks.workunit.client.0.smithi008.stdout:1/990: chown d9/de/df/d17/d1e/d9a/c107 745 1 2023-10-18T20:58:50.791 INFO:tasks.workunit.client.0.smithi008.stdout:1/991: write d9/de/df/d17/d1e/d7d/fca [1070989,79733] 0 2023-10-18T20:58:50.791 INFO:tasks.workunit.client.0.smithi008.stdout:1/992: read d9/de/df/d17/d1e/d3c/f6f [2552706,1358] 0 2023-10-18T20:58:50.810 INFO:tasks.workunit.client.0.smithi008.stdout:1/993: dread d9/de/df/f56 [0,4194304] 0 2023-10-18T20:58:50.811 INFO:tasks.workunit.client.0.smithi008.stdout:1/994: dread - d9/de/df/d17/d1e/d7d/d89/dec/f125 zero size 2023-10-18T20:58:50.811 INFO:tasks.workunit.client.0.smithi008.stdout:1/995: dread - d9/de/df/d17/d55/da8/f115 zero size 2023-10-18T20:58:50.812 INFO:tasks.workunit.client.0.smithi008.stdout:1/996: truncate d9/de/df/d17/d25/f11f 108490 0 2023-10-18T20:58:50.814 INFO:tasks.workunit.client.0.smithi008.stdout:1/997: symlink d9/de/df/d17/d25/d57/l13b 0 2023-10-18T20:58:50.814 INFO:tasks.workunit.client.0.smithi008.stdout:1/998: stat d9/de/df/d17/d1e/d7d/d89/dec/f125 0 2023-10-18T20:58:50.814 INFO:tasks.workunit.client.0.smithi008.stdout:7/903: dwrite d1/d36/f4c [0,4194304] 0 2023-10-18T20:58:50.823 INFO:tasks.workunit.client.0.smithi008.stdout:5/864: dwrite d0/d2/d19/d7c/d58/d65/fd5 [0,4194304] 0 2023-10-18T20:58:50.823 INFO:tasks.workunit.client.0.smithi008.stdout:5/865: chown d0/d127/c110 0 1 2023-10-18T20:58:50.824 INFO:tasks.workunit.client.0.smithi008.stdout:1/999: mknod d9/de/df/d17/d25/d94/da7/c13c 0 2023-10-18T20:58:50.825 INFO:tasks.workunit.client.0.smithi008.stdout:7/904: creat d1/d3/d8b/da5/f11c x:0 0 0 2023-10-18T20:58:50.826 INFO:tasks.workunit.client.0.smithi008.stdout:7/905: stat d1/da6/d79/f4a 0 2023-10-18T20:58:50.828 INFO:tasks.workunit.client.0.smithi008.stdout:5/866: creat d0/d2/d9/d9b/d12e/d70/dc0/ddb/f139 x:0 0 0 2023-10-18T20:58:50.828 INFO:tasks.workunit.client.0.smithi008.stdout:5/867: readlink d0/d2/d9/d9b/l85 0 2023-10-18T20:58:50.828 INFO:tasks.workunit.client.0.smithi008.stdout:5/868: fdatasync d0/d2/d9/d9b/d12e/d70/dc0/ddb/f139 0 2023-10-18T20:58:50.828 INFO:tasks.workunit.client.0.smithi008.stdout:5/869: chown d0/de/c61 2225 1 2023-10-18T20:58:50.835 INFO:tasks.workunit.client.0.smithi008.stdout:2/955: write d1/d3/dd/f71 [861131,113958] 0 2023-10-18T20:58:50.835 INFO:tasks.workunit.client.0.smithi008.stdout:7/906: symlink d1/da6/d4f/d87/l11d 0 2023-10-18T20:58:50.836 INFO:tasks.workunit.client.0.smithi008.stdout:5/870: symlink d0/d2/d9/d9b/de7/l13a 0 2023-10-18T20:58:50.837 INFO:tasks.workunit.client.0.smithi008.stdout:2/956: chown d1/d3/dd/d25/d76/d59/d85/dba 12 1 2023-10-18T20:58:50.837 INFO:tasks.workunit.client.0.smithi008.stdout:7/907: dread - d1/d36/d3d/fb7 zero size 2023-10-18T20:58:50.839 INFO:tasks.workunit.client.0.smithi008.stdout:9/819: dwrite d2/dc/d40/ff1 [0,4194304] 0 2023-10-18T20:58:50.839 INFO:tasks.workunit.client.0.smithi008.stdout:9/820: chown d2/dc/d40/d46/c74 380 1 2023-10-18T20:58:50.840 INFO:tasks.workunit.client.0.smithi008.stdout:0/842: sync 2023-10-18T20:58:50.840 INFO:tasks.workunit.client.0.smithi008.stdout:7/908: creat d1/d36/d3d/d3e/d59/d116/de8/d5f/d7f/d10a/f11e x:0 0 0 2023-10-18T20:58:50.841 INFO:tasks.workunit.client.0.smithi008.stdout:5/871: mkdir d0/d2/d19/d7c/da7/d114/d13b 0 2023-10-18T20:58:50.842 INFO:tasks.workunit.client.0.smithi008.stdout:7/909: truncate d1/da6/d4f/f6e 3020112 0 2023-10-18T20:58:50.843 INFO:tasks.workunit.client.0.smithi008.stdout:7/910: stat d1/d3/c2c 0 2023-10-18T20:58:50.844 INFO:tasks.workunit.client.0.smithi008.stdout:5/872: truncate d0/d2/d19/d7c/f95 825453 0 2023-10-18T20:58:50.846 INFO:tasks.workunit.client.0.smithi008.stdout:7/911: creat d1/d36/d3d/d3e/d59/d116/de8/dbe/f11f x:0 0 0 2023-10-18T20:58:50.865 INFO:tasks.workunit.client.0.smithi008.stdout:5/873: write d0/d2/d9/d9b/d12e/d70/fa8 [252694,10227] 0 2023-10-18T20:58:50.886 INFO:tasks.workunit.client.0.smithi008.stdout:0/843: dwrite d0/dd/d19/d5f/d99/d94/fee [0,4194304] 0 2023-10-18T20:58:50.887 INFO:tasks.workunit.client.0.smithi008.stdout:0/844: chown d0/d7c/d9a/dce/f100 117 1 2023-10-18T20:58:50.900 INFO:tasks.workunit.client.0.smithi008.stdout:0/845: write d0/f14 [3991139,15600] 0 2023-10-18T20:58:50.912 INFO:tasks.workunit.client.0.smithi008.stdout:5/874: dread d0/fbc [0,4194304] 0 2023-10-18T20:58:50.912 INFO:tasks.workunit.client.0.smithi008.stdout:5/875: dread - d0/d2/d19/d7c/d31/f55 zero size 2023-10-18T20:58:50.913 INFO:tasks.workunit.client.0.smithi008.stdout:2/957: dwrite d1/d3/dd/d1c/f100 [0,4194304] 0 2023-10-18T20:58:50.916 INFO:tasks.workunit.client.0.smithi008.stdout:9/821: dwrite d2/dc/d17/d19/d4a/fb3 [0,4194304] 0 2023-10-18T20:58:50.925 INFO:tasks.workunit.client.0.smithi008.stdout:2/958: mknod d1/d3/dd/d1c/d3a/d45/d83/c132 0 2023-10-18T20:58:50.938 INFO:tasks.workunit.client.0.smithi008.stdout:2/959: rename d1/d3/d40/de0 to d1/d3/d133 0 2023-10-18T20:58:50.939 INFO:tasks.workunit.client.0.smithi008.stdout:2/960: chown d1/d3/dd/d1c/ccc 2020 1 2023-10-18T20:58:50.943 INFO:tasks.workunit.client.0.smithi008.stdout:2/961: creat d1/d3/dd/d25/d76/d59/d85/d110/f134 x:0 0 0 2023-10-18T20:58:50.944 INFO:tasks.workunit.client.0.smithi008.stdout:2/962: creat d1/d3/d40/d6e/d7e/db3/f135 x:0 0 0 2023-10-18T20:58:50.945 INFO:tasks.workunit.client.0.smithi008.stdout:0/846: dwrite d0/dd/d19/d24/f3d [4194304,4194304] 0 2023-10-18T20:58:50.947 INFO:tasks.workunit.client.0.smithi008.stdout:2/963: unlink d1/d3/dd/d1c/d3a/d49/c8e 0 2023-10-18T20:58:50.947 INFO:tasks.workunit.client.0.smithi008.stdout:2/964: stat d1/d3/dd/d1c/d3a/ca9 0 2023-10-18T20:58:50.950 INFO:tasks.workunit.client.0.smithi008.stdout:0/847: mknod d0/d7c/d9a/d8a/d8f/d21/c110 0 2023-10-18T20:58:50.954 INFO:tasks.workunit.client.0.smithi008.stdout:2/965: symlink d1/d3/dd/d25/d76/l136 0 2023-10-18T20:58:50.955 INFO:tasks.workunit.client.0.smithi008.stdout:2/966: stat d1/d3/dd/d1c/dc7 0 2023-10-18T20:58:50.958 INFO:tasks.workunit.client.0.smithi008.stdout:0/848: creat d0/d7c/d9a/f111 x:0 0 0 2023-10-18T20:58:50.958 INFO:tasks.workunit.client.0.smithi008.stdout:0/849: stat d0/c34 0 2023-10-18T20:58:50.959 INFO:tasks.workunit.client.0.smithi008.stdout:0/850: truncate d0/dd/df/f1c 4484803 0 2023-10-18T20:58:50.959 INFO:tasks.workunit.client.0.smithi008.stdout:0/851: fsync d0/d7c/d9a/d8a/d8f/d21/df7/d61/f102 0 2023-10-18T20:58:50.961 INFO:tasks.workunit.client.0.smithi008.stdout:0/852: symlink d0/d7c/d9a/d8a/d8f/d21/df7/l112 0 2023-10-18T20:58:50.961 INFO:tasks.workunit.client.0.smithi008.stdout:0/853: chown d0/dd/d19/d24/f98 79 1 2023-10-18T20:58:50.969 INFO:tasks.workunit.client.0.smithi008.stdout:5/876: dwrite d0/d2/d19/d7c/d42/f4e [4194304,4194304] 0 2023-10-18T20:58:50.969 INFO:tasks.workunit.client.0.smithi008.stdout:5/877: truncate d0/d2/d9/d9b/d62/fac 311718 0 2023-10-18T20:58:50.970 INFO:tasks.workunit.client.0.smithi008.stdout:5/878: fdatasync d0/d2/f23 0 2023-10-18T20:58:50.976 INFO:tasks.workunit.client.0.smithi008.stdout:0/854: dread d0/dd/d19/d24/fdf [0,4194304] 0 2023-10-18T20:58:50.977 INFO:tasks.workunit.client.0.smithi008.stdout:0/855: creat d0/d7c/df0/f113 x:0 0 0 2023-10-18T20:58:50.995 INFO:tasks.workunit.client.0.smithi008.stdout:4/863: sync 2023-10-18T20:58:50.995 INFO:tasks.workunit.client.0.smithi008.stdout:2/967: dwrite d1/d3/fd3 [0,4194304] 0 2023-10-18T20:58:50.998 INFO:tasks.workunit.client.0.smithi008.stdout:4/864: creat d0/d76/f12a x:0 0 0 2023-10-18T20:58:50.998 INFO:tasks.workunit.client.0.smithi008.stdout:4/865: readlink d0/d17/d5b/d45/l69 0 2023-10-18T20:58:50.999 INFO:tasks.workunit.client.0.smithi008.stdout:2/968: write d1/d3/dd/d25/d5c/f60 [279166,53189] 0 2023-10-18T20:58:50.999 INFO:tasks.workunit.client.0.smithi008.stdout:4/866: mkdir d0/d12b 0 2023-10-18T20:58:51.001 INFO:tasks.workunit.client.0.smithi008.stdout:4/867: mkdir d0/d12c 0 2023-10-18T20:58:51.009 INFO:tasks.workunit.client.0.smithi008.stdout:2/969: dread d1/d3/d79/fd5 [0,4194304] 0 2023-10-18T20:58:51.011 INFO:tasks.workunit.client.0.smithi008.stdout:2/970: mknod d1/d3/dd/d1c/d3a/d45/de1/c137 0 2023-10-18T20:58:51.011 INFO:tasks.workunit.client.0.smithi008.stdout:2/971: readlink d1/d3/dd/d1c/l7c 0 2023-10-18T20:58:51.013 INFO:tasks.workunit.client.0.smithi008.stdout:2/972: creat d1/d3/d40/d6e/d7e/f138 x:0 0 0 2023-10-18T20:58:51.015 INFO:tasks.workunit.client.0.smithi008.stdout:2/973: symlink d1/d3/d40/l139 0 2023-10-18T20:58:51.030 INFO:tasks.workunit.client.0.smithi008.stdout:5/879: dwrite d0/d2/d9/d9b/d12e/d70/dc0/fd8 [0,4194304] 0 2023-10-18T20:58:51.031 INFO:tasks.workunit.client.0.smithi008.stdout:5/880: write d0/d2/d9/d9b/d12e/d70/f8b [4137348,127141] 0 2023-10-18T20:58:51.037 INFO:tasks.workunit.client.0.smithi008.stdout:2/974: dread d1/d3/d40/d6e/d7e/db3/f10e [0,4194304] 0 2023-10-18T20:58:51.038 INFO:tasks.workunit.client.0.smithi008.stdout:2/975: symlink d1/d3/dd/d1c/l13a 0 2023-10-18T20:58:51.040 INFO:tasks.workunit.client.0.smithi008.stdout:2/976: mknod d1/d3/dd/d25/d76/d59/d85/c13b 0 2023-10-18T20:58:51.044 INFO:tasks.workunit.client.0.smithi008.stdout:4/868: dwrite d0/d3/d21/f5a [0,4194304] 0 2023-10-18T20:58:51.049 INFO:tasks.workunit.client.0.smithi008.stdout:5/881: dread d0/ff7 [0,4194304] 0 2023-10-18T20:58:51.051 INFO:tasks.workunit.client.0.smithi008.stdout:5/882: rmdir d0/d2/d19/d7c/d58/d65 39 2023-10-18T20:58:51.058 INFO:tasks.workunit.client.0.smithi008.stdout:2/977: dread d1/d3/dd/d1c/f100 [0,4194304] 0 2023-10-18T20:58:51.062 INFO:tasks.workunit.client.0.smithi008.stdout:9/822: sync 2023-10-18T20:58:51.062 INFO:tasks.workunit.client.0.smithi008.stdout:7/912: sync 2023-10-18T20:58:51.062 INFO:tasks.workunit.client.0.smithi008.stdout:0/856: sync 2023-10-18T20:58:51.062 INFO:tasks.workunit.client.0.smithi008.stdout:9/823: write d2/dc/d1a/fb7 [242834,104243] 0 2023-10-18T20:58:51.063 INFO:tasks.workunit.client.0.smithi008.stdout:2/978: mkdir d1/d3/dd/d25/d76/d59/d13c 0 2023-10-18T20:58:51.063 INFO:tasks.workunit.client.0.smithi008.stdout:0/857: mknod d0/dd/d19/d5f/c114 0 2023-10-18T20:58:51.071 INFO:tasks.workunit.client.0.smithi008.stdout:5/883: dread d0/d6e/f97 [0,4194304] 0 2023-10-18T20:58:51.073 INFO:tasks.workunit.client.0.smithi008.stdout:5/884: mknod d0/d2/d19/d7c/d31/d8d/dd1/c13c 0 2023-10-18T20:58:51.073 INFO:tasks.workunit.client.0.smithi008.stdout:5/885: fsync d0/d6e/f7d 0 2023-10-18T20:58:51.075 INFO:tasks.workunit.client.0.smithi008.stdout:5/886: getdents d0/d2/d19/d7c/d31/d8d 0 2023-10-18T20:58:51.097 INFO:tasks.workunit.client.0.smithi008.stdout:4/869: dwrite d0/d3/d21/d57/d8f/f72 [0,4194304] 0 2023-10-18T20:58:51.097 INFO:tasks.workunit.client.0.smithi008.stdout:4/870: fdatasync d0/d3/d21/d57/d8f/fdc 0 2023-10-18T20:58:51.097 INFO:tasks.workunit.client.0.smithi008.stdout:4/871: write d0/d58/dc7/fef [834341,27605] 0 2023-10-18T20:58:51.097 INFO:tasks.workunit.client.0.smithi008.stdout:4/872: symlink d0/d58/d8e/l12d 0 2023-10-18T20:58:51.111 INFO:tasks.workunit.client.0.smithi008.stdout:7/913: dread d1/d36/d3d/d3e/d59/d73/fc2 [0,4194304] 0 2023-10-18T20:58:51.114 INFO:tasks.workunit.client.0.smithi008.stdout:7/914: mknod d1/d36/c120 0 2023-10-18T20:58:51.116 INFO:tasks.workunit.client.0.smithi008.stdout:7/915: creat d1/d36/d3d/d3e/d59/d116/de8/d5f/dba/f121 x:0 0 0 2023-10-18T20:58:51.120 INFO:tasks.workunit.client.0.smithi008.stdout:7/916: creat d1/da6/d4f/d87/df9/f122 x:0 0 0 2023-10-18T20:58:51.123 INFO:tasks.workunit.client.0.smithi008.stdout:7/917: link d1/d36/d3d/d3e/d59/d73/d7b/daf/fe0 d1/d36/d3d/d3e/d59/d73/f123 0 2023-10-18T20:58:51.134 INFO:tasks.workunit.client.0.smithi008.stdout:7/918: write d1/d36/d3d/d3e/d59/d73/fc2 [732324,62683] 0 2023-10-18T20:58:51.134 INFO:tasks.workunit.client.0.smithi008.stdout:7/919: stat d1/d36/d3d/d3e/ff6 0 2023-10-18T20:58:51.150 INFO:tasks.workunit.client.0.smithi008.stdout:4/873: dwrite d0/d3/d21/d57/d8f/d95/f122 [0,4194304] 0 2023-10-18T20:58:51.150 INFO:tasks.workunit.client.0.smithi008.stdout:7/920: dread d1/d36/d3d/d3e/d59/d116/de8/f43 [0,4194304] 0 2023-10-18T20:58:51.151 INFO:tasks.workunit.client.0.smithi008.stdout:2/979: dwrite d1/d3/dd/d25/db2/f116 [0,4194304] 0 2023-10-18T20:58:51.152 INFO:tasks.workunit.client.0.smithi008.stdout:2/980: fdatasync d1/d3/dd/d1c/d3a/d57/f6d 0 2023-10-18T20:58:51.154 INFO:tasks.workunit.client.0.smithi008.stdout:4/874: link d0/d17/d6e/lc1 d0/d76/l12e 0 2023-10-18T20:58:51.154 INFO:tasks.workunit.client.0.smithi008.stdout:4/875: creat d0/d17/d5b/f12f x:0 0 0 2023-10-18T20:58:51.155 INFO:tasks.workunit.client.0.smithi008.stdout:4/876: chown d0/d58/d8e/db4/c124 888802 1 2023-10-18T20:58:51.155 INFO:tasks.workunit.client.0.smithi008.stdout:4/877: chown d0/d17/d5b/d45/l10e 1588438962 1 2023-10-18T20:58:51.155 INFO:tasks.workunit.client.0.smithi008.stdout:4/878: write d0/d58/dbf/fca [597520,21699] 0 2023-10-18T20:58:51.156 INFO:tasks.workunit.client.0.smithi008.stdout:4/879: fsync d0/d3/d21/d57/ffa 0 2023-10-18T20:58:51.156 INFO:tasks.workunit.client.0.smithi008.stdout:4/880: truncate d0/d3/d21/d57/d8f/d95/f104 136046 0 2023-10-18T20:58:51.156 INFO:tasks.workunit.client.0.smithi008.stdout:4/881: readlink d0/d58/d8e/lfc 0 2023-10-18T20:58:51.159 INFO:tasks.workunit.client.0.smithi008.stdout:4/882: rename d0/d3/d21/d57/cae to d0/d12c/c130 0 2023-10-18T20:58:51.166 INFO:tasks.workunit.client.0.smithi008.stdout:7/921: dread d1/d36/d3d/d3e/d59/d116/de8/d5f/d7f/fda [0,4194304] 0 2023-10-18T20:58:51.171 INFO:tasks.workunit.client.0.smithi008.stdout:7/922: rename d1/d36/d3d/d3e/d59/d73/d7b/daf/fe0 to d1/d36/d3d/d3e/d59/d116/de8/d5f/f124 0 2023-10-18T20:58:51.172 INFO:tasks.workunit.client.0.smithi008.stdout:7/923: mknod d1/c125 0 2023-10-18T20:58:51.172 INFO:tasks.workunit.client.0.smithi008.stdout:5/887: dwrite d0/d2/d19/d7c/f6b [0,4194304] 0 2023-10-18T20:58:51.173 INFO:tasks.workunit.client.0.smithi008.stdout:2/981: dread d1/d3/dd/d1c/d3a/d45/fda [0,4194304] 0 2023-10-18T20:58:51.174 INFO:tasks.workunit.client.0.smithi008.stdout:2/982: unlink d1/d3/dd/d25/d34/c35 0 2023-10-18T20:58:51.176 INFO:tasks.workunit.client.0.smithi008.stdout:4/883: write d0/d3/d21/fa2 [1283513,123284] 0 2023-10-18T20:58:51.176 INFO:tasks.workunit.client.0.smithi008.stdout:2/983: rename d1/d3/dd/d1c/d3a/d45/daa/d101 to d1/d3/dd/d1c/d3a/d13d 0 2023-10-18T20:58:51.183 INFO:tasks.workunit.client.0.smithi008.stdout:2/984: symlink d1/d3/dd/d25/l13e 0 2023-10-18T20:58:51.183 INFO:tasks.workunit.client.0.smithi008.stdout:2/985: stat d1/d3/dd/d25/db2/d11c/f12e 0 2023-10-18T20:58:51.183 INFO:tasks.workunit.client.0.smithi008.stdout:2/986: truncate d1/d3/d40/d6e/d7e/f138 383865 0 2023-10-18T20:58:51.195 INFO:tasks.workunit.client.0.smithi008.stdout:9/824: sync 2023-10-18T20:58:51.195 INFO:tasks.workunit.client.0.smithi008.stdout:0/858: sync 2023-10-18T20:58:51.196 INFO:tasks.workunit.client.0.smithi008.stdout:9/825: chown d2/dc/d40/dce/de3 304 1 2023-10-18T20:58:51.196 INFO:tasks.workunit.client.0.smithi008.stdout:0/859: write d0/dd/df/fc2 [326083,109389] 0 2023-10-18T20:58:51.197 INFO:tasks.workunit.client.0.smithi008.stdout:9/826: truncate d2/dc/f1c 1073470 0 2023-10-18T20:58:51.198 INFO:tasks.workunit.client.0.smithi008.stdout:0/860: symlink d0/d7c/d9a/l115 0 2023-10-18T20:58:51.204 INFO:tasks.workunit.client.0.smithi008.stdout:2/987: dread d1/d3/dd/d25/d76/d59/d85/d110/fd1 [0,4194304] 0 2023-10-18T20:58:51.221 INFO:tasks.workunit.client.0.smithi008.stdout:2/988: write d1/d3/dd/d25/d76/d59/d85/fff [4166022,19003] 0 2023-10-18T20:58:51.221 INFO:tasks.workunit.client.0.smithi008.stdout:2/989: dread - d1/d3/dd/d25/f107 zero size 2023-10-18T20:58:51.222 INFO:tasks.workunit.client.0.smithi008.stdout:0/861: dread d0/dd/d19/d5f/d99/f33 [0,4194304] 0 2023-10-18T20:58:51.223 INFO:tasks.workunit.client.0.smithi008.stdout:2/990: rename d1/d3/dd/d25/d76/d59/f97 to d1/d3/dd/d1c/d3a/d45/daa/f13f 0 2023-10-18T20:58:51.224 INFO:tasks.workunit.client.0.smithi008.stdout:4/884: dwrite d0/d3/d21/f5a [0,4194304] 0 2023-10-18T20:58:51.224 INFO:tasks.workunit.client.0.smithi008.stdout:4/885: readlink d0/d3/ldd 0 2023-10-18T20:58:51.225 INFO:tasks.workunit.client.0.smithi008.stdout:2/991: creat d1/d3/dd/d1c/d3a/d57/f140 x:0 0 0 2023-10-18T20:58:51.226 INFO:tasks.workunit.client.0.smithi008.stdout:2/992: write d1/d3/d40/d6e/d7e/f131 [4358981,38872] 0 2023-10-18T20:58:51.228 INFO:tasks.workunit.client.0.smithi008.stdout:4/886: mknod d0/d58/d8e/c131 0 2023-10-18T20:58:51.229 INFO:tasks.workunit.client.0.smithi008.stdout:0/862: getdents d0/dd 0 2023-10-18T20:58:51.231 INFO:tasks.workunit.client.0.smithi008.stdout:7/924: dread d1/d36/d3d/d3e/f3c [0,4194304] 0 2023-10-18T20:58:51.237 INFO:tasks.workunit.client.0.smithi008.stdout:4/887: truncate d0/d58/d8e/f53 1003035 0 2023-10-18T20:58:51.237 INFO:tasks.workunit.client.0.smithi008.stdout:0/863: creat d0/dd/d19/d5f/d89/da7/de7/f116 x:0 0 0 2023-10-18T20:58:51.240 INFO:tasks.workunit.client.0.smithi008.stdout:0/864: symlink d0/d7c/d9a/d8a/l117 0 2023-10-18T20:58:51.243 INFO:tasks.workunit.client.0.smithi008.stdout:0/865: creat d0/d7c/d9a/d8a/d8f/da5/f118 x:0 0 0 2023-10-18T20:58:51.247 INFO:tasks.workunit.client.0.smithi008.stdout:5/888: dwrite d0/f29 [0,4194304] 0 2023-10-18T20:58:51.249 INFO:tasks.workunit.client.0.smithi008.stdout:0/866: creat d0/d90/df9/f119 x:0 0 0 2023-10-18T20:58:51.249 INFO:tasks.workunit.client.0.smithi008.stdout:0/867: chown d0/d7c/d9a/d8a/fdd 56 1 2023-10-18T20:58:51.251 INFO:tasks.workunit.client.0.smithi008.stdout:4/888: dread d0/d3/d21/d42/f79 [0,4194304] 0 2023-10-18T20:58:51.252 INFO:tasks.workunit.client.0.smithi008.stdout:5/889: creat d0/de/f13d x:0 0 0 2023-10-18T20:58:51.253 INFO:tasks.workunit.client.0.smithi008.stdout:5/890: fdatasync d0/da9/dda/de1/f12d 0 2023-10-18T20:58:51.254 INFO:tasks.workunit.client.0.smithi008.stdout:0/868: rename d0/dd/d19/d5f/d99/d94/f43 to d0/dd/d19/d24/f11a 0 2023-10-18T20:58:51.256 INFO:tasks.workunit.client.0.smithi008.stdout:4/889: creat d0/d58/dbf/f132 x:0 0 0 2023-10-18T20:58:51.256 INFO:tasks.workunit.client.0.smithi008.stdout:4/890: chown d0/d17/dc6/lf4 806889 1 2023-10-18T20:58:51.256 INFO:tasks.workunit.client.0.smithi008.stdout:0/869: mknod d0/c11b 0 2023-10-18T20:58:51.256 INFO:tasks.workunit.client.0.smithi008.stdout:0/870: chown d0/d7c/d9a/d8a 7834518 1 2023-10-18T20:58:51.257 INFO:tasks.workunit.client.0.smithi008.stdout:0/871: readlink d0/dd/d19/d5f/d99/d5e/d7d/l82 0 2023-10-18T20:58:51.257 INFO:tasks.workunit.client.0.smithi008.stdout:0/872: chown d0/dd/d19/d5f/d99/f4b 144 1 2023-10-18T20:58:51.258 INFO:tasks.workunit.client.0.smithi008.stdout:9/827: dwrite d2/d8/db1/dd3/d59/fbd [0,4194304] 0 2023-10-18T20:58:51.259 INFO:tasks.workunit.client.0.smithi008.stdout:4/891: mknod d0/d58/d83/c133 0 2023-10-18T20:58:51.261 INFO:tasks.workunit.client.0.smithi008.stdout:9/828: mknod d2/d8/db1/dd3/cf5 0 2023-10-18T20:58:51.285 INFO:tasks.workunit.client.0.smithi008.stdout:5/891: write d0/d2/d9/d9b/d12e/d70/dc0/fd8 [562207,40072] 0 2023-10-18T20:58:51.287 INFO:tasks.workunit.client.0.smithi008.stdout:5/892: symlink d0/d2/d9/l13e 0 2023-10-18T20:58:51.289 INFO:tasks.workunit.client.0.smithi008.stdout:5/893: getdents d0/dec 0 2023-10-18T20:58:51.292 INFO:tasks.workunit.client.0.smithi008.stdout:5/894: mkdir d0/d2/d9/d9b/d12e/d70/dc0/ddb/d13f 0 2023-10-18T20:58:51.293 INFO:tasks.workunit.client.0.smithi008.stdout:2/993: dwrite d1/f1a [4194304,4194304] 0 2023-10-18T20:58:51.294 INFO:tasks.workunit.client.0.smithi008.stdout:2/994: fdatasync d1/d3/dd/d25/db2/d11c/ff7 0 2023-10-18T20:58:51.294 INFO:tasks.workunit.client.0.smithi008.stdout:2/995: chown d1/d3/dd/d1c/d3a/d57 15144168 1 2023-10-18T20:58:51.294 INFO:tasks.workunit.client.0.smithi008.stdout:2/996: dread - d1/d3/dd/d25/d5c/f109 zero size 2023-10-18T20:58:51.307 INFO:tasks.workunit.client.0.smithi008.stdout:2/997: rmdir d1/d3/dd/d25/d34 39 2023-10-18T20:58:51.318 INFO:tasks.workunit.client.0.smithi008.stdout:2/998: write d1/d3/d40/d6e/f78 [1645268,95396] 0 2023-10-18T20:58:51.320 INFO:tasks.workunit.client.0.smithi008.stdout:0/873: dwrite d0/dd/fc8 [0,4194304] 0 2023-10-18T20:58:51.320 INFO:tasks.workunit.client.0.smithi008.stdout:0/874: chown d0/dd/d19/fa8 2 1 2023-10-18T20:58:51.321 INFO:tasks.workunit.client.0.smithi008.stdout:2/999: mkdir d1/d3/dd/d1c/d3a/d13d/d141 0 2023-10-18T20:58:51.322 INFO:tasks.workunit.client.0.smithi008.stdout:7/925: dwrite d1/d36/d3d/d3e/d59/d116/de8/f2f [0,4194304] 0 2023-10-18T20:58:51.332 INFO:tasks.workunit.client.0.smithi008.stdout:0/875: dread d0/d7c/d9a/d8a/d8f/d21/df7/f8e [0,4194304] 0 2023-10-18T20:58:51.332 INFO:tasks.workunit.client.0.smithi008.stdout:0/876: truncate d0/dd/d19/d5f/d99/d94/f65 2208982 0 2023-10-18T20:58:51.334 INFO:tasks.workunit.client.0.smithi008.stdout:0/877: rename d0/dd/c106 to d0/d7c/d9a/c11c 0 2023-10-18T20:58:51.336 INFO:tasks.workunit.client.0.smithi008.stdout:0/878: rename d0/dd/d19/d5f/c114 to d0/dd/d19/d5f/d89/c11d 0 2023-10-18T20:58:51.336 INFO:tasks.workunit.client.0.smithi008.stdout:0/879: creat d0/dd/d19/d24/f11e x:0 0 0 2023-10-18T20:58:51.340 INFO:tasks.workunit.client.0.smithi008.stdout:7/926: dread d1/d36/d3d/d3e/d59/d116/de8/d5f/d7f/fbc [0,4194304] 0 2023-10-18T20:58:51.340 INFO:tasks.workunit.client.0.smithi008.stdout:7/927: write d1/da6/ff5 [809149,1967] 0 2023-10-18T20:58:51.340 INFO:tasks.workunit.client.0.smithi008.stdout:7/928: dread - d1/d3/f82 zero size 2023-10-18T20:58:51.341 INFO:tasks.workunit.client.0.smithi008.stdout:4/892: dwrite d0/d17/dc6/f11a [0,4194304] 0 2023-10-18T20:58:51.341 INFO:tasks.workunit.client.0.smithi008.stdout:4/893: creat d0/d58/dc7/f134 x:0 0 0 2023-10-18T20:58:51.343 INFO:tasks.workunit.client.0.smithi008.stdout:5/895: dwrite d0/f3 [0,4194304] 0 2023-10-18T20:58:51.343 INFO:tasks.workunit.client.0.smithi008.stdout:5/896: creat d0/d2/f140 x:0 0 0 2023-10-18T20:58:51.343 INFO:tasks.workunit.client.0.smithi008.stdout:5/897: creat d0/d2/d9/d9b/d12e/d70/dc0/ddb/f141 x:0 0 0 2023-10-18T20:58:51.343 INFO:tasks.workunit.client.0.smithi008.stdout:5/898: write d0/fbc [5165114,46837] 0 2023-10-18T20:58:51.344 INFO:tasks.workunit.client.0.smithi008.stdout:0/880: link d0/d7c/d9a/d8a/d8f/d21/df7/c4d d0/d7c/d9a/d8a/d8f/da5/c11f 0 2023-10-18T20:58:51.354 INFO:tasks.workunit.client.0.smithi008.stdout:5/899: rename d0/d2/d19/d7c/d31/d80/ca3 to d0/de/c142 0 2023-10-18T20:58:51.355 INFO:tasks.workunit.client.0.smithi008.stdout:5/900: chown d0/de/c18 4588 1 2023-10-18T20:58:51.355 INFO:tasks.workunit.client.0.smithi008.stdout:0/881: mknod d0/d7c/d9a/d8a/d8f/da5/de6/c120 0 2023-10-18T20:58:51.356 INFO:tasks.workunit.client.0.smithi008.stdout:0/882: stat d0/dd/d19/d5f/f60 0 2023-10-18T20:58:51.369 INFO:tasks.workunit.client.0.smithi008.stdout:0/883: dread d0/d7c/d9a/d8a/d8f/d21/fad [0,4194304] 0 2023-10-18T20:58:51.372 INFO:tasks.workunit.client.0.smithi008.stdout:0/884: mknod d0/dd/d19/c121 0 2023-10-18T20:58:51.372 INFO:tasks.workunit.client.0.smithi008.stdout:0/885: chown d0/dd/df/feb 2810223 1 2023-10-18T20:58:51.372 INFO:tasks.workunit.client.0.smithi008.stdout:0/886: dread - d0/dd/df/faf zero size 2023-10-18T20:58:51.372 INFO:tasks.workunit.client.0.smithi008.stdout:0/887: dread - d0/dd/df/faa zero size 2023-10-18T20:58:51.374 INFO:tasks.workunit.client.0.smithi008.stdout:0/888: truncate d0/d7c/d9a/d8a/d8f/d21/df7/f5c 876971 0 2023-10-18T20:58:51.374 INFO:tasks.workunit.client.0.smithi008.stdout:0/889: chown d0/dd/d19/d5f/d99/d94/f65 1113 1 2023-10-18T20:58:51.375 INFO:tasks.workunit.client.0.smithi008.stdout:0/890: chown d0/dd/d19/c121 2 1 2023-10-18T20:58:51.375 INFO:tasks.workunit.client.0.smithi008.stdout:0/891: rename d0/dd/d19/d5f/d99 to d0/dd/d19/d5f/d99/d94/d122 22 2023-10-18T20:58:51.375 INFO:tasks.workunit.client.0.smithi008.stdout:0/892: fsync d0/dd/fc8 0 2023-10-18T20:58:51.375 INFO:tasks.workunit.client.0.smithi008.stdout:0/893: creat d0/d7c/d9a/d8a/d8f/da5/f123 x:0 0 0 2023-10-18T20:58:51.376 INFO:tasks.workunit.client.0.smithi008.stdout:0/894: stat d0/d7c/d9a/dce/ce2 0 2023-10-18T20:58:51.376 INFO:tasks.workunit.client.0.smithi008.stdout:0/895: chown d0/dd/ccc 5 1 2023-10-18T20:58:51.384 INFO:tasks.workunit.client.0.smithi008.stdout:4/894: dwrite d0/d17/d5b/f5f [0,4194304] 0 2023-10-18T20:58:51.384 INFO:tasks.workunit.client.0.smithi008.stdout:0/896: rmdir d0/d7c 39 2023-10-18T20:58:51.385 INFO:tasks.workunit.client.0.smithi008.stdout:0/897: fdatasync d0/dd/d19/d5f/d89/da7/fba 0 2023-10-18T20:58:51.385 INFO:tasks.workunit.client.0.smithi008.stdout:0/898: mknod d0/dd/d19/d5f/d89/da7/de7/c124 0 2023-10-18T20:58:51.399 INFO:tasks.workunit.client.0.smithi008.stdout:4/895: dread d0/d3/d21/fa2 [0,4194304] 0 2023-10-18T20:58:51.400 INFO:tasks.workunit.client.0.smithi008.stdout:5/901: dwrite d0/d2/d9/f10b [0,4194304] 0 2023-10-18T20:58:51.402 INFO:tasks.workunit.client.0.smithi008.stdout:0/899: write d0/dd/fc8 [420336,12998] 0 2023-10-18T20:58:51.404 INFO:tasks.workunit.client.0.smithi008.stdout:0/900: symlink d0/d7c/d9a/d8a/d8f/d21/df7/d61/l125 0 2023-10-18T20:58:51.408 INFO:tasks.workunit.client.0.smithi008.stdout:0/901: mkdir d0/d90/d126 0 2023-10-18T20:58:51.409 INFO:tasks.workunit.client.0.smithi008.stdout:5/902: dread d0/d2/d19/d7c/d64/fb6 [0,4194304] 0 2023-10-18T20:58:51.410 INFO:tasks.workunit.client.0.smithi008.stdout:5/903: creat d0/d2/d19/d7c/d31/d80/d91/f143 x:0 0 0 2023-10-18T20:58:51.417 INFO:tasks.workunit.client.0.smithi008.stdout:4/896: dread d0/d3/d21/d57/d8f/f88 [0,4194304] 0 2023-10-18T20:58:51.417 INFO:tasks.workunit.client.0.smithi008.stdout:4/897: rmdir d0/d3/d21/d57/d8f/d95 39 2023-10-18T20:58:51.418 INFO:tasks.workunit.client.0.smithi008.stdout:4/898: dread - d0/d58/d8e/dd2/fe2 zero size 2023-10-18T20:58:51.418 INFO:tasks.workunit.client.0.smithi008.stdout:4/899: chown d0/d3/d21/d57/d8f/d95/f122 0 1 2023-10-18T20:58:51.420 INFO:tasks.workunit.client.0.smithi008.stdout:0/902: dread d0/dd/d19/d24/fdf [0,4194304] 0 2023-10-18T20:58:51.420 INFO:tasks.workunit.client.0.smithi008.stdout:0/903: creat d0/dd/d19/d5f/d99/d5e/d7d/db7/f127 x:0 0 0 2023-10-18T20:58:51.420 INFO:tasks.workunit.client.0.smithi008.stdout:0/904: chown d0/c47 172 1 2023-10-18T20:58:51.424 INFO:tasks.workunit.client.0.smithi008.stdout:4/900: creat d0/d58/d83/f135 x:0 0 0 2023-10-18T20:58:51.470 INFO:tasks.workunit.client.0.smithi008.stdout:9/829: sync 2023-10-18T20:58:51.470 INFO:tasks.workunit.client.0.smithi008.stdout:9/830: creat d2/dc/d40/dce/ff6 x:0 0 0 2023-10-18T20:58:51.471 INFO:tasks.workunit.client.0.smithi008.stdout:9/831: fdatasync d2/d8/da0/fca 0 2023-10-18T20:58:51.473 INFO:tasks.workunit.client.0.smithi008.stdout:9/832: rename d2/dc/d40/dbc to d2/dc/d17/d19/df7 0 2023-10-18T20:58:51.475 INFO:tasks.workunit.client.0.smithi008.stdout:0/905: dwrite d0/dd/d19/d5f/d89/da7/dac/ffe [0,4194304] 0 2023-10-18T20:58:51.480 INFO:tasks.workunit.client.0.smithi008.stdout:0/906: creat d0/dd/df/dd9/f128 x:0 0 0 2023-10-18T20:58:51.480 INFO:tasks.workunit.client.0.smithi008.stdout:0/907: write d0/dd/fc8 [5040294,81277] 0 2023-10-18T20:58:51.480 INFO:tasks.workunit.client.0.smithi008.stdout:0/908: readlink d0/dd/df/l108 0 2023-10-18T20:58:51.483 INFO:tasks.workunit.client.0.smithi008.stdout:0/909: mkdir d0/d90/df9/d129 0 2023-10-18T20:58:51.483 INFO:tasks.workunit.client.0.smithi008.stdout:0/910: write d0/d7c/d9a/d8a/d8f/fd5 [956855,16167] 0 2023-10-18T20:58:51.485 INFO:tasks.workunit.client.0.smithi008.stdout:0/911: rename d0/d7c/d9a/d8a/d8f/fd5 to d0/d7c/d9a/d8a/d8f/f12a 0 2023-10-18T20:58:51.486 INFO:tasks.workunit.client.0.smithi008.stdout:0/912: read d0/dd/d19/fa8 [2086,93951] 0 2023-10-18T20:58:51.493 INFO:tasks.workunit.client.0.smithi008.stdout:4/901: dwrite d0/d17/d6e/f103 [0,4194304] 0 2023-10-18T20:58:51.501 INFO:tasks.workunit.client.0.smithi008.stdout:0/913: write d0/dd/d19/d5f/d99/d94/f95 [78434,62381] 0 2023-10-18T20:58:51.503 INFO:tasks.workunit.client.0.smithi008.stdout:0/914: creat d0/d90/df9/d129/f12b x:0 0 0 2023-10-18T20:58:51.504 INFO:tasks.workunit.client.0.smithi008.stdout:0/915: unlink d0/d7c/d9a/d8a/d8f/da5/cc3 0 2023-10-18T20:58:51.506 INFO:tasks.workunit.client.0.smithi008.stdout:0/916: mkdir d0/d7c/df0/d12c 0 2023-10-18T20:58:51.506 INFO:tasks.workunit.client.0.smithi008.stdout:0/917: readlink d0/d7c/l75 0 2023-10-18T20:58:51.508 INFO:tasks.workunit.client.0.smithi008.stdout:0/918: mknod d0/d90/c12d 0 2023-10-18T20:58:51.512 INFO:tasks.workunit.client.0.smithi008.stdout:0/919: symlink d0/d7c/d9a/d8a/l12e 0 2023-10-18T20:58:51.514 INFO:tasks.workunit.client.0.smithi008.stdout:0/920: rename d0/dd/d19/d24/f97 to d0/d7c/d9a/d8a/d8f/da5/f12f 0 2023-10-18T20:58:51.514 INFO:tasks.workunit.client.0.smithi008.stdout:0/921: stat d0/dd/d19/d24/f3d 0 2023-10-18T20:58:51.515 INFO:tasks.workunit.client.0.smithi008.stdout:0/922: creat d0/d7c/df0/f130 x:0 0 0 2023-10-18T20:58:51.517 INFO:tasks.workunit.client.0.smithi008.stdout:0/923: rename d0/dd/d19/d5f/d99/d94/c42 to d0/d7c/d9a/d8a/d8f/d21/df7/d61/c131 0 2023-10-18T20:58:51.528 INFO:tasks.workunit.client.0.smithi008.stdout:0/924: write d0/dd/d19/d24/fdf [1262080,13895] 0 2023-10-18T20:58:51.531 INFO:tasks.workunit.client.0.smithi008.stdout:9/833: dwrite d2/dc/d3d/d99/fd6 [0,4194304] 0 2023-10-18T20:58:51.534 INFO:tasks.workunit.client.0.smithi008.stdout:4/902: dwrite d0/d17/d5b/fcc [0,4194304] 0 2023-10-18T20:58:51.537 INFO:tasks.workunit.client.0.smithi008.stdout:9/834: dread d2/dc/d17/d19/d4a/f9b [0,4194304] 0 2023-10-18T20:58:51.544 INFO:tasks.workunit.client.0.smithi008.stdout:0/925: write d0/dd/d19/d24/f3d [7231170,74501] 0 2023-10-18T20:58:51.545 INFO:tasks.workunit.client.0.smithi008.stdout:0/926: chown d0/dd/d19/d5f/d99/d94/c57 3 1 2023-10-18T20:58:51.550 INFO:tasks.workunit.client.0.smithi008.stdout:4/903: write d0/d17/f1a [2494172,19691] 0 2023-10-18T20:58:51.550 INFO:tasks.workunit.client.0.smithi008.stdout:9/835: creat d2/dc/d17/d19/d4a/db2/ff8 x:0 0 0 2023-10-18T20:58:51.551 INFO:tasks.workunit.client.0.smithi008.stdout:9/836: fsync d2/dc/d1a/f97 0 2023-10-18T20:58:51.551 INFO:tasks.workunit.client.0.smithi008.stdout:7/929: sync 2023-10-18T20:58:51.551 INFO:tasks.workunit.client.0.smithi008.stdout:5/904: sync 2023-10-18T20:58:51.552 INFO:tasks.workunit.client.0.smithi008.stdout:5/905: write d0/d2/d9/d34/f3b [1659269,90095] 0 2023-10-18T20:58:51.553 INFO:tasks.workunit.client.0.smithi008.stdout:5/906: write d0/d2/d9/d9b/de7/d11f/d75/fb8 [905329,119623] 0 2023-10-18T20:58:51.554 INFO:tasks.workunit.client.0.smithi008.stdout:0/927: mknod d0/dd/dea/c132 0 2023-10-18T20:58:51.554 INFO:tasks.workunit.client.0.smithi008.stdout:4/904: link d0/d3/f1e d0/f136 0 2023-10-18T20:58:51.554 INFO:tasks.workunit.client.0.smithi008.stdout:4/905: dread - d0/d17/d6e/fd4 zero size 2023-10-18T20:58:51.557 INFO:tasks.workunit.client.0.smithi008.stdout:9/837: mknod d2/dc/d17/d19/df7/cf9 0 2023-10-18T20:58:51.557 INFO:tasks.workunit.client.0.smithi008.stdout:5/907: creat d0/de/d134/f144 x:0 0 0 2023-10-18T20:58:51.558 INFO:tasks.workunit.client.0.smithi008.stdout:0/928: mknod d0/d7c/d9a/d8a/db0/c133 0 2023-10-18T20:58:51.559 INFO:tasks.workunit.client.0.smithi008.stdout:0/929: stat d0/dd/d19/d5f/d89/da7/l10a 0 2023-10-18T20:58:51.560 INFO:tasks.workunit.client.0.smithi008.stdout:7/930: getdents d1/d36/d3d/d3e/d59 0 2023-10-18T20:58:51.561 INFO:tasks.workunit.client.0.smithi008.stdout:9/838: truncate d2/dc/d3d/f73 2118591 0 2023-10-18T20:58:51.561 INFO:tasks.workunit.client.0.smithi008.stdout:9/839: getdents d2/dc/d17/d7b/de6 0 2023-10-18T20:58:51.605 INFO:tasks.workunit.client.0.smithi008.stdout:0/930: dwrite d0/dd/d19/fa8 [0,4194304] 0 2023-10-18T20:58:51.606 INFO:tasks.workunit.client.0.smithi008.stdout:5/908: dwrite d0/d2/d9/d9b/f5e [0,4194304] 0 2023-10-18T20:58:51.610 INFO:tasks.workunit.client.0.smithi008.stdout:0/931: link d0/dd/df/dd9/fda d0/d7c/d9a/d8a/d8f/da5/de6/f134 0 2023-10-18T20:58:51.612 INFO:tasks.workunit.client.0.smithi008.stdout:0/932: creat d0/dd/d19/d24/de5/f135 x:0 0 0 2023-10-18T20:58:51.617 INFO:tasks.workunit.client.0.smithi008.stdout:0/933: symlink d0/dd/d19/d5f/d89/da7/dac/l136 0 2023-10-18T20:58:51.638 INFO:tasks.workunit.client.0.smithi008.stdout:4/906: dwrite d0/d17/f23 [0,4194304] 0 2023-10-18T20:58:51.638 INFO:tasks.workunit.client.0.smithi008.stdout:4/907: fsync d0/d17/f23 0 2023-10-18T20:58:51.638 INFO:tasks.workunit.client.0.smithi008.stdout:4/908: read - d0/d17/d6e/dfb/f10a zero size 2023-10-18T20:58:51.638 INFO:tasks.workunit.client.0.smithi008.stdout:4/909: chown d0/d58/dc7/fef 0 1 2023-10-18T20:58:51.641 INFO:tasks.workunit.client.0.smithi008.stdout:4/910: creat d0/d3/d21/d57/d8f/d95/d112/f137 x:0 0 0 2023-10-18T20:58:51.645 INFO:tasks.workunit.client.0.smithi008.stdout:7/931: dwrite d1/d36/d3d/d3e/d59/d116/de8/f66 [0,4194304] 0 2023-10-18T20:58:51.650 INFO:tasks.workunit.client.0.smithi008.stdout:5/909: dwrite d0/d6e/feb [0,4194304] 0 2023-10-18T20:58:51.651 INFO:tasks.workunit.client.0.smithi008.stdout:5/910: readlink d0/d2/d9/l13e 0 2023-10-18T20:58:51.651 INFO:tasks.workunit.client.0.smithi008.stdout:5/911: fdatasync d0/d2/d9/d9b/de7/d11f/d75/fb8 0 2023-10-18T20:58:51.654 INFO:tasks.workunit.client.0.smithi008.stdout:7/932: creat d1/da6/f126 x:0 0 0 2023-10-18T20:58:51.654 INFO:tasks.workunit.client.0.smithi008.stdout:7/933: readlink d1/d36/d3d/d3e/d59/d73/d7b/l81 0 2023-10-18T20:58:51.654 INFO:tasks.workunit.client.0.smithi008.stdout:7/934: truncate d1/d36/d3d/d3e/d59/d116/de8/d5f/d7f/f9a 2612352 0 2023-10-18T20:58:51.655 INFO:tasks.workunit.client.0.smithi008.stdout:5/912: truncate d0/d2/d9/d9b/f5e 1481073 0 2023-10-18T20:58:51.656 INFO:tasks.workunit.client.0.smithi008.stdout:7/935: rmdir d1/d36/d3d/d3e/d59/d116/de8 39 2023-10-18T20:58:51.657 INFO:tasks.workunit.client.0.smithi008.stdout:5/913: symlink d0/d2/d9/d9b/d12e/d9a/l145 0 2023-10-18T20:58:51.659 INFO:tasks.workunit.client.0.smithi008.stdout:7/936: mknod d1/d36/c127 0 2023-10-18T20:58:51.661 INFO:tasks.workunit.client.0.smithi008.stdout:4/911: write d0/f14 [1887101,41656] 0 2023-10-18T20:58:51.661 INFO:tasks.workunit.client.0.smithi008.stdout:5/914: creat d0/d2/d9/d34/dfb/f146 x:0 0 0 2023-10-18T20:58:51.661 INFO:tasks.workunit.client.0.smithi008.stdout:5/915: chown d0/da9/dda/d100/d136 6728626 1 2023-10-18T20:58:51.668 INFO:tasks.workunit.client.0.smithi008.stdout:5/916: symlink d0/d2/d19/d7c/d58/l147 0 2023-10-18T20:58:51.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:50.122181+0000 mgr.smithi008.flmjzp (mgr.14640) 19 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 147 MiB/s rd, 181 MiB/s wr, 255 op/s 2023-10-18T20:58:51.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:50.303072+0000 mon.smithi008 (mon.0) 664 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:51.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:50.304527+0000 mon.smithi008 (mon.0) 665 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:51.673 INFO:tasks.workunit.client.0.smithi008.stdout:5/917: chown d0/d2/d9/d9b/f5e 0 1 2023-10-18T20:58:51.687 INFO:tasks.workunit.client.0.smithi008.stdout:4/912: write d0/d3/d21/f5a [3583960,50840] 0 2023-10-18T20:58:51.691 INFO:tasks.workunit.client.0.smithi008.stdout:4/913: getdents d0/d58/d8e 0 2023-10-18T20:58:51.691 INFO:tasks.workunit.client.0.smithi008.stdout:4/914: write d0/d17/d6e/dfb/f10a [983054,39859] 0 2023-10-18T20:58:51.691 INFO:tasks.workunit.client.0.smithi008.stdout:4/915: write d0/d58/d8e/f53 [1707948,108584] 0 2023-10-18T20:58:51.692 INFO:tasks.workunit.client.0.smithi008.stdout:4/916: write d0/d17/d5b/d2a/f110 [680833,46772] 0 2023-10-18T20:58:51.692 INFO:tasks.workunit.client.0.smithi008.stdout:4/917: unlink d0/d58/d8e/db4/f97 0 2023-10-18T20:58:51.703 INFO:tasks.workunit.client.0.smithi008.stdout:4/918: mknod d0/d58/c138 0 2023-10-18T20:58:51.704 INFO:tasks.workunit.client.0.smithi008.stdout:5/918: write d0/d2/d9/d9b/f50 [3699994,51643] 0 2023-10-18T20:58:51.715 INFO:tasks.workunit.client.0.smithi008.stdout:5/919: link d0/d86/cbd d0/d2/d9/d9b/de7/c148 0 2023-10-18T20:58:51.716 INFO:tasks.workunit.client.0.smithi008.stdout:4/919: mknod d0/d58/dbf/c139 0 2023-10-18T20:58:51.716 INFO:tasks.workunit.client.0.smithi008.stdout:4/920: write d0/d58/dbf/f127 [2039346,5680] 0 2023-10-18T20:58:51.718 INFO:tasks.workunit.client.0.smithi008.stdout:4/921: unlink d0/d3/d21/d42/f50 0 2023-10-18T20:58:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:50.122181+0000 mgr.smithi008.flmjzp (mgr.14640) 19 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 147 MiB/s rd, 181 MiB/s wr, 255 op/s 2023-10-18T20:58:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:50.303072+0000 mon.smithi008 (mon.0) 664 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:50.304527+0000 mon.smithi008 (mon.0) 665 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:51.741 INFO:tasks.workunit.client.0.smithi008.stdout:7/937: dwrite d1/d3/fc0 [4194304,4194304] 0 2023-10-18T20:58:51.741 INFO:tasks.workunit.client.0.smithi008.stdout:7/938: dread - d1/da6/fff zero size 2023-10-18T20:58:51.741 INFO:tasks.workunit.client.0.smithi008.stdout:7/939: read - d1/d36/d3d/d3e/d59/d116/de8/d5f/dba/ded/f114 zero size 2023-10-18T20:58:51.745 INFO:tasks.workunit.client.0.smithi008.stdout:7/940: creat d1/d36/d3d/d3e/d59/f128 x:0 0 0 2023-10-18T20:58:51.746 INFO:tasks.workunit.client.0.smithi008.stdout:7/941: creat d1/d36/d3d/d3e/d59/d116/de8/dbe/f129 x:0 0 0 2023-10-18T20:58:51.752 INFO:tasks.workunit.client.0.smithi008.stdout:7/942: rename d1/d3/d8b/da5/f11c to d1/d36/d3d/d115/f12a 0 2023-10-18T20:58:51.753 INFO:tasks.workunit.client.0.smithi008.stdout:7/943: mknod d1/da6/d4f/d87/df9/c12b 0 2023-10-18T20:58:51.764 INFO:tasks.workunit.client.0.smithi008.stdout:4/922: dwrite d0/d17/d5b/f52 [0,4194304] 0 2023-10-18T20:58:51.768 INFO:tasks.workunit.client.0.smithi008.stdout:4/923: symlink d0/d76/l13a 0 2023-10-18T20:58:51.770 INFO:tasks.workunit.client.0.smithi008.stdout:4/924: rename d0/d17/f6a to d0/d17/d5b/d99/f13b 0 2023-10-18T20:58:51.784 INFO:tasks.workunit.client.0.smithi008.stdout:9/840: sync 2023-10-18T20:58:51.787 INFO:tasks.workunit.client.0.smithi008.stdout:9/841: unlink d2/c28 0 2023-10-18T20:58:51.787 INFO:tasks.workunit.client.0.smithi008.stdout:5/920: dwrite d0/d2/d9/d9b/d12e/d70/fa8 [4194304,4194304] 0 2023-10-18T20:58:51.790 INFO:tasks.workunit.client.0.smithi008.stdout:9/842: write d2/d8/da0/fb0 [477682,59333] 0 2023-10-18T20:58:51.799 INFO:tasks.workunit.client.0.smithi008.stdout:5/921: link d0/d2/d9/d34/f3b d0/da9/dda/d100/d136/f149 0 2023-10-18T20:58:51.802 INFO:tasks.workunit.client.0.smithi008.stdout:9/843: rename d2/dc/d40/d5a/f95 to d2/dc/d40/d46/ffa 0 2023-10-18T20:58:51.830 INFO:tasks.workunit.client.0.smithi008.stdout:0/934: sync 2023-10-18T20:58:51.832 INFO:tasks.workunit.client.0.smithi008.stdout:9/844: rmdir d2/dc 39 2023-10-18T20:58:51.832 INFO:tasks.workunit.client.0.smithi008.stdout:9/845: write d2/d8/db1/fea [731301,44791] 0 2023-10-18T20:58:51.833 INFO:tasks.workunit.client.0.smithi008.stdout:9/846: chown d2/dc/d17/c43 703838 1 2023-10-18T20:58:51.835 INFO:tasks.workunit.client.0.smithi008.stdout:0/935: mknod d0/dd/dea/c137 0 2023-10-18T20:58:51.837 INFO:tasks.workunit.client.0.smithi008.stdout:0/936: symlink d0/d7c/d9a/dce/l138 0 2023-10-18T20:58:51.839 INFO:tasks.workunit.client.0.smithi008.stdout:7/944: dwrite d1/d36/d3d/d3e/d59/f9b [0,4194304] 0 2023-10-18T20:58:51.842 INFO:tasks.workunit.client.0.smithi008.stdout:7/945: mkdir d1/d36/d3d/d3e/d59/d116/de8/d5f/dba/ded/d12c 0 2023-10-18T20:58:51.842 INFO:tasks.workunit.client.0.smithi008.stdout:7/946: stat d1/da6/d4f/d87/l9e 0 2023-10-18T20:58:51.843 INFO:tasks.workunit.client.0.smithi008.stdout:7/947: write d1/d36/d3d/d3e/d59/fec [2229498,39160] 0 2023-10-18T20:58:51.843 INFO:tasks.workunit.client.0.smithi008.stdout:7/948: chown d1/d36/d3d/d3e/d59/d73/d7b/l81 4095028 1 2023-10-18T20:58:51.846 INFO:tasks.workunit.client.0.smithi008.stdout:7/949: getdents d1/d36/d3d/d3e/d59/d116/de8/d5f/dba/ddd 0 2023-10-18T20:58:51.846 INFO:tasks.workunit.client.0.smithi008.stdout:7/950: chown d1/da6/d79/f4a 11488 1 2023-10-18T20:58:51.849 INFO:tasks.workunit.client.0.smithi008.stdout:4/925: dwrite d0/d17/d5b/d99/ff7 [0,4194304] 0 2023-10-18T20:58:51.849 INFO:tasks.workunit.client.0.smithi008.stdout:4/926: chown d0/ca7 455894776 1 2023-10-18T20:58:51.849 INFO:tasks.workunit.client.0.smithi008.stdout:4/927: read d0/f13 [3358881,22405] 0 2023-10-18T20:58:51.851 INFO:tasks.workunit.client.0.smithi008.stdout:5/922: write d0/d2/d19/d7c/f6b [2878191,85180] 0 2023-10-18T20:58:51.861 INFO:tasks.workunit.client.0.smithi008.stdout:0/937: rename d0/dd/d19/d5f to d0/d90/d139 0 2023-10-18T20:58:51.861 INFO:tasks.workunit.client.0.smithi008.stdout:9/847: dread d2/dc/d40/ff1 [0,4194304] 0 2023-10-18T20:58:51.862 INFO:tasks.workunit.client.0.smithi008.stdout:4/928: getdents d0/d17/d6e 0 2023-10-18T20:58:51.862 INFO:tasks.workunit.client.0.smithi008.stdout:4/929: creat d0/d17/d5b/f13c x:0 0 0 2023-10-18T20:58:51.863 INFO:tasks.workunit.client.0.smithi008.stdout:9/848: getdents d2/d8/db1/dd3/d59 0 2023-10-18T20:58:51.863 INFO:tasks.workunit.client.0.smithi008.stdout:9/849: chown d2/dc/d17/d19/df7 21 1 2023-10-18T20:58:51.868 INFO:tasks.workunit.client.0.smithi008.stdout:4/930: rename d0/d17/d5b/d2a/l3f to d0/d3/l13d 0 2023-10-18T20:58:51.871 INFO:tasks.workunit.client.0.smithi008.stdout:9/850: unlink d2/dc/d1a/d1d/l39 0 2023-10-18T20:58:51.871 INFO:tasks.workunit.client.0.smithi008.stdout:9/851: write d2/dc/d1a/d1d/f63 [1116641,10906] 0 2023-10-18T20:58:51.874 INFO:tasks.workunit.client.0.smithi008.stdout:0/938: mknod d0/d7c/d9a/d8a/d8f/d21/df7/c13a 0 2023-10-18T20:58:51.876 INFO:tasks.workunit.client.0.smithi008.stdout:7/951: write d1/d36/d3d/d3e/d59/d116/de8/f89 [1740534,105436] 0 2023-10-18T20:58:51.881 INFO:tasks.workunit.client.0.smithi008.stdout:4/931: rmdir d0/d3/d21/d57/d8f/d82 39 2023-10-18T20:58:51.881 INFO:tasks.workunit.client.0.smithi008.stdout:4/932: fdatasync d0/d3/fa5 0 2023-10-18T20:58:51.881 INFO:tasks.workunit.client.0.smithi008.stdout:4/933: read - d0/d17/d5b/d45/ff5 zero size 2023-10-18T20:58:51.881 INFO:tasks.workunit.client.0.smithi008.stdout:4/934: fsync d0/d17/d6e/f103 0 2023-10-18T20:58:51.883 INFO:tasks.workunit.client.0.smithi008.stdout:9/852: read d2/f5 [1704097,76234] 0 2023-10-18T20:58:51.883 INFO:tasks.workunit.client.0.smithi008.stdout:9/853: dread - d2/dc/d40/d46/ddc/f69 zero size 2023-10-18T20:58:51.885 INFO:tasks.workunit.client.0.smithi008.stdout:7/952: creat d1/d36/d3d/d3e/d59/d116/de8/d54/f12d x:0 0 0 2023-10-18T20:58:51.885 INFO:tasks.workunit.client.0.smithi008.stdout:7/953: readlink d1/d3/l6d 0 2023-10-18T20:58:51.885 INFO:tasks.workunit.client.0.smithi008.stdout:7/954: stat d1/d36/d3d/d3e/d59/d73/d7b/daf/de5 0 2023-10-18T20:58:51.887 INFO:tasks.workunit.client.0.smithi008.stdout:0/939: getdents d0/d7c/d9a/d8a/d8f/da5 0 2023-10-18T20:58:51.889 INFO:tasks.workunit.client.0.smithi008.stdout:4/935: symlink d0/d12c/l13e 0 2023-10-18T20:58:51.892 INFO:tasks.workunit.client.0.smithi008.stdout:9/854: truncate d2/dc/d17/d19/d4a/fab 516614 0 2023-10-18T20:58:51.900 INFO:tasks.workunit.client.0.smithi008.stdout:0/940: mkdir d0/d90/d13b 0 2023-10-18T20:58:51.906 INFO:tasks.workunit.client.0.smithi008.stdout:9/855: mkdir d2/dc/d40/d5a/dfb 0 2023-10-18T20:58:51.915 INFO:tasks.workunit.client.0.smithi008.stdout:9/856: rename d2/dc/d17/d19/l49 to d2/dc/d1a/d1d/da7/lfc 0 2023-10-18T20:58:51.923 INFO:tasks.workunit.client.0.smithi008.stdout:9/857: rmdir d2/dc/d40/dce/de3 39 2023-10-18T20:58:51.936 INFO:tasks.workunit.client.0.smithi008.stdout:0/941: write d0/d7c/d9a/d8a/d8f/f77 [1498324,79799] 0 2023-10-18T20:58:51.942 INFO:tasks.workunit.client.0.smithi008.stdout:9/858: write d2/dc/d3d/d99/fd6 [2634355,61917] 0 2023-10-18T20:58:51.948 INFO:tasks.workunit.client.0.smithi008.stdout:9/859: creat d2/dc/d1a/ffd x:0 0 0 2023-10-18T20:58:51.948 INFO:tasks.workunit.client.0.smithi008.stdout:9/860: chown d2/dc/d40/dce/ff6 3 1 2023-10-18T20:58:51.957 INFO:tasks.workunit.client.0.smithi008.stdout:0/942: read d0/dd/d19/fa8 [533195,58884] 0 2023-10-18T20:58:51.957 INFO:tasks.workunit.client.0.smithi008.stdout:0/943: fsync d0/dd/df/dd9/f128 0 2023-10-18T20:58:51.958 INFO:tasks.workunit.client.0.smithi008.stdout:0/944: dread - d0/d90/d139/d89/da7/dac/fcb zero size 2023-10-18T20:58:51.958 INFO:tasks.workunit.client.0.smithi008.stdout:7/955: dwrite d1/da6/d4f/f5e [0,4194304] 0 2023-10-18T20:58:51.960 INFO:tasks.workunit.client.0.smithi008.stdout:9/861: creat d2/dc/d17/d19/df7/dc9/ffe x:0 0 0 2023-10-18T20:58:51.961 INFO:tasks.workunit.client.0.smithi008.stdout:7/956: creat d1/d36/d3d/d3e/d59/d116/de8/d5f/f12e x:0 0 0 2023-10-18T20:58:51.961 INFO:tasks.workunit.client.0.smithi008.stdout:7/957: fdatasync d1/d3/f2a 0 2023-10-18T20:58:51.962 INFO:tasks.workunit.client.0.smithi008.stdout:7/958: fdatasync d1/da6/d4f/d87/fb3 0 2023-10-18T20:58:51.964 INFO:tasks.workunit.client.0.smithi008.stdout:7/959: creat d1/da6/d4f/dc9/f12f x:0 0 0 2023-10-18T20:58:51.966 INFO:tasks.workunit.client.0.smithi008.stdout:7/960: creat d1/d36/d3d/d3e/d59/d116/de8/de7/f130 x:0 0 0 2023-10-18T20:58:51.966 INFO:tasks.workunit.client.0.smithi008.stdout:4/936: dwrite d0/d17/d5b/f12f [0,4194304] 0 2023-10-18T20:58:51.967 INFO:tasks.workunit.client.0.smithi008.stdout:4/937: chown d0/d17/d5b/d2a/c61 8319 1 2023-10-18T20:58:51.979 INFO:tasks.workunit.client.0.smithi008.stdout:7/961: creat d1/d36/d3d/d3e/d59/d116/de8/d5f/dba/dcc/f131 x:0 0 0 2023-10-18T20:58:51.979 INFO:tasks.workunit.client.0.smithi008.stdout:4/938: mknod d0/d58/d83/c13f 0 2023-10-18T20:58:51.985 INFO:tasks.workunit.client.0.smithi008.stdout:7/962: creat d1/d36/d3d/d3e/d59/d116/de8/d5f/d78/f132 x:0 0 0 2023-10-18T20:58:51.991 INFO:tasks.workunit.client.0.smithi008.stdout:7/963: chown d1 2 1 2023-10-18T20:58:52.009 INFO:tasks.workunit.client.0.smithi008.stdout:7/964: dread d1/d3/fc0 [4194304,4194304] 0 2023-10-18T20:58:52.011 INFO:tasks.workunit.client.0.smithi008.stdout:7/965: truncate d1/da6/d4f/dc9/fd8 3411534 0 2023-10-18T20:58:52.011 INFO:tasks.workunit.client.0.smithi008.stdout:7/966: fsync d1/d36/d3d/d3e/d59/d73/fb8 0 2023-10-18T20:58:52.018 INFO:tasks.workunit.client.0.smithi008.stdout:9/862: dwrite d2/dc/d1a/f5b [0,4194304] 0 2023-10-18T20:58:52.018 INFO:tasks.workunit.client.0.smithi008.stdout:7/967: rename d1/d3/d8b/l10c to d1/d36/l133 0 2023-10-18T20:58:52.018 INFO:tasks.workunit.client.0.smithi008.stdout:7/968: chown d1/d3/l11 1 1 2023-10-18T20:58:52.019 INFO:tasks.workunit.client.0.smithi008.stdout:7/969: getdents d1/d36/d3d/d3e/d59/d116/de8/dbe 0 2023-10-18T20:58:52.020 INFO:tasks.workunit.client.0.smithi008.stdout:7/970: write d1/da6/d4f/d5c/f84 [140233,83057] 0 2023-10-18T20:58:52.023 INFO:tasks.workunit.client.0.smithi008.stdout:7/971: mkdir d1/d36/d3d/d3e/d59/d116/de8/dbe/d134 0 2023-10-18T20:58:52.026 INFO:tasks.workunit.client.0.smithi008.stdout:7/972: truncate d1/f1b 3967550 0 2023-10-18T20:58:52.032 INFO:tasks.workunit.client.0.smithi008.stdout:4/939: dwrite d0/d17/d5b/d45/fe3 [0,4194304] 0 2023-10-18T20:58:52.032 INFO:tasks.workunit.client.0.smithi008.stdout:7/973: mknod d1/d36/d3d/d3e/d59/d116/de8/dbe/df2/d119/c135 0 2023-10-18T20:58:52.032 INFO:tasks.workunit.client.0.smithi008.stdout:7/974: getdents d1/d36/d3d/d3e/d59/d73/d7b/daf/d111/dcb 0 2023-10-18T20:58:52.032 INFO:tasks.workunit.client.0.smithi008.stdout:7/975: chown d1/da6/d4f/d87/cfd 7353 1 2023-10-18T20:58:52.032 INFO:tasks.workunit.client.0.smithi008.stdout:7/976: creat d1/da6/d4f/d87/df9/f136 x:0 0 0 2023-10-18T20:58:52.033 INFO:tasks.workunit.client.0.smithi008.stdout:9/863: dread d2/f4 [0,4194304] 0 2023-10-18T20:58:52.033 INFO:tasks.workunit.client.0.smithi008.stdout:7/977: write d1/d36/d3d/d3e/d59/fe6 [624642,118890] 0 2023-10-18T20:58:52.033 INFO:tasks.workunit.client.0.smithi008.stdout:9/864: readlink d2/dc/d1a/d1d/l27 0 2023-10-18T20:58:52.036 INFO:tasks.workunit.client.0.smithi008.stdout:4/940: rename d0/f13 to d0/d58/d8e/f140 0 2023-10-18T20:58:52.043 INFO:tasks.workunit.client.0.smithi008.stdout:9/865: dread d2/d8/db1/dd3/fc5 [0,4194304] 0 2023-10-18T20:58:52.043 INFO:tasks.workunit.client.0.smithi008.stdout:4/941: symlink d0/d3/d21/d57/d8f/d82/l141 0 2023-10-18T20:58:52.043 INFO:tasks.workunit.client.0.smithi008.stdout:4/942: creat d0/d58/dc7/f142 x:0 0 0 2023-10-18T20:58:52.043 INFO:tasks.workunit.client.0.smithi008.stdout:4/943: fdatasync d0/d17/d5b/f5f 0 2023-10-18T20:58:52.044 INFO:tasks.workunit.client.0.smithi008.stdout:4/944: fsync d0/d58/d8e/ffd 0 2023-10-18T20:58:52.047 INFO:tasks.workunit.client.0.smithi008.stdout:7/978: dread d1/d36/d3d/d3e/f31 [0,4194304] 0 2023-10-18T20:58:52.047 INFO:tasks.workunit.client.0.smithi008.stdout:4/945: unlink d0/d17/d5b/d99/f13b 0 2023-10-18T20:58:52.047 INFO:tasks.workunit.client.0.smithi008.stdout:7/979: fsync d1/d36/fac 0 2023-10-18T20:58:52.048 INFO:tasks.workunit.client.0.smithi008.stdout:4/946: stat d0/d17/f1a 0 2023-10-18T20:58:52.048 INFO:tasks.workunit.client.0.smithi008.stdout:4/947: chown d0/d17/d5b/l7d 1129 1 2023-10-18T20:58:52.049 INFO:tasks.workunit.client.0.smithi008.stdout:7/980: creat d1/d36/d3d/d3e/d59/d116/de8/dbe/f137 x:0 0 0 2023-10-18T20:58:52.053 INFO:tasks.workunit.client.0.smithi008.stdout:7/981: symlink d1/d36/d3d/d3e/d59/d116/de8/d5f/d78/da2/l138 0 2023-10-18T20:58:52.055 INFO:tasks.workunit.client.0.smithi008.stdout:7/982: mknod d1/d36/d3d/d3e/d59/d116/de8/d103/c139 0 2023-10-18T20:58:52.056 INFO:tasks.workunit.client.0.smithi008.stdout:7/983: truncate d1/d36/d3d/d3e/d59/d116/de8/f89 1058001 0 2023-10-18T20:58:52.060 INFO:tasks.workunit.client.0.smithi008.stdout:9/866: dread d2/dc/d1a/d1d/fe7 [0,4194304] 0 2023-10-18T20:58:52.060 INFO:tasks.workunit.client.0.smithi008.stdout:9/867: write d2/d8/f83 [1826821,129036] 0 2023-10-18T20:58:52.060 INFO:tasks.workunit.client.0.smithi008.stdout:9/868: dread - d2/dc/d40/dce/de3/feb zero size 2023-10-18T20:58:52.061 INFO:tasks.workunit.client.0.smithi008.stdout:7/984: creat d1/d36/d3d/f13a x:0 0 0 2023-10-18T20:58:52.061 INFO:tasks.workunit.client.0.smithi008.stdout:7/985: dread - d1/d3/f82 zero size 2023-10-18T20:58:52.061 INFO:tasks.workunit.client.0.smithi008.stdout:7/986: creat d1/da6/d4f/dc9/f13b x:0 0 0 2023-10-18T20:58:52.063 INFO:tasks.workunit.client.0.smithi008.stdout:9/869: rename d2/d8/db1/dd3/fbe to d2/d8/fff 0 2023-10-18T20:58:52.072 INFO:tasks.workunit.client.0.smithi008.stdout:4/948: link d0/d58/d8e/f140 d0/d3/d21/f143 0 2023-10-18T20:58:52.074 INFO:tasks.workunit.client.0.smithi008.stdout:7/987: write d1/d36/d3d/d3e/d59/d116/fa9 [3782667,92801] 0 2023-10-18T20:58:52.075 INFO:tasks.workunit.client.0.smithi008.stdout:7/988: dread - d1/d36/d3d/d3e/d59/d73/d7b/daf/d111/fb6 zero size 2023-10-18T20:58:52.075 INFO:tasks.workunit.client.0.smithi008.stdout:7/989: readlink d1/d3/d8b/da5/lb2 0 2023-10-18T20:58:52.075 INFO:tasks.workunit.client.0.smithi008.stdout:7/990: dread - d1/d36/d3d/d3e/d59/d116/de8/feb zero size 2023-10-18T20:58:52.079 INFO:tasks.workunit.client.0.smithi008.stdout:4/949: mknod d0/d58/d8e/c144 0 2023-10-18T20:58:52.080 INFO:tasks.workunit.client.0.smithi008.stdout:9/870: dread d2/dc/d40/d46/ffa [0,4194304] 0 2023-10-18T20:58:52.080 INFO:tasks.workunit.client.0.smithi008.stdout:7/991: mknod d1/d36/d3d/d3e/d59/d116/c13c 0 2023-10-18T20:58:52.084 INFO:tasks.workunit.client.0.smithi008.stdout:4/950: rename d0/d58/c138 to d0/d3/d21/d57/d8f/d73/c145 0 2023-10-18T20:58:52.111 INFO:tasks.workunit.client.0.smithi008.stdout:7/992: write d1/d36/d3d/d3e/d59/d73/fb8 [3727677,3686] 0 2023-10-18T20:58:52.111 INFO:tasks.workunit.client.0.smithi008.stdout:7/993: creat d1/da6/d4f/d87/df9/f13d x:0 0 0 2023-10-18T20:58:52.128 INFO:tasks.workunit.client.0.smithi008.stdout:7/994: read d1/f6 [2370208,54501] 0 2023-10-18T20:58:52.128 INFO:tasks.workunit.client.0.smithi008.stdout:7/995: stat d1/d3/f14 0 2023-10-18T20:58:52.128 INFO:tasks.workunit.client.0.smithi008.stdout:9/871: dwrite d2/dc/f1c [0,4194304] 0 2023-10-18T20:58:52.130 INFO:tasks.workunit.client.0.smithi008.stdout:9/872: symlink d2/dc/d40/d5a/dfb/l100 0 2023-10-18T20:58:52.132 INFO:tasks.workunit.client.0.smithi008.stdout:9/873: link d2/dc/d17/d19/d4a/cf4 d2/dc/d3d/d99/c101 0 2023-10-18T20:58:52.133 INFO:tasks.workunit.client.0.smithi008.stdout:9/874: stat d2/dc/c52 0 2023-10-18T20:58:52.136 INFO:tasks.workunit.client.0.smithi008.stdout:7/996: dread d1/d36/d3d/d3e/d59/d116/de8/d5f/d7f/fda [0,4194304] 0 2023-10-18T20:58:52.138 INFO:tasks.workunit.client.0.smithi008.stdout:7/997: rename d1/d36/c7c to d1/d36/d3d/d3e/d59/d116/de8/d5f/dba/dcc/d109/c13e 0 2023-10-18T20:58:52.138 INFO:tasks.workunit.client.0.smithi008.stdout:4/951: dwrite d0/d58/d8e/f140 [4194304,4194304] 0 2023-10-18T20:58:52.139 INFO:tasks.workunit.client.0.smithi008.stdout:4/952: chown d0/d3/d21/d57/d8f/lf2 95052006 1 2023-10-18T20:58:52.139 INFO:tasks.workunit.client.0.smithi008.stdout:4/953: readlink d0/d17/d5b/d45/lb3 0 2023-10-18T20:58:52.141 INFO:tasks.workunit.client.0.smithi008.stdout:7/998: creat d1/d36/d3d/d3e/d59/d73/d7b/daf/de5/f13f x:0 0 0 2023-10-18T20:58:52.151 INFO:tasks.workunit.client.0.smithi008.stdout:7/999: getdents d1/d36/d3d/d3e/d59/d116/de8/d5f/dba/dcc/d109 0 2023-10-18T20:58:52.153 INFO:tasks.workunit.client.0.smithi008.stdout:4/954: rmdir d0/d17 39 2023-10-18T20:58:52.155 INFO:tasks.workunit.client.0.smithi008.stdout:5/923: sync 2023-10-18T20:58:52.155 INFO:tasks.workunit.client.0.smithi008.stdout:5/924: write d0/d2/d9/d9b/dba/f118 [48950,26206] 0 2023-10-18T20:58:52.178 INFO:tasks.workunit.client.0.smithi008.stdout:5/925: symlink d0/d2/d19/d7c/d31/d80/d91/l14a 0 2023-10-18T20:58:52.201 INFO:tasks.workunit.client.0.smithi008.stdout:0/945: sync 2023-10-18T20:58:52.201 INFO:tasks.workunit.client.0.smithi008.stdout:0/946: chown d0/dd/d19/d24/de5/cfd 61639 1 2023-10-18T20:58:52.201 INFO:tasks.workunit.client.0.smithi008.stdout:0/947: creat d0/dd/d19/d24/de5/f13c x:0 0 0 2023-10-18T20:58:52.201 INFO:tasks.workunit.client.0.smithi008.stdout:0/948: dread - d0/d7c/d9a/f111 zero size 2023-10-18T20:58:52.203 INFO:tasks.workunit.client.0.smithi008.stdout:9/875: dwrite d2/dc/d3d/f73 [0,4194304] 0 2023-10-18T20:58:52.208 INFO:tasks.workunit.client.0.smithi008.stdout:5/926: rmdir d0/d2/d9/daa 39 2023-10-18T20:58:52.212 INFO:tasks.workunit.client.0.smithi008.stdout:0/949: mkdir d0/dd/dea/d13d 0 2023-10-18T20:58:52.214 INFO:tasks.workunit.client.0.smithi008.stdout:9/876: mkdir d2/dc/d3d/d102 0 2023-10-18T20:58:52.215 INFO:tasks.workunit.client.0.smithi008.stdout:9/877: fdatasync d2/dc/d1a/f97 0 2023-10-18T20:58:52.218 INFO:tasks.workunit.client.0.smithi008.stdout:0/950: getdents d0/dd/df/dd9 0 2023-10-18T20:58:52.224 INFO:tasks.workunit.client.0.smithi008.stdout:5/927: dread d0/d2/d9/d9b/f11c [0,4194304] 0 2023-10-18T20:58:52.235 INFO:tasks.workunit.client.0.smithi008.stdout:9/878: dread d2/dc/d17/d7b/fa2 [0,4194304] 0 2023-10-18T20:58:52.243 INFO:tasks.workunit.client.0.smithi008.stdout:9/879: mknod d2/dc/d40/d56/c103 0 2023-10-18T20:58:52.261 INFO:tasks.workunit.client.0.smithi008.stdout:9/880: dread d2/d8/db1/dd3/d59/fa9 [0,4194304] 0 2023-10-18T20:58:52.266 INFO:tasks.workunit.client.0.smithi008.stdout:9/881: creat d2/dc/d3d/d102/f104 x:0 0 0 2023-10-18T20:58:52.266 INFO:tasks.workunit.client.0.smithi008.stdout:9/882: dread - d2/dc/d40/d5a/faf zero size 2023-10-18T20:58:52.266 INFO:tasks.workunit.client.0.smithi008.stdout:9/883: readlink d2/dc/d3d/l47 0 2023-10-18T20:58:52.277 INFO:tasks.workunit.client.0.smithi008.stdout:9/884: dread d2/dc/d1a/d1d/f3c [4194304,4194304] 0 2023-10-18T20:58:52.277 INFO:tasks.workunit.client.0.smithi008.stdout:9/885: chown d2/dc/f4b 306406635 1 2023-10-18T20:58:52.277 INFO:tasks.workunit.client.0.smithi008.stdout:9/886: write d2/d8/da0/fb0 [1834695,17568] 0 2023-10-18T20:58:52.283 INFO:tasks.workunit.client.0.smithi008.stdout:9/887: symlink d2/dc/d3d/d99/da4/l105 0 2023-10-18T20:58:52.293 INFO:tasks.workunit.client.0.smithi008.stdout:9/888: getdents d2/dc/d3d/d99 0 2023-10-18T20:58:52.296 INFO:tasks.workunit.client.0.smithi008.stdout:4/955: rmdir d0/d17 39 2023-10-18T20:58:52.296 INFO:tasks.workunit.client.0.smithi008.stdout:4/956: chown d0/d3/d21/d57/d8f/d95/f105 383 1 2023-10-18T20:58:52.299 INFO:tasks.workunit.client.0.smithi008.stdout:4/957: getdents d0/d3/d21/d57/d8f 0 2023-10-18T20:58:52.313 INFO:tasks.workunit.client.0.smithi008.stdout:9/889: write d2/dc/d40/d5a/fa3 [11090040,85055] 0 2023-10-18T20:58:52.313 INFO:tasks.workunit.client.0.smithi008.stdout:9/890: chown d2/d8/db1/dd3/cf5 6834 1 2023-10-18T20:58:52.314 INFO:tasks.workunit.client.0.smithi008.stdout:5/928: dwrite d0/d2/ffe [0,4194304] 0 2023-10-18T20:58:52.314 INFO:tasks.workunit.client.0.smithi008.stdout:5/929: fdatasync d0/d2/d9/d9b/d12e/d9a/fd4 0 2023-10-18T20:58:52.315 INFO:tasks.workunit.client.0.smithi008.stdout:0/951: dwrite d0/d7c/d9a/d8a/d8f/f62 [0,4194304] 0 2023-10-18T20:58:52.319 INFO:tasks.workunit.client.0.smithi008.stdout:4/958: symlink d0/d3/d21/l146 0 2023-10-18T20:58:52.326 INFO:tasks.workunit.client.0.smithi008.stdout:5/930: link d0/d86/fae d0/d2/d19/d7c/d42/f14b 0 2023-10-18T20:58:52.328 INFO:tasks.workunit.client.0.smithi008.stdout:4/959: dread d0/d3/d21/f5a [0,4194304] 0 2023-10-18T20:58:52.337 INFO:tasks.workunit.client.0.smithi008.stdout:0/952: write d0/d7c/d9a/d8a/d8f/f62 [3469951,8746] 0 2023-10-18T20:58:52.337 INFO:tasks.workunit.client.0.smithi008.stdout:0/953: write d0/d90/d139/d99/d5e/d7d/db7/fbe [920916,116143] 0 2023-10-18T20:58:52.339 INFO:tasks.workunit.client.0.smithi008.stdout:5/931: creat d0/d2/d9/d9b/d12e/d70/da4/f14c x:0 0 0 2023-10-18T20:58:52.339 INFO:tasks.workunit.client.0.smithi008.stdout:5/932: dread - d0/d2/f10d zero size 2023-10-18T20:58:52.339 INFO:tasks.workunit.client.0.smithi008.stdout:5/933: getdents d0/d2/d19/d7c/d58/d65/d68 0 2023-10-18T20:58:52.340 INFO:tasks.workunit.client.0.smithi008.stdout:5/934: fsync d0/d2/d9/d9b/d12e/fdf 0 2023-10-18T20:58:52.340 INFO:tasks.workunit.client.0.smithi008.stdout:5/935: chown d0/de/l9c 45545891 1 2023-10-18T20:58:52.341 INFO:tasks.workunit.client.0.smithi008.stdout:4/960: mknod d0/d3/d21/d57/c147 0 2023-10-18T20:58:52.341 INFO:tasks.workunit.client.0.smithi008.stdout:4/961: stat d0/d3/d21/d57/d8f/d82 0 2023-10-18T20:58:52.341 INFO:tasks.workunit.client.0.smithi008.stdout:4/962: dread - d0/d58/fe7 zero size 2023-10-18T20:58:52.341 INFO:tasks.workunit.client.0.smithi008.stdout:4/963: fdatasync d0/d58/d8e/ffd 0 2023-10-18T20:58:52.342 INFO:tasks.workunit.client.0.smithi008.stdout:4/964: write d0/d76/fa1 [1773763,50919] 0 2023-10-18T20:58:52.343 INFO:tasks.workunit.client.0.smithi008.stdout:0/954: symlink d0/dd/df/l13e 0 2023-10-18T20:58:52.345 INFO:tasks.workunit.client.0.smithi008.stdout:0/955: symlink d0/d7c/d9a/d8a/l13f 0 2023-10-18T20:58:52.345 INFO:tasks.workunit.client.0.smithi008.stdout:0/956: write d0/d90/d139/d99/f80 [2056920,39489] 0 2023-10-18T20:58:52.346 INFO:tasks.workunit.client.0.smithi008.stdout:0/957: chown d0/d90/d139/d89 32714 1 2023-10-18T20:58:52.348 INFO:tasks.workunit.client.0.smithi008.stdout:5/936: dread d0/d2/d9/d9b/d62/fac [0,4194304] 0 2023-10-18T20:58:52.349 INFO:tasks.workunit.client.0.smithi008.stdout:0/958: creat d0/d90/d139/d99/d5e/d7d/f140 x:0 0 0 2023-10-18T20:58:52.350 INFO:tasks.workunit.client.0.smithi008.stdout:0/959: write d0/dd/d19/d24/de5/f13c [388836,126592] 0 2023-10-18T20:58:52.351 INFO:tasks.workunit.client.0.smithi008.stdout:5/937: rmdir d0/d2/d9/d9b/de7/d11f 39 2023-10-18T20:58:52.353 INFO:tasks.workunit.client.0.smithi008.stdout:0/960: getdents d0/dd/d19 0 2023-10-18T20:58:52.354 INFO:tasks.workunit.client.0.smithi008.stdout:0/961: chown d0/dd/lfb 79 1 2023-10-18T20:58:52.354 INFO:tasks.workunit.client.0.smithi008.stdout:0/962: dread - d0/d7c/d9a/d8a/d8f/d21/df7/d61/f102 zero size 2023-10-18T20:58:52.356 INFO:tasks.workunit.client.0.smithi008.stdout:5/938: mkdir d0/dec/d12f/d14d 0 2023-10-18T20:58:52.359 INFO:tasks.workunit.client.0.smithi008.stdout:0/963: creat d0/d90/d13b/f141 x:0 0 0 2023-10-18T20:58:52.359 INFO:tasks.workunit.client.0.smithi008.stdout:0/964: write d0/dd/d19/d24/f11e [391589,5357] 0 2023-10-18T20:58:52.360 INFO:tasks.workunit.client.0.smithi008.stdout:5/939: symlink d0/d2/d19/d7c/d42/d5a/l14e 0 2023-10-18T20:58:52.362 INFO:tasks.workunit.client.0.smithi008.stdout:5/940: rmdir d0/d2/d9/d9b/d12e/d9a 39 2023-10-18T20:58:52.365 INFO:tasks.workunit.client.0.smithi008.stdout:5/941: creat d0/dec/d12f/f14f x:0 0 0 2023-10-18T20:58:52.368 INFO:tasks.workunit.client.0.smithi008.stdout:5/942: rename d0/d2/d9/c47 to d0/d2/d19/d7c/d31/d82/c150 0 2023-10-18T20:58:52.404 INFO:tasks.workunit.client.0.smithi008.stdout:4/965: dwrite d0/d3/d21/d57/d8f/d82/f9d [0,4194304] 0 2023-10-18T20:58:52.414 INFO:tasks.workunit.client.0.smithi008.stdout:0/965: dwrite d0/d7c/f39 [0,4194304] 0 2023-10-18T20:58:52.421 INFO:tasks.workunit.client.0.smithi008.stdout:0/966: stat d0/d7c/d9a/d8a/d8f/d21/df7/c4d 0 2023-10-18T20:58:52.442 INFO:tasks.workunit.client.0.smithi008.stdout:4/966: dwrite d0/d3/d21/d57/d8f/d82/fb1 [0,4194304] 0 2023-10-18T20:58:52.442 INFO:tasks.workunit.client.0.smithi008.stdout:4/967: chown d0/d58/d8e/dd2 0 1 2023-10-18T20:58:52.444 INFO:tasks.workunit.client.0.smithi008.stdout:4/968: symlink d0/d12b/l148 0 2023-10-18T20:58:52.446 INFO:tasks.workunit.client.0.smithi008.stdout:4/969: creat d0/d58/dbf/f149 x:0 0 0 2023-10-18T20:58:52.446 INFO:tasks.workunit.client.0.smithi008.stdout:4/970: truncate d0/d3/fb5 147376 0 2023-10-18T20:58:52.447 INFO:tasks.workunit.client.0.smithi008.stdout:4/971: chown d0/f11d 450084 1 2023-10-18T20:58:52.447 INFO:tasks.workunit.client.0.smithi008.stdout:4/972: creat d0/d58/dc7/f14a x:0 0 0 2023-10-18T20:58:52.447 INFO:tasks.workunit.client.0.smithi008.stdout:4/973: write d0/d3/d21/d57/d8f/f72 [4282757,88989] 0 2023-10-18T20:58:52.448 INFO:tasks.workunit.client.0.smithi008.stdout:4/974: mkdir d0/d14b 0 2023-10-18T20:58:52.450 INFO:tasks.workunit.client.0.smithi008.stdout:4/975: creat d0/d3/d21/d57/d8f/d73/f14c x:0 0 0 2023-10-18T20:58:52.450 INFO:tasks.workunit.client.0.smithi008.stdout:4/976: dread - d0/d17/f115 zero size 2023-10-18T20:58:52.450 INFO:tasks.workunit.client.0.smithi008.stdout:4/977: fsync d0/d17/d5b/d99/fb6 0 2023-10-18T20:58:52.451 INFO:tasks.workunit.client.0.smithi008.stdout:4/978: truncate d0/d3/d21/d57/d8f/f88 1609154 0 2023-10-18T20:58:52.453 INFO:tasks.workunit.client.0.smithi008.stdout:4/979: link d0/d3/d21/d57/d11e/l128 d0/d3/d21/d57/d8f/d82/l14d 0 2023-10-18T20:58:52.453 INFO:tasks.workunit.client.0.smithi008.stdout:4/980: fdatasync d0/d3/f41 0 2023-10-18T20:58:52.454 INFO:tasks.workunit.client.0.smithi008.stdout:4/981: write d0/d3/d21/d57/d8f/fdc [1598190,103041] 0 2023-10-18T20:58:52.472 INFO:tasks.workunit.client.0.smithi008.stdout:0/967: dwrite d0/d7c/f81 [0,4194304] 0 2023-10-18T20:58:52.478 INFO:tasks.workunit.client.0.smithi008.stdout:0/968: truncate d0/f14 2130910 0 2023-10-18T20:58:52.481 INFO:tasks.workunit.client.0.smithi008.stdout:0/969: getdents d0/dd/df 0 2023-10-18T20:58:52.484 INFO:tasks.workunit.client.0.smithi008.stdout:5/943: sync 2023-10-18T20:58:52.484 INFO:tasks.workunit.client.0.smithi008.stdout:9/891: sync 2023-10-18T20:58:52.487 INFO:tasks.workunit.client.0.smithi008.stdout:5/944: creat d0/d2/d19/d7c/d31/f151 x:0 0 0 2023-10-18T20:58:52.492 INFO:tasks.workunit.client.0.smithi008.stdout:5/945: rename d0/de/c5b to d0/dec/d12f/c152 0 2023-10-18T20:58:52.492 INFO:tasks.workunit.client.0.smithi008.stdout:5/946: creat d0/d2/d9/d9b/d62/f153 x:0 0 0 2023-10-18T20:58:52.492 INFO:tasks.workunit.client.0.smithi008.stdout:5/947: read - d0/d2/d9/d9b/d12e/f77 zero size 2023-10-18T20:58:52.498 INFO:tasks.workunit.client.0.smithi008.stdout:4/982: dwrite d0/d17/d5b/fcc [0,4194304] 0 2023-10-18T20:58:52.503 INFO:tasks.workunit.client.0.smithi008.stdout:4/983: rename d0/lac to d0/d3/d21/d57/d8f/l14e 0 2023-10-18T20:58:52.503 INFO:tasks.workunit.client.0.smithi008.stdout:4/984: fsync d0/d17/fab 0 2023-10-18T20:58:52.504 INFO:tasks.workunit.client.0.smithi008.stdout:4/985: dread - d0/d58/d8e/ffd zero size 2023-10-18T20:58:52.504 INFO:tasks.workunit.client.0.smithi008.stdout:0/970: dread d0/d90/d139/d99/f80 [0,4194304] 0 2023-10-18T20:58:52.527 INFO:tasks.workunit.client.0.smithi008.stdout:0/971: write d0/d90/fd8 [2794197,27314] 0 2023-10-18T20:58:52.528 INFO:tasks.workunit.client.0.smithi008.stdout:5/948: dread d0/d2/d19/d7c/d58/d65/fd5 [0,4194304] 0 2023-10-18T20:58:52.530 INFO:tasks.workunit.client.0.smithi008.stdout:5/949: write d0/d2/d9/d9b/d12e/fdf [164696,58342] 0 2023-10-18T20:58:52.531 INFO:tasks.workunit.client.0.smithi008.stdout:5/950: stat d0/d2/d9/d9b/d12e/d70/dc0/ddb/f139 0 2023-10-18T20:58:52.531 INFO:tasks.workunit.client.0.smithi008.stdout:5/951: stat d0/d2/d19/d7c/l38 0 2023-10-18T20:58:52.532 INFO:tasks.workunit.client.0.smithi008.stdout:5/952: readlink d0/d2/d19/d7c/l112 0 2023-10-18T20:58:52.532 INFO:tasks.workunit.client.0.smithi008.stdout:5/953: write d0/d2/d19/d7c/d58/d65/f2b [1066422,128523] 0 2023-10-18T20:58:52.532 INFO:tasks.workunit.client.0.smithi008.stdout:5/954: write d0/d2/d19/f33 [4717445,8953] 0 2023-10-18T20:58:52.533 INFO:tasks.workunit.client.0.smithi008.stdout:5/955: write d0/d2/d19/d7c/d31/d82/fe3 [1011708,104520] 0 2023-10-18T20:58:52.535 INFO:tasks.workunit.client.0.smithi008.stdout:5/956: mknod d0/de/d109/c154 0 2023-10-18T20:58:52.535 INFO:tasks.workunit.client.0.smithi008.stdout:9/892: dwrite d2/dc/d17/d19/f55 [0,4194304] 0 2023-10-18T20:58:52.539 INFO:tasks.workunit.client.0.smithi008.stdout:5/957: rename d0/d2/d9/d9b/f5e to d0/de/f155 0 2023-10-18T20:58:52.540 INFO:tasks.workunit.client.0.smithi008.stdout:9/893: creat d2/dc/d17/d19/d4a/d9a/f106 x:0 0 0 2023-10-18T20:58:52.540 INFO:tasks.workunit.client.0.smithi008.stdout:9/894: stat d2/dc/c52 0 2023-10-18T20:58:52.542 INFO:tasks.workunit.client.0.smithi008.stdout:9/895: mknod d2/dc/d40/d5a/c107 0 2023-10-18T20:58:52.542 INFO:tasks.workunit.client.0.smithi008.stdout:9/896: dread - d2/dc/d3d/d99/da4/fd0 zero size 2023-10-18T20:58:52.543 INFO:tasks.workunit.client.0.smithi008.stdout:9/897: read d2/dc/d3d/d99/fd6 [3325428,20731] 0 2023-10-18T20:58:52.543 INFO:tasks.workunit.client.0.smithi008.stdout:9/898: write d2/dc/d17/d19/d4a/db2/ff8 [206259,95374] 0 2023-10-18T20:58:52.547 INFO:tasks.workunit.client.0.smithi008.stdout:4/986: dwrite d0/fce [0,4194304] 0 2023-10-18T20:58:52.550 INFO:tasks.workunit.client.0.smithi008.stdout:4/987: getdents d0/d17/dc6 0 2023-10-18T20:58:52.550 INFO:tasks.workunit.client.0.smithi008.stdout:4/988: dread - d0/d76/f12a zero size 2023-10-18T20:58:52.550 INFO:tasks.workunit.client.0.smithi008.stdout:4/989: chown d0/d17/d6e/lc1 1646 1 2023-10-18T20:58:52.554 INFO:tasks.workunit.client.0.smithi008.stdout:4/990: mkdir d0/d3/d21/d57/d8f/d14f 0 2023-10-18T20:58:52.560 INFO:tasks.workunit.client.0.smithi008.stdout:4/991: truncate d0/d3/d21/fa2 3039229 0 2023-10-18T20:58:52.586 INFO:tasks.workunit.client.0.smithi008.stdout:9/899: dwrite d2/d8/db1/fcd [0,4194304] 0 2023-10-18T20:58:52.590 INFO:tasks.workunit.client.0.smithi008.stdout:9/900: unlink d2/dc/d1a/f5b 0 2023-10-18T20:58:52.591 INFO:tasks.workunit.client.0.smithi008.stdout:9/901: chown d2/dc/d17/l45 256952353 1 2023-10-18T20:58:52.610 INFO:tasks.workunit.client.0.smithi008.stdout:5/958: dwrite d0/d2/d9/d9b/d12e/d70/da4/faf [0,4194304] 0 2023-10-18T20:58:52.612 INFO:tasks.workunit.client.0.smithi008.stdout:0/972: dwrite d0/dd/d19/d24/f11e [0,4194304] 0 2023-10-18T20:58:52.618 INFO:tasks.workunit.client.0.smithi008.stdout:5/959: rmdir d0/da9 39 2023-10-18T20:58:52.621 INFO:tasks.workunit.client.0.smithi008.stdout:5/960: mknod d0/de/d134/c156 0 2023-10-18T20:58:52.639 INFO:tasks.workunit.client.0.smithi008.stdout:5/961: write d0/d2/d19/d7c/f95 [1434896,112649] 0 2023-10-18T20:58:52.640 INFO:tasks.workunit.client.0.smithi008.stdout:5/962: chown d0/ff7 4 1 2023-10-18T20:58:52.658 INFO:tasks.workunit.client.0.smithi008.stdout:0/973: dwrite d0/d7c/d9a/d8a/d8f/d21/fad [0,4194304] 0 2023-10-18T20:58:52.658 INFO:tasks.workunit.client.0.smithi008.stdout:0/974: write d0/d7c/d9a/d8a/d8f/f10f [219161,14556] 0 2023-10-18T20:58:52.660 INFO:tasks.workunit.client.0.smithi008.stdout:9/902: dwrite d2/dc/d1a/f54 [0,4194304] 0 2023-10-18T20:58:52.664 INFO:tasks.workunit.client.0.smithi008.stdout:9/903: symlink d2/dc/d1a/d1d/l108 0 2023-10-18T20:58:52.676 INFO:tasks.workunit.client.0.smithi008.stdout:0/975: dread d0/d7c/d9a/d8a/d8f/d21/df7/f5c [0,4194304] 0 2023-10-18T20:58:52.676 INFO:tasks.workunit.client.0.smithi008.stdout:0/976: readlink d0/d7c/d9a/d8a/d8f/d21/df7/d61/ld3 0 2023-10-18T20:58:52.678 INFO:tasks.workunit.client.0.smithi008.stdout:0/977: truncate d0/d90/d139/d99/d94/f65 1488811 0 2023-10-18T20:58:52.678 INFO:tasks.workunit.client.0.smithi008.stdout:0/978: creat d0/d90/d13b/f142 x:0 0 0 2023-10-18T20:58:52.680 INFO:tasks.workunit.client.0.smithi008.stdout:0/979: getdents d0/d90/d139/d89 0 2023-10-18T20:58:52.682 INFO:tasks.workunit.client.0.smithi008.stdout:9/904: write d2/dc/d17/f76 [2604913,56204] 0 2023-10-18T20:58:52.685 INFO:tasks.workunit.client.0.smithi008.stdout:0/980: rename d0/d7c/d9a/d8a/d8f/da5/f12f to d0/dd/dea/f143 0 2023-10-18T20:58:52.685 INFO:tasks.workunit.client.0.smithi008.stdout:0/981: chown d0/d90/d139/d89/da7/dac/ld0 632916 1 2023-10-18T20:58:52.690 INFO:tasks.workunit.client.0.smithi008.stdout:5/963: dwrite d0/d2/d19/d7c/f95 [0,4194304] 0 2023-10-18T20:58:52.692 INFO:tasks.workunit.client.0.smithi008.stdout:9/905: dread d2/dc/d17/d19/d4a/f68 [0,4194304] 0 2023-10-18T20:58:52.698 INFO:tasks.workunit.client.0.smithi008.stdout:5/964: mknod d0/d2/d19/d7c/d31/d82/df5/d111/c157 0 2023-10-18T20:58:52.702 INFO:tasks.workunit.client.0.smithi008.stdout:0/982: write d0/d90/d139/d89/da7/fba [2586724,31472] 0 2023-10-18T20:58:52.735 INFO:tasks.workunit.client.0.smithi008.stdout:4/992: sync 2023-10-18T20:58:52.743 INFO:tasks.workunit.client.0.smithi008.stdout:5/965: dwrite d0/d86/f8c [4194304,4194304] 0 2023-10-18T20:58:52.744 INFO:tasks.workunit.client.0.smithi008.stdout:5/966: dread - d0/d2/d19/d7c/d31/d82/fdc zero size 2023-10-18T20:58:52.771 INFO:tasks.workunit.client.0.smithi008.stdout:0/983: dwrite d0/dd/d19/d24/f11a [0,4194304] 0 2023-10-18T20:58:52.773 INFO:tasks.workunit.client.0.smithi008.stdout:0/984: chown d0/d7c/d9a/d8a/d8f/d21/df7/c7e 1869296 1 2023-10-18T20:58:52.773 INFO:tasks.workunit.client.0.smithi008.stdout:0/985: dread - d0/dd/df/feb zero size 2023-10-18T20:58:52.775 INFO:tasks.workunit.client.0.smithi008.stdout:0/986: mknod d0/d90/d139/d99/c144 0 2023-10-18T20:58:52.778 INFO:tasks.workunit.client.0.smithi008.stdout:0/987: mkdir d0/dd/d19/d145 0 2023-10-18T20:58:52.788 INFO:tasks.workunit.client.0.smithi008.stdout:0/988: dread d0/f51 [0,4194304] 0 2023-10-18T20:58:52.794 INFO:tasks.workunit.client.0.smithi008.stdout:5/967: dwrite d0/d2/d19/d7c/d31/f4a [0,4194304] 0 2023-10-18T20:58:52.795 INFO:tasks.workunit.client.0.smithi008.stdout:5/968: dread - d0/d2/d9/d34/dfb/f146 zero size 2023-10-18T20:58:52.795 INFO:tasks.workunit.client.0.smithi008.stdout:4/993: dwrite d0/d76/f12a [0,4194304] 0 2023-10-18T20:58:52.795 INFO:tasks.workunit.client.0.smithi008.stdout:4/994: fdatasync d0/d58/dc7/fef 0 2023-10-18T20:58:52.798 INFO:tasks.workunit.client.0.smithi008.stdout:5/969: creat d0/d2/d19/d7c/d31/d80/d107/dfa/f158 x:0 0 0 2023-10-18T20:58:52.800 INFO:tasks.workunit.client.0.smithi008.stdout:5/970: creat d0/dec/f159 x:0 0 0 2023-10-18T20:58:52.800 INFO:tasks.workunit.client.0.smithi008.stdout:5/971: write d0/d2/d9/d9b/d12e/d9a/fd4 [168928,43901] 0 2023-10-18T20:58:52.811 INFO:tasks.workunit.client.0.smithi008.stdout:5/972: mkdir d0/d2/d9/d9b/dba/d15a 0 2023-10-18T20:58:52.816 INFO:tasks.workunit.client.0.smithi008.stdout:5/973: rename d0/de/d134 to d0/d103/d15b 0 2023-10-18T20:58:52.817 INFO:tasks.workunit.client.0.smithi008.stdout:5/974: rmdir d0/d2/d19/d7c/da7 39 2023-10-18T20:58:52.821 INFO:tasks.workunit.client.0.smithi008.stdout:5/975: mkdir d0/d2/d19/d7c/d42/d5a/d15c 0 2023-10-18T20:58:52.821 INFO:tasks.workunit.client.0.smithi008.stdout:5/976: creat d0/d2/d9/d9b/d12e/d70/da4/f15d x:0 0 0 2023-10-18T20:58:52.824 INFO:tasks.workunit.client.0.smithi008.stdout:5/977: link d0/da9/dda/de1/l138 d0/de/d109/l15e 0 2023-10-18T20:58:52.825 INFO:tasks.workunit.client.0.smithi008.stdout:5/978: mknod d0/d103/c15f 0 2023-10-18T20:58:52.826 INFO:tasks.workunit.client.0.smithi008.stdout:5/979: fdatasync d0/d2/d19/d7c/d31/d80/d107/dfa/f102 0 2023-10-18T20:58:52.832 INFO:tasks.workunit.client.0.smithi008.stdout:4/995: dwrite d0/d58/d8e/db4/fc4 [0,4194304] 0 2023-10-18T20:58:52.835 INFO:tasks.workunit.client.0.smithi008.stdout:4/996: mkdir d0/d17/d5b/d99/d150 0 2023-10-18T20:58:52.836 INFO:tasks.workunit.client.0.smithi008.stdout:4/997: rmdir d0/d3/d21/d57/d8f/d73 39 2023-10-18T20:58:52.837 INFO:tasks.workunit.client.0.smithi008.stdout:4/998: chown d0/d12c/l13e 2897 1 2023-10-18T20:58:52.838 INFO:tasks.workunit.client.0.smithi008.stdout:4/999: rename d0/d3/d21/fa2 to d0/d58/d8e/dd2/f151 0 2023-10-18T20:58:52.891 INFO:tasks.workunit.client.0.smithi008.stdout:9/906: sync 2023-10-18T20:58:52.892 INFO:tasks.workunit.client.0.smithi008.stdout:9/907: symlink d2/dc/d3d/d102/l109 0 2023-10-18T20:58:52.894 INFO:tasks.workunit.client.0.smithi008.stdout:9/908: creat d2/dc/d17/d19/df7/f10a x:0 0 0 2023-10-18T20:58:52.894 INFO:tasks.workunit.client.0.smithi008.stdout:9/909: chown d2/dc/d17/d19/d4a/db2/ff8 1297328 1 2023-10-18T20:58:52.897 INFO:tasks.workunit.client.0.smithi008.stdout:9/910: creat d2/dc/d17/f10b x:0 0 0 2023-10-18T20:58:52.897 INFO:tasks.workunit.client.0.smithi008.stdout:9/911: chown d2/d8/db1 0 1 2023-10-18T20:58:52.897 INFO:tasks.workunit.client.0.smithi008.stdout:9/912: read - d2/dc/d40/dce/ff6 zero size 2023-10-18T20:58:52.897 INFO:tasks.workunit.client.0.smithi008.stdout:9/913: read - d2/dc/d40/d5a/faf zero size 2023-10-18T20:58:52.898 INFO:tasks.workunit.client.0.smithi008.stdout:9/914: unlink d2/dc/d40/l5f 0 2023-10-18T20:58:52.898 INFO:tasks.workunit.client.0.smithi008.stdout:9/915: dread - d2/dc/d40/d56/fb8 zero size 2023-10-18T20:58:52.899 INFO:tasks.workunit.client.0.smithi008.stdout:9/916: write d2/f5 [3303455,26120] 0 2023-10-18T20:58:52.899 INFO:tasks.workunit.client.0.smithi008.stdout:9/917: fsync d2/d4d/f67 0 2023-10-18T20:58:52.901 INFO:tasks.workunit.client.0.smithi008.stdout:9/918: rename d2/d4d/f7d to d2/d8/db1/dd3/d59/f10c 0 2023-10-18T20:58:52.903 INFO:tasks.workunit.client.0.smithi008.stdout:9/919: mkdir d2/dc/d40/d56/def/d10d 0 2023-10-18T20:58:52.941 INFO:tasks.workunit.client.0.smithi008.stdout:9/920: dwrite d2/dc/d1a/d1d/fcb [0,4194304] 0 2023-10-18T20:58:52.944 INFO:tasks.workunit.client.0.smithi008.stdout:9/921: getdents d2/dc/d40/d5a 0 2023-10-18T20:58:52.944 INFO:tasks.workunit.client.0.smithi008.stdout:9/922: dread - d2/d4d/dc2/ff2 zero size 2023-10-18T20:58:52.957 INFO:tasks.workunit.client.0.smithi008.stdout:0/989: sync 2023-10-18T20:58:52.957 INFO:tasks.workunit.client.0.smithi008.stdout:5/980: sync 2023-10-18T20:58:52.958 INFO:tasks.workunit.client.0.smithi008.stdout:5/981: creat d0/d2/d9/d9b/dba/f160 x:0 0 0 2023-10-18T20:58:52.960 INFO:tasks.workunit.client.0.smithi008.stdout:5/982: mknod d0/c161 0 2023-10-18T20:58:52.963 INFO:tasks.workunit.client.0.smithi008.stdout:5/983: rmdir d0/d2/d19/d7c/d31/d82 39 2023-10-18T20:58:52.963 INFO:tasks.workunit.client.0.smithi008.stdout:5/984: write d0/d2/d9/d9b/f50 [2717678,11257] 0 2023-10-18T20:58:52.970 INFO:tasks.workunit.client.0.smithi008.stdout:0/990: read d0/dd/d19/d24/f88 [3841364,51344] 0 2023-10-18T20:58:52.973 INFO:tasks.workunit.client.0.smithi008.stdout:0/991: mkdir d0/dd/d19/d146 0 2023-10-18T20:58:52.973 INFO:tasks.workunit.client.0.smithi008.stdout:0/992: getdents d0/dd/d19/d145 0 2023-10-18T20:58:52.973 INFO:tasks.workunit.client.0.smithi008.stdout:0/993: chown d0/d7c/d9a/d8a/d8f/d21/c110 0 1 2023-10-18T20:58:52.980 INFO:tasks.workunit.client.0.smithi008.stdout:0/994: mkdir d0/d7c/d9a/d8a/d8f/d21/d85/d147 0 2023-10-18T20:58:53.011 INFO:tasks.workunit.client.0.smithi008.stdout:0/995: write d0/d7c/d9a/d8a/fae [597584,118699] 0 2023-10-18T20:58:53.011 INFO:tasks.workunit.client.0.smithi008.stdout:0/996: creat d0/d7c/df0/f148 x:0 0 0 2023-10-18T20:58:53.013 INFO:tasks.workunit.client.0.smithi008.stdout:9/923: dwrite d2/d8/fff [0,4194304] 0 2023-10-18T20:58:53.013 INFO:tasks.workunit.client.0.smithi008.stdout:9/924: fdatasync d2/dc/d17/d19/d4a/fe9 0 2023-10-18T20:58:53.014 INFO:tasks.workunit.client.0.smithi008.stdout:0/997: rename d0/d7c/d9a/d8a/d8f/d21/df7/d61/cfc to d0/dd/d19/d145/c149 0 2023-10-18T20:58:53.027 INFO:tasks.workunit.client.0.smithi008.stdout:9/925: link d2/d8/db1/fcd d2/dc/d40/dce/de3/f10e 0 2023-10-18T20:58:53.027 INFO:tasks.workunit.client.0.smithi008.stdout:9/926: fsync d2/f4 0 2023-10-18T20:58:53.027 INFO:tasks.workunit.client.0.smithi008.stdout:9/927: write d2/d8/db1/dd3/d59/fb9 [447107,41008] 0 2023-10-18T20:58:53.027 INFO:tasks.workunit.client.0.smithi008.stdout:9/928: fdatasync d2/dc/d40/d5a/faf 0 2023-10-18T20:58:53.029 INFO:tasks.workunit.client.0.smithi008.stdout:0/998: read d0/dd/df/f1c [2900662,111897] 0 2023-10-18T20:58:53.033 INFO:tasks.workunit.client.0.smithi008.stdout:5/985: dwrite d0/d2/d19/d7c/f95 [0,4194304] 0 2023-10-18T20:58:53.041 INFO:tasks.workunit.client.0.smithi008.stdout:5/986: rmdir d0/d2/d9/d9b/de7 39 2023-10-18T20:58:53.041 INFO:tasks.workunit.client.0.smithi008.stdout:5/987: dread - d0/d2/d9/d9b/d12e/d70/da4/f14c zero size 2023-10-18T20:58:53.041 INFO:tasks.workunit.client.0.smithi008.stdout:5/988: readlink d0/d2/d19/d7c/lc2 0 2023-10-18T20:58:53.041 INFO:tasks.workunit.client.0.smithi008.stdout:9/929: read d2/dc/d17/d7b/fa2 [1313469,10385] 0 2023-10-18T20:58:53.044 INFO:tasks.workunit.client.0.smithi008.stdout:5/989: rename d0/d2/d9/d9b/d12e/d70/da4/faf to d0/d127/f162 0 2023-10-18T20:58:53.044 INFO:tasks.workunit.client.0.smithi008.stdout:5/990: write d0/d2/d9/f24 [714088,79833] 0 2023-10-18T20:58:53.044 INFO:tasks.workunit.client.0.smithi008.stdout:5/991: read - d0/d2/d19/d7c/fef zero size 2023-10-18T20:58:53.045 INFO:tasks.workunit.client.0.smithi008.stdout:5/992: mknod d0/d2/d19/d7c/d31/c163 0 2023-10-18T20:58:53.047 INFO:tasks.workunit.client.0.smithi008.stdout:5/993: mknod d0/d2/d19/d7c/d31/d80/d107/c164 0 2023-10-18T20:58:53.056 INFO:tasks.workunit.client.0.smithi008.stdout:9/930: dread d2/d4d/f67 [0,4194304] 0 2023-10-18T20:58:53.056 INFO:tasks.workunit.client.0.smithi008.stdout:9/931: chown d2/dc/d17/d19/d4a/db2 62 1 2023-10-18T20:58:53.058 INFO:tasks.workunit.client.0.smithi008.stdout:5/994: truncate d0/d2/d9/d9b/f50 1224237 0 2023-10-18T20:58:53.058 INFO:tasks.workunit.client.0.smithi008.stdout:5/995: write d0/d2/d19/d7c/d31/f55 [148847,17125] 0 2023-10-18T20:58:53.059 INFO:tasks.workunit.client.0.smithi008.stdout:5/996: mknod d0/d2/d19/d7c/d58/d65/c165 0 2023-10-18T20:58:53.059 INFO:tasks.workunit.client.0.smithi008.stdout:5/997: dread - d0/d2/d19/d7c/d31/f151 zero size 2023-10-18T20:58:53.059 INFO:tasks.workunit.client.0.smithi008.stdout:5/998: truncate d0/d2/d19/d7c/d31/f55 674456 0 2023-10-18T20:58:53.060 INFO:tasks.workunit.client.0.smithi008.stdout:5/999: symlink d0/d2/d19/d7c/d31/d82/df5/l166 0 2023-10-18T20:58:53.093 INFO:tasks.workunit.client.0.smithi008.stdout:9/932: dwrite d2/d8/f84 [0,4194304] 0 2023-10-18T20:58:53.095 INFO:tasks.workunit.client.0.smithi008.stdout:9/933: creat d2/dc/d40/d46/ddc/d90/f10f x:0 0 0 2023-10-18T20:58:53.098 INFO:tasks.workunit.client.0.smithi008.stdout:9/934: link d2/dc/d40/d46/ddc/f69 d2/dc/d17/f110 0 2023-10-18T20:58:53.137 INFO:tasks.workunit.client.0.smithi008.stdout:9/935: dwrite d2/dc/d40/ff1 [0,4194304] 0 2023-10-18T20:58:53.140 INFO:tasks.workunit.client.0.smithi008.stdout:9/936: rmdir d2/d8/db1/dd3 39 2023-10-18T20:58:53.141 INFO:tasks.workunit.client.0.smithi008.stdout:9/937: symlink d2/dc/d40/d56/def/d10d/l111 0 2023-10-18T20:58:53.143 INFO:tasks.workunit.client.0.smithi008.stdout:9/938: getdents d2/dc/d17/d19/d4a 0 2023-10-18T20:58:53.144 INFO:tasks.workunit.client.0.smithi008.stdout:9/939: getdents d2/dc/d3d/d99 0 2023-10-18T20:58:53.145 INFO:tasks.workunit.client.0.smithi008.stdout:0/999: sync 2023-10-18T20:58:53.180 INFO:tasks.workunit.client.0.smithi008.stdout:9/940: dwrite d2/dc/d40/dce/fcf [0,4194304] 0 2023-10-18T20:58:53.183 INFO:tasks.workunit.client.0.smithi008.stdout:9/941: rename d2/dc/f4b to d2/dc/d40/dce/f112 0 2023-10-18T20:58:53.185 INFO:tasks.workunit.client.0.smithi008.stdout:9/942: symlink d2/dc/l113 0 2023-10-18T20:58:53.185 INFO:tasks.workunit.client.0.smithi008.stdout:9/943: chown d2/f7f 1 1 2023-10-18T20:58:53.187 INFO:tasks.workunit.client.0.smithi008.stdout:9/944: mkdir d2/dc/d17/d19/d114 0 2023-10-18T20:58:53.188 INFO:tasks.workunit.client.0.smithi008.stdout:9/945: mknod d2/d8/da0/c115 0 2023-10-18T20:58:53.189 INFO:tasks.workunit.client.0.smithi008.stdout:9/946: chown d2/dc/d40/d46/ddc/d90/f10f 48963 1 2023-10-18T20:58:53.239 INFO:tasks.workunit.client.0.smithi008.stdout:9/947: dwrite d2/d8/f83 [0,4194304] 0 2023-10-18T20:58:53.242 INFO:tasks.workunit.client.0.smithi008.stdout:9/948: creat d2/dc/d17/d19/d114/f116 x:0 0 0 2023-10-18T20:58:53.244 INFO:tasks.workunit.client.0.smithi008.stdout:9/949: rename d2/f1b to d2/dc/d3d/d99/f117 0 2023-10-18T20:58:53.252 INFO:tasks.workunit.client.0.smithi008.stdout:9/950: mkdir d2/dc/d40/d46/d118 0 2023-10-18T20:58:53.253 INFO:tasks.workunit.client.0.smithi008.stdout:9/951: readlink d2/dc/d1a/d1d/l9d 0 2023-10-18T20:58:53.255 INFO:tasks.workunit.client.0.smithi008.stdout:9/952: link d2/dc/d1a/d1d/f7c d2/dc/d17/d19/df7/f119 0 2023-10-18T20:58:53.255 INFO:tasks.workunit.client.0.smithi008.stdout:9/953: read - d2/dc/d17/d19/d4a/d9a/f106 zero size 2023-10-18T20:58:53.256 INFO:tasks.workunit.client.0.smithi008.stdout:9/954: stat d2/dc/d17/c43 0 2023-10-18T20:58:53.265 INFO:tasks.workunit.client.0.smithi008.stdout:9/955: dread d2/dc/d3d/d99/f117 [0,4194304] 0 2023-10-18T20:58:53.304 INFO:tasks.workunit.client.0.smithi008.stdout:9/956: dwrite d2/dc/d1a/d1d/f82 [0,4194304] 0 2023-10-18T20:58:53.304 INFO:tasks.workunit.client.0.smithi008.stdout:9/957: write d2/dc/d17/d19/d4a/db2/ff8 [236457,217] 0 2023-10-18T20:58:53.306 INFO:tasks.workunit.client.0.smithi008.stdout:9/958: mknod d2/dc/d17/d19/df7/c11a 0 2023-10-18T20:58:53.309 INFO:tasks.workunit.client.0.smithi008.stdout:9/959: link d2/dc/d40/d46/ddc/d90/fa8 d2/dc/d17/d19/d114/f11b 0 2023-10-18T20:58:53.309 INFO:tasks.workunit.client.0.smithi008.stdout:9/960: stat d2/dc/d17/d19/df7/dc9 0 2023-10-18T20:58:53.312 INFO:tasks.workunit.client.0.smithi008.stdout:9/961: symlink d2/dc/d17/d7b/de6/l11c 0 2023-10-18T20:58:53.312 INFO:tasks.workunit.client.0.smithi008.stdout:9/962: truncate d2/dc/d1a/d1d/f7c 5036872 0 2023-10-18T20:58:53.316 INFO:tasks.workunit.client.0.smithi008.stdout:9/963: link d2/dc/d1a/ffd d2/dc/d1a/d1d/da7/f11d 0 2023-10-18T20:58:53.318 INFO:tasks.workunit.client.0.smithi008.stdout:9/964: creat d2/dc/d17/d7b/de6/f11e x:0 0 0 2023-10-18T20:58:53.324 INFO:tasks.workunit.client.0.smithi008.stdout:9/965: dread d2/dc/d17/d19/d4a/fab [0,4194304] 0 2023-10-18T20:58:53.324 INFO:tasks.workunit.client.0.smithi008.stdout:9/966: dread - d2/dc/d40/d46/ddc/d90/fa8 zero size 2023-10-18T20:58:53.327 INFO:tasks.workunit.client.0.smithi008.stdout:9/967: rename d2/dc/d17/d19/d4a/fe9 to d2/dc/d40/d46/d118/f11f 0 2023-10-18T20:58:53.328 INFO:tasks.workunit.client.0.smithi008.stdout:9/968: truncate d2/d8/db1/dd3/d59/f94 430957 0 2023-10-18T20:58:53.329 INFO:tasks.workunit.client.0.smithi008.stdout:9/969: getdents d2/dc/d17/d19/df7/dc9/dee 0 2023-10-18T20:58:53.331 INFO:tasks.workunit.client.0.smithi008.stdout:9/970: unlink d2/dc/d17/d19/d4a/d9a/caa 0 2023-10-18T20:58:53.332 INFO:tasks.workunit.client.0.smithi008.stdout:9/971: mknod d2/dc/d40/d56/def/c120 0 2023-10-18T20:58:53.442 INFO:tasks.workunit.client.0.smithi008.stdout:9/972: sync 2023-10-18T20:58:53.451 INFO:tasks.workunit.client.0.smithi008.stdout:9/973: dread d2/dc/d17/d7b/f9f [0,4194304] 0 2023-10-18T20:58:53.456 INFO:tasks.workunit.client.0.smithi008.stdout:9/974: dread d2/d8/db1/dd3/d59/fb9 [0,4194304] 0 2023-10-18T20:58:53.464 INFO:tasks.workunit.client.0.smithi008.stdout:9/975: dread d2/dc/d1a/d1d/fe7 [0,4194304] 0 2023-10-18T20:58:53.466 INFO:tasks.workunit.client.0.smithi008.stdout:9/976: rmdir d2/dc/d3d 39 2023-10-18T20:58:53.468 INFO:tasks.workunit.client.0.smithi008.stdout:9/977: rename d2/dc/d40/l86 to d2/dc/d17/d19/d4a/l121 0 2023-10-18T20:58:53.470 INFO:tasks.workunit.client.0.smithi008.stdout:9/978: rename d2/d8/f83 to d2/dc/d40/f122 0 2023-10-18T20:58:53.470 INFO:tasks.workunit.client.0.smithi008.stdout:9/979: creat d2/d8/db1/f123 x:0 0 0 2023-10-18T20:58:53.472 INFO:tasks.workunit.client.0.smithi008.stdout:9/980: creat d2/d8/db1/dd3/f124 x:0 0 0 2023-10-18T20:58:53.473 INFO:tasks.workunit.client.0.smithi008.stdout:9/981: creat d2/dc/d40/d46/ddc/d90/f125 x:0 0 0 2023-10-18T20:58:53.474 INFO:tasks.workunit.client.0.smithi008.stdout:9/982: mkdir d2/dc/d17/d7b/de6/d126 0 2023-10-18T20:58:53.475 INFO:tasks.workunit.client.0.smithi008.stdout:9/983: rmdir d2/dc/d40/d5a/dfb 39 2023-10-18T20:58:53.476 INFO:tasks.workunit.client.0.smithi008.stdout:9/984: symlink d2/dc/d40/d5a/dfb/l127 0 2023-10-18T20:58:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:52.122770+0000 mgr.smithi008.flmjzp (mgr.14640) 20 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 228 MiB/s rd, 280 MiB/s wr, 399 op/s 2023-10-18T20:58:53.489 INFO:tasks.workunit.client.0.smithi008.stdout:9/985: write d2/dc/d1a/d1d/f3c [4056392,95066] 0 2023-10-18T20:58:53.492 INFO:tasks.workunit.client.0.smithi008.stdout:9/986: symlink d2/d8/db1/dd3/d59/l128 0 2023-10-18T20:58:53.552 INFO:tasks.workunit.client.0.smithi008.stdout:9/987: dwrite d2/dc/d1a/d1d/f44 [0,4194304] 0 2023-10-18T20:58:53.554 INFO:tasks.workunit.client.0.smithi008.stdout:9/988: creat d2/dc/d40/dce/de3/f129 x:0 0 0 2023-10-18T20:58:53.564 INFO:tasks.workunit.client.0.smithi008.stdout:9/989: dread d2/d8/da0/fb0 [0,4194304] 0 2023-10-18T20:58:53.564 INFO:tasks.workunit.client.0.smithi008.stdout:9/990: chown d2/dc/d17/d19/df7/dc9/ffe 37423 1 2023-10-18T20:58:53.565 INFO:tasks.workunit.client.0.smithi008.stdout:9/991: mkdir d2/dc/d1a/d1d/d12a 0 2023-10-18T20:58:53.566 INFO:tasks.workunit.client.0.smithi008.stdout:9/992: rename d2/dc/d17/d7b/de6/f11e to d2/d8/da0/f12b 0 2023-10-18T20:58:53.620 INFO:tasks.workunit.client.0.smithi008.stdout:9/993: dwrite d2/dc/d3d/d99/f117 [0,4194304] 0 2023-10-18T20:58:53.622 INFO:tasks.workunit.client.0.smithi008.stdout:9/994: mknod d2/dc/d40/d5a/c12c 0 2023-10-18T20:58:53.661 INFO:tasks.workunit.client.0.smithi008.stdout:9/995: dwrite d2/dc/f6d [0,4194304] 0 2023-10-18T20:58:53.662 INFO:tasks.workunit.client.0.smithi008.stdout:9/996: readlink d2/ld 0 2023-10-18T20:58:53.662 INFO:tasks.workunit.client.0.smithi008.stdout:9/997: fsync d2/d8/da0/f12b 0 2023-10-18T20:58:53.664 INFO:tasks.workunit.client.0.smithi008.stdout:9/998: rmdir d2/d8/db1/dd3 39 2023-10-18T20:58:53.665 INFO:tasks.workunit.client.0.smithi008.stdout:9/999: mknod d2/dc/d40/d56/def/c12d 0 2023-10-18T20:58:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:52.122770+0000 mgr.smithi008.flmjzp (mgr.14640) 20 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 228 MiB/s rd, 280 MiB/s wr, 399 op/s 2023-10-18T20:58:53.672 INFO:tasks.workunit.client.0.smithi008.stderr:+ rm -rf -- ./tmp.hQJMQ95GxE 2023-10-18T20:58:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:54.123183+0000 mgr.smithi008.flmjzp (mgr.14640) 21 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 171 MiB/s rd, 215 MiB/s wr, 304 op/s 2023-10-18T20:58:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.021630+0000 mon.smithi008 (mon.0) 666 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.022392+0000 mon.smithi008 (mon.0) 667 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:58:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.023162+0000 mon.smithi008 (mon.0) 668 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:58:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.027288+0000 mon.smithi008 (mon.0) 669 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.033270+0000 mon.smithi008 (mon.0) 670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:55.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.035960+0000 mon.smithi008 (mon.0) 671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:58:55.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.042225+0000 mon.smithi008 (mon.0) 672 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:55.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.043124+0000 mon.smithi008 (mon.0) 673 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi008.flmjzp"}]: dispatch 2023-10-18T20:58:55.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.046615+0000 mon.smithi008 (mon.0) 674 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi008.flmjzp"}]': finished 2023-10-18T20:58:55.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.047325+0000 mon.smithi008 (mon.0) 675 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.pgqqwa"}]: dispatch 2023-10-18T20:58:55.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.050502+0000 mon.smithi008 (mon.0) 676 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.pgqqwa"}]': finished 2023-10-18T20:58:55.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:55.051592+0000 mon.smithi008 (mon.0) 677 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-10-18T20:58:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:54.123183+0000 mgr.smithi008.flmjzp (mgr.14640) 21 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 171 MiB/s rd, 215 MiB/s wr, 304 op/s 2023-10-18T20:58:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.021630+0000 mon.smithi008 (mon.0) 666 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.022392+0000 mon.smithi008 (mon.0) 667 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:58:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.023162+0000 mon.smithi008 (mon.0) 668 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:58:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.027288+0000 mon.smithi008 (mon.0) 669 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.033270+0000 mon.smithi008 (mon.0) 670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:58:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.035960+0000 mon.smithi008 (mon.0) 671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:58:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.042225+0000 mon.smithi008 (mon.0) 672 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:55.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.043124+0000 mon.smithi008 (mon.0) 673 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi008.flmjzp"}]: dispatch 2023-10-18T20:58:55.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.046615+0000 mon.smithi008 (mon.0) 674 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi008.flmjzp"}]': finished 2023-10-18T20:58:55.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.047325+0000 mon.smithi008 (mon.0) 675 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.pgqqwa"}]: dispatch 2023-10-18T20:58:55.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.050502+0000 mon.smithi008 (mon.0) 676 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.pgqqwa"}]': finished 2023-10-18T20:58:55.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:55.051592+0000 mon.smithi008 (mon.0) 677 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-10-18T20:58:56.441 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:55.023879+0000 mgr.smithi008.flmjzp (mgr.14640) 22 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:58:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:55.023879+0000 mgr.smithi008.flmjzp (mgr.14640) 22 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:58:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:55.036661+0000 mgr.smithi008.flmjzp (mgr.14640) 23 : cephadm [INF] Upgrade: Setting container_image for all mgr 2023-10-18T20:58:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:56.393216+0000 mon.smithi008 (mon.0) 678 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:56.394050+0000 mon.smithi008 (mon.0) 679 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T20:58:56.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:56.394739+0000 mon.smithi008 (mon.0) 680 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T20:58:56.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:56.395395+0000 mon.smithi008 (mon.0) 681 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:58:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:55.036661+0000 mgr.smithi008.flmjzp (mgr.14640) 23 : cephadm [INF] Upgrade: Setting container_image for all mgr 2023-10-18T20:58:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:56.393216+0000 mon.smithi008 (mon.0) 678 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:58:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:56.394050+0000 mon.smithi008 (mon.0) 679 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T20:58:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:56.394739+0000 mon.smithi008 (mon.0) 680 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T20:58:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: audit 2023-10-18T20:58:56.395395+0000 mon.smithi008 (mon.0) 681 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:58:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cluster 2023-10-18T20:58:56.123588+0000 mgr.smithi008.flmjzp (mgr.14640) 24 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 171 MiB/s rd, 215 MiB/s wr, 304 op/s 2023-10-18T20:58:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:56.388339+0000 mgr.smithi008.flmjzp (mgr.14640) 25 : cephadm [INF] Upgrade: Updating mon.smithi008 2023-10-18T20:58:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: cephadm 2023-10-18T20:58:56.395995+0000 mgr.smithi008.flmjzp (mgr.14640) 26 : cephadm [INF] Deploying daemon mon.smithi008 on smithi008 2023-10-18T20:58:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:56.123588+0000 mgr.smithi008.flmjzp (mgr.14640) 24 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 171 MiB/s rd, 215 MiB/s wr, 304 op/s 2023-10-18T20:58:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:56.388339+0000 mgr.smithi008.flmjzp (mgr.14640) 25 : cephadm [INF] Upgrade: Updating mon.smithi008 2023-10-18T20:58:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:58:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:58:56.395995+0000 mgr.smithi008.flmjzp (mgr.14640) 26 : cephadm [INF] Deploying daemon mon.smithi008 on smithi008 2023-10-18T20:58:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:57 smithi008 systemd[1]: Stopping Ceph mon.smithi008 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T20:58:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:58:57.976+0000 7f9c34a6f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi008 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-10-18T20:58:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008[107756]: debug 2023-10-18T20:58:57.976+0000 7f9c34a6f700 -1 mon.smithi008@0(leader) e2 *** Got Signal Terminated *** 2023-10-18T20:58:58.606 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:58 smithi008 bash[146902]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi008 2023-10-18T20:58:59.253 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:58 smithi008 systemd[1]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi008.service: Succeeded. 2023-10-18T20:58:59.253 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:58 smithi008 systemd[1]: Stopped Ceph mon.smithi008 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T20:58:59.663 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 systemd[1]: Starting Ceph mon.smithi008 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T20:59:00.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 bash[147087]: 6e51711a04f767961734c81cb149f972d646ea660d504cfd1c8ec9ce25f965b5 2023-10-18T20:59:00.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 systemd[1]: Started Ceph mon.smithi008 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T20:59:00.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.748+0000 7f16cbd0c880 0 set uid:gid to 167:167 (ceph:ceph) 2023-10-18T20:59:00.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.748+0000 7f16cbd0c880 0 ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable), process ceph-mon, pid 7 2023-10-18T20:59:00.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.749+0000 7f16cbd0c880 0 pidfile_write: ignore empty --pid-file 2023-10-18T20:59:00.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.756+0000 7f16cbd0c880 0 load: jerasure load: lrc load: isa 2023-10-18T20:59:00.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: RocksDB version: 6.8.1 2023-10-18T20:59:00.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-10-18T20:59:00.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Compile date Oct 16 2023 2023-10-18T20:59:00.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: DB SUMMARY 2023-10-18T20:59:00.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: CURRENT file: CURRENT 2023-10-18T20:59:00.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: IDENTITY file: IDENTITY 2023-10-18T20:59:00.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 392 Bytes 2023-10-18T20:59:00.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi008/store.db dir, Total Num: 1, files: 000014.sst 2023-10-18T20:59:00.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi008/store.db: 000012.log size: 6294329 ; 2023-10-18T20:59:00.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.error_if_exists: 0 2023-10-18T20:59:00.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.create_if_missing: 0 2023-10-18T20:59:00.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.paranoid_checks: 1 2023-10-18T20:59:00.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.env: 0x55a6d95c2080 2023-10-18T20:59:00.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.fs: Posix File System 2023-10-18T20:59:00.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.info_log: 0x55a6da5b7d80 2023-10-18T20:59:00.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_file_opening_threads: 16 2023-10-18T20:59:00.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.statistics: (nil) 2023-10-18T20:59:00.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.use_fsync: 0 2023-10-18T20:59:00.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_log_file_size: 0 2023-10-18T20:59:00.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-18T20:59:00.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.log_file_time_to_roll: 0 2023-10-18T20:59:00.178 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.keep_log_file_num: 1000 2023-10-18T20:59:00.178 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.recycle_log_file_num: 0 2023-10-18T20:59:00.178 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.allow_fallocate: 1 2023-10-18T20:59:00.178 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.allow_mmap_reads: 0 2023-10-18T20:59:00.178 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.allow_mmap_writes: 0 2023-10-18T20:59:00.179 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.use_direct_reads: 0 2023-10-18T20:59:00.179 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-18T20:59:00.179 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.create_missing_column_families: 0 2023-10-18T20:59:00.179 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.db_log_dir: 2023-10-18T20:59:00.179 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi008/store.db 2023-10-18T20:59:00.180 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.table_cache_numshardbits: 6 2023-10-18T20:59:00.180 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_subcompactions: 1 2023-10-18T20:59:00.180 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_background_flushes: -1 2023-10-18T20:59:00.180 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-10-18T20:59:00.180 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-10-18T20:59:00.181 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-18T20:59:00.181 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-18T20:59:00.181 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-10-18T20:59:00.181 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.advise_random_on_open: 1 2023-10-18T20:59:00.181 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.db_write_buffer_size: 0 2023-10-18T20:59:00.181 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.write_buffer_manager: 0x55a6db230360 2023-10-18T20:59:00.182 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-18T20:59:00.182 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-10-18T20:59:00.182 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-18T20:59:00.182 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.use_adaptive_mutex: 0 2023-10-18T20:59:00.182 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.rate_limiter: (nil) 2023-10-18T20:59:00.183 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-18T20:59:00.183 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.wal_recovery_mode: 2 2023-10-18T20:59:00.183 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.enable_thread_tracking: 0 2023-10-18T20:59:00.183 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.enable_pipelined_write: 0 2023-10-18T20:59:00.183 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.unordered_write: 0 2023-10-18T20:59:00.185 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-18T20:59:00.185 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-18T20:59:00.186 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-18T20:59:00.186 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-18T20:59:00.186 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.row_cache: None 2023-10-18T20:59:00.186 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.wal_filter: None 2023-10-18T20:59:00.186 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-18T20:59:00.187 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.allow_ingest_behind: 0 2023-10-18T20:59:00.187 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.preserve_deletes: 0 2023-10-18T20:59:00.187 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.two_write_queues: 0 2023-10-18T20:59:00.187 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.manual_wal_flush: 0 2023-10-18T20:59:00.187 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.atomic_flush: 0 2023-10-18T20:59:00.188 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-18T20:59:00.188 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.persist_stats_to_disk: 0 2023-10-18T20:59:00.188 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-10-18T20:59:00.188 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.log_readahead_size: 0 2023-10-18T20:59:00.188 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-10-18T20:59:00.189 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_background_jobs: 2 2023-10-18T20:59:00.189 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_background_compactions: -1 2023-10-18T20:59:00.189 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-18T20:59:00.189 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-18T20:59:00.189 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.delayed_write_rate : 16777216 2023-10-18T20:59:00.189 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_total_wal_size: 0 2023-10-18T20:59:00.190 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-18T20:59:00.190 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.stats_dump_period_sec: 600 2023-10-18T20:59:00.190 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.stats_persist_period_sec: 600 2023-10-18T20:59:00.190 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-18T20:59:00.190 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_open_files: -1 2023-10-18T20:59:00.191 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.bytes_per_sync: 0 2023-10-18T20:59:00.191 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-10-18T20:59:00.191 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-10-18T20:59:00.191 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.compaction_readahead_size: 0 2023-10-18T20:59:00.191 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Compression algorithms supported: 2023-10-18T20:59:00.191 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-18T20:59:00.192 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: kZSTD supported: 0 2023-10-18T20:59:00.192 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: kXpressCompression supported: 0 2023-10-18T20:59:00.192 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: kLZ4HCCompression supported: 1 2023-10-18T20:59:00.192 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: kLZ4Compression supported: 1 2023-10-18T20:59:00.192 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: kBZip2Compression supported: 0 2023-10-18T20:59:00.193 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: kZlibCompression supported: 1 2023-10-18T20:59:00.193 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: kSnappyCompression supported: 1 2023-10-18T20:59:00.193 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-10-18T20:59:00.193 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi008/store.db/MANIFEST-000008 2023-10-18T20:59:00.193 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.194 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-10-18T20:59:00.194 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.194 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-18T20:59:00.194 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.merge_operator: 2023-10-18T20:59:00.194 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.compaction_filter: None 2023-10-18T20:59:00.195 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.compaction_filter_factory: None 2023-10-18T20:59:00.195 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-10-18T20:59:00.195 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.table_factory: BlockBasedTable 2023-10-18T20:59:00.195 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a6da567d18) 2023-10-18T20:59:00.195 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cache_index_and_filter_blocks: 1 2023-10-18T20:59:00.196 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-18T20:59:00.196 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-18T20:59:00.196 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: pin_top_level_index_and_filter: 1 2023-10-18T20:59:00.196 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: index_type: 0 2023-10-18T20:59:00.196 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: data_block_index_type: 0 2023-10-18T20:59:00.196 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: index_shortening: 1 2023-10-18T20:59:00.197 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: data_block_hash_table_util_ratio: 0.750000 2023-10-18T20:59:00.197 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: hash_index_allow_collision: 1 2023-10-18T20:59:00.197 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: checksum: 1 2023-10-18T20:59:00.197 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: no_block_cache: 0 2023-10-18T20:59:00.197 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: block_cache: 0x55a6da59cf10 2023-10-18T20:59:00.198 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: block_cache_name: BinnedLRUCache 2023-10-18T20:59:00.198 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: block_cache_options: 2023-10-18T20:59:00.198 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: capacity : 536870912 2023-10-18T20:59:00.198 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: num_shard_bits : 4 2023-10-18T20:59:00.198 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: strict_capacity_limit : 0 2023-10-18T20:59:00.199 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: high_pri_pool_ratio: 0.000 2023-10-18T20:59:00.199 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: block_cache_compressed: (nil) 2023-10-18T20:59:00.199 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: persistent_cache: (nil) 2023-10-18T20:59:00.199 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: block_size: 4096 2023-10-18T20:59:00.199 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: block_size_deviation: 10 2023-10-18T20:59:00.199 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: block_restart_interval: 16 2023-10-18T20:59:00.200 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: index_block_restart_interval: 1 2023-10-18T20:59:00.200 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: metadata_block_size: 4096 2023-10-18T20:59:00.200 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: partition_filters: 0 2023-10-18T20:59:00.200 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: use_delta_encoding: 1 2023-10-18T20:59:00.200 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: filter_policy: rocksdb.BuiltinBloomFilter 2023-10-18T20:59:00.201 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: whole_key_filtering: 1 2023-10-18T20:59:00.201 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: verify_compression: 0 2023-10-18T20:59:00.201 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: read_amp_bytes_per_bit: 0 2023-10-18T20:59:00.201 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: format_version: 2 2023-10-18T20:59:00.201 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: enable_index_compression: 1 2023-10-18T20:59:00.201 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: block_align: 0 2023-10-18T20:59:00.202 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.202 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.write_buffer_size: 33554432 2023-10-18T20:59:00.202 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_write_buffer_number: 2 2023-10-18T20:59:00.202 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.compression: NoCompression 2023-10-18T20:59:00.202 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.bottommost_compression: Disabled 2023-10-18T20:59:00.203 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.prefix_extractor: nullptr 2023-10-18T20:59:00.203 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-18T20:59:00.203 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.num_levels: 7 2023-10-18T20:59:00.203 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-18T20:59:00.203 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-18T20:59:00.203 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-18T20:59:00.204 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-18T20:59:00.204 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-18T20:59:00.204 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-18T20:59:00.204 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-18T20:59:00.204 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-18T20:59:00.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-18T20:59:00.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.compression_opts.window_bits: -14 2023-10-18T20:59:00.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.compression_opts.level: 32767 2023-10-18T20:59:00.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.compression_opts.strategy: 0 2023-10-18T20:59:00.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-18T20:59:00.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-18T20:59:00.206 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.compression_opts.enabled: false 2023-10-18T20:59:00.206 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-18T20:59:00.206 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-18T20:59:00.206 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-18T20:59:00.206 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.target_file_size_base: 67108864 2023-10-18T20:59:00.207 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.target_file_size_multiplier: 1 2023-10-18T20:59:00.207 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-18T20:59:00.207 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-18T20:59:00.207 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-18T20:59:00.207 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-18T20:59:00.208 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-18T20:59:00.208 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-18T20:59:00.208 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-18T20:59:00.208 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-18T20:59:00.208 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-18T20:59:00.208 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-18T20:59:00.209 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-18T20:59:00.209 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-18T20:59:00.209 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.arena_block_size: 4194304 2023-10-18T20:59:00.209 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-18T20:59:00.209 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-18T20:59:00.210 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.758+0000 7f16cbd0c880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-10-18T20:59:00.210 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.disable_auto_compactions: 0 2023-10-18T20:59:00.210 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-18T20:59:00.210 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-18T20:59:00.210 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-18T20:59:00.211 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-18T20:59:00.211 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-18T20:59:00.211 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-18T20:59:00.211 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-18T20:59:00.211 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-18T20:59:00.211 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-18T20:59:00.212 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-18T20:59:00.212 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.table_properties_collectors: 2023-10-18T20:59:00.212 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.inplace_update_support: 0 2023-10-18T20:59:00.212 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-10-18T20:59:00.212 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-18T20:59:00.213 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-18T20:59:00.213 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.memtable_huge_page_size: 0 2023-10-18T20:59:00.213 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.bloom_locality: 0 2023-10-18T20:59:00.213 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.max_successive_merges: 0 2023-10-18T20:59:00.213 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-10-18T20:59:00.213 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.paranoid_file_checks: 0 2023-10-18T20:59:00.214 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.force_consistency_checks: 0 2023-10-18T20:59:00.214 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.report_bg_io_stats: 0 2023-10-18T20:59:00.214 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.ttl: 2592000 2023-10-18T20:59:00.214 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.759+0000 7f16cbd0c880 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-10-18T20:59:00.214 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.761+0000 7f16cbd0c880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-10-18T20:59:00.215 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.761+0000 7f16cbd0c880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi008/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 16, last_sequence is 6561, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-18T20:59:00.215 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.215 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.761+0000 7f16cbd0c880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 12 2023-10-18T20:59:00.215 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.215 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.761+0000 7f16cbd0c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662739761920, "job": 1, "event": "recovery_started", "log_files": [12]} 2023-10-18T20:59:00.215 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.761+0000 7f16cbd0c880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #12 mode 2 2023-10-18T20:59:00.216 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.775+0000 7f16cbd0c880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-10-18T20:59:00.216 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.785+0000 7f16cbd0c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662739785830, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 16, "file_size": 6110247, "table_properties": {"data_size": 6100488, "index_size": 7847, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1093, "raw_key_size": 9125, "raw_average_key_size": 21, "raw_value_size": 6088203, "raw_average_value_size": 14530, "num_data_blocks": 250, "num_entries": 419, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1697662739, "oldest_key_time": 3, "file_creation_time": 0}} 2023-10-18T20:59:00.216 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.785+0000 7f16cbd0c880 4 rocksdb: [version_set.cc:3826] Creating manifest 17 2023-10-18T20:59:00.216 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.216 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.785+0000 7f16cbd0c880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-10-18T20:59:00.217 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.786+0000 7f16cbd0c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662739787107, "job": 1, "event": "recovery_finished"} 2023-10-18T20:59:00.217 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.789+0000 7f16cbd0c880 4 rocksdb: DB pointer 0x55a6da665800 2023-10-18T20:59:00.217 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.790+0000 7f16b2b12700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-10-18T20:59:00.217 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.790+0000 7f16b2b12700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-10-18T20:59:00.218 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ** DB Stats ** 2023-10-18T20:59:00.218 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:59:00.218 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-18T20:59:00.218 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T20:59:00.218 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T20:59:00.219 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-18T20:59:00.219 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-10-18T20:59:00.219 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T20:59:00.219 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.219 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ** Compaction Stats [default] ** 2023-10-18T20:59:00.220 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:59:00.220 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:59:00.220 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: L0 1/0 5.83 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.5 0.01 0.00 1 0.010 0 0 2023-10-18T20:59:00.220 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: L6 1/0 17.22 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:59:00.220 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Sum 2/0 23.05 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.5 0.01 0.00 1 0.010 0 0 2023-10-18T20:59:00.220 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.5 0.01 0.00 1 0.010 0 0 2023-10-18T20:59:00.221 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.221 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ** Compaction Stats [default] ** 2023-10-18T20:59:00.221 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:59:00.221 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:59:00.221 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 591.5 0.01 0.00 1 0.010 0 0 2023-10-18T20:59:00.222 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:59:00.222 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Flush(GB): cumulative 0.006, interval 0.006 2023-10-18T20:59:00.222 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T20:59:00.222 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T20:59:00.222 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T20:59:00.223 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: AddFile(Keys): cumulative 0, interval 0 2023-10-18T20:59:00.223 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Cumulative compaction: 0.01 GB write, 188.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:59:00.223 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Interval compaction: 0.01 GB write, 188.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:59:00.223 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T20:59:00.223 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.223 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ** File Read Latency Histogram By Level [default] ** 2023-10-18T20:59:00.224 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.224 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ** Compaction Stats [default] ** 2023-10-18T20:59:00.224 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:59:00.224 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:59:00.224 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: L0 1/0 5.83 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.5 0.01 0.00 1 0.010 0 0 2023-10-18T20:59:00.225 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: L6 1/0 17.22 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:59:00.225 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Sum 2/0 23.05 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.5 0.01 0.00 1 0.010 0 0 2023-10-18T20:59:00.225 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:59:00.225 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.225 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ** Compaction Stats [default] ** 2023-10-18T20:59:00.225 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:59:00.226 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:59:00.226 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 591.5 0.01 0.00 1 0.010 0 0 2023-10-18T20:59:00.226 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:59:00.226 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Flush(GB): cumulative 0.006, interval 0.000 2023-10-18T20:59:00.226 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T20:59:00.227 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T20:59:00.227 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T20:59:00.227 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: AddFile(Keys): cumulative 0, interval 0 2023-10-18T20:59:00.227 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Cumulative compaction: 0.01 GB write, 187.76 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:59:00.227 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:59:00.228 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T20:59:00.228 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.228 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: ** File Read Latency Histogram By Level [default] ** 2023-10-18T20:59:00.228 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.228 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.791+0000 7f16cbd0c880 0 starting mon.smithi008 rank 0 at public addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] at bind addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi008 fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:59:00.229 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.793+0000 7f16cbd0c880 1 mon.smithi008@-1(???) e2 preinit fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:59:00.229 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.793+0000 7f16cbd0c880 0 mon.smithi008@-1(???).mds e16 new map 2023-10-18T20:59:00.229 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.793+0000 7f16cbd0c880 0 mon.smithi008@-1(???).mds e16 print_map 2023-10-18T20:59:00.229 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: e16 2023-10-18T20:59:00.229 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:59:00.229 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:59:00.230 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: legacy client fscid: 1 2023-10-18T20:59:00.230 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.230 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: Filesystem 'cephfs' (1) 2023-10-18T20:59:00.230 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: fs_name cephfs 2023-10-18T20:59:00.231 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: epoch 16 2023-10-18T20:59:00.231 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: flags 32 2023-10-18T20:59:00.231 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:59:00.231 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: modified 2023-10-18T20:57:40.516856+0000 2023-10-18T20:59:00.231 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: tableserver 0 2023-10-18T20:59:00.231 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: root 0 2023-10-18T20:59:00.232 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: session_timeout 60 2023-10-18T20:59:00.232 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: session_autoclose 300 2023-10-18T20:59:00.232 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: max_file_size 1099511627776 2023-10-18T20:59:00.232 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: required_client_features {} 2023-10-18T20:59:00.232 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: last_failure 0 2023-10-18T20:59:00.233 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: last_failure_osd_epoch 0 2023-10-18T20:59:00.233 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:59:00.233 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: max_mds 2 2023-10-18T20:59:00.233 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: in 0,1 2023-10-18T20:59:00.233 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: up {0=14456,1=24321} 2023-10-18T20:59:00.234 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: failed 2023-10-18T20:59:00.234 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: damaged 2023-10-18T20:59:00.234 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: stopped 2023-10-18T20:59:00.234 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: data_pools [3] 2023-10-18T20:59:00.234 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: metadata_pool 2 2023-10-18T20:59:00.235 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: inline_data disabled 2023-10-18T20:59:00.235 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: balancer 2023-10-18T20:59:00.235 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: standby_count_wanted 1 2023-10-18T20:59:00.235 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: [mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:00.235 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: [mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:00.236 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: [mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:00.236 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: [mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:00.236 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.236 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.236 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: 2023-10-18T20:59:00.237 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.793+0000 7f16cbd0c880 0 mon.smithi008@-1(???).osd e45 crush map has features 3314933000852226048, adjusting msgr requires 2023-10-18T20:59:00.237 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.793+0000 7f16cbd0c880 0 mon.smithi008@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-10-18T20:59:00.237 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.793+0000 7f16cbd0c880 0 mon.smithi008@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-10-18T20:59:00.237 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.793+0000 7f16cbd0c880 0 mon.smithi008@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-10-18T20:59:00.237 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:58:56.123588+0000 mgr.smithi008.flmjzp (mgr.14640) 24 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 171 MiB/s rd, 215 MiB/s wr, 304 op/s 2023-10-18T20:59:00.237 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:58:56.388339+0000 mgr.smithi008.flmjzp (mgr.14640) 25 : cephadm [INF] Upgrade: Updating mon.smithi008 2023-10-18T20:59:00.238 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:58:56.395995+0000 mgr.smithi008.flmjzp (mgr.14640) 26 : cephadm [INF] Deploying daemon mon.smithi008 on smithi008 2023-10-18T20:59:00.238 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:58:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T20:58:59.794+0000 7f16cbd0c880 1 mon.smithi008@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-10-18T20:59:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:57.983554+0000 mon.smithi060 (mon.1) 59 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:59:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:57.984380+0000 mon.smithi060 (mon.1) 60 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:59:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:58:58.124032+0000 mgr.smithi008.flmjzp (mgr.14640) 27 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 189 MiB/s rd, 237 MiB/s wr, 387 op/s 2023-10-18T20:59:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:59.437185+0000 mon.smithi060 (mon.1) 61 : audit [DBG] from='mgr.? 172.21.15.60:0/2811441980' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/crt"}]: dispatch 2023-10-18T20:59:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:59.437639+0000 mon.smithi060 (mon.1) 62 : audit [DBG] from='mgr.? 172.21.15.60:0/2811441980' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:59:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:59.440707+0000 mon.smithi060 (mon.1) 63 : audit [DBG] from='mgr.? 172.21.15.60:0/2811441980' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/key"}]: dispatch 2023-10-18T20:59:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:58:59.442045+0000 mon.smithi060 (mon.1) 64 : audit [DBG] from='mgr.? 172.21.15.60:0/2811441980' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:59:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:00.124639+0000 mgr.smithi008.flmjzp (mgr.14640) 28 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 99 MiB/s rd, 120 MiB/s wr, 226 op/s 2023-10-18T20:59:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:01.211318+0000 mon.smithi008 (mon.0) 1 : cluster [INF] mon.smithi008 calling monitor election 2023-10-18T20:59:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:01.213698+0000 mon.smithi008 (mon.0) 2 : cluster [INF] mon.smithi008 is new leader, mons smithi008,smithi060 in quorum (ranks 0,1) 2023-10-18T20:59:01.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:01.218425+0000 mon.smithi008 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi008=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} removed_ranks: {} 2023-10-18T20:59:01.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:01.219300+0000 mon.smithi008 (mon.0) 4 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:59:01.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:01.219361+0000 mon.smithi008 (mon.0) 5 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-10-18T20:59:01.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:01.220333+0000 mon.smithi008 (mon.0) 6 : cluster [DBG] mgrmap e28: smithi008.flmjzp(active, since 32s), standbys: smithi060.pgqqwa 2023-10-18T20:59:01.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:01.221695+0000 mon.smithi008 (mon.0) 7 : cluster [DBG] Standby manager daemon smithi060.pgqqwa restarted 2023-10-18T20:59:01.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:01.221741+0000 mon.smithi008 (mon.0) 8 : cluster [DBG] Standby manager daemon smithi060.pgqqwa started 2023-10-18T20:59:01.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:01.227147+0000 mon.smithi008 (mon.0) 9 : cluster [INF] overall HEALTH_OK 2023-10-18T20:59:01.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:01.227318+0000 mon.smithi008 (mon.0) 10 : audit [INF] from='mgr.14640 ' entity='' 2023-10-18T20:59:01.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:01.229042+0000 mon.smithi060 (mon.1) 65 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:58:57.983554+0000 mon.smithi060 (mon.1) 59 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi008"}]: dispatch 2023-10-18T20:59:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:58:57.984380+0000 mon.smithi060 (mon.1) 60 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2023-10-18T20:59:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:58:58.124032+0000 mgr.smithi008.flmjzp (mgr.14640) 27 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 189 MiB/s rd, 237 MiB/s wr, 387 op/s 2023-10-18T20:59:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:58:59.437185+0000 mon.smithi060 (mon.1) 61 : audit [DBG] from='mgr.? 172.21.15.60:0/2811441980' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/crt"}]: dispatch 2023-10-18T20:59:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:58:59.437639+0000 mon.smithi060 (mon.1) 62 : audit [DBG] from='mgr.? 172.21.15.60:0/2811441980' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T20:59:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:58:59.440707+0000 mon.smithi060 (mon.1) 63 : audit [DBG] from='mgr.? 172.21.15.60:0/2811441980' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.pgqqwa/key"}]: dispatch 2023-10-18T20:59:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:58:59.442045+0000 mon.smithi060 (mon.1) 64 : audit [DBG] from='mgr.? 172.21.15.60:0/2811441980' entity='mgr.smithi060.pgqqwa' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T20:59:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:00.124639+0000 mgr.smithi008.flmjzp (mgr.14640) 28 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 99 MiB/s rd, 120 MiB/s wr, 226 op/s 2023-10-18T20:59:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:01.211318+0000 mon.smithi008 (mon.0) 1 : cluster [INF] mon.smithi008 calling monitor election 2023-10-18T20:59:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:01.213698+0000 mon.smithi008 (mon.0) 2 : cluster [INF] mon.smithi008 is new leader, mons smithi008,smithi060 in quorum (ranks 0,1) 2023-10-18T20:59:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:01.218425+0000 mon.smithi008 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi008=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} removed_ranks: {} 2023-10-18T20:59:01.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:01.219300+0000 mon.smithi008 (mon.0) 4 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:59:01.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:01.219361+0000 mon.smithi008 (mon.0) 5 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-10-18T20:59:01.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:01.220333+0000 mon.smithi008 (mon.0) 6 : cluster [DBG] mgrmap e28: smithi008.flmjzp(active, since 32s), standbys: smithi060.pgqqwa 2023-10-18T20:59:01.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:01.221695+0000 mon.smithi008 (mon.0) 7 : cluster [DBG] Standby manager daemon smithi060.pgqqwa restarted 2023-10-18T20:59:01.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:01.221741+0000 mon.smithi008 (mon.0) 8 : cluster [DBG] Standby manager daemon smithi060.pgqqwa started 2023-10-18T20:59:01.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:01.227147+0000 mon.smithi008 (mon.0) 9 : cluster [INF] overall HEALTH_OK 2023-10-18T20:59:01.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:01.227318+0000 mon.smithi008 (mon.0) 10 : audit [INF] from='mgr.14640 ' entity='' 2023-10-18T20:59:01.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:01.229042+0000 mon.smithi060 (mon.1) 65 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:01.281058+0000 mon.smithi008 (mon.0) 11 : cluster [DBG] mgrmap e29: smithi008.flmjzp(active, since 32s), standbys: smithi060.pgqqwa 2023-10-18T20:59:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:01.281058+0000 mon.smithi008 (mon.0) 11 : cluster [DBG] mgrmap e29: smithi008.flmjzp(active, since 32s), standbys: smithi060.pgqqwa 2023-10-18T20:59:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:02.125066+0000 mgr.smithi008.flmjzp (mgr.14640) 29 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 99 MiB/s rd, 121 MiB/s wr, 272 op/s 2023-10-18T20:59:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:02.125066+0000 mgr.smithi008.flmjzp (mgr.14640) 29 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 99 MiB/s rd, 121 MiB/s wr, 272 op/s 2023-10-18T20:59:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:04.125466+0000 mgr.smithi008.flmjzp (mgr.14640) 30 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 18 MiB/s rd, 22 MiB/s wr, 128 op/s 2023-10-18T20:59:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:04.125466+0000 mgr.smithi008.flmjzp (mgr.14640) 30 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 18 MiB/s rd, 22 MiB/s wr, 128 op/s 2023-10-18T20:59:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:06.125865+0000 mgr.smithi008.flmjzp (mgr.14640) 31 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 18 MiB/s rd, 22 MiB/s wr, 128 op/s 2023-10-18T20:59:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:07.233939+0000 mon.smithi008 (mon.0) 12 : audit [INF] from='mgr.14640 ' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:07.235916+0000 mon.smithi060 (mon.1) 66 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:07.237052+0000 mon.smithi060 (mon.1) 67 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:59:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:07.243019+0000 mon.smithi008 (mon.0) 13 : audit [INF] from='mgr.14640 ' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:07.249823+0000 mon.smithi060 (mon.1) 68 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:07.253803+0000 mon.smithi060 (mon.1) 69 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:07.255337+0000 mon.smithi060 (mon.1) 70 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-10-18T20:59:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:06.125865+0000 mgr.smithi008.flmjzp (mgr.14640) 31 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 18 MiB/s rd, 22 MiB/s wr, 128 op/s 2023-10-18T20:59:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:07.233939+0000 mon.smithi008 (mon.0) 12 : audit [INF] from='mgr.14640 ' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:07.235916+0000 mon.smithi060 (mon.1) 66 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:07.237052+0000 mon.smithi060 (mon.1) 67 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:59:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:07.243019+0000 mon.smithi008 (mon.0) 13 : audit [INF] from='mgr.14640 ' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:07.249823+0000 mon.smithi060 (mon.1) 68 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:07.253803+0000 mon.smithi060 (mon.1) 69 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:07.255337+0000 mon.smithi060 (mon.1) 70 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-10-18T20:59:08.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:59:07.237909+0000 mgr.smithi008.flmjzp (mgr.14640) 32 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:59:08.659 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:07.237909+0000 mgr.smithi008.flmjzp (mgr.14640) 32 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:59:09.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cluster 2023-10-18T20:59:08.126437+0000 mgr.smithi008.flmjzp (mgr.14640) 33 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 2.4 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 19 MiB/s rd, 23 MiB/s wr, 187 op/s 2023-10-18T20:59:09.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:59:08.466133+0000 mgr.smithi008.flmjzp (mgr.14640) 34 : cephadm [INF] Upgrade: Updating mon.smithi060 2023-10-18T20:59:09.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:08.470433+0000 mon.smithi008 (mon.0) 14 : audit [INF] from='mgr.14640 ' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:09.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:08.472235+0000 mon.smithi060 (mon.1) 71 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T20:59:09.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:08.472937+0000 mon.smithi060 (mon.1) 72 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T20:59:09.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: audit 2023-10-18T20:59:08.473824+0000 mon.smithi060 (mon.1) 73 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:09.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: cephadm 2023-10-18T20:59:08.474670+0000 mgr.smithi008.flmjzp (mgr.14640) 35 : cephadm [INF] Deploying daemon mon.smithi060 on smithi060 2023-10-18T20:59:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:08.126437+0000 mgr.smithi008.flmjzp (mgr.14640) 33 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 2.4 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 19 MiB/s rd, 23 MiB/s wr, 187 op/s 2023-10-18T20:59:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:08.466133+0000 mgr.smithi008.flmjzp (mgr.14640) 34 : cephadm [INF] Upgrade: Updating mon.smithi060 2023-10-18T20:59:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:08.470433+0000 mon.smithi008 (mon.0) 14 : audit [INF] from='mgr.14640 ' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:08.472235+0000 mon.smithi060 (mon.1) 71 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T20:59:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:08.472937+0000 mon.smithi060 (mon.1) 72 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T20:59:09.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:08.473824+0000 mon.smithi060 (mon.1) 73 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:09.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:08.474670+0000 mgr.smithi008.flmjzp (mgr.14640) 35 : cephadm [INF] Deploying daemon mon.smithi060 on smithi060 2023-10-18T20:59:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:10 smithi060 systemd[1]: Stopping Ceph mon.smithi060 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T20:59:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:59:10.141+0000 7f019c42f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi060 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-10-18T20:59:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060[110717]: debug 2023-10-18T20:59:10.141+0000 7f019c42f700 -1 mon.smithi060@1(peon) e2 *** Got Signal Terminated *** 2023-10-18T20:59:10.900 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-18T20:59:10.900 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-10-18T20:59:10.919 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:10 smithi060 bash[129422]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon.smithi060 2023-10-18T20:59:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:11 smithi060 systemd[1]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@mon.smithi060.service: Succeeded. 2023-10-18T20:59:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:11 smithi060 systemd[1]: Stopped Ceph mon.smithi060 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T20:59:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:11 smithi060 systemd[1]: Starting Ceph mon.smithi060 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T20:59:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 bash[129619]: 6d113d9ab6efd755a0c244f73f2c9951a893e15ce39bb5150d31c54f0a394ae2 2023-10-18T20:59:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 systemd[1]: Started Ceph mon.smithi060 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T20:59:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.198+0000 7fab2197c880 0 set uid:gid to 167:167 (ceph:ceph) 2023-10-18T20:59:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.198+0000 7fab2197c880 0 ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable), process ceph-mon, pid 7 2023-10-18T20:59:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.198+0000 7fab2197c880 0 pidfile_write: ignore empty --pid-file 2023-10-18T20:59:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.204+0000 7fab2197c880 0 load: jerasure load: lrc load: isa 2023-10-18T20:59:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: RocksDB version: 6.8.1 2023-10-18T20:59:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-10-18T20:59:12.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Compile date Oct 16 2023 2023-10-18T20:59:12.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: DB SUMMARY 2023-10-18T20:59:12.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: CURRENT file: CURRENT 2023-10-18T20:59:12.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: IDENTITY file: IDENTITY 2023-10-18T20:59:12.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 316 Bytes 2023-10-18T20:59:12.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi060/store.db dir, Total Num: 1, files: 000011.sst 2023-10-18T20:59:12.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi060/store.db: 000009.log size: 10681329 ; 2023-10-18T20:59:12.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.error_if_exists: 0 2023-10-18T20:59:12.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.create_if_missing: 0 2023-10-18T20:59:12.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.paranoid_checks: 1 2023-10-18T20:59:12.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.env: 0x561297dc2080 2023-10-18T20:59:12.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.fs: Posix File System 2023-10-18T20:59:12.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.info_log: 0x56129997fd80 2023-10-18T20:59:12.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.max_file_opening_threads: 16 2023-10-18T20:59:12.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.statistics: (nil) 2023-10-18T20:59:12.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.use_fsync: 0 2023-10-18T20:59:12.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.max_log_file_size: 0 2023-10-18T20:59:12.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-18T20:59:12.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.log_file_time_to_roll: 0 2023-10-18T20:59:12.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.keep_log_file_num: 1000 2023-10-18T20:59:12.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.recycle_log_file_num: 0 2023-10-18T20:59:12.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.allow_fallocate: 1 2023-10-18T20:59:12.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.allow_mmap_reads: 0 2023-10-18T20:59:12.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.allow_mmap_writes: 0 2023-10-18T20:59:12.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.use_direct_reads: 0 2023-10-18T20:59:12.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-18T20:59:12.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.create_missing_column_families: 0 2023-10-18T20:59:12.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.db_log_dir: 2023-10-18T20:59:12.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi060/store.db 2023-10-18T20:59:12.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.table_cache_numshardbits: 6 2023-10-18T20:59:12.497 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.max_subcompactions: 1 2023-10-18T20:59:12.497 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.max_background_flushes: -1 2023-10-18T20:59:12.497 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-10-18T20:59:12.497 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-10-18T20:59:12.497 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-18T20:59:12.498 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-18T20:59:12.498 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-10-18T20:59:12.498 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.advise_random_on_open: 1 2023-10-18T20:59:12.498 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.db_write_buffer_size: 0 2023-10-18T20:59:12.498 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.write_buffer_manager: 0x56129a67a360 2023-10-18T20:59:12.499 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-18T20:59:12.499 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-10-18T20:59:12.499 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-18T20:59:12.499 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.use_adaptive_mutex: 0 2023-10-18T20:59:12.499 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.rate_limiter: (nil) 2023-10-18T20:59:12.500 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-18T20:59:12.500 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.wal_recovery_mode: 2 2023-10-18T20:59:12.500 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.enable_thread_tracking: 0 2023-10-18T20:59:12.500 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.enable_pipelined_write: 0 2023-10-18T20:59:12.500 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.unordered_write: 0 2023-10-18T20:59:12.500 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-18T20:59:12.501 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-18T20:59:12.501 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-18T20:59:12.501 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-18T20:59:12.501 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.row_cache: None 2023-10-18T20:59:12.501 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.wal_filter: None 2023-10-18T20:59:12.502 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-18T20:59:12.502 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.allow_ingest_behind: 0 2023-10-18T20:59:12.502 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.preserve_deletes: 0 2023-10-18T20:59:12.502 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.205+0000 7fab2197c880 4 rocksdb: Options.two_write_queues: 0 2023-10-18T20:59:12.502 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.manual_wal_flush: 0 2023-10-18T20:59:12.503 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.atomic_flush: 0 2023-10-18T20:59:12.503 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-18T20:59:12.503 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.persist_stats_to_disk: 0 2023-10-18T20:59:12.503 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-10-18T20:59:12.503 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.log_readahead_size: 0 2023-10-18T20:59:12.504 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-10-18T20:59:12.504 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_background_jobs: 2 2023-10-18T20:59:12.504 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_background_compactions: -1 2023-10-18T20:59:12.504 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-18T20:59:12.506 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-18T20:59:12.506 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.delayed_write_rate : 16777216 2023-10-18T20:59:12.506 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_total_wal_size: 0 2023-10-18T20:59:12.507 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-18T20:59:12.507 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.stats_dump_period_sec: 600 2023-10-18T20:59:12.507 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.stats_persist_period_sec: 600 2023-10-18T20:59:12.507 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-18T20:59:12.507 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_open_files: -1 2023-10-18T20:59:12.508 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.bytes_per_sync: 0 2023-10-18T20:59:12.508 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-10-18T20:59:12.508 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-10-18T20:59:12.508 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_readahead_size: 0 2023-10-18T20:59:12.508 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Compression algorithms supported: 2023-10-18T20:59:12.508 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-18T20:59:12.509 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: kZSTD supported: 0 2023-10-18T20:59:12.509 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: kXpressCompression supported: 0 2023-10-18T20:59:12.509 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: kLZ4HCCompression supported: 1 2023-10-18T20:59:12.509 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: kLZ4Compression supported: 1 2023-10-18T20:59:12.509 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: kBZip2Compression supported: 0 2023-10-18T20:59:12.510 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: kZlibCompression supported: 1 2023-10-18T20:59:12.510 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: kSnappyCompression supported: 1 2023-10-18T20:59:12.510 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-10-18T20:59:12.510 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000005 2023-10-18T20:59:12.510 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.511 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-10-18T20:59:12.511 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.511 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-18T20:59:12.511 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.merge_operator: 2023-10-18T20:59:12.511 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_filter: None 2023-10-18T20:59:12.512 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_filter_factory: None 2023-10-18T20:59:12.512 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-10-18T20:59:12.512 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.table_factory: BlockBasedTable 2023-10-18T20:59:12.512 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56129992fd18) 2023-10-18T20:59:12.512 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cache_index_and_filter_blocks: 1 2023-10-18T20:59:12.512 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-18T20:59:12.513 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-18T20:59:12.513 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: pin_top_level_index_and_filter: 1 2023-10-18T20:59:12.513 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: index_type: 0 2023-10-18T20:59:12.513 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: data_block_index_type: 0 2023-10-18T20:59:12.513 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: index_shortening: 1 2023-10-18T20:59:12.514 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: data_block_hash_table_util_ratio: 0.750000 2023-10-18T20:59:12.514 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: hash_index_allow_collision: 1 2023-10-18T20:59:12.514 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: checksum: 1 2023-10-18T20:59:12.514 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: no_block_cache: 0 2023-10-18T20:59:12.514 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: block_cache: 0x561299964f10 2023-10-18T20:59:12.515 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: block_cache_name: BinnedLRUCache 2023-10-18T20:59:12.515 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: block_cache_options: 2023-10-18T20:59:12.515 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: capacity : 536870912 2023-10-18T20:59:12.515 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: num_shard_bits : 4 2023-10-18T20:59:12.515 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: strict_capacity_limit : 0 2023-10-18T20:59:12.516 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: high_pri_pool_ratio: 0.000 2023-10-18T20:59:12.516 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: block_cache_compressed: (nil) 2023-10-18T20:59:12.516 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: persistent_cache: (nil) 2023-10-18T20:59:12.516 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: block_size: 4096 2023-10-18T20:59:12.516 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: block_size_deviation: 10 2023-10-18T20:59:12.517 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: block_restart_interval: 16 2023-10-18T20:59:12.517 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: index_block_restart_interval: 1 2023-10-18T20:59:12.517 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: metadata_block_size: 4096 2023-10-18T20:59:12.517 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: partition_filters: 0 2023-10-18T20:59:12.517 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: use_delta_encoding: 1 2023-10-18T20:59:12.517 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: filter_policy: rocksdb.BuiltinBloomFilter 2023-10-18T20:59:12.518 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: whole_key_filtering: 1 2023-10-18T20:59:12.518 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: verify_compression: 0 2023-10-18T20:59:12.518 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: read_amp_bytes_per_bit: 0 2023-10-18T20:59:12.518 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: format_version: 2 2023-10-18T20:59:12.518 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: enable_index_compression: 1 2023-10-18T20:59:12.519 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: block_align: 0 2023-10-18T20:59:12.519 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.519 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.write_buffer_size: 33554432 2023-10-18T20:59:12.519 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_write_buffer_number: 2 2023-10-18T20:59:12.519 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compression: NoCompression 2023-10-18T20:59:12.520 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.bottommost_compression: Disabled 2023-10-18T20:59:12.520 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.prefix_extractor: nullptr 2023-10-18T20:59:12.520 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-18T20:59:12.520 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.num_levels: 7 2023-10-18T20:59:12.520 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-18T20:59:12.521 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-18T20:59:12.521 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-18T20:59:12.521 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-18T20:59:12.521 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-18T20:59:12.521 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-18T20:59:12.521 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-18T20:59:12.522 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-18T20:59:12.522 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-18T20:59:12.522 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compression_opts.window_bits: -14 2023-10-18T20:59:12.522 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compression_opts.level: 32767 2023-10-18T20:59:12.522 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compression_opts.strategy: 0 2023-10-18T20:59:12.523 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-18T20:59:12.523 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-18T20:59:12.523 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compression_opts.enabled: false 2023-10-18T20:59:12.523 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-18T20:59:12.523 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-18T20:59:12.524 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-18T20:59:12.524 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.target_file_size_base: 67108864 2023-10-18T20:59:12.524 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.target_file_size_multiplier: 1 2023-10-18T20:59:12.524 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-18T20:59:12.524 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-18T20:59:12.524 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-18T20:59:12.525 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-18T20:59:12.525 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-18T20:59:12.525 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-18T20:59:12.525 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-18T20:59:12.525 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-18T20:59:12.526 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-18T20:59:12.526 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-18T20:59:12.526 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-18T20:59:12.526 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-18T20:59:12.526 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.arena_block_size: 4194304 2023-10-18T20:59:12.527 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-18T20:59:12.527 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-18T20:59:12.527 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-10-18T20:59:12.527 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.disable_auto_compactions: 0 2023-10-18T20:59:12.527 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-18T20:59:12.527 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-18T20:59:12.528 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-18T20:59:12.528 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-18T20:59:12.528 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-18T20:59:12.528 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-18T20:59:12.528 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-18T20:59:12.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-18T20:59:12.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-18T20:59:12.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-18T20:59:12.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.table_properties_collectors: 2023-10-18T20:59:12.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.inplace_update_support: 0 2023-10-18T20:59:12.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-10-18T20:59:12.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-18T20:59:12.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-18T20:59:12.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.memtable_huge_page_size: 0 2023-10-18T20:59:12.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.bloom_locality: 0 2023-10-18T20:59:12.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.max_successive_merges: 0 2023-10-18T20:59:12.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-10-18T20:59:12.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.paranoid_file_checks: 0 2023-10-18T20:59:12.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.force_consistency_checks: 0 2023-10-18T20:59:12.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.report_bg_io_stats: 0 2023-10-18T20:59:12.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.ttl: 2592000 2023-10-18T20:59:12.532 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.206+0000 7fab2197c880 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-10-18T20:59:12.532 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.209+0000 7fab2197c880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-10-18T20:59:12.532 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.209+0000 7fab2197c880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 13, last_sequence is 6390, log_number is 9,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-18T20:59:12.532 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.533 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.209+0000 7fab2197c880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 9 2023-10-18T20:59:12.533 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.533 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.209+0000 7fab2197c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662752210725, "job": 1, "event": "recovery_started", "log_files": [9]} 2023-10-18T20:59:12.533 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.209+0000 7fab2197c880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #9 mode 2 2023-10-18T20:59:12.533 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.235+0000 7fab2197c880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-10-18T20:59:12.534 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.246+0000 7fab2197c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662752247110, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 6907681, "table_properties": {"data_size": 6896733, "index_size": 8908, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1221, "raw_key_size": 10192, "raw_average_key_size": 21, "raw_value_size": 6882912, "raw_average_value_size": 14613, "num_data_blocks": 284, "num_entries": 471, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1697662752, "oldest_key_time": 3, "file_creation_time": 0}} 2023-10-18T20:59:12.534 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.246+0000 7fab2197c880 4 rocksdb: [version_set.cc:3826] Creating manifest 14 2023-10-18T20:59:12.534 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.534 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.246+0000 7fab2197c880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-10-18T20:59:12.534 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.247+0000 7fab2197c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1697662752248034, "job": 1, "event": "recovery_finished"} 2023-10-18T20:59:12.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.249+0000 7fab2197c880 4 rocksdb: DB pointer 0x561299a2d800 2023-10-18T20:59:12.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.249+0000 7fab08782700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-10-18T20:59:12.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.249+0000 7fab08782700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-10-18T20:59:12.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ** DB Stats ** 2023-10-18T20:59:12.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:59:12.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-18T20:59:12.536 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T20:59:12.536 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T20:59:12.536 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-18T20:59:12.536 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-10-18T20:59:12.536 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T20:59:12.537 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.537 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ** Compaction Stats [default] ** 2023-10-18T20:59:12.537 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:59:12.537 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:59:12.537 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: L0 1/0 6.59 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 614.6 0.01 0.00 1 0.011 0 0 2023-10-18T20:59:12.538 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: L6 1/0 17.22 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:59:12.538 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Sum 2/0 23.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 614.6 0.01 0.00 1 0.011 0 0 2023-10-18T20:59:12.538 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 614.6 0.01 0.00 1 0.011 0 0 2023-10-18T20:59:12.538 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.538 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ** Compaction Stats [default] ** 2023-10-18T20:59:12.539 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:59:12.539 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:59:12.539 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 614.6 0.01 0.00 1 0.011 0 0 2023-10-18T20:59:12.539 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:59:12.539 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Flush(GB): cumulative 0.006, interval 0.006 2023-10-18T20:59:12.539 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T20:59:12.540 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T20:59:12.540 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T20:59:12.540 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: AddFile(Keys): cumulative 0, interval 0 2023-10-18T20:59:12.540 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Cumulative compaction: 0.01 GB write, 153.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:59:12.540 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Interval compaction: 0.01 GB write, 153.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:59:12.541 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T20:59:12.541 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.541 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ** File Read Latency Histogram By Level [default] ** 2023-10-18T20:59:12.541 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.541 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ** Compaction Stats [default] ** 2023-10-18T20:59:12.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:59:12.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:59:12.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: L0 1/0 6.59 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 614.6 0.01 0.00 1 0.011 0 0 2023-10-18T20:59:12.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: L6 1/0 17.22 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:59:12.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Sum 2/0 23.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 614.6 0.01 0.00 1 0.011 0 0 2023-10-18T20:59:12.543 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-10-18T20:59:12.543 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.543 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ** Compaction Stats [default] ** 2023-10-18T20:59:12.543 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-10-18T20:59:12.543 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T20:59:12.544 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 614.6 0.01 0.00 1 0.011 0 0 2023-10-18T20:59:12.544 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T20:59:12.544 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Flush(GB): cumulative 0.006, interval 0.000 2023-10-18T20:59:12.544 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T20:59:12.544 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T20:59:12.544 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T20:59:12.545 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: AddFile(Keys): cumulative 0, interval 0 2023-10-18T20:59:12.545 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Cumulative compaction: 0.01 GB write, 152.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:59:12.545 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T20:59:12.545 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T20:59:12.545 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.546 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: ** File Read Latency Histogram By Level [default] ** 2023-10-18T20:59:12.546 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.546 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.250+0000 7fab2197c880 0 starting mon.smithi060 rank 1 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi060 fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:59:12.546 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.252+0000 7fab2197c880 1 mon.smithi060@-1(???) e2 preinit fsid e1aaa62c-6df7-11ee-8db6-212e2dc638e7 2023-10-18T20:59:12.546 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.252+0000 7fab2197c880 0 mon.smithi060@-1(???).mds e16 new map 2023-10-18T20:59:12.547 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.252+0000 7fab2197c880 0 mon.smithi060@-1(???).mds e16 print_map 2023-10-18T20:59:12.547 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: e16 2023-10-18T20:59:12.547 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:59:12.547 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:59:12.547 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: legacy client fscid: 1 2023-10-18T20:59:12.548 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.548 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: Filesystem 'cephfs' (1) 2023-10-18T20:59:12.548 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: fs_name cephfs 2023-10-18T20:59:12.548 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: epoch 16 2023-10-18T20:59:12.548 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: flags 32 2023-10-18T20:59:12.548 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:59:12.549 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: modified 2023-10-18T20:57:40.516856+0000 2023-10-18T20:59:12.549 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: tableserver 0 2023-10-18T20:59:12.549 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: root 0 2023-10-18T20:59:12.549 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: session_timeout 60 2023-10-18T20:59:12.549 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: session_autoclose 300 2023-10-18T20:59:12.550 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: max_file_size 1099511627776 2023-10-18T20:59:12.550 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: required_client_features {} 2023-10-18T20:59:12.550 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: last_failure 0 2023-10-18T20:59:12.550 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: last_failure_osd_epoch 0 2023-10-18T20:59:12.550 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:59:12.551 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: max_mds 2 2023-10-18T20:59:12.551 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: in 0,1 2023-10-18T20:59:12.551 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: up {0=14456,1=24321} 2023-10-18T20:59:12.551 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: failed 2023-10-18T20:59:12.551 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: damaged 2023-10-18T20:59:12.552 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: stopped 2023-10-18T20:59:12.552 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: data_pools [3] 2023-10-18T20:59:12.552 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: metadata_pool 2 2023-10-18T20:59:12.552 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: inline_data disabled 2023-10-18T20:59:12.552 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: balancer 2023-10-18T20:59:12.553 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: standby_count_wanted 1 2023-10-18T20:59:12.553 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: [mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:12.553 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: [mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:12.553 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: [mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:12.553 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: [mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:12.554 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.554 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.554 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: 2023-10-18T20:59:12.554 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.253+0000 7fab2197c880 0 mon.smithi060@-1(???).osd e45 crush map has features 3314933000852226048, adjusting msgr requires 2023-10-18T20:59:12.554 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.253+0000 7fab2197c880 0 mon.smithi060@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-10-18T20:59:12.555 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.253+0000 7fab2197c880 0 mon.smithi060@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-10-18T20:59:12.555 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.253+0000 7fab2197c880 0 mon.smithi060@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-10-18T20:59:12.555 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:08.126437+0000 mgr.smithi008.flmjzp (mgr.14640) 33 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 2.4 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 19 MiB/s rd, 23 MiB/s wr, 187 op/s 2023-10-18T20:59:12.555 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:08.466133+0000 mgr.smithi008.flmjzp (mgr.14640) 34 : cephadm [INF] Upgrade: Updating mon.smithi060 2023-10-18T20:59:12.555 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:08.470433+0000 mon.smithi008 (mon.0) 14 : audit [INF] from='mgr.14640 ' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:12.555 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:08.472235+0000 mon.smithi060 (mon.1) 71 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T20:59:12.556 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:08.472937+0000 mon.smithi060 (mon.1) 72 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T20:59:12.556 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:08.473824+0000 mon.smithi060 (mon.1) 73 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:12.556 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:08.474670+0000 mgr.smithi008.flmjzp (mgr.14640) 35 : cephadm [INF] Deploying daemon mon.smithi060 on smithi060 2023-10-18T20:59:12.556 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: debug 2023-10-18T20:59:12.253+0000 7fab2197c880 1 mon.smithi060@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2023-10-18T20:59:13.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.084+0000 7f2703fff700 1 -- 172.21.15.8:0/1831599247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27040f77d0 msgr2=0x7f27040f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:13.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.084+0000 7f2703fff700 1 --2- 172.21.15.8:0/1831599247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27040f77d0 0x7f27040f7c30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f26f8004660 tx=0x7f26f8009b30).stop 2023-10-18T20:59:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.084+0000 7f2703fff700 1 -- 172.21.15.8:0/1831599247 shutdown_connections 2023-10-18T20:59:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.084+0000 7f2703fff700 1 --2- 172.21.15.8:0/1831599247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27040f77d0 0x7f27040f7c30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.084+0000 7f2703fff700 1 --2- 172.21.15.8:0/1831599247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040f6530 0x7f27040f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.084+0000 7f2703fff700 1 -- 172.21.15.8:0/1831599247 >> 172.21.15.8:0/1831599247 conn(0x7f27040f1c90 msgr2=0x7f27040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.084+0000 7f2703fff700 1 -- 172.21.15.8:0/1831599247 shutdown_connections 2023-10-18T20:59:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.084+0000 7f2703fff700 1 -- 172.21.15.8:0/1831599247 wait complete. 2023-10-18T20:59:13.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.085+0000 7f2703fff700 1 Processor -- start 2023-10-18T20:59:13.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.085+0000 7f2703fff700 1 -- start start 2023-10-18T20:59:13.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f2703fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040f6530 0x7f2704108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:13.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f2703fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27040f77d0 0x7f2704109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:13.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f2703fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27041099b0 con 0x7f27040f77d0 2023-10-18T20:59:13.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f2703fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2704109af0 con 0x7f27040f6530 2023-10-18T20:59:13.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f27027fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27040f77d0 0x7f2704109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:13.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f27027fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27040f77d0 0x7f2704109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47542/0 (socket says 172.21.15.8:47542) 2023-10-18T20:59:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f27027fc700 1 -- 172.21.15.8:0/1825268120 learned_addr learned my addr 172.21.15.8:0/1825268120 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f2702ffd700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040f6530 0x7f2704108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f2702ffd700 1 -- 172.21.15.8:0/1825268120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040f6530 msgr2=0x7f2704108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-10-18T20:59:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f2702ffd700 1 -- 172.21.15.8:0/1825268120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040f6530 msgr2=0x7f2704108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-18T20:59:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f2702ffd700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040f6530 0x7f2704108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T20:59:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.086+0000 7f2702ffd700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040f6530 0x7f2704108f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T20:59:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.087+0000 7f27027fc700 1 -- 172.21.15.8:0/1825268120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040f6530 msgr2=0x7f2704108f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:59:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.087+0000 7f27027fc700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040f6530 0x7f2704108f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.087+0000 7f27027fc700 1 -- 172.21.15.8:0/1825268120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f8005040 con 0x7f27040f77d0 2023-10-18T20:59:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.087+0000 7f27027fc700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27040f77d0 0x7f2704109400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f26f8009990 tx=0x7f26f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.087+0000 7f26eb7fe700 1 -- 172.21.15.8:0/1825268120 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f8018070 con 0x7f27040f77d0 2023-10-18T20:59:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.087+0000 7f26eb7fe700 1 -- 172.21.15.8:0/1825268120 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f26f8009630 con 0x7f27040f77d0 2023-10-18T20:59:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.087+0000 7f2703fff700 1 -- 172.21.15.8:0/1825268120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270410a430 con 0x7f27040f77d0 2023-10-18T20:59:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.087+0000 7f26eb7fe700 1 -- 172.21.15.8:0/1825268120 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f801c400 con 0x7f27040f77d0 2023-10-18T20:59:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.087+0000 7f2703fff700 1 -- 172.21.15.8:0/1825268120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270410a990 con 0x7f27040f77d0 2023-10-18T20:59:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.089+0000 7f2703fff700 1 -- 172.21.15.8:0/1825268120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2704045ad0 con 0x7f27040f77d0 2023-10-18T20:59:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.089+0000 7f26eb7fe700 1 -- 172.21.15.8:0/1825268120 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7f26f801d9e0 con 0x7f27040f77d0 2023-10-18T20:59:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.090+0000 7f26eb7fe700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f26ec061000 0x7f26ec0634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.090+0000 7f26eb7fe700 1 -- 172.21.15.8:0/1825268120 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f26f807df30 con 0x7f27040f77d0 2023-10-18T20:59:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.090+0000 7f2702ffd700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f26ec061000 0x7f26ec0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.091+0000 7f2702ffd700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f26ec061000 0x7f26ec0634c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f27040f7630 tx=0x7f26f4009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:13.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.096+0000 7f26eb7fe700 1 -- 172.21.15.8:0/1825268120 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f26f80acf20 con 0x7f27040f77d0 2023-10-18T20:59:13.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.309+0000 7f2703fff700 1 -- 172.21.15.8:0/1825268120 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f270410abb0 con 0x7f26ec061000 2023-10-18T20:59:13.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.310+0000 7f26eb7fe700 1 -- 172.21.15.8:0/1825268120 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f270410abb0 con 0x7f26ec061000 2023-10-18T20:59:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 -- 172.21.15.8:0/1825268120 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f26ec061000 msgr2=0x7f26ec0634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f26ec061000 0x7f26ec0634c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f27040f7630 tx=0x7f26f4009c00).stop 2023-10-18T20:59:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 -- 172.21.15.8:0/1825268120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27040f77d0 msgr2=0x7f2704109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27040f77d0 0x7f2704109400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f26f8009990 tx=0x7f26f8009b30).stop 2023-10-18T20:59:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 -- 172.21.15.8:0/1825268120 shutdown_connections 2023-10-18T20:59:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f26ec061000 0x7f26ec0634c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040f6530 0x7f2704108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 --2- 172.21.15.8:0/1825268120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27040f77d0 0x7f2704109400 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 -- 172.21.15.8:0/1825268120 >> 172.21.15.8:0/1825268120 conn(0x7f27040f1c90 msgr2=0x7f270406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 -- 172.21.15.8:0/1825268120 shutdown_connections 2023-10-18T20:59:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.312+0000 7f2703fff700 1 -- 172.21.15.8:0/1825268120 wait complete. 2023-10-18T20:59:13.328 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T20:59:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.451+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/1153794442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d00f9690 msgr2=0x7fc9d00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:13.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.451+0000 7fc9d6dc0700 1 --2- 172.21.15.8:0/1153794442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d00f9690 0x7fc9d00fbae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fc9c0004660 tx=0x7fc9c0009b30).stop 2023-10-18T20:59:13.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.451+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/1153794442 shutdown_connections 2023-10-18T20:59:13.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.451+0000 7fc9d6dc0700 1 --2- 172.21.15.8:0/1153794442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d00f9690 0x7fc9d00fbae0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.451+0000 7fc9d6dc0700 1 --2- 172.21.15.8:0/1153794442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0060310 0x7fc9d00f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.451+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/1153794442 >> 172.21.15.8:0/1153794442 conn(0x7fc9d00f0b90 msgr2=0x7fc9d00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.451+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/1153794442 shutdown_connections 2023-10-18T20:59:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.451+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/1153794442 wait complete. 2023-10-18T20:59:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.453+0000 7fc9d6dc0700 1 Processor -- start 2023-10-18T20:59:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.453+0000 7fc9d6dc0700 1 -- start start 2023-10-18T20:59:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.453+0000 7fc9d6dc0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0060310 0x7fc9d0108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.453+0000 7fc9d6dc0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d00f9690 0x7fc9d0109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.453+0000 7fc9d6dc0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d01099f0 con 0x7fc9d00f9690 2023-10-18T20:59:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.453+0000 7fc9d6dc0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0109b30 con 0x7fc9d0060310 2023-10-18T20:59:13.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d55bd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d00f9690 0x7fc9d0109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:13.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d5dbe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0060310 0x7fc9d0108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:13.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d55bd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d00f9690 0x7fc9d0109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47564/0 (socket says 172.21.15.8:47564) 2023-10-18T20:59:13.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d55bd700 1 -- 172.21.15.8:0/3828082953 learned_addr learned my addr 172.21.15.8:0/3828082953 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:13.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d5dbe700 1 -- 172.21.15.8:0/3828082953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0060310 msgr2=0x7fc9d0108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-10-18T20:59:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d5dbe700 1 -- 172.21.15.8:0/3828082953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0060310 msgr2=0x7fc9d0108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-18T20:59:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d5dbe700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0060310 0x7fc9d0108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T20:59:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d5dbe700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0060310 0x7fc9d0108f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T20:59:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d55bd700 1 -- 172.21.15.8:0/3828082953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0060310 msgr2=0x7fc9d0108f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:59:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d55bd700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0060310 0x7fc9d0108f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d55bd700 1 -- 172.21.15.8:0/3828082953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0005040 con 0x7fc9d00f9690 2023-10-18T20:59:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.454+0000 7fc9d55bd700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d00f9690 0x7fc9d0109440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc9c0004e30 tx=0x7fc9c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.455+0000 7fc9c67fc700 1 -- 172.21.15.8:0/3828082953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c0018070 con 0x7fc9d00f9690 2023-10-18T20:59:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.455+0000 7fc9c67fc700 1 -- 172.21.15.8:0/3828082953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc9c0009630 con 0x7fc9d00f9690 2023-10-18T20:59:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.455+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/3828082953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d010a470 con 0x7fc9d00f9690 2023-10-18T20:59:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.455+0000 7fc9c67fc700 1 -- 172.21.15.8:0/3828082953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c001c3c0 con 0x7fc9d00f9690 2023-10-18T20:59:13.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.455+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/3828082953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d010a9d0 con 0x7fc9d00f9690 2023-10-18T20:59:13.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.456+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/3828082953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0045ad0 con 0x7fc9d00f9690 2023-10-18T20:59:13.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.457+0000 7fc9c67fc700 1 -- 172.21.15.8:0/3828082953 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7fc9c001d420 con 0x7fc9d00f9690 2023-10-18T20:59:13.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.458+0000 7fc9c67fc700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9bc061000 0x7fc9bc0634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:13.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.458+0000 7fc9c67fc700 1 -- 172.21.15.8:0/3828082953 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc9c007df90 con 0x7fc9d00f9690 2023-10-18T20:59:13.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.458+0000 7fc9d5dbe700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9bc061000 0x7fc9bc0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:13.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.459+0000 7fc9d5dbe700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9bc061000 0x7fc9bc0634c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc9cc009fd0 tx=0x7fc9cc009c10).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:13.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.463+0000 7fc9c67fc700 1 -- 172.21.15.8:0/3828082953 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc9c0051da0 con 0x7fc9d00f9690 2023-10-18T20:59:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.665+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/3828082953 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9d00fa550 con 0x7fc9bc061000 2023-10-18T20:59:13.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.666+0000 7fc9c67fc700 1 -- 172.21.15.8:0/3828082953 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fc9d00fa550 con 0x7fc9bc061000 2023-10-18T20:59:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.668+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/3828082953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9bc061000 msgr2=0x7fc9bc0634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.668+0000 7fc9d6dc0700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9bc061000 0x7fc9bc0634c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc9cc009fd0 tx=0x7fc9cc009c10).stop 2023-10-18T20:59:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.668+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/3828082953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d00f9690 msgr2=0x7fc9d0109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.668+0000 7fc9d6dc0700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d00f9690 0x7fc9d0109440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc9c0004e30 tx=0x7fc9c0009b30).stop 2023-10-18T20:59:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.668+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/3828082953 shutdown_connections 2023-10-18T20:59:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.668+0000 7fc9d6dc0700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9bc061000 0x7fc9bc0634c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.668+0000 7fc9d6dc0700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0060310 0x7fc9d0108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.668+0000 7fc9d6dc0700 1 --2- 172.21.15.8:0/3828082953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d00f9690 0x7fc9d0109440 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.668+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/3828082953 >> 172.21.15.8:0/3828082953 conn(0x7fc9d00f0b90 msgr2=0x7fc9d00f9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.669+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/3828082953 shutdown_connections 2023-10-18T20:59:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.669+0000 7fc9d6dc0700 1 -- 172.21.15.8:0/3828082953 wait complete. 2023-10-18T20:59:13.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.835+0000 7fd352d65700 1 -- 172.21.15.8:0/1183601282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd34c060310 msgr2=0x7fd34c0fb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:13.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.835+0000 7fd352d65700 1 --2- 172.21.15.8:0/1183601282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd34c060310 0x7fd34c0fb510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd3380045a0 tx=0x7fd338009b30).stop 2023-10-18T20:59:13.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.835+0000 7fd352d65700 1 -- 172.21.15.8:0/1183601282 shutdown_connections 2023-10-18T20:59:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.835+0000 7fd352d65700 1 --2- 172.21.15.8:0/1183601282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd34c0fba00 0x7fd34c0fddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.835+0000 7fd352d65700 1 --2- 172.21.15.8:0/1183601282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd34c060310 0x7fd34c0fb510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.835+0000 7fd352d65700 1 -- 172.21.15.8:0/1183601282 >> 172.21.15.8:0/1183601282 conn(0x7fd34c0f0b90 msgr2=0x7fd34c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.835+0000 7fd352d65700 1 -- 172.21.15.8:0/1183601282 shutdown_connections 2023-10-18T20:59:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.835+0000 7fd352d65700 1 -- 172.21.15.8:0/1183601282 wait complete. 2023-10-18T20:59:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.836+0000 7fd352d65700 1 Processor -- start 2023-10-18T20:59:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.837+0000 7fd352d65700 1 -- start start 2023-10-18T20:59:13.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.838+0000 7fd352d65700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd34c060310 0x7fd34c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:13.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.838+0000 7fd352d65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd34c0fba00 0x7fd34c0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:13.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.839+0000 7fd352d65700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0696c0 con 0x7fd34c060310 2023-10-18T20:59:13.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.839+0000 7fd352d65700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c069800 con 0x7fd34c0fba00 2023-10-18T20:59:13.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.839+0000 7fd351d63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd34c060310 0x7fd34c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:13.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.839+0000 7fd351d63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd34c060310 0x7fd34c068bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47582/0 (socket says 172.21.15.8:47582) 2023-10-18T20:59:13.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.839+0000 7fd351d63700 1 -- 172.21.15.8:0/982666776 learned_addr learned my addr 172.21.15.8:0/982666776 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:13.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.839+0000 7fd351d63700 1 -- 172.21.15.8:0/982666776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd34c0fba00 msgr2=0x7fd34c0690c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-18T20:59:13.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.839+0000 7fd351d63700 1 --2- 172.21.15.8:0/982666776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd34c0fba00 0x7fd34c0690c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:59:13.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.839+0000 7fd351d63700 1 -- 172.21.15.8:0/982666776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338005040 con 0x7fd34c060310 2023-10-18T20:59:13.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.840+0000 7fd351d63700 1 --2- 172.21.15.8:0/982666776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd34c060310 0x7fd34c068bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd338014040 tx=0x7fd33800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:13.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.840+0000 7fd34a7fc700 1 -- 172.21.15.8:0/982666776 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd338019070 con 0x7fd34c060310 2023-10-18T20:59:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.840+0000 7fd352d65700 1 -- 172.21.15.8:0/982666776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c0fa760 con 0x7fd34c060310 2023-10-18T20:59:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.841+0000 7fd34a7fc700 1 -- 172.21.15.8:0/982666776 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd338007ba0 con 0x7fd34c060310 2023-10-18T20:59:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.841+0000 7fd34a7fc700 1 -- 172.21.15.8:0/982666776 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd338014ea0 con 0x7fd34c060310 2023-10-18T20:59:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.841+0000 7fd352d65700 1 -- 172.21.15.8:0/982666776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c0facc0 con 0x7fd34c060310 2023-10-18T20:59:13.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.843+0000 7fd352d65700 1 -- 172.21.15.8:0/982666776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c045ad0 con 0x7fd34c060310 2023-10-18T20:59:13.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.847+0000 7fd34a7fc700 1 -- 172.21.15.8:0/982666776 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7fd338025070 con 0x7fd34c060310 2023-10-18T20:59:13.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.848+0000 7fd34a7fc700 1 --2- 172.21.15.8:0/982666776 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd33c061050 0x7fd33c063510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:13.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.848+0000 7fd34a7fc700 1 -- 172.21.15.8:0/982666776 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd33807d940 con 0x7fd34c060310 2023-10-18T20:59:13.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.849+0000 7fd351562700 1 --2- 172.21.15.8:0/982666776 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd33c061050 0x7fd33c063510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:13.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.850+0000 7fd351562700 1 --2- 172.21.15.8:0/982666776 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd33c061050 0x7fd33c063510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd340004750 tx=0x7fd3400046a0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:13.853+0000 7fd34a7fc700 1 -- 172.21.15.8:0/982666776 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd33804dc90 con 0x7fd34c060310 2023-10-18T20:59:14.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.144+0000 7fd352d65700 1 -- 172.21.15.8:0/982666776 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd34c062780 con 0x7fd33c061050 2023-10-18T20:59:14.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.160+0000 7fd34a7fc700 1 -- 172.21.15.8:0/982666776 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd34c062780 con 0x7fd33c061050 2023-10-18T20:59:14.162 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T20:59:14.163 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (5m) 6s ago 7m 13.6M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T20:59:14.163 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (7m) 6s ago 7m 7256k - 16.2.4 8d91d370c2b8 4b2c6838af84 2023-10-18T20:59:14.163 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (6m) 19s ago 6m 7562k - 16.2.4 8d91d370c2b8 67dc04156fe1 2023-10-18T20:59:14.163 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (5m) 6s ago 7m 24.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T20:59:14.164 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (3m) 6s ago 3m 4443M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T20:59:14.164 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (3m) 6s ago 3m 560M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T20:59:14.164 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (3m) 19s ago 3m 1305M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T20:59:14.164 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (3m) 19s ago 3m 264M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T20:59:14.165 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (63s) 6s ago 8m 439M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T20:59:14.165 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (24s) 19s ago 6m 39.3M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T20:59:14.165 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (14s) 6s ago 8m 31.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T20:59:14.165 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 starting - - - 2048M 2023-10-18T20:59:14.165 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (6m) 6s ago 6m 9437k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T20:59:14.166 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (6m) 19s ago 6m 9869k - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T20:59:14.166 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (5m) 6s ago 5m 653M 4096M 16.2.4 8d91d370c2b8 885270808f90 2023-10-18T20:59:14.166 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (5m) 6s ago 5m 659M 4096M 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T20:59:14.167 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (5m) 6s ago 5m 551M 4096M 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T20:59:14.167 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (5m) 19s ago 5m 781M 4096M 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T20:59:14.167 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (4m) 19s ago 4m 624M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T20:59:14.167 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (4m) 19s ago 4m 657M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T20:59:14.167 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (85s) 6s ago 6m 48.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T20:59:14.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.164+0000 7fd352d65700 1 -- 172.21.15.8:0/982666776 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd33c061050 msgr2=0x7fd33c063510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.164+0000 7fd352d65700 1 --2- 172.21.15.8:0/982666776 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd33c061050 0x7fd33c063510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd340004750 tx=0x7fd3400046a0).stop 2023-10-18T20:59:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.164+0000 7fd352d65700 1 -- 172.21.15.8:0/982666776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd34c060310 msgr2=0x7fd34c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.164+0000 7fd352d65700 1 --2- 172.21.15.8:0/982666776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd34c060310 0x7fd34c068bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd338014040 tx=0x7fd33800b040).stop 2023-10-18T20:59:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.165+0000 7fd352d65700 1 -- 172.21.15.8:0/982666776 shutdown_connections 2023-10-18T20:59:14.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.165+0000 7fd352d65700 1 --2- 172.21.15.8:0/982666776 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd33c061050 0x7fd33c063510 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.165+0000 7fd352d65700 1 --2- 172.21.15.8:0/982666776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd34c060310 0x7fd34c068bd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.165+0000 7fd352d65700 1 --2- 172.21.15.8:0/982666776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd34c0fba00 0x7fd34c0690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T20:59:14.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.165+0000 7fd352d65700 1 -- 172.21.15.8:0/982666776 >> 172.21.15.8:0/982666776 conn(0x7fd34c0f0b90 msgr2=0x7fd34c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:14.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.165+0000 7fd352d65700 1 -- 172.21.15.8:0/982666776 shutdown_connections 2023-10-18T20:59:14.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.165+0000 7fd352d65700 1 -- 172.21.15.8:0/982666776 wait complete. 2023-10-18T20:59:14.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.316+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3991756641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd61406a3b0 msgr2=0x7fd61406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:14.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.316+0000 7fd61b0c5700 1 --2- 172.21.15.8:0/3991756641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd61406a3b0 0x7fd61406a830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd604004660 tx=0x7fd604009b30).stop 2023-10-18T20:59:14.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.316+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3991756641 shutdown_connections 2023-10-18T20:59:14.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.316+0000 7fd61b0c5700 1 --2- 172.21.15.8:0/3991756641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd61406a3b0 0x7fd61406a830 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.316+0000 7fd61b0c5700 1 --2- 172.21.15.8:0/3991756641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd61406b9c0 0x7fd614069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.316+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3991756641 >> 172.21.15.8:0/3991756641 conn(0x7fd6140f1c90 msgr2=0x7fd6140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.316+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3991756641 shutdown_connections 2023-10-18T20:59:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.316+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3991756641 wait complete. 2023-10-18T20:59:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.317+0000 7fd61b0c5700 1 Processor -- start 2023-10-18T20:59:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.317+0000 7fd61b0c5700 1 -- start start 2023-10-18T20:59:14.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd61b0c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd61406a3b0 0x7fd614108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:14.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd61b0c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd61406b9c0 0x7fd614109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:14.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd61b0c5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd614109a00 con 0x7fd61406a3b0 2023-10-18T20:59:14.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd61b0c5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd614109b40 con 0x7fd61406b9c0 2023-10-18T20:59:14.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd61a0c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd61406a3b0 0x7fd614108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:14.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd61a0c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd61406a3b0 0x7fd614108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47592/0 (socket says 172.21.15.8:47592) 2023-10-18T20:59:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd61a0c3700 1 -- 172.21.15.8:0/3297053211 learned_addr learned my addr 172.21.15.8:0/3297053211 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd6198c2700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd61406b9c0 0x7fd614109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd6198c2700 1 -- 172.21.15.8:0/3297053211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd61406b9c0 msgr2=0x7fd614109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-10-18T20:59:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd6198c2700 1 -- 172.21.15.8:0/3297053211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd61406b9c0 msgr2=0x7fd614109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-18T20:59:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd6198c2700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd61406b9c0 0x7fd614109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T20:59:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd6198c2700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd61406b9c0 0x7fd614109450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T20:59:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd61a0c3700 1 -- 172.21.15.8:0/3297053211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd61406b9c0 msgr2=0x7fd614109450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:59:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.318+0000 7fd61a0c3700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd61406b9c0 0x7fd614109450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.319+0000 7fd61a0c3700 1 -- 172.21.15.8:0/3297053211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604005040 con 0x7fd61406a3b0 2023-10-18T20:59:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.319+0000 7fd61a0c3700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd61406a3b0 0x7fd614108f60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd6100026d0 tx=0x7fd610009df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.319+0000 7fd60affd700 1 -- 172.21.15.8:0/3297053211 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd610009320 con 0x7fd61406a3b0 2023-10-18T20:59:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.319+0000 7fd60affd700 1 -- 172.21.15.8:0/3297053211 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd61000f040 con 0x7fd61406a3b0 2023-10-18T20:59:14.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.319+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3297053211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61410a4e0 con 0x7fd61406a3b0 2023-10-18T20:59:14.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.319+0000 7fd60affd700 1 -- 172.21.15.8:0/3297053211 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6100138b0 con 0x7fd61406a3b0 2023-10-18T20:59:14.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.319+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3297053211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61410aaa0 con 0x7fd61406a3b0 2023-10-18T20:59:14.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.320+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3297053211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd614045ad0 con 0x7fd61406a3b0 2023-10-18T20:59:14.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.321+0000 7fd60affd700 1 -- 172.21.15.8:0/3297053211 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7fd610009480 con 0x7fd61406a3b0 2023-10-18T20:59:14.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.322+0000 7fd60affd700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd600061000 0x7fd6000634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:14.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.322+0000 7fd60affd700 1 -- 172.21.15.8:0/3297053211 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd61007c190 con 0x7fd61406a3b0 2023-10-18T20:59:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.322+0000 7fd6198c2700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd600061000 0x7fd6000634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.323+0000 7fd6198c2700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd600061000 0x7fd6000634c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd604004e30 tx=0x7fd604009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.326+0000 7fd60affd700 1 -- 172.21.15.8:0/3297053211 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd61004ff70 con 0x7fd61406a3b0 2023-10-18T20:59:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:12.127317+0000 mgr.smithi008.flmjzp (mgr.14640) 37 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 165 op/s 2023-10-18T20:59:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:13.218021+0000 mon.smithi060 (mon.1) 1 : cluster [INF] mon.smithi060 calling monitor election 2023-10-18T20:59:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:13.219190+0000 mon.smithi008 (mon.0) 17 : cluster [INF] mon.smithi008 calling monitor election 2023-10-18T20:59:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:13.221466+0000 mon.smithi008 (mon.0) 18 : cluster [INF] mon.smithi008 is new leader, mons smithi008,smithi060 in quorum (ranks 0,1) 2023-10-18T20:59:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:13.224814+0000 mon.smithi008 (mon.0) 19 : cluster [DBG] monmap e2: 2 mons at {smithi008=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} removed_ranks: {} 2023-10-18T20:59:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:13.225629+0000 mon.smithi008 (mon.0) 20 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:59:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:13.225654+0000 mon.smithi008 (mon.0) 21 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-10-18T20:59:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:13.225905+0000 mon.smithi008 (mon.0) 22 : cluster [DBG] mgrmap e29: smithi008.flmjzp(active, since 44s), standbys: smithi060.pgqqwa 2023-10-18T20:59:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:13.228893+0000 mon.smithi008 (mon.0) 23 : cluster [INF] overall HEALTH_OK 2023-10-18T20:59:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:13.231514+0000 mon.smithi008 (mon.0) 24 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:14.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:13.232493+0000 mon.smithi008 (mon.0) 25 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:14.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:13.310316+0000 mgr.smithi008.flmjzp (mgr.14640) 38 : audit [DBG] from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:14.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.584+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3297053211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd614101050 con 0x7fd61406a3b0 2023-10-18T20:59:14.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.584+0000 7fd60affd700 1 -- 172.21.15.8:0/3297053211 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+712 (secure 0 0 0) 0x7fd61004fb60 con 0x7fd61406a3b0 2023-10-18T20:59:14.586 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:59:14.587 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T20:59:14.587 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T20:59:14.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:59:14.587 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T20:59:14.587 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T20:59:14.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:59:14.588 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T20:59:14.588 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-10-18T20:59:14.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:59:14.588 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T20:59:14.589 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T20:59:14.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:59:14.589 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T20:59:14.589 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 4, 2023-10-18T20:59:14.589 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10 2023-10-18T20:59:14.590 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T20:59:14.590 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:59:14.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.586+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3297053211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd600061000 msgr2=0x7fd6000634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:14.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.586+0000 7fd61b0c5700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd600061000 0x7fd6000634c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd604004e30 tx=0x7fd604009b30).stop 2023-10-18T20:59:14.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.586+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3297053211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd61406a3b0 msgr2=0x7fd614108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:14.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.586+0000 7fd61b0c5700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd61406a3b0 0x7fd614108f60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd6100026d0 tx=0x7fd610009df0).stop 2023-10-18T20:59:14.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.586+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3297053211 shutdown_connections 2023-10-18T20:59:14.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.586+0000 7fd61b0c5700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd600061000 0x7fd6000634c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.586+0000 7fd61b0c5700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd61406a3b0 0x7fd614108f60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.586+0000 7fd61b0c5700 1 --2- 172.21.15.8:0/3297053211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd61406b9c0 0x7fd614109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.586+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3297053211 >> 172.21.15.8:0/3297053211 conn(0x7fd6140f1c90 msgr2=0x7fd6140fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:14.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.587+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3297053211 shutdown_connections 2023-10-18T20:59:14.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.587+0000 7fd61b0c5700 1 -- 172.21.15.8:0/3297053211 wait complete. 2023-10-18T20:59:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:12.127317+0000 mgr.smithi008.flmjzp (mgr.14640) 37 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 165 op/s 2023-10-18T20:59:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:13.218021+0000 mon.smithi060 (mon.1) 1 : cluster [INF] mon.smithi060 calling monitor election 2023-10-18T20:59:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:13.219190+0000 mon.smithi008 (mon.0) 17 : cluster [INF] mon.smithi008 calling monitor election 2023-10-18T20:59:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:13.221466+0000 mon.smithi008 (mon.0) 18 : cluster [INF] mon.smithi008 is new leader, mons smithi008,smithi060 in quorum (ranks 0,1) 2023-10-18T20:59:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:13.224814+0000 mon.smithi008 (mon.0) 19 : cluster [DBG] monmap e2: 2 mons at {smithi008=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} removed_ranks: {} 2023-10-18T20:59:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:13.225629+0000 mon.smithi008 (mon.0) 20 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:59:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:13.225654+0000 mon.smithi008 (mon.0) 21 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-10-18T20:59:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:13.225905+0000 mon.smithi008 (mon.0) 22 : cluster [DBG] mgrmap e29: smithi008.flmjzp(active, since 44s), standbys: smithi060.pgqqwa 2023-10-18T20:59:14.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:13.228893+0000 mon.smithi008 (mon.0) 23 : cluster [INF] overall HEALTH_OK 2023-10-18T20:59:14.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:13.231514+0000 mon.smithi008 (mon.0) 24 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:14.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:13.232493+0000 mon.smithi008 (mon.0) 25 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:14.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:13.310316+0000 mgr.smithi008.flmjzp (mgr.14640) 38 : audit [DBG] from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.723+0000 7fa2af59e700 1 -- 172.21.15.8:0/2576693109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b00f6530 msgr2=0x7fa2b00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.723+0000 7fa2af59e700 1 --2- 172.21.15.8:0/2576693109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b00f6530 0x7fa2b00f6950 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa2a0004660 tx=0x7fa2a0009b30).stop 2023-10-18T20:59:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.723+0000 7fa2af59e700 1 -- 172.21.15.8:0/2576693109 shutdown_connections 2023-10-18T20:59:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.723+0000 7fa2af59e700 1 --2- 172.21.15.8:0/2576693109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2b00f77d0 0x7fa2b00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.723+0000 7fa2af59e700 1 --2- 172.21.15.8:0/2576693109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b00f6530 0x7fa2b00f6950 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.723+0000 7fa2af59e700 1 -- 172.21.15.8:0/2576693109 >> 172.21.15.8:0/2576693109 conn(0x7fa2b00f1c90 msgr2=0x7fa2b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.723+0000 7fa2af59e700 1 -- 172.21.15.8:0/2576693109 shutdown_connections 2023-10-18T20:59:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.723+0000 7fa2af59e700 1 -- 172.21.15.8:0/2576693109 wait complete. 2023-10-18T20:59:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.724+0000 7fa2af59e700 1 Processor -- start 2023-10-18T20:59:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.724+0000 7fa2af59e700 1 -- start start 2023-10-18T20:59:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2af59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2b00f6530 0x7fa2b0106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2af59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b00f77d0 0x7fa2b0107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2af59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0107920 con 0x7fa2b00f77d0 2023-10-18T20:59:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2af59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0108130 con 0x7fa2b00f6530 2023-10-18T20:59:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2add9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b00f77d0 0x7fa2b0107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2add9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b00f77d0 0x7fa2b0107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47606/0 (socket says 172.21.15.8:47606) 2023-10-18T20:59:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2add9b700 1 -- 172.21.15.8:0/1051380166 learned_addr learned my addr 172.21.15.8:0/1051380166 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2ae59c700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2b00f6530 0x7fa2b0106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2ae59c700 1 -- 172.21.15.8:0/1051380166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2b00f6530 msgr2=0x7fa2b0106e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-10-18T20:59:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2ae59c700 1 -- 172.21.15.8:0/1051380166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2b00f6530 msgr2=0x7fa2b0106e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-18T20:59:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2ae59c700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2b00f6530 0x7fa2b0106e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T20:59:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2ae59c700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2b00f6530 0x7fa2b0106e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T20:59:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2add9b700 1 -- 172.21.15.8:0/1051380166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2b00f6530 msgr2=0x7fa2b0106e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T20:59:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2add9b700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2b00f6530 0x7fa2b0106e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2add9b700 1 -- 172.21.15.8:0/1051380166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a0005040 con 0x7fa2b00f77d0 2023-10-18T20:59:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.725+0000 7fa2add9b700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b00f77d0 0x7fa2b0107320 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa2a40026d0 tx=0x7fa2a4009df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.726+0000 7fa29effd700 1 -- 172.21.15.8:0/1051380166 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2a4009320 con 0x7fa2b00f77d0 2023-10-18T20:59:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.726+0000 7fa29effd700 1 -- 172.21.15.8:0/1051380166 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa2a400f040 con 0x7fa2b00f77d0 2023-10-18T20:59:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.726+0000 7fa2af59e700 1 -- 172.21.15.8:0/1051380166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b01083b0 con 0x7fa2b00f77d0 2023-10-18T20:59:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.726+0000 7fa29effd700 1 -- 172.21.15.8:0/1051380166 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2a40138b0 con 0x7fa2b00f77d0 2023-10-18T20:59:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.726+0000 7fa2af59e700 1 -- 172.21.15.8:0/1051380166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b0108970 con 0x7fa2b00f77d0 2023-10-18T20:59:14.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.727+0000 7fa2af59e700 1 -- 172.21.15.8:0/1051380166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b0059100 con 0x7fa2b00f77d0 2023-10-18T20:59:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.728+0000 7fa29effd700 1 -- 172.21.15.8:0/1051380166 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7fa2a4009480 con 0x7fa2b00f77d0 2023-10-18T20:59:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.728+0000 7fa29effd700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa298061000 0x7fa2980634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.729+0000 7fa29effd700 1 -- 172.21.15.8:0/1051380166 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa2a407c190 con 0x7fa2b00f77d0 2023-10-18T20:59:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.729+0000 7fa2ae59c700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa298061000 0x7fa2980634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.729+0000 7fa2ae59c700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa298061000 0x7fa2980634c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa2b0106ba0 tx=0x7fa2a0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:14.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:14.734+0000 7fa29effd700 1 -- 172.21.15.8:0/1051380166 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa2a404c540 con 0x7fa2b00f77d0 2023-10-18T20:59:15.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.058+0000 7fa2af59e700 1 -- 172.21.15.8:0/1051380166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa2b00fedb0 con 0x7fa2b00f77d0 2023-10-18T20:59:15.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.059+0000 7fa29effd700 1 -- 172.21.15.8:0/1051380166 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fa2a404fb60 con 0x7fa2b00f77d0 2023-10-18T20:59:15.061 INFO:teuthology.orchestra.run.smithi008.stdout:e16 2023-10-18T20:59:15.061 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:59:15.061 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:59:15.062 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T20:59:15.062 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:59:15.062 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T20:59:15.062 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T20:59:15.063 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 16 2023-10-18T20:59:15.063 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T20:59:15.063 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:59:15.063 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:57:40.516856+0000 2023-10-18T20:59:15.064 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T20:59:15.064 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T20:59:15.064 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T20:59:15.064 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T20:59:15.065 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T20:59:15.065 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T20:59:15.065 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T20:59:15.065 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T20:59:15.066 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:59:15.066 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T20:59:15.066 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T20:59:15.066 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T20:59:15.066 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T20:59:15.067 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T20:59:15.067 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T20:59:15.067 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T20:59:15.067 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T20:59:15.068 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T20:59:15.068 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T20:59:15.068 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T20:59:15.068 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:15.068 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:15.069 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:15.069 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:15.069 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:59:15.069 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:59:15.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 -- 172.21.15.8:0/1051380166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa298061000 msgr2=0x7fa2980634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:15.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa298061000 0x7fa2980634c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa2b0106ba0 tx=0x7fa2a0009b30).stop 2023-10-18T20:59:15.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 -- 172.21.15.8:0/1051380166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b00f77d0 msgr2=0x7fa2b0107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:15.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b00f77d0 0x7fa2b0107320 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa2a40026d0 tx=0x7fa2a4009df0).stop 2023-10-18T20:59:15.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 -- 172.21.15.8:0/1051380166 shutdown_connections 2023-10-18T20:59:15.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa298061000 0x7fa2980634c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:15.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2b00f6530 0x7fa2b0106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:15.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 --2- 172.21.15.8:0/1051380166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2b00f77d0 0x7fa2b0107320 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:15.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 -- 172.21.15.8:0/1051380166 >> 172.21.15.8:0/1051380166 conn(0x7fa2b00f1c90 msgr2=0x7fa2b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:15.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 -- 172.21.15.8:0/1051380166 shutdown_connections 2023-10-18T20:59:15.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.061+0000 7fa2af59e700 1 -- 172.21.15.8:0/1051380166 wait complete. 2023-10-18T20:59:15.073 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 16 2023-10-18T20:59:15.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.197+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3680586097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140f6530 msgr2=0x7fbd140f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:15.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.197+0000 7fbd1a7d5700 1 --2- 172.21.15.8:0/3680586097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140f6530 0x7fbd140f6950 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbd10004660 tx=0x7fbd10009b30).stop 2023-10-18T20:59:15.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.197+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3680586097 shutdown_connections 2023-10-18T20:59:15.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.197+0000 7fbd1a7d5700 1 --2- 172.21.15.8:0/3680586097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd140f77d0 0x7fbd140f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T20:59:15.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.197+0000 7fbd1a7d5700 1 --2- 172.21.15.8:0/3680586097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140f6530 0x7fbd140f6950 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:15.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.197+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3680586097 >> 172.21.15.8:0/3680586097 conn(0x7fbd140f1c90 msgr2=0x7fbd140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.197+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3680586097 shutdown_connections 2023-10-18T20:59:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.197+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3680586097 wait complete. 2023-10-18T20:59:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.198+0000 7fbd1a7d5700 1 Processor -- start 2023-10-18T20:59:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.198+0000 7fbd1a7d5700 1 -- start start 2023-10-18T20:59:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd1a7d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140f6530 0x7fbd1406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd1a7d5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd140f77d0 0x7fbd14069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd1a7d5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1406a410 con 0x7fbd140f6530 2023-10-18T20:59:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd1a7d5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1406a550 con 0x7fbd140f77d0 2023-10-18T20:59:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd197d3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140f6530 0x7fbd1406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd197d3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140f6530 0x7fbd1406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47628/0 (socket says 172.21.15.8:47628) 2023-10-18T20:59:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd197d3700 1 -- 172.21.15.8:0/3056790184 learned_addr learned my addr 172.21.15.8:0/3056790184 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd18fd2700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd140f77d0 0x7fbd14069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd18fd2700 1 -- 172.21.15.8:0/3056790184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd140f77d0 msgr2=0x7fbd14069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-10-18T20:59:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd18fd2700 1 -- 172.21.15.8:0/3056790184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd140f77d0 msgr2=0x7fbd14069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-18T20:59:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd18fd2700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd140f77d0 0x7fbd14069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T20:59:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd197d3700 1 -- 172.21.15.8:0/3056790184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd140f77d0 msgr2=0x7fbd14069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd18fd2700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd140f77d0 0x7fbd14069e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T20:59:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.199+0000 7fbd197d3700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd140f77d0 0x7fbd14069e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.200+0000 7fbd197d3700 1 -- 172.21.15.8:0/3056790184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10005040 con 0x7fbd140f6530 2023-10-18T20:59:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.200+0000 7fbd197d3700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140f6530 0x7fbd1406b9a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbd10009f50 tx=0x7fbd10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.200+0000 7fbd09ffb700 1 -- 172.21.15.8:0/3056790184 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd10018070 con 0x7fbd140f6530 2023-10-18T20:59:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.200+0000 7fbd09ffb700 1 -- 172.21.15.8:0/3056790184 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbd1001d8e0 con 0x7fbd140f6530 2023-10-18T20:59:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.200+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3056790184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1406a7d0 con 0x7fbd140f6530 2023-10-18T20:59:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.200+0000 7fbd09ffb700 1 -- 172.21.15.8:0/3056790184 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd1001c4c0 con 0x7fbd140f6530 2023-10-18T20:59:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.200+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3056790184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1410ee00 con 0x7fbd140f6530 2023-10-18T20:59:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.201+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3056790184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd14045ad0 con 0x7fbd140f6530 2023-10-18T20:59:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.202+0000 7fbd09ffb700 1 -- 172.21.15.8:0/3056790184 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7fbd1001d420 con 0x7fbd140f6530 2023-10-18T20:59:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.203+0000 7fbd09ffb700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd00061000 0x7fbd000634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.203+0000 7fbd09ffb700 1 -- 172.21.15.8:0/3056790184 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fbd1007e180 con 0x7fbd140f6530 2023-10-18T20:59:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.203+0000 7fbd18fd2700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd00061000 0x7fbd000634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.204+0000 7fbd18fd2700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd00061000 0x7fbd000634c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fbd04006c40 tx=0x7fbd04008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.207+0000 7fbd09ffb700 1 -- 172.21.15.8:0/3056790184 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbd1004e4b0 con 0x7fbd140f6530 2023-10-18T20:59:15.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.410+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3056790184 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd140008d0 con 0x7fbd00061000 2023-10-18T20:59:15.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.411+0000 7fbd09ffb700 1 -- 172.21.15.8:0/3056790184 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fbd140008d0 con 0x7fbd00061000 2023-10-18T20:59:15.413 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:59:15.413 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T20:59:15.413 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T20:59:15.413 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T20:59:15.414 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T20:59:15.414 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T20:59:15.414 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T20:59:15.414 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "3/21 daemons upgraded", 2023-10-18T20:59:15.415 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mon daemons", 2023-10-18T20:59:15.415 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T20:59:15.415 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:59:15.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3056790184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd00061000 msgr2=0x7fbd000634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:15.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd00061000 0x7fbd000634c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fbd04006c40 tx=0x7fbd04008040).stop 2023-10-18T20:59:15.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3056790184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140f6530 msgr2=0x7fbd1406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:15.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140f6530 0x7fbd1406b9a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbd10009f50 tx=0x7fbd10009b30).stop 2023-10-18T20:59:15.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3056790184 shutdown_connections 2023-10-18T20:59:15.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd00061000 0x7fbd000634c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:15.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140f6530 0x7fbd1406b9a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:15.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 --2- 172.21.15.8:0/3056790184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd140f77d0 0x7fbd14069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:15.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3056790184 >> 172.21.15.8:0/3056790184 conn(0x7fbd140f1c90 msgr2=0x7fbd140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:15.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3056790184 shutdown_connections 2023-10-18T20:59:15.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:15.413+0000 7fbd1a7d5700 1 -- 172.21.15.8:0/3056790184 wait complete. 2023-10-18T20:59:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:13.666653+0000 mgr.smithi008.flmjzp (mgr.14640) 39 : audit [DBG] from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:14.127653+0000 mgr.smithi008.flmjzp (mgr.14640) 40 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 806 KiB/s rd, 877 KiB/s wr, 119 op/s 2023-10-18T20:59:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:14.146507+0000 mgr.smithi008.flmjzp (mgr.14640) 41 : audit [DBG] from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:14.584808+0000 mon.smithi008 (mon.0) 26 : audit [DBG] from='client.? 172.21.15.8:0/3297053211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:15.059412+0000 mon.smithi008 (mon.0) 27 : audit [DBG] from='client.? 172.21.15.8:0/1051380166' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:59:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:13.666653+0000 mgr.smithi008.flmjzp (mgr.14640) 39 : audit [DBG] from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:14.127653+0000 mgr.smithi008.flmjzp (mgr.14640) 40 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 806 KiB/s rd, 877 KiB/s wr, 119 op/s 2023-10-18T20:59:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:14.146507+0000 mgr.smithi008.flmjzp (mgr.14640) 41 : audit [DBG] from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:14.584808+0000 mon.smithi008 (mon.0) 26 : audit [DBG] from='client.? 172.21.15.8:0/3297053211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:15.059412+0000 mon.smithi008 (mon.0) 27 : audit [DBG] from='client.? 172.21.15.8:0/1051380166' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:59:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:15.411250+0000 mgr.smithi008.flmjzp (mgr.14640) 42 : audit [DBG] from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:15.411250+0000 mgr.smithi008.flmjzp (mgr.14640) 42 : audit [DBG] from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:16.127938+0000 mgr.smithi008.flmjzp (mgr.14640) 43 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 806 KiB/s rd, 877 KiB/s wr, 119 op/s 2023-10-18T20:59:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:16.127938+0000 mgr.smithi008.flmjzp (mgr.14640) 43 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 806 KiB/s rd, 877 KiB/s wr, 119 op/s 2023-10-18T20:59:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:18.128335+0000 mgr.smithi008.flmjzp (mgr.14640) 44 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 1.1 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 178 op/s 2023-10-18T20:59:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:18.128335+0000 mgr.smithi008.flmjzp (mgr.14640) 44 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 1.1 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 178 op/s 2023-10-18T20:59:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:20.128636+0000 mgr.smithi008.flmjzp (mgr.14640) 45 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 1.1 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-10-18T20:59:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:20.128636+0000 mgr.smithi008.flmjzp (mgr.14640) 45 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 1.1 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-10-18T20:59:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:22.129155+0000 mgr.smithi008.flmjzp (mgr.14640) 46 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 745 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 190 op/s 2023-10-18T20:59:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:22.224584+0000 mon.smithi008 (mon.0) 28 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:59:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.767697+0000 mon.smithi008 (mon.0) 29 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.768569+0000 mon.smithi008 (mon.0) 30 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:23.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.769341+0000 mon.smithi008 (mon.0) 31 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:59:23.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.773125+0000 mon.smithi008 (mon.0) 32 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:23.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.780701+0000 mon.smithi008 (mon.0) 33 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:23.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.784275+0000 mon.smithi008 (mon.0) 34 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:23.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.786868+0000 mon.smithi008 (mon.0) 35 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:23.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.795242+0000 mon.smithi008 (mon.0) 36 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:23.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.798681+0000 mon.smithi008 (mon.0) 37 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi008"}]: dispatch 2023-10-18T20:59:23.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.804768+0000 mon.smithi008 (mon.0) 38 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi008"}]': finished 2023-10-18T20:59:23.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.806332+0000 mon.smithi008 (mon.0) 39 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"}]: dispatch 2023-10-18T20:59:23.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:22.817066+0000 mon.smithi008 (mon.0) 40 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"}]': finished 2023-10-18T20:59:23.514 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:22.129155+0000 mgr.smithi008.flmjzp (mgr.14640) 46 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 745 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 190 op/s 2023-10-18T20:59:23.514 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:22.224584+0000 mon.smithi008 (mon.0) 28 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T20:59:23.514 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.767697+0000 mon.smithi008 (mon.0) 29 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:23.515 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.768569+0000 mon.smithi008 (mon.0) 30 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:23.515 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.769341+0000 mon.smithi008 (mon.0) 31 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:59:23.515 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.773125+0000 mon.smithi008 (mon.0) 32 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:23.515 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.780701+0000 mon.smithi008 (mon.0) 33 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:23.515 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.784275+0000 mon.smithi008 (mon.0) 34 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:23.515 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.786868+0000 mon.smithi008 (mon.0) 35 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:23.516 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.795242+0000 mon.smithi008 (mon.0) 36 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:23.516 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.798681+0000 mon.smithi008 (mon.0) 37 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi008"}]: dispatch 2023-10-18T20:59:23.516 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.804768+0000 mon.smithi008 (mon.0) 38 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi008"}]': finished 2023-10-18T20:59:23.516 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.806332+0000 mon.smithi008 (mon.0) 39 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"}]: dispatch 2023-10-18T20:59:23.516 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:22.817066+0000 mon.smithi008 (mon.0) 40 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"}]': finished 2023-10-18T20:59:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:22.770012+0000 mgr.smithi008.flmjzp (mgr.14640) 47 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:59:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:22.788374+0000 mgr.smithi008.flmjzp (mgr.14640) 48 : cephadm [INF] Upgrade: Setting container_image for all mon 2023-10-18T20:59:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:22.770012+0000 mgr.smithi008.flmjzp (mgr.14640) 47 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:59:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:22.788374+0000 mgr.smithi008.flmjzp (mgr.14640) 48 : cephadm [INF] Upgrade: Setting container_image for all mon 2023-10-18T20:59:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:24.129535+0000 mgr.smithi008.flmjzp (mgr.14640) 49 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 745 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-10-18T20:59:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:24.316975+0000 mgr.smithi008.flmjzp (mgr.14640) 50 : cephadm [INF] Upgrade: Updating crash.smithi008 (1/2) 2023-10-18T20:59:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:24.321505+0000 mon.smithi008 (mon.0) 41 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:25.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:24.322520+0000 mon.smithi008 (mon.0) 42 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi008", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-10-18T20:59:25.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:24.323308+0000 mon.smithi008 (mon.0) 43 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:25.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:24.323971+0000 mgr.smithi008.flmjzp (mgr.14640) 51 : cephadm [INF] Deploying daemon crash.smithi008 on smithi008 2023-10-18T20:59:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:24.129535+0000 mgr.smithi008.flmjzp (mgr.14640) 49 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 745 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-10-18T20:59:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:24.316975+0000 mgr.smithi008.flmjzp (mgr.14640) 50 : cephadm [INF] Upgrade: Updating crash.smithi008 (1/2) 2023-10-18T20:59:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:24.321505+0000 mon.smithi008 (mon.0) 41 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:24.322520+0000 mon.smithi008 (mon.0) 42 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi008", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-10-18T20:59:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:24.323308+0000 mon.smithi008 (mon.0) 43 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:24.323971+0000 mgr.smithi008.flmjzp (mgr.14640) 51 : cephadm [INF] Deploying daemon crash.smithi008 on smithi008 2023-10-18T20:59:27.605 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:26.129865+0000 mgr.smithi008.flmjzp (mgr.14640) 52 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 745 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-10-18T20:59:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:26.129865+0000 mgr.smithi008.flmjzp (mgr.14640) 52 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 745 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-10-18T20:59:27.891 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-18T20:59:27.892 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-18T20:59:28.880 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:27.680475+0000 mon.smithi008 (mon.0) 44 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:28.880 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:28.130318+0000 mgr.smithi008.flmjzp (mgr.14640) 53 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 556 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2023-10-18T20:59:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:27.680475+0000 mon.smithi008 (mon.0) 44 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:28.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:28.130318+0000 mgr.smithi008.flmjzp (mgr.14640) 53 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 556 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2023-10-18T20:59:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:28.900236+0000 mgr.smithi008.flmjzp (mgr.14640) 54 : cephadm [INF] Upgrade: Updating crash.smithi060 (2/2) 2023-10-18T20:59:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:28.905411+0000 mon.smithi008 (mon.0) 45 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:28.906502+0000 mon.smithi008 (mon.0) 46 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-10-18T20:59:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:28.907468+0000 mon.smithi008 (mon.0) 47 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:28.908159+0000 mgr.smithi008.flmjzp (mgr.14640) 55 : cephadm [INF] Deploying daemon crash.smithi060 on smithi060 2023-10-18T20:59:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:28.900236+0000 mgr.smithi008.flmjzp (mgr.14640) 54 : cephadm [INF] Upgrade: Updating crash.smithi060 (2/2) 2023-10-18T20:59:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:28.905411+0000 mon.smithi008 (mon.0) 45 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:30.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:28.906502+0000 mon.smithi008 (mon.0) 46 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-10-18T20:59:30.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:28.907468+0000 mon.smithi008 (mon.0) 47 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:30.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:28.908159+0000 mgr.smithi008.flmjzp (mgr.14640) 55 : cephadm [INF] Deploying daemon crash.smithi060 on smithi060 2023-10-18T20:59:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:30.130649+0000 mgr.smithi008.flmjzp (mgr.14640) 56 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 556 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 112 op/s 2023-10-18T20:59:31.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:30.130649+0000 mgr.smithi008.flmjzp (mgr.14640) 56 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 556 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 112 op/s 2023-10-18T20:59:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:32.131151+0000 mgr.smithi008.flmjzp (mgr.14640) 57 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 182 op/s 2023-10-18T20:59:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:32.133996+0000 mon.smithi008 (mon.0) 48 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:32.134959+0000 mon.smithi008 (mon.0) 49 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:32.131151+0000 mgr.smithi008.flmjzp (mgr.14640) 57 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 182 op/s 2023-10-18T20:59:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:32.133996+0000 mon.smithi008 (mon.0) 48 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:32.134959+0000 mon.smithi008 (mon.0) 49 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:34.131501+0000 mgr.smithi008.flmjzp (mgr.14640) 58 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 111 op/s 2023-10-18T20:59:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:34.131501+0000 mgr.smithi008.flmjzp (mgr.14640) 58 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 111 op/s 2023-10-18T20:59:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:35.855163+0000 mon.smithi008 (mon.0) 50 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:36.131843+0000 mgr.smithi008.flmjzp (mgr.14640) 59 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 111 op/s 2023-10-18T20:59:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:35.855163+0000 mon.smithi008 (mon.0) 50 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:36.131843+0000 mgr.smithi008.flmjzp (mgr.14640) 59 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 111 op/s 2023-10-18T20:59:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.947873+0000 mon.smithi008 (mon.0) 51 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:39.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.948787+0000 mon.smithi008 (mon.0) 52 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:39.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.949529+0000 mon.smithi008 (mon.0) 53 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:59:39.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:37.950146+0000 mgr.smithi008.flmjzp (mgr.14640) 60 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:59:39.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.953536+0000 mon.smithi008 (mon.0) 54 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:39.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.958807+0000 mon.smithi008 (mon.0) 55 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:39.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.961209+0000 mon.smithi008 (mon.0) 56 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:39.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.962389+0000 mon.smithi008 (mon.0) 57 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:39.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.963654+0000 mon.smithi008 (mon.0) 58 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:39.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:37.964222+0000 mgr.smithi008.flmjzp (mgr.14640) 61 : cephadm [INF] Upgrade: Setting container_image for all crash 2023-10-18T20:59:39.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.968000+0000 mon.smithi008 (mon.0) 59 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:39.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.968770+0000 mon.smithi008 (mon.0) 60 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi008"}]: dispatch 2023-10-18T20:59:39.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.971672+0000 mon.smithi008 (mon.0) 61 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi008"}]': finished 2023-10-18T20:59:39.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.972335+0000 mon.smithi008 (mon.0) 62 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"}]: dispatch 2023-10-18T20:59:39.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.975154+0000 mon.smithi008 (mon.0) 63 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"}]': finished 2023-10-18T20:59:39.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.976304+0000 mon.smithi008 (mon.0) 64 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-10-18T20:59:39.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:37.976463+0000 mgr.smithi008.flmjzp (mgr.14640) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-10-18T20:59:39.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:37.977251+0000 mgr.smithi008.flmjzp (mgr.14640) 63 : cephadm [INF] Upgrade: osd.0 is safe to restart 2023-10-18T20:59:39.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:38.132335+0000 mgr.smithi008.flmjzp (mgr.14640) 64 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 340 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 195 op/s 2023-10-18T20:59:39.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.947873+0000 mon.smithi008 (mon.0) 51 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:39.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.948787+0000 mon.smithi008 (mon.0) 52 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:39.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.949529+0000 mon.smithi008 (mon.0) 53 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:59:39.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:37.950146+0000 mgr.smithi008.flmjzp (mgr.14640) 60 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:59:39.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.953536+0000 mon.smithi008 (mon.0) 54 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:39.425 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.958807+0000 mon.smithi008 (mon.0) 55 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:39.425 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.961209+0000 mon.smithi008 (mon.0) 56 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:39.425 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.962389+0000 mon.smithi008 (mon.0) 57 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:39.426 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.963654+0000 mon.smithi008 (mon.0) 58 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:39.426 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:37.964222+0000 mgr.smithi008.flmjzp (mgr.14640) 61 : cephadm [INF] Upgrade: Setting container_image for all crash 2023-10-18T20:59:39.427 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.968000+0000 mon.smithi008 (mon.0) 59 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:39.427 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.968770+0000 mon.smithi008 (mon.0) 60 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi008"}]: dispatch 2023-10-18T20:59:39.427 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.971672+0000 mon.smithi008 (mon.0) 61 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi008"}]': finished 2023-10-18T20:59:39.428 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.972335+0000 mon.smithi008 (mon.0) 62 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"}]: dispatch 2023-10-18T20:59:39.428 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.975154+0000 mon.smithi008 (mon.0) 63 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"}]': finished 2023-10-18T20:59:39.428 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.976304+0000 mon.smithi008 (mon.0) 64 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-10-18T20:59:39.429 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:37.976463+0000 mgr.smithi008.flmjzp (mgr.14640) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-10-18T20:59:39.429 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:37.977251+0000 mgr.smithi008.flmjzp (mgr.14640) 63 : cephadm [INF] Upgrade: osd.0 is safe to restart 2023-10-18T20:59:39.429 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:38.132335+0000 mgr.smithi008.flmjzp (mgr.14640) 64 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 340 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 195 op/s 2023-10-18T20:59:40.407 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:39.158131+0000 mgr.smithi008.flmjzp (mgr.14640) 65 : cephadm [INF] Upgrade: Updating osd.0 2023-10-18T20:59:40.408 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:39.163567+0000 mon.smithi008 (mon.0) 65 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:40.408 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:39.164341+0000 mon.smithi008 (mon.0) 66 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-18T20:59:40.408 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:39.165005+0000 mon.smithi008 (mon.0) 67 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:40.408 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:39.166153+0000 mgr.smithi008.flmjzp (mgr.14640) 66 : cephadm [INF] Deploying daemon osd.0 on smithi008 2023-10-18T20:59:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:39.158131+0000 mgr.smithi008.flmjzp (mgr.14640) 65 : cephadm [INF] Upgrade: Updating osd.0 2023-10-18T20:59:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:39.163567+0000 mon.smithi008 (mon.0) 65 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:39.164341+0000 mon.smithi008 (mon.0) 66 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-18T20:59:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:39.165005+0000 mon.smithi008 (mon.0) 67 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:39.166153+0000 mgr.smithi008.flmjzp (mgr.14640) 66 : cephadm [INF] Deploying daemon osd.0 on smithi008 2023-10-18T20:59:41.274 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:40.132650+0000 mgr.smithi008.flmjzp (mgr.14640) 67 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 340 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 153 op/s 2023-10-18T20:59:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:40.132650+0000 mgr.smithi008.flmjzp (mgr.14640) 67 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 340 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 153 op/s 2023-10-18T20:59:42.140 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:41 smithi008 systemd[1]: Stopping Ceph osd.0 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T20:59:42.140 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.0[117858]: debug 2023-10-18T20:59:41.860+0000 7fe2332b9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-10-18T20:59:42.141 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.0[117858]: debug 2023-10-18T20:59:41.860+0000 7fe2332b9700 -1 osd.0 45 *** Got signal Terminated *** 2023-10-18T20:59:42.141 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.0[117858]: debug 2023-10-18T20:59:41.860+0000 7fe2332b9700 -1 osd.0 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T20:59:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:42.006996+0000 mon.smithi008 (mon.0) 68 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-10-18T20:59:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:42.007024+0000 mon.smithi008 (mon.0) 69 : cluster [INF] osd.0 failed (root=default,host=smithi008) (connection refused reported by osd.3) 2023-10-18T20:59:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:42.163211+0000 mon.smithi008 (mon.0) 70 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-10-18T20:59:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:42.163308+0000 mon.smithi008 (mon.0) 71 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-10-18T20:59:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:42.163375+0000 mon.smithi008 (mon.0) 72 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-10-18T20:59:42.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:42.163520+0000 mon.smithi008 (mon.0) 73 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-10-18T20:59:42.420 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:42 smithi008 bash[149608]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.0 2023-10-18T20:59:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:42.006996+0000 mon.smithi008 (mon.0) 68 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-10-18T20:59:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:42.007024+0000 mon.smithi008 (mon.0) 69 : cluster [INF] osd.0 failed (root=default,host=smithi008) (connection refused reported by osd.3) 2023-10-18T20:59:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:42.163211+0000 mon.smithi008 (mon.0) 70 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-10-18T20:59:42.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:42.163308+0000 mon.smithi008 (mon.0) 71 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-10-18T20:59:42.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:42.163375+0000 mon.smithi008 (mon.0) 72 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-10-18T20:59:42.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:42.163520+0000 mon.smithi008 (mon.0) 73 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-10-18T20:59:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:42.133055+0000 mgr.smithi008.flmjzp (mgr.14640) 68 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 344 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 238 op/s 2023-10-18T20:59:43.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:42.166668+0000 mon.smithi008 (mon.0) 74 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T20:59:43.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:42.174714+0000 mon.smithi008 (mon.0) 75 : cluster [DBG] osdmap e46: 6 total, 5 up, 6 in 2023-10-18T20:59:43.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:42.175262+0000 mon.smithi008 (mon.0) 76 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-10-18T20:59:43.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:42.180055+0000 mon.smithi008 (mon.0) 77 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-10-18T20:59:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:42.133055+0000 mgr.smithi008.flmjzp (mgr.14640) 68 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 344 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 238 op/s 2023-10-18T20:59:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:42.166668+0000 mon.smithi008 (mon.0) 74 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T20:59:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:42.174714+0000 mon.smithi008 (mon.0) 75 : cluster [DBG] osdmap e46: 6 total, 5 up, 6 in 2023-10-18T20:59:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:42.175262+0000 mon.smithi008 (mon.0) 76 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-10-18T20:59:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:42.180055+0000 mon.smithi008 (mon.0) 77 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-10-18T20:59:44.171 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:43 smithi008 systemd[1]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.0.service: Succeeded. 2023-10-18T20:59:44.171 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:43 smithi008 systemd[1]: Stopped Ceph osd.0 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T20:59:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:43.174321+0000 mon.smithi008 (mon.0) 78 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-10-18T20:59:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:43.174480+0000 mon.smithi008 (mon.0) 79 : cluster [DBG] osdmap e47: 6 total, 5 up, 6 in 2023-10-18T20:59:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:43.174321+0000 mon.smithi008 (mon.0) 78 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-10-18T20:59:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:43.174480+0000 mon.smithi008 (mon.0) 79 : cluster [DBG] osdmap e47: 6 total, 5 up, 6 in 2023-10-18T20:59:44.672 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:44 smithi008 systemd[1]: Starting Ceph osd.0 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T20:59:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:44.133383+0000 mgr.smithi008.flmjzp (mgr.14640) 69 : cluster [DBG] pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 344 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 253 op/s 2023-10-18T20:59:45.537 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:44.133383+0000 mgr.smithi008.flmjzp (mgr.14640) 69 : cluster [DBG] pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 344 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 253 op/s 2023-10-18T20:59:45.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.601+0000 7efecda0c700 1 -- 172.21.15.8:0/3080898392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efec80f66e0 msgr2=0x7efec80f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:45.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.601+0000 7efecda0c700 1 --2- 172.21.15.8:0/3080898392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efec80f66e0 0x7efec80f6b40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7efeb4004660 tx=0x7efeb4009b30).stop 2023-10-18T20:59:45.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.601+0000 7efecda0c700 1 -- 172.21.15.8:0/3080898392 shutdown_connections 2023-10-18T20:59:45.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.601+0000 7efecda0c700 1 --2- 172.21.15.8:0/3080898392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efec80f66e0 0x7efec80f6b40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:45.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.601+0000 7efecda0c700 1 --2- 172.21.15.8:0/3080898392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec80f5440 0x7efec80f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:45.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.601+0000 7efecda0c700 1 -- 172.21.15.8:0/3080898392 >> 172.21.15.8:0/3080898392 conn(0x7efec80f0ba0 msgr2=0x7efec80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.601+0000 7efecda0c700 1 -- 172.21.15.8:0/3080898392 shutdown_connections 2023-10-18T20:59:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.601+0000 7efecda0c700 1 -- 172.21.15.8:0/3080898392 wait complete. 2023-10-18T20:59:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.603+0000 7efecda0c700 1 Processor -- start 2023-10-18T20:59:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.603+0000 7efecda0c700 1 -- start start 2023-10-18T20:59:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.603+0000 7efecda0c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec80f5440 0x7efec8104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.603+0000 7efecda0c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efec80f66e0 0x7efec8104f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.603+0000 7efecda0c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec8105560 con 0x7efec80f66e0 2023-10-18T20:59:45.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.603+0000 7efecda0c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec81056a0 con 0x7efec80f5440 2023-10-18T20:59:45.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.604+0000 7efecca0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec80f5440 0x7efec8104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:45.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.604+0000 7efecca0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec80f5440 0x7efec8104a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:54118/0 (socket says 172.21.15.8:54118) 2023-10-18T20:59:45.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.604+0000 7efecca0a700 1 -- 172.21.15.8:0/3283843079 learned_addr learned my addr 172.21.15.8:0/3283843079 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:45.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.604+0000 7efec7fff700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efec80f66e0 0x7efec8104f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:45.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.604+0000 7efecca0a700 1 -- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efec80f66e0 msgr2=0x7efec8104f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:45.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.604+0000 7efecca0a700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efec80f66e0 0x7efec8104f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:45.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.604+0000 7efecca0a700 1 -- 172.21.15.8:0/3283843079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb4005040 con 0x7efec80f5440 2023-10-18T20:59:45.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.604+0000 7efec7fff700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efec80f66e0 0x7efec8104f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T20:59:45.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.604+0000 7efecca0a700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec80f5440 0x7efec8104a70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7efebc00e7c0 tx=0x7efebc00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:45.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.605+0000 7efec57fa700 1 -- 172.21.15.8:0/3283843079 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efebc0092e0 con 0x7efec80f5440 2023-10-18T20:59:45.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.605+0000 7efecda0c700 1 -- 172.21.15.8:0/3283843079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec8106010 con 0x7efec80f5440 2023-10-18T20:59:45.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.605+0000 7efec57fa700 1 -- 172.21.15.8:0/3283843079 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efebc00f040 con 0x7efec80f5440 2023-10-18T20:59:45.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.605+0000 7efec57fa700 1 -- 172.21.15.8:0/3283843079 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efebc0147e0 con 0x7efec80f5440 2023-10-18T20:59:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.605+0000 7efecda0c700 1 -- 172.21.15.8:0/3283843079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec8106550 con 0x7efec80f5440 2023-10-18T20:59:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.606+0000 7efecda0c700 1 -- 172.21.15.8:0/3283843079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec8045ad0 con 0x7efec80f5440 2023-10-18T20:59:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.607+0000 7efec57fa700 1 -- 172.21.15.8:0/3283843079 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7efebc01b030 con 0x7efec80f5440 2023-10-18T20:59:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.608+0000 7efec57fa700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efeb8061000 0x7efeb80634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.608+0000 7efec57fa700 1 -- 172.21.15.8:0/3283843079 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7efebc07c250 con 0x7efec80f5440 2023-10-18T20:59:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.608+0000 7efec7fff700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efeb8061000 0x7efeb80634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.609+0000 7efec7fff700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efeb8061000 0x7efeb80634c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7efeb4009880 tx=0x7efeb400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.613+0000 7efec57fa700 1 -- 172.21.15.8:0/3283843079 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efebc04c520 con 0x7efec80f5440 2023-10-18T20:59:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.836+0000 7efecda0c700 1 -- 172.21.15.8:0/3283843079 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efec810b100 con 0x7efeb8061000 2023-10-18T20:59:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.837+0000 7efec57fa700 1 -- 172.21.15.8:0/3283843079 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efec810b100 con 0x7efeb8061000 2023-10-18T20:59:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.839+0000 7efecda0c700 1 -- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efeb8061000 msgr2=0x7efeb80634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.839+0000 7efecda0c700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efeb8061000 0x7efeb80634c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7efeb4009880 tx=0x7efeb400b040).stop 2023-10-18T20:59:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.839+0000 7efecda0c700 1 -- 172.21.15.8:0/3283843079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec80f5440 msgr2=0x7efec8104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.839+0000 7efecda0c700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec80f5440 0x7efec8104a70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7efebc00e7c0 tx=0x7efebc00b040).stop 2023-10-18T20:59:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.840+0000 7efecda0c700 1 -- 172.21.15.8:0/3283843079 shutdown_connections 2023-10-18T20:59:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.840+0000 7efecda0c700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efeb8061000 0x7efeb80634c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.840+0000 7efecda0c700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec80f5440 0x7efec8104a70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.840+0000 7efecda0c700 1 --2- 172.21.15.8:0/3283843079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efec80f66e0 0x7efec8104f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.840+0000 7efecda0c700 1 -- 172.21.15.8:0/3283843079 >> 172.21.15.8:0/3283843079 conn(0x7efec80f0ba0 msgr2=0x7efec80fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.840+0000 7efecda0c700 1 -- 172.21.15.8:0/3283843079 shutdown_connections 2023-10-18T20:59:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.840+0000 7efecda0c700 1 -- 172.21.15.8:0/3283843079 wait complete. 2023-10-18T20:59:45.857 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T20:59:45.920 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:45 smithi008 bash[149902]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-18T20:59:45.921 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:45 smithi008 bash[149902]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-10-18T20:59:45.921 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:45 smithi008 bash[149902]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-10-18T20:59:45.921 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:45 smithi008 bash[149902]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-10-18T20:59:45.921 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:45 smithi008 bash[149902]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-10-18T20:59:45.922 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:45 smithi008 bash[149902]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-18T20:59:45.922 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:45 smithi008 bash[149902]: --> ceph-volume raw activate successful for osd ID: 0 2023-10-18T20:59:45.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.993+0000 7f51c2c46700 1 -- 172.21.15.8:0/3884568707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc0f77d0 msgr2=0x7f51bc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:45.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.993+0000 7f51c2c46700 1 --2- 172.21.15.8:0/3884568707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc0f77d0 0x7f51bc0f7c30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f51ac004660 tx=0x7f51ac009b30).stop 2023-10-18T20:59:45.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.993+0000 7f51c2c46700 1 -- 172.21.15.8:0/3884568707 shutdown_connections 2023-10-18T20:59:45.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.993+0000 7f51c2c46700 1 --2- 172.21.15.8:0/3884568707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc0f77d0 0x7f51bc0f7c30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:45.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.993+0000 7f51c2c46700 1 --2- 172.21.15.8:0/3884568707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51bc0f6530 0x7f51bc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:45.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.993+0000 7f51c2c46700 1 -- 172.21.15.8:0/3884568707 >> 172.21.15.8:0/3884568707 conn(0x7f51bc0f1c90 msgr2=0x7f51bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:45.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.993+0000 7f51c2c46700 1 -- 172.21.15.8:0/3884568707 shutdown_connections 2023-10-18T20:59:45.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.993+0000 7f51c2c46700 1 -- 172.21.15.8:0/3884568707 wait complete. 2023-10-18T20:59:45.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.994+0000 7f51c2c46700 1 Processor -- start 2023-10-18T20:59:45.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.995+0000 7f51c2c46700 1 -- start start 2023-10-18T20:59:46.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.995+0000 7f51c2c46700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc0f6530 0x7f51bc106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:46.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.995+0000 7f51c2c46700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51bc0f77d0 0x7f51bc107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:46.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.995+0000 7f51c2c46700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc107840 con 0x7f51bc0f77d0 2023-10-18T20:59:46.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.995+0000 7f51c2c46700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc108050 con 0x7f51bc0f6530 2023-10-18T20:59:46.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.995+0000 7f51c1443700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51bc0f77d0 0x7f51bc107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:46.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.996+0000 7f51c1443700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51bc0f77d0 0x7f51bc107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33574/0 (socket says 172.21.15.8:33574) 2023-10-18T20:59:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.996+0000 7f51c1443700 1 -- 172.21.15.8:0/2378120800 learned_addr learned my addr 172.21.15.8:0/2378120800 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.996+0000 7f51c1c44700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc0f6530 0x7f51bc106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.996+0000 7f51c1443700 1 -- 172.21.15.8:0/2378120800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc0f6530 msgr2=0x7f51bc106d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.996+0000 7f51c1443700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc0f6530 0x7f51bc106d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.996+0000 7f51c1443700 1 -- 172.21.15.8:0/2378120800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac005040 con 0x7f51bc0f77d0 2023-10-18T20:59:46.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.996+0000 7f51c1c44700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc0f6530 0x7f51bc106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T20:59:46.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.996+0000 7f51c1443700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51bc0f77d0 0x7f51bc107240 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f51ac004320 tx=0x7f51ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:46.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.996+0000 7f51b27fc700 1 -- 172.21.15.8:0/2378120800 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ac019070 con 0x7f51bc0f77d0 2023-10-18T20:59:46.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.996+0000 7f51b27fc700 1 -- 172.21.15.8:0/2378120800 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f51ac01e420 con 0x7f51bc0f77d0 2023-10-18T20:59:46.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.997+0000 7f51c2c46700 1 -- 172.21.15.8:0/2378120800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc108270 con 0x7f51bc0f77d0 2023-10-18T20:59:46.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.997+0000 7f51b27fc700 1 -- 172.21.15.8:0/2378120800 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ac014680 con 0x7f51bc0f77d0 2023-10-18T20:59:46.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.997+0000 7f51c2c46700 1 -- 172.21.15.8:0/2378120800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc108750 con 0x7f51bc0f77d0 2023-10-18T20:59:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.998+0000 7f519ffff700 1 -- 172.21.15.8:0/2378120800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5198004fa0 con 0x7f51bc0f77d0 2023-10-18T20:59:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.999+0000 7f51b27fc700 1 -- 172.21.15.8:0/2378120800 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7f51ac01e590 con 0x7f51bc0f77d0 2023-10-18T20:59:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:45.999+0000 7f51b27fc700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f51a8061000 0x7f51a80634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.000+0000 7f51b27fc700 1 -- 172.21.15.8:0/2378120800 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f51ac07d680 con 0x7f51bc0f77d0 2023-10-18T20:59:46.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.000+0000 7f51c1c44700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f51a8061000 0x7f51a80634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:46.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.000+0000 7f51c1c44700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f51a8061000 0x7f51a80634c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f51bc106ac0 tx=0x7f51b800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:46.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.009+0000 7f51b27fc700 1 -- 172.21.15.8:0/2378120800 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f51ac04db60 con 0x7f51bc0f77d0 2023-10-18T20:59:46.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.229+0000 7f519ffff700 1 -- 172.21.15.8:0/2378120800 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5198000bc0 con 0x7f51a8061000 2023-10-18T20:59:46.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.230+0000 7f51b27fc700 1 -- 172.21.15.8:0/2378120800 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5198000bc0 con 0x7f51a8061000 2023-10-18T20:59:46.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.233+0000 7f519ffff700 1 -- 172.21.15.8:0/2378120800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f51a8061000 msgr2=0x7f51a80634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:46.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.233+0000 7f519ffff700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f51a8061000 0x7f51a80634c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f51bc106ac0 tx=0x7f51b800b040).stop 2023-10-18T20:59:46.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.233+0000 7f519ffff700 1 -- 172.21.15.8:0/2378120800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51bc0f77d0 msgr2=0x7f51bc107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:46.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.233+0000 7f519ffff700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51bc0f77d0 0x7f51bc107240 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f51ac004320 tx=0x7f51ac00b040).stop 2023-10-18T20:59:46.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.233+0000 7f519ffff700 1 -- 172.21.15.8:0/2378120800 shutdown_connections 2023-10-18T20:59:46.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.233+0000 7f519ffff700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f51a8061000 0x7f51a80634c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.233+0000 7f519ffff700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc0f6530 0x7f51bc106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.233+0000 7f519ffff700 1 --2- 172.21.15.8:0/2378120800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51bc0f77d0 0x7f51bc107240 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.233+0000 7f519ffff700 1 -- 172.21.15.8:0/2378120800 >> 172.21.15.8:0/2378120800 conn(0x7f51bc0f1c90 msgr2=0x7f51bc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:46.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.234+0000 7f519ffff700 1 -- 172.21.15.8:0/2378120800 shutdown_connections 2023-10-18T20:59:46.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.234+0000 7f519ffff700 1 -- 172.21.15.8:0/2378120800 wait complete. 2023-10-18T20:59:46.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.389+0000 7f3ad6238700 1 -- 172.21.15.8:0/1939918869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad00f77d0 msgr2=0x7f3ad00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:46.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.389+0000 7f3ad6238700 1 --2- 172.21.15.8:0/1939918869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad00f77d0 0x7f3ad00f7c30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3ac0004660 tx=0x7f3ac0009b30).stop 2023-10-18T20:59:46.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.390+0000 7f3ad6238700 1 -- 172.21.15.8:0/1939918869 shutdown_connections 2023-10-18T20:59:46.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.390+0000 7f3ad6238700 1 --2- 172.21.15.8:0/1939918869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad00f77d0 0x7f3ad00f7c30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.390+0000 7f3ad6238700 1 --2- 172.21.15.8:0/1939918869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad00f6530 0x7f3ad00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.390+0000 7f3ad6238700 1 -- 172.21.15.8:0/1939918869 >> 172.21.15.8:0/1939918869 conn(0x7f3ad00f1c90 msgr2=0x7f3ad00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:46.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.390+0000 7f3ad6238700 1 -- 172.21.15.8:0/1939918869 shutdown_connections 2023-10-18T20:59:46.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.390+0000 7f3ad6238700 1 -- 172.21.15.8:0/1939918869 wait complete. 2023-10-18T20:59:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.391+0000 7f3ad6238700 1 Processor -- start 2023-10-18T20:59:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.391+0000 7f3ad6238700 1 -- start start 2023-10-18T20:59:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad6238700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad00f6530 0x7f3ad0108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad6238700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad00f77d0 0x7f3ad01093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad6238700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0109970 con 0x7f3ad00f6530 2023-10-18T20:59:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad6238700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0109ab0 con 0x7f3ad00f77d0 2023-10-18T20:59:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad5236700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad00f6530 0x7f3ad0108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad5236700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad00f6530 0x7f3ad0108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33610/0 (socket says 172.21.15.8:33610) 2023-10-18T20:59:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad5236700 1 -- 172.21.15.8:0/3193128303 learned_addr learned my addr 172.21.15.8:0/3193128303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad4a35700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad00f77d0 0x7f3ad01093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad5236700 1 -- 172.21.15.8:0/3193128303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad00f77d0 msgr2=0x7f3ad01093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad5236700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad00f77d0 0x7f3ad01093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.392+0000 7f3ad5236700 1 -- 172.21.15.8:0/3193128303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac0005040 con 0x7f3ad00f6530 2023-10-18T20:59:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.393+0000 7f3ad5236700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad00f6530 0x7f3ad0108ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3acc00e7c0 tx=0x7f3acc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.393+0000 7f3ac5ffb700 1 -- 172.21.15.8:0/3193128303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3acc0092e0 con 0x7f3ad00f6530 2023-10-18T20:59:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.393+0000 7f3ac5ffb700 1 -- 172.21.15.8:0/3193128303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3acc00f040 con 0x7f3ad00f6530 2023-10-18T20:59:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.393+0000 7f3ad6238700 1 -- 172.21.15.8:0/3193128303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad010a450 con 0x7f3ad00f6530 2023-10-18T20:59:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.393+0000 7f3ac5ffb700 1 -- 172.21.15.8:0/3193128303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3acc0147e0 con 0x7f3ad00f6530 2023-10-18T20:59:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.393+0000 7f3ad6238700 1 -- 172.21.15.8:0/3193128303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad010a990 con 0x7f3ad00f6530 2023-10-18T20:59:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.394+0000 7f3ad6238700 1 -- 172.21.15.8:0/3193128303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad0045ad0 con 0x7f3ad00f6530 2023-10-18T20:59:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.395+0000 7f3ac5ffb700 1 -- 172.21.15.8:0/3193128303 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7f3acc01b030 con 0x7f3ad00f6530 2023-10-18T20:59:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.396+0000 7f3ac5ffb700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3abc061000 0x7f3abc0634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.397+0000 7f3ac5ffb700 1 -- 172.21.15.8:0/3193128303 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f3acc07c1b0 con 0x7f3ad00f6530 2023-10-18T20:59:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.397+0000 7f3ad4a35700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3abc061000 0x7f3abc0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:46.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.397+0000 7f3ad4a35700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3abc061000 0x7f3abc0634c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3ac00043d0 tx=0x7f3ac000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:46.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.401+0000 7f3ac5ffb700 1 -- 172.21.15.8:0/3193128303 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3acc04ff70 con 0x7f3ad00f6530 2023-10-18T20:59:46.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.608+0000 7f3ad6238700 1 -- 172.21.15.8:0/3193128303 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ad010ac00 con 0x7f3abc061000 2023-10-18T20:59:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.618+0000 7f3ac5ffb700 1 -- 172.21.15.8:0/3193128303 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3ad010ac00 con 0x7f3abc061000 2023-10-18T20:59:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T20:59:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (6m) 8s ago 7m 14.8M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T20:59:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (19s) 8s ago 7m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T20:59:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (14s) 10s ago 7m 7566k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T20:59:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (6m) 8s ago 7m 24.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T20:59:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (3m) 8s ago 3m 5050M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T20:59:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (3m) 8s ago 3m 658M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T20:59:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (3m) 10s ago 3m 2598M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T20:59:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (3m) 10s ago 3m 373M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T20:59:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (96s) 8s ago 9m 443M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T20:59:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (56s) 10s ago 7m 394M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T20:59:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (47s) 8s ago 9m 48.9M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T20:59:46.625 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (34s) 10s ago 6m 39.6M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T20:59:46.625 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (7m) 8s ago 7m 9491k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T20:59:46.625 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (6m) 10s ago 6m 9903k - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T20:59:46.625 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 starting - - - 4096M 2023-10-18T20:59:46.626 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (6m) 8s ago 6m 716M 4096M 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T20:59:46.626 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (5m) 8s ago 5m 642M 4096M 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T20:59:46.626 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (5m) 10s ago 5m 856M 4096M 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T20:59:46.626 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (5m) 10s ago 5m 709M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T20:59:46.626 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (5m) 10s ago 5m 745M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T20:59:46.627 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (117s) 8s ago 7m 52.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T20:59:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 -- 172.21.15.8:0/3193128303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3abc061000 msgr2=0x7f3abc0634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3abc061000 0x7f3abc0634c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3ac00043d0 tx=0x7f3ac000b040).stop 2023-10-18T20:59:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 -- 172.21.15.8:0/3193128303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad00f6530 msgr2=0x7f3ad0108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad00f6530 0x7f3ad0108ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3acc00e7c0 tx=0x7f3acc00b040).stop 2023-10-18T20:59:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 -- 172.21.15.8:0/3193128303 shutdown_connections 2023-10-18T20:59:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3abc061000 0x7f3abc0634c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad00f6530 0x7f3ad0108ed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 --2- 172.21.15.8:0/3193128303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad00f77d0 0x7f3ad01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 -- 172.21.15.8:0/3193128303 >> 172.21.15.8:0/3193128303 conn(0x7f3ad00f1c90 msgr2=0x7f3ad00f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:46.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 -- 172.21.15.8:0/3193128303 shutdown_connections 2023-10-18T20:59:46.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.621+0000 7f3ad6238700 1 -- 172.21.15.8:0/3193128303 wait complete. 2023-10-18T20:59:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:45.440193+0000 mon.smithi008 (mon.0) 80 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:46.671 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:46 smithi008 bash[150201]: 8723003d09338057fbf2a0cfe23fbb0fcd76b29363cf518a436961f16d331c39 2023-10-18T20:59:46.671 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-0[150216]: debug 2023-10-18T20:59:46.371+0000 7fa8a3b96700 1 -- 172.21.15.8:0/2075174849 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cd2295c680 con 0x55cd22923000 2023-10-18T20:59:46.671 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:46 smithi008 systemd[1]: Started Ceph osd.0 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T20:59:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:45.440193+0000 mon.smithi008 (mon.0) 80 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:46.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.782+0000 7f3488af5700 1 -- 172.21.15.8:0/2804465533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34840f77d0 msgr2=0x7f34840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:46.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.782+0000 7f3488af5700 1 --2- 172.21.15.8:0/2804465533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34840f77d0 0x7f34840f7c30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f3478004660 tx=0x7f3478009b30).stop 2023-10-18T20:59:46.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.782+0000 7f3488af5700 1 -- 172.21.15.8:0/2804465533 shutdown_connections 2023-10-18T20:59:46.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.782+0000 7f3488af5700 1 --2- 172.21.15.8:0/2804465533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34840f77d0 0x7f34840f7c30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.782+0000 7f3488af5700 1 --2- 172.21.15.8:0/2804465533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34840f6530 0x7f34840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.782+0000 7f3488af5700 1 -- 172.21.15.8:0/2804465533 >> 172.21.15.8:0/2804465533 conn(0x7f34840f1c90 msgr2=0x7f34840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:46.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.782+0000 7f3488af5700 1 -- 172.21.15.8:0/2804465533 shutdown_connections 2023-10-18T20:59:46.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.782+0000 7f3488af5700 1 -- 172.21.15.8:0/2804465533 wait complete. 2023-10-18T20:59:46.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.783+0000 7f3488af5700 1 Processor -- start 2023-10-18T20:59:46.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.784+0000 7f3488af5700 1 -- start start 2023-10-18T20:59:46.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.784+0000 7f3488af5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34840f6530 0x7f3484108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:46.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.784+0000 7f3488af5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34840f77d0 0x7f3484109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:46.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.784+0000 7f3488af5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34841099d0 con 0x7f34840f77d0 2023-10-18T20:59:46.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.784+0000 7f3488af5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484109b10 con 0x7f34840f6530 2023-10-18T20:59:46.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.784+0000 7f3482ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34840f77d0 0x7f3484109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:46.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.784+0000 7f34837fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34840f6530 0x7f3484108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:46.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.784+0000 7f34837fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34840f6530 0x7f3484108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:54170/0 (socket says 172.21.15.8:54170) 2023-10-18T20:59:46.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.784+0000 7f34837fe700 1 -- 172.21.15.8:0/720850234 learned_addr learned my addr 172.21.15.8:0/720850234 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:46.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.785+0000 7f3482ffd700 1 -- 172.21.15.8:0/720850234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34840f6530 msgr2=0x7f3484108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:46.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.785+0000 7f3482ffd700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34840f6530 0x7f3484108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:46.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.785+0000 7f3482ffd700 1 -- 172.21.15.8:0/720850234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3478005040 con 0x7f34840f77d0 2023-10-18T20:59:46.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.785+0000 7f34837fe700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34840f6530 0x7f3484108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T20:59:46.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.785+0000 7f3482ffd700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34840f77d0 0x7f3484109420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3478011000 tx=0x7f347800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:46.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.785+0000 7f346bfff700 1 -- 172.21.15.8:0/720850234 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3478019070 con 0x7f34840f77d0 2023-10-18T20:59:46.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.785+0000 7f346bfff700 1 -- 172.21.15.8:0/720850234 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3478013e70 con 0x7f34840f77d0 2023-10-18T20:59:46.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.786+0000 7f3488af5700 1 -- 172.21.15.8:0/720850234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348410a450 con 0x7f34840f77d0 2023-10-18T20:59:46.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.786+0000 7f346bfff700 1 -- 172.21.15.8:0/720850234 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3478014d30 con 0x7f34840f77d0 2023-10-18T20:59:46.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.786+0000 7f3488af5700 1 -- 172.21.15.8:0/720850234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348410a930 con 0x7f34840f77d0 2023-10-18T20:59:46.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.787+0000 7f3488af5700 1 -- 172.21.15.8:0/720850234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3484045ad0 con 0x7f34840f77d0 2023-10-18T20:59:46.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.788+0000 7f346bfff700 1 -- 172.21.15.8:0/720850234 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7f3478014420 con 0x7f34840f77d0 2023-10-18T20:59:46.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.789+0000 7f346bfff700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f346c061000 0x7f346c0634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:46.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.789+0000 7f346bfff700 1 -- 172.21.15.8:0/720850234 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f347807d6c0 con 0x7f34840f77d0 2023-10-18T20:59:46.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.789+0000 7f34837fe700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f346c061000 0x7f346c0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:46.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.790+0000 7f34837fe700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f346c061000 0x7f346c0634c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f34740041d0 tx=0x7f347400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:46.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:46.797+0000 7f346bfff700 1 -- 172.21.15.8:0/720850234 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f34780514a0 con 0x7f34840f77d0 2023-10-18T20:59:47.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.107+0000 7f3488af5700 1 -- 172.21.15.8:0/720850234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3484027a00 con 0x7f34840f77d0 2023-10-18T20:59:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.107+0000 7f346bfff700 1 -- 172.21.15.8:0/720850234 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3478051090 con 0x7f34840f77d0 2023-10-18T20:59:47.111 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:59:47.111 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T20:59:47.111 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T20:59:47.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:59:47.111 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T20:59:47.112 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T20:59:47.112 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:59:47.112 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T20:59:47.112 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2023-10-18T20:59:47.112 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:59:47.113 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T20:59:47.113 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T20:59:47.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T20:59:47.113 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T20:59:47.113 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 4, 2023-10-18T20:59:47.114 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9 2023-10-18T20:59:47.114 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T20:59:47.114 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:59:47.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 -- 172.21.15.8:0/720850234 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f346c061000 msgr2=0x7f346c0634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:47.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f346c061000 0x7f346c0634c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f34740041d0 tx=0x7f347400b040).stop 2023-10-18T20:59:47.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 -- 172.21.15.8:0/720850234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34840f77d0 msgr2=0x7f3484109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34840f77d0 0x7f3484109420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3478011000 tx=0x7f347800b040).stop 2023-10-18T20:59:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 -- 172.21.15.8:0/720850234 shutdown_connections 2023-10-18T20:59:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f346c061000 0x7f346c0634c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34840f6530 0x7f3484108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 --2- 172.21.15.8:0/720850234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34840f77d0 0x7f3484109420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 -- 172.21.15.8:0/720850234 >> 172.21.15.8:0/720850234 conn(0x7f34840f1c90 msgr2=0x7f348406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 -- 172.21.15.8:0/720850234 shutdown_connections 2023-10-18T20:59:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.110+0000 7f3488af5700 1 -- 172.21.15.8:0/720850234 wait complete. 2023-10-18T20:59:47.170 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-0[150216]: debug 2023-10-18T20:59:46.896+0000 7fa8ab611200 -1 Falling back to public interface 2023-10-18T20:59:47.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.269+0000 7fe974975700 1 -- 172.21.15.8:0/377764058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9700f77d0 msgr2=0x7fe9700f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:47.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.269+0000 7fe974975700 1 --2- 172.21.15.8:0/377764058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9700f77d0 0x7fe9700f7c30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe964004660 tx=0x7fe964009b30).stop 2023-10-18T20:59:47.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.269+0000 7fe974975700 1 -- 172.21.15.8:0/377764058 shutdown_connections 2023-10-18T20:59:47.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.269+0000 7fe974975700 1 --2- 172.21.15.8:0/377764058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9700f77d0 0x7fe9700f7c30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.269+0000 7fe974975700 1 --2- 172.21.15.8:0/377764058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9700f6530 0x7fe9700f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.269+0000 7fe974975700 1 -- 172.21.15.8:0/377764058 >> 172.21.15.8:0/377764058 conn(0x7fe9700f1c90 msgr2=0x7fe9700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:47.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.270+0000 7fe974975700 1 -- 172.21.15.8:0/377764058 shutdown_connections 2023-10-18T20:59:47.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.270+0000 7fe974975700 1 -- 172.21.15.8:0/377764058 wait complete. 2023-10-18T20:59:47.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.271+0000 7fe974975700 1 Processor -- start 2023-10-18T20:59:47.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.271+0000 7fe974975700 1 -- start start 2023-10-18T20:59:47.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.271+0000 7fe974975700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9700f6530 0x7fe970108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:47.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.271+0000 7fe974975700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9700f77d0 0x7fe970109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:47.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.271+0000 7fe974975700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701099c0 con 0x7fe9700f77d0 2023-10-18T20:59:47.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.271+0000 7fe974975700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970109b00 con 0x7fe9700f6530 2023-10-18T20:59:47.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.272+0000 7fe96effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9700f77d0 0x7fe970109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:47.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.272+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9700f6530 0x7fe970108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:47.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.272+0000 7fe96effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9700f77d0 0x7fe970109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40744/0 (socket says 172.21.15.8:40744) 2023-10-18T20:59:47.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.272+0000 7fe96effd700 1 -- 172.21.15.8:0/2534715139 learned_addr learned my addr 172.21.15.8:0/2534715139 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:47.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.272+0000 7fe96f7fe700 1 -- 172.21.15.8:0/2534715139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9700f77d0 msgr2=0x7fe970109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:47.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.272+0000 7fe96f7fe700 1 --2- 172.21.15.8:0/2534715139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9700f77d0 0x7fe970109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.272+0000 7fe96f7fe700 1 -- 172.21.15.8:0/2534715139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964005040 con 0x7fe9700f6530 2023-10-18T20:59:47.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.272+0000 7fe96f7fe700 1 --2- 172.21.15.8:0/2534715139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9700f6530 0x7fe970108f20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe9700f7630 tx=0x7fe96000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:47.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.273+0000 7fe957fff700 1 -- 172.21.15.8:0/2534715139 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9600092e0 con 0x7fe9700f6530 2023-10-18T20:59:47.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.273+0000 7fe957fff700 1 -- 172.21.15.8:0/2534715139 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe96000f040 con 0x7fe9700f6530 2023-10-18T20:59:47.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.273+0000 7fe974975700 1 -- 172.21.15.8:0/2534715139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97010a4a0 con 0x7fe9700f6530 2023-10-18T20:59:47.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.273+0000 7fe957fff700 1 -- 172.21.15.8:0/2534715139 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe960014860 con 0x7fe9700f6530 2023-10-18T20:59:47.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.273+0000 7fe974975700 1 -- 172.21.15.8:0/2534715139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97010a9e0 con 0x7fe9700f6530 2023-10-18T20:59:47.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.274+0000 7fe974975700 1 -- 172.21.15.8:0/2534715139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe970045ad0 con 0x7fe9700f6530 2023-10-18T20:59:47.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.275+0000 7fe957fff700 1 -- 172.21.15.8:0/2534715139 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7fe96001b030 con 0x7fe9700f6530 2023-10-18T20:59:47.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.276+0000 7fe957fff700 1 --2- 172.21.15.8:0/2534715139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe958061000 0x7fe9580634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:47.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.276+0000 7fe957fff700 1 -- 172.21.15.8:0/2534715139 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe96007c0e0 con 0x7fe9700f6530 2023-10-18T20:59:47.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.277+0000 7fe96effd700 1 --2- 172.21.15.8:0/2534715139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe958061000 0x7fe9580634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:47.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.277+0000 7fe96effd700 1 --2- 172.21.15.8:0/2534715139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe958061000 0x7fe9580634c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe964004630 tx=0x7fe964016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:47.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.281+0000 7fe957fff700 1 -- 172.21.15.8:0/2534715139 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe96004fec0 con 0x7fe9700f6530 2023-10-18T20:59:47.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.599+0000 7fe974975700 1 -- 172.21.15.8:0/2534715139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe9700fee40 con 0x7fe9700f6530 2023-10-18T20:59:47.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.601+0000 7fe957fff700 1 -- 172.21.15.8:0/2534715139 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1794 (secure 0 0 0) 0x7fe960019020 con 0x7fe9700f6530 2023-10-18T20:59:47.604 INFO:teuthology.orchestra.run.smithi008.stdout:e17 2023-10-18T20:59:47.604 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T20:59:47.604 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:59:47.604 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T20:59:47.605 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:59:47.605 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T20:59:47.605 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T20:59:47.605 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 17 2023-10-18T20:59:47.605 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T20:59:47.606 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T20:59:47.606 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:59:22.221117+0000 2023-10-18T20:59:47.606 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T20:59:47.606 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T20:59:47.606 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T20:59:47.607 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T20:59:47.607 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T20:59:47.607 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T20:59:47.607 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T20:59:47.607 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T20:59:47.608 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T20:59:47.608 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T20:59:47.608 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T20:59:47.608 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T20:59:47.608 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T20:59:47.608 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T20:59:47.609 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T20:59:47.609 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T20:59:47.609 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T20:59:47.609 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T20:59:47.609 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T20:59:47.609 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T20:59:47.610 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:47.610 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:47.610 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:47.610 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T20:59:47.610 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:59:47.611 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T20:59:47.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.604+0000 7fe974975700 1 -- 172.21.15.8:0/2534715139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe958061000 msgr2=0x7fe9580634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:47.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.604+0000 7fe974975700 1 --2- 172.21.15.8:0/2534715139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe958061000 0x7fe9580634c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe964004630 tx=0x7fe964016040).stop 2023-10-18T20:59:47.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.604+0000 7fe974975700 1 -- 172.21.15.8:0/2534715139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9700f6530 msgr2=0x7fe970108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:47.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.604+0000 7fe974975700 1 --2- 172.21.15.8:0/2534715139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9700f6530 0x7fe970108f20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe9700f7630 tx=0x7fe96000b040).stop 2023-10-18T20:59:47.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.604+0000 7fe974975700 1 -- 172.21.15.8:0/2534715139 shutdown_connections 2023-10-18T20:59:47.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.604+0000 7fe974975700 1 --2- 172.21.15.8:0/2534715139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe958061000 0x7fe9580634c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.604+0000 7fe974975700 1 --2- 172.21.15.8:0/2534715139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9700f6530 0x7fe970108f20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.604+0000 7fe974975700 1 --2- 172.21.15.8:0/2534715139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9700f77d0 0x7fe970109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.604+0000 7fe974975700 1 -- 172.21.15.8:0/2534715139 >> 172.21.15.8:0/2534715139 conn(0x7fe9700f1c90 msgr2=0x7fe97006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:47.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.605+0000 7fe974975700 1 -- 172.21.15.8:0/2534715139 shutdown_connections 2023-10-18T20:59:47.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.605+0000 7fe974975700 1 -- 172.21.15.8:0/2534715139 wait complete. 2023-10-18T20:59:47.613 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-18T20:59:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:45.838837+0000 mgr.smithi008.flmjzp (mgr.14640) 70 : audit [DBG] from='client.44101 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:46.133708+0000 mgr.smithi008.flmjzp (mgr.14640) 71 : cluster [DBG] pgmap v44: 65 pgs: 9 stale+active+clean, 56 active+clean; 344 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 609 KiB/s rd, 675 KiB/s wr, 127 op/s 2023-10-18T20:59:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:46.231661+0000 mgr.smithi008.flmjzp (mgr.14640) 72 : audit [DBG] from='client.34126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:46.459377+0000 mon.smithi008 (mon.0) 81 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:46.460408+0000 mon.smithi008 (mon.0) 82 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:47.109174+0000 mon.smithi008 (mon.0) 83 : audit [DBG] from='client.? 172.21.15.8:0/720850234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:45.838837+0000 mgr.smithi008.flmjzp (mgr.14640) 70 : audit [DBG] from='client.44101 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:46.133708+0000 mgr.smithi008.flmjzp (mgr.14640) 71 : cluster [DBG] pgmap v44: 65 pgs: 9 stale+active+clean, 56 active+clean; 344 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 609 KiB/s rd, 675 KiB/s wr, 127 op/s 2023-10-18T20:59:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:46.231661+0000 mgr.smithi008.flmjzp (mgr.14640) 72 : audit [DBG] from='client.34126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:46.459377+0000 mon.smithi008 (mon.0) 81 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:46.460408+0000 mon.smithi008 (mon.0) 82 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:47.109174+0000 mon.smithi008 (mon.0) 83 : audit [DBG] from='client.? 172.21.15.8:0/720850234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:47.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.777+0000 7fb225d7a700 1 -- 172.21.15.8:0/1567343868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb220060310 msgr2=0x7fb2200f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:47.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.777+0000 7fb225d7a700 1 --2- 172.21.15.8:0/1567343868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb220060310 0x7fb2200f9110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb214004660 tx=0x7fb214009b30).stop 2023-10-18T20:59:47.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.777+0000 7fb225d7a700 1 -- 172.21.15.8:0/1567343868 shutdown_connections 2023-10-18T20:59:47.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.777+0000 7fb225d7a700 1 --2- 172.21.15.8:0/1567343868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2200f9690 0x7fb2200fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.777+0000 7fb225d7a700 1 --2- 172.21.15.8:0/1567343868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb220060310 0x7fb2200f9110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.777+0000 7fb225d7a700 1 -- 172.21.15.8:0/1567343868 >> 172.21.15.8:0/1567343868 conn(0x7fb2200f0b90 msgr2=0x7fb2200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:47.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.777+0000 7fb225d7a700 1 -- 172.21.15.8:0/1567343868 shutdown_connections 2023-10-18T20:59:47.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.777+0000 7fb225d7a700 1 -- 172.21.15.8:0/1567343868 wait complete. 2023-10-18T20:59:47.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.778+0000 7fb225d7a700 1 Processor -- start 2023-10-18T20:59:47.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.778+0000 7fb225d7a700 1 -- start start 2023-10-18T20:59:47.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb225d7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb220060310 0x7fb220108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:47.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb225d7a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2200f9690 0x7fb2201093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:47.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb225d7a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb220109980 con 0x7fb220060310 2023-10-18T20:59:47.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb225d7a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb220109ac0 con 0x7fb2200f9690 2023-10-18T20:59:47.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb224d78700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb220060310 0x7fb220108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:47.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb224d78700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb220060310 0x7fb220108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40768/0 (socket says 172.21.15.8:40768) 2023-10-18T20:59:47.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb224d78700 1 -- 172.21.15.8:0/2322100641 learned_addr learned my addr 172.21.15.8:0/2322100641 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T20:59:47.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb21ffff700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2200f9690 0x7fb2201093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:47.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb224d78700 1 -- 172.21.15.8:0/2322100641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2200f9690 msgr2=0x7fb2201093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:47.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb224d78700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2200f9690 0x7fb2201093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:47.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.779+0000 7fb224d78700 1 -- 172.21.15.8:0/2322100641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214005040 con 0x7fb220060310 2023-10-18T20:59:47.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.780+0000 7fb224d78700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb220060310 0x7fb220108ee0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb214009990 tx=0x7fb214009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:47.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.780+0000 7fb21d7fa700 1 -- 172.21.15.8:0/2322100641 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb214018070 con 0x7fb220060310 2023-10-18T20:59:47.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.780+0000 7fb21d7fa700 1 -- 172.21.15.8:0/2322100641 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb214009630 con 0x7fb220060310 2023-10-18T20:59:47.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.780+0000 7fb21d7fa700 1 -- 172.21.15.8:0/2322100641 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb21401c3c0 con 0x7fb220060310 2023-10-18T20:59:47.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.780+0000 7fb225d7a700 1 -- 172.21.15.8:0/2322100641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22010a400 con 0x7fb220060310 2023-10-18T20:59:47.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.780+0000 7fb225d7a700 1 -- 172.21.15.8:0/2322100641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22010a960 con 0x7fb220060310 2023-10-18T20:59:47.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.781+0000 7fb20affd700 1 -- 172.21.15.8:0/2322100641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb220045ad0 con 0x7fb220060310 2023-10-18T20:59:47.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.783+0000 7fb21d7fa700 1 -- 172.21.15.8:0/2322100641 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 29) v1 ==== 77244+0+0 (secure 0 0 0) 0x7fb21401d970 con 0x7fb220060310 2023-10-18T20:59:47.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.783+0000 7fb21d7fa700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb210061000 0x7fb2100634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T20:59:47.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.783+0000 7fb21d7fa700 1 -- 172.21.15.8:0/2322100641 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb21407de60 con 0x7fb220060310 2023-10-18T20:59:47.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.784+0000 7fb21ffff700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb210061000 0x7fb2100634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T20:59:47.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.784+0000 7fb21ffff700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb210061000 0x7fb2100634c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb2200600e0 tx=0x7fb20c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T20:59:47.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:47.788+0000 7fb21d7fa700 1 -- 172.21.15.8:0/2322100641 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb214051c40 con 0x7fb220060310 2023-10-18T20:59:48.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.035+0000 7fb20affd700 1 -- 172.21.15.8:0/2322100641 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2200fee00 con 0x7fb210061000 2023-10-18T20:59:48.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.037+0000 7fb21d7fa700 1 -- 172.21.15.8:0/2322100641 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb2200fee00 con 0x7fb210061000 2023-10-18T20:59:48.040 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T20:59:48.040 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T20:59:48.040 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T20:59:48.040 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T20:59:48.041 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T20:59:48.041 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T20:59:48.041 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T20:59:48.041 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T20:59:48.041 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T20:59:48.041 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "6/21 daemons upgraded", 2023-10-18T20:59:48.042 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading osd daemons", 2023-10-18T20:59:48.042 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T20:59:48.042 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T20:59:48.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.039+0000 7fb20affd700 1 -- 172.21.15.8:0/2322100641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb210061000 msgr2=0x7fb2100634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:48.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.039+0000 7fb20affd700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb210061000 0x7fb2100634c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb2200600e0 tx=0x7fb20c00b040).stop 2023-10-18T20:59:48.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.039+0000 7fb20affd700 1 -- 172.21.15.8:0/2322100641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb220060310 msgr2=0x7fb220108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T20:59:48.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.039+0000 7fb20affd700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb220060310 0x7fb220108ee0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb214009990 tx=0x7fb214009b30).stop 2023-10-18T20:59:48.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.039+0000 7fb20affd700 1 -- 172.21.15.8:0/2322100641 shutdown_connections 2023-10-18T20:59:48.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.039+0000 7fb20affd700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb210061000 0x7fb2100634c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:48.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.039+0000 7fb20affd700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb220060310 0x7fb220108ee0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:48.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.039+0000 7fb20affd700 1 --2- 172.21.15.8:0/2322100641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2200f9690 0x7fb2201093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T20:59:48.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.039+0000 7fb20affd700 1 -- 172.21.15.8:0/2322100641 >> 172.21.15.8:0/2322100641 conn(0x7fb2200f0b90 msgr2=0x7fb2200f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T20:59:48.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.040+0000 7fb20affd700 1 -- 172.21.15.8:0/2322100641 shutdown_connections 2023-10-18T20:59:48.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T20:59:48.040+0000 7fb20affd700 1 -- 172.21.15.8:0/2322100641 wait complete. 2023-10-18T20:59:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:46.611300+0000 mgr.smithi008.flmjzp (mgr.14640) 73 : audit [DBG] from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:47.601693+0000 mon.smithi060 (mon.1) 2 : audit [DBG] from='client.? 172.21.15.8:0/2534715139' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:59:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:46.611300+0000 mgr.smithi008.flmjzp (mgr.14640) 73 : audit [DBG] from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:48.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:47.601693+0000 mon.smithi060 (mon.1) 2 : audit [DBG] from='client.? 172.21.15.8:0/2534715139' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T20:59:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:48.038286+0000 mgr.smithi008.flmjzp (mgr.14640) 74 : audit [DBG] from='client.34144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:48.134307+0000 mgr.smithi008.flmjzp (mgr.14640) 75 : cluster [DBG] pgmap v45: 65 pgs: 32 active+undersized+degraded, 2 active+undersized, 31 active+clean; 348 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 822 KiB/s rd, 1.5 MiB/s wr, 253 op/s; 7945/53205 objects degraded (14.933%) 2023-10-18T20:59:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:48.459106+0000 mon.smithi008 (mon.0) 84 : cluster [WRN] Health check failed: Degraded data redundancy: 7945/53205 objects degraded (14.933%), 32 pgs degraded (PG_DEGRADED) 2023-10-18T20:59:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:48.038286+0000 mgr.smithi008.flmjzp (mgr.14640) 74 : audit [DBG] from='client.34144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T20:59:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:48.134307+0000 mgr.smithi008.flmjzp (mgr.14640) 75 : cluster [DBG] pgmap v45: 65 pgs: 32 active+undersized+degraded, 2 active+undersized, 31 active+clean; 348 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 822 KiB/s rd, 1.5 MiB/s wr, 253 op/s; 7945/53205 objects degraded (14.933%) 2023-10-18T20:59:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:48.459106+0000 mon.smithi008 (mon.0) 84 : cluster [WRN] Health check failed: Degraded data redundancy: 7945/53205 objects degraded (14.933%), 32 pgs degraded (PG_DEGRADED) 2023-10-18T20:59:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:50.134719+0000 mgr.smithi008.flmjzp (mgr.14640) 76 : cluster [DBG] pgmap v46: 65 pgs: 32 active+undersized+degraded, 2 active+undersized, 31 active+clean; 348 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 213 KiB/s rd, 824 KiB/s wr, 126 op/s; 7945/53205 objects degraded (14.933%) 2023-10-18T20:59:51.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:50.134719+0000 mgr.smithi008.flmjzp (mgr.14640) 76 : cluster [DBG] pgmap v46: 65 pgs: 32 active+undersized+degraded, 2 active+undersized, 31 active+clean; 348 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 213 KiB/s rd, 824 KiB/s wr, 126 op/s; 7945/53205 objects degraded (14.933%) 2023-10-18T20:59:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:52.135257+0000 mgr.smithi008.flmjzp (mgr.14640) 77 : cluster [DBG] pgmap v47: 65 pgs: 32 active+undersized+degraded, 2 active+undersized, 31 active+clean; 350 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 652 KiB/s rd, 1.1 MiB/s wr, 252 op/s; 7360/49362 objects degraded (14.910%) 2023-10-18T20:59:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:52.273301+0000 mon.smithi008 (mon.0) 85 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:53.008864+0000 mon.smithi008 (mon.0) 86 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:53.009804+0000 mon.smithi008 (mon.0) 87 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:59:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:53.014492+0000 mon.smithi008 (mon.0) 88 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:53.020403+0000 mon.smithi008 (mon.0) 89 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:53.023049+0000 mon.smithi008 (mon.0) 90 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:53.024507+0000 mon.smithi008 (mon.0) 91 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:53.026083+0000 mon.smithi008 (mon.0) 92 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:53.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:53.027512+0000 mon.smithi008 (mon.0) 93 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T20:59:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:52.135257+0000 mgr.smithi008.flmjzp (mgr.14640) 77 : cluster [DBG] pgmap v47: 65 pgs: 32 active+undersized+degraded, 2 active+undersized, 31 active+clean; 350 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 652 KiB/s rd, 1.1 MiB/s wr, 252 op/s; 7360/49362 objects degraded (14.910%) 2023-10-18T20:59:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:52.273301+0000 mon.smithi008 (mon.0) 85 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:53.008864+0000 mon.smithi008 (mon.0) 86 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T20:59:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:53.009804+0000 mon.smithi008 (mon.0) 87 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T20:59:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:53.014492+0000 mon.smithi008 (mon.0) 88 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T20:59:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:53.020403+0000 mon.smithi008 (mon.0) 89 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T20:59:53.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:53.023049+0000 mon.smithi008 (mon.0) 90 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:53.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:53.024507+0000 mon.smithi008 (mon.0) 91 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:53.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:53.026083+0000 mon.smithi008 (mon.0) 92 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T20:59:53.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:53.027512+0000 mon.smithi008 (mon.0) 93 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T20:59:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:53.010550+0000 mgr.smithi008.flmjzp (mgr.14640) 78 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:59:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:53.027680+0000 mgr.smithi008.flmjzp (mgr.14640) 79 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T20:59:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T20:59:53.028473+0000 mgr.smithi008.flmjzp (mgr.14640) 80 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-10-18T20:59:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:53.010550+0000 mgr.smithi008.flmjzp (mgr.14640) 78 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T20:59:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:53.027680+0000 mgr.smithi008.flmjzp (mgr.14640) 79 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T20:59:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T20:59:53.028473+0000 mgr.smithi008.flmjzp (mgr.14640) 80 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-10-18T20:59:55.170 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-0[150216]: debug 2023-10-18T20:59:54.858+0000 7fa8ab611200 -1 osd.0 45 log_to_monitors {default=true} 2023-10-18T20:59:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:54.135715+0000 mgr.smithi008.flmjzp (mgr.14640) 81 : cluster [DBG] pgmap v48: 65 pgs: 32 active+undersized+degraded, 2 active+undersized, 31 active+clean; 350 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 593 KiB/s rd, 1.0 MiB/s wr, 229 op/s; 7360/49362 objects degraded (14.910%) 2023-10-18T20:59:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:54.817594+0000 mon.smithi008 (mon.0) 94 : cluster [WRN] Health check update: Degraded data redundancy: 7360/49362 objects degraded (14.910%), 32 pgs degraded (PG_DEGRADED) 2023-10-18T20:59:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:54.865268+0000 mon.smithi008 (mon.0) 95 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1886486620,v1:172.21.15.8:6803/1886486620]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-18T20:59:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:54.135715+0000 mgr.smithi008.flmjzp (mgr.14640) 81 : cluster [DBG] pgmap v48: 65 pgs: 32 active+undersized+degraded, 2 active+undersized, 31 active+clean; 350 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 593 KiB/s rd, 1.0 MiB/s wr, 229 op/s; 7360/49362 objects degraded (14.910%) 2023-10-18T20:59:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:54.817594+0000 mon.smithi008 (mon.0) 94 : cluster [WRN] Health check update: Degraded data redundancy: 7360/49362 objects degraded (14.910%), 32 pgs degraded (PG_DEGRADED) 2023-10-18T20:59:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:54.865268+0000 mon.smithi008 (mon.0) 95 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1886486620,v1:172.21.15.8:6803/1886486620]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-18T20:59:56.170 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 18 20:59:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-0[150216]: debug 2023-10-18T20:59:55.829+0000 7fa89bb09700 -1 osd.0 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T20:59:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:55.823937+0000 mon.smithi008 (mon.0) 96 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1886486620,v1:172.21.15.8:6803/1886486620]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-18T20:59:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:55.824022+0000 mon.smithi008 (mon.0) 97 : cluster [DBG] osdmap e48: 6 total, 5 up, 6 in 2023-10-18T20:59:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:55.824636+0000 mon.smithi008 (mon.0) 98 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1886486620,v1:172.21.15.8:6803/1886486620]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T20:59:57.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:56.136409+0000 mgr.smithi008.flmjzp (mgr.14640) 82 : cluster [DBG] pgmap v50: 65 pgs: 32 active+undersized+degraded, 2 active+undersized, 31 active+clean; 350 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 650 KiB/s rd, 1.1 MiB/s wr, 251 op/s; 7360/49362 objects degraded (14.910%) 2023-10-18T20:59:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:55.823937+0000 mon.smithi008 (mon.0) 96 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1886486620,v1:172.21.15.8:6803/1886486620]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-18T20:59:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:55.824022+0000 mon.smithi008 (mon.0) 97 : cluster [DBG] osdmap e48: 6 total, 5 up, 6 in 2023-10-18T20:59:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:55.824636+0000 mon.smithi008 (mon.0) 98 : audit [INF] from='osd.0 [v2:172.21.15.8:6802/1886486620,v1:172.21.15.8:6803/1886486620]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T20:59:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:56.136409+0000 mgr.smithi008.flmjzp (mgr.14640) 82 : cluster [DBG] pgmap v50: 65 pgs: 32 active+undersized+degraded, 2 active+undersized, 31 active+clean; 350 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 650 KiB/s rd, 1.1 MiB/s wr, 251 op/s; 7360/49362 objects degraded (14.910%) 2023-10-18T20:59:58.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:56.821671+0000 mon.smithi008 (mon.0) 99 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T20:59:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:56.828028+0000 mon.smithi008 (mon.0) 100 : cluster [INF] osd.0 [v2:172.21.15.8:6802/1886486620,v1:172.21.15.8:6803/1886486620] boot 2023-10-18T20:59:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:56.828306+0000 mon.smithi008 (mon.0) 101 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2023-10-18T20:59:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T20:59:56.829446+0000 mon.smithi008 (mon.0) 102 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:59:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:57.830005+0000 mon.smithi008 (mon.0) 103 : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2023-10-18T20:59:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:56.821671+0000 mon.smithi008 (mon.0) 99 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T20:59:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:56.828028+0000 mon.smithi008 (mon.0) 100 : cluster [INF] osd.0 [v2:172.21.15.8:6802/1886486620,v1:172.21.15.8:6803/1886486620] boot 2023-10-18T20:59:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:56.828306+0000 mon.smithi008 (mon.0) 101 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2023-10-18T20:59:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T20:59:56.829446+0000 mon.smithi008 (mon.0) 102 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T20:59:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:57.830005+0000 mon.smithi008 (mon.0) 103 : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2023-10-18T20:59:58.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:58.136959+0000 mgr.smithi008.flmjzp (mgr.14640) 83 : cluster [DBG] pgmap v53: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 354 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 150 op/s; 7060/47223 objects degraded (14.950%) 2023-10-18T20:59:58.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:58.830700+0000 mon.smithi008 (mon.0) 104 : cluster [DBG] osdmap e51: 6 total, 6 up, 6 in 2023-10-18T20:59:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:58.136959+0000 mgr.smithi008.flmjzp (mgr.14640) 83 : cluster [DBG] pgmap v53: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 354 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 150 op/s; 7060/47223 objects degraded (14.950%) 2023-10-18T20:59:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:58.830700+0000 mon.smithi008 (mon.0) 104 : cluster [DBG] osdmap e51: 6 total, 6 up, 6 in 2023-10-18T21:00:00.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:59.818782+0000 mon.smithi008 (mon.0) 105 : cluster [WRN] Health check update: Degraded data redundancy: 7060/47223 objects degraded (14.950%), 33 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:00.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 20:59:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T20:59:59.822601+0000 mon.smithi008 (mon.0) 106 : cluster [DBG] osdmap e52: 6 total, 6 up, 6 in 2023-10-18T21:00:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:59.818782+0000 mon.smithi008 (mon.0) 105 : cluster [WRN] Health check update: Degraded data redundancy: 7060/47223 objects degraded (14.950%), 33 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 20:59:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T20:59:59.822601+0000 mon.smithi008 (mon.0) 106 : cluster [DBG] osdmap e52: 6 total, 6 up, 6 in 2023-10-18T21:00:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000190+0000 mon.smithi008 (mon.0) 107 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 7060/47223 objects degraded (14.950%), 33 pgs degraded 2023-10-18T21:00:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000225+0000 mon.smithi008 (mon.0) 108 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 7060/47223 objects degraded (14.950%), 33 pgs degraded 2023-10-18T21:00:01.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000244+0000 mon.smithi008 (mon.0) 109 : cluster [WRN] pg 2.0 is active+undersized+degraded, acting [3,1] 2023-10-18T21:00:01.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000259+0000 mon.smithi008 (mon.0) 110 : cluster [WRN] pg 2.1 is active+undersized+degraded, acting [2,1] 2023-10-18T21:00:01.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000275+0000 mon.smithi008 (mon.0) 111 : cluster [WRN] pg 2.2 is active+undersized+degraded, acting [5,1] 2023-10-18T21:00:01.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000294+0000 mon.smithi008 (mon.0) 112 : cluster [WRN] pg 2.4 is active+undersized+degraded, acting [1,4] 2023-10-18T21:00:01.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000313+0000 mon.smithi008 (mon.0) 113 : cluster [WRN] pg 2.5 is active+undersized+degraded, acting [3,4] 2023-10-18T21:00:01.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000332+0000 mon.smithi008 (mon.0) 114 : cluster [WRN] pg 2.8 is active+undersized+degraded, acting [3,5] 2023-10-18T21:00:01.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000350+0000 mon.smithi008 (mon.0) 115 : cluster [WRN] pg 2.9 is active+undersized+degraded, acting [1,4] 2023-10-18T21:00:01.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000367+0000 mon.smithi008 (mon.0) 116 : cluster [WRN] pg 2.c is active+undersized+degraded, acting [2,3] 2023-10-18T21:00:01.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000383+0000 mon.smithi008 (mon.0) 117 : cluster [WRN] pg 2.e is active+undersized+degraded, acting [2,3] 2023-10-18T21:00:01.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000398+0000 mon.smithi008 (mon.0) 118 : cluster [WRN] pg 2.f is active+undersized+degraded, acting [4,5] 2023-10-18T21:00:01.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000413+0000 mon.smithi008 (mon.0) 119 : cluster [WRN] pg 2.10 is active+undersized+degraded, acting [2,1] 2023-10-18T21:00:01.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000428+0000 mon.smithi008 (mon.0) 120 : cluster [WRN] pg 2.12 is active+undersized+degraded, acting [3,1] 2023-10-18T21:00:01.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000460+0000 mon.smithi008 (mon.0) 121 : cluster [WRN] pg 2.13 is active+undersized+degraded, acting [4,2] 2023-10-18T21:00:01.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000477+0000 mon.smithi008 (mon.0) 122 : cluster [WRN] pg 2.15 is active+undersized+degraded, acting [1,3] 2023-10-18T21:00:01.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000492+0000 mon.smithi008 (mon.0) 123 : cluster [WRN] pg 2.19 is active+undersized+degraded, acting [4,2] 2023-10-18T21:00:01.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000511+0000 mon.smithi008 (mon.0) 124 : cluster [WRN] pg 2.1b is active+undersized+degraded, acting [1,5] 2023-10-18T21:00:01.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000532+0000 mon.smithi008 (mon.0) 125 : cluster [WRN] pg 2.1d is active+undersized+degraded, acting [3,5] 2023-10-18T21:00:01.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000547+0000 mon.smithi008 (mon.0) 126 : cluster [WRN] pg 2.1e is active+undersized+degraded, acting [2,5] 2023-10-18T21:00:01.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000563+0000 mon.smithi008 (mon.0) 127 : cluster [WRN] pg 2.1f is active+undersized+degraded, acting [3,4] 2023-10-18T21:00:01.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000577+0000 mon.smithi008 (mon.0) 128 : cluster [WRN] pg 3.1 is active+undersized+degraded, acting [4,2] 2023-10-18T21:00:01.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000592+0000 mon.smithi008 (mon.0) 129 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,3] 2023-10-18T21:00:01.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000606+0000 mon.smithi008 (mon.0) 130 : cluster [WRN] pg 3.6 is active+undersized+degraded, acting [1,4] 2023-10-18T21:00:01.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000625+0000 mon.smithi008 (mon.0) 131 : cluster [WRN] pg 3.b is active+undersized+degraded, acting [1,4] 2023-10-18T21:00:01.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000647+0000 mon.smithi008 (mon.0) 132 : cluster [WRN] pg 3.c is active+undersized+degraded, acting [5,3] 2023-10-18T21:00:01.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000675+0000 mon.smithi008 (mon.0) 133 : cluster [WRN] pg 3.f is active+undersized+degraded, acting [5,3] 2023-10-18T21:00:01.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000691+0000 mon.smithi008 (mon.0) 134 : cluster [WRN] pg 3.10 is active+undersized+degraded, acting [5,1] 2023-10-18T21:00:01.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000710+0000 mon.smithi008 (mon.0) 135 : cluster [WRN] pg 3.11 is active+undersized+degraded, acting [3,4] 2023-10-18T21:00:01.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000728+0000 mon.smithi008 (mon.0) 136 : cluster [WRN] pg 3.12 is active+undersized+degraded, acting [3,1] 2023-10-18T21:00:01.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000745+0000 mon.smithi008 (mon.0) 137 : cluster [WRN] pg 3.15 is active+undersized+degraded, acting [3,4] 2023-10-18T21:00:01.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000759+0000 mon.smithi008 (mon.0) 138 : cluster [WRN] pg 3.17 is active+undersized+degraded, acting [5,2] 2023-10-18T21:00:01.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000775+0000 mon.smithi008 (mon.0) 139 : cluster [WRN] pg 3.18 is active+undersized+degraded, acting [2,1] 2023-10-18T21:00:01.178 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000789+0000 mon.smithi008 (mon.0) 140 : cluster [WRN] pg 3.1b is active+undersized+degraded, acting [4,3] 2023-10-18T21:00:01.178 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.000808+0000 mon.smithi008 (mon.0) 141 : cluster [WRN] pg 3.1f is active+undersized+degraded, acting [3,2] 2023-10-18T21:00:01.178 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.137568+0000 mgr.smithi008.flmjzp (mgr.14640) 84 : cluster [DBG] pgmap v56: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 354 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 225 op/s; 7060/47223 objects degraded (14.950%) 2023-10-18T21:00:01.178 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:00.440825+0000 mon.smithi008 (mon.0) 142 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:00:01.178 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:00.827884+0000 mon.smithi008 (mon.0) 143 : cluster [DBG] osdmap e53: 6 total, 6 up, 6 in 2023-10-18T21:00:01.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000190+0000 mon.smithi008 (mon.0) 107 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 7060/47223 objects degraded (14.950%), 33 pgs degraded 2023-10-18T21:00:01.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000225+0000 mon.smithi008 (mon.0) 108 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 7060/47223 objects degraded (14.950%), 33 pgs degraded 2023-10-18T21:00:01.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000244+0000 mon.smithi008 (mon.0) 109 : cluster [WRN] pg 2.0 is active+undersized+degraded, acting [3,1] 2023-10-18T21:00:01.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000259+0000 mon.smithi008 (mon.0) 110 : cluster [WRN] pg 2.1 is active+undersized+degraded, acting [2,1] 2023-10-18T21:00:01.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000275+0000 mon.smithi008 (mon.0) 111 : cluster [WRN] pg 2.2 is active+undersized+degraded, acting [5,1] 2023-10-18T21:00:01.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000294+0000 mon.smithi008 (mon.0) 112 : cluster [WRN] pg 2.4 is active+undersized+degraded, acting [1,4] 2023-10-18T21:00:01.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000313+0000 mon.smithi008 (mon.0) 113 : cluster [WRN] pg 2.5 is active+undersized+degraded, acting [3,4] 2023-10-18T21:00:01.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000332+0000 mon.smithi008 (mon.0) 114 : cluster [WRN] pg 2.8 is active+undersized+degraded, acting [3,5] 2023-10-18T21:00:01.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000350+0000 mon.smithi008 (mon.0) 115 : cluster [WRN] pg 2.9 is active+undersized+degraded, acting [1,4] 2023-10-18T21:00:01.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000367+0000 mon.smithi008 (mon.0) 116 : cluster [WRN] pg 2.c is active+undersized+degraded, acting [2,3] 2023-10-18T21:00:01.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000383+0000 mon.smithi008 (mon.0) 117 : cluster [WRN] pg 2.e is active+undersized+degraded, acting [2,3] 2023-10-18T21:00:01.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000398+0000 mon.smithi008 (mon.0) 118 : cluster [WRN] pg 2.f is active+undersized+degraded, acting [4,5] 2023-10-18T21:00:01.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000413+0000 mon.smithi008 (mon.0) 119 : cluster [WRN] pg 2.10 is active+undersized+degraded, acting [2,1] 2023-10-18T21:00:01.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000428+0000 mon.smithi008 (mon.0) 120 : cluster [WRN] pg 2.12 is active+undersized+degraded, acting [3,1] 2023-10-18T21:00:01.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000460+0000 mon.smithi008 (mon.0) 121 : cluster [WRN] pg 2.13 is active+undersized+degraded, acting [4,2] 2023-10-18T21:00:01.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000477+0000 mon.smithi008 (mon.0) 122 : cluster [WRN] pg 2.15 is active+undersized+degraded, acting [1,3] 2023-10-18T21:00:01.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000492+0000 mon.smithi008 (mon.0) 123 : cluster [WRN] pg 2.19 is active+undersized+degraded, acting [4,2] 2023-10-18T21:00:01.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000511+0000 mon.smithi008 (mon.0) 124 : cluster [WRN] pg 2.1b is active+undersized+degraded, acting [1,5] 2023-10-18T21:00:01.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000532+0000 mon.smithi008 (mon.0) 125 : cluster [WRN] pg 2.1d is active+undersized+degraded, acting [3,5] 2023-10-18T21:00:01.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000547+0000 mon.smithi008 (mon.0) 126 : cluster [WRN] pg 2.1e is active+undersized+degraded, acting [2,5] 2023-10-18T21:00:01.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000563+0000 mon.smithi008 (mon.0) 127 : cluster [WRN] pg 2.1f is active+undersized+degraded, acting [3,4] 2023-10-18T21:00:01.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000577+0000 mon.smithi008 (mon.0) 128 : cluster [WRN] pg 3.1 is active+undersized+degraded, acting [4,2] 2023-10-18T21:00:01.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000592+0000 mon.smithi008 (mon.0) 129 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,3] 2023-10-18T21:00:01.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000606+0000 mon.smithi008 (mon.0) 130 : cluster [WRN] pg 3.6 is active+undersized+degraded, acting [1,4] 2023-10-18T21:00:01.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000625+0000 mon.smithi008 (mon.0) 131 : cluster [WRN] pg 3.b is active+undersized+degraded, acting [1,4] 2023-10-18T21:00:01.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000647+0000 mon.smithi008 (mon.0) 132 : cluster [WRN] pg 3.c is active+undersized+degraded, acting [5,3] 2023-10-18T21:00:01.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000675+0000 mon.smithi008 (mon.0) 133 : cluster [WRN] pg 3.f is active+undersized+degraded, acting [5,3] 2023-10-18T21:00:01.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000691+0000 mon.smithi008 (mon.0) 134 : cluster [WRN] pg 3.10 is active+undersized+degraded, acting [5,1] 2023-10-18T21:00:01.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000710+0000 mon.smithi008 (mon.0) 135 : cluster [WRN] pg 3.11 is active+undersized+degraded, acting [3,4] 2023-10-18T21:00:01.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000728+0000 mon.smithi008 (mon.0) 136 : cluster [WRN] pg 3.12 is active+undersized+degraded, acting [3,1] 2023-10-18T21:00:01.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000745+0000 mon.smithi008 (mon.0) 137 : cluster [WRN] pg 3.15 is active+undersized+degraded, acting [3,4] 2023-10-18T21:00:01.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000759+0000 mon.smithi008 (mon.0) 138 : cluster [WRN] pg 3.17 is active+undersized+degraded, acting [5,2] 2023-10-18T21:00:01.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000775+0000 mon.smithi008 (mon.0) 139 : cluster [WRN] pg 3.18 is active+undersized+degraded, acting [2,1] 2023-10-18T21:00:01.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000789+0000 mon.smithi008 (mon.0) 140 : cluster [WRN] pg 3.1b is active+undersized+degraded, acting [4,3] 2023-10-18T21:00:01.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.000808+0000 mon.smithi008 (mon.0) 141 : cluster [WRN] pg 3.1f is active+undersized+degraded, acting [3,2] 2023-10-18T21:00:01.186 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.137568+0000 mgr.smithi008.flmjzp (mgr.14640) 84 : cluster [DBG] pgmap v56: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 354 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 225 op/s; 7060/47223 objects degraded (14.950%) 2023-10-18T21:00:01.186 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:00.440825+0000 mon.smithi008 (mon.0) 142 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:00:01.186 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:00.827884+0000 mon.smithi008 (mon.0) 143 : cluster [DBG] osdmap e53: 6 total, 6 up, 6 in 2023-10-18T21:00:03.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:02.138059+0000 mgr.smithi008.flmjzp (mgr.14640) 85 : cluster [DBG] pgmap v58: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 activating, 1 active+recovering, 11 active+recovery_wait+degraded, 50 active+clean; 352 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 308 op/s; 1088/43683 objects degraded (2.491%); 2.2 MiB/s, 23 objects/s recovering 2023-10-18T21:00:03.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:02.145068+0000 mon.smithi008 (mon.0) 144 : cluster [DBG] mgrmap e30: smithi008.flmjzp(active, since 93s), standbys: smithi060.pgqqwa 2023-10-18T21:00:03.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:02.138059+0000 mgr.smithi008.flmjzp (mgr.14640) 85 : cluster [DBG] pgmap v58: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 activating, 1 active+recovering, 11 active+recovery_wait+degraded, 50 active+clean; 352 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 308 op/s; 1088/43683 objects degraded (2.491%); 2.2 MiB/s, 23 objects/s recovering 2023-10-18T21:00:03.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:02.145068+0000 mon.smithi008 (mon.0) 144 : cluster [DBG] mgrmap e30: smithi008.flmjzp(active, since 93s), standbys: smithi060.pgqqwa 2023-10-18T21:00:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:04.138426+0000 mgr.smithi008.flmjzp (mgr.14640) 86 : cluster [DBG] pgmap v59: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 activating, 1 active+recovering, 11 active+recovery_wait+degraded, 50 active+clean; 352 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 776 KiB/s rd, 804 KiB/s wr, 221 op/s; 1088/43683 objects degraded (2.491%); 1.6 MiB/s, 16 objects/s recovering 2023-10-18T21:00:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:04.819825+0000 mon.smithi008 (mon.0) 145 : cluster [WRN] Health check update: Degraded data redundancy: 1088/43683 objects degraded (2.491%), 13 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:04.138426+0000 mgr.smithi008.flmjzp (mgr.14640) 86 : cluster [DBG] pgmap v59: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 activating, 1 active+recovering, 11 active+recovery_wait+degraded, 50 active+clean; 352 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 776 KiB/s rd, 804 KiB/s wr, 221 op/s; 1088/43683 objects degraded (2.491%); 1.6 MiB/s, 16 objects/s recovering 2023-10-18T21:00:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:04.819825+0000 mon.smithi008 (mon.0) 145 : cluster [WRN] Health check update: Degraded data redundancy: 1088/43683 objects degraded (2.491%), 13 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:06.138887+0000 mgr.smithi008.flmjzp (mgr.14640) 87 : cluster [DBG] pgmap v60: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 11 active+recovery_wait+degraded, 52 active+clean; 351 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 642 KiB/s rd, 665 KiB/s wr, 206 op/s; 1088/43170 objects degraded (2.520%); 1.3 MiB/s, 21 objects/s recovering 2023-10-18T21:00:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:06.138887+0000 mgr.smithi008.flmjzp (mgr.14640) 87 : cluster [DBG] pgmap v60: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 11 active+recovery_wait+degraded, 52 active+clean; 351 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 642 KiB/s rd, 665 KiB/s wr, 206 op/s; 1088/43170 objects degraded (2.520%); 1.3 MiB/s, 21 objects/s recovering 2023-10-18T21:00:08.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:08.043881+0000 mon.smithi008 (mon.0) 146 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:08.043881+0000 mon.smithi008 (mon.0) 146 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:08.044098+0000 mgr.smithi008.flmjzp (mgr.14640) 88 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:00:08.045089+0000 mgr.smithi008.flmjzp (mgr.14640) 89 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2023-10-18T21:00:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:08.139436+0000 mgr.smithi008.flmjzp (mgr.14640) 90 : cluster [DBG] pgmap v61: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 10 active+recovery_wait+degraded, 52 active+clean; 348 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 334 op/s; 998/39867 objects degraded (2.503%); 1.1 MiB/s, 19 objects/s recovering 2023-10-18T21:00:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:08.044098+0000 mgr.smithi008.flmjzp (mgr.14640) 88 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:00:08.045089+0000 mgr.smithi008.flmjzp (mgr.14640) 89 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2023-10-18T21:00:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:08.139436+0000 mgr.smithi008.flmjzp (mgr.14640) 90 : cluster [DBG] pgmap v61: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 10 active+recovery_wait+degraded, 52 active+clean; 348 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 334 op/s; 998/39867 objects degraded (2.503%); 1.1 MiB/s, 19 objects/s recovering 2023-10-18T21:00:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:09.821260+0000 mon.smithi008 (mon.0) 147 : cluster [WRN] Health check update: Degraded data redundancy: 998/39867 objects degraded (2.503%), 12 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:09.821260+0000 mon.smithi008 (mon.0) 147 : cluster [WRN] Health check update: Degraded data redundancy: 998/39867 objects degraded (2.503%), 12 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:10.139790+0000 mgr.smithi008.flmjzp (mgr.14640) 91 : cluster [DBG] pgmap v62: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 10 active+recovery_wait+degraded, 52 active+clean; 348 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 277 op/s; 998/39867 objects degraded (2.503%); 974 KiB/s, 16 objects/s recovering 2023-10-18T21:00:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:10.139790+0000 mgr.smithi008.flmjzp (mgr.14640) 91 : cluster [DBG] pgmap v62: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 10 active+recovery_wait+degraded, 52 active+clean; 348 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 277 op/s; 998/39867 objects degraded (2.503%); 974 KiB/s, 16 objects/s recovering 2023-10-18T21:00:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:12.140267+0000 mgr.smithi008.flmjzp (mgr.14640) 92 : cluster [DBG] pgmap v63: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 10 active+recovery_wait+degraded, 52 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 347 op/s; 998/36861 objects degraded (2.707%); 861 KiB/s, 19 objects/s recovering 2023-10-18T21:00:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:12.140267+0000 mgr.smithi008.flmjzp (mgr.14640) 92 : cluster [DBG] pgmap v63: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 10 active+recovery_wait+degraded, 52 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 347 op/s; 998/36861 objects degraded (2.707%); 861 KiB/s, 19 objects/s recovering 2023-10-18T21:00:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:14.140886+0000 mgr.smithi008.flmjzp (mgr.14640) 93 : cluster [DBG] pgmap v64: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 10 active+recovery_wait+degraded, 52 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 216 op/s; 998/36861 objects degraded (2.707%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:14.822615+0000 mon.smithi008 (mon.0) 148 : cluster [WRN] Health check update: Degraded data redundancy: 998/36861 objects degraded (2.707%), 12 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:14.140886+0000 mgr.smithi008.flmjzp (mgr.14640) 93 : cluster [DBG] pgmap v64: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 10 active+recovery_wait+degraded, 52 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 216 op/s; 998/36861 objects degraded (2.707%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:14.822615+0000 mon.smithi008 (mon.0) 148 : cluster [WRN] Health check update: Degraded data redundancy: 998/36861 objects degraded (2.707%), 12 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:16.141548+0000 mgr.smithi008.flmjzp (mgr.14640) 94 : cluster [DBG] pgmap v65: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 10 active+recovery_wait+degraded, 52 active+clean; 344 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 231 op/s; 998/36318 objects degraded (2.748%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:16.141548+0000 mgr.smithi008.flmjzp (mgr.14640) 94 : cluster [DBG] pgmap v65: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 10 active+recovery_wait+degraded, 52 active+clean; 344 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 231 op/s; 998/36318 objects degraded (2.748%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:18.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.185+0000 7f021cfa9700 1 -- 172.21.15.8:0/1364082137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02180f64b0 msgr2=0x7f02180f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:18.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.185+0000 7f021cfa9700 1 --2- 172.21.15.8:0/1364082137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02180f64b0 0x7f02180f68d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f02080047e0 tx=0x7f0208009ad0).stop 2023-10-18T21:00:18.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.185+0000 7f021cfa9700 1 -- 172.21.15.8:0/1364082137 shutdown_connections 2023-10-18T21:00:18.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.185+0000 7f021cfa9700 1 --2- 172.21.15.8:0/1364082137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02180f7750 0x7f02180f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.185+0000 7f021cfa9700 1 --2- 172.21.15.8:0/1364082137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02180f64b0 0x7f02180f68d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.185+0000 7f021cfa9700 1 -- 172.21.15.8:0/1364082137 >> 172.21.15.8:0/1364082137 conn(0x7f02180f1c30 msgr2=0x7f02180f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:18.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.185+0000 7f021cfa9700 1 -- 172.21.15.8:0/1364082137 shutdown_connections 2023-10-18T21:00:18.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.185+0000 7f021cfa9700 1 -- 172.21.15.8:0/1364082137 wait complete. 2023-10-18T21:00:18.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.186+0000 7f021cfa9700 1 Processor -- start 2023-10-18T21:00:18.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.186+0000 7f021cfa9700 1 -- start start 2023-10-18T21:00:18.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.187+0000 7f021cfa9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02180f64b0 0x7f021806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:18.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.187+0000 7f021cfa9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02180f7750 0x7f0218069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:18.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.187+0000 7f021cfa9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021806a380 con 0x7f02180f64b0 2023-10-18T21:00:18.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.187+0000 7f021cfa9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021806a4c0 con 0x7f02180f7750 2023-10-18T21:00:18.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.187+0000 7f02177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02180f64b0 0x7f021806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:18.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.187+0000 7f02177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02180f64b0 0x7f021806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47730/0 (socket says 172.21.15.8:47730) 2023-10-18T21:00:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.187+0000 7f02177fe700 1 -- 172.21.15.8:0/2779476546 learned_addr learned my addr 172.21.15.8:0/2779476546 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.187+0000 7f0216ffd700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02180f7750 0x7f0218069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.188+0000 7f02177fe700 1 -- 172.21.15.8:0/2779476546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02180f7750 msgr2=0x7f0218069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:18.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.188+0000 7f02177fe700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02180f7750 0x7f0218069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.188+0000 7f02177fe700 1 -- 172.21.15.8:0/2779476546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208009d70 con 0x7f02180f64b0 2023-10-18T21:00:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.188+0000 7f02177fe700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02180f64b0 0x7f021806b9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0208005010 tx=0x7f0208009ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.188+0000 7f01fffff700 1 -- 172.21.15.8:0/2779476546 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020801a070 con 0x7f02180f64b0 2023-10-18T21:00:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.188+0000 7f01fffff700 1 -- 172.21.15.8:0/2779476546 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0208007e20 con 0x7f02180f64b0 2023-10-18T21:00:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.188+0000 7f021cfa9700 1 -- 172.21.15.8:0/2779476546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021806a740 con 0x7f02180f64b0 2023-10-18T21:00:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.188+0000 7f01fffff700 1 -- 172.21.15.8:0/2779476546 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020800e040 con 0x7f02180f64b0 2023-10-18T21:00:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.188+0000 7f021cfa9700 1 -- 172.21.15.8:0/2779476546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021806aca0 con 0x7f02180f64b0 2023-10-18T21:00:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.189+0000 7f021cfa9700 1 -- 172.21.15.8:0/2779476546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0218045ad0 con 0x7f02180f64b0 2023-10-18T21:00:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.190+0000 7f01fffff700 1 -- 172.21.15.8:0/2779476546 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0208014420 con 0x7f02180f64b0 2023-10-18T21:00:18.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.191+0000 7f01fffff700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0200060f70 0x7f0200063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:18.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.191+0000 7f01fffff700 1 -- 172.21.15.8:0/2779476546 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f020807d5d0 con 0x7f02180f64b0 2023-10-18T21:00:18.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.191+0000 7f0216ffd700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0200060f70 0x7f0200063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:18.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.192+0000 7f0216ffd700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0200060f70 0x7f0200063430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f020c009fd0 tx=0x7f020c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:18.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.196+0000 7f01fffff700 1 -- 172.21.15.8:0/2779476546 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f020804d9a0 con 0x7f02180f64b0 2023-10-18T21:00:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.395+0000 7f021cfa9700 1 -- 172.21.15.8:0/2779476546 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02180feda0 con 0x7f0200060f70 2023-10-18T21:00:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.396+0000 7f01fffff700 1 -- 172.21.15.8:0/2779476546 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f02180feda0 con 0x7f0200060f70 2023-10-18T21:00:18.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 -- 172.21.15.8:0/2779476546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0200060f70 msgr2=0x7f0200063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:18.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0200060f70 0x7f0200063430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f020c009fd0 tx=0x7f020c00b040).stop 2023-10-18T21:00:18.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 -- 172.21.15.8:0/2779476546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02180f64b0 msgr2=0x7f021806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:18.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02180f64b0 0x7f021806b9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0208005010 tx=0x7f0208009ad0).stop 2023-10-18T21:00:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 -- 172.21.15.8:0/2779476546 shutdown_connections 2023-10-18T21:00:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0200060f70 0x7f0200063430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02180f64b0 0x7f021806b9a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 --2- 172.21.15.8:0/2779476546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02180f7750 0x7f0218069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 -- 172.21.15.8:0/2779476546 >> 172.21.15.8:0/2779476546 conn(0x7f02180f1c30 msgr2=0x7f02180fb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 -- 172.21.15.8:0/2779476546 shutdown_connections 2023-10-18T21:00:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.398+0000 7f021cfa9700 1 -- 172.21.15.8:0/2779476546 wait complete. 2023-10-18T21:00:18.416 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:00:18.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.539+0000 7efd969fa700 1 -- 172.21.15.8:0/3925898103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd900f6530 msgr2=0x7efd900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:18.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.539+0000 7efd969fa700 1 --2- 172.21.15.8:0/3925898103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd900f6530 0x7efd900f6950 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7efd8c004660 tx=0x7efd8c009b30).stop 2023-10-18T21:00:18.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.539+0000 7efd969fa700 1 -- 172.21.15.8:0/3925898103 shutdown_connections 2023-10-18T21:00:18.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.539+0000 7efd969fa700 1 --2- 172.21.15.8:0/3925898103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd900f77d0 0x7efd900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.539+0000 7efd969fa700 1 --2- 172.21.15.8:0/3925898103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd900f6530 0x7efd900f6950 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.539+0000 7efd969fa700 1 -- 172.21.15.8:0/3925898103 >> 172.21.15.8:0/3925898103 conn(0x7efd900f1c90 msgr2=0x7efd900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:18.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.539+0000 7efd969fa700 1 -- 172.21.15.8:0/3925898103 shutdown_connections 2023-10-18T21:00:18.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.539+0000 7efd969fa700 1 -- 172.21.15.8:0/3925898103 wait complete. 2023-10-18T21:00:18.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.541+0000 7efd969fa700 1 Processor -- start 2023-10-18T21:00:18.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.541+0000 7efd969fa700 1 -- start start 2023-10-18T21:00:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.541+0000 7efd969fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd900f6530 0x7efd9006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.541+0000 7efd969fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd900f77d0 0x7efd90069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.541+0000 7efd969fa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9006a380 con 0x7efd900f77d0 2023-10-18T21:00:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.541+0000 7efd969fa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9006a4c0 con 0x7efd900f6530 2023-10-18T21:00:18.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.542+0000 7efd951f7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd900f77d0 0x7efd90069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.542+0000 7efd959f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd900f6530 0x7efd9006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.542+0000 7efd951f7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd900f77d0 0x7efd90069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47738/0 (socket says 172.21.15.8:47738) 2023-10-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.542+0000 7efd951f7700 1 -- 172.21.15.8:0/1622142105 learned_addr learned my addr 172.21.15.8:0/1622142105 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.542+0000 7efd951f7700 1 -- 172.21.15.8:0/1622142105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd900f6530 msgr2=0x7efd9006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.542+0000 7efd951f7700 1 --2- 172.21.15.8:0/1622142105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd900f6530 0x7efd9006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.542+0000 7efd951f7700 1 -- 172.21.15.8:0/1622142105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c005040 con 0x7efd900f77d0 2023-10-18T21:00:18.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.542+0000 7efd951f7700 1 --2- 172.21.15.8:0/1622142105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd900f77d0 0x7efd90069e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efd8000e7f0 tx=0x7efd8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:18.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.543+0000 7efd867fc700 1 -- 172.21.15.8:0/1622142105 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd800092e0 con 0x7efd900f77d0 2023-10-18T21:00:18.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.543+0000 7efd867fc700 1 -- 172.21.15.8:0/1622142105 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efd8000f040 con 0x7efd900f77d0 2023-10-18T21:00:18.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.543+0000 7efd969fa700 1 -- 172.21.15.8:0/1622142105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9006a7a0 con 0x7efd900f77d0 2023-10-18T21:00:18.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.543+0000 7efd867fc700 1 -- 172.21.15.8:0/1622142105 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd800147e0 con 0x7efd900f77d0 2023-10-18T21:00:18.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.543+0000 7efd969fa700 1 -- 172.21.15.8:0/1622142105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9010ed60 con 0x7efd900f77d0 2023-10-18T21:00:18.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.544+0000 7efd969fa700 1 -- 172.21.15.8:0/1622142105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd90059100 con 0x7efd900f77d0 2023-10-18T21:00:18.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.545+0000 7efd867fc700 1 -- 172.21.15.8:0/1622142105 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7efd8001b030 con 0x7efd900f77d0 2023-10-18T21:00:18.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.545+0000 7efd867fc700 1 --2- 172.21.15.8:0/1622142105 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 0x7efd7c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:18.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.546+0000 7efd867fc700 1 -- 172.21.15.8:0/1622142105 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7efd8007bfe0 con 0x7efd900f77d0 2023-10-18T21:00:18.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.546+0000 7efd959f8700 1 --2- 172.21.15.8:0/1622142105 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 0x7efd7c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:18.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.546+0000 7efd959f8700 1 --2- 172.21.15.8:0/1622142105 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 0x7efd7c063430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7efd8c004d80 tx=0x7efd8c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:18.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.550+0000 7efd867fc700 1 -- 172.21.15.8:0/1622142105 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efd800aaf20 con 0x7efd900f77d0 2023-10-18T21:00:18.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.752+0000 7efd969fa700 1 -- 172.21.15.8:0/1622142105 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd900fed80 con 0x7efd7c060f70 2023-10-18T21:00:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.753+0000 7efd867fc700 1 -- 172.21.15.8:0/1622142105 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efd900fed80 con 0x7efd7c060f70 2023-10-18T21:00:18.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.755+0000 7efd969fa700 1 -- 172.21.15.8:0/1622142105 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 msgr2=0x7efd7c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:18.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.755+0000 7efd969fa700 1 --2- 172.21.15.8:0/1622142105 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 0x7efd7c063430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7efd8c004d80 tx=0x7efd8c016040).stop 2023-10-18T21:00:18.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.755+0000 7efd969fa700 1 -- 172.21.15.8:0/1622142105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd900f77d0 msgr2=0x7efd90069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:18.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.755+0000 7efd969fa700 1 --2- 172.21.15.8:0/1622142105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd900f77d0 0x7efd90069e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efd8000e7f0 tx=0x7efd8000b040).stop 2023-10-18T21:00:18.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.755+0000 7efd969fa700 1 -- 172.21.15.8:0/1622142105 shutdown_connections 2023-10-18T21:00:18.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.755+0000 7efd969fa700 1 --2- 172.21.15.8:0/1622142105 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 0x7efd7c063430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.755+0000 7efd969fa700 1 --2- 172.21.15.8:0/1622142105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd900f6530 0x7efd9006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.755+0000 7efd969fa700 1 --2- 172.21.15.8:0/1622142105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd900f77d0 0x7efd90069e20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.755+0000 7efd969fa700 1 -- 172.21.15.8:0/1622142105 >> 172.21.15.8:0/1622142105 conn(0x7efd900f1c90 msgr2=0x7efd900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:18.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.755+0000 7efd969fa700 1 -- 172.21.15.8:0/1622142105 shutdown_connections 2023-10-18T21:00:18.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.756+0000 7efd969fa700 1 -- 172.21.15.8:0/1622142105 wait complete. 2023-10-18T21:00:18.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.894+0000 7f69357ee700 1 -- 172.21.15.8:0/1826782917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693006a3b0 msgr2=0x7f693006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:18.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.894+0000 7f69357ee700 1 --2- 172.21.15.8:0/1826782917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693006a3b0 0x7f693006a830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f6924004660 tx=0x7f6924009b30).stop 2023-10-18T21:00:18.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.894+0000 7f69357ee700 1 -- 172.21.15.8:0/1826782917 shutdown_connections 2023-10-18T21:00:18.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.894+0000 7f69357ee700 1 --2- 172.21.15.8:0/1826782917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693006a3b0 0x7f693006a830 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.894+0000 7f69357ee700 1 --2- 172.21.15.8:0/1826782917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f693006b9c0 0x7f6930069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.894+0000 7f69357ee700 1 -- 172.21.15.8:0/1826782917 >> 172.21.15.8:0/1826782917 conn(0x7f69300f1c90 msgr2=0x7f69300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:18.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.894+0000 7f69357ee700 1 -- 172.21.15.8:0/1826782917 shutdown_connections 2023-10-18T21:00:18.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.894+0000 7f69357ee700 1 -- 172.21.15.8:0/1826782917 wait complete. 2023-10-18T21:00:18.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.895+0000 7f69357ee700 1 Processor -- start 2023-10-18T21:00:18.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.895+0000 7f69357ee700 1 -- start start 2023-10-18T21:00:18.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.896+0000 7f69357ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693006a3b0 0x7f6930108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:18.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.896+0000 7f69357ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f693006b9c0 0x7f69301093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:18.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.896+0000 7f69357ee700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6930109970 con 0x7f693006a3b0 2023-10-18T21:00:18.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.896+0000 7f69357ee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6930109ab0 con 0x7f693006b9c0 2023-10-18T21:00:18.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.896+0000 7f692ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693006a3b0 0x7f6930108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.896+0000 7f692ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693006a3b0 0x7f6930108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47756/0 (socket says 172.21.15.8:47756) 2023-10-18T21:00:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.896+0000 7f692ffff700 1 -- 172.21.15.8:0/2724102554 learned_addr learned my addr 172.21.15.8:0/2724102554 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.896+0000 7f692f7fe700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f693006b9c0 0x7f69301093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.897+0000 7f692ffff700 1 -- 172.21.15.8:0/2724102554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f693006b9c0 msgr2=0x7f69301093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.897+0000 7f692ffff700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f693006b9c0 0x7f69301093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.897+0000 7f692ffff700 1 -- 172.21.15.8:0/2724102554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6924005040 con 0x7f693006a3b0 2023-10-18T21:00:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.897+0000 7f692ffff700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693006a3b0 0x7f6930108ed0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f692000e7f0 tx=0x7f692000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:18.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.897+0000 7f692cff9700 1 -- 172.21.15.8:0/2724102554 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69200092e0 con 0x7f693006a3b0 2023-10-18T21:00:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.897+0000 7f692cff9700 1 -- 172.21.15.8:0/2724102554 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f692000f040 con 0x7f693006a3b0 2023-10-18T21:00:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.897+0000 7f69357ee700 1 -- 172.21.15.8:0/2724102554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693010a450 con 0x7f693006a3b0 2023-10-18T21:00:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.897+0000 7f69357ee700 1 -- 172.21.15.8:0/2724102554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693010a990 con 0x7f693006a3b0 2023-10-18T21:00:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.897+0000 7f692cff9700 1 -- 172.21.15.8:0/2724102554 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69200147e0 con 0x7f693006a3b0 2023-10-18T21:00:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.899+0000 7f69357ee700 1 -- 172.21.15.8:0/2724102554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6930045ad0 con 0x7f693006a3b0 2023-10-18T21:00:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.901+0000 7f692cff9700 1 -- 172.21.15.8:0/2724102554 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f692001b030 con 0x7f693006a3b0 2023-10-18T21:00:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.901+0000 7f692cff9700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6918060f70 0x7f6918063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.902+0000 7f692cff9700 1 -- 172.21.15.8:0/2724102554 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f692007bef0 con 0x7f693006a3b0 2023-10-18T21:00:18.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.902+0000 7f692f7fe700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6918060f70 0x7f6918063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:18.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.902+0000 7f692f7fe700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6918060f70 0x7f6918063430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6924005010 tx=0x7f6924016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:18.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:18.905+0000 7f692cff9700 1 -- 172.21.15.8:0/2724102554 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f692004fea0 con 0x7f693006a3b0 2023-10-18T21:00:19.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.169+0000 7f69357ee700 1 -- 172.21.15.8:0/2724102554 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f693010ac00 con 0x7f6918060f70 2023-10-18T21:00:19.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.180+0000 7f692cff9700 1 -- 172.21.15.8:0/2724102554 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f693010ac00 con 0x7f6918060f70 2023-10-18T21:00:19.183 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:00:19.183 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (6m) 26s ago 8m 15.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:00:19.183 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (51s) 26s ago 8m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:00:19.183 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (47s) 43s ago 7m 7566k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:00:19.183 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (6m) 26s ago 8m 25.0M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:00:19.183 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (4m) 26s ago 4m 5328M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T21:00:19.184 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (4m) 26s ago 4m 692M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T21:00:19.184 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (4m) 43s ago 4m 2598M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:00:19.184 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (4m) 43s ago 4m 373M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:00:19.184 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (2m) 26s ago 9m 445M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:00:19.184 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (89s) 43s ago 7m 394M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:00:19.185 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (79s) 26s ago 9m 53.2M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:00:19.185 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (67s) 43s ago 7m 39.6M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:00:19.185 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (7m) 26s ago 7m 9499k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:00:19.185 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (7m) 43s ago 7m 9903k - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:00:19.185 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (33s) 26s ago 7m 10.7M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:00:19.186 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (6m) 26s ago 6m 764M 4096M 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T21:00:19.186 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (6m) 26s ago 6m 659M 4096M 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T21:00:19.186 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (6m) 43s ago 6m 856M 4096M 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T21:00:19.186 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (5m) 43s ago 5m 709M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T21:00:19.186 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (5m) 43s ago 5m 745M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T21:00:19.187 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (2m) 26s ago 7m 52.3M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:00:19.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 -- 172.21.15.8:0/2724102554 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6918060f70 msgr2=0x7f6918063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:19.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6918060f70 0x7f6918063430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6924005010 tx=0x7f6924016040).stop 2023-10-18T21:00:19.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 -- 172.21.15.8:0/2724102554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693006a3b0 msgr2=0x7f6930108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:19.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693006a3b0 0x7f6930108ed0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f692000e7f0 tx=0x7f692000b040).stop 2023-10-18T21:00:19.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 -- 172.21.15.8:0/2724102554 shutdown_connections 2023-10-18T21:00:19.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6918060f70 0x7f6918063430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693006a3b0 0x7f6930108ed0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 --2- 172.21.15.8:0/2724102554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f693006b9c0 0x7f69301093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 -- 172.21.15.8:0/2724102554 >> 172.21.15.8:0/2724102554 conn(0x7f69300f1c90 msgr2=0x7f69300fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:19.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 -- 172.21.15.8:0/2724102554 shutdown_connections 2023-10-18T21:00:19.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.182+0000 7f69357ee700 1 -- 172.21.15.8:0/2724102554 wait complete. 2023-10-18T21:00:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.318+0000 7f8b009ba700 1 -- 172.21.15.8:0/3469178221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8afc060310 msgr2=0x7f8afc0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.318+0000 7f8b009ba700 1 --2- 172.21.15.8:0/3469178221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8afc060310 0x7f8afc0f9110 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8aec004660 tx=0x7f8aec009b30).stop 2023-10-18T21:00:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.318+0000 7f8b009ba700 1 -- 172.21.15.8:0/3469178221 shutdown_connections 2023-10-18T21:00:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.318+0000 7f8b009ba700 1 --2- 172.21.15.8:0/3469178221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8afc0f9690 0x7f8afc0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.318+0000 7f8b009ba700 1 --2- 172.21.15.8:0/3469178221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8afc060310 0x7f8afc0f9110 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.318+0000 7f8b009ba700 1 -- 172.21.15.8:0/3469178221 >> 172.21.15.8:0/3469178221 conn(0x7f8afc0f0b90 msgr2=0x7f8afc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.318+0000 7f8b009ba700 1 -- 172.21.15.8:0/3469178221 shutdown_connections 2023-10-18T21:00:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.318+0000 7f8b009ba700 1 -- 172.21.15.8:0/3469178221 wait complete. 2023-10-18T21:00:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.319+0000 7f8b009ba700 1 Processor -- start 2023-10-18T21:00:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.319+0000 7f8b009ba700 1 -- start start 2023-10-18T21:00:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8b009ba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8afc060310 0x7f8afc108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8b009ba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8afc0f9690 0x7f8afc1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8b009ba700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc109970 con 0x7f8afc0f9690 2023-10-18T21:00:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8b009ba700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc109ab0 con 0x7f8afc060310 2023-10-18T21:00:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8afa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8afc0f9690 0x7f8afc1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8afa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8afc0f9690 0x7f8afc1093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47764/0 (socket says 172.21.15.8:47764) 2023-10-18T21:00:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8afa59c700 1 -- 172.21.15.8:0/2927950761 learned_addr learned my addr 172.21.15.8:0/2927950761 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8afad9d700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8afc060310 0x7f8afc108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8afa59c700 1 -- 172.21.15.8:0/2927950761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8afc060310 msgr2=0x7f8afc108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8afa59c700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8afc060310 0x7f8afc108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.320+0000 7f8afa59c700 1 -- 172.21.15.8:0/2927950761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec005040 con 0x7f8afc0f9690 2023-10-18T21:00:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.321+0000 7f8afa59c700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8afc0f9690 0x7f8afc1093c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8af000e7c0 tx=0x7f8af000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.321+0000 7f8ae37fe700 1 -- 172.21.15.8:0/2927950761 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8af00092e0 con 0x7f8afc0f9690 2023-10-18T21:00:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.321+0000 7f8ae37fe700 1 -- 172.21.15.8:0/2927950761 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8af000f040 con 0x7f8afc0f9690 2023-10-18T21:00:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.321+0000 7f8ae37fe700 1 -- 172.21.15.8:0/2927950761 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8af00147e0 con 0x7f8afc0f9690 2023-10-18T21:00:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.321+0000 7f8b009ba700 1 -- 172.21.15.8:0/2927950761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8afc10a450 con 0x7f8afc0f9690 2023-10-18T21:00:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.321+0000 7f8b009ba700 1 -- 172.21.15.8:0/2927950761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8afc10a990 con 0x7f8afc0f9690 2023-10-18T21:00:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.322+0000 7f8b009ba700 1 -- 172.21.15.8:0/2927950761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8afc045ad0 con 0x7f8afc0f9690 2023-10-18T21:00:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.323+0000 7f8ae37fe700 1 -- 172.21.15.8:0/2927950761 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8af0014a10 con 0x7f8afc0f9690 2023-10-18T21:00:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.324+0000 7f8ae37fe700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ae4060f70 0x7f8ae4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:19.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.324+0000 7f8ae37fe700 1 -- 172.21.15.8:0/2927950761 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f8af007c3e0 con 0x7f8afc0f9690 2023-10-18T21:00:19.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.324+0000 7f8afad9d700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ae4060f70 0x7f8ae4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:19.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.325+0000 7f8afad9d700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ae4060f70 0x7f8ae4063430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8aec009720 tx=0x7f8aec016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:19.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.328+0000 7f8ae37fe700 1 -- 172.21.15.8:0/2927950761 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8af00501a0 con 0x7f8afc0f9690 2023-10-18T21:00:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:18.142196+0000 mgr.smithi008.flmjzp (mgr.14640) 95 : cluster [DBG] pgmap v66: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 9 active+recovery_wait+degraded, 53 active+clean; 339 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 336 op/s; 898/32451 objects degraded (2.767%); 0 B/s, 10 objects/s recovering 2023-10-18T21:00:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:18.397436+0000 mgr.smithi008.flmjzp (mgr.14640) 96 : audit [DBG] from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.586+0000 7f8b009ba700 1 -- 172.21.15.8:0/2927950761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8afc10f4f0 con 0x7f8afc0f9690 2023-10-18T21:00:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.587+0000 7f8ae37fe700 1 -- 172.21.15.8:0/2927950761 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7f8af004fd90 con 0x7f8afc0f9690 2023-10-18T21:00:19.590 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:00:19.590 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:00:19.590 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:00:19.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:00:19.591 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:00:19.591 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:00:19.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:00:19.591 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:00:19.591 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1, 2023-10-18T21:00:19.592 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2023-10-18T21:00:19.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:00:19.592 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:00:19.592 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T21:00:19.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:00:19.593 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:00:19.593 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 5, 2023-10-18T21:00:19.593 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9 2023-10-18T21:00:19.593 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:00:19.593 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:00:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 -- 172.21.15.8:0/2927950761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ae4060f70 msgr2=0x7f8ae4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ae4060f70 0x7f8ae4063430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8aec009720 tx=0x7f8aec016040).stop 2023-10-18T21:00:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 -- 172.21.15.8:0/2927950761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8afc0f9690 msgr2=0x7f8afc1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8afc0f9690 0x7f8afc1093c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8af000e7c0 tx=0x7f8af000b040).stop 2023-10-18T21:00:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 -- 172.21.15.8:0/2927950761 shutdown_connections 2023-10-18T21:00:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ae4060f70 0x7f8ae4063430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8afc060310 0x7f8afc108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 --2- 172.21.15.8:0/2927950761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8afc0f9690 0x7f8afc1093c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 -- 172.21.15.8:0/2927950761 >> 172.21.15.8:0/2927950761 conn(0x7f8afc0f0b90 msgr2=0x7f8afc0f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 -- 172.21.15.8:0/2927950761 shutdown_connections 2023-10-18T21:00:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.589+0000 7f8b009ba700 1 -- 172.21.15.8:0/2927950761 wait complete. 2023-10-18T21:00:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:18.142196+0000 mgr.smithi008.flmjzp (mgr.14640) 95 : cluster [DBG] pgmap v66: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 9 active+recovery_wait+degraded, 53 active+clean; 339 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 336 op/s; 898/32451 objects degraded (2.767%); 0 B/s, 10 objects/s recovering 2023-10-18T21:00:19.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:18.397436+0000 mgr.smithi008.flmjzp (mgr.14640) 96 : audit [DBG] from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:19.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.749+0000 7ff88ffff700 1 -- 172.21.15.8:0/2662662254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8900f77d0 msgr2=0x7ff8900f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:19.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.749+0000 7ff88ffff700 1 --2- 172.21.15.8:0/2662662254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8900f77d0 0x7ff8900f7c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7ff884004660 tx=0x7ff884009b30).stop 2023-10-18T21:00:19.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.749+0000 7ff88ffff700 1 -- 172.21.15.8:0/2662662254 shutdown_connections 2023-10-18T21:00:19.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.749+0000 7ff88ffff700 1 --2- 172.21.15.8:0/2662662254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8900f77d0 0x7ff8900f7c30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.749+0000 7ff88ffff700 1 --2- 172.21.15.8:0/2662662254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8900f6530 0x7ff8900f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.749+0000 7ff88ffff700 1 -- 172.21.15.8:0/2662662254 >> 172.21.15.8:0/2662662254 conn(0x7ff8900f1c90 msgr2=0x7ff8900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:19.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.749+0000 7ff88ffff700 1 -- 172.21.15.8:0/2662662254 shutdown_connections 2023-10-18T21:00:19.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.749+0000 7ff88ffff700 1 -- 172.21.15.8:0/2662662254 wait complete. 2023-10-18T21:00:19.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.750+0000 7ff88ffff700 1 Processor -- start 2023-10-18T21:00:19.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.751+0000 7ff88ffff700 1 -- start start 2023-10-18T21:00:19.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.751+0000 7ff88ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8900f6530 0x7ff89006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:19.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.751+0000 7ff88ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8900f77d0 0x7ff890069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:19.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.751+0000 7ff88ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89006a380 con 0x7ff8900f6530 2023-10-18T21:00:19.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.751+0000 7ff88ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89006a4c0 con 0x7ff8900f77d0 2023-10-18T21:00:19.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.752+0000 7ff88effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8900f6530 0x7ff89006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:19.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.752+0000 7ff88e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8900f77d0 0x7ff890069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:19.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.752+0000 7ff88effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8900f6530 0x7ff89006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47782/0 (socket says 172.21.15.8:47782) 2023-10-18T21:00:19.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.752+0000 7ff88e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8900f77d0 0x7ff890069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:54576/0 (socket says 172.21.15.8:54576) 2023-10-18T21:00:19.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.752+0000 7ff88effd700 1 -- 172.21.15.8:0/3737522896 learned_addr learned my addr 172.21.15.8:0/3737522896 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:19.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.752+0000 7ff88effd700 1 -- 172.21.15.8:0/3737522896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8900f77d0 msgr2=0x7ff890069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:19.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.752+0000 7ff88effd700 1 --2- 172.21.15.8:0/3737522896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8900f77d0 0x7ff890069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:19.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.752+0000 7ff88effd700 1 -- 172.21.15.8:0/3737522896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884005040 con 0x7ff8900f6530 2023-10-18T21:00:19.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.752+0000 7ff88effd700 1 --2- 172.21.15.8:0/3737522896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8900f6530 0x7ff89006b9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff88000e7c0 tx=0x7ff88000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:19.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.753+0000 7ff8777fe700 1 -- 172.21.15.8:0/3737522896 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8800092e0 con 0x7ff8900f6530 2023-10-18T21:00:19.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.753+0000 7ff8777fe700 1 -- 172.21.15.8:0/3737522896 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff88000f040 con 0x7ff8900f6530 2023-10-18T21:00:19.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.753+0000 7ff8777fe700 1 -- 172.21.15.8:0/3737522896 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff880014810 con 0x7ff8900f6530 2023-10-18T21:00:19.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.753+0000 7ff88ffff700 1 -- 172.21.15.8:0/3737522896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89006a7a0 con 0x7ff8900f6530 2023-10-18T21:00:19.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.753+0000 7ff88ffff700 1 -- 172.21.15.8:0/3737522896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89006ac90 con 0x7ff8900f6530 2023-10-18T21:00:19.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.754+0000 7ff88ffff700 1 -- 172.21.15.8:0/3737522896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff890045ad0 con 0x7ff8900f6530 2023-10-18T21:00:19.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.756+0000 7ff8777fe700 1 -- 172.21.15.8:0/3737522896 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff88001b030 con 0x7ff8900f6530 2023-10-18T21:00:19.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.756+0000 7ff8777fe700 1 --2- 172.21.15.8:0/3737522896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff878060f70 0x7ff878063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:19.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.757+0000 7ff8777fe700 1 -- 172.21.15.8:0/3737522896 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7ff88007bd70 con 0x7ff8900f6530 2023-10-18T21:00:19.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.757+0000 7ff88e7fc700 1 --2- 172.21.15.8:0/3737522896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff878060f70 0x7ff878063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:19.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.757+0000 7ff88e7fc700 1 --2- 172.21.15.8:0/3737522896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff878060f70 0x7ff878063430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff884009720 tx=0x7ff884016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:19.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:19.761+0000 7ff8777fe700 1 -- 172.21.15.8:0/3737522896 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff88004c1b0 con 0x7ff8900f6530 2023-10-18T21:00:20.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.114+0000 7ff88ffff700 1 -- 172.21.15.8:0/3737522896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff89006ac90 con 0x7ff8900f6530 2023-10-18T21:00:20.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.115+0000 7ff8777fe700 1 -- 172.21.15.8:0/3737522896 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1794 (secure 0 0 0) 0x7ff89006ac90 con 0x7ff8900f6530 2023-10-18T21:00:20.118 INFO:teuthology.orchestra.run.smithi008.stdout:e17 2023-10-18T21:00:20.118 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:00:20.119 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:00:20.119 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:00:20.119 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:00:20.119 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:00:20.119 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:00:20.120 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 17 2023-10-18T21:00:20.120 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T21:00:20.120 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:00:20.120 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:59:22.221117+0000 2023-10-18T21:00:20.121 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:00:20.121 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:00:20.121 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:00:20.121 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:00:20.121 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:00:20.122 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:00:20.122 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:00:20.122 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T21:00:20.122 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:00:20.122 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T21:00:20.123 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T21:00:20.123 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T21:00:20.123 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:00:20.123 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:00:20.123 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T21:00:20.124 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:00:20.124 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:00:20.124 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:00:20.124 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:00:20.124 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:00:20.124 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:00:20.125 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:00:20.125 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:00:20.125 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:00:20.125 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:00:20.125 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:00:20.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 -- 172.21.15.8:0/3737522896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff878060f70 msgr2=0x7ff878063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:20.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 --2- 172.21.15.8:0/3737522896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff878060f70 0x7ff878063430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff884009720 tx=0x7ff884016040).stop 2023-10-18T21:00:20.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 -- 172.21.15.8:0/3737522896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8900f6530 msgr2=0x7ff89006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:20.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 --2- 172.21.15.8:0/3737522896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8900f6530 0x7ff89006b9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff88000e7c0 tx=0x7ff88000b040).stop 2023-10-18T21:00:20.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 -- 172.21.15.8:0/3737522896 shutdown_connections 2023-10-18T21:00:20.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 --2- 172.21.15.8:0/3737522896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff878060f70 0x7ff878063430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:20.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 --2- 172.21.15.8:0/3737522896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8900f6530 0x7ff89006b9a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:20.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 --2- 172.21.15.8:0/3737522896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8900f77d0 0x7ff890069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:20.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 -- 172.21.15.8:0/3737522896 >> 172.21.15.8:0/3737522896 conn(0x7ff8900f1c90 msgr2=0x7ff8900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:20.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 -- 172.21.15.8:0/3737522896 shutdown_connections 2023-10-18T21:00:20.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.118+0000 7ff88ffff700 1 -- 172.21.15.8:0/3737522896 wait complete. 2023-10-18T21:00:20.129 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-18T21:00:20.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.317+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/89138327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb00f96f0 msgr2=0x7f4cb00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:20.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.317+0000 7f4cb4a3e700 1 --2- 172.21.15.8:0/89138327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb00f96f0 0x7f4cb00fbae0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4ca0004660 tx=0x7f4ca0009b30).stop 2023-10-18T21:00:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.317+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/89138327 shutdown_connections 2023-10-18T21:00:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.317+0000 7f4cb4a3e700 1 --2- 172.21.15.8:0/89138327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb00f96f0 0x7f4cb00fbae0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.317+0000 7f4cb4a3e700 1 --2- 172.21.15.8:0/89138327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb00602b0 0x7f4cb00f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.317+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/89138327 >> 172.21.15.8:0/89138327 conn(0x7f4cb00f0b90 msgr2=0x7f4cb00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:20.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.318+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/89138327 shutdown_connections 2023-10-18T21:00:20.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.318+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/89138327 wait complete. 2023-10-18T21:00:20.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.319+0000 7f4cb4a3e700 1 Processor -- start 2023-10-18T21:00:20.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.319+0000 7f4cb4a3e700 1 -- start start 2023-10-18T21:00:20.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.319+0000 7f4cb4a3e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb00602b0 0x7f4cb0108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:20.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.319+0000 7f4cb4a3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb00f96f0 0x7f4cb01093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.319+0000 7f4cb4a3e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0109980 con 0x7f4cb00f96f0 2023-10-18T21:00:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.319+0000 7f4cb4a3e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0109ac0 con 0x7f4cb00602b0 2023-10-18T21:00:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.320+0000 7f4caeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb00f96f0 0x7f4cb01093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.320+0000 7f4caeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb00f96f0 0x7f4cb01093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47810/0 (socket says 172.21.15.8:47810) 2023-10-18T21:00:20.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.320+0000 7f4caeffd700 1 -- 172.21.15.8:0/3729552061 learned_addr learned my addr 172.21.15.8:0/3729552061 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.320+0000 7f4caf7fe700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb00602b0 0x7f4cb0108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.321+0000 7f4caf7fe700 1 -- 172.21.15.8:0/3729552061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb00f96f0 msgr2=0x7f4cb01093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:20.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.322+0000 7f4caf7fe700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb00f96f0 0x7f4cb01093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:20.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.322+0000 7f4caf7fe700 1 -- 172.21.15.8:0/3729552061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca0005040 con 0x7f4cb00602b0 2023-10-18T21:00:20.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.322+0000 7f4caeffd700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb00f96f0 0x7f4cb01093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:00:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.322+0000 7f4caf7fe700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb00602b0 0x7f4cb0108ee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f4ca400e7c0 tx=0x7f4ca400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.323+0000 7f4c97fff700 1 -- 172.21.15.8:0/3729552061 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ca40092e0 con 0x7f4cb00602b0 2023-10-18T21:00:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.324+0000 7f4c97fff700 1 -- 172.21.15.8:0/3729552061 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4ca400f040 con 0x7f4cb00602b0 2023-10-18T21:00:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.324+0000 7f4c97fff700 1 -- 172.21.15.8:0/3729552061 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ca40147e0 con 0x7f4cb00602b0 2023-10-18T21:00:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.324+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/3729552061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb010a460 con 0x7f4cb00602b0 2023-10-18T21:00:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.324+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/3729552061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb010a9a0 con 0x7f4cb00602b0 2023-10-18T21:00:20.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.327+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/3729552061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb0045ad0 con 0x7f4cb00602b0 2023-10-18T21:00:20.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.329+0000 7f4c97fff700 1 -- 172.21.15.8:0/3729552061 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4ca401b030 con 0x7f4cb00602b0 2023-10-18T21:00:20.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.331+0000 7f4c97fff700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c98060f70 0x7f4c98063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:20.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.332+0000 7f4c97fff700 1 -- 172.21.15.8:0/3729552061 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f4ca407c140 con 0x7f4cb00602b0 2023-10-18T21:00:20.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.333+0000 7f4caeffd700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c98060f70 0x7f4c98063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:20.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.335+0000 7f4caeffd700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c98060f70 0x7f4c98063430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4ca0009720 tx=0x7f4ca000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:20.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.344+0000 7f4c97fff700 1 -- 172.21.15.8:0/3729552061 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4ca404ffe0 con 0x7f4cb00602b0 2023-10-18T21:00:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:18.754531+0000 mgr.smithi008.flmjzp (mgr.14640) 97 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:20.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:19.172157+0000 mgr.smithi008.flmjzp (mgr.14640) 98 : audit [DBG] from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:20.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:19.588689+0000 mon.smithi008 (mon.0) 149 : audit [DBG] from='client.? 172.21.15.8:0/2927950761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:00:20.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:19.823691+0000 mon.smithi008 (mon.0) 150 : cluster [WRN] Health check update: Degraded data redundancy: 898/32451 objects degraded (2.767%), 11 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:20.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:20.116339+0000 mon.smithi008 (mon.0) 151 : audit [DBG] from='client.? 172.21.15.8:0/3737522896' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:00:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:18.754531+0000 mgr.smithi008.flmjzp (mgr.14640) 97 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:19.172157+0000 mgr.smithi008.flmjzp (mgr.14640) 98 : audit [DBG] from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:19.588689+0000 mon.smithi008 (mon.0) 149 : audit [DBG] from='client.? 172.21.15.8:0/2927950761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:00:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:19.823691+0000 mon.smithi008 (mon.0) 150 : cluster [WRN] Health check update: Degraded data redundancy: 898/32451 objects degraded (2.767%), 11 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:20.116339+0000 mon.smithi008 (mon.0) 151 : audit [DBG] from='client.? 172.21.15.8:0/3737522896' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:00:20.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.672+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/3729552061 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cb00f5690 con 0x7f4c98060f70 2023-10-18T21:00:20.677 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:00:20.677 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:00:20.677 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:00:20.678 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:00:20.678 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:00:20.678 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:00:20.678 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:00:20.678 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:00:20.679 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:00:20.679 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "7/21 daemons upgraded", 2023-10-18T21:00:20.679 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading osd daemons", 2023-10-18T21:00:20.679 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:00:20.679 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:00:20.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.674+0000 7f4c97fff700 1 -- 172.21.15.8:0/3729552061 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4cb00f5690 con 0x7f4c98060f70 2023-10-18T21:00:20.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.678+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/3729552061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c98060f70 msgr2=0x7f4c98063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:20.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.678+0000 7f4cb4a3e700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c98060f70 0x7f4c98063430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4ca0009720 tx=0x7f4ca000b040).stop 2023-10-18T21:00:20.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.678+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/3729552061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb00602b0 msgr2=0x7f4cb0108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:20.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.678+0000 7f4cb4a3e700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb00602b0 0x7f4cb0108ee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f4ca400e7c0 tx=0x7f4ca400b040).stop 2023-10-18T21:00:20.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.679+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/3729552061 shutdown_connections 2023-10-18T21:00:20.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.679+0000 7f4cb4a3e700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c98060f70 0x7f4c98063430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:20.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.679+0000 7f4cb4a3e700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb00602b0 0x7f4cb0108ee0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:20.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.679+0000 7f4cb4a3e700 1 --2- 172.21.15.8:0/3729552061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb00f96f0 0x7f4cb01093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:20.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.679+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/3729552061 >> 172.21.15.8:0/3729552061 conn(0x7f4cb00f0b90 msgr2=0x7f4cb00f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:20.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.680+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/3729552061 shutdown_connections 2023-10-18T21:00:20.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:20.680+0000 7f4cb4a3e700 1 -- 172.21.15.8:0/3729552061 wait complete. 2023-10-18T21:00:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:20.142687+0000 mgr.smithi008.flmjzp (mgr.14640) 99 : cluster [DBG] pgmap v67: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 9 active+recovery_wait+degraded, 53 active+clean; 339 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 231 op/s; 898/32451 objects degraded (2.767%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:20.142687+0000 mgr.smithi008.flmjzp (mgr.14640) 99 : cluster [DBG] pgmap v67: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 9 active+recovery_wait+degraded, 53 active+clean; 339 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 231 op/s; 898/32451 objects degraded (2.767%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:20.675533+0000 mgr.smithi008.flmjzp (mgr.14640) 100 : audit [DBG] from='client.44149 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:20.675533+0000 mgr.smithi008.flmjzp (mgr.14640) 100 : audit [DBG] from='client.44149 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:22.143163+0000 mgr.smithi008.flmjzp (mgr.14640) 101 : cluster [DBG] pgmap v68: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 9 active+recovery_wait+degraded, 53 active+clean; 342 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 357 op/s; 898/28386 objects degraded (3.164%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:23.060852+0000 mon.smithi008 (mon.0) 152 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:22.143163+0000 mgr.smithi008.flmjzp (mgr.14640) 101 : cluster [DBG] pgmap v68: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 9 active+recovery_wait+degraded, 53 active+clean; 342 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 357 op/s; 898/28386 objects degraded (3.164%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:23.060852+0000 mon.smithi008 (mon.0) 152 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:23.061203+0000 mgr.smithi008.flmjzp (mgr.14640) 102 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:00:23.063248+0000 mgr.smithi008.flmjzp (mgr.14640) 103 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2023-10-18T21:00:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:23.061203+0000 mgr.smithi008.flmjzp (mgr.14640) 102 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:00:23.063248+0000 mgr.smithi008.flmjzp (mgr.14640) 103 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2023-10-18T21:00:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:24.143575+0000 mgr.smithi008.flmjzp (mgr.14640) 104 : cluster [DBG] pgmap v69: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 9 active+recovery_wait+degraded, 53 active+clean; 342 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 262 op/s; 898/28386 objects degraded (3.164%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:24.824951+0000 mon.smithi008 (mon.0) 153 : cluster [WRN] Health check update: Degraded data redundancy: 898/28386 objects degraded (3.164%), 11 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:24.143575+0000 mgr.smithi008.flmjzp (mgr.14640) 104 : cluster [DBG] pgmap v69: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 9 active+recovery_wait+degraded, 53 active+clean; 342 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 262 op/s; 898/28386 objects degraded (3.164%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:24.824951+0000 mon.smithi008 (mon.0) 153 : cluster [WRN] Health check update: Degraded data redundancy: 898/28386 objects degraded (3.164%), 11 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:26.143949+0000 mgr.smithi008.flmjzp (mgr.14640) 105 : cluster [DBG] pgmap v70: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 9 active+recovery_wait+degraded, 53 active+clean; 342 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 272 op/s; 898/28047 objects degraded (3.202%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:26.143949+0000 mgr.smithi008.flmjzp (mgr.14640) 105 : cluster [DBG] pgmap v70: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 9 active+recovery_wait+degraded, 53 active+clean; 342 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 272 op/s; 898/28047 objects degraded (3.202%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:28.144418+0000 mgr.smithi008.flmjzp (mgr.14640) 106 : cluster [DBG] pgmap v71: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 8 active+recovery_wait+degraded, 54 active+clean; 342 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 339 op/s; 815/25710 objects degraded (3.170%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:28.144418+0000 mgr.smithi008.flmjzp (mgr.14640) 106 : cluster [DBG] pgmap v71: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 8 active+recovery_wait+degraded, 54 active+clean; 342 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 339 op/s; 815/25710 objects degraded (3.170%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:29.827052+0000 mon.smithi008 (mon.0) 154 : cluster [WRN] Health check update: Degraded data redundancy: 815/25710 objects degraded (3.170%), 10 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:29.827052+0000 mon.smithi008 (mon.0) 154 : cluster [WRN] Health check update: Degraded data redundancy: 815/25710 objects degraded (3.170%), 10 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:30.146132+0000 mgr.smithi008.flmjzp (mgr.14640) 107 : cluster [DBG] pgmap v72: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 8 active+recovery_wait+degraded, 54 active+clean; 342 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1016 KiB/s rd, 1.0 MiB/s wr, 219 op/s; 815/25710 objects degraded (3.170%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:30.146132+0000 mgr.smithi008.flmjzp (mgr.14640) 107 : cluster [DBG] pgmap v72: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 8 active+recovery_wait+degraded, 54 active+clean; 342 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1016 KiB/s rd, 1.0 MiB/s wr, 219 op/s; 815/25710 objects degraded (3.170%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:32.146713+0000 mgr.smithi008.flmjzp (mgr.14640) 108 : cluster [DBG] pgmap v73: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 7 active+recovery_wait+degraded, 55 active+clean; 345 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 330 op/s; 725/22698 objects degraded (3.194%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:33.514 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:32.146713+0000 mgr.smithi008.flmjzp (mgr.14640) 108 : cluster [DBG] pgmap v73: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 7 active+recovery_wait+degraded, 55 active+clean; 345 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 330 op/s; 725/22698 objects degraded (3.194%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:34.147162+0000 mgr.smithi008.flmjzp (mgr.14640) 109 : cluster [DBG] pgmap v74: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 7 active+recovery_wait+degraded, 55 active+clean; 345 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 910 KiB/s rd, 936 KiB/s wr, 204 op/s; 725/22698 objects degraded (3.194%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:34.828176+0000 mon.smithi008 (mon.0) 155 : cluster [WRN] Health check update: Degraded data redundancy: 725/22698 objects degraded (3.194%), 9 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:34.147162+0000 mgr.smithi008.flmjzp (mgr.14640) 109 : cluster [DBG] pgmap v74: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 7 active+recovery_wait+degraded, 55 active+clean; 345 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 910 KiB/s rd, 936 KiB/s wr, 204 op/s; 725/22698 objects degraded (3.194%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:34.828176+0000 mon.smithi008 (mon.0) 155 : cluster [WRN] Health check update: Degraded data redundancy: 725/22698 objects degraded (3.194%), 9 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:36.147628+0000 mgr.smithi008.flmjzp (mgr.14640) 110 : cluster [DBG] pgmap v75: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 7 active+recovery_wait+degraded, 55 active+clean; 345 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 913 KiB/s rd, 939 KiB/s wr, 213 op/s; 725/22377 objects degraded (3.240%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:36.147628+0000 mgr.smithi008.flmjzp (mgr.14640) 110 : cluster [DBG] pgmap v75: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 7 active+recovery_wait+degraded, 55 active+clean; 345 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 913 KiB/s rd, 939 KiB/s wr, 213 op/s; 725/22377 objects degraded (3.240%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:38.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:38.078179+0000 mon.smithi008 (mon.0) 156 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:38.078179+0000 mon.smithi008 (mon.0) 156 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:38.078473+0000 mgr.smithi008.flmjzp (mgr.14640) 111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:00:38.080232+0000 mgr.smithi008.flmjzp (mgr.14640) 112 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2023-10-18T21:00:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:38.148256+0000 mgr.smithi008.flmjzp (mgr.14640) 113 : cluster [DBG] pgmap v76: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 7 active+recovery_wait+degraded, 55 active+clean; 348 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 286 op/s; 725/20202 objects degraded (3.589%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:38.078473+0000 mgr.smithi008.flmjzp (mgr.14640) 111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:00:38.080232+0000 mgr.smithi008.flmjzp (mgr.14640) 112 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2023-10-18T21:00:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:38.148256+0000 mgr.smithi008.flmjzp (mgr.14640) 113 : cluster [DBG] pgmap v76: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 7 active+recovery_wait+degraded, 55 active+clean; 348 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 286 op/s; 725/20202 objects degraded (3.589%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:39.829049+0000 mon.smithi008 (mon.0) 157 : cluster [WRN] Health check update: Degraded data redundancy: 725/20202 objects degraded (3.589%), 9 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:39.829049+0000 mon.smithi008 (mon.0) 157 : cluster [WRN] Health check update: Degraded data redundancy: 725/20202 objects degraded (3.589%), 9 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:40.148869+0000 mgr.smithi008.flmjzp (mgr.14640) 114 : cluster [DBG] pgmap v77: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 7 active+recovery_wait+degraded, 55 active+clean; 348 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 962 KiB/s rd, 1019 KiB/s wr, 203 op/s; 725/20202 objects degraded (3.589%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:40.148869+0000 mgr.smithi008.flmjzp (mgr.14640) 114 : cluster [DBG] pgmap v77: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 7 active+recovery_wait+degraded, 55 active+clean; 348 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 962 KiB/s rd, 1019 KiB/s wr, 203 op/s; 725/20202 objects degraded (3.589%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:43.514 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:42.149492+0000 mgr.smithi008.flmjzp (mgr.14640) 115 : cluster [DBG] pgmap v78: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 6 active+recovery_wait+degraded, 56 active+clean; 350 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 313 op/s; 630/17088 objects degraded (3.687%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:42.149492+0000 mgr.smithi008.flmjzp (mgr.14640) 115 : cluster [DBG] pgmap v78: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 6 active+recovery_wait+degraded, 56 active+clean; 350 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 313 op/s; 630/17088 objects degraded (3.687%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:44.149865+0000 mgr.smithi008.flmjzp (mgr.14640) 116 : cluster [DBG] pgmap v79: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 6 active+recovery_wait+degraded, 56 active+clean; 350 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 202 op/s; 630/17088 objects degraded (3.687%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:44.829887+0000 mon.smithi008 (mon.0) 158 : cluster [WRN] Health check update: Degraded data redundancy: 630/17088 objects degraded (3.687%), 8 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:44.149865+0000 mgr.smithi008.flmjzp (mgr.14640) 116 : cluster [DBG] pgmap v79: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 6 active+recovery_wait+degraded, 56 active+clean; 350 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 202 op/s; 630/17088 objects degraded (3.687%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:44.829887+0000 mon.smithi008 (mon.0) 158 : cluster [WRN] Health check update: Degraded data redundancy: 630/17088 objects degraded (3.687%), 8 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:46.150364+0000 mgr.smithi008.flmjzp (mgr.14640) 117 : cluster [DBG] pgmap v80: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering, 5 active+recovery_wait+degraded, 56 active+clean; 349 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 215 op/s; 557/16689 objects degraded (3.338%); 0 B/s, 10 objects/s recovering 2023-10-18T21:00:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:46.150364+0000 mgr.smithi008.flmjzp (mgr.14640) 117 : cluster [DBG] pgmap v80: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 2 active+recovering, 5 active+recovery_wait+degraded, 56 active+clean; 349 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 215 op/s; 557/16689 objects degraded (3.338%); 0 B/s, 10 objects/s recovering 2023-10-18T21:00:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:48.151219+0000 mgr.smithi008.flmjzp (mgr.14640) 118 : cluster [DBG] pgmap v81: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 57 active+clean; 350 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 312 op/s; 557/13578 objects degraded (4.102%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:48.151219+0000 mgr.smithi008.flmjzp (mgr.14640) 118 : cluster [DBG] pgmap v81: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 57 active+clean; 350 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 312 op/s; 557/13578 objects degraded (4.102%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:49.830870+0000 mon.smithi008 (mon.0) 159 : cluster [WRN] Health check update: Degraded data redundancy: 557/13578 objects degraded (4.102%), 7 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:49.830870+0000 mon.smithi008 (mon.0) 159 : cluster [WRN] Health check update: Degraded data redundancy: 557/13578 objects degraded (4.102%), 7 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:50.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.864+0000 7fde4cb82700 1 -- 172.21.15.8:0/2588515293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f6530 msgr2=0x7fde480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:50.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.864+0000 7fde4cb82700 1 --2- 172.21.15.8:0/2588515293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f6530 0x7fde480f6950 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fde38004660 tx=0x7fde38009b30).stop 2023-10-18T21:00:50.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.864+0000 7fde4cb82700 1 -- 172.21.15.8:0/2588515293 shutdown_connections 2023-10-18T21:00:50.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.864+0000 7fde4cb82700 1 --2- 172.21.15.8:0/2588515293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f77d0 0x7fde480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:50.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.864+0000 7fde4cb82700 1 --2- 172.21.15.8:0/2588515293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f6530 0x7fde480f6950 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:50.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.864+0000 7fde4cb82700 1 -- 172.21.15.8:0/2588515293 >> 172.21.15.8:0/2588515293 conn(0x7fde480f1c70 msgr2=0x7fde480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:50.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.864+0000 7fde4cb82700 1 -- 172.21.15.8:0/2588515293 shutdown_connections 2023-10-18T21:00:50.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.864+0000 7fde4cb82700 1 -- 172.21.15.8:0/2588515293 wait complete. 2023-10-18T21:00:50.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.865+0000 7fde4cb82700 1 Processor -- start 2023-10-18T21:00:50.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.865+0000 7fde4cb82700 1 -- start start 2023-10-18T21:00:50.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.865+0000 7fde4cb82700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 0x7fde4806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:50.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.865+0000 7fde4cb82700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:50.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.866+0000 7fde4cb82700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4806a380 con 0x7fde480f77d0 2023-10-18T21:00:50.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.866+0000 7fde4cb82700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4806a4c0 con 0x7fde480f6530 2023-10-18T21:00:50.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.866+0000 7fde46ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:50.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.866+0000 7fde477fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 0x7fde4806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:50.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.866+0000 7fde46ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44094/0 (socket says 172.21.15.8:44094) 2023-10-18T21:00:50.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.866+0000 7fde46ffd700 1 -- 172.21.15.8:0/1470593763 learned_addr learned my addr 172.21.15.8:0/1470593763 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:50.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.866+0000 7fde477fe700 1 -- 172.21.15.8:0/1470593763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 msgr2=0x7fde48069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:50.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.866+0000 7fde477fe700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:50.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.866+0000 7fde477fe700 1 -- 172.21.15.8:0/1470593763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde38005040 con 0x7fde480f6530 2023-10-18T21:00:50.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.866+0000 7fde46ffd700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:00:50.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.867+0000 7fde477fe700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 0x7fde4806b9a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fde480f7630 tx=0x7fde3800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:50.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.867+0000 7fde2ffff700 1 -- 172.21.15.8:0/1470593763 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde38019070 con 0x7fde480f6530 2023-10-18T21:00:50.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.867+0000 7fde4cb82700 1 -- 172.21.15.8:0/1470593763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4806a740 con 0x7fde480f6530 2023-10-18T21:00:50.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.867+0000 7fde2ffff700 1 -- 172.21.15.8:0/1470593763 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fde38013e70 con 0x7fde480f6530 2023-10-18T21:00:50.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.867+0000 7fde2ffff700 1 -- 172.21.15.8:0/1470593763 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde38014d00 con 0x7fde480f6530 2023-10-18T21:00:50.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.867+0000 7fde4cb82700 1 -- 172.21.15.8:0/1470593763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4806ac20 con 0x7fde480f6530 2023-10-18T21:00:50.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.868+0000 7fde4cb82700 1 -- 172.21.15.8:0/1470593763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde48045ad0 con 0x7fde480f6530 2023-10-18T21:00:50.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.870+0000 7fde2ffff700 1 -- 172.21.15.8:0/1470593763 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fde380079c0 con 0x7fde480f6530 2023-10-18T21:00:50.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.870+0000 7fde2ffff700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 0x7fde30063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:50.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.871+0000 7fde2ffff700 1 -- 172.21.15.8:0/1470593763 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fde3807d5f0 con 0x7fde480f6530 2023-10-18T21:00:50.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.871+0000 7fde46ffd700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 0x7fde30063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:50.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.872+0000 7fde46ffd700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 0x7fde30063430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fde3c004fd0 tx=0x7fde3c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:50.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:50.876+0000 7fde2ffff700 1 -- 172.21.15.8:0/1470593763 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fde3804da00 con 0x7fde480f6530 2023-10-18T21:00:51.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.176+0000 7fde4cb82700 1 -- 172.21.15.8:0/1470593763 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde48057f10 con 0x7fde30060f70 2023-10-18T21:00:51.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.178+0000 7fde2ffff700 1 -- 172.21.15.8:0/1470593763 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fde48057f10 con 0x7fde30060f70 2023-10-18T21:00:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.180+0000 7fde4cb82700 1 -- 172.21.15.8:0/1470593763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 msgr2=0x7fde30063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.180+0000 7fde4cb82700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 0x7fde30063430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fde3c004fd0 tx=0x7fde3c00b040).stop 2023-10-18T21:00:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.180+0000 7fde4cb82700 1 -- 172.21.15.8:0/1470593763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 msgr2=0x7fde4806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.180+0000 7fde4cb82700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 0x7fde4806b9a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fde480f7630 tx=0x7fde3800b040).stop 2023-10-18T21:00:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.181+0000 7fde4cb82700 1 -- 172.21.15.8:0/1470593763 shutdown_connections 2023-10-18T21:00:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.181+0000 7fde4cb82700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 0x7fde30063430 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.181+0000 7fde4cb82700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 0x7fde4806b9a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.181+0000 7fde4cb82700 1 --2- 172.21.15.8:0/1470593763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.181+0000 7fde4cb82700 1 -- 172.21.15.8:0/1470593763 >> 172.21.15.8:0/1470593763 conn(0x7fde480f1c70 msgr2=0x7fde480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:51.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.181+0000 7fde4cb82700 1 -- 172.21.15.8:0/1470593763 shutdown_connections 2023-10-18T21:00:51.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.181+0000 7fde4cb82700 1 -- 172.21.15.8:0/1470593763 wait complete. 2023-10-18T21:00:51.210 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:00:51.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.416+0000 7fb36e4b4700 1 -- 172.21.15.8:0/2576542292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f5ef0 msgr2=0x7fb3680f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:51.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.416+0000 7fb36e4b4700 1 --2- 172.21.15.8:0/2576542292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f5ef0 0x7fb3680f6920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fb35c004660 tx=0x7fb35c009b30).stop 2023-10-18T21:00:51.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.416+0000 7fb36e4b4700 1 -- 172.21.15.8:0/2576542292 shutdown_connections 2023-10-18T21:00:51.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.416+0000 7fb36e4b4700 1 --2- 172.21.15.8:0/2576542292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f5ef0 0x7fb3680f6920 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.416+0000 7fb36e4b4700 1 --2- 172.21.15.8:0/2576542292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f55e0 0x7fb3680f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.416+0000 7fb36e4b4700 1 -- 172.21.15.8:0/2576542292 >> 172.21.15.8:0/2576542292 conn(0x7fb3680f0de0 msgr2=0x7fb3680f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:51.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.416+0000 7fb36e4b4700 1 -- 172.21.15.8:0/2576542292 shutdown_connections 2023-10-18T21:00:51.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.417+0000 7fb36e4b4700 1 -- 172.21.15.8:0/2576542292 wait complete. 2023-10-18T21:00:51.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.418+0000 7fb36e4b4700 1 Processor -- start 2023-10-18T21:00:51.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.418+0000 7fb36e4b4700 1 -- start start 2023-10-18T21:00:51.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.419+0000 7fb36e4b4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f55e0 0x7fb368104ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:51.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.419+0000 7fb36e4b4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f5ef0 0x7fb3681051d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:51.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.419+0000 7fb36e4b4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3681057d0 con 0x7fb3680f5ef0 2023-10-18T21:00:51.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.419+0000 7fb36e4b4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb368105910 con 0x7fb3680f55e0 2023-10-18T21:00:51.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.419+0000 7fb367fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f55e0 0x7fb368104ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:51.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.420+0000 7fb367fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f55e0 0x7fb368104ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:44918/0 (socket says 172.21.15.8:44918) 2023-10-18T21:00:51.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.420+0000 7fb367fff700 1 -- 172.21.15.8:0/921213406 learned_addr learned my addr 172.21.15.8:0/921213406 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:51.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.420+0000 7fb3677fe700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f5ef0 0x7fb3681051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:51.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.421+0000 7fb367fff700 1 -- 172.21.15.8:0/921213406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f5ef0 msgr2=0x7fb3681051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:51.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.421+0000 7fb367fff700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f5ef0 0x7fb3681051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.421+0000 7fb367fff700 1 -- 172.21.15.8:0/921213406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c005040 con 0x7fb3680f55e0 2023-10-18T21:00:51.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.422+0000 7fb367fff700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f55e0 0x7fb368104ce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fb35800e7f0 tx=0x7fb35800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:51.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.422+0000 7fb364ff9700 1 -- 172.21.15.8:0/921213406 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3580092e0 con 0x7fb3680f55e0 2023-10-18T21:00:51.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.422+0000 7fb364ff9700 1 -- 172.21.15.8:0/921213406 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb35800f040 con 0x7fb3680f55e0 2023-10-18T21:00:51.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.422+0000 7fb364ff9700 1 -- 172.21.15.8:0/921213406 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3580147e0 con 0x7fb3680f55e0 2023-10-18T21:00:51.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.423+0000 7fb36e4b4700 1 -- 172.21.15.8:0/921213406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb368106280 con 0x7fb3680f55e0 2023-10-18T21:00:51.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.424+0000 7fb36e4b4700 1 -- 172.21.15.8:0/921213406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb368106790 con 0x7fb3680f55e0 2023-10-18T21:00:51.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.425+0000 7fb36e4b4700 1 -- 172.21.15.8:0/921213406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3680f4a70 con 0x7fb3680f55e0 2023-10-18T21:00:51.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.428+0000 7fb364ff9700 1 -- 172.21.15.8:0/921213406 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb3580077b0 con 0x7fb3680f55e0 2023-10-18T21:00:51.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.429+0000 7fb364ff9700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f20 0x7fb3500633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:51.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.429+0000 7fb364ff9700 1 -- 172.21.15.8:0/921213406 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fb35807baa0 con 0x7fb3680f55e0 2023-10-18T21:00:51.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.431+0000 7fb3677fe700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f20 0x7fb3500633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:51.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.431+0000 7fb3677fe700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f20 0x7fb3500633e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb35c004630 tx=0x7fb35c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:51.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.436+0000 7fb364ff9700 1 -- 172.21.15.8:0/921213406 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb35804be60 con 0x7fb3680f55e0 2023-10-18T21:00:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:50.151707+0000 mgr.smithi008.flmjzp (mgr.14640) 119 : cluster [DBG] pgmap v82: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 57 active+clean; 350 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 229 op/s; 557/13578 objects degraded (4.102%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:50.151707+0000 mgr.smithi008.flmjzp (mgr.14640) 119 : cluster [DBG] pgmap v82: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 57 active+clean; 350 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 229 op/s; 557/13578 objects degraded (4.102%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:51.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.771+0000 7fb36e4b4700 1 -- 172.21.15.8:0/921213406 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb36810b370 con 0x7fb350060f20 2023-10-18T21:00:51.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.772+0000 7fb364ff9700 1 -- 172.21.15.8:0/921213406 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb36810b370 con 0x7fb350060f20 2023-10-18T21:00:51.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 -- 172.21.15.8:0/921213406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f20 msgr2=0x7fb3500633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:51.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f20 0x7fb3500633e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb35c004630 tx=0x7fb35c00b040).stop 2023-10-18T21:00:51.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 -- 172.21.15.8:0/921213406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f55e0 msgr2=0x7fb368104ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:51.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f55e0 0x7fb368104ce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fb35800e7f0 tx=0x7fb35800b040).stop 2023-10-18T21:00:51.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 -- 172.21.15.8:0/921213406 shutdown_connections 2023-10-18T21:00:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f20 0x7fb3500633e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f55e0 0x7fb368104ce0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 --2- 172.21.15.8:0/921213406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f5ef0 0x7fb3681051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 -- 172.21.15.8:0/921213406 >> 172.21.15.8:0/921213406 conn(0x7fb3680f0de0 msgr2=0x7fb3680fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 -- 172.21.15.8:0/921213406 shutdown_connections 2023-10-18T21:00:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.774+0000 7fb36e4b4700 1 -- 172.21.15.8:0/921213406 wait complete. 2023-10-18T21:00:51.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.945+0000 7efdcecb2700 1 -- 172.21.15.8:0/1649379804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806a330 msgr2=0x7efdc806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:51.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.945+0000 7efdcecb2700 1 --2- 172.21.15.8:0/1649379804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806a330 0x7efdc806a7b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7efdb8004660 tx=0x7efdb8009b30).stop 2023-10-18T21:00:51.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.945+0000 7efdcecb2700 1 -- 172.21.15.8:0/1649379804 shutdown_connections 2023-10-18T21:00:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.945+0000 7efdcecb2700 1 --2- 172.21.15.8:0/1649379804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806a330 0x7efdc806a7b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.945+0000 7efdcecb2700 1 --2- 172.21.15.8:0/1649379804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc806b940 0x7efdc8069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.945+0000 7efdcecb2700 1 -- 172.21.15.8:0/1649379804 >> 172.21.15.8:0/1649379804 conn(0x7efdc80f1c90 msgr2=0x7efdc80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.945+0000 7efdcecb2700 1 -- 172.21.15.8:0/1649379804 shutdown_connections 2023-10-18T21:00:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.945+0000 7efdcecb2700 1 -- 172.21.15.8:0/1649379804 wait complete. 2023-10-18T21:00:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.946+0000 7efdcecb2700 1 Processor -- start 2023-10-18T21:00:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.946+0000 7efdcecb2700 1 -- start start 2023-10-18T21:00:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.947+0000 7efdcecb2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc806a330 0x7efdc8108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.947+0000 7efdcecb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806b940 0x7efdc81093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.947+0000 7efdcecb2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc81099a0 con 0x7efdc806b940 2023-10-18T21:00:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.947+0000 7efdcecb2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8109ae0 con 0x7efdc806a330 2023-10-18T21:00:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.947+0000 7efdcd4af700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806b940 0x7efdc81093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.947+0000 7efdcd4af700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806b940 0x7efdc81093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44130/0 (socket says 172.21.15.8:44130) 2023-10-18T21:00:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.947+0000 7efdcd4af700 1 -- 172.21.15.8:0/860135002 learned_addr learned my addr 172.21.15.8:0/860135002 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.947+0000 7efdcdcb0700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc806a330 0x7efdc8108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.948+0000 7efdcd4af700 1 -- 172.21.15.8:0/860135002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc806a330 msgr2=0x7efdc8108f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.948+0000 7efdcd4af700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc806a330 0x7efdc8108f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:51.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.948+0000 7efdcd4af700 1 -- 172.21.15.8:0/860135002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb8005040 con 0x7efdc806b940 2023-10-18T21:00:51.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.948+0000 7efdcd4af700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806b940 0x7efdc81093f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7efdb8004320 tx=0x7efdb800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:51.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.948+0000 7efdbe7fc700 1 -- 172.21.15.8:0/860135002 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb8019070 con 0x7efdc806b940 2023-10-18T21:00:51.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.948+0000 7efdbe7fc700 1 -- 172.21.15.8:0/860135002 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efdb801e420 con 0x7efdc806b940 2023-10-18T21:00:51.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.948+0000 7efdcecb2700 1 -- 172.21.15.8:0/860135002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc810a420 con 0x7efdc806b940 2023-10-18T21:00:51.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.948+0000 7efdbe7fc700 1 -- 172.21.15.8:0/860135002 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb8014680 con 0x7efdc806b940 2023-10-18T21:00:51.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.948+0000 7efdcecb2700 1 -- 172.21.15.8:0/860135002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc810a900 con 0x7efdc806b940 2023-10-18T21:00:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.949+0000 7efdcecb2700 1 -- 172.21.15.8:0/860135002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc8045ad0 con 0x7efdc806b940 2023-10-18T21:00:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.950+0000 7efdbe7fc700 1 -- 172.21.15.8:0/860135002 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7efdb801e590 con 0x7efdc806b940 2023-10-18T21:00:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.951+0000 7efdbe7fc700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdb4060f70 0x7efdb4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.951+0000 7efdbe7fc700 1 -- 172.21.15.8:0/860135002 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7efdb807d5e0 con 0x7efdc806b940 2023-10-18T21:00:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.952+0000 7efdcdcb0700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdb4060f70 0x7efdb4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.952+0000 7efdcdcb0700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdb4060f70 0x7efdb4063430 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7efdc4009fd0 tx=0x7efdc400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:51.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:51.956+0000 7efdbe7fc700 1 -- 172.21.15.8:0/860135002 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efdb8051340 con 0x7efdc806b940 2023-10-18T21:00:52.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.159+0000 7efdcecb2700 1 -- 172.21.15.8:0/860135002 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efdc810ab20 con 0x7efdb4060f70 2023-10-18T21:00:52.175 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:00:52.176 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (7m) 59s ago 9m 15.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:00:52.176 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (84s) 59s ago 8m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:00:52.176 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (80s) 76s ago 8m 7566k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:00:52.176 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (7m) 59s ago 8m 25.0M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:00:52.176 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (5m) 59s ago 5m 5328M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T21:00:52.177 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (4m) 59s ago 4m 692M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T21:00:52.177 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (5m) 76s ago 5m 2598M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:00:52.177 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (4m) 76s ago 4m 373M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:00:52.177 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (2m) 59s ago 10m 445M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:00:52.177 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (2m) 76s ago 8m 394M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:00:52.178 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (112s) 59s ago 10m 53.2M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:00:52.178 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (100s) 76s ago 8m 39.6M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:00:52.178 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (8m) 59s ago 8m 9499k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:00:52.178 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (7m) 76s ago 7m 9903k - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:00:52.178 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (66s) 59s ago 7m 10.7M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:00:52.179 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (7m) 59s ago 7m 764M 4096M 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T21:00:52.179 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (6m) 59s ago 6m 659M 4096M 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T21:00:52.179 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (6m) 76s ago 6m 856M 4096M 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T21:00:52.179 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (6m) 76s ago 6m 709M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T21:00:52.179 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (6m) 76s ago 6m 745M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T21:00:52.180 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (3m) 59s ago 8m 52.3M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:00:52.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.174+0000 7efdbe7fc700 1 -- 172.21.15.8:0/860135002 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7efdc810ab20 con 0x7efdb4060f70 2023-10-18T21:00:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.177+0000 7efdcecb2700 1 -- 172.21.15.8:0/860135002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdb4060f70 msgr2=0x7efdb4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.177+0000 7efdcecb2700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdb4060f70 0x7efdb4063430 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7efdc4009fd0 tx=0x7efdc400b040).stop 2023-10-18T21:00:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.177+0000 7efdcecb2700 1 -- 172.21.15.8:0/860135002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806b940 msgr2=0x7efdc81093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.177+0000 7efdcecb2700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806b940 0x7efdc81093f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7efdb8004320 tx=0x7efdb800b040).stop 2023-10-18T21:00:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.178+0000 7efdcecb2700 1 -- 172.21.15.8:0/860135002 shutdown_connections 2023-10-18T21:00:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.178+0000 7efdcecb2700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdb4060f70 0x7efdb4063430 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.178+0000 7efdcecb2700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc806a330 0x7efdc8108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.178+0000 7efdcecb2700 1 --2- 172.21.15.8:0/860135002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdc806b940 0x7efdc81093f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.178+0000 7efdcecb2700 1 -- 172.21.15.8:0/860135002 >> 172.21.15.8:0/860135002 conn(0x7efdc80f1c90 msgr2=0x7efdc80fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.178+0000 7efdcecb2700 1 -- 172.21.15.8:0/860135002 shutdown_connections 2023-10-18T21:00:52.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.179+0000 7efdcecb2700 1 -- 172.21.15.8:0/860135002 wait complete. 2023-10-18T21:00:52.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.414+0000 7ff93c98e700 1 -- 172.21.15.8:0/1688049514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff93806a3b0 msgr2=0x7ff93806a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:52.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.414+0000 7ff93c98e700 1 --2- 172.21.15.8:0/1688049514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff93806a3b0 0x7ff93806a830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff9240045a0 tx=0x7ff924009b30).stop 2023-10-18T21:00:52.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.414+0000 7ff93c98e700 1 -- 172.21.15.8:0/1688049514 shutdown_connections 2023-10-18T21:00:52.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.414+0000 7ff93c98e700 1 --2- 172.21.15.8:0/1688049514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff93806a3b0 0x7ff93806a830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.414+0000 7ff93c98e700 1 --2- 172.21.15.8:0/1688049514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff93806b9c0 0x7ff938069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.414+0000 7ff93c98e700 1 -- 172.21.15.8:0/1688049514 >> 172.21.15.8:0/1688049514 conn(0x7ff9380f1c90 msgr2=0x7ff9380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:52.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.414+0000 7ff93c98e700 1 -- 172.21.15.8:0/1688049514 shutdown_connections 2023-10-18T21:00:52.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.415+0000 7ff93c98e700 1 -- 172.21.15.8:0/1688049514 wait complete. 2023-10-18T21:00:52.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.416+0000 7ff93c98e700 1 Processor -- start 2023-10-18T21:00:52.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.416+0000 7ff93c98e700 1 -- start start 2023-10-18T21:00:52.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.417+0000 7ff93c98e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff93806a3b0 0x7ff938115ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:52.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.417+0000 7ff93c98e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff93806b9c0 0x7ff938115fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:52.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.417+0000 7ff93c98e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938116580 con 0x7ff93806b9c0 2023-10-18T21:00:52.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.417+0000 7ff93c98e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9381166c0 con 0x7ff93806a3b0 2023-10-18T21:00:52.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.418+0000 7ff936ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff93806b9c0 0x7ff938115fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:52.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.418+0000 7ff936ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff93806b9c0 0x7ff938115fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44152/0 (socket says 172.21.15.8:44152) 2023-10-18T21:00:52.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.418+0000 7ff936ffd700 1 -- 172.21.15.8:0/1326934444 learned_addr learned my addr 172.21.15.8:0/1326934444 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:52.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.418+0000 7ff9377fe700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff93806a3b0 0x7ff938115ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:52.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.418+0000 7ff936ffd700 1 -- 172.21.15.8:0/1326934444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff93806a3b0 msgr2=0x7ff938115ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:52.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.418+0000 7ff936ffd700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff93806a3b0 0x7ff938115ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.418+0000 7ff936ffd700 1 -- 172.21.15.8:0/1326934444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928005040 con 0x7ff93806b9c0 2023-10-18T21:00:52.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.418+0000 7ff9377fe700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff93806a3b0 0x7ff938115ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:00:52.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.420+0000 7ff936ffd700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff93806b9c0 0x7ff938115fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ff924009870 tx=0x7ff92400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:52.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.421+0000 7ff92ffff700 1 -- 172.21.15.8:0/1326934444 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff92400e070 con 0x7ff93806b9c0 2023-10-18T21:00:52.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.421+0000 7ff92ffff700 1 -- 172.21.15.8:0/1326934444 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff924007ba0 con 0x7ff93806b9c0 2023-10-18T21:00:52.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.421+0000 7ff92ffff700 1 -- 172.21.15.8:0/1326934444 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff924019070 con 0x7ff93806b9c0 2023-10-18T21:00:52.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.421+0000 7ff93c98e700 1 -- 172.21.15.8:0/1326934444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff924005040 con 0x7ff93806b9c0 2023-10-18T21:00:52.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.421+0000 7ff93c98e700 1 -- 172.21.15.8:0/1326934444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff938117350 con 0x7ff93806b9c0 2023-10-18T21:00:52.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.423+0000 7ff93c98e700 1 -- 172.21.15.8:0/1326934444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff938045ad0 con 0x7ff93806b9c0 2023-10-18T21:00:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.427+0000 7ff92ffff700 1 -- 172.21.15.8:0/1326934444 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff924007d10 con 0x7ff93806b9c0 2023-10-18T21:00:52.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.428+0000 7ff92ffff700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff91c061010 0x7ff91c0634d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:52.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.428+0000 7ff92ffff700 1 -- 172.21.15.8:0/1326934444 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7ff92407d170 con 0x7ff93806b9c0 2023-10-18T21:00:52.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.429+0000 7ff9377fe700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff91c061010 0x7ff91c0634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:52.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.429+0000 7ff9377fe700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff91c061010 0x7ff91c0634d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff928009fd0 tx=0x7ff928009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:52.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.438+0000 7ff92ffff700 1 -- 172.21.15.8:0/1326934444 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff924050fb0 con 0x7ff93806b9c0 2023-10-18T21:00:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:51.177824+0000 mgr.smithi008.flmjzp (mgr.14640) 120 : audit [DBG] from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:51.177824+0000 mgr.smithi008.flmjzp (mgr.14640) 120 : audit [DBG] from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.738+0000 7ff93c98e700 1 -- 172.21.15.8:0/1326934444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff938062270 con 0x7ff93806b9c0 2023-10-18T21:00:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.738+0000 7ff92ffff700 1 -- 172.21.15.8:0/1326934444 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7ff924023070 con 0x7ff93806b9c0 2023-10-18T21:00:52.740 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:00:52.740 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:00:52.740 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:00:52.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:00:52.741 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:00:52.741 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:00:52.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:00:52.741 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:00:52.741 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1, 2023-10-18T21:00:52.742 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2023-10-18T21:00:52.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:00:52.742 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:00:52.742 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T21:00:52.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:00:52.743 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:00:52.743 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 5, 2023-10-18T21:00:52.743 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9 2023-10-18T21:00:52.743 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:00:52.744 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:00:52.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.740+0000 7ff93c98e700 1 -- 172.21.15.8:0/1326934444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff91c061010 msgr2=0x7ff91c0634d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:52.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.740+0000 7ff93c98e700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff91c061010 0x7ff91c0634d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff928009fd0 tx=0x7ff928009b30).stop 2023-10-18T21:00:52.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.740+0000 7ff93c98e700 1 -- 172.21.15.8:0/1326934444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff93806b9c0 msgr2=0x7ff938115fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:52.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.740+0000 7ff93c98e700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff93806b9c0 0x7ff938115fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ff924009870 tx=0x7ff92400b040).stop 2023-10-18T21:00:52.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.741+0000 7ff93c98e700 1 -- 172.21.15.8:0/1326934444 shutdown_connections 2023-10-18T21:00:52.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.741+0000 7ff93c98e700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff91c061010 0x7ff91c0634d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.741+0000 7ff93c98e700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff93806a3b0 0x7ff938115ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.741+0000 7ff93c98e700 1 --2- 172.21.15.8:0/1326934444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff93806b9c0 0x7ff938115fd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.741+0000 7ff93c98e700 1 -- 172.21.15.8:0/1326934444 >> 172.21.15.8:0/1326934444 conn(0x7ff9380f1c90 msgr2=0x7ff9380f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:52.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.741+0000 7ff93c98e700 1 -- 172.21.15.8:0/1326934444 shutdown_connections 2023-10-18T21:00:52.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.741+0000 7ff93c98e700 1 -- 172.21.15.8:0/1326934444 wait complete. 2023-10-18T21:00:52.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.908+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/2945100337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd00f6530 msgr2=0x7f1fd00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:52.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.908+0000 7f1fd5c3b700 1 --2- 172.21.15.8:0/2945100337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd00f6530 0x7f1fd00f6950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1fc4004660 tx=0x7f1fc4009b30).stop 2023-10-18T21:00:52.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.908+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/2945100337 shutdown_connections 2023-10-18T21:00:52.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.908+0000 7f1fd5c3b700 1 --2- 172.21.15.8:0/2945100337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fd00f77d0 0x7f1fd00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.908+0000 7f1fd5c3b700 1 --2- 172.21.15.8:0/2945100337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd00f6530 0x7f1fd00f6950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.908+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/2945100337 >> 172.21.15.8:0/2945100337 conn(0x7f1fd00f1c90 msgr2=0x7f1fd00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:52.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.909+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/2945100337 shutdown_connections 2023-10-18T21:00:52.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.909+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/2945100337 wait complete. 2023-10-18T21:00:52.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.910+0000 7f1fd5c3b700 1 Processor -- start 2023-10-18T21:00:52.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.910+0000 7f1fd5c3b700 1 -- start start 2023-10-18T21:00:52.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.911+0000 7f1fd5c3b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fd00f6530 0x7f1fd0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:52.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.911+0000 7f1fd5c3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd00f77d0 0x7f1fd0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:52.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.911+0000 7f1fd5c3b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0109a00 con 0x7f1fd00f77d0 2023-10-18T21:00:52.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.911+0000 7f1fd5c3b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0109b40 con 0x7f1fd00f6530 2023-10-18T21:00:52.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.911+0000 7f1fcffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd00f77d0 0x7f1fd0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:52.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.911+0000 7f1fcffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd00f77d0 0x7f1fd0109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44178/0 (socket says 172.21.15.8:44178) 2023-10-18T21:00:52.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.911+0000 7f1fcffff700 1 -- 172.21.15.8:0/981639323 learned_addr learned my addr 172.21.15.8:0/981639323 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:52.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.911+0000 7f1fd4c39700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fd00f6530 0x7f1fd0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:52.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.912+0000 7f1fcffff700 1 -- 172.21.15.8:0/981639323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fd00f6530 msgr2=0x7f1fd0108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:52.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.912+0000 7f1fcffff700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fd00f6530 0x7f1fd0108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:52.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.912+0000 7f1fcffff700 1 -- 172.21.15.8:0/981639323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4005040 con 0x7f1fd00f77d0 2023-10-18T21:00:52.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.912+0000 7f1fcffff700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd00f77d0 0x7f1fd0109450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f1fbc00e7f0 tx=0x7f1fbc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:52.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.912+0000 7f1fcd7fa700 1 -- 172.21.15.8:0/981639323 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fbc0092e0 con 0x7f1fd00f77d0 2023-10-18T21:00:52.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.912+0000 7f1fcd7fa700 1 -- 172.21.15.8:0/981639323 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1fbc00f040 con 0x7f1fd00f77d0 2023-10-18T21:00:52.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.912+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/981639323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd010a4e0 con 0x7f1fd00f77d0 2023-10-18T21:00:52.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.912+0000 7f1fcd7fa700 1 -- 172.21.15.8:0/981639323 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fbc0147e0 con 0x7f1fd00f77d0 2023-10-18T21:00:52.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.912+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/981639323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd010aa20 con 0x7f1fd00f77d0 2023-10-18T21:00:52.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.913+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/981639323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd0045ad0 con 0x7f1fd00f77d0 2023-10-18T21:00:52.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.914+0000 7f1fcd7fa700 1 -- 172.21.15.8:0/981639323 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1fbc01b030 con 0x7f1fd00f77d0 2023-10-18T21:00:52.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.915+0000 7f1fcd7fa700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc0060f70 0x7f1fc0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:52.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.915+0000 7f1fcd7fa700 1 -- 172.21.15.8:0/981639323 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f1fbc07bfe0 con 0x7f1fd00f77d0 2023-10-18T21:00:52.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.915+0000 7f1fd4c39700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc0060f70 0x7f1fc0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:52.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.916+0000 7f1fd4c39700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc0060f70 0x7f1fc0063430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1fc4009720 tx=0x7f1fc4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:52.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:52.923+0000 7f1fcd7fa700 1 -- 172.21.15.8:0/981639323 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1fbc0aaf20 con 0x7f1fd00f77d0 2023-10-18T21:00:53.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.323+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/981639323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1fd0027a00 con 0x7f1fd00f77d0 2023-10-18T21:00:53.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.324+0000 7f1fcd7fa700 1 -- 172.21.15.8:0/981639323 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1794 (secure 0 0 0) 0x7f1fbc019070 con 0x7f1fd00f77d0 2023-10-18T21:00:53.326 INFO:teuthology.orchestra.run.smithi008.stdout:e17 2023-10-18T21:00:53.326 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:00:53.326 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:00:53.327 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:00:53.327 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:00:53.327 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:00:53.327 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:00:53.327 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 17 2023-10-18T21:00:53.328 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T21:00:53.328 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:00:53.328 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:59:22.221117+0000 2023-10-18T21:00:53.328 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:00:53.328 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:00:53.329 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:00:53.329 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:00:53.329 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:00:53.329 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:00:53.329 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:00:53.330 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T21:00:53.330 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:00:53.330 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T21:00:53.330 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T21:00:53.331 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T21:00:53.331 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:00:53.331 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:00:53.331 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T21:00:53.331 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:00:53.332 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:00:53.332 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:00:53.332 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:00:53.332 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:00:53.332 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:00:53.333 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:00:53.333 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:00:53.333 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:00:53.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:00:53.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:00:53.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.326+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/981639323 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc0060f70 msgr2=0x7f1fc0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:53.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.326+0000 7f1fd5c3b700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc0060f70 0x7f1fc0063430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1fc4009720 tx=0x7f1fc4016040).stop 2023-10-18T21:00:53.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.327+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/981639323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd00f77d0 msgr2=0x7f1fd0109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:53.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.327+0000 7f1fd5c3b700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd00f77d0 0x7f1fd0109450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f1fbc00e7f0 tx=0x7f1fbc00b040).stop 2023-10-18T21:00:53.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.327+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/981639323 shutdown_connections 2023-10-18T21:00:53.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.327+0000 7f1fd5c3b700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc0060f70 0x7f1fc0063430 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0x7f1fc4009720 tx=0x7f1fc4016040).stop 2023-10-18T21:00:53.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.327+0000 7f1fd5c3b700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fd00f6530 0x7f1fd0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:53.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.327+0000 7f1fd5c3b700 1 --2- 172.21.15.8:0/981639323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fd00f77d0 0x7f1fd0109450 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0x7f1fbc00e7f0 tx=0x7f1fbc00b040).stop 2023-10-18T21:00:53.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.327+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/981639323 >> 172.21.15.8:0/981639323 conn(0x7f1fd00f1c90 msgr2=0x7f1fd006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:53.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.328+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/981639323 shutdown_connections 2023-10-18T21:00:53.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.328+0000 7f1fd5c3b700 1 -- 172.21.15.8:0/981639323 wait complete. 2023-10-18T21:00:53.337 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-18T21:00:53.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.569+0000 7fe5b15f5700 1 -- 172.21.15.8:0/2975688122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5ac0f77d0 msgr2=0x7fe5ac0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:53.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.569+0000 7fe5b15f5700 1 --2- 172.21.15.8:0/2975688122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5ac0f77d0 0x7fe5ac0f7c30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fe5a0004660 tx=0x7fe5a0009b30).stop 2023-10-18T21:00:53.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.569+0000 7fe5b15f5700 1 -- 172.21.15.8:0/2975688122 shutdown_connections 2023-10-18T21:00:53.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.569+0000 7fe5b15f5700 1 --2- 172.21.15.8:0/2975688122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5ac0f77d0 0x7fe5ac0f7c30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:53.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.569+0000 7fe5b15f5700 1 --2- 172.21.15.8:0/2975688122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5ac0f6530 0x7fe5ac0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:53.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.569+0000 7fe5b15f5700 1 -- 172.21.15.8:0/2975688122 >> 172.21.15.8:0/2975688122 conn(0x7fe5ac0f1c90 msgr2=0x7fe5ac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:53.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.569+0000 7fe5b15f5700 1 -- 172.21.15.8:0/2975688122 shutdown_connections 2023-10-18T21:00:53.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.569+0000 7fe5b15f5700 1 -- 172.21.15.8:0/2975688122 wait complete. 2023-10-18T21:00:53.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.570+0000 7fe5b15f5700 1 Processor -- start 2023-10-18T21:00:53.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.570+0000 7fe5b15f5700 1 -- start start 2023-10-18T21:00:53.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.571+0000 7fe5b15f5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5ac0f6530 0x7fe5ac10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:53.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.571+0000 7fe5b15f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5ac10dab0 0x7fe5ac10e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:53.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.571+0000 7fe5b15f5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac10df80 con 0x7fe5ac10dab0 2023-10-18T21:00:53.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.571+0000 7fe5b15f5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac10e0c0 con 0x7fe5ac0f6530 2023-10-18T21:00:53.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.571+0000 7fe5abfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5ac0f6530 0x7fe5ac10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:53.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.571+0000 7fe5abfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5ac0f6530 0x7fe5ac10d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:44966/0 (socket says 172.21.15.8:44966) 2023-10-18T21:00:53.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.571+0000 7fe5abfff700 1 -- 172.21.15.8:0/1807458632 learned_addr learned my addr 172.21.15.8:0/1807458632 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:00:53.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.572+0000 7fe5ab7fe700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5ac10dab0 0x7fe5ac10e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:53.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.572+0000 7fe5abfff700 1 -- 172.21.15.8:0/1807458632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5ac10dab0 msgr2=0x7fe5ac10e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:53.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.572+0000 7fe5abfff700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5ac10dab0 0x7fe5ac10e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:53.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.572+0000 7fe5abfff700 1 -- 172.21.15.8:0/1807458632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a0005040 con 0x7fe5ac0f6530 2023-10-18T21:00:53.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.572+0000 7fe5abfff700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5ac0f6530 0x7fe5ac10d5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe59c002700 tx=0x7fe59c009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:53.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.572+0000 7fe5a8ff9700 1 -- 172.21.15.8:0/1807458632 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe59c009320 con 0x7fe5ac0f6530 2023-10-18T21:00:53.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.573+0000 7fe5a8ff9700 1 -- 172.21.15.8:0/1807458632 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe59c00f040 con 0x7fe5ac0f6530 2023-10-18T21:00:53.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.573+0000 7fe5a8ff9700 1 -- 172.21.15.8:0/1807458632 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe59c014970 con 0x7fe5ac0f6530 2023-10-18T21:00:53.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.573+0000 7fe5b15f5700 1 -- 172.21.15.8:0/1807458632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac10ef50 con 0x7fe5ac0f6530 2023-10-18T21:00:53.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.573+0000 7fe5b15f5700 1 -- 172.21.15.8:0/1807458632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac10f510 con 0x7fe5ac0f6530 2023-10-18T21:00:53.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.574+0000 7fe5b15f5700 1 -- 172.21.15.8:0/1807458632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ac059100 con 0x7fe5ac0f6530 2023-10-18T21:00:53.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.576+0000 7fe5a8ff9700 1 -- 172.21.15.8:0/1807458632 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe59c009480 con 0x7fe5ac0f6530 2023-10-18T21:00:53.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.577+0000 7fe5a8ff9700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe594060f70 0x7fe594063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:00:53.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.577+0000 7fe5a8ff9700 1 -- 172.21.15.8:0/1807458632 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fe59c07c6f0 con 0x7fe5ac0f6530 2023-10-18T21:00:53.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.578+0000 7fe5ab7fe700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe594060f70 0x7fe594063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:00:53.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.578+0000 7fe5ab7fe700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe594060f70 0x7fe594063430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe5a0009040 tx=0x7fe5a0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:00:53.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.580+0000 7fe5a8ff9700 1 -- 172.21.15.8:0/1807458632 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe59c050530 con 0x7fe5ac0f6530 2023-10-18T21:00:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:51.772309+0000 mgr.smithi008.flmjzp (mgr.14640) 121 : audit [DBG] from='client.44157 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:52.152335+0000 mgr.smithi008.flmjzp (mgr.14640) 122 : cluster [DBG] pgmap v83: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 57 active+clean; 347 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 326 op/s; 557/10884 objects degraded (5.118%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:52.160899+0000 mgr.smithi008.flmjzp (mgr.14640) 123 : audit [DBG] from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:52.739009+0000 mon.smithi008 (mon.0) 160 : audit [DBG] from='client.? 172.21.15.8:0/1326934444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:00:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.095013+0000 mon.smithi008 (mon.0) 161 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:00:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:51.772309+0000 mgr.smithi008.flmjzp (mgr.14640) 121 : audit [DBG] from='client.44157 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:52.152335+0000 mgr.smithi008.flmjzp (mgr.14640) 122 : cluster [DBG] pgmap v83: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 57 active+clean; 347 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 326 op/s; 557/10884 objects degraded (5.118%); 0 B/s, 14 objects/s recovering 2023-10-18T21:00:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:52.160899+0000 mgr.smithi008.flmjzp (mgr.14640) 123 : audit [DBG] from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:52.739009+0000 mon.smithi008 (mon.0) 160 : audit [DBG] from='client.? 172.21.15.8:0/1326934444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:00:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.095013+0000 mon.smithi008 (mon.0) 161 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:00:53.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.886+0000 7fe5b15f5700 1 -- 172.21.15.8:0/1807458632 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5ac0fed30 con 0x7fe594060f70 2023-10-18T21:00:53.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.888+0000 7fe5a8ff9700 1 -- 172.21.15.8:0/1807458632 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe5ac0fed30 con 0x7fe594060f70 2023-10-18T21:00:53.889 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:00:53.890 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:00:53.890 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:00:53.890 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:00:53.890 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:00:53.890 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:00:53.891 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:00:53.891 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:00:53.891 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:00:53.891 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "7/21 daemons upgraded", 2023-10-18T21:00:53.891 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading osd daemons", 2023-10-18T21:00:53.892 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:00:53.892 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:00:53.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 -- 172.21.15.8:0/1807458632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe594060f70 msgr2=0x7fe594063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:53.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe594060f70 0x7fe594063430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe5a0009040 tx=0x7fe5a0009b30).stop 2023-10-18T21:00:53.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 -- 172.21.15.8:0/1807458632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5ac0f6530 msgr2=0x7fe5ac10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:00:53.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5ac0f6530 0x7fe5ac10d5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe59c002700 tx=0x7fe59c009d80).stop 2023-10-18T21:00:53.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 -- 172.21.15.8:0/1807458632 shutdown_connections 2023-10-18T21:00:53.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe594060f70 0x7fe594063430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:53.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5ac0f6530 0x7fe5ac10d5c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:53.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 --2- 172.21.15.8:0/1807458632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5ac10dab0 0x7fe5ac10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:00:53.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 -- 172.21.15.8:0/1807458632 >> 172.21.15.8:0/1807458632 conn(0x7fe5ac0f1c90 msgr2=0x7fe5ac0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:00:53.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 -- 172.21.15.8:0/1807458632 shutdown_connections 2023-10-18T21:00:53.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:00:53.890+0000 7fe5b15f5700 1 -- 172.21.15.8:0/1807458632 wait complete. 2023-10-18T21:00:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.324540+0000 mon.smithi008 (mon.0) 162 : audit [DBG] from='client.? 172.21.15.8:0/981639323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:00:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.899956+0000 mon.smithi008 (mon.0) 163 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:00:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.900890+0000 mon.smithi008 (mon.0) 164 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:00:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.905864+0000 mon.smithi008 (mon.0) 165 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:00:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.913769+0000 mon.smithi008 (mon.0) 166 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:00:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.917057+0000 mon.smithi008 (mon.0) 167 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:00:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.919089+0000 mon.smithi008 (mon.0) 168 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:00:54.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.920623+0000 mon.smithi008 (mon.0) 169 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:00:54.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.923334+0000 mon.smithi008 (mon.0) 170 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.324540+0000 mon.smithi008 (mon.0) 162 : audit [DBG] from='client.? 172.21.15.8:0/981639323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:00:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.899956+0000 mon.smithi008 (mon.0) 163 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:00:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.900890+0000 mon.smithi008 (mon.0) 164 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:00:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.905864+0000 mon.smithi008 (mon.0) 165 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:00:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.913769+0000 mon.smithi008 (mon.0) 166 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:00:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.917057+0000 mon.smithi008 (mon.0) 167 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:00:54.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.919089+0000 mon.smithi008 (mon.0) 168 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:00:54.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.920623+0000 mon.smithi008 (mon.0) 169 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:00:54.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.923334+0000 mon.smithi008 (mon.0) 170 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.887985+0000 mgr.smithi008.flmjzp (mgr.14640) 124 : audit [DBG] from='client.44173 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:00:53.901672+0000 mgr.smithi008.flmjzp (mgr.14640) 125 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:00:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:00:53.923521+0000 mgr.smithi008.flmjzp (mgr.14640) 126 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:00:53.924325+0000 mgr.smithi008.flmjzp (mgr.14640) 127 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2023-10-18T21:00:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:54.152719+0000 mgr.smithi008.flmjzp (mgr.14640) 128 : cluster [DBG] pgmap v84: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 57 active+clean; 347 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1007 KiB/s rd, 977 KiB/s wr, 216 op/s; 557/10884 objects degraded (5.118%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:54.831722+0000 mon.smithi008 (mon.0) 171 : cluster [WRN] Health check update: Degraded data redundancy: 557/10884 objects degraded (5.118%), 7 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.887985+0000 mgr.smithi008.flmjzp (mgr.14640) 124 : audit [DBG] from='client.44173 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:00:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:00:53.901672+0000 mgr.smithi008.flmjzp (mgr.14640) 125 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:00:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:00:53.923521+0000 mgr.smithi008.flmjzp (mgr.14640) 126 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:00:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:00:53.924325+0000 mgr.smithi008.flmjzp (mgr.14640) 127 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2023-10-18T21:00:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:54.152719+0000 mgr.smithi008.flmjzp (mgr.14640) 128 : cluster [DBG] pgmap v84: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 57 active+clean; 347 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1007 KiB/s rd, 977 KiB/s wr, 216 op/s; 557/10884 objects degraded (5.118%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:54.831722+0000 mon.smithi008 (mon.0) 171 : cluster [WRN] Health check update: Degraded data redundancy: 557/10884 objects degraded (5.118%), 7 pgs degraded (PG_DEGRADED) 2023-10-18T21:00:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:56.153188+0000 mgr.smithi008.flmjzp (mgr.14640) 129 : cluster [DBG] pgmap v85: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovery_wait+degraded, 58 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1007 KiB/s rd, 977 KiB/s wr, 224 op/s; 557/10596 objects degraded (5.257%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:56.153188+0000 mgr.smithi008.flmjzp (mgr.14640) 129 : cluster [DBG] pgmap v85: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 5 active+recovery_wait+degraded, 58 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1007 KiB/s rd, 977 KiB/s wr, 224 op/s; 557/10596 objects degraded (5.257%); 0 B/s, 9 objects/s recovering 2023-10-18T21:00:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:00:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:58.153712+0000 mgr.smithi008.flmjzp (mgr.14640) 130 : cluster [DBG] pgmap v86: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 4 active+recovery_wait+degraded, 58 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 297 op/s; 473/8439 objects degraded (5.605%); 0 B/s, 13 objects/s recovering 2023-10-18T21:00:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:00:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:58.153712+0000 mgr.smithi008.flmjzp (mgr.14640) 130 : cluster [DBG] pgmap v86: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 4 active+recovery_wait+degraded, 58 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 297 op/s; 473/8439 objects degraded (5.605%); 0 B/s, 13 objects/s recovering 2023-10-18T21:01:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:00:59.832910+0000 mon.smithi008 (mon.0) 172 : cluster [WRN] Health check update: Degraded data redundancy: 473/8439 objects degraded (5.605%), 6 pgs degraded (PG_DEGRADED) 2023-10-18T21:01:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:00:59.832910+0000 mon.smithi008 (mon.0) 172 : cluster [WRN] Health check update: Degraded data redundancy: 473/8439 objects degraded (5.605%), 6 pgs degraded (PG_DEGRADED) 2023-10-18T21:01:01.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:00.154150+0000 mgr.smithi008.flmjzp (mgr.14640) 131 : cluster [DBG] pgmap v87: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 4 active+recovery_wait+degraded, 58 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 885 KiB/s rd, 930 KiB/s wr, 190 op/s; 473/8439 objects degraded (5.605%); 0 B/s, 9 objects/s recovering 2023-10-18T21:01:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:00.154150+0000 mgr.smithi008.flmjzp (mgr.14640) 131 : cluster [DBG] pgmap v87: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 4 active+recovery_wait+degraded, 58 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 885 KiB/s rd, 930 KiB/s wr, 190 op/s; 473/8439 objects degraded (5.605%); 0 B/s, 9 objects/s recovering 2023-10-18T21:01:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:02.154677+0000 mgr.smithi008.flmjzp (mgr.14640) 132 : cluster [DBG] pgmap v88: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovery_wait+degraded, 60 active+clean; 347 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 295 op/s; 349/5607 objects degraded (6.224%); 0 B/s, 16 objects/s recovering 2023-10-18T21:01:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:02.154677+0000 mgr.smithi008.flmjzp (mgr.14640) 132 : cluster [DBG] pgmap v88: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovery_wait+degraded, 60 active+clean; 347 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 295 op/s; 349/5607 objects degraded (6.224%); 0 B/s, 16 objects/s recovering 2023-10-18T21:01:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:04.158787+0000 mgr.smithi008.flmjzp (mgr.14640) 133 : cluster [DBG] pgmap v89: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovery_wait+degraded, 60 active+clean; 347 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 934 KiB/s rd, 955 KiB/s wr, 198 op/s; 349/5607 objects degraded (6.224%); 0 B/s, 11 objects/s recovering 2023-10-18T21:01:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:04.834089+0000 mon.smithi008 (mon.0) 173 : cluster [WRN] Health check update: Degraded data redundancy: 349/5607 objects degraded (6.224%), 4 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2023-10-18T21:01:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:04.158787+0000 mgr.smithi008.flmjzp (mgr.14640) 133 : cluster [DBG] pgmap v89: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovery_wait+degraded, 60 active+clean; 347 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 934 KiB/s rd, 955 KiB/s wr, 198 op/s; 349/5607 objects degraded (6.224%); 0 B/s, 11 objects/s recovering 2023-10-18T21:01:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:04.834089+0000 mon.smithi008 (mon.0) 173 : cluster [WRN] Health check update: Degraded data redundancy: 349/5607 objects degraded (6.224%), 4 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2023-10-18T21:01:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:06.159273+0000 mgr.smithi008.flmjzp (mgr.14640) 134 : cluster [DBG] pgmap v90: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovery_wait+degraded, 60 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 936 KiB/s rd, 957 KiB/s wr, 210 op/s; 349/5232 objects degraded (6.670%); 0 B/s, 11 objects/s recovering 2023-10-18T21:01:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:06.159273+0000 mgr.smithi008.flmjzp (mgr.14640) 134 : cluster [DBG] pgmap v90: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovery_wait+degraded, 60 active+clean; 346 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 936 KiB/s rd, 957 KiB/s wr, 210 op/s; 349/5232 objects degraded (6.670%); 0 B/s, 11 objects/s recovering 2023-10-18T21:01:07.964 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-10-18T21:01:07.964 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-18T21:01:08.558 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-10-18T21:01:08.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-10-18T21:01:08.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:07.339028+0000 mon.smithi008 (mon.0) 174 : cluster [DBG] osdmap e54: 6 total, 6 up, 6 in 2023-10-18T21:01:08.659 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:07.339028+0000 mon.smithi008 (mon.0) 174 : cluster [DBG] osdmap e54: 6 total, 6 up, 6 in 2023-10-18T21:01:08.940 DEBUG:teuthology.parallel:result is None 2023-10-18T21:01:09.575 DEBUG:teuthology.parallel:result is None 2023-10-18T21:01:09.576 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-18T21:01:09.642 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:08.159721+0000 mgr.smithi008.flmjzp (mgr.14640) 135 : cluster [DBG] pgmap v92: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovery_wait+degraded, 60 active+clean; 343 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 261 op/s; 349/2271 objects degraded (15.368%); 0 B/s, 13 objects/s recovering 2023-10-18T21:01:09.642 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:08.343980+0000 mon.smithi008 (mon.0) 175 : cluster [DBG] osdmap e55: 6 total, 6 up, 6 in 2023-10-18T21:01:09.642 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:08.933917+0000 mon.smithi008 (mon.0) 176 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:09.657 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-18T21:01:09.658 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-10-18T21:01:09.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:08.159721+0000 mgr.smithi008.flmjzp (mgr.14640) 135 : cluster [DBG] pgmap v92: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovery_wait+degraded, 60 active+clean; 343 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 261 op/s; 349/2271 objects degraded (15.368%); 0 B/s, 13 objects/s recovering 2023-10-18T21:01:09.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:08.343980+0000 mon.smithi008 (mon.0) 175 : cluster [DBG] osdmap e55: 6 total, 6 up, 6 in 2023-10-18T21:01:09.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:08.933917+0000 mon.smithi008 (mon.0) 176 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:09.737 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-10-18T21:01:09.737 DEBUG:teuthology.parallel:result is None 2023-10-18T21:01:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:08.934109+0000 mgr.smithi008.flmjzp (mgr.14640) 136 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:01:08.935054+0000 mgr.smithi008.flmjzp (mgr.14640) 137 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2023-10-18T21:01:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:09.834944+0000 mon.smithi008 (mon.0) 177 : cluster [WRN] Health check update: Degraded data redundancy: 349/2271 objects degraded (15.368%), 4 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2023-10-18T21:01:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:08.934109+0000 mgr.smithi008.flmjzp (mgr.14640) 136 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:01:08.935054+0000 mgr.smithi008.flmjzp (mgr.14640) 137 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2023-10-18T21:01:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:09.834944+0000 mon.smithi008 (mon.0) 177 : cluster [WRN] Health check update: Degraded data redundancy: 349/2271 objects degraded (15.368%), 4 pgs degraded, 2 pgs undersized (PG_DEGRADED) 2023-10-18T21:01:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:10.160130+0000 mgr.smithi008.flmjzp (mgr.14640) 138 : cluster [DBG] pgmap v94: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovery_wait+degraded, 60 active+clean; 343 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 662 KiB/s rd, 721 KiB/s wr, 171 op/s; 349/2271 objects degraded (15.368%); 0 B/s, 7 objects/s recovering 2023-10-18T21:01:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:10.160130+0000 mgr.smithi008.flmjzp (mgr.14640) 138 : cluster [DBG] pgmap v94: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+recovery_wait+degraded, 60 active+clean; 343 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 662 KiB/s rd, 721 KiB/s wr, 171 op/s; 349/2271 objects degraded (15.368%); 0 B/s, 7 objects/s recovering 2023-10-18T21:01:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:12.160979+0000 mgr.smithi008.flmjzp (mgr.14640) 139 : cluster [DBG] pgmap v95: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 1 active+recovery_wait+degraded, 62 active+clean; 327 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 267 op/s; 196/375 objects degraded (52.267%); 0 B/s, 23 objects/s recovering 2023-10-18T21:01:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:12.160979+0000 mgr.smithi008.flmjzp (mgr.14640) 139 : cluster [DBG] pgmap v95: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 1 active+recovery_wait+degraded, 62 active+clean; 327 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 267 op/s; 196/375 objects degraded (52.267%); 0 B/s, 23 objects/s recovering 2023-10-18T21:01:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:14.161369+0000 mgr.smithi008.flmjzp (mgr.14640) 140 : cluster [DBG] pgmap v96: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 1 active+recovery_wait+degraded, 62 active+clean; 327 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 250 op/s; 196/375 objects degraded (52.267%); 0 B/s, 23 objects/s recovering 2023-10-18T21:01:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:14.835816+0000 mon.smithi008 (mon.0) 178 : cluster [WRN] Health check update: Degraded data redundancy: 196/375 objects degraded (52.267%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2023-10-18T21:01:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:14.161369+0000 mgr.smithi008.flmjzp (mgr.14640) 140 : cluster [DBG] pgmap v96: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 1 active+recovery_wait+degraded, 62 active+clean; 327 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 250 op/s; 196/375 objects degraded (52.267%); 0 B/s, 23 objects/s recovering 2023-10-18T21:01:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:14.835816+0000 mon.smithi008 (mon.0) 178 : cluster [WRN] Health check update: Degraded data redundancy: 196/375 objects degraded (52.267%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2023-10-18T21:01:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:16.161703+0000 mgr.smithi008.flmjzp (mgr.14640) 141 : cluster [DBG] pgmap v97: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 1 active+recovery_wait+degraded, 62 active+clean; 327 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 334 KiB/s rd, 288 KiB/s wr, 87 op/s; 196/375 objects degraded (52.267%); 0 B/s, 15 objects/s recovering 2023-10-18T21:01:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:16.161703+0000 mgr.smithi008.flmjzp (mgr.14640) 141 : cluster [DBG] pgmap v97: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 1 active+recovery_wait+degraded, 62 active+clean; 327 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 334 KiB/s rd, 288 KiB/s wr, 87 op/s; 196/375 objects degraded (52.267%); 0 B/s, 15 objects/s recovering 2023-10-18T21:01:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:18.162105+0000 mgr.smithi008.flmjzp (mgr.14640) 142 : cluster [DBG] pgmap v98: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 63 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 298 KiB/s rd, 256 KiB/s wr, 81 op/s; 88/369 objects degraded (23.848%); 0 B/s, 19 objects/s recovering 2023-10-18T21:01:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:18.162105+0000 mgr.smithi008.flmjzp (mgr.14640) 142 : cluster [DBG] pgmap v98: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 63 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 298 KiB/s rd, 256 KiB/s wr, 81 op/s; 88/369 objects degraded (23.848%); 0 B/s, 19 objects/s recovering 2023-10-18T21:01:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:19.836659+0000 mon.smithi008 (mon.0) 179 : cluster [WRN] Health check update: Degraded data redundancy: 88/369 objects degraded (23.848%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2023-10-18T21:01:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:19.836659+0000 mon.smithi008 (mon.0) 179 : cluster [WRN] Health check update: Degraded data redundancy: 88/369 objects degraded (23.848%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2023-10-18T21:01:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:20.162410+0000 mgr.smithi008.flmjzp (mgr.14640) 143 : cluster [DBG] pgmap v99: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 63 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 252 KiB/s rd, 217 KiB/s wr, 68 op/s; 88/369 objects degraded (23.848%); 0 B/s, 16 objects/s recovering 2023-10-18T21:01:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:20.162410+0000 mgr.smithi008.flmjzp (mgr.14640) 143 : cluster [DBG] pgmap v99: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 63 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 252 KiB/s rd, 217 KiB/s wr, 68 op/s; 88/369 objects degraded (23.848%); 0 B/s, 16 objects/s recovering 2023-10-18T21:01:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:22.162861+0000 mgr.smithi008.flmjzp (mgr.14640) 144 : cluster [DBG] pgmap v100: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 63 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 249 KiB/s rd, 214 KiB/s wr, 69 op/s; 88/369 objects degraded (23.848%); 0 B/s, 20 objects/s recovering 2023-10-18T21:01:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:22.162861+0000 mgr.smithi008.flmjzp (mgr.14640) 144 : cluster [DBG] pgmap v100: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 63 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 249 KiB/s rd, 214 KiB/s wr, 69 op/s; 88/369 objects degraded (23.848%); 0 B/s, 20 objects/s recovering 2023-10-18T21:01:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.053+0000 7f8c5ffff700 1 -- 172.21.15.8:0/2512788309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c600f77d0 msgr2=0x7f8c600f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.053+0000 7f8c5ffff700 1 --2- 172.21.15.8:0/2512788309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c600f77d0 0x7f8c600f7c30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8c54004660 tx=0x7f8c54009b30).stop 2023-10-18T21:01:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.053+0000 7f8c5ffff700 1 -- 172.21.15.8:0/2512788309 shutdown_connections 2023-10-18T21:01:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.053+0000 7f8c5ffff700 1 --2- 172.21.15.8:0/2512788309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c600f77d0 0x7f8c600f7c30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.054+0000 7f8c5ffff700 1 --2- 172.21.15.8:0/2512788309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c600f6530 0x7f8c600f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.054+0000 7f8c5ffff700 1 -- 172.21.15.8:0/2512788309 >> 172.21.15.8:0/2512788309 conn(0x7f8c600f1c90 msgr2=0x7f8c600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.054+0000 7f8c5ffff700 1 -- 172.21.15.8:0/2512788309 shutdown_connections 2023-10-18T21:01:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.054+0000 7f8c5ffff700 1 -- 172.21.15.8:0/2512788309 wait complete. 2023-10-18T21:01:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.054+0000 7f8c5ffff700 1 Processor -- start 2023-10-18T21:01:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.055+0000 7f8c5ffff700 1 -- start start 2023-10-18T21:01:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.055+0000 7f8c5ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c600f6530 0x7f8c60106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.055+0000 7f8c5ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c600f77d0 0x7f8c60107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.055+0000 7f8c5ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c60107880 con 0x7f8c600f6530 2023-10-18T21:01:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.055+0000 7f8c5ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601080c0 con 0x7f8c600f77d0 2023-10-18T21:01:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.055+0000 7f8c5effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c600f6530 0x7f8c60106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.055+0000 7f8c5effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c600f6530 0x7f8c60106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52860/0 (socket says 172.21.15.8:52860) 2023-10-18T21:01:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.055+0000 7f8c5effd700 1 -- 172.21.15.8:0/3212158548 learned_addr learned my addr 172.21.15.8:0/3212158548 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.055+0000 7f8c5e7fc700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c600f77d0 0x7f8c60107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.056+0000 7f8c5effd700 1 -- 172.21.15.8:0/3212158548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c600f77d0 msgr2=0x7f8c60107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.056+0000 7f8c5effd700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c600f77d0 0x7f8c60107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.056+0000 7f8c5effd700 1 -- 172.21.15.8:0/3212158548 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c54005040 con 0x7f8c600f6530 2023-10-18T21:01:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.056+0000 7f8c5effd700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c600f6530 0x7f8c60106d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8c50002700 tx=0x7f8c50009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.056+0000 7f8c477fe700 1 -- 172.21.15.8:0/3212158548 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c500079c0 con 0x7f8c600f6530 2023-10-18T21:01:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.056+0000 7f8c477fe700 1 -- 172.21.15.8:0/3212158548 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8c5000f040 con 0x7f8c600f6530 2023-10-18T21:01:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.056+0000 7f8c5ffff700 1 -- 172.21.15.8:0/3212158548 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c601083a0 con 0x7f8c600f6530 2023-10-18T21:01:24.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.056+0000 7f8c477fe700 1 -- 172.21.15.8:0/3212158548 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c500148d0 con 0x7f8c600f6530 2023-10-18T21:01:24.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.056+0000 7f8c5ffff700 1 -- 172.21.15.8:0/3212158548 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c601088e0 con 0x7f8c600f6530 2023-10-18T21:01:24.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.058+0000 7f8c5ffff700 1 -- 172.21.15.8:0/3212158548 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c60059100 con 0x7f8c600f6530 2023-10-18T21:01:24.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.058+0000 7f8c477fe700 1 -- 172.21.15.8:0/3212158548 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8c5001b060 con 0x7f8c600f6530 2023-10-18T21:01:24.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.059+0000 7f8c477fe700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c48060f70 0x7f8c48063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:24.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.060+0000 7f8c477fe700 1 -- 172.21.15.8:0/3212158548 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8c5007bf00 con 0x7f8c600f6530 2023-10-18T21:01:24.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.060+0000 7f8c5e7fc700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c48060f70 0x7f8c48063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.060+0000 7f8c5e7fc700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c48060f70 0x7f8c48063430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8c54004630 tx=0x7f8c54009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.064+0000 7f8c477fe700 1 -- 172.21.15.8:0/3212158548 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8c5004c380 con 0x7f8c600f6530 2023-10-18T21:01:24.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.262+0000 7f8c5ffff700 1 -- 172.21.15.8:0/3212158548 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c600fee30 con 0x7f8c48060f70 2023-10-18T21:01:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.263+0000 7f8c477fe700 1 -- 172.21.15.8:0/3212158548 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8c600fee30 con 0x7f8c48060f70 2023-10-18T21:01:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.265+0000 7f8c5ffff700 1 -- 172.21.15.8:0/3212158548 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c48060f70 msgr2=0x7f8c48063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.265+0000 7f8c5ffff700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c48060f70 0x7f8c48063430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8c54004630 tx=0x7f8c54009b30).stop 2023-10-18T21:01:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.265+0000 7f8c5ffff700 1 -- 172.21.15.8:0/3212158548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c600f6530 msgr2=0x7f8c60106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.265+0000 7f8c5ffff700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c600f6530 0x7f8c60106d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8c50002700 tx=0x7f8c50009d80).stop 2023-10-18T21:01:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.265+0000 7f8c5ffff700 1 -- 172.21.15.8:0/3212158548 shutdown_connections 2023-10-18T21:01:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.265+0000 7f8c5ffff700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c48060f70 0x7f8c48063430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.265+0000 7f8c5ffff700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c600f6530 0x7f8c60106d90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.265+0000 7f8c5ffff700 1 --2- 172.21.15.8:0/3212158548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c600f77d0 0x7f8c60107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.265+0000 7f8c5ffff700 1 -- 172.21.15.8:0/3212158548 >> 172.21.15.8:0/3212158548 conn(0x7f8c600f1c90 msgr2=0x7f8c600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.266+0000 7f8c5ffff700 1 -- 172.21.15.8:0/3212158548 shutdown_connections 2023-10-18T21:01:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.266+0000 7f8c5ffff700 1 -- 172.21.15.8:0/3212158548 wait complete. 2023-10-18T21:01:24.282 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:01:24.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.407+0000 7f47c66b5700 1 -- 172.21.15.8:0/2773222701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47c00f6530 msgr2=0x7f47c00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.407+0000 7f47c66b5700 1 --2- 172.21.15.8:0/2773222701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47c00f6530 0x7f47c00f6950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f47bc004660 tx=0x7f47bc009b30).stop 2023-10-18T21:01:24.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.407+0000 7f47c66b5700 1 -- 172.21.15.8:0/2773222701 shutdown_connections 2023-10-18T21:01:24.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.407+0000 7f47c66b5700 1 --2- 172.21.15.8:0/2773222701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c00f77d0 0x7f47c00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:01:24.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.407+0000 7f47c66b5700 1 --2- 172.21.15.8:0/2773222701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47c00f6530 0x7f47c00f6950 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.407+0000 7f47c66b5700 1 -- 172.21.15.8:0/2773222701 >> 172.21.15.8:0/2773222701 conn(0x7f47c00f1c90 msgr2=0x7f47c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:24.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.407+0000 7f47c66b5700 1 -- 172.21.15.8:0/2773222701 shutdown_connections 2023-10-18T21:01:24.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.407+0000 7f47c66b5700 1 -- 172.21.15.8:0/2773222701 wait complete. 2023-10-18T21:01:24.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.408+0000 7f47c66b5700 1 Processor -- start 2023-10-18T21:01:24.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.408+0000 7f47c66b5700 1 -- start start 2023-10-18T21:01:24.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.408+0000 7f47c66b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c00f6530 0x7f47c006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:24.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c66b5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47c00f77d0 0x7f47c0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:24.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c66b5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c006a410 con 0x7f47c00f77d0 2023-10-18T21:01:24.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c66b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c006a550 con 0x7f47c00f6530 2023-10-18T21:01:24.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c4eb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47c00f77d0 0x7f47c0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:24.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c4eb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47c00f77d0 0x7f47c0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52882/0 (socket says 172.21.15.8:52882) 2023-10-18T21:01:24.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c4eb2700 1 -- 172.21.15.8:0/319922702 learned_addr learned my addr 172.21.15.8:0/319922702 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:24.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c56b3700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c00f6530 0x7f47c006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:24.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c4eb2700 1 -- 172.21.15.8:0/319922702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c00f6530 msgr2=0x7f47c006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c4eb2700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c00f6530 0x7f47c006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c4eb2700 1 -- 172.21.15.8:0/319922702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc005040 con 0x7f47c00f77d0 2023-10-18T21:01:24.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.409+0000 7f47c4eb2700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47c00f77d0 0x7f47c0069e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f47b000b410 tx=0x7f47b0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:24.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.410+0000 7f47b5ffb700 1 -- 172.21.15.8:0/319922702 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b00125f0 con 0x7f47c00f77d0 2023-10-18T21:01:24.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.410+0000 7f47c66b5700 1 -- 172.21.15.8:0/319922702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c006a830 con 0x7f47c00f77d0 2023-10-18T21:01:24.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.410+0000 7f47b5ffb700 1 -- 172.21.15.8:0/319922702 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f47b000be30 con 0x7f47c00f77d0 2023-10-18T21:01:24.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.410+0000 7f47b5ffb700 1 -- 172.21.15.8:0/319922702 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b0002a60 con 0x7f47c00f77d0 2023-10-18T21:01:24.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.410+0000 7f47c66b5700 1 -- 172.21.15.8:0/319922702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c010ee00 con 0x7f47c00f77d0 2023-10-18T21:01:24.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.411+0000 7f47c66b5700 1 -- 172.21.15.8:0/319922702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c0045ad0 con 0x7f47c00f77d0 2023-10-18T21:01:24.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.412+0000 7f47b5ffb700 1 -- 172.21.15.8:0/319922702 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f47b000f030 con 0x7f47c00f77d0 2023-10-18T21:01:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.413+0000 7f47b5ffb700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47ac060f70 0x7f47ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.413+0000 7f47b5ffb700 1 -- 172.21.15.8:0/319922702 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f47b007c5b0 con 0x7f47c00f77d0 2023-10-18T21:01:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.413+0000 7f47c56b3700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47ac060f70 0x7f47ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.414+0000 7f47c56b3700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47ac060f70 0x7f47ac063430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f47bc009490 tx=0x7f47bc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:24.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.417+0000 7f47b5ffb700 1 -- 172.21.15.8:0/319922702 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f47b004c970 con 0x7f47c00f77d0 2023-10-18T21:01:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.618+0000 7f47c66b5700 1 -- 172.21.15.8:0/319922702 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47c00feeb0 con 0x7f47ac060f70 2023-10-18T21:01:24.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.619+0000 7f47b5ffb700 1 -- 172.21.15.8:0/319922702 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f47c00feeb0 con 0x7f47ac060f70 2023-10-18T21:01:24.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 -- 172.21.15.8:0/319922702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47ac060f70 msgr2=0x7f47ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47ac060f70 0x7f47ac063430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f47bc009490 tx=0x7f47bc009b30).stop 2023-10-18T21:01:24.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 -- 172.21.15.8:0/319922702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47c00f77d0 msgr2=0x7f47c0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47c00f77d0 0x7f47c0069e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f47b000b410 tx=0x7f47b0006ef0).stop 2023-10-18T21:01:24.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 -- 172.21.15.8:0/319922702 shutdown_connections 2023-10-18T21:01:24.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47ac060f70 0x7f47ac063430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c00f6530 0x7f47c006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 --2- 172.21.15.8:0/319922702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47c00f77d0 0x7f47c0069e20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 -- 172.21.15.8:0/319922702 >> 172.21.15.8:0/319922702 conn(0x7f47c00f1c90 msgr2=0x7f47c00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:24.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 -- 172.21.15.8:0/319922702 shutdown_connections 2023-10-18T21:01:24.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.621+0000 7f47c66b5700 1 -- 172.21.15.8:0/319922702 wait complete. 2023-10-18T21:01:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:23.373656+0000 mon.smithi008 (mon.0) 180 : cluster [DBG] osdmap e56: 6 total, 6 up, 6 in 2023-10-18T21:01:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:23.950022+0000 mon.smithi008 (mon.0) 181 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:23.373656+0000 mon.smithi008 (mon.0) 180 : cluster [DBG] osdmap e56: 6 total, 6 up, 6 in 2023-10-18T21:01:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:23.950022+0000 mon.smithi008 (mon.0) 181 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.757+0000 7fa8df59e700 1 -- 172.21.15.8:0/2615922709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8e00f6530 msgr2=0x7fa8e00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.757+0000 7fa8df59e700 1 --2- 172.21.15.8:0/2615922709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8e00f6530 0x7fa8e00f6950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa8d0004660 tx=0x7fa8d0009b30).stop 2023-10-18T21:01:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.758+0000 7fa8df59e700 1 -- 172.21.15.8:0/2615922709 shutdown_connections 2023-10-18T21:01:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.758+0000 7fa8df59e700 1 --2- 172.21.15.8:0/2615922709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8e00f77d0 0x7fa8e00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.758+0000 7fa8df59e700 1 --2- 172.21.15.8:0/2615922709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8e00f6530 0x7fa8e00f6950 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.758+0000 7fa8df59e700 1 -- 172.21.15.8:0/2615922709 >> 172.21.15.8:0/2615922709 conn(0x7fa8e00f1c90 msgr2=0x7fa8e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.758+0000 7fa8df59e700 1 -- 172.21.15.8:0/2615922709 shutdown_connections 2023-10-18T21:01:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.758+0000 7fa8df59e700 1 -- 172.21.15.8:0/2615922709 wait complete. 2023-10-18T21:01:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.758+0000 7fa8df59e700 1 Processor -- start 2023-10-18T21:01:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.759+0000 7fa8df59e700 1 -- start start 2023-10-18T21:01:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.759+0000 7fa8df59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8e00f6530 0x7fa8e0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.759+0000 7fa8df59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8e00f77d0 0x7fa8e0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.759+0000 7fa8df59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0107880 con 0x7fa8e00f77d0 2023-10-18T21:01:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.759+0000 7fa8df59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e01080c0 con 0x7fa8e00f6530 2023-10-18T21:01:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.759+0000 7fa8ddd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8e00f77d0 0x7fa8e0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.759+0000 7fa8ddd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8e00f77d0 0x7fa8e0107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52898/0 (socket says 172.21.15.8:52898) 2023-10-18T21:01:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.759+0000 7fa8ddd9b700 1 -- 172.21.15.8:0/2848436422 learned_addr learned my addr 172.21.15.8:0/2848436422 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.759+0000 7fa8de59c700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8e00f6530 0x7fa8e0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.760+0000 7fa8ddd9b700 1 -- 172.21.15.8:0/2848436422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8e00f6530 msgr2=0x7fa8e0106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.760+0000 7fa8ddd9b700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8e00f6530 0x7fa8e0106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.760+0000 7fa8ddd9b700 1 -- 172.21.15.8:0/2848436422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0005040 con 0x7fa8e00f77d0 2023-10-18T21:01:24.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.760+0000 7fa8ddd9b700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8e00f77d0 0x7fa8e0107280 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa8d4002700 tx=0x7fa8d4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:24.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.760+0000 7fa8ceffd700 1 -- 172.21.15.8:0/2848436422 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d4009320 con 0x7fa8e00f77d0 2023-10-18T21:01:24.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.760+0000 7fa8df59e700 1 -- 172.21.15.8:0/2848436422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e01083a0 con 0x7fa8e00f77d0 2023-10-18T21:01:24.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.760+0000 7fa8ceffd700 1 -- 172.21.15.8:0/2848436422 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa8d400f040 con 0x7fa8e00f77d0 2023-10-18T21:01:24.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.760+0000 7fa8ceffd700 1 -- 172.21.15.8:0/2848436422 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d40148f0 con 0x7fa8e00f77d0 2023-10-18T21:01:24.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.760+0000 7fa8df59e700 1 -- 172.21.15.8:0/2848436422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e01088e0 con 0x7fa8e00f77d0 2023-10-18T21:01:24.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.761+0000 7fa8df59e700 1 -- 172.21.15.8:0/2848436422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e0059100 con 0x7fa8e00f77d0 2023-10-18T21:01:24.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.762+0000 7fa8ceffd700 1 -- 172.21.15.8:0/2848436422 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa8d4009480 con 0x7fa8e00f77d0 2023-10-18T21:01:24.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.763+0000 7fa8ceffd700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c8060f70 0x7fa8c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:24.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.764+0000 7fa8ceffd700 1 -- 172.21.15.8:0/2848436422 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa8d407c440 con 0x7fa8e00f77d0 2023-10-18T21:01:24.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.764+0000 7fa8de59c700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c8060f70 0x7fa8c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:24.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.764+0000 7fa8de59c700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c8060f70 0x7fa8c8063430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa8e0107b50 tx=0x7fa8d0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:24.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.768+0000 7fa8ceffd700 1 -- 172.21.15.8:0/2848436422 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa8d404c800 con 0x7fa8e00f77d0 2023-10-18T21:01:24.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.964+0000 7fa8df59e700 1 -- 172.21.15.8:0/2848436422 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8e00fee50 con 0x7fa8c8060f70 2023-10-18T21:01:24.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.974+0000 7fa8ceffd700 1 -- 172.21.15.8:0/2848436422 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa8e00fee50 con 0x7fa8c8060f70 2023-10-18T21:01:24.977 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:01:24.977 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (8m) 92s ago 9m 15.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:01:24.977 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (117s) 92s ago 9m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:01:24.977 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (113s) 109s ago 8m 7566k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:01:24.977 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (8m) 92s ago 9m 25.0M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:01:24.978 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (5m) 92s ago 5m 5328M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T21:01:24.978 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (5m) 92s ago 5m 692M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T21:01:24.978 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (5m) 109s ago 5m 2598M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:01:24.978 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (5m) 109s ago 5m 373M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:01:24.978 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (3m) 92s ago 10m 445M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:01:24.979 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (2m) 109s ago 8m 394M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:01:24.979 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (2m) 92s ago 11m 53.2M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:01:24.979 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (2m) 109s ago 8m 39.6M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:01:24.979 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (9m) 92s ago 9m 9499k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:01:24.979 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (8m) 109s ago 8m 9903k - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:01:24.979 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (98s) 92s ago 8m 10.7M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:01:24.980 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (7m) 92s ago 7m 764M 4096M 16.2.4 8d91d370c2b8 5a8fe847ca60 2023-10-18T21:01:24.980 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (7m) 92s ago 7m 659M 4096M 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T21:01:24.980 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (7m) 109s ago 7m 856M 4096M 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T21:01:24.980 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (6m) 109s ago 6m 709M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T21:01:24.981 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (6m) 109s ago 6m 745M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T21:01:24.981 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (3m) 92s ago 8m 52.3M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:01:24.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 -- 172.21.15.8:0/2848436422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c8060f70 msgr2=0x7fa8c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c8060f70 0x7fa8c8063430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa8e0107b50 tx=0x7fa8d0009b30).stop 2023-10-18T21:01:24.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 -- 172.21.15.8:0/2848436422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8e00f77d0 msgr2=0x7fa8e0107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:24.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8e00f77d0 0x7fa8e0107280 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa8d4002700 tx=0x7fa8d4009e00).stop 2023-10-18T21:01:24.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 -- 172.21.15.8:0/2848436422 shutdown_connections 2023-10-18T21:01:24.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c8060f70 0x7fa8c8063430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8e00f6530 0x7fa8e0106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 --2- 172.21.15.8:0/2848436422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8e00f77d0 0x7fa8e0107280 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:24.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 -- 172.21.15.8:0/2848436422 >> 172.21.15.8:0/2848436422 conn(0x7fa8e00f1c90 msgr2=0x7fa8e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:24.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 -- 172.21.15.8:0/2848436422 shutdown_connections 2023-10-18T21:01:24.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:24.976+0000 7fa8df59e700 1 -- 172.21.15.8:0/2848436422 wait complete. 2023-10-18T21:01:25.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.111+0000 7f09b74a5700 1 -- 172.21.15.8:0/1885497077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b00f77d0 msgr2=0x7f09b00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:25.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.111+0000 7f09b74a5700 1 --2- 172.21.15.8:0/1885497077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b00f77d0 0x7f09b00f7c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f09a0004660 tx=0x7f09a0009b30).stop 2023-10-18T21:01:25.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.111+0000 7f09b74a5700 1 -- 172.21.15.8:0/1885497077 shutdown_connections 2023-10-18T21:01:25.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.111+0000 7f09b74a5700 1 --2- 172.21.15.8:0/1885497077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b00f77d0 0x7f09b00f7c30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.111+0000 7f09b74a5700 1 --2- 172.21.15.8:0/1885497077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09b00f6530 0x7f09b00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.111+0000 7f09b74a5700 1 -- 172.21.15.8:0/1885497077 >> 172.21.15.8:0/1885497077 conn(0x7f09b00f1c90 msgr2=0x7f09b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:25.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.111+0000 7f09b74a5700 1 -- 172.21.15.8:0/1885497077 shutdown_connections 2023-10-18T21:01:25.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.111+0000 7f09b74a5700 1 -- 172.21.15.8:0/1885497077 wait complete. 2023-10-18T21:01:25.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.112+0000 7f09b74a5700 1 Processor -- start 2023-10-18T21:01:25.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.112+0000 7f09b74a5700 1 -- start start 2023-10-18T21:01:25.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.112+0000 7f09b74a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09b00f6530 0x7f09b0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:25.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.112+0000 7f09b74a5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b00f77d0 0x7f09b0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:25.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.112+0000 7f09b74a5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0107880 con 0x7f09b00f77d0 2023-10-18T21:01:25.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.112+0000 7f09b74a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b01080c0 con 0x7f09b00f6530 2023-10-18T21:01:25.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.112+0000 7f09b5ca2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b00f77d0 0x7f09b0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:25.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.112+0000 7f09b5ca2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b00f77d0 0x7f09b0107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52920/0 (socket says 172.21.15.8:52920) 2023-10-18T21:01:25.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.112+0000 7f09b5ca2700 1 -- 172.21.15.8:0/927910321 learned_addr learned my addr 172.21.15.8:0/927910321 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:25.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.113+0000 7f09b64a3700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09b00f6530 0x7f09b0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:25.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.113+0000 7f09b5ca2700 1 -- 172.21.15.8:0/927910321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09b00f6530 msgr2=0x7f09b0106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:25.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.113+0000 7f09b5ca2700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09b00f6530 0x7f09b0106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.113+0000 7f09b5ca2700 1 -- 172.21.15.8:0/927910321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0005040 con 0x7f09b00f77d0 2023-10-18T21:01:25.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.113+0000 7f09b5ca2700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b00f77d0 0x7f09b0107280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f09a0009f50 tx=0x7f09a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:25.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.113+0000 7f09a6ffd700 1 -- 172.21.15.8:0/927910321 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09a0018070 con 0x7f09b00f77d0 2023-10-18T21:01:25.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.113+0000 7f09a6ffd700 1 -- 172.21.15.8:0/927910321 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f09a0009630 con 0x7f09b00f77d0 2023-10-18T21:01:25.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.113+0000 7f09b74a5700 1 -- 172.21.15.8:0/927910321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b0108340 con 0x7f09b00f77d0 2023-10-18T21:01:25.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.113+0000 7f09a6ffd700 1 -- 172.21.15.8:0/927910321 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09a001c3c0 con 0x7f09b00f77d0 2023-10-18T21:01:25.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.114+0000 7f09b74a5700 1 -- 172.21.15.8:0/927910321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b0108820 con 0x7f09b00f77d0 2023-10-18T21:01:25.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.114+0000 7f09b74a5700 1 -- 172.21.15.8:0/927910321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b0059100 con 0x7f09b00f77d0 2023-10-18T21:01:25.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.115+0000 7f09a6ffd700 1 -- 172.21.15.8:0/927910321 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f09a001d420 con 0x7f09b00f77d0 2023-10-18T21:01:25.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.117+0000 7f09a6ffd700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f099c060f70 0x7f099c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:25.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.117+0000 7f09a6ffd700 1 -- 172.21.15.8:0/927910321 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f09a007dde0 con 0x7f09b00f77d0 2023-10-18T21:01:25.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.117+0000 7f09b64a3700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f099c060f70 0x7f099c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:25.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.117+0000 7f09b64a3700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f099c060f70 0x7f099c063430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f09b0107b50 tx=0x7f09ac00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:25.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.121+0000 7f09a6ffd700 1 -- 172.21.15.8:0/927910321 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f09a004e1a0 con 0x7f09b00f77d0 2023-10-18T21:01:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.372+0000 7f09b74a5700 1 -- 172.21.15.8:0/927910321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f09b0027a00 con 0x7f09b00f77d0 2023-10-18T21:01:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.372+0000 7f09a6ffd700 1 -- 172.21.15.8:0/927910321 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7f09a00517c0 con 0x7f09b00f77d0 2023-10-18T21:01:25.376 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:01:25.376 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:01:25.376 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:01:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:01:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:01:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:01:25.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:01:25.378 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:01:25.378 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1, 2023-10-18T21:01:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2023-10-18T21:01:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:01:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:01:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T21:01:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:01:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:01:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 5, 2023-10-18T21:01:25.381 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9 2023-10-18T21:01:25.381 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:01:25.381 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:01:25.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.374+0000 7f09b74a5700 1 -- 172.21.15.8:0/927910321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f099c060f70 msgr2=0x7f099c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:25.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.374+0000 7f09b74a5700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f099c060f70 0x7f099c063430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f09b0107b50 tx=0x7f09ac00b040).stop 2023-10-18T21:01:25.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.374+0000 7f09b74a5700 1 -- 172.21.15.8:0/927910321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b00f77d0 msgr2=0x7f09b0107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:25.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.374+0000 7f09b74a5700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b00f77d0 0x7f09b0107280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f09a0009f50 tx=0x7f09a0009b30).stop 2023-10-18T21:01:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.374+0000 7f09b74a5700 1 -- 172.21.15.8:0/927910321 shutdown_connections 2023-10-18T21:01:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.374+0000 7f09b74a5700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f099c060f70 0x7f099c063430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.374+0000 7f09b74a5700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09b00f6530 0x7f09b0106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.374+0000 7f09b74a5700 1 --2- 172.21.15.8:0/927910321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09b00f77d0 0x7f09b0107280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.374+0000 7f09b74a5700 1 -- 172.21.15.8:0/927910321 >> 172.21.15.8:0/927910321 conn(0x7f09b00f1c90 msgr2=0x7f09b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:25.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.375+0000 7f09b74a5700 1 -- 172.21.15.8:0/927910321 shutdown_connections 2023-10-18T21:01:25.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.375+0000 7f09b74a5700 1 -- 172.21.15.8:0/927910321 wait complete. 2023-10-18T21:01:25.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.513+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/2929432471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd180f6530 msgr2=0x7fcd180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:25.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.513+0000 7fcd1c9a5700 1 --2- 172.21.15.8:0/2929432471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd180f6530 0x7fcd180f6950 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcd08004660 tx=0x7fcd08009b30).stop 2023-10-18T21:01:25.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.513+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/2929432471 shutdown_connections 2023-10-18T21:01:25.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.513+0000 7fcd1c9a5700 1 --2- 172.21.15.8:0/2929432471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd180f77d0 0x7fcd180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.513+0000 7fcd1c9a5700 1 --2- 172.21.15.8:0/2929432471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd180f6530 0x7fcd180f6950 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.513+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/2929432471 >> 172.21.15.8:0/2929432471 conn(0x7fcd180f1c90 msgr2=0x7fcd180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:25.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.513+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/2929432471 shutdown_connections 2023-10-18T21:01:25.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.513+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/2929432471 wait complete. 2023-10-18T21:01:25.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.514+0000 7fcd1c9a5700 1 Processor -- start 2023-10-18T21:01:25.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.514+0000 7fcd1c9a5700 1 -- start start 2023-10-18T21:01:25.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.515+0000 7fcd1c9a5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd180f6530 0x7fcd18106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:25.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.515+0000 7fcd1c9a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd180f77d0 0x7fcd18107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:25.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.515+0000 7fcd1c9a5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18107910 con 0x7fcd180f6530 2023-10-18T21:01:25.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.515+0000 7fcd1c9a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18108120 con 0x7fcd180f77d0 2023-10-18T21:01:25.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.515+0000 7fcd16d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd180f6530 0x7fcd18106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:25.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.515+0000 7fcd16d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd180f6530 0x7fcd18106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52936/0 (socket says 172.21.15.8:52936) 2023-10-18T21:01:25.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.515+0000 7fcd16d9d700 1 -- 172.21.15.8:0/3408779590 learned_addr learned my addr 172.21.15.8:0/3408779590 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:25.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.515+0000 7fcd1659c700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd180f77d0 0x7fcd18107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:25.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.516+0000 7fcd16d9d700 1 -- 172.21.15.8:0/3408779590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd180f77d0 msgr2=0x7fcd18107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:25.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.516+0000 7fcd16d9d700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd180f77d0 0x7fcd18107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.516+0000 7fcd16d9d700 1 -- 172.21.15.8:0/3408779590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08005040 con 0x7fcd180f6530 2023-10-18T21:01:25.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.516+0000 7fcd1659c700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd180f77d0 0x7fcd18107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:01:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.516+0000 7fcd16d9d700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd180f6530 0x7fcd18106e20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcd08007a60 tx=0x7fcd08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.516+0000 7fccff7fe700 1 -- 172.21.15.8:0/3408779590 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd08018070 con 0x7fcd180f6530 2023-10-18T21:01:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.516+0000 7fccff7fe700 1 -- 172.21.15.8:0/3408779590 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcd08009630 con 0x7fcd180f6530 2023-10-18T21:01:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.516+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/3408779590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd18108340 con 0x7fcd180f6530 2023-10-18T21:01:25.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.516+0000 7fccff7fe700 1 -- 172.21.15.8:0/3408779590 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd0801c540 con 0x7fcd180f6530 2023-10-18T21:01:25.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.516+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/3408779590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd181088a0 con 0x7fcd180f6530 2023-10-18T21:01:25.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.517+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/3408779590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd18059100 con 0x7fcd180f6530 2023-10-18T21:01:25.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.518+0000 7fccff7fe700 1 -- 172.21.15.8:0/3408779590 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcd0801d420 con 0x7fcd180f6530 2023-10-18T21:01:25.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.519+0000 7fccff7fe700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd00060f70 0x7fcd00063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:25.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.519+0000 7fccff7fe700 1 -- 172.21.15.8:0/3408779590 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fcd0807ddb0 con 0x7fcd180f6530 2023-10-18T21:01:25.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.519+0000 7fcd1659c700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd00060f70 0x7fcd00063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:25.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.520+0000 7fcd1659c700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd00060f70 0x7fcd00063430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcd0c009fd0 tx=0x7fcd0c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:25.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.523+0000 7fccff7fe700 1 -- 172.21.15.8:0/3408779590 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcd0804e2b0 con 0x7fcd180f6530 2023-10-18T21:01:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:23.950243+0000 mgr.smithi008.flmjzp (mgr.14640) 145 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:01:23.951311+0000 mgr.smithi008.flmjzp (mgr.14640) 146 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2023-10-18T21:01:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:24.163188+0000 mgr.smithi008.flmjzp (mgr.14640) 147 : cluster [DBG] pgmap v102: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 63 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 2.6 KiB/s wr, 6 op/s; 88/369 objects degraded (23.848%); 0 B/s, 11 objects/s recovering 2023-10-18T21:01:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:24.264801+0000 mgr.smithi008.flmjzp (mgr.14640) 148 : audit [DBG] from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:25.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:24.383484+0000 mon.smithi008 (mon.0) 182 : cluster [DBG] osdmap e57: 6 total, 6 up, 6 in 2023-10-18T21:01:25.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:25.374107+0000 mon.smithi008 (mon.0) 183 : audit [DBG] from='client.? 172.21.15.8:0/927910321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:01:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:23.950243+0000 mgr.smithi008.flmjzp (mgr.14640) 145 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:01:23.951311+0000 mgr.smithi008.flmjzp (mgr.14640) 146 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2023-10-18T21:01:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:24.163188+0000 mgr.smithi008.flmjzp (mgr.14640) 147 : cluster [DBG] pgmap v102: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+degraded, 63 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 2.6 KiB/s wr, 6 op/s; 88/369 objects degraded (23.848%); 0 B/s, 11 objects/s recovering 2023-10-18T21:01:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:24.264801+0000 mgr.smithi008.flmjzp (mgr.14640) 148 : audit [DBG] from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:24.383484+0000 mon.smithi008 (mon.0) 182 : cluster [DBG] osdmap e57: 6 total, 6 up, 6 in 2023-10-18T21:01:25.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:25.374107+0000 mon.smithi008 (mon.0) 183 : audit [DBG] from='client.? 172.21.15.8:0/927910321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:01:25.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.747+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/3408779590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcd180008d0 con 0x7fcd180f6530 2023-10-18T21:01:25.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.748+0000 7fccff7fe700 1 -- 172.21.15.8:0/3408779590 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1794 (secure 0 0 0) 0x7fcd080518d0 con 0x7fcd180f6530 2023-10-18T21:01:25.751 INFO:teuthology.orchestra.run.smithi008.stdout:e17 2023-10-18T21:01:25.751 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:01:25.751 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:01:25.751 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:01:25.751 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:01:25.752 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:01:25.752 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:01:25.752 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 17 2023-10-18T21:01:25.752 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T21:01:25.752 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:01:25.753 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:59:22.221117+0000 2023-10-18T21:01:25.753 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:01:25.753 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:01:25.753 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:01:25.753 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:01:25.754 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:01:25.754 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:01:25.754 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:01:25.754 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T21:01:25.754 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:01:25.755 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T21:01:25.755 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T21:01:25.755 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T21:01:25.755 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:01:25.755 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:01:25.756 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T21:01:25.756 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:01:25.756 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:01:25.756 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:01:25.756 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:01:25.756 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:01:25.757 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:01:25.757 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:01:25.757 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:01:25.757 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:01:25.757 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:01:25.758 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:01:25.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/3408779590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd00060f70 msgr2=0x7fcd00063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:25.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd00060f70 0x7fcd00063430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcd0c009fd0 tx=0x7fcd0c00b040).stop 2023-10-18T21:01:25.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/3408779590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd180f6530 msgr2=0x7fcd18106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:25.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd180f6530 0x7fcd18106e20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcd08007a60 tx=0x7fcd08009b30).stop 2023-10-18T21:01:25.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/3408779590 shutdown_connections 2023-10-18T21:01:25.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd00060f70 0x7fcd00063430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd180f6530 0x7fcd18106e20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 --2- 172.21.15.8:0/3408779590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd180f77d0 0x7fcd18107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/3408779590 >> 172.21.15.8:0/3408779590 conn(0x7fcd180f1c90 msgr2=0x7fcd180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:25.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/3408779590 shutdown_connections 2023-10-18T21:01:25.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.750+0000 7fcd1c9a5700 1 -- 172.21.15.8:0/3408779590 wait complete. 2023-10-18T21:01:25.762 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-18T21:01:25.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.888+0000 7f879d02b700 1 -- 172.21.15.8:0/1314519686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87980f77d0 msgr2=0x7f87980f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:25.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.888+0000 7f879d02b700 1 --2- 172.21.15.8:0/1314519686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87980f77d0 0x7f87980f7c30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f878c004660 tx=0x7f878c009b30).stop 2023-10-18T21:01:25.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.888+0000 7f879d02b700 1 -- 172.21.15.8:0/1314519686 shutdown_connections 2023-10-18T21:01:25.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.888+0000 7f879d02b700 1 --2- 172.21.15.8:0/1314519686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87980f77d0 0x7f87980f7c30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.888+0000 7f879d02b700 1 --2- 172.21.15.8:0/1314519686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87980f6530 0x7f87980f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.888+0000 7f879d02b700 1 -- 172.21.15.8:0/1314519686 >> 172.21.15.8:0/1314519686 conn(0x7f87980f1c90 msgr2=0x7f87980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:25.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.888+0000 7f879d02b700 1 -- 172.21.15.8:0/1314519686 shutdown_connections 2023-10-18T21:01:25.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.889+0000 7f879d02b700 1 -- 172.21.15.8:0/1314519686 wait complete. 2023-10-18T21:01:25.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.889+0000 7f879d02b700 1 Processor -- start 2023-10-18T21:01:25.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.890+0000 7f879d02b700 1 -- start start 2023-10-18T21:01:25.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.890+0000 7f879d02b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87980f6530 0x7f8798106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:25.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.890+0000 7f879d02b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87980f77d0 0x7f8798107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:25.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.890+0000 7f879d02b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798107840 con 0x7f87980f6530 2023-10-18T21:01:25.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.890+0000 7f879d02b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798108050 con 0x7f87980f77d0 2023-10-18T21:01:25.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.890+0000 7f8797fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87980f6530 0x7f8798106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:25.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.890+0000 7f8797fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87980f6530 0x7f8798106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52952/0 (socket says 172.21.15.8:52952) 2023-10-18T21:01:25.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.890+0000 7f8797fff700 1 -- 172.21.15.8:0/939585765 learned_addr learned my addr 172.21.15.8:0/939585765 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:25.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.891+0000 7f87977fe700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87980f77d0 0x7f8798107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:25.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.891+0000 7f8797fff700 1 -- 172.21.15.8:0/939585765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87980f77d0 msgr2=0x7f8798107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:25.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.891+0000 7f8797fff700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87980f77d0 0x7f8798107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:25.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.891+0000 7f8797fff700 1 -- 172.21.15.8:0/939585765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8788005040 con 0x7f87980f6530 2023-10-18T21:01:25.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.891+0000 7f87977fe700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87980f77d0 0x7f8798107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:01:25.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.891+0000 7f8797fff700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87980f6530 0x7f8798106d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f87880048a0 tx=0x7f8788009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:25.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.891+0000 7f8794ff9700 1 -- 172.21.15.8:0/939585765 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f878800e030 con 0x7f87980f6530 2023-10-18T21:01:25.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.891+0000 7f8794ff9700 1 -- 172.21.15.8:0/939585765 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f878800f040 con 0x7f87980f6530 2023-10-18T21:01:25.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.891+0000 7f879d02b700 1 -- 172.21.15.8:0/939585765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c005040 con 0x7f87980f6530 2023-10-18T21:01:25.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.891+0000 7f8794ff9700 1 -- 172.21.15.8:0/939585765 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87880148f0 con 0x7f87980f6530 2023-10-18T21:01:25.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.892+0000 7f879d02b700 1 -- 172.21.15.8:0/939585765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8798108680 con 0x7f87980f6530 2023-10-18T21:01:25.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.893+0000 7f879d02b700 1 -- 172.21.15.8:0/939585765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8798059100 con 0x7f87980f6530 2023-10-18T21:01:25.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.893+0000 7f8794ff9700 1 -- 172.21.15.8:0/939585765 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8788010500 con 0x7f87980f6530 2023-10-18T21:01:25.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.894+0000 7f8794ff9700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8780060f70 0x7f8780063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:25.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.894+0000 7f8794ff9700 1 -- 172.21.15.8:0/939585765 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f878807c750 con 0x7f87980f6530 2023-10-18T21:01:25.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.894+0000 7f87977fe700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8780060f70 0x7f8780063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:25.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.895+0000 7f87977fe700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8780060f70 0x7f8780063430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f878c009720 tx=0x7f878c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:25.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:25.898+0000 7f8794ff9700 1 -- 172.21.15.8:0/939585765 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f878804cb70 con 0x7f87980f6530 2023-10-18T21:01:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.097+0000 7f879d02b700 1 -- 172.21.15.8:0/939585765 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87980feda0 con 0x7f8780060f70 2023-10-18T21:01:26.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.098+0000 7f8794ff9700 1 -- 172.21.15.8:0/939585765 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f87980feda0 con 0x7f8780060f70 2023-10-18T21:01:26.101 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:01:26.101 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:01:26.101 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:01:26.101 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:01:26.102 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:01:26.102 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:01:26.102 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:01:26.102 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:01:26.103 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:01:26.103 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "7/21 daemons upgraded", 2023-10-18T21:01:26.103 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading osd daemons", 2023-10-18T21:01:26.103 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:01:26.104 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:01:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 -- 172.21.15.8:0/939585765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8780060f70 msgr2=0x7f8780063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8780060f70 0x7f8780063430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f878c009720 tx=0x7f878c00b040).stop 2023-10-18T21:01:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 -- 172.21.15.8:0/939585765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87980f6530 msgr2=0x7f8798106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87980f6530 0x7f8798106d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f87880048a0 tx=0x7f8788009b30).stop 2023-10-18T21:01:26.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 -- 172.21.15.8:0/939585765 shutdown_connections 2023-10-18T21:01:26.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8780060f70 0x7f8780063430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:26.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87980f6530 0x7f8798106d50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:26.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 --2- 172.21.15.8:0/939585765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87980f77d0 0x7f8798107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 -- 172.21.15.8:0/939585765 >> 172.21.15.8:0/939585765 conn(0x7f87980f1c90 msgr2=0x7f87980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 -- 172.21.15.8:0/939585765 shutdown_connections 2023-10-18T21:01:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:26.100+0000 7f879d02b700 1 -- 172.21.15.8:0/939585765 wait complete. 2023-10-18T21:01:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:24.620383+0000 mgr.smithi008.flmjzp (mgr.14640) 149 : audit [DBG] from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:24.966745+0000 mgr.smithi008.flmjzp (mgr.14640) 150 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:25.749497+0000 mon.smithi008 (mon.0) 184 : audit [DBG] from='client.? 172.21.15.8:0/3408779590' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:01:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:24.620383+0000 mgr.smithi008.flmjzp (mgr.14640) 149 : audit [DBG] from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:24.966745+0000 mgr.smithi008.flmjzp (mgr.14640) 150 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:25.749497+0000 mon.smithi008 (mon.0) 184 : audit [DBG] from='client.? 172.21.15.8:0/3408779590' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:01:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:26.099587+0000 mgr.smithi008.flmjzp (mgr.14640) 151 : audit [DBG] from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:26.163552+0000 mgr.smithi008.flmjzp (mgr.14640) 152 : cluster [DBG] pgmap v104: 65 pgs: 1 active+recovery_wait+degraded, 64 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s; 88/369 objects degraded (23.848%); 0 B/s, 9 objects/s recovering 2023-10-18T21:01:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:26.383197+0000 mon.smithi008 (mon.0) 185 : cluster [WRN] Health check update: Degraded data redundancy: 88/369 objects degraded (23.848%), 1 pg degraded (PG_DEGRADED) 2023-10-18T21:01:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:26.099587+0000 mgr.smithi008.flmjzp (mgr.14640) 151 : audit [DBG] from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:26.163552+0000 mgr.smithi008.flmjzp (mgr.14640) 152 : cluster [DBG] pgmap v104: 65 pgs: 1 active+recovery_wait+degraded, 64 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s; 88/369 objects degraded (23.848%); 0 B/s, 9 objects/s recovering 2023-10-18T21:01:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:26.383197+0000 mon.smithi008 (mon.0) 185 : cluster [WRN] Health check update: Degraded data redundancy: 88/369 objects degraded (23.848%), 1 pg degraded (PG_DEGRADED) 2023-10-18T21:01:28.661 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:28.391221+0000 mon.smithi008 (mon.0) 186 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 88/369 objects degraded (23.848%), 1 pg degraded) 2023-10-18T21:01:28.662 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:28.391253+0000 mon.smithi008 (mon.0) 187 : cluster [INF] Cluster is now healthy 2023-10-18T21:01:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:28.391221+0000 mon.smithi008 (mon.0) 186 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 88/369 objects degraded (23.848%), 1 pg degraded) 2023-10-18T21:01:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:28.391253+0000 mon.smithi008 (mon.0) 187 : cluster [INF] Cluster is now healthy 2023-10-18T21:01:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:28.164113+0000 mgr.smithi008.flmjzp (mgr.14640) 153 : cluster [DBG] pgmap v105: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 20 objects/s recovering 2023-10-18T21:01:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:28.164113+0000 mgr.smithi008.flmjzp (mgr.14640) 153 : cluster [DBG] pgmap v105: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 20 objects/s recovering 2023-10-18T21:01:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:30.164612+0000 mgr.smithi008.flmjzp (mgr.14640) 154 : cluster [DBG] pgmap v106: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 13 objects/s recovering 2023-10-18T21:01:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:30.443144+0000 mon.smithi008 (mon.0) 188 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:30.164612+0000 mgr.smithi008.flmjzp (mgr.14640) 154 : cluster [DBG] pgmap v106: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 13 objects/s recovering 2023-10-18T21:01:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:30.443144+0000 mon.smithi008 (mon.0) 188 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:32.165233+0000 mgr.smithi008.flmjzp (mgr.14640) 155 : cluster [DBG] pgmap v107: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 0 B/s, 12 objects/s recovering 2023-10-18T21:01:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:32.165233+0000 mgr.smithi008.flmjzp (mgr.14640) 155 : cluster [DBG] pgmap v107: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 0 B/s, 12 objects/s recovering 2023-10-18T21:01:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:34.165712+0000 mgr.smithi008.flmjzp (mgr.14640) 156 : cluster [DBG] pgmap v108: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 0 B/s, 10 objects/s recovering 2023-10-18T21:01:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:34.165712+0000 mgr.smithi008.flmjzp (mgr.14640) 156 : cluster [DBG] pgmap v108: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 0 B/s, 10 objects/s recovering 2023-10-18T21:01:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:35.507059+0000 mon.smithi008 (mon.0) 189 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:35.507059+0000 mon.smithi008 (mon.0) 189 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:36.166191+0000 mgr.smithi008.flmjzp (mgr.14640) 157 : cluster [DBG] pgmap v109: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 0 B/s, 9 objects/s recovering 2023-10-18T21:01:37.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:36.166191+0000 mgr.smithi008.flmjzp (mgr.14640) 157 : cluster [DBG] pgmap v109: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 0 B/s, 9 objects/s recovering 2023-10-18T21:01:39.724 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:38.166757+0000 mgr.smithi008.flmjzp (mgr.14640) 158 : cluster [DBG] pgmap v110: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 7 objects/s recovering 2023-10-18T21:01:39.725 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:38.963499+0000 mon.smithi008 (mon.0) 190 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:38.166757+0000 mgr.smithi008.flmjzp (mgr.14640) 158 : cluster [DBG] pgmap v110: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 7 objects/s recovering 2023-10-18T21:01:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:38.963499+0000 mon.smithi008 (mon.0) 190 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:38.963774+0000 mgr.smithi008.flmjzp (mgr.14640) 159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:01:38.964948+0000 mgr.smithi008.flmjzp (mgr.14640) 160 : cephadm [INF] Upgrade: osd.1 is safe to restart 2023-10-18T21:01:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:40.121680+0000 mon.smithi008 (mon.0) 191 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:40.122492+0000 mon.smithi008 (mon.0) 192 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-18T21:01:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:40.123192+0000 mon.smithi008 (mon.0) 193 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:01:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:38.963774+0000 mgr.smithi008.flmjzp (mgr.14640) 159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-10-18T21:01:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:01:38.964948+0000 mgr.smithi008.flmjzp (mgr.14640) 160 : cephadm [INF] Upgrade: osd.1 is safe to restart 2023-10-18T21:01:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:40.121680+0000 mon.smithi008 (mon.0) 191 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:40.122492+0000 mon.smithi008 (mon.0) 192 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-18T21:01:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:40.123192+0000 mon.smithi008 (mon.0) 193 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:01:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:01:40.117011+0000 mgr.smithi008.flmjzp (mgr.14640) 161 : cephadm [INF] Upgrade: Updating osd.1 2023-10-18T21:01:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:01:40.124240+0000 mgr.smithi008.flmjzp (mgr.14640) 162 : cephadm [INF] Deploying daemon osd.1 on smithi008 2023-10-18T21:01:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:40.167089+0000 mgr.smithi008.flmjzp (mgr.14640) 163 : cluster [DBG] pgmap v111: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T21:01:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:01:40.117011+0000 mgr.smithi008.flmjzp (mgr.14640) 161 : cephadm [INF] Upgrade: Updating osd.1 2023-10-18T21:01:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:01:40.124240+0000 mgr.smithi008.flmjzp (mgr.14640) 162 : cephadm [INF] Deploying daemon osd.1 on smithi008 2023-10-18T21:01:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:40.167089+0000 mgr.smithi008.flmjzp (mgr.14640) 163 : cluster [DBG] pgmap v111: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T21:01:42.782 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:42 smithi008 systemd[1]: Stopping Ceph osd.1 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T21:01:42.782 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.1[121925]: debug 2023-10-18T21:01:42.553+0000 7fc97a7c6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-10-18T21:01:42.783 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.1[121925]: debug 2023-10-18T21:01:42.553+0000 7fc97a7c6700 -1 osd.1 57 *** Got signal Terminated *** 2023-10-18T21:01:42.783 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.1[121925]: debug 2023-10-18T21:01:42.553+0000 7fc97a7c6700 -1 osd.1 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T21:01:43.170 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:42 smithi008 bash[152893]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.1 2023-10-18T21:01:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.167562+0000 mgr.smithi008.flmjzp (mgr.14640) 164 : cluster [DBG] pgmap v112: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-10-18T21:01:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.871980+0000 mon.smithi008 (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-10-18T21:01:43.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.872010+0000 mon.smithi008 (mon.0) 195 : cluster [INF] osd.1 failed (root=default,host=smithi008) (connection refused reported by osd.0) 2023-10-18T21:01:43.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.872129+0000 mon.smithi008 (mon.0) 196 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-10-18T21:01:43.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.872198+0000 mon.smithi008 (mon.0) 197 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-10-18T21:01:43.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.872326+0000 mon.smithi008 (mon.0) 198 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-10-18T21:01:43.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.872552+0000 mon.smithi008 (mon.0) 199 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-10-18T21:01:43.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.872601+0000 mon.smithi008 (mon.0) 200 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-10-18T21:01:43.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.872700+0000 mon.smithi008 (mon.0) 201 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-10-18T21:01:43.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.872769+0000 mon.smithi008 (mon.0) 202 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-10-18T21:01:43.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.872810+0000 mon.smithi008 (mon.0) 203 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-10-18T21:01:43.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:42.872903+0000 mon.smithi008 (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-10-18T21:01:43.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.272999+0000 mon.smithi008 (mon.0) 205 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-10-18T21:01:43.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.273080+0000 mon.smithi008 (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-10-18T21:01:43.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.273189+0000 mon.smithi008 (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-10-18T21:01:43.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.273228+0000 mon.smithi008 (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-10-18T21:01:43.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.273512+0000 mon.smithi008 (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-10-18T21:01:43.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.273558+0000 mon.smithi008 (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-10-18T21:01:43.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.273650+0000 mon.smithi008 (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-10-18T21:01:43.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.273694+0000 mon.smithi008 (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-10-18T21:01:43.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.273787+0000 mon.smithi008 (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-10-18T21:01:43.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.273858+0000 mon.smithi008 (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-10-18T21:01:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.167562+0000 mgr.smithi008.flmjzp (mgr.14640) 164 : cluster [DBG] pgmap v112: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-10-18T21:01:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.871980+0000 mon.smithi008 (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-10-18T21:01:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.872010+0000 mon.smithi008 (mon.0) 195 : cluster [INF] osd.1 failed (root=default,host=smithi008) (connection refused reported by osd.0) 2023-10-18T21:01:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.872129+0000 mon.smithi008 (mon.0) 196 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-10-18T21:01:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.872198+0000 mon.smithi008 (mon.0) 197 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-10-18T21:01:43.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.872326+0000 mon.smithi008 (mon.0) 198 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-10-18T21:01:43.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.872552+0000 mon.smithi008 (mon.0) 199 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-10-18T21:01:43.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.872601+0000 mon.smithi008 (mon.0) 200 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-10-18T21:01:43.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.872700+0000 mon.smithi008 (mon.0) 201 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-10-18T21:01:43.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.872769+0000 mon.smithi008 (mon.0) 202 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-10-18T21:01:43.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.872810+0000 mon.smithi008 (mon.0) 203 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-10-18T21:01:43.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:42.872903+0000 mon.smithi008 (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-10-18T21:01:43.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.272999+0000 mon.smithi008 (mon.0) 205 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-10-18T21:01:43.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.273080+0000 mon.smithi008 (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-10-18T21:01:43.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.273189+0000 mon.smithi008 (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-10-18T21:01:43.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.273228+0000 mon.smithi008 (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-10-18T21:01:43.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.273512+0000 mon.smithi008 (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-10-18T21:01:43.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.273558+0000 mon.smithi008 (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-10-18T21:01:43.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.273650+0000 mon.smithi008 (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-10-18T21:01:43.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.273694+0000 mon.smithi008 (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-10-18T21:01:43.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.273787+0000 mon.smithi008 (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-10-18T21:01:43.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.273858+0000 mon.smithi008 (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-10-18T21:01:44.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.525296+0000 mon.smithi008 (mon.0) 215 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T21:01:44.863 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:43.535652+0000 mon.smithi008 (mon.0) 216 : cluster [DBG] osdmap e58: 6 total, 5 up, 6 in 2023-10-18T21:01:44.863 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:44 smithi008 systemd[1]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.1.service: Succeeded. 2023-10-18T21:01:44.863 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:44 smithi008 systemd[1]: Stopped Ceph osd.1 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T21:01:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.525296+0000 mon.smithi008 (mon.0) 215 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T21:01:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:43.535652+0000 mon.smithi008 (mon.0) 216 : cluster [DBG] osdmap e58: 6 total, 5 up, 6 in 2023-10-18T21:01:45.171 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:44 smithi008 systemd[1]: Starting Ceph osd.1 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T21:01:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:44.167927+0000 mgr.smithi008.flmjzp (mgr.14640) 165 : cluster [DBG] pgmap v114: 65 pgs: 12 stale+active+clean, 53 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-10-18T21:01:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:44.539968+0000 mon.smithi008 (mon.0) 217 : cluster [DBG] osdmap e59: 6 total, 5 up, 6 in 2023-10-18T21:01:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:45.442762+0000 mon.smithi008 (mon.0) 218 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:44.167927+0000 mgr.smithi008.flmjzp (mgr.14640) 165 : cluster [DBG] pgmap v114: 65 pgs: 12 stale+active+clean, 53 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-10-18T21:01:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:44.539968+0000 mon.smithi008 (mon.0) 217 : cluster [DBG] osdmap e59: 6 total, 5 up, 6 in 2023-10-18T21:01:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:45.442762+0000 mon.smithi008 (mon.0) 218 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:46.420 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:45 smithi008 bash[153185]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-18T21:01:46.421 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:45 smithi008 bash[153185]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-10-18T21:01:46.422 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:45 smithi008 bash[153185]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-10-18T21:01:46.422 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:45 smithi008 bash[153185]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-10-18T21:01:46.422 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:45 smithi008 bash[153185]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-10-18T21:01:46.422 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:45 smithi008 bash[153185]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-18T21:01:46.422 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:45 smithi008 bash[153185]: --> ceph-volume raw activate successful for osd ID: 1 2023-10-18T21:01:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:46.539369+0000 mon.smithi008 (mon.0) 219 : cluster [WRN] Health check failed: Degraded data redundancy: 6/369 objects degraded (1.626%), 2 pgs degraded (PG_DEGRADED) 2023-10-18T21:01:46.921 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:46 smithi008 bash[153433]: a27fe035b4c0ab54fcbcd1ac0380952ba123841397465a858bcf2ffd79f3fab3 2023-10-18T21:01:46.921 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-1[153448]: debug 2023-10-18T21:01:46.778+0000 7f6b7db44700 1 -- 172.21.15.8:0/2478540375 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55858907a680 con 0x558589041400 2023-10-18T21:01:46.921 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:46 smithi008 systemd[1]: Started Ceph osd.1 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T21:01:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:46.539369+0000 mon.smithi008 (mon.0) 219 : cluster [WRN] Health check failed: Degraded data redundancy: 6/369 objects degraded (1.626%), 2 pgs degraded (PG_DEGRADED) 2023-10-18T21:01:47.595 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-1[153448]: debug 2023-10-18T21:01:47.298+0000 7f6b855bf200 -1 Falling back to public interface 2023-10-18T21:01:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:46.168351+0000 mgr.smithi008.flmjzp (mgr.14640) 166 : cluster [DBG] pgmap v116: 65 pgs: 2 active+undersized+degraded, 9 stale+active+clean, 3 active+undersized, 51 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 6/369 objects degraded (1.626%) 2023-10-18T21:01:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:46.855652+0000 mon.smithi008 (mon.0) 220 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:46.856512+0000 mon.smithi008 (mon.0) 221 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:01:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:47.210721+0000 mon.smithi008 (mon.0) 222 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:46.168351+0000 mgr.smithi008.flmjzp (mgr.14640) 166 : cluster [DBG] pgmap v116: 65 pgs: 2 active+undersized+degraded, 9 stale+active+clean, 3 active+undersized, 51 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 6/369 objects degraded (1.626%) 2023-10-18T21:01:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:46.855652+0000 mon.smithi008 (mon.0) 220 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:46.856512+0000 mon.smithi008 (mon.0) 221 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:01:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:47.210721+0000 mon.smithi008 (mon.0) 222 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:48.168828+0000 mgr.smithi008.flmjzp (mgr.14640) 167 : cluster [DBG] pgmap v117: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:01:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:48.168828+0000 mgr.smithi008.flmjzp (mgr.14640) 167 : cluster [DBG] pgmap v117: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:01:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:50.169203+0000 mgr.smithi008.flmjzp (mgr.14640) 168 : cluster [DBG] pgmap v118: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 55/369 objects degraded (14.905%) 2023-10-18T21:01:51.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:50.169203+0000 mgr.smithi008.flmjzp (mgr.14640) 168 : cluster [DBG] pgmap v118: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 55/369 objects degraded (14.905%) 2023-10-18T21:01:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:52.076786+0000 mon.smithi008 (mon.0) 223 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:52.077632+0000 mon.smithi008 (mon.0) 224 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:01:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:52.078390+0000 mon.smithi008 (mon.0) 225 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:01:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:01:52.079053+0000 mgr.smithi008.flmjzp (mgr.14640) 169 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:01:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:52.082468+0000 mon.smithi008 (mon.0) 226 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:52.087251+0000 mon.smithi008 (mon.0) 227 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:01:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:52.089499+0000 mon.smithi008 (mon.0) 228 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:01:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:52.090723+0000 mon.smithi008 (mon.0) 229 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:01:53.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:52.092041+0000 mon.smithi008 (mon.0) 230 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:01:53.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:52.093245+0000 mon.smithi008 (mon.0) 231 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-10-18T21:01:53.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:52.093416+0000 mgr.smithi008.flmjzp (mgr.14640) 170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-10-18T21:01:53.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:01:52.094235+0000 mgr.smithi008.flmjzp (mgr.14640) 171 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-10-18T21:01:53.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:52.169912+0000 mgr.smithi008.flmjzp (mgr.14640) 172 : cluster [DBG] pgmap v119: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:01:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:52.076786+0000 mon.smithi008 (mon.0) 223 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:52.077632+0000 mon.smithi008 (mon.0) 224 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:01:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:52.078390+0000 mon.smithi008 (mon.0) 225 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:01:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:01:52.079053+0000 mgr.smithi008.flmjzp (mgr.14640) 169 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:01:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:52.082468+0000 mon.smithi008 (mon.0) 226 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:01:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:52.087251+0000 mon.smithi008 (mon.0) 227 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:01:53.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:52.089499+0000 mon.smithi008 (mon.0) 228 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:01:53.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:52.090723+0000 mon.smithi008 (mon.0) 229 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:01:53.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:52.092041+0000 mon.smithi008 (mon.0) 230 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:01:53.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:52.093245+0000 mon.smithi008 (mon.0) 231 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-10-18T21:01:53.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:52.093416+0000 mgr.smithi008.flmjzp (mgr.14640) 170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-10-18T21:01:53.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:01:52.094235+0000 mgr.smithi008.flmjzp (mgr.14640) 171 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-10-18T21:01:53.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:52.169912+0000 mgr.smithi008.flmjzp (mgr.14640) 172 : cluster [DBG] pgmap v119: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:01:54.670 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-1[153448]: debug 2023-10-18T21:01:54.340+0000 7f6b855bf200 -1 osd.1 57 log_to_monitors {default=true} 2023-10-18T21:01:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:54.170291+0000 mgr.smithi008.flmjzp (mgr.14640) 173 : cluster [DBG] pgmap v120: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:01:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:54.347277+0000 mon.smithi008 (mon.0) 232 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/100500030,v1:172.21.15.8:6811/100500030]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-18T21:01:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:54.846046+0000 mon.smithi008 (mon.0) 233 : cluster [WRN] Health check update: Degraded data redundancy: 55/369 objects degraded (14.905%), 15 pgs degraded (PG_DEGRADED) 2023-10-18T21:01:55.670 INFO:journalctl@ceph.osd.1.smithi008.stdout:Oct 18 21:01:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-1[153448]: debug 2023-10-18T21:01:55.238+0000 7f6b76ab9700 -1 osd.1 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T21:01:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:54.170291+0000 mgr.smithi008.flmjzp (mgr.14640) 173 : cluster [DBG] pgmap v120: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:01:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:54.347277+0000 mon.smithi008 (mon.0) 232 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/100500030,v1:172.21.15.8:6811/100500030]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-18T21:01:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:54.846046+0000 mon.smithi008 (mon.0) 233 : cluster [WRN] Health check update: Degraded data redundancy: 55/369 objects degraded (14.905%), 15 pgs degraded (PG_DEGRADED) 2023-10-18T21:01:56.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.255+0000 7f0e0bfff700 1 -- 172.21.15.8:0/3239418269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040a3530 msgr2=0x7f0e040a3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:56.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.255+0000 7f0e0bfff700 1 --2- 172.21.15.8:0/3239418269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040a3530 0x7f0e040a3950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0dfc004660 tx=0x7f0dfc009b30).stop 2023-10-18T21:01:56.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.256+0000 7f0e0bfff700 1 -- 172.21.15.8:0/3239418269 shutdown_connections 2023-10-18T21:01:56.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.256+0000 7f0e0bfff700 1 --2- 172.21.15.8:0/3239418269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040a4690 0x7f0e040a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.256+0000 7f0e0bfff700 1 --2- 172.21.15.8:0/3239418269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040a3530 0x7f0e040a3950 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.256+0000 7f0e0bfff700 1 -- 172.21.15.8:0/3239418269 >> 172.21.15.8:0/3239418269 conn(0x7f0e0409eb10 msgr2=0x7f0e040a0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:56.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.256+0000 7f0e0bfff700 1 -- 172.21.15.8:0/3239418269 shutdown_connections 2023-10-18T21:01:56.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.257+0000 7f0e0bfff700 1 -- 172.21.15.8:0/3239418269 wait complete. 2023-10-18T21:01:56.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.258+0000 7f0e0bfff700 1 Processor -- start 2023-10-18T21:01:56.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.258+0000 7f0e0bfff700 1 -- start start 2023-10-18T21:01:56.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.259+0000 7f0e0bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040a3530 0x7f0e040b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:56.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.259+0000 7f0e0bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040a4690 0x7f0e040b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:56.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.259+0000 7f0e0bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e040b4610 con 0x7f0e040a3530 2023-10-18T21:01:56.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.259+0000 7f0e0bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e040b4750 con 0x7f0e040a4690 2023-10-18T21:01:56.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.259+0000 7f0e0a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040a4690 0x7f0e040b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:56.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.260+0000 7f0e0a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040a4690 0x7f0e040b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:37878/0 (socket says 172.21.15.8:37878) 2023-10-18T21:01:56.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.260+0000 7f0e0a7fc700 1 -- 172.21.15.8:0/2778301194 learned_addr learned my addr 172.21.15.8:0/2778301194 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:56.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.260+0000 7f0e0affd700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040a3530 0x7f0e040b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:56.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.260+0000 7f0e0a7fc700 1 -- 172.21.15.8:0/2778301194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040a3530 msgr2=0x7f0e040b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:56.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.260+0000 7f0e0a7fc700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040a3530 0x7f0e040b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.260+0000 7f0e0a7fc700 1 -- 172.21.15.8:0/2778301194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e00005040 con 0x7f0e040a4690 2023-10-18T21:01:56.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.261+0000 7f0e0a7fc700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040a4690 0x7f0e040b4060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0e000048a0 tx=0x7f0e00009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:56.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.261+0000 7f0df37fe700 1 -- 172.21.15.8:0/2778301194 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e0000e030 con 0x7f0e040a4690 2023-10-18T21:01:56.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.261+0000 7f0df37fe700 1 -- 172.21.15.8:0/2778301194 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0e0000f040 con 0x7f0e040a4690 2023-10-18T21:01:56.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.261+0000 7f0e0bfff700 1 -- 172.21.15.8:0/2778301194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc005040 con 0x7f0e040a4690 2023-10-18T21:01:56.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.261+0000 7f0df37fe700 1 -- 172.21.15.8:0/2778301194 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e000148f0 con 0x7f0e040a4690 2023-10-18T21:01:56.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.262+0000 7f0e0bfff700 1 -- 172.21.15.8:0/2778301194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e040b7590 con 0x7f0e040a4690 2023-10-18T21:01:56.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.264+0000 7f0e0bfff700 1 -- 172.21.15.8:0/2778301194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e04004840 con 0x7f0e040a4690 2023-10-18T21:01:56.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.265+0000 7f0df37fe700 1 -- 172.21.15.8:0/2778301194 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0e00014a50 con 0x7f0e040a4690 2023-10-18T21:01:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.268+0000 7f0df37fe700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 0x7f0df4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.268+0000 7f0df37fe700 1 -- 172.21.15.8:0/2778301194 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0e0007c7b0 con 0x7f0e040a4690 2023-10-18T21:01:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.270+0000 7f0e0affd700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 0x7f0df4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:56.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.270+0000 7f0e0affd700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 0x7f0df4063430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0dfc000c00 tx=0x7f0dfc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:56.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.271+0000 7f0df37fe700 1 -- 172.21.15.8:0/2778301194 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0e00051690 con 0x7f0e040a4690 2023-10-18T21:01:56.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.467+0000 7f0e0bfff700 1 -- 172.21.15.8:0/2778301194 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e040b8e30 con 0x7f0df4060f70 2023-10-18T21:01:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.469+0000 7f0df37fe700 1 -- 172.21.15.8:0/2778301194 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0e040b8e30 con 0x7f0df4060f70 2023-10-18T21:01:56.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.470+0000 7f0e0bfff700 1 -- 172.21.15.8:0/2778301194 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 msgr2=0x7f0df4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:56.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.470+0000 7f0e0bfff700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 0x7f0df4063430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0dfc000c00 tx=0x7f0dfc00b040).stop 2023-10-18T21:01:56.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.470+0000 7f0e0bfff700 1 -- 172.21.15.8:0/2778301194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040a4690 msgr2=0x7f0e040b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:56.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.470+0000 7f0e0bfff700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040a4690 0x7f0e040b4060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0e000048a0 tx=0x7f0e00009b30).stop 2023-10-18T21:01:56.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.471+0000 7f0e0bfff700 1 -- 172.21.15.8:0/2778301194 shutdown_connections 2023-10-18T21:01:56.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.471+0000 7f0e0bfff700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 0x7f0df4063430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.471+0000 7f0e0bfff700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040a3530 0x7f0e040b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.471+0000 7f0e0bfff700 1 --2- 172.21.15.8:0/2778301194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040a4690 0x7f0e040b4060 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.471+0000 7f0e0bfff700 1 -- 172.21.15.8:0/2778301194 >> 172.21.15.8:0/2778301194 conn(0x7f0e0409eb10 msgr2=0x7f0e040a9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.471+0000 7f0e0bfff700 1 -- 172.21.15.8:0/2778301194 shutdown_connections 2023-10-18T21:01:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.471+0000 7f0e0bfff700 1 -- 172.21.15.8:0/2778301194 wait complete. 2023-10-18T21:01:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:55.231135+0000 mon.smithi008 (mon.0) 234 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/100500030,v1:172.21.15.8:6811/100500030]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-18T21:01:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:55.231221+0000 mon.smithi008 (mon.0) 235 : cluster [DBG] osdmap e60: 6 total, 5 up, 6 in 2023-10-18T21:01:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:55.232046+0000 mon.smithi008 (mon.0) 236 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/100500030,v1:172.21.15.8:6811/100500030]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T21:01:56.488 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:01:56.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.607+0000 7f3f2359e700 1 -- 172.21.15.8:0/1980333997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f240f77d0 msgr2=0x7f3f240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:56.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.607+0000 7f3f2359e700 1 --2- 172.21.15.8:0/1980333997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f240f77d0 0x7f3f240f7c30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f3f18004660 tx=0x7f3f18009b30).stop 2023-10-18T21:01:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.607+0000 7f3f2359e700 1 -- 172.21.15.8:0/1980333997 shutdown_connections 2023-10-18T21:01:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.607+0000 7f3f2359e700 1 --2- 172.21.15.8:0/1980333997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f240f77d0 0x7f3f240f7c30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.607+0000 7f3f2359e700 1 --2- 172.21.15.8:0/1980333997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f240f6530 0x7f3f240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.607+0000 7f3f2359e700 1 -- 172.21.15.8:0/1980333997 >> 172.21.15.8:0/1980333997 conn(0x7f3f240f1c90 msgr2=0x7f3f240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.607+0000 7f3f2359e700 1 -- 172.21.15.8:0/1980333997 shutdown_connections 2023-10-18T21:01:56.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.607+0000 7f3f2359e700 1 -- 172.21.15.8:0/1980333997 wait complete. 2023-10-18T21:01:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.609+0000 7f3f2359e700 1 Processor -- start 2023-10-18T21:01:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.609+0000 7f3f2359e700 1 -- start start 2023-10-18T21:01:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.609+0000 7f3f2359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f240f6530 0x7f3f2406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.609+0000 7f3f2359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f240f77d0 0x7f3f24069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.609+0000 7f3f2359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2406a380 con 0x7f3f240f6530 2023-10-18T21:01:56.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.609+0000 7f3f2359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2406a4c0 con 0x7f3f240f77d0 2023-10-18T21:01:56.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f2259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f240f6530 0x7f3f2406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:56.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f2259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f240f6530 0x7f3f2406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48548/0 (socket says 172.21.15.8:48548) 2023-10-18T21:01:56.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f2259c700 1 -- 172.21.15.8:0/874920563 learned_addr learned my addr 172.21.15.8:0/874920563 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:56.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f21d9b700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f240f77d0 0x7f3f24069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:56.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f2259c700 1 -- 172.21.15.8:0/874920563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f240f77d0 msgr2=0x7f3f24069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:56.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f2259c700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f240f77d0 0x7f3f24069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f2259c700 1 -- 172.21.15.8:0/874920563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18005040 con 0x7f3f240f6530 2023-10-18T21:01:56.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f2259c700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f240f6530 0x7f3f2406b9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3f14002700 tx=0x7f3f14009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:56.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f12ffd700 1 -- 172.21.15.8:0/874920563 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f140079c0 con 0x7f3f240f6530 2023-10-18T21:01:56.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f12ffd700 1 -- 172.21.15.8:0/874920563 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3f1400f040 con 0x7f3f240f6530 2023-10-18T21:01:56.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.610+0000 7f3f12ffd700 1 -- 172.21.15.8:0/874920563 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f140148d0 con 0x7f3f240f6530 2023-10-18T21:01:56.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.611+0000 7f3f2359e700 1 -- 172.21.15.8:0/874920563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2406a7a0 con 0x7f3f240f6530 2023-10-18T21:01:56.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.611+0000 7f3f2359e700 1 -- 172.21.15.8:0/874920563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2410ed70 con 0x7f3f240f6530 2023-10-18T21:01:56.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.612+0000 7f3f2359e700 1 -- 172.21.15.8:0/874920563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f24045ad0 con 0x7f3f240f6530 2023-10-18T21:01:56.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.612+0000 7f3f12ffd700 1 -- 172.21.15.8:0/874920563 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3f1401b060 con 0x7f3f240f6530 2023-10-18T21:01:56.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.613+0000 7f3f12ffd700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3f0c060f70 0x7f3f0c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:56.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.613+0000 7f3f12ffd700 1 -- 172.21.15.8:0/874920563 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f3f1407bf60 con 0x7f3f240f6530 2023-10-18T21:01:56.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.614+0000 7f3f21d9b700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3f0c060f70 0x7f3f0c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:56.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.614+0000 7f3f21d9b700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3f0c060f70 0x7f3f0c063430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3f18004630 tx=0x7f3f18009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:56.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.618+0000 7f3f12ffd700 1 -- 172.21.15.8:0/874920563 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3f1404c3a0 con 0x7f3f240f6530 2023-10-18T21:01:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:55.231135+0000 mon.smithi008 (mon.0) 234 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/100500030,v1:172.21.15.8:6811/100500030]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-18T21:01:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:55.231221+0000 mon.smithi008 (mon.0) 235 : cluster [DBG] osdmap e60: 6 total, 5 up, 6 in 2023-10-18T21:01:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:55.232046+0000 mon.smithi008 (mon.0) 236 : audit [INF] from='osd.1 [v2:172.21.15.8:6810/100500030,v1:172.21.15.8:6811/100500030]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T21:01:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.814+0000 7f3f2359e700 1 -- 172.21.15.8:0/874920563 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f240fee30 con 0x7f3f0c060f70 2023-10-18T21:01:56.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.816+0000 7f3f12ffd700 1 -- 172.21.15.8:0/874920563 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3f240fee30 con 0x7f3f0c060f70 2023-10-18T21:01:56.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.817+0000 7f3f2359e700 1 -- 172.21.15.8:0/874920563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3f0c060f70 msgr2=0x7f3f0c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:56.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.817+0000 7f3f2359e700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3f0c060f70 0x7f3f0c063430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3f18004630 tx=0x7f3f18009b30).stop 2023-10-18T21:01:56.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.817+0000 7f3f2359e700 1 -- 172.21.15.8:0/874920563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f240f6530 msgr2=0x7f3f2406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:56.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.817+0000 7f3f2359e700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f240f6530 0x7f3f2406b9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3f14002700 tx=0x7f3f14009d80).stop 2023-10-18T21:01:56.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.817+0000 7f3f2359e700 1 -- 172.21.15.8:0/874920563 shutdown_connections 2023-10-18T21:01:56.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.817+0000 7f3f2359e700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3f0c060f70 0x7f3f0c063430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.818+0000 7f3f2359e700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f240f6530 0x7f3f2406b9a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.818+0000 7f3f2359e700 1 --2- 172.21.15.8:0/874920563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f240f77d0 0x7f3f24069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.818+0000 7f3f2359e700 1 -- 172.21.15.8:0/874920563 >> 172.21.15.8:0/874920563 conn(0x7f3f240f1c90 msgr2=0x7f3f240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:56.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.818+0000 7f3f2359e700 1 -- 172.21.15.8:0/874920563 shutdown_connections 2023-10-18T21:01:56.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.818+0000 7f3f2359e700 1 -- 172.21.15.8:0/874920563 wait complete. 2023-10-18T21:01:56.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.954+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/1989611598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb280f77d0 msgr2=0x7fdb280f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.954+0000 7fdb2cd8f700 1 --2- 172.21.15.8:0/1989611598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb280f77d0 0x7fdb280f7c30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fdb1c004660 tx=0x7fdb1c009b30).stop 2023-10-18T21:01:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.954+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/1989611598 shutdown_connections 2023-10-18T21:01:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.954+0000 7fdb2cd8f700 1 --2- 172.21.15.8:0/1989611598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb280f77d0 0x7fdb280f7c30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.954+0000 7fdb2cd8f700 1 --2- 172.21.15.8:0/1989611598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb280f6530 0x7fdb280f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.954+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/1989611598 >> 172.21.15.8:0/1989611598 conn(0x7fdb280f1c90 msgr2=0x7fdb280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.954+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/1989611598 shutdown_connections 2023-10-18T21:01:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.954+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/1989611598 wait complete. 2023-10-18T21:01:56.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.955+0000 7fdb2cd8f700 1 Processor -- start 2023-10-18T21:01:56.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.955+0000 7fdb2cd8f700 1 -- start start 2023-10-18T21:01:56.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.955+0000 7fdb2cd8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb280f6530 0x7fdb28108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:56.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.955+0000 7fdb2cd8f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb280f77d0 0x7fdb281093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:56.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.955+0000 7fdb2cd8f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28109970 con 0x7fdb280f6530 2023-10-18T21:01:56.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.955+0000 7fdb2cd8f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28109ab0 con 0x7fdb280f77d0 2023-10-18T21:01:56.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb277fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb280f6530 0x7fdb28108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:56.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb277fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb280f6530 0x7fdb28108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54230/0 (socket says 172.21.15.8:54230) 2023-10-18T21:01:56.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb277fe700 1 -- 172.21.15.8:0/4233313939 learned_addr learned my addr 172.21.15.8:0/4233313939 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:56.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb26ffd700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb280f77d0 0x7fdb281093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:56.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb277fe700 1 -- 172.21.15.8:0/4233313939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb280f77d0 msgr2=0x7fdb281093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:56.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb277fe700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb280f77d0 0x7fdb281093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:56.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb277fe700 1 -- 172.21.15.8:0/4233313939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c005040 con 0x7fdb280f6530 2023-10-18T21:01:56.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb277fe700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb280f6530 0x7fdb28108ed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fdb1800e7c0 tx=0x7fdb1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:56.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb0ffff700 1 -- 172.21.15.8:0/4233313939 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb180092e0 con 0x7fdb280f6530 2023-10-18T21:01:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/4233313939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2810a450 con 0x7fdb280f6530 2023-10-18T21:01:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb0ffff700 1 -- 172.21.15.8:0/4233313939 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdb1800f040 con 0x7fdb280f6530 2023-10-18T21:01:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.956+0000 7fdb0ffff700 1 -- 172.21.15.8:0/4233313939 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb18014810 con 0x7fdb280f6530 2023-10-18T21:01:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.957+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/4233313939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2810a990 con 0x7fdb280f6530 2023-10-18T21:01:56.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.958+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/4233313939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb28045ad0 con 0x7fdb280f6530 2023-10-18T21:01:56.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.959+0000 7fdb0ffff700 1 -- 172.21.15.8:0/4233313939 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdb1801b030 con 0x7fdb280f6530 2023-10-18T21:01:56.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.959+0000 7fdb0ffff700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb10060f70 0x7fdb10063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:56.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.960+0000 7fdb0ffff700 1 -- 172.21.15.8:0/4233313939 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdb1807c050 con 0x7fdb280f6530 2023-10-18T21:01:56.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.960+0000 7fdb26ffd700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb10060f70 0x7fdb10063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:56.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.960+0000 7fdb26ffd700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb10060f70 0x7fdb10063430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdb1c005010 tx=0x7fdb1c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:56.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:56.964+0000 7fdb0ffff700 1 -- 172.21.15.8:0/4233313939 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdb1804ff00 con 0x7fdb280f6530 2023-10-18T21:01:57.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.159+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/4233313939 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb280fee00 con 0x7fdb10060f70 2023-10-18T21:01:57.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.169+0000 7fdb0ffff700 1 -- 172.21.15.8:0/4233313939 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fdb280fee00 con 0x7fdb10060f70 2023-10-18T21:01:57.172 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:01:57.172 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (8m) 5s ago 10m 15.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:01:57.172 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (2m) 5s ago 10m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:01:57.172 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (2m) 2m ago 9m 7566k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:01:57.172 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (8m) 5s ago 9m 25.2M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:01:57.173 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (6m) 5s ago 6m 7674M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T21:01:57.173 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (6m) 5s ago 6m 919M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T21:01:57.173 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (6m) 2m ago 6m 2598M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:01:57.173 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (6m) 2m ago 6m 373M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:01:57.173 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (3m) 5s ago 11m 450M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:01:57.174 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (3m) 2m ago 9m 394M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:01:57.174 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (2m) 5s ago 11m 86.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:01:57.174 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (2m) 2m ago 9m 39.6M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:01:57.174 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (9m) 5s ago 9m 9605k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:01:57.174 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (8m) 2m ago 8m 9903k - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:01:57.175 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (2m) 5s ago 8m 410M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:01:57.175 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (10s) 5s ago 8m 12.0M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:01:57.175 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (8m) 5s ago 8m 879M 4096M 16.2.4 8d91d370c2b8 8bfdac4a060b 2023-10-18T21:01:57.175 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (7m) 2m ago 7m 856M 4096M 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T21:01:57.175 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (7m) 2m ago 7m 709M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T21:01:57.175 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (7m) 2m ago 7m 745M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T21:01:57.176 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (4m) 5s ago 9m 58.6M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:01:57.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/4233313939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb10060f70 msgr2=0x7fdb10063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:57.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb10060f70 0x7fdb10063430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdb1c005010 tx=0x7fdb1c016040).stop 2023-10-18T21:01:57.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/4233313939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb280f6530 msgr2=0x7fdb28108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:57.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb280f6530 0x7fdb28108ed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fdb1800e7c0 tx=0x7fdb1800b040).stop 2023-10-18T21:01:57.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/4233313939 shutdown_connections 2023-10-18T21:01:57.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb10060f70 0x7fdb10063430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb280f6530 0x7fdb28108ed0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 --2- 172.21.15.8:0/4233313939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb280f77d0 0x7fdb281093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/4233313939 >> 172.21.15.8:0/4233313939 conn(0x7fdb280f1c90 msgr2=0x7fdb280f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/4233313939 shutdown_connections 2023-10-18T21:01:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.171+0000 7fdb2cd8f700 1 -- 172.21.15.8:0/4233313939 wait complete. 2023-10-18T21:01:57.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.347+0000 7f3c9e218700 1 -- 172.21.15.8:0/3032021808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c9806b960 msgr2=0x7f3c98069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:57.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.347+0000 7f3c9e218700 1 --2- 172.21.15.8:0/3032021808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c9806b960 0x7f3c98069e60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3c94004660 tx=0x7f3c94009b30).stop 2023-10-18T21:01:57.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.347+0000 7f3c9e218700 1 -- 172.21.15.8:0/3032021808 shutdown_connections 2023-10-18T21:01:57.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.347+0000 7f3c9e218700 1 --2- 172.21.15.8:0/3032021808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9806a350 0x7f3c9806a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:01:57.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.347+0000 7f3c9e218700 1 --2- 172.21.15.8:0/3032021808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c9806b960 0x7f3c98069e60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:57.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.347+0000 7f3c9e218700 1 -- 172.21.15.8:0/3032021808 >> 172.21.15.8:0/3032021808 conn(0x7f3c980f1cd0 msgr2=0x7f3c980f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:57.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.347+0000 7f3c9e218700 1 -- 172.21.15.8:0/3032021808 shutdown_connections 2023-10-18T21:01:57.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.347+0000 7f3c9e218700 1 -- 172.21.15.8:0/3032021808 wait complete. 2023-10-18T21:01:57.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.349+0000 7f3c9e218700 1 Processor -- start 2023-10-18T21:01:57.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.349+0000 7f3c9e218700 1 -- start start 2023-10-18T21:01:57.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.349+0000 7f3c9e218700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9806a350 0x7f3c980f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:57.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.349+0000 7f3c9e218700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c9806b960 0x7f3c980f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:57.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.349+0000 7f3c9e218700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980f6fc0 con 0x7f3c9806a350 2023-10-18T21:01:57.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.349+0000 7f3c9e218700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980f7870 con 0x7f3c9806b960 2023-10-18T21:01:57.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.349+0000 7f3c9d216700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9806a350 0x7f3c980f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.349+0000 7f3c9d216700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9806a350 0x7f3c980f6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54234/0 (socket says 172.21.15.8:54234) 2023-10-18T21:01:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.349+0000 7f3c9d216700 1 -- 172.21.15.8:0/3918188358 learned_addr learned my addr 172.21.15.8:0/3918188358 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.350+0000 7f3c9d216700 1 -- 172.21.15.8:0/3918188358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c9806b960 msgr2=0x7f3c980f6930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-18T21:01:57.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.350+0000 7f3c9d216700 1 --2- 172.21.15.8:0/3918188358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c9806b960 0x7f3c980f6930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:01:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.350+0000 7f3c9d216700 1 -- 172.21.15.8:0/3918188358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94005040 con 0x7f3c9806a350 2023-10-18T21:01:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.350+0000 7f3c9d216700 1 --2- 172.21.15.8:0/3918188358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9806a350 0x7f3c980f6440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3c94009630 tx=0x7f3c94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.351+0000 7f3c8dffb700 1 -- 172.21.15.8:0/3918188358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c94018070 con 0x7f3c9806a350 2023-10-18T21:01:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.351+0000 7f3c8dffb700 1 -- 172.21.15.8:0/3918188358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3c940097d0 con 0x7f3c9806a350 2023-10-18T21:01:57.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.351+0000 7f3c8dffb700 1 -- 172.21.15.8:0/3918188358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c9401c620 con 0x7f3c9806a350 2023-10-18T21:01:57.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.351+0000 7f3c9e218700 1 -- 172.21.15.8:0/3918188358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c980f7ac0 con 0x7f3c9806a350 2023-10-18T21:01:57.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.351+0000 7f3c9e218700 1 -- 172.21.15.8:0/3918188358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c980f8020 con 0x7f3c9806a350 2023-10-18T21:01:57.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.353+0000 7f3c9e218700 1 -- 172.21.15.8:0/3918188358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c98059100 con 0x7f3c9806a350 2023-10-18T21:01:57.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.354+0000 7f3c8dffb700 1 -- 172.21.15.8:0/3918188358 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3c94007cf0 con 0x7f3c9806a350 2023-10-18T21:01:57.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.355+0000 7f3c8dffb700 1 --2- 172.21.15.8:0/3918188358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c84060f70 0x7f3c84063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:57.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.355+0000 7f3c8dffb700 1 -- 172.21.15.8:0/3918188358 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f3c9407df50 con 0x7f3c9806a350 2023-10-18T21:01:57.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.355+0000 7f3c9ca15700 1 --2- 172.21.15.8:0/3918188358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c84060f70 0x7f3c84063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:57.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.356+0000 7f3c9ca15700 1 --2- 172.21.15.8:0/3918188358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c84060f70 0x7f3c84063430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3c8800b460 tx=0x7f3c88006960).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:57.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.363+0000 7f3c8dffb700 1 -- 172.21.15.8:0/3918188358 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3c9404e330 con 0x7f3c9806a350 2023-10-18T21:01:57.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.652+0000 7f3c9e218700 1 -- 172.21.15.8:0/3918188358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3c98027a00 con 0x7f3c9806a350 2023-10-18T21:01:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.653+0000 7f3c8dffb700 1 -- 172.21.15.8:0/3918188358 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7f3c94051950 con 0x7f3c9806a350 2023-10-18T21:01:57.656 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:01:57.657 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:01:57.657 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:01:57.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:01:57.657 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:01:57.658 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:01:57.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:01:57.658 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:01:57.658 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2, 2023-10-18T21:01:57.659 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T21:01:57.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:01:57.659 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:01:57.659 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T21:01:57.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:01:57.660 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:01:57.660 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6, 2023-10-18T21:01:57.660 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8 2023-10-18T21:01:57.660 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:01:57.660 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:01:57.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 -- 172.21.15.8:0/3918188358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c84060f70 msgr2=0x7f3c84063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:57.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 --2- 172.21.15.8:0/3918188358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c84060f70 0x7f3c84063430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3c8800b460 tx=0x7f3c88006960).stop 2023-10-18T21:01:57.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 -- 172.21.15.8:0/3918188358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9806a350 msgr2=0x7f3c980f6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:57.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 --2- 172.21.15.8:0/3918188358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9806a350 0x7f3c980f6440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3c94009630 tx=0x7f3c94009b30).stop 2023-10-18T21:01:57.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 -- 172.21.15.8:0/3918188358 shutdown_connections 2023-10-18T21:01:57.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 --2- 172.21.15.8:0/3918188358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c84060f70 0x7f3c84063430 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:57.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 --2- 172.21.15.8:0/3918188358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9806a350 0x7f3c980f6440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:57.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 --2- 172.21.15.8:0/3918188358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c9806b960 0x7f3c980f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:01:57.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 -- 172.21.15.8:0/3918188358 >> 172.21.15.8:0/3918188358 conn(0x7f3c980f1cd0 msgr2=0x7f3c980fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:57.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 -- 172.21.15.8:0/3918188358 shutdown_connections 2023-10-18T21:01:57.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.655+0000 7f3c9e218700 1 -- 172.21.15.8:0/3918188358 wait complete. 2023-10-18T21:01:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:56.170717+0000 mgr.smithi008.flmjzp (mgr.14640) 174 : cluster [DBG] pgmap v122: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:01:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:56.229541+0000 mon.smithi008 (mon.0) 237 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T21:01:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:56.236070+0000 mon.smithi008 (mon.0) 238 : cluster [INF] osd.1 [v2:172.21.15.8:6810/100500030,v1:172.21.15.8:6811/100500030] boot 2023-10-18T21:01:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:56.236116+0000 mon.smithi008 (mon.0) 239 : cluster [DBG] osdmap e61: 6 total, 6 up, 6 in 2023-10-18T21:01:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:56.236756+0000 mon.smithi008 (mon.0) 240 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T21:01:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:56.469972+0000 mgr.smithi008.flmjzp (mgr.14640) 175 : audit [DBG] from='client.44199 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:56.170717+0000 mgr.smithi008.flmjzp (mgr.14640) 174 : cluster [DBG] pgmap v122: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:01:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:56.229541+0000 mon.smithi008 (mon.0) 237 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T21:01:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:56.236070+0000 mon.smithi008 (mon.0) 238 : cluster [INF] osd.1 [v2:172.21.15.8:6810/100500030,v1:172.21.15.8:6811/100500030] boot 2023-10-18T21:01:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:56.236116+0000 mon.smithi008 (mon.0) 239 : cluster [DBG] osdmap e61: 6 total, 6 up, 6 in 2023-10-18T21:01:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:56.236756+0000 mon.smithi008 (mon.0) 240 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T21:01:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:56.469972+0000 mgr.smithi008.flmjzp (mgr.14640) 175 : audit [DBG] from='client.44199 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:57.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.791+0000 7ff8b91aa700 1 -- 172.21.15.8:0/4285557042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b40f8740 msgr2=0x7ff8b40f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:57.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.791+0000 7ff8b91aa700 1 --2- 172.21.15.8:0/4285557042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b40f8740 0x7ff8b40f8b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff8a4004660 tx=0x7ff8a4009b30).stop 2023-10-18T21:01:57.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.791+0000 7ff8b91aa700 1 -- 172.21.15.8:0/4285557042 shutdown_connections 2023-10-18T21:01:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.791+0000 7ff8b91aa700 1 --2- 172.21.15.8:0/4285557042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b40f99e0 0x7ff8b40f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.791+0000 7ff8b91aa700 1 --2- 172.21.15.8:0/4285557042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b40f8740 0x7ff8b40f8b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.791+0000 7ff8b91aa700 1 -- 172.21.15.8:0/4285557042 >> 172.21.15.8:0/4285557042 conn(0x7ff8b40f40e0 msgr2=0x7ff8b40f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.791+0000 7ff8b91aa700 1 -- 172.21.15.8:0/4285557042 shutdown_connections 2023-10-18T21:01:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.791+0000 7ff8b91aa700 1 -- 172.21.15.8:0/4285557042 wait complete. 2023-10-18T21:01:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.793+0000 7ff8b91aa700 1 Processor -- start 2023-10-18T21:01:57.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.793+0000 7ff8b91aa700 1 -- start start 2023-10-18T21:01:57.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.793+0000 7ff8b91aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b40f8740 0x7ff8b4108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:57.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.793+0000 7ff8b91aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b40f99e0 0x7ff8b4109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:57.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.793+0000 7ff8b91aa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b41099e0 con 0x7ff8b40f99e0 2023-10-18T21:01:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.793+0000 7ff8b91aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4109b20 con 0x7ff8b40f8740 2023-10-18T21:01:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.794+0000 7ff8b37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b40f99e0 0x7ff8b4109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.794+0000 7ff8b37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b40f99e0 0x7ff8b4109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54244/0 (socket says 172.21.15.8:54244) 2023-10-18T21:01:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.794+0000 7ff8b37fe700 1 -- 172.21.15.8:0/464643073 learned_addr learned my addr 172.21.15.8:0/464643073 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.794+0000 7ff8b3fff700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b40f8740 0x7ff8b4108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.794+0000 7ff8b37fe700 1 -- 172.21.15.8:0/464643073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b40f8740 msgr2=0x7ff8b4108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.794+0000 7ff8b37fe700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b40f8740 0x7ff8b4108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.794+0000 7ff8b37fe700 1 -- 172.21.15.8:0/464643073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a4005040 con 0x7ff8b40f99e0 2023-10-18T21:01:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.794+0000 7ff8b37fe700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b40f99e0 0x7ff8b4109430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff8a800e7f0 tx=0x7ff8a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.795+0000 7ff8b0ff9700 1 -- 172.21.15.8:0/464643073 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8a80092e0 con 0x7ff8b40f99e0 2023-10-18T21:01:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.795+0000 7ff8b0ff9700 1 -- 172.21.15.8:0/464643073 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff8a800f040 con 0x7ff8b40f99e0 2023-10-18T21:01:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.795+0000 7ff8b91aa700 1 -- 172.21.15.8:0/464643073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b410a4c0 con 0x7ff8b40f99e0 2023-10-18T21:01:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.795+0000 7ff8b0ff9700 1 -- 172.21.15.8:0/464643073 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8a80147e0 con 0x7ff8b40f99e0 2023-10-18T21:01:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.795+0000 7ff8b91aa700 1 -- 172.21.15.8:0/464643073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b410aa00 con 0x7ff8b40f99e0 2023-10-18T21:01:57.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.796+0000 7ff8b91aa700 1 -- 172.21.15.8:0/464643073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b4045ad0 con 0x7ff8b40f99e0 2023-10-18T21:01:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.797+0000 7ff8b0ff9700 1 -- 172.21.15.8:0/464643073 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff8a801b030 con 0x7ff8b40f99e0 2023-10-18T21:01:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.798+0000 7ff8b0ff9700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff89c060f70 0x7ff89c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.798+0000 7ff8b0ff9700 1 -- 172.21.15.8:0/464643073 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff8a807bfb0 con 0x7ff8b40f99e0 2023-10-18T21:01:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.798+0000 7ff8b3fff700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff89c060f70 0x7ff89c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.799+0000 7ff8b3fff700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff89c060f70 0x7ff89c063430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff8a4005010 tx=0x7ff8a4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:57.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:57.802+0000 7ff8b0ff9700 1 -- 172.21.15.8:0/464643073 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff8a80aaf20 con 0x7ff8b40f99e0 2023-10-18T21:01:58.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.030+0000 7ff8b91aa700 1 -- 172.21.15.8:0/464643073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff8b4027a00 con 0x7ff8b40f99e0 2023-10-18T21:01:58.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.031+0000 7ff8b0ff9700 1 -- 172.21.15.8:0/464643073 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1794 (secure 0 0 0) 0x7ff8a8019020 con 0x7ff8b40f99e0 2023-10-18T21:01:58.034 INFO:teuthology.orchestra.run.smithi008.stdout:e17 2023-10-18T21:01:58.034 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:01:58.034 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:01:58.034 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:01:58.035 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:01:58.035 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:01:58.035 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:01:58.035 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 17 2023-10-18T21:01:58.035 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T21:01:58.036 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:01:58.036 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:59:22.221117+0000 2023-10-18T21:01:58.036 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:01:58.036 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:01:58.036 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:01:58.037 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:01:58.037 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:01:58.037 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:01:58.037 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:01:58.037 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T21:01:58.038 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:01:58.038 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T21:01:58.038 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T21:01:58.038 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T21:01:58.038 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:01:58.039 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:01:58.039 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T21:01:58.039 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:01:58.039 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:01:58.039 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:01:58.040 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:01:58.040 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:01:58.040 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:01:58.040 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:01:58.040 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:01:58.040 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:01:58.041 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:01:58.041 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:01:58.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 -- 172.21.15.8:0/464643073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff89c060f70 msgr2=0x7ff89c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:58.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff89c060f70 0x7ff89c063430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff8a4005010 tx=0x7ff8a4016040).stop 2023-10-18T21:01:58.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 -- 172.21.15.8:0/464643073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b40f99e0 msgr2=0x7ff8b4109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:58.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b40f99e0 0x7ff8b4109430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff8a800e7f0 tx=0x7ff8a800b040).stop 2023-10-18T21:01:58.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 -- 172.21.15.8:0/464643073 shutdown_connections 2023-10-18T21:01:58.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff89c060f70 0x7ff89c063430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:58.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b40f8740 0x7ff8b4108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:58.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 --2- 172.21.15.8:0/464643073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b40f99e0 0x7ff8b4109430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:58.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 -- 172.21.15.8:0/464643073 >> 172.21.15.8:0/464643073 conn(0x7ff8b40f40e0 msgr2=0x7ff8b40fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:58.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 -- 172.21.15.8:0/464643073 shutdown_connections 2023-10-18T21:01:58.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.033+0000 7ff8b91aa700 1 -- 172.21.15.8:0/464643073 wait complete. 2023-10-18T21:01:58.044 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-18T21:01:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.170+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/4180286821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0f77d0 msgr2=0x7f0ecc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.170+0000 7f0ed0b8d700 1 --2- 172.21.15.8:0/4180286821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0f77d0 0x7f0ecc0f7c30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f0ec0004660 tx=0x7f0ec0009b30).stop 2023-10-18T21:01:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.170+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/4180286821 shutdown_connections 2023-10-18T21:01:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.170+0000 7f0ed0b8d700 1 --2- 172.21.15.8:0/4180286821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0f77d0 0x7f0ecc0f7c30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.170+0000 7f0ed0b8d700 1 --2- 172.21.15.8:0/4180286821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ecc0f6530 0x7f0ecc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.170+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/4180286821 >> 172.21.15.8:0/4180286821 conn(0x7f0ecc0f1c90 msgr2=0x7f0ecc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.170+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/4180286821 shutdown_connections 2023-10-18T21:01:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.170+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/4180286821 wait complete. 2023-10-18T21:01:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.171+0000 7f0ed0b8d700 1 Processor -- start 2023-10-18T21:01:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.171+0000 7f0ed0b8d700 1 -- start start 2023-10-18T21:01:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.171+0000 7f0ed0b8d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ecc0f6530 0x7f0ecc108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.171+0000 7f0ed0b8d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0f77d0 0x7f0ecc109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.171+0000 7f0ed0b8d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc109a20 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.171+0000 7f0ed0b8d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc109b60 con 0x7f0ecc0f6530 2023-10-18T21:01:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0ecaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0f77d0 0x7f0ecc109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0ecaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0f77d0 0x7f0ecc109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54250/0 (socket says 172.21.15.8:54250) 2023-10-18T21:01:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0ecaffd700 1 -- 172.21.15.8:0/760702129 learned_addr learned my addr 172.21.15.8:0/760702129 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:01:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0ecb7fe700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ecc0f6530 0x7f0ecc108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0ecaffd700 1 -- 172.21.15.8:0/760702129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ecc0f6530 msgr2=0x7f0ecc108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0ecaffd700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ecc0f6530 0x7f0ecc108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0ecaffd700 1 -- 172.21.15.8:0/760702129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec0005040 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0ecb7fe700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ecc0f6530 0x7f0ecc108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:01:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0ecaffd700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0f77d0 0x7f0ecc109470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0ec0009990 tx=0x7f0ec0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0eb3fff700 1 -- 172.21.15.8:0/760702129 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ec0018070 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0eb3fff700 1 -- 172.21.15.8:0/760702129 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0ec0009630 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.172+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/760702129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc10a4a0 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.173+0000 7f0eb3fff700 1 -- 172.21.15.8:0/760702129 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ec001c400 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.173+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/760702129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc10aa00 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.174+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/760702129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ecc045ad0 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.174+0000 7f0eb3fff700 1 -- 172.21.15.8:0/760702129 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0ec001d9e0 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.175+0000 7f0eb3fff700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0eb4060f70 0x7f0eb4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:01:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.175+0000 7f0eb3fff700 1 -- 172.21.15.8:0/760702129 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0ec007de70 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.176+0000 7f0ecb7fe700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0eb4060f70 0x7f0eb4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:01:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.176+0000 7f0ecb7fe700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0eb4060f70 0x7f0eb4063430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0ecc0f7630 tx=0x7f0ebc009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:01:58.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.179+0000 7f0eb3fff700 1 -- 172.21.15.8:0/760702129 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0ec0051ce0 con 0x7f0ecc0f77d0 2023-10-18T21:01:58.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.381+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/760702129 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ecc0fedd0 con 0x7f0eb4060f70 2023-10-18T21:01:58.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.382+0000 7f0eb3fff700 1 -- 172.21.15.8:0/760702129 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0ecc0fedd0 con 0x7f0eb4060f70 2023-10-18T21:01:58.385 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:01:58.385 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:01:58.386 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:01:58.386 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:01:58.386 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:01:58.386 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:01:58.386 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:01:58.387 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:01:58.387 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:01:58.387 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "8/21 daemons upgraded", 2023-10-18T21:01:58.387 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading osd daemons", 2023-10-18T21:01:58.387 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:01:58.387 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:01:58.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.384+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/760702129 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0eb4060f70 msgr2=0x7f0eb4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:58.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.384+0000 7f0ed0b8d700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0eb4060f70 0x7f0eb4063430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0ecc0f7630 tx=0x7f0ebc009c00).stop 2023-10-18T21:01:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.384+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/760702129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0f77d0 msgr2=0x7f0ecc109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:01:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.384+0000 7f0ed0b8d700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0f77d0 0x7f0ecc109470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0ec0009990 tx=0x7f0ec0009b30).stop 2023-10-18T21:01:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.384+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/760702129 shutdown_connections 2023-10-18T21:01:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.384+0000 7f0ed0b8d700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0eb4060f70 0x7f0eb4063430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:58.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.384+0000 7f0ed0b8d700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ecc0f6530 0x7f0ecc108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:58.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.384+0000 7f0ed0b8d700 1 --2- 172.21.15.8:0/760702129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0f77d0 0x7f0ecc109470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:01:58.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.384+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/760702129 >> 172.21.15.8:0/760702129 conn(0x7f0ecc0f1c90 msgr2=0x7f0ecc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:01:58.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.385+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/760702129 shutdown_connections 2023-10-18T21:01:58.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:01:58.385+0000 7f0ed0b8d700 1 -- 172.21.15.8:0/760702129 wait complete. 2023-10-18T21:01:58.659 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:56.816934+0000 mgr.smithi008.flmjzp (mgr.14640) 176 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:58.659 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:57.161819+0000 mgr.smithi008.flmjzp (mgr.14640) 177 : audit [DBG] from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:58.660 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:57.242517+0000 mon.smithi008 (mon.0) 241 : cluster [DBG] osdmap e62: 6 total, 6 up, 6 in 2023-10-18T21:01:58.660 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:57.654716+0000 mon.smithi008 (mon.0) 242 : audit [DBG] from='client.? 172.21.15.8:0/3918188358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:01:58.660 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:58.032431+0000 mon.smithi008 (mon.0) 243 : audit [DBG] from='client.? 172.21.15.8:0/464643073' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:01:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:56.816934+0000 mgr.smithi008.flmjzp (mgr.14640) 176 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:57.161819+0000 mgr.smithi008.flmjzp (mgr.14640) 177 : audit [DBG] from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:57.242517+0000 mon.smithi008 (mon.0) 241 : cluster [DBG] osdmap e62: 6 total, 6 up, 6 in 2023-10-18T21:01:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:57.654716+0000 mon.smithi008 (mon.0) 242 : audit [DBG] from='client.? 172.21.15.8:0/3918188358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:01:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:58.032431+0000 mon.smithi008 (mon.0) 243 : audit [DBG] from='client.? 172.21.15.8:0/464643073' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:01:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:01:58.171129+0000 mgr.smithi008.flmjzp (mgr.14640) 178 : cluster [DBG] pgmap v125: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:01:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:01:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:01:58.383903+0000 mgr.smithi008.flmjzp (mgr.14640) 179 : audit [DBG] from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:01:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:01:58.171129+0000 mgr.smithi008.flmjzp (mgr.14640) 178 : cluster [DBG] pgmap v125: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:01:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:01:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:01:58.383903+0000 mgr.smithi008.flmjzp (mgr.14640) 179 : audit [DBG] from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:02:01.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:00.171660+0000 mgr.smithi008.flmjzp (mgr.14640) 180 : cluster [DBG] pgmap v126: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:02:01.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:00.443987+0000 mon.smithi008 (mon.0) 244 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:00.171660+0000 mgr.smithi008.flmjzp (mgr.14640) 180 : cluster [DBG] pgmap v126: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/369 objects degraded (14.905%) 2023-10-18T21:02:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:00.443987+0000 mon.smithi008 (mon.0) 244 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:02.444105+0000 mon.smithi008 (mon.0) 245 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/369 objects degraded (14.905%), 15 pgs degraded) 2023-10-18T21:02:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:02.444139+0000 mon.smithi008 (mon.0) 246 : cluster [INF] Cluster is now healthy 2023-10-18T21:02:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:02.444105+0000 mon.smithi008 (mon.0) 245 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/369 objects degraded (14.905%), 15 pgs degraded) 2023-10-18T21:02:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:02.444139+0000 mon.smithi008 (mon.0) 246 : cluster [INF] Cluster is now healthy 2023-10-18T21:02:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:02.172418+0000 mgr.smithi008.flmjzp (mgr.14640) 181 : cluster [DBG] pgmap v127: 65 pgs: 65 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-10-18T21:02:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:02.172418+0000 mgr.smithi008.flmjzp (mgr.14640) 181 : cluster [DBG] pgmap v127: 65 pgs: 65 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-10-18T21:02:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:04.172830+0000 mgr.smithi008.flmjzp (mgr.14640) 182 : cluster [DBG] pgmap v128: 65 pgs: 65 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-10-18T21:02:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:04.172830+0000 mgr.smithi008.flmjzp (mgr.14640) 182 : cluster [DBG] pgmap v128: 65 pgs: 65 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-10-18T21:02:07.886 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:06.173260+0000 mgr.smithi008.flmjzp (mgr.14640) 183 : cluster [DBG] pgmap v129: 65 pgs: 65 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2023-10-18T21:02:07.887 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:07.107070+0000 mon.smithi008 (mon.0) 247 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-10-18T21:02:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:06.173260+0000 mgr.smithi008.flmjzp (mgr.14640) 183 : cluster [DBG] pgmap v129: 65 pgs: 65 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2023-10-18T21:02:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:07.107070+0000 mon.smithi008 (mon.0) 247 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-10-18T21:02:08.768 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:07.107342+0000 mgr.smithi008.flmjzp (mgr.14640) 184 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-10-18T21:02:08.769 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:02:07.108702+0000 mgr.smithi008.flmjzp (mgr.14640) 185 : cephadm [INF] Upgrade: osd.2 is safe to restart 2023-10-18T21:02:08.769 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:08.277499+0000 mon.smithi008 (mon.0) 248 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:08.769 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:08.278301+0000 mon.smithi008 (mon.0) 249 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-18T21:02:08.769 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:08.278968+0000 mon.smithi008 (mon.0) 250 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:02:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:07.107342+0000 mgr.smithi008.flmjzp (mgr.14640) 184 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-10-18T21:02:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:02:07.108702+0000 mgr.smithi008.flmjzp (mgr.14640) 185 : cephadm [INF] Upgrade: osd.2 is safe to restart 2023-10-18T21:02:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:08.277499+0000 mon.smithi008 (mon.0) 248 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:08.278301+0000 mon.smithi008 (mon.0) 249 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-18T21:02:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:08.278968+0000 mon.smithi008 (mon.0) 250 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:02:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:08.173860+0000 mgr.smithi008.flmjzp (mgr.14640) 186 : cluster [DBG] pgmap v130: 65 pgs: 65 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2023-10-18T21:02:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:02:08.273003+0000 mgr.smithi008.flmjzp (mgr.14640) 187 : cephadm [INF] Upgrade: Updating osd.2 2023-10-18T21:02:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:02:08.279978+0000 mgr.smithi008.flmjzp (mgr.14640) 188 : cephadm [INF] Deploying daemon osd.2 on smithi008 2023-10-18T21:02:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:08.173860+0000 mgr.smithi008.flmjzp (mgr.14640) 186 : cluster [DBG] pgmap v130: 65 pgs: 65 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2023-10-18T21:02:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:02:08.273003+0000 mgr.smithi008.flmjzp (mgr.14640) 187 : cephadm [INF] Upgrade: Updating osd.2 2023-10-18T21:02:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:02:08.279978+0000 mgr.smithi008.flmjzp (mgr.14640) 188 : cephadm [INF] Deploying daemon osd.2 on smithi008 2023-10-18T21:02:10.921 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:10 smithi008 systemd[1]: Stopping Ceph osd.2 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T21:02:10.921 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.2[126564]: debug 2023-10-18T21:02:10.701+0000 7f8105afa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-10-18T21:02:10.921 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.2[126564]: debug 2023-10-18T21:02:10.701+0000 7f8105afa700 -1 osd.2 62 *** Got signal Terminated *** 2023-10-18T21:02:10.921 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.2[126564]: debug 2023-10-18T21:02:10.701+0000 7f8105afa700 -1 osd.2 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T21:02:11.255 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:10 smithi008 bash[155571]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.2 2023-10-18T21:02:11.841 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:10.174263+0000 mgr.smithi008.flmjzp (mgr.14640) 189 : cluster [DBG] pgmap v131: 65 pgs: 65 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2023-10-18T21:02:11.841 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:10.521863+0000 mon.smithi008 (mon.0) 251 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:11.842 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:10.809909+0000 mon.smithi008 (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-10-18T21:02:11.842 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:10.809957+0000 mon.smithi008 (mon.0) 253 : cluster [INF] osd.2 failed (root=default,host=smithi008) (connection refused reported by osd.5) 2023-10-18T21:02:11.842 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.005028+0000 mon.smithi008 (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-10-18T21:02:11.842 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.005187+0000 mon.smithi008 (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-10-18T21:02:11.843 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.005240+0000 mon.smithi008 (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-10-18T21:02:11.843 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.005359+0000 mon.smithi008 (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-10-18T21:02:11.843 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.005728+0000 mon.smithi008 (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-10-18T21:02:11.843 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.005880+0000 mon.smithi008 (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.844 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.006006+0000 mon.smithi008 (mon.0) 260 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-10-18T21:02:11.844 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.006136+0000 mon.smithi008 (mon.0) 261 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-10-18T21:02:11.844 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.006260+0000 mon.smithi008 (mon.0) 262 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.844 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.006386+0000 mon.smithi008 (mon.0) 263 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-10-18T21:02:11.845 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.006531+0000 mon.smithi008 (mon.0) 264 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.845 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.405967+0000 mon.smithi008 (mon.0) 265 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-10-18T21:02:11.845 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.406040+0000 mon.smithi008 (mon.0) 266 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-10-18T21:02:11.845 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.406235+0000 mon.smithi008 (mon.0) 267 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-10-18T21:02:11.845 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.406310+0000 mon.smithi008 (mon.0) 268 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-10-18T21:02:11.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.406623+0000 mon.smithi008 (mon.0) 269 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.406693+0000 mon.smithi008 (mon.0) 270 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-10-18T21:02:11.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.406822+0000 mon.smithi008 (mon.0) 271 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-10-18T21:02:11.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.406875+0000 mon.smithi008 (mon.0) 272 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.406983+0000 mon.smithi008 (mon.0) 273 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-10-18T21:02:11.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.407035+0000 mon.smithi008 (mon.0) 274 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.407145+0000 mon.smithi008 (mon.0) 275 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-10-18T21:02:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:10.174263+0000 mgr.smithi008.flmjzp (mgr.14640) 189 : cluster [DBG] pgmap v131: 65 pgs: 65 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2023-10-18T21:02:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:10.521863+0000 mon.smithi008 (mon.0) 251 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:10.809909+0000 mon.smithi008 (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-10-18T21:02:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:10.809957+0000 mon.smithi008 (mon.0) 253 : cluster [INF] osd.2 failed (root=default,host=smithi008) (connection refused reported by osd.5) 2023-10-18T21:02:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.005028+0000 mon.smithi008 (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-10-18T21:02:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.005187+0000 mon.smithi008 (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-10-18T21:02:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.005240+0000 mon.smithi008 (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-10-18T21:02:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.005359+0000 mon.smithi008 (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-10-18T21:02:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.005728+0000 mon.smithi008 (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-10-18T21:02:11.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.005880+0000 mon.smithi008 (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.006006+0000 mon.smithi008 (mon.0) 260 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-10-18T21:02:11.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.006136+0000 mon.smithi008 (mon.0) 261 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-10-18T21:02:11.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.006260+0000 mon.smithi008 (mon.0) 262 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.006386+0000 mon.smithi008 (mon.0) 263 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-10-18T21:02:11.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.006531+0000 mon.smithi008 (mon.0) 264 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.405967+0000 mon.smithi008 (mon.0) 265 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-10-18T21:02:11.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.406040+0000 mon.smithi008 (mon.0) 266 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-10-18T21:02:11.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.406235+0000 mon.smithi008 (mon.0) 267 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-10-18T21:02:11.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.406310+0000 mon.smithi008 (mon.0) 268 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-10-18T21:02:11.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.406623+0000 mon.smithi008 (mon.0) 269 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.406693+0000 mon.smithi008 (mon.0) 270 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-10-18T21:02:11.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.406822+0000 mon.smithi008 (mon.0) 271 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-10-18T21:02:11.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.406875+0000 mon.smithi008 (mon.0) 272 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.406983+0000 mon.smithi008 (mon.0) 273 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-10-18T21:02:11.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.407035+0000 mon.smithi008 (mon.0) 274 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-10-18T21:02:11.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.407145+0000 mon.smithi008 (mon.0) 275 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-10-18T21:02:12.626 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.521225+0000 mon.smithi008 (mon.0) 276 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T21:02:12.627 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:11.534136+0000 mon.smithi008 (mon.0) 277 : cluster [DBG] osdmap e63: 6 total, 5 up, 6 in 2023-10-18T21:02:12.921 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:12 smithi008 systemd[1]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.2.service: Succeeded. 2023-10-18T21:02:12.921 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:12 smithi008 systemd[1]: Stopped Ceph osd.2 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T21:02:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.521225+0000 mon.smithi008 (mon.0) 276 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T21:02:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:11.534136+0000 mon.smithi008 (mon.0) 277 : cluster [DBG] osdmap e63: 6 total, 5 up, 6 in 2023-10-18T21:02:13.337 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:12 smithi008 systemd[1]: Starting Ceph osd.2 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T21:02:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:12.174608+0000 mgr.smithi008.flmjzp (mgr.14640) 190 : cluster [DBG] pgmap v133: 65 pgs: 9 stale+active+clean, 56 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-10-18T21:02:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:12.536797+0000 mon.smithi008 (mon.0) 278 : cluster [DBG] osdmap e64: 6 total, 5 up, 6 in 2023-10-18T21:02:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:12.174608+0000 mgr.smithi008.flmjzp (mgr.14640) 190 : cluster [DBG] pgmap v133: 65 pgs: 9 stale+active+clean, 56 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-10-18T21:02:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:12.536797+0000 mon.smithi008 (mon.0) 278 : cluster [DBG] osdmap e64: 6 total, 5 up, 6 in 2023-10-18T21:02:14.420 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:14 smithi008 bash[155864]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-18T21:02:14.421 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:14 smithi008 bash[155864]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-10-18T21:02:14.421 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:14 smithi008 bash[155864]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-10-18T21:02:14.421 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:14 smithi008 bash[155864]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-10-18T21:02:14.421 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:14 smithi008 bash[155864]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-10-18T21:02:14.422 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:14 smithi008 bash[155864]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-18T21:02:14.422 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:14 smithi008 bash[155864]: --> ceph-volume raw activate successful for osd ID: 2 2023-10-18T21:02:15.420 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:14 smithi008 bash[156133]: e6761a5759ee840d365b94596751261e47e1eae6d20f2912caaaa769b43beb8a 2023-10-18T21:02:15.421 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-2[156147]: debug 2023-10-18T21:02:14.933+0000 7fb1877da700 1 -- 172.21.15.8:0/3091707378 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55db1600c680 con 0x55db15fd3400 2023-10-18T21:02:15.421 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:14 smithi008 systemd[1]: Started Ceph osd.2 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T21:02:15.847 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-2[156147]: debug 2023-10-18T21:02:15.458+0000 7fb18f255200 -1 Falling back to public interface 2023-10-18T21:02:15.848 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:14.174887+0000 mgr.smithi008.flmjzp (mgr.14640) 191 : cluster [DBG] pgmap v135: 65 pgs: 9 stale+active+clean, 56 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-10-18T21:02:15.848 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:15.007538+0000 mon.smithi008 (mon.0) 279 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:15.848 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:15.008327+0000 mon.smithi008 (mon.0) 280 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:02:15.848 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:15.443378+0000 mon.smithi008 (mon.0) 281 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:14.174887+0000 mgr.smithi008.flmjzp (mgr.14640) 191 : cluster [DBG] pgmap v135: 65 pgs: 9 stale+active+clean, 56 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-10-18T21:02:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:15.007538+0000 mon.smithi008 (mon.0) 279 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:15.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:15.008327+0000 mon.smithi008 (mon.0) 280 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:02:15.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:15.443378+0000 mon.smithi008 (mon.0) 281 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:16.540555+0000 mon.smithi008 (mon.0) 282 : cluster [WRN] Health check failed: Degraded data redundancy: 38/369 objects degraded (10.298%), 10 pgs degraded (PG_DEGRADED) 2023-10-18T21:02:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:16.540555+0000 mon.smithi008 (mon.0) 282 : cluster [WRN] Health check failed: Degraded data redundancy: 38/369 objects degraded (10.298%), 10 pgs degraded (PG_DEGRADED) 2023-10-18T21:02:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:16.175312+0000 mgr.smithi008.flmjzp (mgr.14640) 192 : cluster [DBG] pgmap v136: 65 pgs: 10 active+undersized+degraded, 2 stale+active+clean, 9 active+undersized, 44 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 38/369 objects degraded (10.298%) 2023-10-18T21:02:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:16.175312+0000 mgr.smithi008.flmjzp (mgr.14640) 192 : cluster [DBG] pgmap v136: 65 pgs: 10 active+undersized+degraded, 2 stale+active+clean, 9 active+undersized, 44 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 38/369 objects degraded (10.298%) 2023-10-18T21:02:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:18.175734+0000 mgr.smithi008.flmjzp (mgr.14640) 193 : cluster [DBG] pgmap v137: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 44/369 objects degraded (11.924%) 2023-10-18T21:02:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:18.175734+0000 mgr.smithi008.flmjzp (mgr.14640) 193 : cluster [DBG] pgmap v137: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 44/369 objects degraded (11.924%) 2023-10-18T21:02:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:20.004882+0000 mon.smithi008 (mon.0) 283 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:20.176080+0000 mgr.smithi008.flmjzp (mgr.14640) 194 : cluster [DBG] pgmap v138: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 44/369 objects degraded (11.924%) 2023-10-18T21:02:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:20.584145+0000 mon.smithi008 (mon.0) 284 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:02:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:20.584876+0000 mon.smithi008 (mon.0) 285 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:02:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:02:20.585478+0000 mgr.smithi008.flmjzp (mgr.14640) 195 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:02:21.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:20.589689+0000 mon.smithi008 (mon.0) 286 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:21.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:20.594632+0000 mon.smithi008 (mon.0) 287 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:02:21.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:20.596867+0000 mon.smithi008 (mon.0) 288 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:21.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:20.598116+0000 mon.smithi008 (mon.0) 289 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:21.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:20.599313+0000 mon.smithi008 (mon.0) 290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:21.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:20.600545+0000 mon.smithi008 (mon.0) 291 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-10-18T21:02:21.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:20.600699+0000 mgr.smithi008.flmjzp (mgr.14640) 196 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-10-18T21:02:21.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:02:20.601393+0000 mgr.smithi008.flmjzp (mgr.14640) 197 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-10-18T21:02:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:20.004882+0000 mon.smithi008 (mon.0) 283 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:20.176080+0000 mgr.smithi008.flmjzp (mgr.14640) 194 : cluster [DBG] pgmap v138: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 327 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 44/369 objects degraded (11.924%) 2023-10-18T21:02:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:20.584145+0000 mon.smithi008 (mon.0) 284 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:02:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:20.584876+0000 mon.smithi008 (mon.0) 285 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:02:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:02:20.585478+0000 mgr.smithi008.flmjzp (mgr.14640) 195 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:02:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:20.589689+0000 mon.smithi008 (mon.0) 286 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:21.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:20.594632+0000 mon.smithi008 (mon.0) 287 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:02:21.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:20.596867+0000 mon.smithi008 (mon.0) 288 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:21.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:20.598116+0000 mon.smithi008 (mon.0) 289 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:21.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:20.599313+0000 mon.smithi008 (mon.0) 290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:21.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:20.600545+0000 mon.smithi008 (mon.0) 291 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-10-18T21:02:21.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:20.600699+0000 mgr.smithi008.flmjzp (mgr.14640) 196 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-10-18T21:02:21.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:02:20.601393+0000 mgr.smithi008.flmjzp (mgr.14640) 197 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-10-18T21:02:22.010 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-2[156147]: debug 2023-10-18T21:02:21.730+0000 7fb18f255200 -1 osd.2 62 log_to_monitors {default=true} 2023-10-18T21:02:22.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:21.736310+0000 mon.smithi008 (mon.0) 292 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/327215427,v1:172.21.15.8:6819/327215427]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-18T21:02:22.315 INFO:journalctl@ceph.osd.2.smithi008.stdout:Oct 18 21:02:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-2[156147]: debug 2023-10-18T21:02:22.021+0000 7fb17df4a700 -1 osd.2 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T21:02:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:21.736310+0000 mon.smithi008 (mon.0) 292 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/327215427,v1:172.21.15.8:6819/327215427]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-18T21:02:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:22.014978+0000 mon.smithi008 (mon.0) 293 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/327215427,v1:172.21.15.8:6819/327215427]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-18T21:02:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:22.015027+0000 mon.smithi008 (mon.0) 294 : cluster [DBG] osdmap e65: 6 total, 5 up, 6 in 2023-10-18T21:02:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:22.015640+0000 mon.smithi008 (mon.0) 295 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/327215427,v1:172.21.15.8:6819/327215427]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T21:02:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:22.176668+0000 mgr.smithi008.flmjzp (mgr.14640) 198 : cluster [DBG] pgmap v140: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/369 objects degraded (11.924%) 2023-10-18T21:02:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:22.014978+0000 mon.smithi008 (mon.0) 293 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/327215427,v1:172.21.15.8:6819/327215427]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-18T21:02:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:22.015027+0000 mon.smithi008 (mon.0) 294 : cluster [DBG] osdmap e65: 6 total, 5 up, 6 in 2023-10-18T21:02:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:22.015640+0000 mon.smithi008 (mon.0) 295 : audit [INF] from='osd.2 [v2:172.21.15.8:6818/327215427,v1:172.21.15.8:6819/327215427]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-18T21:02:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:22.176668+0000 mgr.smithi008.flmjzp (mgr.14640) 198 : cluster [DBG] pgmap v140: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/369 objects degraded (11.924%) 2023-10-18T21:02:24.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:23.014290+0000 mon.smithi008 (mon.0) 296 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T21:02:24.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:23.022716+0000 mon.smithi008 (mon.0) 297 : cluster [INF] osd.2 [v2:172.21.15.8:6818/327215427,v1:172.21.15.8:6819/327215427] boot 2023-10-18T21:02:24.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:23.022791+0000 mon.smithi008 (mon.0) 298 : cluster [DBG] osdmap e66: 6 total, 6 up, 6 in 2023-10-18T21:02:24.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:23.023256+0000 mon.smithi008 (mon.0) 299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T21:02:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:23.014290+0000 mon.smithi008 (mon.0) 296 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T21:02:24.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:23.022716+0000 mon.smithi008 (mon.0) 297 : cluster [INF] osd.2 [v2:172.21.15.8:6818/327215427,v1:172.21.15.8:6819/327215427] boot 2023-10-18T21:02:24.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:23.022791+0000 mon.smithi008 (mon.0) 298 : cluster [DBG] osdmap e66: 6 total, 6 up, 6 in 2023-10-18T21:02:24.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:23.023256+0000 mon.smithi008 (mon.0) 299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T21:02:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:24.031125+0000 mon.smithi008 (mon.0) 300 : cluster [DBG] osdmap e67: 6 total, 6 up, 6 in 2023-10-18T21:02:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:24.177107+0000 mgr.smithi008.flmjzp (mgr.14640) 199 : cluster [DBG] pgmap v143: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 44/369 objects degraded (11.924%) 2023-10-18T21:02:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:24.853361+0000 mon.smithi008 (mon.0) 301 : cluster [WRN] Health check update: Degraded data redundancy: 44/369 objects degraded (11.924%), 13 pgs degraded (PG_DEGRADED) 2023-10-18T21:02:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:24.031125+0000 mon.smithi008 (mon.0) 300 : cluster [DBG] osdmap e67: 6 total, 6 up, 6 in 2023-10-18T21:02:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:24.177107+0000 mgr.smithi008.flmjzp (mgr.14640) 199 : cluster [DBG] pgmap v143: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 44/369 objects degraded (11.924%) 2023-10-18T21:02:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:24.853361+0000 mon.smithi008 (mon.0) 301 : cluster [WRN] Health check update: Degraded data redundancy: 44/369 objects degraded (11.924%), 13 pgs degraded (PG_DEGRADED) 2023-10-18T21:02:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:26.177722+0000 mgr.smithi008.flmjzp (mgr.14640) 200 : cluster [DBG] pgmap v144: 65 pgs: 7 active+undersized+degraded, 8 active+undersized, 50 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 21/369 objects degraded (5.691%) 2023-10-18T21:02:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:26.177722+0000 mgr.smithi008.flmjzp (mgr.14640) 200 : cluster [DBG] pgmap v144: 65 pgs: 7 active+undersized+degraded, 8 active+undersized, 50 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 21/369 objects degraded (5.691%) 2023-10-18T21:02:28.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.538+0000 7f97d151f700 1 -- 172.21.15.8:0/1203610380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97cc060270 msgr2=0x7f97cc0f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:28.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.538+0000 7f97d151f700 1 --2- 172.21.15.8:0/1203610380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97cc060270 0x7f97cc0f91b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f97bc004660 tx=0x7f97bc009b30).stop 2023-10-18T21:02:28.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.538+0000 7f97d151f700 1 -- 172.21.15.8:0/1203610380 shutdown_connections 2023-10-18T21:02:28.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.538+0000 7f97d151f700 1 --2- 172.21.15.8:0/1203610380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc0f96a0 0x7f97cc0fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:28.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.538+0000 7f97d151f700 1 --2- 172.21.15.8:0/1203610380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97cc060270 0x7f97cc0f91b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:28.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.538+0000 7f97d151f700 1 -- 172.21.15.8:0/1203610380 >> 172.21.15.8:0/1203610380 conn(0x7f97cc0f0b90 msgr2=0x7f97cc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:28.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.538+0000 7f97d151f700 1 -- 172.21.15.8:0/1203610380 shutdown_connections 2023-10-18T21:02:28.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.538+0000 7f97d151f700 1 -- 172.21.15.8:0/1203610380 wait complete. 2023-10-18T21:02:28.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.539+0000 7f97d151f700 1 Processor -- start 2023-10-18T21:02:28.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.539+0000 7f97d151f700 1 -- start start 2023-10-18T21:02:28.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.539+0000 7f97d151f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc060270 0x7f97cc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:28.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.540+0000 7f97d151f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97cc0f96a0 0x7f97cc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:28.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.540+0000 7f97d151f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc107880 con 0x7f97cc0f96a0 2023-10-18T21:02:28.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.540+0000 7f97d151f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc108090 con 0x7f97cc060270 2023-10-18T21:02:28.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.540+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97cc0f96a0 0x7f97cc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:28.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.540+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97cc0f96a0 0x7f97cc107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50316/0 (socket says 172.21.15.8:50316) 2023-10-18T21:02:28.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.540+0000 7f97cb7fe700 1 -- 172.21.15.8:0/3148158926 learned_addr learned my addr 172.21.15.8:0/3148158926 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:02:28.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.540+0000 7f97cbfff700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc060270 0x7f97cc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:28.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.540+0000 7f97cb7fe700 1 -- 172.21.15.8:0/3148158926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc060270 msgr2=0x7f97cc106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.540+0000 7f97cb7fe700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc060270 0x7f97cc106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.540+0000 7f97cb7fe700 1 -- 172.21.15.8:0/3148158926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc005040 con 0x7f97cc0f96a0 2023-10-18T21:02:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.541+0000 7f97cb7fe700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97cc0f96a0 0x7f97cc107280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f97c000e7c0 tx=0x7f97c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.541+0000 7f97c8ff9700 1 -- 172.21.15.8:0/3148158926 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97c00092e0 con 0x7f97cc0f96a0 2023-10-18T21:02:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.541+0000 7f97c8ff9700 1 -- 172.21.15.8:0/3148158926 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f97c000f040 con 0x7f97cc0f96a0 2023-10-18T21:02:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.541+0000 7f97c8ff9700 1 -- 172.21.15.8:0/3148158926 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97c00147e0 con 0x7f97cc0f96a0 2023-10-18T21:02:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.541+0000 7f97d151f700 1 -- 172.21.15.8:0/3148158926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97cc108310 con 0x7f97cc0f96a0 2023-10-18T21:02:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.541+0000 7f97d151f700 1 -- 172.21.15.8:0/3148158926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc108850 con 0x7f97cc0f96a0 2023-10-18T21:02:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.542+0000 7f97d151f700 1 -- 172.21.15.8:0/3148158926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97cc059100 con 0x7f97cc0f96a0 2023-10-18T21:02:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.543+0000 7f97c8ff9700 1 -- 172.21.15.8:0/3148158926 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f97c0014a10 con 0x7f97cc0f96a0 2023-10-18T21:02:28.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.544+0000 7f97c8ff9700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b4060f70 0x7f97b4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:28.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.544+0000 7f97c8ff9700 1 -- 172.21.15.8:0/3148158926 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f97c007c3b0 con 0x7f97cc0f96a0 2023-10-18T21:02:28.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.544+0000 7f97cbfff700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b4060f70 0x7f97b4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:28.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.545+0000 7f97cbfff700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b4060f70 0x7f97b4063430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f97bc005010 tx=0x7f97bc016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:28.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.548+0000 7f97c8ff9700 1 -- 172.21.15.8:0/3148158926 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f97c004c770 con 0x7f97cc0f96a0 2023-10-18T21:02:28.659 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:28.232859+0000 mon.smithi008 (mon.0) 302 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/369 objects degraded (5.691%), 7 pgs degraded) 2023-10-18T21:02:28.660 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:28.232896+0000 mon.smithi008 (mon.0) 303 : cluster [INF] Cluster is now healthy 2023-10-18T21:02:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:28.232859+0000 mon.smithi008 (mon.0) 302 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/369 objects degraded (5.691%), 7 pgs degraded) 2023-10-18T21:02:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:28.232896+0000 mon.smithi008 (mon.0) 303 : cluster [INF] Cluster is now healthy 2023-10-18T21:02:28.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.748+0000 7f97d151f700 1 -- 172.21.15.8:0/3148158926 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97cc0fee60 con 0x7f97b4060f70 2023-10-18T21:02:28.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.749+0000 7f97c8ff9700 1 -- 172.21.15.8:0/3148158926 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f97cc0fee60 con 0x7f97b4060f70 2023-10-18T21:02:28.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.751+0000 7f97d151f700 1 -- 172.21.15.8:0/3148158926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b4060f70 msgr2=0x7f97b4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:28.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.751+0000 7f97d151f700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b4060f70 0x7f97b4063430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f97bc005010 tx=0x7f97bc016040).stop 2023-10-18T21:02:28.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.751+0000 7f97d151f700 1 -- 172.21.15.8:0/3148158926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97cc0f96a0 msgr2=0x7f97cc107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:28.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.751+0000 7f97d151f700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97cc0f96a0 0x7f97cc107280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f97c000e7c0 tx=0x7f97c000b040).stop 2023-10-18T21:02:28.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.751+0000 7f97d151f700 1 -- 172.21.15.8:0/3148158926 shutdown_connections 2023-10-18T21:02:28.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.751+0000 7f97d151f700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b4060f70 0x7f97b4063430 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:28.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.751+0000 7f97d151f700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc060270 0x7f97cc106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:28.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.751+0000 7f97d151f700 1 --2- 172.21.15.8:0/3148158926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97cc0f96a0 0x7f97cc107280 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:28.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.751+0000 7f97d151f700 1 -- 172.21.15.8:0/3148158926 >> 172.21.15.8:0/3148158926 conn(0x7f97cc0f0b90 msgr2=0x7f97cc0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:28.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.751+0000 7f97d151f700 1 -- 172.21.15.8:0/3148158926 shutdown_connections 2023-10-18T21:02:28.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.752+0000 7f97d151f700 1 -- 172.21.15.8:0/3148158926 wait complete. 2023-10-18T21:02:28.767 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:02:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.889+0000 7f98bd244700 1 -- 172.21.15.8:0/2915595937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b80f77d0 msgr2=0x7f98b80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:28.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.889+0000 7f98bd244700 1 --2- 172.21.15.8:0/2915595937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b80f77d0 0x7f98b80f7c30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f98ac004660 tx=0x7f98ac009b30).stop 2023-10-18T21:02:28.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.889+0000 7f98bd244700 1 -- 172.21.15.8:0/2915595937 shutdown_connections 2023-10-18T21:02:28.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.889+0000 7f98bd244700 1 --2- 172.21.15.8:0/2915595937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b80f77d0 0x7f98b80f7c30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:28.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.889+0000 7f98bd244700 1 --2- 172.21.15.8:0/2915595937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80f6530 0x7f98b80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:28.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.889+0000 7f98bd244700 1 -- 172.21.15.8:0/2915595937 >> 172.21.15.8:0/2915595937 conn(0x7f98b80f1c90 msgr2=0x7f98b80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:28.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.889+0000 7f98bd244700 1 -- 172.21.15.8:0/2915595937 shutdown_connections 2023-10-18T21:02:28.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.889+0000 7f98bd244700 1 -- 172.21.15.8:0/2915595937 wait complete. 2023-10-18T21:02:28.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.890+0000 7f98bd244700 1 Processor -- start 2023-10-18T21:02:28.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.890+0000 7f98bd244700 1 -- start start 2023-10-18T21:02:28.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98bd244700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b80f6530 0x7f98b806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:28.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98bd244700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80f77d0 0x7f98b8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:28.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98bd244700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b806a380 con 0x7f98b80f6530 2023-10-18T21:02:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98bd244700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b806a4c0 con 0x7f98b80f77d0 2023-10-18T21:02:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98b7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b80f6530 0x7f98b806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98b7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b80f6530 0x7f98b806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50328/0 (socket says 172.21.15.8:50328) 2023-10-18T21:02:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98b7fff700 1 -- 172.21.15.8:0/2267219302 learned_addr learned my addr 172.21.15.8:0/2267219302 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:02:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98b77fe700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80f77d0 0x7f98b8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98b7fff700 1 -- 172.21.15.8:0/2267219302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80f77d0 msgr2=0x7f98b8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98b7fff700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80f77d0 0x7f98b8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.891+0000 7f98b7fff700 1 -- 172.21.15.8:0/2267219302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac005040 con 0x7f98b80f6530 2023-10-18T21:02:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.892+0000 7f98b7fff700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b80f6530 0x7f98b806b9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f98a800e7c0 tx=0x7f98a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.892+0000 7f98b4ff9700 1 -- 172.21.15.8:0/2267219302 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a80092e0 con 0x7f98b80f6530 2023-10-18T21:02:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.892+0000 7f98b4ff9700 1 -- 172.21.15.8:0/2267219302 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f98a800f040 con 0x7f98b80f6530 2023-10-18T21:02:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.892+0000 7f98b4ff9700 1 -- 172.21.15.8:0/2267219302 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a80147e0 con 0x7f98b80f6530 2023-10-18T21:02:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.892+0000 7f98bd244700 1 -- 172.21.15.8:0/2267219302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b806a7a0 con 0x7f98b80f6530 2023-10-18T21:02:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.892+0000 7f98bd244700 1 -- 172.21.15.8:0/2267219302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b810ed20 con 0x7f98b80f6530 2023-10-18T21:02:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.893+0000 7f98bd244700 1 -- 172.21.15.8:0/2267219302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b8045ad0 con 0x7f98b80f6530 2023-10-18T21:02:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.894+0000 7f98b4ff9700 1 -- 172.21.15.8:0/2267219302 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f98a801b030 con 0x7f98b80f6530 2023-10-18T21:02:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.895+0000 7f98b4ff9700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f98a0060f70 0x7f98a0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.895+0000 7f98b4ff9700 1 -- 172.21.15.8:0/2267219302 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f98a807c180 con 0x7f98b80f6530 2023-10-18T21:02:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.895+0000 7f98b77fe700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f98a0060f70 0x7f98a0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.895+0000 7f98b77fe700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f98a0060f70 0x7f98a0063430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f98ac0043d0 tx=0x7f98ac00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:28.899+0000 7f98b4ff9700 1 -- 172.21.15.8:0/2267219302 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f98a804c4e0 con 0x7f98b80f6530 2023-10-18T21:02:29.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.095+0000 7f98bd244700 1 -- 172.21.15.8:0/2267219302 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98b80fee30 con 0x7f98a0060f70 2023-10-18T21:02:29.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.096+0000 7f98b4ff9700 1 -- 172.21.15.8:0/2267219302 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f98b80fee30 con 0x7f98a0060f70 2023-10-18T21:02:29.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 -- 172.21.15.8:0/2267219302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f98a0060f70 msgr2=0x7f98a0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f98a0060f70 0x7f98a0063430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f98ac0043d0 tx=0x7f98ac00b040).stop 2023-10-18T21:02:29.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 -- 172.21.15.8:0/2267219302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b80f6530 msgr2=0x7f98b806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b80f6530 0x7f98b806b9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f98a800e7c0 tx=0x7f98a800b040).stop 2023-10-18T21:02:29.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 -- 172.21.15.8:0/2267219302 shutdown_connections 2023-10-18T21:02:29.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f98a0060f70 0x7f98a0063430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b80f6530 0x7f98b806b9a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 --2- 172.21.15.8:0/2267219302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80f77d0 0x7f98b8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 -- 172.21.15.8:0/2267219302 >> 172.21.15.8:0/2267219302 conn(0x7f98b80f1c90 msgr2=0x7f98b80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:29.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 -- 172.21.15.8:0/2267219302 shutdown_connections 2023-10-18T21:02:29.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.098+0000 7f98bd244700 1 -- 172.21.15.8:0/2267219302 wait complete. 2023-10-18T21:02:29.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.234+0000 7f6cc350e700 1 -- 172.21.15.8:0/3284219967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cbc0f77d0 msgr2=0x7f6cbc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.234+0000 7f6cc350e700 1 --2- 172.21.15.8:0/3284219967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cbc0f77d0 0x7f6cbc0f7c30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f6cac004660 tx=0x7f6cac009b30).stop 2023-10-18T21:02:29.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.235+0000 7f6cc350e700 1 -- 172.21.15.8:0/3284219967 shutdown_connections 2023-10-18T21:02:29.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.235+0000 7f6cc350e700 1 --2- 172.21.15.8:0/3284219967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cbc0f77d0 0x7f6cbc0f7c30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.235+0000 7f6cc350e700 1 --2- 172.21.15.8:0/3284219967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cbc0f6530 0x7f6cbc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.235+0000 7f6cc350e700 1 -- 172.21.15.8:0/3284219967 >> 172.21.15.8:0/3284219967 conn(0x7f6cbc0f1c90 msgr2=0x7f6cbc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:29.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.235+0000 7f6cc350e700 1 -- 172.21.15.8:0/3284219967 shutdown_connections 2023-10-18T21:02:29.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.235+0000 7f6cc350e700 1 -- 172.21.15.8:0/3284219967 wait complete. 2023-10-18T21:02:29.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.235+0000 7f6cc350e700 1 Processor -- start 2023-10-18T21:02:29.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.236+0000 7f6cc350e700 1 -- start start 2023-10-18T21:02:29.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.236+0000 7f6cc350e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cbc0f6530 0x7f6cbc108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:29.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.236+0000 7f6cc350e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cbc0f77d0 0x7f6cbc109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:29.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.236+0000 7f6cc350e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1099c0 con 0x7f6cbc0f6530 2023-10-18T21:02:29.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.236+0000 7f6cc350e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc109b00 con 0x7f6cbc0f77d0 2023-10-18T21:02:29.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.236+0000 7f6cc250c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cbc0f6530 0x7f6cbc108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:29.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.236+0000 7f6cc250c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cbc0f6530 0x7f6cbc108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50338/0 (socket says 172.21.15.8:50338) 2023-10-18T21:02:29.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.236+0000 7f6cc250c700 1 -- 172.21.15.8:0/3797488057 learned_addr learned my addr 172.21.15.8:0/3797488057 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:02:29.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.236+0000 7f6cc1d0b700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cbc0f77d0 0x7f6cbc109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:29.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.237+0000 7f6cc250c700 1 -- 172.21.15.8:0/3797488057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cbc0f77d0 msgr2=0x7f6cbc109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.237+0000 7f6cc250c700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cbc0f77d0 0x7f6cbc109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.237+0000 7f6cc250c700 1 -- 172.21.15.8:0/3797488057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac005040 con 0x7f6cbc0f6530 2023-10-18T21:02:29.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.237+0000 7f6cc250c700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cbc0f6530 0x7f6cbc108f20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6cb800e7c0 tx=0x7f6cb800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:29.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.237+0000 7f6cb2ffd700 1 -- 172.21.15.8:0/3797488057 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb80092e0 con 0x7f6cbc0f6530 2023-10-18T21:02:29.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.237+0000 7f6cb2ffd700 1 -- 172.21.15.8:0/3797488057 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6cb800f040 con 0x7f6cbc0f6530 2023-10-18T21:02:29.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.237+0000 7f6cb2ffd700 1 -- 172.21.15.8:0/3797488057 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb8014810 con 0x7f6cbc0f6530 2023-10-18T21:02:29.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.237+0000 7f6cc350e700 1 -- 172.21.15.8:0/3797488057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc10a4a0 con 0x7f6cbc0f6530 2023-10-18T21:02:29.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.237+0000 7f6cc350e700 1 -- 172.21.15.8:0/3797488057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc10a9e0 con 0x7f6cbc0f6530 2023-10-18T21:02:29.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.238+0000 7f6cc350e700 1 -- 172.21.15.8:0/3797488057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc045ad0 con 0x7f6cbc0f6530 2023-10-18T21:02:29.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.239+0000 7f6cb2ffd700 1 -- 172.21.15.8:0/3797488057 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6cb801b030 con 0x7f6cbc0f6530 2023-10-18T21:02:29.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.240+0000 7f6cb2ffd700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ca8060f70 0x7f6ca8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:29.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.241+0000 7f6cb2ffd700 1 -- 172.21.15.8:0/3797488057 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6cb807bff0 con 0x7f6cbc0f6530 2023-10-18T21:02:29.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.241+0000 7f6cc1d0b700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ca8060f70 0x7f6ca8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:29.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.241+0000 7f6cc1d0b700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ca8060f70 0x7f6ca8063430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6cac009720 tx=0x7f6cac016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:29.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.245+0000 7f6cb2ffd700 1 -- 172.21.15.8:0/3797488057 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6cb804fe60 con 0x7f6cbc0f6530 2023-10-18T21:02:29.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.439+0000 7f6cc350e700 1 -- 172.21.15.8:0/3797488057 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cbc0fee00 con 0x7f6ca8060f70 2023-10-18T21:02:29.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.449+0000 7f6cb2ffd700 1 -- 172.21.15.8:0/3797488057 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6cbc0fee00 con 0x7f6ca8060f70 2023-10-18T21:02:29.451 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:02:29.451 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (9m) 9s ago 10m 15.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:02:29.451 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (3m) 9s ago 10m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:02:29.451 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (2m) 2m ago 9m 7566k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:02:29.451 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (9m) 9s ago 10m 25.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:02:29.452 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (6m) 9s ago 6m 7674M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T21:02:29.452 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (6m) 9s ago 6m 919M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T21:02:29.452 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (6m) 2m ago 6m 2598M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:02:29.452 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (6m) 2m ago 6m 373M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:02:29.452 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (4m) 9s ago 11m 451M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:02:29.453 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (3m) 2m ago 9m 394M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:02:29.453 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (3m) 9s ago 12m 91.5M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:02:29.453 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (3m) 2m ago 9m 39.6M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:02:29.453 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (10m) 9s ago 10m 9625k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:02:29.453 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (9m) 2m ago 9m 9903k - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:02:29.453 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (2m) 9s ago 9m 414M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:02:29.454 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (42s) 9s ago 8m 285M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:02:29.454 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (14s) 9s ago 8m 10.7M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:02:29.454 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (8m) 2m ago 8m 856M 4096M 16.2.4 8d91d370c2b8 e40ef6900f94 2023-10-18T21:02:29.454 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (8m) 2m ago 8m 709M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T21:02:29.454 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (7m) 2m ago 7m 745M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T21:02:29.455 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (4m) 9s ago 9m 58.7M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:02:29.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 -- 172.21.15.8:0/3797488057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ca8060f70 msgr2=0x7f6ca8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ca8060f70 0x7f6ca8063430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6cac009720 tx=0x7f6cac016040).stop 2023-10-18T21:02:29.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 -- 172.21.15.8:0/3797488057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cbc0f6530 msgr2=0x7f6cbc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cbc0f6530 0x7f6cbc108f20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6cb800e7c0 tx=0x7f6cb800b040).stop 2023-10-18T21:02:29.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 -- 172.21.15.8:0/3797488057 shutdown_connections 2023-10-18T21:02:29.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ca8060f70 0x7f6ca8063430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cbc0f6530 0x7f6cbc108f20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 --2- 172.21.15.8:0/3797488057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cbc0f77d0 0x7f6cbc109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 -- 172.21.15.8:0/3797488057 >> 172.21.15.8:0/3797488057 conn(0x7f6cbc0f1c90 msgr2=0x7f6cbc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:29.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 -- 172.21.15.8:0/3797488057 shutdown_connections 2023-10-18T21:02:29.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.451+0000 7f6cc350e700 1 -- 172.21.15.8:0/3797488057 wait complete. 2023-10-18T21:02:29.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.586+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/4226853377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f6530 msgr2=0x7f0c380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.586+0000 7f0c3f3f1700 1 --2- 172.21.15.8:0/4226853377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f6530 0x7f0c380f6950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0c34004660 tx=0x7f0c34009b30).stop 2023-10-18T21:02:29.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.586+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/4226853377 shutdown_connections 2023-10-18T21:02:29.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.586+0000 7f0c3f3f1700 1 --2- 172.21.15.8:0/4226853377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f77d0 0x7f0c380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.586+0000 7f0c3f3f1700 1 --2- 172.21.15.8:0/4226853377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f6530 0x7f0c380f6950 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.586+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/4226853377 >> 172.21.15.8:0/4226853377 conn(0x7f0c380f1cd0 msgr2=0x7f0c380f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:29.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.586+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/4226853377 shutdown_connections 2023-10-18T21:02:29.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.586+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/4226853377 wait complete. 2023-10-18T21:02:29.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.587+0000 7f0c3f3f1700 1 Processor -- start 2023-10-18T21:02:29.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.587+0000 7f0c3f3f1700 1 -- start start 2023-10-18T21:02:29.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3f3f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 0x7f0c38106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:29.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3f3f1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:29.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3f3f1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c38107880 con 0x7f0c380f77d0 2023-10-18T21:02:29.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3f3f1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c38108090 con 0x7f0c380f6530 2023-10-18T21:02:29.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3dbee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:29.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3e3ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 0x7f0c38106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:29.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3dbee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50368/0 (socket says 172.21.15.8:50368) 2023-10-18T21:02:29.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3dbee700 1 -- 172.21.15.8:0/1143391770 learned_addr learned my addr 172.21.15.8:0/1143391770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:02:29.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3dbee700 1 -- 172.21.15.8:0/1143391770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 msgr2=0x7f0c38106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3dbee700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 0x7f0c38106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3dbee700 1 -- 172.21.15.8:0/1143391770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34005040 con 0x7f0c380f77d0 2023-10-18T21:02:29.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.588+0000 7f0c3e3ef700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 0x7f0c38106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:02:29.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.589+0000 7f0c3dbee700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f0c28002700 tx=0x7f0c28009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:29.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.589+0000 7f0c2effd700 1 -- 172.21.15.8:0/1143391770 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c28009320 con 0x7f0c380f77d0 2023-10-18T21:02:29.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.589+0000 7f0c2effd700 1 -- 172.21.15.8:0/1143391770 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0c2800f040 con 0x7f0c380f77d0 2023-10-18T21:02:29.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.589+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/1143391770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c38108310 con 0x7f0c380f77d0 2023-10-18T21:02:29.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.589+0000 7f0c2effd700 1 -- 172.21.15.8:0/1143391770 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c280148f0 con 0x7f0c380f77d0 2023-10-18T21:02:29.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.589+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/1143391770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c381088d0 con 0x7f0c380f77d0 2023-10-18T21:02:29.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.590+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/1143391770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c38059100 con 0x7f0c380f77d0 2023-10-18T21:02:29.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.591+0000 7f0c2effd700 1 -- 172.21.15.8:0/1143391770 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0c28009480 con 0x7f0c380f77d0 2023-10-18T21:02:29.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.592+0000 7f0c2effd700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c24060f70 0x7f0c24063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:29.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.592+0000 7f0c2effd700 1 -- 172.21.15.8:0/1143391770 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0c2807c2b0 con 0x7f0c380f77d0 2023-10-18T21:02:29.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.592+0000 7f0c3e3ef700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c24060f70 0x7f0c24063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:29.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.593+0000 7f0c3e3ef700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c24060f70 0x7f0c24063430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0c34005010 tx=0x7f0c34009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:29.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.596+0000 7f0c2effd700 1 -- 172.21.15.8:0/1143391770 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0c2804c7b0 con 0x7f0c380f77d0 2023-10-18T21:02:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:28.178182+0000 mgr.smithi008.flmjzp (mgr.14640) 201 : cluster [DBG] pgmap v145: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s 2023-10-18T21:02:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:28.178182+0000 mgr.smithi008.flmjzp (mgr.14640) 201 : cluster [DBG] pgmap v145: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s 2023-10-18T21:02:29.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.847+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/1143391770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0c380fee50 con 0x7f0c380f77d0 2023-10-18T21:02:29.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.848+0000 7f0c2effd700 1 -- 172.21.15.8:0/1143391770 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7f0c380fee50 con 0x7f0c380f77d0 2023-10-18T21:02:29.850 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:02:29.850 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:02:29.850 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:02:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:02:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:02:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:02:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:02:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:02:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 3, 2023-10-18T21:02:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 3 2023-10-18T21:02:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:02:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:02:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T21:02:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:02:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:02:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 7, 2023-10-18T21:02:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2023-10-18T21:02:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:02:29.853 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:02:29.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/1143391770 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c24060f70 msgr2=0x7f0c24063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c24060f70 0x7f0c24063430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0c34005010 tx=0x7f0c34009b30).stop 2023-10-18T21:02:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/1143391770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 msgr2=0x7f0c38107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f0c28002700 tx=0x7f0c28009e00).stop 2023-10-18T21:02:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/1143391770 shutdown_connections 2023-10-18T21:02:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c24060f70 0x7f0c24063430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 0x7f0c38106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 --2- 172.21.15.8:0/1143391770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/1143391770 >> 172.21.15.8:0/1143391770 conn(0x7f0c380f1cd0 msgr2=0x7f0c380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:29.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/1143391770 shutdown_connections 2023-10-18T21:02:29.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.850+0000 7f0c3f3f1700 1 -- 172.21.15.8:0/1143391770 wait complete. 2023-10-18T21:02:29.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.987+0000 7f4424d03700 1 -- 172.21.15.8:0/3689948239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44200f6530 msgr2=0x7f44200f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.987+0000 7f4424d03700 1 --2- 172.21.15.8:0/3689948239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44200f6530 0x7f44200f6950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4410004660 tx=0x7f4410009b30).stop 2023-10-18T21:02:29.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.987+0000 7f4424d03700 1 -- 172.21.15.8:0/3689948239 shutdown_connections 2023-10-18T21:02:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.987+0000 7f4424d03700 1 --2- 172.21.15.8:0/3689948239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44200f77d0 0x7f44200f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.987+0000 7f4424d03700 1 --2- 172.21.15.8:0/3689948239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44200f6530 0x7f44200f6950 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.987+0000 7f4424d03700 1 -- 172.21.15.8:0/3689948239 >> 172.21.15.8:0/3689948239 conn(0x7f44200f1c90 msgr2=0x7f44200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.987+0000 7f4424d03700 1 -- 172.21.15.8:0/3689948239 shutdown_connections 2023-10-18T21:02:29.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.988+0000 7f4424d03700 1 -- 172.21.15.8:0/3689948239 wait complete. 2023-10-18T21:02:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.988+0000 7f4424d03700 1 Processor -- start 2023-10-18T21:02:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.988+0000 7f4424d03700 1 -- start start 2023-10-18T21:02:29.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.989+0000 7f4424d03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44200f6530 0x7f4420106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:29.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.989+0000 7f4424d03700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44200f77d0 0x7f4420107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:29.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.989+0000 7f4424d03700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4420107910 con 0x7f44200f77d0 2023-10-18T21:02:29.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.989+0000 7f4424d03700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4420108120 con 0x7f44200f6530 2023-10-18T21:02:29.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.989+0000 7f441effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44200f77d0 0x7f4420107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.989+0000 7f441effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44200f77d0 0x7f4420107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50380/0 (socket says 172.21.15.8:50380) 2023-10-18T21:02:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.989+0000 7f441effd700 1 -- 172.21.15.8:0/3490711322 learned_addr learned my addr 172.21.15.8:0/3490711322 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:02:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f441f7fe700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44200f6530 0x7f4420106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f441effd700 1 -- 172.21.15.8:0/3490711322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44200f6530 msgr2=0x7f4420106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f441effd700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44200f6530 0x7f4420106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f441effd700 1 -- 172.21.15.8:0/3490711322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4410005040 con 0x7f44200f77d0 2023-10-18T21:02:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f441f7fe700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44200f6530 0x7f4420106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:02:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f441effd700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44200f77d0 0x7f4420107310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f44140026d0 tx=0x7f4414009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f4407fff700 1 -- 172.21.15.8:0/3490711322 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4414009320 con 0x7f44200f77d0 2023-10-18T21:02:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f4407fff700 1 -- 172.21.15.8:0/3490711322 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f441400f040 con 0x7f44200f77d0 2023-10-18T21:02:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f4424d03700 1 -- 172.21.15.8:0/3490711322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44201083a0 con 0x7f44200f77d0 2023-10-18T21:02:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f4407fff700 1 -- 172.21.15.8:0/3490711322 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44140148a0 con 0x7f44200f77d0 2023-10-18T21:02:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.990+0000 7f4424d03700 1 -- 172.21.15.8:0/3490711322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4420108960 con 0x7f44200f77d0 2023-10-18T21:02:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.991+0000 7f4424d03700 1 -- 172.21.15.8:0/3490711322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4420059100 con 0x7f44200f77d0 2023-10-18T21:02:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.992+0000 7f4407fff700 1 -- 172.21.15.8:0/3490711322 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4414009480 con 0x7f44200f77d0 2023-10-18T21:02:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.993+0000 7f4407fff700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4408060f70 0x7f4408063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:29.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.993+0000 7f4407fff700 1 -- 172.21.15.8:0/3490711322 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f441407c750 con 0x7f44200f77d0 2023-10-18T21:02:29.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.993+0000 7f441f7fe700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4408060f70 0x7f4408063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:29.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.994+0000 7f441f7fe700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4408060f70 0x7f4408063430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f4410009d60 tx=0x7f4410009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:29.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:29.997+0000 7f4407fff700 1 -- 172.21.15.8:0/3490711322 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f441404cb90 con 0x7f44200f77d0 2023-10-18T21:02:30.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.225+0000 7f4424d03700 1 -- 172.21.15.8:0/3490711322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f44200fedc0 con 0x7f44200f77d0 2023-10-18T21:02:30.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.225+0000 7f4407fff700 1 -- 172.21.15.8:0/3490711322 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1794 (secure 0 0 0) 0x7f44140501b0 con 0x7f44200f77d0 2023-10-18T21:02:30.228 INFO:teuthology.orchestra.run.smithi008.stdout:e17 2023-10-18T21:02:30.228 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:02:30.228 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:02:30.228 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:02:30.228 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:02:30.229 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:02:30.229 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:02:30.229 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 17 2023-10-18T21:02:30.229 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T21:02:30.230 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:02:30.230 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:59:22.221117+0000 2023-10-18T21:02:30.230 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:02:30.230 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:02:30.230 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:02:30.231 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:02:30.231 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:02:30.231 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:02:30.231 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:02:30.231 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T21:02:30.231 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:02:30.232 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T21:02:30.232 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T21:02:30.232 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T21:02:30.232 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:02:30.232 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:02:30.233 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T21:02:30.233 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:02:30.233 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:02:30.233 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:02:30.233 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:02:30.234 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:02:30.234 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:02:30.234 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:02:30.234 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:02:30.235 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:02:30.235 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:02:30.235 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:02:30.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.227+0000 7f4424d03700 1 -- 172.21.15.8:0/3490711322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4408060f70 msgr2=0x7f4408063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:30.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.227+0000 7f4424d03700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4408060f70 0x7f4408063430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f4410009d60 tx=0x7f4410009b30).stop 2023-10-18T21:02:30.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.227+0000 7f4424d03700 1 -- 172.21.15.8:0/3490711322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44200f77d0 msgr2=0x7f4420107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:30.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.227+0000 7f4424d03700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44200f77d0 0x7f4420107310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f44140026d0 tx=0x7f4414009de0).stop 2023-10-18T21:02:30.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.228+0000 7f4424d03700 1 -- 172.21.15.8:0/3490711322 shutdown_connections 2023-10-18T21:02:30.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.228+0000 7f4424d03700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4408060f70 0x7f4408063430 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:30.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.228+0000 7f4424d03700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44200f6530 0x7f4420106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:30.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.228+0000 7f4424d03700 1 --2- 172.21.15.8:0/3490711322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44200f77d0 0x7f4420107310 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:30.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.228+0000 7f4424d03700 1 -- 172.21.15.8:0/3490711322 >> 172.21.15.8:0/3490711322 conn(0x7f44200f1c90 msgr2=0x7f44200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:30.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.228+0000 7f4424d03700 1 -- 172.21.15.8:0/3490711322 shutdown_connections 2023-10-18T21:02:30.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.228+0000 7f4424d03700 1 -- 172.21.15.8:0/3490711322 wait complete. 2023-10-18T21:02:30.238 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-18T21:02:30.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.366+0000 7f73b118b700 1 -- 172.21.15.8:0/745455881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73ac0f6530 msgr2=0x7f73ac0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:30.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.366+0000 7f73b118b700 1 --2- 172.21.15.8:0/745455881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73ac0f6530 0x7f73ac0f6950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f739c004660 tx=0x7f739c009b30).stop 2023-10-18T21:02:30.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.366+0000 7f73b118b700 1 -- 172.21.15.8:0/745455881 shutdown_connections 2023-10-18T21:02:30.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.366+0000 7f73b118b700 1 --2- 172.21.15.8:0/745455881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73ac0f77d0 0x7f73ac0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:30.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.366+0000 7f73b118b700 1 --2- 172.21.15.8:0/745455881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73ac0f6530 0x7f73ac0f6950 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:30.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.366+0000 7f73b118b700 1 -- 172.21.15.8:0/745455881 >> 172.21.15.8:0/745455881 conn(0x7f73ac0f1c90 msgr2=0x7f73ac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:30.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.366+0000 7f73b118b700 1 -- 172.21.15.8:0/745455881 shutdown_connections 2023-10-18T21:02:30.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.366+0000 7f73b118b700 1 -- 172.21.15.8:0/745455881 wait complete. 2023-10-18T21:02:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.367+0000 7f73b118b700 1 Processor -- start 2023-10-18T21:02:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.367+0000 7f73b118b700 1 -- start start 2023-10-18T21:02:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.367+0000 7f73b118b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73ac0f6530 0x7f73ac108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.367+0000 7f73b118b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73ac0f77d0 0x7f73ac109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.367+0000 7f73b118b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac1099e0 con 0x7f73ac0f77d0 2023-10-18T21:02:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.367+0000 7f73b118b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac109b20 con 0x7f73ac0f6530 2023-10-18T21:02:30.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.368+0000 7f73ab7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73ac0f77d0 0x7f73ac109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:30.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.368+0000 7f73ab7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73ac0f77d0 0x7f73ac109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50392/0 (socket says 172.21.15.8:50392) 2023-10-18T21:02:30.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.368+0000 7f73ab7fe700 1 -- 172.21.15.8:0/1313305259 learned_addr learned my addr 172.21.15.8:0/1313305259 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:02:30.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.368+0000 7f73abfff700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73ac0f6530 0x7f73ac108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:30.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.368+0000 7f73ab7fe700 1 -- 172.21.15.8:0/1313305259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73ac0f6530 msgr2=0x7f73ac108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:30.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.368+0000 7f73ab7fe700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73ac0f6530 0x7f73ac108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:30.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.368+0000 7f73ab7fe700 1 -- 172.21.15.8:0/1313305259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c005040 con 0x7f73ac0f77d0 2023-10-18T21:02:30.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.368+0000 7f73ab7fe700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73ac0f77d0 0x7f73ac109430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f73a000e7f0 tx=0x7f73a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:30.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.368+0000 7f73a8ff9700 1 -- 172.21.15.8:0/1313305259 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a00092e0 con 0x7f73ac0f77d0 2023-10-18T21:02:30.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.369+0000 7f73b118b700 1 -- 172.21.15.8:0/1313305259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ac10a4c0 con 0x7f73ac0f77d0 2023-10-18T21:02:30.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.369+0000 7f73a8ff9700 1 -- 172.21.15.8:0/1313305259 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f73a000f040 con 0x7f73ac0f77d0 2023-10-18T21:02:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.369+0000 7f73a8ff9700 1 -- 172.21.15.8:0/1313305259 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a0014760 con 0x7f73ac0f77d0 2023-10-18T21:02:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.369+0000 7f73b118b700 1 -- 172.21.15.8:0/1313305259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ac10aa00 con 0x7f73ac0f77d0 2023-10-18T21:02:30.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.370+0000 7f73b118b700 1 -- 172.21.15.8:0/1313305259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ac045ad0 con 0x7f73ac0f77d0 2023-10-18T21:02:30.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.371+0000 7f73a8ff9700 1 -- 172.21.15.8:0/1313305259 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f73a001b030 con 0x7f73ac0f77d0 2023-10-18T21:02:30.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.371+0000 7f73a8ff9700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7394060f70 0x7f7394063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:02:30.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.371+0000 7f73a8ff9700 1 -- 172.21.15.8:0/1313305259 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f73a007bf20 con 0x7f73ac0f77d0 2023-10-18T21:02:30.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.372+0000 7f73abfff700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7394060f70 0x7f7394063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:02:30.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.372+0000 7f73abfff700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7394060f70 0x7f7394063430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f739c005010 tx=0x7f739c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:02:30.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.376+0000 7f73a8ff9700 1 -- 172.21.15.8:0/1313305259 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f73a004fdc0 con 0x7f73ac0f77d0 2023-10-18T21:02:30.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.575+0000 7f73b118b700 1 -- 172.21.15.8:0/1313305259 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f73ac10ac70 con 0x7f7394060f70 2023-10-18T21:02:30.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.576+0000 7f73a8ff9700 1 -- 172.21.15.8:0/1313305259 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f73ac10ac70 con 0x7f7394060f70 2023-10-18T21:02:30.578 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:02:30.578 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:02:30.578 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:02:30.578 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:02:30.579 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:02:30.579 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:02:30.579 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:02:30.579 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:02:30.579 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:02:30.580 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "9/21 daemons upgraded", 2023-10-18T21:02:30.580 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading osd daemons", 2023-10-18T21:02:30.580 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:02:30.580 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:02:30.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 -- 172.21.15.8:0/1313305259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7394060f70 msgr2=0x7f7394063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:30.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7394060f70 0x7f7394063430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f739c005010 tx=0x7f739c016040).stop 2023-10-18T21:02:30.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 -- 172.21.15.8:0/1313305259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73ac0f77d0 msgr2=0x7f73ac109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:02:30.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73ac0f77d0 0x7f73ac109430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f73a000e7f0 tx=0x7f73a000b040).stop 2023-10-18T21:02:30.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 -- 172.21.15.8:0/1313305259 shutdown_connections 2023-10-18T21:02:30.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7394060f70 0x7f7394063430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:30.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73ac0f6530 0x7f73ac108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:30.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 --2- 172.21.15.8:0/1313305259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73ac0f77d0 0x7f73ac109430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:02:30.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 -- 172.21.15.8:0/1313305259 >> 172.21.15.8:0/1313305259 conn(0x7f73ac0f1c90 msgr2=0x7f73ac06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:02:30.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 -- 172.21.15.8:0/1313305259 shutdown_connections 2023-10-18T21:02:30.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:02:30.578+0000 7f73b118b700 1 -- 172.21.15.8:0/1313305259 wait complete. 2023-10-18T21:02:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:28.749679+0000 mgr.smithi008.flmjzp (mgr.14640) 202 : audit [DBG] from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:02:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:29.096411+0000 mgr.smithi008.flmjzp (mgr.14640) 203 : audit [DBG] from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:02:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:29.440601+0000 mgr.smithi008.flmjzp (mgr.14640) 204 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:02:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:29.848580+0000 mon.smithi008 (mon.0) 304 : audit [DBG] from='client.? 172.21.15.8:0/1143391770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:30.226107+0000 mon.smithi008 (mon.0) 305 : audit [DBG] from='client.? 172.21.15.8:0/3490711322' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:02:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:28.749679+0000 mgr.smithi008.flmjzp (mgr.14640) 202 : audit [DBG] from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:02:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:29.096411+0000 mgr.smithi008.flmjzp (mgr.14640) 203 : audit [DBG] from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:02:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:29.440601+0000 mgr.smithi008.flmjzp (mgr.14640) 204 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:02:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:29.848580+0000 mon.smithi008 (mon.0) 304 : audit [DBG] from='client.? 172.21.15.8:0/1143391770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:30.226107+0000 mon.smithi008 (mon.0) 305 : audit [DBG] from='client.? 172.21.15.8:0/3490711322' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:02:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:30.178469+0000 mgr.smithi008.flmjzp (mgr.14640) 205 : cluster [DBG] pgmap v146: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2023-10-18T21:02:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:30.443727+0000 mon.smithi008 (mon.0) 306 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:31.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:30.576545+0000 mgr.smithi008.flmjzp (mgr.14640) 206 : audit [DBG] from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:02:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:30.178469+0000 mgr.smithi008.flmjzp (mgr.14640) 205 : cluster [DBG] pgmap v146: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2023-10-18T21:02:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:30.443727+0000 mon.smithi008 (mon.0) 306 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:30.576545+0000 mgr.smithi008.flmjzp (mgr.14640) 206 : audit [DBG] from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:02:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:32.178923+0000 mgr.smithi008.flmjzp (mgr.14640) 207 : cluster [DBG] pgmap v147: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-10-18T21:02:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:32.178923+0000 mgr.smithi008.flmjzp (mgr.14640) 207 : cluster [DBG] pgmap v147: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-10-18T21:02:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:34.179411+0000 mgr.smithi008.flmjzp (mgr.14640) 208 : cluster [DBG] pgmap v148: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2023-10-18T21:02:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:34.179411+0000 mgr.smithi008.flmjzp (mgr.14640) 208 : cluster [DBG] pgmap v148: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2023-10-18T21:02:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:35.534542+0000 mon.smithi008 (mon.0) 307 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:35.615610+0000 mon.smithi008 (mon.0) 308 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-10-18T21:02:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:35.534542+0000 mon.smithi008 (mon.0) 307 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:35.615610+0000 mon.smithi008 (mon.0) 308 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-10-18T21:02:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:35.615846+0000 mgr.smithi008.flmjzp (mgr.14640) 209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-10-18T21:02:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:02:35.617074+0000 mgr.smithi008.flmjzp (mgr.14640) 210 : cephadm [INF] Upgrade: osd.3 is safe to restart 2023-10-18T21:02:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:36.179888+0000 mgr.smithi008.flmjzp (mgr.14640) 211 : cluster [DBG] pgmap v149: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 2 op/s 2023-10-18T21:02:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:36.782239+0000 mon.smithi008 (mon.0) 309 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:36.783374+0000 mon.smithi008 (mon.0) 310 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-18T21:02:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:36.784264+0000 mon.smithi008 (mon.0) 311 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:02:37.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:35.615846+0000 mgr.smithi008.flmjzp (mgr.14640) 209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-10-18T21:02:37.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:02:35.617074+0000 mgr.smithi008.flmjzp (mgr.14640) 210 : cephadm [INF] Upgrade: osd.3 is safe to restart 2023-10-18T21:02:37.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:36.179888+0000 mgr.smithi008.flmjzp (mgr.14640) 211 : cluster [DBG] pgmap v149: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 2 op/s 2023-10-18T21:02:37.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:36.782239+0000 mon.smithi008 (mon.0) 309 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:37.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:36.783374+0000 mon.smithi008 (mon.0) 310 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-18T21:02:37.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:36.784264+0000 mon.smithi008 (mon.0) 311 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:02:38.659 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:02:36.777367+0000 mgr.smithi008.flmjzp (mgr.14640) 212 : cephadm [INF] Upgrade: Updating osd.3 2023-10-18T21:02:38.660 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:02:36.785592+0000 mgr.smithi008.flmjzp (mgr.14640) 213 : cephadm [INF] Deploying daemon osd.3 on smithi060 2023-10-18T21:02:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:02:36.777367+0000 mgr.smithi008.flmjzp (mgr.14640) 212 : cephadm [INF] Upgrade: Updating osd.3 2023-10-18T21:02:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:02:36.785592+0000 mgr.smithi008.flmjzp (mgr.14640) 213 : cephadm [INF] Deploying daemon osd.3 on smithi060 2023-10-18T21:02:39.487 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:39 smithi060 systemd[1]: Stopping Ceph osd.3 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T21:02:39.504 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.3[114985]: debug 2023-10-18T21:02:39.260+0000 7fe41a205700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-10-18T21:02:39.504 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.3[114985]: debug 2023-10-18T21:02:39.260+0000 7fe41a205700 -1 osd.3 67 *** Got signal Terminated *** 2023-10-18T21:02:39.504 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.3[114985]: debug 2023-10-18T21:02:39.260+0000 7fe41a205700 -1 osd.3 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T21:02:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:38.180519+0000 mgr.smithi008.flmjzp (mgr.14640) 214 : cluster [DBG] pgmap v150: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T21:02:39.943 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:38.180519+0000 mgr.smithi008.flmjzp (mgr.14640) 214 : cluster [DBG] pgmap v150: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T21:02:39.943 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:39 smithi060 bash[131615]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.3 2023-10-18T21:02:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.600151+0000 mon.smithi008 (mon.0) 312 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.600192+0000 mon.smithi008 (mon.0) 313 : cluster [INF] osd.3 failed (root=default,host=smithi060) (connection refused reported by osd.1) 2023-10-18T21:02:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.600347+0000 mon.smithi008 (mon.0) 314 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.600433+0000 mon.smithi008 (mon.0) 315 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.600589+0000 mon.smithi008 (mon.0) 316 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.600661+0000 mon.smithi008 (mon.0) 317 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.600832+0000 mon.smithi008 (mon.0) 318 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-10-18T21:02:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.600893+0000 mon.smithi008 (mon.0) 319 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.601019+0000 mon.smithi008 (mon.0) 320 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.601085+0000 mon.smithi008 (mon.0) 321 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-10-18T21:02:40.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:39.601207+0000 mon.smithi008 (mon.0) 322 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.001249+0000 mon.smithi008 (mon.0) 323 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.001331+0000 mon.smithi008 (mon.0) 324 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.001558+0000 mon.smithi008 (mon.0) 325 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.001653+0000 mon.smithi008 (mon.0) 326 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.001817+0000 mon.smithi008 (mon.0) 327 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.001873+0000 mon.smithi008 (mon.0) 328 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.001998+0000 mon.smithi008 (mon.0) 329 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-10-18T21:02:40.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.002051+0000 mon.smithi008 (mon.0) 330 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.002166+0000 mon.smithi008 (mon.0) 331 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.002246+0000 mon.smithi008 (mon.0) 332 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-10-18T21:02:40.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.051483+0000 mon.smithi008 (mon.0) 333 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.131614+0000 mon.smithi008 (mon.0) 334 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.146251+0000 mon.smithi008 (mon.0) 335 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.169621+0000 mon.smithi008 (mon.0) 336 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.252204+0000 mon.smithi008 (mon.0) 337 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.331933+0000 mon.smithi008 (mon.0) 338 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.346720+0000 mon.smithi008 (mon.0) 339 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.369963+0000 mon.smithi008 (mon.0) 340 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.600151+0000 mon.smithi008 (mon.0) 312 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.600192+0000 mon.smithi008 (mon.0) 313 : cluster [INF] osd.3 failed (root=default,host=smithi060) (connection refused reported by osd.1) 2023-10-18T21:02:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.600347+0000 mon.smithi008 (mon.0) 314 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.600433+0000 mon.smithi008 (mon.0) 315 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.600589+0000 mon.smithi008 (mon.0) 316 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.600661+0000 mon.smithi008 (mon.0) 317 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.600832+0000 mon.smithi008 (mon.0) 318 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-10-18T21:02:40.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.600893+0000 mon.smithi008 (mon.0) 319 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.601019+0000 mon.smithi008 (mon.0) 320 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.601085+0000 mon.smithi008 (mon.0) 321 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-10-18T21:02:40.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:39.601207+0000 mon.smithi008 (mon.0) 322 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.001249+0000 mon.smithi008 (mon.0) 323 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.001331+0000 mon.smithi008 (mon.0) 324 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.001558+0000 mon.smithi008 (mon.0) 325 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.001653+0000 mon.smithi008 (mon.0) 326 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.001817+0000 mon.smithi008 (mon.0) 327 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.001873+0000 mon.smithi008 (mon.0) 328 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.001998+0000 mon.smithi008 (mon.0) 329 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-10-18T21:02:40.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.002051+0000 mon.smithi008 (mon.0) 330 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.002166+0000 mon.smithi008 (mon.0) 331 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.002246+0000 mon.smithi008 (mon.0) 332 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-10-18T21:02:40.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.051483+0000 mon.smithi008 (mon.0) 333 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.131614+0000 mon.smithi008 (mon.0) 334 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.146251+0000 mon.smithi008 (mon.0) 335 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.169621+0000 mon.smithi008 (mon.0) 336 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:40.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.252204+0000 mon.smithi008 (mon.0) 337 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-10-18T21:02:40.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.331933+0000 mon.smithi008 (mon.0) 338 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-10-18T21:02:40.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.346720+0000 mon.smithi008 (mon.0) 339 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-10-18T21:02:40.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.369963+0000 mon.smithi008 (mon.0) 340 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-10-18T21:02:41.661 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.180869+0000 mgr.smithi008.flmjzp (mgr.14640) 215 : cluster [DBG] pgmap v151: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T21:02:41.661 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.550888+0000 mon.smithi008 (mon.0) 341 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T21:02:41.662 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:40.561377+0000 mon.smithi008 (mon.0) 342 : cluster [DBG] osdmap e68: 6 total, 5 up, 6 in 2023-10-18T21:02:41.662 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:41 smithi060 systemd[1]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.3.service: Succeeded. 2023-10-18T21:02:41.662 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:41 smithi060 systemd[1]: Stopped Ceph osd.3 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T21:02:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.180869+0000 mgr.smithi008.flmjzp (mgr.14640) 215 : cluster [DBG] pgmap v151: 65 pgs: 65 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T21:02:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.550888+0000 mon.smithi008 (mon.0) 341 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T21:02:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:40.561377+0000 mon.smithi008 (mon.0) 342 : cluster [DBG] osdmap e68: 6 total, 5 up, 6 in 2023-10-18T21:02:41.987 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:41 smithi060 systemd[1]: Starting Ceph osd.3 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T21:02:42.825 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:41.562856+0000 mon.smithi008 (mon.0) 343 : cluster [DBG] osdmap e69: 6 total, 5 up, 6 in 2023-10-18T21:02:42.825 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:42 smithi060 bash[131906]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-18T21:02:42.825 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:42 smithi060 bash[131906]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-10-18T21:02:42.826 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:42 smithi060 bash[131906]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-10-18T21:02:42.826 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:42 smithi060 bash[131906]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-10-18T21:02:42.826 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:42 smithi060 bash[131906]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-10-18T21:02:42.826 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:42 smithi060 bash[131906]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-18T21:02:42.826 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:42 smithi060 bash[131906]: --> ceph-volume raw activate successful for osd ID: 3 2023-10-18T21:02:42.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:41.562856+0000 mon.smithi008 (mon.0) 343 : cluster [DBG] osdmap e69: 6 total, 5 up, 6 in 2023-10-18T21:02:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:42.181297+0000 mgr.smithi008.flmjzp (mgr.14640) 216 : cluster [DBG] pgmap v154: 65 pgs: 2 active+undersized+degraded, 25 peering, 2 stale+active+clean, 2 active+undersized, 34 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3/369 objects degraded (0.813%) 2023-10-18T21:02:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:42.560625+0000 mon.smithi008 (mon.0) 344 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 12 pgs peering (PG_AVAILABILITY) 2023-10-18T21:02:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:42.560703+0000 mon.smithi008 (mon.0) 345 : cluster [WRN] Health check failed: Degraded data redundancy: 3/369 objects degraded (0.813%), 2 pgs degraded (PG_DEGRADED) 2023-10-18T21:02:43.987 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:43 smithi060 bash[132178]: aa15b18af968fc2b4ac2dbbf3f48029eca5abb5354e3ab7d6814fa94a980246b 2023-10-18T21:02:43.987 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:43 smithi060 systemd[1]: Started Ceph osd.3 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T21:02:43.988 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-3[132192]: debug 2023-10-18T21:02:43.561+0000 7feed4a5c700 1 -- 172.21.15.60:0/2937034621 <== mon.1 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55822f2cc680 con 0x55822f293400 2023-10-18T21:02:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:42.181297+0000 mgr.smithi008.flmjzp (mgr.14640) 216 : cluster [DBG] pgmap v154: 65 pgs: 2 active+undersized+degraded, 25 peering, 2 stale+active+clean, 2 active+undersized, 34 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3/369 objects degraded (0.813%) 2023-10-18T21:02:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:42.560625+0000 mon.smithi008 (mon.0) 344 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 12 pgs peering (PG_AVAILABILITY) 2023-10-18T21:02:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:42.560703+0000 mon.smithi008 (mon.0) 345 : cluster [WRN] Health check failed: Degraded data redundancy: 3/369 objects degraded (0.813%), 2 pgs degraded (PG_DEGRADED) 2023-10-18T21:02:44.487 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-3[132192]: debug 2023-10-18T21:02:44.087+0000 7feedc4d7200 -1 Falling back to public interface 2023-10-18T21:02:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:43.626835+0000 mon.smithi008 (mon.0) 346 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:44.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:43.627849+0000 mon.smithi008 (mon.0) 347 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:02:44.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:43.978793+0000 mon.smithi008 (mon.0) 348 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:44.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:44.181786+0000 mgr.smithi008.flmjzp (mgr.14640) 217 : cluster [DBG] pgmap v155: 65 pgs: 2 active+undersized+degraded, 25 peering, 2 stale+active+clean, 2 active+undersized, 34 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3/369 objects degraded (0.813%) 2023-10-18T21:02:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:43.626835+0000 mon.smithi008 (mon.0) 346 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:43.627849+0000 mon.smithi008 (mon.0) 347 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:02:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:43.978793+0000 mon.smithi008 (mon.0) 348 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:44.181786+0000 mgr.smithi008.flmjzp (mgr.14640) 217 : cluster [DBG] pgmap v155: 65 pgs: 2 active+undersized+degraded, 25 peering, 2 stale+active+clean, 2 active+undersized, 34 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3/369 objects degraded (0.813%) 2023-10-18T21:02:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:45.444973+0000 mon.smithi008 (mon.0) 349 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:45.444973+0000 mon.smithi008 (mon.0) 349 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:46.182353+0000 mgr.smithi008.flmjzp (mgr.14640) 218 : cluster [DBG] pgmap v156: 65 pgs: 14 active+undersized+degraded, 9 peering, 15 active+undersized, 27 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 55/369 objects degraded (14.905%) 2023-10-18T21:02:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:47.007293+0000 mon.smithi008 (mon.0) 350 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:47.008505+0000 mon.smithi008 (mon.0) 351 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:02:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:47.009707+0000 mon.smithi008 (mon.0) 352 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:02:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:47.015152+0000 mon.smithi008 (mon.0) 353 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:47.027219+0000 mon.smithi008 (mon.0) 354 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:02:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:47.030985+0000 mon.smithi008 (mon.0) 355 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:47.032616+0000 mon.smithi008 (mon.0) 356 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:47.034244+0000 mon.smithi008 (mon.0) 357 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:47.035862+0000 mon.smithi008 (mon.0) 358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:02:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:46.182353+0000 mgr.smithi008.flmjzp (mgr.14640) 218 : cluster [DBG] pgmap v156: 65 pgs: 14 active+undersized+degraded, 9 peering, 15 active+undersized, 27 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 55/369 objects degraded (14.905%) 2023-10-18T21:02:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:47.007293+0000 mon.smithi008 (mon.0) 350 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:47.008505+0000 mon.smithi008 (mon.0) 351 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:02:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:47.009707+0000 mon.smithi008 (mon.0) 352 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:02:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:47.015152+0000 mon.smithi008 (mon.0) 353 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:02:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:47.027219+0000 mon.smithi008 (mon.0) 354 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:02:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:47.030985+0000 mon.smithi008 (mon.0) 355 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:47.032616+0000 mon.smithi008 (mon.0) 356 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:47.034244+0000 mon.smithi008 (mon.0) 357 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:02:47.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:47.035862+0000 mon.smithi008 (mon.0) 358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:02:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:02:47.010686+0000 mgr.smithi008.flmjzp (mgr.14640) 219 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:02:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:47.036070+0000 mgr.smithi008.flmjzp (mgr.14640) 220 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:02:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:02:47.036998+0000 mgr.smithi008.flmjzp (mgr.14640) 221 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-10-18T21:02:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:02:47.010686+0000 mgr.smithi008.flmjzp (mgr.14640) 219 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:02:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:47.036070+0000 mgr.smithi008.flmjzp (mgr.14640) 220 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:02:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:02:47.036998+0000 mgr.smithi008.flmjzp (mgr.14640) 221 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-10-18T21:02:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:48.182861+0000 mgr.smithi008.flmjzp (mgr.14640) 222 : cluster [DBG] pgmap v157: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 79/369 objects degraded (21.409%) 2023-10-18T21:02:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:48.451142+0000 mon.smithi008 (mon.0) 359 : cluster [WRN] Health check update: Degraded data redundancy: 79/369 objects degraded (21.409%), 19 pgs degraded (PG_DEGRADED) 2023-10-18T21:02:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:48.451234+0000 mon.smithi008 (mon.0) 360 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2023-10-18T21:02:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:48.182861+0000 mgr.smithi008.flmjzp (mgr.14640) 222 : cluster [DBG] pgmap v157: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 79/369 objects degraded (21.409%) 2023-10-18T21:02:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:48.451142+0000 mon.smithi008 (mon.0) 359 : cluster [WRN] Health check update: Degraded data redundancy: 79/369 objects degraded (21.409%), 19 pgs degraded (PG_DEGRADED) 2023-10-18T21:02:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:48.451234+0000 mon.smithi008 (mon.0) 360 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2023-10-18T21:02:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:50.183503+0000 mgr.smithi008.flmjzp (mgr.14640) 223 : cluster [DBG] pgmap v158: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 79/369 objects degraded (21.409%) 2023-10-18T21:02:51.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:50.183503+0000 mgr.smithi008.flmjzp (mgr.14640) 223 : cluster [DBG] pgmap v158: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 79/369 objects degraded (21.409%) 2023-10-18T21:02:53.237 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-3[132192]: debug 2023-10-18T21:02:52.776+0000 7feedc4d7200 -1 osd.3 67 log_to_monitors {default=true} 2023-10-18T21:02:53.519 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:52.184319+0000 mgr.smithi008.flmjzp (mgr.14640) 224 : cluster [DBG] pgmap v159: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 79/369 objects degraded (21.409%) 2023-10-18T21:02:53.519 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:52.783103+0000 mon.smithi060 (mon.1) 3 : audit [INF] from='osd.3 [v2:172.21.15.60:6800/1165265605,v1:172.21.15.60:6801/1165265605]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T21:02:53.519 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:52.783753+0000 mon.smithi008 (mon.0) 361 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T21:02:53.737 INFO:journalctl@ceph.osd.3.smithi060.stdout:Oct 18 21:02:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-3[132192]: debug 2023-10-18T21:02:53.253+0000 7feecf1d4700 -1 osd.3 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T21:02:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:52.184319+0000 mgr.smithi008.flmjzp (mgr.14640) 224 : cluster [DBG] pgmap v159: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 327 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 79/369 objects degraded (21.409%) 2023-10-18T21:02:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:52.783103+0000 mon.smithi060 (mon.1) 3 : audit [INF] from='osd.3 [v2:172.21.15.60:6800/1165265605,v1:172.21.15.60:6801/1165265605]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T21:02:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:52.783753+0000 mon.smithi008 (mon.0) 361 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T21:02:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:53.242165+0000 mon.smithi008 (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-18T21:02:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:53.242304+0000 mon.smithi008 (mon.0) 363 : cluster [DBG] osdmap e70: 6 total, 5 up, 6 in 2023-10-18T21:02:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:53.243258+0000 mon.smithi060 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.60:6800/1165265605,v1:172.21.15.60:6801/1165265605]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:02:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:53.243822+0000 mon.smithi008 (mon.0) 364 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:02:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:53.242165+0000 mon.smithi008 (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-18T21:02:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:53.242304+0000 mon.smithi008 (mon.0) 363 : cluster [DBG] osdmap e70: 6 total, 5 up, 6 in 2023-10-18T21:02:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:53.243258+0000 mon.smithi060 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.60:6800/1165265605,v1:172.21.15.60:6801/1165265605]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:02:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:53.243822+0000 mon.smithi008 (mon.0) 364 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:02:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:54.184841+0000 mgr.smithi008.flmjzp (mgr.14640) 225 : cluster [DBG] pgmap v161: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 79/369 objects degraded (21.409%) 2023-10-18T21:02:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:54.245198+0000 mon.smithi008 (mon.0) 365 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T21:02:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:54.250816+0000 mon.smithi008 (mon.0) 366 : cluster [INF] osd.3 [v2:172.21.15.60:6800/1165265605,v1:172.21.15.60:6801/1165265605] boot 2023-10-18T21:02:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:54.250887+0000 mon.smithi008 (mon.0) 367 : cluster [DBG] osdmap e71: 6 total, 6 up, 6 in 2023-10-18T21:02:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:02:54.252077+0000 mon.smithi008 (mon.0) 368 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T21:02:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:55.252467+0000 mon.smithi008 (mon.0) 369 : cluster [DBG] osdmap e72: 6 total, 6 up, 6 in 2023-10-18T21:02:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:54.184841+0000 mgr.smithi008.flmjzp (mgr.14640) 225 : cluster [DBG] pgmap v161: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 79/369 objects degraded (21.409%) 2023-10-18T21:02:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:54.245198+0000 mon.smithi008 (mon.0) 365 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T21:02:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:54.250816+0000 mon.smithi008 (mon.0) 366 : cluster [INF] osd.3 [v2:172.21.15.60:6800/1165265605,v1:172.21.15.60:6801/1165265605] boot 2023-10-18T21:02:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:54.250887+0000 mon.smithi008 (mon.0) 367 : cluster [DBG] osdmap e71: 6 total, 6 up, 6 in 2023-10-18T21:02:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:02:54.252077+0000 mon.smithi008 (mon.0) 368 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T21:02:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:55.252467+0000 mon.smithi008 (mon.0) 369 : cluster [DBG] osdmap e72: 6 total, 6 up, 6 in 2023-10-18T21:02:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:56.260037+0000 mon.smithi008 (mon.0) 370 : cluster [WRN] Health check update: Degraded data redundancy: 48/369 objects degraded (13.008%), 12 pgs degraded (PG_DEGRADED) 2023-10-18T21:02:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:56.260037+0000 mon.smithi008 (mon.0) 370 : cluster [WRN] Health check update: Degraded data redundancy: 48/369 objects degraded (13.008%), 12 pgs degraded (PG_DEGRADED) 2023-10-18T21:02:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:56.185616+0000 mgr.smithi008.flmjzp (mgr.14640) 226 : cluster [DBG] pgmap v164: 65 pgs: 7 peering, 12 active+undersized+degraded, 9 active+undersized, 37 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s; 48/369 objects degraded (13.008%) 2023-10-18T21:02:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:56.185616+0000 mgr.smithi008.flmjzp (mgr.14640) 226 : cluster [DBG] pgmap v164: 65 pgs: 7 peering, 12 active+undersized+degraded, 9 active+undersized, 37 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s; 48/369 objects degraded (13.008%) 2023-10-18T21:02:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:02:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:02:58.186075+0000 mgr.smithi008.flmjzp (mgr.14640) 227 : cluster [DBG] pgmap v165: 65 pgs: 7 peering, 9 active+undersized+degraded, 7 active+undersized, 42 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 43/369 objects degraded (11.653%) 2023-10-18T21:02:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:02:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:02:58.186075+0000 mgr.smithi008.flmjzp (mgr.14640) 227 : cluster [DBG] pgmap v165: 65 pgs: 7 peering, 9 active+undersized+degraded, 7 active+undersized, 42 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 43/369 objects degraded (11.653%) 2023-10-18T21:03:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.731+0000 7f35ca605700 1 -- 172.21.15.8:0/2524598645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35c40f6530 msgr2=0x7f35c40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.731+0000 7f35ca605700 1 --2- 172.21.15.8:0/2524598645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35c40f6530 0x7f35c40f6950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f35c0004660 tx=0x7f35c0009b30).stop 2023-10-18T21:03:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.731+0000 7f35ca605700 1 -- 172.21.15.8:0/2524598645 shutdown_connections 2023-10-18T21:03:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.731+0000 7f35ca605700 1 --2- 172.21.15.8:0/2524598645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35c40f77d0 0x7f35c40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.731+0000 7f35ca605700 1 --2- 172.21.15.8:0/2524598645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35c40f6530 0x7f35c40f6950 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.731+0000 7f35ca605700 1 -- 172.21.15.8:0/2524598645 >> 172.21.15.8:0/2524598645 conn(0x7f35c40f1c90 msgr2=0x7f35c40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.731+0000 7f35ca605700 1 -- 172.21.15.8:0/2524598645 shutdown_connections 2023-10-18T21:03:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.731+0000 7f35ca605700 1 -- 172.21.15.8:0/2524598645 wait complete. 2023-10-18T21:03:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.732+0000 7f35ca605700 1 Processor -- start 2023-10-18T21:03:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.732+0000 7f35ca605700 1 -- start start 2023-10-18T21:03:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.733+0000 7f35ca605700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35c40f6530 0x7f35c4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.733+0000 7f35ca605700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35c40f77d0 0x7f35c4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.733+0000 7f35ca605700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c4107880 con 0x7f35c40f6530 2023-10-18T21:03:00.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.733+0000 7f35ca605700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c41080c0 con 0x7f35c40f77d0 2023-10-18T21:03:00.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.733+0000 7f35c9603700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35c40f6530 0x7f35c4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:00.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.733+0000 7f35c9603700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35c40f6530 0x7f35c4106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53498/0 (socket says 172.21.15.8:53498) 2023-10-18T21:03:00.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.733+0000 7f35c9603700 1 -- 172.21.15.8:0/2795064530 learned_addr learned my addr 172.21.15.8:0/2795064530 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:00.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.733+0000 7f35c8e02700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35c40f77d0 0x7f35c4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:00.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.734+0000 7f35c9603700 1 -- 172.21.15.8:0/2795064530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35c40f77d0 msgr2=0x7f35c4107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:00.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.734+0000 7f35c9603700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35c40f77d0 0x7f35c4107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:00.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.734+0000 7f35c9603700 1 -- 172.21.15.8:0/2795064530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0005040 con 0x7f35c40f6530 2023-10-18T21:03:00.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.734+0000 7f35c9603700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35c40f6530 0x7f35c4106d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f35c0007a60 tx=0x7f35c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:00.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.734+0000 7f35b9ffb700 1 -- 172.21.15.8:0/2795064530 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c0018070 con 0x7f35c40f6530 2023-10-18T21:03:00.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.734+0000 7f35b9ffb700 1 -- 172.21.15.8:0/2795064530 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f35c0009630 con 0x7f35c40f6530 2023-10-18T21:03:00.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.734+0000 7f35ca605700 1 -- 172.21.15.8:0/2795064530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c4108340 con 0x7f35c40f6530 2023-10-18T21:03:00.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.734+0000 7f35b9ffb700 1 -- 172.21.15.8:0/2795064530 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c001c4d0 con 0x7f35c40f6530 2023-10-18T21:03:00.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.734+0000 7f35ca605700 1 -- 172.21.15.8:0/2795064530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c4108820 con 0x7f35c40f6530 2023-10-18T21:03:00.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.735+0000 7f35ca605700 1 -- 172.21.15.8:0/2795064530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c4059100 con 0x7f35c40f6530 2023-10-18T21:03:00.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.736+0000 7f35b9ffb700 1 -- 172.21.15.8:0/2795064530 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f35c001d420 con 0x7f35c40f6530 2023-10-18T21:03:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.737+0000 7f35b9ffb700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35b0060f70 0x7f35b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.737+0000 7f35b9ffb700 1 -- 172.21.15.8:0/2795064530 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f35c007de40 con 0x7f35c40f6530 2023-10-18T21:03:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.737+0000 7f35c8e02700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35b0060f70 0x7f35b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.738+0000 7f35c8e02700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35b0060f70 0x7f35b0063430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f35c4106b20 tx=0x7f35b400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:00.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.742+0000 7f35b9ffb700 1 -- 172.21.15.8:0/2795064530 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f35c004e270 con 0x7f35c40f6530 2023-10-18T21:03:00.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.940+0000 7f35ca605700 1 -- 172.21.15.8:0/2795064530 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35c40fed30 con 0x7f35b0060f70 2023-10-18T21:03:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.941+0000 7f35b9ffb700 1 -- 172.21.15.8:0/2795064530 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f35c40fed30 con 0x7f35b0060f70 2023-10-18T21:03:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.943+0000 7f35ca605700 1 -- 172.21.15.8:0/2795064530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35b0060f70 msgr2=0x7f35b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.943+0000 7f35ca605700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35b0060f70 0x7f35b0063430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f35c4106b20 tx=0x7f35b400b040).stop 2023-10-18T21:03:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.943+0000 7f35ca605700 1 -- 172.21.15.8:0/2795064530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35c40f6530 msgr2=0x7f35c4106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.943+0000 7f35ca605700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35c40f6530 0x7f35c4106d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f35c0007a60 tx=0x7f35c0009b30).stop 2023-10-18T21:03:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.943+0000 7f35ca605700 1 -- 172.21.15.8:0/2795064530 shutdown_connections 2023-10-18T21:03:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.943+0000 7f35ca605700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35b0060f70 0x7f35b0063430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.943+0000 7f35ca605700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35c40f6530 0x7f35c4106d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.943+0000 7f35ca605700 1 --2- 172.21.15.8:0/2795064530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35c40f77d0 0x7f35c4107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:00.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.943+0000 7f35ca605700 1 -- 172.21.15.8:0/2795064530 >> 172.21.15.8:0/2795064530 conn(0x7f35c40f1c90 msgr2=0x7f35c40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:00.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.944+0000 7f35ca605700 1 -- 172.21.15.8:0/2795064530 shutdown_connections 2023-10-18T21:03:00.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:00.944+0000 7f35ca605700 1 -- 172.21.15.8:0/2795064530 wait complete. 2023-10-18T21:03:00.960 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:03:01.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.079+0000 7fb6af7fe700 1 -- 172.21.15.8:0/2563214597 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6a4013a50 con 0x7fb6b00f6530 2023-10-18T21:03:01.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.080+0000 7fb6b5bca700 1 -- 172.21.15.8:0/2563214597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b00f6530 msgr2=0x7fb6b00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:01.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.080+0000 7fb6b5bca700 1 --2- 172.21.15.8:0/2563214597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b00f6530 0x7fb6b00f6950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb6a4004660 tx=0x7fb6a4009b30).stop 2023-10-18T21:03:01.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.080+0000 7fb6b5bca700 1 -- 172.21.15.8:0/2563214597 shutdown_connections 2023-10-18T21:03:01.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.080+0000 7fb6b5bca700 1 --2- 172.21.15.8:0/2563214597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6b00f77d0 0x7fb6b00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.080+0000 7fb6b5bca700 1 --2- 172.21.15.8:0/2563214597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b00f6530 0x7fb6b00f6950 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.080+0000 7fb6b5bca700 1 -- 172.21.15.8:0/2563214597 >> 172.21.15.8:0/2563214597 conn(0x7fb6b00f1c90 msgr2=0x7fb6b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:01.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.080+0000 7fb6b5bca700 1 -- 172.21.15.8:0/2563214597 shutdown_connections 2023-10-18T21:03:01.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.080+0000 7fb6b5bca700 1 -- 172.21.15.8:0/2563214597 wait complete. 2023-10-18T21:03:01.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.081+0000 7fb6b5bca700 1 Processor -- start 2023-10-18T21:03:01.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.081+0000 7fb6b5bca700 1 -- start start 2023-10-18T21:03:01.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.081+0000 7fb6b5bca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6b00f6530 0x7fb6b010d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:01.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.081+0000 7fb6b5bca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b00f77d0 0x7fb6b010d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.081+0000 7fb6b5bca700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b010de40 con 0x7fb6b00f77d0 2023-10-18T21:03:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.081+0000 7fb6b5bca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b010df80 con 0x7fb6b00f6530 2023-10-18T21:03:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.081+0000 7fb6affff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b00f77d0 0x7fb6b010d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6b4bc8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6b00f6530 0x7fb6b010d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6affff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b00f77d0 0x7fb6b010d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53512/0 (socket says 172.21.15.8:53512) 2023-10-18T21:03:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6affff700 1 -- 172.21.15.8:0/1809733305 learned_addr learned my addr 172.21.15.8:0/1809733305 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6affff700 1 -- 172.21.15.8:0/1809733305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6b00f6530 msgr2=0x7fb6b010d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6affff700 1 --2- 172.21.15.8:0/1809733305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6b00f6530 0x7fb6b010d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6affff700 1 -- 172.21.15.8:0/1809733305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a4005040 con 0x7fb6b00f77d0 2023-10-18T21:03:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6affff700 1 --2- 172.21.15.8:0/1809733305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b00f77d0 0x7fb6b010d890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb69c00e7f0 tx=0x7fb69c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:01.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6ad7fa700 1 -- 172.21.15.8:0/1809733305 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb69c0092e0 con 0x7fb6b00f77d0 2023-10-18T21:03:01.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6b5bca700 1 -- 172.21.15.8:0/1809733305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b010e920 con 0x7fb6b00f77d0 2023-10-18T21:03:01.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6ad7fa700 1 -- 172.21.15.8:0/1809733305 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb69c00f040 con 0x7fb6b00f77d0 2023-10-18T21:03:01.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.082+0000 7fb6ad7fa700 1 -- 172.21.15.8:0/1809733305 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb69c0147e0 con 0x7fb6b00f77d0 2023-10-18T21:03:01.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.083+0000 7fb6b5bca700 1 -- 172.21.15.8:0/1809733305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b010ee60 con 0x7fb6b00f77d0 2023-10-18T21:03:01.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.084+0000 7fb6b5bca700 1 -- 172.21.15.8:0/1809733305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b0045ad0 con 0x7fb6b00f77d0 2023-10-18T21:03:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.084+0000 7fb6ad7fa700 1 -- 172.21.15.8:0/1809733305 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb69c01b030 con 0x7fb6b00f77d0 2023-10-18T21:03:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.086+0000 7fb6ad7fa700 1 --2- 172.21.15.8:0/1809733305 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6a0060f70 0x7fb6a0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.086+0000 7fb6ad7fa700 1 -- 172.21.15.8:0/1809733305 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb69c07bfb0 con 0x7fb6b00f77d0 2023-10-18T21:03:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.086+0000 7fb6b4bc8700 1 --2- 172.21.15.8:0/1809733305 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6a0060f70 0x7fb6a0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.086+0000 7fb6b4bc8700 1 --2- 172.21.15.8:0/1809733305 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6a0060f70 0x7fb6a0063430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb6a4005010 tx=0x7fb6a4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.090+0000 7fb6ad7fa700 1 -- 172.21.15.8:0/1809733305 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb69c0aaf20 con 0x7fb6b00f77d0 2023-10-18T21:03:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.286+0000 7fb6b5bca700 1 -- 172.21.15.8:0/1809733305 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6b00fc230 con 0x7fb6a0060f70 2023-10-18T21:03:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.287+0000 7fb6ad7fa700 1 -- 172.21.15.8:0/1809733305 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb6b00fc230 con 0x7fb6a0060f70 2023-10-18T21:03:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 -- 172.21.15.8:0/1809733305 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6a0060f70 msgr2=0x7fb6a0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 --2- 172.21.15.8:0/1809733305 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6a0060f70 0x7fb6a0063430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb6a4005010 tx=0x7fb6a4016040).stop 2023-10-18T21:03:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 -- 172.21.15.8:0/1809733305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b00f77d0 msgr2=0x7fb6b010d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 --2- 172.21.15.8:0/1809733305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b00f77d0 0x7fb6b010d890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb69c00e7f0 tx=0x7fb69c00b040).stop 2023-10-18T21:03:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 -- 172.21.15.8:0/1809733305 shutdown_connections 2023-10-18T21:03:01.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 --2- 172.21.15.8:0/1809733305 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6a0060f70 0x7fb6a0063430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 --2- 172.21.15.8:0/1809733305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6b00f6530 0x7fb6b010d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 --2- 172.21.15.8:0/1809733305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b00f77d0 0x7fb6b010d890 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 -- 172.21.15.8:0/1809733305 >> 172.21.15.8:0/1809733305 conn(0x7fb6b00f1c90 msgr2=0x7fb6b00f3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:01.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 -- 172.21.15.8:0/1809733305 shutdown_connections 2023-10-18T21:03:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.289+0000 7fb6b5bca700 1 -- 172.21.15.8:0/1809733305 wait complete. 2023-10-18T21:03:01.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.426+0000 7f3a27fff700 1 -- 172.21.15.8:0/2702914924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a280f77d0 msgr2=0x7f3a280f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:01.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.426+0000 7f3a27fff700 1 --2- 172.21.15.8:0/2702914924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a280f77d0 0x7f3a280f7c30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3a1c004660 tx=0x7f3a1c009b30).stop 2023-10-18T21:03:01.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.427+0000 7f3a27fff700 1 -- 172.21.15.8:0/2702914924 shutdown_connections 2023-10-18T21:03:01.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.427+0000 7f3a27fff700 1 --2- 172.21.15.8:0/2702914924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a280f77d0 0x7f3a280f7c30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.427+0000 7f3a27fff700 1 --2- 172.21.15.8:0/2702914924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a280f6530 0x7f3a280f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.427+0000 7f3a27fff700 1 -- 172.21.15.8:0/2702914924 >> 172.21.15.8:0/2702914924 conn(0x7f3a280f1c90 msgr2=0x7f3a280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:01.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.427+0000 7f3a27fff700 1 -- 172.21.15.8:0/2702914924 shutdown_connections 2023-10-18T21:03:01.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.427+0000 7f3a27fff700 1 -- 172.21.15.8:0/2702914924 wait complete. 2023-10-18T21:03:01.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.428+0000 7f3a27fff700 1 Processor -- start 2023-10-18T21:03:01.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.428+0000 7f3a27fff700 1 -- start start 2023-10-18T21:03:01.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a27fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a280f6530 0x7f3a28106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:01.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a27fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a280f77d0 0x7f3a28107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:01.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a27fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28107880 con 0x7f3a280f6530 2023-10-18T21:03:01.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a27fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a281080c0 con 0x7f3a280f77d0 2023-10-18T21:03:01.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a26ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a280f6530 0x7f3a28106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:01.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a26ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a280f6530 0x7f3a28106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53534/0 (socket says 172.21.15.8:53534) 2023-10-18T21:03:01.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a26ffd700 1 -- 172.21.15.8:0/1461800540 learned_addr learned my addr 172.21.15.8:0/1461800540 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:01.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a267fc700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a280f77d0 0x7f3a28107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:01.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a26ffd700 1 -- 172.21.15.8:0/1461800540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a280f77d0 msgr2=0x7f3a28107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:01.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a26ffd700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a280f77d0 0x7f3a28107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a26ffd700 1 -- 172.21.15.8:0/1461800540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c005040 con 0x7f3a280f6530 2023-10-18T21:03:01.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.429+0000 7f3a26ffd700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a280f6530 0x7f3a28106d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3a18002700 tx=0x7f3a18009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:01.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.430+0000 7f3a0f7fe700 1 -- 172.21.15.8:0/1461800540 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a180079c0 con 0x7f3a280f6530 2023-10-18T21:03:01.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.430+0000 7f3a27fff700 1 -- 172.21.15.8:0/1461800540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a281083a0 con 0x7f3a280f6530 2023-10-18T21:03:01.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.430+0000 7f3a0f7fe700 1 -- 172.21.15.8:0/1461800540 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3a1800f040 con 0x7f3a280f6530 2023-10-18T21:03:01.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.430+0000 7f3a0f7fe700 1 -- 172.21.15.8:0/1461800540 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a180148d0 con 0x7f3a280f6530 2023-10-18T21:03:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.430+0000 7f3a27fff700 1 -- 172.21.15.8:0/1461800540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a281088e0 con 0x7f3a280f6530 2023-10-18T21:03:01.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.431+0000 7f3a27fff700 1 -- 172.21.15.8:0/1461800540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a28059100 con 0x7f3a280f6530 2023-10-18T21:03:01.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.432+0000 7f3a0f7fe700 1 -- 172.21.15.8:0/1461800540 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3a1801b060 con 0x7f3a280f6530 2023-10-18T21:03:01.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.433+0000 7f3a0f7fe700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a10060f70 0x7f3a10063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:01.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.433+0000 7f3a0f7fe700 1 -- 172.21.15.8:0/1461800540 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f3a1807bfc0 con 0x7f3a280f6530 2023-10-18T21:03:01.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.433+0000 7f3a267fc700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a10060f70 0x7f3a10063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:01.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.434+0000 7f3a267fc700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a10060f70 0x7f3a10063430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f3a1c004630 tx=0x7f3a1c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:01.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.437+0000 7f3a0f7fe700 1 -- 172.21.15.8:0/1461800540 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3a1804c380 con 0x7f3a280f6530 2023-10-18T21:03:01.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.630+0000 7f3a27fff700 1 -- 172.21.15.8:0/1461800540 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a280fee30 con 0x7f3a10060f70 2023-10-18T21:03:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.640+0000 7f3a0f7fe700 1 -- 172.21.15.8:0/1461800540 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3a280fee30 con 0x7f3a10060f70 2023-10-18T21:03:01.643 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:03:01.643 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (9m) 41s ago 11m 15.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:03:01.643 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (3m) 41s ago 11m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:03:01.643 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (3m) 14s ago 10m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:03:01.643 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (9m) 41s ago 10m 25.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:03:01.644 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (7m) 41s ago 7m 7674M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T21:03:01.644 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (7m) 41s ago 7m 919M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T21:03:01.644 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (7m) 14s ago 7m 3802M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:03:01.644 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (7m) 14s ago 7m 478M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:03:01.644 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (4m) 41s ago 12m 451M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:03:01.644 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (4m) 14s ago 10m 396M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:03:01.645 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (4m) 41s ago 12m 91.5M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:03:01.645 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (3m) 14s ago 10m 72.6M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:03:01.645 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (10m) 41s ago 10m 9625k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:03:01.645 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (9m) 14s ago 9m 9.83M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:03:01.645 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (3m) 41s ago 9m 414M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:03:01.646 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (75s) 41s ago 9m 285M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:03:01.646 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (46s) 41s ago 9m 10.7M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:03:01.646 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (18s) 14s ago 8m 11.9M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:03:01.646 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (8m) 14s ago 8m 902M 4096M 16.2.4 8d91d370c2b8 f0854d9b4b58 2023-10-18T21:03:01.647 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (8m) 14s ago 8m 1036M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T21:03:01.647 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (5m) 41s ago 10m 58.7M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:03:01.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 -- 172.21.15.8:0/1461800540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a10060f70 msgr2=0x7f3a10063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:01.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a10060f70 0x7f3a10063430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f3a1c004630 tx=0x7f3a1c009b30).stop 2023-10-18T21:03:01.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 -- 172.21.15.8:0/1461800540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a280f6530 msgr2=0x7f3a28106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:01.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a280f6530 0x7f3a28106d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3a18002700 tx=0x7f3a18009d80).stop 2023-10-18T21:03:01.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 -- 172.21.15.8:0/1461800540 shutdown_connections 2023-10-18T21:03:01.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a10060f70 0x7f3a10063430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a280f6530 0x7f3a28106d90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 --2- 172.21.15.8:0/1461800540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a280f77d0 0x7f3a28107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 -- 172.21.15.8:0/1461800540 >> 172.21.15.8:0/1461800540 conn(0x7f3a280f1c90 msgr2=0x7f3a280fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:01.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 -- 172.21.15.8:0/1461800540 shutdown_connections 2023-10-18T21:03:01.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.642+0000 7f3a27fff700 1 -- 172.21.15.8:0/1461800540 wait complete. 2023-10-18T21:03:01.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:00.186658+0000 mgr.smithi008.flmjzp (mgr.14640) 228 : cluster [DBG] pgmap v166: 65 pgs: 7 peering, 58 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 709 KiB/s rd, 4 op/s 2023-10-18T21:03:01.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:00.445280+0000 mon.smithi008 (mon.0) 371 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:01.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:00.865175+0000 mon.smithi008 (mon.0) 372 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/369 objects degraded (11.653%), 9 pgs degraded) 2023-10-18T21:03:01.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:00.865212+0000 mon.smithi008 (mon.0) 373 : cluster [INF] Cluster is now healthy 2023-10-18T21:03:01.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.776+0000 7f46abfff700 1 -- 172.21.15.8:0/204708634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46ac0f6530 msgr2=0x7f46ac0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:01.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.776+0000 7f46abfff700 1 --2- 172.21.15.8:0/204708634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46ac0f6530 0x7f46ac0f6950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f469c004660 tx=0x7f469c009b30).stop 2023-10-18T21:03:01.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.776+0000 7f46abfff700 1 -- 172.21.15.8:0/204708634 shutdown_connections 2023-10-18T21:03:01.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.776+0000 7f46abfff700 1 --2- 172.21.15.8:0/204708634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46ac0f77d0 0x7f46ac0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.776+0000 7f46abfff700 1 --2- 172.21.15.8:0/204708634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46ac0f6530 0x7f46ac0f6950 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.776+0000 7f46abfff700 1 -- 172.21.15.8:0/204708634 >> 172.21.15.8:0/204708634 conn(0x7f46ac0f1c90 msgr2=0x7f46ac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:01.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.776+0000 7f46abfff700 1 -- 172.21.15.8:0/204708634 shutdown_connections 2023-10-18T21:03:01.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.776+0000 7f46abfff700 1 -- 172.21.15.8:0/204708634 wait complete. 2023-10-18T21:03:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.777+0000 7f46abfff700 1 Processor -- start 2023-10-18T21:03:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.777+0000 7f46abfff700 1 -- start start 2023-10-18T21:03:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46abfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46ac0f6530 0x7f46ac108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46ac0f77d0 0x7f46ac1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46abfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac109a70 con 0x7f46ac0f77d0 2023-10-18T21:03:01.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46abfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac109bb0 con 0x7f46ac0f6530 2023-10-18T21:03:01.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46aa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46ac0f77d0 0x7f46ac1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:01.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46aa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46ac0f77d0 0x7f46ac1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53538/0 (socket says 172.21.15.8:53538) 2023-10-18T21:03:01.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46aa7fc700 1 -- 172.21.15.8:0/3375089517 learned_addr learned my addr 172.21.15.8:0/3375089517 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:01.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46aaffd700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46ac0f6530 0x7f46ac108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:01.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46aa7fc700 1 -- 172.21.15.8:0/3375089517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46ac0f6530 msgr2=0x7f46ac108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:01.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46aa7fc700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46ac0f6530 0x7f46ac108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:01.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46aa7fc700 1 -- 172.21.15.8:0/3375089517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c005040 con 0x7f46ac0f77d0 2023-10-18T21:03:01.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.778+0000 7f46aa7fc700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46ac0f77d0 0x7f46ac1094c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f46a00026d0 tx=0x7f46a0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:01.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.779+0000 7f46937fe700 1 -- 172.21.15.8:0/3375089517 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46a0009320 con 0x7f46ac0f77d0 2023-10-18T21:03:01.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.779+0000 7f46937fe700 1 -- 172.21.15.8:0/3375089517 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f46a000f040 con 0x7f46ac0f77d0 2023-10-18T21:03:01.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.779+0000 7f46937fe700 1 -- 172.21.15.8:0/3375089517 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46a00148a0 con 0x7f46ac0f77d0 2023-10-18T21:03:01.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.779+0000 7f46abfff700 1 -- 172.21.15.8:0/3375089517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac10a550 con 0x7f46ac0f77d0 2023-10-18T21:03:01.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.779+0000 7f46abfff700 1 -- 172.21.15.8:0/3375089517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac10ab10 con 0x7f46ac0f77d0 2023-10-18T21:03:01.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.780+0000 7f46abfff700 1 -- 172.21.15.8:0/3375089517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac045ad0 con 0x7f46ac0f77d0 2023-10-18T21:03:01.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.781+0000 7f46937fe700 1 -- 172.21.15.8:0/3375089517 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f46a0009480 con 0x7f46ac0f77d0 2023-10-18T21:03:01.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.782+0000 7f46937fe700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4694060f70 0x7f4694063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:01.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.782+0000 7f46937fe700 1 -- 172.21.15.8:0/3375089517 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f46a007c750 con 0x7f46ac0f77d0 2023-10-18T21:03:01.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.782+0000 7f46aaffd700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4694060f70 0x7f4694063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:01.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.783+0000 7f46aaffd700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4694060f70 0x7f4694063430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f469c004e30 tx=0x7f469c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:01.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:01.786+0000 7f46937fe700 1 -- 172.21.15.8:0/3375089517 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f46a00505c0 con 0x7f46ac0f77d0 2023-10-18T21:03:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:00.186658+0000 mgr.smithi008.flmjzp (mgr.14640) 228 : cluster [DBG] pgmap v166: 65 pgs: 7 peering, 58 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 709 KiB/s rd, 4 op/s 2023-10-18T21:03:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:00.445280+0000 mon.smithi008 (mon.0) 371 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:00.865175+0000 mon.smithi008 (mon.0) 372 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/369 objects degraded (11.653%), 9 pgs degraded) 2023-10-18T21:03:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:00.865212+0000 mon.smithi008 (mon.0) 373 : cluster [INF] Cluster is now healthy 2023-10-18T21:03:02.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.036+0000 7f46abfff700 1 -- 172.21.15.8:0/3375089517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f46ac027a00 con 0x7f46ac0f77d0 2023-10-18T21:03:02.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.036+0000 7f46937fe700 1 -- 172.21.15.8:0/3375089517 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7f46a00501b0 con 0x7f46ac0f77d0 2023-10-18T21:03:02.039 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:03:02.040 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:03:02.040 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:03:02.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:03:02.040 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:03:02.040 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:03:02.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:03:02.041 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:03:02.041 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 4, 2023-10-18T21:03:02.041 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T21:03:02.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:03:02.042 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:03:02.042 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T21:03:02.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:03:02.042 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:03:02.042 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 8, 2023-10-18T21:03:02.043 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-10-18T21:03:02.043 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:03:02.043 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:03:02.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 -- 172.21.15.8:0/3375089517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4694060f70 msgr2=0x7f4694063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:02.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4694060f70 0x7f4694063430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f469c004e30 tx=0x7f469c009b30).stop 2023-10-18T21:03:02.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 -- 172.21.15.8:0/3375089517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46ac0f77d0 msgr2=0x7f46ac1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:02.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46ac0f77d0 0x7f46ac1094c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f46a00026d0 tx=0x7f46a0009de0).stop 2023-10-18T21:03:02.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 -- 172.21.15.8:0/3375089517 shutdown_connections 2023-10-18T21:03:02.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4694060f70 0x7f4694063430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46ac0f6530 0x7f46ac108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 --2- 172.21.15.8:0/3375089517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46ac0f77d0 0x7f46ac1094c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 -- 172.21.15.8:0/3375089517 >> 172.21.15.8:0/3375089517 conn(0x7f46ac0f1c90 msgr2=0x7f46ac06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:02.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 -- 172.21.15.8:0/3375089517 shutdown_connections 2023-10-18T21:03:02.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.038+0000 7f46abfff700 1 -- 172.21.15.8:0/3375089517 wait complete. 2023-10-18T21:03:02.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.175+0000 7f7bbf329700 1 -- 172.21.15.8:0/2012529835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bb80f6530 msgr2=0x7f7bb80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:02.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.175+0000 7f7bbf329700 1 --2- 172.21.15.8:0/2012529835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bb80f6530 0x7f7bb80f6950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f7bb4004660 tx=0x7f7bb4009b30).stop 2023-10-18T21:03:02.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.175+0000 7f7bbf329700 1 -- 172.21.15.8:0/2012529835 shutdown_connections 2023-10-18T21:03:02.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.175+0000 7f7bbf329700 1 --2- 172.21.15.8:0/2012529835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb80f77d0 0x7f7bb80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.175+0000 7f7bbf329700 1 --2- 172.21.15.8:0/2012529835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bb80f6530 0x7f7bb80f6950 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.175+0000 7f7bbf329700 1 -- 172.21.15.8:0/2012529835 >> 172.21.15.8:0/2012529835 conn(0x7f7bb80f1c90 msgr2=0x7f7bb80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:02.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.175+0000 7f7bbf329700 1 -- 172.21.15.8:0/2012529835 shutdown_connections 2023-10-18T21:03:02.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.175+0000 7f7bbf329700 1 -- 172.21.15.8:0/2012529835 wait complete. 2023-10-18T21:03:02.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.176+0000 7f7bbf329700 1 Processor -- start 2023-10-18T21:03:02.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.176+0000 7f7bbf329700 1 -- start start 2023-10-18T21:03:02.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbf329700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb80f6530 0x7f7bb8106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:02.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbf329700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bb80f77d0 0x7f7bb8107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:02.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbf329700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8107870 con 0x7f7bb80f77d0 2023-10-18T21:03:02.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbf329700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb81080b0 con 0x7f7bb80f6530 2023-10-18T21:03:02.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbdb26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bb80f77d0 0x7f7bb8107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:02.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbdb26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bb80f77d0 0x7f7bb8107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53550/0 (socket says 172.21.15.8:53550) 2023-10-18T21:03:02.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbdb26700 1 -- 172.21.15.8:0/3311589745 learned_addr learned my addr 172.21.15.8:0/3311589745 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:02.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbe327700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb80f6530 0x7f7bb8106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:02.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbdb26700 1 -- 172.21.15.8:0/3311589745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb80f6530 msgr2=0x7f7bb8106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:02.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbdb26700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb80f6530 0x7f7bb8106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbdb26700 1 -- 172.21.15.8:0/3311589745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4005040 con 0x7f7bb80f77d0 2023-10-18T21:03:02.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.177+0000 7f7bbe327700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb80f6530 0x7f7bb8106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:03:02.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.178+0000 7f7bbdb26700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bb80f77d0 0x7f7bb8107270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f7ba800e7f0 tx=0x7f7ba800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:02.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.178+0000 7f7baeffd700 1 -- 172.21.15.8:0/3311589745 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ba80092e0 con 0x7f7bb80f77d0 2023-10-18T21:03:02.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.178+0000 7f7bbf329700 1 -- 172.21.15.8:0/3311589745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb8108390 con 0x7f7bb80f77d0 2023-10-18T21:03:02.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.178+0000 7f7baeffd700 1 -- 172.21.15.8:0/3311589745 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7ba800f040 con 0x7f7bb80f77d0 2023-10-18T21:03:02.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.178+0000 7f7baeffd700 1 -- 172.21.15.8:0/3311589745 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ba80147e0 con 0x7f7bb80f77d0 2023-10-18T21:03:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.178+0000 7f7bbf329700 1 -- 172.21.15.8:0/3311589745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb81088d0 con 0x7f7bb80f77d0 2023-10-18T21:03:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.179+0000 7f7bbf329700 1 -- 172.21.15.8:0/3311589745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb8059100 con 0x7f7bb80f77d0 2023-10-18T21:03:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.180+0000 7f7baeffd700 1 -- 172.21.15.8:0/3311589745 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7ba801b030 con 0x7f7bb80f77d0 2023-10-18T21:03:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.181+0000 7f7baeffd700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ba4060f70 0x7f7ba4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.181+0000 7f7baeffd700 1 -- 172.21.15.8:0/3311589745 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7ba807bfe0 con 0x7f7bb80f77d0 2023-10-18T21:03:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.181+0000 7f7bbe327700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ba4060f70 0x7f7ba4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.182+0000 7f7bbe327700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ba4060f70 0x7f7ba4063430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f7bb4009880 tx=0x7f7bb400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.185+0000 7f7baeffd700 1 -- 172.21.15.8:0/3311589745 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7ba80aaf20 con 0x7f7bb80f77d0 2023-10-18T21:03:02.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.413+0000 7f7bbf329700 1 -- 172.21.15.8:0/3311589745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7bb80fee20 con 0x7f7bb80f77d0 2023-10-18T21:03:02.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.414+0000 7f7baeffd700 1 -- 172.21.15.8:0/3311589745 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1794 (secure 0 0 0) 0x7f7ba8019020 con 0x7f7bb80f77d0 2023-10-18T21:03:02.417 INFO:teuthology.orchestra.run.smithi008.stdout:e17 2023-10-18T21:03:02.417 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:03:02.417 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:03:02.417 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:03:02.417 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:03:02.418 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:03:02.418 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:03:02.418 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 17 2023-10-18T21:03:02.418 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T21:03:02.418 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:03:02.419 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T20:59:22.221117+0000 2023-10-18T21:03:02.419 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:03:02.419 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:03:02.419 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:03:02.420 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:03:02.420 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:03:02.420 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:03:02.420 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:03:02.420 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T21:03:02.421 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:03:02.421 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T21:03:02.421 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T21:03:02.421 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T21:03:02.421 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:03:02.422 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:03:02.422 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T21:03:02.422 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:03:02.422 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:03:02.423 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:03:02.423 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:03:02.423 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:03:02.423 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 export targets 1 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:03:02.423 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:03:02.424 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:03:02.424 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:03:02.424 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:03:02.424 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:03:02.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 -- 172.21.15.8:0/3311589745 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ba4060f70 msgr2=0x7f7ba4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:02.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ba4060f70 0x7f7ba4063430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f7bb4009880 tx=0x7f7bb400b040).stop 2023-10-18T21:03:02.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 -- 172.21.15.8:0/3311589745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bb80f77d0 msgr2=0x7f7bb8107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:02.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bb80f77d0 0x7f7bb8107270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f7ba800e7f0 tx=0x7f7ba800b040).stop 2023-10-18T21:03:02.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 -- 172.21.15.8:0/3311589745 shutdown_connections 2023-10-18T21:03:02.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ba4060f70 0x7f7ba4063430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb80f6530 0x7f7bb8106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 --2- 172.21.15.8:0/3311589745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bb80f77d0 0x7f7bb8107270 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 -- 172.21.15.8:0/3311589745 >> 172.21.15.8:0/3311589745 conn(0x7f7bb80f1c90 msgr2=0x7f7bb80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:02.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 -- 172.21.15.8:0/3311589745 shutdown_connections 2023-10-18T21:03:02.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.416+0000 7f7bbf329700 1 -- 172.21.15.8:0/3311589745 wait complete. 2023-10-18T21:03:02.427 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-18T21:03:02.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.556+0000 7f951a204700 1 -- 172.21.15.8:0/154341035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95140f77d0 msgr2=0x7f95140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:02.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.556+0000 7f951a204700 1 --2- 172.21.15.8:0/154341035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95140f77d0 0x7f95140f7c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f9504004660 tx=0x7f9504009b30).stop 2023-10-18T21:03:02.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.556+0000 7f951a204700 1 -- 172.21.15.8:0/154341035 shutdown_connections 2023-10-18T21:03:02.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.556+0000 7f951a204700 1 --2- 172.21.15.8:0/154341035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95140f77d0 0x7f95140f7c30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.556+0000 7f951a204700 1 --2- 172.21.15.8:0/154341035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95140f6530 0x7f95140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.556+0000 7f951a204700 1 -- 172.21.15.8:0/154341035 >> 172.21.15.8:0/154341035 conn(0x7f95140f1c90 msgr2=0x7f95140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:02.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.557+0000 7f951a204700 1 -- 172.21.15.8:0/154341035 shutdown_connections 2023-10-18T21:03:02.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.557+0000 7f951a204700 1 -- 172.21.15.8:0/154341035 wait complete. 2023-10-18T21:03:02.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.557+0000 7f951a204700 1 Processor -- start 2023-10-18T21:03:02.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.558+0000 7f951a204700 1 -- start start 2023-10-18T21:03:02.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.558+0000 7f951a204700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95140f6530 0x7f95140ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.558+0000 7f951a204700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95140f77d0 0x7f95140ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.558+0000 7f951a204700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9514100440 con 0x7f95140f6530 2023-10-18T21:03:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.558+0000 7f951a204700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9514100580 con 0x7f95140f77d0 2023-10-18T21:03:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.558+0000 7f9519202700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95140f6530 0x7f95140ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.558+0000 7f9519202700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95140f6530 0x7f95140ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53568/0 (socket says 172.21.15.8:53568) 2023-10-18T21:03:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.558+0000 7f9519202700 1 -- 172.21.15.8:0/1457372608 learned_addr learned my addr 172.21.15.8:0/1457372608 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.558+0000 7f9518a01700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95140f77d0 0x7f95140ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.559+0000 7f9519202700 1 -- 172.21.15.8:0/1457372608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95140f77d0 msgr2=0x7f95140ffe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.559+0000 7f9519202700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95140f77d0 0x7f95140ffe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.559+0000 7f9519202700 1 -- 172.21.15.8:0/1457372608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9504005040 con 0x7f95140f6530 2023-10-18T21:03:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.559+0000 7f9519202700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95140f6530 0x7f95140ff950 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f9510002700 tx=0x7f9510009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.559+0000 7f9509ffb700 1 -- 172.21.15.8:0/1457372608 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95100079c0 con 0x7f95140f6530 2023-10-18T21:03:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.559+0000 7f9509ffb700 1 -- 172.21.15.8:0/1457372608 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f951000f040 con 0x7f95140f6530 2023-10-18T21:03:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.559+0000 7f9509ffb700 1 -- 172.21.15.8:0/1457372608 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95100148d0 con 0x7f95140f6530 2023-10-18T21:03:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.559+0000 7f951a204700 1 -- 172.21.15.8:0/1457372608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9514100ef0 con 0x7f95140f6530 2023-10-18T21:03:02.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.559+0000 7f951a204700 1 -- 172.21.15.8:0/1457372608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95141014b0 con 0x7f95140f6530 2023-10-18T21:03:02.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.560+0000 7f951a204700 1 -- 172.21.15.8:0/1457372608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9514045ad0 con 0x7f95140f6530 2023-10-18T21:03:02.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.561+0000 7f9509ffb700 1 -- 172.21.15.8:0/1457372608 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f951001b060 con 0x7f95140f6530 2023-10-18T21:03:02.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.562+0000 7f9509ffb700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9500060f70 0x7f9500063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.562+0000 7f9509ffb700 1 -- 172.21.15.8:0/1457372608 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f951007bf60 con 0x7f95140f6530 2023-10-18T21:03:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.562+0000 7f9518a01700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9500060f70 0x7f9500063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.563+0000 7f9518a01700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9500060f70 0x7f9500063430 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9504004630 tx=0x7f9504009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:02.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.566+0000 7f9509ffb700 1 -- 172.21.15.8:0/1457372608 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f951004c3a0 con 0x7f95140f6530 2023-10-18T21:03:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:00.942832+0000 mgr.smithi008.flmjzp (mgr.14640) 229 : audit [DBG] from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:01.288492+0000 mgr.smithi008.flmjzp (mgr.14640) 230 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:02.037918+0000 mon.smithi008 (mon.0) 374 : audit [DBG] from='client.? 172.21.15.8:0/3375089517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:02.052586+0000 mon.smithi008 (mon.0) 375 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:03:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:02.415341+0000 mon.smithi008 (mon.0) 376 : audit [DBG] from='client.? 172.21.15.8:0/3311589745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:03:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:00.942832+0000 mgr.smithi008.flmjzp (mgr.14640) 229 : audit [DBG] from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:01.288492+0000 mgr.smithi008.flmjzp (mgr.14640) 230 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:02.037918+0000 mon.smithi008 (mon.0) 374 : audit [DBG] from='client.? 172.21.15.8:0/3375089517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:02.052586+0000 mon.smithi008 (mon.0) 375 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:03:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:02.415341+0000 mon.smithi008 (mon.0) 376 : audit [DBG] from='client.? 172.21.15.8:0/3311589745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:03:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.764+0000 7f951a204700 1 -- 172.21.15.8:0/1457372608 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9514101780 con 0x7f9500060f70 2023-10-18T21:03:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.766+0000 7f9509ffb700 1 -- 172.21.15.8:0/1457372608 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9514101780 con 0x7f9500060f70 2023-10-18T21:03:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:03:02.771 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:03:02.771 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:03:02.772 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:03:02.772 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:03:02.772 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:03:02.772 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:03:02.772 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:03:02.772 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:03:02.773 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "10/21 daemons upgraded", 2023-10-18T21:03:02.773 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading osd daemons", 2023-10-18T21:03:02.773 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:03:02.773 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:03:02.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 -- 172.21.15.8:0/1457372608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9500060f70 msgr2=0x7f9500063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:02.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9500060f70 0x7f9500063430 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9504004630 tx=0x7f9504009b30).stop 2023-10-18T21:03:02.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 -- 172.21.15.8:0/1457372608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95140f6530 msgr2=0x7f95140ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:02.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95140f6530 0x7f95140ff950 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f9510002700 tx=0x7f9510009d80).stop 2023-10-18T21:03:02.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 -- 172.21.15.8:0/1457372608 shutdown_connections 2023-10-18T21:03:02.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9500060f70 0x7f9500063430 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95140f6530 0x7f95140ff950 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 --2- 172.21.15.8:0/1457372608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95140f77d0 0x7f95140ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:02.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 -- 172.21.15.8:0/1457372608 >> 172.21.15.8:0/1457372608 conn(0x7f95140f1c90 msgr2=0x7f951406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:02.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 -- 172.21.15.8:0/1457372608 shutdown_connections 2023-10-18T21:03:02.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:02.768+0000 7f951a204700 1 -- 172.21.15.8:0/1457372608 wait complete. 2023-10-18T21:03:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:01.632882+0000 mgr.smithi008.flmjzp (mgr.14640) 231 : audit [DBG] from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:02.052784+0000 mgr.smithi008.flmjzp (mgr.14640) 232 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:03:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:02.053807+0000 mgr.smithi008.flmjzp (mgr.14640) 233 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2023-10-18T21:03:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:02.187095+0000 mgr.smithi008.flmjzp (mgr.14640) 234 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 616 KiB/s rd, 5 op/s 2023-10-18T21:03:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:01.632882+0000 mgr.smithi008.flmjzp (mgr.14640) 231 : audit [DBG] from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:02.052784+0000 mgr.smithi008.flmjzp (mgr.14640) 232 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:03:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:02.053807+0000 mgr.smithi008.flmjzp (mgr.14640) 233 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2023-10-18T21:03:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:02.187095+0000 mgr.smithi008.flmjzp (mgr.14640) 234 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 616 KiB/s rd, 5 op/s 2023-10-18T21:03:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:02.767054+0000 mgr.smithi008.flmjzp (mgr.14640) 235 : audit [DBG] from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:02.767054+0000 mgr.smithi008.flmjzp (mgr.14640) 235 : audit [DBG] from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:04.187501+0000 mgr.smithi008.flmjzp (mgr.14640) 236 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 496 KiB/s rd, 5 op/s 2023-10-18T21:03:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:04.187501+0000 mgr.smithi008.flmjzp (mgr.14640) 236 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 496 KiB/s rd, 5 op/s 2023-10-18T21:03:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:06.188088+0000 mgr.smithi008.flmjzp (mgr.14640) 237 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 451 KiB/s rd, 5 op/s 2023-10-18T21:03:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:06.188088+0000 mgr.smithi008.flmjzp (mgr.14640) 237 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 451 KiB/s rd, 5 op/s 2023-10-18T21:03:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:08.188694+0000 mgr.smithi008.flmjzp (mgr.14640) 238 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 411 KiB/s rd, 4 op/s 2023-10-18T21:03:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:08.188694+0000 mgr.smithi008.flmjzp (mgr.14640) 238 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 411 KiB/s rd, 4 op/s 2023-10-18T21:03:11.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:10.189192+0000 mgr.smithi008.flmjzp (mgr.14640) 239 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 411 KiB/s rd, 5 op/s 2023-10-18T21:03:11.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:10.475068+0000 mon.smithi008 (mon.0) 377 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T21:03:11.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:10.552170+0000 mon.smithi008 (mon.0) 378 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:10.189192+0000 mgr.smithi008.flmjzp (mgr.14640) 239 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 411 KiB/s rd, 5 op/s 2023-10-18T21:03:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:10.475068+0000 mon.smithi008 (mon.0) 377 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T21:03:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:10.552170+0000 mon.smithi008 (mon.0) 378 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:12.189847+0000 mgr.smithi008.flmjzp (mgr.14640) 240 : cluster [DBG] pgmap v172: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T21:03:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:12.189847+0000 mgr.smithi008.flmjzp (mgr.14640) 240 : cluster [DBG] pgmap v172: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T21:03:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:14.190274+0000 mgr.smithi008.flmjzp (mgr.14640) 241 : cluster [DBG] pgmap v173: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T21:03:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:15.445844+0000 mon.smithi008 (mon.0) 379 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:14.190274+0000 mgr.smithi008.flmjzp (mgr.14640) 241 : cluster [DBG] pgmap v173: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T21:03:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:15.445844+0000 mon.smithi008 (mon.0) 379 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:17.817 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:16.190811+0000 mgr.smithi008.flmjzp (mgr.14640) 242 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T21:03:17.817 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:17.069580+0000 mon.smithi008 (mon.0) 380 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:03:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:16.190811+0000 mgr.smithi008.flmjzp (mgr.14640) 242 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-10-18T21:03:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:17.069580+0000 mon.smithi008 (mon.0) 380 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:03:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:17.069819+0000 mgr.smithi008.flmjzp (mgr.14640) 243 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:03:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:17.071093+0000 mgr.smithi008.flmjzp (mgr.14640) 244 : cephadm [INF] Upgrade: osd.4 is safe to restart 2023-10-18T21:03:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:17.492255+0000 mon.smithi008 (mon.0) 381 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T21:03:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:18.179102+0000 mon.smithi008 (mon.0) 382 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:18.180193+0000 mon.smithi008 (mon.0) 383 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-18T21:03:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:18.181126+0000 mon.smithi008 (mon.0) 384 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:18.753 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:17.069819+0000 mgr.smithi008.flmjzp (mgr.14640) 243 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-10-18T21:03:18.754 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:17.071093+0000 mgr.smithi008.flmjzp (mgr.14640) 244 : cephadm [INF] Upgrade: osd.4 is safe to restart 2023-10-18T21:03:18.754 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:17.492255+0000 mon.smithi008 (mon.0) 381 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby-replay 2023-10-18T21:03:18.754 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:18.179102+0000 mon.smithi008 (mon.0) 382 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:18.754 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:18.180193+0000 mon.smithi008 (mon.0) 383 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-18T21:03:18.754 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:18.181126+0000 mon.smithi008 (mon.0) 384 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:18.173517+0000 mgr.smithi008.flmjzp (mgr.14640) 245 : cephadm [INF] Upgrade: Updating osd.4 2023-10-18T21:03:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:18.182511+0000 mgr.smithi008.flmjzp (mgr.14640) 246 : cephadm [INF] Deploying daemon osd.4 on smithi060 2023-10-18T21:03:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:18.191498+0000 mgr.smithi008.flmjzp (mgr.14640) 247 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T21:03:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:18.173517+0000 mgr.smithi008.flmjzp (mgr.14640) 245 : cephadm [INF] Upgrade: Updating osd.4 2023-10-18T21:03:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:18.182511+0000 mgr.smithi008.flmjzp (mgr.14640) 246 : cephadm [INF] Deploying daemon osd.4 on smithi060 2023-10-18T21:03:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:18.191498+0000 mgr.smithi008.flmjzp (mgr.14640) 247 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T21:03:20.976 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:20.191954+0000 mgr.smithi008.flmjzp (mgr.14640) 248 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T21:03:20.977 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:20 smithi060 systemd[1]: Stopping Ceph osd.4 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T21:03:20.977 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.4[118604]: debug 2023-10-18T21:03:20.755+0000 7f12a8f71700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-10-18T21:03:20.977 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.4[118604]: debug 2023-10-18T21:03:20.755+0000 7f12a8f71700 -1 osd.4 72 *** Got signal Terminated *** 2023-10-18T21:03:20.977 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.4[118604]: debug 2023-10-18T21:03:20.755+0000 7f12a8f71700 -1 osd.4 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T21:03:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:20.191954+0000 mgr.smithi008.flmjzp (mgr.14640) 248 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-10-18T21:03:21.237 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:21 smithi060 bash[133891]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.4 2023-10-18T21:03:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.085328+0000 mon.smithi008 (mon.0) 385 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-10-18T21:03:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.085360+0000 mon.smithi008 (mon.0) 386 : cluster [INF] osd.4 failed (root=default,host=smithi060) (connection refused reported by osd.0) 2023-10-18T21:03:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.085596+0000 mon.smithi008 (mon.0) 387 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-10-18T21:03:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.085690+0000 mon.smithi008 (mon.0) 388 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-10-18T21:03:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.085872+0000 mon.smithi008 (mon.0) 389 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-10-18T21:03:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.085988+0000 mon.smithi008 (mon.0) 390 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-10-18T21:03:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.086127+0000 mon.smithi008 (mon.0) 391 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-10-18T21:03:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.086196+0000 mon.smithi008 (mon.0) 392 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-10-18T21:03:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.086322+0000 mon.smithi008 (mon.0) 393 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-10-18T21:03:22.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.086439+0000 mon.smithi008 (mon.0) 394 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-10-18T21:03:22.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.086604+0000 mon.smithi008 (mon.0) 395 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-10-18T21:03:22.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.485997+0000 mon.smithi008 (mon.0) 396 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-10-18T21:03:22.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.486062+0000 mon.smithi008 (mon.0) 397 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-10-18T21:03:22.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.486212+0000 mon.smithi008 (mon.0) 398 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-10-18T21:03:22.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.486367+0000 mon.smithi008 (mon.0) 399 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-10-18T21:03:22.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.486551+0000 mon.smithi008 (mon.0) 400 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-10-18T21:03:22.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.486647+0000 mon.smithi008 (mon.0) 401 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-10-18T21:03:22.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.486866+0000 mon.smithi008 (mon.0) 402 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-10-18T21:03:22.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.487030+0000 mon.smithi008 (mon.0) 403 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-10-18T21:03:22.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.487146+0000 mon.smithi008 (mon.0) 404 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-10-18T21:03:22.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.487290+0000 mon.smithi008 (mon.0) 405 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-10-18T21:03:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.085328+0000 mon.smithi008 (mon.0) 385 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-10-18T21:03:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.085360+0000 mon.smithi008 (mon.0) 386 : cluster [INF] osd.4 failed (root=default,host=smithi060) (connection refused reported by osd.0) 2023-10-18T21:03:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.085596+0000 mon.smithi008 (mon.0) 387 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-10-18T21:03:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.085690+0000 mon.smithi008 (mon.0) 388 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-10-18T21:03:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.085872+0000 mon.smithi008 (mon.0) 389 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-10-18T21:03:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.085988+0000 mon.smithi008 (mon.0) 390 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-10-18T21:03:22.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.086127+0000 mon.smithi008 (mon.0) 391 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-10-18T21:03:22.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.086196+0000 mon.smithi008 (mon.0) 392 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-10-18T21:03:22.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.086322+0000 mon.smithi008 (mon.0) 393 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-10-18T21:03:22.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.086439+0000 mon.smithi008 (mon.0) 394 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-10-18T21:03:22.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.086604+0000 mon.smithi008 (mon.0) 395 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-10-18T21:03:22.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.485997+0000 mon.smithi008 (mon.0) 396 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-10-18T21:03:22.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.486062+0000 mon.smithi008 (mon.0) 397 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-10-18T21:03:22.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.486212+0000 mon.smithi008 (mon.0) 398 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-10-18T21:03:22.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.486367+0000 mon.smithi008 (mon.0) 399 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-10-18T21:03:22.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.486551+0000 mon.smithi008 (mon.0) 400 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-10-18T21:03:22.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.486647+0000 mon.smithi008 (mon.0) 401 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-10-18T21:03:22.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.486866+0000 mon.smithi008 (mon.0) 402 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-10-18T21:03:22.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.487030+0000 mon.smithi008 (mon.0) 403 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-10-18T21:03:22.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.487146+0000 mon.smithi008 (mon.0) 404 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-10-18T21:03:22.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.487290+0000 mon.smithi008 (mon.0) 405 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-10-18T21:03:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.876880+0000 mon.smithi008 (mon.0) 406 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T21:03:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:21.885545+0000 mon.smithi008 (mon.0) 407 : cluster [DBG] osdmap e73: 6 total, 5 up, 6 in 2023-10-18T21:03:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:22.192536+0000 mgr.smithi008.flmjzp (mgr.14640) 249 : cluster [DBG] pgmap v178: 65 pgs: 2 peering, 5 stale+active+clean, 58 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-10-18T21:03:22.988 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:22 smithi060 systemd[1]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.4.service: Succeeded. 2023-10-18T21:03:22.988 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:22 smithi060 systemd[1]: Stopped Ceph osd.4 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T21:03:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.876880+0000 mon.smithi008 (mon.0) 406 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T21:03:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:21.885545+0000 mon.smithi008 (mon.0) 407 : cluster [DBG] osdmap e73: 6 total, 5 up, 6 in 2023-10-18T21:03:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:22.192536+0000 mgr.smithi008.flmjzp (mgr.14640) 249 : cluster [DBG] pgmap v178: 65 pgs: 2 peering, 5 stale+active+clean, 58 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-10-18T21:03:23.360 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:23 smithi060 systemd[1]: Starting Ceph osd.4 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T21:03:24.148 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:22.883520+0000 mon.smithi008 (mon.0) 408 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-18T21:03:24.149 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:22.890138+0000 mon.smithi008 (mon.0) 409 : cluster [DBG] osdmap e74: 6 total, 5 up, 6 in 2023-10-18T21:03:24.149 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:24 smithi060 bash[134184]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-18T21:03:24.149 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:24 smithi060 bash[134184]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-10-18T21:03:24.149 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:24 smithi060 bash[134184]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-10-18T21:03:24.150 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:24 smithi060 bash[134184]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-10-18T21:03:24.150 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:24 smithi060 bash[134184]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-10-18T21:03:24.150 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:24 smithi060 bash[134184]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-18T21:03:24.150 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:24 smithi060 bash[134184]: --> ceph-volume raw activate successful for osd ID: 4 2023-10-18T21:03:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:22.883520+0000 mon.smithi008 (mon.0) 408 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-18T21:03:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:22.890138+0000 mon.smithi008 (mon.0) 409 : cluster [DBG] osdmap e74: 6 total, 5 up, 6 in 2023-10-18T21:03:25.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:24.193047+0000 mgr.smithi008.flmjzp (mgr.14640) 250 : cluster [DBG] pgmap v180: 65 pgs: 6 active+undersized+degraded, 2 peering, 4 stale+active+clean, 5 active+undersized, 48 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 27/369 objects degraded (7.317%) 2023-10-18T21:03:25.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:24.193047+0000 mgr.smithi008.flmjzp (mgr.14640) 250 : cluster [DBG] pgmap v180: 65 pgs: 6 active+undersized+degraded, 2 peering, 4 stale+active+clean, 5 active+undersized, 48 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 27/369 objects degraded (7.317%) 2023-10-18T21:03:25.237 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-4[134446]: debug 2023-10-18T21:03:24.896+0000 7f0ba57e6700 1 -- 172.21.15.60:0/4198997355 <== mon.1 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5574af5d6680 con 0x5574af59d000 2023-10-18T21:03:25.238 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:24 smithi060 bash[134431]: b2fe70862dcbe64f375cf94e6f2ca634c8deed2a5613936d115249df4f3a12a5 2023-10-18T21:03:25.238 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:24 smithi060 systemd[1]: Started Ceph osd.4 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T21:03:25.737 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-4[134446]: debug 2023-10-18T21:03:25.430+0000 7f0bad261200 -1 Falling back to public interface 2023-10-18T21:03:26.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:24.883556+0000 mon.smithi008 (mon.0) 410 : cluster [WRN] Health check failed: Degraded data redundancy: 27/369 objects degraded (7.317%), 6 pgs degraded (PG_DEGRADED) 2023-10-18T21:03:26.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:25.004596+0000 mon.smithi008 (mon.0) 411 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:26.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:25.005619+0000 mon.smithi008 (mon.0) 412 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:26.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:24.883556+0000 mon.smithi008 (mon.0) 410 : cluster [WRN] Health check failed: Degraded data redundancy: 27/369 objects degraded (7.317%), 6 pgs degraded (PG_DEGRADED) 2023-10-18T21:03:26.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:25.004596+0000 mon.smithi008 (mon.0) 411 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:26.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:25.005619+0000 mon.smithi008 (mon.0) 412 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:27.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:26.193813+0000 mgr.smithi008.flmjzp (mgr.14640) 251 : cluster [DBG] pgmap v181: 65 pgs: 16 active+undersized+degraded, 2 peering, 16 active+undersized, 31 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 62/369 objects degraded (16.802%) 2023-10-18T21:03:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:26.193813+0000 mgr.smithi008.flmjzp (mgr.14640) 251 : cluster [DBG] pgmap v181: 65 pgs: 16 active+undersized+degraded, 2 peering, 16 active+undersized, 31 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 62/369 objects degraded (16.802%) 2023-10-18T21:03:29.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:27.827746+0000 mon.smithi008 (mon.0) 413 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:29.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:28.194469+0000 mgr.smithi008.flmjzp (mgr.14640) 252 : cluster [DBG] pgmap v182: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 62/369 objects degraded (16.802%) 2023-10-18T21:03:29.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:28.392319+0000 mon.smithi008 (mon.0) 414 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:29.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:28.393514+0000 mon.smithi008 (mon.0) 415 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:03:29.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:28.394444+0000 mgr.smithi008.flmjzp (mgr.14640) 253 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:03:29.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:28.399531+0000 mon.smithi008 (mon.0) 416 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:29.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:28.406129+0000 mon.smithi008 (mon.0) 417 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:29.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:28.409174+0000 mon.smithi008 (mon.0) 418 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:29.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:28.410838+0000 mon.smithi008 (mon.0) 419 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:29.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:28.412482+0000 mon.smithi008 (mon.0) 420 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:29.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:28.414136+0000 mon.smithi008 (mon.0) 421 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-10-18T21:03:29.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:28.414322+0000 mgr.smithi008.flmjzp (mgr.14640) 254 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-10-18T21:03:29.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:28.415220+0000 mgr.smithi008.flmjzp (mgr.14640) 255 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-10-18T21:03:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:27.827746+0000 mon.smithi008 (mon.0) 413 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:28.194469+0000 mgr.smithi008.flmjzp (mgr.14640) 252 : cluster [DBG] pgmap v182: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 62/369 objects degraded (16.802%) 2023-10-18T21:03:29.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:28.392319+0000 mon.smithi008 (mon.0) 414 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:29.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:28.393514+0000 mon.smithi008 (mon.0) 415 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:03:29.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:28.394444+0000 mgr.smithi008.flmjzp (mgr.14640) 253 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:03:29.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:28.399531+0000 mon.smithi008 (mon.0) 416 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:29.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:28.406129+0000 mon.smithi008 (mon.0) 417 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:29.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:28.409174+0000 mon.smithi008 (mon.0) 418 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:29.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:28.410838+0000 mon.smithi008 (mon.0) 419 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:29.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:28.412482+0000 mon.smithi008 (mon.0) 420 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:29.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:28.414136+0000 mon.smithi008 (mon.0) 421 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-10-18T21:03:29.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:28.414322+0000 mgr.smithi008.flmjzp (mgr.14640) 254 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-10-18T21:03:29.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:28.415220+0000 mgr.smithi008.flmjzp (mgr.14640) 255 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-10-18T21:03:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:28.825142+0000 mon.smithi008 (mon.0) 422 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-10-18T21:03:30.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:28.825142+0000 mon.smithi008 (mon.0) 422 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-10-18T21:03:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:30.195170+0000 mgr.smithi008.flmjzp (mgr.14640) 256 : cluster [DBG] pgmap v183: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 62/369 objects degraded (16.802%) 2023-10-18T21:03:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:30.446272+0000 mon.smithi008 (mon.0) 423 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:30.195170+0000 mgr.smithi008.flmjzp (mgr.14640) 256 : cluster [DBG] pgmap v183: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 62/369 objects degraded (16.802%) 2023-10-18T21:03:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:30.446272+0000 mon.smithi008 (mon.0) 423 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.921+0000 7f2f63174700 1 -- 172.21.15.8:0/1738672403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5c0f77d0 msgr2=0x7f2f5c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.921+0000 7f2f63174700 1 --2- 172.21.15.8:0/1738672403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5c0f77d0 0x7f2f5c0f7c30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f2f4c004660 tx=0x7f2f4c009b30).stop 2023-10-18T21:03:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.921+0000 7f2f63174700 1 -- 172.21.15.8:0/1738672403 shutdown_connections 2023-10-18T21:03:32.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.921+0000 7f2f63174700 1 --2- 172.21.15.8:0/1738672403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5c0f77d0 0x7f2f5c0f7c30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:32.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.921+0000 7f2f63174700 1 --2- 172.21.15.8:0/1738672403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0f6530 0x7f2f5c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:32.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.921+0000 7f2f63174700 1 -- 172.21.15.8:0/1738672403 >> 172.21.15.8:0/1738672403 conn(0x7f2f5c0f1c90 msgr2=0x7f2f5c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:32.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.922+0000 7f2f63174700 1 -- 172.21.15.8:0/1738672403 shutdown_connections 2023-10-18T21:03:32.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.922+0000 7f2f63174700 1 -- 172.21.15.8:0/1738672403 wait complete. 2023-10-18T21:03:32.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.922+0000 7f2f63174700 1 Processor -- start 2023-10-18T21:03:32.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.923+0000 7f2f63174700 1 -- start start 2023-10-18T21:03:32.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.923+0000 7f2f63174700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5c0f6530 0x7f2f5c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:32.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.923+0000 7f2f63174700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0f77d0 0x7f2f5c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.923+0000 7f2f63174700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c109a20 con 0x7f2f5c0f6530 2023-10-18T21:03:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.923+0000 7f2f63174700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c109b60 con 0x7f2f5c0f77d0 2023-10-18T21:03:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.923+0000 7f2f62172700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5c0f6530 0x7f2f5c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.923+0000 7f2f62172700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5c0f6530 0x7f2f5c108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60648/0 (socket says 172.21.15.8:60648) 2023-10-18T21:03:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.923+0000 7f2f62172700 1 -- 172.21.15.8:0/1035948358 learned_addr learned my addr 172.21.15.8:0/1035948358 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.923+0000 7f2f61971700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0f77d0 0x7f2f5c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.924+0000 7f2f62172700 1 -- 172.21.15.8:0/1035948358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0f77d0 msgr2=0x7f2f5c109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.924+0000 7f2f62172700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0f77d0 0x7f2f5c109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.924+0000 7f2f62172700 1 -- 172.21.15.8:0/1035948358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c005040 con 0x7f2f5c0f6530 2023-10-18T21:03:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.924+0000 7f2f62172700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5c0f6530 0x7f2f5c108f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f2f58002700 tx=0x7f2f58009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.924+0000 7f2f52ffd700 1 -- 172.21.15.8:0/1035948358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f580079c0 con 0x7f2f5c0f6530 2023-10-18T21:03:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.924+0000 7f2f52ffd700 1 -- 172.21.15.8:0/1035948358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2f5800f040 con 0x7f2f5c0f6530 2023-10-18T21:03:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.924+0000 7f2f52ffd700 1 -- 172.21.15.8:0/1035948358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f580148d0 con 0x7f2f5c0f6530 2023-10-18T21:03:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.924+0000 7f2f63174700 1 -- 172.21.15.8:0/1035948358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c10a500 con 0x7f2f5c0f6530 2023-10-18T21:03:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.924+0000 7f2f63174700 1 -- 172.21.15.8:0/1035948358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c10aac0 con 0x7f2f5c0f6530 2023-10-18T21:03:32.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.926+0000 7f2f63174700 1 -- 172.21.15.8:0/1035948358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c045ad0 con 0x7f2f5c0f6530 2023-10-18T21:03:32.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.926+0000 7f2f52ffd700 1 -- 172.21.15.8:0/1035948358 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2f5801b060 con 0x7f2f5c0f6530 2023-10-18T21:03:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.927+0000 7f2f52ffd700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f48060f70 0x7f2f48063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.927+0000 7f2f52ffd700 1 -- 172.21.15.8:0/1035948358 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f2f5807bf60 con 0x7f2f5c0f6530 2023-10-18T21:03:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.928+0000 7f2f61971700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f48060f70 0x7f2f48063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.928+0000 7f2f61971700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f48060f70 0x7f2f48063430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2f4c004630 tx=0x7f2f4c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:32.932+0000 7f2f52ffd700 1 -- 172.21.15.8:0/1035948358 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2f5804fdd0 con 0x7f2f5c0f6530 2023-10-18T21:03:33.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.128+0000 7f2f63174700 1 -- 172.21.15.8:0/1035948358 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f5c10ad90 con 0x7f2f48060f70 2023-10-18T21:03:33.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.129+0000 7f2f52ffd700 1 -- 172.21.15.8:0/1035948358 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2f5c10ad90 con 0x7f2f48060f70 2023-10-18T21:03:33.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 -- 172.21.15.8:0/1035948358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f48060f70 msgr2=0x7f2f48063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f48060f70 0x7f2f48063430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2f4c004630 tx=0x7f2f4c009b30).stop 2023-10-18T21:03:33.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 -- 172.21.15.8:0/1035948358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5c0f6530 msgr2=0x7f2f5c108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5c0f6530 0x7f2f5c108f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f2f58002700 tx=0x7f2f58009d80).stop 2023-10-18T21:03:33.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 -- 172.21.15.8:0/1035948358 shutdown_connections 2023-10-18T21:03:33.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f48060f70 0x7f2f48063430 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f5c0f6530 0x7f2f5c108f80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 --2- 172.21.15.8:0/1035948358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0f77d0 0x7f2f5c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 -- 172.21.15.8:0/1035948358 >> 172.21.15.8:0/1035948358 conn(0x7f2f5c0f1c90 msgr2=0x7f2f5c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:33.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 -- 172.21.15.8:0/1035948358 shutdown_connections 2023-10-18T21:03:33.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.131+0000 7f2f63174700 1 -- 172.21.15.8:0/1035948358 wait complete. 2023-10-18T21:03:33.148 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:03:33.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.267+0000 7f2283012700 1 -- 172.21.15.8:0/1072976842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227c0f6530 msgr2=0x7f227c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.267+0000 7f2283012700 1 --2- 172.21.15.8:0/1072976842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227c0f6530 0x7f227c0f6950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f2278004660 tx=0x7f2278009b30).stop 2023-10-18T21:03:33.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.267+0000 7f2283012700 1 -- 172.21.15.8:0/1072976842 shutdown_connections 2023-10-18T21:03:33.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.267+0000 7f2283012700 1 --2- 172.21.15.8:0/1072976842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f227c0f77d0 0x7f227c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.267+0000 7f2283012700 1 --2- 172.21.15.8:0/1072976842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227c0f6530 0x7f227c0f6950 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.267+0000 7f2283012700 1 -- 172.21.15.8:0/1072976842 >> 172.21.15.8:0/1072976842 conn(0x7f227c0f1c90 msgr2=0x7f227c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:33.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.267+0000 7f2283012700 1 -- 172.21.15.8:0/1072976842 shutdown_connections 2023-10-18T21:03:33.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.267+0000 7f2283012700 1 -- 172.21.15.8:0/1072976842 wait complete. 2023-10-18T21:03:33.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.268+0000 7f2283012700 1 Processor -- start 2023-10-18T21:03:33.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.268+0000 7f2283012700 1 -- start start 2023-10-18T21:03:33.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f2283012700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f227c0f6530 0x7f227c108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:33.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f2283012700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227c0f77d0 0x7f227c109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:33.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f2283012700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c109a00 con 0x7f227c0f77d0 2023-10-18T21:03:33.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f2283012700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c109b40 con 0x7f227c0f6530 2023-10-18T21:03:33.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f228180f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227c0f77d0 0x7f227c109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:33.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f228180f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227c0f77d0 0x7f227c109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60672/0 (socket says 172.21.15.8:60672) 2023-10-18T21:03:33.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f228180f700 1 -- 172.21.15.8:0/2400848084 learned_addr learned my addr 172.21.15.8:0/2400848084 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:33.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f2282010700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f227c0f6530 0x7f227c108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:33.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f228180f700 1 -- 172.21.15.8:0/2400848084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f227c0f6530 msgr2=0x7f227c108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f228180f700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f227c0f6530 0x7f227c108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.269+0000 7f228180f700 1 -- 172.21.15.8:0/2400848084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278005040 con 0x7f227c0f77d0 2023-10-18T21:03:33.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.270+0000 7f228180f700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227c0f77d0 0x7f227c109450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f226c00e7f0 tx=0x7f226c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:33.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.270+0000 7f2272ffd700 1 -- 172.21.15.8:0/2400848084 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f226c0092e0 con 0x7f227c0f77d0 2023-10-18T21:03:33.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.270+0000 7f2272ffd700 1 -- 172.21.15.8:0/2400848084 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f226c00f040 con 0x7f227c0f77d0 2023-10-18T21:03:33.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.270+0000 7f2283012700 1 -- 172.21.15.8:0/2400848084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c10a4e0 con 0x7f227c0f77d0 2023-10-18T21:03:33.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.270+0000 7f2272ffd700 1 -- 172.21.15.8:0/2400848084 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f226c0147e0 con 0x7f227c0f77d0 2023-10-18T21:03:33.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.270+0000 7f2283012700 1 -- 172.21.15.8:0/2400848084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c10aa20 con 0x7f227c0f77d0 2023-10-18T21:03:33.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.271+0000 7f2283012700 1 -- 172.21.15.8:0/2400848084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c045ad0 con 0x7f227c0f77d0 2023-10-18T21:03:33.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.272+0000 7f2272ffd700 1 -- 172.21.15.8:0/2400848084 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f226c01b030 con 0x7f227c0f77d0 2023-10-18T21:03:33.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.273+0000 7f2272ffd700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2268060f70 0x7f2268063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:33.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.273+0000 7f2272ffd700 1 -- 172.21.15.8:0/2400848084 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f226c07bde0 con 0x7f227c0f77d0 2023-10-18T21:03:33.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.273+0000 7f2282010700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2268060f70 0x7f2268063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:33.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.274+0000 7f2282010700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2268060f70 0x7f2268063430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2278009720 tx=0x7f2278016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:33.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.278+0000 7f2272ffd700 1 -- 172.21.15.8:0/2400848084 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f226c04fd40 con 0x7f227c0f77d0 2023-10-18T21:03:33.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.480+0000 7f2283012700 1 -- 172.21.15.8:0/2400848084 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f227c10ac90 con 0x7f2268060f70 2023-10-18T21:03:33.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.481+0000 7f2272ffd700 1 -- 172.21.15.8:0/2400848084 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f227c10ac90 con 0x7f2268060f70 2023-10-18T21:03:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 -- 172.21.15.8:0/2400848084 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2268060f70 msgr2=0x7f2268063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2268060f70 0x7f2268063430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2278009720 tx=0x7f2278016040).stop 2023-10-18T21:03:33.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 -- 172.21.15.8:0/2400848084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227c0f77d0 msgr2=0x7f227c109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227c0f77d0 0x7f227c109450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f226c00e7f0 tx=0x7f226c00b040).stop 2023-10-18T21:03:33.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 -- 172.21.15.8:0/2400848084 shutdown_connections 2023-10-18T21:03:33.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2268060f70 0x7f2268063430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f227c0f6530 0x7f227c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 --2- 172.21.15.8:0/2400848084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227c0f77d0 0x7f227c109450 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 -- 172.21.15.8:0/2400848084 >> 172.21.15.8:0/2400848084 conn(0x7f227c0f1c90 msgr2=0x7f227c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:33.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 -- 172.21.15.8:0/2400848084 shutdown_connections 2023-10-18T21:03:33.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.483+0000 7f2283012700 1 -- 172.21.15.8:0/2400848084 wait complete. 2023-10-18T21:03:33.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.621+0000 7fb399ce2700 1 -- 172.21.15.8:0/501041323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39406a3b0 msgr2=0x7fb39406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.621+0000 7fb399ce2700 1 --2- 172.21.15.8:0/501041323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39406a3b0 0x7fb39406a830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb380004660 tx=0x7fb380009b30).stop 2023-10-18T21:03:33.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.621+0000 7fb399ce2700 1 -- 172.21.15.8:0/501041323 shutdown_connections 2023-10-18T21:03:33.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.621+0000 7fb399ce2700 1 --2- 172.21.15.8:0/501041323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39406a3b0 0x7fb39406a830 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.621+0000 7fb399ce2700 1 --2- 172.21.15.8:0/501041323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb39406b9c0 0x7fb394069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.621+0000 7fb399ce2700 1 -- 172.21.15.8:0/501041323 >> 172.21.15.8:0/501041323 conn(0x7fb3940f1c90 msgr2=0x7fb3940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:33.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.621+0000 7fb399ce2700 1 -- 172.21.15.8:0/501041323 shutdown_connections 2023-10-18T21:03:33.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.621+0000 7fb399ce2700 1 -- 172.21.15.8:0/501041323 wait complete. 2023-10-18T21:03:33.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.622+0000 7fb399ce2700 1 Processor -- start 2023-10-18T21:03:33.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.623+0000 7fb399ce2700 1 -- start start 2023-10-18T21:03:33.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.623+0000 7fb399ce2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb39406a3b0 0x7fb394108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:33.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.623+0000 7fb399ce2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39406b9c0 0x7fb394109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:33.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.623+0000 7fb399ce2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb394109a10 con 0x7fb39406b9c0 2023-10-18T21:03:33.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.623+0000 7fb399ce2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb394109b50 con 0x7fb39406a3b0 2023-10-18T21:03:33.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.623+0000 7fb393fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39406b9c0 0x7fb394109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:33.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.623+0000 7fb393fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39406b9c0 0x7fb394109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60686/0 (socket says 172.21.15.8:60686) 2023-10-18T21:03:33.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.623+0000 7fb393fff700 1 -- 172.21.15.8:0/335814884 learned_addr learned my addr 172.21.15.8:0/335814884 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:33.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.624+0000 7fb398ce0700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb39406a3b0 0x7fb394108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:33.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.624+0000 7fb393fff700 1 -- 172.21.15.8:0/335814884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb39406a3b0 msgr2=0x7fb394108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.624+0000 7fb393fff700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb39406a3b0 0x7fb394108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.624+0000 7fb393fff700 1 -- 172.21.15.8:0/335814884 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380005040 con 0x7fb39406b9c0 2023-10-18T21:03:33.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.624+0000 7fb393fff700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39406b9c0 0x7fb394109460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fb380009990 tx=0x7fb380009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:33.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.624+0000 7fb3917fa700 1 -- 172.21.15.8:0/335814884 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb380018070 con 0x7fb39406b9c0 2023-10-18T21:03:33.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.624+0000 7fb3917fa700 1 -- 172.21.15.8:0/335814884 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb380009630 con 0x7fb39406b9c0 2023-10-18T21:03:33.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.624+0000 7fb3917fa700 1 -- 172.21.15.8:0/335814884 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb38001c3c0 con 0x7fb39406b9c0 2023-10-18T21:03:33.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.624+0000 7fb399ce2700 1 -- 172.21.15.8:0/335814884 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39410a490 con 0x7fb39406b9c0 2023-10-18T21:03:33.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.625+0000 7fb399ce2700 1 -- 172.21.15.8:0/335814884 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39410a9f0 con 0x7fb39406b9c0 2023-10-18T21:03:33.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.626+0000 7fb399ce2700 1 -- 172.21.15.8:0/335814884 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb394045ad0 con 0x7fb39406b9c0 2023-10-18T21:03:33.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.626+0000 7fb3917fa700 1 -- 172.21.15.8:0/335814884 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb38001d970 con 0x7fb39406b9c0 2023-10-18T21:03:33.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.627+0000 7fb3917fa700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb384060f70 0x7fb384063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:33.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.627+0000 7fb3917fa700 1 -- 172.21.15.8:0/335814884 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb38007dcb0 con 0x7fb39406b9c0 2023-10-18T21:03:33.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.628+0000 7fb398ce0700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb384060f70 0x7fb384063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:33.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.628+0000 7fb398ce0700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb384060f70 0x7fb384063430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb388004c40 tx=0x7fb38800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:33.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.631+0000 7fb3917fa700 1 -- 172.21.15.8:0/335814884 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb380051be0 con 0x7fb39406b9c0 2023-10-18T21:03:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:32.195928+0000 mgr.smithi008.flmjzp (mgr.14640) 257 : cluster [DBG] pgmap v184: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 62/369 objects degraded (16.802%) 2023-10-18T21:03:33.737 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-4[134446]: debug 2023-10-18T21:03:33.470+0000 7f0bad261200 -1 osd.4 72 log_to_monitors {default=true} 2023-10-18T21:03:33.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.823+0000 7fb399ce2700 1 -- 172.21.15.8:0/335814884 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb394100fc0 con 0x7fb384060f70 2023-10-18T21:03:33.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.833+0000 7fb3917fa700 1 -- 172.21.15.8:0/335814884 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fb394100fc0 con 0x7fb384060f70 2023-10-18T21:03:33.836 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:03:33.836 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (10m) 73s ago 11m 15.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:03:33.836 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (4m) 73s ago 11m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:03:33.837 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (4m) 6s ago 10m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:03:33.837 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (10m) 73s ago 11m 25.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:03:33.837 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (7m) 73s ago 7m 7674M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T21:03:33.837 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (7m) 73s ago 7m 919M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T21:03:33.837 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (7m) 6s ago 7m 3802M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:03:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (7m) 6s ago 7m 478M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:03:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (5m) 73s ago 13m 451M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:03:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (4m) 6s ago 10m 396M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:03:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (4m) 73s ago 13m 91.5M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:03:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (4m) 6s ago 10m 79.2M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:03:33.839 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (11m) 73s ago 11m 9625k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:03:33.839 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (10m) 6s ago 10m 9.86M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:03:33.839 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (3m) 73s ago 10m 414M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:03:33.839 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (107s) 73s ago 9m 285M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:03:33.840 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (79s) 73s ago 9m 10.7M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:03:33.840 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (50s) 6s ago 9m 336M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:03:33.840 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (9s) 6s ago 9m 10.7M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:03:33.840 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (8m) 6s ago 8m 1040M 4096M 16.2.4 8d91d370c2b8 502143edb3be 2023-10-18T21:03:33.840 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (5m) 73s ago 10m 58.7M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:03:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.835+0000 7fb399ce2700 1 -- 172.21.15.8:0/335814884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb384060f70 msgr2=0x7fb384063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.835+0000 7fb399ce2700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb384060f70 0x7fb384063430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb388004c40 tx=0x7fb38800b040).stop 2023-10-18T21:03:33.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.835+0000 7fb399ce2700 1 -- 172.21.15.8:0/335814884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39406b9c0 msgr2=0x7fb394109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.835+0000 7fb399ce2700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39406b9c0 0x7fb394109460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fb380009990 tx=0x7fb380009b30).stop 2023-10-18T21:03:33.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.835+0000 7fb399ce2700 1 -- 172.21.15.8:0/335814884 shutdown_connections 2023-10-18T21:03:33.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.835+0000 7fb399ce2700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb384060f70 0x7fb384063430 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.835+0000 7fb399ce2700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb39406a3b0 0x7fb394108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.835+0000 7fb399ce2700 1 --2- 172.21.15.8:0/335814884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39406b9c0 0x7fb394109460 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.835+0000 7fb399ce2700 1 -- 172.21.15.8:0/335814884 >> 172.21.15.8:0/335814884 conn(0x7fb3940f1c90 msgr2=0x7fb3940fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:33.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.836+0000 7fb399ce2700 1 -- 172.21.15.8:0/335814884 shutdown_connections 2023-10-18T21:03:33.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.836+0000 7fb399ce2700 1 -- 172.21.15.8:0/335814884 wait complete. 2023-10-18T21:03:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:32.195928+0000 mgr.smithi008.flmjzp (mgr.14640) 257 : cluster [DBG] pgmap v184: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 62/369 objects degraded (16.802%) 2023-10-18T21:03:33.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.971+0000 7fd1dd011700 1 -- 172.21.15.8:0/1198976688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d80f6530 msgr2=0x7fd1d80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.971+0000 7fd1dd011700 1 --2- 172.21.15.8:0/1198976688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d80f6530 0x7fd1d80f6950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd1c8004660 tx=0x7fd1c8009b30).stop 2023-10-18T21:03:33.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.971+0000 7fd1dd011700 1 -- 172.21.15.8:0/1198976688 shutdown_connections 2023-10-18T21:03:33.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.971+0000 7fd1dd011700 1 --2- 172.21.15.8:0/1198976688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d80f77d0 0x7fd1d80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.971+0000 7fd1dd011700 1 --2- 172.21.15.8:0/1198976688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d80f6530 0x7fd1d80f6950 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.971+0000 7fd1dd011700 1 -- 172.21.15.8:0/1198976688 >> 172.21.15.8:0/1198976688 conn(0x7fd1d80f1c90 msgr2=0x7fd1d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:33.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.971+0000 7fd1dd011700 1 -- 172.21.15.8:0/1198976688 shutdown_connections 2023-10-18T21:03:33.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.971+0000 7fd1dd011700 1 -- 172.21.15.8:0/1198976688 wait complete. 2023-10-18T21:03:33.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.972+0000 7fd1dd011700 1 Processor -- start 2023-10-18T21:03:33.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.972+0000 7fd1dd011700 1 -- start start 2023-10-18T21:03:33.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.972+0000 7fd1dd011700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d80f6530 0x7fd1d8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:33.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.972+0000 7fd1dd011700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d80f77d0 0x7fd1d8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:33.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.972+0000 7fd1dd011700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d8107880 con 0x7fd1d80f77d0 2023-10-18T21:03:33.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.972+0000 7fd1dd011700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d81080c0 con 0x7fd1d80f6530 2023-10-18T21:03:33.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d80f77d0 0x7fd1d8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:33.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d80f77d0 0x7fd1d8107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60712/0 (socket says 172.21.15.8:60712) 2023-10-18T21:03:33.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d77fe700 1 -- 172.21.15.8:0/277805337 learned_addr learned my addr 172.21.15.8:0/277805337 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:33.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d7fff700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d80f6530 0x7fd1d8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:33.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d77fe700 1 -- 172.21.15.8:0/277805337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d80f6530 msgr2=0x7fd1d8106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:33.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d77fe700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d80f6530 0x7fd1d8106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:33.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d77fe700 1 -- 172.21.15.8:0/277805337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8005040 con 0x7fd1d80f77d0 2023-10-18T21:03:33.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d7fff700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d80f6530 0x7fd1d8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:03:33.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d77fe700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d80f77d0 0x7fd1d8107280 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fd1cc00e7f0 tx=0x7fd1cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:33.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d4ff9700 1 -- 172.21.15.8:0/277805337 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1cc0092e0 con 0x7fd1d80f77d0 2023-10-18T21:03:33.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d4ff9700 1 -- 172.21.15.8:0/277805337 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd1cc00f040 con 0x7fd1d80f77d0 2023-10-18T21:03:33.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.973+0000 7fd1d4ff9700 1 -- 172.21.15.8:0/277805337 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1cc0147e0 con 0x7fd1d80f77d0 2023-10-18T21:03:33.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.974+0000 7fd1dd011700 1 -- 172.21.15.8:0/277805337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d81083a0 con 0x7fd1d80f77d0 2023-10-18T21:03:33.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.974+0000 7fd1dd011700 1 -- 172.21.15.8:0/277805337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d81088e0 con 0x7fd1d80f77d0 2023-10-18T21:03:33.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.975+0000 7fd1dd011700 1 -- 172.21.15.8:0/277805337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d8059100 con 0x7fd1d80f77d0 2023-10-18T21:03:33.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.975+0000 7fd1d4ff9700 1 -- 172.21.15.8:0/277805337 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd1cc01b030 con 0x7fd1d80f77d0 2023-10-18T21:03:33.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.976+0000 7fd1d4ff9700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1c0060f70 0x7fd1c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:33.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.976+0000 7fd1d4ff9700 1 -- 172.21.15.8:0/277805337 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd1cc07bf30 con 0x7fd1d80f77d0 2023-10-18T21:03:33.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.977+0000 7fd1d7fff700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1c0060f70 0x7fd1c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:33.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.977+0000 7fd1d7fff700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1c0060f70 0x7fd1c0063430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fd1c8000c00 tx=0x7fd1c800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:33.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:33.980+0000 7fd1d4ff9700 1 -- 172.21.15.8:0/277805337 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd1cc04c340 con 0x7fd1d80f77d0 2023-10-18T21:03:34.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.236+0000 7fd1dd011700 1 -- 172.21.15.8:0/277805337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd1d80fed80 con 0x7fd1d80f77d0 2023-10-18T21:03:34.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.237+0000 7fd1d4ff9700 1 -- 172.21.15.8:0/277805337 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7fd1cc019070 con 0x7fd1d80f77d0 2023-10-18T21:03:34.240 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:03:34.240 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:03:34.240 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:03:34.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:03:34.241 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:03:34.241 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:03:34.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:03:34.241 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:03:34.241 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 4, 2023-10-18T21:03:34.242 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2023-10-18T21:03:34.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:03:34.242 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:03:34.242 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T21:03:34.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:03:34.243 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:03:34.243 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 8, 2023-10-18T21:03:34.243 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2023-10-18T21:03:34.243 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:03:34.244 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:03:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 -- 172.21.15.8:0/277805337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1c0060f70 msgr2=0x7fd1c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1c0060f70 0x7fd1c0063430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fd1c8000c00 tx=0x7fd1c800b040).stop 2023-10-18T21:03:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 -- 172.21.15.8:0/277805337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d80f77d0 msgr2=0x7fd1d8107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d80f77d0 0x7fd1d8107280 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fd1cc00e7f0 tx=0x7fd1cc00b040).stop 2023-10-18T21:03:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 -- 172.21.15.8:0/277805337 shutdown_connections 2023-10-18T21:03:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1c0060f70 0x7fd1c0063430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d80f6530 0x7fd1d8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 --2- 172.21.15.8:0/277805337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d80f77d0 0x7fd1d8107280 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 -- 172.21.15.8:0/277805337 >> 172.21.15.8:0/277805337 conn(0x7fd1d80f1c90 msgr2=0x7fd1d80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 -- 172.21.15.8:0/277805337 shutdown_connections 2023-10-18T21:03:34.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.239+0000 7fd1dd011700 1 -- 172.21.15.8:0/277805337 wait complete. 2023-10-18T21:03:34.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.374+0000 7f1f021f2700 1 -- 172.21.15.8:0/903570480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1efc0f6530 msgr2=0x7f1efc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:34.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.374+0000 7f1f021f2700 1 --2- 172.21.15.8:0/903570480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1efc0f6530 0x7f1efc0f6950 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f1ef8004660 tx=0x7f1ef8009b30).stop 2023-10-18T21:03:34.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.375+0000 7f1f021f2700 1 -- 172.21.15.8:0/903570480 shutdown_connections 2023-10-18T21:03:34.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.375+0000 7f1f021f2700 1 --2- 172.21.15.8:0/903570480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc0f77d0 0x7f1efc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.375+0000 7f1f021f2700 1 --2- 172.21.15.8:0/903570480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1efc0f6530 0x7f1efc0f6950 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.375+0000 7f1f021f2700 1 -- 172.21.15.8:0/903570480 >> 172.21.15.8:0/903570480 conn(0x7f1efc0f1c90 msgr2=0x7f1efc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:34.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.375+0000 7f1f021f2700 1 -- 172.21.15.8:0/903570480 shutdown_connections 2023-10-18T21:03:34.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.375+0000 7f1f021f2700 1 -- 172.21.15.8:0/903570480 wait complete. 2023-10-18T21:03:34.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.376+0000 7f1f021f2700 1 Processor -- start 2023-10-18T21:03:34.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.376+0000 7f1f021f2700 1 -- start start 2023-10-18T21:03:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f021f2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc0f6530 0x7f1efc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f021f2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1efc0f77d0 0x7f1efc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f021f2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc06a380 con 0x7f1efc0f77d0 2023-10-18T21:03:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f021f2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc06a4c0 con 0x7f1efc0f6530 2023-10-18T21:03:34.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f009ef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1efc0f77d0 0x7f1efc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:34.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f009ef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1efc0f77d0 0x7f1efc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60724/0 (socket says 172.21.15.8:60724) 2023-10-18T21:03:34.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f009ef700 1 -- 172.21.15.8:0/857930165 learned_addr learned my addr 172.21.15.8:0/857930165 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:34.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f011f0700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc0f6530 0x7f1efc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:34.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f009ef700 1 -- 172.21.15.8:0/857930165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc0f6530 msgr2=0x7f1efc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:34.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f009ef700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc0f6530 0x7f1efc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.377+0000 7f1f009ef700 1 -- 172.21.15.8:0/857930165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef8005040 con 0x7f1efc0f77d0 2023-10-18T21:03:34.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.378+0000 7f1f009ef700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1efc0f77d0 0x7f1efc069e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1eec00e7f0 tx=0x7f1eec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:34.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.378+0000 7f1ef1ffb700 1 -- 172.21.15.8:0/857930165 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eec0092e0 con 0x7f1efc0f77d0 2023-10-18T21:03:34.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.378+0000 7f1ef1ffb700 1 -- 172.21.15.8:0/857930165 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1eec00f040 con 0x7f1efc0f77d0 2023-10-18T21:03:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.378+0000 7f1f021f2700 1 -- 172.21.15.8:0/857930165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc06a7a0 con 0x7f1efc0f77d0 2023-10-18T21:03:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.378+0000 7f1ef1ffb700 1 -- 172.21.15.8:0/857930165 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eec0147e0 con 0x7f1efc0f77d0 2023-10-18T21:03:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.378+0000 7f1f021f2700 1 -- 172.21.15.8:0/857930165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc10ed70 con 0x7f1efc0f77d0 2023-10-18T21:03:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.379+0000 7f1f021f2700 1 -- 172.21.15.8:0/857930165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc059100 con 0x7f1efc0f77d0 2023-10-18T21:03:34.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.380+0000 7f1ef1ffb700 1 -- 172.21.15.8:0/857930165 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1eec01b030 con 0x7f1efc0f77d0 2023-10-18T21:03:34.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.381+0000 7f1ef1ffb700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ee8060f70 0x7f1ee8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:34.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.381+0000 7f1ef1ffb700 1 -- 172.21.15.8:0/857930165 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f1eec07bf20 con 0x7f1efc0f77d0 2023-10-18T21:03:34.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.381+0000 7f1f011f0700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ee8060f70 0x7f1ee8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:34.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.382+0000 7f1f011f0700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ee8060f70 0x7f1ee8063430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1ef80043d0 tx=0x7f1ef800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:34.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.385+0000 7f1ef1ffb700 1 -- 172.21.15.8:0/857930165 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1eec0aaf20 con 0x7f1efc0f77d0 2023-10-18T21:03:34.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.618+0000 7f1f021f2700 1 -- 172.21.15.8:0/857930165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1efc0fed80 con 0x7f1efc0f77d0 2023-10-18T21:03:34.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.619+0000 7f1ef1ffb700 1 -- 172.21.15.8:0/857930165 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1760 (secure 0 0 0) 0x7f1eec019020 con 0x7f1efc0f77d0 2023-10-18T21:03:34.622 INFO:teuthology.orchestra.run.smithi008.stdout:e19 2023-10-18T21:03:34.622 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:03:34.622 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:03:34.623 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:03:34.623 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:03:34.624 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:03:34.624 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:03:34.624 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 19 2023-10-18T21:03:34.624 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 2023-10-18T21:03:34.625 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:03:34.625 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:03:17.484815+0000 2023-10-18T21:03:34.625 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:03:34.626 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:03:34.626 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:03:34.626 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:03:34.626 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:03:34.626 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:03:34.627 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:03:34.627 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T21:03:34.627 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:03:34.628 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 2 2023-10-18T21:03:34.628 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T21:03:34.628 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T21:03:34.628 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:03:34.629 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:03:34.629 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T21:03:34.629 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:03:34.629 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:03:34.629 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:03:34.630 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:03:34.630 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:03:34.630 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:03:34.630 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:14472} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.8:6828/2541768531,v1:172.21.15.8:6829/2541768531] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:03:34.631 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:03:34.631 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{1:24333} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6826/1177007799,v1:172.21.15.60:6827/1177007799] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:03:34.631 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:03:34.631 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:03:34.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 -- 172.21.15.8:0/857930165 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ee8060f70 msgr2=0x7f1ee8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:34.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ee8060f70 0x7f1ee8063430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1ef80043d0 tx=0x7f1ef800b040).stop 2023-10-18T21:03:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 -- 172.21.15.8:0/857930165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1efc0f77d0 msgr2=0x7f1efc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1efc0f77d0 0x7f1efc069e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1eec00e7f0 tx=0x7f1eec00b040).stop 2023-10-18T21:03:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 -- 172.21.15.8:0/857930165 shutdown_connections 2023-10-18T21:03:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ee8060f70 0x7f1ee8063430 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc0f6530 0x7f1efc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 --2- 172.21.15.8:0/857930165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1efc0f77d0 0x7f1efc069e20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 -- 172.21.15.8:0/857930165 >> 172.21.15.8:0/857930165 conn(0x7f1efc0f1c90 msgr2=0x7f1efc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 -- 172.21.15.8:0/857930165 shutdown_connections 2023-10-18T21:03:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.621+0000 7f1f021f2700 1 -- 172.21.15.8:0/857930165 wait complete. 2023-10-18T21:03:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 19 2023-10-18T21:03:34.737 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 18 21:03:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-4[134446]: debug 2023-10-18T21:03:34.470+0000 7f0b9e75b700 -1 osd.4 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T21:03:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:33.130441+0000 mgr.smithi008.flmjzp (mgr.14640) 258 : audit [DBG] from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:34.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:33.477644+0000 mon.smithi060 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.60:6808/2215408686,v1:172.21.15.60:6809/2215408686]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T21:03:34.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:33.478229+0000 mon.smithi008 (mon.0) 424 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T21:03:34.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:33.482420+0000 mgr.smithi008.flmjzp (mgr.14640) 259 : audit [DBG] from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:34.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:34.238488+0000 mon.smithi008 (mon.0) 425 : audit [DBG] from='client.? 172.21.15.8:0/277805337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:34.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.758+0000 7ff494ac9700 1 -- 172.21.15.8:0/1374059829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4900f96a0 msgr2=0x7ff4900fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:34.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.758+0000 7ff494ac9700 1 --2- 172.21.15.8:0/1374059829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4900f96a0 0x7ff4900fbaf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7ff484004660 tx=0x7ff484009b30).stop 2023-10-18T21:03:34.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.758+0000 7ff494ac9700 1 -- 172.21.15.8:0/1374059829 shutdown_connections 2023-10-18T21:03:34.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.758+0000 7ff494ac9700 1 --2- 172.21.15.8:0/1374059829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4900f96a0 0x7ff4900fbaf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.758+0000 7ff494ac9700 1 --2- 172.21.15.8:0/1374059829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff490060310 0x7ff4900f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.758+0000 7ff494ac9700 1 -- 172.21.15.8:0/1374059829 >> 172.21.15.8:0/1374059829 conn(0x7ff4900f0ba0 msgr2=0x7ff4900f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.759+0000 7ff494ac9700 1 -- 172.21.15.8:0/1374059829 shutdown_connections 2023-10-18T21:03:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.759+0000 7ff494ac9700 1 -- 172.21.15.8:0/1374059829 wait complete. 2023-10-18T21:03:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.759+0000 7ff494ac9700 1 Processor -- start 2023-10-18T21:03:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.760+0000 7ff494ac9700 1 -- start start 2023-10-18T21:03:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.760+0000 7ff494ac9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff490060310 0x7ff4900f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.760+0000 7ff494ac9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4900f96a0 0x7ff4900f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.760+0000 7ff494ac9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900f5580 con 0x7ff4900f96a0 2023-10-18T21:03:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.760+0000 7ff494ac9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900f56c0 con 0x7ff490060310 2023-10-18T21:03:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.760+0000 7ff48effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4900f96a0 0x7ff4900f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.760+0000 7ff48effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4900f96a0 0x7ff4900f5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60744/0 (socket says 172.21.15.8:60744) 2023-10-18T21:03:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.760+0000 7ff48effd700 1 -- 172.21.15.8:0/1734512389 learned_addr learned my addr 172.21.15.8:0/1734512389 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:03:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.760+0000 7ff48f7fe700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff490060310 0x7ff4900f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.761+0000 7ff48effd700 1 -- 172.21.15.8:0/1734512389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff490060310 msgr2=0x7ff4900f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.761+0000 7ff48effd700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff490060310 0x7ff4900f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.761+0000 7ff48effd700 1 -- 172.21.15.8:0/1734512389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff484005040 con 0x7ff4900f96a0 2023-10-18T21:03:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.761+0000 7ff48effd700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4900f96a0 0x7ff4900f5020 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff484004e30 tx=0x7ff484009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.761+0000 7ff477fff700 1 -- 172.21.15.8:0/1734512389 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff484018070 con 0x7ff4900f96a0 2023-10-18T21:03:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.761+0000 7ff494ac9700 1 -- 172.21.15.8:0/1734512389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4900f5940 con 0x7ff4900f96a0 2023-10-18T21:03:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.761+0000 7ff477fff700 1 -- 172.21.15.8:0/1734512389 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff484009630 con 0x7ff4900f96a0 2023-10-18T21:03:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.761+0000 7ff477fff700 1 -- 172.21.15.8:0/1734512389 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff48401c3c0 con 0x7ff4900f96a0 2023-10-18T21:03:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.761+0000 7ff494ac9700 1 -- 172.21.15.8:0/1734512389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4900f5ea0 con 0x7ff4900f96a0 2023-10-18T21:03:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.763+0000 7ff494ac9700 1 -- 172.21.15.8:0/1734512389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff490045ad0 con 0x7ff4900f96a0 2023-10-18T21:03:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.763+0000 7ff477fff700 1 -- 172.21.15.8:0/1734512389 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff48401d420 con 0x7ff4900f96a0 2023-10-18T21:03:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.764+0000 7ff477fff700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff478060f70 0x7ff478063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:03:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.764+0000 7ff477fff700 1 -- 172.21.15.8:0/1734512389 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff48407dc60 con 0x7ff4900f96a0 2023-10-18T21:03:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.765+0000 7ff48f7fe700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff478060f70 0x7ff478063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:03:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.765+0000 7ff48f7fe700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff478060f70 0x7ff478063430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ff4900f6930 tx=0x7ff48000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:03:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.769+0000 7ff477fff700 1 -- 172.21.15.8:0/1734512389 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff48404e0e0 con 0x7ff4900f96a0 2023-10-18T21:03:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:33.130441+0000 mgr.smithi008.flmjzp (mgr.14640) 258 : audit [DBG] from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:33.477644+0000 mon.smithi060 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.60:6808/2215408686,v1:172.21.15.60:6809/2215408686]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T21:03:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:33.478229+0000 mon.smithi008 (mon.0) 424 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T21:03:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:33.482420+0000 mgr.smithi008.flmjzp (mgr.14640) 259 : audit [DBG] from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:34.238488+0000 mon.smithi008 (mon.0) 425 : audit [DBG] from='client.? 172.21.15.8:0/277805337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:34.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.967+0000 7ff494ac9700 1 -- 172.21.15.8:0/1734512389 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4900fed40 con 0x7ff478060f70 2023-10-18T21:03:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.968+0000 7ff477fff700 1 -- 172.21.15.8:0/1734512389 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff4900fed40 con 0x7ff478060f70 2023-10-18T21:03:34.971 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:03:34.971 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:03:34.971 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:03:34.971 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:03:34.971 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:03:34.971 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:03:34.972 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:03:34.972 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:03:34.972 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:03:34.972 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "11/21 daemons upgraded", 2023-10-18T21:03:34.972 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading osd daemons", 2023-10-18T21:03:34.973 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:03:34.973 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:03:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.970+0000 7ff494ac9700 1 -- 172.21.15.8:0/1734512389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff478060f70 msgr2=0x7ff478063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.970+0000 7ff494ac9700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff478060f70 0x7ff478063430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ff4900f6930 tx=0x7ff48000b040).stop 2023-10-18T21:03:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.970+0000 7ff494ac9700 1 -- 172.21.15.8:0/1734512389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4900f96a0 msgr2=0x7ff4900f5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:03:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.970+0000 7ff494ac9700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4900f96a0 0x7ff4900f5020 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff484004e30 tx=0x7ff484009b30).stop 2023-10-18T21:03:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.970+0000 7ff494ac9700 1 -- 172.21.15.8:0/1734512389 shutdown_connections 2023-10-18T21:03:34.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.970+0000 7ff494ac9700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff478060f70 0x7ff478063430 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.970+0000 7ff494ac9700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff490060310 0x7ff4900f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.970+0000 7ff494ac9700 1 --2- 172.21.15.8:0/1734512389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4900f96a0 0x7ff4900f5020 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:03:34.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.970+0000 7ff494ac9700 1 -- 172.21.15.8:0/1734512389 >> 172.21.15.8:0/1734512389 conn(0x7ff4900f0ba0 msgr2=0x7ff4900f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:03:34.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.970+0000 7ff494ac9700 1 -- 172.21.15.8:0/1734512389 shutdown_connections 2023-10-18T21:03:34.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:03:34.971+0000 7ff494ac9700 1 -- 172.21.15.8:0/1734512389 wait complete. 2023-10-18T21:03:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:33.825877+0000 mgr.smithi008.flmjzp (mgr.14640) 260 : audit [DBG] from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:34.196435+0000 mgr.smithi008.flmjzp (mgr.14640) 261 : cluster [DBG] pgmap v185: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 62/369 objects degraded (16.802%) 2023-10-18T21:03:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:34.460229+0000 mon.smithi008 (mon.0) 426 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-18T21:03:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:34.460335+0000 mon.smithi008 (mon.0) 427 : cluster [DBG] osdmap e75: 6 total, 5 up, 6 in 2023-10-18T21:03:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:34.462059+0000 mon.smithi060 (mon.1) 6 : audit [INF] from='osd.4 [v2:172.21.15.60:6808/2215408686,v1:172.21.15.60:6809/2215408686]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:03:35.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:34.462612+0000 mon.smithi008 (mon.0) 428 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:03:35.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:34.620586+0000 mon.smithi008 (mon.0) 429 : audit [DBG] from='client.? 172.21.15.8:0/857930165' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:03:35.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:34.872067+0000 mon.smithi008 (mon.0) 430 : cluster [WRN] Health check update: Degraded data redundancy: 62/369 objects degraded (16.802%), 16 pgs degraded (PG_DEGRADED) 2023-10-18T21:03:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:33.825877+0000 mgr.smithi008.flmjzp (mgr.14640) 260 : audit [DBG] from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:34.196435+0000 mgr.smithi008.flmjzp (mgr.14640) 261 : cluster [DBG] pgmap v185: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 327 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 62/369 objects degraded (16.802%) 2023-10-18T21:03:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:34.460229+0000 mon.smithi008 (mon.0) 426 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-18T21:03:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:34.460335+0000 mon.smithi008 (mon.0) 427 : cluster [DBG] osdmap e75: 6 total, 5 up, 6 in 2023-10-18T21:03:35.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:34.462059+0000 mon.smithi060 (mon.1) 6 : audit [INF] from='osd.4 [v2:172.21.15.60:6808/2215408686,v1:172.21.15.60:6809/2215408686]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:03:35.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:34.462612+0000 mon.smithi008 (mon.0) 428 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:03:35.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:34.620586+0000 mon.smithi008 (mon.0) 429 : audit [DBG] from='client.? 172.21.15.8:0/857930165' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:03:35.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:34.872067+0000 mon.smithi008 (mon.0) 430 : cluster [WRN] Health check update: Degraded data redundancy: 62/369 objects degraded (16.802%), 16 pgs degraded (PG_DEGRADED) 2023-10-18T21:03:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:34.969383+0000 mgr.smithi008.flmjzp (mgr.14640) 262 : audit [DBG] from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:35.457156+0000 mon.smithi008 (mon.0) 431 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T21:03:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:35.461598+0000 mon.smithi008 (mon.0) 432 : cluster [INF] osd.4 [v2:172.21.15.60:6808/2215408686,v1:172.21.15.60:6809/2215408686] boot 2023-10-18T21:03:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:35.461657+0000 mon.smithi008 (mon.0) 433 : cluster [DBG] osdmap e76: 6 total, 6 up, 6 in 2023-10-18T21:03:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:35.462302+0000 mon.smithi008 (mon.0) 434 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T21:03:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:36.464650+0000 mon.smithi008 (mon.0) 435 : cluster [DBG] osdmap e77: 6 total, 6 up, 6 in 2023-10-18T21:03:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:34.969383+0000 mgr.smithi008.flmjzp (mgr.14640) 262 : audit [DBG] from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:03:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:35.457156+0000 mon.smithi008 (mon.0) 431 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T21:03:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:35.461598+0000 mon.smithi008 (mon.0) 432 : cluster [INF] osd.4 [v2:172.21.15.60:6808/2215408686,v1:172.21.15.60:6809/2215408686] boot 2023-10-18T21:03:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:35.461657+0000 mon.smithi008 (mon.0) 433 : cluster [DBG] osdmap e76: 6 total, 6 up, 6 in 2023-10-18T21:03:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:35.462302+0000 mon.smithi008 (mon.0) 434 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T21:03:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:36.464650+0000 mon.smithi008 (mon.0) 435 : cluster [DBG] osdmap e77: 6 total, 6 up, 6 in 2023-10-18T21:03:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:36.196896+0000 mgr.smithi008.flmjzp (mgr.14640) 263 : cluster [DBG] pgmap v188: 65 pgs: 10 peering, 12 active+undersized+degraded, 12 active+undersized, 31 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 45/369 objects degraded (12.195%) 2023-10-18T21:03:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:36.196896+0000 mgr.smithi008.flmjzp (mgr.14640) 263 : cluster [DBG] pgmap v188: 65 pgs: 10 peering, 12 active+undersized+degraded, 12 active+undersized, 31 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 45/369 objects degraded (12.195%) 2023-10-18T21:03:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:38.197572+0000 mgr.smithi008.flmjzp (mgr.14640) 264 : cluster [DBG] pgmap v190: 65 pgs: 10 peering, 12 active+undersized+degraded, 11 active+undersized, 32 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 45/369 objects degraded (12.195%) 2023-10-18T21:03:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:38.197572+0000 mgr.smithi008.flmjzp (mgr.14640) 264 : cluster [DBG] pgmap v190: 65 pgs: 10 peering, 12 active+undersized+degraded, 11 active+undersized, 32 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 45/369 objects degraded (12.195%) 2023-10-18T21:03:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:39.873154+0000 mon.smithi008 (mon.0) 436 : cluster [WRN] Health check update: Degraded data redundancy: 45/369 objects degraded (12.195%), 12 pgs degraded (PG_DEGRADED) 2023-10-18T21:03:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:39.873154+0000 mon.smithi008 (mon.0) 436 : cluster [WRN] Health check update: Degraded data redundancy: 45/369 objects degraded (12.195%), 12 pgs degraded (PG_DEGRADED) 2023-10-18T21:03:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:40.198203+0000 mgr.smithi008.flmjzp (mgr.14640) 265 : cluster [DBG] pgmap v191: 65 pgs: 10 peering, 4 active+undersized+degraded, 3 active+undersized, 48 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 14/369 objects degraded (3.794%) 2023-10-18T21:03:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:40.198203+0000 mgr.smithi008.flmjzp (mgr.14640) 265 : cluster [DBG] pgmap v191: 65 pgs: 10 peering, 4 active+undersized+degraded, 3 active+undersized, 48 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 14/369 objects degraded (3.794%) 2023-10-18T21:03:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:42.489194+0000 mon.smithi008 (mon.0) 437 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/369 objects degraded (3.794%), 4 pgs degraded) 2023-10-18T21:03:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:42.489224+0000 mon.smithi008 (mon.0) 438 : cluster [INF] Cluster is now healthy 2023-10-18T21:03:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:42.489194+0000 mon.smithi008 (mon.0) 437 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/369 objects degraded (3.794%), 4 pgs degraded) 2023-10-18T21:03:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:42.489224+0000 mon.smithi008 (mon.0) 438 : cluster [INF] Cluster is now healthy 2023-10-18T21:03:43.902 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:42.198774+0000 mgr.smithi008.flmjzp (mgr.14640) 266 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2023-10-18T21:03:43.902 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:43.429964+0000 mon.smithi008 (mon.0) 439 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-10-18T21:03:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:42.198774+0000 mgr.smithi008.flmjzp (mgr.14640) 266 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2023-10-18T21:03:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:43.429964+0000 mon.smithi008 (mon.0) 439 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-10-18T21:03:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:43.430228+0000 mgr.smithi008.flmjzp (mgr.14640) 267 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-10-18T21:03:44.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:43.431564+0000 mgr.smithi008.flmjzp (mgr.14640) 268 : cephadm [INF] Upgrade: osd.5 is safe to restart 2023-10-18T21:03:44.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:44.531561+0000 mon.smithi008 (mon.0) 440 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:44.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:44.532757+0000 mon.smithi008 (mon.0) 441 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-18T21:03:44.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:44.533666+0000 mon.smithi008 (mon.0) 442 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:44.981 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:43.430228+0000 mgr.smithi008.flmjzp (mgr.14640) 267 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-10-18T21:03:44.982 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:43.431564+0000 mgr.smithi008.flmjzp (mgr.14640) 268 : cephadm [INF] Upgrade: osd.5 is safe to restart 2023-10-18T21:03:44.982 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:44.531561+0000 mon.smithi008 (mon.0) 440 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:44.982 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:44.532757+0000 mon.smithi008 (mon.0) 441 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-18T21:03:44.982 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:44.533666+0000 mon.smithi008 (mon.0) 442 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:44.199240+0000 mgr.smithi008.flmjzp (mgr.14640) 269 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-10-18T21:03:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:44.526159+0000 mgr.smithi008.flmjzp (mgr.14640) 270 : cephadm [INF] Upgrade: Updating osd.5 2023-10-18T21:03:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:44.535066+0000 mgr.smithi008.flmjzp (mgr.14640) 271 : cephadm [INF] Deploying daemon osd.5 on smithi060 2023-10-18T21:03:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:45.446501+0000 mon.smithi008 (mon.0) 443 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:44.199240+0000 mgr.smithi008.flmjzp (mgr.14640) 269 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-10-18T21:03:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:44.526159+0000 mgr.smithi008.flmjzp (mgr.14640) 270 : cephadm [INF] Upgrade: Updating osd.5 2023-10-18T21:03:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:44.535066+0000 mgr.smithi008.flmjzp (mgr.14640) 271 : cephadm [INF] Deploying daemon osd.5 on smithi060 2023-10-18T21:03:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:45.446501+0000 mon.smithi008 (mon.0) 443 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:47.380 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:47 smithi060 systemd[1]: Stopping Ceph osd.5 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T21:03:47.381 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.5[122249]: debug 2023-10-18T21:03:47.159+0000 7ff0345fe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-10-18T21:03:47.381 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.5[122249]: debug 2023-10-18T21:03:47.159+0000 7ff0345fe700 -1 osd.5 77 *** Got signal Terminated *** 2023-10-18T21:03:47.381 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.5[122249]: debug 2023-10-18T21:03:47.159+0000 7ff0345fe700 -1 osd.5 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T21:03:47.579 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:46.199911+0000 mgr.smithi008.flmjzp (mgr.14640) 272 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T21:03:47.580 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.472104+0000 mon.smithi008 (mon.0) 444 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-10-18T21:03:47.580 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.472163+0000 mon.smithi008 (mon.0) 445 : cluster [INF] osd.5 failed (root=default,host=smithi060) (connection refused reported by osd.4) 2023-10-18T21:03:47.580 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.472483+0000 mon.smithi008 (mon.0) 446 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-10-18T21:03:47.580 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.472639+0000 mon.smithi008 (mon.0) 447 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-10-18T21:03:47.580 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.472783+0000 mon.smithi008 (mon.0) 448 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-10-18T21:03:47.737 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:47 smithi060 bash[136131]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd.5 2023-10-18T21:03:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:46.199911+0000 mgr.smithi008.flmjzp (mgr.14640) 272 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T21:03:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.472104+0000 mon.smithi008 (mon.0) 444 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-10-18T21:03:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.472163+0000 mon.smithi008 (mon.0) 445 : cluster [INF] osd.5 failed (root=default,host=smithi060) (connection refused reported by osd.4) 2023-10-18T21:03:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.472483+0000 mon.smithi008 (mon.0) 446 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-10-18T21:03:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.472639+0000 mon.smithi008 (mon.0) 447 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-10-18T21:03:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.472783+0000 mon.smithi008 (mon.0) 448 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-10-18T21:03:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.472930+0000 mon.smithi008 (mon.0) 449 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-10-18T21:03:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.473139+0000 mon.smithi008 (mon.0) 450 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-10-18T21:03:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.473302+0000 mon.smithi008 (mon.0) 451 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-10-18T21:03:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.473460+0000 mon.smithi008 (mon.0) 452 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-10-18T21:03:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.473556+0000 mon.smithi008 (mon.0) 453 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-10-18T21:03:47.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.473806+0000 mon.smithi008 (mon.0) 454 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-10-18T21:03:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.472930+0000 mon.smithi008 (mon.0) 449 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-10-18T21:03:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.473139+0000 mon.smithi008 (mon.0) 450 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-10-18T21:03:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.473302+0000 mon.smithi008 (mon.0) 451 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-10-18T21:03:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.473460+0000 mon.smithi008 (mon.0) 452 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-10-18T21:03:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.473556+0000 mon.smithi008 (mon.0) 453 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-10-18T21:03:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.473806+0000 mon.smithi008 (mon.0) 454 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-10-18T21:03:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.554506+0000 mon.smithi008 (mon.0) 455 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T21:03:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:47.559872+0000 mon.smithi008 (mon.0) 456 : cluster [DBG] osdmap e78: 6 total, 5 up, 6 in 2023-10-18T21:03:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:48.561739+0000 mon.smithi008 (mon.0) 457 : cluster [DBG] osdmap e79: 6 total, 5 up, 6 in 2023-10-18T21:03:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.554506+0000 mon.smithi008 (mon.0) 455 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-18T21:03:48.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:47.559872+0000 mon.smithi008 (mon.0) 456 : cluster [DBG] osdmap e78: 6 total, 5 up, 6 in 2023-10-18T21:03:48.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:48.561739+0000 mon.smithi008 (mon.0) 457 : cluster [DBG] osdmap e79: 6 total, 5 up, 6 in 2023-10-18T21:03:49.487 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:49 smithi060 systemd[1]: ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7@osd.5.service: Succeeded. 2023-10-18T21:03:49.487 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:49 smithi060 systemd[1]: Stopped Ceph osd.5 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T21:03:49.876 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:48.200334+0000 mgr.smithi008.flmjzp (mgr.14640) 273 : cluster [DBG] pgmap v196: 65 pgs: 13 stale+active+clean, 52 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T21:03:49.877 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:49 smithi060 systemd[1]: Starting Ceph osd.5 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7... 2023-10-18T21:03:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:48.200334+0000 mgr.smithi008.flmjzp (mgr.14640) 273 : cluster [DBG] pgmap v196: 65 pgs: 13 stale+active+clean, 52 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-10-18T21:03:50.987 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:50 smithi060 bash[136426]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-18T21:03:50.987 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:50 smithi060 bash[136426]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-10-18T21:03:50.988 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:50 smithi060 bash[136426]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-10-18T21:03:50.988 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:50 smithi060 bash[136426]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-10-18T21:03:50.988 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:50 smithi060 bash[136426]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-10-18T21:03:50.988 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:50 smithi060 bash[136426]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-18T21:03:50.988 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:50 smithi060 bash[136426]: --> ceph-volume raw activate successful for osd ID: 5 2023-10-18T21:03:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:50.200879+0000 mgr.smithi008.flmjzp (mgr.14640) 274 : cluster [DBG] pgmap v198: 65 pgs: 3 active+undersized+degraded, 10 peering, 6 stale+active+clean, 4 active+undersized, 42 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 9/369 objects degraded (2.439%) 2023-10-18T21:03:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:50.571818+0000 mon.smithi008 (mon.0) 458 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:50.877803+0000 mon.smithi008 (mon.0) 459 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-10-18T21:03:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:50.877859+0000 mon.smithi008 (mon.0) 460 : cluster [WRN] Health check failed: Degraded data redundancy: 9/369 objects degraded (2.439%), 3 pgs degraded (PG_DEGRADED) 2023-10-18T21:03:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:50.200879+0000 mgr.smithi008.flmjzp (mgr.14640) 274 : cluster [DBG] pgmap v198: 65 pgs: 3 active+undersized+degraded, 10 peering, 6 stale+active+clean, 4 active+undersized, 42 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 9/369 objects degraded (2.439%) 2023-10-18T21:03:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:50.571818+0000 mon.smithi008 (mon.0) 458 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:50.877803+0000 mon.smithi008 (mon.0) 459 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-10-18T21:03:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:50.877859+0000 mon.smithi008 (mon.0) 460 : cluster [WRN] Health check failed: Degraded data redundancy: 9/369 objects degraded (2.439%), 3 pgs degraded (PG_DEGRADED) 2023-10-18T21:03:51.988 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:51 smithi060 bash[136697]: 6fcd3d85329066ec3298532409158577c366e9856cce6fba556b7cdeae9a1543 2023-10-18T21:03:51.988 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-5[136712]: debug 2023-10-18T21:03:51.666+0000 7f78cc658700 1 -- 172.21.15.60:0/567140195 <== mon.1 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5633ed1e2680 con 0x5633ed1a9000 2023-10-18T21:03:51.989 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:51 smithi060 systemd[1]: Started Ceph osd.5 for e1aaa62c-6df7-11ee-8db6-212e2dc638e7. 2023-10-18T21:03:52.487 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-5[136712]: debug 2023-10-18T21:03:52.191+0000 7f78d40d3200 -1 Falling back to public interface 2023-10-18T21:03:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:51.744768+0000 mon.smithi008 (mon.0) 461 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:51.745793+0000 mon.smithi008 (mon.0) 462 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:52.201520+0000 mgr.smithi008.flmjzp (mgr.14640) 275 : cluster [DBG] pgmap v199: 65 pgs: 8 active+undersized+degraded, 10 peering, 10 active+undersized, 37 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24/369 objects degraded (6.504%) 2023-10-18T21:03:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:51.744768+0000 mon.smithi008 (mon.0) 461 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:51.745793+0000 mon.smithi008 (mon.0) 462 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:52.201520+0000 mgr.smithi008.flmjzp (mgr.14640) 275 : cluster [DBG] pgmap v199: 65 pgs: 8 active+undersized+degraded, 10 peering, 10 active+undersized, 37 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24/369 objects degraded (6.504%) 2023-10-18T21:03:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:54.253125+0000 mon.smithi008 (mon.0) 463 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-10-18T21:03:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:54.253125+0000 mon.smithi008 (mon.0) 463 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-10-18T21:03:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:54.202054+0000 mgr.smithi008.flmjzp (mgr.14640) 276 : cluster [DBG] pgmap v200: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/369 objects degraded (15.989%) 2023-10-18T21:03:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.592581+0000 mon.smithi008 (mon.0) 464 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.593694+0000 mon.smithi008 (mon.0) 465 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.594813+0000 mon.smithi008 (mon.0) 466 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:03:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:54.595725+0000 mgr.smithi008.flmjzp (mgr.14640) 277 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:03:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.599846+0000 mon.smithi008 (mon.0) 467 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:55.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.606557+0000 mon.smithi008 (mon.0) 468 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:55.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.609653+0000 mon.smithi008 (mon.0) 469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:55.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.611273+0000 mon.smithi008 (mon.0) 470 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:55.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.612795+0000 mon.smithi008 (mon.0) 471 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:55.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.614782+0000 mon.smithi008 (mon.0) 472 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:55.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:54.615592+0000 mgr.smithi008.flmjzp (mgr.14640) 278 : cephadm [INF] Upgrade: Setting container_image for all osd 2023-10-18T21:03:55.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.620791+0000 mon.smithi008 (mon.0) 473 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:55.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.621747+0000 mon.smithi008 (mon.0) 474 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-10-18T21:03:55.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.626017+0000 mon.smithi008 (mon.0) 475 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-10-18T21:03:55.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.626898+0000 mon.smithi008 (mon.0) 476 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-10-18T21:03:55.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.630698+0000 mon.smithi008 (mon.0) 477 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-10-18T21:03:55.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.631533+0000 mon.smithi008 (mon.0) 478 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-10-18T21:03:55.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.635297+0000 mon.smithi008 (mon.0) 479 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-10-18T21:03:55.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.636123+0000 mon.smithi008 (mon.0) 480 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-10-18T21:03:55.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.640156+0000 mon.smithi008 (mon.0) 481 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-10-18T21:03:55.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.640987+0000 mon.smithi008 (mon.0) 482 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-10-18T21:03:55.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.645432+0000 mon.smithi008 (mon.0) 483 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-10-18T21:03:55.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.646235+0000 mon.smithi008 (mon.0) 484 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-10-18T21:03:55.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.650169+0000 mon.smithi008 (mon.0) 485 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-10-18T21:03:55.927 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.655523+0000 mon.smithi008 (mon.0) 486 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:55.927 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:54.656001+0000 mon.smithi008 (mon.0) 487 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2023-10-18T21:03:55.927 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:54.659936+0000 mon.smithi008 (mon.0) 488 : cluster [DBG] osdmap e80: 6 total, 5 up, 6 in 2023-10-18T21:03:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:54.202054+0000 mgr.smithi008.flmjzp (mgr.14640) 276 : cluster [DBG] pgmap v200: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/369 objects degraded (15.989%) 2023-10-18T21:03:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.592581+0000 mon.smithi008 (mon.0) 464 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:55.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.593694+0000 mon.smithi008 (mon.0) 465 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:55.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.594813+0000 mon.smithi008 (mon.0) 466 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:03:55.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:54.595725+0000 mgr.smithi008.flmjzp (mgr.14640) 277 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:03:55.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.599846+0000 mon.smithi008 (mon.0) 467 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:55.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.606557+0000 mon.smithi008 (mon.0) 468 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:55.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.609653+0000 mon.smithi008 (mon.0) 469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:55.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.611273+0000 mon.smithi008 (mon.0) 470 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:55.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.612795+0000 mon.smithi008 (mon.0) 471 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:55.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.614782+0000 mon.smithi008 (mon.0) 472 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:55.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:54.615592+0000 mgr.smithi008.flmjzp (mgr.14640) 278 : cephadm [INF] Upgrade: Setting container_image for all osd 2023-10-18T21:03:55.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.620791+0000 mon.smithi008 (mon.0) 473 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:55.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.621747+0000 mon.smithi008 (mon.0) 474 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-10-18T21:03:55.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.626017+0000 mon.smithi008 (mon.0) 475 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-10-18T21:03:55.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.626898+0000 mon.smithi008 (mon.0) 476 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-10-18T21:03:55.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.630698+0000 mon.smithi008 (mon.0) 477 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-10-18T21:03:55.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.631533+0000 mon.smithi008 (mon.0) 478 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-10-18T21:03:55.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.635297+0000 mon.smithi008 (mon.0) 479 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-10-18T21:03:55.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.636123+0000 mon.smithi008 (mon.0) 480 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-10-18T21:03:55.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.640156+0000 mon.smithi008 (mon.0) 481 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-10-18T21:03:55.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.640987+0000 mon.smithi008 (mon.0) 482 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-10-18T21:03:55.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.645432+0000 mon.smithi008 (mon.0) 483 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-10-18T21:03:55.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.646235+0000 mon.smithi008 (mon.0) 484 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-10-18T21:03:55.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.650169+0000 mon.smithi008 (mon.0) 485 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-10-18T21:03:55.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.655523+0000 mon.smithi008 (mon.0) 486 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:55.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:54.656001+0000 mon.smithi008 (mon.0) 487 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2023-10-18T21:03:55.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:54.659936+0000 mon.smithi008 (mon.0) 488 : cluster [DBG] osdmap e80: 6 total, 5 up, 6 in 2023-10-18T21:03:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:54.651852+0000 mgr.smithi008.flmjzp (mgr.14640) 279 : cephadm [INF] Upgrade: Disabling standby-replay for filesystem cephfs 2023-10-18T21:03:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:55.654227+0000 mon.smithi008 (mon.0) 489 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-10-18T21:03:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.659383+0000 mon.smithi008 (mon.0) 490 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2023-10-18T21:03:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:55.659518+0000 mon.smithi008 (mon.0) 491 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2023-10-18T21:03:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.660611+0000 mon.smithi008 (mon.0) 492 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.662542+0000 mon.smithi008 (mon.0) 493 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:56.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.663587+0000 mon.smithi008 (mon.0) 494 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:03:56.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.670373+0000 mon.smithi008 (mon.0) 495 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:56.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.676782+0000 mon.smithi008 (mon.0) 496 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:56.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.679888+0000 mon.smithi008 (mon.0) 497 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:56.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.681537+0000 mon.smithi008 (mon.0) 498 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:56.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.683055+0000 mon.smithi008 (mon.0) 499 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:56.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.685071+0000 mon.smithi008 (mon.0) 500 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:56.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.690767+0000 mon.smithi008 (mon.0) 501 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:56.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:55.691370+0000 mon.smithi008 (mon.0) 502 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-10-18T21:03:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:54.651852+0000 mgr.smithi008.flmjzp (mgr.14640) 279 : cephadm [INF] Upgrade: Disabling standby-replay for filesystem cephfs 2023-10-18T21:03:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:55.654227+0000 mon.smithi008 (mon.0) 489 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-10-18T21:03:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.659383+0000 mon.smithi008 (mon.0) 490 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2023-10-18T21:03:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:55.659518+0000 mon.smithi008 (mon.0) 491 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2023-10-18T21:03:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.660611+0000 mon.smithi008 (mon.0) 492 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.662542+0000 mon.smithi008 (mon.0) 493 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:56.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.663587+0000 mon.smithi008 (mon.0) 494 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:03:56.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.670373+0000 mon.smithi008 (mon.0) 495 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:56.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.676782+0000 mon.smithi008 (mon.0) 496 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:56.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.679888+0000 mon.smithi008 (mon.0) 497 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:56.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.681537+0000 mon.smithi008 (mon.0) 498 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:56.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.683055+0000 mon.smithi008 (mon.0) 499 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:56.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.685071+0000 mon.smithi008 (mon.0) 500 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:56.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.690767+0000 mon.smithi008 (mon.0) 501 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:56.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:55.691370+0000 mon.smithi008 (mon.0) 502 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-10-18T21:03:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:55.664537+0000 mgr.smithi008.flmjzp (mgr.14640) 280 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:03:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:55.686837+0000 mgr.smithi008.flmjzp (mgr.14640) 281 : cephadm [INF] Upgrade: Scaling down filesystem cephfs 2023-10-18T21:03:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:56.202631+0000 mgr.smithi008.flmjzp (mgr.14640) 282 : cluster [DBG] pgmap v202: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/369 objects degraded (15.989%) 2023-10-18T21:03:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:56.689336+0000 mon.smithi008 (mon.0) 503 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-10-18T21:03:57.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.696277+0000 mon.smithi008 (mon.0) 504 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-10-18T21:03:57.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:56.696353+0000 mon.smithi008 (mon.0) 505 : cluster [DBG] mds.? [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] up:boot 2023-10-18T21:03:57.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:56.696424+0000 mon.smithi008 (mon.0) 506 : cluster [DBG] mds.? [v2:172.21.15.8:6828/460576416,v1:172.21.15.8:6829/460576416] up:boot 2023-10-18T21:03:57.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:56.696518+0000 mon.smithi008 (mon.0) 507 : cluster [INF] stopping daemon mds.cephfs.smithi060.grdzlm 2023-10-18T21:03:57.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:56.696908+0000 mon.smithi008 (mon.0) 508 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby 2023-10-18T21:03:57.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.697091+0000 mon.smithi008 (mon.0) 509 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:03:57.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.697853+0000 mon.smithi008 (mon.0) 510 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:03:57.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:56.700228+0000 mon.smithi008 (mon.0) 511 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:stopping} 2 up:standby 2023-10-18T21:03:57.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.701695+0000 mon.smithi008 (mon.0) 512 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:57.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.703852+0000 mon.smithi008 (mon.0) 513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:57.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.705107+0000 mon.smithi008 (mon.0) 514 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:03:57.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.710538+0000 mon.smithi008 (mon.0) 515 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:57.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.716646+0000 mon.smithi008 (mon.0) 516 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:57.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.719527+0000 mon.smithi008 (mon.0) 517 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:57.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.721152+0000 mon.smithi008 (mon.0) 518 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:57.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.722650+0000 mon.smithi008 (mon.0) 519 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:57.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:56.724577+0000 mon.smithi008 (mon.0) 520 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:55.664537+0000 mgr.smithi008.flmjzp (mgr.14640) 280 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:03:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:55.686837+0000 mgr.smithi008.flmjzp (mgr.14640) 281 : cephadm [INF] Upgrade: Scaling down filesystem cephfs 2023-10-18T21:03:57.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:56.202631+0000 mgr.smithi008.flmjzp (mgr.14640) 282 : cluster [DBG] pgmap v202: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/369 objects degraded (15.989%) 2023-10-18T21:03:57.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:56.689336+0000 mon.smithi008 (mon.0) 503 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-10-18T21:03:57.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.696277+0000 mon.smithi008 (mon.0) 504 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-10-18T21:03:57.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:56.696353+0000 mon.smithi008 (mon.0) 505 : cluster [DBG] mds.? [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] up:boot 2023-10-18T21:03:57.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:56.696424+0000 mon.smithi008 (mon.0) 506 : cluster [DBG] mds.? [v2:172.21.15.8:6828/460576416,v1:172.21.15.8:6829/460576416] up:boot 2023-10-18T21:03:57.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:56.696518+0000 mon.smithi008 (mon.0) 507 : cluster [INF] stopping daemon mds.cephfs.smithi060.grdzlm 2023-10-18T21:03:57.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:56.696908+0000 mon.smithi008 (mon.0) 508 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:active} 2 up:standby 2023-10-18T21:03:57.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.697091+0000 mon.smithi008 (mon.0) 509 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:03:57.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.697853+0000 mon.smithi008 (mon.0) 510 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:03:57.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:56.700228+0000 mon.smithi008 (mon.0) 511 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi008.lehgco=up:active,1=cephfs.smithi060.grdzlm=up:stopping} 2 up:standby 2023-10-18T21:03:57.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.701695+0000 mon.smithi008 (mon.0) 512 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:57.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.703852+0000 mon.smithi008 (mon.0) 513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:03:57.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.705107+0000 mon.smithi008 (mon.0) 514 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:03:57.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.710538+0000 mon.smithi008 (mon.0) 515 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:03:57.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.716646+0000 mon.smithi008 (mon.0) 516 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:03:57.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.719527+0000 mon.smithi008 (mon.0) 517 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:57.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.721152+0000 mon.smithi008 (mon.0) 518 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:57.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.722650+0000 mon.smithi008 (mon.0) 519 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:57.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:56.724577+0000 mon.smithi008 (mon.0) 520 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:03:58.737 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-5[136712]: debug 2023-10-18T21:03:58.460+0000 7f78d40d3200 -1 osd.5 77 log_to_monitors {default=true} 2023-10-18T21:03:58.737 INFO:journalctl@ceph.osd.5.smithi060.stdout:Oct 18 21:03:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-osd-5[136712]: debug 2023-10-18T21:03:58.614+0000 7f78c35c9700 -1 osd.5 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T21:03:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:56.705984+0000 mgr.smithi008.flmjzp (mgr.14640) 283 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:03:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:03:56.726254+0000 mgr.smithi008.flmjzp (mgr.14640) 284 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2023-10-18T21:03:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:58.467071+0000 mon.smithi060 (mon.1) 7 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/1086439909,v1:172.21.15.60:6817/1086439909]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T21:03:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:58.467684+0000 mon.smithi008 (mon.0) 521 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T21:03:58.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:56.705984+0000 mgr.smithi008.flmjzp (mgr.14640) 283 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:03:58.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:03:56.726254+0000 mgr.smithi008.flmjzp (mgr.14640) 284 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2023-10-18T21:03:58.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:58.467071+0000 mon.smithi060 (mon.1) 7 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/1086439909,v1:172.21.15.60:6817/1086439909]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T21:03:58.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:58.467684+0000 mon.smithi008 (mon.0) 521 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T21:03:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:58.203228+0000 mgr.smithi008.flmjzp (mgr.14640) 285 : cluster [DBG] pgmap v203: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/369 objects degraded (15.989%) 2023-10-18T21:03:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:58.607018+0000 mon.smithi008 (mon.0) 522 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-18T21:03:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:58.607124+0000 mon.smithi008 (mon.0) 523 : cluster [DBG] osdmap e81: 6 total, 5 up, 6 in 2023-10-18T21:03:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:58.607759+0000 mon.smithi060 (mon.1) 8 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/1086439909,v1:172.21.15.60:6817/1086439909]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:03:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:58.608308+0000 mon.smithi008 (mon.0) 524 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:03:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:58.203228+0000 mgr.smithi008.flmjzp (mgr.14640) 285 : cluster [DBG] pgmap v203: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 327 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/369 objects degraded (15.989%) 2023-10-18T21:03:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:58.607018+0000 mon.smithi008 (mon.0) 522 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-18T21:03:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:58.607124+0000 mon.smithi008 (mon.0) 523 : cluster [DBG] osdmap e81: 6 total, 5 up, 6 in 2023-10-18T21:03:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:58.607759+0000 mon.smithi060 (mon.1) 8 : audit [INF] from='osd.5 [v2:172.21.15.60:6816/1086439909,v1:172.21.15.60:6817/1086439909]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:03:59.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:58.608308+0000 mon.smithi008 (mon.0) 524 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-18T21:04:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:59.603562+0000 mon.smithi008 (mon.0) 525 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T21:04:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:59.609435+0000 mon.smithi008 (mon.0) 526 : cluster [INF] osd.5 [v2:172.21.15.60:6816/1086439909,v1:172.21.15.60:6817/1086439909] boot 2023-10-18T21:04:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:59.609520+0000 mon.smithi008 (mon.0) 527 : cluster [DBG] osdmap e82: 6 total, 6 up, 6 in 2023-10-18T21:04:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:03:59.611011+0000 mon.smithi008 (mon.0) 528 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T21:04:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:03:59.877765+0000 mon.smithi008 (mon.0) 529 : cluster [WRN] Health check update: Degraded data redundancy: 59/369 objects degraded (15.989%), 14 pgs degraded (PG_DEGRADED) 2023-10-18T21:04:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:00.446813+0000 mon.smithi008 (mon.0) 530 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:00.582186+0000 mon.smithi008 (mon.0) 531 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:00.610640+0000 mon.smithi008 (mon.0) 532 : cluster [DBG] osdmap e83: 6 total, 6 up, 6 in 2023-10-18T21:04:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:59.603562+0000 mon.smithi008 (mon.0) 525 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T21:04:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:59.609435+0000 mon.smithi008 (mon.0) 526 : cluster [INF] osd.5 [v2:172.21.15.60:6816/1086439909,v1:172.21.15.60:6817/1086439909] boot 2023-10-18T21:04:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:59.609520+0000 mon.smithi008 (mon.0) 527 : cluster [DBG] osdmap e82: 6 total, 6 up, 6 in 2023-10-18T21:04:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:03:59.611011+0000 mon.smithi008 (mon.0) 528 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T21:04:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:03:59.877765+0000 mon.smithi008 (mon.0) 529 : cluster [WRN] Health check update: Degraded data redundancy: 59/369 objects degraded (15.989%), 14 pgs degraded (PG_DEGRADED) 2023-10-18T21:04:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:00.446813+0000 mon.smithi008 (mon.0) 530 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:00.582186+0000 mon.smithi008 (mon.0) 531 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:00.610640+0000 mon.smithi008 (mon.0) 532 : cluster [DBG] osdmap e83: 6 total, 6 up, 6 in 2023-10-18T21:04:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:00.203838+0000 mgr.smithi008.flmjzp (mgr.14640) 286 : cluster [DBG] pgmap v206: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 59/369 objects degraded (15.989%) 2023-10-18T21:04:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:00.203838+0000 mgr.smithi008.flmjzp (mgr.14640) 286 : cluster [DBG] pgmap v206: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 59/369 objects degraded (15.989%) 2023-10-18T21:04:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:02.204427+0000 mgr.smithi008.flmjzp (mgr.14640) 287 : cluster [DBG] pgmap v208: 65 pgs: 2 peering, 12 active+undersized+degraded, 11 active+undersized, 40 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 682 B/s wr, 2 op/s; 53/369 objects degraded (14.363%) 2023-10-18T21:04:03.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:02.204427+0000 mgr.smithi008.flmjzp (mgr.14640) 287 : cluster [DBG] pgmap v208: 65 pgs: 2 peering, 12 active+undersized+degraded, 11 active+undersized, 40 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 682 B/s wr, 2 op/s; 53/369 objects degraded (14.363%) 2023-10-18T21:04:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.124+0000 7f52c24ce700 1 -- 172.21.15.8:0/3988264877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52bc0f8740 msgr2=0x7f52bc0f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.124+0000 7f52c24ce700 1 --2- 172.21.15.8:0/3988264877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52bc0f8740 0x7f52bc0f8b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f52b8004660 tx=0x7f52b8009b30).stop 2023-10-18T21:04:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.124+0000 7f52c24ce700 1 -- 172.21.15.8:0/3988264877 shutdown_connections 2023-10-18T21:04:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.124+0000 7f52c24ce700 1 --2- 172.21.15.8:0/3988264877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52bc0f99e0 0x7f52bc0f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.124+0000 7f52c24ce700 1 --2- 172.21.15.8:0/3988264877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52bc0f8740 0x7f52bc0f8b60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.124+0000 7f52c24ce700 1 -- 172.21.15.8:0/3988264877 >> 172.21.15.8:0/3988264877 conn(0x7f52bc0f40e0 msgr2=0x7f52bc0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:05.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.124+0000 7f52c24ce700 1 -- 172.21.15.8:0/3988264877 shutdown_connections 2023-10-18T21:04:05.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.124+0000 7f52c24ce700 1 -- 172.21.15.8:0/3988264877 wait complete. 2023-10-18T21:04:05.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.125+0000 7f52c24ce700 1 Processor -- start 2023-10-18T21:04:05.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.125+0000 7f52c24ce700 1 -- start start 2023-10-18T21:04:05.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.126+0000 7f52c24ce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52bc0f8740 0x7f52bc108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:05.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.126+0000 7f52c24ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52bc0f99e0 0x7f52bc1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:05.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.126+0000 7f52c24ce700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc109a60 con 0x7f52bc0f8740 2023-10-18T21:04:05.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.126+0000 7f52c24ce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc109ba0 con 0x7f52bc0f99e0 2023-10-18T21:04:05.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.126+0000 7f52c14cc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52bc0f8740 0x7f52bc108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:05.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.126+0000 7f52c14cc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52bc0f8740 0x7f52bc108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58616/0 (socket says 172.21.15.8:58616) 2023-10-18T21:04:05.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.126+0000 7f52c14cc700 1 -- 172.21.15.8:0/2304381002 learned_addr learned my addr 172.21.15.8:0/2304381002 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:05.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.126+0000 7f52c0ccb700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52bc0f99e0 0x7f52bc1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:05.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.127+0000 7f52c14cc700 1 -- 172.21.15.8:0/2304381002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52bc0f99e0 msgr2=0x7f52bc1094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:05.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.127+0000 7f52c14cc700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52bc0f99e0 0x7f52bc1094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.127+0000 7f52c14cc700 1 -- 172.21.15.8:0/2304381002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8005040 con 0x7f52bc0f8740 2023-10-18T21:04:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.127+0000 7f52c14cc700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52bc0f8740 0x7f52bc108fc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f52b8007a70 tx=0x7f52b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.127+0000 7f52b1ffb700 1 -- 172.21.15.8:0/2304381002 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b8018070 con 0x7f52bc0f8740 2023-10-18T21:04:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.127+0000 7f52b1ffb700 1 -- 172.21.15.8:0/2304381002 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f52b801d8e0 con 0x7f52bc0f8740 2023-10-18T21:04:05.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.127+0000 7f52b1ffb700 1 -- 172.21.15.8:0/2304381002 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b801c5c0 con 0x7f52bc0f8740 2023-10-18T21:04:05.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.127+0000 7f52c24ce700 1 -- 172.21.15.8:0/2304381002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc10a4e0 con 0x7f52bc0f8740 2023-10-18T21:04:05.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.127+0000 7f52c24ce700 1 -- 172.21.15.8:0/2304381002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc10a9f0 con 0x7f52bc0f8740 2023-10-18T21:04:05.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.128+0000 7f52c24ce700 1 -- 172.21.15.8:0/2304381002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc045ad0 con 0x7f52bc0f8740 2023-10-18T21:04:05.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.129+0000 7f52b1ffb700 1 -- 172.21.15.8:0/2304381002 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f52b801da50 con 0x7f52bc0f8740 2023-10-18T21:04:05.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.130+0000 7f52b1ffb700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52a8060f70 0x7f52a8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:05.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.130+0000 7f52b1ffb700 1 -- 172.21.15.8:0/2304381002 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f52b807e070 con 0x7f52bc0f8740 2023-10-18T21:04:05.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.130+0000 7f52c0ccb700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52a8060f70 0x7f52a8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:05.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.131+0000 7f52c0ccb700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52a8060f70 0x7f52a8063430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f52ac007fd0 tx=0x7f52ac009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:05.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.135+0000 7f52b1ffb700 1 -- 172.21.15.8:0/2304381002 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f52b8051f20 con 0x7f52bc0f8740 2023-10-18T21:04:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.334+0000 7f52c24ce700 1 -- 172.21.15.8:0/2304381002 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52bc100f40 con 0x7f52a8060f70 2023-10-18T21:04:05.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.335+0000 7f52b1ffb700 1 -- 172.21.15.8:0/2304381002 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f52bc100f40 con 0x7f52a8060f70 2023-10-18T21:04:05.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 -- 172.21.15.8:0/2304381002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52a8060f70 msgr2=0x7f52a8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:05.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52a8060f70 0x7f52a8063430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f52ac007fd0 tx=0x7f52ac009040).stop 2023-10-18T21:04:05.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 -- 172.21.15.8:0/2304381002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52bc0f8740 msgr2=0x7f52bc108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:05.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52bc0f8740 0x7f52bc108fc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f52b8007a70 tx=0x7f52b8009b30).stop 2023-10-18T21:04:05.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 -- 172.21.15.8:0/2304381002 shutdown_connections 2023-10-18T21:04:05.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52a8060f70 0x7f52a8063430 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52bc0f8740 0x7f52bc108fc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 --2- 172.21.15.8:0/2304381002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52bc0f99e0 0x7f52bc1094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 -- 172.21.15.8:0/2304381002 >> 172.21.15.8:0/2304381002 conn(0x7f52bc0f40e0 msgr2=0x7f52bc0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 -- 172.21.15.8:0/2304381002 shutdown_connections 2023-10-18T21:04:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.337+0000 7f52c24ce700 1 -- 172.21.15.8:0/2304381002 wait complete. 2023-10-18T21:04:05.353 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:04:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.474+0000 7fa215117700 1 -- 172.21.15.8:0/4132343528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2100f6530 msgr2=0x7fa2100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.474+0000 7fa215117700 1 --2- 172.21.15.8:0/4132343528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2100f6530 0x7fa2100f6950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fa200004660 tx=0x7fa200009b30).stop 2023-10-18T21:04:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.474+0000 7fa215117700 1 -- 172.21.15.8:0/4132343528 shutdown_connections 2023-10-18T21:04:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.474+0000 7fa215117700 1 --2- 172.21.15.8:0/4132343528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2100f77d0 0x7fa2100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.474+0000 7fa215117700 1 --2- 172.21.15.8:0/4132343528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2100f6530 0x7fa2100f6950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.474+0000 7fa215117700 1 -- 172.21.15.8:0/4132343528 >> 172.21.15.8:0/4132343528 conn(0x7fa2100f1c90 msgr2=0x7fa2100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:05.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.474+0000 7fa215117700 1 -- 172.21.15.8:0/4132343528 shutdown_connections 2023-10-18T21:04:05.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.474+0000 7fa215117700 1 -- 172.21.15.8:0/4132343528 wait complete. 2023-10-18T21:04:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.475+0000 7fa215117700 1 Processor -- start 2023-10-18T21:04:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.475+0000 7fa215117700 1 -- start start 2023-10-18T21:04:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.475+0000 7fa215117700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2100f6530 0x7fa210108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.475+0000 7fa215117700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2100f77d0 0x7fa210109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.475+0000 7fa215117700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa210109a00 con 0x7fa2100f77d0 2023-10-18T21:04:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.475+0000 7fa215117700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa210109b40 con 0x7fa2100f6530 2023-10-18T21:04:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.475+0000 7fa20f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2100f77d0 0x7fa210109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.475+0000 7fa20f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2100f77d0 0x7fa210109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58642/0 (socket says 172.21.15.8:58642) 2023-10-18T21:04:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.475+0000 7fa20f7fe700 1 -- 172.21.15.8:0/4136786118 learned_addr learned my addr 172.21.15.8:0/4136786118 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.475+0000 7fa20ffff700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2100f6530 0x7fa210108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.476+0000 7fa20f7fe700 1 -- 172.21.15.8:0/4136786118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2100f6530 msgr2=0x7fa210108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.476+0000 7fa20f7fe700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2100f6530 0x7fa210108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.476+0000 7fa20f7fe700 1 -- 172.21.15.8:0/4136786118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200005040 con 0x7fa2100f77d0 2023-10-18T21:04:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.476+0000 7fa20f7fe700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2100f77d0 0x7fa210109450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa20400e7f0 tx=0x7fa20400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.476+0000 7fa20cff9700 1 -- 172.21.15.8:0/4136786118 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2040092e0 con 0x7fa2100f77d0 2023-10-18T21:04:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.476+0000 7fa20cff9700 1 -- 172.21.15.8:0/4136786118 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa20400f040 con 0x7fa2100f77d0 2023-10-18T21:04:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.476+0000 7fa215117700 1 -- 172.21.15.8:0/4136786118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21010a4e0 con 0x7fa2100f77d0 2023-10-18T21:04:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.476+0000 7fa20cff9700 1 -- 172.21.15.8:0/4136786118 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2040147e0 con 0x7fa2100f77d0 2023-10-18T21:04:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.476+0000 7fa215117700 1 -- 172.21.15.8:0/4136786118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21010aa20 con 0x7fa2100f77d0 2023-10-18T21:04:05.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.478+0000 7fa215117700 1 -- 172.21.15.8:0/4136786118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa210045ad0 con 0x7fa2100f77d0 2023-10-18T21:04:05.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.478+0000 7fa20cff9700 1 -- 172.21.15.8:0/4136786118 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa20401b030 con 0x7fa2100f77d0 2023-10-18T21:04:05.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.480+0000 7fa20cff9700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1f8060f70 0x7fa1f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:05.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.480+0000 7fa20cff9700 1 -- 172.21.15.8:0/4136786118 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa20407bea0 con 0x7fa2100f77d0 2023-10-18T21:04:05.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.480+0000 7fa20ffff700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1f8060f70 0x7fa1f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:05.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.481+0000 7fa20ffff700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1f8060f70 0x7fa1f8063430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa200005010 tx=0x7fa200016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:05.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.485+0000 7fa20cff9700 1 -- 172.21.15.8:0/4136786118 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa20404fd40 con 0x7fa2100f77d0 2023-10-18T21:04:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:04.205087+0000 mgr.smithi008.flmjzp (mgr.14640) 288 : cluster [DBG] pgmap v209: 65 pgs: 2 peering, 2 active+undersized+degraded, 1 active+undersized, 60 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 4/369 objects degraded (1.084%); 14 B/s, 0 objects/s recovering 2023-10-18T21:04:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:04.879076+0000 mon.smithi008 (mon.0) 533 : cluster [WRN] Health check update: Degraded data redundancy: 4/369 objects degraded (1.084%), 2 pgs degraded (PG_DEGRADED) 2023-10-18T21:04:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.684+0000 7fa215117700 1 -- 172.21.15.8:0/4136786118 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa21010ac90 con 0x7fa1f8060f70 2023-10-18T21:04:05.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.685+0000 7fa20cff9700 1 -- 172.21.15.8:0/4136786118 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa21010ac90 con 0x7fa1f8060f70 2023-10-18T21:04:05.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.687+0000 7fa215117700 1 -- 172.21.15.8:0/4136786118 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1f8060f70 msgr2=0x7fa1f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:05.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.687+0000 7fa215117700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1f8060f70 0x7fa1f8063430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa200005010 tx=0x7fa200016040).stop 2023-10-18T21:04:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.687+0000 7fa215117700 1 -- 172.21.15.8:0/4136786118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2100f77d0 msgr2=0x7fa210109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.687+0000 7fa215117700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2100f77d0 0x7fa210109450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa20400e7f0 tx=0x7fa20400b040).stop 2023-10-18T21:04:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.688+0000 7fa215117700 1 -- 172.21.15.8:0/4136786118 shutdown_connections 2023-10-18T21:04:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.688+0000 7fa215117700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1f8060f70 0x7fa1f8063430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.688+0000 7fa215117700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2100f6530 0x7fa210108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.688+0000 7fa215117700 1 --2- 172.21.15.8:0/4136786118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2100f77d0 0x7fa210109450 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.688+0000 7fa215117700 1 -- 172.21.15.8:0/4136786118 >> 172.21.15.8:0/4136786118 conn(0x7fa2100f1c90 msgr2=0x7fa21006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.688+0000 7fa215117700 1 -- 172.21.15.8:0/4136786118 shutdown_connections 2023-10-18T21:04:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.688+0000 7fa215117700 1 -- 172.21.15.8:0/4136786118 wait complete. 2023-10-18T21:04:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:04.205087+0000 mgr.smithi008.flmjzp (mgr.14640) 288 : cluster [DBG] pgmap v209: 65 pgs: 2 peering, 2 active+undersized+degraded, 1 active+undersized, 60 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 4/369 objects degraded (1.084%); 14 B/s, 0 objects/s recovering 2023-10-18T21:04:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:04.879076+0000 mon.smithi008 (mon.0) 533 : cluster [WRN] Health check update: Degraded data redundancy: 4/369 objects degraded (1.084%), 2 pgs degraded (PG_DEGRADED) 2023-10-18T21:04:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.823+0000 7f8603fff700 1 -- 172.21.15.8:0/479914877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860406b960 msgr2=0x7f8604069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.823+0000 7f8603fff700 1 --2- 172.21.15.8:0/479914877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860406b960 0x7f8604069e60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f85f4004660 tx=0x7f85f4009b30).stop 2023-10-18T21:04:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.823+0000 7f8603fff700 1 -- 172.21.15.8:0/479914877 shutdown_connections 2023-10-18T21:04:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.823+0000 7f8603fff700 1 --2- 172.21.15.8:0/479914877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860406a350 0x7f860406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.823+0000 7f8603fff700 1 --2- 172.21.15.8:0/479914877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860406b960 0x7f8604069e60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.823+0000 7f8603fff700 1 -- 172.21.15.8:0/479914877 >> 172.21.15.8:0/479914877 conn(0x7f86040f1c90 msgr2=0x7f86040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.823+0000 7f8603fff700 1 -- 172.21.15.8:0/479914877 shutdown_connections 2023-10-18T21:04:05.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.823+0000 7f8603fff700 1 -- 172.21.15.8:0/479914877 wait complete. 2023-10-18T21:04:05.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.824+0000 7f8603fff700 1 Processor -- start 2023-10-18T21:04:05.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.824+0000 7f8603fff700 1 -- start start 2023-10-18T21:04:05.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.824+0000 7f8603fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860406a350 0x7f8604108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:05.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.824+0000 7f8603fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860406b960 0x7f86041093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:05.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.824+0000 7f8603fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86041099a0 con 0x7f860406b960 2023-10-18T21:04:05.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.824+0000 7f8603fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604109ae0 con 0x7f860406a350 2023-10-18T21:04:05.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.825+0000 7f86027fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860406b960 0x7f86041093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.825+0000 7f86027fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860406b960 0x7f86041093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58674/0 (socket says 172.21.15.8:58674) 2023-10-18T21:04:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.825+0000 7f86027fc700 1 -- 172.21.15.8:0/4047187674 learned_addr learned my addr 172.21.15.8:0/4047187674 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.825+0000 7f8602ffd700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860406a350 0x7f8604108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.825+0000 7f86027fc700 1 -- 172.21.15.8:0/4047187674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860406a350 msgr2=0x7f8604108f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.825+0000 7f86027fc700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860406a350 0x7f8604108f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:05.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.825+0000 7f86027fc700 1 -- 172.21.15.8:0/4047187674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4005040 con 0x7f860406b960 2023-10-18T21:04:05.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.825+0000 7f86027fc700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860406b960 0x7f86041093f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f85f800e7f0 tx=0x7f85f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:05.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.826+0000 7f85eb7fe700 1 -- 172.21.15.8:0/4047187674 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f80092e0 con 0x7f860406b960 2023-10-18T21:04:05.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.826+0000 7f8603fff700 1 -- 172.21.15.8:0/4047187674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860410a480 con 0x7f860406b960 2023-10-18T21:04:05.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.826+0000 7f85eb7fe700 1 -- 172.21.15.8:0/4047187674 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f85f800f040 con 0x7f860406b960 2023-10-18T21:04:05.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.826+0000 7f85eb7fe700 1 -- 172.21.15.8:0/4047187674 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f80147e0 con 0x7f860406b960 2023-10-18T21:04:05.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.826+0000 7f8603fff700 1 -- 172.21.15.8:0/4047187674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860410a9c0 con 0x7f860406b960 2023-10-18T21:04:05.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.827+0000 7f8603fff700 1 -- 172.21.15.8:0/4047187674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8604045ad0 con 0x7f860406b960 2023-10-18T21:04:05.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.828+0000 7f85eb7fe700 1 -- 172.21.15.8:0/4047187674 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f85f801b030 con 0x7f860406b960 2023-10-18T21:04:05.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.828+0000 7f85eb7fe700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f85ec060f70 0x7f85ec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:05.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.828+0000 7f85eb7fe700 1 -- 172.21.15.8:0/4047187674 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f85f807bf70 con 0x7f860406b960 2023-10-18T21:04:05.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.829+0000 7f8602ffd700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f85ec060f70 0x7f85ec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:05.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.829+0000 7f8602ffd700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f85ec060f70 0x7f85ec063430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f85f4009720 tx=0x7f85f4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:05.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:05.833+0000 7f85eb7fe700 1 -- 172.21.15.8:0/4047187674 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f85f804fe10 con 0x7f860406b960 2023-10-18T21:04:06.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.023+0000 7f8603fff700 1 -- 172.21.15.8:0/4047187674 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8604100fc0 con 0x7f85ec060f70 2023-10-18T21:04:06.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.033+0000 7f85eb7fe700 1 -- 172.21.15.8:0/4047187674 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8604100fc0 con 0x7f85ec060f70 2023-10-18T21:04:06.035 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:04:06.035 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (10m) 106s ago 12m 15.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:04:06.035 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (4m) 106s ago 12m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:04:06.035 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (4m) 11s ago 11m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:04:06.035 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (10m) 106s ago 11m 25.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:04:06.036 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (8m) 106s ago 8m 7674M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T21:04:06.036 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (8m) 106s ago 8m 919M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T21:04:06.036 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (8m) 11s ago 8m 3802M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:04:06.036 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (8m) 11s ago 8m 478M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:04:06.036 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (5m) 106s ago 13m 451M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:04:06.037 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (5m) 11s ago 11m 396M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:04:06.037 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (5m) 106s ago 13m 91.5M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:04:06.037 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (4m) 11s ago 11m 85.3M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:04:06.037 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (11m) 106s ago 11m 9625k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:04:06.037 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (11m) 11s ago 11m 9.87M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:04:06.037 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (4m) 106s ago 10m 414M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:04:06.038 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (2m) 106s ago 10m 285M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:04:06.038 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (111s) 106s ago 10m 10.7M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:04:06.038 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (82s) 11s ago 9m 340M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:04:06.038 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (41s) 11s ago 9m 305M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:04:06.038 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (14s) 11s ago 9m 10.6M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:04:06.039 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (6m) 106s ago 11m 58.7M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:04:06.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 -- 172.21.15.8:0/4047187674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f85ec060f70 msgr2=0x7f85ec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f85ec060f70 0x7f85ec063430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f85f4009720 tx=0x7f85f4016040).stop 2023-10-18T21:04:06.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 -- 172.21.15.8:0/4047187674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860406b960 msgr2=0x7f86041093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860406b960 0x7f86041093f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f85f800e7f0 tx=0x7f85f800b040).stop 2023-10-18T21:04:06.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 -- 172.21.15.8:0/4047187674 shutdown_connections 2023-10-18T21:04:06.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f85ec060f70 0x7f85ec063430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860406a350 0x7f8604108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 --2- 172.21.15.8:0/4047187674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860406b960 0x7f86041093f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 -- 172.21.15.8:0/4047187674 >> 172.21.15.8:0/4047187674 conn(0x7f86040f1c90 msgr2=0x7f86040fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:06.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 -- 172.21.15.8:0/4047187674 shutdown_connections 2023-10-18T21:04:06.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.035+0000 7f8603fff700 1 -- 172.21.15.8:0/4047187674 wait complete. 2023-10-18T21:04:06.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.171+0000 7f9f5eda2700 1 -- 172.21.15.8:0/478735778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f580f9690 msgr2=0x7f9f580fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.171+0000 7f9f5eda2700 1 --2- 172.21.15.8:0/478735778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f580f9690 0x7f9f580fbae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f9f48004660 tx=0x7f9f48009b30).stop 2023-10-18T21:04:06.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.171+0000 7f9f5eda2700 1 -- 172.21.15.8:0/478735778 shutdown_connections 2023-10-18T21:04:06.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.171+0000 7f9f5eda2700 1 --2- 172.21.15.8:0/478735778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f580f9690 0x7f9f580fbae0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.171+0000 7f9f5eda2700 1 --2- 172.21.15.8:0/478735778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f58060310 0x7f9f580f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.171+0000 7f9f5eda2700 1 -- 172.21.15.8:0/478735778 >> 172.21.15.8:0/478735778 conn(0x7f9f580f0b90 msgr2=0x7f9f580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:06.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.171+0000 7f9f5eda2700 1 -- 172.21.15.8:0/478735778 shutdown_connections 2023-10-18T21:04:06.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.171+0000 7f9f5eda2700 1 -- 172.21.15.8:0/478735778 wait complete. 2023-10-18T21:04:06.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.172+0000 7f9f5eda2700 1 Processor -- start 2023-10-18T21:04:06.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.172+0000 7f9f5eda2700 1 -- start start 2023-10-18T21:04:06.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.172+0000 7f9f5eda2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f58060310 0x7f9f58108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:06.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.172+0000 7f9f5eda2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f580f9690 0x7f9f58109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:06.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.172+0000 7f9f5eda2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f581099b0 con 0x7f9f580f9690 2023-10-18T21:04:06.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.172+0000 7f9f5eda2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f58109af0 con 0x7f9f58060310 2023-10-18T21:04:06.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.172+0000 7f9f5d59f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f580f9690 0x7f9f58109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:06.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.172+0000 7f9f5d59f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f580f9690 0x7f9f58109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58702/0 (socket says 172.21.15.8:58702) 2023-10-18T21:04:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.172+0000 7f9f5d59f700 1 -- 172.21.15.8:0/2059674583 learned_addr learned my addr 172.21.15.8:0/2059674583 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.173+0000 7f9f5dda0700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f58060310 0x7f9f58108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.173+0000 7f9f5d59f700 1 -- 172.21.15.8:0/2059674583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f58060310 msgr2=0x7f9f58108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.173+0000 7f9f5d59f700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f58060310 0x7f9f58108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.173+0000 7f9f5d59f700 1 -- 172.21.15.8:0/2059674583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48005040 con 0x7f9f580f9690 2023-10-18T21:04:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.173+0000 7f9f5d59f700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f580f9690 0x7f9f58109400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f9f48004e30 tx=0x7f9f48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:06.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.173+0000 7f9f4e7fc700 1 -- 172.21.15.8:0/2059674583 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f48018070 con 0x7f9f580f9690 2023-10-18T21:04:06.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.173+0000 7f9f5eda2700 1 -- 172.21.15.8:0/2059674583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5810a430 con 0x7f9f580f9690 2023-10-18T21:04:06.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.173+0000 7f9f4e7fc700 1 -- 172.21.15.8:0/2059674583 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9f48009630 con 0x7f9f580f9690 2023-10-18T21:04:06.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.173+0000 7f9f5eda2700 1 -- 172.21.15.8:0/2059674583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5810a990 con 0x7f9f580f9690 2023-10-18T21:04:06.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.173+0000 7f9f4e7fc700 1 -- 172.21.15.8:0/2059674583 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f4801c3c0 con 0x7f9f580f9690 2023-10-18T21:04:06.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.175+0000 7f9f5eda2700 1 -- 172.21.15.8:0/2059674583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f58045ad0 con 0x7f9f580f9690 2023-10-18T21:04:06.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.175+0000 7f9f4e7fc700 1 -- 172.21.15.8:0/2059674583 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9f4801d420 con 0x7f9f580f9690 2023-10-18T21:04:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.176+0000 7f9f4e7fc700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f44060f70 0x7f9f44063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.176+0000 7f9f4e7fc700 1 -- 172.21.15.8:0/2059674583 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9f4807dd50 con 0x7f9f580f9690 2023-10-18T21:04:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.176+0000 7f9f5dda0700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f44060f70 0x7f9f44063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.177+0000 7f9f5dda0700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f44060f70 0x7f9f44063430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9f54009740 tx=0x7f9f54009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:06.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.180+0000 7f9f4e7fc700 1 -- 172.21.15.8:0/2059674583 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9f48051c00 con 0x7f9f580f9690 2023-10-18T21:04:06.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.435+0000 7f9f5eda2700 1 -- 172.21.15.8:0/2059674583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f5810b020 con 0x7f9f580f9690 2023-10-18T21:04:06.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.435+0000 7f9f4e7fc700 1 -- 172.21.15.8:0/2059674583 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f9f480517f0 con 0x7f9f580f9690 2023-10-18T21:04:06.437 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:04:06.438 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:04:06.438 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:04:06.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:04:06.438 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:04:06.438 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:04:06.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:04:06.439 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:04:06.439 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:04:06.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:04:06.440 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:04:06.440 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T21:04:06.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:04:06.440 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:04:06.440 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 10, 2023-10-18T21:04:06.440 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-10-18T21:04:06.441 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:04:06.441 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:04:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.437+0000 7f9f5eda2700 1 -- 172.21.15.8:0/2059674583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f44060f70 msgr2=0x7f9f44063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.437+0000 7f9f5eda2700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f44060f70 0x7f9f44063430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9f54009740 tx=0x7f9f54009c60).stop 2023-10-18T21:04:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.437+0000 7f9f5eda2700 1 -- 172.21.15.8:0/2059674583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f580f9690 msgr2=0x7f9f58109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.437+0000 7f9f5eda2700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f580f9690 0x7f9f58109400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f9f48004e30 tx=0x7f9f48009b30).stop 2023-10-18T21:04:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.438+0000 7f9f5eda2700 1 -- 172.21.15.8:0/2059674583 shutdown_connections 2023-10-18T21:04:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.438+0000 7f9f5eda2700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f44060f70 0x7f9f44063430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.438+0000 7f9f5eda2700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f58060310 0x7f9f58108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.438+0000 7f9f5eda2700 1 --2- 172.21.15.8:0/2059674583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f580f9690 0x7f9f58109400 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.438+0000 7f9f5eda2700 1 -- 172.21.15.8:0/2059674583 >> 172.21.15.8:0/2059674583 conn(0x7f9f580f0b90 msgr2=0x7f9f580f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:06.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.438+0000 7f9f5eda2700 1 -- 172.21.15.8:0/2059674583 shutdown_connections 2023-10-18T21:04:06.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.438+0000 7f9f5eda2700 1 -- 172.21.15.8:0/2059674583 wait complete. 2023-10-18T21:04:06.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.573+0000 7ff32957c700 1 -- 172.21.15.8:0/4278901956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f6530 msgr2=0x7ff3240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.573+0000 7ff32957c700 1 --2- 172.21.15.8:0/4278901956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f6530 0x7ff3240f6950 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ff314004660 tx=0x7ff314009b30).stop 2023-10-18T21:04:06.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.573+0000 7ff32957c700 1 -- 172.21.15.8:0/4278901956 shutdown_connections 2023-10-18T21:04:06.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.573+0000 7ff32957c700 1 --2- 172.21.15.8:0/4278901956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f77d0 0x7ff3240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.573+0000 7ff32957c700 1 --2- 172.21.15.8:0/4278901956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f6530 0x7ff3240f6950 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.573+0000 7ff32957c700 1 -- 172.21.15.8:0/4278901956 >> 172.21.15.8:0/4278901956 conn(0x7ff3240f1c90 msgr2=0x7ff3240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:06.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.573+0000 7ff32957c700 1 -- 172.21.15.8:0/4278901956 shutdown_connections 2023-10-18T21:04:06.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.573+0000 7ff32957c700 1 -- 172.21.15.8:0/4278901956 wait complete. 2023-10-18T21:04:06.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.574+0000 7ff32957c700 1 Processor -- start 2023-10-18T21:04:06.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.574+0000 7ff32957c700 1 -- start start 2023-10-18T21:04:06.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.574+0000 7ff32957c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f6530 0x7ff324106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:06.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.574+0000 7ff32957c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f77d0 0x7ff324107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:06.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.574+0000 7ff32957c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff324107870 con 0x7ff3240f6530 2023-10-18T21:04:06.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.574+0000 7ff32957c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3241080b0 con 0x7ff3240f77d0 2023-10-18T21:04:06.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.574+0000 7ff323fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f6530 0x7ff324106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:06.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff323fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f6530 0x7ff324106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58720/0 (socket says 172.21.15.8:58720) 2023-10-18T21:04:06.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff323fff700 1 -- 172.21.15.8:0/2178950161 learned_addr learned my addr 172.21.15.8:0/2178950161 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:06.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff3237fe700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f77d0 0x7ff324107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:06.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff323fff700 1 -- 172.21.15.8:0/2178950161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f77d0 msgr2=0x7ff324107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff323fff700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f77d0 0x7ff324107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff323fff700 1 -- 172.21.15.8:0/2178950161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314005040 con 0x7ff3240f6530 2023-10-18T21:04:06.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff323fff700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f6530 0x7ff324106d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff314009870 tx=0x7ff31400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:06.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff320ff9700 1 -- 172.21.15.8:0/2178950161 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff314019070 con 0x7ff3240f6530 2023-10-18T21:04:06.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff320ff9700 1 -- 172.21.15.8:0/2178950161 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff314013380 con 0x7ff3240f6530 2023-10-18T21:04:06.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff320ff9700 1 -- 172.21.15.8:0/2178950161 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff31401edf0 con 0x7ff3240f6530 2023-10-18T21:04:06.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.575+0000 7ff32957c700 1 -- 172.21.15.8:0/2178950161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff324108330 con 0x7ff3240f6530 2023-10-18T21:04:06.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.576+0000 7ff32957c700 1 -- 172.21.15.8:0/2178950161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff324108810 con 0x7ff3240f6530 2023-10-18T21:04:06.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.577+0000 7ff32957c700 1 -- 172.21.15.8:0/2178950161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff324059100 con 0x7ff3240f6530 2023-10-18T21:04:06.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.578+0000 7ff320ff9700 1 -- 172.21.15.8:0/2178950161 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff31401e420 con 0x7ff3240f6530 2023-10-18T21:04:06.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.578+0000 7ff320ff9700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff30c060f70 0x7ff30c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:06.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.578+0000 7ff320ff9700 1 -- 172.21.15.8:0/2178950161 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff31407d500 con 0x7ff3240f6530 2023-10-18T21:04:06.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.579+0000 7ff3237fe700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff30c060f70 0x7ff30c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:06.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.579+0000 7ff3237fe700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff30c060f70 0x7ff30c063430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff324106b10 tx=0x7ff31800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:06.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.583+0000 7ff320ff9700 1 -- 172.21.15.8:0/2178950161 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff31404d980 con 0x7ff3240f6530 2023-10-18T21:04:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:05.335304+0000 mgr.smithi008.flmjzp (mgr.14640) 289 : audit [DBG] from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:05.335304+0000 mgr.smithi008.flmjzp (mgr.14640) 289 : audit [DBG] from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:06.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.809+0000 7ff32957c700 1 -- 172.21.15.8:0/2178950161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff3240fecc0 con 0x7ff3240f6530 2023-10-18T21:04:06.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.810+0000 7ff320ff9700 1 -- 172.21.15.8:0/2178950161 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1767 (secure 0 0 0) 0x7ff314004490 con 0x7ff3240f6530 2023-10-18T21:04:06.812 INFO:teuthology.orchestra.run.smithi008.stdout:e22 2023-10-18T21:04:06.812 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:04:06.812 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:04:06.812 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:04:06.813 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:04:06.813 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:04:06.813 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:04:06.813 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 22 2023-10-18T21:04:06.813 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:04:06.814 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:04:06.814 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:03:56.696563+0000 2023-10-18T21:04:06.814 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:04:06.814 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:04:06.814 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:04:06.815 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:04:06.815 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:04:06.815 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:04:06.815 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:04:06.815 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-18T21:04:06.816 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:04:06.816 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:04:06.816 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1 2023-10-18T21:04:06.816 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=14456,1=24321} 2023-10-18T21:04:06.816 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:04:06.816 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:04:06.817 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-18T21:04:06.817 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:04:06.817 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:04:06.817 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:04:06.817 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:04:06.818 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:04:06.818 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:14456} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.8:6826/3639001015,v1:172.21.15.8:6827/3639001015] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:04:06.818 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{1:24321} state up:stopping seq 3 join_fscid=1 addr [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:04:06.818 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:04:06.818 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:04:06.818 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:04:06.819 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:04:06.819 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.8:6828/460576416,v1:172.21.15.8:6829/460576416] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:04:06.819 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:04:06.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.812+0000 7ff32957c700 1 -- 172.21.15.8:0/2178950161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff30c060f70 msgr2=0x7ff30c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.812+0000 7ff32957c700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff30c060f70 0x7ff30c063430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff324106b10 tx=0x7ff31800b040).stop 2023-10-18T21:04:06.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.812+0000 7ff32957c700 1 -- 172.21.15.8:0/2178950161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f6530 msgr2=0x7ff324106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.812+0000 7ff32957c700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f6530 0x7ff324106d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff314009870 tx=0x7ff31400b040).stop 2023-10-18T21:04:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.812+0000 7ff32957c700 1 -- 172.21.15.8:0/2178950161 shutdown_connections 2023-10-18T21:04:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.812+0000 7ff32957c700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff30c060f70 0x7ff30c063430 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.812+0000 7ff32957c700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3240f6530 0x7ff324106d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.812+0000 7ff32957c700 1 --2- 172.21.15.8:0/2178950161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3240f77d0 0x7ff324107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.812+0000 7ff32957c700 1 -- 172.21.15.8:0/2178950161 >> 172.21.15.8:0/2178950161 conn(0x7ff3240f1c90 msgr2=0x7ff3240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.813+0000 7ff32957c700 1 -- 172.21.15.8:0/2178950161 shutdown_connections 2023-10-18T21:04:06.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.813+0000 7ff32957c700 1 -- 172.21.15.8:0/2178950161 wait complete. 2023-10-18T21:04:06.822 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 22 2023-10-18T21:04:06.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.952+0000 7f08048e6700 1 -- 172.21.15.8:0/3071665047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08000f77d0 msgr2=0x7f08000f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.952+0000 7f08048e6700 1 --2- 172.21.15.8:0/3071665047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08000f77d0 0x7f08000f7c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f07f4004660 tx=0x7f07f4009b30).stop 2023-10-18T21:04:06.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.952+0000 7f08048e6700 1 -- 172.21.15.8:0/3071665047 shutdown_connections 2023-10-18T21:04:06.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.952+0000 7f08048e6700 1 --2- 172.21.15.8:0/3071665047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08000f77d0 0x7f08000f7c30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.952+0000 7f08048e6700 1 --2- 172.21.15.8:0/3071665047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08000f6530 0x7f08000f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:06.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.952+0000 7f08048e6700 1 -- 172.21.15.8:0/3071665047 >> 172.21.15.8:0/3071665047 conn(0x7f08000f1c90 msgr2=0x7f08000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:06.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.952+0000 7f08048e6700 1 -- 172.21.15.8:0/3071665047 shutdown_connections 2023-10-18T21:04:06.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.952+0000 7f08048e6700 1 -- 172.21.15.8:0/3071665047 wait complete. 2023-10-18T21:04:06.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.953+0000 7f08048e6700 1 Processor -- start 2023-10-18T21:04:06.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.953+0000 7f08048e6700 1 -- start start 2023-10-18T21:04:06.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f08048e6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08000f6530 0x7f0800108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:06.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f08048e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08000f77d0 0x7f0800109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:06.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f08048e6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08001099d0 con 0x7f08000f6530 2023-10-18T21:04:06.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f08048e6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0800109b10 con 0x7f08000f77d0 2023-10-18T21:04:06.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f07ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08000f6530 0x7f0800108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:06.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f07ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08000f6530 0x7f0800108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42020/0 (socket says 172.21.15.8:42020) 2023-10-18T21:04:06.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f07ff7fe700 1 -- 172.21.15.8:0/910472349 learned_addr learned my addr 172.21.15.8:0/910472349 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:06.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f07ff7fe700 1 -- 172.21.15.8:0/910472349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08000f77d0 msgr2=0x7f0800109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:06.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f07ff7fe700 1 --2- 172.21.15.8:0/910472349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08000f77d0 0x7f0800109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:04:06.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f07ff7fe700 1 -- 172.21.15.8:0/910472349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4005040 con 0x7f08000f6530 2023-10-18T21:04:06.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.954+0000 7f07ff7fe700 1 --2- 172.21.15.8:0/910472349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08000f6530 0x7f0800108f30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f07f0002700 tx=0x7f07f0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:06.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.955+0000 7f07e7fff700 1 -- 172.21.15.8:0/910472349 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07f0009320 con 0x7f08000f6530 2023-10-18T21:04:06.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.955+0000 7f07e7fff700 1 -- 172.21.15.8:0/910472349 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f07f000f040 con 0x7f08000f6530 2023-10-18T21:04:06.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.955+0000 7f08048e6700 1 -- 172.21.15.8:0/910472349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080010a4b0 con 0x7f08000f6530 2023-10-18T21:04:06.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.955+0000 7f07e7fff700 1 -- 172.21.15.8:0/910472349 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07f0014970 con 0x7f08000f6530 2023-10-18T21:04:06.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.955+0000 7f08048e6700 1 -- 172.21.15.8:0/910472349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080010aa70 con 0x7f08000f6530 2023-10-18T21:04:06.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.956+0000 7f08048e6700 1 -- 172.21.15.8:0/910472349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0800045ad0 con 0x7f08000f6530 2023-10-18T21:04:06.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.957+0000 7f07e7fff700 1 -- 172.21.15.8:0/910472349 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f07f0009480 con 0x7f08000f6530 2023-10-18T21:04:06.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.958+0000 7f07e7fff700 1 --2- 172.21.15.8:0/910472349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f07e8060f70 0x7f07e8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:06.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.958+0000 7f07e7fff700 1 -- 172.21.15.8:0/910472349 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f07f007c380 con 0x7f08000f6530 2023-10-18T21:04:06.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.958+0000 7f07feffd700 1 --2- 172.21.15.8:0/910472349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f07e8060f70 0x7f07e8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:06.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.958+0000 7f07feffd700 1 --2- 172.21.15.8:0/910472349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f07e8060f70 0x7f07e8063430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f07f4009f50 tx=0x7f07f4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:06.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:06.962+0000 7f07e7fff700 1 -- 172.21.15.8:0/910472349 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f07f00501f0 con 0x7f08000f6530 2023-10-18T21:04:07.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.163+0000 7f08048e6700 1 -- 172.21.15.8:0/910472349 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f080010ad40 con 0x7f07e8060f70 2023-10-18T21:04:07.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.164+0000 7f07e7fff700 1 -- 172.21.15.8:0/910472349 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f080010ad40 con 0x7f07e8060f70 2023-10-18T21:04:07.166 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:04:07.166 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:04:07.166 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:04:07.167 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:04:07.167 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:04:07.167 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:04:07.167 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:04:07.167 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:04:07.168 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:04:07.168 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:04:07.168 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:04:07.168 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading osd daemons", 2023-10-18T21:04:07.168 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:04:07.169 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:04:07.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.167+0000 7f08048e6700 1 -- 172.21.15.8:0/910472349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f07e8060f70 msgr2=0x7f07e8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:07.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.167+0000 7f08048e6700 1 --2- 172.21.15.8:0/910472349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f07e8060f70 0x7f07e8063430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f07f4009f50 tx=0x7f07f4009b30).stop 2023-10-18T21:04:07.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.167+0000 7f08048e6700 1 -- 172.21.15.8:0/910472349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08000f6530 msgr2=0x7f0800108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:07.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.167+0000 7f08048e6700 1 --2- 172.21.15.8:0/910472349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08000f6530 0x7f0800108f30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f07f0002700 tx=0x7f07f0009d80).stop 2023-10-18T21:04:07.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.168+0000 7f08048e6700 1 -- 172.21.15.8:0/910472349 shutdown_connections 2023-10-18T21:04:07.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.168+0000 7f08048e6700 1 --2- 172.21.15.8:0/910472349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f07e8060f70 0x7f07e8063430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:07.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.168+0000 7f08048e6700 1 --2- 172.21.15.8:0/910472349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08000f6530 0x7f0800108f30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:07.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.168+0000 7f08048e6700 1 --2- 172.21.15.8:0/910472349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08000f77d0 0x7f0800109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:04:07.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.168+0000 7f08048e6700 1 -- 172.21.15.8:0/910472349 >> 172.21.15.8:0/910472349 conn(0x7f08000f1c90 msgr2=0x7f080006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:07.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.168+0000 7f08048e6700 1 -- 172.21.15.8:0/910472349 shutdown_connections 2023-10-18T21:04:07.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:07.168+0000 7f08048e6700 1 -- 172.21.15.8:0/910472349 wait complete. 2023-10-18T21:04:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:05.685848+0000 mgr.smithi008.flmjzp (mgr.14640) 290 : audit [DBG] from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.025003+0000 mgr.smithi008.flmjzp (mgr.14640) 291 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:06.205497+0000 mgr.smithi008.flmjzp (mgr.14640) 292 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 1.4 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2023-10-18T21:04:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:06.259820+0000 mon.smithi008 (mon.0) 534 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/369 objects degraded (1.084%), 2 pgs degraded) 2023-10-18T21:04:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:06.259847+0000 mon.smithi008 (mon.0) 535 : cluster [INF] Cluster is now healthy 2023-10-18T21:04:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.436056+0000 mon.smithi008 (mon.0) 536 : audit [DBG] from='client.? 172.21.15.8:0/2059674583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.735933+0000 mon.smithi008 (mon.0) 537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.737478+0000 mon.smithi008 (mon.0) 538 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.738143+0000 mon.smithi008 (mon.0) 539 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:04:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.742669+0000 mon.smithi008 (mon.0) 540 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.747593+0000 mon.smithi008 (mon.0) 541 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.750037+0000 mon.smithi008 (mon.0) 542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.751362+0000 mon.smithi008 (mon.0) 543 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.752638+0000 mon.smithi008 (mon.0) 544 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.754230+0000 mon.smithi008 (mon.0) 545 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:06.810650+0000 mon.smithi008 (mon.0) 546 : audit [DBG] from='client.? 172.21.15.8:0/2178950161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:04:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:05.685848+0000 mgr.smithi008.flmjzp (mgr.14640) 290 : audit [DBG] from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.025003+0000 mgr.smithi008.flmjzp (mgr.14640) 291 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:06.205497+0000 mgr.smithi008.flmjzp (mgr.14640) 292 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 1.4 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2023-10-18T21:04:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:06.259820+0000 mon.smithi008 (mon.0) 534 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/369 objects degraded (1.084%), 2 pgs degraded) 2023-10-18T21:04:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:06.259847+0000 mon.smithi008 (mon.0) 535 : cluster [INF] Cluster is now healthy 2023-10-18T21:04:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.436056+0000 mon.smithi008 (mon.0) 536 : audit [DBG] from='client.? 172.21.15.8:0/2059674583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.735933+0000 mon.smithi008 (mon.0) 537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.737478+0000 mon.smithi008 (mon.0) 538 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.738143+0000 mon.smithi008 (mon.0) 539 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:04:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.742669+0000 mon.smithi008 (mon.0) 540 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.747593+0000 mon.smithi008 (mon.0) 541 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:07.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.750037+0000 mon.smithi008 (mon.0) 542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:07.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.751362+0000 mon.smithi008 (mon.0) 543 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:07.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.752638+0000 mon.smithi008 (mon.0) 544 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:07.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.754230+0000 mon.smithi008 (mon.0) 545 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:07.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:06.810650+0000 mon.smithi008 (mon.0) 546 : audit [DBG] from='client.? 172.21.15.8:0/2178950161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:04:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:06.738771+0000 mgr.smithi008.flmjzp (mgr.14640) 293 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:04:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:06.755711+0000 mgr.smithi008.flmjzp (mgr.14640) 294 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2023-10-18T21:04:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:07.164881+0000 mgr.smithi008.flmjzp (mgr.14640) 295 : audit [DBG] from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:06.738771+0000 mgr.smithi008.flmjzp (mgr.14640) 293 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:04:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:06.755711+0000 mgr.smithi008.flmjzp (mgr.14640) 294 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2023-10-18T21:04:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:07.164881+0000 mgr.smithi008.flmjzp (mgr.14640) 295 : audit [DBG] from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:08.206011+0000 mgr.smithi008.flmjzp (mgr.14640) 296 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 1.4 KiB/s wr, 8 op/s; 10 B/s, 0 objects/s recovering 2023-10-18T21:04:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:08.206011+0000 mgr.smithi008.flmjzp (mgr.14640) 296 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 1.4 KiB/s wr, 8 op/s; 10 B/s, 0 objects/s recovering 2023-10-18T21:04:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:10.206550+0000 mgr.smithi008.flmjzp (mgr.14640) 297 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 9.4 KiB/s rd, 1.3 KiB/s wr, 9 op/s; 8 B/s, 0 objects/s recovering 2023-10-18T21:04:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:10.591643+0000 mon.smithi008 (mon.0) 547 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:10.206550+0000 mgr.smithi008.flmjzp (mgr.14640) 297 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 9.4 KiB/s rd, 1.3 KiB/s wr, 9 op/s; 8 B/s, 0 objects/s recovering 2023-10-18T21:04:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:10.591643+0000 mon.smithi008 (mon.0) 547 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:12.207100+0000 mgr.smithi008.flmjzp (mgr.14640) 298 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s; 7 B/s, 0 objects/s recovering 2023-10-18T21:04:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:12.207100+0000 mgr.smithi008.flmjzp (mgr.14640) 298 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s; 7 B/s, 0 objects/s recovering 2023-10-18T21:04:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:14.207572+0000 mgr.smithi008.flmjzp (mgr.14640) 299 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.8 KiB/s rd, 1.1 KiB/s wr, 8 op/s; 7 B/s, 0 objects/s recovering 2023-10-18T21:04:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:15.447532+0000 mon.smithi008 (mon.0) 548 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:14.207572+0000 mgr.smithi008.flmjzp (mgr.14640) 299 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.8 KiB/s rd, 1.1 KiB/s wr, 8 op/s; 7 B/s, 0 objects/s recovering 2023-10-18T21:04:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:15.447532+0000 mon.smithi008 (mon.0) 548 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:17.858 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:16.208125+0000 mgr.smithi008.flmjzp (mgr.14640) 300 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 4 op/s 2023-10-18T21:04:17.858 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:16.766433+0000 mon.smithi008 (mon.0) 549 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:17.858 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:16.768707+0000 mon.smithi008 (mon.0) 550 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:17.859 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:16.769791+0000 mon.smithi008 (mon.0) 551 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:04:17.859 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:16.776064+0000 mon.smithi008 (mon.0) 552 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:17.859 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:16.782553+0000 mon.smithi008 (mon.0) 553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:17.859 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:16.785644+0000 mon.smithi008 (mon.0) 554 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:17.859 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:16.787339+0000 mon.smithi008 (mon.0) 555 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:17.860 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:16.789044+0000 mon.smithi008 (mon.0) 556 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:17.860 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:16.791062+0000 mon.smithi008 (mon.0) 557 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:17.860 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:17.167008+0000 mon.smithi008 (mon.0) 558 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2023-10-18T21:04:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:16.208125+0000 mgr.smithi008.flmjzp (mgr.14640) 300 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 4 op/s 2023-10-18T21:04:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:16.766433+0000 mon.smithi008 (mon.0) 549 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:16.768707+0000 mon.smithi008 (mon.0) 550 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:16.769791+0000 mon.smithi008 (mon.0) 551 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:04:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:16.776064+0000 mon.smithi008 (mon.0) 552 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:16.782553+0000 mon.smithi008 (mon.0) 553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:16.785644+0000 mon.smithi008 (mon.0) 554 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:16.787339+0000 mon.smithi008 (mon.0) 555 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:16.789044+0000 mon.smithi008 (mon.0) 556 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:16.791062+0000 mon.smithi008 (mon.0) 557 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:17.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:17.167008+0000 mon.smithi008 (mon.0) 558 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2023-10-18T21:04:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:16.770801+0000 mgr.smithi008.flmjzp (mgr.14640) 301 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:04:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:16.792910+0000 mgr.smithi008.flmjzp (mgr.14640) 302 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2023-10-18T21:04:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:17.778546+0000 mon.smithi008 (mon.0) 559 : cluster [DBG] mds.1 [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] down:stopped 2023-10-18T21:04:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:17.778629+0000 mon.smithi008 (mon.0) 560 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.lehgco=up:active} 2 up:standby 2023-10-18T21:04:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:16.770801+0000 mgr.smithi008.flmjzp (mgr.14640) 301 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:04:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:16.792910+0000 mgr.smithi008.flmjzp (mgr.14640) 302 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2023-10-18T21:04:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:17.778546+0000 mon.smithi008 (mon.0) 559 : cluster [DBG] mds.1 [v2:172.21.15.60:6824/636466145,v1:172.21.15.60:6825/636466145] down:stopped 2023-10-18T21:04:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:17.778629+0000 mon.smithi008 (mon.0) 560 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.lehgco=up:active} 2 up:standby 2023-10-18T21:04:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:18.208784+0000 mgr.smithi008.flmjzp (mgr.14640) 303 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 3 op/s 2023-10-18T21:04:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:18.782705+0000 mon.smithi008 (mon.0) 561 : cluster [DBG] mds.? [v2:172.21.15.60:6824/894252909,v1:172.21.15.60:6825/894252909] up:boot 2023-10-18T21:04:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:18.782797+0000 mon.smithi008 (mon.0) 562 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.lehgco=up:active} 3 up:standby 2023-10-18T21:04:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:18.782996+0000 mon.smithi008 (mon.0) 563 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:04:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:18.208784+0000 mgr.smithi008.flmjzp (mgr.14640) 303 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 3 op/s 2023-10-18T21:04:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:18.782705+0000 mon.smithi008 (mon.0) 561 : cluster [DBG] mds.? [v2:172.21.15.60:6824/894252909,v1:172.21.15.60:6825/894252909] up:boot 2023-10-18T21:04:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:18.782797+0000 mon.smithi008 (mon.0) 562 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.lehgco=up:active} 3 up:standby 2023-10-18T21:04:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:18.782996+0000 mon.smithi008 (mon.0) 563 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:04:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:20.209282+0000 mgr.smithi008.flmjzp (mgr.14640) 304 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2023-10-18T21:04:21.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:20.209282+0000 mgr.smithi008.flmjzp (mgr.14640) 304 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2023-10-18T21:04:23.522 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:22.209785+0000 mgr.smithi008.flmjzp (mgr.14640) 305 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2023-10-18T21:04:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:22.209785+0000 mgr.smithi008.flmjzp (mgr.14640) 305 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2023-10-18T21:04:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:24.210318+0000 mgr.smithi008.flmjzp (mgr.14640) 306 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-10-18T21:04:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:24.210318+0000 mgr.smithi008.flmjzp (mgr.14640) 306 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-10-18T21:04:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:26.210763+0000 mgr.smithi008.flmjzp (mgr.14640) 307 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:04:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:26.803671+0000 mon.smithi008 (mon.0) 564 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:26.210763+0000 mgr.smithi008.flmjzp (mgr.14640) 307 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:04:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:26.803671+0000 mon.smithi008 (mon.0) 564 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:28.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:27.365480+0000 mon.smithi008 (mon.0) 565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:28.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:27.366306+0000 mon.smithi008 (mon.0) 566 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:04:28.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:27.367005+0000 mgr.smithi008.flmjzp (mgr.14640) 308 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:04:28.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:27.371165+0000 mon.smithi008 (mon.0) 567 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:28.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:27.376039+0000 mon.smithi008 (mon.0) 568 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:28.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:27.378288+0000 mon.smithi008 (mon.0) 569 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:28.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:27.379545+0000 mon.smithi008 (mon.0) 570 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:28.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:27.380747+0000 mon.smithi008 (mon.0) 571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:28.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:27.382244+0000 mon.smithi008 (mon.0) 572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:28.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:27.383989+0000 mon.smithi008 (mon.0) 573 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi008.lehgco"]}]: dispatch 2023-10-18T21:04:28.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:27.384577+0000 mgr.smithi008.flmjzp (mgr.14640) 309 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi008.lehgco 2023-10-18T21:04:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:27.365480+0000 mon.smithi008 (mon.0) 565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:27.366306+0000 mon.smithi008 (mon.0) 566 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:04:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:27.367005+0000 mgr.smithi008.flmjzp (mgr.14640) 308 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:04:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:27.371165+0000 mon.smithi008 (mon.0) 567 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:27.376039+0000 mon.smithi008 (mon.0) 568 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:27.378288+0000 mon.smithi008 (mon.0) 569 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:28.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:27.379545+0000 mon.smithi008 (mon.0) 570 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:28.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:27.380747+0000 mon.smithi008 (mon.0) 571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:28.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:27.382244+0000 mon.smithi008 (mon.0) 572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:28.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:27.383989+0000 mon.smithi008 (mon.0) 573 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi008.lehgco"]}]: dispatch 2023-10-18T21:04:28.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:27.384577+0000 mgr.smithi008.flmjzp (mgr.14640) 309 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi008.lehgco 2023-10-18T21:04:29.657 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:28.211303+0000 mgr.smithi008.flmjzp (mgr.14640) 310 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:04:29.658 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:28.486938+0000 mgr.smithi008.flmjzp (mgr.14640) 311 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi008.lehgco 2023-10-18T21:04:29.658 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:28.491731+0000 mon.smithi008 (mon.0) 574 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:29.658 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:28.492557+0000 mon.smithi008 (mon.0) 575 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.lehgco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T21:04:29.659 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:28.493334+0000 mon.smithi008 (mon.0) 576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:29.659 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:28.494002+0000 mgr.smithi008.flmjzp (mgr.14640) 312 : cephadm [INF] Deploying daemon mds.cephfs.smithi008.lehgco on smithi008 2023-10-18T21:04:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:28.211303+0000 mgr.smithi008.flmjzp (mgr.14640) 310 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:04:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:28.486938+0000 mgr.smithi008.flmjzp (mgr.14640) 311 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi008.lehgco 2023-10-18T21:04:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:28.491731+0000 mon.smithi008 (mon.0) 574 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:28.492557+0000 mon.smithi008 (mon.0) 575 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.lehgco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T21:04:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:28.493334+0000 mon.smithi008 (mon.0) 576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:28.494002+0000 mgr.smithi008.flmjzp (mgr.14640) 312 : cephadm [INF] Deploying daemon mds.cephfs.smithi008.lehgco on smithi008 2023-10-18T21:04:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:29.780707+0000 mon.smithi008 (mon.0) 577 : cluster [DBG] osdmap e84: 6 total, 6 up, 6 in 2023-10-18T21:04:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:29.885217+0000 mon.smithi008 (mon.0) 578 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:04:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:29.885365+0000 mon.smithi008 (mon.0) 579 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-18T21:04:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:29.889026+0000 mon.smithi008 (mon.0) 580 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 2 up:standby 2023-10-18T21:04:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:30.211612+0000 mgr.smithi008.flmjzp (mgr.14640) 313 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:04:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:30.447646+0000 mon.smithi008 (mon.0) 581 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:31.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:29.780707+0000 mon.smithi008 (mon.0) 577 : cluster [DBG] osdmap e84: 6 total, 6 up, 6 in 2023-10-18T21:04:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:29.885217+0000 mon.smithi008 (mon.0) 578 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:04:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:29.885365+0000 mon.smithi008 (mon.0) 579 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-18T21:04:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:29.889026+0000 mon.smithi008 (mon.0) 580 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 2 up:standby 2023-10-18T21:04:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:30.211612+0000 mgr.smithi008.flmjzp (mgr.14640) 313 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:04:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:30.447646+0000 mon.smithi008 (mon.0) 581 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:31.197174+0000 mon.smithi008 (mon.0) 582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:04:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:31.197174+0000 mon.smithi008 (mon.0) 582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:04:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:32.211984+0000 mgr.smithi008.flmjzp (mgr.14640) 314 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 1 op/s 2023-10-18T21:04:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:32.211984+0000 mgr.smithi008.flmjzp (mgr.14640) 314 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 1 op/s 2023-10-18T21:04:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:34.212364+0000 mgr.smithi008.flmjzp (mgr.14640) 315 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.6 MiB/s rd, 3 op/s 2023-10-18T21:04:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:34.212364+0000 mgr.smithi008.flmjzp (mgr.14640) 315 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.6 MiB/s rd, 3 op/s 2023-10-18T21:04:37.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.345+0000 7f46c6e83700 1 -- 172.21.15.8:0/725381619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46c00f6530 msgr2=0x7f46c00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:37.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.345+0000 7f46c6e83700 1 --2- 172.21.15.8:0/725381619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46c00f6530 0x7f46c00f6950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f46bc004660 tx=0x7f46bc009b30).stop 2023-10-18T21:04:37.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.345+0000 7f46c6e83700 1 -- 172.21.15.8:0/725381619 shutdown_connections 2023-10-18T21:04:37.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.345+0000 7f46c6e83700 1 --2- 172.21.15.8:0/725381619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00f77d0 0x7f46c00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.345+0000 7f46c6e83700 1 --2- 172.21.15.8:0/725381619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46c00f6530 0x7f46c00f6950 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.345+0000 7f46c6e83700 1 -- 172.21.15.8:0/725381619 >> 172.21.15.8:0/725381619 conn(0x7f46c00f1c90 msgr2=0x7f46c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:37.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.345+0000 7f46c6e83700 1 -- 172.21.15.8:0/725381619 shutdown_connections 2023-10-18T21:04:37.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.345+0000 7f46c6e83700 1 -- 172.21.15.8:0/725381619 wait complete. 2023-10-18T21:04:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.346+0000 7f46c6e83700 1 Processor -- start 2023-10-18T21:04:37.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.346+0000 7f46c6e83700 1 -- start start 2023-10-18T21:04:37.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.347+0000 7f46c6e83700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46c00f6530 0x7f46c0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:37.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.347+0000 7f46c6e83700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00f77d0 0x7f46c0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:37.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.347+0000 7f46c6e83700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0107910 con 0x7f46c00f6530 2023-10-18T21:04:37.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.347+0000 7f46c6e83700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0108120 con 0x7f46c00f77d0 2023-10-18T21:04:37.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.347+0000 7f46c5e81700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46c00f6530 0x7f46c0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:37.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.347+0000 7f46c5e81700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46c00f6530 0x7f46c0106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45574/0 (socket says 172.21.15.8:45574) 2023-10-18T21:04:37.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.347+0000 7f46c5e81700 1 -- 172.21.15.8:0/3590665408 learned_addr learned my addr 172.21.15.8:0/3590665408 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:37.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.347+0000 7f46c5680700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00f77d0 0x7f46c0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:37.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.348+0000 7f46c5e81700 1 -- 172.21.15.8:0/3590665408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00f77d0 msgr2=0x7f46c0107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.348+0000 7f46c5e81700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00f77d0 0x7f46c0107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.348+0000 7f46c5e81700 1 -- 172.21.15.8:0/3590665408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc005040 con 0x7f46c00f6530 2023-10-18T21:04:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.348+0000 7f46c5680700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00f77d0 0x7f46c0107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:04:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.348+0000 7f46c5e81700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46c00f6530 0x7f46c0106e20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f46bc007a60 tx=0x7f46bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.348+0000 7f46b67fc700 1 -- 172.21.15.8:0/3590665408 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46bc018070 con 0x7f46c00f6530 2023-10-18T21:04:37.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.348+0000 7f46c6e83700 1 -- 172.21.15.8:0/3590665408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c0108340 con 0x7f46c00f6530 2023-10-18T21:04:37.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.348+0000 7f46b67fc700 1 -- 172.21.15.8:0/3590665408 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f46bc009630 con 0x7f46c00f6530 2023-10-18T21:04:37.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.348+0000 7f46b67fc700 1 -- 172.21.15.8:0/3590665408 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46bc01c540 con 0x7f46c00f6530 2023-10-18T21:04:37.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.348+0000 7f46c6e83700 1 -- 172.21.15.8:0/3590665408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c01088a0 con 0x7f46c00f6530 2023-10-18T21:04:37.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.349+0000 7f46c6e83700 1 -- 172.21.15.8:0/3590665408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c0059100 con 0x7f46c00f6530 2023-10-18T21:04:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.351+0000 7f46b67fc700 1 -- 172.21.15.8:0/3590665408 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f46bc01c7b0 con 0x7f46c00f6530 2023-10-18T21:04:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.352+0000 7f46b67fc700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f46ac060f70 0x7f46ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:37.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.352+0000 7f46b67fc700 1 -- 172.21.15.8:0/3590665408 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f46bc07dfa0 con 0x7f46c00f6530 2023-10-18T21:04:37.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.352+0000 7f46c5680700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f46ac060f70 0x7f46ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:37.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.353+0000 7f46c5680700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f46ac060f70 0x7f46ac063430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f46b0009740 tx=0x7f46b0009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:37.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.361+0000 7f46b67fc700 1 -- 172.21.15.8:0/3590665408 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f46bc04e310 con 0x7f46c00f6530 2023-10-18T21:04:37.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.563+0000 7f46c6e83700 1 -- 172.21.15.8:0/3590665408 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46c00fedd0 con 0x7f46ac060f70 2023-10-18T21:04:37.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.565+0000 7f46b67fc700 1 -- 172.21.15.8:0/3590665408 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f46c00fedd0 con 0x7f46ac060f70 2023-10-18T21:04:37.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 -- 172.21.15.8:0/3590665408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f46ac060f70 msgr2=0x7f46ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:37.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f46ac060f70 0x7f46ac063430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f46b0009740 tx=0x7f46b0009be0).stop 2023-10-18T21:04:37.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 -- 172.21.15.8:0/3590665408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46c00f6530 msgr2=0x7f46c0106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:37.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46c00f6530 0x7f46c0106e20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f46bc007a60 tx=0x7f46bc009b30).stop 2023-10-18T21:04:37.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 -- 172.21.15.8:0/3590665408 shutdown_connections 2023-10-18T21:04:37.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f46ac060f70 0x7f46ac063430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46c00f6530 0x7f46c0106e20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 --2- 172.21.15.8:0/3590665408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00f77d0 0x7f46c0107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 -- 172.21.15.8:0/3590665408 >> 172.21.15.8:0/3590665408 conn(0x7f46c00f1c90 msgr2=0x7f46c00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:37.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 -- 172.21.15.8:0/3590665408 shutdown_connections 2023-10-18T21:04:37.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.567+0000 7f46c6e83700 1 -- 172.21.15.8:0/3590665408 wait complete. 2023-10-18T21:04:37.584 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:04:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:36.212813+0000 mgr.smithi008.flmjzp (mgr.14640) 316 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2023-10-18T21:04:37.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.707+0000 7fa1fffff700 1 -- 172.21.15.8:0/1022771844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2000f77d0 msgr2=0x7fa2000f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:37.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.707+0000 7fa1fffff700 1 --2- 172.21.15.8:0/1022771844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2000f77d0 0x7fa2000f7c30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa1f4004660 tx=0x7fa1f4009b30).stop 2023-10-18T21:04:37.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.707+0000 7fa1fffff700 1 -- 172.21.15.8:0/1022771844 shutdown_connections 2023-10-18T21:04:37.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.707+0000 7fa1fffff700 1 --2- 172.21.15.8:0/1022771844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2000f77d0 0x7fa2000f7c30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.707+0000 7fa1fffff700 1 --2- 172.21.15.8:0/1022771844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2000f6530 0x7fa2000f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.707+0000 7fa1fffff700 1 -- 172.21.15.8:0/1022771844 >> 172.21.15.8:0/1022771844 conn(0x7fa2000f1c90 msgr2=0x7fa2000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:37.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.707+0000 7fa1fffff700 1 -- 172.21.15.8:0/1022771844 shutdown_connections 2023-10-18T21:04:37.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.707+0000 7fa1fffff700 1 -- 172.21.15.8:0/1022771844 wait complete. 2023-10-18T21:04:37.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.708+0000 7fa1fffff700 1 Processor -- start 2023-10-18T21:04:37.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.708+0000 7fa1fffff700 1 -- start start 2023-10-18T21:04:37.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.709+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2000f6530 0x7fa200106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:37.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.709+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2000f77d0 0x7fa200107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:37.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.709+0000 7fa1fffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200107850 con 0x7fa2000f77d0 2023-10-18T21:04:37.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.709+0000 7fa1fffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200108060 con 0x7fa2000f6530 2023-10-18T21:04:37.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.709+0000 7fa1fe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2000f77d0 0x7fa200107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:37.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.709+0000 7fa1fe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2000f77d0 0x7fa200107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45578/0 (socket says 172.21.15.8:45578) 2023-10-18T21:04:37.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.709+0000 7fa1fe7fc700 1 -- 172.21.15.8:0/1679059587 learned_addr learned my addr 172.21.15.8:0/1679059587 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:37.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.709+0000 7fa1feffd700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2000f6530 0x7fa200106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:37.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.710+0000 7fa1feffd700 1 -- 172.21.15.8:0/1679059587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2000f77d0 msgr2=0x7fa200107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:37.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.710+0000 7fa1feffd700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2000f77d0 0x7fa200107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.710+0000 7fa1feffd700 1 -- 172.21.15.8:0/1679059587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4005040 con 0x7fa2000f6530 2023-10-18T21:04:37.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.710+0000 7fa1fe7fc700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2000f77d0 0x7fa200107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:04:37.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.710+0000 7fa1feffd700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2000f6530 0x7fa200106d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa2000f7630 tx=0x7fa1f000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:37.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.710+0000 7fa1e77fe700 1 -- 172.21.15.8:0/1679059587 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f00092e0 con 0x7fa2000f6530 2023-10-18T21:04:37.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.710+0000 7fa1e77fe700 1 -- 172.21.15.8:0/1679059587 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa1f000f040 con 0x7fa2000f6530 2023-10-18T21:04:37.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.710+0000 7fa1fffff700 1 -- 172.21.15.8:0/1679059587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2001082e0 con 0x7fa2000f6530 2023-10-18T21:04:37.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.711+0000 7fa1e77fe700 1 -- 172.21.15.8:0/1679059587 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f0014860 con 0x7fa2000f6530 2023-10-18T21:04:37.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.711+0000 7fa1fffff700 1 -- 172.21.15.8:0/1679059587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa200108820 con 0x7fa2000f6530 2023-10-18T21:04:37.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.712+0000 7fa1fffff700 1 -- 172.21.15.8:0/1679059587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa200059100 con 0x7fa2000f6530 2023-10-18T21:04:37.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.713+0000 7fa1e77fe700 1 -- 172.21.15.8:0/1679059587 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa1f001b030 con 0x7fa2000f6530 2023-10-18T21:04:37.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.715+0000 7fa1e77fe700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1e8060f70 0x7fa1e8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:37.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.715+0000 7fa1e77fe700 1 -- 172.21.15.8:0/1679059587 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa1f007bfe0 con 0x7fa2000f6530 2023-10-18T21:04:37.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.715+0000 7fa1fe7fc700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1e8060f70 0x7fa1e8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:37.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.716+0000 7fa1fe7fc700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1e8060f70 0x7fa1e8063430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa1f4009720 tx=0x7fa1f4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:37.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.720+0000 7fa1e77fe700 1 -- 172.21.15.8:0/1679059587 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa1f004c430 con 0x7fa2000f6530 2023-10-18T21:04:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:36.212813+0000 mgr.smithi008.flmjzp (mgr.14640) 316 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2023-10-18T21:04:37.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.918+0000 7fa1fffff700 1 -- 172.21.15.8:0/1679059587 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2000fedd0 con 0x7fa1e8060f70 2023-10-18T21:04:37.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.919+0000 7fa1e77fe700 1 -- 172.21.15.8:0/1679059587 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa2000fedd0 con 0x7fa1e8060f70 2023-10-18T21:04:37.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.921+0000 7fa1fffff700 1 -- 172.21.15.8:0/1679059587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1e8060f70 msgr2=0x7fa1e8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:37.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.921+0000 7fa1fffff700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1e8060f70 0x7fa1e8063430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa1f4009720 tx=0x7fa1f4016040).stop 2023-10-18T21:04:37.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.921+0000 7fa1fffff700 1 -- 172.21.15.8:0/1679059587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2000f6530 msgr2=0x7fa200106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:37.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.921+0000 7fa1fffff700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2000f6530 0x7fa200106d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa2000f7630 tx=0x7fa1f000b040).stop 2023-10-18T21:04:37.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.921+0000 7fa1fffff700 1 -- 172.21.15.8:0/1679059587 shutdown_connections 2023-10-18T21:04:37.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.921+0000 7fa1fffff700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa1e8060f70 0x7fa1e8063430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.921+0000 7fa1fffff700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2000f6530 0x7fa200106d60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.921+0000 7fa1fffff700 1 --2- 172.21.15.8:0/1679059587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2000f77d0 0x7fa200107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:37.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.921+0000 7fa1fffff700 1 -- 172.21.15.8:0/1679059587 >> 172.21.15.8:0/1679059587 conn(0x7fa2000f1c90 msgr2=0x7fa2000fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:37.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.922+0000 7fa1fffff700 1 -- 172.21.15.8:0/1679059587 shutdown_connections 2023-10-18T21:04:37.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:37.922+0000 7fa1fffff700 1 -- 172.21.15.8:0/1679059587 wait complete. 2023-10-18T21:04:38.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.059+0000 7ff1a15de700 1 -- 172.21.15.8:0/83481158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 msgr2=0x7ff19c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:38.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.059+0000 7ff1a15de700 1 --2- 172.21.15.8:0/83481158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 0x7ff19c0f6950 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff18c004660 tx=0x7ff18c009b30).stop 2023-10-18T21:04:38.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.059+0000 7ff1a15de700 1 -- 172.21.15.8:0/83481158 shutdown_connections 2023-10-18T21:04:38.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.059+0000 7ff1a15de700 1 --2- 172.21.15.8:0/83481158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f77d0 0x7ff19c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.059+0000 7ff1a15de700 1 --2- 172.21.15.8:0/83481158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 0x7ff19c0f6950 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.059+0000 7ff1a15de700 1 -- 172.21.15.8:0/83481158 >> 172.21.15.8:0/83481158 conn(0x7ff19c0f1c90 msgr2=0x7ff19c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:38.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.059+0000 7ff1a15de700 1 -- 172.21.15.8:0/83481158 shutdown_connections 2023-10-18T21:04:38.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.059+0000 7ff1a15de700 1 -- 172.21.15.8:0/83481158 wait complete. 2023-10-18T21:04:38.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.060+0000 7ff1a15de700 1 Processor -- start 2023-10-18T21:04:38.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.061+0000 7ff1a15de700 1 -- start start 2023-10-18T21:04:38.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.061+0000 7ff1a15de700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 0x7ff19c108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:38.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.061+0000 7ff1a15de700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f77d0 0x7ff19c1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:38.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.061+0000 7ff1a15de700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c109a60 con 0x7ff19c0f6530 2023-10-18T21:04:38.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.061+0000 7ff1a15de700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c109ba0 con 0x7ff19c0f77d0 2023-10-18T21:04:38.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.061+0000 7ff19bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 0x7ff19c108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:38.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.061+0000 7ff19bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 0x7ff19c108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45590/0 (socket says 172.21.15.8:45590) 2023-10-18T21:04:38.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.061+0000 7ff19bfff700 1 -- 172.21.15.8:0/3194073928 learned_addr learned my addr 172.21.15.8:0/3194073928 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:38.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.062+0000 7ff19b7fe700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f77d0 0x7ff19c1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:38.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.062+0000 7ff19bfff700 1 -- 172.21.15.8:0/3194073928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f77d0 msgr2=0x7ff19c1094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:38.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.062+0000 7ff19bfff700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f77d0 0x7ff19c1094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.062+0000 7ff19bfff700 1 -- 172.21.15.8:0/3194073928 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c005040 con 0x7ff19c0f6530 2023-10-18T21:04:38.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.062+0000 7ff19bfff700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 0x7ff19c108fc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7ff18c007a60 tx=0x7ff18c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:38.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.062+0000 7ff198ff9700 1 -- 172.21.15.8:0/3194073928 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff18c018070 con 0x7ff19c0f6530 2023-10-18T21:04:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.062+0000 7ff198ff9700 1 -- 172.21.15.8:0/3194073928 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff18c009630 con 0x7ff19c0f6530 2023-10-18T21:04:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.062+0000 7ff1a15de700 1 -- 172.21.15.8:0/3194073928 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c10a4e0 con 0x7ff19c0f6530 2023-10-18T21:04:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.062+0000 7ff198ff9700 1 -- 172.21.15.8:0/3194073928 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff18c01c540 con 0x7ff19c0f6530 2023-10-18T21:04:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.063+0000 7ff1a15de700 1 -- 172.21.15.8:0/3194073928 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c10aa40 con 0x7ff19c0f6530 2023-10-18T21:04:38.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.064+0000 7ff1a15de700 1 -- 172.21.15.8:0/3194073928 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c045ad0 con 0x7ff19c0f6530 2023-10-18T21:04:38.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.065+0000 7ff198ff9700 1 -- 172.21.15.8:0/3194073928 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff18c01c7b0 con 0x7ff19c0f6530 2023-10-18T21:04:38.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.066+0000 7ff198ff9700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 0x7ff184063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:38.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.066+0000 7ff198ff9700 1 -- 172.21.15.8:0/3194073928 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff18c07dfa0 con 0x7ff19c0f6530 2023-10-18T21:04:38.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.066+0000 7ff19b7fe700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 0x7ff184063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:38.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.067+0000 7ff19b7fe700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 0x7ff184063430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff1900096c0 tx=0x7ff190009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:38.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.070+0000 7ff198ff9700 1 -- 172.21.15.8:0/3194073928 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff18c051d40 con 0x7ff19c0f6530 2023-10-18T21:04:38.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.291+0000 7ff1a15de700 1 -- 172.21.15.8:0/3194073928 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff19c0fee00 con 0x7ff184060f70 2023-10-18T21:04:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.302+0000 7ff198ff9700 1 -- 172.21.15.8:0/3194073928 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff19c0fee00 con 0x7ff184060f70 2023-10-18T21:04:38.304 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:04:38.304 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (11m) 2m ago 12m 15.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:04:38.305 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (5m) 2m ago 12m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:04:38.305 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (5m) 43s ago 11m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:04:38.305 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (11m) 2m ago 12m 25.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:04:38.305 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (8m) 2m ago 8m 7674M - 16.2.4 8d91d370c2b8 bb0dbfbe0572 2023-10-18T21:04:38.305 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 running (8m) 2m ago 8m 919M - 16.2.4 8d91d370c2b8 2e885521f52f 2023-10-18T21:04:38.306 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (8m) 43s ago 8m 3802M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:04:38.306 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (8m) 43s ago 8m 478M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:04:38.306 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (6m) 2m ago 14m 451M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:04:38.306 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (5m) 43s ago 11m 396M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:04:38.306 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (5m) 2m ago 14m 91.5M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:04:38.307 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (5m) 43s ago 11m 85.3M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:04:38.307 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (12m) 2m ago 12m 9625k - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:04:38.307 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (11m) 43s ago 11m 9.87M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:04:38.307 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (4m) 2m ago 11m 414M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:04:38.307 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (2m) 2m ago 11m 285M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:04:38.308 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (2m) 2m ago 10m 10.7M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:04:38.308 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (114s) 43s ago 10m 340M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:04:38.308 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (73s) 43s ago 10m 305M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:04:38.308 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (46s) 43s ago 9m 10.6M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:04:38.308 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (6m) 2m ago 12m 58.7M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:04:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 -- 172.21.15.8:0/3194073928 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 msgr2=0x7ff184063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 0x7ff184063430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff1900096c0 tx=0x7ff190009be0).stop 2023-10-18T21:04:38.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 -- 172.21.15.8:0/3194073928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 msgr2=0x7ff19c108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:38.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 0x7ff19c108fc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7ff18c007a60 tx=0x7ff18c009b30).stop 2023-10-18T21:04:38.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 -- 172.21.15.8:0/3194073928 shutdown_connections 2023-10-18T21:04:38.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 0x7ff184063430 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 0x7ff19c108fc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 --2- 172.21.15.8:0/3194073928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f77d0 0x7ff19c1094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 -- 172.21.15.8:0/3194073928 >> 172.21.15.8:0/3194073928 conn(0x7ff19c0f1c90 msgr2=0x7ff19c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:38.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 -- 172.21.15.8:0/3194073928 shutdown_connections 2023-10-18T21:04:38.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.304+0000 7ff1a15de700 1 -- 172.21.15.8:0/3194073928 wait complete. 2023-10-18T21:04:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.448+0000 7f4292ffe700 1 -- 172.21.15.8:0/2492745087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428c0f6530 msgr2=0x7f428c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.448+0000 7f4292ffe700 1 --2- 172.21.15.8:0/2492745087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428c0f6530 0x7f428c0f6950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f4288004660 tx=0x7f4288009b30).stop 2023-10-18T21:04:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.448+0000 7f4292ffe700 1 -- 172.21.15.8:0/2492745087 shutdown_connections 2023-10-18T21:04:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.448+0000 7f4292ffe700 1 --2- 172.21.15.8:0/2492745087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c0f77d0 0x7f428c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.448+0000 7f4292ffe700 1 --2- 172.21.15.8:0/2492745087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428c0f6530 0x7f428c0f6950 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.448+0000 7f4292ffe700 1 -- 172.21.15.8:0/2492745087 >> 172.21.15.8:0/2492745087 conn(0x7f428c0f1c90 msgr2=0x7f428c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.448+0000 7f4292ffe700 1 -- 172.21.15.8:0/2492745087 shutdown_connections 2023-10-18T21:04:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.449+0000 7f4292ffe700 1 -- 172.21.15.8:0/2492745087 wait complete. 2023-10-18T21:04:38.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.449+0000 7f4292ffe700 1 Processor -- start 2023-10-18T21:04:38.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.450+0000 7f4292ffe700 1 -- start start 2023-10-18T21:04:38.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.450+0000 7f4292ffe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c0f6530 0x7f428c108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:38.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.450+0000 7f4292ffe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428c0f77d0 0x7f428c109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:38.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.450+0000 7f4292ffe700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c109a00 con 0x7f428c0f77d0 2023-10-18T21:04:38.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.450+0000 7f4292ffe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c109b40 con 0x7f428c0f6530 2023-10-18T21:04:38.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.450+0000 7f4291ffc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c0f6530 0x7f428c108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:38.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.450+0000 7f42917fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428c0f77d0 0x7f428c109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:38.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.450+0000 7f4291ffc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c0f6530 0x7f428c108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:49362/0 (socket says 172.21.15.8:49362) 2023-10-18T21:04:38.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.450+0000 7f42917fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428c0f77d0 0x7f428c109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45612/0 (socket says 172.21.15.8:45612) 2023-10-18T21:04:38.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.450+0000 7f4291ffc700 1 -- 172.21.15.8:0/1250348427 learned_addr learned my addr 172.21.15.8:0/1250348427 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:38.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.451+0000 7f42917fb700 1 -- 172.21.15.8:0/1250348427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c0f6530 msgr2=0x7f428c108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:38.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.451+0000 7f42917fb700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c0f6530 0x7f428c108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.451+0000 7f42917fb700 1 -- 172.21.15.8:0/1250348427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4288005040 con 0x7f428c0f77d0 2023-10-18T21:04:38.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.451+0000 7f4291ffc700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c0f6530 0x7f428c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:04:38.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.451+0000 7f42917fb700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428c0f77d0 0x7f428c109450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f427c00e7c0 tx=0x7f427c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:38.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.451+0000 7f42827fc700 1 -- 172.21.15.8:0/1250348427 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f427c0092e0 con 0x7f428c0f77d0 2023-10-18T21:04:38.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.451+0000 7f42827fc700 1 -- 172.21.15.8:0/1250348427 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f427c00f040 con 0x7f428c0f77d0 2023-10-18T21:04:38.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.451+0000 7f4292ffe700 1 -- 172.21.15.8:0/1250348427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c10a4e0 con 0x7f428c0f77d0 2023-10-18T21:04:38.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.451+0000 7f42827fc700 1 -- 172.21.15.8:0/1250348427 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f427c014920 con 0x7f428c0f77d0 2023-10-18T21:04:38.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.451+0000 7f4292ffe700 1 -- 172.21.15.8:0/1250348427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c10aa20 con 0x7f428c0f77d0 2023-10-18T21:04:38.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.453+0000 7f4292ffe700 1 -- 172.21.15.8:0/1250348427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c045ad0 con 0x7f428c0f77d0 2023-10-18T21:04:38.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.454+0000 7f42827fc700 1 -- 172.21.15.8:0/1250348427 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f427c01b030 con 0x7f428c0f77d0 2023-10-18T21:04:38.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.455+0000 7f42827fc700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4278060f70 0x7f4278063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:38.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.455+0000 7f42827fc700 1 -- 172.21.15.8:0/1250348427 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f427c07bff0 con 0x7f428c0f77d0 2023-10-18T21:04:38.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.455+0000 7f4291ffc700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4278060f70 0x7f4278063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:38.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.456+0000 7f4291ffc700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4278060f70 0x7f4278063430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4288009720 tx=0x7f4288016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:38.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.459+0000 7f42827fc700 1 -- 172.21.15.8:0/1250348427 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f427c04fdf0 con 0x7f428c0f77d0 2023-10-18T21:04:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:37.566051+0000 mgr.smithi008.flmjzp (mgr.14640) 317 : audit [DBG] from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:38.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.731+0000 7f4292ffe700 1 -- 172.21.15.8:0/1250348427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f428c10acf0 con 0x7f428c0f77d0 2023-10-18T21:04:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.731+0000 7f42827fc700 1 -- 172.21.15.8:0/1250348427 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f427c019070 con 0x7f428c0f77d0 2023-10-18T21:04:38.734 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:04:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:04:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:04:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:04:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:04:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:04:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:04:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:04:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:04:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:04:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:04:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 3 2023-10-18T21:04:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:04:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:04:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 10, 2023-10-18T21:04:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 3 2023-10-18T21:04:38.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:04:38.738 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:04:38.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:37.566051+0000 mgr.smithi008.flmjzp (mgr.14640) 317 : audit [DBG] from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:38.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.733+0000 7f4292ffe700 1 -- 172.21.15.8:0/1250348427 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4278060f70 msgr2=0x7f4278063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:38.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.733+0000 7f4292ffe700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4278060f70 0x7f4278063430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4288009720 tx=0x7f4288016040).stop 2023-10-18T21:04:38.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.733+0000 7f4292ffe700 1 -- 172.21.15.8:0/1250348427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428c0f77d0 msgr2=0x7f428c109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:38.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.733+0000 7f4292ffe700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428c0f77d0 0x7f428c109450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f427c00e7c0 tx=0x7f427c00b040).stop 2023-10-18T21:04:38.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.734+0000 7f4292ffe700 1 -- 172.21.15.8:0/1250348427 shutdown_connections 2023-10-18T21:04:38.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.734+0000 7f4292ffe700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4278060f70 0x7f4278063430 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.734+0000 7f4292ffe700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c0f6530 0x7f428c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.734+0000 7f4292ffe700 1 --2- 172.21.15.8:0/1250348427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428c0f77d0 0x7f428c109450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.734+0000 7f4292ffe700 1 -- 172.21.15.8:0/1250348427 >> 172.21.15.8:0/1250348427 conn(0x7f428c0f1c90 msgr2=0x7f428c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.734+0000 7f4292ffe700 1 -- 172.21.15.8:0/1250348427 shutdown_connections 2023-10-18T21:04:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.734+0000 7f4292ffe700 1 -- 172.21.15.8:0/1250348427 wait complete. 2023-10-18T21:04:38.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.872+0000 7f041285b700 1 -- 172.21.15.8:0/954984251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c060310 msgr2=0x7f040c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:38.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.872+0000 7f041285b700 1 --2- 172.21.15.8:0/954984251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c060310 0x7f040c0f9110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0408004660 tx=0x7f0408009b30).stop 2023-10-18T21:04:38.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.872+0000 7f041285b700 1 -- 172.21.15.8:0/954984251 shutdown_connections 2023-10-18T21:04:38.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.872+0000 7f041285b700 1 --2- 172.21.15.8:0/954984251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f9690 0x7f040c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.872+0000 7f041285b700 1 --2- 172.21.15.8:0/954984251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c060310 0x7f040c0f9110 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.872+0000 7f041285b700 1 -- 172.21.15.8:0/954984251 >> 172.21.15.8:0/954984251 conn(0x7f040c0f0b90 msgr2=0x7f040c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:38.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.873+0000 7f041285b700 1 -- 172.21.15.8:0/954984251 shutdown_connections 2023-10-18T21:04:38.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.873+0000 7f041285b700 1 -- 172.21.15.8:0/954984251 wait complete. 2023-10-18T21:04:38.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.873+0000 7f041285b700 1 Processor -- start 2023-10-18T21:04:38.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.874+0000 7f041285b700 1 -- start start 2023-10-18T21:04:38.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.874+0000 7f041285b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c060310 0x7f040c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:38.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.874+0000 7f041285b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f9690 0x7f040c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:38.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.874+0000 7f041285b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c109970 con 0x7f040c060310 2023-10-18T21:04:38.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.874+0000 7f041285b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c109ab0 con 0x7f040c0f9690 2023-10-18T21:04:38.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.874+0000 7f0411859700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c060310 0x7f040c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:38.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.875+0000 7f0411859700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c060310 0x7f040c108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45630/0 (socket says 172.21.15.8:45630) 2023-10-18T21:04:38.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.875+0000 7f0411859700 1 -- 172.21.15.8:0/2339818674 learned_addr learned my addr 172.21.15.8:0/2339818674 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:38.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.875+0000 7f0411058700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f9690 0x7f040c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:38.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.875+0000 7f0411859700 1 -- 172.21.15.8:0/2339818674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f9690 msgr2=0x7f040c1093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:38.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.875+0000 7f0411859700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f9690 0x7f040c1093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:38.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.875+0000 7f0411859700 1 -- 172.21.15.8:0/2339818674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408005040 con 0x7f040c060310 2023-10-18T21:04:38.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.875+0000 7f0411859700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c060310 0x7f040c108ed0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0408009990 tx=0x7f0408009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:38.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.875+0000 7f04027fc700 1 -- 172.21.15.8:0/2339818674 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0408018070 con 0x7f040c060310 2023-10-18T21:04:38.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.876+0000 7f04027fc700 1 -- 172.21.15.8:0/2339818674 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0408009630 con 0x7f040c060310 2023-10-18T21:04:38.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.876+0000 7f041285b700 1 -- 172.21.15.8:0/2339818674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c10a3f0 con 0x7f040c060310 2023-10-18T21:04:38.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.876+0000 7f04027fc700 1 -- 172.21.15.8:0/2339818674 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f040801c400 con 0x7f040c060310 2023-10-18T21:04:38.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.876+0000 7f041285b700 1 -- 172.21.15.8:0/2339818674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c10a950 con 0x7f040c060310 2023-10-18T21:04:38.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.877+0000 7f041285b700 1 -- 172.21.15.8:0/2339818674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040c045ad0 con 0x7f040c060310 2023-10-18T21:04:38.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.878+0000 7f04027fc700 1 -- 172.21.15.8:0/2339818674 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f040801d9e0 con 0x7f040c060310 2023-10-18T21:04:38.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.879+0000 7f04027fc700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f8060f70 0x7f03f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:38.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.879+0000 7f04027fc700 1 -- 172.21.15.8:0/2339818674 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f040807de00 con 0x7f040c060310 2023-10-18T21:04:38.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.879+0000 7f0411058700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f8060f70 0x7f03f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:38.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.880+0000 7f0411058700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f8060f70 0x7f03f8063430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f040c0600e0 tx=0x7f03fc009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:38.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:38.883+0000 7f04027fc700 1 -- 172.21.15.8:0/2339818674 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0408051ce0 con 0x7f040c060310 2023-10-18T21:04:39.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.119+0000 7f041285b700 1 -- 172.21.15.8:0/2339818674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f040c0fee60 con 0x7f040c060310 2023-10-18T21:04:39.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.120+0000 7f04027fc700 1 -- 172.21.15.8:0/2339818674 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1585 (secure 0 0 0) 0x7f04080518d0 con 0x7f040c060310 2023-10-18T21:04:39.123 INFO:teuthology.orchestra.run.smithi008.stdout:e25 2023-10-18T21:04:39.123 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:04:39.123 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:04:39.123 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:04:39.123 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:04:39.124 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:04:39.124 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:04:39.124 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 25 2023-10-18T21:04:39.124 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:04:39.124 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:04:39.125 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:04:29.885262+0000 2023-10-18T21:04:39.125 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:04:39.125 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:04:39.125 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:04:39.125 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:04:39.126 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:04:39.126 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:04:39.126 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:04:39.126 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 84 2023-10-18T21:04:39.126 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:04:39.127 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:04:39.127 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:04:39.127 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=34332} 2023-10-18T21:04:39.127 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:04:39.127 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:04:39.128 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:04:39.128 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:04:39.128 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:04:39.128 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:04:39.128 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:04:39.129 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:04:39.129 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:34332} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.8:6828/460576416,v1:172.21.15.8:6829/460576416] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:04:39.129 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:04:39.129 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:04:39.129 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:04:39.129 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:04:39.130 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:04:39.130 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6824/894252909,v1:172.21.15.60:6825/894252909] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:04:39.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 -- 172.21.15.8:0/2339818674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f8060f70 msgr2=0x7f03f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f8060f70 0x7f03f8063430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f040c0600e0 tx=0x7f03fc009c60).stop 2023-10-18T21:04:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 -- 172.21.15.8:0/2339818674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c060310 msgr2=0x7f040c108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c060310 0x7f040c108ed0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0408009990 tx=0x7f0408009b30).stop 2023-10-18T21:04:39.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 -- 172.21.15.8:0/2339818674 shutdown_connections 2023-10-18T21:04:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f8060f70 0x7f03f8063430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c060310 0x7f040c108ed0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 --2- 172.21.15.8:0/2339818674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f9690 0x7f040c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 -- 172.21.15.8:0/2339818674 >> 172.21.15.8:0/2339818674 conn(0x7f040c0f0b90 msgr2=0x7f040c0f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:39.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 -- 172.21.15.8:0/2339818674 shutdown_connections 2023-10-18T21:04:39.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.122+0000 7f041285b700 1 -- 172.21.15.8:0/2339818674 wait complete. 2023-10-18T21:04:39.133 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 25 2023-10-18T21:04:39.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.261+0000 7f37b9a54700 1 -- 172.21.15.8:0/2354899149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b40f6530 msgr2=0x7f37b40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:39.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.261+0000 7f37b9a54700 1 --2- 172.21.15.8:0/2354899149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b40f6530 0x7f37b40f6950 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f37a8004660 tx=0x7f37a8009b30).stop 2023-10-18T21:04:39.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.261+0000 7f37b9a54700 1 -- 172.21.15.8:0/2354899149 shutdown_connections 2023-10-18T21:04:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.261+0000 7f37b9a54700 1 --2- 172.21.15.8:0/2354899149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b40f77d0 0x7f37b40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.261+0000 7f37b9a54700 1 --2- 172.21.15.8:0/2354899149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b40f6530 0x7f37b40f6950 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.261+0000 7f37b9a54700 1 -- 172.21.15.8:0/2354899149 >> 172.21.15.8:0/2354899149 conn(0x7f37b40f1c90 msgr2=0x7f37b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.261+0000 7f37b9a54700 1 -- 172.21.15.8:0/2354899149 shutdown_connections 2023-10-18T21:04:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.261+0000 7f37b9a54700 1 -- 172.21.15.8:0/2354899149 wait complete. 2023-10-18T21:04:39.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.262+0000 7f37b9a54700 1 Processor -- start 2023-10-18T21:04:39.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.262+0000 7f37b9a54700 1 -- start start 2023-10-18T21:04:39.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.263+0000 7f37b9a54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b40f6530 0x7f37b4106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:39.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.263+0000 7f37b9a54700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b40f77d0 0x7f37b4107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:39.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.263+0000 7f37b9a54700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4107910 con 0x7f37b40f77d0 2023-10-18T21:04:39.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.263+0000 7f37b9a54700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4108120 con 0x7f37b40f6530 2023-10-18T21:04:39.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.263+0000 7f37b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b40f77d0 0x7f37b4107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:39.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.263+0000 7f37b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b40f77d0 0x7f37b4107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45646/0 (socket says 172.21.15.8:45646) 2023-10-18T21:04:39.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.263+0000 7f37b3fff700 1 -- 172.21.15.8:0/2040407100 learned_addr learned my addr 172.21.15.8:0/2040407100 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:04:39.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.263+0000 7f37b8a52700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b40f6530 0x7f37b4106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:39.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.264+0000 7f37b3fff700 1 -- 172.21.15.8:0/2040407100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b40f6530 msgr2=0x7f37b4106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:39.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.264+0000 7f37b3fff700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b40f6530 0x7f37b4106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:39.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.264+0000 7f37b3fff700 1 -- 172.21.15.8:0/2040407100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8005040 con 0x7f37b40f77d0 2023-10-18T21:04:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.264+0000 7f37b3fff700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b40f77d0 0x7f37b4107310 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f37a00026d0 tx=0x7f37a0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.264+0000 7f37b17fa700 1 -- 172.21.15.8:0/2040407100 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37a0009320 con 0x7f37b40f77d0 2023-10-18T21:04:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.264+0000 7f37b9a54700 1 -- 172.21.15.8:0/2040407100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b41083a0 con 0x7f37b40f77d0 2023-10-18T21:04:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.264+0000 7f37b17fa700 1 -- 172.21.15.8:0/2040407100 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f37a000f040 con 0x7f37b40f77d0 2023-10-18T21:04:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.264+0000 7f37b17fa700 1 -- 172.21.15.8:0/2040407100 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37a00148a0 con 0x7f37b40f77d0 2023-10-18T21:04:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.264+0000 7f37b9a54700 1 -- 172.21.15.8:0/2040407100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b4108960 con 0x7f37b40f77d0 2023-10-18T21:04:39.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.265+0000 7f37b9a54700 1 -- 172.21.15.8:0/2040407100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b4059100 con 0x7f37b40f77d0 2023-10-18T21:04:39.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.267+0000 7f37b17fa700 1 -- 172.21.15.8:0/2040407100 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f37a0009480 con 0x7f37b40f77d0 2023-10-18T21:04:39.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.268+0000 7f37b17fa700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37a4060f70 0x7f37a4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:04:39.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.269+0000 7f37b17fa700 1 -- 172.21.15.8:0/2040407100 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f37a007c6e0 con 0x7f37b40f77d0 2023-10-18T21:04:39.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.269+0000 7f37b8a52700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37a4060f70 0x7f37a4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:04:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.270+0000 7f37b8a52700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37a4060f70 0x7f37a4063430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f37a8005010 tx=0x7f37a8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:04:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.273+0000 7f37b17fa700 1 -- 172.21.15.8:0/2040407100 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f37a004cb90 con 0x7f37b40f77d0 2023-10-18T21:04:39.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.479+0000 7f37b9a54700 1 -- 172.21.15.8:0/2040407100 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37b40fedb0 con 0x7f37a4060f70 2023-10-18T21:04:39.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.480+0000 7f37b17fa700 1 -- 172.21.15.8:0/2040407100 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f37b40fedb0 con 0x7f37a4060f70 2023-10-18T21:04:39.482 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:04:39.482 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:04:39.483 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:04:39.483 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:04:39.483 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:04:39.483 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:04:39.483 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:04:39.484 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:04:39.484 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:04:39.484 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:04:39.484 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:04:39.484 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:04:39.485 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:04:39.485 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:04:39.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 -- 172.21.15.8:0/2040407100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37a4060f70 msgr2=0x7f37a4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:39.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37a4060f70 0x7f37a4063430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f37a8005010 tx=0x7f37a8009b30).stop 2023-10-18T21:04:39.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 -- 172.21.15.8:0/2040407100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b40f77d0 msgr2=0x7f37b4107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:04:39.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b40f77d0 0x7f37b4107310 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f37a00026d0 tx=0x7f37a0009de0).stop 2023-10-18T21:04:39.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 -- 172.21.15.8:0/2040407100 shutdown_connections 2023-10-18T21:04:39.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37a4060f70 0x7f37a4063430 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:39.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b40f6530 0x7f37b4106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:39.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 --2- 172.21.15.8:0/2040407100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b40f77d0 0x7f37b4107310 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:04:39.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 -- 172.21.15.8:0/2040407100 >> 172.21.15.8:0/2040407100 conn(0x7f37b40f1c90 msgr2=0x7f37b40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:04:39.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 -- 172.21.15.8:0/2040407100 shutdown_connections 2023-10-18T21:04:39.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:04:39.482+0000 7f37b9a54700 1 -- 172.21.15.8:0/2040407100 wait complete. 2023-10-18T21:04:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:37.920790+0000 mgr.smithi008.flmjzp (mgr.14640) 318 : audit [DBG] from='client.44339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:38.213172+0000 mgr.smithi008.flmjzp (mgr.14640) 319 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2023-10-18T21:04:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:38.294179+0000 mgr.smithi008.flmjzp (mgr.14640) 320 : audit [DBG] from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:38.733128+0000 mon.smithi008 (mon.0) 583 : audit [DBG] from='client.? 172.21.15.8:0/1250348427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:39.121372+0000 mon.smithi008 (mon.0) 584 : audit [DBG] from='client.? 172.21.15.8:0/2339818674' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:04:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:37.920790+0000 mgr.smithi008.flmjzp (mgr.14640) 318 : audit [DBG] from='client.44339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:38.213172+0000 mgr.smithi008.flmjzp (mgr.14640) 319 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2023-10-18T21:04:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:38.294179+0000 mgr.smithi008.flmjzp (mgr.14640) 320 : audit [DBG] from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:38.733128+0000 mon.smithi008 (mon.0) 583 : audit [DBG] from='client.? 172.21.15.8:0/1250348427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:39.121372+0000 mon.smithi008 (mon.0) 584 : audit [DBG] from='client.? 172.21.15.8:0/2339818674' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:04:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:39.481141+0000 mgr.smithi008.flmjzp (mgr.14640) 321 : audit [DBG] from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:39.481141+0000 mgr.smithi008.flmjzp (mgr.14640) 321 : audit [DBG] from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:04:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:40.213548+0000 mgr.smithi008.flmjzp (mgr.14640) 322 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2023-10-18T21:04:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:40.286682+0000 mon.smithi008 (mon.0) 585 : cluster [DBG] mds.? [v2:172.21.15.8:6828/460576416,v1:172.21.15.8:6829/460576416] up:reconnect 2023-10-18T21:04:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:40.286743+0000 mon.smithi008 (mon.0) 586 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:reconnect} 2 up:standby 2023-10-18T21:04:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:40.296148+0000 mds.cephfs.smithi008.mpstiw (mds.0) 1 : cluster [DBG] reconnect by client.24369 v1:172.21.15.8:0/434732952 after 0.0099999 2023-10-18T21:04:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:40.296725+0000 mds.cephfs.smithi008.mpstiw (mds.0) 2 : cluster [DBG] reconnect by client.24375 v1:192.168.0.1:0/1489169714 after 0.0109999 2023-10-18T21:04:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:40.213548+0000 mgr.smithi008.flmjzp (mgr.14640) 322 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2023-10-18T21:04:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:40.286682+0000 mon.smithi008 (mon.0) 585 : cluster [DBG] mds.? [v2:172.21.15.8:6828/460576416,v1:172.21.15.8:6829/460576416] up:reconnect 2023-10-18T21:04:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:40.286743+0000 mon.smithi008 (mon.0) 586 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:reconnect} 2 up:standby 2023-10-18T21:04:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:40.296148+0000 mds.cephfs.smithi008.mpstiw (mds.0) 1 : cluster [DBG] reconnect by client.24369 v1:172.21.15.8:0/434732952 after 0.0099999 2023-10-18T21:04:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:40.296725+0000 mds.cephfs.smithi008.mpstiw (mds.0) 2 : cluster [DBG] reconnect by client.24375 v1:192.168.0.1:0/1489169714 after 0.0109999 2023-10-18T21:04:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:41.288604+0000 mon.smithi008 (mon.0) 587 : cluster [DBG] mds.? [v2:172.21.15.8:6828/460576416,v1:172.21.15.8:6829/460576416] up:rejoin 2023-10-18T21:04:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:41.288675+0000 mon.smithi008 (mon.0) 588 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:rejoin} 2 up:standby 2023-10-18T21:04:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:41.326411+0000 mon.smithi008 (mon.0) 589 : cluster [INF] daemon mds.cephfs.smithi008.mpstiw is now active in filesystem cephfs as rank 0 2023-10-18T21:04:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:41.573260+0000 mon.smithi008 (mon.0) 590 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:41.574171+0000 mon.smithi008 (mon.0) 591 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:41.288604+0000 mon.smithi008 (mon.0) 587 : cluster [DBG] mds.? [v2:172.21.15.8:6828/460576416,v1:172.21.15.8:6829/460576416] up:rejoin 2023-10-18T21:04:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:41.288675+0000 mon.smithi008 (mon.0) 588 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:rejoin} 2 up:standby 2023-10-18T21:04:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:41.326411+0000 mon.smithi008 (mon.0) 589 : cluster [INF] daemon mds.cephfs.smithi008.mpstiw is now active in filesystem cephfs as rank 0 2023-10-18T21:04:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:41.573260+0000 mon.smithi008 (mon.0) 590 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:42.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:41.574171+0000 mon.smithi008 (mon.0) 591 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:42.213916+0000 mgr.smithi008.flmjzp (mgr.14640) 323 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2023-10-18T21:04:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:42.290774+0000 mon.smithi008 (mon.0) 592 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-18T21:04:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:42.290798+0000 mon.smithi008 (mon.0) 593 : cluster [INF] Cluster is now healthy 2023-10-18T21:04:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:42.300562+0000 mon.smithi008 (mon.0) 594 : cluster [DBG] mds.? [v2:172.21.15.8:6828/460576416,v1:172.21.15.8:6829/460576416] up:active 2023-10-18T21:04:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:42.300621+0000 mon.smithi008 (mon.0) 595 : cluster [DBG] mds.? [v2:172.21.15.8:6826/3196777892,v1:172.21.15.8:6827/3196777892] up:boot 2023-10-18T21:04:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:42.300687+0000 mon.smithi008 (mon.0) 596 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.mpstiw=up:active} 3 up:standby 2023-10-18T21:04:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:42.300852+0000 mon.smithi008 (mon.0) 597 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:04:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:42.213916+0000 mgr.smithi008.flmjzp (mgr.14640) 323 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2023-10-18T21:04:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:42.290774+0000 mon.smithi008 (mon.0) 592 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-18T21:04:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:42.290798+0000 mon.smithi008 (mon.0) 593 : cluster [INF] Cluster is now healthy 2023-10-18T21:04:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:42.300562+0000 mon.smithi008 (mon.0) 594 : cluster [DBG] mds.? [v2:172.21.15.8:6828/460576416,v1:172.21.15.8:6829/460576416] up:active 2023-10-18T21:04:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:42.300621+0000 mon.smithi008 (mon.0) 595 : cluster [DBG] mds.? [v2:172.21.15.8:6826/3196777892,v1:172.21.15.8:6827/3196777892] up:boot 2023-10-18T21:04:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:42.300687+0000 mon.smithi008 (mon.0) 596 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi008.mpstiw=up:active} 3 up:standby 2023-10-18T21:04:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:42.300852+0000 mon.smithi008 (mon.0) 597 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:04:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:44.214260+0000 mgr.smithi008.flmjzp (mgr.14640) 324 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2023-10-18T21:04:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:44.214260+0000 mgr.smithi008.flmjzp (mgr.14640) 324 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2023-10-18T21:04:46.708 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:45.447541+0000 mon.smithi008 (mon.0) 598 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:45.447541+0000 mon.smithi008 (mon.0) 598 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:46.214781+0000 mgr.smithi008.flmjzp (mgr.14640) 325 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 4 op/s 2023-10-18T21:04:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:46.214781+0000 mgr.smithi008.flmjzp (mgr.14640) 325 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 4 op/s 2023-10-18T21:04:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:48.215213+0000 mgr.smithi008.flmjzp (mgr.14640) 326 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 170 B/s wr, 4 op/s 2023-10-18T21:04:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:48.215213+0000 mgr.smithi008.flmjzp (mgr.14640) 326 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 170 B/s wr, 4 op/s 2023-10-18T21:04:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:50.215639+0000 mgr.smithi008.flmjzp (mgr.14640) 327 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2023-10-18T21:04:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:50.578505+0000 mon.smithi008 (mon.0) 599 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:50.579476+0000 mon.smithi008 (mon.0) 600 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:50.580237+0000 mon.smithi008 (mon.0) 601 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:04:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:50.580905+0000 mgr.smithi008.flmjzp (mgr.14640) 328 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:04:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:50.584210+0000 mon.smithi008 (mon.0) 602 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:50.589210+0000 mon.smithi008 (mon.0) 603 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:50.591629+0000 mon.smithi008 (mon.0) 604 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:50.592849+0000 mon.smithi008 (mon.0) 605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:51.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:50.594016+0000 mon.smithi008 (mon.0) 606 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:51.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:50.595528+0000 mon.smithi008 (mon.0) 607 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:51.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:50.597214+0000 mon.smithi008 (mon.0) 608 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi008.mpstiw"]}]: dispatch 2023-10-18T21:04:51.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:50.597760+0000 mgr.smithi008.flmjzp (mgr.14640) 329 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi008.mpstiw 2023-10-18T21:04:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:50.215639+0000 mgr.smithi008.flmjzp (mgr.14640) 327 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2023-10-18T21:04:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:50.578505+0000 mon.smithi008 (mon.0) 599 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:50.579476+0000 mon.smithi008 (mon.0) 600 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:50.580237+0000 mon.smithi008 (mon.0) 601 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:04:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:50.580905+0000 mgr.smithi008.flmjzp (mgr.14640) 328 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:04:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:50.584210+0000 mon.smithi008 (mon.0) 602 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:51.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:50.589210+0000 mon.smithi008 (mon.0) 603 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:04:51.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:50.591629+0000 mon.smithi008 (mon.0) 604 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:51.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:50.592849+0000 mon.smithi008 (mon.0) 605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:51.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:50.594016+0000 mon.smithi008 (mon.0) 606 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:51.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:50.595528+0000 mon.smithi008 (mon.0) 607 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:04:51.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:50.597214+0000 mon.smithi008 (mon.0) 608 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi008.mpstiw"]}]: dispatch 2023-10-18T21:04:51.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:50.597760+0000 mgr.smithi008.flmjzp (mgr.14640) 329 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi008.mpstiw 2023-10-18T21:04:52.913 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:51.694820+0000 mgr.smithi008.flmjzp (mgr.14640) 330 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi008.mpstiw 2023-10-18T21:04:52.913 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:51.699303+0000 mon.smithi008 (mon.0) 609 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:52.914 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:51.700168+0000 mon.smithi008 (mon.0) 610 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.mpstiw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T21:04:52.914 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:51.700901+0000 mon.smithi008 (mon.0) 611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:52.914 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:04:51.701523+0000 mgr.smithi008.flmjzp (mgr.14640) 331 : cephadm [INF] Deploying daemon mds.cephfs.smithi008.mpstiw on smithi008 2023-10-18T21:04:52.914 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:52.216006+0000 mgr.smithi008.flmjzp (mgr.14640) 332 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2023-10-18T21:04:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:51.694820+0000 mgr.smithi008.flmjzp (mgr.14640) 330 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi008.mpstiw 2023-10-18T21:04:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:51.699303+0000 mon.smithi008 (mon.0) 609 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:04:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:51.700168+0000 mon.smithi008 (mon.0) 610 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi008.mpstiw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T21:04:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:51.700901+0000 mon.smithi008 (mon.0) 611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:04:52.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:04:51.701523+0000 mgr.smithi008.flmjzp (mgr.14640) 331 : cephadm [INF] Deploying daemon mds.cephfs.smithi008.mpstiw on smithi008 2023-10-18T21:04:52.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:52.216006+0000 mgr.smithi008.flmjzp (mgr.14640) 332 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2023-10-18T21:04:53.866 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:04:53.703+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:04:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:53.027302+0000 mon.smithi008 (mon.0) 612 : cluster [DBG] osdmap e85: 6 total, 6 up, 6 in 2023-10-18T21:04:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:53.704295+0000 mon.smithi008 (mon.0) 613 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-18T21:04:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:53.704324+0000 mon.smithi008 (mon.0) 614 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:04:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:53.708643+0000 mon.smithi008 (mon.0) 615 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:04:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:53.708749+0000 mon.smithi008 (mon.0) 616 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:04:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:53.709022+0000 mon.smithi008 (mon.0) 617 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-10-18T21:04:54.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:53.711862+0000 mon.smithi008 (mon.0) 618 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 2 up:standby 2023-10-18T21:04:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:53.027302+0000 mon.smithi008 (mon.0) 612 : cluster [DBG] osdmap e85: 6 total, 6 up, 6 in 2023-10-18T21:04:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:53.704295+0000 mon.smithi008 (mon.0) 613 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-18T21:04:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:53.704324+0000 mon.smithi008 (mon.0) 614 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:04:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:53.708643+0000 mon.smithi008 (mon.0) 615 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:04:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:53.708749+0000 mon.smithi008 (mon.0) 616 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:04:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:53.709022+0000 mon.smithi008 (mon.0) 617 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-10-18T21:04:54.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:53.711862+0000 mon.smithi008 (mon.0) 618 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 2 up:standby 2023-10-18T21:04:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:54.216382+0000 mgr.smithi008.flmjzp (mgr.14640) 333 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2023-10-18T21:04:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:54.216382+0000 mgr.smithi008.flmjzp (mgr.14640) 333 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2023-10-18T21:04:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:56.216871+0000 mgr.smithi008.flmjzp (mgr.14640) 334 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 5.0 KiB/s wr, 3 op/s 2023-10-18T21:04:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:04:56.708995+0000 mon.smithi008 (mon.0) 619 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:04:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:56.216871+0000 mgr.smithi008.flmjzp (mgr.14640) 334 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 5.0 KiB/s wr, 3 op/s 2023-10-18T21:04:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:04:56.708995+0000 mon.smithi008 (mon.0) 619 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:04:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:04:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:04:58.217265+0000 mgr.smithi008.flmjzp (mgr.14640) 335 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.0 KiB/s wr, 2 op/s 2023-10-18T21:04:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:04:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:04:58.217265+0000 mgr.smithi008.flmjzp (mgr.14640) 335 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.0 KiB/s wr, 2 op/s 2023-10-18T21:05:01.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:00.217743+0000 mgr.smithi008.flmjzp (mgr.14640) 336 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-10-18T21:05:01.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:00.448147+0000 mon.smithi008 (mon.0) 620 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:00.217743+0000 mgr.smithi008.flmjzp (mgr.14640) 336 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-10-18T21:05:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:00.448147+0000 mon.smithi008 (mon.0) 620 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:02.218122+0000 mgr.smithi008.flmjzp (mgr.14640) 337 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:03.866 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:02.218122+0000 mgr.smithi008.flmjzp (mgr.14640) 337 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:05.137 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:04.024499+0000 mon.smithi008 (mon.0) 621 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:05.137 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:04.025333+0000 mon.smithi008 (mon.0) 622 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:05.137 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:04.218518+0000 mgr.smithi008.flmjzp (mgr.14640) 338 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:05.137 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:04.457046+0000 mon.smithi008 (mon.0) 623 : cluster [DBG] mds.? [v2:172.21.15.8:6826/3779014978,v1:172.21.15.8:6827/3779014978] up:boot 2023-10-18T21:05:05.138 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:04.457127+0000 mon.smithi008 (mon.0) 624 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 3 up:standby 2023-10-18T21:05:05.138 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:04.457293+0000 mon.smithi008 (mon.0) 625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:05:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:04.024499+0000 mon.smithi008 (mon.0) 621 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:04.025333+0000 mon.smithi008 (mon.0) 622 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:04.218518+0000 mgr.smithi008.flmjzp (mgr.14640) 338 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:04.457046+0000 mon.smithi008 (mon.0) 623 : cluster [DBG] mds.? [v2:172.21.15.8:6826/3779014978,v1:172.21.15.8:6827/3779014978] up:boot 2023-10-18T21:05:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:04.457127+0000 mon.smithi008 (mon.0) 624 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 3 up:standby 2023-10-18T21:05:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:04.457293+0000 mon.smithi008 (mon.0) 625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:05:06.380 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:05:06.026+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:06.380 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:05.159711+0000 mon.smithi008 (mon.0) 626 : cluster [INF] daemon mds.cephfs.smithi008.lehgco restarted 2023-10-18T21:05:06.380 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:05.164041+0000 mon.smithi008 (mon.0) 627 : cluster [DBG] osdmap e86: 6 total, 6 up, 6 in 2023-10-18T21:05:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:05.159711+0000 mon.smithi008 (mon.0) 626 : cluster [INF] daemon mds.cephfs.smithi008.lehgco restarted 2023-10-18T21:05:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:05.164041+0000 mon.smithi008 (mon.0) 627 : cluster [DBG] osdmap e86: 6 total, 6 up, 6 in 2023-10-18T21:05:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:06.028368+0000 mon.smithi008 (mon.0) 628 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:06.036367+0000 mon.smithi008 (mon.0) 629 : cluster [DBG] mds.? [v2:172.21.15.8:6828/547859340,v1:172.21.15.8:6829/547859340] up:boot 2023-10-18T21:05:07.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:06.036432+0000 mon.smithi008 (mon.0) 630 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:05:07.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:06.036559+0000 mon.smithi008 (mon.0) 631 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:05:07.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:06.036823+0000 mon.smithi008 (mon.0) 632 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:05:07.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:06.036972+0000 mon.smithi008 (mon.0) 633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:05:07.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:06.040667+0000 mon.smithi008 (mon.0) 634 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 3 up:standby 2023-10-18T21:05:07.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:06.218844+0000 mgr.smithi008.flmjzp (mgr.14640) 339 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:06.028368+0000 mon.smithi008 (mon.0) 628 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:06.036367+0000 mon.smithi008 (mon.0) 629 : cluster [DBG] mds.? [v2:172.21.15.8:6828/547859340,v1:172.21.15.8:6829/547859340] up:boot 2023-10-18T21:05:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:06.036432+0000 mon.smithi008 (mon.0) 630 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:05:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:06.036559+0000 mon.smithi008 (mon.0) 631 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:05:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:06.036823+0000 mon.smithi008 (mon.0) 632 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:05:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:06.036972+0000 mon.smithi008 (mon.0) 633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:05:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:06.040667+0000 mon.smithi008 (mon.0) 634 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 3 up:standby 2023-10-18T21:05:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:06.218844+0000 mgr.smithi008.flmjzp (mgr.14640) 339 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:09.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.636+0000 7fb765e34700 1 -- 172.21.15.8:0/974550458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7600f77d0 msgr2=0x7fb7600f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:09.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.636+0000 7fb765e34700 1 --2- 172.21.15.8:0/974550458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7600f77d0 0x7fb7600f7c30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fb74c004660 tx=0x7fb74c009b30).stop 2023-10-18T21:05:09.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.636+0000 7fb765e34700 1 -- 172.21.15.8:0/974550458 shutdown_connections 2023-10-18T21:05:09.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.636+0000 7fb765e34700 1 --2- 172.21.15.8:0/974550458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7600f77d0 0x7fb7600f7c30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:09.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.636+0000 7fb765e34700 1 --2- 172.21.15.8:0/974550458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7600f6530 0x7fb7600f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:09.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.636+0000 7fb765e34700 1 -- 172.21.15.8:0/974550458 >> 172.21.15.8:0/974550458 conn(0x7fb7600f1c90 msgr2=0x7fb7600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:09.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.636+0000 7fb765e34700 1 -- 172.21.15.8:0/974550458 shutdown_connections 2023-10-18T21:05:09.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.637+0000 7fb765e34700 1 -- 172.21.15.8:0/974550458 wait complete. 2023-10-18T21:05:09.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.637+0000 7fb765e34700 1 Processor -- start 2023-10-18T21:05:09.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.638+0000 7fb765e34700 1 -- start start 2023-10-18T21:05:09.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.638+0000 7fb765e34700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7600f6530 0x7fb760106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:09.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.638+0000 7fb765e34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7600f77d0 0x7fb760107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:09.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.638+0000 7fb765e34700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb760107880 con 0x7fb7600f6530 2023-10-18T21:05:09.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.638+0000 7fb765e34700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7601080c0 con 0x7fb7600f77d0 2023-10-18T21:05:09.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.638+0000 7fb764e32700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7600f6530 0x7fb760106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:09.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.638+0000 7fb764e32700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7600f6530 0x7fb760106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39696/0 (socket says 172.21.15.8:39696) 2023-10-18T21:05:09.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.638+0000 7fb764e32700 1 -- 172.21.15.8:0/2746148978 learned_addr learned my addr 172.21.15.8:0/2746148978 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:09.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.638+0000 7fb75ffff700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7600f77d0 0x7fb760107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:09.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.639+0000 7fb764e32700 1 -- 172.21.15.8:0/2746148978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7600f77d0 msgr2=0x7fb760107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:09.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.639+0000 7fb764e32700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7600f77d0 0x7fb760107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:09.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.639+0000 7fb764e32700 1 -- 172.21.15.8:0/2746148978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c005040 con 0x7fb7600f6530 2023-10-18T21:05:09.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.639+0000 7fb764e32700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7600f6530 0x7fb760106d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fb754002700 tx=0x7fb754009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:09.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.639+0000 7fb75d7fa700 1 -- 172.21.15.8:0/2746148978 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7540079c0 con 0x7fb7600f6530 2023-10-18T21:05:09.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.639+0000 7fb75d7fa700 1 -- 172.21.15.8:0/2746148978 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb75400f040 con 0x7fb7600f6530 2023-10-18T21:05:09.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.639+0000 7fb75d7fa700 1 -- 172.21.15.8:0/2746148978 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7540148d0 con 0x7fb7600f6530 2023-10-18T21:05:09.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.639+0000 7fb765e34700 1 -- 172.21.15.8:0/2746148978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7601083a0 con 0x7fb7600f6530 2023-10-18T21:05:09.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.639+0000 7fb765e34700 1 -- 172.21.15.8:0/2746148978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7601088e0 con 0x7fb7600f6530 2023-10-18T21:05:09.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.641+0000 7fb765e34700 1 -- 172.21.15.8:0/2746148978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb760059100 con 0x7fb7600f6530 2023-10-18T21:05:09.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.641+0000 7fb75d7fa700 1 -- 172.21.15.8:0/2746148978 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb75401b060 con 0x7fb7600f6530 2023-10-18T21:05:09.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.642+0000 7fb75d7fa700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb750060f70 0x7fb750063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:09.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.642+0000 7fb75d7fa700 1 -- 172.21.15.8:0/2746148978 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb75407bfa0 con 0x7fb7600f6530 2023-10-18T21:05:09.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.642+0000 7fb75ffff700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb750060f70 0x7fb750063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:09.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.643+0000 7fb75ffff700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb750060f70 0x7fb750063430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fb74c004630 tx=0x7fb74c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:09.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.647+0000 7fb75d7fa700 1 -- 172.21.15.8:0/2746148978 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb75404c3a0 con 0x7fb7600f6530 2023-10-18T21:05:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.844+0000 7fb765e34700 1 -- 172.21.15.8:0/2746148978 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7600fee30 con 0x7fb750060f70 2023-10-18T21:05:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.846+0000 7fb75d7fa700 1 -- 172.21.15.8:0/2746148978 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb7600fee30 con 0x7fb750060f70 2023-10-18T21:05:09.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 -- 172.21.15.8:0/2746148978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb750060f70 msgr2=0x7fb750063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:09.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb750060f70 0x7fb750063430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fb74c004630 tx=0x7fb74c009b30).stop 2023-10-18T21:05:09.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 -- 172.21.15.8:0/2746148978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7600f6530 msgr2=0x7fb760106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7600f6530 0x7fb760106d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fb754002700 tx=0x7fb754009d80).stop 2023-10-18T21:05:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 -- 172.21.15.8:0/2746148978 shutdown_connections 2023-10-18T21:05:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb750060f70 0x7fb750063430 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7600f6530 0x7fb760106d90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 --2- 172.21.15.8:0/2746148978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7600f77d0 0x7fb760107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 -- 172.21.15.8:0/2746148978 >> 172.21.15.8:0/2746148978 conn(0x7fb7600f1c90 msgr2=0x7fb7600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 -- 172.21.15.8:0/2746148978 shutdown_connections 2023-10-18T21:05:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.848+0000 7fb765e34700 1 -- 172.21.15.8:0/2746148978 wait complete. 2023-10-18T21:05:09.865 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:05:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:08.219176+0000 mgr.smithi008.flmjzp (mgr.14640) 340 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:08.573697+0000 mon.smithi008 (mon.0) 635 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:08.574561+0000 mon.smithi008 (mon.0) 636 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:05:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:08.575327+0000 mon.smithi008 (mon.0) 637 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:05:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:08.575993+0000 mgr.smithi008.flmjzp (mgr.14640) 341 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:05:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:08.576578+0000 mgr.smithi008.flmjzp (mgr.14640) 342 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:09.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:08.579853+0000 mon.smithi008 (mon.0) 638 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:09.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:08.584814+0000 mon.smithi008 (mon.0) 639 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:09.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:08.587264+0000 mon.smithi008 (mon.0) 640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:09.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:08.588524+0000 mon.smithi008 (mon.0) 641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:09.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:08.589776+0000 mon.smithi008 (mon.0) 642 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:09.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:08.591301+0000 mon.smithi008 (mon.0) 643 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:09.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:08.592837+0000 mgr.smithi008.flmjzp (mgr.14640) 343 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:05:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:08.219176+0000 mgr.smithi008.flmjzp (mgr.14640) 340 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:08.573697+0000 mon.smithi008 (mon.0) 635 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:08.574561+0000 mon.smithi008 (mon.0) 636 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:05:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:08.575327+0000 mon.smithi008 (mon.0) 637 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:05:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:08.575993+0000 mgr.smithi008.flmjzp (mgr.14640) 341 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:05:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:08.576578+0000 mgr.smithi008.flmjzp (mgr.14640) 342 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:09.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:08.579853+0000 mon.smithi008 (mon.0) 638 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:09.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:08.584814+0000 mon.smithi008 (mon.0) 639 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:09.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:08.587264+0000 mon.smithi008 (mon.0) 640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:09.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:08.588524+0000 mon.smithi008 (mon.0) 641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:09.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:08.589776+0000 mon.smithi008 (mon.0) 642 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:09.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:08.591301+0000 mon.smithi008 (mon.0) 643 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:09.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:08.592837+0000 mgr.smithi008.flmjzp (mgr.14640) 343 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:05:09.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.988+0000 7fa5a4efa700 1 -- 172.21.15.8:0/2931095720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5a00f77d0 msgr2=0x7fa5a00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:09.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.988+0000 7fa5a4efa700 1 --2- 172.21.15.8:0/2931095720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5a00f77d0 0x7fa5a00f7c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fa594004660 tx=0x7fa594009b30).stop 2023-10-18T21:05:09.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.988+0000 7fa5a4efa700 1 -- 172.21.15.8:0/2931095720 shutdown_connections 2023-10-18T21:05:09.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.988+0000 7fa5a4efa700 1 --2- 172.21.15.8:0/2931095720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5a00f77d0 0x7fa5a00f7c30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:09.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.988+0000 7fa5a4efa700 1 --2- 172.21.15.8:0/2931095720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a00f6530 0x7fa5a00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:09.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.988+0000 7fa5a4efa700 1 -- 172.21.15.8:0/2931095720 >> 172.21.15.8:0/2931095720 conn(0x7fa5a00f1c90 msgr2=0x7fa5a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:09.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.988+0000 7fa5a4efa700 1 -- 172.21.15.8:0/2931095720 shutdown_connections 2023-10-18T21:05:09.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.988+0000 7fa5a4efa700 1 -- 172.21.15.8:0/2931095720 wait complete. 2023-10-18T21:05:09.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.989+0000 7fa5a4efa700 1 Processor -- start 2023-10-18T21:05:09.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.990+0000 7fa5a4efa700 1 -- start start 2023-10-18T21:05:09.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.990+0000 7fa5a4efa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a00f6530 0x7fa5a0108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:09.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.990+0000 7fa5a4efa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5a00f77d0 0x7fa5a0109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:09.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.990+0000 7fa5a4efa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a01099c0 con 0x7fa5a00f77d0 2023-10-18T21:05:09.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.990+0000 7fa5a4efa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a0109b00 con 0x7fa5a00f6530 2023-10-18T21:05:09.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa59effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5a00f77d0 0x7fa5a0109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:09.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa59f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a00f6530 0x7fa5a0108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:09.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa59effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5a00f77d0 0x7fa5a0109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39712/0 (socket says 172.21.15.8:39712) 2023-10-18T21:05:09.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa59effd700 1 -- 172.21.15.8:0/3166665372 learned_addr learned my addr 172.21.15.8:0/3166665372 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:09.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa59effd700 1 -- 172.21.15.8:0/3166665372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a00f6530 msgr2=0x7fa5a0108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:09.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa59effd700 1 --2- 172.21.15.8:0/3166665372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a00f6530 0x7fa5a0108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:09.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa59effd700 1 -- 172.21.15.8:0/3166665372 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa594005040 con 0x7fa5a00f77d0 2023-10-18T21:05:09.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa59effd700 1 --2- 172.21.15.8:0/3166665372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5a00f77d0 0x7fa5a0109410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fa594004320 tx=0x7fa59400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:09.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa587fff700 1 -- 172.21.15.8:0/3166665372 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa594019070 con 0x7fa5a00f77d0 2023-10-18T21:05:09.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa587fff700 1 -- 172.21.15.8:0/3166665372 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa59401e420 con 0x7fa5a00f77d0 2023-10-18T21:05:09.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa587fff700 1 -- 172.21.15.8:0/3166665372 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa594014680 con 0x7fa5a00f77d0 2023-10-18T21:05:09.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.991+0000 7fa5a4efa700 1 -- 172.21.15.8:0/3166665372 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a010a440 con 0x7fa5a00f77d0 2023-10-18T21:05:09.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.992+0000 7fa5a4efa700 1 -- 172.21.15.8:0/3166665372 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a010a920 con 0x7fa5a00f77d0 2023-10-18T21:05:09.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.993+0000 7fa5a4efa700 1 -- 172.21.15.8:0/3166665372 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a0045ad0 con 0x7fa5a00f77d0 2023-10-18T21:05:09.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.994+0000 7fa587fff700 1 -- 172.21.15.8:0/3166665372 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa59401e590 con 0x7fa5a00f77d0 2023-10-18T21:05:09.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.994+0000 7fa587fff700 1 --2- 172.21.15.8:0/3166665372 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa588060f70 0x7fa588063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:09.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.994+0000 7fa587fff700 1 -- 172.21.15.8:0/3166665372 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa59407d600 con 0x7fa5a00f77d0 2023-10-18T21:05:09.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.995+0000 7fa59f7fe700 1 --2- 172.21.15.8:0/3166665372 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa588060f70 0x7fa588063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:09.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.995+0000 7fa59f7fe700 1 --2- 172.21.15.8:0/3166665372 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa588060f70 0x7fa588063430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa590009fd0 tx=0x7fa59000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:10.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:09.999+0000 7fa587fff700 1 -- 172.21.15.8:0/3166665372 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa594051310 con 0x7fa5a00f77d0 2023-10-18T21:05:10.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.198+0000 7fa5a4efa700 1 -- 172.21.15.8:0/3166665372 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5a010ab90 con 0x7fa588060f70 2023-10-18T21:05:10.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.200+0000 7fa587fff700 1 -- 172.21.15.8:0/3166665372 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa5a010ab90 con 0x7fa588060f70 2023-10-18T21:05:10.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.201+0000 7fa5a4efa700 1 -- 172.21.15.8:0/3166665372 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa588060f70 msgr2=0x7fa588063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:10.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.201+0000 7fa5a4efa700 1 --2- 172.21.15.8:0/3166665372 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa588060f70 0x7fa588063430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa590009fd0 tx=0x7fa59000b040).stop 2023-10-18T21:05:10.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.201+0000 7fa5a4efa700 1 -- 172.21.15.8:0/3166665372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5a00f77d0 msgr2=0x7fa5a0109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:10.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.201+0000 7fa5a4efa700 1 --2- 172.21.15.8:0/3166665372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5a00f77d0 0x7fa5a0109410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fa594004320 tx=0x7fa59400b040).stop 2023-10-18T21:05:10.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.202+0000 7fa5a4efa700 1 -- 172.21.15.8:0/3166665372 shutdown_connections 2023-10-18T21:05:10.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.202+0000 7fa5a4efa700 1 --2- 172.21.15.8:0/3166665372 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa588060f70 0x7fa588063430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.202+0000 7fa5a4efa700 1 --2- 172.21.15.8:0/3166665372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a00f6530 0x7fa5a0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.202+0000 7fa5a4efa700 1 --2- 172.21.15.8:0/3166665372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5a00f77d0 0x7fa5a0109410 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.202+0000 7fa5a4efa700 1 -- 172.21.15.8:0/3166665372 >> 172.21.15.8:0/3166665372 conn(0x7fa5a00f1c90 msgr2=0x7fa5a006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.202+0000 7fa5a4efa700 1 -- 172.21.15.8:0/3166665372 shutdown_connections 2023-10-18T21:05:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.202+0000 7fa5a4efa700 1 -- 172.21.15.8:0/3166665372 wait complete. 2023-10-18T21:05:10.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.338+0000 7fab9ffff700 1 -- 172.21.15.8:0/2211706738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba00f96a0 msgr2=0x7faba00fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:10.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.338+0000 7fab9ffff700 1 --2- 172.21.15.8:0/2211706738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba00f96a0 0x7faba00fbaf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fab94004660 tx=0x7fab94009b30).stop 2023-10-18T21:05:10.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.338+0000 7fab9ffff700 1 -- 172.21.15.8:0/2211706738 shutdown_connections 2023-10-18T21:05:10.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.338+0000 7fab9ffff700 1 --2- 172.21.15.8:0/2211706738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba00f96a0 0x7faba00fbaf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.338+0000 7fab9ffff700 1 --2- 172.21.15.8:0/2211706738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faba0060310 0x7faba00f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.338+0000 7fab9ffff700 1 -- 172.21.15.8:0/2211706738 >> 172.21.15.8:0/2211706738 conn(0x7faba00f0ba0 msgr2=0x7faba00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:10.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.338+0000 7fab9ffff700 1 -- 172.21.15.8:0/2211706738 shutdown_connections 2023-10-18T21:05:10.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.339+0000 7fab9ffff700 1 -- 172.21.15.8:0/2211706738 wait complete. 2023-10-18T21:05:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.339+0000 7fab9ffff700 1 Processor -- start 2023-10-18T21:05:10.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.339+0000 7fab9ffff700 1 -- start start 2023-10-18T21:05:10.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba0060310 0x7faba0108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:10.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faba00f96a0 0x7faba0109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba01099f0 con 0x7faba0060310 2023-10-18T21:05:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba0109b30 con 0x7faba00f96a0 2023-10-18T21:05:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba0060310 0x7faba0108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba0060310 0x7faba0108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39734/0 (socket says 172.21.15.8:39734) 2023-10-18T21:05:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9effd700 1 -- 172.21.15.8:0/4214509195 learned_addr learned my addr 172.21.15.8:0/4214509195 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:10.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9e7fc700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faba00f96a0 0x7faba0109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:10.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9effd700 1 -- 172.21.15.8:0/4214509195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faba00f96a0 msgr2=0x7faba0109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:10.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9effd700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faba00f96a0 0x7faba0109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9effd700 1 -- 172.21.15.8:0/4214509195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94005040 con 0x7faba0060310 2023-10-18T21:05:10.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.340+0000 7fab9e7fc700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faba00f96a0 0x7faba0109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:05:10.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.341+0000 7fab9effd700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba0060310 0x7faba0108f50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fab900026d0 tx=0x7fab90009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:10.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.341+0000 7fab877fe700 1 -- 172.21.15.8:0/4214509195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab90009320 con 0x7faba0060310 2023-10-18T21:05:10.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.341+0000 7fab877fe700 1 -- 172.21.15.8:0/4214509195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fab9000f040 con 0x7faba0060310 2023-10-18T21:05:10.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.341+0000 7fab9ffff700 1 -- 172.21.15.8:0/4214509195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba010a4d0 con 0x7faba0060310 2023-10-18T21:05:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.341+0000 7fab877fe700 1 -- 172.21.15.8:0/4214509195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab900148a0 con 0x7faba0060310 2023-10-18T21:05:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.341+0000 7fab9ffff700 1 -- 172.21.15.8:0/4214509195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba010aa90 con 0x7faba0060310 2023-10-18T21:05:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.342+0000 7fab9ffff700 1 -- 172.21.15.8:0/4214509195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba0045ad0 con 0x7faba0060310 2023-10-18T21:05:10.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.343+0000 7fab877fe700 1 -- 172.21.15.8:0/4214509195 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fab90009480 con 0x7faba0060310 2023-10-18T21:05:10.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.344+0000 7fab877fe700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab88060f70 0x7fab88063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.344+0000 7fab877fe700 1 -- 172.21.15.8:0/4214509195 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fab9007c980 con 0x7faba0060310 2023-10-18T21:05:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.344+0000 7fab9e7fc700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab88060f70 0x7fab88063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.345+0000 7fab9e7fc700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab88060f70 0x7fab88063430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fab94005010 tx=0x7fab94009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.348+0000 7fab877fe700 1 -- 172.21.15.8:0/4214509195 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fab90050670 con 0x7faba0060310 2023-10-18T21:05:10.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.540+0000 7fab9ffff700 1 -- 172.21.15.8:0/4214509195 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faba00f5680 con 0x7fab88060f70 2023-10-18T21:05:10.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.549+0000 7fab877fe700 1 -- 172.21.15.8:0/4214509195 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7faba00f5680 con 0x7fab88060f70 2023-10-18T21:05:10.552 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:05:10.552 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (11m) 1s ago 13m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:05:10.552 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (5m) 1s ago 13m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:05:10.553 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (5m) 75s ago 12m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:05:10.553 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (11m) 1s ago 12m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:05:10.553 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (5s) 1s ago 9m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:05:10.553 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 1s ago 9m - - 2023-10-18T21:05:10.553 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (9m) 75s ago 9m 3802M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:05:10.554 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (9m) 75s ago 9m 478M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:05:10.554 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (6m) 1s ago 14m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:05:10.554 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (6m) 75s ago 12m 396M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:05:10.554 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (6m) 1s ago 14m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:05:10.554 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (5m) 75s ago 12m 85.3M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:05:10.555 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (12m) 1s ago 12m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:05:10.555 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (12m) 75s ago 12m 9.87M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:05:10.555 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (5m) 1s ago 11m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:05:10.555 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (3m) 1s ago 11m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:05:10.555 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (2m) 1s ago 11m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:05:10.556 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (2m) 75s ago 10m 340M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:05:10.556 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (105s) 75s ago 10m 305M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:05:10.556 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (79s) 75s ago 10m 10.6M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:05:10.556 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (7m) 1s ago 12m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:05:10.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.551+0000 7fab9ffff700 1 -- 172.21.15.8:0/4214509195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab88060f70 msgr2=0x7fab88063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:10.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.551+0000 7fab9ffff700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab88060f70 0x7fab88063430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fab94005010 tx=0x7fab94009b30).stop 2023-10-18T21:05:10.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.551+0000 7fab9ffff700 1 -- 172.21.15.8:0/4214509195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba0060310 msgr2=0x7faba0108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:10.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.551+0000 7fab9ffff700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba0060310 0x7faba0108f50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fab900026d0 tx=0x7fab90009de0).stop 2023-10-18T21:05:10.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.551+0000 7fab9ffff700 1 -- 172.21.15.8:0/4214509195 shutdown_connections 2023-10-18T21:05:10.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.551+0000 7fab9ffff700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab88060f70 0x7fab88063430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.551+0000 7fab9ffff700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faba0060310 0x7faba0108f50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.551+0000 7fab9ffff700 1 --2- 172.21.15.8:0/4214509195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faba00f96a0 0x7faba0109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.552+0000 7fab9ffff700 1 -- 172.21.15.8:0/4214509195 >> 172.21.15.8:0/4214509195 conn(0x7faba00f0ba0 msgr2=0x7faba00f4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:10.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.552+0000 7fab9ffff700 1 -- 172.21.15.8:0/4214509195 shutdown_connections 2023-10-18T21:05:10.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.552+0000 7fab9ffff700 1 -- 172.21.15.8:0/4214509195 wait complete. 2023-10-18T21:05:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.688+0000 7effb938c700 1 -- 172.21.15.8:0/1841744603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb40f6530 msgr2=0x7effb40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.688+0000 7effb938c700 1 --2- 172.21.15.8:0/1841744603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb40f6530 0x7effb40f6950 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7effa4004660 tx=0x7effa4009b30).stop 2023-10-18T21:05:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.688+0000 7effb938c700 1 -- 172.21.15.8:0/1841744603 shutdown_connections 2023-10-18T21:05:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.688+0000 7effb938c700 1 --2- 172.21.15.8:0/1841744603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb40f77d0 0x7effb40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.688+0000 7effb938c700 1 --2- 172.21.15.8:0/1841744603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb40f6530 0x7effb40f6950 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.688+0000 7effb938c700 1 -- 172.21.15.8:0/1841744603 >> 172.21.15.8:0/1841744603 conn(0x7effb40f1c90 msgr2=0x7effb40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.688+0000 7effb938c700 1 -- 172.21.15.8:0/1841744603 shutdown_connections 2023-10-18T21:05:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.688+0000 7effb938c700 1 -- 172.21.15.8:0/1841744603 wait complete. 2023-10-18T21:05:10.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.689+0000 7effb938c700 1 Processor -- start 2023-10-18T21:05:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.689+0000 7effb938c700 1 -- start start 2023-10-18T21:05:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb938c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb40f6530 0x7effb4106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb938c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb40f77d0 0x7effb4107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb938c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb4107910 con 0x7effb40f77d0 2023-10-18T21:05:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb938c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb4108120 con 0x7effb40f6530 2023-10-18T21:05:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb40f77d0 0x7effb4107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb40f77d0 0x7effb4107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39754/0 (socket says 172.21.15.8:39754) 2023-10-18T21:05:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb37fe700 1 -- 172.21.15.8:0/3520945297 learned_addr learned my addr 172.21.15.8:0/3520945297 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb3fff700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb40f6530 0x7effb4106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb37fe700 1 -- 172.21.15.8:0/3520945297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb40f6530 msgr2=0x7effb4106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb37fe700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb40f6530 0x7effb4106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.690+0000 7effb37fe700 1 -- 172.21.15.8:0/3520945297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4005040 con 0x7effb40f77d0 2023-10-18T21:05:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.691+0000 7effb37fe700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb40f77d0 0x7effb4107310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7effa80026d0 tx=0x7effa8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.691+0000 7effb0ff9700 1 -- 172.21.15.8:0/3520945297 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa8009320 con 0x7effb40f77d0 2023-10-18T21:05:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.691+0000 7effb0ff9700 1 -- 172.21.15.8:0/3520945297 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7effa800f040 con 0x7effb40f77d0 2023-10-18T21:05:10.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.691+0000 7effb938c700 1 -- 172.21.15.8:0/3520945297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb41083a0 con 0x7effb40f77d0 2023-10-18T21:05:10.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.691+0000 7effb0ff9700 1 -- 172.21.15.8:0/3520945297 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa80148a0 con 0x7effb40f77d0 2023-10-18T21:05:10.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.691+0000 7effb938c700 1 -- 172.21.15.8:0/3520945297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb4108960 con 0x7effb40f77d0 2023-10-18T21:05:10.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.692+0000 7effb938c700 1 -- 172.21.15.8:0/3520945297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb4059100 con 0x7effb40f77d0 2023-10-18T21:05:10.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.693+0000 7effb0ff9700 1 -- 172.21.15.8:0/3520945297 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7effa8009480 con 0x7effb40f77d0 2023-10-18T21:05:10.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.694+0000 7effb0ff9700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff9c060f70 0x7eff9c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:10.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.694+0000 7effb0ff9700 1 -- 172.21.15.8:0/3520945297 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6070+0+0 (secure 0 0 0) 0x7effa807c980 con 0x7effb40f77d0 2023-10-18T21:05:10.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.695+0000 7effb3fff700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff9c060f70 0x7eff9c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:10.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.695+0000 7effb3fff700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff9c060f70 0x7eff9c063430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7effa4005010 tx=0x7effa4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:10.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.698+0000 7effb0ff9700 1 -- 172.21.15.8:0/3520945297 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7effa804cc40 con 0x7effb40f77d0 2023-10-18T21:05:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:09.571855+0000 mon.smithi008 (mon.0) 644 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-10-18T21:05:10.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.951+0000 7effb938c700 1 -- 172.21.15.8:0/3520945297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7effb40008d0 con 0x7effb40f77d0 2023-10-18T21:05:10.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.952+0000 7effb0ff9700 1 -- 172.21.15.8:0/3520945297 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7effa80181b0 con 0x7effb40f77d0 2023-10-18T21:05:10.955 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:05:10.956 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:05:10.956 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:05:10.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:05:10.957 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:05:10.957 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:05:10.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:05:10.957 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:05:10.958 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:05:10.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:05:10.958 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:05:10.959 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2, 2023-10-18T21:05:10.959 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T21:05:10.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:05:10.959 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:05:10.960 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 12, 2023-10-18T21:05:10.960 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T21:05:10.960 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:05:10.961 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:05:10.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 -- 172.21.15.8:0/3520945297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff9c060f70 msgr2=0x7eff9c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:10.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff9c060f70 0x7eff9c063430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7effa4005010 tx=0x7effa4009b30).stop 2023-10-18T21:05:10.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 -- 172.21.15.8:0/3520945297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb40f77d0 msgr2=0x7effb4107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:10.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb40f77d0 0x7effb4107310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7effa80026d0 tx=0x7effa8009de0).stop 2023-10-18T21:05:10.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 -- 172.21.15.8:0/3520945297 shutdown_connections 2023-10-18T21:05:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff9c060f70 0x7eff9c063430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb40f6530 0x7effb4106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 --2- 172.21.15.8:0/3520945297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb40f77d0 0x7effb4107310 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 -- 172.21.15.8:0/3520945297 >> 172.21.15.8:0/3520945297 conn(0x7effb40f1c90 msgr2=0x7effb40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:10.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 -- 172.21.15.8:0/3520945297 shutdown_connections 2023-10-18T21:05:10.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:10.954+0000 7effb938c700 1 -- 172.21.15.8:0/3520945297 wait complete. 2023-10-18T21:05:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:09.571855+0000 mon.smithi008 (mon.0) 644 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-10-18T21:05:11.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.090+0000 7f5fa939a700 1 -- 172.21.15.8:0/656626153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa40f77d0 msgr2=0x7f5fa40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:11.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.090+0000 7f5fa939a700 1 --2- 172.21.15.8:0/656626153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa40f77d0 0x7f5fa40f7c30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f5f98004660 tx=0x7f5f98009b30).stop 2023-10-18T21:05:11.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.090+0000 7f5fa939a700 1 -- 172.21.15.8:0/656626153 shutdown_connections 2023-10-18T21:05:11.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.090+0000 7f5fa939a700 1 --2- 172.21.15.8:0/656626153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa40f77d0 0x7f5fa40f7c30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.090+0000 7f5fa939a700 1 --2- 172.21.15.8:0/656626153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fa40f6530 0x7f5fa40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.090+0000 7f5fa939a700 1 -- 172.21.15.8:0/656626153 >> 172.21.15.8:0/656626153 conn(0x7f5fa40f1c90 msgr2=0x7f5fa40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:11.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.091+0000 7f5fa939a700 1 -- 172.21.15.8:0/656626153 shutdown_connections 2023-10-18T21:05:11.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.091+0000 7f5fa939a700 1 -- 172.21.15.8:0/656626153 wait complete. 2023-10-18T21:05:11.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.091+0000 7f5fa939a700 1 Processor -- start 2023-10-18T21:05:11.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.092+0000 7f5fa939a700 1 -- start start 2023-10-18T21:05:11.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.092+0000 7f5fa939a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa40f6530 0x7f5fa4106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:11.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.092+0000 7f5fa939a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fa40f77d0 0x7f5fa4107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:11.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.092+0000 7f5fa939a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa4107850 con 0x7f5fa40f6530 2023-10-18T21:05:11.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.092+0000 7f5fa939a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa4108060 con 0x7f5fa40f77d0 2023-10-18T21:05:11.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.092+0000 7f5fa3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa40f6530 0x7f5fa4106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:11.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.092+0000 7f5fa3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa40f6530 0x7f5fa4106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39772/0 (socket says 172.21.15.8:39772) 2023-10-18T21:05:11.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.092+0000 7f5fa3fff700 1 -- 172.21.15.8:0/2836344166 learned_addr learned my addr 172.21.15.8:0/2836344166 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:11.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.092+0000 7f5fa37fe700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fa40f77d0 0x7f5fa4107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:11.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.093+0000 7f5fa3fff700 1 -- 172.21.15.8:0/2836344166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fa40f77d0 msgr2=0x7f5fa4107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:11.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.093+0000 7f5fa3fff700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fa40f77d0 0x7f5fa4107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.093+0000 7f5fa3fff700 1 -- 172.21.15.8:0/2836344166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f98005040 con 0x7f5fa40f6530 2023-10-18T21:05:11.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.093+0000 7f5fa3fff700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa40f6530 0x7f5fa4106d60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f5f9400e7c0 tx=0x7f5f9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:11.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.093+0000 7f5fa0ff9700 1 -- 172.21.15.8:0/2836344166 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f940092e0 con 0x7f5fa40f6530 2023-10-18T21:05:11.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.093+0000 7f5fa0ff9700 1 -- 172.21.15.8:0/2836344166 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5f9400f040 con 0x7f5fa40f6530 2023-10-18T21:05:11.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.093+0000 7f5fa939a700 1 -- 172.21.15.8:0/2836344166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa41082e0 con 0x7f5fa40f6530 2023-10-18T21:05:11.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.093+0000 7f5fa0ff9700 1 -- 172.21.15.8:0/2836344166 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f94014810 con 0x7f5fa40f6530 2023-10-18T21:05:11.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.093+0000 7f5fa939a700 1 -- 172.21.15.8:0/2836344166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa4108820 con 0x7f5fa40f6530 2023-10-18T21:05:11.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.094+0000 7f5fa939a700 1 -- 172.21.15.8:0/2836344166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa4059100 con 0x7f5fa40f6530 2023-10-18T21:05:11.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.095+0000 7f5fa0ff9700 1 -- 172.21.15.8:0/2836344166 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5f9401b030 con 0x7f5fa40f6530 2023-10-18T21:05:11.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.096+0000 7f5fa0ff9700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f8c060f70 0x7f5f8c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:11.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.096+0000 7f5fa0ff9700 1 -- 172.21.15.8:0/2836344166 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5f9407c0b0 con 0x7f5fa40f6530 2023-10-18T21:05:11.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.096+0000 7f5fa37fe700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f8c060f70 0x7f5f8c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:11.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.097+0000 7f5fa37fe700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f8c060f70 0x7f5f8c063430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f5f98005010 tx=0x7f5f98016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:11.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.100+0000 7f5fa0ff9700 1 -- 172.21.15.8:0/2836344166 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5f9404c430 con 0x7f5fa40f6530 2023-10-18T21:05:11.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.327+0000 7f5fa939a700 1 -- 172.21.15.8:0/2836344166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5fa40008d0 con 0x7f5fa40f6530 2023-10-18T21:05:11.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.327+0000 7f5fa0ff9700 1 -- 172.21.15.8:0/2836344166 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1759 (secure 0 0 0) 0x7f5f94019030 con 0x7f5fa40f6530 2023-10-18T21:05:11.330 INFO:teuthology.orchestra.run.smithi008.stdout:e33 2023-10-18T21:05:11.331 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:05:11.331 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:05:11.331 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:05:11.331 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:05:11.332 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:05:11.332 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:05:11.332 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 33 2023-10-18T21:05:11.332 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:05:11.332 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:05:11.333 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:05:06.036481+0000 2023-10-18T21:05:11.333 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:05:11.333 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:05:11.333 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:05:11.333 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:05:11.334 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:05:11.334 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:05:11.334 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:05:11.334 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 86 2023-10-18T21:05:11.334 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:05:11.335 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:05:11.335 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:05:11.335 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=34394} 2023-10-18T21:05:11.335 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:05:11.336 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:05:11.336 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:05:11.336 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:05:11.337 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:05:11.337 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:05:11.337 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:05:11.338 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:05:11.338 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:34394} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.8:6826/3779014978,v1:172.21.15.8:6827/3779014978] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:05:11.338 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:05:11.339 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:05:11.339 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:05:11.339 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:05:11.339 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{-1:34398} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.8:6828/547859340,v1:172.21.15.8:6829/547859340] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:05:11.340 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:05:11.340 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6824/894252909,v1:172.21.15.60:6825/894252909] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:05:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.329+0000 7f5fa939a700 1 -- 172.21.15.8:0/2836344166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f8c060f70 msgr2=0x7f5f8c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.329+0000 7f5fa939a700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f8c060f70 0x7f5f8c063430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f5f98005010 tx=0x7f5f98016040).stop 2023-10-18T21:05:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.329+0000 7f5fa939a700 1 -- 172.21.15.8:0/2836344166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa40f6530 msgr2=0x7f5fa4106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.329+0000 7f5fa939a700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa40f6530 0x7f5fa4106d60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f5f9400e7c0 tx=0x7f5f9400b040).stop 2023-10-18T21:05:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.329+0000 7f5fa939a700 1 -- 172.21.15.8:0/2836344166 shutdown_connections 2023-10-18T21:05:11.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.329+0000 7f5fa939a700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f8c060f70 0x7f5f8c063430 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.329+0000 7f5fa939a700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fa40f6530 0x7f5fa4106d60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.329+0000 7f5fa939a700 1 --2- 172.21.15.8:0/2836344166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fa40f77d0 0x7f5fa4107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.329+0000 7f5fa939a700 1 -- 172.21.15.8:0/2836344166 >> 172.21.15.8:0/2836344166 conn(0x7f5fa40f1c90 msgr2=0x7f5fa40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:11.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.330+0000 7f5fa939a700 1 -- 172.21.15.8:0/2836344166 shutdown_connections 2023-10-18T21:05:11.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.330+0000 7f5fa939a700 1 -- 172.21.15.8:0/2836344166 wait complete. 2023-10-18T21:05:11.344 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 33 2023-10-18T21:05:11.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.470+0000 7ff686545700 1 -- 172.21.15.8:0/3842899256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800f77d0 msgr2=0x7ff6800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:11.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.470+0000 7ff686545700 1 --2- 172.21.15.8:0/3842899256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800f77d0 0x7ff6800f7c30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7ff670004660 tx=0x7ff670009b30).stop 2023-10-18T21:05:11.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.470+0000 7ff686545700 1 -- 172.21.15.8:0/3842899256 shutdown_connections 2023-10-18T21:05:11.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.470+0000 7ff686545700 1 --2- 172.21.15.8:0/3842899256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800f77d0 0x7ff6800f7c30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.470+0000 7ff686545700 1 --2- 172.21.15.8:0/3842899256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6800f6530 0x7ff6800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.470+0000 7ff686545700 1 -- 172.21.15.8:0/3842899256 >> 172.21.15.8:0/3842899256 conn(0x7ff6800f1c90 msgr2=0x7ff6800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:11.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.470+0000 7ff686545700 1 -- 172.21.15.8:0/3842899256 shutdown_connections 2023-10-18T21:05:11.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.470+0000 7ff686545700 1 -- 172.21.15.8:0/3842899256 wait complete. 2023-10-18T21:05:11.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.471+0000 7ff686545700 1 Processor -- start 2023-10-18T21:05:11.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.471+0000 7ff686545700 1 -- start start 2023-10-18T21:05:11.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.471+0000 7ff686545700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6800f6530 0x7ff68006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:11.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.471+0000 7ff686545700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800f77d0 0x7ff680069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:11.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.471+0000 7ff686545700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68006a380 con 0x7ff6800f77d0 2023-10-18T21:05:11.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.471+0000 7ff686545700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68006a4c0 con 0x7ff6800f6530 2023-10-18T21:05:11.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.471+0000 7ff684d42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800f77d0 0x7ff680069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:11.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff684d42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800f77d0 0x7ff680069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39794/0 (socket says 172.21.15.8:39794) 2023-10-18T21:05:11.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff684d42700 1 -- 172.21.15.8:0/2488619257 learned_addr learned my addr 172.21.15.8:0/2488619257 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:11.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff685543700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6800f6530 0x7ff68006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:11.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff684d42700 1 -- 172.21.15.8:0/2488619257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6800f6530 msgr2=0x7ff68006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:11.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff684d42700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6800f6530 0x7ff68006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff684d42700 1 -- 172.21.15.8:0/2488619257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff670005040 con 0x7ff6800f77d0 2023-10-18T21:05:11.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff684d42700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800f77d0 0x7ff680069e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7ff670009990 tx=0x7ff670009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:11.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff675ffb700 1 -- 172.21.15.8:0/2488619257 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff670018070 con 0x7ff6800f77d0 2023-10-18T21:05:11.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff675ffb700 1 -- 172.21.15.8:0/2488619257 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff670009630 con 0x7ff6800f77d0 2023-10-18T21:05:11.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff686545700 1 -- 172.21.15.8:0/2488619257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68006a740 con 0x7ff6800f77d0 2023-10-18T21:05:11.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.472+0000 7ff675ffb700 1 -- 172.21.15.8:0/2488619257 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff67001c3c0 con 0x7ff6800f77d0 2023-10-18T21:05:11.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.473+0000 7ff686545700 1 -- 172.21.15.8:0/2488619257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68006aca0 con 0x7ff6800f77d0 2023-10-18T21:05:11.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.474+0000 7ff686545700 1 -- 172.21.15.8:0/2488619257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff680045ad0 con 0x7ff6800f77d0 2023-10-18T21:05:11.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.474+0000 7ff675ffb700 1 -- 172.21.15.8:0/2488619257 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff67001d970 con 0x7ff6800f77d0 2023-10-18T21:05:11.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.475+0000 7ff675ffb700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff66c060f70 0x7ff66c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:11.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.475+0000 7ff675ffb700 1 -- 172.21.15.8:0/2488619257 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ff67007df10 con 0x7ff6800f77d0 2023-10-18T21:05:11.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.475+0000 7ff685543700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff66c060f70 0x7ff66c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:11.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.476+0000 7ff685543700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff66c060f70 0x7ff66c063430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff68006b730 tx=0x7ff67c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:11.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.479+0000 7ff675ffb700 1 -- 172.21.15.8:0/2488619257 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff67004e210 con 0x7ff6800f77d0 2023-10-18T21:05:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.679+0000 7ff686545700 1 -- 172.21.15.8:0/2488619257 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff680057f10 con 0x7ff66c060f70 2023-10-18T21:05:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.680+0000 7ff675ffb700 1 -- 172.21.15.8:0/2488619257 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff680057f10 con 0x7ff66c060f70 2023-10-18T21:05:11.682 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:05:11.682 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:05:11.683 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:05:11.683 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:05:11.683 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:05:11.683 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:05:11.683 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:05:11.684 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:05:11.684 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:05:11.684 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:05:11.684 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "13/21 daemons upgraded", 2023-10-18T21:05:11.684 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:05:11.684 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:05:11.685 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:05:11.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 -- 172.21.15.8:0/2488619257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff66c060f70 msgr2=0x7ff66c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff66c060f70 0x7ff66c063430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff68006b730 tx=0x7ff67c00b040).stop 2023-10-18T21:05:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 -- 172.21.15.8:0/2488619257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800f77d0 msgr2=0x7ff680069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800f77d0 0x7ff680069e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7ff670009990 tx=0x7ff670009b30).stop 2023-10-18T21:05:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 -- 172.21.15.8:0/2488619257 shutdown_connections 2023-10-18T21:05:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff66c060f70 0x7ff66c063430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6800f6530 0x7ff68006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 --2- 172.21.15.8:0/2488619257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800f77d0 0x7ff680069e20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 -- 172.21.15.8:0/2488619257 >> 172.21.15.8:0/2488619257 conn(0x7ff6800f1c90 msgr2=0x7ff6800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 -- 172.21.15.8:0/2488619257 shutdown_connections 2023-10-18T21:05:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:11.682+0000 7ff686545700 1 -- 172.21.15.8:0/2488619257 wait complete. 2023-10-18T21:05:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:09.847038+0000 mgr.smithi008.flmjzp (mgr.14640) 344 : audit [DBG] from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:10.200992+0000 mgr.smithi008.flmjzp (mgr.14640) 345 : audit [DBG] from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:10.542276+0000 mgr.smithi008.flmjzp (mgr.14640) 346 : audit [DBG] from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:10.576955+0000 mgr.smithi008.flmjzp (mgr.14640) 347 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:10.953676+0000 mon.smithi008 (mon.0) 645 : audit [DBG] from='client.? 172.21.15.8:0/3520945297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:11.329151+0000 mon.smithi008 (mon.0) 646 : audit [DBG] from='client.? 172.21.15.8:0/2836344166' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:05:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:09.847038+0000 mgr.smithi008.flmjzp (mgr.14640) 344 : audit [DBG] from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:10.200992+0000 mgr.smithi008.flmjzp (mgr.14640) 345 : audit [DBG] from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:10.542276+0000 mgr.smithi008.flmjzp (mgr.14640) 346 : audit [DBG] from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:10.576955+0000 mgr.smithi008.flmjzp (mgr.14640) 347 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:10.953676+0000 mon.smithi008 (mon.0) 645 : audit [DBG] from='client.? 172.21.15.8:0/3520945297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:11.329151+0000 mon.smithi008 (mon.0) 646 : audit [DBG] from='client.? 172.21.15.8:0/2836344166' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:05:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:11.681233+0000 mgr.smithi008.flmjzp (mgr.14640) 348 : audit [DBG] from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:12.577326+0000 mgr.smithi008.flmjzp (mgr.14640) 349 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:11.681233+0000 mgr.smithi008.flmjzp (mgr.14640) 348 : audit [DBG] from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:12.577326+0000 mgr.smithi008.flmjzp (mgr.14640) 349 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:14.577840+0000 mgr.smithi008.flmjzp (mgr.14640) 350 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:15.449162+0000 mon.smithi008 (mon.0) 647 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:14.577840+0000 mgr.smithi008.flmjzp (mgr.14640) 350 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:15.449162+0000 mon.smithi008 (mon.0) 647 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:16.578245+0000 mgr.smithi008.flmjzp (mgr.14640) 351 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:16.578245+0000 mgr.smithi008.flmjzp (mgr.14640) 351 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:18.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:05:18.593+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:17.678919+0000 mon.smithi008 (mon.0) 648 : cluster [INF] daemon mds.cephfs.smithi008.mpstiw restarted 2023-10-18T21:05:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:17.682602+0000 mon.smithi008 (mon.0) 649 : cluster [DBG] osdmap e87: 6 total, 6 up, 6 in 2023-10-18T21:05:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:17.678919+0000 mon.smithi008 (mon.0) 648 : cluster [INF] daemon mds.cephfs.smithi008.mpstiw restarted 2023-10-18T21:05:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:17.682602+0000 mon.smithi008 (mon.0) 649 : cluster [DBG] osdmap e87: 6 total, 6 up, 6 in 2023-10-18T21:05:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:18.578713+0000 mgr.smithi008.flmjzp (mgr.14640) 352 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:18.595351+0000 mon.smithi008 (mon.0) 650 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:18.603696+0000 mon.smithi008 (mon.0) 651 : cluster [DBG] mds.? [v2:172.21.15.8:6826/486039929,v1:172.21.15.8:6827/486039929] up:boot 2023-10-18T21:05:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:18.603746+0000 mon.smithi008 (mon.0) 652 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:05:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:18.603869+0000 mon.smithi008 (mon.0) 653 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:05:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:18.604190+0000 mon.smithi008 (mon.0) 654 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:05:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:18.604313+0000 mon.smithi008 (mon.0) 655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:05:19.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:18.605243+0000 mon.smithi008 (mon.0) 656 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:19.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:18.608378+0000 mon.smithi008 (mon.0) 657 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 3 up:standby 2023-10-18T21:05:19.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:18.610786+0000 mon.smithi008 (mon.0) 658 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:05:19.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:18.611881+0000 mon.smithi008 (mon.0) 659 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:05:19.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:18.612837+0000 mgr.smithi008.flmjzp (mgr.14640) 353 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:05:19.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:18.613410+0000 mgr.smithi008.flmjzp (mgr.14640) 354 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:19.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:18.613680+0000 mgr.smithi008.flmjzp (mgr.14640) 355 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:19.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:18.618271+0000 mon.smithi008 (mon.0) 660 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:19.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:18.626012+0000 mon.smithi008 (mon.0) 661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:19.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:18.629419+0000 mon.smithi008 (mon.0) 662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:19.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:18.631044+0000 mon.smithi008 (mon.0) 663 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:19.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:18.632573+0000 mon.smithi008 (mon.0) 664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:19.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:18.634511+0000 mon.smithi008 (mon.0) 665 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:19.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:18.636457+0000 mgr.smithi008.flmjzp (mgr.14640) 356 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:05:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:18.578713+0000 mgr.smithi008.flmjzp (mgr.14640) 352 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:18.595351+0000 mon.smithi008 (mon.0) 650 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:18.603696+0000 mon.smithi008 (mon.0) 651 : cluster [DBG] mds.? [v2:172.21.15.8:6826/486039929,v1:172.21.15.8:6827/486039929] up:boot 2023-10-18T21:05:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:18.603746+0000 mon.smithi008 (mon.0) 652 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:05:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:18.603869+0000 mon.smithi008 (mon.0) 653 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:05:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:18.604190+0000 mon.smithi008 (mon.0) 654 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:05:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:18.604313+0000 mon.smithi008 (mon.0) 655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:05:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:18.605243+0000 mon.smithi008 (mon.0) 656 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:18.608378+0000 mon.smithi008 (mon.0) 657 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 3 up:standby 2023-10-18T21:05:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:18.610786+0000 mon.smithi008 (mon.0) 658 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:05:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:18.611881+0000 mon.smithi008 (mon.0) 659 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:05:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:18.612837+0000 mgr.smithi008.flmjzp (mgr.14640) 353 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:05:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:18.613410+0000 mgr.smithi008.flmjzp (mgr.14640) 354 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:19.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:18.613680+0000 mgr.smithi008.flmjzp (mgr.14640) 355 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:19.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:18.618271+0000 mon.smithi008 (mon.0) 660 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:19.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:18.626012+0000 mon.smithi008 (mon.0) 661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:19.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:18.629419+0000 mon.smithi008 (mon.0) 662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:19.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:18.631044+0000 mon.smithi008 (mon.0) 663 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:19.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:18.632573+0000 mon.smithi008 (mon.0) 664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:19.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:18.634511+0000 mon.smithi008 (mon.0) 665 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:19.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:18.636457+0000 mgr.smithi008.flmjzp (mgr.14640) 356 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:05:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:20.614149+0000 mgr.smithi008.flmjzp (mgr.14640) 357 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:20.614149+0000 mgr.smithi008.flmjzp (mgr.14640) 357 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:22.614719+0000 mgr.smithi008.flmjzp (mgr.14640) 358 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:22.614719+0000 mgr.smithi008.flmjzp (mgr.14640) 358 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:24.615299+0000 mgr.smithi008.flmjzp (mgr.14640) 359 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:25.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:24.615299+0000 mgr.smithi008.flmjzp (mgr.14640) 359 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:26.615751+0000 mgr.smithi008.flmjzp (mgr.14640) 360 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:27.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:26.615751+0000 mgr.smithi008.flmjzp (mgr.14640) 360 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:28.616246+0000 mgr.smithi008.flmjzp (mgr.14640) 361 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:28.647247+0000 mon.smithi008 (mon.0) 666 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:29.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:28.616246+0000 mgr.smithi008.flmjzp (mgr.14640) 361 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:29.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:28.647247+0000 mon.smithi008 (mon.0) 666 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:29.210955+0000 mon.smithi008 (mon.0) 667 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:05:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:29.211789+0000 mon.smithi008 (mon.0) 668 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:05:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:29.212411+0000 mgr.smithi008.flmjzp (mgr.14640) 362 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:05:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:29.212917+0000 mgr.smithi008.flmjzp (mgr.14640) 363 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:29.213122+0000 mgr.smithi008.flmjzp (mgr.14640) 364 : cluster [DBG] pgmap v260: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:29.216967+0000 mon.smithi008 (mon.0) 669 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:29.221890+0000 mon.smithi008 (mon.0) 670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:29.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:29.224249+0000 mon.smithi008 (mon.0) 671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:29.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:29.225464+0000 mon.smithi008 (mon.0) 672 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:29.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:29.226614+0000 mon.smithi008 (mon.0) 673 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:29.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:29.228101+0000 mon.smithi008 (mon.0) 674 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:29.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:29.229545+0000 mgr.smithi008.flmjzp (mgr.14640) 365 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:05:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:29.210955+0000 mon.smithi008 (mon.0) 667 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:05:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:29.211789+0000 mon.smithi008 (mon.0) 668 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:05:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:29.212411+0000 mgr.smithi008.flmjzp (mgr.14640) 362 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:05:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:29.212917+0000 mgr.smithi008.flmjzp (mgr.14640) 363 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:29.213122+0000 mgr.smithi008.flmjzp (mgr.14640) 364 : cluster [DBG] pgmap v260: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:30.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:29.216967+0000 mon.smithi008 (mon.0) 669 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:30.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:29.221890+0000 mon.smithi008 (mon.0) 670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:30.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:29.224249+0000 mon.smithi008 (mon.0) 671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:30.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:29.225464+0000 mon.smithi008 (mon.0) 672 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:30.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:29.226614+0000 mon.smithi008 (mon.0) 673 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:30.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:29.228101+0000 mon.smithi008 (mon.0) 674 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:30.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:29.229545+0000 mgr.smithi008.flmjzp (mgr.14640) 365 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:05:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:05:30.901+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:29.944398+0000 mon.smithi008 (mon.0) 675 : cluster [INF] daemon mds.cephfs.smithi008.lehgco restarted 2023-10-18T21:05:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:29.948813+0000 mon.smithi008 (mon.0) 676 : cluster [DBG] osdmap e88: 6 total, 6 up, 6 in 2023-10-18T21:05:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:29.944398+0000 mon.smithi008 (mon.0) 675 : cluster [INF] daemon mds.cephfs.smithi008.lehgco restarted 2023-10-18T21:05:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:29.948813+0000 mon.smithi008 (mon.0) 676 : cluster [DBG] osdmap e88: 6 total, 6 up, 6 in 2023-10-18T21:05:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:30.901803+0000 mon.smithi008 (mon.0) 677 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:30.908976+0000 mon.smithi008 (mon.0) 678 : cluster [DBG] mds.? [v2:172.21.15.8:6828/2155093583,v1:172.21.15.8:6829/2155093583] up:boot 2023-10-18T21:05:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:30.909049+0000 mon.smithi008 (mon.0) 679 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:05:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:30.909141+0000 mon.smithi008 (mon.0) 680 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:05:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:30.909416+0000 mon.smithi008 (mon.0) 681 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:05:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:30.909531+0000 mon.smithi008 (mon.0) 682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:05:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:30.912895+0000 mon.smithi008 (mon.0) 683 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 3 up:standby 2023-10-18T21:05:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:31.213581+0000 mgr.smithi008.flmjzp (mgr.14640) 366 : cluster [DBG] pgmap v262: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:30.901803+0000 mon.smithi008 (mon.0) 677 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:30.908976+0000 mon.smithi008 (mon.0) 678 : cluster [DBG] mds.? [v2:172.21.15.8:6828/2155093583,v1:172.21.15.8:6829/2155093583] up:boot 2023-10-18T21:05:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:30.909049+0000 mon.smithi008 (mon.0) 679 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:05:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:30.909141+0000 mon.smithi008 (mon.0) 680 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:05:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:30.909416+0000 mon.smithi008 (mon.0) 681 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:05:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:30.909531+0000 mon.smithi008 (mon.0) 682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:05:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:30.912895+0000 mon.smithi008 (mon.0) 683 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 3 up:standby 2023-10-18T21:05:32.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:31.213581+0000 mgr.smithi008.flmjzp (mgr.14640) 366 : cluster [DBG] pgmap v262: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:33.214115+0000 mgr.smithi008.flmjzp (mgr.14640) 367 : cluster [DBG] pgmap v263: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:33.214115+0000 mgr.smithi008.flmjzp (mgr.14640) 367 : cluster [DBG] pgmap v263: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:36.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:35.214659+0000 mgr.smithi008.flmjzp (mgr.14640) 368 : cluster [DBG] pgmap v264: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:35.214659+0000 mgr.smithi008.flmjzp (mgr.14640) 368 : cluster [DBG] pgmap v264: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:37.215266+0000 mgr.smithi008.flmjzp (mgr.14640) 369 : cluster [DBG] pgmap v265: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:37.215266+0000 mgr.smithi008.flmjzp (mgr.14640) 369 : cluster [DBG] pgmap v265: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:39.236972+0000 mon.smithi008 (mon.0) 684 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:39.239090+0000 mon.smithi008 (mon.0) 685 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:05:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:39.240172+0000 mon.smithi008 (mon.0) 686 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:05:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:39.246626+0000 mon.smithi008 (mon.0) 687 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:39.253228+0000 mon.smithi008 (mon.0) 688 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:39.256550+0000 mon.smithi008 (mon.0) 689 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:39.258345+0000 mon.smithi008 (mon.0) 690 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:39.259993+0000 mon.smithi008 (mon.0) 691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:39.262065+0000 mon.smithi008 (mon.0) 692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:39.236972+0000 mon.smithi008 (mon.0) 684 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:39.239090+0000 mon.smithi008 (mon.0) 685 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:05:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:39.240172+0000 mon.smithi008 (mon.0) 686 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:05:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:39.246626+0000 mon.smithi008 (mon.0) 687 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:39.253228+0000 mon.smithi008 (mon.0) 688 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:39.256550+0000 mon.smithi008 (mon.0) 689 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:39.258345+0000 mon.smithi008 (mon.0) 690 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:39.259993+0000 mon.smithi008 (mon.0) 691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:39.262065+0000 mon.smithi008 (mon.0) 692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:39.215863+0000 mgr.smithi008.flmjzp (mgr.14640) 370 : cluster [DBG] pgmap v266: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:39.241093+0000 mgr.smithi008.flmjzp (mgr.14640) 371 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:05:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:39.241595+0000 mgr.smithi008.flmjzp (mgr.14640) 372 : cluster [DBG] pgmap v267: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:39.241817+0000 mgr.smithi008.flmjzp (mgr.14640) 373 : cluster [DBG] pgmap v268: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:39.264048+0000 mgr.smithi008.flmjzp (mgr.14640) 374 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:05:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:39.215863+0000 mgr.smithi008.flmjzp (mgr.14640) 370 : cluster [DBG] pgmap v266: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:39.241093+0000 mgr.smithi008.flmjzp (mgr.14640) 371 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:05:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:39.241595+0000 mgr.smithi008.flmjzp (mgr.14640) 372 : cluster [DBG] pgmap v267: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:39.241817+0000 mgr.smithi008.flmjzp (mgr.14640) 373 : cluster [DBG] pgmap v268: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:39.264048+0000 mgr.smithi008.flmjzp (mgr.14640) 374 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:05:41.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.851+0000 7f4d33fff700 1 -- 172.21.15.8:0/2822508477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d3406a350 msgr2=0x7f4d3406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:41.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.851+0000 7f4d33fff700 1 --2- 172.21.15.8:0/2822508477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d3406a350 0x7f4d3406a7d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4d28004660 tx=0x7f4d28009b30).stop 2023-10-18T21:05:41.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.851+0000 7f4d33fff700 1 -- 172.21.15.8:0/2822508477 shutdown_connections 2023-10-18T21:05:41.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.851+0000 7f4d33fff700 1 --2- 172.21.15.8:0/2822508477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d3406a350 0x7f4d3406a7d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:41.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.852+0000 7f4d33fff700 1 --2- 172.21.15.8:0/2822508477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d3406b960 0x7f4d34069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:41.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.852+0000 7f4d33fff700 1 -- 172.21.15.8:0/2822508477 >> 172.21.15.8:0/2822508477 conn(0x7f4d340f1c90 msgr2=0x7f4d340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:41.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.852+0000 7f4d33fff700 1 -- 172.21.15.8:0/2822508477 shutdown_connections 2023-10-18T21:05:41.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.852+0000 7f4d33fff700 1 -- 172.21.15.8:0/2822508477 wait complete. 2023-10-18T21:05:41.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.852+0000 7f4d33fff700 1 Processor -- start 2023-10-18T21:05:41.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.853+0000 7f4d33fff700 1 -- start start 2023-10-18T21:05:41.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.853+0000 7f4d33fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d3406a350 0x7f4d34108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:41.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.853+0000 7f4d33fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d3406b960 0x7f4d34109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:41.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.853+0000 7f4d33fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34109a30 con 0x7f4d3406b960 2023-10-18T21:05:41.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.853+0000 7f4d33fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34109b70 con 0x7f4d3406a350 2023-10-18T21:05:41.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.853+0000 7f4d327fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d3406b960 0x7f4d34109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:41.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.853+0000 7f4d327fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d3406b960 0x7f4d34109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58326/0 (socket says 172.21.15.8:58326) 2023-10-18T21:05:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.853+0000 7f4d327fc700 1 -- 172.21.15.8:0/1825659587 learned_addr learned my addr 172.21.15.8:0/1825659587 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.853+0000 7f4d32ffd700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d3406a350 0x7f4d34108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.854+0000 7f4d327fc700 1 -- 172.21.15.8:0/1825659587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d3406a350 msgr2=0x7f4d34108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.854+0000 7f4d327fc700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d3406a350 0x7f4d34108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.854+0000 7f4d327fc700 1 -- 172.21.15.8:0/1825659587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d28005040 con 0x7f4d3406b960 2023-10-18T21:05:41.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.854+0000 7f4d327fc700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d3406b960 0x7f4d34109480 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f4d28009f50 tx=0x7f4d28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:41.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.854+0000 7f4d1b7fe700 1 -- 172.21.15.8:0/1825659587 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d28018070 con 0x7f4d3406b960 2023-10-18T21:05:41.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.854+0000 7f4d1b7fe700 1 -- 172.21.15.8:0/1825659587 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4d28009630 con 0x7f4d3406b960 2023-10-18T21:05:41.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.854+0000 7f4d1b7fe700 1 -- 172.21.15.8:0/1825659587 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d2801c3c0 con 0x7f4d3406b960 2023-10-18T21:05:41.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.854+0000 7f4d33fff700 1 -- 172.21.15.8:0/1825659587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3410a4b0 con 0x7f4d3406b960 2023-10-18T21:05:41.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.855+0000 7f4d33fff700 1 -- 172.21.15.8:0/1825659587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3410aa10 con 0x7f4d3406b960 2023-10-18T21:05:41.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.856+0000 7f4d33fff700 1 -- 172.21.15.8:0/1825659587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d34045ad0 con 0x7f4d3406b960 2023-10-18T21:05:41.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.857+0000 7f4d1b7fe700 1 -- 172.21.15.8:0/1825659587 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4d2801d420 con 0x7f4d3406b960 2023-10-18T21:05:41.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.857+0000 7f4d1b7fe700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 0x7f4d1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:41.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.857+0000 7f4d1b7fe700 1 -- 172.21.15.8:0/1825659587 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f4d2807deb0 con 0x7f4d3406b960 2023-10-18T21:05:41.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.858+0000 7f4d32ffd700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 0x7f4d1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:41.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.858+0000 7f4d32ffd700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 0x7f4d1c063430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f4d24004c40 tx=0x7f4d2400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:41.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:41.862+0000 7f4d1b7fe700 1 -- 172.21.15.8:0/1825659587 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4d28051af0 con 0x7f4d3406b960 2023-10-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.074+0000 7f4d33fff700 1 -- 172.21.15.8:0/1825659587 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d34101060 con 0x7f4d1c060f70 2023-10-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.075+0000 7f4d1b7fe700 1 -- 172.21.15.8:0/1825659587 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4d2400f040 con 0x7f4d1c060f70 2023-10-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.077+0000 7f4d33fff700 1 -- 172.21.15.8:0/1825659587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 msgr2=0x7f4d1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.077+0000 7f4d33fff700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 0x7f4d1c063430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f4d24004c40 tx=0x7f4d2400b040).stop 2023-10-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.077+0000 7f4d33fff700 1 -- 172.21.15.8:0/1825659587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d3406b960 msgr2=0x7f4d34109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.077+0000 7f4d33fff700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d3406b960 0x7f4d34109480 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f4d28009f50 tx=0x7f4d28009b30).stop 2023-10-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.078+0000 7f4d33fff700 1 -- 172.21.15.8:0/1825659587 shutdown_connections 2023-10-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.078+0000 7f4d33fff700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 0x7f4d1c063430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.078+0000 7f4d33fff700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d3406a350 0x7f4d34108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.078+0000 7f4d33fff700 1 --2- 172.21.15.8:0/1825659587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d3406b960 0x7f4d34109480 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.078+0000 7f4d33fff700 1 -- 172.21.15.8:0/1825659587 >> 172.21.15.8:0/1825659587 conn(0x7f4d340f1c90 msgr2=0x7f4d340fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.078+0000 7f4d33fff700 1 -- 172.21.15.8:0/1825659587 shutdown_connections 2023-10-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.078+0000 7f4d33fff700 1 -- 172.21.15.8:0/1825659587 wait complete. 2023-10-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:05:42.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.222+0000 7f48cffff700 1 -- 172.21.15.8:0/3195745002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d0060310 msgr2=0x7f48d00f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.222+0000 7f48cffff700 1 --2- 172.21.15.8:0/3195745002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d0060310 0x7f48d00f9110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f48c0004660 tx=0x7f48c0009b30).stop 2023-10-18T21:05:42.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.222+0000 7f48cffff700 1 -- 172.21.15.8:0/3195745002 shutdown_connections 2023-10-18T21:05:42.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.222+0000 7f48cffff700 1 --2- 172.21.15.8:0/3195745002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d00f9690 0x7f48d00fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.222+0000 7f48cffff700 1 --2- 172.21.15.8:0/3195745002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d0060310 0x7f48d00f9110 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.223+0000 7f48cffff700 1 -- 172.21.15.8:0/3195745002 >> 172.21.15.8:0/3195745002 conn(0x7f48d00f0b90 msgr2=0x7f48d00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:42.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.223+0000 7f48cffff700 1 -- 172.21.15.8:0/3195745002 shutdown_connections 2023-10-18T21:05:42.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.223+0000 7f48cffff700 1 -- 172.21.15.8:0/3195745002 wait complete. 2023-10-18T21:05:42.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.223+0000 7f48cffff700 1 Processor -- start 2023-10-18T21:05:42.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.224+0000 7f48cffff700 1 -- start start 2023-10-18T21:05:42.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.224+0000 7f48cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d0060310 0x7f48d0108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:42.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.224+0000 7f48cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d00f9690 0x7f48d01093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:42.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.224+0000 7f48cffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d0109980 con 0x7f48d00f9690 2023-10-18T21:05:42.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.224+0000 7f48cffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d0109ac0 con 0x7f48d0060310 2023-10-18T21:05:42.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.224+0000 7f48ce7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d00f9690 0x7f48d01093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:42.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.224+0000 7f48ce7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d00f9690 0x7f48d01093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58354/0 (socket says 172.21.15.8:58354) 2023-10-18T21:05:42.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.224+0000 7f48ce7fc700 1 -- 172.21.15.8:0/3388124816 learned_addr learned my addr 172.21.15.8:0/3388124816 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:42.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.224+0000 7f48ceffd700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d0060310 0x7f48d0108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:42.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.225+0000 7f48ce7fc700 1 -- 172.21.15.8:0/3388124816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d0060310 msgr2=0x7f48d0108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.225+0000 7f48ce7fc700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d0060310 0x7f48d0108ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.225+0000 7f48ce7fc700 1 -- 172.21.15.8:0/3388124816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c0005040 con 0x7f48d00f9690 2023-10-18T21:05:42.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.225+0000 7f48ce7fc700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d00f9690 0x7f48d01093d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f48c40026d0 tx=0x7f48c4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:42.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.225+0000 7f48b77fe700 1 -- 172.21.15.8:0/3388124816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48c40079c0 con 0x7f48d00f9690 2023-10-18T21:05:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.225+0000 7f48cffff700 1 -- 172.21.15.8:0/3388124816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d010a460 con 0x7f48d00f9690 2023-10-18T21:05:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.225+0000 7f48b77fe700 1 -- 172.21.15.8:0/3388124816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f48c400f040 con 0x7f48d00f9690 2023-10-18T21:05:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.225+0000 7f48b77fe700 1 -- 172.21.15.8:0/3388124816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48c40148d0 con 0x7f48d00f9690 2023-10-18T21:05:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.225+0000 7f48cffff700 1 -- 172.21.15.8:0/3388124816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d010aa20 con 0x7f48d00f9690 2023-10-18T21:05:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.227+0000 7f48cffff700 1 -- 172.21.15.8:0/3388124816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d0045ad0 con 0x7f48d00f9690 2023-10-18T21:05:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.227+0000 7f48b77fe700 1 -- 172.21.15.8:0/3388124816 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f48c40090d0 con 0x7f48d00f9690 2023-10-18T21:05:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.228+0000 7f48b77fe700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48b8060f70 0x7f48b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.228+0000 7f48b77fe700 1 -- 172.21.15.8:0/3388124816 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f48c407c380 con 0x7f48d00f9690 2023-10-18T21:05:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.228+0000 7f48ceffd700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48b8060f70 0x7f48b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.229+0000 7f48ceffd700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48b8060f70 0x7f48b8063430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f48c0004630 tx=0x7f48c0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.232+0000 7f48b77fe700 1 -- 172.21.15.8:0/3388124816 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f48c404ff70 con 0x7f48d00f9690 2023-10-18T21:05:42.459 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:05:42.281+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:42.460 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:41.242229+0000 mgr.smithi008.flmjzp (mgr.14640) 375 : cluster [DBG] pgmap v269: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:42.460 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:42.193351+0000 mon.smithi008 (mon.0) 693 : cluster [INF] daemon mds.cephfs.smithi008.mpstiw restarted 2023-10-18T21:05:42.460 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:42.197610+0000 mon.smithi008 (mon.0) 694 : cluster [DBG] osdmap e89: 6 total, 6 up, 6 in 2023-10-18T21:05:42.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.463+0000 7f48cffff700 1 -- 172.21.15.8:0/3388124816 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48d00f5670 con 0x7f48b8060f70 2023-10-18T21:05:42.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48b77fe700 1 -- 172.21.15.8:0/3388124816 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f48d00f5670 con 0x7f48b8060f70 2023-10-18T21:05:42.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 -- 172.21.15.8:0/3388124816 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48b8060f70 msgr2=0x7f48b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48b8060f70 0x7f48b8063430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f48c0004630 tx=0x7f48c0009b30).stop 2023-10-18T21:05:42.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 -- 172.21.15.8:0/3388124816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d00f9690 msgr2=0x7f48d01093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d00f9690 0x7f48d01093d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f48c40026d0 tx=0x7f48c4009e00).stop 2023-10-18T21:05:42.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 -- 172.21.15.8:0/3388124816 shutdown_connections 2023-10-18T21:05:42.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48b8060f70 0x7f48b8063430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d0060310 0x7f48d0108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 --2- 172.21.15.8:0/3388124816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d00f9690 0x7f48d01093d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 -- 172.21.15.8:0/3388124816 >> 172.21.15.8:0/3388124816 conn(0x7f48d00f0b90 msgr2=0x7f48d00f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:42.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 -- 172.21.15.8:0/3388124816 shutdown_connections 2023-10-18T21:05:42.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.465+0000 7f48cffff700 1 -- 172.21.15.8:0/3388124816 wait complete. 2023-10-18T21:05:42.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.607+0000 7f0e2e82f700 1 -- 172.21.15.8:0/2424749407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e280f6530 msgr2=0x7f0e280f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.607+0000 7f0e2e82f700 1 --2- 172.21.15.8:0/2424749407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e280f6530 0x7f0e280f6950 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f0e24004660 tx=0x7f0e24009b30).stop 2023-10-18T21:05:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.607+0000 7f0e2e82f700 1 -- 172.21.15.8:0/2424749407 shutdown_connections 2023-10-18T21:05:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.607+0000 7f0e2e82f700 1 --2- 172.21.15.8:0/2424749407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e280f77d0 0x7f0e280f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.607+0000 7f0e2e82f700 1 --2- 172.21.15.8:0/2424749407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e280f6530 0x7f0e280f6950 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.607+0000 7f0e2e82f700 1 -- 172.21.15.8:0/2424749407 >> 172.21.15.8:0/2424749407 conn(0x7f0e280f1c90 msgr2=0x7f0e280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.607+0000 7f0e2e82f700 1 -- 172.21.15.8:0/2424749407 shutdown_connections 2023-10-18T21:05:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.607+0000 7f0e2e82f700 1 -- 172.21.15.8:0/2424749407 wait complete. 2023-10-18T21:05:42.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.608+0000 7f0e2e82f700 1 Processor -- start 2023-10-18T21:05:42.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.608+0000 7f0e2e82f700 1 -- start start 2023-10-18T21:05:42.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.609+0000 7f0e2e82f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e280f6530 0x7f0e28106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:42.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.609+0000 7f0e2e82f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e280f77d0 0x7f0e28107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:42.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.609+0000 7f0e2e82f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e28107880 con 0x7f0e280f6530 2023-10-18T21:05:42.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.609+0000 7f0e2e82f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281080c0 con 0x7f0e280f77d0 2023-10-18T21:05:42.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.609+0000 7f0e2d82d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e280f6530 0x7f0e28106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:42.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.609+0000 7f0e2d82d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e280f6530 0x7f0e28106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58370/0 (socket says 172.21.15.8:58370) 2023-10-18T21:05:42.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.609+0000 7f0e2d82d700 1 -- 172.21.15.8:0/3022025142 learned_addr learned my addr 172.21.15.8:0/3022025142 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.609+0000 7f0e2d02c700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e280f77d0 0x7f0e28107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.610+0000 7f0e2d82d700 1 -- 172.21.15.8:0/3022025142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e280f77d0 msgr2=0x7f0e28107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.610+0000 7f0e2d82d700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e280f77d0 0x7f0e28107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.610+0000 7f0e2d82d700 1 -- 172.21.15.8:0/3022025142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e24005040 con 0x7f0e280f6530 2023-10-18T21:05:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.610+0000 7f0e2d82d700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e280f6530 0x7f0e28106d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f0e24009870 tx=0x7f0e2400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.610+0000 7f0e1e7fc700 1 -- 172.21.15.8:0/3022025142 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e24019070 con 0x7f0e280f6530 2023-10-18T21:05:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.610+0000 7f0e1e7fc700 1 -- 172.21.15.8:0/3022025142 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0e24013380 con 0x7f0e280f6530 2023-10-18T21:05:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.610+0000 7f0e1e7fc700 1 -- 172.21.15.8:0/3022025142 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e2401edf0 con 0x7f0e280f6530 2023-10-18T21:05:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.610+0000 7f0e2e82f700 1 -- 172.21.15.8:0/3022025142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e28108340 con 0x7f0e280f6530 2023-10-18T21:05:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.610+0000 7f0e2e82f700 1 -- 172.21.15.8:0/3022025142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e28108820 con 0x7f0e280f6530 2023-10-18T21:05:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.612+0000 7f0e2e82f700 1 -- 172.21.15.8:0/3022025142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e28059100 con 0x7f0e280f6530 2023-10-18T21:05:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.613+0000 7f0e1e7fc700 1 -- 172.21.15.8:0/3022025142 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0e240079c0 con 0x7f0e280f6530 2023-10-18T21:05:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.614+0000 7f0e1e7fc700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e14060f70 0x7f0e14063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.614+0000 7f0e1e7fc700 1 -- 172.21.15.8:0/3022025142 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0e2407d640 con 0x7f0e280f6530 2023-10-18T21:05:42.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.615+0000 7f0e2d02c700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e14060f70 0x7f0e14063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:42.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.615+0000 7f0e2d02c700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e14060f70 0x7f0e14063430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0e28106b20 tx=0x7f0e1800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.619+0000 7f0e1e7fc700 1 -- 172.21.15.8:0/3022025142 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0e2404d940 con 0x7f0e280f6530 2023-10-18T21:05:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:41.242229+0000 mgr.smithi008.flmjzp (mgr.14640) 375 : cluster [DBG] pgmap v269: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:42.193351+0000 mon.smithi008 (mon.0) 693 : cluster [INF] daemon mds.cephfs.smithi008.mpstiw restarted 2023-10-18T21:05:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:42.197610+0000 mon.smithi008 (mon.0) 694 : cluster [DBG] osdmap e89: 6 total, 6 up, 6 in 2023-10-18T21:05:42.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.831+0000 7f0e2e82f700 1 -- 172.21.15.8:0/3022025142 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e280fed30 con 0x7f0e14060f70 2023-10-18T21:05:42.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.841+0000 7f0e1e7fc700 1 -- 172.21.15.8:0/3022025142 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f0e280fed30 con 0x7f0e14060f70 2023-10-18T21:05:42.843 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:05:42.843 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (12m) 34s ago 13m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:05:42.843 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (6m) 34s ago 13m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:05:42.844 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (6m) 108s ago 12m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:05:42.844 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (12m) 34s ago 13m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:05:42.844 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (37s) 34s ago 9m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:05:42.844 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 34s ago 9m - - 2023-10-18T21:05:42.844 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (9m) 108s ago 9m 3802M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:05:42.845 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (9m) 108s ago 9m 478M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:05:42.845 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (7m) 34s ago 15m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:05:42.845 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (6m) 108s ago 12m 396M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:05:42.845 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (6m) 34s ago 15m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:05:42.845 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (6m) 108s ago 12m 85.3M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:05:42.845 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (13m) 34s ago 13m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:05:42.846 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (12m) 108s ago 12m 9.87M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:05:42.846 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (5m) 34s ago 12m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:05:42.846 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (3m) 34s ago 12m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:05:42.846 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (3m) 34s ago 11m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:05:42.847 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (2m) 108s ago 11m 340M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:05:42.847 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (2m) 108s ago 11m 305M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:05:42.847 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (111s) 108s ago 10m 10.6M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:05:42.847 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (7m) 34s ago 13m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:05:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.843+0000 7f0e2e82f700 1 -- 172.21.15.8:0/3022025142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e14060f70 msgr2=0x7f0e14063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.843+0000 7f0e2e82f700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e14060f70 0x7f0e14063430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0e28106b20 tx=0x7f0e1800b040).stop 2023-10-18T21:05:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.843+0000 7f0e2e82f700 1 -- 172.21.15.8:0/3022025142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e280f6530 msgr2=0x7f0e28106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.843+0000 7f0e2e82f700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e280f6530 0x7f0e28106d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f0e24009870 tx=0x7f0e2400b040).stop 2023-10-18T21:05:42.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.843+0000 7f0e2e82f700 1 -- 172.21.15.8:0/3022025142 shutdown_connections 2023-10-18T21:05:42.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.843+0000 7f0e2e82f700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e14060f70 0x7f0e14063430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.843+0000 7f0e2e82f700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e280f6530 0x7f0e28106d90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.843+0000 7f0e2e82f700 1 --2- 172.21.15.8:0/3022025142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e280f77d0 0x7f0e28107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.843+0000 7f0e2e82f700 1 -- 172.21.15.8:0/3022025142 >> 172.21.15.8:0/3022025142 conn(0x7f0e280f1c90 msgr2=0x7f0e280fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:42.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.844+0000 7f0e2e82f700 1 -- 172.21.15.8:0/3022025142 shutdown_connections 2023-10-18T21:05:42.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.844+0000 7f0e2e82f700 1 -- 172.21.15.8:0/3022025142 wait complete. 2023-10-18T21:05:42.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.982+0000 7f4a16f33700 1 -- 172.21.15.8:0/1291351240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a100f6530 msgr2=0x7f4a100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.982+0000 7f4a16f33700 1 --2- 172.21.15.8:0/1291351240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a100f6530 0x7f4a100f6950 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f4a0c004660 tx=0x7f4a0c009b30).stop 2023-10-18T21:05:42.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.982+0000 7f4a16f33700 1 -- 172.21.15.8:0/1291351240 shutdown_connections 2023-10-18T21:05:42.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.982+0000 7f4a16f33700 1 --2- 172.21.15.8:0/1291351240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a100f77d0 0x7f4a100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.982+0000 7f4a16f33700 1 --2- 172.21.15.8:0/1291351240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a100f6530 0x7f4a100f6950 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.982+0000 7f4a16f33700 1 -- 172.21.15.8:0/1291351240 >> 172.21.15.8:0/1291351240 conn(0x7f4a100f1c90 msgr2=0x7f4a100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:42.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.982+0000 7f4a16f33700 1 -- 172.21.15.8:0/1291351240 shutdown_connections 2023-10-18T21:05:42.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.983+0000 7f4a16f33700 1 -- 172.21.15.8:0/1291351240 wait complete. 2023-10-18T21:05:42.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.983+0000 7f4a16f33700 1 Processor -- start 2023-10-18T21:05:42.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.983+0000 7f4a16f33700 1 -- start start 2023-10-18T21:05:42.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.984+0000 7f4a16f33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a100f6530 0x7f4a10106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:42.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.984+0000 7f4a16f33700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a100f77d0 0x7f4a10107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:42.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.984+0000 7f4a16f33700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10107910 con 0x7f4a100f6530 2023-10-18T21:05:42.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.984+0000 7f4a16f33700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10108120 con 0x7f4a100f77d0 2023-10-18T21:05:42.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.984+0000 7f4a15f31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a100f6530 0x7f4a10106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:42.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.984+0000 7f4a15f31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a100f6530 0x7f4a10106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58392/0 (socket says 172.21.15.8:58392) 2023-10-18T21:05:42.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.984+0000 7f4a15f31700 1 -- 172.21.15.8:0/736086353 learned_addr learned my addr 172.21.15.8:0/736086353 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:42.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.984+0000 7f4a15730700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a100f77d0 0x7f4a10107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:42.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.984+0000 7f4a15f31700 1 -- 172.21.15.8:0/736086353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a100f77d0 msgr2=0x7f4a10107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:42.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.984+0000 7f4a15f31700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a100f77d0 0x7f4a10107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:42.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.985+0000 7f4a15f31700 1 -- 172.21.15.8:0/736086353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c005040 con 0x7f4a100f6530 2023-10-18T21:05:42.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.985+0000 7f4a15f31700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a100f6530 0x7f4a10106e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f4a0c004e30 tx=0x7f4a0c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:42.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.985+0000 7f4a067fc700 1 -- 172.21.15.8:0/736086353 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a0c018070 con 0x7f4a100f6530 2023-10-18T21:05:42.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.985+0000 7f4a067fc700 1 -- 172.21.15.8:0/736086353 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4a0c009630 con 0x7f4a100f6530 2023-10-18T21:05:42.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.985+0000 7f4a16f33700 1 -- 172.21.15.8:0/736086353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a10108340 con 0x7f4a100f6530 2023-10-18T21:05:42.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.985+0000 7f4a067fc700 1 -- 172.21.15.8:0/736086353 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a0c01c3c0 con 0x7f4a100f6530 2023-10-18T21:05:42.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.985+0000 7f4a16f33700 1 -- 172.21.15.8:0/736086353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a101088a0 con 0x7f4a100f6530 2023-10-18T21:05:42.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.986+0000 7f4a16f33700 1 -- 172.21.15.8:0/736086353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a10059100 con 0x7f4a100f6530 2023-10-18T21:05:42.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.987+0000 7f4a067fc700 1 -- 172.21.15.8:0/736086353 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4a0c01d420 con 0x7f4a100f6530 2023-10-18T21:05:42.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.989+0000 7f4a067fc700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49fc060f70 0x7f49fc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.989+0000 7f4a067fc700 1 -- 172.21.15.8:0/736086353 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4a0c07df20 con 0x7f4a100f6530 2023-10-18T21:05:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.989+0000 7f4a15730700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49fc060f70 0x7f49fc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.989+0000 7f4a15730700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49fc060f70 0x7f49fc063430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4a00004c40 tx=0x7f4a0000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:42.993+0000 7f4a067fc700 1 -- 172.21.15.8:0/736086353 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4a0c04e0e0 con 0x7f4a100f6530 2023-10-18T21:05:43.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.244+0000 7f4a16f33700 1 -- 172.21.15.8:0/736086353 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4a100fed60 con 0x7f4a100f6530 2023-10-18T21:05:43.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.245+0000 7f4a067fc700 1 -- 172.21.15.8:0/736086353 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7f4a0c051700 con 0x7f4a100f6530 2023-10-18T21:05:43.247 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:05:43.247 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:05:43.247 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:05:43.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:05:43.248 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:05:43.248 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:05:43.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:05:43.248 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:05:43.249 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:05:43.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:05:43.249 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:05:43.249 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2, 2023-10-18T21:05:43.249 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T21:05:43.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:05:43.250 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:05:43.250 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 12, 2023-10-18T21:05:43.250 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T21:05:43.250 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:05:43.251 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:05:43.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.247+0000 7f4a16f33700 1 -- 172.21.15.8:0/736086353 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49fc060f70 msgr2=0x7f49fc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:43.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.247+0000 7f4a16f33700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49fc060f70 0x7f49fc063430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4a00004c40 tx=0x7f4a0000b040).stop 2023-10-18T21:05:43.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.247+0000 7f4a16f33700 1 -- 172.21.15.8:0/736086353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a100f6530 msgr2=0x7f4a10106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:43.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.247+0000 7f4a16f33700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a100f6530 0x7f4a10106e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f4a0c004e30 tx=0x7f4a0c009b30).stop 2023-10-18T21:05:43.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.247+0000 7f4a16f33700 1 -- 172.21.15.8:0/736086353 shutdown_connections 2023-10-18T21:05:43.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.247+0000 7f4a16f33700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49fc060f70 0x7f49fc063430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.247+0000 7f4a16f33700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a100f6530 0x7f4a10106e20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.247+0000 7f4a16f33700 1 --2- 172.21.15.8:0/736086353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a100f77d0 0x7f4a10107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.247+0000 7f4a16f33700 1 -- 172.21.15.8:0/736086353 >> 172.21.15.8:0/736086353 conn(0x7f4a100f1c90 msgr2=0x7f4a100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:43.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.248+0000 7f4a16f33700 1 -- 172.21.15.8:0/736086353 shutdown_connections 2023-10-18T21:05:43.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.248+0000 7f4a16f33700 1 -- 172.21.15.8:0/736086353 wait complete. 2023-10-18T21:05:43.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.387+0000 7fea4d96b700 1 -- 172.21.15.8:0/353561855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea480f6530 msgr2=0x7fea480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:43.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.387+0000 7fea4d96b700 1 --2- 172.21.15.8:0/353561855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea480f6530 0x7fea480f6950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fea3c004660 tx=0x7fea3c009b30).stop 2023-10-18T21:05:43.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.387+0000 7fea4d96b700 1 -- 172.21.15.8:0/353561855 shutdown_connections 2023-10-18T21:05:43.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.387+0000 7fea4d96b700 1 --2- 172.21.15.8:0/353561855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea480f77d0 0x7fea480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.387+0000 7fea4d96b700 1 --2- 172.21.15.8:0/353561855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea480f6530 0x7fea480f6950 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.387+0000 7fea4d96b700 1 -- 172.21.15.8:0/353561855 >> 172.21.15.8:0/353561855 conn(0x7fea480f1c90 msgr2=0x7fea480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:43.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.387+0000 7fea4d96b700 1 -- 172.21.15.8:0/353561855 shutdown_connections 2023-10-18T21:05:43.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.387+0000 7fea4d96b700 1 -- 172.21.15.8:0/353561855 wait complete. 2023-10-18T21:05:43.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.388+0000 7fea4d96b700 1 Processor -- start 2023-10-18T21:05:43.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.388+0000 7fea4d96b700 1 -- start start 2023-10-18T21:05:43.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.388+0000 7fea4d96b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea480f6530 0x7fea4806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:43.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.388+0000 7fea4d96b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea480f77d0 0x7fea48069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.388+0000 7fea4d96b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4806a380 con 0x7fea480f77d0 2023-10-18T21:05:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.388+0000 7fea4d96b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4806a4c0 con 0x7fea480f6530 2023-10-18T21:05:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.388+0000 7fea47fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea480f77d0 0x7fea48069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea47fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea480f77d0 0x7fea48069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58410/0 (socket says 172.21.15.8:58410) 2023-10-18T21:05:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea47fff700 1 -- 172.21.15.8:0/1256539951 learned_addr learned my addr 172.21.15.8:0/1256539951 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea4c969700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea480f6530 0x7fea4806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea47fff700 1 -- 172.21.15.8:0/1256539951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea480f6530 msgr2=0x7fea4806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea47fff700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea480f6530 0x7fea4806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea47fff700 1 -- 172.21.15.8:0/1256539951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c005040 con 0x7fea480f77d0 2023-10-18T21:05:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea47fff700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea480f77d0 0x7fea48069e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fea340026d0 tx=0x7fea34009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea457fa700 1 -- 172.21.15.8:0/1256539951 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea340079c0 con 0x7fea480f77d0 2023-10-18T21:05:43.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea457fa700 1 -- 172.21.15.8:0/1256539951 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fea3400f040 con 0x7fea480f77d0 2023-10-18T21:05:43.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea4d96b700 1 -- 172.21.15.8:0/1256539951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4806a7a0 con 0x7fea480f77d0 2023-10-18T21:05:43.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.389+0000 7fea457fa700 1 -- 172.21.15.8:0/1256539951 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea34014980 con 0x7fea480f77d0 2023-10-18T21:05:43.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.390+0000 7fea4d96b700 1 -- 172.21.15.8:0/1256539951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4810edd0 con 0x7fea480f77d0 2023-10-18T21:05:43.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.391+0000 7fea4d96b700 1 -- 172.21.15.8:0/1256539951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea48045ad0 con 0x7fea480f77d0 2023-10-18T21:05:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.391+0000 7fea457fa700 1 -- 172.21.15.8:0/1256539951 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fea340090d0 con 0x7fea480f77d0 2023-10-18T21:05:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.392+0000 7fea457fa700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea38060f70 0x7fea38063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.392+0000 7fea457fa700 1 -- 172.21.15.8:0/1256539951 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fea3407c290 con 0x7fea480f77d0 2023-10-18T21:05:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.392+0000 7fea4c969700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea38060f70 0x7fea38063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.393+0000 7fea4c969700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea38060f70 0x7fea38063430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fea4806b730 tx=0x7fea3c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.396+0000 7fea457fa700 1 -- 172.21.15.8:0/1256539951 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fea3404c580 con 0x7fea480f77d0 2023-10-18T21:05:43.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.627+0000 7fea4d96b700 1 -- 172.21.15.8:0/1256539951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fea48027a00 con 0x7fea480f77d0 2023-10-18T21:05:43.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.628+0000 7fea457fa700 1 -- 172.21.15.8:0/1256539951 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+1759 (secure 0 0 0) 0x7fea3404fba0 con 0x7fea480f77d0 2023-10-18T21:05:43.630 INFO:teuthology.orchestra.run.smithi008.stdout:e39 2023-10-18T21:05:43.631 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:05:43.631 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:05:43.631 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:05:43.631 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:05:43.632 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:05:43.632 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:05:43.632 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 39 2023-10-18T21:05:43.632 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:05:43.632 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:05:43.633 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:05:42.290475+0000 2023-10-18T21:05:43.633 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:05:43.633 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:05:43.633 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:05:43.633 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:05:43.634 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:05:43.634 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:05:43.634 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:05:43.634 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 89 2023-10-18T21:05:43.634 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:05:43.635 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:05:43.635 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:05:43.635 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=34430} 2023-10-18T21:05:43.635 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:05:43.635 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:05:43.635 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:05:43.636 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:05:43.636 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:05:43.636 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:05:43.636 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:05:43.636 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:05:43.637 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:34430} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.8:6828/2155093583,v1:172.21.15.8:6829/2155093583] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:05:43.637 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:05:43.637 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:05:43.637 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:05:43.637 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:05:43.638 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{-1:34438} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.8:6826/965651309,v1:172.21.15.8:6827/965651309] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:05:43.638 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:05:43.638 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6824/894252909,v1:172.21.15.60:6825/894252909] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:05:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 -- 172.21.15.8:0/1256539951 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea38060f70 msgr2=0x7fea38063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea38060f70 0x7fea38063430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fea4806b730 tx=0x7fea3c009b30).stop 2023-10-18T21:05:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 -- 172.21.15.8:0/1256539951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea480f77d0 msgr2=0x7fea48069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:43.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea480f77d0 0x7fea48069e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fea340026d0 tx=0x7fea34009de0).stop 2023-10-18T21:05:43.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 -- 172.21.15.8:0/1256539951 shutdown_connections 2023-10-18T21:05:43.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea38060f70 0x7fea38063430 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea480f6530 0x7fea4806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 --2- 172.21.15.8:0/1256539951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea480f77d0 0x7fea48069e20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 -- 172.21.15.8:0/1256539951 >> 172.21.15.8:0/1256539951 conn(0x7fea480f1c90 msgr2=0x7fea480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:43.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 -- 172.21.15.8:0/1256539951 shutdown_connections 2023-10-18T21:05:43.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.630+0000 7fea4d96b700 1 -- 172.21.15.8:0/1256539951 wait complete. 2023-10-18T21:05:43.642 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 39 2023-10-18T21:05:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:42.075600+0000 mgr.smithi008.flmjzp (mgr.14640) 376 : audit [DBG] from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:42.281499+0000 mon.smithi008 (mon.0) 695 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:42.290357+0000 mon.smithi008 (mon.0) 696 : cluster [DBG] mds.? [v2:172.21.15.8:6826/965651309,v1:172.21.15.8:6827/965651309] up:boot 2023-10-18T21:05:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:42.290424+0000 mon.smithi008 (mon.0) 697 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:05:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:42.290552+0000 mon.smithi008 (mon.0) 698 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:05:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:42.290863+0000 mon.smithi008 (mon.0) 699 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:05:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:42.290974+0000 mon.smithi008 (mon.0) 700 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:05:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:42.295022+0000 mon.smithi008 (mon.0) 701 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 3 up:standby 2023-10-18T21:05:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:42.465040+0000 mgr.smithi008.flmjzp (mgr.14640) 377 : audit [DBG] from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:43.245629+0000 mon.smithi008 (mon.0) 702 : audit [DBG] from='client.? 172.21.15.8:0/736086353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:42.075600+0000 mgr.smithi008.flmjzp (mgr.14640) 376 : audit [DBG] from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:42.281499+0000 mon.smithi008 (mon.0) 695 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:42.290357+0000 mon.smithi008 (mon.0) 696 : cluster [DBG] mds.? [v2:172.21.15.8:6826/965651309,v1:172.21.15.8:6827/965651309] up:boot 2023-10-18T21:05:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:42.290424+0000 mon.smithi008 (mon.0) 697 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:05:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:42.290552+0000 mon.smithi008 (mon.0) 698 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:05:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:42.290863+0000 mon.smithi008 (mon.0) 699 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:05:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:42.290974+0000 mon.smithi008 (mon.0) 700 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:05:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:42.295022+0000 mon.smithi008 (mon.0) 701 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 3 up:standby 2023-10-18T21:05:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:42.465040+0000 mgr.smithi008.flmjzp (mgr.14640) 377 : audit [DBG] from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:43.245629+0000 mon.smithi008 (mon.0) 702 : audit [DBG] from='client.? 172.21.15.8:0/736086353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:43.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.770+0000 7f52cea97700 1 -- 172.21.15.8:0/2939843857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c80f6530 msgr2=0x7f52c80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:43.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.770+0000 7f52cea97700 1 --2- 172.21.15.8:0/2939843857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c80f6530 0x7f52c80f6950 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f52c4004660 tx=0x7f52c4009b30).stop 2023-10-18T21:05:43.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.770+0000 7f52cea97700 1 -- 172.21.15.8:0/2939843857 shutdown_connections 2023-10-18T21:05:43.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.770+0000 7f52cea97700 1 --2- 172.21.15.8:0/2939843857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c80f77d0 0x7f52c80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.770+0000 7f52cea97700 1 --2- 172.21.15.8:0/2939843857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c80f6530 0x7f52c80f6950 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.770+0000 7f52cea97700 1 -- 172.21.15.8:0/2939843857 >> 172.21.15.8:0/2939843857 conn(0x7f52c80f1c90 msgr2=0x7f52c80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:43.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.770+0000 7f52cea97700 1 -- 172.21.15.8:0/2939843857 shutdown_connections 2023-10-18T21:05:43.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.770+0000 7f52cea97700 1 -- 172.21.15.8:0/2939843857 wait complete. 2023-10-18T21:05:43.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.771+0000 7f52cea97700 1 Processor -- start 2023-10-18T21:05:43.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.771+0000 7f52cea97700 1 -- start start 2023-10-18T21:05:43.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.771+0000 7f52cea97700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c80f6530 0x7f52c8108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:43.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.771+0000 7f52cea97700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c80f77d0 0x7f52c81094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:43.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.771+0000 7f52cea97700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8109a50 con 0x7f52c80f6530 2023-10-18T21:05:43.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.771+0000 7f52cea97700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8109b90 con 0x7f52c80f77d0 2023-10-18T21:05:43.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.772+0000 7f52cda95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c80f6530 0x7f52c8108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:43.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.772+0000 7f52cda95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c80f6530 0x7f52c8108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58424/0 (socket says 172.21.15.8:58424) 2023-10-18T21:05:43.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.772+0000 7f52cda95700 1 -- 172.21.15.8:0/3611829212 learned_addr learned my addr 172.21.15.8:0/3611829212 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:05:43.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.772+0000 7f52cd294700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c80f77d0 0x7f52c81094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:43.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.772+0000 7f52cda95700 1 -- 172.21.15.8:0/3611829212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c80f77d0 msgr2=0x7f52c81094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:43.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.772+0000 7f52cda95700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c80f77d0 0x7f52c81094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.772+0000 7f52cda95700 1 -- 172.21.15.8:0/3611829212 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4005040 con 0x7f52c80f6530 2023-10-18T21:05:43.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.772+0000 7f52cda95700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c80f6530 0x7f52c8108fb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f52c4004e30 tx=0x7f52c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:43.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.772+0000 7f52be7fc700 1 -- 172.21.15.8:0/3611829212 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52c4018070 con 0x7f52c80f6530 2023-10-18T21:05:43.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.772+0000 7f52be7fc700 1 -- 172.21.15.8:0/3611829212 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f52c4009630 con 0x7f52c80f6530 2023-10-18T21:05:43.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.773+0000 7f52be7fc700 1 -- 172.21.15.8:0/3611829212 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52c401c3c0 con 0x7f52c80f6530 2023-10-18T21:05:43.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.773+0000 7f52cea97700 1 -- 172.21.15.8:0/3611829212 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c810a4d0 con 0x7f52c80f6530 2023-10-18T21:05:43.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.773+0000 7f52cea97700 1 -- 172.21.15.8:0/3611829212 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c810aa30 con 0x7f52c80f6530 2023-10-18T21:05:43.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.774+0000 7f52cea97700 1 -- 172.21.15.8:0/3611829212 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c8045ad0 con 0x7f52c80f6530 2023-10-18T21:05:43.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.775+0000 7f52be7fc700 1 -- 172.21.15.8:0/3611829212 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f52c401d420 con 0x7f52c80f6530 2023-10-18T21:05:43.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.775+0000 7f52be7fc700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52b4060f70 0x7f52b4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:05:43.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.775+0000 7f52be7fc700 1 -- 172.21.15.8:0/3611829212 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f52c407df30 con 0x7f52c80f6530 2023-10-18T21:05:43.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.776+0000 7f52cd294700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52b4060f70 0x7f52b4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:05:43.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.776+0000 7f52cd294700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52b4060f70 0x7f52b4063430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f52b80096c0 tx=0x7f52b8009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:05:43.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.780+0000 7f52be7fc700 1 -- 172.21.15.8:0/3611829212 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f52c4051c50 con 0x7f52c80f6530 2023-10-18T21:05:43.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.978+0000 7f52cea97700 1 -- 172.21.15.8:0/3611829212 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52c80fedd0 con 0x7f52b4060f70 2023-10-18T21:05:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.979+0000 7f52be7fc700 1 -- 172.21.15.8:0/3611829212 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f52c80fedd0 con 0x7f52b4060f70 2023-10-18T21:05:43.981 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:05:43.981 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:05:43.981 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:05:43.981 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:05:43.982 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:05:43.982 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:05:43.982 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:05:43.982 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:05:43.982 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:05:43.983 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:05:43.983 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "13/21 daemons upgraded", 2023-10-18T21:05:43.983 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:05:43.983 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:05:43.983 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:05:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.981+0000 7f52cea97700 1 -- 172.21.15.8:0/3611829212 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52b4060f70 msgr2=0x7f52b4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.981+0000 7f52cea97700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52b4060f70 0x7f52b4063430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f52b80096c0 tx=0x7f52b8009be0).stop 2023-10-18T21:05:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.981+0000 7f52cea97700 1 -- 172.21.15.8:0/3611829212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c80f6530 msgr2=0x7f52c8108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:05:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.981+0000 7f52cea97700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c80f6530 0x7f52c8108fb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f52c4004e30 tx=0x7f52c4009b30).stop 2023-10-18T21:05:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.981+0000 7f52cea97700 1 -- 172.21.15.8:0/3611829212 shutdown_connections 2023-10-18T21:05:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.981+0000 7f52cea97700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52b4060f70 0x7f52b4063430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.981+0000 7f52cea97700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c80f6530 0x7f52c8108fb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.981+0000 7f52cea97700 1 --2- 172.21.15.8:0/3611829212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c80f77d0 0x7f52c81094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:05:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.981+0000 7f52cea97700 1 -- 172.21.15.8:0/3611829212 >> 172.21.15.8:0/3611829212 conn(0x7f52c80f1c90 msgr2=0x7f52c806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:05:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.982+0000 7f52cea97700 1 -- 172.21.15.8:0/3611829212 shutdown_connections 2023-10-18T21:05:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:05:43.982+0000 7f52cea97700 1 -- 172.21.15.8:0/3611829212 wait complete. 2023-10-18T21:05:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:42.832472+0000 mgr.smithi008.flmjzp (mgr.14640) 378 : audit [DBG] from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:43.242563+0000 mgr.smithi008.flmjzp (mgr.14640) 379 : cluster [DBG] pgmap v271: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:43.628585+0000 mon.smithi008 (mon.0) 703 : audit [DBG] from='client.? 172.21.15.8:0/1256539951' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:05:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:42.832472+0000 mgr.smithi008.flmjzp (mgr.14640) 378 : audit [DBG] from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:43.242563+0000 mgr.smithi008.flmjzp (mgr.14640) 379 : cluster [DBG] pgmap v271: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:43.628585+0000 mon.smithi008 (mon.0) 703 : audit [DBG] from='client.? 172.21.15.8:0/1256539951' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:05:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:43.979745+0000 mgr.smithi008.flmjzp (mgr.14640) 380 : audit [DBG] from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:43.979745+0000 mgr.smithi008.flmjzp (mgr.14640) 380 : audit [DBG] from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:05:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:45.243092+0000 mgr.smithi008.flmjzp (mgr.14640) 381 : cluster [DBG] pgmap v272: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:45.243092+0000 mgr.smithi008.flmjzp (mgr.14640) 381 : cluster [DBG] pgmap v272: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:47.243583+0000 mgr.smithi008.flmjzp (mgr.14640) 382 : cluster [DBG] pgmap v273: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:47.243583+0000 mgr.smithi008.flmjzp (mgr.14640) 382 : cluster [DBG] pgmap v273: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:49.274834+0000 mon.smithi008 (mon.0) 704 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:49.274834+0000 mon.smithi008 (mon.0) 704 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:49.244251+0000 mgr.smithi008.flmjzp (mgr.14640) 383 : cluster [DBG] pgmap v274: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:49.839360+0000 mon.smithi008 (mon.0) 705 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:05:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:49.840617+0000 mon.smithi008 (mon.0) 706 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:05:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:49.847604+0000 mon.smithi008 (mon.0) 707 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:49.854159+0000 mon.smithi008 (mon.0) 708 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:50.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:49.857247+0000 mon.smithi008 (mon.0) 709 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:50.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:49.858875+0000 mon.smithi008 (mon.0) 710 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:50.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:49.860445+0000 mon.smithi008 (mon.0) 711 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:50.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:49.862425+0000 mon.smithi008 (mon.0) 712 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:49.244251+0000 mgr.smithi008.flmjzp (mgr.14640) 383 : cluster [DBG] pgmap v274: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:49.839360+0000 mon.smithi008 (mon.0) 705 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:05:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:49.840617+0000 mon.smithi008 (mon.0) 706 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:05:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:49.847604+0000 mon.smithi008 (mon.0) 707 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:05:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:49.854159+0000 mon.smithi008 (mon.0) 708 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:05:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:49.857247+0000 mon.smithi008 (mon.0) 709 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:49.858875+0000 mon.smithi008 (mon.0) 710 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:49.860445+0000 mon.smithi008 (mon.0) 711 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:50.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:49.862425+0000 mon.smithi008 (mon.0) 712 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:05:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:49.841660+0000 mgr.smithi008.flmjzp (mgr.14640) 384 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:05:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:49.842317+0000 mgr.smithi008.flmjzp (mgr.14640) 385 : cluster [DBG] pgmap v275: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:49.842597+0000 mgr.smithi008.flmjzp (mgr.14640) 386 : cluster [DBG] pgmap v276: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:49.864312+0000 mgr.smithi008.flmjzp (mgr.14640) 387 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:05:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:49.841660+0000 mgr.smithi008.flmjzp (mgr.14640) 384 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:05:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:49.842317+0000 mgr.smithi008.flmjzp (mgr.14640) 385 : cluster [DBG] pgmap v275: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:49.842597+0000 mgr.smithi008.flmjzp (mgr.14640) 386 : cluster [DBG] pgmap v276: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:49.864312+0000 mgr.smithi008.flmjzp (mgr.14640) 387 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:05:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:51.843238+0000 mgr.smithi008.flmjzp (mgr.14640) 388 : cluster [DBG] pgmap v277: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:51.843238+0000 mgr.smithi008.flmjzp (mgr.14640) 388 : cluster [DBG] pgmap v277: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:54.660 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:05:54.324+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:54.660 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:53.432262+0000 mon.smithi008 (mon.0) 713 : cluster [INF] daemon mds.cephfs.smithi008.lehgco restarted 2023-10-18T21:05:54.660 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:53.436611+0000 mon.smithi008 (mon.0) 714 : cluster [DBG] osdmap e90: 6 total, 6 up, 6 in 2023-10-18T21:05:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:53.432262+0000 mon.smithi008 (mon.0) 713 : cluster [INF] daemon mds.cephfs.smithi008.lehgco restarted 2023-10-18T21:05:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:53.436611+0000 mon.smithi008 (mon.0) 714 : cluster [DBG] osdmap e90: 6 total, 6 up, 6 in 2023-10-18T21:05:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:53.843770+0000 mgr.smithi008.flmjzp (mgr.14640) 389 : cluster [DBG] pgmap v279: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:54.325127+0000 mon.smithi008 (mon.0) 715 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:54.333182+0000 mon.smithi008 (mon.0) 716 : cluster [DBG] mds.? [v2:172.21.15.8:6828/2533319220,v1:172.21.15.8:6829/2533319220] up:boot 2023-10-18T21:05:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:54.333294+0000 mon.smithi008 (mon.0) 717 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:05:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:54.333396+0000 mon.smithi008 (mon.0) 718 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:05:55.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:54.333753+0000 mon.smithi008 (mon.0) 719 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:05:55.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:54.333901+0000 mon.smithi008 (mon.0) 720 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:05:55.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:54.338358+0000 mon.smithi008 (mon.0) 721 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 3 up:standby 2023-10-18T21:05:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:53.843770+0000 mgr.smithi008.flmjzp (mgr.14640) 389 : cluster [DBG] pgmap v279: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:54.325127+0000 mon.smithi008 (mon.0) 715 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:05:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:54.333182+0000 mon.smithi008 (mon.0) 716 : cluster [DBG] mds.? [v2:172.21.15.8:6828/2533319220,v1:172.21.15.8:6829/2533319220] up:boot 2023-10-18T21:05:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:54.333294+0000 mon.smithi008 (mon.0) 717 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:05:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:54.333396+0000 mon.smithi008 (mon.0) 718 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:05:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:54.333753+0000 mon.smithi008 (mon.0) 719 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:05:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:54.333901+0000 mon.smithi008 (mon.0) 720 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:05:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:54.338358+0000 mon.smithi008 (mon.0) 721 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 3 up:standby 2023-10-18T21:05:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:55.844210+0000 mgr.smithi008.flmjzp (mgr.14640) 390 : cluster [DBG] pgmap v280: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:55.844210+0000 mgr.smithi008.flmjzp (mgr.14640) 390 : cluster [DBG] pgmap v280: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:05:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:57.844753+0000 mgr.smithi008.flmjzp (mgr.14640) 391 : cluster [DBG] pgmap v281: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:05:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:05:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:57.844753+0000 mgr.smithi008.flmjzp (mgr.14640) 391 : cluster [DBG] pgmap v281: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:59.869242+0000 mon.smithi008 (mon.0) 722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:59.871343+0000 mon.smithi008 (mon.0) 723 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:59.872417+0000 mon.smithi008 (mon.0) 724 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:59.879103+0000 mon.smithi008 (mon.0) 725 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:59.885600+0000 mon.smithi008 (mon.0) 726 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:59.888590+0000 mon.smithi008 (mon.0) 727 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:59.890228+0000 mon.smithi008 (mon.0) 728 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:59.891802+0000 mon.smithi008 (mon.0) 729 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:05:59.893746+0000 mon.smithi008 (mon.0) 730 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:59.869242+0000 mon.smithi008 (mon.0) 722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:59.871343+0000 mon.smithi008 (mon.0) 723 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:59.872417+0000 mon.smithi008 (mon.0) 724 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:59.879103+0000 mon.smithi008 (mon.0) 725 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:59.885600+0000 mon.smithi008 (mon.0) 726 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:59.888590+0000 mon.smithi008 (mon.0) 727 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:59.890228+0000 mon.smithi008 (mon.0) 728 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:00.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:59.891802+0000 mon.smithi008 (mon.0) 729 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:00.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:05:59.893746+0000 mon.smithi008 (mon.0) 730 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:59.845520+0000 mgr.smithi008.flmjzp (mgr.14640) 392 : cluster [DBG] pgmap v282: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:59.873317+0000 mgr.smithi008.flmjzp (mgr.14640) 393 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:59.873879+0000 mgr.smithi008.flmjzp (mgr.14640) 394 : cluster [DBG] pgmap v283: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:05:59.874160+0000 mgr.smithi008.flmjzp (mgr.14640) 395 : cluster [DBG] pgmap v284: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:05:59.895574+0000 mgr.smithi008.flmjzp (mgr.14640) 396 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:06:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:59.845520+0000 mgr.smithi008.flmjzp (mgr.14640) 392 : cluster [DBG] pgmap v282: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:59.873317+0000 mgr.smithi008.flmjzp (mgr.14640) 393 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:59.873879+0000 mgr.smithi008.flmjzp (mgr.14640) 394 : cluster [DBG] pgmap v283: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:05:59.874160+0000 mgr.smithi008.flmjzp (mgr.14640) 395 : cluster [DBG] pgmap v284: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:05:59.895574+0000 mgr.smithi008.flmjzp (mgr.14640) 396 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:06:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:01.874654+0000 mgr.smithi008.flmjzp (mgr.14640) 397 : cluster [DBG] pgmap v285: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:01.874654+0000 mgr.smithi008.flmjzp (mgr.14640) 397 : cluster [DBG] pgmap v285: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:03.875108+0000 mgr.smithi008.flmjzp (mgr.14640) 398 : cluster [DBG] pgmap v286: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:03.875108+0000 mgr.smithi008.flmjzp (mgr.14640) 398 : cluster [DBG] pgmap v286: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:06:06.354+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:06:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:05.497812+0000 mon.smithi008 (mon.0) 731 : cluster [INF] daemon mds.cephfs.smithi008.mpstiw restarted 2023-10-18T21:06:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:05.502094+0000 mon.smithi008 (mon.0) 732 : cluster [DBG] osdmap e91: 6 total, 6 up, 6 in 2023-10-18T21:06:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:05.497812+0000 mon.smithi008 (mon.0) 731 : cluster [INF] daemon mds.cephfs.smithi008.mpstiw restarted 2023-10-18T21:06:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:05.502094+0000 mon.smithi008 (mon.0) 732 : cluster [DBG] osdmap e91: 6 total, 6 up, 6 in 2023-10-18T21:06:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:05.875645+0000 mgr.smithi008.flmjzp (mgr.14640) 399 : cluster [DBG] pgmap v288: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:06.356138+0000 mon.smithi008 (mon.0) 733 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:06:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:06.364263+0000 mon.smithi008 (mon.0) 734 : cluster [DBG] mds.? [v2:172.21.15.8:6826/467597587,v1:172.21.15.8:6827/467597587] up:boot 2023-10-18T21:06:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:06.364341+0000 mon.smithi008 (mon.0) 735 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:06:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:06.364481+0000 mon.smithi008 (mon.0) 736 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:06:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:06.364795+0000 mon.smithi008 (mon.0) 737 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:06:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:06.364944+0000 mon.smithi008 (mon.0) 738 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:06:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:06.368301+0000 mon.smithi008 (mon.0) 739 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 3 up:standby 2023-10-18T21:06:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:05.875645+0000 mgr.smithi008.flmjzp (mgr.14640) 399 : cluster [DBG] pgmap v288: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:06.356138+0000 mon.smithi008 (mon.0) 733 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:06:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:06.364263+0000 mon.smithi008 (mon.0) 734 : cluster [DBG] mds.? [v2:172.21.15.8:6826/467597587,v1:172.21.15.8:6827/467597587] up:boot 2023-10-18T21:06:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:06.364341+0000 mon.smithi008 (mon.0) 735 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:06:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:06.364481+0000 mon.smithi008 (mon.0) 736 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:06:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:06.364795+0000 mon.smithi008 (mon.0) 737 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:06:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:06.364944+0000 mon.smithi008 (mon.0) 738 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:06:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:06.368301+0000 mon.smithi008 (mon.0) 739 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 3 up:standby 2023-10-18T21:06:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:07.876244+0000 mgr.smithi008.flmjzp (mgr.14640) 400 : cluster [DBG] pgmap v289: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:07.876244+0000 mgr.smithi008.flmjzp (mgr.14640) 400 : cluster [DBG] pgmap v289: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:09.896675+0000 mon.smithi008 (mon.0) 740 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:09.898749+0000 mon.smithi008 (mon.0) 741 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:09.899699+0000 mon.smithi008 (mon.0) 742 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:09.906357+0000 mon.smithi008 (mon.0) 743 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:09.913583+0000 mon.smithi008 (mon.0) 744 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:09.916666+0000 mon.smithi008 (mon.0) 745 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:09.918352+0000 mon.smithi008 (mon.0) 746 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:09.919965+0000 mon.smithi008 (mon.0) 747 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:09.921979+0000 mon.smithi008 (mon.0) 748 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:09.896675+0000 mon.smithi008 (mon.0) 740 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:09.898749+0000 mon.smithi008 (mon.0) 741 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:09.899699+0000 mon.smithi008 (mon.0) 742 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:09.906357+0000 mon.smithi008 (mon.0) 743 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:09.913583+0000 mon.smithi008 (mon.0) 744 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:09.916666+0000 mon.smithi008 (mon.0) 745 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:09.918352+0000 mon.smithi008 (mon.0) 746 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:09.919965+0000 mon.smithi008 (mon.0) 747 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:10.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:09.921979+0000 mon.smithi008 (mon.0) 748 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:09.876741+0000 mgr.smithi008.flmjzp (mgr.14640) 401 : cluster [DBG] pgmap v290: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:09.900637+0000 mgr.smithi008.flmjzp (mgr.14640) 402 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:09.901146+0000 mgr.smithi008.flmjzp (mgr.14640) 403 : cluster [DBG] pgmap v291: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:09.901319+0000 mgr.smithi008.flmjzp (mgr.14640) 404 : cluster [DBG] pgmap v292: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:09.923907+0000 mgr.smithi008.flmjzp (mgr.14640) 405 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:06:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:09.876741+0000 mgr.smithi008.flmjzp (mgr.14640) 401 : cluster [DBG] pgmap v290: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:09.900637+0000 mgr.smithi008.flmjzp (mgr.14640) 402 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:09.901146+0000 mgr.smithi008.flmjzp (mgr.14640) 403 : cluster [DBG] pgmap v291: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:09.901319+0000 mgr.smithi008.flmjzp (mgr.14640) 404 : cluster [DBG] pgmap v292: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:09.923907+0000 mgr.smithi008.flmjzp (mgr.14640) 405 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:06:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:11.901775+0000 mgr.smithi008.flmjzp (mgr.14640) 406 : cluster [DBG] pgmap v293: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:11.901775+0000 mgr.smithi008.flmjzp (mgr.14640) 406 : cluster [DBG] pgmap v293: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:14.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.137+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4069294839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 msgr2=0x7f6f680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:14.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.137+0000 7f6f6d8a7700 1 --2- 172.21.15.8:0/4069294839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f680f7c30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f6f54004660 tx=0x7f6f54009b30).stop 2023-10-18T21:06:14.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.137+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4069294839 shutdown_connections 2023-10-18T21:06:14.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.137+0000 7f6f6d8a7700 1 --2- 172.21.15.8:0/4069294839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f680f7c30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.137+0000 7f6f6d8a7700 1 --2- 172.21.15.8:0/4069294839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 0x7f6f680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.137+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4069294839 >> 172.21.15.8:0/4069294839 conn(0x7f6f680f1c90 msgr2=0x7f6f680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:14.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.138+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4069294839 shutdown_connections 2023-10-18T21:06:14.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.138+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4069294839 wait complete. 2023-10-18T21:06:14.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.138+0000 7f6f6d8a7700 1 Processor -- start 2023-10-18T21:06:14.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.139+0000 7f6f6d8a7700 1 -- start start 2023-10-18T21:06:14.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.139+0000 7f6f6d8a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 0x7f6f68106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:14.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.139+0000 7f6f6d8a7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:14.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.139+0000 7f6f6d8a7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68107830 con 0x7f6f680f77d0 2023-10-18T21:06:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.139+0000 7f6f6d8a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68108040 con 0x7f6f680f6530 2023-10-18T21:06:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.139+0000 7f6f67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.139+0000 7f6f67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39590/0 (socket says 172.21.15.8:39590) 2023-10-18T21:06:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.139+0000 7f6f67fff700 1 -- 172.21.15.8:0/4046585664 learned_addr learned my addr 172.21.15.8:0/4046585664 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f67fff700 1 -- 172.21.15.8:0/4046585664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 msgr2=0x7f6f68106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:14.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f6c8a5700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 0x7f6f68106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:14.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f67fff700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 0x7f6f68106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f67fff700 1 -- 172.21.15.8:0/4046585664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f54005040 con 0x7f6f680f77d0 2023-10-18T21:06:14.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f6c8a5700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 0x7f6f68106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:06:14.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f67fff700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68107230 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f6f54009990 tx=0x7f6f54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:14.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f657fa700 1 -- 172.21.15.8:0/4046585664 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f54018070 con 0x7f6f680f77d0 2023-10-18T21:06:14.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f657fa700 1 -- 172.21.15.8:0/4046585664 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6f54009630 con 0x7f6f680f77d0 2023-10-18T21:06:14.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f657fa700 1 -- 172.21.15.8:0/4046585664 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f5401c400 con 0x7f6f680f77d0 2023-10-18T21:06:14.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4046585664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f68108260 con 0x7f6f680f77d0 2023-10-18T21:06:14.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.140+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4046585664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f68108770 con 0x7f6f680f77d0 2023-10-18T21:06:14.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.141+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4046585664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f68059100 con 0x7f6f680f77d0 2023-10-18T21:06:14.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.142+0000 7f6f657fa700 1 -- 172.21.15.8:0/4046585664 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6f5401d9e0 con 0x7f6f680f77d0 2023-10-18T21:06:14.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.143+0000 7f6f657fa700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f58060f70 0x7f6f58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:14.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.143+0000 7f6f657fa700 1 -- 172.21.15.8:0/4046585664 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6f5407e120 con 0x7f6f680f77d0 2023-10-18T21:06:14.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.143+0000 7f6f6c8a5700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f58060f70 0x7f6f58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:14.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.144+0000 7f6f6c8a5700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f58060f70 0x7f6f58063430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6f5c009fd0 tx=0x7f6f5c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:14.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.148+0000 7f6f657fa700 1 -- 172.21.15.8:0/4046585664 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6f5404e2b0 con 0x7f6f680f77d0 2023-10-18T21:06:14.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.351+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4046585664 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f680fedb0 con 0x7f6f58060f70 2023-10-18T21:06:14.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.352+0000 7f6f657fa700 1 -- 172.21.15.8:0/4046585664 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6f680fedb0 con 0x7f6f58060f70 2023-10-18T21:06:14.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4046585664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f58060f70 msgr2=0x7f6f58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:14.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f58060f70 0x7f6f58063430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6f5c009fd0 tx=0x7f6f5c00b040).stop 2023-10-18T21:06:14.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4046585664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 msgr2=0x7f6f68107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:14.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68107230 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f6f54009990 tx=0x7f6f54009b30).stop 2023-10-18T21:06:14.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4046585664 shutdown_connections 2023-10-18T21:06:14.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f58060f70 0x7f6f58063430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 0x7f6f68106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 --2- 172.21.15.8:0/4046585664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68107230 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4046585664 >> 172.21.15.8:0/4046585664 conn(0x7f6f680f1c90 msgr2=0x7f6f680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:14.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4046585664 shutdown_connections 2023-10-18T21:06:14.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.354+0000 7f6f6d8a7700 1 -- 172.21.15.8:0/4046585664 wait complete. 2023-10-18T21:06:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.493+0000 7f9d5248f700 1 -- 172.21.15.8:0/283400753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c0f6530 msgr2=0x7f9d4c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.493+0000 7f9d5248f700 1 --2- 172.21.15.8:0/283400753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c0f6530 0x7f9d4c0f6950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f9d48004660 tx=0x7f9d48009b30).stop 2023-10-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.493+0000 7f9d5248f700 1 -- 172.21.15.8:0/283400753 shutdown_connections 2023-10-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.493+0000 7f9d5248f700 1 --2- 172.21.15.8:0/283400753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c0f77d0 0x7f9d4c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.493+0000 7f9d5248f700 1 --2- 172.21.15.8:0/283400753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c0f6530 0x7f9d4c0f6950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.493+0000 7f9d5248f700 1 -- 172.21.15.8:0/283400753 >> 172.21.15.8:0/283400753 conn(0x7f9d4c0f1c90 msgr2=0x7f9d4c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.493+0000 7f9d5248f700 1 -- 172.21.15.8:0/283400753 shutdown_connections 2023-10-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.493+0000 7f9d5248f700 1 -- 172.21.15.8:0/283400753 wait complete. 2023-10-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.494+0000 7f9d5248f700 1 Processor -- start 2023-10-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.494+0000 7f9d5248f700 1 -- start start 2023-10-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d5248f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c0f6530 0x7f9d4c108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d5248f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c0f77d0 0x7f9d4c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d5248f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c109a70 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d5248f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c109bb0 con 0x7f9d4c0f6530 2023-10-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d50c8c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c0f77d0 0x7f9d4c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d50c8c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c0f77d0 0x7f9d4c1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39604/0 (socket says 172.21.15.8:39604) 2023-10-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d50c8c700 1 -- 172.21.15.8:0/3275502506 learned_addr learned my addr 172.21.15.8:0/3275502506 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d5148d700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c0f6530 0x7f9d4c108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d50c8c700 1 -- 172.21.15.8:0/3275502506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c0f6530 msgr2=0x7f9d4c108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d50c8c700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c0f6530 0x7f9d4c108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.495+0000 7f9d50c8c700 1 -- 172.21.15.8:0/3275502506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48005040 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.496+0000 7f9d50c8c700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c0f77d0 0x7f9d4c1094c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f9d3c0026d0 tx=0x7f9d3c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.496+0000 7f9d41ffb700 1 -- 172.21.15.8:0/3275502506 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d3c009320 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.496+0000 7f9d41ffb700 1 -- 172.21.15.8:0/3275502506 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9d3c00f040 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.496+0000 7f9d41ffb700 1 -- 172.21.15.8:0/3275502506 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d3c0148a0 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.496+0000 7f9d5248f700 1 -- 172.21.15.8:0/3275502506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c10a550 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.496+0000 7f9d5248f700 1 -- 172.21.15.8:0/3275502506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c10ab10 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.497+0000 7f9d5248f700 1 -- 172.21.15.8:0/3275502506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c045ad0 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.498+0000 7f9d41ffb700 1 -- 172.21.15.8:0/3275502506 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9d3c009480 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.499+0000 7f9d41ffb700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 0x7f9d38063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.499+0000 7f9d41ffb700 1 -- 172.21.15.8:0/3275502506 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9d3c07ca00 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.499+0000 7f9d5148d700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 0x7f9d38063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.500+0000 7f9d5148d700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 0x7f9d38063430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9d48004630 tx=0x7f9d48009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.503+0000 7f9d41ffb700 1 -- 172.21.15.8:0/3275502506 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9d3c0505c0 con 0x7f9d4c0f77d0 2023-10-18T21:06:14.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.702+0000 7f9d5248f700 1 -- 172.21.15.8:0/3275502506 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d4c10ade0 con 0x7f9d38060f70 2023-10-18T21:06:14.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.703+0000 7f9d41ffb700 1 -- 172.21.15.8:0/3275502506 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9d4c10ade0 con 0x7f9d38060f70 2023-10-18T21:06:14.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 -- 172.21.15.8:0/3275502506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 msgr2=0x7f9d38063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:14.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 0x7f9d38063430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9d48004630 tx=0x7f9d48009b30).stop 2023-10-18T21:06:14.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 -- 172.21.15.8:0/3275502506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c0f77d0 msgr2=0x7f9d4c1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:14.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c0f77d0 0x7f9d4c1094c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f9d3c0026d0 tx=0x7f9d3c009de0).stop 2023-10-18T21:06:14.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 -- 172.21.15.8:0/3275502506 shutdown_connections 2023-10-18T21:06:14.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 0x7f9d38063430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c0f6530 0x7f9d4c108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 --2- 172.21.15.8:0/3275502506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c0f77d0 0x7f9d4c1094c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 -- 172.21.15.8:0/3275502506 >> 172.21.15.8:0/3275502506 conn(0x7f9d4c0f1c90 msgr2=0x7f9d4c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:14.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 -- 172.21.15.8:0/3275502506 shutdown_connections 2023-10-18T21:06:14.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.705+0000 7f9d5248f700 1 -- 172.21.15.8:0/3275502506 wait complete. 2023-10-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.842+0000 7f1e2a6da700 1 -- 172.21.15.8:0/1990266624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e240f6530 msgr2=0x7f1e240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.842+0000 7f1e2a6da700 1 --2- 172.21.15.8:0/1990266624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e240f6530 0x7f1e240f6950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f1e20004660 tx=0x7f1e20009b30).stop 2023-10-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.842+0000 7f1e2a6da700 1 -- 172.21.15.8:0/1990266624 shutdown_connections 2023-10-18T21:06:14.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.842+0000 7f1e2a6da700 1 --2- 172.21.15.8:0/1990266624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e240f77d0 0x7f1e240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.842+0000 7f1e2a6da700 1 --2- 172.21.15.8:0/1990266624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e240f6530 0x7f1e240f6950 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.842+0000 7f1e2a6da700 1 -- 172.21.15.8:0/1990266624 >> 172.21.15.8:0/1990266624 conn(0x7f1e240f1c90 msgr2=0x7f1e240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.842+0000 7f1e2a6da700 1 -- 172.21.15.8:0/1990266624 shutdown_connections 2023-10-18T21:06:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.842+0000 7f1e2a6da700 1 -- 172.21.15.8:0/1990266624 wait complete. 2023-10-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.843+0000 7f1e2a6da700 1 Processor -- start 2023-10-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.843+0000 7f1e2a6da700 1 -- start start 2023-10-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e2a6da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e240f6530 0x7f1e2406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e2a6da700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e240f77d0 0x7f1e24069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e2a6da700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2406a380 con 0x7f1e240f77d0 2023-10-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e2a6da700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2406a4c0 con 0x7f1e240f6530 2023-10-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e28ed7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e240f77d0 0x7f1e24069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e28ed7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e240f77d0 0x7f1e24069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39610/0 (socket says 172.21.15.8:39610) 2023-10-18T21:06:14.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e28ed7700 1 -- 172.21.15.8:0/2416966715 learned_addr learned my addr 172.21.15.8:0/2416966715 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e296d8700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e240f6530 0x7f1e2406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e28ed7700 1 -- 172.21.15.8:0/2416966715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e240f6530 msgr2=0x7f1e2406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e28ed7700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e240f6530 0x7f1e2406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.844+0000 7f1e28ed7700 1 -- 172.21.15.8:0/2416966715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e20005040 con 0x7f1e240f77d0 2023-10-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.845+0000 7f1e28ed7700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e240f77d0 0x7f1e24069e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1e14002700 tx=0x7f1e14009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.845+0000 7f1e19ffb700 1 -- 172.21.15.8:0/2416966715 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e14009320 con 0x7f1e240f77d0 2023-10-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.845+0000 7f1e19ffb700 1 -- 172.21.15.8:0/2416966715 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1e1400f040 con 0x7f1e240f77d0 2023-10-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.845+0000 7f1e19ffb700 1 -- 172.21.15.8:0/2416966715 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e140148f0 con 0x7f1e240f77d0 2023-10-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.845+0000 7f1e2a6da700 1 -- 172.21.15.8:0/2416966715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2406a7a0 con 0x7f1e240f77d0 2023-10-18T21:06:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.845+0000 7f1e2a6da700 1 -- 172.21.15.8:0/2416966715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2410ed70 con 0x7f1e240f77d0 2023-10-18T21:06:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.846+0000 7f1e2a6da700 1 -- 172.21.15.8:0/2416966715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e24045ad0 con 0x7f1e240f77d0 2023-10-18T21:06:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.847+0000 7f1e19ffb700 1 -- 172.21.15.8:0/2416966715 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1e14009480 con 0x7f1e240f77d0 2023-10-18T21:06:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.848+0000 7f1e19ffb700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e10060f70 0x7f1e10063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.848+0000 7f1e19ffb700 1 -- 172.21.15.8:0/2416966715 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f1e1407c620 con 0x7f1e240f77d0 2023-10-18T21:06:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.848+0000 7f1e296d8700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e10060f70 0x7f1e10063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.849+0000 7f1e296d8700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e10060f70 0x7f1e10063430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f1e2406b730 tx=0x7f1e20009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:14.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:14.852+0000 7f1e19ffb700 1 -- 172.21.15.8:0/2416966715 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1e1404c7b0 con 0x7f1e240f77d0 2023-10-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.046+0000 7f1e2a6da700 1 -- 172.21.15.8:0/2416966715 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e240fedd0 con 0x7f1e10060f70 2023-10-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.055+0000 7f1e19ffb700 1 -- 172.21.15.8:0/2416966715 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1e240fedd0 con 0x7f1e10060f70 2023-10-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (12m) 66s ago 14m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (6m) 66s ago 14m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (6m) 2m ago 13m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (12m) 66s ago 14m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (70s) 66s ago 10m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 66s ago 10m - - 2023-10-18T21:06:15.059 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (10m) 2m ago 10m 3802M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (10m) 2m ago 10m 478M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (8m) 66s ago 15m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (7m) 2m ago 13m 396M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (7m) 66s ago 15m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (7m) 2m ago 13m 85.3M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:06:15.060 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (13m) 66s ago 13m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (13m) 2m ago 13m 9.87M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (6m) 66s ago 12m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (4m) 66s ago 12m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (4m) 66s ago 12m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:06:15.061 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (3m) 2m ago 12m 340M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (2m) 2m ago 11m 305M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (2m) 2m ago 11m 10.6M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:06:15.062 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (8m) 66s ago 13m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.057+0000 7f1e2a6da700 1 -- 172.21.15.8:0/2416966715 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e10060f70 msgr2=0x7f1e10063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.057+0000 7f1e2a6da700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e10060f70 0x7f1e10063430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f1e2406b730 tx=0x7f1e20009b30).stop 2023-10-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.057+0000 7f1e2a6da700 1 -- 172.21.15.8:0/2416966715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e240f77d0 msgr2=0x7f1e24069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.057+0000 7f1e2a6da700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e240f77d0 0x7f1e24069e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1e14002700 tx=0x7f1e14009e00).stop 2023-10-18T21:06:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.058+0000 7f1e2a6da700 1 -- 172.21.15.8:0/2416966715 shutdown_connections 2023-10-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.058+0000 7f1e2a6da700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e10060f70 0x7f1e10063430 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.058+0000 7f1e2a6da700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e240f6530 0x7f1e2406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.058+0000 7f1e2a6da700 1 --2- 172.21.15.8:0/2416966715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e240f77d0 0x7f1e24069e20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.058+0000 7f1e2a6da700 1 -- 172.21.15.8:0/2416966715 >> 172.21.15.8:0/2416966715 conn(0x7f1e240f1c90 msgr2=0x7f1e240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:15.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.058+0000 7f1e2a6da700 1 -- 172.21.15.8:0/2416966715 shutdown_connections 2023-10-18T21:06:15.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.058+0000 7f1e2a6da700 1 -- 172.21.15.8:0/2416966715 wait complete. 2023-10-18T21:06:15.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.193+0000 7f67010e5700 1 -- 172.21.15.8:0/3046850063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66fc0f6530 msgr2=0x7f66fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.193+0000 7f67010e5700 1 --2- 172.21.15.8:0/3046850063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66fc0f6530 0x7f66fc0f6950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f66ec004660 tx=0x7f66ec009b30).stop 2023-10-18T21:06:15.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.193+0000 7f67010e5700 1 -- 172.21.15.8:0/3046850063 shutdown_connections 2023-10-18T21:06:15.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.193+0000 7f67010e5700 1 --2- 172.21.15.8:0/3046850063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66fc0f77d0 0x7f66fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.193+0000 7f67010e5700 1 --2- 172.21.15.8:0/3046850063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66fc0f6530 0x7f66fc0f6950 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.193+0000 7f67010e5700 1 -- 172.21.15.8:0/3046850063 >> 172.21.15.8:0/3046850063 conn(0x7f66fc0f1c90 msgr2=0x7f66fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:15.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.193+0000 7f67010e5700 1 -- 172.21.15.8:0/3046850063 shutdown_connections 2023-10-18T21:06:15.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.193+0000 7f67010e5700 1 -- 172.21.15.8:0/3046850063 wait complete. 2023-10-18T21:06:15.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.194+0000 7f67010e5700 1 Processor -- start 2023-10-18T21:06:15.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.194+0000 7f67010e5700 1 -- start start 2023-10-18T21:06:15.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f67010e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66fc0f6530 0x7f66fc108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:15.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f67010e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66fc0f77d0 0x7f66fc109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:15.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f67010e5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc109a00 con 0x7f66fc0f77d0 2023-10-18T21:06:15.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f67010e5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc109b40 con 0x7f66fc0f6530 2023-10-18T21:06:15.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f66fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66fc0f77d0 0x7f66fc109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:15.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f66fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66fc0f77d0 0x7f66fc109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39622/0 (socket says 172.21.15.8:39622) 2023-10-18T21:06:15.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f66fb7fe700 1 -- 172.21.15.8:0/571781099 learned_addr learned my addr 172.21.15.8:0/571781099 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:15.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f66fbfff700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66fc0f6530 0x7f66fc108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:15.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f66fb7fe700 1 -- 172.21.15.8:0/571781099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66fc0f6530 msgr2=0x7f66fc108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f66fb7fe700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66fc0f6530 0x7f66fc108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.195+0000 7f66fb7fe700 1 -- 172.21.15.8:0/571781099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec005040 con 0x7f66fc0f77d0 2023-10-18T21:06:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.196+0000 7f66fb7fe700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66fc0f77d0 0x7f66fc109450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f66f000e7f0 tx=0x7f66f000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.196+0000 7f66f8ff9700 1 -- 172.21.15.8:0/571781099 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66f00092e0 con 0x7f66fc0f77d0 2023-10-18T21:06:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.196+0000 7f66f8ff9700 1 -- 172.21.15.8:0/571781099 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f66f000f040 con 0x7f66fc0f77d0 2023-10-18T21:06:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.196+0000 7f67010e5700 1 -- 172.21.15.8:0/571781099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc10a4e0 con 0x7f66fc0f77d0 2023-10-18T21:06:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.196+0000 7f66f8ff9700 1 -- 172.21.15.8:0/571781099 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66f00147e0 con 0x7f66fc0f77d0 2023-10-18T21:06:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.196+0000 7f67010e5700 1 -- 172.21.15.8:0/571781099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc10aa20 con 0x7f66fc0f77d0 2023-10-18T21:06:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.197+0000 7f67010e5700 1 -- 172.21.15.8:0/571781099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc045ad0 con 0x7f66fc0f77d0 2023-10-18T21:06:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.198+0000 7f66f8ff9700 1 -- 172.21.15.8:0/571781099 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f66f001b030 con 0x7f66fc0f77d0 2023-10-18T21:06:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.199+0000 7f66f8ff9700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66e4060f70 0x7f66e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.199+0000 7f66f8ff9700 1 -- 172.21.15.8:0/571781099 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f66f007c260 con 0x7f66fc0f77d0 2023-10-18T21:06:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.199+0000 7f66fbfff700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66e4060f70 0x7f66e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.200+0000 7f66fbfff700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66e4060f70 0x7f66e4063430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f66ec0043d0 tx=0x7f66ec00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.203+0000 7f66f8ff9700 1 -- 172.21.15.8:0/571781099 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f66f004fdf0 con 0x7f66fc0f77d0 2023-10-18T21:06:15.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.457+0000 7f67010e5700 1 -- 172.21.15.8:0/571781099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f66fc027a00 con 0x7f66fc0f77d0 2023-10-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.458+0000 7f66f8ff9700 1 -- 172.21.15.8:0/571781099 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7f66f0019360 con 0x7f66fc0f77d0 2023-10-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:06:15.460 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:06:15.461 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2, 2023-10-18T21:06:15.462 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 12, 2023-10-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:06:15.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 -- 172.21.15.8:0/571781099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66e4060f70 msgr2=0x7f66e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66e4060f70 0x7f66e4063430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f66ec0043d0 tx=0x7f66ec00b040).stop 2023-10-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 -- 172.21.15.8:0/571781099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66fc0f77d0 msgr2=0x7f66fc109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66fc0f77d0 0x7f66fc109450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f66f000e7f0 tx=0x7f66f000b040).stop 2023-10-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 -- 172.21.15.8:0/571781099 shutdown_connections 2023-10-18T21:06:15.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66e4060f70 0x7f66e4063430 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66fc0f6530 0x7f66fc108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 --2- 172.21.15.8:0/571781099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66fc0f77d0 0x7f66fc109450 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 -- 172.21.15.8:0/571781099 >> 172.21.15.8:0/571781099 conn(0x7f66fc0f1c90 msgr2=0x7f66fc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:15.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 -- 172.21.15.8:0/571781099 shutdown_connections 2023-10-18T21:06:15.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.460+0000 7f67010e5700 1 -- 172.21.15.8:0/571781099 wait complete. 2023-10-18T21:06:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.597+0000 7f689b59e700 1 -- 172.21.15.8:0/2796166469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f689c0f77d0 msgr2=0x7f689c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.597+0000 7f689b59e700 1 --2- 172.21.15.8:0/2796166469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f689c0f77d0 0x7f689c0f7c30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f6890004660 tx=0x7f6890009b30).stop 2023-10-18T21:06:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.597+0000 7f689b59e700 1 -- 172.21.15.8:0/2796166469 shutdown_connections 2023-10-18T21:06:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.597+0000 7f689b59e700 1 --2- 172.21.15.8:0/2796166469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f689c0f77d0 0x7f689c0f7c30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.597+0000 7f689b59e700 1 --2- 172.21.15.8:0/2796166469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c0f6530 0x7f689c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.597+0000 7f689b59e700 1 -- 172.21.15.8:0/2796166469 >> 172.21.15.8:0/2796166469 conn(0x7f689c0f1c90 msgr2=0x7f689c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.597+0000 7f689b59e700 1 -- 172.21.15.8:0/2796166469 shutdown_connections 2023-10-18T21:06:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.597+0000 7f689b59e700 1 -- 172.21.15.8:0/2796166469 wait complete. 2023-10-18T21:06:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.598+0000 7f689b59e700 1 Processor -- start 2023-10-18T21:06:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.598+0000 7f689b59e700 1 -- start start 2023-10-18T21:06:15.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.599+0000 7f689b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c0f6530 0x7f689c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:15.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.599+0000 7f689b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f689c0f77d0 0x7f689c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:15.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.599+0000 7f689b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c06a380 con 0x7f689c0f77d0 2023-10-18T21:06:15.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.599+0000 7f689b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c06a4c0 con 0x7f689c0f6530 2023-10-18T21:06:15.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.599+0000 7f6899d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f689c0f77d0 0x7f689c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:15.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.599+0000 7f6899d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f689c0f77d0 0x7f689c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39628/0 (socket says 172.21.15.8:39628) 2023-10-18T21:06:15.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.599+0000 7f6899d9b700 1 -- 172.21.15.8:0/351414583 learned_addr learned my addr 172.21.15.8:0/351414583 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:15.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.599+0000 7f689a59c700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c0f6530 0x7f689c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:15.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.600+0000 7f6899d9b700 1 -- 172.21.15.8:0/351414583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c0f6530 msgr2=0x7f689c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.600+0000 7f6899d9b700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c0f6530 0x7f689c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.600+0000 7f6899d9b700 1 -- 172.21.15.8:0/351414583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890005040 con 0x7f689c0f77d0 2023-10-18T21:06:15.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.600+0000 7f6899d9b700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f689c0f77d0 0x7f689c069e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f6890009990 tx=0x7f6890009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:15.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.600+0000 7f688affd700 1 -- 172.21.15.8:0/351414583 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6890018070 con 0x7f689c0f77d0 2023-10-18T21:06:15.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.600+0000 7f688affd700 1 -- 172.21.15.8:0/351414583 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6890009630 con 0x7f689c0f77d0 2023-10-18T21:06:15.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.600+0000 7f689b59e700 1 -- 172.21.15.8:0/351414583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c06a740 con 0x7f689c0f77d0 2023-10-18T21:06:15.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.600+0000 7f688affd700 1 -- 172.21.15.8:0/351414583 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f689001c3c0 con 0x7f689c0f77d0 2023-10-18T21:06:15.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.600+0000 7f689b59e700 1 -- 172.21.15.8:0/351414583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c06aca0 con 0x7f689c0f77d0 2023-10-18T21:06:15.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.602+0000 7f689b59e700 1 -- 172.21.15.8:0/351414583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c045ad0 con 0x7f689c0f77d0 2023-10-18T21:06:15.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.602+0000 7f688affd700 1 -- 172.21.15.8:0/351414583 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f689001d970 con 0x7f689c0f77d0 2023-10-18T21:06:15.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.604+0000 7f688affd700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6884060f70 0x7f6884063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:15.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.604+0000 7f688affd700 1 -- 172.21.15.8:0/351414583 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f689007e040 con 0x7f689c0f77d0 2023-10-18T21:06:15.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.604+0000 7f689a59c700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6884060f70 0x7f6884063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:15.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.604+0000 7f689a59c700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6884060f70 0x7f6884063430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f689c06b730 tx=0x7f688c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:15.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.608+0000 7f688affd700 1 -- 172.21.15.8:0/351414583 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f689004e210 con 0x7f689c0f77d0 2023-10-18T21:06:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:13.902345+0000 mgr.smithi008.flmjzp (mgr.14640) 407 : cluster [DBG] pgmap v294: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:14.353407+0000 mgr.smithi008.flmjzp (mgr.14640) 408 : audit [DBG] from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:13.902345+0000 mgr.smithi008.flmjzp (mgr.14640) 407 : cluster [DBG] pgmap v294: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:14.353407+0000 mgr.smithi008.flmjzp (mgr.14640) 408 : audit [DBG] from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:15.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.833+0000 7f689b59e700 1 -- 172.21.15.8:0/351414583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f689c027a00 con 0x7f689c0f77d0 2023-10-18T21:06:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.834+0000 7f688affd700 1 -- 172.21.15.8:0/351414583 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+1759 (secure 0 0 0) 0x7f6890051830 con 0x7f689c0f77d0 2023-10-18T21:06:15.836 INFO:teuthology.orchestra.run.smithi008.stdout:e43 2023-10-18T21:06:15.836 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:06:15.837 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:06:15.837 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:06:15.837 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:06:15.837 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:06:15.837 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:06:15.838 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 43 2023-10-18T21:06:15.838 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:06:15.838 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:06:15.838 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:06:06.364394+0000 2023-10-18T21:06:15.838 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:06:15.839 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:06:15.839 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:06:15.839 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:06:15.839 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:06:15.839 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:06:15.840 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:06:15.840 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 91 2023-10-18T21:06:15.840 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:06:15.840 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:06:15.840 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:06:15.840 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=34466} 2023-10-18T21:06:15.841 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:06:15.841 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:06:15.841 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:06:15.841 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:06:15.842 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:06:15.842 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:06:15.842 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:06:15.842 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:06:15.842 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.mpstiw{0:34466} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.8:6826/467597587,v1:172.21.15.8:6827/467597587] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:06:15.843 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:06:15.843 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:06:15.843 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:06:15.843 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:06:15.843 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:06:15.843 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6824/894252909,v1:172.21.15.60:6825/894252909] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:06:15.844 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{-1:44427} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.8:6828/2533319220,v1:172.21.15.8:6829/2533319220] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:06:15.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 -- 172.21.15.8:0/351414583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6884060f70 msgr2=0x7f6884063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6884060f70 0x7f6884063430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f689c06b730 tx=0x7f688c00b040).stop 2023-10-18T21:06:15.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 -- 172.21.15.8:0/351414583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f689c0f77d0 msgr2=0x7f689c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f689c0f77d0 0x7f689c069e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f6890009990 tx=0x7f6890009b30).stop 2023-10-18T21:06:15.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 -- 172.21.15.8:0/351414583 shutdown_connections 2023-10-18T21:06:15.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6884060f70 0x7f6884063430 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c0f6530 0x7f689c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 --2- 172.21.15.8:0/351414583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f689c0f77d0 0x7f689c069e20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 -- 172.21.15.8:0/351414583 >> 172.21.15.8:0/351414583 conn(0x7f689c0f1c90 msgr2=0x7f689c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:15.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 -- 172.21.15.8:0/351414583 shutdown_connections 2023-10-18T21:06:15.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.836+0000 7f689b59e700 1 -- 172.21.15.8:0/351414583 wait complete. 2023-10-18T21:06:15.847 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 43 2023-10-18T21:06:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.975+0000 7fe5b7fff700 1 -- 172.21.15.8:0/2479214595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b80f6530 msgr2=0x7fe5b80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.975+0000 7fe5b7fff700 1 --2- 172.21.15.8:0/2479214595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b80f6530 0x7fe5b80f6950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe5a8004660 tx=0x7fe5a8009b30).stop 2023-10-18T21:06:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.975+0000 7fe5b7fff700 1 -- 172.21.15.8:0/2479214595 shutdown_connections 2023-10-18T21:06:15.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.975+0000 7fe5b7fff700 1 --2- 172.21.15.8:0/2479214595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b80f77d0 0x7fe5b80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.975+0000 7fe5b7fff700 1 --2- 172.21.15.8:0/2479214595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b80f6530 0x7fe5b80f6950 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.975+0000 7fe5b7fff700 1 -- 172.21.15.8:0/2479214595 >> 172.21.15.8:0/2479214595 conn(0x7fe5b80f1c90 msgr2=0x7fe5b80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:15.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.976+0000 7fe5b7fff700 1 -- 172.21.15.8:0/2479214595 shutdown_connections 2023-10-18T21:06:15.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.976+0000 7fe5b7fff700 1 -- 172.21.15.8:0/2479214595 wait complete. 2023-10-18T21:06:15.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.976+0000 7fe5b7fff700 1 Processor -- start 2023-10-18T21:06:15.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b7fff700 1 -- start start 2023-10-18T21:06:15.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b80f6530 0x7fe5b8108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:15.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b80f77d0 0x7fe5b81094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:15.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8109a50 con 0x7fe5b80f6530 2023-10-18T21:06:15.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8109b90 con 0x7fe5b80f77d0 2023-10-18T21:06:15.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b80f6530 0x7fe5b8108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:15.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b80f6530 0x7fe5b8108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39632/0 (socket says 172.21.15.8:39632) 2023-10-18T21:06:15.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b6ffd700 1 -- 172.21.15.8:0/1242937442 learned_addr learned my addr 172.21.15.8:0/1242937442 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:15.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b67fc700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b80f77d0 0x7fe5b81094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:15.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b6ffd700 1 -- 172.21.15.8:0/1242937442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b80f77d0 msgr2=0x7fe5b81094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:15.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.977+0000 7fe5b6ffd700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b80f77d0 0x7fe5b81094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:15.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.978+0000 7fe5b6ffd700 1 -- 172.21.15.8:0/1242937442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8005040 con 0x7fe5b80f6530 2023-10-18T21:06:15.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.978+0000 7fe5b67fc700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b80f77d0 0x7fe5b81094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:06:15.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.978+0000 7fe5b6ffd700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b80f6530 0x7fe5b8108fb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fe5a8007a60 tx=0x7fe5a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:15.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.978+0000 7fe59f7fe700 1 -- 172.21.15.8:0/1242937442 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5a8018070 con 0x7fe5b80f6530 2023-10-18T21:06:15.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.978+0000 7fe59f7fe700 1 -- 172.21.15.8:0/1242937442 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe5a8009630 con 0x7fe5b80f6530 2023-10-18T21:06:15.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.978+0000 7fe59f7fe700 1 -- 172.21.15.8:0/1242937442 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5a801c540 con 0x7fe5b80f6530 2023-10-18T21:06:15.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.978+0000 7fe5b7fff700 1 -- 172.21.15.8:0/1242937442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b810a4d0 con 0x7fe5b80f6530 2023-10-18T21:06:15.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.978+0000 7fe5b7fff700 1 -- 172.21.15.8:0/1242937442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b810aa30 con 0x7fe5b80f6530 2023-10-18T21:06:15.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.979+0000 7fe5b7fff700 1 -- 172.21.15.8:0/1242937442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b8045ad0 con 0x7fe5b80f6530 2023-10-18T21:06:15.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.980+0000 7fe59f7fe700 1 -- 172.21.15.8:0/1242937442 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe5a801d420 con 0x7fe5b80f6530 2023-10-18T21:06:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.981+0000 7fe59f7fe700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5a0060f70 0x7fe5a0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.981+0000 7fe59f7fe700 1 -- 172.21.15.8:0/1242937442 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe5a807e0a0 con 0x7fe5b80f6530 2023-10-18T21:06:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.981+0000 7fe5b67fc700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5a0060f70 0x7fe5a0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.982+0000 7fe5b67fc700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5a0060f70 0x7fe5a0063430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fe5ac009fd0 tx=0x7fe5ac00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:15.985+0000 7fe59f7fe700 1 -- 172.21.15.8:0/1242937442 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe5a8051d20 con 0x7fe5b80f6530 2023-10-18T21:06:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.185+0000 7fe5b7fff700 1 -- 172.21.15.8:0/1242937442 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5b80fedd0 con 0x7fe5a0060f70 2023-10-18T21:06:16.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.186+0000 7fe59f7fe700 1 -- 172.21.15.8:0/1242937442 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe5b80fedd0 con 0x7fe5a0060f70 2023-10-18T21:06:16.188 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:06:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:06:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:06:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:06:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:06:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:06:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:06:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:06:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:06:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:06:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "13/21 daemons upgraded", 2023-10-18T21:06:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:06:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:06:16.191 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:06:16.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 -- 172.21.15.8:0/1242937442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5a0060f70 msgr2=0x7fe5a0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:16.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5a0060f70 0x7fe5a0063430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fe5ac009fd0 tx=0x7fe5ac00b040).stop 2023-10-18T21:06:16.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 -- 172.21.15.8:0/1242937442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b80f6530 msgr2=0x7fe5b8108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:16.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b80f6530 0x7fe5b8108fb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fe5a8007a60 tx=0x7fe5a8009b30).stop 2023-10-18T21:06:16.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 -- 172.21.15.8:0/1242937442 shutdown_connections 2023-10-18T21:06:16.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5a0060f70 0x7fe5a0063430 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:16.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b80f6530 0x7fe5b8108fb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:16.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 --2- 172.21.15.8:0/1242937442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b80f77d0 0x7fe5b81094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:16.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 -- 172.21.15.8:0/1242937442 >> 172.21.15.8:0/1242937442 conn(0x7fe5b80f1c90 msgr2=0x7fe5b806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:16.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 -- 172.21.15.8:0/1242937442 shutdown_connections 2023-10-18T21:06:16.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:16.188+0000 7fe5b7fff700 1 -- 172.21.15.8:0/1242937442 wait complete. 2023-10-18T21:06:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:14.704253+0000 mgr.smithi008.flmjzp (mgr.14640) 409 : audit [DBG] from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:15.048371+0000 mgr.smithi008.flmjzp (mgr.14640) 410 : audit [DBG] from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:15.459240+0000 mon.smithi008 (mon.0) 749 : audit [DBG] from='client.? 172.21.15.8:0/571781099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:15.835246+0000 mon.smithi008 (mon.0) 750 : audit [DBG] from='client.? 172.21.15.8:0/351414583' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:06:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:14.704253+0000 mgr.smithi008.flmjzp (mgr.14640) 409 : audit [DBG] from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:15.048371+0000 mgr.smithi008.flmjzp (mgr.14640) 410 : audit [DBG] from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:15.459240+0000 mon.smithi008 (mon.0) 749 : audit [DBG] from='client.? 172.21.15.8:0/571781099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:15.835246+0000 mon.smithi008 (mon.0) 750 : audit [DBG] from='client.? 172.21.15.8:0/351414583' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:06:17.580 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:15.902797+0000 mgr.smithi008.flmjzp (mgr.14640) 411 : cluster [DBG] pgmap v295: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:17.580 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:16.187373+0000 mgr.smithi008.flmjzp (mgr.14640) 412 : audit [DBG] from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:15.902797+0000 mgr.smithi008.flmjzp (mgr.14640) 411 : cluster [DBG] pgmap v295: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:16.187373+0000 mgr.smithi008.flmjzp (mgr.14640) 412 : audit [DBG] from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:18.559 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:06:18.387+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:06:18.559 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:17.669900+0000 mon.smithi008 (mon.0) 751 : cluster [INF] daemon mds.cephfs.smithi008.mpstiw restarted 2023-10-18T21:06:18.560 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:17.674150+0000 mon.smithi008 (mon.0) 752 : cluster [DBG] osdmap e92: 6 total, 6 up, 6 in 2023-10-18T21:06:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:17.669900+0000 mon.smithi008 (mon.0) 751 : cluster [INF] daemon mds.cephfs.smithi008.mpstiw restarted 2023-10-18T21:06:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:17.674150+0000 mon.smithi008 (mon.0) 752 : cluster [DBG] osdmap e92: 6 total, 6 up, 6 in 2023-10-18T21:06:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:17.903172+0000 mgr.smithi008.flmjzp (mgr.14640) 413 : cluster [DBG] pgmap v297: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:19.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:18.389445+0000 mon.smithi008 (mon.0) 753 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:06:19.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:18.397208+0000 mon.smithi008 (mon.0) 754 : cluster [DBG] mds.? [v2:172.21.15.8:6826/541338251,v1:172.21.15.8:6827/541338251] up:boot 2023-10-18T21:06:19.722 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:18.397251+0000 mon.smithi008 (mon.0) 755 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:06:19.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:18.397372+0000 mon.smithi008 (mon.0) 756 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:06:19.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:18.397730+0000 mon.smithi008 (mon.0) 757 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:06:19.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:18.397863+0000 mon.smithi008 (mon.0) 758 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:06:19.723 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:18.401153+0000 mon.smithi008 (mon.0) 759 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 3 up:standby 2023-10-18T21:06:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:17.903172+0000 mgr.smithi008.flmjzp (mgr.14640) 413 : cluster [DBG] pgmap v297: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:18.389445+0000 mon.smithi008 (mon.0) 753 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:06:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:18.397208+0000 mon.smithi008 (mon.0) 754 : cluster [DBG] mds.? [v2:172.21.15.8:6826/541338251,v1:172.21.15.8:6827/541338251] up:boot 2023-10-18T21:06:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:18.397251+0000 mon.smithi008 (mon.0) 755 : cluster [INF] Standby daemon mds.cephfs.smithi008.mpstiw assigned to filesystem cephfs as rank 0 2023-10-18T21:06:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:18.397372+0000 mon.smithi008 (mon.0) 756 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:06:19.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:18.397730+0000 mon.smithi008 (mon.0) 757 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2023-10-18T21:06:19.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:18.397863+0000 mon.smithi008 (mon.0) 758 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.mpstiw"}]: dispatch 2023-10-18T21:06:19.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:18.401153+0000 mon.smithi008 (mon.0) 759 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.mpstiw=up:replay} 3 up:standby 2023-10-18T21:06:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:19.903735+0000 mgr.smithi008.flmjzp (mgr.14640) 414 : cluster [DBG] pgmap v298: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:19.928679+0000 mon.smithi008 (mon.0) 760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:19.930760+0000 mon.smithi008 (mon.0) 761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:19.931737+0000 mon.smithi008 (mon.0) 762 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:21.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:19.932631+0000 mgr.smithi008.flmjzp (mgr.14640) 415 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:21.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:19.933180+0000 mgr.smithi008.flmjzp (mgr.14640) 416 : cluster [DBG] pgmap v299: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:21.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:19.933377+0000 mgr.smithi008.flmjzp (mgr.14640) 417 : cluster [DBG] pgmap v300: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:21.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:19.937289+0000 mon.smithi008 (mon.0) 763 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:21.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:19.945515+0000 mon.smithi008 (mon.0) 764 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:21.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:19.949084+0000 mon.smithi008 (mon.0) 765 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:21.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:19.951107+0000 mon.smithi008 (mon.0) 766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:21.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:19.953071+0000 mon.smithi008 (mon.0) 767 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:21.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:19.955694+0000 mon.smithi008 (mon.0) 768 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:21.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:19.957810+0000 mgr.smithi008.flmjzp (mgr.14640) 418 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:06:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:19.903735+0000 mgr.smithi008.flmjzp (mgr.14640) 414 : cluster [DBG] pgmap v298: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:19.928679+0000 mon.smithi008 (mon.0) 760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:19.930760+0000 mon.smithi008 (mon.0) 761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:19.931737+0000 mon.smithi008 (mon.0) 762 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:19.932631+0000 mgr.smithi008.flmjzp (mgr.14640) 415 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:21.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:19.933180+0000 mgr.smithi008.flmjzp (mgr.14640) 416 : cluster [DBG] pgmap v299: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:21.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:19.933377+0000 mgr.smithi008.flmjzp (mgr.14640) 417 : cluster [DBG] pgmap v300: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:21.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:19.937289+0000 mon.smithi008 (mon.0) 763 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:21.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:19.945515+0000 mon.smithi008 (mon.0) 764 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:21.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:19.949084+0000 mon.smithi008 (mon.0) 765 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:21.178 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:19.951107+0000 mon.smithi008 (mon.0) 766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:21.178 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:19.953071+0000 mon.smithi008 (mon.0) 767 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:21.178 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:19.955694+0000 mon.smithi008 (mon.0) 768 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:21.178 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:19.957810+0000 mgr.smithi008.flmjzp (mgr.14640) 418 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:06:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:21.933866+0000 mgr.smithi008.flmjzp (mgr.14640) 419 : cluster [DBG] pgmap v301: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:21.933866+0000 mgr.smithi008.flmjzp (mgr.14640) 419 : cluster [DBG] pgmap v301: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:23.934491+0000 mgr.smithi008.flmjzp (mgr.14640) 420 : cluster [DBG] pgmap v302: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:23.934491+0000 mgr.smithi008.flmjzp (mgr.14640) 420 : cluster [DBG] pgmap v302: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:25.935055+0000 mgr.smithi008.flmjzp (mgr.14640) 421 : cluster [DBG] pgmap v303: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:25.935055+0000 mgr.smithi008.flmjzp (mgr.14640) 421 : cluster [DBG] pgmap v303: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:27.935660+0000 mgr.smithi008.flmjzp (mgr.14640) 422 : cluster [DBG] pgmap v304: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:27.935660+0000 mgr.smithi008.flmjzp (mgr.14640) 422 : cluster [DBG] pgmap v304: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:29.936198+0000 mgr.smithi008.flmjzp (mgr.14640) 423 : cluster [DBG] pgmap v305: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:29.963309+0000 mon.smithi008 (mon.0) 769 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:31.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:30.532349+0000 mon.smithi008 (mon.0) 770 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:31.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:30.533157+0000 mon.smithi008 (mon.0) 771 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:31.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:30.533759+0000 mgr.smithi008.flmjzp (mgr.14640) 424 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:31.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:30.534213+0000 mgr.smithi008.flmjzp (mgr.14640) 425 : cluster [DBG] pgmap v306: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:31.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:30.534386+0000 mgr.smithi008.flmjzp (mgr.14640) 426 : cluster [DBG] pgmap v307: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:31.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:30.538071+0000 mon.smithi008 (mon.0) 772 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:31.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:30.543145+0000 mon.smithi008 (mon.0) 773 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:31.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:30.545487+0000 mon.smithi008 (mon.0) 774 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:31.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:30.546786+0000 mon.smithi008 (mon.0) 775 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:31.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:30.548054+0000 mon.smithi008 (mon.0) 776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:31.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:30.549656+0000 mon.smithi008 (mon.0) 777 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:31.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:30.551180+0000 mgr.smithi008.flmjzp (mgr.14640) 427 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:06:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:29.936198+0000 mgr.smithi008.flmjzp (mgr.14640) 423 : cluster [DBG] pgmap v305: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:29.963309+0000 mon.smithi008 (mon.0) 769 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:30.532349+0000 mon.smithi008 (mon.0) 770 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:30.533157+0000 mon.smithi008 (mon.0) 771 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:30.533759+0000 mgr.smithi008.flmjzp (mgr.14640) 424 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:30.534213+0000 mgr.smithi008.flmjzp (mgr.14640) 425 : cluster [DBG] pgmap v306: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:31.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:30.534386+0000 mgr.smithi008.flmjzp (mgr.14640) 426 : cluster [DBG] pgmap v307: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:31.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:30.538071+0000 mon.smithi008 (mon.0) 772 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:31.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:30.543145+0000 mon.smithi008 (mon.0) 773 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:31.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:30.545487+0000 mon.smithi008 (mon.0) 774 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:31.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:30.546786+0000 mon.smithi008 (mon.0) 775 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:31.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:30.548054+0000 mon.smithi008 (mon.0) 776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:31.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:30.549656+0000 mon.smithi008 (mon.0) 777 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:31.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:30.551180+0000 mgr.smithi008.flmjzp (mgr.14640) 427 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.mpstiw to be up:active (currently up:replay) 2023-10-18T21:06:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:32.534929+0000 mgr.smithi008.flmjzp (mgr.14640) 428 : cluster [DBG] pgmap v308: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:32.534929+0000 mgr.smithi008.flmjzp (mgr.14640) 428 : cluster [DBG] pgmap v308: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:34.535602+0000 mgr.smithi008.flmjzp (mgr.14640) 429 : cluster [DBG] pgmap v309: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:34.916339+0000 mon.smithi008 (mon.0) 778 : cluster [WRN] Replacing daemon mds.cephfs.smithi008.mpstiw as rank 0 with standby daemon mds.cephfs.smithi060.rvrncq 2023-10-18T21:06:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:34.916443+0000 mon.smithi008 (mon.0) 779 : cluster [INF] MDS daemon mds.cephfs.smithi008.mpstiw is removed because it is dead or otherwise unavailable. 2023-10-18T21:06:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:34.921702+0000 mon.smithi008 (mon.0) 780 : cluster [DBG] osdmap e93: 6 total, 6 up, 6 in 2023-10-18T21:06:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:34.926341+0000 mon.smithi008 (mon.0) 781 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 2 up:standby 2023-10-18T21:06:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:34.535602+0000 mgr.smithi008.flmjzp (mgr.14640) 429 : cluster [DBG] pgmap v309: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:06:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:34.916339+0000 mon.smithi008 (mon.0) 778 : cluster [WRN] Replacing daemon mds.cephfs.smithi008.mpstiw as rank 0 with standby daemon mds.cephfs.smithi060.rvrncq 2023-10-18T21:06:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:34.916443+0000 mon.smithi008 (mon.0) 779 : cluster [INF] MDS daemon mds.cephfs.smithi008.mpstiw is removed because it is dead or otherwise unavailable. 2023-10-18T21:06:35.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:34.921702+0000 mon.smithi008 (mon.0) 780 : cluster [DBG] osdmap e93: 6 total, 6 up, 6 in 2023-10-18T21:06:35.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:34.926341+0000 mon.smithi008 (mon.0) 781 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 2 up:standby 2023-10-18T21:06:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:36.536052+0000 mgr.smithi008.flmjzp (mgr.14640) 430 : cluster [DBG] pgmap v311: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1 op/s 2023-10-18T21:06:37.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:36.536052+0000 mgr.smithi008.flmjzp (mgr.14640) 430 : cluster [DBG] pgmap v311: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1 op/s 2023-10-18T21:06:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:38.536569+0000 mgr.smithi008.flmjzp (mgr.14640) 431 : cluster [DBG] pgmap v312: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.0 MiB/s rd, 3 op/s 2023-10-18T21:06:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:38.536569+0000 mgr.smithi008.flmjzp (mgr.14640) 431 : cluster [DBG] pgmap v312: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.0 MiB/s rd, 3 op/s 2023-10-18T21:06:41.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:40.537128+0000 mgr.smithi008.flmjzp (mgr.14640) 432 : cluster [DBG] pgmap v313: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2023-10-18T21:06:41.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:40.561171+0000 mon.smithi008 (mon.0) 782 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:41.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:40.563380+0000 mon.smithi008 (mon.0) 783 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:41.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:40.564655+0000 mon.smithi008 (mon.0) 784 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:41.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:40.565511+0000 mgr.smithi008.flmjzp (mgr.14640) 433 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:41.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:40.565994+0000 mgr.smithi008.flmjzp (mgr.14640) 434 : cluster [DBG] pgmap v314: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2023-10-18T21:06:41.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:40.566183+0000 mgr.smithi008.flmjzp (mgr.14640) 435 : cluster [DBG] pgmap v315: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 21 MiB/s rd, 7 op/s 2023-10-18T21:06:41.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:40.571105+0000 mon.smithi008 (mon.0) 785 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:41.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:40.577467+0000 mon.smithi008 (mon.0) 786 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:41.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:40.580619+0000 mon.smithi008 (mon.0) 787 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:41.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:40.582292+0000 mon.smithi008 (mon.0) 788 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:41.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:40.583856+0000 mon.smithi008 (mon.0) 789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:41.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:40.585830+0000 mon.smithi008 (mon.0) 790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:41.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:40.587661+0000 mgr.smithi008.flmjzp (mgr.14640) 436 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:06:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:40.537128+0000 mgr.smithi008.flmjzp (mgr.14640) 432 : cluster [DBG] pgmap v313: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2023-10-18T21:06:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:40.561171+0000 mon.smithi008 (mon.0) 782 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:40.563380+0000 mon.smithi008 (mon.0) 783 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:40.564655+0000 mon.smithi008 (mon.0) 784 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:40.565511+0000 mgr.smithi008.flmjzp (mgr.14640) 433 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:40.565994+0000 mgr.smithi008.flmjzp (mgr.14640) 434 : cluster [DBG] pgmap v314: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2023-10-18T21:06:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:40.566183+0000 mgr.smithi008.flmjzp (mgr.14640) 435 : cluster [DBG] pgmap v315: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 21 MiB/s rd, 7 op/s 2023-10-18T21:06:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:40.571105+0000 mon.smithi008 (mon.0) 785 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:40.577467+0000 mon.smithi008 (mon.0) 786 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:40.580619+0000 mon.smithi008 (mon.0) 787 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:40.582292+0000 mon.smithi008 (mon.0) 788 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:41.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:40.583856+0000 mon.smithi008 (mon.0) 789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:41.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:40.585830+0000 mon.smithi008 (mon.0) 790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:41.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:40.587661+0000 mgr.smithi008.flmjzp (mgr.14640) 436 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:06:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:42.566840+0000 mgr.smithi008.flmjzp (mgr.14640) 437 : cluster [DBG] pgmap v316: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2023-10-18T21:06:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:42.566840+0000 mgr.smithi008.flmjzp (mgr.14640) 437 : cluster [DBG] pgmap v316: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2023-10-18T21:06:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:44.567345+0000 mgr.smithi008.flmjzp (mgr.14640) 438 : cluster [DBG] pgmap v317: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 MiB/s rd, 6 op/s 2023-10-18T21:06:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:44.629028+0000 mon.smithi008 (mon.0) 791 : cluster [DBG] mds.? [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] up:reconnect 2023-10-18T21:06:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:44.629078+0000 mon.smithi008 (mon.0) 792 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:reconnect} 2 up:standby 2023-10-18T21:06:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:44.637688+0000 mds.cephfs.smithi060.rvrncq (mds.0) 1 : cluster [DBG] reconnect by client.24375 v1:192.168.0.1:0/1489169714 after 0.00999992 2023-10-18T21:06:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:44.637799+0000 mds.cephfs.smithi060.rvrncq (mds.0) 2 : cluster [DBG] reconnect by client.24369 v1:172.21.15.8:0/434732952 after 0.00999992 2023-10-18T21:06:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:44.567345+0000 mgr.smithi008.flmjzp (mgr.14640) 438 : cluster [DBG] pgmap v317: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 MiB/s rd, 6 op/s 2023-10-18T21:06:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:44.629028+0000 mon.smithi008 (mon.0) 791 : cluster [DBG] mds.? [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] up:reconnect 2023-10-18T21:06:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:44.629078+0000 mon.smithi008 (mon.0) 792 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:reconnect} 2 up:standby 2023-10-18T21:06:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:44.637688+0000 mds.cephfs.smithi060.rvrncq (mds.0) 1 : cluster [DBG] reconnect by client.24375 v1:192.168.0.1:0/1489169714 after 0.00999992 2023-10-18T21:06:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:44.637799+0000 mds.cephfs.smithi060.rvrncq (mds.0) 2 : cluster [DBG] reconnect by client.24369 v1:172.21.15.8:0/434732952 after 0.00999992 2023-10-18T21:06:46.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.343+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/3226398328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc406b9c0 msgr2=0x7f6fc4069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:46.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.343+0000 7f6fcb4c4700 1 --2- 172.21.15.8:0/3226398328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc406b9c0 0x7f6fc4069ec0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f6fc0004660 tx=0x7f6fc0009b30).stop 2023-10-18T21:06:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.343+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/3226398328 shutdown_connections 2023-10-18T21:06:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.343+0000 7f6fcb4c4700 1 --2- 172.21.15.8:0/3226398328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc406a3b0 0x7f6fc406a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.343+0000 7f6fcb4c4700 1 --2- 172.21.15.8:0/3226398328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc406b9c0 0x7f6fc4069ec0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.343+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/3226398328 >> 172.21.15.8:0/3226398328 conn(0x7f6fc40f1c90 msgr2=0x7f6fc40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:46.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.343+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/3226398328 shutdown_connections 2023-10-18T21:06:46.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.343+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/3226398328 wait complete. 2023-10-18T21:06:46.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.344+0000 7f6fcb4c4700 1 Processor -- start 2023-10-18T21:06:46.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.344+0000 7f6fcb4c4700 1 -- start start 2023-10-18T21:06:46.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.344+0000 7f6fcb4c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc406a3b0 0x7f6fc4108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:46.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.344+0000 7f6fcb4c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc406b9c0 0x7f6fc41094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:46.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.344+0000 7f6fcb4c4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4109a50 con 0x7f6fc406a3b0 2023-10-18T21:06:46.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.344+0000 7f6fcb4c4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4109b90 con 0x7f6fc406b9c0 2023-10-18T21:06:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fca4c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc406a3b0 0x7f6fc4108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fca4c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc406a3b0 0x7f6fc4108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58480/0 (socket says 172.21.15.8:58480) 2023-10-18T21:06:46.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fca4c2700 1 -- 172.21.15.8:0/1342979517 learned_addr learned my addr 172.21.15.8:0/1342979517 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:46.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fc9cc1700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc406b9c0 0x7f6fc41094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:46.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fca4c2700 1 -- 172.21.15.8:0/1342979517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc406b9c0 msgr2=0x7f6fc41094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:46.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fca4c2700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc406b9c0 0x7f6fc41094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fca4c2700 1 -- 172.21.15.8:0/1342979517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0005040 con 0x7f6fc406a3b0 2023-10-18T21:06:46.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fca4c2700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc406a3b0 0x7f6fc4108fb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f6fc0009f50 tx=0x7f6fc0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:46.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fbaffd700 1 -- 172.21.15.8:0/1342979517 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fc0018070 con 0x7f6fc406a3b0 2023-10-18T21:06:46.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fbaffd700 1 -- 172.21.15.8:0/1342979517 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6fc0009630 con 0x7f6fc406a3b0 2023-10-18T21:06:46.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fbaffd700 1 -- 172.21.15.8:0/1342979517 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fc001c3c0 con 0x7f6fc406a3b0 2023-10-18T21:06:46.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.345+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/1342979517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc410a4d0 con 0x7f6fc406a3b0 2023-10-18T21:06:46.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.346+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/1342979517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc410aa30 con 0x7f6fc406a3b0 2023-10-18T21:06:46.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.347+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/1342979517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc4045ad0 con 0x7f6fc406a3b0 2023-10-18T21:06:46.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.347+0000 7f6fbaffd700 1 -- 172.21.15.8:0/1342979517 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6fc001d420 con 0x7f6fc406a3b0 2023-10-18T21:06:46.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.348+0000 7f6fbaffd700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fb0060f70 0x7f6fb0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:46.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.348+0000 7f6fbaffd700 1 -- 172.21.15.8:0/1342979517 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f6fc007dfe0 con 0x7f6fc406a3b0 2023-10-18T21:06:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.349+0000 7f6fc9cc1700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fb0060f70 0x7f6fb0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.349+0000 7f6fc9cc1700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fb0060f70 0x7f6fb0063430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f6fb4004c40 tx=0x7f6fb400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.353+0000 7f6fbaffd700 1 -- 172.21.15.8:0/1342979517 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6fc0051ba0 con 0x7f6fc406a3b0 2023-10-18T21:06:46.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.550+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/1342979517 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fc4100fc0 con 0x7f6fb0060f70 2023-10-18T21:06:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.551+0000 7f6fbaffd700 1 -- 172.21.15.8:0/1342979517 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6fc4100fc0 con 0x7f6fb0060f70 2023-10-18T21:06:46.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/1342979517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fb0060f70 msgr2=0x7f6fb0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:46.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fb0060f70 0x7f6fb0063430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f6fb4004c40 tx=0x7f6fb400b040).stop 2023-10-18T21:06:46.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/1342979517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc406a3b0 msgr2=0x7f6fc4108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:46.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc406a3b0 0x7f6fc4108fb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f6fc0009f50 tx=0x7f6fc0009b30).stop 2023-10-18T21:06:46.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/1342979517 shutdown_connections 2023-10-18T21:06:46.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fb0060f70 0x7f6fb0063430 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fc406a3b0 0x7f6fc4108fb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 --2- 172.21.15.8:0/1342979517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc406b9c0 0x7f6fc41094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/1342979517 >> 172.21.15.8:0/1342979517 conn(0x7f6fc40f1c90 msgr2=0x7f6fc40fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:46.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/1342979517 shutdown_connections 2023-10-18T21:06:46.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.553+0000 7f6fcb4c4700 1 -- 172.21.15.8:0/1342979517 wait complete. 2023-10-18T21:06:46.570 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:06:46.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.693+0000 7f8e47133700 1 -- 172.21.15.8:0/618151715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e400f9690 msgr2=0x7f8e400fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:46.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.693+0000 7f8e47133700 1 --2- 172.21.15.8:0/618151715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e400f9690 0x7f8e400fbae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f8e30004660 tx=0x7f8e30009b30).stop 2023-10-18T21:06:46.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.693+0000 7f8e47133700 1 -- 172.21.15.8:0/618151715 shutdown_connections 2023-10-18T21:06:46.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.693+0000 7f8e47133700 1 --2- 172.21.15.8:0/618151715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e400f9690 0x7f8e400fbae0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.693+0000 7f8e47133700 1 --2- 172.21.15.8:0/618151715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e40060310 0x7f8e400f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.693+0000 7f8e47133700 1 -- 172.21.15.8:0/618151715 >> 172.21.15.8:0/618151715 conn(0x7f8e400f0b90 msgr2=0x7f8e400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:46.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.693+0000 7f8e47133700 1 -- 172.21.15.8:0/618151715 shutdown_connections 2023-10-18T21:06:46.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.693+0000 7f8e47133700 1 -- 172.21.15.8:0/618151715 wait complete. 2023-10-18T21:06:46.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.694+0000 7f8e47133700 1 Processor -- start 2023-10-18T21:06:46.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.694+0000 7f8e47133700 1 -- start start 2023-10-18T21:06:46.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e47133700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e40060310 0x7f8e400f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:46.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e47133700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e400f9690 0x7f8e400f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:46.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e47133700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400f5570 con 0x7f8e40060310 2023-10-18T21:06:46.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e47133700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400f56b0 con 0x7f8e400f9690 2023-10-18T21:06:46.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e46131700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e40060310 0x7f8e400f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:46.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e46131700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e40060310 0x7f8e400f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58494/0 (socket says 172.21.15.8:58494) 2023-10-18T21:06:46.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e46131700 1 -- 172.21.15.8:0/1049582853 learned_addr learned my addr 172.21.15.8:0/1049582853 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:46.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e45930700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e400f9690 0x7f8e400f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:46.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e46131700 1 -- 172.21.15.8:0/1049582853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e400f9690 msgr2=0x7f8e400f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e46131700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e400f9690 0x7f8e400f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.695+0000 7f8e46131700 1 -- 172.21.15.8:0/1049582853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e30005040 con 0x7f8e40060310 2023-10-18T21:06:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.696+0000 7f8e46131700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e40060310 0x7f8e400f6b90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f8e3c0026d0 tx=0x7f8e3c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.696+0000 7f8e36ffd700 1 -- 172.21.15.8:0/1049582853 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e3c0079c0 con 0x7f8e40060310 2023-10-18T21:06:46.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.696+0000 7f8e36ffd700 1 -- 172.21.15.8:0/1049582853 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8e3c00f040 con 0x7f8e40060310 2023-10-18T21:06:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.696+0000 7f8e47133700 1 -- 172.21.15.8:0/1049582853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e400f5990 con 0x7f8e40060310 2023-10-18T21:06:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.696+0000 7f8e36ffd700 1 -- 172.21.15.8:0/1049582853 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e3c014980 con 0x7f8e40060310 2023-10-18T21:06:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.696+0000 7f8e47133700 1 -- 172.21.15.8:0/1049582853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4010eda0 con 0x7f8e40060310 2023-10-18T21:06:46.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.697+0000 7f8e47133700 1 -- 172.21.15.8:0/1049582853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e40045ad0 con 0x7f8e40060310 2023-10-18T21:06:46.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.698+0000 7f8e36ffd700 1 -- 172.21.15.8:0/1049582853 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8e3c0090d0 con 0x7f8e40060310 2023-10-18T21:06:46.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.699+0000 7f8e36ffd700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e2c060f70 0x7f8e2c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:46.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.699+0000 7f8e36ffd700 1 -- 172.21.15.8:0/1049582853 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f8e3c07c4a0 con 0x7f8e40060310 2023-10-18T21:06:46.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.699+0000 7f8e45930700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e2c060f70 0x7f8e2c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:46.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.700+0000 7f8e45930700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e2c060f70 0x7f8e2c063430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8e30004630 tx=0x7f8e30009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:46.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.703+0000 7f8e36ffd700 1 -- 172.21.15.8:0/1049582853 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8e3c04c5e0 con 0x7f8e40060310 2023-10-18T21:06:46.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.898+0000 7f8e47133700 1 -- 172.21.15.8:0/1049582853 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e400fedd0 con 0x7f8e2c060f70 2023-10-18T21:06:46.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.899+0000 7f8e36ffd700 1 -- 172.21.15.8:0/1049582853 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8e400fedd0 con 0x7f8e2c060f70 2023-10-18T21:06:46.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 -- 172.21.15.8:0/1049582853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e2c060f70 msgr2=0x7f8e2c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:46.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e2c060f70 0x7f8e2c063430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8e30004630 tx=0x7f8e30009b30).stop 2023-10-18T21:06:46.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 -- 172.21.15.8:0/1049582853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e40060310 msgr2=0x7f8e400f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:46.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e40060310 0x7f8e400f6b90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f8e3c0026d0 tx=0x7f8e3c009de0).stop 2023-10-18T21:06:46.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 -- 172.21.15.8:0/1049582853 shutdown_connections 2023-10-18T21:06:46.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e2c060f70 0x7f8e2c063430 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e40060310 0x7f8e400f6b90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 --2- 172.21.15.8:0/1049582853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e400f9690 0x7f8e400f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:46.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 -- 172.21.15.8:0/1049582853 >> 172.21.15.8:0/1049582853 conn(0x7f8e400f0b90 msgr2=0x7f8e400f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:46.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 -- 172.21.15.8:0/1049582853 shutdown_connections 2023-10-18T21:06:46.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:46.901+0000 7f8e47133700 1 -- 172.21.15.8:0/1049582853 wait complete. 2023-10-18T21:06:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:45.631937+0000 mon.smithi008 (mon.0) 793 : cluster [DBG] mds.? [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] up:rejoin 2023-10-18T21:06:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:45.632018+0000 mon.smithi008 (mon.0) 794 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:rejoin} 2 up:standby 2023-10-18T21:06:46.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:45.675234+0000 mon.smithi008 (mon.0) 795 : cluster [INF] daemon mds.cephfs.smithi060.rvrncq is now active in filesystem cephfs as rank 0 2023-10-18T21:06:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:45.631937+0000 mon.smithi008 (mon.0) 793 : cluster [DBG] mds.? [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] up:rejoin 2023-10-18T21:06:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:45.632018+0000 mon.smithi008 (mon.0) 794 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:rejoin} 2 up:standby 2023-10-18T21:06:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:45.675234+0000 mon.smithi008 (mon.0) 795 : cluster [INF] daemon mds.cephfs.smithi060.rvrncq is now active in filesystem cephfs as rank 0 2023-10-18T21:06:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.046+0000 7f10b759e700 1 -- 172.21.15.8:0/1098183815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b80f6530 msgr2=0x7f10b80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.046+0000 7f10b759e700 1 --2- 172.21.15.8:0/1098183815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b80f6530 0x7f10b80f6950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f10a8004660 tx=0x7f10a8009b30).stop 2023-10-18T21:06:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.046+0000 7f10b759e700 1 -- 172.21.15.8:0/1098183815 shutdown_connections 2023-10-18T21:06:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.046+0000 7f10b759e700 1 --2- 172.21.15.8:0/1098183815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b80f77d0 0x7f10b80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:06:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.046+0000 7f10b759e700 1 --2- 172.21.15.8:0/1098183815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b80f6530 0x7f10b80f6950 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.046+0000 7f10b759e700 1 -- 172.21.15.8:0/1098183815 >> 172.21.15.8:0/1098183815 conn(0x7f10b80f1c90 msgr2=0x7f10b80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:47.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.046+0000 7f10b759e700 1 -- 172.21.15.8:0/1098183815 shutdown_connections 2023-10-18T21:06:47.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.046+0000 7f10b759e700 1 -- 172.21.15.8:0/1098183815 wait complete. 2023-10-18T21:06:47.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.047+0000 7f10b759e700 1 Processor -- start 2023-10-18T21:06:47.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.047+0000 7f10b759e700 1 -- start start 2023-10-18T21:06:47.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.047+0000 7f10b759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b80f6530 0x7f10b8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:47.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.047+0000 7f10b759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b80f77d0 0x7f10b81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:47.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.047+0000 7f10b759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8109b00 con 0x7f10b80f6530 2023-10-18T21:06:47.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.047+0000 7f10b759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b810a3b0 con 0x7f10b80f77d0 2023-10-18T21:06:47.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.048+0000 7f10b659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b80f6530 0x7f10b8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:47.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.048+0000 7f10b659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b80f6530 0x7f10b8108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50594/0 (socket says 172.21.15.8:50594) 2023-10-18T21:06:47.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.048+0000 7f10b659c700 1 -- 172.21.15.8:0/3879198455 learned_addr learned my addr 172.21.15.8:0/3879198455 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:47.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.048+0000 7f10b5d9b700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b80f77d0 0x7f10b81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:47.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.048+0000 7f10b659c700 1 -- 172.21.15.8:0/3879198455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b80f77d0 msgr2=0x7f10b81094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:47.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.048+0000 7f10b659c700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b80f77d0 0x7f10b81094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.048+0000 7f10b659c700 1 -- 172.21.15.8:0/3879198455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a8005040 con 0x7f10b80f6530 2023-10-18T21:06:47.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.048+0000 7f10b659c700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b80f6530 0x7f10b8108fd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f10a8007a70 tx=0x7f10a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:47.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.048+0000 7f10a6ffd700 1 -- 172.21.15.8:0/3879198455 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10a8018070 con 0x7f10b80f6530 2023-10-18T21:06:47.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.049+0000 7f10a6ffd700 1 -- 172.21.15.8:0/3879198455 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f10a801d8e0 con 0x7f10b80f6530 2023-10-18T21:06:47.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.049+0000 7f10b759e700 1 -- 172.21.15.8:0/3879198455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b810a630 con 0x7f10b80f6530 2023-10-18T21:06:47.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.049+0000 7f10a6ffd700 1 -- 172.21.15.8:0/3879198455 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10a801c660 con 0x7f10b80f6530 2023-10-18T21:06:47.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.049+0000 7f10b759e700 1 -- 172.21.15.8:0/3879198455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b810ab90 con 0x7f10b80f6530 2023-10-18T21:06:47.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.050+0000 7f10b759e700 1 -- 172.21.15.8:0/3879198455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b8059100 con 0x7f10b80f6530 2023-10-18T21:06:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.051+0000 7f10a6ffd700 1 -- 172.21.15.8:0/3879198455 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f10a801da50 con 0x7f10b80f6530 2023-10-18T21:06:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.052+0000 7f10a6ffd700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a0060f70 0x7f10a0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.052+0000 7f10a6ffd700 1 -- 172.21.15.8:0/3879198455 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f10a807e410 con 0x7f10b80f6530 2023-10-18T21:06:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.052+0000 7f10b5d9b700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a0060f70 0x7f10a0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.052+0000 7f10b5d9b700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a0060f70 0x7f10a0063430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f10ac00b790 tx=0x7f10ac008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:47.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.056+0000 7f10a6ffd700 1 -- 172.21.15.8:0/3879198455 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f10a8051f70 con 0x7f10b80f6530 2023-10-18T21:06:47.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.246+0000 7f10b759e700 1 -- 172.21.15.8:0/3879198455 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10b80fed40 con 0x7f10a0060f70 2023-10-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.256+0000 7f10a6ffd700 1 -- 172.21.15.8:0/3879198455 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f10b80fed40 con 0x7f10a0060f70 2023-10-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (13m) 98s ago 14m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (7m) 98s ago 14m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (7m) 2m ago 14m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (13m) 98s ago 14m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (102s) 98s ago 10m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 98s ago 10m - - 2023-10-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (10m) 2m ago 10m 3802M - 16.2.4 8d91d370c2b8 59710487fde8 2023-10-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (10m) 2m ago 10m 478M - 16.2.4 8d91d370c2b8 7ec094d1e995 2023-10-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (8m) 98s ago 16m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (7m) 2m ago 14m 396M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (7m) 98s ago 16m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (7m) 2m ago 13m 85.3M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (14m) 98s ago 14m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (13m) 2m ago 13m 9.87M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (7m) 98s ago 13m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (5m) 98s ago 13m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (4m) 98s ago 12m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (4m) 2m ago 12m 340M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (3m) 2m ago 12m 305M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (2m) 2m ago 12m 10.6M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (8m) 98s ago 14m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.257+0000 7f10b759e700 1 -- 172.21.15.8:0/3879198455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a0060f70 msgr2=0x7f10a0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.258+0000 7f10b759e700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a0060f70 0x7f10a0063430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f10ac00b790 tx=0x7f10ac008040).stop 2023-10-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.258+0000 7f10b759e700 1 -- 172.21.15.8:0/3879198455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b80f6530 msgr2=0x7f10b8108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.258+0000 7f10b759e700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b80f6530 0x7f10b8108fd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f10a8007a70 tx=0x7f10a8009b30).stop 2023-10-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.258+0000 7f10b759e700 1 -- 172.21.15.8:0/3879198455 shutdown_connections 2023-10-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.258+0000 7f10b759e700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a0060f70 0x7f10a0063430 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.258+0000 7f10b759e700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b80f6530 0x7f10b8108fd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.258+0000 7f10b759e700 1 --2- 172.21.15.8:0/3879198455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b80f77d0 0x7f10b81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.258+0000 7f10b759e700 1 -- 172.21.15.8:0/3879198455 >> 172.21.15.8:0/3879198455 conn(0x7f10b80f1c90 msgr2=0x7f10b806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.258+0000 7f10b759e700 1 -- 172.21.15.8:0/3879198455 shutdown_connections 2023-10-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.258+0000 7f10b759e700 1 -- 172.21.15.8:0/3879198455 wait complete. 2023-10-18T21:06:47.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.394+0000 7f25e2182700 1 -- 172.21.15.8:0/772737033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f77d0 msgr2=0x7f25dc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:47.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.394+0000 7f25e2182700 1 --2- 172.21.15.8:0/772737033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f77d0 0x7f25dc0f7c30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f25cc004660 tx=0x7f25cc009b30).stop 2023-10-18T21:06:47.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.394+0000 7f25e2182700 1 -- 172.21.15.8:0/772737033 shutdown_connections 2023-10-18T21:06:47.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.394+0000 7f25e2182700 1 --2- 172.21.15.8:0/772737033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f77d0 0x7f25dc0f7c30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.394+0000 7f25e2182700 1 --2- 172.21.15.8:0/772737033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f6530 0x7f25dc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:06:47.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.394+0000 7f25e2182700 1 -- 172.21.15.8:0/772737033 >> 172.21.15.8:0/772737033 conn(0x7f25dc0f1c90 msgr2=0x7f25dc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:47.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.394+0000 7f25e2182700 1 -- 172.21.15.8:0/772737033 shutdown_connections 2023-10-18T21:06:47.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.394+0000 7f25e2182700 1 -- 172.21.15.8:0/772737033 wait complete. 2023-10-18T21:06:47.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.395+0000 7f25e2182700 1 Processor -- start 2023-10-18T21:06:47.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.395+0000 7f25e2182700 1 -- start start 2023-10-18T21:06:47.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e2182700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:47.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e2182700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f77d0 0x7f25dc1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:47.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e2182700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc109b00 con 0x7f25dc0f6530 2023-10-18T21:06:47.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e2182700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc10a3b0 con 0x7f25dc0f77d0 2023-10-18T21:06:47.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e1180700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:47.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e1180700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50622/0 (socket says 172.21.15.8:50622) 2023-10-18T21:06:47.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e1180700 1 -- 172.21.15.8:0/2177489184 learned_addr learned my addr 172.21.15.8:0/2177489184 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:47.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e097f700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f77d0 0x7f25dc1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:47.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e1180700 1 -- 172.21.15.8:0/2177489184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f77d0 msgr2=0x7f25dc1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:47.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e1180700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f77d0 0x7f25dc1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.396+0000 7f25e1180700 1 -- 172.21.15.8:0/2177489184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc005040 con 0x7f25dc0f6530 2023-10-18T21:06:47.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.397+0000 7f25e1180700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108fd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f25d80093f0 tx=0x7f25d8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:47.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.397+0000 7f25d1ffb700 1 -- 172.21.15.8:0/2177489184 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25d8009ea0 con 0x7f25dc0f6530 2023-10-18T21:06:47.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.397+0000 7f25d1ffb700 1 -- 172.21.15.8:0/2177489184 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f25d8013b00 con 0x7f25dc0f6530 2023-10-18T21:06:47.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.397+0000 7f25e2182700 1 -- 172.21.15.8:0/2177489184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc10a690 con 0x7f25dc0f6530 2023-10-18T21:06:47.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.397+0000 7f25d1ffb700 1 -- 172.21.15.8:0/2177489184 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25d800dbf0 con 0x7f25dc0f6530 2023-10-18T21:06:47.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.397+0000 7f25e2182700 1 -- 172.21.15.8:0/2177489184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc10ac50 con 0x7f25dc0f6530 2023-10-18T21:06:47.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.398+0000 7f25e2182700 1 -- 172.21.15.8:0/2177489184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc059100 con 0x7f25dc0f6530 2023-10-18T21:06:47.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.399+0000 7f25d1ffb700 1 -- 172.21.15.8:0/2177489184 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f25d801a060 con 0x7f25dc0f6530 2023-10-18T21:06:47.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.400+0000 7f25d1ffb700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 0x7f25c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:47.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.400+0000 7f25d1ffb700 1 -- 172.21.15.8:0/2177489184 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f25d807c4f0 con 0x7f25dc0f6530 2023-10-18T21:06:47.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.400+0000 7f25e097f700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 0x7f25c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:47.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.401+0000 7f25e097f700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 0x7f25c8063430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f25cc009490 tx=0x7f25cc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:47.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.404+0000 7f25d1ffb700 1 -- 172.21.15.8:0/2177489184 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f25d804ffc0 con 0x7f25dc0f6530 2023-10-18T21:06:47.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.661+0000 7f25e2182700 1 -- 172.21.15.8:0/2177489184 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f25dc027a00 con 0x7f25dc0f6530 2023-10-18T21:06:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.661+0000 7f25d1ffb700 1 -- 172.21.15.8:0/2177489184 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7f25d804fbb0 con 0x7f25dc0f6530 2023-10-18T21:06:47.664 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:06:47.664 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:06:47.664 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:06:47.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:06:47.665 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:06:47.665 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:06:47.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:06:47.665 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:06:47.666 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:06:47.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:06:47.666 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:06:47.666 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1, 2023-10-18T21:06:47.666 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T21:06:47.667 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:06:47.667 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:06:47.667 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11, 2023-10-18T21:06:47.667 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-10-18T21:06:47.667 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:06:47.668 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:06:47.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.663+0000 7f25e2182700 1 -- 172.21.15.8:0/2177489184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 msgr2=0x7f25c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:47.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.663+0000 7f25e2182700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 0x7f25c8063430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f25cc009490 tx=0x7f25cc009b30).stop 2023-10-18T21:06:47.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.663+0000 7f25e2182700 1 -- 172.21.15.8:0/2177489184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 msgr2=0x7f25dc108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:47.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.663+0000 7f25e2182700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108fd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f25d80093f0 tx=0x7f25d8006ec0).stop 2023-10-18T21:06:47.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.664+0000 7f25e2182700 1 -- 172.21.15.8:0/2177489184 shutdown_connections 2023-10-18T21:06:47.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.664+0000 7f25e2182700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 0x7f25c8063430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.664+0000 7f25e2182700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108fd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.664+0000 7f25e2182700 1 --2- 172.21.15.8:0/2177489184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f77d0 0x7f25dc1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.664+0000 7f25e2182700 1 -- 172.21.15.8:0/2177489184 >> 172.21.15.8:0/2177489184 conn(0x7f25dc0f1c90 msgr2=0x7f25dc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.664+0000 7f25e2182700 1 -- 172.21.15.8:0/2177489184 shutdown_connections 2023-10-18T21:06:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.664+0000 7f25e2182700 1 -- 172.21.15.8:0/2177489184 wait complete. 2023-10-18T21:06:47.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.800+0000 7f8e4bfff700 1 -- 172.21.15.8:0/766165848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e4c0fba70 msgr2=0x7f8e4c0fde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:47.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.800+0000 7f8e4bfff700 1 --2- 172.21.15.8:0/766165848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e4c0fba70 0x7f8e4c0fde60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f8e40004660 tx=0x7f8e40009b30).stop 2023-10-18T21:06:47.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.800+0000 7f8e4bfff700 1 -- 172.21.15.8:0/766165848 shutdown_connections 2023-10-18T21:06:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.800+0000 7f8e4bfff700 1 --2- 172.21.15.8:0/766165848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e4c0fba70 0x7f8e4c0fde60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.800+0000 7f8e4bfff700 1 --2- 172.21.15.8:0/766165848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e4c0602b0 0x7f8e4c0fb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.800+0000 7f8e4bfff700 1 -- 172.21.15.8:0/766165848 >> 172.21.15.8:0/766165848 conn(0x7f8e4c0f0ba0 msgr2=0x7f8e4c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.800+0000 7f8e4bfff700 1 -- 172.21.15.8:0/766165848 shutdown_connections 2023-10-18T21:06:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.800+0000 7f8e4bfff700 1 -- 172.21.15.8:0/766165848 wait complete. 2023-10-18T21:06:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.801+0000 7f8e4bfff700 1 Processor -- start 2023-10-18T21:06:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.801+0000 7f8e4bfff700 1 -- start start 2023-10-18T21:06:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.802+0000 7f8e4bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e4c0602b0 0x7f8e4c108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.802+0000 7f8e4bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e4c0fba70 0x7f8e4c1093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.802+0000 7f8e4bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c109990 con 0x7f8e4c0fba70 2023-10-18T21:06:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.802+0000 7f8e4bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c109ad0 con 0x7f8e4c0602b0 2023-10-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.802+0000 7f8e4a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e4c0fba70 0x7f8e4c1093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.802+0000 7f8e4a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e4c0fba70 0x7f8e4c1093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50640/0 (socket says 172.21.15.8:50640) 2023-10-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.802+0000 7f8e4a7fc700 1 -- 172.21.15.8:0/1406267306 learned_addr learned my addr 172.21.15.8:0/1406267306 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.802+0000 7f8e4affd700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e4c0602b0 0x7f8e4c108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.802+0000 7f8e4a7fc700 1 -- 172.21.15.8:0/1406267306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e4c0602b0 msgr2=0x7f8e4c108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.802+0000 7f8e4a7fc700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e4c0602b0 0x7f8e4c108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.803+0000 7f8e4a7fc700 1 -- 172.21.15.8:0/1406267306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40005040 con 0x7f8e4c0fba70 2023-10-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.803+0000 7f8e4a7fc700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e4c0fba70 0x7f8e4c1093e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8e40004e30 tx=0x7f8e40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.803+0000 7f8e337fe700 1 -- 172.21.15.8:0/1406267306 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e40018070 con 0x7f8e4c0fba70 2023-10-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.803+0000 7f8e337fe700 1 -- 172.21.15.8:0/1406267306 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8e40009630 con 0x7f8e4c0fba70 2023-10-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.803+0000 7f8e4bfff700 1 -- 172.21.15.8:0/1406267306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c10a410 con 0x7f8e4c0fba70 2023-10-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.803+0000 7f8e337fe700 1 -- 172.21.15.8:0/1406267306 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e4001c3c0 con 0x7f8e4c0fba70 2023-10-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.803+0000 7f8e4bfff700 1 -- 172.21.15.8:0/1406267306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c10a970 con 0x7f8e4c0fba70 2023-10-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.804+0000 7f8e4bfff700 1 -- 172.21.15.8:0/1406267306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c045ad0 con 0x7f8e4c0fba70 2023-10-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.805+0000 7f8e337fe700 1 -- 172.21.15.8:0/1406267306 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8e4001d420 con 0x7f8e4c0fba70 2023-10-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.806+0000 7f8e337fe700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e34060f70 0x7f8e34063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.806+0000 7f8e337fe700 1 -- 172.21.15.8:0/1406267306 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f8e4007e080 con 0x7f8e4c0fba70 2023-10-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.806+0000 7f8e4affd700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e34060f70 0x7f8e34063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.807+0000 7f8e4affd700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e34060f70 0x7f8e34063430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8e3c004ce0 tx=0x7f8e3c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:47.810+0000 7f8e337fe700 1 -- 172.21.15.8:0/1406267306 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8e40051b40 con 0x7f8e4c0fba70 2023-10-18T21:06:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:46.552313+0000 mgr.smithi008.flmjzp (mgr.14640) 439 : audit [DBG] from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:46.567760+0000 mgr.smithi008.flmjzp (mgr.14640) 440 : cluster [DBG] pgmap v318: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 4 op/s 2023-10-18T21:06:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:46.634851+0000 mon.smithi008 (mon.0) 796 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-18T21:06:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:46.642598+0000 mon.smithi008 (mon.0) 797 : cluster [DBG] mds.? [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] up:active 2023-10-18T21:06:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:46.642649+0000 mon.smithi008 (mon.0) 798 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi060.rvrncq=up:active} 2 up:standby 2023-10-18T21:06:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:46.552313+0000 mgr.smithi008.flmjzp (mgr.14640) 439 : audit [DBG] from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:46.567760+0000 mgr.smithi008.flmjzp (mgr.14640) 440 : cluster [DBG] pgmap v318: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 4 op/s 2023-10-18T21:06:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:46.634851+0000 mon.smithi008 (mon.0) 796 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-18T21:06:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:46.642598+0000 mon.smithi008 (mon.0) 797 : cluster [DBG] mds.? [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] up:active 2023-10-18T21:06:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:46.642649+0000 mon.smithi008 (mon.0) 798 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi060.rvrncq=up:active} 2 up:standby 2023-10-18T21:06:48.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.035+0000 7f8e4bfff700 1 -- 172.21.15.8:0/1406267306 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e4c100fd0 con 0x7f8e4c0fba70 2023-10-18T21:06:48.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.036+0000 7f8e337fe700 1 -- 172.21.15.8:0/1406267306 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 49 v49) v1 ==== 76+0+1588 (secure 0 0 0) 0x7f8e40051730 con 0x7f8e4c0fba70 2023-10-18T21:06:48.039 INFO:teuthology.orchestra.run.smithi008.stdout:e49 2023-10-18T21:06:48.039 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:06:48.039 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:06:48.039 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:06:48.040 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:06:48.040 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:06:48.040 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:06:48.040 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 49 2023-10-18T21:06:48.040 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:06:48.040 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:06:48.041 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:06:46.634817+0000 2023-10-18T21:06:48.041 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:06:48.041 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:06:48.041 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:06:48.041 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:06:48.042 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:06:48.042 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:06:48.042 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:06:48.043 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 93 2023-10-18T21:06:48.043 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:06:48.043 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:06:48.043 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:06:48.044 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44303} 2023-10-18T21:06:48.044 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:06:48.044 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:06:48.044 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:06:48.044 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:06:48.045 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:06:48.045 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:06:48.045 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:06:48.045 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:06:48.045 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44303} state up:active seq 46 join_fscid=1 addr [v2:172.21.15.60:6826/2547417133,v1:172.21.15.60:6827/2547417133] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:06:48.046 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:06:48.046 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:06:48.046 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:06:48.046 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:06:48.047 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6824/894252909,v1:172.21.15.60:6825/894252909] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:06:48.047 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{-1:44427} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.8:6828/2533319220,v1:172.21.15.8:6829/2533319220] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:06:48.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 -- 172.21.15.8:0/1406267306 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e34060f70 msgr2=0x7f8e34063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:48.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e34060f70 0x7f8e34063430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8e3c004ce0 tx=0x7f8e3c00b040).stop 2023-10-18T21:06:48.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 -- 172.21.15.8:0/1406267306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e4c0fba70 msgr2=0x7f8e4c1093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:48.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e4c0fba70 0x7f8e4c1093e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8e40004e30 tx=0x7f8e40009b30).stop 2023-10-18T21:06:48.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 -- 172.21.15.8:0/1406267306 shutdown_connections 2023-10-18T21:06:48.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8e34060f70 0x7f8e34063430 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:48.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e4c0602b0 0x7f8e4c108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:48.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 --2- 172.21.15.8:0/1406267306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e4c0fba70 0x7f8e4c1093e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:48.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 -- 172.21.15.8:0/1406267306 >> 172.21.15.8:0/1406267306 conn(0x7f8e4c0f0ba0 msgr2=0x7f8e4c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:48.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 -- 172.21.15.8:0/1406267306 shutdown_connections 2023-10-18T21:06:48.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.038+0000 7f8e4bfff700 1 -- 172.21.15.8:0/1406267306 wait complete. 2023-10-18T21:06:48.050 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 49 2023-10-18T21:06:48.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.175+0000 7fa0c2a55700 1 -- 172.21.15.8:0/3165898070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0bc0f6530 msgr2=0x7fa0bc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:48.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.175+0000 7fa0c2a55700 1 --2- 172.21.15.8:0/3165898070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0bc0f6530 0x7fa0bc0f6950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fa0b8004660 tx=0x7fa0b8009b30).stop 2023-10-18T21:06:48.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.176+0000 7fa0c2a55700 1 -- 172.21.15.8:0/3165898070 shutdown_connections 2023-10-18T21:06:48.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.176+0000 7fa0c2a55700 1 --2- 172.21.15.8:0/3165898070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc0f77d0 0x7fa0bc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:48.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.176+0000 7fa0c2a55700 1 --2- 172.21.15.8:0/3165898070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0bc0f6530 0x7fa0bc0f6950 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:48.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.176+0000 7fa0c2a55700 1 -- 172.21.15.8:0/3165898070 >> 172.21.15.8:0/3165898070 conn(0x7fa0bc0f1c90 msgr2=0x7fa0bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:48.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.176+0000 7fa0c2a55700 1 -- 172.21.15.8:0/3165898070 shutdown_connections 2023-10-18T21:06:48.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.176+0000 7fa0c2a55700 1 -- 172.21.15.8:0/3165898070 wait complete. 2023-10-18T21:06:48.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.176+0000 7fa0c2a55700 1 Processor -- start 2023-10-18T21:06:48.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.177+0000 7fa0c2a55700 1 -- start start 2023-10-18T21:06:48.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.177+0000 7fa0c2a55700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc0f6530 0x7fa0bc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:48.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.177+0000 7fa0c2a55700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0bc0f77d0 0x7fa0bc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:48.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.177+0000 7fa0c2a55700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc06a380 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.177+0000 7fa0c2a55700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc06a4c0 con 0x7fa0bc0f6530 2023-10-18T21:06:48.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.177+0000 7fa0c1252700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0bc0f77d0 0x7fa0bc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:48.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.177+0000 7fa0c1252700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0bc0f77d0 0x7fa0bc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50652/0 (socket says 172.21.15.8:50652) 2023-10-18T21:06:48.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.177+0000 7fa0c1252700 1 -- 172.21.15.8:0/2044764980 learned_addr learned my addr 172.21.15.8:0/2044764980 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:06:48.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.177+0000 7fa0c1a53700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc0f6530 0x7fa0bc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:48.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.178+0000 7fa0c1252700 1 -- 172.21.15.8:0/2044764980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc0f6530 msgr2=0x7fa0bc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:48.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.178+0000 7fa0c1252700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc0f6530 0x7fa0bc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:48.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.178+0000 7fa0c1252700 1 -- 172.21.15.8:0/2044764980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8005040 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.178+0000 7fa0c1252700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0bc0f77d0 0x7fa0bc069e20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa0ac00c790 tx=0x7fa0ac007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:48.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.178+0000 7fa0b27fc700 1 -- 172.21.15.8:0/2044764980 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0ac002590 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.178+0000 7fa0b27fc700 1 -- 172.21.15.8:0/2044764980 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa0ac002bb0 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.178+0000 7fa0c2a55700 1 -- 172.21.15.8:0/2044764980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc06a7a0 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.178+0000 7fa0b27fc700 1 -- 172.21.15.8:0/2044764980 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0ac013e10 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.178+0000 7fa0c2a55700 1 -- 172.21.15.8:0/2044764980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0bc10ede0 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.179+0000 7fa0c2a55700 1 -- 172.21.15.8:0/2044764980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0bc045ad0 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.180+0000 7fa0b27fc700 1 -- 172.21.15.8:0/2044764980 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa0ac01a060 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.181+0000 7fa0b27fc700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0a8060f70 0x7fa0a8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:06:48.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.181+0000 7fa0b27fc700 1 -- 172.21.15.8:0/2044764980 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fa0ac07c660 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.181+0000 7fa0c1a53700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0a8060f70 0x7fa0a8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:06:48.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.182+0000 7fa0c1a53700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0a8060f70 0x7fa0a8063430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fa0b8009490 tx=0x7fa0b8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:06:48.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.185+0000 7fa0b27fc700 1 -- 172.21.15.8:0/2044764980 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa0ac050240 con 0x7fa0bc0f77d0 2023-10-18T21:06:48.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.386+0000 7fa0c2a55700 1 -- 172.21.15.8:0/2044764980 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0bc0fedd0 con 0x7fa0a8060f70 2023-10-18T21:06:48.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.387+0000 7fa0b27fc700 1 -- 172.21.15.8:0/2044764980 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa0bc0fedd0 con 0x7fa0a8060f70 2023-10-18T21:06:48.390 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:06:48.390 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:06:48.390 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:06:48.391 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:06:48.391 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:06:48.391 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:06:48.391 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:06:48.391 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:06:48.391 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:06:48.392 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:06:48.392 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "13/21 daemons upgraded", 2023-10-18T21:06:48.392 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:06:48.392 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:06:48.392 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:06:48.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.389+0000 7fa0c2a55700 1 -- 172.21.15.8:0/2044764980 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0a8060f70 msgr2=0x7fa0a8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:48.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.389+0000 7fa0c2a55700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0a8060f70 0x7fa0a8063430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fa0b8009490 tx=0x7fa0b8009b30).stop 2023-10-18T21:06:48.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.389+0000 7fa0c2a55700 1 -- 172.21.15.8:0/2044764980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0bc0f77d0 msgr2=0x7fa0bc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:06:48.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.389+0000 7fa0c2a55700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0bc0f77d0 0x7fa0bc069e20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa0ac00c790 tx=0x7fa0ac007d70).stop 2023-10-18T21:06:48.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.390+0000 7fa0c2a55700 1 -- 172.21.15.8:0/2044764980 shutdown_connections 2023-10-18T21:06:48.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.390+0000 7fa0c2a55700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0a8060f70 0x7fa0a8063430 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:48.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.390+0000 7fa0c2a55700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc0f6530 0x7fa0bc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:48.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.390+0000 7fa0c2a55700 1 --2- 172.21.15.8:0/2044764980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0bc0f77d0 0x7fa0bc069e20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:06:48.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.390+0000 7fa0c2a55700 1 -- 172.21.15.8:0/2044764980 >> 172.21.15.8:0/2044764980 conn(0x7fa0bc0f1c90 msgr2=0x7fa0bc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:06:48.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.390+0000 7fa0c2a55700 1 -- 172.21.15.8:0/2044764980 shutdown_connections 2023-10-18T21:06:48.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:06:48.390+0000 7fa0c2a55700 1 -- 172.21.15.8:0/2044764980 wait complete. 2023-10-18T21:06:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:46.900244+0000 mgr.smithi008.flmjzp (mgr.14640) 441 : audit [DBG] from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:48.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:47.248627+0000 mgr.smithi008.flmjzp (mgr.14640) 442 : audit [DBG] from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:48.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:47.663071+0000 mon.smithi008 (mon.0) 799 : audit [DBG] from='client.? 172.21.15.8:0/2177489184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:48.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:48.037673+0000 mon.smithi008 (mon.0) 800 : audit [DBG] from='client.? 172.21.15.8:0/1406267306' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:06:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:46.900244+0000 mgr.smithi008.flmjzp (mgr.14640) 441 : audit [DBG] from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:47.248627+0000 mgr.smithi008.flmjzp (mgr.14640) 442 : audit [DBG] from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:47.663071+0000 mon.smithi008 (mon.0) 799 : audit [DBG] from='client.? 172.21.15.8:0/2177489184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:48.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:48.037673+0000 mon.smithi008 (mon.0) 800 : audit [DBG] from='client.? 172.21.15.8:0/1406267306' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:06:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:48.388920+0000 mgr.smithi008.flmjzp (mgr.14640) 443 : audit [DBG] from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:48.568123+0000 mgr.smithi008.flmjzp (mgr.14640) 444 : cluster [DBG] pgmap v319: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 255 B/s wr, 6 op/s 2023-10-18T21:06:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:48.388920+0000 mgr.smithi008.flmjzp (mgr.14640) 443 : audit [DBG] from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:06:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:48.568123+0000 mgr.smithi008.flmjzp (mgr.14640) 444 : cluster [DBG] pgmap v319: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 255 B/s wr, 6 op/s 2023-10-18T21:06:51.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:50.568705+0000 mgr.smithi008.flmjzp (mgr.14640) 445 : cluster [DBG] pgmap v320: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.4 MiB/s rd, 204 B/s wr, 5 op/s 2023-10-18T21:06:51.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:50.593303+0000 mon.smithi008 (mon.0) 801 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:50.568705+0000 mgr.smithi008.flmjzp (mgr.14640) 445 : cluster [DBG] pgmap v320: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.4 MiB/s rd, 204 B/s wr, 5 op/s 2023-10-18T21:06:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:50.593303+0000 mon.smithi008 (mon.0) 801 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:51.183216+0000 mon.smithi008 (mon.0) 802 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:51.184246+0000 mon.smithi008 (mon.0) 803 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:51.185123+0000 mgr.smithi008.flmjzp (mgr.14640) 446 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:51.185672+0000 mgr.smithi008.flmjzp (mgr.14640) 447 : cluster [DBG] pgmap v321: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.9 MiB/s rd, 192 B/s wr, 5 op/s 2023-10-18T21:06:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:51.185869+0000 mgr.smithi008.flmjzp (mgr.14640) 448 : cluster [DBG] pgmap v322: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.7 MiB/s rd, 237 B/s wr, 6 op/s 2023-10-18T21:06:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:51.190507+0000 mon.smithi008 (mon.0) 804 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:51.196521+0000 mon.smithi008 (mon.0) 805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:52.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:51.199286+0000 mon.smithi008 (mon.0) 806 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:52.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:51.200887+0000 mon.smithi008 (mon.0) 807 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:52.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:51.202404+0000 mon.smithi008 (mon.0) 808 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:52.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:51.204333+0000 mon.smithi008 (mon.0) 809 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:52.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:51.206426+0000 mon.smithi008 (mon.0) 810 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.grdzlm"]}]: dispatch 2023-10-18T21:06:52.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:51.207124+0000 mgr.smithi008.flmjzp (mgr.14640) 449 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi060.grdzlm 2023-10-18T21:06:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:51.183216+0000 mon.smithi008 (mon.0) 802 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:52.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:51.184246+0000 mon.smithi008 (mon.0) 803 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:06:52.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:51.185123+0000 mgr.smithi008.flmjzp (mgr.14640) 446 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:06:52.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:51.185672+0000 mgr.smithi008.flmjzp (mgr.14640) 447 : cluster [DBG] pgmap v321: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.9 MiB/s rd, 192 B/s wr, 5 op/s 2023-10-18T21:06:52.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:51.185869+0000 mgr.smithi008.flmjzp (mgr.14640) 448 : cluster [DBG] pgmap v322: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.7 MiB/s rd, 237 B/s wr, 6 op/s 2023-10-18T21:06:52.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:51.190507+0000 mon.smithi008 (mon.0) 804 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:52.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:51.196521+0000 mon.smithi008 (mon.0) 805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:06:52.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:51.199286+0000 mon.smithi008 (mon.0) 806 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:52.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:51.200887+0000 mon.smithi008 (mon.0) 807 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:52.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:51.202404+0000 mon.smithi008 (mon.0) 808 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:52.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:51.204333+0000 mon.smithi008 (mon.0) 809 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:06:52.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:51.206426+0000 mon.smithi008 (mon.0) 810 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.grdzlm"]}]: dispatch 2023-10-18T21:06:52.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:51.207124+0000 mgr.smithi008.flmjzp (mgr.14640) 449 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi060.grdzlm 2023-10-18T21:06:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:53.186404+0000 mgr.smithi008.flmjzp (mgr.14640) 450 : cluster [DBG] pgmap v323: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 237 B/s wr, 4 op/s 2023-10-18T21:06:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:53.186404+0000 mgr.smithi008.flmjzp (mgr.14640) 450 : cluster [DBG] pgmap v323: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 237 B/s wr, 4 op/s 2023-10-18T21:06:56.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:55.187089+0000 mgr.smithi008.flmjzp (mgr.14640) 451 : cluster [DBG] pgmap v324: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4.5 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-10-18T21:06:56.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:55.501881+0000 mgr.smithi008.flmjzp (mgr.14640) 452 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi060.grdzlm 2023-10-18T21:06:56.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:55.507552+0000 mon.smithi008 (mon.0) 811 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:56.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:55.508697+0000 mon.smithi008 (mon.0) 812 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.grdzlm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T21:06:56.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:55.509748+0000 mon.smithi008 (mon.0) 813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:56.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:06:55.510568+0000 mgr.smithi008.flmjzp (mgr.14640) 453 : cephadm [INF] Deploying daemon mds.cephfs.smithi060.grdzlm on smithi060 2023-10-18T21:06:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:55.187089+0000 mgr.smithi008.flmjzp (mgr.14640) 451 : cluster [DBG] pgmap v324: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4.5 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-10-18T21:06:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:55.501881+0000 mgr.smithi008.flmjzp (mgr.14640) 452 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi060.grdzlm 2023-10-18T21:06:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:55.507552+0000 mon.smithi008 (mon.0) 811 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:06:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:55.508697+0000 mon.smithi008 (mon.0) 812 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.grdzlm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T21:06:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:55.509748+0000 mon.smithi008 (mon.0) 813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:06:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:06:55.510568+0000 mgr.smithi008.flmjzp (mgr.14640) 453 : cephadm [INF] Deploying daemon mds.cephfs.smithi060.grdzlm on smithi060 2023-10-18T21:06:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:56.913525+0000 mon.smithi008 (mon.0) 814 : cluster [WRN] daemon mds.cephfs.smithi060.grdzlm compat changed unexpectedly 2023-10-18T21:06:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:56.918127+0000 mon.smithi008 (mon.0) 815 : cluster [DBG] osdmap e94: 6 total, 6 up, 6 in 2023-10-18T21:06:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:56.913525+0000 mon.smithi008 (mon.0) 814 : cluster [WRN] daemon mds.cephfs.smithi060.grdzlm compat changed unexpectedly 2023-10-18T21:06:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:56.918127+0000 mon.smithi008 (mon.0) 815 : cluster [DBG] osdmap e94: 6 total, 6 up, 6 in 2023-10-18T21:06:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:57.187672+0000 mgr.smithi008.flmjzp (mgr.14640) 454 : cluster [DBG] pgmap v326: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 7.6 KiB/s wr, 4 op/s 2023-10-18T21:06:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:06:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:57.513841+0000 mon.smithi008 (mon.0) 816 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi060.rvrncq=up:active} 1 up:standby 2023-10-18T21:06:58.926 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:57.187672+0000 mgr.smithi008.flmjzp (mgr.14640) 454 : cluster [DBG] pgmap v326: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 7.6 KiB/s wr, 4 op/s 2023-10-18T21:06:58.926 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:06:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:57.513841+0000 mon.smithi008 (mon.0) 816 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi060.rvrncq=up:active} 1 up:standby 2023-10-18T21:07:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:59.188109+0000 mgr.smithi008.flmjzp (mgr.14640) 455 : cluster [DBG] pgmap v327: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6.2 KiB/s wr, 2 op/s 2023-10-18T21:07:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:59.490142+0000 mon.smithi008 (mon.0) 817 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:59.491118+0000 mon.smithi008 (mon.0) 818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:59.520406+0000 mon.smithi008 (mon.0) 819 : cluster [DBG] mds.? [v2:172.21.15.60:6824/3230954720,v1:172.21.15.60:6825/3230954720] up:boot 2023-10-18T21:07:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:06:59.520489+0000 mon.smithi008 (mon.0) 820 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi060.rvrncq=up:active} 2 up:standby 2023-10-18T21:07:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:06:59.520659+0000 mon.smithi008 (mon.0) 821 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:07:00.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:00.450618+0000 mon.smithi008 (mon.0) 822 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:59.188109+0000 mgr.smithi008.flmjzp (mgr.14640) 455 : cluster [DBG] pgmap v327: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6.2 KiB/s wr, 2 op/s 2023-10-18T21:07:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:59.490142+0000 mon.smithi008 (mon.0) 817 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:59.491118+0000 mon.smithi008 (mon.0) 818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:59.520406+0000 mon.smithi008 (mon.0) 819 : cluster [DBG] mds.? [v2:172.21.15.60:6824/3230954720,v1:172.21.15.60:6825/3230954720] up:boot 2023-10-18T21:07:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:06:59.520489+0000 mon.smithi008 (mon.0) 820 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi060.rvrncq=up:active} 2 up:standby 2023-10-18T21:07:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:06:59.520659+0000 mon.smithi008 (mon.0) 821 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:07:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:00.450618+0000 mon.smithi008 (mon.0) 822 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:01.188752+0000 mgr.smithi008.flmjzp (mgr.14640) 456 : cluster [DBG] pgmap v328: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.0 KiB/s wr, 2 op/s 2023-10-18T21:07:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:02.250191+0000 mon.smithi008 (mon.0) 823 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:02.251289+0000 mon.smithi008 (mon.0) 824 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:02.252397+0000 mon.smithi008 (mon.0) 825 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:02.258155+0000 mon.smithi008 (mon.0) 826 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:02.264584+0000 mon.smithi008 (mon.0) 827 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:02.267560+0000 mon.smithi008 (mon.0) 828 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:02.269179+0000 mon.smithi008 (mon.0) 829 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:02.270768+0000 mon.smithi008 (mon.0) 830 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:02.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:02.272749+0000 mon.smithi008 (mon.0) 831 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:02.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:02.274931+0000 mon.smithi008 (mon.0) 832 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.rvrncq"]}]: dispatch 2023-10-18T21:07:02.767 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:01.188752+0000 mgr.smithi008.flmjzp (mgr.14640) 456 : cluster [DBG] pgmap v328: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.0 KiB/s wr, 2 op/s 2023-10-18T21:07:02.768 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:02.250191+0000 mon.smithi008 (mon.0) 823 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:02.768 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:02.251289+0000 mon.smithi008 (mon.0) 824 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:02.768 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:02.252397+0000 mon.smithi008 (mon.0) 825 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:02.768 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:02.258155+0000 mon.smithi008 (mon.0) 826 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:02.768 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:02.264584+0000 mon.smithi008 (mon.0) 827 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:02.769 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:02.267560+0000 mon.smithi008 (mon.0) 828 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:02.769 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:02.269179+0000 mon.smithi008 (mon.0) 829 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:02.769 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:02.270768+0000 mon.smithi008 (mon.0) 830 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:02.769 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:02.272749+0000 mon.smithi008 (mon.0) 831 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:02.770 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:02.274931+0000 mon.smithi008 (mon.0) 832 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.rvrncq"]}]: dispatch 2023-10-18T21:07:03.766 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:02.253286+0000 mgr.smithi008.flmjzp (mgr.14640) 457 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:03.766 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:02.253977+0000 mgr.smithi008.flmjzp (mgr.14640) 458 : cluster [DBG] pgmap v329: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.5 KiB/s wr, 2 op/s 2023-10-18T21:07:03.766 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:02.254198+0000 mgr.smithi008.flmjzp (mgr.14640) 459 : cluster [DBG] pgmap v330: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-10-18T21:07:03.766 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:02.275651+0000 mgr.smithi008.flmjzp (mgr.14640) 460 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi060.rvrncq 2023-10-18T21:07:03.767 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:03.335136+0000 mon.smithi008 (mon.0) 833 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:03.767 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:03.336205+0000 mon.smithi008 (mon.0) 834 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.rvrncq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T21:07:03.767 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:03.337363+0000 mon.smithi008 (mon.0) 835 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:02.253286+0000 mgr.smithi008.flmjzp (mgr.14640) 457 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:02.253977+0000 mgr.smithi008.flmjzp (mgr.14640) 458 : cluster [DBG] pgmap v329: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.5 KiB/s wr, 2 op/s 2023-10-18T21:07:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:02.254198+0000 mgr.smithi008.flmjzp (mgr.14640) 459 : cluster [DBG] pgmap v330: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-10-18T21:07:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:02.275651+0000 mgr.smithi008.flmjzp (mgr.14640) 460 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi060.rvrncq 2023-10-18T21:07:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:03.335136+0000 mon.smithi008 (mon.0) 833 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:03.336205+0000 mon.smithi008 (mon.0) 834 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.rvrncq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T21:07:03.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:03.337363+0000 mon.smithi008 (mon.0) 835 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:03.330316+0000 mgr.smithi008.flmjzp (mgr.14640) 461 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi060.rvrncq 2023-10-18T21:07:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:03.338261+0000 mgr.smithi008.flmjzp (mgr.14640) 462 : cephadm [INF] Deploying daemon mds.cephfs.smithi060.rvrncq on smithi060 2023-10-18T21:07:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:03.330316+0000 mgr.smithi008.flmjzp (mgr.14640) 461 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi060.rvrncq 2023-10-18T21:07:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:03.338261+0000 mgr.smithi008.flmjzp (mgr.14640) 462 : cephadm [INF] Deploying daemon mds.cephfs.smithi060.rvrncq on smithi060 2023-10-18T21:07:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:04.254672+0000 mgr.smithi008.flmjzp (mgr.14640) 463 : cluster [DBG] pgmap v331: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:04.608949+0000 mon.smithi008 (mon.0) 836 : cluster [DBG] osdmap e95: 6 total, 6 up, 6 in 2023-10-18T21:07:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:04.926220+0000 mon.smithi008 (mon.0) 837 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:07:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:04.926398+0000 mon.smithi008 (mon.0) 838 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-18T21:07:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:04.931072+0000 mon.smithi008 (mon.0) 839 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 1 up:standby 2023-10-18T21:07:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:04.254672+0000 mgr.smithi008.flmjzp (mgr.14640) 463 : cluster [DBG] pgmap v331: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:04.608949+0000 mon.smithi008 (mon.0) 836 : cluster [DBG] osdmap e95: 6 total, 6 up, 6 in 2023-10-18T21:07:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:04.926220+0000 mon.smithi008 (mon.0) 837 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:07:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:04.926398+0000 mon.smithi008 (mon.0) 838 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-18T21:07:05.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:04.931072+0000 mon.smithi008 (mon.0) 839 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 1 up:standby 2023-10-18T21:07:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:06.255113+0000 mgr.smithi008.flmjzp (mgr.14640) 464 : cluster [DBG] pgmap v333: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:06.255113+0000 mgr.smithi008.flmjzp (mgr.14640) 464 : cluster [DBG] pgmap v333: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:08.255731+0000 mgr.smithi008.flmjzp (mgr.14640) 465 : cluster [DBG] pgmap v334: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:08.255731+0000 mgr.smithi008.flmjzp (mgr.14640) 465 : cluster [DBG] pgmap v334: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:10.256316+0000 mgr.smithi008.flmjzp (mgr.14640) 466 : cluster [DBG] pgmap v335: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:10.256316+0000 mgr.smithi008.flmjzp (mgr.14640) 466 : cluster [DBG] pgmap v335: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:12.256949+0000 mgr.smithi008.flmjzp (mgr.14640) 467 : cluster [DBG] pgmap v336: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:12.256949+0000 mgr.smithi008.flmjzp (mgr.14640) 467 : cluster [DBG] pgmap v336: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:13.495182+0000 mon.smithi008 (mon.0) 840 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:13.496266+0000 mon.smithi008 (mon.0) 841 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:14.315945+0000 mon.smithi008 (mon.0) 842 : cluster [DBG] mds.? [v2:172.21.15.60:6826/532509022,v1:172.21.15.60:6827/532509022] up:boot 2023-10-18T21:07:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:14.316039+0000 mon.smithi008 (mon.0) 843 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 2 up:standby 2023-10-18T21:07:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:14.316214+0000 mon.smithi008 (mon.0) 844 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:07:14.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:13.495182+0000 mon.smithi008 (mon.0) 840 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:14.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:13.496266+0000 mon.smithi008 (mon.0) 841 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:14.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:14.315945+0000 mon.smithi008 (mon.0) 842 : cluster [DBG] mds.? [v2:172.21.15.60:6826/532509022,v1:172.21.15.60:6827/532509022] up:boot 2023-10-18T21:07:14.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:14.316039+0000 mon.smithi008 (mon.0) 843 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 2 up:standby 2023-10-18T21:07:14.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:14.316214+0000 mon.smithi008 (mon.0) 844 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:07:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:14.257670+0000 mgr.smithi008.flmjzp (mgr.14640) 468 : cluster [DBG] pgmap v337: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:15.450733+0000 mon.smithi008 (mon.0) 845 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:14.257670+0000 mgr.smithi008.flmjzp (mgr.14640) 468 : cluster [DBG] pgmap v337: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:15.450733+0000 mon.smithi008 (mon.0) 845 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:15.700745+0000 mon.smithi008 (mon.0) 846 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:15.702328+0000 mon.smithi008 (mon.0) 847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:15.703579+0000 mon.smithi008 (mon.0) 848 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:15.704535+0000 mgr.smithi008.flmjzp (mgr.14640) 469 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:15.705185+0000 mgr.smithi008.flmjzp (mgr.14640) 470 : cluster [DBG] pgmap v338: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:15.705410+0000 mgr.smithi008.flmjzp (mgr.14640) 471 : cluster [DBG] pgmap v339: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:15.710426+0000 mon.smithi008 (mon.0) 849 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:15.720281+0000 mon.smithi008 (mon.0) 850 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:16.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:15.723426+0000 mon.smithi008 (mon.0) 851 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:16.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:15.725004+0000 mon.smithi008 (mon.0) 852 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:16.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:15.726507+0000 mon.smithi008 (mon.0) 853 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:16.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:15.728533+0000 mon.smithi008 (mon.0) 854 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:16.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:15.730572+0000 mgr.smithi008.flmjzp (mgr.14640) 472 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:07:16.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:16.216090+0000 mon.smithi008 (mon.0) 855 : cluster [INF] daemon mds.cephfs.smithi008.lehgco restarted 2023-10-18T21:07:16.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:16.220083+0000 mon.smithi008 (mon.0) 856 : cluster [DBG] osdmap e96: 6 total, 6 up, 6 in 2023-10-18T21:07:17.066 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:15.700745+0000 mon.smithi008 (mon.0) 846 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:17.066 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:15.702328+0000 mon.smithi008 (mon.0) 847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:17.066 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:15.703579+0000 mon.smithi008 (mon.0) 848 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:17.066 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:15.704535+0000 mgr.smithi008.flmjzp (mgr.14640) 469 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:17.067 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:15.705185+0000 mgr.smithi008.flmjzp (mgr.14640) 470 : cluster [DBG] pgmap v338: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:17.067 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:15.705410+0000 mgr.smithi008.flmjzp (mgr.14640) 471 : cluster [DBG] pgmap v339: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:17.067 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:15.710426+0000 mon.smithi008 (mon.0) 849 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:17.067 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:15.720281+0000 mon.smithi008 (mon.0) 850 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:17.067 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:15.723426+0000 mon.smithi008 (mon.0) 851 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:17.068 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:15.725004+0000 mon.smithi008 (mon.0) 852 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:17.068 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:15.726507+0000 mon.smithi008 (mon.0) 853 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:17.068 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:15.728533+0000 mon.smithi008 (mon.0) 854 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:17.068 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:15.730572+0000 mgr.smithi008.flmjzp (mgr.14640) 472 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:07:17.068 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:16.216090+0000 mon.smithi008 (mon.0) 855 : cluster [INF] daemon mds.cephfs.smithi008.lehgco restarted 2023-10-18T21:07:17.068 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:16.220083+0000 mon.smithi008 (mon.0) 856 : cluster [DBG] osdmap e96: 6 total, 6 up, 6 in 2023-10-18T21:07:17.069 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:07:16.707+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:07:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:16.708099+0000 mon.smithi008 (mon.0) 857 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:07:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:16.711619+0000 mon.smithi008 (mon.0) 858 : cluster [DBG] mds.? [v2:172.21.15.8:6826/729289097,v1:172.21.15.8:6827/729289097] up:boot 2023-10-18T21:07:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:16.711666+0000 mon.smithi008 (mon.0) 859 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:07:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:16.711750+0000 mon.smithi008 (mon.0) 860 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:07:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:16.711989+0000 mon.smithi008 (mon.0) 861 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-10-18T21:07:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:16.712094+0000 mon.smithi008 (mon.0) 862 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:07:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:16.715219+0000 mon.smithi008 (mon.0) 863 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 2 up:standby 2023-10-18T21:07:18.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:16.708099+0000 mon.smithi008 (mon.0) 857 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:07:18.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:16.711619+0000 mon.smithi008 (mon.0) 858 : cluster [DBG] mds.? [v2:172.21.15.8:6826/729289097,v1:172.21.15.8:6827/729289097] up:boot 2023-10-18T21:07:18.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:16.711666+0000 mon.smithi008 (mon.0) 859 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:07:18.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:16.711750+0000 mon.smithi008 (mon.0) 860 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:07:18.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:16.711989+0000 mon.smithi008 (mon.0) 861 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-10-18T21:07:18.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:16.712094+0000 mon.smithi008 (mon.0) 862 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:07:18.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:16.715219+0000 mon.smithi008 (mon.0) 863 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 2 up:standby 2023-10-18T21:07:18.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.545+0000 7f6055d42700 1 -- 172.21.15.8:0/2266760685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605006b9c0 msgr2=0x7f6050069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:18.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.545+0000 7f6055d42700 1 --2- 172.21.15.8:0/2266760685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605006b9c0 0x7f6050069ec0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f6044004660 tx=0x7f6044009b30).stop 2023-10-18T21:07:18.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.546+0000 7f6055d42700 1 -- 172.21.15.8:0/2266760685 shutdown_connections 2023-10-18T21:07:18.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.546+0000 7f6055d42700 1 --2- 172.21.15.8:0/2266760685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f605006a3b0 0x7f605006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:18.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.546+0000 7f6055d42700 1 --2- 172.21.15.8:0/2266760685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605006b9c0 0x7f6050069ec0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:18.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.546+0000 7f6055d42700 1 -- 172.21.15.8:0/2266760685 >> 172.21.15.8:0/2266760685 conn(0x7f60500f1c90 msgr2=0x7f60500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:18.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.546+0000 7f6055d42700 1 -- 172.21.15.8:0/2266760685 shutdown_connections 2023-10-18T21:07:18.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.546+0000 7f6055d42700 1 -- 172.21.15.8:0/2266760685 wait complete. 2023-10-18T21:07:18.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.547+0000 7f6055d42700 1 Processor -- start 2023-10-18T21:07:18.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.547+0000 7f6055d42700 1 -- start start 2023-10-18T21:07:18.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f6055d42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605006a3b0 0x7f6050108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:18.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f6055d42700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f605006b9c0 0x7f60501094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:18.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f6055d42700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050109a50 con 0x7f605006a3b0 2023-10-18T21:07:18.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f6055d42700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050109b90 con 0x7f605006b9c0 2023-10-18T21:07:18.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f6054d40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605006a3b0 0x7f6050108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:18.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f6054d40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605006a3b0 0x7f6050108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59532/0 (socket says 172.21.15.8:59532) 2023-10-18T21:07:18.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f6054d40700 1 -- 172.21.15.8:0/322089717 learned_addr learned my addr 172.21.15.8:0/322089717 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:18.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f604ffff700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f605006b9c0 0x7f60501094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:18.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f6054d40700 1 -- 172.21.15.8:0/322089717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f605006b9c0 msgr2=0x7f60501094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:18.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f6054d40700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f605006b9c0 0x7f60501094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:18.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.548+0000 7f6054d40700 1 -- 172.21.15.8:0/322089717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044005040 con 0x7f605006a3b0 2023-10-18T21:07:18.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.549+0000 7f6054d40700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605006a3b0 0x7f6050108fb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f6044009990 tx=0x7f6044009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:18.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.549+0000 7f604d7fa700 1 -- 172.21.15.8:0/322089717 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6044018070 con 0x7f605006a3b0 2023-10-18T21:07:18.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.549+0000 7f604d7fa700 1 -- 172.21.15.8:0/322089717 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6044009630 con 0x7f605006a3b0 2023-10-18T21:07:18.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.549+0000 7f6055d42700 1 -- 172.21.15.8:0/322089717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605010a4d0 con 0x7f605006a3b0 2023-10-18T21:07:18.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.549+0000 7f604d7fa700 1 -- 172.21.15.8:0/322089717 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f604401c400 con 0x7f605006a3b0 2023-10-18T21:07:18.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.549+0000 7f6055d42700 1 -- 172.21.15.8:0/322089717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605010aa30 con 0x7f605006a3b0 2023-10-18T21:07:18.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.550+0000 7f6055d42700 1 -- 172.21.15.8:0/322089717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6050045ad0 con 0x7f605006a3b0 2023-10-18T21:07:18.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.551+0000 7f604d7fa700 1 -- 172.21.15.8:0/322089717 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f604401d9e0 con 0x7f605006a3b0 2023-10-18T21:07:18.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.552+0000 7f604d7fa700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 0x7f6040063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:18.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.552+0000 7f604d7fa700 1 -- 172.21.15.8:0/322089717 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6844+0+0 (secure 0 0 0) 0x7f604407e1a0 con 0x7f605006a3b0 2023-10-18T21:07:18.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.553+0000 7f604ffff700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 0x7f6040063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:18.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.553+0000 7f604ffff700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 0x7f6040063430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f603c0096c0 tx=0x7f603c009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:18.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.557+0000 7f604d7fa700 1 -- 172.21.15.8:0/322089717 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6044051cd0 con 0x7f605006a3b0 2023-10-18T21:07:18.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.758+0000 7f6055d42700 1 -- 172.21.15.8:0/322089717 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6050101030 con 0x7f6040060f70 2023-10-18T21:07:18.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.759+0000 7f604d7fa700 1 -- 172.21.15.8:0/322089717 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6050101030 con 0x7f6040060f70 2023-10-18T21:07:18.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 -- 172.21.15.8:0/322089717 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 msgr2=0x7f6040063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:18.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 0x7f6040063430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f603c0096c0 tx=0x7f603c009be0).stop 2023-10-18T21:07:18.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 -- 172.21.15.8:0/322089717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605006a3b0 msgr2=0x7f6050108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:18.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605006a3b0 0x7f6050108fb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f6044009990 tx=0x7f6044009b30).stop 2023-10-18T21:07:18.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 -- 172.21.15.8:0/322089717 shutdown_connections 2023-10-18T21:07:18.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 0x7f6040063430 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:18.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605006a3b0 0x7f6050108fb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:18.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 --2- 172.21.15.8:0/322089717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f605006b9c0 0x7f60501094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:18.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 -- 172.21.15.8:0/322089717 >> 172.21.15.8:0/322089717 conn(0x7f60500f1c90 msgr2=0x7f60500fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:18.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 -- 172.21.15.8:0/322089717 shutdown_connections 2023-10-18T21:07:18.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.761+0000 7f6055d42700 1 -- 172.21.15.8:0/322089717 wait complete. 2023-10-18T21:07:18.778 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:07:18.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.900+0000 7f0b02da9700 1 -- 172.21.15.8:0/3041359580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc0f77d0 msgr2=0x7f0afc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:18.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.900+0000 7f0b02da9700 1 --2- 172.21.15.8:0/3041359580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc0f77d0 0x7f0afc0f7c30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0aec004660 tx=0x7f0aec009b30).stop 2023-10-18T21:07:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.900+0000 7f0b02da9700 1 -- 172.21.15.8:0/3041359580 shutdown_connections 2023-10-18T21:07:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.900+0000 7f0b02da9700 1 --2- 172.21.15.8:0/3041359580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc0f77d0 0x7f0afc0f7c30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.900+0000 7f0b02da9700 1 --2- 172.21.15.8:0/3041359580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc0f6530 0x7f0afc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.900+0000 7f0b02da9700 1 -- 172.21.15.8:0/3041359580 >> 172.21.15.8:0/3041359580 conn(0x7f0afc0f1c90 msgr2=0x7f0afc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.900+0000 7f0b02da9700 1 -- 172.21.15.8:0/3041359580 shutdown_connections 2023-10-18T21:07:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.900+0000 7f0b02da9700 1 -- 172.21.15.8:0/3041359580 wait complete. 2023-10-18T21:07:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.901+0000 7f0b02da9700 1 Processor -- start 2023-10-18T21:07:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.901+0000 7f0b02da9700 1 -- start start 2023-10-18T21:07:18.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.901+0000 7f0b02da9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc0f6530 0x7f0afc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.901+0000 7f0b02da9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc0f77d0 0x7f0afc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.901+0000 7f0b02da9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc06a380 con 0x7f0afc0f77d0 2023-10-18T21:07:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.901+0000 7f0b02da9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc06a4c0 con 0x7f0afc0f6530 2023-10-18T21:07:18.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.901+0000 7f0b015a6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc0f77d0 0x7f0afc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:18.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.901+0000 7f0b015a6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc0f77d0 0x7f0afc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59558/0 (socket says 172.21.15.8:59558) 2023-10-18T21:07:18.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.901+0000 7f0b015a6700 1 -- 172.21.15.8:0/2244533571 learned_addr learned my addr 172.21.15.8:0/2244533571 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:18.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.901+0000 7f0b01da7700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc0f6530 0x7f0afc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:18.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.902+0000 7f0b015a6700 1 -- 172.21.15.8:0/2244533571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc0f6530 msgr2=0x7f0afc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:18.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.902+0000 7f0b015a6700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc0f6530 0x7f0afc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:18.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.902+0000 7f0b015a6700 1 -- 172.21.15.8:0/2244533571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec005040 con 0x7f0afc0f77d0 2023-10-18T21:07:18.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.902+0000 7f0b015a6700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc0f77d0 0x7f0afc069e20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f0aec004d80 tx=0x7f0aec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:18.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.902+0000 7f0af27fc700 1 -- 172.21.15.8:0/2244533571 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aec019070 con 0x7f0afc0f77d0 2023-10-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.902+0000 7f0af27fc700 1 -- 172.21.15.8:0/2244533571 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0aec01e420 con 0x7f0afc0f77d0 2023-10-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.902+0000 7f0b02da9700 1 -- 172.21.15.8:0/2244533571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc06a740 con 0x7f0afc0f77d0 2023-10-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.902+0000 7f0af27fc700 1 -- 172.21.15.8:0/2244533571 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aec014660 con 0x7f0afc0f77d0 2023-10-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.903+0000 7f0b02da9700 1 -- 172.21.15.8:0/2244533571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc06ac20 con 0x7f0afc0f77d0 2023-10-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.904+0000 7f0b02da9700 1 -- 172.21.15.8:0/2244533571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc045ad0 con 0x7f0afc0f77d0 2023-10-18T21:07:18.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.904+0000 7f0af27fc700 1 -- 172.21.15.8:0/2244533571 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0aec01e590 con 0x7f0afc0f77d0 2023-10-18T21:07:18.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.905+0000 7f0af27fc700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ae8060f70 0x7f0ae8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:18.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.905+0000 7f0af27fc700 1 -- 172.21.15.8:0/2244533571 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6844+0+0 (secure 0 0 0) 0x7f0aec07da00 con 0x7f0afc0f77d0 2023-10-18T21:07:18.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.906+0000 7f0b01da7700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ae8060f70 0x7f0ae8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:18.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.906+0000 7f0b01da7700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ae8060f70 0x7f0ae8063430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f0afc06b730 tx=0x7f0af800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:18.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:18.910+0000 7f0af27fc700 1 -- 172.21.15.8:0/2244533571 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0aec04d9c0 con 0x7f0afc0f77d0 2023-10-18T21:07:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:17.705818+0000 mgr.smithi008.flmjzp (mgr.14640) 473 : cluster [DBG] pgmap v341: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:19.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.108+0000 7f0b02da9700 1 -- 172.21.15.8:0/2244533571 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0afc0fedd0 con 0x7f0ae8060f70 2023-10-18T21:07:19.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.109+0000 7f0af27fc700 1 -- 172.21.15.8:0/2244533571 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0afc0fedd0 con 0x7f0ae8060f70 2023-10-18T21:07:19.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.111+0000 7f0b02da9700 1 -- 172.21.15.8:0/2244533571 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ae8060f70 msgr2=0x7f0ae8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:19.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.111+0000 7f0b02da9700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ae8060f70 0x7f0ae8063430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f0afc06b730 tx=0x7f0af800b040).stop 2023-10-18T21:07:19.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.111+0000 7f0b02da9700 1 -- 172.21.15.8:0/2244533571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc0f77d0 msgr2=0x7f0afc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:19.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.111+0000 7f0b02da9700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc0f77d0 0x7f0afc069e20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f0aec004d80 tx=0x7f0aec00b040).stop 2023-10-18T21:07:19.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.111+0000 7f0b02da9700 1 -- 172.21.15.8:0/2244533571 shutdown_connections 2023-10-18T21:07:19.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.111+0000 7f0b02da9700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ae8060f70 0x7f0ae8063430 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.111+0000 7f0b02da9700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc0f6530 0x7f0afc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.111+0000 7f0b02da9700 1 --2- 172.21.15.8:0/2244533571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc0f77d0 0x7f0afc069e20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.111+0000 7f0b02da9700 1 -- 172.21.15.8:0/2244533571 >> 172.21.15.8:0/2244533571 conn(0x7f0afc0f1c90 msgr2=0x7f0afc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:19.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.112+0000 7f0b02da9700 1 -- 172.21.15.8:0/2244533571 shutdown_connections 2023-10-18T21:07:19.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.112+0000 7f0b02da9700 1 -- 172.21.15.8:0/2244533571 wait complete. 2023-10-18T21:07:19.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:17.705818+0000 mgr.smithi008.flmjzp (mgr.14640) 473 : cluster [DBG] pgmap v341: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.248+0000 7fdba16f9700 1 -- 172.21.15.8:0/251903331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb9c0f77d0 msgr2=0x7fdb9c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:19.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.248+0000 7fdba16f9700 1 --2- 172.21.15.8:0/251903331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb9c0f77d0 0x7fdb9c0f7c30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fdb90004660 tx=0x7fdb90009b30).stop 2023-10-18T21:07:19.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.248+0000 7fdba16f9700 1 -- 172.21.15.8:0/251903331 shutdown_connections 2023-10-18T21:07:19.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.248+0000 7fdba16f9700 1 --2- 172.21.15.8:0/251903331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb9c0f77d0 0x7fdb9c0f7c30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.248+0000 7fdba16f9700 1 --2- 172.21.15.8:0/251903331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb9c0f6530 0x7fdb9c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.248+0000 7fdba16f9700 1 -- 172.21.15.8:0/251903331 >> 172.21.15.8:0/251903331 conn(0x7fdb9c0f1c90 msgr2=0x7fdb9c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:19.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.248+0000 7fdba16f9700 1 -- 172.21.15.8:0/251903331 shutdown_connections 2023-10-18T21:07:19.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.248+0000 7fdba16f9700 1 -- 172.21.15.8:0/251903331 wait complete. 2023-10-18T21:07:19.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.249+0000 7fdba16f9700 1 Processor -- start 2023-10-18T21:07:19.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.249+0000 7fdba16f9700 1 -- start start 2023-10-18T21:07:19.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.249+0000 7fdba16f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb9c0f6530 0x7fdb9c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:19.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.249+0000 7fdba16f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb9c0f77d0 0x7fdb9c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:19.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.249+0000 7fdba16f9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c06a380 con 0x7fdb9c0f6530 2023-10-18T21:07:19.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.249+0000 7fdba16f9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c06a4c0 con 0x7fdb9c0f77d0 2023-10-18T21:07:19.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.250+0000 7fdb9bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb9c0f6530 0x7fdb9c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:19.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.250+0000 7fdb9bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb9c0f6530 0x7fdb9c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59582/0 (socket says 172.21.15.8:59582) 2023-10-18T21:07:19.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.250+0000 7fdb9bfff700 1 -- 172.21.15.8:0/188886357 learned_addr learned my addr 172.21.15.8:0/188886357 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:19.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.250+0000 7fdb9b7fe700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb9c0f77d0 0x7fdb9c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:19.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.250+0000 7fdb9bfff700 1 -- 172.21.15.8:0/188886357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb9c0f77d0 msgr2=0x7fdb9c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:19.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.250+0000 7fdb9bfff700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb9c0f77d0 0x7fdb9c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.250+0000 7fdb9bfff700 1 -- 172.21.15.8:0/188886357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90005040 con 0x7fdb9c0f6530 2023-10-18T21:07:19.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.250+0000 7fdb9bfff700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb9c0f6530 0x7fdb9c06b9a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fdb8c00e7c0 tx=0x7fdb8c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:19.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.251+0000 7fdb98ff9700 1 -- 172.21.15.8:0/188886357 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb8c0092e0 con 0x7fdb9c0f6530 2023-10-18T21:07:19.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.251+0000 7fdb98ff9700 1 -- 172.21.15.8:0/188886357 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdb8c00f040 con 0x7fdb9c0f6530 2023-10-18T21:07:19.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.251+0000 7fdb98ff9700 1 -- 172.21.15.8:0/188886357 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb8c014810 con 0x7fdb9c0f6530 2023-10-18T21:07:19.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.251+0000 7fdba16f9700 1 -- 172.21.15.8:0/188886357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c06a7a0 con 0x7fdb9c0f6530 2023-10-18T21:07:19.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.251+0000 7fdba16f9700 1 -- 172.21.15.8:0/188886357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c10ecc0 con 0x7fdb9c0f6530 2023-10-18T21:07:19.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.252+0000 7fdba16f9700 1 -- 172.21.15.8:0/188886357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c045ad0 con 0x7fdb9c0f6530 2023-10-18T21:07:19.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.253+0000 7fdb98ff9700 1 -- 172.21.15.8:0/188886357 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdb8c01b030 con 0x7fdb9c0f6530 2023-10-18T21:07:19.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.254+0000 7fdb98ff9700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb84060f70 0x7fdb84063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:19.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.254+0000 7fdb98ff9700 1 -- 172.21.15.8:0/188886357 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6844+0+0 (secure 0 0 0) 0x7fdb8c07c430 con 0x7fdb9c0f6530 2023-10-18T21:07:19.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.254+0000 7fdb9b7fe700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb84060f70 0x7fdb84063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:19.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.254+0000 7fdb9b7fe700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb84060f70 0x7fdb84063430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fdb90005010 tx=0x7fdb90016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:19.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.258+0000 7fdb98ff9700 1 -- 172.21.15.8:0/188886357 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdb8c04c430 con 0x7fdb9c0f6530 2023-10-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.449+0000 7fdba16f9700 1 -- 172.21.15.8:0/188886357 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb9c0fee30 con 0x7fdb84060f70 2023-10-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.459+0000 7fdb98ff9700 1 -- 172.21.15.8:0/188886357 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fdb9c0fee30 con 0x7fdb84060f70 2023-10-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (13m) 2m ago 15m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (7m) 2m ago 15m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (7m) 3s ago 14m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (13m) 2m ago 15m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (2m) 2m ago 11m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 11m - - 2023-10-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (20s) 3s ago 11m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (6s) 3s ago 11m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (9m) 2m ago 16m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (8m) 3s ago 14m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (8m) 2m ago 16m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (8m) 3s ago 14m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (14m) 2m ago 14m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (14m) 3s ago 14m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (7m) 2m ago 14m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (5m) 2m ago 13m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (5m) 2m ago 13m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (4m) 3s ago 13m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (3m) 3s ago 12m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (3m) 3s ago 12m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (9m) 2m ago 14m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.461+0000 7fdba16f9700 1 -- 172.21.15.8:0/188886357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb84060f70 msgr2=0x7fdb84063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.461+0000 7fdba16f9700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb84060f70 0x7fdb84063430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fdb90005010 tx=0x7fdb90016040).stop 2023-10-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.461+0000 7fdba16f9700 1 -- 172.21.15.8:0/188886357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb9c0f6530 msgr2=0x7fdb9c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.461+0000 7fdba16f9700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb9c0f6530 0x7fdb9c06b9a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fdb8c00e7c0 tx=0x7fdb8c00b040).stop 2023-10-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.461+0000 7fdba16f9700 1 -- 172.21.15.8:0/188886357 shutdown_connections 2023-10-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.461+0000 7fdba16f9700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb84060f70 0x7fdb84063430 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.461+0000 7fdba16f9700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb9c0f6530 0x7fdb9c06b9a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.461+0000 7fdba16f9700 1 --2- 172.21.15.8:0/188886357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb9c0f77d0 0x7fdb9c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.461+0000 7fdba16f9700 1 -- 172.21.15.8:0/188886357 >> 172.21.15.8:0/188886357 conn(0x7fdb9c0f1c90 msgr2=0x7fdb9c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.462+0000 7fdba16f9700 1 -- 172.21.15.8:0/188886357 shutdown_connections 2023-10-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.462+0000 7fdba16f9700 1 -- 172.21.15.8:0/188886357 wait complete. 2023-10-18T21:07:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.597+0000 7fa93759e700 1 -- 172.21.15.8:0/3759575538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9380602b0 msgr2=0x7fa9380f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.597+0000 7fa93759e700 1 --2- 172.21.15.8:0/3759575538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9380602b0 0x7fa9380f9170 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fa928004660 tx=0x7fa928009b30).stop 2023-10-18T21:07:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.597+0000 7fa93759e700 1 -- 172.21.15.8:0/3759575538 shutdown_connections 2023-10-18T21:07:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.597+0000 7fa93759e700 1 --2- 172.21.15.8:0/3759575538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9380f96f0 0x7fa9380fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.597+0000 7fa93759e700 1 --2- 172.21.15.8:0/3759575538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9380602b0 0x7fa9380f9170 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.597+0000 7fa93759e700 1 -- 172.21.15.8:0/3759575538 >> 172.21.15.8:0/3759575538 conn(0x7fa9380f0b90 msgr2=0x7fa9380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.598+0000 7fa93759e700 1 -- 172.21.15.8:0/3759575538 shutdown_connections 2023-10-18T21:07:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.598+0000 7fa93759e700 1 -- 172.21.15.8:0/3759575538 wait complete. 2023-10-18T21:07:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.598+0000 7fa93759e700 1 Processor -- start 2023-10-18T21:07:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.599+0000 7fa93759e700 1 -- start start 2023-10-18T21:07:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.599+0000 7fa93759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9380602b0 0x7fa938108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.599+0000 7fa93759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9380f96f0 0x7fa938109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.599+0000 7fa93759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa938109a10 con 0x7fa9380f96f0 2023-10-18T21:07:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.599+0000 7fa93759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa938109b50 con 0x7fa9380602b0 2023-10-18T21:07:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.599+0000 7fa935d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9380f96f0 0x7fa938109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.599+0000 7fa935d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9380f96f0 0x7fa938109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59592/0 (socket says 172.21.15.8:59592) 2023-10-18T21:07:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.599+0000 7fa935d9b700 1 -- 172.21.15.8:0/1499703859 learned_addr learned my addr 172.21.15.8:0/1499703859 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.599+0000 7fa93659c700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9380602b0 0x7fa938108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.600+0000 7fa935d9b700 1 -- 172.21.15.8:0/1499703859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9380602b0 msgr2=0x7fa938108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.600+0000 7fa935d9b700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9380602b0 0x7fa938108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.600+0000 7fa935d9b700 1 -- 172.21.15.8:0/1499703859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa928005040 con 0x7fa9380f96f0 2023-10-18T21:07:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.600+0000 7fa935d9b700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9380f96f0 0x7fa938109460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fa92c002700 tx=0x7fa92c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.600+0000 7fa926ffd700 1 -- 172.21.15.8:0/1499703859 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa92c0079c0 con 0x7fa9380f96f0 2023-10-18T21:07:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.600+0000 7fa926ffd700 1 -- 172.21.15.8:0/1499703859 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa92c00f040 con 0x7fa9380f96f0 2023-10-18T21:07:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.600+0000 7fa926ffd700 1 -- 172.21.15.8:0/1499703859 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa92c014800 con 0x7fa9380f96f0 2023-10-18T21:07:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.600+0000 7fa93759e700 1 -- 172.21.15.8:0/1499703859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93810a4f0 con 0x7fa9380f96f0 2023-10-18T21:07:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.600+0000 7fa93759e700 1 -- 172.21.15.8:0/1499703859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93810aab0 con 0x7fa9380f96f0 2023-10-18T21:07:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.602+0000 7fa93759e700 1 -- 172.21.15.8:0/1499703859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa938045ad0 con 0x7fa9380f96f0 2023-10-18T21:07:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.602+0000 7fa926ffd700 1 -- 172.21.15.8:0/1499703859 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa92c01b060 con 0x7fa9380f96f0 2023-10-18T21:07:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.603+0000 7fa926ffd700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa920060f70 0x7fa920063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.603+0000 7fa926ffd700 1 -- 172.21.15.8:0/1499703859 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6844+0+0 (secure 0 0 0) 0x7fa92c07c280 con 0x7fa9380f96f0 2023-10-18T21:07:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.604+0000 7fa93659c700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa920060f70 0x7fa920063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.604+0000 7fa93659c700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa920060f70 0x7fa920063430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa928004630 tx=0x7fa928009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:19.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.607+0000 7fa926ffd700 1 -- 172.21.15.8:0/1499703859 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa92c04fdb0 con 0x7fa9380f96f0 2023-10-18T21:07:19.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.864+0000 7fa93759e700 1 -- 172.21.15.8:0/1499703859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa93810f590 con 0x7fa9380f96f0 2023-10-18T21:07:19.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.865+0000 7fa926ffd700 1 -- 172.21.15.8:0/1499703859 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fa92c04f9a0 con 0x7fa9380f96f0 2023-10-18T21:07:19.866 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:07:19.867 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:07:19.867 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:07:19.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:07:19.867 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:07:19.867 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:07:19.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:07:19.868 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:07:19.868 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:07:19.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:07:19.868 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:07:19.869 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 3 2023-10-18T21:07:19.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:07:19.869 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:07:19.869 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 13 2023-10-18T21:07:19.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:07:19.869 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:07:19.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 -- 172.21.15.8:0/1499703859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa920060f70 msgr2=0x7fa920063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa920060f70 0x7fa920063430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa928004630 tx=0x7fa928009b30).stop 2023-10-18T21:07:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 -- 172.21.15.8:0/1499703859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9380f96f0 msgr2=0x7fa938109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9380f96f0 0x7fa938109460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fa92c002700 tx=0x7fa92c009d60).stop 2023-10-18T21:07:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 -- 172.21.15.8:0/1499703859 shutdown_connections 2023-10-18T21:07:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa920060f70 0x7fa920063430 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9380602b0 0x7fa938108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 --2- 172.21.15.8:0/1499703859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9380f96f0 0x7fa938109460 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 -- 172.21.15.8:0/1499703859 >> 172.21.15.8:0/1499703859 conn(0x7fa9380f0b90 msgr2=0x7fa9380f5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 -- 172.21.15.8:0/1499703859 shutdown_connections 2023-10-18T21:07:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:19.867+0000 7fa93759e700 1 -- 172.21.15.8:0/1499703859 wait complete. 2023-10-18T21:07:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:18.759352+0000 mgr.smithi008.flmjzp (mgr.14640) 474 : audit [DBG] from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:19.109743+0000 mgr.smithi008.flmjzp (mgr.14640) 475 : audit [DBG] from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:19.450949+0000 mgr.smithi008.flmjzp (mgr.14640) 476 : audit [DBG] from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.003+0000 7f76ce2f6700 1 -- 172.21.15.8:0/747817965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c80f6530 msgr2=0x7f76c80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.003+0000 7f76ce2f6700 1 --2- 172.21.15.8:0/747817965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c80f6530 0x7f76c80f6950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f76c4004660 tx=0x7f76c4009b30).stop 2023-10-18T21:07:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.004+0000 7f76ce2f6700 1 -- 172.21.15.8:0/747817965 shutdown_connections 2023-10-18T21:07:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.004+0000 7f76ce2f6700 1 --2- 172.21.15.8:0/747817965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c80f77d0 0x7f76c80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:07:20.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.004+0000 7f76ce2f6700 1 --2- 172.21.15.8:0/747817965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c80f6530 0x7f76c80f6950 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.004+0000 7f76ce2f6700 1 -- 172.21.15.8:0/747817965 >> 172.21.15.8:0/747817965 conn(0x7f76c80f1c90 msgr2=0x7f76c80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:20.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.004+0000 7f76ce2f6700 1 -- 172.21.15.8:0/747817965 shutdown_connections 2023-10-18T21:07:20.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.004+0000 7f76ce2f6700 1 -- 172.21.15.8:0/747817965 wait complete. 2023-10-18T21:07:20.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.004+0000 7f76ce2f6700 1 Processor -- start 2023-10-18T21:07:20.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.005+0000 7f76ce2f6700 1 -- start start 2023-10-18T21:07:20.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.005+0000 7f76ce2f6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c80f6530 0x7f76c80ff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:20.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.005+0000 7f76ce2f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c80f77d0 0x7f76c80ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.005+0000 7f76ce2f6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8100550 con 0x7f76c80f77d0 2023-10-18T21:07:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.005+0000 7f76ce2f6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8100e00 con 0x7f76c80f6530 2023-10-18T21:07:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.005+0000 7f76ccaf3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c80f77d0 0x7f76c80ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.005+0000 7f76ccaf3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c80f77d0 0x7f76c80ffec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59606/0 (socket says 172.21.15.8:59606) 2023-10-18T21:07:20.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.005+0000 7f76ccaf3700 1 -- 172.21.15.8:0/3455370925 learned_addr learned my addr 172.21.15.8:0/3455370925 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:20.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.005+0000 7f76cd2f4700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c80f6530 0x7f76c80ff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:20.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.006+0000 7f76ccaf3700 1 -- 172.21.15.8:0/3455370925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c80f6530 msgr2=0x7f76c80ff9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:20.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.006+0000 7f76ccaf3700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c80f6530 0x7f76c80ff9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.006+0000 7f76ccaf3700 1 -- 172.21.15.8:0/3455370925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4005040 con 0x7f76c80f77d0 2023-10-18T21:07:20.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.006+0000 7f76ccaf3700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c80f77d0 0x7f76c80ffec0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f76b800b410 tx=0x7f76b8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:20.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.006+0000 7f76bdffb700 1 -- 172.21.15.8:0/3455370925 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b80125f0 con 0x7f76c80f77d0 2023-10-18T21:07:20.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.006+0000 7f76bdffb700 1 -- 172.21.15.8:0/3455370925 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f76b800be30 con 0x7f76c80f77d0 2023-10-18T21:07:20.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.006+0000 7f76ce2f6700 1 -- 172.21.15.8:0/3455370925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c81010b0 con 0x7f76c80f77d0 2023-10-18T21:07:20.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.006+0000 7f76bdffb700 1 -- 172.21.15.8:0/3455370925 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b8002a60 con 0x7f76c80f77d0 2023-10-18T21:07:20.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.006+0000 7f76ce2f6700 1 -- 172.21.15.8:0/3455370925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c8101670 con 0x7f76c80f77d0 2023-10-18T21:07:20.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.007+0000 7f76ce2f6700 1 -- 172.21.15.8:0/3455370925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c8059100 con 0x7f76c80f77d0 2023-10-18T21:07:20.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.008+0000 7f76bdffb700 1 -- 172.21.15.8:0/3455370925 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f76b800f030 con 0x7f76c80f77d0 2023-10-18T21:07:20.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.009+0000 7f76bdffb700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76b4060f70 0x7f76b4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:20.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.009+0000 7f76bdffb700 1 -- 172.21.15.8:0/3455370925 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6844+0+0 (secure 0 0 0) 0x7f76b807c9d0 con 0x7f76c80f77d0 2023-10-18T21:07:20.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.009+0000 7f76cd2f4700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76b4060f70 0x7f76b4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:20.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.010+0000 7f76cd2f4700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76b4060f70 0x7f76b4063430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f76c80ff760 tx=0x7f76c4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:20.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.014+0000 7f76bdffb700 1 -- 172.21.15.8:0/3455370925 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f76b804c990 con 0x7f76c80f77d0 2023-10-18T21:07:20.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:18.759352+0000 mgr.smithi008.flmjzp (mgr.14640) 474 : audit [DBG] from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:20.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:19.109743+0000 mgr.smithi008.flmjzp (mgr.14640) 475 : audit [DBG] from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:20.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:19.450949+0000 mgr.smithi008.flmjzp (mgr.14640) 476 : audit [DBG] from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:20.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.238+0000 7f76ce2f6700 1 -- 172.21.15.8:0/3455370925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76c80fed40 con 0x7f76c80f77d0 2023-10-18T21:07:20.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.239+0000 7f76bdffb700 1 -- 172.21.15.8:0/3455370925 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 55 v55) v1 ==== 76+0+1585 (secure 0 0 0) 0x7f76b804ffb0 con 0x7f76c80f77d0 2023-10-18T21:07:20.241 INFO:teuthology.orchestra.run.smithi008.stdout:e55 2023-10-18T21:07:20.241 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:07:20.241 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:07:20.241 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:07:20.241 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:07:20.242 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:07:20.242 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:07:20.242 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 55 2023-10-18T21:07:20.242 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:07:20.242 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:07:20.243 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:07:16.711689+0000 2023-10-18T21:07:20.243 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:07:20.243 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:07:20.243 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:07:20.243 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:07:20.244 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:07:20.244 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:07:20.244 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:07:20.244 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 96 2023-10-18T21:07:20.244 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:07:20.245 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:07:20.245 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:07:20.245 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=34530} 2023-10-18T21:07:20.245 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:07:20.245 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:07:20.246 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:07:20.246 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:07:20.246 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:07:20.246 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:07:20.247 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:07:20.247 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:07:20.247 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi008.lehgco{0:34530} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.8:6826/729289097,v1:172.21.15.8:6827/729289097] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:07:20.248 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:07:20.248 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:07:20.248 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:07:20.248 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:07:20.249 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{-1:44477} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6824/3230954720,v1:172.21.15.60:6825/3230954720] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:07:20.249 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{-1:44481} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/532509022,v1:172.21.15.60:6827/532509022] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:07:20.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 -- 172.21.15.8:0/3455370925 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76b4060f70 msgr2=0x7f76b4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:20.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76b4060f70 0x7f76b4063430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f76c80ff760 tx=0x7f76c4009b30).stop 2023-10-18T21:07:20.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 -- 172.21.15.8:0/3455370925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c80f77d0 msgr2=0x7f76c80ffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:20.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c80f77d0 0x7f76c80ffec0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f76b800b410 tx=0x7f76b8006ef0).stop 2023-10-18T21:07:20.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 -- 172.21.15.8:0/3455370925 shutdown_connections 2023-10-18T21:07:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76b4060f70 0x7f76b4063430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c80f6530 0x7f76c80ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 --2- 172.21.15.8:0/3455370925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c80f77d0 0x7f76c80ffec0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 -- 172.21.15.8:0/3455370925 >> 172.21.15.8:0/3455370925 conn(0x7f76c80f1c90 msgr2=0x7f76c80f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:20.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 -- 172.21.15.8:0/3455370925 shutdown_connections 2023-10-18T21:07:20.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.241+0000 7f76ce2f6700 1 -- 172.21.15.8:0/3455370925 wait complete. 2023-10-18T21:07:20.253 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 55 2023-10-18T21:07:20.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.379+0000 7fa5b9a99700 1 -- 172.21.15.8:0/4289291870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5b40f77d0 msgr2=0x7fa5b40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:20.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.379+0000 7fa5b9a99700 1 --2- 172.21.15.8:0/4289291870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5b40f77d0 0x7fa5b40f7c30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fa5a0004660 tx=0x7fa5a0009b30).stop 2023-10-18T21:07:20.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.379+0000 7fa5b9a99700 1 -- 172.21.15.8:0/4289291870 shutdown_connections 2023-10-18T21:07:20.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.379+0000 7fa5b9a99700 1 --2- 172.21.15.8:0/4289291870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5b40f77d0 0x7fa5b40f7c30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.379+0000 7fa5b9a99700 1 --2- 172.21.15.8:0/4289291870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5b40f6530 0x7fa5b40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.379+0000 7fa5b9a99700 1 -- 172.21.15.8:0/4289291870 >> 172.21.15.8:0/4289291870 conn(0x7fa5b40f1c90 msgr2=0x7fa5b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:20.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.379+0000 7fa5b9a99700 1 -- 172.21.15.8:0/4289291870 shutdown_connections 2023-10-18T21:07:20.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.379+0000 7fa5b9a99700 1 -- 172.21.15.8:0/4289291870 wait complete. 2023-10-18T21:07:20.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.380+0000 7fa5b9a99700 1 Processor -- start 2023-10-18T21:07:20.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.380+0000 7fa5b9a99700 1 -- start start 2023-10-18T21:07:20.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.380+0000 7fa5b9a99700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5b40f6530 0x7fa5b406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:20.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.380+0000 7fa5b9a99700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5b40f77d0 0x7fa5b4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:20.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.380+0000 7fa5b9a99700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b406a380 con 0x7fa5b40f77d0 2023-10-18T21:07:20.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.380+0000 7fa5b9a99700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b406a4c0 con 0x7fa5b40f6530 2023-10-18T21:07:20.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.381+0000 7fa5b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5b40f77d0 0x7fa5b4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:20.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.381+0000 7fa5b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5b40f77d0 0x7fa5b4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59626/0 (socket says 172.21.15.8:59626) 2023-10-18T21:07:20.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.381+0000 7fa5b3fff700 1 -- 172.21.15.8:0/805400862 learned_addr learned my addr 172.21.15.8:0/805400862 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:20.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.381+0000 7fa5b8a97700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5b40f6530 0x7fa5b406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:20.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.381+0000 7fa5b3fff700 1 -- 172.21.15.8:0/805400862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5b40f6530 msgr2=0x7fa5b406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:20.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.381+0000 7fa5b3fff700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5b40f6530 0x7fa5b406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.381+0000 7fa5b3fff700 1 -- 172.21.15.8:0/805400862 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0005040 con 0x7fa5b40f77d0 2023-10-18T21:07:20.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.381+0000 7fa5b3fff700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5b40f77d0 0x7fa5b4069e20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fa5a0009f50 tx=0x7fa5a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:20.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.382+0000 7fa5b17fa700 1 -- 172.21.15.8:0/805400862 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a0018070 con 0x7fa5b40f77d0 2023-10-18T21:07:20.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.382+0000 7fa5b17fa700 1 -- 172.21.15.8:0/805400862 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa5a0009630 con 0x7fa5b40f77d0 2023-10-18T21:07:20.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.382+0000 7fa5b9a99700 1 -- 172.21.15.8:0/805400862 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b406a740 con 0x7fa5b40f77d0 2023-10-18T21:07:20.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.382+0000 7fa5b17fa700 1 -- 172.21.15.8:0/805400862 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a001c3c0 con 0x7fa5b40f77d0 2023-10-18T21:07:20.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.382+0000 7fa5b9a99700 1 -- 172.21.15.8:0/805400862 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b406aca0 con 0x7fa5b40f77d0 2023-10-18T21:07:20.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.383+0000 7fa5b9a99700 1 -- 172.21.15.8:0/805400862 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b4045ad0 con 0x7fa5b40f77d0 2023-10-18T21:07:20.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.384+0000 7fa5b17fa700 1 -- 172.21.15.8:0/805400862 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa5a001d420 con 0x7fa5b40f77d0 2023-10-18T21:07:20.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.384+0000 7fa5b17fa700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5a4060f70 0x7fa5a4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:20.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.385+0000 7fa5b17fa700 1 -- 172.21.15.8:0/805400862 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6844+0+0 (secure 0 0 0) 0x7fa5a007e300 con 0x7fa5b40f77d0 2023-10-18T21:07:20.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.385+0000 7fa5b8a97700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5a4060f70 0x7fa5a4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:20.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.385+0000 7fa5b8a97700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5a4060f70 0x7fa5a4063430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa5b406b730 tx=0x7fa5a8009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:20.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.389+0000 7fa5b17fa700 1 -- 172.21.15.8:0/805400862 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa5a004e2c0 con 0x7fa5b40f77d0 2023-10-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.588+0000 7fa5b9a99700 1 -- 172.21.15.8:0/805400862 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5b40fedd0 con 0x7fa5a4060f70 2023-10-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.589+0000 7fa5b17fa700 1 -- 172.21.15.8:0/805400862 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa5b40fedd0 con 0x7fa5a4060f70 2023-10-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 -- 172.21.15.8:0/805400862 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5a4060f70 msgr2=0x7fa5a4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5a4060f70 0x7fa5a4063430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa5b406b730 tx=0x7fa5a8009c00).stop 2023-10-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 -- 172.21.15.8:0/805400862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5b40f77d0 msgr2=0x7fa5b4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5b40f77d0 0x7fa5b4069e20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fa5a0009f50 tx=0x7fa5a0009b30).stop 2023-10-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 -- 172.21.15.8:0/805400862 shutdown_connections 2023-10-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5a4060f70 0x7fa5a4063430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5b40f6530 0x7fa5b406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 --2- 172.21.15.8:0/805400862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5b40f77d0 0x7fa5b4069e20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 -- 172.21.15.8:0/805400862 >> 172.21.15.8:0/805400862 conn(0x7fa5b40f1c90 msgr2=0x7fa5b40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 -- 172.21.15.8:0/805400862 shutdown_connections 2023-10-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:20.592+0000 7fa5b9a99700 1 -- 172.21.15.8:0/805400862 wait complete. 2023-10-18T21:07:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:19.706335+0000 mgr.smithi008.flmjzp (mgr.14640) 477 : cluster [DBG] pgmap v342: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:19.865309+0000 mon.smithi008 (mon.0) 864 : audit [DBG] from='client.? 172.21.15.8:0/1499703859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:20.239489+0000 mon.smithi008 (mon.0) 865 : audit [DBG] from='client.? 172.21.15.8:0/3455370925' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:07:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:20.589805+0000 mgr.smithi008.flmjzp (mgr.14640) 478 : audit [DBG] from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:19.706335+0000 mgr.smithi008.flmjzp (mgr.14640) 477 : cluster [DBG] pgmap v342: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:19.865309+0000 mon.smithi008 (mon.0) 864 : audit [DBG] from='client.? 172.21.15.8:0/1499703859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:20.239489+0000 mon.smithi008 (mon.0) 865 : audit [DBG] from='client.? 172.21.15.8:0/3455370925' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:07:21.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:20.589805+0000 mgr.smithi008.flmjzp (mgr.14640) 478 : audit [DBG] from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:21.706876+0000 mgr.smithi008.flmjzp (mgr.14640) 479 : cluster [DBG] pgmap v343: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:21.706876+0000 mgr.smithi008.flmjzp (mgr.14640) 479 : cluster [DBG] pgmap v343: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:23.707374+0000 mgr.smithi008.flmjzp (mgr.14640) 480 : cluster [DBG] pgmap v344: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:25.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:23.707374+0000 mgr.smithi008.flmjzp (mgr.14640) 480 : cluster [DBG] pgmap v344: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:26.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:25.735563+0000 mon.smithi008 (mon.0) 866 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:26.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:25.738738+0000 mon.smithi008 (mon.0) 867 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:26.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:25.739717+0000 mon.smithi008 (mon.0) 868 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:26.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:25.746239+0000 mon.smithi008 (mon.0) 869 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:26.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:25.754186+0000 mon.smithi008 (mon.0) 870 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:26.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:25.757740+0000 mon.smithi008 (mon.0) 871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:26.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:25.759683+0000 mon.smithi008 (mon.0) 872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:26.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:25.761622+0000 mon.smithi008 (mon.0) 873 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:26.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:25.764252+0000 mon.smithi008 (mon.0) 874 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:25.735563+0000 mon.smithi008 (mon.0) 866 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:25.738738+0000 mon.smithi008 (mon.0) 867 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:25.739717+0000 mon.smithi008 (mon.0) 868 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:25.746239+0000 mon.smithi008 (mon.0) 869 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:25.754186+0000 mon.smithi008 (mon.0) 870 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:25.757740+0000 mon.smithi008 (mon.0) 871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:25.759683+0000 mon.smithi008 (mon.0) 872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:25.761622+0000 mon.smithi008 (mon.0) 873 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:25.764252+0000 mon.smithi008 (mon.0) 874 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:25.707893+0000 mgr.smithi008.flmjzp (mgr.14640) 481 : cluster [DBG] pgmap v345: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:25.740532+0000 mgr.smithi008.flmjzp (mgr.14640) 482 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:25.741128+0000 mgr.smithi008.flmjzp (mgr.14640) 483 : cluster [DBG] pgmap v346: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:25.741363+0000 mgr.smithi008.flmjzp (mgr.14640) 484 : cluster [DBG] pgmap v347: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:25.766498+0000 mgr.smithi008.flmjzp (mgr.14640) 485 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:07:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:25.707893+0000 mgr.smithi008.flmjzp (mgr.14640) 481 : cluster [DBG] pgmap v345: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:25.740532+0000 mgr.smithi008.flmjzp (mgr.14640) 482 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:25.741128+0000 mgr.smithi008.flmjzp (mgr.14640) 483 : cluster [DBG] pgmap v346: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:25.741363+0000 mgr.smithi008.flmjzp (mgr.14640) 484 : cluster [DBG] pgmap v347: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:25.766498+0000 mgr.smithi008.flmjzp (mgr.14640) 485 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:07:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:27.935677+0000 mon.smithi008 (mon.0) 875 : cluster [INF] daemon mds.cephfs.smithi008.lehgco restarted 2023-10-18T21:07:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:27.939569+0000 mon.smithi008 (mon.0) 876 : cluster [DBG] osdmap e97: 6 total, 6 up, 6 in 2023-10-18T21:07:28.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:07:27.942+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:07:28.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:27.935677+0000 mon.smithi008 (mon.0) 875 : cluster [INF] daemon mds.cephfs.smithi008.lehgco restarted 2023-10-18T21:07:28.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:27.939569+0000 mon.smithi008 (mon.0) 876 : cluster [DBG] osdmap e97: 6 total, 6 up, 6 in 2023-10-18T21:07:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:27.742035+0000 mgr.smithi008.flmjzp (mgr.14640) 486 : cluster [DBG] pgmap v348: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:27.943262+0000 mon.smithi008 (mon.0) 877 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:07:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:27.949301+0000 mon.smithi008 (mon.0) 878 : cluster [DBG] mds.? [v2:172.21.15.8:6826/2355735817,v1:172.21.15.8:6827/2355735817] up:boot 2023-10-18T21:07:29.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:27.949342+0000 mon.smithi008 (mon.0) 879 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:07:29.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:27.949438+0000 mon.smithi008 (mon.0) 880 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:07:29.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:27.949681+0000 mon.smithi008 (mon.0) 881 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-10-18T21:07:29.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:27.949790+0000 mon.smithi008 (mon.0) 882 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:07:29.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:27.952368+0000 mon.smithi008 (mon.0) 883 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 2 up:standby 2023-10-18T21:07:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:27.742035+0000 mgr.smithi008.flmjzp (mgr.14640) 486 : cluster [DBG] pgmap v348: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:27.943262+0000 mon.smithi008 (mon.0) 877 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:07:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:27.949301+0000 mon.smithi008 (mon.0) 878 : cluster [DBG] mds.? [v2:172.21.15.8:6826/2355735817,v1:172.21.15.8:6827/2355735817] up:boot 2023-10-18T21:07:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:27.949342+0000 mon.smithi008 (mon.0) 879 : cluster [INF] Standby daemon mds.cephfs.smithi008.lehgco assigned to filesystem cephfs as rank 0 2023-10-18T21:07:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:27.949438+0000 mon.smithi008 (mon.0) 880 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:07:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:27.949681+0000 mon.smithi008 (mon.0) 881 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-10-18T21:07:29.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:27.949790+0000 mon.smithi008 (mon.0) 882 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi008.lehgco"}]: dispatch 2023-10-18T21:07:29.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:27.952368+0000 mon.smithi008 (mon.0) 883 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi008.lehgco=up:replay} 2 up:standby 2023-10-18T21:07:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:29.742738+0000 mgr.smithi008.flmjzp (mgr.14640) 487 : cluster [DBG] pgmap v350: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:29.742738+0000 mgr.smithi008.flmjzp (mgr.14640) 487 : cluster [DBG] pgmap v350: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:31.743249+0000 mgr.smithi008.flmjzp (mgr.14640) 488 : cluster [DBG] pgmap v351: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:31.743249+0000 mgr.smithi008.flmjzp (mgr.14640) 488 : cluster [DBG] pgmap v351: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:33.743739+0000 mgr.smithi008.flmjzp (mgr.14640) 489 : cluster [DBG] pgmap v352: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:33.743739+0000 mgr.smithi008.flmjzp (mgr.14640) 489 : cluster [DBG] pgmap v352: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:35.773567+0000 mon.smithi008 (mon.0) 884 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:35.773567+0000 mon.smithi008 (mon.0) 884 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:35.744217+0000 mgr.smithi008.flmjzp (mgr.14640) 490 : cluster [DBG] pgmap v353: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:36.341166+0000 mon.smithi008 (mon.0) 885 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:36.342039+0000 mon.smithi008 (mon.0) 886 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:36.342726+0000 mgr.smithi008.flmjzp (mgr.14640) 491 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:36.343177+0000 mgr.smithi008.flmjzp (mgr.14640) 492 : cluster [DBG] pgmap v354: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:36.343343+0000 mgr.smithi008.flmjzp (mgr.14640) 493 : cluster [DBG] pgmap v355: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:36.347678+0000 mon.smithi008 (mon.0) 887 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:37.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:36.352615+0000 mon.smithi008 (mon.0) 888 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:37.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:36.355061+0000 mon.smithi008 (mon.0) 889 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:37.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:36.356280+0000 mon.smithi008 (mon.0) 890 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:37.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:36.357520+0000 mon.smithi008 (mon.0) 891 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:37.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:36.359106+0000 mon.smithi008 (mon.0) 892 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:37.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:36.360701+0000 mgr.smithi008.flmjzp (mgr.14640) 494 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:07:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:35.744217+0000 mgr.smithi008.flmjzp (mgr.14640) 490 : cluster [DBG] pgmap v353: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:36.341166+0000 mon.smithi008 (mon.0) 885 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:36.342039+0000 mon.smithi008 (mon.0) 886 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:36.342726+0000 mgr.smithi008.flmjzp (mgr.14640) 491 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:36.343177+0000 mgr.smithi008.flmjzp (mgr.14640) 492 : cluster [DBG] pgmap v354: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:36.343343+0000 mgr.smithi008.flmjzp (mgr.14640) 493 : cluster [DBG] pgmap v355: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:36.347678+0000 mon.smithi008 (mon.0) 887 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:36.352615+0000 mon.smithi008 (mon.0) 888 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:36.355061+0000 mon.smithi008 (mon.0) 889 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:36.356280+0000 mon.smithi008 (mon.0) 890 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:36.357520+0000 mon.smithi008 (mon.0) 891 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:36.359106+0000 mon.smithi008 (mon.0) 892 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:36.360701+0000 mgr.smithi008.flmjzp (mgr.14640) 494 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi008.lehgco to be up:active (currently up:replay) 2023-10-18T21:07:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:38.343773+0000 mgr.smithi008.flmjzp (mgr.14640) 495 : cluster [DBG] pgmap v356: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:38.343773+0000 mgr.smithi008.flmjzp (mgr.14640) 495 : cluster [DBG] pgmap v356: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:41.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:40.344376+0000 mgr.smithi008.flmjzp (mgr.14640) 496 : cluster [DBG] pgmap v357: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:40.344376+0000 mgr.smithi008.flmjzp (mgr.14640) 496 : cluster [DBG] pgmap v357: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:42.344879+0000 mgr.smithi008.flmjzp (mgr.14640) 497 : cluster [DBG] pgmap v358: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:42.344879+0000 mgr.smithi008.flmjzp (mgr.14640) 497 : cluster [DBG] pgmap v358: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:44.345513+0000 mgr.smithi008.flmjzp (mgr.14640) 498 : cluster [DBG] pgmap v359: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:44.936255+0000 mon.smithi008 (mon.0) 893 : cluster [WRN] Replacing daemon mds.cephfs.smithi008.lehgco as rank 0 with standby daemon mds.cephfs.smithi060.grdzlm 2023-10-18T21:07:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:44.936387+0000 mon.smithi008 (mon.0) 894 : cluster [INF] MDS daemon mds.cephfs.smithi008.lehgco is removed because it is dead or otherwise unavailable. 2023-10-18T21:07:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:44.941862+0000 mon.smithi008 (mon.0) 895 : cluster [DBG] osdmap e98: 6 total, 6 up, 6 in 2023-10-18T21:07:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:44.946951+0000 mon.smithi008 (mon.0) 896 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:07:45.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:44.345513+0000 mgr.smithi008.flmjzp (mgr.14640) 498 : cluster [DBG] pgmap v359: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:45.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:44.936255+0000 mon.smithi008 (mon.0) 893 : cluster [WRN] Replacing daemon mds.cephfs.smithi008.lehgco as rank 0 with standby daemon mds.cephfs.smithi060.grdzlm 2023-10-18T21:07:45.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:44.936387+0000 mon.smithi008 (mon.0) 894 : cluster [INF] MDS daemon mds.cephfs.smithi008.lehgco is removed because it is dead or otherwise unavailable. 2023-10-18T21:07:45.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:44.941862+0000 mon.smithi008 (mon.0) 895 : cluster [DBG] osdmap e98: 6 total, 6 up, 6 in 2023-10-18T21:07:45.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:44.946951+0000 mon.smithi008 (mon.0) 896 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:07:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:46.370855+0000 mon.smithi008 (mon.0) 897 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:46.373142+0000 mon.smithi008 (mon.0) 898 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:46.374275+0000 mon.smithi008 (mon.0) 899 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:46.380673+0000 mon.smithi008 (mon.0) 900 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:46.387322+0000 mon.smithi008 (mon.0) 901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:46.390475+0000 mon.smithi008 (mon.0) 902 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:46.392117+0000 mon.smithi008 (mon.0) 903 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:46.393730+0000 mon.smithi008 (mon.0) 904 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:46.395762+0000 mon.smithi008 (mon.0) 905 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:46.370855+0000 mon.smithi008 (mon.0) 897 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:46.373142+0000 mon.smithi008 (mon.0) 898 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:46.374275+0000 mon.smithi008 (mon.0) 899 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:46.380673+0000 mon.smithi008 (mon.0) 900 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:46.387322+0000 mon.smithi008 (mon.0) 901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:46.390475+0000 mon.smithi008 (mon.0) 902 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:46.392117+0000 mon.smithi008 (mon.0) 903 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:46.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:46.393730+0000 mon.smithi008 (mon.0) 904 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:46.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:46.395762+0000 mon.smithi008 (mon.0) 905 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:46.346116+0000 mgr.smithi008.flmjzp (mgr.14640) 499 : cluster [DBG] pgmap v361: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:46.375201+0000 mgr.smithi008.flmjzp (mgr.14640) 500 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:46.375782+0000 mgr.smithi008.flmjzp (mgr.14640) 501 : cluster [DBG] pgmap v362: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:46.375981+0000 mgr.smithi008.flmjzp (mgr.14640) 502 : cluster [DBG] pgmap v363: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:46.397670+0000 mgr.smithi008.flmjzp (mgr.14640) 503 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:07:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:46.346116+0000 mgr.smithi008.flmjzp (mgr.14640) 499 : cluster [DBG] pgmap v361: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:46.375201+0000 mgr.smithi008.flmjzp (mgr.14640) 500 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:46.375782+0000 mgr.smithi008.flmjzp (mgr.14640) 501 : cluster [DBG] pgmap v362: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:46.375981+0000 mgr.smithi008.flmjzp (mgr.14640) 502 : cluster [DBG] pgmap v363: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:46.397670+0000 mgr.smithi008.flmjzp (mgr.14640) 503 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:07:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:48.376368+0000 mgr.smithi008.flmjzp (mgr.14640) 504 : cluster [DBG] pgmap v364: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:48.376368+0000 mgr.smithi008.flmjzp (mgr.14640) 504 : cluster [DBG] pgmap v364: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.746+0000 7fba0759e700 1 -- 172.21.15.8:0/3306240941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba080f6530 msgr2=0x7fba080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.746+0000 7fba0759e700 1 --2- 172.21.15.8:0/3306240941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba080f6530 0x7fba080f6950 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb9f8004660 tx=0x7fb9f8009b30).stop 2023-10-18T21:07:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.746+0000 7fba0759e700 1 -- 172.21.15.8:0/3306240941 shutdown_connections 2023-10-18T21:07:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.746+0000 7fba0759e700 1 --2- 172.21.15.8:0/3306240941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba080f77d0 0x7fba080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.746+0000 7fba0759e700 1 --2- 172.21.15.8:0/3306240941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba080f6530 0x7fba080f6950 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.746+0000 7fba0759e700 1 -- 172.21.15.8:0/3306240941 >> 172.21.15.8:0/3306240941 conn(0x7fba080f1c90 msgr2=0x7fba080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.746+0000 7fba0759e700 1 -- 172.21.15.8:0/3306240941 shutdown_connections 2023-10-18T21:07:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.746+0000 7fba0759e700 1 -- 172.21.15.8:0/3306240941 wait complete. 2023-10-18T21:07:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.747+0000 7fba0759e700 1 Processor -- start 2023-10-18T21:07:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.747+0000 7fba0759e700 1 -- start start 2023-10-18T21:07:50.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.747+0000 7fba0759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba080f6530 0x7fba08108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:50.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.747+0000 7fba0759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba080f77d0 0x7fba081094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:50.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.747+0000 7fba0759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba08109a70 con 0x7fba080f6530 2023-10-18T21:07:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.747+0000 7fba0759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba08109bb0 con 0x7fba080f77d0 2023-10-18T21:07:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.748+0000 7fba0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba080f6530 0x7fba08108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.748+0000 7fba0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba080f6530 0x7fba08108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57996/0 (socket says 172.21.15.8:57996) 2023-10-18T21:07:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.748+0000 7fba0659c700 1 -- 172.21.15.8:0/2077699458 learned_addr learned my addr 172.21.15.8:0/2077699458 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.748+0000 7fba05d9b700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba080f77d0 0x7fba081094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.748+0000 7fba0659c700 1 -- 172.21.15.8:0/2077699458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba080f77d0 msgr2=0x7fba081094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.748+0000 7fba0659c700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba080f77d0 0x7fba081094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.748+0000 7fba0659c700 1 -- 172.21.15.8:0/2077699458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f8005040 con 0x7fba080f6530 2023-10-18T21:07:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.748+0000 7fba05d9b700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba080f77d0 0x7fba081094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:07:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.748+0000 7fba0659c700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba080f6530 0x7fba08108fd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb9f8004e30 tx=0x7fb9f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.749+0000 7fb9f6ffd700 1 -- 172.21.15.8:0/2077699458 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f8018070 con 0x7fba080f6530 2023-10-18T21:07:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.749+0000 7fb9f6ffd700 1 -- 172.21.15.8:0/2077699458 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb9f8009630 con 0x7fba080f6530 2023-10-18T21:07:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.749+0000 7fb9f6ffd700 1 -- 172.21.15.8:0/2077699458 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f801c3c0 con 0x7fba080f6530 2023-10-18T21:07:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.749+0000 7fba0759e700 1 -- 172.21.15.8:0/2077699458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0810a4f0 con 0x7fba080f6530 2023-10-18T21:07:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.749+0000 7fba0759e700 1 -- 172.21.15.8:0/2077699458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0810aa50 con 0x7fba080f6530 2023-10-18T21:07:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.750+0000 7fba0759e700 1 -- 172.21.15.8:0/2077699458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba08045ad0 con 0x7fba080f6530 2023-10-18T21:07:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.751+0000 7fb9f6ffd700 1 -- 172.21.15.8:0/2077699458 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb9f801d420 con 0x7fba080f6530 2023-10-18T21:07:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.752+0000 7fb9f6ffd700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb9f0060f70 0x7fb9f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.752+0000 7fb9f6ffd700 1 -- 172.21.15.8:0/2077699458 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7016+0+0 (secure 0 0 0) 0x7fb9f807e350 con 0x7fba080f6530 2023-10-18T21:07:50.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.752+0000 7fba05d9b700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb9f0060f70 0x7fb9f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:50.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.752+0000 7fba05d9b700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb9f0060f70 0x7fb9f0063430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fb9fc009740 tx=0x7fb9fc009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:50.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.756+0000 7fb9f6ffd700 1 -- 172.21.15.8:0/2077699458 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb9f8051d40 con 0x7fba080f6530 2023-10-18T21:07:50.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.956+0000 7fba0759e700 1 -- 172.21.15.8:0/2077699458 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba080008d0 con 0x7fb9f0060f70 2023-10-18T21:07:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.958+0000 7fb9f6ffd700 1 -- 172.21.15.8:0/2077699458 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fba080008d0 con 0x7fb9f0060f70 2023-10-18T21:07:50.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 -- 172.21.15.8:0/2077699458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb9f0060f70 msgr2=0x7fb9f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:50.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb9f0060f70 0x7fb9f0063430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fb9fc009740 tx=0x7fb9fc009be0).stop 2023-10-18T21:07:50.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 -- 172.21.15.8:0/2077699458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba080f6530 msgr2=0x7fba08108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba080f6530 0x7fba08108fd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb9f8004e30 tx=0x7fb9f8009b30).stop 2023-10-18T21:07:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 -- 172.21.15.8:0/2077699458 shutdown_connections 2023-10-18T21:07:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb9f0060f70 0x7fb9f0063430 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba080f6530 0x7fba08108fd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 --2- 172.21.15.8:0/2077699458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba080f77d0 0x7fba081094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:50.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 -- 172.21.15.8:0/2077699458 >> 172.21.15.8:0/2077699458 conn(0x7fba080f1c90 msgr2=0x7fba0806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:50.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 -- 172.21.15.8:0/2077699458 shutdown_connections 2023-10-18T21:07:50.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:50.960+0000 7fba0759e700 1 -- 172.21.15.8:0/2077699458 wait complete. 2023-10-18T21:07:50.977 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:07:51.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.097+0000 7f81a50b5700 1 -- 172.21.15.8:0/1217571330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a00f96f0 msgr2=0x7f81a00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:51.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.097+0000 7f81a50b5700 1 --2- 172.21.15.8:0/1217571330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a00f96f0 0x7f81a00fbae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f8194004660 tx=0x7f8194009b30).stop 2023-10-18T21:07:51.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.097+0000 7f81a50b5700 1 -- 172.21.15.8:0/1217571330 shutdown_connections 2023-10-18T21:07:51.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.097+0000 7f81a50b5700 1 --2- 172.21.15.8:0/1217571330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a00f96f0 0x7f81a00fbae0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.097+0000 7f81a50b5700 1 --2- 172.21.15.8:0/1217571330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a00602b0 0x7f81a00f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.097+0000 7f81a50b5700 1 -- 172.21.15.8:0/1217571330 >> 172.21.15.8:0/1217571330 conn(0x7f81a00f0b90 msgr2=0x7f81a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:51.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.097+0000 7f81a50b5700 1 -- 172.21.15.8:0/1217571330 shutdown_connections 2023-10-18T21:07:51.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.097+0000 7f81a50b5700 1 -- 172.21.15.8:0/1217571330 wait complete. 2023-10-18T21:07:51.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.098+0000 7f81a50b5700 1 Processor -- start 2023-10-18T21:07:51.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.098+0000 7f81a50b5700 1 -- start start 2023-10-18T21:07:51.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f81a50b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a00602b0 0x7f81a0106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:51.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f81a50b5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a00f96f0 0x7f81a0107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:51.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f81a50b5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a0107890 con 0x7f81a00f96f0 2023-10-18T21:07:51.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f81a50b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a01080d0 con 0x7f81a00602b0 2023-10-18T21:07:51.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f819f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a00f96f0 0x7f81a0107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:51.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f819f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a00f96f0 0x7f81a0107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58004/0 (socket says 172.21.15.8:58004) 2023-10-18T21:07:51.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f819f7fe700 1 -- 172.21.15.8:0/3315783272 learned_addr learned my addr 172.21.15.8:0/3315783272 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:51.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f819ffff700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a00602b0 0x7f81a0106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:51.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f819f7fe700 1 -- 172.21.15.8:0/3315783272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a00602b0 msgr2=0x7f81a0106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:51.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f819f7fe700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a00602b0 0x7f81a0106da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.099+0000 7f819f7fe700 1 -- 172.21.15.8:0/3315783272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8194005040 con 0x7f81a00f96f0 2023-10-18T21:07:51.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.100+0000 7f819f7fe700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a00f96f0 0x7f81a0107290 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8194004e30 tx=0x7f8194009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:51.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.100+0000 7f819cff9700 1 -- 172.21.15.8:0/3315783272 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8194018070 con 0x7f81a00f96f0 2023-10-18T21:07:51.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.100+0000 7f819cff9700 1 -- 172.21.15.8:0/3315783272 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8194009630 con 0x7f81a00f96f0 2023-10-18T21:07:51.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.100+0000 7f81a50b5700 1 -- 172.21.15.8:0/3315783272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a0108350 con 0x7f81a00f96f0 2023-10-18T21:07:51.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.100+0000 7f819cff9700 1 -- 172.21.15.8:0/3315783272 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f819401c3c0 con 0x7f81a00f96f0 2023-10-18T21:07:51.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.100+0000 7f81a50b5700 1 -- 172.21.15.8:0/3315783272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a0108830 con 0x7f81a00f96f0 2023-10-18T21:07:51.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.101+0000 7f81a50b5700 1 -- 172.21.15.8:0/3315783272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a0059100 con 0x7f81a00f96f0 2023-10-18T21:07:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.102+0000 7f819cff9700 1 -- 172.21.15.8:0/3315783272 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f819401d420 con 0x7f81a00f96f0 2023-10-18T21:07:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.103+0000 7f819cff9700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8188060f70 0x7f8188063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.103+0000 7f819cff9700 1 -- 172.21.15.8:0/3315783272 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7016+0+0 (secure 0 0 0) 0x7f819407e1e0 con 0x7f81a00f96f0 2023-10-18T21:07:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.103+0000 7f819ffff700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8188060f70 0x7f8188063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.104+0000 7f819ffff700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8188060f70 0x7f8188063430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f81a0107b60 tx=0x7f8190009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.107+0000 7f819cff9700 1 -- 172.21.15.8:0/3315783272 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f819404e220 con 0x7f81a00f96f0 2023-10-18T21:07:51.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:50.376841+0000 mgr.smithi008.flmjzp (mgr.14640) 505 : cluster [DBG] pgmap v365: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:51.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.305+0000 7f81a50b5700 1 -- 172.21.15.8:0/3315783272 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81a00008d0 con 0x7f8188060f70 2023-10-18T21:07:51.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.306+0000 7f819cff9700 1 -- 172.21.15.8:0/3315783272 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f81a00008d0 con 0x7f8188060f70 2023-10-18T21:07:51.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 -- 172.21.15.8:0/3315783272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8188060f70 msgr2=0x7f8188063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:51.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8188060f70 0x7f8188063430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f81a0107b60 tx=0x7f8190009be0).stop 2023-10-18T21:07:51.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 -- 172.21.15.8:0/3315783272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a00f96f0 msgr2=0x7f81a0107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:51.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a00f96f0 0x7f81a0107290 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8194004e30 tx=0x7f8194009b30).stop 2023-10-18T21:07:51.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 -- 172.21.15.8:0/3315783272 shutdown_connections 2023-10-18T21:07:51.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8188060f70 0x7f8188063430 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a00602b0 0x7f81a0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 --2- 172.21.15.8:0/3315783272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a00f96f0 0x7f81a0107290 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 -- 172.21.15.8:0/3315783272 >> 172.21.15.8:0/3315783272 conn(0x7f81a00f0b90 msgr2=0x7f81a00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:51.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 -- 172.21.15.8:0/3315783272 shutdown_connections 2023-10-18T21:07:51.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.309+0000 7f81a50b5700 1 -- 172.21.15.8:0/3315783272 wait complete. 2023-10-18T21:07:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:50.376841+0000 mgr.smithi008.flmjzp (mgr.14640) 505 : cluster [DBG] pgmap v365: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:51.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.447+0000 7f286d7b6700 1 -- 172.21.15.8:0/2567866168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28680f6530 msgr2=0x7f28680f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:51.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.447+0000 7f286d7b6700 1 --2- 172.21.15.8:0/2567866168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28680f6530 0x7f28680f6950 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f2858004660 tx=0x7f2858009b30).stop 2023-10-18T21:07:51.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.447+0000 7f286d7b6700 1 -- 172.21.15.8:0/2567866168 shutdown_connections 2023-10-18T21:07:51.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.447+0000 7f286d7b6700 1 --2- 172.21.15.8:0/2567866168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680f77d0 0x7f28680f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.447+0000 7f286d7b6700 1 --2- 172.21.15.8:0/2567866168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28680f6530 0x7f28680f6950 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.447+0000 7f286d7b6700 1 -- 172.21.15.8:0/2567866168 >> 172.21.15.8:0/2567866168 conn(0x7f28680f1c90 msgr2=0x7f28680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:51.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.447+0000 7f286d7b6700 1 -- 172.21.15.8:0/2567866168 shutdown_connections 2023-10-18T21:07:51.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.447+0000 7f286d7b6700 1 -- 172.21.15.8:0/2567866168 wait complete. 2023-10-18T21:07:51.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.448+0000 7f286d7b6700 1 Processor -- start 2023-10-18T21:07:51.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.448+0000 7f286d7b6700 1 -- start start 2023-10-18T21:07:51.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.448+0000 7f286d7b6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28680f6530 0x7f2868108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:51.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.448+0000 7f286d7b6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680f77d0 0x7f2868109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:51.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.448+0000 7f286d7b6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28681099f0 con 0x7f28680f6530 2023-10-18T21:07:51.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.448+0000 7f286d7b6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2868109b30 con 0x7f28680f77d0 2023-10-18T21:07:51.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f2867fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28680f6530 0x7f2868108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f2867fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28680f6530 0x7f2868108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58022/0 (socket says 172.21.15.8:58022) 2023-10-18T21:07:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f2867fff700 1 -- 172.21.15.8:0/811801764 learned_addr learned my addr 172.21.15.8:0/811801764 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f2867fff700 1 -- 172.21.15.8:0/811801764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680f77d0 msgr2=0x7f2868109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f28677fe700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680f77d0 0x7f2868109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f2867fff700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680f77d0 0x7f2868109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f2867fff700 1 -- 172.21.15.8:0/811801764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2858005040 con 0x7f28680f6530 2023-10-18T21:07:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f28677fe700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680f77d0 0x7f2868109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:07:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f2867fff700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28680f6530 0x7f2868108f50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f2858007a60 tx=0x7f2858009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f2864ff9700 1 -- 172.21.15.8:0/811801764 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2858018070 con 0x7f28680f6530 2023-10-18T21:07:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f2864ff9700 1 -- 172.21.15.8:0/811801764 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2858009630 con 0x7f28680f6530 2023-10-18T21:07:51.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f2864ff9700 1 -- 172.21.15.8:0/811801764 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f285801c540 con 0x7f28680f6530 2023-10-18T21:07:51.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.449+0000 7f286d7b6700 1 -- 172.21.15.8:0/811801764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286810a470 con 0x7f28680f6530 2023-10-18T21:07:51.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.450+0000 7f286d7b6700 1 -- 172.21.15.8:0/811801764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286810a980 con 0x7f28680f6530 2023-10-18T21:07:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.451+0000 7f286d7b6700 1 -- 172.21.15.8:0/811801764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2868045ad0 con 0x7f28680f6530 2023-10-18T21:07:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.451+0000 7f2864ff9700 1 -- 172.21.15.8:0/811801764 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f285801c7b0 con 0x7f28680f6530 2023-10-18T21:07:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.453+0000 7f2864ff9700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 0x7f2850063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.453+0000 7f2864ff9700 1 -- 172.21.15.8:0/811801764 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7016+0+0 (secure 0 0 0) 0x7f285807e3f0 con 0x7f28680f6530 2023-10-18T21:07:51.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.453+0000 7f28677fe700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 0x7f2850063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:51.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.454+0000 7f28677fe700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 0x7f2850063430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f285c009fd0 tx=0x7f285c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:51.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.457+0000 7f2864ff9700 1 -- 172.21.15.8:0/811801764 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2858051d30 con 0x7f28680f6530 2023-10-18T21:07:51.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.650+0000 7f286d7b6700 1 -- 172.21.15.8:0/811801764 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f28680fee30 con 0x7f2850060f70 2023-10-18T21:07:51.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.659+0000 7f2864ff9700 1 -- 172.21.15.8:0/811801764 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f28680fee30 con 0x7f2850060f70 2023-10-18T21:07:51.662 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:07:51.662 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (14m) 2m ago 16m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:07:51.662 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (8m) 2m ago 15m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:07:51.662 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (8m) 35s ago 15m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:07:51.663 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (14m) 2m ago 15m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:07:51.663 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (2m) 2m ago 12m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:07:51.663 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 11m - - 2023-10-18T21:07:51.663 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (52s) 35s ago 11m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:07:51.663 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (38s) 35s ago 11m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:07:51.664 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (9m) 2m ago 17m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:07:51.664 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (9m) 35s ago 15m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:07:51.664 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (8m) 2m ago 17m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:07:51.664 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (8m) 35s ago 15m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:07:51.664 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (15m) 2m ago 15m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:07:51.665 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (14m) 35s ago 14m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:07:51.665 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (8m) 2m ago 14m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:07:51.665 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (6m) 2m ago 14m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:07:51.665 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (5m) 2m ago 13m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:07:51.665 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (5m) 35s ago 13m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:07:51.665 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (4m) 35s ago 13m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:07:51.666 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (4m) 35s ago 13m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:07:51.666 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (10m) 2m ago 15m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:07:51.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.661+0000 7f286d7b6700 1 -- 172.21.15.8:0/811801764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 msgr2=0x7f2850063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:51.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.661+0000 7f286d7b6700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 0x7f2850063430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f285c009fd0 tx=0x7f285c00b040).stop 2023-10-18T21:07:51.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.661+0000 7f286d7b6700 1 -- 172.21.15.8:0/811801764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28680f6530 msgr2=0x7f2868108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:51.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.661+0000 7f286d7b6700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28680f6530 0x7f2868108f50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f2858007a60 tx=0x7f2858009b30).stop 2023-10-18T21:07:51.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.661+0000 7f286d7b6700 1 -- 172.21.15.8:0/811801764 shutdown_connections 2023-10-18T21:07:51.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.661+0000 7f286d7b6700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 0x7f2850063430 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.661+0000 7f286d7b6700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28680f6530 0x7f2868108f50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.661+0000 7f286d7b6700 1 --2- 172.21.15.8:0/811801764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680f77d0 0x7f2868109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.661+0000 7f286d7b6700 1 -- 172.21.15.8:0/811801764 >> 172.21.15.8:0/811801764 conn(0x7f28680f1c90 msgr2=0x7f28680f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:51.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.662+0000 7f286d7b6700 1 -- 172.21.15.8:0/811801764 shutdown_connections 2023-10-18T21:07:51.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.662+0000 7f286d7b6700 1 -- 172.21.15.8:0/811801764 wait complete. 2023-10-18T21:07:51.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.797+0000 7f65871d9700 1 -- 172.21.15.8:0/53241236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65800f6530 msgr2=0x7f65800f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:51.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.797+0000 7f65871d9700 1 --2- 172.21.15.8:0/53241236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65800f6530 0x7f65800f6950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f657c004660 tx=0x7f657c009b30).stop 2023-10-18T21:07:51.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.797+0000 7f65871d9700 1 -- 172.21.15.8:0/53241236 shutdown_connections 2023-10-18T21:07:51.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.797+0000 7f65871d9700 1 --2- 172.21.15.8:0/53241236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65800f77d0 0x7f65800f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.797+0000 7f65871d9700 1 --2- 172.21.15.8:0/53241236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65800f6530 0x7f65800f6950 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.797+0000 7f65871d9700 1 -- 172.21.15.8:0/53241236 >> 172.21.15.8:0/53241236 conn(0x7f65800f1c90 msgr2=0x7f65800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:51.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.798+0000 7f65871d9700 1 -- 172.21.15.8:0/53241236 shutdown_connections 2023-10-18T21:07:51.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.798+0000 7f65871d9700 1 -- 172.21.15.8:0/53241236 wait complete. 2023-10-18T21:07:51.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.799+0000 7f65871d9700 1 Processor -- start 2023-10-18T21:07:51.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.799+0000 7f65871d9700 1 -- start start 2023-10-18T21:07:51.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.799+0000 7f65871d9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65800f6530 0x7f6580106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:51.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65871d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65800f77d0 0x7f6580107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:51.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65871d9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6580107870 con 0x7f65800f77d0 2023-10-18T21:07:51.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65871d9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65801080b0 con 0x7f65800f6530 2023-10-18T21:07:51.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65859d6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65800f77d0 0x7f6580107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:51.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65859d6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65800f77d0 0x7f6580107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58030/0 (socket says 172.21.15.8:58030) 2023-10-18T21:07:51.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65859d6700 1 -- 172.21.15.8:0/1635068304 learned_addr learned my addr 172.21.15.8:0/1635068304 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:51.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65861d7700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65800f6530 0x7f6580106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:51.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65859d6700 1 -- 172.21.15.8:0/1635068304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65800f6530 msgr2=0x7f6580106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:51.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65859d6700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65800f6530 0x7f6580106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:51.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65859d6700 1 -- 172.21.15.8:0/1635068304 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c005040 con 0x7f65800f77d0 2023-10-18T21:07:51.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65861d7700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65800f6530 0x7f6580106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:07:51.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.800+0000 7f65859d6700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65800f77d0 0x7f6580107270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f657000e7f0 tx=0x7f657000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:51.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.801+0000 7f6576ffd700 1 -- 172.21.15.8:0/1635068304 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65700092e0 con 0x7f65800f77d0 2023-10-18T21:07:51.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.801+0000 7f6576ffd700 1 -- 172.21.15.8:0/1635068304 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f657000f040 con 0x7f65800f77d0 2023-10-18T21:07:51.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.801+0000 7f65871d9700 1 -- 172.21.15.8:0/1635068304 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6580108390 con 0x7f65800f77d0 2023-10-18T21:07:51.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.801+0000 7f6576ffd700 1 -- 172.21.15.8:0/1635068304 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65700147e0 con 0x7f65800f77d0 2023-10-18T21:07:51.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.801+0000 7f65871d9700 1 -- 172.21.15.8:0/1635068304 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65801088d0 con 0x7f65800f77d0 2023-10-18T21:07:51.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.802+0000 7f65871d9700 1 -- 172.21.15.8:0/1635068304 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6580059100 con 0x7f65800f77d0 2023-10-18T21:07:51.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.803+0000 7f6576ffd700 1 -- 172.21.15.8:0/1635068304 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f657001b030 con 0x7f65800f77d0 2023-10-18T21:07:51.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.804+0000 7f6576ffd700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f656c060f70 0x7f656c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:51.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.804+0000 7f6576ffd700 1 -- 172.21.15.8:0/1635068304 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7016+0+0 (secure 0 0 0) 0x7f657007c3e0 con 0x7f65800f77d0 2023-10-18T21:07:51.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.804+0000 7f65861d7700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f656c060f70 0x7f656c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:51.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.805+0000 7f65861d7700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f656c060f70 0x7f656c063430 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f657c004d80 tx=0x7f657c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:51.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:51.808+0000 7f6576ffd700 1 -- 172.21.15.8:0/1635068304 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f657004c340 con 0x7f65800f77d0 2023-10-18T21:07:52.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.065+0000 7f65871d9700 1 -- 172.21.15.8:0/1635068304 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f65800fecc0 con 0x7f65800f77d0 2023-10-18T21:07:52.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.065+0000 7f6576ffd700 1 -- 172.21.15.8:0/1635068304 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f65700192a0 con 0x7f65800f77d0 2023-10-18T21:07:52.068 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:07:52.068 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:07:52.068 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:07:52.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:07:52.069 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:07:52.069 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:07:52.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:07:52.069 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:07:52.069 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:07:52.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:07:52.070 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:07:52.070 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:07:52.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:07:52.071 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:07:52.071 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 12 2023-10-18T21:07:52.071 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:07:52.071 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:07:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.067+0000 7f65871d9700 1 -- 172.21.15.8:0/1635068304 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f656c060f70 msgr2=0x7f656c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.067+0000 7f65871d9700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f656c060f70 0x7f656c063430 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f657c004d80 tx=0x7f657c00b040).stop 2023-10-18T21:07:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.067+0000 7f65871d9700 1 -- 172.21.15.8:0/1635068304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65800f77d0 msgr2=0x7f6580107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.067+0000 7f65871d9700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65800f77d0 0x7f6580107270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f657000e7f0 tx=0x7f657000b040).stop 2023-10-18T21:07:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.067+0000 7f65871d9700 1 -- 172.21.15.8:0/1635068304 shutdown_connections 2023-10-18T21:07:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.067+0000 7f65871d9700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f656c060f70 0x7f656c063430 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.067+0000 7f65871d9700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65800f6530 0x7f6580106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.067+0000 7f65871d9700 1 --2- 172.21.15.8:0/1635068304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65800f77d0 0x7f6580107270 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.067+0000 7f65871d9700 1 -- 172.21.15.8:0/1635068304 >> 172.21.15.8:0/1635068304 conn(0x7f65800f1c90 msgr2=0x7f65800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.068+0000 7f65871d9700 1 -- 172.21.15.8:0/1635068304 shutdown_connections 2023-10-18T21:07:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.068+0000 7f65871d9700 1 -- 172.21.15.8:0/1635068304 wait complete. 2023-10-18T21:07:52.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.204+0000 7fbe3273e700 1 -- 172.21.15.8:0/3433427867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe2c0f77d0 msgr2=0x7fbe2c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:52.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.204+0000 7fbe3273e700 1 --2- 172.21.15.8:0/3433427867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe2c0f77d0 0x7fbe2c0f7c30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fbe1c004660 tx=0x7fbe1c009b30).stop 2023-10-18T21:07:52.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.204+0000 7fbe3273e700 1 -- 172.21.15.8:0/3433427867 shutdown_connections 2023-10-18T21:07:52.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.204+0000 7fbe3273e700 1 --2- 172.21.15.8:0/3433427867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe2c0f77d0 0x7fbe2c0f7c30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.204+0000 7fbe3273e700 1 --2- 172.21.15.8:0/3433427867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe2c0f6530 0x7fbe2c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.204+0000 7fbe3273e700 1 -- 172.21.15.8:0/3433427867 >> 172.21.15.8:0/3433427867 conn(0x7fbe2c0f1c90 msgr2=0x7fbe2c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:52.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.204+0000 7fbe3273e700 1 -- 172.21.15.8:0/3433427867 shutdown_connections 2023-10-18T21:07:52.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.204+0000 7fbe3273e700 1 -- 172.21.15.8:0/3433427867 wait complete. 2023-10-18T21:07:52.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.205+0000 7fbe3273e700 1 Processor -- start 2023-10-18T21:07:52.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.205+0000 7fbe3273e700 1 -- start start 2023-10-18T21:07:52.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe3273e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe2c0f6530 0x7fbe2c106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:52.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe3273e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe2c0f77d0 0x7fbe2c107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:52.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe3273e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c107850 con 0x7fbe2c0f6530 2023-10-18T21:07:52.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe3273e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c108060 con 0x7fbe2c0f77d0 2023-10-18T21:07:52.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe3173c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe2c0f6530 0x7fbe2c106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:52.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe3173c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe2c0f6530 0x7fbe2c106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58058/0 (socket says 172.21.15.8:58058) 2023-10-18T21:07:52.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe3173c700 1 -- 172.21.15.8:0/1263269146 learned_addr learned my addr 172.21.15.8:0/1263269146 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:52.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe30f3b700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe2c0f77d0 0x7fbe2c107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:52.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe3173c700 1 -- 172.21.15.8:0/1263269146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe2c0f77d0 msgr2=0x7fbe2c107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:52.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe3173c700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe2c0f77d0 0x7fbe2c107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.206+0000 7fbe3173c700 1 -- 172.21.15.8:0/1263269146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c005040 con 0x7fbe2c0f6530 2023-10-18T21:07:52.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.207+0000 7fbe3173c700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe2c0f6530 0x7fbe2c106d60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fbe2800e7c0 tx=0x7fbe2800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:52.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.207+0000 7fbe21ffb700 1 -- 172.21.15.8:0/1263269146 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe280092e0 con 0x7fbe2c0f6530 2023-10-18T21:07:52.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.207+0000 7fbe21ffb700 1 -- 172.21.15.8:0/1263269146 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbe2800f040 con 0x7fbe2c0f6530 2023-10-18T21:07:52.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.207+0000 7fbe3273e700 1 -- 172.21.15.8:0/1263269146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c1082e0 con 0x7fbe2c0f6530 2023-10-18T21:07:52.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.207+0000 7fbe21ffb700 1 -- 172.21.15.8:0/1263269146 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe280147e0 con 0x7fbe2c0f6530 2023-10-18T21:07:52.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.207+0000 7fbe3273e700 1 -- 172.21.15.8:0/1263269146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c108820 con 0x7fbe2c0f6530 2023-10-18T21:07:52.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.208+0000 7fbe3273e700 1 -- 172.21.15.8:0/1263269146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c059100 con 0x7fbe2c0f6530 2023-10-18T21:07:52.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.209+0000 7fbe21ffb700 1 -- 172.21.15.8:0/1263269146 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbe2801b030 con 0x7fbe2c0f6530 2023-10-18T21:07:52.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.210+0000 7fbe21ffb700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe18060f70 0x7fbe18063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:52.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.210+0000 7fbe21ffb700 1 -- 172.21.15.8:0/1263269146 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7016+0+0 (secure 0 0 0) 0x7fbe2807c650 con 0x7fbe2c0f6530 2023-10-18T21:07:52.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.210+0000 7fbe30f3b700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe18060f70 0x7fbe18063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:52.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.211+0000 7fbe30f3b700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe18060f70 0x7fbe18063430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fbe1c0043d0 tx=0x7fbe1c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:52.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.214+0000 7fbe21ffb700 1 -- 172.21.15.8:0/1263269146 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbe2804c620 con 0x7fbe2c0f6530 2023-10-18T21:07:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:50.959096+0000 mgr.smithi008.flmjzp (mgr.14640) 506 : audit [DBG] from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:51.307862+0000 mgr.smithi008.flmjzp (mgr.14640) 507 : audit [DBG] from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:51.652290+0000 mgr.smithi008.flmjzp (mgr.14640) 508 : audit [DBG] from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:50.959096+0000 mgr.smithi008.flmjzp (mgr.14640) 506 : audit [DBG] from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:51.307862+0000 mgr.smithi008.flmjzp (mgr.14640) 507 : audit [DBG] from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:51.652290+0000 mgr.smithi008.flmjzp (mgr.14640) 508 : audit [DBG] from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:52.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.441+0000 7fbe3273e700 1 -- 172.21.15.8:0/1263269146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbe2c0fed60 con 0x7fbe2c0f6530 2023-10-18T21:07:52.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.442+0000 7fbe21ffb700 1 -- 172.21.15.8:0/1263269146 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 58 v58) v1 ==== 76+0+1413 (secure 0 0 0) 0x7fbe280195a0 con 0x7fbe2c0f6530 2023-10-18T21:07:52.444 INFO:teuthology.orchestra.run.smithi008.stdout:e58 2023-10-18T21:07:52.444 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:07:52.445 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:07:52.445 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:07:52.445 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:07:52.445 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:07:52.445 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:07:52.446 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 58 2023-10-18T21:07:52.446 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:07:52.446 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:07:52.446 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:07:44.937039+0000 2023-10-18T21:07:52.446 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:07:52.447 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:07:52.447 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:07:52.447 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:07:52.447 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:07:52.447 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:07:52.448 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:07:52.448 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 98 2023-10-18T21:07:52.448 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:07:52.448 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:07:52.448 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:07:52.449 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44477} 2023-10-18T21:07:52.449 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:07:52.449 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:07:52.449 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:07:52.449 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:07:52.449 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:07:52.450 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:07:52.450 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:07:52.450 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:07:52.450 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{0:44477} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.60:6824/3230954720,v1:172.21.15.60:6825/3230954720] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:07:52.450 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:07:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:07:52.451 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:07:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:07:52.451 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{-1:44481} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/532509022,v1:172.21.15.60:6827/532509022] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:07:52.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 -- 172.21.15.8:0/1263269146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe18060f70 msgr2=0x7fbe18063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:52.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe18060f70 0x7fbe18063430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fbe1c0043d0 tx=0x7fbe1c00b040).stop 2023-10-18T21:07:52.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 -- 172.21.15.8:0/1263269146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe2c0f6530 msgr2=0x7fbe2c106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:52.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe2c0f6530 0x7fbe2c106d60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fbe2800e7c0 tx=0x7fbe2800b040).stop 2023-10-18T21:07:52.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 -- 172.21.15.8:0/1263269146 shutdown_connections 2023-10-18T21:07:52.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe18060f70 0x7fbe18063430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe2c0f6530 0x7fbe2c106d60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 --2- 172.21.15.8:0/1263269146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe2c0f77d0 0x7fbe2c107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 -- 172.21.15.8:0/1263269146 >> 172.21.15.8:0/1263269146 conn(0x7fbe2c0f1c90 msgr2=0x7fbe2c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:52.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 -- 172.21.15.8:0/1263269146 shutdown_connections 2023-10-18T21:07:52.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.444+0000 7fbe3273e700 1 -- 172.21.15.8:0/1263269146 wait complete. 2023-10-18T21:07:52.454 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 58 2023-10-18T21:07:52.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.582+0000 7fbd7359e700 1 -- 172.21.15.8:0/2590571343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd740f6530 msgr2=0x7fbd740f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:52.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.582+0000 7fbd7359e700 1 --2- 172.21.15.8:0/2590571343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd740f6530 0x7fbd740f6950 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fbd64004660 tx=0x7fbd64009b30).stop 2023-10-18T21:07:52.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.582+0000 7fbd7359e700 1 -- 172.21.15.8:0/2590571343 shutdown_connections 2023-10-18T21:07:52.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.582+0000 7fbd7359e700 1 --2- 172.21.15.8:0/2590571343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd740f77d0 0x7fbd740f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.583+0000 7fbd7359e700 1 --2- 172.21.15.8:0/2590571343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd740f6530 0x7fbd740f6950 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.583+0000 7fbd7359e700 1 -- 172.21.15.8:0/2590571343 >> 172.21.15.8:0/2590571343 conn(0x7fbd740f1c90 msgr2=0x7fbd740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:52.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.583+0000 7fbd7359e700 1 -- 172.21.15.8:0/2590571343 shutdown_connections 2023-10-18T21:07:52.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.583+0000 7fbd7359e700 1 -- 172.21.15.8:0/2590571343 wait complete. 2023-10-18T21:07:52.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.583+0000 7fbd7359e700 1 Processor -- start 2023-10-18T21:07:52.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.584+0000 7fbd7359e700 1 -- start start 2023-10-18T21:07:52.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.584+0000 7fbd7359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd740f6530 0x7fbd74108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:52.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.584+0000 7fbd7359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd740f77d0 0x7fbd74109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.584+0000 7fbd7359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74109a00 con 0x7fbd740f6530 2023-10-18T21:07:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.584+0000 7fbd7359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74109b40 con 0x7fbd740f77d0 2023-10-18T21:07:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.584+0000 7fbd7259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd740f6530 0x7fbd74108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.584+0000 7fbd7259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd740f6530 0x7fbd74108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58080/0 (socket says 172.21.15.8:58080) 2023-10-18T21:07:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.584+0000 7fbd7259c700 1 -- 172.21.15.8:0/862366492 learned_addr learned my addr 172.21.15.8:0/862366492 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:07:52.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.584+0000 7fbd71d9b700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd740f77d0 0x7fbd74109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:52.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.585+0000 7fbd7259c700 1 -- 172.21.15.8:0/862366492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd740f77d0 msgr2=0x7fbd74109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:52.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.585+0000 7fbd7259c700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd740f77d0 0x7fbd74109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.585+0000 7fbd7259c700 1 -- 172.21.15.8:0/862366492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd64005040 con 0x7fbd740f6530 2023-10-18T21:07:52.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.585+0000 7fbd7259c700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd740f6530 0x7fbd74108f60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fbd64009870 tx=0x7fbd6400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:52.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.585+0000 7fbd62ffd700 1 -- 172.21.15.8:0/862366492 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd64019070 con 0x7fbd740f6530 2023-10-18T21:07:52.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.585+0000 7fbd62ffd700 1 -- 172.21.15.8:0/862366492 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbd64013380 con 0x7fbd740f6530 2023-10-18T21:07:52.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.585+0000 7fbd62ffd700 1 -- 172.21.15.8:0/862366492 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd6401edf0 con 0x7fbd740f6530 2023-10-18T21:07:52.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.585+0000 7fbd7359e700 1 -- 172.21.15.8:0/862366492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7410a480 con 0x7fbd740f6530 2023-10-18T21:07:52.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.585+0000 7fbd7359e700 1 -- 172.21.15.8:0/862366492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7410a960 con 0x7fbd740f6530 2023-10-18T21:07:52.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.587+0000 7fbd7359e700 1 -- 172.21.15.8:0/862366492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd74045ad0 con 0x7fbd740f6530 2023-10-18T21:07:52.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.587+0000 7fbd62ffd700 1 -- 172.21.15.8:0/862366492 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbd6401e420 con 0x7fbd740f6530 2023-10-18T21:07:52.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.588+0000 7fbd62ffd700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd5c060f70 0x7fbd5c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:07:52.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.588+0000 7fbd62ffd700 1 -- 172.21.15.8:0/862366492 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7016+0+0 (secure 0 0 0) 0x7fbd6407d9a0 con 0x7fbd740f6530 2023-10-18T21:07:52.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.588+0000 7fbd71d9b700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd5c060f70 0x7fbd5c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:07:52.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.589+0000 7fbd71d9b700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd5c060f70 0x7fbd5c063430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fbd68009fd0 tx=0x7fbd6800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:07:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.592+0000 7fbd62ffd700 1 -- 172.21.15.8:0/862366492 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbd64051360 con 0x7fbd740f6530 2023-10-18T21:07:52.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.796+0000 7fbd7359e700 1 -- 172.21.15.8:0/862366492 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd740fee40 con 0x7fbd5c060f70 2023-10-18T21:07:52.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.798+0000 7fbd62ffd700 1 -- 172.21.15.8:0/862366492 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbd740fee40 con 0x7fbd5c060f70 2023-10-18T21:07:52.800 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:07:52.800 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:07:52.800 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:07:52.800 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:07:52.801 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:07:52.801 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:07:52.801 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:07:52.801 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:07:52.801 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:07:52.802 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:07:52.802 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:07:52.802 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:07:52.802 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:07:52.802 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:07:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.799+0000 7fbd7359e700 1 -- 172.21.15.8:0/862366492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd5c060f70 msgr2=0x7fbd5c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.799+0000 7fbd7359e700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd5c060f70 0x7fbd5c063430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fbd68009fd0 tx=0x7fbd6800b040).stop 2023-10-18T21:07:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.799+0000 7fbd7359e700 1 -- 172.21.15.8:0/862366492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd740f6530 msgr2=0x7fbd74108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:07:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.799+0000 7fbd7359e700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd740f6530 0x7fbd74108f60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fbd64009870 tx=0x7fbd6400b040).stop 2023-10-18T21:07:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.800+0000 7fbd7359e700 1 -- 172.21.15.8:0/862366492 shutdown_connections 2023-10-18T21:07:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.800+0000 7fbd7359e700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd5c060f70 0x7fbd5c063430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.800+0000 7fbd7359e700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd740f6530 0x7fbd74108f60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.800+0000 7fbd7359e700 1 --2- 172.21.15.8:0/862366492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd740f77d0 0x7fbd74109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:07:52.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.800+0000 7fbd7359e700 1 -- 172.21.15.8:0/862366492 >> 172.21.15.8:0/862366492 conn(0x7fbd740f1c90 msgr2=0x7fbd7406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:07:52.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.800+0000 7fbd7359e700 1 -- 172.21.15.8:0/862366492 shutdown_connections 2023-10-18T21:07:52.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:07:52.800+0000 7fbd7359e700 1 -- 172.21.15.8:0/862366492 wait complete. 2023-10-18T21:07:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:52.066784+0000 mon.smithi008 (mon.0) 906 : audit [DBG] from='client.? 172.21.15.8:0/1635068304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:52.377268+0000 mgr.smithi008.flmjzp (mgr.14640) 509 : cluster [DBG] pgmap v366: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:52.443523+0000 mon.smithi008 (mon.0) 907 : audit [DBG] from='client.? 172.21.15.8:0/1263269146' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:07:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:52.066784+0000 mon.smithi008 (mon.0) 906 : audit [DBG] from='client.? 172.21.15.8:0/1635068304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:52.377268+0000 mgr.smithi008.flmjzp (mgr.14640) 509 : cluster [DBG] pgmap v366: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:52.443523+0000 mon.smithi008 (mon.0) 907 : audit [DBG] from='client.? 172.21.15.8:0/1263269146' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:07:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:52.798950+0000 mgr.smithi008.flmjzp (mgr.14640) 510 : audit [DBG] from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:54.237 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:52.798950+0000 mgr.smithi008.flmjzp (mgr.14640) 510 : audit [DBG] from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:07:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:54.377975+0000 mgr.smithi008.flmjzp (mgr.14640) 511 : cluster [DBG] pgmap v367: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:54.377975+0000 mgr.smithi008.flmjzp (mgr.14640) 511 : cluster [DBG] pgmap v367: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:56.257683+0000 mon.smithi008 (mon.0) 908 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm restarted 2023-10-18T21:07:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:56.262269+0000 mon.smithi008 (mon.0) 909 : cluster [DBG] osdmap e99: 6 total, 6 up, 6 in 2023-10-18T21:07:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:07:56.307+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:07:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:56.257683+0000 mon.smithi008 (mon.0) 908 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm restarted 2023-10-18T21:07:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:56.262269+0000 mon.smithi008 (mon.0) 909 : cluster [DBG] osdmap e99: 6 total, 6 up, 6 in 2023-10-18T21:07:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:56.308670+0000 mon.smithi008 (mon.0) 910 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:07:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:56.311964+0000 mon.smithi008 (mon.0) 911 : cluster [DBG] mds.? [v2:172.21.15.60:6824/4145190794,v1:172.21.15.60:6825/4145190794] up:boot 2023-10-18T21:07:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:56.312024+0000 mon.smithi008 (mon.0) 912 : cluster [INF] Standby daemon mds.cephfs.smithi060.rvrncq assigned to filesystem cephfs as rank 0 2023-10-18T21:07:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:56.312161+0000 mon.smithi008 (mon.0) 913 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:07:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:56.312572+0000 mon.smithi008 (mon.0) 914 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:07:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:56.312709+0000 mon.smithi008 (mon.0) 915 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:07:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:56.316561+0000 mon.smithi008 (mon.0) 916 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 1 up:standby 2023-10-18T21:07:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:56.378469+0000 mgr.smithi008.flmjzp (mgr.14640) 512 : cluster [DBG] pgmap v369: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:56.408521+0000 mon.smithi008 (mon.0) 917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:57.107521+0000 mon.smithi008 (mon.0) 918 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:57.108641+0000 mon.smithi008 (mon.0) 919 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:57.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:57.115091+0000 mon.smithi008 (mon.0) 920 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:57.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:57.123009+0000 mon.smithi008 (mon.0) 921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:57.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:57.126651+0000 mon.smithi008 (mon.0) 922 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:57.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:57.128679+0000 mon.smithi008 (mon.0) 923 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:57.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:57.130593+0000 mon.smithi008 (mon.0) 924 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:57.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:07:57.133218+0000 mon.smithi008 (mon.0) 925 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:56.308670+0000 mon.smithi008 (mon.0) 910 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:07:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:56.311964+0000 mon.smithi008 (mon.0) 911 : cluster [DBG] mds.? [v2:172.21.15.60:6824/4145190794,v1:172.21.15.60:6825/4145190794] up:boot 2023-10-18T21:07:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:56.312024+0000 mon.smithi008 (mon.0) 912 : cluster [INF] Standby daemon mds.cephfs.smithi060.rvrncq assigned to filesystem cephfs as rank 0 2023-10-18T21:07:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:56.312161+0000 mon.smithi008 (mon.0) 913 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:07:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:56.312572+0000 mon.smithi008 (mon.0) 914 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:07:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:56.312709+0000 mon.smithi008 (mon.0) 915 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:07:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:56.316561+0000 mon.smithi008 (mon.0) 916 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 1 up:standby 2023-10-18T21:07:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:56.378469+0000 mgr.smithi008.flmjzp (mgr.14640) 512 : cluster [DBG] pgmap v369: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:56.408521+0000 mon.smithi008 (mon.0) 917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:57.107521+0000 mon.smithi008 (mon.0) 918 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:07:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:57.108641+0000 mon.smithi008 (mon.0) 919 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:07:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:57.115091+0000 mon.smithi008 (mon.0) 920 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:07:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:57.123009+0000 mon.smithi008 (mon.0) 921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:07:57.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:57.126651+0000 mon.smithi008 (mon.0) 922 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:57.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:57.128679+0000 mon.smithi008 (mon.0) 923 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:57.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:57.130593+0000 mon.smithi008 (mon.0) 924 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:57.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:07:57.133218+0000 mon.smithi008 (mon.0) 925 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:07:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:57.109542+0000 mgr.smithi008.flmjzp (mgr.14640) 513 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:57.110164+0000 mgr.smithi008.flmjzp (mgr.14640) 514 : cluster [DBG] pgmap v370: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:57.110390+0000 mgr.smithi008.flmjzp (mgr.14640) 515 : cluster [DBG] pgmap v371: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:07:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:07:57.136793+0000 mgr.smithi008.flmjzp (mgr.14640) 516 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:07:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:57.109542+0000 mgr.smithi008.flmjzp (mgr.14640) 513 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:07:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:57.110164+0000 mgr.smithi008.flmjzp (mgr.14640) 514 : cluster [DBG] pgmap v370: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:57.110390+0000 mgr.smithi008.flmjzp (mgr.14640) 515 : cluster [DBG] pgmap v371: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:07:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:07:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:07:57.136793+0000 mgr.smithi008.flmjzp (mgr.14640) 516 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:08:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:07:59.111066+0000 mgr.smithi008.flmjzp (mgr.14640) 517 : cluster [DBG] pgmap v372: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:00.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:07:59.111066+0000 mgr.smithi008.flmjzp (mgr.14640) 517 : cluster [DBG] pgmap v372: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:01.111695+0000 mgr.smithi008.flmjzp (mgr.14640) 518 : cluster [DBG] pgmap v373: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:01.111695+0000 mgr.smithi008.flmjzp (mgr.14640) 518 : cluster [DBG] pgmap v373: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:03.112297+0000 mgr.smithi008.flmjzp (mgr.14640) 519 : cluster [DBG] pgmap v374: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:03.112297+0000 mgr.smithi008.flmjzp (mgr.14640) 519 : cluster [DBG] pgmap v374: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:05.112970+0000 mgr.smithi008.flmjzp (mgr.14640) 520 : cluster [DBG] pgmap v375: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:05.112970+0000 mgr.smithi008.flmjzp (mgr.14640) 520 : cluster [DBG] pgmap v375: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:07.139110+0000 mon.smithi008 (mon.0) 926 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:07.141188+0000 mon.smithi008 (mon.0) 927 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:07.142130+0000 mon.smithi008 (mon.0) 928 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:07.148325+0000 mon.smithi008 (mon.0) 929 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:07.154648+0000 mon.smithi008 (mon.0) 930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:07.157627+0000 mon.smithi008 (mon.0) 931 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:07.159225+0000 mon.smithi008 (mon.0) 932 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:07.160782+0000 mon.smithi008 (mon.0) 933 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:07.162624+0000 mon.smithi008 (mon.0) 934 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:07.139110+0000 mon.smithi008 (mon.0) 926 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:07.141188+0000 mon.smithi008 (mon.0) 927 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:07.142130+0000 mon.smithi008 (mon.0) 928 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:07.148325+0000 mon.smithi008 (mon.0) 929 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:07.154648+0000 mon.smithi008 (mon.0) 930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:07.157627+0000 mon.smithi008 (mon.0) 931 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:07.159225+0000 mon.smithi008 (mon.0) 932 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:07.160782+0000 mon.smithi008 (mon.0) 933 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:07.162624+0000 mon.smithi008 (mon.0) 934 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:07.113592+0000 mgr.smithi008.flmjzp (mgr.14640) 521 : cluster [DBG] pgmap v376: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:07.142946+0000 mgr.smithi008.flmjzp (mgr.14640) 522 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:07.143497+0000 mgr.smithi008.flmjzp (mgr.14640) 523 : cluster [DBG] pgmap v377: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:07.143697+0000 mgr.smithi008.flmjzp (mgr.14640) 524 : cluster [DBG] pgmap v378: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:07.164509+0000 mgr.smithi008.flmjzp (mgr.14640) 525 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:08:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:07.746461+0000 mon.smithi008 (mon.0) 935 : cluster [INF] daemon mds.cephfs.smithi060.rvrncq restarted 2023-10-18T21:08:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:07.750979+0000 mon.smithi008 (mon.0) 936 : cluster [DBG] osdmap e100: 6 total, 6 up, 6 in 2023-10-18T21:08:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:08:08.191+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:08:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:07.113592+0000 mgr.smithi008.flmjzp (mgr.14640) 521 : cluster [DBG] pgmap v376: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:07.142946+0000 mgr.smithi008.flmjzp (mgr.14640) 522 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:07.143497+0000 mgr.smithi008.flmjzp (mgr.14640) 523 : cluster [DBG] pgmap v377: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:07.143697+0000 mgr.smithi008.flmjzp (mgr.14640) 524 : cluster [DBG] pgmap v378: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:07.164509+0000 mgr.smithi008.flmjzp (mgr.14640) 525 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:08:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:07.746461+0000 mon.smithi008 (mon.0) 935 : cluster [INF] daemon mds.cephfs.smithi060.rvrncq restarted 2023-10-18T21:08:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:07.750979+0000 mon.smithi008 (mon.0) 936 : cluster [DBG] osdmap e100: 6 total, 6 up, 6 in 2023-10-18T21:08:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:08.192520+0000 mon.smithi008 (mon.0) 937 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:08:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:08.196607+0000 mon.smithi008 (mon.0) 938 : cluster [DBG] mds.? [v2:172.21.15.60:6826/683740919,v1:172.21.15.60:6827/683740919] up:boot 2023-10-18T21:08:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:08.196695+0000 mon.smithi008 (mon.0) 939 : cluster [INF] Standby daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 0 2023-10-18T21:08:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:08.196813+0000 mon.smithi008 (mon.0) 940 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:08:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:08.197234+0000 mon.smithi008 (mon.0) 941 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:08:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:08.197515+0000 mon.smithi008 (mon.0) 942 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:08:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:08.201839+0000 mon.smithi008 (mon.0) 943 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:08:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:08.192520+0000 mon.smithi008 (mon.0) 937 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:08:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:08.196607+0000 mon.smithi008 (mon.0) 938 : cluster [DBG] mds.? [v2:172.21.15.60:6826/683740919,v1:172.21.15.60:6827/683740919] up:boot 2023-10-18T21:08:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:08.196695+0000 mon.smithi008 (mon.0) 939 : cluster [INF] Standby daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 0 2023-10-18T21:08:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:08.196813+0000 mon.smithi008 (mon.0) 940 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:08:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:08.197234+0000 mon.smithi008 (mon.0) 941 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:08:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:08.197515+0000 mon.smithi008 (mon.0) 942 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:08:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:08.201839+0000 mon.smithi008 (mon.0) 943 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:08:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:09.144193+0000 mgr.smithi008.flmjzp (mgr.14640) 526 : cluster [DBG] pgmap v380: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:09.144193+0000 mgr.smithi008.flmjzp (mgr.14640) 526 : cluster [DBG] pgmap v380: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:11.144834+0000 mgr.smithi008.flmjzp (mgr.14640) 527 : cluster [DBG] pgmap v381: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:11.144834+0000 mgr.smithi008.flmjzp (mgr.14640) 527 : cluster [DBG] pgmap v381: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:13.145263+0000 mgr.smithi008.flmjzp (mgr.14640) 528 : cluster [DBG] pgmap v382: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:13.145263+0000 mgr.smithi008.flmjzp (mgr.14640) 528 : cluster [DBG] pgmap v382: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:15.145776+0000 mgr.smithi008.flmjzp (mgr.14640) 529 : cluster [DBG] pgmap v383: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:15.145776+0000 mgr.smithi008.flmjzp (mgr.14640) 529 : cluster [DBG] pgmap v383: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:17.175253+0000 mon.smithi008 (mon.0) 944 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:17.177536+0000 mon.smithi008 (mon.0) 945 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:17.178545+0000 mon.smithi008 (mon.0) 946 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:17.185531+0000 mon.smithi008 (mon.0) 947 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:17.191912+0000 mon.smithi008 (mon.0) 948 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:17.194971+0000 mon.smithi008 (mon.0) 949 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:17.196573+0000 mon.smithi008 (mon.0) 950 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:17.198226+0000 mon.smithi008 (mon.0) 951 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:17.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:17.202177+0000 mon.smithi008 (mon.0) 952 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:17.175253+0000 mon.smithi008 (mon.0) 944 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:17.177536+0000 mon.smithi008 (mon.0) 945 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:17.178545+0000 mon.smithi008 (mon.0) 946 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:17.185531+0000 mon.smithi008 (mon.0) 947 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:17.191912+0000 mon.smithi008 (mon.0) 948 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:17.194971+0000 mon.smithi008 (mon.0) 949 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:17.196573+0000 mon.smithi008 (mon.0) 950 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:17.198226+0000 mon.smithi008 (mon.0) 951 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:17.202177+0000 mon.smithi008 (mon.0) 952 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:17.146350+0000 mgr.smithi008.flmjzp (mgr.14640) 530 : cluster [DBG] pgmap v384: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:17.179431+0000 mgr.smithi008.flmjzp (mgr.14640) 531 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:17.179975+0000 mgr.smithi008.flmjzp (mgr.14640) 532 : cluster [DBG] pgmap v385: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:18.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:17.180222+0000 mgr.smithi008.flmjzp (mgr.14640) 533 : cluster [DBG] pgmap v386: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:18.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:17.204126+0000 mgr.smithi008.flmjzp (mgr.14640) 534 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:08:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:17.146350+0000 mgr.smithi008.flmjzp (mgr.14640) 530 : cluster [DBG] pgmap v384: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:17.179431+0000 mgr.smithi008.flmjzp (mgr.14640) 531 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:17.179975+0000 mgr.smithi008.flmjzp (mgr.14640) 532 : cluster [DBG] pgmap v385: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:17.180222+0000 mgr.smithi008.flmjzp (mgr.14640) 533 : cluster [DBG] pgmap v386: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:17.204126+0000 mgr.smithi008.flmjzp (mgr.14640) 534 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:08:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:19.180902+0000 mgr.smithi008.flmjzp (mgr.14640) 535 : cluster [DBG] pgmap v387: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:19.468065+0000 mon.smithi008 (mon.0) 953 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm restarted 2023-10-18T21:08:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:19.472391+0000 mon.smithi008 (mon.0) 954 : cluster [DBG] osdmap e101: 6 total, 6 up, 6 in 2023-10-18T21:08:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:19.945572+0000 mon.smithi008 (mon.0) 955 : cluster [INF] Standby daemon mds.cephfs.smithi060.rvrncq assigned to filesystem cephfs as rank 0 2023-10-18T21:08:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:19.949714+0000 mon.smithi008 (mon.0) 956 : cluster [DBG] mds.? [v2:172.21.15.60:6824/373098336,v1:172.21.15.60:6825/373098336] up:boot 2023-10-18T21:08:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:19.949757+0000 mon.smithi008 (mon.0) 957 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 1 up:standby 2023-10-18T21:08:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:19.950163+0000 mon.smithi008 (mon.0) 958 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:08:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:19.180902+0000 mgr.smithi008.flmjzp (mgr.14640) 535 : cluster [DBG] pgmap v387: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:19.468065+0000 mon.smithi008 (mon.0) 953 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm restarted 2023-10-18T21:08:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:19.472391+0000 mon.smithi008 (mon.0) 954 : cluster [DBG] osdmap e101: 6 total, 6 up, 6 in 2023-10-18T21:08:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:19.945572+0000 mon.smithi008 (mon.0) 955 : cluster [INF] Standby daemon mds.cephfs.smithi060.rvrncq assigned to filesystem cephfs as rank 0 2023-10-18T21:08:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:19.949714+0000 mon.smithi008 (mon.0) 956 : cluster [DBG] mds.? [v2:172.21.15.60:6824/373098336,v1:172.21.15.60:6825/373098336] up:boot 2023-10-18T21:08:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:19.949757+0000 mon.smithi008 (mon.0) 957 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 1 up:standby 2023-10-18T21:08:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:19.950163+0000 mon.smithi008 (mon.0) 958 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:08:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:21.181566+0000 mgr.smithi008.flmjzp (mgr.14640) 536 : cluster [DBG] pgmap v389: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:21.181566+0000 mgr.smithi008.flmjzp (mgr.14640) 536 : cluster [DBG] pgmap v389: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.954+0000 7f833cd1d700 1 -- 172.21.15.8:0/3277144749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83380f6530 msgr2=0x7f83380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.954+0000 7f833cd1d700 1 --2- 172.21.15.8:0/3277144749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83380f6530 0x7f83380f6950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f8328004660 tx=0x7f8328009b30).stop 2023-10-18T21:08:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.954+0000 7f833cd1d700 1 -- 172.21.15.8:0/3277144749 shutdown_connections 2023-10-18T21:08:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.954+0000 7f833cd1d700 1 --2- 172.21.15.8:0/3277144749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83380f77d0 0x7f83380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.954+0000 7f833cd1d700 1 --2- 172.21.15.8:0/3277144749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83380f6530 0x7f83380f6950 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.954+0000 7f833cd1d700 1 -- 172.21.15.8:0/3277144749 >> 172.21.15.8:0/3277144749 conn(0x7f83380f1c90 msgr2=0x7f83380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.954+0000 7f833cd1d700 1 -- 172.21.15.8:0/3277144749 shutdown_connections 2023-10-18T21:08:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.955+0000 7f833cd1d700 1 -- 172.21.15.8:0/3277144749 wait complete. 2023-10-18T21:08:22.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.955+0000 7f833cd1d700 1 Processor -- start 2023-10-18T21:08:22.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.955+0000 7f833cd1d700 1 -- start start 2023-10-18T21:08:22.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.956+0000 7f833cd1d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83380f6530 0x7f8338106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:22.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.956+0000 7f833cd1d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83380f77d0 0x7f8338107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:22.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.956+0000 7f833cd1d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8338107880 con 0x7f83380f77d0 2023-10-18T21:08:22.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.956+0000 7f833cd1d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83381080c0 con 0x7f83380f6530 2023-10-18T21:08:22.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.956+0000 7f8336ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83380f77d0 0x7f8338107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:22.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.956+0000 7f8336ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83380f77d0 0x7f8338107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32780/0 (socket says 172.21.15.8:32780) 2023-10-18T21:08:22.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.956+0000 7f8336ffd700 1 -- 172.21.15.8:0/4134947573 learned_addr learned my addr 172.21.15.8:0/4134947573 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:22.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.956+0000 7f83377fe700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83380f6530 0x7f8338106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:22.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.957+0000 7f8336ffd700 1 -- 172.21.15.8:0/4134947573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83380f6530 msgr2=0x7f8338106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:22.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.957+0000 7f8336ffd700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83380f6530 0x7f8338106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:22.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.957+0000 7f8336ffd700 1 -- 172.21.15.8:0/4134947573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8328005040 con 0x7f83380f77d0 2023-10-18T21:08:22.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.957+0000 7f83377fe700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83380f6530 0x7f8338106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:08:22.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.957+0000 7f8336ffd700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83380f77d0 0x7f8338107280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f832c002700 tx=0x7f832c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:22.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.957+0000 7f831ffff700 1 -- 172.21.15.8:0/4134947573 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f832c009320 con 0x7f83380f77d0 2023-10-18T21:08:22.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.957+0000 7f831ffff700 1 -- 172.21.15.8:0/4134947573 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f832c00f040 con 0x7f83380f77d0 2023-10-18T21:08:22.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.957+0000 7f831ffff700 1 -- 172.21.15.8:0/4134947573 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f832c0148f0 con 0x7f83380f77d0 2023-10-18T21:08:22.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.957+0000 7f833cd1d700 1 -- 172.21.15.8:0/4134947573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83381083a0 con 0x7f83380f77d0 2023-10-18T21:08:22.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.957+0000 7f833cd1d700 1 -- 172.21.15.8:0/4134947573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83381088e0 con 0x7f83380f77d0 2023-10-18T21:08:22.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.958+0000 7f833cd1d700 1 -- 172.21.15.8:0/4134947573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8338059100 con 0x7f83380f77d0 2023-10-18T21:08:22.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.959+0000 7f831ffff700 1 -- 172.21.15.8:0/4134947573 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f832c009480 con 0x7f83380f77d0 2023-10-18T21:08:22.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.960+0000 7f831ffff700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8320060f70 0x7f8320063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:22.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.960+0000 7f831ffff700 1 -- 172.21.15.8:0/4134947573 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7274+0+0 (secure 0 0 0) 0x7f832c07c920 con 0x7f83380f77d0 2023-10-18T21:08:22.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.960+0000 7f83377fe700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8320060f70 0x7f8320063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:22.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.961+0000 7f83377fe700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8320060f70 0x7f8320063430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f8338107b50 tx=0x7f8328009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:22.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:22.964+0000 7f831ffff700 1 -- 172.21.15.8:0/4134947573 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f832c04c7b0 con 0x7f83380f77d0 2023-10-18T21:08:23.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.161+0000 7f833cd1d700 1 -- 172.21.15.8:0/4134947573 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83380feda0 con 0x7f8320060f70 2023-10-18T21:08:23.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.162+0000 7f831ffff700 1 -- 172.21.15.8:0/4134947573 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f83380feda0 con 0x7f8320060f70 2023-10-18T21:08:23.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 -- 172.21.15.8:0/4134947573 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8320060f70 msgr2=0x7f8320063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:23.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8320060f70 0x7f8320063430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f8338107b50 tx=0x7f8328009b30).stop 2023-10-18T21:08:23.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 -- 172.21.15.8:0/4134947573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83380f77d0 msgr2=0x7f8338107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:23.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83380f77d0 0x7f8338107280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f832c002700 tx=0x7f832c009e00).stop 2023-10-18T21:08:23.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 -- 172.21.15.8:0/4134947573 shutdown_connections 2023-10-18T21:08:23.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8320060f70 0x7f8320063430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83380f6530 0x7f8338106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 --2- 172.21.15.8:0/4134947573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83380f77d0 0x7f8338107280 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 -- 172.21.15.8:0/4134947573 >> 172.21.15.8:0/4134947573 conn(0x7f83380f1c90 msgr2=0x7f83380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:23.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 -- 172.21.15.8:0/4134947573 shutdown_connections 2023-10-18T21:08:23.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.165+0000 7f833cd1d700 1 -- 172.21.15.8:0/4134947573 wait complete. 2023-10-18T21:08:23.182 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:08:23.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.302+0000 7fc6b739e700 1 -- 172.21.15.8:0/3083140144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6b00f6530 msgr2=0x7fc6b00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.302+0000 7fc6b739e700 1 --2- 172.21.15.8:0/3083140144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6b00f6530 0x7fc6b00f6950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fc6ac004660 tx=0x7fc6ac009b30).stop 2023-10-18T21:08:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.302+0000 7fc6b739e700 1 -- 172.21.15.8:0/3083140144 shutdown_connections 2023-10-18T21:08:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.302+0000 7fc6b739e700 1 --2- 172.21.15.8:0/3083140144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b00f77d0 0x7fc6b00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.302+0000 7fc6b739e700 1 --2- 172.21.15.8:0/3083140144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6b00f6530 0x7fc6b00f6950 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.302+0000 7fc6b739e700 1 -- 172.21.15.8:0/3083140144 >> 172.21.15.8:0/3083140144 conn(0x7fc6b00f1c90 msgr2=0x7fc6b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:23.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.302+0000 7fc6b739e700 1 -- 172.21.15.8:0/3083140144 shutdown_connections 2023-10-18T21:08:23.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.302+0000 7fc6b739e700 1 -- 172.21.15.8:0/3083140144 wait complete. 2023-10-18T21:08:23.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.303+0000 7fc6b739e700 1 Processor -- start 2023-10-18T21:08:23.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.303+0000 7fc6b739e700 1 -- start start 2023-10-18T21:08:23.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b739e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b00f6530 0x7fc6b0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:23.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b739e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6b00f77d0 0x7fc6b0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:23.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b739e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0107880 con 0x7fc6b00f77d0 2023-10-18T21:08:23.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b739e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b01080c0 con 0x7fc6b00f6530 2023-10-18T21:08:23.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b5b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6b00f77d0 0x7fc6b0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:23.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b5b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6b00f77d0 0x7fc6b0107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32804/0 (socket says 172.21.15.8:32804) 2023-10-18T21:08:23.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b5b9b700 1 -- 172.21.15.8:0/2794062270 learned_addr learned my addr 172.21.15.8:0/2794062270 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:23.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b5b9b700 1 -- 172.21.15.8:0/2794062270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b00f6530 msgr2=0x7fc6b0106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:23.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b639c700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b00f6530 0x7fc6b0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:23.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b5b9b700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b00f6530 0x7fc6b0106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b5b9b700 1 -- 172.21.15.8:0/2794062270 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac005040 con 0x7fc6b00f77d0 2023-10-18T21:08:23.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b639c700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b00f6530 0x7fc6b0106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:08:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.304+0000 7fc6b5b9b700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6b00f77d0 0x7fc6b0107280 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fc6a00026d0 tx=0x7fc6a0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.305+0000 7fc6a6ffd700 1 -- 172.21.15.8:0/2794062270 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6a0009320 con 0x7fc6b00f77d0 2023-10-18T21:08:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.305+0000 7fc6a6ffd700 1 -- 172.21.15.8:0/2794062270 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc6a000f040 con 0x7fc6b00f77d0 2023-10-18T21:08:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.305+0000 7fc6a6ffd700 1 -- 172.21.15.8:0/2794062270 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6a00148a0 con 0x7fc6b00f77d0 2023-10-18T21:08:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.305+0000 7fc6b739e700 1 -- 172.21.15.8:0/2794062270 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b01083a0 con 0x7fc6b00f77d0 2023-10-18T21:08:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.305+0000 7fc6b739e700 1 -- 172.21.15.8:0/2794062270 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b01088e0 con 0x7fc6b00f77d0 2023-10-18T21:08:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.306+0000 7fc6b739e700 1 -- 172.21.15.8:0/2794062270 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b0059100 con 0x7fc6b00f77d0 2023-10-18T21:08:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.307+0000 7fc6a6ffd700 1 -- 172.21.15.8:0/2794062270 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc6a0009480 con 0x7fc6b00f77d0 2023-10-18T21:08:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.308+0000 7fc6a6ffd700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc69c060f70 0x7fc69c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.308+0000 7fc6a6ffd700 1 -- 172.21.15.8:0/2794062270 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7274+0+0 (secure 0 0 0) 0x7fc6a007cc40 con 0x7fc6b00f77d0 2023-10-18T21:08:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.308+0000 7fc6b639c700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc69c060f70 0x7fc69c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.309+0000 7fc6b639c700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc69c060f70 0x7fc69c063430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fc6ac009d60 tx=0x7fc6ac009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:23.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.312+0000 7fc6a6ffd700 1 -- 172.21.15.8:0/2794062270 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc6a004cb90 con 0x7fc6b00f77d0 2023-10-18T21:08:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.510+0000 7fc6b739e700 1 -- 172.21.15.8:0/2794062270 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6b00fee30 con 0x7fc69c060f70 2023-10-18T21:08:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.511+0000 7fc6a6ffd700 1 -- 172.21.15.8:0/2794062270 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc6b00fee30 con 0x7fc69c060f70 2023-10-18T21:08:23.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 -- 172.21.15.8:0/2794062270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc69c060f70 msgr2=0x7fc69c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:23.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc69c060f70 0x7fc69c063430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fc6ac009d60 tx=0x7fc6ac009b30).stop 2023-10-18T21:08:23.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 -- 172.21.15.8:0/2794062270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6b00f77d0 msgr2=0x7fc6b0107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:23.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6b00f77d0 0x7fc6b0107280 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fc6a00026d0 tx=0x7fc6a0009de0).stop 2023-10-18T21:08:23.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 -- 172.21.15.8:0/2794062270 shutdown_connections 2023-10-18T21:08:23.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc69c060f70 0x7fc69c063430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6b00f6530 0x7fc6b0106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 --2- 172.21.15.8:0/2794062270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6b00f77d0 0x7fc6b0107280 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 -- 172.21.15.8:0/2794062270 >> 172.21.15.8:0/2794062270 conn(0x7fc6b00f1c90 msgr2=0x7fc6b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:23.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 -- 172.21.15.8:0/2794062270 shutdown_connections 2023-10-18T21:08:23.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.513+0000 7fc6b739e700 1 -- 172.21.15.8:0/2794062270 wait complete. 2023-10-18T21:08:23.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.650+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/1062725435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4c80f6530 msgr2=0x7ff4c80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:23.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.650+0000 7ff4cc8c6700 1 --2- 172.21.15.8:0/1062725435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4c80f6530 0x7ff4c80f6950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7ff4b8004660 tx=0x7ff4b8009b30).stop 2023-10-18T21:08:23.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.650+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/1062725435 shutdown_connections 2023-10-18T21:08:23.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.650+0000 7ff4cc8c6700 1 --2- 172.21.15.8:0/1062725435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80f77d0 0x7ff4c80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.650+0000 7ff4cc8c6700 1 --2- 172.21.15.8:0/1062725435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4c80f6530 0x7ff4c80f6950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.650+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/1062725435 >> 172.21.15.8:0/1062725435 conn(0x7ff4c80f1c90 msgr2=0x7ff4c80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:23.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.650+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/1062725435 shutdown_connections 2023-10-18T21:08:23.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.650+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/1062725435 wait complete. 2023-10-18T21:08:23.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.651+0000 7ff4cc8c6700 1 Processor -- start 2023-10-18T21:08:23.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.651+0000 7ff4cc8c6700 1 -- start start 2023-10-18T21:08:23.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.651+0000 7ff4cc8c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80f6530 0x7ff4c8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:23.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.651+0000 7ff4cc8c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4c80f77d0 0x7ff4c81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:23.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.651+0000 7ff4cc8c6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8109a70 con 0x7ff4c80f77d0 2023-10-18T21:08:23.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.651+0000 7ff4cc8c6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8109bb0 con 0x7ff4c80f6530 2023-10-18T21:08:23.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.652+0000 7ff4c659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4c80f77d0 0x7ff4c81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:23.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.652+0000 7ff4c659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4c80f77d0 0x7ff4c81094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32828/0 (socket says 172.21.15.8:32828) 2023-10-18T21:08:23.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.652+0000 7ff4c659c700 1 -- 172.21.15.8:0/2543479444 learned_addr learned my addr 172.21.15.8:0/2543479444 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:23.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.652+0000 7ff4c6d9d700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80f6530 0x7ff4c8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:23.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.652+0000 7ff4c659c700 1 -- 172.21.15.8:0/2543479444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80f6530 msgr2=0x7ff4c8108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:23.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.652+0000 7ff4c659c700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80f6530 0x7ff4c8108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.652+0000 7ff4c659c700 1 -- 172.21.15.8:0/2543479444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b8005040 con 0x7ff4c80f77d0 2023-10-18T21:08:23.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.652+0000 7ff4c659c700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4c80f77d0 0x7ff4c81094c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff4bc0026d0 tx=0x7ff4bc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:23.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.653+0000 7ff4af7fe700 1 -- 172.21.15.8:0/2543479444 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4bc0079c0 con 0x7ff4c80f77d0 2023-10-18T21:08:23.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.653+0000 7ff4af7fe700 1 -- 172.21.15.8:0/2543479444 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff4bc00f040 con 0x7ff4c80f77d0 2023-10-18T21:08:23.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.653+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/2543479444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c810a550 con 0x7ff4c80f77d0 2023-10-18T21:08:23.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.653+0000 7ff4af7fe700 1 -- 172.21.15.8:0/2543479444 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4bc014980 con 0x7ff4c80f77d0 2023-10-18T21:08:23.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.653+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/2543479444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c810ab10 con 0x7ff4c80f77d0 2023-10-18T21:08:23.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.654+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/2543479444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c8045ad0 con 0x7ff4c80f77d0 2023-10-18T21:08:23.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.655+0000 7ff4af7fe700 1 -- 172.21.15.8:0/2543479444 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff4bc0090d0 con 0x7ff4c80f77d0 2023-10-18T21:08:23.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.655+0000 7ff4af7fe700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4b0060f70 0x7ff4b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:23.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.656+0000 7ff4af7fe700 1 -- 172.21.15.8:0/2543479444 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7274+0+0 (secure 0 0 0) 0x7ff4bc07c720 con 0x7ff4c80f77d0 2023-10-18T21:08:23.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.656+0000 7ff4c6d9d700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4b0060f70 0x7ff4b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:23.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.656+0000 7ff4c6d9d700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4b0060f70 0x7ff4b0063430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff4b8004630 tx=0x7ff4b8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:23.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.660+0000 7ff4af7fe700 1 -- 172.21.15.8:0/2543479444 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff4bc050010 con 0x7ff4c80f77d0 2023-10-18T21:08:23.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.851+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/2543479444 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4c810ad90 con 0x7ff4b0060f70 2023-10-18T21:08:23.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.860+0000 7ff4af7fe700 1 -- 172.21.15.8:0/2543479444 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff4c810ad90 con 0x7ff4b0060f70 2023-10-18T21:08:23.863 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:08:23.863 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (15m) 3m ago 16m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:08:23.863 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (8m) 3m ago 16m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:08:23.863 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (8m) 68s ago 15m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:08:23.863 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (14m) 3m ago 16m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:08:23.864 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (3m) 3m ago 12m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:08:23.864 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 12m - - 2023-10-18T21:08:23.864 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (84s) 68s ago 12m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:08:23.864 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (70s) 68s ago 12m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:08:23.865 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (10m) 3m ago 17m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:08:23.865 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (9m) 68s ago 15m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:08:23.865 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (9m) 3m ago 17m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:08:23.865 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (9m) 68s ago 15m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:08:23.865 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (16m) 3m ago 16m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:08:23.866 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (15m) 68s ago 15m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:08:23.866 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (8m) 3m ago 15m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:08:23.866 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (6m) 3m ago 14m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:08:23.866 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (6m) 3m ago 14m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:08:23.867 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (5m) 68s ago 14m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:08:23.867 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (4m) 68s ago 13m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:08:23.867 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (4m) 68s ago 13m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:08:23.867 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (10m) 3m ago 15m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:08:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/2543479444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4b0060f70 msgr2=0x7ff4b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4b0060f70 0x7ff4b0063430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff4b8004630 tx=0x7ff4b8009b30).stop 2023-10-18T21:08:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/2543479444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4c80f77d0 msgr2=0x7ff4c81094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4c80f77d0 0x7ff4c81094c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff4bc0026d0 tx=0x7ff4bc009de0).stop 2023-10-18T21:08:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/2543479444 shutdown_connections 2023-10-18T21:08:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4b0060f70 0x7ff4b0063430 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80f6530 0x7ff4c8108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 --2- 172.21.15.8:0/2543479444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4c80f77d0 0x7ff4c81094c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/2543479444 >> 172.21.15.8:0/2543479444 conn(0x7ff4c80f1c90 msgr2=0x7ff4c806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/2543479444 shutdown_connections 2023-10-18T21:08:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:23.862+0000 7ff4cc8c6700 1 -- 172.21.15.8:0/2543479444 wait complete. 2023-10-18T21:08:24.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.000+0000 7fe28759e700 1 -- 172.21.15.8:0/1620374918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2880f6530 msgr2=0x7fe2880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:24.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.000+0000 7fe28759e700 1 --2- 172.21.15.8:0/1620374918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2880f6530 0x7fe2880f6950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe278004660 tx=0x7fe278009b30).stop 2023-10-18T21:08:24.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.000+0000 7fe28759e700 1 -- 172.21.15.8:0/1620374918 shutdown_connections 2023-10-18T21:08:24.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.000+0000 7fe28759e700 1 --2- 172.21.15.8:0/1620374918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2880f77d0 0x7fe2880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.000+0000 7fe28759e700 1 --2- 172.21.15.8:0/1620374918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2880f6530 0x7fe2880f6950 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.000+0000 7fe28759e700 1 -- 172.21.15.8:0/1620374918 >> 172.21.15.8:0/1620374918 conn(0x7fe2880f1c90 msgr2=0x7fe2880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.000+0000 7fe28759e700 1 -- 172.21.15.8:0/1620374918 shutdown_connections 2023-10-18T21:08:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.000+0000 7fe28759e700 1 -- 172.21.15.8:0/1620374918 wait complete. 2023-10-18T21:08:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.001+0000 7fe28759e700 1 Processor -- start 2023-10-18T21:08:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.001+0000 7fe28759e700 1 -- start start 2023-10-18T21:08:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.001+0000 7fe28759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2880f6530 0x7fe28806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.001+0000 7fe28759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2880f77d0 0x7fe288069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.001+0000 7fe28759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28806a380 con 0x7fe2880f77d0 2023-10-18T21:08:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.001+0000 7fe28759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28806a4c0 con 0x7fe2880f6530 2023-10-18T21:08:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.001+0000 7fe27ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2880f77d0 0x7fe288069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.001+0000 7fe27ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2880f77d0 0x7fe288069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32840/0 (socket says 172.21.15.8:32840) 2023-10-18T21:08:24.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.001+0000 7fe27ffff700 1 -- 172.21.15.8:0/1509473335 learned_addr learned my addr 172.21.15.8:0/1509473335 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:24.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.002+0000 7fe28659c700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2880f6530 0x7fe28806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:24.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.002+0000 7fe27ffff700 1 -- 172.21.15.8:0/1509473335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2880f6530 msgr2=0x7fe28806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:24.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.002+0000 7fe27ffff700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2880f6530 0x7fe28806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.002+0000 7fe27ffff700 1 -- 172.21.15.8:0/1509473335 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278005040 con 0x7fe2880f77d0 2023-10-18T21:08:24.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.002+0000 7fe27ffff700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2880f77d0 0x7fe288069e20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe27000e7f0 tx=0x7fe27000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:24.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.002+0000 7fe27effd700 1 -- 172.21.15.8:0/1509473335 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2700092e0 con 0x7fe2880f77d0 2023-10-18T21:08:24.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.002+0000 7fe27effd700 1 -- 172.21.15.8:0/1509473335 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe27000f040 con 0x7fe2880f77d0 2023-10-18T21:08:24.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.002+0000 7fe28759e700 1 -- 172.21.15.8:0/1509473335 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28806a7a0 con 0x7fe2880f77d0 2023-10-18T21:08:24.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.002+0000 7fe27effd700 1 -- 172.21.15.8:0/1509473335 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2700147e0 con 0x7fe2880f77d0 2023-10-18T21:08:24.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.002+0000 7fe28759e700 1 -- 172.21.15.8:0/1509473335 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28810ed70 con 0x7fe2880f77d0 2023-10-18T21:08:24.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.004+0000 7fe28759e700 1 -- 172.21.15.8:0/1509473335 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe288045ad0 con 0x7fe2880f77d0 2023-10-18T21:08:24.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.004+0000 7fe27effd700 1 -- 172.21.15.8:0/1509473335 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe27001b030 con 0x7fe2880f77d0 2023-10-18T21:08:24.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.005+0000 7fe27effd700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe274060f70 0x7fe274063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:24.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.005+0000 7fe27effd700 1 -- 172.21.15.8:0/1509473335 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7274+0+0 (secure 0 0 0) 0x7fe27007c4e0 con 0x7fe2880f77d0 2023-10-18T21:08:24.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.006+0000 7fe28659c700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe274060f70 0x7fe274063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:24.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.006+0000 7fe28659c700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe274060f70 0x7fe274063430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fe2780043d0 tx=0x7fe27800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:24.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.009+0000 7fe27effd700 1 -- 172.21.15.8:0/1509473335 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe27004c340 con 0x7fe2880f77d0 2023-10-18T21:08:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.265+0000 7fe28759e700 1 -- 172.21.15.8:0/1509473335 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe288027a00 con 0x7fe2880f77d0 2023-10-18T21:08:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.266+0000 7fe27effd700 1 -- 172.21.15.8:0/1509473335 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fe2700192a0 con 0x7fe2880f77d0 2023-10-18T21:08:24.268 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:08:24.269 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:08:24.269 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:08:24.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:08:24.269 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:08:24.270 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:08:24.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:08:24.270 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:08:24.270 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:08:24.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:08:24.271 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:08:24.271 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:08:24.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:08:24.271 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:08:24.272 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 12 2023-10-18T21:08:24.272 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:08:24.272 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:08:24.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 -- 172.21.15.8:0/1509473335 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe274060f70 msgr2=0x7fe274063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:24.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe274060f70 0x7fe274063430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fe2780043d0 tx=0x7fe27800b040).stop 2023-10-18T21:08:24.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 -- 172.21.15.8:0/1509473335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2880f77d0 msgr2=0x7fe288069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:24.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2880f77d0 0x7fe288069e20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe27000e7f0 tx=0x7fe27000b040).stop 2023-10-18T21:08:24.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 -- 172.21.15.8:0/1509473335 shutdown_connections 2023-10-18T21:08:24.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe274060f70 0x7fe274063430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2880f6530 0x7fe28806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 --2- 172.21.15.8:0/1509473335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2880f77d0 0x7fe288069e20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 -- 172.21.15.8:0/1509473335 >> 172.21.15.8:0/1509473335 conn(0x7fe2880f1c90 msgr2=0x7fe2880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:24.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 -- 172.21.15.8:0/1509473335 shutdown_connections 2023-10-18T21:08:24.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.268+0000 7fe28759e700 1 -- 172.21.15.8:0/1509473335 wait complete. 2023-10-18T21:08:24.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.406+0000 7ff6d561c700 1 -- 172.21.15.8:0/814450430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6d00f77d0 msgr2=0x7ff6d00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:24.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.406+0000 7ff6d561c700 1 --2- 172.21.15.8:0/814450430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6d00f77d0 0x7ff6d00f7c30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ff6c4004660 tx=0x7ff6c4009b30).stop 2023-10-18T21:08:24.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.406+0000 7ff6d561c700 1 -- 172.21.15.8:0/814450430 shutdown_connections 2023-10-18T21:08:24.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.406+0000 7ff6d561c700 1 --2- 172.21.15.8:0/814450430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6d00f77d0 0x7ff6d00f7c30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.406+0000 7ff6d561c700 1 --2- 172.21.15.8:0/814450430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00f6530 0x7ff6d00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.406+0000 7ff6d561c700 1 -- 172.21.15.8:0/814450430 >> 172.21.15.8:0/814450430 conn(0x7ff6d00f1c90 msgr2=0x7ff6d00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:24.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.406+0000 7ff6d561c700 1 -- 172.21.15.8:0/814450430 shutdown_connections 2023-10-18T21:08:24.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.406+0000 7ff6d561c700 1 -- 172.21.15.8:0/814450430 wait complete. 2023-10-18T21:08:24.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.407+0000 7ff6d561c700 1 Processor -- start 2023-10-18T21:08:24.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.407+0000 7ff6d561c700 1 -- start start 2023-10-18T21:08:24.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.408+0000 7ff6d561c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6d00f6530 0x7ff6d0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:24.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.408+0000 7ff6d561c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00f77d0 0x7ff6d0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:24.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.408+0000 7ff6d561c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d0107880 con 0x7ff6d00f6530 2023-10-18T21:08:24.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.408+0000 7ff6d561c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d01080c0 con 0x7ff6d00f77d0 2023-10-18T21:08:24.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.408+0000 7ff6cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6d00f6530 0x7ff6d0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:24.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.408+0000 7ff6cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6d00f6530 0x7ff6d0106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32844/0 (socket says 172.21.15.8:32844) 2023-10-18T21:08:24.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.408+0000 7ff6cffff700 1 -- 172.21.15.8:0/2181800737 learned_addr learned my addr 172.21.15.8:0/2181800737 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:24.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.408+0000 7ff6cf7fe700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00f77d0 0x7ff6d0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:24.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.409+0000 7ff6cffff700 1 -- 172.21.15.8:0/2181800737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00f77d0 msgr2=0x7ff6d0107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:24.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.409+0000 7ff6cffff700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00f77d0 0x7ff6d0107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.409+0000 7ff6cffff700 1 -- 172.21.15.8:0/2181800737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c4005040 con 0x7ff6d00f6530 2023-10-18T21:08:24.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.409+0000 7ff6cffff700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6d00f6530 0x7ff6d0106d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7ff6c0002700 tx=0x7ff6c0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:24.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.409+0000 7ff6ccff9700 1 -- 172.21.15.8:0/2181800737 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c00079c0 con 0x7ff6d00f6530 2023-10-18T21:08:24.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.409+0000 7ff6ccff9700 1 -- 172.21.15.8:0/2181800737 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff6c000f040 con 0x7ff6d00f6530 2023-10-18T21:08:24.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.409+0000 7ff6d561c700 1 -- 172.21.15.8:0/2181800737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d01083a0 con 0x7ff6d00f6530 2023-10-18T21:08:24.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.409+0000 7ff6ccff9700 1 -- 172.21.15.8:0/2181800737 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c00148d0 con 0x7ff6d00f6530 2023-10-18T21:08:24.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.409+0000 7ff6d561c700 1 -- 172.21.15.8:0/2181800737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d01088e0 con 0x7ff6d00f6530 2023-10-18T21:08:24.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.411+0000 7ff6d561c700 1 -- 172.21.15.8:0/2181800737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d0059100 con 0x7ff6d00f6530 2023-10-18T21:08:24.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.411+0000 7ff6ccff9700 1 -- 172.21.15.8:0/2181800737 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff6c001b060 con 0x7ff6d00f6530 2023-10-18T21:08:24.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.412+0000 7ff6ccff9700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6b8060f70 0x7ff6b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:24.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.412+0000 7ff6ccff9700 1 -- 172.21.15.8:0/2181800737 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7274+0+0 (secure 0 0 0) 0x7ff6c007c4d0 con 0x7ff6d00f6530 2023-10-18T21:08:24.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.412+0000 7ff6cf7fe700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6b8060f70 0x7ff6b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:24.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.413+0000 7ff6cf7fe700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6b8060f70 0x7ff6b8063430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7ff6c4004630 tx=0x7ff6c4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:24.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.416+0000 7ff6ccff9700 1 -- 172.21.15.8:0/2181800737 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff6c004c3a0 con 0x7ff6d00f6530 2023-10-18T21:08:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.648+0000 7ff6d561c700 1 -- 172.21.15.8:0/2181800737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff6d00fedc0 con 0x7ff6d00f6530 2023-10-18T21:08:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.649+0000 7ff6ccff9700 1 -- 172.21.15.8:0/2181800737 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 63 v63) v1 ==== 76+0+1412 (secure 0 0 0) 0x7ff6c004f9c0 con 0x7ff6d00f6530 2023-10-18T21:08:24.651 INFO:teuthology.orchestra.run.smithi008.stdout:e63 2023-10-18T21:08:24.652 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:08:24.652 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:08:24.652 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:08:24.652 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:08:24.652 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:08:24.653 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:08:24.653 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 63 2023-10-18T21:08:24.653 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:08:24.653 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:08:24.653 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:08:19.945670+0000 2023-10-18T21:08:24.654 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:08:24.654 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:08:24.654 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:08:24.654 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:08:24.655 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:08:24.655 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:08:24.655 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:08:24.655 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 101 2023-10-18T21:08:24.655 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:08:24.655 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:08:24.656 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:08:24.656 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44537} 2023-10-18T21:08:24.656 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:08:24.656 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:08:24.656 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:08:24.657 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:08:24.657 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:08:24.657 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:08:24.657 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:08:24.657 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:08:24.658 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44537} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/683740919,v1:172.21.15.60:6827/683740919] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:08:24.658 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:08:24.658 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:08:24.658 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:08:24.658 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:08:24.659 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{-1:44541} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6824/373098336,v1:172.21.15.60:6825/373098336] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:08:24.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 -- 172.21.15.8:0/2181800737 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6b8060f70 msgr2=0x7ff6b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:24.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6b8060f70 0x7ff6b8063430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7ff6c4004630 tx=0x7ff6c4009b30).stop 2023-10-18T21:08:24.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 -- 172.21.15.8:0/2181800737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6d00f6530 msgr2=0x7ff6d0106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:24.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6d00f6530 0x7ff6d0106d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7ff6c0002700 tx=0x7ff6c0009d80).stop 2023-10-18T21:08:24.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 -- 172.21.15.8:0/2181800737 shutdown_connections 2023-10-18T21:08:24.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6b8060f70 0x7ff6b8063430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6d00f6530 0x7ff6d0106d90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 --2- 172.21.15.8:0/2181800737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00f77d0 0x7ff6d0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 -- 172.21.15.8:0/2181800737 >> 172.21.15.8:0/2181800737 conn(0x7ff6d00f1c90 msgr2=0x7ff6d00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:24.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 -- 172.21.15.8:0/2181800737 shutdown_connections 2023-10-18T21:08:24.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.651+0000 7ff6d561c700 1 -- 172.21.15.8:0/2181800737 wait complete. 2023-10-18T21:08:24.661 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 63 2023-10-18T21:08:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:23.163868+0000 mgr.smithi008.flmjzp (mgr.14640) 537 : audit [DBG] from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:23.182328+0000 mgr.smithi008.flmjzp (mgr.14640) 538 : cluster [DBG] pgmap v390: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:23.512441+0000 mgr.smithi008.flmjzp (mgr.14640) 539 : audit [DBG] from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:23.163868+0000 mgr.smithi008.flmjzp (mgr.14640) 537 : audit [DBG] from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:23.182328+0000 mgr.smithi008.flmjzp (mgr.14640) 538 : cluster [DBG] pgmap v390: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:23.512441+0000 mgr.smithi008.flmjzp (mgr.14640) 539 : audit [DBG] from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:24.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.792+0000 7fc9d2f75700 1 -- 172.21.15.8:0/1447417787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9cc0f77d0 msgr2=0x7fc9cc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:24.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.792+0000 7fc9d2f75700 1 --2- 172.21.15.8:0/1447417787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9cc0f77d0 0x7fc9cc0f7c30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fc9bc004660 tx=0x7fc9bc009b30).stop 2023-10-18T21:08:24.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.792+0000 7fc9d2f75700 1 -- 172.21.15.8:0/1447417787 shutdown_connections 2023-10-18T21:08:24.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.792+0000 7fc9d2f75700 1 --2- 172.21.15.8:0/1447417787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9cc0f77d0 0x7fc9cc0f7c30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.792+0000 7fc9d2f75700 1 --2- 172.21.15.8:0/1447417787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9cc0f6530 0x7fc9cc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.792+0000 7fc9d2f75700 1 -- 172.21.15.8:0/1447417787 >> 172.21.15.8:0/1447417787 conn(0x7fc9cc0f1c90 msgr2=0x7fc9cc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:24.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.792+0000 7fc9d2f75700 1 -- 172.21.15.8:0/1447417787 shutdown_connections 2023-10-18T21:08:24.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.792+0000 7fc9d2f75700 1 -- 172.21.15.8:0/1447417787 wait complete. 2023-10-18T21:08:24.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.793+0000 7fc9d2f75700 1 Processor -- start 2023-10-18T21:08:24.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.794+0000 7fc9d2f75700 1 -- start start 2023-10-18T21:08:24.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.794+0000 7fc9d2f75700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9cc0f6530 0x7fc9cc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.794+0000 7fc9d2f75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9cc0f77d0 0x7fc9cc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.794+0000 7fc9d2f75700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc107880 con 0x7fc9cc0f6530 2023-10-18T21:08:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.794+0000 7fc9d2f75700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc1080c0 con 0x7fc9cc0f77d0 2023-10-18T21:08:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.794+0000 7fc9d1f73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9cc0f6530 0x7fc9cc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.794+0000 7fc9d1f73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9cc0f6530 0x7fc9cc106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32872/0 (socket says 172.21.15.8:32872) 2023-10-18T21:08:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.794+0000 7fc9d1f73700 1 -- 172.21.15.8:0/16577988 learned_addr learned my addr 172.21.15.8:0/16577988 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9d1772700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9cc0f77d0 0x7fc9cc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9d1f73700 1 -- 172.21.15.8:0/16577988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9cc0f77d0 msgr2=0x7fc9cc107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9d1f73700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9cc0f77d0 0x7fc9cc107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9d1f73700 1 -- 172.21.15.8:0/16577988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc005040 con 0x7fc9cc0f6530 2023-10-18T21:08:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9d1772700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9cc0f77d0 0x7fc9cc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:08:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9d1f73700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9cc0f6530 0x7fc9cc106d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fc9c8002700 tx=0x7fc9c8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9c27fc700 1 -- 172.21.15.8:0/16577988 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c8009320 con 0x7fc9cc0f6530 2023-10-18T21:08:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9c27fc700 1 -- 172.21.15.8:0/16577988 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc9c800f040 con 0x7fc9cc0f6530 2023-10-18T21:08:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9d2f75700 1 -- 172.21.15.8:0/16577988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc1083a0 con 0x7fc9cc0f6530 2023-10-18T21:08:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9c27fc700 1 -- 172.21.15.8:0/16577988 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c8014970 con 0x7fc9cc0f6530 2023-10-18T21:08:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.795+0000 7fc9d2f75700 1 -- 172.21.15.8:0/16577988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc1088e0 con 0x7fc9cc0f6530 2023-10-18T21:08:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.797+0000 7fc9d2f75700 1 -- 172.21.15.8:0/16577988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc059100 con 0x7fc9cc0f6530 2023-10-18T21:08:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.798+0000 7fc9c27fc700 1 -- 172.21.15.8:0/16577988 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc9c8009480 con 0x7fc9cc0f6530 2023-10-18T21:08:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.798+0000 7fc9c27fc700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9b8060f70 0x7fc9b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.799+0000 7fc9c27fc700 1 -- 172.21.15.8:0/16577988 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7274+0+0 (secure 0 0 0) 0x7fc9c807c920 con 0x7fc9cc0f6530 2023-10-18T21:08:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.799+0000 7fc9d1772700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9b8060f70 0x7fc9b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.799+0000 7fc9d1772700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9b8060f70 0x7fc9b8063430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc9bc005010 tx=0x7fc9bc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:24.802+0000 7fc9c27fc700 1 -- 172.21.15.8:0/16577988 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc9c804c7f0 con 0x7fc9cc0f6530 2023-10-18T21:08:25.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.002+0000 7fc9d2f75700 1 -- 172.21.15.8:0/16577988 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9cc0fee00 con 0x7fc9b8060f70 2023-10-18T21:08:25.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.003+0000 7fc9c27fc700 1 -- 172.21.15.8:0/16577988 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc9cc0fee00 con 0x7fc9b8060f70 2023-10-18T21:08:25.005 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:08:25.005 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:08:25.005 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:08:25.006 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:08:25.006 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:08:25.006 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:08:25.006 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:08:25.006 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:08:25.007 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:08:25.007 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:08:25.007 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:08:25.007 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:08:25.007 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:08:25.008 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:08:25.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 -- 172.21.15.8:0/16577988 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9b8060f70 msgr2=0x7fc9b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:25.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9b8060f70 0x7fc9b8063430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc9bc005010 tx=0x7fc9bc009b30).stop 2023-10-18T21:08:25.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 -- 172.21.15.8:0/16577988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9cc0f6530 msgr2=0x7fc9cc106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:25.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9cc0f6530 0x7fc9cc106d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fc9c8002700 tx=0x7fc9c8009d80).stop 2023-10-18T21:08:25.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 -- 172.21.15.8:0/16577988 shutdown_connections 2023-10-18T21:08:25.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9b8060f70 0x7fc9b8063430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:25.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9cc0f6530 0x7fc9cc106d90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:25.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 --2- 172.21.15.8:0/16577988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9cc0f77d0 0x7fc9cc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:25.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 -- 172.21.15.8:0/16577988 >> 172.21.15.8:0/16577988 conn(0x7fc9cc0f1c90 msgr2=0x7fc9cc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:25.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 -- 172.21.15.8:0/16577988 shutdown_connections 2023-10-18T21:08:25.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:25.005+0000 7fc9d2f75700 1 -- 172.21.15.8:0/16577988 wait complete. 2023-10-18T21:08:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:23.853203+0000 mgr.smithi008.flmjzp (mgr.14640) 540 : audit [DBG] from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:24.267482+0000 mon.smithi008 (mon.0) 959 : audit [DBG] from='client.? 172.21.15.8:0/1509473335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:24.650381+0000 mon.smithi008 (mon.0) 960 : audit [DBG] from='client.? 172.21.15.8:0/2181800737' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:08:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:23.853203+0000 mgr.smithi008.flmjzp (mgr.14640) 540 : audit [DBG] from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:24.267482+0000 mon.smithi008 (mon.0) 959 : audit [DBG] from='client.? 172.21.15.8:0/1509473335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:24.650381+0000 mon.smithi008 (mon.0) 960 : audit [DBG] from='client.? 172.21.15.8:0/2181800737' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:08:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:25.004199+0000 mgr.smithi008.flmjzp (mgr.14640) 541 : audit [DBG] from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:25.182790+0000 mgr.smithi008.flmjzp (mgr.14640) 542 : cluster [DBG] pgmap v391: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:25.004199+0000 mgr.smithi008.flmjzp (mgr.14640) 541 : audit [DBG] from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:25.182790+0000 mgr.smithi008.flmjzp (mgr.14640) 542 : cluster [DBG] pgmap v391: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:27.214970+0000 mon.smithi008 (mon.0) 961 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:27.217131+0000 mon.smithi008 (mon.0) 962 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:27.218094+0000 mon.smithi008 (mon.0) 963 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:27.224301+0000 mon.smithi008 (mon.0) 964 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:27.230970+0000 mon.smithi008 (mon.0) 965 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:27.234007+0000 mon.smithi008 (mon.0) 966 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:27.235681+0000 mon.smithi008 (mon.0) 967 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:27.237334+0000 mon.smithi008 (mon.0) 968 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:27.239298+0000 mon.smithi008 (mon.0) 969 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:27.214970+0000 mon.smithi008 (mon.0) 961 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:27.217131+0000 mon.smithi008 (mon.0) 962 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:27.218094+0000 mon.smithi008 (mon.0) 963 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:27.224301+0000 mon.smithi008 (mon.0) 964 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:27.230970+0000 mon.smithi008 (mon.0) 965 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:27.234007+0000 mon.smithi008 (mon.0) 966 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:27.235681+0000 mon.smithi008 (mon.0) 967 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:27.237334+0000 mon.smithi008 (mon.0) 968 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:27.239298+0000 mon.smithi008 (mon.0) 969 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:27.183525+0000 mgr.smithi008.flmjzp (mgr.14640) 543 : cluster [DBG] pgmap v392: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:27.218929+0000 mgr.smithi008.flmjzp (mgr.14640) 544 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:27.219469+0000 mgr.smithi008.flmjzp (mgr.14640) 545 : cluster [DBG] pgmap v393: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:27.219717+0000 mgr.smithi008.flmjzp (mgr.14640) 546 : cluster [DBG] pgmap v394: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:27.241275+0000 mgr.smithi008.flmjzp (mgr.14640) 547 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:08:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:27.183525+0000 mgr.smithi008.flmjzp (mgr.14640) 543 : cluster [DBG] pgmap v392: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:27.218929+0000 mgr.smithi008.flmjzp (mgr.14640) 544 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:27.219469+0000 mgr.smithi008.flmjzp (mgr.14640) 545 : cluster [DBG] pgmap v393: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:27.219717+0000 mgr.smithi008.flmjzp (mgr.14640) 546 : cluster [DBG] pgmap v394: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:27.241275+0000 mgr.smithi008.flmjzp (mgr.14640) 547 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:08:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:29.220362+0000 mgr.smithi008.flmjzp (mgr.14640) 548 : cluster [DBG] pgmap v395: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:29.220362+0000 mgr.smithi008.flmjzp (mgr.14640) 548 : cluster [DBG] pgmap v395: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:31.426 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:31.258440+0000 mon.smithi008 (mon.0) 970 : cluster [INF] daemon mds.cephfs.smithi060.rvrncq restarted 2023-10-18T21:08:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:08:31.262+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:08:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:31.258440+0000 mon.smithi008 (mon.0) 970 : cluster [INF] daemon mds.cephfs.smithi060.rvrncq restarted 2023-10-18T21:08:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:31.220825+0000 mgr.smithi008.flmjzp (mgr.14640) 549 : cluster [DBG] pgmap v396: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:31.263190+0000 mon.smithi008 (mon.0) 971 : cluster [DBG] osdmap e102: 6 total, 6 up, 6 in 2023-10-18T21:08:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:31.264044+0000 mon.smithi008 (mon.0) 972 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:08:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:31.270495+0000 mon.smithi008 (mon.0) 973 : cluster [DBG] mds.? [v2:172.21.15.60:6826/1992755606,v1:172.21.15.60:6827/1992755606] up:boot 2023-10-18T21:08:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:31.270565+0000 mon.smithi008 (mon.0) 974 : cluster [INF] Standby daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 0 2023-10-18T21:08:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:31.270693+0000 mon.smithi008 (mon.0) 975 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:08:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:31.271019+0000 mon.smithi008 (mon.0) 976 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:08:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:31.271176+0000 mon.smithi008 (mon.0) 977 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:08:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:31.273928+0000 mon.smithi008 (mon.0) 978 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:08:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:31.220825+0000 mgr.smithi008.flmjzp (mgr.14640) 549 : cluster [DBG] pgmap v396: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:31.263190+0000 mon.smithi008 (mon.0) 971 : cluster [DBG] osdmap e102: 6 total, 6 up, 6 in 2023-10-18T21:08:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:31.264044+0000 mon.smithi008 (mon.0) 972 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:08:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:31.270495+0000 mon.smithi008 (mon.0) 973 : cluster [DBG] mds.? [v2:172.21.15.60:6826/1992755606,v1:172.21.15.60:6827/1992755606] up:boot 2023-10-18T21:08:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:31.270565+0000 mon.smithi008 (mon.0) 974 : cluster [INF] Standby daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 0 2023-10-18T21:08:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:31.270693+0000 mon.smithi008 (mon.0) 975 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:08:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:31.271019+0000 mon.smithi008 (mon.0) 976 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:08:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:31.271176+0000 mon.smithi008 (mon.0) 977 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:08:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:31.273928+0000 mon.smithi008 (mon.0) 978 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:08:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:33.221422+0000 mgr.smithi008.flmjzp (mgr.14640) 550 : cluster [DBG] pgmap v398: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:33.221422+0000 mgr.smithi008.flmjzp (mgr.14640) 550 : cluster [DBG] pgmap v398: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:35.222141+0000 mgr.smithi008.flmjzp (mgr.14640) 551 : cluster [DBG] pgmap v399: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:35.222141+0000 mgr.smithi008.flmjzp (mgr.14640) 551 : cluster [DBG] pgmap v399: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:37.252093+0000 mon.smithi008 (mon.0) 979 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:37.252093+0000 mon.smithi008 (mon.0) 979 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:37.222847+0000 mgr.smithi008.flmjzp (mgr.14640) 552 : cluster [DBG] pgmap v400: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:37.812438+0000 mon.smithi008 (mon.0) 980 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:37.813286+0000 mon.smithi008 (mon.0) 981 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:37.818804+0000 mon.smithi008 (mon.0) 982 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:37.823603+0000 mon.smithi008 (mon.0) 983 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:37.826105+0000 mon.smithi008 (mon.0) 984 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:37.827387+0000 mon.smithi008 (mon.0) 985 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:37.828601+0000 mon.smithi008 (mon.0) 986 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:37.830153+0000 mon.smithi008 (mon.0) 987 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:37.222847+0000 mgr.smithi008.flmjzp (mgr.14640) 552 : cluster [DBG] pgmap v400: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:37.812438+0000 mon.smithi008 (mon.0) 980 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:37.813286+0000 mon.smithi008 (mon.0) 981 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:37.818804+0000 mon.smithi008 (mon.0) 982 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:37.823603+0000 mon.smithi008 (mon.0) 983 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:37.826105+0000 mon.smithi008 (mon.0) 984 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:37.827387+0000 mon.smithi008 (mon.0) 985 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:37.828601+0000 mon.smithi008 (mon.0) 986 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:37.830153+0000 mon.smithi008 (mon.0) 987 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:37.813948+0000 mgr.smithi008.flmjzp (mgr.14640) 553 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:37.814399+0000 mgr.smithi008.flmjzp (mgr.14640) 554 : cluster [DBG] pgmap v401: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:37.814625+0000 mgr.smithi008.flmjzp (mgr.14640) 555 : cluster [DBG] pgmap v402: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:37.831731+0000 mgr.smithi008.flmjzp (mgr.14640) 556 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:08:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:37.813948+0000 mgr.smithi008.flmjzp (mgr.14640) 553 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:37.814399+0000 mgr.smithi008.flmjzp (mgr.14640) 554 : cluster [DBG] pgmap v401: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:37.814625+0000 mgr.smithi008.flmjzp (mgr.14640) 555 : cluster [DBG] pgmap v402: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:37.831731+0000 mgr.smithi008.flmjzp (mgr.14640) 556 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:08:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:39.815175+0000 mgr.smithi008.flmjzp (mgr.14640) 557 : cluster [DBG] pgmap v403: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:39.815175+0000 mgr.smithi008.flmjzp (mgr.14640) 557 : cluster [DBG] pgmap v403: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:43.619 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:41.815668+0000 mgr.smithi008.flmjzp (mgr.14640) 558 : cluster [DBG] pgmap v404: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:43.620 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:42.472727+0000 mon.smithi008 (mon.0) 988 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm restarted 2023-10-18T21:08:43.620 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:42.476924+0000 mon.smithi008 (mon.0) 989 : cluster [DBG] osdmap e103: 6 total, 6 up, 6 in 2023-10-18T21:08:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:08:43.320+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:08:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:41.815668+0000 mgr.smithi008.flmjzp (mgr.14640) 558 : cluster [DBG] pgmap v404: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:42.472727+0000 mon.smithi008 (mon.0) 988 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm restarted 2023-10-18T21:08:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:42.476924+0000 mon.smithi008 (mon.0) 989 : cluster [DBG] osdmap e103: 6 total, 6 up, 6 in 2023-10-18T21:08:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:43.321265+0000 mon.smithi008 (mon.0) 990 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:08:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:43.328862+0000 mon.smithi008 (mon.0) 991 : cluster [DBG] mds.? [v2:172.21.15.60:6824/2713815287,v1:172.21.15.60:6825/2713815287] up:boot 2023-10-18T21:08:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:43.328929+0000 mon.smithi008 (mon.0) 992 : cluster [INF] Standby daemon mds.cephfs.smithi060.rvrncq assigned to filesystem cephfs as rank 0 2023-10-18T21:08:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:43.329059+0000 mon.smithi008 (mon.0) 993 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:08:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:43.329351+0000 mon.smithi008 (mon.0) 994 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:08:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:43.329484+0000 mon.smithi008 (mon.0) 995 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:08:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:43.332010+0000 mon.smithi008 (mon.0) 996 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 1 up:standby 2023-10-18T21:08:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:43.321265+0000 mon.smithi008 (mon.0) 990 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:08:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:43.328862+0000 mon.smithi008 (mon.0) 991 : cluster [DBG] mds.? [v2:172.21.15.60:6824/2713815287,v1:172.21.15.60:6825/2713815287] up:boot 2023-10-18T21:08:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:43.328929+0000 mon.smithi008 (mon.0) 992 : cluster [INF] Standby daemon mds.cephfs.smithi060.rvrncq assigned to filesystem cephfs as rank 0 2023-10-18T21:08:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:43.329059+0000 mon.smithi008 (mon.0) 993 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:08:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:43.329351+0000 mon.smithi008 (mon.0) 994 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:08:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:43.329484+0000 mon.smithi008 (mon.0) 995 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:08:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:43.332010+0000 mon.smithi008 (mon.0) 996 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 1 up:standby 2023-10-18T21:08:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:43.816297+0000 mgr.smithi008.flmjzp (mgr.14640) 559 : cluster [DBG] pgmap v406: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:43.816297+0000 mgr.smithi008.flmjzp (mgr.14640) 559 : cluster [DBG] pgmap v406: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:45.816854+0000 mgr.smithi008.flmjzp (mgr.14640) 560 : cluster [DBG] pgmap v407: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:45.816854+0000 mgr.smithi008.flmjzp (mgr.14640) 560 : cluster [DBG] pgmap v407: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:47.839695+0000 mon.smithi008 (mon.0) 997 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:47.842777+0000 mon.smithi008 (mon.0) 998 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:47.843801+0000 mon.smithi008 (mon.0) 999 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:47.850074+0000 mon.smithi008 (mon.0) 1000 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:47.856353+0000 mon.smithi008 (mon.0) 1001 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:47.859415+0000 mon.smithi008 (mon.0) 1002 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:47.861339+0000 mon.smithi008 (mon.0) 1003 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:47.863023+0000 mon.smithi008 (mon.0) 1004 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:47.864942+0000 mon.smithi008 (mon.0) 1005 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:47.839695+0000 mon.smithi008 (mon.0) 997 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:47.842777+0000 mon.smithi008 (mon.0) 998 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:47.843801+0000 mon.smithi008 (mon.0) 999 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:47.850074+0000 mon.smithi008 (mon.0) 1000 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:47.856353+0000 mon.smithi008 (mon.0) 1001 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:48.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:47.859415+0000 mon.smithi008 (mon.0) 1002 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:48.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:47.861339+0000 mon.smithi008 (mon.0) 1003 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:48.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:47.863023+0000 mon.smithi008 (mon.0) 1004 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:48.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:47.864942+0000 mon.smithi008 (mon.0) 1005 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:47.817406+0000 mgr.smithi008.flmjzp (mgr.14640) 561 : cluster [DBG] pgmap v408: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:47.844679+0000 mgr.smithi008.flmjzp (mgr.14640) 562 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:47.845217+0000 mgr.smithi008.flmjzp (mgr.14640) 563 : cluster [DBG] pgmap v409: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:47.845476+0000 mgr.smithi008.flmjzp (mgr.14640) 564 : cluster [DBG] pgmap v410: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:47.866799+0000 mgr.smithi008.flmjzp (mgr.14640) 565 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:08:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:47.817406+0000 mgr.smithi008.flmjzp (mgr.14640) 561 : cluster [DBG] pgmap v408: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:47.844679+0000 mgr.smithi008.flmjzp (mgr.14640) 562 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:47.845217+0000 mgr.smithi008.flmjzp (mgr.14640) 563 : cluster [DBG] pgmap v409: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:47.845476+0000 mgr.smithi008.flmjzp (mgr.14640) 564 : cluster [DBG] pgmap v410: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:47.866799+0000 mgr.smithi008.flmjzp (mgr.14640) 565 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:08:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:49.846113+0000 mgr.smithi008.flmjzp (mgr.14640) 566 : cluster [DBG] pgmap v411: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:49.846113+0000 mgr.smithi008.flmjzp (mgr.14640) 566 : cluster [DBG] pgmap v411: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:51.846781+0000 mgr.smithi008.flmjzp (mgr.14640) 567 : cluster [DBG] pgmap v412: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:51.846781+0000 mgr.smithi008.flmjzp (mgr.14640) 567 : cluster [DBG] pgmap v412: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:55.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.160+0000 7fc5e7fff700 1 -- 172.21.15.8:0/2108810766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f77d0 msgr2=0x7fc5e80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:55.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.160+0000 7fc5e7fff700 1 --2- 172.21.15.8:0/2108810766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f77d0 0x7fc5e80f7c30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fc5dc004660 tx=0x7fc5dc009b30).stop 2023-10-18T21:08:55.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.160+0000 7fc5e7fff700 1 -- 172.21.15.8:0/2108810766 shutdown_connections 2023-10-18T21:08:55.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.160+0000 7fc5e7fff700 1 --2- 172.21.15.8:0/2108810766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f77d0 0x7fc5e80f7c30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.160+0000 7fc5e7fff700 1 --2- 172.21.15.8:0/2108810766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f6530 0x7fc5e80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.160+0000 7fc5e7fff700 1 -- 172.21.15.8:0/2108810766 >> 172.21.15.8:0/2108810766 conn(0x7fc5e80f1c90 msgr2=0x7fc5e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:55.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.160+0000 7fc5e7fff700 1 -- 172.21.15.8:0/2108810766 shutdown_connections 2023-10-18T21:08:55.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.160+0000 7fc5e7fff700 1 -- 172.21.15.8:0/2108810766 wait complete. 2023-10-18T21:08:55.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.161+0000 7fc5e7fff700 1 Processor -- start 2023-10-18T21:08:55.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.161+0000 7fc5e7fff700 1 -- start start 2023-10-18T21:08:55.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.161+0000 7fc5e7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f6530 0x7fc5e806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:55.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.162+0000 7fc5e7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f77d0 0x7fc5e8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:55.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.162+0000 7fc5e7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e806a380 con 0x7fc5e80f6530 2023-10-18T21:08:55.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.162+0000 7fc5e7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e806a4c0 con 0x7fc5e80f77d0 2023-10-18T21:08:55.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.162+0000 7fc5e6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f6530 0x7fc5e806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:55.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.162+0000 7fc5e6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f6530 0x7fc5e806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46974/0 (socket says 172.21.15.8:46974) 2023-10-18T21:08:55.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.162+0000 7fc5e6ffd700 1 -- 172.21.15.8:0/1501494930 learned_addr learned my addr 172.21.15.8:0/1501494930 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:55.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.162+0000 7fc5e67fc700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f77d0 0x7fc5e8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:55.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.162+0000 7fc5e6ffd700 1 -- 172.21.15.8:0/1501494930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f77d0 msgr2=0x7fc5e8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:55.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.162+0000 7fc5e6ffd700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f77d0 0x7fc5e8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.162+0000 7fc5e6ffd700 1 -- 172.21.15.8:0/1501494930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc005040 con 0x7fc5e80f6530 2023-10-18T21:08:55.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.163+0000 7fc5e6ffd700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f6530 0x7fc5e806b9a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fc5d800e7c0 tx=0x7fc5d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:55.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.163+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/1501494930 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d80092e0 con 0x7fc5e80f6530 2023-10-18T21:08:55.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.163+0000 7fc5e7fff700 1 -- 172.21.15.8:0/1501494930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e806a7a0 con 0x7fc5e80f6530 2023-10-18T21:08:55.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.163+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/1501494930 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc5d800f040 con 0x7fc5e80f6530 2023-10-18T21:08:55.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.163+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/1501494930 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d8014810 con 0x7fc5e80f6530 2023-10-18T21:08:55.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.163+0000 7fc5e7fff700 1 -- 172.21.15.8:0/1501494930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e810ed20 con 0x7fc5e80f6530 2023-10-18T21:08:55.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.164+0000 7fc5e7fff700 1 -- 172.21.15.8:0/1501494930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e8045ad0 con 0x7fc5e80f6530 2023-10-18T21:08:55.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.165+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/1501494930 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc5d801b030 con 0x7fc5e80f6530 2023-10-18T21:08:55.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.166+0000 7fc5cf7fe700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 0x7fc5d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:55.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.166+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/1501494930 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7532+0+0 (secure 0 0 0) 0x7fc5d807c660 con 0x7fc5e80f6530 2023-10-18T21:08:55.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.166+0000 7fc5e67fc700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 0x7fc5d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:55.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.166+0000 7fc5e67fc700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 0x7fc5d0063430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc5dc009720 tx=0x7fc5dc016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:55.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.170+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/1501494930 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc5d804c430 con 0x7fc5e80f6530 2023-10-18T21:08:55.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.369+0000 7fc5e7fff700 1 -- 172.21.15.8:0/1501494930 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5e80fee30 con 0x7fc5d0060f70 2023-10-18T21:08:55.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.371+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/1501494930 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc5e80fee30 con 0x7fc5d0060f70 2023-10-18T21:08:55.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.372+0000 7fc5e7fff700 1 -- 172.21.15.8:0/1501494930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 msgr2=0x7fc5d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:55.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.372+0000 7fc5e7fff700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 0x7fc5d0063430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc5dc009720 tx=0x7fc5dc016040).stop 2023-10-18T21:08:55.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.372+0000 7fc5e7fff700 1 -- 172.21.15.8:0/1501494930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f6530 msgr2=0x7fc5e806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:55.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.372+0000 7fc5e7fff700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f6530 0x7fc5e806b9a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fc5d800e7c0 tx=0x7fc5d800b040).stop 2023-10-18T21:08:55.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.373+0000 7fc5e7fff700 1 -- 172.21.15.8:0/1501494930 shutdown_connections 2023-10-18T21:08:55.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.373+0000 7fc5e7fff700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 0x7fc5d0063430 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.373+0000 7fc5e7fff700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f6530 0x7fc5e806b9a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.373+0000 7fc5e7fff700 1 --2- 172.21.15.8:0/1501494930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f77d0 0x7fc5e8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.373+0000 7fc5e7fff700 1 -- 172.21.15.8:0/1501494930 >> 172.21.15.8:0/1501494930 conn(0x7fc5e80f1c90 msgr2=0x7fc5e80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:55.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.373+0000 7fc5e7fff700 1 -- 172.21.15.8:0/1501494930 shutdown_connections 2023-10-18T21:08:55.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.373+0000 7fc5e7fff700 1 -- 172.21.15.8:0/1501494930 wait complete. 2023-10-18T21:08:55.389 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:08:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.512+0000 7f90f7fff700 1 -- 172.21.15.8:0/1676841801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90f80f6530 msgr2=0x7f90f80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.512+0000 7f90f7fff700 1 --2- 172.21.15.8:0/1676841801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90f80f6530 0x7f90f80f6950 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f90e8004660 tx=0x7f90e8009b30).stop 2023-10-18T21:08:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.513+0000 7f90f7fff700 1 -- 172.21.15.8:0/1676841801 shutdown_connections 2023-10-18T21:08:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.513+0000 7f90f7fff700 1 --2- 172.21.15.8:0/1676841801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90f80f77d0 0x7f90f80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.513+0000 7f90f7fff700 1 --2- 172.21.15.8:0/1676841801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90f80f6530 0x7f90f80f6950 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.513+0000 7f90f7fff700 1 -- 172.21.15.8:0/1676841801 >> 172.21.15.8:0/1676841801 conn(0x7f90f80f1c90 msgr2=0x7f90f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.513+0000 7f90f7fff700 1 -- 172.21.15.8:0/1676841801 shutdown_connections 2023-10-18T21:08:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.513+0000 7f90f7fff700 1 -- 172.21.15.8:0/1676841801 wait complete. 2023-10-18T21:08:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.514+0000 7f90f7fff700 1 Processor -- start 2023-10-18T21:08:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.514+0000 7f90f7fff700 1 -- start start 2023-10-18T21:08:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90f80f6530 0x7f90f806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90f80f77d0 0x7f90f8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f806a380 con 0x7f90f80f77d0 2023-10-18T21:08:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f806a4c0 con 0x7f90f80f6530 2023-10-18T21:08:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90f80f77d0 0x7f90f8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90f80f6530 0x7f90f806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90f80f77d0 0x7f90f8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46988/0 (socket says 172.21.15.8:46988) 2023-10-18T21:08:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f67fc700 1 -- 172.21.15.8:0/4253359721 learned_addr learned my addr 172.21.15.8:0/4253359721 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f67fc700 1 -- 172.21.15.8:0/4253359721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90f80f6530 msgr2=0x7f90f806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f67fc700 1 --2- 172.21.15.8:0/4253359721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90f80f6530 0x7f90f806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.515+0000 7f90f67fc700 1 -- 172.21.15.8:0/4253359721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8005040 con 0x7f90f80f77d0 2023-10-18T21:08:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.516+0000 7f90f67fc700 1 --2- 172.21.15.8:0/4253359721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90f80f77d0 0x7f90f8069e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f90ec00e7f0 tx=0x7f90ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.516+0000 7f90df7fe700 1 -- 172.21.15.8:0/4253359721 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90ec0092e0 con 0x7f90f80f77d0 2023-10-18T21:08:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.516+0000 7f90df7fe700 1 -- 172.21.15.8:0/4253359721 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f90ec00f040 con 0x7f90f80f77d0 2023-10-18T21:08:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.516+0000 7f90f7fff700 1 -- 172.21.15.8:0/4253359721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f806a7a0 con 0x7f90f80f77d0 2023-10-18T21:08:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.516+0000 7f90df7fe700 1 -- 172.21.15.8:0/4253359721 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90ec0147e0 con 0x7f90f80f77d0 2023-10-18T21:08:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.516+0000 7f90f7fff700 1 -- 172.21.15.8:0/4253359721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f810ed70 con 0x7f90f80f77d0 2023-10-18T21:08:55.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.517+0000 7f90f7fff700 1 -- 172.21.15.8:0/4253359721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f8059100 con 0x7f90f80f77d0 2023-10-18T21:08:55.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.518+0000 7f90df7fe700 1 -- 172.21.15.8:0/4253359721 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f90ec01b030 con 0x7f90f80f77d0 2023-10-18T21:08:55.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.519+0000 7f90df7fe700 1 --2- 172.21.15.8:0/4253359721 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f90e0060f70 0x7f90e0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:55.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.519+0000 7f90df7fe700 1 -- 172.21.15.8:0/4253359721 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7532+0+0 (secure 0 0 0) 0x7f90ec07c660 con 0x7f90f80f77d0 2023-10-18T21:08:55.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.519+0000 7f90f6ffd700 1 --2- 172.21.15.8:0/4253359721 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f90e0060f70 0x7f90e0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:55.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.520+0000 7f90f6ffd700 1 --2- 172.21.15.8:0/4253359721 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f90e0060f70 0x7f90e0063430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f90e8004d80 tx=0x7f90e8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:55.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.523+0000 7f90df7fe700 1 -- 172.21.15.8:0/4253359721 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f90ec04c420 con 0x7f90f80f77d0 2023-10-18T21:08:55.589 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:53.847317+0000 mgr.smithi008.flmjzp (mgr.14640) 568 : cluster [DBG] pgmap v413: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:55.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:54.495815+0000 mon.smithi008 (mon.0) 1006 : cluster [INF] daemon mds.cephfs.smithi060.rvrncq restarted 2023-10-18T21:08:55.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:54.500540+0000 mon.smithi008 (mon.0) 1007 : cluster [DBG] osdmap e104: 6 total, 6 up, 6 in 2023-10-18T21:08:55.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:54.977493+0000 mon.smithi008 (mon.0) 1008 : cluster [INF] Standby daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 0 2023-10-18T21:08:55.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:54.982011+0000 mon.smithi008 (mon.0) 1009 : cluster [DBG] mds.? [v2:172.21.15.60:6826/4245733837,v1:172.21.15.60:6827/4245733837] up:boot 2023-10-18T21:08:55.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:54.982094+0000 mon.smithi008 (mon.0) 1010 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:08:55.591 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:54.982482+0000 mon.smithi008 (mon.0) 1011 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:08:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:53.847317+0000 mgr.smithi008.flmjzp (mgr.14640) 568 : cluster [DBG] pgmap v413: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:54.495815+0000 mon.smithi008 (mon.0) 1006 : cluster [INF] daemon mds.cephfs.smithi060.rvrncq restarted 2023-10-18T21:08:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:54.500540+0000 mon.smithi008 (mon.0) 1007 : cluster [DBG] osdmap e104: 6 total, 6 up, 6 in 2023-10-18T21:08:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:54.977493+0000 mon.smithi008 (mon.0) 1008 : cluster [INF] Standby daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 0 2023-10-18T21:08:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:54.982011+0000 mon.smithi008 (mon.0) 1009 : cluster [DBG] mds.? [v2:172.21.15.60:6826/4245733837,v1:172.21.15.60:6827/4245733837] up:boot 2023-10-18T21:08:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:54.982094+0000 mon.smithi008 (mon.0) 1010 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:08:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:54.982482+0000 mon.smithi008 (mon.0) 1011 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:08:55.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.723+0000 7f90f7fff700 1 -- 172.21.15.8:0/4253359721 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90f80fed80 con 0x7f90e0060f70 2023-10-18T21:08:55.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.724+0000 7f90df7fe700 1 -- 172.21.15.8:0/4253359721 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f90f80fed80 con 0x7f90e0060f70 2023-10-18T21:08:55.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 -- 172.21.15.8:0/4253359721 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f90e0060f70 msgr2=0x7f90e0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:55.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 --2- 172.21.15.8:0/4253359721 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f90e0060f70 0x7f90e0063430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f90e8004d80 tx=0x7f90e8016040).stop 2023-10-18T21:08:55.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 -- 172.21.15.8:0/4253359721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90f80f77d0 msgr2=0x7f90f8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:55.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 --2- 172.21.15.8:0/4253359721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90f80f77d0 0x7f90f8069e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f90ec00e7f0 tx=0x7f90ec00b040).stop 2023-10-18T21:08:55.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 -- 172.21.15.8:0/4253359721 shutdown_connections 2023-10-18T21:08:55.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 --2- 172.21.15.8:0/4253359721 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f90e0060f70 0x7f90e0063430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 --2- 172.21.15.8:0/4253359721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90f80f6530 0x7f90f806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 --2- 172.21.15.8:0/4253359721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90f80f77d0 0x7f90f8069e20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 -- 172.21.15.8:0/4253359721 >> 172.21.15.8:0/4253359721 conn(0x7f90f80f1c90 msgr2=0x7f90f80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:55.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 -- 172.21.15.8:0/4253359721 shutdown_connections 2023-10-18T21:08:55.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.726+0000 7f90f7fff700 1 -- 172.21.15.8:0/4253359721 wait complete. 2023-10-18T21:08:55.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.864+0000 7fe73bfff700 1 -- 172.21.15.8:0/342748994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73c0f77d0 msgr2=0x7fe73c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:55.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.864+0000 7fe73bfff700 1 --2- 172.21.15.8:0/342748994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73c0f77d0 0x7fe73c0f7c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fe730004660 tx=0x7fe730009b30).stop 2023-10-18T21:08:55.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.864+0000 7fe73bfff700 1 -- 172.21.15.8:0/342748994 shutdown_connections 2023-10-18T21:08:55.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.864+0000 7fe73bfff700 1 --2- 172.21.15.8:0/342748994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73c0f77d0 0x7fe73c0f7c30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.864+0000 7fe73bfff700 1 --2- 172.21.15.8:0/342748994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0f6530 0x7fe73c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.864+0000 7fe73bfff700 1 -- 172.21.15.8:0/342748994 >> 172.21.15.8:0/342748994 conn(0x7fe73c0f1c90 msgr2=0x7fe73c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:55.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.864+0000 7fe73bfff700 1 -- 172.21.15.8:0/342748994 shutdown_connections 2023-10-18T21:08:55.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.864+0000 7fe73bfff700 1 -- 172.21.15.8:0/342748994 wait complete. 2023-10-18T21:08:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.865+0000 7fe73bfff700 1 Processor -- start 2023-10-18T21:08:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.865+0000 7fe73bfff700 1 -- start start 2023-10-18T21:08:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.865+0000 7fe73bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0f6530 0x7fe73c108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.865+0000 7fe73bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73c0f77d0 0x7fe73c1093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.865+0000 7fe73bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c109980 con 0x7fe73c0f77d0 2023-10-18T21:08:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.865+0000 7fe73bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c109ac0 con 0x7fe73c0f6530 2023-10-18T21:08:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.866+0000 7fe73a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73c0f77d0 0x7fe73c1093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.866+0000 7fe73a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73c0f77d0 0x7fe73c1093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46998/0 (socket says 172.21.15.8:46998) 2023-10-18T21:08:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.866+0000 7fe73a7fc700 1 -- 172.21.15.8:0/1094704657 learned_addr learned my addr 172.21.15.8:0/1094704657 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.866+0000 7fe73affd700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0f6530 0x7fe73c108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.866+0000 7fe73a7fc700 1 -- 172.21.15.8:0/1094704657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0f6530 msgr2=0x7fe73c108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.866+0000 7fe73a7fc700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0f6530 0x7fe73c108ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.866+0000 7fe73a7fc700 1 -- 172.21.15.8:0/1094704657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe730005040 con 0x7fe73c0f77d0 2023-10-18T21:08:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.866+0000 7fe73a7fc700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73c0f77d0 0x7fe73c1093d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fe730004320 tx=0x7fe73000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.866+0000 7fe7237fe700 1 -- 172.21.15.8:0/1094704657 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe730019070 con 0x7fe73c0f77d0 2023-10-18T21:08:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.867+0000 7fe7237fe700 1 -- 172.21.15.8:0/1094704657 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe73001e420 con 0x7fe73c0f77d0 2023-10-18T21:08:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.867+0000 7fe7237fe700 1 -- 172.21.15.8:0/1094704657 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe730014680 con 0x7fe73c0f77d0 2023-10-18T21:08:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.867+0000 7fe73bfff700 1 -- 172.21.15.8:0/1094704657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c10a400 con 0x7fe73c0f77d0 2023-10-18T21:08:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.867+0000 7fe73bfff700 1 -- 172.21.15.8:0/1094704657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c10a8e0 con 0x7fe73c0f77d0 2023-10-18T21:08:55.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.868+0000 7fe73bfff700 1 -- 172.21.15.8:0/1094704657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c045ad0 con 0x7fe73c0f77d0 2023-10-18T21:08:55.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.869+0000 7fe7237fe700 1 -- 172.21.15.8:0/1094704657 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe73001e590 con 0x7fe73c0f77d0 2023-10-18T21:08:55.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.870+0000 7fe7237fe700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe724060f70 0x7fe724063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:55.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.870+0000 7fe7237fe700 1 -- 172.21.15.8:0/1094704657 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7532+0+0 (secure 0 0 0) 0x7fe73007dbb0 con 0x7fe73c0f77d0 2023-10-18T21:08:55.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.870+0000 7fe73affd700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe724060f70 0x7fe724063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:55.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.871+0000 7fe73affd700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe724060f70 0x7fe724063430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fe72c009fd0 tx=0x7fe72c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:55.875+0000 7fe7237fe700 1 -- 172.21.15.8:0/1094704657 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe730051310 con 0x7fe73c0f77d0 2023-10-18T21:08:56.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.067+0000 7fe73bfff700 1 -- 172.21.15.8:0/1094704657 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe73c0fedd0 con 0x7fe724060f70 2023-10-18T21:08:56.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.076+0000 7fe7237fe700 1 -- 172.21.15.8:0/1094704657 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe73c0fedd0 con 0x7fe724060f70 2023-10-18T21:08:56.078 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:08:56.078 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (15m) 3m ago 17m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:08:56.078 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (9m) 3m ago 17m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:08:56.079 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (9m) 100s ago 16m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:08:56.079 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (15m) 3m ago 16m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:08:56.079 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (3m) 3m ago 13m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:08:56.079 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 13m - - 2023-10-18T21:08:56.079 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (116s) 100s ago 13m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:08:56.079 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (102s) 100s ago 12m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:08:56.080 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (10m) 3m ago 18m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:08:56.080 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (10m) 100s ago 16m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:08:56.080 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (9m) 3m ago 18m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:08:56.080 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (9m) 100s ago 16m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:08:56.080 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (16m) 3m ago 16m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:08:56.080 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (15m) 100s ago 15m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:08:56.081 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (9m) 3m ago 15m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:08:56.081 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (7m) 3m ago 15m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:08:56.081 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (6m) 3m ago 15m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:08:56.081 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (6m) 100s ago 14m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:08:56.081 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (5m) 100s ago 14m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:08:56.082 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (5m) 100s ago 14m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:08:56.082 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (11m) 3m ago 16m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:08:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.078+0000 7fe73bfff700 1 -- 172.21.15.8:0/1094704657 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe724060f70 msgr2=0x7fe724063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.078+0000 7fe73bfff700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe724060f70 0x7fe724063430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fe72c009fd0 tx=0x7fe72c00b040).stop 2023-10-18T21:08:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.078+0000 7fe73bfff700 1 -- 172.21.15.8:0/1094704657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73c0f77d0 msgr2=0x7fe73c1093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.078+0000 7fe73bfff700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73c0f77d0 0x7fe73c1093d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fe730004320 tx=0x7fe73000b040).stop 2023-10-18T21:08:56.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.078+0000 7fe73bfff700 1 -- 172.21.15.8:0/1094704657 shutdown_connections 2023-10-18T21:08:56.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.078+0000 7fe73bfff700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe724060f70 0x7fe724063430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.078+0000 7fe73bfff700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0f6530 0x7fe73c108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.078+0000 7fe73bfff700 1 --2- 172.21.15.8:0/1094704657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73c0f77d0 0x7fe73c1093d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.078+0000 7fe73bfff700 1 -- 172.21.15.8:0/1094704657 >> 172.21.15.8:0/1094704657 conn(0x7fe73c0f1c90 msgr2=0x7fe73c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.079+0000 7fe73bfff700 1 -- 172.21.15.8:0/1094704657 shutdown_connections 2023-10-18T21:08:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.079+0000 7fe73bfff700 1 -- 172.21.15.8:0/1094704657 wait complete. 2023-10-18T21:08:56.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.217+0000 7f5728876700 1 -- 172.21.15.8:0/1529561730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57240f6530 msgr2=0x7f57240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:56.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.217+0000 7f5728876700 1 --2- 172.21.15.8:0/1529561730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57240f6530 0x7f57240f6950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f5714004660 tx=0x7f5714009b30).stop 2023-10-18T21:08:56.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.217+0000 7f5728876700 1 -- 172.21.15.8:0/1529561730 shutdown_connections 2023-10-18T21:08:56.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.217+0000 7f5728876700 1 --2- 172.21.15.8:0/1529561730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240f77d0 0x7f57240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.217+0000 7f5728876700 1 --2- 172.21.15.8:0/1529561730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57240f6530 0x7f57240f6950 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.217+0000 7f5728876700 1 -- 172.21.15.8:0/1529561730 >> 172.21.15.8:0/1529561730 conn(0x7f57240f1c90 msgr2=0x7f57240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:56.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.217+0000 7f5728876700 1 -- 172.21.15.8:0/1529561730 shutdown_connections 2023-10-18T21:08:56.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.217+0000 7f5728876700 1 -- 172.21.15.8:0/1529561730 wait complete. 2023-10-18T21:08:56.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.218+0000 7f5728876700 1 Processor -- start 2023-10-18T21:08:56.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.218+0000 7f5728876700 1 -- start start 2023-10-18T21:08:56.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.218+0000 7f5728876700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57240f6530 0x7f5724108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:56.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.218+0000 7f5728876700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240f77d0 0x7f5724109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:56.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.218+0000 7f5728876700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5724109a10 con 0x7f57240f6530 2023-10-18T21:08:56.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.218+0000 7f5728876700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5724109b50 con 0x7f57240f77d0 2023-10-18T21:08:56.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.218+0000 7f5722d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57240f6530 0x7f5724108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:56.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.218+0000 7f5722d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57240f6530 0x7f5724108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47020/0 (socket says 172.21.15.8:47020) 2023-10-18T21:08:56.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.218+0000 7f5722d9d700 1 -- 172.21.15.8:0/1899958151 learned_addr learned my addr 172.21.15.8:0/1899958151 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:56.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.219+0000 7f572259c700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240f77d0 0x7f5724109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:56.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.219+0000 7f5722d9d700 1 -- 172.21.15.8:0/1899958151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240f77d0 msgr2=0x7f5724109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:56.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.219+0000 7f5722d9d700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240f77d0 0x7f5724109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.219+0000 7f5722d9d700 1 -- 172.21.15.8:0/1899958151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714005040 con 0x7f57240f6530 2023-10-18T21:08:56.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.219+0000 7f5722d9d700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57240f6530 0x7f5724108f70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f5714014040 tx=0x7f571400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:56.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.219+0000 7f570b7fe700 1 -- 172.21.15.8:0/1899958151 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5714019070 con 0x7f57240f6530 2023-10-18T21:08:56.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.219+0000 7f5728876700 1 -- 172.21.15.8:0/1899958151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572410a490 con 0x7f57240f6530 2023-10-18T21:08:56.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.219+0000 7f570b7fe700 1 -- 172.21.15.8:0/1899958151 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f571401e420 con 0x7f57240f6530 2023-10-18T21:08:56.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.219+0000 7f570b7fe700 1 -- 172.21.15.8:0/1899958151 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5714014660 con 0x7f57240f6530 2023-10-18T21:08:56.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.219+0000 7f5728876700 1 -- 172.21.15.8:0/1899958151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572410a970 con 0x7f57240f6530 2023-10-18T21:08:56.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.220+0000 7f5728876700 1 -- 172.21.15.8:0/1899958151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5724045ad0 con 0x7f57240f6530 2023-10-18T21:08:56.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.221+0000 7f570b7fe700 1 -- 172.21.15.8:0/1899958151 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f571401e9e0 con 0x7f57240f6530 2023-10-18T21:08:56.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.222+0000 7f570b7fe700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f570c060f70 0x7f570c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:56.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.222+0000 7f570b7fe700 1 -- 172.21.15.8:0/1899958151 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7532+0+0 (secure 0 0 0) 0x7f571407dc70 con 0x7f57240f6530 2023-10-18T21:08:56.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.222+0000 7f572259c700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f570c060f70 0x7f570c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:56.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.223+0000 7f572259c700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f570c060f70 0x7f570c063430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f5718007f80 tx=0x7f571800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:56.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.226+0000 7f570b7fe700 1 -- 172.21.15.8:0/1899958151 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5714051470 con 0x7f57240f6530 2023-10-18T21:08:56.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.481+0000 7f5728876700 1 -- 172.21.15.8:0/1899958151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f57240fc0e0 con 0x7f57240f6530 2023-10-18T21:08:56.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.481+0000 7f570b7fe700 1 -- 172.21.15.8:0/1899958151 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5714004490 con 0x7f57240f6530 2023-10-18T21:08:56.483 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:08:56.483 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:08:56.483 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:08:56.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:08:56.484 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:08:56.484 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:08:56.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:08:56.484 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:08:56.484 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:08:56.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:08:56.485 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:08:56.485 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:08:56.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:08:56.485 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:08:56.485 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 12 2023-10-18T21:08:56.485 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:08:56.486 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:08:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.483+0000 7f5728876700 1 -- 172.21.15.8:0/1899958151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f570c060f70 msgr2=0x7f570c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:56.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.483+0000 7f5728876700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f570c060f70 0x7f570c063430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f5718007f80 tx=0x7f571800b040).stop 2023-10-18T21:08:56.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.483+0000 7f5728876700 1 -- 172.21.15.8:0/1899958151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57240f6530 msgr2=0x7f5724108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:56.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.483+0000 7f5728876700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57240f6530 0x7f5724108f70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f5714014040 tx=0x7f571400b040).stop 2023-10-18T21:08:56.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.483+0000 7f5728876700 1 -- 172.21.15.8:0/1899958151 shutdown_connections 2023-10-18T21:08:56.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.483+0000 7f5728876700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f570c060f70 0x7f570c063430 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.483+0000 7f5728876700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57240f6530 0x7f5724108f70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.483+0000 7f5728876700 1 --2- 172.21.15.8:0/1899958151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240f77d0 0x7f5724109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.483+0000 7f5728876700 1 -- 172.21.15.8:0/1899958151 >> 172.21.15.8:0/1899958151 conn(0x7f57240f1c90 msgr2=0x7f572406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.483+0000 7f5728876700 1 -- 172.21.15.8:0/1899958151 shutdown_connections 2023-10-18T21:08:56.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.484+0000 7f5728876700 1 -- 172.21.15.8:0/1899958151 wait complete. 2023-10-18T21:08:56.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.621+0000 7f2cbbfff700 1 -- 172.21.15.8:0/383142712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0f77d0 msgr2=0x7f2cbc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:56.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.621+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/383142712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0f77d0 0x7f2cbc0f7c30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2cb0004660 tx=0x7f2cb0009b30).stop 2023-10-18T21:08:56.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.621+0000 7f2cbbfff700 1 -- 172.21.15.8:0/383142712 shutdown_connections 2023-10-18T21:08:56.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.621+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/383142712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0f77d0 0x7f2cbc0f7c30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.621+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/383142712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cbc0f6530 0x7f2cbc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.621+0000 7f2cbbfff700 1 -- 172.21.15.8:0/383142712 >> 172.21.15.8:0/383142712 conn(0x7f2cbc0f1c90 msgr2=0x7f2cbc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:56.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.621+0000 7f2cbbfff700 1 -- 172.21.15.8:0/383142712 shutdown_connections 2023-10-18T21:08:56.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.621+0000 7f2cbbfff700 1 -- 172.21.15.8:0/383142712 wait complete. 2023-10-18T21:08:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.622+0000 7f2cbbfff700 1 Processor -- start 2023-10-18T21:08:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.622+0000 7f2cbbfff700 1 -- start start 2023-10-18T21:08:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0f6530 0x7f2cbc108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:56.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cbc0f77d0 0x7f2cbc109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:56.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cbbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc109a20 con 0x7f2cbc0f6530 2023-10-18T21:08:56.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cbbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc109b60 con 0x7f2cbc0f77d0 2023-10-18T21:08:56.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cbaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0f6530 0x7f2cbc108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:56.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cbaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0f6530 0x7f2cbc108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47046/0 (socket says 172.21.15.8:47046) 2023-10-18T21:08:56.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cbaffd700 1 -- 172.21.15.8:0/2272470577 learned_addr learned my addr 172.21.15.8:0/2272470577 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:56.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cba7fc700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cbc0f77d0 0x7f2cbc109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:56.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cbaffd700 1 -- 172.21.15.8:0/2272470577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cbc0f77d0 msgr2=0x7f2cbc109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:56.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cbaffd700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cbc0f77d0 0x7f2cbc109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.623+0000 7f2cbaffd700 1 -- 172.21.15.8:0/2272470577 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb0005040 con 0x7f2cbc0f6530 2023-10-18T21:08:56.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.624+0000 7f2cbaffd700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0f6530 0x7f2cbc108f80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f2cac002700 tx=0x7f2cac009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:56.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.624+0000 7f2ca37fe700 1 -- 172.21.15.8:0/2272470577 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cac0079c0 con 0x7f2cbc0f6530 2023-10-18T21:08:56.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.624+0000 7f2ca37fe700 1 -- 172.21.15.8:0/2272470577 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2cac00f040 con 0x7f2cbc0f6530 2023-10-18T21:08:56.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.624+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2272470577 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cbc10a500 con 0x7f2cbc0f6530 2023-10-18T21:08:56.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.624+0000 7f2ca37fe700 1 -- 172.21.15.8:0/2272470577 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cac0148d0 con 0x7f2cbc0f6530 2023-10-18T21:08:56.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.624+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2272470577 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc10aac0 con 0x7f2cbc0f6530 2023-10-18T21:08:56.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.625+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2272470577 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cbc045ad0 con 0x7f2cbc0f6530 2023-10-18T21:08:56.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.626+0000 7f2ca37fe700 1 -- 172.21.15.8:0/2272470577 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2cac01b060 con 0x7f2cbc0f6530 2023-10-18T21:08:56.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.627+0000 7f2ca37fe700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ca4060f70 0x7f2ca4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:56.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.627+0000 7f2ca37fe700 1 -- 172.21.15.8:0/2272470577 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7532+0+0 (secure 0 0 0) 0x7f2cac07c5b0 con 0x7f2cbc0f6530 2023-10-18T21:08:56.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.627+0000 7f2cba7fc700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ca4060f70 0x7f2ca4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:56.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.628+0000 7f2cba7fc700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ca4060f70 0x7f2ca4063430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f2cb0004630 tx=0x7f2cb0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:56.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.631+0000 7f2ca37fe700 1 -- 172.21.15.8:0/2272470577 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2cac04fdb0 con 0x7f2cbc0f6530 2023-10-18T21:08:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:55.370965+0000 mgr.smithi008.flmjzp (mgr.14640) 569 : audit [DBG] from='client.34626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:55.370965+0000 mgr.smithi008.flmjzp (mgr.14640) 569 : audit [DBG] from='client.34626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:56.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.860+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2272470577 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2cbc0fedd0 con 0x7f2cbc0f6530 2023-10-18T21:08:56.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.860+0000 7f2ca37fe700 1 -- 172.21.15.8:0/2272470577 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 68 v68) v1 ==== 76+0+1416 (secure 0 0 0) 0x7f2cac04f9a0 con 0x7f2cbc0f6530 2023-10-18T21:08:56.862 INFO:teuthology.orchestra.run.smithi008.stdout:e68 2023-10-18T21:08:56.862 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:08:56.862 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:08:56.862 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:08:56.863 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:08:56.863 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:08:56.863 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:08:56.863 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 68 2023-10-18T21:08:56.863 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:08:56.864 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:08:56.864 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:08:54.977566+0000 2023-10-18T21:08:56.864 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:08:56.864 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:08:56.864 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:08:56.865 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:08:56.865 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:08:56.865 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:08:56.865 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:08:56.865 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 104 2023-10-18T21:08:56.865 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:08:56.866 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:08:56.866 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:08:56.866 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44569} 2023-10-18T21:08:56.866 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:08:56.866 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:08:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:08:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:08:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:08:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:08:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:08:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:08:56.868 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{0:44569} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.60:6824/2713815287,v1:172.21.15.60:6825/2713815287] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:08:56.868 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:08:56.868 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:08:56.868 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:08:56.868 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:08:56.869 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{-1:44573} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/4245733837,v1:172.21.15.60:6827/4245733837] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:08:56.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.862+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2272470577 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ca4060f70 msgr2=0x7f2ca4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:56.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.862+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ca4060f70 0x7f2ca4063430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f2cb0004630 tx=0x7f2cb0009b30).stop 2023-10-18T21:08:56.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.862+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2272470577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0f6530 msgr2=0x7f2cbc108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:56.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.862+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0f6530 0x7f2cbc108f80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f2cac002700 tx=0x7f2cac009d80).stop 2023-10-18T21:08:56.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.862+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2272470577 shutdown_connections 2023-10-18T21:08:56.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.862+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ca4060f70 0x7f2ca4063430 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.862+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0f6530 0x7f2cbc108f80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.862+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/2272470577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cbc0f77d0 0x7f2cbc109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:56.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.862+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2272470577 >> 172.21.15.8:0/2272470577 conn(0x7f2cbc0f1c90 msgr2=0x7f2cbc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:56.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.863+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2272470577 shutdown_connections 2023-10-18T21:08:56.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:56.863+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2272470577 wait complete. 2023-10-18T21:08:56.872 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 68 2023-10-18T21:08:57.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.000+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/3820961701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e80f6530 msgr2=0x7fe7e80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:57.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.000+0000 7fe7ec9ca700 1 --2- 172.21.15.8:0/3820961701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e80f6530 0x7fe7e80f6950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe7d8004660 tx=0x7fe7d8009b30).stop 2023-10-18T21:08:57.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.000+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/3820961701 shutdown_connections 2023-10-18T21:08:57.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.000+0000 7fe7ec9ca700 1 --2- 172.21.15.8:0/3820961701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7e80f77d0 0x7fe7e80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:57.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.000+0000 7fe7ec9ca700 1 --2- 172.21.15.8:0/3820961701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e80f6530 0x7fe7e80f6950 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:57.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.000+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/3820961701 >> 172.21.15.8:0/3820961701 conn(0x7fe7e80f1c90 msgr2=0x7fe7e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:57.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.000+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/3820961701 shutdown_connections 2023-10-18T21:08:57.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.000+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/3820961701 wait complete. 2023-10-18T21:08:57.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.001+0000 7fe7ec9ca700 1 Processor -- start 2023-10-18T21:08:57.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.001+0000 7fe7ec9ca700 1 -- start start 2023-10-18T21:08:57.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.001+0000 7fe7ec9ca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7e80f6530 0x7fe7e8108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:57.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7ec9ca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e80f77d0 0x7fe7e8109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:57.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7ec9ca700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8109a00 con 0x7fe7e80f77d0 2023-10-18T21:08:57.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7ec9ca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8109b40 con 0x7fe7e80f6530 2023-10-18T21:08:57.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e80f77d0 0x7fe7e8109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:57.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e80f77d0 0x7fe7e8109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39314/0 (socket says 172.21.15.8:39314) 2023-10-18T21:08:57.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7e659c700 1 -- 172.21.15.8:0/2483706417 learned_addr learned my addr 172.21.15.8:0/2483706417 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:08:57.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7e6d9d700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7e80f6530 0x7fe7e8108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:57.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7e659c700 1 -- 172.21.15.8:0/2483706417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7e80f6530 msgr2=0x7fe7e8108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:57.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7e659c700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7e80f6530 0x7fe7e8108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:57.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7e659c700 1 -- 172.21.15.8:0/2483706417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8005040 con 0x7fe7e80f77d0 2023-10-18T21:08:57.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.002+0000 7fe7e659c700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e80f77d0 0x7fe7e8109450 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe7dc00e7f0 tx=0x7fe7dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:57.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.003+0000 7fe7cf7fe700 1 -- 172.21.15.8:0/2483706417 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7dc0092e0 con 0x7fe7e80f77d0 2023-10-18T21:08:57.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.003+0000 7fe7cf7fe700 1 -- 172.21.15.8:0/2483706417 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe7dc00f040 con 0x7fe7e80f77d0 2023-10-18T21:08:57.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.003+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/2483706417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e810a4e0 con 0x7fe7e80f77d0 2023-10-18T21:08:57.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.003+0000 7fe7cf7fe700 1 -- 172.21.15.8:0/2483706417 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7dc0147e0 con 0x7fe7e80f77d0 2023-10-18T21:08:57.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.003+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/2483706417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e810aa20 con 0x7fe7e80f77d0 2023-10-18T21:08:57.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.004+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/2483706417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e8045ad0 con 0x7fe7e80f77d0 2023-10-18T21:08:57.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.005+0000 7fe7cf7fe700 1 -- 172.21.15.8:0/2483706417 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe7dc01b030 con 0x7fe7e80f77d0 2023-10-18T21:08:57.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.005+0000 7fe7cf7fe700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe7d0060f70 0x7fe7d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:08:57.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.006+0000 7fe7cf7fe700 1 -- 172.21.15.8:0/2483706417 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7532+0+0 (secure 0 0 0) 0x7fe7dc07c690 con 0x7fe7e80f77d0 2023-10-18T21:08:57.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.006+0000 7fe7e6d9d700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe7d0060f70 0x7fe7d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:08:57.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.006+0000 7fe7e6d9d700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe7d0060f70 0x7fe7d0063430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fe7d80043d0 tx=0x7fe7d800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:08:57.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.009+0000 7fe7cf7fe700 1 -- 172.21.15.8:0/2483706417 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe7dc04fe80 con 0x7fe7e80f77d0 2023-10-18T21:08:57.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.212+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/2483706417 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7e810ac40 con 0x7fe7d0060f70 2023-10-18T21:08:57.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.213+0000 7fe7cf7fe700 1 -- 172.21.15.8:0/2483706417 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe7e810ac40 con 0x7fe7d0060f70 2023-10-18T21:08:57.214 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:08:57.214 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:08:57.215 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:08:57.215 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:08:57.215 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:08:57.215 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:08:57.215 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:08:57.215 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:08:57.216 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:08:57.216 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:08:57.216 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:08:57.216 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:08:57.216 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:08:57.217 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:08:57.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/2483706417 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe7d0060f70 msgr2=0x7fe7d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:57.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe7d0060f70 0x7fe7d0063430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fe7d80043d0 tx=0x7fe7d800b040).stop 2023-10-18T21:08:57.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/2483706417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e80f77d0 msgr2=0x7fe7e8109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:08:57.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e80f77d0 0x7fe7e8109450 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe7dc00e7f0 tx=0x7fe7dc00b040).stop 2023-10-18T21:08:57.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/2483706417 shutdown_connections 2023-10-18T21:08:57.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe7d0060f70 0x7fe7d0063430 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:57.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7e80f6530 0x7fe7e8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:57.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 --2- 172.21.15.8:0/2483706417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e80f77d0 0x7fe7e8109450 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:08:57.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/2483706417 >> 172.21.15.8:0/2483706417 conn(0x7fe7e80f1c90 msgr2=0x7fe7e806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:08:57.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/2483706417 shutdown_connections 2023-10-18T21:08:57.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:08:57.215+0000 7fe7ec9ca700 1 -- 172.21.15.8:0/2483706417 wait complete. 2023-10-18T21:08:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:55.724272+0000 mgr.smithi008.flmjzp (mgr.14640) 570 : audit [DBG] from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:55.847710+0000 mgr.smithi008.flmjzp (mgr.14640) 571 : cluster [DBG] pgmap v415: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:56.068340+0000 mgr.smithi008.flmjzp (mgr.14640) 572 : audit [DBG] from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:56.481768+0000 mon.smithi008 (mon.0) 1012 : audit [DBG] from='client.? 172.21.15.8:0/1899958151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:56.860765+0000 mon.smithi008 (mon.0) 1013 : audit [DBG] from='client.? 172.21.15.8:0/2272470577' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:08:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:55.724272+0000 mgr.smithi008.flmjzp (mgr.14640) 570 : audit [DBG] from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:55.847710+0000 mgr.smithi008.flmjzp (mgr.14640) 571 : cluster [DBG] pgmap v415: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:56.068340+0000 mgr.smithi008.flmjzp (mgr.14640) 572 : audit [DBG] from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:56.481768+0000 mon.smithi008 (mon.0) 1012 : audit [DBG] from='client.? 172.21.15.8:0/1899958151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:56.860765+0000 mon.smithi008 (mon.0) 1013 : audit [DBG] from='client.? 172.21.15.8:0/2272470577' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:08:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:57.213350+0000 mgr.smithi008.flmjzp (mgr.14640) 573 : audit [DBG] from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:57.874582+0000 mon.smithi008 (mon.0) 1014 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:57.213350+0000 mgr.smithi008.flmjzp (mgr.14640) 573 : audit [DBG] from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:08:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:57.874582+0000 mon.smithi008 (mon.0) 1014 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:57.848157+0000 mgr.smithi008.flmjzp (mgr.14640) 574 : cluster [DBG] pgmap v416: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:58.442699+0000 mon.smithi008 (mon.0) 1015 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:58.443765+0000 mon.smithi008 (mon.0) 1016 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:58.444655+0000 mgr.smithi008.flmjzp (mgr.14640) 575 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:58.445281+0000 mgr.smithi008.flmjzp (mgr.14640) 576 : cluster [DBG] pgmap v417: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:08:58.445490+0000 mgr.smithi008.flmjzp (mgr.14640) 577 : cluster [DBG] pgmap v418: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:59.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:58.449835+0000 mon.smithi008 (mon.0) 1017 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:59.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:58.456402+0000 mon.smithi008 (mon.0) 1018 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:59.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:58.459678+0000 mon.smithi008 (mon.0) 1019 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:59.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:58.461469+0000 mon.smithi008 (mon.0) 1020 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:59.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:58.463129+0000 mon.smithi008 (mon.0) 1021 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:59.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:08:58.465156+0000 mon.smithi008 (mon.0) 1022 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:59.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:08:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:08:58.467104+0000 mgr.smithi008.flmjzp (mgr.14640) 578 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:08:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:57.848157+0000 mgr.smithi008.flmjzp (mgr.14640) 574 : cluster [DBG] pgmap v416: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:58.442699+0000 mon.smithi008 (mon.0) 1015 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:08:59.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:58.443765+0000 mon.smithi008 (mon.0) 1016 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:08:59.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:58.444655+0000 mgr.smithi008.flmjzp (mgr.14640) 575 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:08:59.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:58.445281+0000 mgr.smithi008.flmjzp (mgr.14640) 576 : cluster [DBG] pgmap v417: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:59.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:08:58.445490+0000 mgr.smithi008.flmjzp (mgr.14640) 577 : cluster [DBG] pgmap v418: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:08:59.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:58.449835+0000 mon.smithi008 (mon.0) 1017 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:08:59.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:58.456402+0000 mon.smithi008 (mon.0) 1018 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:08:59.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:58.459678+0000 mon.smithi008 (mon.0) 1019 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:59.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:58.461469+0000 mon.smithi008 (mon.0) 1020 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:59.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:58.463129+0000 mon.smithi008 (mon.0) 1021 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:59.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:08:58.465156+0000 mon.smithi008 (mon.0) 1022 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:08:59.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:08:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:08:58.467104+0000 mgr.smithi008.flmjzp (mgr.14640) 578 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:09:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:00.446174+0000 mgr.smithi008.flmjzp (mgr.14640) 579 : cluster [DBG] pgmap v419: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:00.446174+0000 mgr.smithi008.flmjzp (mgr.14640) 579 : cluster [DBG] pgmap v419: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:02.446657+0000 mgr.smithi008.flmjzp (mgr.14640) 580 : cluster [DBG] pgmap v420: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:02.446657+0000 mgr.smithi008.flmjzp (mgr.14640) 580 : cluster [DBG] pgmap v420: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:05.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:04.447281+0000 mgr.smithi008.flmjzp (mgr.14640) 581 : cluster [DBG] pgmap v421: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:04.447281+0000 mgr.smithi008.flmjzp (mgr.14640) 581 : cluster [DBG] pgmap v421: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:06.774 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:06.263785+0000 mon.smithi008 (mon.0) 1023 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm restarted 2023-10-18T21:09:06.774 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:06.268613+0000 mon.smithi008 (mon.0) 1024 : cluster [DBG] osdmap e105: 6 total, 6 up, 6 in 2023-10-18T21:09:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:09:06.505+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:09:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:06.263785+0000 mon.smithi008 (mon.0) 1023 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm restarted 2023-10-18T21:09:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:06.268613+0000 mon.smithi008 (mon.0) 1024 : cluster [DBG] osdmap e105: 6 total, 6 up, 6 in 2023-10-18T21:09:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:06.447680+0000 mgr.smithi008.flmjzp (mgr.14640) 582 : cluster [DBG] pgmap v423: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:06.505918+0000 mon.smithi008 (mon.0) 1025 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:09:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:06.512761+0000 mon.smithi008 (mon.0) 1026 : cluster [DBG] mds.? [v2:172.21.15.60:6824/2874723784,v1:172.21.15.60:6825/2874723784] up:boot 2023-10-18T21:09:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:06.512816+0000 mon.smithi008 (mon.0) 1027 : cluster [INF] Standby daemon mds.cephfs.smithi060.rvrncq assigned to filesystem cephfs as rank 0 2023-10-18T21:09:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:06.512898+0000 mon.smithi008 (mon.0) 1028 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:09:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:06.513145+0000 mon.smithi008 (mon.0) 1029 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:09:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:06.513293+0000 mon.smithi008 (mon.0) 1030 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:09:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:06.516094+0000 mon.smithi008 (mon.0) 1031 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 1 up:standby 2023-10-18T21:09:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:06.447680+0000 mgr.smithi008.flmjzp (mgr.14640) 582 : cluster [DBG] pgmap v423: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:06.505918+0000 mon.smithi008 (mon.0) 1025 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:09:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:06.512761+0000 mon.smithi008 (mon.0) 1026 : cluster [DBG] mds.? [v2:172.21.15.60:6824/2874723784,v1:172.21.15.60:6825/2874723784] up:boot 2023-10-18T21:09:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:06.512816+0000 mon.smithi008 (mon.0) 1027 : cluster [INF] Standby daemon mds.cephfs.smithi060.rvrncq assigned to filesystem cephfs as rank 0 2023-10-18T21:09:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:06.512898+0000 mon.smithi008 (mon.0) 1028 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:09:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:06.513145+0000 mon.smithi008 (mon.0) 1029 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:09:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:06.513293+0000 mon.smithi008 (mon.0) 1030 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:09:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:06.516094+0000 mon.smithi008 (mon.0) 1031 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 1 up:standby 2023-10-18T21:09:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:08.469437+0000 mon.smithi008 (mon.0) 1032 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:08.471664+0000 mon.smithi008 (mon.0) 1033 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:09:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:08.472727+0000 mon.smithi008 (mon.0) 1034 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:09:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:08.479199+0000 mon.smithi008 (mon.0) 1035 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:08.485707+0000 mon.smithi008 (mon.0) 1036 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:08.488958+0000 mon.smithi008 (mon.0) 1037 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:08.490682+0000 mon.smithi008 (mon.0) 1038 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:08.492318+0000 mon.smithi008 (mon.0) 1039 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:08.494369+0000 mon.smithi008 (mon.0) 1040 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:08.469437+0000 mon.smithi008 (mon.0) 1032 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:08.471664+0000 mon.smithi008 (mon.0) 1033 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:09:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:08.472727+0000 mon.smithi008 (mon.0) 1034 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:09:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:08.479199+0000 mon.smithi008 (mon.0) 1035 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:08.485707+0000 mon.smithi008 (mon.0) 1036 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:08.488958+0000 mon.smithi008 (mon.0) 1037 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:08.490682+0000 mon.smithi008 (mon.0) 1038 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:08.492318+0000 mon.smithi008 (mon.0) 1039 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:08.494369+0000 mon.smithi008 (mon.0) 1040 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:08.448221+0000 mgr.smithi008.flmjzp (mgr.14640) 583 : cluster [DBG] pgmap v424: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:08.473663+0000 mgr.smithi008.flmjzp (mgr.14640) 584 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:09:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:08.474218+0000 mgr.smithi008.flmjzp (mgr.14640) 585 : cluster [DBG] pgmap v425: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:08.474482+0000 mgr.smithi008.flmjzp (mgr.14640) 586 : cluster [DBG] pgmap v426: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:09.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:08.496416+0000 mgr.smithi008.flmjzp (mgr.14640) 587 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:09:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:08.448221+0000 mgr.smithi008.flmjzp (mgr.14640) 583 : cluster [DBG] pgmap v424: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:08.473663+0000 mgr.smithi008.flmjzp (mgr.14640) 584 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:09:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:08.474218+0000 mgr.smithi008.flmjzp (mgr.14640) 585 : cluster [DBG] pgmap v425: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:08.474482+0000 mgr.smithi008.flmjzp (mgr.14640) 586 : cluster [DBG] pgmap v426: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:08.496416+0000 mgr.smithi008.flmjzp (mgr.14640) 587 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:09:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:10.475070+0000 mgr.smithi008.flmjzp (mgr.14640) 588 : cluster [DBG] pgmap v427: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:10.475070+0000 mgr.smithi008.flmjzp (mgr.14640) 588 : cluster [DBG] pgmap v427: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:12.475750+0000 mgr.smithi008.flmjzp (mgr.14640) 589 : cluster [DBG] pgmap v428: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:12.475750+0000 mgr.smithi008.flmjzp (mgr.14640) 589 : cluster [DBG] pgmap v428: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:14.476279+0000 mgr.smithi008.flmjzp (mgr.14640) 590 : cluster [DBG] pgmap v429: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:14.476279+0000 mgr.smithi008.flmjzp (mgr.14640) 590 : cluster [DBG] pgmap v429: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:16.476778+0000 mgr.smithi008.flmjzp (mgr.14640) 591 : cluster [DBG] pgmap v430: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:16.476778+0000 mgr.smithi008.flmjzp (mgr.14640) 591 : cluster [DBG] pgmap v430: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: debug 2023-10-18T21:09:18.540+0000 7f16b7b1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:09:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:17.745268+0000 mon.smithi008 (mon.0) 1041 : cluster [INF] daemon mds.cephfs.smithi060.rvrncq restarted 2023-10-18T21:09:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:17.750378+0000 mon.smithi008 (mon.0) 1042 : cluster [DBG] osdmap e106: 6 total, 6 up, 6 in 2023-10-18T21:09:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:18.507114+0000 mon.smithi008 (mon.0) 1043 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:18.509395+0000 mon.smithi008 (mon.0) 1044 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:09:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:18.510444+0000 mon.smithi008 (mon.0) 1045 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:09:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:18.516562+0000 mon.smithi008 (mon.0) 1046 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:18.524849+0000 mon.smithi008 (mon.0) 1047 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:18.528635+0000 mon.smithi008 (mon.0) 1048 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:18.530675+0000 mon.smithi008 (mon.0) 1049 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:18.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:18.532325+0000 mon.smithi008 (mon.0) 1050 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:18.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:18.534265+0000 mon.smithi008 (mon.0) 1051 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:18.839 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:17.745268+0000 mon.smithi008 (mon.0) 1041 : cluster [INF] daemon mds.cephfs.smithi060.rvrncq restarted 2023-10-18T21:09:18.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:17.750378+0000 mon.smithi008 (mon.0) 1042 : cluster [DBG] osdmap e106: 6 total, 6 up, 6 in 2023-10-18T21:09:18.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:18.507114+0000 mon.smithi008 (mon.0) 1043 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:18.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:18.509395+0000 mon.smithi008 (mon.0) 1044 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:09:18.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:18.510444+0000 mon.smithi008 (mon.0) 1045 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:09:18.841 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:18.516562+0000 mon.smithi008 (mon.0) 1046 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:18.841 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:18.524849+0000 mon.smithi008 (mon.0) 1047 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:18.841 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:18.528635+0000 mon.smithi008 (mon.0) 1048 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:18.841 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:18.530675+0000 mon.smithi008 (mon.0) 1049 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:18.842 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:18.532325+0000 mon.smithi008 (mon.0) 1050 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:18.842 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:18.534265+0000 mon.smithi008 (mon.0) 1051 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:18.477332+0000 mgr.smithi008.flmjzp (mgr.14640) 592 : cluster [DBG] pgmap v432: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:18.511346+0000 mgr.smithi008.flmjzp (mgr.14640) 593 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:09:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:18.511917+0000 mgr.smithi008.flmjzp (mgr.14640) 594 : cluster [DBG] pgmap v433: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:18.512131+0000 mgr.smithi008.flmjzp (mgr.14640) 595 : cluster [DBG] pgmap v434: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:18.536208+0000 mgr.smithi008.flmjzp (mgr.14640) 596 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:09:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:18.540590+0000 mon.smithi008 (mon.0) 1052 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:09:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:18.548304+0000 mon.smithi008 (mon.0) 1053 : cluster [DBG] mds.? [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] up:boot 2023-10-18T21:09:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:18.548368+0000 mon.smithi008 (mon.0) 1054 : cluster [INF] Standby daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 0 2023-10-18T21:09:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:18.548506+0000 mon.smithi008 (mon.0) 1055 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:09:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:18.548779+0000 mon.smithi008 (mon.0) 1056 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:09:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:18.548907+0000 mon.smithi008 (mon.0) 1057 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:09:19.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:18.551418+0000 mon.smithi008 (mon.0) 1058 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:09:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:18.477332+0000 mgr.smithi008.flmjzp (mgr.14640) 592 : cluster [DBG] pgmap v432: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:18.511346+0000 mgr.smithi008.flmjzp (mgr.14640) 593 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:09:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:18.511917+0000 mgr.smithi008.flmjzp (mgr.14640) 594 : cluster [DBG] pgmap v433: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:18.512131+0000 mgr.smithi008.flmjzp (mgr.14640) 595 : cluster [DBG] pgmap v434: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:18.536208+0000 mgr.smithi008.flmjzp (mgr.14640) 596 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:09:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:18.540590+0000 mon.smithi008 (mon.0) 1052 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T21:09:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:18.548304+0000 mon.smithi008 (mon.0) 1053 : cluster [DBG] mds.? [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] up:boot 2023-10-18T21:09:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:18.548368+0000 mon.smithi008 (mon.0) 1054 : cluster [INF] Standby daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 0 2023-10-18T21:09:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:18.548506+0000 mon.smithi008 (mon.0) 1055 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T21:09:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:18.548779+0000 mon.smithi008 (mon.0) 1056 : cluster [DBG] fsmap cephfs:0/1 2 up:standby, 1 failed 2023-10-18T21:09:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:18.548907+0000 mon.smithi008 (mon.0) 1057 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.rvrncq"}]: dispatch 2023-10-18T21:09:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:18.551418+0000 mon.smithi008 (mon.0) 1058 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:09:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:20.512810+0000 mgr.smithi008.flmjzp (mgr.14640) 597 : cluster [DBG] pgmap v435: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:20.512810+0000 mgr.smithi008.flmjzp (mgr.14640) 597 : cluster [DBG] pgmap v435: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:22.513417+0000 mgr.smithi008.flmjzp (mgr.14640) 598 : cluster [DBG] pgmap v436: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:22.513417+0000 mgr.smithi008.flmjzp (mgr.14640) 598 : cluster [DBG] pgmap v436: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:24.514015+0000 mgr.smithi008.flmjzp (mgr.14640) 599 : cluster [DBG] pgmap v437: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:24.514015+0000 mgr.smithi008.flmjzp (mgr.14640) 599 : cluster [DBG] pgmap v437: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:27.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.368+0000 7f7cf219d700 1 -- 172.21.15.8:0/3038129069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cec060310 msgr2=0x7f7cec0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:27.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.368+0000 7f7cf219d700 1 --2- 172.21.15.8:0/3038129069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cec060310 0x7f7cec0f9110 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7ce8004660 tx=0x7f7ce8009b30).stop 2023-10-18T21:09:27.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.368+0000 7f7cf219d700 1 -- 172.21.15.8:0/3038129069 shutdown_connections 2023-10-18T21:09:27.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.368+0000 7f7cf219d700 1 --2- 172.21.15.8:0/3038129069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0f9690 0x7f7cec0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:27.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.368+0000 7f7cf219d700 1 --2- 172.21.15.8:0/3038129069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cec060310 0x7f7cec0f9110 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:27.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.368+0000 7f7cf219d700 1 -- 172.21.15.8:0/3038129069 >> 172.21.15.8:0/3038129069 conn(0x7f7cec0f0b90 msgr2=0x7f7cec0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:27.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.368+0000 7f7cf219d700 1 -- 172.21.15.8:0/3038129069 shutdown_connections 2023-10-18T21:09:27.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.368+0000 7f7cf219d700 1 -- 172.21.15.8:0/3038129069 wait complete. 2023-10-18T21:09:27.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.369+0000 7f7cf219d700 1 Processor -- start 2023-10-18T21:09:27.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.369+0000 7f7cf219d700 1 -- start start 2023-10-18T21:09:27.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.369+0000 7f7cf219d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec060310 0x7f7cec108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:27.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.369+0000 7f7cf219d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cec0f9690 0x7f7cec109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:27.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.369+0000 7f7cf219d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec109a10 con 0x7f7cec0f9690 2023-10-18T21:09:27.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.369+0000 7f7cf219d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec109b50 con 0x7f7cec060310 2023-10-18T21:09:27.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.370+0000 7f7cf099a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cec0f9690 0x7f7cec109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:27.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.370+0000 7f7cf099a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cec0f9690 0x7f7cec109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50642/0 (socket says 172.21.15.8:50642) 2023-10-18T21:09:27.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.370+0000 7f7cf099a700 1 -- 172.21.15.8:0/1685829151 learned_addr learned my addr 172.21.15.8:0/1685829151 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:09:27.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.370+0000 7f7cf119b700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec060310 0x7f7cec108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:27.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.370+0000 7f7cf099a700 1 -- 172.21.15.8:0/1685829151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec060310 msgr2=0x7f7cec108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:27.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.370+0000 7f7cf099a700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec060310 0x7f7cec108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:27.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.370+0000 7f7cf099a700 1 -- 172.21.15.8:0/1685829151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce8005040 con 0x7f7cec0f9690 2023-10-18T21:09:27.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.370+0000 7f7cf099a700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cec0f9690 0x7f7cec109460 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f7cdc002700 tx=0x7f7cdc009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:27.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.371+0000 7f7ce1ffb700 1 -- 172.21.15.8:0/1685829151 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cdc0079c0 con 0x7f7cec0f9690 2023-10-18T21:09:27.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.371+0000 7f7cf219d700 1 -- 172.21.15.8:0/1685829151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec10a4f0 con 0x7f7cec0f9690 2023-10-18T21:09:27.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.371+0000 7f7ce1ffb700 1 -- 172.21.15.8:0/1685829151 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7cdc00f040 con 0x7f7cec0f9690 2023-10-18T21:09:27.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.371+0000 7f7ce1ffb700 1 -- 172.21.15.8:0/1685829151 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cdc014800 con 0x7f7cec0f9690 2023-10-18T21:09:27.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.371+0000 7f7cf219d700 1 -- 172.21.15.8:0/1685829151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cec10aab0 con 0x7f7cec0f9690 2023-10-18T21:09:27.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.372+0000 7f7cf219d700 1 -- 172.21.15.8:0/1685829151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cec045ad0 con 0x7f7cec0f9690 2023-10-18T21:09:27.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.373+0000 7f7ce1ffb700 1 -- 172.21.15.8:0/1685829151 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7cdc01b060 con 0x7f7cec0f9690 2023-10-18T21:09:27.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.374+0000 7f7ce1ffb700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cd8060f70 0x7f7cd8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:27.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.374+0000 7f7ce1ffb700 1 -- 172.21.15.8:0/1685829151 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7704+0+0 (secure 0 0 0) 0x7f7cdc07c790 con 0x7f7cec0f9690 2023-10-18T21:09:27.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.374+0000 7f7cf119b700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cd8060f70 0x7f7cd8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:27.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.374+0000 7f7cf119b700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cd8060f70 0x7f7cd8063430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f7ce8004630 tx=0x7f7ce8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:27.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.378+0000 7f7ce1ffb700 1 -- 172.21.15.8:0/1685829151 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7cdc04fe20 con 0x7f7cec0f9690 2023-10-18T21:09:27.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.578+0000 7f7cf219d700 1 -- 172.21.15.8:0/1685829151 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cec0f5670 con 0x7f7cd8060f70 2023-10-18T21:09:27.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.579+0000 7f7ce1ffb700 1 -- 172.21.15.8:0/1685829151 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7cec0f5670 con 0x7f7cd8060f70 2023-10-18T21:09:27.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.581+0000 7f7cf219d700 1 -- 172.21.15.8:0/1685829151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cd8060f70 msgr2=0x7f7cd8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:27.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.581+0000 7f7cf219d700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cd8060f70 0x7f7cd8063430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f7ce8004630 tx=0x7f7ce8009b30).stop 2023-10-18T21:09:27.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.581+0000 7f7cf219d700 1 -- 172.21.15.8:0/1685829151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cec0f9690 msgr2=0x7f7cec109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:27.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.581+0000 7f7cf219d700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cec0f9690 0x7f7cec109460 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f7cdc002700 tx=0x7f7cdc009d60).stop 2023-10-18T21:09:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.581+0000 7f7cf219d700 1 -- 172.21.15.8:0/1685829151 shutdown_connections 2023-10-18T21:09:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.581+0000 7f7cf219d700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cd8060f70 0x7f7cd8063430 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.581+0000 7f7cf219d700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec060310 0x7f7cec108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.581+0000 7f7cf219d700 1 --2- 172.21.15.8:0/1685829151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cec0f9690 0x7f7cec109460 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.582+0000 7f7cf219d700 1 -- 172.21.15.8:0/1685829151 >> 172.21.15.8:0/1685829151 conn(0x7f7cec0f0b90 msgr2=0x7f7cec0f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.582+0000 7f7cf219d700 1 -- 172.21.15.8:0/1685829151 shutdown_connections 2023-10-18T21:09:27.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.582+0000 7f7cf219d700 1 -- 172.21.15.8:0/1685829151 wait complete. 2023-10-18T21:09:27.598 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:09:27.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.720+0000 7f3bc7fff700 1 -- 172.21.15.8:0/1857484520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bc80f6530 msgr2=0x7f3bc80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:27.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.720+0000 7f3bc7fff700 1 --2- 172.21.15.8:0/1857484520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bc80f6530 0x7f3bc80f6950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f3bb8004660 tx=0x7f3bb8009b30).stop 2023-10-18T21:09:27.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.720+0000 7f3bc7fff700 1 -- 172.21.15.8:0/1857484520 shutdown_connections 2023-10-18T21:09:27.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.720+0000 7f3bc7fff700 1 --2- 172.21.15.8:0/1857484520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc80f77d0 0x7f3bc80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:27.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.720+0000 7f3bc7fff700 1 --2- 172.21.15.8:0/1857484520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bc80f6530 0x7f3bc80f6950 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:27.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.720+0000 7f3bc7fff700 1 -- 172.21.15.8:0/1857484520 >> 172.21.15.8:0/1857484520 conn(0x7f3bc80f1c90 msgr2=0x7f3bc80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:27.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.720+0000 7f3bc7fff700 1 -- 172.21.15.8:0/1857484520 shutdown_connections 2023-10-18T21:09:27.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.720+0000 7f3bc7fff700 1 -- 172.21.15.8:0/1857484520 wait complete. 2023-10-18T21:09:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.721+0000 7f3bc7fff700 1 Processor -- start 2023-10-18T21:09:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.721+0000 7f3bc7fff700 1 -- start start 2023-10-18T21:09:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc80f6530 0x7f3bc806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bc80f77d0 0x7f3bc8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc806a380 con 0x7f3bc80f77d0 2023-10-18T21:09:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc806a4c0 con 0x7f3bc80f6530 2023-10-18T21:09:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bc80f77d0 0x7f3bc8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bc80f77d0 0x7f3bc8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50660/0 (socket says 172.21.15.8:50660) 2023-10-18T21:09:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc67fc700 1 -- 172.21.15.8:0/4141630123 learned_addr learned my addr 172.21.15.8:0/4141630123 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:09:27.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc67fc700 1 -- 172.21.15.8:0/4141630123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc80f6530 msgr2=0x7f3bc806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:27.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc67fc700 1 --2- 172.21.15.8:0/4141630123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc80f6530 0x7f3bc806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:09:27.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc67fc700 1 -- 172.21.15.8:0/4141630123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8005040 con 0x7f3bc80f77d0 2023-10-18T21:09:27.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.722+0000 7f3bc67fc700 1 --2- 172.21.15.8:0/4141630123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bc80f77d0 0x7f3bc8069e20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f3bbc002700 tx=0x7f3bbc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:27.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.723+0000 7f3baf7fe700 1 -- 172.21.15.8:0/4141630123 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bbc009320 con 0x7f3bc80f77d0 2023-10-18T21:09:27.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.723+0000 7f3baf7fe700 1 -- 172.21.15.8:0/4141630123 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3bbc00f040 con 0x7f3bc80f77d0 2023-10-18T21:09:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.723+0000 7f3baf7fe700 1 -- 172.21.15.8:0/4141630123 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bbc0148a0 con 0x7f3bc80f77d0 2023-10-18T21:09:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.723+0000 7f3bc7fff700 1 -- 172.21.15.8:0/4141630123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc806a7a0 con 0x7f3bc80f77d0 2023-10-18T21:09:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.723+0000 7f3bc7fff700 1 -- 172.21.15.8:0/4141630123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc810ed60 con 0x7f3bc80f77d0 2023-10-18T21:09:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.724+0000 7f3bc7fff700 1 -- 172.21.15.8:0/4141630123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc8045ad0 con 0x7f3bc80f77d0 2023-10-18T21:09:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.725+0000 7f3baf7fe700 1 -- 172.21.15.8:0/4141630123 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3bbc009480 con 0x7f3bc80f77d0 2023-10-18T21:09:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.726+0000 7f3baf7fe700 1 --2- 172.21.15.8:0/4141630123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3bb0060f70 0x7f3bb0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.726+0000 7f3baf7fe700 1 -- 172.21.15.8:0/4141630123 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7704+0+0 (secure 0 0 0) 0x7f3bbc07cbe0 con 0x7f3bc80f77d0 2023-10-18T21:09:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.726+0000 7f3bc6ffd700 1 --2- 172.21.15.8:0/4141630123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3bb0060f70 0x7f3bb0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.726+0000 7f3bc6ffd700 1 --2- 172.21.15.8:0/4141630123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3bb0060f70 0x7f3bb0063430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3bb8009f50 tx=0x7f3bb8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:27.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.731+0000 7f3baf7fe700 1 -- 172.21.15.8:0/4141630123 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3bbc04c7e0 con 0x7f3bc80f77d0 2023-10-18T21:09:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:26.514510+0000 mgr.smithi008.flmjzp (mgr.14640) 600 : cluster [DBG] pgmap v438: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:27.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.939+0000 7f3bc7fff700 1 -- 172.21.15.8:0/4141630123 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bc8057f10 con 0x7f3bb0060f70 2023-10-18T21:09:27.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.941+0000 7f3baf7fe700 1 -- 172.21.15.8:0/4141630123 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3bc8057f10 con 0x7f3bb0060f70 2023-10-18T21:09:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.943+0000 7f3bc7fff700 1 -- 172.21.15.8:0/4141630123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3bb0060f70 msgr2=0x7f3bb0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.943+0000 7f3bc7fff700 1 --2- 172.21.15.8:0/4141630123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3bb0060f70 0x7f3bb0063430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3bb8009f50 tx=0x7f3bb8009b30).stop 2023-10-18T21:09:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.943+0000 7f3bc7fff700 1 -- 172.21.15.8:0/4141630123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bc80f77d0 msgr2=0x7f3bc8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.943+0000 7f3bc7fff700 1 --2- 172.21.15.8:0/4141630123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bc80f77d0 0x7f3bc8069e20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f3bbc002700 tx=0x7f3bbc009e00).stop 2023-10-18T21:09:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.943+0000 7f3bc7fff700 1 -- 172.21.15.8:0/4141630123 shutdown_connections 2023-10-18T21:09:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.943+0000 7f3bc7fff700 1 --2- 172.21.15.8:0/4141630123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3bb0060f70 0x7f3bb0063430 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.943+0000 7f3bc7fff700 1 --2- 172.21.15.8:0/4141630123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc80f6530 0x7f3bc806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:09:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.943+0000 7f3bc7fff700 1 --2- 172.21.15.8:0/4141630123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bc80f77d0 0x7f3bc8069e20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.943+0000 7f3bc7fff700 1 -- 172.21.15.8:0/4141630123 >> 172.21.15.8:0/4141630123 conn(0x7f3bc80f1c90 msgr2=0x7f3bc80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.944+0000 7f3bc7fff700 1 -- 172.21.15.8:0/4141630123 shutdown_connections 2023-10-18T21:09:27.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:27.944+0000 7f3bc7fff700 1 -- 172.21.15.8:0/4141630123 wait complete. 2023-10-18T21:09:27.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:26.514510+0000 mgr.smithi008.flmjzp (mgr.14640) 600 : cluster [DBG] pgmap v438: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:28.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.082+0000 7f9b0359e700 1 -- 172.21.15.8:0/2050896403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 msgr2=0x7f9b040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:28.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.082+0000 7f9b0359e700 1 --2- 172.21.15.8:0/2050896403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b040f6950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f9af4004660 tx=0x7f9af4009b30).stop 2023-10-18T21:09:28.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.083+0000 7f9b0359e700 1 -- 172.21.15.8:0/2050896403 shutdown_connections 2023-10-18T21:09:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.083+0000 7f9b0359e700 1 --2- 172.21.15.8:0/2050896403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 0x7f9b040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.083+0000 7f9b0359e700 1 --2- 172.21.15.8:0/2050896403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b040f6950 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.083+0000 7f9b0359e700 1 -- 172.21.15.8:0/2050896403 >> 172.21.15.8:0/2050896403 conn(0x7f9b040f1c90 msgr2=0x7f9b040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.083+0000 7f9b0359e700 1 -- 172.21.15.8:0/2050896403 shutdown_connections 2023-10-18T21:09:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.083+0000 7f9b0359e700 1 -- 172.21.15.8:0/2050896403 wait complete. 2023-10-18T21:09:28.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.084+0000 7f9b0359e700 1 Processor -- start 2023-10-18T21:09:28.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.084+0000 7f9b0359e700 1 -- start start 2023-10-18T21:09:28.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b0359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:28.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b0359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 0x7f9b04069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:28.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b0359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0406a380 con 0x7f9b040f6530 2023-10-18T21:09:28.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b0359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0406a4c0 con 0x7f9b040f77d0 2023-10-18T21:09:28.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b0259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:28.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b0259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50688/0 (socket says 172.21.15.8:50688) 2023-10-18T21:09:28.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b0259c700 1 -- 172.21.15.8:0/1673599314 learned_addr learned my addr 172.21.15.8:0/1673599314 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:09:28.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b01d9b700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 0x7f9b04069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:28.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b0259c700 1 -- 172.21.15.8:0/1673599314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 msgr2=0x7f9b04069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:28.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b0259c700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 0x7f9b04069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b0259c700 1 -- 172.21.15.8:0/1673599314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4005040 con 0x7f9b040f6530 2023-10-18T21:09:28.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.085+0000 7f9b01d9b700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 0x7f9b04069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:09:28.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.086+0000 7f9b0259c700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f9af4007a70 tx=0x7f9af4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:28.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.086+0000 7f9af2ffd700 1 -- 172.21.15.8:0/1673599314 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af4018070 con 0x7f9b040f6530 2023-10-18T21:09:28.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.086+0000 7f9af2ffd700 1 -- 172.21.15.8:0/1673599314 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9af401d8e0 con 0x7f9b040f6530 2023-10-18T21:09:28.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.086+0000 7f9af2ffd700 1 -- 172.21.15.8:0/1673599314 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af401c660 con 0x7f9b040f6530 2023-10-18T21:09:28.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.086+0000 7f9b0359e700 1 -- 172.21.15.8:0/1673599314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0406a740 con 0x7f9b040f6530 2023-10-18T21:09:28.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.086+0000 7f9b0359e700 1 -- 172.21.15.8:0/1673599314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0406ac50 con 0x7f9b040f6530 2023-10-18T21:09:28.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.088+0000 7f9b0359e700 1 -- 172.21.15.8:0/1673599314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b04045ad0 con 0x7f9b040f6530 2023-10-18T21:09:28.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.089+0000 7f9af2ffd700 1 -- 172.21.15.8:0/1673599314 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9af401da50 con 0x7f9b040f6530 2023-10-18T21:09:28.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.090+0000 7f9af2ffd700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 0x7f9aec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:28.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.090+0000 7f9af2ffd700 1 -- 172.21.15.8:0/1673599314 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7704+0+0 (secure 0 0 0) 0x7f9af407e820 con 0x7f9b040f6530 2023-10-18T21:09:28.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.090+0000 7f9b01d9b700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 0x7f9aec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:28.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.091+0000 7f9b01d9b700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 0x7f9aec063430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f9af8004ac0 tx=0x7f9af8009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.095+0000 7f9af2ffd700 1 -- 172.21.15.8:0/1673599314 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9af404e540 con 0x7f9b040f6530 2023-10-18T21:09:28.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.290+0000 7f9b0359e700 1 -- 172.21.15.8:0/1673599314 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b040008d0 con 0x7f9aec060f70 2023-10-18T21:09:28.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.299+0000 7f9af2ffd700 1 -- 172.21.15.8:0/1673599314 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9b040008d0 con 0x7f9aec060f70 2023-10-18T21:09:28.302 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:09:28.302 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (16m) 4m ago 17m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:09:28.302 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (10m) 4m ago 17m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:09:28.303 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (9m) 2m ago 16m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:09:28.303 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (16m) 4m ago 17m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:09:28.304 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (4m) 4m ago 13m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:09:28.304 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 13m - - 2023-10-18T21:09:28.304 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (2m) 2m ago 13m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:09:28.304 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (2m) 2m ago 13m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:09:28.305 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (11m) 4m ago 18m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:09:28.305 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (10m) 2m ago 16m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:09:28.305 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (10m) 4m ago 19m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:09:28.305 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (10m) 2m ago 16m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:09:28.305 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (17m) 4m ago 17m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:09:28.306 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (16m) 2m ago 16m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:09:28.306 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (9m) 4m ago 16m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:09:28.306 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (7m) 4m ago 15m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:09:28.306 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (7m) 4m ago 15m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:09:28.307 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (6m) 2m ago 15m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:09:28.307 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (6m) 2m ago 15m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:09:28.307 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (5m) 2m ago 14m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:09:28.307 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (11m) 4m ago 16m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:09:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.301+0000 7f9b0359e700 1 -- 172.21.15.8:0/1673599314 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 msgr2=0x7f9aec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:28.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.301+0000 7f9b0359e700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 0x7f9aec063430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f9af8004ac0 tx=0x7f9af8009040).stop 2023-10-18T21:09:28.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.301+0000 7f9b0359e700 1 -- 172.21.15.8:0/1673599314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 msgr2=0x7f9b0406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:28.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.301+0000 7f9b0359e700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f9af4007a70 tx=0x7f9af4009b30).stop 2023-10-18T21:09:28.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.301+0000 7f9b0359e700 1 -- 172.21.15.8:0/1673599314 shutdown_connections 2023-10-18T21:09:28.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.301+0000 7f9b0359e700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 0x7f9aec063430 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.301+0000 7f9b0359e700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.301+0000 7f9b0359e700 1 --2- 172.21.15.8:0/1673599314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 0x7f9b04069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.301+0000 7f9b0359e700 1 -- 172.21.15.8:0/1673599314 >> 172.21.15.8:0/1673599314 conn(0x7f9b040f1c90 msgr2=0x7f9b040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:28.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.302+0000 7f9b0359e700 1 -- 172.21.15.8:0/1673599314 shutdown_connections 2023-10-18T21:09:28.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.302+0000 7f9b0359e700 1 -- 172.21.15.8:0/1673599314 wait complete. 2023-10-18T21:09:28.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.441+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2547577938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8ec0f66e0 msgr2=0x7fa8ec0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:28.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.441+0000 7fa8f2bc2700 1 --2- 172.21.15.8:0/2547577938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec0f6b00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fa8e0004660 tx=0x7fa8e0009b30).stop 2023-10-18T21:09:28.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.441+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2547577938 shutdown_connections 2023-10-18T21:09:28.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.441+0000 7fa8f2bc2700 1 --2- 172.21.15.8:0/2547577938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.441+0000 7fa8f2bc2700 1 --2- 172.21.15.8:0/2547577938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec0f6b00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.441+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2547577938 >> 172.21.15.8:0/2547577938 conn(0x7fa8ec0f1e40 msgr2=0x7fa8ec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:28.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.441+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2547577938 shutdown_connections 2023-10-18T21:09:28.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.441+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2547577938 wait complete. 2023-10-18T21:09:28.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.442+0000 7fa8f2bc2700 1 Processor -- start 2023-10-18T21:09:28.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.443+0000 7fa8f2bc2700 1 -- start start 2023-10-18T21:09:28.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.443+0000 7fa8f2bc2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:28.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.443+0000 7fa8f2bc2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:28.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.443+0000 7fa8f2bc2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec06a380 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.443+0000 7fa8f2bc2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec06a4c0 con 0x7fa8ec0f7980 2023-10-18T21:09:28.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.443+0000 7fa8f095e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:28.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.443+0000 7fa8f095e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50726/0 (socket says 172.21.15.8:50726) 2023-10-18T21:09:28.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.443+0000 7fa8f095e700 1 -- 172.21.15.8:0/2942505999 learned_addr learned my addr 172.21.15.8:0/2942505999 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:09:28.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.443+0000 7fa8ebfff700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:28.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.444+0000 7fa8f095e700 1 -- 172.21.15.8:0/2942505999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ec0f7980 msgr2=0x7fa8ec069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:28.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.444+0000 7fa8f095e700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.444+0000 7fa8f095e700 1 -- 172.21.15.8:0/2942505999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e0005040 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.444+0000 7fa8f095e700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec06b9a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fa8e0004e30 tx=0x7fa8e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:28.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.444+0000 7fa8e97fa700 1 -- 172.21.15.8:0/2942505999 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8e0018070 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.444+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2942505999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec06a740 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.444+0000 7fa8e97fa700 1 -- 172.21.15.8:0/2942505999 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa8e0009630 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.444+0000 7fa8e97fa700 1 -- 172.21.15.8:0/2942505999 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8e001c3c0 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.444+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2942505999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec06aca0 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.446+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2942505999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec045ad0 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.447+0000 7fa8e97fa700 1 -- 172.21.15.8:0/2942505999 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa8e001d420 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.448+0000 7fa8e97fa700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8dc060f20 0x7fa8dc0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:28.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.448+0000 7fa8e97fa700 1 -- 172.21.15.8:0/2942505999 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7704+0+0 (secure 0 0 0) 0x7fa8e007e480 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.448+0000 7fa8ebfff700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8dc060f20 0x7fa8dc0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:28.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.449+0000 7fa8ebfff700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8dc060f20 0x7fa8dc0633e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fa8d8004e20 tx=0x7fa8d800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.453+0000 7fa8e97fa700 1 -- 172.21.15.8:0/2942505999 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa8e004e0e0 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.719+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2942505999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa8ec0fef10 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.720+0000 7fa8e97fa700 1 -- 172.21.15.8:0/2942505999 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fa8e0051700 con 0x7fa8ec0f66e0 2023-10-18T21:09:28.723 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:09:28.723 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:09:28.723 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:09:28.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:09:28.723 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:09:28.724 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:09:28.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:09:28.724 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:09:28.724 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:09:28.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:09:28.725 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:09:28.725 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:09:28.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:09:28.725 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:09:28.726 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 12 2023-10-18T21:09:28.726 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:09:28.726 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:09:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.722+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2942505999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8dc060f20 msgr2=0x7fa8dc0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.722+0000 7fa8f2bc2700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8dc060f20 0x7fa8dc0633e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fa8d8004e20 tx=0x7fa8d800b040).stop 2023-10-18T21:09:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.722+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2942505999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8ec0f66e0 msgr2=0x7fa8ec06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.722+0000 7fa8f2bc2700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec06b9a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fa8e0004e30 tx=0x7fa8e0009b30).stop 2023-10-18T21:09:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.722+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2942505999 shutdown_connections 2023-10-18T21:09:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.722+0000 7fa8f2bc2700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8dc060f20 0x7fa8dc0633e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.722+0000 7fa8f2bc2700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8ec0f66e0 0x7fa8ec06b9a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.722+0000 7fa8f2bc2700 1 --2- 172.21.15.8:0/2942505999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8ec0f7980 0x7fa8ec069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.722+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2942505999 >> 172.21.15.8:0/2942505999 conn(0x7fa8ec0f1e40 msgr2=0x7fa8ec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.723+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2942505999 shutdown_connections 2023-10-18T21:09:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.723+0000 7fa8f2bc2700 1 -- 172.21.15.8:0/2942505999 wait complete. 2023-10-18T21:09:28.812 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:27.580753+0000 mgr.smithi008.flmjzp (mgr.14640) 601 : audit [DBG] from='client.34656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:28.813 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.065320+0000 mon.smithi008 (mon.0) 1059 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:28.813 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.421202+0000 mon.smithi008 (mon.0) 1060 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:28.813 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.546034+0000 mon.smithi008 (mon.0) 1061 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:28.813 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.547899+0000 mon.smithi008 (mon.0) 1062 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:09:28.814 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.548773+0000 mon.smithi008 (mon.0) 1063 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:09:28.814 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.554109+0000 mon.smithi008 (mon.0) 1064 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:28.814 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.562612+0000 mon.smithi008 (mon.0) 1065 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:28.814 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.566043+0000 mon.smithi008 (mon.0) 1066 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:28.814 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.567925+0000 mon.smithi008 (mon.0) 1067 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:28.815 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.569298+0000 mon.smithi008 (mon.0) 1068 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:28.815 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.571312+0000 mon.smithi008 (mon.0) 1069 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.864+0000 7f57e480f700 1 -- 172.21.15.8:0/3279441339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57e00f77d0 msgr2=0x7f57e00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.864+0000 7f57e480f700 1 --2- 172.21.15.8:0/3279441339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57e00f77d0 0x7f57e00f7c30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f57d4004660 tx=0x7f57d4009b30).stop 2023-10-18T21:09:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.864+0000 7f57e480f700 1 -- 172.21.15.8:0/3279441339 shutdown_connections 2023-10-18T21:09:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.864+0000 7f57e480f700 1 --2- 172.21.15.8:0/3279441339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57e00f77d0 0x7f57e00f7c30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.864+0000 7f57e480f700 1 --2- 172.21.15.8:0/3279441339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e00f6530 0x7f57e00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.864+0000 7f57e480f700 1 -- 172.21.15.8:0/3279441339 >> 172.21.15.8:0/3279441339 conn(0x7f57e00f1c90 msgr2=0x7f57e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.864+0000 7f57e480f700 1 -- 172.21.15.8:0/3279441339 shutdown_connections 2023-10-18T21:09:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.865+0000 7f57e480f700 1 -- 172.21.15.8:0/3279441339 wait complete. 2023-10-18T21:09:28.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.865+0000 7f57e480f700 1 Processor -- start 2023-10-18T21:09:28.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.865+0000 7f57e480f700 1 -- start start 2023-10-18T21:09:28.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.866+0000 7f57e480f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57e00f6530 0x7f57e0108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:28.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.866+0000 7f57e480f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e00f77d0 0x7f57e0109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:28.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.866+0000 7f57e480f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e0109a20 con 0x7f57e00f6530 2023-10-18T21:09:28.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.866+0000 7f57e480f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e0109b60 con 0x7f57e00f77d0 2023-10-18T21:09:28.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.866+0000 7f57df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57e00f6530 0x7f57e0108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:28.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.866+0000 7f57df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57e00f6530 0x7f57e0108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50746/0 (socket says 172.21.15.8:50746) 2023-10-18T21:09:28.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.866+0000 7f57df7fe700 1 -- 172.21.15.8:0/613254609 learned_addr learned my addr 172.21.15.8:0/613254609 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:09:28.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.866+0000 7f57deffd700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e00f77d0 0x7f57e0109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.867+0000 7f57df7fe700 1 -- 172.21.15.8:0/613254609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e00f77d0 msgr2=0x7f57e0109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.867+0000 7f57df7fe700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e00f77d0 0x7f57e0109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.867+0000 7f57df7fe700 1 -- 172.21.15.8:0/613254609 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d4005040 con 0x7f57e00f6530 2023-10-18T21:09:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.867+0000 7f57df7fe700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57e00f6530 0x7f57e0108f80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f57d0002700 tx=0x7f57d0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.867+0000 7f57c7fff700 1 -- 172.21.15.8:0/613254609 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57d00079c0 con 0x7f57e00f6530 2023-10-18T21:09:28.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.867+0000 7f57c7fff700 1 -- 172.21.15.8:0/613254609 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f57d000f040 con 0x7f57e00f6530 2023-10-18T21:09:28.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.867+0000 7f57e480f700 1 -- 172.21.15.8:0/613254609 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e010a500 con 0x7f57e00f6530 2023-10-18T21:09:28.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.867+0000 7f57c7fff700 1 -- 172.21.15.8:0/613254609 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57d00148d0 con 0x7f57e00f6530 2023-10-18T21:09:28.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.867+0000 7f57e480f700 1 -- 172.21.15.8:0/613254609 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e010aac0 con 0x7f57e00f6530 2023-10-18T21:09:28.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.869+0000 7f57e480f700 1 -- 172.21.15.8:0/613254609 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e0045ad0 con 0x7f57e00f6530 2023-10-18T21:09:28.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.869+0000 7f57c7fff700 1 -- 172.21.15.8:0/613254609 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f57d001b060 con 0x7f57e00f6530 2023-10-18T21:09:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.870+0000 7f57c7fff700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c8060f70 0x7f57c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.870+0000 7f57c7fff700 1 -- 172.21.15.8:0/613254609 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7704+0+0 (secure 0 0 0) 0x7f57d007c660 con 0x7f57e00f6530 2023-10-18T21:09:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.871+0000 7f57deffd700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c8060f70 0x7f57c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.871+0000 7f57deffd700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c8060f70 0x7f57c8063430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f57d4004630 tx=0x7f57d4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:28.878+0000 7f57c7fff700 1 -- 172.21.15.8:0/613254609 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f57d004fdb0 con 0x7f57e00f6530 2023-10-18T21:09:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:27.580753+0000 mgr.smithi008.flmjzp (mgr.14640) 601 : audit [DBG] from='client.34656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.065320+0000 mon.smithi008 (mon.0) 1059 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.421202+0000 mon.smithi008 (mon.0) 1060 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.546034+0000 mon.smithi008 (mon.0) 1061 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.547899+0000 mon.smithi008 (mon.0) 1062 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:09:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.548773+0000 mon.smithi008 (mon.0) 1063 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:09:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.554109+0000 mon.smithi008 (mon.0) 1064 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.562612+0000 mon.smithi008 (mon.0) 1065 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:28.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.566043+0000 mon.smithi008 (mon.0) 1066 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:28.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.567925+0000 mon.smithi008 (mon.0) 1067 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:28.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.569298+0000 mon.smithi008 (mon.0) 1068 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:28.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.571312+0000 mon.smithi008 (mon.0) 1069 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.109+0000 7f57e480f700 1 -- 172.21.15.8:0/613254609 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f57e00fedd0 con 0x7f57e00f6530 2023-10-18T21:09:29.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.109+0000 7f57c7fff700 1 -- 172.21.15.8:0/613254609 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 72 v72) v1 ==== 76+0+1414 (secure 0 0 0) 0x7f57d004f9a0 con 0x7f57e00f6530 2023-10-18T21:09:29.112 INFO:teuthology.orchestra.run.smithi008.stdout:e72 2023-10-18T21:09:29.112 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:09:29.121 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:09:29.122 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:09:29.122 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:09:29.122 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:09:29.123 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:09:29.123 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 72 2023-10-18T21:09:29.123 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:09:29.123 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:09:29.123 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:18.548423+0000 2023-10-18T21:09:29.124 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:09:29.124 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:09:29.124 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:09:29.124 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:09:29.124 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:09:29.125 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:09:29.125 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:09:29.125 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 106 2023-10-18T21:09:29.125 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:09:29.125 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:09:29.126 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:09:29.126 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44601} 2023-10-18T21:09:29.126 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:09:29.126 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:09:29.126 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:09:29.127 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:09:29.127 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:09:29.127 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:09:29.127 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:09:29.127 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:09:29.128 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.grdzlm{0:44601} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.60:6824/2874723784,v1:172.21.15.60:6825/2874723784] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:09:29.128 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:09:29.128 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:09:29.128 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-18T21:09:29.128 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:09:29.128 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{-1:44605} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:09:29.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.111+0000 7f57e480f700 1 -- 172.21.15.8:0/613254609 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c8060f70 msgr2=0x7f57c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:29.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.111+0000 7f57e480f700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c8060f70 0x7f57c8063430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f57d4004630 tx=0x7f57d4009b30).stop 2023-10-18T21:09:29.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.111+0000 7f57e480f700 1 -- 172.21.15.8:0/613254609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57e00f6530 msgr2=0x7f57e0108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:29.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.111+0000 7f57e480f700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57e00f6530 0x7f57e0108f80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f57d0002700 tx=0x7f57d0009d80).stop 2023-10-18T21:09:29.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.112+0000 7f57e480f700 1 -- 172.21.15.8:0/613254609 shutdown_connections 2023-10-18T21:09:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.112+0000 7f57e480f700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c8060f70 0x7f57c8063430 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.112+0000 7f57e480f700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57e00f6530 0x7f57e0108f80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.112+0000 7f57e480f700 1 --2- 172.21.15.8:0/613254609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e00f77d0 0x7f57e0109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.112+0000 7f57e480f700 1 -- 172.21.15.8:0/613254609 >> 172.21.15.8:0/613254609 conn(0x7f57e00f1c90 msgr2=0x7f57e006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.112+0000 7f57e480f700 1 -- 172.21.15.8:0/613254609 shutdown_connections 2023-10-18T21:09:29.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.112+0000 7f57e480f700 1 -- 172.21.15.8:0/613254609 wait complete. 2023-10-18T21:09:29.132 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 72 2023-10-18T21:09:29.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.254+0000 7f1d263c3700 1 -- 172.21.15.8:0/61568118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2006a330 msgr2=0x7f1d2006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:29.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.254+0000 7f1d263c3700 1 --2- 172.21.15.8:0/61568118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2006a330 0x7f1d2006a7b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f1d10004660 tx=0x7f1d10009b30).stop 2023-10-18T21:09:29.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.254+0000 7f1d263c3700 1 -- 172.21.15.8:0/61568118 shutdown_connections 2023-10-18T21:09:29.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.254+0000 7f1d263c3700 1 --2- 172.21.15.8:0/61568118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2006a330 0x7f1d2006a7b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:29.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.254+0000 7f1d263c3700 1 --2- 172.21.15.8:0/61568118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d2006b940 0x7f1d20069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:29.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.254+0000 7f1d263c3700 1 -- 172.21.15.8:0/61568118 >> 172.21.15.8:0/61568118 conn(0x7f1d200f1c90 msgr2=0x7f1d200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:29.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.254+0000 7f1d263c3700 1 -- 172.21.15.8:0/61568118 shutdown_connections 2023-10-18T21:09:29.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.254+0000 7f1d263c3700 1 -- 172.21.15.8:0/61568118 wait complete. 2023-10-18T21:09:29.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.255+0000 7f1d263c3700 1 Processor -- start 2023-10-18T21:09:29.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.255+0000 7f1d263c3700 1 -- start start 2023-10-18T21:09:29.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.255+0000 7f1d263c3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d2006a330 0x7f1d20108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:29.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.256+0000 7f1d263c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2006b940 0x7f1d20109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:29.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.256+0000 7f1d263c3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d20109a30 con 0x7f1d2006b940 2023-10-18T21:09:29.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.256+0000 7f1d263c3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d20109b70 con 0x7f1d2006a330 2023-10-18T21:09:29.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.257+0000 7f1d24bc0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2006b940 0x7f1d20109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:29.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.257+0000 7f1d24bc0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2006b940 0x7f1d20109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50802/0 (socket says 172.21.15.8:50802) 2023-10-18T21:09:29.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.257+0000 7f1d24bc0700 1 -- 172.21.15.8:0/1895640736 learned_addr learned my addr 172.21.15.8:0/1895640736 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:09:29.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.257+0000 7f1d253c1700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d2006a330 0x7f1d20108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:29.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.257+0000 7f1d24bc0700 1 -- 172.21.15.8:0/1895640736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d2006a330 msgr2=0x7f1d20108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:29.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.257+0000 7f1d24bc0700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d2006a330 0x7f1d20108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:29.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.257+0000 7f1d24bc0700 1 -- 172.21.15.8:0/1895640736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10005040 con 0x7f1d2006b940 2023-10-18T21:09:29.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.257+0000 7f1d24bc0700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2006b940 0x7f1d20109480 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f1d10009f50 tx=0x7f1d10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:29.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.258+0000 7f1d15ffb700 1 -- 172.21.15.8:0/1895640736 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d10018070 con 0x7f1d2006b940 2023-10-18T21:09:29.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.258+0000 7f1d15ffb700 1 -- 172.21.15.8:0/1895640736 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1d10009630 con 0x7f1d2006b940 2023-10-18T21:09:29.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.258+0000 7f1d263c3700 1 -- 172.21.15.8:0/1895640736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2010a4b0 con 0x7f1d2006b940 2023-10-18T21:09:29.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.258+0000 7f1d15ffb700 1 -- 172.21.15.8:0/1895640736 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d1001c3c0 con 0x7f1d2006b940 2023-10-18T21:09:29.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.258+0000 7f1d263c3700 1 -- 172.21.15.8:0/1895640736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2010aa10 con 0x7f1d2006b940 2023-10-18T21:09:29.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.259+0000 7f1d263c3700 1 -- 172.21.15.8:0/1895640736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d20045ad0 con 0x7f1d2006b940 2023-10-18T21:09:29.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.260+0000 7f1d15ffb700 1 -- 172.21.15.8:0/1895640736 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1d1001d420 con 0x7f1d2006b940 2023-10-18T21:09:29.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.261+0000 7f1d15ffb700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d0c060f70 0x7f1d0c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.261+0000 7f1d15ffb700 1 -- 172.21.15.8:0/1895640736 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7704+0+0 (secure 0 0 0) 0x7f1d1007e550 con 0x7f1d2006b940 2023-10-18T21:09:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.262+0000 7f1d253c1700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d0c060f70 0x7f1d0c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.262+0000 7f1d253c1700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d0c060f70 0x7f1d0c063430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f1d1c004c40 tx=0x7f1d1c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:29.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.265+0000 7f1d15ffb700 1 -- 172.21.15.8:0/1895640736 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1d10051be0 con 0x7f1d2006b940 2023-10-18T21:09:29.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.464+0000 7f1d263c3700 1 -- 172.21.15.8:0/1895640736 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d2010ac30 con 0x7f1d0c060f70 2023-10-18T21:09:29.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.465+0000 7f1d15ffb700 1 -- 172.21.15.8:0/1895640736 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1d2010ac30 con 0x7f1d0c060f70 2023-10-18T21:09:29.467 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:09:29.468 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:09:29.468 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:09:29.468 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:09:29.468 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:09:29.468 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:09:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:09:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:09:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:09:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:09:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:09:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:09:29.470 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:09:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:09:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 -- 172.21.15.8:0/1895640736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d0c060f70 msgr2=0x7f1d0c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d0c060f70 0x7f1d0c063430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f1d1c004c40 tx=0x7f1d1c00b040).stop 2023-10-18T21:09:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 -- 172.21.15.8:0/1895640736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2006b940 msgr2=0x7f1d20109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2006b940 0x7f1d20109480 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f1d10009f50 tx=0x7f1d10009b30).stop 2023-10-18T21:09:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 -- 172.21.15.8:0/1895640736 shutdown_connections 2023-10-18T21:09:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d0c060f70 0x7f1d0c063430 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d2006a330 0x7f1d20108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 --2- 172.21.15.8:0/1895640736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2006b940 0x7f1d20109480 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 -- 172.21.15.8:0/1895640736 >> 172.21.15.8:0/1895640736 conn(0x7f1d200f1c90 msgr2=0x7f1d200fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 -- 172.21.15.8:0/1895640736 shutdown_connections 2023-10-18T21:09:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:29.467+0000 7f1d263c3700 1 -- 172.21.15.8:0/1895640736 wait complete. 2023-10-18T21:09:29.875 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:27.942431+0000 mgr.smithi008.flmjzp (mgr.14640) 602 : audit [DBG] from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:29.875 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.060979+0000 mgr.smithi008.flmjzp (mgr.14640) 603 : audit [DBG] from='client.34664 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:29.876 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:28.065992+0000 mgr.smithi008.flmjzp (mgr.14640) 604 : cluster [DBG] pgmap v439: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:29.876 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.292187+0000 mgr.smithi008.flmjzp (mgr.14640) 605 : audit [DBG] from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:29.876 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.416605+0000 mgr.smithi008.flmjzp (mgr.14640) 606 : audit [DBG] from='client.34672 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:29.876 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:28.422070+0000 mgr.smithi008.flmjzp (mgr.14640) 607 : cluster [DBG] pgmap v440: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:29.876 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:28.549601+0000 mgr.smithi008.flmjzp (mgr.14640) 608 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:09:29.876 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:28.550074+0000 mgr.smithi008.flmjzp (mgr.14640) 609 : cluster [DBG] pgmap v441: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:29.877 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:28.550267+0000 mgr.smithi008.flmjzp (mgr.14640) 610 : cluster [DBG] pgmap v442: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:29.877 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:28.573167+0000 mgr.smithi008.flmjzp (mgr.14640) 611 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:09:29.877 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.721713+0000 mon.smithi008 (mon.0) 1070 : audit [DBG] from='client.? 172.21.15.8:0/2942505999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:29.877 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.792746+0000 mon.smithi008 (mon.0) 1071 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:29.878 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:29.063558+0000 mon.smithi008 (mon.0) 1072 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH) 2023-10-18T21:09:29.878 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:29.111071+0000 mon.smithi008 (mon.0) 1073 : audit [DBG] from='client.? 172.21.15.8:0/613254609' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:09:29.878 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:29.151390+0000 mon.smithi008 (mon.0) 1074 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:29.878 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:29.504892+0000 mon.smithi008 (mon.0) 1075 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:27.942431+0000 mgr.smithi008.flmjzp (mgr.14640) 602 : audit [DBG] from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.060979+0000 mgr.smithi008.flmjzp (mgr.14640) 603 : audit [DBG] from='client.34664 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:28.065992+0000 mgr.smithi008.flmjzp (mgr.14640) 604 : cluster [DBG] pgmap v439: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.292187+0000 mgr.smithi008.flmjzp (mgr.14640) 605 : audit [DBG] from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.416605+0000 mgr.smithi008.flmjzp (mgr.14640) 606 : audit [DBG] from='client.34672 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:28.422070+0000 mgr.smithi008.flmjzp (mgr.14640) 607 : cluster [DBG] pgmap v440: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:28.549601+0000 mgr.smithi008.flmjzp (mgr.14640) 608 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:09:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:28.550074+0000 mgr.smithi008.flmjzp (mgr.14640) 609 : cluster [DBG] pgmap v441: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:28.550267+0000 mgr.smithi008.flmjzp (mgr.14640) 610 : cluster [DBG] pgmap v442: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:28.573167+0000 mgr.smithi008.flmjzp (mgr.14640) 611 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:09:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.721713+0000 mon.smithi008 (mon.0) 1070 : audit [DBG] from='client.? 172.21.15.8:0/2942505999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.792746+0000 mon.smithi008 (mon.0) 1071 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:29.063558+0000 mon.smithi008 (mon.0) 1072 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH) 2023-10-18T21:09:29.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:29.111071+0000 mon.smithi008 (mon.0) 1073 : audit [DBG] from='client.? 172.21.15.8:0/613254609' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:09:29.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:29.151390+0000 mon.smithi008 (mon.0) 1074 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:29.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:29.504892+0000 mon.smithi008 (mon.0) 1075 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:28.788274+0000 mgr.smithi008.flmjzp (mgr.14640) 612 : audit [DBG] from='client.34680 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:28.793500+0000 mgr.smithi008.flmjzp (mgr.14640) 613 : cluster [DBG] pgmap v443: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:29.147190+0000 mgr.smithi008.flmjzp (mgr.14640) 614 : audit [DBG] from='client.34688 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:29.152118+0000 mgr.smithi008.flmjzp (mgr.14640) 615 : cluster [DBG] pgmap v444: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:29.466422+0000 mgr.smithi008.flmjzp (mgr.14640) 616 : audit [DBG] from='client.34692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:29.500916+0000 mgr.smithi008.flmjzp (mgr.14640) 617 : audit [DBG] from='client.34696 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:29.505651+0000 mgr.smithi008.flmjzp (mgr.14640) 618 : cluster [DBG] pgmap v445: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:30.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:29.734230+0000 mon.smithi008 (mon.0) 1076 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm restarted 2023-10-18T21:09:30.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:29.738173+0000 mon.smithi008 (mon.0) 1077 : cluster [DBG] osdmap e107: 6 total, 6 up, 6 in 2023-10-18T21:09:30.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:29.856633+0000 mon.smithi008 (mon.0) 1078 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:30.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:29.986393+0000 mon.smithi008 (mon.0) 1079 : cluster [INF] Standby daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 0 2023-10-18T21:09:30.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:29.989661+0000 mon.smithi008 (mon.0) 1080 : cluster [DBG] mds.? [v2:172.21.15.60:6824/2855213053,v1:172.21.15.60:6825/2855213053] up:boot 2023-10-18T21:09:30.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:29.989713+0000 mon.smithi008 (mon.0) 1081 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:09:30.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:29.990023+0000 mon.smithi008 (mon.0) 1082 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:09:30.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:30.204066+0000 mon.smithi008 (mon.0) 1083 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:30.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:30.452516+0000 mon.smithi008 (mon.0) 1084 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:30.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:30.555808+0000 mon.smithi008 (mon.0) 1085 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:28.788274+0000 mgr.smithi008.flmjzp (mgr.14640) 612 : audit [DBG] from='client.34680 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:28.793500+0000 mgr.smithi008.flmjzp (mgr.14640) 613 : cluster [DBG] pgmap v443: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:29.147190+0000 mgr.smithi008.flmjzp (mgr.14640) 614 : audit [DBG] from='client.34688 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:29.152118+0000 mgr.smithi008.flmjzp (mgr.14640) 615 : cluster [DBG] pgmap v444: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:29.466422+0000 mgr.smithi008.flmjzp (mgr.14640) 616 : audit [DBG] from='client.34692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:29.500916+0000 mgr.smithi008.flmjzp (mgr.14640) 617 : audit [DBG] from='client.34696 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:29.505651+0000 mgr.smithi008.flmjzp (mgr.14640) 618 : cluster [DBG] pgmap v445: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:30.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:29.734230+0000 mon.smithi008 (mon.0) 1076 : cluster [INF] daemon mds.cephfs.smithi060.grdzlm restarted 2023-10-18T21:09:30.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:29.738173+0000 mon.smithi008 (mon.0) 1077 : cluster [DBG] osdmap e107: 6 total, 6 up, 6 in 2023-10-18T21:09:30.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:29.856633+0000 mon.smithi008 (mon.0) 1078 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:30.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:29.986393+0000 mon.smithi008 (mon.0) 1079 : cluster [INF] Standby daemon mds.cephfs.smithi060.grdzlm assigned to filesystem cephfs as rank 0 2023-10-18T21:09:30.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:29.989661+0000 mon.smithi008 (mon.0) 1080 : cluster [DBG] mds.? [v2:172.21.15.60:6824/2855213053,v1:172.21.15.60:6825/2855213053] up:boot 2023-10-18T21:09:30.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:29.989713+0000 mon.smithi008 (mon.0) 1081 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.grdzlm=up:replay} 1 up:standby 2023-10-18T21:09:30.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:29.990023+0000 mon.smithi008 (mon.0) 1082 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.grdzlm"}]: dispatch 2023-10-18T21:09:30.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:30.204066+0000 mon.smithi008 (mon.0) 1083 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:30.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:30.452516+0000 mon.smithi008 (mon.0) 1084 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:30.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:30.555808+0000 mon.smithi008 (mon.0) 1085 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:29.852796+0000 mgr.smithi008.flmjzp (mgr.14640) 619 : audit [DBG] from='client.44647 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:29.857334+0000 mgr.smithi008.flmjzp (mgr.14640) 620 : cluster [DBG] pgmap v447: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:30.200306+0000 mgr.smithi008.flmjzp (mgr.14640) 621 : audit [DBG] from='client.34708 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:30.204800+0000 mgr.smithi008.flmjzp (mgr.14640) 622 : cluster [DBG] pgmap v448: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:30.551660+0000 mgr.smithi008.flmjzp (mgr.14640) 623 : audit [DBG] from='client.34712 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:30.556611+0000 mgr.smithi008.flmjzp (mgr.14640) 624 : cluster [DBG] pgmap v449: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:30.903585+0000 mon.smithi008 (mon.0) 1086 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:31.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:31.252498+0000 mon.smithi008 (mon.0) 1087 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:29.852796+0000 mgr.smithi008.flmjzp (mgr.14640) 619 : audit [DBG] from='client.44647 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:29.857334+0000 mgr.smithi008.flmjzp (mgr.14640) 620 : cluster [DBG] pgmap v447: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:30.200306+0000 mgr.smithi008.flmjzp (mgr.14640) 621 : audit [DBG] from='client.34708 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:30.204800+0000 mgr.smithi008.flmjzp (mgr.14640) 622 : cluster [DBG] pgmap v448: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:30.551660+0000 mgr.smithi008.flmjzp (mgr.14640) 623 : audit [DBG] from='client.34712 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:30.556611+0000 mgr.smithi008.flmjzp (mgr.14640) 624 : cluster [DBG] pgmap v449: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:30.903585+0000 mon.smithi008 (mon.0) 1086 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:31.252498+0000 mon.smithi008 (mon.0) 1087 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:32.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:30.899608+0000 mgr.smithi008.flmjzp (mgr.14640) 625 : audit [DBG] from='client.34716 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:32.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:30.904356+0000 mgr.smithi008.flmjzp (mgr.14640) 626 : cluster [DBG] pgmap v450: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:32.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:31.248708+0000 mgr.smithi008.flmjzp (mgr.14640) 627 : audit [DBG] from='client.34720 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:32.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:31.253252+0000 mgr.smithi008.flmjzp (mgr.14640) 628 : cluster [DBG] pgmap v451: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:32.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:31.597475+0000 mgr.smithi008.flmjzp (mgr.14640) 629 : audit [DBG] from='client.34724 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:32.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:31.600920+0000 mon.smithi008 (mon.0) 1088 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:32.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:31.601739+0000 mgr.smithi008.flmjzp (mgr.14640) 630 : cluster [DBG] pgmap v452: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:32.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:32.476069+0000 mon.smithi008 (mon.0) 1089 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:32.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:30.899608+0000 mgr.smithi008.flmjzp (mgr.14640) 625 : audit [DBG] from='client.34716 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:32.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:30.904356+0000 mgr.smithi008.flmjzp (mgr.14640) 626 : cluster [DBG] pgmap v450: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:31.248708+0000 mgr.smithi008.flmjzp (mgr.14640) 627 : audit [DBG] from='client.34720 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:31.253252+0000 mgr.smithi008.flmjzp (mgr.14640) 628 : cluster [DBG] pgmap v451: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:31.597475+0000 mgr.smithi008.flmjzp (mgr.14640) 629 : audit [DBG] from='client.34724 -' entity='client.crash.smithi008' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:31.600920+0000 mon.smithi008 (mon.0) 1088 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:31.601739+0000 mgr.smithi008.flmjzp (mgr.14640) 630 : cluster [DBG] pgmap v452: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:32.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:32.476069+0000 mon.smithi008 (mon.0) 1089 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:33.895 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:32.471211+0000 mgr.smithi008.flmjzp (mgr.14640) 631 : audit [DBG] from='client.44673 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:33.896 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:32.477117+0000 mgr.smithi008.flmjzp (mgr.14640) 632 : cluster [DBG] pgmap v453: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:33.896 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:32.826803+0000 mon.smithi008 (mon.0) 1090 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:33.896 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:33.173274+0000 mon.smithi008 (mon.0) 1091 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:33.896 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:33.526345+0000 mon.smithi008 (mon.0) 1092 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:32.471211+0000 mgr.smithi008.flmjzp (mgr.14640) 631 : audit [DBG] from='client.44673 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:32.477117+0000 mgr.smithi008.flmjzp (mgr.14640) 632 : cluster [DBG] pgmap v453: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:32.826803+0000 mon.smithi008 (mon.0) 1090 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:33.173274+0000 mon.smithi008 (mon.0) 1091 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:33.526345+0000 mon.smithi008 (mon.0) 1092 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:32.821969+0000 mgr.smithi008.flmjzp (mgr.14640) 633 : audit [DBG] from='client.44677 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:32.828075+0000 mgr.smithi008.flmjzp (mgr.14640) 634 : cluster [DBG] pgmap v454: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:33.168265+0000 mgr.smithi008.flmjzp (mgr.14640) 635 : audit [DBG] from='client.44681 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:33.174367+0000 mgr.smithi008.flmjzp (mgr.14640) 636 : cluster [DBG] pgmap v455: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:33.521902+0000 mgr.smithi008.flmjzp (mgr.14640) 637 : audit [DBG] from='client.44685 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:33.527514+0000 mgr.smithi008.flmjzp (mgr.14640) 638 : cluster [DBG] pgmap v456: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:33.875803+0000 mon.smithi008 (mon.0) 1093 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:34.224222+0000 mon.smithi008 (mon.0) 1094 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:34.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:34.524264+0000 mon.smithi008 (mon.0) 1095 : cluster [WRN] Health check update: 17 daemons have recently crashed (RECENT_CRASH) 2023-10-18T21:09:34.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:34.569973+0000 mon.smithi008 (mon.0) 1096 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:34.938 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:32.821969+0000 mgr.smithi008.flmjzp (mgr.14640) 633 : audit [DBG] from='client.44677 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:34.938 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:32.828075+0000 mgr.smithi008.flmjzp (mgr.14640) 634 : cluster [DBG] pgmap v454: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:34.939 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:33.168265+0000 mgr.smithi008.flmjzp (mgr.14640) 635 : audit [DBG] from='client.44681 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:34.939 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:33.174367+0000 mgr.smithi008.flmjzp (mgr.14640) 636 : cluster [DBG] pgmap v455: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:34.939 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:33.521902+0000 mgr.smithi008.flmjzp (mgr.14640) 637 : audit [DBG] from='client.44685 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:34.939 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:33.527514+0000 mgr.smithi008.flmjzp (mgr.14640) 638 : cluster [DBG] pgmap v456: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:34.939 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:33.875803+0000 mon.smithi008 (mon.0) 1093 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:34.940 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:34.224222+0000 mon.smithi008 (mon.0) 1094 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:34.940 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:34.524264+0000 mon.smithi008 (mon.0) 1095 : cluster [WRN] Health check update: 17 daemons have recently crashed (RECENT_CRASH) 2023-10-18T21:09:34.940 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:34.569973+0000 mon.smithi008 (mon.0) 1096 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:33.870275+0000 mgr.smithi008.flmjzp (mgr.14640) 639 : audit [DBG] from='client.44689 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:33.876938+0000 mgr.smithi008.flmjzp (mgr.14640) 640 : cluster [DBG] pgmap v457: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:34.219133+0000 mgr.smithi008.flmjzp (mgr.14640) 641 : audit [DBG] from='client.44693 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:34.225331+0000 mgr.smithi008.flmjzp (mgr.14640) 642 : cluster [DBG] pgmap v458: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:34.565532+0000 mgr.smithi008.flmjzp (mgr.14640) 643 : audit [DBG] from='client.44697 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:34.571132+0000 mgr.smithi008.flmjzp (mgr.14640) 644 : cluster [DBG] pgmap v459: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:34.919041+0000 mon.smithi008 (mon.0) 1097 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:35.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:35.265991+0000 mon.smithi008 (mon.0) 1098 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:33.870275+0000 mgr.smithi008.flmjzp (mgr.14640) 639 : audit [DBG] from='client.44689 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:33.876938+0000 mgr.smithi008.flmjzp (mgr.14640) 640 : cluster [DBG] pgmap v457: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:35.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:34.219133+0000 mgr.smithi008.flmjzp (mgr.14640) 641 : audit [DBG] from='client.44693 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:35.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:34.225331+0000 mgr.smithi008.flmjzp (mgr.14640) 642 : cluster [DBG] pgmap v458: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:35.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:34.565532+0000 mgr.smithi008.flmjzp (mgr.14640) 643 : audit [DBG] from='client.44697 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:35.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:34.571132+0000 mgr.smithi008.flmjzp (mgr.14640) 644 : cluster [DBG] pgmap v459: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:35.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:34.919041+0000 mon.smithi008 (mon.0) 1097 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:35.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:35.265991+0000 mon.smithi008 (mon.0) 1098 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:34.913815+0000 mgr.smithi008.flmjzp (mgr.14640) 645 : audit [DBG] from='client.44701 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:34.920535+0000 mgr.smithi008.flmjzp (mgr.14640) 646 : cluster [DBG] pgmap v460: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:35.260724+0000 mgr.smithi008.flmjzp (mgr.14640) 647 : audit [DBG] from='client.44705 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:35.267119+0000 mgr.smithi008.flmjzp (mgr.14640) 648 : cluster [DBG] pgmap v461: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:35.613353+0000 mgr.smithi008.flmjzp (mgr.14640) 649 : audit [DBG] from='client.44709 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:35.617721+0000 mon.smithi008 (mon.0) 1099 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:35.618875+0000 mgr.smithi008.flmjzp (mgr.14640) 650 : cluster [DBG] pgmap v462: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:34.913815+0000 mgr.smithi008.flmjzp (mgr.14640) 645 : audit [DBG] from='client.44701 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:34.920535+0000 mgr.smithi008.flmjzp (mgr.14640) 646 : cluster [DBG] pgmap v460: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:35.260724+0000 mgr.smithi008.flmjzp (mgr.14640) 647 : audit [DBG] from='client.44705 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:35.267119+0000 mgr.smithi008.flmjzp (mgr.14640) 648 : cluster [DBG] pgmap v461: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:35.613353+0000 mgr.smithi008.flmjzp (mgr.14640) 649 : audit [DBG] from='client.44709 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:09:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:35.617721+0000 mon.smithi008 (mon.0) 1099 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:35.618875+0000 mgr.smithi008.flmjzp (mgr.14640) 650 : cluster [DBG] pgmap v462: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:38.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:37.619520+0000 mgr.smithi008.flmjzp (mgr.14640) 651 : cluster [DBG] pgmap v463: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:38.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:38.576324+0000 mon.smithi008 (mon.0) 1100 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:37.619520+0000 mgr.smithi008.flmjzp (mgr.14640) 651 : cluster [DBG] pgmap v463: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:38.576324+0000 mon.smithi008 (mon.0) 1100 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:39.134491+0000 mon.smithi008 (mon.0) 1101 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:09:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:39.135337+0000 mon.smithi008 (mon.0) 1102 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:09:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:39.140838+0000 mon.smithi008 (mon.0) 1103 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:39.146043+0000 mon.smithi008 (mon.0) 1104 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:39.148299+0000 mon.smithi008 (mon.0) 1105 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:39.149507+0000 mon.smithi008 (mon.0) 1106 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:39.150630+0000 mon.smithi008 (mon.0) 1107 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:39.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:39.152149+0000 mon.smithi008 (mon.0) 1108 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:39.134491+0000 mon.smithi008 (mon.0) 1101 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:09:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:39.135337+0000 mon.smithi008 (mon.0) 1102 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:09:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:39.140838+0000 mon.smithi008 (mon.0) 1103 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:39.146043+0000 mon.smithi008 (mon.0) 1104 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:39.148299+0000 mon.smithi008 (mon.0) 1105 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:39.149507+0000 mon.smithi008 (mon.0) 1106 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:39.150630+0000 mon.smithi008 (mon.0) 1107 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:39.152149+0000 mon.smithi008 (mon.0) 1108 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:39.136019+0000 mgr.smithi008.flmjzp (mgr.14640) 652 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:09:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:39.136588+0000 mgr.smithi008.flmjzp (mgr.14640) 653 : cluster [DBG] pgmap v464: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:39.136883+0000 mgr.smithi008.flmjzp (mgr.14640) 654 : cluster [DBG] pgmap v465: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:39.153743+0000 mgr.smithi008.flmjzp (mgr.14640) 655 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:09:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:39.990194+0000 mon.smithi008 (mon.0) 1109 : cluster [WRN] Health check update: 21 daemons have recently crashed (RECENT_CRASH) 2023-10-18T21:09:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:39.136019+0000 mgr.smithi008.flmjzp (mgr.14640) 652 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:09:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:39.136588+0000 mgr.smithi008.flmjzp (mgr.14640) 653 : cluster [DBG] pgmap v464: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:39.136883+0000 mgr.smithi008.flmjzp (mgr.14640) 654 : cluster [DBG] pgmap v465: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:39.153743+0000 mgr.smithi008.flmjzp (mgr.14640) 655 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.grdzlm to be up:active (currently up:replay) 2023-10-18T21:09:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:39.990194+0000 mon.smithi008 (mon.0) 1109 : cluster [WRN] Health check update: 21 daemons have recently crashed (RECENT_CRASH) 2023-10-18T21:09:42.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:41.137486+0000 mgr.smithi008.flmjzp (mgr.14640) 656 : cluster [DBG] pgmap v466: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:41.137486+0000 mgr.smithi008.flmjzp (mgr.14640) 656 : cluster [DBG] pgmap v466: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:43.138029+0000 mgr.smithi008.flmjzp (mgr.14640) 657 : cluster [DBG] pgmap v467: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:43.138029+0000 mgr.smithi008.flmjzp (mgr.14640) 657 : cluster [DBG] pgmap v467: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:44.991728+0000 mon.smithi008 (mon.0) 1110 : cluster [WRN] Replacing daemon mds.cephfs.smithi060.grdzlm as rank 0 with standby daemon mds.cephfs.smithi060.rvrncq 2023-10-18T21:09:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:44.991782+0000 mon.smithi008 (mon.0) 1111 : cluster [INF] MDS daemon mds.cephfs.smithi060.grdzlm is removed because it is dead or otherwise unavailable. 2023-10-18T21:09:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:44.992556+0000 mon.smithi008 (mon.0) 1112 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-10-18T21:09:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:44.996890+0000 mon.smithi008 (mon.0) 1113 : cluster [DBG] osdmap e108: 6 total, 6 up, 6 in 2023-10-18T21:09:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:45.001109+0000 mon.smithi008 (mon.0) 1114 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 2023-10-18T21:09:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:45.453842+0000 mon.smithi008 (mon.0) 1115 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:44.991728+0000 mon.smithi008 (mon.0) 1110 : cluster [WRN] Replacing daemon mds.cephfs.smithi060.grdzlm as rank 0 with standby daemon mds.cephfs.smithi060.rvrncq 2023-10-18T21:09:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:44.991782+0000 mon.smithi008 (mon.0) 1111 : cluster [INF] MDS daemon mds.cephfs.smithi060.grdzlm is removed because it is dead or otherwise unavailable. 2023-10-18T21:09:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:44.992556+0000 mon.smithi008 (mon.0) 1112 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-10-18T21:09:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:44.996890+0000 mon.smithi008 (mon.0) 1113 : cluster [DBG] osdmap e108: 6 total, 6 up, 6 in 2023-10-18T21:09:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:45.001109+0000 mon.smithi008 (mon.0) 1114 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay} 2023-10-18T21:09:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:45.453842+0000 mon.smithi008 (mon.0) 1115 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:45.138428+0000 mgr.smithi008.flmjzp (mgr.14640) 658 : cluster [DBG] pgmap v469: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:45.138428+0000 mgr.smithi008.flmjzp (mgr.14640) 658 : cluster [DBG] pgmap v469: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:47.139004+0000 mgr.smithi008.flmjzp (mgr.14640) 659 : cluster [DBG] pgmap v470: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:47.139004+0000 mgr.smithi008.flmjzp (mgr.14640) 659 : cluster [DBG] pgmap v470: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:49.159954+0000 mon.smithi008 (mon.0) 1116 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:49.162103+0000 mon.smithi008 (mon.0) 1117 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:09:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:49.163089+0000 mon.smithi008 (mon.0) 1118 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:09:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:49.169369+0000 mon.smithi008 (mon.0) 1119 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:49.176580+0000 mon.smithi008 (mon.0) 1120 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:49.180166+0000 mon.smithi008 (mon.0) 1121 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:49.182155+0000 mon.smithi008 (mon.0) 1122 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:49.184060+0000 mon.smithi008 (mon.0) 1123 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:49.186646+0000 mon.smithi008 (mon.0) 1124 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:49.159954+0000 mon.smithi008 (mon.0) 1116 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:49.162103+0000 mon.smithi008 (mon.0) 1117 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:09:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:49.163089+0000 mon.smithi008 (mon.0) 1118 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:09:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:49.169369+0000 mon.smithi008 (mon.0) 1119 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:09:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:49.176580+0000 mon.smithi008 (mon.0) 1120 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:49.180166+0000 mon.smithi008 (mon.0) 1121 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:49.182155+0000 mon.smithi008 (mon.0) 1122 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:49.184060+0000 mon.smithi008 (mon.0) 1123 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:49.186646+0000 mon.smithi008 (mon.0) 1124 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:09:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:49.139608+0000 mgr.smithi008.flmjzp (mgr.14640) 660 : cluster [DBG] pgmap v471: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:49.163953+0000 mgr.smithi008.flmjzp (mgr.14640) 661 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:09:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:49.164535+0000 mgr.smithi008.flmjzp (mgr.14640) 662 : cluster [DBG] pgmap v472: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:49.164777+0000 mgr.smithi008.flmjzp (mgr.14640) 663 : cluster [DBG] pgmap v473: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:50.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:49.188873+0000 mgr.smithi008.flmjzp (mgr.14640) 664 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:09:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:49.139608+0000 mgr.smithi008.flmjzp (mgr.14640) 660 : cluster [DBG] pgmap v471: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:49.163953+0000 mgr.smithi008.flmjzp (mgr.14640) 661 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:09:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:49.164535+0000 mgr.smithi008.flmjzp (mgr.14640) 662 : cluster [DBG] pgmap v472: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:49.164777+0000 mgr.smithi008.flmjzp (mgr.14640) 663 : cluster [DBG] pgmap v473: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:50.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:49.188873+0000 mgr.smithi008.flmjzp (mgr.14640) 664 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:09:52.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:51.165575+0000 mgr.smithi008.flmjzp (mgr.14640) 665 : cluster [DBG] pgmap v474: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:51.165575+0000 mgr.smithi008.flmjzp (mgr.14640) 665 : cluster [DBG] pgmap v474: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:54.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:53.166243+0000 mgr.smithi008.flmjzp (mgr.14640) 666 : cluster [DBG] pgmap v475: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:53.166243+0000 mgr.smithi008.flmjzp (mgr.14640) 666 : cluster [DBG] pgmap v475: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:55.167060+0000 mgr.smithi008.flmjzp (mgr.14640) 667 : cluster [DBG] pgmap v476: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:56.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:55.167060+0000 mgr.smithi008.flmjzp (mgr.14640) 667 : cluster [DBG] pgmap v476: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:57.167733+0000 mgr.smithi008.flmjzp (mgr.14640) 668 : cluster [DBG] pgmap v477: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:57.167733+0000 mgr.smithi008.flmjzp (mgr.14640) 668 : cluster [DBG] pgmap v477: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:09:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:09:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:59.198779+0000 mon.smithi008 (mon.0) 1125 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:59.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.620+0000 7fe1388d4700 1 -- 172.21.15.8:0/1303812140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1340f6530 msgr2=0x7fe1340f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:59.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.620+0000 7fe1388d4700 1 --2- 172.21.15.8:0/1303812140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1340f6530 0x7fe1340f6950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fe124004660 tx=0x7fe124009b30).stop 2023-10-18T21:09:59.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.621+0000 7fe1388d4700 1 -- 172.21.15.8:0/1303812140 shutdown_connections 2023-10-18T21:09:59.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.621+0000 7fe1388d4700 1 --2- 172.21.15.8:0/1303812140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1340f77d0 0x7fe1340f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:59.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.621+0000 7fe1388d4700 1 --2- 172.21.15.8:0/1303812140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1340f6530 0x7fe1340f6950 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:59.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.621+0000 7fe1388d4700 1 -- 172.21.15.8:0/1303812140 >> 172.21.15.8:0/1303812140 conn(0x7fe1340f1c90 msgr2=0x7fe1340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:59.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.621+0000 7fe1388d4700 1 -- 172.21.15.8:0/1303812140 shutdown_connections 2023-10-18T21:09:59.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.621+0000 7fe1388d4700 1 -- 172.21.15.8:0/1303812140 wait complete. 2023-10-18T21:09:59.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.621+0000 7fe1388d4700 1 Processor -- start 2023-10-18T21:09:59.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.622+0000 7fe1388d4700 1 -- start start 2023-10-18T21:09:59.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.622+0000 7fe1388d4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1340f6530 0x7fe134108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:59.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.622+0000 7fe1388d4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1340f77d0 0x7fe134109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:59.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.622+0000 7fe1388d4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe134109a00 con 0x7fe1340f6530 2023-10-18T21:09:59.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.622+0000 7fe1388d4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe134109b40 con 0x7fe1340f77d0 2023-10-18T21:09:59.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.622+0000 7fe1337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1340f6530 0x7fe134108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:59.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.622+0000 7fe1337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1340f6530 0x7fe134108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33986/0 (socket says 172.21.15.8:33986) 2023-10-18T21:09:59.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.622+0000 7fe1337fe700 1 -- 172.21.15.8:0/1579785598 learned_addr learned my addr 172.21.15.8:0/1579785598 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:09:59.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.622+0000 7fe132ffd700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1340f77d0 0x7fe134109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:59.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.623+0000 7fe1337fe700 1 -- 172.21.15.8:0/1579785598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1340f77d0 msgr2=0x7fe134109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:59.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.623+0000 7fe1337fe700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1340f77d0 0x7fe134109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:59.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.623+0000 7fe1337fe700 1 -- 172.21.15.8:0/1579785598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124005040 con 0x7fe1340f6530 2023-10-18T21:09:59.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.623+0000 7fe1337fe700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1340f6530 0x7fe134108f60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fe124009870 tx=0x7fe12400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:59.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.623+0000 7fe11bfff700 1 -- 172.21.15.8:0/1579785598 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe124019070 con 0x7fe1340f6530 2023-10-18T21:09:59.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.623+0000 7fe11bfff700 1 -- 172.21.15.8:0/1579785598 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe124013380 con 0x7fe1340f6530 2023-10-18T21:09:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.623+0000 7fe11bfff700 1 -- 172.21.15.8:0/1579785598 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe12401edf0 con 0x7fe1340f6530 2023-10-18T21:09:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.623+0000 7fe1388d4700 1 -- 172.21.15.8:0/1579785598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13410a480 con 0x7fe1340f6530 2023-10-18T21:09:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.624+0000 7fe1388d4700 1 -- 172.21.15.8:0/1579785598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13410a910 con 0x7fe1340f6530 2023-10-18T21:09:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.625+0000 7fe1388d4700 1 -- 172.21.15.8:0/1579785598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe134045ad0 con 0x7fe1340f6530 2023-10-18T21:09:59.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.625+0000 7fe11bfff700 1 -- 172.21.15.8:0/1579785598 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe12401e420 con 0x7fe1340f6530 2023-10-18T21:09:59.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.626+0000 7fe11bfff700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe11c060f70 0x7fe11c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.626+0000 7fe11bfff700 1 -- 172.21.15.8:0/1579785598 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe12407ddd0 con 0x7fe1340f6530 2023-10-18T21:09:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.626+0000 7fe132ffd700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe11c060f70 0x7fe11c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.627+0000 7fe132ffd700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe11c060f70 0x7fe11c063430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fe128009fd0 tx=0x7fe12800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.631+0000 7fe11bfff700 1 -- 172.21.15.8:0/1579785598 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe1240513b0 con 0x7fe1340f6530 2023-10-18T21:09:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:09:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:59.198779+0000 mon.smithi008 (mon.0) 1125 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:09:59.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.832+0000 7fe1388d4700 1 -- 172.21.15.8:0/1579785598 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1340fc190 con 0x7fe11c060f70 2023-10-18T21:09:59.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.833+0000 7fe11bfff700 1 -- 172.21.15.8:0/1579785598 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe1340fc190 con 0x7fe11c060f70 2023-10-18T21:09:59.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 -- 172.21.15.8:0/1579785598 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe11c060f70 msgr2=0x7fe11c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:59.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe11c060f70 0x7fe11c063430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fe128009fd0 tx=0x7fe12800b040).stop 2023-10-18T21:09:59.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 -- 172.21.15.8:0/1579785598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1340f6530 msgr2=0x7fe134108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:59.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1340f6530 0x7fe134108f60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fe124009870 tx=0x7fe12400b040).stop 2023-10-18T21:09:59.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 -- 172.21.15.8:0/1579785598 shutdown_connections 2023-10-18T21:09:59.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe11c060f70 0x7fe11c063430 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:59.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1340f6530 0x7fe134108f60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:59.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 --2- 172.21.15.8:0/1579785598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1340f77d0 0x7fe134109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:59.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 -- 172.21.15.8:0/1579785598 >> 172.21.15.8:0/1579785598 conn(0x7fe1340f1c90 msgr2=0x7fe13406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:59.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 -- 172.21.15.8:0/1579785598 shutdown_connections 2023-10-18T21:09:59.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.835+0000 7fe1388d4700 1 -- 172.21.15.8:0/1579785598 wait complete. 2023-10-18T21:09:59.852 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:09:59.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.973+0000 7fef8086f700 1 -- 172.21.15.8:0/2046692679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef7c0f77d0 msgr2=0x7fef7c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:59.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.973+0000 7fef8086f700 1 --2- 172.21.15.8:0/2046692679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef7c0f77d0 0x7fef7c0f7c30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fef70004660 tx=0x7fef70009b30).stop 2023-10-18T21:09:59.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.973+0000 7fef8086f700 1 -- 172.21.15.8:0/2046692679 shutdown_connections 2023-10-18T21:09:59.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.973+0000 7fef8086f700 1 --2- 172.21.15.8:0/2046692679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef7c0f77d0 0x7fef7c0f7c30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:59.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.973+0000 7fef8086f700 1 --2- 172.21.15.8:0/2046692679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c0f6530 0x7fef7c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:59.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.973+0000 7fef8086f700 1 -- 172.21.15.8:0/2046692679 >> 172.21.15.8:0/2046692679 conn(0x7fef7c0f1c90 msgr2=0x7fef7c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:09:59.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.973+0000 7fef8086f700 1 -- 172.21.15.8:0/2046692679 shutdown_connections 2023-10-18T21:09:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.973+0000 7fef8086f700 1 -- 172.21.15.8:0/2046692679 wait complete. 2023-10-18T21:09:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.974+0000 7fef8086f700 1 Processor -- start 2023-10-18T21:09:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.974+0000 7fef8086f700 1 -- start start 2023-10-18T21:09:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.974+0000 7fef8086f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef7c0f6530 0x7fef7c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.974+0000 7fef8086f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c0f77d0 0x7fef7c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.974+0000 7fef8086f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c06a380 con 0x7fef7c0f6530 2023-10-18T21:09:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.974+0000 7fef8086f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c06a4c0 con 0x7fef7c0f77d0 2023-10-18T21:09:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.975+0000 7fef7b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef7c0f6530 0x7fef7c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.975+0000 7fef7b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef7c0f6530 0x7fef7c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34008/0 (socket says 172.21.15.8:34008) 2023-10-18T21:09:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.975+0000 7fef7b7fe700 1 -- 172.21.15.8:0/1371812722 learned_addr learned my addr 172.21.15.8:0/1371812722 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:09:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.975+0000 7fef7affd700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c0f77d0 0x7fef7c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.975+0000 7fef7b7fe700 1 -- 172.21.15.8:0/1371812722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c0f77d0 msgr2=0x7fef7c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:09:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.975+0000 7fef7b7fe700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c0f77d0 0x7fef7c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:09:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.975+0000 7fef7b7fe700 1 -- 172.21.15.8:0/1371812722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70005040 con 0x7fef7c0f6530 2023-10-18T21:09:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.975+0000 7fef7b7fe700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef7c0f6530 0x7fef7c06b9a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fef6c002700 tx=0x7fef6c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:59.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.976+0000 7fef63fff700 1 -- 172.21.15.8:0/1371812722 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef6c0079c0 con 0x7fef7c0f6530 2023-10-18T21:09:59.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.976+0000 7fef63fff700 1 -- 172.21.15.8:0/1371812722 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fef6c00f040 con 0x7fef7c0f6530 2023-10-18T21:09:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.976+0000 7fef8086f700 1 -- 172.21.15.8:0/1371812722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c06a7a0 con 0x7fef7c0f6530 2023-10-18T21:09:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.976+0000 7fef63fff700 1 -- 172.21.15.8:0/1371812722 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef6c0148d0 con 0x7fef7c0f6530 2023-10-18T21:09:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.976+0000 7fef8086f700 1 -- 172.21.15.8:0/1371812722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c10ed70 con 0x7fef7c0f6530 2023-10-18T21:09:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.977+0000 7fef8086f700 1 -- 172.21.15.8:0/1371812722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c045ad0 con 0x7fef7c0f6530 2023-10-18T21:09:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.978+0000 7fef63fff700 1 -- 172.21.15.8:0/1371812722 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fef6c01b060 con 0x7fef7c0f6530 2023-10-18T21:09:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.979+0000 7fef63fff700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fef64060f70 0x7fef64063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:09:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.979+0000 7fef63fff700 1 -- 172.21.15.8:0/1371812722 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fef6c07c7d0 con 0x7fef7c0f6530 2023-10-18T21:09:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.979+0000 7fef7affd700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fef64060f70 0x7fef64063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:09:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.979+0000 7fef7affd700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fef64060f70 0x7fef64063430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fef70004630 tx=0x7fef70009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:09:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:09:59.983+0000 7fef63fff700 1 -- 172.21.15.8:0/1371812722 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fef6c04c380 con 0x7fef7c0f6530 2023-10-18T21:10:00.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.183+0000 7fef8086f700 1 -- 172.21.15.8:0/1371812722 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef7c0fedd0 con 0x7fef64060f70 2023-10-18T21:10:00.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.185+0000 7fef63fff700 1 -- 172.21.15.8:0/1371812722 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fef7c0fedd0 con 0x7fef64060f70 2023-10-18T21:10:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.186+0000 7fef8086f700 1 -- 172.21.15.8:0/1371812722 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fef64060f70 msgr2=0x7fef64063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.186+0000 7fef8086f700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fef64060f70 0x7fef64063430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fef70004630 tx=0x7fef70009b30).stop 2023-10-18T21:10:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.186+0000 7fef8086f700 1 -- 172.21.15.8:0/1371812722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef7c0f6530 msgr2=0x7fef7c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.186+0000 7fef8086f700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef7c0f6530 0x7fef7c06b9a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fef6c002700 tx=0x7fef6c009d80).stop 2023-10-18T21:10:00.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.187+0000 7fef8086f700 1 -- 172.21.15.8:0/1371812722 shutdown_connections 2023-10-18T21:10:00.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.187+0000 7fef8086f700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fef64060f70 0x7fef64063430 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.187+0000 7fef8086f700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef7c0f6530 0x7fef7c06b9a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.187+0000 7fef8086f700 1 --2- 172.21.15.8:0/1371812722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c0f77d0 0x7fef7c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.187+0000 7fef8086f700 1 -- 172.21.15.8:0/1371812722 >> 172.21.15.8:0/1371812722 conn(0x7fef7c0f1c90 msgr2=0x7fef7c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:00.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.187+0000 7fef8086f700 1 -- 172.21.15.8:0/1371812722 shutdown_connections 2023-10-18T21:10:00.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.187+0000 7fef8086f700 1 -- 172.21.15.8:0/1371812722 wait complete. 2023-10-18T21:10:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.325+0000 7fee0359e700 1 -- 172.21.15.8:0/2018174418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee040f77d0 msgr2=0x7fee040f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.325+0000 7fee0359e700 1 --2- 172.21.15.8:0/2018174418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee040f77d0 0x7fee040f7c30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fedf8004660 tx=0x7fedf8009b30).stop 2023-10-18T21:10:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.325+0000 7fee0359e700 1 -- 172.21.15.8:0/2018174418 shutdown_connections 2023-10-18T21:10:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.325+0000 7fee0359e700 1 --2- 172.21.15.8:0/2018174418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee040f77d0 0x7fee040f7c30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.325+0000 7fee0359e700 1 --2- 172.21.15.8:0/2018174418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee040f6530 0x7fee040f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.325+0000 7fee0359e700 1 -- 172.21.15.8:0/2018174418 >> 172.21.15.8:0/2018174418 conn(0x7fee040f1c90 msgr2=0x7fee040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.325+0000 7fee0359e700 1 -- 172.21.15.8:0/2018174418 shutdown_connections 2023-10-18T21:10:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.325+0000 7fee0359e700 1 -- 172.21.15.8:0/2018174418 wait complete. 2023-10-18T21:10:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.326+0000 7fee0359e700 1 Processor -- start 2023-10-18T21:10:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.326+0000 7fee0359e700 1 -- start start 2023-10-18T21:10:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee0359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee040f6530 0x7fee04108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee0359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee040f77d0 0x7fee04109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee0359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee041099b0 con 0x7fee040f77d0 2023-10-18T21:10:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee0359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee04109af0 con 0x7fee040f6530 2023-10-18T21:10:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee01d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee040f77d0 0x7fee04109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee01d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee040f77d0 0x7fee04109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34016/0 (socket says 172.21.15.8:34016) 2023-10-18T21:10:00.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee01d9b700 1 -- 172.21.15.8:0/100942739 learned_addr learned my addr 172.21.15.8:0/100942739 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:10:00.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee0259c700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee040f6530 0x7fee04108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:00.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee01d9b700 1 -- 172.21.15.8:0/100942739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee040f6530 msgr2=0x7fee04108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:00.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee01d9b700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee040f6530 0x7fee04108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.327+0000 7fee01d9b700 1 -- 172.21.15.8:0/100942739 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8005040 con 0x7fee040f77d0 2023-10-18T21:10:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.328+0000 7fee01d9b700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee040f77d0 0x7fee04109400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fedf8009f50 tx=0x7fedf8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.328+0000 7fedf2ffd700 1 -- 172.21.15.8:0/100942739 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedf8018070 con 0x7fee040f77d0 2023-10-18T21:10:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.328+0000 7fedf2ffd700 1 -- 172.21.15.8:0/100942739 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fedf8009630 con 0x7fee040f77d0 2023-10-18T21:10:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.328+0000 7fedf2ffd700 1 -- 172.21.15.8:0/100942739 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedf801c3c0 con 0x7fee040f77d0 2023-10-18T21:10:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.328+0000 7fee0359e700 1 -- 172.21.15.8:0/100942739 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0410a430 con 0x7fee040f77d0 2023-10-18T21:10:00.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.328+0000 7fee0359e700 1 -- 172.21.15.8:0/100942739 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0410a990 con 0x7fee040f77d0 2023-10-18T21:10:00.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.329+0000 7fee0359e700 1 -- 172.21.15.8:0/100942739 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee04045ad0 con 0x7fee040f77d0 2023-10-18T21:10:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.330+0000 7fedf2ffd700 1 -- 172.21.15.8:0/100942739 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fedf801d420 con 0x7fee040f77d0 2023-10-18T21:10:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.331+0000 7fedf2ffd700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedec060f70 0x7fedec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.331+0000 7fedf2ffd700 1 -- 172.21.15.8:0/100942739 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fedf807e580 con 0x7fee040f77d0 2023-10-18T21:10:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.331+0000 7fee0259c700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedec060f70 0x7fedec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.332+0000 7fee0259c700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedec060f70 0x7fedec063430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fee040f7630 tx=0x7fedf400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:00.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.335+0000 7fedf2ffd700 1 -- 172.21.15.8:0/100942739 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fedf8051be0 con 0x7fee040f77d0 2023-10-18T21:10:00.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:59.168301+0000 mgr.smithi008.flmjzp (mgr.14640) 669 : cluster [DBG] pgmap v478: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:00.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:59.765758+0000 mon.smithi008 (mon.0) 1126 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:00.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:59.766643+0000 mon.smithi008 (mon.0) 1127 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:00.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:59.771893+0000 mon.smithi008 (mon.0) 1128 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:00.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:59.777005+0000 mon.smithi008 (mon.0) 1129 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:00.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:59.779308+0000 mon.smithi008 (mon.0) 1130 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:00.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:59.780583+0000 mon.smithi008 (mon.0) 1131 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:00.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:59.781807+0000 mon.smithi008 (mon.0) 1132 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:00.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:59.783318+0000 mon.smithi008 (mon.0) 1133 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:00.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:59.999826+0000 mon.smithi008 (mon.0) 1134 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay(laggy or crashed)} 2023-10-18T21:10:00.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000268+0000 mon.smithi008 (mon.0) 1135 : cluster [WRN] Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 21 daemons have recently crashed 2023-10-18T21:10:00.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000283+0000 mon.smithi008 (mon.0) 1136 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2023-10-18T21:10:00.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000290+0000 mon.smithi008 (mon.0) 1137 : cluster [WRN] daemon mds.cephfs.smithi008.mpstiw on smithi008 is in error state 2023-10-18T21:10:00.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000296+0000 mon.smithi008 (mon.0) 1138 : cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2023-10-18T21:10:00.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000304+0000 mon.smithi008 (mon.0) 1139 : cluster [WRN] fs cephfs is degraded 2023-10-18T21:10:00.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000313+0000 mon.smithi008 (mon.0) 1140 : cluster [WRN] [WRN] MDS_INSUFFICIENT_STANDBY: insufficient standby MDS daemons available 2023-10-18T21:10:00.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000321+0000 mon.smithi008 (mon.0) 1141 : cluster [WRN] have 0; want 1 more 2023-10-18T21:10:00.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000328+0000 mon.smithi008 (mon.0) 1142 : cluster [WRN] [WRN] RECENT_CRASH: 21 daemons have recently crashed 2023-10-18T21:10:00.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000336+0000 mon.smithi008 (mon.0) 1143 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:04:53.712088Z 2023-10-18T21:10:00.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000345+0000 mon.smithi008 (mon.0) 1144 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:06.040852Z 2023-10-18T21:10:00.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000354+0000 mon.smithi008 (mon.0) 1145 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:05:18.608464Z 2023-10-18T21:10:00.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000363+0000 mon.smithi008 (mon.0) 1146 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:30.912404Z 2023-10-18T21:10:00.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000371+0000 mon.smithi008 (mon.0) 1147 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:05:42.294371Z 2023-10-18T21:10:00.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000379+0000 mon.smithi008 (mon.0) 1148 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:54.337607Z 2023-10-18T21:10:00.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000391+0000 mon.smithi008 (mon.0) 1149 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:06:06.371237Z 2023-10-18T21:10:00.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000400+0000 mon.smithi008 (mon.0) 1150 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:06:18.404137Z 2023-10-18T21:10:00.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000407+0000 mon.smithi008 (mon.0) 1151 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:04.931636Z 2023-10-18T21:10:00.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000415+0000 mon.smithi008 (mon.0) 1152 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:16.718165Z 2023-10-18T21:10:00.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000442+0000 mon.smithi008 (mon.0) 1153 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:27.955553Z 2023-10-18T21:10:00.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000472+0000 mon.smithi008 (mon.0) 1154 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:07:44.946768Z 2023-10-18T21:10:00.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000484+0000 mon.smithi008 (mon.0) 1155 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:07:56.316504Z 2023-10-18T21:10:00.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000492+0000 mon.smithi008 (mon.0) 1156 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:08.201797Z 2023-10-18T21:10:00.495 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000500+0000 mon.smithi008 (mon.0) 1157 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:08:19.950444Z 2023-10-18T21:10:00.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000508+0000 mon.smithi008 (mon.0) 1158 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:31.274473Z 2023-10-18T21:10:00.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000516+0000 mon.smithi008 (mon.0) 1159 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:08:43.332863Z 2023-10-18T21:10:00.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000527+0000 mon.smithi008 (mon.0) 1160 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:54.982081Z 2023-10-18T21:10:00.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000535+0000 mon.smithi008 (mon.0) 1161 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:09:06.516458Z 2023-10-18T21:10:00.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000542+0000 mon.smithi008 (mon.0) 1162 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:09:18.552578Z 2023-10-18T21:10:00.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:00.000550+0000 mon.smithi008 (mon.0) 1163 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:09:29.990016Z 2023-10-18T21:10:00.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.527+0000 7fee0359e700 1 -- 172.21.15.8:0/100942739 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee0410ac00 con 0x7fedec060f70 2023-10-18T21:10:00.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.537+0000 7fedf2ffd700 1 -- 172.21.15.8:0/100942739 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fee0410ac00 con 0x7fedec060f70 2023-10-18T21:10:00.539 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:10:00.539 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (16m) 4m ago 18m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:10:00.540 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (10m) 4m ago 18m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:10:00.540 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (10m) 2m ago 17m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:10:00.540 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (16m) 4m ago 17m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:10:00.540 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (4m) 4m ago 14m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:10:00.540 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 14m - - 2023-10-18T21:10:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (3m) 2m ago 14m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:10:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (2m) 2m ago 14m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:10:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (11m) 4m ago 19m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:10:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (11m) 2m ago 17m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:10:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (11m) 4m ago 19m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:10:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (10m) 2m ago 17m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:10:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (17m) 4m ago 17m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:10:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (16m) 2m ago 16m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:10:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (10m) 4m ago 16m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:10:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (8m) 4m ago 16m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:10:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (7m) 4m ago 16m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:10:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (7m) 2m ago 15m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:10:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (6m) 2m ago 15m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:10:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (6m) 2m ago 15m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:10:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (12m) 4m ago 17m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:10:00.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 -- 172.21.15.8:0/100942739 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedec060f70 msgr2=0x7fedec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:00.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedec060f70 0x7fedec063430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fee040f7630 tx=0x7fedf400b040).stop 2023-10-18T21:10:00.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 -- 172.21.15.8:0/100942739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee040f77d0 msgr2=0x7fee04109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:00.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee040f77d0 0x7fee04109400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fedf8009f50 tx=0x7fedf8009b30).stop 2023-10-18T21:10:00.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 -- 172.21.15.8:0/100942739 shutdown_connections 2023-10-18T21:10:00.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedec060f70 0x7fedec063430 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee040f6530 0x7fee04108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 --2- 172.21.15.8:0/100942739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee040f77d0 0x7fee04109400 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 -- 172.21.15.8:0/100942739 >> 172.21.15.8:0/100942739 conn(0x7fee040f1c90 msgr2=0x7fee0406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:00.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 -- 172.21.15.8:0/100942739 shutdown_connections 2023-10-18T21:10:00.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.539+0000 7fee0359e700 1 -- 172.21.15.8:0/100942739 wait complete. 2023-10-18T21:10:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:59.168301+0000 mgr.smithi008.flmjzp (mgr.14640) 669 : cluster [DBG] pgmap v478: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:59.765758+0000 mon.smithi008 (mon.0) 1126 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:59.766643+0000 mon.smithi008 (mon.0) 1127 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:59.771893+0000 mon.smithi008 (mon.0) 1128 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:59.777005+0000 mon.smithi008 (mon.0) 1129 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:59.779308+0000 mon.smithi008 (mon.0) 1130 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:59.780583+0000 mon.smithi008 (mon.0) 1131 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:59.781807+0000 mon.smithi008 (mon.0) 1132 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:59.783318+0000 mon.smithi008 (mon.0) 1133 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:00.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:59.999826+0000 mon.smithi008 (mon.0) 1134 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi060.rvrncq=up:replay(laggy or crashed)} 2023-10-18T21:10:00.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000268+0000 mon.smithi008 (mon.0) 1135 : cluster [WRN] Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 21 daemons have recently crashed 2023-10-18T21:10:00.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000283+0000 mon.smithi008 (mon.0) 1136 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2023-10-18T21:10:00.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000290+0000 mon.smithi008 (mon.0) 1137 : cluster [WRN] daemon mds.cephfs.smithi008.mpstiw on smithi008 is in error state 2023-10-18T21:10:00.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000296+0000 mon.smithi008 (mon.0) 1138 : cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2023-10-18T21:10:00.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000304+0000 mon.smithi008 (mon.0) 1139 : cluster [WRN] fs cephfs is degraded 2023-10-18T21:10:00.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000313+0000 mon.smithi008 (mon.0) 1140 : cluster [WRN] [WRN] MDS_INSUFFICIENT_STANDBY: insufficient standby MDS daemons available 2023-10-18T21:10:00.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000321+0000 mon.smithi008 (mon.0) 1141 : cluster [WRN] have 0; want 1 more 2023-10-18T21:10:00.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000328+0000 mon.smithi008 (mon.0) 1142 : cluster [WRN] [WRN] RECENT_CRASH: 21 daemons have recently crashed 2023-10-18T21:10:00.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000336+0000 mon.smithi008 (mon.0) 1143 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:04:53.712088Z 2023-10-18T21:10:00.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000345+0000 mon.smithi008 (mon.0) 1144 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:06.040852Z 2023-10-18T21:10:00.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000354+0000 mon.smithi008 (mon.0) 1145 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:05:18.608464Z 2023-10-18T21:10:00.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000363+0000 mon.smithi008 (mon.0) 1146 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:30.912404Z 2023-10-18T21:10:00.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000371+0000 mon.smithi008 (mon.0) 1147 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:05:42.294371Z 2023-10-18T21:10:00.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000379+0000 mon.smithi008 (mon.0) 1148 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:54.337607Z 2023-10-18T21:10:00.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000391+0000 mon.smithi008 (mon.0) 1149 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:06:06.371237Z 2023-10-18T21:10:00.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000400+0000 mon.smithi008 (mon.0) 1150 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:06:18.404137Z 2023-10-18T21:10:00.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000407+0000 mon.smithi008 (mon.0) 1151 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:04.931636Z 2023-10-18T21:10:00.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000415+0000 mon.smithi008 (mon.0) 1152 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:16.718165Z 2023-10-18T21:10:00.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000442+0000 mon.smithi008 (mon.0) 1153 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:27.955553Z 2023-10-18T21:10:00.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000472+0000 mon.smithi008 (mon.0) 1154 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:07:44.946768Z 2023-10-18T21:10:00.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000484+0000 mon.smithi008 (mon.0) 1155 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:07:56.316504Z 2023-10-18T21:10:00.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000492+0000 mon.smithi008 (mon.0) 1156 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:08.201797Z 2023-10-18T21:10:00.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000500+0000 mon.smithi008 (mon.0) 1157 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:08:19.950444Z 2023-10-18T21:10:00.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000508+0000 mon.smithi008 (mon.0) 1158 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:31.274473Z 2023-10-18T21:10:00.678 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000516+0000 mon.smithi008 (mon.0) 1159 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:08:43.332863Z 2023-10-18T21:10:00.678 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000527+0000 mon.smithi008 (mon.0) 1160 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:54.982081Z 2023-10-18T21:10:00.678 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000535+0000 mon.smithi008 (mon.0) 1161 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:09:06.516458Z 2023-10-18T21:10:00.678 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000542+0000 mon.smithi008 (mon.0) 1162 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:09:18.552578Z 2023-10-18T21:10:00.678 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:00.000550+0000 mon.smithi008 (mon.0) 1163 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:09:29.990016Z 2023-10-18T21:10:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.678+0000 7f74ca1d5700 1 -- 172.21.15.8:0/2623759391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c40f77d0 msgr2=0x7f74c40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.678+0000 7f74ca1d5700 1 --2- 172.21.15.8:0/2623759391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c40f77d0 0x7f74c40f7c30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f74b4004660 tx=0x7f74b4009b30).stop 2023-10-18T21:10:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.678+0000 7f74ca1d5700 1 -- 172.21.15.8:0/2623759391 shutdown_connections 2023-10-18T21:10:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.678+0000 7f74ca1d5700 1 --2- 172.21.15.8:0/2623759391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c40f77d0 0x7f74c40f7c30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.678+0000 7f74ca1d5700 1 --2- 172.21.15.8:0/2623759391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c40f6530 0x7f74c40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:10:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.678+0000 7f74ca1d5700 1 -- 172.21.15.8:0/2623759391 >> 172.21.15.8:0/2623759391 conn(0x7f74c40f1c90 msgr2=0x7f74c40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.678+0000 7f74ca1d5700 1 -- 172.21.15.8:0/2623759391 shutdown_connections 2023-10-18T21:10:00.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.678+0000 7f74ca1d5700 1 -- 172.21.15.8:0/2623759391 wait complete. 2023-10-18T21:10:00.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.679+0000 7f74ca1d5700 1 Processor -- start 2023-10-18T21:10:00.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.679+0000 7f74ca1d5700 1 -- start start 2023-10-18T21:10:00.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74ca1d5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c40f6530 0x7f74c4106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:00.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74ca1d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c40f77d0 0x7f74c4107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:00.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74ca1d5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c41079a0 con 0x7f74c40f77d0 2023-10-18T21:10:00.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74ca1d5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4108120 con 0x7f74c40f6530 2023-10-18T21:10:00.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74c89d2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c40f77d0 0x7f74c4107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:00.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74c89d2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c40f77d0 0x7f74c4107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34038/0 (socket says 172.21.15.8:34038) 2023-10-18T21:10:00.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74c89d2700 1 -- 172.21.15.8:0/1896399002 learned_addr learned my addr 172.21.15.8:0/1896399002 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:10:00.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74c91d3700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c40f6530 0x7f74c4106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:00.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74c89d2700 1 -- 172.21.15.8:0/1896399002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c40f6530 msgr2=0x7f74c4106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:00.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74c89d2700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c40f6530 0x7f74c4106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.680+0000 7f74c89d2700 1 -- 172.21.15.8:0/1896399002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b4005040 con 0x7f74c40f77d0 2023-10-18T21:10:00.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.681+0000 7f74c89d2700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c40f77d0 0x7f74c4107310 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f74b4009830 tx=0x7f74b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:00.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.681+0000 7f74b9ffb700 1 -- 172.21.15.8:0/1896399002 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b4018070 con 0x7f74c40f77d0 2023-10-18T21:10:00.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.681+0000 7f74b9ffb700 1 -- 172.21.15.8:0/1896399002 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f74b401d8e0 con 0x7f74c40f77d0 2023-10-18T21:10:00.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.681+0000 7f74ca1d5700 1 -- 172.21.15.8:0/1896399002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c4108340 con 0x7f74c40f77d0 2023-10-18T21:10:00.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.681+0000 7f74b9ffb700 1 -- 172.21.15.8:0/1896399002 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b401c480 con 0x7f74c40f77d0 2023-10-18T21:10:00.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.681+0000 7f74ca1d5700 1 -- 172.21.15.8:0/1896399002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c41088a0 con 0x7f74c40f77d0 2023-10-18T21:10:00.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.682+0000 7f74ca1d5700 1 -- 172.21.15.8:0/1896399002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c4045ad0 con 0x7f74c40f77d0 2023-10-18T21:10:00.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.683+0000 7f74b9ffb700 1 -- 172.21.15.8:0/1896399002 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f74b401da50 con 0x7f74c40f77d0 2023-10-18T21:10:00.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.684+0000 7f74b9ffb700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74b0060f70 0x7f74b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:00.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.685+0000 7f74b9ffb700 1 -- 172.21.15.8:0/1896399002 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f74b407e780 con 0x7f74c40f77d0 2023-10-18T21:10:00.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.685+0000 7f74c91d3700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74b0060f70 0x7f74b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:00.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.685+0000 7f74c91d3700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74b0060f70 0x7f74b0063430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f74c4106b90 tx=0x7f74c0008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:00.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.689+0000 7f74b9ffb700 1 -- 172.21.15.8:0/1896399002 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f74b404e3b0 con 0x7f74c40f77d0 2023-10-18T21:10:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.945+0000 7f74ca1d5700 1 -- 172.21.15.8:0/1896399002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f74c40fee60 con 0x7f74c40f77d0 2023-10-18T21:10:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.945+0000 7f74b9ffb700 1 -- 172.21.15.8:0/1896399002 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f74b40519d0 con 0x7f74c40f77d0 2023-10-18T21:10:00.948 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:10:00.948 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:10:00.948 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:10:00.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:10:00.948 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:10:00.949 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:10:00.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:10:00.949 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:10:00.949 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:10:00.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:10:00.950 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:10:00.950 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:10:00.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:10:00.950 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:10:00.951 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:10:00.951 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:10:00.951 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:10:00.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.947+0000 7f74ca1d5700 1 -- 172.21.15.8:0/1896399002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74b0060f70 msgr2=0x7f74b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:00.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.947+0000 7f74ca1d5700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74b0060f70 0x7f74b0063430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f74c4106b90 tx=0x7f74c0008040).stop 2023-10-18T21:10:00.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.947+0000 7f74ca1d5700 1 -- 172.21.15.8:0/1896399002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c40f77d0 msgr2=0x7f74c4107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:00.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.947+0000 7f74ca1d5700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c40f77d0 0x7f74c4107310 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f74b4009830 tx=0x7f74b4009b30).stop 2023-10-18T21:10:00.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.947+0000 7f74ca1d5700 1 -- 172.21.15.8:0/1896399002 shutdown_connections 2023-10-18T21:10:00.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.947+0000 7f74ca1d5700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74b0060f70 0x7f74b0063430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.947+0000 7f74ca1d5700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c40f6530 0x7f74c4106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.947+0000 7f74ca1d5700 1 --2- 172.21.15.8:0/1896399002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c40f77d0 0x7f74c4107310 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:00.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.947+0000 7f74ca1d5700 1 -- 172.21.15.8:0/1896399002 >> 172.21.15.8:0/1896399002 conn(0x7f74c40f1c90 msgr2=0x7f74c40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:00.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.948+0000 7f74ca1d5700 1 -- 172.21.15.8:0/1896399002 shutdown_connections 2023-10-18T21:10:00.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:00.948+0000 7f74ca1d5700 1 -- 172.21.15.8:0/1896399002 wait complete. 2023-10-18T21:10:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.084+0000 7f81fdd89700 1 -- 172.21.15.8:0/984034393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f77d0 msgr2=0x7f81f80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.084+0000 7f81fdd89700 1 --2- 172.21.15.8:0/984034393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f77d0 0x7f81f80f7c30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f81e4004660 tx=0x7f81e4009b30).stop 2023-10-18T21:10:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.085+0000 7f81fdd89700 1 -- 172.21.15.8:0/984034393 shutdown_connections 2023-10-18T21:10:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.085+0000 7f81fdd89700 1 --2- 172.21.15.8:0/984034393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f77d0 0x7f81f80f7c30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.085+0000 7f81fdd89700 1 --2- 172.21.15.8:0/984034393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f6530 0x7f81f80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.085+0000 7f81fdd89700 1 -- 172.21.15.8:0/984034393 >> 172.21.15.8:0/984034393 conn(0x7f81f80f1c90 msgr2=0x7f81f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.085+0000 7f81fdd89700 1 -- 172.21.15.8:0/984034393 shutdown_connections 2023-10-18T21:10:01.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.085+0000 7f81fdd89700 1 -- 172.21.15.8:0/984034393 wait complete. 2023-10-18T21:10:01.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.086+0000 7f81fdd89700 1 Processor -- start 2023-10-18T21:10:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.086+0000 7f81fdd89700 1 -- start start 2023-10-18T21:10:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.086+0000 7f81fdd89700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f6530 0x7f81f8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.086+0000 7f81fdd89700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f77d0 0x7f81f8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.086+0000 7f81fdd89700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8107880 con 0x7f81f80f77d0 2023-10-18T21:10:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.086+0000 7f81fdd89700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f81080c0 con 0x7f81f80f6530 2023-10-18T21:10:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.086+0000 7f81f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f77d0 0x7f81f8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f77d0 0x7f81f8107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34044/0 (socket says 172.21.15.8:34044) 2023-10-18T21:10:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81f7fff700 1 -- 172.21.15.8:0/3808156487 learned_addr learned my addr 172.21.15.8:0/3808156487 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:10:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81fcd87700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f6530 0x7f81f8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81f7fff700 1 -- 172.21.15.8:0/3808156487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f6530 msgr2=0x7f81f8106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:01.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81f7fff700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f6530 0x7f81f8106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81f7fff700 1 -- 172.21.15.8:0/3808156487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e4005040 con 0x7f81f80f77d0 2023-10-18T21:10:01.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81f7fff700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f77d0 0x7f81f8107280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f81e4009990 tx=0x7f81e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:01.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81f57fa700 1 -- 172.21.15.8:0/3808156487 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81e4018070 con 0x7f81f80f77d0 2023-10-18T21:10:01.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81f57fa700 1 -- 172.21.15.8:0/3808156487 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f81e4009630 con 0x7f81f80f77d0 2023-10-18T21:10:01.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81fdd89700 1 -- 172.21.15.8:0/3808156487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f8108340 con 0x7f81f80f77d0 2023-10-18T21:10:01.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.087+0000 7f81f57fa700 1 -- 172.21.15.8:0/3808156487 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81e401c3c0 con 0x7f81f80f77d0 2023-10-18T21:10:01.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.088+0000 7f81fdd89700 1 -- 172.21.15.8:0/3808156487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f8108820 con 0x7f81f80f77d0 2023-10-18T21:10:01.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.088+0000 7f81fdd89700 1 -- 172.21.15.8:0/3808156487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f8059100 con 0x7f81f80f77d0 2023-10-18T21:10:01.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.090+0000 7f81f57fa700 1 -- 172.21.15.8:0/3808156487 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f81e401d970 con 0x7f81f80f77d0 2023-10-18T21:10:01.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.090+0000 7f81f57fa700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e8060f70 0x7f81e8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:01.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.090+0000 7f81f57fa700 1 -- 172.21.15.8:0/3808156487 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f81e407e640 con 0x7f81f80f77d0 2023-10-18T21:10:01.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.091+0000 7f81fcd87700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e8060f70 0x7f81e8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:01.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.091+0000 7f81fcd87700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e8060f70 0x7f81e8063430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f81f8107b50 tx=0x7f81ec00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:01.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.095+0000 7f81f57fa700 1 -- 172.21.15.8:0/3808156487 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f81e404e1f0 con 0x7f81f80f77d0 2023-10-18T21:10:01.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.323+0000 7f81fdd89700 1 -- 172.21.15.8:0/3808156487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f81f8045ad0 con 0x7f81f80f77d0 2023-10-18T21:10:01.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.324+0000 7f81f57fa700 1 -- 172.21.15.8:0/3808156487 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f81e4051810 con 0x7f81f80f77d0 2023-10-18T21:10:01.327 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:10:01.327 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:10:01.327 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:10:01.327 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:10:01.327 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:10:01.328 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:10:01.328 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:10:01.328 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:10:01.328 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:10:01.329 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:10:01.329 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:10:01.329 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:10:01.329 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:10:01.329 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:10:01.329 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:10:01.330 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:10:01.330 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:10:01.330 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:10:01.330 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:10:01.330 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:10:01.331 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:10:01.331 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:10:01.331 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:10:01.331 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:10:01.331 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:10:01.332 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:10:01.332 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:10:01.332 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:10:01.332 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:10:01.332 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:10:01.332 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:10:01.333 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:10:01.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:10:01.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:10:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 -- 172.21.15.8:0/3808156487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e8060f70 msgr2=0x7f81e8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e8060f70 0x7f81e8063430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f81f8107b50 tx=0x7f81ec00b040).stop 2023-10-18T21:10:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 -- 172.21.15.8:0/3808156487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f77d0 msgr2=0x7f81f8107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f77d0 0x7f81f8107280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f81e4009990 tx=0x7f81e4009b30).stop 2023-10-18T21:10:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 -- 172.21.15.8:0/3808156487 shutdown_connections 2023-10-18T21:10:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e8060f70 0x7f81e8063430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f6530 0x7f81f8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 --2- 172.21.15.8:0/3808156487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f77d0 0x7f81f8107280 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 -- 172.21.15.8:0/3808156487 >> 172.21.15.8:0/3808156487 conn(0x7f81f80f1c90 msgr2=0x7f81f80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:01.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 -- 172.21.15.8:0/3808156487 shutdown_connections 2023-10-18T21:10:01.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.326+0000 7f81fdd89700 1 -- 172.21.15.8:0/3808156487 wait complete. 2023-10-18T21:10:01.336 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:10:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.464+0000 7f1b5201d700 1 -- 172.21.15.8:0/1988564343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b4c0f6530 msgr2=0x7f1b4c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.464+0000 7f1b5201d700 1 --2- 172.21.15.8:0/1988564343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b4c0f6530 0x7f1b4c0f6950 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f1b48004660 tx=0x7f1b48009b30).stop 2023-10-18T21:10:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.464+0000 7f1b5201d700 1 -- 172.21.15.8:0/1988564343 shutdown_connections 2023-10-18T21:10:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.464+0000 7f1b5201d700 1 --2- 172.21.15.8:0/1988564343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b4c0f77d0 0x7f1b4c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.464+0000 7f1b5201d700 1 --2- 172.21.15.8:0/1988564343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b4c0f6530 0x7f1b4c0f6950 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.464+0000 7f1b5201d700 1 -- 172.21.15.8:0/1988564343 >> 172.21.15.8:0/1988564343 conn(0x7f1b4c0f1c90 msgr2=0x7f1b4c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:01.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.464+0000 7f1b5201d700 1 -- 172.21.15.8:0/1988564343 shutdown_connections 2023-10-18T21:10:01.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.464+0000 7f1b5201d700 1 -- 172.21.15.8:0/1988564343 wait complete. 2023-10-18T21:10:01.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.465+0000 7f1b5201d700 1 Processor -- start 2023-10-18T21:10:01.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.465+0000 7f1b5201d700 1 -- start start 2023-10-18T21:10:01.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.465+0000 7f1b5201d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b4c0f6530 0x7f1b4c108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:01.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5201d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b4c0f77d0 0x7f1b4c1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:01.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5201d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c109a60 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5201d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c109ba0 con 0x7f1b4c0f6530 2023-10-18T21:10:01.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5081a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b4c0f77d0 0x7f1b4c1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:01.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5081a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b4c0f77d0 0x7f1b4c1094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34048/0 (socket says 172.21.15.8:34048) 2023-10-18T21:10:01.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5081a700 1 -- 172.21.15.8:0/3311454899 learned_addr learned my addr 172.21.15.8:0/3311454899 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:10:01.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5101b700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b4c0f6530 0x7f1b4c108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:01.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5081a700 1 -- 172.21.15.8:0/3311454899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b4c0f6530 msgr2=0x7f1b4c108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:01.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5081a700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b4c0f6530 0x7f1b4c108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5081a700 1 -- 172.21.15.8:0/3311454899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b48005040 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.466+0000 7f1b5081a700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b4c0f77d0 0x7f1b4c1094b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f1b3c00c790 tx=0x7f1b3c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:01.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.467+0000 7f1b41ffb700 1 -- 172.21.15.8:0/3311454899 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b3c002590 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.467+0000 7f1b41ffb700 1 -- 172.21.15.8:0/3311454899 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1b3c002bb0 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.467+0000 7f1b41ffb700 1 -- 172.21.15.8:0/3311454899 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b3c013e10 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.467+0000 7f1b5201d700 1 -- 172.21.15.8:0/3311454899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c10a540 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.467+0000 7f1b5201d700 1 -- 172.21.15.8:0/3311454899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c10aa60 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.468+0000 7f1b5201d700 1 -- 172.21.15.8:0/3311454899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c045ad0 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.469+0000 7f1b41ffb700 1 -- 172.21.15.8:0/3311454899 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1b3c01a060 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.470+0000 7f1b41ffb700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b38060f70 0x7f1b38063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:01.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.470+0000 7f1b41ffb700 1 -- 172.21.15.8:0/3311454899 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1b3c07cbf0 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.470+0000 7f1b5101b700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b38060f70 0x7f1b38063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:01.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.471+0000 7f1b5101b700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b38060f70 0x7f1b38063430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f1b48009f50 tx=0x7f1b48009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:01.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.474+0000 7f1b41ffb700 1 -- 172.21.15.8:0/3311454899 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1b3c050060 con 0x7f1b4c0f77d0 2023-10-18T21:10:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:59.767323+0000 mgr.smithi008.flmjzp (mgr.14640) 670 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:59.767936+0000 mgr.smithi008.flmjzp (mgr.14640) 671 : cluster [DBG] pgmap v479: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:09:59.768190+0000 mgr.smithi008.flmjzp (mgr.14640) 672 : cluster [DBG] pgmap v480: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:09:59.784863+0000 mgr.smithi008.flmjzp (mgr.14640) 673 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:09:59.834555+0000 mgr.smithi008.flmjzp (mgr.14640) 674 : audit [DBG] from='client.34764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:00.185968+0000 mgr.smithi008.flmjzp (mgr.14640) 675 : audit [DBG] from='client.34768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:00.530012+0000 mgr.smithi008.flmjzp (mgr.14640) 676 : audit [DBG] from='client.34772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:00.946936+0000 mon.smithi008 (mon.0) 1164 : audit [DBG] from='client.? 172.21.15.8:0/1896399002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:59.767323+0000 mgr.smithi008.flmjzp (mgr.14640) 670 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:59.767936+0000 mgr.smithi008.flmjzp (mgr.14640) 671 : cluster [DBG] pgmap v479: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:09:59.768190+0000 mgr.smithi008.flmjzp (mgr.14640) 672 : cluster [DBG] pgmap v480: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:09:59.784863+0000 mgr.smithi008.flmjzp (mgr.14640) 673 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:09:59.834555+0000 mgr.smithi008.flmjzp (mgr.14640) 674 : audit [DBG] from='client.34764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:00.185968+0000 mgr.smithi008.flmjzp (mgr.14640) 675 : audit [DBG] from='client.34768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:00.530012+0000 mgr.smithi008.flmjzp (mgr.14640) 676 : audit [DBG] from='client.34772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:00.946936+0000 mon.smithi008 (mon.0) 1164 : audit [DBG] from='client.? 172.21.15.8:0/1896399002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:01.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.672+0000 7f1b5201d700 1 -- 172.21.15.8:0/3311454899 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b4c0fee30 con 0x7f1b38060f70 2023-10-18T21:10:01.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.673+0000 7f1b41ffb700 1 -- 172.21.15.8:0/3311454899 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1b4c0fee30 con 0x7f1b38060f70 2023-10-18T21:10:01.675 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:10:01.676 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:10:01.676 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:10:01.676 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:10:01.676 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:10:01.676 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:10:01.677 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:10:01.677 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:10:01.677 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:10:01.677 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:10:01.677 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:10:01.677 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:10:01.678 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:10:01.678 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:10:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.675+0000 7f1b5201d700 1 -- 172.21.15.8:0/3311454899 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b38060f70 msgr2=0x7f1b38063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.675+0000 7f1b5201d700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b38060f70 0x7f1b38063430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f1b48009f50 tx=0x7f1b48009b30).stop 2023-10-18T21:10:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.675+0000 7f1b5201d700 1 -- 172.21.15.8:0/3311454899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b4c0f77d0 msgr2=0x7f1b4c1094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.675+0000 7f1b5201d700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b4c0f77d0 0x7f1b4c1094b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f1b3c00c790 tx=0x7f1b3c007d70).stop 2023-10-18T21:10:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.675+0000 7f1b5201d700 1 -- 172.21.15.8:0/3311454899 shutdown_connections 2023-10-18T21:10:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.675+0000 7f1b5201d700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b38060f70 0x7f1b38063430 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.675+0000 7f1b5201d700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b4c0f6530 0x7f1b4c108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.675+0000 7f1b5201d700 1 --2- 172.21.15.8:0/3311454899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b4c0f77d0 0x7f1b4c1094b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.675+0000 7f1b5201d700 1 -- 172.21.15.8:0/3311454899 >> 172.21.15.8:0/3311454899 conn(0x7f1b4c0f1c90 msgr2=0x7f1b4c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.676+0000 7f1b5201d700 1 -- 172.21.15.8:0/3311454899 shutdown_connections 2023-10-18T21:10:01.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:01.676+0000 7f1b5201d700 1 -- 172.21.15.8:0/3311454899 wait complete. 2023-10-18T21:10:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:01.325647+0000 mon.smithi008 (mon.0) 1165 : audit [DBG] from='client.? 172.21.15.8:0/3808156487' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:10:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:01.674542+0000 mgr.smithi008.flmjzp (mgr.14640) 677 : audit [DBG] from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:01.325647+0000 mon.smithi008 (mon.0) 1165 : audit [DBG] from='client.? 172.21.15.8:0/3808156487' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:10:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:01.674542+0000 mgr.smithi008.flmjzp (mgr.14640) 677 : audit [DBG] from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:03.533 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:01.768785+0000 mgr.smithi008.flmjzp (mgr.14640) 678 : cluster [DBG] pgmap v481: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:01.768785+0000 mgr.smithi008.flmjzp (mgr.14640) 678 : cluster [DBG] pgmap v481: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:03.769533+0000 mgr.smithi008.flmjzp (mgr.14640) 679 : cluster [DBG] pgmap v482: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:03.769533+0000 mgr.smithi008.flmjzp (mgr.14640) 679 : cluster [DBG] pgmap v482: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:05.770050+0000 mgr.smithi008.flmjzp (mgr.14640) 680 : cluster [DBG] pgmap v483: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:05.770050+0000 mgr.smithi008.flmjzp (mgr.14640) 680 : cluster [DBG] pgmap v483: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:07.770584+0000 mgr.smithi008.flmjzp (mgr.14640) 681 : cluster [DBG] pgmap v484: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:07.770584+0000 mgr.smithi008.flmjzp (mgr.14640) 681 : cluster [DBG] pgmap v484: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:09.795559+0000 mon.smithi008 (mon.0) 1166 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:09.797823+0000 mon.smithi008 (mon.0) 1167 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:09.798855+0000 mon.smithi008 (mon.0) 1168 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:09.805285+0000 mon.smithi008 (mon.0) 1169 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:09.811652+0000 mon.smithi008 (mon.0) 1170 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:09.814689+0000 mon.smithi008 (mon.0) 1171 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:09.816364+0000 mon.smithi008 (mon.0) 1172 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:09.817944+0000 mon.smithi008 (mon.0) 1173 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:09.819922+0000 mon.smithi008 (mon.0) 1174 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:09.795559+0000 mon.smithi008 (mon.0) 1166 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:09.797823+0000 mon.smithi008 (mon.0) 1167 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:09.798855+0000 mon.smithi008 (mon.0) 1168 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:09.805285+0000 mon.smithi008 (mon.0) 1169 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:09.811652+0000 mon.smithi008 (mon.0) 1170 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:09.814689+0000 mon.smithi008 (mon.0) 1171 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:09.816364+0000 mon.smithi008 (mon.0) 1172 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:09.817944+0000 mon.smithi008 (mon.0) 1173 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:09.819922+0000 mon.smithi008 (mon.0) 1174 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:09.771057+0000 mgr.smithi008.flmjzp (mgr.14640) 682 : cluster [DBG] pgmap v485: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:10:09.799764+0000 mgr.smithi008.flmjzp (mgr.14640) 683 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:09.800305+0000 mgr.smithi008.flmjzp (mgr.14640) 684 : cluster [DBG] pgmap v486: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:09.800545+0000 mgr.smithi008.flmjzp (mgr.14640) 685 : cluster [DBG] pgmap v487: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:10:09.821896+0000 mgr.smithi008.flmjzp (mgr.14640) 686 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:09.771057+0000 mgr.smithi008.flmjzp (mgr.14640) 682 : cluster [DBG] pgmap v485: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:10:09.799764+0000 mgr.smithi008.flmjzp (mgr.14640) 683 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:09.800305+0000 mgr.smithi008.flmjzp (mgr.14640) 684 : cluster [DBG] pgmap v486: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:09.800545+0000 mgr.smithi008.flmjzp (mgr.14640) 685 : cluster [DBG] pgmap v487: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:10:09.821896+0000 mgr.smithi008.flmjzp (mgr.14640) 686 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:13.533 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:11.801070+0000 mgr.smithi008.flmjzp (mgr.14640) 687 : cluster [DBG] pgmap v488: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:11.801070+0000 mgr.smithi008.flmjzp (mgr.14640) 687 : cluster [DBG] pgmap v488: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:13.801792+0000 mgr.smithi008.flmjzp (mgr.14640) 688 : cluster [DBG] pgmap v489: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:13.801792+0000 mgr.smithi008.flmjzp (mgr.14640) 688 : cluster [DBG] pgmap v489: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:15.802325+0000 mgr.smithi008.flmjzp (mgr.14640) 689 : cluster [DBG] pgmap v490: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:15.802325+0000 mgr.smithi008.flmjzp (mgr.14640) 689 : cluster [DBG] pgmap v490: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:17.802878+0000 mgr.smithi008.flmjzp (mgr.14640) 690 : cluster [DBG] pgmap v491: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:17.802878+0000 mgr.smithi008.flmjzp (mgr.14640) 690 : cluster [DBG] pgmap v491: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:19.832584+0000 mon.smithi008 (mon.0) 1175 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:19.834782+0000 mon.smithi008 (mon.0) 1176 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:19.835723+0000 mon.smithi008 (mon.0) 1177 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:19.842300+0000 mon.smithi008 (mon.0) 1178 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:19.848728+0000 mon.smithi008 (mon.0) 1179 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:19.851979+0000 mon.smithi008 (mon.0) 1180 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:19.853711+0000 mon.smithi008 (mon.0) 1181 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:19.855415+0000 mon.smithi008 (mon.0) 1182 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:19.857488+0000 mon.smithi008 (mon.0) 1183 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:19.832584+0000 mon.smithi008 (mon.0) 1175 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:19.834782+0000 mon.smithi008 (mon.0) 1176 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:19.835723+0000 mon.smithi008 (mon.0) 1177 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:19.842300+0000 mon.smithi008 (mon.0) 1178 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:19.848728+0000 mon.smithi008 (mon.0) 1179 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:19.851979+0000 mon.smithi008 (mon.0) 1180 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:19.853711+0000 mon.smithi008 (mon.0) 1181 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:20.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:19.855415+0000 mon.smithi008 (mon.0) 1182 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:20.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:19.857488+0000 mon.smithi008 (mon.0) 1183 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:19.803425+0000 mgr.smithi008.flmjzp (mgr.14640) 691 : cluster [DBG] pgmap v492: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:10:19.836552+0000 mgr.smithi008.flmjzp (mgr.14640) 692 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:19.837111+0000 mgr.smithi008.flmjzp (mgr.14640) 693 : cluster [DBG] pgmap v493: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:19.837366+0000 mgr.smithi008.flmjzp (mgr.14640) 694 : cluster [DBG] pgmap v494: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:10:19.859467+0000 mgr.smithi008.flmjzp (mgr.14640) 695 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:19.803425+0000 mgr.smithi008.flmjzp (mgr.14640) 691 : cluster [DBG] pgmap v492: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:10:19.836552+0000 mgr.smithi008.flmjzp (mgr.14640) 692 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:19.837111+0000 mgr.smithi008.flmjzp (mgr.14640) 693 : cluster [DBG] pgmap v493: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:19.837366+0000 mgr.smithi008.flmjzp (mgr.14640) 694 : cluster [DBG] pgmap v494: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:10:19.859467+0000 mgr.smithi008.flmjzp (mgr.14640) 695 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:21.837864+0000 mgr.smithi008.flmjzp (mgr.14640) 696 : cluster [DBG] pgmap v495: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:21.837864+0000 mgr.smithi008.flmjzp (mgr.14640) 696 : cluster [DBG] pgmap v495: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:23.838404+0000 mgr.smithi008.flmjzp (mgr.14640) 697 : cluster [DBG] pgmap v496: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:23.838404+0000 mgr.smithi008.flmjzp (mgr.14640) 697 : cluster [DBG] pgmap v496: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:25.838982+0000 mgr.smithi008.flmjzp (mgr.14640) 698 : cluster [DBG] pgmap v497: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:25.838982+0000 mgr.smithi008.flmjzp (mgr.14640) 698 : cluster [DBG] pgmap v497: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:27.839537+0000 mgr.smithi008.flmjzp (mgr.14640) 699 : cluster [DBG] pgmap v498: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:27.839537+0000 mgr.smithi008.flmjzp (mgr.14640) 699 : cluster [DBG] pgmap v498: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:29.870208+0000 mon.smithi008 (mon.0) 1184 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:29.872537+0000 mon.smithi008 (mon.0) 1185 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:29.873596+0000 mon.smithi008 (mon.0) 1186 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:29.880629+0000 mon.smithi008 (mon.0) 1187 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:29.887585+0000 mon.smithi008 (mon.0) 1188 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:29.891213+0000 mon.smithi008 (mon.0) 1189 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:29.893205+0000 mon.smithi008 (mon.0) 1190 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:29.895061+0000 mon.smithi008 (mon.0) 1191 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:30.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:29.897627+0000 mon.smithi008 (mon.0) 1192 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:29.870208+0000 mon.smithi008 (mon.0) 1184 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:29.872537+0000 mon.smithi008 (mon.0) 1185 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:29.873596+0000 mon.smithi008 (mon.0) 1186 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:29.880629+0000 mon.smithi008 (mon.0) 1187 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:29.887585+0000 mon.smithi008 (mon.0) 1188 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:29.891213+0000 mon.smithi008 (mon.0) 1189 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:29.893205+0000 mon.smithi008 (mon.0) 1190 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:29.895061+0000 mon.smithi008 (mon.0) 1191 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:30.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:29.897627+0000 mon.smithi008 (mon.0) 1192 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:29.840080+0000 mgr.smithi008.flmjzp (mgr.14640) 700 : cluster [DBG] pgmap v499: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:10:29.874526+0000 mgr.smithi008.flmjzp (mgr.14640) 701 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:29.875111+0000 mgr.smithi008.flmjzp (mgr.14640) 702 : cluster [DBG] pgmap v500: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:29.875347+0000 mgr.smithi008.flmjzp (mgr.14640) 703 : cluster [DBG] pgmap v501: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:10:29.899755+0000 mgr.smithi008.flmjzp (mgr.14640) 704 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:29.840080+0000 mgr.smithi008.flmjzp (mgr.14640) 700 : cluster [DBG] pgmap v499: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:10:29.874526+0000 mgr.smithi008.flmjzp (mgr.14640) 701 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:29.875111+0000 mgr.smithi008.flmjzp (mgr.14640) 702 : cluster [DBG] pgmap v500: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:29.875347+0000 mgr.smithi008.flmjzp (mgr.14640) 703 : cluster [DBG] pgmap v501: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:10:29.899755+0000 mgr.smithi008.flmjzp (mgr.14640) 704 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:31.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.829+0000 7fd3e1761700 1 -- 172.21.15.8:0/850449257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3dc0f6530 msgr2=0x7fd3dc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:31.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.829+0000 7fd3e1761700 1 --2- 172.21.15.8:0/850449257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc0f6950 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fd3cc004660 tx=0x7fd3cc009b30).stop 2023-10-18T21:10:31.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.829+0000 7fd3e1761700 1 -- 172.21.15.8:0/850449257 shutdown_connections 2023-10-18T21:10:31.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.829+0000 7fd3e1761700 1 --2- 172.21.15.8:0/850449257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:31.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.829+0000 7fd3e1761700 1 --2- 172.21.15.8:0/850449257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc0f6950 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:31.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.829+0000 7fd3e1761700 1 -- 172.21.15.8:0/850449257 >> 172.21.15.8:0/850449257 conn(0x7fd3dc0f1c90 msgr2=0x7fd3dc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:31.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.829+0000 7fd3e1761700 1 -- 172.21.15.8:0/850449257 shutdown_connections 2023-10-18T21:10:31.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.829+0000 7fd3e1761700 1 -- 172.21.15.8:0/850449257 wait complete. 2023-10-18T21:10:31.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.830+0000 7fd3e1761700 1 Processor -- start 2023-10-18T21:10:31.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.831+0000 7fd3e1761700 1 -- start start 2023-10-18T21:10:31.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.831+0000 7fd3e1761700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.831+0000 7fd3e1761700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.831+0000 7fd3e1761700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc107880 con 0x7fd3dc0f77d0 2023-10-18T21:10:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.831+0000 7fd3e1761700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc1080c0 con 0x7fd3dc0f6530 2023-10-18T21:10:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.832+0000 7fd3db7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.832+0000 7fd3db7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49520/0 (socket says 172.21.15.8:49520) 2023-10-18T21:10:31.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.832+0000 7fd3db7fe700 1 -- 172.21.15.8:0/3294998137 learned_addr learned my addr 172.21.15.8:0/3294998137 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:10:31.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.832+0000 7fd3dbfff700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:31.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.832+0000 7fd3dbfff700 1 -- 172.21.15.8:0/3294998137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3dc0f77d0 msgr2=0x7fd3dc107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:31.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.832+0000 7fd3dbfff700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:31.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.832+0000 7fd3dbfff700 1 -- 172.21.15.8:0/3294998137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc005040 con 0x7fd3dc0f6530 2023-10-18T21:10:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.832+0000 7fd3db7fe700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:10:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.832+0000 7fd3dbfff700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc106d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd3cc000c00 tx=0x7fd3cc009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.833+0000 7fd3d8ff9700 1 -- 172.21.15.8:0/3294998137 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3cc018070 con 0x7fd3dc0f6530 2023-10-18T21:10:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.833+0000 7fd3d8ff9700 1 -- 172.21.15.8:0/3294998137 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd3cc009630 con 0x7fd3dc0f6530 2023-10-18T21:10:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.833+0000 7fd3e1761700 1 -- 172.21.15.8:0/3294998137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc108340 con 0x7fd3dc0f6530 2023-10-18T21:10:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.833+0000 7fd3d8ff9700 1 -- 172.21.15.8:0/3294998137 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3cc0123c0 con 0x7fd3dc0f6530 2023-10-18T21:10:31.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.833+0000 7fd3e1761700 1 -- 172.21.15.8:0/3294998137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc108820 con 0x7fd3dc0f6530 2023-10-18T21:10:31.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.834+0000 7fd3e1761700 1 -- 172.21.15.8:0/3294998137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3dc059100 con 0x7fd3dc0f6530 2023-10-18T21:10:31.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.835+0000 7fd3d8ff9700 1 -- 172.21.15.8:0/3294998137 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd3cc01d420 con 0x7fd3dc0f6530 2023-10-18T21:10:31.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.836+0000 7fd3d8ff9700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3c4060f70 0x7fd3c4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:31.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.836+0000 7fd3d8ff9700 1 -- 172.21.15.8:0/3294998137 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd3cc07e5c0 con 0x7fd3dc0f6530 2023-10-18T21:10:31.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.836+0000 7fd3db7fe700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3c4060f70 0x7fd3c4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:31.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.836+0000 7fd3db7fe700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3c4060f70 0x7fd3c4063430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fd3dc106b20 tx=0x7fd3d000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:31.841+0000 7fd3d8ff9700 1 -- 172.21.15.8:0/3294998137 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd3cc04e170 con 0x7fd3dc0f6530 2023-10-18T21:10:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.037+0000 7fd3e1761700 1 -- 172.21.15.8:0/3294998137 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3dc0fee00 con 0x7fd3c4060f70 2023-10-18T21:10:32.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.038+0000 7fd3d8ff9700 1 -- 172.21.15.8:0/3294998137 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd3dc0fee00 con 0x7fd3c4060f70 2023-10-18T21:10:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 -- 172.21.15.8:0/3294998137 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3c4060f70 msgr2=0x7fd3c4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3c4060f70 0x7fd3c4063430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fd3dc106b20 tx=0x7fd3d000b040).stop 2023-10-18T21:10:32.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 -- 172.21.15.8:0/3294998137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3dc0f6530 msgr2=0x7fd3dc106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc106d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd3cc000c00 tx=0x7fd3cc009b30).stop 2023-10-18T21:10:32.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 -- 172.21.15.8:0/3294998137 shutdown_connections 2023-10-18T21:10:32.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3c4060f70 0x7fd3c4063430 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc106d90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 --2- 172.21.15.8:0/3294998137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 -- 172.21.15.8:0/3294998137 >> 172.21.15.8:0/3294998137 conn(0x7fd3dc0f1c90 msgr2=0x7fd3dc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:32.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 -- 172.21.15.8:0/3294998137 shutdown_connections 2023-10-18T21:10:32.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.040+0000 7fd3e1761700 1 -- 172.21.15.8:0/3294998137 wait complete. 2023-10-18T21:10:32.056 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:10:32.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.177+0000 7f97c67fc700 1 -- 172.21.15.8:0/2989037437 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b8013b20 con 0x7f97c80f6530 2023-10-18T21:10:32.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.178+0000 7f97cccc0700 1 -- 172.21.15.8:0/2989037437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 msgr2=0x7f97c80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.178+0000 7f97cccc0700 1 --2- 172.21.15.8:0/2989037437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c80f6950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f97b8004660 tx=0x7f97b8009b30).stop 2023-10-18T21:10:32.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.178+0000 7f97cccc0700 1 -- 172.21.15.8:0/2989037437 shutdown_connections 2023-10-18T21:10:32.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.178+0000 7f97cccc0700 1 --2- 172.21.15.8:0/2989037437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f77d0 0x7f97c80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.178+0000 7f97cccc0700 1 --2- 172.21.15.8:0/2989037437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c80f6950 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.178+0000 7f97cccc0700 1 -- 172.21.15.8:0/2989037437 >> 172.21.15.8:0/2989037437 conn(0x7f97c80f1c90 msgr2=0x7f97c80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:32.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.178+0000 7f97cccc0700 1 -- 172.21.15.8:0/2989037437 shutdown_connections 2023-10-18T21:10:32.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.178+0000 7f97cccc0700 1 -- 172.21.15.8:0/2989037437 wait complete. 2023-10-18T21:10:32.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.179+0000 7f97cccc0700 1 Processor -- start 2023-10-18T21:10:32.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.179+0000 7f97cccc0700 1 -- start start 2023-10-18T21:10:32.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.179+0000 7f97cccc0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:32.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.179+0000 7f97cccc0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f77d0 0x7f97c81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:32.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.179+0000 7f97cccc0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8109a70 con 0x7f97c80f6530 2023-10-18T21:10:32.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.179+0000 7f97cccc0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8109bb0 con 0x7f97c80f77d0 2023-10-18T21:10:32.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.179+0000 7f97c77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.179+0000 7f97c77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49542/0 (socket says 172.21.15.8:49542) 2023-10-18T21:10:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.179+0000 7f97c77fe700 1 -- 172.21.15.8:0/2943309665 learned_addr learned my addr 172.21.15.8:0/2943309665 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:10:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.180+0000 7f97c6ffd700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f77d0 0x7f97c81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.180+0000 7f97c77fe700 1 -- 172.21.15.8:0/2943309665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f77d0 msgr2=0x7f97c81094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.180+0000 7f97c77fe700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f77d0 0x7f97c81094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.180+0000 7f97c77fe700 1 -- 172.21.15.8:0/2943309665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8005040 con 0x7f97c80f6530 2023-10-18T21:10:32.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.180+0000 7f97c77fe700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8108fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f97b8004e30 tx=0x7f97b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:32.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.180+0000 7f97affff700 1 -- 172.21.15.8:0/2943309665 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b8018070 con 0x7f97c80f6530 2023-10-18T21:10:32.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.180+0000 7f97affff700 1 -- 172.21.15.8:0/2943309665 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f97b8009630 con 0x7f97c80f6530 2023-10-18T21:10:32.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.180+0000 7f97cccc0700 1 -- 172.21.15.8:0/2943309665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c810a4f0 con 0x7f97c80f6530 2023-10-18T21:10:32.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.180+0000 7f97affff700 1 -- 172.21.15.8:0/2943309665 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b801c3c0 con 0x7f97c80f6530 2023-10-18T21:10:32.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.180+0000 7f97cccc0700 1 -- 172.21.15.8:0/2943309665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c810aa50 con 0x7f97c80f6530 2023-10-18T21:10:32.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.181+0000 7f97cccc0700 1 -- 172.21.15.8:0/2943309665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c8045ad0 con 0x7f97c80f6530 2023-10-18T21:10:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.182+0000 7f97affff700 1 -- 172.21.15.8:0/2943309665 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f97b801d420 con 0x7f97c80f6530 2023-10-18T21:10:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.183+0000 7f97affff700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 0x7f97b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.183+0000 7f97affff700 1 -- 172.21.15.8:0/2943309665 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f97b807e3c0 con 0x7f97c80f6530 2023-10-18T21:10:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.183+0000 7f97c6ffd700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 0x7f97b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:32.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.184+0000 7f97c6ffd700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 0x7f97b0063430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f97bc004c40 tx=0x7f97bc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:32.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.188+0000 7f97affff700 1 -- 172.21.15.8:0/2943309665 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f97b8051ae0 con 0x7f97c80f6530 2023-10-18T21:10:32.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.383+0000 7f97cccc0700 1 -- 172.21.15.8:0/2943309665 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97c80fee00 con 0x7f97b0060f70 2023-10-18T21:10:32.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.384+0000 7f97affff700 1 -- 172.21.15.8:0/2943309665 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f97c80fee00 con 0x7f97b0060f70 2023-10-18T21:10:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.386+0000 7f97cccc0700 1 -- 172.21.15.8:0/2943309665 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 msgr2=0x7f97b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.386+0000 7f97cccc0700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 0x7f97b0063430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f97bc004c40 tx=0x7f97bc00b040).stop 2023-10-18T21:10:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.386+0000 7f97cccc0700 1 -- 172.21.15.8:0/2943309665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 msgr2=0x7f97c8108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.386+0000 7f97cccc0700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8108fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f97b8004e30 tx=0x7f97b8009b30).stop 2023-10-18T21:10:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.386+0000 7f97cccc0700 1 -- 172.21.15.8:0/2943309665 shutdown_connections 2023-10-18T21:10:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.386+0000 7f97cccc0700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 0x7f97b0063430 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.386+0000 7f97cccc0700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8108fd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.387+0000 7f97cccc0700 1 --2- 172.21.15.8:0/2943309665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f77d0 0x7f97c81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.387+0000 7f97cccc0700 1 -- 172.21.15.8:0/2943309665 >> 172.21.15.8:0/2943309665 conn(0x7f97c80f1c90 msgr2=0x7f97c806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.387+0000 7f97cccc0700 1 -- 172.21.15.8:0/2943309665 shutdown_connections 2023-10-18T21:10:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.387+0000 7f97cccc0700 1 -- 172.21.15.8:0/2943309665 wait complete. 2023-10-18T21:10:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.523+0000 7f3cba287700 1 -- 172.21.15.8:0/3871416928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cb40602b0 msgr2=0x7f3cb40f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.523+0000 7f3cba287700 1 --2- 172.21.15.8:0/3871416928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cb40602b0 0x7f3cb40f9170 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f3cb0004660 tx=0x7f3cb0009b30).stop 2023-10-18T21:10:32.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.523+0000 7f3cba287700 1 -- 172.21.15.8:0/3871416928 shutdown_connections 2023-10-18T21:10:32.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.523+0000 7f3cba287700 1 --2- 172.21.15.8:0/3871416928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40f96f0 0x7f3cb40fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.523+0000 7f3cba287700 1 --2- 172.21.15.8:0/3871416928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cb40602b0 0x7f3cb40f9170 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.523+0000 7f3cba287700 1 -- 172.21.15.8:0/3871416928 >> 172.21.15.8:0/3871416928 conn(0x7f3cb40f0b90 msgr2=0x7f3cb40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:32.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.523+0000 7f3cba287700 1 -- 172.21.15.8:0/3871416928 shutdown_connections 2023-10-18T21:10:32.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.523+0000 7f3cba287700 1 -- 172.21.15.8:0/3871416928 wait complete. 2023-10-18T21:10:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.524+0000 7f3cba287700 1 Processor -- start 2023-10-18T21:10:32.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.524+0000 7f3cba287700 1 -- start start 2023-10-18T21:10:32.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.524+0000 7f3cba287700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cb40602b0 0x7f3cb4106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:32.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.524+0000 7f3cba287700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40f96f0 0x7f3cb4107260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:32.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.524+0000 7f3cba287700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4107860 con 0x7f3cb40602b0 2023-10-18T21:10:32.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.524+0000 7f3cba287700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4108070 con 0x7f3cb40f96f0 2023-10-18T21:10:32.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.525+0000 7f3cb9285700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cb40602b0 0x7f3cb4106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:32.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.525+0000 7f3cb9285700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cb40602b0 0x7f3cb4106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49564/0 (socket says 172.21.15.8:49564) 2023-10-18T21:10:32.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.525+0000 7f3cb9285700 1 -- 172.21.15.8:0/451668362 learned_addr learned my addr 172.21.15.8:0/451668362 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:10:32.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.525+0000 7f3cb9285700 1 -- 172.21.15.8:0/451668362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40f96f0 msgr2=0x7f3cb4107260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.525+0000 7f3cb9285700 1 --2- 172.21.15.8:0/451668362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40f96f0 0x7f3cb4107260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:10:32.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.525+0000 7f3cb9285700 1 -- 172.21.15.8:0/451668362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb0005040 con 0x7f3cb40602b0 2023-10-18T21:10:32.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.525+0000 7f3cb9285700 1 --2- 172.21.15.8:0/451668362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cb40602b0 0x7f3cb4106d70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f3cb0004320 tx=0x7f3cb000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:32.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.525+0000 7f3ca9ffb700 1 -- 172.21.15.8:0/451668362 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cb0019070 con 0x7f3cb40602b0 2023-10-18T21:10:32.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.526+0000 7f3cba287700 1 -- 172.21.15.8:0/451668362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb4108290 con 0x7f3cb40602b0 2023-10-18T21:10:32.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.526+0000 7f3ca9ffb700 1 -- 172.21.15.8:0/451668362 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3cb001e420 con 0x7f3cb40602b0 2023-10-18T21:10:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.526+0000 7f3cba287700 1 -- 172.21.15.8:0/451668362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb4108770 con 0x7f3cb40602b0 2023-10-18T21:10:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.526+0000 7f3ca9ffb700 1 -- 172.21.15.8:0/451668362 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cb0014600 con 0x7f3cb40602b0 2023-10-18T21:10:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.527+0000 7f3cba287700 1 -- 172.21.15.8:0/451668362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb4059100 con 0x7f3cb40602b0 2023-10-18T21:10:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.528+0000 7f3ca9ffb700 1 -- 172.21.15.8:0/451668362 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3cb001e590 con 0x7f3cb40602b0 2023-10-18T21:10:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.528+0000 7f3ca9ffb700 1 --2- 172.21.15.8:0/451668362 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ca0060f70 0x7f3ca0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.528+0000 7f3ca9ffb700 1 -- 172.21.15.8:0/451668362 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3cb007de90 con 0x7f3cb40602b0 2023-10-18T21:10:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.529+0000 7f3cb8a84700 1 --2- 172.21.15.8:0/451668362 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ca0060f70 0x7f3ca0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.529+0000 7f3cb8a84700 1 --2- 172.21.15.8:0/451668362 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ca0060f70 0x7f3ca0063430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f3cb4060080 tx=0x7f3ca400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:32.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.533+0000 7f3ca9ffb700 1 -- 172.21.15.8:0/451668362 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3cb004d9e0 con 0x7f3cb40602b0 2023-10-18T21:10:32.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.730+0000 7f3cba287700 1 -- 172.21.15.8:0/451668362 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cb40fee90 con 0x7f3ca0060f70 2023-10-18T21:10:32.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.740+0000 7f3ca9ffb700 1 -- 172.21.15.8:0/451668362 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3ca400f040 con 0x7f3ca0060f70 2023-10-18T21:10:32.742 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:10:32.742 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (17m) 5m ago 18m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:10:32.742 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (11m) 5m ago 18m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:10:32.742 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (11m) 3m ago 17m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:10:32.743 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (17m) 5m ago 18m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:10:32.743 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (5m) 5m ago 14m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:10:32.743 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 14m - - 2023-10-18T21:10:32.743 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (3m) 3m ago 14m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:10:32.743 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (3m) 3m ago 14m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:10:32.744 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (12m) 5m ago 20m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:10:32.744 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (11m) 3m ago 17m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:10:32.744 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (11m) 5m ago 20m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:10:32.744 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (11m) 3m ago 17m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:10:32.745 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (18m) 5m ago 18m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:10:32.745 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (17m) 3m ago 17m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:10:32.745 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (10m) 5m ago 17m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:10:32.745 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (8m) 5m ago 16m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:10:32.746 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (8m) 5m ago 16m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:10:32.746 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (7m) 3m ago 16m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:10:32.746 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (7m) 3m ago 16m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:10:32.746 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (6m) 3m ago 15m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:10:32.746 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (12m) 5m ago 17m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:10:32.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 -- 172.21.15.8:0/451668362 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ca0060f70 msgr2=0x7f3ca0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 --2- 172.21.15.8:0/451668362 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ca0060f70 0x7f3ca0063430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f3cb4060080 tx=0x7f3ca400b040).stop 2023-10-18T21:10:32.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 -- 172.21.15.8:0/451668362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cb40602b0 msgr2=0x7f3cb4106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 --2- 172.21.15.8:0/451668362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cb40602b0 0x7f3cb4106d70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f3cb0004320 tx=0x7f3cb000b040).stop 2023-10-18T21:10:32.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 -- 172.21.15.8:0/451668362 shutdown_connections 2023-10-18T21:10:32.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 --2- 172.21.15.8:0/451668362 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ca0060f70 0x7f3ca0063430 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 --2- 172.21.15.8:0/451668362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cb40602b0 0x7f3cb4106d70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 --2- 172.21.15.8:0/451668362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40f96f0 0x7f3cb4107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:10:32.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 -- 172.21.15.8:0/451668362 >> 172.21.15.8:0/451668362 conn(0x7f3cb40f0b90 msgr2=0x7f3cb40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:32.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 -- 172.21.15.8:0/451668362 shutdown_connections 2023-10-18T21:10:32.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.743+0000 7f3cba287700 1 -- 172.21.15.8:0/451668362 wait complete. 2023-10-18T21:10:32.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.879+0000 7f76d98db700 1 -- 172.21.15.8:0/4285226740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d40f6530 msgr2=0x7f76d40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.879+0000 7f76d98db700 1 --2- 172.21.15.8:0/4285226740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d40f6530 0x7f76d40f6950 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f76c8004660 tx=0x7f76c8009b30).stop 2023-10-18T21:10:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.879+0000 7f76d98db700 1 -- 172.21.15.8:0/4285226740 shutdown_connections 2023-10-18T21:10:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.879+0000 7f76d98db700 1 --2- 172.21.15.8:0/4285226740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40f77d0 0x7f76d40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.879+0000 7f76d98db700 1 --2- 172.21.15.8:0/4285226740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d40f6530 0x7f76d40f6950 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.879+0000 7f76d98db700 1 -- 172.21.15.8:0/4285226740 >> 172.21.15.8:0/4285226740 conn(0x7f76d40f1c90 msgr2=0x7f76d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.879+0000 7f76d98db700 1 -- 172.21.15.8:0/4285226740 shutdown_connections 2023-10-18T21:10:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.879+0000 7f76d98db700 1 -- 172.21.15.8:0/4285226740 wait complete. 2023-10-18T21:10:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.880+0000 7f76d98db700 1 Processor -- start 2023-10-18T21:10:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.880+0000 7f76d98db700 1 -- start start 2023-10-18T21:10:32.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.880+0000 7f76d98db700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40f6530 0x7f76d4106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:32.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.880+0000 7f76d98db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d40f77d0 0x7f76d4107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:32.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.880+0000 7f76d98db700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4107910 con 0x7f76d40f77d0 2023-10-18T21:10:32.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.880+0000 7f76d98db700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4108120 con 0x7f76d40f6530 2023-10-18T21:10:32.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d40f77d0 0x7f76d4107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:32.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d40f77d0 0x7f76d4107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49582/0 (socket says 172.21.15.8:49582) 2023-10-18T21:10:32.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d3fff700 1 -- 172.21.15.8:0/3149900513 learned_addr learned my addr 172.21.15.8:0/3149900513 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:10:32.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d88d9700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40f6530 0x7f76d4106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:32.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d3fff700 1 -- 172.21.15.8:0/3149900513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40f6530 msgr2=0x7f76d4106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:32.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d3fff700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40f6530 0x7f76d4106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:32.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d3fff700 1 -- 172.21.15.8:0/3149900513 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c8005040 con 0x7f76d40f77d0 2023-10-18T21:10:32.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d3fff700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d40f77d0 0x7f76d4107310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f76c00026d0 tx=0x7f76c0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:32.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d17fa700 1 -- 172.21.15.8:0/3149900513 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c00079c0 con 0x7f76d40f77d0 2023-10-18T21:10:32.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d17fa700 1 -- 172.21.15.8:0/3149900513 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f76c000f040 con 0x7f76d40f77d0 2023-10-18T21:10:32.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d17fa700 1 -- 172.21.15.8:0/3149900513 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c0014980 con 0x7f76d40f77d0 2023-10-18T21:10:32.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.881+0000 7f76d98db700 1 -- 172.21.15.8:0/3149900513 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d41083a0 con 0x7f76d40f77d0 2023-10-18T21:10:32.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.882+0000 7f76d98db700 1 -- 172.21.15.8:0/3149900513 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d4108960 con 0x7f76d40f77d0 2023-10-18T21:10:32.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.883+0000 7f76d98db700 1 -- 172.21.15.8:0/3149900513 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d4059100 con 0x7f76d40f77d0 2023-10-18T21:10:32.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.884+0000 7f76d17fa700 1 -- 172.21.15.8:0/3149900513 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f76c00090d0 con 0x7f76d40f77d0 2023-10-18T21:10:32.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.885+0000 7f76d17fa700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76c4060f70 0x7f76c4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:32.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.885+0000 7f76d17fa700 1 -- 172.21.15.8:0/3149900513 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f76c007c980 con 0x7f76d40f77d0 2023-10-18T21:10:32.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.885+0000 7f76d88d9700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76c4060f70 0x7f76c4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:32.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.886+0000 7f76d88d9700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76c4060f70 0x7f76c4063430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f76c8005010 tx=0x7f76c8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:32.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:32.889+0000 7f76d17fa700 1 -- 172.21.15.8:0/3149900513 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f76c004c5e0 con 0x7f76d40f77d0 2023-10-18T21:10:33.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.142+0000 7f76d98db700 1 -- 172.21.15.8:0/3149900513 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f76d40fee50 con 0x7f76d40f77d0 2023-10-18T21:10:33.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.143+0000 7f76d17fa700 1 -- 172.21.15.8:0/3149900513 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f76d40fee50 con 0x7f76d40f77d0 2023-10-18T21:10:33.144 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:10:33.144 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:10:33.144 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:10:33.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:10:33.145 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:10:33.145 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:10:33.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:10:33.145 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:10:33.145 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:10:33.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:10:33.146 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:10:33.146 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:10:33.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:10:33.146 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:10:33.147 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:10:33.147 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:10:33.147 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:10:33.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.144+0000 7f76d98db700 1 -- 172.21.15.8:0/3149900513 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76c4060f70 msgr2=0x7f76c4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:33.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.144+0000 7f76d98db700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76c4060f70 0x7f76c4063430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f76c8005010 tx=0x7f76c8009b30).stop 2023-10-18T21:10:33.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.144+0000 7f76d98db700 1 -- 172.21.15.8:0/3149900513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d40f77d0 msgr2=0x7f76d4107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:33.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.144+0000 7f76d98db700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d40f77d0 0x7f76d4107310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f76c00026d0 tx=0x7f76c0009de0).stop 2023-10-18T21:10:33.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.145+0000 7f76d98db700 1 -- 172.21.15.8:0/3149900513 shutdown_connections 2023-10-18T21:10:33.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.145+0000 7f76d98db700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76c4060f70 0x7f76c4063430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.145+0000 7f76d98db700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40f6530 0x7f76d4106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.145+0000 7f76d98db700 1 --2- 172.21.15.8:0/3149900513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76d40f77d0 0x7f76d4107310 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.145+0000 7f76d98db700 1 -- 172.21.15.8:0/3149900513 >> 172.21.15.8:0/3149900513 conn(0x7f76d40f1c90 msgr2=0x7f76d40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:33.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.145+0000 7f76d98db700 1 -- 172.21.15.8:0/3149900513 shutdown_connections 2023-10-18T21:10:33.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.145+0000 7f76d98db700 1 -- 172.21.15.8:0/3149900513 wait complete. 2023-10-18T21:10:33.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.281+0000 7fa64db85700 1 -- 172.21.15.8:0/2809340723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6480f77d0 msgr2=0x7fa6480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:33.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.281+0000 7fa64db85700 1 --2- 172.21.15.8:0/2809340723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6480f77d0 0x7fa6480f7c30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fa634004660 tx=0x7fa634009b30).stop 2023-10-18T21:10:33.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.281+0000 7fa64db85700 1 -- 172.21.15.8:0/2809340723 shutdown_connections 2023-10-18T21:10:33.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.281+0000 7fa64db85700 1 --2- 172.21.15.8:0/2809340723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6480f77d0 0x7fa6480f7c30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.281+0000 7fa64db85700 1 --2- 172.21.15.8:0/2809340723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6480f6530 0x7fa6480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.281+0000 7fa64db85700 1 -- 172.21.15.8:0/2809340723 >> 172.21.15.8:0/2809340723 conn(0x7fa6480f1c90 msgr2=0x7fa6480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:33.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.281+0000 7fa64db85700 1 -- 172.21.15.8:0/2809340723 shutdown_connections 2023-10-18T21:10:33.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.281+0000 7fa64db85700 1 -- 172.21.15.8:0/2809340723 wait complete. 2023-10-18T21:10:33.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.282+0000 7fa64db85700 1 Processor -- start 2023-10-18T21:10:33.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.283+0000 7fa64db85700 1 -- start start 2023-10-18T21:10:33.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.283+0000 7fa64db85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6480f6530 0x7fa648106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:33.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.283+0000 7fa64db85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6480f77d0 0x7fa648107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:33.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.283+0000 7fa64db85700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa648107830 con 0x7fa6480f6530 2023-10-18T21:10:33.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.283+0000 7fa64db85700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa648108040 con 0x7fa6480f77d0 2023-10-18T21:10:33.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.283+0000 7fa64cb83700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6480f6530 0x7fa648106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:33.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.283+0000 7fa64cb83700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6480f6530 0x7fa648106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49586/0 (socket says 172.21.15.8:49586) 2023-10-18T21:10:33.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.283+0000 7fa64cb83700 1 -- 172.21.15.8:0/2323097379 learned_addr learned my addr 172.21.15.8:0/2323097379 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:10:33.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa647fff700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6480f77d0 0x7fa648107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:33.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa64cb83700 1 -- 172.21.15.8:0/2323097379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6480f77d0 msgr2=0x7fa648107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:33.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa64cb83700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6480f77d0 0x7fa648107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa64cb83700 1 -- 172.21.15.8:0/2323097379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa634005040 con 0x7fa6480f6530 2023-10-18T21:10:33.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa647fff700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6480f77d0 0x7fa648107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:10:33.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa64cb83700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6480f6530 0x7fa648106d40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fa63c002700 tx=0x7fa63c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:33.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa6457fa700 1 -- 172.21.15.8:0/2323097379 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa63c009320 con 0x7fa6480f6530 2023-10-18T21:10:33.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa6457fa700 1 -- 172.21.15.8:0/2323097379 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa63c00f040 con 0x7fa6480f6530 2023-10-18T21:10:33.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa64db85700 1 -- 172.21.15.8:0/2323097379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6481082c0 con 0x7fa6480f6530 2023-10-18T21:10:33.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa6457fa700 1 -- 172.21.15.8:0/2323097379 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa63c014970 con 0x7fa6480f6530 2023-10-18T21:10:33.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.284+0000 7fa64db85700 1 -- 172.21.15.8:0/2323097379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa648108880 con 0x7fa6480f6530 2023-10-18T21:10:33.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.285+0000 7fa64db85700 1 -- 172.21.15.8:0/2323097379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa648059100 con 0x7fa6480f6530 2023-10-18T21:10:33.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.286+0000 7fa6457fa700 1 -- 172.21.15.8:0/2323097379 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa63c009480 con 0x7fa6480f6530 2023-10-18T21:10:33.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.287+0000 7fa6457fa700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa638060f70 0x7fa638063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:33.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.287+0000 7fa6457fa700 1 -- 172.21.15.8:0/2323097379 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa63c07cc40 con 0x7fa6480f6530 2023-10-18T21:10:33.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.287+0000 7fa647fff700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa638060f70 0x7fa638063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:33.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.288+0000 7fa647fff700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa638060f70 0x7fa638063430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fa634005010 tx=0x7fa634009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:33.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.291+0000 7fa6457fa700 1 -- 172.21.15.8:0/2323097379 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa63c04c7f0 con 0x7fa6480f6530 2023-10-18T21:10:33.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.517+0000 7fa64db85700 1 -- 172.21.15.8:0/2323097379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa6480fee00 con 0x7fa6480f6530 2023-10-18T21:10:33.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.518+0000 7fa6457fa700 1 -- 172.21.15.8:0/2323097379 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fa63c04fe10 con 0x7fa6480f6530 2023-10-18T21:10:33.519 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:10:33.519 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:10:33.520 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:10:33.520 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:10:33.520 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:10:33.520 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:10:33.521 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:10:33.521 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:10:33.521 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:10:33.521 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:10:33.521 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:10:33.521 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:10:33.522 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:10:33.522 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:10:33.522 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:10:33.522 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:10:33.522 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:10:33.523 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:10:33.523 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:10:33.523 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:10:33.523 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:10:33.523 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:10:33.524 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:10:33.524 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:10:33.524 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:10:33.524 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:10:33.524 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:10:33.525 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:10:33.525 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:10:33.525 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:10:33.525 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:10:33.526 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:10:33.526 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:10:33.526 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:10:33.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 -- 172.21.15.8:0/2323097379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa638060f70 msgr2=0x7fa638063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:33.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa638060f70 0x7fa638063430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fa634005010 tx=0x7fa634009b30).stop 2023-10-18T21:10:33.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 -- 172.21.15.8:0/2323097379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6480f6530 msgr2=0x7fa648106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6480f6530 0x7fa648106d40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fa63c002700 tx=0x7fa63c009d80).stop 2023-10-18T21:10:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 -- 172.21.15.8:0/2323097379 shutdown_connections 2023-10-18T21:10:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa638060f70 0x7fa638063430 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6480f6530 0x7fa648106d40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 --2- 172.21.15.8:0/2323097379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6480f77d0 0x7fa648107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 -- 172.21.15.8:0/2323097379 >> 172.21.15.8:0/2323097379 conn(0x7fa6480f1c90 msgr2=0x7fa6480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 -- 172.21.15.8:0/2323097379 shutdown_connections 2023-10-18T21:10:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.520+0000 7fa64db85700 1 -- 172.21.15.8:0/2323097379 wait complete. 2023-10-18T21:10:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:10:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.658+0000 7fa5eb59e700 1 -- 172.21.15.8:0/1462470418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5ec0f6530 msgr2=0x7fa5ec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.658+0000 7fa5eb59e700 1 --2- 172.21.15.8:0/1462470418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5ec0f6530 0x7fa5ec0f6950 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fa5dc004660 tx=0x7fa5dc009b30).stop 2023-10-18T21:10:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.658+0000 7fa5eb59e700 1 -- 172.21.15.8:0/1462470418 shutdown_connections 2023-10-18T21:10:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.658+0000 7fa5eb59e700 1 --2- 172.21.15.8:0/1462470418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec0f77d0 0x7fa5ec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.658+0000 7fa5eb59e700 1 --2- 172.21.15.8:0/1462470418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5ec0f6530 0x7fa5ec0f6950 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.658+0000 7fa5eb59e700 1 -- 172.21.15.8:0/1462470418 >> 172.21.15.8:0/1462470418 conn(0x7fa5ec0f1c90 msgr2=0x7fa5ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.658+0000 7fa5eb59e700 1 -- 172.21.15.8:0/1462470418 shutdown_connections 2023-10-18T21:10:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.659+0000 7fa5eb59e700 1 -- 172.21.15.8:0/1462470418 wait complete. 2023-10-18T21:10:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.659+0000 7fa5eb59e700 1 Processor -- start 2023-10-18T21:10:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.660+0000 7fa5eb59e700 1 -- start start 2023-10-18T21:10:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.660+0000 7fa5eb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5ec0f6530 0x7fa5ec106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.660+0000 7fa5eb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec0f77d0 0x7fa5ec107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.660+0000 7fa5eb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec107880 con 0x7fa5ec0f6530 2023-10-18T21:10:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.660+0000 7fa5eb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec1080c0 con 0x7fa5ec0f77d0 2023-10-18T21:10:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.660+0000 7fa5ea59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5ec0f6530 0x7fa5ec106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.660+0000 7fa5ea59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5ec0f6530 0x7fa5ec106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49594/0 (socket says 172.21.15.8:49594) 2023-10-18T21:10:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.660+0000 7fa5ea59c700 1 -- 172.21.15.8:0/3946090754 learned_addr learned my addr 172.21.15.8:0/3946090754 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:10:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.660+0000 7fa5e9d9b700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec0f77d0 0x7fa5ec107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.661+0000 7fa5ea59c700 1 -- 172.21.15.8:0/3946090754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec0f77d0 msgr2=0x7fa5ec107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.661+0000 7fa5ea59c700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec0f77d0 0x7fa5ec107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.661+0000 7fa5ea59c700 1 -- 172.21.15.8:0/3946090754 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc005040 con 0x7fa5ec0f6530 2023-10-18T21:10:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.661+0000 7fa5ea59c700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5ec0f6530 0x7fa5ec106d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fa5dc009870 tx=0x7fa5dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.661+0000 7fa5daffd700 1 -- 172.21.15.8:0/3946090754 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5dc019070 con 0x7fa5ec0f6530 2023-10-18T21:10:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.661+0000 7fa5daffd700 1 -- 172.21.15.8:0/3946090754 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa5dc013380 con 0x7fa5ec0f6530 2023-10-18T21:10:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.661+0000 7fa5eb59e700 1 -- 172.21.15.8:0/3946090754 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec108340 con 0x7fa5ec0f6530 2023-10-18T21:10:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.661+0000 7fa5daffd700 1 -- 172.21.15.8:0/3946090754 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5dc01edf0 con 0x7fa5ec0f6530 2023-10-18T21:10:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.661+0000 7fa5eb59e700 1 -- 172.21.15.8:0/3946090754 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec108820 con 0x7fa5ec0f6530 2023-10-18T21:10:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.662+0000 7fa5eb59e700 1 -- 172.21.15.8:0/3946090754 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec059100 con 0x7fa5ec0f6530 2023-10-18T21:10:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.663+0000 7fa5daffd700 1 -- 172.21.15.8:0/3946090754 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa5dc01e420 con 0x7fa5ec0f6530 2023-10-18T21:10:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.664+0000 7fa5daffd700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 0x7fa5d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:10:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.664+0000 7fa5daffd700 1 -- 172.21.15.8:0/3946090754 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa5dc07ddb0 con 0x7fa5ec0f6530 2023-10-18T21:10:33.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.664+0000 7fa5e9d9b700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 0x7fa5d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:10:33.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.665+0000 7fa5e9d9b700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 0x7fa5d4063430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fa5ec106b20 tx=0x7fa5e000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:10:33.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.668+0000 7fa5daffd700 1 -- 172.21.15.8:0/3946090754 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa5dc04d960 con 0x7fa5ec0f6530 2023-10-18T21:10:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:31.875877+0000 mgr.smithi008.flmjzp (mgr.14640) 705 : cluster [DBG] pgmap v502: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:32.038481+0000 mgr.smithi008.flmjzp (mgr.14640) 706 : audit [DBG] from='client.44733 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:32.384876+0000 mgr.smithi008.flmjzp (mgr.14640) 707 : audit [DBG] from='client.34792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:33.143170+0000 mon.smithi008 (mon.0) 1193 : audit [DBG] from='client.? 172.21.15.8:0/3149900513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:31.875877+0000 mgr.smithi008.flmjzp (mgr.14640) 705 : cluster [DBG] pgmap v502: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:32.038481+0000 mgr.smithi008.flmjzp (mgr.14640) 706 : audit [DBG] from='client.44733 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:32.384876+0000 mgr.smithi008.flmjzp (mgr.14640) 707 : audit [DBG] from='client.34792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:33.143170+0000 mon.smithi008 (mon.0) 1193 : audit [DBG] from='client.? 172.21.15.8:0/3149900513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.867+0000 7fa5eb59e700 1 -- 172.21.15.8:0/3946090754 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5ec0fed30 con 0x7fa5d4060f70 2023-10-18T21:10:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.868+0000 7fa5daffd700 1 -- 172.21.15.8:0/3946090754 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa5ec0fed30 con 0x7fa5d4060f70 2023-10-18T21:10:33.870 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:10:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:10:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:10:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:10:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:10:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:10:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:10:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:10:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:10:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:10:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:10:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:10:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:10:33.872 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:10:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.870+0000 7fa5eb59e700 1 -- 172.21.15.8:0/3946090754 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 msgr2=0x7fa5d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.870+0000 7fa5eb59e700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 0x7fa5d4063430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fa5ec106b20 tx=0x7fa5e000b040).stop 2023-10-18T21:10:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.870+0000 7fa5eb59e700 1 -- 172.21.15.8:0/3946090754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5ec0f6530 msgr2=0x7fa5ec106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:10:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.870+0000 7fa5eb59e700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5ec0f6530 0x7fa5ec106d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fa5dc009870 tx=0x7fa5dc00b040).stop 2023-10-18T21:10:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.870+0000 7fa5eb59e700 1 -- 172.21.15.8:0/3946090754 shutdown_connections 2023-10-18T21:10:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.870+0000 7fa5eb59e700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 0x7fa5d4063430 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.870+0000 7fa5eb59e700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5ec0f6530 0x7fa5ec106d90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.870+0000 7fa5eb59e700 1 --2- 172.21.15.8:0/3946090754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec0f77d0 0x7fa5ec107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:10:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.870+0000 7fa5eb59e700 1 -- 172.21.15.8:0/3946090754 >> 172.21.15.8:0/3946090754 conn(0x7fa5ec0f1c90 msgr2=0x7fa5ec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:10:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.871+0000 7fa5eb59e700 1 -- 172.21.15.8:0/3946090754 shutdown_connections 2023-10-18T21:10:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:10:33.871+0000 7fa5eb59e700 1 -- 172.21.15.8:0/3946090754 wait complete. 2023-10-18T21:10:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:32.732063+0000 mgr.smithi008.flmjzp (mgr.14640) 708 : audit [DBG] from='client.34796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:33.518489+0000 mon.smithi008 (mon.0) 1194 : audit [DBG] from='client.? 172.21.15.8:0/2323097379' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:10:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:32.732063+0000 mgr.smithi008.flmjzp (mgr.14640) 708 : audit [DBG] from='client.34796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:33.518489+0000 mon.smithi008 (mon.0) 1194 : audit [DBG] from='client.? 172.21.15.8:0/2323097379' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:10:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:33.868739+0000 mgr.smithi008.flmjzp (mgr.14640) 709 : audit [DBG] from='client.34808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:33.876332+0000 mgr.smithi008.flmjzp (mgr.14640) 710 : cluster [DBG] pgmap v503: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:33.868739+0000 mgr.smithi008.flmjzp (mgr.14640) 709 : audit [DBG] from='client.34808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:10:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:33.876332+0000 mgr.smithi008.flmjzp (mgr.14640) 710 : cluster [DBG] pgmap v503: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:35.876837+0000 mgr.smithi008.flmjzp (mgr.14640) 711 : cluster [DBG] pgmap v504: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:37.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:35.876837+0000 mgr.smithi008.flmjzp (mgr.14640) 711 : cluster [DBG] pgmap v504: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:37.877460+0000 mgr.smithi008.flmjzp (mgr.14640) 712 : cluster [DBG] pgmap v505: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:37.877460+0000 mgr.smithi008.flmjzp (mgr.14640) 712 : cluster [DBG] pgmap v505: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:39.907250+0000 mon.smithi008 (mon.0) 1195 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:40.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:39.907250+0000 mon.smithi008 (mon.0) 1195 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:39.877933+0000 mgr.smithi008.flmjzp (mgr.14640) 713 : cluster [DBG] pgmap v506: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:40.466870+0000 mon.smithi008 (mon.0) 1196 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:40.468062+0000 mon.smithi008 (mon.0) 1197 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:10:40.468709+0000 mgr.smithi008.flmjzp (mgr.14640) 714 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:40.469197+0000 mgr.smithi008.flmjzp (mgr.14640) 715 : cluster [DBG] pgmap v507: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:40.469410+0000 mgr.smithi008.flmjzp (mgr.14640) 716 : cluster [DBG] pgmap v508: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:40.473592+0000 mon.smithi008 (mon.0) 1198 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:40.478446+0000 mon.smithi008 (mon.0) 1199 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:40.480937+0000 mon.smithi008 (mon.0) 1200 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:41.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:40.482226+0000 mon.smithi008 (mon.0) 1201 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:41.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:40.483445+0000 mon.smithi008 (mon.0) 1202 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:41.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:40.484934+0000 mon.smithi008 (mon.0) 1203 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:41.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:10:40.486546+0000 mgr.smithi008.flmjzp (mgr.14640) 717 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:39.877933+0000 mgr.smithi008.flmjzp (mgr.14640) 713 : cluster [DBG] pgmap v506: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:40.466870+0000 mon.smithi008 (mon.0) 1196 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:40.468062+0000 mon.smithi008 (mon.0) 1197 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:10:40.468709+0000 mgr.smithi008.flmjzp (mgr.14640) 714 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:40.469197+0000 mgr.smithi008.flmjzp (mgr.14640) 715 : cluster [DBG] pgmap v507: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:40.469410+0000 mgr.smithi008.flmjzp (mgr.14640) 716 : cluster [DBG] pgmap v508: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:40.473592+0000 mon.smithi008 (mon.0) 1198 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:40.478446+0000 mon.smithi008 (mon.0) 1199 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:40.480937+0000 mon.smithi008 (mon.0) 1200 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:40.482226+0000 mon.smithi008 (mon.0) 1201 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:40.483445+0000 mon.smithi008 (mon.0) 1202 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:40.484934+0000 mon.smithi008 (mon.0) 1203 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:41.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:10:40.486546+0000 mgr.smithi008.flmjzp (mgr.14640) 717 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:42.469965+0000 mgr.smithi008.flmjzp (mgr.14640) 718 : cluster [DBG] pgmap v509: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:42.469965+0000 mgr.smithi008.flmjzp (mgr.14640) 718 : cluster [DBG] pgmap v509: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:44.470667+0000 mgr.smithi008.flmjzp (mgr.14640) 719 : cluster [DBG] pgmap v510: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:44.470667+0000 mgr.smithi008.flmjzp (mgr.14640) 719 : cluster [DBG] pgmap v510: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:46.471380+0000 mgr.smithi008.flmjzp (mgr.14640) 720 : cluster [DBG] pgmap v511: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:47.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:46.471380+0000 mgr.smithi008.flmjzp (mgr.14640) 720 : cluster [DBG] pgmap v511: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:48.472021+0000 mgr.smithi008.flmjzp (mgr.14640) 721 : cluster [DBG] pgmap v512: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:49.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:48.472021+0000 mgr.smithi008.flmjzp (mgr.14640) 721 : cluster [DBG] pgmap v512: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:50.472802+0000 mgr.smithi008.flmjzp (mgr.14640) 722 : cluster [DBG] pgmap v513: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:50.492161+0000 mon.smithi008 (mon.0) 1204 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:50.494364+0000 mon.smithi008 (mon.0) 1205 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:50.495404+0000 mon.smithi008 (mon.0) 1206 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:10:50.496337+0000 mgr.smithi008.flmjzp (mgr.14640) 723 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:50.496970+0000 mgr.smithi008.flmjzp (mgr.14640) 724 : cluster [DBG] pgmap v514: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:50.497191+0000 mgr.smithi008.flmjzp (mgr.14640) 725 : cluster [DBG] pgmap v515: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:50.502205+0000 mon.smithi008 (mon.0) 1207 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:50.508636+0000 mon.smithi008 (mon.0) 1208 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:50.511729+0000 mon.smithi008 (mon.0) 1209 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:50.513372+0000 mon.smithi008 (mon.0) 1210 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:51.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:50.514950+0000 mon.smithi008 (mon.0) 1211 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:51.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:10:50.516926+0000 mon.smithi008 (mon.0) 1212 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:51.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:10:50.518861+0000 mgr.smithi008.flmjzp (mgr.14640) 726 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:50.472802+0000 mgr.smithi008.flmjzp (mgr.14640) 722 : cluster [DBG] pgmap v513: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:50.492161+0000 mon.smithi008 (mon.0) 1204 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:50.494364+0000 mon.smithi008 (mon.0) 1205 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:10:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:50.495404+0000 mon.smithi008 (mon.0) 1206 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:10:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:10:50.496337+0000 mgr.smithi008.flmjzp (mgr.14640) 723 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:10:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:50.496970+0000 mgr.smithi008.flmjzp (mgr.14640) 724 : cluster [DBG] pgmap v514: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:50.497191+0000 mgr.smithi008.flmjzp (mgr.14640) 725 : cluster [DBG] pgmap v515: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:50.502205+0000 mon.smithi008 (mon.0) 1207 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:10:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:50.508636+0000 mon.smithi008 (mon.0) 1208 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:10:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:50.511729+0000 mon.smithi008 (mon.0) 1209 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:51.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:50.513372+0000 mon.smithi008 (mon.0) 1210 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:51.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:50.514950+0000 mon.smithi008 (mon.0) 1211 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:51.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:10:50.516926+0000 mon.smithi008 (mon.0) 1212 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:10:51.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:10:50.518861+0000 mgr.smithi008.flmjzp (mgr.14640) 726 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:10:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:52.497787+0000 mgr.smithi008.flmjzp (mgr.14640) 727 : cluster [DBG] pgmap v516: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:52.497787+0000 mgr.smithi008.flmjzp (mgr.14640) 727 : cluster [DBG] pgmap v516: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:54.498411+0000 mgr.smithi008.flmjzp (mgr.14640) 728 : cluster [DBG] pgmap v517: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:54.498411+0000 mgr.smithi008.flmjzp (mgr.14640) 728 : cluster [DBG] pgmap v517: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:56.498952+0000 mgr.smithi008.flmjzp (mgr.14640) 729 : cluster [DBG] pgmap v518: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:56.498952+0000 mgr.smithi008.flmjzp (mgr.14640) 729 : cluster [DBG] pgmap v518: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:10:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:10:58.499665+0000 mgr.smithi008.flmjzp (mgr.14640) 730 : cluster [DBG] pgmap v519: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:10:59.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:10:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:10:58.499665+0000 mgr.smithi008.flmjzp (mgr.14640) 730 : cluster [DBG] pgmap v519: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:00.500154+0000 mgr.smithi008.flmjzp (mgr.14640) 731 : cluster [DBG] pgmap v520: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:00.521832+0000 mon.smithi008 (mon.0) 1213 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:00.500154+0000 mgr.smithi008.flmjzp (mgr.14640) 731 : cluster [DBG] pgmap v520: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:00.521832+0000 mon.smithi008 (mon.0) 1213 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:02.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:01.082140+0000 mon.smithi008 (mon.0) 1214 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:02.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:01.083262+0000 mon.smithi008 (mon.0) 1215 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:02.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:01.084168+0000 mgr.smithi008.flmjzp (mgr.14640) 732 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:02.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:01.084855+0000 mgr.smithi008.flmjzp (mgr.14640) 733 : cluster [DBG] pgmap v521: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:02.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:01.085149+0000 mgr.smithi008.flmjzp (mgr.14640) 734 : cluster [DBG] pgmap v522: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:02.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:01.089358+0000 mon.smithi008 (mon.0) 1216 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:02.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:01.096547+0000 mon.smithi008 (mon.0) 1217 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:02.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:01.100062+0000 mon.smithi008 (mon.0) 1218 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:02.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:01.102014+0000 mon.smithi008 (mon.0) 1219 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:02.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:01.103819+0000 mon.smithi008 (mon.0) 1220 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:02.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:01.105765+0000 mon.smithi008 (mon.0) 1221 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:02.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:01.107691+0000 mgr.smithi008.flmjzp (mgr.14640) 735 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:01.082140+0000 mon.smithi008 (mon.0) 1214 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:01.083262+0000 mon.smithi008 (mon.0) 1215 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:01.084168+0000 mgr.smithi008.flmjzp (mgr.14640) 732 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:01.084855+0000 mgr.smithi008.flmjzp (mgr.14640) 733 : cluster [DBG] pgmap v521: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:01.085149+0000 mgr.smithi008.flmjzp (mgr.14640) 734 : cluster [DBG] pgmap v522: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:01.089358+0000 mon.smithi008 (mon.0) 1216 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:01.096547+0000 mon.smithi008 (mon.0) 1217 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:01.100062+0000 mon.smithi008 (mon.0) 1218 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:01.102014+0000 mon.smithi008 (mon.0) 1219 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:02.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:01.103819+0000 mon.smithi008 (mon.0) 1220 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:02.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:01.105765+0000 mon.smithi008 (mon.0) 1221 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:02.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:01.107691+0000 mgr.smithi008.flmjzp (mgr.14640) 735 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:04.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.020+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/755692920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd40f77d0 msgr2=0x7f8cd40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.020+0000 7f8cd8d4c700 1 --2- 172.21.15.8:0/755692920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd40f77d0 0x7f8cd40f7c30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f8cc8004660 tx=0x7f8cc8009b30).stop 2023-10-18T21:11:04.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.020+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/755692920 shutdown_connections 2023-10-18T21:11:04.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.020+0000 7f8cd8d4c700 1 --2- 172.21.15.8:0/755692920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd40f77d0 0x7f8cd40f7c30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.020+0000 7f8cd8d4c700 1 --2- 172.21.15.8:0/755692920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd40f6530 0x7f8cd40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.020+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/755692920 >> 172.21.15.8:0/755692920 conn(0x7f8cd40f1cd0 msgr2=0x7f8cd40f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:04.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.020+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/755692920 shutdown_connections 2023-10-18T21:11:04.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.020+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/755692920 wait complete. 2023-10-18T21:11:04.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.021+0000 7f8cd8d4c700 1 Processor -- start 2023-10-18T21:11:04.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.021+0000 7f8cd8d4c700 1 -- start start 2023-10-18T21:11:04.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.021+0000 7f8cd8d4c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd40f6530 0x7f8cd4106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:04.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.021+0000 7f8cd8d4c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd40f77d0 0x7f8cd4107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:04.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.021+0000 7f8cd8d4c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4107870 con 0x7f8cd40f77d0 2023-10-18T21:11:04.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.021+0000 7f8cd8d4c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd41080b0 con 0x7f8cd40f6530 2023-10-18T21:11:04.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.022+0000 7f8cd2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd40f77d0 0x7f8cd4107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:04.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.022+0000 7f8cd2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd40f77d0 0x7f8cd4107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43734/0 (socket says 172.21.15.8:43734) 2023-10-18T21:11:04.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.022+0000 7f8cd2ffd700 1 -- 172.21.15.8:0/3738881244 learned_addr learned my addr 172.21.15.8:0/3738881244 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:04.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.022+0000 7f8cd37fe700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd40f6530 0x7f8cd4106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:04.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.022+0000 7f8cd2ffd700 1 -- 172.21.15.8:0/3738881244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd40f6530 msgr2=0x7f8cd4106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.022+0000 7f8cd2ffd700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd40f6530 0x7f8cd4106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.022+0000 7f8cd2ffd700 1 -- 172.21.15.8:0/3738881244 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8005040 con 0x7f8cd40f77d0 2023-10-18T21:11:04.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.022+0000 7f8cd2ffd700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd40f77d0 0x7f8cd4107270 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f8cc8009990 tx=0x7f8cc8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:04.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.022+0000 7f8cbbfff700 1 -- 172.21.15.8:0/3738881244 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc8018070 con 0x7f8cd40f77d0 2023-10-18T21:11:04.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.023+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/3738881244 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd4108330 con 0x7f8cd40f77d0 2023-10-18T21:11:04.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.023+0000 7f8cbbfff700 1 -- 172.21.15.8:0/3738881244 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8cc8009630 con 0x7f8cd40f77d0 2023-10-18T21:11:04.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.023+0000 7f8cbbfff700 1 -- 172.21.15.8:0/3738881244 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc801c400 con 0x7f8cd40f77d0 2023-10-18T21:11:04.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.023+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/3738881244 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd4108810 con 0x7f8cd40f77d0 2023-10-18T21:11:04.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.024+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/3738881244 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd4059100 con 0x7f8cd40f77d0 2023-10-18T21:11:04.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.025+0000 7f8cbbfff700 1 -- 172.21.15.8:0/3738881244 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8cc801d9e0 con 0x7f8cd40f77d0 2023-10-18T21:11:04.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.026+0000 7f8cbbfff700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8cbc060f70 0x7f8cbc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:04.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.026+0000 7f8cbbfff700 1 -- 172.21.15.8:0/3738881244 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8cc807e670 con 0x7f8cd40f77d0 2023-10-18T21:11:04.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.026+0000 7f8cd37fe700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8cbc060f70 0x7f8cbc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:04.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.027+0000 7f8cd37fe700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8cbc060f70 0x7f8cbc063430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f8cd4107b40 tx=0x7f8cc4009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:04.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.031+0000 7f8cbbfff700 1 -- 172.21.15.8:0/3738881244 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8cc804e2a0 con 0x7f8cd40f77d0 2023-10-18T21:11:04.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.234+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/3738881244 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cd40fee40 con 0x7f8cbc060f70 2023-10-18T21:11:04.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.235+0000 7f8cbbfff700 1 -- 172.21.15.8:0/3738881244 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8cd40fee40 con 0x7f8cbc060f70 2023-10-18T21:11:04.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.237+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/3738881244 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8cbc060f70 msgr2=0x7f8cbc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.237+0000 7f8cd8d4c700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8cbc060f70 0x7f8cbc063430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f8cd4107b40 tx=0x7f8cc4009c00).stop 2023-10-18T21:11:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.237+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/3738881244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd40f77d0 msgr2=0x7f8cd4107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.237+0000 7f8cd8d4c700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd40f77d0 0x7f8cd4107270 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f8cc8009990 tx=0x7f8cc8009b30).stop 2023-10-18T21:11:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.237+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/3738881244 shutdown_connections 2023-10-18T21:11:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.237+0000 7f8cd8d4c700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8cbc060f70 0x7f8cbc063430 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.237+0000 7f8cd8d4c700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd40f6530 0x7f8cd4106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.237+0000 7f8cd8d4c700 1 --2- 172.21.15.8:0/3738881244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd40f77d0 0x7f8cd4107270 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.237+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/3738881244 >> 172.21.15.8:0/3738881244 conn(0x7f8cd40f1cd0 msgr2=0x7f8cd40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:04.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.237+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/3738881244 shutdown_connections 2023-10-18T21:11:04.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.238+0000 7f8cd8d4c700 1 -- 172.21.15.8:0/3738881244 wait complete. 2023-10-18T21:11:04.256 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:11:04.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.377+0000 7f53fb59e700 1 -- 172.21.15.8:0/1557370109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 msgr2=0x7f53fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.377+0000 7f53fb59e700 1 --2- 172.21.15.8:0/1557370109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 0x7f53fc0f6950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f53ec004660 tx=0x7f53ec009b30).stop 2023-10-18T21:11:04.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.377+0000 7f53fb59e700 1 -- 172.21.15.8:0/1557370109 shutdown_connections 2023-10-18T21:11:04.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.377+0000 7f53fb59e700 1 --2- 172.21.15.8:0/1557370109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f77d0 0x7f53fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:11:04.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.377+0000 7f53fb59e700 1 --2- 172.21.15.8:0/1557370109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 0x7f53fc0f6950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.377+0000 7f53fb59e700 1 -- 172.21.15.8:0/1557370109 >> 172.21.15.8:0/1557370109 conn(0x7f53fc0f1c90 msgr2=0x7f53fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:04.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.377+0000 7f53fb59e700 1 -- 172.21.15.8:0/1557370109 shutdown_connections 2023-10-18T21:11:04.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.377+0000 7f53fb59e700 1 -- 172.21.15.8:0/1557370109 wait complete. 2023-10-18T21:11:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.378+0000 7f53fb59e700 1 Processor -- start 2023-10-18T21:11:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.379+0000 7f53fb59e700 1 -- start start 2023-10-18T21:11:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.379+0000 7f53fb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f6530 0x7f53fc106e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.379+0000 7f53fb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f77d0 0x7f53fc107330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.379+0000 7f53fb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1079c0 con 0x7f53fc0f77d0 2023-10-18T21:11:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.379+0000 7f53fb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc108140 con 0x7f53fc0f6530 2023-10-18T21:11:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.379+0000 7f53f9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f77d0 0x7f53fc107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53f9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f77d0 0x7f53fc107330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43748/0 (socket says 172.21.15.8:43748) 2023-10-18T21:11:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53f9d9b700 1 -- 172.21.15.8:0/975445243 learned_addr learned my addr 172.21.15.8:0/975445243 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53fa59c700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f6530 0x7f53fc106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53f9d9b700 1 -- 172.21.15.8:0/975445243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f6530 msgr2=0x7f53fc106e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53f9d9b700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f6530 0x7f53fc106e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53f9d9b700 1 -- 172.21.15.8:0/975445243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec005040 con 0x7f53fc0f77d0 2023-10-18T21:11:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53f9d9b700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f77d0 0x7f53fc107330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f53f000b410 tx=0x7f53f0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53eaffd700 1 -- 172.21.15.8:0/975445243 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f00125f0 con 0x7f53fc0f77d0 2023-10-18T21:11:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53fb59e700 1 -- 172.21.15.8:0/975445243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc1083c0 con 0x7f53fc0f77d0 2023-10-18T21:11:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53eaffd700 1 -- 172.21.15.8:0/975445243 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f53f000be30 con 0x7f53fc0f77d0 2023-10-18T21:11:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.380+0000 7f53eaffd700 1 -- 172.21.15.8:0/975445243 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f0002a60 con 0x7f53fc0f77d0 2023-10-18T21:11:04.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.381+0000 7f53fb59e700 1 -- 172.21.15.8:0/975445243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc108980 con 0x7f53fc0f77d0 2023-10-18T21:11:04.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.382+0000 7f53fb59e700 1 -- 172.21.15.8:0/975445243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc045ad0 con 0x7f53fc0f77d0 2023-10-18T21:11:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.383+0000 7f53eaffd700 1 -- 172.21.15.8:0/975445243 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f53f000f030 con 0x7f53fc0f77d0 2023-10-18T21:11:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.383+0000 7f53eaffd700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 0x7f53e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.383+0000 7f53eaffd700 1 -- 172.21.15.8:0/975445243 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f53f007cd20 con 0x7f53fc0f77d0 2023-10-18T21:11:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.384+0000 7f53fa59c700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 0x7f53e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.384+0000 7f53fa59c700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 0x7f53e4063430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f53fc106bb0 tx=0x7f53ec009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.388+0000 7f53eaffd700 1 -- 172.21.15.8:0/975445243 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f53f004c990 con 0x7f53fc0f77d0 2023-10-18T21:11:04.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:03.085731+0000 mgr.smithi008.flmjzp (mgr.14640) 736 : cluster [DBG] pgmap v523: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:03.085731+0000 mgr.smithi008.flmjzp (mgr.14640) 736 : cluster [DBG] pgmap v523: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:04.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.587+0000 7f53fb59e700 1 -- 172.21.15.8:0/975445243 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53fc0feef0 con 0x7f53e4060f70 2023-10-18T21:11:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.589+0000 7f53eaffd700 1 -- 172.21.15.8:0/975445243 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f53ec019040 con 0x7f53e4060f70 2023-10-18T21:11:04.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 -- 172.21.15.8:0/975445243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 msgr2=0x7f53e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 0x7f53e4063430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f53fc106bb0 tx=0x7f53ec009b30).stop 2023-10-18T21:11:04.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 -- 172.21.15.8:0/975445243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f77d0 msgr2=0x7f53fc107330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f77d0 0x7f53fc107330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f53f000b410 tx=0x7f53f0006ef0).stop 2023-10-18T21:11:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 -- 172.21.15.8:0/975445243 shutdown_connections 2023-10-18T21:11:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 0x7f53e4063430 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f6530 0x7f53fc106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 --2- 172.21.15.8:0/975445243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f77d0 0x7f53fc107330 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 -- 172.21.15.8:0/975445243 >> 172.21.15.8:0/975445243 conn(0x7f53fc0f1c90 msgr2=0x7f53fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 -- 172.21.15.8:0/975445243 shutdown_connections 2023-10-18T21:11:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.591+0000 7f53fb59e700 1 -- 172.21.15.8:0/975445243 wait complete. 2023-10-18T21:11:04.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.729+0000 7f57e11bf700 1 -- 172.21.15.8:0/2848402170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57dc0f6530 msgr2=0x7f57dc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.729+0000 7f57e11bf700 1 --2- 172.21.15.8:0/2848402170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57dc0f6530 0x7f57dc0f6950 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f57cc004660 tx=0x7f57cc009b30).stop 2023-10-18T21:11:04.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.730+0000 7f57e11bf700 1 -- 172.21.15.8:0/2848402170 shutdown_connections 2023-10-18T21:11:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.730+0000 7f57e11bf700 1 --2- 172.21.15.8:0/2848402170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57dc0f77d0 0x7f57dc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.730+0000 7f57e11bf700 1 --2- 172.21.15.8:0/2848402170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57dc0f6530 0x7f57dc0f6950 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.730+0000 7f57e11bf700 1 -- 172.21.15.8:0/2848402170 >> 172.21.15.8:0/2848402170 conn(0x7f57dc0f1c90 msgr2=0x7f57dc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.730+0000 7f57e11bf700 1 -- 172.21.15.8:0/2848402170 shutdown_connections 2023-10-18T21:11:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.730+0000 7f57e11bf700 1 -- 172.21.15.8:0/2848402170 wait complete. 2023-10-18T21:11:04.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.731+0000 7f57e11bf700 1 Processor -- start 2023-10-18T21:11:04.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.731+0000 7f57e11bf700 1 -- start start 2023-10-18T21:11:04.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.731+0000 7f57e11bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57dc0f6530 0x7f57dc108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:04.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.731+0000 7f57e11bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57dc0f77d0 0x7f57dc109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:04.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.731+0000 7f57e11bf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc109a00 con 0x7f57dc0f6530 2023-10-18T21:11:04.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.731+0000 7f57e11bf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc109b40 con 0x7f57dc0f77d0 2023-10-18T21:11:04.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57dc0f6530 0x7f57dc108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57dc0f6530 0x7f57dc108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43764/0 (socket says 172.21.15.8:43764) 2023-10-18T21:11:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57dbfff700 1 -- 172.21.15.8:0/2441830311 learned_addr learned my addr 172.21.15.8:0/2441830311 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57db7fe700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57dc0f77d0 0x7f57dc109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57dbfff700 1 -- 172.21.15.8:0/2441830311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57dc0f77d0 msgr2=0x7f57dc109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57dbfff700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57dc0f77d0 0x7f57dc109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57dbfff700 1 -- 172.21.15.8:0/2441830311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc005040 con 0x7f57dc0f6530 2023-10-18T21:11:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57db7fe700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57dc0f77d0 0x7f57dc109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:11:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57dbfff700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57dc0f6530 0x7f57dc108f60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f57cc007a60 tx=0x7f57cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57d8ff9700 1 -- 172.21.15.8:0/2441830311 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57cc018070 con 0x7f57dc0f6530 2023-10-18T21:11:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57e11bf700 1 -- 172.21.15.8:0/2441830311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc10a480 con 0x7f57dc0f6530 2023-10-18T21:11:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.732+0000 7f57d8ff9700 1 -- 172.21.15.8:0/2441830311 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f57cc009630 con 0x7f57dc0f6530 2023-10-18T21:11:04.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.733+0000 7f57d8ff9700 1 -- 172.21.15.8:0/2441830311 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57cc01c540 con 0x7f57dc0f6530 2023-10-18T21:11:04.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.733+0000 7f57e11bf700 1 -- 172.21.15.8:0/2441830311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc10a9e0 con 0x7f57dc0f6530 2023-10-18T21:11:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.734+0000 7f57e11bf700 1 -- 172.21.15.8:0/2441830311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc045ad0 con 0x7f57dc0f6530 2023-10-18T21:11:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.735+0000 7f57d8ff9700 1 -- 172.21.15.8:0/2441830311 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f57cc01c7b0 con 0x7f57dc0f6530 2023-10-18T21:11:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.735+0000 7f57d8ff9700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c4060f70 0x7f57c4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.735+0000 7f57d8ff9700 1 -- 172.21.15.8:0/2441830311 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f57cc07e750 con 0x7f57dc0f6530 2023-10-18T21:11:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.736+0000 7f57db7fe700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c4060f70 0x7f57c4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:04.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.736+0000 7f57db7fe700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c4060f70 0x7f57c4063430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f57d0009760 tx=0x7f57d0009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:04.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.740+0000 7f57d8ff9700 1 -- 172.21.15.8:0/2441830311 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f57cc051d30 con 0x7f57dc0f6530 2023-10-18T21:11:04.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.935+0000 7f57e11bf700 1 -- 172.21.15.8:0/2441830311 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f57dc0fee00 con 0x7f57c4060f70 2023-10-18T21:11:04.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.945+0000 7f57d8ff9700 1 -- 172.21.15.8:0/2441830311 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f57dc0fee00 con 0x7f57c4060f70 2023-10-18T21:11:04.947 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:11:04.947 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (17m) 5m ago 19m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:11:04.948 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (11m) 5m ago 19m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:11:04.948 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (11m) 3m ago 18m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:11:04.948 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (17m) 5m ago 18m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:11:04.948 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (6m) 5m ago 15m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:11:04.948 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 15m - - 2023-10-18T21:11:04.949 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (4m) 3m ago 15m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:11:04.949 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (3m) 3m ago 15m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:11:04.949 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (12m) 5m ago 20m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:11:04.949 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (12m) 3m ago 18m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:11:04.949 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (12m) 5m ago 20m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:11:04.950 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (11m) 3m ago 18m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:11:04.950 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (18m) 5m ago 18m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:11:04.950 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (18m) 3m ago 18m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:11:04.950 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (11m) 5m ago 17m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:11:04.950 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (9m) 5m ago 17m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:11:04.950 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (8m) 5m ago 17m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:11:04.951 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (8m) 3m ago 16m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:11:04.951 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (7m) 3m ago 16m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:11:04.951 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (7m) 3m ago 16m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:11:04.951 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (13m) 5m ago 18m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:11:04.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 -- 172.21.15.8:0/2441830311 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c4060f70 msgr2=0x7f57c4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c4060f70 0x7f57c4063430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f57d0009760 tx=0x7f57d0009c60).stop 2023-10-18T21:11:04.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 -- 172.21.15.8:0/2441830311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57dc0f6530 msgr2=0x7f57dc108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:04.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57dc0f6530 0x7f57dc108f60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f57cc007a60 tx=0x7f57cc009b30).stop 2023-10-18T21:11:04.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 -- 172.21.15.8:0/2441830311 shutdown_connections 2023-10-18T21:11:04.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57c4060f70 0x7f57c4063430 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57dc0f6530 0x7f57dc108f60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 --2- 172.21.15.8:0/2441830311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57dc0f77d0 0x7f57dc109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:04.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 -- 172.21.15.8:0/2441830311 >> 172.21.15.8:0/2441830311 conn(0x7f57dc0f1c90 msgr2=0x7f57dc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:04.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 -- 172.21.15.8:0/2441830311 shutdown_connections 2023-10-18T21:11:04.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:04.947+0000 7f57e11bf700 1 -- 172.21.15.8:0/2441830311 wait complete. 2023-10-18T21:11:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.085+0000 7f5bb34fe700 1 -- 172.21.15.8:0/531572202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bac0f6530 msgr2=0x7f5bac0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:05.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.085+0000 7f5bb34fe700 1 --2- 172.21.15.8:0/531572202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bac0f6530 0x7f5bac0f6950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f5ba8004660 tx=0x7f5ba8009b30).stop 2023-10-18T21:11:05.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.085+0000 7f5bb34fe700 1 -- 172.21.15.8:0/531572202 shutdown_connections 2023-10-18T21:11:05.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.085+0000 7f5bb34fe700 1 --2- 172.21.15.8:0/531572202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bac0f77d0 0x7f5bac0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.085+0000 7f5bb34fe700 1 --2- 172.21.15.8:0/531572202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bac0f6530 0x7f5bac0f6950 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.085+0000 7f5bb34fe700 1 -- 172.21.15.8:0/531572202 >> 172.21.15.8:0/531572202 conn(0x7f5bac0f1c90 msgr2=0x7f5bac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:05.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.085+0000 7f5bb34fe700 1 -- 172.21.15.8:0/531572202 shutdown_connections 2023-10-18T21:11:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.085+0000 7f5bb34fe700 1 -- 172.21.15.8:0/531572202 wait complete. 2023-10-18T21:11:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.086+0000 7f5bb34fe700 1 Processor -- start 2023-10-18T21:11:05.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.086+0000 7f5bb34fe700 1 -- start start 2023-10-18T21:11:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.086+0000 7f5bb34fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bac0f6530 0x7f5bac106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.086+0000 7f5bb34fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bac0f77d0 0x7f5bac107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.086+0000 7f5bb34fe700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac107880 con 0x7f5bac0f77d0 2023-10-18T21:11:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.086+0000 7f5bb34fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac1080c0 con 0x7f5bac0f6530 2023-10-18T21:11:05.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5bb1cfb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bac0f77d0 0x7f5bac107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5bb1cfb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bac0f77d0 0x7f5bac107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43776/0 (socket says 172.21.15.8:43776) 2023-10-18T21:11:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5bb1cfb700 1 -- 172.21.15.8:0/1739413976 learned_addr learned my addr 172.21.15.8:0/1739413976 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5bb24fc700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bac0f6530 0x7f5bac106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5bb1cfb700 1 -- 172.21.15.8:0/1739413976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bac0f6530 msgr2=0x7f5bac106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:05.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5bb1cfb700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bac0f6530 0x7f5bac106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5bb1cfb700 1 -- 172.21.15.8:0/1739413976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba8005040 con 0x7f5bac0f77d0 2023-10-18T21:11:05.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5bb1cfb700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bac0f77d0 0x7f5bac107280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f5b9c002700 tx=0x7f5b9c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:05.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5ba2ffd700 1 -- 172.21.15.8:0/1739413976 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b9c009320 con 0x7f5bac0f77d0 2023-10-18T21:11:05.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5ba2ffd700 1 -- 172.21.15.8:0/1739413976 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5b9c00f040 con 0x7f5bac0f77d0 2023-10-18T21:11:05.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5ba2ffd700 1 -- 172.21.15.8:0/1739413976 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b9c0148a0 con 0x7f5bac0f77d0 2023-10-18T21:11:05.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.087+0000 7f5bb34fe700 1 -- 172.21.15.8:0/1739413976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac1083a0 con 0x7f5bac0f77d0 2023-10-18T21:11:05.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.088+0000 7f5bb34fe700 1 -- 172.21.15.8:0/1739413976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bac1088e0 con 0x7f5bac0f77d0 2023-10-18T21:11:05.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.089+0000 7f5bb34fe700 1 -- 172.21.15.8:0/1739413976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bac059100 con 0x7f5bac0f77d0 2023-10-18T21:11:05.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.090+0000 7f5ba2ffd700 1 -- 172.21.15.8:0/1739413976 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5b9c009480 con 0x7f5bac0f77d0 2023-10-18T21:11:05.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.090+0000 7f5ba2ffd700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b98060f70 0x7f5b98063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:05.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.090+0000 7f5ba2ffd700 1 -- 172.21.15.8:0/1739413976 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5b9c07cc00 con 0x7f5bac0f77d0 2023-10-18T21:11:05.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.091+0000 7f5bb24fc700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b98060f70 0x7f5b98063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:05.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.091+0000 7f5bb24fc700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b98060f70 0x7f5b98063430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f5ba8005010 tx=0x7f5ba8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:05.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.095+0000 7f5ba2ffd700 1 -- 172.21.15.8:0/1739413976 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5b9c04c7b0 con 0x7f5bac0f77d0 2023-10-18T21:11:05.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.354+0000 7f5bb34fe700 1 -- 172.21.15.8:0/1739413976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5bac027a00 con 0x7f5bac0f77d0 2023-10-18T21:11:05.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.354+0000 7f5ba2ffd700 1 -- 172.21.15.8:0/1739413976 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5b9c04fdd0 con 0x7f5bac0f77d0 2023-10-18T21:11:05.357 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:11:05.357 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:11:05.357 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:11:05.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:11:05.358 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:11:05.358 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:11:05.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:11:05.358 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:11:05.358 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:11:05.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:11:05.359 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:11:05.359 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:11:05.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:11:05.359 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:11:05.360 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:11:05.360 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:11:05.360 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:11:05.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.356+0000 7f5bb34fe700 1 -- 172.21.15.8:0/1739413976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b98060f70 msgr2=0x7f5b98063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:05.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.356+0000 7f5bb34fe700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b98060f70 0x7f5b98063430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f5ba8005010 tx=0x7f5ba8009b30).stop 2023-10-18T21:11:05.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.356+0000 7f5bb34fe700 1 -- 172.21.15.8:0/1739413976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bac0f77d0 msgr2=0x7f5bac107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:05.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.356+0000 7f5bb34fe700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bac0f77d0 0x7f5bac107280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f5b9c002700 tx=0x7f5b9c009e00).stop 2023-10-18T21:11:05.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.356+0000 7f5bb34fe700 1 -- 172.21.15.8:0/1739413976 shutdown_connections 2023-10-18T21:11:05.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.356+0000 7f5bb34fe700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b98060f70 0x7f5b98063430 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.356+0000 7f5bb34fe700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bac0f6530 0x7f5bac106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.356+0000 7f5bb34fe700 1 --2- 172.21.15.8:0/1739413976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bac0f77d0 0x7f5bac107280 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.356+0000 7f5bb34fe700 1 -- 172.21.15.8:0/1739413976 >> 172.21.15.8:0/1739413976 conn(0x7f5bac0f1c90 msgr2=0x7f5bac0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:05.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.357+0000 7f5bb34fe700 1 -- 172.21.15.8:0/1739413976 shutdown_connections 2023-10-18T21:11:05.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.357+0000 7f5bb34fe700 1 -- 172.21.15.8:0/1739413976 wait complete. 2023-10-18T21:11:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:04.236717+0000 mgr.smithi008.flmjzp (mgr.14640) 737 : audit [DBG] from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:04.589932+0000 mgr.smithi008.flmjzp (mgr.14640) 738 : audit [DBG] from='client.34816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:04.236717+0000 mgr.smithi008.flmjzp (mgr.14640) 737 : audit [DBG] from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:04.589932+0000 mgr.smithi008.flmjzp (mgr.14640) 738 : audit [DBG] from='client.34816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:05.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.493+0000 7f74a89f6700 1 -- 172.21.15.8:0/1995699607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74a40f77d0 msgr2=0x7f74a40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:05.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.493+0000 7f74a89f6700 1 --2- 172.21.15.8:0/1995699607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74a40f77d0 0x7f74a40f7c30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f7498004660 tx=0x7f7498009b30).stop 2023-10-18T21:11:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.493+0000 7f74a89f6700 1 -- 172.21.15.8:0/1995699607 shutdown_connections 2023-10-18T21:11:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.493+0000 7f74a89f6700 1 --2- 172.21.15.8:0/1995699607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74a40f77d0 0x7f74a40f7c30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.493+0000 7f74a89f6700 1 --2- 172.21.15.8:0/1995699607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40f6530 0x7f74a40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.493+0000 7f74a89f6700 1 -- 172.21.15.8:0/1995699607 >> 172.21.15.8:0/1995699607 conn(0x7f74a40f1c90 msgr2=0x7f74a40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.493+0000 7f74a89f6700 1 -- 172.21.15.8:0/1995699607 shutdown_connections 2023-10-18T21:11:05.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.493+0000 7f74a89f6700 1 -- 172.21.15.8:0/1995699607 wait complete. 2023-10-18T21:11:05.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.494+0000 7f74a89f6700 1 Processor -- start 2023-10-18T21:11:05.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.495+0000 7f74a89f6700 1 -- start start 2023-10-18T21:11:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.495+0000 7f74a89f6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40f6530 0x7f74a4106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.495+0000 7f74a89f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74a40f77d0 0x7f74a4107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.495+0000 7f74a89f6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a41077d0 con 0x7f74a40f77d0 2023-10-18T21:11:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.495+0000 7f74a89f6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4107fd0 con 0x7f74a40f6530 2023-10-18T21:11:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.495+0000 7f74a2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74a40f77d0 0x7f74a4107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.495+0000 7f74a2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74a40f77d0 0x7f74a4107220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43790/0 (socket says 172.21.15.8:43790) 2023-10-18T21:11:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.495+0000 7f74a2ffd700 1 -- 172.21.15.8:0/2663046467 learned_addr learned my addr 172.21.15.8:0/2663046467 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.495+0000 7f74a37fe700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40f6530 0x7f74a4106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.496+0000 7f74a2ffd700 1 -- 172.21.15.8:0/2663046467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40f6530 msgr2=0x7f74a4106d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.496+0000 7f74a2ffd700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40f6530 0x7f74a4106d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.496+0000 7f74a2ffd700 1 -- 172.21.15.8:0/2663046467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7498005040 con 0x7f74a40f77d0 2023-10-18T21:11:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.496+0000 7f74a2ffd700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74a40f77d0 0x7f74a4107220 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f7498004d80 tx=0x7f749800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.496+0000 7f748bfff700 1 -- 172.21.15.8:0/2663046467 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7498019070 con 0x7f74a40f77d0 2023-10-18T21:11:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.496+0000 7f748bfff700 1 -- 172.21.15.8:0/2663046467 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f749801e420 con 0x7f74a40f77d0 2023-10-18T21:11:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.496+0000 7f74a89f6700 1 -- 172.21.15.8:0/2663046467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a4108250 con 0x7f74a40f77d0 2023-10-18T21:11:05.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.496+0000 7f748bfff700 1 -- 172.21.15.8:0/2663046467 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7498014660 con 0x7f74a40f77d0 2023-10-18T21:11:05.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.496+0000 7f74a89f6700 1 -- 172.21.15.8:0/2663046467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a4108730 con 0x7f74a40f77d0 2023-10-18T21:11:05.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.497+0000 7f74a89f6700 1 -- 172.21.15.8:0/2663046467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a4059100 con 0x7f74a40f77d0 2023-10-18T21:11:05.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.498+0000 7f748bfff700 1 -- 172.21.15.8:0/2663046467 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f749801e590 con 0x7f74a40f77d0 2023-10-18T21:11:05.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.499+0000 7f748bfff700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f748c060f70 0x7f748c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:05.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.499+0000 7f748bfff700 1 -- 172.21.15.8:0/2663046467 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f749807dd70 con 0x7f74a40f77d0 2023-10-18T21:11:05.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.499+0000 7f74a37fe700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f748c060f70 0x7f748c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.500+0000 7f74a37fe700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f748c060f70 0x7f748c063430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f7494009fd0 tx=0x7f749400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.503+0000 7f748bfff700 1 -- 172.21.15.8:0/2663046467 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f74980513d0 con 0x7f74a40f77d0 2023-10-18T21:11:05.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.729+0000 7f74a89f6700 1 -- 172.21.15.8:0/2663046467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f74a4045ad0 con 0x7f74a40f77d0 2023-10-18T21:11:05.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.730+0000 7f748bfff700 1 -- 172.21.15.8:0/2663046467 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f7498050fc0 con 0x7f74a40f77d0 2023-10-18T21:11:05.732 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:11:05.733 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:11:05.733 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:11:05.733 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:11:05.733 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:11:05.733 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:11:05.734 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:11:05.734 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:11:05.734 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:11:05.734 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:11:05.735 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:11:05.735 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:11:05.735 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:11:05.735 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:11:05.735 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:11:05.736 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:11:05.736 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:11:05.736 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:11:05.736 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:11:05.736 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:11:05.737 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:11:05.737 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:11:05.737 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:11:05.737 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:11:05.737 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:11:05.738 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:11:05.738 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:11:05.738 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:11:05.738 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:11:05.739 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:11:05.739 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:11:05.739 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:11:05.739 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:11:05.739 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:11:05.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.732+0000 7f74a89f6700 1 -- 172.21.15.8:0/2663046467 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f748c060f70 msgr2=0x7f748c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:05.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.732+0000 7f74a89f6700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f748c060f70 0x7f748c063430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f7494009fd0 tx=0x7f749400b040).stop 2023-10-18T21:11:05.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.732+0000 7f74a89f6700 1 -- 172.21.15.8:0/2663046467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74a40f77d0 msgr2=0x7f74a4107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:05.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.732+0000 7f74a89f6700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74a40f77d0 0x7f74a4107220 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f7498004d80 tx=0x7f749800b040).stop 2023-10-18T21:11:05.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.732+0000 7f74a89f6700 1 -- 172.21.15.8:0/2663046467 shutdown_connections 2023-10-18T21:11:05.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.732+0000 7f74a89f6700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f748c060f70 0x7f748c063430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.732+0000 7f74a89f6700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40f6530 0x7f74a4106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.732+0000 7f74a89f6700 1 --2- 172.21.15.8:0/2663046467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74a40f77d0 0x7f74a4107220 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.732+0000 7f74a89f6700 1 -- 172.21.15.8:0/2663046467 >> 172.21.15.8:0/2663046467 conn(0x7f74a40f1c90 msgr2=0x7f74a40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:05.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.732+0000 7f74a89f6700 1 -- 172.21.15.8:0/2663046467 shutdown_connections 2023-10-18T21:11:05.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.733+0000 7f74a89f6700 1 -- 172.21.15.8:0/2663046467 wait complete. 2023-10-18T21:11:05.743 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:11:05.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.870+0000 7f6734a8a700 1 -- 172.21.15.8:0/151921596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67300f6530 msgr2=0x7f67300f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:05.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.870+0000 7f6734a8a700 1 --2- 172.21.15.8:0/151921596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67300f6530 0x7f67300f6950 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f6720004660 tx=0x7f6720009b30).stop 2023-10-18T21:11:05.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.870+0000 7f6734a8a700 1 -- 172.21.15.8:0/151921596 shutdown_connections 2023-10-18T21:11:05.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.870+0000 7f6734a8a700 1 --2- 172.21.15.8:0/151921596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67300f77d0 0x7f67300f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.870+0000 7f6734a8a700 1 --2- 172.21.15.8:0/151921596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67300f6530 0x7f67300f6950 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.870+0000 7f6734a8a700 1 -- 172.21.15.8:0/151921596 >> 172.21.15.8:0/151921596 conn(0x7f67300f1c90 msgr2=0x7f67300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:05.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.871+0000 7f6734a8a700 1 -- 172.21.15.8:0/151921596 shutdown_connections 2023-10-18T21:11:05.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.871+0000 7f6734a8a700 1 -- 172.21.15.8:0/151921596 wait complete. 2023-10-18T21:11:05.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.871+0000 7f6734a8a700 1 Processor -- start 2023-10-18T21:11:05.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.872+0000 7f6734a8a700 1 -- start start 2023-10-18T21:11:05.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.872+0000 7f6734a8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67300f6530 0x7f6730106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:05.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.872+0000 7f6734a8a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67300f77d0 0x7f6730107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:05.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.872+0000 7f6734a8a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6730107880 con 0x7f67300f77d0 2023-10-18T21:11:05.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.872+0000 7f6734a8a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67301080c0 con 0x7f67300f6530 2023-10-18T21:11:05.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.872+0000 7f672effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67300f77d0 0x7f6730107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:05.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.872+0000 7f672effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67300f77d0 0x7f6730107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43810/0 (socket says 172.21.15.8:43810) 2023-10-18T21:11:05.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.872+0000 7f672effd700 1 -- 172.21.15.8:0/2110446069 learned_addr learned my addr 172.21.15.8:0/2110446069 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:05.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.872+0000 7f672f7fe700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67300f6530 0x7f6730106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:05.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.873+0000 7f672effd700 1 -- 172.21.15.8:0/2110446069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67300f6530 msgr2=0x7f6730106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:05.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.873+0000 7f672effd700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67300f6530 0x7f6730106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:05.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.873+0000 7f672effd700 1 -- 172.21.15.8:0/2110446069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6720005040 con 0x7f67300f77d0 2023-10-18T21:11:05.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.873+0000 7f672effd700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67300f77d0 0x7f6730107280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f672400e7f0 tx=0x7f672400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:05.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.873+0000 7f6717fff700 1 -- 172.21.15.8:0/2110446069 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67240092e0 con 0x7f67300f77d0 2023-10-18T21:11:05.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.873+0000 7f6717fff700 1 -- 172.21.15.8:0/2110446069 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f672400f040 con 0x7f67300f77d0 2023-10-18T21:11:05.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.873+0000 7f6717fff700 1 -- 172.21.15.8:0/2110446069 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67240147e0 con 0x7f67300f77d0 2023-10-18T21:11:05.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.873+0000 7f6734a8a700 1 -- 172.21.15.8:0/2110446069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67301083a0 con 0x7f67300f77d0 2023-10-18T21:11:05.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.873+0000 7f6734a8a700 1 -- 172.21.15.8:0/2110446069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67301088e0 con 0x7f67300f77d0 2023-10-18T21:11:05.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.874+0000 7f6734a8a700 1 -- 172.21.15.8:0/2110446069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6730059100 con 0x7f67300f77d0 2023-10-18T21:11:05.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.875+0000 7f6717fff700 1 -- 172.21.15.8:0/2110446069 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f672401b030 con 0x7f67300f77d0 2023-10-18T21:11:05.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.876+0000 7f6717fff700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6718060f70 0x7f6718063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:05.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.876+0000 7f6717fff700 1 -- 172.21.15.8:0/2110446069 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f672407c6b0 con 0x7f67300f77d0 2023-10-18T21:11:05.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.876+0000 7f672f7fe700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6718060f70 0x7f6718063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:05.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.877+0000 7f672f7fe700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6718060f70 0x7f6718063430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f6720005010 tx=0x7f6720016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:05.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:05.880+0000 7f6717fff700 1 -- 172.21.15.8:0/2110446069 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f672404c310 con 0x7f67300f77d0 2023-10-18T21:11:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.077+0000 7f6734a8a700 1 -- 172.21.15.8:0/2110446069 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67300fed90 con 0x7f6718060f70 2023-10-18T21:11:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.078+0000 7f6717fff700 1 -- 172.21.15.8:0/2110446069 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f67300fed90 con 0x7f6718060f70 2023-10-18T21:11:06.080 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:11:06.081 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:11:06.081 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:11:06.081 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:11:06.081 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:11:06.081 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:11:06.082 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:11:06.082 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:11:06.082 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:11:06.082 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:11:06.082 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:11:06.083 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:11:06.083 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:11:06.083 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:11:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.080+0000 7f6734a8a700 1 -- 172.21.15.8:0/2110446069 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6718060f70 msgr2=0x7f6718063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.080+0000 7f6734a8a700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6718060f70 0x7f6718063430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f6720005010 tx=0x7f6720016040).stop 2023-10-18T21:11:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.080+0000 7f6734a8a700 1 -- 172.21.15.8:0/2110446069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67300f77d0 msgr2=0x7f6730107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.080+0000 7f6734a8a700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67300f77d0 0x7f6730107280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f672400e7f0 tx=0x7f672400b040).stop 2023-10-18T21:11:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.080+0000 7f6734a8a700 1 -- 172.21.15.8:0/2110446069 shutdown_connections 2023-10-18T21:11:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.080+0000 7f6734a8a700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6718060f70 0x7f6718063430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.080+0000 7f6734a8a700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67300f6530 0x7f6730106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:06.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.080+0000 7f6734a8a700 1 --2- 172.21.15.8:0/2110446069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67300f77d0 0x7f6730107280 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:06.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.080+0000 7f6734a8a700 1 -- 172.21.15.8:0/2110446069 >> 172.21.15.8:0/2110446069 conn(0x7f67300f1c90 msgr2=0x7f67300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:06.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.081+0000 7f6734a8a700 1 -- 172.21.15.8:0/2110446069 shutdown_connections 2023-10-18T21:11:06.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:06.081+0000 7f6734a8a700 1 -- 172.21.15.8:0/2110446069 wait complete. 2023-10-18T21:11:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:04.937480+0000 mgr.smithi008.flmjzp (mgr.14640) 739 : audit [DBG] from='client.34820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:05.086173+0000 mgr.smithi008.flmjzp (mgr.14640) 740 : cluster [DBG] pgmap v524: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:05.355883+0000 mon.smithi008 (mon.0) 1222 : audit [DBG] from='client.? 172.21.15.8:0/1739413976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:05.731692+0000 mon.smithi008 (mon.0) 1223 : audit [DBG] from='client.? 172.21.15.8:0/2663046467' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:11:06.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:04.937480+0000 mgr.smithi008.flmjzp (mgr.14640) 739 : audit [DBG] from='client.34820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:05.086173+0000 mgr.smithi008.flmjzp (mgr.14640) 740 : cluster [DBG] pgmap v524: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:05.355883+0000 mon.smithi008 (mon.0) 1222 : audit [DBG] from='client.? 172.21.15.8:0/1739413976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:05.731692+0000 mon.smithi008 (mon.0) 1223 : audit [DBG] from='client.? 172.21.15.8:0/2663046467' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:11:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:06.079343+0000 mgr.smithi008.flmjzp (mgr.14640) 741 : audit [DBG] from='client.34832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:07.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:06.079343+0000 mgr.smithi008.flmjzp (mgr.14640) 741 : audit [DBG] from='client.34832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:08.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:07.086781+0000 mgr.smithi008.flmjzp (mgr.14640) 742 : cluster [DBG] pgmap v525: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:07.086781+0000 mgr.smithi008.flmjzp (mgr.14640) 742 : cluster [DBG] pgmap v525: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:09.087331+0000 mgr.smithi008.flmjzp (mgr.14640) 743 : cluster [DBG] pgmap v526: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:09.087331+0000 mgr.smithi008.flmjzp (mgr.14640) 743 : cluster [DBG] pgmap v526: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:11.113215+0000 mon.smithi008 (mon.0) 1224 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:11.115497+0000 mon.smithi008 (mon.0) 1225 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:11.116608+0000 mon.smithi008 (mon.0) 1226 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:11.123479+0000 mon.smithi008 (mon.0) 1227 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:11.131483+0000 mon.smithi008 (mon.0) 1228 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:11.135365+0000 mon.smithi008 (mon.0) 1229 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:11.137288+0000 mon.smithi008 (mon.0) 1230 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:11.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:11.139197+0000 mon.smithi008 (mon.0) 1231 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:11.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:11.141804+0000 mon.smithi008 (mon.0) 1232 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:11.113215+0000 mon.smithi008 (mon.0) 1224 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:11.115497+0000 mon.smithi008 (mon.0) 1225 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:11.116608+0000 mon.smithi008 (mon.0) 1226 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:11.123479+0000 mon.smithi008 (mon.0) 1227 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:11.131483+0000 mon.smithi008 (mon.0) 1228 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:11.135365+0000 mon.smithi008 (mon.0) 1229 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:11.137288+0000 mon.smithi008 (mon.0) 1230 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:11.139197+0000 mon.smithi008 (mon.0) 1231 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:11.141804+0000 mon.smithi008 (mon.0) 1232 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:12.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:11.088114+0000 mgr.smithi008.flmjzp (mgr.14640) 744 : cluster [DBG] pgmap v527: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:12.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:11.117529+0000 mgr.smithi008.flmjzp (mgr.14640) 745 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:11.118106+0000 mgr.smithi008.flmjzp (mgr.14640) 746 : cluster [DBG] pgmap v528: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:11.118337+0000 mgr.smithi008.flmjzp (mgr.14640) 747 : cluster [DBG] pgmap v529: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:11.144038+0000 mgr.smithi008.flmjzp (mgr.14640) 748 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:11.088114+0000 mgr.smithi008.flmjzp (mgr.14640) 744 : cluster [DBG] pgmap v527: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:11.117529+0000 mgr.smithi008.flmjzp (mgr.14640) 745 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:11.118106+0000 mgr.smithi008.flmjzp (mgr.14640) 746 : cluster [DBG] pgmap v528: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:11.118337+0000 mgr.smithi008.flmjzp (mgr.14640) 747 : cluster [DBG] pgmap v529: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:11.144038+0000 mgr.smithi008.flmjzp (mgr.14640) 748 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:14.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:13.118812+0000 mgr.smithi008.flmjzp (mgr.14640) 749 : cluster [DBG] pgmap v530: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:13.118812+0000 mgr.smithi008.flmjzp (mgr.14640) 749 : cluster [DBG] pgmap v530: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:15.119425+0000 mgr.smithi008.flmjzp (mgr.14640) 750 : cluster [DBG] pgmap v531: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:15.119425+0000 mgr.smithi008.flmjzp (mgr.14640) 750 : cluster [DBG] pgmap v531: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:17.119910+0000 mgr.smithi008.flmjzp (mgr.14640) 751 : cluster [DBG] pgmap v532: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:17.119910+0000 mgr.smithi008.flmjzp (mgr.14640) 751 : cluster [DBG] pgmap v532: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:19.120536+0000 mgr.smithi008.flmjzp (mgr.14640) 752 : cluster [DBG] pgmap v533: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:19.120536+0000 mgr.smithi008.flmjzp (mgr.14640) 752 : cluster [DBG] pgmap v533: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:21.154699+0000 mon.smithi008 (mon.0) 1233 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:21.156956+0000 mon.smithi008 (mon.0) 1234 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:21.158002+0000 mon.smithi008 (mon.0) 1235 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:21.164465+0000 mon.smithi008 (mon.0) 1236 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:21.171013+0000 mon.smithi008 (mon.0) 1237 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:21.174319+0000 mon.smithi008 (mon.0) 1238 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:21.176302+0000 mon.smithi008 (mon.0) 1239 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:21.177887+0000 mon.smithi008 (mon.0) 1240 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:21.154699+0000 mon.smithi008 (mon.0) 1233 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:21.156956+0000 mon.smithi008 (mon.0) 1234 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:21.158002+0000 mon.smithi008 (mon.0) 1235 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:21.164465+0000 mon.smithi008 (mon.0) 1236 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:21.171013+0000 mon.smithi008 (mon.0) 1237 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:21.174319+0000 mon.smithi008 (mon.0) 1238 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:21.176302+0000 mon.smithi008 (mon.0) 1239 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:21.177887+0000 mon.smithi008 (mon.0) 1240 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:21.121181+0000 mgr.smithi008.flmjzp (mgr.14640) 753 : cluster [DBG] pgmap v534: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:21.158897+0000 mgr.smithi008.flmjzp (mgr.14640) 754 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:21.159503+0000 mgr.smithi008.flmjzp (mgr.14640) 755 : cluster [DBG] pgmap v535: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:21.159823+0000 mgr.smithi008.flmjzp (mgr.14640) 756 : cluster [DBG] pgmap v536: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:21.180225+0000 mon.smithi008 (mon.0) 1241 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:22.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:21.182224+0000 mgr.smithi008.flmjzp (mgr.14640) 757 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:21.121181+0000 mgr.smithi008.flmjzp (mgr.14640) 753 : cluster [DBG] pgmap v534: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:21.158897+0000 mgr.smithi008.flmjzp (mgr.14640) 754 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:21.159503+0000 mgr.smithi008.flmjzp (mgr.14640) 755 : cluster [DBG] pgmap v535: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:21.159823+0000 mgr.smithi008.flmjzp (mgr.14640) 756 : cluster [DBG] pgmap v536: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:21.180225+0000 mon.smithi008 (mon.0) 1241 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:21.182224+0000 mgr.smithi008.flmjzp (mgr.14640) 757 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:23.160531+0000 mgr.smithi008.flmjzp (mgr.14640) 758 : cluster [DBG] pgmap v537: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:23.160531+0000 mgr.smithi008.flmjzp (mgr.14640) 758 : cluster [DBG] pgmap v537: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:25.161109+0000 mgr.smithi008.flmjzp (mgr.14640) 759 : cluster [DBG] pgmap v538: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:25.161109+0000 mgr.smithi008.flmjzp (mgr.14640) 759 : cluster [DBG] pgmap v538: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:28.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:27.161638+0000 mgr.smithi008.flmjzp (mgr.14640) 760 : cluster [DBG] pgmap v539: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:27.161638+0000 mgr.smithi008.flmjzp (mgr.14640) 760 : cluster [DBG] pgmap v539: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:29.162195+0000 mgr.smithi008.flmjzp (mgr.14640) 761 : cluster [DBG] pgmap v540: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:29.162195+0000 mgr.smithi008.flmjzp (mgr.14640) 761 : cluster [DBG] pgmap v540: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:31.189996+0000 mon.smithi008 (mon.0) 1242 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:31.192321+0000 mon.smithi008 (mon.0) 1243 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:31.193425+0000 mon.smithi008 (mon.0) 1244 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:31.200245+0000 mon.smithi008 (mon.0) 1245 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:31.206665+0000 mon.smithi008 (mon.0) 1246 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:31.209918+0000 mon.smithi008 (mon.0) 1247 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:31.211602+0000 mon.smithi008 (mon.0) 1248 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:31.213240+0000 mon.smithi008 (mon.0) 1249 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:31.215238+0000 mon.smithi008 (mon.0) 1250 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:31.189996+0000 mon.smithi008 (mon.0) 1242 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:31.192321+0000 mon.smithi008 (mon.0) 1243 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:31.193425+0000 mon.smithi008 (mon.0) 1244 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:31.200245+0000 mon.smithi008 (mon.0) 1245 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:31.206665+0000 mon.smithi008 (mon.0) 1246 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:31.209918+0000 mon.smithi008 (mon.0) 1247 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:31.211602+0000 mon.smithi008 (mon.0) 1248 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:31.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:31.213240+0000 mon.smithi008 (mon.0) 1249 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:31.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:31.215238+0000 mon.smithi008 (mon.0) 1250 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:31.162762+0000 mgr.smithi008.flmjzp (mgr.14640) 762 : cluster [DBG] pgmap v541: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:31.194417+0000 mgr.smithi008.flmjzp (mgr.14640) 763 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:31.194998+0000 mgr.smithi008.flmjzp (mgr.14640) 764 : cluster [DBG] pgmap v542: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:31.195270+0000 mgr.smithi008.flmjzp (mgr.14640) 765 : cluster [DBG] pgmap v543: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:32.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:31.217248+0000 mgr.smithi008.flmjzp (mgr.14640) 766 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:31.162762+0000 mgr.smithi008.flmjzp (mgr.14640) 762 : cluster [DBG] pgmap v541: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:31.194417+0000 mgr.smithi008.flmjzp (mgr.14640) 763 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:31.194998+0000 mgr.smithi008.flmjzp (mgr.14640) 764 : cluster [DBG] pgmap v542: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:31.195270+0000 mgr.smithi008.flmjzp (mgr.14640) 765 : cluster [DBG] pgmap v543: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:31.217248+0000 mgr.smithi008.flmjzp (mgr.14640) 766 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:34.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:33.195765+0000 mgr.smithi008.flmjzp (mgr.14640) 767 : cluster [DBG] pgmap v544: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:33.195765+0000 mgr.smithi008.flmjzp (mgr.14640) 767 : cluster [DBG] pgmap v544: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.235+0000 7f74f5300700 1 -- 172.21.15.8:0/4086667522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74f00f6530 msgr2=0x7f74f00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.235+0000 7f74f5300700 1 --2- 172.21.15.8:0/4086667522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74f00f6530 0x7f74f00f6950 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f74e0004660 tx=0x7f74e0009b30).stop 2023-10-18T21:11:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.235+0000 7f74f5300700 1 -- 172.21.15.8:0/4086667522 shutdown_connections 2023-10-18T21:11:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.235+0000 7f74f5300700 1 --2- 172.21.15.8:0/4086667522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74f00f77d0 0x7f74f00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.235+0000 7f74f5300700 1 --2- 172.21.15.8:0/4086667522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74f00f6530 0x7f74f00f6950 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.235+0000 7f74f5300700 1 -- 172.21.15.8:0/4086667522 >> 172.21.15.8:0/4086667522 conn(0x7f74f00f1c90 msgr2=0x7f74f00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:36.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.235+0000 7f74f5300700 1 -- 172.21.15.8:0/4086667522 shutdown_connections 2023-10-18T21:11:36.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.235+0000 7f74f5300700 1 -- 172.21.15.8:0/4086667522 wait complete. 2023-10-18T21:11:36.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.236+0000 7f74f5300700 1 Processor -- start 2023-10-18T21:11:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.236+0000 7f74f5300700 1 -- start start 2023-10-18T21:11:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.236+0000 7f74f5300700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74f00f6530 0x7f74f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.236+0000 7f74f5300700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74f00f77d0 0x7f74f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:36.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.236+0000 7f74f5300700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f006a380 con 0x7f74f00f6530 2023-10-18T21:11:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.236+0000 7f74f5300700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f006a4c0 con 0x7f74f00f77d0 2023-10-18T21:11:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.237+0000 7f74effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74f00f6530 0x7f74f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.237+0000 7f74effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74f00f6530 0x7f74f006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46166/0 (socket says 172.21.15.8:46166) 2023-10-18T21:11:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.237+0000 7f74effff700 1 -- 172.21.15.8:0/3526955747 learned_addr learned my addr 172.21.15.8:0/3526955747 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.237+0000 7f74ef7fe700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74f00f77d0 0x7f74f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.237+0000 7f74effff700 1 -- 172.21.15.8:0/3526955747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74f00f77d0 msgr2=0x7f74f0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.237+0000 7f74effff700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74f00f77d0 0x7f74f0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.237+0000 7f74effff700 1 -- 172.21.15.8:0/3526955747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0005040 con 0x7f74f00f6530 2023-10-18T21:11:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.237+0000 7f74effff700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74f00f6530 0x7f74f006b9a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f74e0009870 tx=0x7f74e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.238+0000 7f74ecff9700 1 -- 172.21.15.8:0/3526955747 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e0019070 con 0x7f74f00f6530 2023-10-18T21:11:36.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.238+0000 7f74f5300700 1 -- 172.21.15.8:0/3526955747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f006a740 con 0x7f74f00f6530 2023-10-18T21:11:36.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.238+0000 7f74ecff9700 1 -- 172.21.15.8:0/3526955747 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f74e001e420 con 0x7f74f00f6530 2023-10-18T21:11:36.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.238+0000 7f74ecff9700 1 -- 172.21.15.8:0/3526955747 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e0014660 con 0x7f74f00f6530 2023-10-18T21:11:36.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.238+0000 7f74f5300700 1 -- 172.21.15.8:0/3526955747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f006ac20 con 0x7f74f00f6530 2023-10-18T21:11:36.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.239+0000 7f74f5300700 1 -- 172.21.15.8:0/3526955747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f0045ad0 con 0x7f74f00f6530 2023-10-18T21:11:36.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.240+0000 7f74ecff9700 1 -- 172.21.15.8:0/3526955747 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f74e001e9c0 con 0x7f74f00f6530 2023-10-18T21:11:36.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.241+0000 7f74ecff9700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74d8060f70 0x7f74d8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:36.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.241+0000 7f74ecff9700 1 -- 172.21.15.8:0/3526955747 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f74e007dcc0 con 0x7f74f00f6530 2023-10-18T21:11:36.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.241+0000 7f74ef7fe700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74d8060f70 0x7f74d8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:36.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.242+0000 7f74ef7fe700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74d8060f70 0x7f74d8063430 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f74e4007fd0 tx=0x7f74e400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:36.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.245+0000 7f74ecff9700 1 -- 172.21.15.8:0/3526955747 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f74e004d9b0 con 0x7f74f00f6530 2023-10-18T21:11:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:35.196407+0000 mgr.smithi008.flmjzp (mgr.14640) 768 : cluster [DBG] pgmap v545: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:36.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.443+0000 7f74f5300700 1 -- 172.21.15.8:0/3526955747 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74f00fee40 con 0x7f74d8060f70 2023-10-18T21:11:36.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.444+0000 7f74ecff9700 1 -- 172.21.15.8:0/3526955747 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f74f00fee40 con 0x7f74d8060f70 2023-10-18T21:11:36.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 -- 172.21.15.8:0/3526955747 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74d8060f70 msgr2=0x7f74d8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:36.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74d8060f70 0x7f74d8063430 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f74e4007fd0 tx=0x7f74e400b040).stop 2023-10-18T21:11:36.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 -- 172.21.15.8:0/3526955747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74f00f6530 msgr2=0x7f74f006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:36.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74f00f6530 0x7f74f006b9a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f74e0009870 tx=0x7f74e000b040).stop 2023-10-18T21:11:36.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 -- 172.21.15.8:0/3526955747 shutdown_connections 2023-10-18T21:11:36.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f74d8060f70 0x7f74d8063430 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74f00f6530 0x7f74f006b9a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 --2- 172.21.15.8:0/3526955747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74f00f77d0 0x7f74f0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 -- 172.21.15.8:0/3526955747 >> 172.21.15.8:0/3526955747 conn(0x7f74f00f1c90 msgr2=0x7f74f00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:36.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 -- 172.21.15.8:0/3526955747 shutdown_connections 2023-10-18T21:11:36.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.446+0000 7f74f5300700 1 -- 172.21.15.8:0/3526955747 wait complete. 2023-10-18T21:11:36.463 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:11:36.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:35.196407+0000 mgr.smithi008.flmjzp (mgr.14640) 768 : cluster [DBG] pgmap v545: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.586+0000 7ff22359e700 1 -- 172.21.15.8:0/490022320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2240f77d0 msgr2=0x7ff2240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.586+0000 7ff22359e700 1 --2- 172.21.15.8:0/490022320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2240f77d0 0x7ff2240f7c30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ff218004660 tx=0x7ff218009b30).stop 2023-10-18T21:11:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.586+0000 7ff22359e700 1 -- 172.21.15.8:0/490022320 shutdown_connections 2023-10-18T21:11:36.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.586+0000 7ff22359e700 1 --2- 172.21.15.8:0/490022320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2240f77d0 0x7ff2240f7c30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.586+0000 7ff22359e700 1 --2- 172.21.15.8:0/490022320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2240f6530 0x7ff2240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.586+0000 7ff22359e700 1 -- 172.21.15.8:0/490022320 >> 172.21.15.8:0/490022320 conn(0x7ff2240f1c90 msgr2=0x7ff2240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:36.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.586+0000 7ff22359e700 1 -- 172.21.15.8:0/490022320 shutdown_connections 2023-10-18T21:11:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.586+0000 7ff22359e700 1 -- 172.21.15.8:0/490022320 wait complete. 2023-10-18T21:11:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.587+0000 7ff22359e700 1 Processor -- start 2023-10-18T21:11:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.587+0000 7ff22359e700 1 -- start start 2023-10-18T21:11:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.587+0000 7ff22359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2240f6530 0x7ff224108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.587+0000 7ff22359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2240f77d0 0x7ff224109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.587+0000 7ff22359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2241099c0 con 0x7ff2240f6530 2023-10-18T21:11:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.587+0000 7ff22359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff224109b00 con 0x7ff2240f77d0 2023-10-18T21:11:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.587+0000 7ff22259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2240f6530 0x7ff224108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff22259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2240f6530 0x7ff224108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46182/0 (socket says 172.21.15.8:46182) 2023-10-18T21:11:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff22259c700 1 -- 172.21.15.8:0/3071555436 learned_addr learned my addr 172.21.15.8:0/3071555436 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff221d9b700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2240f77d0 0x7ff224109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff22259c700 1 -- 172.21.15.8:0/3071555436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2240f77d0 msgr2=0x7ff224109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:36.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff22259c700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2240f77d0 0x7ff224109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff22259c700 1 -- 172.21.15.8:0/3071555436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218005040 con 0x7ff2240f6530 2023-10-18T21:11:36.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff22259c700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2240f6530 0x7ff224108f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ff214002700 tx=0x7ff214009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:36.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff212ffd700 1 -- 172.21.15.8:0/3071555436 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2140079c0 con 0x7ff2240f6530 2023-10-18T21:11:36.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff212ffd700 1 -- 172.21.15.8:0/3071555436 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff21400f040 con 0x7ff2240f6530 2023-10-18T21:11:36.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff212ffd700 1 -- 172.21.15.8:0/3071555436 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2140148d0 con 0x7ff2240f6530 2023-10-18T21:11:36.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.588+0000 7ff22359e700 1 -- 172.21.15.8:0/3071555436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22410a4a0 con 0x7ff2240f6530 2023-10-18T21:11:36.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.589+0000 7ff22359e700 1 -- 172.21.15.8:0/3071555436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22410aa60 con 0x7ff2240f6530 2023-10-18T21:11:36.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.590+0000 7ff22359e700 1 -- 172.21.15.8:0/3071555436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff224045ad0 con 0x7ff2240f6530 2023-10-18T21:11:36.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.590+0000 7ff212ffd700 1 -- 172.21.15.8:0/3071555436 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff21401b060 con 0x7ff2240f6530 2023-10-18T21:11:36.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.591+0000 7ff212ffd700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff20c060f70 0x7ff20c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:36.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.591+0000 7ff212ffd700 1 -- 172.21.15.8:0/3071555436 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff21407c7a0 con 0x7ff2240f6530 2023-10-18T21:11:36.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.592+0000 7ff221d9b700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff20c060f70 0x7ff20c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.592+0000 7ff221d9b700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff20c060f70 0x7ff20c063430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff218004630 tx=0x7ff218009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.595+0000 7ff212ffd700 1 -- 172.21.15.8:0/3071555436 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff21404fe00 con 0x7ff2240f6530 2023-10-18T21:11:36.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.803+0000 7ff22359e700 1 -- 172.21.15.8:0/3071555436 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff22410ad30 con 0x7ff20c060f70 2023-10-18T21:11:36.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.804+0000 7ff212ffd700 1 -- 172.21.15.8:0/3071555436 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff22410ad30 con 0x7ff20c060f70 2023-10-18T21:11:36.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.806+0000 7ff22359e700 1 -- 172.21.15.8:0/3071555436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff20c060f70 msgr2=0x7ff20c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:36.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.806+0000 7ff22359e700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff20c060f70 0x7ff20c063430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff218004630 tx=0x7ff218009b30).stop 2023-10-18T21:11:36.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.806+0000 7ff22359e700 1 -- 172.21.15.8:0/3071555436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2240f6530 msgr2=0x7ff224108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:36.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.806+0000 7ff22359e700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2240f6530 0x7ff224108f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ff214002700 tx=0x7ff214009e00).stop 2023-10-18T21:11:36.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.807+0000 7ff22359e700 1 -- 172.21.15.8:0/3071555436 shutdown_connections 2023-10-18T21:11:36.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.807+0000 7ff22359e700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff20c060f70 0x7ff20c063430 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.807+0000 7ff22359e700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2240f6530 0x7ff224108f20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.807+0000 7ff22359e700 1 --2- 172.21.15.8:0/3071555436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2240f77d0 0x7ff224109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.807+0000 7ff22359e700 1 -- 172.21.15.8:0/3071555436 >> 172.21.15.8:0/3071555436 conn(0x7ff2240f1c90 msgr2=0x7ff22406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:36.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.807+0000 7ff22359e700 1 -- 172.21.15.8:0/3071555436 shutdown_connections 2023-10-18T21:11:36.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.807+0000 7ff22359e700 1 -- 172.21.15.8:0/3071555436 wait complete. 2023-10-18T21:11:36.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.947+0000 7f1495c54700 1 -- 172.21.15.8:0/1750391769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f6530 msgr2=0x7f14900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.947+0000 7f1495c54700 1 --2- 172.21.15.8:0/1750391769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f6530 0x7f14900f6950 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f1484004660 tx=0x7f1484009b30).stop 2023-10-18T21:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.947+0000 7f1495c54700 1 -- 172.21.15.8:0/1750391769 shutdown_connections 2023-10-18T21:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.947+0000 7f1495c54700 1 --2- 172.21.15.8:0/1750391769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f77d0 0x7f14900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.947+0000 7f1495c54700 1 --2- 172.21.15.8:0/1750391769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f6530 0x7f14900f6950 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.947+0000 7f1495c54700 1 -- 172.21.15.8:0/1750391769 >> 172.21.15.8:0/1750391769 conn(0x7f14900f1c90 msgr2=0x7f14900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.947+0000 7f1495c54700 1 -- 172.21.15.8:0/1750391769 shutdown_connections 2023-10-18T21:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.947+0000 7f1495c54700 1 -- 172.21.15.8:0/1750391769 wait complete. 2023-10-18T21:11:36.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.948+0000 7f1495c54700 1 Processor -- start 2023-10-18T21:11:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.948+0000 7f1495c54700 1 -- start start 2023-10-18T21:11:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.948+0000 7f1495c54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 0x7f1490108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.948+0000 7f1495c54700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.948+0000 7f1495c54700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1490109a00 con 0x7f14900f77d0 2023-10-18T21:11:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.948+0000 7f1495c54700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1490109b40 con 0x7f14900f6530 2023-10-18T21:11:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.949+0000 7f148ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.949+0000 7f148ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47028/0 (socket says 172.21.15.8:47028) 2023-10-18T21:11:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.949+0000 7f148ffff700 1 -- 172.21.15.8:0/9244198 learned_addr learned my addr 172.21.15.8:0/9244198 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.949+0000 7f1494c52700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 0x7f1490108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.949+0000 7f148ffff700 1 -- 172.21.15.8:0/9244198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 msgr2=0x7f1490108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.949+0000 7f148ffff700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 0x7f1490108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.949+0000 7f148ffff700 1 -- 172.21.15.8:0/9244198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484005040 con 0x7f14900f77d0 2023-10-18T21:11:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.949+0000 7f148ffff700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f147c00e7f0 tx=0x7f147c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.949+0000 7f148d7fa700 1 -- 172.21.15.8:0/9244198 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f147c0092e0 con 0x7f14900f77d0 2023-10-18T21:11:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.950+0000 7f148d7fa700 1 -- 172.21.15.8:0/9244198 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f147c00f040 con 0x7f14900f77d0 2023-10-18T21:11:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.950+0000 7f148d7fa700 1 -- 172.21.15.8:0/9244198 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f147c0147e0 con 0x7f14900f77d0 2023-10-18T21:11:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.950+0000 7f1495c54700 1 -- 172.21.15.8:0/9244198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149010a4e0 con 0x7f14900f77d0 2023-10-18T21:11:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.950+0000 7f1495c54700 1 -- 172.21.15.8:0/9244198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149010aa20 con 0x7f14900f77d0 2023-10-18T21:11:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.951+0000 7f1495c54700 1 -- 172.21.15.8:0/9244198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1490045ad0 con 0x7f14900f77d0 2023-10-18T21:11:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.952+0000 7f148d7fa700 1 -- 172.21.15.8:0/9244198 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f147c01b030 con 0x7f14900f77d0 2023-10-18T21:11:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.952+0000 7f148d7fa700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 0x7f1480063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.953+0000 7f148d7fa700 1 -- 172.21.15.8:0/9244198 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f147c07c6b0 con 0x7f14900f77d0 2023-10-18T21:11:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.953+0000 7f1494c52700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 0x7f1480063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.953+0000 7f1494c52700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 0x7f1480063430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1484005010 tx=0x7f1484016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:36.957+0000 7f148d7fa700 1 -- 172.21.15.8:0/9244198 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f147c04fd40 con 0x7f14900f77d0 2023-10-18T21:11:37.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.155+0000 7f1495c54700 1 -- 172.21.15.8:0/9244198 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f149010ac90 con 0x7f1480060f70 2023-10-18T21:11:37.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.165+0000 7f148d7fa700 1 -- 172.21.15.8:0/9244198 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f149010ac90 con 0x7f1480060f70 2023-10-18T21:11:37.167 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:11:37.167 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (18m) 6m ago 19m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:11:37.167 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (12m) 6m ago 19m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:11:37.167 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (12m) 4m ago 18m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:11:37.168 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (18m) 6m ago 19m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:11:37.168 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (6m) 6m ago 15m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:11:37.168 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 15m - - 2023-10-18T21:11:37.168 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (4m) 4m ago 15m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:11:37.168 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (4m) 4m ago 15m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:11:37.169 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (13m) 6m ago 21m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:11:37.169 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (12m) 4m ago 18m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:11:37.169 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (12m) 6m ago 21m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:11:37.169 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (12m) 4m ago 18m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:11:37.169 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (19m) 6m ago 19m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:11:37.169 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (18m) 4m ago 18m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:11:37.170 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (11m) 6m ago 18m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:11:37.170 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (9m) 6m ago 18m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:11:37.170 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (9m) 6m ago 17m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:11:37.170 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (8m) 4m ago 17m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:11:37.170 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (8m) 4m ago 17m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:11:37.171 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (7m) 4m ago 16m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:11:37.171 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (13m) 6m ago 19m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:11:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 -- 172.21.15.8:0/9244198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 msgr2=0x7f1480063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 0x7f1480063430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1484005010 tx=0x7f1484016040).stop 2023-10-18T21:11:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 -- 172.21.15.8:0/9244198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 msgr2=0x7f1490109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f147c00e7f0 tx=0x7f147c00b040).stop 2023-10-18T21:11:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 -- 172.21.15.8:0/9244198 shutdown_connections 2023-10-18T21:11:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 0x7f1480063430 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 0x7f1490108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 --2- 172.21.15.8:0/9244198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109450 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 -- 172.21.15.8:0/9244198 >> 172.21.15.8:0/9244198 conn(0x7f14900f1c90 msgr2=0x7f149006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:37.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 -- 172.21.15.8:0/9244198 shutdown_connections 2023-10-18T21:11:37.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.167+0000 7f1495c54700 1 -- 172.21.15.8:0/9244198 wait complete. 2023-10-18T21:11:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.302+0000 7ff72f066700 1 -- 172.21.15.8:0/2741773662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff72806a3b0 msgr2=0x7ff72806a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.302+0000 7ff72f066700 1 --2- 172.21.15.8:0/2741773662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff72806a3b0 0x7ff72806a830 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7ff718004660 tx=0x7ff718009b30).stop 2023-10-18T21:11:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.302+0000 7ff72f066700 1 -- 172.21.15.8:0/2741773662 shutdown_connections 2023-10-18T21:11:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.302+0000 7ff72f066700 1 --2- 172.21.15.8:0/2741773662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff72806a3b0 0x7ff72806a830 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.302+0000 7ff72f066700 1 --2- 172.21.15.8:0/2741773662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72806b9c0 0x7ff728069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:11:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.302+0000 7ff72f066700 1 -- 172.21.15.8:0/2741773662 >> 172.21.15.8:0/2741773662 conn(0x7ff7280f1c90 msgr2=0x7ff7280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.302+0000 7ff72f066700 1 -- 172.21.15.8:0/2741773662 shutdown_connections 2023-10-18T21:11:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.302+0000 7ff72f066700 1 -- 172.21.15.8:0/2741773662 wait complete. 2023-10-18T21:11:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.303+0000 7ff72f066700 1 Processor -- start 2023-10-18T21:11:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.303+0000 7ff72f066700 1 -- start start 2023-10-18T21:11:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72f066700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72806a3b0 0x7ff728108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72f066700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff72806b9c0 0x7ff7281093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72f066700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff728109a20 con 0x7ff72806b9c0 2023-10-18T21:11:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72f066700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72810a2d0 con 0x7ff72806a3b0 2023-10-18T21:11:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72d863700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff72806b9c0 0x7ff7281093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72d863700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff72806b9c0 0x7ff7281093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47044/0 (socket says 172.21.15.8:47044) 2023-10-18T21:11:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72d863700 1 -- 172.21.15.8:0/2135780214 learned_addr learned my addr 172.21.15.8:0/2135780214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72e064700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72806a3b0 0x7ff728108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72d863700 1 -- 172.21.15.8:0/2135780214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72806a3b0 msgr2=0x7ff728108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72d863700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72806a3b0 0x7ff728108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.304+0000 7ff72d863700 1 -- 172.21.15.8:0/2135780214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718005040 con 0x7ff72806b9c0 2023-10-18T21:11:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.305+0000 7ff72d863700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff72806b9c0 0x7ff7281093e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7ff718009990 tx=0x7ff718009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.305+0000 7ff71effd700 1 -- 172.21.15.8:0/2135780214 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff718018070 con 0x7ff72806b9c0 2023-10-18T21:11:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.305+0000 7ff71effd700 1 -- 172.21.15.8:0/2135780214 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff718009780 con 0x7ff72806b9c0 2023-10-18T21:11:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.305+0000 7ff72f066700 1 -- 172.21.15.8:0/2135780214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72810a550 con 0x7ff72806b9c0 2023-10-18T21:11:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.305+0000 7ff71effd700 1 -- 172.21.15.8:0/2135780214 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff71801c5e0 con 0x7ff72806b9c0 2023-10-18T21:11:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.305+0000 7ff72f066700 1 -- 172.21.15.8:0/2135780214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72810aab0 con 0x7ff72806b9c0 2023-10-18T21:11:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.306+0000 7ff72f066700 1 -- 172.21.15.8:0/2135780214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff728059100 con 0x7ff72806b9c0 2023-10-18T21:11:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.307+0000 7ff71effd700 1 -- 172.21.15.8:0/2135780214 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff71801dac0 con 0x7ff72806b9c0 2023-10-18T21:11:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.308+0000 7ff71effd700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff714060f70 0x7ff714063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.308+0000 7ff71effd700 1 -- 172.21.15.8:0/2135780214 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff71807e830 con 0x7ff72806b9c0 2023-10-18T21:11:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.308+0000 7ff72e064700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff714060f70 0x7ff714063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.309+0000 7ff72e064700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff714060f70 0x7ff714063430 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7ff724006fd0 tx=0x7ff724008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.312+0000 7ff71effd700 1 -- 172.21.15.8:0/2135780214 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff718051e10 con 0x7ff72806b9c0 2023-10-18T21:11:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:36.445511+0000 mgr.smithi008.flmjzp (mgr.14640) 769 : audit [DBG] from='client.34836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:36.445511+0000 mgr.smithi008.flmjzp (mgr.14640) 769 : audit [DBG] from='client.34836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:37.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.565+0000 7ff72f066700 1 -- 172.21.15.8:0/2135780214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff728100f30 con 0x7ff72806b9c0 2023-10-18T21:11:37.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.565+0000 7ff71effd700 1 -- 172.21.15.8:0/2135780214 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7ff718051a00 con 0x7ff72806b9c0 2023-10-18T21:11:37.568 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:11:37.568 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:11:37.568 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:11:37.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:11:37.569 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:11:37.569 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:11:37.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:11:37.569 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:11:37.569 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:11:37.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:11:37.570 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:11:37.570 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:11:37.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:11:37.570 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:11:37.570 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:11:37.571 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:11:37.571 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:11:37.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.567+0000 7ff72f066700 1 -- 172.21.15.8:0/2135780214 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff714060f70 msgr2=0x7ff714063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:37.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.567+0000 7ff72f066700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff714060f70 0x7ff714063430 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7ff724006fd0 tx=0x7ff724008040).stop 2023-10-18T21:11:37.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.567+0000 7ff72f066700 1 -- 172.21.15.8:0/2135780214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff72806b9c0 msgr2=0x7ff7281093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:37.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.567+0000 7ff72f066700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff72806b9c0 0x7ff7281093e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7ff718009990 tx=0x7ff718009b30).stop 2023-10-18T21:11:37.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.567+0000 7ff72f066700 1 -- 172.21.15.8:0/2135780214 shutdown_connections 2023-10-18T21:11:37.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.568+0000 7ff72f066700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff714060f70 0x7ff714063430 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.568+0000 7ff72f066700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72806a3b0 0x7ff728108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.568+0000 7ff72f066700 1 --2- 172.21.15.8:0/2135780214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff72806b9c0 0x7ff7281093e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.568+0000 7ff72f066700 1 -- 172.21.15.8:0/2135780214 >> 172.21.15.8:0/2135780214 conn(0x7ff7280f1c90 msgr2=0x7ff7280fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:37.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.568+0000 7ff72f066700 1 -- 172.21.15.8:0/2135780214 shutdown_connections 2023-10-18T21:11:37.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.568+0000 7ff72f066700 1 -- 172.21.15.8:0/2135780214 wait complete. 2023-10-18T21:11:37.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.705+0000 7f7194eaa700 1 -- 172.21.15.8:0/2121050267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900f6530 msgr2=0x7f71900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:37.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.705+0000 7f7194eaa700 1 --2- 172.21.15.8:0/2121050267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900f6530 0x7f71900f6950 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f7180004660 tx=0x7f7180009b30).stop 2023-10-18T21:11:37.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.705+0000 7f7194eaa700 1 -- 172.21.15.8:0/2121050267 shutdown_connections 2023-10-18T21:11:37.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.705+0000 7f7194eaa700 1 --2- 172.21.15.8:0/2121050267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71900f77d0 0x7f71900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.705+0000 7f7194eaa700 1 --2- 172.21.15.8:0/2121050267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900f6530 0x7f71900f6950 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.705+0000 7f7194eaa700 1 -- 172.21.15.8:0/2121050267 >> 172.21.15.8:0/2121050267 conn(0x7f71900f1c90 msgr2=0x7f71900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:37.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.705+0000 7f7194eaa700 1 -- 172.21.15.8:0/2121050267 shutdown_connections 2023-10-18T21:11:37.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.705+0000 7f7194eaa700 1 -- 172.21.15.8:0/2121050267 wait complete. 2023-10-18T21:11:37.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.706+0000 7f7194eaa700 1 Processor -- start 2023-10-18T21:11:37.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.707+0000 7f7194eaa700 1 -- start start 2023-10-18T21:11:37.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.707+0000 7f7194eaa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71900f6530 0x7f7190106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:37.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.707+0000 7f7194eaa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900f77d0 0x7f7190107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:37.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.707+0000 7f7194eaa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190107900 con 0x7f71900f77d0 2023-10-18T21:11:37.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.707+0000 7f7194eaa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190108110 con 0x7f71900f6530 2023-10-18T21:11:37.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f718effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900f77d0 0x7f7190107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:37.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f718effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900f77d0 0x7f7190107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47062/0 (socket says 172.21.15.8:47062) 2023-10-18T21:11:37.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f718effd700 1 -- 172.21.15.8:0/2360425978 learned_addr learned my addr 172.21.15.8:0/2360425978 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:37.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f718f7fe700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71900f6530 0x7f7190106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:37.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f718effd700 1 -- 172.21.15.8:0/2360425978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71900f6530 msgr2=0x7f7190106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:37.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f718effd700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71900f6530 0x7f7190106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f718effd700 1 -- 172.21.15.8:0/2360425978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180005040 con 0x7f71900f77d0 2023-10-18T21:11:37.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f718effd700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900f77d0 0x7f7190107300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f71840026d0 tx=0x7f7184009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:37.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f7177fff700 1 -- 172.21.15.8:0/2360425978 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71840079c0 con 0x7f71900f77d0 2023-10-18T21:11:37.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f7177fff700 1 -- 172.21.15.8:0/2360425978 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f718400f040 con 0x7f71900f77d0 2023-10-18T21:11:37.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f7177fff700 1 -- 172.21.15.8:0/2360425978 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7184014980 con 0x7f71900f77d0 2023-10-18T21:11:37.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.708+0000 7f7194eaa700 1 -- 172.21.15.8:0/2360425978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7190108390 con 0x7f71900f77d0 2023-10-18T21:11:37.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.709+0000 7f7194eaa700 1 -- 172.21.15.8:0/2360425978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7190108950 con 0x7f71900f77d0 2023-10-18T21:11:37.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.710+0000 7f7194eaa700 1 -- 172.21.15.8:0/2360425978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7190059100 con 0x7f71900f77d0 2023-10-18T21:11:37.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.710+0000 7f7177fff700 1 -- 172.21.15.8:0/2360425978 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f71840090d0 con 0x7f71900f77d0 2023-10-18T21:11:37.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.711+0000 7f7177fff700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7178060f70 0x7f7178063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:37.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.711+0000 7f7177fff700 1 -- 172.21.15.8:0/2360425978 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f718407c8a0 con 0x7f71900f77d0 2023-10-18T21:11:37.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.712+0000 7f718f7fe700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7178060f70 0x7f7178063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:37.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.712+0000 7f718f7fe700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7178060f70 0x7f7178063430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7180005010 tx=0x7f7180009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:37.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.715+0000 7f7177fff700 1 -- 172.21.15.8:0/2360425978 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f718404c580 con 0x7f71900f77d0 2023-10-18T21:11:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.941+0000 7f7194eaa700 1 -- 172.21.15.8:0/2360425978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f71900fee50 con 0x7f71900f77d0 2023-10-18T21:11:37.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.942+0000 7f7177fff700 1 -- 172.21.15.8:0/2360425978 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f71900fee50 con 0x7f71900f77d0 2023-10-18T21:11:37.944 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:11:37.944 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:11:37.945 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:11:37.945 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:11:37.945 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:11:37.945 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:11:37.945 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:11:37.946 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:11:37.946 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:11:37.946 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:11:37.946 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:11:37.947 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:11:37.947 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:11:37.947 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:11:37.947 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:11:37.947 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:11:37.948 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:11:37.948 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:11:37.948 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:11:37.948 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:11:37.948 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:11:37.949 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:11:37.949 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:11:37.949 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:11:37.949 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:11:37.949 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:11:37.950 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:11:37.950 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:11:37.950 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:11:37.950 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:11:37.950 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:11:37.951 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:11:37.951 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:11:37.951 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:11:37.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 -- 172.21.15.8:0/2360425978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7178060f70 msgr2=0x7f7178063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:37.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7178060f70 0x7f7178063430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7180005010 tx=0x7f7180009b30).stop 2023-10-18T21:11:37.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 -- 172.21.15.8:0/2360425978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900f77d0 msgr2=0x7f7190107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:37.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900f77d0 0x7f7190107300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f71840026d0 tx=0x7f7184009de0).stop 2023-10-18T21:11:37.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 -- 172.21.15.8:0/2360425978 shutdown_connections 2023-10-18T21:11:37.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7178060f70 0x7f7178063430 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71900f6530 0x7f7190106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 --2- 172.21.15.8:0/2360425978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900f77d0 0x7f7190107300 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:37.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 -- 172.21.15.8:0/2360425978 >> 172.21.15.8:0/2360425978 conn(0x7f71900f1c90 msgr2=0x7f71900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:37.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 -- 172.21.15.8:0/2360425978 shutdown_connections 2023-10-18T21:11:37.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:37.944+0000 7f7194eaa700 1 -- 172.21.15.8:0/2360425978 wait complete. 2023-10-18T21:11:37.954 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:11:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.082+0000 7f54264aa700 1 -- 172.21.15.8:0/4004446108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54200f77d0 msgr2=0x7f54200f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.082+0000 7f54264aa700 1 --2- 172.21.15.8:0/4004446108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54200f77d0 0x7f54200f7c30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f5410004660 tx=0x7f5410009b30).stop 2023-10-18T21:11:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.082+0000 7f54264aa700 1 -- 172.21.15.8:0/4004446108 shutdown_connections 2023-10-18T21:11:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.082+0000 7f54264aa700 1 --2- 172.21.15.8:0/4004446108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54200f77d0 0x7f54200f7c30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.082+0000 7f54264aa700 1 --2- 172.21.15.8:0/4004446108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54200f6530 0x7f54200f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.082+0000 7f54264aa700 1 -- 172.21.15.8:0/4004446108 >> 172.21.15.8:0/4004446108 conn(0x7f54200f1cd0 msgr2=0x7f54200f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.082+0000 7f54264aa700 1 -- 172.21.15.8:0/4004446108 shutdown_connections 2023-10-18T21:11:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.082+0000 7f54264aa700 1 -- 172.21.15.8:0/4004446108 wait complete. 2023-10-18T21:11:38.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.083+0000 7f54264aa700 1 Processor -- start 2023-10-18T21:11:38.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.083+0000 7f54264aa700 1 -- start start 2023-10-18T21:11:38.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f54264aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54200f6530 0x7f5420106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:38.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f54264aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54200f77d0 0x7f5420107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:38.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f54264aa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54201077e0 con 0x7f54200f77d0 2023-10-18T21:11:38.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f54264aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5420107fe0 con 0x7f54200f6530 2023-10-18T21:11:38.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f5424ca7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54200f77d0 0x7f5420107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:38.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f5424ca7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54200f77d0 0x7f5420107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47072/0 (socket says 172.21.15.8:47072) 2023-10-18T21:11:38.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f5424ca7700 1 -- 172.21.15.8:0/2821593783 learned_addr learned my addr 172.21.15.8:0/2821593783 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:11:38.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f54254a8700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54200f6530 0x7f5420106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:38.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f5424ca7700 1 -- 172.21.15.8:0/2821593783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54200f6530 msgr2=0x7f5420106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:38.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f5424ca7700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54200f6530 0x7f5420106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:38.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.084+0000 7f5424ca7700 1 -- 172.21.15.8:0/2821593783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5410005040 con 0x7f54200f77d0 2023-10-18T21:11:38.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.085+0000 7f5424ca7700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54200f77d0 0x7f5420107230 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f5410004320 tx=0x7f541000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:38.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.085+0000 7f5415ffb700 1 -- 172.21.15.8:0/2821593783 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5410019070 con 0x7f54200f77d0 2023-10-18T21:11:38.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.085+0000 7f5415ffb700 1 -- 172.21.15.8:0/2821593783 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f541001e420 con 0x7f54200f77d0 2023-10-18T21:11:38.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.085+0000 7f5415ffb700 1 -- 172.21.15.8:0/2821593783 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5410014680 con 0x7f54200f77d0 2023-10-18T21:11:38.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.085+0000 7f54264aa700 1 -- 172.21.15.8:0/2821593783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5420108260 con 0x7f54200f77d0 2023-10-18T21:11:38.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.085+0000 7f54264aa700 1 -- 172.21.15.8:0/2821593783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5420108740 con 0x7f54200f77d0 2023-10-18T21:11:38.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.086+0000 7f54264aa700 1 -- 172.21.15.8:0/2821593783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5420059100 con 0x7f54200f77d0 2023-10-18T21:11:38.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.087+0000 7f5415ffb700 1 -- 172.21.15.8:0/2821593783 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f541001e590 con 0x7f54200f77d0 2023-10-18T21:11:38.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.088+0000 7f5415ffb700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f540c060f70 0x7f540c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:11:38.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.088+0000 7f5415ffb700 1 -- 172.21.15.8:0/2821593783 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f541007dd10 con 0x7f54200f77d0 2023-10-18T21:11:38.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.089+0000 7f54254a8700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f540c060f70 0x7f540c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:11:38.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.089+0000 7f54254a8700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f540c060f70 0x7f540c063430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f541c009fd0 tx=0x7f541c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:11:38.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.092+0000 7f5415ffb700 1 -- 172.21.15.8:0/2821593783 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5410051310 con 0x7f54200f77d0 2023-10-18T21:11:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.289+0000 7f54264aa700 1 -- 172.21.15.8:0/2821593783 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54200fecc0 con 0x7f540c060f70 2023-10-18T21:11:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.291+0000 7f5415ffb700 1 -- 172.21.15.8:0/2821593783 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f54200fecc0 con 0x7f540c060f70 2023-10-18T21:11:38.293 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:11:38.293 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:11:38.293 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:11:38.293 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:11:38.294 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:11:38.294 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:11:38.294 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:11:38.294 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:11:38.295 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:11:38.295 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:11:38.295 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:11:38.295 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:11:38.295 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:11:38.296 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:11:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 -- 172.21.15.8:0/2821593783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f540c060f70 msgr2=0x7f540c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:38.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f540c060f70 0x7f540c063430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f541c009fd0 tx=0x7f541c00b040).stop 2023-10-18T21:11:38.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 -- 172.21.15.8:0/2821593783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54200f77d0 msgr2=0x7f5420107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:11:38.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54200f77d0 0x7f5420107230 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f5410004320 tx=0x7f541000b040).stop 2023-10-18T21:11:38.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 -- 172.21.15.8:0/2821593783 shutdown_connections 2023-10-18T21:11:38.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f540c060f70 0x7f540c063430 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:38.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54200f6530 0x7f5420106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:38.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 --2- 172.21.15.8:0/2821593783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54200f77d0 0x7f5420107230 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:11:38.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 -- 172.21.15.8:0/2821593783 >> 172.21.15.8:0/2821593783 conn(0x7f54200f1cd0 msgr2=0x7f54200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:11:38.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 -- 172.21.15.8:0/2821593783 shutdown_connections 2023-10-18T21:11:38.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:11:38.293+0000 7f54264aa700 1 -- 172.21.15.8:0/2821593783 wait complete. 2023-10-18T21:11:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:36.805678+0000 mgr.smithi008.flmjzp (mgr.14640) 770 : audit [DBG] from='client.34840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:37.157629+0000 mgr.smithi008.flmjzp (mgr.14640) 771 : audit [DBG] from='client.34844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:37.196878+0000 mgr.smithi008.flmjzp (mgr.14640) 772 : cluster [DBG] pgmap v546: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:37.566992+0000 mon.smithi008 (mon.0) 1251 : audit [DBG] from='client.? 172.21.15.8:0/2135780214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:38.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:37.943354+0000 mon.smithi008 (mon.0) 1252 : audit [DBG] from='client.? 172.21.15.8:0/2360425978' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:11:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:36.805678+0000 mgr.smithi008.flmjzp (mgr.14640) 770 : audit [DBG] from='client.34840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:37.157629+0000 mgr.smithi008.flmjzp (mgr.14640) 771 : audit [DBG] from='client.34844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:37.196878+0000 mgr.smithi008.flmjzp (mgr.14640) 772 : cluster [DBG] pgmap v546: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:37.566992+0000 mon.smithi008 (mon.0) 1251 : audit [DBG] from='client.? 172.21.15.8:0/2135780214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:38.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:37.943354+0000 mon.smithi008 (mon.0) 1252 : audit [DBG] from='client.? 172.21.15.8:0/2360425978' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:11:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:38.292133+0000 mgr.smithi008.flmjzp (mgr.14640) 773 : audit [DBG] from='client.34856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:39.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:38.292133+0000 mgr.smithi008.flmjzp (mgr.14640) 773 : audit [DBG] from='client.34856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:11:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:39.197411+0000 mgr.smithi008.flmjzp (mgr.14640) 774 : cluster [DBG] pgmap v547: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:39.197411+0000 mgr.smithi008.flmjzp (mgr.14640) 774 : cluster [DBG] pgmap v547: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:41.220736+0000 mon.smithi008 (mon.0) 1253 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:41.220736+0000 mon.smithi008 (mon.0) 1253 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:41.198005+0000 mgr.smithi008.flmjzp (mgr.14640) 775 : cluster [DBG] pgmap v548: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:41.783023+0000 mon.smithi008 (mon.0) 1254 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:41.783811+0000 mon.smithi008 (mon.0) 1255 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:41.789078+0000 mon.smithi008 (mon.0) 1256 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:41.794096+0000 mon.smithi008 (mon.0) 1257 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:41.796483+0000 mon.smithi008 (mon.0) 1258 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:41.797776+0000 mon.smithi008 (mon.0) 1259 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:41.798977+0000 mon.smithi008 (mon.0) 1260 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:41.800602+0000 mon.smithi008 (mon.0) 1261 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:41.198005+0000 mgr.smithi008.flmjzp (mgr.14640) 775 : cluster [DBG] pgmap v548: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:41.783023+0000 mon.smithi008 (mon.0) 1254 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:41.783811+0000 mon.smithi008 (mon.0) 1255 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:41.789078+0000 mon.smithi008 (mon.0) 1256 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:41.794096+0000 mon.smithi008 (mon.0) 1257 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:41.796483+0000 mon.smithi008 (mon.0) 1258 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:41.797776+0000 mon.smithi008 (mon.0) 1259 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:41.798977+0000 mon.smithi008 (mon.0) 1260 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:42.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:41.800602+0000 mon.smithi008 (mon.0) 1261 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:43.536 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:41.784438+0000 mgr.smithi008.flmjzp (mgr.14640) 776 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:43.536 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:41.784902+0000 mgr.smithi008.flmjzp (mgr.14640) 777 : cluster [DBG] pgmap v549: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:43.536 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:41.785109+0000 mgr.smithi008.flmjzp (mgr.14640) 778 : cluster [DBG] pgmap v550: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:43.537 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:41.802190+0000 mgr.smithi008.flmjzp (mgr.14640) 779 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:41.784438+0000 mgr.smithi008.flmjzp (mgr.14640) 776 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:41.784902+0000 mgr.smithi008.flmjzp (mgr.14640) 777 : cluster [DBG] pgmap v549: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:41.785109+0000 mgr.smithi008.flmjzp (mgr.14640) 778 : cluster [DBG] pgmap v550: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:41.802190+0000 mgr.smithi008.flmjzp (mgr.14640) 779 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:43.785766+0000 mgr.smithi008.flmjzp (mgr.14640) 780 : cluster [DBG] pgmap v551: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:43.785766+0000 mgr.smithi008.flmjzp (mgr.14640) 780 : cluster [DBG] pgmap v551: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:45.786376+0000 mgr.smithi008.flmjzp (mgr.14640) 781 : cluster [DBG] pgmap v552: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:45.786376+0000 mgr.smithi008.flmjzp (mgr.14640) 781 : cluster [DBG] pgmap v552: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:47.786997+0000 mgr.smithi008.flmjzp (mgr.14640) 782 : cluster [DBG] pgmap v553: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:47.786997+0000 mgr.smithi008.flmjzp (mgr.14640) 782 : cluster [DBG] pgmap v553: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:49.787564+0000 mgr.smithi008.flmjzp (mgr.14640) 783 : cluster [DBG] pgmap v554: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:49.787564+0000 mgr.smithi008.flmjzp (mgr.14640) 783 : cluster [DBG] pgmap v554: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:51.812036+0000 mon.smithi008 (mon.0) 1262 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:52.164325+0000 mon.smithi008 (mon.0) 1263 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:52.165351+0000 mon.smithi008 (mon.0) 1264 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:52.166112+0000 mon.smithi008 (mon.0) 1265 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:52.171145+0000 mon.smithi008 (mon.0) 1266 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:52.176234+0000 mon.smithi008 (mon.0) 1267 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:52.178659+0000 mon.smithi008 (mon.0) 1268 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:52.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:52.179909+0000 mon.smithi008 (mon.0) 1269 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:52.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:52.181139+0000 mon.smithi008 (mon.0) 1270 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:52.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:11:52.182665+0000 mon.smithi008 (mon.0) 1271 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:51.812036+0000 mon.smithi008 (mon.0) 1262 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:52.164325+0000 mon.smithi008 (mon.0) 1263 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:52.165351+0000 mon.smithi008 (mon.0) 1264 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:11:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:52.166112+0000 mon.smithi008 (mon.0) 1265 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:11:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:52.171145+0000 mon.smithi008 (mon.0) 1266 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:11:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:52.176234+0000 mon.smithi008 (mon.0) 1267 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:11:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:52.178659+0000 mon.smithi008 (mon.0) 1268 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:52.179909+0000 mon.smithi008 (mon.0) 1269 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:52.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:52.181139+0000 mon.smithi008 (mon.0) 1270 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:52.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:11:52.182665+0000 mon.smithi008 (mon.0) 1271 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:11:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:51.788270+0000 mgr.smithi008.flmjzp (mgr.14640) 784 : cluster [DBG] pgmap v555: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:52.166774+0000 mgr.smithi008.flmjzp (mgr.14640) 785 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:52.167269+0000 mgr.smithi008.flmjzp (mgr.14640) 786 : cluster [DBG] pgmap v556: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:52.167539+0000 mgr.smithi008.flmjzp (mgr.14640) 787 : cluster [DBG] pgmap v557: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:11:52.184335+0000 mgr.smithi008.flmjzp (mgr.14640) 788 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:51.788270+0000 mgr.smithi008.flmjzp (mgr.14640) 784 : cluster [DBG] pgmap v555: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:52.166774+0000 mgr.smithi008.flmjzp (mgr.14640) 785 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:11:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:52.167269+0000 mgr.smithi008.flmjzp (mgr.14640) 786 : cluster [DBG] pgmap v556: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:52.167539+0000 mgr.smithi008.flmjzp (mgr.14640) 787 : cluster [DBG] pgmap v557: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:11:52.184335+0000 mgr.smithi008.flmjzp (mgr.14640) 788 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:11:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:54.168033+0000 mgr.smithi008.flmjzp (mgr.14640) 789 : cluster [DBG] pgmap v558: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:54.168033+0000 mgr.smithi008.flmjzp (mgr.14640) 789 : cluster [DBG] pgmap v558: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:56.168561+0000 mgr.smithi008.flmjzp (mgr.14640) 790 : cluster [DBG] pgmap v559: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:56.168561+0000 mgr.smithi008.flmjzp (mgr.14640) 790 : cluster [DBG] pgmap v559: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:11:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:11:58.169079+0000 mgr.smithi008.flmjzp (mgr.14640) 791 : cluster [DBG] pgmap v560: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:11:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:11:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:11:58.169079+0000 mgr.smithi008.flmjzp (mgr.14640) 791 : cluster [DBG] pgmap v560: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:00.169683+0000 mgr.smithi008.flmjzp (mgr.14640) 792 : cluster [DBG] pgmap v561: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:00.169683+0000 mgr.smithi008.flmjzp (mgr.14640) 792 : cluster [DBG] pgmap v561: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:02.192990+0000 mon.smithi008 (mon.0) 1272 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:02.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:02.192990+0000 mon.smithi008 (mon.0) 1272 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:03.536 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:02.170222+0000 mgr.smithi008.flmjzp (mgr.14640) 793 : cluster [DBG] pgmap v562: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:03.537 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:02.756683+0000 mon.smithi008 (mon.0) 1273 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:03.537 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:02.757852+0000 mon.smithi008 (mon.0) 1274 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:03.537 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:02.764629+0000 mon.smithi008 (mon.0) 1275 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:03.538 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:02.771068+0000 mon.smithi008 (mon.0) 1276 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:03.538 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:02.774269+0000 mon.smithi008 (mon.0) 1277 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:03.538 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:02.775980+0000 mon.smithi008 (mon.0) 1278 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:03.538 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:02.777619+0000 mon.smithi008 (mon.0) 1279 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:03.538 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:02.779794+0000 mon.smithi008 (mon.0) 1280 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:02.170222+0000 mgr.smithi008.flmjzp (mgr.14640) 793 : cluster [DBG] pgmap v562: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:02.756683+0000 mon.smithi008 (mon.0) 1273 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:02.757852+0000 mon.smithi008 (mon.0) 1274 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:02.764629+0000 mon.smithi008 (mon.0) 1275 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:02.771068+0000 mon.smithi008 (mon.0) 1276 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:02.774269+0000 mon.smithi008 (mon.0) 1277 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:02.775980+0000 mon.smithi008 (mon.0) 1278 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:02.777619+0000 mon.smithi008 (mon.0) 1279 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:02.779794+0000 mon.smithi008 (mon.0) 1280 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:02.758751+0000 mgr.smithi008.flmjzp (mgr.14640) 794 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:02.759375+0000 mgr.smithi008.flmjzp (mgr.14640) 795 : cluster [DBG] pgmap v563: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:02.759653+0000 mgr.smithi008.flmjzp (mgr.14640) 796 : cluster [DBG] pgmap v564: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:02.781709+0000 mgr.smithi008.flmjzp (mgr.14640) 797 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:04.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:02.758751+0000 mgr.smithi008.flmjzp (mgr.14640) 794 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:02.759375+0000 mgr.smithi008.flmjzp (mgr.14640) 795 : cluster [DBG] pgmap v563: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:02.759653+0000 mgr.smithi008.flmjzp (mgr.14640) 796 : cluster [DBG] pgmap v564: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:02.781709+0000 mgr.smithi008.flmjzp (mgr.14640) 797 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:04.760170+0000 mgr.smithi008.flmjzp (mgr.14640) 798 : cluster [DBG] pgmap v565: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:06.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:04.760170+0000 mgr.smithi008.flmjzp (mgr.14640) 798 : cluster [DBG] pgmap v565: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:08.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.447+0000 7fc670fba700 1 -- 172.21.15.8:0/4020792865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc66c0f6530 msgr2=0x7fc66c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.447+0000 7fc670fba700 1 --2- 172.21.15.8:0/4020792865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc66c0f6530 0x7fc66c0f6950 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fc65c004660 tx=0x7fc65c009b30).stop 2023-10-18T21:12:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.447+0000 7fc670fba700 1 -- 172.21.15.8:0/4020792865 shutdown_connections 2023-10-18T21:12:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.447+0000 7fc670fba700 1 --2- 172.21.15.8:0/4020792865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c0f77d0 0x7fc66c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:08.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.447+0000 7fc670fba700 1 --2- 172.21.15.8:0/4020792865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc66c0f6530 0x7fc66c0f6950 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:08.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.447+0000 7fc670fba700 1 -- 172.21.15.8:0/4020792865 >> 172.21.15.8:0/4020792865 conn(0x7fc66c0f1c90 msgr2=0x7fc66c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:08.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.448+0000 7fc670fba700 1 -- 172.21.15.8:0/4020792865 shutdown_connections 2023-10-18T21:12:08.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.448+0000 7fc670fba700 1 -- 172.21.15.8:0/4020792865 wait complete. 2023-10-18T21:12:08.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.448+0000 7fc670fba700 1 Processor -- start 2023-10-18T21:12:08.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.449+0000 7fc670fba700 1 -- start start 2023-10-18T21:12:08.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.449+0000 7fc670fba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc66c0f6530 0x7fc66c108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:08.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.449+0000 7fc670fba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c0f77d0 0x7fc66c1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:08.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.449+0000 7fc670fba700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c109a60 con 0x7fc66c0f6530 2023-10-18T21:12:08.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.449+0000 7fc670fba700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c109ba0 con 0x7fc66c0f77d0 2023-10-18T21:12:08.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.449+0000 7fc66b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc66c0f6530 0x7fc66c108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:08.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.449+0000 7fc66b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc66c0f6530 0x7fc66c108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43116/0 (socket says 172.21.15.8:43116) 2023-10-18T21:12:08.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.449+0000 7fc66b7fe700 1 -- 172.21.15.8:0/318108019 learned_addr learned my addr 172.21.15.8:0/318108019 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:08.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.449+0000 7fc66affd700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c0f77d0 0x7fc66c1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:08.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.450+0000 7fc66b7fe700 1 -- 172.21.15.8:0/318108019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c0f77d0 msgr2=0x7fc66c1094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:08.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.450+0000 7fc66b7fe700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c0f77d0 0x7fc66c1094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:08.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.450+0000 7fc66b7fe700 1 -- 172.21.15.8:0/318108019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c005040 con 0x7fc66c0f6530 2023-10-18T21:12:08.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.450+0000 7fc66affd700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c0f77d0 0x7fc66c1094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:12:08.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.450+0000 7fc66b7fe700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc66c0f6530 0x7fc66c108fc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fc65c007a60 tx=0x7fc65c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:08.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.450+0000 7fc653fff700 1 -- 172.21.15.8:0/318108019 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc65c018070 con 0x7fc66c0f6530 2023-10-18T21:12:08.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.450+0000 7fc653fff700 1 -- 172.21.15.8:0/318108019 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc65c009630 con 0x7fc66c0f6530 2023-10-18T21:12:08.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.450+0000 7fc670fba700 1 -- 172.21.15.8:0/318108019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66c10a4e0 con 0x7fc66c0f6530 2023-10-18T21:12:08.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.450+0000 7fc653fff700 1 -- 172.21.15.8:0/318108019 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc65c01c540 con 0x7fc66c0f6530 2023-10-18T21:12:08.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.450+0000 7fc670fba700 1 -- 172.21.15.8:0/318108019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66c10aa40 con 0x7fc66c0f6530 2023-10-18T21:12:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.451+0000 7fc670fba700 1 -- 172.21.15.8:0/318108019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66c045ad0 con 0x7fc66c0f6530 2023-10-18T21:12:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.452+0000 7fc653fff700 1 -- 172.21.15.8:0/318108019 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc65c01d420 con 0x7fc66c0f6530 2023-10-18T21:12:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.453+0000 7fc653fff700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc654060f70 0x7fc654063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:08.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.453+0000 7fc653fff700 1 -- 172.21.15.8:0/318108019 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc65c07e600 con 0x7fc66c0f6530 2023-10-18T21:12:08.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.453+0000 7fc66affd700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc654060f70 0x7fc654063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:08.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.454+0000 7fc66affd700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc654060f70 0x7fc654063430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc660009740 tx=0x7fc660009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:08.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.458+0000 7fc653fff700 1 -- 172.21.15.8:0/318108019 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc65c051d20 con 0x7fc66c0f6530 2023-10-18T21:12:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.661+0000 7fc670fba700 1 -- 172.21.15.8:0/318108019 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc66c0fedd0 con 0x7fc654060f70 2023-10-18T21:12:08.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.662+0000 7fc653fff700 1 -- 172.21.15.8:0/318108019 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc66c0fedd0 con 0x7fc654060f70 2023-10-18T21:12:08.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 -- 172.21.15.8:0/318108019 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc654060f70 msgr2=0x7fc654063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:08.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc654060f70 0x7fc654063430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc660009740 tx=0x7fc660009be0).stop 2023-10-18T21:12:08.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 -- 172.21.15.8:0/318108019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc66c0f6530 msgr2=0x7fc66c108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:08.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc66c0f6530 0x7fc66c108fc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fc65c007a60 tx=0x7fc65c009b30).stop 2023-10-18T21:12:08.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 -- 172.21.15.8:0/318108019 shutdown_connections 2023-10-18T21:12:08.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc654060f70 0x7fc654063430 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:08.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc66c0f6530 0x7fc66c108fc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:08.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 --2- 172.21.15.8:0/318108019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c0f77d0 0x7fc66c1094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:08.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 -- 172.21.15.8:0/318108019 >> 172.21.15.8:0/318108019 conn(0x7fc66c0f1c90 msgr2=0x7fc66c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:08.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 -- 172.21.15.8:0/318108019 shutdown_connections 2023-10-18T21:12:08.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.664+0000 7fc670fba700 1 -- 172.21.15.8:0/318108019 wait complete. 2023-10-18T21:12:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:06.760842+0000 mgr.smithi008.flmjzp (mgr.14640) 799 : cluster [DBG] pgmap v566: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:08.681 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:12:08.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:06.760842+0000 mgr.smithi008.flmjzp (mgr.14640) 799 : cluster [DBG] pgmap v566: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:08.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.804+0000 7fd99ed9d700 1 -- 172.21.15.8:0/1705627223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9980f6530 msgr2=0x7fd9980f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:08.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.804+0000 7fd99ed9d700 1 --2- 172.21.15.8:0/1705627223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9980f6530 0x7fd9980f6950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fd994004660 tx=0x7fd994009b30).stop 2023-10-18T21:12:08.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.804+0000 7fd99ed9d700 1 -- 172.21.15.8:0/1705627223 shutdown_connections 2023-10-18T21:12:08.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.805+0000 7fd99ed9d700 1 --2- 172.21.15.8:0/1705627223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9980f77d0 0x7fd9980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:12:08.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.805+0000 7fd99ed9d700 1 --2- 172.21.15.8:0/1705627223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9980f6530 0x7fd9980f6950 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:08.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.805+0000 7fd99ed9d700 1 -- 172.21.15.8:0/1705627223 >> 172.21.15.8:0/1705627223 conn(0x7fd9980f1c90 msgr2=0x7fd9980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:08.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.805+0000 7fd99ed9d700 1 -- 172.21.15.8:0/1705627223 shutdown_connections 2023-10-18T21:12:08.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.805+0000 7fd99ed9d700 1 -- 172.21.15.8:0/1705627223 wait complete. 2023-10-18T21:12:08.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.805+0000 7fd99ed9d700 1 Processor -- start 2023-10-18T21:12:08.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.806+0000 7fd99ed9d700 1 -- start start 2023-10-18T21:12:08.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.806+0000 7fd99ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9980f6530 0x7fd998106e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:08.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.806+0000 7fd99ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9980f77d0 0x7fd998107330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:08.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.806+0000 7fd99ed9d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981079c0 con 0x7fd9980f6530 2023-10-18T21:12:08.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.806+0000 7fd99ed9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd998108140 con 0x7fd9980f77d0 2023-10-18T21:12:08.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.806+0000 7fd99dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9980f6530 0x7fd998106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:08.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.806+0000 7fd99dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9980f6530 0x7fd998106e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43140/0 (socket says 172.21.15.8:43140) 2023-10-18T21:12:08.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.806+0000 7fd99dd9b700 1 -- 172.21.15.8:0/242061838 learned_addr learned my addr 172.21.15.8:0/242061838 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:08.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.806+0000 7fd99d59a700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9980f77d0 0x7fd998107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:08.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.807+0000 7fd99dd9b700 1 -- 172.21.15.8:0/242061838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9980f77d0 msgr2=0x7fd998107330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:08.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.807+0000 7fd99dd9b700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9980f77d0 0x7fd998107330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:08.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.807+0000 7fd99dd9b700 1 -- 172.21.15.8:0/242061838 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd994005040 con 0x7fd9980f6530 2023-10-18T21:12:08.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.807+0000 7fd99dd9b700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9980f6530 0x7fd998106e40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fd994007a70 tx=0x7fd994009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:08.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.807+0000 7fd98e7fc700 1 -- 172.21.15.8:0/242061838 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd994018070 con 0x7fd9980f6530 2023-10-18T21:12:08.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.807+0000 7fd98e7fc700 1 -- 172.21.15.8:0/242061838 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd99401d8e0 con 0x7fd9980f6530 2023-10-18T21:12:08.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.807+0000 7fd99ed9d700 1 -- 172.21.15.8:0/242061838 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd998108360 con 0x7fd9980f6530 2023-10-18T21:12:08.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.807+0000 7fd98e7fc700 1 -- 172.21.15.8:0/242061838 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd99401c5c0 con 0x7fd9980f6530 2023-10-18T21:12:08.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.807+0000 7fd99ed9d700 1 -- 172.21.15.8:0/242061838 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9981088c0 con 0x7fd9980f6530 2023-10-18T21:12:08.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.808+0000 7fd99ed9d700 1 -- 172.21.15.8:0/242061838 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd998045ad0 con 0x7fd9980f6530 2023-10-18T21:12:08.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.809+0000 7fd98e7fc700 1 -- 172.21.15.8:0/242061838 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd99401da50 con 0x7fd9980f6530 2023-10-18T21:12:08.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.810+0000 7fd98e7fc700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd984060f70 0x7fd984063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:08.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.810+0000 7fd98e7fc700 1 -- 172.21.15.8:0/242061838 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd99407e7e0 con 0x7fd9980f6530 2023-10-18T21:12:08.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.810+0000 7fd99d59a700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd984060f70 0x7fd984063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:08.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.811+0000 7fd99d59a700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd984060f70 0x7fd984063430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fd988006fd0 tx=0x7fd988008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:08.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:08.814+0000 7fd98e7fc700 1 -- 172.21.15.8:0/242061838 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd99404e450 con 0x7fd9980f6530 2023-10-18T21:12:09.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.012+0000 7fd99ed9d700 1 -- 172.21.15.8:0/242061838 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9980feeb0 con 0x7fd984060f70 2023-10-18T21:12:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.013+0000 7fd98e7fc700 1 -- 172.21.15.8:0/242061838 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd9980feeb0 con 0x7fd984060f70 2023-10-18T21:12:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.015+0000 7fd99ed9d700 1 -- 172.21.15.8:0/242061838 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd984060f70 msgr2=0x7fd984063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.015+0000 7fd99ed9d700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd984060f70 0x7fd984063430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fd988006fd0 tx=0x7fd988008040).stop 2023-10-18T21:12:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.015+0000 7fd99ed9d700 1 -- 172.21.15.8:0/242061838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9980f6530 msgr2=0x7fd998106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.015+0000 7fd99ed9d700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9980f6530 0x7fd998106e40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fd994007a70 tx=0x7fd994009b30).stop 2023-10-18T21:12:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.015+0000 7fd99ed9d700 1 -- 172.21.15.8:0/242061838 shutdown_connections 2023-10-18T21:12:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.015+0000 7fd99ed9d700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd984060f70 0x7fd984063430 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.015+0000 7fd99ed9d700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9980f6530 0x7fd998106e40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.015+0000 7fd99ed9d700 1 --2- 172.21.15.8:0/242061838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9980f77d0 0x7fd998107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.015+0000 7fd99ed9d700 1 -- 172.21.15.8:0/242061838 >> 172.21.15.8:0/242061838 conn(0x7fd9980f1c90 msgr2=0x7fd9980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.015+0000 7fd99ed9d700 1 -- 172.21.15.8:0/242061838 shutdown_connections 2023-10-18T21:12:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.016+0000 7fd99ed9d700 1 -- 172.21.15.8:0/242061838 wait complete. 2023-10-18T21:12:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.152+0000 7f10c648d700 1 -- 172.21.15.8:0/3681914173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10c00f6530 msgr2=0x7f10c00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.152+0000 7f10c648d700 1 --2- 172.21.15.8:0/3681914173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10c00f6530 0x7f10c00f6950 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f10bc0045a0 tx=0x7f10bc009b30).stop 2023-10-18T21:12:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.152+0000 7f10c648d700 1 -- 172.21.15.8:0/3681914173 shutdown_connections 2023-10-18T21:12:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.152+0000 7f10c648d700 1 --2- 172.21.15.8:0/3681914173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c00f77d0 0x7f10c00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.152+0000 7f10c648d700 1 --2- 172.21.15.8:0/3681914173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10c00f6530 0x7f10c00f6950 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.152+0000 7f10c648d700 1 -- 172.21.15.8:0/3681914173 >> 172.21.15.8:0/3681914173 conn(0x7f10c00f1c90 msgr2=0x7f10c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.152+0000 7f10c648d700 1 -- 172.21.15.8:0/3681914173 shutdown_connections 2023-10-18T21:12:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.152+0000 7f10c648d700 1 -- 172.21.15.8:0/3681914173 wait complete. 2023-10-18T21:12:09.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.153+0000 7f10c648d700 1 Processor -- start 2023-10-18T21:12:09.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.153+0000 7f10c648d700 1 -- start start 2023-10-18T21:12:09.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c648d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c00f6530 0x7f10c0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:09.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c648d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10c00f77d0 0x7f10c0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:09.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c648d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c0109a00 con 0x7f10c00f77d0 2023-10-18T21:12:09.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c648d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c0109b40 con 0x7f10c00f6530 2023-10-18T21:12:09.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c4c8a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10c00f77d0 0x7f10c0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:09.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c4c8a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10c00f77d0 0x7f10c0109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43158/0 (socket says 172.21.15.8:43158) 2023-10-18T21:12:09.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c4c8a700 1 -- 172.21.15.8:0/1473112153 learned_addr learned my addr 172.21.15.8:0/1473112153 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:09.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c548b700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c00f6530 0x7f10c0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:09.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c4c8a700 1 -- 172.21.15.8:0/1473112153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c00f6530 msgr2=0x7f10c0108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c4c8a700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c00f6530 0x7f10c0108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.154+0000 7f10c4c8a700 1 -- 172.21.15.8:0/1473112153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b0005040 con 0x7f10c00f77d0 2023-10-18T21:12:09.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.155+0000 7f10c4c8a700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10c00f77d0 0x7f10c0109450 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f10b0004960 tx=0x7f10b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:09.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.155+0000 7f10b5ffb700 1 -- 172.21.15.8:0/1473112153 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b0007e50 con 0x7f10c00f77d0 2023-10-18T21:12:09.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.155+0000 7f10b5ffb700 1 -- 172.21.15.8:0/1473112153 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f10b000f040 con 0x7f10c00f77d0 2023-10-18T21:12:09.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.155+0000 7f10b5ffb700 1 -- 172.21.15.8:0/1473112153 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b0014a40 con 0x7f10c00f77d0 2023-10-18T21:12:09.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.155+0000 7f10c648d700 1 -- 172.21.15.8:0/1473112153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc005040 con 0x7f10c00f77d0 2023-10-18T21:12:09.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.155+0000 7f10c648d700 1 -- 172.21.15.8:0/1473112153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c010a890 con 0x7f10c00f77d0 2023-10-18T21:12:09.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.156+0000 7f10c648d700 1 -- 172.21.15.8:0/1473112153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c0045ad0 con 0x7f10c00f77d0 2023-10-18T21:12:09.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.157+0000 7f10b5ffb700 1 -- 172.21.15.8:0/1473112153 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f10b0014ba0 con 0x7f10c00f77d0 2023-10-18T21:12:09.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.158+0000 7f10b5ffb700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10ac060f70 0x7f10ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:09.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.158+0000 7f10b5ffb700 1 -- 172.21.15.8:0/1473112153 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f10b007cb00 con 0x7f10c00f77d0 2023-10-18T21:12:09.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.158+0000 7f10c548b700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10ac060f70 0x7f10ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:09.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.158+0000 7f10c548b700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10ac060f70 0x7f10ac063430 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f10bc009d60 tx=0x7f10bc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:09.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.162+0000 7f10b5ffb700 1 -- 172.21.15.8:0/1473112153 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f10b0049f20 con 0x7f10c00f77d0 2023-10-18T21:12:09.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.351+0000 7f10c648d700 1 -- 172.21.15.8:0/1473112153 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10c00fc150 con 0x7f10ac060f70 2023-10-18T21:12:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.361+0000 7f10b5ffb700 1 -- 172.21.15.8:0/1473112153 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f10c00fc150 con 0x7f10ac060f70 2023-10-18T21:12:09.362 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:12:09.363 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (18m) 7m ago 20m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:12:09.363 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (12m) 7m ago 20m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:12:09.363 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (12m) 4m ago 19m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:12:09.363 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (18m) 7m ago 19m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:12:09.364 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (7m) 7m ago 16m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:12:09.364 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 16m - - 2023-10-18T21:12:09.364 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (5m) 4m ago 16m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:12:09.364 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (4m) 4m ago 16m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:12:09.365 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (13m) 7m ago 21m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:12:09.365 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (13m) 4m ago 19m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:12:09.365 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (13m) 7m ago 21m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:12:09.365 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (12m) 4m ago 19m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:12:09.365 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (19m) 7m ago 19m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:12:09.366 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (19m) 4m ago 19m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:12:09.366 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (12m) 7m ago 18m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:12:09.366 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (10m) 7m ago 18m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:12:09.366 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (9m) 7m ago 18m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:12:09.366 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (9m) 4m ago 17m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:12:09.367 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (8m) 4m ago 17m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:12:09.367 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (8m) 4m ago 17m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:12:09.367 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (14m) 7m ago 19m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:12:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 -- 172.21.15.8:0/1473112153 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10ac060f70 msgr2=0x7f10ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10ac060f70 0x7f10ac063430 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f10bc009d60 tx=0x7f10bc00b040).stop 2023-10-18T21:12:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 -- 172.21.15.8:0/1473112153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10c00f77d0 msgr2=0x7f10c0109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10c00f77d0 0x7f10c0109450 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f10b0004960 tx=0x7f10b0009b30).stop 2023-10-18T21:12:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 -- 172.21.15.8:0/1473112153 shutdown_connections 2023-10-18T21:12:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10ac060f70 0x7f10ac063430 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c00f6530 0x7f10c0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 --2- 172.21.15.8:0/1473112153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10c00f77d0 0x7f10c0109450 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 -- 172.21.15.8:0/1473112153 >> 172.21.15.8:0/1473112153 conn(0x7f10c00f1c90 msgr2=0x7f10c006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:09.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 -- 172.21.15.8:0/1473112153 shutdown_connections 2023-10-18T21:12:09.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.363+0000 7f10c648d700 1 -- 172.21.15.8:0/1473112153 wait complete. 2023-10-18T21:12:09.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.499+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1367926890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f00f6530 msgr2=0x7fb7f00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.499+0000 7fb7f6c6c700 1 --2- 172.21.15.8:0/1367926890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f00f6530 0x7fb7f00f6950 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fb7ec004660 tx=0x7fb7ec009b30).stop 2023-10-18T21:12:09.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.499+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1367926890 shutdown_connections 2023-10-18T21:12:09.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.499+0000 7fb7f6c6c700 1 --2- 172.21.15.8:0/1367926890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7f00f77d0 0x7fb7f00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.499+0000 7fb7f6c6c700 1 --2- 172.21.15.8:0/1367926890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f00f6530 0x7fb7f00f6950 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.499+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1367926890 >> 172.21.15.8:0/1367926890 conn(0x7fb7f00f1c90 msgr2=0x7fb7f00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:09.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.499+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1367926890 shutdown_connections 2023-10-18T21:12:09.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.499+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1367926890 wait complete. 2023-10-18T21:12:09.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.500+0000 7fb7f6c6c700 1 Processor -- start 2023-10-18T21:12:09.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.500+0000 7fb7f6c6c700 1 -- start start 2023-10-18T21:12:09.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.500+0000 7fb7f6c6c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f00f6530 0x7fb7f0108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:09.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.500+0000 7fb7f6c6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7f00f77d0 0x7fb7f01094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:09.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.500+0000 7fb7f6c6c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0109a50 con 0x7fb7f00f6530 2023-10-18T21:12:09.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.500+0000 7fb7f6c6c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0109b90 con 0x7fb7f00f77d0 2023-10-18T21:12:09.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.501+0000 7fb7f5c6a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f00f6530 0x7fb7f0108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:09.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.501+0000 7fb7f5c6a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f00f6530 0x7fb7f0108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43188/0 (socket says 172.21.15.8:43188) 2023-10-18T21:12:09.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.501+0000 7fb7f5c6a700 1 -- 172.21.15.8:0/1913195232 learned_addr learned my addr 172.21.15.8:0/1913195232 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:09.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.501+0000 7fb7f5469700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7f00f77d0 0x7fb7f01094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:09.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.501+0000 7fb7f5c6a700 1 -- 172.21.15.8:0/1913195232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7f00f77d0 msgr2=0x7fb7f01094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.501+0000 7fb7f5c6a700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7f00f77d0 0x7fb7f01094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.501+0000 7fb7f5c6a700 1 -- 172.21.15.8:0/1913195232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec005040 con 0x7fb7f00f6530 2023-10-18T21:12:09.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.501+0000 7fb7f5469700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7f00f77d0 0x7fb7f01094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:12:09.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.501+0000 7fb7f5c6a700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f00f6530 0x7fb7f0108fb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fb7ec004e30 tx=0x7fb7ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:09.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.502+0000 7fb7e67fc700 1 -- 172.21.15.8:0/1913195232 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7ec018070 con 0x7fb7f00f6530 2023-10-18T21:12:09.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.502+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1913195232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f010a4d0 con 0x7fb7f00f6530 2023-10-18T21:12:09.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.502+0000 7fb7e67fc700 1 -- 172.21.15.8:0/1913195232 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb7ec009630 con 0x7fb7f00f6530 2023-10-18T21:12:09.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.502+0000 7fb7e67fc700 1 -- 172.21.15.8:0/1913195232 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7ec01c3c0 con 0x7fb7f00f6530 2023-10-18T21:12:09.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.502+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1913195232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f010aa30 con 0x7fb7f00f6530 2023-10-18T21:12:09.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.503+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1913195232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f0045ad0 con 0x7fb7f00f6530 2023-10-18T21:12:09.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.504+0000 7fb7e67fc700 1 -- 172.21.15.8:0/1913195232 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb7ec01d420 con 0x7fb7f00f6530 2023-10-18T21:12:09.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.505+0000 7fb7e67fc700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7dc060f70 0x7fb7dc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:09.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.505+0000 7fb7e67fc700 1 -- 172.21.15.8:0/1913195232 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb7ec07e5f0 con 0x7fb7f00f6530 2023-10-18T21:12:09.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.505+0000 7fb7f5469700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7dc060f70 0x7fb7dc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:09.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.505+0000 7fb7f5469700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7dc060f70 0x7fb7dc063430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fb7e0009fd0 tx=0x7fb7e000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:09.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.509+0000 7fb7e67fc700 1 -- 172.21.15.8:0/1913195232 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb7ec051d40 con 0x7fb7f00f6530 2023-10-18T21:12:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:08.662381+0000 mgr.smithi008.flmjzp (mgr.14640) 800 : audit [DBG] from='client.34860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:09.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:08.662381+0000 mgr.smithi008.flmjzp (mgr.14640) 800 : audit [DBG] from='client.34860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:09.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.761+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1913195232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb7f0027a00 con 0x7fb7f00f6530 2023-10-18T21:12:09.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.761+0000 7fb7e67fc700 1 -- 172.21.15.8:0/1913195232 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fb7ec051930 con 0x7fb7f00f6530 2023-10-18T21:12:09.763 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:12:09.763 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:12:09.763 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:12:09.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:12:09.763 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:12:09.764 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:12:09.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:12:09.764 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:12:09.764 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:12:09.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:12:09.765 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:12:09.765 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:12:09.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:12:09.765 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:12:09.765 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:12:09.766 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:12:09.766 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:12:09.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.763+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1913195232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7dc060f70 msgr2=0x7fb7dc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.763+0000 7fb7f6c6c700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7dc060f70 0x7fb7dc063430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fb7e0009fd0 tx=0x7fb7e000b040).stop 2023-10-18T21:12:09.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.763+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1913195232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f00f6530 msgr2=0x7fb7f0108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.763+0000 7fb7f6c6c700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f00f6530 0x7fb7f0108fb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fb7ec004e30 tx=0x7fb7ec009b30).stop 2023-10-18T21:12:09.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.764+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1913195232 shutdown_connections 2023-10-18T21:12:09.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.764+0000 7fb7f6c6c700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7dc060f70 0x7fb7dc063430 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.764+0000 7fb7f6c6c700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f00f6530 0x7fb7f0108fb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.764+0000 7fb7f6c6c700 1 --2- 172.21.15.8:0/1913195232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7f00f77d0 0x7fb7f01094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.764+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1913195232 >> 172.21.15.8:0/1913195232 conn(0x7fb7f00f1c90 msgr2=0x7fb7f006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:09.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.764+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1913195232 shutdown_connections 2023-10-18T21:12:09.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.764+0000 7fb7f6c6c700 1 -- 172.21.15.8:0/1913195232 wait complete. 2023-10-18T21:12:09.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.900+0000 7f0d6ffff700 1 -- 172.21.15.8:0/2678389863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d700f6530 msgr2=0x7f0d700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.900+0000 7f0d6ffff700 1 --2- 172.21.15.8:0/2678389863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d700f6530 0x7f0d700f6950 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f0d60004660 tx=0x7f0d60009b30).stop 2023-10-18T21:12:09.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.900+0000 7f0d6ffff700 1 -- 172.21.15.8:0/2678389863 shutdown_connections 2023-10-18T21:12:09.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.900+0000 7f0d6ffff700 1 --2- 172.21.15.8:0/2678389863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d700f77d0 0x7f0d700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:12:09.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.900+0000 7f0d6ffff700 1 --2- 172.21.15.8:0/2678389863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d700f6530 0x7f0d700f6950 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.900+0000 7f0d6ffff700 1 -- 172.21.15.8:0/2678389863 >> 172.21.15.8:0/2678389863 conn(0x7f0d700f1c90 msgr2=0x7f0d700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:09.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.900+0000 7f0d6ffff700 1 -- 172.21.15.8:0/2678389863 shutdown_connections 2023-10-18T21:12:09.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.901+0000 7f0d6ffff700 1 -- 172.21.15.8:0/2678389863 wait complete. 2023-10-18T21:12:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.902+0000 7f0d6ffff700 1 Processor -- start 2023-10-18T21:12:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.902+0000 7f0d6ffff700 1 -- start start 2023-10-18T21:12:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.902+0000 7f0d6ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d700f6530 0x7f0d70106e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.902+0000 7f0d6ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d700f77d0 0x7f0d70107330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.902+0000 7f0d6ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d701079c0 con 0x7f0d700f6530 2023-10-18T21:12:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.902+0000 7f0d6ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70108140 con 0x7f0d700f77d0 2023-10-18T21:12:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.903+0000 7f0d6effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d700f6530 0x7f0d70106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.903+0000 7f0d6effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d700f6530 0x7f0d70106e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43206/0 (socket says 172.21.15.8:43206) 2023-10-18T21:12:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.903+0000 7f0d6effd700 1 -- 172.21.15.8:0/1212312653 learned_addr learned my addr 172.21.15.8:0/1212312653 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.903+0000 7f0d6effd700 1 -- 172.21.15.8:0/1212312653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d700f77d0 msgr2=0x7f0d70107330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.903+0000 7f0d6e7fc700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d700f77d0 0x7f0d70107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.903+0000 7f0d6effd700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d700f77d0 0x7f0d70107330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.903+0000 7f0d6effd700 1 -- 172.21.15.8:0/1212312653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60005040 con 0x7f0d700f6530 2023-10-18T21:12:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.903+0000 7f0d6e7fc700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d700f77d0 0x7f0d70107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:12:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.903+0000 7f0d6effd700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d700f6530 0x7f0d70106e40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f0d60009f50 tx=0x7f0d60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.904+0000 7f0d577fe700 1 -- 172.21.15.8:0/1212312653 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d60018070 con 0x7f0d700f6530 2023-10-18T21:12:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.904+0000 7f0d6ffff700 1 -- 172.21.15.8:0/1212312653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d70108360 con 0x7f0d700f6530 2023-10-18T21:12:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.904+0000 7f0d577fe700 1 -- 172.21.15.8:0/1212312653 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0d6001d8e0 con 0x7f0d700f6530 2023-10-18T21:12:09.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.904+0000 7f0d577fe700 1 -- 172.21.15.8:0/1212312653 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d6001c4c0 con 0x7f0d700f6530 2023-10-18T21:12:09.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.904+0000 7f0d6ffff700 1 -- 172.21.15.8:0/1212312653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d701088c0 con 0x7f0d700f6530 2023-10-18T21:12:09.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.905+0000 7f0d6ffff700 1 -- 172.21.15.8:0/1212312653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d70045ad0 con 0x7f0d700f6530 2023-10-18T21:12:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.906+0000 7f0d577fe700 1 -- 172.21.15.8:0/1212312653 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0d6001d420 con 0x7f0d700f6530 2023-10-18T21:12:09.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.906+0000 7f0d577fe700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d58060f70 0x7f0d58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.907+0000 7f0d577fe700 1 -- 172.21.15.8:0/1212312653 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0d6007e7e0 con 0x7f0d700f6530 2023-10-18T21:12:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.907+0000 7f0d6e7fc700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d58060f70 0x7f0d58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:09.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.907+0000 7f0d6e7fc700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d58060f70 0x7f0d58063430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0d6400a7e0 tx=0x7f0d64008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:09.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:09.911+0000 7f0d577fe700 1 -- 172.21.15.8:0/1212312653 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0d6004e450 con 0x7f0d700f6530 2023-10-18T21:12:10.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.136+0000 7f0d6ffff700 1 -- 172.21.15.8:0/1212312653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0d700fee10 con 0x7f0d700f6530 2023-10-18T21:12:10.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.137+0000 7f0d577fe700 1 -- 172.21.15.8:0/1212312653 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f0d60051a70 con 0x7f0d700f6530 2023-10-18T21:12:10.139 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:12:10.139 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:12:10.139 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:12:10.140 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:12:10.140 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:12:10.140 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:12:10.140 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:12:10.140 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:12:10.141 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:12:10.141 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:12:10.141 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:12:10.141 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:12:10.141 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:12:10.141 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:12:10.142 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:12:10.142 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:12:10.142 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:12:10.142 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:12:10.142 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:12:10.143 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:12:10.143 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:12:10.143 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:12:10.143 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:12:10.143 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:12:10.144 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:12:10.144 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:12:10.144 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:12:10.144 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:12:10.144 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:12:10.145 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:12:10.145 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:12:10.145 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:12:10.145 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:12:10.145 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:12:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 -- 172.21.15.8:0/1212312653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d58060f70 msgr2=0x7f0d58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d58060f70 0x7f0d58063430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0d6400a7e0 tx=0x7f0d64008040).stop 2023-10-18T21:12:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 -- 172.21.15.8:0/1212312653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d700f6530 msgr2=0x7f0d70106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d700f6530 0x7f0d70106e40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f0d60009f50 tx=0x7f0d60009b30).stop 2023-10-18T21:12:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 -- 172.21.15.8:0/1212312653 shutdown_connections 2023-10-18T21:12:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d58060f70 0x7f0d58063430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d700f6530 0x7f0d70106e40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 --2- 172.21.15.8:0/1212312653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d700f77d0 0x7f0d70107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 -- 172.21.15.8:0/1212312653 >> 172.21.15.8:0/1212312653 conn(0x7f0d700f1c90 msgr2=0x7f0d700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 -- 172.21.15.8:0/1212312653 shutdown_connections 2023-10-18T21:12:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.139+0000 7f0d6ffff700 1 -- 172.21.15.8:0/1212312653 wait complete. 2023-10-18T21:12:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:12:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.277+0000 7f2fa8891700 1 -- 172.21.15.8:0/4224734876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa406b9c0 msgr2=0x7f2fa4069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.277+0000 7f2fa8891700 1 --2- 172.21.15.8:0/4224734876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa406b9c0 0x7f2fa4069ec0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f2f94004660 tx=0x7f2f94009b30).stop 2023-10-18T21:12:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.277+0000 7f2fa8891700 1 -- 172.21.15.8:0/4224734876 shutdown_connections 2023-10-18T21:12:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.277+0000 7f2fa8891700 1 --2- 172.21.15.8:0/4224734876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa406a3b0 0x7f2fa406a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.277+0000 7f2fa8891700 1 --2- 172.21.15.8:0/4224734876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa406b9c0 0x7f2fa4069ec0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.277+0000 7f2fa8891700 1 -- 172.21.15.8:0/4224734876 >> 172.21.15.8:0/4224734876 conn(0x7f2fa40f1c90 msgr2=0x7f2fa40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.277+0000 7f2fa8891700 1 -- 172.21.15.8:0/4224734876 shutdown_connections 2023-10-18T21:12:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.277+0000 7f2fa8891700 1 -- 172.21.15.8:0/4224734876 wait complete. 2023-10-18T21:12:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.278+0000 7f2fa8891700 1 Processor -- start 2023-10-18T21:12:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.278+0000 7f2fa8891700 1 -- start start 2023-10-18T21:12:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.278+0000 7f2fa8891700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa406a3b0 0x7f2fa4108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:10.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.278+0000 7f2fa8891700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa406b9c0 0x7f2fa4109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:10.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.278+0000 7f2fa8891700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa41099e0 con 0x7f2fa406a3b0 2023-10-18T21:12:10.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.278+0000 7f2fa8891700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4109b20 con 0x7f2fa406b9c0 2023-10-18T21:12:10.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.279+0000 7f2fa2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa406a3b0 0x7f2fa4108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:10.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.279+0000 7f2fa2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa406a3b0 0x7f2fa4108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43230/0 (socket says 172.21.15.8:43230) 2023-10-18T21:12:10.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.279+0000 7f2fa2d9d700 1 -- 172.21.15.8:0/169411966 learned_addr learned my addr 172.21.15.8:0/169411966 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:10.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.279+0000 7f2fa259c700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa406b9c0 0x7f2fa4109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:10.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.279+0000 7f2fa2d9d700 1 -- 172.21.15.8:0/169411966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa406b9c0 msgr2=0x7f2fa4109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:10.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.279+0000 7f2fa2d9d700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa406b9c0 0x7f2fa4109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:10.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.279+0000 7f2fa2d9d700 1 -- 172.21.15.8:0/169411966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f94005040 con 0x7f2fa406a3b0 2023-10-18T21:12:10.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.279+0000 7f2fa2d9d700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa406a3b0 0x7f2fa4108f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f2f94004320 tx=0x7f2f9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.280+0000 7f2f8b7fe700 1 -- 172.21.15.8:0/169411966 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f94019070 con 0x7f2fa406a3b0 2023-10-18T21:12:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.280+0000 7f2fa8891700 1 -- 172.21.15.8:0/169411966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa410a460 con 0x7f2fa406a3b0 2023-10-18T21:12:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.280+0000 7f2f8b7fe700 1 -- 172.21.15.8:0/169411966 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2f9401e420 con 0x7f2fa406a3b0 2023-10-18T21:12:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.280+0000 7f2f8b7fe700 1 -- 172.21.15.8:0/169411966 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f94014660 con 0x7f2fa406a3b0 2023-10-18T21:12:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.280+0000 7f2fa8891700 1 -- 172.21.15.8:0/169411966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa410a940 con 0x7f2fa406a3b0 2023-10-18T21:12:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.281+0000 7f2fa8891700 1 -- 172.21.15.8:0/169411966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa4045ad0 con 0x7f2fa406a3b0 2023-10-18T21:12:10.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.282+0000 7f2f8b7fe700 1 -- 172.21.15.8:0/169411966 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2f9401e590 con 0x7f2fa406a3b0 2023-10-18T21:12:10.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.282+0000 7f2f8b7fe700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f8c060f70 0x7f2f8c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:10.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.283+0000 7f2f8b7fe700 1 -- 172.21.15.8:0/169411966 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2f9407deb0 con 0x7f2fa406a3b0 2023-10-18T21:12:10.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.283+0000 7f2fa259c700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f8c060f70 0x7f2f8c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:10.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.283+0000 7f2fa259c700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f8c060f70 0x7f2f8c063430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f2f98007f80 tx=0x7f2f9800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:10.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.287+0000 7f2f8b7fe700 1 -- 172.21.15.8:0/169411966 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2f94051430 con 0x7f2fa406a3b0 2023-10-18T21:12:10.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.488+0000 7f2fa8891700 1 -- 172.21.15.8:0/169411966 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fa4102f20 con 0x7f2f8c060f70 2023-10-18T21:12:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.489+0000 7f2f8b7fe700 1 -- 172.21.15.8:0/169411966 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2fa4102f20 con 0x7f2f8c060f70 2023-10-18T21:12:10.490 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:12:10.491 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:12:10.491 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:12:10.491 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:12:10.491 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:12:10.491 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:12:10.492 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:12:10.492 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:12:10.492 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:12:10.492 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:12:10.492 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:12:10.493 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:12:10.493 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:12:10.493 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:12:10.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.491+0000 7f2fa8891700 1 -- 172.21.15.8:0/169411966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f8c060f70 msgr2=0x7f2f8c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:10.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.491+0000 7f2fa8891700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f8c060f70 0x7f2f8c063430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f2f98007f80 tx=0x7f2f9800b040).stop 2023-10-18T21:12:10.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.491+0000 7f2fa8891700 1 -- 172.21.15.8:0/169411966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa406a3b0 msgr2=0x7f2fa4108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:10.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.491+0000 7f2fa8891700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa406a3b0 0x7f2fa4108f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f2f94004320 tx=0x7f2f9400b040).stop 2023-10-18T21:12:10.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.491+0000 7f2fa8891700 1 -- 172.21.15.8:0/169411966 shutdown_connections 2023-10-18T21:12:10.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.491+0000 7f2fa8891700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2f8c060f70 0x7f2f8c063430 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:10.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.491+0000 7f2fa8891700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa406a3b0 0x7f2fa4108f40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:10.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.491+0000 7f2fa8891700 1 --2- 172.21.15.8:0/169411966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa406b9c0 0x7f2fa4109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:10.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.491+0000 7f2fa8891700 1 -- 172.21.15.8:0/169411966 >> 172.21.15.8:0/169411966 conn(0x7f2fa40f1c90 msgr2=0x7f2fa40fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:10.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.491+0000 7f2fa8891700 1 -- 172.21.15.8:0/169411966 shutdown_connections 2023-10-18T21:12:10.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:10.492+0000 7f2fa8891700 1 -- 172.21.15.8:0/169411966 wait complete. 2023-10-18T21:12:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:08.761323+0000 mgr.smithi008.flmjzp (mgr.14640) 801 : cluster [DBG] pgmap v567: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:09.013486+0000 mgr.smithi008.flmjzp (mgr.14640) 802 : audit [DBG] from='client.34864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:09.353040+0000 mgr.smithi008.flmjzp (mgr.14640) 803 : audit [DBG] from='client.34868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:09.761996+0000 mon.smithi008 (mon.0) 1281 : audit [DBG] from='client.? 172.21.15.8:0/1913195232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:10.137667+0000 mon.smithi008 (mon.0) 1282 : audit [DBG] from='client.? 172.21.15.8:0/1212312653' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:12:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:08.761323+0000 mgr.smithi008.flmjzp (mgr.14640) 801 : cluster [DBG] pgmap v567: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:09.013486+0000 mgr.smithi008.flmjzp (mgr.14640) 802 : audit [DBG] from='client.34864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:09.353040+0000 mgr.smithi008.flmjzp (mgr.14640) 803 : audit [DBG] from='client.34868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:09.761996+0000 mon.smithi008 (mon.0) 1281 : audit [DBG] from='client.? 172.21.15.8:0/1913195232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:10.137667+0000 mon.smithi008 (mon.0) 1282 : audit [DBG] from='client.? 172.21.15.8:0/1212312653' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:12:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:10.489685+0000 mgr.smithi008.flmjzp (mgr.14640) 804 : audit [DBG] from='client.34880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:10.489685+0000 mgr.smithi008.flmjzp (mgr.14640) 804 : audit [DBG] from='client.34880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:10.761880+0000 mgr.smithi008.flmjzp (mgr.14640) 805 : cluster [DBG] pgmap v568: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:12.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:10.761880+0000 mgr.smithi008.flmjzp (mgr.14640) 805 : cluster [DBG] pgmap v568: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:13.537 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:12.788760+0000 mon.smithi008 (mon.0) 1283 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:13.537 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:12.790877+0000 mon.smithi008 (mon.0) 1284 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:13.538 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:12.791904+0000 mon.smithi008 (mon.0) 1285 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:13.538 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:12.798304+0000 mon.smithi008 (mon.0) 1286 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:13.538 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:12.804864+0000 mon.smithi008 (mon.0) 1287 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:13.538 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:12.807888+0000 mon.smithi008 (mon.0) 1288 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:13.538 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:12.809565+0000 mon.smithi008 (mon.0) 1289 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:13.539 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:12.811194+0000 mon.smithi008 (mon.0) 1290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:13.539 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:12.813132+0000 mon.smithi008 (mon.0) 1291 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:12.788760+0000 mon.smithi008 (mon.0) 1283 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:12.790877+0000 mon.smithi008 (mon.0) 1284 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:12.791904+0000 mon.smithi008 (mon.0) 1285 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:12.798304+0000 mon.smithi008 (mon.0) 1286 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:12.804864+0000 mon.smithi008 (mon.0) 1287 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:12.807888+0000 mon.smithi008 (mon.0) 1288 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:12.809565+0000 mon.smithi008 (mon.0) 1289 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:12.811194+0000 mon.smithi008 (mon.0) 1290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:12.813132+0000 mon.smithi008 (mon.0) 1291 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:12.762360+0000 mgr.smithi008.flmjzp (mgr.14640) 806 : cluster [DBG] pgmap v569: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:12.792827+0000 mgr.smithi008.flmjzp (mgr.14640) 807 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:12.793398+0000 mgr.smithi008.flmjzp (mgr.14640) 808 : cluster [DBG] pgmap v570: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:12.793623+0000 mgr.smithi008.flmjzp (mgr.14640) 809 : cluster [DBG] pgmap v571: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:12.815128+0000 mgr.smithi008.flmjzp (mgr.14640) 810 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:12.762360+0000 mgr.smithi008.flmjzp (mgr.14640) 806 : cluster [DBG] pgmap v569: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:12.792827+0000 mgr.smithi008.flmjzp (mgr.14640) 807 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:12.793398+0000 mgr.smithi008.flmjzp (mgr.14640) 808 : cluster [DBG] pgmap v570: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:12.793623+0000 mgr.smithi008.flmjzp (mgr.14640) 809 : cluster [DBG] pgmap v571: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:12.815128+0000 mgr.smithi008.flmjzp (mgr.14640) 810 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:14.794113+0000 mgr.smithi008.flmjzp (mgr.14640) 811 : cluster [DBG] pgmap v572: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:14.794113+0000 mgr.smithi008.flmjzp (mgr.14640) 811 : cluster [DBG] pgmap v572: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:16.794618+0000 mgr.smithi008.flmjzp (mgr.14640) 812 : cluster [DBG] pgmap v573: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:16.794618+0000 mgr.smithi008.flmjzp (mgr.14640) 812 : cluster [DBG] pgmap v573: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:18.795183+0000 mgr.smithi008.flmjzp (mgr.14640) 813 : cluster [DBG] pgmap v574: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:20.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:18.795183+0000 mgr.smithi008.flmjzp (mgr.14640) 813 : cluster [DBG] pgmap v574: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:20.795622+0000 mgr.smithi008.flmjzp (mgr.14640) 814 : cluster [DBG] pgmap v575: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:20.795622+0000 mgr.smithi008.flmjzp (mgr.14640) 814 : cluster [DBG] pgmap v575: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:22.820666+0000 mon.smithi008 (mon.0) 1292 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:22.822704+0000 mon.smithi008 (mon.0) 1293 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:22.823643+0000 mon.smithi008 (mon.0) 1294 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:22.830211+0000 mon.smithi008 (mon.0) 1295 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:22.836796+0000 mon.smithi008 (mon.0) 1296 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:22.839979+0000 mon.smithi008 (mon.0) 1297 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:22.841598+0000 mon.smithi008 (mon.0) 1298 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:23.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:22.843136+0000 mon.smithi008 (mon.0) 1299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:23.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:22.845078+0000 mon.smithi008 (mon.0) 1300 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:23.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:22.820666+0000 mon.smithi008 (mon.0) 1292 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:22.822704+0000 mon.smithi008 (mon.0) 1293 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:22.823643+0000 mon.smithi008 (mon.0) 1294 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:22.830211+0000 mon.smithi008 (mon.0) 1295 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:22.836796+0000 mon.smithi008 (mon.0) 1296 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:22.839979+0000 mon.smithi008 (mon.0) 1297 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:22.841598+0000 mon.smithi008 (mon.0) 1298 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:22.843136+0000 mon.smithi008 (mon.0) 1299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:23.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:22.845078+0000 mon.smithi008 (mon.0) 1300 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:22.796128+0000 mgr.smithi008.flmjzp (mgr.14640) 815 : cluster [DBG] pgmap v576: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:22.824488+0000 mgr.smithi008.flmjzp (mgr.14640) 816 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:22.825032+0000 mgr.smithi008.flmjzp (mgr.14640) 817 : cluster [DBG] pgmap v577: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:22.825352+0000 mgr.smithi008.flmjzp (mgr.14640) 818 : cluster [DBG] pgmap v578: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:22.847359+0000 mgr.smithi008.flmjzp (mgr.14640) 819 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:24.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:22.796128+0000 mgr.smithi008.flmjzp (mgr.14640) 815 : cluster [DBG] pgmap v576: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:22.824488+0000 mgr.smithi008.flmjzp (mgr.14640) 816 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:22.825032+0000 mgr.smithi008.flmjzp (mgr.14640) 817 : cluster [DBG] pgmap v577: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:22.825352+0000 mgr.smithi008.flmjzp (mgr.14640) 818 : cluster [DBG] pgmap v578: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:22.847359+0000 mgr.smithi008.flmjzp (mgr.14640) 819 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:24.826103+0000 mgr.smithi008.flmjzp (mgr.14640) 820 : cluster [DBG] pgmap v579: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:26.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:24.826103+0000 mgr.smithi008.flmjzp (mgr.14640) 820 : cluster [DBG] pgmap v579: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:26.826789+0000 mgr.smithi008.flmjzp (mgr.14640) 821 : cluster [DBG] pgmap v580: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:26.826789+0000 mgr.smithi008.flmjzp (mgr.14640) 821 : cluster [DBG] pgmap v580: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:28.827273+0000 mgr.smithi008.flmjzp (mgr.14640) 822 : cluster [DBG] pgmap v581: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:28.827273+0000 mgr.smithi008.flmjzp (mgr.14640) 822 : cluster [DBG] pgmap v581: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:30.827772+0000 mgr.smithi008.flmjzp (mgr.14640) 823 : cluster [DBG] pgmap v582: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:32.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:30.827772+0000 mgr.smithi008.flmjzp (mgr.14640) 823 : cluster [DBG] pgmap v582: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:32.857893+0000 mon.smithi008 (mon.0) 1301 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:32.859978+0000 mon.smithi008 (mon.0) 1302 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:32.860936+0000 mon.smithi008 (mon.0) 1303 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:32.867756+0000 mon.smithi008 (mon.0) 1304 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:32.873995+0000 mon.smithi008 (mon.0) 1305 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:32.877157+0000 mon.smithi008 (mon.0) 1306 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:32.878891+0000 mon.smithi008 (mon.0) 1307 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:32.880553+0000 mon.smithi008 (mon.0) 1308 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:33.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:32.882582+0000 mon.smithi008 (mon.0) 1309 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:32.857893+0000 mon.smithi008 (mon.0) 1301 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:32.859978+0000 mon.smithi008 (mon.0) 1302 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:32.860936+0000 mon.smithi008 (mon.0) 1303 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:32.867756+0000 mon.smithi008 (mon.0) 1304 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:32.873995+0000 mon.smithi008 (mon.0) 1305 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:32.877157+0000 mon.smithi008 (mon.0) 1306 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:32.878891+0000 mon.smithi008 (mon.0) 1307 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:32.880553+0000 mon.smithi008 (mon.0) 1308 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:32.882582+0000 mon.smithi008 (mon.0) 1309 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:32.828429+0000 mgr.smithi008.flmjzp (mgr.14640) 824 : cluster [DBG] pgmap v583: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:32.861794+0000 mgr.smithi008.flmjzp (mgr.14640) 825 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:32.862334+0000 mgr.smithi008.flmjzp (mgr.14640) 826 : cluster [DBG] pgmap v584: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:32.862687+0000 mgr.smithi008.flmjzp (mgr.14640) 827 : cluster [DBG] pgmap v585: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:32.884592+0000 mgr.smithi008.flmjzp (mgr.14640) 828 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:34.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:32.828429+0000 mgr.smithi008.flmjzp (mgr.14640) 824 : cluster [DBG] pgmap v583: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:32.861794+0000 mgr.smithi008.flmjzp (mgr.14640) 825 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:32.862334+0000 mgr.smithi008.flmjzp (mgr.14640) 826 : cluster [DBG] pgmap v584: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:32.862687+0000 mgr.smithi008.flmjzp (mgr.14640) 827 : cluster [DBG] pgmap v585: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:34.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:32.884592+0000 mgr.smithi008.flmjzp (mgr.14640) 828 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:34.863234+0000 mgr.smithi008.flmjzp (mgr.14640) 829 : cluster [DBG] pgmap v586: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:34.863234+0000 mgr.smithi008.flmjzp (mgr.14640) 829 : cluster [DBG] pgmap v586: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:36.863907+0000 mgr.smithi008.flmjzp (mgr.14640) 830 : cluster [DBG] pgmap v587: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:38.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:36.863907+0000 mgr.smithi008.flmjzp (mgr.14640) 830 : cluster [DBG] pgmap v587: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.646+0000 7f2604c04700 1 -- 172.21.15.8:0/3148547496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f77d0 msgr2=0x7f26000f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.646+0000 7f2604c04700 1 --2- 172.21.15.8:0/3148547496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f77d0 0x7f26000f7c30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f25f4004660 tx=0x7f25f4009b30).stop 2023-10-18T21:12:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.646+0000 7f2604c04700 1 -- 172.21.15.8:0/3148547496 shutdown_connections 2023-10-18T21:12:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.646+0000 7f2604c04700 1 --2- 172.21.15.8:0/3148547496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f77d0 0x7f26000f7c30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.646+0000 7f2604c04700 1 --2- 172.21.15.8:0/3148547496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26000f6530 0x7f26000f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.646+0000 7f2604c04700 1 -- 172.21.15.8:0/3148547496 >> 172.21.15.8:0/3148547496 conn(0x7f26000f1c90 msgr2=0x7f26000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.646+0000 7f2604c04700 1 -- 172.21.15.8:0/3148547496 shutdown_connections 2023-10-18T21:12:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.646+0000 7f2604c04700 1 -- 172.21.15.8:0/3148547496 wait complete. 2023-10-18T21:12:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.647+0000 7f2604c04700 1 Processor -- start 2023-10-18T21:12:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.647+0000 7f2604c04700 1 -- start start 2023-10-18T21:12:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.647+0000 7f2604c04700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f6530 0x7f2600108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.647+0000 7f2604c04700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26000f77d0 0x7f2600109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.647+0000 7f2604c04700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600109a00 con 0x7f26000f6530 2023-10-18T21:12:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.647+0000 7f2604c04700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600109b40 con 0x7f26000f77d0 2023-10-18T21:12:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.648+0000 7f25ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f6530 0x7f2600108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.648+0000 7f25ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f6530 0x7f2600108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57754/0 (socket says 172.21.15.8:57754) 2023-10-18T21:12:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.648+0000 7f25ff7fe700 1 -- 172.21.15.8:0/3972386363 learned_addr learned my addr 172.21.15.8:0/3972386363 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.648+0000 7f25feffd700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26000f77d0 0x7f2600109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.648+0000 7f25ff7fe700 1 -- 172.21.15.8:0/3972386363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26000f77d0 msgr2=0x7f2600109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:40.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.648+0000 7f25ff7fe700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26000f77d0 0x7f2600109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:40.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.648+0000 7f25ff7fe700 1 -- 172.21.15.8:0/3972386363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4005040 con 0x7f26000f6530 2023-10-18T21:12:40.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.648+0000 7f25ff7fe700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f6530 0x7f2600108f60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f25f0002700 tx=0x7f25f0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:40.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.649+0000 7f25e7fff700 1 -- 172.21.15.8:0/3972386363 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f00079c0 con 0x7f26000f6530 2023-10-18T21:12:40.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.649+0000 7f25e7fff700 1 -- 172.21.15.8:0/3972386363 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f25f000f040 con 0x7f26000f6530 2023-10-18T21:12:40.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.649+0000 7f25e7fff700 1 -- 172.21.15.8:0/3972386363 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f00148d0 con 0x7f26000f6530 2023-10-18T21:12:40.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.649+0000 7f2604c04700 1 -- 172.21.15.8:0/3972386363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260010a4e0 con 0x7f26000f6530 2023-10-18T21:12:40.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.649+0000 7f2604c04700 1 -- 172.21.15.8:0/3972386363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260010aaa0 con 0x7f26000f6530 2023-10-18T21:12:40.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.650+0000 7f2604c04700 1 -- 172.21.15.8:0/3972386363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2600045ad0 con 0x7f26000f6530 2023-10-18T21:12:40.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.651+0000 7f25e7fff700 1 -- 172.21.15.8:0/3972386363 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f25f001b060 con 0x7f26000f6530 2023-10-18T21:12:40.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.652+0000 7f25e7fff700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25e8060f70 0x7f25e8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:40.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.652+0000 7f25e7fff700 1 -- 172.21.15.8:0/3972386363 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f25f007c770 con 0x7f26000f6530 2023-10-18T21:12:40.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.652+0000 7f25feffd700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25e8060f70 0x7f25e8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:40.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.653+0000 7f25feffd700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25e8060f70 0x7f25e8063430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f25f4004630 tx=0x7f25f4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:40.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.657+0000 7f25e7fff700 1 -- 172.21.15.8:0/3972386363 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f25f004fdd0 con 0x7f26000f6530 2023-10-18T21:12:40.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:38.864484+0000 mgr.smithi008.flmjzp (mgr.14640) 831 : cluster [DBG] pgmap v588: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:40.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:38.864484+0000 mgr.smithi008.flmjzp (mgr.14640) 831 : cluster [DBG] pgmap v588: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:40.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.858+0000 7f2604c04700 1 -- 172.21.15.8:0/3972386363 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26000fbd70 con 0x7f25e8060f70 2023-10-18T21:12:40.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.859+0000 7f25e7fff700 1 -- 172.21.15.8:0/3972386363 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f26000fbd70 con 0x7f25e8060f70 2023-10-18T21:12:40.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.861+0000 7f2604c04700 1 -- 172.21.15.8:0/3972386363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25e8060f70 msgr2=0x7f25e8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:40.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.861+0000 7f2604c04700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25e8060f70 0x7f25e8063430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f25f4004630 tx=0x7f25f4009b30).stop 2023-10-18T21:12:40.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.861+0000 7f2604c04700 1 -- 172.21.15.8:0/3972386363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f6530 msgr2=0x7f2600108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:40.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.861+0000 7f2604c04700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f6530 0x7f2600108f60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f25f0002700 tx=0x7f25f0009d80).stop 2023-10-18T21:12:40.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.861+0000 7f2604c04700 1 -- 172.21.15.8:0/3972386363 shutdown_connections 2023-10-18T21:12:40.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.861+0000 7f2604c04700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25e8060f70 0x7f25e8063430 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:40.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.861+0000 7f2604c04700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f6530 0x7f2600108f60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:40.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.861+0000 7f2604c04700 1 --2- 172.21.15.8:0/3972386363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26000f77d0 0x7f2600109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:40.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.861+0000 7f2604c04700 1 -- 172.21.15.8:0/3972386363 >> 172.21.15.8:0/3972386363 conn(0x7f26000f1c90 msgr2=0x7f26000f3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:40.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.862+0000 7f2604c04700 1 -- 172.21.15.8:0/3972386363 shutdown_connections 2023-10-18T21:12:40.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.862+0000 7f2604c04700 1 -- 172.21.15.8:0/3972386363 wait complete. 2023-10-18T21:12:40.878 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:12:41.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.999+0000 7f814e6f8700 1 -- 172.21.15.8:0/3830376879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480f6530 msgr2=0x7f81480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:40.999+0000 7f814e6f8700 1 --2- 172.21.15.8:0/3830376879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480f6530 0x7f81480f6950 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f8144004660 tx=0x7f8144009b30).stop 2023-10-18T21:12:41.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.000+0000 7f814e6f8700 1 -- 172.21.15.8:0/3830376879 shutdown_connections 2023-10-18T21:12:41.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.000+0000 7f814e6f8700 1 --2- 172.21.15.8:0/3830376879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480f77d0 0x7f81480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.000+0000 7f814e6f8700 1 --2- 172.21.15.8:0/3830376879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480f6530 0x7f81480f6950 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.000+0000 7f814e6f8700 1 -- 172.21.15.8:0/3830376879 >> 172.21.15.8:0/3830376879 conn(0x7f81480f1c90 msgr2=0x7f81480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:41.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.000+0000 7f814e6f8700 1 -- 172.21.15.8:0/3830376879 shutdown_connections 2023-10-18T21:12:41.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.000+0000 7f814e6f8700 1 -- 172.21.15.8:0/3830376879 wait complete. 2023-10-18T21:12:41.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.001+0000 7f814e6f8700 1 Processor -- start 2023-10-18T21:12:41.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.001+0000 7f814e6f8700 1 -- start start 2023-10-18T21:12:41.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.001+0000 7f814e6f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480f6530 0x7f8148108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.001+0000 7f814e6f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480f77d0 0x7f8148109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.001+0000 7f814e6f8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148109a00 con 0x7f81480f6530 2023-10-18T21:12:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.001+0000 7f814e6f8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148109b40 con 0x7f81480f77d0 2023-10-18T21:12:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.001+0000 7f814d6f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480f6530 0x7f8148108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.001+0000 7f814d6f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480f6530 0x7f8148108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57776/0 (socket says 172.21.15.8:57776) 2023-10-18T21:12:41.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.001+0000 7f814d6f6700 1 -- 172.21.15.8:0/3260706619 learned_addr learned my addr 172.21.15.8:0/3260706619 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:41.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f814cef5700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480f77d0 0x7f8148109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:41.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f814d6f6700 1 -- 172.21.15.8:0/3260706619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480f77d0 msgr2=0x7f8148109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f814d6f6700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480f77d0 0x7f8148109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f814d6f6700 1 -- 172.21.15.8:0/3260706619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144005040 con 0x7f81480f6530 2023-10-18T21:12:41.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f814cef5700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480f77d0 0x7f8148109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:12:41.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f814d6f6700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480f6530 0x7f8148108f60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f8144004e30 tx=0x7f8144009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:41.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f813dffb700 1 -- 172.21.15.8:0/3260706619 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8144018070 con 0x7f81480f6530 2023-10-18T21:12:41.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f813dffb700 1 -- 172.21.15.8:0/3260706619 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8144009630 con 0x7f81480f6530 2023-10-18T21:12:41.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f813dffb700 1 -- 172.21.15.8:0/3260706619 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f814401c3c0 con 0x7f81480f6530 2023-10-18T21:12:41.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f814e6f8700 1 -- 172.21.15.8:0/3260706619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814810a480 con 0x7f81480f6530 2023-10-18T21:12:41.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.002+0000 7f814e6f8700 1 -- 172.21.15.8:0/3260706619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814810a9e0 con 0x7f81480f6530 2023-10-18T21:12:41.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.003+0000 7f814e6f8700 1 -- 172.21.15.8:0/3260706619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8148045ad0 con 0x7f81480f6530 2023-10-18T21:12:41.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.004+0000 7f813dffb700 1 -- 172.21.15.8:0/3260706619 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f814401d420 con 0x7f81480f6530 2023-10-18T21:12:41.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.005+0000 7f813dffb700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8134060f70 0x7f8134063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:41.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.005+0000 7f813dffb700 1 -- 172.21.15.8:0/3260706619 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f814407e6b0 con 0x7f81480f6530 2023-10-18T21:12:41.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.005+0000 7f814cef5700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8134060f70 0x7f8134063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:41.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.006+0000 7f814cef5700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8134060f70 0x7f8134063430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f8138009760 tx=0x7f8138009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:41.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.009+0000 7f813dffb700 1 -- 172.21.15.8:0/3260706619 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8144051d40 con 0x7f81480f6530 2023-10-18T21:12:41.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.206+0000 7f814e6f8700 1 -- 172.21.15.8:0/3260706619 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81480fee00 con 0x7f8134060f70 2023-10-18T21:12:41.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.208+0000 7f813dffb700 1 -- 172.21.15.8:0/3260706619 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f81480fee00 con 0x7f8134060f70 2023-10-18T21:12:41.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.209+0000 7f814e6f8700 1 -- 172.21.15.8:0/3260706619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8134060f70 msgr2=0x7f8134063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.210+0000 7f814e6f8700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8134060f70 0x7f8134063430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f8138009760 tx=0x7f8138009c60).stop 2023-10-18T21:12:41.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.210+0000 7f814e6f8700 1 -- 172.21.15.8:0/3260706619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480f6530 msgr2=0x7f8148108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.210+0000 7f814e6f8700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480f6530 0x7f8148108f60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f8144004e30 tx=0x7f8144009b30).stop 2023-10-18T21:12:41.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.210+0000 7f814e6f8700 1 -- 172.21.15.8:0/3260706619 shutdown_connections 2023-10-18T21:12:41.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.210+0000 7f814e6f8700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8134060f70 0x7f8134063430 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.210+0000 7f814e6f8700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480f6530 0x7f8148108f60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.210+0000 7f814e6f8700 1 --2- 172.21.15.8:0/3260706619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480f77d0 0x7f8148109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.210+0000 7f814e6f8700 1 -- 172.21.15.8:0/3260706619 >> 172.21.15.8:0/3260706619 conn(0x7f81480f1c90 msgr2=0x7f814806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:41.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.210+0000 7f814e6f8700 1 -- 172.21.15.8:0/3260706619 shutdown_connections 2023-10-18T21:12:41.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.210+0000 7f814e6f8700 1 -- 172.21.15.8:0/3260706619 wait complete. 2023-10-18T21:12:41.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.346+0000 7fb889565700 1 -- 172.21.15.8:0/1990752067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8840f9690 msgr2=0x7fb8840fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.346+0000 7fb889565700 1 --2- 172.21.15.8:0/1990752067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8840f9690 0x7fb8840fbae0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fb878004660 tx=0x7fb878009b30).stop 2023-10-18T21:12:41.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.346+0000 7fb889565700 1 -- 172.21.15.8:0/1990752067 shutdown_connections 2023-10-18T21:12:41.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.346+0000 7fb889565700 1 --2- 172.21.15.8:0/1990752067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8840f9690 0x7fb8840fbae0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.346+0000 7fb889565700 1 --2- 172.21.15.8:0/1990752067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb884060310 0x7fb8840f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.346+0000 7fb889565700 1 -- 172.21.15.8:0/1990752067 >> 172.21.15.8:0/1990752067 conn(0x7fb8840f0b90 msgr2=0x7fb8840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.346+0000 7fb889565700 1 -- 172.21.15.8:0/1990752067 shutdown_connections 2023-10-18T21:12:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.347+0000 7fb889565700 1 -- 172.21.15.8:0/1990752067 wait complete. 2023-10-18T21:12:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.347+0000 7fb889565700 1 Processor -- start 2023-10-18T21:12:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.348+0000 7fb889565700 1 -- start start 2023-10-18T21:12:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.348+0000 7fb889565700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb884060310 0x7fb884106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.348+0000 7fb889565700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8840f9690 0x7fb8841072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:41.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.348+0000 7fb889565700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8841078b0 con 0x7fb8840f9690 2023-10-18T21:12:41.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.348+0000 7fb889565700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8841080f0 con 0x7fb884060310 2023-10-18T21:12:41.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.349+0000 7fb8837fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8840f9690 0x7fb8841072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:41.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.349+0000 7fb883fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb884060310 0x7fb884106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:41.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.349+0000 7fb883fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb884060310 0x7fb884106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:56628/0 (socket says 172.21.15.8:56628) 2023-10-18T21:12:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.349+0000 7fb883fff700 1 -- 172.21.15.8:0/1469533434 learned_addr learned my addr 172.21.15.8:0/1469533434 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.349+0000 7fb8837fe700 1 -- 172.21.15.8:0/1469533434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb884060310 msgr2=0x7fb884106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.349+0000 7fb8837fe700 1 --2- 172.21.15.8:0/1469533434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb884060310 0x7fb884106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.349+0000 7fb8837fe700 1 -- 172.21.15.8:0/1469533434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878005040 con 0x7fb8840f9690 2023-10-18T21:12:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.349+0000 7fb8837fe700 1 --2- 172.21.15.8:0/1469533434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8840f9690 0x7fb8841072b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fb878000c00 tx=0x7fb878009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.350+0000 7fb880ff9700 1 -- 172.21.15.8:0/1469533434 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb878018070 con 0x7fb8840f9690 2023-10-18T21:12:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.350+0000 7fb880ff9700 1 -- 172.21.15.8:0/1469533434 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb878009630 con 0x7fb8840f9690 2023-10-18T21:12:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.350+0000 7fb889565700 1 -- 172.21.15.8:0/1469533434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb884108370 con 0x7fb8840f9690 2023-10-18T21:12:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.350+0000 7fb880ff9700 1 -- 172.21.15.8:0/1469533434 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8780123c0 con 0x7fb8840f9690 2023-10-18T21:12:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.350+0000 7fb889565700 1 -- 172.21.15.8:0/1469533434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb884108850 con 0x7fb8840f9690 2023-10-18T21:12:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.351+0000 7fb889565700 1 -- 172.21.15.8:0/1469533434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb884059100 con 0x7fb8840f9690 2023-10-18T21:12:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.352+0000 7fb880ff9700 1 -- 172.21.15.8:0/1469533434 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb87801d420 con 0x7fb8840f9690 2023-10-18T21:12:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.353+0000 7fb880ff9700 1 --2- 172.21.15.8:0/1469533434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb86c060f70 0x7fb86c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.353+0000 7fb880ff9700 1 -- 172.21.15.8:0/1469533434 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb87807e580 con 0x7fb8840f9690 2023-10-18T21:12:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.353+0000 7fb883fff700 1 --2- 172.21.15.8:0/1469533434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb86c060f70 0x7fb86c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:41.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.354+0000 7fb883fff700 1 --2- 172.21.15.8:0/1469533434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb86c060f70 0x7fb86c063430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fb884107b80 tx=0x7fb87400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:41.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.357+0000 7fb880ff9700 1 -- 172.21.15.8:0/1469533434 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb87804e1b0 con 0x7fb8840f9690 2023-10-18T21:12:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.545+0000 7fb889565700 1 -- 172.21.15.8:0/1469533434 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8840feda0 con 0x7fb86c060f70 2023-10-18T21:12:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.555+0000 7fb880ff9700 1 -- 172.21.15.8:0/1469533434 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb8840feda0 con 0x7fb86c060f70 2023-10-18T21:12:41.557 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:12:41.558 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (19m) 7m ago 20m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:12:41.558 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (13m) 7m ago 20m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:12:41.558 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (13m) 5m ago 19m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:12:41.558 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (19m) 7m ago 20m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:12:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (7m) 7m ago 16m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:12:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 16m - - 2023-10-18T21:12:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (5m) 5m ago 16m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:12:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (5m) 5m ago 16m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:12:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (14m) 7m ago 22m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:12:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (13m) 5m ago 19m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:12:41.560 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (13m) 7m ago 22m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:12:41.560 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (13m) 5m ago 19m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:12:41.560 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (20m) 7m ago 20m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:12:41.560 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (19m) 5m ago 19m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:12:41.560 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (12m) 7m ago 19m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:12:41.560 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (10m) 7m ago 19m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:12:41.561 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (10m) 7m ago 18m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:12:41.561 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (9m) 5m ago 18m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:12:41.561 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (9m) 5m ago 18m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:12:41.561 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (8m) 5m ago 17m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:12:41.561 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (14m) 7m ago 20m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:12:41.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 -- 172.21.15.8:0/1469533434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb86c060f70 msgr2=0x7fb86c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 --2- 172.21.15.8:0/1469533434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb86c060f70 0x7fb86c063430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fb884107b80 tx=0x7fb87400b040).stop 2023-10-18T21:12:41.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 -- 172.21.15.8:0/1469533434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8840f9690 msgr2=0x7fb8841072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 --2- 172.21.15.8:0/1469533434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8840f9690 0x7fb8841072b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fb878000c00 tx=0x7fb878009b30).stop 2023-10-18T21:12:41.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 -- 172.21.15.8:0/1469533434 shutdown_connections 2023-10-18T21:12:41.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 --2- 172.21.15.8:0/1469533434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb86c060f70 0x7fb86c063430 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 --2- 172.21.15.8:0/1469533434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb884060310 0x7fb884106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 --2- 172.21.15.8:0/1469533434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8840f9690 0x7fb8841072b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 -- 172.21.15.8:0/1469533434 >> 172.21.15.8:0/1469533434 conn(0x7fb8840f0b90 msgr2=0x7fb8840f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:41.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 -- 172.21.15.8:0/1469533434 shutdown_connections 2023-10-18T21:12:41.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.557+0000 7fb889565700 1 -- 172.21.15.8:0/1469533434 wait complete. 2023-10-18T21:12:41.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.694+0000 7f18ebfff700 1 -- 172.21.15.8:0/3925503063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18ec0f77d0 msgr2=0x7f18ec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.694+0000 7f18ebfff700 1 --2- 172.21.15.8:0/3925503063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18ec0f77d0 0x7f18ec0f7c30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f18e0004660 tx=0x7f18e0009b30).stop 2023-10-18T21:12:41.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.694+0000 7f18ebfff700 1 -- 172.21.15.8:0/3925503063 shutdown_connections 2023-10-18T21:12:41.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.694+0000 7f18ebfff700 1 --2- 172.21.15.8:0/3925503063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18ec0f77d0 0x7f18ec0f7c30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.694+0000 7f18ebfff700 1 --2- 172.21.15.8:0/3925503063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18ec0f6530 0x7f18ec0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.694+0000 7f18ebfff700 1 -- 172.21.15.8:0/3925503063 >> 172.21.15.8:0/3925503063 conn(0x7f18ec0f1c90 msgr2=0x7f18ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:41.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.694+0000 7f18ebfff700 1 -- 172.21.15.8:0/3925503063 shutdown_connections 2023-10-18T21:12:41.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.694+0000 7f18ebfff700 1 -- 172.21.15.8:0/3925503063 wait complete. 2023-10-18T21:12:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.695+0000 7f18ebfff700 1 Processor -- start 2023-10-18T21:12:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.695+0000 7f18ebfff700 1 -- start start 2023-10-18T21:12:41.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.695+0000 7f18ebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18ec0f6530 0x7f18ec106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:41.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.695+0000 7f18ebfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18ec0f77d0 0x7f18ec107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:41.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.695+0000 7f18ebfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec107850 con 0x7f18ec0f77d0 2023-10-18T21:12:41.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.695+0000 7f18ebfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec108060 con 0x7f18ec0f6530 2023-10-18T21:12:41.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.696+0000 7f18ea7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18ec0f77d0 0x7f18ec107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.696+0000 7f18ea7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18ec0f77d0 0x7f18ec107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57796/0 (socket says 172.21.15.8:57796) 2023-10-18T21:12:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.696+0000 7f18ea7fc700 1 -- 172.21.15.8:0/2924067401 learned_addr learned my addr 172.21.15.8:0/2924067401 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.696+0000 7f18ea7fc700 1 -- 172.21.15.8:0/2924067401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18ec0f6530 msgr2=0x7f18ec106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.696+0000 7f18ea7fc700 1 --2- 172.21.15.8:0/2924067401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18ec0f6530 0x7f18ec106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:12:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.696+0000 7f18ea7fc700 1 -- 172.21.15.8:0/2924067401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0005040 con 0x7f18ec0f77d0 2023-10-18T21:12:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.696+0000 7f18ea7fc700 1 --2- 172.21.15.8:0/2924067401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18ec0f77d0 0x7f18ec107250 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f18e0009990 tx=0x7f18e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.696+0000 7f18d37fe700 1 -- 172.21.15.8:0/2924067401 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e0018070 con 0x7f18ec0f77d0 2023-10-18T21:12:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.697+0000 7f18d37fe700 1 -- 172.21.15.8:0/2924067401 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f18e0009630 con 0x7f18ec0f77d0 2023-10-18T21:12:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.697+0000 7f18ebfff700 1 -- 172.21.15.8:0/2924067401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec108280 con 0x7f18ec0f77d0 2023-10-18T21:12:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.697+0000 7f18d37fe700 1 -- 172.21.15.8:0/2924067401 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e001c400 con 0x7f18ec0f77d0 2023-10-18T21:12:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.697+0000 7f18ebfff700 1 -- 172.21.15.8:0/2924067401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec1087e0 con 0x7f18ec0f77d0 2023-10-18T21:12:41.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.698+0000 7f18ebfff700 1 -- 172.21.15.8:0/2924067401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec059100 con 0x7f18ec0f77d0 2023-10-18T21:12:41.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.699+0000 7f18d37fe700 1 -- 172.21.15.8:0/2924067401 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f18e001d9e0 con 0x7f18ec0f77d0 2023-10-18T21:12:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.699+0000 7f18d37fe700 1 --2- 172.21.15.8:0/2924067401 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18d4060f70 0x7f18d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.699+0000 7f18d37fe700 1 -- 172.21.15.8:0/2924067401 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f18e007e740 con 0x7f18ec0f77d0 2023-10-18T21:12:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.700+0000 7f18eaffd700 1 --2- 172.21.15.8:0/2924067401 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18d4060f70 0x7f18d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.700+0000 7f18eaffd700 1 --2- 172.21.15.8:0/2924067401 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18d4060f70 0x7f18d4063430 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f18dc009880 tx=0x7f18dc009a60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.704+0000 7f18d37fe700 1 -- 172.21.15.8:0/2924067401 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f18e004e2f0 con 0x7f18ec0f77d0 2023-10-18T21:12:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.954+0000 7f18ebfff700 1 -- 172.21.15.8:0/2924067401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f18ec0008d0 con 0x7f18ec0f77d0 2023-10-18T21:12:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.955+0000 7f18d37fe700 1 -- 172.21.15.8:0/2924067401 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f18e0051910 con 0x7f18ec0f77d0 2023-10-18T21:12:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:12:41.957 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:12:41.958 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:12:41.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:12:41.958 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:12:41.958 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:12:41.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:12:41.959 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:12:41.959 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:12:41.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:12:41.959 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:12:41.959 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:12:41.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:12:41.960 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:12:41.960 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:12:41.960 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:12:41.960 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:12:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 -- 172.21.15.8:0/2924067401 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18d4060f70 msgr2=0x7f18d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 --2- 172.21.15.8:0/2924067401 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18d4060f70 0x7f18d4063430 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f18dc009880 tx=0x7f18dc009a60).stop 2023-10-18T21:12:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 -- 172.21.15.8:0/2924067401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18ec0f77d0 msgr2=0x7f18ec107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:41.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 --2- 172.21.15.8:0/2924067401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18ec0f77d0 0x7f18ec107250 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f18e0009990 tx=0x7f18e0009b30).stop 2023-10-18T21:12:41.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 -- 172.21.15.8:0/2924067401 shutdown_connections 2023-10-18T21:12:41.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 --2- 172.21.15.8:0/2924067401 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18d4060f70 0x7f18d4063430 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 --2- 172.21.15.8:0/2924067401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18ec0f6530 0x7f18ec106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:12:41.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 --2- 172.21.15.8:0/2924067401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18ec0f77d0 0x7f18ec107250 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:41.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 -- 172.21.15.8:0/2924067401 >> 172.21.15.8:0/2924067401 conn(0x7f18ec0f1c90 msgr2=0x7f18ec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:41.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 -- 172.21.15.8:0/2924067401 shutdown_connections 2023-10-18T21:12:41.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:41.957+0000 7f18ebfff700 1 -- 172.21.15.8:0/2924067401 wait complete. 2023-10-18T21:12:42.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.093+0000 7f50ee830700 1 -- 172.21.15.8:0/3074565800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50e80f77d0 msgr2=0x7f50e80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:42.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.093+0000 7f50ee830700 1 --2- 172.21.15.8:0/3074565800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50e80f77d0 0x7f50e80f7c30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f50d8004660 tx=0x7f50d8009b30).stop 2023-10-18T21:12:42.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.093+0000 7f50ee830700 1 -- 172.21.15.8:0/3074565800 shutdown_connections 2023-10-18T21:12:42.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.093+0000 7f50ee830700 1 --2- 172.21.15.8:0/3074565800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50e80f77d0 0x7f50e80f7c30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.093+0000 7f50ee830700 1 --2- 172.21.15.8:0/3074565800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e80f6530 0x7f50e80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.093+0000 7f50ee830700 1 -- 172.21.15.8:0/3074565800 >> 172.21.15.8:0/3074565800 conn(0x7f50e80f1c90 msgr2=0x7f50e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:42.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.093+0000 7f50ee830700 1 -- 172.21.15.8:0/3074565800 shutdown_connections 2023-10-18T21:12:42.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.094+0000 7f50ee830700 1 -- 172.21.15.8:0/3074565800 wait complete. 2023-10-18T21:12:42.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.094+0000 7f50ee830700 1 Processor -- start 2023-10-18T21:12:42.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.094+0000 7f50ee830700 1 -- start start 2023-10-18T21:12:42.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.095+0000 7f50ee830700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50e80f6530 0x7f50e8108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:42.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.095+0000 7f50ee830700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e80f77d0 0x7f50e8109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:42.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.095+0000 7f50ee830700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e81099c0 con 0x7f50e80f6530 2023-10-18T21:12:42.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.095+0000 7f50ee830700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8109b00 con 0x7f50e80f77d0 2023-10-18T21:12:42.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.095+0000 7f50ed82e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50e80f6530 0x7f50e8108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:42.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.095+0000 7f50ed82e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50e80f6530 0x7f50e8108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57806/0 (socket says 172.21.15.8:57806) 2023-10-18T21:12:42.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.095+0000 7f50ed82e700 1 -- 172.21.15.8:0/1390487888 learned_addr learned my addr 172.21.15.8:0/1390487888 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:42.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.095+0000 7f50ed02d700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e80f77d0 0x7f50e8109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:42.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.096+0000 7f50ed82e700 1 -- 172.21.15.8:0/1390487888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e80f77d0 msgr2=0x7f50e8109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:42.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.096+0000 7f50ed82e700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e80f77d0 0x7f50e8109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.096+0000 7f50ed82e700 1 -- 172.21.15.8:0/1390487888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d8005040 con 0x7f50e80f6530 2023-10-18T21:12:42.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.096+0000 7f50ed82e700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50e80f6530 0x7f50e8108f20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f50e400e7c0 tx=0x7f50e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:42.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.096+0000 7f50de7fc700 1 -- 172.21.15.8:0/1390487888 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50e40092e0 con 0x7f50e80f6530 2023-10-18T21:12:42.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.096+0000 7f50de7fc700 1 -- 172.21.15.8:0/1390487888 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f50e400f040 con 0x7f50e80f6530 2023-10-18T21:12:42.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.096+0000 7f50ee830700 1 -- 172.21.15.8:0/1390487888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e810a4a0 con 0x7f50e80f6530 2023-10-18T21:12:42.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.096+0000 7f50de7fc700 1 -- 172.21.15.8:0/1390487888 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50e4014810 con 0x7f50e80f6530 2023-10-18T21:12:42.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.096+0000 7f50ee830700 1 -- 172.21.15.8:0/1390487888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e810a9e0 con 0x7f50e80f6530 2023-10-18T21:12:42.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.097+0000 7f50ee830700 1 -- 172.21.15.8:0/1390487888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e8045ad0 con 0x7f50e80f6530 2023-10-18T21:12:42.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.098+0000 7f50de7fc700 1 -- 172.21.15.8:0/1390487888 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f50e401b030 con 0x7f50e80f6530 2023-10-18T21:12:42.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.099+0000 7f50de7fc700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50d4060f70 0x7f50d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:42.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.099+0000 7f50de7fc700 1 -- 172.21.15.8:0/1390487888 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f50e407c920 con 0x7f50e80f6530 2023-10-18T21:12:42.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.100+0000 7f50ed02d700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50d4060f70 0x7f50d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:42.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.100+0000 7f50ed02d700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50d4060f70 0x7f50d4063430 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f50d8005010 tx=0x7f50d8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:42.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.104+0000 7f50de7fc700 1 -- 172.21.15.8:0/1390487888 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f50e404ff00 con 0x7f50e80f6530 2023-10-18T21:12:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.330+0000 7f50ee830700 1 -- 172.21.15.8:0/1390487888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f50e80fed90 con 0x7f50e80f6530 2023-10-18T21:12:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.330+0000 7f50de7fc700 1 -- 172.21.15.8:0/1390487888 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f50e4019030 con 0x7f50e80f6530 2023-10-18T21:12:42.333 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:12:42.333 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:12:42.333 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:12:42.333 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:12:42.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:12:42.334 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:12:42.334 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:12:42.334 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:12:42.334 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:12:42.335 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:12:42.335 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:12:42.335 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:12:42.335 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:12:42.335 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:12:42.336 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:12:42.336 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:12:42.336 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:12:42.336 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:12:42.336 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:12:42.337 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:12:42.337 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:12:42.337 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:12:42.337 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:12:42.337 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:12:42.338 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:12:42.338 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:12:42.338 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:12:42.338 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:12:42.338 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:12:42.339 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:12:42.339 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:12:42.339 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:12:42.339 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:12:42.339 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:12:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.332+0000 7f50ee830700 1 -- 172.21.15.8:0/1390487888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50d4060f70 msgr2=0x7f50d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.332+0000 7f50ee830700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50d4060f70 0x7f50d4063430 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f50d8005010 tx=0x7f50d8016040).stop 2023-10-18T21:12:42.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.332+0000 7f50ee830700 1 -- 172.21.15.8:0/1390487888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50e80f6530 msgr2=0x7f50e8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:42.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.332+0000 7f50ee830700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50e80f6530 0x7f50e8108f20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f50e400e7c0 tx=0x7f50e400b040).stop 2023-10-18T21:12:42.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.332+0000 7f50ee830700 1 -- 172.21.15.8:0/1390487888 shutdown_connections 2023-10-18T21:12:42.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.332+0000 7f50ee830700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50d4060f70 0x7f50d4063430 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.332+0000 7f50ee830700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50e80f6530 0x7f50e8108f20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.332+0000 7f50ee830700 1 --2- 172.21.15.8:0/1390487888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e80f77d0 0x7f50e8109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.332+0000 7f50ee830700 1 -- 172.21.15.8:0/1390487888 >> 172.21.15.8:0/1390487888 conn(0x7f50e80f1c90 msgr2=0x7f50e806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.333+0000 7f50ee830700 1 -- 172.21.15.8:0/1390487888 shutdown_connections 2023-10-18T21:12:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.333+0000 7f50ee830700 1 -- 172.21.15.8:0/1390487888 wait complete. 2023-10-18T21:12:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:12:42.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.470+0000 7f092111b700 1 -- 172.21.15.8:0/2312841189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f091c0f77d0 msgr2=0x7f091c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:42.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.470+0000 7f092111b700 1 --2- 172.21.15.8:0/2312841189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f091c0f77d0 0x7f091c0f7c30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f0910004660 tx=0x7f0910009b30).stop 2023-10-18T21:12:42.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.470+0000 7f092111b700 1 -- 172.21.15.8:0/2312841189 shutdown_connections 2023-10-18T21:12:42.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.470+0000 7f092111b700 1 --2- 172.21.15.8:0/2312841189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f091c0f77d0 0x7f091c0f7c30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.470+0000 7f092111b700 1 --2- 172.21.15.8:0/2312841189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f091c0f6530 0x7f091c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.470+0000 7f092111b700 1 -- 172.21.15.8:0/2312841189 >> 172.21.15.8:0/2312841189 conn(0x7f091c0f1c90 msgr2=0x7f091c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:42.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.470+0000 7f092111b700 1 -- 172.21.15.8:0/2312841189 shutdown_connections 2023-10-18T21:12:42.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.471+0000 7f092111b700 1 -- 172.21.15.8:0/2312841189 wait complete. 2023-10-18T21:12:42.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.471+0000 7f092111b700 1 Processor -- start 2023-10-18T21:12:42.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.472+0000 7f092111b700 1 -- start start 2023-10-18T21:12:42.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.472+0000 7f092111b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f091c0f6530 0x7f091c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:42.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.472+0000 7f092111b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f091c0f77d0 0x7f091c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:42.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.472+0000 7f092111b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c06a380 con 0x7f091c0f77d0 2023-10-18T21:12:42.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.472+0000 7f092111b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c06a4c0 con 0x7f091c0f6530 2023-10-18T21:12:42.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.472+0000 7f091b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f091c0f77d0 0x7f091c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:42.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.472+0000 7f091b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f091c0f77d0 0x7f091c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57820/0 (socket says 172.21.15.8:57820) 2023-10-18T21:12:42.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.472+0000 7f091b7fe700 1 -- 172.21.15.8:0/3196809010 learned_addr learned my addr 172.21.15.8:0/3196809010 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:12:42.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.472+0000 7f091bfff700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f091c0f6530 0x7f091c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:42.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.473+0000 7f091b7fe700 1 -- 172.21.15.8:0/3196809010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f091c0f6530 msgr2=0x7f091c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:42.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.473+0000 7f091b7fe700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f091c0f6530 0x7f091c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.473+0000 7f091b7fe700 1 -- 172.21.15.8:0/3196809010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910005040 con 0x7f091c0f77d0 2023-10-18T21:12:42.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.473+0000 7f091b7fe700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f091c0f77d0 0x7f091c069e20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f0910009830 tx=0x7f0910009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:42.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.473+0000 7f0918ff9700 1 -- 172.21.15.8:0/3196809010 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0910018070 con 0x7f091c0f77d0 2023-10-18T21:12:42.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.473+0000 7f0918ff9700 1 -- 172.21.15.8:0/3196809010 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f091001d8e0 con 0x7f091c0f77d0 2023-10-18T21:12:42.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.473+0000 7f092111b700 1 -- 172.21.15.8:0/3196809010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c06a740 con 0x7f091c0f77d0 2023-10-18T21:12:42.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.473+0000 7f0918ff9700 1 -- 172.21.15.8:0/3196809010 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f091001c480 con 0x7f091c0f77d0 2023-10-18T21:12:42.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.473+0000 7f092111b700 1 -- 172.21.15.8:0/3196809010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c06aca0 con 0x7f091c0f77d0 2023-10-18T21:12:42.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.474+0000 7f092111b700 1 -- 172.21.15.8:0/3196809010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c045ad0 con 0x7f091c0f77d0 2023-10-18T21:12:42.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.475+0000 7f0918ff9700 1 -- 172.21.15.8:0/3196809010 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f091001da50 con 0x7f091c0f77d0 2023-10-18T21:12:42.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.476+0000 7f0918ff9700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0904060f70 0x7f0904063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:12:42.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.476+0000 7f0918ff9700 1 -- 172.21.15.8:0/3196809010 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f091007e780 con 0x7f091c0f77d0 2023-10-18T21:12:42.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.476+0000 7f091bfff700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0904060f70 0x7f0904063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:12:42.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.477+0000 7f091bfff700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0904060f70 0x7f0904063430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f091c06b730 tx=0x7f090c009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:12:42.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.480+0000 7f0918ff9700 1 -- 172.21.15.8:0/3196809010 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f091004e3b0 con 0x7f091c0f77d0 2023-10-18T21:12:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:40.860811+0000 mgr.smithi008.flmjzp (mgr.14640) 832 : audit [DBG] from='client.34884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:40.864920+0000 mgr.smithi008.flmjzp (mgr.14640) 833 : cluster [DBG] pgmap v589: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:41.209075+0000 mgr.smithi008.flmjzp (mgr.14640) 834 : audit [DBG] from='client.34888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:41.547933+0000 mgr.smithi008.flmjzp (mgr.14640) 835 : audit [DBG] from='client.34892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:41.956555+0000 mon.smithi008 (mon.0) 1310 : audit [DBG] from='client.? 172.21.15.8:0/2924067401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:42.331849+0000 mon.smithi008 (mon.0) 1311 : audit [DBG] from='client.? 172.21.15.8:0/1390487888' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:12:42.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.680+0000 7f092111b700 1 -- 172.21.15.8:0/3196809010 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f091c0fee30 con 0x7f0904060f70 2023-10-18T21:12:42.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.682+0000 7f0918ff9700 1 -- 172.21.15.8:0/3196809010 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f091c0fee30 con 0x7f0904060f70 2023-10-18T21:12:42.684 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:12:42.684 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:12:42.684 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:12:42.684 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:12:42.685 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:12:42.685 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:12:42.685 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:12:42.685 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:12:42.685 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:12:42.685 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:12:42.686 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:12:42.686 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:12:42.686 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:12:42.686 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:12:42.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.683+0000 7f092111b700 1 -- 172.21.15.8:0/3196809010 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0904060f70 msgr2=0x7f0904063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:42.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.683+0000 7f092111b700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0904060f70 0x7f0904063430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f091c06b730 tx=0x7f090c009040).stop 2023-10-18T21:12:42.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.683+0000 7f092111b700 1 -- 172.21.15.8:0/3196809010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f091c0f77d0 msgr2=0x7f091c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:12:42.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.683+0000 7f092111b700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f091c0f77d0 0x7f091c069e20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f0910009830 tx=0x7f0910009b30).stop 2023-10-18T21:12:42.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.684+0000 7f092111b700 1 -- 172.21.15.8:0/3196809010 shutdown_connections 2023-10-18T21:12:42.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.684+0000 7f092111b700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0904060f70 0x7f0904063430 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.684+0000 7f092111b700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f091c0f6530 0x7f091c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.684+0000 7f092111b700 1 --2- 172.21.15.8:0/3196809010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f091c0f77d0 0x7f091c069e20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:12:42.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.684+0000 7f092111b700 1 -- 172.21.15.8:0/3196809010 >> 172.21.15.8:0/3196809010 conn(0x7f091c0f1c90 msgr2=0x7f091c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:12:42.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.684+0000 7f092111b700 1 -- 172.21.15.8:0/3196809010 shutdown_connections 2023-10-18T21:12:42.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:12:42.684+0000 7f092111b700 1 -- 172.21.15.8:0/3196809010 wait complete. 2023-10-18T21:12:42.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:40.860811+0000 mgr.smithi008.flmjzp (mgr.14640) 832 : audit [DBG] from='client.34884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:40.864920+0000 mgr.smithi008.flmjzp (mgr.14640) 833 : cluster [DBG] pgmap v589: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:41.209075+0000 mgr.smithi008.flmjzp (mgr.14640) 834 : audit [DBG] from='client.34888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:41.547933+0000 mgr.smithi008.flmjzp (mgr.14640) 835 : audit [DBG] from='client.34892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:41.956555+0000 mon.smithi008 (mon.0) 1310 : audit [DBG] from='client.? 172.21.15.8:0/2924067401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:42.331849+0000 mon.smithi008 (mon.0) 1311 : audit [DBG] from='client.? 172.21.15.8:0/1390487888' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:12:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:42.683036+0000 mgr.smithi008.flmjzp (mgr.14640) 836 : audit [DBG] from='client.34904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:42.894968+0000 mon.smithi008 (mon.0) 1312 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:43.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:42.683036+0000 mgr.smithi008.flmjzp (mgr.14640) 836 : audit [DBG] from='client.34904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:12:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:42.894968+0000 mon.smithi008 (mon.0) 1312 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:42.865366+0000 mgr.smithi008.flmjzp (mgr.14640) 837 : cluster [DBG] pgmap v590: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:43.443097+0000 mon.smithi008 (mon.0) 1313 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:43.443876+0000 mon.smithi008 (mon.0) 1314 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:43.444545+0000 mgr.smithi008.flmjzp (mgr.14640) 838 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:43.445047+0000 mgr.smithi008.flmjzp (mgr.14640) 839 : cluster [DBG] pgmap v591: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:43.445260+0000 mgr.smithi008.flmjzp (mgr.14640) 840 : cluster [DBG] pgmap v592: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:43.449233+0000 mon.smithi008 (mon.0) 1315 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:43.454254+0000 mon.smithi008 (mon.0) 1316 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:43.456566+0000 mon.smithi008 (mon.0) 1317 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:44.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:43.457744+0000 mon.smithi008 (mon.0) 1318 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:44.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:43.458926+0000 mon.smithi008 (mon.0) 1319 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:44.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:43.460510+0000 mon.smithi008 (mon.0) 1320 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:44.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:43.462046+0000 mgr.smithi008.flmjzp (mgr.14640) 841 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:42.865366+0000 mgr.smithi008.flmjzp (mgr.14640) 837 : cluster [DBG] pgmap v590: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:43.443097+0000 mon.smithi008 (mon.0) 1313 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:43.443876+0000 mon.smithi008 (mon.0) 1314 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:43.444545+0000 mgr.smithi008.flmjzp (mgr.14640) 838 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:43.445047+0000 mgr.smithi008.flmjzp (mgr.14640) 839 : cluster [DBG] pgmap v591: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:43.445260+0000 mgr.smithi008.flmjzp (mgr.14640) 840 : cluster [DBG] pgmap v592: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:43.449233+0000 mon.smithi008 (mon.0) 1315 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:43.454254+0000 mon.smithi008 (mon.0) 1316 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:44.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:43.456566+0000 mon.smithi008 (mon.0) 1317 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:44.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:43.457744+0000 mon.smithi008 (mon.0) 1318 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:44.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:43.458926+0000 mon.smithi008 (mon.0) 1319 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:44.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:43.460510+0000 mon.smithi008 (mon.0) 1320 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:44.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:43.462046+0000 mgr.smithi008.flmjzp (mgr.14640) 841 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:45.445935+0000 mgr.smithi008.flmjzp (mgr.14640) 842 : cluster [DBG] pgmap v593: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:46.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:45.445935+0000 mgr.smithi008.flmjzp (mgr.14640) 842 : cluster [DBG] pgmap v593: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:47.446684+0000 mgr.smithi008.flmjzp (mgr.14640) 843 : cluster [DBG] pgmap v594: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:47.446684+0000 mgr.smithi008.flmjzp (mgr.14640) 843 : cluster [DBG] pgmap v594: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:49.447339+0000 mgr.smithi008.flmjzp (mgr.14640) 844 : cluster [DBG] pgmap v595: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:49.447339+0000 mgr.smithi008.flmjzp (mgr.14640) 844 : cluster [DBG] pgmap v595: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:51.448005+0000 mgr.smithi008.flmjzp (mgr.14640) 845 : cluster [DBG] pgmap v596: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:51.448005+0000 mgr.smithi008.flmjzp (mgr.14640) 845 : cluster [DBG] pgmap v596: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:53.472686+0000 mon.smithi008 (mon.0) 1321 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:53.472686+0000 mon.smithi008 (mon.0) 1321 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:54.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:53.448574+0000 mgr.smithi008.flmjzp (mgr.14640) 846 : cluster [DBG] pgmap v597: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:54.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:53.827828+0000 mon.smithi008 (mon.0) 1322 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:53.828987+0000 mon.smithi008 (mon.0) 1323 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:53.830127+0000 mon.smithi008 (mon.0) 1324 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:53.836203+0000 mon.smithi008 (mon.0) 1325 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:53.842943+0000 mon.smithi008 (mon.0) 1326 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:53.846555+0000 mon.smithi008 (mon.0) 1327 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:53.848552+0000 mon.smithi008 (mon.0) 1328 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:53.850530+0000 mon.smithi008 (mon.0) 1329 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:12:53.853198+0000 mon.smithi008 (mon.0) 1330 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:53.448574+0000 mgr.smithi008.flmjzp (mgr.14640) 846 : cluster [DBG] pgmap v597: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:53.827828+0000 mon.smithi008 (mon.0) 1322 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:53.828987+0000 mon.smithi008 (mon.0) 1323 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:12:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:53.830127+0000 mon.smithi008 (mon.0) 1324 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:12:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:53.836203+0000 mon.smithi008 (mon.0) 1325 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:12:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:53.842943+0000 mon.smithi008 (mon.0) 1326 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:12:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:53.846555+0000 mon.smithi008 (mon.0) 1327 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:53.848552+0000 mon.smithi008 (mon.0) 1328 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:53.850530+0000 mon.smithi008 (mon.0) 1329 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:54.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:12:53.853198+0000 mon.smithi008 (mon.0) 1330 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:12:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:53.831075+0000 mgr.smithi008.flmjzp (mgr.14640) 847 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:53.831836+0000 mgr.smithi008.flmjzp (mgr.14640) 848 : cluster [DBG] pgmap v598: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:53.832099+0000 mgr.smithi008.flmjzp (mgr.14640) 849 : cluster [DBG] pgmap v599: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:12:53.855504+0000 mgr.smithi008.flmjzp (mgr.14640) 850 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:53.831075+0000 mgr.smithi008.flmjzp (mgr.14640) 847 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:12:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:53.831836+0000 mgr.smithi008.flmjzp (mgr.14640) 848 : cluster [DBG] pgmap v598: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:53.832099+0000 mgr.smithi008.flmjzp (mgr.14640) 849 : cluster [DBG] pgmap v599: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:12:53.855504+0000 mgr.smithi008.flmjzp (mgr.14640) 850 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:12:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:55.832679+0000 mgr.smithi008.flmjzp (mgr.14640) 851 : cluster [DBG] pgmap v600: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:57.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:55.832679+0000 mgr.smithi008.flmjzp (mgr.14640) 851 : cluster [DBG] pgmap v600: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:12:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:57.833123+0000 mgr.smithi008.flmjzp (mgr.14640) 852 : cluster [DBG] pgmap v601: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:12:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:12:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:57.833123+0000 mgr.smithi008.flmjzp (mgr.14640) 852 : cluster [DBG] pgmap v601: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:12:59.833660+0000 mgr.smithi008.flmjzp (mgr.14640) 853 : cluster [DBG] pgmap v602: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:12:59.833660+0000 mgr.smithi008.flmjzp (mgr.14640) 853 : cluster [DBG] pgmap v602: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:01.834217+0000 mgr.smithi008.flmjzp (mgr.14640) 854 : cluster [DBG] pgmap v603: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:03.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:01.834217+0000 mgr.smithi008.flmjzp (mgr.14640) 854 : cluster [DBG] pgmap v603: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:03.862935+0000 mon.smithi008 (mon.0) 1331 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:04.424044+0000 mon.smithi008 (mon.0) 1332 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:04.425148+0000 mon.smithi008 (mon.0) 1333 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:04.431749+0000 mon.smithi008 (mon.0) 1334 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:04.438300+0000 mon.smithi008 (mon.0) 1335 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:04.441682+0000 mon.smithi008 (mon.0) 1336 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:04.443522+0000 mon.smithi008 (mon.0) 1337 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:04.445260+0000 mon.smithi008 (mon.0) 1338 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:04.447412+0000 mon.smithi008 (mon.0) 1339 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:03.862935+0000 mon.smithi008 (mon.0) 1331 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:04.424044+0000 mon.smithi008 (mon.0) 1332 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:04.425148+0000 mon.smithi008 (mon.0) 1333 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:04.431749+0000 mon.smithi008 (mon.0) 1334 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:04.438300+0000 mon.smithi008 (mon.0) 1335 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:04.441682+0000 mon.smithi008 (mon.0) 1336 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:04.443522+0000 mon.smithi008 (mon.0) 1337 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:04.445260+0000 mon.smithi008 (mon.0) 1338 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:04.447412+0000 mon.smithi008 (mon.0) 1339 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:03.834771+0000 mgr.smithi008.flmjzp (mgr.14640) 855 : cluster [DBG] pgmap v604: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:04.426021+0000 mgr.smithi008.flmjzp (mgr.14640) 856 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:04.426677+0000 mgr.smithi008.flmjzp (mgr.14640) 857 : cluster [DBG] pgmap v605: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:04.427010+0000 mgr.smithi008.flmjzp (mgr.14640) 858 : cluster [DBG] pgmap v606: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:04.449494+0000 mgr.smithi008.flmjzp (mgr.14640) 859 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:03.834771+0000 mgr.smithi008.flmjzp (mgr.14640) 855 : cluster [DBG] pgmap v604: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:04.426021+0000 mgr.smithi008.flmjzp (mgr.14640) 856 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:04.426677+0000 mgr.smithi008.flmjzp (mgr.14640) 857 : cluster [DBG] pgmap v605: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:04.427010+0000 mgr.smithi008.flmjzp (mgr.14640) 858 : cluster [DBG] pgmap v606: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:05.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:04.449494+0000 mgr.smithi008.flmjzp (mgr.14640) 859 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:06.427572+0000 mgr.smithi008.flmjzp (mgr.14640) 860 : cluster [DBG] pgmap v607: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:07.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:06.427572+0000 mgr.smithi008.flmjzp (mgr.14640) 860 : cluster [DBG] pgmap v607: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:08.428021+0000 mgr.smithi008.flmjzp (mgr.14640) 861 : cluster [DBG] pgmap v608: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:09.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:08.428021+0000 mgr.smithi008.flmjzp (mgr.14640) 861 : cluster [DBG] pgmap v608: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:10.428661+0000 mgr.smithi008.flmjzp (mgr.14640) 862 : cluster [DBG] pgmap v609: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:10.428661+0000 mgr.smithi008.flmjzp (mgr.14640) 862 : cluster [DBG] pgmap v609: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:12.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.838+0000 7f6a79f33700 1 -- 172.21.15.8:0/1675247396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a740f77d0 msgr2=0x7f6a740f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.838+0000 7f6a79f33700 1 --2- 172.21.15.8:0/1675247396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a740f77d0 0x7f6a740f7c30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f6a60004660 tx=0x7f6a60009b30).stop 2023-10-18T21:13:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.838+0000 7f6a79f33700 1 -- 172.21.15.8:0/1675247396 shutdown_connections 2023-10-18T21:13:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.838+0000 7f6a79f33700 1 --2- 172.21.15.8:0/1675247396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a740f77d0 0x7f6a740f7c30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.838+0000 7f6a79f33700 1 --2- 172.21.15.8:0/1675247396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a740f6530 0x7f6a740f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:12.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.838+0000 7f6a79f33700 1 -- 172.21.15.8:0/1675247396 >> 172.21.15.8:0/1675247396 conn(0x7f6a740f1c70 msgr2=0x7f6a740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:12.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.838+0000 7f6a79f33700 1 -- 172.21.15.8:0/1675247396 shutdown_connections 2023-10-18T21:13:12.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.838+0000 7f6a79f33700 1 -- 172.21.15.8:0/1675247396 wait complete. 2023-10-18T21:13:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.839+0000 7f6a79f33700 1 Processor -- start 2023-10-18T21:13:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.839+0000 7f6a79f33700 1 -- start start 2023-10-18T21:13:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.839+0000 7f6a79f33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a740f6530 0x7f6a7406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.839+0000 7f6a79f33700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a740f77d0 0x7f6a74069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.839+0000 7f6a79f33700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7406a380 con 0x7f6a740f6530 2023-10-18T21:13:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.839+0000 7f6a79f33700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7406a4c0 con 0x7f6a740f77d0 2023-10-18T21:13:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.840+0000 7f6a78f31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a740f6530 0x7f6a7406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.840+0000 7f6a78f31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a740f6530 0x7f6a7406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60582/0 (socket says 172.21.15.8:60582) 2023-10-18T21:13:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.840+0000 7f6a78f31700 1 -- 172.21.15.8:0/1787771354 learned_addr learned my addr 172.21.15.8:0/1787771354 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.840+0000 7f6a78f31700 1 -- 172.21.15.8:0/1787771354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a740f77d0 msgr2=0x7f6a74069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.840+0000 7f6a73fff700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a740f77d0 0x7f6a74069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.840+0000 7f6a78f31700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a740f77d0 0x7f6a74069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.840+0000 7f6a78f31700 1 -- 172.21.15.8:0/1787771354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60005040 con 0x7f6a740f6530 2023-10-18T21:13:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.840+0000 7f6a78f31700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a740f6530 0x7f6a7406b9a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f6a68002700 tx=0x7f6a68009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.841+0000 7f6a717fa700 1 -- 172.21.15.8:0/1787771354 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a68009320 con 0x7f6a740f6530 2023-10-18T21:13:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.841+0000 7f6a717fa700 1 -- 172.21.15.8:0/1787771354 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6a6800f040 con 0x7f6a740f6530 2023-10-18T21:13:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.841+0000 7f6a79f33700 1 -- 172.21.15.8:0/1787771354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7406a7a0 con 0x7f6a740f6530 2023-10-18T21:13:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.841+0000 7f6a717fa700 1 -- 172.21.15.8:0/1787771354 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a68014970 con 0x7f6a740f6530 2023-10-18T21:13:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.841+0000 7f6a79f33700 1 -- 172.21.15.8:0/1787771354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7410ed90 con 0x7f6a740f6530 2023-10-18T21:13:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.842+0000 7f6a79f33700 1 -- 172.21.15.8:0/1787771354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a74045ad0 con 0x7f6a740f6530 2023-10-18T21:13:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.843+0000 7f6a717fa700 1 -- 172.21.15.8:0/1787771354 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6a68009480 con 0x7f6a740f6530 2023-10-18T21:13:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.844+0000 7f6a717fa700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a64060f70 0x7f6a64063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:12.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.844+0000 7f6a717fa700 1 -- 172.21.15.8:0/1787771354 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6a6807cc40 con 0x7f6a740f6530 2023-10-18T21:13:12.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.844+0000 7f6a73fff700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a64060f70 0x7f6a64063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:12.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.844+0000 7f6a73fff700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a64060f70 0x7f6a64063430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f6a60009d60 tx=0x7f6a60009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:12.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:12.848+0000 7f6a717fa700 1 -- 172.21.15.8:0/1787771354 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6a6804c7f0 con 0x7f6a740f6530 2023-10-18T21:13:13.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.047+0000 7f6a79f33700 1 -- 172.21.15.8:0/1787771354 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a740fee40 con 0x7f6a64060f70 2023-10-18T21:13:13.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.048+0000 7f6a717fa700 1 -- 172.21.15.8:0/1787771354 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6a740fee40 con 0x7f6a64060f70 2023-10-18T21:13:13.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.050+0000 7f6a79f33700 1 -- 172.21.15.8:0/1787771354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a64060f70 msgr2=0x7f6a64063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.050+0000 7f6a79f33700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a64060f70 0x7f6a64063430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f6a60009d60 tx=0x7f6a60009b30).stop 2023-10-18T21:13:13.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.050+0000 7f6a79f33700 1 -- 172.21.15.8:0/1787771354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a740f6530 msgr2=0x7f6a7406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.050+0000 7f6a79f33700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a740f6530 0x7f6a7406b9a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f6a68002700 tx=0x7f6a68009d80).stop 2023-10-18T21:13:13.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.051+0000 7f6a79f33700 1 -- 172.21.15.8:0/1787771354 shutdown_connections 2023-10-18T21:13:13.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.051+0000 7f6a79f33700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a64060f70 0x7f6a64063430 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.051+0000 7f6a79f33700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a740f6530 0x7f6a7406b9a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.051+0000 7f6a79f33700 1 --2- 172.21.15.8:0/1787771354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a740f77d0 0x7f6a74069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.051+0000 7f6a79f33700 1 -- 172.21.15.8:0/1787771354 >> 172.21.15.8:0/1787771354 conn(0x7f6a740f1c70 msgr2=0x7f6a740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:13.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.051+0000 7f6a79f33700 1 -- 172.21.15.8:0/1787771354 shutdown_connections 2023-10-18T21:13:13.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.051+0000 7f6a79f33700 1 -- 172.21.15.8:0/1787771354 wait complete. 2023-10-18T21:13:13.067 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:13:13.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.189+0000 7f99fb42a700 1 -- 172.21.15.8:0/2691197950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99f40f77d0 msgr2=0x7f99f40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.189+0000 7f99fb42a700 1 --2- 172.21.15.8:0/2691197950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99f40f77d0 0x7f99f40f7c30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f99e4004660 tx=0x7f99e4009b30).stop 2023-10-18T21:13:13.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.189+0000 7f99fb42a700 1 -- 172.21.15.8:0/2691197950 shutdown_connections 2023-10-18T21:13:13.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.189+0000 7f99fb42a700 1 --2- 172.21.15.8:0/2691197950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99f40f77d0 0x7f99f40f7c30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.189+0000 7f99fb42a700 1 --2- 172.21.15.8:0/2691197950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99f40f6530 0x7f99f40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.189+0000 7f99fb42a700 1 -- 172.21.15.8:0/2691197950 >> 172.21.15.8:0/2691197950 conn(0x7f99f40f1c90 msgr2=0x7f99f40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:13.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.189+0000 7f99fb42a700 1 -- 172.21.15.8:0/2691197950 shutdown_connections 2023-10-18T21:13:13.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.189+0000 7f99fb42a700 1 -- 172.21.15.8:0/2691197950 wait complete. 2023-10-18T21:13:13.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.190+0000 7f99fb42a700 1 Processor -- start 2023-10-18T21:13:13.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.190+0000 7f99fb42a700 1 -- start start 2023-10-18T21:13:13.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.190+0000 7f99fb42a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99f40f6530 0x7f99f4108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:13.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.190+0000 7f99fb42a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99f40f77d0 0x7f99f4109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:13.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.190+0000 7f99fb42a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f41099d0 con 0x7f99f40f6530 2023-10-18T21:13:13.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.190+0000 7f99fb42a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4109b10 con 0x7f99f40f77d0 2023-10-18T21:13:13.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.190+0000 7f99fa428700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99f40f6530 0x7f99f4108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:13.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99fa428700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99f40f6530 0x7f99f4108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60610/0 (socket says 172.21.15.8:60610) 2023-10-18T21:13:13.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99fa428700 1 -- 172.21.15.8:0/1741879112 learned_addr learned my addr 172.21.15.8:0/1741879112 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:13.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99f9c27700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99f40f77d0 0x7f99f4109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:13.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99fa428700 1 -- 172.21.15.8:0/1741879112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99f40f77d0 msgr2=0x7f99f4109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99fa428700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99f40f77d0 0x7f99f4109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99fa428700 1 -- 172.21.15.8:0/1741879112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e4005040 con 0x7f99f40f6530 2023-10-18T21:13:13.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99fa428700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99f40f6530 0x7f99f4108f30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f99f0002700 tx=0x7f99f0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:13.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99eaffd700 1 -- 172.21.15.8:0/1741879112 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99f0009320 con 0x7f99f40f6530 2023-10-18T21:13:13.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99eaffd700 1 -- 172.21.15.8:0/1741879112 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f99f000f040 con 0x7f99f40f6530 2023-10-18T21:13:13.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99eaffd700 1 -- 172.21.15.8:0/1741879112 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99f0014970 con 0x7f99f40f6530 2023-10-18T21:13:13.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.191+0000 7f99fb42a700 1 -- 172.21.15.8:0/1741879112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f410a4b0 con 0x7f99f40f6530 2023-10-18T21:13:13.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.192+0000 7f99fb42a700 1 -- 172.21.15.8:0/1741879112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f410aa70 con 0x7f99f40f6530 2023-10-18T21:13:13.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.193+0000 7f99fb42a700 1 -- 172.21.15.8:0/1741879112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f4045ad0 con 0x7f99f40f6530 2023-10-18T21:13:13.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.194+0000 7f99eaffd700 1 -- 172.21.15.8:0/1741879112 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f99f0009480 con 0x7f99f40f6530 2023-10-18T21:13:13.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.195+0000 7f99eaffd700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99e0060f70 0x7f99e0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:13.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.195+0000 7f99eaffd700 1 -- 172.21.15.8:0/1741879112 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f99f007cb90 con 0x7f99f40f6530 2023-10-18T21:13:13.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.195+0000 7f99f9c27700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99e0060f70 0x7f99e0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:13.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.196+0000 7f99f9c27700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99e0060f70 0x7f99e0063430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f99e4009d60 tx=0x7f99e4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:13.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.199+0000 7f99eaffd700 1 -- 172.21.15.8:0/1741879112 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f99f00501f0 con 0x7f99f40f6530 2023-10-18T21:13:13.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.399+0000 7f99fb42a700 1 -- 172.21.15.8:0/1741879112 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99f40fee40 con 0x7f99e0060f70 2023-10-18T21:13:13.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.400+0000 7f99eaffd700 1 -- 172.21.15.8:0/1741879112 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f99f40fee40 con 0x7f99e0060f70 2023-10-18T21:13:13.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 -- 172.21.15.8:0/1741879112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99e0060f70 msgr2=0x7f99e0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99e0060f70 0x7f99e0063430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f99e4009d60 tx=0x7f99e4009b30).stop 2023-10-18T21:13:13.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 -- 172.21.15.8:0/1741879112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99f40f6530 msgr2=0x7f99f4108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99f40f6530 0x7f99f4108f30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f99f0002700 tx=0x7f99f0009d80).stop 2023-10-18T21:13:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 -- 172.21.15.8:0/1741879112 shutdown_connections 2023-10-18T21:13:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99e0060f70 0x7f99e0063430 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99f40f6530 0x7f99f4108f30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 --2- 172.21.15.8:0/1741879112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99f40f77d0 0x7f99f4109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 -- 172.21.15.8:0/1741879112 >> 172.21.15.8:0/1741879112 conn(0x7f99f40f1c90 msgr2=0x7f99f406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 -- 172.21.15.8:0/1741879112 shutdown_connections 2023-10-18T21:13:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.402+0000 7f99fb42a700 1 -- 172.21.15.8:0/1741879112 wait complete. 2023-10-18T21:13:13.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.539+0000 7f167359e700 1 -- 172.21.15.8:0/612641701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16740f77d0 msgr2=0x7f16740f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.539+0000 7f167359e700 1 --2- 172.21.15.8:0/612641701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16740f77d0 0x7f16740f7c30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f1668004660 tx=0x7f1668009b30).stop 2023-10-18T21:13:13.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.539+0000 7f167359e700 1 -- 172.21.15.8:0/612641701 shutdown_connections 2023-10-18T21:13:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.539+0000 7f167359e700 1 --2- 172.21.15.8:0/612641701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16740f77d0 0x7f16740f7c30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.539+0000 7f167359e700 1 --2- 172.21.15.8:0/612641701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16740f6530 0x7f16740f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.539+0000 7f167359e700 1 -- 172.21.15.8:0/612641701 >> 172.21.15.8:0/612641701 conn(0x7f16740f1c90 msgr2=0x7f16740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.539+0000 7f167359e700 1 -- 172.21.15.8:0/612641701 shutdown_connections 2023-10-18T21:13:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.540+0000 7f167359e700 1 -- 172.21.15.8:0/612641701 wait complete. 2023-10-18T21:13:13.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.540+0000 7f167359e700 1 Processor -- start 2023-10-18T21:13:13.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.541+0000 7f167359e700 1 -- start start 2023-10-18T21:13:13.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.541+0000 7f167359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16740f6530 0x7f167406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:13.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.541+0000 7f167359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16740f77d0 0x7f1674069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:13.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.541+0000 7f167359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167406a380 con 0x7f16740f6530 2023-10-18T21:13:13.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.541+0000 7f167359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167406a4c0 con 0x7f16740f77d0 2023-10-18T21:13:13.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.541+0000 7f167259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16740f6530 0x7f167406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.541+0000 7f167259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16740f6530 0x7f167406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60616/0 (socket says 172.21.15.8:60616) 2023-10-18T21:13:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.541+0000 7f167259c700 1 -- 172.21.15.8:0/1372860761 learned_addr learned my addr 172.21.15.8:0/1372860761 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.542+0000 7f167259c700 1 -- 172.21.15.8:0/1372860761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16740f77d0 msgr2=0x7f1674069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.542+0000 7f167259c700 1 --2- 172.21.15.8:0/1372860761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16740f77d0 0x7f1674069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:13:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.542+0000 7f167259c700 1 -- 172.21.15.8:0/1372860761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668005040 con 0x7f16740f6530 2023-10-18T21:13:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.542+0000 7f167259c700 1 --2- 172.21.15.8:0/1372860761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16740f6530 0x7f167406b9a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f166400e7c0 tx=0x7f166400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.542+0000 7f1662ffd700 1 -- 172.21.15.8:0/1372860761 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16640092e0 con 0x7f16740f6530 2023-10-18T21:13:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.542+0000 7f1662ffd700 1 -- 172.21.15.8:0/1372860761 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f166400f040 con 0x7f16740f6530 2023-10-18T21:13:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.542+0000 7f167359e700 1 -- 172.21.15.8:0/1372860761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167406a7a0 con 0x7f16740f6530 2023-10-18T21:13:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.542+0000 7f1662ffd700 1 -- 172.21.15.8:0/1372860761 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16640147e0 con 0x7f16740f6530 2023-10-18T21:13:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.542+0000 7f167359e700 1 -- 172.21.15.8:0/1372860761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167410ed20 con 0x7f16740f6530 2023-10-18T21:13:13.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.543+0000 7f167359e700 1 -- 172.21.15.8:0/1372860761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1674059100 con 0x7f16740f6530 2023-10-18T21:13:13.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.544+0000 7f1662ffd700 1 -- 172.21.15.8:0/1372860761 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f166401b030 con 0x7f16740f6530 2023-10-18T21:13:13.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.545+0000 7f1662ffd700 1 --2- 172.21.15.8:0/1372860761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f165c060f70 0x7f165c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:13.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.545+0000 7f1662ffd700 1 -- 172.21.15.8:0/1372860761 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f166407c9b0 con 0x7f16740f6530 2023-10-18T21:13:13.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.545+0000 7f1671d9b700 1 --2- 172.21.15.8:0/1372860761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f165c060f70 0x7f165c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:13.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.546+0000 7f1671d9b700 1 --2- 172.21.15.8:0/1372860761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f165c060f70 0x7f165c063430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f1668005010 tx=0x7f166800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.549+0000 7f1662ffd700 1 -- 172.21.15.8:0/1372860761 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f166404c620 con 0x7f16740f6530 2023-10-18T21:13:13.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:12.429131+0000 mgr.smithi008.flmjzp (mgr.14640) 863 : cluster [DBG] pgmap v610: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:13.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.742+0000 7f167359e700 1 -- 172.21.15.8:0/1372860761 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f16740fee50 con 0x7f165c060f70 2023-10-18T21:13:13.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.751+0000 7f1662ffd700 1 -- 172.21.15.8:0/1372860761 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f16740fee50 con 0x7f165c060f70 2023-10-18T21:13:13.754 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:13:13.754 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (19m) 8m ago 21m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:13:13.754 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (13m) 8m ago 21m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:13:13.754 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (13m) 5m ago 20m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:13:13.755 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (19m) 8m ago 21m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:13:13.755 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (8m) 8m ago 17m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:13:13.755 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 17m - - 2023-10-18T21:13:13.755 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (6m) 5m ago 17m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:13:13.755 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (6m) 5m ago 17m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:13:13.756 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (15m) 8m ago 22m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:13:13.756 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (14m) 5m ago 20m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:13:13.756 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (14m) 8m ago 22m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:13:13.756 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (14m) 5m ago 20m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:13:13.756 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (20m) 8m ago 20m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:13:13.757 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (20m) 5m ago 20m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:13:13.757 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (13m) 8m ago 19m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:13:13.757 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (11m) 8m ago 19m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:13:13.757 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (10m) 8m ago 19m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:13:13.757 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (10m) 5m ago 19m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:13:13.758 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (9m) 5m ago 18m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:13:13.758 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (9m) 5m ago 18m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:13:13.758 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (15m) 8m ago 20m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:13:13.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.753+0000 7f167359e700 1 -- 172.21.15.8:0/1372860761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f165c060f70 msgr2=0x7f165c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.753+0000 7f167359e700 1 --2- 172.21.15.8:0/1372860761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f165c060f70 0x7f165c063430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f1668005010 tx=0x7f166800b040).stop 2023-10-18T21:13:13.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.753+0000 7f167359e700 1 -- 172.21.15.8:0/1372860761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16740f6530 msgr2=0x7f167406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.753+0000 7f167359e700 1 --2- 172.21.15.8:0/1372860761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16740f6530 0x7f167406b9a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f166400e7c0 tx=0x7f166400b040).stop 2023-10-18T21:13:13.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.754+0000 7f167359e700 1 -- 172.21.15.8:0/1372860761 shutdown_connections 2023-10-18T21:13:13.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.754+0000 7f167359e700 1 --2- 172.21.15.8:0/1372860761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f165c060f70 0x7f165c063430 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.754+0000 7f167359e700 1 --2- 172.21.15.8:0/1372860761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16740f6530 0x7f167406b9a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.754+0000 7f167359e700 1 --2- 172.21.15.8:0/1372860761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16740f77d0 0x7f1674069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:13:13.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.754+0000 7f167359e700 1 -- 172.21.15.8:0/1372860761 >> 172.21.15.8:0/1372860761 conn(0x7f16740f1c90 msgr2=0x7f16740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:13.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.754+0000 7f167359e700 1 -- 172.21.15.8:0/1372860761 shutdown_connections 2023-10-18T21:13:13.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.754+0000 7f167359e700 1 -- 172.21.15.8:0/1372860761 wait complete. 2023-10-18T21:13:13.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.889+0000 7f1a6e285700 1 -- 172.21.15.8:0/297298302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a680f77d0 msgr2=0x7f1a680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.889+0000 7f1a6e285700 1 --2- 172.21.15.8:0/297298302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a680f77d0 0x7f1a680f7c30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f1a58004660 tx=0x7f1a58009b30).stop 2023-10-18T21:13:13.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.889+0000 7f1a6e285700 1 -- 172.21.15.8:0/297298302 shutdown_connections 2023-10-18T21:13:13.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.889+0000 7f1a6e285700 1 --2- 172.21.15.8:0/297298302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a680f77d0 0x7f1a680f7c30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.889+0000 7f1a6e285700 1 --2- 172.21.15.8:0/297298302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680f6530 0x7f1a680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.889+0000 7f1a6e285700 1 -- 172.21.15.8:0/297298302 >> 172.21.15.8:0/297298302 conn(0x7f1a680f1c90 msgr2=0x7f1a680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:13.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.889+0000 7f1a6e285700 1 -- 172.21.15.8:0/297298302 shutdown_connections 2023-10-18T21:13:13.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.889+0000 7f1a6e285700 1 -- 172.21.15.8:0/297298302 wait complete. 2023-10-18T21:13:13.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.890+0000 7f1a6e285700 1 Processor -- start 2023-10-18T21:13:13.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.890+0000 7f1a6e285700 1 -- start start 2023-10-18T21:13:13.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6e285700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a680f6530 0x7f1a6806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:13.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6e285700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680f77d0 0x7f1a68069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:13.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6e285700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6806a380 con 0x7f1a680f6530 2023-10-18T21:13:13.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6e285700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6806a4c0 con 0x7f1a680f77d0 2023-10-18T21:13:13.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6d283700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a680f6530 0x7f1a6806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:13.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6d283700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a680f6530 0x7f1a6806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60632/0 (socket says 172.21.15.8:60632) 2023-10-18T21:13:13.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6d283700 1 -- 172.21.15.8:0/1847230578 learned_addr learned my addr 172.21.15.8:0/1847230578 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:13.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6ca82700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680f77d0 0x7f1a68069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:13.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6d283700 1 -- 172.21.15.8:0/1847230578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680f77d0 msgr2=0x7f1a68069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:13.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6d283700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680f77d0 0x7f1a68069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:13.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6d283700 1 -- 172.21.15.8:0/1847230578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a58005040 con 0x7f1a680f6530 2023-10-18T21:13:13.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.891+0000 7f1a6d283700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a680f6530 0x7f1a6806b9a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f1a64002700 tx=0x7f1a64009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:13.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.892+0000 7f1a5dffb700 1 -- 172.21.15.8:0/1847230578 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a640079c0 con 0x7f1a680f6530 2023-10-18T21:13:13.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.892+0000 7f1a5dffb700 1 -- 172.21.15.8:0/1847230578 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1a6400f040 con 0x7f1a680f6530 2023-10-18T21:13:13.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.892+0000 7f1a6e285700 1 -- 172.21.15.8:0/1847230578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6806a7a0 con 0x7f1a680f6530 2023-10-18T21:13:13.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.892+0000 7f1a5dffb700 1 -- 172.21.15.8:0/1847230578 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a640148d0 con 0x7f1a680f6530 2023-10-18T21:13:13.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.892+0000 7f1a6e285700 1 -- 172.21.15.8:0/1847230578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6810ed00 con 0x7f1a680f6530 2023-10-18T21:13:13.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.893+0000 7f1a6e285700 1 -- 172.21.15.8:0/1847230578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a68045ad0 con 0x7f1a680f6530 2023-10-18T21:13:13.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.894+0000 7f1a5dffb700 1 -- 172.21.15.8:0/1847230578 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1a6401b060 con 0x7f1a680f6530 2023-10-18T21:13:13.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.895+0000 7f1a5dffb700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a54060f70 0x7f1a54063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.895+0000 7f1a5dffb700 1 -- 172.21.15.8:0/1847230578 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1a6407c6b0 con 0x7f1a680f6530 2023-10-18T21:13:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.895+0000 7f1a6ca82700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a54060f70 0x7f1a54063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.896+0000 7f1a6ca82700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a54060f70 0x7f1a54063430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f1a58004630 tx=0x7f1a58009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:13.899+0000 7f1a5dffb700 1 -- 172.21.15.8:0/1847230578 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1a6404c3a0 con 0x7f1a680f6530 2023-10-18T21:13:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:12.429131+0000 mgr.smithi008.flmjzp (mgr.14640) 863 : cluster [DBG] pgmap v610: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.154+0000 7f1a6e285700 1 -- 172.21.15.8:0/1847230578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1a68027a00 con 0x7f1a680f6530 2023-10-18T21:13:14.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.155+0000 7f1a5dffb700 1 -- 172.21.15.8:0/1847230578 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f1a6404f9c0 con 0x7f1a680f6530 2023-10-18T21:13:14.157 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:13:14.157 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:13:14.157 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:13:14.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:13:14.158 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:13:14.158 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:13:14.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:13:14.158 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:13:14.159 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:13:14.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:13:14.159 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:13:14.159 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:13:14.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:13:14.160 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:13:14.160 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:13:14.160 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:13:14.160 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:13:14.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 -- 172.21.15.8:0/1847230578 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a54060f70 msgr2=0x7f1a54063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:14.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a54060f70 0x7f1a54063430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f1a58004630 tx=0x7f1a58009b30).stop 2023-10-18T21:13:14.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 -- 172.21.15.8:0/1847230578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a680f6530 msgr2=0x7f1a6806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:14.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a680f6530 0x7f1a6806b9a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f1a64002700 tx=0x7f1a64009d80).stop 2023-10-18T21:13:14.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 -- 172.21.15.8:0/1847230578 shutdown_connections 2023-10-18T21:13:14.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a54060f70 0x7f1a54063430 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a680f6530 0x7f1a6806b9a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 --2- 172.21.15.8:0/1847230578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680f77d0 0x7f1a68069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 -- 172.21.15.8:0/1847230578 >> 172.21.15.8:0/1847230578 conn(0x7f1a680f1c90 msgr2=0x7f1a680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:14.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 -- 172.21.15.8:0/1847230578 shutdown_connections 2023-10-18T21:13:14.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.157+0000 7f1a6e285700 1 -- 172.21.15.8:0/1847230578 wait complete. 2023-10-18T21:13:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.297+0000 7f85ae00e700 1 -- 172.21.15.8:0/2828508858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85a806b9c0 msgr2=0x7f85a8069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.297+0000 7f85ae00e700 1 --2- 172.21.15.8:0/2828508858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85a806b9c0 0x7f85a8069ec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f85a4004660 tx=0x7f85a4009b30).stop 2023-10-18T21:13:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.297+0000 7f85ae00e700 1 -- 172.21.15.8:0/2828508858 shutdown_connections 2023-10-18T21:13:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.297+0000 7f85ae00e700 1 --2- 172.21.15.8:0/2828508858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a806a3b0 0x7f85a806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.297+0000 7f85ae00e700 1 --2- 172.21.15.8:0/2828508858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85a806b9c0 0x7f85a8069ec0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.297+0000 7f85ae00e700 1 -- 172.21.15.8:0/2828508858 >> 172.21.15.8:0/2828508858 conn(0x7f85a80f1c90 msgr2=0x7f85a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.297+0000 7f85ae00e700 1 -- 172.21.15.8:0/2828508858 shutdown_connections 2023-10-18T21:13:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.297+0000 7f85ae00e700 1 -- 172.21.15.8:0/2828508858 wait complete. 2023-10-18T21:13:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.298+0000 7f85ae00e700 1 Processor -- start 2023-10-18T21:13:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.298+0000 7f85ae00e700 1 -- start start 2023-10-18T21:13:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ae00e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a806a3b0 0x7f85a810d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ae00e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85a806b9c0 0x7f85a810d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ae00e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a810de20 con 0x7f85a806b9c0 2023-10-18T21:13:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ae00e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a810df60 con 0x7f85a806a3b0 2023-10-18T21:13:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ac80b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85a806b9c0 0x7f85a810d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ac80b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85a806b9c0 0x7f85a810d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60648/0 (socket says 172.21.15.8:60648) 2023-10-18T21:13:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ac80b700 1 -- 172.21.15.8:0/3584014803 learned_addr learned my addr 172.21.15.8:0/3584014803 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ad00c700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a806a3b0 0x7f85a810d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:14.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ac80b700 1 -- 172.21.15.8:0/3584014803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a806a3b0 msgr2=0x7f85a810d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:14.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ac80b700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a806a3b0 0x7f85a810d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ac80b700 1 -- 172.21.15.8:0/3584014803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a4005040 con 0x7f85a806b9c0 2023-10-18T21:13:14.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.299+0000 7f85ac80b700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85a806b9c0 0x7f85a810d870 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f85980026d0 tx=0x7f8598009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:14.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.300+0000 7f859dffb700 1 -- 172.21.15.8:0/3584014803 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85980079c0 con 0x7f85a806b9c0 2023-10-18T21:13:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.300+0000 7f859dffb700 1 -- 172.21.15.8:0/3584014803 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f859800f040 con 0x7f85a806b9c0 2023-10-18T21:13:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.300+0000 7f85ae00e700 1 -- 172.21.15.8:0/3584014803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a810e900 con 0x7f85a806b9c0 2023-10-18T21:13:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.300+0000 7f859dffb700 1 -- 172.21.15.8:0/3584014803 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8598014980 con 0x7f85a806b9c0 2023-10-18T21:13:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.300+0000 7f85ae00e700 1 -- 172.21.15.8:0/3584014803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a810eec0 con 0x7f85a806b9c0 2023-10-18T21:13:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.301+0000 7f85ae00e700 1 -- 172.21.15.8:0/3584014803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a8045ad0 con 0x7f85a806b9c0 2023-10-18T21:13:14.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.302+0000 7f859dffb700 1 -- 172.21.15.8:0/3584014803 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f85980090d0 con 0x7f85a806b9c0 2023-10-18T21:13:14.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.303+0000 7f859dffb700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8594060f70 0x7f8594063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:14.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.303+0000 7f859dffb700 1 -- 172.21.15.8:0/3584014803 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f859807c7e0 con 0x7f85a806b9c0 2023-10-18T21:13:14.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.303+0000 7f85ad00c700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8594060f70 0x7f8594063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:14.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.303+0000 7f85ad00c700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8594060f70 0x7f8594063430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f85a4004630 tx=0x7f85a4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:14.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.307+0000 7f859dffb700 1 -- 172.21.15.8:0/3584014803 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f859804ffb0 con 0x7f85a806b9c0 2023-10-18T21:13:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.549+0000 7f85ae00e700 1 -- 172.21.15.8:0/3584014803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f85a810f190 con 0x7f85a806b9c0 2023-10-18T21:13:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.550+0000 7f859dffb700 1 -- 172.21.15.8:0/3584014803 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f859804fba0 con 0x7f85a806b9c0 2023-10-18T21:13:14.552 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:13:14.552 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:13:14.553 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:13:14.553 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:13:14.553 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:13:14.553 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:13:14.553 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:13:14.554 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:13:14.554 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:13:14.554 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:13:14.554 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:13:14.554 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:13:14.555 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:13:14.555 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:13:14.555 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:13:14.555 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:13:14.555 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:13:14.556 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:13:14.556 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:13:14.556 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:13:14.556 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:13:14.556 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:13:14.557 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:13:14.557 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:13:14.557 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:13:14.557 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:13:14.557 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:13:14.557 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:13:14.558 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:13:14.558 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:13:14.558 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:13:14.558 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:13:14.558 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:13:14.558 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:13:14.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 -- 172.21.15.8:0/3584014803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8594060f70 msgr2=0x7f8594063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:14.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8594060f70 0x7f8594063430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f85a4004630 tx=0x7f85a4009b30).stop 2023-10-18T21:13:14.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 -- 172.21.15.8:0/3584014803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85a806b9c0 msgr2=0x7f85a810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:14.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85a806b9c0 0x7f85a810d870 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f85980026d0 tx=0x7f8598009de0).stop 2023-10-18T21:13:14.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 -- 172.21.15.8:0/3584014803 shutdown_connections 2023-10-18T21:13:14.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8594060f70 0x7f8594063430 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a806a3b0 0x7f85a810d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 --2- 172.21.15.8:0/3584014803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85a806b9c0 0x7f85a810d870 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 -- 172.21.15.8:0/3584014803 >> 172.21.15.8:0/3584014803 conn(0x7f85a80f1c90 msgr2=0x7f85a80f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:14.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 -- 172.21.15.8:0/3584014803 shutdown_connections 2023-10-18T21:13:14.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.552+0000 7f85ae00e700 1 -- 172.21.15.8:0/3584014803 wait complete. 2023-10-18T21:13:14.561 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:13:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:13.049803+0000 mgr.smithi008.flmjzp (mgr.14640) 864 : audit [DBG] from='client.34908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:13.401406+0000 mgr.smithi008.flmjzp (mgr.14640) 865 : audit [DBG] from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.156187+0000 mon.smithi008 (mon.0) 1340 : audit [DBG] from='client.? 172.21.15.8:0/1847230578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.459888+0000 mon.smithi008 (mon.0) 1341 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.461495+0000 mon.smithi008 (mon.0) 1342 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.462179+0000 mon.smithi008 (mon.0) 1343 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.468603+0000 mon.smithi008 (mon.0) 1344 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.476707+0000 mon.smithi008 (mon.0) 1345 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.479824+0000 mon.smithi008 (mon.0) 1346 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.481511+0000 mon.smithi008 (mon.0) 1347 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.483136+0000 mon.smithi008 (mon.0) 1348 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:14.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.689+0000 7f5912b31700 1 -- 172.21.15.8:0/2257754448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f590c0f77d0 msgr2=0x7f590c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:14.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.689+0000 7f5912b31700 1 --2- 172.21.15.8:0/2257754448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f590c0f77d0 0x7f590c0f7c30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f58fc004660 tx=0x7f58fc009b30).stop 2023-10-18T21:13:14.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.690+0000 7f5912b31700 1 -- 172.21.15.8:0/2257754448 shutdown_connections 2023-10-18T21:13:14.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.690+0000 7f5912b31700 1 --2- 172.21.15.8:0/2257754448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f590c0f77d0 0x7f590c0f7c30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.690+0000 7f5912b31700 1 --2- 172.21.15.8:0/2257754448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c0f6530 0x7f590c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.690+0000 7f5912b31700 1 -- 172.21.15.8:0/2257754448 >> 172.21.15.8:0/2257754448 conn(0x7f590c0f1c90 msgr2=0x7f590c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:14.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.690+0000 7f5912b31700 1 -- 172.21.15.8:0/2257754448 shutdown_connections 2023-10-18T21:13:14.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.690+0000 7f5912b31700 1 -- 172.21.15.8:0/2257754448 wait complete. 2023-10-18T21:13:14.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.690+0000 7f5912b31700 1 Processor -- start 2023-10-18T21:13:14.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.691+0000 7f5912b31700 1 -- start start 2023-10-18T21:13:14.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.691+0000 7f5912b31700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c0f6530 0x7f590c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:14.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.691+0000 7f5912b31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f590c0f77d0 0x7f590c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:14.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.691+0000 7f5912b31700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c109a20 con 0x7f590c0f77d0 2023-10-18T21:13:14.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.691+0000 7f5912b31700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c109b60 con 0x7f590c0f6530 2023-10-18T21:13:14.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.691+0000 7f591132e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f590c0f77d0 0x7f590c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:14.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.691+0000 7f591132e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f590c0f77d0 0x7f590c109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60660/0 (socket says 172.21.15.8:60660) 2023-10-18T21:13:14.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.691+0000 7f591132e700 1 -- 172.21.15.8:0/1780418861 learned_addr learned my addr 172.21.15.8:0/1780418861 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:14.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.691+0000 7f5911b2f700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c0f6530 0x7f590c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:14.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.692+0000 7f591132e700 1 -- 172.21.15.8:0/1780418861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c0f6530 msgr2=0x7f590c108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:14.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.692+0000 7f591132e700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c0f6530 0x7f590c108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.692+0000 7f591132e700 1 -- 172.21.15.8:0/1780418861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc005040 con 0x7f590c0f77d0 2023-10-18T21:13:14.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.692+0000 7f591132e700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f590c0f77d0 0x7f590c109470 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f58fc009990 tx=0x7f58fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:14.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.692+0000 7f59027fc700 1 -- 172.21.15.8:0/1780418861 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58fc018070 con 0x7f590c0f77d0 2023-10-18T21:13:14.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.692+0000 7f59027fc700 1 -- 172.21.15.8:0/1780418861 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f58fc009630 con 0x7f590c0f77d0 2023-10-18T21:13:14.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.692+0000 7f5912b31700 1 -- 172.21.15.8:0/1780418861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c10a4a0 con 0x7f590c0f77d0 2023-10-18T21:13:14.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.692+0000 7f59027fc700 1 -- 172.21.15.8:0/1780418861 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58fc01c3c0 con 0x7f590c0f77d0 2023-10-18T21:13:14.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.692+0000 7f5912b31700 1 -- 172.21.15.8:0/1780418861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c10aa00 con 0x7f590c0f77d0 2023-10-18T21:13:14.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.694+0000 7f5912b31700 1 -- 172.21.15.8:0/1780418861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c045ad0 con 0x7f590c0f77d0 2023-10-18T21:13:14.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.694+0000 7f59027fc700 1 -- 172.21.15.8:0/1780418861 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f58fc01d970 con 0x7f590c0f77d0 2023-10-18T21:13:14.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.695+0000 7f59027fc700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f58f8060f70 0x7f58f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:14.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.695+0000 7f59027fc700 1 -- 172.21.15.8:0/1780418861 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f58fc07e4e0 con 0x7f590c0f77d0 2023-10-18T21:13:14.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.696+0000 7f5911b2f700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f58f8060f70 0x7f58f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:14.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.696+0000 7f5911b2f700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f58f8060f70 0x7f58f8063430 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f590c0f7630 tx=0x7f590800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:14.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.700+0000 7f59027fc700 1 -- 172.21.15.8:0/1780418861 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f58fc051c00 con 0x7f590c0f77d0 2023-10-18T21:13:14.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.895+0000 7f5912b31700 1 -- 172.21.15.8:0/1780418861 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f590c0fedd0 con 0x7f58f8060f70 2023-10-18T21:13:14.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.896+0000 7f59027fc700 1 -- 172.21.15.8:0/1780418861 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f590c0fedd0 con 0x7f58f8060f70 2023-10-18T21:13:14.899 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:13:14.899 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:13:14.899 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:13:14.899 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:13:14.899 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:13:14.900 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:13:14.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:13:14.900 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:13:14.900 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:13:14.900 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:13:14.901 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:13:14.901 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:13:14.901 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:13:14.901 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:13:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.898+0000 7f5912b31700 1 -- 172.21.15.8:0/1780418861 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f58f8060f70 msgr2=0x7f58f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.898+0000 7f5912b31700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f58f8060f70 0x7f58f8063430 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f590c0f7630 tx=0x7f590800b040).stop 2023-10-18T21:13:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.898+0000 7f5912b31700 1 -- 172.21.15.8:0/1780418861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f590c0f77d0 msgr2=0x7f590c109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.898+0000 7f5912b31700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f590c0f77d0 0x7f590c109470 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f58fc009990 tx=0x7f58fc009b30).stop 2023-10-18T21:13:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.899+0000 7f5912b31700 1 -- 172.21.15.8:0/1780418861 shutdown_connections 2023-10-18T21:13:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.899+0000 7f5912b31700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f58f8060f70 0x7f58f8063430 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.899+0000 7f5912b31700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f590c0f6530 0x7f590c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.899+0000 7f5912b31700 1 --2- 172.21.15.8:0/1780418861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f590c0f77d0 0x7f590c109470 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.899+0000 7f5912b31700 1 -- 172.21.15.8:0/1780418861 >> 172.21.15.8:0/1780418861 conn(0x7f590c0f1c90 msgr2=0x7f590c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.899+0000 7f5912b31700 1 -- 172.21.15.8:0/1780418861 shutdown_connections 2023-10-18T21:13:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:14.899+0000 7f5912b31700 1 -- 172.21.15.8:0/1780418861 wait complete. 2023-10-18T21:13:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:13.049803+0000 mgr.smithi008.flmjzp (mgr.14640) 864 : audit [DBG] from='client.34908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:13.401406+0000 mgr.smithi008.flmjzp (mgr.14640) 865 : audit [DBG] from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.156187+0000 mon.smithi008 (mon.0) 1340 : audit [DBG] from='client.? 172.21.15.8:0/1847230578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.459888+0000 mon.smithi008 (mon.0) 1341 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.461495+0000 mon.smithi008 (mon.0) 1342 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.462179+0000 mon.smithi008 (mon.0) 1343 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.468603+0000 mon.smithi008 (mon.0) 1344 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:14.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.476707+0000 mon.smithi008 (mon.0) 1345 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:14.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.479824+0000 mon.smithi008 (mon.0) 1346 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:14.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.481511+0000 mon.smithi008 (mon.0) 1347 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:14.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.483136+0000 mon.smithi008 (mon.0) 1348 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:13.744184+0000 mgr.smithi008.flmjzp (mgr.14640) 866 : audit [DBG] from='client.34916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:14.429552+0000 mgr.smithi008.flmjzp (mgr.14640) 867 : cluster [DBG] pgmap v611: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:14.462954+0000 mgr.smithi008.flmjzp (mgr.14640) 868 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:14.463513+0000 mgr.smithi008.flmjzp (mgr.14640) 869 : cluster [DBG] pgmap v612: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:14.463782+0000 mgr.smithi008.flmjzp (mgr.14640) 870 : cluster [DBG] pgmap v613: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.487467+0000 mon.smithi008 (mon.0) 1349 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:14.490197+0000 mgr.smithi008.flmjzp (mgr.14640) 871 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.551600+0000 mon.smithi008 (mon.0) 1350 : audit [DBG] from='client.? 172.21.15.8:0/3584014803' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:13:15.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:13.744184+0000 mgr.smithi008.flmjzp (mgr.14640) 866 : audit [DBG] from='client.34916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:14.429552+0000 mgr.smithi008.flmjzp (mgr.14640) 867 : cluster [DBG] pgmap v611: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:14.462954+0000 mgr.smithi008.flmjzp (mgr.14640) 868 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:14.463513+0000 mgr.smithi008.flmjzp (mgr.14640) 869 : cluster [DBG] pgmap v612: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:14.463782+0000 mgr.smithi008.flmjzp (mgr.14640) 870 : cluster [DBG] pgmap v613: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:15.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.487467+0000 mon.smithi008 (mon.0) 1349 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:15.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:14.490197+0000 mgr.smithi008.flmjzp (mgr.14640) 871 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:15.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.551600+0000 mon.smithi008 (mon.0) 1350 : audit [DBG] from='client.? 172.21.15.8:0/3584014803' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:13:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:14.897837+0000 mgr.smithi008.flmjzp (mgr.14640) 872 : audit [DBG] from='client.34928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:14.897837+0000 mgr.smithi008.flmjzp (mgr.14640) 872 : audit [DBG] from='client.34928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:16.464425+0000 mgr.smithi008.flmjzp (mgr.14640) 873 : cluster [DBG] pgmap v614: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:16.464425+0000 mgr.smithi008.flmjzp (mgr.14640) 873 : cluster [DBG] pgmap v614: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:18.464883+0000 mgr.smithi008.flmjzp (mgr.14640) 874 : cluster [DBG] pgmap v615: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:18.464883+0000 mgr.smithi008.flmjzp (mgr.14640) 874 : cluster [DBG] pgmap v615: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:20.465413+0000 mgr.smithi008.flmjzp (mgr.14640) 875 : cluster [DBG] pgmap v616: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:20.465413+0000 mgr.smithi008.flmjzp (mgr.14640) 875 : cluster [DBG] pgmap v616: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:22.465851+0000 mgr.smithi008.flmjzp (mgr.14640) 876 : cluster [DBG] pgmap v617: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:23.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:22.465851+0000 mgr.smithi008.flmjzp (mgr.14640) 876 : cluster [DBG] pgmap v617: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:24.501000+0000 mon.smithi008 (mon.0) 1351 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:24.503349+0000 mon.smithi008 (mon.0) 1352 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:24.504367+0000 mon.smithi008 (mon.0) 1353 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:24.511077+0000 mon.smithi008 (mon.0) 1354 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:24.517406+0000 mon.smithi008 (mon.0) 1355 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:24.520677+0000 mon.smithi008 (mon.0) 1356 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:24.501000+0000 mon.smithi008 (mon.0) 1351 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:24.503349+0000 mon.smithi008 (mon.0) 1352 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:24.504367+0000 mon.smithi008 (mon.0) 1353 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:24.511077+0000 mon.smithi008 (mon.0) 1354 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:24.517406+0000 mon.smithi008 (mon.0) 1355 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:24.520677+0000 mon.smithi008 (mon.0) 1356 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:24.466370+0000 mgr.smithi008.flmjzp (mgr.14640) 877 : cluster [DBG] pgmap v618: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:24.505223+0000 mgr.smithi008.flmjzp (mgr.14640) 878 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:24.505802+0000 mgr.smithi008.flmjzp (mgr.14640) 879 : cluster [DBG] pgmap v619: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:25.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:24.506065+0000 mgr.smithi008.flmjzp (mgr.14640) 880 : cluster [DBG] pgmap v620: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:25.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:24.522422+0000 mon.smithi008 (mon.0) 1357 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:25.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:24.525634+0000 mon.smithi008 (mon.0) 1358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:25.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:24.529477+0000 mon.smithi008 (mon.0) 1359 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:25.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:24.531601+0000 mgr.smithi008.flmjzp (mgr.14640) 881 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:24.466370+0000 mgr.smithi008.flmjzp (mgr.14640) 877 : cluster [DBG] pgmap v618: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:24.505223+0000 mgr.smithi008.flmjzp (mgr.14640) 878 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:24.505802+0000 mgr.smithi008.flmjzp (mgr.14640) 879 : cluster [DBG] pgmap v619: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:24.506065+0000 mgr.smithi008.flmjzp (mgr.14640) 880 : cluster [DBG] pgmap v620: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:25.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:24.522422+0000 mon.smithi008 (mon.0) 1357 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:25.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:24.525634+0000 mon.smithi008 (mon.0) 1358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:25.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:24.529477+0000 mon.smithi008 (mon.0) 1359 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:25.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:24.531601+0000 mgr.smithi008.flmjzp (mgr.14640) 881 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:26.506840+0000 mgr.smithi008.flmjzp (mgr.14640) 882 : cluster [DBG] pgmap v621: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:27.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:26.506840+0000 mgr.smithi008.flmjzp (mgr.14640) 882 : cluster [DBG] pgmap v621: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:28.507395+0000 mgr.smithi008.flmjzp (mgr.14640) 883 : cluster [DBG] pgmap v622: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:28.507395+0000 mgr.smithi008.flmjzp (mgr.14640) 883 : cluster [DBG] pgmap v622: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:30.508022+0000 mgr.smithi008.flmjzp (mgr.14640) 884 : cluster [DBG] pgmap v623: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:31.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:30.508022+0000 mgr.smithi008.flmjzp (mgr.14640) 884 : cluster [DBG] pgmap v623: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:32.508577+0000 mgr.smithi008.flmjzp (mgr.14640) 885 : cluster [DBG] pgmap v624: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:32.508577+0000 mgr.smithi008.flmjzp (mgr.14640) 885 : cluster [DBG] pgmap v624: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:34.536806+0000 mon.smithi008 (mon.0) 1360 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:34.539051+0000 mon.smithi008 (mon.0) 1361 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:34.540061+0000 mon.smithi008 (mon.0) 1362 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:34.546891+0000 mon.smithi008 (mon.0) 1363 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:34.553338+0000 mon.smithi008 (mon.0) 1364 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:34.556492+0000 mon.smithi008 (mon.0) 1365 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:34.558193+0000 mon.smithi008 (mon.0) 1366 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:34.559825+0000 mon.smithi008 (mon.0) 1367 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:34.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:34.561789+0000 mon.smithi008 (mon.0) 1368 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:34.536806+0000 mon.smithi008 (mon.0) 1360 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:34.539051+0000 mon.smithi008 (mon.0) 1361 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:34.540061+0000 mon.smithi008 (mon.0) 1362 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:34.546891+0000 mon.smithi008 (mon.0) 1363 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:34.553338+0000 mon.smithi008 (mon.0) 1364 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:34.556492+0000 mon.smithi008 (mon.0) 1365 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:34.558193+0000 mon.smithi008 (mon.0) 1366 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:34.559825+0000 mon.smithi008 (mon.0) 1367 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:34.561789+0000 mon.smithi008 (mon.0) 1368 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:34.509112+0000 mgr.smithi008.flmjzp (mgr.14640) 886 : cluster [DBG] pgmap v625: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:34.540976+0000 mgr.smithi008.flmjzp (mgr.14640) 887 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:34.541593+0000 mgr.smithi008.flmjzp (mgr.14640) 888 : cluster [DBG] pgmap v626: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:34.541906+0000 mgr.smithi008.flmjzp (mgr.14640) 889 : cluster [DBG] pgmap v627: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:34.563763+0000 mgr.smithi008.flmjzp (mgr.14640) 890 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:35.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:34.509112+0000 mgr.smithi008.flmjzp (mgr.14640) 886 : cluster [DBG] pgmap v625: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:35.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:34.540976+0000 mgr.smithi008.flmjzp (mgr.14640) 887 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:35.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:34.541593+0000 mgr.smithi008.flmjzp (mgr.14640) 888 : cluster [DBG] pgmap v626: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:35.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:34.541906+0000 mgr.smithi008.flmjzp (mgr.14640) 889 : cluster [DBG] pgmap v627: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:35.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:34.563763+0000 mgr.smithi008.flmjzp (mgr.14640) 890 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:36.542490+0000 mgr.smithi008.flmjzp (mgr.14640) 891 : cluster [DBG] pgmap v628: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:37.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:36.542490+0000 mgr.smithi008.flmjzp (mgr.14640) 891 : cluster [DBG] pgmap v628: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:38.543101+0000 mgr.smithi008.flmjzp (mgr.14640) 892 : cluster [DBG] pgmap v629: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:38.543101+0000 mgr.smithi008.flmjzp (mgr.14640) 892 : cluster [DBG] pgmap v629: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:40.543780+0000 mgr.smithi008.flmjzp (mgr.14640) 893 : cluster [DBG] pgmap v630: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:40.543780+0000 mgr.smithi008.flmjzp (mgr.14640) 893 : cluster [DBG] pgmap v630: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:42.544527+0000 mgr.smithi008.flmjzp (mgr.14640) 894 : cluster [DBG] pgmap v631: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:43.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:42.544527+0000 mgr.smithi008.flmjzp (mgr.14640) 894 : cluster [DBG] pgmap v631: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:44.574049+0000 mon.smithi008 (mon.0) 1369 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:44.574049+0000 mon.smithi008 (mon.0) 1369 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:45.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.049+0000 7f5800b2a700 1 -- 172.21.15.8:0/676781164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc0f6530 msgr2=0x7f57fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:45.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.049+0000 7f5800b2a700 1 --2- 172.21.15.8:0/676781164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc0f6530 0x7f57fc0f6950 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f57ec004660 tx=0x7f57ec009b30).stop 2023-10-18T21:13:45.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.049+0000 7f5800b2a700 1 -- 172.21.15.8:0/676781164 shutdown_connections 2023-10-18T21:13:45.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.049+0000 7f5800b2a700 1 --2- 172.21.15.8:0/676781164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57fc0f77d0 0x7f57fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.049+0000 7f5800b2a700 1 --2- 172.21.15.8:0/676781164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc0f6530 0x7f57fc0f6950 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.049+0000 7f5800b2a700 1 -- 172.21.15.8:0/676781164 >> 172.21.15.8:0/676781164 conn(0x7f57fc0f1c90 msgr2=0x7f57fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:45.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.049+0000 7f5800b2a700 1 -- 172.21.15.8:0/676781164 shutdown_connections 2023-10-18T21:13:45.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.049+0000 7f5800b2a700 1 -- 172.21.15.8:0/676781164 wait complete. 2023-10-18T21:13:45.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.050+0000 7f5800b2a700 1 Processor -- start 2023-10-18T21:13:45.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.050+0000 7f5800b2a700 1 -- start start 2023-10-18T21:13:45.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.051+0000 7f5800b2a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc0f6530 0x7f57fc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:45.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.051+0000 7f5800b2a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57fc0f77d0 0x7f57fc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:45.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.051+0000 7f5800b2a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc107880 con 0x7f57fc0f6530 2023-10-18T21:13:45.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.051+0000 7f5800b2a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc1080c0 con 0x7f57fc0f77d0 2023-10-18T21:13:45.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.051+0000 7f57fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc0f6530 0x7f57fc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:45.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.051+0000 7f57fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc0f6530 0x7f57fc106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34770/0 (socket says 172.21.15.8:34770) 2023-10-18T21:13:45.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.051+0000 7f57fb7fe700 1 -- 172.21.15.8:0/3444740763 learned_addr learned my addr 172.21.15.8:0/3444740763 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:45.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.051+0000 7f57faffd700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57fc0f77d0 0x7f57fc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:45.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.052+0000 7f57fb7fe700 1 -- 172.21.15.8:0/3444740763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57fc0f77d0 msgr2=0x7f57fc107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:45.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.052+0000 7f57fb7fe700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57fc0f77d0 0x7f57fc107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.052+0000 7f57fb7fe700 1 -- 172.21.15.8:0/3444740763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec005040 con 0x7f57fc0f6530 2023-10-18T21:13:45.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.052+0000 7f57faffd700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57fc0f77d0 0x7f57fc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:13:45.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.052+0000 7f57fb7fe700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc0f6530 0x7f57fc106d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f57ec009870 tx=0x7f57ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:45.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.053+0000 7f57e3fff700 1 -- 172.21.15.8:0/3444740763 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ec019070 con 0x7f57fc0f6530 2023-10-18T21:13:45.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.053+0000 7f5800b2a700 1 -- 172.21.15.8:0/3444740763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc108340 con 0x7f57fc0f6530 2023-10-18T21:13:45.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.053+0000 7f5800b2a700 1 -- 172.21.15.8:0/3444740763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57fc108820 con 0x7f57fc0f6530 2023-10-18T21:13:45.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.053+0000 7f57e3fff700 1 -- 172.21.15.8:0/3444740763 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f57ec01e420 con 0x7f57fc0f6530 2023-10-18T21:13:45.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.053+0000 7f57e3fff700 1 -- 172.21.15.8:0/3444740763 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ec014680 con 0x7f57fc0f6530 2023-10-18T21:13:45.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.055+0000 7f5800b2a700 1 -- 172.21.15.8:0/3444740763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc004fa0 con 0x7f57fc0f6530 2023-10-18T21:13:45.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.055+0000 7f57e3fff700 1 -- 172.21.15.8:0/3444740763 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f57ec01e9a0 con 0x7f57fc0f6530 2023-10-18T21:13:45.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.057+0000 7f57e3fff700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57e4060f70 0x7f57e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:45.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.057+0000 7f57e3fff700 1 -- 172.21.15.8:0/3444740763 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f57ec07de50 con 0x7f57fc0f6530 2023-10-18T21:13:45.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.057+0000 7f57faffd700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57e4060f70 0x7f57e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:45.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.058+0000 7f57faffd700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57e4060f70 0x7f57e4063430 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f57fc106b20 tx=0x7f57f000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:45.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.061+0000 7f57e3fff700 1 -- 172.21.15.8:0/3444740763 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f57ec04da60 con 0x7f57fc0f6530 2023-10-18T21:13:45.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.265+0000 7f5800b2a700 1 -- 172.21.15.8:0/3444740763 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57dc002a40 con 0x7f57e4060f70 2023-10-18T21:13:45.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.267+0000 7f57e3fff700 1 -- 172.21.15.8:0/3444740763 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f57dc002a40 con 0x7f57e4060f70 2023-10-18T21:13:45.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.268+0000 7f5800b2a700 1 -- 172.21.15.8:0/3444740763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57e4060f70 msgr2=0x7f57e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:45.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.268+0000 7f5800b2a700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57e4060f70 0x7f57e4063430 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f57fc106b20 tx=0x7f57f000b040).stop 2023-10-18T21:13:45.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.268+0000 7f5800b2a700 1 -- 172.21.15.8:0/3444740763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc0f6530 msgr2=0x7f57fc106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:45.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.268+0000 7f5800b2a700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc0f6530 0x7f57fc106d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f57ec009870 tx=0x7f57ec00b040).stop 2023-10-18T21:13:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.269+0000 7f5800b2a700 1 -- 172.21.15.8:0/3444740763 shutdown_connections 2023-10-18T21:13:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.269+0000 7f5800b2a700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57e4060f70 0x7f57e4063430 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.269+0000 7f5800b2a700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc0f6530 0x7f57fc106d90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.269+0000 7f5800b2a700 1 --2- 172.21.15.8:0/3444740763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57fc0f77d0 0x7f57fc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.269+0000 7f5800b2a700 1 -- 172.21.15.8:0/3444740763 >> 172.21.15.8:0/3444740763 conn(0x7f57fc0f1c90 msgr2=0x7f57fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:45.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.269+0000 7f5800b2a700 1 -- 172.21.15.8:0/3444740763 shutdown_connections 2023-10-18T21:13:45.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.269+0000 7f5800b2a700 1 -- 172.21.15.8:0/3444740763 wait complete. 2023-10-18T21:13:45.285 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:13:45.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.407+0000 7f9bd359e700 1 -- 172.21.15.8:0/330337730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bd40f6530 msgr2=0x7f9bd40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.407+0000 7f9bd359e700 1 --2- 172.21.15.8:0/330337730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bd40f6530 0x7f9bd40f6950 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f9bc4004660 tx=0x7f9bc4009b30).stop 2023-10-18T21:13:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.407+0000 7f9bd359e700 1 -- 172.21.15.8:0/330337730 shutdown_connections 2023-10-18T21:13:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.407+0000 7f9bd359e700 1 --2- 172.21.15.8:0/330337730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd40f77d0 0x7f9bd40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.407+0000 7f9bd359e700 1 --2- 172.21.15.8:0/330337730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bd40f6530 0x7f9bd40f6950 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.407+0000 7f9bd359e700 1 -- 172.21.15.8:0/330337730 >> 172.21.15.8:0/330337730 conn(0x7f9bd40f1c90 msgr2=0x7f9bd40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.407+0000 7f9bd359e700 1 -- 172.21.15.8:0/330337730 shutdown_connections 2023-10-18T21:13:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.407+0000 7f9bd359e700 1 -- 172.21.15.8:0/330337730 wait complete. 2023-10-18T21:13:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.408+0000 7f9bd359e700 1 Processor -- start 2023-10-18T21:13:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.408+0000 7f9bd359e700 1 -- start start 2023-10-18T21:13:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bd40f6530 0x7f9bd4108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd40f77d0 0x7f9bd4109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd4109a00 con 0x7f9bd40f6530 2023-10-18T21:13:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd4109b40 con 0x7f9bd40f77d0 2023-10-18T21:13:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bd40f6530 0x7f9bd4108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bd40f6530 0x7f9bd4108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34792/0 (socket says 172.21.15.8:34792) 2023-10-18T21:13:45.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd259c700 1 -- 172.21.15.8:0/3003503378 learned_addr learned my addr 172.21.15.8:0/3003503378 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:45.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd259c700 1 -- 172.21.15.8:0/3003503378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd40f77d0 msgr2=0x7f9bd4109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:45.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd259c700 1 --2- 172.21.15.8:0/3003503378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd40f77d0 0x7f9bd4109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:13:45.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd259c700 1 -- 172.21.15.8:0/3003503378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc4005040 con 0x7f9bd40f6530 2023-10-18T21:13:45.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.409+0000 7f9bd259c700 1 --2- 172.21.15.8:0/3003503378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bd40f6530 0x7f9bd4108f60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f9bc4009870 tx=0x7f9bc400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:45.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.410+0000 7f9bc2ffd700 1 -- 172.21.15.8:0/3003503378 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4019070 con 0x7f9bd40f6530 2023-10-18T21:13:45.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.410+0000 7f9bc2ffd700 1 -- 172.21.15.8:0/3003503378 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9bc401e420 con 0x7f9bd40f6530 2023-10-18T21:13:45.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.410+0000 7f9bc2ffd700 1 -- 172.21.15.8:0/3003503378 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4014660 con 0x7f9bd40f6530 2023-10-18T21:13:45.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.410+0000 7f9bd359e700 1 -- 172.21.15.8:0/3003503378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd410a480 con 0x7f9bd40f6530 2023-10-18T21:13:45.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.410+0000 7f9bd359e700 1 -- 172.21.15.8:0/3003503378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd410a960 con 0x7f9bd40f6530 2023-10-18T21:13:45.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.411+0000 7f9bd359e700 1 -- 172.21.15.8:0/3003503378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd4045ad0 con 0x7f9bd40f6530 2023-10-18T21:13:45.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.412+0000 7f9bc2ffd700 1 -- 172.21.15.8:0/3003503378 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9bc401e9c0 con 0x7f9bd40f6530 2023-10-18T21:13:45.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.413+0000 7f9bc2ffd700 1 --2- 172.21.15.8:0/3003503378 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bbc060f70 0x7f9bbc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:45.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.413+0000 7f9bc2ffd700 1 -- 172.21.15.8:0/3003503378 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9bc407dd80 con 0x7f9bd40f6530 2023-10-18T21:13:45.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.413+0000 7f9bd1d9b700 1 --2- 172.21.15.8:0/3003503378 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bbc060f70 0x7f9bbc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:45.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.413+0000 7f9bd1d9b700 1 --2- 172.21.15.8:0/3003503378 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bbc060f70 0x7f9bbc063430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f9bc8004b70 tx=0x7f9bc800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:45.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.417+0000 7f9bc2ffd700 1 -- 172.21.15.8:0/3003503378 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9bc40513e0 con 0x7f9bd40f6530 2023-10-18T21:13:45.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.637+0000 7f9bd359e700 1 -- 172.21.15.8:0/3003503378 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bd40fee00 con 0x7f9bbc060f70 2023-10-18T21:13:45.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.638+0000 7f9bc2ffd700 1 -- 172.21.15.8:0/3003503378 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9bd40fee00 con 0x7f9bbc060f70 2023-10-18T21:13:45.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 -- 172.21.15.8:0/3003503378 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bbc060f70 msgr2=0x7f9bbc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 --2- 172.21.15.8:0/3003503378 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bbc060f70 0x7f9bbc063430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f9bc8004b70 tx=0x7f9bc800b040).stop 2023-10-18T21:13:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 -- 172.21.15.8:0/3003503378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bd40f6530 msgr2=0x7f9bd4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 --2- 172.21.15.8:0/3003503378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bd40f6530 0x7f9bd4108f60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f9bc4009870 tx=0x7f9bc400b040).stop 2023-10-18T21:13:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 -- 172.21.15.8:0/3003503378 shutdown_connections 2023-10-18T21:13:45.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 --2- 172.21.15.8:0/3003503378 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bbc060f70 0x7f9bbc063430 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 --2- 172.21.15.8:0/3003503378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bd40f6530 0x7f9bd4108f60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 --2- 172.21.15.8:0/3003503378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd40f77d0 0x7f9bd4109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:13:45.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 -- 172.21.15.8:0/3003503378 >> 172.21.15.8:0/3003503378 conn(0x7f9bd40f1c90 msgr2=0x7f9bd406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:45.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 -- 172.21.15.8:0/3003503378 shutdown_connections 2023-10-18T21:13:45.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.640+0000 7f9bd359e700 1 -- 172.21.15.8:0/3003503378 wait complete. 2023-10-18T21:13:45.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.778+0000 7f12be956700 1 -- 172.21.15.8:0/673843617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12b80f77d0 msgr2=0x7f12b80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:45.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.778+0000 7f12be956700 1 --2- 172.21.15.8:0/673843617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12b80f77d0 0x7f12b80f7c30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f12a8004660 tx=0x7f12a8009b30).stop 2023-10-18T21:13:45.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.778+0000 7f12be956700 1 -- 172.21.15.8:0/673843617 shutdown_connections 2023-10-18T21:13:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.778+0000 7f12be956700 1 --2- 172.21.15.8:0/673843617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12b80f77d0 0x7f12b80f7c30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.778+0000 7f12be956700 1 --2- 172.21.15.8:0/673843617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b80f6530 0x7f12b80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.778+0000 7f12be956700 1 -- 172.21.15.8:0/673843617 >> 172.21.15.8:0/673843617 conn(0x7f12b80f1c90 msgr2=0x7f12b80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.778+0000 7f12be956700 1 -- 172.21.15.8:0/673843617 shutdown_connections 2023-10-18T21:13:45.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.778+0000 7f12be956700 1 -- 172.21.15.8:0/673843617 wait complete. 2023-10-18T21:13:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.779+0000 7f12be956700 1 Processor -- start 2023-10-18T21:13:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.779+0000 7f12be956700 1 -- start start 2023-10-18T21:13:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12be956700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12b80f6530 0x7f12b806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12be956700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b80f77d0 0x7f12b8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12be956700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b806a380 con 0x7f12b80f6530 2023-10-18T21:13:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12be956700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b806a4c0 con 0x7f12b80f77d0 2023-10-18T21:13:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12bd954700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12b80f6530 0x7f12b806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12bd954700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12b80f6530 0x7f12b806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34822/0 (socket says 172.21.15.8:34822) 2023-10-18T21:13:45.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12bd954700 1 -- 172.21.15.8:0/1190403785 learned_addr learned my addr 172.21.15.8:0/1190403785 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:45.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12bd153700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b80f77d0 0x7f12b8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:45.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12bd954700 1 -- 172.21.15.8:0/1190403785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b80f77d0 msgr2=0x7f12b8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:45.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12bd954700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b80f77d0 0x7f12b8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.780+0000 7f12bd954700 1 -- 172.21.15.8:0/1190403785 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8005040 con 0x7f12b80f6530 2023-10-18T21:13:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.781+0000 7f12bd954700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12b80f6530 0x7f12b806b9a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f12b400c790 tx=0x7f12b4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.781+0000 7f12ae7fc700 1 -- 172.21.15.8:0/1190403785 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b400e680 con 0x7f12b80f6530 2023-10-18T21:13:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.781+0000 7f12ae7fc700 1 -- 172.21.15.8:0/1190403785 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f12b400eca0 con 0x7f12b80f6530 2023-10-18T21:13:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.781+0000 7f12be956700 1 -- 172.21.15.8:0/1190403785 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b806a7a0 con 0x7f12b80f6530 2023-10-18T21:13:45.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.781+0000 7f12ae7fc700 1 -- 172.21.15.8:0/1190403785 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b4012d80 con 0x7f12b80f6530 2023-10-18T21:13:45.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.781+0000 7f12be956700 1 -- 172.21.15.8:0/1190403785 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b810ed70 con 0x7f12b80f6530 2023-10-18T21:13:45.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.782+0000 7f12be956700 1 -- 172.21.15.8:0/1190403785 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b8045ad0 con 0x7f12b80f6530 2023-10-18T21:13:45.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.783+0000 7f12ae7fc700 1 -- 172.21.15.8:0/1190403785 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f12b4010070 con 0x7f12b80f6530 2023-10-18T21:13:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.784+0000 7f12ae7fc700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12a4060f70 0x7f12a4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.784+0000 7f12ae7fc700 1 -- 172.21.15.8:0/1190403785 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f12b407c910 con 0x7f12b80f6530 2023-10-18T21:13:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.784+0000 7f12bd153700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12a4060f70 0x7f12a4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.785+0000 7f12bd153700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12a4060f70 0x7f12a4063430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f12a8009490 tx=0x7f12a8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.788+0000 7f12ae7fc700 1 -- 172.21.15.8:0/1190403785 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f12b404c600 con 0x7f12b80f6530 2023-10-18T21:13:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:44.545120+0000 mgr.smithi008.flmjzp (mgr.14640) 895 : cluster [DBG] pgmap v632: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.169892+0000 mon.smithi008 (mon.0) 1370 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.170787+0000 mon.smithi008 (mon.0) 1371 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.177009+0000 mon.smithi008 (mon.0) 1372 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.181945+0000 mon.smithi008 (mon.0) 1373 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.184717+0000 mon.smithi008 (mon.0) 1374 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.186142+0000 mon.smithi008 (mon.0) 1375 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:45.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.187531+0000 mon.smithi008 (mon.0) 1376 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:45.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.189251+0000 mon.smithi008 (mon.0) 1377 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:44.545120+0000 mgr.smithi008.flmjzp (mgr.14640) 895 : cluster [DBG] pgmap v632: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.169892+0000 mon.smithi008 (mon.0) 1370 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.170787+0000 mon.smithi008 (mon.0) 1371 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.177009+0000 mon.smithi008 (mon.0) 1372 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.181945+0000 mon.smithi008 (mon.0) 1373 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.184717+0000 mon.smithi008 (mon.0) 1374 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.186142+0000 mon.smithi008 (mon.0) 1375 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.187531+0000 mon.smithi008 (mon.0) 1376 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.189251+0000 mon.smithi008 (mon.0) 1377 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:45.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.988+0000 7f12be956700 1 -- 172.21.15.8:0/1190403785 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f12b80fedd0 con 0x7f12a4060f70 2023-10-18T21:13:45.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.997+0000 7f12ae7fc700 1 -- 172.21.15.8:0/1190403785 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f12b80fedd0 con 0x7f12a4060f70 2023-10-18T21:13:45.998 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:13:45.999 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (20m) 8m ago 21m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:13:45.999 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (14m) 8m ago 21m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:13:45.999 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (14m) 6m ago 21m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:13:45.999 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (20m) 8m ago 21m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:13:45.999 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (8m) 8m ago 17m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:13:46.000 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 17m - - 2023-10-18T21:13:46.000 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (6m) 6m ago 17m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:13:46.000 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (6m) 6m ago 17m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:13:46.000 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (15m) 8m ago 23m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:13:46.000 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (14m) 6m ago 20m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:13:46.001 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (14m) 8m ago 23m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:13:46.001 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (14m) 6m ago 20m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:13:46.001 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (21m) 8m ago 21m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:13:46.001 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (20m) 6m ago 20m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:13:46.001 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (13m) 8m ago 20m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:13:46.002 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (11m) 8m ago 20m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:13:46.002 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (11m) 8m ago 19m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:13:46.002 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (11m) 6m ago 19m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:13:46.002 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (10m) 6m ago 19m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:13:46.002 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (9m) 6m ago 19m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:13:46.003 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (15m) 8m ago 21m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:13:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 -- 172.21.15.8:0/1190403785 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12a4060f70 msgr2=0x7f12a4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12a4060f70 0x7f12a4063430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f12a8009490 tx=0x7f12a8009b30).stop 2023-10-18T21:13:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 -- 172.21.15.8:0/1190403785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12b80f6530 msgr2=0x7f12b806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12b80f6530 0x7f12b806b9a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f12b400c790 tx=0x7f12b4007d90).stop 2023-10-18T21:13:46.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 -- 172.21.15.8:0/1190403785 shutdown_connections 2023-10-18T21:13:46.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12a4060f70 0x7f12a4063430 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12b80f6530 0x7f12b806b9a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 --2- 172.21.15.8:0/1190403785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b80f77d0 0x7f12b8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 -- 172.21.15.8:0/1190403785 >> 172.21.15.8:0/1190403785 conn(0x7f12b80f1c90 msgr2=0x7f12b80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:46.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 -- 172.21.15.8:0/1190403785 shutdown_connections 2023-10-18T21:13:46.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:45.999+0000 7f12be956700 1 -- 172.21.15.8:0/1190403785 wait complete. 2023-10-18T21:13:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.137+0000 7f9efcfae700 1 -- 172.21.15.8:0/4229642114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f77d0 msgr2=0x7f9ef80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.137+0000 7f9efcfae700 1 --2- 172.21.15.8:0/4229642114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f77d0 0x7f9ef80f7c30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f9eec004660 tx=0x7f9eec009b30).stop 2023-10-18T21:13:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.137+0000 7f9efcfae700 1 -- 172.21.15.8:0/4229642114 shutdown_connections 2023-10-18T21:13:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.137+0000 7f9efcfae700 1 --2- 172.21.15.8:0/4229642114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f77d0 0x7f9ef80f7c30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.137+0000 7f9efcfae700 1 --2- 172.21.15.8:0/4229642114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f6530 0x7f9ef80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.137+0000 7f9efcfae700 1 -- 172.21.15.8:0/4229642114 >> 172.21.15.8:0/4229642114 conn(0x7f9ef80f1c90 msgr2=0x7f9ef80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.138+0000 7f9efcfae700 1 -- 172.21.15.8:0/4229642114 shutdown_connections 2023-10-18T21:13:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.138+0000 7f9efcfae700 1 -- 172.21.15.8:0/4229642114 wait complete. 2023-10-18T21:13:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.138+0000 7f9efcfae700 1 Processor -- start 2023-10-18T21:13:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.139+0000 7f9efcfae700 1 -- start start 2023-10-18T21:13:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.139+0000 7f9efcfae700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:46.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.139+0000 7f9efcfae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 0x7f9ef8109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:46.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.139+0000 7f9efcfae700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8109a20 con 0x7f9ef80f6530 2023-10-18T21:13:46.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.139+0000 7f9efcfae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8109b60 con 0x7f9ef80f77d0 2023-10-18T21:13:46.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.139+0000 7f9ef77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:46.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.139+0000 7f9ef77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34842/0 (socket says 172.21.15.8:34842) 2023-10-18T21:13:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.139+0000 7f9ef77fe700 1 -- 172.21.15.8:0/2114351474 learned_addr learned my addr 172.21.15.8:0/2114351474 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.139+0000 7f9ef6ffd700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 0x7f9ef8109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.140+0000 7f9ef77fe700 1 -- 172.21.15.8:0/2114351474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 msgr2=0x7f9ef8109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.140+0000 7f9ef77fe700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 0x7f9ef8109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.140+0000 7f9ef77fe700 1 -- 172.21.15.8:0/2114351474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec005040 con 0x7f9ef80f6530 2023-10-18T21:13:46.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.140+0000 7f9ef77fe700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108f80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f9ee8002700 tx=0x7f9ee8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:46.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.140+0000 7f9edffff700 1 -- 172.21.15.8:0/2114351474 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee80079c0 con 0x7f9ef80f6530 2023-10-18T21:13:46.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.140+0000 7f9edffff700 1 -- 172.21.15.8:0/2114351474 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9ee800f040 con 0x7f9ef80f6530 2023-10-18T21:13:46.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.140+0000 7f9edffff700 1 -- 172.21.15.8:0/2114351474 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee80148d0 con 0x7f9ef80f6530 2023-10-18T21:13:46.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.140+0000 7f9efcfae700 1 -- 172.21.15.8:0/2114351474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef810a500 con 0x7f9ef80f6530 2023-10-18T21:13:46.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.140+0000 7f9efcfae700 1 -- 172.21.15.8:0/2114351474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef810aac0 con 0x7f9ef80f6530 2023-10-18T21:13:46.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.141+0000 7f9efcfae700 1 -- 172.21.15.8:0/2114351474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef8045ad0 con 0x7f9ef80f6530 2023-10-18T21:13:46.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.142+0000 7f9edffff700 1 -- 172.21.15.8:0/2114351474 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9ee801b060 con 0x7f9ef80f6530 2023-10-18T21:13:46.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.143+0000 7f9edffff700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee0060f70 0x7f9ee0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:46.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.144+0000 7f9edffff700 1 -- 172.21.15.8:0/2114351474 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9ee807c6b0 con 0x7f9ef80f6530 2023-10-18T21:13:46.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.144+0000 7f9ef6ffd700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee0060f70 0x7f9ee0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:46.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.144+0000 7f9ef6ffd700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee0060f70 0x7f9ee0063430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f9eec004630 tx=0x7f9eec009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:46.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.148+0000 7f9edffff700 1 -- 172.21.15.8:0/2114351474 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9ee804fdd0 con 0x7f9ef80f6530 2023-10-18T21:13:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.399+0000 7f9efcfae700 1 -- 172.21.15.8:0/2114351474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ef80fedd0 con 0x7f9ef80f6530 2023-10-18T21:13:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.399+0000 7f9edffff700 1 -- 172.21.15.8:0/2114351474 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f9ee804f9c0 con 0x7f9ef80f6530 2023-10-18T21:13:46.401 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:13:46.401 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:13:46.401 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:13:46.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:13:46.402 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:13:46.402 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:13:46.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:13:46.402 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:13:46.403 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:13:46.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:13:46.403 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:13:46.403 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:13:46.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:13:46.403 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:13:46.404 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:13:46.404 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:13:46.404 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:13:46.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 -- 172.21.15.8:0/2114351474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee0060f70 msgr2=0x7f9ee0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee0060f70 0x7f9ee0063430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f9eec004630 tx=0x7f9eec009b30).stop 2023-10-18T21:13:46.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 -- 172.21.15.8:0/2114351474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 msgr2=0x7f9ef8108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108f80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f9ee8002700 tx=0x7f9ee8009d80).stop 2023-10-18T21:13:46.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 -- 172.21.15.8:0/2114351474 shutdown_connections 2023-10-18T21:13:46.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee0060f70 0x7f9ee0063430 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108f80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 --2- 172.21.15.8:0/2114351474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 0x7f9ef8109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 -- 172.21.15.8:0/2114351474 >> 172.21.15.8:0/2114351474 conn(0x7f9ef80f1c90 msgr2=0x7f9ef806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:46.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 -- 172.21.15.8:0/2114351474 shutdown_connections 2023-10-18T21:13:46.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.402+0000 7f9efcfae700 1 -- 172.21.15.8:0/2114351474 wait complete. 2023-10-18T21:13:46.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.539+0000 7f5803fff700 1 -- 172.21.15.8:0/381953523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58040f6530 msgr2=0x7f58040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.539+0000 7f5803fff700 1 --2- 172.21.15.8:0/381953523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58040f6530 0x7f58040f6950 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f57f4004660 tx=0x7f57f4009b30).stop 2023-10-18T21:13:46.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.539+0000 7f5803fff700 1 -- 172.21.15.8:0/381953523 shutdown_connections 2023-10-18T21:13:46.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.539+0000 7f5803fff700 1 --2- 172.21.15.8:0/381953523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58040f77d0 0x7f58040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.539+0000 7f5803fff700 1 --2- 172.21.15.8:0/381953523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58040f6530 0x7f58040f6950 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.539+0000 7f5803fff700 1 -- 172.21.15.8:0/381953523 >> 172.21.15.8:0/381953523 conn(0x7f58040f1c90 msgr2=0x7f58040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:46.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.539+0000 7f5803fff700 1 -- 172.21.15.8:0/381953523 shutdown_connections 2023-10-18T21:13:46.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.539+0000 7f5803fff700 1 -- 172.21.15.8:0/381953523 wait complete. 2023-10-18T21:13:46.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.540+0000 7f5803fff700 1 Processor -- start 2023-10-18T21:13:46.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.540+0000 7f5803fff700 1 -- start start 2023-10-18T21:13:46.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.540+0000 7f5803fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58040f6530 0x7f5804106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:46.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.540+0000 7f5803fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58040f77d0 0x7f5804107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:46.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.540+0000 7f5803fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5804107880 con 0x7f58040f6530 2023-10-18T21:13:46.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.540+0000 7f5803fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58041080c0 con 0x7f58040f77d0 2023-10-18T21:13:46.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.541+0000 7f5802ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58040f6530 0x7f5804106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:46.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.541+0000 7f5802ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58040f6530 0x7f5804106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34858/0 (socket says 172.21.15.8:34858) 2023-10-18T21:13:46.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.541+0000 7f5802ffd700 1 -- 172.21.15.8:0/1580093136 learned_addr learned my addr 172.21.15.8:0/1580093136 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:46.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.541+0000 7f58027fc700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58040f77d0 0x7f5804107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:46.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.541+0000 7f5802ffd700 1 -- 172.21.15.8:0/1580093136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58040f77d0 msgr2=0x7f5804107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.541+0000 7f5802ffd700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58040f77d0 0x7f5804107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.541+0000 7f5802ffd700 1 -- 172.21.15.8:0/1580093136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4005040 con 0x7f58040f6530 2023-10-18T21:13:46.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.541+0000 7f58027fc700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58040f77d0 0x7f5804107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:13:46.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.541+0000 7f5802ffd700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58040f6530 0x7f5804106d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f57f4009870 tx=0x7f57f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:46.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.541+0000 7f57eb7fe700 1 -- 172.21.15.8:0/1580093136 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57f4019070 con 0x7f58040f6530 2023-10-18T21:13:46.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.542+0000 7f57eb7fe700 1 -- 172.21.15.8:0/1580093136 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f57f401e420 con 0x7f58040f6530 2023-10-18T21:13:46.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.542+0000 7f5803fff700 1 -- 172.21.15.8:0/1580093136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5804108340 con 0x7f58040f6530 2023-10-18T21:13:46.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.542+0000 7f57eb7fe700 1 -- 172.21.15.8:0/1580093136 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57f4014660 con 0x7f58040f6530 2023-10-18T21:13:46.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.542+0000 7f5803fff700 1 -- 172.21.15.8:0/1580093136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5804108820 con 0x7f58040f6530 2023-10-18T21:13:46.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.543+0000 7f5803fff700 1 -- 172.21.15.8:0/1580093136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5804059100 con 0x7f58040f6530 2023-10-18T21:13:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.544+0000 7f57eb7fe700 1 -- 172.21.15.8:0/1580093136 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f57f401e9c0 con 0x7f58040f6530 2023-10-18T21:13:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.544+0000 7f57eb7fe700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57ec060f70 0x7f57ec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.545+0000 7f57eb7fe700 1 -- 172.21.15.8:0/1580093136 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f57f407ddd0 con 0x7f58040f6530 2023-10-18T21:13:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.545+0000 7f58027fc700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57ec060f70 0x7f57ec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.545+0000 7f58027fc700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57ec060f70 0x7f57ec063430 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f5804106b20 tx=0x7f57f800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.549+0000 7f57eb7fe700 1 -- 172.21.15.8:0/1580093136 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f57f404da40 con 0x7f58040f6530 2023-10-18T21:13:46.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.775+0000 7f5803fff700 1 -- 172.21.15.8:0/1580093136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f58040fecc0 con 0x7f58040f6530 2023-10-18T21:13:46.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.775+0000 7f57eb7fe700 1 -- 172.21.15.8:0/1580093136 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f57f4051060 con 0x7f58040f6530 2023-10-18T21:13:46.776 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:13:46.777 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:13:46.777 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:13:46.777 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:13:46.777 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:13:46.777 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:13:46.778 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:13:46.778 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:13:46.778 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:13:46.778 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:13:46.779 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:13:46.779 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:13:46.779 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:13:46.779 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:13:46.779 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:13:46.779 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:13:46.780 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:13:46.780 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:13:46.780 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:13:46.780 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:13:46.780 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:13:46.781 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:13:46.781 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:13:46.781 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:13:46.781 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:13:46.781 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:13:46.781 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:13:46.782 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:13:46.782 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:13:46.782 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:13:46.782 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:13:46.782 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:13:46.783 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:13:46.783 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:13:46.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 -- 172.21.15.8:0/1580093136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57ec060f70 msgr2=0x7f57ec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57ec060f70 0x7f57ec063430 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f5804106b20 tx=0x7f57f800b040).stop 2023-10-18T21:13:46.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 -- 172.21.15.8:0/1580093136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58040f6530 msgr2=0x7f5804106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58040f6530 0x7f5804106d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f57f4009870 tx=0x7f57f400b040).stop 2023-10-18T21:13:46.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 -- 172.21.15.8:0/1580093136 shutdown_connections 2023-10-18T21:13:46.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f57ec060f70 0x7f57ec063430 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58040f6530 0x7f5804106d90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 --2- 172.21.15.8:0/1580093136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58040f77d0 0x7f5804107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 -- 172.21.15.8:0/1580093136 >> 172.21.15.8:0/1580093136 conn(0x7f58040f1c90 msgr2=0x7f58040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:46.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 -- 172.21.15.8:0/1580093136 shutdown_connections 2023-10-18T21:13:46.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.777+0000 7f5803fff700 1 -- 172.21.15.8:0/1580093136 wait complete. 2023-10-18T21:13:46.786 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:13:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.914+0000 7f7e31f81700 1 -- 172.21.15.8:0/584040891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 msgr2=0x7f7e2c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.914+0000 7f7e31f81700 1 --2- 172.21.15.8:0/584040891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c0f6950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f7e20004660 tx=0x7f7e20009b30).stop 2023-10-18T21:13:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.915+0000 7f7e31f81700 1 -- 172.21.15.8:0/584040891 shutdown_connections 2023-10-18T21:13:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.915+0000 7f7e31f81700 1 --2- 172.21.15.8:0/584040891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.915+0000 7f7e31f81700 1 --2- 172.21.15.8:0/584040891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c0f6950 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.915+0000 7f7e31f81700 1 -- 172.21.15.8:0/584040891 >> 172.21.15.8:0/584040891 conn(0x7f7e2c0f1c90 msgr2=0x7f7e2c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:46.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.915+0000 7f7e31f81700 1 -- 172.21.15.8:0/584040891 shutdown_connections 2023-10-18T21:13:46.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.915+0000 7f7e31f81700 1 -- 172.21.15.8:0/584040891 wait complete. 2023-10-18T21:13:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.915+0000 7f7e31f81700 1 Processor -- start 2023-10-18T21:13:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.916+0000 7f7e31f81700 1 -- start start 2023-10-18T21:13:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.916+0000 7f7e31f81700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.916+0000 7f7e31f81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.916+0000 7f7e31f81700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c107910 con 0x7f7e2c0f6530 2023-10-18T21:13:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.916+0000 7f7e31f81700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c108120 con 0x7f7e2c0f77d0 2023-10-18T21:13:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.916+0000 7f7e30f7f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.916+0000 7f7e30f7f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57714/0 (socket says 172.21.15.8:57714) 2023-10-18T21:13:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.916+0000 7f7e30f7f700 1 -- 172.21.15.8:0/3223468756 learned_addr learned my addr 172.21.15.8:0/3223468756 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:13:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.916+0000 7f7e2bfff700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.917+0000 7f7e30f7f700 1 -- 172.21.15.8:0/3223468756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 msgr2=0x7f7e2c107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.917+0000 7f7e30f7f700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.917+0000 7f7e30f7f700 1 -- 172.21.15.8:0/3223468756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20005040 con 0x7f7e2c0f6530 2023-10-18T21:13:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.917+0000 7f7e2bfff700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:13:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.917+0000 7f7e30f7f700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c106e20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f7e20004e30 tx=0x7f7e20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.917+0000 7f7e297fa700 1 -- 172.21.15.8:0/3223468756 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e20018070 con 0x7f7e2c0f6530 2023-10-18T21:13:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.917+0000 7f7e297fa700 1 -- 172.21.15.8:0/3223468756 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7e20009630 con 0x7f7e2c0f6530 2023-10-18T21:13:46.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.917+0000 7f7e297fa700 1 -- 172.21.15.8:0/3223468756 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e2001c3c0 con 0x7f7e2c0f6530 2023-10-18T21:13:46.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.917+0000 7f7e31f81700 1 -- 172.21.15.8:0/3223468756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c108340 con 0x7f7e2c0f6530 2023-10-18T21:13:46.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.917+0000 7f7e31f81700 1 -- 172.21.15.8:0/3223468756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c1088a0 con 0x7f7e2c0f6530 2023-10-18T21:13:46.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.918+0000 7f7e31f81700 1 -- 172.21.15.8:0/3223468756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c059100 con 0x7f7e2c0f6530 2023-10-18T21:13:46.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:45.171509+0000 mgr.smithi008.flmjzp (mgr.14640) 896 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:46.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:45.171996+0000 mgr.smithi008.flmjzp (mgr.14640) 897 : cluster [DBG] pgmap v633: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:46.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:45.172258+0000 mgr.smithi008.flmjzp (mgr.14640) 898 : cluster [DBG] pgmap v634: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:46.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:45.190941+0000 mgr.smithi008.flmjzp (mgr.14640) 899 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:46.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.266963+0000 mgr.smithi008.flmjzp (mgr.14640) 900 : audit [DBG] from='client.34932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:46.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.638592+0000 mgr.smithi008.flmjzp (mgr.14640) 901 : audit [DBG] from='client.34936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:46.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:46.400111+0000 mon.smithi008 (mon.0) 1378 : audit [DBG] from='client.? 172.21.15.8:0/2114351474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:46.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.919+0000 7f7e297fa700 1 -- 172.21.15.8:0/3223468756 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7e2001d420 con 0x7f7e2c0f6530 2023-10-18T21:13:46.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.920+0000 7f7e297fa700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e1c060f70 0x7f7e1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:13:46.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.920+0000 7f7e297fa700 1 -- 172.21.15.8:0/3223468756 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7e2007e5f0 con 0x7f7e2c0f6530 2023-10-18T21:13:46.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.920+0000 7f7e2bfff700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e1c060f70 0x7f7e1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:13:46.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.921+0000 7f7e2bfff700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e1c060f70 0x7f7e1c063430 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f7e18009740 tx=0x7f7e18009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:13:46.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:46.924+0000 7f7e297fa700 1 -- 172.21.15.8:0/3223468756 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7e2004e310 con 0x7f7e2c0f6530 2023-10-18T21:13:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:45.171509+0000 mgr.smithi008.flmjzp (mgr.14640) 896 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:45.171996+0000 mgr.smithi008.flmjzp (mgr.14640) 897 : cluster [DBG] pgmap v633: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:45.172258+0000 mgr.smithi008.flmjzp (mgr.14640) 898 : cluster [DBG] pgmap v634: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:45.190941+0000 mgr.smithi008.flmjzp (mgr.14640) 899 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.266963+0000 mgr.smithi008.flmjzp (mgr.14640) 900 : audit [DBG] from='client.34932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.638592+0000 mgr.smithi008.flmjzp (mgr.14640) 901 : audit [DBG] from='client.34936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:46.400111+0000 mon.smithi008 (mon.0) 1378 : audit [DBG] from='client.? 172.21.15.8:0/2114351474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.123+0000 7f7e31f81700 1 -- 172.21.15.8:0/3223468756 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e2c0008d0 con 0x7f7e1c060f70 2023-10-18T21:13:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.125+0000 7f7e297fa700 1 -- 172.21.15.8:0/3223468756 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7e2c0008d0 con 0x7f7e1c060f70 2023-10-18T21:13:47.126 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:13:47.126 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:13:47.126 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:13:47.126 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:13:47.127 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:13:47.127 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:13:47.127 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:13:47.127 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:13:47.127 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:13:47.128 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:13:47.128 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:13:47.128 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:13:47.128 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:13:47.128 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:13:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 -- 172.21.15.8:0/3223468756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e1c060f70 msgr2=0x7f7e1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e1c060f70 0x7f7e1c063430 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f7e18009740 tx=0x7f7e18009be0).stop 2023-10-18T21:13:47.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 -- 172.21.15.8:0/3223468756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 msgr2=0x7f7e2c106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:13:47.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c106e20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f7e20004e30 tx=0x7f7e20009b30).stop 2023-10-18T21:13:47.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 -- 172.21.15.8:0/3223468756 shutdown_connections 2023-10-18T21:13:47.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e1c060f70 0x7f7e1c063430 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:47.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c106e20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:47.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 --2- 172.21.15.8:0/3223468756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:13:47.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 -- 172.21.15.8:0/3223468756 >> 172.21.15.8:0/3223468756 conn(0x7f7e2c0f1c90 msgr2=0x7f7e2c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:13:47.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 -- 172.21.15.8:0/3223468756 shutdown_connections 2023-10-18T21:13:47.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:13:47.127+0000 7f7e31f81700 1 -- 172.21.15.8:0/3223468756 wait complete. 2023-10-18T21:13:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:45.989181+0000 mgr.smithi008.flmjzp (mgr.14640) 902 : audit [DBG] from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:46.775838+0000 mon.smithi008 (mon.0) 1379 : audit [DBG] from='client.? 172.21.15.8:0/1580093136' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:13:47.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:45.989181+0000 mgr.smithi008.flmjzp (mgr.14640) 902 : audit [DBG] from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:46.775838+0000 mon.smithi008 (mon.0) 1379 : audit [DBG] from='client.? 172.21.15.8:0/1580093136' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:13:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:47.125004+0000 mgr.smithi008.flmjzp (mgr.14640) 903 : audit [DBG] from='client.34952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:47.172967+0000 mgr.smithi008.flmjzp (mgr.14640) 904 : cluster [DBG] pgmap v635: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:48.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:47.125004+0000 mgr.smithi008.flmjzp (mgr.14640) 903 : audit [DBG] from='client.34952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:13:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:47.172967+0000 mgr.smithi008.flmjzp (mgr.14640) 904 : cluster [DBG] pgmap v635: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:49.173740+0000 mgr.smithi008.flmjzp (mgr.14640) 905 : cluster [DBG] pgmap v636: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:49.173740+0000 mgr.smithi008.flmjzp (mgr.14640) 905 : cluster [DBG] pgmap v636: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:52.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:51.174238+0000 mgr.smithi008.flmjzp (mgr.14640) 906 : cluster [DBG] pgmap v637: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:52.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:51.174238+0000 mgr.smithi008.flmjzp (mgr.14640) 906 : cluster [DBG] pgmap v637: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:54.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:53.174921+0000 mgr.smithi008.flmjzp (mgr.14640) 907 : cluster [DBG] pgmap v638: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:54.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:53.174921+0000 mgr.smithi008.flmjzp (mgr.14640) 907 : cluster [DBG] pgmap v638: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:55.175592+0000 mgr.smithi008.flmjzp (mgr.14640) 908 : cluster [DBG] pgmap v639: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:55.195245+0000 mon.smithi008 (mon.0) 1380 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:55.197552+0000 mon.smithi008 (mon.0) 1381 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:55.198652+0000 mon.smithi008 (mon.0) 1382 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:55.199630+0000 mgr.smithi008.flmjzp (mgr.14640) 909 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:55.200238+0000 mgr.smithi008.flmjzp (mgr.14640) 910 : cluster [DBG] pgmap v640: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:55.200549+0000 mgr.smithi008.flmjzp (mgr.14640) 911 : cluster [DBG] pgmap v641: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:55.205312+0000 mon.smithi008 (mon.0) 1383 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:55.211898+0000 mon.smithi008 (mon.0) 1384 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:55.215033+0000 mon.smithi008 (mon.0) 1385 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:55.216710+0000 mon.smithi008 (mon.0) 1386 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:56.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:55.218359+0000 mon.smithi008 (mon.0) 1387 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:56.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:13:55.220376+0000 mon.smithi008 (mon.0) 1388 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:56.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:13:55.222350+0000 mgr.smithi008.flmjzp (mgr.14640) 912 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:55.175592+0000 mgr.smithi008.flmjzp (mgr.14640) 908 : cluster [DBG] pgmap v639: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:55.195245+0000 mon.smithi008 (mon.0) 1380 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:55.197552+0000 mon.smithi008 (mon.0) 1381 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:13:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:55.198652+0000 mon.smithi008 (mon.0) 1382 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:13:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:55.199630+0000 mgr.smithi008.flmjzp (mgr.14640) 909 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:13:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:55.200238+0000 mgr.smithi008.flmjzp (mgr.14640) 910 : cluster [DBG] pgmap v640: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:55.200549+0000 mgr.smithi008.flmjzp (mgr.14640) 911 : cluster [DBG] pgmap v641: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:55.205312+0000 mon.smithi008 (mon.0) 1383 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:13:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:55.211898+0000 mon.smithi008 (mon.0) 1384 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:13:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:55.215033+0000 mon.smithi008 (mon.0) 1385 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:55.216710+0000 mon.smithi008 (mon.0) 1386 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:55.218359+0000 mon.smithi008 (mon.0) 1387 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:13:55.220376+0000 mon.smithi008 (mon.0) 1388 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:13:56.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:13:55.222350+0000 mgr.smithi008.flmjzp (mgr.14640) 912 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:13:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:13:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:57.201061+0000 mgr.smithi008.flmjzp (mgr.14640) 913 : cluster [DBG] pgmap v642: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:13:58.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:13:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:57.201061+0000 mgr.smithi008.flmjzp (mgr.14640) 913 : cluster [DBG] pgmap v642: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:13:59.201643+0000 mgr.smithi008.flmjzp (mgr.14640) 914 : cluster [DBG] pgmap v643: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:13:59.201643+0000 mgr.smithi008.flmjzp (mgr.14640) 914 : cluster [DBG] pgmap v643: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:01.202227+0000 mgr.smithi008.flmjzp (mgr.14640) 915 : cluster [DBG] pgmap v644: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:02.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:01.202227+0000 mgr.smithi008.flmjzp (mgr.14640) 915 : cluster [DBG] pgmap v644: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:04.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:03.202861+0000 mgr.smithi008.flmjzp (mgr.14640) 916 : cluster [DBG] pgmap v645: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:03.202861+0000 mgr.smithi008.flmjzp (mgr.14640) 916 : cluster [DBG] pgmap v645: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:05.203393+0000 mgr.smithi008.flmjzp (mgr.14640) 917 : cluster [DBG] pgmap v646: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:05.230629+0000 mon.smithi008 (mon.0) 1389 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:05.790328+0000 mon.smithi008 (mon.0) 1390 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:05.791486+0000 mon.smithi008 (mon.0) 1391 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:05.798619+0000 mon.smithi008 (mon.0) 1392 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:05.805030+0000 mon.smithi008 (mon.0) 1393 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:05.808156+0000 mon.smithi008 (mon.0) 1394 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:06.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:05.809819+0000 mon.smithi008 (mon.0) 1395 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:06.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:05.811442+0000 mon.smithi008 (mon.0) 1396 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:06.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:05.813493+0000 mon.smithi008 (mon.0) 1397 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:06.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:05.203393+0000 mgr.smithi008.flmjzp (mgr.14640) 917 : cluster [DBG] pgmap v646: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:05.230629+0000 mon.smithi008 (mon.0) 1389 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:05.790328+0000 mon.smithi008 (mon.0) 1390 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:05.791486+0000 mon.smithi008 (mon.0) 1391 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:05.798619+0000 mon.smithi008 (mon.0) 1392 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:05.805030+0000 mon.smithi008 (mon.0) 1393 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:05.808156+0000 mon.smithi008 (mon.0) 1394 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:05.809819+0000 mon.smithi008 (mon.0) 1395 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:05.811442+0000 mon.smithi008 (mon.0) 1396 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:06.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:05.813493+0000 mon.smithi008 (mon.0) 1397 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:05.792415+0000 mgr.smithi008.flmjzp (mgr.14640) 918 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:05.793181+0000 mgr.smithi008.flmjzp (mgr.14640) 919 : cluster [DBG] pgmap v647: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:05.793513+0000 mgr.smithi008.flmjzp (mgr.14640) 920 : cluster [DBG] pgmap v648: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:05.815435+0000 mgr.smithi008.flmjzp (mgr.14640) 921 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:07.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:05.792415+0000 mgr.smithi008.flmjzp (mgr.14640) 918 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:05.793181+0000 mgr.smithi008.flmjzp (mgr.14640) 919 : cluster [DBG] pgmap v647: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:05.793513+0000 mgr.smithi008.flmjzp (mgr.14640) 920 : cluster [DBG] pgmap v648: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:05.815435+0000 mgr.smithi008.flmjzp (mgr.14640) 921 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:07.794212+0000 mgr.smithi008.flmjzp (mgr.14640) 922 : cluster [DBG] pgmap v649: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:07.794212+0000 mgr.smithi008.flmjzp (mgr.14640) 922 : cluster [DBG] pgmap v649: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:09.794772+0000 mgr.smithi008.flmjzp (mgr.14640) 923 : cluster [DBG] pgmap v650: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:09.794772+0000 mgr.smithi008.flmjzp (mgr.14640) 923 : cluster [DBG] pgmap v650: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:11.795415+0000 mgr.smithi008.flmjzp (mgr.14640) 924 : cluster [DBG] pgmap v651: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:13.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:11.795415+0000 mgr.smithi008.flmjzp (mgr.14640) 924 : cluster [DBG] pgmap v651: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:13.795939+0000 mgr.smithi008.flmjzp (mgr.14640) 925 : cluster [DBG] pgmap v652: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:15.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:13.795939+0000 mgr.smithi008.flmjzp (mgr.14640) 925 : cluster [DBG] pgmap v652: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:15.826169+0000 mon.smithi008 (mon.0) 1398 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:15.828294+0000 mon.smithi008 (mon.0) 1399 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:15.829313+0000 mon.smithi008 (mon.0) 1400 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:15.836217+0000 mon.smithi008 (mon.0) 1401 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:15.842832+0000 mon.smithi008 (mon.0) 1402 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:15.845972+0000 mon.smithi008 (mon.0) 1403 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:15.847591+0000 mon.smithi008 (mon.0) 1404 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:15.849161+0000 mon.smithi008 (mon.0) 1405 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:15.851116+0000 mon.smithi008 (mon.0) 1406 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:15.826169+0000 mon.smithi008 (mon.0) 1398 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:15.828294+0000 mon.smithi008 (mon.0) 1399 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:15.829313+0000 mon.smithi008 (mon.0) 1400 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:15.836217+0000 mon.smithi008 (mon.0) 1401 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:15.842832+0000 mon.smithi008 (mon.0) 1402 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:15.845972+0000 mon.smithi008 (mon.0) 1403 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:15.847591+0000 mon.smithi008 (mon.0) 1404 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:15.849161+0000 mon.smithi008 (mon.0) 1405 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:15.851116+0000 mon.smithi008 (mon.0) 1406 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:17.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.279+0000 7f6324885700 1 -- 172.21.15.8:0/90194340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63200f9690 msgr2=0x7f63200fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:17.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.279+0000 7f6324885700 1 --2- 172.21.15.8:0/90194340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63200f9690 0x7f63200fbae0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f6314004660 tx=0x7f6314009b30).stop 2023-10-18T21:14:17.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.279+0000 7f6324885700 1 -- 172.21.15.8:0/90194340 shutdown_connections 2023-10-18T21:14:17.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.279+0000 7f6324885700 1 --2- 172.21.15.8:0/90194340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63200f9690 0x7f63200fbae0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.279+0000 7f6324885700 1 --2- 172.21.15.8:0/90194340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6320060310 0x7f63200f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.279+0000 7f6324885700 1 -- 172.21.15.8:0/90194340 >> 172.21.15.8:0/90194340 conn(0x7f63200f0b90 msgr2=0x7f63200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:17.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.279+0000 7f6324885700 1 -- 172.21.15.8:0/90194340 shutdown_connections 2023-10-18T21:14:17.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.279+0000 7f6324885700 1 -- 172.21.15.8:0/90194340 wait complete. 2023-10-18T21:14:17.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.280+0000 7f6324885700 1 Processor -- start 2023-10-18T21:14:17.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.280+0000 7f6324885700 1 -- start start 2023-10-18T21:14:17.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f6324885700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6320060310 0x7f6320108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:17.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f6324885700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63200f9690 0x7f63201093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:17.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f6324885700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320109980 con 0x7f63200f9690 2023-10-18T21:14:17.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f6324885700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320109ac0 con 0x7f6320060310 2023-10-18T21:14:17.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f631e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63200f9690 0x7f63201093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:17.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f631e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63200f9690 0x7f63201093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53734/0 (socket says 172.21.15.8:53734) 2023-10-18T21:14:17.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f631e59c700 1 -- 172.21.15.8:0/3393589067 learned_addr learned my addr 172.21.15.8:0/3393589067 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:17.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f631ed9d700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6320060310 0x7f6320108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f631e59c700 1 -- 172.21.15.8:0/3393589067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6320060310 msgr2=0x7f6320108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f631e59c700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6320060310 0x7f6320108ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f631e59c700 1 -- 172.21.15.8:0/3393589067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6314005040 con 0x7f63200f9690 2023-10-18T21:14:17.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.281+0000 7f631e59c700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63200f9690 0x7f63201093d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f6314004e30 tx=0x7f6314009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:17.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.282+0000 7f63077fe700 1 -- 172.21.15.8:0/3393589067 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6314018070 con 0x7f63200f9690 2023-10-18T21:14:17.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.282+0000 7f63077fe700 1 -- 172.21.15.8:0/3393589067 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6314009630 con 0x7f63200f9690 2023-10-18T21:14:17.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.282+0000 7f6324885700 1 -- 172.21.15.8:0/3393589067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632010a400 con 0x7f63200f9690 2023-10-18T21:14:17.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.282+0000 7f63077fe700 1 -- 172.21.15.8:0/3393589067 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f631401c3c0 con 0x7f63200f9690 2023-10-18T21:14:17.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.282+0000 7f6324885700 1 -- 172.21.15.8:0/3393589067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632010a960 con 0x7f63200f9690 2023-10-18T21:14:17.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.283+0000 7f6324885700 1 -- 172.21.15.8:0/3393589067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6320045ad0 con 0x7f63200f9690 2023-10-18T21:14:17.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.284+0000 7f63077fe700 1 -- 172.21.15.8:0/3393589067 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f631401d420 con 0x7f63200f9690 2023-10-18T21:14:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.285+0000 7f63077fe700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6308060f70 0x7f6308063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.285+0000 7f63077fe700 1 -- 172.21.15.8:0/3393589067 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f631407e540 con 0x7f63200f9690 2023-10-18T21:14:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.285+0000 7f631ed9d700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6308060f70 0x7f6308063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.286+0000 7f631ed9d700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6308060f70 0x7f6308063430 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f6310009740 tx=0x7f6310009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.289+0000 7f63077fe700 1 -- 172.21.15.8:0/3393589067 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6314051c50 con 0x7f63200f9690 2023-10-18T21:14:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:15.796565+0000 mgr.smithi008.flmjzp (mgr.14640) 926 : cluster [DBG] pgmap v653: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:15.830186+0000 mgr.smithi008.flmjzp (mgr.14640) 927 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:15.830776+0000 mgr.smithi008.flmjzp (mgr.14640) 928 : cluster [DBG] pgmap v654: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:15.831076+0000 mgr.smithi008.flmjzp (mgr.14640) 929 : cluster [DBG] pgmap v655: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:15.853081+0000 mgr.smithi008.flmjzp (mgr.14640) 930 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:15.796565+0000 mgr.smithi008.flmjzp (mgr.14640) 926 : cluster [DBG] pgmap v653: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:15.830186+0000 mgr.smithi008.flmjzp (mgr.14640) 927 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:15.830776+0000 mgr.smithi008.flmjzp (mgr.14640) 928 : cluster [DBG] pgmap v654: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:15.831076+0000 mgr.smithi008.flmjzp (mgr.14640) 929 : cluster [DBG] pgmap v655: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:15.853081+0000 mgr.smithi008.flmjzp (mgr.14640) 930 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:17.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.487+0000 7f6324885700 1 -- 172.21.15.8:0/3393589067 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f63200fa4d0 con 0x7f6308060f70 2023-10-18T21:14:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.488+0000 7f63077fe700 1 -- 172.21.15.8:0/3393589067 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f63200fa4d0 con 0x7f6308060f70 2023-10-18T21:14:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.490+0000 7f6324885700 1 -- 172.21.15.8:0/3393589067 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6308060f70 msgr2=0x7f6308063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.490+0000 7f6324885700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6308060f70 0x7f6308063430 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f6310009740 tx=0x7f6310009c60).stop 2023-10-18T21:14:17.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.490+0000 7f6324885700 1 -- 172.21.15.8:0/3393589067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63200f9690 msgr2=0x7f63201093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:17.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.490+0000 7f6324885700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63200f9690 0x7f63201093d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f6314004e30 tx=0x7f6314009b30).stop 2023-10-18T21:14:17.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.490+0000 7f6324885700 1 -- 172.21.15.8:0/3393589067 shutdown_connections 2023-10-18T21:14:17.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.490+0000 7f6324885700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6308060f70 0x7f6308063430 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.490+0000 7f6324885700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6320060310 0x7f6320108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.490+0000 7f6324885700 1 --2- 172.21.15.8:0/3393589067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63200f9690 0x7f63201093d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.490+0000 7f6324885700 1 -- 172.21.15.8:0/3393589067 >> 172.21.15.8:0/3393589067 conn(0x7f63200f0b90 msgr2=0x7f63200f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.490+0000 7f6324885700 1 -- 172.21.15.8:0/3393589067 shutdown_connections 2023-10-18T21:14:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.491+0000 7f6324885700 1 -- 172.21.15.8:0/3393589067 wait complete. 2023-10-18T21:14:17.507 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:14:17.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.628+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/1154519787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd880f6530 msgr2=0x7fdd880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:17.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.628+0000 7fdd8ed8b700 1 --2- 172.21.15.8:0/1154519787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd880f6530 0x7fdd880f6950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fdd84004660 tx=0x7fdd84009b30).stop 2023-10-18T21:14:17.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.628+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/1154519787 shutdown_connections 2023-10-18T21:14:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.628+0000 7fdd8ed8b700 1 --2- 172.21.15.8:0/1154519787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd880f77d0 0x7fdd880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.628+0000 7fdd8ed8b700 1 --2- 172.21.15.8:0/1154519787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd880f6530 0x7fdd880f6950 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.628+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/1154519787 >> 172.21.15.8:0/1154519787 conn(0x7fdd880f1c90 msgr2=0x7fdd880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.628+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/1154519787 shutdown_connections 2023-10-18T21:14:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.628+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/1154519787 wait complete. 2023-10-18T21:14:17.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.629+0000 7fdd8ed8b700 1 Processor -- start 2023-10-18T21:14:17.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.629+0000 7fdd8ed8b700 1 -- start start 2023-10-18T21:14:17.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.629+0000 7fdd8ed8b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd880f6530 0x7fdd8806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.629+0000 7fdd8ed8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd880f77d0 0x7fdd88069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.629+0000 7fdd8ed8b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8806a380 con 0x7fdd880f6530 2023-10-18T21:14:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.629+0000 7fdd8ed8b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8806a4c0 con 0x7fdd880f77d0 2023-10-18T21:14:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.629+0000 7fdd8dd89700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd880f6530 0x7fdd8806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd8dd89700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd880f6530 0x7fdd8806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53748/0 (socket says 172.21.15.8:53748) 2023-10-18T21:14:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd8dd89700 1 -- 172.21.15.8:0/2272470683 learned_addr learned my addr 172.21.15.8:0/2272470683 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd8d588700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd880f77d0 0x7fdd88069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd8dd89700 1 -- 172.21.15.8:0/2272470683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd880f77d0 msgr2=0x7fdd88069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd8dd89700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd880f77d0 0x7fdd88069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd8dd89700 1 -- 172.21.15.8:0/2272470683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84005040 con 0x7fdd880f6530 2023-10-18T21:14:17.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd8dd89700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd880f6530 0x7fdd8806b9a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fdd84014040 tx=0x7fdd8400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:17.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2272470683 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd84019070 con 0x7fdd880f6530 2023-10-18T21:14:17.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2272470683 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdd8401e420 con 0x7fdd880f6530 2023-10-18T21:14:17.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2272470683 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd84014620 con 0x7fdd880f6530 2023-10-18T21:14:17.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.630+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/2272470683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8806a740 con 0x7fdd880f6530 2023-10-18T21:14:17.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.631+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/2272470683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8806ac20 con 0x7fdd880f6530 2023-10-18T21:14:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.632+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/2272470683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd88045ad0 con 0x7fdd880f6530 2023-10-18T21:14:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.632+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2272470683 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdd8401e9e0 con 0x7fdd880f6530 2023-10-18T21:14:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.633+0000 7fdd7e7fc700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd74060f70 0x7fdd74063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.633+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2272470683 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdd8407dcc0 con 0x7fdd880f6530 2023-10-18T21:14:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.634+0000 7fdd8d588700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd74060f70 0x7fdd74063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.634+0000 7fdd8d588700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd74060f70 0x7fdd74063430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fdd78009fd0 tx=0x7fdd7800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:17.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.638+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2272470683 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdd84083020 con 0x7fdd880f6530 2023-10-18T21:14:17.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.835+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/2272470683 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd88057f10 con 0x7fdd74060f70 2023-10-18T21:14:17.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.836+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2272470683 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdd88057f10 con 0x7fdd74060f70 2023-10-18T21:14:17.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/2272470683 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd74060f70 msgr2=0x7fdd74063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:17.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd74060f70 0x7fdd74063430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fdd78009fd0 tx=0x7fdd7800b040).stop 2023-10-18T21:14:17.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/2272470683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd880f6530 msgr2=0x7fdd8806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:17.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd880f6530 0x7fdd8806b9a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fdd84014040 tx=0x7fdd8400b040).stop 2023-10-18T21:14:17.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/2272470683 shutdown_connections 2023-10-18T21:14:17.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd74060f70 0x7fdd74063430 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd880f6530 0x7fdd8806b9a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 --2- 172.21.15.8:0/2272470683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd880f77d0 0x7fdd88069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/2272470683 >> 172.21.15.8:0/2272470683 conn(0x7fdd880f1c90 msgr2=0x7fdd880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:17.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/2272470683 shutdown_connections 2023-10-18T21:14:17.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.838+0000 7fdd8ed8b700 1 -- 172.21.15.8:0/2272470683 wait complete. 2023-10-18T21:14:17.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.975+0000 7f1b89a6a700 1 -- 172.21.15.8:0/1089170958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f99e0 msgr2=0x7f1b840f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:17.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.975+0000 7f1b89a6a700 1 --2- 172.21.15.8:0/1089170958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f99e0 0x7f1b840f9e40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f1b70004660 tx=0x7f1b70009b30).stop 2023-10-18T21:14:17.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.976+0000 7f1b89a6a700 1 -- 172.21.15.8:0/1089170958 shutdown_connections 2023-10-18T21:14:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.976+0000 7f1b89a6a700 1 --2- 172.21.15.8:0/1089170958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f99e0 0x7f1b840f9e40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.976+0000 7f1b89a6a700 1 --2- 172.21.15.8:0/1089170958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f8740 0x7f1b840f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.976+0000 7f1b89a6a700 1 -- 172.21.15.8:0/1089170958 >> 172.21.15.8:0/1089170958 conn(0x7f1b840f40e0 msgr2=0x7f1b840f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.976+0000 7f1b89a6a700 1 -- 172.21.15.8:0/1089170958 shutdown_connections 2023-10-18T21:14:17.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.976+0000 7f1b89a6a700 1 -- 172.21.15.8:0/1089170958 wait complete. 2023-10-18T21:14:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.976+0000 7f1b89a6a700 1 Processor -- start 2023-10-18T21:14:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.977+0000 7f1b89a6a700 1 -- start start 2023-10-18T21:14:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.977+0000 7f1b89a6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f8740 0x7f1b84108ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.977+0000 7f1b89a6a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f99e0 0x7f1b841093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.977+0000 7f1b89a6a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84109960 con 0x7f1b840f99e0 2023-10-18T21:14:17.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.977+0000 7f1b89a6a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84109aa0 con 0x7f1b840f8740 2023-10-18T21:14:17.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.977+0000 7f1b83fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f99e0 0x7f1b841093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:17.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.977+0000 7f1b83fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f99e0 0x7f1b841093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53768/0 (socket says 172.21.15.8:53768) 2023-10-18T21:14:17.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.977+0000 7f1b83fff700 1 -- 172.21.15.8:0/2863464281 learned_addr learned my addr 172.21.15.8:0/2863464281 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:17.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.977+0000 7f1b88a68700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f8740 0x7f1b84108ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:17.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.978+0000 7f1b83fff700 1 -- 172.21.15.8:0/2863464281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f8740 msgr2=0x7f1b84108ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:17.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.978+0000 7f1b83fff700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f8740 0x7f1b84108ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:17.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.978+0000 7f1b83fff700 1 -- 172.21.15.8:0/2863464281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70005040 con 0x7f1b840f99e0 2023-10-18T21:14:17.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.978+0000 7f1b83fff700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f99e0 0x7f1b841093b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f1b70004d80 tx=0x7f1b7000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:17.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.978+0000 7f1b817fa700 1 -- 172.21.15.8:0/2863464281 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b70019070 con 0x7f1b840f99e0 2023-10-18T21:14:17.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.978+0000 7f1b817fa700 1 -- 172.21.15.8:0/2863464281 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1b7001e420 con 0x7f1b840f99e0 2023-10-18T21:14:17.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.978+0000 7f1b817fa700 1 -- 172.21.15.8:0/2863464281 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b70014660 con 0x7f1b840f99e0 2023-10-18T21:14:17.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.978+0000 7f1b89a6a700 1 -- 172.21.15.8:0/2863464281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8410a3e0 con 0x7f1b840f99e0 2023-10-18T21:14:17.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.978+0000 7f1b89a6a700 1 -- 172.21.15.8:0/2863464281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8410a870 con 0x7f1b840f99e0 2023-10-18T21:14:17.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.979+0000 7f1b89a6a700 1 -- 172.21.15.8:0/2863464281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b84045ad0 con 0x7f1b840f99e0 2023-10-18T21:14:17.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.980+0000 7f1b817fa700 1 -- 172.21.15.8:0/2863464281 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1b7001e590 con 0x7f1b840f99e0 2023-10-18T21:14:17.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.981+0000 7f1b817fa700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b74060f70 0x7f1b74063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:17.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.981+0000 7f1b817fa700 1 -- 172.21.15.8:0/2863464281 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1b7007dd80 con 0x7f1b840f99e0 2023-10-18T21:14:17.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.981+0000 7f1b88a68700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b74060f70 0x7f1b74063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:17.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.982+0000 7f1b88a68700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b74060f70 0x7f1b74063430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f1b78009fd0 tx=0x7f1b7800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:17.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:17.985+0000 7f1b817fa700 1 -- 172.21.15.8:0/2863464281 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1b700513e0 con 0x7f1b840f99e0 2023-10-18T21:14:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.183+0000 7f1b89a6a700 1 -- 172.21.15.8:0/2863464281 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b8410aae0 con 0x7f1b74060f70 2023-10-18T21:14:18.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.193+0000 7f1b817fa700 1 -- 172.21.15.8:0/2863464281 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1b8410aae0 con 0x7f1b74060f70 2023-10-18T21:14:18.195 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:14:18.195 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (20m) 9m ago 22m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:14:18.195 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (14m) 9m ago 22m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:14:18.196 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (14m) 7m ago 21m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:14:18.196 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (20m) 9m ago 22m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:14:18.196 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (9m) 9m ago 18m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:14:18.196 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 18m - - 2023-10-18T21:14:18.196 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (7m) 7m ago 18m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:14:18.197 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (7m) 7m ago 18m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:14:18.197 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (16m) 9m ago 23m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:14:18.197 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (15m) 7m ago 21m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:14:18.197 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (15m) 9m ago 23m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:14:18.197 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (15m) 7m ago 21m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:14:18.197 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (21m) 9m ago 21m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:14:18.198 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (21m) 7m ago 21m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:14:18.198 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (14m) 9m ago 21m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:14:18.198 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (12m) 9m ago 20m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:14:18.198 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (12m) 9m ago 20m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:14:18.198 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (11m) 7m ago 20m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:14:18.199 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (10m) 7m ago 19m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:14:18.199 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (10m) 7m ago 19m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:14:18.199 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (16m) 9m ago 21m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:14:18.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 -- 172.21.15.8:0/2863464281 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b74060f70 msgr2=0x7f1b74063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:18.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b74060f70 0x7f1b74063430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f1b78009fd0 tx=0x7f1b7800b040).stop 2023-10-18T21:14:18.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 -- 172.21.15.8:0/2863464281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f99e0 msgr2=0x7f1b841093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:18.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f99e0 0x7f1b841093b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f1b70004d80 tx=0x7f1b7000b040).stop 2023-10-18T21:14:18.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 -- 172.21.15.8:0/2863464281 shutdown_connections 2023-10-18T21:14:18.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b74060f70 0x7f1b74063430 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f8740 0x7f1b84108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 --2- 172.21.15.8:0/2863464281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f99e0 0x7f1b841093b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 -- 172.21.15.8:0/2863464281 >> 172.21.15.8:0/2863464281 conn(0x7f1b840f40e0 msgr2=0x7f1b840fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:18.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 -- 172.21.15.8:0/2863464281 shutdown_connections 2023-10-18T21:14:18.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.195+0000 7f1b89a6a700 1 -- 172.21.15.8:0/2863464281 wait complete. 2023-10-18T21:14:18.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.331+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1174980205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c700f6530 msgr2=0x7f5c700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:18.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.331+0000 7f5c6ffff700 1 --2- 172.21.15.8:0/1174980205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c700f6530 0x7f5c700f6950 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f5c60004660 tx=0x7f5c60009b30).stop 2023-10-18T21:14:18.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.332+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1174980205 shutdown_connections 2023-10-18T21:14:18.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.332+0000 7f5c6ffff700 1 --2- 172.21.15.8:0/1174980205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c700f77d0 0x7f5c700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.332+0000 7f5c6ffff700 1 --2- 172.21.15.8:0/1174980205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c700f6530 0x7f5c700f6950 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.332+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1174980205 >> 172.21.15.8:0/1174980205 conn(0x7f5c700f1c90 msgr2=0x7f5c700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:18.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.332+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1174980205 shutdown_connections 2023-10-18T21:14:18.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.332+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1174980205 wait complete. 2023-10-18T21:14:18.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.333+0000 7f5c6ffff700 1 Processor -- start 2023-10-18T21:14:18.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.333+0000 7f5c6ffff700 1 -- start start 2023-10-18T21:14:18.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.334+0000 7f5c6ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c700f6530 0x7f5c70108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:18.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.334+0000 7f5c6ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c700f77d0 0x7f5c701094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:18.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.334+0000 7f5c6ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70109a70 con 0x7f5c700f6530 2023-10-18T21:14:18.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.334+0000 7f5c6ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70109bb0 con 0x7f5c700f77d0 2023-10-18T21:14:18.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.334+0000 7f5c6effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c700f6530 0x7f5c70108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:18.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.334+0000 7f5c6effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c700f6530 0x7f5c70108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53794/0 (socket says 172.21.15.8:53794) 2023-10-18T21:14:18.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.334+0000 7f5c6effd700 1 -- 172.21.15.8:0/1751826913 learned_addr learned my addr 172.21.15.8:0/1751826913 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.334+0000 7f5c6effd700 1 -- 172.21.15.8:0/1751826913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c700f77d0 msgr2=0x7f5c701094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.334+0000 7f5c6effd700 1 --2- 172.21.15.8:0/1751826913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c700f77d0 0x7f5c701094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:14:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.334+0000 7f5c6effd700 1 -- 172.21.15.8:0/1751826913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c60005040 con 0x7f5c700f6530 2023-10-18T21:14:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.335+0000 7f5c6effd700 1 --2- 172.21.15.8:0/1751826913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c700f6530 0x7f5c70108fd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f5c60007a60 tx=0x7f5c60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.335+0000 7f5c577fe700 1 -- 172.21.15.8:0/1751826913 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c60018070 con 0x7f5c700f6530 2023-10-18T21:14:18.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.335+0000 7f5c577fe700 1 -- 172.21.15.8:0/1751826913 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5c60009630 con 0x7f5c700f6530 2023-10-18T21:14:18.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.335+0000 7f5c577fe700 1 -- 172.21.15.8:0/1751826913 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c6001c540 con 0x7f5c700f6530 2023-10-18T21:14:18.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.335+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1751826913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7010a4f0 con 0x7f5c700f6530 2023-10-18T21:14:18.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.335+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1751826913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7010aa50 con 0x7f5c700f6530 2023-10-18T21:14:18.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.336+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1751826913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c70045ad0 con 0x7f5c700f6530 2023-10-18T21:14:18.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.337+0000 7f5c577fe700 1 -- 172.21.15.8:0/1751826913 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5c6001c7b0 con 0x7f5c700f6530 2023-10-18T21:14:18.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.338+0000 7f5c577fe700 1 --2- 172.21.15.8:0/1751826913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c58060f70 0x7f5c58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:18.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.338+0000 7f5c577fe700 1 -- 172.21.15.8:0/1751826913 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5c6007e760 con 0x7f5c700f6530 2023-10-18T21:14:18.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.338+0000 7f5c6e7fc700 1 --2- 172.21.15.8:0/1751826913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c58060f70 0x7f5c58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:18.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.339+0000 7f5c6e7fc700 1 --2- 172.21.15.8:0/1751826913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c58060f70 0x7f5c58063430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f5c64004a10 tx=0x7f5c640099e0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:18.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.342+0000 7f5c577fe700 1 -- 172.21.15.8:0/1751826913 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5c60051d40 con 0x7f5c700f6530 2023-10-18T21:14:18.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:17.489407+0000 mgr.smithi008.flmjzp (mgr.14640) 931 : audit [DBG] from='client.34956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:18.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:17.489407+0000 mgr.smithi008.flmjzp (mgr.14640) 931 : audit [DBG] from='client.34956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:18.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.595+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1751826913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c70027a00 con 0x7f5c700f6530 2023-10-18T21:14:18.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.596+0000 7f5c577fe700 1 -- 172.21.15.8:0/1751826913 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5c60051930 con 0x7f5c700f6530 2023-10-18T21:14:18.598 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:14:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:14:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:14:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:14:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:14:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:14:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:14:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:14:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:14:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:14:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:14:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:14:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:14:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:14:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:14:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:14:18.601 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:14:18.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1751826913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c58060f70 msgr2=0x7f5c58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:18.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 --2- 172.21.15.8:0/1751826913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c58060f70 0x7f5c58063430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f5c64004a10 tx=0x7f5c640099e0).stop 2023-10-18T21:14:18.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1751826913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c700f6530 msgr2=0x7f5c70108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:18.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 --2- 172.21.15.8:0/1751826913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c700f6530 0x7f5c70108fd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f5c60007a60 tx=0x7f5c60009b30).stop 2023-10-18T21:14:18.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1751826913 shutdown_connections 2023-10-18T21:14:18.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 --2- 172.21.15.8:0/1751826913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c58060f70 0x7f5c58063430 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 --2- 172.21.15.8:0/1751826913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c700f6530 0x7f5c70108fd0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 --2- 172.21.15.8:0/1751826913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c700f77d0 0x7f5c701094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:14:18.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1751826913 >> 172.21.15.8:0/1751826913 conn(0x7f5c700f1c90 msgr2=0x7f5c7006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:18.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1751826913 shutdown_connections 2023-10-18T21:14:18.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.598+0000 7f5c6ffff700 1 -- 172.21.15.8:0/1751826913 wait complete. 2023-10-18T21:14:18.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.734+0000 7f271aa55700 1 -- 172.21.15.8:0/3757238924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27140f77d0 msgr2=0x7f27140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:18.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.734+0000 7f271aa55700 1 --2- 172.21.15.8:0/3757238924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27140f77d0 0x7f27140f7c30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f2704004660 tx=0x7f2704009b30).stop 2023-10-18T21:14:18.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.735+0000 7f271aa55700 1 -- 172.21.15.8:0/3757238924 shutdown_connections 2023-10-18T21:14:18.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.735+0000 7f271aa55700 1 --2- 172.21.15.8:0/3757238924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27140f77d0 0x7f27140f7c30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.735+0000 7f271aa55700 1 --2- 172.21.15.8:0/3757238924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27140f6530 0x7f27140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.735+0000 7f271aa55700 1 -- 172.21.15.8:0/3757238924 >> 172.21.15.8:0/3757238924 conn(0x7f27140f1c90 msgr2=0x7f27140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:18.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.735+0000 7f271aa55700 1 -- 172.21.15.8:0/3757238924 shutdown_connections 2023-10-18T21:14:18.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.735+0000 7f271aa55700 1 -- 172.21.15.8:0/3757238924 wait complete. 2023-10-18T21:14:18.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.735+0000 7f271aa55700 1 Processor -- start 2023-10-18T21:14:18.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.736+0000 7f271aa55700 1 -- start start 2023-10-18T21:14:18.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.736+0000 7f271aa55700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27140f6530 0x7f2714108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:18.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.736+0000 7f271aa55700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27140f77d0 0x7f2714109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:18.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.736+0000 7f271aa55700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714109a20 con 0x7f27140f6530 2023-10-18T21:14:18.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.736+0000 7f271aa55700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714109b60 con 0x7f27140f77d0 2023-10-18T21:14:18.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.736+0000 7f2719a53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27140f6530 0x7f2714108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:18.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.736+0000 7f2719a53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27140f6530 0x7f2714108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53800/0 (socket says 172.21.15.8:53800) 2023-10-18T21:14:18.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.736+0000 7f2719a53700 1 -- 172.21.15.8:0/1477248386 learned_addr learned my addr 172.21.15.8:0/1477248386 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:18.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.736+0000 7f2719252700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27140f77d0 0x7f2714109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:18.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.737+0000 7f2719a53700 1 -- 172.21.15.8:0/1477248386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27140f77d0 msgr2=0x7f2714109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:18.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.737+0000 7f2719a53700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27140f77d0 0x7f2714109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.737+0000 7f2719a53700 1 -- 172.21.15.8:0/1477248386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2704005040 con 0x7f27140f6530 2023-10-18T21:14:18.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.737+0000 7f2719a53700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27140f6530 0x7f2714108f80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f2710002700 tx=0x7f2710009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:18.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.737+0000 7f270a7fc700 1 -- 172.21.15.8:0/1477248386 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27100079c0 con 0x7f27140f6530 2023-10-18T21:14:18.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.737+0000 7f270a7fc700 1 -- 172.21.15.8:0/1477248386 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f271000f040 con 0x7f27140f6530 2023-10-18T21:14:18.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.737+0000 7f270a7fc700 1 -- 172.21.15.8:0/1477248386 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27100148d0 con 0x7f27140f6530 2023-10-18T21:14:18.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.737+0000 7f271aa55700 1 -- 172.21.15.8:0/1477248386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271410a500 con 0x7f27140f6530 2023-10-18T21:14:18.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.737+0000 7f271aa55700 1 -- 172.21.15.8:0/1477248386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271410aac0 con 0x7f27140f6530 2023-10-18T21:14:18.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.738+0000 7f271aa55700 1 -- 172.21.15.8:0/1477248386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2714045ad0 con 0x7f27140f6530 2023-10-18T21:14:18.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.739+0000 7f270a7fc700 1 -- 172.21.15.8:0/1477248386 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f271001b060 con 0x7f27140f6530 2023-10-18T21:14:18.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.740+0000 7f270a7fc700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2700060f70 0x7f2700063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:18.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.740+0000 7f270a7fc700 1 -- 172.21.15.8:0/1477248386 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f271007c6b0 con 0x7f27140f6530 2023-10-18T21:14:18.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.740+0000 7f2719252700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2700060f70 0x7f2700063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:18.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.741+0000 7f2719252700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2700060f70 0x7f2700063430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f2704004630 tx=0x7f2704009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:18.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.744+0000 7f270a7fc700 1 -- 172.21.15.8:0/1477248386 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f271004fdd0 con 0x7f27140f6530 2023-10-18T21:14:18.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.974+0000 7f271aa55700 1 -- 172.21.15.8:0/1477248386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f27140fedd0 con 0x7f27140f6530 2023-10-18T21:14:18.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.974+0000 7f270a7fc700 1 -- 172.21.15.8:0/1477248386 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f271004f9c0 con 0x7f27140f6530 2023-10-18T21:14:18.976 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:14:18.977 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:14:18.977 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:14:18.977 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:14:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:14:18.977 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:14:18.978 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:14:18.978 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:14:18.978 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:14:18.978 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:14:18.978 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:14:18.979 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:14:18.979 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:14:18.979 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:14:18.979 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:14:18.979 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:14:18.979 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:14:18.980 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:14:18.980 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:14:18.980 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:14:18.980 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:14:18.980 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:14:18.981 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:14:18.981 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:14:18.981 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:14:18.981 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:14:18.981 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:14:18.981 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:14:18.982 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:14:18.982 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:14:18.982 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:14:18.982 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:14:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:14:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:14:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 -- 172.21.15.8:0/1477248386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2700060f70 msgr2=0x7f2700063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2700060f70 0x7f2700063430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f2704004630 tx=0x7f2704009b30).stop 2023-10-18T21:14:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 -- 172.21.15.8:0/1477248386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27140f6530 msgr2=0x7f2714108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27140f6530 0x7f2714108f80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f2710002700 tx=0x7f2710009d80).stop 2023-10-18T21:14:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 -- 172.21.15.8:0/1477248386 shutdown_connections 2023-10-18T21:14:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2700060f70 0x7f2700063430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27140f6530 0x7f2714108f80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 --2- 172.21.15.8:0/1477248386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27140f77d0 0x7f2714109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:18.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 -- 172.21.15.8:0/1477248386 >> 172.21.15.8:0/1477248386 conn(0x7f27140f1c90 msgr2=0x7f271406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:18.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 -- 172.21.15.8:0/1477248386 shutdown_connections 2023-10-18T21:14:18.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:18.976+0000 7f271aa55700 1 -- 172.21.15.8:0/1477248386 wait complete. 2023-10-18T21:14:18.986 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:14:19.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.114+0000 7f670f59e700 1 -- 172.21.15.8:0/3580808935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67100f64b0 msgr2=0x7f67100f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:19.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.114+0000 7f670f59e700 1 --2- 172.21.15.8:0/3580808935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67100f64b0 0x7f67100f68d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f6700004660 tx=0x7f6700009b30).stop 2023-10-18T21:14:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.114+0000 7f670f59e700 1 -- 172.21.15.8:0/3580808935 shutdown_connections 2023-10-18T21:14:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.114+0000 7f670f59e700 1 --2- 172.21.15.8:0/3580808935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67100f7750 0x7f67100f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.114+0000 7f670f59e700 1 --2- 172.21.15.8:0/3580808935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67100f64b0 0x7f67100f68d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.114+0000 7f670f59e700 1 -- 172.21.15.8:0/3580808935 >> 172.21.15.8:0/3580808935 conn(0x7f67100f1c30 msgr2=0x7f67100f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:19.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.114+0000 7f670f59e700 1 -- 172.21.15.8:0/3580808935 shutdown_connections 2023-10-18T21:14:19.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.114+0000 7f670f59e700 1 -- 172.21.15.8:0/3580808935 wait complete. 2023-10-18T21:14:19.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.115+0000 7f670f59e700 1 Processor -- start 2023-10-18T21:14:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.115+0000 7f670f59e700 1 -- start start 2023-10-18T21:14:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.115+0000 7f670f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67100f64b0 0x7f671006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.115+0000 7f670f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67100f7750 0x7f6710069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.115+0000 7f670f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671006a380 con 0x7f67100f7750 2023-10-18T21:14:19.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.115+0000 7f670f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671006a4c0 con 0x7f67100f64b0 2023-10-18T21:14:19.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.116+0000 7f670dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67100f7750 0x7f6710069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:19.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.116+0000 7f670dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67100f7750 0x7f6710069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53812/0 (socket says 172.21.15.8:53812) 2023-10-18T21:14:19.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.116+0000 7f670dd9b700 1 -- 172.21.15.8:0/1621705535 learned_addr learned my addr 172.21.15.8:0/1621705535 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:19.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.116+0000 7f670e59c700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67100f64b0 0x7f671006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:19.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.116+0000 7f670dd9b700 1 -- 172.21.15.8:0/1621705535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67100f64b0 msgr2=0x7f671006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:19.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.116+0000 7f670dd9b700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67100f64b0 0x7f671006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:19.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.116+0000 7f670dd9b700 1 -- 172.21.15.8:0/1621705535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700005040 con 0x7f67100f7750 2023-10-18T21:14:19.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.116+0000 7f670dd9b700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67100f7750 0x7f6710069e20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f670400e7f0 tx=0x7f670400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:19.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.117+0000 7f66feffd700 1 -- 172.21.15.8:0/1621705535 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67040092e0 con 0x7f67100f7750 2023-10-18T21:14:19.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.117+0000 7f66feffd700 1 -- 172.21.15.8:0/1621705535 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f670400f040 con 0x7f67100f7750 2023-10-18T21:14:19.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.117+0000 7f670f59e700 1 -- 172.21.15.8:0/1621705535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671006a7a0 con 0x7f67100f7750 2023-10-18T21:14:19.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.117+0000 7f66feffd700 1 -- 172.21.15.8:0/1621705535 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67040147e0 con 0x7f67100f7750 2023-10-18T21:14:19.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.117+0000 7f670f59e700 1 -- 172.21.15.8:0/1621705535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671010ece0 con 0x7f67100f7750 2023-10-18T21:14:19.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.118+0000 7f670f59e700 1 -- 172.21.15.8:0/1621705535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6710059100 con 0x7f67100f7750 2023-10-18T21:14:19.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.119+0000 7f66feffd700 1 -- 172.21.15.8:0/1621705535 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f670401b030 con 0x7f67100f7750 2023-10-18T21:14:19.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.119+0000 7f66feffd700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66f8060f70 0x7f66f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:19.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.120+0000 7f66feffd700 1 -- 172.21.15.8:0/1621705535 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f670407c700 con 0x7f67100f7750 2023-10-18T21:14:19.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.120+0000 7f670e59c700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66f8060f70 0x7f66f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:19.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.120+0000 7f670e59c700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66f8060f70 0x7f66f8063430 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f6700005010 tx=0x7f6700016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:19.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.124+0000 7f66feffd700 1 -- 172.21.15.8:0/1621705535 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f670404c420 con 0x7f67100f7750 2023-10-18T21:14:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.320+0000 7f670f59e700 1 -- 172.21.15.8:0/1621705535 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67100fed00 con 0x7f66f8060f70 2023-10-18T21:14:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.321+0000 7f66feffd700 1 -- 172.21.15.8:0/1621705535 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f67100fed00 con 0x7f66f8060f70 2023-10-18T21:14:19.323 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:14:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:14:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:14:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:14:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:14:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:14:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:14:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:14:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:14:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:14:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:14:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:14:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:14:19.325 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:14:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 -- 172.21.15.8:0/1621705535 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66f8060f70 msgr2=0x7f66f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66f8060f70 0x7f66f8063430 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f6700005010 tx=0x7f6700016040).stop 2023-10-18T21:14:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 -- 172.21.15.8:0/1621705535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67100f7750 msgr2=0x7f6710069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67100f7750 0x7f6710069e20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f670400e7f0 tx=0x7f670400b040).stop 2023-10-18T21:14:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 -- 172.21.15.8:0/1621705535 shutdown_connections 2023-10-18T21:14:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f66f8060f70 0x7f66f8063430 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67100f64b0 0x7f671006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 --2- 172.21.15.8:0/1621705535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67100f7750 0x7f6710069e20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 -- 172.21.15.8:0/1621705535 >> 172.21.15.8:0/1621705535 conn(0x7f67100f1c30 msgr2=0x7f67100fb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 -- 172.21.15.8:0/1621705535 shutdown_connections 2023-10-18T21:14:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:19.323+0000 7f670f59e700 1 -- 172.21.15.8:0/1621705535 wait complete. 2023-10-18T21:14:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:17.831508+0000 mgr.smithi008.flmjzp (mgr.14640) 932 : cluster [DBG] pgmap v656: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:17.837687+0000 mgr.smithi008.flmjzp (mgr.14640) 933 : audit [DBG] from='client.34960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:18.185731+0000 mgr.smithi008.flmjzp (mgr.14640) 934 : audit [DBG] from='client.34964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:18.597560+0000 mon.smithi008 (mon.0) 1407 : audit [DBG] from='client.? 172.21.15.8:0/1751826913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:18.975809+0000 mon.smithi008 (mon.0) 1408 : audit [DBG] from='client.? 172.21.15.8:0/1477248386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:14:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:17.831508+0000 mgr.smithi008.flmjzp (mgr.14640) 932 : cluster [DBG] pgmap v656: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:17.837687+0000 mgr.smithi008.flmjzp (mgr.14640) 933 : audit [DBG] from='client.34960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:18.185731+0000 mgr.smithi008.flmjzp (mgr.14640) 934 : audit [DBG] from='client.34964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:18.597560+0000 mon.smithi008 (mon.0) 1407 : audit [DBG] from='client.? 172.21.15.8:0/1751826913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:18.975809+0000 mon.smithi008 (mon.0) 1408 : audit [DBG] from='client.? 172.21.15.8:0/1477248386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:14:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:19.322239+0000 mgr.smithi008.flmjzp (mgr.14640) 935 : audit [DBG] from='client.34976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:20.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:19.322239+0000 mgr.smithi008.flmjzp (mgr.14640) 935 : audit [DBG] from='client.34976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:19.832200+0000 mgr.smithi008.flmjzp (mgr.14640) 936 : cluster [DBG] pgmap v657: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:19.832200+0000 mgr.smithi008.flmjzp (mgr.14640) 936 : cluster [DBG] pgmap v657: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:21.832797+0000 mgr.smithi008.flmjzp (mgr.14640) 937 : cluster [DBG] pgmap v658: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:23.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:21.832797+0000 mgr.smithi008.flmjzp (mgr.14640) 937 : cluster [DBG] pgmap v658: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:23.833405+0000 mgr.smithi008.flmjzp (mgr.14640) 938 : cluster [DBG] pgmap v659: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:23.833405+0000 mgr.smithi008.flmjzp (mgr.14640) 938 : cluster [DBG] pgmap v659: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:25.862126+0000 mon.smithi008 (mon.0) 1409 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:25.864138+0000 mon.smithi008 (mon.0) 1410 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:25.865142+0000 mon.smithi008 (mon.0) 1411 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:25.871954+0000 mon.smithi008 (mon.0) 1412 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:25.878480+0000 mon.smithi008 (mon.0) 1413 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:25.883184+0000 mon.smithi008 (mon.0) 1414 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:25.884858+0000 mon.smithi008 (mon.0) 1415 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:25.886348+0000 mon.smithi008 (mon.0) 1416 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:25.888322+0000 mon.smithi008 (mon.0) 1417 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:25.862126+0000 mon.smithi008 (mon.0) 1409 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:25.864138+0000 mon.smithi008 (mon.0) 1410 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:25.865142+0000 mon.smithi008 (mon.0) 1411 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:25.871954+0000 mon.smithi008 (mon.0) 1412 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:25.878480+0000 mon.smithi008 (mon.0) 1413 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:25.883184+0000 mon.smithi008 (mon.0) 1414 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:25.884858+0000 mon.smithi008 (mon.0) 1415 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:25.886348+0000 mon.smithi008 (mon.0) 1416 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:25.888322+0000 mon.smithi008 (mon.0) 1417 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:25.834097+0000 mgr.smithi008.flmjzp (mgr.14640) 939 : cluster [DBG] pgmap v660: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:25.865990+0000 mgr.smithi008.flmjzp (mgr.14640) 940 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:25.866611+0000 mgr.smithi008.flmjzp (mgr.14640) 941 : cluster [DBG] pgmap v661: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:25.866917+0000 mgr.smithi008.flmjzp (mgr.14640) 942 : cluster [DBG] pgmap v662: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:25.890287+0000 mgr.smithi008.flmjzp (mgr.14640) 943 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:25.834097+0000 mgr.smithi008.flmjzp (mgr.14640) 939 : cluster [DBG] pgmap v660: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:25.865990+0000 mgr.smithi008.flmjzp (mgr.14640) 940 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:25.866611+0000 mgr.smithi008.flmjzp (mgr.14640) 941 : cluster [DBG] pgmap v661: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:25.866917+0000 mgr.smithi008.flmjzp (mgr.14640) 942 : cluster [DBG] pgmap v662: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:25.890287+0000 mgr.smithi008.flmjzp (mgr.14640) 943 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:27.867555+0000 mgr.smithi008.flmjzp (mgr.14640) 944 : cluster [DBG] pgmap v663: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:29.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:27.867555+0000 mgr.smithi008.flmjzp (mgr.14640) 944 : cluster [DBG] pgmap v663: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:29.868052+0000 mgr.smithi008.flmjzp (mgr.14640) 945 : cluster [DBG] pgmap v664: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:29.868052+0000 mgr.smithi008.flmjzp (mgr.14640) 945 : cluster [DBG] pgmap v664: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:31.868597+0000 mgr.smithi008.flmjzp (mgr.14640) 946 : cluster [DBG] pgmap v665: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:33.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:31.868597+0000 mgr.smithi008.flmjzp (mgr.14640) 946 : cluster [DBG] pgmap v665: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:33.869288+0000 mgr.smithi008.flmjzp (mgr.14640) 947 : cluster [DBG] pgmap v666: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:35.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:33.869288+0000 mgr.smithi008.flmjzp (mgr.14640) 947 : cluster [DBG] pgmap v666: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:35.901131+0000 mon.smithi008 (mon.0) 1418 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:35.903340+0000 mon.smithi008 (mon.0) 1419 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:35.904413+0000 mon.smithi008 (mon.0) 1420 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:35.911009+0000 mon.smithi008 (mon.0) 1421 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:35.918802+0000 mon.smithi008 (mon.0) 1422 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:35.922020+0000 mon.smithi008 (mon.0) 1423 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:35.923634+0000 mon.smithi008 (mon.0) 1424 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:36.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:35.925124+0000 mon.smithi008 (mon.0) 1425 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:36.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:35.927023+0000 mon.smithi008 (mon.0) 1426 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:35.901131+0000 mon.smithi008 (mon.0) 1418 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:35.903340+0000 mon.smithi008 (mon.0) 1419 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:35.904413+0000 mon.smithi008 (mon.0) 1420 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:35.911009+0000 mon.smithi008 (mon.0) 1421 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:35.918802+0000 mon.smithi008 (mon.0) 1422 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:35.922020+0000 mon.smithi008 (mon.0) 1423 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:35.923634+0000 mon.smithi008 (mon.0) 1424 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:35.925124+0000 mon.smithi008 (mon.0) 1425 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:35.927023+0000 mon.smithi008 (mon.0) 1426 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:35.869817+0000 mgr.smithi008.flmjzp (mgr.14640) 948 : cluster [DBG] pgmap v667: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:35.905341+0000 mgr.smithi008.flmjzp (mgr.14640) 949 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:35.905954+0000 mgr.smithi008.flmjzp (mgr.14640) 950 : cluster [DBG] pgmap v668: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:35.906194+0000 mgr.smithi008.flmjzp (mgr.14640) 951 : cluster [DBG] pgmap v669: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:35.929056+0000 mgr.smithi008.flmjzp (mgr.14640) 952 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:37.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:35.869817+0000 mgr.smithi008.flmjzp (mgr.14640) 948 : cluster [DBG] pgmap v667: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:35.905341+0000 mgr.smithi008.flmjzp (mgr.14640) 949 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:35.905954+0000 mgr.smithi008.flmjzp (mgr.14640) 950 : cluster [DBG] pgmap v668: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:35.906194+0000 mgr.smithi008.flmjzp (mgr.14640) 951 : cluster [DBG] pgmap v669: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:35.929056+0000 mgr.smithi008.flmjzp (mgr.14640) 952 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:37.906853+0000 mgr.smithi008.flmjzp (mgr.14640) 953 : cluster [DBG] pgmap v670: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:39.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:37.906853+0000 mgr.smithi008.flmjzp (mgr.14640) 953 : cluster [DBG] pgmap v670: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:39.907400+0000 mgr.smithi008.flmjzp (mgr.14640) 954 : cluster [DBG] pgmap v671: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:39.907400+0000 mgr.smithi008.flmjzp (mgr.14640) 954 : cluster [DBG] pgmap v671: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:43.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:41.907994+0000 mgr.smithi008.flmjzp (mgr.14640) 955 : cluster [DBG] pgmap v672: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:43.542 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:41.907994+0000 mgr.smithi008.flmjzp (mgr.14640) 955 : cluster [DBG] pgmap v672: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:43.908677+0000 mgr.smithi008.flmjzp (mgr.14640) 956 : cluster [DBG] pgmap v673: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:43.908677+0000 mgr.smithi008.flmjzp (mgr.14640) 956 : cluster [DBG] pgmap v673: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:45.939833+0000 mon.smithi008 (mon.0) 1427 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:45.939833+0000 mon.smithi008 (mon.0) 1427 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:45.909307+0000 mgr.smithi008.flmjzp (mgr.14640) 957 : cluster [DBG] pgmap v674: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:46.498710+0000 mon.smithi008 (mon.0) 1428 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:46.499505+0000 mon.smithi008 (mon.0) 1429 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:46.500166+0000 mgr.smithi008.flmjzp (mgr.14640) 958 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:46.500691+0000 mgr.smithi008.flmjzp (mgr.14640) 959 : cluster [DBG] pgmap v675: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:46.500905+0000 mgr.smithi008.flmjzp (mgr.14640) 960 : cluster [DBG] pgmap v676: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:46.504816+0000 mon.smithi008 (mon.0) 1430 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:46.509799+0000 mon.smithi008 (mon.0) 1431 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:46.512200+0000 mon.smithi008 (mon.0) 1432 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:46.513410+0000 mon.smithi008 (mon.0) 1433 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:46.514567+0000 mon.smithi008 (mon.0) 1434 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:46.516039+0000 mon.smithi008 (mon.0) 1435 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:46.517652+0000 mgr.smithi008.flmjzp (mgr.14640) 961 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:45.909307+0000 mgr.smithi008.flmjzp (mgr.14640) 957 : cluster [DBG] pgmap v674: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:46.498710+0000 mon.smithi008 (mon.0) 1428 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:46.499505+0000 mon.smithi008 (mon.0) 1429 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:46.500166+0000 mgr.smithi008.flmjzp (mgr.14640) 958 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:46.500691+0000 mgr.smithi008.flmjzp (mgr.14640) 959 : cluster [DBG] pgmap v675: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:46.500905+0000 mgr.smithi008.flmjzp (mgr.14640) 960 : cluster [DBG] pgmap v676: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:46.504816+0000 mon.smithi008 (mon.0) 1430 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:47.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:46.509799+0000 mon.smithi008 (mon.0) 1431 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:47.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:46.512200+0000 mon.smithi008 (mon.0) 1432 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:47.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:46.513410+0000 mon.smithi008 (mon.0) 1433 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:47.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:46.514567+0000 mon.smithi008 (mon.0) 1434 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:47.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:46.516039+0000 mon.smithi008 (mon.0) 1435 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:47.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:46.517652+0000 mgr.smithi008.flmjzp (mgr.14640) 961 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:49.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.476+0000 7fcb7319b700 1 -- 172.21.15.8:0/1558874837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb6c0f6530 msgr2=0x7fcb6c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:49.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.476+0000 7fcb7319b700 1 --2- 172.21.15.8:0/1558874837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb6c0f6530 0x7fcb6c0f6950 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fcb68004660 tx=0x7fcb68009b30).stop 2023-10-18T21:14:49.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.476+0000 7fcb7319b700 1 -- 172.21.15.8:0/1558874837 shutdown_connections 2023-10-18T21:14:49.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.476+0000 7fcb7319b700 1 --2- 172.21.15.8:0/1558874837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb6c0f77d0 0x7fcb6c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:49.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.476+0000 7fcb7319b700 1 --2- 172.21.15.8:0/1558874837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb6c0f6530 0x7fcb6c0f6950 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:49.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.476+0000 7fcb7319b700 1 -- 172.21.15.8:0/1558874837 >> 172.21.15.8:0/1558874837 conn(0x7fcb6c0f1c90 msgr2=0x7fcb6c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:49.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.476+0000 7fcb7319b700 1 -- 172.21.15.8:0/1558874837 shutdown_connections 2023-10-18T21:14:49.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.476+0000 7fcb7319b700 1 -- 172.21.15.8:0/1558874837 wait complete. 2023-10-18T21:14:49.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.477+0000 7fcb7319b700 1 Processor -- start 2023-10-18T21:14:49.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.477+0000 7fcb7319b700 1 -- start start 2023-10-18T21:14:49.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.478+0000 7fcb7319b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb6c0f6530 0x7fcb6c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:49.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.478+0000 7fcb7319b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb6c0f77d0 0x7fcb6c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:49.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.478+0000 7fcb7319b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c06a380 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.478+0000 7fcb7319b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c06a4c0 con 0x7fcb6c0f6530 2023-10-18T21:14:49.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.478+0000 7fcb71998700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb6c0f77d0 0x7fcb6c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:49.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.478+0000 7fcb71998700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb6c0f77d0 0x7fcb6c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39276/0 (socket says 172.21.15.8:39276) 2023-10-18T21:14:49.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.478+0000 7fcb71998700 1 -- 172.21.15.8:0/1969374968 learned_addr learned my addr 172.21.15.8:0/1969374968 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:49.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.478+0000 7fcb72199700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb6c0f6530 0x7fcb6c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:49.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.479+0000 7fcb71998700 1 -- 172.21.15.8:0/1969374968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb6c0f6530 msgr2=0x7fcb6c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:49.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.479+0000 7fcb71998700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb6c0f6530 0x7fcb6c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:49.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.479+0000 7fcb71998700 1 -- 172.21.15.8:0/1969374968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68005040 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.479+0000 7fcb71998700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb6c0f77d0 0x7fcb6c069e20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fcb5c0026d0 tx=0x7fcb5c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:49.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.479+0000 7fcb62ffd700 1 -- 172.21.15.8:0/1969374968 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5c0079c0 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.479+0000 7fcb62ffd700 1 -- 172.21.15.8:0/1969374968 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcb5c00f040 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.479+0000 7fcb62ffd700 1 -- 172.21.15.8:0/1969374968 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5c014980 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.479+0000 7fcb7319b700 1 -- 172.21.15.8:0/1969374968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c06a7a0 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.479+0000 7fcb7319b700 1 -- 172.21.15.8:0/1969374968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c10ede0 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.480+0000 7fcb7319b700 1 -- 172.21.15.8:0/1969374968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c045ad0 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.481+0000 7fcb62ffd700 1 -- 172.21.15.8:0/1969374968 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcb5c0090d0 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.482+0000 7fcb62ffd700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb58060f70 0x7fcb58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:49.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.483+0000 7fcb62ffd700 1 -- 172.21.15.8:0/1969374968 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcb5c07c8a0 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.483+0000 7fcb72199700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb58060f70 0x7fcb58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:49.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.483+0000 7fcb72199700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb58060f70 0x7fcb58063430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fcb68005010 tx=0x7fcb68009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:49.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.487+0000 7fcb62ffd700 1 -- 172.21.15.8:0/1969374968 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcb5c04c580 con 0x7fcb6c0f77d0 2023-10-18T21:14:49.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.685+0000 7fcb7319b700 1 -- 172.21.15.8:0/1969374968 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb6c0fedd0 con 0x7fcb58060f70 2023-10-18T21:14:49.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.687+0000 7fcb62ffd700 1 -- 172.21.15.8:0/1969374968 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcb6c0fedd0 con 0x7fcb58060f70 2023-10-18T21:14:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 -- 172.21.15.8:0/1969374968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb58060f70 msgr2=0x7fcb58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb58060f70 0x7fcb58063430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fcb68005010 tx=0x7fcb68009b30).stop 2023-10-18T21:14:49.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 -- 172.21.15.8:0/1969374968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb6c0f77d0 msgr2=0x7fcb6c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:49.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb6c0f77d0 0x7fcb6c069e20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fcb5c0026d0 tx=0x7fcb5c009de0).stop 2023-10-18T21:14:49.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 -- 172.21.15.8:0/1969374968 shutdown_connections 2023-10-18T21:14:49.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb58060f70 0x7fcb58063430 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:49.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb6c0f6530 0x7fcb6c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:49.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 --2- 172.21.15.8:0/1969374968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb6c0f77d0 0x7fcb6c069e20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:49.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 -- 172.21.15.8:0/1969374968 >> 172.21.15.8:0/1969374968 conn(0x7fcb6c0f1c90 msgr2=0x7fcb6c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:49.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 -- 172.21.15.8:0/1969374968 shutdown_connections 2023-10-18T21:14:49.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.689+0000 7fcb7319b700 1 -- 172.21.15.8:0/1969374968 wait complete. 2023-10-18T21:14:49.706 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:14:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.826+0000 7f2bf359e700 1 -- 172.21.15.8:0/1178239551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bf40f9690 msgr2=0x7f2bf40fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.826+0000 7f2bf359e700 1 --2- 172.21.15.8:0/1178239551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bf40f9690 0x7f2bf40fbae0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f2bdc004660 tx=0x7f2bdc009b30).stop 2023-10-18T21:14:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.826+0000 7f2bf359e700 1 -- 172.21.15.8:0/1178239551 shutdown_connections 2023-10-18T21:14:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.826+0000 7f2bf359e700 1 --2- 172.21.15.8:0/1178239551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bf40f9690 0x7f2bf40fbae0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.826+0000 7f2bf359e700 1 --2- 172.21.15.8:0/1178239551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4060310 0x7f2bf40f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.826+0000 7f2bf359e700 1 -- 172.21.15.8:0/1178239551 >> 172.21.15.8:0/1178239551 conn(0x7f2bf40f0b90 msgr2=0x7f2bf40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.826+0000 7f2bf359e700 1 -- 172.21.15.8:0/1178239551 shutdown_connections 2023-10-18T21:14:49.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.826+0000 7f2bf359e700 1 -- 172.21.15.8:0/1178239551 wait complete. 2023-10-18T21:14:49.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.827+0000 7f2bf359e700 1 Processor -- start 2023-10-18T21:14:49.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.827+0000 7f2bf359e700 1 -- start start 2023-10-18T21:14:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.827+0000 7f2bf359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4060310 0x7f2bf4106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.827+0000 7f2bf359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bf40f9690 0x7f2bf41072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.827+0000 7f2bf359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf41078b0 con 0x7f2bf40f9690 2023-10-18T21:14:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.827+0000 7f2bf359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf41080f0 con 0x7f2bf4060310 2023-10-18T21:14:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.828+0000 7f2bebfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bf40f9690 0x7f2bf41072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:49.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.828+0000 7f2bf259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4060310 0x7f2bf4106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:49.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.828+0000 7f2bf259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4060310 0x7f2bf4106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:45840/0 (socket says 172.21.15.8:45840) 2023-10-18T21:14:49.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.828+0000 7f2bf259c700 1 -- 172.21.15.8:0/2099834799 learned_addr learned my addr 172.21.15.8:0/2099834799 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:49.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.828+0000 7f2bebfff700 1 -- 172.21.15.8:0/2099834799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4060310 msgr2=0x7f2bf4106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:49.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.828+0000 7f2bebfff700 1 --2- 172.21.15.8:0/2099834799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4060310 0x7f2bf4106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.828+0000 7f2bebfff700 1 -- 172.21.15.8:0/2099834799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc005040 con 0x7f2bf40f9690 2023-10-18T21:14:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.828+0000 7f2bebfff700 1 --2- 172.21.15.8:0/2099834799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bf40f9690 0x7f2bf41072b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f2bdc000c00 tx=0x7f2bdc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.829+0000 7f2beaffd700 1 -- 172.21.15.8:0/2099834799 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bdc018070 con 0x7f2bf40f9690 2023-10-18T21:14:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.829+0000 7f2beaffd700 1 -- 172.21.15.8:0/2099834799 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2bdc009630 con 0x7f2bf40f9690 2023-10-18T21:14:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.829+0000 7f2bf359e700 1 -- 172.21.15.8:0/2099834799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf4108370 con 0x7f2bf40f9690 2023-10-18T21:14:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.829+0000 7f2beaffd700 1 -- 172.21.15.8:0/2099834799 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bdc0123c0 con 0x7f2bf40f9690 2023-10-18T21:14:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.829+0000 7f2bf359e700 1 -- 172.21.15.8:0/2099834799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf4108850 con 0x7f2bf40f9690 2023-10-18T21:14:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.830+0000 7f2bf359e700 1 -- 172.21.15.8:0/2099834799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf4059100 con 0x7f2bf40f9690 2023-10-18T21:14:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.831+0000 7f2beaffd700 1 -- 172.21.15.8:0/2099834799 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2bdc01d420 con 0x7f2bf40f9690 2023-10-18T21:14:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.831+0000 7f2beaffd700 1 --2- 172.21.15.8:0/2099834799 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2be0060f70 0x7f2be0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.831+0000 7f2beaffd700 1 -- 172.21.15.8:0/2099834799 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2bdc07e550 con 0x7f2bf40f9690 2023-10-18T21:14:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.832+0000 7f2bf259c700 1 --2- 172.21.15.8:0/2099834799 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2be0060f70 0x7f2be0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.832+0000 7f2bf259c700 1 --2- 172.21.15.8:0/2099834799 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2be0060f70 0x7f2be0063430 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f2bf4107b80 tx=0x7f2be4011040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:49.836+0000 7f2beaffd700 1 -- 172.21.15.8:0/2099834799 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2bdc04e180 con 0x7f2bf40f9690 2023-10-18T21:14:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:48.501484+0000 mgr.smithi008.flmjzp (mgr.14640) 962 : cluster [DBG] pgmap v677: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:49.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:48.501484+0000 mgr.smithi008.flmjzp (mgr.14640) 962 : cluster [DBG] pgmap v677: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.031+0000 7f2bf359e700 1 -- 172.21.15.8:0/2099834799 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bf40fed30 con 0x7f2be0060f70 2023-10-18T21:14:50.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.033+0000 7f2beaffd700 1 -- 172.21.15.8:0/2099834799 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2bf40fed30 con 0x7f2be0060f70 2023-10-18T21:14:50.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.034+0000 7f2bf359e700 1 -- 172.21.15.8:0/2099834799 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2be0060f70 msgr2=0x7f2be0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.034+0000 7f2bf359e700 1 --2- 172.21.15.8:0/2099834799 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2be0060f70 0x7f2be0063430 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f2bf4107b80 tx=0x7f2be4011040).stop 2023-10-18T21:14:50.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.034+0000 7f2bf359e700 1 -- 172.21.15.8:0/2099834799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bf40f9690 msgr2=0x7f2bf41072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.034+0000 7f2bf359e700 1 --2- 172.21.15.8:0/2099834799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bf40f9690 0x7f2bf41072b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f2bdc000c00 tx=0x7f2bdc009b30).stop 2023-10-18T21:14:50.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.035+0000 7f2bf359e700 1 -- 172.21.15.8:0/2099834799 shutdown_connections 2023-10-18T21:14:50.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.035+0000 7f2bf359e700 1 --2- 172.21.15.8:0/2099834799 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2be0060f70 0x7f2be0063430 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.035+0000 7f2bf359e700 1 --2- 172.21.15.8:0/2099834799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4060310 0x7f2bf4106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.035+0000 7f2bf359e700 1 --2- 172.21.15.8:0/2099834799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bf40f9690 0x7f2bf41072b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.035+0000 7f2bf359e700 1 -- 172.21.15.8:0/2099834799 >> 172.21.15.8:0/2099834799 conn(0x7f2bf40f0b90 msgr2=0x7f2bf40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:50.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.035+0000 7f2bf359e700 1 -- 172.21.15.8:0/2099834799 shutdown_connections 2023-10-18T21:14:50.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.035+0000 7f2bf359e700 1 -- 172.21.15.8:0/2099834799 wait complete. 2023-10-18T21:14:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.173+0000 7fcaeee44700 1 -- 172.21.15.8:0/696045665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcae80f9690 msgr2=0x7fcae80fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.173+0000 7fcaeee44700 1 --2- 172.21.15.8:0/696045665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcae80f9690 0x7fcae80fbae0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fcad8004660 tx=0x7fcad8009b30).stop 2023-10-18T21:14:50.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.173+0000 7fcaeee44700 1 -- 172.21.15.8:0/696045665 shutdown_connections 2023-10-18T21:14:50.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.173+0000 7fcaeee44700 1 --2- 172.21.15.8:0/696045665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcae80f9690 0x7fcae80fbae0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.173+0000 7fcaeee44700 1 --2- 172.21.15.8:0/696045665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae8060310 0x7fcae80f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.173+0000 7fcaeee44700 1 -- 172.21.15.8:0/696045665 >> 172.21.15.8:0/696045665 conn(0x7fcae80f0b90 msgr2=0x7fcae80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:50.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.173+0000 7fcaeee44700 1 -- 172.21.15.8:0/696045665 shutdown_connections 2023-10-18T21:14:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.173+0000 7fcaeee44700 1 -- 172.21.15.8:0/696045665 wait complete. 2023-10-18T21:14:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.174+0000 7fcaeee44700 1 Processor -- start 2023-10-18T21:14:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.174+0000 7fcaeee44700 1 -- start start 2023-10-18T21:14:50.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.174+0000 7fcaeee44700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcae8060310 0x7fcae8108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:50.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.174+0000 7fcaeee44700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae80f9690 0x7fcae8109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:50.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.174+0000 7fcaeee44700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae81099b0 con 0x7fcae8060310 2023-10-18T21:14:50.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.174+0000 7fcaeee44700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae8109af0 con 0x7fcae80f9690 2023-10-18T21:14:50.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.175+0000 7fcaede42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcae8060310 0x7fcae8108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.175+0000 7fcaede42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcae8060310 0x7fcae8108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39314/0 (socket says 172.21.15.8:39314) 2023-10-18T21:14:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.175+0000 7fcaede42700 1 -- 172.21.15.8:0/1498868858 learned_addr learned my addr 172.21.15.8:0/1498868858 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.175+0000 7fcaed641700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae80f9690 0x7fcae8109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.175+0000 7fcaede42700 1 -- 172.21.15.8:0/1498868858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae80f9690 msgr2=0x7fcae8109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.175+0000 7fcaede42700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae80f9690 0x7fcae8109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.175+0000 7fcaede42700 1 -- 172.21.15.8:0/1498868858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8005040 con 0x7fcae8060310 2023-10-18T21:14:50.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.175+0000 7fcaede42700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcae8060310 0x7fcae8108f10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fcae400e7f0 tx=0x7fcae400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:50.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.176+0000 7fcade7fc700 1 -- 172.21.15.8:0/1498868858 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae40092e0 con 0x7fcae8060310 2023-10-18T21:14:50.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.176+0000 7fcade7fc700 1 -- 172.21.15.8:0/1498868858 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcae400f040 con 0x7fcae8060310 2023-10-18T21:14:50.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.176+0000 7fcaeee44700 1 -- 172.21.15.8:0/1498868858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae810a490 con 0x7fcae8060310 2023-10-18T21:14:50.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.176+0000 7fcade7fc700 1 -- 172.21.15.8:0/1498868858 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae40147e0 con 0x7fcae8060310 2023-10-18T21:14:50.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.176+0000 7fcaeee44700 1 -- 172.21.15.8:0/1498868858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae810a9d0 con 0x7fcae8060310 2023-10-18T21:14:50.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.177+0000 7fcaeee44700 1 -- 172.21.15.8:0/1498868858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae8045ad0 con 0x7fcae8060310 2023-10-18T21:14:50.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.178+0000 7fcade7fc700 1 -- 172.21.15.8:0/1498868858 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcae401b030 con 0x7fcae8060310 2023-10-18T21:14:50.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.178+0000 7fcade7fc700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcad4060f70 0x7fcad4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:50.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.179+0000 7fcade7fc700 1 -- 172.21.15.8:0/1498868858 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcae407c680 con 0x7fcae8060310 2023-10-18T21:14:50.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.179+0000 7fcaed641700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcad4060f70 0x7fcad4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:50.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.179+0000 7fcaed641700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcad4060f70 0x7fcad4063430 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fcad8004630 tx=0x7fcad800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:50.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.183+0000 7fcade7fc700 1 -- 172.21.15.8:0/1498868858 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcae404fd70 con 0x7fcae8060310 2023-10-18T21:14:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.375+0000 7fcaeee44700 1 -- 172.21.15.8:0/1498868858 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcae80f5650 con 0x7fcad4060f70 2023-10-18T21:14:50.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.385+0000 7fcade7fc700 1 -- 172.21.15.8:0/1498868858 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcae80f5650 con 0x7fcad4060f70 2023-10-18T21:14:50.387 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:14:50.387 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (21m) 9m ago 22m 15.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:14:50.388 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (15m) 9m ago 22m 7558k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:14:50.388 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (15m) 7m ago 22m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:14:50.388 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (21m) 9m ago 22m 26.1M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:14:50.388 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 running (9m) 9m ago 19m - - 16.2.14-100-gb4ddd52c 92842c92b8bd 3556c3afca3b 2023-10-18T21:14:50.388 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 18m - - 2023-10-18T21:14:50.388 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (7m) 7m ago 18m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:14:50.389 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (7m) 7m ago 18m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:14:50.389 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (16m) 9m ago 24m 459M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:14:50.389 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (16m) 7m ago 22m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:14:50.389 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (15m) 9m ago 24m 116M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:14:50.389 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (15m) 7m ago 22m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:14:50.390 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (22m) 9m ago 22m 9.81M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:14:50.390 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (21m) 7m ago 21m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:14:50.390 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (15m) 9m ago 21m 444M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:14:50.390 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (13m) 9m ago 21m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:14:50.390 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (12m) 9m ago 20m 253M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:14:50.391 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (12m) 7m ago 20m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:14:50.391 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (11m) 7m ago 20m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:14:50.391 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (10m) 7m ago 20m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:14:50.391 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (17m) 9m ago 22m 61.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:14:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 -- 172.21.15.8:0/1498868858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcad4060f70 msgr2=0x7fcad4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcad4060f70 0x7fcad4063430 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fcad8004630 tx=0x7fcad800b040).stop 2023-10-18T21:14:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 -- 172.21.15.8:0/1498868858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcae8060310 msgr2=0x7fcae8108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcae8060310 0x7fcae8108f10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fcae400e7f0 tx=0x7fcae400b040).stop 2023-10-18T21:14:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 -- 172.21.15.8:0/1498868858 shutdown_connections 2023-10-18T21:14:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcad4060f70 0x7fcad4063430 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcae8060310 0x7fcae8108f10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 --2- 172.21.15.8:0/1498868858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae80f9690 0x7fcae8109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 -- 172.21.15.8:0/1498868858 >> 172.21.15.8:0/1498868858 conn(0x7fcae80f0b90 msgr2=0x7fcae80f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 -- 172.21.15.8:0/1498868858 shutdown_connections 2023-10-18T21:14:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.387+0000 7fcaeee44700 1 -- 172.21.15.8:0/1498868858 wait complete. 2023-10-18T21:14:50.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.524+0000 7fbc25bab700 1 -- 172.21.15.8:0/1434813770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc200f77d0 msgr2=0x7fbc200f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.524+0000 7fbc25bab700 1 --2- 172.21.15.8:0/1434813770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc200f77d0 0x7fbc200f7c30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fbc0c004660 tx=0x7fbc0c009b30).stop 2023-10-18T21:14:50.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.524+0000 7fbc25bab700 1 -- 172.21.15.8:0/1434813770 shutdown_connections 2023-10-18T21:14:50.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.524+0000 7fbc25bab700 1 --2- 172.21.15.8:0/1434813770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc200f77d0 0x7fbc200f7c30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.524+0000 7fbc25bab700 1 --2- 172.21.15.8:0/1434813770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc200f6530 0x7fbc200f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.524+0000 7fbc25bab700 1 -- 172.21.15.8:0/1434813770 >> 172.21.15.8:0/1434813770 conn(0x7fbc200f1c90 msgr2=0x7fbc200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:50.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.524+0000 7fbc25bab700 1 -- 172.21.15.8:0/1434813770 shutdown_connections 2023-10-18T21:14:50.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.524+0000 7fbc25bab700 1 -- 172.21.15.8:0/1434813770 wait complete. 2023-10-18T21:14:50.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.525+0000 7fbc25bab700 1 Processor -- start 2023-10-18T21:14:50.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.525+0000 7fbc25bab700 1 -- start start 2023-10-18T21:14:50.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.525+0000 7fbc25bab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc200f6530 0x7fbc20108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:50.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.525+0000 7fbc25bab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc200f77d0 0x7fbc201093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:50.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.525+0000 7fbc25bab700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc201099a0 con 0x7fbc200f6530 2023-10-18T21:14:50.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.525+0000 7fbc25bab700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20109ae0 con 0x7fbc200f77d0 2023-10-18T21:14:50.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc24ba9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc200f6530 0x7fbc20108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:50.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc24ba9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc200f6530 0x7fbc20108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39332/0 (socket says 172.21.15.8:39332) 2023-10-18T21:14:50.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc24ba9700 1 -- 172.21.15.8:0/413806552 learned_addr learned my addr 172.21.15.8:0/413806552 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:50.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc1ffff700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc200f77d0 0x7fbc201093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:50.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc24ba9700 1 -- 172.21.15.8:0/413806552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc200f77d0 msgr2=0x7fbc201093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc24ba9700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc200f77d0 0x7fbc201093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc24ba9700 1 -- 172.21.15.8:0/413806552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c005040 con 0x7fbc200f6530 2023-10-18T21:14:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc1ffff700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc200f77d0 0x7fbc201093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:14:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc24ba9700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc200f6530 0x7fbc20108f00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fbc1400e7c0 tx=0x7fbc1400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc1d7fa700 1 -- 172.21.15.8:0/413806552 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc140092e0 con 0x7fbc200f6530 2023-10-18T21:14:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc1d7fa700 1 -- 172.21.15.8:0/413806552 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbc1400f040 con 0x7fbc200f6530 2023-10-18T21:14:50.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.526+0000 7fbc25bab700 1 -- 172.21.15.8:0/413806552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2010a480 con 0x7fbc200f6530 2023-10-18T21:14:50.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.527+0000 7fbc1d7fa700 1 -- 172.21.15.8:0/413806552 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc140147e0 con 0x7fbc200f6530 2023-10-18T21:14:50.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.527+0000 7fbc25bab700 1 -- 172.21.15.8:0/413806552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2010a9c0 con 0x7fbc200f6530 2023-10-18T21:14:50.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.528+0000 7fbc25bab700 1 -- 172.21.15.8:0/413806552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc20045ad0 con 0x7fbc200f6530 2023-10-18T21:14:50.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.529+0000 7fbc1d7fa700 1 -- 172.21.15.8:0/413806552 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbc1401b030 con 0x7fbc200f6530 2023-10-18T21:14:50.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.529+0000 7fbc1d7fa700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc10060f70 0x7fbc10063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:50.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.529+0000 7fbc1d7fa700 1 -- 172.21.15.8:0/413806552 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbc1407c990 con 0x7fbc200f6530 2023-10-18T21:14:50.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.530+0000 7fbc1ffff700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc10060f70 0x7fbc10063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:50.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.530+0000 7fbc1ffff700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc10060f70 0x7fbc10063430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fbc0c0043d0 tx=0x7fbc0c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:50.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.534+0000 7fbc1d7fa700 1 -- 172.21.15.8:0/413806552 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbc1404ff10 con 0x7fbc200f6530 2023-10-18T21:14:50.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.788+0000 7fbc25bab700 1 -- 172.21.15.8:0/413806552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbc2010ac30 con 0x7fbc200f6530 2023-10-18T21:14:50.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.789+0000 7fbc1d7fa700 1 -- 172.21.15.8:0/413806552 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fbc14019020 con 0x7fbc200f6530 2023-10-18T21:14:50.791 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:14:50.791 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:14:50.791 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:14:50.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:14:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:14:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:14:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:14:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:14:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:14:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:14:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:14:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:14:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:14:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:14:50.794 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:14:50.794 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:14:50.794 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:14:50.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 -- 172.21.15.8:0/413806552 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc10060f70 msgr2=0x7fbc10063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc10060f70 0x7fbc10063430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fbc0c0043d0 tx=0x7fbc0c00b040).stop 2023-10-18T21:14:50.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 -- 172.21.15.8:0/413806552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc200f6530 msgr2=0x7fbc20108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc200f6530 0x7fbc20108f00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fbc1400e7c0 tx=0x7fbc1400b040).stop 2023-10-18T21:14:50.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 -- 172.21.15.8:0/413806552 shutdown_connections 2023-10-18T21:14:50.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc10060f70 0x7fbc10063430 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc200f6530 0x7fbc20108f00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 --2- 172.21.15.8:0/413806552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc200f77d0 0x7fbc201093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 -- 172.21.15.8:0/413806552 >> 172.21.15.8:0/413806552 conn(0x7fbc200f1c90 msgr2=0x7fbc2006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:50.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 -- 172.21.15.8:0/413806552 shutdown_connections 2023-10-18T21:14:50.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.791+0000 7fbc25bab700 1 -- 172.21.15.8:0/413806552 wait complete. 2023-10-18T21:14:50.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:49.688174+0000 mgr.smithi008.flmjzp (mgr.14640) 963 : audit [DBG] from='client.34980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:50.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.929+0000 7f203751b700 1 -- 172.21.15.8:0/460259443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300f77d0 msgr2=0x7f20300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.929+0000 7f203751b700 1 --2- 172.21.15.8:0/460259443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300f77d0 0x7f20300f7c30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f2020004660 tx=0x7f2020009b30).stop 2023-10-18T21:14:50.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.929+0000 7f203751b700 1 -- 172.21.15.8:0/460259443 shutdown_connections 2023-10-18T21:14:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.929+0000 7f203751b700 1 --2- 172.21.15.8:0/460259443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300f77d0 0x7f20300f7c30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.929+0000 7f203751b700 1 --2- 172.21.15.8:0/460259443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20300f6530 0x7f20300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.929+0000 7f203751b700 1 -- 172.21.15.8:0/460259443 >> 172.21.15.8:0/460259443 conn(0x7f20300f1c90 msgr2=0x7f20300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.929+0000 7f203751b700 1 -- 172.21.15.8:0/460259443 shutdown_connections 2023-10-18T21:14:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.929+0000 7f203751b700 1 -- 172.21.15.8:0/460259443 wait complete. 2023-10-18T21:14:50.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.930+0000 7f203751b700 1 Processor -- start 2023-10-18T21:14:50.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.931+0000 7f203751b700 1 -- start start 2023-10-18T21:14:50.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.931+0000 7f203751b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300f6530 0x7f203006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:50.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.931+0000 7f203751b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20300f77d0 0x7f2030069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:50.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.931+0000 7f203751b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203006a380 con 0x7f20300f6530 2023-10-18T21:14:50.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.931+0000 7f203751b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203006a4c0 con 0x7f20300f77d0 2023-10-18T21:14:50.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.931+0000 7f2036519700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300f6530 0x7f203006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:50.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.931+0000 7f2035d18700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20300f77d0 0x7f2030069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.931+0000 7f2036519700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300f6530 0x7f203006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39348/0 (socket says 172.21.15.8:39348) 2023-10-18T21:14:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.931+0000 7f2036519700 1 -- 172.21.15.8:0/3123526920 learned_addr learned my addr 172.21.15.8:0/3123526920 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.932+0000 7f2036519700 1 -- 172.21.15.8:0/3123526920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20300f77d0 msgr2=0x7f2030069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.932+0000 7f2036519700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20300f77d0 0x7f2030069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.932+0000 7f2036519700 1 -- 172.21.15.8:0/3123526920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2020005040 con 0x7f20300f6530 2023-10-18T21:14:50.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.932+0000 7f2035d18700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20300f77d0 0x7f2030069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:14:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.932+0000 7f2036519700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300f6530 0x7f203006b9a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f202c002700 tx=0x7f202c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.932+0000 7f2026ffd700 1 -- 172.21.15.8:0/3123526920 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f202c0079c0 con 0x7f20300f6530 2023-10-18T21:14:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.932+0000 7f2026ffd700 1 -- 172.21.15.8:0/3123526920 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f202c00f040 con 0x7f20300f6530 2023-10-18T21:14:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.932+0000 7f2026ffd700 1 -- 172.21.15.8:0/3123526920 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f202c0148d0 con 0x7f20300f6530 2023-10-18T21:14:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.932+0000 7f203751b700 1 -- 172.21.15.8:0/3123526920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203006a7a0 con 0x7f20300f6530 2023-10-18T21:14:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.933+0000 7f203751b700 1 -- 172.21.15.8:0/3123526920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203010ed70 con 0x7f20300f6530 2023-10-18T21:14:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.934+0000 7f203751b700 1 -- 172.21.15.8:0/3123526920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2030045ad0 con 0x7f20300f6530 2023-10-18T21:14:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.935+0000 7f2026ffd700 1 -- 172.21.15.8:0/3123526920 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f202c01b060 con 0x7f20300f6530 2023-10-18T21:14:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.935+0000 7f2026ffd700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f201c060f70 0x7f201c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.935+0000 7f2026ffd700 1 -- 172.21.15.8:0/3123526920 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f202c07c6b0 con 0x7f20300f6530 2023-10-18T21:14:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.936+0000 7f2035d18700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f201c060f70 0x7f201c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.936+0000 7f2035d18700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f201c060f70 0x7f201c063430 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f2020004e30 tx=0x7f2020009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:50.939+0000 7f2026ffd700 1 -- 172.21.15.8:0/3123526920 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f202c04c3a0 con 0x7f20300f6530 2023-10-18T21:14:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:49.688174+0000 mgr.smithi008.flmjzp (mgr.14640) 963 : audit [DBG] from='client.34980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:51.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.166+0000 7f203751b700 1 -- 172.21.15.8:0/3123526920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f20300fedc0 con 0x7f20300f6530 2023-10-18T21:14:51.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.167+0000 7f2026ffd700 1 -- 172.21.15.8:0/3123526920 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f202c04f9c0 con 0x7f20300f6530 2023-10-18T21:14:51.169 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:14:51.169 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:14:51.170 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:14:51.170 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:14:51.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:14:51.170 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:14:51.171 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:14:51.171 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:14:51.171 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:14:51.171 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:14:51.171 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:14:51.171 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:14:51.172 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:14:51.172 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:14:51.172 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:14:51.172 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:14:51.172 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:14:51.173 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:14:51.173 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:14:51.173 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:14:51.173 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:14:51.173 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:14:51.174 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:14:51.174 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:14:51.174 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:14:51.174 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:14:51.174 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:14:51.175 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:14:51.175 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:14:51.175 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:14:51.175 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:14:51.175 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:14:51.176 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:14:51.176 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:14:51.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 -- 172.21.15.8:0/3123526920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f201c060f70 msgr2=0x7f201c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:51.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f201c060f70 0x7f201c063430 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f2020004e30 tx=0x7f2020009b30).stop 2023-10-18T21:14:51.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 -- 172.21.15.8:0/3123526920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300f6530 msgr2=0x7f203006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:51.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300f6530 0x7f203006b9a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f202c002700 tx=0x7f202c009d80).stop 2023-10-18T21:14:51.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 -- 172.21.15.8:0/3123526920 shutdown_connections 2023-10-18T21:14:51.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f201c060f70 0x7f201c063430 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:51.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300f6530 0x7f203006b9a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:51.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 --2- 172.21.15.8:0/3123526920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20300f77d0 0x7f2030069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:51.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 -- 172.21.15.8:0/3123526920 >> 172.21.15.8:0/3123526920 conn(0x7f20300f1c90 msgr2=0x7f20300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:51.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 -- 172.21.15.8:0/3123526920 shutdown_connections 2023-10-18T21:14:51.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.169+0000 7f203751b700 1 -- 172.21.15.8:0/3123526920 wait complete. 2023-10-18T21:14:51.179 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:14:51.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.307+0000 7fc602b94700 1 -- 172.21.15.8:0/1028670039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5fc0f77d0 msgr2=0x7fc5fc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:51.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.307+0000 7fc602b94700 1 --2- 172.21.15.8:0/1028670039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc0f7c30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fc5ec004660 tx=0x7fc5ec009b30).stop 2023-10-18T21:14:51.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.307+0000 7fc602b94700 1 -- 172.21.15.8:0/1028670039 shutdown_connections 2023-10-18T21:14:51.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.307+0000 7fc602b94700 1 --2- 172.21.15.8:0/1028670039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc0f7c30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:51.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.307+0000 7fc602b94700 1 --2- 172.21.15.8:0/1028670039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:51.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.307+0000 7fc602b94700 1 -- 172.21.15.8:0/1028670039 >> 172.21.15.8:0/1028670039 conn(0x7fc5fc0f1c90 msgr2=0x7fc5fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:51.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.308+0000 7fc602b94700 1 -- 172.21.15.8:0/1028670039 shutdown_connections 2023-10-18T21:14:51.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.308+0000 7fc602b94700 1 -- 172.21.15.8:0/1028670039 wait complete. 2023-10-18T21:14:51.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.308+0000 7fc602b94700 1 Processor -- start 2023-10-18T21:14:51.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.309+0000 7fc602b94700 1 -- start start 2023-10-18T21:14:51.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.309+0000 7fc602b94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:51.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.309+0000 7fc602b94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:51.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.309+0000 7fc602b94700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc109a20 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.309+0000 7fc602b94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc109b60 con 0x7fc5fc0f6530 2023-10-18T21:14:51.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.309+0000 7fc601391700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:51.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.309+0000 7fc601391700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39376/0 (socket says 172.21.15.8:39376) 2023-10-18T21:14:51.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.309+0000 7fc601391700 1 -- 172.21.15.8:0/3066828298 learned_addr learned my addr 172.21.15.8:0/3066828298 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:14:51.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.310+0000 7fc601b92700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:51.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.310+0000 7fc601391700 1 -- 172.21.15.8:0/3066828298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc0f6530 msgr2=0x7fc5fc108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:51.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.310+0000 7fc601391700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:51.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.310+0000 7fc601391700 1 -- 172.21.15.8:0/3066828298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec005040 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.310+0000 7fc601391700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc109470 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fc5ec009f50 tx=0x7fc5ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:51.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.310+0000 7fc5f27fc700 1 -- 172.21.15.8:0/3066828298 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ec018070 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.310+0000 7fc602b94700 1 -- 172.21.15.8:0/3066828298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc10a4a0 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.310+0000 7fc5f27fc700 1 -- 172.21.15.8:0/3066828298 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc5ec009630 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.310+0000 7fc602b94700 1 -- 172.21.15.8:0/3066828298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc10aa00 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.310+0000 7fc5f27fc700 1 -- 172.21.15.8:0/3066828298 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ec01c3e0 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.311+0000 7fc602b94700 1 -- 172.21.15.8:0/3066828298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc045ad0 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.312+0000 7fc5f27fc700 1 -- 172.21.15.8:0/3066828298 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc5ec01d420 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.313+0000 7fc5f27fc700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5e8060f70 0x7fc5e8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:14:51.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.313+0000 7fc5f27fc700 1 -- 172.21.15.8:0/3066828298 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc5ec07e6a0 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.313+0000 7fc601b92700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5e8060f70 0x7fc5e8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:14:51.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.314+0000 7fc601b92700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5e8060f70 0x7fc5e8063430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fc5fc0f7630 tx=0x7fc5f8009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:14:51.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.317+0000 7fc5f27fc700 1 -- 172.21.15.8:0/3066828298 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc5ec051a50 con 0x7fc5fc0f77d0 2023-10-18T21:14:51.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.516+0000 7fc602b94700 1 -- 172.21.15.8:0/3066828298 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5fc0fee40 con 0x7fc5e8060f70 2023-10-18T21:14:51.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.518+0000 7fc5f27fc700 1 -- 172.21.15.8:0/3066828298 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc5fc0fee40 con 0x7fc5e8060f70 2023-10-18T21:14:51.520 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:14:51.520 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:14:51.520 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:14:51.520 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:14:51.521 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:14:51.521 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:14:51.521 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:14:51.521 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:14:51.521 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:14:51.522 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:14:51.522 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "15/21 daemons upgraded", 2023-10-18T21:14:51.522 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:14:51.522 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:14:51.522 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:14:51.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 -- 172.21.15.8:0/3066828298 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5e8060f70 msgr2=0x7fc5e8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:51.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5e8060f70 0x7fc5e8063430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fc5fc0f7630 tx=0x7fc5f8009c00).stop 2023-10-18T21:14:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 -- 172.21.15.8:0/3066828298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5fc0f77d0 msgr2=0x7fc5fc109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:14:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc109470 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fc5ec009f50 tx=0x7fc5ec009b30).stop 2023-10-18T21:14:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 -- 172.21.15.8:0/3066828298 shutdown_connections 2023-10-18T21:14:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5e8060f70 0x7fc5e8063430 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 --2- 172.21.15.8:0/3066828298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc109470 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:14:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 -- 172.21.15.8:0/3066828298 >> 172.21.15.8:0/3066828298 conn(0x7fc5fc0f1c90 msgr2=0x7fc5fc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:14:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 -- 172.21.15.8:0/3066828298 shutdown_connections 2023-10-18T21:14:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:14:51.520+0000 7fc602b94700 1 -- 172.21.15.8:0/3066828298 wait complete. 2023-10-18T21:14:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:50.033974+0000 mgr.smithi008.flmjzp (mgr.14640) 964 : audit [DBG] from='client.34984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:50.378081+0000 mgr.smithi008.flmjzp (mgr.14640) 965 : audit [DBG] from='client.34988 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:50.501915+0000 mgr.smithi008.flmjzp (mgr.14640) 966 : cluster [DBG] pgmap v678: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:50.790184+0000 mon.smithi008 (mon.0) 1436 : audit [DBG] from='client.? 172.21.15.8:0/413806552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:51.168639+0000 mon.smithi008 (mon.0) 1437 : audit [DBG] from='client.? 172.21.15.8:0/3123526920' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:14:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:50.033974+0000 mgr.smithi008.flmjzp (mgr.14640) 964 : audit [DBG] from='client.34984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:50.378081+0000 mgr.smithi008.flmjzp (mgr.14640) 965 : audit [DBG] from='client.34988 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:50.501915+0000 mgr.smithi008.flmjzp (mgr.14640) 966 : cluster [DBG] pgmap v678: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:50.790184+0000 mon.smithi008 (mon.0) 1436 : audit [DBG] from='client.? 172.21.15.8:0/413806552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:51.168639+0000 mon.smithi008 (mon.0) 1437 : audit [DBG] from='client.? 172.21.15.8:0/3123526920' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:14:52.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:51.519041+0000 mgr.smithi008.flmjzp (mgr.14640) 967 : audit [DBG] from='client.35000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:52.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:51.519041+0000 mgr.smithi008.flmjzp (mgr.14640) 967 : audit [DBG] from='client.35000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:14:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:52.502511+0000 mgr.smithi008.flmjzp (mgr.14640) 968 : cluster [DBG] pgmap v679: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:53.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:52.502511+0000 mgr.smithi008.flmjzp (mgr.14640) 968 : cluster [DBG] pgmap v679: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:54.503215+0000 mgr.smithi008.flmjzp (mgr.14640) 969 : cluster [DBG] pgmap v680: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:55.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:54.503215+0000 mgr.smithi008.flmjzp (mgr.14640) 969 : cluster [DBG] pgmap v680: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:56.528397+0000 mon.smithi008 (mon.0) 1438 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:56.530596+0000 mon.smithi008 (mon.0) 1439 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:56.531629+0000 mon.smithi008 (mon.0) 1440 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:56.538355+0000 mon.smithi008 (mon.0) 1441 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:56.544858+0000 mon.smithi008 (mon.0) 1442 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:56.548027+0000 mon.smithi008 (mon.0) 1443 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:56.549692+0000 mon.smithi008 (mon.0) 1444 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:56.551350+0000 mon.smithi008 (mon.0) 1445 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:14:56.553343+0000 mon.smithi008 (mon.0) 1446 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:56.528397+0000 mon.smithi008 (mon.0) 1438 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:56.530596+0000 mon.smithi008 (mon.0) 1439 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:14:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:56.531629+0000 mon.smithi008 (mon.0) 1440 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:14:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:56.538355+0000 mon.smithi008 (mon.0) 1441 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:14:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:56.544858+0000 mon.smithi008 (mon.0) 1442 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:14:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:56.548027+0000 mon.smithi008 (mon.0) 1443 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:56.549692+0000 mon.smithi008 (mon.0) 1444 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:56.551350+0000 mon.smithi008 (mon.0) 1445 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:14:56.553343+0000 mon.smithi008 (mon.0) 1446 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:14:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:56.503835+0000 mgr.smithi008.flmjzp (mgr.14640) 970 : cluster [DBG] pgmap v681: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:56.532535+0000 mgr.smithi008.flmjzp (mgr.14640) 971 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:56.533148+0000 mgr.smithi008.flmjzp (mgr.14640) 972 : cluster [DBG] pgmap v682: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:56.533459+0000 mgr.smithi008.flmjzp (mgr.14640) 973 : cluster [DBG] pgmap v683: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:14:56.555279+0000 mgr.smithi008.flmjzp (mgr.14640) 974 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:57.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:56.503835+0000 mgr.smithi008.flmjzp (mgr.14640) 970 : cluster [DBG] pgmap v681: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:56.532535+0000 mgr.smithi008.flmjzp (mgr.14640) 971 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:14:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:56.533148+0000 mgr.smithi008.flmjzp (mgr.14640) 972 : cluster [DBG] pgmap v682: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:56.533459+0000 mgr.smithi008.flmjzp (mgr.14640) 973 : cluster [DBG] pgmap v683: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:14:56.555279+0000 mgr.smithi008.flmjzp (mgr.14640) 974 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:14:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:14:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:14:58.534151+0000 mgr.smithi008.flmjzp (mgr.14640) 975 : cluster [DBG] pgmap v684: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:14:59.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:14:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:14:58.534151+0000 mgr.smithi008.flmjzp (mgr.14640) 975 : cluster [DBG] pgmap v684: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:00.534801+0000 mgr.smithi008.flmjzp (mgr.14640) 976 : cluster [DBG] pgmap v685: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:00.534801+0000 mgr.smithi008.flmjzp (mgr.14640) 976 : cluster [DBG] pgmap v685: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:02.535326+0000 mgr.smithi008.flmjzp (mgr.14640) 977 : cluster [DBG] pgmap v686: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:03.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:02.535326+0000 mgr.smithi008.flmjzp (mgr.14640) 977 : cluster [DBG] pgmap v686: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:04.535791+0000 mgr.smithi008.flmjzp (mgr.14640) 978 : cluster [DBG] pgmap v687: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:05.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:04.535791+0000 mgr.smithi008.flmjzp (mgr.14640) 978 : cluster [DBG] pgmap v687: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:06.561178+0000 mon.smithi008 (mon.0) 1447 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:06.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:06.561178+0000 mon.smithi008 (mon.0) 1447 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:06.536300+0000 mgr.smithi008.flmjzp (mgr.14640) 979 : cluster [DBG] pgmap v688: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:07.117928+0000 mon.smithi008 (mon.0) 1448 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:15:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:07.119043+0000 mon.smithi008 (mon.0) 1449 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:15:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:07.125646+0000 mon.smithi008 (mon.0) 1450 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:07.131978+0000 mon.smithi008 (mon.0) 1451 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:07.135107+0000 mon.smithi008 (mon.0) 1452 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:07.136840+0000 mon.smithi008 (mon.0) 1453 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:07.138464+0000 mon.smithi008 (mon.0) 1454 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:07.140373+0000 mon.smithi008 (mon.0) 1455 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:07.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:06.536300+0000 mgr.smithi008.flmjzp (mgr.14640) 979 : cluster [DBG] pgmap v688: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:07.117928+0000 mon.smithi008 (mon.0) 1448 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:15:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:07.119043+0000 mon.smithi008 (mon.0) 1449 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:15:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:07.125646+0000 mon.smithi008 (mon.0) 1450 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:07.131978+0000 mon.smithi008 (mon.0) 1451 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:07.135107+0000 mon.smithi008 (mon.0) 1452 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:07.136840+0000 mon.smithi008 (mon.0) 1453 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:07.138464+0000 mon.smithi008 (mon.0) 1454 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:07.140373+0000 mon.smithi008 (mon.0) 1455 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:08.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:15:07.119954+0000 mgr.smithi008.flmjzp (mgr.14640) 980 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:15:08.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:07.120641+0000 mgr.smithi008.flmjzp (mgr.14640) 981 : cluster [DBG] pgmap v689: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:08.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:07.120958+0000 mgr.smithi008.flmjzp (mgr.14640) 982 : cluster [DBG] pgmap v690: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:08.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:15:07.142333+0000 mgr.smithi008.flmjzp (mgr.14640) 983 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:15:08.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:15:07.119954+0000 mgr.smithi008.flmjzp (mgr.14640) 980 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:15:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:07.120641+0000 mgr.smithi008.flmjzp (mgr.14640) 981 : cluster [DBG] pgmap v689: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:07.120958+0000 mgr.smithi008.flmjzp (mgr.14640) 982 : cluster [DBG] pgmap v690: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:15:07.142333+0000 mgr.smithi008.flmjzp (mgr.14640) 983 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:15:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:09.121743+0000 mgr.smithi008.flmjzp (mgr.14640) 984 : cluster [DBG] pgmap v691: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:09.121743+0000 mgr.smithi008.flmjzp (mgr.14640) 984 : cluster [DBG] pgmap v691: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:12.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:11.122314+0000 mgr.smithi008.flmjzp (mgr.14640) 985 : cluster [DBG] pgmap v692: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:12.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:11.122314+0000 mgr.smithi008.flmjzp (mgr.14640) 985 : cluster [DBG] pgmap v692: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:14.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:13.122958+0000 mgr.smithi008.flmjzp (mgr.14640) 986 : cluster [DBG] pgmap v693: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:13.122958+0000 mgr.smithi008.flmjzp (mgr.14640) 986 : cluster [DBG] pgmap v693: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:15.123473+0000 mgr.smithi008.flmjzp (mgr.14640) 987 : cluster [DBG] pgmap v694: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:16.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:15.123473+0000 mgr.smithi008.flmjzp (mgr.14640) 987 : cluster [DBG] pgmap v694: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:17.153111+0000 mon.smithi008 (mon.0) 1456 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:17.153111+0000 mon.smithi008 (mon.0) 1456 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:18.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:17.124055+0000 mgr.smithi008.flmjzp (mgr.14640) 988 : cluster [DBG] pgmap v695: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:18.639 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:17.124055+0000 mgr.smithi008.flmjzp (mgr.14640) 988 : cluster [DBG] pgmap v695: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:19.124520+0000 mgr.smithi008.flmjzp (mgr.14640) 989 : cluster [DBG] pgmap v696: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:20.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:19.124520+0000 mgr.smithi008.flmjzp (mgr.14640) 989 : cluster [DBG] pgmap v696: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:21.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.680+0000 7ff92617e700 1 -- 172.21.15.8:0/1404783418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9200f77d0 msgr2=0x7ff9200f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:21.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.680+0000 7ff92617e700 1 --2- 172.21.15.8:0/1404783418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9200f77d0 0x7ff9200f7c30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7ff910004660 tx=0x7ff910009b30).stop 2023-10-18T21:15:21.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.680+0000 7ff92617e700 1 -- 172.21.15.8:0/1404783418 shutdown_connections 2023-10-18T21:15:21.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.680+0000 7ff92617e700 1 --2- 172.21.15.8:0/1404783418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9200f77d0 0x7ff9200f7c30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:21.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.680+0000 7ff92617e700 1 --2- 172.21.15.8:0/1404783418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9200f6530 0x7ff9200f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:21.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.680+0000 7ff92617e700 1 -- 172.21.15.8:0/1404783418 >> 172.21.15.8:0/1404783418 conn(0x7ff9200f1c90 msgr2=0x7ff9200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:21.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.680+0000 7ff92617e700 1 -- 172.21.15.8:0/1404783418 shutdown_connections 2023-10-18T21:15:21.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.680+0000 7ff92617e700 1 -- 172.21.15.8:0/1404783418 wait complete. 2023-10-18T21:15:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.681+0000 7ff92617e700 1 Processor -- start 2023-10-18T21:15:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.681+0000 7ff92617e700 1 -- start start 2023-10-18T21:15:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.681+0000 7ff92617e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9200f6530 0x7ff920108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.681+0000 7ff92617e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9200f77d0 0x7ff920109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.681+0000 7ff92617e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9201099c0 con 0x7ff9200f6530 2023-10-18T21:15:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.681+0000 7ff92617e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff920109b00 con 0x7ff9200f77d0 2023-10-18T21:15:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.682+0000 7ff92517c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9200f6530 0x7ff920108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.682+0000 7ff92517c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9200f6530 0x7ff920108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41368/0 (socket says 172.21.15.8:41368) 2023-10-18T21:15:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.682+0000 7ff92517c700 1 -- 172.21.15.8:0/2657548200 learned_addr learned my addr 172.21.15.8:0/2657548200 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.682+0000 7ff92497b700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9200f77d0 0x7ff920109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.682+0000 7ff92517c700 1 -- 172.21.15.8:0/2657548200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9200f77d0 msgr2=0x7ff920109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.682+0000 7ff92517c700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9200f77d0 0x7ff920109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.682+0000 7ff92517c700 1 -- 172.21.15.8:0/2657548200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910005040 con 0x7ff9200f6530 2023-10-18T21:15:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.682+0000 7ff92517c700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9200f6530 0x7ff920108f20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7ff91c00e7c0 tx=0x7ff91c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.683+0000 7ff915ffb700 1 -- 172.21.15.8:0/2657548200 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91c0092e0 con 0x7ff9200f6530 2023-10-18T21:15:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.683+0000 7ff915ffb700 1 -- 172.21.15.8:0/2657548200 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff91c00f040 con 0x7ff9200f6530 2023-10-18T21:15:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.683+0000 7ff92617e700 1 -- 172.21.15.8:0/2657548200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92010a4a0 con 0x7ff9200f6530 2023-10-18T21:15:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.683+0000 7ff915ffb700 1 -- 172.21.15.8:0/2657548200 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91c0147e0 con 0x7ff9200f6530 2023-10-18T21:15:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.683+0000 7ff92617e700 1 -- 172.21.15.8:0/2657548200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92010a9e0 con 0x7ff9200f6530 2023-10-18T21:15:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.684+0000 7ff92617e700 1 -- 172.21.15.8:0/2657548200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff920045ad0 con 0x7ff9200f6530 2023-10-18T21:15:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.685+0000 7ff915ffb700 1 -- 172.21.15.8:0/2657548200 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff91c01b030 con 0x7ff9200f6530 2023-10-18T21:15:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.686+0000 7ff915ffb700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff90c060f70 0x7ff90c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:21.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.686+0000 7ff915ffb700 1 -- 172.21.15.8:0/2657548200 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff91c07cac0 con 0x7ff9200f6530 2023-10-18T21:15:21.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.686+0000 7ff92497b700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff90c060f70 0x7ff90c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:21.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.687+0000 7ff92497b700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff90c060f70 0x7ff90c063430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ff9100043d0 tx=0x7ff91000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:21.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.691+0000 7ff915ffb700 1 -- 172.21.15.8:0/2657548200 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff91c050110 con 0x7ff9200f6530 2023-10-18T21:15:21.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.895+0000 7ff92617e700 1 -- 172.21.15.8:0/2657548200 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff92010ac00 con 0x7ff90c060f70 2023-10-18T21:15:21.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.896+0000 7ff915ffb700 1 -- 172.21.15.8:0/2657548200 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff92010ac00 con 0x7ff90c060f70 2023-10-18T21:15:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 -- 172.21.15.8:0/2657548200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff90c060f70 msgr2=0x7ff90c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff90c060f70 0x7ff90c063430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ff9100043d0 tx=0x7ff91000b040).stop 2023-10-18T21:15:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 -- 172.21.15.8:0/2657548200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9200f6530 msgr2=0x7ff920108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9200f6530 0x7ff920108f20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7ff91c00e7c0 tx=0x7ff91c00b040).stop 2023-10-18T21:15:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 -- 172.21.15.8:0/2657548200 shutdown_connections 2023-10-18T21:15:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff90c060f70 0x7ff90c063430 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9200f6530 0x7ff920108f20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 --2- 172.21.15.8:0/2657548200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9200f77d0 0x7ff920109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 -- 172.21.15.8:0/2657548200 >> 172.21.15.8:0/2657548200 conn(0x7ff9200f1c90 msgr2=0x7ff92006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 -- 172.21.15.8:0/2657548200 shutdown_connections 2023-10-18T21:15:21.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:21.899+0000 7ff92617e700 1 -- 172.21.15.8:0/2657548200 wait complete. 2023-10-18T21:15:21.915 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:15:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.037+0000 7f5ed89c7700 1 -- 172.21.15.8:0/636887232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ed40f6530 msgr2=0x7f5ed40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.037+0000 7f5ed89c7700 1 --2- 172.21.15.8:0/636887232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ed40f6530 0x7f5ed40f6950 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f5ec4004660 tx=0x7f5ec4009b30).stop 2023-10-18T21:15:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.037+0000 7f5ed89c7700 1 -- 172.21.15.8:0/636887232 shutdown_connections 2023-10-18T21:15:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.037+0000 7f5ed89c7700 1 --2- 172.21.15.8:0/636887232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40f77d0 0x7f5ed40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.037+0000 7f5ed89c7700 1 --2- 172.21.15.8:0/636887232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ed40f6530 0x7f5ed40f6950 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.037+0000 7f5ed89c7700 1 -- 172.21.15.8:0/636887232 >> 172.21.15.8:0/636887232 conn(0x7f5ed40f1c90 msgr2=0x7f5ed40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.037+0000 7f5ed89c7700 1 -- 172.21.15.8:0/636887232 shutdown_connections 2023-10-18T21:15:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.037+0000 7f5ed89c7700 1 -- 172.21.15.8:0/636887232 wait complete. 2023-10-18T21:15:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.038+0000 7f5ed89c7700 1 Processor -- start 2023-10-18T21:15:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.038+0000 7f5ed89c7700 1 -- start start 2023-10-18T21:15:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.038+0000 7f5ed89c7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ed40f6530 0x7f5ed406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.038+0000 7f5ed89c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40f77d0 0x7f5ed4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.038+0000 7f5ed89c7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed406a380 con 0x7f5ed40f6530 2023-10-18T21:15:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.038+0000 7f5ed89c7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed406a4c0 con 0x7f5ed40f77d0 2023-10-18T21:15:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.039+0000 7f5ed2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ed40f6530 0x7f5ed406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.039+0000 7f5ed2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ed40f6530 0x7f5ed406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41388/0 (socket says 172.21.15.8:41388) 2023-10-18T21:15:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.039+0000 7f5ed2d9d700 1 -- 172.21.15.8:0/3395621886 learned_addr learned my addr 172.21.15.8:0/3395621886 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.039+0000 7f5ed259c700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40f77d0 0x7f5ed4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.039+0000 7f5ed2d9d700 1 -- 172.21.15.8:0/3395621886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40f77d0 msgr2=0x7f5ed4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.039+0000 7f5ed2d9d700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40f77d0 0x7f5ed4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.039+0000 7f5ed2d9d700 1 -- 172.21.15.8:0/3395621886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4005040 con 0x7f5ed40f6530 2023-10-18T21:15:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.039+0000 7f5ed259c700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40f77d0 0x7f5ed4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:15:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.039+0000 7f5ed2d9d700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ed40f6530 0x7f5ed406b9a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f5ec4007a60 tx=0x7f5ec4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.040+0000 7f5ebb7fe700 1 -- 172.21.15.8:0/3395621886 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ec4018070 con 0x7f5ed40f6530 2023-10-18T21:15:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.040+0000 7f5ebb7fe700 1 -- 172.21.15.8:0/3395621886 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5ec4009630 con 0x7f5ed40f6530 2023-10-18T21:15:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.040+0000 7f5ed89c7700 1 -- 172.21.15.8:0/3395621886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed406a740 con 0x7f5ed40f6530 2023-10-18T21:15:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.040+0000 7f5ebb7fe700 1 -- 172.21.15.8:0/3395621886 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ec401c540 con 0x7f5ed40f6530 2023-10-18T21:15:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.040+0000 7f5ed89c7700 1 -- 172.21.15.8:0/3395621886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed406aca0 con 0x7f5ed40f6530 2023-10-18T21:15:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.041+0000 7f5ed89c7700 1 -- 172.21.15.8:0/3395621886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed4045ad0 con 0x7f5ed40f6530 2023-10-18T21:15:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.042+0000 7f5ebb7fe700 1 -- 172.21.15.8:0/3395621886 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5ec401d420 con 0x7f5ed40f6530 2023-10-18T21:15:22.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.043+0000 7f5ebb7fe700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ebc060f70 0x7f5ebc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:22.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.043+0000 7f5ebb7fe700 1 -- 172.21.15.8:0/3395621886 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5ec407e6c0 con 0x7f5ed40f6530 2023-10-18T21:15:22.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.043+0000 7f5ed259c700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ebc060f70 0x7f5ebc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:22.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.044+0000 7f5ed259c700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ebc060f70 0x7f5ebc063430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f5ec8007800 tx=0x7f5ec8009d00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:22.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.047+0000 7f5ebb7fe700 1 -- 172.21.15.8:0/3395621886 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5ec404e2f0 con 0x7f5ed40f6530 2023-10-18T21:15:22.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.248+0000 7f5ed89c7700 1 -- 172.21.15.8:0/3395621886 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ed40fee40 con 0x7f5ebc060f70 2023-10-18T21:15:22.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.250+0000 7f5ebb7fe700 1 -- 172.21.15.8:0/3395621886 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5ed40fee40 con 0x7f5ebc060f70 2023-10-18T21:15:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.251+0000 7f5ed89c7700 1 -- 172.21.15.8:0/3395621886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ebc060f70 msgr2=0x7f5ebc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.251+0000 7f5ed89c7700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ebc060f70 0x7f5ebc063430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f5ec8007800 tx=0x7f5ec8009d00).stop 2023-10-18T21:15:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.251+0000 7f5ed89c7700 1 -- 172.21.15.8:0/3395621886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ed40f6530 msgr2=0x7f5ed406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.252+0000 7f5ed89c7700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ed40f6530 0x7f5ed406b9a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f5ec4007a60 tx=0x7f5ec4009b30).stop 2023-10-18T21:15:22.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.252+0000 7f5ed89c7700 1 -- 172.21.15.8:0/3395621886 shutdown_connections 2023-10-18T21:15:22.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.252+0000 7f5ed89c7700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ebc060f70 0x7f5ebc063430 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.252+0000 7f5ed89c7700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ed40f6530 0x7f5ed406b9a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.252+0000 7f5ed89c7700 1 --2- 172.21.15.8:0/3395621886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40f77d0 0x7f5ed4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.252+0000 7f5ed89c7700 1 -- 172.21.15.8:0/3395621886 >> 172.21.15.8:0/3395621886 conn(0x7f5ed40f1c90 msgr2=0x7f5ed40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:22.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.252+0000 7f5ed89c7700 1 -- 172.21.15.8:0/3395621886 shutdown_connections 2023-10-18T21:15:22.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.252+0000 7f5ed89c7700 1 -- 172.21.15.8:0/3395621886 wait complete. 2023-10-18T21:15:22.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.389+0000 7f6f7994e700 1 -- 172.21.15.8:0/208867678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f74060310 msgr2=0x7f6f740f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.389+0000 7f6f7994e700 1 --2- 172.21.15.8:0/208867678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f74060310 0x7f6f740f9110 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f6f68004660 tx=0x7f6f68009b30).stop 2023-10-18T21:15:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.389+0000 7f6f7994e700 1 -- 172.21.15.8:0/208867678 shutdown_connections 2023-10-18T21:15:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.389+0000 7f6f7994e700 1 --2- 172.21.15.8:0/208867678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f740f9690 0x7f6f740fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.389+0000 7f6f7994e700 1 --2- 172.21.15.8:0/208867678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f74060310 0x7f6f740f9110 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.389+0000 7f6f7994e700 1 -- 172.21.15.8:0/208867678 >> 172.21.15.8:0/208867678 conn(0x7f6f740f0b90 msgr2=0x7f6f740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:22.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.389+0000 7f6f7994e700 1 -- 172.21.15.8:0/208867678 shutdown_connections 2023-10-18T21:15:22.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.389+0000 7f6f7994e700 1 -- 172.21.15.8:0/208867678 wait complete. 2023-10-18T21:15:22.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.390+0000 7f6f7994e700 1 Processor -- start 2023-10-18T21:15:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.390+0000 7f6f7994e700 1 -- start start 2023-10-18T21:15:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f7994e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f74060310 0x7f6f740f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f7994e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f740f9690 0x7f6f740f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f7994e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740f5570 con 0x7f6f74060310 2023-10-18T21:15:22.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f7994e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740f56b0 con 0x7f6f740f9690 2023-10-18T21:15:22.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f7894c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f74060310 0x7f6f740f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:22.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f7894c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f74060310 0x7f6f740f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41406/0 (socket says 172.21.15.8:41406) 2023-10-18T21:15:22.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f7894c700 1 -- 172.21.15.8:0/3427708369 learned_addr learned my addr 172.21.15.8:0/3427708369 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:22.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f73fff700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f740f9690 0x7f6f740f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f7894c700 1 -- 172.21.15.8:0/3427708369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f740f9690 msgr2=0x7f6f740f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f7894c700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f740f9690 0x7f6f740f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.391+0000 7f6f7894c700 1 -- 172.21.15.8:0/3427708369 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f68005040 con 0x7f6f74060310 2023-10-18T21:15:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.392+0000 7f6f7894c700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f74060310 0x7f6f740f6b90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f6f68004320 tx=0x7f6f6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.392+0000 7f6f717fa700 1 -- 172.21.15.8:0/3427708369 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f68019070 con 0x7f6f74060310 2023-10-18T21:15:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.392+0000 7f6f717fa700 1 -- 172.21.15.8:0/3427708369 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6f6801e420 con 0x7f6f74060310 2023-10-18T21:15:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.392+0000 7f6f7994e700 1 -- 172.21.15.8:0/3427708369 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f740f5930 con 0x7f6f74060310 2023-10-18T21:15:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.392+0000 7f6f717fa700 1 -- 172.21.15.8:0/3427708369 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f68014660 con 0x7f6f74060310 2023-10-18T21:15:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.392+0000 7f6f7994e700 1 -- 172.21.15.8:0/3427708369 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f740f5e10 con 0x7f6f74060310 2023-10-18T21:15:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.393+0000 7f6f7994e700 1 -- 172.21.15.8:0/3427708369 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f74045ad0 con 0x7f6f74060310 2023-10-18T21:15:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.394+0000 7f6f717fa700 1 -- 172.21.15.8:0/3427708369 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6f6801e590 con 0x7f6f74060310 2023-10-18T21:15:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.395+0000 7f6f717fa700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f64060f70 0x7f6f64063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.395+0000 7f6f717fa700 1 -- 172.21.15.8:0/3427708369 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6f6807e280 con 0x7f6f74060310 2023-10-18T21:15:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.396+0000 7f6f73fff700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f64060f70 0x7f6f64063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:22.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.396+0000 7f6f73fff700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f64060f70 0x7f6f64063430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f6f740600e0 tx=0x7f6f6000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:22.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.399+0000 7f6f717fa700 1 -- 172.21.15.8:0/3427708369 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6f6804de50 con 0x7f6f74060310 2023-10-18T21:15:22.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.591+0000 7f6f7994e700 1 -- 172.21.15.8:0/3427708369 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f74057f10 con 0x7f6f64060f70 2023-10-18T21:15:22.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.601+0000 7f6f717fa700 1 -- 172.21.15.8:0/3427708369 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6f74057f10 con 0x7f6f64060f70 2023-10-18T21:15:22.602 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:15:22.602 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (22m) 0s ago 23m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:15:22.603 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (15m) 0s ago 23m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:15:22.603 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (15m) 8m ago 22m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:15:22.603 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (21m) 0s ago 23m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:15:22.603 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 0s ago 19m - - 2023-10-18T21:15:22.603 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 0s ago 19m - - 2023-10-18T21:15:22.604 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (8m) 8m ago 19m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:15:22.604 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (8m) 8m ago 19m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:15:22.604 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (17m) 0s ago 24m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:15:22.604 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (16m) 8m ago 22m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:15:22.604 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (16m) 0s ago 24m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:15:22.604 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (16m) 8m ago 22m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:15:22.605 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (23m) 0s ago 23m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:15:22.605 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (22m) 8m ago 22m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:15:22.605 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (15m) 0s ago 22m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:15:22.605 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (13m) 0s ago 21m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:15:22.605 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (13m) 0s ago 21m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:15:22.605 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (12m) 8m ago 21m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:15:22.606 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (11m) 8m ago 20m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:15:22.606 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (11m) 8m ago 20m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:15:22.606 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (17m) 0s ago 22m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:15:22.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.603+0000 7f6f7994e700 1 -- 172.21.15.8:0/3427708369 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f64060f70 msgr2=0x7f6f64063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:22.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.603+0000 7f6f7994e700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f64060f70 0x7f6f64063430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f6f740600e0 tx=0x7f6f6000b040).stop 2023-10-18T21:15:22.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.603+0000 7f6f7994e700 1 -- 172.21.15.8:0/3427708369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f74060310 msgr2=0x7f6f740f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:22.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.603+0000 7f6f7994e700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f74060310 0x7f6f740f6b90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f6f68004320 tx=0x7f6f6800b040).stop 2023-10-18T21:15:22.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.603+0000 7f6f7994e700 1 -- 172.21.15.8:0/3427708369 shutdown_connections 2023-10-18T21:15:22.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.603+0000 7f6f7994e700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f64060f70 0x7f6f64063430 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.603+0000 7f6f7994e700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f74060310 0x7f6f740f6b90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.603+0000 7f6f7994e700 1 --2- 172.21.15.8:0/3427708369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f740f9690 0x7f6f740f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.603+0000 7f6f7994e700 1 -- 172.21.15.8:0/3427708369 >> 172.21.15.8:0/3427708369 conn(0x7f6f740f0b90 msgr2=0x7f6f740f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:22.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.603+0000 7f6f7994e700 1 -- 172.21.15.8:0/3427708369 shutdown_connections 2023-10-18T21:15:22.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.604+0000 7f6f7994e700 1 -- 172.21.15.8:0/3427708369 wait complete. 2023-10-18T21:15:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.741+0000 7f36eb59e700 1 -- 172.21.15.8:0/696646065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec0f6530 msgr2=0x7f36ec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.741+0000 7f36eb59e700 1 --2- 172.21.15.8:0/696646065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec0f6530 0x7f36ec0f6950 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f36dc004660 tx=0x7f36dc009b30).stop 2023-10-18T21:15:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.741+0000 7f36eb59e700 1 -- 172.21.15.8:0/696646065 shutdown_connections 2023-10-18T21:15:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.741+0000 7f36eb59e700 1 --2- 172.21.15.8:0/696646065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36ec0f77d0 0x7f36ec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.741+0000 7f36eb59e700 1 --2- 172.21.15.8:0/696646065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec0f6530 0x7f36ec0f6950 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.741+0000 7f36eb59e700 1 -- 172.21.15.8:0/696646065 >> 172.21.15.8:0/696646065 conn(0x7f36ec0f1c90 msgr2=0x7f36ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.741+0000 7f36eb59e700 1 -- 172.21.15.8:0/696646065 shutdown_connections 2023-10-18T21:15:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.741+0000 7f36eb59e700 1 -- 172.21.15.8:0/696646065 wait complete. 2023-10-18T21:15:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.742+0000 7f36eb59e700 1 Processor -- start 2023-10-18T21:15:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.742+0000 7f36eb59e700 1 -- start start 2023-10-18T21:15:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.742+0000 7f36eb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec0f6530 0x7f36ec108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.742+0000 7f36eb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36ec0f77d0 0x7f36ec109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.742+0000 7f36eb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec109a00 con 0x7f36ec0f6530 2023-10-18T21:15:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.742+0000 7f36eb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec109b40 con 0x7f36ec0f77d0 2023-10-18T21:15:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.742+0000 7f36ea59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec0f6530 0x7f36ec108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.742+0000 7f36ea59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec0f6530 0x7f36ec108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41432/0 (socket says 172.21.15.8:41432) 2023-10-18T21:15:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.742+0000 7f36ea59c700 1 -- 172.21.15.8:0/228991187 learned_addr learned my addr 172.21.15.8:0/228991187 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.743+0000 7f36e9d9b700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36ec0f77d0 0x7f36ec109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.743+0000 7f36ea59c700 1 -- 172.21.15.8:0/228991187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36ec0f77d0 msgr2=0x7f36ec109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.743+0000 7f36ea59c700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36ec0f77d0 0x7f36ec109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.743+0000 7f36ea59c700 1 -- 172.21.15.8:0/228991187 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc005040 con 0x7f36ec0f6530 2023-10-18T21:15:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.743+0000 7f36ea59c700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec0f6530 0x7f36ec108f60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f36dc009870 tx=0x7f36dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:22.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.743+0000 7f36daffd700 1 -- 172.21.15.8:0/228991187 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36dc019070 con 0x7f36ec0f6530 2023-10-18T21:15:22.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.743+0000 7f36daffd700 1 -- 172.21.15.8:0/228991187 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f36dc013380 con 0x7f36ec0f6530 2023-10-18T21:15:22.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.743+0000 7f36eb59e700 1 -- 172.21.15.8:0/228991187 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ec10a480 con 0x7f36ec0f6530 2023-10-18T21:15:22.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.743+0000 7f36daffd700 1 -- 172.21.15.8:0/228991187 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36dc01edf0 con 0x7f36ec0f6530 2023-10-18T21:15:22.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.743+0000 7f36eb59e700 1 -- 172.21.15.8:0/228991187 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec10a960 con 0x7f36ec0f6530 2023-10-18T21:15:22.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.745+0000 7f36eb59e700 1 -- 172.21.15.8:0/228991187 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec045ad0 con 0x7f36ec0f6530 2023-10-18T21:15:22.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.745+0000 7f36daffd700 1 -- 172.21.15.8:0/228991187 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f36dc01e420 con 0x7f36ec0f6530 2023-10-18T21:15:22.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.746+0000 7f36daffd700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f36d4060f70 0x7f36d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:22.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.746+0000 7f36daffd700 1 -- 172.21.15.8:0/228991187 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f36dc07ddd0 con 0x7f36ec0f6530 2023-10-18T21:15:22.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.746+0000 7f36e9d9b700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f36d4060f70 0x7f36d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:22.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.747+0000 7f36e9d9b700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f36d4060f70 0x7f36d4063430 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f36e0009fd0 tx=0x7f36e000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:22.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:22.750+0000 7f36daffd700 1 -- 172.21.15.8:0/228991187 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f36dc0513b0 con 0x7f36ec0f6530 2023-10-18T21:15:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:21.124999+0000 mgr.smithi008.flmjzp (mgr.14640) 990 : cluster [DBG] pgmap v697: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:21.704386+0000 mon.smithi008 (mon.0) 1457 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:21.705218+0000 mon.smithi008 (mon.0) 1458 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:15:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:21.706013+0000 mon.smithi008 (mon.0) 1459 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:15:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:15:21.706671+0000 mgr.smithi008.flmjzp (mgr.14640) 991 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:15:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:21.707127+0000 mgr.smithi008.flmjzp (mgr.14640) 992 : cluster [DBG] pgmap v698: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:21.707301+0000 mgr.smithi008.flmjzp (mgr.14640) 993 : cluster [DBG] pgmap v699: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:21.710756+0000 mon.smithi008 (mon.0) 1460 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:21.715749+0000 mon.smithi008 (mon.0) 1461 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:22.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:21.718211+0000 mon.smithi008 (mon.0) 1462 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:22.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:21.719617+0000 mon.smithi008 (mon.0) 1463 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:22.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:21.720903+0000 mon.smithi008 (mon.0) 1464 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:22.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:21.722439+0000 mon.smithi008 (mon.0) 1465 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:22.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:15:21.724029+0000 mgr.smithi008.flmjzp (mgr.14640) 994 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:15:23.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.000+0000 7f36eb59e700 1 -- 172.21.15.8:0/228991187 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f36ec0fc120 con 0x7f36ec0f6530 2023-10-18T21:15:23.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.001+0000 7f36daffd700 1 -- 172.21.15.8:0/228991187 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f36dc004490 con 0x7f36ec0f6530 2023-10-18T21:15:23.002 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:15:23.002 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:15:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:15:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:15:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:15:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:15:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:15:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:15:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:15:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:15:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:15:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:15:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:15:23.005 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:15:23.005 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:15:23.005 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:15:23.005 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:15:23.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 -- 172.21.15.8:0/228991187 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f36d4060f70 msgr2=0x7f36d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:23.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f36d4060f70 0x7f36d4063430 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f36e0009fd0 tx=0x7f36e000b040).stop 2023-10-18T21:15:23.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 -- 172.21.15.8:0/228991187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec0f6530 msgr2=0x7f36ec108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec0f6530 0x7f36ec108f60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f36dc009870 tx=0x7f36dc00b040).stop 2023-10-18T21:15:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 -- 172.21.15.8:0/228991187 shutdown_connections 2023-10-18T21:15:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f36d4060f70 0x7f36d4063430 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec0f6530 0x7f36ec108f60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 --2- 172.21.15.8:0/228991187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36ec0f77d0 0x7f36ec109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 -- 172.21.15.8:0/228991187 >> 172.21.15.8:0/228991187 conn(0x7f36ec0f1c90 msgr2=0x7f36ec06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:23.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 -- 172.21.15.8:0/228991187 shutdown_connections 2023-10-18T21:15:23.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.003+0000 7f36eb59e700 1 -- 172.21.15.8:0/228991187 wait complete. 2023-10-18T21:15:23.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.139+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/3121577074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f380f77d0 msgr2=0x7f9f380f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:23.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.139+0000 7f9f3d0dc700 1 --2- 172.21.15.8:0/3121577074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f380f77d0 0x7f9f380f7c30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f9f2c004660 tx=0x7f9f2c009b30).stop 2023-10-18T21:15:23.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.140+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/3121577074 shutdown_connections 2023-10-18T21:15:23.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.140+0000 7f9f3d0dc700 1 --2- 172.21.15.8:0/3121577074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f380f77d0 0x7f9f380f7c30 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.140+0000 7f9f3d0dc700 1 --2- 172.21.15.8:0/3121577074 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f380f6530 0x7f9f380f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.140+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/3121577074 >> 172.21.15.8:0/3121577074 conn(0x7f9f380f1c90 msgr2=0x7f9f380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:23.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.140+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/3121577074 shutdown_connections 2023-10-18T21:15:23.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.140+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/3121577074 wait complete. 2023-10-18T21:15:23.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.140+0000 7f9f3d0dc700 1 Processor -- start 2023-10-18T21:15:23.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.141+0000 7f9f3d0dc700 1 -- start start 2023-10-18T21:15:23.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.141+0000 7f9f3d0dc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f380f6530 0x7f9f38108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:23.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.141+0000 7f9f3d0dc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f380f77d0 0x7f9f38109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:23.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.141+0000 7f9f3d0dc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38109a20 con 0x7f9f380f77d0 2023-10-18T21:15:23.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.141+0000 7f9f3d0dc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38109b60 con 0x7f9f380f6530 2023-10-18T21:15:23.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.141+0000 7f9f377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f380f77d0 0x7f9f38109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:23.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.141+0000 7f9f377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f380f77d0 0x7f9f38109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41456/0 (socket says 172.21.15.8:41456) 2023-10-18T21:15:23.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.141+0000 7f9f377fe700 1 -- 172.21.15.8:0/1547739287 learned_addr learned my addr 172.21.15.8:0/1547739287 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:23.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.141+0000 7f9f37fff700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f380f6530 0x7f9f38108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:23.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.142+0000 7f9f377fe700 1 -- 172.21.15.8:0/1547739287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f380f6530 msgr2=0x7f9f38108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.142+0000 7f9f377fe700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f380f6530 0x7f9f38108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.142+0000 7f9f377fe700 1 -- 172.21.15.8:0/1547739287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c005040 con 0x7f9f380f77d0 2023-10-18T21:15:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.142+0000 7f9f37fff700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f380f6530 0x7f9f38108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:15:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.142+0000 7f9f377fe700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f380f77d0 0x7f9f38109470 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f9f2c009990 tx=0x7f9f2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.142+0000 7f9f34ff9700 1 -- 172.21.15.8:0/1547739287 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f2c018070 con 0x7f9f380f77d0 2023-10-18T21:15:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.142+0000 7f9f34ff9700 1 -- 172.21.15.8:0/1547739287 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9f2c009780 con 0x7f9f380f77d0 2023-10-18T21:15:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.142+0000 7f9f34ff9700 1 -- 172.21.15.8:0/1547739287 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f2c01c5e0 con 0x7f9f380f77d0 2023-10-18T21:15:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.142+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/1547739287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3810a4a0 con 0x7f9f380f77d0 2023-10-18T21:15:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.142+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/1547739287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3810aa00 con 0x7f9f380f77d0 2023-10-18T21:15:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.144+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/1547739287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f38045ad0 con 0x7f9f380f77d0 2023-10-18T21:15:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.145+0000 7f9f34ff9700 1 -- 172.21.15.8:0/1547739287 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9f2c01dac0 con 0x7f9f380f77d0 2023-10-18T21:15:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.145+0000 7f9f34ff9700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f20060f70 0x7f9f20063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.145+0000 7f9f34ff9700 1 -- 172.21.15.8:0/1547739287 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9f2c07e680 con 0x7f9f380f77d0 2023-10-18T21:15:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.146+0000 7f9f37fff700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f20060f70 0x7f9f20063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.146+0000 7f9f37fff700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f20060f70 0x7f9f20063430 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f9f380f7630 tx=0x7f9f28009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.149+0000 7f9f34ff9700 1 -- 172.21.15.8:0/1547739287 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9f2c051da0 con 0x7f9f380f77d0 2023-10-18T21:15:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:21.124999+0000 mgr.smithi008.flmjzp (mgr.14640) 990 : cluster [DBG] pgmap v697: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:21.704386+0000 mon.smithi008 (mon.0) 1457 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:21.705218+0000 mon.smithi008 (mon.0) 1458 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:15:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:21.706013+0000 mon.smithi008 (mon.0) 1459 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:15:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:15:21.706671+0000 mgr.smithi008.flmjzp (mgr.14640) 991 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:15:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:21.707127+0000 mgr.smithi008.flmjzp (mgr.14640) 992 : cluster [DBG] pgmap v698: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:21.707301+0000 mgr.smithi008.flmjzp (mgr.14640) 993 : cluster [DBG] pgmap v699: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:21.710756+0000 mon.smithi008 (mon.0) 1460 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:21.715749+0000 mon.smithi008 (mon.0) 1461 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:23.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:21.718211+0000 mon.smithi008 (mon.0) 1462 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:23.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:21.719617+0000 mon.smithi008 (mon.0) 1463 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:23.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:21.720903+0000 mon.smithi008 (mon.0) 1464 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:23.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:21.722439+0000 mon.smithi008 (mon.0) 1465 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:23.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:15:21.724029+0000 mgr.smithi008.flmjzp (mgr.14640) 994 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:15:23.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.374+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/1547739287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9f380fed60 con 0x7f9f380f77d0 2023-10-18T21:15:23.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.374+0000 7f9f34ff9700 1 -- 172.21.15.8:0/1547739287 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f9f2c051990 con 0x7f9f380f77d0 2023-10-18T21:15:23.376 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:15:23.376 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:15:23.376 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:15:23.376 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:15:23.376 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:15:23.377 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:15:23.377 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:15:23.377 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:15:23.377 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:15:23.377 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:15:23.378 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:15:23.378 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:15:23.378 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:15:23.378 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:15:23.378 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:15:23.378 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:15:23.379 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:15:23.379 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:15:23.379 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:15:23.379 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:15:23.379 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:15:23.380 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:15:23.380 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:15:23.380 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:15:23.380 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:15:23.380 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:15:23.381 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:15:23.381 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:15:23.381 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:15:23.381 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:15:23.381 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:15:23.382 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:15:23.382 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:15:23.382 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:15:23.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.376+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/1547739287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f20060f70 msgr2=0x7f9f20063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:23.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.376+0000 7f9f3d0dc700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f20060f70 0x7f9f20063430 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f9f380f7630 tx=0x7f9f28009040).stop 2023-10-18T21:15:23.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.376+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/1547739287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f380f77d0 msgr2=0x7f9f38109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:23.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.376+0000 7f9f3d0dc700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f380f77d0 0x7f9f38109470 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f9f2c009990 tx=0x7f9f2c009b30).stop 2023-10-18T21:15:23.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.376+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/1547739287 shutdown_connections 2023-10-18T21:15:23.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.376+0000 7f9f3d0dc700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9f20060f70 0x7f9f20063430 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.376+0000 7f9f3d0dc700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f380f6530 0x7f9f38108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.376+0000 7f9f3d0dc700 1 --2- 172.21.15.8:0/1547739287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f380f77d0 0x7f9f38109470 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.376+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/1547739287 >> 172.21.15.8:0/1547739287 conn(0x7f9f380f1c90 msgr2=0x7f9f3806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:23.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.376+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/1547739287 shutdown_connections 2023-10-18T21:15:23.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.377+0000 7f9f3d0dc700 1 -- 172.21.15.8:0/1547739287 wait complete. 2023-10-18T21:15:23.386 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:15:23.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.515+0000 7feaa0e69700 1 -- 172.21.15.8:0/3262172271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea9c0f77d0 msgr2=0x7fea9c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:23.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.515+0000 7feaa0e69700 1 --2- 172.21.15.8:0/3262172271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea9c0f77d0 0x7fea9c0f7c30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fea90004660 tx=0x7fea90009b30).stop 2023-10-18T21:15:23.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.515+0000 7feaa0e69700 1 -- 172.21.15.8:0/3262172271 shutdown_connections 2023-10-18T21:15:23.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.516+0000 7feaa0e69700 1 --2- 172.21.15.8:0/3262172271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea9c0f77d0 0x7fea9c0f7c30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.516+0000 7feaa0e69700 1 --2- 172.21.15.8:0/3262172271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea9c0f6530 0x7fea9c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.516+0000 7feaa0e69700 1 -- 172.21.15.8:0/3262172271 >> 172.21.15.8:0/3262172271 conn(0x7fea9c0f1c70 msgr2=0x7fea9c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:23.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.516+0000 7feaa0e69700 1 -- 172.21.15.8:0/3262172271 shutdown_connections 2023-10-18T21:15:23.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.516+0000 7feaa0e69700 1 -- 172.21.15.8:0/3262172271 wait complete. 2023-10-18T21:15:23.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.516+0000 7feaa0e69700 1 Processor -- start 2023-10-18T21:15:23.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.517+0000 7feaa0e69700 1 -- start start 2023-10-18T21:15:23.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.517+0000 7feaa0e69700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea9c0f6530 0x7fea9c108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:23.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.517+0000 7feaa0e69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea9c0f77d0 0x7fea9c109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:23.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.517+0000 7feaa0e69700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1099f0 con 0x7fea9c0f77d0 2023-10-18T21:15:23.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.517+0000 7feaa0e69700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c109b30 con 0x7fea9c0f6530 2023-10-18T21:15:23.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.517+0000 7fea9affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea9c0f77d0 0x7fea9c109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:23.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.517+0000 7fea9affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea9c0f77d0 0x7fea9c109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41470/0 (socket says 172.21.15.8:41470) 2023-10-18T21:15:23.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.517+0000 7fea9affd700 1 -- 172.21.15.8:0/2805008223 learned_addr learned my addr 172.21.15.8:0/2805008223 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:23.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.517+0000 7fea9b7fe700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea9c0f6530 0x7fea9c108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:23.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.518+0000 7fea9affd700 1 -- 172.21.15.8:0/2805008223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea9c0f6530 msgr2=0x7fea9c108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:23.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.518+0000 7fea9affd700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea9c0f6530 0x7fea9c108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.518+0000 7fea9affd700 1 -- 172.21.15.8:0/2805008223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90005040 con 0x7fea9c0f77d0 2023-10-18T21:15:23.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.518+0000 7fea9affd700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea9c0f77d0 0x7fea9c109440 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fea90009f50 tx=0x7fea90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:23.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.518+0000 7fea83fff700 1 -- 172.21.15.8:0/2805008223 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea90018070 con 0x7fea9c0f77d0 2023-10-18T21:15:23.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.518+0000 7fea83fff700 1 -- 172.21.15.8:0/2805008223 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fea90009630 con 0x7fea9c0f77d0 2023-10-18T21:15:23.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.518+0000 7fea83fff700 1 -- 172.21.15.8:0/2805008223 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9001c3c0 con 0x7fea9c0f77d0 2023-10-18T21:15:23.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.518+0000 7feaa0e69700 1 -- 172.21.15.8:0/2805008223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c10a470 con 0x7fea9c0f77d0 2023-10-18T21:15:23.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.518+0000 7feaa0e69700 1 -- 172.21.15.8:0/2805008223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c10a9d0 con 0x7fea9c0f77d0 2023-10-18T21:15:23.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.519+0000 7feaa0e69700 1 -- 172.21.15.8:0/2805008223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c045ad0 con 0x7fea9c0f77d0 2023-10-18T21:15:23.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.520+0000 7fea83fff700 1 -- 172.21.15.8:0/2805008223 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fea9001d420 con 0x7fea9c0f77d0 2023-10-18T21:15:23.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.521+0000 7fea83fff700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea84060f70 0x7fea84063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:23.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.521+0000 7fea83fff700 1 -- 172.21.15.8:0/2805008223 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fea9007e600 con 0x7fea9c0f77d0 2023-10-18T21:15:23.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.521+0000 7fea9b7fe700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea84060f70 0x7fea84063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:23.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.522+0000 7fea9b7fe700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea84060f70 0x7fea84063430 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fea9c0f7630 tx=0x7fea8c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:23.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.525+0000 7fea83fff700 1 -- 172.21.15.8:0/2805008223 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fea90051be0 con 0x7fea9c0f77d0 2023-10-18T21:15:23.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.726+0000 7feaa0e69700 1 -- 172.21.15.8:0/2805008223 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea9c0fee30 con 0x7fea84060f70 2023-10-18T21:15:23.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.727+0000 7fea83fff700 1 -- 172.21.15.8:0/2805008223 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fea9c0fee30 con 0x7fea84060f70 2023-10-18T21:15:23.729 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:15:23.729 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:15:23.729 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:15:23.729 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:15:23.729 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:15:23.730 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:15:23.730 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:15:23.730 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:15:23.730 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:15:23.730 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:15:23.731 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "14/21 daemons upgraded", 2023-10-18T21:15:23.731 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:15:23.731 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:15:23.731 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:15:23.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.729+0000 7feaa0e69700 1 -- 172.21.15.8:0/2805008223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea84060f70 msgr2=0x7fea84063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:23.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.729+0000 7feaa0e69700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea84060f70 0x7fea84063430 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fea9c0f7630 tx=0x7fea8c00b040).stop 2023-10-18T21:15:23.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.729+0000 7feaa0e69700 1 -- 172.21.15.8:0/2805008223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea9c0f77d0 msgr2=0x7fea9c109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.729+0000 7feaa0e69700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea9c0f77d0 0x7fea9c109440 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fea90009f50 tx=0x7fea90009b30).stop 2023-10-18T21:15:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.729+0000 7feaa0e69700 1 -- 172.21.15.8:0/2805008223 shutdown_connections 2023-10-18T21:15:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.729+0000 7feaa0e69700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea84060f70 0x7fea84063430 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.729+0000 7feaa0e69700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea9c0f6530 0x7fea9c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.729+0000 7feaa0e69700 1 --2- 172.21.15.8:0/2805008223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea9c0f77d0 0x7fea9c109440 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:23.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.729+0000 7feaa0e69700 1 -- 172.21.15.8:0/2805008223 >> 172.21.15.8:0/2805008223 conn(0x7fea9c0f1c70 msgr2=0x7fea9c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:23.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.730+0000 7feaa0e69700 1 -- 172.21.15.8:0/2805008223 shutdown_connections 2023-10-18T21:15:23.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:23.730+0000 7feaa0e69700 1 -- 172.21.15.8:0/2805008223 wait complete. 2023-10-18T21:15:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:21.896857+0000 mgr.smithi008.flmjzp (mgr.14640) 995 : audit [DBG] from='client.35004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:22.249996+0000 mgr.smithi008.flmjzp (mgr.14640) 996 : audit [DBG] from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:22.592976+0000 mgr.smithi008.flmjzp (mgr.14640) 997 : audit [DBG] from='client.35012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:22.702568+0000 mon.smithi008 (mon.0) 1466 : cluster [WRN] Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-10-18T21:15:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:23.001624+0000 mon.smithi008 (mon.0) 1467 : audit [DBG] from='client.? 172.21.15.8:0/228991187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:23.374923+0000 mon.smithi008 (mon.0) 1468 : audit [DBG] from='client.? 172.21.15.8:0/1547739287' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:15:23.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:21.896857+0000 mgr.smithi008.flmjzp (mgr.14640) 995 : audit [DBG] from='client.35004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:22.249996+0000 mgr.smithi008.flmjzp (mgr.14640) 996 : audit [DBG] from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:22.592976+0000 mgr.smithi008.flmjzp (mgr.14640) 997 : audit [DBG] from='client.35012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:22.702568+0000 mon.smithi008 (mon.0) 1466 : cluster [WRN] Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-10-18T21:15:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:23.001624+0000 mon.smithi008 (mon.0) 1467 : audit [DBG] from='client.? 172.21.15.8:0/228991187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:23.374923+0000 mon.smithi008 (mon.0) 1468 : audit [DBG] from='client.? 172.21.15.8:0/1547739287' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:15:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:23.707685+0000 mgr.smithi008.flmjzp (mgr.14640) 998 : cluster [DBG] pgmap v700: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:23.727777+0000 mgr.smithi008.flmjzp (mgr.14640) 999 : audit [DBG] from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:25.126 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:23.707685+0000 mgr.smithi008.flmjzp (mgr.14640) 998 : cluster [DBG] pgmap v700: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:25.127 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:23.727777+0000 mgr.smithi008.flmjzp (mgr.14640) 999 : audit [DBG] from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:25.708226+0000 mgr.smithi008.flmjzp (mgr.14640) 1000 : cluster [DBG] pgmap v701: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:26.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:25.708226+0000 mgr.smithi008.flmjzp (mgr.14640) 1000 : cluster [DBG] pgmap v701: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:27.708777+0000 mgr.smithi008.flmjzp (mgr.14640) 1001 : cluster [DBG] pgmap v702: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:27.708777+0000 mgr.smithi008.flmjzp (mgr.14640) 1001 : cluster [DBG] pgmap v702: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:29.709331+0000 mgr.smithi008.flmjzp (mgr.14640) 1002 : cluster [DBG] pgmap v703: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:30.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:29.709331+0000 mgr.smithi008.flmjzp (mgr.14640) 1002 : cluster [DBG] pgmap v703: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:31.709883+0000 mgr.smithi008.flmjzp (mgr.14640) 1003 : cluster [DBG] pgmap v704: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:31.730981+0000 mon.smithi008 (mon.0) 1469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:31.733100+0000 mon.smithi008 (mon.0) 1470 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:15:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:31.734072+0000 mon.smithi008 (mon.0) 1471 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:15:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:15:31.734936+0000 mgr.smithi008.flmjzp (mgr.14640) 1004 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:15:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:31.735559+0000 mgr.smithi008.flmjzp (mgr.14640) 1005 : cluster [DBG] pgmap v705: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:31.735889+0000 mgr.smithi008.flmjzp (mgr.14640) 1006 : cluster [DBG] pgmap v706: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:31.740714+0000 mon.smithi008 (mon.0) 1472 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:31.747162+0000 mon.smithi008 (mon.0) 1473 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:31.750222+0000 mon.smithi008 (mon.0) 1474 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:31.751924+0000 mon.smithi008 (mon.0) 1475 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:31.753507+0000 mon.smithi008 (mon.0) 1476 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:31.755489+0000 mon.smithi008 (mon.0) 1477 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:32.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:31.709883+0000 mgr.smithi008.flmjzp (mgr.14640) 1003 : cluster [DBG] pgmap v704: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:31.730981+0000 mon.smithi008 (mon.0) 1469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:31.733100+0000 mon.smithi008 (mon.0) 1470 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:15:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:31.734072+0000 mon.smithi008 (mon.0) 1471 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:15:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:15:31.734936+0000 mgr.smithi008.flmjzp (mgr.14640) 1004 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:15:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:31.735559+0000 mgr.smithi008.flmjzp (mgr.14640) 1005 : cluster [DBG] pgmap v705: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:31.735889+0000 mgr.smithi008.flmjzp (mgr.14640) 1006 : cluster [DBG] pgmap v706: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:31.740714+0000 mon.smithi008 (mon.0) 1472 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:31.747162+0000 mon.smithi008 (mon.0) 1473 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:31.750222+0000 mon.smithi008 (mon.0) 1474 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:32.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:31.751924+0000 mon.smithi008 (mon.0) 1475 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:32.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:31.753507+0000 mon.smithi008 (mon.0) 1476 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:32.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:31.755489+0000 mon.smithi008 (mon.0) 1477 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:15:31.757640+0000 mgr.smithi008.flmjzp (mgr.14640) 1007 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:15:33.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:15:31.757640+0000 mgr.smithi008.flmjzp (mgr.14640) 1007 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:15:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:33.736574+0000 mgr.smithi008.flmjzp (mgr.14640) 1008 : cluster [DBG] pgmap v707: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:34.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:33.736574+0000 mgr.smithi008.flmjzp (mgr.14640) 1008 : cluster [DBG] pgmap v707: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:35.737122+0000 mgr.smithi008.flmjzp (mgr.14640) 1009 : cluster [DBG] pgmap v708: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:36.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:35.737122+0000 mgr.smithi008.flmjzp (mgr.14640) 1009 : cluster [DBG] pgmap v708: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:37.737826+0000 mgr.smithi008.flmjzp (mgr.14640) 1010 : cluster [DBG] pgmap v709: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:38.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:37.737826+0000 mgr.smithi008.flmjzp (mgr.14640) 1010 : cluster [DBG] pgmap v709: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:40.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:39.738336+0000 mgr.smithi008.flmjzp (mgr.14640) 1011 : cluster [DBG] pgmap v710: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:40.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:39.738336+0000 mgr.smithi008.flmjzp (mgr.14640) 1011 : cluster [DBG] pgmap v710: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:41.738971+0000 mgr.smithi008.flmjzp (mgr.14640) 1012 : cluster [DBG] pgmap v711: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:41.768283+0000 mon.smithi008 (mon.0) 1478 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:41.770439+0000 mon.smithi008 (mon.0) 1479 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:15:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:41.771406+0000 mon.smithi008 (mon.0) 1480 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:15:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:41.778027+0000 mon.smithi008 (mon.0) 1481 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:41.784589+0000 mon.smithi008 (mon.0) 1482 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:41.787648+0000 mon.smithi008 (mon.0) 1483 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:41.789309+0000 mon.smithi008 (mon.0) 1484 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:42.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:41.793440+0000 mon.smithi008 (mon.0) 1485 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:42.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:41.795540+0000 mon.smithi008 (mon.0) 1486 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:42.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:41.738971+0000 mgr.smithi008.flmjzp (mgr.14640) 1012 : cluster [DBG] pgmap v711: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:41.768283+0000 mon.smithi008 (mon.0) 1478 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:41.770439+0000 mon.smithi008 (mon.0) 1479 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:15:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:41.771406+0000 mon.smithi008 (mon.0) 1480 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:15:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:41.778027+0000 mon.smithi008 (mon.0) 1481 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:41.784589+0000 mon.smithi008 (mon.0) 1482 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:41.787648+0000 mon.smithi008 (mon.0) 1483 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:41.789309+0000 mon.smithi008 (mon.0) 1484 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:41.793440+0000 mon.smithi008 (mon.0) 1485 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:41.795540+0000 mon.smithi008 (mon.0) 1486 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:15:41.772289+0000 mgr.smithi008.flmjzp (mgr.14640) 1013 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:15:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:41.772877+0000 mgr.smithi008.flmjzp (mgr.14640) 1014 : cluster [DBG] pgmap v712: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:41.773185+0000 mgr.smithi008.flmjzp (mgr.14640) 1015 : cluster [DBG] pgmap v713: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:15:41.797650+0000 mgr.smithi008.flmjzp (mgr.14640) 1016 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:15:43.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:15:41.772289+0000 mgr.smithi008.flmjzp (mgr.14640) 1013 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:15:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:41.772877+0000 mgr.smithi008.flmjzp (mgr.14640) 1014 : cluster [DBG] pgmap v712: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:41.773185+0000 mgr.smithi008.flmjzp (mgr.14640) 1015 : cluster [DBG] pgmap v713: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:15:41.797650+0000 mgr.smithi008.flmjzp (mgr.14640) 1016 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:15:45.128 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:43.773775+0000 mgr.smithi008.flmjzp (mgr.14640) 1017 : cluster [DBG] pgmap v714: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:45.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:43.773775+0000 mgr.smithi008.flmjzp (mgr.14640) 1017 : cluster [DBG] pgmap v714: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:45.774258+0000 mgr.smithi008.flmjzp (mgr.14640) 1018 : cluster [DBG] pgmap v715: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:47.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:45.774258+0000 mgr.smithi008.flmjzp (mgr.14640) 1018 : cluster [DBG] pgmap v715: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:47.774810+0000 mgr.smithi008.flmjzp (mgr.14640) 1019 : cluster [DBG] pgmap v716: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:49.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:47.774810+0000 mgr.smithi008.flmjzp (mgr.14640) 1019 : cluster [DBG] pgmap v716: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:49.775363+0000 mgr.smithi008.flmjzp (mgr.14640) 1020 : cluster [DBG] pgmap v717: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:49.775363+0000 mgr.smithi008.flmjzp (mgr.14640) 1020 : cluster [DBG] pgmap v717: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:52.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:51.808443+0000 mon.smithi008 (mon.0) 1487 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:52.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:51.808443+0000 mon.smithi008 (mon.0) 1487 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:51.776022+0000 mgr.smithi008.flmjzp (mgr.14640) 1021 : cluster [DBG] pgmap v718: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:52.369669+0000 mon.smithi008 (mon.0) 1488 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:15:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:52.370567+0000 mon.smithi008 (mon.0) 1489 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:15:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:15:52.371314+0000 mgr.smithi008.flmjzp (mgr.14640) 1022 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:15:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:52.371907+0000 mgr.smithi008.flmjzp (mgr.14640) 1023 : cluster [DBG] pgmap v719: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:52.372127+0000 mgr.smithi008.flmjzp (mgr.14640) 1024 : cluster [DBG] pgmap v720: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:52.376123+0000 mon.smithi008 (mon.0) 1490 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:52.380985+0000 mon.smithi008 (mon.0) 1491 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:52.383285+0000 mon.smithi008 (mon.0) 1492 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:52.384486+0000 mon.smithi008 (mon.0) 1493 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:52.385926+0000 mon.smithi008 (mon.0) 1494 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:52.387936+0000 mon.smithi008 (mon.0) 1495 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:15:52.389750+0000 mgr.smithi008.flmjzp (mgr.14640) 1025 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:15:53.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:51.776022+0000 mgr.smithi008.flmjzp (mgr.14640) 1021 : cluster [DBG] pgmap v718: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:53.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:52.369669+0000 mon.smithi008 (mon.0) 1488 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:15:53.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:52.370567+0000 mon.smithi008 (mon.0) 1489 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:15:53.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:15:52.371314+0000 mgr.smithi008.flmjzp (mgr.14640) 1022 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:15:53.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:52.371907+0000 mgr.smithi008.flmjzp (mgr.14640) 1023 : cluster [DBG] pgmap v719: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:53.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:52.372127+0000 mgr.smithi008.flmjzp (mgr.14640) 1024 : cluster [DBG] pgmap v720: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:53.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:52.376123+0000 mon.smithi008 (mon.0) 1490 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:15:53.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:52.380985+0000 mon.smithi008 (mon.0) 1491 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:15:53.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:52.383285+0000 mon.smithi008 (mon.0) 1492 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:53.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:52.384486+0000 mon.smithi008 (mon.0) 1493 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:53.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:52.385926+0000 mon.smithi008 (mon.0) 1494 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:53.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:52.387936+0000 mon.smithi008 (mon.0) 1495 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:53.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:15:52.389750+0000 mgr.smithi008.flmjzp (mgr.14640) 1025 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:15:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.883+0000 7f6a5105b700 1 -- 172.21.15.8:0/71605493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4c0f77d0 msgr2=0x7f6a4c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.883+0000 7f6a5105b700 1 --2- 172.21.15.8:0/71605493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4c0f77d0 0x7f6a4c0f7c30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f6a40004660 tx=0x7f6a40009b30).stop 2023-10-18T21:15:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.883+0000 7f6a5105b700 1 -- 172.21.15.8:0/71605493 shutdown_connections 2023-10-18T21:15:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.883+0000 7f6a5105b700 1 --2- 172.21.15.8:0/71605493 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4c0f77d0 0x7f6a4c0f7c30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.883+0000 7f6a5105b700 1 --2- 172.21.15.8:0/71605493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c0f6530 0x7f6a4c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.883+0000 7f6a5105b700 1 -- 172.21.15.8:0/71605493 >> 172.21.15.8:0/71605493 conn(0x7f6a4c0f1c90 msgr2=0x7f6a4c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.883+0000 7f6a5105b700 1 -- 172.21.15.8:0/71605493 shutdown_connections 2023-10-18T21:15:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.883+0000 7f6a5105b700 1 -- 172.21.15.8:0/71605493 wait complete. 2023-10-18T21:15:53.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.884+0000 7f6a5105b700 1 Processor -- start 2023-10-18T21:15:53.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.885+0000 7f6a5105b700 1 -- start start 2023-10-18T21:15:53.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.885+0000 7f6a5105b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c0f6530 0x7f6a4c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:53.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.885+0000 7f6a5105b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4c0f77d0 0x7f6a4c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:53.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.885+0000 7f6a5105b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c06a380 con 0x7f6a4c0f77d0 2023-10-18T21:15:53.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.885+0000 7f6a5105b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c06a4c0 con 0x7f6a4c0f6530 2023-10-18T21:15:53.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.885+0000 7f6a4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4c0f77d0 0x7f6a4c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:53.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.885+0000 7f6a4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4c0f77d0 0x7f6a4c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52816/0 (socket says 172.21.15.8:52816) 2023-10-18T21:15:53.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.885+0000 7f6a4b7fe700 1 -- 172.21.15.8:0/4058721462 learned_addr learned my addr 172.21.15.8:0/4058721462 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:53.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.886+0000 7f6a4bfff700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c0f6530 0x7f6a4c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:53.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.886+0000 7f6a4b7fe700 1 -- 172.21.15.8:0/4058721462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c0f6530 msgr2=0x7f6a4c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:53.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.886+0000 7f6a4b7fe700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c0f6530 0x7f6a4c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:53.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.886+0000 7f6a4b7fe700 1 -- 172.21.15.8:0/4058721462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a40005040 con 0x7f6a4c0f77d0 2023-10-18T21:15:53.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.886+0000 7f6a4b7fe700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4c0f77d0 0x7f6a4c069e20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f6a40004320 tx=0x7f6a4000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:53.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.886+0000 7f6a48ff9700 1 -- 172.21.15.8:0/4058721462 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a40019070 con 0x7f6a4c0f77d0 2023-10-18T21:15:53.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.886+0000 7f6a48ff9700 1 -- 172.21.15.8:0/4058721462 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6a4001e420 con 0x7f6a4c0f77d0 2023-10-18T21:15:53.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.886+0000 7f6a5105b700 1 -- 172.21.15.8:0/4058721462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c06a740 con 0x7f6a4c0f77d0 2023-10-18T21:15:53.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.887+0000 7f6a48ff9700 1 -- 172.21.15.8:0/4058721462 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a40014680 con 0x7f6a4c0f77d0 2023-10-18T21:15:53.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.887+0000 7f6a5105b700 1 -- 172.21.15.8:0/4058721462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c06ac20 con 0x7f6a4c0f77d0 2023-10-18T21:15:53.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.888+0000 7f6a5105b700 1 -- 172.21.15.8:0/4058721462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c045ad0 con 0x7f6a4c0f77d0 2023-10-18T21:15:53.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.889+0000 7f6a48ff9700 1 -- 172.21.15.8:0/4058721462 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6a4001e590 con 0x7f6a4c0f77d0 2023-10-18T21:15:53.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.889+0000 7f6a48ff9700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a34060f70 0x7f6a34063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:53.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.890+0000 7f6a48ff9700 1 -- 172.21.15.8:0/4058721462 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6a4007ddd0 con 0x7f6a4c0f77d0 2023-10-18T21:15:53.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.890+0000 7f6a4bfff700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a34060f70 0x7f6a34063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:53.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.890+0000 7f6a4bfff700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a34060f70 0x7f6a34063430 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f6a4c06b730 tx=0x7f6a3c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:53.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:53.894+0000 7f6a48ff9700 1 -- 172.21.15.8:0/4058721462 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6a4004d920 con 0x7f6a4c0f77d0 2023-10-18T21:15:54.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.092+0000 7f6a5105b700 1 -- 172.21.15.8:0/4058721462 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a4c0fed30 con 0x7f6a34060f70 2023-10-18T21:15:54.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.094+0000 7f6a48ff9700 1 -- 172.21.15.8:0/4058721462 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6a4c0fed30 con 0x7f6a34060f70 2023-10-18T21:15:54.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 -- 172.21.15.8:0/4058721462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a34060f70 msgr2=0x7f6a34063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a34060f70 0x7f6a34063430 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f6a4c06b730 tx=0x7f6a3c00b040).stop 2023-10-18T21:15:54.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 -- 172.21.15.8:0/4058721462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4c0f77d0 msgr2=0x7f6a4c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4c0f77d0 0x7f6a4c069e20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f6a40004320 tx=0x7f6a4000b040).stop 2023-10-18T21:15:54.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 -- 172.21.15.8:0/4058721462 shutdown_connections 2023-10-18T21:15:54.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a34060f70 0x7f6a34063430 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c0f6530 0x7f6a4c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 --2- 172.21.15.8:0/4058721462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4c0f77d0 0x7f6a4c069e20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 -- 172.21.15.8:0/4058721462 >> 172.21.15.8:0/4058721462 conn(0x7f6a4c0f1c90 msgr2=0x7f6a4c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:54.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 -- 172.21.15.8:0/4058721462 shutdown_connections 2023-10-18T21:15:54.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.096+0000 7f6a5105b700 1 -- 172.21.15.8:0/4058721462 wait complete. 2023-10-18T21:15:54.113 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:15:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.235+0000 7fd3b7fff700 1 -- 172.21.15.8:0/287779984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3b80f6530 msgr2=0x7fd3b80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.235+0000 7fd3b7fff700 1 --2- 172.21.15.8:0/287779984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3b80f6530 0x7fd3b80f6950 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fd3a8004660 tx=0x7fd3a8009b30).stop 2023-10-18T21:15:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.235+0000 7fd3b7fff700 1 -- 172.21.15.8:0/287779984 shutdown_connections 2023-10-18T21:15:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.235+0000 7fd3b7fff700 1 --2- 172.21.15.8:0/287779984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b80f77d0 0x7fd3b80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.235+0000 7fd3b7fff700 1 --2- 172.21.15.8:0/287779984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3b80f6530 0x7fd3b80f6950 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.235+0000 7fd3b7fff700 1 -- 172.21.15.8:0/287779984 >> 172.21.15.8:0/287779984 conn(0x7fd3b80f1c90 msgr2=0x7fd3b80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:54.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.235+0000 7fd3b7fff700 1 -- 172.21.15.8:0/287779984 shutdown_connections 2023-10-18T21:15:54.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.236+0000 7fd3b7fff700 1 -- 172.21.15.8:0/287779984 wait complete. 2023-10-18T21:15:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.236+0000 7fd3b7fff700 1 Processor -- start 2023-10-18T21:15:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.236+0000 7fd3b7fff700 1 -- start start 2023-10-18T21:15:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3b80f6530 0x7fd3b8106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b80f77d0 0x7fd3b8107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8107870 con 0x7fd3b80f6530 2023-10-18T21:15:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b81080b0 con 0x7fd3b80f77d0 2023-10-18T21:15:54.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3b80f6530 0x7fd3b8106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:54.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3b80f6530 0x7fd3b8106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52822/0 (socket says 172.21.15.8:52822) 2023-10-18T21:15:54.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b6ffd700 1 -- 172.21.15.8:0/2046824649 learned_addr learned my addr 172.21.15.8:0/2046824649 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:54.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b67fc700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b80f77d0 0x7fd3b8107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:54.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b6ffd700 1 -- 172.21.15.8:0/2046824649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b80f77d0 msgr2=0x7fd3b8107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b6ffd700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b80f77d0 0x7fd3b8107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.237+0000 7fd3b6ffd700 1 -- 172.21.15.8:0/2046824649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8005040 con 0x7fd3b80f6530 2023-10-18T21:15:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.238+0000 7fd3b6ffd700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3b80f6530 0x7fd3b8106d80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fd3a8009870 tx=0x7fd3a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.238+0000 7fd39f7fe700 1 -- 172.21.15.8:0/2046824649 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a8019070 con 0x7fd3b80f6530 2023-10-18T21:15:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.238+0000 7fd39f7fe700 1 -- 172.21.15.8:0/2046824649 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd3a8013380 con 0x7fd3b80f6530 2023-10-18T21:15:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.238+0000 7fd39f7fe700 1 -- 172.21.15.8:0/2046824649 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a801edf0 con 0x7fd3b80f6530 2023-10-18T21:15:54.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.238+0000 7fd3b7fff700 1 -- 172.21.15.8:0/2046824649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b8108330 con 0x7fd3b80f6530 2023-10-18T21:15:54.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.238+0000 7fd3b7fff700 1 -- 172.21.15.8:0/2046824649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b8108810 con 0x7fd3b80f6530 2023-10-18T21:15:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.239+0000 7fd3b7fff700 1 -- 172.21.15.8:0/2046824649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b8059100 con 0x7fd3b80f6530 2023-10-18T21:15:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.240+0000 7fd39f7fe700 1 -- 172.21.15.8:0/2046824649 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd3a801e420 con 0x7fd3b80f6530 2023-10-18T21:15:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.241+0000 7fd39f7fe700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3a0060f70 0x7fd3a0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.241+0000 7fd39f7fe700 1 -- 172.21.15.8:0/2046824649 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd3a807dd00 con 0x7fd3b80f6530 2023-10-18T21:15:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.241+0000 7fd3b67fc700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3a0060f70 0x7fd3a0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:54.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.242+0000 7fd3b67fc700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3a0060f70 0x7fd3a0063430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fd3b8106b10 tx=0x7fd3ac00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:54.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.245+0000 7fd39f7fe700 1 -- 172.21.15.8:0/2046824649 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd3a804d930 con 0x7fd3b80f6530 2023-10-18T21:15:54.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.448+0000 7fd3b7fff700 1 -- 172.21.15.8:0/2046824649 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3b80feda0 con 0x7fd3a0060f70 2023-10-18T21:15:54.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.449+0000 7fd39f7fe700 1 -- 172.21.15.8:0/2046824649 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd3b80feda0 con 0x7fd3a0060f70 2023-10-18T21:15:54.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 -- 172.21.15.8:0/2046824649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3a0060f70 msgr2=0x7fd3a0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3a0060f70 0x7fd3a0063430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fd3b8106b10 tx=0x7fd3ac00b040).stop 2023-10-18T21:15:54.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 -- 172.21.15.8:0/2046824649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3b80f6530 msgr2=0x7fd3b8106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3b80f6530 0x7fd3b8106d80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fd3a8009870 tx=0x7fd3a800b040).stop 2023-10-18T21:15:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 -- 172.21.15.8:0/2046824649 shutdown_connections 2023-10-18T21:15:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3a0060f70 0x7fd3a0063430 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3b80f6530 0x7fd3b8106d80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 --2- 172.21.15.8:0/2046824649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b80f77d0 0x7fd3b8107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 -- 172.21.15.8:0/2046824649 >> 172.21.15.8:0/2046824649 conn(0x7fd3b80f1c90 msgr2=0x7fd3b80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:54.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 -- 172.21.15.8:0/2046824649 shutdown_connections 2023-10-18T21:15:54.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.452+0000 7fd3b7fff700 1 -- 172.21.15.8:0/2046824649 wait complete. 2023-10-18T21:15:54.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.589+0000 7fbce10e6700 1 -- 172.21.15.8:0/588886628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcdc0f6530 msgr2=0x7fbcdc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.589+0000 7fbce10e6700 1 --2- 172.21.15.8:0/588886628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcdc0f6530 0x7fbcdc0f6950 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fbccc004660 tx=0x7fbccc009b30).stop 2023-10-18T21:15:54.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.590+0000 7fbce10e6700 1 -- 172.21.15.8:0/588886628 shutdown_connections 2023-10-18T21:15:54.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.590+0000 7fbce10e6700 1 --2- 172.21.15.8:0/588886628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcdc0f77d0 0x7fbcdc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.590+0000 7fbce10e6700 1 --2- 172.21.15.8:0/588886628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcdc0f6530 0x7fbcdc0f6950 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.590+0000 7fbce10e6700 1 -- 172.21.15.8:0/588886628 >> 172.21.15.8:0/588886628 conn(0x7fbcdc0f1c90 msgr2=0x7fbcdc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:54.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.590+0000 7fbce10e6700 1 -- 172.21.15.8:0/588886628 shutdown_connections 2023-10-18T21:15:54.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.590+0000 7fbce10e6700 1 -- 172.21.15.8:0/588886628 wait complete. 2023-10-18T21:15:54.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.591+0000 7fbce10e6700 1 Processor -- start 2023-10-18T21:15:54.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.591+0000 7fbce10e6700 1 -- start start 2023-10-18T21:15:54.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbce10e6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcdc0f6530 0x7fbcdc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:54.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbce10e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcdc0f77d0 0x7fbcdc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:54.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbce10e6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc107880 con 0x7fbcdc0f6530 2023-10-18T21:15:54.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbce10e6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc1080c0 con 0x7fbcdc0f77d0 2023-10-18T21:15:54.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbcdbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcdc0f6530 0x7fbcdc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:54.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbcdbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcdc0f6530 0x7fbcdc106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52836/0 (socket says 172.21.15.8:52836) 2023-10-18T21:15:54.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbcdbfff700 1 -- 172.21.15.8:0/2922850327 learned_addr learned my addr 172.21.15.8:0/2922850327 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:54.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbcdb7fe700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcdc0f77d0 0x7fbcdc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbcdbfff700 1 -- 172.21.15.8:0/2922850327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcdc0f77d0 msgr2=0x7fbcdc107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbcdbfff700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcdc0f77d0 0x7fbcdc107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.592+0000 7fbcdbfff700 1 -- 172.21.15.8:0/2922850327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc005040 con 0x7fbcdc0f6530 2023-10-18T21:15:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.593+0000 7fbcdbfff700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcdc0f6530 0x7fbcdc106d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fbccc009870 tx=0x7fbccc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.593+0000 7fbcd8ff9700 1 -- 172.21.15.8:0/2922850327 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbccc019070 con 0x7fbcdc0f6530 2023-10-18T21:15:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.593+0000 7fbcd8ff9700 1 -- 172.21.15.8:0/2922850327 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbccc013380 con 0x7fbcdc0f6530 2023-10-18T21:15:54.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.593+0000 7fbce10e6700 1 -- 172.21.15.8:0/2922850327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcdc108340 con 0x7fbcdc0f6530 2023-10-18T21:15:54.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.593+0000 7fbcd8ff9700 1 -- 172.21.15.8:0/2922850327 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbccc01edf0 con 0x7fbcdc0f6530 2023-10-18T21:15:54.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.593+0000 7fbce10e6700 1 -- 172.21.15.8:0/2922850327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcdc108820 con 0x7fbcdc0f6530 2023-10-18T21:15:54.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.594+0000 7fbce10e6700 1 -- 172.21.15.8:0/2922850327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcdc059100 con 0x7fbcdc0f6530 2023-10-18T21:15:54.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.595+0000 7fbcd8ff9700 1 -- 172.21.15.8:0/2922850327 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbccc01e420 con 0x7fbcdc0f6530 2023-10-18T21:15:54.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.596+0000 7fbcd8ff9700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbcc4060f70 0x7fbcc4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:54.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.596+0000 7fbcd8ff9700 1 -- 172.21.15.8:0/2922850327 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbccc07ddd0 con 0x7fbcdc0f6530 2023-10-18T21:15:54.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.596+0000 7fbcdb7fe700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbcc4060f70 0x7fbcc4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:54.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.597+0000 7fbcdb7fe700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbcc4060f70 0x7fbcc4063430 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fbcdc106b20 tx=0x7fbcd000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:54.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.600+0000 7fbcd8ff9700 1 -- 172.21.15.8:0/2922850327 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbccc04d980 con 0x7fbcdc0f6530 2023-10-18T21:15:54.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.794+0000 7fbce10e6700 1 -- 172.21.15.8:0/2922850327 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcdc0fed30 con 0x7fbcc4060f70 2023-10-18T21:15:54.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.804+0000 7fbcd8ff9700 1 -- 172.21.15.8:0/2922850327 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fbcdc0fed30 con 0x7fbcc4060f70 2023-10-18T21:15:54.806 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:15:54.806 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (22m) 33s ago 24m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:15:54.806 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (16m) 33s ago 24m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:15:54.806 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (16m) 8m ago 23m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:15:54.806 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (22m) 33s ago 23m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:15:54.807 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 33s ago 20m - - 2023-10-18T21:15:54.807 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 33s ago 20m - - 2023-10-18T21:15:54.807 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (8m) 8m ago 20m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:15:54.807 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (8m) 8m ago 19m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:15:54.807 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (17m) 33s ago 25m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:15:54.807 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (17m) 8m ago 23m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:15:54.808 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (16m) 33s ago 25m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:15:54.808 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (16m) 8m ago 23m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:15:54.808 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (23m) 33s ago 23m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:15:54.808 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (22m) 8m ago 22m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:15:54.808 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (16m) 33s ago 22m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:15:54.809 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (14m) 33s ago 22m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:15:54.809 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (13m) 33s ago 21m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:15:54.809 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (13m) 8m ago 21m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:15:54.809 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (12m) 8m ago 21m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:15:54.809 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (12m) 8m ago 21m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:15:54.809 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (18m) 33s ago 23m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:15:54.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 -- 172.21.15.8:0/2922850327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbcc4060f70 msgr2=0x7fbcc4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbcc4060f70 0x7fbcc4063430 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fbcdc106b20 tx=0x7fbcd000b040).stop 2023-10-18T21:15:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 -- 172.21.15.8:0/2922850327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcdc0f6530 msgr2=0x7fbcdc106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcdc0f6530 0x7fbcdc106d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fbccc009870 tx=0x7fbccc00b040).stop 2023-10-18T21:15:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 -- 172.21.15.8:0/2922850327 shutdown_connections 2023-10-18T21:15:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbcc4060f70 0x7fbcc4063430 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcdc0f6530 0x7fbcdc106d90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 --2- 172.21.15.8:0/2922850327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcdc0f77d0 0x7fbcdc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 -- 172.21.15.8:0/2922850327 >> 172.21.15.8:0/2922850327 conn(0x7fbcdc0f1c90 msgr2=0x7fbcdc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 -- 172.21.15.8:0/2922850327 shutdown_connections 2023-10-18T21:15:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.806+0000 7fbce10e6700 1 -- 172.21.15.8:0/2922850327 wait complete. 2023-10-18T21:15:54.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.942+0000 7f1c2b59e700 1 -- 172.21.15.8:0/3825998285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c2c0f6530 msgr2=0x7f1c2c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.942+0000 7f1c2b59e700 1 --2- 172.21.15.8:0/3825998285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c2c0f6530 0x7f1c2c0f6950 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f1c1c004660 tx=0x7f1c1c009b30).stop 2023-10-18T21:15:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.942+0000 7f1c2b59e700 1 -- 172.21.15.8:0/3825998285 shutdown_connections 2023-10-18T21:15:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.942+0000 7f1c2b59e700 1 --2- 172.21.15.8:0/3825998285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c2c0f77d0 0x7f1c2c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.942+0000 7f1c2b59e700 1 --2- 172.21.15.8:0/3825998285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c2c0f6530 0x7f1c2c0f6950 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.942+0000 7f1c2b59e700 1 -- 172.21.15.8:0/3825998285 >> 172.21.15.8:0/3825998285 conn(0x7f1c2c0f1c90 msgr2=0x7f1c2c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.942+0000 7f1c2b59e700 1 -- 172.21.15.8:0/3825998285 shutdown_connections 2023-10-18T21:15:54.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.942+0000 7f1c2b59e700 1 -- 172.21.15.8:0/3825998285 wait complete. 2023-10-18T21:15:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.943+0000 7f1c2b59e700 1 Processor -- start 2023-10-18T21:15:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.943+0000 7f1c2b59e700 1 -- start start 2023-10-18T21:15:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c2b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c2c0f6530 0x7f1c2c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c2b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c2c0f77d0 0x7f1c2c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c2b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c06a380 con 0x7f1c2c0f6530 2023-10-18T21:15:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c2b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c06a4c0 con 0x7f1c2c0f77d0 2023-10-18T21:15:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c2a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c2c0f6530 0x7f1c2c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c2a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c2c0f6530 0x7f1c2c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52846/0 (socket says 172.21.15.8:52846) 2023-10-18T21:15:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c2a59c700 1 -- 172.21.15.8:0/2986230023 learned_addr learned my addr 172.21.15.8:0/2986230023 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c29d9b700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c2c0f77d0 0x7f1c2c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c2a59c700 1 -- 172.21.15.8:0/2986230023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c2c0f77d0 msgr2=0x7f1c2c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c2a59c700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c2c0f77d0 0x7f1c2c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.944+0000 7f1c2a59c700 1 -- 172.21.15.8:0/2986230023 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c005040 con 0x7f1c2c0f6530 2023-10-18T21:15:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.945+0000 7f1c2a59c700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c2c0f6530 0x7f1c2c06b9a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f1c1c004e30 tx=0x7f1c1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.945+0000 7f1c1affd700 1 -- 172.21.15.8:0/2986230023 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c1c018070 con 0x7f1c2c0f6530 2023-10-18T21:15:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.945+0000 7f1c1affd700 1 -- 172.21.15.8:0/2986230023 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1c1c009630 con 0x7f1c2c0f6530 2023-10-18T21:15:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.945+0000 7f1c1affd700 1 -- 172.21.15.8:0/2986230023 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c1c01c3c0 con 0x7f1c2c0f6530 2023-10-18T21:15:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.945+0000 7f1c2b59e700 1 -- 172.21.15.8:0/2986230023 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c06a740 con 0x7f1c2c0f6530 2023-10-18T21:15:54.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.945+0000 7f1c2b59e700 1 -- 172.21.15.8:0/2986230023 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c06aca0 con 0x7f1c2c0f6530 2023-10-18T21:15:54.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.946+0000 7f1c2b59e700 1 -- 172.21.15.8:0/2986230023 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2c045ad0 con 0x7f1c2c0f6530 2023-10-18T21:15:54.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.947+0000 7f1c1affd700 1 -- 172.21.15.8:0/2986230023 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1c1c01d420 con 0x7f1c2c0f6530 2023-10-18T21:15:54.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.948+0000 7f1c1affd700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c14060f70 0x7f1c14063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:54.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.948+0000 7f1c1affd700 1 -- 172.21.15.8:0/2986230023 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1c1c07e480 con 0x7f1c2c0f6530 2023-10-18T21:15:54.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.948+0000 7f1c29d9b700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c14060f70 0x7f1c14063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:54.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.949+0000 7f1c29d9b700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c14060f70 0x7f1c14063430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f1c20009760 tx=0x7f1c20009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:54.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:54.952+0000 7f1c1affd700 1 -- 172.21.15.8:0/2986230023 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1c1c04e220 con 0x7f1c2c0f6530 2023-10-18T21:15:55.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.208+0000 7f1c2b59e700 1 -- 172.21.15.8:0/2986230023 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1c2c0fee00 con 0x7f1c2c0f6530 2023-10-18T21:15:55.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.208+0000 7f1c1affd700 1 -- 172.21.15.8:0/2986230023 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f1c1c051840 con 0x7f1c2c0f6530 2023-10-18T21:15:55.210 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:15:55.211 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:15:55.211 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:15:55.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:15:55.211 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:15:55.212 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:15:55.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:15:55.212 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:15:55.212 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:15:55.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:15:55.213 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:15:55.213 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:15:55.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:15:55.213 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:15:55.214 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:15:55.214 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:15:55.214 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:15:55.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.210+0000 7f1c2b59e700 1 -- 172.21.15.8:0/2986230023 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c14060f70 msgr2=0x7f1c14063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:55.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.210+0000 7f1c2b59e700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c14060f70 0x7f1c14063430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f1c20009760 tx=0x7f1c20009c60).stop 2023-10-18T21:15:55.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.210+0000 7f1c2b59e700 1 -- 172.21.15.8:0/2986230023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c2c0f6530 msgr2=0x7f1c2c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:55.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.210+0000 7f1c2b59e700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c2c0f6530 0x7f1c2c06b9a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f1c1c004e30 tx=0x7f1c1c009b30).stop 2023-10-18T21:15:55.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.210+0000 7f1c2b59e700 1 -- 172.21.15.8:0/2986230023 shutdown_connections 2023-10-18T21:15:55.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.210+0000 7f1c2b59e700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c14060f70 0x7f1c14063430 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.211+0000 7f1c2b59e700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c2c0f6530 0x7f1c2c06b9a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.211+0000 7f1c2b59e700 1 --2- 172.21.15.8:0/2986230023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c2c0f77d0 0x7f1c2c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.211+0000 7f1c2b59e700 1 -- 172.21.15.8:0/2986230023 >> 172.21.15.8:0/2986230023 conn(0x7f1c2c0f1c90 msgr2=0x7f1c2c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.211+0000 7f1c2b59e700 1 -- 172.21.15.8:0/2986230023 shutdown_connections 2023-10-18T21:15:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.211+0000 7f1c2b59e700 1 -- 172.21.15.8:0/2986230023 wait complete. 2023-10-18T21:15:55.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.347+0000 7f0bd9d37700 1 -- 172.21.15.8:0/3228002997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd4060270 msgr2=0x7f0bd40f91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:55.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.347+0000 7f0bd9d37700 1 --2- 172.21.15.8:0/3228002997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd4060270 0x7f0bd40f91c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f0bc8004660 tx=0x7f0bc8009b30).stop 2023-10-18T21:15:55.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.347+0000 7f0bd9d37700 1 -- 172.21.15.8:0/3228002997 shutdown_connections 2023-10-18T21:15:55.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.347+0000 7f0bd9d37700 1 --2- 172.21.15.8:0/3228002997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd40f96b0 0x7f0bd40fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.347+0000 7f0bd9d37700 1 --2- 172.21.15.8:0/3228002997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd4060270 0x7f0bd40f91c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.347+0000 7f0bd9d37700 1 -- 172.21.15.8:0/3228002997 >> 172.21.15.8:0/3228002997 conn(0x7f0bd40f0ba0 msgr2=0x7f0bd40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:55.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.347+0000 7f0bd9d37700 1 -- 172.21.15.8:0/3228002997 shutdown_connections 2023-10-18T21:15:55.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.347+0000 7f0bd9d37700 1 -- 172.21.15.8:0/3228002997 wait complete. 2023-10-18T21:15:55.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.348+0000 7f0bd9d37700 1 Processor -- start 2023-10-18T21:15:55.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.348+0000 7f0bd9d37700 1 -- start start 2023-10-18T21:15:55.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.348+0000 7f0bd9d37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd4060270 0x7f0bd4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:55.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.348+0000 7f0bd9d37700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd40f96b0 0x7f0bd4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:55.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.348+0000 7f0bd9d37700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd4107880 con 0x7f0bd4060270 2023-10-18T21:15:55.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.348+0000 7f0bd9d37700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd41080c0 con 0x7f0bd40f96b0 2023-10-18T21:15:55.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd8d35700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd4060270 0x7f0bd4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:55.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd8d35700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd4060270 0x7f0bd4106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52866/0 (socket says 172.21.15.8:52866) 2023-10-18T21:15:55.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd8d35700 1 -- 172.21.15.8:0/2326814071 learned_addr learned my addr 172.21.15.8:0/2326814071 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:55.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd3fff700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd40f96b0 0x7f0bd4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:55.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd8d35700 1 -- 172.21.15.8:0/2326814071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd40f96b0 msgr2=0x7f0bd4107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:55.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd8d35700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd40f96b0 0x7f0bd4107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd8d35700 1 -- 172.21.15.8:0/2326814071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8005040 con 0x7f0bd4060270 2023-10-18T21:15:55.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd8d35700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd4060270 0x7f0bd4106d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f0bc8004320 tx=0x7f0bc800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:55.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd17fa700 1 -- 172.21.15.8:0/2326814071 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bc8019070 con 0x7f0bd4060270 2023-10-18T21:15:55.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd17fa700 1 -- 172.21.15.8:0/2326814071 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0bc801e420 con 0x7f0bd4060270 2023-10-18T21:15:55.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.349+0000 7f0bd17fa700 1 -- 172.21.15.8:0/2326814071 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bc8014680 con 0x7f0bd4060270 2023-10-18T21:15:55.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.350+0000 7f0bd9d37700 1 -- 172.21.15.8:0/2326814071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd4108340 con 0x7f0bd4060270 2023-10-18T21:15:55.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.350+0000 7f0bd9d37700 1 -- 172.21.15.8:0/2326814071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd4108820 con 0x7f0bd4060270 2023-10-18T21:15:55.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.351+0000 7f0bd9d37700 1 -- 172.21.15.8:0/2326814071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd4059100 con 0x7f0bd4060270 2023-10-18T21:15:55.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.352+0000 7f0bd17fa700 1 -- 172.21.15.8:0/2326814071 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0bc801e590 con 0x7f0bd4060270 2023-10-18T21:15:55.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.352+0000 7f0bd17fa700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bc4060f70 0x7f0bc4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:55.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.352+0000 7f0bd17fa700 1 -- 172.21.15.8:0/2326814071 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0bc807dd90 con 0x7f0bd4060270 2023-10-18T21:15:55.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.353+0000 7f0bd3fff700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bc4060f70 0x7f0bc4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:55.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.353+0000 7f0bd3fff700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bc4060f70 0x7f0bc4063430 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f0bd4106b20 tx=0x7f0bc000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:55.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.357+0000 7f0bd17fa700 1 -- 172.21.15.8:0/2326814071 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0bc804d960 con 0x7f0bd4060270 2023-10-18T21:15:55.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.582+0000 7f0bd9d37700 1 -- 172.21.15.8:0/2326814071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0bd40fed00 con 0x7f0bd4060270 2023-10-18T21:15:55.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.582+0000 7f0bd17fa700 1 -- 172.21.15.8:0/2326814071 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f0bc8050f80 con 0x7f0bd4060270 2023-10-18T21:15:55.585 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:15:55.585 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:15:55.585 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:15:55.585 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:15:55.585 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:15:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:15:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:15:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:15:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:15:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:15:55.587 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:15:55.587 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:15:55.587 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:15:55.587 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:15:55.588 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:15:55.588 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:15:55.588 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:15:55.588 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:15:55.588 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:15:55.589 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:15:55.589 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:15:55.589 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:15:55.589 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:15:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:15:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:15:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:15:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:15:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:15:55.590 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:15:55.591 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:15:55.591 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:15:55.591 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:15:55.591 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:15:55.591 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:15:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.584+0000 7f0bd9d37700 1 -- 172.21.15.8:0/2326814071 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bc4060f70 msgr2=0x7f0bc4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:55.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.584+0000 7f0bd9d37700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bc4060f70 0x7f0bc4063430 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f0bd4106b20 tx=0x7f0bc000b040).stop 2023-10-18T21:15:55.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.584+0000 7f0bd9d37700 1 -- 172.21.15.8:0/2326814071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd4060270 msgr2=0x7f0bd4106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:55.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.584+0000 7f0bd9d37700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd4060270 0x7f0bd4106d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f0bc8004320 tx=0x7f0bc800b040).stop 2023-10-18T21:15:55.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.584+0000 7f0bd9d37700 1 -- 172.21.15.8:0/2326814071 shutdown_connections 2023-10-18T21:15:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.584+0000 7f0bd9d37700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bc4060f70 0x7f0bc4063430 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.584+0000 7f0bd9d37700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd4060270 0x7f0bd4106d90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.584+0000 7f0bd9d37700 1 --2- 172.21.15.8:0/2326814071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd40f96b0 0x7f0bd4107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.584+0000 7f0bd9d37700 1 -- 172.21.15.8:0/2326814071 >> 172.21.15.8:0/2326814071 conn(0x7f0bd40f0ba0 msgr2=0x7f0bd40f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.585+0000 7f0bd9d37700 1 -- 172.21.15.8:0/2326814071 shutdown_connections 2023-10-18T21:15:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.585+0000 7f0bd9d37700 1 -- 172.21.15.8:0/2326814071 wait complete. 2023-10-18T21:15:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:15:55.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.722+0000 7f5cb3fff700 1 -- 172.21.15.8:0/1726600834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb40f6530 msgr2=0x7f5cb40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:55.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.722+0000 7f5cb3fff700 1 --2- 172.21.15.8:0/1726600834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb40f6530 0x7f5cb40f6950 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f5ca4004660 tx=0x7f5ca4009b30).stop 2023-10-18T21:15:55.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.722+0000 7f5cb3fff700 1 -- 172.21.15.8:0/1726600834 shutdown_connections 2023-10-18T21:15:55.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.722+0000 7f5cb3fff700 1 --2- 172.21.15.8:0/1726600834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb40f77d0 0x7f5cb40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.722+0000 7f5cb3fff700 1 --2- 172.21.15.8:0/1726600834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb40f6530 0x7f5cb40f6950 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.722+0000 7f5cb3fff700 1 -- 172.21.15.8:0/1726600834 >> 172.21.15.8:0/1726600834 conn(0x7f5cb40f1c90 msgr2=0x7f5cb40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:55.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.722+0000 7f5cb3fff700 1 -- 172.21.15.8:0/1726600834 shutdown_connections 2023-10-18T21:15:55.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.722+0000 7f5cb3fff700 1 -- 172.21.15.8:0/1726600834 wait complete. 2023-10-18T21:15:55.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.723+0000 7f5cb3fff700 1 Processor -- start 2023-10-18T21:15:55.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.723+0000 7f5cb3fff700 1 -- start start 2023-10-18T21:15:55.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.723+0000 7f5cb3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb40f6530 0x7f5cb4106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:55.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.723+0000 7f5cb3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb40f77d0 0x7f5cb4107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:55.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.723+0000 7f5cb3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb4107910 con 0x7f5cb40f6530 2023-10-18T21:15:55.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.723+0000 7f5cb3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb4108120 con 0x7f5cb40f77d0 2023-10-18T21:15:55.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.723+0000 7f5cb2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb40f6530 0x7f5cb4106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.723+0000 7f5cb2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb40f6530 0x7f5cb4106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52884/0 (socket says 172.21.15.8:52884) 2023-10-18T21:15:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.723+0000 7f5cb2ffd700 1 -- 172.21.15.8:0/4262725103 learned_addr learned my addr 172.21.15.8:0/4262725103 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:15:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.724+0000 7f5cb27fc700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb40f77d0 0x7f5cb4107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.724+0000 7f5cb2ffd700 1 -- 172.21.15.8:0/4262725103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb40f77d0 msgr2=0x7f5cb4107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.724+0000 7f5cb2ffd700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb40f77d0 0x7f5cb4107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.724+0000 7f5cb2ffd700 1 -- 172.21.15.8:0/4262725103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca4005040 con 0x7f5cb40f6530 2023-10-18T21:15:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.724+0000 7f5cb2ffd700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb40f6530 0x7f5cb4106e20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f5ca4004e30 tx=0x7f5ca4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.724+0000 7f5c9b7fe700 1 -- 172.21.15.8:0/4262725103 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ca4018070 con 0x7f5cb40f6530 2023-10-18T21:15:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.724+0000 7f5cb3fff700 1 -- 172.21.15.8:0/4262725103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb4108340 con 0x7f5cb40f6530 2023-10-18T21:15:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.724+0000 7f5c9b7fe700 1 -- 172.21.15.8:0/4262725103 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5ca4009630 con 0x7f5cb40f6530 2023-10-18T21:15:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.724+0000 7f5c9b7fe700 1 -- 172.21.15.8:0/4262725103 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ca401c3c0 con 0x7f5cb40f6530 2023-10-18T21:15:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.724+0000 7f5cb3fff700 1 -- 172.21.15.8:0/4262725103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb41088a0 con 0x7f5cb40f6530 2023-10-18T21:15:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.725+0000 7f5cb3fff700 1 -- 172.21.15.8:0/4262725103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb4059100 con 0x7f5cb40f6530 2023-10-18T21:15:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.726+0000 7f5c9b7fe700 1 -- 172.21.15.8:0/4262725103 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5ca401d420 con 0x7f5cb40f6530 2023-10-18T21:15:55.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.728+0000 7f5c9b7fe700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c9c060f70 0x7f5c9c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:15:55.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.728+0000 7f5c9b7fe700 1 -- 172.21.15.8:0/4262725103 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5ca407e540 con 0x7f5cb40f6530 2023-10-18T21:15:55.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.728+0000 7f5cb27fc700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c9c060f70 0x7f5c9c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:15:55.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.728+0000 7f5cb27fc700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c9c060f70 0x7f5c9c063430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f5ca80096c0 tx=0x7f5ca8009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:15:55.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.732+0000 7f5c9b7fe700 1 -- 172.21.15.8:0/4262725103 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5ca404e220 con 0x7f5cb40f6530 2023-10-18T21:15:55.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:54.095120+0000 mgr.smithi008.flmjzp (mgr.14640) 1026 : audit [DBG] from='client.35028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:54.372598+0000 mgr.smithi008.flmjzp (mgr.14640) 1027 : cluster [DBG] pgmap v721: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:54.450501+0000 mgr.smithi008.flmjzp (mgr.14640) 1028 : audit [DBG] from='client.35032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:55.209746+0000 mon.smithi008 (mon.0) 1496 : audit [DBG] from='client.? 172.21.15.8:0/2986230023' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:54.095120+0000 mgr.smithi008.flmjzp (mgr.14640) 1026 : audit [DBG] from='client.35028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:54.372598+0000 mgr.smithi008.flmjzp (mgr.14640) 1027 : cluster [DBG] pgmap v721: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:54.450501+0000 mgr.smithi008.flmjzp (mgr.14640) 1028 : audit [DBG] from='client.35032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:55.209746+0000 mon.smithi008 (mon.0) 1496 : audit [DBG] from='client.? 172.21.15.8:0/2986230023' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:15:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.930+0000 7f5cb3fff700 1 -- 172.21.15.8:0/4262725103 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cb40008d0 con 0x7f5c9c060f70 2023-10-18T21:15:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.931+0000 7f5c9b7fe700 1 -- 172.21.15.8:0/4262725103 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5cb40008d0 con 0x7f5c9c060f70 2023-10-18T21:15:55.933 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:15:55.933 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:15:55.933 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:15:55.934 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:15:55.934 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:15:55.934 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:15:55.934 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:15:55.934 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:15:55.935 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:15:55.935 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:15:55.935 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "14/21 daemons upgraded", 2023-10-18T21:15:55.935 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:15:55.935 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:15:55.936 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:15:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 -- 172.21.15.8:0/4262725103 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c9c060f70 msgr2=0x7f5c9c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c9c060f70 0x7f5c9c063430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f5ca80096c0 tx=0x7f5ca8009be0).stop 2023-10-18T21:15:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 -- 172.21.15.8:0/4262725103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb40f6530 msgr2=0x7f5cb4106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:15:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb40f6530 0x7f5cb4106e20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f5ca4004e30 tx=0x7f5ca4009b30).stop 2023-10-18T21:15:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 -- 172.21.15.8:0/4262725103 shutdown_connections 2023-10-18T21:15:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c9c060f70 0x7f5c9c063430 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb40f6530 0x7f5cb4106e20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 --2- 172.21.15.8:0/4262725103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb40f77d0 0x7f5cb4107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:15:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 -- 172.21.15.8:0/4262725103 >> 172.21.15.8:0/4262725103 conn(0x7f5cb40f1c90 msgr2=0x7f5cb40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:15:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 -- 172.21.15.8:0/4262725103 shutdown_connections 2023-10-18T21:15:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:15:55.933+0000 7f5cb3fff700 1 -- 172.21.15.8:0/4262725103 wait complete. 2023-10-18T21:15:56.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:54.796607+0000 mgr.smithi008.flmjzp (mgr.14640) 1029 : audit [DBG] from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:55.583950+0000 mon.smithi008 (mon.0) 1497 : audit [DBG] from='client.? 172.21.15.8:0/2326814071' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:15:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:54.796607+0000 mgr.smithi008.flmjzp (mgr.14640) 1029 : audit [DBG] from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:55.583950+0000 mon.smithi008 (mon.0) 1497 : audit [DBG] from='client.? 172.21.15.8:0/2326814071' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:15:57.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:15:55.932339+0000 mgr.smithi008.flmjzp (mgr.14640) 1030 : audit [DBG] from='client.35048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:56.373223+0000 mgr.smithi008.flmjzp (mgr.14640) 1031 : cluster [DBG] pgmap v722: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:15:55.932339+0000 mgr.smithi008.flmjzp (mgr.14640) 1030 : audit [DBG] from='client.35048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:15:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:56.373223+0000 mgr.smithi008.flmjzp (mgr.14640) 1031 : cluster [DBG] pgmap v722: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:59.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:15:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:15:58.373893+0000 mgr.smithi008.flmjzp (mgr.14640) 1032 : cluster [DBG] pgmap v723: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:15:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:15:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:15:58.373893+0000 mgr.smithi008.flmjzp (mgr.14640) 1032 : cluster [DBG] pgmap v723: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:00.374437+0000 mgr.smithi008.flmjzp (mgr.14640) 1033 : cluster [DBG] pgmap v724: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:00.374437+0000 mgr.smithi008.flmjzp (mgr.14640) 1033 : cluster [DBG] pgmap v724: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:02.400389+0000 mon.smithi008 (mon.0) 1498 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:02.402647+0000 mon.smithi008 (mon.0) 1499 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:02.403747+0000 mon.smithi008 (mon.0) 1500 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:02.410709+0000 mon.smithi008 (mon.0) 1501 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:02.417038+0000 mon.smithi008 (mon.0) 1502 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:02.420295+0000 mon.smithi008 (mon.0) 1503 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:02.422025+0000 mon.smithi008 (mon.0) 1504 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:02.423641+0000 mon.smithi008 (mon.0) 1505 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:02.425612+0000 mon.smithi008 (mon.0) 1506 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:02.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:02.400389+0000 mon.smithi008 (mon.0) 1498 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:02.402647+0000 mon.smithi008 (mon.0) 1499 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:02.403747+0000 mon.smithi008 (mon.0) 1500 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:02.410709+0000 mon.smithi008 (mon.0) 1501 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:02.417038+0000 mon.smithi008 (mon.0) 1502 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:02.420295+0000 mon.smithi008 (mon.0) 1503 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:02.422025+0000 mon.smithi008 (mon.0) 1504 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:02.423641+0000 mon.smithi008 (mon.0) 1505 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:02.425612+0000 mon.smithi008 (mon.0) 1506 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:03.719 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:02.375096+0000 mgr.smithi008.flmjzp (mgr.14640) 1034 : cluster [DBG] pgmap v725: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:03.719 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:02.404695+0000 mgr.smithi008.flmjzp (mgr.14640) 1035 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:03.719 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:02.405268+0000 mgr.smithi008.flmjzp (mgr.14640) 1036 : cluster [DBG] pgmap v726: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:03.719 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:02.405504+0000 mgr.smithi008.flmjzp (mgr.14640) 1037 : cluster [DBG] pgmap v727: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:03.720 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:02.427722+0000 mgr.smithi008.flmjzp (mgr.14640) 1038 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:02.375096+0000 mgr.smithi008.flmjzp (mgr.14640) 1034 : cluster [DBG] pgmap v725: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:02.404695+0000 mgr.smithi008.flmjzp (mgr.14640) 1035 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:02.405268+0000 mgr.smithi008.flmjzp (mgr.14640) 1036 : cluster [DBG] pgmap v726: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:02.405504+0000 mgr.smithi008.flmjzp (mgr.14640) 1037 : cluster [DBG] pgmap v727: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:02.427722+0000 mgr.smithi008.flmjzp (mgr.14640) 1038 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:04.406019+0000 mgr.smithi008.flmjzp (mgr.14640) 1039 : cluster [DBG] pgmap v728: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:04.406019+0000 mgr.smithi008.flmjzp (mgr.14640) 1039 : cluster [DBG] pgmap v728: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:07.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:06.406613+0000 mgr.smithi008.flmjzp (mgr.14640) 1040 : cluster [DBG] pgmap v729: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:06.406613+0000 mgr.smithi008.flmjzp (mgr.14640) 1040 : cluster [DBG] pgmap v729: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:09.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:08.407277+0000 mgr.smithi008.flmjzp (mgr.14640) 1041 : cluster [DBG] pgmap v730: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:08.407277+0000 mgr.smithi008.flmjzp (mgr.14640) 1041 : cluster [DBG] pgmap v730: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:10.407789+0000 mgr.smithi008.flmjzp (mgr.14640) 1042 : cluster [DBG] pgmap v731: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:10.407789+0000 mgr.smithi008.flmjzp (mgr.14640) 1042 : cluster [DBG] pgmap v731: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:12.430261+0000 mon.smithi008 (mon.0) 1507 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:12.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:12.430261+0000 mon.smithi008 (mon.0) 1507 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:12.408252+0000 mgr.smithi008.flmjzp (mgr.14640) 1043 : cluster [DBG] pgmap v732: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:12.986077+0000 mon.smithi008 (mon.0) 1508 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:12.987186+0000 mon.smithi008 (mon.0) 1509 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:12.994371+0000 mon.smithi008 (mon.0) 1510 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:13.002441+0000 mon.smithi008 (mon.0) 1511 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:13.006030+0000 mon.smithi008 (mon.0) 1512 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:13.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:13.008048+0000 mon.smithi008 (mon.0) 1513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:13.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:13.009928+0000 mon.smithi008 (mon.0) 1514 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:13.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:13.012518+0000 mon.smithi008 (mon.0) 1515 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:13.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:12.408252+0000 mgr.smithi008.flmjzp (mgr.14640) 1043 : cluster [DBG] pgmap v732: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:12.986077+0000 mon.smithi008 (mon.0) 1508 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:12.987186+0000 mon.smithi008 (mon.0) 1509 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:12.994371+0000 mon.smithi008 (mon.0) 1510 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:13.002441+0000 mon.smithi008 (mon.0) 1511 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:13.006030+0000 mon.smithi008 (mon.0) 1512 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:13.008048+0000 mon.smithi008 (mon.0) 1513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:13.009928+0000 mon.smithi008 (mon.0) 1514 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:13.012518+0000 mon.smithi008 (mon.0) 1515 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:12.988112+0000 mgr.smithi008.flmjzp (mgr.14640) 1044 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:12.988791+0000 mgr.smithi008.flmjzp (mgr.14640) 1045 : cluster [DBG] pgmap v733: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:12.989147+0000 mgr.smithi008.flmjzp (mgr.14640) 1046 : cluster [DBG] pgmap v734: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:13.014745+0000 mgr.smithi008.flmjzp (mgr.14640) 1047 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:12.988112+0000 mgr.smithi008.flmjzp (mgr.14640) 1044 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:12.988791+0000 mgr.smithi008.flmjzp (mgr.14640) 1045 : cluster [DBG] pgmap v733: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:12.989147+0000 mgr.smithi008.flmjzp (mgr.14640) 1046 : cluster [DBG] pgmap v734: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:13.014745+0000 mgr.smithi008.flmjzp (mgr.14640) 1047 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:14.989944+0000 mgr.smithi008.flmjzp (mgr.14640) 1048 : cluster [DBG] pgmap v735: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:16.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:14.989944+0000 mgr.smithi008.flmjzp (mgr.14640) 1048 : cluster [DBG] pgmap v735: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:16.990505+0000 mgr.smithi008.flmjzp (mgr.14640) 1049 : cluster [DBG] pgmap v736: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:18.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:16.990505+0000 mgr.smithi008.flmjzp (mgr.14640) 1049 : cluster [DBG] pgmap v736: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:18.991298+0000 mgr.smithi008.flmjzp (mgr.14640) 1050 : cluster [DBG] pgmap v737: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:20.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:18.991298+0000 mgr.smithi008.flmjzp (mgr.14640) 1050 : cluster [DBG] pgmap v737: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:20.991884+0000 mgr.smithi008.flmjzp (mgr.14640) 1051 : cluster [DBG] pgmap v738: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:22.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:20.991884+0000 mgr.smithi008.flmjzp (mgr.14640) 1051 : cluster [DBG] pgmap v738: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:23.024980+0000 mon.smithi008 (mon.0) 1516 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:23.027044+0000 mon.smithi008 (mon.0) 1517 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:23.028084+0000 mon.smithi008 (mon.0) 1518 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:23.034509+0000 mon.smithi008 (mon.0) 1519 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:23.042585+0000 mon.smithi008 (mon.0) 1520 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:23.045665+0000 mon.smithi008 (mon.0) 1521 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:23.047281+0000 mon.smithi008 (mon.0) 1522 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:23.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:23.048908+0000 mon.smithi008 (mon.0) 1523 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:23.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:23.050928+0000 mon.smithi008 (mon.0) 1524 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:23.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:23.024980+0000 mon.smithi008 (mon.0) 1516 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:23.027044+0000 mon.smithi008 (mon.0) 1517 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:23.028084+0000 mon.smithi008 (mon.0) 1518 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:23.034509+0000 mon.smithi008 (mon.0) 1519 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:23.042585+0000 mon.smithi008 (mon.0) 1520 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:23.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:23.045665+0000 mon.smithi008 (mon.0) 1521 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:23.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:23.047281+0000 mon.smithi008 (mon.0) 1522 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:23.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:23.048908+0000 mon.smithi008 (mon.0) 1523 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:23.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:23.050928+0000 mon.smithi008 (mon.0) 1524 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:22.992351+0000 mgr.smithi008.flmjzp (mgr.14640) 1052 : cluster [DBG] pgmap v739: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:23.028953+0000 mgr.smithi008.flmjzp (mgr.14640) 1053 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:23.029545+0000 mgr.smithi008.flmjzp (mgr.14640) 1054 : cluster [DBG] pgmap v740: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:23.029842+0000 mgr.smithi008.flmjzp (mgr.14640) 1055 : cluster [DBG] pgmap v741: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:23.052980+0000 mgr.smithi008.flmjzp (mgr.14640) 1056 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:24.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:22.992351+0000 mgr.smithi008.flmjzp (mgr.14640) 1052 : cluster [DBG] pgmap v739: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:23.028953+0000 mgr.smithi008.flmjzp (mgr.14640) 1053 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:23.029545+0000 mgr.smithi008.flmjzp (mgr.14640) 1054 : cluster [DBG] pgmap v740: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:23.029842+0000 mgr.smithi008.flmjzp (mgr.14640) 1055 : cluster [DBG] pgmap v741: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:23.052980+0000 mgr.smithi008.flmjzp (mgr.14640) 1056 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:26.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.086+0000 7fc6953e6700 1 -- 172.21.15.8:0/435795011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc69006b960 msgr2=0x7fc690069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.086+0000 7fc6953e6700 1 --2- 172.21.15.8:0/435795011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc69006b960 0x7fc690069e60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fc680004660 tx=0x7fc680009b30).stop 2023-10-18T21:16:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.086+0000 7fc6953e6700 1 -- 172.21.15.8:0/435795011 shutdown_connections 2023-10-18T21:16:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.086+0000 7fc6953e6700 1 --2- 172.21.15.8:0/435795011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc69006a350 0x7fc69006a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.086+0000 7fc6953e6700 1 --2- 172.21.15.8:0/435795011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc69006b960 0x7fc690069e60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.086+0000 7fc6953e6700 1 -- 172.21.15.8:0/435795011 >> 172.21.15.8:0/435795011 conn(0x7fc6900f1c90 msgr2=0x7fc6900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.086+0000 7fc6953e6700 1 -- 172.21.15.8:0/435795011 shutdown_connections 2023-10-18T21:16:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.086+0000 7fc6953e6700 1 -- 172.21.15.8:0/435795011 wait complete. 2023-10-18T21:16:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.087+0000 7fc6953e6700 1 Processor -- start 2023-10-18T21:16:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.087+0000 7fc6953e6700 1 -- start start 2023-10-18T21:16:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.087+0000 7fc6953e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc69006a350 0x7fc690108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc6953e6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc69006b960 0x7fc690109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc6953e6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690109a20 con 0x7fc69006b960 2023-10-18T21:16:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc6953e6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690109b60 con 0x7fc69006a350 2023-10-18T21:16:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc68f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc69006b960 0x7fc690109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc68f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc69006b960 0x7fc690109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50950/0 (socket says 172.21.15.8:50950) 2023-10-18T21:16:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc68f7fe700 1 -- 172.21.15.8:0/4122344913 learned_addr learned my addr 172.21.15.8:0/4122344913 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc68ffff700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc69006a350 0x7fc690108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc68f7fe700 1 -- 172.21.15.8:0/4122344913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc69006a350 msgr2=0x7fc690108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc68f7fe700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc69006a350 0x7fc690108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc68f7fe700 1 -- 172.21.15.8:0/4122344913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680005040 con 0x7fc69006b960 2023-10-18T21:16:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.088+0000 7fc68f7fe700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc69006b960 0x7fc690109470 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fc6840026d0 tx=0x7fc684009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.090+0000 7fc68cff9700 1 -- 172.21.15.8:0/4122344913 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc684009320 con 0x7fc69006b960 2023-10-18T21:16:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.090+0000 7fc6953e6700 1 -- 172.21.15.8:0/4122344913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69010a500 con 0x7fc69006b960 2023-10-18T21:16:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.090+0000 7fc68cff9700 1 -- 172.21.15.8:0/4122344913 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc68400f040 con 0x7fc69006b960 2023-10-18T21:16:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.090+0000 7fc68cff9700 1 -- 172.21.15.8:0/4122344913 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6840148a0 con 0x7fc69006b960 2023-10-18T21:16:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.090+0000 7fc6953e6700 1 -- 172.21.15.8:0/4122344913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69010aac0 con 0x7fc69006b960 2023-10-18T21:16:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.091+0000 7fc6953e6700 1 -- 172.21.15.8:0/4122344913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc690045ad0 con 0x7fc69006b960 2023-10-18T21:16:26.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.092+0000 7fc68cff9700 1 -- 172.21.15.8:0/4122344913 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc684009480 con 0x7fc69006b960 2023-10-18T21:16:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.093+0000 7fc68cff9700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc678060f70 0x7fc678063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.093+0000 7fc68cff9700 1 -- 172.21.15.8:0/4122344913 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc68407d090 con 0x7fc69006b960 2023-10-18T21:16:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.093+0000 7fc68ffff700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc678060f70 0x7fc678063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.094+0000 7fc68ffff700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc678060f70 0x7fc678063430 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fc680004630 tx=0x7fc680009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.096+0000 7fc68cff9700 1 -- 172.21.15.8:0/4122344913 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc684050670 con 0x7fc69006b960 2023-10-18T21:16:26.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.299+0000 7fc6953e6700 1 -- 172.21.15.8:0/4122344913 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc69010ad40 con 0x7fc678060f70 2023-10-18T21:16:26.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.300+0000 7fc68cff9700 1 -- 172.21.15.8:0/4122344913 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc69010ad40 con 0x7fc678060f70 2023-10-18T21:16:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 -- 172.21.15.8:0/4122344913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc678060f70 msgr2=0x7fc678063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc678060f70 0x7fc678063430 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fc680004630 tx=0x7fc680009b30).stop 2023-10-18T21:16:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 -- 172.21.15.8:0/4122344913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc69006b960 msgr2=0x7fc690109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc69006b960 0x7fc690109470 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fc6840026d0 tx=0x7fc684009de0).stop 2023-10-18T21:16:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 -- 172.21.15.8:0/4122344913 shutdown_connections 2023-10-18T21:16:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc678060f70 0x7fc678063430 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc69006a350 0x7fc690108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 --2- 172.21.15.8:0/4122344913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc69006b960 0x7fc690109470 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 -- 172.21.15.8:0/4122344913 >> 172.21.15.8:0/4122344913 conn(0x7fc6900f1c90 msgr2=0x7fc6900fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:26.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 -- 172.21.15.8:0/4122344913 shutdown_connections 2023-10-18T21:16:26.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.302+0000 7fc6953e6700 1 -- 172.21.15.8:0/4122344913 wait complete. 2023-10-18T21:16:26.317 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:16:26.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.440+0000 7fd7951d9700 1 -- 172.21.15.8:0/1704309107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7900f6530 msgr2=0x7fd7900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:26.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.440+0000 7fd7951d9700 1 --2- 172.21.15.8:0/1704309107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7900f6530 0x7fd7900f6950 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fd780004660 tx=0x7fd780009b30).stop 2023-10-18T21:16:26.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.440+0000 7fd7951d9700 1 -- 172.21.15.8:0/1704309107 shutdown_connections 2023-10-18T21:16:26.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.440+0000 7fd7951d9700 1 --2- 172.21.15.8:0/1704309107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7900f77d0 0x7fd7900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.440+0000 7fd7951d9700 1 --2- 172.21.15.8:0/1704309107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7900f6530 0x7fd7900f6950 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.440+0000 7fd7951d9700 1 -- 172.21.15.8:0/1704309107 >> 172.21.15.8:0/1704309107 conn(0x7fd7900f1c90 msgr2=0x7fd7900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:26.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.440+0000 7fd7951d9700 1 -- 172.21.15.8:0/1704309107 shutdown_connections 2023-10-18T21:16:26.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.440+0000 7fd7951d9700 1 -- 172.21.15.8:0/1704309107 wait complete. 2023-10-18T21:16:26.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.441+0000 7fd7951d9700 1 Processor -- start 2023-10-18T21:16:26.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.441+0000 7fd7951d9700 1 -- start start 2023-10-18T21:16:26.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.442+0000 7fd7951d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7900f6530 0x7fd790108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:26.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.442+0000 7fd7951d9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7900f77d0 0x7fd790109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:26.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.442+0000 7fd7951d9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd790109a00 con 0x7fd7900f6530 2023-10-18T21:16:26.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.442+0000 7fd7951d9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd790109b40 con 0x7fd7900f77d0 2023-10-18T21:16:26.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.442+0000 7fd78ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7900f6530 0x7fd790108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:26.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.442+0000 7fd78ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7900f6530 0x7fd790108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50966/0 (socket says 172.21.15.8:50966) 2023-10-18T21:16:26.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.442+0000 7fd78ffff700 1 -- 172.21.15.8:0/3264940213 learned_addr learned my addr 172.21.15.8:0/3264940213 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:26.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.442+0000 7fd78ffff700 1 -- 172.21.15.8:0/3264940213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7900f77d0 msgr2=0x7fd790109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:26.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.442+0000 7fd78f7fe700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7900f77d0 0x7fd790109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.442+0000 7fd78ffff700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7900f77d0 0x7fd790109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.443+0000 7fd78ffff700 1 -- 172.21.15.8:0/3264940213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780005040 con 0x7fd7900f6530 2023-10-18T21:16:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.443+0000 7fd78f7fe700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7900f77d0 0x7fd790109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:16:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.443+0000 7fd78ffff700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7900f6530 0x7fd790108f60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fd780007a60 tx=0x7fd780009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.443+0000 7fd78cff9700 1 -- 172.21.15.8:0/3264940213 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd780018070 con 0x7fd7900f6530 2023-10-18T21:16:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.443+0000 7fd78cff9700 1 -- 172.21.15.8:0/3264940213 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd780009630 con 0x7fd7900f6530 2023-10-18T21:16:26.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.443+0000 7fd7951d9700 1 -- 172.21.15.8:0/3264940213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79010a480 con 0x7fd7900f6530 2023-10-18T21:16:26.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.443+0000 7fd78cff9700 1 -- 172.21.15.8:0/3264940213 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd78001c540 con 0x7fd7900f6530 2023-10-18T21:16:26.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.443+0000 7fd7951d9700 1 -- 172.21.15.8:0/3264940213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79010a9e0 con 0x7fd7900f6530 2023-10-18T21:16:26.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.444+0000 7fd7951d9700 1 -- 172.21.15.8:0/3264940213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd790045ad0 con 0x7fd7900f6530 2023-10-18T21:16:26.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.445+0000 7fd78cff9700 1 -- 172.21.15.8:0/3264940213 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd78001c7b0 con 0x7fd7900f6530 2023-10-18T21:16:26.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.446+0000 7fd78cff9700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd778060f70 0x7fd778063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:26.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.446+0000 7fd78cff9700 1 -- 172.21.15.8:0/3264940213 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd78007e760 con 0x7fd7900f6530 2023-10-18T21:16:26.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.446+0000 7fd78f7fe700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd778060f70 0x7fd778063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:26.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.447+0000 7fd78f7fe700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd778060f70 0x7fd778063430 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fd784009880 tx=0x7fd78400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:26.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.450+0000 7fd78cff9700 1 -- 172.21.15.8:0/3264940213 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd780051d40 con 0x7fd7900f6530 2023-10-18T21:16:26.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.647+0000 7fd7951d9700 1 -- 172.21.15.8:0/3264940213 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7900fee00 con 0x7fd778060f70 2023-10-18T21:16:26.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.648+0000 7fd78cff9700 1 -- 172.21.15.8:0/3264940213 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd7900fee00 con 0x7fd778060f70 2023-10-18T21:16:26.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.650+0000 7fd7951d9700 1 -- 172.21.15.8:0/3264940213 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd778060f70 msgr2=0x7fd778063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:26.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.650+0000 7fd7951d9700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd778060f70 0x7fd778063430 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fd784009880 tx=0x7fd78400b040).stop 2023-10-18T21:16:26.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.650+0000 7fd7951d9700 1 -- 172.21.15.8:0/3264940213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7900f6530 msgr2=0x7fd790108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:26.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.650+0000 7fd7951d9700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7900f6530 0x7fd790108f60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fd780007a60 tx=0x7fd780009b30).stop 2023-10-18T21:16:26.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.650+0000 7fd7951d9700 1 -- 172.21.15.8:0/3264940213 shutdown_connections 2023-10-18T21:16:26.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.650+0000 7fd7951d9700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd778060f70 0x7fd778063430 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.650+0000 7fd7951d9700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7900f6530 0x7fd790108f60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.650+0000 7fd7951d9700 1 --2- 172.21.15.8:0/3264940213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7900f77d0 0x7fd790109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.650+0000 7fd7951d9700 1 -- 172.21.15.8:0/3264940213 >> 172.21.15.8:0/3264940213 conn(0x7fd7900f1c90 msgr2=0x7fd79006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:26.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.651+0000 7fd7951d9700 1 -- 172.21.15.8:0/3264940213 shutdown_connections 2023-10-18T21:16:26.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.651+0000 7fd7951d9700 1 -- 172.21.15.8:0/3264940213 wait complete. 2023-10-18T21:16:26.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.788+0000 7fb0fb59e700 1 -- 172.21.15.8:0/3311840442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0fc0f6530 msgr2=0x7fb0fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:26.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.788+0000 7fb0fb59e700 1 --2- 172.21.15.8:0/3311840442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0fc0f6530 0x7fb0fc0f6950 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fb0ec004660 tx=0x7fb0ec009b30).stop 2023-10-18T21:16:26.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.788+0000 7fb0fb59e700 1 -- 172.21.15.8:0/3311840442 shutdown_connections 2023-10-18T21:16:26.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.788+0000 7fb0fb59e700 1 --2- 172.21.15.8:0/3311840442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0fc0f77d0 0x7fb0fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.788+0000 7fb0fb59e700 1 --2- 172.21.15.8:0/3311840442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0fc0f6530 0x7fb0fc0f6950 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.788+0000 7fb0fb59e700 1 -- 172.21.15.8:0/3311840442 >> 172.21.15.8:0/3311840442 conn(0x7fb0fc0f1c90 msgr2=0x7fb0fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:26.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.788+0000 7fb0fb59e700 1 -- 172.21.15.8:0/3311840442 shutdown_connections 2023-10-18T21:16:26.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.788+0000 7fb0fb59e700 1 -- 172.21.15.8:0/3311840442 wait complete. 2023-10-18T21:16:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.789+0000 7fb0fb59e700 1 Processor -- start 2023-10-18T21:16:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.789+0000 7fb0fb59e700 1 -- start start 2023-10-18T21:16:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.789+0000 7fb0fb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0fc0f6530 0x7fb0fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.789+0000 7fb0fb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0fc0f77d0 0x7fb0fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.789+0000 7fb0fb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc06a380 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.789+0000 7fb0fb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc06a4c0 con 0x7fb0fc0f6530 2023-10-18T21:16:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.790+0000 7fb0f9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0fc0f77d0 0x7fb0fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.790+0000 7fb0f9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0fc0f77d0 0x7fb0fc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50970/0 (socket says 172.21.15.8:50970) 2023-10-18T21:16:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.790+0000 7fb0f9d9b700 1 -- 172.21.15.8:0/1460069911 learned_addr learned my addr 172.21.15.8:0/1460069911 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.790+0000 7fb0fa59c700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0fc0f6530 0x7fb0fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.790+0000 7fb0f9d9b700 1 -- 172.21.15.8:0/1460069911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0fc0f6530 msgr2=0x7fb0fc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:26.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.790+0000 7fb0f9d9b700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0fc0f6530 0x7fb0fc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:26.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.790+0000 7fb0f9d9b700 1 -- 172.21.15.8:0/1460069911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec005040 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.790+0000 7fb0f9d9b700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0fc0f77d0 0x7fb0fc069e20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fb0f00026d0 tx=0x7fb0f0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:26.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.791+0000 7fb0eaffd700 1 -- 172.21.15.8:0/1460069911 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f00079c0 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.791+0000 7fb0eaffd700 1 -- 172.21.15.8:0/1460069911 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb0f000f040 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.791+0000 7fb0eaffd700 1 -- 172.21.15.8:0/1460069911 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f0014980 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.791+0000 7fb0fb59e700 1 -- 172.21.15.8:0/1460069911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc06a7a0 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.791+0000 7fb0fb59e700 1 -- 172.21.15.8:0/1460069911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc10edd0 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.792+0000 7fb0fb59e700 1 -- 172.21.15.8:0/1460069911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc045ad0 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.793+0000 7fb0eaffd700 1 -- 172.21.15.8:0/1460069911 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb0f00090d0 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.794+0000 7fb0eaffd700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0e4060f70 0x7fb0e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.794+0000 7fb0eaffd700 1 -- 172.21.15.8:0/1460069911 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb0f007c8a0 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.794+0000 7fb0fa59c700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0e4060f70 0x7fb0e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.794+0000 7fb0fa59c700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0e4060f70 0x7fb0e4063430 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fb0ec005010 tx=0x7fb0ec009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.798+0000 7fb0eaffd700 1 -- 172.21.15.8:0/1460069911 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb0f004c580 con 0x7fb0fc0f77d0 2023-10-18T21:16:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:25.030498+0000 mgr.smithi008.flmjzp (mgr.14640) 1057 : cluster [DBG] pgmap v742: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:26.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:25.030498+0000 mgr.smithi008.flmjzp (mgr.14640) 1057 : cluster [DBG] pgmap v742: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:26.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.989+0000 7fb0fb59e700 1 -- 172.21.15.8:0/1460069911 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0fc057f10 con 0x7fb0e4060f70 2023-10-18T21:16:26.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:26.999+0000 7fb0eaffd700 1 -- 172.21.15.8:0/1460069911 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb0fc057f10 con 0x7fb0e4060f70 2023-10-18T21:16:27.000 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:16:27.000 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (23m) 65s ago 24m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:16:27.000 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (16m) 65s ago 24m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:16:27.000 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (16m) 9m ago 23m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:16:27.000 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (23m) 65s ago 24m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:16:27.000 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 65s ago 20m - - 2023-10-18T21:16:27.001 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 65s ago 20m - - 2023-10-18T21:16:27.001 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (9m) 9m ago 20m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:16:27.001 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (9m) 9m ago 20m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:16:27.001 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (18m) 65s ago 25m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:16:27.001 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (17m) 9m ago 23m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:16:27.001 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (17m) 65s ago 26m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:16:27.002 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (17m) 9m ago 23m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:16:27.002 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (24m) 65s ago 24m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:16:27.002 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (23m) 9m ago 23m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:16:27.002 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (16m) 65s ago 23m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:16:27.002 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (14m) 65s ago 22m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:16:27.003 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (14m) 65s ago 22m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:16:27.003 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (13m) 9m ago 22m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:16:27.003 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (13m) 9m ago 21m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:16:27.003 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (12m) 9m ago 21m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:16:27.003 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (18m) 65s ago 23m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:16:27.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.000+0000 7fb0fb59e700 1 -- 172.21.15.8:0/1460069911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0e4060f70 msgr2=0x7fb0e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.000+0000 7fb0fb59e700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0e4060f70 0x7fb0e4063430 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fb0ec005010 tx=0x7fb0ec009b30).stop 2023-10-18T21:16:27.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.000+0000 7fb0fb59e700 1 -- 172.21.15.8:0/1460069911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0fc0f77d0 msgr2=0x7fb0fc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.000+0000 7fb0fb59e700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0fc0f77d0 0x7fb0fc069e20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fb0f00026d0 tx=0x7fb0f0009de0).stop 2023-10-18T21:16:27.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.001+0000 7fb0fb59e700 1 -- 172.21.15.8:0/1460069911 shutdown_connections 2023-10-18T21:16:27.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.001+0000 7fb0fb59e700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0e4060f70 0x7fb0e4063430 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.001+0000 7fb0fb59e700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0fc0f6530 0x7fb0fc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.001+0000 7fb0fb59e700 1 --2- 172.21.15.8:0/1460069911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0fc0f77d0 0x7fb0fc069e20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.001+0000 7fb0fb59e700 1 -- 172.21.15.8:0/1460069911 >> 172.21.15.8:0/1460069911 conn(0x7fb0fc0f1c90 msgr2=0x7fb0fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:27.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.001+0000 7fb0fb59e700 1 -- 172.21.15.8:0/1460069911 shutdown_connections 2023-10-18T21:16:27.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.001+0000 7fb0fb59e700 1 -- 172.21.15.8:0/1460069911 wait complete. 2023-10-18T21:16:27.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.140+0000 7f994c8aa700 1 -- 172.21.15.8:0/2864794135 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9944013a50 con 0x7f99480f6530 2023-10-18T21:16:27.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.141+0000 7f994e8ae700 1 -- 172.21.15.8:0/2864794135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99480f6530 msgr2=0x7f99480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.141+0000 7f994e8ae700 1 --2- 172.21.15.8:0/2864794135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99480f6530 0x7f99480f6950 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f9944004660 tx=0x7f9944009b30).stop 2023-10-18T21:16:27.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.141+0000 7f994e8ae700 1 -- 172.21.15.8:0/2864794135 shutdown_connections 2023-10-18T21:16:27.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.141+0000 7f994e8ae700 1 --2- 172.21.15.8:0/2864794135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99480f77d0 0x7f99480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.141+0000 7f994e8ae700 1 --2- 172.21.15.8:0/2864794135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99480f6530 0x7f99480f6950 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.141+0000 7f994e8ae700 1 -- 172.21.15.8:0/2864794135 >> 172.21.15.8:0/2864794135 conn(0x7f99480f1c90 msgr2=0x7f99480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:27.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.141+0000 7f994e8ae700 1 -- 172.21.15.8:0/2864794135 shutdown_connections 2023-10-18T21:16:27.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.141+0000 7f994e8ae700 1 -- 172.21.15.8:0/2864794135 wait complete. 2023-10-18T21:16:27.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.142+0000 7f994e8ae700 1 Processor -- start 2023-10-18T21:16:27.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.142+0000 7f994e8ae700 1 -- start start 2023-10-18T21:16:27.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.142+0000 7f994e8ae700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99480f6530 0x7f994810d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:27.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.142+0000 7f994e8ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99480f77d0 0x7f994810d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:27.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.142+0000 7f994e8ae700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994810ddb0 con 0x7f99480f6530 2023-10-18T21:16:27.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.142+0000 7f994e8ae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994810def0 con 0x7f99480f77d0 2023-10-18T21:16:27.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.143+0000 7f994d8ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99480f6530 0x7f994810d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:27.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.143+0000 7f994d8ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99480f6530 0x7f994810d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47056/0 (socket says 172.21.15.8:47056) 2023-10-18T21:16:27.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.143+0000 7f994d8ac700 1 -- 172.21.15.8:0/1810464639 learned_addr learned my addr 172.21.15.8:0/1810464639 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:27.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.143+0000 7f994d0ab700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99480f77d0 0x7f994810d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:27.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.143+0000 7f994d8ac700 1 -- 172.21.15.8:0/1810464639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99480f77d0 msgr2=0x7f994810d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.143+0000 7f994d8ac700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99480f77d0 0x7f994810d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.143+0000 7f994d8ac700 1 -- 172.21.15.8:0/1810464639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9944005040 con 0x7f99480f6530 2023-10-18T21:16:27.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.143+0000 7f994d8ac700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99480f6530 0x7f994810d310 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f9944014040 tx=0x7f994400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:27.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.143+0000 7f993e7fc700 1 -- 172.21.15.8:0/1810464639 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9944019070 con 0x7f99480f6530 2023-10-18T21:16:27.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.144+0000 7f993e7fc700 1 -- 172.21.15.8:0/1810464639 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f994401e420 con 0x7f99480f6530 2023-10-18T21:16:27.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.144+0000 7f994e8ae700 1 -- 172.21.15.8:0/1810464639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994810e830 con 0x7f99480f6530 2023-10-18T21:16:27.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.144+0000 7f993e7fc700 1 -- 172.21.15.8:0/1810464639 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9944014620 con 0x7f99480f6530 2023-10-18T21:16:27.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.144+0000 7f994e8ae700 1 -- 172.21.15.8:0/1810464639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994810ed10 con 0x7f99480f6530 2023-10-18T21:16:27.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.145+0000 7f994e8ae700 1 -- 172.21.15.8:0/1810464639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9948045ad0 con 0x7f99480f6530 2023-10-18T21:16:27.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.146+0000 7f993e7fc700 1 -- 172.21.15.8:0/1810464639 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f994401e9e0 con 0x7f99480f6530 2023-10-18T21:16:27.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.146+0000 7f993e7fc700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9934060f70 0x7f9934063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:27.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.146+0000 7f993e7fc700 1 -- 172.21.15.8:0/1810464639 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f994407dd80 con 0x7f99480f6530 2023-10-18T21:16:27.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.147+0000 7f994d0ab700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9934060f70 0x7f9934063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:27.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.147+0000 7f994d0ab700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9934060f70 0x7f9934063430 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f9938009fd0 tx=0x7f993800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:27.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.151+0000 7f993e7fc700 1 -- 172.21.15.8:0/1810464639 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9944051360 con 0x7f99480f6530 2023-10-18T21:16:27.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.404+0000 7f994e8ae700 1 -- 172.21.15.8:0/1810464639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9948027a00 con 0x7f99480f6530 2023-10-18T21:16:27.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.405+0000 7f993e7fc700 1 -- 172.21.15.8:0/1810464639 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f9944050f50 con 0x7f99480f6530 2023-10-18T21:16:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:16:27.406 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:16:27.406 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:16:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:16:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:16:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:16:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:16:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:16:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:16:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:16:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:16:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:16:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:16:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:16:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:16:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:16:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:16:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 -- 172.21.15.8:0/1810464639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9934060f70 msgr2=0x7f9934063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9934060f70 0x7f9934063430 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f9938009fd0 tx=0x7f993800b040).stop 2023-10-18T21:16:27.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 -- 172.21.15.8:0/1810464639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99480f6530 msgr2=0x7f994810d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99480f6530 0x7f994810d310 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f9944014040 tx=0x7f994400b040).stop 2023-10-18T21:16:27.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 -- 172.21.15.8:0/1810464639 shutdown_connections 2023-10-18T21:16:27.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9934060f70 0x7f9934063430 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99480f6530 0x7f994810d310 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 --2- 172.21.15.8:0/1810464639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99480f77d0 0x7f994810d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 -- 172.21.15.8:0/1810464639 >> 172.21.15.8:0/1810464639 conn(0x7f99480f1c90 msgr2=0x7f99480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:27.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 -- 172.21.15.8:0/1810464639 shutdown_connections 2023-10-18T21:16:27.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.407+0000 7f994e8ae700 1 -- 172.21.15.8:0/1810464639 wait complete. 2023-10-18T21:16:27.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.545+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/2577584131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf780f6530 msgr2=0x7fbf780f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.545+0000 7fbf7d7b1700 1 --2- 172.21.15.8:0/2577584131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf780f6530 0x7fbf780f6950 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fbf68004660 tx=0x7fbf68009b30).stop 2023-10-18T21:16:27.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.545+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/2577584131 shutdown_connections 2023-10-18T21:16:27.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.545+0000 7fbf7d7b1700 1 --2- 172.21.15.8:0/2577584131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf780f77d0 0x7fbf780f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.545+0000 7fbf7d7b1700 1 --2- 172.21.15.8:0/2577584131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf780f6530 0x7fbf780f6950 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.545+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/2577584131 >> 172.21.15.8:0/2577584131 conn(0x7fbf780f1c90 msgr2=0x7fbf780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:27.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.545+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/2577584131 shutdown_connections 2023-10-18T21:16:27.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.545+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/2577584131 wait complete. 2023-10-18T21:16:27.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.546+0000 7fbf7d7b1700 1 Processor -- start 2023-10-18T21:16:27.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.546+0000 7fbf7d7b1700 1 -- start start 2023-10-18T21:16:27.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf7d7b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf780f6530 0x7fbf78106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:27.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf7d7b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf780f77d0 0x7fbf78107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:27.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf7d7b1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf78107910 con 0x7fbf780f77d0 2023-10-18T21:16:27.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf7d7b1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf78108120 con 0x7fbf780f6530 2023-10-18T21:16:27.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf777fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf780f77d0 0x7fbf78107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:27.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf777fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf780f77d0 0x7fbf78107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47078/0 (socket says 172.21.15.8:47078) 2023-10-18T21:16:27.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf777fe700 1 -- 172.21.15.8:0/3745677822 learned_addr learned my addr 172.21.15.8:0/3745677822 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:27.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf77fff700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf780f6530 0x7fbf78106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:27.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf777fe700 1 -- 172.21.15.8:0/3745677822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf780f6530 msgr2=0x7fbf78106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf777fe700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf780f6530 0x7fbf78106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.547+0000 7fbf777fe700 1 -- 172.21.15.8:0/3745677822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf68005040 con 0x7fbf780f77d0 2023-10-18T21:16:27.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.548+0000 7fbf777fe700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf780f77d0 0x7fbf78107310 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbf6c0026d0 tx=0x7fbf6c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:27.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.548+0000 7fbf74ff9700 1 -- 172.21.15.8:0/3745677822 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf6c009320 con 0x7fbf780f77d0 2023-10-18T21:16:27.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.548+0000 7fbf74ff9700 1 -- 172.21.15.8:0/3745677822 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbf6c00f040 con 0x7fbf780f77d0 2023-10-18T21:16:27.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.548+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/3745677822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf781083a0 con 0x7fbf780f77d0 2023-10-18T21:16:27.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.548+0000 7fbf74ff9700 1 -- 172.21.15.8:0/3745677822 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf6c0148a0 con 0x7fbf780f77d0 2023-10-18T21:16:27.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.548+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/3745677822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf78108960 con 0x7fbf780f77d0 2023-10-18T21:16:27.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.549+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/3745677822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf78059100 con 0x7fbf780f77d0 2023-10-18T21:16:27.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.550+0000 7fbf74ff9700 1 -- 172.21.15.8:0/3745677822 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbf6c009480 con 0x7fbf780f77d0 2023-10-18T21:16:27.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.551+0000 7fbf74ff9700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf60060f70 0x7fbf60063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:27.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.551+0000 7fbf74ff9700 1 -- 172.21.15.8:0/3745677822 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbf6c07d090 con 0x7fbf780f77d0 2023-10-18T21:16:27.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.551+0000 7fbf77fff700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf60060f70 0x7fbf60063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:27.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.552+0000 7fbf77fff700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf60060f70 0x7fbf60063430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fbf68005010 tx=0x7fbf68009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:27.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.555+0000 7fbf74ff9700 1 -- 172.21.15.8:0/3745677822 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbf6c04cc40 con 0x7fbf780f77d0 2023-10-18T21:16:27.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.781+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/3745677822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbf78027a00 con 0x7fbf780f77d0 2023-10-18T21:16:27.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.782+0000 7fbf74ff9700 1 -- 172.21.15.8:0/3745677822 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fbf6c0181b0 con 0x7fbf780f77d0 2023-10-18T21:16:27.783 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:16:27.783 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:16:27.784 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:16:27.784 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:16:27.784 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:16:27.784 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:16:27.784 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:16:27.785 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:16:27.785 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:16:27.785 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:16:27.785 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:16:27.785 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:16:27.786 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:16:27.786 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:16:27.786 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:16:27.786 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:16:27.786 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:16:27.786 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:16:27.787 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:16:27.787 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:16:27.787 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:16:27.787 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:16:27.787 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:16:27.788 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:16:27.788 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:16:27.788 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:16:27.788 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:16:27.788 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:16:27.788 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:16:27.789 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:16:27.789 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:16:27.789 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:16:27.789 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:16:27.789 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:16:27.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/3745677822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf60060f70 msgr2=0x7fbf60063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf60060f70 0x7fbf60063430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fbf68005010 tx=0x7fbf68009b30).stop 2023-10-18T21:16:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/3745677822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf780f77d0 msgr2=0x7fbf78107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf780f77d0 0x7fbf78107310 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbf6c0026d0 tx=0x7fbf6c009de0).stop 2023-10-18T21:16:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/3745677822 shutdown_connections 2023-10-18T21:16:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf60060f70 0x7fbf60063430 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf780f6530 0x7fbf78106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 --2- 172.21.15.8:0/3745677822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf780f77d0 0x7fbf78107310 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/3745677822 >> 172.21.15.8:0/3745677822 conn(0x7fbf780f1c90 msgr2=0x7fbf780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/3745677822 shutdown_connections 2023-10-18T21:16:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.784+0000 7fbf7d7b1700 1 -- 172.21.15.8:0/3745677822 wait complete. 2023-10-18T21:16:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:16:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:26.300320+0000 mgr.smithi008.flmjzp (mgr.14640) 1058 : audit [DBG] from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:16:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:26.648689+0000 mgr.smithi008.flmjzp (mgr.14640) 1059 : audit [DBG] from='client.35056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:16:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:27.405235+0000 mon.smithi008 (mon.0) 1525 : audit [DBG] from='client.? 172.21.15.8:0/1810464639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:27.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.923+0000 7f49c2a21700 1 -- 172.21.15.8:0/1168672809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49bc0f6530 msgr2=0x7f49bc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.923+0000 7f49c2a21700 1 --2- 172.21.15.8:0/1168672809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49bc0f6530 0x7f49bc0f6950 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f49b8004660 tx=0x7f49b8009b30).stop 2023-10-18T21:16:27.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.924+0000 7f49c2a21700 1 -- 172.21.15.8:0/1168672809 shutdown_connections 2023-10-18T21:16:27.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.924+0000 7f49c2a21700 1 --2- 172.21.15.8:0/1168672809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0f77d0 0x7f49bc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.924+0000 7f49c2a21700 1 --2- 172.21.15.8:0/1168672809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49bc0f6530 0x7f49bc0f6950 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.924+0000 7f49c2a21700 1 -- 172.21.15.8:0/1168672809 >> 172.21.15.8:0/1168672809 conn(0x7f49bc0f1c90 msgr2=0x7f49bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:27.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.924+0000 7f49c2a21700 1 -- 172.21.15.8:0/1168672809 shutdown_connections 2023-10-18T21:16:27.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.924+0000 7f49c2a21700 1 -- 172.21.15.8:0/1168672809 wait complete. 2023-10-18T21:16:27.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.925+0000 7f49c2a21700 1 Processor -- start 2023-10-18T21:16:27.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.925+0000 7f49c2a21700 1 -- start start 2023-10-18T21:16:27.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c2a21700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0f6530 0x7f49bc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:27.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c2a21700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49bc0f77d0 0x7f49bc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:27.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c2a21700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc06a380 con 0x7f49bc0f77d0 2023-10-18T21:16:27.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c2a21700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc06a4c0 con 0x7f49bc0f6530 2023-10-18T21:16:27.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c121e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49bc0f77d0 0x7f49bc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:27.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c121e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49bc0f77d0 0x7f49bc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47098/0 (socket says 172.21.15.8:47098) 2023-10-18T21:16:27.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c121e700 1 -- 172.21.15.8:0/1255358018 learned_addr learned my addr 172.21.15.8:0/1255358018 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:27.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c1a1f700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0f6530 0x7f49bc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:27.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c121e700 1 -- 172.21.15.8:0/1255358018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0f6530 msgr2=0x7f49bc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:27.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c121e700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0f6530 0x7f49bc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:27.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c121e700 1 -- 172.21.15.8:0/1255358018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b8005040 con 0x7f49bc0f77d0 2023-10-18T21:16:27.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.926+0000 7f49c1a1f700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0f6530 0x7f49bc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:16:27.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.927+0000 7f49c121e700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49bc0f77d0 0x7f49bc069e20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f49ac0026d0 tx=0x7f49ac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.927+0000 7f49b27fc700 1 -- 172.21.15.8:0/1255358018 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49ac009320 con 0x7f49bc0f77d0 2023-10-18T21:16:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.927+0000 7f49b27fc700 1 -- 172.21.15.8:0/1255358018 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f49ac00f040 con 0x7f49bc0f77d0 2023-10-18T21:16:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.927+0000 7f49b27fc700 1 -- 172.21.15.8:0/1255358018 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49ac0148a0 con 0x7f49bc0f77d0 2023-10-18T21:16:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.927+0000 7f49c2a21700 1 -- 172.21.15.8:0/1255358018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc06a7a0 con 0x7f49bc0f77d0 2023-10-18T21:16:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.927+0000 7f49c2a21700 1 -- 172.21.15.8:0/1255358018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc10ede0 con 0x7f49bc0f77d0 2023-10-18T21:16:27.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.928+0000 7f49c2a21700 1 -- 172.21.15.8:0/1255358018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc045ad0 con 0x7f49bc0f77d0 2023-10-18T21:16:27.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.929+0000 7f49b27fc700 1 -- 172.21.15.8:0/1255358018 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f49ac009480 con 0x7f49bc0f77d0 2023-10-18T21:16:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.930+0000 7f49b27fc700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49a8060f70 0x7f49a8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.930+0000 7f49b27fc700 1 -- 172.21.15.8:0/1255358018 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f49ac07cf60 con 0x7f49bc0f77d0 2023-10-18T21:16:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.930+0000 7f49c1a1f700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49a8060f70 0x7f49a8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.931+0000 7f49c1a1f700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49a8060f70 0x7f49a8063430 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f49b8004630 tx=0x7f49b8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:27.934+0000 7f49b27fc700 1 -- 172.21.15.8:0/1255358018 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f49ac04cb90 con 0x7f49bc0f77d0 2023-10-18T21:16:27.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:26.300320+0000 mgr.smithi008.flmjzp (mgr.14640) 1058 : audit [DBG] from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:16:27.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:26.648689+0000 mgr.smithi008.flmjzp (mgr.14640) 1059 : audit [DBG] from='client.35056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:16:27.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:27.405235+0000 mon.smithi008 (mon.0) 1525 : audit [DBG] from='client.? 172.21.15.8:0/1810464639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:28.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.131+0000 7f49c2a21700 1 -- 172.21.15.8:0/1255358018 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49bc057f10 con 0x7f49a8060f70 2023-10-18T21:16:28.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.132+0000 7f49b27fc700 1 -- 172.21.15.8:0/1255358018 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f49bc057f10 con 0x7f49a8060f70 2023-10-18T21:16:28.133 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:16:28.133 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:16:28.134 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:16:28.134 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:16:28.134 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:16:28.134 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:16:28.134 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:16:28.135 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:16:28.135 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:16:28.135 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:16:28.135 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "14/21 daemons upgraded", 2023-10-18T21:16:28.135 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:16:28.136 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:16:28.136 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:16:28.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.134+0000 7f49c2a21700 1 -- 172.21.15.8:0/1255358018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49a8060f70 msgr2=0x7f49a8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:28.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.134+0000 7f49c2a21700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49a8060f70 0x7f49a8063430 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f49b8004630 tx=0x7f49b8009b30).stop 2023-10-18T21:16:28.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.134+0000 7f49c2a21700 1 -- 172.21.15.8:0/1255358018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49bc0f77d0 msgr2=0x7f49bc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:28.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.134+0000 7f49c2a21700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49bc0f77d0 0x7f49bc069e20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f49ac0026d0 tx=0x7f49ac009de0).stop 2023-10-18T21:16:28.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.135+0000 7f49c2a21700 1 -- 172.21.15.8:0/1255358018 shutdown_connections 2023-10-18T21:16:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.135+0000 7f49c2a21700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49a8060f70 0x7f49a8063430 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.135+0000 7f49c2a21700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0f6530 0x7f49bc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.135+0000 7f49c2a21700 1 --2- 172.21.15.8:0/1255358018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49bc0f77d0 0x7f49bc069e20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.135+0000 7f49c2a21700 1 -- 172.21.15.8:0/1255358018 >> 172.21.15.8:0/1255358018 conn(0x7f49bc0f1c90 msgr2=0x7f49bc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.135+0000 7f49c2a21700 1 -- 172.21.15.8:0/1255358018 shutdown_connections 2023-10-18T21:16:28.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:28.135+0000 7f49c2a21700 1 -- 172.21.15.8:0/1255358018 wait complete. 2023-10-18T21:16:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:26.990484+0000 mgr.smithi008.flmjzp (mgr.14640) 1060 : audit [DBG] from='client.35060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:16:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:27.031048+0000 mgr.smithi008.flmjzp (mgr.14640) 1061 : cluster [DBG] pgmap v743: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:27.782429+0000 mon.smithi008 (mon.0) 1526 : audit [DBG] from='client.? 172.21.15.8:0/3745677822' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:16:28.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:26.990484+0000 mgr.smithi008.flmjzp (mgr.14640) 1060 : audit [DBG] from='client.35060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:16:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:27.031048+0000 mgr.smithi008.flmjzp (mgr.14640) 1061 : cluster [DBG] pgmap v743: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:27.782429+0000 mon.smithi008 (mon.0) 1526 : audit [DBG] from='client.? 172.21.15.8:0/3745677822' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:16:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:28.132670+0000 mgr.smithi008.flmjzp (mgr.14640) 1062 : audit [DBG] from='client.35072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:16:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:28.132670+0000 mgr.smithi008.flmjzp (mgr.14640) 1062 : audit [DBG] from='client.35072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:16:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:29.031710+0000 mgr.smithi008.flmjzp (mgr.14640) 1063 : cluster [DBG] pgmap v744: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:30.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:29.031710+0000 mgr.smithi008.flmjzp (mgr.14640) 1063 : cluster [DBG] pgmap v744: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:31.032348+0000 mgr.smithi008.flmjzp (mgr.14640) 1064 : cluster [DBG] pgmap v745: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:32.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:31.032348+0000 mgr.smithi008.flmjzp (mgr.14640) 1064 : cluster [DBG] pgmap v745: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:33.063631+0000 mon.smithi008 (mon.0) 1527 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:33.065847+0000 mon.smithi008 (mon.0) 1528 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:33.066844+0000 mon.smithi008 (mon.0) 1529 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:33.073233+0000 mon.smithi008 (mon.0) 1530 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:33.079736+0000 mon.smithi008 (mon.0) 1531 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:33.082769+0000 mon.smithi008 (mon.0) 1532 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:33.084485+0000 mon.smithi008 (mon.0) 1533 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:33.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:33.086161+0000 mon.smithi008 (mon.0) 1534 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:33.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:33.088797+0000 mon.smithi008 (mon.0) 1535 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:33.063631+0000 mon.smithi008 (mon.0) 1527 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:33.065847+0000 mon.smithi008 (mon.0) 1528 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:33.066844+0000 mon.smithi008 (mon.0) 1529 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:33.073233+0000 mon.smithi008 (mon.0) 1530 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:33.079736+0000 mon.smithi008 (mon.0) 1531 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:33.082769+0000 mon.smithi008 (mon.0) 1532 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:33.084485+0000 mon.smithi008 (mon.0) 1533 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:33.086161+0000 mon.smithi008 (mon.0) 1534 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:33.088797+0000 mon.smithi008 (mon.0) 1535 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:33.032816+0000 mgr.smithi008.flmjzp (mgr.14640) 1065 : cluster [DBG] pgmap v746: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:33.067678+0000 mgr.smithi008.flmjzp (mgr.14640) 1066 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:33.068261+0000 mgr.smithi008.flmjzp (mgr.14640) 1067 : cluster [DBG] pgmap v747: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:33.068609+0000 mgr.smithi008.flmjzp (mgr.14640) 1068 : cluster [DBG] pgmap v748: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:33.090953+0000 mgr.smithi008.flmjzp (mgr.14640) 1069 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:33.032816+0000 mgr.smithi008.flmjzp (mgr.14640) 1065 : cluster [DBG] pgmap v746: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:33.067678+0000 mgr.smithi008.flmjzp (mgr.14640) 1066 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:33.068261+0000 mgr.smithi008.flmjzp (mgr.14640) 1067 : cluster [DBG] pgmap v747: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:33.068609+0000 mgr.smithi008.flmjzp (mgr.14640) 1068 : cluster [DBG] pgmap v748: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:33.090953+0000 mgr.smithi008.flmjzp (mgr.14640) 1069 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:35.069150+0000 mgr.smithi008.flmjzp (mgr.14640) 1070 : cluster [DBG] pgmap v749: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:36.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:35.069150+0000 mgr.smithi008.flmjzp (mgr.14640) 1070 : cluster [DBG] pgmap v749: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:38.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:37.069797+0000 mgr.smithi008.flmjzp (mgr.14640) 1071 : cluster [DBG] pgmap v750: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:38.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:37.069797+0000 mgr.smithi008.flmjzp (mgr.14640) 1071 : cluster [DBG] pgmap v750: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:39.070392+0000 mgr.smithi008.flmjzp (mgr.14640) 1072 : cluster [DBG] pgmap v751: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:40.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:39.070392+0000 mgr.smithi008.flmjzp (mgr.14640) 1072 : cluster [DBG] pgmap v751: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:42.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:41.071141+0000 mgr.smithi008.flmjzp (mgr.14640) 1073 : cluster [DBG] pgmap v752: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:42.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:41.071141+0000 mgr.smithi008.flmjzp (mgr.14640) 1073 : cluster [DBG] pgmap v752: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:43.101835+0000 mon.smithi008 (mon.0) 1536 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:43.104065+0000 mon.smithi008 (mon.0) 1537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:43.105124+0000 mon.smithi008 (mon.0) 1538 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:43.111941+0000 mon.smithi008 (mon.0) 1539 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:43.118672+0000 mon.smithi008 (mon.0) 1540 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:43.121824+0000 mon.smithi008 (mon.0) 1541 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:43.123534+0000 mon.smithi008 (mon.0) 1542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:43.125168+0000 mon.smithi008 (mon.0) 1543 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:43.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:43.127180+0000 mon.smithi008 (mon.0) 1544 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:43.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:43.101835+0000 mon.smithi008 (mon.0) 1536 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:43.104065+0000 mon.smithi008 (mon.0) 1537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:43.105124+0000 mon.smithi008 (mon.0) 1538 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:43.111941+0000 mon.smithi008 (mon.0) 1539 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:43.118672+0000 mon.smithi008 (mon.0) 1540 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:43.121824+0000 mon.smithi008 (mon.0) 1541 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:43.123534+0000 mon.smithi008 (mon.0) 1542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:43.125168+0000 mon.smithi008 (mon.0) 1543 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:43.127180+0000 mon.smithi008 (mon.0) 1544 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:43.071728+0000 mgr.smithi008.flmjzp (mgr.14640) 1074 : cluster [DBG] pgmap v753: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:43.106074+0000 mgr.smithi008.flmjzp (mgr.14640) 1075 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:43.106639+0000 mgr.smithi008.flmjzp (mgr.14640) 1076 : cluster [DBG] pgmap v754: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:44.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:43.106964+0000 mgr.smithi008.flmjzp (mgr.14640) 1077 : cluster [DBG] pgmap v755: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:44.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:43.129173+0000 mgr.smithi008.flmjzp (mgr.14640) 1078 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:43.071728+0000 mgr.smithi008.flmjzp (mgr.14640) 1074 : cluster [DBG] pgmap v753: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:43.106074+0000 mgr.smithi008.flmjzp (mgr.14640) 1075 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:43.106639+0000 mgr.smithi008.flmjzp (mgr.14640) 1076 : cluster [DBG] pgmap v754: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:43.106964+0000 mgr.smithi008.flmjzp (mgr.14640) 1077 : cluster [DBG] pgmap v755: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:43.129173+0000 mgr.smithi008.flmjzp (mgr.14640) 1078 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:45.107628+0000 mgr.smithi008.flmjzp (mgr.14640) 1079 : cluster [DBG] pgmap v756: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:46.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:45.107628+0000 mgr.smithi008.flmjzp (mgr.14640) 1079 : cluster [DBG] pgmap v756: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:47.108156+0000 mgr.smithi008.flmjzp (mgr.14640) 1080 : cluster [DBG] pgmap v757: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:47.108156+0000 mgr.smithi008.flmjzp (mgr.14640) 1080 : cluster [DBG] pgmap v757: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:49.108890+0000 mgr.smithi008.flmjzp (mgr.14640) 1081 : cluster [DBG] pgmap v758: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:49.108890+0000 mgr.smithi008.flmjzp (mgr.14640) 1081 : cluster [DBG] pgmap v758: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:52.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:51.109561+0000 mgr.smithi008.flmjzp (mgr.14640) 1082 : cluster [DBG] pgmap v759: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:51.109561+0000 mgr.smithi008.flmjzp (mgr.14640) 1082 : cluster [DBG] pgmap v759: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:53.134025+0000 mon.smithi008 (mon.0) 1545 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:53.134025+0000 mon.smithi008 (mon.0) 1545 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:54.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:53.110184+0000 mgr.smithi008.flmjzp (mgr.14640) 1083 : cluster [DBG] pgmap v760: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:53.697349+0000 mon.smithi008 (mon.0) 1546 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:53.698157+0000 mon.smithi008 (mon.0) 1547 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:53.698821+0000 mgr.smithi008.flmjzp (mgr.14640) 1084 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:53.699368+0000 mgr.smithi008.flmjzp (mgr.14640) 1085 : cluster [DBG] pgmap v761: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:54.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:53.699656+0000 mgr.smithi008.flmjzp (mgr.14640) 1086 : cluster [DBG] pgmap v762: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:53.703601+0000 mon.smithi008 (mon.0) 1548 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:53.708659+0000 mon.smithi008 (mon.0) 1549 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:53.711081+0000 mon.smithi008 (mon.0) 1550 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:53.712336+0000 mon.smithi008 (mon.0) 1551 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:54.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:53.713541+0000 mon.smithi008 (mon.0) 1552 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:54.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:53.715062+0000 mon.smithi008 (mon.0) 1553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:54.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:16:53.716609+0000 mgr.smithi008.flmjzp (mgr.14640) 1087 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:54.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:53.110184+0000 mgr.smithi008.flmjzp (mgr.14640) 1083 : cluster [DBG] pgmap v760: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:53.697349+0000 mon.smithi008 (mon.0) 1546 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:16:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:53.698157+0000 mon.smithi008 (mon.0) 1547 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:16:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:53.698821+0000 mgr.smithi008.flmjzp (mgr.14640) 1084 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:16:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:53.699368+0000 mgr.smithi008.flmjzp (mgr.14640) 1085 : cluster [DBG] pgmap v761: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:53.699656+0000 mgr.smithi008.flmjzp (mgr.14640) 1086 : cluster [DBG] pgmap v762: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:53.703601+0000 mon.smithi008 (mon.0) 1548 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:16:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:53.708659+0000 mon.smithi008 (mon.0) 1549 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:16:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:53.711081+0000 mon.smithi008 (mon.0) 1550 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:53.712336+0000 mon.smithi008 (mon.0) 1551 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:54.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:53.713541+0000 mon.smithi008 (mon.0) 1552 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:54.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:53.715062+0000 mon.smithi008 (mon.0) 1553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:16:54.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:16:53.716609+0000 mgr.smithi008.flmjzp (mgr.14640) 1087 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:16:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:55.700230+0000 mgr.smithi008.flmjzp (mgr.14640) 1088 : cluster [DBG] pgmap v763: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:56.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:55.700230+0000 mgr.smithi008.flmjzp (mgr.14640) 1088 : cluster [DBG] pgmap v763: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:58.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.287+0000 7f20c17c1700 1 -- 172.21.15.8:0/2426248848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20bc0f6530 msgr2=0x7f20bc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:58.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.287+0000 7f20c17c1700 1 --2- 172.21.15.8:0/2426248848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20bc0f6530 0x7f20bc0f6950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f20ac004660 tx=0x7f20ac009b30).stop 2023-10-18T21:16:58.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.287+0000 7f20c17c1700 1 -- 172.21.15.8:0/2426248848 shutdown_connections 2023-10-18T21:16:58.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.287+0000 7f20c17c1700 1 --2- 172.21.15.8:0/2426248848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20bc0f77d0 0x7f20bc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.287+0000 7f20c17c1700 1 --2- 172.21.15.8:0/2426248848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20bc0f6530 0x7f20bc0f6950 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.287+0000 7f20c17c1700 1 -- 172.21.15.8:0/2426248848 >> 172.21.15.8:0/2426248848 conn(0x7f20bc0f1c90 msgr2=0x7f20bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:58.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.287+0000 7f20c17c1700 1 -- 172.21.15.8:0/2426248848 shutdown_connections 2023-10-18T21:16:58.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.287+0000 7f20c17c1700 1 -- 172.21.15.8:0/2426248848 wait complete. 2023-10-18T21:16:58.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.288+0000 7f20c17c1700 1 Processor -- start 2023-10-18T21:16:58.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.288+0000 7f20c17c1700 1 -- start start 2023-10-18T21:16:58.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.288+0000 7f20c17c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20bc0f6530 0x7f20bc108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:58.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20c17c1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20bc0f77d0 0x7f20bc1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:58.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20c17c1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc109a70 con 0x7f20bc0f6530 2023-10-18T21:16:58.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20c17c1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc109bb0 con 0x7f20bc0f77d0 2023-10-18T21:16:58.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20bc0f6530 0x7f20bc108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20bc0f6530 0x7f20bc108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33388/0 (socket says 172.21.15.8:33388) 2023-10-18T21:16:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20bbfff700 1 -- 172.21.15.8:0/2216008811 learned_addr learned my addr 172.21.15.8:0/2216008811 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20bb7fe700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20bc0f77d0 0x7f20bc1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20bbfff700 1 -- 172.21.15.8:0/2216008811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20bc0f77d0 msgr2=0x7f20bc1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20bbfff700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20bc0f77d0 0x7f20bc1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20bbfff700 1 -- 172.21.15.8:0/2216008811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac005040 con 0x7f20bc0f6530 2023-10-18T21:16:58.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20bb7fe700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20bc0f77d0 0x7f20bc1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:16:58.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.289+0000 7f20bbfff700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20bc0f6530 0x7f20bc108fd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f20ac004e30 tx=0x7f20ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:58.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.290+0000 7f20b8ff9700 1 -- 172.21.15.8:0/2216008811 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20ac018070 con 0x7f20bc0f6530 2023-10-18T21:16:58.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.290+0000 7f20b8ff9700 1 -- 172.21.15.8:0/2216008811 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f20ac009630 con 0x7f20bc0f6530 2023-10-18T21:16:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.290+0000 7f20b8ff9700 1 -- 172.21.15.8:0/2216008811 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20ac01c3c0 con 0x7f20bc0f6530 2023-10-18T21:16:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.290+0000 7f20c17c1700 1 -- 172.21.15.8:0/2216008811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc10a4f0 con 0x7f20bc0f6530 2023-10-18T21:16:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.290+0000 7f20c17c1700 1 -- 172.21.15.8:0/2216008811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc10aa50 con 0x7f20bc0f6530 2023-10-18T21:16:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.291+0000 7f20c17c1700 1 -- 172.21.15.8:0/2216008811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20bc045ad0 con 0x7f20bc0f6530 2023-10-18T21:16:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.292+0000 7f20b8ff9700 1 -- 172.21.15.8:0/2216008811 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f20ac01d420 con 0x7f20bc0f6530 2023-10-18T21:16:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.293+0000 7f20b8ff9700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20a4060f70 0x7f20a4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.293+0000 7f20b8ff9700 1 -- 172.21.15.8:0/2216008811 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f20ac07e500 con 0x7f20bc0f6530 2023-10-18T21:16:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.293+0000 7f20bb7fe700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20a4060f70 0x7f20a4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.294+0000 7f20bb7fe700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20a4060f70 0x7f20a4063430 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f20b0009740 tx=0x7f20b0009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.297+0000 7f20b8ff9700 1 -- 172.21.15.8:0/2216008811 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f20ac051c50 con 0x7f20bc0f6530 2023-10-18T21:16:58.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.496+0000 7f20c17c1700 1 -- 172.21.15.8:0/2216008811 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f20bc0fee00 con 0x7f20a4060f70 2023-10-18T21:16:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.498+0000 7f20b8ff9700 1 -- 172.21.15.8:0/2216008811 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f20bc0fee00 con 0x7f20a4060f70 2023-10-18T21:16:58.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 -- 172.21.15.8:0/2216008811 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20a4060f70 msgr2=0x7f20a4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20a4060f70 0x7f20a4063430 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f20b0009740 tx=0x7f20b0009be0).stop 2023-10-18T21:16:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 -- 172.21.15.8:0/2216008811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20bc0f6530 msgr2=0x7f20bc108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20bc0f6530 0x7f20bc108fd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f20ac004e30 tx=0x7f20ac009b30).stop 2023-10-18T21:16:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 -- 172.21.15.8:0/2216008811 shutdown_connections 2023-10-18T21:16:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20a4060f70 0x7f20a4063430 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20bc0f6530 0x7f20bc108fd0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 --2- 172.21.15.8:0/2216008811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20bc0f77d0 0x7f20bc1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 -- 172.21.15.8:0/2216008811 >> 172.21.15.8:0/2216008811 conn(0x7f20bc0f1c90 msgr2=0x7f20bc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 -- 172.21.15.8:0/2216008811 shutdown_connections 2023-10-18T21:16:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.500+0000 7f20c17c1700 1 -- 172.21.15.8:0/2216008811 wait complete. 2023-10-18T21:16:58.516 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:16:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.637+0000 7fdf0dd20700 1 -- 172.21.15.8:0/1329587467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf080f6530 msgr2=0x7fdf080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.637+0000 7fdf0dd20700 1 --2- 172.21.15.8:0/1329587467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf080f6530 0x7fdf080f6950 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fdefc004660 tx=0x7fdefc009b30).stop 2023-10-18T21:16:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.638+0000 7fdf0dd20700 1 -- 172.21.15.8:0/1329587467 shutdown_connections 2023-10-18T21:16:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.638+0000 7fdf0dd20700 1 --2- 172.21.15.8:0/1329587467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf080f77d0 0x7fdf080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:16:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.638+0000 7fdf0dd20700 1 --2- 172.21.15.8:0/1329587467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf080f6530 0x7fdf080f6950 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.638+0000 7fdf0dd20700 1 -- 172.21.15.8:0/1329587467 >> 172.21.15.8:0/1329587467 conn(0x7fdf080f1c90 msgr2=0x7fdf080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.638+0000 7fdf0dd20700 1 -- 172.21.15.8:0/1329587467 shutdown_connections 2023-10-18T21:16:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.638+0000 7fdf0dd20700 1 -- 172.21.15.8:0/1329587467 wait complete. 2023-10-18T21:16:58.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.638+0000 7fdf0dd20700 1 Processor -- start 2023-10-18T21:16:58.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.639+0000 7fdf0dd20700 1 -- start start 2023-10-18T21:16:58.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.639+0000 7fdf0dd20700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf080f6530 0x7fdf0806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:58.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.639+0000 7fdf0dd20700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf080f77d0 0x7fdf08069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:58.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.639+0000 7fdf0dd20700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0806a410 con 0x7fdf080f77d0 2023-10-18T21:16:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.639+0000 7fdf0dd20700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0806a550 con 0x7fdf080f6530 2023-10-18T21:16:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.639+0000 7fdf07fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf080f77d0 0x7fdf08069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.639+0000 7fdf07fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf080f77d0 0x7fdf08069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33408/0 (socket says 172.21.15.8:33408) 2023-10-18T21:16:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.639+0000 7fdf07fff700 1 -- 172.21.15.8:0/3936251397 learned_addr learned my addr 172.21.15.8:0/3936251397 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.639+0000 7fdf0cd1e700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf080f6530 0x7fdf0806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.640+0000 7fdf07fff700 1 -- 172.21.15.8:0/3936251397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf080f6530 msgr2=0x7fdf0806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.640+0000 7fdf07fff700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf080f6530 0x7fdf0806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.640+0000 7fdf07fff700 1 -- 172.21.15.8:0/3936251397 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc005040 con 0x7fdf080f77d0 2023-10-18T21:16:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.640+0000 7fdf07fff700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf080f77d0 0x7fdf08069e20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fdef400b410 tx=0x7fdef4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.640+0000 7fdf057fa700 1 -- 172.21.15.8:0/3936251397 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdef40125f0 con 0x7fdf080f77d0 2023-10-18T21:16:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.640+0000 7fdf057fa700 1 -- 172.21.15.8:0/3936251397 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdef400be30 con 0x7fdf080f77d0 2023-10-18T21:16:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.640+0000 7fdf0dd20700 1 -- 172.21.15.8:0/3936251397 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0806a830 con 0x7fdf080f77d0 2023-10-18T21:16:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.640+0000 7fdf057fa700 1 -- 172.21.15.8:0/3936251397 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdef4002a60 con 0x7fdf080f77d0 2023-10-18T21:16:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.640+0000 7fdf0dd20700 1 -- 172.21.15.8:0/3936251397 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0810ee00 con 0x7fdf080f77d0 2023-10-18T21:16:58.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.642+0000 7fdf0dd20700 1 -- 172.21.15.8:0/3936251397 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf08045ad0 con 0x7fdf080f77d0 2023-10-18T21:16:58.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.642+0000 7fdf057fa700 1 -- 172.21.15.8:0/3936251397 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdef400f030 con 0x7fdf080f77d0 2023-10-18T21:16:58.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.643+0000 7fdf057fa700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdef8060f70 0x7fdef8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.643+0000 7fdf057fa700 1 -- 172.21.15.8:0/3936251397 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdef407cdc0 con 0x7fdf080f77d0 2023-10-18T21:16:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.644+0000 7fdf0cd1e700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdef8060f70 0x7fdef8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.644+0000 7fdf0cd1e700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdef8060f70 0x7fdef8063430 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fdf0806b730 tx=0x7fdefc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.648+0000 7fdf057fa700 1 -- 172.21.15.8:0/3936251397 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdef4080030 con 0x7fdf080f77d0 2023-10-18T21:16:58.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.847+0000 7fdf0dd20700 1 -- 172.21.15.8:0/3936251397 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf080feeb0 con 0x7fdef8060f70 2023-10-18T21:16:58.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.848+0000 7fdf057fa700 1 -- 172.21.15.8:0/3936251397 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdf080feeb0 con 0x7fdef8060f70 2023-10-18T21:16:58.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.850+0000 7fdf0dd20700 1 -- 172.21.15.8:0/3936251397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdef8060f70 msgr2=0x7fdef8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:58.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.850+0000 7fdf0dd20700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdef8060f70 0x7fdef8063430 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fdf0806b730 tx=0x7fdefc009b30).stop 2023-10-18T21:16:58.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.850+0000 7fdf0dd20700 1 -- 172.21.15.8:0/3936251397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf080f77d0 msgr2=0x7fdf08069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:58.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.850+0000 7fdf0dd20700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf080f77d0 0x7fdf08069e20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fdef400b410 tx=0x7fdef4006ef0).stop 2023-10-18T21:16:58.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.850+0000 7fdf0dd20700 1 -- 172.21.15.8:0/3936251397 shutdown_connections 2023-10-18T21:16:58.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.850+0000 7fdf0dd20700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdef8060f70 0x7fdef8063430 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.850+0000 7fdf0dd20700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf080f6530 0x7fdf0806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.850+0000 7fdf0dd20700 1 --2- 172.21.15.8:0/3936251397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf080f77d0 0x7fdf08069e20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.850+0000 7fdf0dd20700 1 -- 172.21.15.8:0/3936251397 >> 172.21.15.8:0/3936251397 conn(0x7fdf080f1c90 msgr2=0x7fdf080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:58.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.851+0000 7fdf0dd20700 1 -- 172.21.15.8:0/3936251397 shutdown_connections 2023-10-18T21:16:58.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.851+0000 7fdf0dd20700 1 -- 172.21.15.8:0/3936251397 wait complete. 2023-10-18T21:16:58.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.987+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2401004995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa5c0f6530 msgr2=0x7ffa5c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:58.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.987+0000 7ffa5b59e700 1 --2- 172.21.15.8:0/2401004995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa5c0f6530 0x7ffa5c0f6950 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7ffa4c004660 tx=0x7ffa4c009b30).stop 2023-10-18T21:16:58.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.987+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2401004995 shutdown_connections 2023-10-18T21:16:58.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.987+0000 7ffa5b59e700 1 --2- 172.21.15.8:0/2401004995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa5c0f77d0 0x7ffa5c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.987+0000 7ffa5b59e700 1 --2- 172.21.15.8:0/2401004995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa5c0f6530 0x7ffa5c0f6950 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.987+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2401004995 >> 172.21.15.8:0/2401004995 conn(0x7ffa5c0f1c70 msgr2=0x7ffa5c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:58.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.987+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2401004995 shutdown_connections 2023-10-18T21:16:58.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.987+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2401004995 wait complete. 2023-10-18T21:16:58.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.988+0000 7ffa5b59e700 1 Processor -- start 2023-10-18T21:16:58.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.988+0000 7ffa5b59e700 1 -- start start 2023-10-18T21:16:58.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa5b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa5c0f6530 0x7ffa5c108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:58.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa5b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa5c0f77d0 0x7ffa5c1094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:58.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa5b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c109a80 con 0x7ffa5c0f77d0 2023-10-18T21:16:58.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa5b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c109bc0 con 0x7ffa5c0f6530 2023-10-18T21:16:58.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa59d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa5c0f77d0 0x7ffa5c1094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:58.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa59d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa5c0f77d0 0x7ffa5c1094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33436/0 (socket says 172.21.15.8:33436) 2023-10-18T21:16:58.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa59d9b700 1 -- 172.21.15.8:0/2851103449 learned_addr learned my addr 172.21.15.8:0/2851103449 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:58.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa5a59c700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa5c0f6530 0x7ffa5c108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:58.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa59d9b700 1 -- 172.21.15.8:0/2851103449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa5c0f6530 msgr2=0x7ffa5c108fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:58.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa59d9b700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa5c0f6530 0x7ffa5c108fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:58.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa59d9b700 1 -- 172.21.15.8:0/2851103449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c005040 con 0x7ffa5c0f77d0 2023-10-18T21:16:58.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa5a59c700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa5c0f6530 0x7ffa5c108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:16:58.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.989+0000 7ffa59d9b700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa5c0f77d0 0x7ffa5c1094d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7ffa500026d0 tx=0x7ffa50009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:58.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.990+0000 7ffa4affd700 1 -- 172.21.15.8:0/2851103449 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa50009320 con 0x7ffa5c0f77d0 2023-10-18T21:16:58.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.990+0000 7ffa4affd700 1 -- 172.21.15.8:0/2851103449 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ffa5000f040 con 0x7ffa5c0f77d0 2023-10-18T21:16:58.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.990+0000 7ffa4affd700 1 -- 172.21.15.8:0/2851103449 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa500148a0 con 0x7ffa5c0f77d0 2023-10-18T21:16:58.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.990+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2851103449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c10a560 con 0x7ffa5c0f77d0 2023-10-18T21:16:58.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.990+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2851103449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c10ab20 con 0x7ffa5c0f77d0 2023-10-18T21:16:58.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.991+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2851103449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c045ad0 con 0x7ffa5c0f77d0 2023-10-18T21:16:58.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.992+0000 7ffa4affd700 1 -- 172.21.15.8:0/2851103449 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ffa50009480 con 0x7ffa5c0f77d0 2023-10-18T21:16:58.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.992+0000 7ffa4affd700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa44060f70 0x7ffa44063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:58.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.993+0000 7ffa4affd700 1 -- 172.21.15.8:0/2851103449 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ffa5007cf60 con 0x7ffa5c0f77d0 2023-10-18T21:16:58.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.993+0000 7ffa5a59c700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa44060f70 0x7ffa44063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:58.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.993+0000 7ffa5a59c700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa44060f70 0x7ffa44063430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7ffa4c009d60 tx=0x7ffa4c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:58.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:58.996+0000 7ffa4affd700 1 -- 172.21.15.8:0/2851103449 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ffa500505c0 con 0x7ffa5c0f77d0 2023-10-18T21:16:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:57.700895+0000 mgr.smithi008.flmjzp (mgr.14640) 1089 : cluster [DBG] pgmap v764: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:59.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.188+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2851103449 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa5c10adf0 con 0x7ffa44060f70 2023-10-18T21:16:59.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.197+0000 7ffa4affd700 1 -- 172.21.15.8:0/2851103449 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ffa5c10adf0 con 0x7ffa44060f70 2023-10-18T21:16:59.198 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:16:59.199 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (23m) 97s ago 25m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:16:59.199 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (17m) 97s ago 25m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:16:59.199 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (17m) 9m ago 24m 7822k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:16:59.199 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (23m) 97s ago 24m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:16:59.199 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 97s ago 21m - - 2023-10-18T21:16:59.200 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 97s ago 21m - - 2023-10-18T21:16:59.200 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 running (10m) 9m ago 21m 12.1M - 16.2.14-100-gb4ddd52c 92842c92b8bd 6aedfcd4961e 2023-10-18T21:16:59.200 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 running (9m) 9m ago 21m 10.9M - 16.2.14-100-gb4ddd52c 92842c92b8bd d50aca3c0693 2023-10-18T21:16:59.200 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (18m) 97s ago 26m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:16:59.200 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (18m) 9m ago 24m 398M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:16:59.201 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (17m) 97s ago 26m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:16:59.201 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (17m) 9m ago 24m 93.0M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:16:59.201 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (24m) 97s ago 24m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:16:59.201 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (23m) 9m ago 23m 9.96M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:16:59.201 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (17m) 97s ago 23m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:16:59.202 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (15m) 97s ago 23m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:16:59.202 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (14m) 97s ago 23m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:16:59.202 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (14m) 9m ago 22m 364M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:16:59.202 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (13m) 9m ago 22m 329M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:16:59.202 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (13m) 9m ago 22m 249M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:16:59.203 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (19m) 97s ago 24m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:16:59.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.199+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2851103449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa44060f70 msgr2=0x7ffa44063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:59.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.199+0000 7ffa5b59e700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa44060f70 0x7ffa44063430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7ffa4c009d60 tx=0x7ffa4c009b30).stop 2023-10-18T21:16:59.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.199+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2851103449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa5c0f77d0 msgr2=0x7ffa5c1094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:59.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.199+0000 7ffa5b59e700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa5c0f77d0 0x7ffa5c1094d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7ffa500026d0 tx=0x7ffa50009de0).stop 2023-10-18T21:16:59.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.199+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2851103449 shutdown_connections 2023-10-18T21:16:59.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.199+0000 7ffa5b59e700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa44060f70 0x7ffa44063430 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.199+0000 7ffa5b59e700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa5c0f6530 0x7ffa5c108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.199+0000 7ffa5b59e700 1 --2- 172.21.15.8:0/2851103449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa5c0f77d0 0x7ffa5c1094d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.199+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2851103449 >> 172.21.15.8:0/2851103449 conn(0x7ffa5c0f1c70 msgr2=0x7ffa5c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:59.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.200+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2851103449 shutdown_connections 2023-10-18T21:16:59.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.200+0000 7ffa5b59e700 1 -- 172.21.15.8:0/2851103449 wait complete. 2023-10-18T21:16:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:57.700895+0000 mgr.smithi008.flmjzp (mgr.14640) 1089 : cluster [DBG] pgmap v764: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:16:59.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.335+0000 7fe1c359e700 1 -- 172.21.15.8:0/194943260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c40f77d0 msgr2=0x7fe1c40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:59.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.335+0000 7fe1c359e700 1 --2- 172.21.15.8:0/194943260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c40f77d0 0x7fe1c40f7c30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fe1b8004660 tx=0x7fe1b8009b30).stop 2023-10-18T21:16:59.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.335+0000 7fe1c359e700 1 -- 172.21.15.8:0/194943260 shutdown_connections 2023-10-18T21:16:59.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.335+0000 7fe1c359e700 1 --2- 172.21.15.8:0/194943260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c40f77d0 0x7fe1c40f7c30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.335+0000 7fe1c359e700 1 --2- 172.21.15.8:0/194943260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c40f6530 0x7fe1c40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.335+0000 7fe1c359e700 1 -- 172.21.15.8:0/194943260 >> 172.21.15.8:0/194943260 conn(0x7fe1c40f1c90 msgr2=0x7fe1c40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:59.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.335+0000 7fe1c359e700 1 -- 172.21.15.8:0/194943260 shutdown_connections 2023-10-18T21:16:59.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.335+0000 7fe1c359e700 1 -- 172.21.15.8:0/194943260 wait complete. 2023-10-18T21:16:59.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.336+0000 7fe1c359e700 1 Processor -- start 2023-10-18T21:16:59.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.336+0000 7fe1c359e700 1 -- start start 2023-10-18T21:16:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c40f6530 0x7fe1c4106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c40f77d0 0x7fe1c4107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c4107850 con 0x7fe1c40f77d0 2023-10-18T21:16:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c4108060 con 0x7fe1c40f6530 2023-10-18T21:16:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c40f77d0 0x7fe1c4107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:59.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c40f77d0 0x7fe1c4107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33456/0 (socket says 172.21.15.8:33456) 2023-10-18T21:16:59.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c1d9b700 1 -- 172.21.15.8:0/4207309047 learned_addr learned my addr 172.21.15.8:0/4207309047 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:59.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c259c700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c40f6530 0x7fe1c4106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:59.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c1d9b700 1 -- 172.21.15.8:0/4207309047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c40f6530 msgr2=0x7fe1c4106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:59.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c1d9b700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c40f6530 0x7fe1c4106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.337+0000 7fe1c1d9b700 1 -- 172.21.15.8:0/4207309047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8005040 con 0x7fe1c40f77d0 2023-10-18T21:16:59.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.338+0000 7fe1c1d9b700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c40f77d0 0x7fe1c4107250 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fe1b8004320 tx=0x7fe1b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:59.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.338+0000 7fe1b2ffd700 1 -- 172.21.15.8:0/4207309047 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1b8019070 con 0x7fe1c40f77d0 2023-10-18T21:16:59.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.338+0000 7fe1c359e700 1 -- 172.21.15.8:0/4207309047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c4108280 con 0x7fe1c40f77d0 2023-10-18T21:16:59.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.338+0000 7fe1b2ffd700 1 -- 172.21.15.8:0/4207309047 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe1b801e420 con 0x7fe1c40f77d0 2023-10-18T21:16:59.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.338+0000 7fe1b2ffd700 1 -- 172.21.15.8:0/4207309047 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1b8014680 con 0x7fe1c40f77d0 2023-10-18T21:16:59.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.338+0000 7fe1c359e700 1 -- 172.21.15.8:0/4207309047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c4108760 con 0x7fe1c40f77d0 2023-10-18T21:16:59.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.339+0000 7fe1c359e700 1 -- 172.21.15.8:0/4207309047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c4059100 con 0x7fe1c40f77d0 2023-10-18T21:16:59.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.340+0000 7fe1b2ffd700 1 -- 172.21.15.8:0/4207309047 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe1b801e590 con 0x7fe1c40f77d0 2023-10-18T21:16:59.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.341+0000 7fe1b2ffd700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1ac060f70 0x7fe1ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:59.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.341+0000 7fe1b2ffd700 1 -- 172.21.15.8:0/4207309047 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe1b807dd10 con 0x7fe1c40f77d0 2023-10-18T21:16:59.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.341+0000 7fe1c259c700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1ac060f70 0x7fe1ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:59.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.342+0000 7fe1c259c700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1ac060f70 0x7fe1ac063430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fe1c4106ad0 tx=0x7fe1b400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:59.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.345+0000 7fe1b2ffd700 1 -- 172.21.15.8:0/4207309047 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe1b804d8e0 con 0x7fe1c40f77d0 2023-10-18T21:16:59.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.597+0000 7fe1c359e700 1 -- 172.21.15.8:0/4207309047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe1c40fedc0 con 0x7fe1c40f77d0 2023-10-18T21:16:59.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.597+0000 7fe1b2ffd700 1 -- 172.21.15.8:0/4207309047 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fe1b8050f00 con 0x7fe1c40f77d0 2023-10-18T21:16:59.599 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:16:59.599 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:16:59.599 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:16:59.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:16:59.599 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:16:59.600 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:16:59.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:16:59.600 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:16:59.600 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:16:59.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:16:59.601 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:16:59.601 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:16:59.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:16:59.601 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:16:59.601 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:16:59.601 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:16:59.602 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:16:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.599+0000 7fe1c359e700 1 -- 172.21.15.8:0/4207309047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1ac060f70 msgr2=0x7fe1ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.599+0000 7fe1c359e700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1ac060f70 0x7fe1ac063430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fe1c4106ad0 tx=0x7fe1b400b040).stop 2023-10-18T21:16:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.599+0000 7fe1c359e700 1 -- 172.21.15.8:0/4207309047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c40f77d0 msgr2=0x7fe1c4107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.599+0000 7fe1c359e700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c40f77d0 0x7fe1c4107250 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fe1b8004320 tx=0x7fe1b800b040).stop 2023-10-18T21:16:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.600+0000 7fe1c359e700 1 -- 172.21.15.8:0/4207309047 shutdown_connections 2023-10-18T21:16:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.600+0000 7fe1c359e700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1ac060f70 0x7fe1ac063430 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.600+0000 7fe1c359e700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c40f6530 0x7fe1c4106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.600+0000 7fe1c359e700 1 --2- 172.21.15.8:0/4207309047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c40f77d0 0x7fe1c4107250 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.600+0000 7fe1c359e700 1 -- 172.21.15.8:0/4207309047 >> 172.21.15.8:0/4207309047 conn(0x7fe1c40f1c90 msgr2=0x7fe1c40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.600+0000 7fe1c359e700 1 -- 172.21.15.8:0/4207309047 shutdown_connections 2023-10-18T21:16:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.600+0000 7fe1c359e700 1 -- 172.21.15.8:0/4207309047 wait complete. 2023-10-18T21:16:59.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.736+0000 7f6fa31c4700 1 -- 172.21.15.8:0/2499632127 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f9c0f6530 msgr2=0x7f6f9c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:59.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.736+0000 7f6fa31c4700 1 --2- 172.21.15.8:0/2499632127 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f9c0f6530 0x7f6f9c0f6950 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f6f98004660 tx=0x7f6f98009b30).stop 2023-10-18T21:16:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.736+0000 7f6fa31c4700 1 -- 172.21.15.8:0/2499632127 shutdown_connections 2023-10-18T21:16:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.736+0000 7f6fa31c4700 1 --2- 172.21.15.8:0/2499632127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c0f77d0 0x7f6f9c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.736+0000 7f6fa31c4700 1 --2- 172.21.15.8:0/2499632127 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f9c0f6530 0x7f6f9c0f6950 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.736+0000 7f6fa31c4700 1 -- 172.21.15.8:0/2499632127 >> 172.21.15.8:0/2499632127 conn(0x7f6f9c0f1c90 msgr2=0x7f6f9c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.736+0000 7f6fa31c4700 1 -- 172.21.15.8:0/2499632127 shutdown_connections 2023-10-18T21:16:59.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.736+0000 7f6fa31c4700 1 -- 172.21.15.8:0/2499632127 wait complete. 2023-10-18T21:16:59.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.737+0000 7f6fa31c4700 1 Processor -- start 2023-10-18T21:16:59.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.737+0000 7f6fa31c4700 1 -- start start 2023-10-18T21:16:59.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.737+0000 7f6fa31c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c0f6530 0x7f6f9c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:59.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.737+0000 7f6fa31c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f9c0f77d0 0x7f6f9c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:59.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.737+0000 7f6fa31c4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c107880 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.737+0000 7f6fa31c4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c1080c0 con 0x7f6f9c0f6530 2023-10-18T21:16:59.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.738+0000 7f6fa19c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f9c0f77d0 0x7f6f9c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:59.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.738+0000 7f6fa19c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f9c0f77d0 0x7f6f9c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33478/0 (socket says 172.21.15.8:33478) 2023-10-18T21:16:59.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.738+0000 7f6fa19c1700 1 -- 172.21.15.8:0/3828877565 learned_addr learned my addr 172.21.15.8:0/3828877565 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:16:59.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.738+0000 7f6fa21c2700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c0f6530 0x7f6f9c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:59.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.738+0000 7f6fa19c1700 1 -- 172.21.15.8:0/3828877565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c0f6530 msgr2=0x7f6f9c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:59.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.738+0000 7f6fa19c1700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c0f6530 0x7f6f9c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.738+0000 7f6fa19c1700 1 -- 172.21.15.8:0/3828877565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98005040 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.738+0000 7f6fa19c1700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f9c0f77d0 0x7f6f9c107280 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f6f8c00e7f0 tx=0x7f6f8c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:59.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.739+0000 7f6f92ffd700 1 -- 172.21.15.8:0/3828877565 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f8c0092e0 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.739+0000 7f6fa31c4700 1 -- 172.21.15.8:0/3828877565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c1083a0 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.739+0000 7f6f92ffd700 1 -- 172.21.15.8:0/3828877565 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6f8c00f040 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.739+0000 7f6f92ffd700 1 -- 172.21.15.8:0/3828877565 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f8c0147e0 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.739+0000 7f6fa31c4700 1 -- 172.21.15.8:0/3828877565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c1088e0 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.740+0000 7f6fa31c4700 1 -- 172.21.15.8:0/3828877565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9c059100 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.741+0000 7f6f92ffd700 1 -- 172.21.15.8:0/3828877565 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6f8c01b030 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.742+0000 7f6f92ffd700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f88060f70 0x7f6f88063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:16:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.742+0000 7f6f92ffd700 1 -- 172.21.15.8:0/3828877565 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6f8c07c740 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.742+0000 7f6fa21c2700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f88060f70 0x7f6f88063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:16:59.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.743+0000 7f6fa21c2700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f88060f70 0x7f6f88063430 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f6f98004d80 tx=0x7f6f9800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:16:59.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.746+0000 7f6f92ffd700 1 -- 172.21.15.8:0/3828877565 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6f8c04c340 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.975+0000 7f6fa31c4700 1 -- 172.21.15.8:0/3828877565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6f9c0fecc0 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.976+0000 7f6f92ffd700 1 -- 172.21.15.8:0/3828877565 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f6f8c019070 con 0x7f6f9c0f77d0 2023-10-18T21:16:59.977 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:16:59.977 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:16:59.978 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:16:59.978 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:16:59.978 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:16:59.978 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:16:59.978 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:16:59.979 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:16:59.979 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:16:59.979 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:16:59.979 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:16:59.979 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:16:59.979 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:16:59.980 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:16:59.980 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:16:59.980 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:16:59.980 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:16:59.980 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:16:59.981 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:16:59.981 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:16:59.981 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:16:59.981 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:16:59.981 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:16:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:16:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:16:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:16:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:16:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:16:59.983 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:16:59.983 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:16:59.983 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:16:59.983 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:16:59.983 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:16:59.984 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:16:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 -- 172.21.15.8:0/3828877565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f88060f70 msgr2=0x7f6f88063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f88060f70 0x7f6f88063430 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f6f98004d80 tx=0x7f6f9800b040).stop 2023-10-18T21:16:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 -- 172.21.15.8:0/3828877565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f9c0f77d0 msgr2=0x7f6f9c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:16:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f9c0f77d0 0x7f6f9c107280 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f6f8c00e7f0 tx=0x7f6f8c00b040).stop 2023-10-18T21:16:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 -- 172.21.15.8:0/3828877565 shutdown_connections 2023-10-18T21:16:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f88060f70 0x7f6f88063430 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c0f6530 0x7f6f9c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 --2- 172.21.15.8:0/3828877565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f9c0f77d0 0x7f6f9c107280 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:16:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 -- 172.21.15.8:0/3828877565 >> 172.21.15.8:0/3828877565 conn(0x7f6f9c0f1c90 msgr2=0x7f6f9c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:16:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 -- 172.21.15.8:0/3828877565 shutdown_connections 2023-10-18T21:16:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:16:59.978+0000 7f6fa31c4700 1 -- 172.21.15.8:0/3828877565 wait complete. 2023-10-18T21:16:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:17:00.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.115+0000 7f07422f5700 1 -- 172.21.15.8:0/1935459228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f073c0f6530 msgr2=0x7f073c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:00.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.115+0000 7f07422f5700 1 --2- 172.21.15.8:0/1935459228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f073c0f6530 0x7f073c0f6950 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f0738004660 tx=0x7f0738009b30).stop 2023-10-18T21:17:00.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.115+0000 7f07422f5700 1 -- 172.21.15.8:0/1935459228 shutdown_connections 2023-10-18T21:17:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.115+0000 7f07422f5700 1 --2- 172.21.15.8:0/1935459228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f073c0f77d0 0x7f073c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.115+0000 7f07422f5700 1 --2- 172.21.15.8:0/1935459228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f073c0f6530 0x7f073c0f6950 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.115+0000 7f07422f5700 1 -- 172.21.15.8:0/1935459228 >> 172.21.15.8:0/1935459228 conn(0x7f073c0f1c90 msgr2=0x7f073c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.115+0000 7f07422f5700 1 -- 172.21.15.8:0/1935459228 shutdown_connections 2023-10-18T21:17:00.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.115+0000 7f07422f5700 1 -- 172.21.15.8:0/1935459228 wait complete. 2023-10-18T21:17:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.116+0000 7f07422f5700 1 Processor -- start 2023-10-18T21:17:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.116+0000 7f07422f5700 1 -- start start 2023-10-18T21:17:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.116+0000 7f07422f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f073c0f6530 0x7f073c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.116+0000 7f07422f5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f073c0f77d0 0x7f073c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.116+0000 7f07422f5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c06a380 con 0x7f073c0f6530 2023-10-18T21:17:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.116+0000 7f07422f5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c06a4c0 con 0x7f073c0f77d0 2023-10-18T21:17:00.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f07412f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f073c0f6530 0x7f073c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f07412f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f073c0f6530 0x7f073c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33488/0 (socket says 172.21.15.8:33488) 2023-10-18T21:17:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f07412f3700 1 -- 172.21.15.8:0/2698596096 learned_addr learned my addr 172.21.15.8:0/2698596096 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:17:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f0740af2700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f073c0f77d0 0x7f073c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f07412f3700 1 -- 172.21.15.8:0/2698596096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f073c0f77d0 msgr2=0x7f073c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:00.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f07412f3700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f073c0f77d0 0x7f073c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f07412f3700 1 -- 172.21.15.8:0/2698596096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0738005040 con 0x7f073c0f6530 2023-10-18T21:17:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f0740af2700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f073c0f77d0 0x7f073c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:17:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f07412f3700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f073c0f6530 0x7f073c06b9a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f0738007a60 tx=0x7f0738009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f0731ffb700 1 -- 172.21.15.8:0/2698596096 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0738018070 con 0x7f073c0f6530 2023-10-18T21:17:00.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f07422f5700 1 -- 172.21.15.8:0/2698596096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c06a740 con 0x7f073c0f6530 2023-10-18T21:17:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f0731ffb700 1 -- 172.21.15.8:0/2698596096 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0738009630 con 0x7f073c0f6530 2023-10-18T21:17:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.117+0000 7f0731ffb700 1 -- 172.21.15.8:0/2698596096 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f073801c540 con 0x7f073c0f6530 2023-10-18T21:17:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.118+0000 7f07422f5700 1 -- 172.21.15.8:0/2698596096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c06aca0 con 0x7f073c0f6530 2023-10-18T21:17:00.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.119+0000 7f07422f5700 1 -- 172.21.15.8:0/2698596096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073c045ad0 con 0x7f073c0f6530 2023-10-18T21:17:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.120+0000 7f0731ffb700 1 -- 172.21.15.8:0/2698596096 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f073801d420 con 0x7f073c0f6530 2023-10-18T21:17:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.120+0000 7f0731ffb700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 0x7f0728063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:00.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.120+0000 7f0731ffb700 1 -- 172.21.15.8:0/2698596096 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f073807e680 con 0x7f073c0f6530 2023-10-18T21:17:00.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.121+0000 7f0740af2700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 0x7f0728063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:00.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.121+0000 7f0740af2700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 0x7f0728063430 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f072c004b90 tx=0x7f072c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:00.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.125+0000 7f0731ffb700 1 -- 172.21.15.8:0/2698596096 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f073804e2b0 con 0x7f073c0f6530 2023-10-18T21:17:00.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:58.498090+0000 mgr.smithi008.flmjzp (mgr.14640) 1090 : audit [DBG] from='client.35076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:00.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:16:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:59.597932+0000 mon.smithi008 (mon.0) 1554 : audit [DBG] from='client.? 172.21.15.8:0/4207309047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:58.498090+0000 mgr.smithi008.flmjzp (mgr.14640) 1090 : audit [DBG] from='client.35076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:16:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:59.597932+0000 mon.smithi008 (mon.0) 1554 : audit [DBG] from='client.? 172.21.15.8:0/4207309047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:00.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.321+0000 7f07422f5700 1 -- 172.21.15.8:0/2698596096 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f073c0fee80 con 0x7f0728060f70 2023-10-18T21:17:00.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.322+0000 7f0731ffb700 1 -- 172.21.15.8:0/2698596096 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f073c0fee80 con 0x7f0728060f70 2023-10-18T21:17:00.323 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:17:00.324 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:17:00.324 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:17:00.324 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:17:00.324 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:17:00.324 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:17:00.325 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:17:00.325 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:17:00.325 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:17:00.325 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:17:00.325 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "14/21 daemons upgraded", 2023-10-18T21:17:00.326 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:17:00.326 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:17:00.326 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:17:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.324+0000 7f07422f5700 1 -- 172.21.15.8:0/2698596096 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 msgr2=0x7f0728063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.324+0000 7f07422f5700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 0x7f0728063430 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f072c004b90 tx=0x7f072c00b040).stop 2023-10-18T21:17:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.324+0000 7f07422f5700 1 -- 172.21.15.8:0/2698596096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f073c0f6530 msgr2=0x7f073c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.324+0000 7f07422f5700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f073c0f6530 0x7f073c06b9a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f0738007a60 tx=0x7f0738009b30).stop 2023-10-18T21:17:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.324+0000 7f07422f5700 1 -- 172.21.15.8:0/2698596096 shutdown_connections 2023-10-18T21:17:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.324+0000 7f07422f5700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 0x7f0728063430 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.324+0000 7f07422f5700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f073c0f6530 0x7f073c06b9a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.324+0000 7f07422f5700 1 --2- 172.21.15.8:0/2698596096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f073c0f77d0 0x7f073c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.324+0000 7f07422f5700 1 -- 172.21.15.8:0/2698596096 >> 172.21.15.8:0/2698596096 conn(0x7f073c0f1c90 msgr2=0x7f073c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.325+0000 7f07422f5700 1 -- 172.21.15.8:0/2698596096 shutdown_connections 2023-10-18T21:17:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:00.325+0000 7f07422f5700 1 -- 172.21.15.8:0/2698596096 wait complete. 2023-10-18T21:17:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:58.848686+0000 mgr.smithi008.flmjzp (mgr.14640) 1091 : audit [DBG] from='client.35080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:59.189365+0000 mgr.smithi008.flmjzp (mgr.14640) 1092 : audit [DBG] from='client.35084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:16:59.701374+0000 mgr.smithi008.flmjzp (mgr.14640) 1093 : cluster [DBG] pgmap v765: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:16:59.976415+0000 mon.smithi008 (mon.0) 1555 : audit [DBG] from='client.? 172.21.15.8:0/3828877565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:17:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:58.848686+0000 mgr.smithi008.flmjzp (mgr.14640) 1091 : audit [DBG] from='client.35080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:59.189365+0000 mgr.smithi008.flmjzp (mgr.14640) 1092 : audit [DBG] from='client.35084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:01.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:16:59.701374+0000 mgr.smithi008.flmjzp (mgr.14640) 1093 : cluster [DBG] pgmap v765: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:01.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:16:59.976415+0000 mon.smithi008 (mon.0) 1555 : audit [DBG] from='client.? 172.21.15.8:0/3828877565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:17:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:00.322847+0000 mgr.smithi008.flmjzp (mgr.14640) 1094 : audit [DBG] from='client.35096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:02.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:00.322847+0000 mgr.smithi008.flmjzp (mgr.14640) 1094 : audit [DBG] from='client.35096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:03.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:01.701974+0000 mgr.smithi008.flmjzp (mgr.14640) 1095 : cluster [DBG] pgmap v766: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:03.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:01.701974+0000 mgr.smithi008.flmjzp (mgr.14640) 1095 : cluster [DBG] pgmap v766: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:03.702543+0000 mgr.smithi008.flmjzp (mgr.14640) 1096 : cluster [DBG] pgmap v767: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:03.727313+0000 mon.smithi008 (mon.0) 1556 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:03.729409+0000 mon.smithi008 (mon.0) 1557 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:03.730473+0000 mon.smithi008 (mon.0) 1558 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:03.731371+0000 mgr.smithi008.flmjzp (mgr.14640) 1097 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:03.731970+0000 mgr.smithi008.flmjzp (mgr.14640) 1098 : cluster [DBG] pgmap v768: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:03.732375+0000 mgr.smithi008.flmjzp (mgr.14640) 1099 : cluster [DBG] pgmap v769: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:03.736906+0000 mon.smithi008 (mon.0) 1559 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:03.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:03.743166+0000 mon.smithi008 (mon.0) 1560 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:03.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:03.746345+0000 mon.smithi008 (mon.0) 1561 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:03.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:03.748070+0000 mon.smithi008 (mon.0) 1562 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:03.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:03.749701+0000 mon.smithi008 (mon.0) 1563 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:03.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:03.751688+0000 mon.smithi008 (mon.0) 1564 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:03.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:03.753621+0000 mgr.smithi008.flmjzp (mgr.14640) 1100 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:04.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:03.702543+0000 mgr.smithi008.flmjzp (mgr.14640) 1096 : cluster [DBG] pgmap v767: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:03.727313+0000 mon.smithi008 (mon.0) 1556 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:03.729409+0000 mon.smithi008 (mon.0) 1557 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:03.730473+0000 mon.smithi008 (mon.0) 1558 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:03.731371+0000 mgr.smithi008.flmjzp (mgr.14640) 1097 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:03.731970+0000 mgr.smithi008.flmjzp (mgr.14640) 1098 : cluster [DBG] pgmap v768: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:03.732375+0000 mgr.smithi008.flmjzp (mgr.14640) 1099 : cluster [DBG] pgmap v769: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:03.736906+0000 mon.smithi008 (mon.0) 1559 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:03.743166+0000 mon.smithi008 (mon.0) 1560 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:03.746345+0000 mon.smithi008 (mon.0) 1561 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:04.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:03.748070+0000 mon.smithi008 (mon.0) 1562 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:04.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:03.749701+0000 mon.smithi008 (mon.0) 1563 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:04.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:03.751688+0000 mon.smithi008 (mon.0) 1564 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:04.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:03.753621+0000 mgr.smithi008.flmjzp (mgr.14640) 1100 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:05.732982+0000 mgr.smithi008.flmjzp (mgr.14640) 1101 : cluster [DBG] pgmap v770: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:06.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:05.732982+0000 mgr.smithi008.flmjzp (mgr.14640) 1101 : cluster [DBG] pgmap v770: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:07.733440+0000 mgr.smithi008.flmjzp (mgr.14640) 1102 : cluster [DBG] pgmap v771: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:08.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:07.733440+0000 mgr.smithi008.flmjzp (mgr.14640) 1102 : cluster [DBG] pgmap v771: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:10.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:09.734030+0000 mgr.smithi008.flmjzp (mgr.14640) 1103 : cluster [DBG] pgmap v772: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:10.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:09.734030+0000 mgr.smithi008.flmjzp (mgr.14640) 1103 : cluster [DBG] pgmap v772: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:11.734674+0000 mgr.smithi008.flmjzp (mgr.14640) 1104 : cluster [DBG] pgmap v773: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:12.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:11.734674+0000 mgr.smithi008.flmjzp (mgr.14640) 1104 : cluster [DBG] pgmap v773: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:13.735363+0000 mgr.smithi008.flmjzp (mgr.14640) 1105 : cluster [DBG] pgmap v774: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:13.762158+0000 mon.smithi008 (mon.0) 1565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:14.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:13.735363+0000 mgr.smithi008.flmjzp (mgr.14640) 1105 : cluster [DBG] pgmap v774: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:13.762158+0000 mon.smithi008 (mon.0) 1565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:15.130 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:14.323944+0000 mon.smithi008 (mon.0) 1566 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:15.130 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:14.325193+0000 mon.smithi008 (mon.0) 1567 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:15.131 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:14.326138+0000 mgr.smithi008.flmjzp (mgr.14640) 1106 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:15.131 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:14.326892+0000 mgr.smithi008.flmjzp (mgr.14640) 1107 : cluster [DBG] pgmap v775: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:15.131 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:14.327164+0000 mgr.smithi008.flmjzp (mgr.14640) 1108 : cluster [DBG] pgmap v776: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:15.131 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:14.332289+0000 mon.smithi008 (mon.0) 1568 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:15.132 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:14.338746+0000 mon.smithi008 (mon.0) 1569 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:15.132 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:14.341934+0000 mon.smithi008 (mon.0) 1570 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:15.132 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:14.343716+0000 mon.smithi008 (mon.0) 1571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:15.132 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:14.345348+0000 mon.smithi008 (mon.0) 1572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:15.132 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:14.347389+0000 mon.smithi008 (mon.0) 1573 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:15.133 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:14.349373+0000 mgr.smithi008.flmjzp (mgr.14640) 1109 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:15.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:14.323944+0000 mon.smithi008 (mon.0) 1566 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:14.325193+0000 mon.smithi008 (mon.0) 1567 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:14.326138+0000 mgr.smithi008.flmjzp (mgr.14640) 1106 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:14.326892+0000 mgr.smithi008.flmjzp (mgr.14640) 1107 : cluster [DBG] pgmap v775: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:14.327164+0000 mgr.smithi008.flmjzp (mgr.14640) 1108 : cluster [DBG] pgmap v776: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:14.332289+0000 mon.smithi008 (mon.0) 1568 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:14.338746+0000 mon.smithi008 (mon.0) 1569 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:14.341934+0000 mon.smithi008 (mon.0) 1570 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:15.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:14.343716+0000 mon.smithi008 (mon.0) 1571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:15.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:14.345348+0000 mon.smithi008 (mon.0) 1572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:15.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:14.347389+0000 mon.smithi008 (mon.0) 1573 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:15.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:14.349373+0000 mgr.smithi008.flmjzp (mgr.14640) 1109 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:16.327744+0000 mgr.smithi008.flmjzp (mgr.14640) 1110 : cluster [DBG] pgmap v777: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:17.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:16.327744+0000 mgr.smithi008.flmjzp (mgr.14640) 1110 : cluster [DBG] pgmap v777: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:18.328311+0000 mgr.smithi008.flmjzp (mgr.14640) 1111 : cluster [DBG] pgmap v778: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:19.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:18.328311+0000 mgr.smithi008.flmjzp (mgr.14640) 1111 : cluster [DBG] pgmap v778: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:20.328844+0000 mgr.smithi008.flmjzp (mgr.14640) 1112 : cluster [DBG] pgmap v779: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:21.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:20.328844+0000 mgr.smithi008.flmjzp (mgr.14640) 1112 : cluster [DBG] pgmap v779: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:22.329319+0000 mgr.smithi008.flmjzp (mgr.14640) 1113 : cluster [DBG] pgmap v780: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:23.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:22.329319+0000 mgr.smithi008.flmjzp (mgr.14640) 1113 : cluster [DBG] pgmap v780: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:24.359357+0000 mon.smithi008 (mon.0) 1574 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:24.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:24.359357+0000 mon.smithi008 (mon.0) 1574 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:25.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:24.329872+0000 mgr.smithi008.flmjzp (mgr.14640) 1114 : cluster [DBG] pgmap v781: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:24.329872+0000 mgr.smithi008.flmjzp (mgr.14640) 1114 : cluster [DBG] pgmap v781: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:26.330550+0000 mgr.smithi008.flmjzp (mgr.14640) 1115 : cluster [DBG] pgmap v782: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:26.881311+0000 mon.smithi008 (mon.0) 1575 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:26.882480+0000 mon.smithi008 (mon.0) 1576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:26.883581+0000 mon.smithi008 (mon.0) 1577 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:26.889410+0000 mon.smithi008 (mon.0) 1578 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:26.896749+0000 mon.smithi008 (mon.0) 1579 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:26.899728+0000 mon.smithi008 (mon.0) 1580 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:26.901290+0000 mon.smithi008 (mon.0) 1581 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:26.902890+0000 mon.smithi008 (mon.0) 1582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:26.904834+0000 mon.smithi008 (mon.0) 1583 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:27.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:26.330550+0000 mgr.smithi008.flmjzp (mgr.14640) 1115 : cluster [DBG] pgmap v782: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:26.881311+0000 mon.smithi008 (mon.0) 1575 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:26.882480+0000 mon.smithi008 (mon.0) 1576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:26.883581+0000 mon.smithi008 (mon.0) 1577 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:26.889410+0000 mon.smithi008 (mon.0) 1578 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:26.896749+0000 mon.smithi008 (mon.0) 1579 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:26.899728+0000 mon.smithi008 (mon.0) 1580 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:26.901290+0000 mon.smithi008 (mon.0) 1581 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:26.902890+0000 mon.smithi008 (mon.0) 1582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:26.904834+0000 mon.smithi008 (mon.0) 1583 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:26.884503+0000 mgr.smithi008.flmjzp (mgr.14640) 1116 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:26.885139+0000 mgr.smithi008.flmjzp (mgr.14640) 1117 : cluster [DBG] pgmap v783: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:26.885509+0000 mgr.smithi008.flmjzp (mgr.14640) 1118 : cluster [DBG] pgmap v784: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:26.906719+0000 mgr.smithi008.flmjzp (mgr.14640) 1119 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:27.879106+0000 mon.smithi008 (mon.0) 1584 : cluster [WRN] Health check update: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-10-18T21:17:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:26.884503+0000 mgr.smithi008.flmjzp (mgr.14640) 1116 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:26.885139+0000 mgr.smithi008.flmjzp (mgr.14640) 1117 : cluster [DBG] pgmap v783: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:26.885509+0000 mgr.smithi008.flmjzp (mgr.14640) 1118 : cluster [DBG] pgmap v784: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:26.906719+0000 mgr.smithi008.flmjzp (mgr.14640) 1119 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:27.879106+0000 mon.smithi008 (mon.0) 1584 : cluster [WRN] Health check update: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-10-18T21:17:30.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.477+0000 7f5ff8a47700 1 -- 172.21.15.8:0/602897970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ff40f77d0 msgr2=0x7f5ff40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:30.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.477+0000 7f5ff8a47700 1 --2- 172.21.15.8:0/602897970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ff40f77d0 0x7f5ff40f7c30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f5fe8004660 tx=0x7f5fe8009b30).stop 2023-10-18T21:17:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.477+0000 7f5ff8a47700 1 -- 172.21.15.8:0/602897970 shutdown_connections 2023-10-18T21:17:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.478+0000 7f5ff8a47700 1 --2- 172.21.15.8:0/602897970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ff40f77d0 0x7f5ff40f7c30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.478+0000 7f5ff8a47700 1 --2- 172.21.15.8:0/602897970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff40f6530 0x7f5ff40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.478+0000 7f5ff8a47700 1 -- 172.21.15.8:0/602897970 >> 172.21.15.8:0/602897970 conn(0x7f5ff40f1c90 msgr2=0x7f5ff40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.478+0000 7f5ff8a47700 1 -- 172.21.15.8:0/602897970 shutdown_connections 2023-10-18T21:17:30.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.478+0000 7f5ff8a47700 1 -- 172.21.15.8:0/602897970 wait complete. 2023-10-18T21:17:30.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.479+0000 7f5ff8a47700 1 Processor -- start 2023-10-18T21:17:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.479+0000 7f5ff8a47700 1 -- start start 2023-10-18T21:17:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff8a47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff40f6530 0x7f5ff406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff8a47700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ff40f77d0 0x7f5ff4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff8a47700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff406a380 con 0x7f5ff40f77d0 2023-10-18T21:17:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff8a47700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff406a4c0 con 0x7f5ff40f6530 2023-10-18T21:17:30.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ff40f77d0 0x7f5ff4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:30.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ff40f77d0 0x7f5ff4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47010/0 (socket says 172.21.15.8:47010) 2023-10-18T21:17:30.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff259c700 1 -- 172.21.15.8:0/2302389330 learned_addr learned my addr 172.21.15.8:0/2302389330 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:17:30.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff2d9d700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff40f6530 0x7f5ff406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:30.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff259c700 1 -- 172.21.15.8:0/2302389330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff40f6530 msgr2=0x7f5ff406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff259c700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff40f6530 0x7f5ff406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.480+0000 7f5ff259c700 1 -- 172.21.15.8:0/2302389330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe8005040 con 0x7f5ff40f77d0 2023-10-18T21:17:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.481+0000 7f5ff259c700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ff40f77d0 0x7f5ff4069e20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f5fe8004320 tx=0x7f5fe800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.481+0000 7f5fdb7fe700 1 -- 172.21.15.8:0/2302389330 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fe8019070 con 0x7f5ff40f77d0 2023-10-18T21:17:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.481+0000 7f5fdb7fe700 1 -- 172.21.15.8:0/2302389330 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5fe801e420 con 0x7f5ff40f77d0 2023-10-18T21:17:30.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.481+0000 7f5fdb7fe700 1 -- 172.21.15.8:0/2302389330 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fe8014680 con 0x7f5ff40f77d0 2023-10-18T21:17:30.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.481+0000 7f5ff8a47700 1 -- 172.21.15.8:0/2302389330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff406a740 con 0x7f5ff40f77d0 2023-10-18T21:17:30.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.481+0000 7f5ff8a47700 1 -- 172.21.15.8:0/2302389330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff406ac20 con 0x7f5ff40f77d0 2023-10-18T21:17:30.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.482+0000 7f5ff8a47700 1 -- 172.21.15.8:0/2302389330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff4045ad0 con 0x7f5ff40f77d0 2023-10-18T21:17:30.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.483+0000 7f5fdb7fe700 1 -- 172.21.15.8:0/2302389330 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5fe801e590 con 0x7f5ff40f77d0 2023-10-18T21:17:30.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.484+0000 7f5fdb7fe700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fdc060f70 0x7f5fdc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:30.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.484+0000 7f5fdb7fe700 1 -- 172.21.15.8:0/2302389330 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5fe807dd10 con 0x7f5ff40f77d0 2023-10-18T21:17:30.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.484+0000 7f5ff2d9d700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fdc060f70 0x7f5fdc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:30.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.485+0000 7f5ff2d9d700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fdc060f70 0x7f5fdc063430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f5ff406b730 tx=0x7f5fe400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:30.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.489+0000 7f5fdb7fe700 1 -- 172.21.15.8:0/2302389330 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5fe804d8e0 con 0x7f5ff40f77d0 2023-10-18T21:17:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:28.886245+0000 mgr.smithi008.flmjzp (mgr.14640) 1120 : cluster [DBG] pgmap v785: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:30.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.686+0000 7f5ff8a47700 1 -- 172.21.15.8:0/2302389330 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ff40fedd0 con 0x7f5fdc060f70 2023-10-18T21:17:30.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.687+0000 7f5fdb7fe700 1 -- 172.21.15.8:0/2302389330 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5ff40fedd0 con 0x7f5fdc060f70 2023-10-18T21:17:30.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 -- 172.21.15.8:0/2302389330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fdc060f70 msgr2=0x7f5fdc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:30.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fdc060f70 0x7f5fdc063430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f5ff406b730 tx=0x7f5fe400b040).stop 2023-10-18T21:17:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 -- 172.21.15.8:0/2302389330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ff40f77d0 msgr2=0x7f5ff4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ff40f77d0 0x7f5ff4069e20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f5fe8004320 tx=0x7f5fe800b040).stop 2023-10-18T21:17:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 -- 172.21.15.8:0/2302389330 shutdown_connections 2023-10-18T21:17:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fdc060f70 0x7f5fdc063430 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff40f6530 0x7f5ff406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 --2- 172.21.15.8:0/2302389330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ff40f77d0 0x7f5ff4069e20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 -- 172.21.15.8:0/2302389330 >> 172.21.15.8:0/2302389330 conn(0x7f5ff40f1c90 msgr2=0x7f5ff40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 -- 172.21.15.8:0/2302389330 shutdown_connections 2023-10-18T21:17:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.689+0000 7f5ff8a47700 1 -- 172.21.15.8:0/2302389330 wait complete. 2023-10-18T21:17:30.706 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:17:30.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:28.886245+0000 mgr.smithi008.flmjzp (mgr.14640) 1120 : cluster [DBG] pgmap v785: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:30.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.827+0000 7f1e3d731700 1 -- 172.21.15.8:0/173657201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e380f77d0 msgr2=0x7f1e380f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:30.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.827+0000 7f1e3d731700 1 --2- 172.21.15.8:0/173657201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e380f77d0 0x7f1e380f7c30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f1e2c004660 tx=0x7f1e2c009b30).stop 2023-10-18T21:17:30.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.827+0000 7f1e3d731700 1 -- 172.21.15.8:0/173657201 shutdown_connections 2023-10-18T21:17:30.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.827+0000 7f1e3d731700 1 --2- 172.21.15.8:0/173657201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e380f77d0 0x7f1e380f7c30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:30.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.827+0000 7f1e3d731700 1 --2- 172.21.15.8:0/173657201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e380f6530 0x7f1e380f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:30.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.827+0000 7f1e3d731700 1 -- 172.21.15.8:0/173657201 >> 172.21.15.8:0/173657201 conn(0x7f1e380f1c90 msgr2=0x7f1e380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:30.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.827+0000 7f1e3d731700 1 -- 172.21.15.8:0/173657201 shutdown_connections 2023-10-18T21:17:30.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.827+0000 7f1e3d731700 1 -- 172.21.15.8:0/173657201 wait complete. 2023-10-18T21:17:30.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.828+0000 7f1e3d731700 1 Processor -- start 2023-10-18T21:17:30.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.828+0000 7f1e3d731700 1 -- start start 2023-10-18T21:17:30.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.829+0000 7f1e3d731700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e380f6530 0x7f1e38108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:30.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.829+0000 7f1e3d731700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e380f77d0 0x7f1e38109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:30.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.829+0000 7f1e3d731700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e381099c0 con 0x7f1e380f6530 2023-10-18T21:17:30.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.829+0000 7f1e3d731700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e38109b00 con 0x7f1e380f77d0 2023-10-18T21:17:30.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.829+0000 7f1e37fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e380f6530 0x7f1e38108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:30.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.829+0000 7f1e37fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e380f6530 0x7f1e38108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47028/0 (socket says 172.21.15.8:47028) 2023-10-18T21:17:30.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.829+0000 7f1e37fff700 1 -- 172.21.15.8:0/51229063 learned_addr learned my addr 172.21.15.8:0/51229063 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:17:30.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.829+0000 7f1e377fe700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e380f77d0 0x7f1e38109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:30.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.830+0000 7f1e37fff700 1 -- 172.21.15.8:0/51229063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e380f77d0 msgr2=0x7f1e38109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:30.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.830+0000 7f1e37fff700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e380f77d0 0x7f1e38109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:30.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.830+0000 7f1e37fff700 1 -- 172.21.15.8:0/51229063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c005040 con 0x7f1e380f6530 2023-10-18T21:17:30.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.830+0000 7f1e37fff700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e380f6530 0x7f1e38108f20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f1e2800e7c0 tx=0x7f1e2800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:30.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.830+0000 7f1e34ff9700 1 -- 172.21.15.8:0/51229063 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e280092e0 con 0x7f1e380f6530 2023-10-18T21:17:30.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.830+0000 7f1e34ff9700 1 -- 172.21.15.8:0/51229063 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1e2800f040 con 0x7f1e380f6530 2023-10-18T21:17:30.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.830+0000 7f1e3d731700 1 -- 172.21.15.8:0/51229063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3810a4a0 con 0x7f1e380f6530 2023-10-18T21:17:30.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.830+0000 7f1e34ff9700 1 -- 172.21.15.8:0/51229063 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e28014810 con 0x7f1e380f6530 2023-10-18T21:17:30.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.830+0000 7f1e3d731700 1 -- 172.21.15.8:0/51229063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3810a9e0 con 0x7f1e380f6530 2023-10-18T21:17:30.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.831+0000 7f1e3d731700 1 -- 172.21.15.8:0/51229063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e38045ad0 con 0x7f1e380f6530 2023-10-18T21:17:30.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.833+0000 7f1e34ff9700 1 -- 172.21.15.8:0/51229063 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1e2801b030 con 0x7f1e380f6530 2023-10-18T21:17:30.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.834+0000 7f1e34ff9700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e20060f70 0x7f1e20063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:30.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.834+0000 7f1e34ff9700 1 -- 172.21.15.8:0/51229063 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1e2807c890 con 0x7f1e380f6530 2023-10-18T21:17:30.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.834+0000 7f1e377fe700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e20060f70 0x7f1e20063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:30.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.835+0000 7f1e377fe700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e20060f70 0x7f1e20063430 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f1e2c009720 tx=0x7f1e2c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:30.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:30.838+0000 7f1e34ff9700 1 -- 172.21.15.8:0/51229063 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1e2804ff30 con 0x7f1e380f6530 2023-10-18T21:17:31.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.039+0000 7f1e3d731700 1 -- 172.21.15.8:0/51229063 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e3810ac60 con 0x7f1e20060f70 2023-10-18T21:17:31.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.041+0000 7f1e34ff9700 1 -- 172.21.15.8:0/51229063 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1e3810ac60 con 0x7f1e20060f70 2023-10-18T21:17:31.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.042+0000 7f1e3d731700 1 -- 172.21.15.8:0/51229063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e20060f70 msgr2=0x7f1e20063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.042+0000 7f1e3d731700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e20060f70 0x7f1e20063430 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f1e2c009720 tx=0x7f1e2c016040).stop 2023-10-18T21:17:31.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.043+0000 7f1e3d731700 1 -- 172.21.15.8:0/51229063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e380f6530 msgr2=0x7f1e38108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.043+0000 7f1e3d731700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e380f6530 0x7f1e38108f20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f1e2800e7c0 tx=0x7f1e2800b040).stop 2023-10-18T21:17:31.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.043+0000 7f1e3d731700 1 -- 172.21.15.8:0/51229063 shutdown_connections 2023-10-18T21:17:31.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.043+0000 7f1e3d731700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e20060f70 0x7f1e20063430 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.043+0000 7f1e3d731700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e380f6530 0x7f1e38108f20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.043+0000 7f1e3d731700 1 --2- 172.21.15.8:0/51229063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e380f77d0 0x7f1e38109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.043+0000 7f1e3d731700 1 -- 172.21.15.8:0/51229063 >> 172.21.15.8:0/51229063 conn(0x7f1e380f1c90 msgr2=0x7f1e3806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:31.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.043+0000 7f1e3d731700 1 -- 172.21.15.8:0/51229063 shutdown_connections 2023-10-18T21:17:31.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.043+0000 7f1e3d731700 1 -- 172.21.15.8:0/51229063 wait complete. 2023-10-18T21:17:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.178+0000 7f2117fff700 1 -- 172.21.15.8:0/1972442392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21180f6530 msgr2=0x7f21180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.178+0000 7f2117fff700 1 --2- 172.21.15.8:0/1972442392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21180f6530 0x7f21180f6950 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f2108004660 tx=0x7f2108009b30).stop 2023-10-18T21:17:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.179+0000 7f2117fff700 1 -- 172.21.15.8:0/1972442392 shutdown_connections 2023-10-18T21:17:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.179+0000 7f2117fff700 1 --2- 172.21.15.8:0/1972442392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21180f77d0 0x7f21180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.179+0000 7f2117fff700 1 --2- 172.21.15.8:0/1972442392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21180f6530 0x7f21180f6950 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.179+0000 7f2117fff700 1 -- 172.21.15.8:0/1972442392 >> 172.21.15.8:0/1972442392 conn(0x7f21180f1c90 msgr2=0x7f21180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.179+0000 7f2117fff700 1 -- 172.21.15.8:0/1972442392 shutdown_connections 2023-10-18T21:17:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.179+0000 7f2117fff700 1 -- 172.21.15.8:0/1972442392 wait complete. 2023-10-18T21:17:31.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.179+0000 7f2117fff700 1 Processor -- start 2023-10-18T21:17:31.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.180+0000 7f2117fff700 1 -- start start 2023-10-18T21:17:31.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.180+0000 7f2117fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21180f77d0 0x7f2118106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:31.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.180+0000 7f2117fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107450 0x7f2118108340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:31.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.180+0000 7f2117fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2118107920 con 0x7f2118107450 2023-10-18T21:17:31.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.180+0000 7f2117fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2118107a60 con 0x7f21180f77d0 2023-10-18T21:17:31.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.180+0000 7f21167fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107450 0x7f2118108340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:31.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.180+0000 7f21167fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107450 0x7f2118108340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47042/0 (socket says 172.21.15.8:47042) 2023-10-18T21:17:31.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.180+0000 7f21167fc700 1 -- 172.21.15.8:0/3976036057 learned_addr learned my addr 172.21.15.8:0/3976036057 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:17:31.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.180+0000 7f2116ffd700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21180f77d0 0x7f2118106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:31.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.181+0000 7f21167fc700 1 -- 172.21.15.8:0/3976036057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21180f77d0 msgr2=0x7f2118106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.181+0000 7f21167fc700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21180f77d0 0x7f2118106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.181+0000 7f21167fc700 1 -- 172.21.15.8:0/3976036057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108005040 con 0x7f2118107450 2023-10-18T21:17:31.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.181+0000 7f21167fc700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107450 0x7f2118108340 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f210c0026d0 tx=0x7f210c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:31.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.181+0000 7f20ff7fe700 1 -- 172.21.15.8:0/3976036057 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f210c0079c0 con 0x7f2118107450 2023-10-18T21:17:31.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.181+0000 7f20ff7fe700 1 -- 172.21.15.8:0/3976036057 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f210c00f040 con 0x7f2118107450 2023-10-18T21:17:31.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.181+0000 7f20ff7fe700 1 -- 172.21.15.8:0/3976036057 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f210c014980 con 0x7f2118107450 2023-10-18T21:17:31.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.181+0000 7f2117fff700 1 -- 172.21.15.8:0/3976036057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21181088f0 con 0x7f2118107450 2023-10-18T21:17:31.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.181+0000 7f2117fff700 1 -- 172.21.15.8:0/3976036057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2118108eb0 con 0x7f2118107450 2023-10-18T21:17:31.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.182+0000 7f2117fff700 1 -- 172.21.15.8:0/3976036057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2118059100 con 0x7f2118107450 2023-10-18T21:17:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.183+0000 7f20ff7fe700 1 -- 172.21.15.8:0/3976036057 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f210c0090d0 con 0x7f2118107450 2023-10-18T21:17:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.184+0000 7f20ff7fe700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2100060f70 0x7f2100063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.184+0000 7f20ff7fe700 1 -- 172.21.15.8:0/3976036057 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f210c07c8a0 con 0x7f2118107450 2023-10-18T21:17:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.185+0000 7f2116ffd700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2100060f70 0x7f2100063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.185+0000 7f2116ffd700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2100060f70 0x7f2100063430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f2108000c00 tx=0x7f2108009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:31.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.188+0000 7f20ff7fe700 1 -- 172.21.15.8:0/3976036057 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f210c04ffb0 con 0x7f2118107450 2023-10-18T21:17:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.379+0000 7f2117fff700 1 -- 172.21.15.8:0/3976036057 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f21180fed30 con 0x7f2100060f70 2023-10-18T21:17:31.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.388+0000 7f20ff7fe700 1 -- 172.21.15.8:0/3976036057 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f21180fed30 con 0x7f2100060f70 2023-10-18T21:17:31.390 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:17:31.391 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (24m) 2m ago 25m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:17:31.391 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (18m) 2m ago 25m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:17:31.391 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (17m) 4s ago 24m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:17:31.391 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (24m) 2m ago 25m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:17:31.391 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 21m - - 2023-10-18T21:17:31.392 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 21m - - 2023-10-18T21:17:31.392 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4s ago 21m - - 2023-10-18T21:17:31.392 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4s ago 21m - - 2023-10-18T21:17:31.392 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (19m) 2m ago 27m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:17:31.392 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (18m) 4s ago 24m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:17:31.393 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (18m) 2m ago 27m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:17:31.393 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (18m) 4s ago 24m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:17:31.393 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (25m) 2m ago 25m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:17:31.393 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (24m) 4s ago 24m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:17:31.393 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (17m) 2m ago 24m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:17:31.394 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (15m) 2m ago 23m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:17:31.394 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (15m) 2m ago 23m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:17:31.394 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (14m) 4s ago 23m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:17:31.394 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (14m) 4s ago 23m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:17:31.394 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (13m) 4s ago 22m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:17:31.395 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (19m) 2m ago 24m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:17:31.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.390+0000 7f2117fff700 1 -- 172.21.15.8:0/3976036057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2100060f70 msgr2=0x7f2100063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.390+0000 7f2117fff700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2100060f70 0x7f2100063430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f2108000c00 tx=0x7f2108009b30).stop 2023-10-18T21:17:31.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.390+0000 7f2117fff700 1 -- 172.21.15.8:0/3976036057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107450 msgr2=0x7f2118108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.390+0000 7f2117fff700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107450 0x7f2118108340 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f210c0026d0 tx=0x7f210c009de0).stop 2023-10-18T21:17:31.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.390+0000 7f2117fff700 1 -- 172.21.15.8:0/3976036057 shutdown_connections 2023-10-18T21:17:31.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.390+0000 7f2117fff700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2100060f70 0x7f2100063430 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.390+0000 7f2117fff700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21180f77d0 0x7f2118106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.390+0000 7f2117fff700 1 --2- 172.21.15.8:0/3976036057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107450 0x7f2118108340 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.390+0000 7f2117fff700 1 -- 172.21.15.8:0/3976036057 >> 172.21.15.8:0/3976036057 conn(0x7f21180f1c90 msgr2=0x7f21180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.391+0000 7f2117fff700 1 -- 172.21.15.8:0/3976036057 shutdown_connections 2023-10-18T21:17:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.391+0000 7f2117fff700 1 -- 172.21.15.8:0/3976036057 wait complete. 2023-10-18T21:17:31.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:30.688408+0000 mgr.smithi008.flmjzp (mgr.14640) 1121 : audit [DBG] from='client.35100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.527+0000 7fce95b00700 1 -- 172.21.15.8:0/2839797279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f77d0 msgr2=0x7fce900f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.527+0000 7fce95b00700 1 --2- 172.21.15.8:0/2839797279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f77d0 0x7fce900f7c30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fce7c004660 tx=0x7fce7c009b30).stop 2023-10-18T21:17:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.527+0000 7fce95b00700 1 -- 172.21.15.8:0/2839797279 shutdown_connections 2023-10-18T21:17:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.527+0000 7fce95b00700 1 --2- 172.21.15.8:0/2839797279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f77d0 0x7fce900f7c30 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.527+0000 7fce95b00700 1 --2- 172.21.15.8:0/2839797279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f6530 0x7fce900f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.527+0000 7fce95b00700 1 -- 172.21.15.8:0/2839797279 >> 172.21.15.8:0/2839797279 conn(0x7fce900f1c90 msgr2=0x7fce900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.527+0000 7fce95b00700 1 -- 172.21.15.8:0/2839797279 shutdown_connections 2023-10-18T21:17:31.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.527+0000 7fce95b00700 1 -- 172.21.15.8:0/2839797279 wait complete. 2023-10-18T21:17:31.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.528+0000 7fce95b00700 1 Processor -- start 2023-10-18T21:17:31.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.528+0000 7fce95b00700 1 -- start start 2023-10-18T21:17:31.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.528+0000 7fce95b00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f6530 0x7fce9006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:31.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.528+0000 7fce95b00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f77d0 0x7fce90069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:31.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.528+0000 7fce95b00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9006a380 con 0x7fce900f77d0 2023-10-18T21:17:31.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.528+0000 7fce95b00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9006a4c0 con 0x7fce900f6530 2023-10-18T21:17:31.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.529+0000 7fce8ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f77d0 0x7fce90069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:31.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.529+0000 7fce8ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f77d0 0x7fce90069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47056/0 (socket says 172.21.15.8:47056) 2023-10-18T21:17:31.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.529+0000 7fce8ffff700 1 -- 172.21.15.8:0/3127086282 learned_addr learned my addr 172.21.15.8:0/3127086282 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:17:31.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.529+0000 7fce94afe700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f6530 0x7fce9006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:31.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.529+0000 7fce8ffff700 1 -- 172.21.15.8:0/3127086282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f6530 msgr2=0x7fce9006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.529+0000 7fce8ffff700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f6530 0x7fce9006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.529+0000 7fce8ffff700 1 -- 172.21.15.8:0/3127086282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c005040 con 0x7fce900f77d0 2023-10-18T21:17:31.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.529+0000 7fce8ffff700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f77d0 0x7fce90069e20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fce7c009f50 tx=0x7fce7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:31.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.530+0000 7fce8d7fa700 1 -- 172.21.15.8:0/3127086282 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce7c018070 con 0x7fce900f77d0 2023-10-18T21:17:31.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.530+0000 7fce8d7fa700 1 -- 172.21.15.8:0/3127086282 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fce7c009630 con 0x7fce900f77d0 2023-10-18T21:17:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.530+0000 7fce95b00700 1 -- 172.21.15.8:0/3127086282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9006a740 con 0x7fce900f77d0 2023-10-18T21:17:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.530+0000 7fce8d7fa700 1 -- 172.21.15.8:0/3127086282 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce7c01c3c0 con 0x7fce900f77d0 2023-10-18T21:17:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.530+0000 7fce95b00700 1 -- 172.21.15.8:0/3127086282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9006aca0 con 0x7fce900f77d0 2023-10-18T21:17:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.531+0000 7fce95b00700 1 -- 172.21.15.8:0/3127086282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce90045ad0 con 0x7fce900f77d0 2023-10-18T21:17:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.532+0000 7fce8d7fa700 1 -- 172.21.15.8:0/3127086282 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fce7c01d420 con 0x7fce900f77d0 2023-10-18T21:17:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.533+0000 7fce8d7fa700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce80060f70 0x7fce80063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.533+0000 7fce8d7fa700 1 -- 172.21.15.8:0/3127086282 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fce7c07e600 con 0x7fce900f77d0 2023-10-18T21:17:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.533+0000 7fce94afe700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce80060f70 0x7fce80063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.533+0000 7fce94afe700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce80060f70 0x7fce80063430 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fce9006b730 tx=0x7fce84009c80).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:31.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.537+0000 7fce8d7fa700 1 -- 172.21.15.8:0/3127086282 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fce7c04e310 con 0x7fce900f77d0 2023-10-18T21:17:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:30.688408+0000 mgr.smithi008.flmjzp (mgr.14640) 1121 : audit [DBG] from='client.35100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:31.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.789+0000 7fce95b00700 1 -- 172.21.15.8:0/3127086282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fce900fecc0 con 0x7fce900f77d0 2023-10-18T21:17:31.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.789+0000 7fce8d7fa700 1 -- 172.21.15.8:0/3127086282 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fce7c051930 con 0x7fce900f77d0 2023-10-18T21:17:31.792 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:17:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:17:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:17:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:17:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:17:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:17:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:17:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:17:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:17:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:17:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:17:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:17:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:17:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:17:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:17:31.795 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:17:31.795 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:17:31.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.791+0000 7fce95b00700 1 -- 172.21.15.8:0/3127086282 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce80060f70 msgr2=0x7fce80063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.791+0000 7fce95b00700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce80060f70 0x7fce80063430 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fce9006b730 tx=0x7fce84009c80).stop 2023-10-18T21:17:31.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.791+0000 7fce95b00700 1 -- 172.21.15.8:0/3127086282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f77d0 msgr2=0x7fce90069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.791+0000 7fce95b00700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f77d0 0x7fce90069e20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fce7c009f50 tx=0x7fce7c009b30).stop 2023-10-18T21:17:31.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.791+0000 7fce95b00700 1 -- 172.21.15.8:0/3127086282 shutdown_connections 2023-10-18T21:17:31.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.791+0000 7fce95b00700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce80060f70 0x7fce80063430 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.791+0000 7fce95b00700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f6530 0x7fce9006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.791+0000 7fce95b00700 1 --2- 172.21.15.8:0/3127086282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f77d0 0x7fce90069e20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.791+0000 7fce95b00700 1 -- 172.21.15.8:0/3127086282 >> 172.21.15.8:0/3127086282 conn(0x7fce900f1c90 msgr2=0x7fce900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:31.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.791+0000 7fce95b00700 1 -- 172.21.15.8:0/3127086282 shutdown_connections 2023-10-18T21:17:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.792+0000 7fce95b00700 1 -- 172.21.15.8:0/3127086282 wait complete. 2023-10-18T21:17:31.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.927+0000 7f7ca8bea700 1 -- 172.21.15.8:0/17239949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 msgr2=0x7f7ca40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.927+0000 7f7ca8bea700 1 --2- 172.21.15.8:0/17239949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca40f7c30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f7c98004660 tx=0x7f7c98009b30).stop 2023-10-18T21:17:31.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.927+0000 7f7ca8bea700 1 -- 172.21.15.8:0/17239949 shutdown_connections 2023-10-18T21:17:31.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.927+0000 7f7ca8bea700 1 --2- 172.21.15.8:0/17239949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca40f7c30 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.927+0000 7f7ca8bea700 1 --2- 172.21.15.8:0/17239949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 0x7f7ca40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.927+0000 7f7ca8bea700 1 -- 172.21.15.8:0/17239949 >> 172.21.15.8:0/17239949 conn(0x7f7ca40f1c90 msgr2=0x7f7ca40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:31.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.927+0000 7f7ca8bea700 1 -- 172.21.15.8:0/17239949 shutdown_connections 2023-10-18T21:17:31.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.927+0000 7f7ca8bea700 1 -- 172.21.15.8:0/17239949 wait complete. 2023-10-18T21:17:31.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.928+0000 7f7ca8bea700 1 Processor -- start 2023-10-18T21:17:31.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.928+0000 7f7ca8bea700 1 -- start start 2023-10-18T21:17:31.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca8bea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 0x7f7ca4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:31.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca8bea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:31.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca8bea700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4107880 con 0x7f7ca40f77d0 2023-10-18T21:17:31.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca8bea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41080c0 con 0x7f7ca40f6530 2023-10-18T21:17:31.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:31.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47062/0 (socket says 172.21.15.8:47062) 2023-10-18T21:17:31.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca2ffd700 1 -- 172.21.15.8:0/850192553 learned_addr learned my addr 172.21.15.8:0/850192553 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:17:31.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca37fe700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 0x7f7ca4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:31.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca2ffd700 1 -- 172.21.15.8:0/850192553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 msgr2=0x7f7ca4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:31.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca2ffd700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 0x7f7ca4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:31.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.929+0000 7f7ca2ffd700 1 -- 172.21.15.8:0/850192553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98005040 con 0x7f7ca40f77d0 2023-10-18T21:17:31.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.930+0000 7f7ca2ffd700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4107280 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f7c98009f50 tx=0x7f7c98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:31.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.930+0000 7f7c8bfff700 1 -- 172.21.15.8:0/850192553 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c98018070 con 0x7f7ca40f77d0 2023-10-18T21:17:31.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.930+0000 7f7ca8bea700 1 -- 172.21.15.8:0/850192553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca4108340 con 0x7f7ca40f77d0 2023-10-18T21:17:31.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.930+0000 7f7c8bfff700 1 -- 172.21.15.8:0/850192553 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7c98009630 con 0x7f7ca40f77d0 2023-10-18T21:17:31.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.930+0000 7f7c8bfff700 1 -- 172.21.15.8:0/850192553 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c9801c3c0 con 0x7f7ca40f77d0 2023-10-18T21:17:31.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.930+0000 7f7ca8bea700 1 -- 172.21.15.8:0/850192553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca4108820 con 0x7f7ca40f77d0 2023-10-18T21:17:31.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.931+0000 7f7ca8bea700 1 -- 172.21.15.8:0/850192553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca4059100 con 0x7f7ca40f77d0 2023-10-18T21:17:31.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.932+0000 7f7c8bfff700 1 -- 172.21.15.8:0/850192553 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7c9801d420 con 0x7f7ca40f77d0 2023-10-18T21:17:31.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.933+0000 7f7c8bfff700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 0x7f7c8c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:31.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.933+0000 7f7c8bfff700 1 -- 172.21.15.8:0/850192553 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7c9807e480 con 0x7f7ca40f77d0 2023-10-18T21:17:31.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.933+0000 7f7ca37fe700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 0x7f7c8c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:31.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.934+0000 7f7ca37fe700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 0x7f7c8c063430 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7ca4107b50 tx=0x7f7c9400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:31.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:31.937+0000 7f7c8bfff700 1 -- 172.21.15.8:0/850192553 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7c9804e170 con 0x7f7ca40f77d0 2023-10-18T21:17:32.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.161+0000 7f7ca8bea700 1 -- 172.21.15.8:0/850192553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7ca4027a00 con 0x7f7ca40f77d0 2023-10-18T21:17:32.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.161+0000 7f7c8bfff700 1 -- 172.21.15.8:0/850192553 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f7c98051790 con 0x7f7ca40f77d0 2023-10-18T21:17:32.163 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:17:32.164 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:17:32.164 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:17:32.164 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:17:32.164 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:17:32.165 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:17:32.165 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:17:32.165 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:17:32.165 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:17:32.165 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:17:32.166 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:17:32.166 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:17:32.166 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:17:32.166 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:17:32.166 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:17:32.167 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:17:32.167 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:17:32.167 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:17:32.167 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:17:32.167 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:17:32.167 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:17:32.168 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:17:32.168 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:17:32.168 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:17:32.168 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:17:32.168 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:17:32.169 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:17:32.169 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:17:32.169 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:17:32.169 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:17:32.169 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:17:32.170 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:17:32.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:17:32.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:17:32.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 -- 172.21.15.8:0/850192553 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 msgr2=0x7f7c8c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:32.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 0x7f7c8c063430 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7ca4107b50 tx=0x7f7c9400b040).stop 2023-10-18T21:17:32.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 -- 172.21.15.8:0/850192553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 msgr2=0x7f7ca4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:32.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4107280 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f7c98009f50 tx=0x7f7c98009b30).stop 2023-10-18T21:17:32.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 -- 172.21.15.8:0/850192553 shutdown_connections 2023-10-18T21:17:32.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 0x7f7c8c063430 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:32.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 0x7f7ca4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:32.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 --2- 172.21.15.8:0/850192553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4107280 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:32.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 -- 172.21.15.8:0/850192553 >> 172.21.15.8:0/850192553 conn(0x7f7ca40f1c90 msgr2=0x7f7ca40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:32.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 -- 172.21.15.8:0/850192553 shutdown_connections 2023-10-18T21:17:32.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.163+0000 7f7ca8bea700 1 -- 172.21.15.8:0/850192553 wait complete. 2023-10-18T21:17:32.173 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:17:32.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.300+0000 7f5bccb72700 1 -- 172.21.15.8:0/2634975903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc80f77d0 msgr2=0x7f5bc80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:32.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.300+0000 7f5bccb72700 1 --2- 172.21.15.8:0/2634975903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc80f77d0 0x7f5bc80f7c30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f5bbc004660 tx=0x7f5bbc009b30).stop 2023-10-18T21:17:32.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.300+0000 7f5bccb72700 1 -- 172.21.15.8:0/2634975903 shutdown_connections 2023-10-18T21:17:32.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.300+0000 7f5bccb72700 1 --2- 172.21.15.8:0/2634975903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc80f77d0 0x7f5bc80f7c30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:32.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.300+0000 7f5bccb72700 1 --2- 172.21.15.8:0/2634975903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc80f6530 0x7f5bc80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:32.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.300+0000 7f5bccb72700 1 -- 172.21.15.8:0/2634975903 >> 172.21.15.8:0/2634975903 conn(0x7f5bc80f1c90 msgr2=0x7f5bc80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:32.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.300+0000 7f5bccb72700 1 -- 172.21.15.8:0/2634975903 shutdown_connections 2023-10-18T21:17:32.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.300+0000 7f5bccb72700 1 -- 172.21.15.8:0/2634975903 wait complete. 2023-10-18T21:17:32.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.301+0000 7f5bccb72700 1 Processor -- start 2023-10-18T21:17:32.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.301+0000 7f5bccb72700 1 -- start start 2023-10-18T21:17:32.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bccb72700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc80f6530 0x7f5bc8108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:32.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bccb72700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc80f77d0 0x7f5bc8109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:32.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bccb72700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc81099b0 con 0x7f5bc80f77d0 2023-10-18T21:17:32.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bccb72700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8109af0 con 0x7f5bc80f6530 2023-10-18T21:17:32.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bc6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc80f77d0 0x7f5bc8109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bc6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc80f77d0 0x7f5bc8109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47072/0 (socket says 172.21.15.8:47072) 2023-10-18T21:17:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bc6ffd700 1 -- 172.21.15.8:0/1875239345 learned_addr learned my addr 172.21.15.8:0/1875239345 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:17:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bc77fe700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc80f6530 0x7f5bc8108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bc6ffd700 1 -- 172.21.15.8:0/1875239345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc80f6530 msgr2=0x7f5bc8108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:32.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bc6ffd700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc80f6530 0x7f5bc8108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:32.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bc6ffd700 1 -- 172.21.15.8:0/1875239345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc005040 con 0x7f5bc80f77d0 2023-10-18T21:17:32.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.302+0000 7f5bc77fe700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc80f6530 0x7f5bc8108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:17:32.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.303+0000 7f5bc6ffd700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc80f77d0 0x7f5bc8109400 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f5bbc009990 tx=0x7f5bbc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:32.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.303+0000 7f5baffff700 1 -- 172.21.15.8:0/1875239345 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bbc018070 con 0x7f5bc80f77d0 2023-10-18T21:17:32.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.303+0000 7f5baffff700 1 -- 172.21.15.8:0/1875239345 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5bbc009780 con 0x7f5bc80f77d0 2023-10-18T21:17:32.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.303+0000 7f5baffff700 1 -- 172.21.15.8:0/1875239345 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bbc01c5a0 con 0x7f5bc80f77d0 2023-10-18T21:17:32.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.303+0000 7f5bccb72700 1 -- 172.21.15.8:0/1875239345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc810a430 con 0x7f5bc80f77d0 2023-10-18T21:17:32.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.303+0000 7f5bccb72700 1 -- 172.21.15.8:0/1875239345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc810a990 con 0x7f5bc80f77d0 2023-10-18T21:17:32.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.304+0000 7f5bccb72700 1 -- 172.21.15.8:0/1875239345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc8045ad0 con 0x7f5bc80f77d0 2023-10-18T21:17:32.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.305+0000 7f5baffff700 1 -- 172.21.15.8:0/1875239345 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5bbc01db30 con 0x7f5bc80f77d0 2023-10-18T21:17:32.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.306+0000 7f5baffff700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bb0060f70 0x7f5bb0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:17:32.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.306+0000 7f5baffff700 1 -- 172.21.15.8:0/1875239345 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5bbc07e940 con 0x7f5bc80f77d0 2023-10-18T21:17:32.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.306+0000 7f5bc77fe700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bb0060f70 0x7f5bb0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:17:32.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.307+0000 7f5bc77fe700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bb0060f70 0x7f5bb0063430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f5bc80f7630 tx=0x7f5bb8009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:17:32.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.310+0000 7f5baffff700 1 -- 172.21.15.8:0/1875239345 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5bbc051f20 con 0x7f5bc80f77d0 2023-10-18T21:17:32.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.515+0000 7f5bccb72700 1 -- 172.21.15.8:0/1875239345 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bc80fed30 con 0x7f5bb0060f70 2023-10-18T21:17:32.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.516+0000 7f5baffff700 1 -- 172.21.15.8:0/1875239345 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5bc80fed30 con 0x7f5bb0060f70 2023-10-18T21:17:32.518 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:17:32.519 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:17:32.519 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:17:32.519 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:17:32.519 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:17:32.519 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:17:32.520 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:17:32.520 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:17:32.520 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:17:32.520 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:17:32.520 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:17:32.521 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:17:32.521 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:17:32.521 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:17:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.518+0000 7f5bccb72700 1 -- 172.21.15.8:0/1875239345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bb0060f70 msgr2=0x7f5bb0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.518+0000 7f5bccb72700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bb0060f70 0x7f5bb0063430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f5bc80f7630 tx=0x7f5bb8009040).stop 2023-10-18T21:17:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.518+0000 7f5bccb72700 1 -- 172.21.15.8:0/1875239345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc80f77d0 msgr2=0x7f5bc8109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:17:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.518+0000 7f5bccb72700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc80f77d0 0x7f5bc8109400 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f5bbc009990 tx=0x7f5bbc009b30).stop 2023-10-18T21:17:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.519+0000 7f5bccb72700 1 -- 172.21.15.8:0/1875239345 shutdown_connections 2023-10-18T21:17:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.519+0000 7f5bccb72700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bb0060f70 0x7f5bb0063430 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.519+0000 7f5bccb72700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc80f6530 0x7f5bc8108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.519+0000 7f5bccb72700 1 --2- 172.21.15.8:0/1875239345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc80f77d0 0x7f5bc8109400 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:17:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.519+0000 7f5bccb72700 1 -- 172.21.15.8:0/1875239345 >> 172.21.15.8:0/1875239345 conn(0x7f5bc80f1c90 msgr2=0x7f5bc806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:17:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.519+0000 7f5bccb72700 1 -- 172.21.15.8:0/1875239345 shutdown_connections 2023-10-18T21:17:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:17:32.519+0000 7f5bccb72700 1 -- 172.21.15.8:0/1875239345 wait complete. 2023-10-18T21:17:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:30.886682+0000 mgr.smithi008.flmjzp (mgr.14640) 1122 : cluster [DBG] pgmap v786: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:31.042029+0000 mgr.smithi008.flmjzp (mgr.14640) 1123 : audit [DBG] from='client.35104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:31.381384+0000 mgr.smithi008.flmjzp (mgr.14640) 1124 : audit [DBG] from='client.35108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:31.790963+0000 mon.smithi008 (mon.0) 1585 : audit [DBG] from='client.? 172.21.15.8:0/3127086282' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:32.162924+0000 mon.smithi008 (mon.0) 1586 : audit [DBG] from='client.? 172.21.15.8:0/850192553' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:17:32.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:30.886682+0000 mgr.smithi008.flmjzp (mgr.14640) 1122 : cluster [DBG] pgmap v786: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:31.042029+0000 mgr.smithi008.flmjzp (mgr.14640) 1123 : audit [DBG] from='client.35104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:31.381384+0000 mgr.smithi008.flmjzp (mgr.14640) 1124 : audit [DBG] from='client.35108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:31.790963+0000 mon.smithi008 (mon.0) 1585 : audit [DBG] from='client.? 172.21.15.8:0/3127086282' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:32.162924+0000 mon.smithi008 (mon.0) 1586 : audit [DBG] from='client.? 172.21.15.8:0/850192553' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:17:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:32.517838+0000 mgr.smithi008.flmjzp (mgr.14640) 1125 : audit [DBG] from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:33.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:32.517838+0000 mgr.smithi008.flmjzp (mgr.14640) 1125 : audit [DBG] from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:17:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:32.887167+0000 mgr.smithi008.flmjzp (mgr.14640) 1126 : cluster [DBG] pgmap v787: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:34.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:32.887167+0000 mgr.smithi008.flmjzp (mgr.14640) 1126 : cluster [DBG] pgmap v787: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:34.887765+0000 mgr.smithi008.flmjzp (mgr.14640) 1127 : cluster [DBG] pgmap v788: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:34.887765+0000 mgr.smithi008.flmjzp (mgr.14640) 1127 : cluster [DBG] pgmap v788: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:37.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:36.913057+0000 mon.smithi008 (mon.0) 1587 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:36.915475+0000 mon.smithi008 (mon.0) 1588 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:36.916576+0000 mon.smithi008 (mon.0) 1589 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:36.923520+0000 mon.smithi008 (mon.0) 1590 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:36.929812+0000 mon.smithi008 (mon.0) 1591 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:36.932954+0000 mon.smithi008 (mon.0) 1592 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:36.934645+0000 mon.smithi008 (mon.0) 1593 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:36.936226+0000 mon.smithi008 (mon.0) 1594 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:36.938268+0000 mon.smithi008 (mon.0) 1595 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:36.913057+0000 mon.smithi008 (mon.0) 1587 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:36.915475+0000 mon.smithi008 (mon.0) 1588 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:36.916576+0000 mon.smithi008 (mon.0) 1589 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:36.923520+0000 mon.smithi008 (mon.0) 1590 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:36.929812+0000 mon.smithi008 (mon.0) 1591 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:36.932954+0000 mon.smithi008 (mon.0) 1592 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:36.934645+0000 mon.smithi008 (mon.0) 1593 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:36.936226+0000 mon.smithi008 (mon.0) 1594 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:36.938268+0000 mon.smithi008 (mon.0) 1595 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:36.888356+0000 mgr.smithi008.flmjzp (mgr.14640) 1128 : cluster [DBG] pgmap v789: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:36.917578+0000 mgr.smithi008.flmjzp (mgr.14640) 1129 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:36.918099+0000 mgr.smithi008.flmjzp (mgr.14640) 1130 : cluster [DBG] pgmap v790: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:36.918366+0000 mgr.smithi008.flmjzp (mgr.14640) 1131 : cluster [DBG] pgmap v791: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:36.940141+0000 mgr.smithi008.flmjzp (mgr.14640) 1132 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:38.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:36.888356+0000 mgr.smithi008.flmjzp (mgr.14640) 1128 : cluster [DBG] pgmap v789: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:36.917578+0000 mgr.smithi008.flmjzp (mgr.14640) 1129 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:36.918099+0000 mgr.smithi008.flmjzp (mgr.14640) 1130 : cluster [DBG] pgmap v790: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:36.918366+0000 mgr.smithi008.flmjzp (mgr.14640) 1131 : cluster [DBG] pgmap v791: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:36.940141+0000 mgr.smithi008.flmjzp (mgr.14640) 1132 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:40.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:38.918880+0000 mgr.smithi008.flmjzp (mgr.14640) 1133 : cluster [DBG] pgmap v792: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:38.918880+0000 mgr.smithi008.flmjzp (mgr.14640) 1133 : cluster [DBG] pgmap v792: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:40.919408+0000 mgr.smithi008.flmjzp (mgr.14640) 1134 : cluster [DBG] pgmap v793: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:42.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:40.919408+0000 mgr.smithi008.flmjzp (mgr.14640) 1134 : cluster [DBG] pgmap v793: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:42.920165+0000 mgr.smithi008.flmjzp (mgr.14640) 1135 : cluster [DBG] pgmap v794: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:44.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:42.920165+0000 mgr.smithi008.flmjzp (mgr.14640) 1135 : cluster [DBG] pgmap v794: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:46.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:44.920748+0000 mgr.smithi008.flmjzp (mgr.14640) 1136 : cluster [DBG] pgmap v795: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:44.920748+0000 mgr.smithi008.flmjzp (mgr.14640) 1136 : cluster [DBG] pgmap v795: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:47.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:46.946609+0000 mon.smithi008 (mon.0) 1596 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:46.948739+0000 mon.smithi008 (mon.0) 1597 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:46.949768+0000 mon.smithi008 (mon.0) 1598 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:46.956357+0000 mon.smithi008 (mon.0) 1599 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:46.964418+0000 mon.smithi008 (mon.0) 1600 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:46.968030+0000 mon.smithi008 (mon.0) 1601 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:46.970041+0000 mon.smithi008 (mon.0) 1602 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:46.971572+0000 mon.smithi008 (mon.0) 1603 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:46.973561+0000 mon.smithi008 (mon.0) 1604 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:46.946609+0000 mon.smithi008 (mon.0) 1596 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:46.948739+0000 mon.smithi008 (mon.0) 1597 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:46.949768+0000 mon.smithi008 (mon.0) 1598 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:46.956357+0000 mon.smithi008 (mon.0) 1599 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:46.964418+0000 mon.smithi008 (mon.0) 1600 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:46.968030+0000 mon.smithi008 (mon.0) 1601 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:46.970041+0000 mon.smithi008 (mon.0) 1602 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:46.971572+0000 mon.smithi008 (mon.0) 1603 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:46.973561+0000 mon.smithi008 (mon.0) 1604 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:46.921376+0000 mgr.smithi008.flmjzp (mgr.14640) 1137 : cluster [DBG] pgmap v796: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:46.950654+0000 mgr.smithi008.flmjzp (mgr.14640) 1138 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:46.951215+0000 mgr.smithi008.flmjzp (mgr.14640) 1139 : cluster [DBG] pgmap v797: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:46.951494+0000 mgr.smithi008.flmjzp (mgr.14640) 1140 : cluster [DBG] pgmap v798: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:46.975474+0000 mgr.smithi008.flmjzp (mgr.14640) 1141 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:48.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:46.921376+0000 mgr.smithi008.flmjzp (mgr.14640) 1137 : cluster [DBG] pgmap v796: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:46.950654+0000 mgr.smithi008.flmjzp (mgr.14640) 1138 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:46.951215+0000 mgr.smithi008.flmjzp (mgr.14640) 1139 : cluster [DBG] pgmap v797: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:46.951494+0000 mgr.smithi008.flmjzp (mgr.14640) 1140 : cluster [DBG] pgmap v798: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:46.975474+0000 mgr.smithi008.flmjzp (mgr.14640) 1141 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:50.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:48.952103+0000 mgr.smithi008.flmjzp (mgr.14640) 1142 : cluster [DBG] pgmap v799: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:48.952103+0000 mgr.smithi008.flmjzp (mgr.14640) 1142 : cluster [DBG] pgmap v799: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:50.952596+0000 mgr.smithi008.flmjzp (mgr.14640) 1143 : cluster [DBG] pgmap v800: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:52.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:50.952596+0000 mgr.smithi008.flmjzp (mgr.14640) 1143 : cluster [DBG] pgmap v800: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:52.953237+0000 mgr.smithi008.flmjzp (mgr.14640) 1144 : cluster [DBG] pgmap v801: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:54.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:52.953237+0000 mgr.smithi008.flmjzp (mgr.14640) 1144 : cluster [DBG] pgmap v801: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:56.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:54.953844+0000 mgr.smithi008.flmjzp (mgr.14640) 1145 : cluster [DBG] pgmap v802: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:54.953844+0000 mgr.smithi008.flmjzp (mgr.14640) 1145 : cluster [DBG] pgmap v802: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:57.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:56.985081+0000 mon.smithi008 (mon.0) 1605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:56.985081+0000 mon.smithi008 (mon.0) 1605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:56.954602+0000 mgr.smithi008.flmjzp (mgr.14640) 1146 : cluster [DBG] pgmap v803: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:57.550024+0000 mon.smithi008 (mon.0) 1606 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:57.550851+0000 mon.smithi008 (mon.0) 1607 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:57.551492+0000 mgr.smithi008.flmjzp (mgr.14640) 1147 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:57.552031+0000 mgr.smithi008.flmjzp (mgr.14640) 1148 : cluster [DBG] pgmap v804: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:57.552347+0000 mgr.smithi008.flmjzp (mgr.14640) 1149 : cluster [DBG] pgmap v805: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:57.556190+0000 mon.smithi008 (mon.0) 1608 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:57.560977+0000 mon.smithi008 (mon.0) 1609 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:57.563456+0000 mon.smithi008 (mon.0) 1610 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:57.564687+0000 mon.smithi008 (mon.0) 1611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:57.565964+0000 mon.smithi008 (mon.0) 1612 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:17:57.567578+0000 mon.smithi008 (mon.0) 1613 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:58.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:17:57.569196+0000 mgr.smithi008.flmjzp (mgr.14640) 1150 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:17:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:56.954602+0000 mgr.smithi008.flmjzp (mgr.14640) 1146 : cluster [DBG] pgmap v803: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:57.550024+0000 mon.smithi008 (mon.0) 1606 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:17:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:57.550851+0000 mon.smithi008 (mon.0) 1607 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:17:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:57.551492+0000 mgr.smithi008.flmjzp (mgr.14640) 1147 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:17:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:57.552031+0000 mgr.smithi008.flmjzp (mgr.14640) 1148 : cluster [DBG] pgmap v804: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:57.552347+0000 mgr.smithi008.flmjzp (mgr.14640) 1149 : cluster [DBG] pgmap v805: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:17:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:57.556190+0000 mon.smithi008 (mon.0) 1608 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:17:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:57.560977+0000 mon.smithi008 (mon.0) 1609 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:17:58.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:57.563456+0000 mon.smithi008 (mon.0) 1610 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:58.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:57.564687+0000 mon.smithi008 (mon.0) 1611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:58.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:57.565964+0000 mon.smithi008 (mon.0) 1612 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:58.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:17:57.567578+0000 mon.smithi008 (mon.0) 1613 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:17:58.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:17:57.569196+0000 mgr.smithi008.flmjzp (mgr.14640) 1150 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:17:59.552867+0000 mgr.smithi008.flmjzp (mgr.14640) 1151 : cluster [DBG] pgmap v806: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:00.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:17:59.552867+0000 mgr.smithi008.flmjzp (mgr.14640) 1151 : cluster [DBG] pgmap v806: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:02.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.674+0000 7f6f67fff700 1 -- 172.21.15.8:0/2451046417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f6530 msgr2=0x7f6f680f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:02.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.674+0000 7f6f67fff700 1 --2- 172.21.15.8:0/2451046417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f6530 0x7f6f680f6950 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f6f58004660 tx=0x7f6f58009b30).stop 2023-10-18T21:18:02.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.674+0000 7f6f67fff700 1 -- 172.21.15.8:0/2451046417 shutdown_connections 2023-10-18T21:18:02.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.674+0000 7f6f67fff700 1 --2- 172.21.15.8:0/2451046417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f77d0 0x7f6f680f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:02.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.674+0000 7f6f67fff700 1 --2- 172.21.15.8:0/2451046417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f6530 0x7f6f680f6950 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:02.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.674+0000 7f6f67fff700 1 -- 172.21.15.8:0/2451046417 >> 172.21.15.8:0/2451046417 conn(0x7f6f680f1c90 msgr2=0x7f6f680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:02.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.674+0000 7f6f67fff700 1 -- 172.21.15.8:0/2451046417 shutdown_connections 2023-10-18T21:18:02.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.674+0000 7f6f67fff700 1 -- 172.21.15.8:0/2451046417 wait complete. 2023-10-18T21:18:02.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.675+0000 7f6f67fff700 1 Processor -- start 2023-10-18T21:18:02.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.676+0000 7f6f67fff700 1 -- start start 2023-10-18T21:18:02.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.676+0000 7f6f67fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 0x7f6f68108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:02.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.676+0000 7f6f67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:02.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.676+0000 7f6f67fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f681099f0 con 0x7f6f680f77d0 2023-10-18T21:18:02.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.676+0000 7f6f67fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68109b30 con 0x7f6f680f6530 2023-10-18T21:18:02.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.676+0000 7f6f667fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.676+0000 7f6f667fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51334/0 (socket says 172.21.15.8:51334) 2023-10-18T21:18:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.676+0000 7f6f667fc700 1 -- 172.21.15.8:0/2932283279 learned_addr learned my addr 172.21.15.8:0/2932283279 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.677+0000 7f6f66ffd700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 0x7f6f68108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.677+0000 7f6f667fc700 1 -- 172.21.15.8:0/2932283279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 msgr2=0x7f6f68108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:02.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.677+0000 7f6f667fc700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 0x7f6f68108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:02.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.677+0000 7f6f667fc700 1 -- 172.21.15.8:0/2932283279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f58005040 con 0x7f6f680f77d0 2023-10-18T21:18:02.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.677+0000 7f6f667fc700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68109440 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6f5c00e7f0 tx=0x7f6f5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:02.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.677+0000 7f6f4f7fe700 1 -- 172.21.15.8:0/2932283279 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f5c0092e0 con 0x7f6f680f77d0 2023-10-18T21:18:02.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.677+0000 7f6f4f7fe700 1 -- 172.21.15.8:0/2932283279 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6f5c00f040 con 0x7f6f680f77d0 2023-10-18T21:18:02.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.677+0000 7f6f67fff700 1 -- 172.21.15.8:0/2932283279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6810a4d0 con 0x7f6f680f77d0 2023-10-18T21:18:02.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.677+0000 7f6f4f7fe700 1 -- 172.21.15.8:0/2932283279 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f5c0147e0 con 0x7f6f680f77d0 2023-10-18T21:18:02.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.678+0000 7f6f67fff700 1 -- 172.21.15.8:0/2932283279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6810aa10 con 0x7f6f680f77d0 2023-10-18T21:18:02.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.678+0000 7f6f67fff700 1 -- 172.21.15.8:0/2932283279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f68045ad0 con 0x7f6f680f77d0 2023-10-18T21:18:02.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.679+0000 7f6f4f7fe700 1 -- 172.21.15.8:0/2932283279 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6f5c01b030 con 0x7f6f680f77d0 2023-10-18T21:18:02.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.680+0000 7f6f4f7fe700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f50060f70 0x7f6f50063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:02.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.680+0000 7f6f4f7fe700 1 -- 172.21.15.8:0/2932283279 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6f5c07c7f0 con 0x7f6f680f77d0 2023-10-18T21:18:02.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.681+0000 7f6f66ffd700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f50060f70 0x7f6f50063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:02.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.681+0000 7f6f66ffd700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f50060f70 0x7f6f50063430 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f6f58009720 tx=0x7f6f5800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:02.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.685+0000 7f6f4f7fe700 1 -- 172.21.15.8:0/2932283279 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6f5c04fe80 con 0x7f6f680f77d0 2023-10-18T21:18:02.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.884+0000 7f6f67fff700 1 -- 172.21.15.8:0/2932283279 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f6810ac30 con 0x7f6f50060f70 2023-10-18T21:18:02.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.885+0000 7f6f4f7fe700 1 -- 172.21.15.8:0/2932283279 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6f6810ac30 con 0x7f6f50060f70 2023-10-18T21:18:02.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.887+0000 7f6f67fff700 1 -- 172.21.15.8:0/2932283279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f50060f70 msgr2=0x7f6f50063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:02.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.887+0000 7f6f67fff700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f50060f70 0x7f6f50063430 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f6f58009720 tx=0x7f6f5800b040).stop 2023-10-18T21:18:02.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.887+0000 7f6f67fff700 1 -- 172.21.15.8:0/2932283279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 msgr2=0x7f6f68109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:02.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.887+0000 7f6f67fff700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68109440 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6f5c00e7f0 tx=0x7f6f5c00b040).stop 2023-10-18T21:18:02.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.887+0000 7f6f67fff700 1 -- 172.21.15.8:0/2932283279 shutdown_connections 2023-10-18T21:18:02.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.887+0000 7f6f67fff700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f50060f70 0x7f6f50063430 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:02.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.887+0000 7f6f67fff700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f680f6530 0x7f6f68108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:02.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.887+0000 7f6f67fff700 1 --2- 172.21.15.8:0/2932283279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f680f77d0 0x7f6f68109440 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:02.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.887+0000 7f6f67fff700 1 -- 172.21.15.8:0/2932283279 >> 172.21.15.8:0/2932283279 conn(0x7f6f680f1c90 msgr2=0x7f6f680f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:02.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.887+0000 7f6f67fff700 1 -- 172.21.15.8:0/2932283279 shutdown_connections 2023-10-18T21:18:02.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:02.888+0000 7f6f67fff700 1 -- 172.21.15.8:0/2932283279 wait complete. 2023-10-18T21:18:02.903 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:18:02.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:01.553475+0000 mgr.smithi008.flmjzp (mgr.14640) 1152 : cluster [DBG] pgmap v807: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:02.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:01.553475+0000 mgr.smithi008.flmjzp (mgr.14640) 1152 : cluster [DBG] pgmap v807: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:03.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.025+0000 7f5ec553c700 1 -- 172.21.15.8:0/4253205582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ec00f6530 msgr2=0x7f5ec00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:03.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.025+0000 7f5ec553c700 1 --2- 172.21.15.8:0/4253205582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ec00f6530 0x7f5ec00f6950 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f5eb0004660 tx=0x7f5eb0009b30).stop 2023-10-18T21:18:03.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.025+0000 7f5ec553c700 1 -- 172.21.15.8:0/4253205582 shutdown_connections 2023-10-18T21:18:03.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.025+0000 7f5ec553c700 1 --2- 172.21.15.8:0/4253205582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec00f77d0 0x7f5ec00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.025+0000 7f5ec553c700 1 --2- 172.21.15.8:0/4253205582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ec00f6530 0x7f5ec00f6950 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.025+0000 7f5ec553c700 1 -- 172.21.15.8:0/4253205582 >> 172.21.15.8:0/4253205582 conn(0x7f5ec00f1c90 msgr2=0x7f5ec00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:03.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.025+0000 7f5ec553c700 1 -- 172.21.15.8:0/4253205582 shutdown_connections 2023-10-18T21:18:03.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.025+0000 7f5ec553c700 1 -- 172.21.15.8:0/4253205582 wait complete. 2023-10-18T21:18:03.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.026+0000 7f5ec553c700 1 Processor -- start 2023-10-18T21:18:03.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.026+0000 7f5ec553c700 1 -- start start 2023-10-18T21:18:03.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ec553c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec00f6530 0x7f5ec0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:03.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ec553c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ec00f77d0 0x7f5ec0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:03.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ec553c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec0109a00 con 0x7f5ec00f77d0 2023-10-18T21:18:03.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ec553c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec0109b40 con 0x7f5ec00f6530 2023-10-18T21:18:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ec00f77d0 0x7f5ec0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ec00f77d0 0x7f5ec0109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51356/0 (socket says 172.21.15.8:51356) 2023-10-18T21:18:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ebf7fe700 1 -- 172.21.15.8:0/1845948090 learned_addr learned my addr 172.21.15.8:0/1845948090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ebffff700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec00f6530 0x7f5ec0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ebf7fe700 1 -- 172.21.15.8:0/1845948090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec00f6530 msgr2=0x7f5ec0108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ebf7fe700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec00f6530 0x7f5ec0108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ebf7fe700 1 -- 172.21.15.8:0/1845948090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb0005040 con 0x7f5ec00f77d0 2023-10-18T21:18:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.027+0000 7f5ebffff700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec00f6530 0x7f5ec0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:18:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.028+0000 7f5ebf7fe700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ec00f77d0 0x7f5ec0109450 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f5eb4002700 tx=0x7f5eb4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.028+0000 7f5ebcff9700 1 -- 172.21.15.8:0/1845948090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eb4009320 con 0x7f5ec00f77d0 2023-10-18T21:18:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.028+0000 7f5ebcff9700 1 -- 172.21.15.8:0/1845948090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5eb400f040 con 0x7f5ec00f77d0 2023-10-18T21:18:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.028+0000 7f5ec553c700 1 -- 172.21.15.8:0/1845948090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec010a4e0 con 0x7f5ec00f77d0 2023-10-18T21:18:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.028+0000 7f5ebcff9700 1 -- 172.21.15.8:0/1845948090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eb40148a0 con 0x7f5ec00f77d0 2023-10-18T21:18:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.028+0000 7f5ec553c700 1 -- 172.21.15.8:0/1845948090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec010aaa0 con 0x7f5ec00f77d0 2023-10-18T21:18:03.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.029+0000 7f5ec553c700 1 -- 172.21.15.8:0/1845948090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec0045ad0 con 0x7f5ec00f77d0 2023-10-18T21:18:03.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.030+0000 7f5ebcff9700 1 -- 172.21.15.8:0/1845948090 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5eb4009480 con 0x7f5ec00f77d0 2023-10-18T21:18:03.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.031+0000 7f5ebcff9700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ea8060f70 0x7f5ea8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:03.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.031+0000 7f5ebcff9700 1 -- 172.21.15.8:0/1845948090 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5eb407cc00 con 0x7f5ec00f77d0 2023-10-18T21:18:03.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.031+0000 7f5ebffff700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ea8060f70 0x7f5ea8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:03.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.032+0000 7f5ebffff700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ea8060f70 0x7f5ea8063430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f5eb0005010 tx=0x7f5eb0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:03.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.035+0000 7f5ebcff9700 1 -- 172.21.15.8:0/1845948090 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5eb40501e0 con 0x7f5ec00f77d0 2023-10-18T21:18:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.234+0000 7f5ec553c700 1 -- 172.21.15.8:0/1845948090 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ec010ad70 con 0x7f5ea8060f70 2023-10-18T21:18:03.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.235+0000 7f5ebcff9700 1 -- 172.21.15.8:0/1845948090 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5ec010ad70 con 0x7f5ea8060f70 2023-10-18T21:18:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 -- 172.21.15.8:0/1845948090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ea8060f70 msgr2=0x7f5ea8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ea8060f70 0x7f5ea8063430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f5eb0005010 tx=0x7f5eb0009b30).stop 2023-10-18T21:18:03.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 -- 172.21.15.8:0/1845948090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ec00f77d0 msgr2=0x7f5ec0109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:03.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ec00f77d0 0x7f5ec0109450 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f5eb4002700 tx=0x7f5eb4009e00).stop 2023-10-18T21:18:03.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 -- 172.21.15.8:0/1845948090 shutdown_connections 2023-10-18T21:18:03.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ea8060f70 0x7f5ea8063430 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec00f6530 0x7f5ec0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 --2- 172.21.15.8:0/1845948090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ec00f77d0 0x7f5ec0109450 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 -- 172.21.15.8:0/1845948090 >> 172.21.15.8:0/1845948090 conn(0x7f5ec00f1c90 msgr2=0x7f5ec006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 -- 172.21.15.8:0/1845948090 shutdown_connections 2023-10-18T21:18:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.237+0000 7f5ec553c700 1 -- 172.21.15.8:0/1845948090 wait complete. 2023-10-18T21:18:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.374+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/2854845553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff80f77d0 msgr2=0x7f7ff80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.374+0000 7f7ffc9b7700 1 --2- 172.21.15.8:0/2854845553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff80f77d0 0x7f7ff80f7c30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f7fec004660 tx=0x7f7fec009b30).stop 2023-10-18T21:18:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.374+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/2854845553 shutdown_connections 2023-10-18T21:18:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.374+0000 7f7ffc9b7700 1 --2- 172.21.15.8:0/2854845553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff80f77d0 0x7f7ff80f7c30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.374+0000 7f7ffc9b7700 1 --2- 172.21.15.8:0/2854845553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff80f6530 0x7f7ff80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:18:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.374+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/2854845553 >> 172.21.15.8:0/2854845553 conn(0x7f7ff80f1c90 msgr2=0x7f7ff80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.374+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/2854845553 shutdown_connections 2023-10-18T21:18:03.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.374+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/2854845553 wait complete. 2023-10-18T21:18:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.375+0000 7f7ffc9b7700 1 Processor -- start 2023-10-18T21:18:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.375+0000 7f7ffc9b7700 1 -- start start 2023-10-18T21:18:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.375+0000 7f7ffc9b7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff80f6530 0x7f7ff806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.375+0000 7f7ffc9b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff80f77d0 0x7f7ff8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.375+0000 7f7ffc9b7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff806a410 con 0x7f7ff80f6530 2023-10-18T21:18:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.375+0000 7f7ffc9b7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff806a550 con 0x7f7ff80f77d0 2023-10-18T21:18:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.375+0000 7f7ff6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff80f6530 0x7f7ff806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7ff6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff80f6530 0x7f7ff806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51380/0 (socket says 172.21.15.8:51380) 2023-10-18T21:18:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7ff6d9d700 1 -- 172.21.15.8:0/954968916 learned_addr learned my addr 172.21.15.8:0/954968916 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7ff659c700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff80f77d0 0x7f7ff8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7ff6d9d700 1 -- 172.21.15.8:0/954968916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff80f77d0 msgr2=0x7f7ff8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7ff6d9d700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff80f77d0 0x7f7ff8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7ff6d9d700 1 -- 172.21.15.8:0/954968916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec005040 con 0x7f7ff80f6530 2023-10-18T21:18:03.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7ff6d9d700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff80f6530 0x7f7ff806b9a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f7fe80093f0 tx=0x7f7fe8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:03.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7fdf7fe700 1 -- 172.21.15.8:0/954968916 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe8013640 con 0x7f7ff80f6530 2023-10-18T21:18:03.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7fdf7fe700 1 -- 172.21.15.8:0/954968916 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7fe8013c60 con 0x7f7ff80f6530 2023-10-18T21:18:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7fdf7fe700 1 -- 172.21.15.8:0/954968916 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe8012ce0 con 0x7f7ff80f6530 2023-10-18T21:18:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.376+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/954968916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff806a830 con 0x7f7ff80f6530 2023-10-18T21:18:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.377+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/954968916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff810ede0 con 0x7f7ff80f6530 2023-10-18T21:18:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.378+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/954968916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff8045ad0 con 0x7f7ff80f6530 2023-10-18T21:18:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.378+0000 7f7fdf7fe700 1 -- 172.21.15.8:0/954968916 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7fe801a060 con 0x7f7ff80f6530 2023-10-18T21:18:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.379+0000 7f7fdf7fe700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7fe0060f70 0x7f7fe0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.379+0000 7f7fdf7fe700 1 -- 172.21.15.8:0/954968916 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7fe807c860 con 0x7f7ff80f6530 2023-10-18T21:18:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.380+0000 7f7ff659c700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7fe0060f70 0x7f7fe0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.380+0000 7f7ff659c700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7fe0060f70 0x7f7fe0063430 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f7fec009f50 tx=0x7f7fec009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:03.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.383+0000 7f7fdf7fe700 1 -- 172.21.15.8:0/954968916 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7fe804c470 con 0x7f7ff80f6530 2023-10-18T21:18:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.578+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/954968916 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ff8057f10 con 0x7f7fe0060f70 2023-10-18T21:18:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.588+0000 7f7fdf7fe700 1 -- 172.21.15.8:0/954968916 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7ff8057f10 con 0x7f7fe0060f70 2023-10-18T21:18:03.589 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:18:03.589 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (24m) 2m ago 26m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:18:03.589 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (18m) 2m ago 26m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:18:03.589 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (18m) 36s ago 25m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:18:03.590 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (24m) 2m ago 25m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:18:03.590 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 22m - - 2023-10-18T21:18:03.590 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 22m - - 2023-10-18T21:18:03.590 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 36s ago 22m - - 2023-10-18T21:18:03.590 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 36s ago 22m - - 2023-10-18T21:18:03.591 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (19m) 2m ago 27m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:18:03.591 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (19m) 36s ago 25m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:18:03.591 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (19m) 2m ago 27m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:18:03.591 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (18m) 36s ago 25m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:18:03.591 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (25m) 2m ago 25m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:18:03.592 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (24m) 36s ago 24m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:18:03.592 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (18m) 2m ago 24m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:18:03.592 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (16m) 2m ago 24m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:18:03.592 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (15m) 2m ago 24m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:18:03.592 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (15m) 36s ago 23m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:18:03.593 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (14m) 36s ago 23m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:18:03.593 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (14m) 36s ago 23m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:18:03.593 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (20m) 2m ago 25m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:18:03.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/954968916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7fe0060f70 msgr2=0x7f7fe0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:03.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7fe0060f70 0x7f7fe0063430 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f7fec009f50 tx=0x7f7fec009b30).stop 2023-10-18T21:18:03.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/954968916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff80f6530 msgr2=0x7f7ff806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:03.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff80f6530 0x7f7ff806b9a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f7fe80093f0 tx=0x7f7fe8006ec0).stop 2023-10-18T21:18:03.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/954968916 shutdown_connections 2023-10-18T21:18:03.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7fe0060f70 0x7f7fe0063430 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff80f6530 0x7f7ff806b9a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 --2- 172.21.15.8:0/954968916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff80f77d0 0x7f7ff8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/954968916 >> 172.21.15.8:0/954968916 conn(0x7f7ff80f1c90 msgr2=0x7f7ff80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:03.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/954968916 shutdown_connections 2023-10-18T21:18:03.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.590+0000 7f7ffc9b7700 1 -- 172.21.15.8:0/954968916 wait complete. 2023-10-18T21:18:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.727+0000 7fe7acee8700 1 -- 172.21.15.8:0/724563670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7a80f6530 msgr2=0x7fe7a80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.727+0000 7fe7acee8700 1 --2- 172.21.15.8:0/724563670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7a80f6530 0x7fe7a80f6950 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fe798004660 tx=0x7fe798009b30).stop 2023-10-18T21:18:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.727+0000 7fe7acee8700 1 -- 172.21.15.8:0/724563670 shutdown_connections 2023-10-18T21:18:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.727+0000 7fe7acee8700 1 --2- 172.21.15.8:0/724563670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7a80f77d0 0x7fe7a80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.727+0000 7fe7acee8700 1 --2- 172.21.15.8:0/724563670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7a80f6530 0x7fe7a80f6950 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.727+0000 7fe7acee8700 1 -- 172.21.15.8:0/724563670 >> 172.21.15.8:0/724563670 conn(0x7fe7a80f1c90 msgr2=0x7fe7a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.727+0000 7fe7acee8700 1 -- 172.21.15.8:0/724563670 shutdown_connections 2023-10-18T21:18:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.727+0000 7fe7acee8700 1 -- 172.21.15.8:0/724563670 wait complete. 2023-10-18T21:18:03.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.728+0000 7fe7acee8700 1 Processor -- start 2023-10-18T21:18:03.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.728+0000 7fe7acee8700 1 -- start start 2023-10-18T21:18:03.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7acee8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7a80f6530 0x7fe7a8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:03.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7acee8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7a80f77d0 0x7fe7a81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:03.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7acee8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a8109a70 con 0x7fe7a80f77d0 2023-10-18T21:18:03.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7acee8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a8109bb0 con 0x7fe7a80f6530 2023-10-18T21:18:03.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7a6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7a80f77d0 0x7fe7a81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:03.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7a6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7a80f77d0 0x7fe7a81094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51412/0 (socket says 172.21.15.8:51412) 2023-10-18T21:18:03.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7a6ffd700 1 -- 172.21.15.8:0/563403927 learned_addr learned my addr 172.21.15.8:0/563403927 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:03.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7a77fe700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7a80f6530 0x7fe7a8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:03.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7a6ffd700 1 -- 172.21.15.8:0/563403927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7a80f6530 msgr2=0x7fe7a8108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:03.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7a6ffd700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7a80f6530 0x7fe7a8108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:03.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.729+0000 7fe7a6ffd700 1 -- 172.21.15.8:0/563403927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe798005040 con 0x7fe7a80f77d0 2023-10-18T21:18:03.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.730+0000 7fe7a6ffd700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7a80f77d0 0x7fe7a81094c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fe79c0026d0 tx=0x7fe79c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:03.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.730+0000 7fe78ffff700 1 -- 172.21.15.8:0/563403927 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe79c0079c0 con 0x7fe7a80f77d0 2023-10-18T21:18:03.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.730+0000 7fe78ffff700 1 -- 172.21.15.8:0/563403927 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe79c00f040 con 0x7fe7a80f77d0 2023-10-18T21:18:03.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.730+0000 7fe7acee8700 1 -- 172.21.15.8:0/563403927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a810a550 con 0x7fe7a80f77d0 2023-10-18T21:18:03.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.730+0000 7fe78ffff700 1 -- 172.21.15.8:0/563403927 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe79c014980 con 0x7fe7a80f77d0 2023-10-18T21:18:03.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.730+0000 7fe7acee8700 1 -- 172.21.15.8:0/563403927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a810ab10 con 0x7fe7a80f77d0 2023-10-18T21:18:03.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.731+0000 7fe7acee8700 1 -- 172.21.15.8:0/563403927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a8045ad0 con 0x7fe7a80f77d0 2023-10-18T21:18:03.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.732+0000 7fe78ffff700 1 -- 172.21.15.8:0/563403927 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe79c0090d0 con 0x7fe7a80f77d0 2023-10-18T21:18:03.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.733+0000 7fe78ffff700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe790060f70 0x7fe790063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:03.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.733+0000 7fe78ffff700 1 -- 172.21.15.8:0/563403927 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe79c07c980 con 0x7fe7a80f77d0 2023-10-18T21:18:03.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.733+0000 7fe7a77fe700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe790060f70 0x7fe790063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:03.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.734+0000 7fe7a77fe700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe790060f70 0x7fe790063430 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fe798004630 tx=0x7fe798009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:03.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.737+0000 7fe78ffff700 1 -- 172.21.15.8:0/563403927 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe79c050010 con 0x7fe7a80f77d0 2023-10-18T21:18:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.996+0000 7fe7acee8700 1 -- 172.21.15.8:0/563403927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe7a8027a00 con 0x7fe7a80f77d0 2023-10-18T21:18:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.996+0000 7fe78ffff700 1 -- 172.21.15.8:0/563403927 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fe79c04fc00 con 0x7fe7a80f77d0 2023-10-18T21:18:03.998 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:18:03.998 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:18:03.998 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:18:03.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:18:03.999 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:18:03.999 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:18:03.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:18:03.999 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:18:03.999 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:18:04.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:18:04.000 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:18:04.000 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:18:04.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:18:04.001 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:18:04.001 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:18:04.001 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:18:04.001 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:18:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 -- 172.21.15.8:0/563403927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe790060f70 msgr2=0x7fe790063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:04.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe790060f70 0x7fe790063430 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fe798004630 tx=0x7fe798009b30).stop 2023-10-18T21:18:04.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 -- 172.21.15.8:0/563403927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7a80f77d0 msgr2=0x7fe7a81094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:04.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7a80f77d0 0x7fe7a81094c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fe79c0026d0 tx=0x7fe79c009de0).stop 2023-10-18T21:18:04.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 -- 172.21.15.8:0/563403927 shutdown_connections 2023-10-18T21:18:04.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe790060f70 0x7fe790063430 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7a80f6530 0x7fe7a8108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 --2- 172.21.15.8:0/563403927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7a80f77d0 0x7fe7a81094c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 -- 172.21.15.8:0/563403927 >> 172.21.15.8:0/563403927 conn(0x7fe7a80f1c90 msgr2=0x7fe7a806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:04.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 -- 172.21.15.8:0/563403927 shutdown_connections 2023-10-18T21:18:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:03.998+0000 7fe7acee8700 1 -- 172.21.15.8:0/563403927 wait complete. 2023-10-18T21:18:04.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.136+0000 7f296ac5e700 1 -- 172.21.15.8:0/2688217944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29640f6530 msgr2=0x7f29640f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:04.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.136+0000 7f296ac5e700 1 --2- 172.21.15.8:0/2688217944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29640f6530 0x7f29640f6950 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f2960004660 tx=0x7f2960009b30).stop 2023-10-18T21:18:04.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.136+0000 7f296ac5e700 1 -- 172.21.15.8:0/2688217944 shutdown_connections 2023-10-18T21:18:04.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.136+0000 7f296ac5e700 1 --2- 172.21.15.8:0/2688217944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29640f77d0 0x7f29640f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.136+0000 7f296ac5e700 1 --2- 172.21.15.8:0/2688217944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29640f6530 0x7f29640f6950 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.136+0000 7f296ac5e700 1 -- 172.21.15.8:0/2688217944 >> 172.21.15.8:0/2688217944 conn(0x7f29640f1c90 msgr2=0x7f29640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:04.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.136+0000 7f296ac5e700 1 -- 172.21.15.8:0/2688217944 shutdown_connections 2023-10-18T21:18:04.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.137+0000 7f296ac5e700 1 -- 172.21.15.8:0/2688217944 wait complete. 2023-10-18T21:18:04.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.138+0000 7f296ac5e700 1 Processor -- start 2023-10-18T21:18:04.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.138+0000 7f296ac5e700 1 -- start start 2023-10-18T21:18:04.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.138+0000 7f296ac5e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29640f6530 0x7f2964106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:04.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.138+0000 7f296ac5e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29640f77d0 0x7f2964107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:04.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.138+0000 7f296ac5e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2964107880 con 0x7f29640f77d0 2023-10-18T21:18:04.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.138+0000 7f296ac5e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29641080c0 con 0x7f29640f6530 2023-10-18T21:18:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.139+0000 7f296945b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29640f77d0 0x7f2964107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.139+0000 7f296945b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29640f77d0 0x7f2964107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51428/0 (socket says 172.21.15.8:51428) 2023-10-18T21:18:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.139+0000 7f296945b700 1 -- 172.21.15.8:0/1841103792 learned_addr learned my addr 172.21.15.8:0/1841103792 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.139+0000 7f2969c5c700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29640f6530 0x7f2964106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.139+0000 7f296945b700 1 -- 172.21.15.8:0/1841103792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29640f6530 msgr2=0x7f2964106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:04.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.139+0000 7f296945b700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29640f6530 0x7f2964106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.139+0000 7f296945b700 1 -- 172.21.15.8:0/1841103792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2954005040 con 0x7f29640f77d0 2023-10-18T21:18:04.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.139+0000 7f296945b700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29640f77d0 0x7f2964107280 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f2954004870 tx=0x7f2954009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:04.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.140+0000 7f295a7fc700 1 -- 172.21.15.8:0/1841103792 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295400e030 con 0x7f29640f77d0 2023-10-18T21:18:04.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.140+0000 7f295a7fc700 1 -- 172.21.15.8:0/1841103792 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f295400f040 con 0x7f29640f77d0 2023-10-18T21:18:04.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.140+0000 7f296ac5e700 1 -- 172.21.15.8:0/1841103792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2960005040 con 0x7f29640f77d0 2023-10-18T21:18:04.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.140+0000 7f295a7fc700 1 -- 172.21.15.8:0/1841103792 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2954014880 con 0x7f29640f77d0 2023-10-18T21:18:04.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.140+0000 7f296ac5e700 1 -- 172.21.15.8:0/1841103792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2964108750 con 0x7f29640f77d0 2023-10-18T21:18:04.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.141+0000 7f296ac5e700 1 -- 172.21.15.8:0/1841103792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2964059100 con 0x7f29640f77d0 2023-10-18T21:18:04.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.142+0000 7f295a7fc700 1 -- 172.21.15.8:0/1841103792 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2954010500 con 0x7f29640f77d0 2023-10-18T21:18:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.143+0000 7f295a7fc700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2950060f70 0x7f2950063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.143+0000 7f295a7fc700 1 -- 172.21.15.8:0/1841103792 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f295407cea0 con 0x7f29640f77d0 2023-10-18T21:18:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.143+0000 7f2969c5c700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2950060f70 0x7f2950063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.144+0000 7f2969c5c700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2950060f70 0x7f2950063430 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f2960005010 tx=0x7f2960016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:04.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.147+0000 7f295a7fc700 1 -- 172.21.15.8:0/1841103792 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f295404cad0 con 0x7f29640f77d0 2023-10-18T21:18:04.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.374+0000 7f296ac5e700 1 -- 172.21.15.8:0/1841103792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2964045ad0 con 0x7f29640f77d0 2023-10-18T21:18:04.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.375+0000 7f295a7fc700 1 -- 172.21.15.8:0/1841103792 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f29540500f0 con 0x7f29640f77d0 2023-10-18T21:18:04.376 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:18:04.376 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:18:04.376 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:18:04.377 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:18:04.377 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:18:04.377 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:18:04.377 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:18:04.377 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:18:04.378 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:18:04.378 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:18:04.378 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:18:04.378 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:18:04.379 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:18:04.379 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:18:04.379 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:18:04.379 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:18:04.379 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:18:04.379 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:18:04.380 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:18:04.380 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:18:04.380 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:18:04.380 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:18:04.380 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:18:04.381 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:18:04.381 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:18:04.381 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:18:04.381 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:18:04.381 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:18:04.382 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:18:04.382 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:18:04.382 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:18:04.382 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:18:04.383 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:18:04.383 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:18:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 -- 172.21.15.8:0/1841103792 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2950060f70 msgr2=0x7f2950063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2950060f70 0x7f2950063430 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f2960005010 tx=0x7f2960016040).stop 2023-10-18T21:18:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 -- 172.21.15.8:0/1841103792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29640f77d0 msgr2=0x7f2964107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29640f77d0 0x7f2964107280 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f2954004870 tx=0x7f2954009b30).stop 2023-10-18T21:18:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 -- 172.21.15.8:0/1841103792 shutdown_connections 2023-10-18T21:18:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2950060f70 0x7f2950063430 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29640f6530 0x7f2964106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 --2- 172.21.15.8:0/1841103792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29640f77d0 0x7f2964107280 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 -- 172.21.15.8:0/1841103792 >> 172.21.15.8:0/1841103792 conn(0x7f29640f1c90 msgr2=0x7f29640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 -- 172.21.15.8:0/1841103792 shutdown_connections 2023-10-18T21:18:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.377+0000 7f296ac5e700 1 -- 172.21.15.8:0/1841103792 wait complete. 2023-10-18T21:18:04.386 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:18:04.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.515+0000 7f225b12d700 1 -- 172.21.15.8:0/3448714038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540f6530 msgr2=0x7f22540f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:04.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.515+0000 7f225b12d700 1 --2- 172.21.15.8:0/3448714038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540f6530 0x7f22540f6950 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f2250004660 tx=0x7f2250009b30).stop 2023-10-18T21:18:04.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.515+0000 7f225b12d700 1 -- 172.21.15.8:0/3448714038 shutdown_connections 2023-10-18T21:18:04.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.515+0000 7f225b12d700 1 --2- 172.21.15.8:0/3448714038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540f77d0 0x7f22540f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.515+0000 7f225b12d700 1 --2- 172.21.15.8:0/3448714038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540f6530 0x7f22540f6950 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.515+0000 7f225b12d700 1 -- 172.21.15.8:0/3448714038 >> 172.21.15.8:0/3448714038 conn(0x7f22540f1c90 msgr2=0x7f22540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:04.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.516+0000 7f225b12d700 1 -- 172.21.15.8:0/3448714038 shutdown_connections 2023-10-18T21:18:04.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.516+0000 7f225b12d700 1 -- 172.21.15.8:0/3448714038 wait complete. 2023-10-18T21:18:04.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.516+0000 7f225b12d700 1 Processor -- start 2023-10-18T21:18:04.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.517+0000 7f225b12d700 1 -- start start 2023-10-18T21:18:04.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.517+0000 7f225b12d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540f6530 0x7f2254108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:04.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.517+0000 7f225b12d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540f77d0 0x7f22541094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:04.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.517+0000 7f225b12d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2254109a70 con 0x7f22540f6530 2023-10-18T21:18:04.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.517+0000 7f225b12d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2254109bb0 con 0x7f22540f77d0 2023-10-18T21:18:04.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.517+0000 7f225a12b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540f6530 0x7f2254108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:04.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.517+0000 7f225a12b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540f6530 0x7f2254108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51450/0 (socket says 172.21.15.8:51450) 2023-10-18T21:18:04.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.517+0000 7f225a12b700 1 -- 172.21.15.8:0/661193330 learned_addr learned my addr 172.21.15.8:0/661193330 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:04.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.517+0000 7f225992a700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540f77d0 0x7f22541094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:04.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.518+0000 7f225a12b700 1 -- 172.21.15.8:0/661193330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540f77d0 msgr2=0x7f22541094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:04.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.518+0000 7f225a12b700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540f77d0 0x7f22541094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.518+0000 7f225a12b700 1 -- 172.21.15.8:0/661193330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250005040 con 0x7f22540f6530 2023-10-18T21:18:04.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.518+0000 7f225a12b700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540f6530 0x7f2254108fd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f2250004e30 tx=0x7f2250009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:04.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.518+0000 7f224affd700 1 -- 172.21.15.8:0/661193330 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2250018070 con 0x7f22540f6530 2023-10-18T21:18:04.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.518+0000 7f224affd700 1 -- 172.21.15.8:0/661193330 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2250009630 con 0x7f22540f6530 2023-10-18T21:18:04.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.518+0000 7f225b12d700 1 -- 172.21.15.8:0/661193330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225410a4f0 con 0x7f22540f6530 2023-10-18T21:18:04.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.518+0000 7f224affd700 1 -- 172.21.15.8:0/661193330 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f225001c3c0 con 0x7f22540f6530 2023-10-18T21:18:04.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.518+0000 7f225b12d700 1 -- 172.21.15.8:0/661193330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225410aa50 con 0x7f22540f6530 2023-10-18T21:18:04.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.519+0000 7f225b12d700 1 -- 172.21.15.8:0/661193330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2254045ad0 con 0x7f22540f6530 2023-10-18T21:18:04.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.520+0000 7f224affd700 1 -- 172.21.15.8:0/661193330 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f225001d420 con 0x7f22540f6530 2023-10-18T21:18:04.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.521+0000 7f224affd700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2240060f70 0x7f2240063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:04.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.521+0000 7f224affd700 1 -- 172.21.15.8:0/661193330 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f225007e530 con 0x7f22540f6530 2023-10-18T21:18:04.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.521+0000 7f225992a700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2240060f70 0x7f2240063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:04.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.522+0000 7f225992a700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2240060f70 0x7f2240063430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f2244004c40 tx=0x7f224400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:04.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.525+0000 7f224affd700 1 -- 172.21.15.8:0/661193330 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2250051b10 con 0x7f22540f6530 2023-10-18T21:18:04.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.727+0000 7f225b12d700 1 -- 172.21.15.8:0/661193330 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22540fee00 con 0x7f2240060f70 2023-10-18T21:18:04.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.728+0000 7f224affd700 1 -- 172.21.15.8:0/661193330 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f22540fee00 con 0x7f2240060f70 2023-10-18T21:18:04.729 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:18:04.729 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:18:04.729 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:18:04.729 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:18:04.729 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:18:04.730 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:18:04.730 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:18:04.730 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:18:04.730 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:18:04.731 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:18:04.731 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:18:04.731 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:18:04.731 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:18:04.731 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:18:04.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 -- 172.21.15.8:0/661193330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2240060f70 msgr2=0x7f2240063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2240060f70 0x7f2240063430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f2244004c40 tx=0x7f224400b040).stop 2023-10-18T21:18:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 -- 172.21.15.8:0/661193330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540f6530 msgr2=0x7f2254108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540f6530 0x7f2254108fd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f2250004e30 tx=0x7f2250009b30).stop 2023-10-18T21:18:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 -- 172.21.15.8:0/661193330 shutdown_connections 2023-10-18T21:18:04.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2240060f70 0x7f2240063430 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540f6530 0x7f2254108fd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 --2- 172.21.15.8:0/661193330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540f77d0 0x7f22541094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:04.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 -- 172.21.15.8:0/661193330 >> 172.21.15.8:0/661193330 conn(0x7f22540f1c90 msgr2=0x7f225406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:04.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 -- 172.21.15.8:0/661193330 shutdown_connections 2023-10-18T21:18:04.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:04.730+0000 7f225b12d700 1 -- 172.21.15.8:0/661193330 wait complete. 2023-10-18T21:18:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:02.885404+0000 mgr.smithi008.flmjzp (mgr.14640) 1153 : audit [DBG] from='client.35124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:03.235481+0000 mgr.smithi008.flmjzp (mgr.14640) 1154 : audit [DBG] from='client.35128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:03.553907+0000 mgr.smithi008.flmjzp (mgr.14640) 1155 : cluster [DBG] pgmap v808: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:03.579922+0000 mgr.smithi008.flmjzp (mgr.14640) 1156 : audit [DBG] from='client.35132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:03.996847+0000 mon.smithi008 (mon.0) 1614 : audit [DBG] from='client.? 172.21.15.8:0/563403927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:04.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:04.375471+0000 mon.smithi008 (mon.0) 1615 : audit [DBG] from='client.? 172.21.15.8:0/1841103792' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:18:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:02.885404+0000 mgr.smithi008.flmjzp (mgr.14640) 1153 : audit [DBG] from='client.35124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:03.235481+0000 mgr.smithi008.flmjzp (mgr.14640) 1154 : audit [DBG] from='client.35128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:03.553907+0000 mgr.smithi008.flmjzp (mgr.14640) 1155 : cluster [DBG] pgmap v808: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:03.579922+0000 mgr.smithi008.flmjzp (mgr.14640) 1156 : audit [DBG] from='client.35132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:03.996847+0000 mon.smithi008 (mon.0) 1614 : audit [DBG] from='client.? 172.21.15.8:0/563403927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:04.375471+0000 mon.smithi008 (mon.0) 1615 : audit [DBG] from='client.? 172.21.15.8:0/1841103792' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:18:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:04.728201+0000 mgr.smithi008.flmjzp (mgr.14640) 1157 : audit [DBG] from='client.35144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:05.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:04.728201+0000 mgr.smithi008.flmjzp (mgr.14640) 1157 : audit [DBG] from='client.35144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:05.554405+0000 mgr.smithi008.flmjzp (mgr.14640) 1158 : cluster [DBG] pgmap v809: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:06.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:05.554405+0000 mgr.smithi008.flmjzp (mgr.14640) 1158 : cluster [DBG] pgmap v809: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:07.579962+0000 mon.smithi008 (mon.0) 1616 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:07.582180+0000 mon.smithi008 (mon.0) 1617 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:07.583255+0000 mon.smithi008 (mon.0) 1618 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:07.589917+0000 mon.smithi008 (mon.0) 1619 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:07.596365+0000 mon.smithi008 (mon.0) 1620 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:07.599509+0000 mon.smithi008 (mon.0) 1621 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:07.601604+0000 mon.smithi008 (mon.0) 1622 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:07.603558+0000 mon.smithi008 (mon.0) 1623 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:07.605551+0000 mon.smithi008 (mon.0) 1624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:07.579962+0000 mon.smithi008 (mon.0) 1616 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:07.582180+0000 mon.smithi008 (mon.0) 1617 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:07.583255+0000 mon.smithi008 (mon.0) 1618 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:07.589917+0000 mon.smithi008 (mon.0) 1619 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:07.596365+0000 mon.smithi008 (mon.0) 1620 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:07.599509+0000 mon.smithi008 (mon.0) 1621 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:07.601604+0000 mon.smithi008 (mon.0) 1622 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:07.603558+0000 mon.smithi008 (mon.0) 1623 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:07.605551+0000 mon.smithi008 (mon.0) 1624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:08.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:07.555015+0000 mgr.smithi008.flmjzp (mgr.14640) 1159 : cluster [DBG] pgmap v810: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:08.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:07.584209+0000 mgr.smithi008.flmjzp (mgr.14640) 1160 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:18:08.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:07.584827+0000 mgr.smithi008.flmjzp (mgr.14640) 1161 : cluster [DBG] pgmap v811: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:08.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:07.585170+0000 mgr.smithi008.flmjzp (mgr.14640) 1162 : cluster [DBG] pgmap v812: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:08.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:07.607611+0000 mgr.smithi008.flmjzp (mgr.14640) 1163 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:08.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:07.555015+0000 mgr.smithi008.flmjzp (mgr.14640) 1159 : cluster [DBG] pgmap v810: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:07.584209+0000 mgr.smithi008.flmjzp (mgr.14640) 1160 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:18:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:07.584827+0000 mgr.smithi008.flmjzp (mgr.14640) 1161 : cluster [DBG] pgmap v811: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:07.585170+0000 mgr.smithi008.flmjzp (mgr.14640) 1162 : cluster [DBG] pgmap v812: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:07.607611+0000 mgr.smithi008.flmjzp (mgr.14640) 1163 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:10.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:09.585729+0000 mgr.smithi008.flmjzp (mgr.14640) 1164 : cluster [DBG] pgmap v813: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:10.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:09.585729+0000 mgr.smithi008.flmjzp (mgr.14640) 1164 : cluster [DBG] pgmap v813: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:12.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:11.586324+0000 mgr.smithi008.flmjzp (mgr.14640) 1165 : cluster [DBG] pgmap v814: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:12.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:11.586324+0000 mgr.smithi008.flmjzp (mgr.14640) 1165 : cluster [DBG] pgmap v814: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:14.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:13.586973+0000 mgr.smithi008.flmjzp (mgr.14640) 1166 : cluster [DBG] pgmap v815: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:13.586973+0000 mgr.smithi008.flmjzp (mgr.14640) 1166 : cluster [DBG] pgmap v815: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:15.587688+0000 mgr.smithi008.flmjzp (mgr.14640) 1167 : cluster [DBG] pgmap v816: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:16.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:15.587688+0000 mgr.smithi008.flmjzp (mgr.14640) 1167 : cluster [DBG] pgmap v816: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:17.611113+0000 mon.smithi008 (mon.0) 1625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:17.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:17.611113+0000 mon.smithi008 (mon.0) 1625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:18.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:17.588143+0000 mgr.smithi008.flmjzp (mgr.14640) 1168 : cluster [DBG] pgmap v817: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:18.172090+0000 mon.smithi008 (mon.0) 1626 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:18.173322+0000 mon.smithi008 (mon.0) 1627 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:18.180016+0000 mon.smithi008 (mon.0) 1628 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:18.186618+0000 mon.smithi008 (mon.0) 1629 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:18.189765+0000 mon.smithi008 (mon.0) 1630 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:18.191469+0000 mon.smithi008 (mon.0) 1631 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:18.193105+0000 mon.smithi008 (mon.0) 1632 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:18.195179+0000 mon.smithi008 (mon.0) 1633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:19.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:17.588143+0000 mgr.smithi008.flmjzp (mgr.14640) 1168 : cluster [DBG] pgmap v817: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:19.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:18.172090+0000 mon.smithi008 (mon.0) 1626 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:19.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:18.173322+0000 mon.smithi008 (mon.0) 1627 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:19.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:18.180016+0000 mon.smithi008 (mon.0) 1628 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:19.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:18.186618+0000 mon.smithi008 (mon.0) 1629 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:19.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:18.189765+0000 mon.smithi008 (mon.0) 1630 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:19.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:18.191469+0000 mon.smithi008 (mon.0) 1631 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:19.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:18.193105+0000 mon.smithi008 (mon.0) 1632 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:19.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:18.195179+0000 mon.smithi008 (mon.0) 1633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:18.174312+0000 mgr.smithi008.flmjzp (mgr.14640) 1169 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:18:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:18.175011+0000 mgr.smithi008.flmjzp (mgr.14640) 1170 : cluster [DBG] pgmap v818: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:18.175301+0000 mgr.smithi008.flmjzp (mgr.14640) 1171 : cluster [DBG] pgmap v819: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:18.197326+0000 mgr.smithi008.flmjzp (mgr.14640) 1172 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:20.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:18.174312+0000 mgr.smithi008.flmjzp (mgr.14640) 1169 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:18:20.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:18.175011+0000 mgr.smithi008.flmjzp (mgr.14640) 1170 : cluster [DBG] pgmap v818: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:20.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:18.175301+0000 mgr.smithi008.flmjzp (mgr.14640) 1171 : cluster [DBG] pgmap v819: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:20.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:18.197326+0000 mgr.smithi008.flmjzp (mgr.14640) 1172 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:20.175999+0000 mgr.smithi008.flmjzp (mgr.14640) 1173 : cluster [DBG] pgmap v820: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:21.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:20.175999+0000 mgr.smithi008.flmjzp (mgr.14640) 1173 : cluster [DBG] pgmap v820: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:23.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:22.176555+0000 mgr.smithi008.flmjzp (mgr.14640) 1174 : cluster [DBG] pgmap v821: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:23.548 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:22.176555+0000 mgr.smithi008.flmjzp (mgr.14640) 1174 : cluster [DBG] pgmap v821: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:24.177265+0000 mgr.smithi008.flmjzp (mgr.14640) 1175 : cluster [DBG] pgmap v822: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:25.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:24.177265+0000 mgr.smithi008.flmjzp (mgr.14640) 1175 : cluster [DBG] pgmap v822: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:26.177964+0000 mgr.smithi008.flmjzp (mgr.14640) 1176 : cluster [DBG] pgmap v823: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:27.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:26.177964+0000 mgr.smithi008.flmjzp (mgr.14640) 1176 : cluster [DBG] pgmap v823: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:28.208145+0000 mon.smithi008 (mon.0) 1634 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:28.210219+0000 mon.smithi008 (mon.0) 1635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:28.211260+0000 mon.smithi008 (mon.0) 1636 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:28.218020+0000 mon.smithi008 (mon.0) 1637 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:28.224401+0000 mon.smithi008 (mon.0) 1638 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:28.227552+0000 mon.smithi008 (mon.0) 1639 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:28.229202+0000 mon.smithi008 (mon.0) 1640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:28.230835+0000 mon.smithi008 (mon.0) 1641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:28.232800+0000 mon.smithi008 (mon.0) 1642 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:28.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:28.208145+0000 mon.smithi008 (mon.0) 1634 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:28.210219+0000 mon.smithi008 (mon.0) 1635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:28.211260+0000 mon.smithi008 (mon.0) 1636 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:28.218020+0000 mon.smithi008 (mon.0) 1637 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:28.224401+0000 mon.smithi008 (mon.0) 1638 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:28.227552+0000 mon.smithi008 (mon.0) 1639 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:28.229202+0000 mon.smithi008 (mon.0) 1640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:28.230835+0000 mon.smithi008 (mon.0) 1641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:28.232800+0000 mon.smithi008 (mon.0) 1642 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:28.178502+0000 mgr.smithi008.flmjzp (mgr.14640) 1177 : cluster [DBG] pgmap v824: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:28.212099+0000 mgr.smithi008.flmjzp (mgr.14640) 1178 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:18:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:28.212654+0000 mgr.smithi008.flmjzp (mgr.14640) 1179 : cluster [DBG] pgmap v825: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:28.212907+0000 mgr.smithi008.flmjzp (mgr.14640) 1180 : cluster [DBG] pgmap v826: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:28.234677+0000 mgr.smithi008.flmjzp (mgr.14640) 1181 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:29.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:28.178502+0000 mgr.smithi008.flmjzp (mgr.14640) 1177 : cluster [DBG] pgmap v824: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:29.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:28.212099+0000 mgr.smithi008.flmjzp (mgr.14640) 1178 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:18:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:28.212654+0000 mgr.smithi008.flmjzp (mgr.14640) 1179 : cluster [DBG] pgmap v825: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:28.212907+0000 mgr.smithi008.flmjzp (mgr.14640) 1180 : cluster [DBG] pgmap v826: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:28.234677+0000 mgr.smithi008.flmjzp (mgr.14640) 1181 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:30.213571+0000 mgr.smithi008.flmjzp (mgr.14640) 1182 : cluster [DBG] pgmap v827: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:31.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:30.213571+0000 mgr.smithi008.flmjzp (mgr.14640) 1182 : cluster [DBG] pgmap v827: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:33.549 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:32.214057+0000 mgr.smithi008.flmjzp (mgr.14640) 1183 : cluster [DBG] pgmap v828: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:33.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:32.214057+0000 mgr.smithi008.flmjzp (mgr.14640) 1183 : cluster [DBG] pgmap v828: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:34.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.884+0000 7fe2c9559700 1 -- 172.21.15.8:0/3261859654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2c40f6530 msgr2=0x7fe2c40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.884+0000 7fe2c9559700 1 --2- 172.21.15.8:0/3261859654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2c40f6530 0x7fe2c40f6950 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fe2b4004660 tx=0x7fe2b4009b30).stop 2023-10-18T21:18:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.884+0000 7fe2c9559700 1 -- 172.21.15.8:0/3261859654 shutdown_connections 2023-10-18T21:18:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.884+0000 7fe2c9559700 1 --2- 172.21.15.8:0/3261859654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c40f77d0 0x7fe2c40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.884+0000 7fe2c9559700 1 --2- 172.21.15.8:0/3261859654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2c40f6530 0x7fe2c40f6950 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.884+0000 7fe2c9559700 1 -- 172.21.15.8:0/3261859654 >> 172.21.15.8:0/3261859654 conn(0x7fe2c40f1c90 msgr2=0x7fe2c40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:34.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.884+0000 7fe2c9559700 1 -- 172.21.15.8:0/3261859654 shutdown_connections 2023-10-18T21:18:34.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.885+0000 7fe2c9559700 1 -- 172.21.15.8:0/3261859654 wait complete. 2023-10-18T21:18:34.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.886+0000 7fe2c9559700 1 Processor -- start 2023-10-18T21:18:34.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.886+0000 7fe2c9559700 1 -- start start 2023-10-18T21:18:34.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.886+0000 7fe2c9559700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c40f6530 0x7fe2c406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:34.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.886+0000 7fe2c9559700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2c40f77d0 0x7fe2c4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:34.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.886+0000 7fe2c9559700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c406a380 con 0x7fe2c40f77d0 2023-10-18T21:18:34.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.886+0000 7fe2c9559700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c406a4c0 con 0x7fe2c40f6530 2023-10-18T21:18:34.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.887+0000 7fe2c37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2c40f77d0 0x7fe2c4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:34.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.887+0000 7fe2c37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2c40f77d0 0x7fe2c4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43000/0 (socket says 172.21.15.8:43000) 2023-10-18T21:18:34.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.887+0000 7fe2c37fe700 1 -- 172.21.15.8:0/3343041916 learned_addr learned my addr 172.21.15.8:0/3343041916 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:34.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.887+0000 7fe2c3fff700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c40f6530 0x7fe2c406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:34.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.887+0000 7fe2c37fe700 1 -- 172.21.15.8:0/3343041916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c40f6530 msgr2=0x7fe2c406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:34.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.887+0000 7fe2c37fe700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c40f6530 0x7fe2c406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:34.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.887+0000 7fe2c37fe700 1 -- 172.21.15.8:0/3343041916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4005040 con 0x7fe2c40f77d0 2023-10-18T21:18:34.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.887+0000 7fe2c37fe700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2c40f77d0 0x7fe2c4069e20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fe2b8002700 tx=0x7fe2b8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.888+0000 7fe2c0ff9700 1 -- 172.21.15.8:0/3343041916 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2b8009320 con 0x7fe2c40f77d0 2023-10-18T21:18:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.888+0000 7fe2c9559700 1 -- 172.21.15.8:0/3343041916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c406a7a0 con 0x7fe2c40f77d0 2023-10-18T21:18:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.888+0000 7fe2c0ff9700 1 -- 172.21.15.8:0/3343041916 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe2b800f040 con 0x7fe2c40f77d0 2023-10-18T21:18:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.888+0000 7fe2c0ff9700 1 -- 172.21.15.8:0/3343041916 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2b80148f0 con 0x7fe2c40f77d0 2023-10-18T21:18:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.888+0000 7fe2c9559700 1 -- 172.21.15.8:0/3343041916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c410ed60 con 0x7fe2c40f77d0 2023-10-18T21:18:34.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.889+0000 7fe2c9559700 1 -- 172.21.15.8:0/3343041916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c4045ad0 con 0x7fe2c40f77d0 2023-10-18T21:18:34.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.890+0000 7fe2c0ff9700 1 -- 172.21.15.8:0/3343041916 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe2b8009480 con 0x7fe2c40f77d0 2023-10-18T21:18:34.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.891+0000 7fe2c0ff9700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe2ac060f70 0x7fe2ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:34.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.891+0000 7fe2c0ff9700 1 -- 172.21.15.8:0/3343041916 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe2b807cb90 con 0x7fe2c40f77d0 2023-10-18T21:18:34.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.891+0000 7fe2c3fff700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe2ac060f70 0x7fe2ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:34.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.891+0000 7fe2c3fff700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe2ac060f70 0x7fe2ac063430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fe2c406b730 tx=0x7fe2b4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:34.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:34.895+0000 7fe2c0ff9700 1 -- 172.21.15.8:0/3343041916 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe2b804c800 con 0x7fe2c40f77d0 2023-10-18T21:18:35.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.095+0000 7fe2c9559700 1 -- 172.21.15.8:0/3343041916 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2c40fee30 con 0x7fe2ac060f70 2023-10-18T21:18:35.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.097+0000 7fe2c0ff9700 1 -- 172.21.15.8:0/3343041916 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe2c40fee30 con 0x7fe2ac060f70 2023-10-18T21:18:35.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 -- 172.21.15.8:0/3343041916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe2ac060f70 msgr2=0x7fe2ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe2ac060f70 0x7fe2ac063430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fe2c406b730 tx=0x7fe2b4009b30).stop 2023-10-18T21:18:35.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 -- 172.21.15.8:0/3343041916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2c40f77d0 msgr2=0x7fe2c4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2c40f77d0 0x7fe2c4069e20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fe2b8002700 tx=0x7fe2b8009e00).stop 2023-10-18T21:18:35.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 -- 172.21.15.8:0/3343041916 shutdown_connections 2023-10-18T21:18:35.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe2ac060f70 0x7fe2ac063430 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c40f6530 0x7fe2c406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 --2- 172.21.15.8:0/3343041916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2c40f77d0 0x7fe2c4069e20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 -- 172.21.15.8:0/3343041916 >> 172.21.15.8:0/3343041916 conn(0x7fe2c40f1c90 msgr2=0x7fe2c40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:35.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 -- 172.21.15.8:0/3343041916 shutdown_connections 2023-10-18T21:18:35.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.099+0000 7fe2c9559700 1 -- 172.21.15.8:0/3343041916 wait complete. 2023-10-18T21:18:35.114 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:18:35.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.238+0000 7f8fac978700 1 -- 172.21.15.8:0/2522051890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fa80f6530 msgr2=0x7f8fa80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.238+0000 7f8fac978700 1 --2- 172.21.15.8:0/2522051890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fa80f6530 0x7f8fa80f6950 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f8f98004660 tx=0x7f8f98009b30).stop 2023-10-18T21:18:35.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.238+0000 7f8fac978700 1 -- 172.21.15.8:0/2522051890 shutdown_connections 2023-10-18T21:18:35.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.238+0000 7f8fac978700 1 --2- 172.21.15.8:0/2522051890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fa80f77d0 0x7f8fa80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.238+0000 7f8fac978700 1 --2- 172.21.15.8:0/2522051890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fa80f6530 0x7f8fa80f6950 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.238+0000 7f8fac978700 1 -- 172.21.15.8:0/2522051890 >> 172.21.15.8:0/2522051890 conn(0x7f8fa80f1c90 msgr2=0x7f8fa80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:35.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.238+0000 7f8fac978700 1 -- 172.21.15.8:0/2522051890 shutdown_connections 2023-10-18T21:18:35.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.238+0000 7f8fac978700 1 -- 172.21.15.8:0/2522051890 wait complete. 2023-10-18T21:18:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.239+0000 7f8fac978700 1 Processor -- start 2023-10-18T21:18:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.239+0000 7f8fac978700 1 -- start start 2023-10-18T21:18:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fac978700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fa80f6530 0x7f8fa8106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fac978700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fa80f77d0 0x7f8fa8107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fac978700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8107870 con 0x7f8fa80f6530 2023-10-18T21:18:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fac978700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa81080b0 con 0x7f8fa80f77d0 2023-10-18T21:18:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fa77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fa80f6530 0x7f8fa8106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fa77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fa80f6530 0x7f8fa8106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43014/0 (socket says 172.21.15.8:43014) 2023-10-18T21:18:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fa77fe700 1 -- 172.21.15.8:0/3107706016 learned_addr learned my addr 172.21.15.8:0/3107706016 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fa6ffd700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fa80f77d0 0x7f8fa8107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fa77fe700 1 -- 172.21.15.8:0/3107706016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fa80f77d0 msgr2=0x7f8fa8107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fa77fe700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fa80f77d0 0x7f8fa8107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.240+0000 7f8fa77fe700 1 -- 172.21.15.8:0/3107706016 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98005040 con 0x7f8fa80f6530 2023-10-18T21:18:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.241+0000 7f8fa77fe700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fa80f6530 0x7f8fa8106d80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f8f98009870 tx=0x7f8f9800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.241+0000 7f8f8ffff700 1 -- 172.21.15.8:0/3107706016 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f98019070 con 0x7f8fa80f6530 2023-10-18T21:18:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.241+0000 7f8f8ffff700 1 -- 172.21.15.8:0/3107706016 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8f9801e420 con 0x7f8fa80f6530 2023-10-18T21:18:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.241+0000 7f8fac978700 1 -- 172.21.15.8:0/3107706016 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa8108330 con 0x7f8fa80f6530 2023-10-18T21:18:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.241+0000 7f8f8ffff700 1 -- 172.21.15.8:0/3107706016 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f98014660 con 0x7f8fa80f6530 2023-10-18T21:18:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.241+0000 7f8fac978700 1 -- 172.21.15.8:0/3107706016 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa8108810 con 0x7f8fa80f6530 2023-10-18T21:18:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.242+0000 7f8fac978700 1 -- 172.21.15.8:0/3107706016 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa8059100 con 0x7f8fa80f6530 2023-10-18T21:18:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.243+0000 7f8f8ffff700 1 -- 172.21.15.8:0/3107706016 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8f9801e9c0 con 0x7f8fa80f6530 2023-10-18T21:18:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.244+0000 7f8f8ffff700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f90060f70 0x7f8f90063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.244+0000 7f8f8ffff700 1 -- 172.21.15.8:0/3107706016 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8f9807dd80 con 0x7f8fa80f6530 2023-10-18T21:18:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.244+0000 7f8fa6ffd700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f90060f70 0x7f8f90063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.245+0000 7f8fa6ffd700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f90060f70 0x7f8f90063430 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f8fa8106b10 tx=0x7f8f9c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.249+0000 7f8f8ffff700 1 -- 172.21.15.8:0/3107706016 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8f9804d9b0 con 0x7f8fa80f6530 2023-10-18T21:18:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:34.214656+0000 mgr.smithi008.flmjzp (mgr.14640) 1184 : cluster [DBG] pgmap v829: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:35.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.447+0000 7f8fac978700 1 -- 172.21.15.8:0/3107706016 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fa80feda0 con 0x7f8f90060f70 2023-10-18T21:18:35.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.448+0000 7f8f8ffff700 1 -- 172.21.15.8:0/3107706016 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8fa80feda0 con 0x7f8f90060f70 2023-10-18T21:18:35.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 -- 172.21.15.8:0/3107706016 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f90060f70 msgr2=0x7f8f90063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f90060f70 0x7f8f90063430 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f8fa8106b10 tx=0x7f8f9c00b040).stop 2023-10-18T21:18:35.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 -- 172.21.15.8:0/3107706016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fa80f6530 msgr2=0x7f8fa8106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fa80f6530 0x7f8fa8106d80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f8f98009870 tx=0x7f8f9800b040).stop 2023-10-18T21:18:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 -- 172.21.15.8:0/3107706016 shutdown_connections 2023-10-18T21:18:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f90060f70 0x7f8f90063430 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fa80f6530 0x7f8fa8106d80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 --2- 172.21.15.8:0/3107706016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fa80f77d0 0x7f8fa8107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 -- 172.21.15.8:0/3107706016 >> 172.21.15.8:0/3107706016 conn(0x7f8fa80f1c90 msgr2=0x7f8fa80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 -- 172.21.15.8:0/3107706016 shutdown_connections 2023-10-18T21:18:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.450+0000 7f8fac978700 1 -- 172.21.15.8:0/3107706016 wait complete. 2023-10-18T21:18:35.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.589+0000 7f6b3f59e700 1 -- 172.21.15.8:0/3774997554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b400f9690 msgr2=0x7f6b400fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.589+0000 7f6b3f59e700 1 --2- 172.21.15.8:0/3774997554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b400f9690 0x7f6b400fbae0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f6b34004660 tx=0x7f6b34009b30).stop 2023-10-18T21:18:35.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.589+0000 7f6b3f59e700 1 -- 172.21.15.8:0/3774997554 shutdown_connections 2023-10-18T21:18:35.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.589+0000 7f6b3f59e700 1 --2- 172.21.15.8:0/3774997554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b400f9690 0x7f6b400fbae0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.589+0000 7f6b3f59e700 1 --2- 172.21.15.8:0/3774997554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b40060310 0x7f6b400f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.589+0000 7f6b3f59e700 1 -- 172.21.15.8:0/3774997554 >> 172.21.15.8:0/3774997554 conn(0x7f6b400f0b90 msgr2=0x7f6b400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:35.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.589+0000 7f6b3f59e700 1 -- 172.21.15.8:0/3774997554 shutdown_connections 2023-10-18T21:18:35.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.590+0000 7f6b3f59e700 1 -- 172.21.15.8:0/3774997554 wait complete. 2023-10-18T21:18:35.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.591+0000 7f6b3f59e700 1 Processor -- start 2023-10-18T21:18:35.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.591+0000 7f6b3f59e700 1 -- start start 2023-10-18T21:18:35.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.591+0000 7f6b3f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b40060310 0x7f6b400f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:35.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.591+0000 7f6b3f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400f9690 0x7f6b400f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.591+0000 7f6b3f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400f5570 con 0x7f6b40060310 2023-10-18T21:18:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.591+0000 7f6b3f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400f56b0 con 0x7f6b400f9690 2023-10-18T21:18:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.592+0000 7f6b3e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b40060310 0x7f6b400f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.592+0000 7f6b3e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b40060310 0x7f6b400f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43026/0 (socket says 172.21.15.8:43026) 2023-10-18T21:18:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.592+0000 7f6b3e59c700 1 -- 172.21.15.8:0/66120533 learned_addr learned my addr 172.21.15.8:0/66120533 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:35.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.592+0000 7f6b3dd9b700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400f9690 0x7f6b400f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:35.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.592+0000 7f6b3e59c700 1 -- 172.21.15.8:0/66120533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400f9690 msgr2=0x7f6b400f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.592+0000 7f6b3e59c700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400f9690 0x7f6b400f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.592+0000 7f6b3e59c700 1 -- 172.21.15.8:0/66120533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34005040 con 0x7f6b40060310 2023-10-18T21:18:35.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.592+0000 7f6b3e59c700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b40060310 0x7f6b400f6b90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f6b300026d0 tx=0x7f6b30009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:35.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.593+0000 7f6b2effd700 1 -- 172.21.15.8:0/66120533 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b30009320 con 0x7f6b40060310 2023-10-18T21:18:35.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.593+0000 7f6b2effd700 1 -- 172.21.15.8:0/66120533 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6b3000f040 con 0x7f6b40060310 2023-10-18T21:18:35.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.593+0000 7f6b3f59e700 1 -- 172.21.15.8:0/66120533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b400f5990 con 0x7f6b40060310 2023-10-18T21:18:35.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.593+0000 7f6b2effd700 1 -- 172.21.15.8:0/66120533 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b300148a0 con 0x7f6b40060310 2023-10-18T21:18:35.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.593+0000 7f6b3f59e700 1 -- 172.21.15.8:0/66120533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4010eda0 con 0x7f6b40060310 2023-10-18T21:18:35.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.594+0000 7f6b3f59e700 1 -- 172.21.15.8:0/66120533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b40045ad0 con 0x7f6b40060310 2023-10-18T21:18:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.595+0000 7f6b2effd700 1 -- 172.21.15.8:0/66120533 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6b30009480 con 0x7f6b40060310 2023-10-18T21:18:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.595+0000 7f6b2effd700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 0x7f6b28063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.596+0000 7f6b2effd700 1 -- 172.21.15.8:0/66120533 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6b3007cea0 con 0x7f6b40060310 2023-10-18T21:18:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.596+0000 7f6b3dd9b700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 0x7f6b28063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:35.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.596+0000 7f6b3dd9b700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 0x7f6b28063430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f6b34004630 tx=0x7f6b34009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:35.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.600+0000 7f6b2effd700 1 -- 172.21.15.8:0/66120533 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6b3004cb90 con 0x7f6b40060310 2023-10-18T21:18:35.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:34.214656+0000 mgr.smithi008.flmjzp (mgr.14640) 1184 : cluster [DBG] pgmap v829: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.790+0000 7f6b3f59e700 1 -- 172.21.15.8:0/66120533 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b400fee30 con 0x7f6b28060f70 2023-10-18T21:18:35.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.799+0000 7f6b2effd700 1 -- 172.21.15.8:0/66120533 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6b400fee30 con 0x7f6b28060f70 2023-10-18T21:18:35.800 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:18:35.801 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (25m) 3m ago 26m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:18:35.801 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (19m) 3m ago 26m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:18:35.801 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (19m) 68s ago 25m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:18:35.801 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (25m) 3m ago 26m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:18:35.801 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 22m - - 2023-10-18T21:18:35.802 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 22m - - 2023-10-18T21:18:35.802 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 68s ago 22m - - 2023-10-18T21:18:35.802 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 68s ago 22m - - 2023-10-18T21:18:35.802 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (20m) 3m ago 28m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:18:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (19m) 68s ago 25m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:18:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (19m) 3m ago 28m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:18:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (19m) 68s ago 25m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:18:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (26m) 3m ago 26m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:18:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (25m) 68s ago 25m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:18:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (18m) 3m ago 25m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:18:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (16m) 3m ago 24m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:18:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (16m) 3m ago 24m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:18:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (15m) 68s ago 24m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:18:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (15m) 68s ago 24m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:18:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (14m) 68s ago 23m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:18:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (20m) 3m ago 25m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:18:35.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.801+0000 7f6b3f59e700 1 -- 172.21.15.8:0/66120533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 msgr2=0x7f6b28063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.801+0000 7f6b3f59e700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 0x7f6b28063430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f6b34004630 tx=0x7f6b34009b30).stop 2023-10-18T21:18:35.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.801+0000 7f6b3f59e700 1 -- 172.21.15.8:0/66120533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b40060310 msgr2=0x7f6b400f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.801+0000 7f6b3f59e700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b40060310 0x7f6b400f6b90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f6b300026d0 tx=0x7f6b30009de0).stop 2023-10-18T21:18:35.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.802+0000 7f6b3f59e700 1 -- 172.21.15.8:0/66120533 shutdown_connections 2023-10-18T21:18:35.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.802+0000 7f6b3f59e700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 0x7f6b28063430 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.802+0000 7f6b3f59e700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b40060310 0x7f6b400f6b90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.802+0000 7f6b3f59e700 1 --2- 172.21.15.8:0/66120533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400f9690 0x7f6b400f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.802+0000 7f6b3f59e700 1 -- 172.21.15.8:0/66120533 >> 172.21.15.8:0/66120533 conn(0x7f6b400f0b90 msgr2=0x7f6b400f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:35.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.802+0000 7f6b3f59e700 1 -- 172.21.15.8:0/66120533 shutdown_connections 2023-10-18T21:18:35.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.802+0000 7f6b3f59e700 1 -- 172.21.15.8:0/66120533 wait complete. 2023-10-18T21:18:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.937+0000 7f03e3fff700 1 -- 172.21.15.8:0/2217123171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03e40f77d0 msgr2=0x7f03e40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.937+0000 7f03e3fff700 1 --2- 172.21.15.8:0/2217123171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03e40f77d0 0x7f03e40f7c30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f03d8004660 tx=0x7f03d8009b30).stop 2023-10-18T21:18:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.937+0000 7f03e3fff700 1 -- 172.21.15.8:0/2217123171 shutdown_connections 2023-10-18T21:18:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.937+0000 7f03e3fff700 1 --2- 172.21.15.8:0/2217123171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03e40f77d0 0x7f03e40f7c30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.938+0000 7f03e3fff700 1 --2- 172.21.15.8:0/2217123171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03e40f6530 0x7f03e40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.938+0000 7f03e3fff700 1 -- 172.21.15.8:0/2217123171 >> 172.21.15.8:0/2217123171 conn(0x7f03e40f1c90 msgr2=0x7f03e40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.938+0000 7f03e3fff700 1 -- 172.21.15.8:0/2217123171 shutdown_connections 2023-10-18T21:18:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.938+0000 7f03e3fff700 1 -- 172.21.15.8:0/2217123171 wait complete. 2023-10-18T21:18:35.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.938+0000 7f03e3fff700 1 Processor -- start 2023-10-18T21:18:35.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.939+0000 7f03e3fff700 1 -- start start 2023-10-18T21:18:35.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.939+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03e40f6530 0x7f03e406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:35.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.939+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03e40f77d0 0x7f03e4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:35.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.939+0000 7f03e3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e406a380 con 0x7f03e40f6530 2023-10-18T21:18:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.939+0000 7f03e3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e406a4c0 con 0x7f03e40f77d0 2023-10-18T21:18:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.939+0000 7f03e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03e40f6530 0x7f03e406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.939+0000 7f03e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03e40f6530 0x7f03e406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43040/0 (socket says 172.21.15.8:43040) 2023-10-18T21:18:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.939+0000 7f03e2ffd700 1 -- 172.21.15.8:0/2987266232 learned_addr learned my addr 172.21.15.8:0/2987266232 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.939+0000 7f03e27fc700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03e40f77d0 0x7f03e4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.940+0000 7f03e2ffd700 1 -- 172.21.15.8:0/2987266232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03e40f77d0 msgr2=0x7f03e4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.940+0000 7f03e2ffd700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03e40f77d0 0x7f03e4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.940+0000 7f03e2ffd700 1 -- 172.21.15.8:0/2987266232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8005040 con 0x7f03e40f6530 2023-10-18T21:18:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.940+0000 7f03e2ffd700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03e40f6530 0x7f03e406b9a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f03d4002700 tx=0x7f03d4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.940+0000 7f03cb7fe700 1 -- 172.21.15.8:0/2987266232 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d4009320 con 0x7f03e40f6530 2023-10-18T21:18:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.940+0000 7f03cb7fe700 1 -- 172.21.15.8:0/2987266232 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f03d400f040 con 0x7f03e40f6530 2023-10-18T21:18:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.940+0000 7f03cb7fe700 1 -- 172.21.15.8:0/2987266232 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d4014950 con 0x7f03e40f6530 2023-10-18T21:18:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.940+0000 7f03e3fff700 1 -- 172.21.15.8:0/2987266232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e406a7a0 con 0x7f03e40f6530 2023-10-18T21:18:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.940+0000 7f03e3fff700 1 -- 172.21.15.8:0/2987266232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e410ed20 con 0x7f03e40f6530 2023-10-18T21:18:35.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.941+0000 7f03e3fff700 1 -- 172.21.15.8:0/2987266232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e4045ad0 con 0x7f03e40f6530 2023-10-18T21:18:35.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.942+0000 7f03cb7fe700 1 -- 172.21.15.8:0/2987266232 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f03d4009480 con 0x7f03e40f6530 2023-10-18T21:18:35.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.943+0000 7f03cb7fe700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03cc060f70 0x7f03cc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:35.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.943+0000 7f03cb7fe700 1 -- 172.21.15.8:0/2987266232 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f03d407cc70 con 0x7f03e40f6530 2023-10-18T21:18:35.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.943+0000 7f03e27fc700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03cc060f70 0x7f03cc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:35.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.944+0000 7f03e27fc700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03cc060f70 0x7f03cc063430 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f03d8004e30 tx=0x7f03d8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:35.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:35.947+0000 7f03cb7fe700 1 -- 172.21.15.8:0/2987266232 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f03d4083080 con 0x7f03e40f6530 2023-10-18T21:18:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.203+0000 7f03e3fff700 1 -- 172.21.15.8:0/2987266232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f03e40fedd0 con 0x7f03e40f6530 2023-10-18T21:18:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.204+0000 7f03cb7fe700 1 -- 172.21.15.8:0/2987266232 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f03d404c8a0 con 0x7f03e40f6530 2023-10-18T21:18:36.205 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:18:36.205 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:18:36.205 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:18:36.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:18:36.206 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:18:36.206 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:18:36.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:18:36.206 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:18:36.206 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:18:36.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:18:36.207 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:18:36.207 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:18:36.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:18:36.207 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:18:36.208 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:18:36.208 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:18:36.208 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:18:36.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 -- 172.21.15.8:0/2987266232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03cc060f70 msgr2=0x7f03cc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03cc060f70 0x7f03cc063430 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f03d8004e30 tx=0x7f03d8009b30).stop 2023-10-18T21:18:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 -- 172.21.15.8:0/2987266232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03e40f6530 msgr2=0x7f03e406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03e40f6530 0x7f03e406b9a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f03d4002700 tx=0x7f03d4009e00).stop 2023-10-18T21:18:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 -- 172.21.15.8:0/2987266232 shutdown_connections 2023-10-18T21:18:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03cc060f70 0x7f03cc063430 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03e40f6530 0x7f03e406b9a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 --2- 172.21.15.8:0/2987266232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03e40f77d0 0x7f03e4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 -- 172.21.15.8:0/2987266232 >> 172.21.15.8:0/2987266232 conn(0x7f03e40f1c90 msgr2=0x7f03e40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:36.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 -- 172.21.15.8:0/2987266232 shutdown_connections 2023-10-18T21:18:36.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.206+0000 7f03e3fff700 1 -- 172.21.15.8:0/2987266232 wait complete. 2023-10-18T21:18:36.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.343+0000 7f89ebfff700 1 -- 172.21.15.8:0/1132234534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89ec0f6530 msgr2=0x7f89ec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:36.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.343+0000 7f89ebfff700 1 --2- 172.21.15.8:0/1132234534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89ec0f6530 0x7f89ec0f6950 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f89dc004660 tx=0x7f89dc009b30).stop 2023-10-18T21:18:36.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.343+0000 7f89ebfff700 1 -- 172.21.15.8:0/1132234534 shutdown_connections 2023-10-18T21:18:36.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.343+0000 7f89ebfff700 1 --2- 172.21.15.8:0/1132234534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89ec0f77d0 0x7f89ec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.343+0000 7f89ebfff700 1 --2- 172.21.15.8:0/1132234534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89ec0f6530 0x7f89ec0f6950 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.343+0000 7f89ebfff700 1 -- 172.21.15.8:0/1132234534 >> 172.21.15.8:0/1132234534 conn(0x7f89ec0f1c90 msgr2=0x7f89ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:36.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.343+0000 7f89ebfff700 1 -- 172.21.15.8:0/1132234534 shutdown_connections 2023-10-18T21:18:36.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.343+0000 7f89ebfff700 1 -- 172.21.15.8:0/1132234534 wait complete. 2023-10-18T21:18:36.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.344+0000 7f89ebfff700 1 Processor -- start 2023-10-18T21:18:36.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.344+0000 7f89ebfff700 1 -- start start 2023-10-18T21:18:36.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.344+0000 7f89ebfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89ec0f6530 0x7f89ec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:36.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.344+0000 7f89ebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89ec0f77d0 0x7f89ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:36.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.344+0000 7f89ebfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec06a380 con 0x7f89ec0f6530 2023-10-18T21:18:36.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.344+0000 7f89ebfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec06a4c0 con 0x7f89ec0f77d0 2023-10-18T21:18:36.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.345+0000 7f89eaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89ec0f6530 0x7f89ec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:36.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.345+0000 7f89eaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89ec0f6530 0x7f89ec06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43062/0 (socket says 172.21.15.8:43062) 2023-10-18T21:18:36.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.345+0000 7f89eaffd700 1 -- 172.21.15.8:0/1233033688 learned_addr learned my addr 172.21.15.8:0/1233033688 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:36.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.345+0000 7f89ea7fc700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89ec0f77d0 0x7f89ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:36.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.345+0000 7f89eaffd700 1 -- 172.21.15.8:0/1233033688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89ec0f77d0 msgr2=0x7f89ec069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:36.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.345+0000 7f89eaffd700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89ec0f77d0 0x7f89ec069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.345+0000 7f89eaffd700 1 -- 172.21.15.8:0/1233033688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc005040 con 0x7f89ec0f6530 2023-10-18T21:18:36.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.345+0000 7f89eaffd700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89ec0f6530 0x7f89ec06b9a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f89dc009870 tx=0x7f89dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:36.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.346+0000 7f89d37fe700 1 -- 172.21.15.8:0/1233033688 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89dc019070 con 0x7f89ec0f6530 2023-10-18T21:18:36.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.346+0000 7f89d37fe700 1 -- 172.21.15.8:0/1233033688 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f89dc013380 con 0x7f89ec0f6530 2023-10-18T21:18:36.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.346+0000 7f89ebfff700 1 -- 172.21.15.8:0/1233033688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec06a740 con 0x7f89ec0f6530 2023-10-18T21:18:36.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.346+0000 7f89d37fe700 1 -- 172.21.15.8:0/1233033688 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89dc01edf0 con 0x7f89ec0f6530 2023-10-18T21:18:36.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.346+0000 7f89ebfff700 1 -- 172.21.15.8:0/1233033688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec06ac20 con 0x7f89ec0f6530 2023-10-18T21:18:36.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.347+0000 7f89ebfff700 1 -- 172.21.15.8:0/1233033688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec045ad0 con 0x7f89ec0f6530 2023-10-18T21:18:36.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.348+0000 7f89d37fe700 1 -- 172.21.15.8:0/1233033688 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f89dc01e420 con 0x7f89ec0f6530 2023-10-18T21:18:36.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.348+0000 7f89d37fe700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89d4060f70 0x7f89d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:36.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.349+0000 7f89d37fe700 1 -- 172.21.15.8:0/1233033688 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f89dc07dd10 con 0x7f89ec0f6530 2023-10-18T21:18:36.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.349+0000 7f89ea7fc700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89d4060f70 0x7f89d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:36.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.349+0000 7f89ea7fc700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89d4060f70 0x7f89d4063430 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f89e0009fd0 tx=0x7f89e000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:36.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.353+0000 7f89d37fe700 1 -- 172.21.15.8:0/1233033688 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f89dc04d980 con 0x7f89ec0f6530 2023-10-18T21:18:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.578+0000 7f89ebfff700 1 -- 172.21.15.8:0/1233033688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f89ec0fed60 con 0x7f89ec0f6530 2023-10-18T21:18:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.578+0000 7f89d37fe700 1 -- 172.21.15.8:0/1233033688 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f89dc004490 con 0x7f89ec0f6530 2023-10-18T21:18:36.580 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:18:36.580 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:18:36.580 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:18:36.580 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:18:36.581 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:18:36.581 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:18:36.581 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:18:36.581 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:18:36.581 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:18:36.582 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:18:36.582 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:18:36.582 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:18:36.582 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:18:36.582 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:18:36.583 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:18:36.583 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:18:36.583 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:18:36.583 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:18:36.583 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:18:36.583 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:18:36.584 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:18:36.584 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:18:36.584 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:18:36.584 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:18:36.584 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:18:36.585 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:18:36.585 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:18:36.585 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:18:36.585 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:18:36.585 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:18:36.585 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:18:36.586 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:18:36.586 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:18:36.586 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:18:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.580+0000 7f89ebfff700 1 -- 172.21.15.8:0/1233033688 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89d4060f70 msgr2=0x7f89d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.580+0000 7f89ebfff700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89d4060f70 0x7f89d4063430 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f89e0009fd0 tx=0x7f89e000b040).stop 2023-10-18T21:18:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.580+0000 7f89ebfff700 1 -- 172.21.15.8:0/1233033688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89ec0f6530 msgr2=0x7f89ec06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.580+0000 7f89ebfff700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89ec0f6530 0x7f89ec06b9a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f89dc009870 tx=0x7f89dc00b040).stop 2023-10-18T21:18:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.581+0000 7f89ebfff700 1 -- 172.21.15.8:0/1233033688 shutdown_connections 2023-10-18T21:18:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.581+0000 7f89ebfff700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89d4060f70 0x7f89d4063430 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.581+0000 7f89ebfff700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89ec0f6530 0x7f89ec06b9a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.581+0000 7f89ebfff700 1 --2- 172.21.15.8:0/1233033688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89ec0f77d0 0x7f89ec069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.581+0000 7f89ebfff700 1 -- 172.21.15.8:0/1233033688 >> 172.21.15.8:0/1233033688 conn(0x7f89ec0f1c90 msgr2=0x7f89ec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.581+0000 7f89ebfff700 1 -- 172.21.15.8:0/1233033688 shutdown_connections 2023-10-18T21:18:36.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.581+0000 7f89ebfff700 1 -- 172.21.15.8:0/1233033688 wait complete. 2023-10-18T21:18:36.589 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:18:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:35.096987+0000 mgr.smithi008.flmjzp (mgr.14640) 1185 : audit [DBG] from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:35.448366+0000 mgr.smithi008.flmjzp (mgr.14640) 1186 : audit [DBG] from='client.35152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:36.204241+0000 mon.smithi008 (mon.0) 1643 : audit [DBG] from='client.? 172.21.15.8:0/2987266232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:36.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.722+0000 7fb36c904700 1 -- 172.21.15.8:0/3027730310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f77d0 msgr2=0x7fb3680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:36.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.722+0000 7fb36c904700 1 --2- 172.21.15.8:0/3027730310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f77d0 0x7fb3680f7c30 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fb35c004660 tx=0x7fb35c009b30).stop 2023-10-18T21:18:36.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.722+0000 7fb36c904700 1 -- 172.21.15.8:0/3027730310 shutdown_connections 2023-10-18T21:18:36.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.722+0000 7fb36c904700 1 --2- 172.21.15.8:0/3027730310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f77d0 0x7fb3680f7c30 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.722+0000 7fb36c904700 1 --2- 172.21.15.8:0/3027730310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f6530 0x7fb3680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.722+0000 7fb36c904700 1 -- 172.21.15.8:0/3027730310 >> 172.21.15.8:0/3027730310 conn(0x7fb3680f1c90 msgr2=0x7fb3680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:36.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.722+0000 7fb36c904700 1 -- 172.21.15.8:0/3027730310 shutdown_connections 2023-10-18T21:18:36.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.722+0000 7fb36c904700 1 -- 172.21.15.8:0/3027730310 wait complete. 2023-10-18T21:18:36.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.723+0000 7fb36c904700 1 Processor -- start 2023-10-18T21:18:36.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.723+0000 7fb36c904700 1 -- start start 2023-10-18T21:18:36.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb36c904700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f6530 0x7fb368106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:36.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb36c904700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f77d0 0x7fb368107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:36.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb36c904700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb368107850 con 0x7fb3680f6530 2023-10-18T21:18:36.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb36c904700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb368108060 con 0x7fb3680f77d0 2023-10-18T21:18:36.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb366d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f6530 0x7fb368106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:36.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb366d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f6530 0x7fb368106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43078/0 (socket says 172.21.15.8:43078) 2023-10-18T21:18:36.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb366d9d700 1 -- 172.21.15.8:0/3927196395 learned_addr learned my addr 172.21.15.8:0/3927196395 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:18:36.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb36659c700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f77d0 0x7fb368107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:36.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb366d9d700 1 -- 172.21.15.8:0/3927196395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f77d0 msgr2=0x7fb368107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:36.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb366d9d700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f77d0 0x7fb368107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.724+0000 7fb366d9d700 1 -- 172.21.15.8:0/3927196395 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c005040 con 0x7fb3680f6530 2023-10-18T21:18:36.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.725+0000 7fb366d9d700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f6530 0x7fb368106d60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fb35800e7c0 tx=0x7fb35800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:36.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.725+0000 7fb34f7fe700 1 -- 172.21.15.8:0/3927196395 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3580092e0 con 0x7fb3680f6530 2023-10-18T21:18:36.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.725+0000 7fb34f7fe700 1 -- 172.21.15.8:0/3927196395 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb35800f040 con 0x7fb3680f6530 2023-10-18T21:18:36.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.725+0000 7fb36c904700 1 -- 172.21.15.8:0/3927196395 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3681082e0 con 0x7fb3680f6530 2023-10-18T21:18:36.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.725+0000 7fb34f7fe700 1 -- 172.21.15.8:0/3927196395 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb358014810 con 0x7fb3680f6530 2023-10-18T21:18:36.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.725+0000 7fb36c904700 1 -- 172.21.15.8:0/3927196395 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb368108820 con 0x7fb3680f6530 2023-10-18T21:18:36.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.726+0000 7fb36c904700 1 -- 172.21.15.8:0/3927196395 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb368059100 con 0x7fb3680f6530 2023-10-18T21:18:36.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.727+0000 7fb34f7fe700 1 -- 172.21.15.8:0/3927196395 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb35801b030 con 0x7fb3680f6530 2023-10-18T21:18:36.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.728+0000 7fb34f7fe700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f70 0x7fb350063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:18:36.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.728+0000 7fb34f7fe700 1 -- 172.21.15.8:0/3927196395 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb35807c880 con 0x7fb3680f6530 2023-10-18T21:18:36.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.728+0000 7fb36659c700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f70 0x7fb350063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:18:36.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.728+0000 7fb36659c700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f70 0x7fb350063430 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fb35c009720 tx=0x7fb35c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:18:36.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.732+0000 7fb34f7fe700 1 -- 172.21.15.8:0/3927196395 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb35804c430 con 0x7fb3680f6530 2023-10-18T21:18:36.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:35.096987+0000 mgr.smithi008.flmjzp (mgr.14640) 1185 : audit [DBG] from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:36.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:35.448366+0000 mgr.smithi008.flmjzp (mgr.14640) 1186 : audit [DBG] from='client.35152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:36.204241+0000 mon.smithi008 (mon.0) 1643 : audit [DBG] from='client.? 172.21.15.8:0/2987266232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:36.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.932+0000 7fb36c904700 1 -- 172.21.15.8:0/3927196395 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3680008d0 con 0x7fb350060f70 2023-10-18T21:18:36.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.934+0000 7fb34f7fe700 1 -- 172.21.15.8:0/3927196395 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb3680008d0 con 0x7fb350060f70 2023-10-18T21:18:36.935 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:18:36.935 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:18:36.935 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:18:36.935 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:18:36.935 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:18:36.936 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:18:36.936 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:18:36.936 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:18:36.936 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:18:36.936 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:18:36.937 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:18:36.937 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:18:36.937 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:18:36.937 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:18:36.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.935+0000 7fb36c904700 1 -- 172.21.15.8:0/3927196395 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f70 msgr2=0x7fb350063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:36.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.935+0000 7fb36c904700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f70 0x7fb350063430 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fb35c009720 tx=0x7fb35c016040).stop 2023-10-18T21:18:36.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.935+0000 7fb36c904700 1 -- 172.21.15.8:0/3927196395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f6530 msgr2=0x7fb368106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:18:36.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.935+0000 7fb36c904700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f6530 0x7fb368106d60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fb35800e7c0 tx=0x7fb35800b040).stop 2023-10-18T21:18:36.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.936+0000 7fb36c904700 1 -- 172.21.15.8:0/3927196395 shutdown_connections 2023-10-18T21:18:36.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.936+0000 7fb36c904700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb350060f70 0x7fb350063430 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.936+0000 7fb36c904700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680f6530 0x7fb368106d60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.936+0000 7fb36c904700 1 --2- 172.21.15.8:0/3927196395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3680f77d0 0x7fb368107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:18:36.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.936+0000 7fb36c904700 1 -- 172.21.15.8:0/3927196395 >> 172.21.15.8:0/3927196395 conn(0x7fb3680f1c90 msgr2=0x7fb3680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:18:36.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.936+0000 7fb36c904700 1 -- 172.21.15.8:0/3927196395 shutdown_connections 2023-10-18T21:18:36.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:18:36.936+0000 7fb36c904700 1 -- 172.21.15.8:0/3927196395 wait complete. 2023-10-18T21:18:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:35.791507+0000 mgr.smithi008.flmjzp (mgr.14640) 1187 : audit [DBG] from='client.35156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:36.215110+0000 mgr.smithi008.flmjzp (mgr.14640) 1188 : cluster [DBG] pgmap v830: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:36.579237+0000 mon.smithi008 (mon.0) 1644 : audit [DBG] from='client.? 172.21.15.8:0/1233033688' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:18:37.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:35.791507+0000 mgr.smithi008.flmjzp (mgr.14640) 1187 : audit [DBG] from='client.35156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:36.215110+0000 mgr.smithi008.flmjzp (mgr.14640) 1188 : cluster [DBG] pgmap v830: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:36.579237+0000 mon.smithi008 (mon.0) 1644 : audit [DBG] from='client.? 172.21.15.8:0/1233033688' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:18:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:36.933907+0000 mgr.smithi008.flmjzp (mgr.14640) 1189 : audit [DBG] from='client.35168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:38.237477+0000 mon.smithi008 (mon.0) 1645 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:38.239668+0000 mon.smithi008 (mon.0) 1646 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:38.240712+0000 mon.smithi008 (mon.0) 1647 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:38.247332+0000 mon.smithi008 (mon.0) 1648 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:38.253974+0000 mon.smithi008 (mon.0) 1649 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:38.257156+0000 mon.smithi008 (mon.0) 1650 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:38.258940+0000 mon.smithi008 (mon.0) 1651 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:38.260682+0000 mon.smithi008 (mon.0) 1652 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:38.262781+0000 mon.smithi008 (mon.0) 1653 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:36.933907+0000 mgr.smithi008.flmjzp (mgr.14640) 1189 : audit [DBG] from='client.35168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:18:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:38.237477+0000 mon.smithi008 (mon.0) 1645 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:38.239668+0000 mon.smithi008 (mon.0) 1646 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:38.240712+0000 mon.smithi008 (mon.0) 1647 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:38.247332+0000 mon.smithi008 (mon.0) 1648 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:38.253974+0000 mon.smithi008 (mon.0) 1649 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:38.257156+0000 mon.smithi008 (mon.0) 1650 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:38.258940+0000 mon.smithi008 (mon.0) 1651 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:38.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:38.260682+0000 mon.smithi008 (mon.0) 1652 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:38.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:38.262781+0000 mon.smithi008 (mon.0) 1653 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:38.215729+0000 mgr.smithi008.flmjzp (mgr.14640) 1190 : cluster [DBG] pgmap v831: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:38.241607+0000 mgr.smithi008.flmjzp (mgr.14640) 1191 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:18:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:38.242162+0000 mgr.smithi008.flmjzp (mgr.14640) 1192 : cluster [DBG] pgmap v832: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:38.242435+0000 mgr.smithi008.flmjzp (mgr.14640) 1193 : cluster [DBG] pgmap v833: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:38.264800+0000 mgr.smithi008.flmjzp (mgr.14640) 1194 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:39.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:38.215729+0000 mgr.smithi008.flmjzp (mgr.14640) 1190 : cluster [DBG] pgmap v831: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:38.241607+0000 mgr.smithi008.flmjzp (mgr.14640) 1191 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:18:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:38.242162+0000 mgr.smithi008.flmjzp (mgr.14640) 1192 : cluster [DBG] pgmap v832: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:38.242435+0000 mgr.smithi008.flmjzp (mgr.14640) 1193 : cluster [DBG] pgmap v833: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:38.264800+0000 mgr.smithi008.flmjzp (mgr.14640) 1194 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:40.243023+0000 mgr.smithi008.flmjzp (mgr.14640) 1195 : cluster [DBG] pgmap v834: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:40.243023+0000 mgr.smithi008.flmjzp (mgr.14640) 1195 : cluster [DBG] pgmap v834: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:43.550 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:42.243527+0000 mgr.smithi008.flmjzp (mgr.14640) 1196 : cluster [DBG] pgmap v835: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:43.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:42.243527+0000 mgr.smithi008.flmjzp (mgr.14640) 1196 : cluster [DBG] pgmap v835: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:44.244139+0000 mgr.smithi008.flmjzp (mgr.14640) 1197 : cluster [DBG] pgmap v836: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:45.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:44.244139+0000 mgr.smithi008.flmjzp (mgr.14640) 1197 : cluster [DBG] pgmap v836: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:46.244702+0000 mgr.smithi008.flmjzp (mgr.14640) 1198 : cluster [DBG] pgmap v837: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:47.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:46.244702+0000 mgr.smithi008.flmjzp (mgr.14640) 1198 : cluster [DBG] pgmap v837: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:48.271806+0000 mon.smithi008 (mon.0) 1654 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:48.275013+0000 mon.smithi008 (mon.0) 1655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:48.276009+0000 mon.smithi008 (mon.0) 1656 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:48.282945+0000 mon.smithi008 (mon.0) 1657 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:48.289285+0000 mon.smithi008 (mon.0) 1658 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:48.292434+0000 mon.smithi008 (mon.0) 1659 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:48.294208+0000 mon.smithi008 (mon.0) 1660 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:48.295831+0000 mon.smithi008 (mon.0) 1661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:48.297850+0000 mon.smithi008 (mon.0) 1662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:48.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:48.271806+0000 mon.smithi008 (mon.0) 1654 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:48.275013+0000 mon.smithi008 (mon.0) 1655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:48.276009+0000 mon.smithi008 (mon.0) 1656 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:48.282945+0000 mon.smithi008 (mon.0) 1657 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:48.289285+0000 mon.smithi008 (mon.0) 1658 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:48.292434+0000 mon.smithi008 (mon.0) 1659 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:48.294208+0000 mon.smithi008 (mon.0) 1660 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:48.295831+0000 mon.smithi008 (mon.0) 1661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:48.297850+0000 mon.smithi008 (mon.0) 1662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:48.245294+0000 mgr.smithi008.flmjzp (mgr.14640) 1199 : cluster [DBG] pgmap v838: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:48.276893+0000 mgr.smithi008.flmjzp (mgr.14640) 1200 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:18:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:48.277493+0000 mgr.smithi008.flmjzp (mgr.14640) 1201 : cluster [DBG] pgmap v839: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:48.277725+0000 mgr.smithi008.flmjzp (mgr.14640) 1202 : cluster [DBG] pgmap v840: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:48.299780+0000 mgr.smithi008.flmjzp (mgr.14640) 1203 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:49.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:48.245294+0000 mgr.smithi008.flmjzp (mgr.14640) 1199 : cluster [DBG] pgmap v838: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:48.276893+0000 mgr.smithi008.flmjzp (mgr.14640) 1200 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:18:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:48.277493+0000 mgr.smithi008.flmjzp (mgr.14640) 1201 : cluster [DBG] pgmap v839: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:48.277725+0000 mgr.smithi008.flmjzp (mgr.14640) 1202 : cluster [DBG] pgmap v840: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:48.299780+0000 mgr.smithi008.flmjzp (mgr.14640) 1203 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:18:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:50.278235+0000 mgr.smithi008.flmjzp (mgr.14640) 1204 : cluster [DBG] pgmap v841: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:50.278235+0000 mgr.smithi008.flmjzp (mgr.14640) 1204 : cluster [DBG] pgmap v841: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:52.278794+0000 mgr.smithi008.flmjzp (mgr.14640) 1205 : cluster [DBG] pgmap v842: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:53.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:52.278794+0000 mgr.smithi008.flmjzp (mgr.14640) 1205 : cluster [DBG] pgmap v842: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:54.279532+0000 mgr.smithi008.flmjzp (mgr.14640) 1206 : cluster [DBG] pgmap v843: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:55.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:54.279532+0000 mgr.smithi008.flmjzp (mgr.14640) 1206 : cluster [DBG] pgmap v843: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:56.280244+0000 mgr.smithi008.flmjzp (mgr.14640) 1207 : cluster [DBG] pgmap v844: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:57.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:56.280244+0000 mgr.smithi008.flmjzp (mgr.14640) 1207 : cluster [DBG] pgmap v844: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:58.310028+0000 mon.smithi008 (mon.0) 1663 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:58.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:58.310028+0000 mon.smithi008 (mon.0) 1663 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:58.280749+0000 mgr.smithi008.flmjzp (mgr.14640) 1208 : cluster [DBG] pgmap v845: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:58.866990+0000 mon.smithi008 (mon.0) 1664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:58.867766+0000 mon.smithi008 (mon.0) 1665 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:58.873100+0000 mon.smithi008 (mon.0) 1666 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:58.877961+0000 mon.smithi008 (mon.0) 1667 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:58.880294+0000 mon.smithi008 (mon.0) 1668 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:58.881506+0000 mon.smithi008 (mon.0) 1669 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:58.882669+0000 mon.smithi008 (mon.0) 1670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:59.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:18:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:18:58.884203+0000 mon.smithi008 (mon.0) 1671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:59.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:58.280749+0000 mgr.smithi008.flmjzp (mgr.14640) 1208 : cluster [DBG] pgmap v845: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:18:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:58.866990+0000 mon.smithi008 (mon.0) 1664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:18:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:58.867766+0000 mon.smithi008 (mon.0) 1665 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:18:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:58.873100+0000 mon.smithi008 (mon.0) 1666 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:18:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:58.877961+0000 mon.smithi008 (mon.0) 1667 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:18:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:58.880294+0000 mon.smithi008 (mon.0) 1668 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:59.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:58.881506+0000 mon.smithi008 (mon.0) 1669 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:59.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:58.882669+0000 mon.smithi008 (mon.0) 1670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:18:59.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:18:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:18:58.884203+0000 mon.smithi008 (mon.0) 1671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:58.868350+0000 mgr.smithi008.flmjzp (mgr.14640) 1209 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:58.868915+0000 mgr.smithi008.flmjzp (mgr.14640) 1210 : cluster [DBG] pgmap v846: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:18:58.869128+0000 mgr.smithi008.flmjzp (mgr.14640) 1211 : cluster [DBG] pgmap v847: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:18:58.885805+0000 mgr.smithi008.flmjzp (mgr.14640) 1212 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:00.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:58.868350+0000 mgr.smithi008.flmjzp (mgr.14640) 1209 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:00.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:58.868915+0000 mgr.smithi008.flmjzp (mgr.14640) 1210 : cluster [DBG] pgmap v846: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:18:58.869128+0000 mgr.smithi008.flmjzp (mgr.14640) 1211 : cluster [DBG] pgmap v847: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:18:58.885805+0000 mgr.smithi008.flmjzp (mgr.14640) 1212 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:00.869653+0000 mgr.smithi008.flmjzp (mgr.14640) 1213 : cluster [DBG] pgmap v848: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:02.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:00.869653+0000 mgr.smithi008.flmjzp (mgr.14640) 1213 : cluster [DBG] pgmap v848: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:02.870189+0000 mgr.smithi008.flmjzp (mgr.14640) 1214 : cluster [DBG] pgmap v849: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:04.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:02.870189+0000 mgr.smithi008.flmjzp (mgr.14640) 1214 : cluster [DBG] pgmap v849: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:04.870862+0000 mgr.smithi008.flmjzp (mgr.14640) 1215 : cluster [DBG] pgmap v850: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:06.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:04.870862+0000 mgr.smithi008.flmjzp (mgr.14640) 1215 : cluster [DBG] pgmap v850: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:07.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.092+0000 7f5c5502b700 1 -- 172.21.15.8:0/2701272069 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c40013b20 con 0x7f5c500f77d0 2023-10-18T21:19:07.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.092+0000 7f5c5702f700 1 -- 172.21.15.8:0/2701272069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c500f77d0 msgr2=0x7f5c500f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:07.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.092+0000 7f5c5702f700 1 --2- 172.21.15.8:0/2701272069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c500f77d0 0x7f5c500f7c30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f5c40004660 tx=0x7f5c40009b30).stop 2023-10-18T21:19:07.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.092+0000 7f5c5702f700 1 -- 172.21.15.8:0/2701272069 shutdown_connections 2023-10-18T21:19:07.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.092+0000 7f5c5702f700 1 --2- 172.21.15.8:0/2701272069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c500f77d0 0x7f5c500f7c30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.092+0000 7f5c5702f700 1 --2- 172.21.15.8:0/2701272069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c500f6530 0x7f5c500f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.092+0000 7f5c5702f700 1 -- 172.21.15.8:0/2701272069 >> 172.21.15.8:0/2701272069 conn(0x7f5c500f1c90 msgr2=0x7f5c500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:07.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.092+0000 7f5c5702f700 1 -- 172.21.15.8:0/2701272069 shutdown_connections 2023-10-18T21:19:07.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.092+0000 7f5c5702f700 1 -- 172.21.15.8:0/2701272069 wait complete. 2023-10-18T21:19:07.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.093+0000 7f5c5702f700 1 Processor -- start 2023-10-18T21:19:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.093+0000 7f5c5702f700 1 -- start start 2023-10-18T21:19:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5702f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c500f6530 0x7f5c50108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5702f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c500f77d0 0x7f5c50109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5702f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c501099f0 con 0x7f5c500f6530 2023-10-18T21:19:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5702f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c50109b30 con 0x7f5c500f77d0 2023-10-18T21:19:07.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5602d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c500f6530 0x7f5c50108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:07.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5602d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c500f6530 0x7f5c50108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34410/0 (socket says 172.21.15.8:34410) 2023-10-18T21:19:07.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5602d700 1 -- 172.21.15.8:0/3220274340 learned_addr learned my addr 172.21.15.8:0/3220274340 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:07.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5582c700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c500f77d0 0x7f5c50109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:07.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5602d700 1 -- 172.21.15.8:0/3220274340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c500f77d0 msgr2=0x7f5c50109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:07.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5602d700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c500f77d0 0x7f5c50109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.094+0000 7f5c5602d700 1 -- 172.21.15.8:0/3220274340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40005040 con 0x7f5c500f6530 2023-10-18T21:19:07.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.095+0000 7f5c5602d700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c500f6530 0x7f5c50108f50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f5c4c002700 tx=0x7f5c4c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:07.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.095+0000 7f5c46ffd700 1 -- 172.21.15.8:0/3220274340 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c4c0079c0 con 0x7f5c500f6530 2023-10-18T21:19:07.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.095+0000 7f5c46ffd700 1 -- 172.21.15.8:0/3220274340 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5c4c00f040 con 0x7f5c500f6530 2023-10-18T21:19:07.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.095+0000 7f5c46ffd700 1 -- 172.21.15.8:0/3220274340 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c4c0148d0 con 0x7f5c500f6530 2023-10-18T21:19:07.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.095+0000 7f5c5702f700 1 -- 172.21.15.8:0/3220274340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5010a4d0 con 0x7f5c500f6530 2023-10-18T21:19:07.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.095+0000 7f5c5702f700 1 -- 172.21.15.8:0/3220274340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5010aa90 con 0x7f5c500f6530 2023-10-18T21:19:07.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.096+0000 7f5c5702f700 1 -- 172.21.15.8:0/3220274340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c50045ad0 con 0x7f5c500f6530 2023-10-18T21:19:07.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.097+0000 7f5c46ffd700 1 -- 172.21.15.8:0/3220274340 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5c4c01b060 con 0x7f5c500f6530 2023-10-18T21:19:07.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.098+0000 7f5c46ffd700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c3c060f70 0x7f5c3c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:07.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.098+0000 7f5c46ffd700 1 -- 172.21.15.8:0/3220274340 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5c4c07c720 con 0x7f5c500f6530 2023-10-18T21:19:07.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.098+0000 7f5c5582c700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c3c060f70 0x7f5c3c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:07.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.099+0000 7f5c5582c700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c3c060f70 0x7f5c3c063430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f5c40004630 tx=0x7f5c40009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:07.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.102+0000 7f5c46ffd700 1 -- 172.21.15.8:0/3220274340 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5c4c04fd80 con 0x7f5c500f6530 2023-10-18T21:19:07.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.300+0000 7f5c5702f700 1 -- 172.21.15.8:0/3220274340 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c500fee30 con 0x7f5c3c060f70 2023-10-18T21:19:07.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.301+0000 7f5c46ffd700 1 -- 172.21.15.8:0/3220274340 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5c500fee30 con 0x7f5c3c060f70 2023-10-18T21:19:07.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.303+0000 7f5c5702f700 1 -- 172.21.15.8:0/3220274340 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c3c060f70 msgr2=0x7f5c3c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:07.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.303+0000 7f5c5702f700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c3c060f70 0x7f5c3c063430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f5c40004630 tx=0x7f5c40009b30).stop 2023-10-18T21:19:07.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.303+0000 7f5c5702f700 1 -- 172.21.15.8:0/3220274340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c500f6530 msgr2=0x7f5c50108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:07.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.303+0000 7f5c5702f700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c500f6530 0x7f5c50108f50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f5c4c002700 tx=0x7f5c4c009d80).stop 2023-10-18T21:19:07.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.303+0000 7f5c5702f700 1 -- 172.21.15.8:0/3220274340 shutdown_connections 2023-10-18T21:19:07.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.303+0000 7f5c5702f700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c3c060f70 0x7f5c3c063430 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.303+0000 7f5c5702f700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c500f6530 0x7f5c50108f50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.303+0000 7f5c5702f700 1 --2- 172.21.15.8:0/3220274340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c500f77d0 0x7f5c50109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.303+0000 7f5c5702f700 1 -- 172.21.15.8:0/3220274340 >> 172.21.15.8:0/3220274340 conn(0x7f5c500f1c90 msgr2=0x7f5c500f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:07.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.304+0000 7f5c5702f700 1 -- 172.21.15.8:0/3220274340 shutdown_connections 2023-10-18T21:19:07.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.304+0000 7f5c5702f700 1 -- 172.21.15.8:0/3220274340 wait complete. 2023-10-18T21:19:07.320 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:19:07.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.442+0000 7f4aa759e700 1 -- 172.21.15.8:0/2577481608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa806b9c0 msgr2=0x7f4aa8069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.442+0000 7f4aa759e700 1 --2- 172.21.15.8:0/2577481608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa806b9c0 0x7f4aa8069ec0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f4a98004660 tx=0x7f4a98009b30).stop 2023-10-18T21:19:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.442+0000 7f4aa759e700 1 -- 172.21.15.8:0/2577481608 shutdown_connections 2023-10-18T21:19:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.442+0000 7f4aa759e700 1 --2- 172.21.15.8:0/2577481608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa806a3b0 0x7f4aa806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.442+0000 7f4aa759e700 1 --2- 172.21.15.8:0/2577481608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa806b9c0 0x7f4aa8069ec0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.442+0000 7f4aa759e700 1 -- 172.21.15.8:0/2577481608 >> 172.21.15.8:0/2577481608 conn(0x7f4aa80f1c90 msgr2=0x7f4aa80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.442+0000 7f4aa759e700 1 -- 172.21.15.8:0/2577481608 shutdown_connections 2023-10-18T21:19:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.442+0000 7f4aa759e700 1 -- 172.21.15.8:0/2577481608 wait complete. 2023-10-18T21:19:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.443+0000 7f4aa759e700 1 Processor -- start 2023-10-18T21:19:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.443+0000 7f4aa759e700 1 -- start start 2023-10-18T21:19:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.443+0000 7f4aa759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa806a3b0 0x7f4aa8108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.443+0000 7f4aa759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa806b9c0 0x7f4aa81094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.443+0000 7f4aa759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8109a50 con 0x7f4aa806b9c0 2023-10-18T21:19:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.443+0000 7f4aa759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8109b90 con 0x7f4aa806a3b0 2023-10-18T21:19:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.443+0000 7f4aa5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa806b9c0 0x7f4aa81094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4aa5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa806b9c0 0x7f4aa81094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34424/0 (socket says 172.21.15.8:34424) 2023-10-18T21:19:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4aa659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa806a3b0 0x7f4aa8108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4aa5d9b700 1 -- 172.21.15.8:0/3334942880 learned_addr learned my addr 172.21.15.8:0/3334942880 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4aa5d9b700 1 -- 172.21.15.8:0/3334942880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa806a3b0 msgr2=0x7f4aa8108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4aa5d9b700 1 --2- 172.21.15.8:0/3334942880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa806a3b0 0x7f4aa8108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4aa5d9b700 1 -- 172.21.15.8:0/3334942880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a98005040 con 0x7f4aa806b9c0 2023-10-18T21:19:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4aa5d9b700 1 --2- 172.21.15.8:0/3334942880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa806b9c0 0x7f4aa81094a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f4a9c0026d0 tx=0x7f4a9c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4a96ffd700 1 -- 172.21.15.8:0/3334942880 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a9c0079c0 con 0x7f4aa806b9c0 2023-10-18T21:19:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4a96ffd700 1 -- 172.21.15.8:0/3334942880 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4a9c00f040 con 0x7f4aa806b9c0 2023-10-18T21:19:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4aa759e700 1 -- 172.21.15.8:0/3334942880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa810a530 con 0x7f4aa806b9c0 2023-10-18T21:19:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.444+0000 7f4a96ffd700 1 -- 172.21.15.8:0/3334942880 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a9c014980 con 0x7f4aa806b9c0 2023-10-18T21:19:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.445+0000 7f4aa759e700 1 -- 172.21.15.8:0/3334942880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa810aaf0 con 0x7f4aa806b9c0 2023-10-18T21:19:07.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.446+0000 7f4aa759e700 1 -- 172.21.15.8:0/3334942880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa8045ad0 con 0x7f4aa806b9c0 2023-10-18T21:19:07.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.446+0000 7f4a96ffd700 1 -- 172.21.15.8:0/3334942880 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4a9c0090d0 con 0x7f4aa806b9c0 2023-10-18T21:19:07.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.447+0000 7f4a96ffd700 1 --2- 172.21.15.8:0/3334942880 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a90060f70 0x7f4a90063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:07.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.447+0000 7f4a96ffd700 1 -- 172.21.15.8:0/3334942880 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4a9c07c980 con 0x7f4aa806b9c0 2023-10-18T21:19:07.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.448+0000 7f4aa659c700 1 --2- 172.21.15.8:0/3334942880 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a90060f70 0x7f4a90063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:07.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.448+0000 7f4aa659c700 1 --2- 172.21.15.8:0/3334942880 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a90060f70 0x7f4a90063430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f4a98004630 tx=0x7f4a98009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:07.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.451+0000 7f4a96ffd700 1 -- 172.21.15.8:0/3334942880 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4a9c050010 con 0x7f4aa806b9c0 2023-10-18T21:19:07.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.651+0000 7f4aa759e700 1 -- 172.21.15.8:0/3334942880 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aa810ad70 con 0x7f4a90060f70 2023-10-18T21:19:07.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.652+0000 7f4a96ffd700 1 -- 172.21.15.8:0/3334942880 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4aa810ad70 con 0x7f4a90060f70 2023-10-18T21:19:07.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 -- 172.21.15.8:0/3334942880 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a90060f70 msgr2=0x7f4a90063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:07.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 --2- 172.21.15.8:0/3334942880 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a90060f70 0x7f4a90063430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f4a98004630 tx=0x7f4a98009b30).stop 2023-10-18T21:19:07.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 -- 172.21.15.8:0/3334942880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa806b9c0 msgr2=0x7f4aa81094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:07.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 --2- 172.21.15.8:0/3334942880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa806b9c0 0x7f4aa81094a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f4a9c0026d0 tx=0x7f4a9c009de0).stop 2023-10-18T21:19:07.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 -- 172.21.15.8:0/3334942880 shutdown_connections 2023-10-18T21:19:07.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 --2- 172.21.15.8:0/3334942880 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a90060f70 0x7f4a90063430 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 --2- 172.21.15.8:0/3334942880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa806a3b0 0x7f4aa8108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 --2- 172.21.15.8:0/3334942880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa806b9c0 0x7f4aa81094a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 -- 172.21.15.8:0/3334942880 >> 172.21.15.8:0/3334942880 conn(0x7f4aa80f1c90 msgr2=0x7f4aa80fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:07.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 -- 172.21.15.8:0/3334942880 shutdown_connections 2023-10-18T21:19:07.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.654+0000 7f4aa759e700 1 -- 172.21.15.8:0/3334942880 wait complete. 2023-10-18T21:19:07.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.790+0000 7fc7cbfff700 1 -- 172.21.15.8:0/1975682065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7cc0f6530 msgr2=0x7fc7cc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:07.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.790+0000 7fc7cbfff700 1 --2- 172.21.15.8:0/1975682065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7cc0f6530 0x7fc7cc0f6950 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fc7bc004660 tx=0x7fc7bc009b30).stop 2023-10-18T21:19:07.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.791+0000 7fc7cbfff700 1 -- 172.21.15.8:0/1975682065 shutdown_connections 2023-10-18T21:19:07.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.791+0000 7fc7cbfff700 1 --2- 172.21.15.8:0/1975682065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0f77d0 0x7fc7cc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.791+0000 7fc7cbfff700 1 --2- 172.21.15.8:0/1975682065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7cc0f6530 0x7fc7cc0f6950 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.791+0000 7fc7cbfff700 1 -- 172.21.15.8:0/1975682065 >> 172.21.15.8:0/1975682065 conn(0x7fc7cc0f1c90 msgr2=0x7fc7cc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:07.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.791+0000 7fc7cbfff700 1 -- 172.21.15.8:0/1975682065 shutdown_connections 2023-10-18T21:19:07.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.791+0000 7fc7cbfff700 1 -- 172.21.15.8:0/1975682065 wait complete. 2023-10-18T21:19:07.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.792+0000 7fc7cbfff700 1 Processor -- start 2023-10-18T21:19:07.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.792+0000 7fc7cbfff700 1 -- start start 2023-10-18T21:19:07.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7cbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7cc0f6530 0x7fc7cc106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:07.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0f77d0 0x7fc7cc107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:07.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7cbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc107910 con 0x7fc7cc0f6530 2023-10-18T21:19:07.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7cbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc108120 con 0x7fc7cc0f77d0 2023-10-18T21:19:07.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7caffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7cc0f6530 0x7fc7cc106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:07.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7caffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7cc0f6530 0x7fc7cc106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34442/0 (socket says 172.21.15.8:34442) 2023-10-18T21:19:07.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7caffd700 1 -- 172.21.15.8:0/3748736891 learned_addr learned my addr 172.21.15.8:0/3748736891 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:07.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7ca7fc700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0f77d0 0x7fc7cc107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:07.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7caffd700 1 -- 172.21.15.8:0/3748736891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0f77d0 msgr2=0x7fc7cc107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:07.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7caffd700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0f77d0 0x7fc7cc107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:07.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.793+0000 7fc7caffd700 1 -- 172.21.15.8:0/3748736891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc005040 con 0x7fc7cc0f6530 2023-10-18T21:19:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.794+0000 7fc7caffd700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7cc0f6530 0x7fc7cc106e20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fc7bc007a60 tx=0x7fc7bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.794+0000 7fc7b37fe700 1 -- 172.21.15.8:0/3748736891 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7bc018070 con 0x7fc7cc0f6530 2023-10-18T21:19:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.794+0000 7fc7b37fe700 1 -- 172.21.15.8:0/3748736891 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc7bc009630 con 0x7fc7cc0f6530 2023-10-18T21:19:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.794+0000 7fc7cbfff700 1 -- 172.21.15.8:0/3748736891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc108340 con 0x7fc7cc0f6530 2023-10-18T21:19:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.794+0000 7fc7b37fe700 1 -- 172.21.15.8:0/3748736891 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7bc01c540 con 0x7fc7cc0f6530 2023-10-18T21:19:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.794+0000 7fc7cbfff700 1 -- 172.21.15.8:0/3748736891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc1088a0 con 0x7fc7cc0f6530 2023-10-18T21:19:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.795+0000 7fc7cbfff700 1 -- 172.21.15.8:0/3748736891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc059100 con 0x7fc7cc0f6530 2023-10-18T21:19:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.796+0000 7fc7b37fe700 1 -- 172.21.15.8:0/3748736891 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc7bc01d420 con 0x7fc7cc0f6530 2023-10-18T21:19:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.797+0000 7fc7b37fe700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7b4060f70 0x7fc7b4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.797+0000 7fc7b37fe700 1 -- 172.21.15.8:0/3748736891 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc7bc07e6c0 con 0x7fc7cc0f6530 2023-10-18T21:19:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.797+0000 7fc7ca7fc700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7b4060f70 0x7fc7b4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.798+0000 7fc7ca7fc700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7b4060f70 0x7fc7b4063430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fc7c00096c0 tx=0x7fc7c0009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:07.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.801+0000 7fc7b37fe700 1 -- 172.21.15.8:0/3748736891 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc7bc04e2f0 con 0x7fc7cc0f6530 2023-10-18T21:19:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:07.994+0000 7fc7cbfff700 1 -- 172.21.15.8:0/3748736891 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7cc0fedd0 con 0x7fc7b4060f70 2023-10-18T21:19:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.004+0000 7fc7b37fe700 1 -- 172.21.15.8:0/3748736891 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc7cc0fedd0 con 0x7fc7b4060f70 2023-10-18T21:19:08.006 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:19:08.006 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (25m) 3m ago 27m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:19:08.006 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (19m) 3m ago 27m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:19:08.006 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (19m) 101s ago 26m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:19:08.007 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (25m) 3m ago 26m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:19:08.007 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 23m - - 2023-10-18T21:19:08.007 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 23m - - 2023-10-18T21:19:08.007 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 101s ago 23m - - 2023-10-18T21:19:08.007 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 101s ago 23m - - 2023-10-18T21:19:08.007 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (20m) 3m ago 28m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:19:08.008 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (20m) 101s ago 26m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:19:08.008 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (20m) 3m ago 28m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:19:08.008 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (19m) 101s ago 26m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:19:08.008 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (26m) 3m ago 26m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:19:08.008 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (26m) 101s ago 26m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:19:08.008 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (19m) 3m ago 25m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:19:08.009 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (17m) 3m ago 25m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:19:08.009 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (16m) 3m ago 25m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:19:08.009 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (16m) 101s ago 24m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:19:08.009 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (15m) 101s ago 24m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:19:08.009 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (15m) 101s ago 24m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:19:08.009 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (21m) 3m ago 26m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:19:08.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 -- 172.21.15.8:0/3748736891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7b4060f70 msgr2=0x7fc7b4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7b4060f70 0x7fc7b4063430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fc7c00096c0 tx=0x7fc7c0009be0).stop 2023-10-18T21:19:08.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 -- 172.21.15.8:0/3748736891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7cc0f6530 msgr2=0x7fc7cc106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7cc0f6530 0x7fc7cc106e20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fc7bc007a60 tx=0x7fc7bc009b30).stop 2023-10-18T21:19:08.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 -- 172.21.15.8:0/3748736891 shutdown_connections 2023-10-18T21:19:08.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7b4060f70 0x7fc7b4063430 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7cc0f6530 0x7fc7cc106e20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 --2- 172.21.15.8:0/3748736891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0f77d0 0x7fc7cc107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 -- 172.21.15.8:0/3748736891 >> 172.21.15.8:0/3748736891 conn(0x7fc7cc0f1c90 msgr2=0x7fc7cc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:08.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 -- 172.21.15.8:0/3748736891 shutdown_connections 2023-10-18T21:19:08.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.006+0000 7fc7cbfff700 1 -- 172.21.15.8:0/3748736891 wait complete. 2023-10-18T21:19:08.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.141+0000 7fc26359e700 1 -- 172.21.15.8:0/2700276055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2640f6530 msgr2=0x7fc2640f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.141+0000 7fc26359e700 1 --2- 172.21.15.8:0/2700276055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2640f6530 0x7fc2640f6950 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fc254004660 tx=0x7fc254009b30).stop 2023-10-18T21:19:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.141+0000 7fc26359e700 1 -- 172.21.15.8:0/2700276055 shutdown_connections 2023-10-18T21:19:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.141+0000 7fc26359e700 1 --2- 172.21.15.8:0/2700276055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2640f77d0 0x7fc2640f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.141+0000 7fc26359e700 1 --2- 172.21.15.8:0/2700276055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2640f6530 0x7fc2640f6950 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.141+0000 7fc26359e700 1 -- 172.21.15.8:0/2700276055 >> 172.21.15.8:0/2700276055 conn(0x7fc2640f1c90 msgr2=0x7fc2640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.142+0000 7fc26359e700 1 -- 172.21.15.8:0/2700276055 shutdown_connections 2023-10-18T21:19:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.142+0000 7fc26359e700 1 -- 172.21.15.8:0/2700276055 wait complete. 2023-10-18T21:19:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.142+0000 7fc26359e700 1 Processor -- start 2023-10-18T21:19:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.143+0000 7fc26359e700 1 -- start start 2023-10-18T21:19:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.143+0000 7fc26359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2640f6530 0x7fc264108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.143+0000 7fc26359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2640f77d0 0x7fc2641094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.143+0000 7fc26359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc264109a70 con 0x7fc2640f77d0 2023-10-18T21:19:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.143+0000 7fc26359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc264109bb0 con 0x7fc2640f6530 2023-10-18T21:19:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.143+0000 7fc261d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2640f77d0 0x7fc2641094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.143+0000 7fc261d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2640f77d0 0x7fc2641094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34462/0 (socket says 172.21.15.8:34462) 2023-10-18T21:19:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.143+0000 7fc261d9b700 1 -- 172.21.15.8:0/2667496211 learned_addr learned my addr 172.21.15.8:0/2667496211 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.143+0000 7fc26259c700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2640f6530 0x7fc264108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.144+0000 7fc261d9b700 1 -- 172.21.15.8:0/2667496211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2640f6530 msgr2=0x7fc264108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.144+0000 7fc261d9b700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2640f6530 0x7fc264108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.144+0000 7fc261d9b700 1 -- 172.21.15.8:0/2667496211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254005040 con 0x7fc2640f77d0 2023-10-18T21:19:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.144+0000 7fc261d9b700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2640f77d0 0x7fc2641094c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fc2580026d0 tx=0x7fc258009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.144+0000 7fc252ffd700 1 -- 172.21.15.8:0/2667496211 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2580079c0 con 0x7fc2640f77d0 2023-10-18T21:19:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.144+0000 7fc26359e700 1 -- 172.21.15.8:0/2667496211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26410a550 con 0x7fc2640f77d0 2023-10-18T21:19:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.144+0000 7fc252ffd700 1 -- 172.21.15.8:0/2667496211 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc25800f040 con 0x7fc2640f77d0 2023-10-18T21:19:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.144+0000 7fc252ffd700 1 -- 172.21.15.8:0/2667496211 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc258014900 con 0x7fc2640f77d0 2023-10-18T21:19:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.144+0000 7fc26359e700 1 -- 172.21.15.8:0/2667496211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26410ab10 con 0x7fc2640f77d0 2023-10-18T21:19:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.145+0000 7fc26359e700 1 -- 172.21.15.8:0/2667496211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc264045ad0 con 0x7fc2640f77d0 2023-10-18T21:19:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.146+0000 7fc252ffd700 1 -- 172.21.15.8:0/2667496211 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc2580090d0 con 0x7fc2640f77d0 2023-10-18T21:19:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.147+0000 7fc252ffd700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc24c060f70 0x7fc24c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.147+0000 7fc252ffd700 1 -- 172.21.15.8:0/2667496211 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc25807c9a0 con 0x7fc2640f77d0 2023-10-18T21:19:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.147+0000 7fc26259c700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc24c060f70 0x7fc24c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.148+0000 7fc26259c700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc24c060f70 0x7fc24c063430 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fc254004630 tx=0x7fc254009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.151+0000 7fc252ffd700 1 -- 172.21.15.8:0/2667496211 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc258050030 con 0x7fc2640f77d0 2023-10-18T21:19:08.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.409+0000 7fc26359e700 1 -- 172.21.15.8:0/2667496211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc264027a00 con 0x7fc2640f77d0 2023-10-18T21:19:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.410+0000 7fc252ffd700 1 -- 172.21.15.8:0/2667496211 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fc25804fc20 con 0x7fc2640f77d0 2023-10-18T21:19:08.412 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:19:08.412 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:19:08.412 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:19:08.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:19:08.413 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:19:08.413 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:19:08.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:19:08.413 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:19:08.413 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:19:08.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:19:08.414 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:19:08.414 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:19:08.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:19:08.414 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:19:08.415 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:19:08.415 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:19:08.415 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:19:08.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 -- 172.21.15.8:0/2667496211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc24c060f70 msgr2=0x7fc24c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc24c060f70 0x7fc24c063430 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fc254004630 tx=0x7fc254009b30).stop 2023-10-18T21:19:08.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 -- 172.21.15.8:0/2667496211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2640f77d0 msgr2=0x7fc2641094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2640f77d0 0x7fc2641094c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fc2580026d0 tx=0x7fc258009de0).stop 2023-10-18T21:19:08.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 -- 172.21.15.8:0/2667496211 shutdown_connections 2023-10-18T21:19:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc24c060f70 0x7fc24c063430 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2640f6530 0x7fc264108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 --2- 172.21.15.8:0/2667496211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2640f77d0 0x7fc2641094c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 -- 172.21.15.8:0/2667496211 >> 172.21.15.8:0/2667496211 conn(0x7fc2640f1c90 msgr2=0x7fc26406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 -- 172.21.15.8:0/2667496211 shutdown_connections 2023-10-18T21:19:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.412+0000 7fc26359e700 1 -- 172.21.15.8:0/2667496211 wait complete. 2023-10-18T21:19:08.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.550+0000 7fd78d5fe700 1 -- 172.21.15.8:0/4090907634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7880f6530 msgr2=0x7fd7880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.550+0000 7fd78d5fe700 1 --2- 172.21.15.8:0/4090907634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7880f6530 0x7fd7880f6950 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fd778004660 tx=0x7fd778009b30).stop 2023-10-18T21:19:08.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.550+0000 7fd78d5fe700 1 -- 172.21.15.8:0/4090907634 shutdown_connections 2023-10-18T21:19:08.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.550+0000 7fd78d5fe700 1 --2- 172.21.15.8:0/4090907634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7880f77d0 0x7fd7880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.550+0000 7fd78d5fe700 1 --2- 172.21.15.8:0/4090907634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7880f6530 0x7fd7880f6950 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.550+0000 7fd78d5fe700 1 -- 172.21.15.8:0/4090907634 >> 172.21.15.8:0/4090907634 conn(0x7fd7880f1c90 msgr2=0x7fd7880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:08.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.550+0000 7fd78d5fe700 1 -- 172.21.15.8:0/4090907634 shutdown_connections 2023-10-18T21:19:08.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.550+0000 7fd78d5fe700 1 -- 172.21.15.8:0/4090907634 wait complete. 2023-10-18T21:19:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.551+0000 7fd78d5fe700 1 Processor -- start 2023-10-18T21:19:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.551+0000 7fd78d5fe700 1 -- start start 2023-10-18T21:19:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.551+0000 7fd78d5fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7880f6530 0x7fd788106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.551+0000 7fd78d5fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7880f77d0 0x7fd788107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.551+0000 7fd78d5fe700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd788107910 con 0x7fd7880f6530 2023-10-18T21:19:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.551+0000 7fd78d5fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd788108120 con 0x7fd7880f77d0 2023-10-18T21:19:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.552+0000 7fd787fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7880f6530 0x7fd788106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.552+0000 7fd787fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7880f6530 0x7fd788106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34474/0 (socket says 172.21.15.8:34474) 2023-10-18T21:19:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.552+0000 7fd787fff700 1 -- 172.21.15.8:0/3895209974 learned_addr learned my addr 172.21.15.8:0/3895209974 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.552+0000 7fd7877fe700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7880f77d0 0x7fd788107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.552+0000 7fd787fff700 1 -- 172.21.15.8:0/3895209974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7880f77d0 msgr2=0x7fd788107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.552+0000 7fd787fff700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7880f77d0 0x7fd788107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.552+0000 7fd787fff700 1 -- 172.21.15.8:0/3895209974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd778005040 con 0x7fd7880f6530 2023-10-18T21:19:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.552+0000 7fd787fff700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7880f6530 0x7fd788106e20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fd778007a60 tx=0x7fd778009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.553+0000 7fd784ff9700 1 -- 172.21.15.8:0/3895209974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd778018070 con 0x7fd7880f6530 2023-10-18T21:19:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.553+0000 7fd784ff9700 1 -- 172.21.15.8:0/3895209974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd778009630 con 0x7fd7880f6530 2023-10-18T21:19:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.553+0000 7fd784ff9700 1 -- 172.21.15.8:0/3895209974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd77801c4d0 con 0x7fd7880f6530 2023-10-18T21:19:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.553+0000 7fd78d5fe700 1 -- 172.21.15.8:0/3895209974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd788108340 con 0x7fd7880f6530 2023-10-18T21:19:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.553+0000 7fd78d5fe700 1 -- 172.21.15.8:0/3895209974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7881088a0 con 0x7fd7880f6530 2023-10-18T21:19:08.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.554+0000 7fd78d5fe700 1 -- 172.21.15.8:0/3895209974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd788059100 con 0x7fd7880f6530 2023-10-18T21:19:08.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.555+0000 7fd784ff9700 1 -- 172.21.15.8:0/3895209974 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd77801d420 con 0x7fd7880f6530 2023-10-18T21:19:08.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.556+0000 7fd784ff9700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd770060f70 0x7fd770063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:08.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.556+0000 7fd784ff9700 1 -- 172.21.15.8:0/3895209974 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd77807e4a0 con 0x7fd7880f6530 2023-10-18T21:19:08.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.556+0000 7fd7877fe700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd770060f70 0x7fd770063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:08.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.556+0000 7fd7877fe700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd770060f70 0x7fd770063430 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fd77c004c40 tx=0x7fd77c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.560+0000 7fd784ff9700 1 -- 172.21.15.8:0/3895209974 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd77804e190 con 0x7fd7880f6530 2023-10-18T21:19:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:06.871488+0000 mgr.smithi008.flmjzp (mgr.14640) 1216 : cluster [DBG] pgmap v851: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:07.302549+0000 mgr.smithi008.flmjzp (mgr.14640) 1217 : audit [DBG] from='client.35172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:07.653370+0000 mgr.smithi008.flmjzp (mgr.14640) 1218 : audit [DBG] from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:08.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:06.871488+0000 mgr.smithi008.flmjzp (mgr.14640) 1216 : cluster [DBG] pgmap v851: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:07.302549+0000 mgr.smithi008.flmjzp (mgr.14640) 1217 : audit [DBG] from='client.35172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:07.653370+0000 mgr.smithi008.flmjzp (mgr.14640) 1218 : audit [DBG] from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.786+0000 7fd78d5fe700 1 -- 172.21.15.8:0/3895209974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd7880fecc0 con 0x7fd7880f6530 2023-10-18T21:19:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.787+0000 7fd784ff9700 1 -- 172.21.15.8:0/3895209974 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fd7780517b0 con 0x7fd7880f6530 2023-10-18T21:19:08.789 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:19:08.789 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:19:08.789 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:19:08.789 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:19:08.790 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:19:08.790 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:19:08.790 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:19:08.790 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:19:08.790 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:19:08.791 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:19:08.791 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:19:08.791 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:19:08.791 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:19:08.791 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:19:08.792 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:19:08.792 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:19:08.792 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:19:08.792 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:19:08.792 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:19:08.793 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:19:08.793 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:19:08.793 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:19:08.793 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:19:08.793 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:19:08.794 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:19:08.794 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:19:08.794 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:19:08.794 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:19:08.794 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:19:08.795 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:19:08.795 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:19:08.795 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:19:08.795 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:19:08.795 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:19:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.788+0000 7fd78d5fe700 1 -- 172.21.15.8:0/3895209974 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd770060f70 msgr2=0x7fd770063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.788+0000 7fd78d5fe700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd770060f70 0x7fd770063430 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fd77c004c40 tx=0x7fd77c00b040).stop 2023-10-18T21:19:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.788+0000 7fd78d5fe700 1 -- 172.21.15.8:0/3895209974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7880f6530 msgr2=0x7fd788106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.789+0000 7fd78d5fe700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7880f6530 0x7fd788106e20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fd778007a60 tx=0x7fd778009b30).stop 2023-10-18T21:19:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.789+0000 7fd78d5fe700 1 -- 172.21.15.8:0/3895209974 shutdown_connections 2023-10-18T21:19:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.789+0000 7fd78d5fe700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd770060f70 0x7fd770063430 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.789+0000 7fd78d5fe700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7880f6530 0x7fd788106e20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.789+0000 7fd78d5fe700 1 --2- 172.21.15.8:0/3895209974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7880f77d0 0x7fd788107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.789+0000 7fd78d5fe700 1 -- 172.21.15.8:0/3895209974 >> 172.21.15.8:0/3895209974 conn(0x7fd7880f1c90 msgr2=0x7fd7880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:08.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.789+0000 7fd78d5fe700 1 -- 172.21.15.8:0/3895209974 shutdown_connections 2023-10-18T21:19:08.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.789+0000 7fd78d5fe700 1 -- 172.21.15.8:0/3895209974 wait complete. 2023-10-18T21:19:08.798 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:19:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.930+0000 7f0b99335700 1 -- 172.21.15.8:0/4244138944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b940f6530 msgr2=0x7f0b940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.930+0000 7f0b99335700 1 --2- 172.21.15.8:0/4244138944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b940f6530 0x7f0b940f6950 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f0b84004660 tx=0x7f0b84009b30).stop 2023-10-18T21:19:08.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.930+0000 7f0b99335700 1 -- 172.21.15.8:0/4244138944 shutdown_connections 2023-10-18T21:19:08.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.930+0000 7f0b99335700 1 --2- 172.21.15.8:0/4244138944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b940f77d0 0x7f0b940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.930+0000 7f0b99335700 1 --2- 172.21.15.8:0/4244138944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b940f6530 0x7f0b940f6950 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.930+0000 7f0b99335700 1 -- 172.21.15.8:0/4244138944 >> 172.21.15.8:0/4244138944 conn(0x7f0b940f1c90 msgr2=0x7f0b940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:08.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.930+0000 7f0b99335700 1 -- 172.21.15.8:0/4244138944 shutdown_connections 2023-10-18T21:19:08.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.930+0000 7f0b99335700 1 -- 172.21.15.8:0/4244138944 wait complete. 2023-10-18T21:19:08.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.931+0000 7f0b99335700 1 Processor -- start 2023-10-18T21:19:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.932+0000 7f0b99335700 1 -- start start 2023-10-18T21:19:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.932+0000 7f0b99335700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b940f6530 0x7f0b9406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.932+0000 7f0b99335700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b940f77d0 0x7f0b94069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.932+0000 7f0b99335700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9406a380 con 0x7f0b940f77d0 2023-10-18T21:19:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.932+0000 7f0b99335700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9406a4c0 con 0x7f0b940f6530 2023-10-18T21:19:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.932+0000 7f0b937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b940f77d0 0x7f0b94069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.932+0000 7f0b937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b940f77d0 0x7f0b94069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34492/0 (socket says 172.21.15.8:34492) 2023-10-18T21:19:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.932+0000 7f0b937fe700 1 -- 172.21.15.8:0/2430785984 learned_addr learned my addr 172.21.15.8:0/2430785984 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.932+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b940f6530 0x7f0b9406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.933+0000 7f0b937fe700 1 -- 172.21.15.8:0/2430785984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b940f6530 msgr2=0x7f0b9406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.933+0000 7f0b937fe700 1 --2- 172.21.15.8:0/2430785984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b940f6530 0x7f0b9406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.933+0000 7f0b937fe700 1 -- 172.21.15.8:0/2430785984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b84005040 con 0x7f0b940f77d0 2023-10-18T21:19:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.933+0000 7f0b937fe700 1 --2- 172.21.15.8:0/2430785984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b940f77d0 0x7f0b94069e20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f0b8800e7f0 tx=0x7f0b8800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.933+0000 7f0b90ff9700 1 -- 172.21.15.8:0/2430785984 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b880092e0 con 0x7f0b940f77d0 2023-10-18T21:19:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.933+0000 7f0b90ff9700 1 -- 172.21.15.8:0/2430785984 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0b8800f040 con 0x7f0b940f77d0 2023-10-18T21:19:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.933+0000 7f0b90ff9700 1 -- 172.21.15.8:0/2430785984 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b880147e0 con 0x7f0b940f77d0 2023-10-18T21:19:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.933+0000 7f0b99335700 1 -- 172.21.15.8:0/2430785984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9406a7a0 con 0x7f0b940f77d0 2023-10-18T21:19:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.934+0000 7f0b99335700 1 -- 172.21.15.8:0/2430785984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9406ac90 con 0x7f0b940f77d0 2023-10-18T21:19:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.935+0000 7f0b99335700 1 -- 172.21.15.8:0/2430785984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b94045ad0 con 0x7f0b940f77d0 2023-10-18T21:19:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.935+0000 7f0b90ff9700 1 -- 172.21.15.8:0/2430785984 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0b8801b030 con 0x7f0b940f77d0 2023-10-18T21:19:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.936+0000 7f0b90ff9700 1 --2- 172.21.15.8:0/2430785984 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b7c060f70 0x7f0b7c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.936+0000 7f0b90ff9700 1 -- 172.21.15.8:0/2430785984 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0b8807c540 con 0x7f0b940f77d0 2023-10-18T21:19:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.936+0000 7f0b93fff700 1 --2- 172.21.15.8:0/2430785984 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b7c060f70 0x7f0b7c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.937+0000 7f0b93fff700 1 --2- 172.21.15.8:0/2430785984 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b7c060f70 0x7f0b7c063430 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f0b84005010 tx=0x7f0b84016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:08.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:08.940+0000 7f0b90ff9700 1 -- 172.21.15.8:0/2430785984 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0b8804c260 con 0x7f0b940f77d0 2023-10-18T21:19:09.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.137+0000 7f0b99335700 1 -- 172.21.15.8:0/2430785984 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b9406ac90 con 0x7f0b7c060f70 2023-10-18T21:19:09.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.138+0000 7f0b90ff9700 1 -- 172.21.15.8:0/2430785984 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0b9406ac90 con 0x7f0b7c060f70 2023-10-18T21:19:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:19:09.140 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:19:09.140 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:19:09.141 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:19:09.141 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:19:09.141 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:19:09.141 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:19:09.141 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:19:09.142 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:19:09.142 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:19:09.142 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:19:09.142 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:19:09.142 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:19:09.143 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:19:09.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 -- 172.21.15.8:0/2430785984 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b7c060f70 msgr2=0x7f0b7c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:09.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 --2- 172.21.15.8:0/2430785984 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b7c060f70 0x7f0b7c063430 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f0b84005010 tx=0x7f0b84016040).stop 2023-10-18T21:19:09.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 -- 172.21.15.8:0/2430785984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b940f77d0 msgr2=0x7f0b94069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:09.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 --2- 172.21.15.8:0/2430785984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b940f77d0 0x7f0b94069e20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f0b8800e7f0 tx=0x7f0b8800b040).stop 2023-10-18T21:19:09.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 -- 172.21.15.8:0/2430785984 shutdown_connections 2023-10-18T21:19:09.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 --2- 172.21.15.8:0/2430785984 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b7c060f70 0x7f0b7c063430 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:09.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 --2- 172.21.15.8:0/2430785984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b940f6530 0x7f0b9406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:09.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 --2- 172.21.15.8:0/2430785984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b940f77d0 0x7f0b94069e20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:09.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 -- 172.21.15.8:0/2430785984 >> 172.21.15.8:0/2430785984 conn(0x7f0b940f1c90 msgr2=0x7f0b940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:09.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 -- 172.21.15.8:0/2430785984 shutdown_connections 2023-10-18T21:19:09.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:09.140+0000 7f0b99335700 1 -- 172.21.15.8:0/2430785984 wait complete. 2023-10-18T21:19:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:07.996529+0000 mgr.smithi008.flmjzp (mgr.14640) 1219 : audit [DBG] from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.411425+0000 mon.smithi008 (mon.0) 1672 : audit [DBG] from='client.? 172.21.15.8:0/2667496211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.788254+0000 mon.smithi008 (mon.0) 1673 : audit [DBG] from='client.? 172.21.15.8:0/3895209974' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:19:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.896026+0000 mon.smithi008 (mon.0) 1674 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.897745+0000 mon.smithi008 (mon.0) 1675 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:19:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.898499+0000 mon.smithi008 (mon.0) 1676 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:19:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.903698+0000 mon.smithi008 (mon.0) 1677 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.909551+0000 mon.smithi008 (mon.0) 1678 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.912267+0000 mon.smithi008 (mon.0) 1679 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.913595+0000 mon.smithi008 (mon.0) 1680 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:09.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.914909+0000 mon.smithi008 (mon.0) 1681 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:09.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:08.917041+0000 mon.smithi008 (mon.0) 1682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:09.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:07.996529+0000 mgr.smithi008.flmjzp (mgr.14640) 1219 : audit [DBG] from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.411425+0000 mon.smithi008 (mon.0) 1672 : audit [DBG] from='client.? 172.21.15.8:0/2667496211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.788254+0000 mon.smithi008 (mon.0) 1673 : audit [DBG] from='client.? 172.21.15.8:0/3895209974' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:19:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.896026+0000 mon.smithi008 (mon.0) 1674 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.897745+0000 mon.smithi008 (mon.0) 1675 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:19:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.898499+0000 mon.smithi008 (mon.0) 1676 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:19:09.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.903698+0000 mon.smithi008 (mon.0) 1677 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:09.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.909551+0000 mon.smithi008 (mon.0) 1678 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:09.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.912267+0000 mon.smithi008 (mon.0) 1679 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:09.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.913595+0000 mon.smithi008 (mon.0) 1680 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:09.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.914909+0000 mon.smithi008 (mon.0) 1681 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:09.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:08.917041+0000 mon.smithi008 (mon.0) 1682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:08.871959+0000 mgr.smithi008.flmjzp (mgr.14640) 1220 : cluster [DBG] pgmap v852: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:19:08.899137+0000 mgr.smithi008.flmjzp (mgr.14640) 1221 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:08.899575+0000 mgr.smithi008.flmjzp (mgr.14640) 1222 : cluster [DBG] pgmap v853: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:08.899777+0000 mgr.smithi008.flmjzp (mgr.14640) 1223 : cluster [DBG] pgmap v854: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:19:08.918759+0000 mgr.smithi008.flmjzp (mgr.14640) 1224 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:09.139420+0000 mgr.smithi008.flmjzp (mgr.14640) 1225 : audit [DBG] from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:10.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:08.871959+0000 mgr.smithi008.flmjzp (mgr.14640) 1220 : cluster [DBG] pgmap v852: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:10.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:19:08.899137+0000 mgr.smithi008.flmjzp (mgr.14640) 1221 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:08.899575+0000 mgr.smithi008.flmjzp (mgr.14640) 1222 : cluster [DBG] pgmap v853: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:08.899777+0000 mgr.smithi008.flmjzp (mgr.14640) 1223 : cluster [DBG] pgmap v854: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:19:08.918759+0000 mgr.smithi008.flmjzp (mgr.14640) 1224 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:09.139420+0000 mgr.smithi008.flmjzp (mgr.14640) 1225 : audit [DBG] from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:10.900226+0000 mgr.smithi008.flmjzp (mgr.14640) 1226 : cluster [DBG] pgmap v855: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:12.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:10.900226+0000 mgr.smithi008.flmjzp (mgr.14640) 1226 : cluster [DBG] pgmap v855: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:12.900973+0000 mgr.smithi008.flmjzp (mgr.14640) 1227 : cluster [DBG] pgmap v856: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:14.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:12.900973+0000 mgr.smithi008.flmjzp (mgr.14640) 1227 : cluster [DBG] pgmap v856: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:14.901558+0000 mgr.smithi008.flmjzp (mgr.14640) 1228 : cluster [DBG] pgmap v857: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:14.901558+0000 mgr.smithi008.flmjzp (mgr.14640) 1228 : cluster [DBG] pgmap v857: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:16.902127+0000 mgr.smithi008.flmjzp (mgr.14640) 1229 : cluster [DBG] pgmap v858: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:18.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:16.902127+0000 mgr.smithi008.flmjzp (mgr.14640) 1229 : cluster [DBG] pgmap v858: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:18.929468+0000 mon.smithi008 (mon.0) 1683 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:19.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:18.929468+0000 mon.smithi008 (mon.0) 1683 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:18.902860+0000 mgr.smithi008.flmjzp (mgr.14640) 1230 : cluster [DBG] pgmap v859: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:19.486120+0000 mon.smithi008 (mon.0) 1684 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:19:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:19.487252+0000 mon.smithi008 (mon.0) 1685 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:19:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:19:19.488304+0000 mgr.smithi008.flmjzp (mgr.14640) 1231 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:19.488925+0000 mgr.smithi008.flmjzp (mgr.14640) 1232 : cluster [DBG] pgmap v860: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:19.489217+0000 mgr.smithi008.flmjzp (mgr.14640) 1233 : cluster [DBG] pgmap v861: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:19.494061+0000 mon.smithi008 (mon.0) 1686 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:19.501032+0000 mon.smithi008 (mon.0) 1687 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:19.504181+0000 mon.smithi008 (mon.0) 1688 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:19.505874+0000 mon.smithi008 (mon.0) 1689 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:19.507433+0000 mon.smithi008 (mon.0) 1690 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:19.509468+0000 mon.smithi008 (mon.0) 1691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:19:19.511376+0000 mgr.smithi008.flmjzp (mgr.14640) 1234 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:20.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:18.902860+0000 mgr.smithi008.flmjzp (mgr.14640) 1230 : cluster [DBG] pgmap v859: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:20.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:19.486120+0000 mon.smithi008 (mon.0) 1684 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:19:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:19.487252+0000 mon.smithi008 (mon.0) 1685 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:19:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:19:19.488304+0000 mgr.smithi008.flmjzp (mgr.14640) 1231 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:19.488925+0000 mgr.smithi008.flmjzp (mgr.14640) 1232 : cluster [DBG] pgmap v860: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:19.489217+0000 mgr.smithi008.flmjzp (mgr.14640) 1233 : cluster [DBG] pgmap v861: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:19.494061+0000 mon.smithi008 (mon.0) 1686 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:19.501032+0000 mon.smithi008 (mon.0) 1687 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:19.504181+0000 mon.smithi008 (mon.0) 1688 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:19.505874+0000 mon.smithi008 (mon.0) 1689 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:19.507433+0000 mon.smithi008 (mon.0) 1690 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:19.509468+0000 mon.smithi008 (mon.0) 1691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:20.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:19:19.511376+0000 mgr.smithi008.flmjzp (mgr.14640) 1234 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:21.489979+0000 mgr.smithi008.flmjzp (mgr.14640) 1235 : cluster [DBG] pgmap v862: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:22.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:21.489979+0000 mgr.smithi008.flmjzp (mgr.14640) 1235 : cluster [DBG] pgmap v862: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:23.490625+0000 mgr.smithi008.flmjzp (mgr.14640) 1236 : cluster [DBG] pgmap v863: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:24.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:23.490625+0000 mgr.smithi008.flmjzp (mgr.14640) 1236 : cluster [DBG] pgmap v863: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:25.491253+0000 mgr.smithi008.flmjzp (mgr.14640) 1237 : cluster [DBG] pgmap v864: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:26.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:25.491253+0000 mgr.smithi008.flmjzp (mgr.14640) 1237 : cluster [DBG] pgmap v864: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:27.491902+0000 mgr.smithi008.flmjzp (mgr.14640) 1238 : cluster [DBG] pgmap v865: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:28.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:27.491902+0000 mgr.smithi008.flmjzp (mgr.14640) 1238 : cluster [DBG] pgmap v865: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:29.521528+0000 mon.smithi008 (mon.0) 1692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:29.930 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:29.523714+0000 mon.smithi008 (mon.0) 1693 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:19:29.930 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:29.524863+0000 mon.smithi008 (mon.0) 1694 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:19:29.930 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:29.531465+0000 mon.smithi008 (mon.0) 1695 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:29.931 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:29.537953+0000 mon.smithi008 (mon.0) 1696 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:29.931 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:29.541083+0000 mon.smithi008 (mon.0) 1697 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:29.931 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:29.542750+0000 mon.smithi008 (mon.0) 1698 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:29.931 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:29.544364+0000 mon.smithi008 (mon.0) 1699 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:29.931 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:29.546352+0000 mon.smithi008 (mon.0) 1700 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:29.521528+0000 mon.smithi008 (mon.0) 1692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:29.523714+0000 mon.smithi008 (mon.0) 1693 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:19:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:29.524863+0000 mon.smithi008 (mon.0) 1694 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:19:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:29.531465+0000 mon.smithi008 (mon.0) 1695 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:29.537953+0000 mon.smithi008 (mon.0) 1696 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:29.541083+0000 mon.smithi008 (mon.0) 1697 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:29.542750+0000 mon.smithi008 (mon.0) 1698 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:29.544364+0000 mon.smithi008 (mon.0) 1699 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:29.546352+0000 mon.smithi008 (mon.0) 1700 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:29.492671+0000 mgr.smithi008.flmjzp (mgr.14640) 1239 : cluster [DBG] pgmap v866: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:19:29.525807+0000 mgr.smithi008.flmjzp (mgr.14640) 1240 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:29.526366+0000 mgr.smithi008.flmjzp (mgr.14640) 1241 : cluster [DBG] pgmap v867: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:29.526705+0000 mgr.smithi008.flmjzp (mgr.14640) 1242 : cluster [DBG] pgmap v868: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:19:29.548222+0000 mgr.smithi008.flmjzp (mgr.14640) 1243 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:29.492671+0000 mgr.smithi008.flmjzp (mgr.14640) 1239 : cluster [DBG] pgmap v866: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:19:29.525807+0000 mgr.smithi008.flmjzp (mgr.14640) 1240 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:29.526366+0000 mgr.smithi008.flmjzp (mgr.14640) 1241 : cluster [DBG] pgmap v867: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:29.526705+0000 mgr.smithi008.flmjzp (mgr.14640) 1242 : cluster [DBG] pgmap v868: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:19:29.548222+0000 mgr.smithi008.flmjzp (mgr.14640) 1243 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:31.527516+0000 mgr.smithi008.flmjzp (mgr.14640) 1244 : cluster [DBG] pgmap v869: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:32.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:31.527516+0000 mgr.smithi008.flmjzp (mgr.14640) 1244 : cluster [DBG] pgmap v869: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:33.528041+0000 mgr.smithi008.flmjzp (mgr.14640) 1245 : cluster [DBG] pgmap v870: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:33.528041+0000 mgr.smithi008.flmjzp (mgr.14640) 1245 : cluster [DBG] pgmap v870: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:35.528756+0000 mgr.smithi008.flmjzp (mgr.14640) 1246 : cluster [DBG] pgmap v871: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:35.984295+0000 mon.smithi008 (mon.0) 1701 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:36.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:35.528756+0000 mgr.smithi008.flmjzp (mgr.14640) 1246 : cluster [DBG] pgmap v871: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:35.984295+0000 mon.smithi008 (mon.0) 1701 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:37.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:35.979492+0000 mgr.smithi008.flmjzp (mgr.14640) 1247 : audit [DBG] from='client.45093 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:35.985507+0000 mgr.smithi008.flmjzp (mgr.14640) 1248 : cluster [DBG] pgmap v872: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:36.160738+0000 mon.smithi008 (mon.0) 1702 : cluster [WRN] Health check update: 22 daemons have recently crashed (RECENT_CRASH) 2023-10-18T21:19:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:35.979492+0000 mgr.smithi008.flmjzp (mgr.14640) 1247 : audit [DBG] from='client.45093 -' entity='client.crash.smithi060' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:35.985507+0000 mgr.smithi008.flmjzp (mgr.14640) 1248 : cluster [DBG] pgmap v872: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:36.160738+0000 mon.smithi008 (mon.0) 1702 : cluster [WRN] Health check update: 22 daemons have recently crashed (RECENT_CRASH) 2023-10-18T21:19:39.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.295+0000 7fd7aee1b700 1 -- 172.21.15.8:0/4110491671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7a80f77d0 msgr2=0x7fd7a80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:39.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.295+0000 7fd7aee1b700 1 --2- 172.21.15.8:0/4110491671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7a80f77d0 0x7fd7a80f7c30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fd798004660 tx=0x7fd798009b30).stop 2023-10-18T21:19:39.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.295+0000 7fd7aee1b700 1 -- 172.21.15.8:0/4110491671 shutdown_connections 2023-10-18T21:19:39.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.295+0000 7fd7aee1b700 1 --2- 172.21.15.8:0/4110491671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7a80f77d0 0x7fd7a80f7c30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.295+0000 7fd7aee1b700 1 --2- 172.21.15.8:0/4110491671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a80f6530 0x7fd7a80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.295+0000 7fd7aee1b700 1 -- 172.21.15.8:0/4110491671 >> 172.21.15.8:0/4110491671 conn(0x7fd7a80f1c90 msgr2=0x7fd7a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:39.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.295+0000 7fd7aee1b700 1 -- 172.21.15.8:0/4110491671 shutdown_connections 2023-10-18T21:19:39.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.295+0000 7fd7aee1b700 1 -- 172.21.15.8:0/4110491671 wait complete. 2023-10-18T21:19:39.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.296+0000 7fd7aee1b700 1 Processor -- start 2023-10-18T21:19:39.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.296+0000 7fd7aee1b700 1 -- start start 2023-10-18T21:19:39.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7aee1b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a80f6530 0x7fd7a80ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:39.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7aee1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7a80f77d0 0x7fd7a80ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:39.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7aee1b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a8100440 con 0x7fd7a80f77d0 2023-10-18T21:19:39.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7aee1b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a8100580 con 0x7fd7a80f6530 2023-10-18T21:19:39.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7ad618700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7a80f77d0 0x7fd7a80ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:39.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7ad618700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7a80f77d0 0x7fd7a80ffe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44626/0 (socket says 172.21.15.8:44626) 2023-10-18T21:19:39.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7ad618700 1 -- 172.21.15.8:0/909532842 learned_addr learned my addr 172.21.15.8:0/909532842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:39.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7ade19700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a80f6530 0x7fd7a80ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:39.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7ad618700 1 -- 172.21.15.8:0/909532842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a80f6530 msgr2=0x7fd7a80ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:39.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7ad618700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a80f6530 0x7fd7a80ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.297+0000 7fd7ad618700 1 -- 172.21.15.8:0/909532842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd798005040 con 0x7fd7a80f77d0 2023-10-18T21:19:39.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.298+0000 7fd7ad618700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7a80f77d0 0x7fd7a80ffe40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fd798009990 tx=0x7fd798009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:39.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.298+0000 7fd79e7fc700 1 -- 172.21.15.8:0/909532842 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd798018070 con 0x7fd7a80f77d0 2023-10-18T21:19:39.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.298+0000 7fd79e7fc700 1 -- 172.21.15.8:0/909532842 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd798009630 con 0x7fd7a80f77d0 2023-10-18T21:19:39.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.298+0000 7fd79e7fc700 1 -- 172.21.15.8:0/909532842 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd79801c400 con 0x7fd7a80f77d0 2023-10-18T21:19:39.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.298+0000 7fd7aee1b700 1 -- 172.21.15.8:0/909532842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a8100e90 con 0x7fd7a80f77d0 2023-10-18T21:19:39.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.298+0000 7fd7aee1b700 1 -- 172.21.15.8:0/909532842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a81013f0 con 0x7fd7a80f77d0 2023-10-18T21:19:39.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.299+0000 7fd7aee1b700 1 -- 172.21.15.8:0/909532842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a8045ad0 con 0x7fd7a80f77d0 2023-10-18T21:19:39.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.300+0000 7fd79e7fc700 1 -- 172.21.15.8:0/909532842 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd79801d9e0 con 0x7fd7a80f77d0 2023-10-18T21:19:39.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.301+0000 7fd79e7fc700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd794060f70 0x7fd794063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:39.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.301+0000 7fd79e7fc700 1 -- 172.21.15.8:0/909532842 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd79807e670 con 0x7fd7a80f77d0 2023-10-18T21:19:39.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.301+0000 7fd7ade19700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd794060f70 0x7fd794063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:39.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.302+0000 7fd7ade19700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd794060f70 0x7fd794063430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fd7a80ff6e0 tx=0x7fd7a4009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:39.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.306+0000 7fd79e7fc700 1 -- 172.21.15.8:0/909532842 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd79804e2a0 con 0x7fd7a80f77d0 2023-10-18T21:19:39.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:37.986003+0000 mgr.smithi008.flmjzp (mgr.14640) 1249 : cluster [DBG] pgmap v873: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:39.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.503+0000 7fd7aee1b700 1 -- 172.21.15.8:0/909532842 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7a80fee70 con 0x7fd794060f70 2023-10-18T21:19:39.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.505+0000 7fd79e7fc700 1 -- 172.21.15.8:0/909532842 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd7a4009290 con 0x7fd794060f70 2023-10-18T21:19:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.506+0000 7fd7aee1b700 1 -- 172.21.15.8:0/909532842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd794060f70 msgr2=0x7fd794063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.506+0000 7fd7aee1b700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd794060f70 0x7fd794063430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fd7a80ff6e0 tx=0x7fd7a4009c00).stop 2023-10-18T21:19:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.506+0000 7fd7aee1b700 1 -- 172.21.15.8:0/909532842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7a80f77d0 msgr2=0x7fd7a80ffe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.506+0000 7fd7aee1b700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7a80f77d0 0x7fd7a80ffe40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fd798009990 tx=0x7fd798009b30).stop 2023-10-18T21:19:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.507+0000 7fd7aee1b700 1 -- 172.21.15.8:0/909532842 shutdown_connections 2023-10-18T21:19:39.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.507+0000 7fd7aee1b700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd794060f70 0x7fd794063430 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.507+0000 7fd7aee1b700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a80f6530 0x7fd7a80ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.507+0000 7fd7aee1b700 1 --2- 172.21.15.8:0/909532842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7a80f77d0 0x7fd7a80ffe40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.507+0000 7fd7aee1b700 1 -- 172.21.15.8:0/909532842 >> 172.21.15.8:0/909532842 conn(0x7fd7a80f1c90 msgr2=0x7fd7a806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:39.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.507+0000 7fd7aee1b700 1 -- 172.21.15.8:0/909532842 shutdown_connections 2023-10-18T21:19:39.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.507+0000 7fd7aee1b700 1 -- 172.21.15.8:0/909532842 wait complete. 2023-10-18T21:19:39.522 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:19:39.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.646+0000 7f7082dbd700 1 -- 172.21.15.8:0/1434095574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f707c0f99e0 msgr2=0x7f707c0f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:39.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.646+0000 7f7082dbd700 1 --2- 172.21.15.8:0/1434095574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f707c0f99e0 0x7f707c0f9e40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f706c004660 tx=0x7f706c009b30).stop 2023-10-18T21:19:39.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.646+0000 7f7082dbd700 1 -- 172.21.15.8:0/1434095574 shutdown_connections 2023-10-18T21:19:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.646+0000 7f7082dbd700 1 --2- 172.21.15.8:0/1434095574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f707c0f99e0 0x7f707c0f9e40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.646+0000 7f7082dbd700 1 --2- 172.21.15.8:0/1434095574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c0f8740 0x7f707c0f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.646+0000 7f7082dbd700 1 -- 172.21.15.8:0/1434095574 >> 172.21.15.8:0/1434095574 conn(0x7f707c0f40e0 msgr2=0x7f707c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.646+0000 7f7082dbd700 1 -- 172.21.15.8:0/1434095574 shutdown_connections 2023-10-18T21:19:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.646+0000 7f7082dbd700 1 -- 172.21.15.8:0/1434095574 wait complete. 2023-10-18T21:19:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.647+0000 7f7082dbd700 1 Processor -- start 2023-10-18T21:19:39.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.647+0000 7f7082dbd700 1 -- start start 2023-10-18T21:19:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.647+0000 7f7082dbd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f707c0f8740 0x7f707c108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.647+0000 7f7082dbd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c0f99e0 0x7f707c109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.647+0000 7f7082dbd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c1099e0 con 0x7f707c0f8740 2023-10-18T21:19:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.647+0000 7f7082dbd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c109b20 con 0x7f707c0f99e0 2023-10-18T21:19:39.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f7081dbb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f707c0f8740 0x7f707c108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f7081dbb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f707c0f8740 0x7f707c108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44632/0 (socket says 172.21.15.8:44632) 2023-10-18T21:19:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f7081dbb700 1 -- 172.21.15.8:0/3687463893 learned_addr learned my addr 172.21.15.8:0/3687463893 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f70815ba700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c0f99e0 0x7f707c109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f7081dbb700 1 -- 172.21.15.8:0/3687463893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c0f99e0 msgr2=0x7f707c109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:39.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f7081dbb700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c0f99e0 0x7f707c109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f7081dbb700 1 -- 172.21.15.8:0/3687463893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c005040 con 0x7f707c0f8740 2023-10-18T21:19:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f7081dbb700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f707c0f8740 0x7f707c108f40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f7078002700 tx=0x7f7078009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f70727fc700 1 -- 172.21.15.8:0/3687463893 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70780079c0 con 0x7f707c0f8740 2023-10-18T21:19:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f70727fc700 1 -- 172.21.15.8:0/3687463893 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f707800f040 con 0x7f707c0f8740 2023-10-18T21:19:39.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.648+0000 7f7082dbd700 1 -- 172.21.15.8:0/3687463893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c10a4c0 con 0x7f707c0f8740 2023-10-18T21:19:39.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.649+0000 7f70727fc700 1 -- 172.21.15.8:0/3687463893 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70780148d0 con 0x7f707c0f8740 2023-10-18T21:19:39.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.649+0000 7f7082dbd700 1 -- 172.21.15.8:0/3687463893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c10aa80 con 0x7f707c0f8740 2023-10-18T21:19:39.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.650+0000 7f7082dbd700 1 -- 172.21.15.8:0/3687463893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c045ad0 con 0x7f707c0f8740 2023-10-18T21:19:39.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.651+0000 7f70727fc700 1 -- 172.21.15.8:0/3687463893 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f707801b060 con 0x7f707c0f8740 2023-10-18T21:19:39.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.651+0000 7f70727fc700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7068060f70 0x7f7068063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:39.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.652+0000 7f70727fc700 1 -- 172.21.15.8:0/3687463893 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f707807c770 con 0x7f707c0f8740 2023-10-18T21:19:39.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.652+0000 7f70815ba700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7068060f70 0x7f7068063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:39.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.652+0000 7f70815ba700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7068060f70 0x7f7068063430 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f706c004630 tx=0x7f706c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:39.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.656+0000 7f70727fc700 1 -- 172.21.15.8:0/3687463893 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f707804fdd0 con 0x7f707c0f8740 2023-10-18T21:19:39.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:37.986003+0000 mgr.smithi008.flmjzp (mgr.14640) 1249 : cluster [DBG] pgmap v873: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.861+0000 7f7082dbd700 1 -- 172.21.15.8:0/3687463893 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f707c101040 con 0x7f7068060f70 2023-10-18T21:19:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.862+0000 7f70727fc700 1 -- 172.21.15.8:0/3687463893 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f707c101040 con 0x7f7068060f70 2023-10-18T21:19:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 -- 172.21.15.8:0/3687463893 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7068060f70 msgr2=0x7f7068063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7068060f70 0x7f7068063430 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f706c004630 tx=0x7f706c009b30).stop 2023-10-18T21:19:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 -- 172.21.15.8:0/3687463893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f707c0f8740 msgr2=0x7f707c108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f707c0f8740 0x7f707c108f40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f7078002700 tx=0x7f7078009d80).stop 2023-10-18T21:19:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 -- 172.21.15.8:0/3687463893 shutdown_connections 2023-10-18T21:19:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7068060f70 0x7f7068063430 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f707c0f8740 0x7f707c108f40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 --2- 172.21.15.8:0/3687463893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c0f99e0 0x7f707c109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 -- 172.21.15.8:0/3687463893 >> 172.21.15.8:0/3687463893 conn(0x7f707c0f40e0 msgr2=0x7f707c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 -- 172.21.15.8:0/3687463893 shutdown_connections 2023-10-18T21:19:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:39.864+0000 7f7082dbd700 1 -- 172.21.15.8:0/3687463893 wait complete. 2023-10-18T21:19:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.000+0000 7fcd5eb74700 1 -- 172.21.15.8:0/3120636742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580f77d0 msgr2=0x7fcd580f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.000+0000 7fcd5eb74700 1 --2- 172.21.15.8:0/3120636742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580f77d0 0x7fcd580f7c30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fcd48004660 tx=0x7fcd48009b30).stop 2023-10-18T21:19:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.000+0000 7fcd5eb74700 1 -- 172.21.15.8:0/3120636742 shutdown_connections 2023-10-18T21:19:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.000+0000 7fcd5eb74700 1 --2- 172.21.15.8:0/3120636742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580f77d0 0x7fcd580f7c30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.000+0000 7fcd5eb74700 1 --2- 172.21.15.8:0/3120636742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd580f6530 0x7fcd580f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.000+0000 7fcd5eb74700 1 -- 172.21.15.8:0/3120636742 >> 172.21.15.8:0/3120636742 conn(0x7fcd580f1c90 msgr2=0x7fcd580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.000+0000 7fcd5eb74700 1 -- 172.21.15.8:0/3120636742 shutdown_connections 2023-10-18T21:19:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.000+0000 7fcd5eb74700 1 -- 172.21.15.8:0/3120636742 wait complete. 2023-10-18T21:19:40.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.001+0000 7fcd5eb74700 1 Processor -- start 2023-10-18T21:19:40.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.001+0000 7fcd5eb74700 1 -- start start 2023-10-18T21:19:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.001+0000 7fcd5eb74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580f6530 0x7fcd58108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.001+0000 7fcd5eb74700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd580f77d0 0x7fcd58109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.001+0000 7fcd5eb74700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd581099c0 con 0x7fcd580f6530 2023-10-18T21:19:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.001+0000 7fcd5eb74700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58109b00 con 0x7fcd580f77d0 2023-10-18T21:19:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.002+0000 7fcd5db72700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580f6530 0x7fcd58108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.002+0000 7fcd5db72700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580f6530 0x7fcd58108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44650/0 (socket says 172.21.15.8:44650) 2023-10-18T21:19:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.002+0000 7fcd5db72700 1 -- 172.21.15.8:0/2870145309 learned_addr learned my addr 172.21.15.8:0/2870145309 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.002+0000 7fcd5d371700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd580f77d0 0x7fcd58109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.002+0000 7fcd5db72700 1 -- 172.21.15.8:0/2870145309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd580f77d0 msgr2=0x7fcd58109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.002+0000 7fcd5db72700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd580f77d0 0x7fcd58109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.002+0000 7fcd5db72700 1 -- 172.21.15.8:0/2870145309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48005040 con 0x7fcd580f6530 2023-10-18T21:19:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.002+0000 7fcd5db72700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580f6530 0x7fcd58108f20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fcd5400e7c0 tx=0x7fcd5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.002+0000 7fcd4e7fc700 1 -- 172.21.15.8:0/2870145309 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd540092e0 con 0x7fcd580f6530 2023-10-18T21:19:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.003+0000 7fcd4e7fc700 1 -- 172.21.15.8:0/2870145309 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcd5400f040 con 0x7fcd580f6530 2023-10-18T21:19:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.003+0000 7fcd4e7fc700 1 -- 172.21.15.8:0/2870145309 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd54014810 con 0x7fcd580f6530 2023-10-18T21:19:40.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.003+0000 7fcd5eb74700 1 -- 172.21.15.8:0/2870145309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5810a4a0 con 0x7fcd580f6530 2023-10-18T21:19:40.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.003+0000 7fcd5eb74700 1 -- 172.21.15.8:0/2870145309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5810a990 con 0x7fcd580f6530 2023-10-18T21:19:40.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.004+0000 7fcd5eb74700 1 -- 172.21.15.8:0/2870145309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd58045ad0 con 0x7fcd580f6530 2023-10-18T21:19:40.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.005+0000 7fcd4e7fc700 1 -- 172.21.15.8:0/2870145309 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcd5401b030 con 0x7fcd580f6530 2023-10-18T21:19:40.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.005+0000 7fcd4e7fc700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd44060f70 0x7fcd44063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:40.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.005+0000 7fcd4e7fc700 1 -- 172.21.15.8:0/2870145309 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcd5407c920 con 0x7fcd580f6530 2023-10-18T21:19:40.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.006+0000 7fcd5d371700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd44060f70 0x7fcd44063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:40.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.006+0000 7fcd5d371700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd44060f70 0x7fcd44063430 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fcd48005010 tx=0x7fcd48016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:40.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.010+0000 7fcd4e7fc700 1 -- 172.21.15.8:0/2870145309 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcd5404ff00 con 0x7fcd580f6530 2023-10-18T21:19:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.203+0000 7fcd5eb74700 1 -- 172.21.15.8:0/2870145309 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd5810ac60 con 0x7fcd44060f70 2023-10-18T21:19:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.212+0000 7fcd4e7fc700 1 -- 172.21.15.8:0/2870145309 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcd5810ac60 con 0x7fcd44060f70 2023-10-18T21:19:40.213 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:19:40.214 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (26m) 4m ago 27m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:19:40.214 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (20m) 4m ago 27m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:19:40.214 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (20m) 2m ago 26m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:19:40.214 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (26m) 4m ago 27m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:19:40.215 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 23m - - 2023-10-18T21:19:40.215 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 23m - - 2023-10-18T21:19:40.215 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 23m - - 2023-10-18T21:19:40.215 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 23m - - 2023-10-18T21:19:40.215 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (21m) 4m ago 29m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:19:40.215 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (20m) 2m ago 26m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:19:40.216 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (20m) 4m ago 29m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:19:40.216 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (20m) 2m ago 26m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:19:40.216 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (27m) 4m ago 27m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:19:40.216 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (26m) 2m ago 26m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:19:40.216 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (19m) 4m ago 26m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:19:40.217 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (17m) 4m ago 26m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:19:40.217 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (17m) 4m ago 25m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:19:40.217 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (16m) 2m ago 25m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:19:40.217 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (16m) 2m ago 25m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:19:40.218 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (15m) 2m ago 24m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:19:40.218 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (21m) 4m ago 27m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:19:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.214+0000 7fcd5eb74700 1 -- 172.21.15.8:0/2870145309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd44060f70 msgr2=0x7fcd44063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.214+0000 7fcd5eb74700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd44060f70 0x7fcd44063430 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fcd48005010 tx=0x7fcd48016040).stop 2023-10-18T21:19:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.214+0000 7fcd5eb74700 1 -- 172.21.15.8:0/2870145309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580f6530 msgr2=0x7fcd58108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.214+0000 7fcd5eb74700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580f6530 0x7fcd58108f20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fcd5400e7c0 tx=0x7fcd5400b040).stop 2023-10-18T21:19:40.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.215+0000 7fcd5eb74700 1 -- 172.21.15.8:0/2870145309 shutdown_connections 2023-10-18T21:19:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.215+0000 7fcd5eb74700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd44060f70 0x7fcd44063430 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.215+0000 7fcd5eb74700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd580f6530 0x7fcd58108f20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.215+0000 7fcd5eb74700 1 --2- 172.21.15.8:0/2870145309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd580f77d0 0x7fcd58109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.215+0000 7fcd5eb74700 1 -- 172.21.15.8:0/2870145309 >> 172.21.15.8:0/2870145309 conn(0x7fcd580f1c90 msgr2=0x7fcd5806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.215+0000 7fcd5eb74700 1 -- 172.21.15.8:0/2870145309 shutdown_connections 2023-10-18T21:19:40.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.215+0000 7fcd5eb74700 1 -- 172.21.15.8:0/2870145309 wait complete. 2023-10-18T21:19:40.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.349+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2947670684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5db40f6530 msgr2=0x7f5db40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.349+0000 7f5dbab7a700 1 --2- 172.21.15.8:0/2947670684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5db40f6530 0x7f5db40f6950 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f5db0004660 tx=0x7f5db0009b30).stop 2023-10-18T21:19:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.349+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2947670684 shutdown_connections 2023-10-18T21:19:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.349+0000 7f5dbab7a700 1 --2- 172.21.15.8:0/2947670684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db40f77d0 0x7f5db40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.349+0000 7f5dbab7a700 1 --2- 172.21.15.8:0/2947670684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5db40f6530 0x7f5db40f6950 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.349+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2947670684 >> 172.21.15.8:0/2947670684 conn(0x7f5db40f1c90 msgr2=0x7f5db40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.349+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2947670684 shutdown_connections 2023-10-18T21:19:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.349+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2947670684 wait complete. 2023-10-18T21:19:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.350+0000 7f5dbab7a700 1 Processor -- start 2023-10-18T21:19:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.350+0000 7f5dbab7a700 1 -- start start 2023-10-18T21:19:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5dbab7a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db40f6530 0x7f5db4106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5dbab7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5db40f77d0 0x7f5db4107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5dbab7a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4107870 con 0x7f5db40f77d0 2023-10-18T21:19:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5dbab7a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db41080b0 con 0x7f5db40f6530 2023-10-18T21:19:40.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5db9377700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5db40f77d0 0x7f5db4107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:40.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5db9377700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5db40f77d0 0x7f5db4107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44668/0 (socket says 172.21.15.8:44668) 2023-10-18T21:19:40.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5db9377700 1 -- 172.21.15.8:0/2413794551 learned_addr learned my addr 172.21.15.8:0/2413794551 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:40.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5db9b78700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db40f6530 0x7f5db4106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:40.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5db9377700 1 -- 172.21.15.8:0/2413794551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db40f6530 msgr2=0x7f5db4106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5db9377700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db40f6530 0x7f5db4106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.351+0000 7f5db9377700 1 -- 172.21.15.8:0/2413794551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db0005040 con 0x7f5db40f77d0 2023-10-18T21:19:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.352+0000 7f5db9377700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5db40f77d0 0x7f5db4107270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f5da400e7f0 tx=0x7f5da400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.352+0000 7f5daa7fc700 1 -- 172.21.15.8:0/2413794551 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5da40092e0 con 0x7f5db40f77d0 2023-10-18T21:19:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.352+0000 7f5daa7fc700 1 -- 172.21.15.8:0/2413794551 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5da400f040 con 0x7f5db40f77d0 2023-10-18T21:19:40.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.352+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2413794551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db4108390 con 0x7f5db40f77d0 2023-10-18T21:19:40.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.352+0000 7f5daa7fc700 1 -- 172.21.15.8:0/2413794551 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5da40147e0 con 0x7f5db40f77d0 2023-10-18T21:19:40.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.352+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2413794551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db41088d0 con 0x7f5db40f77d0 2023-10-18T21:19:40.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.353+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2413794551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db4059100 con 0x7f5db40f77d0 2023-10-18T21:19:40.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.354+0000 7f5daa7fc700 1 -- 172.21.15.8:0/2413794551 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5da401b030 con 0x7f5db40f77d0 2023-10-18T21:19:40.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.355+0000 7f5daa7fc700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5da0060f70 0x7f5da0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:40.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.355+0000 7f5daa7fc700 1 -- 172.21.15.8:0/2413794551 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5da407c6b0 con 0x7f5db40f77d0 2023-10-18T21:19:40.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.355+0000 7f5db9b78700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5da0060f70 0x7f5da0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:40.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.356+0000 7f5db9b78700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5da0060f70 0x7f5da0063430 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f5db0004d80 tx=0x7f5db0016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:40.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.359+0000 7f5daa7fc700 1 -- 172.21.15.8:0/2413794551 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5da404c310 con 0x7f5db40f77d0 2023-10-18T21:19:40.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.504952+0000 mgr.smithi008.flmjzp (mgr.14640) 1250 : audit [DBG] from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.558802+0000 mon.smithi008 (mon.0) 1703 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.560551+0000 mon.smithi008 (mon.0) 1704 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:19:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.561239+0000 mon.smithi008 (mon.0) 1705 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:19:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:19:39.561871+0000 mgr.smithi008.flmjzp (mgr.14640) 1251 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:39.562533+0000 mgr.smithi008.flmjzp (mgr.14640) 1252 : cluster [DBG] pgmap v874: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:39.562897+0000 mgr.smithi008.flmjzp (mgr.14640) 1253 : cluster [DBG] pgmap v875: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.566620+0000 mon.smithi008 (mon.0) 1706 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.571823+0000 mon.smithi008 (mon.0) 1707 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.574196+0000 mon.smithi008 (mon.0) 1708 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.575428+0000 mon.smithi008 (mon.0) 1709 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:40.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.576596+0000 mon.smithi008 (mon.0) 1710 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:40.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.578055+0000 mon.smithi008 (mon.0) 1711 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:40.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:19:39.579547+0000 mgr.smithi008.flmjzp (mgr.14640) 1254 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:40.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.612+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2413794551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5db40fed80 con 0x7f5db40f77d0 2023-10-18T21:19:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.613+0000 7f5daa7fc700 1 -- 172.21.15.8:0/2413794551 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5da4019020 con 0x7f5db40f77d0 2023-10-18T21:19:40.614 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:19:40.615 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:19:40.615 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:19:40.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:19:40.615 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:19:40.615 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:19:40.616 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:19:40.616 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:19:40.616 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:19:40.616 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:19:40.616 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:19:40.617 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:19:40.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:19:40.617 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:19:40.617 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:19:40.617 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:19:40.618 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:19:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2413794551 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5da0060f70 msgr2=0x7f5da0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5da0060f70 0x7f5da0063430 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f5db0004d80 tx=0x7f5db0016040).stop 2023-10-18T21:19:40.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2413794551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5db40f77d0 msgr2=0x7f5db4107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5db40f77d0 0x7f5db4107270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f5da400e7f0 tx=0x7f5da400b040).stop 2023-10-18T21:19:40.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2413794551 shutdown_connections 2023-10-18T21:19:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5da0060f70 0x7f5da0063430 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db40f6530 0x7f5db4106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 --2- 172.21.15.8:0/2413794551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5db40f77d0 0x7f5db4107270 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2413794551 >> 172.21.15.8:0/2413794551 conn(0x7f5db40f1c90 msgr2=0x7f5db40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2413794551 shutdown_connections 2023-10-18T21:19:40.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.615+0000 7f5dbab7a700 1 -- 172.21.15.8:0/2413794551 wait complete. 2023-10-18T21:19:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.504952+0000 mgr.smithi008.flmjzp (mgr.14640) 1250 : audit [DBG] from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.558802+0000 mon.smithi008 (mon.0) 1703 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.560551+0000 mon.smithi008 (mon.0) 1704 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:19:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.561239+0000 mon.smithi008 (mon.0) 1705 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:19:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:19:39.561871+0000 mgr.smithi008.flmjzp (mgr.14640) 1251 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:39.562533+0000 mgr.smithi008.flmjzp (mgr.14640) 1252 : cluster [DBG] pgmap v874: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:39.562897+0000 mgr.smithi008.flmjzp (mgr.14640) 1253 : cluster [DBG] pgmap v875: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.566620+0000 mon.smithi008 (mon.0) 1706 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.571823+0000 mon.smithi008 (mon.0) 1707 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.574196+0000 mon.smithi008 (mon.0) 1708 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.575428+0000 mon.smithi008 (mon.0) 1709 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.576596+0000 mon.smithi008 (mon.0) 1710 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:40.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.578055+0000 mon.smithi008 (mon.0) 1711 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:40.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:19:39.579547+0000 mgr.smithi008.flmjzp (mgr.14640) 1254 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.752+0000 7fdbef581700 1 -- 172.21.15.8:0/447539001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe80f77d0 msgr2=0x7fdbe80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.752+0000 7fdbef581700 1 --2- 172.21.15.8:0/447539001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe80f77d0 0x7fdbe80f7c30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fdbd8004660 tx=0x7fdbd8009b30).stop 2023-10-18T21:19:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.752+0000 7fdbef581700 1 -- 172.21.15.8:0/447539001 shutdown_connections 2023-10-18T21:19:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.752+0000 7fdbef581700 1 --2- 172.21.15.8:0/447539001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe80f77d0 0x7fdbe80f7c30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.752+0000 7fdbef581700 1 --2- 172.21.15.8:0/447539001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe80f6530 0x7fdbe80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.752+0000 7fdbef581700 1 -- 172.21.15.8:0/447539001 >> 172.21.15.8:0/447539001 conn(0x7fdbe80f1c90 msgr2=0x7fdbe80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.752+0000 7fdbef581700 1 -- 172.21.15.8:0/447539001 shutdown_connections 2023-10-18T21:19:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.752+0000 7fdbef581700 1 -- 172.21.15.8:0/447539001 wait complete. 2023-10-18T21:19:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.753+0000 7fdbef581700 1 Processor -- start 2023-10-18T21:19:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.753+0000 7fdbef581700 1 -- start start 2023-10-18T21:19:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.754+0000 7fdbef581700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe80f6530 0x7fdbe806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.754+0000 7fdbef581700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe80f77d0 0x7fdbe8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.754+0000 7fdbef581700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe806a380 con 0x7fdbe80f77d0 2023-10-18T21:19:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.754+0000 7fdbef581700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe806a4c0 con 0x7fdbe80f6530 2023-10-18T21:19:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.754+0000 7fdbedd7e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe80f77d0 0x7fdbe8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.754+0000 7fdbedd7e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe80f77d0 0x7fdbe8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44684/0 (socket says 172.21.15.8:44684) 2023-10-18T21:19:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.754+0000 7fdbedd7e700 1 -- 172.21.15.8:0/622433056 learned_addr learned my addr 172.21.15.8:0/622433056 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.754+0000 7fdbee57f700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe80f6530 0x7fdbe806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.755+0000 7fdbedd7e700 1 -- 172.21.15.8:0/622433056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe80f6530 msgr2=0x7fdbe806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.755+0000 7fdbedd7e700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe80f6530 0x7fdbe806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:40.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.755+0000 7fdbedd7e700 1 -- 172.21.15.8:0/622433056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd8005040 con 0x7fdbe80f77d0 2023-10-18T21:19:40.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.755+0000 7fdbedd7e700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe80f77d0 0x7fdbe8069e20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fdbd8009990 tx=0x7fdbd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:40.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.755+0000 7fdbdeffd700 1 -- 172.21.15.8:0/622433056 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd8018070 con 0x7fdbe80f77d0 2023-10-18T21:19:40.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.755+0000 7fdbef581700 1 -- 172.21.15.8:0/622433056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe806a740 con 0x7fdbe80f77d0 2023-10-18T21:19:40.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.755+0000 7fdbdeffd700 1 -- 172.21.15.8:0/622433056 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdbd8009630 con 0x7fdbe80f77d0 2023-10-18T21:19:40.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.755+0000 7fdbdeffd700 1 -- 172.21.15.8:0/622433056 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd801c3c0 con 0x7fdbe80f77d0 2023-10-18T21:19:40.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.755+0000 7fdbef581700 1 -- 172.21.15.8:0/622433056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe806aca0 con 0x7fdbe80f77d0 2023-10-18T21:19:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.757+0000 7fdbef581700 1 -- 172.21.15.8:0/622433056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe8045ad0 con 0x7fdbe80f77d0 2023-10-18T21:19:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.758+0000 7fdbdeffd700 1 -- 172.21.15.8:0/622433056 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdbd801d970 con 0x7fdbe80f77d0 2023-10-18T21:19:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.758+0000 7fdbdeffd700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdbd4060f70 0x7fdbd4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.759+0000 7fdbdeffd700 1 -- 172.21.15.8:0/622433056 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdbd807e660 con 0x7fdbe80f77d0 2023-10-18T21:19:40.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.759+0000 7fdbee57f700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdbd4060f70 0x7fdbd4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:40.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.759+0000 7fdbee57f700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdbd4060f70 0x7fdbd4063430 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fdbe806b730 tx=0x7fdbe400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:40.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.763+0000 7fdbdeffd700 1 -- 172.21.15.8:0/622433056 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdbd804e210 con 0x7fdbe80f77d0 2023-10-18T21:19:40.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.987+0000 7fdbef581700 1 -- 172.21.15.8:0/622433056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdbe8027a00 con 0x7fdbe80f77d0 2023-10-18T21:19:40.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.987+0000 7fdbdeffd700 1 -- 172.21.15.8:0/622433056 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fdbd8051830 con 0x7fdbe80f77d0 2023-10-18T21:19:40.989 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:19:40.989 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:19:40.990 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:19:40.990 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:19:40.990 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:19:40.990 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:19:40.991 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:19:40.991 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:19:40.991 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:19:40.991 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:19:40.992 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:19:40.992 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:19:40.992 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:19:40.992 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:19:40.993 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:19:40.993 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:19:40.993 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:19:40.993 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:19:40.994 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:19:40.994 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:19:40.994 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:19:40.995 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:19:40.995 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:19:40.995 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:19:40.996 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:19:40.996 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:19:40.996 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:19:40.996 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:19:40.997 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:19:40.997 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:19:40.997 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:19:40.997 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:19:40.998 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:19:40.998 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:19:40.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.989+0000 7fdbef581700 1 -- 172.21.15.8:0/622433056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdbd4060f70 msgr2=0x7fdbd4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.989+0000 7fdbef581700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdbd4060f70 0x7fdbd4063430 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fdbe806b730 tx=0x7fdbe400b040).stop 2023-10-18T21:19:40.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.989+0000 7fdbef581700 1 -- 172.21.15.8:0/622433056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe80f77d0 msgr2=0x7fdbe8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:40.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.989+0000 7fdbef581700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe80f77d0 0x7fdbe8069e20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fdbd8009990 tx=0x7fdbd8009b30).stop 2023-10-18T21:19:40.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.989+0000 7fdbef581700 1 -- 172.21.15.8:0/622433056 shutdown_connections 2023-10-18T21:19:41.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.989+0000 7fdbef581700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdbd4060f70 0x7fdbd4063430 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:41.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.989+0000 7fdbef581700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe80f6530 0x7fdbe806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:41.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.989+0000 7fdbef581700 1 --2- 172.21.15.8:0/622433056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbe80f77d0 0x7fdbe8069e20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:41.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.990+0000 7fdbef581700 1 -- 172.21.15.8:0/622433056 >> 172.21.15.8:0/622433056 conn(0x7fdbe80f1c90 msgr2=0x7fdbe80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:41.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.990+0000 7fdbef581700 1 -- 172.21.15.8:0/622433056 shutdown_connections 2023-10-18T21:19:41.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:40.990+0000 7fdbef581700 1 -- 172.21.15.8:0/622433056 wait complete. 2023-10-18T21:19:41.001 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:19:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.127+0000 7fcecd370700 1 -- 172.21.15.8:0/2197299460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec80f6530 msgr2=0x7fcec80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.127+0000 7fcecd370700 1 --2- 172.21.15.8:0/2197299460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec80f6530 0x7fcec80f6950 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fceb8004660 tx=0x7fceb8009b30).stop 2023-10-18T21:19:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.127+0000 7fcecd370700 1 -- 172.21.15.8:0/2197299460 shutdown_connections 2023-10-18T21:19:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.127+0000 7fcecd370700 1 --2- 172.21.15.8:0/2197299460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80f77d0 0x7fcec80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.127+0000 7fcecd370700 1 --2- 172.21.15.8:0/2197299460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec80f6530 0x7fcec80f6950 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.127+0000 7fcecd370700 1 -- 172.21.15.8:0/2197299460 >> 172.21.15.8:0/2197299460 conn(0x7fcec80f1c90 msgr2=0x7fcec80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.127+0000 7fcecd370700 1 -- 172.21.15.8:0/2197299460 shutdown_connections 2023-10-18T21:19:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.127+0000 7fcecd370700 1 -- 172.21.15.8:0/2197299460 wait complete. 2023-10-18T21:19:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.128+0000 7fcecd370700 1 Processor -- start 2023-10-18T21:19:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.128+0000 7fcecd370700 1 -- start start 2023-10-18T21:19:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.128+0000 7fcecd370700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80f6530 0x7fcec806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.128+0000 7fcecd370700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec80f77d0 0x7fcec8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.128+0000 7fcecd370700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec806a380 con 0x7fcec80f77d0 2023-10-18T21:19:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.128+0000 7fcecd370700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec806a4c0 con 0x7fcec80f6530 2023-10-18T21:19:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.128+0000 7fcec77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec80f77d0 0x7fcec8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcec77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec80f77d0 0x7fcec8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44706/0 (socket says 172.21.15.8:44706) 2023-10-18T21:19:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcec77fe700 1 -- 172.21.15.8:0/453144000 learned_addr learned my addr 172.21.15.8:0/453144000 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:19:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcec7fff700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80f6530 0x7fcec806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcec77fe700 1 -- 172.21.15.8:0/453144000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80f6530 msgr2=0x7fcec806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcec77fe700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80f6530 0x7fcec806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcec77fe700 1 -- 172.21.15.8:0/453144000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8005040 con 0x7fcec80f77d0 2023-10-18T21:19:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcec77fe700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec80f77d0 0x7fcec8069e20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fcebc00e7f0 tx=0x7fcebc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcec4ff9700 1 -- 172.21.15.8:0/453144000 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcebc0092e0 con 0x7fcec80f77d0 2023-10-18T21:19:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcecd370700 1 -- 172.21.15.8:0/453144000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec806a7a0 con 0x7fcec80f77d0 2023-10-18T21:19:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcec4ff9700 1 -- 172.21.15.8:0/453144000 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcebc00f040 con 0x7fcec80f77d0 2023-10-18T21:19:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.129+0000 7fcec4ff9700 1 -- 172.21.15.8:0/453144000 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcebc0147e0 con 0x7fcec80f77d0 2023-10-18T21:19:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.130+0000 7fcecd370700 1 -- 172.21.15.8:0/453144000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec810ed70 con 0x7fcec80f77d0 2023-10-18T21:19:41.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.131+0000 7fcecd370700 1 -- 172.21.15.8:0/453144000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec8059100 con 0x7fcec80f77d0 2023-10-18T21:19:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.131+0000 7fcec4ff9700 1 -- 172.21.15.8:0/453144000 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcebc01b030 con 0x7fcec80f77d0 2023-10-18T21:19:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.132+0000 7fcec4ff9700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fceb0060f70 0x7fceb0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:19:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.132+0000 7fcec4ff9700 1 -- 172.21.15.8:0/453144000 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcebc07c7c0 con 0x7fcec80f77d0 2023-10-18T21:19:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.133+0000 7fcec7fff700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fceb0060f70 0x7fceb0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:19:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.133+0000 7fcec7fff700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fceb0060f70 0x7fceb0063430 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fceb8005010 tx=0x7fceb8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:19:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.136+0000 7fcec4ff9700 1 -- 172.21.15.8:0/453144000 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcebc04c420 con 0x7fcec80f77d0 2023-10-18T21:19:41.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.335+0000 7fcecd370700 1 -- 172.21.15.8:0/453144000 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcec80fed80 con 0x7fceb0060f70 2023-10-18T21:19:41.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.337+0000 7fcec4ff9700 1 -- 172.21.15.8:0/453144000 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcec80fed80 con 0x7fceb0060f70 2023-10-18T21:19:41.338 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:19:41.338 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:19:41.338 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:19:41.338 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:19:41.338 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:19:41.339 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:19:41.339 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:19:41.339 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:19:41.339 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:19:41.339 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:19:41.339 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:19:41.340 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:19:41.340 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:19:41.340 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:19:41.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.338+0000 7fcecd370700 1 -- 172.21.15.8:0/453144000 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fceb0060f70 msgr2=0x7fceb0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:41.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.338+0000 7fcecd370700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fceb0060f70 0x7fceb0063430 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fceb8005010 tx=0x7fceb8016040).stop 2023-10-18T21:19:41.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.338+0000 7fcecd370700 1 -- 172.21.15.8:0/453144000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec80f77d0 msgr2=0x7fcec8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:19:41.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.338+0000 7fcecd370700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec80f77d0 0x7fcec8069e20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fcebc00e7f0 tx=0x7fcebc00b040).stop 2023-10-18T21:19:41.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.339+0000 7fcecd370700 1 -- 172.21.15.8:0/453144000 shutdown_connections 2023-10-18T21:19:41.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.339+0000 7fcecd370700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fceb0060f70 0x7fceb0063430 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:41.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.339+0000 7fcecd370700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80f6530 0x7fcec806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:41.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.339+0000 7fcecd370700 1 --2- 172.21.15.8:0/453144000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec80f77d0 0x7fcec8069e20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:19:41.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.339+0000 7fcecd370700 1 -- 172.21.15.8:0/453144000 >> 172.21.15.8:0/453144000 conn(0x7fcec80f1c90 msgr2=0x7fcec80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:19:41.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.339+0000 7fcecd370700 1 -- 172.21.15.8:0/453144000 shutdown_connections 2023-10-18T21:19:41.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:19:41.339+0000 7fcecd370700 1 -- 172.21.15.8:0/453144000 wait complete. 2023-10-18T21:19:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:39.862498+0000 mgr.smithi008.flmjzp (mgr.14640) 1255 : audit [DBG] from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:40.204351+0000 mgr.smithi008.flmjzp (mgr.14640) 1256 : audit [DBG] from='client.35208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:40.613708+0000 mon.smithi008 (mon.0) 1712 : audit [DBG] from='client.? 172.21.15.8:0/2413794551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:40.988225+0000 mon.smithi008 (mon.0) 1713 : audit [DBG] from='client.? 172.21.15.8:0/622433056' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:19:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:39.862498+0000 mgr.smithi008.flmjzp (mgr.14640) 1255 : audit [DBG] from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:40.204351+0000 mgr.smithi008.flmjzp (mgr.14640) 1256 : audit [DBG] from='client.35208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:40.613708+0000 mon.smithi008 (mon.0) 1712 : audit [DBG] from='client.? 172.21.15.8:0/2413794551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:40.988225+0000 mon.smithi008 (mon.0) 1713 : audit [DBG] from='client.? 172.21.15.8:0/622433056' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:19:42.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:41.337064+0000 mgr.smithi008.flmjzp (mgr.14640) 1257 : audit [DBG] from='client.35220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:42.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:41.563410+0000 mgr.smithi008.flmjzp (mgr.14640) 1258 : cluster [DBG] pgmap v876: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:41.337064+0000 mgr.smithi008.flmjzp (mgr.14640) 1257 : audit [DBG] from='client.35220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:19:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:41.563410+0000 mgr.smithi008.flmjzp (mgr.14640) 1258 : cluster [DBG] pgmap v876: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:43.563873+0000 mgr.smithi008.flmjzp (mgr.14640) 1259 : cluster [DBG] pgmap v877: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:44.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:43.563873+0000 mgr.smithi008.flmjzp (mgr.14640) 1259 : cluster [DBG] pgmap v877: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:45.564421+0000 mgr.smithi008.flmjzp (mgr.14640) 1260 : cluster [DBG] pgmap v878: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:46.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:45.564421+0000 mgr.smithi008.flmjzp (mgr.14640) 1260 : cluster [DBG] pgmap v878: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:47.564994+0000 mgr.smithi008.flmjzp (mgr.14640) 1261 : cluster [DBG] pgmap v879: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:48.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:47.564994+0000 mgr.smithi008.flmjzp (mgr.14640) 1261 : cluster [DBG] pgmap v879: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:49.582906+0000 mon.smithi008 (mon.0) 1714 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:49.584968+0000 mon.smithi008 (mon.0) 1715 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:19:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:49.585961+0000 mon.smithi008 (mon.0) 1716 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:19:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:49.592475+0000 mon.smithi008 (mon.0) 1717 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:49.600466+0000 mon.smithi008 (mon.0) 1718 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:49.603933+0000 mon.smithi008 (mon.0) 1719 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:49.605898+0000 mon.smithi008 (mon.0) 1720 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:49.607689+0000 mon.smithi008 (mon.0) 1721 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:49.610255+0000 mon.smithi008 (mon.0) 1722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:49.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:49.582906+0000 mon.smithi008 (mon.0) 1714 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:49.584968+0000 mon.smithi008 (mon.0) 1715 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:19:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:49.585961+0000 mon.smithi008 (mon.0) 1716 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:19:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:49.592475+0000 mon.smithi008 (mon.0) 1717 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:19:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:49.600466+0000 mon.smithi008 (mon.0) 1718 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:49.603933+0000 mon.smithi008 (mon.0) 1719 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:49.605898+0000 mon.smithi008 (mon.0) 1720 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:49.607689+0000 mon.smithi008 (mon.0) 1721 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:49.610255+0000 mon.smithi008 (mon.0) 1722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:19:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:49.565724+0000 mgr.smithi008.flmjzp (mgr.14640) 1262 : cluster [DBG] pgmap v880: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:19:49.586877+0000 mgr.smithi008.flmjzp (mgr.14640) 1263 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:49.587434+0000 mgr.smithi008.flmjzp (mgr.14640) 1264 : cluster [DBG] pgmap v881: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:49.587852+0000 mgr.smithi008.flmjzp (mgr.14640) 1265 : cluster [DBG] pgmap v882: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:19:49.612364+0000 mgr.smithi008.flmjzp (mgr.14640) 1266 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:49.565724+0000 mgr.smithi008.flmjzp (mgr.14640) 1262 : cluster [DBG] pgmap v880: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:19:49.586877+0000 mgr.smithi008.flmjzp (mgr.14640) 1263 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:19:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:49.587434+0000 mgr.smithi008.flmjzp (mgr.14640) 1264 : cluster [DBG] pgmap v881: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:49.587852+0000 mgr.smithi008.flmjzp (mgr.14640) 1265 : cluster [DBG] pgmap v882: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:19:49.612364+0000 mgr.smithi008.flmjzp (mgr.14640) 1266 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:19:52.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:51.588577+0000 mgr.smithi008.flmjzp (mgr.14640) 1267 : cluster [DBG] pgmap v883: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:52.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:51.588577+0000 mgr.smithi008.flmjzp (mgr.14640) 1267 : cluster [DBG] pgmap v883: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:54.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:53.589202+0000 mgr.smithi008.flmjzp (mgr.14640) 1268 : cluster [DBG] pgmap v884: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:54.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:53.589202+0000 mgr.smithi008.flmjzp (mgr.14640) 1268 : cluster [DBG] pgmap v884: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:56.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:55.589910+0000 mgr.smithi008.flmjzp (mgr.14640) 1269 : cluster [DBG] pgmap v885: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:55.589910+0000 mgr.smithi008.flmjzp (mgr.14640) 1269 : cluster [DBG] pgmap v885: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:58.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:57.590549+0000 mgr.smithi008.flmjzp (mgr.14640) 1270 : cluster [DBG] pgmap v886: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:58.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:57.590549+0000 mgr.smithi008.flmjzp (mgr.14640) 1270 : cluster [DBG] pgmap v886: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:19:59.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:19:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:19:59.623121+0000 mon.smithi008 (mon.0) 1723 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:19:59.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:19:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:19:59.623121+0000 mon.smithi008 (mon.0) 1723 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:19:59.591178+0000 mgr.smithi008.flmjzp (mgr.14640) 1271 : cluster [DBG] pgmap v887: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000115+0000 mon.smithi008 (mon.0) 1724 : cluster [WRN] Health detail: HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T21:20:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000138+0000 mon.smithi008 (mon.0) 1725 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 4 failed cephadm daemon(s) 2023-10-18T21:20:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000149+0000 mon.smithi008 (mon.0) 1726 : cluster [WRN] daemon mds.cephfs.smithi008.lehgco on smithi008 is in error state 2023-10-18T21:20:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000156+0000 mon.smithi008 (mon.0) 1727 : cluster [WRN] daemon mds.cephfs.smithi008.mpstiw on smithi008 is in error state 2023-10-18T21:20:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000162+0000 mon.smithi008 (mon.0) 1728 : cluster [WRN] daemon mds.cephfs.smithi060.grdzlm on smithi060 is in error state 2023-10-18T21:20:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000168+0000 mon.smithi008 (mon.0) 1729 : cluster [WRN] daemon mds.cephfs.smithi060.rvrncq on smithi060 is in error state 2023-10-18T21:20:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000177+0000 mon.smithi008 (mon.0) 1730 : cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2023-10-18T21:20:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000187+0000 mon.smithi008 (mon.0) 1731 : cluster [WRN] fs cephfs is degraded 2023-10-18T21:20:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000197+0000 mon.smithi008 (mon.0) 1732 : cluster [WRN] [WRN] MDS_INSUFFICIENT_STANDBY: insufficient standby MDS daemons available 2023-10-18T21:20:00.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000207+0000 mon.smithi008 (mon.0) 1733 : cluster [WRN] have 0; want 1 more 2023-10-18T21:20:00.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000217+0000 mon.smithi008 (mon.0) 1734 : cluster [WRN] [WRN] RECENT_CRASH: 22 daemons have recently crashed 2023-10-18T21:20:00.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000224+0000 mon.smithi008 (mon.0) 1735 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:04:53.712088Z 2023-10-18T21:20:00.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000232+0000 mon.smithi008 (mon.0) 1736 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:06.040852Z 2023-10-18T21:20:00.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000238+0000 mon.smithi008 (mon.0) 1737 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:05:18.608464Z 2023-10-18T21:20:00.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000244+0000 mon.smithi008 (mon.0) 1738 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:30.912404Z 2023-10-18T21:20:00.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000250+0000 mon.smithi008 (mon.0) 1739 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:05:42.294371Z 2023-10-18T21:20:00.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000257+0000 mon.smithi008 (mon.0) 1740 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:54.337607Z 2023-10-18T21:20:00.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000266+0000 mon.smithi008 (mon.0) 1741 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:06:06.371237Z 2023-10-18T21:20:00.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000274+0000 mon.smithi008 (mon.0) 1742 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:06:18.404137Z 2023-10-18T21:20:00.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000282+0000 mon.smithi008 (mon.0) 1743 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:04.931636Z 2023-10-18T21:20:00.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000292+0000 mon.smithi008 (mon.0) 1744 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:16.718165Z 2023-10-18T21:20:00.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000301+0000 mon.smithi008 (mon.0) 1745 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:27.955553Z 2023-10-18T21:20:00.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000308+0000 mon.smithi008 (mon.0) 1746 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:07:44.946768Z 2023-10-18T21:20:00.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000318+0000 mon.smithi008 (mon.0) 1747 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:07:56.316504Z 2023-10-18T21:20:00.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000326+0000 mon.smithi008 (mon.0) 1748 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:08.201797Z 2023-10-18T21:20:00.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000334+0000 mon.smithi008 (mon.0) 1749 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:08:19.950444Z 2023-10-18T21:20:00.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000342+0000 mon.smithi008 (mon.0) 1750 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:31.274473Z 2023-10-18T21:20:00.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000350+0000 mon.smithi008 (mon.0) 1751 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:08:43.332863Z 2023-10-18T21:20:00.926 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000357+0000 mon.smithi008 (mon.0) 1752 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:54.982081Z 2023-10-18T21:20:00.927 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000366+0000 mon.smithi008 (mon.0) 1753 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:09:06.516458Z 2023-10-18T21:20:00.927 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000374+0000 mon.smithi008 (mon.0) 1754 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:09:18.552578Z 2023-10-18T21:20:00.927 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000382+0000 mon.smithi008 (mon.0) 1755 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:09:29.990016Z 2023-10-18T21:20:00.927 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.000389+0000 mon.smithi008 (mon.0) 1756 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:09:45.001557Z 2023-10-18T21:20:00.928 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:00.191702+0000 mon.smithi008 (mon.0) 1757 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:00.928 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:00.192621+0000 mon.smithi008 (mon.0) 1758 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:00.928 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:00.199771+0000 mon.smithi008 (mon.0) 1759 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:00.928 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:00.206229+0000 mon.smithi008 (mon.0) 1760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:00.928 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:00.209300+0000 mon.smithi008 (mon.0) 1761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:00.928 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:00.211094+0000 mon.smithi008 (mon.0) 1762 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:00.929 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:00.212772+0000 mon.smithi008 (mon.0) 1763 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:00.929 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:00.214883+0000 mon.smithi008 (mon.0) 1764 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:19:59.591178+0000 mgr.smithi008.flmjzp (mgr.14640) 1271 : cluster [DBG] pgmap v887: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000115+0000 mon.smithi008 (mon.0) 1724 : cluster [WRN] Health detail: HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T21:20:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000138+0000 mon.smithi008 (mon.0) 1725 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 4 failed cephadm daemon(s) 2023-10-18T21:20:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000149+0000 mon.smithi008 (mon.0) 1726 : cluster [WRN] daemon mds.cephfs.smithi008.lehgco on smithi008 is in error state 2023-10-18T21:20:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000156+0000 mon.smithi008 (mon.0) 1727 : cluster [WRN] daemon mds.cephfs.smithi008.mpstiw on smithi008 is in error state 2023-10-18T21:20:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000162+0000 mon.smithi008 (mon.0) 1728 : cluster [WRN] daemon mds.cephfs.smithi060.grdzlm on smithi060 is in error state 2023-10-18T21:20:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000168+0000 mon.smithi008 (mon.0) 1729 : cluster [WRN] daemon mds.cephfs.smithi060.rvrncq on smithi060 is in error state 2023-10-18T21:20:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000177+0000 mon.smithi008 (mon.0) 1730 : cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2023-10-18T21:20:00.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000187+0000 mon.smithi008 (mon.0) 1731 : cluster [WRN] fs cephfs is degraded 2023-10-18T21:20:00.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000197+0000 mon.smithi008 (mon.0) 1732 : cluster [WRN] [WRN] MDS_INSUFFICIENT_STANDBY: insufficient standby MDS daemons available 2023-10-18T21:20:00.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000207+0000 mon.smithi008 (mon.0) 1733 : cluster [WRN] have 0; want 1 more 2023-10-18T21:20:00.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000217+0000 mon.smithi008 (mon.0) 1734 : cluster [WRN] [WRN] RECENT_CRASH: 22 daemons have recently crashed 2023-10-18T21:20:00.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000224+0000 mon.smithi008 (mon.0) 1735 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:04:53.712088Z 2023-10-18T21:20:00.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000232+0000 mon.smithi008 (mon.0) 1736 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:06.040852Z 2023-10-18T21:20:00.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000238+0000 mon.smithi008 (mon.0) 1737 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:05:18.608464Z 2023-10-18T21:20:00.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000244+0000 mon.smithi008 (mon.0) 1738 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:30.912404Z 2023-10-18T21:20:00.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000250+0000 mon.smithi008 (mon.0) 1739 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:05:42.294371Z 2023-10-18T21:20:00.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000257+0000 mon.smithi008 (mon.0) 1740 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:05:54.337607Z 2023-10-18T21:20:00.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000266+0000 mon.smithi008 (mon.0) 1741 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:06:06.371237Z 2023-10-18T21:20:00.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000274+0000 mon.smithi008 (mon.0) 1742 : cluster [WRN] mds.cephfs.smithi008.mpstiw crashed on host smithi008 at 2023-10-18T21:06:18.404137Z 2023-10-18T21:20:00.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000282+0000 mon.smithi008 (mon.0) 1743 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:04.931636Z 2023-10-18T21:20:00.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000292+0000 mon.smithi008 (mon.0) 1744 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:16.718165Z 2023-10-18T21:20:00.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000301+0000 mon.smithi008 (mon.0) 1745 : cluster [WRN] mds.cephfs.smithi008.lehgco crashed on host smithi008 at 2023-10-18T21:07:27.955553Z 2023-10-18T21:20:00.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000308+0000 mon.smithi008 (mon.0) 1746 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:07:44.946768Z 2023-10-18T21:20:00.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000318+0000 mon.smithi008 (mon.0) 1747 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:07:56.316504Z 2023-10-18T21:20:00.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000326+0000 mon.smithi008 (mon.0) 1748 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:08.201797Z 2023-10-18T21:20:00.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000334+0000 mon.smithi008 (mon.0) 1749 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:08:19.950444Z 2023-10-18T21:20:00.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000342+0000 mon.smithi008 (mon.0) 1750 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:31.274473Z 2023-10-18T21:20:00.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000350+0000 mon.smithi008 (mon.0) 1751 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:08:43.332863Z 2023-10-18T21:20:00.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000357+0000 mon.smithi008 (mon.0) 1752 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:08:54.982081Z 2023-10-18T21:20:00.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000366+0000 mon.smithi008 (mon.0) 1753 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:09:06.516458Z 2023-10-18T21:20:00.993 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000374+0000 mon.smithi008 (mon.0) 1754 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:09:18.552578Z 2023-10-18T21:20:00.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000382+0000 mon.smithi008 (mon.0) 1755 : cluster [WRN] mds.cephfs.smithi060.grdzlm crashed on host smithi060 at 2023-10-18T21:09:29.990016Z 2023-10-18T21:20:00.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.000389+0000 mon.smithi008 (mon.0) 1756 : cluster [WRN] mds.cephfs.smithi060.rvrncq crashed on host smithi060 at 2023-10-18T21:09:45.001557Z 2023-10-18T21:20:00.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:00.191702+0000 mon.smithi008 (mon.0) 1757 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:00.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:00.192621+0000 mon.smithi008 (mon.0) 1758 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:00.994 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:00.199771+0000 mon.smithi008 (mon.0) 1759 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:00.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:00.206229+0000 mon.smithi008 (mon.0) 1760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:00.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:00.209300+0000 mon.smithi008 (mon.0) 1761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:00.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:00.211094+0000 mon.smithi008 (mon.0) 1762 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:00.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:00.212772+0000 mon.smithi008 (mon.0) 1763 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:00.995 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:00.214883+0000 mon.smithi008 (mon.0) 1764 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:00.193322+0000 mgr.smithi008.flmjzp (mgr.14640) 1272 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.193880+0000 mgr.smithi008.flmjzp (mgr.14640) 1273 : cluster [DBG] pgmap v888: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:00.194070+0000 mgr.smithi008.flmjzp (mgr.14640) 1274 : cluster [DBG] pgmap v889: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:00.216701+0000 mgr.smithi008.flmjzp (mgr.14640) 1275 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:01.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:00.193322+0000 mgr.smithi008.flmjzp (mgr.14640) 1272 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.193880+0000 mgr.smithi008.flmjzp (mgr.14640) 1273 : cluster [DBG] pgmap v888: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:00.194070+0000 mgr.smithi008.flmjzp (mgr.14640) 1274 : cluster [DBG] pgmap v889: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:00.216701+0000 mgr.smithi008.flmjzp (mgr.14640) 1275 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:02.194729+0000 mgr.smithi008.flmjzp (mgr.14640) 1276 : cluster [DBG] pgmap v890: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:03.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:02.194729+0000 mgr.smithi008.flmjzp (mgr.14640) 1276 : cluster [DBG] pgmap v890: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:04.195512+0000 mgr.smithi008.flmjzp (mgr.14640) 1277 : cluster [DBG] pgmap v891: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:05.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:04.195512+0000 mgr.smithi008.flmjzp (mgr.14640) 1277 : cluster [DBG] pgmap v891: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:07.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:06.196000+0000 mgr.smithi008.flmjzp (mgr.14640) 1278 : cluster [DBG] pgmap v892: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:06.196000+0000 mgr.smithi008.flmjzp (mgr.14640) 1278 : cluster [DBG] pgmap v892: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:09.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:08.196434+0000 mgr.smithi008.flmjzp (mgr.14640) 1279 : cluster [DBG] pgmap v893: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:10.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:08.196434+0000 mgr.smithi008.flmjzp (mgr.14640) 1279 : cluster [DBG] pgmap v893: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:10.197020+0000 mgr.smithi008.flmjzp (mgr.14640) 1280 : cluster [DBG] pgmap v894: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:10.227401+0000 mon.smithi008 (mon.0) 1765 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:10.229613+0000 mon.smithi008 (mon.0) 1766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:10.230654+0000 mon.smithi008 (mon.0) 1767 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:10.231592+0000 mgr.smithi008.flmjzp (mgr.14640) 1281 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:10.232234+0000 mgr.smithi008.flmjzp (mgr.14640) 1282 : cluster [DBG] pgmap v895: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:10.232626+0000 mgr.smithi008.flmjzp (mgr.14640) 1283 : cluster [DBG] pgmap v896: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:10.237616+0000 mon.smithi008 (mon.0) 1768 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:10.244112+0000 mon.smithi008 (mon.0) 1769 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:10.247491+0000 mon.smithi008 (mon.0) 1770 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:10.249442+0000 mon.smithi008 (mon.0) 1771 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:11.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:10.251181+0000 mon.smithi008 (mon.0) 1772 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:11.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:10.253288+0000 mon.smithi008 (mon.0) 1773 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:11.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:10.255238+0000 mgr.smithi008.flmjzp (mgr.14640) 1284 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:11.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.491+0000 7fc2199b3700 1 -- 172.21.15.8:0/3366489471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2140f6530 msgr2=0x7fc2140f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:11.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.491+0000 7fc2199b3700 1 --2- 172.21.15.8:0/3366489471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2140f6530 0x7fc2140f6950 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fc208004660 tx=0x7fc208009b30).stop 2023-10-18T21:20:11.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.491+0000 7fc2199b3700 1 -- 172.21.15.8:0/3366489471 shutdown_connections 2023-10-18T21:20:11.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.491+0000 7fc2199b3700 1 --2- 172.21.15.8:0/3366489471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2140f77d0 0x7fc2140f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:11.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.491+0000 7fc2199b3700 1 --2- 172.21.15.8:0/3366489471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2140f6530 0x7fc2140f6950 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:11.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.491+0000 7fc2199b3700 1 -- 172.21.15.8:0/3366489471 >> 172.21.15.8:0/3366489471 conn(0x7fc2140f1c90 msgr2=0x7fc2140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:11.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.492+0000 7fc2199b3700 1 -- 172.21.15.8:0/3366489471 shutdown_connections 2023-10-18T21:20:11.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.492+0000 7fc2199b3700 1 -- 172.21.15.8:0/3366489471 wait complete. 2023-10-18T21:20:11.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.492+0000 7fc2199b3700 1 Processor -- start 2023-10-18T21:20:11.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.493+0000 7fc2199b3700 1 -- start start 2023-10-18T21:20:11.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.493+0000 7fc2199b3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2140f6530 0x7fc21406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.493+0000 7fc2199b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2140f77d0 0x7fc214069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.493+0000 7fc2199b3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21406a380 con 0x7fc2140f77d0 2023-10-18T21:20:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.493+0000 7fc2199b3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21406a4c0 con 0x7fc2140f6530 2023-10-18T21:20:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.493+0000 7fc213fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2140f77d0 0x7fc214069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.493+0000 7fc213fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2140f77d0 0x7fc214069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49820/0 (socket says 172.21.15.8:49820) 2023-10-18T21:20:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.493+0000 7fc213fff700 1 -- 172.21.15.8:0/2339647843 learned_addr learned my addr 172.21.15.8:0/2339647843 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.493+0000 7fc2189b1700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2140f6530 0x7fc21406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.494+0000 7fc213fff700 1 -- 172.21.15.8:0/2339647843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2140f6530 msgr2=0x7fc21406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.494+0000 7fc213fff700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2140f6530 0x7fc21406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.494+0000 7fc213fff700 1 -- 172.21.15.8:0/2339647843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208005040 con 0x7fc2140f77d0 2023-10-18T21:20:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.494+0000 7fc213fff700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2140f77d0 0x7fc214069e20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fc20000c790 tx=0x7fc200007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.494+0000 7fc2117fa700 1 -- 172.21.15.8:0/2339647843 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc200002590 con 0x7fc2140f77d0 2023-10-18T21:20:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.494+0000 7fc2117fa700 1 -- 172.21.15.8:0/2339647843 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc200002bb0 con 0x7fc2140f77d0 2023-10-18T21:20:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.494+0000 7fc2199b3700 1 -- 172.21.15.8:0/2339647843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21406a7a0 con 0x7fc2140f77d0 2023-10-18T21:20:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.494+0000 7fc2117fa700 1 -- 172.21.15.8:0/2339647843 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc200013e10 con 0x7fc2140f77d0 2023-10-18T21:20:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.494+0000 7fc2199b3700 1 -- 172.21.15.8:0/2339647843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21410ede0 con 0x7fc2140f77d0 2023-10-18T21:20:11.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.495+0000 7fc2199b3700 1 -- 172.21.15.8:0/2339647843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc214059100 con 0x7fc2140f77d0 2023-10-18T21:20:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.496+0000 7fc2117fa700 1 -- 172.21.15.8:0/2339647843 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc20001a060 con 0x7fc2140f77d0 2023-10-18T21:20:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.497+0000 7fc2117fa700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc204060f70 0x7fc204063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.497+0000 7fc2117fa700 1 -- 172.21.15.8:0/2339647843 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc20007ccb0 con 0x7fc2140f77d0 2023-10-18T21:20:11.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.497+0000 7fc2189b1700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc204060f70 0x7fc204063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:11.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.498+0000 7fc2189b1700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc204060f70 0x7fc204063430 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fc21406b730 tx=0x7fc208009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:11.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.502+0000 7fc2117fa700 1 -- 172.21.15.8:0/2339647843 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc200050290 con 0x7fc2140f77d0 2023-10-18T21:20:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:10.197020+0000 mgr.smithi008.flmjzp (mgr.14640) 1280 : cluster [DBG] pgmap v894: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:10.227401+0000 mon.smithi008 (mon.0) 1765 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:10.229613+0000 mon.smithi008 (mon.0) 1766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:10.230654+0000 mon.smithi008 (mon.0) 1767 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:10.231592+0000 mgr.smithi008.flmjzp (mgr.14640) 1281 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:10.232234+0000 mgr.smithi008.flmjzp (mgr.14640) 1282 : cluster [DBG] pgmap v895: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:11.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:10.232626+0000 mgr.smithi008.flmjzp (mgr.14640) 1283 : cluster [DBG] pgmap v896: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:11.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:10.237616+0000 mon.smithi008 (mon.0) 1768 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:11.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:10.244112+0000 mon.smithi008 (mon.0) 1769 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:11.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:10.247491+0000 mon.smithi008 (mon.0) 1770 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:11.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:10.249442+0000 mon.smithi008 (mon.0) 1771 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:11.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:10.251181+0000 mon.smithi008 (mon.0) 1772 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:11.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:10.253288+0000 mon.smithi008 (mon.0) 1773 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:11.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:10.255238+0000 mgr.smithi008.flmjzp (mgr.14640) 1284 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:11.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.699+0000 7fc2199b3700 1 -- 172.21.15.8:0/2339647843 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2140fed90 con 0x7fc204060f70 2023-10-18T21:20:11.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.701+0000 7fc2117fa700 1 -- 172.21.15.8:0/2339647843 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc2140fed90 con 0x7fc204060f70 2023-10-18T21:20:11.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 -- 172.21.15.8:0/2339647843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc204060f70 msgr2=0x7fc204063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:11.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc204060f70 0x7fc204063430 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fc21406b730 tx=0x7fc208009b30).stop 2023-10-18T21:20:11.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 -- 172.21.15.8:0/2339647843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2140f77d0 msgr2=0x7fc214069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:11.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2140f77d0 0x7fc214069e20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fc20000c790 tx=0x7fc200007d70).stop 2023-10-18T21:20:11.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 -- 172.21.15.8:0/2339647843 shutdown_connections 2023-10-18T21:20:11.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc204060f70 0x7fc204063430 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:11.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2140f6530 0x7fc21406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:11.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 --2- 172.21.15.8:0/2339647843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2140f77d0 0x7fc214069e20 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:11.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 -- 172.21.15.8:0/2339647843 >> 172.21.15.8:0/2339647843 conn(0x7fc2140f1c90 msgr2=0x7fc2140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:11.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 -- 172.21.15.8:0/2339647843 shutdown_connections 2023-10-18T21:20:11.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.703+0000 7fc2199b3700 1 -- 172.21.15.8:0/2339647843 wait complete. 2023-10-18T21:20:11.720 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:20:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.841+0000 7fc494c5f700 1 -- 172.21.15.8:0/2768262318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4900f77d0 msgr2=0x7fc4900f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.841+0000 7fc494c5f700 1 --2- 172.21.15.8:0/2768262318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4900f77d0 0x7fc4900f7c30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fc484004660 tx=0x7fc484009b30).stop 2023-10-18T21:20:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.841+0000 7fc494c5f700 1 -- 172.21.15.8:0/2768262318 shutdown_connections 2023-10-18T21:20:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.841+0000 7fc494c5f700 1 --2- 172.21.15.8:0/2768262318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4900f77d0 0x7fc4900f7c30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.841+0000 7fc494c5f700 1 --2- 172.21.15.8:0/2768262318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4900f6530 0x7fc4900f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.841+0000 7fc494c5f700 1 -- 172.21.15.8:0/2768262318 >> 172.21.15.8:0/2768262318 conn(0x7fc4900f1c90 msgr2=0x7fc4900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:11.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.841+0000 7fc494c5f700 1 -- 172.21.15.8:0/2768262318 shutdown_connections 2023-10-18T21:20:11.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.841+0000 7fc494c5f700 1 -- 172.21.15.8:0/2768262318 wait complete. 2023-10-18T21:20:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.842+0000 7fc494c5f700 1 Processor -- start 2023-10-18T21:20:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.842+0000 7fc494c5f700 1 -- start start 2023-10-18T21:20:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc494c5f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4900f6530 0x7fc490106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc494c5f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4900f77d0 0x7fc490107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc494c5f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc490107850 con 0x7fc4900f77d0 2023-10-18T21:20:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc494c5f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc490108060 con 0x7fc4900f6530 2023-10-18T21:20:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc48effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4900f77d0 0x7fc490107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc48effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4900f77d0 0x7fc490107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49830/0 (socket says 172.21.15.8:49830) 2023-10-18T21:20:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc48effd700 1 -- 172.21.15.8:0/1573307245 learned_addr learned my addr 172.21.15.8:0/1573307245 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc48f7fe700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4900f6530 0x7fc490106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc48effd700 1 -- 172.21.15.8:0/1573307245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4900f6530 msgr2=0x7fc490106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc48effd700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4900f6530 0x7fc490106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.843+0000 7fc48effd700 1 -- 172.21.15.8:0/1573307245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484005040 con 0x7fc4900f77d0 2023-10-18T21:20:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.844+0000 7fc48effd700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4900f77d0 0x7fc490107250 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc484004320 tx=0x7fc48400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.844+0000 7fc477fff700 1 -- 172.21.15.8:0/1573307245 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc484019070 con 0x7fc4900f77d0 2023-10-18T21:20:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.844+0000 7fc477fff700 1 -- 172.21.15.8:0/1573307245 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc48401e420 con 0x7fc4900f77d0 2023-10-18T21:20:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.844+0000 7fc477fff700 1 -- 172.21.15.8:0/1573307245 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc484014680 con 0x7fc4900f77d0 2023-10-18T21:20:11.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.844+0000 7fc494c5f700 1 -- 172.21.15.8:0/1573307245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc490108280 con 0x7fc4900f77d0 2023-10-18T21:20:11.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.844+0000 7fc494c5f700 1 -- 172.21.15.8:0/1573307245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc490108760 con 0x7fc4900f77d0 2023-10-18T21:20:11.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.845+0000 7fc494c5f700 1 -- 172.21.15.8:0/1573307245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc490059100 con 0x7fc4900f77d0 2023-10-18T21:20:11.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.846+0000 7fc477fff700 1 -- 172.21.15.8:0/1573307245 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc48401e590 con 0x7fc4900f77d0 2023-10-18T21:20:11.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.847+0000 7fc477fff700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc478060f70 0x7fc478063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:11.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.847+0000 7fc477fff700 1 -- 172.21.15.8:0/1573307245 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc48407dd10 con 0x7fc4900f77d0 2023-10-18T21:20:11.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.847+0000 7fc48f7fe700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc478060f70 0x7fc478063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:11.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.848+0000 7fc48f7fe700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc478060f70 0x7fc478063430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fc490106ad0 tx=0x7fc48000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:11.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:11.851+0000 7fc477fff700 1 -- 172.21.15.8:0/1573307245 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc48404d8e0 con 0x7fc4900f77d0 2023-10-18T21:20:12.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.051+0000 7fc494c5f700 1 -- 172.21.15.8:0/1573307245 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4900fedb0 con 0x7fc478060f70 2023-10-18T21:20:12.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.052+0000 7fc477fff700 1 -- 172.21.15.8:0/1573307245 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc4900fedb0 con 0x7fc478060f70 2023-10-18T21:20:12.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.054+0000 7fc494c5f700 1 -- 172.21.15.8:0/1573307245 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc478060f70 msgr2=0x7fc478063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.054+0000 7fc494c5f700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc478060f70 0x7fc478063430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fc490106ad0 tx=0x7fc48000b040).stop 2023-10-18T21:20:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.054+0000 7fc494c5f700 1 -- 172.21.15.8:0/1573307245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4900f77d0 msgr2=0x7fc490107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.054+0000 7fc494c5f700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4900f77d0 0x7fc490107250 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc484004320 tx=0x7fc48400b040).stop 2023-10-18T21:20:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.054+0000 7fc494c5f700 1 -- 172.21.15.8:0/1573307245 shutdown_connections 2023-10-18T21:20:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.054+0000 7fc494c5f700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc478060f70 0x7fc478063430 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.054+0000 7fc494c5f700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4900f6530 0x7fc490106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.054+0000 7fc494c5f700 1 --2- 172.21.15.8:0/1573307245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4900f77d0 0x7fc490107250 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.054+0000 7fc494c5f700 1 -- 172.21.15.8:0/1573307245 >> 172.21.15.8:0/1573307245 conn(0x7fc4900f1c90 msgr2=0x7fc4900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:12.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.055+0000 7fc494c5f700 1 -- 172.21.15.8:0/1573307245 shutdown_connections 2023-10-18T21:20:12.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.055+0000 7fc494c5f700 1 -- 172.21.15.8:0/1573307245 wait complete. 2023-10-18T21:20:12.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.191+0000 7fcf29c41700 1 -- 172.21.15.8:0/2081300368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf240f6530 msgr2=0x7fcf240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.191+0000 7fcf29c41700 1 --2- 172.21.15.8:0/2081300368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf240f6530 0x7fcf240f6950 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fcf18004660 tx=0x7fcf18009b30).stop 2023-10-18T21:20:12.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.191+0000 7fcf29c41700 1 -- 172.21.15.8:0/2081300368 shutdown_connections 2023-10-18T21:20:12.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.191+0000 7fcf29c41700 1 --2- 172.21.15.8:0/2081300368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf240f77d0 0x7fcf240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.191+0000 7fcf29c41700 1 --2- 172.21.15.8:0/2081300368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf240f6530 0x7fcf240f6950 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.191+0000 7fcf29c41700 1 -- 172.21.15.8:0/2081300368 >> 172.21.15.8:0/2081300368 conn(0x7fcf240f1c90 msgr2=0x7fcf240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:12.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.191+0000 7fcf29c41700 1 -- 172.21.15.8:0/2081300368 shutdown_connections 2023-10-18T21:20:12.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.191+0000 7fcf29c41700 1 -- 172.21.15.8:0/2081300368 wait complete. 2023-10-18T21:20:12.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.192+0000 7fcf29c41700 1 Processor -- start 2023-10-18T21:20:12.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.192+0000 7fcf29c41700 1 -- start start 2023-10-18T21:20:12.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.192+0000 7fcf29c41700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf240f6530 0x7fcf24106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:12.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.192+0000 7fcf29c41700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf240f77d0 0x7fcf24107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:12.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.193+0000 7fcf29c41700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24107910 con 0x7fcf240f77d0 2023-10-18T21:20:12.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.193+0000 7fcf29c41700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24108120 con 0x7fcf240f6530 2023-10-18T21:20:12.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.193+0000 7fcf23fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf240f77d0 0x7fcf24107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:12.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.193+0000 7fcf23fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf240f77d0 0x7fcf24107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49850/0 (socket says 172.21.15.8:49850) 2023-10-18T21:20:12.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.193+0000 7fcf23fff700 1 -- 172.21.15.8:0/3513434818 learned_addr learned my addr 172.21.15.8:0/3513434818 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:12.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.193+0000 7fcf28c3f700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf240f6530 0x7fcf24106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:12.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.193+0000 7fcf23fff700 1 -- 172.21.15.8:0/3513434818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf240f6530 msgr2=0x7fcf24106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.193+0000 7fcf23fff700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf240f6530 0x7fcf24106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.193+0000 7fcf23fff700 1 -- 172.21.15.8:0/3513434818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18005040 con 0x7fcf240f77d0 2023-10-18T21:20:12.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.193+0000 7fcf23fff700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf240f77d0 0x7fcf24107310 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fcf100026d0 tx=0x7fcf10009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:12.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.194+0000 7fcf217fa700 1 -- 172.21.15.8:0/3513434818 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf100079c0 con 0x7fcf240f77d0 2023-10-18T21:20:12.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.194+0000 7fcf217fa700 1 -- 172.21.15.8:0/3513434818 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcf1000f040 con 0x7fcf240f77d0 2023-10-18T21:20:12.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.194+0000 7fcf29c41700 1 -- 172.21.15.8:0/3513434818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf241083a0 con 0x7fcf240f77d0 2023-10-18T21:20:12.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.194+0000 7fcf217fa700 1 -- 172.21.15.8:0/3513434818 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf10014980 con 0x7fcf240f77d0 2023-10-18T21:20:12.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.194+0000 7fcf29c41700 1 -- 172.21.15.8:0/3513434818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf24108960 con 0x7fcf240f77d0 2023-10-18T21:20:12.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.195+0000 7fcf29c41700 1 -- 172.21.15.8:0/3513434818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf24059100 con 0x7fcf240f77d0 2023-10-18T21:20:12.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.196+0000 7fcf217fa700 1 -- 172.21.15.8:0/3513434818 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcf100090d0 con 0x7fcf240f77d0 2023-10-18T21:20:12.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.197+0000 7fcf217fa700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf14060f70 0x7fcf14063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:12.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.197+0000 7fcf217fa700 1 -- 172.21.15.8:0/3513434818 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcf1007c980 con 0x7fcf240f77d0 2023-10-18T21:20:12.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.197+0000 7fcf28c3f700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf14060f70 0x7fcf14063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:12.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.197+0000 7fcf28c3f700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf14060f70 0x7fcf14063430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fcf18005010 tx=0x7fcf18009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:12.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.201+0000 7fcf217fa700 1 -- 172.21.15.8:0/3513434818 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcf1004c5e0 con 0x7fcf240f77d0 2023-10-18T21:20:12.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.395+0000 7fcf29c41700 1 -- 172.21.15.8:0/3513434818 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf240fee50 con 0x7fcf14060f70 2023-10-18T21:20:12.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.405+0000 7fcf217fa700 1 -- 172.21.15.8:0/3513434818 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcf240fee50 con 0x7fcf14060f70 2023-10-18T21:20:12.407 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:20:12.407 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (26m) 4m ago 28m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:20:12.407 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (20m) 4m ago 28m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:20:12.408 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (20m) 2m ago 27m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:20:12.408 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (26m) 4m ago 28m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:20:12.408 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 24m - - 2023-10-18T21:20:12.408 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 24m - - 2023-10-18T21:20:12.408 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 24m - - 2023-10-18T21:20:12.409 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 24m - - 2023-10-18T21:20:12.409 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (22m) 4m ago 29m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:20:12.409 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (21m) 2m ago 27m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:20:12.409 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (21m) 4m ago 29m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:20:12.409 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (21m) 2m ago 27m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:20:12.410 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (27m) 4m ago 27m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:20:12.410 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (27m) 2m ago 27m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:20:12.410 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (20m) 4m ago 26m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:20:12.410 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (18m) 4m ago 26m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:20:12.410 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (17m) 4m ago 26m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:20:12.411 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (17m) 2m ago 26m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:20:12.411 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (16m) 2m ago 25m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:20:12.411 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (16m) 2m ago 25m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:20:12.411 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (22m) 4m ago 27m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:20:12.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 -- 172.21.15.8:0/3513434818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf14060f70 msgr2=0x7fcf14063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf14060f70 0x7fcf14063430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fcf18005010 tx=0x7fcf18009b30).stop 2023-10-18T21:20:12.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 -- 172.21.15.8:0/3513434818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf240f77d0 msgr2=0x7fcf24107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf240f77d0 0x7fcf24107310 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fcf100026d0 tx=0x7fcf10009de0).stop 2023-10-18T21:20:12.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 -- 172.21.15.8:0/3513434818 shutdown_connections 2023-10-18T21:20:12.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf14060f70 0x7fcf14063430 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf240f6530 0x7fcf24106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 --2- 172.21.15.8:0/3513434818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf240f77d0 0x7fcf24107310 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 -- 172.21.15.8:0/3513434818 >> 172.21.15.8:0/3513434818 conn(0x7fcf240f1c90 msgr2=0x7fcf240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:12.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 -- 172.21.15.8:0/3513434818 shutdown_connections 2023-10-18T21:20:12.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.407+0000 7fcf29c41700 1 -- 172.21.15.8:0/3513434818 wait complete. 2023-10-18T21:20:12.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:11.702181+0000 mgr.smithi008.flmjzp (mgr.14640) 1285 : audit [DBG] from='client.35224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:12.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.542+0000 7fa6130b4700 1 -- 172.21.15.8:0/1434745606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa60c0f6530 msgr2=0x7fa60c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.542+0000 7fa6130b4700 1 --2- 172.21.15.8:0/1434745606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa60c0f6530 0x7fa60c0f6950 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fa608004660 tx=0x7fa608009b30).stop 2023-10-18T21:20:12.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.542+0000 7fa6130b4700 1 -- 172.21.15.8:0/1434745606 shutdown_connections 2023-10-18T21:20:12.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.542+0000 7fa6130b4700 1 --2- 172.21.15.8:0/1434745606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0f77d0 0x7fa60c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.542+0000 7fa6130b4700 1 --2- 172.21.15.8:0/1434745606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa60c0f6530 0x7fa60c0f6950 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.542+0000 7fa6130b4700 1 -- 172.21.15.8:0/1434745606 >> 172.21.15.8:0/1434745606 conn(0x7fa60c0f1c90 msgr2=0x7fa60c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:12.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.543+0000 7fa6130b4700 1 -- 172.21.15.8:0/1434745606 shutdown_connections 2023-10-18T21:20:12.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.543+0000 7fa6130b4700 1 -- 172.21.15.8:0/1434745606 wait complete. 2023-10-18T21:20:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.543+0000 7fa6130b4700 1 Processor -- start 2023-10-18T21:20:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.543+0000 7fa6130b4700 1 -- start start 2023-10-18T21:20:12.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.544+0000 7fa6130b4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa60c0f6530 0x7fa60c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:12.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.544+0000 7fa6130b4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0f77d0 0x7fa60c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:12.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.544+0000 7fa6130b4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c06a380 con 0x7fa60c0f6530 2023-10-18T21:20:12.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.544+0000 7fa6130b4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c06a4c0 con 0x7fa60c0f77d0 2023-10-18T21:20:12.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.544+0000 7fa6120b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa60c0f6530 0x7fa60c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:12.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.544+0000 7fa6120b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa60c0f6530 0x7fa60c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49874/0 (socket says 172.21.15.8:49874) 2023-10-18T21:20:12.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.544+0000 7fa6120b2700 1 -- 172.21.15.8:0/668004191 learned_addr learned my addr 172.21.15.8:0/668004191 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:12.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.544+0000 7fa6118b1700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0f77d0 0x7fa60c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:12.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.545+0000 7fa6120b2700 1 -- 172.21.15.8:0/668004191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0f77d0 msgr2=0x7fa60c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.545+0000 7fa6120b2700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0f77d0 0x7fa60c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.545+0000 7fa6120b2700 1 -- 172.21.15.8:0/668004191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608005040 con 0x7fa60c0f6530 2023-10-18T21:20:12.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.545+0000 7fa6120b2700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa60c0f6530 0x7fa60c06b9a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fa608009f50 tx=0x7fa608009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:12.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.545+0000 7fa602ffd700 1 -- 172.21.15.8:0/668004191 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa608018070 con 0x7fa60c0f6530 2023-10-18T21:20:12.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.545+0000 7fa6130b4700 1 -- 172.21.15.8:0/668004191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c06a740 con 0x7fa60c0f6530 2023-10-18T21:20:12.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.545+0000 7fa602ffd700 1 -- 172.21.15.8:0/668004191 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa60801d8e0 con 0x7fa60c0f6530 2023-10-18T21:20:12.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.545+0000 7fa602ffd700 1 -- 172.21.15.8:0/668004191 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa60801c440 con 0x7fa60c0f6530 2023-10-18T21:20:12.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.545+0000 7fa6130b4700 1 -- 172.21.15.8:0/668004191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c06aca0 con 0x7fa60c0f6530 2023-10-18T21:20:12.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.546+0000 7fa6130b4700 1 -- 172.21.15.8:0/668004191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c045ad0 con 0x7fa60c0f6530 2023-10-18T21:20:12.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.547+0000 7fa602ffd700 1 -- 172.21.15.8:0/668004191 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa60801da50 con 0x7fa60c0f6530 2023-10-18T21:20:12.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.548+0000 7fa602ffd700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5f8060f70 0x7fa5f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:12.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.548+0000 7fa602ffd700 1 -- 172.21.15.8:0/668004191 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa60807e7d0 con 0x7fa60c0f6530 2023-10-18T21:20:12.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.548+0000 7fa6118b1700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5f8060f70 0x7fa5f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:12.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.549+0000 7fa6118b1700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5f8060f70 0x7fa5f8063430 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fa5fc007fd0 tx=0x7fa5fc009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:12.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.552+0000 7fa602ffd700 1 -- 172.21.15.8:0/668004191 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa60804e380 con 0x7fa60c0f6530 2023-10-18T21:20:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:11.702181+0000 mgr.smithi008.flmjzp (mgr.14640) 1285 : audit [DBG] from='client.35224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:12.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.804+0000 7fa6130b4700 1 -- 172.21.15.8:0/668004191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa60c0fedd0 con 0x7fa60c0f6530 2023-10-18T21:20:12.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.804+0000 7fa602ffd700 1 -- 172.21.15.8:0/668004191 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fa6080519a0 con 0x7fa60c0f6530 2023-10-18T21:20:12.806 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:20:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:20:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:20:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:20:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:20:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:20:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:20:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:20:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:20:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:20:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:20:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:20:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:20:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:20:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:20:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:20:12.809 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:20:12.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 -- 172.21.15.8:0/668004191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5f8060f70 msgr2=0x7fa5f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5f8060f70 0x7fa5f8063430 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fa5fc007fd0 tx=0x7fa5fc009040).stop 2023-10-18T21:20:12.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 -- 172.21.15.8:0/668004191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa60c0f6530 msgr2=0x7fa60c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa60c0f6530 0x7fa60c06b9a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fa608009f50 tx=0x7fa608009b30).stop 2023-10-18T21:20:12.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 -- 172.21.15.8:0/668004191 shutdown_connections 2023-10-18T21:20:12.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5f8060f70 0x7fa5f8063430 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa60c0f6530 0x7fa60c06b9a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 --2- 172.21.15.8:0/668004191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0f77d0 0x7fa60c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 -- 172.21.15.8:0/668004191 >> 172.21.15.8:0/668004191 conn(0x7fa60c0f1c90 msgr2=0x7fa60c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:12.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 -- 172.21.15.8:0/668004191 shutdown_connections 2023-10-18T21:20:12.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.806+0000 7fa6130b4700 1 -- 172.21.15.8:0/668004191 wait complete. 2023-10-18T21:20:12.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.943+0000 7fcafffff700 1 -- 172.21.15.8:0/4048022780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb000f8740 msgr2=0x7fcb000f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.943+0000 7fcafffff700 1 --2- 172.21.15.8:0/4048022780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb000f8740 0x7fcb000f8b60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fcaf0004660 tx=0x7fcaf0009b30).stop 2023-10-18T21:20:12.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.944+0000 7fcafffff700 1 -- 172.21.15.8:0/4048022780 shutdown_connections 2023-10-18T21:20:12.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.944+0000 7fcafffff700 1 --2- 172.21.15.8:0/4048022780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb000f99e0 0x7fcb000f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.944+0000 7fcafffff700 1 --2- 172.21.15.8:0/4048022780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb000f8740 0x7fcb000f8b60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.944+0000 7fcafffff700 1 -- 172.21.15.8:0/4048022780 >> 172.21.15.8:0/4048022780 conn(0x7fcb000f40e0 msgr2=0x7fcb000f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.944+0000 7fcafffff700 1 -- 172.21.15.8:0/4048022780 shutdown_connections 2023-10-18T21:20:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.944+0000 7fcafffff700 1 -- 172.21.15.8:0/4048022780 wait complete. 2023-10-18T21:20:12.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.945+0000 7fcafffff700 1 Processor -- start 2023-10-18T21:20:12.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.945+0000 7fcafffff700 1 -- start start 2023-10-18T21:20:12.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.945+0000 7fcafffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb000f8740 0x7fcb00108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:12.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.945+0000 7fcafffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb000f99e0 0x7fcb00109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:12.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.945+0000 7fcafffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb001099f0 con 0x7fcb000f8740 2023-10-18T21:20:12.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.945+0000 7fcafffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00109b30 con 0x7fcb000f99e0 2023-10-18T21:20:12.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.945+0000 7fcafeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb000f8740 0x7fcb00108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:12.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.945+0000 7fcafeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb000f8740 0x7fcb00108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49898/0 (socket says 172.21.15.8:49898) 2023-10-18T21:20:12.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.945+0000 7fcafeffd700 1 -- 172.21.15.8:0/2056974633 learned_addr learned my addr 172.21.15.8:0/2056974633 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:12.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.946+0000 7fcafe7fc700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb000f99e0 0x7fcb00109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:12.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.946+0000 7fcafeffd700 1 -- 172.21.15.8:0/2056974633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb000f99e0 msgr2=0x7fcb00109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:12.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.946+0000 7fcafeffd700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb000f99e0 0x7fcb00109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:12.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.946+0000 7fcafeffd700 1 -- 172.21.15.8:0/2056974633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf0005040 con 0x7fcb000f8740 2023-10-18T21:20:12.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.946+0000 7fcafe7fc700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb000f99e0 0x7fcb00109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:20:12.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.946+0000 7fcafeffd700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb000f8740 0x7fcb00108f50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fcaf0009870 tx=0x7fcaf000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:12.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.946+0000 7fcae77fe700 1 -- 172.21.15.8:0/2056974633 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf0019070 con 0x7fcb000f8740 2023-10-18T21:20:12.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.946+0000 7fcae77fe700 1 -- 172.21.15.8:0/2056974633 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcaf001e420 con 0x7fcb000f8740 2023-10-18T21:20:12.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.946+0000 7fcafffff700 1 -- 172.21.15.8:0/2056974633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0010a470 con 0x7fcb000f8740 2023-10-18T21:20:12.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.946+0000 7fcae77fe700 1 -- 172.21.15.8:0/2056974633 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf0014660 con 0x7fcb000f8740 2023-10-18T21:20:12.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.947+0000 7fcafffff700 1 -- 172.21.15.8:0/2056974633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0010a950 con 0x7fcb000f8740 2023-10-18T21:20:12.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.948+0000 7fcafffff700 1 -- 172.21.15.8:0/2056974633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb00045ad0 con 0x7fcb000f8740 2023-10-18T21:20:12.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.948+0000 7fcae77fe700 1 -- 172.21.15.8:0/2056974633 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcaf001e9c0 con 0x7fcb000f8740 2023-10-18T21:20:12.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.949+0000 7fcae77fe700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcae8060f70 0x7fcae8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:12.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.949+0000 7fcae77fe700 1 -- 172.21.15.8:0/2056974633 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcaf007dcc0 con 0x7fcb000f8740 2023-10-18T21:20:12.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.949+0000 7fcafe7fc700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcae8060f70 0x7fcae8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:12.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.950+0000 7fcafe7fc700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcae8060f70 0x7fcae8063430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fcaf4007fc0 tx=0x7fcaf400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:12.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:12.953+0000 7fcae77fe700 1 -- 172.21.15.8:0/2056974633 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcaf00513e0 con 0x7fcb000f8740 2023-10-18T21:20:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.179+0000 7fcafffff700 1 -- 172.21.15.8:0/2056974633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcb00100fe0 con 0x7fcb000f8740 2023-10-18T21:20:13.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.180+0000 7fcae77fe700 1 -- 172.21.15.8:0/2056974633 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fcaf0050fd0 con 0x7fcb000f8740 2023-10-18T21:20:13.182 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:20:13.183 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:20:13.183 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:20:13.183 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:20:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:20:13.183 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:20:13.184 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:20:13.184 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:20:13.184 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:20:13.184 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:20:13.184 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:20:13.185 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:20:13.185 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:20:13.185 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:20:13.185 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:20:13.185 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:20:13.186 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:20:13.186 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:20:13.186 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:20:13.186 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:20:13.186 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:20:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:20:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:20:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:20:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:20:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:20:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:20:13.188 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:20:13.188 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:20:13.188 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:20:13.188 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:20:13.188 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:20:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:20:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:20:13.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.182+0000 7fcafffff700 1 -- 172.21.15.8:0/2056974633 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcae8060f70 msgr2=0x7fcae8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:13.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.182+0000 7fcafffff700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcae8060f70 0x7fcae8063430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fcaf4007fc0 tx=0x7fcaf400b040).stop 2023-10-18T21:20:13.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.182+0000 7fcafffff700 1 -- 172.21.15.8:0/2056974633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb000f8740 msgr2=0x7fcb00108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:13.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.182+0000 7fcafffff700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb000f8740 0x7fcb00108f50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fcaf0009870 tx=0x7fcaf000b040).stop 2023-10-18T21:20:13.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.182+0000 7fcafffff700 1 -- 172.21.15.8:0/2056974633 shutdown_connections 2023-10-18T21:20:13.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.182+0000 7fcafffff700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcae8060f70 0x7fcae8063430 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:13.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.182+0000 7fcafffff700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb000f8740 0x7fcb00108f50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:13.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.182+0000 7fcafffff700 1 --2- 172.21.15.8:0/2056974633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb000f99e0 0x7fcb00109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:13.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.182+0000 7fcafffff700 1 -- 172.21.15.8:0/2056974633 >> 172.21.15.8:0/2056974633 conn(0x7fcb000f40e0 msgr2=0x7fcb000fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:13.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.182+0000 7fcafffff700 1 -- 172.21.15.8:0/2056974633 shutdown_connections 2023-10-18T21:20:13.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.183+0000 7fcafffff700 1 -- 172.21.15.8:0/2056974633 wait complete. 2023-10-18T21:20:13.195 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:20:13.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.320+0000 7f33aca2b700 1 -- 172.21.15.8:0/1658646879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a80f6530 msgr2=0x7f33a80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:13.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.320+0000 7f33aca2b700 1 --2- 172.21.15.8:0/1658646879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a80f6530 0x7f33a80f6950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f3398004660 tx=0x7f3398009b30).stop 2023-10-18T21:20:13.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.321+0000 7f33aca2b700 1 -- 172.21.15.8:0/1658646879 shutdown_connections 2023-10-18T21:20:13.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.321+0000 7f33aca2b700 1 --2- 172.21.15.8:0/1658646879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a80f77d0 0x7f33a80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:13.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.321+0000 7f33aca2b700 1 --2- 172.21.15.8:0/1658646879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a80f6530 0x7f33a80f6950 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:13.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.321+0000 7f33aca2b700 1 -- 172.21.15.8:0/1658646879 >> 172.21.15.8:0/1658646879 conn(0x7f33a80f1c90 msgr2=0x7f33a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:13.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.321+0000 7f33aca2b700 1 -- 172.21.15.8:0/1658646879 shutdown_connections 2023-10-18T21:20:13.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.321+0000 7f33aca2b700 1 -- 172.21.15.8:0/1658646879 wait complete. 2023-10-18T21:20:13.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.322+0000 7f33aca2b700 1 Processor -- start 2023-10-18T21:20:13.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.322+0000 7f33aca2b700 1 -- start start 2023-10-18T21:20:13.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.322+0000 7f33aca2b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a80f6530 0x7f33a8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:13.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.322+0000 7f33aca2b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a80f77d0 0x7f33a81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:13.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.322+0000 7f33aca2b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8109a70 con 0x7f33a80f6530 2023-10-18T21:20:13.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.322+0000 7f33aca2b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8109bb0 con 0x7f33a80f77d0 2023-10-18T21:20:13.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.322+0000 7f33a77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a80f6530 0x7f33a8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:13.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.322+0000 7f33a77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a80f6530 0x7f33a8108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49916/0 (socket says 172.21.15.8:49916) 2023-10-18T21:20:13.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.322+0000 7f33a77fe700 1 -- 172.21.15.8:0/221024926 learned_addr learned my addr 172.21.15.8:0/221024926 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:13.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.323+0000 7f33a6ffd700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a80f77d0 0x7f33a81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:13.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.323+0000 7f33a77fe700 1 -- 172.21.15.8:0/221024926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a80f77d0 msgr2=0x7f33a81094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:13.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.323+0000 7f33a77fe700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a80f77d0 0x7f33a81094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:13.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.323+0000 7f33a77fe700 1 -- 172.21.15.8:0/221024926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398005040 con 0x7f33a80f6530 2023-10-18T21:20:13.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.323+0000 7f33a77fe700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a80f6530 0x7f33a8108fd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f3398007a60 tx=0x7f3398009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:13.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.323+0000 7f338ffff700 1 -- 172.21.15.8:0/221024926 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3398018070 con 0x7f33a80f6530 2023-10-18T21:20:13.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.323+0000 7f338ffff700 1 -- 172.21.15.8:0/221024926 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3398009630 con 0x7f33a80f6530 2023-10-18T21:20:13.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.323+0000 7f33aca2b700 1 -- 172.21.15.8:0/221024926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a810a4f0 con 0x7f33a80f6530 2023-10-18T21:20:13.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.323+0000 7f338ffff700 1 -- 172.21.15.8:0/221024926 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f339801c4d0 con 0x7f33a80f6530 2023-10-18T21:20:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.323+0000 7f33aca2b700 1 -- 172.21.15.8:0/221024926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a810aa50 con 0x7f33a80f6530 2023-10-18T21:20:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.324+0000 7f33aca2b700 1 -- 172.21.15.8:0/221024926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a8045ad0 con 0x7f33a80f6530 2023-10-18T21:20:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.325+0000 7f338ffff700 1 -- 172.21.15.8:0/221024926 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f339801d420 con 0x7f33a80f6530 2023-10-18T21:20:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.326+0000 7f338ffff700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3390060f70 0x7f3390063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.326+0000 7f338ffff700 1 -- 172.21.15.8:0/221024926 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f339807e650 con 0x7f33a80f6530 2023-10-18T21:20:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.326+0000 7f33a6ffd700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3390060f70 0x7f3390063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.327+0000 7f33a6ffd700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3390060f70 0x7f3390063430 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f339c004c40 tx=0x7f339c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.330+0000 7f338ffff700 1 -- 172.21.15.8:0/221024926 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3398051ca0 con 0x7f33a80f6530 2023-10-18T21:20:13.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:12.053655+0000 mgr.smithi008.flmjzp (mgr.14640) 1286 : audit [DBG] from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:12.233067+0000 mgr.smithi008.flmjzp (mgr.14640) 1287 : cluster [DBG] pgmap v897: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:12.397957+0000 mgr.smithi008.flmjzp (mgr.14640) 1288 : audit [DBG] from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:12.805793+0000 mon.smithi008 (mon.0) 1774 : audit [DBG] from='client.? 172.21.15.8:0/668004191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:13.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.529+0000 7f33aca2b700 1 -- 172.21.15.8:0/221024926 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33a80fee00 con 0x7f3390060f70 2023-10-18T21:20:13.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.530+0000 7f338ffff700 1 -- 172.21.15.8:0/221024926 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f33a80fee00 con 0x7f3390060f70 2023-10-18T21:20:13.532 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:20:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:20:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:20:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:20:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:20:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:20:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:20:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:20:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:20:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:20:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:20:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:20:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:20:13.535 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:20:13.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.532+0000 7f33aca2b700 1 -- 172.21.15.8:0/221024926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3390060f70 msgr2=0x7f3390063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:13.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.532+0000 7f33aca2b700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3390060f70 0x7f3390063430 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f339c004c40 tx=0x7f339c00b040).stop 2023-10-18T21:20:13.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.532+0000 7f33aca2b700 1 -- 172.21.15.8:0/221024926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a80f6530 msgr2=0x7f33a8108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:13.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.532+0000 7f33aca2b700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a80f6530 0x7f33a8108fd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f3398007a60 tx=0x7f3398009b30).stop 2023-10-18T21:20:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.532+0000 7f33aca2b700 1 -- 172.21.15.8:0/221024926 shutdown_connections 2023-10-18T21:20:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.532+0000 7f33aca2b700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3390060f70 0x7f3390063430 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.532+0000 7f33aca2b700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a80f6530 0x7f33a8108fd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.532+0000 7f33aca2b700 1 --2- 172.21.15.8:0/221024926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a80f77d0 0x7f33a81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.532+0000 7f33aca2b700 1 -- 172.21.15.8:0/221024926 >> 172.21.15.8:0/221024926 conn(0x7f33a80f1c90 msgr2=0x7f33a806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.533+0000 7f33aca2b700 1 -- 172.21.15.8:0/221024926 shutdown_connections 2023-10-18T21:20:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:13.533+0000 7f33aca2b700 1 -- 172.21.15.8:0/221024926 wait complete. 2023-10-18T21:20:13.552 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:12.053655+0000 mgr.smithi008.flmjzp (mgr.14640) 1286 : audit [DBG] from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:13.552 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:12.233067+0000 mgr.smithi008.flmjzp (mgr.14640) 1287 : cluster [DBG] pgmap v897: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:13.552 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:12.397957+0000 mgr.smithi008.flmjzp (mgr.14640) 1288 : audit [DBG] from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:13.553 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:12.805793+0000 mon.smithi008 (mon.0) 1774 : audit [DBG] from='client.? 172.21.15.8:0/668004191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:14.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:13.181608+0000 mon.smithi008 (mon.0) 1775 : audit [DBG] from='client.? 172.21.15.8:0/2056974633' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:20:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:13.531774+0000 mgr.smithi008.flmjzp (mgr.14640) 1289 : audit [DBG] from='client.35244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:13.181608+0000 mon.smithi008 (mon.0) 1775 : audit [DBG] from='client.? 172.21.15.8:0/2056974633' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:20:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:13.531774+0000 mgr.smithi008.flmjzp (mgr.14640) 1289 : audit [DBG] from='client.35244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:14.233518+0000 mgr.smithi008.flmjzp (mgr.14640) 1290 : cluster [DBG] pgmap v898: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:15.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:14.233518+0000 mgr.smithi008.flmjzp (mgr.14640) 1290 : cluster [DBG] pgmap v898: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:16.234043+0000 mgr.smithi008.flmjzp (mgr.14640) 1291 : cluster [DBG] pgmap v899: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:17.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:16.234043+0000 mgr.smithi008.flmjzp (mgr.14640) 1291 : cluster [DBG] pgmap v899: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:18.234631+0000 mgr.smithi008.flmjzp (mgr.14640) 1292 : cluster [DBG] pgmap v900: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:19.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:18.234631+0000 mgr.smithi008.flmjzp (mgr.14640) 1292 : cluster [DBG] pgmap v900: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:21.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:20.235224+0000 mgr.smithi008.flmjzp (mgr.14640) 1293 : cluster [DBG] pgmap v901: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:20.266021+0000 mon.smithi008 (mon.0) 1776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:20.825896+0000 mon.smithi008 (mon.0) 1777 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:20.827007+0000 mon.smithi008 (mon.0) 1778 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:20.834187+0000 mon.smithi008 (mon.0) 1779 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:20.840727+0000 mon.smithi008 (mon.0) 1780 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:20.843924+0000 mon.smithi008 (mon.0) 1781 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:20.845629+0000 mon.smithi008 (mon.0) 1782 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:20.847390+0000 mon.smithi008 (mon.0) 1783 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:20.849585+0000 mon.smithi008 (mon.0) 1784 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:20.235224+0000 mgr.smithi008.flmjzp (mgr.14640) 1293 : cluster [DBG] pgmap v901: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:20.266021+0000 mon.smithi008 (mon.0) 1776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:20.825896+0000 mon.smithi008 (mon.0) 1777 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:20.827007+0000 mon.smithi008 (mon.0) 1778 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:20.834187+0000 mon.smithi008 (mon.0) 1779 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:20.840727+0000 mon.smithi008 (mon.0) 1780 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:20.843924+0000 mon.smithi008 (mon.0) 1781 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:20.845629+0000 mon.smithi008 (mon.0) 1782 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:20.847390+0000 mon.smithi008 (mon.0) 1783 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:20.849585+0000 mon.smithi008 (mon.0) 1784 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:22.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:20.827920+0000 mgr.smithi008.flmjzp (mgr.14640) 1294 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:22.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:20.828632+0000 mgr.smithi008.flmjzp (mgr.14640) 1295 : cluster [DBG] pgmap v902: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:20.828941+0000 mgr.smithi008.flmjzp (mgr.14640) 1296 : cluster [DBG] pgmap v903: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:20.851584+0000 mgr.smithi008.flmjzp (mgr.14640) 1297 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:20.827920+0000 mgr.smithi008.flmjzp (mgr.14640) 1294 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:20.828632+0000 mgr.smithi008.flmjzp (mgr.14640) 1295 : cluster [DBG] pgmap v902: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:20.828941+0000 mgr.smithi008.flmjzp (mgr.14640) 1296 : cluster [DBG] pgmap v903: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:20.851584+0000 mgr.smithi008.flmjzp (mgr.14640) 1297 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:24.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:22.829603+0000 mgr.smithi008.flmjzp (mgr.14640) 1298 : cluster [DBG] pgmap v904: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:22.829603+0000 mgr.smithi008.flmjzp (mgr.14640) 1298 : cluster [DBG] pgmap v904: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:26.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:24.830202+0000 mgr.smithi008.flmjzp (mgr.14640) 1299 : cluster [DBG] pgmap v905: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:24.830202+0000 mgr.smithi008.flmjzp (mgr.14640) 1299 : cluster [DBG] pgmap v905: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:28.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:26.830907+0000 mgr.smithi008.flmjzp (mgr.14640) 1300 : cluster [DBG] pgmap v906: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:26.830907+0000 mgr.smithi008.flmjzp (mgr.14640) 1300 : cluster [DBG] pgmap v906: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:28.831476+0000 mgr.smithi008.flmjzp (mgr.14640) 1301 : cluster [DBG] pgmap v907: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:30.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:28.831476+0000 mgr.smithi008.flmjzp (mgr.14640) 1301 : cluster [DBG] pgmap v907: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:31.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:30.861533+0000 mon.smithi008 (mon.0) 1785 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:30.863640+0000 mon.smithi008 (mon.0) 1786 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:30.864653+0000 mon.smithi008 (mon.0) 1787 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:30.871830+0000 mon.smithi008 (mon.0) 1788 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:30.879726+0000 mon.smithi008 (mon.0) 1789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:30.883319+0000 mon.smithi008 (mon.0) 1790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:30.885338+0000 mon.smithi008 (mon.0) 1791 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:30.887217+0000 mon.smithi008 (mon.0) 1792 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:30.889793+0000 mon.smithi008 (mon.0) 1793 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:30.861533+0000 mon.smithi008 (mon.0) 1785 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:30.863640+0000 mon.smithi008 (mon.0) 1786 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:30.864653+0000 mon.smithi008 (mon.0) 1787 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:30.871830+0000 mon.smithi008 (mon.0) 1788 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:30.879726+0000 mon.smithi008 (mon.0) 1789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:30.883319+0000 mon.smithi008 (mon.0) 1790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:30.885338+0000 mon.smithi008 (mon.0) 1791 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:30.887217+0000 mon.smithi008 (mon.0) 1792 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:31.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:30.889793+0000 mon.smithi008 (mon.0) 1793 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:32.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:30.831954+0000 mgr.smithi008.flmjzp (mgr.14640) 1302 : cluster [DBG] pgmap v908: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:30.865516+0000 mgr.smithi008.flmjzp (mgr.14640) 1303 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:30.866048+0000 mgr.smithi008.flmjzp (mgr.14640) 1304 : cluster [DBG] pgmap v909: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:30.866289+0000 mgr.smithi008.flmjzp (mgr.14640) 1305 : cluster [DBG] pgmap v910: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:30.891768+0000 mgr.smithi008.flmjzp (mgr.14640) 1306 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:30.831954+0000 mgr.smithi008.flmjzp (mgr.14640) 1302 : cluster [DBG] pgmap v908: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:30.865516+0000 mgr.smithi008.flmjzp (mgr.14640) 1303 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:30.866048+0000 mgr.smithi008.flmjzp (mgr.14640) 1304 : cluster [DBG] pgmap v909: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:30.866289+0000 mgr.smithi008.flmjzp (mgr.14640) 1305 : cluster [DBG] pgmap v910: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:30.891768+0000 mgr.smithi008.flmjzp (mgr.14640) 1306 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:34.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:32.866854+0000 mgr.smithi008.flmjzp (mgr.14640) 1307 : cluster [DBG] pgmap v911: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:32.866854+0000 mgr.smithi008.flmjzp (mgr.14640) 1307 : cluster [DBG] pgmap v911: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:36.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:34.867425+0000 mgr.smithi008.flmjzp (mgr.14640) 1308 : cluster [DBG] pgmap v912: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:34.867425+0000 mgr.smithi008.flmjzp (mgr.14640) 1308 : cluster [DBG] pgmap v912: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:38.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:36.867969+0000 mgr.smithi008.flmjzp (mgr.14640) 1309 : cluster [DBG] pgmap v913: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:36.867969+0000 mgr.smithi008.flmjzp (mgr.14640) 1309 : cluster [DBG] pgmap v913: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:38.868769+0000 mgr.smithi008.flmjzp (mgr.14640) 1310 : cluster [DBG] pgmap v914: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:40.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:38.868769+0000 mgr.smithi008.flmjzp (mgr.14640) 1310 : cluster [DBG] pgmap v914: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:40.899732+0000 mon.smithi008 (mon.0) 1794 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:40.901812+0000 mon.smithi008 (mon.0) 1795 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:40.902829+0000 mon.smithi008 (mon.0) 1796 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:40.909833+0000 mon.smithi008 (mon.0) 1797 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:40.916857+0000 mon.smithi008 (mon.0) 1798 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:40.919938+0000 mon.smithi008 (mon.0) 1799 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:40.921564+0000 mon.smithi008 (mon.0) 1800 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:40.923152+0000 mon.smithi008 (mon.0) 1801 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:40.925190+0000 mon.smithi008 (mon.0) 1802 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:40.899732+0000 mon.smithi008 (mon.0) 1794 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:40.901812+0000 mon.smithi008 (mon.0) 1795 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:40.902829+0000 mon.smithi008 (mon.0) 1796 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:40.909833+0000 mon.smithi008 (mon.0) 1797 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:40.916857+0000 mon.smithi008 (mon.0) 1798 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:40.919938+0000 mon.smithi008 (mon.0) 1799 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:40.921564+0000 mon.smithi008 (mon.0) 1800 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:40.923152+0000 mon.smithi008 (mon.0) 1801 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:40.925190+0000 mon.smithi008 (mon.0) 1802 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:42.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:40.869358+0000 mgr.smithi008.flmjzp (mgr.14640) 1311 : cluster [DBG] pgmap v915: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:42.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:40.903764+0000 mgr.smithi008.flmjzp (mgr.14640) 1312 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:40.904361+0000 mgr.smithi008.flmjzp (mgr.14640) 1313 : cluster [DBG] pgmap v916: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:40.904612+0000 mgr.smithi008.flmjzp (mgr.14640) 1314 : cluster [DBG] pgmap v917: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:40.927120+0000 mgr.smithi008.flmjzp (mgr.14640) 1315 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:40.869358+0000 mgr.smithi008.flmjzp (mgr.14640) 1311 : cluster [DBG] pgmap v915: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:40.903764+0000 mgr.smithi008.flmjzp (mgr.14640) 1312 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:40.904361+0000 mgr.smithi008.flmjzp (mgr.14640) 1313 : cluster [DBG] pgmap v916: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:40.904612+0000 mgr.smithi008.flmjzp (mgr.14640) 1314 : cluster [DBG] pgmap v917: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:40.927120+0000 mgr.smithi008.flmjzp (mgr.14640) 1315 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:43.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.686+0000 7f7315755700 1 -- 172.21.15.8:0/515052667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73100f7980 msgr2=0x7f73100f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:43.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.686+0000 7f7315755700 1 --2- 172.21.15.8:0/515052667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73100f7980 0x7f73100f7de0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f7304004660 tx=0x7f7304009b30).stop 2023-10-18T21:20:43.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.686+0000 7f7315755700 1 -- 172.21.15.8:0/515052667 shutdown_connections 2023-10-18T21:20:43.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.686+0000 7f7315755700 1 --2- 172.21.15.8:0/515052667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73100f7980 0x7f73100f7de0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:43.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.686+0000 7f7315755700 1 --2- 172.21.15.8:0/515052667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73100f66e0 0x7f73100f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.686+0000 7f7315755700 1 -- 172.21.15.8:0/515052667 >> 172.21.15.8:0/515052667 conn(0x7f73100f1e40 msgr2=0x7f73100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.686+0000 7f7315755700 1 -- 172.21.15.8:0/515052667 shutdown_connections 2023-10-18T21:20:43.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.686+0000 7f7315755700 1 -- 172.21.15.8:0/515052667 wait complete. 2023-10-18T21:20:43.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.687+0000 7f7315755700 1 Processor -- start 2023-10-18T21:20:43.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.687+0000 7f7315755700 1 -- start start 2023-10-18T21:20:43.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.687+0000 7f7315755700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73100f66e0 0x7f731006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:43.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.687+0000 7f7315755700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73100f7980 0x7f7310069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:43.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.687+0000 7f7315755700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731006a380 con 0x7f73100f66e0 2023-10-18T21:20:43.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.687+0000 7f7315755700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731006a4c0 con 0x7f73100f7980 2023-10-18T21:20:43.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.687+0000 7f730effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73100f66e0 0x7f731006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:43.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.688+0000 7f730effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73100f66e0 0x7f731006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43496/0 (socket says 172.21.15.8:43496) 2023-10-18T21:20:43.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.688+0000 7f730effd700 1 -- 172.21.15.8:0/2118691692 learned_addr learned my addr 172.21.15.8:0/2118691692 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:43.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.688+0000 7f730e7fc700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73100f7980 0x7f7310069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:43.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.688+0000 7f730effd700 1 -- 172.21.15.8:0/2118691692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73100f7980 msgr2=0x7f7310069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:43.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.688+0000 7f730effd700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73100f7980 0x7f7310069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:43.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.688+0000 7f730effd700 1 -- 172.21.15.8:0/2118691692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304005040 con 0x7f73100f66e0 2023-10-18T21:20:43.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.688+0000 7f730effd700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73100f66e0 0x7f731006b9a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f730000c790 tx=0x7f7300007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:43.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.688+0000 7f72f77fe700 1 -- 172.21.15.8:0/2118691692 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730000e680 con 0x7f73100f66e0 2023-10-18T21:20:43.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.689+0000 7f72f77fe700 1 -- 172.21.15.8:0/2118691692 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f730000eca0 con 0x7f73100f66e0 2023-10-18T21:20:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.689+0000 7f7315755700 1 -- 172.21.15.8:0/2118691692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731006a7a0 con 0x7f73100f66e0 2023-10-18T21:20:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.689+0000 7f72f77fe700 1 -- 172.21.15.8:0/2118691692 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7300012d80 con 0x7f73100f66e0 2023-10-18T21:20:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.689+0000 7f7315755700 1 -- 172.21.15.8:0/2118691692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731010efb0 con 0x7f73100f66e0 2023-10-18T21:20:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.690+0000 7f7315755700 1 -- 172.21.15.8:0/2118691692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7310045ad0 con 0x7f73100f66e0 2023-10-18T21:20:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.691+0000 7f72f77fe700 1 -- 172.21.15.8:0/2118691692 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7300010070 con 0x7f73100f66e0 2023-10-18T21:20:43.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.692+0000 7f72f77fe700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f72f8060f20 0x7f72f80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:43.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.692+0000 7f72f77fe700 1 -- 172.21.15.8:0/2118691692 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f730007ca70 con 0x7f73100f66e0 2023-10-18T21:20:43.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.692+0000 7f730e7fc700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f72f8060f20 0x7f72f80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:43.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.692+0000 7f730e7fc700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f72f8060f20 0x7f72f80633e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f7304004e30 tx=0x7f7304009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:43.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.696+0000 7f72f77fe700 1 -- 172.21.15.8:0/2118691692 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f730004c5c0 con 0x7f73100f66e0 2023-10-18T21:20:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.898+0000 7f7315755700 1 -- 172.21.15.8:0/2118691692 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f73100fefb0 con 0x7f72f8060f20 2023-10-18T21:20:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.899+0000 7f72f77fe700 1 -- 172.21.15.8:0/2118691692 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f73100fefb0 con 0x7f72f8060f20 2023-10-18T21:20:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.901+0000 7f7315755700 1 -- 172.21.15.8:0/2118691692 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f72f8060f20 msgr2=0x7f72f80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.901+0000 7f7315755700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f72f8060f20 0x7f72f80633e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f7304004e30 tx=0x7f7304009b30).stop 2023-10-18T21:20:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.901+0000 7f7315755700 1 -- 172.21.15.8:0/2118691692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73100f66e0 msgr2=0x7f731006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.901+0000 7f7315755700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73100f66e0 0x7f731006b9a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f730000c790 tx=0x7f7300007d90).stop 2023-10-18T21:20:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.901+0000 7f7315755700 1 -- 172.21.15.8:0/2118691692 shutdown_connections 2023-10-18T21:20:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.901+0000 7f7315755700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f72f8060f20 0x7f72f80633e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.901+0000 7f7315755700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73100f66e0 0x7f731006b9a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.901+0000 7f7315755700 1 --2- 172.21.15.8:0/2118691692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73100f7980 0x7f7310069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.901+0000 7f7315755700 1 -- 172.21.15.8:0/2118691692 >> 172.21.15.8:0/2118691692 conn(0x7f73100f1e40 msgr2=0x7f73100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.901+0000 7f7315755700 1 -- 172.21.15.8:0/2118691692 shutdown_connections 2023-10-18T21:20:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:43.902+0000 7f7315755700 1 -- 172.21.15.8:0/2118691692 wait complete. 2023-10-18T21:20:43.918 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:20:44.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.040+0000 7ff4eb59e700 1 -- 172.21.15.8:0/3626400253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4ec0f77d0 msgr2=0x7ff4ec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:44.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.040+0000 7ff4eb59e700 1 --2- 172.21.15.8:0/3626400253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4ec0f77d0 0x7ff4ec0f7c30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff4e00045a0 tx=0x7ff4e0009b30).stop 2023-10-18T21:20:44.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.040+0000 7ff4eb59e700 1 -- 172.21.15.8:0/3626400253 shutdown_connections 2023-10-18T21:20:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.040+0000 7ff4eb59e700 1 --2- 172.21.15.8:0/3626400253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4ec0f77d0 0x7ff4ec0f7c30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.040+0000 7ff4eb59e700 1 --2- 172.21.15.8:0/3626400253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4ec0f6530 0x7ff4ec0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.040+0000 7ff4eb59e700 1 -- 172.21.15.8:0/3626400253 >> 172.21.15.8:0/3626400253 conn(0x7ff4ec0f1c90 msgr2=0x7ff4ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.040+0000 7ff4eb59e700 1 -- 172.21.15.8:0/3626400253 shutdown_connections 2023-10-18T21:20:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.040+0000 7ff4eb59e700 1 -- 172.21.15.8:0/3626400253 wait complete. 2023-10-18T21:20:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.041+0000 7ff4eb59e700 1 Processor -- start 2023-10-18T21:20:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.041+0000 7ff4eb59e700 1 -- start start 2023-10-18T21:20:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.041+0000 7ff4eb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4ec0f6530 0x7ff4ec108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.041+0000 7ff4eb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4ec0f77d0 0x7ff4ec109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.041+0000 7ff4eb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1099d0 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.041+0000 7ff4eb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec109b10 con 0x7ff4ec0f6530 2023-10-18T21:20:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.042+0000 7ff4e9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4ec0f77d0 0x7ff4ec109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.042+0000 7ff4e9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4ec0f77d0 0x7ff4ec109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43522/0 (socket says 172.21.15.8:43522) 2023-10-18T21:20:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.042+0000 7ff4e9d9b700 1 -- 172.21.15.8:0/664429390 learned_addr learned my addr 172.21.15.8:0/664429390 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.042+0000 7ff4ea59c700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4ec0f6530 0x7ff4ec108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.042+0000 7ff4e9d9b700 1 -- 172.21.15.8:0/664429390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4ec0f6530 msgr2=0x7ff4ec108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.042+0000 7ff4e9d9b700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4ec0f6530 0x7ff4ec108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.042+0000 7ff4e9d9b700 1 -- 172.21.15.8:0/664429390 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc005040 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.042+0000 7ff4e9d9b700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4ec0f77d0 0x7ff4ec109420 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7ff4e0009720 tx=0x7ff4e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.043+0000 7ff4daffd700 1 -- 172.21.15.8:0/664429390 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e000e070 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.043+0000 7ff4daffd700 1 -- 172.21.15.8:0/664429390 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff4e0007e80 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.043+0000 7ff4eb59e700 1 -- 172.21.15.8:0/664429390 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e0005040 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.043+0000 7ff4daffd700 1 -- 172.21.15.8:0/664429390 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e0019070 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.043+0000 7ff4eb59e700 1 -- 172.21.15.8:0/664429390 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec10a7a0 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.044+0000 7ff4eb59e700 1 -- 172.21.15.8:0/664429390 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec059100 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.045+0000 7ff4daffd700 1 -- 172.21.15.8:0/664429390 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff4e0025070 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.046+0000 7ff4daffd700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 0x7ff4d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:44.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.046+0000 7ff4daffd700 1 -- 172.21.15.8:0/664429390 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff4e007d6d0 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.046+0000 7ff4ea59c700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 0x7ff4d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:44.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.046+0000 7ff4ea59c700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 0x7ff4d4063430 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff4dc009fd0 tx=0x7ff4dc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:44.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.050+0000 7ff4daffd700 1 -- 172.21.15.8:0/664429390 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff4e0050cb0 con 0x7ff4ec0f77d0 2023-10-18T21:20:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.251+0000 7ff4eb59e700 1 -- 172.21.15.8:0/664429390 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4ec0fc100 con 0x7ff4d4060f70 2023-10-18T21:20:44.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.252+0000 7ff4daffd700 1 -- 172.21.15.8:0/664429390 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff4ec0fc100 con 0x7ff4d4060f70 2023-10-18T21:20:44.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.254+0000 7ff4eb59e700 1 -- 172.21.15.8:0/664429390 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 msgr2=0x7ff4d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:44.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.254+0000 7ff4eb59e700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 0x7ff4d4063430 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff4dc009fd0 tx=0x7ff4dc00b040).stop 2023-10-18T21:20:44.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.254+0000 7ff4eb59e700 1 -- 172.21.15.8:0/664429390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4ec0f77d0 msgr2=0x7ff4ec109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:44.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.254+0000 7ff4eb59e700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4ec0f77d0 0x7ff4ec109420 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7ff4e0009720 tx=0x7ff4e000b040).stop 2023-10-18T21:20:44.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.254+0000 7ff4eb59e700 1 -- 172.21.15.8:0/664429390 shutdown_connections 2023-10-18T21:20:44.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.254+0000 7ff4eb59e700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 0x7ff4d4063430 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.254+0000 7ff4eb59e700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4ec0f6530 0x7ff4ec108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.254+0000 7ff4eb59e700 1 --2- 172.21.15.8:0/664429390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4ec0f77d0 0x7ff4ec109420 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.254+0000 7ff4eb59e700 1 -- 172.21.15.8:0/664429390 >> 172.21.15.8:0/664429390 conn(0x7ff4ec0f1c90 msgr2=0x7ff4ec06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.255+0000 7ff4eb59e700 1 -- 172.21.15.8:0/664429390 shutdown_connections 2023-10-18T21:20:44.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.255+0000 7ff4eb59e700 1 -- 172.21.15.8:0/664429390 wait complete. 2023-10-18T21:20:44.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.391+0000 7fc0cf59e700 1 -- 172.21.15.8:0/840463672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0d00f77d0 msgr2=0x7fc0d00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:44.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.391+0000 7fc0cf59e700 1 --2- 172.21.15.8:0/840463672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0d00f77d0 0x7fc0d00f7c30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fc0c4004660 tx=0x7fc0c4009b30).stop 2023-10-18T21:20:44.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.391+0000 7fc0cf59e700 1 -- 172.21.15.8:0/840463672 shutdown_connections 2023-10-18T21:20:44.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.391+0000 7fc0cf59e700 1 --2- 172.21.15.8:0/840463672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0d00f77d0 0x7fc0d00f7c30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.391+0000 7fc0cf59e700 1 --2- 172.21.15.8:0/840463672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d00f6530 0x7fc0d00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.391+0000 7fc0cf59e700 1 -- 172.21.15.8:0/840463672 >> 172.21.15.8:0/840463672 conn(0x7fc0d00f1c90 msgr2=0x7fc0d00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:44.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.391+0000 7fc0cf59e700 1 -- 172.21.15.8:0/840463672 shutdown_connections 2023-10-18T21:20:44.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.391+0000 7fc0cf59e700 1 -- 172.21.15.8:0/840463672 wait complete. 2023-10-18T21:20:44.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.392+0000 7fc0cf59e700 1 Processor -- start 2023-10-18T21:20:44.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.393+0000 7fc0cf59e700 1 -- start start 2023-10-18T21:20:44.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.393+0000 7fc0cf59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0d00f6530 0x7fc0d0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:44.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.393+0000 7fc0cf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d00f77d0 0x7fc0d0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:44.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.393+0000 7fc0cf59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d0107880 con 0x7fc0d00f6530 2023-10-18T21:20:44.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.393+0000 7fc0cf59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d01080c0 con 0x7fc0d00f77d0 2023-10-18T21:20:44.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.393+0000 7fc0ce59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0d00f6530 0x7fc0d0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:44.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.393+0000 7fc0ce59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0d00f6530 0x7fc0d0106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43548/0 (socket says 172.21.15.8:43548) 2023-10-18T21:20:44.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.393+0000 7fc0ce59c700 1 -- 172.21.15.8:0/2402449028 learned_addr learned my addr 172.21.15.8:0/2402449028 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:44.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0cdd9b700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d00f77d0 0x7fc0d0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:44.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0ce59c700 1 -- 172.21.15.8:0/2402449028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d00f77d0 msgr2=0x7fc0d0107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:44.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0ce59c700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d00f77d0 0x7fc0d0107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0ce59c700 1 -- 172.21.15.8:0/2402449028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c4005040 con 0x7fc0d00f6530 2023-10-18T21:20:44.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0cdd9b700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d00f77d0 0x7fc0d0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:20:44.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0ce59c700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0d00f6530 0x7fc0d0106d90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fc0c0002700 tx=0x7fc0c0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:44.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0beffd700 1 -- 172.21.15.8:0/2402449028 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0c0009320 con 0x7fc0d00f6530 2023-10-18T21:20:44.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0beffd700 1 -- 172.21.15.8:0/2402449028 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc0c000f040 con 0x7fc0d00f6530 2023-10-18T21:20:44.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0beffd700 1 -- 172.21.15.8:0/2402449028 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0c0014970 con 0x7fc0d00f6530 2023-10-18T21:20:44.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0cf59e700 1 -- 172.21.15.8:0/2402449028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d01083a0 con 0x7fc0d00f6530 2023-10-18T21:20:44.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.394+0000 7fc0cf59e700 1 -- 172.21.15.8:0/2402449028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d01088e0 con 0x7fc0d00f6530 2023-10-18T21:20:44.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.395+0000 7fc0cf59e700 1 -- 172.21.15.8:0/2402449028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d0059100 con 0x7fc0d00f6530 2023-10-18T21:20:44.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.396+0000 7fc0beffd700 1 -- 172.21.15.8:0/2402449028 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc0c0009480 con 0x7fc0d00f6530 2023-10-18T21:20:44.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.397+0000 7fc0beffd700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0b8060f70 0x7fc0b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:44.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.397+0000 7fc0beffd700 1 -- 172.21.15.8:0/2402449028 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc0c007cb90 con 0x7fc0d00f6530 2023-10-18T21:20:44.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.397+0000 7fc0cdd9b700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0b8060f70 0x7fc0b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:44.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.398+0000 7fc0cdd9b700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0b8060f70 0x7fc0b8063430 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fc0c4009d60 tx=0x7fc0c4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:44.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.401+0000 7fc0beffd700 1 -- 172.21.15.8:0/2402449028 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc0c004c7c0 con 0x7fc0d00f6530 2023-10-18T21:20:44.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.592+0000 7fc0cf59e700 1 -- 172.21.15.8:0/2402449028 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0d00fee00 con 0x7fc0b8060f70 2023-10-18T21:20:44.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.602+0000 7fc0beffd700 1 -- 172.21.15.8:0/2402449028 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc0d00fee00 con 0x7fc0b8060f70 2023-10-18T21:20:44.604 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:20:44.604 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (27m) 5m ago 28m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:20:44.604 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (21m) 5m ago 28m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:20:44.605 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (21m) 3m ago 28m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:20:44.605 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (27m) 5m ago 28m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:20:44.605 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 24m - - 2023-10-18T21:20:44.605 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 24m - - 2023-10-18T21:20:44.605 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 24m - - 2023-10-18T21:20:44.606 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 24m - - 2023-10-18T21:20:44.606 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (22m) 5m ago 30m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:20:44.606 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (21m) 3m ago 27m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:20:44.606 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (21m) 5m ago 30m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:20:44.606 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (21m) 3m ago 27m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:20:44.607 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (28m) 5m ago 28m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:20:44.607 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (27m) 3m ago 27m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:20:44.607 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (20m) 5m ago 27m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:20:44.607 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (18m) 5m ago 27m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:20:44.607 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (18m) 5m ago 26m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:20:44.608 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (18m) 3m ago 26m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:20:44.608 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (17m) 3m ago 26m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:20:44.608 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (16m) 3m ago 26m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:20:44.608 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (22m) 5m ago 28m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:20:44.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 -- 172.21.15.8:0/2402449028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0b8060f70 msgr2=0x7fc0b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:44.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0b8060f70 0x7fc0b8063430 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fc0c4009d60 tx=0x7fc0c4009b30).stop 2023-10-18T21:20:44.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 -- 172.21.15.8:0/2402449028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0d00f6530 msgr2=0x7fc0d0106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:44.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0d00f6530 0x7fc0d0106d90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fc0c0002700 tx=0x7fc0c0009d80).stop 2023-10-18T21:20:44.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 -- 172.21.15.8:0/2402449028 shutdown_connections 2023-10-18T21:20:44.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0b8060f70 0x7fc0b8063430 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0d00f6530 0x7fc0d0106d90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 --2- 172.21.15.8:0/2402449028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d00f77d0 0x7fc0d0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 -- 172.21.15.8:0/2402449028 >> 172.21.15.8:0/2402449028 conn(0x7fc0d00f1c90 msgr2=0x7fc0d00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:44.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 -- 172.21.15.8:0/2402449028 shutdown_connections 2023-10-18T21:20:44.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.604+0000 7fc0cf59e700 1 -- 172.21.15.8:0/2402449028 wait complete. 2023-10-18T21:20:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:42.905079+0000 mgr.smithi008.flmjzp (mgr.14640) 1316 : cluster [DBG] pgmap v918: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:44.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:42.905079+0000 mgr.smithi008.flmjzp (mgr.14640) 1316 : cluster [DBG] pgmap v918: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:44.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.739+0000 7fe649f05700 1 -- 172.21.15.8:0/846443849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6440f6530 msgr2=0x7fe6440f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:44.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.739+0000 7fe649f05700 1 --2- 172.21.15.8:0/846443849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6440f6530 0x7fe6440f6950 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fe638004660 tx=0x7fe638009b30).stop 2023-10-18T21:20:44.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.739+0000 7fe649f05700 1 -- 172.21.15.8:0/846443849 shutdown_connections 2023-10-18T21:20:44.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.739+0000 7fe649f05700 1 --2- 172.21.15.8:0/846443849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6440f77d0 0x7fe6440f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.739+0000 7fe649f05700 1 --2- 172.21.15.8:0/846443849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6440f6530 0x7fe6440f6950 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.739+0000 7fe649f05700 1 -- 172.21.15.8:0/846443849 >> 172.21.15.8:0/846443849 conn(0x7fe6440f1c90 msgr2=0x7fe6440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:44.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.739+0000 7fe649f05700 1 -- 172.21.15.8:0/846443849 shutdown_connections 2023-10-18T21:20:44.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.739+0000 7fe649f05700 1 -- 172.21.15.8:0/846443849 wait complete. 2023-10-18T21:20:44.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.740+0000 7fe649f05700 1 Processor -- start 2023-10-18T21:20:44.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.740+0000 7fe649f05700 1 -- start start 2023-10-18T21:20:44.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.741+0000 7fe649f05700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6440f6530 0x7fe644108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:44.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.741+0000 7fe649f05700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6440f77d0 0x7fe644109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:44.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.741+0000 7fe649f05700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6441099f0 con 0x7fe6440f77d0 2023-10-18T21:20:44.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.741+0000 7fe649f05700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe644109b30 con 0x7fe6440f6530 2023-10-18T21:20:44.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.741+0000 7fe643fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6440f77d0 0x7fe644109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:44.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.741+0000 7fe643fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6440f77d0 0x7fe644109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43562/0 (socket says 172.21.15.8:43562) 2023-10-18T21:20:44.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.741+0000 7fe643fff700 1 -- 172.21.15.8:0/2286521948 learned_addr learned my addr 172.21.15.8:0/2286521948 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:44.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.741+0000 7fe648f03700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6440f6530 0x7fe644108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:44.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.741+0000 7fe643fff700 1 -- 172.21.15.8:0/2286521948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6440f6530 msgr2=0x7fe644108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:44.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.742+0000 7fe643fff700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6440f6530 0x7fe644108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:44.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.742+0000 7fe643fff700 1 -- 172.21.15.8:0/2286521948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638005040 con 0x7fe6440f77d0 2023-10-18T21:20:44.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.742+0000 7fe643fff700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6440f77d0 0x7fe644109440 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fe63000e7f0 tx=0x7fe63000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:44.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.742+0000 7fe6417fa700 1 -- 172.21.15.8:0/2286521948 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6300092e0 con 0x7fe6440f77d0 2023-10-18T21:20:44.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.742+0000 7fe6417fa700 1 -- 172.21.15.8:0/2286521948 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe63000f040 con 0x7fe6440f77d0 2023-10-18T21:20:44.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.742+0000 7fe649f05700 1 -- 172.21.15.8:0/2286521948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64410a4d0 con 0x7fe6440f77d0 2023-10-18T21:20:44.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.742+0000 7fe6417fa700 1 -- 172.21.15.8:0/2286521948 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6300147e0 con 0x7fe6440f77d0 2023-10-18T21:20:44.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.742+0000 7fe649f05700 1 -- 172.21.15.8:0/2286521948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64410aa10 con 0x7fe6440f77d0 2023-10-18T21:20:44.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.744+0000 7fe649f05700 1 -- 172.21.15.8:0/2286521948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe644045ad0 con 0x7fe6440f77d0 2023-10-18T21:20:44.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.744+0000 7fe6417fa700 1 -- 172.21.15.8:0/2286521948 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe63001b030 con 0x7fe6440f77d0 2023-10-18T21:20:44.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.745+0000 7fe6417fa700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe634060f70 0x7fe634063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:44.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.745+0000 7fe6417fa700 1 -- 172.21.15.8:0/2286521948 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe63007c6b0 con 0x7fe6440f77d0 2023-10-18T21:20:44.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.745+0000 7fe648f03700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe634060f70 0x7fe634063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:44.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.746+0000 7fe648f03700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe634060f70 0x7fe634063430 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fe638009720 tx=0x7fe638016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:44.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:44.749+0000 7fe6417fa700 1 -- 172.21.15.8:0/2286521948 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe63004fd40 con 0x7fe6440f77d0 2023-10-18T21:20:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.004+0000 7fe649f05700 1 -- 172.21.15.8:0/2286521948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe644027a00 con 0x7fe6440f77d0 2023-10-18T21:20:45.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.004+0000 7fe6417fa700 1 -- 172.21.15.8:0/2286521948 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fe630019020 con 0x7fe6440f77d0 2023-10-18T21:20:45.007 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:20:45.007 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:20:45.007 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:20:45.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:20:45.008 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:20:45.008 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:20:45.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:20:45.008 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:20:45.009 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:20:45.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:20:45.009 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:20:45.009 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:20:45.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:20:45.010 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:20:45.010 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:20:45.010 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:20:45.010 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:20:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 -- 172.21.15.8:0/2286521948 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe634060f70 msgr2=0x7fe634063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe634060f70 0x7fe634063430 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fe638009720 tx=0x7fe638016040).stop 2023-10-18T21:20:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 -- 172.21.15.8:0/2286521948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6440f77d0 msgr2=0x7fe644109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6440f77d0 0x7fe644109440 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fe63000e7f0 tx=0x7fe63000b040).stop 2023-10-18T21:20:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 -- 172.21.15.8:0/2286521948 shutdown_connections 2023-10-18T21:20:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe634060f70 0x7fe634063430 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6440f6530 0x7fe644108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 --2- 172.21.15.8:0/2286521948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6440f77d0 0x7fe644109440 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 -- 172.21.15.8:0/2286521948 >> 172.21.15.8:0/2286521948 conn(0x7fe6440f1c90 msgr2=0x7fe6440f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 -- 172.21.15.8:0/2286521948 shutdown_connections 2023-10-18T21:20:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.006+0000 7fe649f05700 1 -- 172.21.15.8:0/2286521948 wait complete. 2023-10-18T21:20:45.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.144+0000 7f1e57fff700 1 -- 172.21.15.8:0/2988370988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e58060270 msgr2=0x7f1e580f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:45.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.144+0000 7f1e57fff700 1 --2- 172.21.15.8:0/2988370988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e58060270 0x7f1e580f91b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f1e48004660 tx=0x7f1e48009b30).stop 2023-10-18T21:20:45.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.144+0000 7f1e57fff700 1 -- 172.21.15.8:0/2988370988 shutdown_connections 2023-10-18T21:20:45.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.144+0000 7f1e57fff700 1 --2- 172.21.15.8:0/2988370988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e580f96a0 0x7f1e580fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.144+0000 7f1e57fff700 1 --2- 172.21.15.8:0/2988370988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e58060270 0x7f1e580f91b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.144+0000 7f1e57fff700 1 -- 172.21.15.8:0/2988370988 >> 172.21.15.8:0/2988370988 conn(0x7f1e580f0b90 msgr2=0x7f1e580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:45.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.144+0000 7f1e57fff700 1 -- 172.21.15.8:0/2988370988 shutdown_connections 2023-10-18T21:20:45.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.144+0000 7f1e57fff700 1 -- 172.21.15.8:0/2988370988 wait complete. 2023-10-18T21:20:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.145+0000 7f1e57fff700 1 Processor -- start 2023-10-18T21:20:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.145+0000 7f1e57fff700 1 -- start start 2023-10-18T21:20:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.145+0000 7f1e57fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e58060270 0x7f1e580f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.145+0000 7f1e57fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e580f96a0 0x7f1e580f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.145+0000 7f1e57fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e580f5610 con 0x7f1e580f96a0 2023-10-18T21:20:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.145+0000 7f1e57fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e580f5750 con 0x7f1e58060270 2023-10-18T21:20:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.146+0000 7f1e567fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e580f96a0 0x7f1e580f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.146+0000 7f1e567fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e580f96a0 0x7f1e580f50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43576/0 (socket says 172.21.15.8:43576) 2023-10-18T21:20:45.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.146+0000 7f1e567fc700 1 -- 172.21.15.8:0/2059895976 learned_addr learned my addr 172.21.15.8:0/2059895976 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:45.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.146+0000 7f1e56ffd700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e58060270 0x7f1e580f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:45.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.146+0000 7f1e567fc700 1 -- 172.21.15.8:0/2059895976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e58060270 msgr2=0x7f1e580f6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:45.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.146+0000 7f1e567fc700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e58060270 0x7f1e580f6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.146+0000 7f1e567fc700 1 -- 172.21.15.8:0/2059895976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e48005040 con 0x7f1e580f96a0 2023-10-18T21:20:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.146+0000 7f1e567fc700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e580f96a0 0x7f1e580f50b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f1e4c0026d0 tx=0x7f1e4c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.146+0000 7f1e3f7fe700 1 -- 172.21.15.8:0/2059895976 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e4c009320 con 0x7f1e580f96a0 2023-10-18T21:20:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.147+0000 7f1e57fff700 1 -- 172.21.15.8:0/2059895976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e580f5a30 con 0x7f1e580f96a0 2023-10-18T21:20:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.147+0000 7f1e3f7fe700 1 -- 172.21.15.8:0/2059895976 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1e4c00f040 con 0x7f1e580f96a0 2023-10-18T21:20:45.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.147+0000 7f1e3f7fe700 1 -- 172.21.15.8:0/2059895976 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e4c0148f0 con 0x7f1e580f96a0 2023-10-18T21:20:45.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.147+0000 7f1e57fff700 1 -- 172.21.15.8:0/2059895976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5810ed50 con 0x7f1e580f96a0 2023-10-18T21:20:45.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.148+0000 7f1e57fff700 1 -- 172.21.15.8:0/2059895976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e58045ad0 con 0x7f1e580f96a0 2023-10-18T21:20:45.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.149+0000 7f1e3f7fe700 1 -- 172.21.15.8:0/2059895976 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1e4c0077b0 con 0x7f1e580f96a0 2023-10-18T21:20:45.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.149+0000 7f1e3f7fe700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e40060f70 0x7f1e40063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:45.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.149+0000 7f1e3f7fe700 1 -- 172.21.15.8:0/2059895976 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1e4c07cc70 con 0x7f1e580f96a0 2023-10-18T21:20:45.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.150+0000 7f1e56ffd700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e40060f70 0x7f1e40063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:45.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.150+0000 7f1e56ffd700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e40060f70 0x7f1e40063430 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f1e48009d60 tx=0x7f1e48009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:45.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.153+0000 7f1e3f7fe700 1 -- 172.21.15.8:0/2059895976 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1e4c083080 con 0x7f1e580f96a0 2023-10-18T21:20:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.379+0000 7f1e57fff700 1 -- 172.21.15.8:0/2059895976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1e580fecf0 con 0x7f1e580f96a0 2023-10-18T21:20:45.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.380+0000 7f1e3f7fe700 1 -- 172.21.15.8:0/2059895976 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1e4c04c8a0 con 0x7f1e580f96a0 2023-10-18T21:20:45.382 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:20:45.382 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:20:45.382 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:20:45.383 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:20:45.383 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:20:45.383 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:20:45.383 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:20:45.383 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:20:45.384 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:20:45.384 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:20:45.384 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:20:45.384 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:20:45.384 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:20:45.385 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:20:45.385 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:20:45.385 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:20:45.385 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:20:45.386 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:20:45.386 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:20:45.386 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:20:45.386 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:20:45.386 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:20:45.387 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:20:45.387 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:20:45.387 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:20:45.387 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:20:45.387 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:20:45.388 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:20:45.388 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:20:45.388 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:20:45.388 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:20:45.388 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:20:45.389 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:20:45.389 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:20:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.381+0000 7f1e57fff700 1 -- 172.21.15.8:0/2059895976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e40060f70 msgr2=0x7f1e40063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.381+0000 7f1e57fff700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e40060f70 0x7f1e40063430 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f1e48009d60 tx=0x7f1e48009b30).stop 2023-10-18T21:20:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.381+0000 7f1e57fff700 1 -- 172.21.15.8:0/2059895976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e580f96a0 msgr2=0x7f1e580f50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.381+0000 7f1e57fff700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e580f96a0 0x7f1e580f50b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f1e4c0026d0 tx=0x7f1e4c009e00).stop 2023-10-18T21:20:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.382+0000 7f1e57fff700 1 -- 172.21.15.8:0/2059895976 shutdown_connections 2023-10-18T21:20:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.382+0000 7f1e57fff700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1e40060f70 0x7f1e40063430 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.382+0000 7f1e57fff700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e58060270 0x7f1e580f6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.382+0000 7f1e57fff700 1 --2- 172.21.15.8:0/2059895976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e580f96a0 0x7f1e580f50b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.382+0000 7f1e57fff700 1 -- 172.21.15.8:0/2059895976 >> 172.21.15.8:0/2059895976 conn(0x7f1e580f0b90 msgr2=0x7f1e580f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.382+0000 7f1e57fff700 1 -- 172.21.15.8:0/2059895976 shutdown_connections 2023-10-18T21:20:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.382+0000 7f1e57fff700 1 -- 172.21.15.8:0/2059895976 wait complete. 2023-10-18T21:20:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:20:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:43.900623+0000 mgr.smithi008.flmjzp (mgr.14640) 1317 : audit [DBG] from='client.35248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:44.253705+0000 mgr.smithi008.flmjzp (mgr.14640) 1318 : audit [DBG] from='client.35252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:44.594835+0000 mgr.smithi008.flmjzp (mgr.14640) 1319 : audit [DBG] from='client.35256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:45.005861+0000 mon.smithi008 (mon.0) 1803 : audit [DBG] from='client.? 172.21.15.8:0/2286521948' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:45.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.520+0000 7f3c1e21a700 1 -- 172.21.15.8:0/4049315187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c180f77d0 msgr2=0x7f3c180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:45.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.520+0000 7f3c1e21a700 1 --2- 172.21.15.8:0/4049315187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c180f77d0 0x7f3c180f7c30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f3c08004660 tx=0x7f3c08009b30).stop 2023-10-18T21:20:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.520+0000 7f3c1e21a700 1 -- 172.21.15.8:0/4049315187 shutdown_connections 2023-10-18T21:20:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.520+0000 7f3c1e21a700 1 --2- 172.21.15.8:0/4049315187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c180f77d0 0x7f3c180f7c30 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.520+0000 7f3c1e21a700 1 --2- 172.21.15.8:0/4049315187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c180f6530 0x7f3c180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.520+0000 7f3c1e21a700 1 -- 172.21.15.8:0/4049315187 >> 172.21.15.8:0/4049315187 conn(0x7f3c180f1c90 msgr2=0x7f3c180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.520+0000 7f3c1e21a700 1 -- 172.21.15.8:0/4049315187 shutdown_connections 2023-10-18T21:20:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.520+0000 7f3c1e21a700 1 -- 172.21.15.8:0/4049315187 wait complete. 2023-10-18T21:20:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.521+0000 7f3c1e21a700 1 Processor -- start 2023-10-18T21:20:45.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.522+0000 7f3c1e21a700 1 -- start start 2023-10-18T21:20:45.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.522+0000 7f3c1e21a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c180f6530 0x7f3c1806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:45.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.522+0000 7f3c1e21a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c180f77d0 0x7f3c18069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:45.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.522+0000 7f3c1e21a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1806a380 con 0x7f3c180f77d0 2023-10-18T21:20:45.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.522+0000 7f3c1e21a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1806a4c0 con 0x7f3c180f6530 2023-10-18T21:20:45.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.522+0000 7f3c1ca17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c180f77d0 0x7f3c18069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:45.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.522+0000 7f3c1ca17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c180f77d0 0x7f3c18069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43606/0 (socket says 172.21.15.8:43606) 2023-10-18T21:20:45.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.523+0000 7f3c1ca17700 1 -- 172.21.15.8:0/972146671 learned_addr learned my addr 172.21.15.8:0/972146671 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:20:45.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.523+0000 7f3c1d218700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c180f6530 0x7f3c1806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:45.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.523+0000 7f3c1ca17700 1 -- 172.21.15.8:0/972146671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c180f6530 msgr2=0x7f3c1806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:45.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.523+0000 7f3c1ca17700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c180f6530 0x7f3c1806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.523+0000 7f3c1ca17700 1 -- 172.21.15.8:0/972146671 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08005040 con 0x7f3c180f77d0 2023-10-18T21:20:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.523+0000 7f3c1ca17700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c180f77d0 0x7f3c18069e20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f3c08009990 tx=0x7f3c08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.523+0000 7f3c0dffb700 1 -- 172.21.15.8:0/972146671 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c08018070 con 0x7f3c180f77d0 2023-10-18T21:20:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.523+0000 7f3c0dffb700 1 -- 172.21.15.8:0/972146671 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3c08009630 con 0x7f3c180f77d0 2023-10-18T21:20:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.523+0000 7f3c1e21a700 1 -- 172.21.15.8:0/972146671 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1806a740 con 0x7f3c180f77d0 2023-10-18T21:20:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.523+0000 7f3c0dffb700 1 -- 172.21.15.8:0/972146671 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c0801c400 con 0x7f3c180f77d0 2023-10-18T21:20:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.524+0000 7f3c1e21a700 1 -- 172.21.15.8:0/972146671 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1806aca0 con 0x7f3c180f77d0 2023-10-18T21:20:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.525+0000 7f3c1e21a700 1 -- 172.21.15.8:0/972146671 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c18045ad0 con 0x7f3c180f77d0 2023-10-18T21:20:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.525+0000 7f3c0dffb700 1 -- 172.21.15.8:0/972146671 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3c0801d9e0 con 0x7f3c180f77d0 2023-10-18T21:20:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.526+0000 7f3c0dffb700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c04060f70 0x7f3c04063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:20:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.526+0000 7f3c0dffb700 1 -- 172.21.15.8:0/972146671 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3c0807e640 con 0x7f3c180f77d0 2023-10-18T21:20:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.527+0000 7f3c1d218700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c04060f70 0x7f3c04063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:20:45.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.527+0000 7f3c1d218700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c04060f70 0x7f3c04063430 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f3c1806b730 tx=0x7f3c14009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:20:45.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.531+0000 7f3c0dffb700 1 -- 172.21.15.8:0/972146671 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3c0804e2b0 con 0x7f3c180f77d0 2023-10-18T21:20:45.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.731+0000 7f3c1e21a700 1 -- 172.21.15.8:0/972146671 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c180fedd0 con 0x7f3c04060f70 2023-10-18T21:20:45.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.732+0000 7f3c0dffb700 1 -- 172.21.15.8:0/972146671 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3c180fedd0 con 0x7f3c04060f70 2023-10-18T21:20:45.734 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:20:45.735 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:20:45.735 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:20:45.735 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:20:45.735 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:20:45.735 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:20:45.736 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:20:45.736 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:20:45.736 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:20:45.736 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:20:45.736 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:20:45.737 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:20:45.737 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:20:45.737 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:20:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:43.900623+0000 mgr.smithi008.flmjzp (mgr.14640) 1317 : audit [DBG] from='client.35248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:44.253705+0000 mgr.smithi008.flmjzp (mgr.14640) 1318 : audit [DBG] from='client.35252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:44.594835+0000 mgr.smithi008.flmjzp (mgr.14640) 1319 : audit [DBG] from='client.35256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:45.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:45.005861+0000 mon.smithi008 (mon.0) 1803 : audit [DBG] from='client.? 172.21.15.8:0/2286521948' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:45.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.734+0000 7f3c1e21a700 1 -- 172.21.15.8:0/972146671 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c04060f70 msgr2=0x7f3c04063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:45.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.734+0000 7f3c1e21a700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c04060f70 0x7f3c04063430 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f3c1806b730 tx=0x7f3c14009c00).stop 2023-10-18T21:20:45.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.734+0000 7f3c1e21a700 1 -- 172.21.15.8:0/972146671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c180f77d0 msgr2=0x7f3c18069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:20:45.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.735+0000 7f3c1e21a700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c180f77d0 0x7f3c18069e20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f3c08009990 tx=0x7f3c08009b30).stop 2023-10-18T21:20:45.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.735+0000 7f3c1e21a700 1 -- 172.21.15.8:0/972146671 shutdown_connections 2023-10-18T21:20:45.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.735+0000 7f3c1e21a700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c04060f70 0x7f3c04063430 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.735+0000 7f3c1e21a700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c180f6530 0x7f3c1806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.735+0000 7f3c1e21a700 1 --2- 172.21.15.8:0/972146671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c180f77d0 0x7f3c18069e20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:20:45.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.735+0000 7f3c1e21a700 1 -- 172.21.15.8:0/972146671 >> 172.21.15.8:0/972146671 conn(0x7f3c180f1c90 msgr2=0x7f3c180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:20:45.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.735+0000 7f3c1e21a700 1 -- 172.21.15.8:0/972146671 shutdown_connections 2023-10-18T21:20:45.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:20:45.735+0000 7f3c1e21a700 1 -- 172.21.15.8:0/972146671 wait complete. 2023-10-18T21:20:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:44.905563+0000 mgr.smithi008.flmjzp (mgr.14640) 1320 : cluster [DBG] pgmap v919: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:45.381286+0000 mon.smithi008 (mon.0) 1804 : audit [DBG] from='client.? 172.21.15.8:0/2059895976' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:20:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:45.733727+0000 mgr.smithi008.flmjzp (mgr.14640) 1321 : audit [DBG] from='client.35268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:46.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:44.905563+0000 mgr.smithi008.flmjzp (mgr.14640) 1320 : cluster [DBG] pgmap v919: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:45.381286+0000 mon.smithi008 (mon.0) 1804 : audit [DBG] from='client.? 172.21.15.8:0/2059895976' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:20:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:45.733727+0000 mgr.smithi008.flmjzp (mgr.14640) 1321 : audit [DBG] from='client.35268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:20:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:46.906181+0000 mgr.smithi008.flmjzp (mgr.14640) 1322 : cluster [DBG] pgmap v920: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:48.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:46.906181+0000 mgr.smithi008.flmjzp (mgr.14640) 1322 : cluster [DBG] pgmap v920: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:48.906805+0000 mgr.smithi008.flmjzp (mgr.14640) 1323 : cluster [DBG] pgmap v921: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:50.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:48.906805+0000 mgr.smithi008.flmjzp (mgr.14640) 1323 : cluster [DBG] pgmap v921: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:50.933785+0000 mon.smithi008 (mon.0) 1805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:50.935995+0000 mon.smithi008 (mon.0) 1806 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:50.937006+0000 mon.smithi008 (mon.0) 1807 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:50.943535+0000 mon.smithi008 (mon.0) 1808 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:50.950988+0000 mon.smithi008 (mon.0) 1809 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:50.954240+0000 mon.smithi008 (mon.0) 1810 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:50.955927+0000 mon.smithi008 (mon.0) 1811 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:50.957566+0000 mon.smithi008 (mon.0) 1812 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:20:50.959598+0000 mon.smithi008 (mon.0) 1813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:50.933785+0000 mon.smithi008 (mon.0) 1805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:50.935995+0000 mon.smithi008 (mon.0) 1806 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:20:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:50.937006+0000 mon.smithi008 (mon.0) 1807 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:20:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:50.943535+0000 mon.smithi008 (mon.0) 1808 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:20:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:50.950988+0000 mon.smithi008 (mon.0) 1809 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:20:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:50.954240+0000 mon.smithi008 (mon.0) 1810 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:50.955927+0000 mon.smithi008 (mon.0) 1811 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:50.957566+0000 mon.smithi008 (mon.0) 1812 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:20:50.959598+0000 mon.smithi008 (mon.0) 1813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:20:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:50.907384+0000 mgr.smithi008.flmjzp (mgr.14640) 1324 : cluster [DBG] pgmap v922: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:50.937891+0000 mgr.smithi008.flmjzp (mgr.14640) 1325 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:50.938491+0000 mgr.smithi008.flmjzp (mgr.14640) 1326 : cluster [DBG] pgmap v923: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:50.938779+0000 mgr.smithi008.flmjzp (mgr.14640) 1327 : cluster [DBG] pgmap v924: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:20:50.961528+0000 mgr.smithi008.flmjzp (mgr.14640) 1328 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:52.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:50.907384+0000 mgr.smithi008.flmjzp (mgr.14640) 1324 : cluster [DBG] pgmap v922: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:52.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:50.937891+0000 mgr.smithi008.flmjzp (mgr.14640) 1325 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:20:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:50.938491+0000 mgr.smithi008.flmjzp (mgr.14640) 1326 : cluster [DBG] pgmap v923: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:50.938779+0000 mgr.smithi008.flmjzp (mgr.14640) 1327 : cluster [DBG] pgmap v924: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:20:50.961528+0000 mgr.smithi008.flmjzp (mgr.14640) 1328 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:20:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:52.939326+0000 mgr.smithi008.flmjzp (mgr.14640) 1329 : cluster [DBG] pgmap v925: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:54.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:52.939326+0000 mgr.smithi008.flmjzp (mgr.14640) 1329 : cluster [DBG] pgmap v925: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:54.940107+0000 mgr.smithi008.flmjzp (mgr.14640) 1330 : cluster [DBG] pgmap v926: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:56.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:54.940107+0000 mgr.smithi008.flmjzp (mgr.14640) 1330 : cluster [DBG] pgmap v926: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:20:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:56.940790+0000 mgr.smithi008.flmjzp (mgr.14640) 1331 : cluster [DBG] pgmap v927: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:20:58.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:20:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:56.940790+0000 mgr.smithi008.flmjzp (mgr.14640) 1331 : cluster [DBG] pgmap v927: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:20:58.941415+0000 mgr.smithi008.flmjzp (mgr.14640) 1332 : cluster [DBG] pgmap v928: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:00.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:20:58.941415+0000 mgr.smithi008.flmjzp (mgr.14640) 1332 : cluster [DBG] pgmap v928: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:00.969077+0000 mon.smithi008 (mon.0) 1814 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:00.969077+0000 mon.smithi008 (mon.0) 1814 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:00.942211+0000 mgr.smithi008.flmjzp (mgr.14640) 1333 : cluster [DBG] pgmap v929: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:01.529628+0000 mon.smithi008 (mon.0) 1815 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:01.530442+0000 mon.smithi008 (mon.0) 1816 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:01.531106+0000 mgr.smithi008.flmjzp (mgr.14640) 1334 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:01.531673+0000 mgr.smithi008.flmjzp (mgr.14640) 1335 : cluster [DBG] pgmap v930: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:01.531959+0000 mgr.smithi008.flmjzp (mgr.14640) 1336 : cluster [DBG] pgmap v931: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:01.535879+0000 mon.smithi008 (mon.0) 1817 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:01.540635+0000 mon.smithi008 (mon.0) 1818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:01.543013+0000 mon.smithi008 (mon.0) 1819 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:01.544256+0000 mon.smithi008 (mon.0) 1820 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:01.545438+0000 mon.smithi008 (mon.0) 1821 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:01.547066+0000 mon.smithi008 (mon.0) 1822 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:01.548577+0000 mgr.smithi008.flmjzp (mgr.14640) 1337 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:02.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:00.942211+0000 mgr.smithi008.flmjzp (mgr.14640) 1333 : cluster [DBG] pgmap v929: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:01.529628+0000 mon.smithi008 (mon.0) 1815 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:01.530442+0000 mon.smithi008 (mon.0) 1816 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:01.531106+0000 mgr.smithi008.flmjzp (mgr.14640) 1334 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:01.531673+0000 mgr.smithi008.flmjzp (mgr.14640) 1335 : cluster [DBG] pgmap v930: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:01.531959+0000 mgr.smithi008.flmjzp (mgr.14640) 1336 : cluster [DBG] pgmap v931: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:01.535879+0000 mon.smithi008 (mon.0) 1817 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:01.540635+0000 mon.smithi008 (mon.0) 1818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:01.543013+0000 mon.smithi008 (mon.0) 1819 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:01.544256+0000 mon.smithi008 (mon.0) 1820 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:01.545438+0000 mon.smithi008 (mon.0) 1821 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:02.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:01.547066+0000 mon.smithi008 (mon.0) 1822 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:02.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:01.548577+0000 mgr.smithi008.flmjzp (mgr.14640) 1337 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:03.532558+0000 mgr.smithi008.flmjzp (mgr.14640) 1338 : cluster [DBG] pgmap v932: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:04.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:03.532558+0000 mgr.smithi008.flmjzp (mgr.14640) 1338 : cluster [DBG] pgmap v932: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:06.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:05.533096+0000 mgr.smithi008.flmjzp (mgr.14640) 1339 : cluster [DBG] pgmap v933: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:05.533096+0000 mgr.smithi008.flmjzp (mgr.14640) 1339 : cluster [DBG] pgmap v933: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:08.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:07.533637+0000 mgr.smithi008.flmjzp (mgr.14640) 1340 : cluster [DBG] pgmap v934: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:08.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:07.533637+0000 mgr.smithi008.flmjzp (mgr.14640) 1340 : cluster [DBG] pgmap v934: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:09.534196+0000 mgr.smithi008.flmjzp (mgr.14640) 1341 : cluster [DBG] pgmap v935: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:10.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:09.534196+0000 mgr.smithi008.flmjzp (mgr.14640) 1341 : cluster [DBG] pgmap v935: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:11.558136+0000 mon.smithi008 (mon.0) 1823 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:11.560302+0000 mon.smithi008 (mon.0) 1824 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:11.561285+0000 mon.smithi008 (mon.0) 1825 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:11.568026+0000 mon.smithi008 (mon.0) 1826 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:11.574361+0000 mon.smithi008 (mon.0) 1827 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:11.577581+0000 mon.smithi008 (mon.0) 1828 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:11.579227+0000 mon.smithi008 (mon.0) 1829 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:11.580869+0000 mon.smithi008 (mon.0) 1830 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:11.582819+0000 mon.smithi008 (mon.0) 1831 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:11.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:11.558136+0000 mon.smithi008 (mon.0) 1823 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:11.560302+0000 mon.smithi008 (mon.0) 1824 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:11.561285+0000 mon.smithi008 (mon.0) 1825 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:11.568026+0000 mon.smithi008 (mon.0) 1826 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:11.574361+0000 mon.smithi008 (mon.0) 1827 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:11.577581+0000 mon.smithi008 (mon.0) 1828 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:11.579227+0000 mon.smithi008 (mon.0) 1829 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:11.580869+0000 mon.smithi008 (mon.0) 1830 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:11.582819+0000 mon.smithi008 (mon.0) 1831 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:12.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:11.534803+0000 mgr.smithi008.flmjzp (mgr.14640) 1342 : cluster [DBG] pgmap v936: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:12.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:11.562144+0000 mgr.smithi008.flmjzp (mgr.14640) 1343 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:12.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:11.562697+0000 mgr.smithi008.flmjzp (mgr.14640) 1344 : cluster [DBG] pgmap v937: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:12.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:11.562973+0000 mgr.smithi008.flmjzp (mgr.14640) 1345 : cluster [DBG] pgmap v938: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:12.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:11.584629+0000 mgr.smithi008.flmjzp (mgr.14640) 1346 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:12.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:11.534803+0000 mgr.smithi008.flmjzp (mgr.14640) 1342 : cluster [DBG] pgmap v936: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:12.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:11.562144+0000 mgr.smithi008.flmjzp (mgr.14640) 1343 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:11.562697+0000 mgr.smithi008.flmjzp (mgr.14640) 1344 : cluster [DBG] pgmap v937: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:11.562973+0000 mgr.smithi008.flmjzp (mgr.14640) 1345 : cluster [DBG] pgmap v938: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:11.584629+0000 mgr.smithi008.flmjzp (mgr.14640) 1346 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:14.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:13.563721+0000 mgr.smithi008.flmjzp (mgr.14640) 1347 : cluster [DBG] pgmap v939: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:13.563721+0000 mgr.smithi008.flmjzp (mgr.14640) 1347 : cluster [DBG] pgmap v939: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:15.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.893+0000 7f48e5703700 1 -- 172.21.15.8:0/966677554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00f77d0 msgr2=0x7f48e00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:15.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.893+0000 7f48e5703700 1 --2- 172.21.15.8:0/966677554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00f77d0 0x7f48e00f7c30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f48d4004660 tx=0x7f48d4009b30).stop 2023-10-18T21:21:15.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.893+0000 7f48e5703700 1 -- 172.21.15.8:0/966677554 shutdown_connections 2023-10-18T21:21:15.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.893+0000 7f48e5703700 1 --2- 172.21.15.8:0/966677554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00f77d0 0x7f48e00f7c30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.893+0000 7f48e5703700 1 --2- 172.21.15.8:0/966677554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00f6530 0x7f48e00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:21:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.893+0000 7f48e5703700 1 -- 172.21.15.8:0/966677554 >> 172.21.15.8:0/966677554 conn(0x7f48e00f1c90 msgr2=0x7f48e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.894+0000 7f48e5703700 1 -- 172.21.15.8:0/966677554 shutdown_connections 2023-10-18T21:21:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.894+0000 7f48e5703700 1 -- 172.21.15.8:0/966677554 wait complete. 2023-10-18T21:21:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.894+0000 7f48e5703700 1 Processor -- start 2023-10-18T21:21:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.894+0000 7f48e5703700 1 -- start start 2023-10-18T21:21:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.895+0000 7f48e5703700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00f6530 0x7f48e0108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.895+0000 7f48e5703700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00f77d0 0x7f48e01094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.895+0000 7f48e5703700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0109b00 con 0x7f48e00f6530 2023-10-18T21:21:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.895+0000 7f48e5703700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e010a3b0 con 0x7f48e00f77d0 2023-10-18T21:21:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.895+0000 7f48dffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00f6530 0x7f48e0108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.895+0000 7f48df7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00f77d0 0x7f48e01094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:15.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.895+0000 7f48dffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00f6530 0x7f48e0108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53130/0 (socket says 172.21.15.8:53130) 2023-10-18T21:21:15.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.895+0000 7f48dffff700 1 -- 172.21.15.8:0/4126227637 learned_addr learned my addr 172.21.15.8:0/4126227637 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:15.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.896+0000 7f48dffff700 1 -- 172.21.15.8:0/4126227637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00f77d0 msgr2=0x7f48e01094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:15.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.896+0000 7f48dffff700 1 --2- 172.21.15.8:0/4126227637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00f77d0 0x7f48e01094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:15.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.896+0000 7f48dffff700 1 -- 172.21.15.8:0/4126227637 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4005040 con 0x7f48e00f6530 2023-10-18T21:21:15.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.896+0000 7f48dffff700 1 --2- 172.21.15.8:0/4126227637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00f6530 0x7f48e0108fd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f48d00093f0 tx=0x7f48d0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:15.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.896+0000 7f48dcff9700 1 -- 172.21.15.8:0/4126227637 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48d0013640 con 0x7f48e00f6530 2023-10-18T21:21:15.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.896+0000 7f48dcff9700 1 -- 172.21.15.8:0/4126227637 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f48d0013c60 con 0x7f48e00f6530 2023-10-18T21:21:15.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.896+0000 7f48e5703700 1 -- 172.21.15.8:0/4126227637 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e010a690 con 0x7f48e00f6530 2023-10-18T21:21:15.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.896+0000 7f48dcff9700 1 -- 172.21.15.8:0/4126227637 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48d0012ce0 con 0x7f48e00f6530 2023-10-18T21:21:15.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.896+0000 7f48e5703700 1 -- 172.21.15.8:0/4126227637 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e010ac50 con 0x7f48e00f6530 2023-10-18T21:21:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.897+0000 7f48e5703700 1 -- 172.21.15.8:0/4126227637 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e0059100 con 0x7f48e00f6530 2023-10-18T21:21:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.898+0000 7f48dcff9700 1 -- 172.21.15.8:0/4126227637 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f48d001a060 con 0x7f48e00f6530 2023-10-18T21:21:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.899+0000 7f48dcff9700 1 --2- 172.21.15.8:0/4126227637 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48c8060f70 0x7f48c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.899+0000 7f48dcff9700 1 -- 172.21.15.8:0/4126227637 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f48d007c940 con 0x7f48e00f6530 2023-10-18T21:21:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.899+0000 7f48df7fe700 1 --2- 172.21.15.8:0/4126227637 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48c8060f70 0x7f48c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.900+0000 7f48df7fe700 1 --2- 172.21.15.8:0/4126227637 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48c8060f70 0x7f48c8063430 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f48d4004630 tx=0x7f48d4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:15.903+0000 7f48dcff9700 1 -- 172.21.15.8:0/4126227637 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f48d004fec0 con 0x7f48e00f6530 2023-10-18T21:21:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.105+0000 7f48e5703700 1 -- 172.21.15.8:0/4126227637 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48e00fedd0 con 0x7f48c8060f70 2023-10-18T21:21:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.106+0000 7f48dcff9700 1 -- 172.21.15.8:0/4126227637 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f48e00fedd0 con 0x7f48c8060f70 2023-10-18T21:21:16.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 -- 172.21.15.8:0/4126227637 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48c8060f70 msgr2=0x7f48c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 --2- 172.21.15.8:0/4126227637 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48c8060f70 0x7f48c8063430 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f48d4004630 tx=0x7f48d4009b30).stop 2023-10-18T21:21:16.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 -- 172.21.15.8:0/4126227637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00f6530 msgr2=0x7f48e0108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 --2- 172.21.15.8:0/4126227637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00f6530 0x7f48e0108fd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f48d00093f0 tx=0x7f48d0006ec0).stop 2023-10-18T21:21:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 -- 172.21.15.8:0/4126227637 shutdown_connections 2023-10-18T21:21:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 --2- 172.21.15.8:0/4126227637 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f48c8060f70 0x7f48c8063430 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 --2- 172.21.15.8:0/4126227637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e00f6530 0x7f48e0108fd0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 --2- 172.21.15.8:0/4126227637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00f77d0 0x7f48e01094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 -- 172.21.15.8:0/4126227637 >> 172.21.15.8:0/4126227637 conn(0x7f48e00f1c90 msgr2=0x7f48e006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 -- 172.21.15.8:0/4126227637 shutdown_connections 2023-10-18T21:21:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.109+0000 7f48e5703700 1 -- 172.21.15.8:0/4126227637 wait complete. 2023-10-18T21:21:16.124 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:21:16.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.249+0000 7f7e33104700 1 -- 172.21.15.8:0/2535702250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 msgr2=0x7f7e2c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.249+0000 7f7e33104700 1 --2- 172.21.15.8:0/2535702250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c0f6950 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f7e28004660 tx=0x7f7e28009b30).stop 2023-10-18T21:21:16.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.249+0000 7f7e33104700 1 -- 172.21.15.8:0/2535702250 shutdown_connections 2023-10-18T21:21:16.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.249+0000 7f7e33104700 1 --2- 172.21.15.8:0/2535702250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.249+0000 7f7e33104700 1 --2- 172.21.15.8:0/2535702250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c0f6950 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.249+0000 7f7e33104700 1 -- 172.21.15.8:0/2535702250 >> 172.21.15.8:0/2535702250 conn(0x7f7e2c0f1c90 msgr2=0x7f7e2c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:16.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.249+0000 7f7e33104700 1 -- 172.21.15.8:0/2535702250 shutdown_connections 2023-10-18T21:21:16.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.249+0000 7f7e33104700 1 -- 172.21.15.8:0/2535702250 wait complete. 2023-10-18T21:21:16.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.250+0000 7f7e33104700 1 Processor -- start 2023-10-18T21:21:16.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.250+0000 7f7e33104700 1 -- start start 2023-10-18T21:21:16.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.250+0000 7f7e33104700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:16.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.250+0000 7f7e33104700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:16.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.250+0000 7f7e33104700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c109a70 con 0x7f7e2c0f6530 2023-10-18T21:21:16.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.250+0000 7f7e33104700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c109bb0 con 0x7f7e2c0f77d0 2023-10-18T21:21:16.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.251+0000 7f7e32102700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:16.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.251+0000 7f7e32102700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53148/0 (socket says 172.21.15.8:53148) 2023-10-18T21:21:16.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.251+0000 7f7e32102700 1 -- 172.21.15.8:0/3805087756 learned_addr learned my addr 172.21.15.8:0/3805087756 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:16.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.251+0000 7f7e31901700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:16.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.251+0000 7f7e32102700 1 -- 172.21.15.8:0/3805087756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 msgr2=0x7f7e2c1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.251+0000 7f7e32102700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.251+0000 7f7e32102700 1 -- 172.21.15.8:0/3805087756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28005040 con 0x7f7e2c0f6530 2023-10-18T21:21:16.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.251+0000 7f7e32102700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c108fd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f7e28007a60 tx=0x7f7e28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:16.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.251+0000 7f7e22ffd700 1 -- 172.21.15.8:0/3805087756 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e28018070 con 0x7f7e2c0f6530 2023-10-18T21:21:16.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.252+0000 7f7e22ffd700 1 -- 172.21.15.8:0/3805087756 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7e28009630 con 0x7f7e2c0f6530 2023-10-18T21:21:16.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.252+0000 7f7e22ffd700 1 -- 172.21.15.8:0/3805087756 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e2801c4d0 con 0x7f7e2c0f6530 2023-10-18T21:21:16.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.252+0000 7f7e33104700 1 -- 172.21.15.8:0/3805087756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c10a4f0 con 0x7f7e2c0f6530 2023-10-18T21:21:16.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.252+0000 7f7e33104700 1 -- 172.21.15.8:0/3805087756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c10aa50 con 0x7f7e2c0f6530 2023-10-18T21:21:16.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.253+0000 7f7e33104700 1 -- 172.21.15.8:0/3805087756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c045ad0 con 0x7f7e2c0f6530 2023-10-18T21:21:16.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.254+0000 7f7e22ffd700 1 -- 172.21.15.8:0/3805087756 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7e2801d420 con 0x7f7e2c0f6530 2023-10-18T21:21:16.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.254+0000 7f7e22ffd700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e18060f70 0x7f7e18063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:16.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.254+0000 7f7e22ffd700 1 -- 172.21.15.8:0/3805087756 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7e2807e550 con 0x7f7e2c0f6530 2023-10-18T21:21:16.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.255+0000 7f7e31901700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e18060f70 0x7f7e18063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:16.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.255+0000 7f7e31901700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e18060f70 0x7f7e18063430 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f7e1c004c40 tx=0x7f7e1c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:16.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.258+0000 7f7e22ffd700 1 -- 172.21.15.8:0/3805087756 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7e28051bb0 con 0x7f7e2c0f6530 2023-10-18T21:21:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.459+0000 7f7e33104700 1 -- 172.21.15.8:0/3805087756 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e2c0fee40 con 0x7f7e18060f70 2023-10-18T21:21:16.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.461+0000 7f7e22ffd700 1 -- 172.21.15.8:0/3805087756 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7e2c0fee40 con 0x7f7e18060f70 2023-10-18T21:21:16.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.462+0000 7f7e33104700 1 -- 172.21.15.8:0/3805087756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e18060f70 msgr2=0x7f7e18063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.462+0000 7f7e33104700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e18060f70 0x7f7e18063430 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f7e1c004c40 tx=0x7f7e1c00b040).stop 2023-10-18T21:21:16.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.462+0000 7f7e33104700 1 -- 172.21.15.8:0/3805087756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 msgr2=0x7f7e2c108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.462+0000 7f7e33104700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c108fd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f7e28007a60 tx=0x7f7e28009b30).stop 2023-10-18T21:21:16.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.462+0000 7f7e33104700 1 -- 172.21.15.8:0/3805087756 shutdown_connections 2023-10-18T21:21:16.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.462+0000 7f7e33104700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e18060f70 0x7f7e18063430 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.462+0000 7f7e33104700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e2c0f6530 0x7f7e2c108fd0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.462+0000 7f7e33104700 1 --2- 172.21.15.8:0/3805087756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c0f77d0 0x7f7e2c1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.462+0000 7f7e33104700 1 -- 172.21.15.8:0/3805087756 >> 172.21.15.8:0/3805087756 conn(0x7f7e2c0f1c90 msgr2=0x7f7e2c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:16.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.463+0000 7f7e33104700 1 -- 172.21.15.8:0/3805087756 shutdown_connections 2023-10-18T21:21:16.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.463+0000 7f7e33104700 1 -- 172.21.15.8:0/3805087756 wait complete. 2023-10-18T21:21:16.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:15.564484+0000 mgr.smithi008.flmjzp (mgr.14640) 1348 : cluster [DBG] pgmap v940: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:16.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.600+0000 7fb851e68700 1 -- 172.21.15.8:0/3429783205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84c0f77d0 msgr2=0x7fb84c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.600+0000 7fb851e68700 1 --2- 172.21.15.8:0/3429783205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84c0f77d0 0x7fb84c0f7c30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fb838004660 tx=0x7fb838009b30).stop 2023-10-18T21:21:16.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.600+0000 7fb851e68700 1 -- 172.21.15.8:0/3429783205 shutdown_connections 2023-10-18T21:21:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.600+0000 7fb851e68700 1 --2- 172.21.15.8:0/3429783205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84c0f77d0 0x7fb84c0f7c30 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.600+0000 7fb851e68700 1 --2- 172.21.15.8:0/3429783205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0f6530 0x7fb84c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.600+0000 7fb851e68700 1 -- 172.21.15.8:0/3429783205 >> 172.21.15.8:0/3429783205 conn(0x7fb84c0f1c90 msgr2=0x7fb84c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.600+0000 7fb851e68700 1 -- 172.21.15.8:0/3429783205 shutdown_connections 2023-10-18T21:21:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.600+0000 7fb851e68700 1 -- 172.21.15.8:0/3429783205 wait complete. 2023-10-18T21:21:16.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.601+0000 7fb851e68700 1 Processor -- start 2023-10-18T21:21:16.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.601+0000 7fb851e68700 1 -- start start 2023-10-18T21:21:16.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.601+0000 7fb851e68700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0f6530 0x7fb84c108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:16.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.601+0000 7fb851e68700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84c0f77d0 0x7fb84c109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:16.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.601+0000 7fb851e68700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c1099c0 con 0x7fb84c0f77d0 2023-10-18T21:21:16.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.601+0000 7fb851e68700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c109b00 con 0x7fb84c0f6530 2023-10-18T21:21:16.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb84bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84c0f77d0 0x7fb84c109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:16.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb84bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84c0f77d0 0x7fb84c109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53170/0 (socket says 172.21.15.8:53170) 2023-10-18T21:21:16.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb84bfff700 1 -- 172.21.15.8:0/2923756367 learned_addr learned my addr 172.21.15.8:0/2923756367 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:16.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb850e66700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0f6530 0x7fb84c108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:16.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb84bfff700 1 -- 172.21.15.8:0/2923756367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0f6530 msgr2=0x7fb84c108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb84bfff700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0f6530 0x7fb84c108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb84bfff700 1 -- 172.21.15.8:0/2923756367 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838005040 con 0x7fb84c0f77d0 2023-10-18T21:21:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb84bfff700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84c0f77d0 0x7fb84c109410 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fb838004320 tx=0x7fb83800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb8497fa700 1 -- 172.21.15.8:0/2923756367 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb838019070 con 0x7fb84c0f77d0 2023-10-18T21:21:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb8497fa700 1 -- 172.21.15.8:0/2923756367 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb83801e420 con 0x7fb84c0f77d0 2023-10-18T21:21:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.602+0000 7fb8497fa700 1 -- 172.21.15.8:0/2923756367 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb838014660 con 0x7fb84c0f77d0 2023-10-18T21:21:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.603+0000 7fb851e68700 1 -- 172.21.15.8:0/2923756367 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84c10a440 con 0x7fb84c0f77d0 2023-10-18T21:21:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.603+0000 7fb851e68700 1 -- 172.21.15.8:0/2923756367 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84c10a920 con 0x7fb84c0f77d0 2023-10-18T21:21:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.604+0000 7fb851e68700 1 -- 172.21.15.8:0/2923756367 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84c045ad0 con 0x7fb84c0f77d0 2023-10-18T21:21:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.605+0000 7fb8497fa700 1 -- 172.21.15.8:0/2923756367 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb83801e590 con 0x7fb84c0f77d0 2023-10-18T21:21:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.606+0000 7fb8497fa700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb83c060fc0 0x7fb83c063480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.607+0000 7fb8497fa700 1 -- 172.21.15.8:0/2923756367 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb83807dd90 con 0x7fb84c0f77d0 2023-10-18T21:21:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.607+0000 7fb850e66700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb83c060fc0 0x7fb83c063480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.607+0000 7fb850e66700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb83c060fc0 0x7fb83c063480 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fb84c0f7630 tx=0x7fb84000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.611+0000 7fb8497fa700 1 -- 172.21.15.8:0/2923756367 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb838051390 con 0x7fb84c0f77d0 2023-10-18T21:21:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:15.564484+0000 mgr.smithi008.flmjzp (mgr.14640) 1348 : cluster [DBG] pgmap v940: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:16.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.804+0000 7fb851e68700 1 -- 172.21.15.8:0/2923756367 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb84c10ab90 con 0x7fb83c060fc0 2023-10-18T21:21:16.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.814+0000 7fb8497fa700 1 -- 172.21.15.8:0/2923756367 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb84c10ab90 con 0x7fb83c060fc0 2023-10-18T21:21:16.815 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:21:16.815 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (27m) 5m ago 29m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:21:16.816 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (21m) 5m ago 29m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:21:16.816 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (21m) 3m ago 28m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:21:16.816 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (27m) 5m ago 29m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:21:16.816 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 25m - - 2023-10-18T21:21:16.816 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 25m - - 2023-10-18T21:21:16.817 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 25m - - 2023-10-18T21:21:16.817 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 25m - - 2023-10-18T21:21:16.817 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (23m) 5m ago 30m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:21:16.817 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (22m) 3m ago 28m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:21:16.817 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (22m) 5m ago 30m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:21:16.818 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (22m) 3m ago 28m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:21:16.818 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (28m) 5m ago 28m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:21:16.818 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (28m) 3m ago 28m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:21:16.818 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (21m) 5m ago 27m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:21:16.818 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (19m) 5m ago 27m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:21:16.819 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (19m) 5m ago 27m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:21:16.819 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (18m) 3m ago 27m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:21:16.819 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (17m) 3m ago 26m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:21:16.819 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (17m) 3m ago 26m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:21:16.819 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (23m) 5m ago 28m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:21:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 -- 172.21.15.8:0/2923756367 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb83c060fc0 msgr2=0x7fb83c063480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb83c060fc0 0x7fb83c063480 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fb84c0f7630 tx=0x7fb84000b040).stop 2023-10-18T21:21:16.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 -- 172.21.15.8:0/2923756367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84c0f77d0 msgr2=0x7fb84c109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84c0f77d0 0x7fb84c109410 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fb838004320 tx=0x7fb83800b040).stop 2023-10-18T21:21:16.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 -- 172.21.15.8:0/2923756367 shutdown_connections 2023-10-18T21:21:16.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb83c060fc0 0x7fb83c063480 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0f6530 0x7fb84c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 --2- 172.21.15.8:0/2923756367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84c0f77d0 0x7fb84c109410 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 -- 172.21.15.8:0/2923756367 >> 172.21.15.8:0/2923756367 conn(0x7fb84c0f1c90 msgr2=0x7fb84c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:16.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 -- 172.21.15.8:0/2923756367 shutdown_connections 2023-10-18T21:21:16.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.816+0000 7fb851e68700 1 -- 172.21.15.8:0/2923756367 wait complete. 2023-10-18T21:21:16.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.952+0000 7fc45330f700 1 -- 172.21.15.8:0/4494295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc44c0f96a0 msgr2=0x7fc44c0fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.952+0000 7fc45330f700 1 --2- 172.21.15.8:0/4494295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc44c0f96a0 0x7fc44c0fbaf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fc43c004660 tx=0x7fc43c009b30).stop 2023-10-18T21:21:16.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.952+0000 7fc45330f700 1 -- 172.21.15.8:0/4494295 shutdown_connections 2023-10-18T21:21:16.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.952+0000 7fc45330f700 1 --2- 172.21.15.8:0/4494295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc44c0f96a0 0x7fc44c0fbaf0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.952+0000 7fc45330f700 1 --2- 172.21.15.8:0/4494295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc44c060310 0x7fc44c0f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.952+0000 7fc45330f700 1 -- 172.21.15.8:0/4494295 >> 172.21.15.8:0/4494295 conn(0x7fc44c0f0ba0 msgr2=0x7fc44c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:16.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.952+0000 7fc45330f700 1 -- 172.21.15.8:0/4494295 shutdown_connections 2023-10-18T21:21:16.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.952+0000 7fc45330f700 1 -- 172.21.15.8:0/4494295 wait complete. 2023-10-18T21:21:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.953+0000 7fc45330f700 1 Processor -- start 2023-10-18T21:21:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.953+0000 7fc45330f700 1 -- start start 2023-10-18T21:21:16.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.953+0000 7fc45330f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc44c060310 0x7fc44c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:16.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.953+0000 7fc45330f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc44c0f96a0 0x7fc44c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:16.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.953+0000 7fc45330f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c109970 con 0x7fc44c0f96a0 2023-10-18T21:21:16.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.953+0000 7fc45330f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c109ab0 con 0x7fc44c060310 2023-10-18T21:21:16.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc451b0c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc44c0f96a0 0x7fc44c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:16.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc451b0c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc44c0f96a0 0x7fc44c1093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60682/0 (socket says 172.21.15.8:60682) 2023-10-18T21:21:16.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc451b0c700 1 -- 172.21.15.8:0/3148016061 learned_addr learned my addr 172.21.15.8:0/3148016061 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:16.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc45230d700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc44c060310 0x7fc44c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:16.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc451b0c700 1 -- 172.21.15.8:0/3148016061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc44c060310 msgr2=0x7fc44c108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:16.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc451b0c700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc44c060310 0x7fc44c108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:16.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc451b0c700 1 -- 172.21.15.8:0/3148016061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c005040 con 0x7fc44c0f96a0 2023-10-18T21:21:16.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc45230d700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc44c060310 0x7fc44c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:21:16.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc451b0c700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc44c0f96a0 0x7fc44c1093c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fc43c007a60 tx=0x7fc43c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:16.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc442ffd700 1 -- 172.21.15.8:0/3148016061 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43c018070 con 0x7fc44c0f96a0 2023-10-18T21:21:16.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc45330f700 1 -- 172.21.15.8:0/3148016061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c10a3f0 con 0x7fc44c0f96a0 2023-10-18T21:21:16.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.954+0000 7fc442ffd700 1 -- 172.21.15.8:0/3148016061 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc43c009630 con 0x7fc44c0f96a0 2023-10-18T21:21:16.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.955+0000 7fc442ffd700 1 -- 172.21.15.8:0/3148016061 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43c01c540 con 0x7fc44c0f96a0 2023-10-18T21:21:16.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.955+0000 7fc45330f700 1 -- 172.21.15.8:0/3148016061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c10a950 con 0x7fc44c0f96a0 2023-10-18T21:21:16.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.956+0000 7fc45330f700 1 -- 172.21.15.8:0/3148016061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c045ad0 con 0x7fc44c0f96a0 2023-10-18T21:21:16.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.957+0000 7fc442ffd700 1 -- 172.21.15.8:0/3148016061 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc43c01c7b0 con 0x7fc44c0f96a0 2023-10-18T21:21:16.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.957+0000 7fc442ffd700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc438060f70 0x7fc438063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:16.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.957+0000 7fc442ffd700 1 -- 172.21.15.8:0/3148016061 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc43c07e760 con 0x7fc44c0f96a0 2023-10-18T21:21:16.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.958+0000 7fc45230d700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc438060f70 0x7fc438063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:16.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.958+0000 7fc45230d700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc438060f70 0x7fc438063430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fc448009880 tx=0x7fc44800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:16.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:16.961+0000 7fc442ffd700 1 -- 172.21.15.8:0/3148016061 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc43c051d40 con 0x7fc44c0f96a0 2023-10-18T21:21:17.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.218+0000 7fc45330f700 1 -- 172.21.15.8:0/3148016061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc44c10b050 con 0x7fc44c0f96a0 2023-10-18T21:21:17.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.219+0000 7fc442ffd700 1 -- 172.21.15.8:0/3148016061 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fc43c051930 con 0x7fc44c0f96a0 2023-10-18T21:21:17.220 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:21:17.220 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:21:17.220 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:21:17.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:21:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:21:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:21:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:21:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:21:17.221 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:21:17.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:21:17.222 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:21:17.222 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:21:17.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:21:17.222 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:21:17.223 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:21:17.223 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:21:17.223 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:21:17.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.220+0000 7fc45330f700 1 -- 172.21.15.8:0/3148016061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc438060f70 msgr2=0x7fc438063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:17.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.220+0000 7fc45330f700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc438060f70 0x7fc438063430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fc448009880 tx=0x7fc44800b040).stop 2023-10-18T21:21:17.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.221+0000 7fc45330f700 1 -- 172.21.15.8:0/3148016061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc44c0f96a0 msgr2=0x7fc44c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:17.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.221+0000 7fc45330f700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc44c0f96a0 0x7fc44c1093c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fc43c007a60 tx=0x7fc43c009b30).stop 2023-10-18T21:21:17.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.221+0000 7fc45330f700 1 -- 172.21.15.8:0/3148016061 shutdown_connections 2023-10-18T21:21:17.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.221+0000 7fc45330f700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc438060f70 0x7fc438063430 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.221+0000 7fc45330f700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc44c060310 0x7fc44c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.221+0000 7fc45330f700 1 --2- 172.21.15.8:0/3148016061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc44c0f96a0 0x7fc44c1093c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.221+0000 7fc45330f700 1 -- 172.21.15.8:0/3148016061 >> 172.21.15.8:0/3148016061 conn(0x7fc44c0f0ba0 msgr2=0x7fc44c0f4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:17.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.221+0000 7fc45330f700 1 -- 172.21.15.8:0/3148016061 shutdown_connections 2023-10-18T21:21:17.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.221+0000 7fc45330f700 1 -- 172.21.15.8:0/3148016061 wait complete. 2023-10-18T21:21:17.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.357+0000 7f16dc84b700 1 -- 172.21.15.8:0/3053470289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16d80f6530 msgr2=0x7f16d80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:17.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.357+0000 7f16dc84b700 1 --2- 172.21.15.8:0/3053470289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16d80f6530 0x7f16d80f6950 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f16c8004660 tx=0x7f16c8009b30).stop 2023-10-18T21:21:17.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.357+0000 7f16dc84b700 1 -- 172.21.15.8:0/3053470289 shutdown_connections 2023-10-18T21:21:17.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.357+0000 7f16dc84b700 1 --2- 172.21.15.8:0/3053470289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16d80f77d0 0x7f16d80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:21:17.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.357+0000 7f16dc84b700 1 --2- 172.21.15.8:0/3053470289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16d80f6530 0x7f16d80f6950 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.357+0000 7f16dc84b700 1 -- 172.21.15.8:0/3053470289 >> 172.21.15.8:0/3053470289 conn(0x7f16d80f1c90 msgr2=0x7f16d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:17.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.358+0000 7f16dc84b700 1 -- 172.21.15.8:0/3053470289 shutdown_connections 2023-10-18T21:21:17.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.358+0000 7f16dc84b700 1 -- 172.21.15.8:0/3053470289 wait complete. 2023-10-18T21:21:17.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.358+0000 7f16dc84b700 1 Processor -- start 2023-10-18T21:21:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.358+0000 7f16dc84b700 1 -- start start 2023-10-18T21:21:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.359+0000 7f16dc84b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16d80f6530 0x7f16d8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.359+0000 7f16dc84b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16d80f77d0 0x7f16d81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.359+0000 7f16dc84b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d8109b00 con 0x7f16d80f77d0 2023-10-18T21:21:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.359+0000 7f16dc84b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d810a3b0 con 0x7f16d80f6530 2023-10-18T21:21:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.359+0000 7f16d659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16d80f77d0 0x7f16d81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.359+0000 7f16d659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16d80f77d0 0x7f16d81094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60700/0 (socket says 172.21.15.8:60700) 2023-10-18T21:21:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.359+0000 7f16d659c700 1 -- 172.21.15.8:0/474911025 learned_addr learned my addr 172.21.15.8:0/474911025 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.359+0000 7f16d6d9d700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16d80f6530 0x7f16d8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:17.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.360+0000 7f16d659c700 1 -- 172.21.15.8:0/474911025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16d80f6530 msgr2=0x7f16d8108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:17.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.360+0000 7f16d659c700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16d80f6530 0x7f16d8108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.360+0000 7f16d659c700 1 -- 172.21.15.8:0/474911025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8005040 con 0x7f16d80f77d0 2023-10-18T21:21:17.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.360+0000 7f16d659c700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16d80f77d0 0x7f16d81094c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f16cc00b410 tx=0x7f16cc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.360+0000 7f16bf7fe700 1 -- 172.21.15.8:0/474911025 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16cc0125f0 con 0x7f16d80f77d0 2023-10-18T21:21:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.360+0000 7f16bf7fe700 1 -- 172.21.15.8:0/474911025 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f16cc00be30 con 0x7f16d80f77d0 2023-10-18T21:21:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.360+0000 7f16dc84b700 1 -- 172.21.15.8:0/474911025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d810a690 con 0x7f16d80f77d0 2023-10-18T21:21:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.360+0000 7f16bf7fe700 1 -- 172.21.15.8:0/474911025 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16cc002a60 con 0x7f16d80f77d0 2023-10-18T21:21:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.360+0000 7f16dc84b700 1 -- 172.21.15.8:0/474911025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d810ac50 con 0x7f16d80f77d0 2023-10-18T21:21:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.361+0000 7f16dc84b700 1 -- 172.21.15.8:0/474911025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d8059100 con 0x7f16d80f77d0 2023-10-18T21:21:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.362+0000 7f16bf7fe700 1 -- 172.21.15.8:0/474911025 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f16cc00f030 con 0x7f16d80f77d0 2023-10-18T21:21:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.363+0000 7f16bf7fe700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16c0060f70 0x7f16c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.363+0000 7f16bf7fe700 1 -- 172.21.15.8:0/474911025 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f16cc07cd20 con 0x7f16d80f77d0 2023-10-18T21:21:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.363+0000 7f16d6d9d700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16c0060f70 0x7f16c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:17.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.364+0000 7f16d6d9d700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16c0060f70 0x7f16c0063430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f16c8004630 tx=0x7f16c8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:17.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.367+0000 7f16bf7fe700 1 -- 172.21.15.8:0/474911025 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f16cc050320 con 0x7f16d80f77d0 2023-10-18T21:21:17.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:16.106815+0000 mgr.smithi008.flmjzp (mgr.14640) 1349 : audit [DBG] from='client.35272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:17.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:16.460879+0000 mgr.smithi008.flmjzp (mgr.14640) 1350 : audit [DBG] from='client.35276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:16.805955+0000 mgr.smithi008.flmjzp (mgr.14640) 1351 : audit [DBG] from='client.35280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:17.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.592+0000 7f16dc84b700 1 -- 172.21.15.8:0/474911025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f16d80fed40 con 0x7f16d80f77d0 2023-10-18T21:21:17.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.593+0000 7f16bf7fe700 1 -- 172.21.15.8:0/474911025 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f16cc04ff10 con 0x7f16d80f77d0 2023-10-18T21:21:17.594 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:21:17.594 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:21:17.595 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:21:17.595 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:21:17.595 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:21:17.595 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:21:17.595 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:21:17.596 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:21:17.596 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:21:17.596 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:21:17.596 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:21:17.596 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:21:17.597 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:21:17.597 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:21:17.597 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:21:17.597 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:21:17.597 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:21:17.598 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:21:17.598 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:21:17.598 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:21:17.598 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:21:17.598 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:21:17.599 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:21:17.599 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:21:17.599 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:21:17.599 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:21:17.599 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:21:17.599 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:21:17.600 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:21:17.600 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:21:17.600 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:21:17.600 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:21:17.600 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:21:17.601 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:21:17.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 -- 172.21.15.8:0/474911025 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16c0060f70 msgr2=0x7f16c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:17.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16c0060f70 0x7f16c0063430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f16c8004630 tx=0x7f16c8009b30).stop 2023-10-18T21:21:17.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 -- 172.21.15.8:0/474911025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16d80f77d0 msgr2=0x7f16d81094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:17.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16d80f77d0 0x7f16d81094c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f16cc00b410 tx=0x7f16cc006ef0).stop 2023-10-18T21:21:17.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 -- 172.21.15.8:0/474911025 shutdown_connections 2023-10-18T21:21:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16c0060f70 0x7f16c0063430 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16d80f6530 0x7f16d8108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 --2- 172.21.15.8:0/474911025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16d80f77d0 0x7f16d81094c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 -- 172.21.15.8:0/474911025 >> 172.21.15.8:0/474911025 conn(0x7f16d80f1c90 msgr2=0x7f16d806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 -- 172.21.15.8:0/474911025 shutdown_connections 2023-10-18T21:21:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.595+0000 7f16dc84b700 1 -- 172.21.15.8:0/474911025 wait complete. 2023-10-18T21:21:17.604 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:21:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:16.106815+0000 mgr.smithi008.flmjzp (mgr.14640) 1349 : audit [DBG] from='client.35272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:16.460879+0000 mgr.smithi008.flmjzp (mgr.14640) 1350 : audit [DBG] from='client.35276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:16.805955+0000 mgr.smithi008.flmjzp (mgr.14640) 1351 : audit [DBG] from='client.35280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:17.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.733+0000 7f7ef3483700 1 -- 172.21.15.8:0/1431400132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eec0f6530 msgr2=0x7f7eec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:17.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.733+0000 7f7ef3483700 1 --2- 172.21.15.8:0/1431400132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eec0f6530 0x7f7eec0f6950 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f7ee8004660 tx=0x7f7ee8009b30).stop 2023-10-18T21:21:17.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.733+0000 7f7ef3483700 1 -- 172.21.15.8:0/1431400132 shutdown_connections 2023-10-18T21:21:17.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.733+0000 7f7ef3483700 1 --2- 172.21.15.8:0/1431400132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eec0f77d0 0x7f7eec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.733+0000 7f7ef3483700 1 --2- 172.21.15.8:0/1431400132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eec0f6530 0x7f7eec0f6950 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.733+0000 7f7ef3483700 1 -- 172.21.15.8:0/1431400132 >> 172.21.15.8:0/1431400132 conn(0x7f7eec0f1c90 msgr2=0x7f7eec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.733+0000 7f7ef3483700 1 -- 172.21.15.8:0/1431400132 shutdown_connections 2023-10-18T21:21:17.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.733+0000 7f7ef3483700 1 -- 172.21.15.8:0/1431400132 wait complete. 2023-10-18T21:21:17.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.734+0000 7f7ef3483700 1 Processor -- start 2023-10-18T21:21:17.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.734+0000 7f7ef3483700 1 -- start start 2023-10-18T21:21:17.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.734+0000 7f7ef3483700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eec0f6530 0x7f7eec106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:17.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.734+0000 7f7ef3483700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eec0f77d0 0x7f7eec107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:17.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.734+0000 7f7ef3483700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec107910 con 0x7f7eec0f6530 2023-10-18T21:21:17.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.734+0000 7f7ef3483700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec108120 con 0x7f7eec0f77d0 2023-10-18T21:21:17.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.735+0000 7f7ef2481700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eec0f6530 0x7f7eec106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:17.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.735+0000 7f7ef2481700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eec0f6530 0x7f7eec106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60704/0 (socket says 172.21.15.8:60704) 2023-10-18T21:21:17.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.735+0000 7f7ef2481700 1 -- 172.21.15.8:0/1327605631 learned_addr learned my addr 172.21.15.8:0/1327605631 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:17.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.735+0000 7f7ef1c80700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eec0f77d0 0x7f7eec107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:17.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.735+0000 7f7ef2481700 1 -- 172.21.15.8:0/1327605631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eec0f77d0 msgr2=0x7f7eec107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:17.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.735+0000 7f7ef2481700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eec0f77d0 0x7f7eec107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.735+0000 7f7ef2481700 1 -- 172.21.15.8:0/1327605631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee8005040 con 0x7f7eec0f6530 2023-10-18T21:21:17.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.735+0000 7f7ef2481700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eec0f6530 0x7f7eec106e20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f7ee8007a60 tx=0x7f7ee8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:17.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.735+0000 7f7ee2ffd700 1 -- 172.21.15.8:0/1327605631 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee8018070 con 0x7f7eec0f6530 2023-10-18T21:21:17.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.736+0000 7f7ee2ffd700 1 -- 172.21.15.8:0/1327605631 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7ee8009630 con 0x7f7eec0f6530 2023-10-18T21:21:17.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.736+0000 7f7ef3483700 1 -- 172.21.15.8:0/1327605631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eec108340 con 0x7f7eec0f6530 2023-10-18T21:21:17.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.736+0000 7f7ee2ffd700 1 -- 172.21.15.8:0/1327605631 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee801c4d0 con 0x7f7eec0f6530 2023-10-18T21:21:17.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.736+0000 7f7ef3483700 1 -- 172.21.15.8:0/1327605631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec1088a0 con 0x7f7eec0f6530 2023-10-18T21:21:17.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.737+0000 7f7ef3483700 1 -- 172.21.15.8:0/1327605631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec059100 con 0x7f7eec0f6530 2023-10-18T21:21:17.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.737+0000 7f7ee2ffd700 1 -- 172.21.15.8:0/1327605631 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7ee801d420 con 0x7f7eec0f6530 2023-10-18T21:21:17.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.738+0000 7f7ee2ffd700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ed8060f70 0x7f7ed8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:17.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.738+0000 7f7ee2ffd700 1 -- 172.21.15.8:0/1327605631 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7ee807e650 con 0x7f7eec0f6530 2023-10-18T21:21:17.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.739+0000 7f7ef1c80700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ed8060f70 0x7f7ed8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:17.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.739+0000 7f7ef1c80700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ed8060f70 0x7f7ed8063430 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f7edc004c40 tx=0x7f7edc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:17.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.743+0000 7f7ee2ffd700 1 -- 172.21.15.8:0/1327605631 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7ee804e270 con 0x7f7eec0f6530 2023-10-18T21:21:17.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.940+0000 7f7ef3483700 1 -- 172.21.15.8:0/1327605631 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7eec0fed30 con 0x7f7ed8060f70 2023-10-18T21:21:17.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.941+0000 7f7ee2ffd700 1 -- 172.21.15.8:0/1327605631 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7eec0fed30 con 0x7f7ed8060f70 2023-10-18T21:21:17.942 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:21:17.943 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:21:17.943 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:21:17.943 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:21:17.943 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:21:17.943 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:21:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:21:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:21:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:21:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:21:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:21:17.944 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:21:17.945 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:21:17.945 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:21:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.943+0000 7f7ef3483700 1 -- 172.21.15.8:0/1327605631 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ed8060f70 msgr2=0x7f7ed8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.943+0000 7f7ef3483700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ed8060f70 0x7f7ed8063430 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f7edc004c40 tx=0x7f7edc00b040).stop 2023-10-18T21:21:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.943+0000 7f7ef3483700 1 -- 172.21.15.8:0/1327605631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eec0f6530 msgr2=0x7f7eec106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.943+0000 7f7ef3483700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eec0f6530 0x7f7eec106e20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f7ee8007a60 tx=0x7f7ee8009b30).stop 2023-10-18T21:21:17.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.943+0000 7f7ef3483700 1 -- 172.21.15.8:0/1327605631 shutdown_connections 2023-10-18T21:21:17.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.943+0000 7f7ef3483700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ed8060f70 0x7f7ed8063430 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.943+0000 7f7ef3483700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eec0f6530 0x7f7eec106e20 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.943+0000 7f7ef3483700 1 --2- 172.21.15.8:0/1327605631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eec0f77d0 0x7f7eec107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:17.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.943+0000 7f7ef3483700 1 -- 172.21.15.8:0/1327605631 >> 172.21.15.8:0/1327605631 conn(0x7f7eec0f1c90 msgr2=0x7f7eec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:17.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.944+0000 7f7ef3483700 1 -- 172.21.15.8:0/1327605631 shutdown_connections 2023-10-18T21:21:17.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:17.944+0000 7f7ef3483700 1 -- 172.21.15.8:0/1327605631 wait complete. 2023-10-18T21:21:18.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:17.219241+0000 mon.smithi008 (mon.0) 1832 : audit [DBG] from='client.? 172.21.15.8:0/3148016061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:17.564908+0000 mgr.smithi008.flmjzp (mgr.14640) 1352 : cluster [DBG] pgmap v941: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:17.593682+0000 mon.smithi008 (mon.0) 1833 : audit [DBG] from='client.? 172.21.15.8:0/474911025' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:21:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:17.219241+0000 mon.smithi008 (mon.0) 1832 : audit [DBG] from='client.? 172.21.15.8:0/3148016061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:17.564908+0000 mgr.smithi008.flmjzp (mgr.14640) 1352 : cluster [DBG] pgmap v941: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:17.593682+0000 mon.smithi008 (mon.0) 1833 : audit [DBG] from='client.? 172.21.15.8:0/474911025' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:21:19.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:17.941845+0000 mgr.smithi008.flmjzp (mgr.14640) 1353 : audit [DBG] from='client.35292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:17.941845+0000 mgr.smithi008.flmjzp (mgr.14640) 1353 : audit [DBG] from='client.35292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:19.565429+0000 mgr.smithi008.flmjzp (mgr.14640) 1354 : cluster [DBG] pgmap v942: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:20.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:19.565429+0000 mgr.smithi008.flmjzp (mgr.14640) 1354 : cluster [DBG] pgmap v942: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:21.595228+0000 mon.smithi008 (mon.0) 1834 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:21.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:21.595228+0000 mon.smithi008 (mon.0) 1834 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:22.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:21.566161+0000 mgr.smithi008.flmjzp (mgr.14640) 1355 : cluster [DBG] pgmap v943: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:22.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:22.158099+0000 mon.smithi008 (mon.0) 1835 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:22.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:22.159259+0000 mon.smithi008 (mon.0) 1836 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:22.165903+0000 mon.smithi008 (mon.0) 1837 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:22.172397+0000 mon.smithi008 (mon.0) 1838 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:22.175795+0000 mon.smithi008 (mon.0) 1839 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:22.177489+0000 mon.smithi008 (mon.0) 1840 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:22.179095+0000 mon.smithi008 (mon.0) 1841 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:22.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:22.181119+0000 mon.smithi008 (mon.0) 1842 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:22.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:21.566161+0000 mgr.smithi008.flmjzp (mgr.14640) 1355 : cluster [DBG] pgmap v943: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:22.158099+0000 mon.smithi008 (mon.0) 1835 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:22.159259+0000 mon.smithi008 (mon.0) 1836 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:22.165903+0000 mon.smithi008 (mon.0) 1837 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:22.172397+0000 mon.smithi008 (mon.0) 1838 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:22.175795+0000 mon.smithi008 (mon.0) 1839 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:22.177489+0000 mon.smithi008 (mon.0) 1840 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:22.179095+0000 mon.smithi008 (mon.0) 1841 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:22.181119+0000 mon.smithi008 (mon.0) 1842 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:22.160161+0000 mgr.smithi008.flmjzp (mgr.14640) 1356 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:22.160871+0000 mgr.smithi008.flmjzp (mgr.14640) 1357 : cluster [DBG] pgmap v944: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:22.161158+0000 mgr.smithi008.flmjzp (mgr.14640) 1358 : cluster [DBG] pgmap v945: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:22.183142+0000 mgr.smithi008.flmjzp (mgr.14640) 1359 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:23.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:22.160161+0000 mgr.smithi008.flmjzp (mgr.14640) 1356 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:23.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:22.160871+0000 mgr.smithi008.flmjzp (mgr.14640) 1357 : cluster [DBG] pgmap v944: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:22.161158+0000 mgr.smithi008.flmjzp (mgr.14640) 1358 : cluster [DBG] pgmap v945: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:22.183142+0000 mgr.smithi008.flmjzp (mgr.14640) 1359 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:24.161775+0000 mgr.smithi008.flmjzp (mgr.14640) 1360 : cluster [DBG] pgmap v946: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:25.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:24.161775+0000 mgr.smithi008.flmjzp (mgr.14640) 1360 : cluster [DBG] pgmap v946: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:26.162438+0000 mgr.smithi008.flmjzp (mgr.14640) 1361 : cluster [DBG] pgmap v947: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:27.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:26.162438+0000 mgr.smithi008.flmjzp (mgr.14640) 1361 : cluster [DBG] pgmap v947: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:28.163050+0000 mgr.smithi008.flmjzp (mgr.14640) 1362 : cluster [DBG] pgmap v948: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:30.143 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:28.163050+0000 mgr.smithi008.flmjzp (mgr.14640) 1362 : cluster [DBG] pgmap v948: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:31.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:30.163784+0000 mgr.smithi008.flmjzp (mgr.14640) 1363 : cluster [DBG] pgmap v949: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:30.163784+0000 mgr.smithi008.flmjzp (mgr.14640) 1363 : cluster [DBG] pgmap v949: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:32.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:32.184971+0000 mon.smithi008 (mon.0) 1843 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:32.187216+0000 mon.smithi008 (mon.0) 1844 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:32.188295+0000 mon.smithi008 (mon.0) 1845 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:32.195100+0000 mon.smithi008 (mon.0) 1846 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:32.201561+0000 mon.smithi008 (mon.0) 1847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:32.204818+0000 mon.smithi008 (mon.0) 1848 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:32.206537+0000 mon.smithi008 (mon.0) 1849 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:32.208256+0000 mon.smithi008 (mon.0) 1850 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:32.210288+0000 mon.smithi008 (mon.0) 1851 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:32.184971+0000 mon.smithi008 (mon.0) 1843 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:32.187216+0000 mon.smithi008 (mon.0) 1844 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:32.188295+0000 mon.smithi008 (mon.0) 1845 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:32.195100+0000 mon.smithi008 (mon.0) 1846 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:32.201561+0000 mon.smithi008 (mon.0) 1847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:32.204818+0000 mon.smithi008 (mon.0) 1848 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:32.206537+0000 mon.smithi008 (mon.0) 1849 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:32.208256+0000 mon.smithi008 (mon.0) 1850 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:33.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:32.210288+0000 mon.smithi008 (mon.0) 1851 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:32.164470+0000 mgr.smithi008.flmjzp (mgr.14640) 1364 : cluster [DBG] pgmap v950: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:32.189220+0000 mgr.smithi008.flmjzp (mgr.14640) 1365 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:32.189822+0000 mgr.smithi008.flmjzp (mgr.14640) 1366 : cluster [DBG] pgmap v951: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:32.190090+0000 mgr.smithi008.flmjzp (mgr.14640) 1367 : cluster [DBG] pgmap v952: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:32.212252+0000 mgr.smithi008.flmjzp (mgr.14640) 1368 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:33.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:32.164470+0000 mgr.smithi008.flmjzp (mgr.14640) 1364 : cluster [DBG] pgmap v950: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:32.189220+0000 mgr.smithi008.flmjzp (mgr.14640) 1365 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:32.189822+0000 mgr.smithi008.flmjzp (mgr.14640) 1366 : cluster [DBG] pgmap v951: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:32.190090+0000 mgr.smithi008.flmjzp (mgr.14640) 1367 : cluster [DBG] pgmap v952: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:32.212252+0000 mgr.smithi008.flmjzp (mgr.14640) 1368 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:35.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:34.190601+0000 mgr.smithi008.flmjzp (mgr.14640) 1369 : cluster [DBG] pgmap v953: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:36.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:34.190601+0000 mgr.smithi008.flmjzp (mgr.14640) 1369 : cluster [DBG] pgmap v953: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:37.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:36.191241+0000 mgr.smithi008.flmjzp (mgr.14640) 1370 : cluster [DBG] pgmap v954: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:36.191241+0000 mgr.smithi008.flmjzp (mgr.14640) 1370 : cluster [DBG] pgmap v954: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:38.191969+0000 mgr.smithi008.flmjzp (mgr.14640) 1371 : cluster [DBG] pgmap v955: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:40.143 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:38.191969+0000 mgr.smithi008.flmjzp (mgr.14640) 1371 : cluster [DBG] pgmap v955: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:40.192536+0000 mgr.smithi008.flmjzp (mgr.14640) 1372 : cluster [DBG] pgmap v956: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:40.192536+0000 mgr.smithi008.flmjzp (mgr.14640) 1372 : cluster [DBG] pgmap v956: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:43.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:42.193089+0000 mgr.smithi008.flmjzp (mgr.14640) 1373 : cluster [DBG] pgmap v957: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:42.219089+0000 mon.smithi008 (mon.0) 1852 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:42.221294+0000 mon.smithi008 (mon.0) 1853 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:42.222527+0000 mon.smithi008 (mon.0) 1854 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:42.223528+0000 mgr.smithi008.flmjzp (mgr.14640) 1374 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:42.224076+0000 mgr.smithi008.flmjzp (mgr.14640) 1375 : cluster [DBG] pgmap v958: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:42.224333+0000 mgr.smithi008.flmjzp (mgr.14640) 1376 : cluster [DBG] pgmap v959: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:42.228838+0000 mon.smithi008 (mon.0) 1855 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:42.235189+0000 mon.smithi008 (mon.0) 1856 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:42.238355+0000 mon.smithi008 (mon.0) 1857 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:43.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:42.240071+0000 mon.smithi008 (mon.0) 1858 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:43.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:42.241727+0000 mon.smithi008 (mon.0) 1859 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:43.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:42.243709+0000 mon.smithi008 (mon.0) 1860 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:43.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:42.245729+0000 mgr.smithi008.flmjzp (mgr.14640) 1377 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:43.555 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:42.193089+0000 mgr.smithi008.flmjzp (mgr.14640) 1373 : cluster [DBG] pgmap v957: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:43.555 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:42.219089+0000 mon.smithi008 (mon.0) 1852 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:43.555 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:42.221294+0000 mon.smithi008 (mon.0) 1853 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:43.556 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:42.222527+0000 mon.smithi008 (mon.0) 1854 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:43.556 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:42.223528+0000 mgr.smithi008.flmjzp (mgr.14640) 1374 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:43.556 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:42.224076+0000 mgr.smithi008.flmjzp (mgr.14640) 1375 : cluster [DBG] pgmap v958: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:43.556 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:42.224333+0000 mgr.smithi008.flmjzp (mgr.14640) 1376 : cluster [DBG] pgmap v959: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:43.556 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:42.228838+0000 mon.smithi008 (mon.0) 1855 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:43.557 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:42.235189+0000 mon.smithi008 (mon.0) 1856 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:43.557 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:42.238355+0000 mon.smithi008 (mon.0) 1857 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:43.557 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:42.240071+0000 mon.smithi008 (mon.0) 1858 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:43.557 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:42.241727+0000 mon.smithi008 (mon.0) 1859 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:43.558 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:42.243709+0000 mon.smithi008 (mon.0) 1860 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:43.558 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:42.245729+0000 mgr.smithi008.flmjzp (mgr.14640) 1377 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:44.224997+0000 mgr.smithi008.flmjzp (mgr.14640) 1378 : cluster [DBG] pgmap v960: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:45.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:44.224997+0000 mgr.smithi008.flmjzp (mgr.14640) 1378 : cluster [DBG] pgmap v960: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:46.225509+0000 mgr.smithi008.flmjzp (mgr.14640) 1379 : cluster [DBG] pgmap v961: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:47.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:46.225509+0000 mgr.smithi008.flmjzp (mgr.14640) 1379 : cluster [DBG] pgmap v961: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:48.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.095+0000 7f8c371c1700 1 -- 172.21.15.8:0/1850408432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c300f77d0 msgr2=0x7f8c300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:48.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.095+0000 7f8c371c1700 1 --2- 172.21.15.8:0/1850408432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c300f77d0 0x7f8c300f7c30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f8c20004660 tx=0x7f8c20009b30).stop 2023-10-18T21:21:48.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.095+0000 7f8c371c1700 1 -- 172.21.15.8:0/1850408432 shutdown_connections 2023-10-18T21:21:48.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.095+0000 7f8c371c1700 1 --2- 172.21.15.8:0/1850408432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c300f77d0 0x7f8c300f7c30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.095+0000 7f8c371c1700 1 --2- 172.21.15.8:0/1850408432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c300f6530 0x7f8c300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.095+0000 7f8c371c1700 1 -- 172.21.15.8:0/1850408432 >> 172.21.15.8:0/1850408432 conn(0x7f8c300f1c90 msgr2=0x7f8c300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:48.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.095+0000 7f8c371c1700 1 -- 172.21.15.8:0/1850408432 shutdown_connections 2023-10-18T21:21:48.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.095+0000 7f8c371c1700 1 -- 172.21.15.8:0/1850408432 wait complete. 2023-10-18T21:21:48.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.096+0000 7f8c371c1700 1 Processor -- start 2023-10-18T21:21:48.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.097+0000 7f8c371c1700 1 -- start start 2023-10-18T21:21:48.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.097+0000 7f8c371c1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c300f6530 0x7f8c30108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:48.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.097+0000 7f8c371c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c300f77d0 0x7f8c30109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:48.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.097+0000 7f8c371c1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30109a20 con 0x7f8c300f77d0 2023-10-18T21:21:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.097+0000 7f8c371c1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30109b60 con 0x7f8c300f6530 2023-10-18T21:21:48.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.097+0000 7f8c359be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c300f77d0 0x7f8c30109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.097+0000 7f8c359be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c300f77d0 0x7f8c30109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38330/0 (socket says 172.21.15.8:38330) 2023-10-18T21:21:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.097+0000 7f8c359be700 1 -- 172.21.15.8:0/1975973363 learned_addr learned my addr 172.21.15.8:0/1975973363 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.097+0000 7f8c361bf700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c300f6530 0x7f8c30108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.098+0000 7f8c359be700 1 -- 172.21.15.8:0/1975973363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c300f6530 msgr2=0x7f8c30108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:48.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.098+0000 7f8c359be700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c300f6530 0x7f8c30108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.098+0000 7f8c359be700 1 -- 172.21.15.8:0/1975973363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20005040 con 0x7f8c300f77d0 2023-10-18T21:21:48.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.098+0000 7f8c359be700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c300f77d0 0x7f8c30109470 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f8c20009990 tx=0x7f8c20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:48.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.098+0000 7f8c26ffd700 1 -- 172.21.15.8:0/1975973363 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c20018070 con 0x7f8c300f77d0 2023-10-18T21:21:48.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.098+0000 7f8c26ffd700 1 -- 172.21.15.8:0/1975973363 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8c20009630 con 0x7f8c300f77d0 2023-10-18T21:21:48.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.098+0000 7f8c371c1700 1 -- 172.21.15.8:0/1975973363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3010a4a0 con 0x7f8c300f77d0 2023-10-18T21:21:48.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.098+0000 7f8c26ffd700 1 -- 172.21.15.8:0/1975973363 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c2001c3c0 con 0x7f8c300f77d0 2023-10-18T21:21:48.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.098+0000 7f8c371c1700 1 -- 172.21.15.8:0/1975973363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3010aa00 con 0x7f8c300f77d0 2023-10-18T21:21:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.100+0000 7f8c371c1700 1 -- 172.21.15.8:0/1975973363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c30045ad0 con 0x7f8c300f77d0 2023-10-18T21:21:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.101+0000 7f8c26ffd700 1 -- 172.21.15.8:0/1975973363 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8c2001d970 con 0x7f8c300f77d0 2023-10-18T21:21:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.101+0000 7f8c26ffd700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c1c060f70 0x7f8c1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:48.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.101+0000 7f8c26ffd700 1 -- 172.21.15.8:0/1975973363 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8c2007e4e0 con 0x7f8c300f77d0 2023-10-18T21:21:48.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.102+0000 7f8c361bf700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c1c060f70 0x7f8c1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:48.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.102+0000 7f8c361bf700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c1c060f70 0x7f8c1c063430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f8c300f7630 tx=0x7f8c2c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:48.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.106+0000 7f8c26ffd700 1 -- 172.21.15.8:0/1975973363 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8c20051a60 con 0x7f8c300f77d0 2023-10-18T21:21:48.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.303+0000 7f8c371c1700 1 -- 172.21.15.8:0/1975973363 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c300fee00 con 0x7f8c1c060f70 2023-10-18T21:21:48.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.304+0000 7f8c26ffd700 1 -- 172.21.15.8:0/1975973363 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8c300fee00 con 0x7f8c1c060f70 2023-10-18T21:21:48.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.306+0000 7f8c371c1700 1 -- 172.21.15.8:0/1975973363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c1c060f70 msgr2=0x7f8c1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:48.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.306+0000 7f8c371c1700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c1c060f70 0x7f8c1c063430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f8c300f7630 tx=0x7f8c2c00b040).stop 2023-10-18T21:21:48.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.307+0000 7f8c371c1700 1 -- 172.21.15.8:0/1975973363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c300f77d0 msgr2=0x7f8c30109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:48.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.307+0000 7f8c371c1700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c300f77d0 0x7f8c30109470 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f8c20009990 tx=0x7f8c20009b30).stop 2023-10-18T21:21:48.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.307+0000 7f8c371c1700 1 -- 172.21.15.8:0/1975973363 shutdown_connections 2023-10-18T21:21:48.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.307+0000 7f8c371c1700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c1c060f70 0x7f8c1c063430 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.307+0000 7f8c371c1700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c300f6530 0x7f8c30108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.307+0000 7f8c371c1700 1 --2- 172.21.15.8:0/1975973363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c300f77d0 0x7f8c30109470 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.307+0000 7f8c371c1700 1 -- 172.21.15.8:0/1975973363 >> 172.21.15.8:0/1975973363 conn(0x7f8c300f1c90 msgr2=0x7f8c3006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:48.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.307+0000 7f8c371c1700 1 -- 172.21.15.8:0/1975973363 shutdown_connections 2023-10-18T21:21:48.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.307+0000 7f8c371c1700 1 -- 172.21.15.8:0/1975973363 wait complete. 2023-10-18T21:21:48.323 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:21:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.444+0000 7fa9952d1700 1 -- 172.21.15.8:0/3567063290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9900602b0 msgr2=0x7fa9900f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.444+0000 7fa9952d1700 1 --2- 172.21.15.8:0/3567063290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9900602b0 0x7fa9900f9170 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fa980004660 tx=0x7fa980009b30).stop 2023-10-18T21:21:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.445+0000 7fa9952d1700 1 -- 172.21.15.8:0/3567063290 shutdown_connections 2023-10-18T21:21:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.445+0000 7fa9952d1700 1 --2- 172.21.15.8:0/3567063290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9900f96f0 0x7fa9900fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.445+0000 7fa9952d1700 1 --2- 172.21.15.8:0/3567063290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9900602b0 0x7fa9900f9170 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.445+0000 7fa9952d1700 1 -- 172.21.15.8:0/3567063290 >> 172.21.15.8:0/3567063290 conn(0x7fa9900f0b90 msgr2=0x7fa9900f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:48.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.445+0000 7fa9952d1700 1 -- 172.21.15.8:0/3567063290 shutdown_connections 2023-10-18T21:21:48.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.445+0000 7fa9952d1700 1 -- 172.21.15.8:0/3567063290 wait complete. 2023-10-18T21:21:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.446+0000 7fa9952d1700 1 Processor -- start 2023-10-18T21:21:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.446+0000 7fa9952d1700 1 -- start start 2023-10-18T21:21:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.446+0000 7fa9952d1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9900602b0 0x7fa990106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.446+0000 7fa9952d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9900f96f0 0x7fa990107260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.446+0000 7fa9952d1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa990107860 con 0x7fa9900602b0 2023-10-18T21:21:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.446+0000 7fa9952d1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa990108070 con 0x7fa9900f96f0 2023-10-18T21:21:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.446+0000 7fa98ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9900602b0 0x7fa990106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.446+0000 7fa98ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9900602b0 0x7fa990106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38348/0 (socket says 172.21.15.8:38348) 2023-10-18T21:21:48.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.446+0000 7fa98ffff700 1 -- 172.21.15.8:0/2188961450 learned_addr learned my addr 172.21.15.8:0/2188961450 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:48.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa98f7fe700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9900f96f0 0x7fa990107260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:48.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa98ffff700 1 -- 172.21.15.8:0/2188961450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9900f96f0 msgr2=0x7fa990107260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:48.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa98ffff700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9900f96f0 0x7fa990107260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa98ffff700 1 -- 172.21.15.8:0/2188961450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980005040 con 0x7fa9900602b0 2023-10-18T21:21:48.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa98f7fe700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9900f96f0 0x7fa990107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:21:48.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa98ffff700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9900602b0 0x7fa990106d70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fa980004320 tx=0x7fa98000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:48.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa98cff9700 1 -- 172.21.15.8:0/2188961450 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa980019070 con 0x7fa9900602b0 2023-10-18T21:21:48.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa98cff9700 1 -- 172.21.15.8:0/2188961450 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa98001e420 con 0x7fa9900602b0 2023-10-18T21:21:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa9952d1700 1 -- 172.21.15.8:0/2188961450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa990108290 con 0x7fa9900602b0 2023-10-18T21:21:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa98cff9700 1 -- 172.21.15.8:0/2188961450 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa980014660 con 0x7fa9900602b0 2023-10-18T21:21:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.447+0000 7fa9952d1700 1 -- 172.21.15.8:0/2188961450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa990108770 con 0x7fa9900602b0 2023-10-18T21:21:48.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.449+0000 7fa9952d1700 1 -- 172.21.15.8:0/2188961450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa990059100 con 0x7fa9900602b0 2023-10-18T21:21:48.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.450+0000 7fa98cff9700 1 -- 172.21.15.8:0/2188961450 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa98001e590 con 0x7fa9900602b0 2023-10-18T21:21:48.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.450+0000 7fa98cff9700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa978060f70 0x7fa978063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:48.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.450+0000 7fa98cff9700 1 -- 172.21.15.8:0/2188961450 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa98007dec0 con 0x7fa9900602b0 2023-10-18T21:21:48.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.451+0000 7fa98f7fe700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa978060f70 0x7fa978063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:48.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.451+0000 7fa98f7fe700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa978060f70 0x7fa978063430 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fa984009da0 tx=0x7fa98400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:48.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.454+0000 7fa98cff9700 1 -- 172.21.15.8:0/2188961450 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa98004da10 con 0x7fa9900602b0 2023-10-18T21:21:48.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.653+0000 7fa9952d1700 1 -- 172.21.15.8:0/2188961450 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9900fedf0 con 0x7fa978060f70 2023-10-18T21:21:48.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.654+0000 7fa98cff9700 1 -- 172.21.15.8:0/2188961450 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa9900fedf0 con 0x7fa978060f70 2023-10-18T21:21:48.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.657+0000 7fa9952d1700 1 -- 172.21.15.8:0/2188961450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa978060f70 msgr2=0x7fa978063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:48.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.657+0000 7fa9952d1700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa978060f70 0x7fa978063430 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fa984009da0 tx=0x7fa98400b040).stop 2023-10-18T21:21:48.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.657+0000 7fa9952d1700 1 -- 172.21.15.8:0/2188961450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9900602b0 msgr2=0x7fa990106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:48.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.657+0000 7fa9952d1700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9900602b0 0x7fa990106d70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fa980004320 tx=0x7fa98000b040).stop 2023-10-18T21:21:48.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.657+0000 7fa9952d1700 1 -- 172.21.15.8:0/2188961450 shutdown_connections 2023-10-18T21:21:48.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.657+0000 7fa9952d1700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa978060f70 0x7fa978063430 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.657+0000 7fa9952d1700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9900602b0 0x7fa990106d70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.657+0000 7fa9952d1700 1 --2- 172.21.15.8:0/2188961450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9900f96f0 0x7fa990107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.657+0000 7fa9952d1700 1 -- 172.21.15.8:0/2188961450 >> 172.21.15.8:0/2188961450 conn(0x7fa9900f0b90 msgr2=0x7fa9900f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:48.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.657+0000 7fa9952d1700 1 -- 172.21.15.8:0/2188961450 shutdown_connections 2023-10-18T21:21:48.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.658+0000 7fa9952d1700 1 -- 172.21.15.8:0/2188961450 wait complete. 2023-10-18T21:21:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.794+0000 7f9d3af02700 1 -- 172.21.15.8:0/311461884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d340f77d0 msgr2=0x7f9d340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.794+0000 7f9d3af02700 1 --2- 172.21.15.8:0/311461884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d340f77d0 0x7f9d340f7c30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f9d24004660 tx=0x7f9d24009b30).stop 2023-10-18T21:21:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.794+0000 7f9d3af02700 1 -- 172.21.15.8:0/311461884 shutdown_connections 2023-10-18T21:21:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.794+0000 7f9d3af02700 1 --2- 172.21.15.8:0/311461884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d340f77d0 0x7f9d340f7c30 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.794+0000 7f9d3af02700 1 --2- 172.21.15.8:0/311461884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d340f6530 0x7f9d340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.794+0000 7f9d3af02700 1 -- 172.21.15.8:0/311461884 >> 172.21.15.8:0/311461884 conn(0x7f9d340f1c90 msgr2=0x7f9d340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.794+0000 7f9d3af02700 1 -- 172.21.15.8:0/311461884 shutdown_connections 2023-10-18T21:21:48.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.794+0000 7f9d3af02700 1 -- 172.21.15.8:0/311461884 wait complete. 2023-10-18T21:21:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.795+0000 7f9d3af02700 1 Processor -- start 2023-10-18T21:21:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.795+0000 7f9d3af02700 1 -- start start 2023-10-18T21:21:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.795+0000 7f9d3af02700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d340f6530 0x7f9d34106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.795+0000 7f9d3af02700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d340f77d0 0x7f9d34107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.795+0000 7f9d3af02700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d34107850 con 0x7f9d340f6530 2023-10-18T21:21:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.795+0000 7f9d3af02700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d34108060 con 0x7f9d340f77d0 2023-10-18T21:21:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.795+0000 7f9d39f00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d340f6530 0x7f9d34106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.795+0000 7f9d39f00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d340f6530 0x7f9d34106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38370/0 (socket says 172.21.15.8:38370) 2023-10-18T21:21:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.795+0000 7f9d39f00700 1 -- 172.21.15.8:0/3650897051 learned_addr learned my addr 172.21.15.8:0/3650897051 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.796+0000 7f9d396ff700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d340f77d0 0x7f9d34107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:48.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.796+0000 7f9d39f00700 1 -- 172.21.15.8:0/3650897051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d340f77d0 msgr2=0x7f9d34107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:48.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.796+0000 7f9d39f00700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d340f77d0 0x7f9d34107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:48.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.796+0000 7f9d39f00700 1 -- 172.21.15.8:0/3650897051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d24005040 con 0x7f9d340f6530 2023-10-18T21:21:48.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.796+0000 7f9d39f00700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d340f6530 0x7f9d34106d60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f9d3000e7c0 tx=0x7f9d3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.796+0000 7f9d2a7fc700 1 -- 172.21.15.8:0/3650897051 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d300092e0 con 0x7f9d340f6530 2023-10-18T21:21:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.796+0000 7f9d2a7fc700 1 -- 172.21.15.8:0/3650897051 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9d3000f040 con 0x7f9d340f6530 2023-10-18T21:21:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.796+0000 7f9d3af02700 1 -- 172.21.15.8:0/3650897051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d341082e0 con 0x7f9d340f6530 2023-10-18T21:21:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.796+0000 7f9d2a7fc700 1 -- 172.21.15.8:0/3650897051 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d300147e0 con 0x7f9d340f6530 2023-10-18T21:21:48.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.797+0000 7f9d3af02700 1 -- 172.21.15.8:0/3650897051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d34108820 con 0x7f9d340f6530 2023-10-18T21:21:48.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.798+0000 7f9d3af02700 1 -- 172.21.15.8:0/3650897051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d34059100 con 0x7f9d340f6530 2023-10-18T21:21:48.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.798+0000 7f9d2a7fc700 1 -- 172.21.15.8:0/3650897051 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9d3001b030 con 0x7f9d340f6530 2023-10-18T21:21:48.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.799+0000 7f9d2a7fc700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d20060f70 0x7f9d20063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:48.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.799+0000 7f9d2a7fc700 1 -- 172.21.15.8:0/3650897051 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9d3007c9e0 con 0x7f9d340f6530 2023-10-18T21:21:48.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.800+0000 7f9d396ff700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d20060f70 0x7f9d20063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:48.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.800+0000 7f9d396ff700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d20060f70 0x7f9d20063430 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f9d24009720 tx=0x7f9d2400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:48.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:48.803+0000 7f9d2a7fc700 1 -- 172.21.15.8:0/3650897051 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9d3004c530 con 0x7f9d340f6530 2023-10-18T21:21:49.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.000+0000 7f9d3af02700 1 -- 172.21.15.8:0/3650897051 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d340fedd0 con 0x7f9d20060f70 2023-10-18T21:21:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.010+0000 7f9d2a7fc700 1 -- 172.21.15.8:0/3650897051 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9d340fedd0 con 0x7f9d20060f70 2023-10-18T21:21:49.012 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:21:49.012 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (28m) 6m ago 29m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:21:49.012 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (22m) 6m ago 29m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:21:49.012 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (22m) 4m ago 29m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:21:49.012 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (28m) 6m ago 29m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:21:49.013 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 25m - - 2023-10-18T21:21:49.013 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 25m - - 2023-10-18T21:21:49.013 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 25m - - 2023-10-18T21:21:49.013 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 25m - - 2023-10-18T21:21:49.013 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (23m) 6m ago 31m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:21:49.014 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (22m) 4m ago 29m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:21:49.014 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (22m) 6m ago 31m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:21:49.014 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (22m) 4m ago 28m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:21:49.014 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (29m) 6m ago 29m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:21:49.014 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (28m) 4m ago 28m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:21:49.015 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (22m) 6m ago 28m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:21:49.015 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (20m) 6m ago 28m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:21:49.015 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (19m) 6m ago 27m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:21:49.015 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (19m) 4m ago 27m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:21:49.015 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (18m) 4m ago 27m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:21:49.016 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (17m) 4m ago 27m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:21:49.016 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (24m) 6m ago 29m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:21:49.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 -- 172.21.15.8:0/3650897051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d20060f70 msgr2=0x7f9d20063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d20060f70 0x7f9d20063430 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f9d24009720 tx=0x7f9d2400b040).stop 2023-10-18T21:21:49.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 -- 172.21.15.8:0/3650897051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d340f6530 msgr2=0x7f9d34106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d340f6530 0x7f9d34106d60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f9d3000e7c0 tx=0x7f9d3000b040).stop 2023-10-18T21:21:49.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 -- 172.21.15.8:0/3650897051 shutdown_connections 2023-10-18T21:21:49.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d20060f70 0x7f9d20063430 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d340f6530 0x7f9d34106d60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 --2- 172.21.15.8:0/3650897051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d340f77d0 0x7f9d34107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 -- 172.21.15.8:0/3650897051 >> 172.21.15.8:0/3650897051 conn(0x7f9d340f1c90 msgr2=0x7f9d340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:49.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 -- 172.21.15.8:0/3650897051 shutdown_connections 2023-10-18T21:21:49.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.012+0000 7f9d3af02700 1 -- 172.21.15.8:0/3650897051 wait complete. 2023-10-18T21:21:49.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.147+0000 7f0df4e59700 1 -- 172.21.15.8:0/1007597224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0df00f77d0 msgr2=0x7f0df00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.147+0000 7f0df4e59700 1 --2- 172.21.15.8:0/1007597224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0df00f77d0 0x7f0df00f7c30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f0de4004660 tx=0x7f0de4009b30).stop 2023-10-18T21:21:49.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.147+0000 7f0df4e59700 1 -- 172.21.15.8:0/1007597224 shutdown_connections 2023-10-18T21:21:49.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.147+0000 7f0df4e59700 1 --2- 172.21.15.8:0/1007597224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0df00f77d0 0x7f0df00f7c30 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.147+0000 7f0df4e59700 1 --2- 172.21.15.8:0/1007597224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0df00f6530 0x7f0df00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.147+0000 7f0df4e59700 1 -- 172.21.15.8:0/1007597224 >> 172.21.15.8:0/1007597224 conn(0x7f0df00f1c90 msgr2=0x7f0df00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.147+0000 7f0df4e59700 1 -- 172.21.15.8:0/1007597224 shutdown_connections 2023-10-18T21:21:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.147+0000 7f0df4e59700 1 -- 172.21.15.8:0/1007597224 wait complete. 2023-10-18T21:21:49.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.148+0000 7f0df4e59700 1 Processor -- start 2023-10-18T21:21:49.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.149+0000 7f0df4e59700 1 -- start start 2023-10-18T21:21:49.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.149+0000 7f0df4e59700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0df00f6530 0x7f0df0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:49.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.149+0000 7f0df4e59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0df00f77d0 0x7f0df0107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:49.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.149+0000 7f0df4e59700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0107850 con 0x7f0df00f6530 2023-10-18T21:21:49.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.149+0000 7f0df4e59700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0108060 con 0x7f0df00f77d0 2023-10-18T21:21:49.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.149+0000 7f0def7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0df00f6530 0x7f0df0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:49.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.149+0000 7f0def7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0df00f6530 0x7f0df0106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38376/0 (socket says 172.21.15.8:38376) 2023-10-18T21:21:49.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.149+0000 7f0def7fe700 1 -- 172.21.15.8:0/3327975024 learned_addr learned my addr 172.21.15.8:0/3327975024 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:49.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.150+0000 7f0def7fe700 1 -- 172.21.15.8:0/3327975024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0df00f77d0 msgr2=0x7f0df0107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.150+0000 7f0def7fe700 1 --2- 172.21.15.8:0/3327975024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0df00f77d0 0x7f0df0107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:21:49.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.150+0000 7f0def7fe700 1 -- 172.21.15.8:0/3327975024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de4005040 con 0x7f0df00f6530 2023-10-18T21:21:49.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.150+0000 7f0def7fe700 1 --2- 172.21.15.8:0/3327975024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0df00f6530 0x7f0df0106d60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f0de000e7c0 tx=0x7f0de000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:49.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.150+0000 7f0dd7fff700 1 -- 172.21.15.8:0/3327975024 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de00092e0 con 0x7f0df00f6530 2023-10-18T21:21:49.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.150+0000 7f0dd7fff700 1 -- 172.21.15.8:0/3327975024 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0de000f040 con 0x7f0df00f6530 2023-10-18T21:21:49.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.150+0000 7f0df4e59700 1 -- 172.21.15.8:0/3327975024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df01082e0 con 0x7f0df00f6530 2023-10-18T21:21:49.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.150+0000 7f0dd7fff700 1 -- 172.21.15.8:0/3327975024 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de00147e0 con 0x7f0df00f6530 2023-10-18T21:21:49.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.150+0000 7f0df4e59700 1 -- 172.21.15.8:0/3327975024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df0108820 con 0x7f0df00f6530 2023-10-18T21:21:49.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.151+0000 7f0df4e59700 1 -- 172.21.15.8:0/3327975024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df0059100 con 0x7f0df00f6530 2023-10-18T21:21:49.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.152+0000 7f0dd7fff700 1 -- 172.21.15.8:0/3327975024 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0de001b030 con 0x7f0df00f6530 2023-10-18T21:21:49.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.153+0000 7f0dd7fff700 1 --2- 172.21.15.8:0/3327975024 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0dd8060f70 0x7f0dd8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:49.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.153+0000 7f0dd7fff700 1 -- 172.21.15.8:0/3327975024 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0de007c9b0 con 0x7f0df00f6530 2023-10-18T21:21:49.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.153+0000 7f0deeffd700 1 --2- 172.21.15.8:0/3327975024 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0dd8060f70 0x7f0dd8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:49.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.154+0000 7f0deeffd700 1 --2- 172.21.15.8:0/3327975024 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0dd8060f70 0x7f0dd8063430 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f0de4004d80 tx=0x7f0de400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:49.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.157+0000 7f0dd7fff700 1 -- 172.21.15.8:0/3327975024 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0de004c620 con 0x7f0df00f6530 2023-10-18T21:21:49.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.408+0000 7f0df4e59700 1 -- 172.21.15.8:0/3327975024 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0df00fecc0 con 0x7f0df00f6530 2023-10-18T21:21:49.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.409+0000 7f0dd7fff700 1 -- 172.21.15.8:0/3327975024 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f0de0019020 con 0x7f0df00f6530 2023-10-18T21:21:49.411 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:21:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:21:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:21:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:21:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:21:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:21:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:21:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:21:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:21:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:21:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:21:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:21:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:21:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:21:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:21:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:21:49.415 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:21:49.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 -- 172.21.15.8:0/3327975024 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0dd8060f70 msgr2=0x7f0dd8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 --2- 172.21.15.8:0/3327975024 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0dd8060f70 0x7f0dd8063430 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f0de4004d80 tx=0x7f0de400b040).stop 2023-10-18T21:21:49.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 -- 172.21.15.8:0/3327975024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0df00f6530 msgr2=0x7f0df0106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 --2- 172.21.15.8:0/3327975024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0df00f6530 0x7f0df0106d60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f0de000e7c0 tx=0x7f0de000b040).stop 2023-10-18T21:21:49.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 -- 172.21.15.8:0/3327975024 shutdown_connections 2023-10-18T21:21:49.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 --2- 172.21.15.8:0/3327975024 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0dd8060f70 0x7f0dd8063430 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 --2- 172.21.15.8:0/3327975024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0df00f6530 0x7f0df0106d60 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 --2- 172.21.15.8:0/3327975024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0df00f77d0 0x7f0df0107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:21:49.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 -- 172.21.15.8:0/3327975024 >> 172.21.15.8:0/3327975024 conn(0x7f0df00f1c90 msgr2=0x7f0df00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:49.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 -- 172.21.15.8:0/3327975024 shutdown_connections 2023-10-18T21:21:49.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.411+0000 7f0df4e59700 1 -- 172.21.15.8:0/3327975024 wait complete. 2023-10-18T21:21:49.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.547+0000 7f266640c700 1 -- 172.21.15.8:0/1897990046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26600f99e0 msgr2=0x7f26600f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.547+0000 7f266640c700 1 --2- 172.21.15.8:0/1897990046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26600f99e0 0x7f26600f9e40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f2650004660 tx=0x7f2650009b30).stop 2023-10-18T21:21:49.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.547+0000 7f266640c700 1 -- 172.21.15.8:0/1897990046 shutdown_connections 2023-10-18T21:21:49.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.547+0000 7f266640c700 1 --2- 172.21.15.8:0/1897990046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26600f99e0 0x7f26600f9e40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.547+0000 7f266640c700 1 --2- 172.21.15.8:0/1897990046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26600f8740 0x7f26600f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.547+0000 7f266640c700 1 -- 172.21.15.8:0/1897990046 >> 172.21.15.8:0/1897990046 conn(0x7f26600f40e0 msgr2=0x7f26600f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:49.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.547+0000 7f266640c700 1 -- 172.21.15.8:0/1897990046 shutdown_connections 2023-10-18T21:21:49.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.547+0000 7f266640c700 1 -- 172.21.15.8:0/1897990046 wait complete. 2023-10-18T21:21:49.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.548+0000 7f266640c700 1 Processor -- start 2023-10-18T21:21:49.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.548+0000 7f266640c700 1 -- start start 2023-10-18T21:21:49.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.548+0000 7f266640c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26600f8740 0x7f2660108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:49.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.548+0000 7f266640c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26600f99e0 0x7f26601093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:49.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.548+0000 7f266640c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2660109990 con 0x7f26600f8740 2023-10-18T21:21:49.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.548+0000 7f266640c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2660109ad0 con 0x7f26600f99e0 2023-10-18T21:21:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f266540a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26600f8740 0x7f2660108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f266540a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26600f8740 0x7f2660108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38394/0 (socket says 172.21.15.8:38394) 2023-10-18T21:21:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f266540a700 1 -- 172.21.15.8:0/1973832520 learned_addr learned my addr 172.21.15.8:0/1973832520 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f2664c09700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26600f99e0 0x7f26601093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:49.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f266540a700 1 -- 172.21.15.8:0/1973832520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26600f99e0 msgr2=0x7f26601093e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f266540a700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26600f99e0 0x7f26601093e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f266540a700 1 -- 172.21.15.8:0/1973832520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2650005040 con 0x7f26600f8740 2023-10-18T21:21:49.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f266540a700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26600f8740 0x7f2660108ef0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f265c00e7c0 tx=0x7f265c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:49.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f2655ffb700 1 -- 172.21.15.8:0/1973832520 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f265c0092e0 con 0x7f26600f8740 2023-10-18T21:21:49.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f2655ffb700 1 -- 172.21.15.8:0/1973832520 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f265c00f040 con 0x7f26600f8740 2023-10-18T21:21:49.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f2655ffb700 1 -- 172.21.15.8:0/1973832520 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f265c014810 con 0x7f26600f8740 2023-10-18T21:21:49.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.549+0000 7f266640c700 1 -- 172.21.15.8:0/1973832520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266010a470 con 0x7f26600f8740 2023-10-18T21:21:49.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.550+0000 7f266640c700 1 -- 172.21.15.8:0/1973832520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266010a9b0 con 0x7f26600f8740 2023-10-18T21:21:49.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.551+0000 7f266640c700 1 -- 172.21.15.8:0/1973832520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2660045ad0 con 0x7f26600f8740 2023-10-18T21:21:49.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.551+0000 7f2655ffb700 1 -- 172.21.15.8:0/1973832520 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f265c01b030 con 0x7f26600f8740 2023-10-18T21:21:49.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.552+0000 7f2655ffb700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f264c060f70 0x7f264c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:49.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.552+0000 7f2655ffb700 1 -- 172.21.15.8:0/1973832520 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f265c07c860 con 0x7f26600f8740 2023-10-18T21:21:49.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.553+0000 7f2664c09700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f264c060f70 0x7f264c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:49.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.553+0000 7f2664c09700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f264c060f70 0x7f264c063430 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f2650005010 tx=0x7f2650016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:49.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.557+0000 7f2655ffb700 1 -- 172.21.15.8:0/1973832520 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f265c04ff00 con 0x7f26600f8740 2023-10-18T21:21:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:48.225923+0000 mgr.smithi008.flmjzp (mgr.14640) 1380 : cluster [DBG] pgmap v962: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:48.305810+0000 mgr.smithi008.flmjzp (mgr.14640) 1381 : audit [DBG] from='client.35296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:48.655907+0000 mgr.smithi008.flmjzp (mgr.14640) 1382 : audit [DBG] from='client.35300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:49.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:48.225923+0000 mgr.smithi008.flmjzp (mgr.14640) 1380 : cluster [DBG] pgmap v962: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:48.305810+0000 mgr.smithi008.flmjzp (mgr.14640) 1381 : audit [DBG] from='client.35296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:48.655907+0000 mgr.smithi008.flmjzp (mgr.14640) 1382 : audit [DBG] from='client.35300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.781+0000 7f266640c700 1 -- 172.21.15.8:0/1973832520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2660100fa0 con 0x7f26600f8740 2023-10-18T21:21:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.782+0000 7f2655ffb700 1 -- 172.21.15.8:0/1973832520 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f265c019030 con 0x7f26600f8740 2023-10-18T21:21:49.784 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:21:49.785 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:21:49.785 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:21:49.785 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:21:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:21:49.785 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:21:49.786 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:21:49.786 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:21:49.786 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:21:49.786 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:21:49.786 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:21:49.787 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:21:49.787 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:21:49.787 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:21:49.787 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:21:49.787 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:21:49.788 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:21:49.788 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:21:49.788 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:21:49.788 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:21:49.788 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:21:49.789 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:21:49.789 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:21:49.789 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:21:49.789 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:21:49.789 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:21:49.790 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:21:49.790 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:21:49.790 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:21:49.790 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:21:49.790 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:21:49.791 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:21:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:21:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:21:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 -- 172.21.15.8:0/1973832520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f264c060f70 msgr2=0x7f264c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f264c060f70 0x7f264c063430 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f2650005010 tx=0x7f2650016040).stop 2023-10-18T21:21:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 -- 172.21.15.8:0/1973832520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26600f8740 msgr2=0x7f2660108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26600f8740 0x7f2660108ef0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f265c00e7c0 tx=0x7f265c00b040).stop 2023-10-18T21:21:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 -- 172.21.15.8:0/1973832520 shutdown_connections 2023-10-18T21:21:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f264c060f70 0x7f264c063430 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26600f8740 0x7f2660108ef0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 --2- 172.21.15.8:0/1973832520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26600f99e0 0x7f26601093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 -- 172.21.15.8:0/1973832520 >> 172.21.15.8:0/1973832520 conn(0x7f26600f40e0 msgr2=0x7f26600fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:49.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 -- 172.21.15.8:0/1973832520 shutdown_connections 2023-10-18T21:21:49.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.784+0000 7f266640c700 1 -- 172.21.15.8:0/1973832520 wait complete. 2023-10-18T21:21:49.794 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:21:49.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.921+0000 7f7066ffd700 1 -- 172.21.15.8:0/1816190479 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c013b20 con 0x7f70680f77d0 2023-10-18T21:21:49.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.921+0000 7f706d1f5700 1 -- 172.21.15.8:0/1816190479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70680f77d0 msgr2=0x7f70680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.921+0000 7f706d1f5700 1 --2- 172.21.15.8:0/1816190479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70680f77d0 0x7f70680f7c30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f705c004660 tx=0x7f705c009b30).stop 2023-10-18T21:21:49.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.921+0000 7f706d1f5700 1 -- 172.21.15.8:0/1816190479 shutdown_connections 2023-10-18T21:21:49.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.921+0000 7f706d1f5700 1 --2- 172.21.15.8:0/1816190479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70680f77d0 0x7f70680f7c30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.921+0000 7f706d1f5700 1 --2- 172.21.15.8:0/1816190479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70680f6530 0x7f70680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.921+0000 7f706d1f5700 1 -- 172.21.15.8:0/1816190479 >> 172.21.15.8:0/1816190479 conn(0x7f70680f1c90 msgr2=0x7f70680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:49.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.921+0000 7f706d1f5700 1 -- 172.21.15.8:0/1816190479 shutdown_connections 2023-10-18T21:21:49.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.921+0000 7f706d1f5700 1 -- 172.21.15.8:0/1816190479 wait complete. 2023-10-18T21:21:49.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.922+0000 7f706d1f5700 1 Processor -- start 2023-10-18T21:21:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.922+0000 7f706d1f5700 1 -- start start 2023-10-18T21:21:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.923+0000 7f706d1f5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70680f6530 0x7f7068106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.923+0000 7f706d1f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70680f77d0 0x7f7068107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.923+0000 7f706d1f5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7068107830 con 0x7f70680f77d0 2023-10-18T21:21:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.923+0000 7f706d1f5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7068108040 con 0x7f70680f6530 2023-10-18T21:21:49.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.923+0000 7f70677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70680f77d0 0x7f7068107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:49.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.923+0000 7f7067fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70680f6530 0x7f7068106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:49.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.923+0000 7f70677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70680f77d0 0x7f7068107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38416/0 (socket says 172.21.15.8:38416) 2023-10-18T21:21:49.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.923+0000 7f70677fe700 1 -- 172.21.15.8:0/1065782195 learned_addr learned my addr 172.21.15.8:0/1065782195 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:21:49.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.924+0000 7f70677fe700 1 -- 172.21.15.8:0/1065782195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70680f6530 msgr2=0x7f7068106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:49.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.924+0000 7f70677fe700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70680f6530 0x7f7068106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:49.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.924+0000 7f70677fe700 1 -- 172.21.15.8:0/1065782195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c005040 con 0x7f70680f77d0 2023-10-18T21:21:49.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.924+0000 7f7067fff700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70680f6530 0x7f7068106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:21:49.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.924+0000 7f70677fe700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70680f77d0 0x7f7068107230 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f705c009f50 tx=0x7f705c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:49.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.924+0000 7f7064ff9700 1 -- 172.21.15.8:0/1065782195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c018070 con 0x7f70680f77d0 2023-10-18T21:21:49.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.924+0000 7f706d1f5700 1 -- 172.21.15.8:0/1065782195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7068108260 con 0x7f70680f77d0 2023-10-18T21:21:49.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.924+0000 7f7064ff9700 1 -- 172.21.15.8:0/1065782195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f705c009630 con 0x7f70680f77d0 2023-10-18T21:21:49.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.924+0000 7f7064ff9700 1 -- 172.21.15.8:0/1065782195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c01c3c0 con 0x7f70680f77d0 2023-10-18T21:21:49.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.924+0000 7f706d1f5700 1 -- 172.21.15.8:0/1065782195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70681087c0 con 0x7f70680f77d0 2023-10-18T21:21:49.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.925+0000 7f706d1f5700 1 -- 172.21.15.8:0/1065782195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7068059100 con 0x7f70680f77d0 2023-10-18T21:21:49.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.926+0000 7f7064ff9700 1 -- 172.21.15.8:0/1065782195 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f705c01d420 con 0x7f70680f77d0 2023-10-18T21:21:49.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.927+0000 7f7064ff9700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7050060f70 0x7f7050063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:21:49.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.927+0000 7f7064ff9700 1 -- 172.21.15.8:0/1065782195 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f705c07e580 con 0x7f70680f77d0 2023-10-18T21:21:49.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.927+0000 7f7067fff700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7050060f70 0x7f7050063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:21:49.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.928+0000 7f7067fff700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7050060f70 0x7f7050063430 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f7068106ab0 tx=0x7f705800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:21:49.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:49.931+0000 7f7064ff9700 1 -- 172.21.15.8:0/1065782195 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f705c04e1b0 con 0x7f70680f77d0 2023-10-18T21:21:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.131+0000 7f706d1f5700 1 -- 172.21.15.8:0/1065782195 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70680fedb0 con 0x7f7050060f70 2023-10-18T21:21:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.132+0000 7f7064ff9700 1 -- 172.21.15.8:0/1065782195 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f70680fedb0 con 0x7f7050060f70 2023-10-18T21:21:50.135 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:21:50.135 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:21:50.135 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:21:50.136 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:21:50.136 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:21:50.136 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:21:50.137 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:21:50.137 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:21:50.137 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:21:50.138 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:21:50.138 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:21:50.138 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:21:50.138 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:21:50.139 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:21:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 -- 172.21.15.8:0/1065782195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7050060f70 msgr2=0x7f7050063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7050060f70 0x7f7050063430 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f7068106ab0 tx=0x7f705800b040).stop 2023-10-18T21:21:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 -- 172.21.15.8:0/1065782195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70680f77d0 msgr2=0x7f7068107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:21:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70680f77d0 0x7f7068107230 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f705c009f50 tx=0x7f705c009b30).stop 2023-10-18T21:21:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 -- 172.21.15.8:0/1065782195 shutdown_connections 2023-10-18T21:21:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7050060f70 0x7f7050063430 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70680f6530 0x7f7068106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 --2- 172.21.15.8:0/1065782195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70680f77d0 0x7f7068107230 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:21:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 -- 172.21.15.8:0/1065782195 >> 172.21.15.8:0/1065782195 conn(0x7f70680f1c90 msgr2=0x7f70680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:21:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 -- 172.21.15.8:0/1065782195 shutdown_connections 2023-10-18T21:21:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:21:50.135+0000 7f706d1f5700 1 -- 172.21.15.8:0/1065782195 wait complete. 2023-10-18T21:21:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:49.002715+0000 mgr.smithi008.flmjzp (mgr.14640) 1383 : audit [DBG] from='client.35304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:49.410418+0000 mon.smithi008 (mon.0) 1861 : audit [DBG] from='client.? 172.21.15.8:0/3327975024' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:49.783663+0000 mon.smithi008 (mon.0) 1862 : audit [DBG] from='client.? 172.21.15.8:0/1973832520' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:21:50.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:49.002715+0000 mgr.smithi008.flmjzp (mgr.14640) 1383 : audit [DBG] from='client.35304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:50.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:49.410418+0000 mon.smithi008 (mon.0) 1861 : audit [DBG] from='client.? 172.21.15.8:0/3327975024' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:49.783663+0000 mon.smithi008 (mon.0) 1862 : audit [DBG] from='client.? 172.21.15.8:0/1973832520' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:21:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:50.133902+0000 mgr.smithi008.flmjzp (mgr.14640) 1384 : audit [DBG] from='client.35316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:50.226342+0000 mgr.smithi008.flmjzp (mgr.14640) 1385 : cluster [DBG] pgmap v963: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:50.133902+0000 mgr.smithi008.flmjzp (mgr.14640) 1384 : audit [DBG] from='client.35316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:21:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:50.226342+0000 mgr.smithi008.flmjzp (mgr.14640) 1385 : cluster [DBG] pgmap v963: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:52.256380+0000 mon.smithi008 (mon.0) 1863 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:52.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:52.256380+0000 mon.smithi008 (mon.0) 1863 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:52.226810+0000 mgr.smithi008.flmjzp (mgr.14640) 1386 : cluster [DBG] pgmap v964: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:52.610371+0000 mon.smithi008 (mon.0) 1864 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:52.611368+0000 mon.smithi008 (mon.0) 1865 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:53.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:52.612165+0000 mon.smithi008 (mon.0) 1866 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:53.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:52.612889+0000 mgr.smithi008.flmjzp (mgr.14640) 1387 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:53.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:52.613461+0000 mgr.smithi008.flmjzp (mgr.14640) 1388 : cluster [DBG] pgmap v965: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:53.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:52.613711+0000 mgr.smithi008.flmjzp (mgr.14640) 1389 : cluster [DBG] pgmap v966: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:53.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:52.617849+0000 mon.smithi008 (mon.0) 1867 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:53.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:52.622848+0000 mon.smithi008 (mon.0) 1868 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:53.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:52.625280+0000 mon.smithi008 (mon.0) 1869 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:53.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:52.626557+0000 mon.smithi008 (mon.0) 1870 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:53.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:52.628061+0000 mon.smithi008 (mon.0) 1871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:53.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:21:52.629686+0000 mon.smithi008 (mon.0) 1872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:53.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:21:52.631258+0000 mgr.smithi008.flmjzp (mgr.14640) 1390 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:53.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:52.226810+0000 mgr.smithi008.flmjzp (mgr.14640) 1386 : cluster [DBG] pgmap v964: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:52.610371+0000 mon.smithi008 (mon.0) 1864 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:52.611368+0000 mon.smithi008 (mon.0) 1865 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:21:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:52.612165+0000 mon.smithi008 (mon.0) 1866 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:21:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:52.612889+0000 mgr.smithi008.flmjzp (mgr.14640) 1387 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:21:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:52.613461+0000 mgr.smithi008.flmjzp (mgr.14640) 1388 : cluster [DBG] pgmap v965: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:52.613711+0000 mgr.smithi008.flmjzp (mgr.14640) 1389 : cluster [DBG] pgmap v966: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:52.617849+0000 mon.smithi008 (mon.0) 1867 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:21:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:52.622848+0000 mon.smithi008 (mon.0) 1868 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:21:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:52.625280+0000 mon.smithi008 (mon.0) 1869 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:53.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:52.626557+0000 mon.smithi008 (mon.0) 1870 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:53.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:52.628061+0000 mon.smithi008 (mon.0) 1871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:53.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:21:52.629686+0000 mon.smithi008 (mon.0) 1872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:21:53.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:21:52.631258+0000 mgr.smithi008.flmjzp (mgr.14640) 1390 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:21:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:54.614367+0000 mgr.smithi008.flmjzp (mgr.14640) 1391 : cluster [DBG] pgmap v967: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:55.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:54.614367+0000 mgr.smithi008.flmjzp (mgr.14640) 1391 : cluster [DBG] pgmap v967: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:57.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:56.614968+0000 mgr.smithi008.flmjzp (mgr.14640) 1392 : cluster [DBG] pgmap v968: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:58.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:56.614968+0000 mgr.smithi008.flmjzp (mgr.14640) 1392 : cluster [DBG] pgmap v968: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:21:59.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:21:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:21:58.615641+0000 mgr.smithi008.flmjzp (mgr.14640) 1393 : cluster [DBG] pgmap v969: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:00.144 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:21:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:21:58.615641+0000 mgr.smithi008.flmjzp (mgr.14640) 1393 : cluster [DBG] pgmap v969: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:00.616239+0000 mgr.smithi008.flmjzp (mgr.14640) 1394 : cluster [DBG] pgmap v970: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:00.616239+0000 mgr.smithi008.flmjzp (mgr.14640) 1394 : cluster [DBG] pgmap v970: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:02.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:02.641550+0000 mon.smithi008 (mon.0) 1873 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:03.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:02.641550+0000 mon.smithi008 (mon.0) 1873 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:02.616846+0000 mgr.smithi008.flmjzp (mgr.14640) 1395 : cluster [DBG] pgmap v971: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:03.200353+0000 mon.smithi008 (mon.0) 1874 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:03.201235+0000 mon.smithi008 (mon.0) 1875 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:03.206695+0000 mon.smithi008 (mon.0) 1876 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:03.211635+0000 mon.smithi008 (mon.0) 1877 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:03.214011+0000 mon.smithi008 (mon.0) 1878 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:03.215268+0000 mon.smithi008 (mon.0) 1879 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:03.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:03.216536+0000 mon.smithi008 (mon.0) 1880 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:03.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:03.218035+0000 mon.smithi008 (mon.0) 1881 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:03.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:02.616846+0000 mgr.smithi008.flmjzp (mgr.14640) 1395 : cluster [DBG] pgmap v971: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:03.200353+0000 mon.smithi008 (mon.0) 1874 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:03.201235+0000 mon.smithi008 (mon.0) 1875 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:03.206695+0000 mon.smithi008 (mon.0) 1876 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:03.211635+0000 mon.smithi008 (mon.0) 1877 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:03.214011+0000 mon.smithi008 (mon.0) 1878 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:03.215268+0000 mon.smithi008 (mon.0) 1879 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:03.216536+0000 mon.smithi008 (mon.0) 1880 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:03.218035+0000 mon.smithi008 (mon.0) 1881 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:04.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:03.201863+0000 mgr.smithi008.flmjzp (mgr.14640) 1396 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:03.202324+0000 mgr.smithi008.flmjzp (mgr.14640) 1397 : cluster [DBG] pgmap v972: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:03.202528+0000 mgr.smithi008.flmjzp (mgr.14640) 1398 : cluster [DBG] pgmap v973: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:03.219523+0000 mgr.smithi008.flmjzp (mgr.14640) 1399 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:05.139 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:03.201863+0000 mgr.smithi008.flmjzp (mgr.14640) 1396 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:05.139 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:03.202324+0000 mgr.smithi008.flmjzp (mgr.14640) 1397 : cluster [DBG] pgmap v972: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:05.139 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:03.202528+0000 mgr.smithi008.flmjzp (mgr.14640) 1398 : cluster [DBG] pgmap v973: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:05.140 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:03.219523+0000 mgr.smithi008.flmjzp (mgr.14640) 1399 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:06.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:05.203215+0000 mgr.smithi008.flmjzp (mgr.14640) 1400 : cluster [DBG] pgmap v974: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:07.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:05.203215+0000 mgr.smithi008.flmjzp (mgr.14640) 1400 : cluster [DBG] pgmap v974: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:08.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:07.203758+0000 mgr.smithi008.flmjzp (mgr.14640) 1401 : cluster [DBG] pgmap v975: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:09.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:07.203758+0000 mgr.smithi008.flmjzp (mgr.14640) 1401 : cluster [DBG] pgmap v975: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:10.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:09.204236+0000 mgr.smithi008.flmjzp (mgr.14640) 1402 : cluster [DBG] pgmap v976: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:09.204236+0000 mgr.smithi008.flmjzp (mgr.14640) 1402 : cluster [DBG] pgmap v976: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:12.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:11.204914+0000 mgr.smithi008.flmjzp (mgr.14640) 1403 : cluster [DBG] pgmap v977: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:11.204914+0000 mgr.smithi008.flmjzp (mgr.14640) 1403 : cluster [DBG] pgmap v977: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:13.227894+0000 mon.smithi008 (mon.0) 1882 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:13.230093+0000 mon.smithi008 (mon.0) 1883 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:13.231158+0000 mon.smithi008 (mon.0) 1884 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:13.237942+0000 mon.smithi008 (mon.0) 1885 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:13.244384+0000 mon.smithi008 (mon.0) 1886 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:13.247382+0000 mon.smithi008 (mon.0) 1887 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:13.249010+0000 mon.smithi008 (mon.0) 1888 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:13.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:13.250590+0000 mon.smithi008 (mon.0) 1889 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:13.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:13.252550+0000 mon.smithi008 (mon.0) 1890 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:13.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:13.227894+0000 mon.smithi008 (mon.0) 1882 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:13.230093+0000 mon.smithi008 (mon.0) 1883 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:13.231158+0000 mon.smithi008 (mon.0) 1884 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:13.237942+0000 mon.smithi008 (mon.0) 1885 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:13.244384+0000 mon.smithi008 (mon.0) 1886 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:13.247382+0000 mon.smithi008 (mon.0) 1887 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:13.249010+0000 mon.smithi008 (mon.0) 1888 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:13.250590+0000 mon.smithi008 (mon.0) 1889 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:13.252550+0000 mon.smithi008 (mon.0) 1890 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:13.205443+0000 mgr.smithi008.flmjzp (mgr.14640) 1404 : cluster [DBG] pgmap v978: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:13.232052+0000 mgr.smithi008.flmjzp (mgr.14640) 1405 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:13.232641+0000 mgr.smithi008.flmjzp (mgr.14640) 1406 : cluster [DBG] pgmap v979: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:13.232926+0000 mgr.smithi008.flmjzp (mgr.14640) 1407 : cluster [DBG] pgmap v980: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:13.254364+0000 mgr.smithi008.flmjzp (mgr.14640) 1408 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:15.139 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:13.205443+0000 mgr.smithi008.flmjzp (mgr.14640) 1404 : cluster [DBG] pgmap v978: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:15.139 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:13.232052+0000 mgr.smithi008.flmjzp (mgr.14640) 1405 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:15.140 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:13.232641+0000 mgr.smithi008.flmjzp (mgr.14640) 1406 : cluster [DBG] pgmap v979: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:15.140 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:13.232926+0000 mgr.smithi008.flmjzp (mgr.14640) 1407 : cluster [DBG] pgmap v980: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:15.140 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:13.254364+0000 mgr.smithi008.flmjzp (mgr.14640) 1408 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:16.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:15.233675+0000 mgr.smithi008.flmjzp (mgr.14640) 1409 : cluster [DBG] pgmap v981: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:15.233675+0000 mgr.smithi008.flmjzp (mgr.14640) 1409 : cluster [DBG] pgmap v981: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:17.234219+0000 mgr.smithi008.flmjzp (mgr.14640) 1410 : cluster [DBG] pgmap v982: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:18.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:17.234219+0000 mgr.smithi008.flmjzp (mgr.14640) 1410 : cluster [DBG] pgmap v982: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.289+0000 7f9c931eb700 1 -- 172.21.15.8:0/1893241221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c8c0f6530 msgr2=0x7f9c8c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.289+0000 7f9c931eb700 1 --2- 172.21.15.8:0/1893241221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c8c0f6530 0x7f9c8c0f6950 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f9c88004660 tx=0x7f9c88009b30).stop 2023-10-18T21:22:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.289+0000 7f9c931eb700 1 -- 172.21.15.8:0/1893241221 shutdown_connections 2023-10-18T21:22:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.289+0000 7f9c931eb700 1 --2- 172.21.15.8:0/1893241221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c8c0f77d0 0x7f9c8c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.289+0000 7f9c931eb700 1 --2- 172.21.15.8:0/1893241221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c8c0f6530 0x7f9c8c0f6950 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.289+0000 7f9c931eb700 1 -- 172.21.15.8:0/1893241221 >> 172.21.15.8:0/1893241221 conn(0x7f9c8c0f1c90 msgr2=0x7f9c8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:20.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.289+0000 7f9c931eb700 1 -- 172.21.15.8:0/1893241221 shutdown_connections 2023-10-18T21:22:20.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.289+0000 7f9c931eb700 1 -- 172.21.15.8:0/1893241221 wait complete. 2023-10-18T21:22:20.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.291+0000 7f9c931eb700 1 Processor -- start 2023-10-18T21:22:20.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.291+0000 7f9c931eb700 1 -- start start 2023-10-18T21:22:20.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.291+0000 7f9c931eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c8c0f6530 0x7f9c8c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:20.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.291+0000 7f9c931eb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c8c0f77d0 0x7f9c8c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:20.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.291+0000 7f9c931eb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c06a380 con 0x7f9c8c0f6530 2023-10-18T21:22:20.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.291+0000 7f9c931eb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c06a4c0 con 0x7f9c8c0f77d0 2023-10-18T21:22:20.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.292+0000 7f9c921e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c8c0f6530 0x7f9c8c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:20.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.292+0000 7f9c921e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c8c0f6530 0x7f9c8c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35704/0 (socket says 172.21.15.8:35704) 2023-10-18T21:22:20.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.292+0000 7f9c921e9700 1 -- 172.21.15.8:0/446995720 learned_addr learned my addr 172.21.15.8:0/446995720 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:20.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.292+0000 7f9c919e8700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c8c0f77d0 0x7f9c8c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:20.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.292+0000 7f9c921e9700 1 -- 172.21.15.8:0/446995720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c8c0f77d0 msgr2=0x7f9c8c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:20.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.292+0000 7f9c921e9700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c8c0f77d0 0x7f9c8c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.292+0000 7f9c921e9700 1 -- 172.21.15.8:0/446995720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88005040 con 0x7f9c8c0f6530 2023-10-18T21:22:20.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.293+0000 7f9c921e9700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c8c0f6530 0x7f9c8c06b9a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f9c88004e30 tx=0x7f9c88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:20.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.294+0000 7f9c82ffd700 1 -- 172.21.15.8:0/446995720 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c88018070 con 0x7f9c8c0f6530 2023-10-18T21:22:20.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.294+0000 7f9c82ffd700 1 -- 172.21.15.8:0/446995720 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9c88009630 con 0x7f9c8c0f6530 2023-10-18T21:22:20.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.294+0000 7f9c931eb700 1 -- 172.21.15.8:0/446995720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c06a740 con 0x7f9c8c0f6530 2023-10-18T21:22:20.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.294+0000 7f9c82ffd700 1 -- 172.21.15.8:0/446995720 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c8801c3c0 con 0x7f9c8c0f6530 2023-10-18T21:22:20.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.294+0000 7f9c931eb700 1 -- 172.21.15.8:0/446995720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c06aca0 con 0x7f9c8c0f6530 2023-10-18T21:22:20.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.295+0000 7f9c931eb700 1 -- 172.21.15.8:0/446995720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c045ad0 con 0x7f9c8c0f6530 2023-10-18T21:22:20.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.296+0000 7f9c82ffd700 1 -- 172.21.15.8:0/446995720 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9c8801d420 con 0x7f9c8c0f6530 2023-10-18T21:22:20.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.297+0000 7f9c82ffd700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c78060f70 0x7f9c78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:20.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.297+0000 7f9c82ffd700 1 -- 172.21.15.8:0/446995720 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9c8807e530 con 0x7f9c8c0f6530 2023-10-18T21:22:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.297+0000 7f9c919e8700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c78060f70 0x7f9c78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.298+0000 7f9c919e8700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c78060f70 0x7f9c78063430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f9c7c004e20 tx=0x7f9c7c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:20.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.302+0000 7f9c82ffd700 1 -- 172.21.15.8:0/446995720 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9c8804e0e0 con 0x7f9c8c0f6530 2023-10-18T21:22:20.419 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:19.234985+0000 mgr.smithi008.flmjzp (mgr.14640) 1411 : cluster [DBG] pgmap v983: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.500+0000 7f9c931eb700 1 -- 172.21.15.8:0/446995720 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c8c0fee40 con 0x7f9c78060f70 2023-10-18T21:22:20.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.502+0000 7f9c82ffd700 1 -- 172.21.15.8:0/446995720 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9c8c0fee40 con 0x7f9c78060f70 2023-10-18T21:22:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 -- 172.21.15.8:0/446995720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c78060f70 msgr2=0x7f9c78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c78060f70 0x7f9c78063430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f9c7c004e20 tx=0x7f9c7c00b040).stop 2023-10-18T21:22:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 -- 172.21.15.8:0/446995720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c8c0f6530 msgr2=0x7f9c8c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c8c0f6530 0x7f9c8c06b9a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f9c88004e30 tx=0x7f9c88009b30).stop 2023-10-18T21:22:20.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 -- 172.21.15.8:0/446995720 shutdown_connections 2023-10-18T21:22:20.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c78060f70 0x7f9c78063430 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c8c0f6530 0x7f9c8c06b9a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 --2- 172.21.15.8:0/446995720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c8c0f77d0 0x7f9c8c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 -- 172.21.15.8:0/446995720 >> 172.21.15.8:0/446995720 conn(0x7f9c8c0f1c90 msgr2=0x7f9c8c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:20.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 -- 172.21.15.8:0/446995720 shutdown_connections 2023-10-18T21:22:20.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.504+0000 7f9c931eb700 1 -- 172.21.15.8:0/446995720 wait complete. 2023-10-18T21:22:20.521 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:22:20.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.643+0000 7fe0e3fff700 1 -- 172.21.15.8:0/2884798224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e40f77d0 msgr2=0x7fe0e40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:20.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.643+0000 7fe0e3fff700 1 --2- 172.21.15.8:0/2884798224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e40f77d0 0x7fe0e40f7c30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fe0d8004660 tx=0x7fe0d8009b30).stop 2023-10-18T21:22:20.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.643+0000 7fe0e3fff700 1 -- 172.21.15.8:0/2884798224 shutdown_connections 2023-10-18T21:22:20.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.643+0000 7fe0e3fff700 1 --2- 172.21.15.8:0/2884798224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e40f77d0 0x7fe0e40f7c30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.643+0000 7fe0e3fff700 1 --2- 172.21.15.8:0/2884798224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e40f6530 0x7fe0e40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.643+0000 7fe0e3fff700 1 -- 172.21.15.8:0/2884798224 >> 172.21.15.8:0/2884798224 conn(0x7fe0e40f1c90 msgr2=0x7fe0e40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:20.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.643+0000 7fe0e3fff700 1 -- 172.21.15.8:0/2884798224 shutdown_connections 2023-10-18T21:22:20.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.643+0000 7fe0e3fff700 1 -- 172.21.15.8:0/2884798224 wait complete. 2023-10-18T21:22:20.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.644+0000 7fe0e3fff700 1 Processor -- start 2023-10-18T21:22:20.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.644+0000 7fe0e3fff700 1 -- start start 2023-10-18T21:22:20.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.644+0000 7fe0e3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e40f6530 0x7fe0e40ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:20.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.644+0000 7fe0e3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e40f77d0 0x7fe0e40ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:20.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.644+0000 7fe0e3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4100440 con 0x7fe0e40f6530 2023-10-18T21:22:20.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.644+0000 7fe0e3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4100580 con 0x7fe0e40f77d0 2023-10-18T21:22:20.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e40f6530 0x7fe0e40ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:20.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e40f6530 0x7fe0e40ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35724/0 (socket says 172.21.15.8:35724) 2023-10-18T21:22:20.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0e2ffd700 1 -- 172.21.15.8:0/529061959 learned_addr learned my addr 172.21.15.8:0/529061959 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:20.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0e27fc700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e40f77d0 0x7fe0e40ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:20.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0e2ffd700 1 -- 172.21.15.8:0/529061959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e40f77d0 msgr2=0x7fe0e40ffe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:20.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0e2ffd700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e40f77d0 0x7fe0e40ffe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0e2ffd700 1 -- 172.21.15.8:0/529061959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8005040 con 0x7fe0e40f6530 2023-10-18T21:22:20.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0e2ffd700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e40f6530 0x7fe0e40ff950 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fe0d400e7c0 tx=0x7fe0d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:20.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0cb7fe700 1 -- 172.21.15.8:0/529061959 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d40092e0 con 0x7fe0e40f6530 2023-10-18T21:22:20.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0cb7fe700 1 -- 172.21.15.8:0/529061959 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe0d400f040 con 0x7fe0e40f6530 2023-10-18T21:22:20.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.645+0000 7fe0e3fff700 1 -- 172.21.15.8:0/529061959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e4100ef0 con 0x7fe0e40f6530 2023-10-18T21:22:20.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.646+0000 7fe0cb7fe700 1 -- 172.21.15.8:0/529061959 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d40147e0 con 0x7fe0e40f6530 2023-10-18T21:22:20.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.646+0000 7fe0e3fff700 1 -- 172.21.15.8:0/529061959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e4101430 con 0x7fe0e40f6530 2023-10-18T21:22:20.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.647+0000 7fe0e3fff700 1 -- 172.21.15.8:0/529061959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e4045ad0 con 0x7fe0e40f6530 2023-10-18T21:22:20.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.648+0000 7fe0cb7fe700 1 -- 172.21.15.8:0/529061959 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe0d401b030 con 0x7fe0e40f6530 2023-10-18T21:22:20.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.648+0000 7fe0cb7fe700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe0cc060f70 0x7fe0cc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:20.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.649+0000 7fe0cb7fe700 1 -- 172.21.15.8:0/529061959 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe0d407ca70 con 0x7fe0e40f6530 2023-10-18T21:22:20.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.649+0000 7fe0e27fc700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe0cc060f70 0x7fe0cc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:20.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.649+0000 7fe0e27fc700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe0cc060f70 0x7fe0cc063430 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fe0d80043d0 tx=0x7fe0d800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:20.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.653+0000 7fe0cb7fe700 1 -- 172.21.15.8:0/529061959 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe0d404c620 con 0x7fe0e40f6530 2023-10-18T21:22:20.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:19.234985+0000 mgr.smithi008.flmjzp (mgr.14640) 1411 : cluster [DBG] pgmap v983: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:20.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.850+0000 7fe0e3fff700 1 -- 172.21.15.8:0/529061959 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0e40fee30 con 0x7fe0cc060f70 2023-10-18T21:22:20.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.851+0000 7fe0cb7fe700 1 -- 172.21.15.8:0/529061959 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe0e40fee30 con 0x7fe0cc060f70 2023-10-18T21:22:20.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 -- 172.21.15.8:0/529061959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe0cc060f70 msgr2=0x7fe0cc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:20.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe0cc060f70 0x7fe0cc063430 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fe0d80043d0 tx=0x7fe0d800b040).stop 2023-10-18T21:22:20.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 -- 172.21.15.8:0/529061959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e40f6530 msgr2=0x7fe0e40ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:20.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e40f6530 0x7fe0e40ff950 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fe0d400e7c0 tx=0x7fe0d400b040).stop 2023-10-18T21:22:20.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 -- 172.21.15.8:0/529061959 shutdown_connections 2023-10-18T21:22:20.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe0cc060f70 0x7fe0cc063430 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e40f6530 0x7fe0e40ff950 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 --2- 172.21.15.8:0/529061959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0e40f77d0 0x7fe0e40ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 -- 172.21.15.8:0/529061959 >> 172.21.15.8:0/529061959 conn(0x7fe0e40f1c90 msgr2=0x7fe0e406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:20.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 -- 172.21.15.8:0/529061959 shutdown_connections 2023-10-18T21:22:20.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.853+0000 7fe0e3fff700 1 -- 172.21.15.8:0/529061959 wait complete. 2023-10-18T21:22:20.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.990+0000 7ff473fff700 1 -- 172.21.15.8:0/2500813700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4740f6530 msgr2=0x7ff4740f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:20.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.990+0000 7ff473fff700 1 --2- 172.21.15.8:0/2500813700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4740f6530 0x7ff4740f6950 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7ff464004660 tx=0x7ff464009b30).stop 2023-10-18T21:22:20.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.990+0000 7ff473fff700 1 -- 172.21.15.8:0/2500813700 shutdown_connections 2023-10-18T21:22:20.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.990+0000 7ff473fff700 1 --2- 172.21.15.8:0/2500813700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740f77d0 0x7ff4740f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.990+0000 7ff473fff700 1 --2- 172.21.15.8:0/2500813700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4740f6530 0x7ff4740f6950 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:20.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.990+0000 7ff473fff700 1 -- 172.21.15.8:0/2500813700 >> 172.21.15.8:0/2500813700 conn(0x7ff4740f1c90 msgr2=0x7ff4740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:20.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.990+0000 7ff473fff700 1 -- 172.21.15.8:0/2500813700 shutdown_connections 2023-10-18T21:22:20.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.990+0000 7ff473fff700 1 -- 172.21.15.8:0/2500813700 wait complete. 2023-10-18T21:22:20.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.991+0000 7ff473fff700 1 Processor -- start 2023-10-18T21:22:20.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.991+0000 7ff473fff700 1 -- start start 2023-10-18T21:22:20.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.991+0000 7ff473fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740f6530 0x7ff474106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:20.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.991+0000 7ff473fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4740f77d0 0x7ff474107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:20.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.991+0000 7ff473fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474107880 con 0x7ff4740f77d0 2023-10-18T21:22:20.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.991+0000 7ff473fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4741080c0 con 0x7ff4740f6530 2023-10-18T21:22:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff4727fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4740f77d0 0x7ff474107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff4727fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4740f77d0 0x7ff474107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35738/0 (socket says 172.21.15.8:35738) 2023-10-18T21:22:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff4727fc700 1 -- 172.21.15.8:0/582906962 learned_addr learned my addr 172.21.15.8:0/582906962 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff4727fc700 1 -- 172.21.15.8:0/582906962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740f6530 msgr2=0x7ff474106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff4727fc700 1 --2- 172.21.15.8:0/582906962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740f6530 0x7ff474106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:22:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff4727fc700 1 -- 172.21.15.8:0/582906962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464005040 con 0x7ff4740f77d0 2023-10-18T21:22:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff4727fc700 1 --2- 172.21.15.8:0/582906962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4740f77d0 0x7ff474107280 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7ff46800e7f0 tx=0x7ff46800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff45b7fe700 1 -- 172.21.15.8:0/582906962 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4680092e0 con 0x7ff4740f77d0 2023-10-18T21:22:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff45b7fe700 1 -- 172.21.15.8:0/582906962 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff46800f040 con 0x7ff4740f77d0 2023-10-18T21:22:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff473fff700 1 -- 172.21.15.8:0/582906962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4741083a0 con 0x7ff4740f77d0 2023-10-18T21:22:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.992+0000 7ff45b7fe700 1 -- 172.21.15.8:0/582906962 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4680147e0 con 0x7ff4740f77d0 2023-10-18T21:22:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.993+0000 7ff473fff700 1 -- 172.21.15.8:0/582906962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4741088e0 con 0x7ff4740f77d0 2023-10-18T21:22:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.994+0000 7ff473fff700 1 -- 172.21.15.8:0/582906962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff474059100 con 0x7ff4740f77d0 2023-10-18T21:22:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.994+0000 7ff45b7fe700 1 -- 172.21.15.8:0/582906962 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff46801b030 con 0x7ff4740f77d0 2023-10-18T21:22:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.995+0000 7ff45b7fe700 1 --2- 172.21.15.8:0/582906962 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff45c060f70 0x7ff45c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.995+0000 7ff45b7fe700 1 -- 172.21.15.8:0/582906962 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff46807c740 con 0x7ff4740f77d0 2023-10-18T21:22:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.996+0000 7ff472ffd700 1 --2- 172.21.15.8:0/582906962 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff45c060f70 0x7ff45c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:21.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.996+0000 7ff472ffd700 1 --2- 172.21.15.8:0/582906962 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff45c060f70 0x7ff45c063430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7ff464004d80 tx=0x7ff46400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:21.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:20.999+0000 7ff45b7fe700 1 -- 172.21.15.8:0/582906962 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff46804c340 con 0x7ff4740f77d0 2023-10-18T21:22:21.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.190+0000 7ff473fff700 1 -- 172.21.15.8:0/582906962 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4740fedd0 con 0x7ff45c060f70 2023-10-18T21:22:21.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.200+0000 7ff45b7fe700 1 -- 172.21.15.8:0/582906962 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff4740fedd0 con 0x7ff45c060f70 2023-10-18T21:22:21.202 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:22:21.202 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (29m) 6m ago 30m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:22:21.202 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (22m) 6m ago 30m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:22:21.202 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (22m) 4m ago 29m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:22:21.203 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (28m) 6m ago 30m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:22:21.203 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 26m - - 2023-10-18T21:22:21.203 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 26m - - 2023-10-18T21:22:21.204 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 26m - - 2023-10-18T21:22:21.204 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 26m - - 2023-10-18T21:22:21.204 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (24m) 6m ago 31m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:22:21.204 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (23m) 4m ago 29m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:22:21.204 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (23m) 6m ago 31m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:22:21.205 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (23m) 4m ago 29m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:22:21.205 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (29m) 6m ago 29m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:22:21.205 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (29m) 4m ago 29m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:22:21.205 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (22m) 6m ago 29m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:22:21.205 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (20m) 6m ago 28m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:22:21.206 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (20m) 6m ago 28m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:22:21.206 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (19m) 4m ago 28m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:22:21.206 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (18m) 4m ago 27m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:22:21.206 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (18m) 4m ago 27m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:22:21.206 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (24m) 6m ago 29m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:22:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 -- 172.21.15.8:0/582906962 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff45c060f70 msgr2=0x7ff45c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:21.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 --2- 172.21.15.8:0/582906962 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff45c060f70 0x7ff45c063430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7ff464004d80 tx=0x7ff46400b040).stop 2023-10-18T21:22:21.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 -- 172.21.15.8:0/582906962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4740f77d0 msgr2=0x7ff474107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:21.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 --2- 172.21.15.8:0/582906962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4740f77d0 0x7ff474107280 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7ff46800e7f0 tx=0x7ff46800b040).stop 2023-10-18T21:22:21.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 -- 172.21.15.8:0/582906962 shutdown_connections 2023-10-18T21:22:21.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 --2- 172.21.15.8:0/582906962 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff45c060f70 0x7ff45c063430 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 --2- 172.21.15.8:0/582906962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740f6530 0x7ff474106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:22:21.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 --2- 172.21.15.8:0/582906962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4740f77d0 0x7ff474107280 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 -- 172.21.15.8:0/582906962 >> 172.21.15.8:0/582906962 conn(0x7ff4740f1c90 msgr2=0x7ff4740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:21.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 -- 172.21.15.8:0/582906962 shutdown_connections 2023-10-18T21:22:21.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.202+0000 7ff473fff700 1 -- 172.21.15.8:0/582906962 wait complete. 2023-10-18T21:22:21.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.338+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1033718978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc406b960 msgr2=0x7f1bc4069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:21.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.338+0000 7f1bc8e3b700 1 --2- 172.21.15.8:0/1033718978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc406b960 0x7f1bc4069e60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f1bb4004660 tx=0x7f1bb4009b30).stop 2023-10-18T21:22:21.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.338+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1033718978 shutdown_connections 2023-10-18T21:22:21.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.338+0000 7f1bc8e3b700 1 --2- 172.21.15.8:0/1033718978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc406a350 0x7f1bc406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.338+0000 7f1bc8e3b700 1 --2- 172.21.15.8:0/1033718978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc406b960 0x7f1bc4069e60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.338+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1033718978 >> 172.21.15.8:0/1033718978 conn(0x7f1bc40f1c90 msgr2=0x7f1bc40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:21.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.338+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1033718978 shutdown_connections 2023-10-18T21:22:21.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.338+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1033718978 wait complete. 2023-10-18T21:22:21.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.339+0000 7f1bc8e3b700 1 Processor -- start 2023-10-18T21:22:21.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.339+0000 7f1bc8e3b700 1 -- start start 2023-10-18T21:22:21.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc8e3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc406a350 0x7f1bc4108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:21.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc8e3b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc406b960 0x7f1bc4109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc8e3b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4109a20 con 0x7f1bc406a350 2023-10-18T21:22:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc8e3b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4109b60 con 0x7f1bc406b960 2023-10-18T21:22:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc406a350 0x7f1bc4108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:21.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc406a350 0x7f1bc4108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35742/0 (socket says 172.21.15.8:35742) 2023-10-18T21:22:21.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc37fe700 1 -- 172.21.15.8:0/1072778886 learned_addr learned my addr 172.21.15.8:0/1072778886 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:21.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc2ffd700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc406b960 0x7f1bc4109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:21.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc37fe700 1 -- 172.21.15.8:0/1072778886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc406b960 msgr2=0x7f1bc4109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc37fe700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc406b960 0x7f1bc4109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.340+0000 7f1bc37fe700 1 -- 172.21.15.8:0/1072778886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb4005040 con 0x7f1bc406a350 2023-10-18T21:22:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.341+0000 7f1bc37fe700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc406a350 0x7f1bc4108f80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f1bb4009f50 tx=0x7f1bb4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.341+0000 7f1babfff700 1 -- 172.21.15.8:0/1072778886 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bb4018070 con 0x7f1bc406a350 2023-10-18T21:22:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.341+0000 7f1babfff700 1 -- 172.21.15.8:0/1072778886 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1bb4009630 con 0x7f1bc406a350 2023-10-18T21:22:21.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.341+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1072778886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc410a4a0 con 0x7f1bc406a350 2023-10-18T21:22:21.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.341+0000 7f1babfff700 1 -- 172.21.15.8:0/1072778886 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bb401c3c0 con 0x7f1bc406a350 2023-10-18T21:22:21.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.341+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1072778886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc410aa00 con 0x7f1bc406a350 2023-10-18T21:22:21.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.342+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1072778886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc4045ad0 con 0x7f1bc406a350 2023-10-18T21:22:21.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.343+0000 7f1babfff700 1 -- 172.21.15.8:0/1072778886 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1bb401d420 con 0x7f1bc406a350 2023-10-18T21:22:21.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.344+0000 7f1babfff700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bac060f70 0x7f1bac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.344+0000 7f1babfff700 1 -- 172.21.15.8:0/1072778886 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1bb407e540 con 0x7f1bc406a350 2023-10-18T21:22:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.344+0000 7f1bc2ffd700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bac060f70 0x7f1bac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.345+0000 7f1bc2ffd700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bac060f70 0x7f1bac063430 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f1bb8004c40 tx=0x7f1bb800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:21.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.348+0000 7f1babfff700 1 -- 172.21.15.8:0/1072778886 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1bb4051ba0 con 0x7f1bc406a350 2023-10-18T21:22:21.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:20.503208+0000 mgr.smithi008.flmjzp (mgr.14640) 1412 : audit [DBG] from='client.35320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:21.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.599+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1072778886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1bc4100f80 con 0x7f1bc406a350 2023-10-18T21:22:21.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.600+0000 7f1babfff700 1 -- 172.21.15.8:0/1072778886 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f1bb4051790 con 0x7f1bc406a350 2023-10-18T21:22:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:22:21.602 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:22:21.603 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:22:21.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:22:21.603 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:22:21.603 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:22:21.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:22:21.604 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:22:21.604 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:22:21.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:22:21.604 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:22:21.604 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:22:21.605 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:22:21.605 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:22:21.605 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:22:21.605 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:22:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:22:21.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1072778886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bac060f70 msgr2=0x7f1bac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:21.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bac060f70 0x7f1bac063430 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f1bb8004c40 tx=0x7f1bb800b040).stop 2023-10-18T21:22:21.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1072778886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc406a350 msgr2=0x7f1bc4108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:21.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc406a350 0x7f1bc4108f80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f1bb4009f50 tx=0x7f1bb4009b30).stop 2023-10-18T21:22:21.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1072778886 shutdown_connections 2023-10-18T21:22:21.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bac060f70 0x7f1bac063430 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bc406a350 0x7f1bc4108f80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 --2- 172.21.15.8:0/1072778886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc406b960 0x7f1bc4109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1072778886 >> 172.21.15.8:0/1072778886 conn(0x7f1bc40f1c90 msgr2=0x7f1bc40fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:21.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1072778886 shutdown_connections 2023-10-18T21:22:21.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.602+0000 7f1bc8e3b700 1 -- 172.21.15.8:0/1072778886 wait complete. 2023-10-18T21:22:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:20.503208+0000 mgr.smithi008.flmjzp (mgr.14640) 1412 : audit [DBG] from='client.35320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.738+0000 7fed8afe0700 1 -- 172.21.15.8:0/197152014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed840f77d0 msgr2=0x7fed840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:21.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.738+0000 7fed8afe0700 1 --2- 172.21.15.8:0/197152014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed840f77d0 0x7fed840f7c30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fed74004660 tx=0x7fed74009b30).stop 2023-10-18T21:22:21.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.739+0000 7fed8afe0700 1 -- 172.21.15.8:0/197152014 shutdown_connections 2023-10-18T21:22:21.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.739+0000 7fed8afe0700 1 --2- 172.21.15.8:0/197152014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed840f77d0 0x7fed840f7c30 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.739+0000 7fed8afe0700 1 --2- 172.21.15.8:0/197152014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed840f6530 0x7fed840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.739+0000 7fed8afe0700 1 -- 172.21.15.8:0/197152014 >> 172.21.15.8:0/197152014 conn(0x7fed840f1cd0 msgr2=0x7fed840f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:21.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.739+0000 7fed8afe0700 1 -- 172.21.15.8:0/197152014 shutdown_connections 2023-10-18T21:22:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.739+0000 7fed8afe0700 1 -- 172.21.15.8:0/197152014 wait complete. 2023-10-18T21:22:21.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.740+0000 7fed8afe0700 1 Processor -- start 2023-10-18T21:22:21.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.740+0000 7fed8afe0700 1 -- start start 2023-10-18T21:22:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed8afe0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed840f6530 0x7fed84106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed8afe0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed840f77d0 0x7fed84107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:21.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed8afe0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed84107870 con 0x7fed840f6530 2023-10-18T21:22:21.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed8afe0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed841080b0 con 0x7fed840f77d0 2023-10-18T21:22:21.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed89fde700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed840f6530 0x7fed84106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:21.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed89fde700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed840f6530 0x7fed84106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35760/0 (socket says 172.21.15.8:35760) 2023-10-18T21:22:21.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed89fde700 1 -- 172.21.15.8:0/557104087 learned_addr learned my addr 172.21.15.8:0/557104087 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:21.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed897dd700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed840f77d0 0x7fed84107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed89fde700 1 -- 172.21.15.8:0/557104087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed840f77d0 msgr2=0x7fed84107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed89fde700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed840f77d0 0x7fed84107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.741+0000 7fed89fde700 1 -- 172.21.15.8:0/557104087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74005040 con 0x7fed840f6530 2023-10-18T21:22:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.742+0000 7fed897dd700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed840f77d0 0x7fed84107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:22:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.742+0000 7fed89fde700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed840f6530 0x7fed84106d80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fed80002700 tx=0x7fed80009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.742+0000 7fed7a7fc700 1 -- 172.21.15.8:0/557104087 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed80009320 con 0x7fed840f6530 2023-10-18T21:22:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.742+0000 7fed7a7fc700 1 -- 172.21.15.8:0/557104087 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fed8000f040 con 0x7fed840f6530 2023-10-18T21:22:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.742+0000 7fed8afe0700 1 -- 172.21.15.8:0/557104087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed84108390 con 0x7fed840f6530 2023-10-18T21:22:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.742+0000 7fed7a7fc700 1 -- 172.21.15.8:0/557104087 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed80014970 con 0x7fed840f6530 2023-10-18T21:22:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.742+0000 7fed8afe0700 1 -- 172.21.15.8:0/557104087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed841088d0 con 0x7fed840f6530 2023-10-18T21:22:21.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.743+0000 7fed8afe0700 1 -- 172.21.15.8:0/557104087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed84059100 con 0x7fed840f6530 2023-10-18T21:22:21.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.744+0000 7fed7a7fc700 1 -- 172.21.15.8:0/557104087 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fed80009480 con 0x7fed840f6530 2023-10-18T21:22:21.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.745+0000 7fed7a7fc700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fed70060f70 0x7fed70063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:21.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.745+0000 7fed7a7fc700 1 -- 172.21.15.8:0/557104087 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fed8007cb80 con 0x7fed840f6530 2023-10-18T21:22:21.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.745+0000 7fed897dd700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fed70060f70 0x7fed70063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:21.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.746+0000 7fed897dd700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fed70060f70 0x7fed70063430 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fed74005010 tx=0x7fed74009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:21.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.749+0000 7fed7a7fc700 1 -- 172.21.15.8:0/557104087 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fed8004c7f0 con 0x7fed840f6530 2023-10-18T21:22:21.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.977+0000 7fed8afe0700 1 -- 172.21.15.8:0/557104087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fed840fee00 con 0x7fed840f6530 2023-10-18T21:22:21.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.977+0000 7fed7a7fc700 1 -- 172.21.15.8:0/557104087 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fed8004fe10 con 0x7fed840f6530 2023-10-18T21:22:21.979 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:22:21.980 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:22:21.980 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:22:21.980 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:22:21.980 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:22:21.980 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:22:21.981 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:22:21.981 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:22:21.981 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:22:21.981 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:22:21.981 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:22:21.982 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:22:21.982 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:22:21.982 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:22:21.982 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:22:21.982 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:22:21.983 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:22:21.983 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:22:21.983 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:22:21.983 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:22:21.983 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:22:21.984 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:22:21.984 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:22:21.984 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:22:21.984 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:22:21.984 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:22:21.984 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:22:21.985 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:22:21.985 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:22:21.985 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:22:21.985 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:22:21.985 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:22:21.986 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:22:21.986 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:22:21.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.979+0000 7fed8afe0700 1 -- 172.21.15.8:0/557104087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fed70060f70 msgr2=0x7fed70063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:21.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.979+0000 7fed8afe0700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fed70060f70 0x7fed70063430 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fed74005010 tx=0x7fed74009b30).stop 2023-10-18T21:22:21.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.979+0000 7fed8afe0700 1 -- 172.21.15.8:0/557104087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed840f6530 msgr2=0x7fed84106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:21.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.979+0000 7fed8afe0700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed840f6530 0x7fed84106d80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fed80002700 tx=0x7fed80009d80).stop 2023-10-18T21:22:21.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.979+0000 7fed8afe0700 1 -- 172.21.15.8:0/557104087 shutdown_connections 2023-10-18T21:22:21.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.979+0000 7fed8afe0700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fed70060f70 0x7fed70063430 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.979+0000 7fed8afe0700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed840f6530 0x7fed84106d80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.979+0000 7fed8afe0700 1 --2- 172.21.15.8:0/557104087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed840f77d0 0x7fed84107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:21.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.979+0000 7fed8afe0700 1 -- 172.21.15.8:0/557104087 >> 172.21.15.8:0/557104087 conn(0x7fed840f1cd0 msgr2=0x7fed840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:21.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.980+0000 7fed8afe0700 1 -- 172.21.15.8:0/557104087 shutdown_connections 2023-10-18T21:22:21.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:21.980+0000 7fed8afe0700 1 -- 172.21.15.8:0/557104087 wait complete. 2023-10-18T21:22:21.989 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:22:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.116+0000 7fec9cd55700 1 -- 172.21.15.8:0/4060890164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 msgr2=0x7fec980f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.116+0000 7fec9cd55700 1 --2- 172.21.15.8:0/4060890164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 0x7fec980f7c30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fec8c004660 tx=0x7fec8c009b30).stop 2023-10-18T21:22:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.116+0000 7fec9cd55700 1 -- 172.21.15.8:0/4060890164 shutdown_connections 2023-10-18T21:22:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.116+0000 7fec9cd55700 1 --2- 172.21.15.8:0/4060890164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 0x7fec980f7c30 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.116+0000 7fec9cd55700 1 --2- 172.21.15.8:0/4060890164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f6530 0x7fec980f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:22:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.116+0000 7fec9cd55700 1 -- 172.21.15.8:0/4060890164 >> 172.21.15.8:0/4060890164 conn(0x7fec980f1c90 msgr2=0x7fec980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:22.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.116+0000 7fec9cd55700 1 -- 172.21.15.8:0/4060890164 shutdown_connections 2023-10-18T21:22:22.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.116+0000 7fec9cd55700 1 -- 172.21.15.8:0/4060890164 wait complete. 2023-10-18T21:22:22.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.117+0000 7fec9cd55700 1 Processor -- start 2023-10-18T21:22:22.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.117+0000 7fec9cd55700 1 -- start start 2023-10-18T21:22:22.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec9cd55700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f6530 0x7fec98108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:22.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec9cd55700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 0x7fec981094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:22.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec9cd55700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec98109b00 con 0x7fec980f77d0 2023-10-18T21:22:22.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec9cd55700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9810a3b0 con 0x7fec980f6530 2023-10-18T21:22:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec96ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 0x7fec981094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec96ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 0x7fec981094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35772/0 (socket says 172.21.15.8:35772) 2023-10-18T21:22:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec96ffd700 1 -- 172.21.15.8:0/1600820287 learned_addr learned my addr 172.21.15.8:0/1600820287 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec977fe700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f6530 0x7fec98108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec96ffd700 1 -- 172.21.15.8:0/1600820287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f6530 msgr2=0x7fec98108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec96ffd700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f6530 0x7fec98108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec96ffd700 1 -- 172.21.15.8:0/1600820287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c005040 con 0x7fec980f77d0 2023-10-18T21:22:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.118+0000 7fec977fe700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f6530 0x7fec98108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:22:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.119+0000 7fec96ffd700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 0x7fec981094c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fec8c009830 tx=0x7fec8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.119+0000 7fec7ffff700 1 -- 172.21.15.8:0/1600820287 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec8c018070 con 0x7fec980f77d0 2023-10-18T21:22:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.119+0000 7fec7ffff700 1 -- 172.21.15.8:0/1600820287 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fec8c01d8e0 con 0x7fec980f77d0 2023-10-18T21:22:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.119+0000 7fec9cd55700 1 -- 172.21.15.8:0/1600820287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9810a630 con 0x7fec980f77d0 2023-10-18T21:22:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.119+0000 7fec7ffff700 1 -- 172.21.15.8:0/1600820287 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec8c01c540 con 0x7fec980f77d0 2023-10-18T21:22:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.119+0000 7fec9cd55700 1 -- 172.21.15.8:0/1600820287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9810ab90 con 0x7fec980f77d0 2023-10-18T21:22:22.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.120+0000 7fec9cd55700 1 -- 172.21.15.8:0/1600820287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec98059100 con 0x7fec980f77d0 2023-10-18T21:22:22.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.121+0000 7fec7ffff700 1 -- 172.21.15.8:0/1600820287 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fec8c01da50 con 0x7fec980f77d0 2023-10-18T21:22:22.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.122+0000 7fec7ffff700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 0x7fec80063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:22.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.122+0000 7fec7ffff700 1 -- 172.21.15.8:0/1600820287 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fec8c07e930 con 0x7fec980f77d0 2023-10-18T21:22:22.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.122+0000 7fec977fe700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 0x7fec80063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:22.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.123+0000 7fec977fe700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 0x7fec80063430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fec980f7630 tx=0x7fec88008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.126+0000 7fec7ffff700 1 -- 172.21.15.8:0/1600820287 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fec8c051f10 con 0x7fec980f77d0 2023-10-18T21:22:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.325+0000 7fec9cd55700 1 -- 172.21.15.8:0/1600820287 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec980fedd0 con 0x7fec80060f70 2023-10-18T21:22:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.327+0000 7fec7ffff700 1 -- 172.21.15.8:0/1600820287 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fec980fedd0 con 0x7fec80060f70 2023-10-18T21:22:22.329 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:22:22.329 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:22:22.329 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:22:22.329 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:22:22.330 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:22:22.330 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:22:22.330 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:22:22.330 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:22:22.330 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:22:22.331 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:22:22.331 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:22:22.331 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:22:22.331 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:22:22.331 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:22:22.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 -- 172.21.15.8:0/1600820287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 msgr2=0x7fec80063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:22.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 0x7fec80063430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fec980f7630 tx=0x7fec88008040).stop 2023-10-18T21:22:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 -- 172.21.15.8:0/1600820287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 msgr2=0x7fec981094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 0x7fec981094c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fec8c009830 tx=0x7fec8c009b30).stop 2023-10-18T21:22:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 -- 172.21.15.8:0/1600820287 shutdown_connections 2023-10-18T21:22:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 0x7fec80063430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f6530 0x7fec98108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 --2- 172.21.15.8:0/1600820287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 0x7fec981094c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:22.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 -- 172.21.15.8:0/1600820287 >> 172.21.15.8:0/1600820287 conn(0x7fec980f1c90 msgr2=0x7fec9806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:22.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 -- 172.21.15.8:0/1600820287 shutdown_connections 2023-10-18T21:22:22.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:22.329+0000 7fec9cd55700 1 -- 172.21.15.8:0/1600820287 wait complete. 2023-10-18T21:22:22.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:20.852362+0000 mgr.smithi008.flmjzp (mgr.14640) 1413 : audit [DBG] from='client.35324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:21.192866+0000 mgr.smithi008.flmjzp (mgr.14640) 1414 : audit [DBG] from='client.35328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:21.235824+0000 mgr.smithi008.flmjzp (mgr.14640) 1415 : cluster [DBG] pgmap v984: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:21.601393+0000 mon.smithi008 (mon.0) 1891 : audit [DBG] from='client.? 172.21.15.8:0/1072778886' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:21.978831+0000 mon.smithi008 (mon.0) 1892 : audit [DBG] from='client.? 172.21.15.8:0/557104087' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:22:22.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:20.852362+0000 mgr.smithi008.flmjzp (mgr.14640) 1413 : audit [DBG] from='client.35324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:22.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:21.192866+0000 mgr.smithi008.flmjzp (mgr.14640) 1414 : audit [DBG] from='client.35328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:21.235824+0000 mgr.smithi008.flmjzp (mgr.14640) 1415 : cluster [DBG] pgmap v984: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:21.601393+0000 mon.smithi008 (mon.0) 1891 : audit [DBG] from='client.? 172.21.15.8:0/1072778886' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:21.978831+0000 mon.smithi008 (mon.0) 1892 : audit [DBG] from='client.? 172.21.15.8:0/557104087' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:22:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:22.328150+0000 mgr.smithi008.flmjzp (mgr.14640) 1416 : audit [DBG] from='client.35340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:23.256975+0000 mon.smithi008 (mon.0) 1893 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:23.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:22.328150+0000 mgr.smithi008.flmjzp (mgr.14640) 1416 : audit [DBG] from='client.35340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:23.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:23.256975+0000 mon.smithi008 (mon.0) 1893 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:23.236422+0000 mgr.smithi008.flmjzp (mgr.14640) 1417 : cluster [DBG] pgmap v985: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:23.820872+0000 mon.smithi008 (mon.0) 1894 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:23.822036+0000 mon.smithi008 (mon.0) 1895 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:23.822957+0000 mgr.smithi008.flmjzp (mgr.14640) 1418 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:23.823688+0000 mgr.smithi008.flmjzp (mgr.14640) 1419 : cluster [DBG] pgmap v986: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:23.823979+0000 mgr.smithi008.flmjzp (mgr.14640) 1420 : cluster [DBG] pgmap v987: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:23.828903+0000 mon.smithi008 (mon.0) 1896 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:23.837378+0000 mon.smithi008 (mon.0) 1897 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:24.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:23.840483+0000 mon.smithi008 (mon.0) 1898 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:24.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:23.842139+0000 mon.smithi008 (mon.0) 1899 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:24.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:23.843776+0000 mon.smithi008 (mon.0) 1900 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:24.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:23.845704+0000 mon.smithi008 (mon.0) 1901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:24.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:23.236422+0000 mgr.smithi008.flmjzp (mgr.14640) 1417 : cluster [DBG] pgmap v985: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:23.820872+0000 mon.smithi008 (mon.0) 1894 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:23.822036+0000 mon.smithi008 (mon.0) 1895 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:23.822957+0000 mgr.smithi008.flmjzp (mgr.14640) 1418 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:23.823688+0000 mgr.smithi008.flmjzp (mgr.14640) 1419 : cluster [DBG] pgmap v986: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:23.823979+0000 mgr.smithi008.flmjzp (mgr.14640) 1420 : cluster [DBG] pgmap v987: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:23.828903+0000 mon.smithi008 (mon.0) 1896 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:23.837378+0000 mon.smithi008 (mon.0) 1897 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:23.840483+0000 mon.smithi008 (mon.0) 1898 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:23.842139+0000 mon.smithi008 (mon.0) 1899 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:23.843776+0000 mon.smithi008 (mon.0) 1900 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:24.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:23.845704+0000 mon.smithi008 (mon.0) 1901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:23.847582+0000 mgr.smithi008.flmjzp (mgr.14640) 1421 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:25.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:23.847582+0000 mgr.smithi008.flmjzp (mgr.14640) 1421 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:25.824769+0000 mgr.smithi008.flmjzp (mgr.14640) 1422 : cluster [DBG] pgmap v988: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:26.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:25.824769+0000 mgr.smithi008.flmjzp (mgr.14640) 1422 : cluster [DBG] pgmap v988: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:27.825485+0000 mgr.smithi008.flmjzp (mgr.14640) 1423 : cluster [DBG] pgmap v989: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:27.825485+0000 mgr.smithi008.flmjzp (mgr.14640) 1423 : cluster [DBG] pgmap v989: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:30.145 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:29.826121+0000 mgr.smithi008.flmjzp (mgr.14640) 1424 : cluster [DBG] pgmap v990: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:30.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:29.826121+0000 mgr.smithi008.flmjzp (mgr.14640) 1424 : cluster [DBG] pgmap v990: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:31.826668+0000 mgr.smithi008.flmjzp (mgr.14640) 1425 : cluster [DBG] pgmap v991: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:31.826668+0000 mgr.smithi008.flmjzp (mgr.14640) 1425 : cluster [DBG] pgmap v991: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:33.827243+0000 mgr.smithi008.flmjzp (mgr.14640) 1426 : cluster [DBG] pgmap v992: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:33.852980+0000 mon.smithi008 (mon.0) 1902 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:33.855041+0000 mon.smithi008 (mon.0) 1903 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:33.856025+0000 mon.smithi008 (mon.0) 1904 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:33.862757+0000 mon.smithi008 (mon.0) 1905 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:33.869020+0000 mon.smithi008 (mon.0) 1906 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:33.872014+0000 mon.smithi008 (mon.0) 1907 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:34.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:33.873643+0000 mon.smithi008 (mon.0) 1908 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:34.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:33.875214+0000 mon.smithi008 (mon.0) 1909 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:34.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:33.877241+0000 mon.smithi008 (mon.0) 1910 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:34.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:33.827243+0000 mgr.smithi008.flmjzp (mgr.14640) 1426 : cluster [DBG] pgmap v992: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:33.852980+0000 mon.smithi008 (mon.0) 1902 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:33.855041+0000 mon.smithi008 (mon.0) 1903 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:33.856025+0000 mon.smithi008 (mon.0) 1904 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:33.862757+0000 mon.smithi008 (mon.0) 1905 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:33.869020+0000 mon.smithi008 (mon.0) 1906 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:33.872014+0000 mon.smithi008 (mon.0) 1907 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:33.873643+0000 mon.smithi008 (mon.0) 1908 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:33.875214+0000 mon.smithi008 (mon.0) 1909 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:33.877241+0000 mon.smithi008 (mon.0) 1910 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:35.140 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:33.856878+0000 mgr.smithi008.flmjzp (mgr.14640) 1427 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:35.140 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:33.857511+0000 mgr.smithi008.flmjzp (mgr.14640) 1428 : cluster [DBG] pgmap v993: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:35.140 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:33.857755+0000 mgr.smithi008.flmjzp (mgr.14640) 1429 : cluster [DBG] pgmap v994: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:35.140 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:33.879165+0000 mgr.smithi008.flmjzp (mgr.14640) 1430 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:35.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:33.856878+0000 mgr.smithi008.flmjzp (mgr.14640) 1427 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:33.857511+0000 mgr.smithi008.flmjzp (mgr.14640) 1428 : cluster [DBG] pgmap v993: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:33.857755+0000 mgr.smithi008.flmjzp (mgr.14640) 1429 : cluster [DBG] pgmap v994: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:33.879165+0000 mgr.smithi008.flmjzp (mgr.14640) 1430 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:37.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:35.858348+0000 mgr.smithi008.flmjzp (mgr.14640) 1431 : cluster [DBG] pgmap v995: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:35.858348+0000 mgr.smithi008.flmjzp (mgr.14640) 1431 : cluster [DBG] pgmap v995: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:37.858925+0000 mgr.smithi008.flmjzp (mgr.14640) 1432 : cluster [DBG] pgmap v996: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:39.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:37.858925+0000 mgr.smithi008.flmjzp (mgr.14640) 1432 : cluster [DBG] pgmap v996: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:39.859690+0000 mgr.smithi008.flmjzp (mgr.14640) 1433 : cluster [DBG] pgmap v997: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:39.859690+0000 mgr.smithi008.flmjzp (mgr.14640) 1433 : cluster [DBG] pgmap v997: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:43.557 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:41.860221+0000 mgr.smithi008.flmjzp (mgr.14640) 1434 : cluster [DBG] pgmap v998: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:43.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:41.860221+0000 mgr.smithi008.flmjzp (mgr.14640) 1434 : cluster [DBG] pgmap v998: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:43.888636+0000 mon.smithi008 (mon.0) 1911 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:43.890711+0000 mon.smithi008 (mon.0) 1912 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:43.891712+0000 mon.smithi008 (mon.0) 1913 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:43.898509+0000 mon.smithi008 (mon.0) 1914 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:43.905028+0000 mon.smithi008 (mon.0) 1915 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:43.908478+0000 mon.smithi008 (mon.0) 1916 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:43.910245+0000 mon.smithi008 (mon.0) 1917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:43.911958+0000 mon.smithi008 (mon.0) 1918 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:43.914021+0000 mon.smithi008 (mon.0) 1919 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:44.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:43.888636+0000 mon.smithi008 (mon.0) 1911 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:44.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:43.890711+0000 mon.smithi008 (mon.0) 1912 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:43.891712+0000 mon.smithi008 (mon.0) 1913 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:43.898509+0000 mon.smithi008 (mon.0) 1914 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:43.905028+0000 mon.smithi008 (mon.0) 1915 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:43.908478+0000 mon.smithi008 (mon.0) 1916 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:43.910245+0000 mon.smithi008 (mon.0) 1917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:43.911958+0000 mon.smithi008 (mon.0) 1918 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:43.914021+0000 mon.smithi008 (mon.0) 1919 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:43.860815+0000 mgr.smithi008.flmjzp (mgr.14640) 1435 : cluster [DBG] pgmap v999: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:43.892595+0000 mgr.smithi008.flmjzp (mgr.14640) 1436 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:43.893150+0000 mgr.smithi008.flmjzp (mgr.14640) 1437 : cluster [DBG] pgmap v1000: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:43.893438+0000 mgr.smithi008.flmjzp (mgr.14640) 1438 : cluster [DBG] pgmap v1001: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:43.915945+0000 mgr.smithi008.flmjzp (mgr.14640) 1439 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:45.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:43.860815+0000 mgr.smithi008.flmjzp (mgr.14640) 1435 : cluster [DBG] pgmap v999: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:43.892595+0000 mgr.smithi008.flmjzp (mgr.14640) 1436 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:43.893150+0000 mgr.smithi008.flmjzp (mgr.14640) 1437 : cluster [DBG] pgmap v1000: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:43.893438+0000 mgr.smithi008.flmjzp (mgr.14640) 1438 : cluster [DBG] pgmap v1001: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:43.915945+0000 mgr.smithi008.flmjzp (mgr.14640) 1439 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:45.894039+0000 mgr.smithi008.flmjzp (mgr.14640) 1440 : cluster [DBG] pgmap v1002: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:47.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:45.894039+0000 mgr.smithi008.flmjzp (mgr.14640) 1440 : cluster [DBG] pgmap v1002: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:47.894638+0000 mgr.smithi008.flmjzp (mgr.14640) 1441 : cluster [DBG] pgmap v1003: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:49.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:47.894638+0000 mgr.smithi008.flmjzp (mgr.14640) 1441 : cluster [DBG] pgmap v1003: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:49.895406+0000 mgr.smithi008.flmjzp (mgr.14640) 1442 : cluster [DBG] pgmap v1004: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:49.895406+0000 mgr.smithi008.flmjzp (mgr.14640) 1442 : cluster [DBG] pgmap v1004: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:52.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.480+0000 7fda337fe700 1 -- 172.21.15.8:0/3987046577 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda20013a50 con 0x7fda340f77d0 2023-10-18T21:22:52.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.481+0000 7fda3992a700 1 -- 172.21.15.8:0/3987046577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda340f77d0 msgr2=0x7fda340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:52.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.481+0000 7fda3992a700 1 --2- 172.21.15.8:0/3987046577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda340f77d0 0x7fda340f7c30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fda20004660 tx=0x7fda20009b30).stop 2023-10-18T21:22:52.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.481+0000 7fda3992a700 1 -- 172.21.15.8:0/3987046577 shutdown_connections 2023-10-18T21:22:52.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.481+0000 7fda3992a700 1 --2- 172.21.15.8:0/3987046577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda340f77d0 0x7fda340f7c30 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:52.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.481+0000 7fda3992a700 1 --2- 172.21.15.8:0/3987046577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda340f6530 0x7fda340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:52.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.481+0000 7fda3992a700 1 -- 172.21.15.8:0/3987046577 >> 172.21.15.8:0/3987046577 conn(0x7fda340f1c90 msgr2=0x7fda340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:52.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.481+0000 7fda3992a700 1 -- 172.21.15.8:0/3987046577 shutdown_connections 2023-10-18T21:22:52.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.481+0000 7fda3992a700 1 -- 172.21.15.8:0/3987046577 wait complete. 2023-10-18T21:22:52.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.482+0000 7fda3992a700 1 Processor -- start 2023-10-18T21:22:52.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.483+0000 7fda3992a700 1 -- start start 2023-10-18T21:22:52.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.483+0000 7fda3992a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda340f6530 0x7fda3410d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:52.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.483+0000 7fda3992a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda340f77d0 0x7fda3410d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:52.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.483+0000 7fda3992a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3410ddd0 con 0x7fda340f6530 2023-10-18T21:22:52.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.483+0000 7fda3992a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3410df10 con 0x7fda340f77d0 2023-10-18T21:22:52.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.483+0000 7fda38928700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda340f6530 0x7fda3410d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:52.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.483+0000 7fda38928700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda340f6530 0x7fda3410d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39550/0 (socket says 172.21.15.8:39550) 2023-10-18T21:22:52.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.483+0000 7fda38928700 1 -- 172.21.15.8:0/2381625538 learned_addr learned my addr 172.21.15.8:0/2381625538 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:52.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.483+0000 7fda33fff700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda340f77d0 0x7fda3410d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:52.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.484+0000 7fda38928700 1 -- 172.21.15.8:0/2381625538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda340f77d0 msgr2=0x7fda3410d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:52.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.484+0000 7fda38928700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda340f77d0 0x7fda3410d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:52.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.484+0000 7fda38928700 1 -- 172.21.15.8:0/2381625538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20005040 con 0x7fda340f6530 2023-10-18T21:22:52.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.484+0000 7fda38928700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda340f6530 0x7fda3410d330 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fda2800e7c0 tx=0x7fda2800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:52.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.484+0000 7fda317fa700 1 -- 172.21.15.8:0/2381625538 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda280092e0 con 0x7fda340f6530 2023-10-18T21:22:52.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.484+0000 7fda317fa700 1 -- 172.21.15.8:0/2381625538 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fda2800f040 con 0x7fda340f6530 2023-10-18T21:22:52.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.484+0000 7fda3992a700 1 -- 172.21.15.8:0/2381625538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3410e8b0 con 0x7fda340f6530 2023-10-18T21:22:52.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.484+0000 7fda317fa700 1 -- 172.21.15.8:0/2381625538 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda280147e0 con 0x7fda340f6530 2023-10-18T21:22:52.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.484+0000 7fda3992a700 1 -- 172.21.15.8:0/2381625538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3410edf0 con 0x7fda340f6530 2023-10-18T21:22:52.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.485+0000 7fda3992a700 1 -- 172.21.15.8:0/2381625538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda34045ad0 con 0x7fda340f6530 2023-10-18T21:22:52.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.486+0000 7fda317fa700 1 -- 172.21.15.8:0/2381625538 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fda2801b030 con 0x7fda340f6530 2023-10-18T21:22:52.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.487+0000 7fda317fa700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda24060f70 0x7fda24063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:52.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.487+0000 7fda317fa700 1 -- 172.21.15.8:0/2381625538 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fda2807ca70 con 0x7fda340f6530 2023-10-18T21:22:52.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.487+0000 7fda33fff700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda24060f70 0x7fda24063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:52.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.488+0000 7fda33fff700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda24060f70 0x7fda24063430 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fda20009720 tx=0x7fda2000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:52.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.492+0000 7fda317fa700 1 -- 172.21.15.8:0/2381625538 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fda28050050 con 0x7fda340f6530 2023-10-18T21:22:52.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.689+0000 7fda3992a700 1 -- 172.21.15.8:0/2381625538 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda3406b500 con 0x7fda24060f70 2023-10-18T21:22:52.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.691+0000 7fda317fa700 1 -- 172.21.15.8:0/2381625538 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fda3406b500 con 0x7fda24060f70 2023-10-18T21:22:52.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 -- 172.21.15.8:0/2381625538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda24060f70 msgr2=0x7fda24063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:52.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda24060f70 0x7fda24063430 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fda20009720 tx=0x7fda2000b040).stop 2023-10-18T21:22:52.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 -- 172.21.15.8:0/2381625538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda340f6530 msgr2=0x7fda3410d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:52.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda340f6530 0x7fda3410d330 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fda2800e7c0 tx=0x7fda2800b040).stop 2023-10-18T21:22:52.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 -- 172.21.15.8:0/2381625538 shutdown_connections 2023-10-18T21:22:52.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda24060f70 0x7fda24063430 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:52.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda340f6530 0x7fda3410d330 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:52.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 --2- 172.21.15.8:0/2381625538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda340f77d0 0x7fda3410d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:52.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 -- 172.21.15.8:0/2381625538 >> 172.21.15.8:0/2381625538 conn(0x7fda340f1c90 msgr2=0x7fda340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:52.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 -- 172.21.15.8:0/2381625538 shutdown_connections 2023-10-18T21:22:52.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.693+0000 7fda3992a700 1 -- 172.21.15.8:0/2381625538 wait complete. 2023-10-18T21:22:52.708 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:22:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.831+0000 7f52fbfff700 1 -- 172.21.15.8:0/3409175693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52fc0f77d0 msgr2=0x7f52fc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.831+0000 7f52fbfff700 1 --2- 172.21.15.8:0/3409175693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52fc0f77d0 0x7f52fc0f7c30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f52f0004660 tx=0x7f52f0009b30).stop 2023-10-18T21:22:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.831+0000 7f52fbfff700 1 -- 172.21.15.8:0/3409175693 shutdown_connections 2023-10-18T21:22:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.831+0000 7f52fbfff700 1 --2- 172.21.15.8:0/3409175693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52fc0f77d0 0x7f52fc0f7c30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.831+0000 7f52fbfff700 1 --2- 172.21.15.8:0/3409175693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52fc0f6530 0x7f52fc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.831+0000 7f52fbfff700 1 -- 172.21.15.8:0/3409175693 >> 172.21.15.8:0/3409175693 conn(0x7f52fc0f1cd0 msgr2=0x7f52fc0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.831+0000 7f52fbfff700 1 -- 172.21.15.8:0/3409175693 shutdown_connections 2023-10-18T21:22:52.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.831+0000 7f52fbfff700 1 -- 172.21.15.8:0/3409175693 wait complete. 2023-10-18T21:22:52.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.832+0000 7f52fbfff700 1 Processor -- start 2023-10-18T21:22:52.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.832+0000 7f52fbfff700 1 -- start start 2023-10-18T21:22:52.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52fc0f6530 0x7f52fc108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:52.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52fbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52fc0f77d0 0x7f52fc109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:52.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52fbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc1099e0 con 0x7f52fc0f6530 2023-10-18T21:22:52.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52fbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc109b20 con 0x7f52fc0f77d0 2023-10-18T21:22:52.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52faffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52fc0f6530 0x7f52fc108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:52.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52faffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52fc0f6530 0x7f52fc108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39556/0 (socket says 172.21.15.8:39556) 2023-10-18T21:22:52.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52faffd700 1 -- 172.21.15.8:0/1898156734 learned_addr learned my addr 172.21.15.8:0/1898156734 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:52.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52fa7fc700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52fc0f77d0 0x7f52fc109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:52.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52faffd700 1 -- 172.21.15.8:0/1898156734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52fc0f77d0 msgr2=0x7f52fc109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:52.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52faffd700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52fc0f77d0 0x7f52fc109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:52.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.833+0000 7f52faffd700 1 -- 172.21.15.8:0/1898156734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0005040 con 0x7f52fc0f6530 2023-10-18T21:22:52.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.834+0000 7f52faffd700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52fc0f6530 0x7f52fc108f40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f52ec002700 tx=0x7f52ec009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:52.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.834+0000 7f52e37fe700 1 -- 172.21.15.8:0/1898156734 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52ec0079c0 con 0x7f52fc0f6530 2023-10-18T21:22:52.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.834+0000 7f52e37fe700 1 -- 172.21.15.8:0/1898156734 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f52ec00f040 con 0x7f52fc0f6530 2023-10-18T21:22:52.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.834+0000 7f52fbfff700 1 -- 172.21.15.8:0/1898156734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc10a4c0 con 0x7f52fc0f6530 2023-10-18T21:22:52.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.834+0000 7f52e37fe700 1 -- 172.21.15.8:0/1898156734 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52ec0148d0 con 0x7f52fc0f6530 2023-10-18T21:22:52.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.834+0000 7f52fbfff700 1 -- 172.21.15.8:0/1898156734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc10aa80 con 0x7f52fc0f6530 2023-10-18T21:22:52.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.835+0000 7f52fbfff700 1 -- 172.21.15.8:0/1898156734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc045ad0 con 0x7f52fc0f6530 2023-10-18T21:22:52.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.836+0000 7f52e37fe700 1 -- 172.21.15.8:0/1898156734 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f52ec01b060 con 0x7f52fc0f6530 2023-10-18T21:22:52.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.837+0000 7f52e37fe700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52e4060f70 0x7f52e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:52.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.837+0000 7f52e37fe700 1 -- 172.21.15.8:0/1898156734 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f52ec07c710 con 0x7f52fc0f6530 2023-10-18T21:22:52.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.837+0000 7f52fa7fc700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52e4060f70 0x7f52e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:52.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.837+0000 7f52fa7fc700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52e4060f70 0x7f52e4063430 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f52f0004630 tx=0x7f52f0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:52.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:52.840+0000 7f52e37fe700 1 -- 172.21.15.8:0/1898156734 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f52ec04fdb0 con 0x7f52fc0f6530 2023-10-18T21:22:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.036+0000 7f52fbfff700 1 -- 172.21.15.8:0/1898156734 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52fc10ad00 con 0x7f52e4060f70 2023-10-18T21:22:53.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.037+0000 7f52e37fe700 1 -- 172.21.15.8:0/1898156734 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f52fc10ad00 con 0x7f52e4060f70 2023-10-18T21:22:53.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.039+0000 7f52fbfff700 1 -- 172.21.15.8:0/1898156734 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52e4060f70 msgr2=0x7f52e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.039+0000 7f52fbfff700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52e4060f70 0x7f52e4063430 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f52f0004630 tx=0x7f52f0009b30).stop 2023-10-18T21:22:53.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.039+0000 7f52fbfff700 1 -- 172.21.15.8:0/1898156734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52fc0f6530 msgr2=0x7f52fc108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.039+0000 7f52fbfff700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52fc0f6530 0x7f52fc108f40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f52ec002700 tx=0x7f52ec009d80).stop 2023-10-18T21:22:53.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.040+0000 7f52fbfff700 1 -- 172.21.15.8:0/1898156734 shutdown_connections 2023-10-18T21:22:53.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.040+0000 7f52fbfff700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f52e4060f70 0x7f52e4063430 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.040+0000 7f52fbfff700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52fc0f6530 0x7f52fc108f40 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.040+0000 7f52fbfff700 1 --2- 172.21.15.8:0/1898156734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52fc0f77d0 0x7f52fc109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.040+0000 7f52fbfff700 1 -- 172.21.15.8:0/1898156734 >> 172.21.15.8:0/1898156734 conn(0x7f52fc0f1cd0 msgr2=0x7f52fc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:53.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.040+0000 7f52fbfff700 1 -- 172.21.15.8:0/1898156734 shutdown_connections 2023-10-18T21:22:53.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.040+0000 7f52fbfff700 1 -- 172.21.15.8:0/1898156734 wait complete. 2023-10-18T21:22:53.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.176+0000 7fe8d51b3700 1 -- 172.21.15.8:0/2239797589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00f6530 msgr2=0x7fe8d00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.176+0000 7fe8d51b3700 1 --2- 172.21.15.8:0/2239797589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00f6530 0x7fe8d00f6950 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fe8c0004660 tx=0x7fe8c0009b30).stop 2023-10-18T21:22:53.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.176+0000 7fe8d51b3700 1 -- 172.21.15.8:0/2239797589 shutdown_connections 2023-10-18T21:22:53.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.176+0000 7fe8d51b3700 1 --2- 172.21.15.8:0/2239797589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d00f77d0 0x7fe8d00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.176+0000 7fe8d51b3700 1 --2- 172.21.15.8:0/2239797589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00f6530 0x7fe8d00f6950 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.176+0000 7fe8d51b3700 1 -- 172.21.15.8:0/2239797589 >> 172.21.15.8:0/2239797589 conn(0x7fe8d00f1c90 msgr2=0x7fe8d00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:53.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.176+0000 7fe8d51b3700 1 -- 172.21.15.8:0/2239797589 shutdown_connections 2023-10-18T21:22:53.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.176+0000 7fe8d51b3700 1 -- 172.21.15.8:0/2239797589 wait complete. 2023-10-18T21:22:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.177+0000 7fe8d51b3700 1 Processor -- start 2023-10-18T21:22:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.178+0000 7fe8d51b3700 1 -- start start 2023-10-18T21:22:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.178+0000 7fe8d51b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00f6530 0x7fe8d006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.178+0000 7fe8d51b3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d00f77d0 0x7fe8d0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.178+0000 7fe8d51b3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d006a380 con 0x7fe8d00f6530 2023-10-18T21:22:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.178+0000 7fe8d51b3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d006a4c0 con 0x7fe8d00f77d0 2023-10-18T21:22:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.178+0000 7fe8cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00f6530 0x7fe8d006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00f6530 0x7fe8d006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39568/0 (socket says 172.21.15.8:39568) 2023-10-18T21:22:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8cffff700 1 -- 172.21.15.8:0/3337025904 learned_addr learned my addr 172.21.15.8:0/3337025904 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8cf7fe700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d00f77d0 0x7fe8d0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8cffff700 1 -- 172.21.15.8:0/3337025904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d00f77d0 msgr2=0x7fe8d0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8cffff700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d00f77d0 0x7fe8d0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8cffff700 1 -- 172.21.15.8:0/3337025904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c0005040 con 0x7fe8d00f6530 2023-10-18T21:22:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8cffff700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00f6530 0x7fe8d006b9a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fe8c0009870 tx=0x7fe8c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8ccff9700 1 -- 172.21.15.8:0/3337025904 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c0019070 con 0x7fe8d00f6530 2023-10-18T21:22:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8ccff9700 1 -- 172.21.15.8:0/3337025904 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe8c001e420 con 0x7fe8d00f6530 2023-10-18T21:22:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8ccff9700 1 -- 172.21.15.8:0/3337025904 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c0014660 con 0x7fe8d00f6530 2023-10-18T21:22:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.179+0000 7fe8d51b3700 1 -- 172.21.15.8:0/3337025904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d006a740 con 0x7fe8d00f6530 2023-10-18T21:22:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.180+0000 7fe8d51b3700 1 -- 172.21.15.8:0/3337025904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d006ac20 con 0x7fe8d00f6530 2023-10-18T21:22:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.181+0000 7fe8d51b3700 1 -- 172.21.15.8:0/3337025904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d0045ad0 con 0x7fe8d00f6530 2023-10-18T21:22:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.181+0000 7fe8ccff9700 1 -- 172.21.15.8:0/3337025904 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe8c001e9c0 con 0x7fe8d00f6530 2023-10-18T21:22:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.182+0000 7fe8ccff9700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8b8060f70 0x7fe8b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.182+0000 7fe8ccff9700 1 -- 172.21.15.8:0/3337025904 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe8c007dd40 con 0x7fe8d00f6530 2023-10-18T21:22:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.182+0000 7fe8cf7fe700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8b8060f70 0x7fe8b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.183+0000 7fe8cf7fe700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8b8060f70 0x7fe8b8063430 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fe8c4007fd0 tx=0x7fe8c400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.186+0000 7fe8ccff9700 1 -- 172.21.15.8:0/3337025904 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe8c004d9b0 con 0x7fe8d00f6530 2023-10-18T21:22:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.376+0000 7fe8d51b3700 1 -- 172.21.15.8:0/3337025904 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8d0057f10 con 0x7fe8b8060f70 2023-10-18T21:22:53.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.386+0000 7fe8ccff9700 1 -- 172.21.15.8:0/3337025904 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe8d0057f10 con 0x7fe8b8060f70 2023-10-18T21:22:53.387 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:22:53.387 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (29m) 7m ago 31m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:22:53.387 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (23m) 7m ago 31m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:22:53.388 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (23m) 5m ago 30m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:22:53.388 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (29m) 7m ago 30m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:22:53.388 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 27m - - 2023-10-18T21:22:53.388 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 26m - - 2023-10-18T21:22:53.388 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 27m - - 2023-10-18T21:22:53.388 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 26m - - 2023-10-18T21:22:53.389 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (24m) 7m ago 32m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:22:53.389 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (24m) 5m ago 30m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:22:53.389 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (23m) 7m ago 32m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:22:53.389 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (23m) 5m ago 30m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:22:53.389 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (30m) 7m ago 30m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:22:53.389 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (29m) 5m ago 29m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:22:53.390 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (23m) 7m ago 29m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:22:53.390 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (21m) 7m ago 29m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:22:53.390 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (20m) 7m ago 28m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:22:53.390 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (20m) 5m ago 28m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:22:53.390 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (19m) 5m ago 28m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:22:53.391 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (19m) 5m ago 28m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:22:53.391 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (25m) 7m ago 30m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:22:53.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 -- 172.21.15.8:0/3337025904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8b8060f70 msgr2=0x7fe8b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8b8060f70 0x7fe8b8063430 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fe8c4007fd0 tx=0x7fe8c400b040).stop 2023-10-18T21:22:53.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 -- 172.21.15.8:0/3337025904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00f6530 msgr2=0x7fe8d006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00f6530 0x7fe8d006b9a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fe8c0009870 tx=0x7fe8c000b040).stop 2023-10-18T21:22:53.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 -- 172.21.15.8:0/3337025904 shutdown_connections 2023-10-18T21:22:53.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8b8060f70 0x7fe8b8063430 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00f6530 0x7fe8d006b9a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 --2- 172.21.15.8:0/3337025904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d00f77d0 0x7fe8d0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 -- 172.21.15.8:0/3337025904 >> 172.21.15.8:0/3337025904 conn(0x7fe8d00f1c90 msgr2=0x7fe8d00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:53.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 -- 172.21.15.8:0/3337025904 shutdown_connections 2023-10-18T21:22:53.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.388+0000 7fe8d51b3700 1 -- 172.21.15.8:0/3337025904 wait complete. 2023-10-18T21:22:53.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.524+0000 7f17db2e4700 1 -- 172.21.15.8:0/260587811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17d40f77d0 msgr2=0x7f17d40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.524+0000 7f17db2e4700 1 --2- 172.21.15.8:0/260587811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17d40f77d0 0x7f17d40f7c30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f17c4004660 tx=0x7f17c4009b30).stop 2023-10-18T21:22:53.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.524+0000 7f17db2e4700 1 -- 172.21.15.8:0/260587811 shutdown_connections 2023-10-18T21:22:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.524+0000 7f17db2e4700 1 --2- 172.21.15.8:0/260587811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17d40f77d0 0x7f17d40f7c30 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.524+0000 7f17db2e4700 1 --2- 172.21.15.8:0/260587811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17d40f6530 0x7f17d40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.524+0000 7f17db2e4700 1 -- 172.21.15.8:0/260587811 >> 172.21.15.8:0/260587811 conn(0x7f17d40f1c90 msgr2=0x7f17d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.524+0000 7f17db2e4700 1 -- 172.21.15.8:0/260587811 shutdown_connections 2023-10-18T21:22:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.524+0000 7f17db2e4700 1 -- 172.21.15.8:0/260587811 wait complete. 2023-10-18T21:22:53.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.525+0000 7f17db2e4700 1 Processor -- start 2023-10-18T21:22:53.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.525+0000 7f17db2e4700 1 -- start start 2023-10-18T21:22:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.525+0000 7f17db2e4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17d40f6530 0x7f17d406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.525+0000 7f17db2e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17d40f77d0 0x7f17d4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.525+0000 7f17db2e4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d406a380 con 0x7f17d40f6530 2023-10-18T21:22:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.525+0000 7f17db2e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d406a4c0 con 0x7f17d40f77d0 2023-10-18T21:22:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.525+0000 7f17da2e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17d40f6530 0x7f17d406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.525+0000 7f17da2e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17d40f6530 0x7f17d406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39582/0 (socket says 172.21.15.8:39582) 2023-10-18T21:22:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.525+0000 7f17da2e2700 1 -- 172.21.15.8:0/718763216 learned_addr learned my addr 172.21.15.8:0/718763216 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.526+0000 7f17d9ae1700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17d40f77d0 0x7f17d4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.526+0000 7f17da2e2700 1 -- 172.21.15.8:0/718763216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17d40f77d0 msgr2=0x7f17d4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.526+0000 7f17da2e2700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17d40f77d0 0x7f17d4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.526+0000 7f17da2e2700 1 -- 172.21.15.8:0/718763216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c4005040 con 0x7f17d40f6530 2023-10-18T21:22:53.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.526+0000 7f17da2e2700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17d40f6530 0x7f17d406b9a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f17d000e7c0 tx=0x7f17d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:53.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.526+0000 7f17caffd700 1 -- 172.21.15.8:0/718763216 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17d00092e0 con 0x7f17d40f6530 2023-10-18T21:22:53.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.526+0000 7f17caffd700 1 -- 172.21.15.8:0/718763216 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f17d000f040 con 0x7f17d40f6530 2023-10-18T21:22:53.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.526+0000 7f17db2e4700 1 -- 172.21.15.8:0/718763216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d406a7a0 con 0x7f17d40f6530 2023-10-18T21:22:53.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.526+0000 7f17caffd700 1 -- 172.21.15.8:0/718763216 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17d00147e0 con 0x7f17d40f6530 2023-10-18T21:22:53.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.526+0000 7f17db2e4700 1 -- 172.21.15.8:0/718763216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d410ed20 con 0x7f17d40f6530 2023-10-18T21:22:53.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.528+0000 7f17db2e4700 1 -- 172.21.15.8:0/718763216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d4045ad0 con 0x7f17d40f6530 2023-10-18T21:22:53.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.528+0000 7f17caffd700 1 -- 172.21.15.8:0/718763216 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f17d001b030 con 0x7f17d40f6530 2023-10-18T21:22:53.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.529+0000 7f17caffd700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17c0060f70 0x7f17c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:53.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.529+0000 7f17caffd700 1 -- 172.21.15.8:0/718763216 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f17d007c990 con 0x7f17d40f6530 2023-10-18T21:22:53.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.529+0000 7f17d9ae1700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17c0060f70 0x7f17c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:53.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.530+0000 7f17d9ae1700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17c0060f70 0x7f17c0063430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f17c4009720 tx=0x7f17c400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:53.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.533+0000 7f17caffd700 1 -- 172.21.15.8:0/718763216 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f17d004c4e0 con 0x7f17d40f6530 2023-10-18T21:22:53.557 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:51.896040+0000 mgr.smithi008.flmjzp (mgr.14640) 1443 : cluster [DBG] pgmap v1005: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:53.557 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:52.691243+0000 mgr.smithi008.flmjzp (mgr.14640) 1444 : audit [DBG] from='client.35344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:53.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:51.896040+0000 mgr.smithi008.flmjzp (mgr.14640) 1443 : cluster [DBG] pgmap v1005: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:53.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:52.691243+0000 mgr.smithi008.flmjzp (mgr.14640) 1444 : audit [DBG] from='client.35344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.787+0000 7f17db2e4700 1 -- 172.21.15.8:0/718763216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f17d40fedc0 con 0x7f17d40f6530 2023-10-18T21:22:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.787+0000 7f17caffd700 1 -- 172.21.15.8:0/718763216 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f17d0019020 con 0x7f17d40f6530 2023-10-18T21:22:53.788 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:22:53.788 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:22:53.789 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:22:53.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:22:53.789 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:22:53.789 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:22:53.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:22:53.790 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:22:53.790 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:22:53.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:22:53.790 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:22:53.790 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:22:53.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:22:53.791 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:22:53.791 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:22:53.791 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:22:53.791 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:22:53.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.789+0000 7f17db2e4700 1 -- 172.21.15.8:0/718763216 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17c0060f70 msgr2=0x7f17c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.789+0000 7f17db2e4700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17c0060f70 0x7f17c0063430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f17c4009720 tx=0x7f17c400b040).stop 2023-10-18T21:22:53.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.789+0000 7f17db2e4700 1 -- 172.21.15.8:0/718763216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17d40f6530 msgr2=0x7f17d406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.789+0000 7f17db2e4700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17d40f6530 0x7f17d406b9a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f17d000e7c0 tx=0x7f17d000b040).stop 2023-10-18T21:22:53.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.789+0000 7f17db2e4700 1 -- 172.21.15.8:0/718763216 shutdown_connections 2023-10-18T21:22:53.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.790+0000 7f17db2e4700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17c0060f70 0x7f17c0063430 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.790+0000 7f17db2e4700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17d40f6530 0x7f17d406b9a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.790+0000 7f17db2e4700 1 --2- 172.21.15.8:0/718763216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17d40f77d0 0x7f17d4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.790+0000 7f17db2e4700 1 -- 172.21.15.8:0/718763216 >> 172.21.15.8:0/718763216 conn(0x7f17d40f1c90 msgr2=0x7f17d40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:53.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.790+0000 7f17db2e4700 1 -- 172.21.15.8:0/718763216 shutdown_connections 2023-10-18T21:22:53.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.790+0000 7f17db2e4700 1 -- 172.21.15.8:0/718763216 wait complete. 2023-10-18T21:22:53.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.929+0000 7f604d7ad700 1 -- 172.21.15.8:0/2595922895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60480f9690 msgr2=0x7f60480fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.929+0000 7f604d7ad700 1 --2- 172.21.15.8:0/2595922895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60480f9690 0x7f60480fbae0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f603c004660 tx=0x7f603c009b30).stop 2023-10-18T21:22:53.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.929+0000 7f604d7ad700 1 -- 172.21.15.8:0/2595922895 shutdown_connections 2023-10-18T21:22:53.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.929+0000 7f604d7ad700 1 --2- 172.21.15.8:0/2595922895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60480f9690 0x7f60480fbae0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.929+0000 7f604d7ad700 1 --2- 172.21.15.8:0/2595922895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6048060310 0x7f60480f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.929+0000 7f604d7ad700 1 -- 172.21.15.8:0/2595922895 >> 172.21.15.8:0/2595922895 conn(0x7f60480f0b90 msgr2=0x7f60480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:53.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.929+0000 7f604d7ad700 1 -- 172.21.15.8:0/2595922895 shutdown_connections 2023-10-18T21:22:53.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.929+0000 7f604d7ad700 1 -- 172.21.15.8:0/2595922895 wait complete. 2023-10-18T21:22:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.930+0000 7f604d7ad700 1 Processor -- start 2023-10-18T21:22:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.930+0000 7f604d7ad700 1 -- start start 2023-10-18T21:22:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.931+0000 7f604d7ad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6048060310 0x7f60480f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:53.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.931+0000 7f604d7ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60480f9690 0x7f60480f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:53.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.931+0000 7f604d7ad700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60480f5570 con 0x7f6048060310 2023-10-18T21:22:53.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.931+0000 7f604d7ad700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60480f56b0 con 0x7f60480f9690 2023-10-18T21:22:53.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.931+0000 7f6047fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6048060310 0x7f60480f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:53.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.931+0000 7f6047fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6048060310 0x7f60480f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39598/0 (socket says 172.21.15.8:39598) 2023-10-18T21:22:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.931+0000 7f6047fff700 1 -- 172.21.15.8:0/339903432 learned_addr learned my addr 172.21.15.8:0/339903432 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.931+0000 7f60477fe700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60480f9690 0x7f60480f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.932+0000 7f6047fff700 1 -- 172.21.15.8:0/339903432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60480f9690 msgr2=0x7f60480f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.932+0000 7f6047fff700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60480f9690 0x7f60480f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:53.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.932+0000 7f6047fff700 1 -- 172.21.15.8:0/339903432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c005040 con 0x7f6048060310 2023-10-18T21:22:53.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.932+0000 7f6047fff700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6048060310 0x7f60480f6b90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f60380026d0 tx=0x7f6038009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:53.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.932+0000 7f6044ff9700 1 -- 172.21.15.8:0/339903432 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60380079c0 con 0x7f6048060310 2023-10-18T21:22:53.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.932+0000 7f6044ff9700 1 -- 172.21.15.8:0/339903432 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f603800f040 con 0x7f6048060310 2023-10-18T21:22:53.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.932+0000 7f6044ff9700 1 -- 172.21.15.8:0/339903432 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6038014980 con 0x7f6048060310 2023-10-18T21:22:53.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.932+0000 7f604d7ad700 1 -- 172.21.15.8:0/339903432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60480f5990 con 0x7f6048060310 2023-10-18T21:22:53.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.932+0000 7f604d7ad700 1 -- 172.21.15.8:0/339903432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604810eda0 con 0x7f6048060310 2023-10-18T21:22:53.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.933+0000 7f604d7ad700 1 -- 172.21.15.8:0/339903432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6048045ad0 con 0x7f6048060310 2023-10-18T21:22:53.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.934+0000 7f6044ff9700 1 -- 172.21.15.8:0/339903432 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f60380090d0 con 0x7f6048060310 2023-10-18T21:22:53.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.935+0000 7f6044ff9700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6030060f70 0x7f6030063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:53.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.935+0000 7f6044ff9700 1 -- 172.21.15.8:0/339903432 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f603807c860 con 0x7f6048060310 2023-10-18T21:22:53.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.935+0000 7f60477fe700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6030060f70 0x7f6030063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:53.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.936+0000 7f60477fe700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6030060f70 0x7f6030063430 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f603c004630 tx=0x7f603c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:53.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:53.939+0000 7f6044ff9700 1 -- 172.21.15.8:0/339903432 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f603804c580 con 0x7f6048060310 2023-10-18T21:22:54.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.165+0000 7f604d7ad700 1 -- 172.21.15.8:0/339903432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6048027a00 con 0x7f6048060310 2023-10-18T21:22:54.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.165+0000 7f6044ff9700 1 -- 172.21.15.8:0/339903432 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f603804fba0 con 0x7f6048060310 2023-10-18T21:22:54.166 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:22:54.167 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:22:54.167 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:22:54.167 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:22:54.167 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:22:54.167 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:22:54.168 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:22:54.168 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:22:54.168 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:22:54.168 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:22:54.168 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:22:54.169 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:22:54.169 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:22:54.169 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:22:54.169 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:22:54.169 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:22:54.170 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:22:54.170 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:22:54.170 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:22:54.170 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:22:54.170 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:22:54.171 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:22:54.171 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:22:54.171 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:22:54.171 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:22:54.171 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:22:54.172 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:22:54.172 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:22:54.172 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:22:54.172 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:22:54.172 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:22:54.172 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:22:54.173 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:22:54.173 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:22:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 -- 172.21.15.8:0/339903432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6030060f70 msgr2=0x7f6030063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6030060f70 0x7f6030063430 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f603c004630 tx=0x7f603c009b30).stop 2023-10-18T21:22:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 -- 172.21.15.8:0/339903432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6048060310 msgr2=0x7f60480f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6048060310 0x7f60480f6b90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f60380026d0 tx=0x7f6038009de0).stop 2023-10-18T21:22:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 -- 172.21.15.8:0/339903432 shutdown_connections 2023-10-18T21:22:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6030060f70 0x7f6030063430 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6048060310 0x7f60480f6b90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 --2- 172.21.15.8:0/339903432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60480f9690 0x7f60480f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 -- 172.21.15.8:0/339903432 >> 172.21.15.8:0/339903432 conn(0x7f60480f0b90 msgr2=0x7f60480f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 -- 172.21.15.8:0/339903432 shutdown_connections 2023-10-18T21:22:54.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.167+0000 7f604d7ad700 1 -- 172.21.15.8:0/339903432 wait complete. 2023-10-18T21:22:54.176 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:22:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.308+0000 7f25e22ed700 1 -- 172.21.15.8:0/1669667169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f77d0 msgr2=0x7f25dc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.308+0000 7f25e22ed700 1 --2- 172.21.15.8:0/1669667169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f77d0 0x7f25dc0f7c30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f25cc004660 tx=0x7f25cc009b30).stop 2023-10-18T21:22:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.308+0000 7f25e22ed700 1 -- 172.21.15.8:0/1669667169 shutdown_connections 2023-10-18T21:22:54.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.308+0000 7f25e22ed700 1 --2- 172.21.15.8:0/1669667169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f77d0 0x7f25dc0f7c30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:54.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.308+0000 7f25e22ed700 1 --2- 172.21.15.8:0/1669667169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f6530 0x7f25dc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:54.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.308+0000 7f25e22ed700 1 -- 172.21.15.8:0/1669667169 >> 172.21.15.8:0/1669667169 conn(0x7f25dc0f1c90 msgr2=0x7f25dc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:54.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.308+0000 7f25e22ed700 1 -- 172.21.15.8:0/1669667169 shutdown_connections 2023-10-18T21:22:54.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.308+0000 7f25e22ed700 1 -- 172.21.15.8:0/1669667169 wait complete. 2023-10-18T21:22:54.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.309+0000 7f25e22ed700 1 Processor -- start 2023-10-18T21:22:54.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.309+0000 7f25e22ed700 1 -- start start 2023-10-18T21:22:54.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.309+0000 7f25e22ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:54.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.309+0000 7f25e22ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f77d0 0x7f25dc109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:54.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.310+0000 7f25e22ed700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc1099c0 con 0x7f25dc0f6530 2023-10-18T21:22:54.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.310+0000 7f25e22ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc109b00 con 0x7f25dc0f77d0 2023-10-18T21:22:54.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.310+0000 7f25e12eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:54.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.310+0000 7f25e12eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39616/0 (socket says 172.21.15.8:39616) 2023-10-18T21:22:54.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.310+0000 7f25e12eb700 1 -- 172.21.15.8:0/1887757215 learned_addr learned my addr 172.21.15.8:0/1887757215 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:22:54.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.310+0000 7f25e0aea700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f77d0 0x7f25dc109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:54.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.310+0000 7f25e12eb700 1 -- 172.21.15.8:0/1887757215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f77d0 msgr2=0x7f25dc109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:54.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.310+0000 7f25e12eb700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f77d0 0x7f25dc109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.310+0000 7f25e12eb700 1 -- 172.21.15.8:0/1887757215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc005040 con 0x7f25dc0f6530 2023-10-18T21:22:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.310+0000 7f25e12eb700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108f20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f25d800e7c0 tx=0x7f25d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.311+0000 7f25d1ffb700 1 -- 172.21.15.8:0/1887757215 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25d80092e0 con 0x7f25dc0f6530 2023-10-18T21:22:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.311+0000 7f25d1ffb700 1 -- 172.21.15.8:0/1887757215 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f25d800f040 con 0x7f25dc0f6530 2023-10-18T21:22:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.311+0000 7f25e22ed700 1 -- 172.21.15.8:0/1887757215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc10a4a0 con 0x7f25dc0f6530 2023-10-18T21:22:54.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.311+0000 7f25d1ffb700 1 -- 172.21.15.8:0/1887757215 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25d8014810 con 0x7f25dc0f6530 2023-10-18T21:22:54.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.311+0000 7f25e22ed700 1 -- 172.21.15.8:0/1887757215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc10a9e0 con 0x7f25dc0f6530 2023-10-18T21:22:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.312+0000 7f25e22ed700 1 -- 172.21.15.8:0/1887757215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc045ad0 con 0x7f25dc0f6530 2023-10-18T21:22:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.313+0000 7f25d1ffb700 1 -- 172.21.15.8:0/1887757215 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f25d801b030 con 0x7f25dc0f6530 2023-10-18T21:22:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.313+0000 7f25d1ffb700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 0x7f25c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:22:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.314+0000 7f25d1ffb700 1 -- 172.21.15.8:0/1887757215 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f25d807c7c0 con 0x7f25dc0f6530 2023-10-18T21:22:54.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.314+0000 7f25e0aea700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 0x7f25c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:22:54.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.314+0000 7f25e0aea700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 0x7f25c8063430 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f25cc005010 tx=0x7f25cc016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:22:54.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.318+0000 7f25d1ffb700 1 -- 172.21.15.8:0/1887757215 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f25d804fe60 con 0x7f25dc0f6530 2023-10-18T21:22:54.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.515+0000 7f25e22ed700 1 -- 172.21.15.8:0/1887757215 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25dc0fee00 con 0x7f25c8060f70 2023-10-18T21:22:54.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.516+0000 7f25d1ffb700 1 -- 172.21.15.8:0/1887757215 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f25dc0fee00 con 0x7f25c8060f70 2023-10-18T21:22:54.517 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:22:54.517 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:22:54.518 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:22:54.518 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:22:54.518 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:22:54.518 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:22:54.518 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:22:54.519 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:22:54.519 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:22:54.519 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:22:54.519 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:22:54.519 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:22:54.520 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:22:54.520 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:22:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.518+0000 7f25e22ed700 1 -- 172.21.15.8:0/1887757215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 msgr2=0x7f25c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.518+0000 7f25e22ed700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 0x7f25c8063430 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f25cc005010 tx=0x7f25cc016040).stop 2023-10-18T21:22:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.518+0000 7f25e22ed700 1 -- 172.21.15.8:0/1887757215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 msgr2=0x7f25dc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:22:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.518+0000 7f25e22ed700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108f20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f25d800e7c0 tx=0x7f25d800b040).stop 2023-10-18T21:22:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.518+0000 7f25e22ed700 1 -- 172.21.15.8:0/1887757215 shutdown_connections 2023-10-18T21:22:54.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.518+0000 7f25e22ed700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25c8060f70 0x7f25c8063430 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:54.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.518+0000 7f25e22ed700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25dc0f6530 0x7f25dc108f20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:54.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.518+0000 7f25e22ed700 1 --2- 172.21.15.8:0/1887757215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25dc0f77d0 0x7f25dc109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:22:54.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.518+0000 7f25e22ed700 1 -- 172.21.15.8:0/1887757215 >> 172.21.15.8:0/1887757215 conn(0x7f25dc0f1c90 msgr2=0x7f25dc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:22:54.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.519+0000 7f25e22ed700 1 -- 172.21.15.8:0/1887757215 shutdown_connections 2023-10-18T21:22:54.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:22:54.519+0000 7f25e22ed700 1 -- 172.21.15.8:0/1887757215 wait complete. 2023-10-18T21:22:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:53.037752+0000 mgr.smithi008.flmjzp (mgr.14640) 1445 : audit [DBG] from='client.35348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:53.378083+0000 mgr.smithi008.flmjzp (mgr.14640) 1446 : audit [DBG] from='client.35352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:53.787753+0000 mon.smithi008 (mon.0) 1920 : audit [DBG] from='client.? 172.21.15.8:0/718763216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:53.926045+0000 mon.smithi008 (mon.0) 1921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.165784+0000 mon.smithi008 (mon.0) 1922 : audit [DBG] from='client.? 172.21.15.8:0/339903432' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:22:54.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:53.037752+0000 mgr.smithi008.flmjzp (mgr.14640) 1445 : audit [DBG] from='client.35348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:54.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:53.378083+0000 mgr.smithi008.flmjzp (mgr.14640) 1446 : audit [DBG] from='client.35352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:53.787753+0000 mon.smithi008 (mon.0) 1920 : audit [DBG] from='client.? 172.21.15.8:0/718763216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:53.926045+0000 mon.smithi008 (mon.0) 1921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.165784+0000 mon.smithi008 (mon.0) 1922 : audit [DBG] from='client.? 172.21.15.8:0/339903432' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:22:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:53.896536+0000 mgr.smithi008.flmjzp (mgr.14640) 1447 : cluster [DBG] pgmap v1006: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.280847+0000 mon.smithi008 (mon.0) 1923 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.281725+0000 mon.smithi008 (mon.0) 1924 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.282487+0000 mon.smithi008 (mon.0) 1925 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:54.283194+0000 mgr.smithi008.flmjzp (mgr.14640) 1448 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:54.283706+0000 mgr.smithi008.flmjzp (mgr.14640) 1449 : cluster [DBG] pgmap v1007: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:54.283904+0000 mgr.smithi008.flmjzp (mgr.14640) 1450 : cluster [DBG] pgmap v1008: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.288366+0000 mon.smithi008 (mon.0) 1926 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:55.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.293534+0000 mon.smithi008 (mon.0) 1927 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:55.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.296183+0000 mon.smithi008 (mon.0) 1928 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:55.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.297593+0000 mon.smithi008 (mon.0) 1929 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:55.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.298985+0000 mon.smithi008 (mon.0) 1930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:55.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.300705+0000 mon.smithi008 (mon.0) 1931 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:55.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:22:54.302507+0000 mgr.smithi008.flmjzp (mgr.14640) 1451 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:55.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:22:54.516579+0000 mgr.smithi008.flmjzp (mgr.14640) 1452 : audit [DBG] from='client.35364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:55.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:53.896536+0000 mgr.smithi008.flmjzp (mgr.14640) 1447 : cluster [DBG] pgmap v1006: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.280847+0000 mon.smithi008 (mon.0) 1923 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.281725+0000 mon.smithi008 (mon.0) 1924 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:22:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.282487+0000 mon.smithi008 (mon.0) 1925 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:22:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:54.283194+0000 mgr.smithi008.flmjzp (mgr.14640) 1448 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:22:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:54.283706+0000 mgr.smithi008.flmjzp (mgr.14640) 1449 : cluster [DBG] pgmap v1007: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:54.283904+0000 mgr.smithi008.flmjzp (mgr.14640) 1450 : cluster [DBG] pgmap v1008: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.288366+0000 mon.smithi008 (mon.0) 1926 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:22:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.293534+0000 mon.smithi008 (mon.0) 1927 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:22:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.296183+0000 mon.smithi008 (mon.0) 1928 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.297593+0000 mon.smithi008 (mon.0) 1929 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:55.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.298985+0000 mon.smithi008 (mon.0) 1930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:55.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.300705+0000 mon.smithi008 (mon.0) 1931 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:22:55.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:22:54.302507+0000 mgr.smithi008.flmjzp (mgr.14640) 1451 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:22:55.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:22:54.516579+0000 mgr.smithi008.flmjzp (mgr.14640) 1452 : audit [DBG] from='client.35364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:22:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:56.284583+0000 mgr.smithi008.flmjzp (mgr.14640) 1453 : cluster [DBG] pgmap v1009: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:57.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:56.284583+0000 mgr.smithi008.flmjzp (mgr.14640) 1453 : cluster [DBG] pgmap v1009: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:22:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:22:58.285137+0000 mgr.smithi008.flmjzp (mgr.14640) 1454 : cluster [DBG] pgmap v1010: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:22:59.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:22:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:22:58.285137+0000 mgr.smithi008.flmjzp (mgr.14640) 1454 : cluster [DBG] pgmap v1010: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:00.285927+0000 mgr.smithi008.flmjzp (mgr.14640) 1455 : cluster [DBG] pgmap v1011: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:00.285927+0000 mgr.smithi008.flmjzp (mgr.14640) 1455 : cluster [DBG] pgmap v1011: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:02.286680+0000 mgr.smithi008.flmjzp (mgr.14640) 1456 : cluster [DBG] pgmap v1012: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:03.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:02.286680+0000 mgr.smithi008.flmjzp (mgr.14640) 1456 : cluster [DBG] pgmap v1012: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:04.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:04.308313+0000 mon.smithi008 (mon.0) 1932 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:04.308313+0000 mon.smithi008 (mon.0) 1932 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:04.287498+0000 mgr.smithi008.flmjzp (mgr.14640) 1457 : cluster [DBG] pgmap v1013: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:04.876685+0000 mon.smithi008 (mon.0) 1933 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:04.877502+0000 mon.smithi008 (mon.0) 1934 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:04.882785+0000 mon.smithi008 (mon.0) 1935 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:04.887796+0000 mon.smithi008 (mon.0) 1936 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:04.890147+0000 mon.smithi008 (mon.0) 1937 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:04.891321+0000 mon.smithi008 (mon.0) 1938 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:04.892456+0000 mon.smithi008 (mon.0) 1939 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:04.894282+0000 mon.smithi008 (mon.0) 1940 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:05.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:04.287498+0000 mgr.smithi008.flmjzp (mgr.14640) 1457 : cluster [DBG] pgmap v1013: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:04.876685+0000 mon.smithi008 (mon.0) 1933 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:04.877502+0000 mon.smithi008 (mon.0) 1934 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:04.882785+0000 mon.smithi008 (mon.0) 1935 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:04.887796+0000 mon.smithi008 (mon.0) 1936 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:04.890147+0000 mon.smithi008 (mon.0) 1937 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:04.891321+0000 mon.smithi008 (mon.0) 1938 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:04.892456+0000 mon.smithi008 (mon.0) 1939 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:04.894282+0000 mon.smithi008 (mon.0) 1940 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:04.878165+0000 mgr.smithi008.flmjzp (mgr.14640) 1458 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:04.878719+0000 mgr.smithi008.flmjzp (mgr.14640) 1459 : cluster [DBG] pgmap v1014: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:04.878913+0000 mgr.smithi008.flmjzp (mgr.14640) 1460 : cluster [DBG] pgmap v1015: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:04.895959+0000 mgr.smithi008.flmjzp (mgr.14640) 1461 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:06.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:04.878165+0000 mgr.smithi008.flmjzp (mgr.14640) 1458 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:04.878719+0000 mgr.smithi008.flmjzp (mgr.14640) 1459 : cluster [DBG] pgmap v1014: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:04.878913+0000 mgr.smithi008.flmjzp (mgr.14640) 1460 : cluster [DBG] pgmap v1015: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:04.895959+0000 mgr.smithi008.flmjzp (mgr.14640) 1461 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:06.879474+0000 mgr.smithi008.flmjzp (mgr.14640) 1462 : cluster [DBG] pgmap v1016: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:08.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:06.879474+0000 mgr.smithi008.flmjzp (mgr.14640) 1462 : cluster [DBG] pgmap v1016: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:08.880100+0000 mgr.smithi008.flmjzp (mgr.14640) 1463 : cluster [DBG] pgmap v1017: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:10.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:08.880100+0000 mgr.smithi008.flmjzp (mgr.14640) 1463 : cluster [DBG] pgmap v1017: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:10.880664+0000 mgr.smithi008.flmjzp (mgr.14640) 1464 : cluster [DBG] pgmap v1018: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:12.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:10.880664+0000 mgr.smithi008.flmjzp (mgr.14640) 1464 : cluster [DBG] pgmap v1018: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:12.881291+0000 mgr.smithi008.flmjzp (mgr.14640) 1465 : cluster [DBG] pgmap v1019: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:14.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:12.881291+0000 mgr.smithi008.flmjzp (mgr.14640) 1465 : cluster [DBG] pgmap v1019: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:14.905799+0000 mon.smithi008 (mon.0) 1941 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:14.907942+0000 mon.smithi008 (mon.0) 1942 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:14.908939+0000 mon.smithi008 (mon.0) 1943 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:14.915605+0000 mon.smithi008 (mon.0) 1944 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:14.922071+0000 mon.smithi008 (mon.0) 1945 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:14.925187+0000 mon.smithi008 (mon.0) 1946 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:14.926886+0000 mon.smithi008 (mon.0) 1947 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:14.928553+0000 mon.smithi008 (mon.0) 1948 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:15.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:14.930551+0000 mon.smithi008 (mon.0) 1949 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:15.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:14.905799+0000 mon.smithi008 (mon.0) 1941 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:14.907942+0000 mon.smithi008 (mon.0) 1942 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:14.908939+0000 mon.smithi008 (mon.0) 1943 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:14.915605+0000 mon.smithi008 (mon.0) 1944 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:14.922071+0000 mon.smithi008 (mon.0) 1945 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:14.925187+0000 mon.smithi008 (mon.0) 1946 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:14.926886+0000 mon.smithi008 (mon.0) 1947 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:14.928553+0000 mon.smithi008 (mon.0) 1948 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:14.930551+0000 mon.smithi008 (mon.0) 1949 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:14.881891+0000 mgr.smithi008.flmjzp (mgr.14640) 1466 : cluster [DBG] pgmap v1020: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:14.909842+0000 mgr.smithi008.flmjzp (mgr.14640) 1467 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:14.910345+0000 mgr.smithi008.flmjzp (mgr.14640) 1468 : cluster [DBG] pgmap v1021: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:14.910683+0000 mgr.smithi008.flmjzp (mgr.14640) 1469 : cluster [DBG] pgmap v1022: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:14.932379+0000 mgr.smithi008.flmjzp (mgr.14640) 1470 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:14.881891+0000 mgr.smithi008.flmjzp (mgr.14640) 1466 : cluster [DBG] pgmap v1020: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:14.909842+0000 mgr.smithi008.flmjzp (mgr.14640) 1467 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:14.910345+0000 mgr.smithi008.flmjzp (mgr.14640) 1468 : cluster [DBG] pgmap v1021: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:14.910683+0000 mgr.smithi008.flmjzp (mgr.14640) 1469 : cluster [DBG] pgmap v1022: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:14.932379+0000 mgr.smithi008.flmjzp (mgr.14640) 1470 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:16.911347+0000 mgr.smithi008.flmjzp (mgr.14640) 1471 : cluster [DBG] pgmap v1023: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:18.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:16.911347+0000 mgr.smithi008.flmjzp (mgr.14640) 1471 : cluster [DBG] pgmap v1023: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:18.912048+0000 mgr.smithi008.flmjzp (mgr.14640) 1472 : cluster [DBG] pgmap v1024: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:20.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:18.912048+0000 mgr.smithi008.flmjzp (mgr.14640) 1472 : cluster [DBG] pgmap v1024: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:20.912849+0000 mgr.smithi008.flmjzp (mgr.14640) 1473 : cluster [DBG] pgmap v1025: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:22.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:20.912849+0000 mgr.smithi008.flmjzp (mgr.14640) 1473 : cluster [DBG] pgmap v1025: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:24.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:22.913585+0000 mgr.smithi008.flmjzp (mgr.14640) 1474 : cluster [DBG] pgmap v1026: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.674+0000 7ff38b59e700 1 -- 172.21.15.8:0/196991718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff38c0f77d0 msgr2=0x7ff38c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.674+0000 7ff38b59e700 1 --2- 172.21.15.8:0/196991718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff38c0f77d0 0x7ff38c0f7c30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7ff380004660 tx=0x7ff380009b30).stop 2023-10-18T21:23:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.674+0000 7ff38b59e700 1 -- 172.21.15.8:0/196991718 shutdown_connections 2023-10-18T21:23:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.674+0000 7ff38b59e700 1 --2- 172.21.15.8:0/196991718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff38c0f77d0 0x7ff38c0f7c30 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.674+0000 7ff38b59e700 1 --2- 172.21.15.8:0/196991718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff38c0f6530 0x7ff38c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.674+0000 7ff38b59e700 1 -- 172.21.15.8:0/196991718 >> 172.21.15.8:0/196991718 conn(0x7ff38c0f1c90 msgr2=0x7ff38c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.674+0000 7ff38b59e700 1 -- 172.21.15.8:0/196991718 shutdown_connections 2023-10-18T21:23:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.674+0000 7ff38b59e700 1 -- 172.21.15.8:0/196991718 wait complete. 2023-10-18T21:23:24.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.675+0000 7ff38b59e700 1 Processor -- start 2023-10-18T21:23:24.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.676+0000 7ff38b59e700 1 -- start start 2023-10-18T21:23:24.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.676+0000 7ff38b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff38c0f6530 0x7ff38c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:24.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.676+0000 7ff38b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:24.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.676+0000 7ff38b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c107880 con 0x7ff38c0f77d0 2023-10-18T21:23:24.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.676+0000 7ff38b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c1080c0 con 0x7ff38c0f6530 2023-10-18T21:23:24.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.676+0000 7ff389d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:24.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.676+0000 7ff38a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff38c0f6530 0x7ff38c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:24.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.676+0000 7ff389d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58758/0 (socket says 172.21.15.8:58758) 2023-10-18T21:23:24.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.676+0000 7ff389d9b700 1 -- 172.21.15.8:0/1704109461 learned_addr learned my addr 172.21.15.8:0/1704109461 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:24.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.677+0000 7ff389d9b700 1 -- 172.21.15.8:0/1704109461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff38c0f6530 msgr2=0x7ff38c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:24.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.677+0000 7ff389d9b700 1 --2- 172.21.15.8:0/1704109461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff38c0f6530 0x7ff38c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:24.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.677+0000 7ff389d9b700 1 -- 172.21.15.8:0/1704109461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380005040 con 0x7ff38c0f77d0 2023-10-18T21:23:24.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.677+0000 7ff389d9b700 1 --2- 172.21.15.8:0/1704109461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107280 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7ff380009f50 tx=0x7ff380009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:24.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.677+0000 7ff37affd700 1 -- 172.21.15.8:0/1704109461 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff380018070 con 0x7ff38c0f77d0 2023-10-18T21:23:24.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.677+0000 7ff37affd700 1 -- 172.21.15.8:0/1704109461 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff380009630 con 0x7ff38c0f77d0 2023-10-18T21:23:24.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.677+0000 7ff37affd700 1 -- 172.21.15.8:0/1704109461 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff38001c3c0 con 0x7ff38c0f77d0 2023-10-18T21:23:24.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.677+0000 7ff38b59e700 1 -- 172.21.15.8:0/1704109461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c108340 con 0x7ff38c0f77d0 2023-10-18T21:23:24.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.678+0000 7ff38b59e700 1 -- 172.21.15.8:0/1704109461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c108820 con 0x7ff38c0f77d0 2023-10-18T21:23:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.679+0000 7ff38b59e700 1 -- 172.21.15.8:0/1704109461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c059100 con 0x7ff38c0f77d0 2023-10-18T21:23:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.680+0000 7ff37affd700 1 -- 172.21.15.8:0/1704109461 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff38001d420 con 0x7ff38c0f77d0 2023-10-18T21:23:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.680+0000 7ff37affd700 1 --2- 172.21.15.8:0/1704109461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff374060f70 0x7ff374063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.681+0000 7ff37affd700 1 -- 172.21.15.8:0/1704109461 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff38007e540 con 0x7ff38c0f77d0 2023-10-18T21:23:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.681+0000 7ff38a59c700 1 --2- 172.21.15.8:0/1704109461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff374060f70 0x7ff374063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:24.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.681+0000 7ff38a59c700 1 --2- 172.21.15.8:0/1704109461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff374060f70 0x7ff374063430 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7ff38c107b50 tx=0x7ff37c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:24.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.685+0000 7ff37affd700 1 -- 172.21.15.8:0/1704109461 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff38004e170 con 0x7ff38c0f77d0 2023-10-18T21:23:24.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:22.913585+0000 mgr.smithi008.flmjzp (mgr.14640) 1474 : cluster [DBG] pgmap v1026: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:24.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.886+0000 7ff38b59e700 1 -- 172.21.15.8:0/1704109461 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff38c0fed30 con 0x7ff374060f70 2023-10-18T21:23:24.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.888+0000 7ff37affd700 1 -- 172.21.15.8:0/1704109461 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff38c0fed30 con 0x7ff374060f70 2023-10-18T21:23:24.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 -- 172.21.15.8:0/1704109461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff374060f70 msgr2=0x7ff374063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:24.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 --2- 172.21.15.8:0/1704109461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff374060f70 0x7ff374063430 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7ff38c107b50 tx=0x7ff37c00b040).stop 2023-10-18T21:23:24.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 -- 172.21.15.8:0/1704109461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff38c0f77d0 msgr2=0x7ff38c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:24.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 --2- 172.21.15.8:0/1704109461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107280 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7ff380009f50 tx=0x7ff380009b30).stop 2023-10-18T21:23:24.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 -- 172.21.15.8:0/1704109461 shutdown_connections 2023-10-18T21:23:24.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 --2- 172.21.15.8:0/1704109461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff374060f70 0x7ff374063430 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:24.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 --2- 172.21.15.8:0/1704109461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff38c0f6530 0x7ff38c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:24.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 --2- 172.21.15.8:0/1704109461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff38c0f77d0 0x7ff38c107280 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:24.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 -- 172.21.15.8:0/1704109461 >> 172.21.15.8:0/1704109461 conn(0x7ff38c0f1c90 msgr2=0x7ff38c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:24.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 -- 172.21.15.8:0/1704109461 shutdown_connections 2023-10-18T21:23:24.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:24.890+0000 7ff38b59e700 1 -- 172.21.15.8:0/1704109461 wait complete. 2023-10-18T21:23:24.907 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:23:25.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.031+0000 7f0da4fe6700 1 -- 172.21.15.8:0/1565199744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da00f77d0 msgr2=0x7f0da00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:25.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.031+0000 7f0da4fe6700 1 --2- 172.21.15.8:0/1565199744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da00f77d0 0x7f0da00f7c30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f0d94004660 tx=0x7f0d94009b30).stop 2023-10-18T21:23:25.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.031+0000 7f0da4fe6700 1 -- 172.21.15.8:0/1565199744 shutdown_connections 2023-10-18T21:23:25.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.031+0000 7f0da4fe6700 1 --2- 172.21.15.8:0/1565199744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da00f77d0 0x7f0da00f7c30 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.031+0000 7f0da4fe6700 1 --2- 172.21.15.8:0/1565199744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da00f6530 0x7f0da00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.031+0000 7f0da4fe6700 1 -- 172.21.15.8:0/1565199744 >> 172.21.15.8:0/1565199744 conn(0x7f0da00f1c90 msgr2=0x7f0da00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:25.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.031+0000 7f0da4fe6700 1 -- 172.21.15.8:0/1565199744 shutdown_connections 2023-10-18T21:23:25.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.031+0000 7f0da4fe6700 1 -- 172.21.15.8:0/1565199744 wait complete. 2023-10-18T21:23:25.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.032+0000 7f0da4fe6700 1 Processor -- start 2023-10-18T21:23:25.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.032+0000 7f0da4fe6700 1 -- start start 2023-10-18T21:23:25.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.032+0000 7f0da4fe6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da00f6530 0x7f0da00ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:25.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.032+0000 7f0da4fe6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da00f77d0 0x7f0da00ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.032+0000 7f0da4fe6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0100440 con 0x7f0da00f6530 2023-10-18T21:23:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.032+0000 7f0da4fe6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0100580 con 0x7f0da00f77d0 2023-10-18T21:23:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.033+0000 7f0d9f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da00f6530 0x7f0da00ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.033+0000 7f0d9f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da00f6530 0x7f0da00ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58778/0 (socket says 172.21.15.8:58778) 2023-10-18T21:23:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.033+0000 7f0d9f7fe700 1 -- 172.21.15.8:0/2906603830 learned_addr learned my addr 172.21.15.8:0/2906603830 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:25.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.033+0000 7f0d9effd700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da00f77d0 0x7f0da00ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:25.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.033+0000 7f0d9f7fe700 1 -- 172.21.15.8:0/2906603830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da00f77d0 msgr2=0x7f0da00ffe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:25.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.033+0000 7f0d9f7fe700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da00f77d0 0x7f0da00ffe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.033+0000 7f0d9f7fe700 1 -- 172.21.15.8:0/2906603830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d94005040 con 0x7f0da00f6530 2023-10-18T21:23:25.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.033+0000 7f0d9f7fe700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da00f6530 0x7f0da00ff950 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f0d90002700 tx=0x7f0d90009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:25.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.033+0000 7f0d87fff700 1 -- 172.21.15.8:0/2906603830 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d900079c0 con 0x7f0da00f6530 2023-10-18T21:23:25.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.034+0000 7f0d87fff700 1 -- 172.21.15.8:0/2906603830 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0d9000f040 con 0x7f0da00f6530 2023-10-18T21:23:25.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.034+0000 7f0d87fff700 1 -- 172.21.15.8:0/2906603830 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d900148d0 con 0x7f0da00f6530 2023-10-18T21:23:25.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.034+0000 7f0da4fe6700 1 -- 172.21.15.8:0/2906603830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da0100ef0 con 0x7f0da00f6530 2023-10-18T21:23:25.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.034+0000 7f0da4fe6700 1 -- 172.21.15.8:0/2906603830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da01014b0 con 0x7f0da00f6530 2023-10-18T21:23:25.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.035+0000 7f0da4fe6700 1 -- 172.21.15.8:0/2906603830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da0045ad0 con 0x7f0da00f6530 2023-10-18T21:23:25.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.036+0000 7f0d87fff700 1 -- 172.21.15.8:0/2906603830 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0d9001b060 con 0x7f0da00f6530 2023-10-18T21:23:25.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.037+0000 7f0d87fff700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 0x7f0d88063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:25.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.037+0000 7f0d87fff700 1 -- 172.21.15.8:0/2906603830 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0d9007c770 con 0x7f0da00f6530 2023-10-18T21:23:25.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.037+0000 7f0d9effd700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 0x7f0d88063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:25.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.038+0000 7f0d9effd700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 0x7f0d88063430 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f0d94004630 tx=0x7f0d94009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:25.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.041+0000 7f0d87fff700 1 -- 172.21.15.8:0/2906603830 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0d9004c3a0 con 0x7f0da00f6530 2023-10-18T21:23:25.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.242+0000 7f0da4fe6700 1 -- 172.21.15.8:0/2906603830 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0da00fee40 con 0x7f0d88060f70 2023-10-18T21:23:25.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.243+0000 7f0d87fff700 1 -- 172.21.15.8:0/2906603830 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0da00fee40 con 0x7f0d88060f70 2023-10-18T21:23:25.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.245+0000 7f0da4fe6700 1 -- 172.21.15.8:0/2906603830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 msgr2=0x7f0d88063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:25.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.245+0000 7f0da4fe6700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 0x7f0d88063430 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f0d94004630 tx=0x7f0d94009b30).stop 2023-10-18T21:23:25.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.245+0000 7f0da4fe6700 1 -- 172.21.15.8:0/2906603830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da00f6530 msgr2=0x7f0da00ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:25.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.245+0000 7f0da4fe6700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da00f6530 0x7f0da00ff950 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f0d90002700 tx=0x7f0d90009d80).stop 2023-10-18T21:23:25.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.245+0000 7f0da4fe6700 1 -- 172.21.15.8:0/2906603830 shutdown_connections 2023-10-18T21:23:25.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.245+0000 7f0da4fe6700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 0x7f0d88063430 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.245+0000 7f0da4fe6700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da00f6530 0x7f0da00ff950 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.245+0000 7f0da4fe6700 1 --2- 172.21.15.8:0/2906603830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0da00f77d0 0x7f0da00ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.245+0000 7f0da4fe6700 1 -- 172.21.15.8:0/2906603830 >> 172.21.15.8:0/2906603830 conn(0x7f0da00f1c90 msgr2=0x7f0da006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:25.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.245+0000 7f0da4fe6700 1 -- 172.21.15.8:0/2906603830 shutdown_connections 2023-10-18T21:23:25.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.246+0000 7f0da4fe6700 1 -- 172.21.15.8:0/2906603830 wait complete. 2023-10-18T21:23:25.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.381+0000 7ff3156cf700 1 -- 172.21.15.8:0/4012757040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3100f7750 msgr2=0x7ff3100f7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.381+0000 7ff3156cf700 1 --2- 172.21.15.8:0/4012757040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3100f7750 0x7ff3100f7bb0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7ff304004660 tx=0x7ff304009b30).stop 2023-10-18T21:23:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.381+0000 7ff3156cf700 1 -- 172.21.15.8:0/4012757040 shutdown_connections 2023-10-18T21:23:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.381+0000 7ff3156cf700 1 --2- 172.21.15.8:0/4012757040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3100f7750 0x7ff3100f7bb0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.381+0000 7ff3156cf700 1 --2- 172.21.15.8:0/4012757040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3100f64b0 0x7ff3100f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.381+0000 7ff3156cf700 1 -- 172.21.15.8:0/4012757040 >> 172.21.15.8:0/4012757040 conn(0x7ff3100f1c30 msgr2=0x7ff3100f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:25.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.381+0000 7ff3156cf700 1 -- 172.21.15.8:0/4012757040 shutdown_connections 2023-10-18T21:23:25.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.381+0000 7ff3156cf700 1 -- 172.21.15.8:0/4012757040 wait complete. 2023-10-18T21:23:25.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.382+0000 7ff3156cf700 1 Processor -- start 2023-10-18T21:23:25.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.382+0000 7ff3156cf700 1 -- start start 2023-10-18T21:23:25.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff3156cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3100f64b0 0x7ff310106d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:25.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff3156cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3100f7750 0x7ff310107200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:25.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff3156cf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3101077b0 con 0x7ff3100f7750 2023-10-18T21:23:25.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff3156cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff310107fb0 con 0x7ff3100f64b0 2023-10-18T21:23:25.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff30f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3100f7750 0x7ff310107200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:25.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff30ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3100f64b0 0x7ff310106d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:25.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff30f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3100f7750 0x7ff310107200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58806/0 (socket says 172.21.15.8:58806) 2023-10-18T21:23:25.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff30f7fe700 1 -- 172.21.15.8:0/3839548919 learned_addr learned my addr 172.21.15.8:0/3839548919 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:25.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff30f7fe700 1 -- 172.21.15.8:0/3839548919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3100f64b0 msgr2=0x7ff310106d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:25.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff30f7fe700 1 --2- 172.21.15.8:0/3839548919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3100f64b0 0x7ff310106d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.383+0000 7ff30f7fe700 1 -- 172.21.15.8:0/3839548919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304005040 con 0x7ff3100f7750 2023-10-18T21:23:25.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.384+0000 7ff30f7fe700 1 --2- 172.21.15.8:0/3839548919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3100f7750 0x7ff310107200 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7ff304004320 tx=0x7ff30400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:25.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.384+0000 7ff30cff9700 1 -- 172.21.15.8:0/3839548919 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff304019070 con 0x7ff3100f7750 2023-10-18T21:23:25.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.384+0000 7ff30cff9700 1 -- 172.21.15.8:0/3839548919 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff30401e420 con 0x7ff3100f7750 2023-10-18T21:23:25.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.384+0000 7ff30cff9700 1 -- 172.21.15.8:0/3839548919 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff304014680 con 0x7ff3100f7750 2023-10-18T21:23:25.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.384+0000 7ff3156cf700 1 -- 172.21.15.8:0/3839548919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff310108230 con 0x7ff3100f7750 2023-10-18T21:23:25.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.384+0000 7ff3156cf700 1 -- 172.21.15.8:0/3839548919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff310108710 con 0x7ff3100f7750 2023-10-18T21:23:25.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.385+0000 7ff3156cf700 1 -- 172.21.15.8:0/3839548919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff310059100 con 0x7ff3100f7750 2023-10-18T21:23:25.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.386+0000 7ff30cff9700 1 -- 172.21.15.8:0/3839548919 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff30401e590 con 0x7ff3100f7750 2023-10-18T21:23:25.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.387+0000 7ff30cff9700 1 --2- 172.21.15.8:0/3839548919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2f8060f70 0x7ff2f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:25.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.387+0000 7ff30cff9700 1 -- 172.21.15.8:0/3839548919 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff30407dd10 con 0x7ff3100f7750 2023-10-18T21:23:25.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.387+0000 7ff30ffff700 1 --2- 172.21.15.8:0/3839548919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2f8060f70 0x7ff2f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:25.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.388+0000 7ff30ffff700 1 --2- 172.21.15.8:0/3839548919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2f8060f70 0x7ff2f8063430 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff3100f75b0 tx=0x7ff30000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:25.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.391+0000 7ff30cff9700 1 -- 172.21.15.8:0/3839548919 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff304051310 con 0x7ff3100f7750 2023-10-18T21:23:25.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.588+0000 7ff3156cf700 1 -- 172.21.15.8:0/3839548919 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3100fecb0 con 0x7ff2f8060f70 2023-10-18T21:23:25.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.598+0000 7ff30cff9700 1 -- 172.21.15.8:0/3839548919 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff3100fecb0 con 0x7ff2f8060f70 2023-10-18T21:23:25.600 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:23:25.600 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (30m) 8m ago 31m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:23:25.600 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (23m) 8m ago 31m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:23:25.601 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (23m) 5m ago 30m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:23:25.601 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (30m) 8m ago 31m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:23:25.601 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 27m - - 2023-10-18T21:23:25.601 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 27m - - 2023-10-18T21:23:25.601 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 27m - - 2023-10-18T21:23:25.602 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 27m - - 2023-10-18T21:23:25.602 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (25m) 8m ago 32m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:23:25.602 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (24m) 5m ago 30m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:23:25.602 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (24m) 8m ago 33m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:23:25.602 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (24m) 5m ago 30m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:23:25.603 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (31m) 8m ago 31m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:23:25.603 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (30m) 5m ago 30m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:23:25.603 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (23m) 8m ago 30m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:23:25.603 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (21m) 8m ago 29m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:23:25.603 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (21m) 8m ago 29m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:23:25.604 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (20m) 5m ago 29m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:23:25.604 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (20m) 5m ago 28m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:23:25.604 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (19m) 5m ago 28m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:23:25.604 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (25m) 8m ago 30m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:23:25.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 -- 172.21.15.8:0/3839548919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2f8060f70 msgr2=0x7ff2f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:25.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 --2- 172.21.15.8:0/3839548919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2f8060f70 0x7ff2f8063430 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff3100f75b0 tx=0x7ff30000b040).stop 2023-10-18T21:23:25.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 -- 172.21.15.8:0/3839548919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3100f7750 msgr2=0x7ff310107200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:25.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 --2- 172.21.15.8:0/3839548919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3100f7750 0x7ff310107200 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7ff304004320 tx=0x7ff30400b040).stop 2023-10-18T21:23:25.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 -- 172.21.15.8:0/3839548919 shutdown_connections 2023-10-18T21:23:25.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 --2- 172.21.15.8:0/3839548919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2f8060f70 0x7ff2f8063430 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 --2- 172.21.15.8:0/3839548919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3100f64b0 0x7ff310106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 --2- 172.21.15.8:0/3839548919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3100f7750 0x7ff310107200 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 -- 172.21.15.8:0/3839548919 >> 172.21.15.8:0/3839548919 conn(0x7ff3100f1c30 msgr2=0x7ff3100fb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:25.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 -- 172.21.15.8:0/3839548919 shutdown_connections 2023-10-18T21:23:25.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.600+0000 7ff3156cf700 1 -- 172.21.15.8:0/3839548919 wait complete. 2023-10-18T21:23:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:24.942039+0000 mon.smithi008 (mon.0) 1950 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:25.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:24.942039+0000 mon.smithi008 (mon.0) 1950 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:25.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.736+0000 7f03dd543700 1 -- 172.21.15.8:0/3640482384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d80f77d0 msgr2=0x7f03d80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:25.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.736+0000 7f03dd543700 1 --2- 172.21.15.8:0/3640482384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d80f77d0 0x7f03d80f7c30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f03cc004660 tx=0x7f03cc009b30).stop 2023-10-18T21:23:25.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.736+0000 7f03dd543700 1 -- 172.21.15.8:0/3640482384 shutdown_connections 2023-10-18T21:23:25.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.736+0000 7f03dd543700 1 --2- 172.21.15.8:0/3640482384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d80f77d0 0x7f03d80f7c30 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.736+0000 7f03dd543700 1 --2- 172.21.15.8:0/3640482384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d80f6530 0x7f03d80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.736+0000 7f03dd543700 1 -- 172.21.15.8:0/3640482384 >> 172.21.15.8:0/3640482384 conn(0x7f03d80f1c90 msgr2=0x7f03d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:25.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.736+0000 7f03dd543700 1 -- 172.21.15.8:0/3640482384 shutdown_connections 2023-10-18T21:23:25.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.736+0000 7f03dd543700 1 -- 172.21.15.8:0/3640482384 wait complete. 2023-10-18T21:23:25.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.737+0000 7f03dd543700 1 Processor -- start 2023-10-18T21:23:25.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.738+0000 7f03dd543700 1 -- start start 2023-10-18T21:23:25.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.738+0000 7f03dd543700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d80f6530 0x7f03d8106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:25.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.738+0000 7f03dd543700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d80f77d0 0x7f03d8107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:25.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.738+0000 7f03dd543700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d8107850 con 0x7f03d80f6530 2023-10-18T21:23:25.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.738+0000 7f03dd543700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d8108060 con 0x7f03d80f77d0 2023-10-18T21:23:25.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.738+0000 7f03d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d80f6530 0x7f03d8106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.738+0000 7f03d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d80f6530 0x7f03d8106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58836/0 (socket says 172.21.15.8:58836) 2023-10-18T21:23:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.738+0000 7f03d7fff700 1 -- 172.21.15.8:0/802263052 learned_addr learned my addr 172.21.15.8:0/802263052 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.739+0000 7f03d77fe700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d80f77d0 0x7f03d8107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.739+0000 7f03d7fff700 1 -- 172.21.15.8:0/802263052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d80f77d0 msgr2=0x7f03d8107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:25.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.739+0000 7f03d7fff700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d80f77d0 0x7f03d8107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.739+0000 7f03d7fff700 1 -- 172.21.15.8:0/802263052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc005040 con 0x7f03d80f6530 2023-10-18T21:23:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.739+0000 7f03d7fff700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d80f6530 0x7f03d8106d60 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f03c800e7c0 tx=0x7f03c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.739+0000 7f03d4ff9700 1 -- 172.21.15.8:0/802263052 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c80092e0 con 0x7f03d80f6530 2023-10-18T21:23:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.739+0000 7f03d4ff9700 1 -- 172.21.15.8:0/802263052 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f03c800f040 con 0x7f03d80f6530 2023-10-18T21:23:25.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.739+0000 7f03dd543700 1 -- 172.21.15.8:0/802263052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d81082e0 con 0x7f03d80f6530 2023-10-18T21:23:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.739+0000 7f03d4ff9700 1 -- 172.21.15.8:0/802263052 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c8014810 con 0x7f03d80f6530 2023-10-18T21:23:25.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.740+0000 7f03dd543700 1 -- 172.21.15.8:0/802263052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d8108820 con 0x7f03d80f6530 2023-10-18T21:23:25.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.741+0000 7f03dd543700 1 -- 172.21.15.8:0/802263052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d8059100 con 0x7f03d80f6530 2023-10-18T21:23:25.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.741+0000 7f03d4ff9700 1 -- 172.21.15.8:0/802263052 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f03c801b030 con 0x7f03d80f6530 2023-10-18T21:23:25.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.742+0000 7f03d4ff9700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03c0060f70 0x7f03c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:25.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.742+0000 7f03d4ff9700 1 -- 172.21.15.8:0/802263052 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f03c807c7c0 con 0x7f03d80f6530 2023-10-18T21:23:25.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.743+0000 7f03d77fe700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03c0060f70 0x7f03c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:25.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.743+0000 7f03d77fe700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03c0060f70 0x7f03c0063430 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f03cc005010 tx=0x7f03cc016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:25.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:25.747+0000 7f03d4ff9700 1 -- 172.21.15.8:0/802263052 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f03c804c430 con 0x7f03d80f6530 2023-10-18T21:23:26.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.003+0000 7f03dd543700 1 -- 172.21.15.8:0/802263052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f03d80008d0 con 0x7f03d80f6530 2023-10-18T21:23:26.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.003+0000 7f03d4ff9700 1 -- 172.21.15.8:0/802263052 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f03c8019070 con 0x7f03d80f6530 2023-10-18T21:23:26.006 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:23:26.006 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:23:26.006 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:23:26.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:23:26.006 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:23:26.007 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:23:26.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:23:26.007 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:23:26.007 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:23:26.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:23:26.008 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:23:26.008 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:23:26.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:23:26.008 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:23:26.008 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:23:26.009 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:23:26.009 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:23:26.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 -- 172.21.15.8:0/802263052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03c0060f70 msgr2=0x7f03c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:26.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03c0060f70 0x7f03c0063430 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f03cc005010 tx=0x7f03cc016040).stop 2023-10-18T21:23:26.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 -- 172.21.15.8:0/802263052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d80f6530 msgr2=0x7f03d8106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:26.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d80f6530 0x7f03d8106d60 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f03c800e7c0 tx=0x7f03c800b040).stop 2023-10-18T21:23:26.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 -- 172.21.15.8:0/802263052 shutdown_connections 2023-10-18T21:23:26.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03c0060f70 0x7f03c0063430 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d80f6530 0x7f03d8106d60 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 --2- 172.21.15.8:0/802263052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d80f77d0 0x7f03d8107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 -- 172.21.15.8:0/802263052 >> 172.21.15.8:0/802263052 conn(0x7f03d80f1c90 msgr2=0x7f03d80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:26.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 -- 172.21.15.8:0/802263052 shutdown_connections 2023-10-18T21:23:26.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.006+0000 7f03dd543700 1 -- 172.21.15.8:0/802263052 wait complete. 2023-10-18T21:23:26.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.144+0000 7f8f0b277700 1 -- 172.21.15.8:0/3295222577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f040f6530 msgr2=0x7f8f040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:26.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.144+0000 7f8f0b277700 1 --2- 172.21.15.8:0/3295222577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f040f6530 0x7f8f040f6950 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f8f00004660 tx=0x7f8f00009b30).stop 2023-10-18T21:23:26.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.144+0000 7f8f0b277700 1 -- 172.21.15.8:0/3295222577 shutdown_connections 2023-10-18T21:23:26.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.144+0000 7f8f0b277700 1 --2- 172.21.15.8:0/3295222577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f040f77d0 0x7f8f040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.144+0000 7f8f0b277700 1 --2- 172.21.15.8:0/3295222577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f040f6530 0x7f8f040f6950 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.144+0000 7f8f0b277700 1 -- 172.21.15.8:0/3295222577 >> 172.21.15.8:0/3295222577 conn(0x7f8f040f1c90 msgr2=0x7f8f040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:26.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.144+0000 7f8f0b277700 1 -- 172.21.15.8:0/3295222577 shutdown_connections 2023-10-18T21:23:26.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.144+0000 7f8f0b277700 1 -- 172.21.15.8:0/3295222577 wait complete. 2023-10-18T21:23:26.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.145+0000 7f8f0b277700 1 Processor -- start 2023-10-18T21:23:26.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.145+0000 7f8f0b277700 1 -- start start 2023-10-18T21:23:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.145+0000 7f8f0b277700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f040f6530 0x7f8f04108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.146+0000 7f8f0b277700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f040f77d0 0x7f8f04109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.146+0000 7f8f0b277700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04109a00 con 0x7f8f040f77d0 2023-10-18T21:23:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.146+0000 7f8f0b277700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04109b40 con 0x7f8f040f6530 2023-10-18T21:23:26.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.146+0000 7f8f0a275700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f040f6530 0x7f8f04108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:26.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.146+0000 7f8f09a74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f040f77d0 0x7f8f04109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:26.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.146+0000 7f8f0a275700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f040f6530 0x7f8f04108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:53160/0 (socket says 172.21.15.8:53160) 2023-10-18T21:23:26.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.146+0000 7f8f09a74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f040f77d0 0x7f8f04109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58850/0 (socket says 172.21.15.8:58850) 2023-10-18T21:23:26.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.146+0000 7f8f0a275700 1 -- 172.21.15.8:0/3574170541 learned_addr learned my addr 172.21.15.8:0/3574170541 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:26.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.147+0000 7f8f09a74700 1 -- 172.21.15.8:0/3574170541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f040f6530 msgr2=0x7f8f04108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:26.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.147+0000 7f8f09a74700 1 --2- 172.21.15.8:0/3574170541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f040f6530 0x7f8f04108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.147+0000 7f8f09a74700 1 -- 172.21.15.8:0/3574170541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00005040 con 0x7f8f040f77d0 2023-10-18T21:23:26.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.147+0000 7f8f09a74700 1 --2- 172.21.15.8:0/3574170541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f040f77d0 0x7f8f04109450 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f8ef400e7c0 tx=0x7f8ef400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:26.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.147+0000 7f8efaffd700 1 -- 172.21.15.8:0/3574170541 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ef40092e0 con 0x7f8f040f77d0 2023-10-18T21:23:26.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.147+0000 7f8efaffd700 1 -- 172.21.15.8:0/3574170541 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8ef400f040 con 0x7f8f040f77d0 2023-10-18T21:23:26.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.147+0000 7f8efaffd700 1 -- 172.21.15.8:0/3574170541 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ef4014920 con 0x7f8f040f77d0 2023-10-18T21:23:26.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.147+0000 7f8f0b277700 1 -- 172.21.15.8:0/3574170541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0410a4e0 con 0x7f8f040f77d0 2023-10-18T21:23:26.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.148+0000 7f8f0b277700 1 -- 172.21.15.8:0/3574170541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0410aa20 con 0x7f8f040f77d0 2023-10-18T21:23:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.149+0000 7f8f0b277700 1 -- 172.21.15.8:0/3574170541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f04045ad0 con 0x7f8f040f77d0 2023-10-18T21:23:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.150+0000 7f8efaffd700 1 -- 172.21.15.8:0/3574170541 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8ef401b030 con 0x7f8f040f77d0 2023-10-18T21:23:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.150+0000 7f8efaffd700 1 --2- 172.21.15.8:0/3574170541 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ef0060f70 0x7f8ef0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.151+0000 7f8efaffd700 1 -- 172.21.15.8:0/3574170541 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8ef407c730 con 0x7f8f040f77d0 2023-10-18T21:23:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.151+0000 7f8f0a275700 1 --2- 172.21.15.8:0/3574170541 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ef0060f70 0x7f8ef0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.151+0000 7f8f0a275700 1 --2- 172.21.15.8:0/3574170541 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ef0060f70 0x7f8ef0063430 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f8f00009720 tx=0x7f8f00016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:26.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.155+0000 7f8efaffd700 1 -- 172.21.15.8:0/3574170541 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8ef404fdf0 con 0x7f8f040f77d0 2023-10-18T21:23:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.382+0000 7f8f0b277700 1 -- 172.21.15.8:0/3574170541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8f04027a00 con 0x7f8f040f77d0 2023-10-18T21:23:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.382+0000 7f8efaffd700 1 -- 172.21.15.8:0/3574170541 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f8ef4019070 con 0x7f8f040f77d0 2023-10-18T21:23:26.384 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:23:26.385 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:23:26.385 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:23:26.385 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:23:26.385 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:23:26.385 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:23:26.386 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:23:26.386 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:23:26.386 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:23:26.386 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:23:26.386 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:23:26.387 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:23:26.387 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:23:26.387 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:23:26.387 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:23:26.387 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:23:26.388 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:23:26.388 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:23:26.388 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:23:26.388 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:23:26.388 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:23:26.388 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:23:26.389 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:23:26.389 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:23:26.389 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:23:26.389 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:23:26.389 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:23:26.390 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:23:26.390 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:23:26.390 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:23:26.390 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:23:26.390 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:23:26.391 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:23:26.391 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:23:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 -- 172.21.15.8:0/3574170541 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ef0060f70 msgr2=0x7f8ef0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 --2- 172.21.15.8:0/3574170541 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ef0060f70 0x7f8ef0063430 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f8f00009720 tx=0x7f8f00016040).stop 2023-10-18T21:23:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 -- 172.21.15.8:0/3574170541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f040f77d0 msgr2=0x7f8f04109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 --2- 172.21.15.8:0/3574170541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f040f77d0 0x7f8f04109450 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f8ef400e7c0 tx=0x7f8ef400b040).stop 2023-10-18T21:23:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 -- 172.21.15.8:0/3574170541 shutdown_connections 2023-10-18T21:23:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 --2- 172.21.15.8:0/3574170541 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ef0060f70 0x7f8ef0063430 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 --2- 172.21.15.8:0/3574170541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f040f6530 0x7f8f04108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 --2- 172.21.15.8:0/3574170541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f040f77d0 0x7f8f04109450 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 -- 172.21.15.8:0/3574170541 >> 172.21.15.8:0/3574170541 conn(0x7f8f040f1c90 msgr2=0x7f8f0406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:26.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 -- 172.21.15.8:0/3574170541 shutdown_connections 2023-10-18T21:23:26.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.384+0000 7f8f0b277700 1 -- 172.21.15.8:0/3574170541 wait complete. 2023-10-18T21:23:26.394 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:23:26.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.522+0000 7f70f759e700 1 -- 172.21.15.8:0/3926622628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f80f6530 msgr2=0x7f70f80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:26.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.522+0000 7f70f759e700 1 --2- 172.21.15.8:0/3926622628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f80f6530 0x7f70f80f6950 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f70e8004660 tx=0x7f70e8009b30).stop 2023-10-18T21:23:26.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.522+0000 7f70f759e700 1 -- 172.21.15.8:0/3926622628 shutdown_connections 2023-10-18T21:23:26.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.522+0000 7f70f759e700 1 --2- 172.21.15.8:0/3926622628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80f77d0 0x7f70f80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:23:26.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.522+0000 7f70f759e700 1 --2- 172.21.15.8:0/3926622628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f80f6530 0x7f70f80f6950 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.522+0000 7f70f759e700 1 -- 172.21.15.8:0/3926622628 >> 172.21.15.8:0/3926622628 conn(0x7f70f80f1c90 msgr2=0x7f70f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:26.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.523+0000 7f70f759e700 1 -- 172.21.15.8:0/3926622628 shutdown_connections 2023-10-18T21:23:26.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.523+0000 7f70f759e700 1 -- 172.21.15.8:0/3926622628 wait complete. 2023-10-18T21:23:26.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.523+0000 7f70f759e700 1 Processor -- start 2023-10-18T21:23:26.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.523+0000 7f70f759e700 1 -- start start 2023-10-18T21:23:26.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f80f6530 0x7f70f8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:26.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80f77d0 0x7f70f81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8109b00 con 0x7f70f80f6530 2023-10-18T21:23:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f810a3b0 con 0x7f70f80f77d0 2023-10-18T21:23:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f80f6530 0x7f70f8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f80f6530 0x7f70f8108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58872/0 (socket says 172.21.15.8:58872) 2023-10-18T21:23:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f659c700 1 -- 172.21.15.8:0/1982998272 learned_addr learned my addr 172.21.15.8:0/1982998272 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f5d9b700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80f77d0 0x7f70f81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f659c700 1 -- 172.21.15.8:0/1982998272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80f77d0 msgr2=0x7f70f81094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f659c700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80f77d0 0x7f70f81094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.524+0000 7f70f659c700 1 -- 172.21.15.8:0/1982998272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8005040 con 0x7f70f80f6530 2023-10-18T21:23:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.525+0000 7f70f659c700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f80f6530 0x7f70f8108fd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f70e8007a70 tx=0x7f70e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.525+0000 7f70e6ffd700 1 -- 172.21.15.8:0/1982998272 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e8018070 con 0x7f70f80f6530 2023-10-18T21:23:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.525+0000 7f70e6ffd700 1 -- 172.21.15.8:0/1982998272 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f70e801d8e0 con 0x7f70f80f6530 2023-10-18T21:23:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.525+0000 7f70e6ffd700 1 -- 172.21.15.8:0/1982998272 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e801c660 con 0x7f70f80f6530 2023-10-18T21:23:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.525+0000 7f70f759e700 1 -- 172.21.15.8:0/1982998272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f810a630 con 0x7f70f80f6530 2023-10-18T21:23:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.525+0000 7f70f759e700 1 -- 172.21.15.8:0/1982998272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f810ab90 con 0x7f70f80f6530 2023-10-18T21:23:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.526+0000 7f70f759e700 1 -- 172.21.15.8:0/1982998272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f8059100 con 0x7f70f80f6530 2023-10-18T21:23:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.527+0000 7f70e6ffd700 1 -- 172.21.15.8:0/1982998272 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f70e801da50 con 0x7f70f80f6530 2023-10-18T21:23:26.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.528+0000 7f70e6ffd700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f70e0060f70 0x7f70e0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:26.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.528+0000 7f70e6ffd700 1 -- 172.21.15.8:0/1982998272 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f70e807e8c0 con 0x7f70f80f6530 2023-10-18T21:23:26.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.528+0000 7f70f5d9b700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f70e0060f70 0x7f70e0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:26.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.529+0000 7f70f5d9b700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f70e0060f70 0x7f70e0063430 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f70ec00b790 tx=0x7f70ec008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.532+0000 7f70e6ffd700 1 -- 172.21.15.8:0/1982998272 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f70e8051f20 con 0x7f70f80f6530 2023-10-18T21:23:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:24.889023+0000 mgr.smithi008.flmjzp (mgr.14640) 1475 : audit [DBG] from='client.35368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:24.914041+0000 mgr.smithi008.flmjzp (mgr.14640) 1476 : cluster [DBG] pgmap v1027: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:25.244343+0000 mgr.smithi008.flmjzp (mgr.14640) 1477 : audit [DBG] from='client.35372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:25.498172+0000 mon.smithi008 (mon.0) 1951 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:25.499026+0000 mon.smithi008 (mon.0) 1952 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:25.499713+0000 mgr.smithi008.flmjzp (mgr.14640) 1478 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:25.500254+0000 mgr.smithi008.flmjzp (mgr.14640) 1479 : cluster [DBG] pgmap v1028: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:25.500453+0000 mgr.smithi008.flmjzp (mgr.14640) 1480 : cluster [DBG] pgmap v1029: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:25.505337+0000 mon.smithi008 (mon.0) 1953 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:25.510284+0000 mon.smithi008 (mon.0) 1954 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:25.513010+0000 mon.smithi008 (mon.0) 1955 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:25.514384+0000 mon.smithi008 (mon.0) 1956 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:26.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:25.515711+0000 mon.smithi008 (mon.0) 1957 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:26.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:25.517409+0000 mon.smithi008 (mon.0) 1958 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:26.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:25.519058+0000 mgr.smithi008.flmjzp (mgr.14640) 1481 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:26.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:25.590950+0000 mgr.smithi008.flmjzp (mgr.14640) 1482 : audit [DBG] from='client.35376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:26.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:26.005085+0000 mon.smithi008 (mon.0) 1959 : audit [DBG] from='client.? 172.21.15.8:0/802263052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:26.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:26.383920+0000 mon.smithi008 (mon.0) 1960 : audit [DBG] from='client.? 172.21.15.8:0/3574170541' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:23:26.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.729+0000 7f70f759e700 1 -- 172.21.15.8:0/1982998272 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70f80fedb0 con 0x7f70e0060f70 2023-10-18T21:23:26.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.731+0000 7f70e6ffd700 1 -- 172.21.15.8:0/1982998272 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f70f80fedb0 con 0x7f70e0060f70 2023-10-18T21:23:26.732 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:23:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:23:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:23:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:23:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:23:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:23:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:23:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:23:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:23:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:23:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:23:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:23:26.735 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:23:26.735 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:23:26.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 -- 172.21.15.8:0/1982998272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f70e0060f70 msgr2=0x7f70e0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:26.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f70e0060f70 0x7f70e0063430 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f70ec00b790 tx=0x7f70ec008040).stop 2023-10-18T21:23:26.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 -- 172.21.15.8:0/1982998272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f80f6530 msgr2=0x7f70f8108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:26.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f80f6530 0x7f70f8108fd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f70e8007a70 tx=0x7f70e8009b30).stop 2023-10-18T21:23:26.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 -- 172.21.15.8:0/1982998272 shutdown_connections 2023-10-18T21:23:26.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f70e0060f70 0x7f70e0063430 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f80f6530 0x7f70f8108fd0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 --2- 172.21.15.8:0/1982998272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80f77d0 0x7f70f81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:26.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 -- 172.21.15.8:0/1982998272 >> 172.21.15.8:0/1982998272 conn(0x7f70f80f1c90 msgr2=0x7f70f806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:26.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 -- 172.21.15.8:0/1982998272 shutdown_connections 2023-10-18T21:23:26.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:26.733+0000 7f70f759e700 1 -- 172.21.15.8:0/1982998272 wait complete. 2023-10-18T21:23:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:24.889023+0000 mgr.smithi008.flmjzp (mgr.14640) 1475 : audit [DBG] from='client.35368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:24.914041+0000 mgr.smithi008.flmjzp (mgr.14640) 1476 : cluster [DBG] pgmap v1027: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:26.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:25.244343+0000 mgr.smithi008.flmjzp (mgr.14640) 1477 : audit [DBG] from='client.35372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:26.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:25.498172+0000 mon.smithi008 (mon.0) 1951 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:26.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:25.499026+0000 mon.smithi008 (mon.0) 1952 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:26.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:25.499713+0000 mgr.smithi008.flmjzp (mgr.14640) 1478 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:26.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:25.500254+0000 mgr.smithi008.flmjzp (mgr.14640) 1479 : cluster [DBG] pgmap v1028: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:26.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:25.500453+0000 mgr.smithi008.flmjzp (mgr.14640) 1480 : cluster [DBG] pgmap v1029: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:26.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:25.505337+0000 mon.smithi008 (mon.0) 1953 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:26.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:25.510284+0000 mon.smithi008 (mon.0) 1954 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:26.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:25.513010+0000 mon.smithi008 (mon.0) 1955 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:26.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:25.514384+0000 mon.smithi008 (mon.0) 1956 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:26.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:25.515711+0000 mon.smithi008 (mon.0) 1957 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:26.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:25.517409+0000 mon.smithi008 (mon.0) 1958 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:26.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:25.519058+0000 mgr.smithi008.flmjzp (mgr.14640) 1481 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:26.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:25.590950+0000 mgr.smithi008.flmjzp (mgr.14640) 1482 : audit [DBG] from='client.35376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:26.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:26.005085+0000 mon.smithi008 (mon.0) 1959 : audit [DBG] from='client.? 172.21.15.8:0/802263052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:26.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:26.383920+0000 mon.smithi008 (mon.0) 1960 : audit [DBG] from='client.? 172.21.15.8:0/3574170541' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:23:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:26.732021+0000 mgr.smithi008.flmjzp (mgr.14640) 1483 : audit [DBG] from='client.35388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:27.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:26.732021+0000 mgr.smithi008.flmjzp (mgr.14640) 1483 : audit [DBG] from='client.35388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:27.500957+0000 mgr.smithi008.flmjzp (mgr.14640) 1484 : cluster [DBG] pgmap v1030: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:28.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:27.500957+0000 mgr.smithi008.flmjzp (mgr.14640) 1484 : cluster [DBG] pgmap v1030: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:29.501608+0000 mgr.smithi008.flmjzp (mgr.14640) 1485 : cluster [DBG] pgmap v1031: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:30.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:29.501608+0000 mgr.smithi008.flmjzp (mgr.14640) 1485 : cluster [DBG] pgmap v1031: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:31.502124+0000 mgr.smithi008.flmjzp (mgr.14640) 1486 : cluster [DBG] pgmap v1032: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:32.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:31.502124+0000 mgr.smithi008.flmjzp (mgr.14640) 1486 : cluster [DBG] pgmap v1032: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:33.502729+0000 mgr.smithi008.flmjzp (mgr.14640) 1487 : cluster [DBG] pgmap v1033: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:33.502729+0000 mgr.smithi008.flmjzp (mgr.14640) 1487 : cluster [DBG] pgmap v1033: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:35.503592+0000 mgr.smithi008.flmjzp (mgr.14640) 1488 : cluster [DBG] pgmap v1034: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:35.529860+0000 mon.smithi008 (mon.0) 1961 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:35.531928+0000 mon.smithi008 (mon.0) 1962 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:35.532943+0000 mon.smithi008 (mon.0) 1963 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:35.533858+0000 mgr.smithi008.flmjzp (mgr.14640) 1489 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:35.534484+0000 mgr.smithi008.flmjzp (mgr.14640) 1490 : cluster [DBG] pgmap v1035: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:35.534806+0000 mgr.smithi008.flmjzp (mgr.14640) 1491 : cluster [DBG] pgmap v1036: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:35.539939+0000 mon.smithi008 (mon.0) 1964 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:35.546560+0000 mon.smithi008 (mon.0) 1965 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:35.549996+0000 mon.smithi008 (mon.0) 1966 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:35.551821+0000 mon.smithi008 (mon.0) 1967 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:35.553485+0000 mon.smithi008 (mon.0) 1968 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:35.555503+0000 mon.smithi008 (mon.0) 1969 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:36.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:35.557438+0000 mgr.smithi008.flmjzp (mgr.14640) 1492 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:36.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:35.503592+0000 mgr.smithi008.flmjzp (mgr.14640) 1488 : cluster [DBG] pgmap v1034: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:36.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:35.529860+0000 mon.smithi008 (mon.0) 1961 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:35.531928+0000 mon.smithi008 (mon.0) 1962 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:35.532943+0000 mon.smithi008 (mon.0) 1963 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:35.533858+0000 mgr.smithi008.flmjzp (mgr.14640) 1489 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:35.534484+0000 mgr.smithi008.flmjzp (mgr.14640) 1490 : cluster [DBG] pgmap v1035: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:35.534806+0000 mgr.smithi008.flmjzp (mgr.14640) 1491 : cluster [DBG] pgmap v1036: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:35.539939+0000 mon.smithi008 (mon.0) 1964 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:35.546560+0000 mon.smithi008 (mon.0) 1965 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:35.549996+0000 mon.smithi008 (mon.0) 1966 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:35.551821+0000 mon.smithi008 (mon.0) 1967 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:35.553485+0000 mon.smithi008 (mon.0) 1968 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:36.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:35.555503+0000 mon.smithi008 (mon.0) 1969 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:36.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:35.557438+0000 mgr.smithi008.flmjzp (mgr.14640) 1492 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:38.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:37.535309+0000 mgr.smithi008.flmjzp (mgr.14640) 1493 : cluster [DBG] pgmap v1037: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:38.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:37.535309+0000 mgr.smithi008.flmjzp (mgr.14640) 1493 : cluster [DBG] pgmap v1037: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:39.536027+0000 mgr.smithi008.flmjzp (mgr.14640) 1494 : cluster [DBG] pgmap v1038: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:40.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:39.536027+0000 mgr.smithi008.flmjzp (mgr.14640) 1494 : cluster [DBG] pgmap v1038: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:42.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:41.536680+0000 mgr.smithi008.flmjzp (mgr.14640) 1495 : cluster [DBG] pgmap v1039: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:42.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:41.536680+0000 mgr.smithi008.flmjzp (mgr.14640) 1495 : cluster [DBG] pgmap v1039: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:43.537196+0000 mgr.smithi008.flmjzp (mgr.14640) 1496 : cluster [DBG] pgmap v1040: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:44.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:43.537196+0000 mgr.smithi008.flmjzp (mgr.14640) 1496 : cluster [DBG] pgmap v1040: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:45.537783+0000 mgr.smithi008.flmjzp (mgr.14640) 1497 : cluster [DBG] pgmap v1041: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:45.567091+0000 mon.smithi008 (mon.0) 1970 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:45.569180+0000 mon.smithi008 (mon.0) 1971 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:45.570157+0000 mon.smithi008 (mon.0) 1972 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:45.570994+0000 mgr.smithi008.flmjzp (mgr.14640) 1498 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:45.571556+0000 mgr.smithi008.flmjzp (mgr.14640) 1499 : cluster [DBG] pgmap v1042: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:45.571806+0000 mgr.smithi008.flmjzp (mgr.14640) 1500 : cluster [DBG] pgmap v1043: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:45.576373+0000 mon.smithi008 (mon.0) 1973 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:45.583407+0000 mon.smithi008 (mon.0) 1974 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:45.586995+0000 mon.smithi008 (mon.0) 1975 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:45.588987+0000 mon.smithi008 (mon.0) 1976 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:45.590819+0000 mon.smithi008 (mon.0) 1977 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:45.593379+0000 mon.smithi008 (mon.0) 1978 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:46.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:45.595456+0000 mgr.smithi008.flmjzp (mgr.14640) 1501 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:46.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:45.537783+0000 mgr.smithi008.flmjzp (mgr.14640) 1497 : cluster [DBG] pgmap v1041: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:46.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:45.567091+0000 mon.smithi008 (mon.0) 1970 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:45.569180+0000 mon.smithi008 (mon.0) 1971 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:45.570157+0000 mon.smithi008 (mon.0) 1972 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:45.570994+0000 mgr.smithi008.flmjzp (mgr.14640) 1498 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:45.571556+0000 mgr.smithi008.flmjzp (mgr.14640) 1499 : cluster [DBG] pgmap v1042: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:45.571806+0000 mgr.smithi008.flmjzp (mgr.14640) 1500 : cluster [DBG] pgmap v1043: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:45.576373+0000 mon.smithi008 (mon.0) 1973 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:45.583407+0000 mon.smithi008 (mon.0) 1974 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:45.586995+0000 mon.smithi008 (mon.0) 1975 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:45.588987+0000 mon.smithi008 (mon.0) 1976 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:45.590819+0000 mon.smithi008 (mon.0) 1977 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:46.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:45.593379+0000 mon.smithi008 (mon.0) 1978 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:46.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:45.595456+0000 mgr.smithi008.flmjzp (mgr.14640) 1501 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:47.572504+0000 mgr.smithi008.flmjzp (mgr.14640) 1502 : cluster [DBG] pgmap v1044: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:48.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:47.572504+0000 mgr.smithi008.flmjzp (mgr.14640) 1502 : cluster [DBG] pgmap v1044: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:49.573110+0000 mgr.smithi008.flmjzp (mgr.14640) 1503 : cluster [DBG] pgmap v1045: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:49.573110+0000 mgr.smithi008.flmjzp (mgr.14640) 1503 : cluster [DBG] pgmap v1045: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:52.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:51.573844+0000 mgr.smithi008.flmjzp (mgr.14640) 1504 : cluster [DBG] pgmap v1046: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:52.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:51.573844+0000 mgr.smithi008.flmjzp (mgr.14640) 1504 : cluster [DBG] pgmap v1046: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:54.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:53.574372+0000 mgr.smithi008.flmjzp (mgr.14640) 1505 : cluster [DBG] pgmap v1047: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:54.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:53.574372+0000 mgr.smithi008.flmjzp (mgr.14640) 1505 : cluster [DBG] pgmap v1047: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:55.574967+0000 mgr.smithi008.flmjzp (mgr.14640) 1506 : cluster [DBG] pgmap v1048: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:55.606113+0000 mon.smithi008 (mon.0) 1979 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:55.608120+0000 mon.smithi008 (mon.0) 1980 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:55.609091+0000 mon.smithi008 (mon.0) 1981 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:55.609935+0000 mgr.smithi008.flmjzp (mgr.14640) 1507 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:55.610558+0000 mgr.smithi008.flmjzp (mgr.14640) 1508 : cluster [DBG] pgmap v1049: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:55.610850+0000 mgr.smithi008.flmjzp (mgr.14640) 1509 : cluster [DBG] pgmap v1050: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:55.615536+0000 mon.smithi008 (mon.0) 1982 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:56.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:55.622167+0000 mon.smithi008 (mon.0) 1983 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:56.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:55.625737+0000 mon.smithi008 (mon.0) 1984 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:56.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:55.627780+0000 mon.smithi008 (mon.0) 1985 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:56.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:55.629694+0000 mon.smithi008 (mon.0) 1986 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:56.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:55.632322+0000 mon.smithi008 (mon.0) 1987 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:56.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:23:55.634425+0000 mgr.smithi008.flmjzp (mgr.14640) 1510 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:56.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:55.574967+0000 mgr.smithi008.flmjzp (mgr.14640) 1506 : cluster [DBG] pgmap v1048: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:55.606113+0000 mon.smithi008 (mon.0) 1979 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:55.608120+0000 mon.smithi008 (mon.0) 1980 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:23:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:55.609091+0000 mon.smithi008 (mon.0) 1981 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:23:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:55.609935+0000 mgr.smithi008.flmjzp (mgr.14640) 1507 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:23:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:55.610558+0000 mgr.smithi008.flmjzp (mgr.14640) 1508 : cluster [DBG] pgmap v1049: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:55.610850+0000 mgr.smithi008.flmjzp (mgr.14640) 1509 : cluster [DBG] pgmap v1050: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:55.615536+0000 mon.smithi008 (mon.0) 1982 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:23:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:55.622167+0000 mon.smithi008 (mon.0) 1983 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:23:56.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:55.625737+0000 mon.smithi008 (mon.0) 1984 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:56.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:55.627780+0000 mon.smithi008 (mon.0) 1985 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:56.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:55.629694+0000 mon.smithi008 (mon.0) 1986 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:56.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:55.632322+0000 mon.smithi008 (mon.0) 1987 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:56.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:23:55.634425+0000 mgr.smithi008.flmjzp (mgr.14640) 1510 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:23:56.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.886+0000 7f286aa40700 1 -- 172.21.15.8:0/565610879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28640f6530 msgr2=0x7f28640f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:56.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.886+0000 7f286aa40700 1 --2- 172.21.15.8:0/565610879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28640f6530 0x7f28640f6950 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f2860004660 tx=0x7f2860009b30).stop 2023-10-18T21:23:56.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.886+0000 7f286aa40700 1 -- 172.21.15.8:0/565610879 shutdown_connections 2023-10-18T21:23:56.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.886+0000 7f286aa40700 1 --2- 172.21.15.8:0/565610879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28640f77d0 0x7f28640f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:56.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.886+0000 7f286aa40700 1 --2- 172.21.15.8:0/565610879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28640f6530 0x7f28640f6950 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:56.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.886+0000 7f286aa40700 1 -- 172.21.15.8:0/565610879 >> 172.21.15.8:0/565610879 conn(0x7f28640f1c90 msgr2=0x7f28640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:56.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.886+0000 7f286aa40700 1 -- 172.21.15.8:0/565610879 shutdown_connections 2023-10-18T21:23:56.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.886+0000 7f286aa40700 1 -- 172.21.15.8:0/565610879 wait complete. 2023-10-18T21:23:56.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.887+0000 7f286aa40700 1 Processor -- start 2023-10-18T21:23:56.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.888+0000 7f286aa40700 1 -- start start 2023-10-18T21:23:56.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.888+0000 7f286aa40700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28640f6530 0x7f286406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:56.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.888+0000 7f286aa40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28640f77d0 0x7f2864069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:56.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.888+0000 7f286aa40700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286406a380 con 0x7f28640f77d0 2023-10-18T21:23:56.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.888+0000 7f286aa40700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286406a4c0 con 0x7f28640f6530 2023-10-18T21:23:56.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.888+0000 7f286923d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28640f77d0 0x7f2864069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:56.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.888+0000 7f286923d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28640f77d0 0x7f2864069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36486/0 (socket says 172.21.15.8:36486) 2023-10-18T21:23:56.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.888+0000 7f286923d700 1 -- 172.21.15.8:0/1901245546 learned_addr learned my addr 172.21.15.8:0/1901245546 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:56.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.889+0000 7f2869a3e700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28640f6530 0x7f286406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:56.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.889+0000 7f286923d700 1 -- 172.21.15.8:0/1901245546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28640f6530 msgr2=0x7f286406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:56.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.889+0000 7f286923d700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28640f6530 0x7f286406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:56.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.889+0000 7f286923d700 1 -- 172.21.15.8:0/1901245546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860005040 con 0x7f28640f77d0 2023-10-18T21:23:56.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.889+0000 7f286923d700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28640f77d0 0x7f2864069e20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f28540026d0 tx=0x7f2854009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:56.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.889+0000 7f285a7fc700 1 -- 172.21.15.8:0/1901245546 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28540079c0 con 0x7f28640f77d0 2023-10-18T21:23:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.889+0000 7f285a7fc700 1 -- 172.21.15.8:0/1901245546 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f285400f040 con 0x7f28640f77d0 2023-10-18T21:23:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.889+0000 7f286aa40700 1 -- 172.21.15.8:0/1901245546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286406a7a0 con 0x7f28640f77d0 2023-10-18T21:23:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.889+0000 7f285a7fc700 1 -- 172.21.15.8:0/1901245546 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2854014980 con 0x7f28640f77d0 2023-10-18T21:23:56.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.890+0000 7f286aa40700 1 -- 172.21.15.8:0/1901245546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286410ede0 con 0x7f28640f77d0 2023-10-18T21:23:56.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.891+0000 7f286aa40700 1 -- 172.21.15.8:0/1901245546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2864045ad0 con 0x7f28640f77d0 2023-10-18T21:23:56.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.891+0000 7f285a7fc700 1 -- 172.21.15.8:0/1901245546 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f28540090d0 con 0x7f28640f77d0 2023-10-18T21:23:56.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.893+0000 7f285a7fc700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 0x7f2850063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:56.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.893+0000 7f285a7fc700 1 -- 172.21.15.8:0/1901245546 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f285407c7e0 con 0x7f28640f77d0 2023-10-18T21:23:56.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.893+0000 7f2869a3e700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 0x7f2850063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:56.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.893+0000 7f2869a3e700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 0x7f2850063430 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f286406b730 tx=0x7f2860009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:56.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:56.897+0000 7f285a7fc700 1 -- 172.21.15.8:0/1901245546 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f285404c580 con 0x7f28640f77d0 2023-10-18T21:23:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.097+0000 7f286aa40700 1 -- 172.21.15.8:0/1901245546 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f28640fedd0 con 0x7f2850060f70 2023-10-18T21:23:57.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.098+0000 7f285a7fc700 1 -- 172.21.15.8:0/1901245546 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f28640fedd0 con 0x7f2850060f70 2023-10-18T21:23:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 -- 172.21.15.8:0/1901245546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 msgr2=0x7f2850063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 0x7f2850063430 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f286406b730 tx=0x7f2860009b30).stop 2023-10-18T21:23:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 -- 172.21.15.8:0/1901245546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28640f77d0 msgr2=0x7f2864069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28640f77d0 0x7f2864069e20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f28540026d0 tx=0x7f2854009de0).stop 2023-10-18T21:23:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 -- 172.21.15.8:0/1901245546 shutdown_connections 2023-10-18T21:23:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2850060f70 0x7f2850063430 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28640f6530 0x7f286406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 --2- 172.21.15.8:0/1901245546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28640f77d0 0x7f2864069e20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 -- 172.21.15.8:0/1901245546 >> 172.21.15.8:0/1901245546 conn(0x7f28640f1c90 msgr2=0x7f28640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 -- 172.21.15.8:0/1901245546 shutdown_connections 2023-10-18T21:23:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.101+0000 7f286aa40700 1 -- 172.21.15.8:0/1901245546 wait complete. 2023-10-18T21:23:57.117 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:23:57.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.238+0000 7fdc3b7fe700 1 -- 172.21.15.8:0/2026275038 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc28013b20 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.238+0000 7fdc41952700 1 -- 172.21.15.8:0/2026275038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc3c0f77d0 msgr2=0x7fdc3c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.238+0000 7fdc41952700 1 --2- 172.21.15.8:0/2026275038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc3c0f77d0 0x7fdc3c0f7c30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fdc28004660 tx=0x7fdc28009b30).stop 2023-10-18T21:23:57.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.238+0000 7fdc41952700 1 -- 172.21.15.8:0/2026275038 shutdown_connections 2023-10-18T21:23:57.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.238+0000 7fdc41952700 1 --2- 172.21.15.8:0/2026275038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc3c0f77d0 0x7fdc3c0f7c30 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.238+0000 7fdc41952700 1 --2- 172.21.15.8:0/2026275038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc3c0f6530 0x7fdc3c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.238+0000 7fdc41952700 1 -- 172.21.15.8:0/2026275038 >> 172.21.15.8:0/2026275038 conn(0x7fdc3c0f1c90 msgr2=0x7fdc3c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:57.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.238+0000 7fdc41952700 1 -- 172.21.15.8:0/2026275038 shutdown_connections 2023-10-18T21:23:57.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.238+0000 7fdc41952700 1 -- 172.21.15.8:0/2026275038 wait complete. 2023-10-18T21:23:57.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.239+0000 7fdc41952700 1 Processor -- start 2023-10-18T21:23:57.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.239+0000 7fdc41952700 1 -- start start 2023-10-18T21:23:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.239+0000 7fdc41952700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc3c0f6530 0x7fdc3c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.239+0000 7fdc41952700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc3c0f77d0 0x7fdc3c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.239+0000 7fdc41952700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c107880 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.239+0000 7fdc41952700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c1080c0 con 0x7fdc3c0f6530 2023-10-18T21:23:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc3bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc3c0f77d0 0x7fdc3c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:57.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc3bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc3c0f77d0 0x7fdc3c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36506/0 (socket says 172.21.15.8:36506) 2023-10-18T21:23:57.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc3bfff700 1 -- 172.21.15.8:0/3809113915 learned_addr learned my addr 172.21.15.8:0/3809113915 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:57.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc40950700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc3c0f6530 0x7fdc3c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:57.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc3bfff700 1 -- 172.21.15.8:0/3809113915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc3c0f6530 msgr2=0x7fdc3c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc3bfff700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc3c0f6530 0x7fdc3c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc3bfff700 1 -- 172.21.15.8:0/3809113915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28005040 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc3bfff700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc3c0f77d0 0x7fdc3c107280 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fdc28009f50 tx=0x7fdc28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:57.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc397fa700 1 -- 172.21.15.8:0/3809113915 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc28018070 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc397fa700 1 -- 172.21.15.8:0/3809113915 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdc28009630 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc41952700 1 -- 172.21.15.8:0/3809113915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3c108340 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.240+0000 7fdc397fa700 1 -- 172.21.15.8:0/3809113915 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc2801c3c0 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.241+0000 7fdc41952700 1 -- 172.21.15.8:0/3809113915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3c108820 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.242+0000 7fdc41952700 1 -- 172.21.15.8:0/3809113915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3c059100 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.243+0000 7fdc397fa700 1 -- 172.21.15.8:0/3809113915 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdc2801d420 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.243+0000 7fdc397fa700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc2c060f70 0x7fdc2c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:57.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.243+0000 7fdc397fa700 1 -- 172.21.15.8:0/3809113915 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdc2807e580 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.244+0000 7fdc40950700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc2c060f70 0x7fdc2c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:57.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.244+0000 7fdc40950700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc2c060f70 0x7fdc2c063430 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fdc3c107b50 tx=0x7fdc3000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:57.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.248+0000 7fdc397fa700 1 -- 172.21.15.8:0/3809113915 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdc2804e1b0 con 0x7fdc3c0f77d0 2023-10-18T21:23:57.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.445+0000 7fdc41952700 1 -- 172.21.15.8:0/3809113915 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc3c0feda0 con 0x7fdc2c060f70 2023-10-18T21:23:57.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.446+0000 7fdc397fa700 1 -- 172.21.15.8:0/3809113915 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdc3c0feda0 con 0x7fdc2c060f70 2023-10-18T21:23:57.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 -- 172.21.15.8:0/3809113915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc2c060f70 msgr2=0x7fdc2c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc2c060f70 0x7fdc2c063430 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fdc3c107b50 tx=0x7fdc3000b040).stop 2023-10-18T21:23:57.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 -- 172.21.15.8:0/3809113915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc3c0f77d0 msgr2=0x7fdc3c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc3c0f77d0 0x7fdc3c107280 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fdc28009f50 tx=0x7fdc28009b30).stop 2023-10-18T21:23:57.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 -- 172.21.15.8:0/3809113915 shutdown_connections 2023-10-18T21:23:57.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc2c060f70 0x7fdc2c063430 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc3c0f6530 0x7fdc3c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 --2- 172.21.15.8:0/3809113915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc3c0f77d0 0x7fdc3c107280 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 -- 172.21.15.8:0/3809113915 >> 172.21.15.8:0/3809113915 conn(0x7fdc3c0f1c90 msgr2=0x7fdc3c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:57.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 -- 172.21.15.8:0/3809113915 shutdown_connections 2023-10-18T21:23:57.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.448+0000 7fdc41952700 1 -- 172.21.15.8:0/3809113915 wait complete. 2023-10-18T21:23:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.584+0000 7fccef59e700 1 -- 172.21.15.8:0/146115933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf00f77d0 msgr2=0x7fccf00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.584+0000 7fccef59e700 1 --2- 172.21.15.8:0/146115933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf00f77d0 0x7fccf00f7c30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fcce4004660 tx=0x7fcce4009b30).stop 2023-10-18T21:23:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.584+0000 7fccef59e700 1 -- 172.21.15.8:0/146115933 shutdown_connections 2023-10-18T21:23:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.584+0000 7fccef59e700 1 --2- 172.21.15.8:0/146115933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf00f77d0 0x7fccf00f7c30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.584+0000 7fccef59e700 1 --2- 172.21.15.8:0/146115933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf00f6530 0x7fccf00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.584+0000 7fccef59e700 1 -- 172.21.15.8:0/146115933 >> 172.21.15.8:0/146115933 conn(0x7fccf00f1c90 msgr2=0x7fccf00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:57.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.584+0000 7fccef59e700 1 -- 172.21.15.8:0/146115933 shutdown_connections 2023-10-18T21:23:57.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.584+0000 7fccef59e700 1 -- 172.21.15.8:0/146115933 wait complete. 2023-10-18T21:23:57.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.585+0000 7fccef59e700 1 Processor -- start 2023-10-18T21:23:57.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.585+0000 7fccef59e700 1 -- start start 2023-10-18T21:23:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.585+0000 7fccef59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf00f6530 0x7fccf0108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.585+0000 7fccef59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf00f77d0 0x7fccf01093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.585+0000 7fccef59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf01099a0 con 0x7fccf00f6530 2023-10-18T21:23:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.585+0000 7fccef59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf0109ae0 con 0x7fccf00f77d0 2023-10-18T21:23:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.585+0000 7fccee59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf00f6530 0x7fccf0108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.585+0000 7fccee59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf00f6530 0x7fccf0108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36522/0 (socket says 172.21.15.8:36522) 2023-10-18T21:23:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.585+0000 7fccee59c700 1 -- 172.21.15.8:0/3982006522 learned_addr learned my addr 172.21.15.8:0/3982006522 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.586+0000 7fccedd9b700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf00f77d0 0x7fccf01093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.586+0000 7fccee59c700 1 -- 172.21.15.8:0/3982006522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf00f77d0 msgr2=0x7fccf01093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.586+0000 7fccee59c700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf00f77d0 0x7fccf01093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.586+0000 7fccee59c700 1 -- 172.21.15.8:0/3982006522 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4005040 con 0x7fccf00f6530 2023-10-18T21:23:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.586+0000 7fccee59c700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf00f6530 0x7fccf0108f00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fcce000e7c0 tx=0x7fcce000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.586+0000 7fccdeffd700 1 -- 172.21.15.8:0/3982006522 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce00092e0 con 0x7fccf00f6530 2023-10-18T21:23:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.586+0000 7fccdeffd700 1 -- 172.21.15.8:0/3982006522 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcce000f040 con 0x7fccf00f6530 2023-10-18T21:23:57.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.586+0000 7fccdeffd700 1 -- 172.21.15.8:0/3982006522 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce00147e0 con 0x7fccf00f6530 2023-10-18T21:23:57.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.586+0000 7fccef59e700 1 -- 172.21.15.8:0/3982006522 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf010a480 con 0x7fccf00f6530 2023-10-18T21:23:57.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.587+0000 7fccef59e700 1 -- 172.21.15.8:0/3982006522 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf010a9c0 con 0x7fccf00f6530 2023-10-18T21:23:57.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.588+0000 7fccef59e700 1 -- 172.21.15.8:0/3982006522 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf0045ad0 con 0x7fccf00f6530 2023-10-18T21:23:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.589+0000 7fccdeffd700 1 -- 172.21.15.8:0/3982006522 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcce001b030 con 0x7fccf00f6530 2023-10-18T21:23:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.589+0000 7fccdeffd700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd8060f70 0x7fccd8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:57.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.589+0000 7fccdeffd700 1 -- 172.21.15.8:0/3982006522 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcce007c990 con 0x7fccf00f6530 2023-10-18T21:23:57.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.590+0000 7fccedd9b700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd8060f70 0x7fccd8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:57.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.590+0000 7fccedd9b700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd8060f70 0x7fccd8063430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fcce40043d0 tx=0x7fcce400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:57.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.594+0000 7fccdeffd700 1 -- 172.21.15.8:0/3982006522 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcce004ff10 con 0x7fccf00f6530 2023-10-18T21:23:57.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.786+0000 7fccef59e700 1 -- 172.21.15.8:0/3982006522 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fccf00fee30 con 0x7fccd8060f70 2023-10-18T21:23:57.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.795+0000 7fccdeffd700 1 -- 172.21.15.8:0/3982006522 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fccf00fee30 con 0x7fccd8060f70 2023-10-18T21:23:57.796 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:23:57.797 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (30m) 8m ago 32m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:23:57.797 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (24m) 8m ago 32m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:23:57.797 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (24m) 6m ago 31m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:23:57.797 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (30m) 8m ago 31m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:23:57.797 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 28m - - 2023-10-18T21:23:57.798 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 28m - - 2023-10-18T21:23:57.798 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 28m - - 2023-10-18T21:23:57.798 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 28m - - 2023-10-18T21:23:57.798 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (25m) 8m ago 33m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:23:57.798 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (25m) 6m ago 31m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:23:57.799 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (24m) 8m ago 33m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:23:57.799 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (24m) 6m ago 31m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:23:57.799 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (31m) 8m ago 31m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:23:57.800 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (30m) 6m ago 30m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:23:57.800 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (24m) 8m ago 30m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:23:57.800 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (22m) 8m ago 30m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:23:57.800 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (21m) 8m ago 30m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:23:57.800 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (21m) 6m ago 29m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:23:57.800 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (20m) 6m ago 29m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:23:57.801 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (20m) 6m ago 29m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:23:57.801 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (26m) 8m ago 31m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:23:57.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.797+0000 7fccef59e700 1 -- 172.21.15.8:0/3982006522 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd8060f70 msgr2=0x7fccd8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.797+0000 7fccef59e700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd8060f70 0x7fccd8063430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fcce40043d0 tx=0x7fcce400b040).stop 2023-10-18T21:23:57.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.797+0000 7fccef59e700 1 -- 172.21.15.8:0/3982006522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf00f6530 msgr2=0x7fccf0108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.797+0000 7fccef59e700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf00f6530 0x7fccf0108f00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fcce000e7c0 tx=0x7fcce000b040).stop 2023-10-18T21:23:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.798+0000 7fccef59e700 1 -- 172.21.15.8:0/3982006522 shutdown_connections 2023-10-18T21:23:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.798+0000 7fccef59e700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd8060f70 0x7fccd8063430 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.798+0000 7fccef59e700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf00f6530 0x7fccf0108f00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.798+0000 7fccef59e700 1 --2- 172.21.15.8:0/3982006522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf00f77d0 0x7fccf01093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.798+0000 7fccef59e700 1 -- 172.21.15.8:0/3982006522 >> 172.21.15.8:0/3982006522 conn(0x7fccf00f1c90 msgr2=0x7fccf006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:57.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.798+0000 7fccef59e700 1 -- 172.21.15.8:0/3982006522 shutdown_connections 2023-10-18T21:23:57.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.798+0000 7fccef59e700 1 -- 172.21.15.8:0/3982006522 wait complete. 2023-10-18T21:23:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.937+0000 7f575759e700 1 -- 172.21.15.8:0/147949720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57580f6530 msgr2=0x7f57580f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.937+0000 7f575759e700 1 --2- 172.21.15.8:0/147949720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57580f6530 0x7f57580f6950 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f5748004660 tx=0x7f5748009b30).stop 2023-10-18T21:23:57.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.937+0000 7f575759e700 1 -- 172.21.15.8:0/147949720 shutdown_connections 2023-10-18T21:23:57.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.937+0000 7f575759e700 1 --2- 172.21.15.8:0/147949720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57580f77d0 0x7f57580f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.937+0000 7f575759e700 1 --2- 172.21.15.8:0/147949720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57580f6530 0x7f57580f6950 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.937+0000 7f575759e700 1 -- 172.21.15.8:0/147949720 >> 172.21.15.8:0/147949720 conn(0x7f57580f1c90 msgr2=0x7f57580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.937+0000 7f575759e700 1 -- 172.21.15.8:0/147949720 shutdown_connections 2023-10-18T21:23:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.937+0000 7f575759e700 1 -- 172.21.15.8:0/147949720 wait complete. 2023-10-18T21:23:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.938+0000 7f575759e700 1 Processor -- start 2023-10-18T21:23:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.938+0000 7f575759e700 1 -- start start 2023-10-18T21:23:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.939+0000 7f575759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57580f6530 0x7f575806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.939+0000 7f575759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57580f77d0 0x7f5758069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.939+0000 7f575759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575806a380 con 0x7f57580f77d0 2023-10-18T21:23:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.939+0000 7f575759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575806a4c0 con 0x7f57580f6530 2023-10-18T21:23:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.939+0000 7f5755d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57580f77d0 0x7f5758069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.939+0000 7f5755d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57580f77d0 0x7f5758069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36536/0 (socket says 172.21.15.8:36536) 2023-10-18T21:23:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.939+0000 7f5755d9b700 1 -- 172.21.15.8:0/700067910 learned_addr learned my addr 172.21.15.8:0/700067910 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.939+0000 7f575659c700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57580f6530 0x7f575806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.940+0000 7f5755d9b700 1 -- 172.21.15.8:0/700067910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57580f6530 msgr2=0x7f575806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.940+0000 7f5755d9b700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57580f6530 0x7f575806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.940+0000 7f5755d9b700 1 -- 172.21.15.8:0/700067910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748005040 con 0x7f57580f77d0 2023-10-18T21:23:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.940+0000 7f5755d9b700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57580f77d0 0x7f5758069e20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f574c00e7f0 tx=0x7f574c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.940+0000 7f5746ffd700 1 -- 172.21.15.8:0/700067910 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f574c0092e0 con 0x7f57580f77d0 2023-10-18T21:23:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.940+0000 7f5746ffd700 1 -- 172.21.15.8:0/700067910 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f574c00f040 con 0x7f57580f77d0 2023-10-18T21:23:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.940+0000 7f575759e700 1 -- 172.21.15.8:0/700067910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575806a7a0 con 0x7f57580f77d0 2023-10-18T21:23:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.940+0000 7f5746ffd700 1 -- 172.21.15.8:0/700067910 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f574c0147e0 con 0x7f57580f77d0 2023-10-18T21:23:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.940+0000 7f575759e700 1 -- 172.21.15.8:0/700067910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575810ed70 con 0x7f57580f77d0 2023-10-18T21:23:57.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.941+0000 7f575759e700 1 -- 172.21.15.8:0/700067910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5758045ad0 con 0x7f57580f77d0 2023-10-18T21:23:57.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.942+0000 7f5746ffd700 1 -- 172.21.15.8:0/700067910 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f574c01b030 con 0x7f57580f77d0 2023-10-18T21:23:57.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.943+0000 7f5746ffd700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5740060f70 0x7f5740063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:57.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.943+0000 7f5746ffd700 1 -- 172.21.15.8:0/700067910 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f574c07c6b0 con 0x7f57580f77d0 2023-10-18T21:23:57.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.943+0000 7f575659c700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5740060f70 0x7f5740063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:57.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.944+0000 7f575659c700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5740060f70 0x7f5740063430 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f5748005010 tx=0x7f5748016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:57.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:57.947+0000 7f5746ffd700 1 -- 172.21.15.8:0/700067910 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f574c04c310 con 0x7f57580f77d0 2023-10-18T21:23:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.197+0000 7f575759e700 1 -- 172.21.15.8:0/700067910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5758027a00 con 0x7f57580f77d0 2023-10-18T21:23:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.198+0000 7f5746ffd700 1 -- 172.21.15.8:0/700067910 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f574c019020 con 0x7f57580f77d0 2023-10-18T21:23:58.200 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:23:58.200 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:23:58.200 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:23:58.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:23:58.201 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:23:58.201 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:23:58.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:23:58.201 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:23:58.202 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:23:58.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:23:58.202 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:23:58.202 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:23:58.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:23:58.203 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:23:58.203 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:23:58.203 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:23:58.203 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:23:58.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 -- 172.21.15.8:0/700067910 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5740060f70 msgr2=0x7f5740063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:58.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5740060f70 0x7f5740063430 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f5748005010 tx=0x7f5748016040).stop 2023-10-18T21:23:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 -- 172.21.15.8:0/700067910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57580f77d0 msgr2=0x7f5758069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57580f77d0 0x7f5758069e20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f574c00e7f0 tx=0x7f574c00b040).stop 2023-10-18T21:23:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 -- 172.21.15.8:0/700067910 shutdown_connections 2023-10-18T21:23:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5740060f70 0x7f5740063430 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57580f6530 0x7f575806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 --2- 172.21.15.8:0/700067910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57580f77d0 0x7f5758069e20 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 -- 172.21.15.8:0/700067910 >> 172.21.15.8:0/700067910 conn(0x7f57580f1c90 msgr2=0x7f57580fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 -- 172.21.15.8:0/700067910 shutdown_connections 2023-10-18T21:23:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.200+0000 7f575759e700 1 -- 172.21.15.8:0/700067910 wait complete. 2023-10-18T21:23:58.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.336+0000 7fc0b89f1700 1 -- 172.21.15.8:0/2347935333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0b40f6530 msgr2=0x7fc0b40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:58.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.336+0000 7fc0b89f1700 1 --2- 172.21.15.8:0/2347935333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0b40f6530 0x7fc0b40f6950 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fc0a4004660 tx=0x7fc0a4009b30).stop 2023-10-18T21:23:58.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.337+0000 7fc0b89f1700 1 -- 172.21.15.8:0/2347935333 shutdown_connections 2023-10-18T21:23:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.337+0000 7fc0b89f1700 1 --2- 172.21.15.8:0/2347935333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b40f77d0 0x7fc0b40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.337+0000 7fc0b89f1700 1 --2- 172.21.15.8:0/2347935333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0b40f6530 0x7fc0b40f6950 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.337+0000 7fc0b89f1700 1 -- 172.21.15.8:0/2347935333 >> 172.21.15.8:0/2347935333 conn(0x7fc0b40f1c90 msgr2=0x7fc0b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.337+0000 7fc0b89f1700 1 -- 172.21.15.8:0/2347935333 shutdown_connections 2023-10-18T21:23:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.337+0000 7fc0b89f1700 1 -- 172.21.15.8:0/2347935333 wait complete. 2023-10-18T21:23:58.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.338+0000 7fc0b89f1700 1 Processor -- start 2023-10-18T21:23:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.338+0000 7fc0b89f1700 1 -- start start 2023-10-18T21:23:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.338+0000 7fc0b89f1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0b40f6530 0x7fc0b4108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.338+0000 7fc0b89f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b40f77d0 0x7fc0b4109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.338+0000 7fc0b89f1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4109a00 con 0x7fc0b40f6530 2023-10-18T21:23:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.338+0000 7fc0b89f1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4109b40 con 0x7fc0b40f77d0 2023-10-18T21:23:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.338+0000 7fc0b37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0b40f6530 0x7fc0b4108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.339+0000 7fc0b37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0b40f6530 0x7fc0b4108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36556/0 (socket says 172.21.15.8:36556) 2023-10-18T21:23:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.339+0000 7fc0b37fe700 1 -- 172.21.15.8:0/3259346895 learned_addr learned my addr 172.21.15.8:0/3259346895 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.339+0000 7fc0b2ffd700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b40f77d0 0x7fc0b4109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:58.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.339+0000 7fc0b37fe700 1 -- 172.21.15.8:0/3259346895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b40f77d0 msgr2=0x7fc0b4109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:58.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.339+0000 7fc0b37fe700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b40f77d0 0x7fc0b4109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.339+0000 7fc0b37fe700 1 -- 172.21.15.8:0/3259346895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4005040 con 0x7fc0b40f6530 2023-10-18T21:23:58.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.339+0000 7fc0b37fe700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0b40f6530 0x7fc0b4108f60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fc0a4014040 tx=0x7fc0a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:58.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.339+0000 7fc09bfff700 1 -- 172.21.15.8:0/3259346895 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a4019070 con 0x7fc0b40f6530 2023-10-18T21:23:58.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.339+0000 7fc09bfff700 1 -- 172.21.15.8:0/3259346895 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc0a401e420 con 0x7fc0b40f6530 2023-10-18T21:23:58.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.339+0000 7fc0b89f1700 1 -- 172.21.15.8:0/3259346895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b410a480 con 0x7fc0b40f6530 2023-10-18T21:23:58.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.340+0000 7fc09bfff700 1 -- 172.21.15.8:0/3259346895 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a4014620 con 0x7fc0b40f6530 2023-10-18T21:23:58.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.340+0000 7fc0b89f1700 1 -- 172.21.15.8:0/3259346895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b410a960 con 0x7fc0b40f6530 2023-10-18T21:23:58.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.341+0000 7fc0b89f1700 1 -- 172.21.15.8:0/3259346895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b4045ad0 con 0x7fc0b40f6530 2023-10-18T21:23:58.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.342+0000 7fc09bfff700 1 -- 172.21.15.8:0/3259346895 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc0a401e9e0 con 0x7fc0b40f6530 2023-10-18T21:23:58.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.343+0000 7fc09bfff700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc09c060f70 0x7fc09c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.343+0000 7fc09bfff700 1 -- 172.21.15.8:0/3259346895 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc0a407ddb0 con 0x7fc0b40f6530 2023-10-18T21:23:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.343+0000 7fc0b2ffd700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc09c060f70 0x7fc09c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.344+0000 7fc0b2ffd700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc09c060f70 0x7fc09c063430 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fc0a8009fd0 tx=0x7fc0a800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:58.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.347+0000 7fc09bfff700 1 -- 172.21.15.8:0/3259346895 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc0a4051390 con 0x7fc0b40f6530 2023-10-18T21:23:58.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.573+0000 7fc0b89f1700 1 -- 172.21.15.8:0/3259346895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc0b40fecc0 con 0x7fc0b40f6530 2023-10-18T21:23:58.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.574+0000 7fc09bfff700 1 -- 172.21.15.8:0/3259346895 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fc0a4004490 con 0x7fc0b40f6530 2023-10-18T21:23:58.575 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:23:58.575 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:23:58.575 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:23:58.576 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:23:58.576 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:23:58.576 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:23:58.576 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:23:58.577 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:23:58.577 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:23:58.577 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:23:58.577 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:23:58.578 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:23:58.578 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:23:58.578 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:23:58.578 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:23:58.578 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:23:58.579 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:23:58.579 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:23:58.579 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:23:58.579 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:23:58.579 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:23:58.580 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:23:58.580 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:23:58.580 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:23:58.580 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:23:58.580 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:23:58.581 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:23:58.581 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:23:58.581 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:23:58.581 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:23:58.581 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:23:58.582 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:23:58.582 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:23:58.582 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:23:58.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.575+0000 7fc0b89f1700 1 -- 172.21.15.8:0/3259346895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc09c060f70 msgr2=0x7fc09c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:58.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.576+0000 7fc0b89f1700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc09c060f70 0x7fc09c063430 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fc0a8009fd0 tx=0x7fc0a800b040).stop 2023-10-18T21:23:58.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.576+0000 7fc0b89f1700 1 -- 172.21.15.8:0/3259346895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0b40f6530 msgr2=0x7fc0b4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:58.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.576+0000 7fc0b89f1700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0b40f6530 0x7fc0b4108f60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fc0a4014040 tx=0x7fc0a400b040).stop 2023-10-18T21:23:58.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.576+0000 7fc0b89f1700 1 -- 172.21.15.8:0/3259346895 shutdown_connections 2023-10-18T21:23:58.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.576+0000 7fc0b89f1700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc09c060f70 0x7fc09c063430 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.576+0000 7fc0b89f1700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0b40f6530 0x7fc0b4108f60 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.576+0000 7fc0b89f1700 1 --2- 172.21.15.8:0/3259346895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b40f77d0 0x7fc0b4109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.576+0000 7fc0b89f1700 1 -- 172.21.15.8:0/3259346895 >> 172.21.15.8:0/3259346895 conn(0x7fc0b40f1c90 msgr2=0x7fc0b406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:58.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.576+0000 7fc0b89f1700 1 -- 172.21.15.8:0/3259346895 shutdown_connections 2023-10-18T21:23:58.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.576+0000 7fc0b89f1700 1 -- 172.21.15.8:0/3259346895 wait complete. 2023-10-18T21:23:58.585 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:23:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.715+0000 7f04aeed3700 1 -- 172.21.15.8:0/2397860270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a80f6530 msgr2=0x7f04a80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.715+0000 7f04aeed3700 1 --2- 172.21.15.8:0/2397860270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a80f6530 0x7f04a80f6950 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f04a4004660 tx=0x7f04a4009b30).stop 2023-10-18T21:23:58.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.715+0000 7f04aeed3700 1 -- 172.21.15.8:0/2397860270 shutdown_connections 2023-10-18T21:23:58.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.715+0000 7f04aeed3700 1 --2- 172.21.15.8:0/2397860270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04a80f77d0 0x7f04a80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:23:58.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.715+0000 7f04aeed3700 1 --2- 172.21.15.8:0/2397860270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a80f6530 0x7f04a80f6950 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.715+0000 7f04aeed3700 1 -- 172.21.15.8:0/2397860270 >> 172.21.15.8:0/2397860270 conn(0x7f04a80f1c90 msgr2=0x7f04a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:58.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.715+0000 7f04aeed3700 1 -- 172.21.15.8:0/2397860270 shutdown_connections 2023-10-18T21:23:58.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.715+0000 7f04aeed3700 1 -- 172.21.15.8:0/2397860270 wait complete. 2023-10-18T21:23:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.716+0000 7f04aeed3700 1 Processor -- start 2023-10-18T21:23:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.716+0000 7f04aeed3700 1 -- start start 2023-10-18T21:23:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.716+0000 7f04aeed3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04a80f6530 0x7f04a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.716+0000 7f04aeed3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a80f77d0 0x7f04a8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:58.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.716+0000 7f04aeed3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a806a410 con 0x7f04a80f77d0 2023-10-18T21:23:58.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.716+0000 7f04aeed3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a806a550 con 0x7f04a80f6530 2023-10-18T21:23:58.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f04ad6d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a80f77d0 0x7f04a8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:58.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f04ad6d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a80f77d0 0x7f04a8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36560/0 (socket says 172.21.15.8:36560) 2023-10-18T21:23:58.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f04ad6d0700 1 -- 172.21.15.8:0/1246315389 learned_addr learned my addr 172.21.15.8:0/1246315389 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:23:58.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f04aded1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04a80f6530 0x7f04a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:58.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f04ad6d0700 1 -- 172.21.15.8:0/1246315389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04a80f6530 msgr2=0x7f04a806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:58.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f04ad6d0700 1 --2- 172.21.15.8:0/1246315389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04a80f6530 0x7f04a806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f04ad6d0700 1 -- 172.21.15.8:0/1246315389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a4005040 con 0x7f04a80f77d0 2023-10-18T21:23:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f04ad6d0700 1 --2- 172.21.15.8:0/1246315389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a80f77d0 0x7f04a8069e20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f049800b410 tx=0x7f0498006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f049e7fc700 1 -- 172.21.15.8:0/1246315389 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04980125f0 con 0x7f04a80f77d0 2023-10-18T21:23:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f049e7fc700 1 -- 172.21.15.8:0/1246315389 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f049800be30 con 0x7f04a80f77d0 2023-10-18T21:23:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.717+0000 7f049e7fc700 1 -- 172.21.15.8:0/1246315389 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0498002a60 con 0x7f04a80f77d0 2023-10-18T21:23:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.718+0000 7f04aeed3700 1 -- 172.21.15.8:0/1246315389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a806a830 con 0x7f04a80f77d0 2023-10-18T21:23:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.718+0000 7f04aeed3700 1 -- 172.21.15.8:0/1246315389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a810ee00 con 0x7f04a80f77d0 2023-10-18T21:23:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.719+0000 7f04aeed3700 1 -- 172.21.15.8:0/1246315389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a8045ad0 con 0x7f04a80f77d0 2023-10-18T21:23:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.720+0000 7f049e7fc700 1 -- 172.21.15.8:0/1246315389 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f049800f030 con 0x7f04a80f77d0 2023-10-18T21:23:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.720+0000 7f049e7fc700 1 --2- 172.21.15.8:0/1246315389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0494060f70 0x7f0494063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:23:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.721+0000 7f049e7fc700 1 -- 172.21.15.8:0/1246315389 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f049807cdc0 con 0x7f04a80f77d0 2023-10-18T21:23:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.721+0000 7f04aded1700 1 --2- 172.21.15.8:0/1246315389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0494060f70 0x7f0494063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:23:58.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.721+0000 7f04aded1700 1 --2- 172.21.15.8:0/1246315389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0494060f70 0x7f0494063430 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f04a806b730 tx=0x7f04a4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:23:58.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.725+0000 7f049e7fc700 1 -- 172.21.15.8:0/1246315389 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0498080030 con 0x7f04a80f77d0 2023-10-18T21:23:58.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:57.098876+0000 mgr.smithi008.flmjzp (mgr.14640) 1511 : audit [DBG] from='client.35392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:58.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:57.446354+0000 mgr.smithi008.flmjzp (mgr.14640) 1512 : audit [DBG] from='client.35396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:58.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:57.611274+0000 mgr.smithi008.flmjzp (mgr.14640) 1513 : cluster [DBG] pgmap v1051: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:58.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:57.787356+0000 mgr.smithi008.flmjzp (mgr.14640) 1514 : audit [DBG] from='client.35400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:58.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:58.198666+0000 mon.smithi008 (mon.0) 1988 : audit [DBG] from='client.? 172.21.15.8:0/700067910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:58.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:58.574313+0000 mon.smithi008 (mon.0) 1989 : audit [DBG] from='client.? 172.21.15.8:0/3259346895' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:23:58.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.924+0000 7f04aeed3700 1 -- 172.21.15.8:0/1246315389 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04a80feeb0 con 0x7f0494060f70 2023-10-18T21:23:58.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.925+0000 7f049e7fc700 1 -- 172.21.15.8:0/1246315389 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f04a80feeb0 con 0x7f0494060f70 2023-10-18T21:23:58.926 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:23:58.926 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:23:58.926 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:23:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:23:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:23:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:23:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:23:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:23:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:23:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:23:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:23:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:23:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:23:58.929 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:23:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 -- 172.21.15.8:0/1246315389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0494060f70 msgr2=0x7f0494063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 --2- 172.21.15.8:0/1246315389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0494060f70 0x7f0494063430 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f04a806b730 tx=0x7f04a4009b30).stop 2023-10-18T21:23:58.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 -- 172.21.15.8:0/1246315389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a80f77d0 msgr2=0x7f04a8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:23:58.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 --2- 172.21.15.8:0/1246315389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a80f77d0 0x7f04a8069e20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f049800b410 tx=0x7f0498006ef0).stop 2023-10-18T21:23:58.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 -- 172.21.15.8:0/1246315389 shutdown_connections 2023-10-18T21:23:58.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 --2- 172.21.15.8:0/1246315389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0494060f70 0x7f0494063430 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 --2- 172.21.15.8:0/1246315389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04a80f6530 0x7f04a806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 --2- 172.21.15.8:0/1246315389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a80f77d0 0x7f04a8069e20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:23:58.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 -- 172.21.15.8:0/1246315389 >> 172.21.15.8:0/1246315389 conn(0x7f04a80f1c90 msgr2=0x7f04a80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:23:58.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 -- 172.21.15.8:0/1246315389 shutdown_connections 2023-10-18T21:23:58.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:23:58.927+0000 7f04aeed3700 1 -- 172.21.15.8:0/1246315389 wait complete. 2023-10-18T21:23:58.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:57.098876+0000 mgr.smithi008.flmjzp (mgr.14640) 1511 : audit [DBG] from='client.35392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:57.446354+0000 mgr.smithi008.flmjzp (mgr.14640) 1512 : audit [DBG] from='client.35396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:57.611274+0000 mgr.smithi008.flmjzp (mgr.14640) 1513 : cluster [DBG] pgmap v1051: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:23:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:57.787356+0000 mgr.smithi008.flmjzp (mgr.14640) 1514 : audit [DBG] from='client.35400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:23:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:58.198666+0000 mon.smithi008 (mon.0) 1988 : audit [DBG] from='client.? 172.21.15.8:0/700067910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:23:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:58.574313+0000 mon.smithi008 (mon.0) 1989 : audit [DBG] from='client.? 172.21.15.8:0/3259346895' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:24:00.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:23:58.925474+0000 mgr.smithi008.flmjzp (mgr.14640) 1515 : audit [DBG] from='client.35412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:24:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:23:59.611961+0000 mgr.smithi008.flmjzp (mgr.14640) 1516 : cluster [DBG] pgmap v1052: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:23:58.925474+0000 mgr.smithi008.flmjzp (mgr.14640) 1515 : audit [DBG] from='client.35412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:24:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:23:59.611961+0000 mgr.smithi008.flmjzp (mgr.14640) 1516 : cluster [DBG] pgmap v1052: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:02.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:01.612427+0000 mgr.smithi008.flmjzp (mgr.14640) 1517 : cluster [DBG] pgmap v1053: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:03.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:01.612427+0000 mgr.smithi008.flmjzp (mgr.14640) 1517 : cluster [DBG] pgmap v1053: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:03.612914+0000 mgr.smithi008.flmjzp (mgr.14640) 1518 : cluster [DBG] pgmap v1054: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:05.142 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:03.612914+0000 mgr.smithi008.flmjzp (mgr.14640) 1518 : cluster [DBG] pgmap v1054: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:06.527 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:05.613571+0000 mgr.smithi008.flmjzp (mgr.14640) 1519 : cluster [DBG] pgmap v1055: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:06.528 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:05.645208+0000 mon.smithi008 (mon.0) 1990 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:06.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:05.613571+0000 mgr.smithi008.flmjzp (mgr.14640) 1519 : cluster [DBG] pgmap v1055: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:06.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:05.645208+0000 mon.smithi008 (mon.0) 1990 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:08.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:07.614055+0000 mgr.smithi008.flmjzp (mgr.14640) 1520 : cluster [DBG] pgmap v1056: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:08.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:08.552874+0000 mon.smithi008 (mon.0) 1991 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:07.614055+0000 mgr.smithi008.flmjzp (mgr.14640) 1520 : cluster [DBG] pgmap v1056: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:08.552874+0000 mon.smithi008 (mon.0) 1991 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:09.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:08.546872+0000 mgr.smithi008.flmjzp (mgr.14640) 1521 : cephadm [INF] Detected new or changed devices on smithi008 2023-10-18T21:24:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:09.105040+0000 mon.smithi008 (mon.0) 1992 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:24:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:09.105821+0000 mon.smithi008 (mon.0) 1993 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:24:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:09.111224+0000 mon.smithi008 (mon.0) 1994 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:09.116155+0000 mon.smithi008 (mon.0) 1995 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:09.118503+0000 mon.smithi008 (mon.0) 1996 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:09.119708+0000 mon.smithi008 (mon.0) 1997 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:09.120869+0000 mon.smithi008 (mon.0) 1998 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:09.122333+0000 mon.smithi008 (mon.0) 1999 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:10.148 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:08.546872+0000 mgr.smithi008.flmjzp (mgr.14640) 1521 : cephadm [INF] Detected new or changed devices on smithi008 2023-10-18T21:24:10.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:09.105040+0000 mon.smithi008 (mon.0) 1992 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:24:10.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:09.105821+0000 mon.smithi008 (mon.0) 1993 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:24:10.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:09.111224+0000 mon.smithi008 (mon.0) 1994 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:10.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:09.116155+0000 mon.smithi008 (mon.0) 1995 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:10.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:09.118503+0000 mon.smithi008 (mon.0) 1996 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:10.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:09.119708+0000 mon.smithi008 (mon.0) 1997 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:10.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:09.120869+0000 mon.smithi008 (mon.0) 1998 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:10.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:09.122333+0000 mon.smithi008 (mon.0) 1999 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:10.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:09.106432+0000 mgr.smithi008.flmjzp (mgr.14640) 1522 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:24:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:09.106973+0000 mgr.smithi008.flmjzp (mgr.14640) 1523 : cluster [DBG] pgmap v1057: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:09.107194+0000 mgr.smithi008.flmjzp (mgr.14640) 1524 : cluster [DBG] pgmap v1058: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:09.123849+0000 mgr.smithi008.flmjzp (mgr.14640) 1525 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:24:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:09.106432+0000 mgr.smithi008.flmjzp (mgr.14640) 1522 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:24:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:09.106973+0000 mgr.smithi008.flmjzp (mgr.14640) 1523 : cluster [DBG] pgmap v1057: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:09.107194+0000 mgr.smithi008.flmjzp (mgr.14640) 1524 : cluster [DBG] pgmap v1058: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:09.123849+0000 mgr.smithi008.flmjzp (mgr.14640) 1525 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:24:12.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:11.107904+0000 mgr.smithi008.flmjzp (mgr.14640) 1526 : cluster [DBG] pgmap v1059: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:11.107904+0000 mgr.smithi008.flmjzp (mgr.14640) 1526 : cluster [DBG] pgmap v1059: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:13.108491+0000 mgr.smithi008.flmjzp (mgr.14640) 1527 : cluster [DBG] pgmap v1060: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:15.143 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:13.108491+0000 mgr.smithi008.flmjzp (mgr.14640) 1527 : cluster [DBG] pgmap v1060: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:16.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:15.109086+0000 mgr.smithi008.flmjzp (mgr.14640) 1528 : cluster [DBG] pgmap v1061: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:17.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:15.109086+0000 mgr.smithi008.flmjzp (mgr.14640) 1528 : cluster [DBG] pgmap v1061: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:18.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:17.109802+0000 mgr.smithi008.flmjzp (mgr.14640) 1529 : cluster [DBG] pgmap v1062: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:19.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:17.109802+0000 mgr.smithi008.flmjzp (mgr.14640) 1529 : cluster [DBG] pgmap v1062: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:19.132693+0000 mon.smithi008 (mon.0) 2000 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:19.134793+0000 mon.smithi008 (mon.0) 2001 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:24:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:19.135740+0000 mon.smithi008 (mon.0) 2002 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:24:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:19.142191+0000 mon.smithi008 (mon.0) 2003 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:19.148752+0000 mon.smithi008 (mon.0) 2004 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:19.151949+0000 mon.smithi008 (mon.0) 2005 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:19.153616+0000 mon.smithi008 (mon.0) 2006 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:19.155182+0000 mon.smithi008 (mon.0) 2007 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:19.157101+0000 mon.smithi008 (mon.0) 2008 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:20.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:19.132693+0000 mon.smithi008 (mon.0) 2000 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:20.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:19.134793+0000 mon.smithi008 (mon.0) 2001 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:24:20.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:19.135740+0000 mon.smithi008 (mon.0) 2002 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:24:20.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:19.142191+0000 mon.smithi008 (mon.0) 2003 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:20.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:19.148752+0000 mon.smithi008 (mon.0) 2004 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:20.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:19.151949+0000 mon.smithi008 (mon.0) 2005 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:20.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:19.153616+0000 mon.smithi008 (mon.0) 2006 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:20.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:19.155182+0000 mon.smithi008 (mon.0) 2007 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:20.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:19.157101+0000 mon.smithi008 (mon.0) 2008 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:20.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:19.110507+0000 mgr.smithi008.flmjzp (mgr.14640) 1530 : cluster [DBG] pgmap v1063: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:19.136632+0000 mgr.smithi008.flmjzp (mgr.14640) 1531 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:24:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:19.137179+0000 mgr.smithi008.flmjzp (mgr.14640) 1532 : cluster [DBG] pgmap v1064: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:19.137460+0000 mgr.smithi008.flmjzp (mgr.14640) 1533 : cluster [DBG] pgmap v1065: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:19.159013+0000 mgr.smithi008.flmjzp (mgr.14640) 1534 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:24:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:19.110507+0000 mgr.smithi008.flmjzp (mgr.14640) 1530 : cluster [DBG] pgmap v1063: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:19.136632+0000 mgr.smithi008.flmjzp (mgr.14640) 1531 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:24:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:19.137179+0000 mgr.smithi008.flmjzp (mgr.14640) 1532 : cluster [DBG] pgmap v1064: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:19.137460+0000 mgr.smithi008.flmjzp (mgr.14640) 1533 : cluster [DBG] pgmap v1065: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:19.159013+0000 mgr.smithi008.flmjzp (mgr.14640) 1534 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:24:22.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:21.137892+0000 mgr.smithi008.flmjzp (mgr.14640) 1535 : cluster [DBG] pgmap v1066: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:21.137892+0000 mgr.smithi008.flmjzp (mgr.14640) 1535 : cluster [DBG] pgmap v1066: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:24.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:23.138385+0000 mgr.smithi008.flmjzp (mgr.14640) 1536 : cluster [DBG] pgmap v1067: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:25.143 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:23.138385+0000 mgr.smithi008.flmjzp (mgr.14640) 1536 : cluster [DBG] pgmap v1067: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:26.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:25.138975+0000 mgr.smithi008.flmjzp (mgr.14640) 1537 : cluster [DBG] pgmap v1068: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:27.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:25.138975+0000 mgr.smithi008.flmjzp (mgr.14640) 1537 : cluster [DBG] pgmap v1068: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:28.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:27.139543+0000 mgr.smithi008.flmjzp (mgr.14640) 1538 : cluster [DBG] pgmap v1069: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:29.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.081+0000 7ffa22af2700 1 -- 172.21.15.8:0/3857384784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa1c06a3b0 msgr2=0x7ffa1c06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:29.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.081+0000 7ffa22af2700 1 --2- 172.21.15.8:0/3857384784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa1c06a3b0 0x7ffa1c06a830 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7ffa0c004660 tx=0x7ffa0c009b30).stop 2023-10-18T21:24:29.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.082+0000 7ffa22af2700 1 -- 172.21.15.8:0/3857384784 shutdown_connections 2023-10-18T21:24:29.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.082+0000 7ffa22af2700 1 --2- 172.21.15.8:0/3857384784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa1c06a3b0 0x7ffa1c06a830 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.082+0000 7ffa22af2700 1 --2- 172.21.15.8:0/3857384784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa1c06b9c0 0x7ffa1c069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.082+0000 7ffa22af2700 1 -- 172.21.15.8:0/3857384784 >> 172.21.15.8:0/3857384784 conn(0x7ffa1c0f1c90 msgr2=0x7ffa1c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:29.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.082+0000 7ffa22af2700 1 -- 172.21.15.8:0/3857384784 shutdown_connections 2023-10-18T21:24:29.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.082+0000 7ffa22af2700 1 -- 172.21.15.8:0/3857384784 wait complete. 2023-10-18T21:24:29.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.083+0000 7ffa22af2700 1 Processor -- start 2023-10-18T21:24:29.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.083+0000 7ffa22af2700 1 -- start start 2023-10-18T21:24:29.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.083+0000 7ffa22af2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa1c06a3b0 0x7ffa1c108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:29.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.083+0000 7ffa22af2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa1c06b9c0 0x7ffa1c109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:29.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.083+0000 7ffa22af2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c109a10 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.083+0000 7ffa22af2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c109b50 con 0x7ffa1c06b9c0 2023-10-18T21:24:29.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.083+0000 7ffa21af0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa1c06a3b0 0x7ffa1c108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:29.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.083+0000 7ffa21af0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa1c06a3b0 0x7ffa1c108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36130/0 (socket says 172.21.15.8:36130) 2023-10-18T21:24:29.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.083+0000 7ffa21af0700 1 -- 172.21.15.8:0/1741209090 learned_addr learned my addr 172.21.15.8:0/1741209090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:24:29.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.083+0000 7ffa212ef700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa1c06b9c0 0x7ffa1c109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:29.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.084+0000 7ffa21af0700 1 -- 172.21.15.8:0/1741209090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa1c06b9c0 msgr2=0x7ffa1c109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:29.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.084+0000 7ffa21af0700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa1c06b9c0 0x7ffa1c109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.084+0000 7ffa21af0700 1 -- 172.21.15.8:0/1741209090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c005040 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.084+0000 7ffa21af0700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa1c06a3b0 0x7ffa1c108f70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7ffa180026d0 tx=0x7ffa18009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:29.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.084+0000 7ffa127fc700 1 -- 172.21.15.8:0/1741209090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa180079c0 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.084+0000 7ffa127fc700 1 -- 172.21.15.8:0/1741209090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ffa1800f040 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.084+0000 7ffa22af2700 1 -- 172.21.15.8:0/1741209090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c10a4f0 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.084+0000 7ffa127fc700 1 -- 172.21.15.8:0/1741209090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa18014980 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.085+0000 7ffa22af2700 1 -- 172.21.15.8:0/1741209090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c10aab0 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.086+0000 7ffa22af2700 1 -- 172.21.15.8:0/1741209090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c045ad0 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.086+0000 7ffa127fc700 1 -- 172.21.15.8:0/1741209090 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ffa180090d0 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.087+0000 7ffa127fc700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa08060f70 0x7ffa08063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:29.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.087+0000 7ffa127fc700 1 -- 172.21.15.8:0/1741209090 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ffa1807c8a0 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.088+0000 7ffa212ef700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa08060f70 0x7ffa08063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:29.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.088+0000 7ffa212ef700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa08060f70 0x7ffa08063430 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7ffa0c004630 tx=0x7ffa0c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:29.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.092+0000 7ffa127fc700 1 -- 172.21.15.8:0/1741209090 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ffa1804ffb0 con 0x7ffa1c06a3b0 2023-10-18T21:24:29.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:27.139543+0000 mgr.smithi008.flmjzp (mgr.14640) 1538 : cluster [DBG] pgmap v1069: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:29.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.292+0000 7ffa22af2700 1 -- 172.21.15.8:0/1741209090 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa1c101030 con 0x7ffa08060f70 2023-10-18T21:24:29.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.293+0000 7ffa127fc700 1 -- 172.21.15.8:0/1741209090 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffa1c101030 con 0x7ffa08060f70 2023-10-18T21:24:29.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 -- 172.21.15.8:0/1741209090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa08060f70 msgr2=0x7ffa08063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:29.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa08060f70 0x7ffa08063430 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7ffa0c004630 tx=0x7ffa0c009b30).stop 2023-10-18T21:24:29.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 -- 172.21.15.8:0/1741209090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa1c06a3b0 msgr2=0x7ffa1c108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:29.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa1c06a3b0 0x7ffa1c108f70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7ffa180026d0 tx=0x7ffa18009de0).stop 2023-10-18T21:24:29.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 -- 172.21.15.8:0/1741209090 shutdown_connections 2023-10-18T21:24:29.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffa08060f70 0x7ffa08063430 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa1c06a3b0 0x7ffa1c108f70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 --2- 172.21.15.8:0/1741209090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa1c06b9c0 0x7ffa1c109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 -- 172.21.15.8:0/1741209090 >> 172.21.15.8:0/1741209090 conn(0x7ffa1c0f1c90 msgr2=0x7ffa1c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 -- 172.21.15.8:0/1741209090 shutdown_connections 2023-10-18T21:24:29.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.296+0000 7ffa22af2700 1 -- 172.21.15.8:0/1741209090 wait complete. 2023-10-18T21:24:29.311 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:24:29.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.433+0000 7f961bfff700 1 -- 172.21.15.8:0/824220836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0f77d0 msgr2=0x7f961c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:29.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.433+0000 7f961bfff700 1 --2- 172.21.15.8:0/824220836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0f77d0 0x7f961c0f7c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9610004660 tx=0x7f9610009b30).stop 2023-10-18T21:24:29.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.433+0000 7f961bfff700 1 -- 172.21.15.8:0/824220836 shutdown_connections 2023-10-18T21:24:29.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.433+0000 7f961bfff700 1 --2- 172.21.15.8:0/824220836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0f77d0 0x7f961c0f7c30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.433+0000 7f961bfff700 1 --2- 172.21.15.8:0/824220836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c0f6530 0x7f961c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.433+0000 7f961bfff700 1 -- 172.21.15.8:0/824220836 >> 172.21.15.8:0/824220836 conn(0x7f961c0f1c90 msgr2=0x7f961c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:29.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.433+0000 7f961bfff700 1 -- 172.21.15.8:0/824220836 shutdown_connections 2023-10-18T21:24:29.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.433+0000 7f961bfff700 1 -- 172.21.15.8:0/824220836 wait complete. 2023-10-18T21:24:29.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.434+0000 7f961bfff700 1 Processor -- start 2023-10-18T21:24:29.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.434+0000 7f961bfff700 1 -- start start 2023-10-18T21:24:29.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.434+0000 7f961bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c0f6530 0x7f961c108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:29.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.434+0000 7f961bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0f77d0 0x7f961c109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:29.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.434+0000 7f961bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c1099d0 con 0x7f961c0f6530 2023-10-18T21:24:29.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.434+0000 7f961bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c109b10 con 0x7f961c0f77d0 2023-10-18T21:24:29.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.434+0000 7f961affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c0f6530 0x7f961c108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:29.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f961affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c0f6530 0x7f961c108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36150/0 (socket says 172.21.15.8:36150) 2023-10-18T21:24:29.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f961affd700 1 -- 172.21.15.8:0/3843107579 learned_addr learned my addr 172.21.15.8:0/3843107579 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:24:29.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f961a7fc700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0f77d0 0x7f961c109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:29.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f961affd700 1 -- 172.21.15.8:0/3843107579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0f77d0 msgr2=0x7f961c109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:29.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f961affd700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0f77d0 0x7f961c109420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f961affd700 1 -- 172.21.15.8:0/3843107579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610005040 con 0x7f961c0f6530 2023-10-18T21:24:29.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f961affd700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c0f6530 0x7f961c108f30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f960c00e7c0 tx=0x7f960c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:29.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f96037fe700 1 -- 172.21.15.8:0/3843107579 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960c0092e0 con 0x7f961c0f6530 2023-10-18T21:24:29.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f96037fe700 1 -- 172.21.15.8:0/3843107579 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f960c00f040 con 0x7f961c0f6530 2023-10-18T21:24:29.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f961bfff700 1 -- 172.21.15.8:0/3843107579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961c10a4b0 con 0x7f961c0f6530 2023-10-18T21:24:29.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.435+0000 7f96037fe700 1 -- 172.21.15.8:0/3843107579 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960c014810 con 0x7f961c0f6530 2023-10-18T21:24:29.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.436+0000 7f961bfff700 1 -- 172.21.15.8:0/3843107579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c10a9f0 con 0x7f961c0f6530 2023-10-18T21:24:29.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.436+0000 7f961bfff700 1 -- 172.21.15.8:0/3843107579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c045ad0 con 0x7f961c0f6530 2023-10-18T21:24:29.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.438+0000 7f96037fe700 1 -- 172.21.15.8:0/3843107579 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f960c01b030 con 0x7f961c0f6530 2023-10-18T21:24:29.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.438+0000 7f96037fe700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9604060f70 0x7f9604063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:29.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.438+0000 7f96037fe700 1 -- 172.21.15.8:0/3843107579 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f960c07c8b0 con 0x7f961c0f6530 2023-10-18T21:24:29.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.439+0000 7f961a7fc700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9604060f70 0x7f9604063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:29.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.439+0000 7f961a7fc700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9604060f70 0x7f9604063430 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f9610005010 tx=0x7f9610016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:29.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.443+0000 7f96037fe700 1 -- 172.21.15.8:0/3843107579 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f960c04fe90 con 0x7f961c0f6530 2023-10-18T21:24:29.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.641+0000 7f961bfff700 1 -- 172.21.15.8:0/3843107579 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f961c10acc0 con 0x7f9604060f70 2023-10-18T21:24:29.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.642+0000 7f96037fe700 1 -- 172.21.15.8:0/3843107579 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f961c10acc0 con 0x7f9604060f70 2023-10-18T21:24:29.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 -- 172.21.15.8:0/3843107579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9604060f70 msgr2=0x7f9604063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:29.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9604060f70 0x7f9604063430 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f9610005010 tx=0x7f9610016040).stop 2023-10-18T21:24:29.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 -- 172.21.15.8:0/3843107579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c0f6530 msgr2=0x7f961c108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:29.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c0f6530 0x7f961c108f30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f960c00e7c0 tx=0x7f960c00b040).stop 2023-10-18T21:24:29.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 -- 172.21.15.8:0/3843107579 shutdown_connections 2023-10-18T21:24:29.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9604060f70 0x7f9604063430 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c0f6530 0x7f961c108f30 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 --2- 172.21.15.8:0/3843107579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0f77d0 0x7f961c109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 -- 172.21.15.8:0/3843107579 >> 172.21.15.8:0/3843107579 conn(0x7f961c0f1c90 msgr2=0x7f961c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:29.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 -- 172.21.15.8:0/3843107579 shutdown_connections 2023-10-18T21:24:29.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.644+0000 7f961bfff700 1 -- 172.21.15.8:0/3843107579 wait complete. 2023-10-18T21:24:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.783+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/3185340576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7a80f77d0 msgr2=0x7fa7a80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:29.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.783+0000 7fa7ae9a7700 1 --2- 172.21.15.8:0/3185340576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7a80f77d0 0x7fa7a80f7c30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa798004660 tx=0x7fa798009b30).stop 2023-10-18T21:24:29.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.783+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/3185340576 shutdown_connections 2023-10-18T21:24:29.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.783+0000 7fa7ae9a7700 1 --2- 172.21.15.8:0/3185340576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7a80f77d0 0x7fa7a80f7c30 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.783+0000 7fa7ae9a7700 1 --2- 172.21.15.8:0/3185340576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a80f6530 0x7fa7a80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.783+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/3185340576 >> 172.21.15.8:0/3185340576 conn(0x7fa7a80f1c90 msgr2=0x7fa7a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:29.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.783+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/3185340576 shutdown_connections 2023-10-18T21:24:29.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.784+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/3185340576 wait complete. 2023-10-18T21:24:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.784+0000 7fa7ae9a7700 1 Processor -- start 2023-10-18T21:24:29.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.784+0000 7fa7ae9a7700 1 -- start start 2023-10-18T21:24:29.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.785+0000 7fa7ae9a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a80f6530 0x7fa7a8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:29.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.785+0000 7fa7ae9a7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7a80f77d0 0x7fa7a8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:29.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.785+0000 7fa7ae9a7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a8107880 con 0x7fa7a80f77d0 2023-10-18T21:24:29.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.785+0000 7fa7ae9a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a81080c0 con 0x7fa7a80f6530 2023-10-18T21:24:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.785+0000 7fa7ad1a4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7a80f77d0 0x7fa7a8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.785+0000 7fa7ad9a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a80f6530 0x7fa7a8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.785+0000 7fa7ad1a4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7a80f77d0 0x7fa7a8107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36162/0 (socket says 172.21.15.8:36162) 2023-10-18T21:24:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.785+0000 7fa7ad1a4700 1 -- 172.21.15.8:0/4214601501 learned_addr learned my addr 172.21.15.8:0/4214601501 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:24:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.786+0000 7fa7ad1a4700 1 -- 172.21.15.8:0/4214601501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a80f6530 msgr2=0x7fa7a8106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:29.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.786+0000 7fa7ad1a4700 1 --2- 172.21.15.8:0/4214601501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a80f6530 0x7fa7a8106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:29.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.786+0000 7fa7ad1a4700 1 -- 172.21.15.8:0/4214601501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798005040 con 0x7fa7a80f77d0 2023-10-18T21:24:29.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.786+0000 7fa7ad1a4700 1 --2- 172.21.15.8:0/4214601501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7a80f77d0 0x7fa7a8107280 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fa798009990 tx=0x7fa798009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:29.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.786+0000 7fa79e7fc700 1 -- 172.21.15.8:0/4214601501 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa798018070 con 0x7fa7a80f77d0 2023-10-18T21:24:29.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.786+0000 7fa79e7fc700 1 -- 172.21.15.8:0/4214601501 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa798009630 con 0x7fa7a80f77d0 2023-10-18T21:24:29.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.786+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/4214601501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a8108340 con 0x7fa7a80f77d0 2023-10-18T21:24:29.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.786+0000 7fa79e7fc700 1 -- 172.21.15.8:0/4214601501 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa79801c3c0 con 0x7fa7a80f77d0 2023-10-18T21:24:29.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.786+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/4214601501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a8108820 con 0x7fa7a80f77d0 2023-10-18T21:24:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.787+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/4214601501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a8059100 con 0x7fa7a80f77d0 2023-10-18T21:24:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.788+0000 7fa79e7fc700 1 -- 172.21.15.8:0/4214601501 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa79801d970 con 0x7fa7a80f77d0 2023-10-18T21:24:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.789+0000 7fa79e7fc700 1 --2- 172.21.15.8:0/4214601501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa794060f70 0x7fa794063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:29.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.789+0000 7fa79e7fc700 1 -- 172.21.15.8:0/4214601501 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa79807e660 con 0x7fa7a80f77d0 2023-10-18T21:24:29.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.789+0000 7fa7ad9a5700 1 --2- 172.21.15.8:0/4214601501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa794060f70 0x7fa794063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:29.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.790+0000 7fa7ad9a5700 1 --2- 172.21.15.8:0/4214601501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa794060f70 0x7fa794063430 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fa7a8107b50 tx=0x7fa7a400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:29.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.793+0000 7fa79e7fc700 1 -- 172.21.15.8:0/4214601501 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa79804e210 con 0x7fa7a80f77d0 2023-10-18T21:24:29.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.984+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/4214601501 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7a80fee50 con 0x7fa794060f70 2023-10-18T21:24:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.165821+0000 mon.smithi008 (mon.0) 2009 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.720018+0000 mon.smithi008 (mon.0) 2010 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:24:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.720886+0000 mon.smithi008 (mon.0) 2011 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:24:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.994+0000 7fa79e7fc700 1 -- 172.21.15.8:0/4214601501 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa7a80fee50 con 0x7fa794060f70 2023-10-18T21:24:29.995 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:24:29.995 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (31m) 9m ago 32m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:24:29.995 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (25m) 9m ago 32m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:24:29.995 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (24m) 7m ago 31m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:24:29.995 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (31m) 9m ago 32m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:24:29.996 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 28m - - 2023-10-18T21:24:29.996 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 28m - - 2023-10-18T21:24:29.996 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 28m - - 2023-10-18T21:24:29.996 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 28m - - 2023-10-18T21:24:29.996 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (26m) 9m ago 33m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:24:29.996 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (25m) 7m ago 31m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:24:29.997 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (25m) 9m ago 34m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:24:29.997 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (25m) 7m ago 31m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:24:29.997 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (32m) 9m ago 32m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:24:29.997 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (31m) 7m ago 31m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:24:29.997 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (24m) 9m ago 31m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:24:29.998 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (22m) 9m ago 30m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:24:29.998 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (22m) 9m ago 30m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:24:29.998 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (21m) 7m ago 30m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:24:29.998 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (21m) 7m ago 30m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:24:29.998 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (20m) 7m ago 29m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:24:29.999 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (26m) 9m ago 31m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:24:29.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/4214601501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa794060f70 msgr2=0x7fa794063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 --2- 172.21.15.8:0/4214601501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa794060f70 0x7fa794063430 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fa7a8107b50 tx=0x7fa7a400b040).stop 2023-10-18T21:24:30.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/4214601501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7a80f77d0 msgr2=0x7fa7a8107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 --2- 172.21.15.8:0/4214601501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7a80f77d0 0x7fa7a8107280 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fa798009990 tx=0x7fa798009b30).stop 2023-10-18T21:24:30.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/4214601501 shutdown_connections 2023-10-18T21:24:30.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 --2- 172.21.15.8:0/4214601501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa794060f70 0x7fa794063430 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 --2- 172.21.15.8:0/4214601501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a80f6530 0x7fa7a8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 --2- 172.21.15.8:0/4214601501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7a80f77d0 0x7fa7a8107280 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/4214601501 >> 172.21.15.8:0/4214601501 conn(0x7fa7a80f1c90 msgr2=0x7fa7a80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:30.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/4214601501 shutdown_connections 2023-10-18T21:24:30.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:29.996+0000 7fa7ae9a7700 1 -- 172.21.15.8:0/4214601501 wait complete. 2023-10-18T21:24:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.132+0000 7fb699977700 1 -- 172.21.15.8:0/1322505368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6940f77d0 msgr2=0x7fb6940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.132+0000 7fb699977700 1 --2- 172.21.15.8:0/1322505368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6940f77d0 0x7fb6940f7c30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fb680004660 tx=0x7fb680009b30).stop 2023-10-18T21:24:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.132+0000 7fb699977700 1 -- 172.21.15.8:0/1322505368 shutdown_connections 2023-10-18T21:24:30.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.132+0000 7fb699977700 1 --2- 172.21.15.8:0/1322505368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6940f77d0 0x7fb6940f7c30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.132+0000 7fb699977700 1 --2- 172.21.15.8:0/1322505368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6940f6530 0x7fb6940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.132+0000 7fb699977700 1 -- 172.21.15.8:0/1322505368 >> 172.21.15.8:0/1322505368 conn(0x7fb6940f1c90 msgr2=0x7fb6940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:30.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.132+0000 7fb699977700 1 -- 172.21.15.8:0/1322505368 shutdown_connections 2023-10-18T21:24:30.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.132+0000 7fb699977700 1 -- 172.21.15.8:0/1322505368 wait complete. 2023-10-18T21:24:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.133+0000 7fb699977700 1 Processor -- start 2023-10-18T21:24:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.133+0000 7fb699977700 1 -- start start 2023-10-18T21:24:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.133+0000 7fb699977700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6940f6530 0x7fb694106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.133+0000 7fb699977700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6940f77d0 0x7fb694107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:30.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.133+0000 7fb699977700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb694107850 con 0x7fb6940f6530 2023-10-18T21:24:30.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.133+0000 7fb699977700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb694108060 con 0x7fb6940f77d0 2023-10-18T21:24:30.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.133+0000 7fb698975700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6940f6530 0x7fb694106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:30.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.133+0000 7fb698975700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6940f6530 0x7fb694106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36178/0 (socket says 172.21.15.8:36178) 2023-10-18T21:24:30.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.133+0000 7fb698975700 1 -- 172.21.15.8:0/3061205784 learned_addr learned my addr 172.21.15.8:0/3061205784 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:24:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.133+0000 7fb693fff700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6940f77d0 0x7fb694107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.134+0000 7fb698975700 1 -- 172.21.15.8:0/3061205784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6940f77d0 msgr2=0x7fb694107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.134+0000 7fb698975700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6940f77d0 0x7fb694107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.134+0000 7fb698975700 1 -- 172.21.15.8:0/3061205784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb680005040 con 0x7fb6940f6530 2023-10-18T21:24:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.134+0000 7fb698975700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6940f6530 0x7fb694106d60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fb68800e7c0 tx=0x7fb68800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.134+0000 7fb6917fa700 1 -- 172.21.15.8:0/3061205784 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6880092e0 con 0x7fb6940f6530 2023-10-18T21:24:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.134+0000 7fb6917fa700 1 -- 172.21.15.8:0/3061205784 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb68800f040 con 0x7fb6940f6530 2023-10-18T21:24:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.134+0000 7fb699977700 1 -- 172.21.15.8:0/3061205784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6941082e0 con 0x7fb6940f6530 2023-10-18T21:24:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.134+0000 7fb6917fa700 1 -- 172.21.15.8:0/3061205784 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb688014810 con 0x7fb6940f6530 2023-10-18T21:24:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.134+0000 7fb699977700 1 -- 172.21.15.8:0/3061205784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb694108820 con 0x7fb6940f6530 2023-10-18T21:24:30.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.136+0000 7fb699977700 1 -- 172.21.15.8:0/3061205784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb694059100 con 0x7fb6940f6530 2023-10-18T21:24:30.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.136+0000 7fb6917fa700 1 -- 172.21.15.8:0/3061205784 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb68801b030 con 0x7fb6940f6530 2023-10-18T21:24:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.137+0000 7fb6917fa700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb684060f70 0x7fb684063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.137+0000 7fb6917fa700 1 -- 172.21.15.8:0/3061205784 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb68807c920 con 0x7fb6940f6530 2023-10-18T21:24:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.137+0000 7fb693fff700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb684060f70 0x7fb684063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.138+0000 7fb693fff700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb684060f70 0x7fb684063430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fb680009720 tx=0x7fb680016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:30.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.141+0000 7fb6917fa700 1 -- 172.21.15.8:0/3061205784 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb68804c4d0 con 0x7fb6940f6530 2023-10-18T21:24:30.148 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.165821+0000 mon.smithi008 (mon.0) 2009 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:30.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.720018+0000 mon.smithi008 (mon.0) 2010 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:24:30.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.720886+0000 mon.smithi008 (mon.0) 2011 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:24:30.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.398+0000 7fb699977700 1 -- 172.21.15.8:0/3061205784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb6940008d0 con 0x7fb6940f6530 2023-10-18T21:24:30.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.398+0000 7fb6917fa700 1 -- 172.21.15.8:0/3061205784 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fb688019070 con 0x7fb6940f6530 2023-10-18T21:24:30.399 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:24:30.400 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:24:30.400 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:24:30.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:24:30.400 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:24:30.400 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:24:30.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:24:30.401 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:24:30.401 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:24:30.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:24:30.401 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:24:30.401 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:24:30.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:24:30.402 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:24:30.402 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:24:30.402 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:24:30.402 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:24:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.400+0000 7fb699977700 1 -- 172.21.15.8:0/3061205784 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb684060f70 msgr2=0x7fb684063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.400+0000 7fb699977700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb684060f70 0x7fb684063430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fb680009720 tx=0x7fb680016040).stop 2023-10-18T21:24:30.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.400+0000 7fb699977700 1 -- 172.21.15.8:0/3061205784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6940f6530 msgr2=0x7fb694106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.400+0000 7fb699977700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6940f6530 0x7fb694106d60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fb68800e7c0 tx=0x7fb68800b040).stop 2023-10-18T21:24:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.401+0000 7fb699977700 1 -- 172.21.15.8:0/3061205784 shutdown_connections 2023-10-18T21:24:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.401+0000 7fb699977700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb684060f70 0x7fb684063430 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.401+0000 7fb699977700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6940f6530 0x7fb694106d60 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.401+0000 7fb699977700 1 --2- 172.21.15.8:0/3061205784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6940f77d0 0x7fb694107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.401+0000 7fb699977700 1 -- 172.21.15.8:0/3061205784 >> 172.21.15.8:0/3061205784 conn(0x7fb6940f1c90 msgr2=0x7fb6940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.401+0000 7fb699977700 1 -- 172.21.15.8:0/3061205784 shutdown_connections 2023-10-18T21:24:30.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.401+0000 7fb699977700 1 -- 172.21.15.8:0/3061205784 wait complete. 2023-10-18T21:24:30.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.554+0000 7ff552ed4700 1 -- 172.21.15.8:0/2357010454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff54c0f6530 msgr2=0x7ff54c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.554+0000 7ff552ed4700 1 --2- 172.21.15.8:0/2357010454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff54c0f6530 0x7ff54c0f6950 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7ff548004660 tx=0x7ff548009b30).stop 2023-10-18T21:24:30.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.554+0000 7ff552ed4700 1 -- 172.21.15.8:0/2357010454 shutdown_connections 2023-10-18T21:24:30.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.554+0000 7ff552ed4700 1 --2- 172.21.15.8:0/2357010454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff54c0f77d0 0x7ff54c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.554+0000 7ff552ed4700 1 --2- 172.21.15.8:0/2357010454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff54c0f6530 0x7ff54c0f6950 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.554+0000 7ff552ed4700 1 -- 172.21.15.8:0/2357010454 >> 172.21.15.8:0/2357010454 conn(0x7ff54c0f1c90 msgr2=0x7ff54c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:30.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.554+0000 7ff552ed4700 1 -- 172.21.15.8:0/2357010454 shutdown_connections 2023-10-18T21:24:30.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.554+0000 7ff552ed4700 1 -- 172.21.15.8:0/2357010454 wait complete. 2023-10-18T21:24:30.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.555+0000 7ff552ed4700 1 Processor -- start 2023-10-18T21:24:30.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.555+0000 7ff552ed4700 1 -- start start 2023-10-18T21:24:30.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.555+0000 7ff552ed4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff54c0f6530 0x7ff54c106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:30.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.555+0000 7ff552ed4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff54c0f77d0 0x7ff54c107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:30.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.555+0000 7ff552ed4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c107910 con 0x7ff54c0f6530 2023-10-18T21:24:30.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.555+0000 7ff552ed4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c108120 con 0x7ff54c0f77d0 2023-10-18T21:24:30.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.555+0000 7ff551ed2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff54c0f6530 0x7ff54c106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:30.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.555+0000 7ff551ed2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff54c0f6530 0x7ff54c106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36190/0 (socket says 172.21.15.8:36190) 2023-10-18T21:24:30.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.555+0000 7ff551ed2700 1 -- 172.21.15.8:0/1118632 learned_addr learned my addr 172.21.15.8:0/1118632 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:24:30.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.556+0000 7ff5516d1700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff54c0f77d0 0x7ff54c107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:30.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.556+0000 7ff551ed2700 1 -- 172.21.15.8:0/1118632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff54c0f77d0 msgr2=0x7ff54c107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.556+0000 7ff551ed2700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff54c0f77d0 0x7ff54c107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.556+0000 7ff551ed2700 1 -- 172.21.15.8:0/1118632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff548005040 con 0x7ff54c0f6530 2023-10-18T21:24:30.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.556+0000 7ff551ed2700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff54c0f6530 0x7ff54c106e20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7ff548007a60 tx=0x7ff548009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:30.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.556+0000 7ff5427fc700 1 -- 172.21.15.8:0/1118632 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff548018070 con 0x7ff54c0f6530 2023-10-18T21:24:30.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.556+0000 7ff5427fc700 1 -- 172.21.15.8:0/1118632 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff548009630 con 0x7ff54c0f6530 2023-10-18T21:24:30.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.556+0000 7ff552ed4700 1 -- 172.21.15.8:0/1118632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54c108340 con 0x7ff54c0f6530 2023-10-18T21:24:30.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.556+0000 7ff5427fc700 1 -- 172.21.15.8:0/1118632 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff54801c4d0 con 0x7ff54c0f6530 2023-10-18T21:24:30.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.557+0000 7ff552ed4700 1 -- 172.21.15.8:0/1118632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c1088a0 con 0x7ff54c0f6530 2023-10-18T21:24:30.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.558+0000 7ff552ed4700 1 -- 172.21.15.8:0/1118632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c059100 con 0x7ff54c0f6530 2023-10-18T21:24:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.559+0000 7ff5427fc700 1 -- 172.21.15.8:0/1118632 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff54801d420 con 0x7ff54c0f6530 2023-10-18T21:24:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.559+0000 7ff5427fc700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff538060f70 0x7ff538063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.559+0000 7ff5427fc700 1 -- 172.21.15.8:0/1118632 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff54807e4a0 con 0x7ff54c0f6530 2023-10-18T21:24:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.560+0000 7ff5516d1700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff538060f70 0x7ff538063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.560+0000 7ff5516d1700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff538060f70 0x7ff538063430 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7ff53c004c40 tx=0x7ff53c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:30.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.564+0000 7ff5427fc700 1 -- 172.21.15.8:0/1118632 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff54804e190 con 0x7ff54c0f6530 2023-10-18T21:24:30.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.796+0000 7ff552ed4700 1 -- 172.21.15.8:0/1118632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff54c0fecc0 con 0x7ff54c0f6530 2023-10-18T21:24:30.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.796+0000 7ff5427fc700 1 -- 172.21.15.8:0/1118632 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7ff5480517b0 con 0x7ff54c0f6530 2023-10-18T21:24:30.797 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:24:30.797 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:24:30.798 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:24:30.798 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:24:30.798 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:24:30.798 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:24:30.798 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:24:30.799 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:24:30.799 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:24:30.799 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:24:30.799 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:24:30.799 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:24:30.800 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:24:30.800 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:24:30.800 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:24:30.800 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:24:30.800 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:24:30.801 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:24:30.801 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:24:30.801 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:24:30.801 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:24:30.801 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:24:30.801 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:24:30.802 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:24:30.802 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:24:30.802 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:24:30.802 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:24:30.802 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:24:30.803 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:24:30.803 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:24:30.803 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:24:30.803 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:24:30.803 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:24:30.803 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:24:30.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 -- 172.21.15.8:0/1118632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff538060f70 msgr2=0x7ff538063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff538060f70 0x7ff538063430 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7ff53c004c40 tx=0x7ff53c00b040).stop 2023-10-18T21:24:30.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 -- 172.21.15.8:0/1118632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff54c0f6530 msgr2=0x7ff54c106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff54c0f6530 0x7ff54c106e20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7ff548007a60 tx=0x7ff548009b30).stop 2023-10-18T21:24:30.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 -- 172.21.15.8:0/1118632 shutdown_connections 2023-10-18T21:24:30.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff538060f70 0x7ff538063430 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff54c0f6530 0x7ff54c106e20 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 --2- 172.21.15.8:0/1118632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff54c0f77d0 0x7ff54c107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 -- 172.21.15.8:0/1118632 >> 172.21.15.8:0/1118632 conn(0x7ff54c0f1c90 msgr2=0x7ff54c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:30.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 -- 172.21.15.8:0/1118632 shutdown_connections 2023-10-18T21:24:30.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.798+0000 7ff552ed4700 1 -- 172.21.15.8:0/1118632 wait complete. 2023-10-18T21:24:30.807 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:24:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.937+0000 7faefdb82700 1 -- 172.21.15.8:0/1061482214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef806c340 msgr2=0x7faef806c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.937+0000 7faefdb82700 1 --2- 172.21.15.8:0/1061482214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef806c340 0x7faef806c760 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7faeec004660 tx=0x7faeec009b30).stop 2023-10-18T21:24:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.937+0000 7faefdb82700 1 -- 172.21.15.8:0/1061482214 shutdown_connections 2023-10-18T21:24:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.937+0000 7faefdb82700 1 --2- 172.21.15.8:0/1061482214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef806d630 0x7faef806dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.937+0000 7faefdb82700 1 --2- 172.21.15.8:0/1061482214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef806c340 0x7faef806c760 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.937+0000 7faefdb82700 1 -- 172.21.15.8:0/1061482214 >> 172.21.15.8:0/1061482214 conn(0x7faef80f40e0 msgr2=0x7faef80f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.937+0000 7faefdb82700 1 -- 172.21.15.8:0/1061482214 shutdown_connections 2023-10-18T21:24:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.937+0000 7faefdb82700 1 -- 172.21.15.8:0/1061482214 wait complete. 2023-10-18T21:24:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.938+0000 7faefdb82700 1 Processor -- start 2023-10-18T21:24:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.938+0000 7faefdb82700 1 -- start start 2023-10-18T21:24:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.938+0000 7faefdb82700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef806c340 0x7faef810d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faefdb82700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef806d630 0x7faef810d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faefdb82700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef810ddd0 con 0x7faef806c340 2023-10-18T21:24:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faefdb82700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef810df10 con 0x7faef806d630 2023-10-18T21:24:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faefcb80700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef806c340 0x7faef810d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faefcb80700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef806c340 0x7faef810d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36216/0 (socket says 172.21.15.8:36216) 2023-10-18T21:24:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faefcb80700 1 -- 172.21.15.8:0/1723477115 learned_addr learned my addr 172.21.15.8:0/1723477115 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:24:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faef7fff700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef806d630 0x7faef810d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faefcb80700 1 -- 172.21.15.8:0/1723477115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef806d630 msgr2=0x7faef810d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faefcb80700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef806d630 0x7faef810d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:30.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faefcb80700 1 -- 172.21.15.8:0/1723477115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec005040 con 0x7faef806c340 2023-10-18T21:24:30.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.939+0000 7faefcb80700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef806c340 0x7faef810d330 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7faeec009f50 tx=0x7faeec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:30.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.940+0000 7faef57fa700 1 -- 172.21.15.8:0/1723477115 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faeec018070 con 0x7faef806c340 2023-10-18T21:24:30.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.940+0000 7faef57fa700 1 -- 172.21.15.8:0/1723477115 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faeec009630 con 0x7faef806c340 2023-10-18T21:24:30.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.940+0000 7faefdb82700 1 -- 172.21.15.8:0/1723477115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef810e850 con 0x7faef806c340 2023-10-18T21:24:30.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.940+0000 7faef57fa700 1 -- 172.21.15.8:0/1723477115 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faeec01c3c0 con 0x7faef806c340 2023-10-18T21:24:30.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.940+0000 7faefdb82700 1 -- 172.21.15.8:0/1723477115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef810edb0 con 0x7faef806c340 2023-10-18T21:24:30.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.941+0000 7faefdb82700 1 -- 172.21.15.8:0/1723477115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef8045ad0 con 0x7faef806c340 2023-10-18T21:24:30.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.942+0000 7faef57fa700 1 -- 172.21.15.8:0/1723477115 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faeec01d420 con 0x7faef806c340 2023-10-18T21:24:30.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.942+0000 7faef57fa700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faee8060f70 0x7faee8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:24:30.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.942+0000 7faef57fa700 1 -- 172.21.15.8:0/1723477115 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faeec07e480 con 0x7faef806c340 2023-10-18T21:24:30.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.943+0000 7faef7fff700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faee8060f70 0x7faee8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:24:30.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.943+0000 7faef7fff700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faee8060f70 0x7faee8063430 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7faee4004c40 tx=0x7faee400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:24:30.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:30.947+0000 7faef57fa700 1 -- 172.21.15.8:0/1723477115 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faeec051ba0 con 0x7faef806c340 2023-10-18T21:24:30.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:29.139981+0000 mgr.smithi008.flmjzp (mgr.14640) 1539 : cluster [DBG] pgmap v1070: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.293883+0000 mgr.smithi008.flmjzp (mgr.14640) 1540 : audit [DBG] from='client.35416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:24:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.642274+0000 mgr.smithi008.flmjzp (mgr.14640) 1541 : audit [DBG] from='client.35420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:24:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:29.721597+0000 mgr.smithi008.flmjzp (mgr.14640) 1542 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:24:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:29.722245+0000 mgr.smithi008.flmjzp (mgr.14640) 1543 : cluster [DBG] pgmap v1071: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:29.722623+0000 mgr.smithi008.flmjzp (mgr.14640) 1544 : cluster [DBG] pgmap v1072: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.730609+0000 mon.smithi008 (mon.0) 2012 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.735735+0000 mon.smithi008 (mon.0) 2013 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.738240+0000 mon.smithi008 (mon.0) 2014 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.739513+0000 mon.smithi008 (mon.0) 2015 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.740802+0000 mon.smithi008 (mon.0) 2016 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:30.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.742396+0000 mon.smithi008 (mon.0) 2017 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:30.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:29.744318+0000 mgr.smithi008.flmjzp (mgr.14640) 1545 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:24:30.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:30.398893+0000 mon.smithi008 (mon.0) 2018 : audit [DBG] from='client.? 172.21.15.8:0/3061205784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:31.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.145+0000 7faefdb82700 1 -- 172.21.15.8:0/1723477115 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faef8105400 con 0x7faee8060f70 2023-10-18T21:24:31.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.147+0000 7faef57fa700 1 -- 172.21.15.8:0/1723477115 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faef8105400 con 0x7faee8060f70 2023-10-18T21:24:31.147 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:24:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:24:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:24:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:24:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:24:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:24:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:24:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:24:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:24:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:24:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:24:31.150 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:24:31.150 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:24:31.150 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:24:31.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.148+0000 7faefdb82700 1 -- 172.21.15.8:0/1723477115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faee8060f70 msgr2=0x7faee8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:31.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.148+0000 7faefdb82700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faee8060f70 0x7faee8063430 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7faee4004c40 tx=0x7faee400b040).stop 2023-10-18T21:24:31.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.149+0000 7faefdb82700 1 -- 172.21.15.8:0/1723477115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef806c340 msgr2=0x7faef810d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:24:31.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.149+0000 7faefdb82700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef806c340 0x7faef810d330 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7faeec009f50 tx=0x7faeec009b30).stop 2023-10-18T21:24:31.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.149+0000 7faefdb82700 1 -- 172.21.15.8:0/1723477115 shutdown_connections 2023-10-18T21:24:31.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.149+0000 7faefdb82700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faee8060f70 0x7faee8063430 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:31.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.149+0000 7faefdb82700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faef806c340 0x7faef810d330 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:31.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.149+0000 7faefdb82700 1 --2- 172.21.15.8:0/1723477115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef806d630 0x7faef810d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:24:31.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.149+0000 7faefdb82700 1 -- 172.21.15.8:0/1723477115 >> 172.21.15.8:0/1723477115 conn(0x7faef80f40e0 msgr2=0x7faef8103300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:24:31.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.149+0000 7faefdb82700 1 -- 172.21.15.8:0/1723477115 shutdown_connections 2023-10-18T21:24:31.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:24:31.149+0000 7faefdb82700 1 -- 172.21.15.8:0/1723477115 wait complete. 2023-10-18T21:24:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:29.139981+0000 mgr.smithi008.flmjzp (mgr.14640) 1539 : cluster [DBG] pgmap v1070: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.293883+0000 mgr.smithi008.flmjzp (mgr.14640) 1540 : audit [DBG] from='client.35416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:24:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.642274+0000 mgr.smithi008.flmjzp (mgr.14640) 1541 : audit [DBG] from='client.35420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:24:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:29.721597+0000 mgr.smithi008.flmjzp (mgr.14640) 1542 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:24:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:29.722245+0000 mgr.smithi008.flmjzp (mgr.14640) 1543 : cluster [DBG] pgmap v1071: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:29.722623+0000 mgr.smithi008.flmjzp (mgr.14640) 1544 : cluster [DBG] pgmap v1072: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.730609+0000 mon.smithi008 (mon.0) 2012 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.735735+0000 mon.smithi008 (mon.0) 2013 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.738240+0000 mon.smithi008 (mon.0) 2014 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.739513+0000 mon.smithi008 (mon.0) 2015 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:31.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.740802+0000 mon.smithi008 (mon.0) 2016 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:31.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.742396+0000 mon.smithi008 (mon.0) 2017 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:31.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:29.744318+0000 mgr.smithi008.flmjzp (mgr.14640) 1545 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:24:31.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:30.398893+0000 mon.smithi008 (mon.0) 2018 : audit [DBG] from='client.? 172.21.15.8:0/3061205784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:29.985729+0000 mgr.smithi008.flmjzp (mgr.14640) 1546 : audit [DBG] from='client.35424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:24:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:30.796810+0000 mon.smithi008 (mon.0) 2019 : audit [DBG] from='client.? 172.21.15.8:0/1118632' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:24:32.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:29.985729+0000 mgr.smithi008.flmjzp (mgr.14640) 1546 : audit [DBG] from='client.35424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:24:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:30.796810+0000 mon.smithi008 (mon.0) 2019 : audit [DBG] from='client.? 172.21.15.8:0/1118632' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:24:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:31.147072+0000 mgr.smithi008.flmjzp (mgr.14640) 1547 : audit [DBG] from='client.35436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:24:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:31.723222+0000 mgr.smithi008.flmjzp (mgr.14640) 1548 : cluster [DBG] pgmap v1073: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:33.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:31.147072+0000 mgr.smithi008.flmjzp (mgr.14640) 1547 : audit [DBG] from='client.35436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:24:33.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:31.723222+0000 mgr.smithi008.flmjzp (mgr.14640) 1548 : cluster [DBG] pgmap v1073: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:35.143 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:33.723872+0000 mgr.smithi008.flmjzp (mgr.14640) 1549 : cluster [DBG] pgmap v1074: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:35.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:33.723872+0000 mgr.smithi008.flmjzp (mgr.14640) 1549 : cluster [DBG] pgmap v1074: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:35.724584+0000 mgr.smithi008.flmjzp (mgr.14640) 1550 : cluster [DBG] pgmap v1075: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:36.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:35.724584+0000 mgr.smithi008.flmjzp (mgr.14640) 1550 : cluster [DBG] pgmap v1075: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:37.725121+0000 mgr.smithi008.flmjzp (mgr.14640) 1551 : cluster [DBG] pgmap v1076: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:39.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:37.725121+0000 mgr.smithi008.flmjzp (mgr.14640) 1551 : cluster [DBG] pgmap v1076: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:40.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:39.755093+0000 mon.smithi008 (mon.0) 2020 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:40.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:39.757252+0000 mon.smithi008 (mon.0) 2021 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:24:40.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:39.758255+0000 mon.smithi008 (mon.0) 2022 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:24:40.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:39.765178+0000 mon.smithi008 (mon.0) 2023 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:40.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:39.771698+0000 mon.smithi008 (mon.0) 2024 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:40.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:39.774770+0000 mon.smithi008 (mon.0) 2025 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:40.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:39.776412+0000 mon.smithi008 (mon.0) 2026 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:40.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:39.778017+0000 mon.smithi008 (mon.0) 2027 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:40.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:39.779890+0000 mon.smithi008 (mon.0) 2028 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:40.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:39.755093+0000 mon.smithi008 (mon.0) 2020 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:39.757252+0000 mon.smithi008 (mon.0) 2021 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:24:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:39.758255+0000 mon.smithi008 (mon.0) 2022 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:24:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:39.765178+0000 mon.smithi008 (mon.0) 2023 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:39.771698+0000 mon.smithi008 (mon.0) 2024 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:40.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:39.774770+0000 mon.smithi008 (mon.0) 2025 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:40.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:39.776412+0000 mon.smithi008 (mon.0) 2026 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:40.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:39.778017+0000 mon.smithi008 (mon.0) 2027 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:40.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:39.779890+0000 mon.smithi008 (mon.0) 2028 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:39.725786+0000 mgr.smithi008.flmjzp (mgr.14640) 1552 : cluster [DBG] pgmap v1077: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:39.759128+0000 mgr.smithi008.flmjzp (mgr.14640) 1553 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:24:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:39.759767+0000 mgr.smithi008.flmjzp (mgr.14640) 1554 : cluster [DBG] pgmap v1078: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:39.759992+0000 mgr.smithi008.flmjzp (mgr.14640) 1555 : cluster [DBG] pgmap v1079: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:41.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:39.782487+0000 mgr.smithi008.flmjzp (mgr.14640) 1556 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:24:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:39.725786+0000 mgr.smithi008.flmjzp (mgr.14640) 1552 : cluster [DBG] pgmap v1077: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:39.759128+0000 mgr.smithi008.flmjzp (mgr.14640) 1553 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:24:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:39.759767+0000 mgr.smithi008.flmjzp (mgr.14640) 1554 : cluster [DBG] pgmap v1078: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:41.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:39.759992+0000 mgr.smithi008.flmjzp (mgr.14640) 1555 : cluster [DBG] pgmap v1079: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:41.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:39.782487+0000 mgr.smithi008.flmjzp (mgr.14640) 1556 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:24:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:41.760641+0000 mgr.smithi008.flmjzp (mgr.14640) 1557 : cluster [DBG] pgmap v1080: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:43.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:41.760641+0000 mgr.smithi008.flmjzp (mgr.14640) 1557 : cluster [DBG] pgmap v1080: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:45.144 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:43.761318+0000 mgr.smithi008.flmjzp (mgr.14640) 1558 : cluster [DBG] pgmap v1081: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:45.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:43.761318+0000 mgr.smithi008.flmjzp (mgr.14640) 1558 : cluster [DBG] pgmap v1081: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:45.761883+0000 mgr.smithi008.flmjzp (mgr.14640) 1559 : cluster [DBG] pgmap v1082: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:46.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:45.761883+0000 mgr.smithi008.flmjzp (mgr.14640) 1559 : cluster [DBG] pgmap v1082: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:47.762596+0000 mgr.smithi008.flmjzp (mgr.14640) 1560 : cluster [DBG] pgmap v1083: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:47.762596+0000 mgr.smithi008.flmjzp (mgr.14640) 1560 : cluster [DBG] pgmap v1083: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:50.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:49.787607+0000 mon.smithi008 (mon.0) 2029 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:49.787607+0000 mon.smithi008 (mon.0) 2029 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:49.763302+0000 mgr.smithi008.flmjzp (mgr.14640) 1561 : cluster [DBG] pgmap v1084: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:49.763302+0000 mgr.smithi008.flmjzp (mgr.14640) 1561 : cluster [DBG] pgmap v1084: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:51.763883+0000 mgr.smithi008.flmjzp (mgr.14640) 1562 : cluster [DBG] pgmap v1085: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:52.677496+0000 mon.smithi008 (mon.0) 2030 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:52.678599+0000 mon.smithi008 (mon.0) 2031 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:24:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:52.679664+0000 mon.smithi008 (mon.0) 2032 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:24:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:52.685685+0000 mon.smithi008 (mon.0) 2033 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:52.691915+0000 mon.smithi008 (mon.0) 2034 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:52.694957+0000 mon.smithi008 (mon.0) 2035 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:52.696566+0000 mon.smithi008 (mon.0) 2036 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:52.698109+0000 mon.smithi008 (mon.0) 2037 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:24:52.700076+0000 mon.smithi008 (mon.0) 2038 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:53.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:51.763883+0000 mgr.smithi008.flmjzp (mgr.14640) 1562 : cluster [DBG] pgmap v1085: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:53.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:52.677496+0000 mon.smithi008 (mon.0) 2030 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:52.678599+0000 mon.smithi008 (mon.0) 2031 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:24:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:52.679664+0000 mon.smithi008 (mon.0) 2032 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:24:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:52.685685+0000 mon.smithi008 (mon.0) 2033 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:24:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:52.691915+0000 mon.smithi008 (mon.0) 2034 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:24:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:52.694957+0000 mon.smithi008 (mon.0) 2035 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:52.696566+0000 mon.smithi008 (mon.0) 2036 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:52.698109+0000 mon.smithi008 (mon.0) 2037 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:24:52.700076+0000 mon.smithi008 (mon.0) 2038 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:24:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:52.671115+0000 mgr.smithi008.flmjzp (mgr.14640) 1563 : cephadm [INF] Detected new or changed devices on smithi060 2023-10-18T21:24:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:52.680527+0000 mgr.smithi008.flmjzp (mgr.14640) 1564 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:24:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:52.681232+0000 mgr.smithi008.flmjzp (mgr.14640) 1565 : cluster [DBG] pgmap v1086: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:52.681523+0000 mgr.smithi008.flmjzp (mgr.14640) 1566 : cluster [DBG] pgmap v1087: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:24:52.701963+0000 mgr.smithi008.flmjzp (mgr.14640) 1567 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:24:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:52.671115+0000 mgr.smithi008.flmjzp (mgr.14640) 1563 : cephadm [INF] Detected new or changed devices on smithi060 2023-10-18T21:24:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:52.680527+0000 mgr.smithi008.flmjzp (mgr.14640) 1564 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:24:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:52.681232+0000 mgr.smithi008.flmjzp (mgr.14640) 1565 : cluster [DBG] pgmap v1086: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:52.681523+0000 mgr.smithi008.flmjzp (mgr.14640) 1566 : cluster [DBG] pgmap v1087: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:24:52.701963+0000 mgr.smithi008.flmjzp (mgr.14640) 1567 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:24:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:54.682138+0000 mgr.smithi008.flmjzp (mgr.14640) 1568 : cluster [DBG] pgmap v1088: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:56.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:54.682138+0000 mgr.smithi008.flmjzp (mgr.14640) 1568 : cluster [DBG] pgmap v1088: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:58.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:56.682750+0000 mgr.smithi008.flmjzp (mgr.14640) 1569 : cluster [DBG] pgmap v1089: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:24:58.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:56.682750+0000 mgr.smithi008.flmjzp (mgr.14640) 1569 : cluster [DBG] pgmap v1089: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:00.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:24:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:24:58.683385+0000 mgr.smithi008.flmjzp (mgr.14640) 1570 : cluster [DBG] pgmap v1090: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:24:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:24:58.683385+0000 mgr.smithi008.flmjzp (mgr.14640) 1570 : cluster [DBG] pgmap v1090: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:01.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.302+0000 7fedcd884700 1 -- 172.21.15.8:0/676886479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc80f77d0 msgr2=0x7fedc80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:01.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.302+0000 7fedcd884700 1 --2- 172.21.15.8:0/676886479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc80f77d0 0x7fedc80f7c30 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fedb4004660 tx=0x7fedb4009b30).stop 2023-10-18T21:25:01.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.302+0000 7fedcd884700 1 -- 172.21.15.8:0/676886479 shutdown_connections 2023-10-18T21:25:01.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.302+0000 7fedcd884700 1 --2- 172.21.15.8:0/676886479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc80f77d0 0x7fedc80f7c30 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.302+0000 7fedcd884700 1 --2- 172.21.15.8:0/676886479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc80f6530 0x7fedc80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.302+0000 7fedcd884700 1 -- 172.21.15.8:0/676886479 >> 172.21.15.8:0/676886479 conn(0x7fedc80f1c90 msgr2=0x7fedc80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:01.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.302+0000 7fedcd884700 1 -- 172.21.15.8:0/676886479 shutdown_connections 2023-10-18T21:25:01.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.302+0000 7fedcd884700 1 -- 172.21.15.8:0/676886479 wait complete. 2023-10-18T21:25:01.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.303+0000 7fedcd884700 1 Processor -- start 2023-10-18T21:25:01.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.303+0000 7fedcd884700 1 -- start start 2023-10-18T21:25:01.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedcd884700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc80f6530 0x7fedc8108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:01.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedcd884700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc80f77d0 0x7fedc8109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:01.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedcd884700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc81099c0 con 0x7fedc80f6530 2023-10-18T21:25:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedcd884700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8109b00 con 0x7fedc80f77d0 2023-10-18T21:25:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedcc882700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc80f6530 0x7fedc8108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedcc882700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc80f6530 0x7fedc8108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38852/0 (socket says 172.21.15.8:38852) 2023-10-18T21:25:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedcc882700 1 -- 172.21.15.8:0/3217367253 learned_addr learned my addr 172.21.15.8:0/3217367253 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedc7fff700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc80f77d0 0x7fedc8109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:01.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedcc882700 1 -- 172.21.15.8:0/3217367253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc80f77d0 msgr2=0x7fedc8109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:01.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedcc882700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc80f77d0 0x7fedc8109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.304+0000 7fedcc882700 1 -- 172.21.15.8:0/3217367253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4005040 con 0x7fedc80f6530 2023-10-18T21:25:01.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.305+0000 7fedcc882700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc80f6530 0x7fedc8108f20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fedbc00e7c0 tx=0x7fedbc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:01.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.305+0000 7fedc57fa700 1 -- 172.21.15.8:0/3217367253 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedbc0092e0 con 0x7fedc80f6530 2023-10-18T21:25:01.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.305+0000 7fedc57fa700 1 -- 172.21.15.8:0/3217367253 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fedbc00f040 con 0x7fedc80f6530 2023-10-18T21:25:01.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.305+0000 7fedc57fa700 1 -- 172.21.15.8:0/3217367253 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedbc014810 con 0x7fedc80f6530 2023-10-18T21:25:01.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.305+0000 7fedcd884700 1 -- 172.21.15.8:0/3217367253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc810a4a0 con 0x7fedc80f6530 2023-10-18T21:25:01.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.305+0000 7fedcd884700 1 -- 172.21.15.8:0/3217367253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc810a9e0 con 0x7fedc80f6530 2023-10-18T21:25:01.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.306+0000 7fedcd884700 1 -- 172.21.15.8:0/3217367253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc8045ad0 con 0x7fedc80f6530 2023-10-18T21:25:01.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.307+0000 7fedc57fa700 1 -- 172.21.15.8:0/3217367253 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fedbc01b030 con 0x7fedc80f6530 2023-10-18T21:25:01.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.308+0000 7fedc57fa700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedb8060f70 0x7fedb8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:01.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.308+0000 7fedc57fa700 1 -- 172.21.15.8:0/3217367253 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fedbc07c880 con 0x7fedc80f6530 2023-10-18T21:25:01.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.308+0000 7fedc7fff700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedb8060f70 0x7fedb8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:01.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.309+0000 7fedc7fff700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedb8060f70 0x7fedb8063430 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fedb4005010 tx=0x7fedb4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:01.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.313+0000 7fedc57fa700 1 -- 172.21.15.8:0/3217367253 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fedbc04fe60 con 0x7fedc80f6530 2023-10-18T21:25:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:00.684119+0000 mgr.smithi008.flmjzp (mgr.14640) 1571 : cluster [DBG] pgmap v1091: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:01.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.510+0000 7fedcd884700 1 -- 172.21.15.8:0/3217367253 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedc80fee00 con 0x7fedb8060f70 2023-10-18T21:25:01.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.512+0000 7fedc57fa700 1 -- 172.21.15.8:0/3217367253 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fedc80fee00 con 0x7fedb8060f70 2023-10-18T21:25:01.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 -- 172.21.15.8:0/3217367253 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedb8060f70 msgr2=0x7fedb8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:01.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedb8060f70 0x7fedb8063430 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fedb4005010 tx=0x7fedb4016040).stop 2023-10-18T21:25:01.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 -- 172.21.15.8:0/3217367253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc80f6530 msgr2=0x7fedc8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:01.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc80f6530 0x7fedc8108f20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fedbc00e7c0 tx=0x7fedbc00b040).stop 2023-10-18T21:25:01.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 -- 172.21.15.8:0/3217367253 shutdown_connections 2023-10-18T21:25:01.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fedb8060f70 0x7fedb8063430 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc80f6530 0x7fedc8108f20 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 --2- 172.21.15.8:0/3217367253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc80f77d0 0x7fedc8109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 -- 172.21.15.8:0/3217367253 >> 172.21.15.8:0/3217367253 conn(0x7fedc80f1c90 msgr2=0x7fedc806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:01.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 -- 172.21.15.8:0/3217367253 shutdown_connections 2023-10-18T21:25:01.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.514+0000 7fedcd884700 1 -- 172.21.15.8:0/3217367253 wait complete. 2023-10-18T21:25:01.530 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:25:01.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.652+0000 7f337c52a700 1 -- 172.21.15.8:0/2638966035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33740f66e0 msgr2=0x7f33740f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.652+0000 7f337c52a700 1 --2- 172.21.15.8:0/2638966035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33740f66e0 0x7f33740f6b00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f3370004660 tx=0x7f3370009b30).stop 2023-10-18T21:25:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.652+0000 7f337c52a700 1 -- 172.21.15.8:0/2638966035 shutdown_connections 2023-10-18T21:25:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.652+0000 7f337c52a700 1 --2- 172.21.15.8:0/2638966035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33740f7980 0x7f33740f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.652+0000 7f337c52a700 1 --2- 172.21.15.8:0/2638966035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33740f66e0 0x7f33740f6b00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.652+0000 7f337c52a700 1 -- 172.21.15.8:0/2638966035 >> 172.21.15.8:0/2638966035 conn(0x7f33740f1e40 msgr2=0x7f33740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:01.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.653+0000 7f337c52a700 1 -- 172.21.15.8:0/2638966035 shutdown_connections 2023-10-18T21:25:01.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.653+0000 7f337c52a700 1 -- 172.21.15.8:0/2638966035 wait complete. 2023-10-18T21:25:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.653+0000 7f337c52a700 1 Processor -- start 2023-10-18T21:25:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.654+0000 7f337c52a700 1 -- start start 2023-10-18T21:25:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.654+0000 7f337c52a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33740f66e0 0x7f3374106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.654+0000 7f337c52a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33740f7980 0x7f33741074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.654+0000 7f337c52a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3374107a70 con 0x7f33740f66e0 2023-10-18T21:25:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.654+0000 7f337c52a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3374107bb0 con 0x7f33740f7980 2023-10-18T21:25:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.654+0000 7f337a2c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33740f66e0 0x7f3374106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.654+0000 7f337a2c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33740f66e0 0x7f3374106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38862/0 (socket says 172.21.15.8:38862) 2023-10-18T21:25:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.654+0000 7f337a2c6700 1 -- 172.21.15.8:0/3970025270 learned_addr learned my addr 172.21.15.8:0/3970025270 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.654+0000 7f3379ac5700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33740f7980 0x7f33741074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:01.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.655+0000 7f337a2c6700 1 -- 172.21.15.8:0/3970025270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33740f7980 msgr2=0x7f33741074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:01.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.655+0000 7f337a2c6700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33740f7980 0x7f33741074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.655+0000 7f337a2c6700 1 -- 172.21.15.8:0/3970025270 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3370005040 con 0x7f33740f66e0 2023-10-18T21:25:01.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.655+0000 7f337a2c6700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33740f66e0 0x7f3374106fd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f3370007a60 tx=0x7f3370009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:01.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.655+0000 7f336affd700 1 -- 172.21.15.8:0/3970025270 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3370018070 con 0x7f33740f66e0 2023-10-18T21:25:01.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.655+0000 7f337c52a700 1 -- 172.21.15.8:0/3970025270 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33741084f0 con 0x7f33740f66e0 2023-10-18T21:25:01.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.655+0000 7f336affd700 1 -- 172.21.15.8:0/3970025270 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3370009630 con 0x7f33740f66e0 2023-10-18T21:25:01.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.655+0000 7f336affd700 1 -- 172.21.15.8:0/3970025270 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f337001c4d0 con 0x7f33740f66e0 2023-10-18T21:25:01.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.655+0000 7f337c52a700 1 -- 172.21.15.8:0/3970025270 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3374108a50 con 0x7f33740f66e0 2023-10-18T21:25:01.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.656+0000 7f337c52a700 1 -- 172.21.15.8:0/3970025270 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3374045ad0 con 0x7f33740f66e0 2023-10-18T21:25:01.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.657+0000 7f336affd700 1 -- 172.21.15.8:0/3970025270 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f337001d420 con 0x7f33740f66e0 2023-10-18T21:25:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.658+0000 7f336affd700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3360060f20 0x7f33600633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.658+0000 7f336affd700 1 -- 172.21.15.8:0/3970025270 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f337007e590 con 0x7f33740f66e0 2023-10-18T21:25:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.658+0000 7f3379ac5700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3360060f20 0x7f33600633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.659+0000 7f3379ac5700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3360060f20 0x7f33600633e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f3364004c40 tx=0x7f336400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.662+0000 7f336affd700 1 -- 172.21.15.8:0/3970025270 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3370051ca0 con 0x7f33740f66e0 2023-10-18T21:25:01.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:00.684119+0000 mgr.smithi008.flmjzp (mgr.14640) 1571 : cluster [DBG] pgmap v1091: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:01.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.862+0000 7f337c52a700 1 -- 172.21.15.8:0/3970025270 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33740fef80 con 0x7f3360060f20 2023-10-18T21:25:01.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.863+0000 7f336affd700 1 -- 172.21.15.8:0/3970025270 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f33740fef80 con 0x7f3360060f20 2023-10-18T21:25:01.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 -- 172.21.15.8:0/3970025270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3360060f20 msgr2=0x7f33600633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:01.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3360060f20 0x7f33600633e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f3364004c40 tx=0x7f336400b040).stop 2023-10-18T21:25:01.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 -- 172.21.15.8:0/3970025270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33740f66e0 msgr2=0x7f3374106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:01.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33740f66e0 0x7f3374106fd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f3370007a60 tx=0x7f3370009b30).stop 2023-10-18T21:25:01.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 -- 172.21.15.8:0/3970025270 shutdown_connections 2023-10-18T21:25:01.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3360060f20 0x7f33600633e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33740f66e0 0x7f3374106fd0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 --2- 172.21.15.8:0/3970025270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33740f7980 0x7f33741074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:01.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 -- 172.21.15.8:0/3970025270 >> 172.21.15.8:0/3970025270 conn(0x7f33740f1e40 msgr2=0x7f33740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:01.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 -- 172.21.15.8:0/3970025270 shutdown_connections 2023-10-18T21:25:01.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:01.865+0000 7f337c52a700 1 -- 172.21.15.8:0/3970025270 wait complete. 2023-10-18T21:25:02.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.001+0000 7fc95bfff700 1 -- 172.21.15.8:0/943485945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0f96b0 msgr2=0x7fc95c0fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.001+0000 7fc95bfff700 1 --2- 172.21.15.8:0/943485945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0f96b0 0x7fc95c0fbb00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fc950004660 tx=0x7fc950009b30).stop 2023-10-18T21:25:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.002+0000 7fc95bfff700 1 -- 172.21.15.8:0/943485945 shutdown_connections 2023-10-18T21:25:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.002+0000 7fc95bfff700 1 --2- 172.21.15.8:0/943485945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0f96b0 0x7fc95c0fbb00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.002+0000 7fc95bfff700 1 --2- 172.21.15.8:0/943485945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc95c060270 0x7fc95c0f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.002+0000 7fc95bfff700 1 -- 172.21.15.8:0/943485945 >> 172.21.15.8:0/943485945 conn(0x7fc95c0f0ba0 msgr2=0x7fc95c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:02.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.002+0000 7fc95bfff700 1 -- 172.21.15.8:0/943485945 shutdown_connections 2023-10-18T21:25:02.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.002+0000 7fc95bfff700 1 -- 172.21.15.8:0/943485945 wait complete. 2023-10-18T21:25:02.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.002+0000 7fc95bfff700 1 Processor -- start 2023-10-18T21:25:02.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.003+0000 7fc95bfff700 1 -- start start 2023-10-18T21:25:02.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.003+0000 7fc95bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc95c060270 0x7fc95c0f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:02.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.003+0000 7fc95bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0f96b0 0x7fc95c0f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:02.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.003+0000 7fc95bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0f5620 con 0x7fc95c0f96b0 2023-10-18T21:25:02.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.003+0000 7fc95bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0f5760 con 0x7fc95c060270 2023-10-18T21:25:02.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.003+0000 7fc95a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0f96b0 0x7fc95c0f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:02.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.003+0000 7fc95a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0f96b0 0x7fc95c0f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38872/0 (socket says 172.21.15.8:38872) 2023-10-18T21:25:02.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.003+0000 7fc95a7fc700 1 -- 172.21.15.8:0/3283257146 learned_addr learned my addr 172.21.15.8:0/3283257146 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:02.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc95affd700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc95c060270 0x7fc95c0f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:02.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc95a7fc700 1 -- 172.21.15.8:0/3283257146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc95c060270 msgr2=0x7fc95c0f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:02.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc95a7fc700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc95c060270 0x7fc95c0f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc95a7fc700 1 -- 172.21.15.8:0/3283257146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc950005040 con 0x7fc95c0f96b0 2023-10-18T21:25:02.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc95affd700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc95c060270 0x7fc95c0f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:25:02.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc95a7fc700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0f96b0 0x7fc95c0f50c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fc950007a60 tx=0x7fc950009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:02.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc9437fe700 1 -- 172.21.15.8:0/3283257146 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc950018070 con 0x7fc95c0f96b0 2023-10-18T21:25:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc9437fe700 1 -- 172.21.15.8:0/3283257146 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc950009630 con 0x7fc95c0f96b0 2023-10-18T21:25:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc9437fe700 1 -- 172.21.15.8:0/3283257146 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc95001c5c0 con 0x7fc95c0f96b0 2023-10-18T21:25:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc95bfff700 1 -- 172.21.15.8:0/3283257146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c0f59e0 con 0x7fc95c0f96b0 2023-10-18T21:25:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.004+0000 7fc95bfff700 1 -- 172.21.15.8:0/3283257146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c0f5f40 con 0x7fc95c0f96b0 2023-10-18T21:25:02.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.006+0000 7fc95bfff700 1 -- 172.21.15.8:0/3283257146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c045ad0 con 0x7fc95c0f96b0 2023-10-18T21:25:02.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.006+0000 7fc9437fe700 1 -- 172.21.15.8:0/3283257146 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc95001d420 con 0x7fc95c0f96b0 2023-10-18T21:25:02.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.007+0000 7fc9437fe700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc944060f70 0x7fc944063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:02.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.007+0000 7fc9437fe700 1 -- 172.21.15.8:0/3283257146 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc95007e5c0 con 0x7fc95c0f96b0 2023-10-18T21:25:02.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.007+0000 7fc95affd700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc944060f70 0x7fc944063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:02.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.008+0000 7fc95affd700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc944060f70 0x7fc944063430 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fc95c0f69d0 tx=0x7fc94c009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:02.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.011+0000 7fc9437fe700 1 -- 172.21.15.8:0/3283257146 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc95004e2b0 con 0x7fc95c0f96b0 2023-10-18T21:25:02.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.202+0000 7fc95bfff700 1 -- 172.21.15.8:0/3283257146 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc95c057f10 con 0x7fc944060f70 2023-10-18T21:25:02.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.212+0000 7fc9437fe700 1 -- 172.21.15.8:0/3283257146 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc95c057f10 con 0x7fc944060f70 2023-10-18T21:25:02.214 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:25:02.214 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (31m) 9m ago 33m 16.5M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:25:02.214 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (25m) 9m ago 33m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:25:02.214 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (25m) 7m ago 32m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:25:02.215 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (31m) 9m ago 32m 26.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:25:02.215 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 29m - - 2023-10-18T21:25:02.215 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 29m - - 2023-10-18T21:25:02.215 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 29m - - 2023-10-18T21:25:02.216 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 29m - - 2023-10-18T21:25:02.216 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (26m) 9m ago 34m 476M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:25:02.216 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (26m) 7m ago 32m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:25:02.216 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (26m) 9m ago 34m 187M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:25:02.216 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (25m) 7m ago 32m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:25:02.217 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (32m) 9m ago 32m 10.0M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:25:02.217 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (31m) 7m ago 31m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:25:02.217 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (25m) 9m ago 31m 470M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:25:02.217 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (23m) 9m ago 31m 358M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:25:02.217 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (22m) 9m ago 31m 276M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:25:02.218 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (22m) 7m ago 30m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:25:02.218 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (21m) 7m ago 30m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:25:02.218 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (21m) 7m ago 30m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:25:02.218 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (27m) 9m ago 32m 65.4M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:25:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 -- 172.21.15.8:0/3283257146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc944060f70 msgr2=0x7fc944063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc944060f70 0x7fc944063430 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fc95c0f69d0 tx=0x7fc94c009c00).stop 2023-10-18T21:25:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 -- 172.21.15.8:0/3283257146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0f96b0 msgr2=0x7fc95c0f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:02.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0f96b0 0x7fc95c0f50c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fc950007a60 tx=0x7fc950009b30).stop 2023-10-18T21:25:02.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 -- 172.21.15.8:0/3283257146 shutdown_connections 2023-10-18T21:25:02.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc944060f70 0x7fc944063430 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc95c060270 0x7fc95c0f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 --2- 172.21.15.8:0/3283257146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc95c0f96b0 0x7fc95c0f50c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 -- 172.21.15.8:0/3283257146 >> 172.21.15.8:0/3283257146 conn(0x7fc95c0f0ba0 msgr2=0x7fc95c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:02.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 -- 172.21.15.8:0/3283257146 shutdown_connections 2023-10-18T21:25:02.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.214+0000 7fc95bfff700 1 -- 172.21.15.8:0/3283257146 wait complete. 2023-10-18T21:25:02.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.350+0000 7f6bf7fff700 1 -- 172.21.15.8:0/1274395936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bf80f6530 msgr2=0x7f6bf80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:02.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.350+0000 7f6bf7fff700 1 --2- 172.21.15.8:0/1274395936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bf80f6530 0x7f6bf80f6950 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f6be8004660 tx=0x7f6be8009b30).stop 2023-10-18T21:25:02.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.350+0000 7f6bf7fff700 1 -- 172.21.15.8:0/1274395936 shutdown_connections 2023-10-18T21:25:02.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.350+0000 7f6bf7fff700 1 --2- 172.21.15.8:0/1274395936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80f77d0 0x7f6bf80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.350+0000 7f6bf7fff700 1 --2- 172.21.15.8:0/1274395936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bf80f6530 0x7f6bf80f6950 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.350+0000 7f6bf7fff700 1 -- 172.21.15.8:0/1274395936 >> 172.21.15.8:0/1274395936 conn(0x7f6bf80f1c90 msgr2=0x7f6bf80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:02.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.351+0000 7f6bf7fff700 1 -- 172.21.15.8:0/1274395936 shutdown_connections 2023-10-18T21:25:02.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.351+0000 7f6bf7fff700 1 -- 172.21.15.8:0/1274395936 wait complete. 2023-10-18T21:25:02.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.351+0000 7f6bf7fff700 1 Processor -- start 2023-10-18T21:25:02.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.352+0000 7f6bf7fff700 1 -- start start 2023-10-18T21:25:02.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.352+0000 7f6bf7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80f6530 0x7f6bf8106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:02.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.352+0000 7f6bf7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bf80f77d0 0x7f6bf8107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:02.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.352+0000 7f6bf7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8107870 con 0x7f6bf80f77d0 2023-10-18T21:25:02.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.352+0000 7f6bf7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf81080b0 con 0x7f6bf80f6530 2023-10-18T21:25:02.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.352+0000 7f6bf67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bf80f77d0 0x7f6bf8107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:02.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.352+0000 7f6bf67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bf80f77d0 0x7f6bf8107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38892/0 (socket says 172.21.15.8:38892) 2023-10-18T21:25:02.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.352+0000 7f6bf67fc700 1 -- 172.21.15.8:0/2152748758 learned_addr learned my addr 172.21.15.8:0/2152748758 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:02.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.352+0000 7f6bf6ffd700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80f6530 0x7f6bf8106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:02.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.353+0000 7f6bf67fc700 1 -- 172.21.15.8:0/2152748758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80f6530 msgr2=0x7f6bf8106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:02.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.353+0000 7f6bf67fc700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80f6530 0x7f6bf8106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.353+0000 7f6bf67fc700 1 -- 172.21.15.8:0/2152748758 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8005040 con 0x7f6bf80f77d0 2023-10-18T21:25:02.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.353+0000 7f6bf67fc700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bf80f77d0 0x7f6bf8107270 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f6bec00e7f0 tx=0x7f6bec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:02.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.353+0000 7f6bdf7fe700 1 -- 172.21.15.8:0/2152748758 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bec0092e0 con 0x7f6bf80f77d0 2023-10-18T21:25:02.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.353+0000 7f6bdf7fe700 1 -- 172.21.15.8:0/2152748758 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6bec00f040 con 0x7f6bf80f77d0 2023-10-18T21:25:02.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.353+0000 7f6bdf7fe700 1 -- 172.21.15.8:0/2152748758 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bec0147e0 con 0x7f6bf80f77d0 2023-10-18T21:25:02.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.353+0000 7f6bf7fff700 1 -- 172.21.15.8:0/2152748758 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf8108390 con 0x7f6bf80f77d0 2023-10-18T21:25:02.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.353+0000 7f6bf7fff700 1 -- 172.21.15.8:0/2152748758 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf81088d0 con 0x7f6bf80f77d0 2023-10-18T21:25:02.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.354+0000 7f6bf7fff700 1 -- 172.21.15.8:0/2152748758 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf8059100 con 0x7f6bf80f77d0 2023-10-18T21:25:02.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.355+0000 7f6bdf7fe700 1 -- 172.21.15.8:0/2152748758 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6bec01b030 con 0x7f6bf80f77d0 2023-10-18T21:25:02.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.356+0000 7f6bdf7fe700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6be0060f70 0x7f6be0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:02.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.356+0000 7f6bdf7fe700 1 -- 172.21.15.8:0/2152748758 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6bec07c7c0 con 0x7f6bf80f77d0 2023-10-18T21:25:02.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.356+0000 7f6bf6ffd700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6be0060f70 0x7f6be0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:02.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.357+0000 7f6bf6ffd700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6be0060f70 0x7f6be0063430 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f6be8005010 tx=0x7f6be8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:02.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.360+0000 7f6bdf7fe700 1 -- 172.21.15.8:0/2152748758 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6bec04c420 con 0x7f6bf80f77d0 2023-10-18T21:25:02.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.615+0000 7f6bf7fff700 1 -- 172.21.15.8:0/2152748758 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6bf80fed80 con 0x7f6bf80f77d0 2023-10-18T21:25:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.615+0000 7f6bdf7fe700 1 -- 172.21.15.8:0/2152748758 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f6bec019020 con 0x7f6bf80f77d0 2023-10-18T21:25:02.617 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:25:02.618 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:25:02.618 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:25:02.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:25:02.618 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:25:02.618 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:25:02.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:25:02.619 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:25:02.619 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:25:02.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:25:02.619 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:25:02.620 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:25:02.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:25:02.620 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:25:02.620 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:25:02.620 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:25:02.620 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:25:02.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 -- 172.21.15.8:0/2152748758 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6be0060f70 msgr2=0x7f6be0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:02.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6be0060f70 0x7f6be0063430 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f6be8005010 tx=0x7f6be8016040).stop 2023-10-18T21:25:02.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 -- 172.21.15.8:0/2152748758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bf80f77d0 msgr2=0x7f6bf8107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:02.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bf80f77d0 0x7f6bf8107270 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f6bec00e7f0 tx=0x7f6bec00b040).stop 2023-10-18T21:25:02.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 -- 172.21.15.8:0/2152748758 shutdown_connections 2023-10-18T21:25:02.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6be0060f70 0x7f6be0063430 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80f6530 0x7f6bf8106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 --2- 172.21.15.8:0/2152748758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bf80f77d0 0x7f6bf8107270 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 -- 172.21.15.8:0/2152748758 >> 172.21.15.8:0/2152748758 conn(0x7f6bf80f1c90 msgr2=0x7f6bf80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 -- 172.21.15.8:0/2152748758 shutdown_connections 2023-10-18T21:25:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.617+0000 7f6bf7fff700 1 -- 172.21.15.8:0/2152748758 wait complete. 2023-10-18T21:25:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:01.513116+0000 mgr.smithi008.flmjzp (mgr.14640) 1572 : audit [DBG] from='client.35440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:02.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:01.513116+0000 mgr.smithi008.flmjzp (mgr.14640) 1572 : audit [DBG] from='client.35440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:02.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.758+0000 7f35127b5700 1 -- 172.21.15.8:0/4171214806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f350c0f6530 msgr2=0x7f350c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:02.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.758+0000 7f35127b5700 1 --2- 172.21.15.8:0/4171214806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f350c0f6530 0x7f350c0f6950 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f3508004660 tx=0x7f3508009b30).stop 2023-10-18T21:25:02.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.759+0000 7f35127b5700 1 -- 172.21.15.8:0/4171214806 shutdown_connections 2023-10-18T21:25:02.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.759+0000 7f35127b5700 1 --2- 172.21.15.8:0/4171214806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f350c0f77d0 0x7f350c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.759+0000 7f35127b5700 1 --2- 172.21.15.8:0/4171214806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f350c0f6530 0x7f350c0f6950 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.759+0000 7f35127b5700 1 -- 172.21.15.8:0/4171214806 >> 172.21.15.8:0/4171214806 conn(0x7f350c0f1c90 msgr2=0x7f350c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:02.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.759+0000 7f35127b5700 1 -- 172.21.15.8:0/4171214806 shutdown_connections 2023-10-18T21:25:02.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.759+0000 7f35127b5700 1 -- 172.21.15.8:0/4171214806 wait complete. 2023-10-18T21:25:02.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.760+0000 7f35127b5700 1 Processor -- start 2023-10-18T21:25:02.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.760+0000 7f35127b5700 1 -- start start 2023-10-18T21:25:02.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f35127b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f350c0f6530 0x7f350c108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:02.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f35127b5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f350c0f77d0 0x7f350c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:02.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f35127b5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c109a70 con 0x7f350c0f77d0 2023-10-18T21:25:02.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f35127b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c109bb0 con 0x7f350c0f6530 2023-10-18T21:25:02.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f3510fb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f350c0f77d0 0x7f350c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:02.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f3510fb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f350c0f77d0 0x7f350c1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38908/0 (socket says 172.21.15.8:38908) 2023-10-18T21:25:02.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f3510fb2700 1 -- 172.21.15.8:0/2406608639 learned_addr learned my addr 172.21.15.8:0/2406608639 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:02.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f35117b3700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f350c0f6530 0x7f350c108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:02.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f3510fb2700 1 -- 172.21.15.8:0/2406608639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f350c0f6530 msgr2=0x7f350c108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f3510fb2700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f350c0f6530 0x7f350c108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.761+0000 7f3510fb2700 1 -- 172.21.15.8:0/2406608639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3508005040 con 0x7f350c0f77d0 2023-10-18T21:25:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.762+0000 7f3510fb2700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f350c0f77d0 0x7f350c1094c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f34fc0026d0 tx=0x7f34fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.762+0000 7f3501ffb700 1 -- 172.21.15.8:0/2406608639 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34fc0079c0 con 0x7f350c0f77d0 2023-10-18T21:25:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.762+0000 7f3501ffb700 1 -- 172.21.15.8:0/2406608639 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f34fc00f040 con 0x7f350c0f77d0 2023-10-18T21:25:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.762+0000 7f3501ffb700 1 -- 172.21.15.8:0/2406608639 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34fc014980 con 0x7f350c0f77d0 2023-10-18T21:25:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.762+0000 7f35127b5700 1 -- 172.21.15.8:0/2406608639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c10a550 con 0x7f350c0f77d0 2023-10-18T21:25:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.762+0000 7f35127b5700 1 -- 172.21.15.8:0/2406608639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c10ab10 con 0x7f350c0f77d0 2023-10-18T21:25:02.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.763+0000 7f35127b5700 1 -- 172.21.15.8:0/2406608639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c045ad0 con 0x7f350c0f77d0 2023-10-18T21:25:02.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.764+0000 7f3501ffb700 1 -- 172.21.15.8:0/2406608639 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f34fc0090d0 con 0x7f350c0f77d0 2023-10-18T21:25:02.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.765+0000 7f3501ffb700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34f8060f70 0x7f34f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:02.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.765+0000 7f3501ffb700 1 -- 172.21.15.8:0/2406608639 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f34fc07c8a0 con 0x7f350c0f77d0 2023-10-18T21:25:02.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.765+0000 7f35117b3700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34f8060f70 0x7f34f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.766+0000 7f35117b3700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34f8060f70 0x7f34f8063430 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f3508004630 tx=0x7f3508009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.769+0000 7f3501ffb700 1 -- 172.21.15.8:0/2406608639 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f34fc04ffb0 con 0x7f350c0f77d0 2023-10-18T21:25:02.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.994+0000 7f35127b5700 1 -- 172.21.15.8:0/2406608639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f350c027a00 con 0x7f350c0f77d0 2023-10-18T21:25:02.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.994+0000 7f3501ffb700 1 -- 172.21.15.8:0/2406608639 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f34fc04fba0 con 0x7f350c0f77d0 2023-10-18T21:25:02.997 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:25:02.997 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:25:02.997 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:25:02.997 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:25:02.997 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:25:02.997 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:25:02.998 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:25:02.998 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:25:02.998 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:25:02.998 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:25:02.998 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:25:02.999 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:25:02.999 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:25:02.999 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:25:02.999 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:25:02.999 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:25:03.000 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:25:03.000 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:25:03.000 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:25:03.000 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:25:03.000 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:25:03.000 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:25:03.001 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:25:03.001 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:25:03.001 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:25:03.001 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:25:03.001 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:25:03.001 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:25:03.002 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:25:03.002 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:25:03.002 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:25:03.002 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:25:03.002 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:25:03.003 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:25:03.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.996+0000 7f35127b5700 1 -- 172.21.15.8:0/2406608639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34f8060f70 msgr2=0x7f34f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:03.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.996+0000 7f35127b5700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34f8060f70 0x7f34f8063430 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f3508004630 tx=0x7f3508009b30).stop 2023-10-18T21:25:03.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.996+0000 7f35127b5700 1 -- 172.21.15.8:0/2406608639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f350c0f77d0 msgr2=0x7f350c1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:03.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.996+0000 7f35127b5700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f350c0f77d0 0x7f350c1094c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f34fc0026d0 tx=0x7f34fc009de0).stop 2023-10-18T21:25:03.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.996+0000 7f35127b5700 1 -- 172.21.15.8:0/2406608639 shutdown_connections 2023-10-18T21:25:03.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.996+0000 7f35127b5700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34f8060f70 0x7f34f8063430 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:03.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.996+0000 7f35127b5700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f350c0f6530 0x7f350c108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:03.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.996+0000 7f35127b5700 1 --2- 172.21.15.8:0/2406608639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f350c0f77d0 0x7f350c1094c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:03.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.996+0000 7f35127b5700 1 -- 172.21.15.8:0/2406608639 >> 172.21.15.8:0/2406608639 conn(0x7f350c0f1c90 msgr2=0x7f350c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:03.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.997+0000 7f35127b5700 1 -- 172.21.15.8:0/2406608639 shutdown_connections 2023-10-18T21:25:03.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:02.997+0000 7f35127b5700 1 -- 172.21.15.8:0/2406608639 wait complete. 2023-10-18T21:25:03.005 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:25:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.134+0000 7f91f72a2700 1 -- 172.21.15.8:0/808956516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91f00f6530 msgr2=0x7f91f00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.134+0000 7f91f72a2700 1 --2- 172.21.15.8:0/808956516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91f00f6530 0x7f91f00f6950 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f91ec004660 tx=0x7f91ec009b30).stop 2023-10-18T21:25:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.134+0000 7f91f72a2700 1 -- 172.21.15.8:0/808956516 shutdown_connections 2023-10-18T21:25:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.134+0000 7f91f72a2700 1 --2- 172.21.15.8:0/808956516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91f00f77d0 0x7f91f00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.134+0000 7f91f72a2700 1 --2- 172.21.15.8:0/808956516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91f00f6530 0x7f91f00f6950 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.134+0000 7f91f72a2700 1 -- 172.21.15.8:0/808956516 >> 172.21.15.8:0/808956516 conn(0x7f91f00f1c90 msgr2=0x7f91f00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.134+0000 7f91f72a2700 1 -- 172.21.15.8:0/808956516 shutdown_connections 2023-10-18T21:25:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.134+0000 7f91f72a2700 1 -- 172.21.15.8:0/808956516 wait complete. 2023-10-18T21:25:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.135+0000 7f91f72a2700 1 Processor -- start 2023-10-18T21:25:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.135+0000 7f91f72a2700 1 -- start start 2023-10-18T21:25:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f72a2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91f00f6530 0x7f91f0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f72a2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91f00f77d0 0x7f91f0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f72a2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0109a00 con 0x7f91f00f6530 2023-10-18T21:25:03.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f72a2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0109b40 con 0x7f91f00f77d0 2023-10-18T21:25:03.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f62a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91f00f6530 0x7f91f0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:03.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f62a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91f00f6530 0x7f91f0108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38916/0 (socket says 172.21.15.8:38916) 2023-10-18T21:25:03.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f62a0700 1 -- 172.21.15.8:0/243747239 learned_addr learned my addr 172.21.15.8:0/243747239 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:03.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f5a9f700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91f00f77d0 0x7f91f0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:03.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f62a0700 1 -- 172.21.15.8:0/243747239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91f00f77d0 msgr2=0x7f91f0109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:03.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f62a0700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91f00f77d0 0x7f91f0109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:03.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.136+0000 7f91f62a0700 1 -- 172.21.15.8:0/243747239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec005040 con 0x7f91f00f6530 2023-10-18T21:25:03.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.137+0000 7f91f62a0700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91f00f6530 0x7f91f0108f60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f91ec014040 tx=0x7f91ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:03.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.137+0000 7f91e6ffd700 1 -- 172.21.15.8:0/243747239 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91ec019070 con 0x7f91f00f6530 2023-10-18T21:25:03.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.137+0000 7f91e6ffd700 1 -- 172.21.15.8:0/243747239 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f91ec01e420 con 0x7f91f00f6530 2023-10-18T21:25:03.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.137+0000 7f91e6ffd700 1 -- 172.21.15.8:0/243747239 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91ec014660 con 0x7f91f00f6530 2023-10-18T21:25:03.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.137+0000 7f91f72a2700 1 -- 172.21.15.8:0/243747239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f010a480 con 0x7f91f00f6530 2023-10-18T21:25:03.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.137+0000 7f91f72a2700 1 -- 172.21.15.8:0/243747239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f010a910 con 0x7f91f00f6530 2023-10-18T21:25:03.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.138+0000 7f91f72a2700 1 -- 172.21.15.8:0/243747239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f0045ad0 con 0x7f91f00f6530 2023-10-18T21:25:03.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.139+0000 7f91e6ffd700 1 -- 172.21.15.8:0/243747239 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f91ec01e9e0 con 0x7f91f00f6530 2023-10-18T21:25:03.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.140+0000 7f91e6ffd700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91dc060f70 0x7f91dc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:03.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.140+0000 7f91e6ffd700 1 -- 172.21.15.8:0/243747239 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f91ec07dd00 con 0x7f91f00f6530 2023-10-18T21:25:03.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.140+0000 7f91f5a9f700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91dc060f70 0x7f91dc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:03.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.141+0000 7f91f5a9f700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91dc060f70 0x7f91dc063430 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f91e0007f80 tx=0x7f91e000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:03.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.145+0000 7f91e6ffd700 1 -- 172.21.15.8:0/243747239 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f91ec081030 con 0x7f91f00f6530 2023-10-18T21:25:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.345+0000 7f91f72a2700 1 -- 172.21.15.8:0/243747239 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91f00fedd0 con 0x7f91dc060f70 2023-10-18T21:25:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.346+0000 7f91e6ffd700 1 -- 172.21.15.8:0/243747239 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f91f00fedd0 con 0x7f91dc060f70 2023-10-18T21:25:03.348 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:25:03.349 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:25:03.349 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:25:03.349 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:25:03.350 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:25:03.350 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:25:03.350 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:25:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:25:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:25:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:25:03.352 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:25:03.352 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:25:03.352 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:25:03.353 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:25:03.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 -- 172.21.15.8:0/243747239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91dc060f70 msgr2=0x7f91dc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:03.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91dc060f70 0x7f91dc063430 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f91e0007f80 tx=0x7f91e000b040).stop 2023-10-18T21:25:03.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 -- 172.21.15.8:0/243747239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91f00f6530 msgr2=0x7f91f0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:03.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91f00f6530 0x7f91f0108f60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f91ec014040 tx=0x7f91ec00b040).stop 2023-10-18T21:25:03.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 -- 172.21.15.8:0/243747239 shutdown_connections 2023-10-18T21:25:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91dc060f70 0x7f91dc063430 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91f00f6530 0x7f91f0108f60 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 --2- 172.21.15.8:0/243747239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91f00f77d0 0x7f91f0109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 -- 172.21.15.8:0/243747239 >> 172.21.15.8:0/243747239 conn(0x7f91f00f1c90 msgr2=0x7f91f006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 -- 172.21.15.8:0/243747239 shutdown_connections 2023-10-18T21:25:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:03.348+0000 7f91f72a2700 1 -- 172.21.15.8:0/243747239 wait complete. 2023-10-18T21:25:03.561 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:01.864410+0000 mgr.smithi008.flmjzp (mgr.14640) 1573 : audit [DBG] from='client.35444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:03.562 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.204905+0000 mgr.smithi008.flmjzp (mgr.14640) 1574 : audit [DBG] from='client.35448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:03.562 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.616776+0000 mon.smithi008 (mon.0) 2039 : audit [DBG] from='client.? 172.21.15.8:0/2152748758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:03.562 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:02.684562+0000 mgr.smithi008.flmjzp (mgr.14640) 1575 : cluster [DBG] pgmap v1092: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:03.562 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.708160+0000 mon.smithi008 (mon.0) 2040 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:03.562 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.709855+0000 mon.smithi008 (mon.0) 2041 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:03.563 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.710583+0000 mon.smithi008 (mon.0) 2042 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:03.563 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:02.711214+0000 mgr.smithi008.flmjzp (mgr.14640) 1576 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:25:03.563 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:02.711686+0000 mgr.smithi008.flmjzp (mgr.14640) 1577 : cluster [DBG] pgmap v1093: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:03.563 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:02.711937+0000 mgr.smithi008.flmjzp (mgr.14640) 1578 : cluster [DBG] pgmap v1094: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:03.563 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.715953+0000 mon.smithi008 (mon.0) 2043 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:03.564 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.720928+0000 mon.smithi008 (mon.0) 2044 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:03.564 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.723304+0000 mon.smithi008 (mon.0) 2045 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:03.564 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.724550+0000 mon.smithi008 (mon.0) 2046 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:03.564 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.725758+0000 mon.smithi008 (mon.0) 2047 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:03.564 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.727298+0000 mon.smithi008 (mon.0) 2048 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:03.565 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:02.728870+0000 mgr.smithi008.flmjzp (mgr.14640) 1579 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:25:03.565 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:02.996053+0000 mon.smithi008 (mon.0) 2049 : audit [DBG] from='client.? 172.21.15.8:0/2406608639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:25:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:01.864410+0000 mgr.smithi008.flmjzp (mgr.14640) 1573 : audit [DBG] from='client.35444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.204905+0000 mgr.smithi008.flmjzp (mgr.14640) 1574 : audit [DBG] from='client.35448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.616776+0000 mon.smithi008 (mon.0) 2039 : audit [DBG] from='client.? 172.21.15.8:0/2152748758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:02.684562+0000 mgr.smithi008.flmjzp (mgr.14640) 1575 : cluster [DBG] pgmap v1092: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.708160+0000 mon.smithi008 (mon.0) 2040 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.709855+0000 mon.smithi008 (mon.0) 2041 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.710583+0000 mon.smithi008 (mon.0) 2042 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:02.711214+0000 mgr.smithi008.flmjzp (mgr.14640) 1576 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:25:03.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:02.711686+0000 mgr.smithi008.flmjzp (mgr.14640) 1577 : cluster [DBG] pgmap v1093: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:03.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:02.711937+0000 mgr.smithi008.flmjzp (mgr.14640) 1578 : cluster [DBG] pgmap v1094: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:03.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.715953+0000 mon.smithi008 (mon.0) 2043 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:03.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.720928+0000 mon.smithi008 (mon.0) 2044 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:03.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.723304+0000 mon.smithi008 (mon.0) 2045 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:03.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.724550+0000 mon.smithi008 (mon.0) 2046 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:03.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.725758+0000 mon.smithi008 (mon.0) 2047 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:03.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.727298+0000 mon.smithi008 (mon.0) 2048 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:03.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:02.728870+0000 mgr.smithi008.flmjzp (mgr.14640) 1579 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:25:03.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:02.996053+0000 mon.smithi008 (mon.0) 2049 : audit [DBG] from='client.? 172.21.15.8:0/2406608639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:25:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:03.347212+0000 mgr.smithi008.flmjzp (mgr.14640) 1580 : audit [DBG] from='client.35460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:04.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:03.347212+0000 mgr.smithi008.flmjzp (mgr.14640) 1580 : audit [DBG] from='client.35460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:04.712424+0000 mgr.smithi008.flmjzp (mgr.14640) 1581 : cluster [DBG] pgmap v1095: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:04.712424+0000 mgr.smithi008.flmjzp (mgr.14640) 1581 : cluster [DBG] pgmap v1095: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:06.713139+0000 mgr.smithi008.flmjzp (mgr.14640) 1582 : cluster [DBG] pgmap v1096: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:08.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:06.713139+0000 mgr.smithi008.flmjzp (mgr.14640) 1582 : cluster [DBG] pgmap v1096: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:10.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:08.713707+0000 mgr.smithi008.flmjzp (mgr.14640) 1583 : cluster [DBG] pgmap v1097: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:10.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:08.713707+0000 mgr.smithi008.flmjzp (mgr.14640) 1583 : cluster [DBG] pgmap v1097: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:10.714332+0000 mgr.smithi008.flmjzp (mgr.14640) 1584 : cluster [DBG] pgmap v1098: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:10.714332+0000 mgr.smithi008.flmjzp (mgr.14640) 1584 : cluster [DBG] pgmap v1098: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:13.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:12.739525+0000 mon.smithi008 (mon.0) 2050 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:13.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:12.739525+0000 mon.smithi008 (mon.0) 2050 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:12.714881+0000 mgr.smithi008.flmjzp (mgr.14640) 1585 : cluster [DBG] pgmap v1099: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:13.299937+0000 mon.smithi008 (mon.0) 2051 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:13.301237+0000 mon.smithi008 (mon.0) 2052 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:13.306505+0000 mon.smithi008 (mon.0) 2053 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:13.311428+0000 mon.smithi008 (mon.0) 2054 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:13.313868+0000 mon.smithi008 (mon.0) 2055 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:13.315200+0000 mon.smithi008 (mon.0) 2056 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:13.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:13.316432+0000 mon.smithi008 (mon.0) 2057 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:13.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:13.317938+0000 mon.smithi008 (mon.0) 2058 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:12.714881+0000 mgr.smithi008.flmjzp (mgr.14640) 1585 : cluster [DBG] pgmap v1099: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:14.285 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:13.299937+0000 mon.smithi008 (mon.0) 2051 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:14.285 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:13.301237+0000 mon.smithi008 (mon.0) 2052 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:14.286 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:13.306505+0000 mon.smithi008 (mon.0) 2053 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:14.286 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:13.311428+0000 mon.smithi008 (mon.0) 2054 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:14.286 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:13.313868+0000 mon.smithi008 (mon.0) 2055 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:14.286 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:13.315200+0000 mon.smithi008 (mon.0) 2056 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:14.287 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:13.316432+0000 mon.smithi008 (mon.0) 2057 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:14.287 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:13.317938+0000 mon.smithi008 (mon.0) 2058 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:15.145 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:13.301930+0000 mgr.smithi008.flmjzp (mgr.14640) 1586 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:25:15.145 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:13.302396+0000 mgr.smithi008.flmjzp (mgr.14640) 1587 : cluster [DBG] pgmap v1100: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:15.145 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:13.302624+0000 mgr.smithi008.flmjzp (mgr.14640) 1588 : cluster [DBG] pgmap v1101: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:15.145 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:13.319614+0000 mgr.smithi008.flmjzp (mgr.14640) 1589 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:25:15.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:13.301930+0000 mgr.smithi008.flmjzp (mgr.14640) 1586 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:25:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:13.302396+0000 mgr.smithi008.flmjzp (mgr.14640) 1587 : cluster [DBG] pgmap v1100: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:13.302624+0000 mgr.smithi008.flmjzp (mgr.14640) 1588 : cluster [DBG] pgmap v1101: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:13.319614+0000 mgr.smithi008.flmjzp (mgr.14640) 1589 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:25:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:15.303270+0000 mgr.smithi008.flmjzp (mgr.14640) 1590 : cluster [DBG] pgmap v1102: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:15.303270+0000 mgr.smithi008.flmjzp (mgr.14640) 1590 : cluster [DBG] pgmap v1102: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:17.303880+0000 mgr.smithi008.flmjzp (mgr.14640) 1591 : cluster [DBG] pgmap v1103: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:18.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:17.303880+0000 mgr.smithi008.flmjzp (mgr.14640) 1591 : cluster [DBG] pgmap v1103: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:19.304738+0000 mgr.smithi008.flmjzp (mgr.14640) 1592 : cluster [DBG] pgmap v1104: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:20.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:19.304738+0000 mgr.smithi008.flmjzp (mgr.14640) 1592 : cluster [DBG] pgmap v1104: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:21.305310+0000 mgr.smithi008.flmjzp (mgr.14640) 1593 : cluster [DBG] pgmap v1105: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:22.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:21.305310+0000 mgr.smithi008.flmjzp (mgr.14640) 1593 : cluster [DBG] pgmap v1105: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:23.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:23.330379+0000 mon.smithi008 (mon.0) 2059 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:23.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:23.330379+0000 mon.smithi008 (mon.0) 2059 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:24.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:23.305897+0000 mgr.smithi008.flmjzp (mgr.14640) 1594 : cluster [DBG] pgmap v1106: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:24.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:23.305897+0000 mgr.smithi008.flmjzp (mgr.14640) 1594 : cluster [DBG] pgmap v1106: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:25.306493+0000 mgr.smithi008.flmjzp (mgr.14640) 1595 : cluster [DBG] pgmap v1107: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:26.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:25.306493+0000 mgr.smithi008.flmjzp (mgr.14640) 1595 : cluster [DBG] pgmap v1107: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:27.306989+0000 mgr.smithi008.flmjzp (mgr.14640) 1596 : cluster [DBG] pgmap v1108: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:28.109149+0000 mon.smithi008 (mon.0) 2060 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:28.110087+0000 mon.smithi008 (mon.0) 2061 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:28.110809+0000 mon.smithi008 (mon.0) 2062 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:28.115762+0000 mon.smithi008 (mon.0) 2063 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:28.120588+0000 mon.smithi008 (mon.0) 2064 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:28.123144+0000 mon.smithi008 (mon.0) 2065 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:28.124520+0000 mon.smithi008 (mon.0) 2066 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:28.125817+0000 mon.smithi008 (mon.0) 2067 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:28.127470+0000 mon.smithi008 (mon.0) 2068 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:28.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:27.306989+0000 mgr.smithi008.flmjzp (mgr.14640) 1596 : cluster [DBG] pgmap v1108: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:28.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:28.109149+0000 mon.smithi008 (mon.0) 2060 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:28.110087+0000 mon.smithi008 (mon.0) 2061 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:28.110809+0000 mon.smithi008 (mon.0) 2062 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:28.115762+0000 mon.smithi008 (mon.0) 2063 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:28.120588+0000 mon.smithi008 (mon.0) 2064 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:28.123144+0000 mon.smithi008 (mon.0) 2065 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:28.124520+0000 mon.smithi008 (mon.0) 2066 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:28.125817+0000 mon.smithi008 (mon.0) 2067 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:28.127470+0000 mon.smithi008 (mon.0) 2068 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:28.111399+0000 mgr.smithi008.flmjzp (mgr.14640) 1597 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:25:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:28.111868+0000 mgr.smithi008.flmjzp (mgr.14640) 1598 : cluster [DBG] pgmap v1109: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:28.112156+0000 mgr.smithi008.flmjzp (mgr.14640) 1599 : cluster [DBG] pgmap v1110: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:28.129026+0000 mgr.smithi008.flmjzp (mgr.14640) 1600 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:25:29.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:28.111399+0000 mgr.smithi008.flmjzp (mgr.14640) 1597 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:25:29.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:28.111868+0000 mgr.smithi008.flmjzp (mgr.14640) 1598 : cluster [DBG] pgmap v1109: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:28.112156+0000 mgr.smithi008.flmjzp (mgr.14640) 1599 : cluster [DBG] pgmap v1110: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:28.129026+0000 mgr.smithi008.flmjzp (mgr.14640) 1600 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:25:31.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:30.112766+0000 mgr.smithi008.flmjzp (mgr.14640) 1601 : cluster [DBG] pgmap v1111: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:30.112766+0000 mgr.smithi008.flmjzp (mgr.14640) 1601 : cluster [DBG] pgmap v1111: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:33.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.504+0000 7f0db4d5e700 1 -- 172.21.15.8:0/192862798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0db00f6530 msgr2=0x7f0db00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:33.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.504+0000 7f0db4d5e700 1 --2- 172.21.15.8:0/192862798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0db00f6530 0x7f0db00f6950 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f0da00045a0 tx=0x7f0da0009b30).stop 2023-10-18T21:25:33.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.504+0000 7f0db4d5e700 1 -- 172.21.15.8:0/192862798 shutdown_connections 2023-10-18T21:25:33.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.504+0000 7f0db4d5e700 1 --2- 172.21.15.8:0/192862798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db00f77d0 0x7f0db00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:33.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.504+0000 7f0db4d5e700 1 --2- 172.21.15.8:0/192862798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0db00f6530 0x7f0db00f6950 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.504+0000 7f0db4d5e700 1 -- 172.21.15.8:0/192862798 >> 172.21.15.8:0/192862798 conn(0x7f0db00f1c90 msgr2=0x7f0db00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.504+0000 7f0db4d5e700 1 -- 172.21.15.8:0/192862798 shutdown_connections 2023-10-18T21:25:33.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.504+0000 7f0db4d5e700 1 -- 172.21.15.8:0/192862798 wait complete. 2023-10-18T21:25:33.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.505+0000 7f0db4d5e700 1 Processor -- start 2023-10-18T21:25:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.506+0000 7f0db4d5e700 1 -- start start 2023-10-18T21:25:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.506+0000 7f0db4d5e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db00f6530 0x7f0db0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.506+0000 7f0db4d5e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0db00f77d0 0x7f0db0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.506+0000 7f0db4d5e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0109a00 con 0x7f0db00f77d0 2023-10-18T21:25:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.506+0000 7f0db4d5e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0109b40 con 0x7f0db00f6530 2023-10-18T21:25:33.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.506+0000 7f0daeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0db00f77d0 0x7f0db0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.506+0000 7f0daeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0db00f77d0 0x7f0db0109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59826/0 (socket says 172.21.15.8:59826) 2023-10-18T21:25:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.506+0000 7f0daeffd700 1 -- 172.21.15.8:0/1912463941 learned_addr learned my addr 172.21.15.8:0/1912463941 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0daf7fe700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db00f6530 0x7f0db0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0daeffd700 1 -- 172.21.15.8:0/1912463941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db00f6530 msgr2=0x7f0db0108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:33.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0daeffd700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db00f6530 0x7f0db0108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0daeffd700 1 -- 172.21.15.8:0/1912463941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0005040 con 0x7f0db00f77d0 2023-10-18T21:25:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0daf7fe700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db00f6530 0x7f0db0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:25:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0daeffd700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0db00f77d0 0x7f0db0109450 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f0da400e7c0 tx=0x7f0da400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0d97fff700 1 -- 172.21.15.8:0/1912463941 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da40092e0 con 0x7f0db00f77d0 2023-10-18T21:25:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0d97fff700 1 -- 172.21.15.8:0/1912463941 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0da400f040 con 0x7f0db00f77d0 2023-10-18T21:25:33.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0d97fff700 1 -- 172.21.15.8:0/1912463941 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da4014880 con 0x7f0db00f77d0 2023-10-18T21:25:33.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0db4d5e700 1 -- 172.21.15.8:0/1912463941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db010a4e0 con 0x7f0db00f77d0 2023-10-18T21:25:33.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.507+0000 7f0db4d5e700 1 -- 172.21.15.8:0/1912463941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db010aa20 con 0x7f0db00f77d0 2023-10-18T21:25:33.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.509+0000 7f0db4d5e700 1 -- 172.21.15.8:0/1912463941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db0045ad0 con 0x7f0db00f77d0 2023-10-18T21:25:33.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.510+0000 7f0d97fff700 1 -- 172.21.15.8:0/1912463941 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0da401b030 con 0x7f0db00f77d0 2023-10-18T21:25:33.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.511+0000 7f0d97fff700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d98060f70 0x7f0d98063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:33.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.511+0000 7f0d97fff700 1 -- 172.21.15.8:0/1912463941 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0da407c990 con 0x7f0db00f77d0 2023-10-18T21:25:33.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.511+0000 7f0daf7fe700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d98060f70 0x7f0d98063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:33.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.512+0000 7f0daf7fe700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d98060f70 0x7f0d98063430 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f0da0004570 tx=0x7f0da000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:33.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.516+0000 7f0d97fff700 1 -- 172.21.15.8:0/1912463941 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0da4050030 con 0x7f0db00f77d0 2023-10-18T21:25:33.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:32.113352+0000 mgr.smithi008.flmjzp (mgr.14640) 1602 : cluster [DBG] pgmap v1112: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:33.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.716+0000 7f0db4d5e700 1 -- 172.21.15.8:0/1912463941 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0db010ac40 con 0x7f0d98060f70 2023-10-18T21:25:33.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.717+0000 7f0d97fff700 1 -- 172.21.15.8:0/1912463941 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0db010ac40 con 0x7f0d98060f70 2023-10-18T21:25:33.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 -- 172.21.15.8:0/1912463941 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d98060f70 msgr2=0x7f0d98063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:33.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d98060f70 0x7f0d98063430 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f0da0004570 tx=0x7f0da000b040).stop 2023-10-18T21:25:33.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 -- 172.21.15.8:0/1912463941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0db00f77d0 msgr2=0x7f0db0109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:33.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0db00f77d0 0x7f0db0109450 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f0da400e7c0 tx=0x7f0da400b040).stop 2023-10-18T21:25:33.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 -- 172.21.15.8:0/1912463941 shutdown_connections 2023-10-18T21:25:33.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d98060f70 0x7f0d98063430 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:33.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db00f6530 0x7f0db0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:33.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 --2- 172.21.15.8:0/1912463941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0db00f77d0 0x7f0db0109450 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:33.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 -- 172.21.15.8:0/1912463941 >> 172.21.15.8:0/1912463941 conn(0x7f0db00f1c90 msgr2=0x7f0db006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:33.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 -- 172.21.15.8:0/1912463941 shutdown_connections 2023-10-18T21:25:33.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.719+0000 7f0db4d5e700 1 -- 172.21.15.8:0/1912463941 wait complete. 2023-10-18T21:25:33.734 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:25:33.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:32.113352+0000 mgr.smithi008.flmjzp (mgr.14640) 1602 : cluster [DBG] pgmap v1112: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:33.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.861+0000 7fe50cd8d700 1 -- 172.21.15.8:0/3629786411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5080f77d0 msgr2=0x7fe5080f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.861+0000 7fe50cd8d700 1 --2- 172.21.15.8:0/3629786411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5080f77d0 0x7fe5080f7c30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fe4fc004660 tx=0x7fe4fc009b30).stop 2023-10-18T21:25:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.861+0000 7fe50cd8d700 1 -- 172.21.15.8:0/3629786411 shutdown_connections 2023-10-18T21:25:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.861+0000 7fe50cd8d700 1 --2- 172.21.15.8:0/3629786411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5080f77d0 0x7fe5080f7c30 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.861+0000 7fe50cd8d700 1 --2- 172.21.15.8:0/3629786411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5080f6530 0x7fe5080f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.861+0000 7fe50cd8d700 1 -- 172.21.15.8:0/3629786411 >> 172.21.15.8:0/3629786411 conn(0x7fe5080f1c90 msgr2=0x7fe5080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:33.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.862+0000 7fe50cd8d700 1 -- 172.21.15.8:0/3629786411 shutdown_connections 2023-10-18T21:25:33.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.862+0000 7fe50cd8d700 1 -- 172.21.15.8:0/3629786411 wait complete. 2023-10-18T21:25:33.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.862+0000 7fe50cd8d700 1 Processor -- start 2023-10-18T21:25:33.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.863+0000 7fe50cd8d700 1 -- start start 2023-10-18T21:25:33.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.863+0000 7fe50cd8d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5080f6530 0x7fe508108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:33.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.863+0000 7fe50cd8d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5080f77d0 0x7fe508109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:33.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.863+0000 7fe50cd8d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5081099b0 con 0x7fe5080f6530 2023-10-18T21:25:33.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.863+0000 7fe50cd8d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508109af0 con 0x7fe5080f77d0 2023-10-18T21:25:33.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.863+0000 7fe5077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5080f6530 0x7fe508108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.863+0000 7fe5077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5080f6530 0x7fe508108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59848/0 (socket says 172.21.15.8:59848) 2023-10-18T21:25:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.863+0000 7fe5077fe700 1 -- 172.21.15.8:0/534140324 learned_addr learned my addr 172.21.15.8:0/534140324 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.864+0000 7fe5077fe700 1 -- 172.21.15.8:0/534140324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5080f77d0 msgr2=0x7fe508109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.864+0000 7fe5077fe700 1 --2- 172.21.15.8:0/534140324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5080f77d0 0x7fe508109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:25:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.864+0000 7fe5077fe700 1 -- 172.21.15.8:0/534140324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc005040 con 0x7fe5080f6530 2023-10-18T21:25:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.864+0000 7fe5077fe700 1 --2- 172.21.15.8:0/534140324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5080f6530 0x7fe508108f10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fe4f8002700 tx=0x7fe4f8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.864+0000 7fe4effff700 1 -- 172.21.15.8:0/534140324 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f8009320 con 0x7fe5080f6530 2023-10-18T21:25:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.864+0000 7fe4effff700 1 -- 172.21.15.8:0/534140324 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe4f800f040 con 0x7fe5080f6530 2023-10-18T21:25:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.864+0000 7fe4effff700 1 -- 172.21.15.8:0/534140324 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f8014970 con 0x7fe5080f6530 2023-10-18T21:25:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.864+0000 7fe50cd8d700 1 -- 172.21.15.8:0/534140324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50810a490 con 0x7fe5080f6530 2023-10-18T21:25:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.864+0000 7fe50cd8d700 1 -- 172.21.15.8:0/534140324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50810aa00 con 0x7fe5080f6530 2023-10-18T21:25:33.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.865+0000 7fe50cd8d700 1 -- 172.21.15.8:0/534140324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe508045ad0 con 0x7fe5080f6530 2023-10-18T21:25:33.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.866+0000 7fe4effff700 1 -- 172.21.15.8:0/534140324 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe4f8009480 con 0x7fe5080f6530 2023-10-18T21:25:33.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.867+0000 7fe4effff700 1 --2- 172.21.15.8:0/534140324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4f0060f70 0x7fe4f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:33.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.867+0000 7fe4effff700 1 -- 172.21.15.8:0/534140324 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe4f807cb80 con 0x7fe5080f6530 2023-10-18T21:25:33.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.867+0000 7fe506ffd700 1 --2- 172.21.15.8:0/534140324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4f0060f70 0x7fe4f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:33.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.868+0000 7fe506ffd700 1 --2- 172.21.15.8:0/534140324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4f0060f70 0x7fe4f0063430 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fe4fc009f50 tx=0x7fe4fc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:33.871+0000 7fe4effff700 1 -- 172.21.15.8:0/534140324 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe4f8050220 con 0x7fe5080f6530 2023-10-18T21:25:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.070+0000 7fe50cd8d700 1 -- 172.21.15.8:0/534140324 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe50810acd0 con 0x7fe4f0060f70 2023-10-18T21:25:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.071+0000 7fe4effff700 1 -- 172.21.15.8:0/534140324 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe50810acd0 con 0x7fe4f0060f70 2023-10-18T21:25:34.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.073+0000 7fe50cd8d700 1 -- 172.21.15.8:0/534140324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4f0060f70 msgr2=0x7fe4f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.073+0000 7fe50cd8d700 1 --2- 172.21.15.8:0/534140324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4f0060f70 0x7fe4f0063430 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fe4fc009f50 tx=0x7fe4fc009b30).stop 2023-10-18T21:25:34.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.073+0000 7fe50cd8d700 1 -- 172.21.15.8:0/534140324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5080f6530 msgr2=0x7fe508108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.073+0000 7fe50cd8d700 1 --2- 172.21.15.8:0/534140324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5080f6530 0x7fe508108f10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fe4f8002700 tx=0x7fe4f8009d80).stop 2023-10-18T21:25:34.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.073+0000 7fe50cd8d700 1 -- 172.21.15.8:0/534140324 shutdown_connections 2023-10-18T21:25:34.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.073+0000 7fe50cd8d700 1 --2- 172.21.15.8:0/534140324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4f0060f70 0x7fe4f0063430 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.073+0000 7fe50cd8d700 1 --2- 172.21.15.8:0/534140324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5080f6530 0x7fe508108f10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.073+0000 7fe50cd8d700 1 --2- 172.21.15.8:0/534140324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5080f77d0 0x7fe508109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:25:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.073+0000 7fe50cd8d700 1 -- 172.21.15.8:0/534140324 >> 172.21.15.8:0/534140324 conn(0x7fe5080f1c90 msgr2=0x7fe50806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.074+0000 7fe50cd8d700 1 -- 172.21.15.8:0/534140324 shutdown_connections 2023-10-18T21:25:34.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.074+0000 7fe50cd8d700 1 -- 172.21.15.8:0/534140324 wait complete. 2023-10-18T21:25:34.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.211+0000 7ff8cb59e700 1 -- 172.21.15.8:0/3770524558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8cc0f77d0 msgr2=0x7ff8cc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.211+0000 7ff8cb59e700 1 --2- 172.21.15.8:0/3770524558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8cc0f77d0 0x7ff8cc0f7c30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7ff8c0004660 tx=0x7ff8c0009b30).stop 2023-10-18T21:25:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.211+0000 7ff8cb59e700 1 -- 172.21.15.8:0/3770524558 shutdown_connections 2023-10-18T21:25:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.211+0000 7ff8cb59e700 1 --2- 172.21.15.8:0/3770524558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8cc0f77d0 0x7ff8cc0f7c30 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.211+0000 7ff8cb59e700 1 --2- 172.21.15.8:0/3770524558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8cc0f6530 0x7ff8cc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.211+0000 7ff8cb59e700 1 -- 172.21.15.8:0/3770524558 >> 172.21.15.8:0/3770524558 conn(0x7ff8cc0f1c90 msgr2=0x7ff8cc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.211+0000 7ff8cb59e700 1 -- 172.21.15.8:0/3770524558 shutdown_connections 2023-10-18T21:25:34.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.211+0000 7ff8cb59e700 1 -- 172.21.15.8:0/3770524558 wait complete. 2023-10-18T21:25:34.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.212+0000 7ff8cb59e700 1 Processor -- start 2023-10-18T21:25:34.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.212+0000 7ff8cb59e700 1 -- start start 2023-10-18T21:25:34.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8cb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8cc0f6530 0x7ff8cc108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:34.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8cb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8cc0f77d0 0x7ff8cc109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:34.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8cb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc1099c0 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8cb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc109b00 con 0x7ff8cc0f6530 2023-10-18T21:25:34.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8c9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8cc0f77d0 0x7ff8cc109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:34.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8c9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8cc0f77d0 0x7ff8cc109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59868/0 (socket says 172.21.15.8:59868) 2023-10-18T21:25:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8c9d9b700 1 -- 172.21.15.8:0/2009662506 learned_addr learned my addr 172.21.15.8:0/2009662506 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8ca59c700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8cc0f6530 0x7ff8cc108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8c9d9b700 1 -- 172.21.15.8:0/2009662506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8cc0f6530 msgr2=0x7ff8cc108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8c9d9b700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8cc0f6530 0x7ff8cc108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.213+0000 7ff8c9d9b700 1 -- 172.21.15.8:0/2009662506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c0005040 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.214+0000 7ff8c9d9b700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8cc0f77d0 0x7ff8cc109410 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7ff8c0004d80 tx=0x7ff8c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:34.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.214+0000 7ff8baffd700 1 -- 172.21.15.8:0/2009662506 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c0019070 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.214+0000 7ff8baffd700 1 -- 172.21.15.8:0/2009662506 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff8c001e420 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.214+0000 7ff8cb59e700 1 -- 172.21.15.8:0/2009662506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc10a440 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.214+0000 7ff8baffd700 1 -- 172.21.15.8:0/2009662506 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c0014660 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.214+0000 7ff8cb59e700 1 -- 172.21.15.8:0/2009662506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc10a920 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.215+0000 7ff8cb59e700 1 -- 172.21.15.8:0/2009662506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc045ad0 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.216+0000 7ff8baffd700 1 -- 172.21.15.8:0/2009662506 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff8c001e590 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.217+0000 7ff8baffd700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8b4060f70 0x7ff8b4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:34.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.217+0000 7ff8baffd700 1 -- 172.21.15.8:0/2009662506 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff8c007dd80 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.217+0000 7ff8ca59c700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8b4060f70 0x7ff8b4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:34.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.218+0000 7ff8ca59c700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8b4060f70 0x7ff8b4063430 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7ff8bc009fd0 tx=0x7ff8bc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:34.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.221+0000 7ff8baffd700 1 -- 172.21.15.8:0/2009662506 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff8c00513e0 con 0x7ff8cc0f77d0 2023-10-18T21:25:34.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.421+0000 7ff8cb59e700 1 -- 172.21.15.8:0/2009662506 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8cc10ab40 con 0x7ff8b4060f70 2023-10-18T21:25:34.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.430+0000 7ff8baffd700 1 -- 172.21.15.8:0/2009662506 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff8cc10ab40 con 0x7ff8b4060f70 2023-10-18T21:25:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:25:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (32m) 6s ago 33m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:25:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (26m) 6s ago 33m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:25:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (26m) 8m ago 32m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:25:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (32m) 6s ago 33m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:25:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6s ago 29m - - 2023-10-18T21:25:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6s ago 29m - - 2023-10-18T21:25:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 29m - - 2023-10-18T21:25:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 29m - - 2023-10-18T21:25:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (27m) 6s ago 35m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:25:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (26m) 8m ago 32m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:25:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (26m) 6s ago 35m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:25:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (26m) 8m ago 32m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:25:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (33m) 6s ago 33m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:25:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (32m) 8m ago 32m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:25:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (25m) 6s ago 32m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:25:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (23m) 6s ago 31m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:25:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (23m) 6s ago 31m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:25:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (22m) 8m ago 31m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:25:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (22m) 8m ago 31m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:25:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (21m) 8m ago 30m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:25:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (27m) 6s ago 32m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:25:34.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 -- 172.21.15.8:0/2009662506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8b4060f70 msgr2=0x7ff8b4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8b4060f70 0x7ff8b4063430 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7ff8bc009fd0 tx=0x7ff8bc00b040).stop 2023-10-18T21:25:34.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 -- 172.21.15.8:0/2009662506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8cc0f77d0 msgr2=0x7ff8cc109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8cc0f77d0 0x7ff8cc109410 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7ff8c0004d80 tx=0x7ff8c000b040).stop 2023-10-18T21:25:34.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 -- 172.21.15.8:0/2009662506 shutdown_connections 2023-10-18T21:25:34.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8b4060f70 0x7ff8b4063430 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8cc0f6530 0x7ff8cc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 --2- 172.21.15.8:0/2009662506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8cc0f77d0 0x7ff8cc109410 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 -- 172.21.15.8:0/2009662506 >> 172.21.15.8:0/2009662506 conn(0x7ff8cc0f1c90 msgr2=0x7ff8cc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:34.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 -- 172.21.15.8:0/2009662506 shutdown_connections 2023-10-18T21:25:34.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.432+0000 7ff8cb59e700 1 -- 172.21.15.8:0/2009662506 wait complete. 2023-10-18T21:25:34.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.570+0000 7f1c1e35b700 1 -- 172.21.15.8:0/1312465223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c180f6530 msgr2=0x7f1c180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.570+0000 7f1c1e35b700 1 --2- 172.21.15.8:0/1312465223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c180f6530 0x7f1c180f6950 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f1c14004660 tx=0x7f1c14009b30).stop 2023-10-18T21:25:34.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.570+0000 7f1c1e35b700 1 -- 172.21.15.8:0/1312465223 shutdown_connections 2023-10-18T21:25:34.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.570+0000 7f1c1e35b700 1 --2- 172.21.15.8:0/1312465223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c180f77d0 0x7f1c180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.570+0000 7f1c1e35b700 1 --2- 172.21.15.8:0/1312465223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c180f6530 0x7f1c180f6950 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.570+0000 7f1c1e35b700 1 -- 172.21.15.8:0/1312465223 >> 172.21.15.8:0/1312465223 conn(0x7f1c180f1c90 msgr2=0x7f1c180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.570+0000 7f1c1e35b700 1 -- 172.21.15.8:0/1312465223 shutdown_connections 2023-10-18T21:25:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.570+0000 7f1c1e35b700 1 -- 172.21.15.8:0/1312465223 wait complete. 2023-10-18T21:25:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.571+0000 7f1c1e35b700 1 Processor -- start 2023-10-18T21:25:34.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.571+0000 7f1c1e35b700 1 -- start start 2023-10-18T21:25:34.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.571+0000 7f1c1e35b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c180f6530 0x7f1c18108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:34.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.571+0000 7f1c1e35b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c180f77d0 0x7f1c181094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:34.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.571+0000 7f1c1e35b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c18109a50 con 0x7f1c180f6530 2023-10-18T21:25:34.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.571+0000 7f1c1e35b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c18109b90 con 0x7f1c180f77d0 2023-10-18T21:25:34.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.572+0000 7f1c1d359700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c180f6530 0x7f1c18108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:34.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.572+0000 7f1c1d359700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c180f6530 0x7f1c18108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59884/0 (socket says 172.21.15.8:59884) 2023-10-18T21:25:34.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.572+0000 7f1c1d359700 1 -- 172.21.15.8:0/870705584 learned_addr learned my addr 172.21.15.8:0/870705584 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:34.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.572+0000 7f1c1cb58700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c180f77d0 0x7f1c181094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.572+0000 7f1c1d359700 1 -- 172.21.15.8:0/870705584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c180f77d0 msgr2=0x7f1c181094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.572+0000 7f1c1d359700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c180f77d0 0x7f1c181094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.572+0000 7f1c1d359700 1 -- 172.21.15.8:0/870705584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14005040 con 0x7f1c180f6530 2023-10-18T21:25:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.572+0000 7f1c1d359700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c180f6530 0x7f1c18108fb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f1c14004e30 tx=0x7f1c14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.572+0000 7f1c0dffb700 1 -- 172.21.15.8:0/870705584 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c14018070 con 0x7f1c180f6530 2023-10-18T21:25:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.573+0000 7f1c0dffb700 1 -- 172.21.15.8:0/870705584 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1c14009630 con 0x7f1c180f6530 2023-10-18T21:25:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.573+0000 7f1c1e35b700 1 -- 172.21.15.8:0/870705584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1810a4d0 con 0x7f1c180f6530 2023-10-18T21:25:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.573+0000 7f1c0dffb700 1 -- 172.21.15.8:0/870705584 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c1401c3c0 con 0x7f1c180f6530 2023-10-18T21:25:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.573+0000 7f1c1e35b700 1 -- 172.21.15.8:0/870705584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1810aa30 con 0x7f1c180f6530 2023-10-18T21:25:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.574+0000 7f1c1e35b700 1 -- 172.21.15.8:0/870705584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c18045ad0 con 0x7f1c180f6530 2023-10-18T21:25:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.575+0000 7f1c0dffb700 1 -- 172.21.15.8:0/870705584 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1c1401d420 con 0x7f1c180f6530 2023-10-18T21:25:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.575+0000 7f1c0dffb700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c04060f70 0x7f1c04063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.576+0000 7f1c0dffb700 1 -- 172.21.15.8:0/870705584 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1c1407e540 con 0x7f1c180f6530 2023-10-18T21:25:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.576+0000 7f1c1cb58700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c04060f70 0x7f1c04063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.576+0000 7f1c1cb58700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c04060f70 0x7f1c04063430 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f1c080096c0 tx=0x7f1c08009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:34.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.580+0000 7f1c0dffb700 1 -- 172.21.15.8:0/870705584 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1c14051c50 con 0x7f1c180f6530 2023-10-18T21:25:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:33.717326+0000 mgr.smithi008.flmjzp (mgr.14640) 1603 : audit [DBG] from='client.35464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:34.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:33.717326+0000 mgr.smithi008.flmjzp (mgr.14640) 1603 : audit [DBG] from='client.35464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.833+0000 7f1c1e35b700 1 -- 172.21.15.8:0/870705584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1c180fed90 con 0x7f1c180f6530 2023-10-18T21:25:34.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.833+0000 7f1c0dffb700 1 -- 172.21.15.8:0/870705584 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f1c14051840 con 0x7f1c180f6530 2023-10-18T21:25:34.834 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:25:34.835 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:25:34.835 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:25:34.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:25:34.835 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:25:34.835 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:25:34.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:25:34.836 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:25:34.836 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:25:34.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:25:34.836 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:25:34.836 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:25:34.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:25:34.837 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:25:34.837 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:25:34.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:25:34.837 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:25:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.835+0000 7f1c1e35b700 1 -- 172.21.15.8:0/870705584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c04060f70 msgr2=0x7f1c04063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.835+0000 7f1c1e35b700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c04060f70 0x7f1c04063430 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f1c080096c0 tx=0x7f1c08009be0).stop 2023-10-18T21:25:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.835+0000 7f1c1e35b700 1 -- 172.21.15.8:0/870705584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c180f6530 msgr2=0x7f1c18108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.835+0000 7f1c1e35b700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c180f6530 0x7f1c18108fb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f1c14004e30 tx=0x7f1c14009b30).stop 2023-10-18T21:25:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.835+0000 7f1c1e35b700 1 -- 172.21.15.8:0/870705584 shutdown_connections 2023-10-18T21:25:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.835+0000 7f1c1e35b700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c04060f70 0x7f1c04063430 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.835+0000 7f1c1e35b700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c180f6530 0x7f1c18108fb0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.835+0000 7f1c1e35b700 1 --2- 172.21.15.8:0/870705584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c180f77d0 0x7f1c181094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.835+0000 7f1c1e35b700 1 -- 172.21.15.8:0/870705584 >> 172.21.15.8:0/870705584 conn(0x7f1c180f1c90 msgr2=0x7f1c1806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:34.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.835+0000 7f1c1e35b700 1 -- 172.21.15.8:0/870705584 shutdown_connections 2023-10-18T21:25:34.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.836+0000 7f1c1e35b700 1 -- 172.21.15.8:0/870705584 wait complete. 2023-10-18T21:25:34.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.972+0000 7f6677212700 1 -- 172.21.15.8:0/846199395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66700f9690 msgr2=0x7f66700fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.972+0000 7f6677212700 1 --2- 172.21.15.8:0/846199395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66700f9690 0x7f66700fbae0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f6660004660 tx=0x7f6660009b30).stop 2023-10-18T21:25:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.972+0000 7f6677212700 1 -- 172.21.15.8:0/846199395 shutdown_connections 2023-10-18T21:25:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.972+0000 7f6677212700 1 --2- 172.21.15.8:0/846199395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66700f9690 0x7f66700fbae0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.972+0000 7f6677212700 1 --2- 172.21.15.8:0/846199395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6670060310 0x7f66700f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.972+0000 7f6677212700 1 -- 172.21.15.8:0/846199395 >> 172.21.15.8:0/846199395 conn(0x7f66700f0b90 msgr2=0x7f66700f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.972+0000 7f6677212700 1 -- 172.21.15.8:0/846199395 shutdown_connections 2023-10-18T21:25:34.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.972+0000 7f6677212700 1 -- 172.21.15.8:0/846199395 wait complete. 2023-10-18T21:25:34.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.973+0000 7f6677212700 1 Processor -- start 2023-10-18T21:25:34.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.973+0000 7f6677212700 1 -- start start 2023-10-18T21:25:34.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.974+0000 7f6677212700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6670060310 0x7f6670106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:34.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.974+0000 7f6677212700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66700f9690 0x7f6670107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:34.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.974+0000 7f6677212700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6670107840 con 0x7f6670060310 2023-10-18T21:25:34.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.974+0000 7f6677212700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6670108050 con 0x7f66700f9690 2023-10-18T21:25:34.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.974+0000 7f6676210700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6670060310 0x7f6670106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:34.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.974+0000 7f6676210700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6670060310 0x7f6670106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59910/0 (socket says 172.21.15.8:59910) 2023-10-18T21:25:34.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.974+0000 7f6676210700 1 -- 172.21.15.8:0/103132640 learned_addr learned my addr 172.21.15.8:0/103132640 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:34.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.974+0000 7f6675a0f700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66700f9690 0x7f6670107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:34.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.975+0000 7f6676210700 1 -- 172.21.15.8:0/103132640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66700f9690 msgr2=0x7f6670107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:34.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.975+0000 7f6676210700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66700f9690 0x7f6670107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:34.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.975+0000 7f6676210700 1 -- 172.21.15.8:0/103132640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6660005040 con 0x7f6670060310 2023-10-18T21:25:34.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.975+0000 7f6676210700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6670060310 0x7f6670106d50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f666c00e7f0 tx=0x7f666c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:34.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.975+0000 7f6666ffd700 1 -- 172.21.15.8:0/103132640 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f666c0092e0 con 0x7f6670060310 2023-10-18T21:25:34.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.975+0000 7f6666ffd700 1 -- 172.21.15.8:0/103132640 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f666c00f040 con 0x7f6670060310 2023-10-18T21:25:34.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.975+0000 7f6666ffd700 1 -- 172.21.15.8:0/103132640 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f666c0147e0 con 0x7f6670060310 2023-10-18T21:25:34.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.975+0000 7f6677212700 1 -- 172.21.15.8:0/103132640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66701082d0 con 0x7f6670060310 2023-10-18T21:25:34.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.975+0000 7f6677212700 1 -- 172.21.15.8:0/103132640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6670108810 con 0x7f6670060310 2023-10-18T21:25:34.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.976+0000 7f6677212700 1 -- 172.21.15.8:0/103132640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6670059100 con 0x7f6670060310 2023-10-18T21:25:34.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.977+0000 7f6666ffd700 1 -- 172.21.15.8:0/103132640 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f666c01b030 con 0x7f6670060310 2023-10-18T21:25:34.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.978+0000 7f6666ffd700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f665c060f70 0x7f665c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:34.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.978+0000 7f6666ffd700 1 -- 172.21.15.8:0/103132640 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f666c07c6b0 con 0x7f6670060310 2023-10-18T21:25:34.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.978+0000 7f6675a0f700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f665c060f70 0x7f665c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:34.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.979+0000 7f6675a0f700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f665c060f70 0x7f665c063430 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f6660009720 tx=0x7f6660016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:34.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:34.982+0000 7f6666ffd700 1 -- 172.21.15.8:0/103132640 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f666c04c310 con 0x7f6670060310 2023-10-18T21:25:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.214+0000 7f6677212700 1 -- 172.21.15.8:0/103132640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f66700fecf0 con 0x7f6670060310 2023-10-18T21:25:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.214+0000 7f6666ffd700 1 -- 172.21.15.8:0/103132640 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f666c019070 con 0x7f6670060310 2023-10-18T21:25:35.215 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:25:35.215 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:25:35.216 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:25:35.216 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:25:35.216 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:25:35.216 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:25:35.216 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:25:35.217 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:25:35.217 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:25:35.217 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:25:35.217 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:25:35.217 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:25:35.217 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:25:35.218 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:25:35.218 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:25:35.218 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:25:35.218 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:25:35.218 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:25:35.219 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:25:35.219 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:25:35.219 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:25:35.219 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:25:35.219 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:25:35.219 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:25:35.220 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:25:35.220 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:25:35.220 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:25:35.220 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:25:35.220 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:25:35.220 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:25:35.221 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:25:35.221 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:25:35.221 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:25:35.221 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:25:35.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 -- 172.21.15.8:0/103132640 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f665c060f70 msgr2=0x7f665c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:35.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f665c060f70 0x7f665c063430 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f6660009720 tx=0x7f6660016040).stop 2023-10-18T21:25:35.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 -- 172.21.15.8:0/103132640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6670060310 msgr2=0x7f6670106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:35.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6670060310 0x7f6670106d50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f666c00e7f0 tx=0x7f666c00b040).stop 2023-10-18T21:25:35.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 -- 172.21.15.8:0/103132640 shutdown_connections 2023-10-18T21:25:35.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f665c060f70 0x7f665c063430 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:35.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6670060310 0x7f6670106d50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:35.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 --2- 172.21.15.8:0/103132640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66700f9690 0x7f6670107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:35.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 -- 172.21.15.8:0/103132640 >> 172.21.15.8:0/103132640 conn(0x7f66700f0b90 msgr2=0x7f66700f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:35.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 -- 172.21.15.8:0/103132640 shutdown_connections 2023-10-18T21:25:35.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.216+0000 7f6677212700 1 -- 172.21.15.8:0/103132640 wait complete. 2023-10-18T21:25:35.224 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:25:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.353+0000 7fad2b1c1700 1 -- 172.21.15.8:0/4022174696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad240f77d0 msgr2=0x7fad240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.353+0000 7fad2b1c1700 1 --2- 172.21.15.8:0/4022174696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad240f77d0 0x7fad240f7c30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fad14004660 tx=0x7fad14009b30).stop 2023-10-18T21:25:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.353+0000 7fad2b1c1700 1 -- 172.21.15.8:0/4022174696 shutdown_connections 2023-10-18T21:25:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.353+0000 7fad2b1c1700 1 --2- 172.21.15.8:0/4022174696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad240f77d0 0x7fad240f7c30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.353+0000 7fad2b1c1700 1 --2- 172.21.15.8:0/4022174696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad240f6530 0x7fad240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.353+0000 7fad2b1c1700 1 -- 172.21.15.8:0/4022174696 >> 172.21.15.8:0/4022174696 conn(0x7fad240f1cd0 msgr2=0x7fad240f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.353+0000 7fad2b1c1700 1 -- 172.21.15.8:0/4022174696 shutdown_connections 2023-10-18T21:25:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.353+0000 7fad2b1c1700 1 -- 172.21.15.8:0/4022174696 wait complete. 2023-10-18T21:25:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.354+0000 7fad2b1c1700 1 Processor -- start 2023-10-18T21:25:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.354+0000 7fad2b1c1700 1 -- start start 2023-10-18T21:25:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.354+0000 7fad2b1c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad240f6530 0x7fad2406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.354+0000 7fad2b1c1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad240f77d0 0x7fad24069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.354+0000 7fad2b1c1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2406a380 con 0x7fad240f6530 2023-10-18T21:25:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.354+0000 7fad2b1c1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2406a4c0 con 0x7fad240f77d0 2023-10-18T21:25:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.354+0000 7fad2a1bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad240f6530 0x7fad2406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.354+0000 7fad2a1bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad240f6530 0x7fad2406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59938/0 (socket says 172.21.15.8:59938) 2023-10-18T21:25:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.354+0000 7fad2a1bf700 1 -- 172.21.15.8:0/109408383 learned_addr learned my addr 172.21.15.8:0/109408383 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:25:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.355+0000 7fad299be700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad240f77d0 0x7fad24069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.355+0000 7fad2a1bf700 1 -- 172.21.15.8:0/109408383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad240f77d0 msgr2=0x7fad24069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.355+0000 7fad2a1bf700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad240f77d0 0x7fad24069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.355+0000 7fad2a1bf700 1 -- 172.21.15.8:0/109408383 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14005040 con 0x7fad240f6530 2023-10-18T21:25:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.355+0000 7fad2a1bf700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad240f6530 0x7fad2406b9a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fad20002700 tx=0x7fad20009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.355+0000 7fad1affd700 1 -- 172.21.15.8:0/109408383 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad20009320 con 0x7fad240f6530 2023-10-18T21:25:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.355+0000 7fad1affd700 1 -- 172.21.15.8:0/109408383 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fad2000f040 con 0x7fad240f6530 2023-10-18T21:25:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.355+0000 7fad1affd700 1 -- 172.21.15.8:0/109408383 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad20014970 con 0x7fad240f6530 2023-10-18T21:25:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.355+0000 7fad2b1c1700 1 -- 172.21.15.8:0/109408383 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2406a7a0 con 0x7fad240f6530 2023-10-18T21:25:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.355+0000 7fad2b1c1700 1 -- 172.21.15.8:0/109408383 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2410ed60 con 0x7fad240f6530 2023-10-18T21:25:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.357+0000 7fad2b1c1700 1 -- 172.21.15.8:0/109408383 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad24045ad0 con 0x7fad240f6530 2023-10-18T21:25:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.357+0000 7fad1affd700 1 -- 172.21.15.8:0/109408383 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fad20009480 con 0x7fad240f6530 2023-10-18T21:25:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.358+0000 7fad1affd700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fad10060f70 0x7fad10063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:25:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.358+0000 7fad1affd700 1 -- 172.21.15.8:0/109408383 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fad2007cad0 con 0x7fad240f6530 2023-10-18T21:25:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.359+0000 7fad299be700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fad10060f70 0x7fad10063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:25:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.359+0000 7fad299be700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fad10060f70 0x7fad10063430 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fad14004630 tx=0x7fad14009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:25:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.363+0000 7fad1affd700 1 -- 172.21.15.8:0/109408383 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fad2004c7c0 con 0x7fad240f6530 2023-10-18T21:25:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:34.071556+0000 mgr.smithi008.flmjzp (mgr.14640) 1604 : audit [DBG] from='client.35468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:34.113795+0000 mgr.smithi008.flmjzp (mgr.14640) 1605 : cluster [DBG] pgmap v1113: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:34.422174+0000 mgr.smithi008.flmjzp (mgr.14640) 1606 : audit [DBG] from='client.35472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:34.833935+0000 mon.smithi008 (mon.0) 2069 : audit [DBG] from='client.? 172.21.15.8:0/870705584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:35.214772+0000 mon.smithi008 (mon.0) 2070 : audit [DBG] from='client.? 172.21.15.8:0/103132640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:25:35.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.563+0000 7fad2b1c1700 1 -- 172.21.15.8:0/109408383 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad240fee00 con 0x7fad10060f70 2023-10-18T21:25:35.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.564+0000 7fad1affd700 1 -- 172.21.15.8:0/109408383 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fad240fee00 con 0x7fad10060f70 2023-10-18T21:25:35.565 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:25:35.565 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:25:35.565 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:25:35.566 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:25:35.566 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:25:35.566 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:25:35.566 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:25:35.566 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:25:35.567 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:25:35.567 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:25:35.567 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:25:35.567 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:25:35.567 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:25:35.568 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:25:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 -- 172.21.15.8:0/109408383 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fad10060f70 msgr2=0x7fad10063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fad10060f70 0x7fad10063430 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fad14004630 tx=0x7fad14009b30).stop 2023-10-18T21:25:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 -- 172.21.15.8:0/109408383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad240f6530 msgr2=0x7fad2406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:25:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad240f6530 0x7fad2406b9a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fad20002700 tx=0x7fad20009d80).stop 2023-10-18T21:25:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 -- 172.21.15.8:0/109408383 shutdown_connections 2023-10-18T21:25:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fad10060f70 0x7fad10063430 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:35.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad240f6530 0x7fad2406b9a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:35.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 --2- 172.21.15.8:0/109408383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad240f77d0 0x7fad24069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:25:35.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 -- 172.21.15.8:0/109408383 >> 172.21.15.8:0/109408383 conn(0x7fad240f1cd0 msgr2=0x7fad240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:25:35.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 -- 172.21.15.8:0/109408383 shutdown_connections 2023-10-18T21:25:35.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:25:35.566+0000 7fad2b1c1700 1 -- 172.21.15.8:0/109408383 wait complete. 2023-10-18T21:25:35.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:34.071556+0000 mgr.smithi008.flmjzp (mgr.14640) 1604 : audit [DBG] from='client.35468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:34.113795+0000 mgr.smithi008.flmjzp (mgr.14640) 1605 : cluster [DBG] pgmap v1113: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:34.422174+0000 mgr.smithi008.flmjzp (mgr.14640) 1606 : audit [DBG] from='client.35472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:34.833935+0000 mon.smithi008 (mon.0) 2069 : audit [DBG] from='client.? 172.21.15.8:0/870705584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:35.214772+0000 mon.smithi008 (mon.0) 2070 : audit [DBG] from='client.? 172.21.15.8:0/103132640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:25:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:35.564264+0000 mgr.smithi008.flmjzp (mgr.14640) 1607 : audit [DBG] from='client.35484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:36.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:35.564264+0000 mgr.smithi008.flmjzp (mgr.14640) 1607 : audit [DBG] from='client.35484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:25:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:36.114283+0000 mgr.smithi008.flmjzp (mgr.14640) 1608 : cluster [DBG] pgmap v1114: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:37.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:36.114283+0000 mgr.smithi008.flmjzp (mgr.14640) 1608 : cluster [DBG] pgmap v1114: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:38.139750+0000 mon.smithi008 (mon.0) 2071 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:38.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:38.139750+0000 mon.smithi008 (mon.0) 2071 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:38.114813+0000 mgr.smithi008.flmjzp (mgr.14640) 1609 : cluster [DBG] pgmap v1115: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:38.697954+0000 mon.smithi008 (mon.0) 2072 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:38.699096+0000 mon.smithi008 (mon.0) 2073 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:38.700022+0000 mgr.smithi008.flmjzp (mgr.14640) 1610 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:25:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:38.700753+0000 mgr.smithi008.flmjzp (mgr.14640) 1611 : cluster [DBG] pgmap v1116: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:38.701007+0000 mgr.smithi008.flmjzp (mgr.14640) 1612 : cluster [DBG] pgmap v1117: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:38.705805+0000 mon.smithi008 (mon.0) 2074 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:38.713435+0000 mon.smithi008 (mon.0) 2075 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:38.716915+0000 mon.smithi008 (mon.0) 2076 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:38.718901+0000 mon.smithi008 (mon.0) 2077 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:38.720837+0000 mon.smithi008 (mon.0) 2078 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:38.723464+0000 mon.smithi008 (mon.0) 2079 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:38.725579+0000 mgr.smithi008.flmjzp (mgr.14640) 1613 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:25:39.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:38.114813+0000 mgr.smithi008.flmjzp (mgr.14640) 1609 : cluster [DBG] pgmap v1115: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:39.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:38.697954+0000 mon.smithi008 (mon.0) 2072 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:38.699096+0000 mon.smithi008 (mon.0) 2073 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:38.700022+0000 mgr.smithi008.flmjzp (mgr.14640) 1610 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:25:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:38.700753+0000 mgr.smithi008.flmjzp (mgr.14640) 1611 : cluster [DBG] pgmap v1116: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:38.701007+0000 mgr.smithi008.flmjzp (mgr.14640) 1612 : cluster [DBG] pgmap v1117: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:38.705805+0000 mon.smithi008 (mon.0) 2074 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:38.713435+0000 mon.smithi008 (mon.0) 2075 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:38.716915+0000 mon.smithi008 (mon.0) 2076 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:38.718901+0000 mon.smithi008 (mon.0) 2077 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:38.720837+0000 mon.smithi008 (mon.0) 2078 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:38.723464+0000 mon.smithi008 (mon.0) 2079 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:38.725579+0000 mgr.smithi008.flmjzp (mgr.14640) 1613 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:25:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:40.701748+0000 mgr.smithi008.flmjzp (mgr.14640) 1614 : cluster [DBG] pgmap v1118: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:40.701748+0000 mgr.smithi008.flmjzp (mgr.14640) 1614 : cluster [DBG] pgmap v1118: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:42.702491+0000 mgr.smithi008.flmjzp (mgr.14640) 1615 : cluster [DBG] pgmap v1119: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:42.702491+0000 mgr.smithi008.flmjzp (mgr.14640) 1615 : cluster [DBG] pgmap v1119: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:44.703097+0000 mgr.smithi008.flmjzp (mgr.14640) 1616 : cluster [DBG] pgmap v1120: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:46.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:44.703097+0000 mgr.smithi008.flmjzp (mgr.14640) 1616 : cluster [DBG] pgmap v1120: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:46.703803+0000 mgr.smithi008.flmjzp (mgr.14640) 1617 : cluster [DBG] pgmap v1121: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:48.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:46.703803+0000 mgr.smithi008.flmjzp (mgr.14640) 1617 : cluster [DBG] pgmap v1121: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:48.733209+0000 mon.smithi008 (mon.0) 2080 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:48.735411+0000 mon.smithi008 (mon.0) 2081 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:48.736523+0000 mon.smithi008 (mon.0) 2082 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:48.743568+0000 mon.smithi008 (mon.0) 2083 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:48.750034+0000 mon.smithi008 (mon.0) 2084 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:48.753250+0000 mon.smithi008 (mon.0) 2085 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:48.755068+0000 mon.smithi008 (mon.0) 2086 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:48.756668+0000 mon.smithi008 (mon.0) 2087 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:48.758634+0000 mon.smithi008 (mon.0) 2088 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:48.733209+0000 mon.smithi008 (mon.0) 2080 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:48.735411+0000 mon.smithi008 (mon.0) 2081 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:48.736523+0000 mon.smithi008 (mon.0) 2082 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:48.743568+0000 mon.smithi008 (mon.0) 2083 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:48.750034+0000 mon.smithi008 (mon.0) 2084 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:48.753250+0000 mon.smithi008 (mon.0) 2085 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:48.755068+0000 mon.smithi008 (mon.0) 2086 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:48.756668+0000 mon.smithi008 (mon.0) 2087 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:48.758634+0000 mon.smithi008 (mon.0) 2088 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:50.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:48.704384+0000 mgr.smithi008.flmjzp (mgr.14640) 1618 : cluster [DBG] pgmap v1122: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:50.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:48.737445+0000 mgr.smithi008.flmjzp (mgr.14640) 1619 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:25:50.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:48.738026+0000 mgr.smithi008.flmjzp (mgr.14640) 1620 : cluster [DBG] pgmap v1123: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:50.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:48.738321+0000 mgr.smithi008.flmjzp (mgr.14640) 1621 : cluster [DBG] pgmap v1124: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:50.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:48.760526+0000 mgr.smithi008.flmjzp (mgr.14640) 1622 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:25:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:48.704384+0000 mgr.smithi008.flmjzp (mgr.14640) 1618 : cluster [DBG] pgmap v1122: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:48.737445+0000 mgr.smithi008.flmjzp (mgr.14640) 1619 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:25:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:48.738026+0000 mgr.smithi008.flmjzp (mgr.14640) 1620 : cluster [DBG] pgmap v1123: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:48.738321+0000 mgr.smithi008.flmjzp (mgr.14640) 1621 : cluster [DBG] pgmap v1124: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:48.760526+0000 mgr.smithi008.flmjzp (mgr.14640) 1622 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:25:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:50.738852+0000 mgr.smithi008.flmjzp (mgr.14640) 1623 : cluster [DBG] pgmap v1125: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:50.738852+0000 mgr.smithi008.flmjzp (mgr.14640) 1623 : cluster [DBG] pgmap v1125: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:52.739348+0000 mgr.smithi008.flmjzp (mgr.14640) 1624 : cluster [DBG] pgmap v1126: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:52.739348+0000 mgr.smithi008.flmjzp (mgr.14640) 1624 : cluster [DBG] pgmap v1126: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:54.739892+0000 mgr.smithi008.flmjzp (mgr.14640) 1625 : cluster [DBG] pgmap v1127: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:56.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:54.739892+0000 mgr.smithi008.flmjzp (mgr.14640) 1625 : cluster [DBG] pgmap v1127: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:58.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:56.740443+0000 mgr.smithi008.flmjzp (mgr.14640) 1626 : cluster [DBG] pgmap v1128: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:58.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:56.740443+0000 mgr.smithi008.flmjzp (mgr.14640) 1626 : cluster [DBG] pgmap v1128: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:25:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:58.769343+0000 mon.smithi008 (mon.0) 2089 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:58.771519+0000 mon.smithi008 (mon.0) 2090 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:58.772619+0000 mon.smithi008 (mon.0) 2091 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:58.779599+0000 mon.smithi008 (mon.0) 2092 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:58.786222+0000 mon.smithi008 (mon.0) 2093 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:58.789417+0000 mon.smithi008 (mon.0) 2094 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:58.791091+0000 mon.smithi008 (mon.0) 2095 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:58.792716+0000 mon.smithi008 (mon.0) 2096 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:25:58.794814+0000 mon.smithi008 (mon.0) 2097 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:58.769343+0000 mon.smithi008 (mon.0) 2089 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:58.771519+0000 mon.smithi008 (mon.0) 2090 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:25:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:58.772619+0000 mon.smithi008 (mon.0) 2091 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:25:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:58.779599+0000 mon.smithi008 (mon.0) 2092 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:25:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:58.786222+0000 mon.smithi008 (mon.0) 2093 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:25:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:58.789417+0000 mon.smithi008 (mon.0) 2094 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:58.791091+0000 mon.smithi008 (mon.0) 2095 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:58.792716+0000 mon.smithi008 (mon.0) 2096 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:25:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:25:58.794814+0000 mon.smithi008 (mon.0) 2097 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:00.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:58.740955+0000 mgr.smithi008.flmjzp (mgr.14640) 1627 : cluster [DBG] pgmap v1129: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:00.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:58.773606+0000 mgr.smithi008.flmjzp (mgr.14640) 1628 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:00.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:58.774168+0000 mgr.smithi008.flmjzp (mgr.14640) 1629 : cluster [DBG] pgmap v1130: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:00.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:25:58.774507+0000 mgr.smithi008.flmjzp (mgr.14640) 1630 : cluster [DBG] pgmap v1131: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:00.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:25:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:25:58.796701+0000 mgr.smithi008.flmjzp (mgr.14640) 1631 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:58.740955+0000 mgr.smithi008.flmjzp (mgr.14640) 1627 : cluster [DBG] pgmap v1129: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:58.773606+0000 mgr.smithi008.flmjzp (mgr.14640) 1628 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:58.774168+0000 mgr.smithi008.flmjzp (mgr.14640) 1629 : cluster [DBG] pgmap v1130: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:25:58.774507+0000 mgr.smithi008.flmjzp (mgr.14640) 1630 : cluster [DBG] pgmap v1131: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:25:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:25:58.796701+0000 mgr.smithi008.flmjzp (mgr.14640) 1631 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:00.775040+0000 mgr.smithi008.flmjzp (mgr.14640) 1632 : cluster [DBG] pgmap v1132: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:00.775040+0000 mgr.smithi008.flmjzp (mgr.14640) 1632 : cluster [DBG] pgmap v1132: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:02.775685+0000 mgr.smithi008.flmjzp (mgr.14640) 1633 : cluster [DBG] pgmap v1133: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:04.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:02.775685+0000 mgr.smithi008.flmjzp (mgr.14640) 1633 : cluster [DBG] pgmap v1133: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.718+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/815560495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0060310 msgr2=0x7f9eb00f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.718+0000 7f9eb5ff7700 1 --2- 172.21.15.8:0/815560495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0060310 0x7f9eb00f9110 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f9ea4004660 tx=0x7f9ea4009b30).stop 2023-10-18T21:26:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.718+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/815560495 shutdown_connections 2023-10-18T21:26:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.718+0000 7f9eb5ff7700 1 --2- 172.21.15.8:0/815560495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eb00f9690 0x7f9eb00fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.718+0000 7f9eb5ff7700 1 --2- 172.21.15.8:0/815560495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0060310 0x7f9eb00f9110 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.718+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/815560495 >> 172.21.15.8:0/815560495 conn(0x7f9eb00f0b90 msgr2=0x7f9eb00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.718+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/815560495 shutdown_connections 2023-10-18T21:26:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.718+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/815560495 wait complete. 2023-10-18T21:26:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.719+0000 7f9eb5ff7700 1 Processor -- start 2023-10-18T21:26:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.719+0000 7f9eb5ff7700 1 -- start start 2023-10-18T21:26:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.720+0000 7f9eb5ff7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0060310 0x7f9eb0106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.720+0000 7f9eb5ff7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eb00f9690 0x7f9eb01072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.720+0000 7f9eb5ff7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01078a0 con 0x7f9eb0060310 2023-10-18T21:26:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.720+0000 7f9eb5ff7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01080e0 con 0x7f9eb00f9690 2023-10-18T21:26:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.720+0000 7f9eb4ff5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0060310 0x7f9eb0106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.720+0000 7f9eb4ff5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0060310 0x7f9eb0106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45890/0 (socket says 172.21.15.8:45890) 2023-10-18T21:26:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.720+0000 7f9eb4ff5700 1 -- 172.21.15.8:0/2180858291 learned_addr learned my addr 172.21.15.8:0/2180858291 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9eaffff700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eb00f9690 0x7f9eb01072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9eb4ff5700 1 -- 172.21.15.8:0/2180858291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eb00f9690 msgr2=0x7f9eb01072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9eb4ff5700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eb00f9690 0x7f9eb01072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9eb4ff5700 1 -- 172.21.15.8:0/2180858291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea4005040 con 0x7f9eb0060310 2023-10-18T21:26:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9eaffff700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eb00f9690 0x7f9eb01072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:26:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9eb4ff5700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0060310 0x7f9eb0106db0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f9ea4009f50 tx=0x7f9ea4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9ead7fa700 1 -- 172.21.15.8:0/2180858291 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ea4018070 con 0x7f9eb0060310 2023-10-18T21:26:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9ead7fa700 1 -- 172.21.15.8:0/2180858291 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9ea4009630 con 0x7f9eb0060310 2023-10-18T21:26:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9ead7fa700 1 -- 172.21.15.8:0/2180858291 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ea401c3c0 con 0x7f9eb0060310 2023-10-18T21:26:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/2180858291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb0108360 con 0x7f9eb0060310 2023-10-18T21:26:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.721+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/2180858291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb0108840 con 0x7f9eb0060310 2023-10-18T21:26:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.722+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/2180858291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb0059100 con 0x7f9eb0060310 2023-10-18T21:26:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.723+0000 7f9ead7fa700 1 -- 172.21.15.8:0/2180858291 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9ea401d420 con 0x7f9eb0060310 2023-10-18T21:26:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.724+0000 7f9ead7fa700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ea0060f70 0x7f9ea0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.724+0000 7f9ead7fa700 1 -- 172.21.15.8:0/2180858291 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9ea407e640 con 0x7f9eb0060310 2023-10-18T21:26:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.724+0000 7f9eaffff700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ea0060f70 0x7f9ea0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:05.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.725+0000 7f9eaffff700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ea0060f70 0x7f9ea0063430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f9eb0106b40 tx=0x7f9e9c009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:05.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.729+0000 7f9ead7fa700 1 -- 172.21.15.8:0/2180858291 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9ea404e2e0 con 0x7f9eb0060310 2023-10-18T21:26:05.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.928+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/2180858291 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9eb00fedc0 con 0x7f9ea0060f70 2023-10-18T21:26:05.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.929+0000 7f9ead7fa700 1 -- 172.21.15.8:0/2180858291 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9eb00fedc0 con 0x7f9ea0060f70 2023-10-18T21:26:05.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/2180858291 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ea0060f70 msgr2=0x7f9ea0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:05.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ea0060f70 0x7f9ea0063430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f9eb0106b40 tx=0x7f9e9c009be0).stop 2023-10-18T21:26:05.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/2180858291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0060310 msgr2=0x7f9eb0106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:05.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0060310 0x7f9eb0106db0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f9ea4009f50 tx=0x7f9ea4009b30).stop 2023-10-18T21:26:05.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/2180858291 shutdown_connections 2023-10-18T21:26:05.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ea0060f70 0x7f9ea0063430 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:05.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9eb0060310 0x7f9eb0106db0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:05.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 --2- 172.21.15.8:0/2180858291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eb00f9690 0x7f9eb01072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:05.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/2180858291 >> 172.21.15.8:0/2180858291 conn(0x7f9eb00f0b90 msgr2=0x7f9eb00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:05.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/2180858291 shutdown_connections 2023-10-18T21:26:05.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:05.931+0000 7f9eb5ff7700 1 -- 172.21.15.8:0/2180858291 wait complete. 2023-10-18T21:26:05.948 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:26:06.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.070+0000 7f7b374fd700 1 -- 172.21.15.8:0/379091883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b300f77d0 msgr2=0x7f7b300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:06.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.070+0000 7f7b374fd700 1 --2- 172.21.15.8:0/379091883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b300f77d0 0x7f7b300f7c30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f7b20004660 tx=0x7f7b20009b30).stop 2023-10-18T21:26:06.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.070+0000 7f7b374fd700 1 -- 172.21.15.8:0/379091883 shutdown_connections 2023-10-18T21:26:06.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.070+0000 7f7b374fd700 1 --2- 172.21.15.8:0/379091883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b300f77d0 0x7f7b300f7c30 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.070+0000 7f7b374fd700 1 --2- 172.21.15.8:0/379091883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b300f6530 0x7f7b300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.070+0000 7f7b374fd700 1 -- 172.21.15.8:0/379091883 >> 172.21.15.8:0/379091883 conn(0x7f7b300f1c90 msgr2=0x7f7b300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:06.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.070+0000 7f7b374fd700 1 -- 172.21.15.8:0/379091883 shutdown_connections 2023-10-18T21:26:06.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.070+0000 7f7b374fd700 1 -- 172.21.15.8:0/379091883 wait complete. 2023-10-18T21:26:06.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.071+0000 7f7b374fd700 1 Processor -- start 2023-10-18T21:26:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.071+0000 7f7b374fd700 1 -- start start 2023-10-18T21:26:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.071+0000 7f7b374fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b300f6530 0x7f7b30108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.071+0000 7f7b374fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b300f77d0 0x7f7b301093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:06.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.071+0000 7f7b374fd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b301099a0 con 0x7f7b300f77d0 2023-10-18T21:26:06.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.071+0000 7f7b374fd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30109ae0 con 0x7f7b300f6530 2023-10-18T21:26:06.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.071+0000 7f7b35cfa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b300f77d0 0x7f7b301093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:06.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.071+0000 7f7b35cfa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b300f77d0 0x7f7b301093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45912/0 (socket says 172.21.15.8:45912) 2023-10-18T21:26:06.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.071+0000 7f7b35cfa700 1 -- 172.21.15.8:0/3902541140 learned_addr learned my addr 172.21.15.8:0/3902541140 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:06.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.072+0000 7f7b364fb700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b300f6530 0x7f7b30108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:06.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.072+0000 7f7b35cfa700 1 -- 172.21.15.8:0/3902541140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b300f6530 msgr2=0x7f7b30108f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:06.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.072+0000 7f7b35cfa700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b300f6530 0x7f7b30108f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.072+0000 7f7b35cfa700 1 -- 172.21.15.8:0/3902541140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b20005040 con 0x7f7b300f77d0 2023-10-18T21:26:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.072+0000 7f7b35cfa700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b300f77d0 0x7f7b301093f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f7b20004d80 tx=0x7f7b2000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.072+0000 7f7b26ffd700 1 -- 172.21.15.8:0/3902541140 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b20019070 con 0x7f7b300f77d0 2023-10-18T21:26:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.072+0000 7f7b26ffd700 1 -- 172.21.15.8:0/3902541140 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7b2001e420 con 0x7f7b300f77d0 2023-10-18T21:26:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.072+0000 7f7b374fd700 1 -- 172.21.15.8:0/3902541140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3010a420 con 0x7f7b300f77d0 2023-10-18T21:26:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.072+0000 7f7b26ffd700 1 -- 172.21.15.8:0/3902541140 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b20014680 con 0x7f7b300f77d0 2023-10-18T21:26:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.072+0000 7f7b374fd700 1 -- 172.21.15.8:0/3902541140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3010a900 con 0x7f7b300f77d0 2023-10-18T21:26:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.073+0000 7f7b374fd700 1 -- 172.21.15.8:0/3902541140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b30045ad0 con 0x7f7b300f77d0 2023-10-18T21:26:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.074+0000 7f7b26ffd700 1 -- 172.21.15.8:0/3902541140 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7b2001e9c0 con 0x7f7b300f77d0 2023-10-18T21:26:06.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.075+0000 7f7b26ffd700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b1c060f70 0x7f7b1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:06.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.075+0000 7f7b26ffd700 1 -- 172.21.15.8:0/3902541140 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7b2007dde0 con 0x7f7b300f77d0 2023-10-18T21:26:06.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.075+0000 7f7b364fb700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b1c060f70 0x7f7b1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:06.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.076+0000 7f7b364fb700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b1c060f70 0x7f7b1c063430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f7b300f7630 tx=0x7f7b2c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:06.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.079+0000 7f7b26ffd700 1 -- 172.21.15.8:0/3902541140 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7b20051440 con 0x7f7b300f77d0 2023-10-18T21:26:06.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:04.776177+0000 mgr.smithi008.flmjzp (mgr.14640) 1634 : cluster [DBG] pgmap v1134: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:06.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:04.776177+0000 mgr.smithi008.flmjzp (mgr.14640) 1634 : cluster [DBG] pgmap v1134: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:06.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.283+0000 7f7b374fd700 1 -- 172.21.15.8:0/3902541140 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b300fc190 con 0x7f7b1c060f70 2023-10-18T21:26:06.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.284+0000 7f7b26ffd700 1 -- 172.21.15.8:0/3902541140 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7b300fc190 con 0x7f7b1c060f70 2023-10-18T21:26:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 -- 172.21.15.8:0/3902541140 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b1c060f70 msgr2=0x7f7b1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b1c060f70 0x7f7b1c063430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f7b300f7630 tx=0x7f7b2c00b040).stop 2023-10-18T21:26:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 -- 172.21.15.8:0/3902541140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b300f77d0 msgr2=0x7f7b301093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b300f77d0 0x7f7b301093f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f7b20004d80 tx=0x7f7b2000b040).stop 2023-10-18T21:26:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 -- 172.21.15.8:0/3902541140 shutdown_connections 2023-10-18T21:26:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b1c060f70 0x7f7b1c063430 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b300f6530 0x7f7b30108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 --2- 172.21.15.8:0/3902541140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b300f77d0 0x7f7b301093f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 -- 172.21.15.8:0/3902541140 >> 172.21.15.8:0/3902541140 conn(0x7f7b300f1c90 msgr2=0x7f7b3006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:06.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 -- 172.21.15.8:0/3902541140 shutdown_connections 2023-10-18T21:26:06.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.286+0000 7f7b374fd700 1 -- 172.21.15.8:0/3902541140 wait complete. 2023-10-18T21:26:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.422+0000 7f5b2bfff700 1 -- 172.21.15.8:0/1526910885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b2c0f77d0 msgr2=0x7f5b2c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.422+0000 7f5b2bfff700 1 --2- 172.21.15.8:0/1526910885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b2c0f77d0 0x7f5b2c0f7c30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f5b20004660 tx=0x7f5b20009b30).stop 2023-10-18T21:26:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.422+0000 7f5b2bfff700 1 -- 172.21.15.8:0/1526910885 shutdown_connections 2023-10-18T21:26:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.422+0000 7f5b2bfff700 1 --2- 172.21.15.8:0/1526910885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b2c0f77d0 0x7f5b2c0f7c30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.422+0000 7f5b2bfff700 1 --2- 172.21.15.8:0/1526910885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c0f6530 0x7f5b2c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.422+0000 7f5b2bfff700 1 -- 172.21.15.8:0/1526910885 >> 172.21.15.8:0/1526910885 conn(0x7f5b2c0f1c90 msgr2=0x7f5b2c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.423+0000 7f5b2bfff700 1 -- 172.21.15.8:0/1526910885 shutdown_connections 2023-10-18T21:26:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.423+0000 7f5b2bfff700 1 -- 172.21.15.8:0/1526910885 wait complete. 2023-10-18T21:26:06.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.423+0000 7f5b2bfff700 1 Processor -- start 2023-10-18T21:26:06.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.424+0000 7f5b2bfff700 1 -- start start 2023-10-18T21:26:06.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.424+0000 7f5b2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b2c0f6530 0x7f5b2c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.424+0000 7f5b2bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c0f77d0 0x7f5b2c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.424+0000 7f5b2bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c06a380 con 0x7f5b2c0f6530 2023-10-18T21:26:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.424+0000 7f5b2bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c06a4c0 con 0x7f5b2c0f77d0 2023-10-18T21:26:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.424+0000 7f5b2affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b2c0f6530 0x7f5b2c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.424+0000 7f5b2affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b2c0f6530 0x7f5b2c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45924/0 (socket says 172.21.15.8:45924) 2023-10-18T21:26:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.424+0000 7f5b2affd700 1 -- 172.21.15.8:0/3580875536 learned_addr learned my addr 172.21.15.8:0/3580875536 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.424+0000 7f5b2a7fc700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c0f77d0 0x7f5b2c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.425+0000 7f5b2affd700 1 -- 172.21.15.8:0/3580875536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c0f77d0 msgr2=0x7f5b2c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.425+0000 7f5b2affd700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c0f77d0 0x7f5b2c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.425+0000 7f5b2affd700 1 -- 172.21.15.8:0/3580875536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b20005040 con 0x7f5b2c0f6530 2023-10-18T21:26:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.425+0000 7f5b2affd700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b2c0f6530 0x7f5b2c06b9a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f5b1c002700 tx=0x7f5b1c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.425+0000 7f5b137fe700 1 -- 172.21.15.8:0/3580875536 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1c0079c0 con 0x7f5b2c0f6530 2023-10-18T21:26:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.425+0000 7f5b137fe700 1 -- 172.21.15.8:0/3580875536 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5b1c00f040 con 0x7f5b2c0f6530 2023-10-18T21:26:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.425+0000 7f5b137fe700 1 -- 172.21.15.8:0/3580875536 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1c0148d0 con 0x7f5b2c0f6530 2023-10-18T21:26:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.425+0000 7f5b2bfff700 1 -- 172.21.15.8:0/3580875536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c06a7a0 con 0x7f5b2c0f6530 2023-10-18T21:26:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.425+0000 7f5b2bfff700 1 -- 172.21.15.8:0/3580875536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c10ed70 con 0x7f5b2c0f6530 2023-10-18T21:26:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.427+0000 7f5b2bfff700 1 -- 172.21.15.8:0/3580875536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c045ad0 con 0x7f5b2c0f6530 2023-10-18T21:26:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.427+0000 7f5b137fe700 1 -- 172.21.15.8:0/3580875536 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5b1c01b060 con 0x7f5b2c0f6530 2023-10-18T21:26:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.428+0000 7f5b137fe700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b14060f70 0x7f5b14063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.428+0000 7f5b137fe700 1 -- 172.21.15.8:0/3580875536 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5b1c07c6b0 con 0x7f5b2c0f6530 2023-10-18T21:26:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.429+0000 7f5b2a7fc700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b14060f70 0x7f5b14063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.429+0000 7f5b2a7fc700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b14060f70 0x7f5b14063430 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f5b20004630 tx=0x7f5b20009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:06.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.432+0000 7f5b137fe700 1 -- 172.21.15.8:0/3580875536 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5b1c04c3a0 con 0x7f5b2c0f6530 2023-10-18T21:26:06.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.622+0000 7f5b2bfff700 1 -- 172.21.15.8:0/3580875536 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b2c0fee30 con 0x7f5b14060f70 2023-10-18T21:26:06.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.632+0000 7f5b137fe700 1 -- 172.21.15.8:0/3580875536 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5b2c0fee30 con 0x7f5b14060f70 2023-10-18T21:26:06.634 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:26:06.634 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (32m) 38s ago 34m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:26:06.634 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (26m) 38s ago 34m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:26:06.635 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (26m) 8m ago 33m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:26:06.635 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (32m) 38s ago 33m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:26:06.635 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 38s ago 30m - - 2023-10-18T21:26:06.635 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 38s ago 30m - - 2023-10-18T21:26:06.636 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 30m - - 2023-10-18T21:26:06.636 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 30m - - 2023-10-18T21:26:06.636 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (27m) 38s ago 35m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:26:06.636 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (27m) 8m ago 33m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:26:06.637 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (27m) 38s ago 35m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:26:06.637 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (26m) 8m ago 33m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:26:06.637 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (33m) 38s ago 33m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:26:06.637 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (33m) 8m ago 33m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:26:06.637 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (26m) 38s ago 32m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:26:06.638 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (24m) 38s ago 32m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:26:06.638 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (23m) 38s ago 32m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:26:06.638 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (23m) 8m ago 31m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:26:06.639 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (22m) 8m ago 31m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:26:06.639 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (22m) 8m ago 31m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:26:06.639 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (28m) 38s ago 33m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:26:06.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.634+0000 7f5b2bfff700 1 -- 172.21.15.8:0/3580875536 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b14060f70 msgr2=0x7f5b14063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:06.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.634+0000 7f5b2bfff700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b14060f70 0x7f5b14063430 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f5b20004630 tx=0x7f5b20009b30).stop 2023-10-18T21:26:06.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.634+0000 7f5b2bfff700 1 -- 172.21.15.8:0/3580875536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b2c0f6530 msgr2=0x7f5b2c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:06.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.634+0000 7f5b2bfff700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b2c0f6530 0x7f5b2c06b9a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f5b1c002700 tx=0x7f5b1c009d80).stop 2023-10-18T21:26:06.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.634+0000 7f5b2bfff700 1 -- 172.21.15.8:0/3580875536 shutdown_connections 2023-10-18T21:26:06.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.634+0000 7f5b2bfff700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b14060f70 0x7f5b14063430 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.634+0000 7f5b2bfff700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b2c0f6530 0x7f5b2c06b9a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.634+0000 7f5b2bfff700 1 --2- 172.21.15.8:0/3580875536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c0f77d0 0x7f5b2c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.634+0000 7f5b2bfff700 1 -- 172.21.15.8:0/3580875536 >> 172.21.15.8:0/3580875536 conn(0x7f5b2c0f1c90 msgr2=0x7f5b2c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:06.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.634+0000 7f5b2bfff700 1 -- 172.21.15.8:0/3580875536 shutdown_connections 2023-10-18T21:26:06.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.635+0000 7f5b2bfff700 1 -- 172.21.15.8:0/3580875536 wait complete. 2023-10-18T21:26:06.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.771+0000 7ff03ad56700 1 -- 172.21.15.8:0/2163237995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0340f6530 msgr2=0x7ff0340f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:06.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.771+0000 7ff03ad56700 1 --2- 172.21.15.8:0/2163237995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0340f6530 0x7ff0340f6950 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7ff030004660 tx=0x7ff030009b30).stop 2023-10-18T21:26:06.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.772+0000 7ff03ad56700 1 -- 172.21.15.8:0/2163237995 shutdown_connections 2023-10-18T21:26:06.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.772+0000 7ff03ad56700 1 --2- 172.21.15.8:0/2163237995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0340f77d0 0x7ff0340f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.772+0000 7ff03ad56700 1 --2- 172.21.15.8:0/2163237995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0340f6530 0x7ff0340f6950 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.772+0000 7ff03ad56700 1 -- 172.21.15.8:0/2163237995 >> 172.21.15.8:0/2163237995 conn(0x7ff0340f1cd0 msgr2=0x7ff0340f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:06.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.772+0000 7ff03ad56700 1 -- 172.21.15.8:0/2163237995 shutdown_connections 2023-10-18T21:26:06.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.772+0000 7ff03ad56700 1 -- 172.21.15.8:0/2163237995 wait complete. 2023-10-18T21:26:06.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.772+0000 7ff03ad56700 1 Processor -- start 2023-10-18T21:26:06.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.773+0000 7ff03ad56700 1 -- start start 2023-10-18T21:26:06.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.773+0000 7ff03ad56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0340f6530 0x7ff034108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:06.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.773+0000 7ff03ad56700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0340f77d0 0x7ff034109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:06.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.773+0000 7ff03ad56700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0341099e0 con 0x7ff0340f77d0 2023-10-18T21:26:06.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.773+0000 7ff03ad56700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff034109b20 con 0x7ff0340f6530 2023-10-18T21:26:06.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.773+0000 7ff039553700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0340f77d0 0x7ff034109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:06.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.773+0000 7ff039d54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0340f6530 0x7ff034108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:06.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.773+0000 7ff039553700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0340f77d0 0x7ff034109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45944/0 (socket says 172.21.15.8:45944) 2023-10-18T21:26:06.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.773+0000 7ff039553700 1 -- 172.21.15.8:0/3156116723 learned_addr learned my addr 172.21.15.8:0/3156116723 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:06.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.774+0000 7ff039553700 1 -- 172.21.15.8:0/3156116723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0340f6530 msgr2=0x7ff034108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:06.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.774+0000 7ff039553700 1 --2- 172.21.15.8:0/3156116723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0340f6530 0x7ff034108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:06.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.774+0000 7ff039553700 1 -- 172.21.15.8:0/3156116723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff030005040 con 0x7ff0340f77d0 2023-10-18T21:26:06.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.774+0000 7ff039553700 1 --2- 172.21.15.8:0/3156116723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0340f77d0 0x7ff034109430 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7ff02400e7f0 tx=0x7ff02400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:06.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.774+0000 7ff02a7fc700 1 -- 172.21.15.8:0/3156116723 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0240092e0 con 0x7ff0340f77d0 2023-10-18T21:26:06.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.774+0000 7ff02a7fc700 1 -- 172.21.15.8:0/3156116723 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff02400f040 con 0x7ff0340f77d0 2023-10-18T21:26:06.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.774+0000 7ff03ad56700 1 -- 172.21.15.8:0/3156116723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03410a4c0 con 0x7ff0340f77d0 2023-10-18T21:26:06.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.774+0000 7ff02a7fc700 1 -- 172.21.15.8:0/3156116723 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0240147e0 con 0x7ff0340f77d0 2023-10-18T21:26:06.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.774+0000 7ff03ad56700 1 -- 172.21.15.8:0/3156116723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03410aa00 con 0x7ff0340f77d0 2023-10-18T21:26:06.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.775+0000 7ff03ad56700 1 -- 172.21.15.8:0/3156116723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff034045ad0 con 0x7ff0340f77d0 2023-10-18T21:26:06.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.776+0000 7ff02a7fc700 1 -- 172.21.15.8:0/3156116723 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff02401b030 con 0x7ff0340f77d0 2023-10-18T21:26:06.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.777+0000 7ff02a7fc700 1 --2- 172.21.15.8:0/3156116723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff020060f70 0x7ff020063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:06.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.777+0000 7ff02a7fc700 1 -- 172.21.15.8:0/3156116723 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff02407c6b0 con 0x7ff0340f77d0 2023-10-18T21:26:06.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.777+0000 7ff039d54700 1 --2- 172.21.15.8:0/3156116723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff020060f70 0x7ff020063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:06.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.778+0000 7ff039d54700 1 --2- 172.21.15.8:0/3156116723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff020060f70 0x7ff020063430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7ff030005010 tx=0x7ff030016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:06.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:06.781+0000 7ff02a7fc700 1 -- 172.21.15.8:0/3156116723 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff02404fd40 con 0x7ff0340f77d0 2023-10-18T21:26:07.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.039+0000 7ff03ad56700 1 -- 172.21.15.8:0/3156116723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff034027a00 con 0x7ff0340f77d0 2023-10-18T21:26:07.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.039+0000 7ff02a7fc700 1 -- 172.21.15.8:0/3156116723 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7ff024019020 con 0x7ff0340f77d0 2023-10-18T21:26:07.042 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:26:07.042 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:26:07.042 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:26:07.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:26:07.043 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:26:07.043 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:26:07.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:26:07.043 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:26:07.043 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:26:07.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:26:07.044 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:26:07.044 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:26:07.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:26:07.044 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:26:07.045 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:26:07.045 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:26:07.045 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:26:07.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.041+0000 7ff03ad56700 1 -- 172.21.15.8:0/3156116723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff020060f70 msgr2=0x7ff020063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:07.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.041+0000 7ff03ad56700 1 --2- 172.21.15.8:0/3156116723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff020060f70 0x7ff020063430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7ff030005010 tx=0x7ff030016040).stop 2023-10-18T21:26:07.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.041+0000 7ff03ad56700 1 -- 172.21.15.8:0/3156116723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0340f77d0 msgr2=0x7ff034109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:07.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.041+0000 7ff03ad56700 1 --2- 172.21.15.8:0/3156116723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0340f77d0 0x7ff034109430 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7ff02400e7f0 tx=0x7ff02400b040).stop 2023-10-18T21:26:07.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.042+0000 7ff03ad56700 1 -- 172.21.15.8:0/3156116723 shutdown_connections 2023-10-18T21:26:07.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.042+0000 7ff03ad56700 1 --2- 172.21.15.8:0/3156116723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff020060f70 0x7ff020063430 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.042+0000 7ff03ad56700 1 --2- 172.21.15.8:0/3156116723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0340f6530 0x7ff034108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.042+0000 7ff03ad56700 1 --2- 172.21.15.8:0/3156116723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0340f77d0 0x7ff034109430 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.042+0000 7ff03ad56700 1 -- 172.21.15.8:0/3156116723 >> 172.21.15.8:0/3156116723 conn(0x7ff0340f1cd0 msgr2=0x7ff03406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.042+0000 7ff03ad56700 1 -- 172.21.15.8:0/3156116723 shutdown_connections 2023-10-18T21:26:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.042+0000 7ff03ad56700 1 -- 172.21.15.8:0/3156116723 wait complete. 2023-10-18T21:26:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.178+0000 7f7b8359e700 1 -- 172.21.15.8:0/1930858345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f6530 msgr2=0x7f7b840f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.178+0000 7f7b8359e700 1 --2- 172.21.15.8:0/1930858345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f6530 0x7f7b840f6950 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f7b74004660 tx=0x7f7b74009b30).stop 2023-10-18T21:26:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.178+0000 7f7b8359e700 1 -- 172.21.15.8:0/1930858345 shutdown_connections 2023-10-18T21:26:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.178+0000 7f7b8359e700 1 --2- 172.21.15.8:0/1930858345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f77d0 0x7f7b840f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.178+0000 7f7b8359e700 1 --2- 172.21.15.8:0/1930858345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f6530 0x7f7b840f6950 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.179+0000 7f7b8359e700 1 -- 172.21.15.8:0/1930858345 >> 172.21.15.8:0/1930858345 conn(0x7f7b840f1cd0 msgr2=0x7f7b840f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:07.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.179+0000 7f7b8359e700 1 -- 172.21.15.8:0/1930858345 shutdown_connections 2023-10-18T21:26:07.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.179+0000 7f7b8359e700 1 -- 172.21.15.8:0/1930858345 wait complete. 2023-10-18T21:26:07.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.180+0000 7f7b8359e700 1 Processor -- start 2023-10-18T21:26:07.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.180+0000 7f7b8359e700 1 -- start start 2023-10-18T21:26:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.180+0000 7f7b8359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b8406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b8359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b8359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8406a380 con 0x7f7b840f77d0 2023-10-18T21:26:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b8359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8406a4c0 con 0x7f7b840f6530 2023-10-18T21:26:07.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b7bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:07.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b7bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60780/0 (socket says 172.21.15.8:60780) 2023-10-18T21:26:07.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b7bfff700 1 -- 172.21.15.8:0/2809379160 learned_addr learned my addr 172.21.15.8:0/2809379160 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:07.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b8259c700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b8406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:07.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b7bfff700 1 -- 172.21.15.8:0/2809379160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 msgr2=0x7f7b8406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:07.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b7bfff700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b8406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b7bfff700 1 -- 172.21.15.8:0/2809379160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74005040 con 0x7f7b840f77d0 2023-10-18T21:26:07.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.181+0000 7f7b8259c700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b8406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:26:07.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.182+0000 7f7b7bfff700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84069e20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f7b6c0026d0 tx=0x7f7b6c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:07.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.182+0000 7f7b7affd700 1 -- 172.21.15.8:0/2809379160 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b6c009320 con 0x7f7b840f77d0 2023-10-18T21:26:07.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.182+0000 7f7b7affd700 1 -- 172.21.15.8:0/2809379160 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7b6c00f040 con 0x7f7b840f77d0 2023-10-18T21:26:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.182+0000 7f7b8359e700 1 -- 172.21.15.8:0/2809379160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8406a7a0 con 0x7f7b840f77d0 2023-10-18T21:26:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.182+0000 7f7b7affd700 1 -- 172.21.15.8:0/2809379160 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b6c0148a0 con 0x7f7b840f77d0 2023-10-18T21:26:07.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.182+0000 7f7b8359e700 1 -- 172.21.15.8:0/2809379160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8410edb0 con 0x7f7b840f77d0 2023-10-18T21:26:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.183+0000 7f7b8359e700 1 -- 172.21.15.8:0/2809379160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b84045ad0 con 0x7f7b840f77d0 2023-10-18T21:26:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.184+0000 7f7b7affd700 1 -- 172.21.15.8:0/2809379160 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7b6c009480 con 0x7f7b840f77d0 2023-10-18T21:26:07.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.185+0000 7f7b7affd700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 0x7f7b70063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.185+0000 7f7b7affd700 1 -- 172.21.15.8:0/2809379160 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7b6c07cf60 con 0x7f7b840f77d0 2023-10-18T21:26:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.185+0000 7f7b8259c700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 0x7f7b70063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.186+0000 7f7b8259c700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 0x7f7b70063430 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f7b74009d60 tx=0x7f7b74009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:07.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.189+0000 7f7b7affd700 1 -- 172.21.15.8:0/2809379160 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7b6c04cb90 con 0x7f7b840f77d0 2023-10-18T21:26:07.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.413+0000 7f7b8359e700 1 -- 172.21.15.8:0/2809379160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b840fed60 con 0x7f7b840f77d0 2023-10-18T21:26:07.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.414+0000 7f7b7affd700 1 -- 172.21.15.8:0/2809379160 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f7b6c0501b0 con 0x7f7b840f77d0 2023-10-18T21:26:07.416 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:26:07.416 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:26:07.416 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:26:07.416 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:26:07.417 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:26:07.417 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:26:07.417 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:26:07.417 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:26:07.418 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:26:07.418 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:26:07.418 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:26:07.418 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:26:07.418 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:26:07.419 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:26:07.419 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:26:07.419 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:26:07.419 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:26:07.420 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:26:07.420 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:26:07.420 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:26:07.420 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:26:07.420 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:26:07.421 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:26:07.421 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:26:07.421 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:26:07.421 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:26:07.421 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:26:07.422 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:26:07.422 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:26:07.422 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:26:07.422 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:26:07.423 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:26:07.423 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:26:07.423 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:26:07.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 -- 172.21.15.8:0/2809379160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 msgr2=0x7f7b70063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:07.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 0x7f7b70063430 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f7b74009d60 tx=0x7f7b74009b30).stop 2023-10-18T21:26:07.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 -- 172.21.15.8:0/2809379160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 msgr2=0x7f7b84069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:07.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84069e20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f7b6c0026d0 tx=0x7f7b6c009de0).stop 2023-10-18T21:26:07.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 -- 172.21.15.8:0/2809379160 shutdown_connections 2023-10-18T21:26:07.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 0x7f7b70063430 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b8406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 --2- 172.21.15.8:0/2809379160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84069e20 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 -- 172.21.15.8:0/2809379160 >> 172.21.15.8:0/2809379160 conn(0x7f7b840f1cd0 msgr2=0x7f7b840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:07.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 -- 172.21.15.8:0/2809379160 shutdown_connections 2023-10-18T21:26:07.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.416+0000 7f7b8359e700 1 -- 172.21.15.8:0/2809379160 wait complete. 2023-10-18T21:26:07.426 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:26:07.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.556+0000 7f4c11ace700 1 -- 172.21.15.8:0/2423269369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c06b9c0 msgr2=0x7f4c0c069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:07.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.556+0000 7f4c11ace700 1 --2- 172.21.15.8:0/2423269369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c06b9c0 0x7f4c0c069ec0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f4c00004660 tx=0x7f4c00009b30).stop 2023-10-18T21:26:07.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.556+0000 7f4c11ace700 1 -- 172.21.15.8:0/2423269369 shutdown_connections 2023-10-18T21:26:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.556+0000 7f4c11ace700 1 --2- 172.21.15.8:0/2423269369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c0c06a3b0 0x7f4c0c06a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.556+0000 7f4c11ace700 1 --2- 172.21.15.8:0/2423269369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c06b9c0 0x7f4c0c069ec0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.556+0000 7f4c11ace700 1 -- 172.21.15.8:0/2423269369 >> 172.21.15.8:0/2423269369 conn(0x7f4c0c0f1c90 msgr2=0x7f4c0c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.556+0000 7f4c11ace700 1 -- 172.21.15.8:0/2423269369 shutdown_connections 2023-10-18T21:26:07.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.556+0000 7f4c11ace700 1 -- 172.21.15.8:0/2423269369 wait complete. 2023-10-18T21:26:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.557+0000 7f4c11ace700 1 Processor -- start 2023-10-18T21:26:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.557+0000 7f4c11ace700 1 -- start start 2023-10-18T21:26:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c11ace700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c0c06a3b0 0x7f4c0c108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c11ace700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c06b9c0 0x7f4c0c1094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c11ace700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c109a50 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c11ace700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c109b90 con 0x7f4c0c06a3b0 2023-10-18T21:26:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c0bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c06b9c0 0x7f4c0c1094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c0bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c06b9c0 0x7f4c0c1094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60806/0 (socket says 172.21.15.8:60806) 2023-10-18T21:26:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c0bfff700 1 -- 172.21.15.8:0/84530570 learned_addr learned my addr 172.21.15.8:0/84530570 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c10acc700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c0c06a3b0 0x7f4c0c108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c0bfff700 1 -- 172.21.15.8:0/84530570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c0c06a3b0 msgr2=0x7f4c0c108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c0bfff700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c0c06a3b0 0x7f4c0c108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.558+0000 7f4c0bfff700 1 -- 172.21.15.8:0/84530570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00005040 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.559+0000 7f4c0bfff700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c06b9c0 0x7f4c0c1094a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f4bf80026d0 tx=0x7f4bf8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.559+0000 7f4c097fa700 1 -- 172.21.15.8:0/84530570 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf80079c0 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.559+0000 7f4c097fa700 1 -- 172.21.15.8:0/84530570 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4bf800f040 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.559+0000 7f4c11ace700 1 -- 172.21.15.8:0/84530570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c10a530 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.559+0000 7f4c097fa700 1 -- 172.21.15.8:0/84530570 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf8014980 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.559+0000 7f4c11ace700 1 -- 172.21.15.8:0/84530570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c10aaf0 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.560+0000 7f4c11ace700 1 -- 172.21.15.8:0/84530570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0c045ad0 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.561+0000 7f4c097fa700 1 -- 172.21.15.8:0/84530570 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4bf80090d0 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.562+0000 7f4c097fa700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4bfc060f70 0x7f4bfc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.562+0000 7f4c097fa700 1 -- 172.21.15.8:0/84530570 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4bf807c980 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.562+0000 7f4c10acc700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4bfc060f70 0x7f4bfc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.563+0000 7f4c10acc700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4bfc060f70 0x7f4bfc063430 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f4c00004630 tx=0x7f4c00009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.566+0000 7f4c097fa700 1 -- 172.21.15.8:0/84530570 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4bf8050010 con 0x7f4c0c06b9c0 2023-10-18T21:26:07.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.765+0000 7f4c11ace700 1 -- 172.21.15.8:0/84530570 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c0c10ad70 con 0x7f4bfc060f70 2023-10-18T21:26:07.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.766+0000 7f4c097fa700 1 -- 172.21.15.8:0/84530570 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4c0c10ad70 con 0x7f4bfc060f70 2023-10-18T21:26:07.768 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:26:07.768 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:26:07.768 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:26:07.768 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:26:07.769 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:26:07.769 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:26:07.769 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:26:07.769 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:26:07.769 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:26:07.770 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:26:07.770 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:26:07.770 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:26:07.770 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:26:07.770 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:26:07.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 -- 172.21.15.8:0/84530570 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4bfc060f70 msgr2=0x7f4bfc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:07.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4bfc060f70 0x7f4bfc063430 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f4c00004630 tx=0x7f4c00009b30).stop 2023-10-18T21:26:07.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 -- 172.21.15.8:0/84530570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c06b9c0 msgr2=0x7f4c0c1094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:07.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c06b9c0 0x7f4c0c1094a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f4bf80026d0 tx=0x7f4bf8009de0).stop 2023-10-18T21:26:07.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 -- 172.21.15.8:0/84530570 shutdown_connections 2023-10-18T21:26:07.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4bfc060f70 0x7f4bfc063430 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c0c06a3b0 0x7f4c0c108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 --2- 172.21.15.8:0/84530570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c06b9c0 0x7f4c0c1094a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:07.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 -- 172.21.15.8:0/84530570 >> 172.21.15.8:0/84530570 conn(0x7f4c0c0f1c90 msgr2=0x7f4c0c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:07.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 -- 172.21.15.8:0/84530570 shutdown_connections 2023-10-18T21:26:07.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:07.768+0000 7f4c11ace700 1 -- 172.21.15.8:0/84530570 wait complete. 2023-10-18T21:26:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:05.930550+0000 mgr.smithi008.flmjzp (mgr.14640) 1635 : audit [DBG] from='client.35488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:06.285340+0000 mgr.smithi008.flmjzp (mgr.14640) 1636 : audit [DBG] from='client.35492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:06.625072+0000 mgr.smithi008.flmjzp (mgr.14640) 1637 : audit [DBG] from='client.35496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:06.776693+0000 mgr.smithi008.flmjzp (mgr.14640) 1638 : cluster [DBG] pgmap v1135: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:08.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:07.040958+0000 mon.smithi008 (mon.0) 2098 : audit [DBG] from='client.? 172.21.15.8:0/3156116723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:08.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:07.415249+0000 mon.smithi008 (mon.0) 2099 : audit [DBG] from='client.? 172.21.15.8:0/2809379160' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:26:08.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:05.930550+0000 mgr.smithi008.flmjzp (mgr.14640) 1635 : audit [DBG] from='client.35488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:08.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:06.285340+0000 mgr.smithi008.flmjzp (mgr.14640) 1636 : audit [DBG] from='client.35492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:06.625072+0000 mgr.smithi008.flmjzp (mgr.14640) 1637 : audit [DBG] from='client.35496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:06.776693+0000 mgr.smithi008.flmjzp (mgr.14640) 1638 : cluster [DBG] pgmap v1135: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:07.040958+0000 mon.smithi008 (mon.0) 2098 : audit [DBG] from='client.? 172.21.15.8:0/3156116723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:07.415249+0000 mon.smithi008 (mon.0) 2099 : audit [DBG] from='client.? 172.21.15.8:0/2809379160' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:26:09.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:07.767230+0000 mgr.smithi008.flmjzp (mgr.14640) 1639 : audit [DBG] from='client.35508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:09.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:08.803515+0000 mon.smithi008 (mon.0) 2100 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:09.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:08.805712+0000 mon.smithi008 (mon.0) 2101 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:26:09.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:08.806773+0000 mon.smithi008 (mon.0) 2102 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:26:09.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:08.813474+0000 mon.smithi008 (mon.0) 2103 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:26:09.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:08.821428+0000 mon.smithi008 (mon.0) 2104 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:09.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:08.824901+0000 mon.smithi008 (mon.0) 2105 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:09.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:08.826760+0000 mon.smithi008 (mon.0) 2106 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:09.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:08.828548+0000 mon.smithi008 (mon.0) 2107 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:09.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:08.831160+0000 mon.smithi008 (mon.0) 2108 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:09.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:07.767230+0000 mgr.smithi008.flmjzp (mgr.14640) 1639 : audit [DBG] from='client.35508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:09.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:08.803515+0000 mon.smithi008 (mon.0) 2100 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:08.805712+0000 mon.smithi008 (mon.0) 2101 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:26:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:08.806773+0000 mon.smithi008 (mon.0) 2102 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:26:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:08.813474+0000 mon.smithi008 (mon.0) 2103 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:26:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:08.821428+0000 mon.smithi008 (mon.0) 2104 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:08.824901+0000 mon.smithi008 (mon.0) 2105 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:09.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:08.826760+0000 mon.smithi008 (mon.0) 2106 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:09.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:08.828548+0000 mon.smithi008 (mon.0) 2107 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:09.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:08.831160+0000 mon.smithi008 (mon.0) 2108 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:10.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:08.777199+0000 mgr.smithi008.flmjzp (mgr.14640) 1640 : cluster [DBG] pgmap v1136: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:10.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:26:08.807711+0000 mgr.smithi008.flmjzp (mgr.14640) 1641 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:10.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:08.808288+0000 mgr.smithi008.flmjzp (mgr.14640) 1642 : cluster [DBG] pgmap v1137: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:10.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:08.808626+0000 mgr.smithi008.flmjzp (mgr.14640) 1643 : cluster [DBG] pgmap v1138: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:10.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:26:08.833248+0000 mgr.smithi008.flmjzp (mgr.14640) 1644 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:10.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:08.777199+0000 mgr.smithi008.flmjzp (mgr.14640) 1640 : cluster [DBG] pgmap v1136: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:26:08.807711+0000 mgr.smithi008.flmjzp (mgr.14640) 1641 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:08.808288+0000 mgr.smithi008.flmjzp (mgr.14640) 1642 : cluster [DBG] pgmap v1137: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:08.808626+0000 mgr.smithi008.flmjzp (mgr.14640) 1643 : cluster [DBG] pgmap v1138: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:26:08.833248+0000 mgr.smithi008.flmjzp (mgr.14640) 1644 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:10.809158+0000 mgr.smithi008.flmjzp (mgr.14640) 1645 : cluster [DBG] pgmap v1139: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:10.809158+0000 mgr.smithi008.flmjzp (mgr.14640) 1645 : cluster [DBG] pgmap v1139: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:12.809885+0000 mgr.smithi008.flmjzp (mgr.14640) 1646 : cluster [DBG] pgmap v1140: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:14.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:12.809885+0000 mgr.smithi008.flmjzp (mgr.14640) 1646 : cluster [DBG] pgmap v1140: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:14.810508+0000 mgr.smithi008.flmjzp (mgr.14640) 1647 : cluster [DBG] pgmap v1141: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:16.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:14.810508+0000 mgr.smithi008.flmjzp (mgr.14640) 1647 : cluster [DBG] pgmap v1141: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:17.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:16.811040+0000 mgr.smithi008.flmjzp (mgr.14640) 1648 : cluster [DBG] pgmap v1142: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:16.811040+0000 mgr.smithi008.flmjzp (mgr.14640) 1648 : cluster [DBG] pgmap v1142: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:19.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:18.811751+0000 mgr.smithi008.flmjzp (mgr.14640) 1649 : cluster [DBG] pgmap v1143: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:19.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:18.844011+0000 mon.smithi008 (mon.0) 2109 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:19.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:18.811751+0000 mgr.smithi008.flmjzp (mgr.14640) 1649 : cluster [DBG] pgmap v1143: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:19.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:18.844011+0000 mon.smithi008 (mon.0) 2109 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:20.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:19.405788+0000 mon.smithi008 (mon.0) 2110 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:26:20.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:19.406614+0000 mon.smithi008 (mon.0) 2111 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:26:20.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:26:19.407290+0000 mgr.smithi008.flmjzp (mgr.14640) 1650 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:20.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:19.407788+0000 mgr.smithi008.flmjzp (mgr.14640) 1651 : cluster [DBG] pgmap v1144: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:20.154 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:19.408045+0000 mgr.smithi008.flmjzp (mgr.14640) 1652 : cluster [DBG] pgmap v1145: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:20.154 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:19.411776+0000 mon.smithi008 (mon.0) 2112 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:26:20.154 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:19.417783+0000 mon.smithi008 (mon.0) 2113 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:20.154 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:19.420556+0000 mon.smithi008 (mon.0) 2114 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:20.154 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:19.422051+0000 mon.smithi008 (mon.0) 2115 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:20.155 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:19.423443+0000 mon.smithi008 (mon.0) 2116 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:20.155 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:19.425434+0000 mon.smithi008 (mon.0) 2117 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:20.155 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:26:19.427130+0000 mgr.smithi008.flmjzp (mgr.14640) 1653 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:20.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:19.405788+0000 mon.smithi008 (mon.0) 2110 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:26:20.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:19.406614+0000 mon.smithi008 (mon.0) 2111 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:26:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:26:19.407290+0000 mgr.smithi008.flmjzp (mgr.14640) 1650 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:19.407788+0000 mgr.smithi008.flmjzp (mgr.14640) 1651 : cluster [DBG] pgmap v1144: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:19.408045+0000 mgr.smithi008.flmjzp (mgr.14640) 1652 : cluster [DBG] pgmap v1145: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:19.411776+0000 mon.smithi008 (mon.0) 2112 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:26:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:19.417783+0000 mon.smithi008 (mon.0) 2113 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:19.420556+0000 mon.smithi008 (mon.0) 2114 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:19.422051+0000 mon.smithi008 (mon.0) 2115 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:19.423443+0000 mon.smithi008 (mon.0) 2116 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:19.425434+0000 mon.smithi008 (mon.0) 2117 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:20.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:26:19.427130+0000 mgr.smithi008.flmjzp (mgr.14640) 1653 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:21.408865+0000 mgr.smithi008.flmjzp (mgr.14640) 1654 : cluster [DBG] pgmap v1146: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:22.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:21.408865+0000 mgr.smithi008.flmjzp (mgr.14640) 1654 : cluster [DBG] pgmap v1146: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:23.409426+0000 mgr.smithi008.flmjzp (mgr.14640) 1655 : cluster [DBG] pgmap v1147: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:24.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:23.409426+0000 mgr.smithi008.flmjzp (mgr.14640) 1655 : cluster [DBG] pgmap v1147: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:25.409972+0000 mgr.smithi008.flmjzp (mgr.14640) 1656 : cluster [DBG] pgmap v1148: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:26.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:25.409972+0000 mgr.smithi008.flmjzp (mgr.14640) 1656 : cluster [DBG] pgmap v1148: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:27.410640+0000 mgr.smithi008.flmjzp (mgr.14640) 1657 : cluster [DBG] pgmap v1149: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:28.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:27.410640+0000 mgr.smithi008.flmjzp (mgr.14640) 1657 : cluster [DBG] pgmap v1149: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:29.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:29.437730+0000 mon.smithi008 (mon.0) 2118 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:29.439920+0000 mon.smithi008 (mon.0) 2119 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:26:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:29.441033+0000 mon.smithi008 (mon.0) 2120 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:26:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:29.448042+0000 mon.smithi008 (mon.0) 2121 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:26:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:29.456090+0000 mon.smithi008 (mon.0) 2122 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:29.459594+0000 mon.smithi008 (mon.0) 2123 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:29.461582+0000 mon.smithi008 (mon.0) 2124 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:29.463529+0000 mon.smithi008 (mon.0) 2125 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:29.437730+0000 mon.smithi008 (mon.0) 2118 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:29.439920+0000 mon.smithi008 (mon.0) 2119 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:26:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:29.441033+0000 mon.smithi008 (mon.0) 2120 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:26:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:29.448042+0000 mon.smithi008 (mon.0) 2121 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:26:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:29.456090+0000 mon.smithi008 (mon.0) 2122 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:29.459594+0000 mon.smithi008 (mon.0) 2123 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:29.461582+0000 mon.smithi008 (mon.0) 2124 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:29.463529+0000 mon.smithi008 (mon.0) 2125 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:30.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:29.411199+0000 mgr.smithi008.flmjzp (mgr.14640) 1658 : cluster [DBG] pgmap v1150: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:26:29.441970+0000 mgr.smithi008.flmjzp (mgr.14640) 1659 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:29.442592+0000 mgr.smithi008.flmjzp (mgr.14640) 1660 : cluster [DBG] pgmap v1151: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:29.442834+0000 mgr.smithi008.flmjzp (mgr.14640) 1661 : cluster [DBG] pgmap v1152: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:29.466379+0000 mon.smithi008 (mon.0) 2126 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:26:29.468718+0000 mgr.smithi008.flmjzp (mgr.14640) 1662 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:29.411199+0000 mgr.smithi008.flmjzp (mgr.14640) 1658 : cluster [DBG] pgmap v1150: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:26:29.441970+0000 mgr.smithi008.flmjzp (mgr.14640) 1659 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:29.442592+0000 mgr.smithi008.flmjzp (mgr.14640) 1660 : cluster [DBG] pgmap v1151: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:29.442834+0000 mgr.smithi008.flmjzp (mgr.14640) 1661 : cluster [DBG] pgmap v1152: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:29.466379+0000 mon.smithi008 (mon.0) 2126 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:30.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:26:29.468718+0000 mgr.smithi008.flmjzp (mgr.14640) 1662 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:31.443276+0000 mgr.smithi008.flmjzp (mgr.14640) 1663 : cluster [DBG] pgmap v1153: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:32.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:31.443276+0000 mgr.smithi008.flmjzp (mgr.14640) 1663 : cluster [DBG] pgmap v1153: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:33.443853+0000 mgr.smithi008.flmjzp (mgr.14640) 1664 : cluster [DBG] pgmap v1154: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:34.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:33.443853+0000 mgr.smithi008.flmjzp (mgr.14640) 1664 : cluster [DBG] pgmap v1154: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:35.444382+0000 mgr.smithi008.flmjzp (mgr.14640) 1665 : cluster [DBG] pgmap v1155: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:36.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:35.444382+0000 mgr.smithi008.flmjzp (mgr.14640) 1665 : cluster [DBG] pgmap v1155: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:37.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.923+0000 7fb849373700 1 -- 172.21.15.8:0/3416137074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8440f6530 msgr2=0x7fb8440f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:37.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.923+0000 7fb849373700 1 --2- 172.21.15.8:0/3416137074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8440f6530 0x7fb8440f6950 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb834004660 tx=0x7fb834009b30).stop 2023-10-18T21:26:37.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.923+0000 7fb849373700 1 -- 172.21.15.8:0/3416137074 shutdown_connections 2023-10-18T21:26:37.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.923+0000 7fb849373700 1 --2- 172.21.15.8:0/3416137074 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8440f77d0 0x7fb8440f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:37.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.923+0000 7fb849373700 1 --2- 172.21.15.8:0/3416137074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8440f6530 0x7fb8440f6950 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:37.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.923+0000 7fb849373700 1 -- 172.21.15.8:0/3416137074 >> 172.21.15.8:0/3416137074 conn(0x7fb8440f1c90 msgr2=0x7fb8440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:37.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.923+0000 7fb849373700 1 -- 172.21.15.8:0/3416137074 shutdown_connections 2023-10-18T21:26:37.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.924+0000 7fb849373700 1 -- 172.21.15.8:0/3416137074 wait complete. 2023-10-18T21:26:37.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.924+0000 7fb849373700 1 Processor -- start 2023-10-18T21:26:37.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.925+0000 7fb849373700 1 -- start start 2023-10-18T21:26:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.925+0000 7fb849373700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8440f6530 0x7fb844108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.925+0000 7fb849373700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8440f77d0 0x7fb844109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.925+0000 7fb849373700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb844109a00 con 0x7fb8440f6530 2023-10-18T21:26:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.925+0000 7fb849373700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb844109b40 con 0x7fb8440f77d0 2023-10-18T21:26:37.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.925+0000 7fb843fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8440f6530 0x7fb844108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:37.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.925+0000 7fb843fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8440f6530 0x7fb844108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51810/0 (socket says 172.21.15.8:51810) 2023-10-18T21:26:37.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.925+0000 7fb843fff700 1 -- 172.21.15.8:0/2518849746 learned_addr learned my addr 172.21.15.8:0/2518849746 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:37.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.925+0000 7fb8437fe700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8440f77d0 0x7fb844109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:37.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.926+0000 7fb843fff700 1 -- 172.21.15.8:0/2518849746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8440f77d0 msgr2=0x7fb844109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.926+0000 7fb843fff700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8440f77d0 0x7fb844109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.926+0000 7fb843fff700 1 -- 172.21.15.8:0/2518849746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb834005040 con 0x7fb8440f6530 2023-10-18T21:26:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.926+0000 7fb843fff700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8440f6530 0x7fb844108f60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fb834009870 tx=0x7fb83400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.926+0000 7fb840ff9700 1 -- 172.21.15.8:0/2518849746 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb834019070 con 0x7fb8440f6530 2023-10-18T21:26:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.926+0000 7fb840ff9700 1 -- 172.21.15.8:0/2518849746 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb834013380 con 0x7fb8440f6530 2023-10-18T21:26:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.926+0000 7fb849373700 1 -- 172.21.15.8:0/2518849746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84410a480 con 0x7fb8440f6530 2023-10-18T21:26:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.926+0000 7fb840ff9700 1 -- 172.21.15.8:0/2518849746 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb83401edf0 con 0x7fb8440f6530 2023-10-18T21:26:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.926+0000 7fb849373700 1 -- 172.21.15.8:0/2518849746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84410a960 con 0x7fb8440f6530 2023-10-18T21:26:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.927+0000 7fb849373700 1 -- 172.21.15.8:0/2518849746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb844045ad0 con 0x7fb8440f6530 2023-10-18T21:26:37.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.928+0000 7fb840ff9700 1 -- 172.21.15.8:0/2518849746 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb83401e420 con 0x7fb8440f6530 2023-10-18T21:26:37.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.929+0000 7fb840ff9700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb82c060f70 0x7fb82c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:37.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.929+0000 7fb840ff9700 1 -- 172.21.15.8:0/2518849746 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb83407dd00 con 0x7fb8440f6530 2023-10-18T21:26:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.929+0000 7fb8437fe700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb82c060f70 0x7fb82c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.930+0000 7fb8437fe700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb82c060f70 0x7fb82c063430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fb838009fd0 tx=0x7fb83800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:37.934+0000 7fb840ff9700 1 -- 172.21.15.8:0/2518849746 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb834051360 con 0x7fb8440f6530 2023-10-18T21:26:38.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.133+0000 7fb849373700 1 -- 172.21.15.8:0/2518849746 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8440008d0 con 0x7fb82c060f70 2023-10-18T21:26:38.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.135+0000 7fb840ff9700 1 -- 172.21.15.8:0/2518849746 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb8440008d0 con 0x7fb82c060f70 2023-10-18T21:26:38.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 -- 172.21.15.8:0/2518849746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb82c060f70 msgr2=0x7fb82c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb82c060f70 0x7fb82c063430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fb838009fd0 tx=0x7fb83800b040).stop 2023-10-18T21:26:38.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 -- 172.21.15.8:0/2518849746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8440f6530 msgr2=0x7fb844108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8440f6530 0x7fb844108f60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fb834009870 tx=0x7fb83400b040).stop 2023-10-18T21:26:38.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 -- 172.21.15.8:0/2518849746 shutdown_connections 2023-10-18T21:26:38.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb82c060f70 0x7fb82c063430 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8440f6530 0x7fb844108f60 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 --2- 172.21.15.8:0/2518849746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8440f77d0 0x7fb844109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 -- 172.21.15.8:0/2518849746 >> 172.21.15.8:0/2518849746 conn(0x7fb8440f1c90 msgr2=0x7fb84406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:38.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 -- 172.21.15.8:0/2518849746 shutdown_connections 2023-10-18T21:26:38.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.137+0000 7fb849373700 1 -- 172.21.15.8:0/2518849746 wait complete. 2023-10-18T21:26:38.153 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:26:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.275+0000 7fedbb59e700 1 -- 172.21.15.8:0/2205506158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedbc0f77d0 msgr2=0x7fedbc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.275+0000 7fedbb59e700 1 --2- 172.21.15.8:0/2205506158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedbc0f77d0 0x7fedbc0f7c30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fedb0004660 tx=0x7fedb0009b30).stop 2023-10-18T21:26:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.275+0000 7fedbb59e700 1 -- 172.21.15.8:0/2205506158 shutdown_connections 2023-10-18T21:26:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.275+0000 7fedbb59e700 1 --2- 172.21.15.8:0/2205506158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedbc0f77d0 0x7fedbc0f7c30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.275+0000 7fedbb59e700 1 --2- 172.21.15.8:0/2205506158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0f6530 0x7fedbc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.275+0000 7fedbb59e700 1 -- 172.21.15.8:0/2205506158 >> 172.21.15.8:0/2205506158 conn(0x7fedbc0f1c90 msgr2=0x7fedbc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:38.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.275+0000 7fedbb59e700 1 -- 172.21.15.8:0/2205506158 shutdown_connections 2023-10-18T21:26:38.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.275+0000 7fedbb59e700 1 -- 172.21.15.8:0/2205506158 wait complete. 2023-10-18T21:26:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.277+0000 7fedbb59e700 1 Processor -- start 2023-10-18T21:26:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.277+0000 7fedbb59e700 1 -- start start 2023-10-18T21:26:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.277+0000 7fedbb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0f6530 0x7fedbc106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.277+0000 7fedbb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedbc0f77d0 0x7fedbc107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.277+0000 7fedbb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc107850 con 0x7fedbc0f77d0 2023-10-18T21:26:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.277+0000 7fedbb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc108060 con 0x7fedbc0f6530 2023-10-18T21:26:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.278+0000 7fedb9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedbc0f77d0 0x7fedbc107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.278+0000 7fedb9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedbc0f77d0 0x7fedbc107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51824/0 (socket says 172.21.15.8:51824) 2023-10-18T21:26:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.278+0000 7fedb9d9b700 1 -- 172.21.15.8:0/2773152232 learned_addr learned my addr 172.21.15.8:0/2773152232 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.278+0000 7fedba59c700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0f6530 0x7fedbc106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.278+0000 7fedb9d9b700 1 -- 172.21.15.8:0/2773152232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0f6530 msgr2=0x7fedbc106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.278+0000 7fedb9d9b700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0f6530 0x7fedbc106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.278+0000 7fedb9d9b700 1 -- 172.21.15.8:0/2773152232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb0005040 con 0x7fedbc0f77d0 2023-10-18T21:26:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.278+0000 7fedb9d9b700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedbc0f77d0 0x7fedbc107250 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fedb0004d80 tx=0x7fedb000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.279+0000 7fedaaffd700 1 -- 172.21.15.8:0/2773152232 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedb0019070 con 0x7fedbc0f77d0 2023-10-18T21:26:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.279+0000 7fedaaffd700 1 -- 172.21.15.8:0/2773152232 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fedb001e420 con 0x7fedbc0f77d0 2023-10-18T21:26:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.279+0000 7fedaaffd700 1 -- 172.21.15.8:0/2773152232 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedb0014660 con 0x7fedbc0f77d0 2023-10-18T21:26:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.279+0000 7fedbb59e700 1 -- 172.21.15.8:0/2773152232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedbc108280 con 0x7fedbc0f77d0 2023-10-18T21:26:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.279+0000 7fedbb59e700 1 -- 172.21.15.8:0/2773152232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedbc108760 con 0x7fedbc0f77d0 2023-10-18T21:26:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.280+0000 7fedbb59e700 1 -- 172.21.15.8:0/2773152232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedbc059100 con 0x7fedbc0f77d0 2023-10-18T21:26:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.281+0000 7fedaaffd700 1 -- 172.21.15.8:0/2773152232 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fedb001e590 con 0x7fedbc0f77d0 2023-10-18T21:26:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.281+0000 7fedaaffd700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feda4060f70 0x7feda4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:38.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.281+0000 7fedaaffd700 1 -- 172.21.15.8:0/2773152232 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fedb007dd80 con 0x7fedbc0f77d0 2023-10-18T21:26:38.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.282+0000 7fedba59c700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feda4060f70 0x7feda4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:38.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.282+0000 7fedba59c700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feda4060f70 0x7feda4063430 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fedbc106ad0 tx=0x7fedac00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:38.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.286+0000 7fedaaffd700 1 -- 172.21.15.8:0/2773152232 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fedb004d9b0 con 0x7fedbc0f77d0 2023-10-18T21:26:38.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.485+0000 7fedbb59e700 1 -- 172.21.15.8:0/2773152232 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedbc0fee50 con 0x7feda4060f70 2023-10-18T21:26:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.487+0000 7fedaaffd700 1 -- 172.21.15.8:0/2773152232 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fedbc0fee50 con 0x7feda4060f70 2023-10-18T21:26:38.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 -- 172.21.15.8:0/2773152232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feda4060f70 msgr2=0x7feda4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feda4060f70 0x7feda4063430 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fedbc106ad0 tx=0x7fedac00b040).stop 2023-10-18T21:26:38.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 -- 172.21.15.8:0/2773152232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedbc0f77d0 msgr2=0x7fedbc107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedbc0f77d0 0x7fedbc107250 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fedb0004d80 tx=0x7fedb000b040).stop 2023-10-18T21:26:38.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 -- 172.21.15.8:0/2773152232 shutdown_connections 2023-10-18T21:26:38.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feda4060f70 0x7feda4063430 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0f6530 0x7fedbc106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 --2- 172.21.15.8:0/2773152232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedbc0f77d0 0x7fedbc107250 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 -- 172.21.15.8:0/2773152232 >> 172.21.15.8:0/2773152232 conn(0x7fedbc0f1c90 msgr2=0x7fedbc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:38.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 -- 172.21.15.8:0/2773152232 shutdown_connections 2023-10-18T21:26:38.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.489+0000 7fedbb59e700 1 -- 172.21.15.8:0/2773152232 wait complete. 2023-10-18T21:26:38.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.625+0000 7fc6393fa700 1 -- 172.21.15.8:0/1803464161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6340f77d0 msgr2=0x7fc6340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.625+0000 7fc6393fa700 1 --2- 172.21.15.8:0/1803464161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6340f77d0 0x7fc6340f7c30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fc628004660 tx=0x7fc628009b30).stop 2023-10-18T21:26:38.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.625+0000 7fc6393fa700 1 -- 172.21.15.8:0/1803464161 shutdown_connections 2023-10-18T21:26:38.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.625+0000 7fc6393fa700 1 --2- 172.21.15.8:0/1803464161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6340f77d0 0x7fc6340f7c30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.625+0000 7fc6393fa700 1 --2- 172.21.15.8:0/1803464161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6340f6530 0x7fc6340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.625+0000 7fc6393fa700 1 -- 172.21.15.8:0/1803464161 >> 172.21.15.8:0/1803464161 conn(0x7fc6340f1c90 msgr2=0x7fc6340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:38.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.625+0000 7fc6393fa700 1 -- 172.21.15.8:0/1803464161 shutdown_connections 2023-10-18T21:26:38.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.626+0000 7fc6393fa700 1 -- 172.21.15.8:0/1803464161 wait complete. 2023-10-18T21:26:38.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.626+0000 7fc6393fa700 1 Processor -- start 2023-10-18T21:26:38.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.626+0000 7fc6393fa700 1 -- start start 2023-10-18T21:26:38.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.627+0000 7fc6393fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6340f6530 0x7fc634108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:38.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.627+0000 7fc6393fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6340f77d0 0x7fc634109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:38.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.627+0000 7fc6393fa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc634109a20 con 0x7fc6340f77d0 2023-10-18T21:26:38.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.627+0000 7fc6393fa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc634109b60 con 0x7fc6340f6530 2023-10-18T21:26:38.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.627+0000 7fc6337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6340f77d0 0x7fc634109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:38.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.627+0000 7fc6337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6340f77d0 0x7fc634109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51836/0 (socket says 172.21.15.8:51836) 2023-10-18T21:26:38.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.627+0000 7fc6337fe700 1 -- 172.21.15.8:0/4141185218 learned_addr learned my addr 172.21.15.8:0/4141185218 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:38.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.627+0000 7fc633fff700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6340f6530 0x7fc634108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:38.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.628+0000 7fc6337fe700 1 -- 172.21.15.8:0/4141185218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6340f6530 msgr2=0x7fc634108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.628+0000 7fc6337fe700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6340f6530 0x7fc634108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.628+0000 7fc6337fe700 1 -- 172.21.15.8:0/4141185218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628005040 con 0x7fc6340f77d0 2023-10-18T21:26:38.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.628+0000 7fc6337fe700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6340f77d0 0x7fc634109470 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fc628009f50 tx=0x7fc628009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:38.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.628+0000 7fc630ff9700 1 -- 172.21.15.8:0/4141185218 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc628018070 con 0x7fc6340f77d0 2023-10-18T21:26:38.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.628+0000 7fc630ff9700 1 -- 172.21.15.8:0/4141185218 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc628009630 con 0x7fc6340f77d0 2023-10-18T21:26:38.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.628+0000 7fc6393fa700 1 -- 172.21.15.8:0/4141185218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63410a4a0 con 0x7fc6340f77d0 2023-10-18T21:26:38.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.628+0000 7fc630ff9700 1 -- 172.21.15.8:0/4141185218 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc62801c3c0 con 0x7fc6340f77d0 2023-10-18T21:26:38.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.628+0000 7fc6393fa700 1 -- 172.21.15.8:0/4141185218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63410aa00 con 0x7fc6340f77d0 2023-10-18T21:26:38.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.629+0000 7fc6393fa700 1 -- 172.21.15.8:0/4141185218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc634045ad0 con 0x7fc6340f77d0 2023-10-18T21:26:38.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.630+0000 7fc630ff9700 1 -- 172.21.15.8:0/4141185218 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc62801d420 con 0x7fc6340f77d0 2023-10-18T21:26:38.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.631+0000 7fc630ff9700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc61c060f70 0x7fc61c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:38.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.631+0000 7fc630ff9700 1 -- 172.21.15.8:0/4141185218 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc62807e540 con 0x7fc6340f77d0 2023-10-18T21:26:38.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.631+0000 7fc633fff700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc61c060f70 0x7fc61c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:38.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.632+0000 7fc633fff700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc61c060f70 0x7fc61c063430 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fc6340f7630 tx=0x7fc62400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:38.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.635+0000 7fc630ff9700 1 -- 172.21.15.8:0/4141185218 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc628051ba0 con 0x7fc6340f77d0 2023-10-18T21:26:38.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:37.445018+0000 mgr.smithi008.flmjzp (mgr.14640) 1666 : cluster [DBG] pgmap v1156: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:38.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.829+0000 7fc6393fa700 1 -- 172.21.15.8:0/4141185218 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6340fee00 con 0x7fc61c060f70 2023-10-18T21:26:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.838+0000 7fc630ff9700 1 -- 172.21.15.8:0/4141185218 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc6340fee00 con 0x7fc61c060f70 2023-10-18T21:26:38.840 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:26:38.840 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (33m) 70s ago 34m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:26:38.841 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (27m) 70s ago 34m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:26:38.841 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (27m) 9m ago 33m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:26:38.841 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (33m) 70s ago 34m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:26:38.841 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 70s ago 30m - - 2023-10-18T21:26:38.842 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 70s ago 30m - - 2023-10-18T21:26:38.842 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 30m - - 2023-10-18T21:26:38.842 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 30m - - 2023-10-18T21:26:38.842 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (28m) 70s ago 36m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:26:38.842 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (27m) 9m ago 33m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:26:38.843 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (27m) 70s ago 36m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:26:38.843 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (27m) 9m ago 33m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:26:38.843 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (34m) 70s ago 34m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:26:38.843 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (33m) 9m ago 33m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:26:38.843 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (26m) 70s ago 33m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:26:38.844 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (24m) 70s ago 33m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:26:38.844 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (24m) 70s ago 32m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:26:38.844 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (23m) 9m ago 32m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:26:38.844 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (23m) 9m ago 32m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:26:38.844 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (22m) 9m ago 31m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:26:38.845 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (28m) 70s ago 34m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:26:38.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 -- 172.21.15.8:0/4141185218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc61c060f70 msgr2=0x7fc61c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc61c060f70 0x7fc61c063430 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fc6340f7630 tx=0x7fc62400b040).stop 2023-10-18T21:26:38.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 -- 172.21.15.8:0/4141185218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6340f77d0 msgr2=0x7fc634109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6340f77d0 0x7fc634109470 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fc628009f50 tx=0x7fc628009b30).stop 2023-10-18T21:26:38.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 -- 172.21.15.8:0/4141185218 shutdown_connections 2023-10-18T21:26:38.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc61c060f70 0x7fc61c063430 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6340f6530 0x7fc634108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 --2- 172.21.15.8:0/4141185218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6340f77d0 0x7fc634109470 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 -- 172.21.15.8:0/4141185218 >> 172.21.15.8:0/4141185218 conn(0x7fc6340f1c90 msgr2=0x7fc63406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:38.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 -- 172.21.15.8:0/4141185218 shutdown_connections 2023-10-18T21:26:38.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.840+0000 7fc6393fa700 1 -- 172.21.15.8:0/4141185218 wait complete. 2023-10-18T21:26:38.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.977+0000 7f81fe39d700 1 -- 172.21.15.8:0/101664703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f5430 msgr2=0x7f81f80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.977+0000 7f81fe39d700 1 --2- 172.21.15.8:0/101664703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f5430 0x7f81f80f5850 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f81f4004660 tx=0x7f81f4009b30).stop 2023-10-18T21:26:38.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.977+0000 7f81fe39d700 1 -- 172.21.15.8:0/101664703 shutdown_connections 2023-10-18T21:26:38.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.977+0000 7f81fe39d700 1 --2- 172.21.15.8:0/101664703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f66d0 0x7f81f80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.977+0000 7f81fe39d700 1 --2- 172.21.15.8:0/101664703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f5430 0x7f81f80f5850 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.977+0000 7f81fe39d700 1 -- 172.21.15.8:0/101664703 >> 172.21.15.8:0/101664703 conn(0x7f81f80f0b90 msgr2=0x7f81f80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:38.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.977+0000 7f81fe39d700 1 -- 172.21.15.8:0/101664703 shutdown_connections 2023-10-18T21:26:38.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.977+0000 7f81fe39d700 1 -- 172.21.15.8:0/101664703 wait complete. 2023-10-18T21:26:38.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.978+0000 7f81fe39d700 1 Processor -- start 2023-10-18T21:26:38.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.978+0000 7f81fe39d700 1 -- start start 2023-10-18T21:26:38.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.978+0000 7f81fe39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f5430 0x7f81f80fe850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:38.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.978+0000 7f81fe39d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f66d0 0x7f81f80fed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:38.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.978+0000 7f81fe39d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f80ff340 con 0x7f81f80f66d0 2023-10-18T21:26:38.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.978+0000 7f81fe39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f80ff480 con 0x7f81f80f5430 2023-10-18T21:26:38.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.979+0000 7f81fcb9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f66d0 0x7f81f80fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:38.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.979+0000 7f81fcb9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f66d0 0x7f81f80fed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51842/0 (socket says 172.21.15.8:51842) 2023-10-18T21:26:38.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.979+0000 7f81fcb9a700 1 -- 172.21.15.8:0/188340451 learned_addr learned my addr 172.21.15.8:0/188340451 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:38.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.979+0000 7f81fd39b700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f5430 0x7f81f80fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:38.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.979+0000 7f81fcb9a700 1 -- 172.21.15.8:0/188340451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f5430 msgr2=0x7f81f80fe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:38.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.979+0000 7f81fcb9a700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f5430 0x7f81f80fe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:38.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.979+0000 7f81fcb9a700 1 -- 172.21.15.8:0/188340451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f4005040 con 0x7f81f80f66d0 2023-10-18T21:26:38.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.979+0000 7f81fcb9a700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f66d0 0x7f81f80fed40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f81e80026d0 tx=0x7f81e8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:38.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.980+0000 7f81edffb700 1 -- 172.21.15.8:0/188340451 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81e8009320 con 0x7f81f80f66d0 2023-10-18T21:26:38.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.980+0000 7f81edffb700 1 -- 172.21.15.8:0/188340451 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f81e800f040 con 0x7f81f80f66d0 2023-10-18T21:26:38.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.980+0000 7f81fe39d700 1 -- 172.21.15.8:0/188340451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f80ffdf0 con 0x7f81f80f66d0 2023-10-18T21:26:38.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.980+0000 7f81edffb700 1 -- 172.21.15.8:0/188340451 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81e80148a0 con 0x7f81f80f66d0 2023-10-18T21:26:38.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.980+0000 7f81fe39d700 1 -- 172.21.15.8:0/188340451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f81003b0 con 0x7f81f80f66d0 2023-10-18T21:26:38.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.981+0000 7f81fe39d700 1 -- 172.21.15.8:0/188340451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f8045ad0 con 0x7f81f80f66d0 2023-10-18T21:26:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:37.445018+0000 mgr.smithi008.flmjzp (mgr.14640) 1666 : cluster [DBG] pgmap v1156: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:38.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.982+0000 7f81edffb700 1 -- 172.21.15.8:0/188340451 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f81e8009480 con 0x7f81f80f66d0 2023-10-18T21:26:38.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.982+0000 7f81edffb700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e4060f70 0x7f81e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:38.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.983+0000 7f81edffb700 1 -- 172.21.15.8:0/188340451 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f81e807d090 con 0x7f81f80f66d0 2023-10-18T21:26:38.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.983+0000 7f81fd39b700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e4060f70 0x7f81e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:38.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.983+0000 7f81fd39b700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e4060f70 0x7f81e4063430 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f81f4005010 tx=0x7f81f4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:38.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:38.986+0000 7f81edffb700 1 -- 172.21.15.8:0/188340451 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f81e804cc40 con 0x7f81f80f66d0 2023-10-18T21:26:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.238+0000 7f81fe39d700 1 -- 172.21.15.8:0/188340451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f81f8100a50 con 0x7f81f80f66d0 2023-10-18T21:26:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.239+0000 7f81edffb700 1 -- 172.21.15.8:0/188340451 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f81e80181b0 con 0x7f81f80f66d0 2023-10-18T21:26:39.241 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:26:39.241 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:26:39.242 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:26:39.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:26:39.242 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:26:39.243 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:26:39.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:26:39.243 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:26:39.243 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:26:39.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:26:39.244 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:26:39.244 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:26:39.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:26:39.244 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:26:39.244 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:26:39.245 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:26:39.245 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:26:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 -- 172.21.15.8:0/188340451 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e4060f70 msgr2=0x7f81e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e4060f70 0x7f81e4063430 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f81f4005010 tx=0x7f81f4009b30).stop 2023-10-18T21:26:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 -- 172.21.15.8:0/188340451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f66d0 msgr2=0x7f81f80fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f66d0 0x7f81f80fed40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f81e80026d0 tx=0x7f81e8009de0).stop 2023-10-18T21:26:39.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 -- 172.21.15.8:0/188340451 shutdown_connections 2023-10-18T21:26:39.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81e4060f70 0x7f81e4063430 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81f80f5430 0x7f81f80fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 --2- 172.21.15.8:0/188340451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f80f66d0 0x7f81f80fed40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 -- 172.21.15.8:0/188340451 >> 172.21.15.8:0/188340451 conn(0x7f81f80f0b90 msgr2=0x7f81f805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:39.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 -- 172.21.15.8:0/188340451 shutdown_connections 2023-10-18T21:26:39.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.241+0000 7f81fe39d700 1 -- 172.21.15.8:0/188340451 wait complete. 2023-10-18T21:26:39.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.378+0000 7f3287560700 1 -- 172.21.15.8:0/3476548374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32800f77d0 msgr2=0x7f32800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:39.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.378+0000 7f3287560700 1 --2- 172.21.15.8:0/3476548374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32800f77d0 0x7f32800f7c30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f3270004660 tx=0x7f3270009b30).stop 2023-10-18T21:26:39.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.378+0000 7f3287560700 1 -- 172.21.15.8:0/3476548374 shutdown_connections 2023-10-18T21:26:39.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.378+0000 7f3287560700 1 --2- 172.21.15.8:0/3476548374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32800f77d0 0x7f32800f7c30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.378+0000 7f3287560700 1 --2- 172.21.15.8:0/3476548374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32800f6530 0x7f32800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:26:39.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.378+0000 7f3287560700 1 -- 172.21.15.8:0/3476548374 >> 172.21.15.8:0/3476548374 conn(0x7f32800f1c90 msgr2=0x7f32800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:39.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.378+0000 7f3287560700 1 -- 172.21.15.8:0/3476548374 shutdown_connections 2023-10-18T21:26:39.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.378+0000 7f3287560700 1 -- 172.21.15.8:0/3476548374 wait complete. 2023-10-18T21:26:39.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.379+0000 7f3287560700 1 Processor -- start 2023-10-18T21:26:39.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.379+0000 7f3287560700 1 -- start start 2023-10-18T21:26:39.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f3287560700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32800f6530 0x7f3280108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:39.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f3287560700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32800f77d0 0x7f32801094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f3287560700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3280109b00 con 0x7f32800f6530 2023-10-18T21:26:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f3287560700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328010a3b0 con 0x7f32800f77d0 2023-10-18T21:26:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f328655e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32800f6530 0x7f3280108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f328655e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32800f6530 0x7f3280108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51862/0 (socket says 172.21.15.8:51862) 2023-10-18T21:26:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f328655e700 1 -- 172.21.15.8:0/4142085884 learned_addr learned my addr 172.21.15.8:0/4142085884 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f3285d5d700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32800f77d0 0x7f32801094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f328655e700 1 -- 172.21.15.8:0/4142085884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32800f77d0 msgr2=0x7f32801094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f328655e700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32800f77d0 0x7f32801094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.380+0000 7f328655e700 1 -- 172.21.15.8:0/4142085884 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270005040 con 0x7f32800f6530 2023-10-18T21:26:39.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.381+0000 7f328655e700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32800f6530 0x7f3280108fd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f327c0093f0 tx=0x7f327c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:39.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.381+0000 7f3276ffd700 1 -- 172.21.15.8:0/4142085884 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327c013640 con 0x7f32800f6530 2023-10-18T21:26:39.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.381+0000 7f3276ffd700 1 -- 172.21.15.8:0/4142085884 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f327c013c60 con 0x7f32800f6530 2023-10-18T21:26:39.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.381+0000 7f3287560700 1 -- 172.21.15.8:0/4142085884 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328010a690 con 0x7f32800f6530 2023-10-18T21:26:39.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.381+0000 7f3276ffd700 1 -- 172.21.15.8:0/4142085884 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327c012ce0 con 0x7f32800f6530 2023-10-18T21:26:39.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.381+0000 7f3287560700 1 -- 172.21.15.8:0/4142085884 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328010ac50 con 0x7f32800f6530 2023-10-18T21:26:39.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.382+0000 7f3287560700 1 -- 172.21.15.8:0/4142085884 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3280059100 con 0x7f32800f6530 2023-10-18T21:26:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.383+0000 7f3276ffd700 1 -- 172.21.15.8:0/4142085884 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f327c01a060 con 0x7f32800f6530 2023-10-18T21:26:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.384+0000 7f3276ffd700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f326c060f70 0x7f326c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.384+0000 7f3276ffd700 1 -- 172.21.15.8:0/4142085884 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f327c07c880 con 0x7f32800f6530 2023-10-18T21:26:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.384+0000 7f3285d5d700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f326c060f70 0x7f326c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.385+0000 7f3285d5d700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f326c060f70 0x7f326c063430 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f3270009f50 tx=0x7f3270009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:39.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.388+0000 7f3276ffd700 1 -- 172.21.15.8:0/4142085884 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f327c04ff60 con 0x7f32800f6530 2023-10-18T21:26:39.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.617+0000 7f3287560700 1 -- 172.21.15.8:0/4142085884 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f32800fed60 con 0x7f32800f6530 2023-10-18T21:26:39.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.617+0000 7f3276ffd700 1 -- 172.21.15.8:0/4142085884 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f327c04fb50 con 0x7f32800f6530 2023-10-18T21:26:39.619 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:26:39.619 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:26:39.620 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:26:39.620 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:26:39.620 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:26:39.620 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:26:39.620 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:26:39.620 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:26:39.621 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:26:39.621 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:26:39.621 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:26:39.621 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:26:39.621 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:26:39.622 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:26:39.622 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:26:39.622 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:26:39.622 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:26:39.622 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:26:39.623 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:26:39.623 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:26:39.623 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:26:39.623 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:26:39.623 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:26:39.623 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:26:39.624 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:26:39.624 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:26:39.624 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:26:39.624 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:26:39.624 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:26:39.624 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:26:39.625 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:26:39.625 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:26:39.625 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:26:39.625 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:26:39.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.619+0000 7f3287560700 1 -- 172.21.15.8:0/4142085884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f326c060f70 msgr2=0x7f326c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:39.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.619+0000 7f3287560700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f326c060f70 0x7f326c063430 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f3270009f50 tx=0x7f3270009b30).stop 2023-10-18T21:26:39.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.619+0000 7f3287560700 1 -- 172.21.15.8:0/4142085884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32800f6530 msgr2=0x7f3280108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:39.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.619+0000 7f3287560700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32800f6530 0x7f3280108fd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f327c0093f0 tx=0x7f327c006ec0).stop 2023-10-18T21:26:39.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.619+0000 7f3287560700 1 -- 172.21.15.8:0/4142085884 shutdown_connections 2023-10-18T21:26:39.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.619+0000 7f3287560700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f326c060f70 0x7f326c063430 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.619+0000 7f3287560700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32800f6530 0x7f3280108fd0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.619+0000 7f3287560700 1 --2- 172.21.15.8:0/4142085884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32800f77d0 0x7f32801094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.619+0000 7f3287560700 1 -- 172.21.15.8:0/4142085884 >> 172.21.15.8:0/4142085884 conn(0x7f32800f1c90 msgr2=0x7f328006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.620+0000 7f3287560700 1 -- 172.21.15.8:0/4142085884 shutdown_connections 2023-10-18T21:26:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.620+0000 7f3287560700 1 -- 172.21.15.8:0/4142085884 wait complete. 2023-10-18T21:26:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:26:39.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.757+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2694827883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c3c0f77d0 msgr2=0x7f2c3c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:39.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.757+0000 7f2c3bfff700 1 --2- 172.21.15.8:0/2694827883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c3c0f77d0 0x7f2c3c0f7c30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f2c30004660 tx=0x7f2c30009b30).stop 2023-10-18T21:26:39.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.757+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2694827883 shutdown_connections 2023-10-18T21:26:39.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.757+0000 7f2c3bfff700 1 --2- 172.21.15.8:0/2694827883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c3c0f77d0 0x7f2c3c0f7c30 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.757+0000 7f2c3bfff700 1 --2- 172.21.15.8:0/2694827883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c3c0f6530 0x7f2c3c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.757+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2694827883 >> 172.21.15.8:0/2694827883 conn(0x7f2c3c0f1c90 msgr2=0x7f2c3c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:39.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.757+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2694827883 shutdown_connections 2023-10-18T21:26:39.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.757+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2694827883 wait complete. 2023-10-18T21:26:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.758+0000 7f2c3bfff700 1 Processor -- start 2023-10-18T21:26:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.758+0000 7f2c3bfff700 1 -- start start 2023-10-18T21:26:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.758+0000 7f2c3bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c3c0f6530 0x7f2c3c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.758+0000 7f2c3bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c3c0f77d0 0x7f2c3c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.758+0000 7f2c3bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c06a380 con 0x7f2c3c0f6530 2023-10-18T21:26:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.758+0000 7f2c3bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c06a4c0 con 0x7f2c3c0f77d0 2023-10-18T21:26:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.758+0000 7f2c3affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c3c0f6530 0x7f2c3c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c3affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c3c0f6530 0x7f2c3c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51868/0 (socket says 172.21.15.8:51868) 2023-10-18T21:26:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c3a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c3c0f77d0 0x7f2c3c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c3affd700 1 -- 172.21.15.8:0/2755572979 learned_addr learned my addr 172.21.15.8:0/2755572979 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:26:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c3affd700 1 -- 172.21.15.8:0/2755572979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c3c0f77d0 msgr2=0x7f2c3c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c3affd700 1 --2- 172.21.15.8:0/2755572979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c3c0f77d0 0x7f2c3c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c3affd700 1 -- 172.21.15.8:0/2755572979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c30005040 con 0x7f2c3c0f6530 2023-10-18T21:26:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c3affd700 1 --2- 172.21.15.8:0/2755572979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c3c0f6530 0x7f2c3c06b9a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f2c2c00e7c0 tx=0x7f2c2c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c237fe700 1 -- 172.21.15.8:0/2755572979 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c2c0092e0 con 0x7f2c3c0f6530 2023-10-18T21:26:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c237fe700 1 -- 172.21.15.8:0/2755572979 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2c2c00f040 con 0x7f2c3c0f6530 2023-10-18T21:26:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c237fe700 1 -- 172.21.15.8:0/2755572979 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c2c014810 con 0x7f2c3c0f6530 2023-10-18T21:26:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.759+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2755572979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c06a7a0 con 0x7f2c3c0f6530 2023-10-18T21:26:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.760+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2755572979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c10ecc0 con 0x7f2c3c0f6530 2023-10-18T21:26:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.761+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2755572979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c045ad0 con 0x7f2c3c0f6530 2023-10-18T21:26:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.761+0000 7f2c237fe700 1 -- 172.21.15.8:0/2755572979 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2c2c01b030 con 0x7f2c3c0f6530 2023-10-18T21:26:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.762+0000 7f2c237fe700 1 --2- 172.21.15.8:0/2755572979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c24060f70 0x7f2c24063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:26:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.762+0000 7f2c237fe700 1 -- 172.21.15.8:0/2755572979 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2c2c07c880 con 0x7f2c3c0f6530 2023-10-18T21:26:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.763+0000 7f2c3a7fc700 1 --2- 172.21.15.8:0/2755572979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c24060f70 0x7f2c24063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:26:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.763+0000 7f2c3a7fc700 1 --2- 172.21.15.8:0/2755572979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c24060f70 0x7f2c24063430 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f2c30009720 tx=0x7f2c30016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:26:39.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.767+0000 7f2c237fe700 1 -- 172.21.15.8:0/2755572979 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2c2c04c430 con 0x7f2c3c0f6530 2023-10-18T21:26:39.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:38.136013+0000 mgr.smithi008.flmjzp (mgr.14640) 1667 : audit [DBG] from='client.35512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:38.488034+0000 mgr.smithi008.flmjzp (mgr.14640) 1668 : audit [DBG] from='client.35516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:38.831221+0000 mgr.smithi008.flmjzp (mgr.14640) 1669 : audit [DBG] from='client.35520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:39.240623+0000 mon.smithi008 (mon.0) 2127 : audit [DBG] from='client.? 172.21.15.8:0/188340451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:39.479249+0000 mon.smithi008 (mon.0) 2128 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.967+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2755572979 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c3c0fee30 con 0x7f2c24060f70 2023-10-18T21:26:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.969+0000 7f2c237fe700 1 -- 172.21.15.8:0/2755572979 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2c3c0fee30 con 0x7f2c24060f70 2023-10-18T21:26:39.970 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:26:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:26:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:26:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:26:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:26:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:26:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:26:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:26:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:26:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:26:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:26:39.973 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:26:39.973 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:26:39.973 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:26:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.970+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2755572979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c24060f70 msgr2=0x7f2c24063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.970+0000 7f2c3bfff700 1 --2- 172.21.15.8:0/2755572979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c24060f70 0x7f2c24063430 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f2c30009720 tx=0x7f2c30016040).stop 2023-10-18T21:26:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.970+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2755572979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c3c0f6530 msgr2=0x7f2c3c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:26:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.970+0000 7f2c3bfff700 1 --2- 172.21.15.8:0/2755572979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c3c0f6530 0x7f2c3c06b9a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f2c2c00e7c0 tx=0x7f2c2c00b040).stop 2023-10-18T21:26:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.971+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2755572979 shutdown_connections 2023-10-18T21:26:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.971+0000 7f2c3bfff700 1 --2- 172.21.15.8:0/2755572979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c24060f70 0x7f2c24063430 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.971+0000 7f2c3bfff700 1 --2- 172.21.15.8:0/2755572979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c3c0f6530 0x7f2c3c06b9a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.971+0000 7f2c3bfff700 1 --2- 172.21.15.8:0/2755572979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c3c0f77d0 0x7f2c3c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:26:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.971+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2755572979 >> 172.21.15.8:0/2755572979 conn(0x7f2c3c0f1c90 msgr2=0x7f2c3c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:26:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.971+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2755572979 shutdown_connections 2023-10-18T21:26:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:26:39.971+0000 7f2c3bfff700 1 -- 172.21.15.8:0/2755572979 wait complete. 2023-10-18T21:26:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:38.136013+0000 mgr.smithi008.flmjzp (mgr.14640) 1667 : audit [DBG] from='client.35512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:38.488034+0000 mgr.smithi008.flmjzp (mgr.14640) 1668 : audit [DBG] from='client.35516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:38.831221+0000 mgr.smithi008.flmjzp (mgr.14640) 1669 : audit [DBG] from='client.35520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:39.240623+0000 mon.smithi008 (mon.0) 2127 : audit [DBG] from='client.? 172.21.15.8:0/188340451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:39.479249+0000 mon.smithi008 (mon.0) 2128 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:39.445529+0000 mgr.smithi008.flmjzp (mgr.14640) 1670 : cluster [DBG] pgmap v1157: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:39.618811+0000 mon.smithi008 (mon.0) 2129 : audit [DBG] from='client.? 172.21.15.8:0/4142085884' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:26:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:40.037288+0000 mon.smithi008 (mon.0) 2130 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:26:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:40.038152+0000 mon.smithi008 (mon.0) 2131 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:26:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:40.043651+0000 mon.smithi008 (mon.0) 2132 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:26:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:40.048920+0000 mon.smithi008 (mon.0) 2133 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:40.051276+0000 mon.smithi008 (mon.0) 2134 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:40.052499+0000 mon.smithi008 (mon.0) 2135 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:40.053680+0000 mon.smithi008 (mon.0) 2136 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:40.055177+0000 mon.smithi008 (mon.0) 2137 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:40.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:39.445529+0000 mgr.smithi008.flmjzp (mgr.14640) 1670 : cluster [DBG] pgmap v1157: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:40.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:39.618811+0000 mon.smithi008 (mon.0) 2129 : audit [DBG] from='client.? 172.21.15.8:0/4142085884' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:26:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:40.037288+0000 mon.smithi008 (mon.0) 2130 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:26:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:40.038152+0000 mon.smithi008 (mon.0) 2131 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:26:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:40.043651+0000 mon.smithi008 (mon.0) 2132 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:26:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:40.048920+0000 mon.smithi008 (mon.0) 2133 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:40.051276+0000 mon.smithi008 (mon.0) 2134 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:40.052499+0000 mon.smithi008 (mon.0) 2135 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:40.053680+0000 mon.smithi008 (mon.0) 2136 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:40.055177+0000 mon.smithi008 (mon.0) 2137 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:39.969955+0000 mgr.smithi008.flmjzp (mgr.14640) 1671 : audit [DBG] from='client.35532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:26:40.038815+0000 mgr.smithi008.flmjzp (mgr.14640) 1672 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:40.039352+0000 mgr.smithi008.flmjzp (mgr.14640) 1673 : cluster [DBG] pgmap v1158: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:40.039631+0000 mgr.smithi008.flmjzp (mgr.14640) 1674 : cluster [DBG] pgmap v1159: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:26:40.056692+0000 mgr.smithi008.flmjzp (mgr.14640) 1675 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:41.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:39.969955+0000 mgr.smithi008.flmjzp (mgr.14640) 1671 : audit [DBG] from='client.35532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:26:41.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:26:40.038815+0000 mgr.smithi008.flmjzp (mgr.14640) 1672 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:40.039352+0000 mgr.smithi008.flmjzp (mgr.14640) 1673 : cluster [DBG] pgmap v1158: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:40.039631+0000 mgr.smithi008.flmjzp (mgr.14640) 1674 : cluster [DBG] pgmap v1159: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:26:40.056692+0000 mgr.smithi008.flmjzp (mgr.14640) 1675 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:42.040100+0000 mgr.smithi008.flmjzp (mgr.14640) 1676 : cluster [DBG] pgmap v1160: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:43.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:42.040100+0000 mgr.smithi008.flmjzp (mgr.14640) 1676 : cluster [DBG] pgmap v1160: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:44.040668+0000 mgr.smithi008.flmjzp (mgr.14640) 1677 : cluster [DBG] pgmap v1161: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:45.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:44.040668+0000 mgr.smithi008.flmjzp (mgr.14640) 1677 : cluster [DBG] pgmap v1161: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:46.041217+0000 mgr.smithi008.flmjzp (mgr.14640) 1678 : cluster [DBG] pgmap v1162: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:47.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:46.041217+0000 mgr.smithi008.flmjzp (mgr.14640) 1678 : cluster [DBG] pgmap v1162: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:48.041888+0000 mgr.smithi008.flmjzp (mgr.14640) 1679 : cluster [DBG] pgmap v1163: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:49.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:48.041888+0000 mgr.smithi008.flmjzp (mgr.14640) 1679 : cluster [DBG] pgmap v1163: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:50.067487+0000 mon.smithi008 (mon.0) 2138 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:50.069765+0000 mon.smithi008 (mon.0) 2139 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:26:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:50.070856+0000 mon.smithi008 (mon.0) 2140 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:26:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:50.077294+0000 mon.smithi008 (mon.0) 2141 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:26:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:50.083652+0000 mon.smithi008 (mon.0) 2142 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:50.086739+0000 mon.smithi008 (mon.0) 2143 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:50.088434+0000 mon.smithi008 (mon.0) 2144 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:50.090011+0000 mon.smithi008 (mon.0) 2145 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:50.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:26:50.091982+0000 mon.smithi008 (mon.0) 2146 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:50.067487+0000 mon.smithi008 (mon.0) 2138 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:50.069765+0000 mon.smithi008 (mon.0) 2139 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:26:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:50.070856+0000 mon.smithi008 (mon.0) 2140 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:26:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:50.077294+0000 mon.smithi008 (mon.0) 2141 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:26:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:50.083652+0000 mon.smithi008 (mon.0) 2142 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:26:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:50.086739+0000 mon.smithi008 (mon.0) 2143 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:50.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:50.088434+0000 mon.smithi008 (mon.0) 2144 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:50.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:50.090011+0000 mon.smithi008 (mon.0) 2145 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:50.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:26:50.091982+0000 mon.smithi008 (mon.0) 2146 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:26:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:50.042430+0000 mgr.smithi008.flmjzp (mgr.14640) 1680 : cluster [DBG] pgmap v1164: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:26:50.071798+0000 mgr.smithi008.flmjzp (mgr.14640) 1681 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:50.072403+0000 mgr.smithi008.flmjzp (mgr.14640) 1682 : cluster [DBG] pgmap v1165: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:50.072736+0000 mgr.smithi008.flmjzp (mgr.14640) 1683 : cluster [DBG] pgmap v1166: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:26:50.093886+0000 mgr.smithi008.flmjzp (mgr.14640) 1684 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:51.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:50.042430+0000 mgr.smithi008.flmjzp (mgr.14640) 1680 : cluster [DBG] pgmap v1164: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:51.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:26:50.071798+0000 mgr.smithi008.flmjzp (mgr.14640) 1681 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:26:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:50.072403+0000 mgr.smithi008.flmjzp (mgr.14640) 1682 : cluster [DBG] pgmap v1165: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:50.072736+0000 mgr.smithi008.flmjzp (mgr.14640) 1683 : cluster [DBG] pgmap v1166: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:26:50.093886+0000 mgr.smithi008.flmjzp (mgr.14640) 1684 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:26:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:52.073513+0000 mgr.smithi008.flmjzp (mgr.14640) 1685 : cluster [DBG] pgmap v1167: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:53.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:52.073513+0000 mgr.smithi008.flmjzp (mgr.14640) 1685 : cluster [DBG] pgmap v1167: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:54.074102+0000 mgr.smithi008.flmjzp (mgr.14640) 1686 : cluster [DBG] pgmap v1168: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:55.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:54.074102+0000 mgr.smithi008.flmjzp (mgr.14640) 1686 : cluster [DBG] pgmap v1168: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:56.074799+0000 mgr.smithi008.flmjzp (mgr.14640) 1687 : cluster [DBG] pgmap v1169: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:57.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:56.074799+0000 mgr.smithi008.flmjzp (mgr.14640) 1687 : cluster [DBG] pgmap v1169: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:26:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:26:58.075429+0000 mgr.smithi008.flmjzp (mgr.14640) 1688 : cluster [DBG] pgmap v1170: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:26:59.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:26:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:26:58.075429+0000 mgr.smithi008.flmjzp (mgr.14640) 1688 : cluster [DBG] pgmap v1170: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:00.104556+0000 mon.smithi008 (mon.0) 2147 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:00.106673+0000 mon.smithi008 (mon.0) 2148 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:00.107665+0000 mon.smithi008 (mon.0) 2149 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:00.114310+0000 mon.smithi008 (mon.0) 2150 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:00.120907+0000 mon.smithi008 (mon.0) 2151 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:00.124033+0000 mon.smithi008 (mon.0) 2152 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:00.125642+0000 mon.smithi008 (mon.0) 2153 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:00.127200+0000 mon.smithi008 (mon.0) 2154 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:00.129120+0000 mon.smithi008 (mon.0) 2155 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:00.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:00.104556+0000 mon.smithi008 (mon.0) 2147 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:00.106673+0000 mon.smithi008 (mon.0) 2148 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:00.107665+0000 mon.smithi008 (mon.0) 2149 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:00.114310+0000 mon.smithi008 (mon.0) 2150 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:00.120907+0000 mon.smithi008 (mon.0) 2151 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:00.124033+0000 mon.smithi008 (mon.0) 2152 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:00.125642+0000 mon.smithi008 (mon.0) 2153 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:00.127200+0000 mon.smithi008 (mon.0) 2154 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:00.129120+0000 mon.smithi008 (mon.0) 2155 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:00.076181+0000 mgr.smithi008.flmjzp (mgr.14640) 1689 : cluster [DBG] pgmap v1171: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:00.108481+0000 mgr.smithi008.flmjzp (mgr.14640) 1690 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:00.109107+0000 mgr.smithi008.flmjzp (mgr.14640) 1691 : cluster [DBG] pgmap v1172: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:00.109441+0000 mgr.smithi008.flmjzp (mgr.14640) 1692 : cluster [DBG] pgmap v1173: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:00.130999+0000 mgr.smithi008.flmjzp (mgr.14640) 1693 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:01.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:00.076181+0000 mgr.smithi008.flmjzp (mgr.14640) 1689 : cluster [DBG] pgmap v1171: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:00.108481+0000 mgr.smithi008.flmjzp (mgr.14640) 1690 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:00.109107+0000 mgr.smithi008.flmjzp (mgr.14640) 1691 : cluster [DBG] pgmap v1172: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:00.109441+0000 mgr.smithi008.flmjzp (mgr.14640) 1692 : cluster [DBG] pgmap v1173: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:00.130999+0000 mgr.smithi008.flmjzp (mgr.14640) 1693 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:02.110216+0000 mgr.smithi008.flmjzp (mgr.14640) 1694 : cluster [DBG] pgmap v1174: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:03.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:02.110216+0000 mgr.smithi008.flmjzp (mgr.14640) 1694 : cluster [DBG] pgmap v1174: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:04.110843+0000 mgr.smithi008.flmjzp (mgr.14640) 1695 : cluster [DBG] pgmap v1175: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:05.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:04.110843+0000 mgr.smithi008.flmjzp (mgr.14640) 1695 : cluster [DBG] pgmap v1175: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:06.111412+0000 mgr.smithi008.flmjzp (mgr.14640) 1696 : cluster [DBG] pgmap v1176: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:07.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:06.111412+0000 mgr.smithi008.flmjzp (mgr.14640) 1696 : cluster [DBG] pgmap v1176: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:08.111878+0000 mgr.smithi008.flmjzp (mgr.14640) 1697 : cluster [DBG] pgmap v1177: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:09.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:08.111878+0000 mgr.smithi008.flmjzp (mgr.14640) 1697 : cluster [DBG] pgmap v1177: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.126+0000 7f011c94d700 1 -- 172.21.15.8:0/521583443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01180f77d0 msgr2=0x7f01180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.126+0000 7f011c94d700 1 --2- 172.21.15.8:0/521583443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01180f77d0 0x7f01180f7c30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f010c004660 tx=0x7f010c009b30).stop 2023-10-18T21:27:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.126+0000 7f011c94d700 1 -- 172.21.15.8:0/521583443 shutdown_connections 2023-10-18T21:27:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.126+0000 7f011c94d700 1 --2- 172.21.15.8:0/521583443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01180f77d0 0x7f01180f7c30 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.126+0000 7f011c94d700 1 --2- 172.21.15.8:0/521583443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01180f6530 0x7f01180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.126+0000 7f011c94d700 1 -- 172.21.15.8:0/521583443 >> 172.21.15.8:0/521583443 conn(0x7f01180f1cd0 msgr2=0x7f01180f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.126+0000 7f011c94d700 1 -- 172.21.15.8:0/521583443 shutdown_connections 2023-10-18T21:27:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.126+0000 7f011c94d700 1 -- 172.21.15.8:0/521583443 wait complete. 2023-10-18T21:27:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.127+0000 7f011c94d700 1 Processor -- start 2023-10-18T21:27:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.127+0000 7f011c94d700 1 -- start start 2023-10-18T21:27:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.128+0000 7f011c94d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01180f6530 0x7f0118108ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.128+0000 7f011c94d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01180f77d0 0x7f0118109390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.128+0000 7f011c94d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0118109940 con 0x7f01180f77d0 2023-10-18T21:27:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.128+0000 7f011c94d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0118109a80 con 0x7f01180f6530 2023-10-18T21:27:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.128+0000 7f011659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01180f77d0 0x7f0118109390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.128+0000 7f011659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01180f77d0 0x7f0118109390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57682/0 (socket says 172.21.15.8:57682) 2023-10-18T21:27:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.128+0000 7f011659c700 1 -- 172.21.15.8:0/2884503142 learned_addr learned my addr 172.21.15.8:0/2884503142 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.128+0000 7f0116d9d700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01180f6530 0x7f0118108ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.129+0000 7f011659c700 1 -- 172.21.15.8:0/2884503142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01180f6530 msgr2=0x7f0118108ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.129+0000 7f011659c700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01180f6530 0x7f0118108ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.129+0000 7f011659c700 1 -- 172.21.15.8:0/2884503142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c005040 con 0x7f01180f77d0 2023-10-18T21:27:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.129+0000 7f011659c700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01180f77d0 0x7f0118109390 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f010c004320 tx=0x7f010c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.129+0000 7f00ff7fe700 1 -- 172.21.15.8:0/2884503142 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f010c019070 con 0x7f01180f77d0 2023-10-18T21:27:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.129+0000 7f00ff7fe700 1 -- 172.21.15.8:0/2884503142 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f010c01e420 con 0x7f01180f77d0 2023-10-18T21:27:10.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.129+0000 7f011c94d700 1 -- 172.21.15.8:0/2884503142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011810a3c0 con 0x7f01180f77d0 2023-10-18T21:27:10.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.129+0000 7f00ff7fe700 1 -- 172.21.15.8:0/2884503142 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f010c014680 con 0x7f01180f77d0 2023-10-18T21:27:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.129+0000 7f011c94d700 1 -- 172.21.15.8:0/2884503142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011810a8a0 con 0x7f01180f77d0 2023-10-18T21:27:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.130+0000 7f011c94d700 1 -- 172.21.15.8:0/2884503142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0118045ad0 con 0x7f01180f77d0 2023-10-18T21:27:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.131+0000 7f00ff7fe700 1 -- 172.21.15.8:0/2884503142 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f010c01e590 con 0x7f01180f77d0 2023-10-18T21:27:10.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.132+0000 7f00ff7fe700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0100060f70 0x7f0100063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:10.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.132+0000 7f00ff7fe700 1 -- 172.21.15.8:0/2884503142 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f010c07ddd0 con 0x7f01180f77d0 2023-10-18T21:27:10.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.133+0000 7f0116d9d700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0100060f70 0x7f0100063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:10.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.133+0000 7f0116d9d700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0100060f70 0x7f0100063430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f0108009fd0 tx=0x7f010800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:10.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.137+0000 7f00ff7fe700 1 -- 172.21.15.8:0/2884503142 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f010c051350 con 0x7f01180f77d0 2023-10-18T21:27:10.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.340+0000 7f011c94d700 1 -- 172.21.15.8:0/2884503142 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01180fee30 con 0x7f0100060f70 2023-10-18T21:27:10.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.341+0000 7f00ff7fe700 1 -- 172.21.15.8:0/2884503142 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f01180fee30 con 0x7f0100060f70 2023-10-18T21:27:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 -- 172.21.15.8:0/2884503142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0100060f70 msgr2=0x7f0100063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0100060f70 0x7f0100063430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f0108009fd0 tx=0x7f010800b040).stop 2023-10-18T21:27:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 -- 172.21.15.8:0/2884503142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01180f77d0 msgr2=0x7f0118109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01180f77d0 0x7f0118109390 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f010c004320 tx=0x7f010c00b040).stop 2023-10-18T21:27:10.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 -- 172.21.15.8:0/2884503142 shutdown_connections 2023-10-18T21:27:10.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0100060f70 0x7f0100063430 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01180f6530 0x7f0118108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 --2- 172.21.15.8:0/2884503142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01180f77d0 0x7f0118109390 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 -- 172.21.15.8:0/2884503142 >> 172.21.15.8:0/2884503142 conn(0x7f01180f1cd0 msgr2=0x7f011806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:10.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 -- 172.21.15.8:0/2884503142 shutdown_connections 2023-10-18T21:27:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.343+0000 7f011c94d700 1 -- 172.21.15.8:0/2884503142 wait complete. 2023-10-18T21:27:10.358 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:27:10.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.481+0000 7f073ffff700 1 -- 172.21.15.8:0/2492071021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07400f6530 msgr2=0x7f07400f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:10.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.481+0000 7f073ffff700 1 --2- 172.21.15.8:0/2492071021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07400f6530 0x7f07400f6950 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f0730004660 tx=0x7f0730009b30).stop 2023-10-18T21:27:10.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.481+0000 7f073ffff700 1 -- 172.21.15.8:0/2492071021 shutdown_connections 2023-10-18T21:27:10.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.481+0000 7f073ffff700 1 --2- 172.21.15.8:0/2492071021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07400f77d0 0x7f07400f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.481+0000 7f073ffff700 1 --2- 172.21.15.8:0/2492071021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07400f6530 0x7f07400f6950 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.481+0000 7f073ffff700 1 -- 172.21.15.8:0/2492071021 >> 172.21.15.8:0/2492071021 conn(0x7f07400f1c90 msgr2=0x7f07400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:10.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.481+0000 7f073ffff700 1 -- 172.21.15.8:0/2492071021 shutdown_connections 2023-10-18T21:27:10.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.482+0000 7f073ffff700 1 -- 172.21.15.8:0/2492071021 wait complete. 2023-10-18T21:27:10.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.482+0000 7f073ffff700 1 Processor -- start 2023-10-18T21:27:10.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.482+0000 7f073ffff700 1 -- start start 2023-10-18T21:27:10.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.483+0000 7f073ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07400f6530 0x7f0740106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:10.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.483+0000 7f073ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07400f77d0 0x7f0740107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:10.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.483+0000 7f073ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0740107910 con 0x7f07400f6530 2023-10-18T21:27:10.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.483+0000 7f073ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0740108120 con 0x7f07400f77d0 2023-10-18T21:27:10.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.483+0000 7f073effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07400f6530 0x7f0740106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.483+0000 7f073effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07400f6530 0x7f0740106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57712/0 (socket says 172.21.15.8:57712) 2023-10-18T21:27:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.483+0000 7f073effd700 1 -- 172.21.15.8:0/2672328173 learned_addr learned my addr 172.21.15.8:0/2672328173 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.483+0000 7f073e7fc700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07400f77d0 0x7f0740107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.483+0000 7f073effd700 1 -- 172.21.15.8:0/2672328173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07400f77d0 msgr2=0x7f0740107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.484+0000 7f073effd700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07400f77d0 0x7f0740107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.484+0000 7f073effd700 1 -- 172.21.15.8:0/2672328173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0730005040 con 0x7f07400f6530 2023-10-18T21:27:10.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.484+0000 7f073effd700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07400f6530 0x7f0740106e20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f0730007a60 tx=0x7f0730009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:10.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.484+0000 7f07277fe700 1 -- 172.21.15.8:0/2672328173 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0730018070 con 0x7f07400f6530 2023-10-18T21:27:10.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.484+0000 7f07277fe700 1 -- 172.21.15.8:0/2672328173 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0730009630 con 0x7f07400f6530 2023-10-18T21:27:10.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.484+0000 7f073ffff700 1 -- 172.21.15.8:0/2672328173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0740108340 con 0x7f07400f6530 2023-10-18T21:27:10.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.484+0000 7f07277fe700 1 -- 172.21.15.8:0/2672328173 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f073001c540 con 0x7f07400f6530 2023-10-18T21:27:10.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.484+0000 7f073ffff700 1 -- 172.21.15.8:0/2672328173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07401088a0 con 0x7f07400f6530 2023-10-18T21:27:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.485+0000 7f073ffff700 1 -- 172.21.15.8:0/2672328173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0740059100 con 0x7f07400f6530 2023-10-18T21:27:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.486+0000 7f07277fe700 1 -- 172.21.15.8:0/2672328173 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f073001d420 con 0x7f07400f6530 2023-10-18T21:27:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.487+0000 7f07277fe700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 0x7f0728063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.487+0000 7f07277fe700 1 -- 172.21.15.8:0/2672328173 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f073007e600 con 0x7f07400f6530 2023-10-18T21:27:10.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.487+0000 7f073e7fc700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 0x7f0728063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:10.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.488+0000 7f073e7fc700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 0x7f0728063430 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f07340096c0 tx=0x7f0734009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:10.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.491+0000 7f07277fe700 1 -- 172.21.15.8:0/2672328173 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f073004e2f0 con 0x7f07400f6530 2023-10-18T21:27:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.694+0000 7f073ffff700 1 -- 172.21.15.8:0/2672328173 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07400fed30 con 0x7f0728060f70 2023-10-18T21:27:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.696+0000 7f07277fe700 1 -- 172.21.15.8:0/2672328173 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f07400fed30 con 0x7f0728060f70 2023-10-18T21:27:10.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 -- 172.21.15.8:0/2672328173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 msgr2=0x7f0728063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:10.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 0x7f0728063430 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f07340096c0 tx=0x7f0734009be0).stop 2023-10-18T21:27:10.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 -- 172.21.15.8:0/2672328173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07400f6530 msgr2=0x7f0740106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:10.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07400f6530 0x7f0740106e20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f0730007a60 tx=0x7f0730009b30).stop 2023-10-18T21:27:10.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 -- 172.21.15.8:0/2672328173 shutdown_connections 2023-10-18T21:27:10.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0728060f70 0x7f0728063430 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07400f6530 0x7f0740106e20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 --2- 172.21.15.8:0/2672328173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07400f77d0 0x7f0740107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 -- 172.21.15.8:0/2672328173 >> 172.21.15.8:0/2672328173 conn(0x7f07400f1c90 msgr2=0x7f07400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:10.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 -- 172.21.15.8:0/2672328173 shutdown_connections 2023-10-18T21:27:10.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.698+0000 7f073ffff700 1 -- 172.21.15.8:0/2672328173 wait complete. 2023-10-18T21:27:10.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.834+0000 7f0565916700 1 -- 172.21.15.8:0/4264667651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05600f6530 msgr2=0x7f05600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:10.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.834+0000 7f0565916700 1 --2- 172.21.15.8:0/4264667651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05600f6530 0x7f05600f6950 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f0554004660 tx=0x7f0554009b30).stop 2023-10-18T21:27:10.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.835+0000 7f0565916700 1 -- 172.21.15.8:0/4264667651 shutdown_connections 2023-10-18T21:27:10.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.835+0000 7f0565916700 1 --2- 172.21.15.8:0/4264667651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05600f77d0 0x7f05600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.835+0000 7f0565916700 1 --2- 172.21.15.8:0/4264667651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05600f6530 0x7f05600f6950 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.835+0000 7f0565916700 1 -- 172.21.15.8:0/4264667651 >> 172.21.15.8:0/4264667651 conn(0x7f05600f1c90 msgr2=0x7f05600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:10.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.835+0000 7f0565916700 1 -- 172.21.15.8:0/4264667651 shutdown_connections 2023-10-18T21:27:10.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.835+0000 7f0565916700 1 -- 172.21.15.8:0/4264667651 wait complete. 2023-10-18T21:27:10.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.835+0000 7f0565916700 1 Processor -- start 2023-10-18T21:27:10.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.836+0000 7f0565916700 1 -- start start 2023-10-18T21:27:10.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.836+0000 7f0565916700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05600f6530 0x7f0560106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:10.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.836+0000 7f0565916700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05600f77d0 0x7f0560107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:10.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.836+0000 7f0565916700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0560107900 con 0x7f05600f6530 2023-10-18T21:27:10.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.836+0000 7f0565916700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0560108110 con 0x7f05600f77d0 2023-10-18T21:27:10.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.836+0000 7f0564914700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05600f6530 0x7f0560106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:10.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.836+0000 7f0564914700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05600f6530 0x7f0560106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57734/0 (socket says 172.21.15.8:57734) 2023-10-18T21:27:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.836+0000 7f0564914700 1 -- 172.21.15.8:0/3148574449 learned_addr learned my addr 172.21.15.8:0/3148574449 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.837+0000 7f055ffff700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05600f77d0 0x7f0560107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.837+0000 7f0564914700 1 -- 172.21.15.8:0/3148574449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05600f77d0 msgr2=0x7f0560107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.837+0000 7f0564914700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05600f77d0 0x7f0560107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.837+0000 7f0564914700 1 -- 172.21.15.8:0/3148574449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554005040 con 0x7f05600f6530 2023-10-18T21:27:10.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.837+0000 7f0564914700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05600f6530 0x7f0560106e10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f0554007a60 tx=0x7f0554009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:10.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.837+0000 7f055d7fa700 1 -- 172.21.15.8:0/3148574449 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0554018070 con 0x7f05600f6530 2023-10-18T21:27:10.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.837+0000 7f055d7fa700 1 -- 172.21.15.8:0/3148574449 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0554009630 con 0x7f05600f6530 2023-10-18T21:27:10.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.837+0000 7f055d7fa700 1 -- 172.21.15.8:0/3148574449 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055401c540 con 0x7f05600f6530 2023-10-18T21:27:10.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.837+0000 7f0565916700 1 -- 172.21.15.8:0/3148574449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0560108330 con 0x7f05600f6530 2023-10-18T21:27:10.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.837+0000 7f0565916700 1 -- 172.21.15.8:0/3148574449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0560108890 con 0x7f05600f6530 2023-10-18T21:27:10.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.838+0000 7f0565916700 1 -- 172.21.15.8:0/3148574449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0560059100 con 0x7f05600f6530 2023-10-18T21:27:10.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.839+0000 7f055d7fa700 1 -- 172.21.15.8:0/3148574449 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f055401c7b0 con 0x7f05600f6530 2023-10-18T21:27:10.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.840+0000 7f055d7fa700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0550060f70 0x7f0550063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:10.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.840+0000 7f055d7fa700 1 -- 172.21.15.8:0/3148574449 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f055407e760 con 0x7f05600f6530 2023-10-18T21:27:10.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.841+0000 7f055ffff700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0550060f70 0x7f0550063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:10.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.841+0000 7f055ffff700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0550060f70 0x7f0550063430 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f054c004a70 tx=0x7f054c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:10.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:10.845+0000 7f055d7fa700 1 -- 172.21.15.8:0/3148574449 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f055404e310 con 0x7f05600f6530 2023-10-18T21:27:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.140940+0000 mon.smithi008 (mon.0) 2156 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.142527+0000 mon.smithi008 (mon.0) 2157 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.143225+0000 mon.smithi008 (mon.0) 2158 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.149863+0000 mon.smithi008 (mon.0) 2159 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.155869+0000 mon.smithi008 (mon.0) 2160 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:10.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.158875+0000 mon.smithi008 (mon.0) 2161 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:10.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.160198+0000 mon.smithi008 (mon.0) 2162 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:10.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.161409+0000 mon.smithi008 (mon.0) 2163 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:10.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.162968+0000 mon.smithi008 (mon.0) 2164 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:10.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.140940+0000 mon.smithi008 (mon.0) 2156 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.142527+0000 mon.smithi008 (mon.0) 2157 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.143225+0000 mon.smithi008 (mon.0) 2158 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.149863+0000 mon.smithi008 (mon.0) 2159 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.155869+0000 mon.smithi008 (mon.0) 2160 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.158875+0000 mon.smithi008 (mon.0) 2161 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.160198+0000 mon.smithi008 (mon.0) 2162 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:10.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.161409+0000 mon.smithi008 (mon.0) 2163 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:10.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.162968+0000 mon.smithi008 (mon.0) 2164 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:11.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.038+0000 7f0565916700 1 -- 172.21.15.8:0/3148574449 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f05600fed30 con 0x7f0550060f70 2023-10-18T21:27:11.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.048+0000 7f055d7fa700 1 -- 172.21.15.8:0/3148574449 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f05600fed30 con 0x7f0550060f70 2023-10-18T21:27:11.049 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:27:11.049 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (33m) 102s ago 35m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:27:11.049 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (27m) 102s ago 35m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:27:11.049 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (27m) 9m ago 34m 8002k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:27:11.049 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (33m) 102s ago 34m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:27:11.050 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 102s ago 31m - - 2023-10-18T21:27:11.050 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 102s ago 31m - - 2023-10-18T21:27:11.050 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 31m - - 2023-10-18T21:27:11.050 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 31m - - 2023-10-18T21:27:11.050 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (29m) 102s ago 36m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:27:11.051 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (28m) 9m ago 34m 401M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:27:11.051 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (28m) 102s ago 36m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:27:11.051 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (27m) 9m ago 34m 126M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:27:11.051 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (34m) 102s ago 34m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:27:11.051 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (34m) 9m ago 34m 10.3M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:27:11.051 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (27m) 102s ago 33m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:27:11.052 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (25m) 102s ago 33m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:27:11.052 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (24m) 102s ago 33m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:27:11.052 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (24m) 9m ago 32m 392M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:27:11.052 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (23m) 9m ago 32m 351M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:27:11.052 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (23m) 9m ago 32m 272M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:27:11.052 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (29m) 102s ago 34m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:27:11.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 -- 172.21.15.8:0/3148574449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0550060f70 msgr2=0x7f0550063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0550060f70 0x7f0550063430 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f054c004a70 tx=0x7f054c00b040).stop 2023-10-18T21:27:11.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 -- 172.21.15.8:0/3148574449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05600f6530 msgr2=0x7f0560106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05600f6530 0x7f0560106e10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f0554007a60 tx=0x7f0554009b30).stop 2023-10-18T21:27:11.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 -- 172.21.15.8:0/3148574449 shutdown_connections 2023-10-18T21:27:11.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0550060f70 0x7f0550063430 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05600f6530 0x7f0560106e10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 --2- 172.21.15.8:0/3148574449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05600f77d0 0x7f0560107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 -- 172.21.15.8:0/3148574449 >> 172.21.15.8:0/3148574449 conn(0x7f05600f1c90 msgr2=0x7f05600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:11.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 -- 172.21.15.8:0/3148574449 shutdown_connections 2023-10-18T21:27:11.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.050+0000 7f0565916700 1 -- 172.21.15.8:0/3148574449 wait complete. 2023-10-18T21:27:11.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.185+0000 7fdb74e8f700 1 -- 172.21.15.8:0/429981882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb700f96d0 msgr2=0x7fdb700fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.185+0000 7fdb74e8f700 1 --2- 172.21.15.8:0/429981882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb700f96d0 0x7fdb700fbae0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fdb64004660 tx=0x7fdb64009b30).stop 2023-10-18T21:27:11.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.185+0000 7fdb74e8f700 1 -- 172.21.15.8:0/429981882 shutdown_connections 2023-10-18T21:27:11.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.185+0000 7fdb74e8f700 1 --2- 172.21.15.8:0/429981882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb700f96d0 0x7fdb700fbae0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.185+0000 7fdb74e8f700 1 --2- 172.21.15.8:0/429981882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb700602d0 0x7fdb700f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.185+0000 7fdb74e8f700 1 -- 172.21.15.8:0/429981882 >> 172.21.15.8:0/429981882 conn(0x7fdb700f0b90 msgr2=0x7fdb700f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:11.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.185+0000 7fdb74e8f700 1 -- 172.21.15.8:0/429981882 shutdown_connections 2023-10-18T21:27:11.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.186+0000 7fdb74e8f700 1 -- 172.21.15.8:0/429981882 wait complete. 2023-10-18T21:27:11.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.186+0000 7fdb74e8f700 1 Processor -- start 2023-10-18T21:27:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.186+0000 7fdb74e8f700 1 -- start start 2023-10-18T21:27:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb74e8f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb700602d0 0x7fdb70106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb74e8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb700f96d0 0x7fdb701072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb74e8f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb701078a0 con 0x7fdb700f96d0 2023-10-18T21:27:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb74e8f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb701080e0 con 0x7fdb700602d0 2023-10-18T21:27:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb6effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb700f96d0 0x7fdb701072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb6effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb700f96d0 0x7fdb701072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57752/0 (socket says 172.21.15.8:57752) 2023-10-18T21:27:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb6effd700 1 -- 172.21.15.8:0/740647480 learned_addr learned my addr 172.21.15.8:0/740647480 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb6f7fe700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb700602d0 0x7fdb70106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb6effd700 1 -- 172.21.15.8:0/740647480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb700602d0 msgr2=0x7fdb70106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb6effd700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb700602d0 0x7fdb70106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb6effd700 1 -- 172.21.15.8:0/740647480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb64005040 con 0x7fdb700f96d0 2023-10-18T21:27:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.187+0000 7fdb6f7fe700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb700602d0 0x7fdb70106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:27:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.188+0000 7fdb6effd700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb700f96d0 0x7fdb701072a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fdb64004e30 tx=0x7fdb64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.188+0000 7fdb57fff700 1 -- 172.21.15.8:0/740647480 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb64018070 con 0x7fdb700f96d0 2023-10-18T21:27:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.188+0000 7fdb57fff700 1 -- 172.21.15.8:0/740647480 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdb64009630 con 0x7fdb700f96d0 2023-10-18T21:27:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.188+0000 7fdb74e8f700 1 -- 172.21.15.8:0/740647480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb70108360 con 0x7fdb700f96d0 2023-10-18T21:27:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.188+0000 7fdb57fff700 1 -- 172.21.15.8:0/740647480 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb6401c3c0 con 0x7fdb700f96d0 2023-10-18T21:27:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.188+0000 7fdb74e8f700 1 -- 172.21.15.8:0/740647480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb70108840 con 0x7fdb700f96d0 2023-10-18T21:27:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.189+0000 7fdb74e8f700 1 -- 172.21.15.8:0/740647480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb70059100 con 0x7fdb700f96d0 2023-10-18T21:27:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.190+0000 7fdb57fff700 1 -- 172.21.15.8:0/740647480 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdb6401d420 con 0x7fdb700f96d0 2023-10-18T21:27:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.191+0000 7fdb57fff700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb58060f70 0x7fdb58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.191+0000 7fdb57fff700 1 -- 172.21.15.8:0/740647480 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdb6407e540 con 0x7fdb700f96d0 2023-10-18T21:27:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.191+0000 7fdb6f7fe700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb58060f70 0x7fdb58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.192+0000 7fdb6f7fe700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb58060f70 0x7fdb58063430 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fdb70107b70 tx=0x7fdb60009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:11.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.195+0000 7fdb57fff700 1 -- 172.21.15.8:0/740647480 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdb6404e220 con 0x7fdb700f96d0 2023-10-18T21:27:11.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.455+0000 7fdb74e8f700 1 -- 172.21.15.8:0/740647480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdb700fecc0 con 0x7fdb700f96d0 2023-10-18T21:27:11.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.455+0000 7fdb57fff700 1 -- 172.21.15.8:0/740647480 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fdb64051840 con 0x7fdb700f96d0 2023-10-18T21:27:11.456 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:27:11.457 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:27:11.457 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:27:11.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:27:11.457 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:27:11.457 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:27:11.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:27:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:27:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:27:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:27:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:27:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:27:11.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:27:11.459 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:27:11.459 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:27:11.459 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:27:11.459 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:27:11.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.457+0000 7fdb74e8f700 1 -- 172.21.15.8:0/740647480 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb58060f70 msgr2=0x7fdb58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.457+0000 7fdb74e8f700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb58060f70 0x7fdb58063430 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fdb70107b70 tx=0x7fdb60009c00).stop 2023-10-18T21:27:11.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.457+0000 7fdb74e8f700 1 -- 172.21.15.8:0/740647480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb700f96d0 msgr2=0x7fdb701072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.457+0000 7fdb74e8f700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb700f96d0 0x7fdb701072a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fdb64004e30 tx=0x7fdb64009b30).stop 2023-10-18T21:27:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.458+0000 7fdb74e8f700 1 -- 172.21.15.8:0/740647480 shutdown_connections 2023-10-18T21:27:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.458+0000 7fdb74e8f700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb58060f70 0x7fdb58063430 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.458+0000 7fdb74e8f700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb700602d0 0x7fdb70106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.458+0000 7fdb74e8f700 1 --2- 172.21.15.8:0/740647480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb700f96d0 0x7fdb701072a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.458+0000 7fdb74e8f700 1 -- 172.21.15.8:0/740647480 >> 172.21.15.8:0/740647480 conn(0x7fdb700f0b90 msgr2=0x7fdb700f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:11.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.458+0000 7fdb74e8f700 1 -- 172.21.15.8:0/740647480 shutdown_connections 2023-10-18T21:27:11.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.458+0000 7fdb74e8f700 1 -- 172.21.15.8:0/740647480 wait complete. 2023-10-18T21:27:11.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.596+0000 7fb009bb8700 1 -- 172.21.15.8:0/2998331332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0040f6530 msgr2=0x7fb0040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.596+0000 7fb009bb8700 1 --2- 172.21.15.8:0/2998331332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0040f6530 0x7fb0040f6950 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7faff8004660 tx=0x7faff8009b30).stop 2023-10-18T21:27:11.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.596+0000 7fb009bb8700 1 -- 172.21.15.8:0/2998331332 shutdown_connections 2023-10-18T21:27:11.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.596+0000 7fb009bb8700 1 --2- 172.21.15.8:0/2998331332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0040f77d0 0x7fb0040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.596+0000 7fb009bb8700 1 --2- 172.21.15.8:0/2998331332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0040f6530 0x7fb0040f6950 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.596+0000 7fb009bb8700 1 -- 172.21.15.8:0/2998331332 >> 172.21.15.8:0/2998331332 conn(0x7fb0040f1c90 msgr2=0x7fb0040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:11.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.596+0000 7fb009bb8700 1 -- 172.21.15.8:0/2998331332 shutdown_connections 2023-10-18T21:27:11.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.596+0000 7fb009bb8700 1 -- 172.21.15.8:0/2998331332 wait complete. 2023-10-18T21:27:11.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.597+0000 7fb009bb8700 1 Processor -- start 2023-10-18T21:27:11.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.597+0000 7fb009bb8700 1 -- start start 2023-10-18T21:27:11.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb009bb8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0040f6530 0x7fb004108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:11.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb009bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0040f77d0 0x7fb004109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:11.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb009bb8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004109a00 con 0x7fb0040f6530 2023-10-18T21:27:11.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb009bb8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004109b40 con 0x7fb0040f77d0 2023-10-18T21:27:11.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb008bb6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0040f6530 0x7fb004108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:11.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb008bb6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0040f6530 0x7fb004108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57782/0 (socket says 172.21.15.8:57782) 2023-10-18T21:27:11.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb008bb6700 1 -- 172.21.15.8:0/3976419442 learned_addr learned my addr 172.21.15.8:0/3976419442 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:11.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb003fff700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0040f77d0 0x7fb004109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:11.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb008bb6700 1 -- 172.21.15.8:0/3976419442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0040f77d0 msgr2=0x7fb004109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb008bb6700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0040f77d0 0x7fb004109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.598+0000 7fb008bb6700 1 -- 172.21.15.8:0/3976419442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8005040 con 0x7fb0040f6530 2023-10-18T21:27:11.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.599+0000 7fb008bb6700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0040f6530 0x7fb004108f60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7faff8014040 tx=0x7faff800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:11.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.599+0000 7fb0017fa700 1 -- 172.21.15.8:0/3976419442 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faff8019070 con 0x7fb0040f6530 2023-10-18T21:27:11.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.599+0000 7fb0017fa700 1 -- 172.21.15.8:0/3976419442 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faff801e420 con 0x7fb0040f6530 2023-10-18T21:27:11.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.599+0000 7fb0017fa700 1 -- 172.21.15.8:0/3976419442 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faff8014620 con 0x7fb0040f6530 2023-10-18T21:27:11.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.599+0000 7fb009bb8700 1 -- 172.21.15.8:0/3976419442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00410a480 con 0x7fb0040f6530 2023-10-18T21:27:11.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.599+0000 7fb009bb8700 1 -- 172.21.15.8:0/3976419442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00410a960 con 0x7fb0040f6530 2023-10-18T21:27:11.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.600+0000 7fb009bb8700 1 -- 172.21.15.8:0/3976419442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb004045ad0 con 0x7fb0040f6530 2023-10-18T21:27:11.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.601+0000 7fb0017fa700 1 -- 172.21.15.8:0/3976419442 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faff801e9e0 con 0x7fb0040f6530 2023-10-18T21:27:11.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.602+0000 7fb0017fa700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faff4060f70 0x7faff4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:11.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.602+0000 7fb0017fa700 1 -- 172.21.15.8:0/3976419442 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faff807dcb0 con 0x7fb0040f6530 2023-10-18T21:27:11.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.602+0000 7fb003fff700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faff4060f70 0x7faff4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:11.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.602+0000 7fb003fff700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faff4060f70 0x7faff4063430 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7faff0009fd0 tx=0x7faff000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:11.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.606+0000 7fb0017fa700 1 -- 172.21.15.8:0/3976419442 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faff8051310 con 0x7fb0040f6530 2023-10-18T21:27:11.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.832+0000 7fb009bb8700 1 -- 172.21.15.8:0/3976419442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb0040fee40 con 0x7fb0040f6530 2023-10-18T21:27:11.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.832+0000 7fb0017fa700 1 -- 172.21.15.8:0/3976419442 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7faff8050f00 con 0x7fb0040f6530 2023-10-18T21:27:11.834 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:27:11.834 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:27:11.834 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:27:11.834 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:27:11.834 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:27:11.835 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:27:11.835 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:27:11.835 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:27:11.835 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:27:11.835 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:27:11.836 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:27:11.836 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:27:11.836 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:27:11.836 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:27:11.836 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:27:11.837 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:27:11.837 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:27:11.837 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:27:11.837 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:27:11.837 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:27:11.838 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:27:11.838 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:27:11.838 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:27:11.838 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:27:11.838 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:27:11.839 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:27:11.839 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:27:11.839 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:27:11.839 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:27:11.839 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:27:11.840 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:27:11.840 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:27:11.840 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:27:11.840 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:27:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.834+0000 7fb009bb8700 1 -- 172.21.15.8:0/3976419442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faff4060f70 msgr2=0x7faff4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.834+0000 7fb009bb8700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faff4060f70 0x7faff4063430 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7faff0009fd0 tx=0x7faff000b040).stop 2023-10-18T21:27:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.834+0000 7fb009bb8700 1 -- 172.21.15.8:0/3976419442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0040f6530 msgr2=0x7fb004108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.834+0000 7fb009bb8700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0040f6530 0x7fb004108f60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7faff8014040 tx=0x7faff800b040).stop 2023-10-18T21:27:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.834+0000 7fb009bb8700 1 -- 172.21.15.8:0/3976419442 shutdown_connections 2023-10-18T21:27:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.834+0000 7fb009bb8700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faff4060f70 0x7faff4063430 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.834+0000 7fb009bb8700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0040f6530 0x7fb004108f60 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.834+0000 7fb009bb8700 1 --2- 172.21.15.8:0/3976419442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0040f77d0 0x7fb004109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.834+0000 7fb009bb8700 1 -- 172.21.15.8:0/3976419442 >> 172.21.15.8:0/3976419442 conn(0x7fb0040f1c90 msgr2=0x7fb00406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.834+0000 7fb009bb8700 1 -- 172.21.15.8:0/3976419442 shutdown_connections 2023-10-18T21:27:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.835+0000 7fb009bb8700 1 -- 172.21.15.8:0/3976419442 wait complete. 2023-10-18T21:27:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:27:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:10.112326+0000 mgr.smithi008.flmjzp (mgr.14640) 1698 : cluster [DBG] pgmap v1178: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:10.143867+0000 mgr.smithi008.flmjzp (mgr.14640) 1699 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:10.144319+0000 mgr.smithi008.flmjzp (mgr.14640) 1700 : cluster [DBG] pgmap v1179: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:10.144526+0000 mgr.smithi008.flmjzp (mgr.14640) 1701 : cluster [DBG] pgmap v1180: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:10.164607+0000 mgr.smithi008.flmjzp (mgr.14640) 1702 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.341416+0000 mgr.smithi008.flmjzp (mgr.14640) 1703 : audit [DBG] from='client.35536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:10.696048+0000 mgr.smithi008.flmjzp (mgr.14640) 1704 : audit [DBG] from='client.35540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:11.455933+0000 mon.smithi008 (mon.0) 2165 : audit [DBG] from='client.? 172.21.15.8:0/740647480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.972+0000 7f3215ffa700 1 -- 172.21.15.8:0/3510110327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32100f77d0 msgr2=0x7f32100f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.972+0000 7f3215ffa700 1 --2- 172.21.15.8:0/3510110327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32100f77d0 0x7f32100f7c30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f31fc004660 tx=0x7f31fc009b30).stop 2023-10-18T21:27:11.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.972+0000 7f3215ffa700 1 -- 172.21.15.8:0/3510110327 shutdown_connections 2023-10-18T21:27:11.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.972+0000 7f3215ffa700 1 --2- 172.21.15.8:0/3510110327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32100f77d0 0x7f32100f7c30 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.972+0000 7f3215ffa700 1 --2- 172.21.15.8:0/3510110327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32100f6530 0x7f32100f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.972+0000 7f3215ffa700 1 -- 172.21.15.8:0/3510110327 >> 172.21.15.8:0/3510110327 conn(0x7f32100f1c90 msgr2=0x7f32100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:11.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.973+0000 7f3215ffa700 1 -- 172.21.15.8:0/3510110327 shutdown_connections 2023-10-18T21:27:11.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.973+0000 7f3215ffa700 1 -- 172.21.15.8:0/3510110327 wait complete. 2023-10-18T21:27:11.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.973+0000 7f3215ffa700 1 Processor -- start 2023-10-18T21:27:11.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.974+0000 7f3215ffa700 1 -- start start 2023-10-18T21:27:11.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.974+0000 7f3215ffa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32100f6530 0x7f3210108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:11.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.974+0000 7f3215ffa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32100f77d0 0x7f3210109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:11.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.974+0000 7f3215ffa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32101099d0 con 0x7f32100f77d0 2023-10-18T21:27:11.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.974+0000 7f3215ffa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3210109b10 con 0x7f32100f6530 2023-10-18T21:27:11.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.974+0000 7f320ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32100f77d0 0x7f3210109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:11.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.974+0000 7f320ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32100f77d0 0x7f3210109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57810/0 (socket says 172.21.15.8:57810) 2023-10-18T21:27:11.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.974+0000 7f320ffff700 1 -- 172.21.15.8:0/2280064557 learned_addr learned my addr 172.21.15.8:0/2280064557 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:11.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.974+0000 7f3214ff8700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32100f6530 0x7f3210108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:11.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.975+0000 7f320ffff700 1 -- 172.21.15.8:0/2280064557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32100f6530 msgr2=0x7f3210108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:11.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.975+0000 7f320ffff700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32100f6530 0x7f3210108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:11.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.975+0000 7f320ffff700 1 -- 172.21.15.8:0/2280064557 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc005040 con 0x7f32100f77d0 2023-10-18T21:27:11.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.975+0000 7f320ffff700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32100f77d0 0x7f3210109420 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f31fc009990 tx=0x7f31fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:11.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.975+0000 7f320d7fa700 1 -- 172.21.15.8:0/2280064557 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31fc018070 con 0x7f32100f77d0 2023-10-18T21:27:11.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.975+0000 7f320d7fa700 1 -- 172.21.15.8:0/2280064557 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f31fc009630 con 0x7f32100f77d0 2023-10-18T21:27:11.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.975+0000 7f3215ffa700 1 -- 172.21.15.8:0/2280064557 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321010a450 con 0x7f32100f77d0 2023-10-18T21:27:11.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.975+0000 7f320d7fa700 1 -- 172.21.15.8:0/2280064557 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31fc01c3c0 con 0x7f32100f77d0 2023-10-18T21:27:11.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.975+0000 7f3215ffa700 1 -- 172.21.15.8:0/2280064557 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321010a9b0 con 0x7f32100f77d0 2023-10-18T21:27:11.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.976+0000 7f3215ffa700 1 -- 172.21.15.8:0/2280064557 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3210045ad0 con 0x7f32100f77d0 2023-10-18T21:27:11.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.977+0000 7f320d7fa700 1 -- 172.21.15.8:0/2280064557 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f31fc01d970 con 0x7f32100f77d0 2023-10-18T21:27:11.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.978+0000 7f320d7fa700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3200060f70 0x7f3200063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:11.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.978+0000 7f320d7fa700 1 -- 172.21.15.8:0/2280064557 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f31fc07e660 con 0x7f32100f77d0 2023-10-18T21:27:11.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.978+0000 7f3214ff8700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3200060f70 0x7f3200063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:11.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.979+0000 7f3214ff8700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3200060f70 0x7f3200063430 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f32100f7630 tx=0x7f320400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:11.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:11.982+0000 7f320d7fa700 1 -- 172.21.15.8:0/2280064557 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f31fc051c40 con 0x7f32100f77d0 2023-10-18T21:27:11.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:10.112326+0000 mgr.smithi008.flmjzp (mgr.14640) 1698 : cluster [DBG] pgmap v1178: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:11.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:10.143867+0000 mgr.smithi008.flmjzp (mgr.14640) 1699 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:10.144319+0000 mgr.smithi008.flmjzp (mgr.14640) 1700 : cluster [DBG] pgmap v1179: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:10.144526+0000 mgr.smithi008.flmjzp (mgr.14640) 1701 : cluster [DBG] pgmap v1180: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:10.164607+0000 mgr.smithi008.flmjzp (mgr.14640) 1702 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.341416+0000 mgr.smithi008.flmjzp (mgr.14640) 1703 : audit [DBG] from='client.35536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:10.696048+0000 mgr.smithi008.flmjzp (mgr.14640) 1704 : audit [DBG] from='client.35540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:11.455933+0000 mon.smithi008 (mon.0) 2165 : audit [DBG] from='client.? 172.21.15.8:0/740647480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:12.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.180+0000 7f3215ffa700 1 -- 172.21.15.8:0/2280064557 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f321010abd0 con 0x7f3200060f70 2023-10-18T21:27:12.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.182+0000 7f320d7fa700 1 -- 172.21.15.8:0/2280064557 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f321010abd0 con 0x7f3200060f70 2023-10-18T21:27:12.182 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:27:12.183 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:27:12.183 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:27:12.183 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:27:12.183 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:27:12.183 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:27:12.184 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:27:12.184 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:27:12.184 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:27:12.184 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:27:12.184 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:27:12.185 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:27:12.185 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:27:12.185 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:27:12.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 -- 172.21.15.8:0/2280064557 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3200060f70 msgr2=0x7f3200063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:12.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3200060f70 0x7f3200063430 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f32100f7630 tx=0x7f320400b040).stop 2023-10-18T21:27:12.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 -- 172.21.15.8:0/2280064557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32100f77d0 msgr2=0x7f3210109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:12.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32100f77d0 0x7f3210109420 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f31fc009990 tx=0x7f31fc009b30).stop 2023-10-18T21:27:12.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 -- 172.21.15.8:0/2280064557 shutdown_connections 2023-10-18T21:27:12.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3200060f70 0x7f3200063430 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:12.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32100f6530 0x7f3210108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:12.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 --2- 172.21.15.8:0/2280064557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32100f77d0 0x7f3210109420 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:12.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 -- 172.21.15.8:0/2280064557 >> 172.21.15.8:0/2280064557 conn(0x7f32100f1c90 msgr2=0x7f321006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:12.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 -- 172.21.15.8:0/2280064557 shutdown_connections 2023-10-18T21:27:12.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:12.184+0000 7f3215ffa700 1 -- 172.21.15.8:0/2280064557 wait complete. 2023-10-18T21:27:12.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:11.039712+0000 mgr.smithi008.flmjzp (mgr.14640) 1705 : audit [DBG] from='client.35544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:12.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:11.833020+0000 mon.smithi008 (mon.0) 2166 : audit [DBG] from='client.? 172.21.15.8:0/3976419442' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:27:12.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:11.039712+0000 mgr.smithi008.flmjzp (mgr.14640) 1705 : audit [DBG] from='client.35544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:11.833020+0000 mon.smithi008 (mon.0) 2166 : audit [DBG] from='client.? 172.21.15.8:0/3976419442' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:27:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:12.145082+0000 mgr.smithi008.flmjzp (mgr.14640) 1706 : cluster [DBG] pgmap v1181: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:12.181928+0000 mgr.smithi008.flmjzp (mgr.14640) 1707 : audit [DBG] from='client.35556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:13.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:12.145082+0000 mgr.smithi008.flmjzp (mgr.14640) 1706 : cluster [DBG] pgmap v1181: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:13.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:12.181928+0000 mgr.smithi008.flmjzp (mgr.14640) 1707 : audit [DBG] from='client.35556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:14.145930+0000 mgr.smithi008.flmjzp (mgr.14640) 1708 : cluster [DBG] pgmap v1182: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:15.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:14.145930+0000 mgr.smithi008.flmjzp (mgr.14640) 1708 : cluster [DBG] pgmap v1182: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:16.146762+0000 mgr.smithi008.flmjzp (mgr.14640) 1709 : cluster [DBG] pgmap v1183: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:17.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:16.146762+0000 mgr.smithi008.flmjzp (mgr.14640) 1709 : cluster [DBG] pgmap v1183: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:18.147248+0000 mgr.smithi008.flmjzp (mgr.14640) 1710 : cluster [DBG] pgmap v1184: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:18.147248+0000 mgr.smithi008.flmjzp (mgr.14640) 1710 : cluster [DBG] pgmap v1184: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:20.175091+0000 mon.smithi008 (mon.0) 2167 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:20.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:20.175091+0000 mon.smithi008 (mon.0) 2167 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:20.147908+0000 mgr.smithi008.flmjzp (mgr.14640) 1711 : cluster [DBG] pgmap v1185: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:20.742310+0000 mon.smithi008 (mon.0) 2168 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:20.743160+0000 mon.smithi008 (mon.0) 2169 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:20.743859+0000 mgr.smithi008.flmjzp (mgr.14640) 1712 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:20.744419+0000 mgr.smithi008.flmjzp (mgr.14640) 1713 : cluster [DBG] pgmap v1186: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:20.744645+0000 mgr.smithi008.flmjzp (mgr.14640) 1714 : cluster [DBG] pgmap v1187: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:20.748654+0000 mon.smithi008 (mon.0) 2170 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:20.754066+0000 mon.smithi008 (mon.0) 2171 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:20.756373+0000 mon.smithi008 (mon.0) 2172 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:20.757570+0000 mon.smithi008 (mon.0) 2173 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:20.758719+0000 mon.smithi008 (mon.0) 2174 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:20.760181+0000 mon.smithi008 (mon.0) 2175 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:21.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:20.761738+0000 mgr.smithi008.flmjzp (mgr.14640) 1715 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:21.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:20.147908+0000 mgr.smithi008.flmjzp (mgr.14640) 1711 : cluster [DBG] pgmap v1185: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:20.742310+0000 mon.smithi008 (mon.0) 2168 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:20.743160+0000 mon.smithi008 (mon.0) 2169 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:20.743859+0000 mgr.smithi008.flmjzp (mgr.14640) 1712 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:20.744419+0000 mgr.smithi008.flmjzp (mgr.14640) 1713 : cluster [DBG] pgmap v1186: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:20.744645+0000 mgr.smithi008.flmjzp (mgr.14640) 1714 : cluster [DBG] pgmap v1187: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:20.748654+0000 mon.smithi008 (mon.0) 2170 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:20.754066+0000 mon.smithi008 (mon.0) 2171 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:20.756373+0000 mon.smithi008 (mon.0) 2172 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:20.757570+0000 mon.smithi008 (mon.0) 2173 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:21.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:20.758719+0000 mon.smithi008 (mon.0) 2174 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:21.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:20.760181+0000 mon.smithi008 (mon.0) 2175 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:21.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:20.761738+0000 mgr.smithi008.flmjzp (mgr.14640) 1715 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:22.745237+0000 mgr.smithi008.flmjzp (mgr.14640) 1716 : cluster [DBG] pgmap v1188: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:24.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:22.745237+0000 mgr.smithi008.flmjzp (mgr.14640) 1716 : cluster [DBG] pgmap v1188: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:26.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:24.745927+0000 mgr.smithi008.flmjzp (mgr.14640) 1717 : cluster [DBG] pgmap v1189: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:26.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:24.745927+0000 mgr.smithi008.flmjzp (mgr.14640) 1717 : cluster [DBG] pgmap v1189: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:26.746664+0000 mgr.smithi008.flmjzp (mgr.14640) 1718 : cluster [DBG] pgmap v1190: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:26.746664+0000 mgr.smithi008.flmjzp (mgr.14640) 1718 : cluster [DBG] pgmap v1190: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:30.155 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:28.747365+0000 mgr.smithi008.flmjzp (mgr.14640) 1719 : cluster [DBG] pgmap v1191: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:30.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:28.747365+0000 mgr.smithi008.flmjzp (mgr.14640) 1719 : cluster [DBG] pgmap v1191: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:31.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:30.748037+0000 mgr.smithi008.flmjzp (mgr.14640) 1720 : cluster [DBG] pgmap v1192: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:30.770810+0000 mon.smithi008 (mon.0) 2176 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:30.748037+0000 mgr.smithi008.flmjzp (mgr.14640) 1720 : cluster [DBG] pgmap v1192: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:30.770810+0000 mon.smithi008 (mon.0) 2176 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:32.748743+0000 mgr.smithi008.flmjzp (mgr.14640) 1721 : cluster [DBG] pgmap v1193: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:33.257087+0000 mon.smithi008 (mon.0) 2177 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:33.258101+0000 mon.smithi008 (mon.0) 2178 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:33.259322+0000 mon.smithi008 (mon.0) 2179 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:33.265310+0000 mon.smithi008 (mon.0) 2180 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:33.273182+0000 mon.smithi008 (mon.0) 2181 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:33.276748+0000 mon.smithi008 (mon.0) 2182 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:33.278738+0000 mon.smithi008 (mon.0) 2183 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:33.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:33.280711+0000 mon.smithi008 (mon.0) 2184 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:33.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:33.283409+0000 mon.smithi008 (mon.0) 2185 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:34.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:32.748743+0000 mgr.smithi008.flmjzp (mgr.14640) 1721 : cluster [DBG] pgmap v1193: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:33.257087+0000 mon.smithi008 (mon.0) 2177 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:33.258101+0000 mon.smithi008 (mon.0) 2178 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:33.259322+0000 mon.smithi008 (mon.0) 2179 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:33.265310+0000 mon.smithi008 (mon.0) 2180 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:33.273182+0000 mon.smithi008 (mon.0) 2181 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:33.276748+0000 mon.smithi008 (mon.0) 2182 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:33.278738+0000 mon.smithi008 (mon.0) 2183 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:33.280711+0000 mon.smithi008 (mon.0) 2184 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:33.283409+0000 mon.smithi008 (mon.0) 2185 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:35.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:33.260330+0000 mgr.smithi008.flmjzp (mgr.14640) 1722 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:35.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:33.261002+0000 mgr.smithi008.flmjzp (mgr.14640) 1723 : cluster [DBG] pgmap v1194: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:35.149 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:33.261234+0000 mgr.smithi008.flmjzp (mgr.14640) 1724 : cluster [DBG] pgmap v1195: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:35.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:33.285516+0000 mgr.smithi008.flmjzp (mgr.14640) 1725 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:35.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:33.260330+0000 mgr.smithi008.flmjzp (mgr.14640) 1722 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:35.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:33.261002+0000 mgr.smithi008.flmjzp (mgr.14640) 1723 : cluster [DBG] pgmap v1194: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:33.261234+0000 mgr.smithi008.flmjzp (mgr.14640) 1724 : cluster [DBG] pgmap v1195: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:33.285516+0000 mgr.smithi008.flmjzp (mgr.14640) 1725 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:35.261857+0000 mgr.smithi008.flmjzp (mgr.14640) 1726 : cluster [DBG] pgmap v1196: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:37.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:35.261857+0000 mgr.smithi008.flmjzp (mgr.14640) 1726 : cluster [DBG] pgmap v1196: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:37.262353+0000 mgr.smithi008.flmjzp (mgr.14640) 1727 : cluster [DBG] pgmap v1197: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:39.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:37.262353+0000 mgr.smithi008.flmjzp (mgr.14640) 1727 : cluster [DBG] pgmap v1197: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:39.262940+0000 mgr.smithi008.flmjzp (mgr.14640) 1728 : cluster [DBG] pgmap v1198: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:39.262940+0000 mgr.smithi008.flmjzp (mgr.14640) 1728 : cluster [DBG] pgmap v1198: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.336+0000 7f1557113700 1 -- 172.21.15.8:0/3906644751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f155006b9c0 msgr2=0x7f1550069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.337+0000 7f1557113700 1 --2- 172.21.15.8:0/3906644751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f155006b9c0 0x7f1550069ec0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f154c004660 tx=0x7f154c009b30).stop 2023-10-18T21:27:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.337+0000 7f1557113700 1 -- 172.21.15.8:0/3906644751 shutdown_connections 2023-10-18T21:27:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.337+0000 7f1557113700 1 --2- 172.21.15.8:0/3906644751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f155006a3b0 0x7f155006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.337+0000 7f1557113700 1 --2- 172.21.15.8:0/3906644751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f155006b9c0 0x7f1550069ec0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.337+0000 7f1557113700 1 -- 172.21.15.8:0/3906644751 >> 172.21.15.8:0/3906644751 conn(0x7f15500f1c90 msgr2=0x7f15500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.337+0000 7f1557113700 1 -- 172.21.15.8:0/3906644751 shutdown_connections 2023-10-18T21:27:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.337+0000 7f1557113700 1 -- 172.21.15.8:0/3906644751 wait complete. 2023-10-18T21:27:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.338+0000 7f1557113700 1 Processor -- start 2023-10-18T21:27:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.338+0000 7f1557113700 1 -- start start 2023-10-18T21:27:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.338+0000 7f1557113700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f155006a3b0 0x7f1550108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:42.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.338+0000 7f1557113700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f155006b9c0 0x7f15501094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:42.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.338+0000 7f1557113700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1550109a50 con 0x7f155006a3b0 2023-10-18T21:27:42.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.338+0000 7f1557113700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1550109b90 con 0x7f155006b9c0 2023-10-18T21:27:42.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.338+0000 7f1556111700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f155006a3b0 0x7f1550108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:42.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.338+0000 7f1556111700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f155006a3b0 0x7f1550108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38148/0 (socket says 172.21.15.8:38148) 2023-10-18T21:27:42.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.338+0000 7f1556111700 1 -- 172.21.15.8:0/3155151303 learned_addr learned my addr 172.21.15.8:0/3155151303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:42.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.339+0000 7f1555910700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f155006b9c0 0x7f15501094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:42.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.339+0000 7f1556111700 1 -- 172.21.15.8:0/3155151303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f155006b9c0 msgr2=0x7f15501094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:42.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.339+0000 7f1556111700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f155006b9c0 0x7f15501094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.339+0000 7f1556111700 1 -- 172.21.15.8:0/3155151303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c005040 con 0x7f155006a3b0 2023-10-18T21:27:42.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.339+0000 7f1555910700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f155006b9c0 0x7f15501094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:27:42.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.339+0000 7f1556111700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f155006a3b0 0x7f1550108fb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f154c009830 tx=0x7f154c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:42.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.339+0000 7f1546ffd700 1 -- 172.21.15.8:0/3155151303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f154c018070 con 0x7f155006a3b0 2023-10-18T21:27:42.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.339+0000 7f1546ffd700 1 -- 172.21.15.8:0/3155151303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f154c01d8e0 con 0x7f155006a3b0 2023-10-18T21:27:42.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.339+0000 7f1557113700 1 -- 172.21.15.8:0/3155151303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155010a4d0 con 0x7f155006a3b0 2023-10-18T21:27:42.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.339+0000 7f1546ffd700 1 -- 172.21.15.8:0/3155151303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f154c01c540 con 0x7f155006a3b0 2023-10-18T21:27:42.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.340+0000 7f1557113700 1 -- 172.21.15.8:0/3155151303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155010aa30 con 0x7f155006a3b0 2023-10-18T21:27:42.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.341+0000 7f1557113700 1 -- 172.21.15.8:0/3155151303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1550045ad0 con 0x7f155006a3b0 2023-10-18T21:27:42.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.341+0000 7f1546ffd700 1 -- 172.21.15.8:0/3155151303 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f154c01da50 con 0x7f155006a3b0 2023-10-18T21:27:42.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.342+0000 7f1546ffd700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f153c060f70 0x7f153c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:42.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.342+0000 7f1546ffd700 1 -- 172.21.15.8:0/3155151303 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f154c07e7c0 con 0x7f155006a3b0 2023-10-18T21:27:42.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.343+0000 7f1555910700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f153c060f70 0x7f153c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:42.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.343+0000 7f1555910700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f153c060f70 0x7f153c063430 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f1540004a90 tx=0x7f1540009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:42.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.347+0000 7f1546ffd700 1 -- 172.21.15.8:0/3155151303 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f154c051e20 con 0x7f155006a3b0 2023-10-18T21:27:42.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.545+0000 7f1557113700 1 -- 172.21.15.8:0/3155151303 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1550100f20 con 0x7f153c060f70 2023-10-18T21:27:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.546+0000 7f1546ffd700 1 -- 172.21.15.8:0/3155151303 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1550100f20 con 0x7f153c060f70 2023-10-18T21:27:42.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.548+0000 7f1557113700 1 -- 172.21.15.8:0/3155151303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f153c060f70 msgr2=0x7f153c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:42.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.548+0000 7f1557113700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f153c060f70 0x7f153c063430 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f1540004a90 tx=0x7f1540009040).stop 2023-10-18T21:27:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.548+0000 7f1557113700 1 -- 172.21.15.8:0/3155151303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f155006a3b0 msgr2=0x7f1550108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.548+0000 7f1557113700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f155006a3b0 0x7f1550108fb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f154c009830 tx=0x7f154c009b30).stop 2023-10-18T21:27:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.548+0000 7f1557113700 1 -- 172.21.15.8:0/3155151303 shutdown_connections 2023-10-18T21:27:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.548+0000 7f1557113700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f153c060f70 0x7f153c063430 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.548+0000 7f1557113700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f155006a3b0 0x7f1550108fb0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.548+0000 7f1557113700 1 --2- 172.21.15.8:0/3155151303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f155006b9c0 0x7f15501094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.548+0000 7f1557113700 1 -- 172.21.15.8:0/3155151303 >> 172.21.15.8:0/3155151303 conn(0x7f15500f1c90 msgr2=0x7f15500fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.549+0000 7f1557113700 1 -- 172.21.15.8:0/3155151303 shutdown_connections 2023-10-18T21:27:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.549+0000 7f1557113700 1 -- 172.21.15.8:0/3155151303 wait complete. 2023-10-18T21:27:42.565 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:27:42.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.686+0000 7f48864e1700 1 -- 172.21.15.8:0/1200821730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48800f6530 msgr2=0x7f48800f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:42.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.686+0000 7f48864e1700 1 --2- 172.21.15.8:0/1200821730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48800f6530 0x7f48800f6950 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f487c004660 tx=0x7f487c009b30).stop 2023-10-18T21:27:42.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.686+0000 7f48864e1700 1 -- 172.21.15.8:0/1200821730 shutdown_connections 2023-10-18T21:27:42.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.686+0000 7f48864e1700 1 --2- 172.21.15.8:0/1200821730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48800f77d0 0x7f48800f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.686+0000 7f48864e1700 1 --2- 172.21.15.8:0/1200821730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48800f6530 0x7f48800f6950 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.686+0000 7f48864e1700 1 -- 172.21.15.8:0/1200821730 >> 172.21.15.8:0/1200821730 conn(0x7f48800f1c90 msgr2=0x7f48800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:42.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.686+0000 7f48864e1700 1 -- 172.21.15.8:0/1200821730 shutdown_connections 2023-10-18T21:27:42.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.686+0000 7f48864e1700 1 -- 172.21.15.8:0/1200821730 wait complete. 2023-10-18T21:27:42.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.687+0000 7f48864e1700 1 Processor -- start 2023-10-18T21:27:42.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.687+0000 7f48864e1700 1 -- start start 2023-10-18T21:27:42.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.687+0000 7f48864e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48800f6530 0x7f488006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:42.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.687+0000 7f48864e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48800f77d0 0x7f4880069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:42.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.687+0000 7f48864e1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488006a380 con 0x7f48800f77d0 2023-10-18T21:27:42.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.687+0000 7f48864e1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488006a4c0 con 0x7f48800f6530 2023-10-18T21:27:42.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.687+0000 7f4884cde700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48800f77d0 0x7f4880069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:42.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f4884cde700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48800f77d0 0x7f4880069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38170/0 (socket says 172.21.15.8:38170) 2023-10-18T21:27:42.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f4884cde700 1 -- 172.21.15.8:0/3616870470 learned_addr learned my addr 172.21.15.8:0/3616870470 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f48854df700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48800f6530 0x7f488006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f4884cde700 1 -- 172.21.15.8:0/3616870470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48800f6530 msgr2=0x7f488006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f4884cde700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48800f6530 0x7f488006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f4884cde700 1 -- 172.21.15.8:0/3616870470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c005040 con 0x7f48800f77d0 2023-10-18T21:27:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f48854df700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48800f6530 0x7f488006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:27:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f4884cde700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48800f77d0 0x7f4880069e20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f48700026d0 tx=0x7f4870009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f4875ffb700 1 -- 172.21.15.8:0/3616870470 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4870009320 con 0x7f48800f77d0 2023-10-18T21:27:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f4875ffb700 1 -- 172.21.15.8:0/3616870470 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f487000f040 con 0x7f48800f77d0 2023-10-18T21:27:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f4875ffb700 1 -- 172.21.15.8:0/3616870470 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48700148a0 con 0x7f48800f77d0 2023-10-18T21:27:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.688+0000 7f48864e1700 1 -- 172.21.15.8:0/3616870470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488006a7a0 con 0x7f48800f77d0 2023-10-18T21:27:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.689+0000 7f48864e1700 1 -- 172.21.15.8:0/3616870470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488010ede0 con 0x7f48800f77d0 2023-10-18T21:27:42.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.690+0000 7f48864e1700 1 -- 172.21.15.8:0/3616870470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4880045ad0 con 0x7f48800f77d0 2023-10-18T21:27:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.690+0000 7f4875ffb700 1 -- 172.21.15.8:0/3616870470 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4870009480 con 0x7f48800f77d0 2023-10-18T21:27:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.691+0000 7f4875ffb700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f486c060f70 0x7f486c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.691+0000 7f4875ffb700 1 -- 172.21.15.8:0/3616870470 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f487007cfd0 con 0x7f48800f77d0 2023-10-18T21:27:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.691+0000 7f48854df700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f486c060f70 0x7f486c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.692+0000 7f48854df700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f486c060f70 0x7f486c063430 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f487c004630 tx=0x7f487c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.695+0000 7f4875ffb700 1 -- 172.21.15.8:0/3616870470 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f487004cc40 con 0x7f48800f77d0 2023-10-18T21:27:42.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.899+0000 7f48864e1700 1 -- 172.21.15.8:0/3616870470 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48800fedd0 con 0x7f486c060f70 2023-10-18T21:27:42.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.900+0000 7f4875ffb700 1 -- 172.21.15.8:0/3616870470 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f48800fedd0 con 0x7f486c060f70 2023-10-18T21:27:42.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 -- 172.21.15.8:0/3616870470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f486c060f70 msgr2=0x7f486c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:42.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f486c060f70 0x7f486c063430 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f487c004630 tx=0x7f487c009b30).stop 2023-10-18T21:27:42.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 -- 172.21.15.8:0/3616870470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48800f77d0 msgr2=0x7f4880069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:42.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48800f77d0 0x7f4880069e20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f48700026d0 tx=0x7f4870009de0).stop 2023-10-18T21:27:42.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 -- 172.21.15.8:0/3616870470 shutdown_connections 2023-10-18T21:27:42.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f486c060f70 0x7f486c063430 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48800f6530 0x7f488006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 --2- 172.21.15.8:0/3616870470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48800f77d0 0x7f4880069e20 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:42.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 -- 172.21.15.8:0/3616870470 >> 172.21.15.8:0/3616870470 conn(0x7f48800f1c90 msgr2=0x7f48800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 -- 172.21.15.8:0/3616870470 shutdown_connections 2023-10-18T21:27:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:42.902+0000 7f48864e1700 1 -- 172.21.15.8:0/3616870470 wait complete. 2023-10-18T21:27:43.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.039+0000 7f8f63fff700 1 -- 172.21.15.8:0/1970382324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f640f77d0 msgr2=0x7f8f640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:43.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.039+0000 7f8f63fff700 1 --2- 172.21.15.8:0/1970382324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f640f77d0 0x7f8f640f7c30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f8f58004660 tx=0x7f8f58009b30).stop 2023-10-18T21:27:43.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.040+0000 7f8f63fff700 1 -- 172.21.15.8:0/1970382324 shutdown_connections 2023-10-18T21:27:43.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.040+0000 7f8f63fff700 1 --2- 172.21.15.8:0/1970382324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f640f77d0 0x7f8f640f7c30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.040+0000 7f8f63fff700 1 --2- 172.21.15.8:0/1970382324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f640f6530 0x7f8f640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.040+0000 7f8f63fff700 1 -- 172.21.15.8:0/1970382324 >> 172.21.15.8:0/1970382324 conn(0x7f8f640f1c70 msgr2=0x7f8f640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:43.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.040+0000 7f8f63fff700 1 -- 172.21.15.8:0/1970382324 shutdown_connections 2023-10-18T21:27:43.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.040+0000 7f8f63fff700 1 -- 172.21.15.8:0/1970382324 wait complete. 2023-10-18T21:27:43.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.040+0000 7f8f63fff700 1 Processor -- start 2023-10-18T21:27:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.041+0000 7f8f63fff700 1 -- start start 2023-10-18T21:27:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.041+0000 7f8f63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f640f6530 0x7f8f64106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.041+0000 7f8f63fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f640f77d0 0x7f8f641072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.041+0000 7f8f63fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641078c0 con 0x7f8f640f6530 2023-10-18T21:27:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.041+0000 7f8f63fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64108100 con 0x7f8f640f77d0 2023-10-18T21:27:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.041+0000 7f8f62ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f640f6530 0x7f8f64106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.041+0000 7f8f62ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f640f6530 0x7f8f64106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38192/0 (socket says 172.21.15.8:38192) 2023-10-18T21:27:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.041+0000 7f8f62ffd700 1 -- 172.21.15.8:0/52027104 learned_addr learned my addr 172.21.15.8:0/52027104 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.041+0000 7f8f627fc700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f640f77d0 0x7f8f641072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.042+0000 7f8f62ffd700 1 -- 172.21.15.8:0/52027104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f640f77d0 msgr2=0x7f8f641072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:43.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.042+0000 7f8f62ffd700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f640f77d0 0x7f8f641072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.042+0000 7f8f62ffd700 1 -- 172.21.15.8:0/52027104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f58005040 con 0x7f8f640f6530 2023-10-18T21:27:43.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.042+0000 7f8f62ffd700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f640f6530 0x7f8f64106dd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f8f54002700 tx=0x7f8f54009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:43.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.042+0000 7f8f4b7fe700 1 -- 172.21.15.8:0/52027104 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f540079c0 con 0x7f8f640f6530 2023-10-18T21:27:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.042+0000 7f8f4b7fe700 1 -- 172.21.15.8:0/52027104 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8f5400f040 con 0x7f8f640f6530 2023-10-18T21:27:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.042+0000 7f8f4b7fe700 1 -- 172.21.15.8:0/52027104 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f54014860 con 0x7f8f640f6530 2023-10-18T21:27:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.042+0000 7f8f63fff700 1 -- 172.21.15.8:0/52027104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f641083e0 con 0x7f8f640f6530 2023-10-18T21:27:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.042+0000 7f8f63fff700 1 -- 172.21.15.8:0/52027104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f64108920 con 0x7f8f640f6530 2023-10-18T21:27:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.043+0000 7f8f63fff700 1 -- 172.21.15.8:0/52027104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f64059100 con 0x7f8f640f6530 2023-10-18T21:27:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.044+0000 7f8f4b7fe700 1 -- 172.21.15.8:0/52027104 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8f5401b060 con 0x7f8f640f6530 2023-10-18T21:27:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.045+0000 7f8f4b7fe700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f4c060f70 0x7f8f4c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.045+0000 7f8f4b7fe700 1 -- 172.21.15.8:0/52027104 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8f5407c700 con 0x7f8f640f6530 2023-10-18T21:27:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.045+0000 7f8f627fc700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f4c060f70 0x7f8f4c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.046+0000 7f8f627fc700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f4c060f70 0x7f8f4c063430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f8f58004630 tx=0x7f8f58009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.049+0000 7f8f4b7fe700 1 -- 172.21.15.8:0/52027104 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8f5404c370 con 0x7f8f640f6530 2023-10-18T21:27:43.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:41.263600+0000 mgr.smithi008.flmjzp (mgr.14640) 1729 : cluster [DBG] pgmap v1199: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:43.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:41.263600+0000 mgr.smithi008.flmjzp (mgr.14640) 1729 : cluster [DBG] pgmap v1199: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:43.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.242+0000 7f8f63fff700 1 -- 172.21.15.8:0/52027104 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f640fee50 con 0x7f8f4c060f70 2023-10-18T21:27:43.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.252+0000 7f8f4b7fe700 1 -- 172.21.15.8:0/52027104 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8f640fee50 con 0x7f8f4c060f70 2023-10-18T21:27:43.254 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:27:43.254 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (34m) 2m ago 35m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:27:43.254 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (28m) 2m ago 35m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:27:43.254 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (28m) 9s ago 34m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:27:43.255 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (34m) 2m ago 35m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:27:43.255 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 31m - - 2023-10-18T21:27:43.255 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 31m - - 2023-10-18T21:27:43.255 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9s ago 31m - - 2023-10-18T21:27:43.255 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9s ago 31m - - 2023-10-18T21:27:43.256 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (29m) 2m ago 37m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:27:43.256 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (28m) 9s ago 34m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:27:43.256 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (28m) 2m ago 37m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:27:43.256 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (28m) 9s ago 34m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:27:43.257 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (35m) 2m ago 35m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:27:43.257 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (34m) 9s ago 34m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:27:43.257 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (27m) 2m ago 34m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:27:43.257 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (25m) 2m ago 34m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:27:43.258 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (25m) 2m ago 33m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:27:43.258 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (24m) 9s ago 33m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:27:43.258 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (24m) 9s ago 33m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:27:43.258 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (23m) 9s ago 32m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:27:43.259 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (29m) 2m ago 35m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:27:43.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 -- 172.21.15.8:0/52027104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f4c060f70 msgr2=0x7f8f4c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f4c060f70 0x7f8f4c063430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f8f58004630 tx=0x7f8f58009b30).stop 2023-10-18T21:27:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 -- 172.21.15.8:0/52027104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f640f6530 msgr2=0x7f8f64106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f640f6530 0x7f8f64106dd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f8f54002700 tx=0x7f8f54009d60).stop 2023-10-18T21:27:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 -- 172.21.15.8:0/52027104 shutdown_connections 2023-10-18T21:27:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f4c060f70 0x7f8f4c063430 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f640f6530 0x7f8f64106dd0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 --2- 172.21.15.8:0/52027104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f640f77d0 0x7f8f641072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 -- 172.21.15.8:0/52027104 >> 172.21.15.8:0/52027104 conn(0x7f8f640f1c70 msgr2=0x7f8f640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:43.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 -- 172.21.15.8:0/52027104 shutdown_connections 2023-10-18T21:27:43.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.254+0000 7f8f63fff700 1 -- 172.21.15.8:0/52027104 wait complete. 2023-10-18T21:27:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.391+0000 7f6de3105700 1 -- 172.21.15.8:0/3856885572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ddc0f77d0 msgr2=0x7f6ddc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.391+0000 7f6de3105700 1 --2- 172.21.15.8:0/3856885572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ddc0f77d0 0x7f6ddc0f7c30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f6dcc004660 tx=0x7f6dcc009b30).stop 2023-10-18T21:27:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.391+0000 7f6de3105700 1 -- 172.21.15.8:0/3856885572 shutdown_connections 2023-10-18T21:27:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.391+0000 7f6de3105700 1 --2- 172.21.15.8:0/3856885572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ddc0f77d0 0x7f6ddc0f7c30 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.391+0000 7f6de3105700 1 --2- 172.21.15.8:0/3856885572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ddc0f6530 0x7f6ddc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.391+0000 7f6de3105700 1 -- 172.21.15.8:0/3856885572 >> 172.21.15.8:0/3856885572 conn(0x7f6ddc0f1c90 msgr2=0x7f6ddc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:43.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.391+0000 7f6de3105700 1 -- 172.21.15.8:0/3856885572 shutdown_connections 2023-10-18T21:27:43.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.391+0000 7f6de3105700 1 -- 172.21.15.8:0/3856885572 wait complete. 2023-10-18T21:27:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.392+0000 7f6de3105700 1 Processor -- start 2023-10-18T21:27:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.392+0000 7f6de3105700 1 -- start start 2023-10-18T21:27:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.393+0000 7f6de3105700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ddc0f6530 0x7f6ddc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.393+0000 7f6de3105700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ddc0f77d0 0x7f6ddc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.393+0000 7f6de3105700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc06a380 con 0x7f6ddc0f6530 2023-10-18T21:27:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.393+0000 7f6de3105700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc06a4c0 con 0x7f6ddc0f77d0 2023-10-18T21:27:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.393+0000 7f6de2103700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ddc0f6530 0x7f6ddc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.393+0000 7f6de2103700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ddc0f6530 0x7f6ddc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38204/0 (socket says 172.21.15.8:38204) 2023-10-18T21:27:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.393+0000 7f6de1902700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ddc0f77d0 0x7f6ddc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.393+0000 7f6de2103700 1 -- 172.21.15.8:0/4270864972 learned_addr learned my addr 172.21.15.8:0/4270864972 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:43.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.394+0000 7f6de2103700 1 -- 172.21.15.8:0/4270864972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ddc0f77d0 msgr2=0x7f6ddc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:43.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.394+0000 7f6de2103700 1 --2- 172.21.15.8:0/4270864972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ddc0f77d0 0x7f6ddc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.394+0000 7f6de2103700 1 -- 172.21.15.8:0/4270864972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc005040 con 0x7f6ddc0f6530 2023-10-18T21:27:43.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.394+0000 7f6de2103700 1 --2- 172.21.15.8:0/4270864972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ddc0f6530 0x7f6ddc06b9a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f6dd8002700 tx=0x7f6dd8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:43.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.394+0000 7f6dd2ffd700 1 -- 172.21.15.8:0/4270864972 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd80079c0 con 0x7f6ddc0f6530 2023-10-18T21:27:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.394+0000 7f6dd2ffd700 1 -- 172.21.15.8:0/4270864972 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6dd800f040 con 0x7f6ddc0f6530 2023-10-18T21:27:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.394+0000 7f6de3105700 1 -- 172.21.15.8:0/4270864972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc06a7a0 con 0x7f6ddc0f6530 2023-10-18T21:27:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.394+0000 7f6dd2ffd700 1 -- 172.21.15.8:0/4270864972 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd80148d0 con 0x7f6ddc0f6530 2023-10-18T21:27:43.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.394+0000 7f6de3105700 1 -- 172.21.15.8:0/4270864972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc10ed70 con 0x7f6ddc0f6530 2023-10-18T21:27:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.396+0000 7f6de3105700 1 -- 172.21.15.8:0/4270864972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc045ad0 con 0x7f6ddc0f6530 2023-10-18T21:27:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.396+0000 7f6dd2ffd700 1 -- 172.21.15.8:0/4270864972 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6dd801b060 con 0x7f6ddc0f6530 2023-10-18T21:27:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.397+0000 7f6dd2ffd700 1 --2- 172.21.15.8:0/4270864972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dc8060f70 0x7f6dc8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.397+0000 7f6dd2ffd700 1 -- 172.21.15.8:0/4270864972 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6dd807c770 con 0x7f6ddc0f6530 2023-10-18T21:27:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.397+0000 7f6de1902700 1 --2- 172.21.15.8:0/4270864972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dc8060f70 0x7f6dc8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.398+0000 7f6de1902700 1 --2- 172.21.15.8:0/4270864972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dc8060f70 0x7f6dc8063430 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f6dcc004630 tx=0x7f6dcc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:43.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.401+0000 7f6dd2ffd700 1 -- 172.21.15.8:0/4270864972 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6dd804c3a0 con 0x7f6ddc0f6530 2023-10-18T21:27:43.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.656+0000 7f6de3105700 1 -- 172.21.15.8:0/4270864972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ddc0fedc0 con 0x7f6ddc0f6530 2023-10-18T21:27:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.657+0000 7f6dd2ffd700 1 -- 172.21.15.8:0/4270864972 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f6dd804f9c0 con 0x7f6ddc0f6530 2023-10-18T21:27:43.659 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:27:43.660 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:27:43.660 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:27:43.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:27:43.660 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:27:43.660 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:27:43.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:27:43.661 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:27:43.661 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:27:43.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:27:43.661 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:27:43.662 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:27:43.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:27:43.662 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:27:43.662 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:27:43.662 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:27:43.663 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:27:43.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 -- 172.21.15.8:0/4270864972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dc8060f70 msgr2=0x7f6dc8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:43.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 --2- 172.21.15.8:0/4270864972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dc8060f70 0x7f6dc8063430 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f6dcc004630 tx=0x7f6dcc009b30).stop 2023-10-18T21:27:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 -- 172.21.15.8:0/4270864972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ddc0f6530 msgr2=0x7f6ddc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 --2- 172.21.15.8:0/4270864972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ddc0f6530 0x7f6ddc06b9a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f6dd8002700 tx=0x7f6dd8009d80).stop 2023-10-18T21:27:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 -- 172.21.15.8:0/4270864972 shutdown_connections 2023-10-18T21:27:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 --2- 172.21.15.8:0/4270864972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dc8060f70 0x7f6dc8063430 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 --2- 172.21.15.8:0/4270864972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ddc0f6530 0x7f6ddc06b9a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 --2- 172.21.15.8:0/4270864972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ddc0f77d0 0x7f6ddc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 -- 172.21.15.8:0/4270864972 >> 172.21.15.8:0/4270864972 conn(0x7f6ddc0f1c90 msgr2=0x7f6ddc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 -- 172.21.15.8:0/4270864972 shutdown_connections 2023-10-18T21:27:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.659+0000 7f6de3105700 1 -- 172.21.15.8:0/4270864972 wait complete. 2023-10-18T21:27:43.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.795+0000 7f1d80c87700 1 -- 172.21.15.8:0/3731031785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d7c060310 msgr2=0x7f1d7c0f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:43.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.795+0000 7f1d80c87700 1 --2- 172.21.15.8:0/3731031785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d7c060310 0x7f1d7c0f9120 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f1d6c004660 tx=0x7f1d6c009b30).stop 2023-10-18T21:27:43.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.795+0000 7f1d80c87700 1 -- 172.21.15.8:0/3731031785 shutdown_connections 2023-10-18T21:27:43.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.795+0000 7f1d80c87700 1 --2- 172.21.15.8:0/3731031785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d7c0f96a0 0x7f1d7c0fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.795+0000 7f1d80c87700 1 --2- 172.21.15.8:0/3731031785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d7c060310 0x7f1d7c0f9120 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.795+0000 7f1d80c87700 1 -- 172.21.15.8:0/3731031785 >> 172.21.15.8:0/3731031785 conn(0x7f1d7c0f0ba0 msgr2=0x7f1d7c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:43.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.795+0000 7f1d80c87700 1 -- 172.21.15.8:0/3731031785 shutdown_connections 2023-10-18T21:27:43.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.795+0000 7f1d80c87700 1 -- 172.21.15.8:0/3731031785 wait complete. 2023-10-18T21:27:43.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.796+0000 7f1d80c87700 1 Processor -- start 2023-10-18T21:27:43.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.797+0000 7f1d80c87700 1 -- start start 2023-10-18T21:27:43.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.797+0000 7f1d80c87700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d7c060310 0x7f1d7c0f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:43.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.797+0000 7f1d80c87700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d7c0f96a0 0x7f1d7c0f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:43.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.797+0000 7f1d80c87700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0f5580 con 0x7f1d7c060310 2023-10-18T21:27:43.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.797+0000 7f1d80c87700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0f56c0 con 0x7f1d7c0f96a0 2023-10-18T21:27:43.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.797+0000 7f1d7b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d7c060310 0x7f1d7c0f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:43.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.798+0000 7f1d7b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d7c060310 0x7f1d7c0f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38230/0 (socket says 172.21.15.8:38230) 2023-10-18T21:27:43.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.798+0000 7f1d7b7fe700 1 -- 172.21.15.8:0/2008218877 learned_addr learned my addr 172.21.15.8:0/2008218877 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:43.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.798+0000 7f1d7affd700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d7c0f96a0 0x7f1d7c0f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:43.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.798+0000 7f1d7b7fe700 1 -- 172.21.15.8:0/2008218877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d7c0f96a0 msgr2=0x7f1d7c0f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:43.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.798+0000 7f1d7b7fe700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d7c0f96a0 0x7f1d7c0f5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:43.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.798+0000 7f1d7b7fe700 1 -- 172.21.15.8:0/2008218877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c005040 con 0x7f1d7c060310 2023-10-18T21:27:43.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.798+0000 7f1d7b7fe700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d7c060310 0x7f1d7c0f6ba0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f1d6c004d80 tx=0x7f1d6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:43.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.798+0000 7f1d63fff700 1 -- 172.21.15.8:0/2008218877 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d6c019070 con 0x7f1d7c060310 2023-10-18T21:27:43.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.798+0000 7f1d63fff700 1 -- 172.21.15.8:0/2008218877 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1d6c01e420 con 0x7f1d7c060310 2023-10-18T21:27:43.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.798+0000 7f1d80c87700 1 -- 172.21.15.8:0/2008218877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c0f5940 con 0x7f1d7c060310 2023-10-18T21:27:43.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.799+0000 7f1d63fff700 1 -- 172.21.15.8:0/2008218877 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d6c014660 con 0x7f1d7c060310 2023-10-18T21:27:43.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.799+0000 7f1d80c87700 1 -- 172.21.15.8:0/2008218877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c0f5e20 con 0x7f1d7c060310 2023-10-18T21:27:43.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.800+0000 7f1d80c87700 1 -- 172.21.15.8:0/2008218877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c045ad0 con 0x7f1d7c060310 2023-10-18T21:27:43.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.801+0000 7f1d63fff700 1 -- 172.21.15.8:0/2008218877 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1d6c01e590 con 0x7f1d7c060310 2023-10-18T21:27:43.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.801+0000 7f1d63fff700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d64060f70 0x7f1d64063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:43.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.801+0000 7f1d63fff700 1 -- 172.21.15.8:0/2008218877 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1d6c07dd50 con 0x7f1d7c060310 2023-10-18T21:27:43.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.802+0000 7f1d7affd700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d64060f70 0x7f1d64063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:43.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.802+0000 7f1d7affd700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d64060f70 0x7f1d64063430 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f1d70009fd0 tx=0x7f1d7000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:43.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:43.806+0000 7f1d63fff700 1 -- 172.21.15.8:0/2008218877 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1d6c04d9c0 con 0x7f1d7c060310 2023-10-18T21:27:44.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.037+0000 7f1d80c87700 1 -- 172.21.15.8:0/2008218877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1d7c0fed90 con 0x7f1d7c060310 2023-10-18T21:27:44.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.037+0000 7f1d63fff700 1 -- 172.21.15.8:0/2008218877 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1d6c050fe0 con 0x7f1d7c060310 2023-10-18T21:27:44.039 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:27:44.040 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:27:44.040 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:27:44.040 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:27:44.040 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:27:44.040 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:27:44.041 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:27:44.041 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:27:44.041 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:27:44.041 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:27:44.041 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:27:44.042 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:27:44.042 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:27:44.042 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:27:44.042 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:27:44.043 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:27:44.043 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:27:44.043 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:27:44.043 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:27:44.043 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:27:44.044 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:27:44.044 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:27:44.044 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:27:44.044 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:27:44.044 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:27:44.045 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:27:44.045 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:27:44.045 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:27:44.045 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:27:44.046 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:27:44.046 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:27:44.046 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:27:44.046 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:27:44.046 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:27:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 -- 172.21.15.8:0/2008218877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d64060f70 msgr2=0x7f1d64063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d64060f70 0x7f1d64063430 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f1d70009fd0 tx=0x7f1d7000b040).stop 2023-10-18T21:27:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 -- 172.21.15.8:0/2008218877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d7c060310 msgr2=0x7f1d7c0f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d7c060310 0x7f1d7c0f6ba0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f1d6c004d80 tx=0x7f1d6c00b040).stop 2023-10-18T21:27:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 -- 172.21.15.8:0/2008218877 shutdown_connections 2023-10-18T21:27:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1d64060f70 0x7f1d64063430 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d7c060310 0x7f1d7c0f6ba0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 --2- 172.21.15.8:0/2008218877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d7c0f96a0 0x7f1d7c0f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 -- 172.21.15.8:0/2008218877 >> 172.21.15.8:0/2008218877 conn(0x7f1d7c0f0ba0 msgr2=0x7f1d7c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 -- 172.21.15.8:0/2008218877 shutdown_connections 2023-10-18T21:27:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.039+0000 7f1d80c87700 1 -- 172.21.15.8:0/2008218877 wait complete. 2023-10-18T21:27:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:27:44.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:42.547730+0000 mgr.smithi008.flmjzp (mgr.14640) 1730 : audit [DBG] from='client.35560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.296120+0000 mon.smithi008 (mon.0) 2186 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.658653+0000 mon.smithi008 (mon.0) 2187 : audit [DBG] from='client.? 172.21.15.8:0/4270864972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:44.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.178+0000 7fa473fff700 1 -- 172.21.15.8:0/4156030841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa474060310 msgr2=0x7fa4740f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:44.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.178+0000 7fa473fff700 1 --2- 172.21.15.8:0/4156030841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa474060310 0x7fa4740f9120 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fa464004660 tx=0x7fa464009b30).stop 2023-10-18T21:27:44.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.178+0000 7fa473fff700 1 -- 172.21.15.8:0/4156030841 shutdown_connections 2023-10-18T21:27:44.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.178+0000 7fa473fff700 1 --2- 172.21.15.8:0/4156030841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4740f96a0 0x7fa4740fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:44.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.178+0000 7fa473fff700 1 --2- 172.21.15.8:0/4156030841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa474060310 0x7fa4740f9120 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:44.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.178+0000 7fa473fff700 1 -- 172.21.15.8:0/4156030841 >> 172.21.15.8:0/4156030841 conn(0x7fa4740f0ba0 msgr2=0x7fa4740f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:44.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.178+0000 7fa473fff700 1 -- 172.21.15.8:0/4156030841 shutdown_connections 2023-10-18T21:27:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.178+0000 7fa473fff700 1 -- 172.21.15.8:0/4156030841 wait complete. 2023-10-18T21:27:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.179+0000 7fa473fff700 1 Processor -- start 2023-10-18T21:27:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.179+0000 7fa473fff700 1 -- start start 2023-10-18T21:27:44.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.180+0000 7fa473fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa474060310 0x7fa474108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:44.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.180+0000 7fa473fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740f96a0 0x7fa4741093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:44.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.180+0000 7fa473fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa474109990 con 0x7fa4740f96a0 2023-10-18T21:27:44.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.180+0000 7fa473fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa474109ad0 con 0x7fa474060310 2023-10-18T21:27:44.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.180+0000 7fa4727fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740f96a0 0x7fa4741093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:44.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.180+0000 7fa4727fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740f96a0 0x7fa4741093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38238/0 (socket says 172.21.15.8:38238) 2023-10-18T21:27:44.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.180+0000 7fa4727fc700 1 -- 172.21.15.8:0/1238270765 learned_addr learned my addr 172.21.15.8:0/1238270765 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:27:44.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.180+0000 7fa472ffd700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa474060310 0x7fa474108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:44.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.181+0000 7fa4727fc700 1 -- 172.21.15.8:0/1238270765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa474060310 msgr2=0x7fa474108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.181+0000 7fa4727fc700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa474060310 0x7fa474108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.181+0000 7fa4727fc700 1 -- 172.21.15.8:0/1238270765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464005040 con 0x7fa4740f96a0 2023-10-18T21:27:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.181+0000 7fa4727fc700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740f96a0 0x7fa4741093e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fa46800e7c0 tx=0x7fa46800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.181+0000 7fa45b7fe700 1 -- 172.21.15.8:0/1238270765 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4680092e0 con 0x7fa4740f96a0 2023-10-18T21:27:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.181+0000 7fa473fff700 1 -- 172.21.15.8:0/1238270765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47410a470 con 0x7fa4740f96a0 2023-10-18T21:27:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.181+0000 7fa45b7fe700 1 -- 172.21.15.8:0/1238270765 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa46800f040 con 0x7fa4740f96a0 2023-10-18T21:27:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.181+0000 7fa45b7fe700 1 -- 172.21.15.8:0/1238270765 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4680147e0 con 0x7fa4740f96a0 2023-10-18T21:27:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.181+0000 7fa473fff700 1 -- 172.21.15.8:0/1238270765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47410a9b0 con 0x7fa4740f96a0 2023-10-18T21:27:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.182+0000 7fa473fff700 1 -- 172.21.15.8:0/1238270765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa474045ad0 con 0x7fa4740f96a0 2023-10-18T21:27:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.183+0000 7fa45b7fe700 1 -- 172.21.15.8:0/1238270765 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa468014a60 con 0x7fa4740f96a0 2023-10-18T21:27:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.184+0000 7fa45b7fe700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa45c060f70 0x7fa45c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:27:44.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.184+0000 7fa45b7fe700 1 -- 172.21.15.8:0/1238270765 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa46807cc90 con 0x7fa4740f96a0 2023-10-18T21:27:44.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.184+0000 7fa472ffd700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa45c060f70 0x7fa45c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:27:44.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.185+0000 7fa472ffd700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa45c060f70 0x7fa45c063430 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fa464009720 tx=0x7fa464016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:27:44.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.188+0000 7fa45b7fe700 1 -- 172.21.15.8:0/1238270765 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa4680502e0 con 0x7fa4740f96a0 2023-10-18T21:27:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:42.547730+0000 mgr.smithi008.flmjzp (mgr.14640) 1730 : audit [DBG] from='client.35560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.296120+0000 mon.smithi008 (mon.0) 2186 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.658653+0000 mon.smithi008 (mon.0) 2187 : audit [DBG] from='client.? 172.21.15.8:0/4270864972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:44.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.387+0000 7fa473fff700 1 -- 172.21.15.8:0/1238270765 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4740f5680 con 0x7fa45c060f70 2023-10-18T21:27:44.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.388+0000 7fa45b7fe700 1 -- 172.21.15.8:0/1238270765 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa4740f5680 con 0x7fa45c060f70 2023-10-18T21:27:44.390 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:27:44.390 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:27:44.391 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:27:44.391 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:27:44.391 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:27:44.391 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:27:44.391 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:27:44.392 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:27:44.392 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:27:44.392 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:27:44.392 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:27:44.392 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:27:44.393 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:27:44.393 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:27:44.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.390+0000 7fa473fff700 1 -- 172.21.15.8:0/1238270765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa45c060f70 msgr2=0x7fa45c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:44.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.390+0000 7fa473fff700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa45c060f70 0x7fa45c063430 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fa464009720 tx=0x7fa464016040).stop 2023-10-18T21:27:44.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.390+0000 7fa473fff700 1 -- 172.21.15.8:0/1238270765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740f96a0 msgr2=0x7fa4741093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:27:44.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.391+0000 7fa473fff700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740f96a0 0x7fa4741093e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fa46800e7c0 tx=0x7fa46800b040).stop 2023-10-18T21:27:44.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.391+0000 7fa473fff700 1 -- 172.21.15.8:0/1238270765 shutdown_connections 2023-10-18T21:27:44.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.391+0000 7fa473fff700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa45c060f70 0x7fa45c063430 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:44.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.391+0000 7fa473fff700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa474060310 0x7fa474108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:44.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.391+0000 7fa473fff700 1 --2- 172.21.15.8:0/1238270765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4740f96a0 0x7fa4741093e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:27:44.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.391+0000 7fa473fff700 1 -- 172.21.15.8:0/1238270765 >> 172.21.15.8:0/1238270765 conn(0x7fa4740f0ba0 msgr2=0x7fa4740f4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:27:44.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.391+0000 7fa473fff700 1 -- 172.21.15.8:0/1238270765 shutdown_connections 2023-10-18T21:27:44.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:27:44.391+0000 7fa473fff700 1 -- 172.21.15.8:0/1238270765 wait complete. 2023-10-18T21:27:45.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:42.901354+0000 mgr.smithi008.flmjzp (mgr.14640) 1731 : audit [DBG] from='client.35564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:45.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.244899+0000 mgr.smithi008.flmjzp (mgr.14640) 1732 : audit [DBG] from='client.35568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:45.150 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:43.263975+0000 mgr.smithi008.flmjzp (mgr.14640) 1733 : cluster [DBG] pgmap v1200: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:45.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.855631+0000 mon.smithi008 (mon.0) 2188 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:45.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.856488+0000 mon.smithi008 (mon.0) 2189 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:45.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:43.857183+0000 mgr.smithi008.flmjzp (mgr.14640) 1734 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:45.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:43.857741+0000 mgr.smithi008.flmjzp (mgr.14640) 1735 : cluster [DBG] pgmap v1201: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:45.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:43.858196+0000 mgr.smithi008.flmjzp (mgr.14640) 1736 : cluster [DBG] pgmap v1202: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:45.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.861804+0000 mon.smithi008 (mon.0) 2190 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:45.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.866712+0000 mon.smithi008 (mon.0) 2191 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:45.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.869134+0000 mon.smithi008 (mon.0) 2192 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:45.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.870403+0000 mon.smithi008 (mon.0) 2193 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:45.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.871653+0000 mon.smithi008 (mon.0) 2194 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:45.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:43.873284+0000 mon.smithi008 (mon.0) 2195 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:45.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:43.874914+0000 mgr.smithi008.flmjzp (mgr.14640) 1737 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:45.153 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:44.038812+0000 mon.smithi008 (mon.0) 2196 : audit [DBG] from='client.? 172.21.15.8:0/2008218877' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:27:45.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:42.901354+0000 mgr.smithi008.flmjzp (mgr.14640) 1731 : audit [DBG] from='client.35564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.244899+0000 mgr.smithi008.flmjzp (mgr.14640) 1732 : audit [DBG] from='client.35568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:43.263975+0000 mgr.smithi008.flmjzp (mgr.14640) 1733 : cluster [DBG] pgmap v1200: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.855631+0000 mon.smithi008 (mon.0) 2188 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.856488+0000 mon.smithi008 (mon.0) 2189 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:45.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:43.857183+0000 mgr.smithi008.flmjzp (mgr.14640) 1734 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:45.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:43.857741+0000 mgr.smithi008.flmjzp (mgr.14640) 1735 : cluster [DBG] pgmap v1201: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:45.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:43.858196+0000 mgr.smithi008.flmjzp (mgr.14640) 1736 : cluster [DBG] pgmap v1202: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:45.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.861804+0000 mon.smithi008 (mon.0) 2190 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:45.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.866712+0000 mon.smithi008 (mon.0) 2191 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:45.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.869134+0000 mon.smithi008 (mon.0) 2192 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:45.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.870403+0000 mon.smithi008 (mon.0) 2193 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:45.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.871653+0000 mon.smithi008 (mon.0) 2194 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:45.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:43.873284+0000 mon.smithi008 (mon.0) 2195 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:45.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:43.874914+0000 mgr.smithi008.flmjzp (mgr.14640) 1737 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:45.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:44.038812+0000 mon.smithi008 (mon.0) 2196 : audit [DBG] from='client.? 172.21.15.8:0/2008218877' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:27:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:44.389785+0000 mgr.smithi008.flmjzp (mgr.14640) 1738 : audit [DBG] from='client.35580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:46.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:44.389785+0000 mgr.smithi008.flmjzp (mgr.14640) 1738 : audit [DBG] from='client.35580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:27:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:45.858822+0000 mgr.smithi008.flmjzp (mgr.14640) 1739 : cluster [DBG] pgmap v1203: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:45.858822+0000 mgr.smithi008.flmjzp (mgr.14640) 1739 : cluster [DBG] pgmap v1203: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:48.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:47.859302+0000 mgr.smithi008.flmjzp (mgr.14640) 1740 : cluster [DBG] pgmap v1204: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:47.859302+0000 mgr.smithi008.flmjzp (mgr.14640) 1740 : cluster [DBG] pgmap v1204: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:49.859931+0000 mgr.smithi008.flmjzp (mgr.14640) 1741 : cluster [DBG] pgmap v1205: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:49.859931+0000 mgr.smithi008.flmjzp (mgr.14640) 1741 : cluster [DBG] pgmap v1205: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:52.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:51.860684+0000 mgr.smithi008.flmjzp (mgr.14640) 1742 : cluster [DBG] pgmap v1206: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:51.860684+0000 mgr.smithi008.flmjzp (mgr.14640) 1742 : cluster [DBG] pgmap v1206: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:53.861373+0000 mgr.smithi008.flmjzp (mgr.14640) 1743 : cluster [DBG] pgmap v1207: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:53.879475+0000 mon.smithi008 (mon.0) 2197 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:53.881778+0000 mon.smithi008 (mon.0) 2198 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:53.882761+0000 mon.smithi008 (mon.0) 2199 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:53.883659+0000 mgr.smithi008.flmjzp (mgr.14640) 1744 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:53.884314+0000 mgr.smithi008.flmjzp (mgr.14640) 1745 : cluster [DBG] pgmap v1208: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:54.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:53.884558+0000 mgr.smithi008.flmjzp (mgr.14640) 1746 : cluster [DBG] pgmap v1209: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:54.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:53.889239+0000 mon.smithi008 (mon.0) 2200 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:54.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:53.895662+0000 mon.smithi008 (mon.0) 2201 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:54.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:53.898635+0000 mon.smithi008 (mon.0) 2202 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:54.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:53.900341+0000 mon.smithi008 (mon.0) 2203 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:54.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:53.902015+0000 mon.smithi008 (mon.0) 2204 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:54.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:27:53.904661+0000 mon.smithi008 (mon.0) 2205 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:54.275 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:53.861373+0000 mgr.smithi008.flmjzp (mgr.14640) 1743 : cluster [DBG] pgmap v1207: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:54.276 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:53.879475+0000 mon.smithi008 (mon.0) 2197 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:54.276 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:53.881778+0000 mon.smithi008 (mon.0) 2198 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:27:54.276 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:53.882761+0000 mon.smithi008 (mon.0) 2199 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:27:54.276 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:53.883659+0000 mgr.smithi008.flmjzp (mgr.14640) 1744 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:27:54.276 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:53.884314+0000 mgr.smithi008.flmjzp (mgr.14640) 1745 : cluster [DBG] pgmap v1208: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:54.277 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:53.884558+0000 mgr.smithi008.flmjzp (mgr.14640) 1746 : cluster [DBG] pgmap v1209: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:54.277 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:53.889239+0000 mon.smithi008 (mon.0) 2200 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:27:54.277 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:53.895662+0000 mon.smithi008 (mon.0) 2201 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:27:54.277 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:53.898635+0000 mon.smithi008 (mon.0) 2202 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:54.277 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:53.900341+0000 mon.smithi008 (mon.0) 2203 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:54.278 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:53.902015+0000 mon.smithi008 (mon.0) 2204 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:54.278 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:27:53.904661+0000 mon.smithi008 (mon.0) 2205 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:27:55.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:27:53.906806+0000 mgr.smithi008.flmjzp (mgr.14640) 1747 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:27:53.906806+0000 mgr.smithi008.flmjzp (mgr.14640) 1747 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:27:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:55.885034+0000 mgr.smithi008.flmjzp (mgr.14640) 1748 : cluster [DBG] pgmap v1210: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:56.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:55.885034+0000 mgr.smithi008.flmjzp (mgr.14640) 1748 : cluster [DBG] pgmap v1210: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:58.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:57.885672+0000 mgr.smithi008.flmjzp (mgr.14640) 1749 : cluster [DBG] pgmap v1211: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:27:58.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:57.885672+0000 mgr.smithi008.flmjzp (mgr.14640) 1749 : cluster [DBG] pgmap v1211: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:27:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:27:59.886211+0000 mgr.smithi008.flmjzp (mgr.14640) 1750 : cluster [DBG] pgmap v1212: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:27:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:27:59.886211+0000 mgr.smithi008.flmjzp (mgr.14640) 1750 : cluster [DBG] pgmap v1212: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:01.886807+0000 mgr.smithi008.flmjzp (mgr.14640) 1751 : cluster [DBG] pgmap v1213: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:02.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:01.886807+0000 mgr.smithi008.flmjzp (mgr.14640) 1751 : cluster [DBG] pgmap v1213: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:03.887476+0000 mgr.smithi008.flmjzp (mgr.14640) 1752 : cluster [DBG] pgmap v1214: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:03.917225+0000 mon.smithi008 (mon.0) 2206 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:03.919517+0000 mon.smithi008 (mon.0) 2207 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:03.920630+0000 mon.smithi008 (mon.0) 2208 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:03.927687+0000 mon.smithi008 (mon.0) 2209 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:03.934532+0000 mon.smithi008 (mon.0) 2210 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:03.937864+0000 mon.smithi008 (mon.0) 2211 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:04.276 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:03.887476+0000 mgr.smithi008.flmjzp (mgr.14640) 1752 : cluster [DBG] pgmap v1214: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:04.276 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:03.917225+0000 mon.smithi008 (mon.0) 2206 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:04.277 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:03.919517+0000 mon.smithi008 (mon.0) 2207 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:04.277 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:03.920630+0000 mon.smithi008 (mon.0) 2208 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:04.277 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:03.927687+0000 mon.smithi008 (mon.0) 2209 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:04.277 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:03.934532+0000 mon.smithi008 (mon.0) 2210 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:04.277 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:03.937864+0000 mon.smithi008 (mon.0) 2211 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:05.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:03.921522+0000 mgr.smithi008.flmjzp (mgr.14640) 1753 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:03.922045+0000 mgr.smithi008.flmjzp (mgr.14640) 1754 : cluster [DBG] pgmap v1215: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:03.922290+0000 mgr.smithi008.flmjzp (mgr.14640) 1755 : cluster [DBG] pgmap v1216: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:03.942489+0000 mon.smithi008 (mon.0) 2212 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:03.946549+0000 mon.smithi008 (mon.0) 2213 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:03.949305+0000 mon.smithi008 (mon.0) 2214 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:05.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:03.951519+0000 mgr.smithi008.flmjzp (mgr.14640) 1756 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:03.921522+0000 mgr.smithi008.flmjzp (mgr.14640) 1753 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:03.922045+0000 mgr.smithi008.flmjzp (mgr.14640) 1754 : cluster [DBG] pgmap v1215: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:03.922290+0000 mgr.smithi008.flmjzp (mgr.14640) 1755 : cluster [DBG] pgmap v1216: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:03.942489+0000 mon.smithi008 (mon.0) 2212 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:03.946549+0000 mon.smithi008 (mon.0) 2213 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:03.949305+0000 mon.smithi008 (mon.0) 2214 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:03.951519+0000 mgr.smithi008.flmjzp (mgr.14640) 1756 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:05.922858+0000 mgr.smithi008.flmjzp (mgr.14640) 1757 : cluster [DBG] pgmap v1217: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:07.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:05.922858+0000 mgr.smithi008.flmjzp (mgr.14640) 1757 : cluster [DBG] pgmap v1217: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:07.923367+0000 mgr.smithi008.flmjzp (mgr.14640) 1758 : cluster [DBG] pgmap v1218: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:09.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:07.923367+0000 mgr.smithi008.flmjzp (mgr.14640) 1758 : cluster [DBG] pgmap v1218: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:09.923998+0000 mgr.smithi008.flmjzp (mgr.14640) 1759 : cluster [DBG] pgmap v1219: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:09.923998+0000 mgr.smithi008.flmjzp (mgr.14640) 1759 : cluster [DBG] pgmap v1219: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:11.924572+0000 mgr.smithi008.flmjzp (mgr.14640) 1760 : cluster [DBG] pgmap v1220: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:13.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:11.924572+0000 mgr.smithi008.flmjzp (mgr.14640) 1760 : cluster [DBG] pgmap v1220: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.544+0000 7ff11483d700 1 -- 172.21.15.8:0/1657613268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1100f6530 msgr2=0x7ff1100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.544+0000 7ff11483d700 1 --2- 172.21.15.8:0/1657613268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1100f6530 0x7ff1100f6950 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7ff100004660 tx=0x7ff100009b30).stop 2023-10-18T21:28:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.544+0000 7ff11483d700 1 -- 172.21.15.8:0/1657613268 shutdown_connections 2023-10-18T21:28:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.544+0000 7ff11483d700 1 --2- 172.21.15.8:0/1657613268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1100f77d0 0x7ff1100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.544+0000 7ff11483d700 1 --2- 172.21.15.8:0/1657613268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1100f6530 0x7ff1100f6950 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.544+0000 7ff11483d700 1 -- 172.21.15.8:0/1657613268 >> 172.21.15.8:0/1657613268 conn(0x7ff1100f1c90 msgr2=0x7ff1100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.544+0000 7ff11483d700 1 -- 172.21.15.8:0/1657613268 shutdown_connections 2023-10-18T21:28:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.544+0000 7ff11483d700 1 -- 172.21.15.8:0/1657613268 wait complete. 2023-10-18T21:28:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.545+0000 7ff11483d700 1 Processor -- start 2023-10-18T21:28:14.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.545+0000 7ff11483d700 1 -- start start 2023-10-18T21:28:14.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.545+0000 7ff11483d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1100f6530 0x7ff110106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.545+0000 7ff11483d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1100f77d0 0x7ff110107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.545+0000 7ff11483d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff110107910 con 0x7ff1100f77d0 2023-10-18T21:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.545+0000 7ff11483d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff110108120 con 0x7ff1100f6530 2023-10-18T21:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.546+0000 7ff10e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1100f77d0 0x7ff110107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.546+0000 7ff10e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1100f77d0 0x7ff110107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59942/0 (socket says 172.21.15.8:59942) 2023-10-18T21:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.546+0000 7ff10e59c700 1 -- 172.21.15.8:0/2523477960 learned_addr learned my addr 172.21.15.8:0/2523477960 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.546+0000 7ff10ed9d700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1100f6530 0x7ff110106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.546+0000 7ff10e59c700 1 -- 172.21.15.8:0/2523477960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1100f6530 msgr2=0x7ff110106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.546+0000 7ff10e59c700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1100f6530 0x7ff110106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.546+0000 7ff10e59c700 1 -- 172.21.15.8:0/2523477960 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff100005040 con 0x7ff1100f77d0 2023-10-18T21:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.546+0000 7ff10ed9d700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1100f6530 0x7ff110106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.546+0000 7ff10e59c700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1100f77d0 0x7ff110107310 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7ff1040026d0 tx=0x7ff104009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.547+0000 7ff0f77fe700 1 -- 172.21.15.8:0/2523477960 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff104009320 con 0x7ff1100f77d0 2023-10-18T21:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.547+0000 7ff0f77fe700 1 -- 172.21.15.8:0/2523477960 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff10400f040 con 0x7ff1100f77d0 2023-10-18T21:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.547+0000 7ff0f77fe700 1 -- 172.21.15.8:0/2523477960 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1040148a0 con 0x7ff1100f77d0 2023-10-18T21:28:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.547+0000 7ff11483d700 1 -- 172.21.15.8:0/2523477960 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1101083a0 con 0x7ff1100f77d0 2023-10-18T21:28:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.547+0000 7ff11483d700 1 -- 172.21.15.8:0/2523477960 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff110108960 con 0x7ff1100f77d0 2023-10-18T21:28:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.548+0000 7ff11483d700 1 -- 172.21.15.8:0/2523477960 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff110059100 con 0x7ff1100f77d0 2023-10-18T21:28:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.549+0000 7ff0f77fe700 1 -- 172.21.15.8:0/2523477960 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff104009480 con 0x7ff1100f77d0 2023-10-18T21:28:14.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.550+0000 7ff0f77fe700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0f8060f70 0x7ff0f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:14.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.550+0000 7ff0f77fe700 1 -- 172.21.15.8:0/2523477960 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff10407cf60 con 0x7ff1100f77d0 2023-10-18T21:28:14.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.550+0000 7ff10ed9d700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0f8060f70 0x7ff0f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:14.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.551+0000 7ff10ed9d700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0f8060f70 0x7ff0f8063430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7ff110106b90 tx=0x7ff100009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:14.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.554+0000 7ff0f77fe700 1 -- 172.21.15.8:0/2523477960 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff10404cb90 con 0x7ff1100f77d0 2023-10-18T21:28:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:13.959244+0000 mon.smithi008 (mon.0) 2215 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:13.961355+0000 mon.smithi008 (mon.0) 2216 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:13.962286+0000 mon.smithi008 (mon.0) 2217 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:13.968749+0000 mon.smithi008 (mon.0) 2218 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:13.974947+0000 mon.smithi008 (mon.0) 2219 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:13.977838+0000 mon.smithi008 (mon.0) 2220 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:13.979439+0000 mon.smithi008 (mon.0) 2221 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:13.980941+0000 mon.smithi008 (mon.0) 2222 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:13.982881+0000 mon.smithi008 (mon.0) 2223 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:14.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:13.959244+0000 mon.smithi008 (mon.0) 2215 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:14.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:13.961355+0000 mon.smithi008 (mon.0) 2216 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:13.962286+0000 mon.smithi008 (mon.0) 2217 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:13.968749+0000 mon.smithi008 (mon.0) 2218 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:13.974947+0000 mon.smithi008 (mon.0) 2219 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:13.977838+0000 mon.smithi008 (mon.0) 2220 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:13.979439+0000 mon.smithi008 (mon.0) 2221 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:13.980941+0000 mon.smithi008 (mon.0) 2222 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:13.982881+0000 mon.smithi008 (mon.0) 2223 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.752+0000 7ff11483d700 1 -- 172.21.15.8:0/2523477960 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1100fee30 con 0x7ff0f8060f70 2023-10-18T21:28:14.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.754+0000 7ff0f77fe700 1 -- 172.21.15.8:0/2523477960 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff1100fee30 con 0x7ff0f8060f70 2023-10-18T21:28:14.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 -- 172.21.15.8:0/2523477960 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0f8060f70 msgr2=0x7ff0f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:14.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0f8060f70 0x7ff0f8063430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7ff110106b90 tx=0x7ff100009b30).stop 2023-10-18T21:28:14.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 -- 172.21.15.8:0/2523477960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1100f77d0 msgr2=0x7ff110107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:14.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1100f77d0 0x7ff110107310 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7ff1040026d0 tx=0x7ff104009de0).stop 2023-10-18T21:28:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 -- 172.21.15.8:0/2523477960 shutdown_connections 2023-10-18T21:28:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0f8060f70 0x7ff0f8063430 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1100f6530 0x7ff110106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 --2- 172.21.15.8:0/2523477960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1100f77d0 0x7ff110107310 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 -- 172.21.15.8:0/2523477960 >> 172.21.15.8:0/2523477960 conn(0x7ff1100f1c90 msgr2=0x7ff1100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 -- 172.21.15.8:0/2523477960 shutdown_connections 2023-10-18T21:28:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.756+0000 7ff11483d700 1 -- 172.21.15.8:0/2523477960 wait complete. 2023-10-18T21:28:14.772 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:28:14.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.893+0000 7f800bfff700 1 -- 172.21.15.8:0/2382914537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f800c0f99e0 msgr2=0x7f800c0f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:14.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.893+0000 7f800bfff700 1 --2- 172.21.15.8:0/2382914537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f800c0f99e0 0x7f800c0f9e40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f8000004660 tx=0x7f8000009b30).stop 2023-10-18T21:28:14.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.893+0000 7f800bfff700 1 -- 172.21.15.8:0/2382914537 shutdown_connections 2023-10-18T21:28:14.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.893+0000 7f800bfff700 1 --2- 172.21.15.8:0/2382914537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f800c0f99e0 0x7f800c0f9e40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:14.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.893+0000 7f800bfff700 1 --2- 172.21.15.8:0/2382914537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f800c0f8740 0x7f800c0f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:14.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.893+0000 7f800bfff700 1 -- 172.21.15.8:0/2382914537 >> 172.21.15.8:0/2382914537 conn(0x7f800c0f40e0 msgr2=0x7f800c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:14.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.893+0000 7f800bfff700 1 -- 172.21.15.8:0/2382914537 shutdown_connections 2023-10-18T21:28:14.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.894+0000 7f800bfff700 1 -- 172.21.15.8:0/2382914537 wait complete. 2023-10-18T21:28:14.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.894+0000 7f800bfff700 1 Processor -- start 2023-10-18T21:28:14.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.895+0000 7f800bfff700 1 -- start start 2023-10-18T21:28:14.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.895+0000 7f800bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f800c0f8740 0x7f800c108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:14.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.895+0000 7f800bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f800c0f99e0 0x7f800c109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:14.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.895+0000 7f800bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c1099d0 con 0x7f800c0f99e0 2023-10-18T21:28:14.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.895+0000 7f800bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c109b10 con 0x7f800c0f8740 2023-10-18T21:28:14.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.895+0000 7f800a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f800c0f99e0 0x7f800c109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:14.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.895+0000 7f800a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f800c0f99e0 0x7f800c109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59970/0 (socket says 172.21.15.8:59970) 2023-10-18T21:28:14.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.895+0000 7f800a7fc700 1 -- 172.21.15.8:0/2060470822 learned_addr learned my addr 172.21.15.8:0/2060470822 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:14.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.895+0000 7f800affd700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f800c0f8740 0x7f800c108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:14.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.896+0000 7f800a7fc700 1 -- 172.21.15.8:0/2060470822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f800c0f8740 msgr2=0x7f800c108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:14.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.896+0000 7f800a7fc700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f800c0f8740 0x7f800c108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:14.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.896+0000 7f800a7fc700 1 -- 172.21.15.8:0/2060470822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000005040 con 0x7f800c0f99e0 2023-10-18T21:28:14.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.896+0000 7f800affd700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f800c0f8740 0x7f800c108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:28:14.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.896+0000 7f800a7fc700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f800c0f99e0 0x7f800c109420 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f8000009990 tx=0x7f8000009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:14.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.896+0000 7f7ff37fe700 1 -- 172.21.15.8:0/2060470822 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8000018070 con 0x7f800c0f99e0 2023-10-18T21:28:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.896+0000 7f7ff37fe700 1 -- 172.21.15.8:0/2060470822 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8000009630 con 0x7f800c0f99e0 2023-10-18T21:28:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.896+0000 7f800bfff700 1 -- 172.21.15.8:0/2060470822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c10a450 con 0x7f800c0f99e0 2023-10-18T21:28:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.896+0000 7f7ff37fe700 1 -- 172.21.15.8:0/2060470822 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f800001c400 con 0x7f800c0f99e0 2023-10-18T21:28:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.896+0000 7f800bfff700 1 -- 172.21.15.8:0/2060470822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c10a9b0 con 0x7f800c0f99e0 2023-10-18T21:28:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.897+0000 7f800bfff700 1 -- 172.21.15.8:0/2060470822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c045ad0 con 0x7f800c0f99e0 2023-10-18T21:28:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.898+0000 7f7ff37fe700 1 -- 172.21.15.8:0/2060470822 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f800001d9e0 con 0x7f800c0f99e0 2023-10-18T21:28:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.899+0000 7f7ff37fe700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ff4060f70 0x7f7ff4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.899+0000 7f7ff37fe700 1 -- 172.21.15.8:0/2060470822 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f800007e740 con 0x7f800c0f99e0 2023-10-18T21:28:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.899+0000 7f800affd700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ff4060f70 0x7f7ff4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.900+0000 7f800affd700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ff4060f70 0x7f7ff4063430 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f800c0f9840 tx=0x7f7ffc009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:14.903+0000 7f7ff37fe700 1 -- 172.21.15.8:0/2060470822 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8000051d20 con 0x7f800c0f99e0 2023-10-18T21:28:15.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.110+0000 7f800bfff700 1 -- 172.21.15.8:0/2060470822 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f800c100fe0 con 0x7f7ff4060f70 2023-10-18T21:28:15.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.111+0000 7f7ff37fe700 1 -- 172.21.15.8:0/2060470822 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f800c100fe0 con 0x7f7ff4060f70 2023-10-18T21:28:15.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.113+0000 7f800bfff700 1 -- 172.21.15.8:0/2060470822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ff4060f70 msgr2=0x7f7ff4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:15.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.113+0000 7f800bfff700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ff4060f70 0x7f7ff4063430 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f800c0f9840 tx=0x7f7ffc009c00).stop 2023-10-18T21:28:15.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.113+0000 7f800bfff700 1 -- 172.21.15.8:0/2060470822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f800c0f99e0 msgr2=0x7f800c109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:15.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.113+0000 7f800bfff700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f800c0f99e0 0x7f800c109420 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f8000009990 tx=0x7f8000009b30).stop 2023-10-18T21:28:15.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.114+0000 7f800bfff700 1 -- 172.21.15.8:0/2060470822 shutdown_connections 2023-10-18T21:28:15.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.114+0000 7f800bfff700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7ff4060f70 0x7f7ff4063430 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.114+0000 7f800bfff700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f800c0f8740 0x7f800c108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.114+0000 7f800bfff700 1 --2- 172.21.15.8:0/2060470822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f800c0f99e0 0x7f800c109420 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.114+0000 7f800bfff700 1 -- 172.21.15.8:0/2060470822 >> 172.21.15.8:0/2060470822 conn(0x7f800c0f40e0 msgr2=0x7f800c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:15.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.114+0000 7f800bfff700 1 -- 172.21.15.8:0/2060470822 shutdown_connections 2023-10-18T21:28:15.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.114+0000 7f800bfff700 1 -- 172.21.15.8:0/2060470822 wait complete. 2023-10-18T21:28:15.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.250+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1282618610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 msgr2=0x7f2a080f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:15.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.250+0000 7f2a0ece4700 1 --2- 172.21.15.8:0/1282618610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 0x7f2a080f7c30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f29f8004660 tx=0x7f29f8009b30).stop 2023-10-18T21:28:15.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.250+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1282618610 shutdown_connections 2023-10-18T21:28:15.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.250+0000 7f2a0ece4700 1 --2- 172.21.15.8:0/1282618610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 0x7f2a080f7c30 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.250+0000 7f2a0ece4700 1 --2- 172.21.15.8:0/1282618610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f6530 0x7f2a080f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.250+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1282618610 >> 172.21.15.8:0/1282618610 conn(0x7f2a080f1c90 msgr2=0x7f2a080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:15.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.250+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1282618610 shutdown_connections 2023-10-18T21:28:15.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.250+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1282618610 wait complete. 2023-10-18T21:28:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.251+0000 7f2a0ece4700 1 Processor -- start 2023-10-18T21:28:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.251+0000 7f2a0ece4700 1 -- start start 2023-10-18T21:28:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0ece4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f6530 0x7f2a08108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0ece4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 0x7f2a08109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0ece4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081099c0 con 0x7f2a080f77d0 2023-10-18T21:28:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0ece4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08109b00 con 0x7f2a080f6530 2023-10-18T21:28:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0d4e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 0x7f2a08109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0d4e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 0x7f2a08109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59982/0 (socket says 172.21.15.8:59982) 2023-10-18T21:28:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0d4e1700 1 -- 172.21.15.8:0/1039212783 learned_addr learned my addr 172.21.15.8:0/1039212783 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0dce2700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f6530 0x7f2a08108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0d4e1700 1 -- 172.21.15.8:0/1039212783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f6530 msgr2=0x7f2a08108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0d4e1700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f6530 0x7f2a08108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.252+0000 7f2a0d4e1700 1 -- 172.21.15.8:0/1039212783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f8005040 con 0x7f2a080f77d0 2023-10-18T21:28:15.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.253+0000 7f2a0d4e1700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 0x7f2a08109410 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f29f8004d80 tx=0x7f29f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:15.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.253+0000 7f29fe7fc700 1 -- 172.21.15.8:0/1039212783 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f8019070 con 0x7f2a080f77d0 2023-10-18T21:28:15.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.253+0000 7f29fe7fc700 1 -- 172.21.15.8:0/1039212783 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f29f801e420 con 0x7f2a080f77d0 2023-10-18T21:28:15.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.253+0000 7f29fe7fc700 1 -- 172.21.15.8:0/1039212783 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f8014680 con 0x7f2a080f77d0 2023-10-18T21:28:15.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.253+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1039212783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0810a440 con 0x7f2a080f77d0 2023-10-18T21:28:15.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.253+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1039212783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0810a880 con 0x7f2a080f77d0 2023-10-18T21:28:15.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.254+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1039212783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a08045ad0 con 0x7f2a080f77d0 2023-10-18T21:28:15.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.255+0000 7f29fe7fc700 1 -- 172.21.15.8:0/1039212783 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f29f801e9c0 con 0x7f2a080f77d0 2023-10-18T21:28:15.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.256+0000 7f29fe7fc700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f4060f70 0x7f29f4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:15.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.256+0000 7f29fe7fc700 1 -- 172.21.15.8:0/1039212783 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f29f807dea0 con 0x7f2a080f77d0 2023-10-18T21:28:15.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.256+0000 7f2a0dce2700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f4060f70 0x7f29f4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:15.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.256+0000 7f2a0dce2700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f4060f70 0x7f29f4063430 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f2a080f7630 tx=0x7f2a0400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:15.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.260+0000 7f29fe7fc700 1 -- 172.21.15.8:0/1039212783 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f29f8051480 con 0x7f2a080f77d0 2023-10-18T21:28:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:13.925183+0000 mgr.smithi008.flmjzp (mgr.14640) 1761 : cluster [DBG] pgmap v1221: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:13.963092+0000 mgr.smithi008.flmjzp (mgr.14640) 1762 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:13.963642+0000 mgr.smithi008.flmjzp (mgr.14640) 1763 : cluster [DBG] pgmap v1222: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:13.963879+0000 mgr.smithi008.flmjzp (mgr.14640) 1764 : cluster [DBG] pgmap v1223: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:13.984661+0000 mgr.smithi008.flmjzp (mgr.14640) 1765 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:14.755118+0000 mgr.smithi008.flmjzp (mgr.14640) 1766 : audit [DBG] from='client.35584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:15.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.459+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1039212783 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a080fc190 con 0x7f29f4060f70 2023-10-18T21:28:15.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.468+0000 7f29fe7fc700 1 -- 172.21.15.8:0/1039212783 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2a080fc190 con 0x7f29f4060f70 2023-10-18T21:28:15.470 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:28:15.471 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (34m) 2m ago 36m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:28:15.471 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (28m) 2m ago 36m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:28:15.471 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (28m) 42s ago 35m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:28:15.471 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (34m) 2m ago 36m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:28:15.471 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 32m - - 2023-10-18T21:28:15.472 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 32m - - 2023-10-18T21:28:15.472 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 42s ago 32m - - 2023-10-18T21:28:15.472 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 42s ago 32m - - 2023-10-18T21:28:15.472 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (30m) 2m ago 37m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:28:15.472 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (29m) 42s ago 35m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:28:15.473 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (29m) 2m ago 37m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:28:15.473 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (29m) 42s ago 35m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:28:15.473 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (35m) 2m ago 35m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:28:15.473 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (35m) 42s ago 35m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:28:15.473 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (28m) 2m ago 34m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:28:15.473 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (26m) 2m ago 34m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:28:15.474 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (26m) 2m ago 34m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:28:15.474 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (25m) 42s ago 34m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:28:15.474 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (24m) 42s ago 33m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:28:15.474 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (24m) 42s ago 33m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:28:15.474 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (30m) 2m ago 35m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:28:15.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.470+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1039212783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f4060f70 msgr2=0x7f29f4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:15.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.470+0000 7f2a0ece4700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f4060f70 0x7f29f4063430 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f2a080f7630 tx=0x7f2a0400b040).stop 2023-10-18T21:28:15.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.470+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1039212783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 msgr2=0x7f2a08109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:15.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.470+0000 7f2a0ece4700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 0x7f2a08109410 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f29f8004d80 tx=0x7f29f800b040).stop 2023-10-18T21:28:15.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.470+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1039212783 shutdown_connections 2023-10-18T21:28:15.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.470+0000 7f2a0ece4700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f4060f70 0x7f29f4063430 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.470+0000 7f2a0ece4700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f6530 0x7f2a08108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.471+0000 7f2a0ece4700 1 --2- 172.21.15.8:0/1039212783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 0x7f2a08109410 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.471+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1039212783 >> 172.21.15.8:0/1039212783 conn(0x7f2a080f1c90 msgr2=0x7f2a0806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:15.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.471+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1039212783 shutdown_connections 2023-10-18T21:28:15.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.471+0000 7f2a0ece4700 1 -- 172.21.15.8:0/1039212783 wait complete. 2023-10-18T21:28:15.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.607+0000 7f849d819700 1 -- 172.21.15.8:0/1809060992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84980f77d0 msgr2=0x7f84980f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:15.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.607+0000 7f849d819700 1 --2- 172.21.15.8:0/1809060992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84980f77d0 0x7f84980f7c30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f8484004660 tx=0x7f8484009b30).stop 2023-10-18T21:28:15.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.607+0000 7f849d819700 1 -- 172.21.15.8:0/1809060992 shutdown_connections 2023-10-18T21:28:15.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.607+0000 7f849d819700 1 --2- 172.21.15.8:0/1809060992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84980f77d0 0x7f84980f7c30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.607+0000 7f849d819700 1 --2- 172.21.15.8:0/1809060992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84980f6530 0x7f84980f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.607+0000 7f849d819700 1 -- 172.21.15.8:0/1809060992 >> 172.21.15.8:0/1809060992 conn(0x7f84980f1c90 msgr2=0x7f84980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:15.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.607+0000 7f849d819700 1 -- 172.21.15.8:0/1809060992 shutdown_connections 2023-10-18T21:28:15.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.607+0000 7f849d819700 1 -- 172.21.15.8:0/1809060992 wait complete. 2023-10-18T21:28:15.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.608+0000 7f849d819700 1 Processor -- start 2023-10-18T21:28:15.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.608+0000 7f849d819700 1 -- start start 2023-10-18T21:28:15.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.609+0000 7f849d819700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84980f6530 0x7f8498106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:15.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.609+0000 7f849d819700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84980f77d0 0x7f8498107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:15.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.609+0000 7f849d819700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84981077d0 con 0x7f84980f6530 2023-10-18T21:28:15.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.609+0000 7f849d819700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498107fd0 con 0x7f84980f77d0 2023-10-18T21:28:15.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.609+0000 7f849c817700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84980f6530 0x7f8498106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.609+0000 7f849c817700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84980f6530 0x7f8498106d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60008/0 (socket says 172.21.15.8:60008) 2023-10-18T21:28:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.609+0000 7f849c817700 1 -- 172.21.15.8:0/374893110 learned_addr learned my addr 172.21.15.8:0/374893110 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.609+0000 7f8497fff700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84980f77d0 0x7f8498107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.610+0000 7f849c817700 1 -- 172.21.15.8:0/374893110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84980f77d0 msgr2=0x7f8498107220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.610+0000 7f849c817700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84980f77d0 0x7f8498107220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.610+0000 7f849c817700 1 -- 172.21.15.8:0/374893110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8484005040 con 0x7f84980f6530 2023-10-18T21:28:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.610+0000 7f849c817700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84980f6530 0x7f8498106d30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f848c00e7c0 tx=0x7f848c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.610+0000 7f84957fa700 1 -- 172.21.15.8:0/374893110 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f848c0092e0 con 0x7f84980f6530 2023-10-18T21:28:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.610+0000 7f84957fa700 1 -- 172.21.15.8:0/374893110 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f848c00f040 con 0x7f84980f6530 2023-10-18T21:28:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.610+0000 7f84957fa700 1 -- 172.21.15.8:0/374893110 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f848c014810 con 0x7f84980f6530 2023-10-18T21:28:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.610+0000 7f849d819700 1 -- 172.21.15.8:0/374893110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84981082b0 con 0x7f84980f6530 2023-10-18T21:28:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.610+0000 7f849d819700 1 -- 172.21.15.8:0/374893110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84981087f0 con 0x7f84980f6530 2023-10-18T21:28:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.611+0000 7f849d819700 1 -- 172.21.15.8:0/374893110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8498059100 con 0x7f84980f6530 2023-10-18T21:28:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.612+0000 7f84957fa700 1 -- 172.21.15.8:0/374893110 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f848c01b030 con 0x7f84980f6530 2023-10-18T21:28:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.613+0000 7f84957fa700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8488060f70 0x7f8488063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.613+0000 7f84957fa700 1 -- 172.21.15.8:0/374893110 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f848c07c7c0 con 0x7f84980f6530 2023-10-18T21:28:15.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.613+0000 7f8497fff700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8488060f70 0x7f8488063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:15.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.614+0000 7f8497fff700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8488060f70 0x7f8488063430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f8484005010 tx=0x7f8484016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:15.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.617+0000 7f84957fa700 1 -- 172.21.15.8:0/374893110 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f848c04fe60 con 0x7f84980f6530 2023-10-18T21:28:15.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:13.925183+0000 mgr.smithi008.flmjzp (mgr.14640) 1761 : cluster [DBG] pgmap v1221: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:15.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:13.963092+0000 mgr.smithi008.flmjzp (mgr.14640) 1762 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:13.963642+0000 mgr.smithi008.flmjzp (mgr.14640) 1763 : cluster [DBG] pgmap v1222: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:13.963879+0000 mgr.smithi008.flmjzp (mgr.14640) 1764 : cluster [DBG] pgmap v1223: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:13.984661+0000 mgr.smithi008.flmjzp (mgr.14640) 1765 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:14.755118+0000 mgr.smithi008.flmjzp (mgr.14640) 1766 : audit [DBG] from='client.35584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:15.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.880+0000 7f849d819700 1 -- 172.21.15.8:0/374893110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f84980008d0 con 0x7f84980f6530 2023-10-18T21:28:15.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.880+0000 7f84957fa700 1 -- 172.21.15.8:0/374893110 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f848c019070 con 0x7f84980f6530 2023-10-18T21:28:15.882 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:28:15.883 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:28:15.883 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:28:15.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:28:15.883 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:28:15.884 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:28:15.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:28:15.884 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:28:15.884 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:28:15.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:28:15.885 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:28:15.885 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:28:15.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:28:15.885 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:28:15.885 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:28:15.886 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:28:15.886 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:28:15.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.882+0000 7f849d819700 1 -- 172.21.15.8:0/374893110 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8488060f70 msgr2=0x7f8488063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:15.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.882+0000 7f849d819700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8488060f70 0x7f8488063430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f8484005010 tx=0x7f8484016040).stop 2023-10-18T21:28:15.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.882+0000 7f849d819700 1 -- 172.21.15.8:0/374893110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84980f6530 msgr2=0x7f8498106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:15.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.882+0000 7f849d819700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84980f6530 0x7f8498106d30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f848c00e7c0 tx=0x7f848c00b040).stop 2023-10-18T21:28:15.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.882+0000 7f849d819700 1 -- 172.21.15.8:0/374893110 shutdown_connections 2023-10-18T21:28:15.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.882+0000 7f849d819700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8488060f70 0x7f8488063430 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.882+0000 7f849d819700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84980f6530 0x7f8498106d30 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.882+0000 7f849d819700 1 --2- 172.21.15.8:0/374893110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84980f77d0 0x7f8498107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:15.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.882+0000 7f849d819700 1 -- 172.21.15.8:0/374893110 >> 172.21.15.8:0/374893110 conn(0x7f84980f1c90 msgr2=0x7f84980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:15.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.883+0000 7f849d819700 1 -- 172.21.15.8:0/374893110 shutdown_connections 2023-10-18T21:28:15.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:15.883+0000 7f849d819700 1 -- 172.21.15.8:0/374893110 wait complete. 2023-10-18T21:28:16.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.018+0000 7f54be3c1700 1 -- 172.21.15.8:0/2138452679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b80f77d0 msgr2=0x7f54b80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:16.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.018+0000 7f54be3c1700 1 --2- 172.21.15.8:0/2138452679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b80f77d0 0x7f54b80f7c30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f54a8004660 tx=0x7f54a8009b30).stop 2023-10-18T21:28:16.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.018+0000 7f54be3c1700 1 -- 172.21.15.8:0/2138452679 shutdown_connections 2023-10-18T21:28:16.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.018+0000 7f54be3c1700 1 --2- 172.21.15.8:0/2138452679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b80f77d0 0x7f54b80f7c30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.018+0000 7f54be3c1700 1 --2- 172.21.15.8:0/2138452679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54b80f6530 0x7f54b80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.019+0000 7f54be3c1700 1 -- 172.21.15.8:0/2138452679 >> 172.21.15.8:0/2138452679 conn(0x7f54b80f1c90 msgr2=0x7f54b80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:16.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.019+0000 7f54be3c1700 1 -- 172.21.15.8:0/2138452679 shutdown_connections 2023-10-18T21:28:16.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.019+0000 7f54be3c1700 1 -- 172.21.15.8:0/2138452679 wait complete. 2023-10-18T21:28:16.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.020+0000 7f54be3c1700 1 Processor -- start 2023-10-18T21:28:16.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.020+0000 7f54be3c1700 1 -- start start 2023-10-18T21:28:16.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.020+0000 7f54be3c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b80f6530 0x7f54b8108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:16.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.020+0000 7f54be3c1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54b80f77d0 0x7f54b8109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:16.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.020+0000 7f54be3c1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b81099c0 con 0x7f54b80f6530 2023-10-18T21:28:16.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.020+0000 7f54be3c1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b8109b00 con 0x7f54b80f77d0 2023-10-18T21:28:16.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.020+0000 7f54bd3bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b80f6530 0x7f54b8108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:16.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.020+0000 7f54bd3bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b80f6530 0x7f54b8108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60034/0 (socket says 172.21.15.8:60034) 2023-10-18T21:28:16.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.021+0000 7f54bd3bf700 1 -- 172.21.15.8:0/2273978859 learned_addr learned my addr 172.21.15.8:0/2273978859 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:16.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.021+0000 7f54bcbbe700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54b80f77d0 0x7f54b8109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:16.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.021+0000 7f54bd3bf700 1 -- 172.21.15.8:0/2273978859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54b80f77d0 msgr2=0x7f54b8109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:16.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.021+0000 7f54bd3bf700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54b80f77d0 0x7f54b8109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.021+0000 7f54bd3bf700 1 -- 172.21.15.8:0/2273978859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8005040 con 0x7f54b80f6530 2023-10-18T21:28:16.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.021+0000 7f54bd3bf700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b80f6530 0x7f54b8108f20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f54b4002700 tx=0x7f54b4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:16.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.021+0000 7f54adffb700 1 -- 172.21.15.8:0/2273978859 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b40079c0 con 0x7f54b80f6530 2023-10-18T21:28:16.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.021+0000 7f54be3c1700 1 -- 172.21.15.8:0/2273978859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b810a4a0 con 0x7f54b80f6530 2023-10-18T21:28:16.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.021+0000 7f54adffb700 1 -- 172.21.15.8:0/2273978859 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f54b400f040 con 0x7f54b80f6530 2023-10-18T21:28:16.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.022+0000 7f54be3c1700 1 -- 172.21.15.8:0/2273978859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b810aa60 con 0x7f54b80f6530 2023-10-18T21:28:16.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.022+0000 7f54adffb700 1 -- 172.21.15.8:0/2273978859 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b4014850 con 0x7f54b80f6530 2023-10-18T21:28:16.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.023+0000 7f54be3c1700 1 -- 172.21.15.8:0/2273978859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b8045ad0 con 0x7f54b80f6530 2023-10-18T21:28:16.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.023+0000 7f54adffb700 1 -- 172.21.15.8:0/2273978859 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f54b401b060 con 0x7f54b80f6530 2023-10-18T21:28:16.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.024+0000 7f54adffb700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54a4060f70 0x7f54a4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:16.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.024+0000 7f54adffb700 1 -- 172.21.15.8:0/2273978859 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f54b407c7a0 con 0x7f54b80f6530 2023-10-18T21:28:16.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.025+0000 7f54bcbbe700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54a4060f70 0x7f54a4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:16.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.025+0000 7f54bcbbe700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54a4060f70 0x7f54a4063430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f54a8004630 tx=0x7f54a8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:16.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.028+0000 7f54adffb700 1 -- 172.21.15.8:0/2273978859 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f54b404fde0 con 0x7f54b80f6530 2023-10-18T21:28:16.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.258+0000 7f54be3c1700 1 -- 172.21.15.8:0/2273978859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f54b80fee40 con 0x7f54b80f6530 2023-10-18T21:28:16.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.258+0000 7f54adffb700 1 -- 172.21.15.8:0/2273978859 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f54b400e1a0 con 0x7f54b80f6530 2023-10-18T21:28:16.260 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:28:16.260 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:28:16.261 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:28:16.261 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:28:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:28:16.261 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:28:16.261 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:28:16.262 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:28:16.262 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:28:16.262 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:28:16.262 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:28:16.263 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:28:16.263 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:28:16.263 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:28:16.263 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:28:16.263 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:28:16.264 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:28:16.264 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:28:16.264 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:28:16.264 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:28:16.264 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:28:16.265 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:28:16.265 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:28:16.265 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:28:16.265 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:28:16.265 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:28:16.266 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:28:16.266 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:28:16.266 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:28:16.266 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:28:16.266 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:28:16.267 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:28:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:28:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:28:16.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 -- 172.21.15.8:0/2273978859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54a4060f70 msgr2=0x7f54a4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:16.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54a4060f70 0x7f54a4063430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f54a8004630 tx=0x7f54a8009b30).stop 2023-10-18T21:28:16.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 -- 172.21.15.8:0/2273978859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b80f6530 msgr2=0x7f54b8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:16.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b80f6530 0x7f54b8108f20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f54b4002700 tx=0x7f54b4009e00).stop 2023-10-18T21:28:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 -- 172.21.15.8:0/2273978859 shutdown_connections 2023-10-18T21:28:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54a4060f70 0x7f54a4063430 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b80f6530 0x7f54b8108f20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 --2- 172.21.15.8:0/2273978859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54b80f77d0 0x7f54b8109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 -- 172.21.15.8:0/2273978859 >> 172.21.15.8:0/2273978859 conn(0x7f54b80f1c90 msgr2=0x7f54b806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:16.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 -- 172.21.15.8:0/2273978859 shutdown_connections 2023-10-18T21:28:16.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.260+0000 7f54be3c1700 1 -- 172.21.15.8:0/2273978859 wait complete. 2023-10-18T21:28:16.270 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:28:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.397+0000 7fbf11a35700 1 -- 172.21.15.8:0/473686608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf0c06a3b0 msgr2=0x7fbf0c06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.397+0000 7fbf11a35700 1 --2- 172.21.15.8:0/473686608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf0c06a3b0 0x7fbf0c06a830 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fbef8004660 tx=0x7fbef8009b30).stop 2023-10-18T21:28:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.397+0000 7fbf11a35700 1 -- 172.21.15.8:0/473686608 shutdown_connections 2023-10-18T21:28:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.397+0000 7fbf11a35700 1 --2- 172.21.15.8:0/473686608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf0c06a3b0 0x7fbf0c06a830 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.397+0000 7fbf11a35700 1 --2- 172.21.15.8:0/473686608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf0c06b9c0 0x7fbf0c069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.397+0000 7fbf11a35700 1 -- 172.21.15.8:0/473686608 >> 172.21.15.8:0/473686608 conn(0x7fbf0c0f1c90 msgr2=0x7fbf0c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:16.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.397+0000 7fbf11a35700 1 -- 172.21.15.8:0/473686608 shutdown_connections 2023-10-18T21:28:16.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.397+0000 7fbf11a35700 1 -- 172.21.15.8:0/473686608 wait complete. 2023-10-18T21:28:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.398+0000 7fbf11a35700 1 Processor -- start 2023-10-18T21:28:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.398+0000 7fbf11a35700 1 -- start start 2023-10-18T21:28:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf11a35700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf0c06a3b0 0x7fbf0c108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf11a35700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf0c06b9c0 0x7fbf0c109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf11a35700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c109a10 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf11a35700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c109b50 con 0x7fbf0c06b9c0 2023-10-18T21:28:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf10a33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf0c06a3b0 0x7fbf0c108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf10a33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf0c06a3b0 0x7fbf0c108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60052/0 (socket says 172.21.15.8:60052) 2023-10-18T21:28:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf10a33700 1 -- 172.21.15.8:0/599761687 learned_addr learned my addr 172.21.15.8:0/599761687 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf0bfff700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf0c06b9c0 0x7fbf0c109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:16.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf10a33700 1 -- 172.21.15.8:0/599761687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf0c06b9c0 msgr2=0x7fbf0c109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:16.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf10a33700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf0c06b9c0 0x7fbf0c109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.399+0000 7fbf10a33700 1 -- 172.21.15.8:0/599761687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8005040 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.400+0000 7fbf10a33700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf0c06a3b0 0x7fbf0c108f70 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fbf000026d0 tx=0x7fbf00009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:16.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.400+0000 7fbf097fa700 1 -- 172.21.15.8:0/599761687 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf000079c0 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.400+0000 7fbf097fa700 1 -- 172.21.15.8:0/599761687 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbf0000f040 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.400+0000 7fbf11a35700 1 -- 172.21.15.8:0/599761687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c10a4f0 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.400+0000 7fbf097fa700 1 -- 172.21.15.8:0/599761687 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf00014980 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.400+0000 7fbf11a35700 1 -- 172.21.15.8:0/599761687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c10aab0 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.401+0000 7fbf11a35700 1 -- 172.21.15.8:0/599761687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c045ad0 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.402+0000 7fbf097fa700 1 -- 172.21.15.8:0/599761687 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbf000090d0 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.403+0000 7fbf097fa700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbefc060f70 0x7fbefc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:16.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.403+0000 7fbf097fa700 1 -- 172.21.15.8:0/599761687 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbf0007c7e0 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.403+0000 7fbf0bfff700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbefc060f70 0x7fbefc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:16.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.404+0000 7fbf0bfff700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbefc060f70 0x7fbefc063430 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fbef8004630 tx=0x7fbef8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:16.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.407+0000 7fbf097fa700 1 -- 172.21.15.8:0/599761687 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbf0004ffb0 con 0x7fbf0c06a3b0 2023-10-18T21:28:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.605+0000 7fbf11a35700 1 -- 172.21.15.8:0/599761687 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf0c100ff0 con 0x7fbefc060f70 2023-10-18T21:28:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.607+0000 7fbf097fa700 1 -- 172.21.15.8:0/599761687 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbf0c100ff0 con 0x7fbefc060f70 2023-10-18T21:28:16.608 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:28:16.609 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:28:16.609 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:28:16.609 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:28:16.609 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:28:16.609 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:28:16.610 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:28:16.610 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:28:16.610 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:28:16.610 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:28:16.610 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:28:16.611 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:28:16.611 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:28:16.611 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:28:16.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 -- 172.21.15.8:0/599761687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbefc060f70 msgr2=0x7fbefc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:16.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbefc060f70 0x7fbefc063430 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fbef8004630 tx=0x7fbef8009b30).stop 2023-10-18T21:28:16.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 -- 172.21.15.8:0/599761687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf0c06a3b0 msgr2=0x7fbf0c108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf0c06a3b0 0x7fbf0c108f70 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fbf000026d0 tx=0x7fbf00009de0).stop 2023-10-18T21:28:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 -- 172.21.15.8:0/599761687 shutdown_connections 2023-10-18T21:28:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbefc060f70 0x7fbefc063430 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf0c06a3b0 0x7fbf0c108f70 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 --2- 172.21.15.8:0/599761687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf0c06b9c0 0x7fbf0c109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:16.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 -- 172.21.15.8:0/599761687 >> 172.21.15.8:0/599761687 conn(0x7fbf0c0f1c90 msgr2=0x7fbf0c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:16.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 -- 172.21.15.8:0/599761687 shutdown_connections 2023-10-18T21:28:16.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:16.609+0000 7fbf11a35700 1 -- 172.21.15.8:0/599761687 wait complete. 2023-10-18T21:28:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:15.112709+0000 mgr.smithi008.flmjzp (mgr.14640) 1767 : audit [DBG] from='client.35588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:15.461401+0000 mgr.smithi008.flmjzp (mgr.14640) 1768 : audit [DBG] from='client.35592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:15.881888+0000 mon.smithi008 (mon.0) 2224 : audit [DBG] from='client.? 172.21.15.8:0/374893110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:16.259710+0000 mon.smithi008 (mon.0) 2225 : audit [DBG] from='client.? 172.21.15.8:0/2273978859' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:28:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:15.112709+0000 mgr.smithi008.flmjzp (mgr.14640) 1767 : audit [DBG] from='client.35588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:15.461401+0000 mgr.smithi008.flmjzp (mgr.14640) 1768 : audit [DBG] from='client.35592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:15.881888+0000 mon.smithi008 (mon.0) 2224 : audit [DBG] from='client.? 172.21.15.8:0/374893110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:16.259710+0000 mon.smithi008 (mon.0) 2225 : audit [DBG] from='client.? 172.21.15.8:0/2273978859' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:28:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:15.964314+0000 mgr.smithi008.flmjzp (mgr.14640) 1769 : cluster [DBG] pgmap v1224: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:16.608032+0000 mgr.smithi008.flmjzp (mgr.14640) 1770 : audit [DBG] from='client.35604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:17.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:15.964314+0000 mgr.smithi008.flmjzp (mgr.14640) 1769 : cluster [DBG] pgmap v1224: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:16.608032+0000 mgr.smithi008.flmjzp (mgr.14640) 1770 : audit [DBG] from='client.35604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:17.964829+0000 mgr.smithi008.flmjzp (mgr.14640) 1771 : cluster [DBG] pgmap v1225: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:19.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:17.964829+0000 mgr.smithi008.flmjzp (mgr.14640) 1771 : cluster [DBG] pgmap v1225: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:21.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:19.965488+0000 mgr.smithi008.flmjzp (mgr.14640) 1772 : cluster [DBG] pgmap v1226: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:19.965488+0000 mgr.smithi008.flmjzp (mgr.14640) 1772 : cluster [DBG] pgmap v1226: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:21.966092+0000 mgr.smithi008.flmjzp (mgr.14640) 1773 : cluster [DBG] pgmap v1227: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:23.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:21.966092+0000 mgr.smithi008.flmjzp (mgr.14640) 1773 : cluster [DBG] pgmap v1227: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:23.991851+0000 mon.smithi008 (mon.0) 2226 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:24.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:23.991851+0000 mon.smithi008 (mon.0) 2226 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:23.966674+0000 mgr.smithi008.flmjzp (mgr.14640) 1774 : cluster [DBG] pgmap v1228: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:24.562607+0000 mon.smithi008 (mon.0) 2227 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:24.563423+0000 mon.smithi008 (mon.0) 2228 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:24.564063+0000 mgr.smithi008.flmjzp (mgr.14640) 1775 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:24.564534+0000 mgr.smithi008.flmjzp (mgr.14640) 1776 : cluster [DBG] pgmap v1229: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:24.564746+0000 mgr.smithi008.flmjzp (mgr.14640) 1777 : cluster [DBG] pgmap v1230: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:24.568941+0000 mon.smithi008 (mon.0) 2229 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:24.573954+0000 mon.smithi008 (mon.0) 2230 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:24.576280+0000 mon.smithi008 (mon.0) 2231 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:24.577538+0000 mon.smithi008 (mon.0) 2232 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:24.578980+0000 mon.smithi008 (mon.0) 2233 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:24.580469+0000 mon.smithi008 (mon.0) 2234 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:24.582174+0000 mgr.smithi008.flmjzp (mgr.14640) 1778 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:25.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:23.966674+0000 mgr.smithi008.flmjzp (mgr.14640) 1774 : cluster [DBG] pgmap v1228: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:25.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:24.562607+0000 mon.smithi008 (mon.0) 2227 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:24.563423+0000 mon.smithi008 (mon.0) 2228 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:24.564063+0000 mgr.smithi008.flmjzp (mgr.14640) 1775 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:24.564534+0000 mgr.smithi008.flmjzp (mgr.14640) 1776 : cluster [DBG] pgmap v1229: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:24.564746+0000 mgr.smithi008.flmjzp (mgr.14640) 1777 : cluster [DBG] pgmap v1230: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:24.568941+0000 mon.smithi008 (mon.0) 2229 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:24.573954+0000 mon.smithi008 (mon.0) 2230 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:24.576280+0000 mon.smithi008 (mon.0) 2231 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:24.577538+0000 mon.smithi008 (mon.0) 2232 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:24.578980+0000 mon.smithi008 (mon.0) 2233 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:25.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:24.580469+0000 mon.smithi008 (mon.0) 2234 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:25.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:24.582174+0000 mgr.smithi008.flmjzp (mgr.14640) 1778 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:26.565475+0000 mgr.smithi008.flmjzp (mgr.14640) 1779 : cluster [DBG] pgmap v1231: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:27.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:26.565475+0000 mgr.smithi008.flmjzp (mgr.14640) 1779 : cluster [DBG] pgmap v1231: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:28.566050+0000 mgr.smithi008.flmjzp (mgr.14640) 1780 : cluster [DBG] pgmap v1232: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:28.566050+0000 mgr.smithi008.flmjzp (mgr.14640) 1780 : cluster [DBG] pgmap v1232: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:31.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:30.566752+0000 mgr.smithi008.flmjzp (mgr.14640) 1781 : cluster [DBG] pgmap v1233: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:30.566752+0000 mgr.smithi008.flmjzp (mgr.14640) 1781 : cluster [DBG] pgmap v1233: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:32.567269+0000 mgr.smithi008.flmjzp (mgr.14640) 1782 : cluster [DBG] pgmap v1234: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:33.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:32.567269+0000 mgr.smithi008.flmjzp (mgr.14640) 1782 : cluster [DBG] pgmap v1234: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:34.591470+0000 mon.smithi008 (mon.0) 2235 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:34.593730+0000 mon.smithi008 (mon.0) 2236 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:34.594772+0000 mon.smithi008 (mon.0) 2237 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:34.601853+0000 mon.smithi008 (mon.0) 2238 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:34.614010+0000 mon.smithi008 (mon.0) 2239 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:34.617611+0000 mon.smithi008 (mon.0) 2240 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:34.619532+0000 mon.smithi008 (mon.0) 2241 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:34.621365+0000 mon.smithi008 (mon.0) 2242 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:34.591470+0000 mon.smithi008 (mon.0) 2235 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:34.593730+0000 mon.smithi008 (mon.0) 2236 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:34.594772+0000 mon.smithi008 (mon.0) 2237 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:34.601853+0000 mon.smithi008 (mon.0) 2238 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:34.614010+0000 mon.smithi008 (mon.0) 2239 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:34.617611+0000 mon.smithi008 (mon.0) 2240 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:34.619532+0000 mon.smithi008 (mon.0) 2241 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:34.621365+0000 mon.smithi008 (mon.0) 2242 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:34.567921+0000 mgr.smithi008.flmjzp (mgr.14640) 1783 : cluster [DBG] pgmap v1235: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:34.595731+0000 mgr.smithi008.flmjzp (mgr.14640) 1784 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:34.596334+0000 mgr.smithi008.flmjzp (mgr.14640) 1785 : cluster [DBG] pgmap v1236: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:34.596637+0000 mgr.smithi008.flmjzp (mgr.14640) 1786 : cluster [DBG] pgmap v1237: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:34.629466+0000 mon.smithi008 (mon.0) 2243 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:34.631997+0000 mgr.smithi008.flmjzp (mgr.14640) 1787 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:35.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:34.567921+0000 mgr.smithi008.flmjzp (mgr.14640) 1783 : cluster [DBG] pgmap v1235: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:35.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:34.595731+0000 mgr.smithi008.flmjzp (mgr.14640) 1784 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:34.596334+0000 mgr.smithi008.flmjzp (mgr.14640) 1785 : cluster [DBG] pgmap v1236: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:34.596637+0000 mgr.smithi008.flmjzp (mgr.14640) 1786 : cluster [DBG] pgmap v1237: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:34.629466+0000 mon.smithi008 (mon.0) 2243 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:34.631997+0000 mgr.smithi008.flmjzp (mgr.14640) 1787 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:36.597429+0000 mgr.smithi008.flmjzp (mgr.14640) 1788 : cluster [DBG] pgmap v1238: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:37.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:36.597429+0000 mgr.smithi008.flmjzp (mgr.14640) 1788 : cluster [DBG] pgmap v1238: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:38.598002+0000 mgr.smithi008.flmjzp (mgr.14640) 1789 : cluster [DBG] pgmap v1239: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:38.598002+0000 mgr.smithi008.flmjzp (mgr.14640) 1789 : cluster [DBG] pgmap v1239: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:40.598537+0000 mgr.smithi008.flmjzp (mgr.14640) 1790 : cluster [DBG] pgmap v1240: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:40.598537+0000 mgr.smithi008.flmjzp (mgr.14640) 1790 : cluster [DBG] pgmap v1240: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:42.599197+0000 mgr.smithi008.flmjzp (mgr.14640) 1791 : cluster [DBG] pgmap v1241: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:43.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:42.599197+0000 mgr.smithi008.flmjzp (mgr.14640) 1791 : cluster [DBG] pgmap v1241: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:44.642846+0000 mon.smithi008 (mon.0) 2244 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:44.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:44.642846+0000 mon.smithi008 (mon.0) 2244 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:44.599805+0000 mgr.smithi008.flmjzp (mgr.14640) 1792 : cluster [DBG] pgmap v1242: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:45.204157+0000 mon.smithi008 (mon.0) 2245 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:45.205364+0000 mon.smithi008 (mon.0) 2246 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:45.212371+0000 mon.smithi008 (mon.0) 2247 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:45.219205+0000 mon.smithi008 (mon.0) 2248 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:45.222374+0000 mon.smithi008 (mon.0) 2249 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:45.224180+0000 mon.smithi008 (mon.0) 2250 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:45.225941+0000 mon.smithi008 (mon.0) 2251 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:45.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:45.228125+0000 mon.smithi008 (mon.0) 2252 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:45.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:44.599805+0000 mgr.smithi008.flmjzp (mgr.14640) 1792 : cluster [DBG] pgmap v1242: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:45.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:45.204157+0000 mon.smithi008 (mon.0) 2245 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:45.205364+0000 mon.smithi008 (mon.0) 2246 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:45.212371+0000 mon.smithi008 (mon.0) 2247 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:45.219205+0000 mon.smithi008 (mon.0) 2248 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:45.222374+0000 mon.smithi008 (mon.0) 2249 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:45.224180+0000 mon.smithi008 (mon.0) 2250 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:45.225941+0000 mon.smithi008 (mon.0) 2251 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:45.228125+0000 mon.smithi008 (mon.0) 2252 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:46.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.764+0000 7f8263fff700 1 -- 172.21.15.8:0/3545150187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82640f77d0 msgr2=0x7f82640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:46.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.764+0000 7f8263fff700 1 --2- 172.21.15.8:0/3545150187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82640f77d0 0x7f82640f7c30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f8258004660 tx=0x7f8258009b30).stop 2023-10-18T21:28:46.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.764+0000 7f8263fff700 1 -- 172.21.15.8:0/3545150187 shutdown_connections 2023-10-18T21:28:46.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.764+0000 7f8263fff700 1 --2- 172.21.15.8:0/3545150187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82640f77d0 0x7f82640f7c30 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:46.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.764+0000 7f8263fff700 1 --2- 172.21.15.8:0/3545150187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82640f6530 0x7f82640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:46.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.764+0000 7f8263fff700 1 -- 172.21.15.8:0/3545150187 >> 172.21.15.8:0/3545150187 conn(0x7f82640f1c90 msgr2=0x7f82640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:46.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.764+0000 7f8263fff700 1 -- 172.21.15.8:0/3545150187 shutdown_connections 2023-10-18T21:28:46.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.764+0000 7f8263fff700 1 -- 172.21.15.8:0/3545150187 wait complete. 2023-10-18T21:28:46.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.765+0000 7f8263fff700 1 Processor -- start 2023-10-18T21:28:46.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.765+0000 7f8263fff700 1 -- start start 2023-10-18T21:28:46.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f8263fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82640f6530 0x7f8264108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:46.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f8263fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82640f77d0 0x7f82641093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:46.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f8263fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8264109980 con 0x7f82640f77d0 2023-10-18T21:28:46.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f8263fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8264109ac0 con 0x7f82640f6530 2023-10-18T21:28:46.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f82627fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82640f77d0 0x7f82641093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:46.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f82627fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82640f77d0 0x7f82641093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55418/0 (socket says 172.21.15.8:55418) 2023-10-18T21:28:46.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f82627fc700 1 -- 172.21.15.8:0/2123174225 learned_addr learned my addr 172.21.15.8:0/2123174225 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:46.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f8262ffd700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82640f6530 0x7f8264108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:46.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f82627fc700 1 -- 172.21.15.8:0/2123174225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82640f6530 msgr2=0x7f8264108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:46.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f82627fc700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82640f6530 0x7f8264108ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:46.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.766+0000 7f82627fc700 1 -- 172.21.15.8:0/2123174225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8258005040 con 0x7f82640f77d0 2023-10-18T21:28:46.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.767+0000 7f82627fc700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82640f77d0 0x7f82641093d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f8258009f50 tx=0x7f8258009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:46.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.767+0000 7f824b7fe700 1 -- 172.21.15.8:0/2123174225 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8258018070 con 0x7f82640f77d0 2023-10-18T21:28:46.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.767+0000 7f824b7fe700 1 -- 172.21.15.8:0/2123174225 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8258009630 con 0x7f82640f77d0 2023-10-18T21:28:46.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.767+0000 7f824b7fe700 1 -- 172.21.15.8:0/2123174225 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f825801c3c0 con 0x7f82640f77d0 2023-10-18T21:28:46.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.767+0000 7f8263fff700 1 -- 172.21.15.8:0/2123174225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826410a400 con 0x7f82640f77d0 2023-10-18T21:28:46.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.767+0000 7f8263fff700 1 -- 172.21.15.8:0/2123174225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826410a960 con 0x7f82640f77d0 2023-10-18T21:28:46.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.768+0000 7f8263fff700 1 -- 172.21.15.8:0/2123174225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8264045ad0 con 0x7f82640f77d0 2023-10-18T21:28:46.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.769+0000 7f824b7fe700 1 -- 172.21.15.8:0/2123174225 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f825801d420 con 0x7f82640f77d0 2023-10-18T21:28:46.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.770+0000 7f824b7fe700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f824c060f70 0x7f824c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:46.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.770+0000 7f824b7fe700 1 -- 172.21.15.8:0/2123174225 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f825807e600 con 0x7f82640f77d0 2023-10-18T21:28:46.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.770+0000 7f8262ffd700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f824c060f70 0x7f824c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:46.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.771+0000 7f8262ffd700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f824c060f70 0x7f824c063430 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f82640f7630 tx=0x7f8254009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:46.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.774+0000 7f824b7fe700 1 -- 172.21.15.8:0/2123174225 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8258051d40 con 0x7f82640f77d0 2023-10-18T21:28:46.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.975+0000 7f8263fff700 1 -- 172.21.15.8:0/2123174225 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82640fedd0 con 0x7f824c060f70 2023-10-18T21:28:46.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.976+0000 7f824b7fe700 1 -- 172.21.15.8:0/2123174225 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f82640fedd0 con 0x7f824c060f70 2023-10-18T21:28:46.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 -- 172.21.15.8:0/2123174225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f824c060f70 msgr2=0x7f824c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:46.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f824c060f70 0x7f824c063430 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f82640f7630 tx=0x7f8254009c00).stop 2023-10-18T21:28:46.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 -- 172.21.15.8:0/2123174225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82640f77d0 msgr2=0x7f82641093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:46.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82640f77d0 0x7f82641093d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f8258009f50 tx=0x7f8258009b30).stop 2023-10-18T21:28:46.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 -- 172.21.15.8:0/2123174225 shutdown_connections 2023-10-18T21:28:46.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f824c060f70 0x7f824c063430 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:46.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82640f6530 0x7f8264108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:46.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 --2- 172.21.15.8:0/2123174225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82640f77d0 0x7f82641093d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:46.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 -- 172.21.15.8:0/2123174225 >> 172.21.15.8:0/2123174225 conn(0x7f82640f1c90 msgr2=0x7f82640f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:46.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 -- 172.21.15.8:0/2123174225 shutdown_connections 2023-10-18T21:28:46.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:46.978+0000 7f8263fff700 1 -- 172.21.15.8:0/2123174225 wait complete. 2023-10-18T21:28:46.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:45.206397+0000 mgr.smithi008.flmjzp (mgr.14640) 1793 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:46.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:45.207066+0000 mgr.smithi008.flmjzp (mgr.14640) 1794 : cluster [DBG] pgmap v1243: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:45.207328+0000 mgr.smithi008.flmjzp (mgr.14640) 1795 : cluster [DBG] pgmap v1244: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:45.230133+0000 mgr.smithi008.flmjzp (mgr.14640) 1796 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:46.994 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:28:47.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.119+0000 7f605ca08700 1 -- 172.21.15.8:0/970584863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6058060310 msgr2=0x7f60580f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:47.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.119+0000 7f605ca08700 1 --2- 172.21.15.8:0/970584863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6058060310 0x7f60580f9120 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f6048004660 tx=0x7f6048009b30).stop 2023-10-18T21:28:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.119+0000 7f605ca08700 1 -- 172.21.15.8:0/970584863 shutdown_connections 2023-10-18T21:28:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.119+0000 7f605ca08700 1 --2- 172.21.15.8:0/970584863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60580f96a0 0x7f60580fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.119+0000 7f605ca08700 1 --2- 172.21.15.8:0/970584863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6058060310 0x7f60580f9120 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.119+0000 7f605ca08700 1 -- 172.21.15.8:0/970584863 >> 172.21.15.8:0/970584863 conn(0x7f60580f0ba0 msgr2=0x7f60580f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.119+0000 7f605ca08700 1 -- 172.21.15.8:0/970584863 shutdown_connections 2023-10-18T21:28:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.119+0000 7f605ca08700 1 -- 172.21.15.8:0/970584863 wait complete. 2023-10-18T21:28:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.120+0000 7f605ca08700 1 Processor -- start 2023-10-18T21:28:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.120+0000 7f605ca08700 1 -- start start 2023-10-18T21:28:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.120+0000 7f605ca08700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6058060310 0x7f6058106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.120+0000 7f605ca08700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60580f96a0 0x7f60581072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.121+0000 7f605ca08700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60581078b0 con 0x7f6058060310 2023-10-18T21:28:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.121+0000 7f605ca08700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60581080f0 con 0x7f60580f96a0 2023-10-18T21:28:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.121+0000 7f6056d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6058060310 0x7f6058106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.121+0000 7f6056d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6058060310 0x7f6058106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52472/0 (socket says 172.21.15.8:52472) 2023-10-18T21:28:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.121+0000 7f6056d9d700 1 -- 172.21.15.8:0/1221239515 learned_addr learned my addr 172.21.15.8:0/1221239515 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.121+0000 7f605659c700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60580f96a0 0x7f60581072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.121+0000 7f6056d9d700 1 -- 172.21.15.8:0/1221239515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60580f96a0 msgr2=0x7f60581072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.121+0000 7f6056d9d700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60580f96a0 0x7f60581072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.121+0000 7f6056d9d700 1 -- 172.21.15.8:0/1221239515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048005040 con 0x7f6058060310 2023-10-18T21:28:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.121+0000 7f6056d9d700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6058060310 0x7f6058106dc0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f6048009f50 tx=0x7f6048009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:47.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.122+0000 7f603f7fe700 1 -- 172.21.15.8:0/1221239515 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6048018070 con 0x7f6058060310 2023-10-18T21:28:47.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.122+0000 7f603f7fe700 1 -- 172.21.15.8:0/1221239515 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6048009630 con 0x7f6058060310 2023-10-18T21:28:47.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.122+0000 7f603f7fe700 1 -- 172.21.15.8:0/1221239515 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f604801c3c0 con 0x7f6058060310 2023-10-18T21:28:47.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.122+0000 7f605ca08700 1 -- 172.21.15.8:0/1221239515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6058108370 con 0x7f6058060310 2023-10-18T21:28:47.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.122+0000 7f605ca08700 1 -- 172.21.15.8:0/1221239515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6058108850 con 0x7f6058060310 2023-10-18T21:28:47.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.123+0000 7f605ca08700 1 -- 172.21.15.8:0/1221239515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6058059100 con 0x7f6058060310 2023-10-18T21:28:47.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.124+0000 7f603f7fe700 1 -- 172.21.15.8:0/1221239515 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f604801d420 con 0x7f6058060310 2023-10-18T21:28:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.124+0000 7f603f7fe700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 0x7f6040063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.125+0000 7f603f7fe700 1 -- 172.21.15.8:0/1221239515 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f604807e710 con 0x7f6058060310 2023-10-18T21:28:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.125+0000 7f605659c700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 0x7f6040063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.125+0000 7f605659c700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 0x7f6040063430 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f6058106b50 tx=0x7f604c009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.129+0000 7f603f7fe700 1 -- 172.21.15.8:0/1221239515 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f604804e2c0 con 0x7f6058060310 2023-10-18T21:28:47.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:45.206397+0000 mgr.smithi008.flmjzp (mgr.14640) 1793 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:45.207066+0000 mgr.smithi008.flmjzp (mgr.14640) 1794 : cluster [DBG] pgmap v1243: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:45.207328+0000 mgr.smithi008.flmjzp (mgr.14640) 1795 : cluster [DBG] pgmap v1244: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:45.230133+0000 mgr.smithi008.flmjzp (mgr.14640) 1796 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:47.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.328+0000 7f605ca08700 1 -- 172.21.15.8:0/1221239515 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60580fedb0 con 0x7f6040060f70 2023-10-18T21:28:47.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.330+0000 7f603f7fe700 1 -- 172.21.15.8:0/1221239515 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f60580fedb0 con 0x7f6040060f70 2023-10-18T21:28:47.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 -- 172.21.15.8:0/1221239515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 msgr2=0x7f6040063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:47.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 0x7f6040063430 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f6058106b50 tx=0x7f604c009be0).stop 2023-10-18T21:28:47.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 -- 172.21.15.8:0/1221239515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6058060310 msgr2=0x7f6058106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:47.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6058060310 0x7f6058106dc0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f6048009f50 tx=0x7f6048009b30).stop 2023-10-18T21:28:47.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 -- 172.21.15.8:0/1221239515 shutdown_connections 2023-10-18T21:28:47.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6040060f70 0x7f6040063430 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6058060310 0x7f6058106dc0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 --2- 172.21.15.8:0/1221239515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60580f96a0 0x7f60581072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 -- 172.21.15.8:0/1221239515 >> 172.21.15.8:0/1221239515 conn(0x7f60580f0ba0 msgr2=0x7f60580f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:47.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 -- 172.21.15.8:0/1221239515 shutdown_connections 2023-10-18T21:28:47.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.332+0000 7f605ca08700 1 -- 172.21.15.8:0/1221239515 wait complete. 2023-10-18T21:28:47.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.470+0000 7f9efefeb700 1 -- 172.21.15.8:0/3865263799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f77d0 msgr2=0x7f9ef80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:47.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.470+0000 7f9efefeb700 1 --2- 172.21.15.8:0/3865263799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f77d0 0x7f9ef80f7c30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f9ee8004660 tx=0x7f9ee8009b30).stop 2023-10-18T21:28:47.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.470+0000 7f9efefeb700 1 -- 172.21.15.8:0/3865263799 shutdown_connections 2023-10-18T21:28:47.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.470+0000 7f9efefeb700 1 --2- 172.21.15.8:0/3865263799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f77d0 0x7f9ef80f7c30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.470+0000 7f9efefeb700 1 --2- 172.21.15.8:0/3865263799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f6530 0x7f9ef80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.470+0000 7f9efefeb700 1 -- 172.21.15.8:0/3865263799 >> 172.21.15.8:0/3865263799 conn(0x7f9ef80f1c90 msgr2=0x7f9ef80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:47.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.470+0000 7f9efefeb700 1 -- 172.21.15.8:0/3865263799 shutdown_connections 2023-10-18T21:28:47.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.470+0000 7f9efefeb700 1 -- 172.21.15.8:0/3865263799 wait complete. 2023-10-18T21:28:47.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.471+0000 7f9efefeb700 1 Processor -- start 2023-10-18T21:28:47.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.471+0000 7f9efefeb700 1 -- start start 2023-10-18T21:28:47.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.471+0000 7f9efefeb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:47.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.471+0000 7f9efefeb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 0x7f9ef81093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:47.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.471+0000 7f9efefeb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8109970 con 0x7f9ef80f6530 2023-10-18T21:28:47.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.471+0000 7f9efefeb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8109ab0 con 0x7f9ef80f77d0 2023-10-18T21:28:47.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.471+0000 7f9efdfe9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:47.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.471+0000 7f9efdfe9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52482/0 (socket says 172.21.15.8:52482) 2023-10-18T21:28:47.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.471+0000 7f9efdfe9700 1 -- 172.21.15.8:0/3652832132 learned_addr learned my addr 172.21.15.8:0/3652832132 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:47.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.472+0000 7f9efdfe9700 1 -- 172.21.15.8:0/3652832132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 msgr2=0x7f9ef81093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:47.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.472+0000 7f9efd7e8700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 0x7f9ef81093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:47.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.472+0000 7f9efdfe9700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 0x7f9ef81093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.472+0000 7f9efdfe9700 1 -- 172.21.15.8:0/3652832132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee8005040 con 0x7f9ef80f6530 2023-10-18T21:28:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.472+0000 7f9efd7e8700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 0x7f9ef81093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:28:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.472+0000 7f9efdfe9700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108ed0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f9ef400e7c0 tx=0x7f9ef400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.472+0000 7f9eee7fc700 1 -- 172.21.15.8:0/3652832132 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef40092e0 con 0x7f9ef80f6530 2023-10-18T21:28:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.472+0000 7f9eee7fc700 1 -- 172.21.15.8:0/3652832132 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9ef400f040 con 0x7f9ef80f6530 2023-10-18T21:28:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.472+0000 7f9eee7fc700 1 -- 172.21.15.8:0/3652832132 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef40147e0 con 0x7f9ef80f6530 2023-10-18T21:28:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.472+0000 7f9efefeb700 1 -- 172.21.15.8:0/3652832132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef810a450 con 0x7f9ef80f6530 2023-10-18T21:28:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.473+0000 7f9efefeb700 1 -- 172.21.15.8:0/3652832132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef810a990 con 0x7f9ef80f6530 2023-10-18T21:28:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.474+0000 7f9efefeb700 1 -- 172.21.15.8:0/3652832132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef8045ad0 con 0x7f9ef80f6530 2023-10-18T21:28:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.475+0000 7f9eee7fc700 1 -- 172.21.15.8:0/3652832132 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9ef401b030 con 0x7f9ef80f6530 2023-10-18T21:28:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.475+0000 7f9eee7fc700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 0x7f9ee4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.476+0000 7f9eee7fc700 1 -- 172.21.15.8:0/3652832132 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9ef407c990 con 0x7f9ef80f6530 2023-10-18T21:28:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.476+0000 7f9efd7e8700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 0x7f9ee4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.476+0000 7f9efd7e8700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 0x7f9ee4063430 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f9ee80043d0 tx=0x7f9ee800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.480+0000 7f9eee7fc700 1 -- 172.21.15.8:0/3652832132 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9ef404ff10 con 0x7f9ef80f6530 2023-10-18T21:28:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.673+0000 7f9efefeb700 1 -- 172.21.15.8:0/3652832132 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ef810ac00 con 0x7f9ee4060f70 2023-10-18T21:28:47.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.682+0000 7f9eee7fc700 1 -- 172.21.15.8:0/3652832132 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9ef810ac00 con 0x7f9ee4060f70 2023-10-18T21:28:47.683 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:28:47.683 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (35m) 3m ago 36m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:28:47.683 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (29m) 3m ago 36m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:28:47.684 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (29m) 74s ago 36m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:28:47.684 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (35m) 3m ago 36m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:28:47.684 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 32m - - 2023-10-18T21:28:47.684 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 32m - - 2023-10-18T21:28:47.684 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 74s ago 32m - - 2023-10-18T21:28:47.685 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 74s ago 32m - - 2023-10-18T21:28:47.685 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (30m) 3m ago 38m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:28:47.685 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (29m) 74s ago 36m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:28:47.685 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (29m) 3m ago 38m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:28:47.685 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (29m) 74s ago 35m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:28:47.685 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (36m) 3m ago 36m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:28:47.686 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (35m) 74s ago 35m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:28:47.686 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (29m) 3m ago 35m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:28:47.686 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (27m) 3m ago 35m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:28:47.686 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (26m) 3m ago 34m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:28:47.686 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (26m) 74s ago 34m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:28:47.686 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (25m) 74s ago 34m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:28:47.687 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (24m) 74s ago 34m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:28:47.687 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (30m) 3m ago 36m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:28:47.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.684+0000 7f9efefeb700 1 -- 172.21.15.8:0/3652832132 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 msgr2=0x7f9ee4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:47.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.684+0000 7f9efefeb700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 0x7f9ee4063430 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f9ee80043d0 tx=0x7f9ee800b040).stop 2023-10-18T21:28:47.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.684+0000 7f9efefeb700 1 -- 172.21.15.8:0/3652832132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 msgr2=0x7f9ef8108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:47.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.684+0000 7f9efefeb700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108ed0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f9ef400e7c0 tx=0x7f9ef400b040).stop 2023-10-18T21:28:47.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.685+0000 7f9efefeb700 1 -- 172.21.15.8:0/3652832132 shutdown_connections 2023-10-18T21:28:47.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.685+0000 7f9efefeb700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 0x7f9ee4063430 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.685+0000 7f9efefeb700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ef80f6530 0x7f9ef8108ed0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.685+0000 7f9efefeb700 1 --2- 172.21.15.8:0/3652832132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef80f77d0 0x7f9ef81093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.685+0000 7f9efefeb700 1 -- 172.21.15.8:0/3652832132 >> 172.21.15.8:0/3652832132 conn(0x7f9ef80f1c90 msgr2=0x7f9ef806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:47.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.685+0000 7f9efefeb700 1 -- 172.21.15.8:0/3652832132 shutdown_connections 2023-10-18T21:28:47.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.685+0000 7f9efefeb700 1 -- 172.21.15.8:0/3652832132 wait complete. 2023-10-18T21:28:47.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.820+0000 7f0abb59e700 1 -- 172.21.15.8:0/4293429794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0abc0f6530 msgr2=0x7f0abc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:47.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.820+0000 7f0abb59e700 1 --2- 172.21.15.8:0/4293429794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0abc0f6530 0x7f0abc0f6950 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f0aac004660 tx=0x7f0aac009b30).stop 2023-10-18T21:28:47.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.820+0000 7f0abb59e700 1 -- 172.21.15.8:0/4293429794 shutdown_connections 2023-10-18T21:28:47.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.820+0000 7f0abb59e700 1 --2- 172.21.15.8:0/4293429794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0abc0f77d0 0x7f0abc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.820+0000 7f0abb59e700 1 --2- 172.21.15.8:0/4293429794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0abc0f6530 0x7f0abc0f6950 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.820+0000 7f0abb59e700 1 -- 172.21.15.8:0/4293429794 >> 172.21.15.8:0/4293429794 conn(0x7f0abc0f1c90 msgr2=0x7f0abc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:47.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.820+0000 7f0abb59e700 1 -- 172.21.15.8:0/4293429794 shutdown_connections 2023-10-18T21:28:47.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.820+0000 7f0abb59e700 1 -- 172.21.15.8:0/4293429794 wait complete. 2023-10-18T21:28:47.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.821+0000 7f0abb59e700 1 Processor -- start 2023-10-18T21:28:47.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.821+0000 7f0abb59e700 1 -- start start 2023-10-18T21:28:47.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.821+0000 7f0abb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0abc0f6530 0x7f0abc108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:47.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.821+0000 7f0abb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0abc0f77d0 0x7f0abc1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:47.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.821+0000 7f0abb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc109a70 con 0x7f0abc0f6530 2023-10-18T21:28:47.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.821+0000 7f0abb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc109bb0 con 0x7f0abc0f77d0 2023-10-18T21:28:47.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.822+0000 7f0aba59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0abc0f6530 0x7f0abc108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:47.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.822+0000 7f0aba59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0abc0f6530 0x7f0abc108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52504/0 (socket says 172.21.15.8:52504) 2023-10-18T21:28:47.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.822+0000 7f0aba59c700 1 -- 172.21.15.8:0/1037331903 learned_addr learned my addr 172.21.15.8:0/1037331903 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:47.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.822+0000 7f0ab9d9b700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0abc0f77d0 0x7f0abc1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:47.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.822+0000 7f0aba59c700 1 -- 172.21.15.8:0/1037331903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0abc0f77d0 msgr2=0x7f0abc1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:47.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.822+0000 7f0aba59c700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0abc0f77d0 0x7f0abc1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:47.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.822+0000 7f0aba59c700 1 -- 172.21.15.8:0/1037331903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac005040 con 0x7f0abc0f6530 2023-10-18T21:28:47.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.822+0000 7f0ab9d9b700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0abc0f77d0 0x7f0abc1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:28:47.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.822+0000 7f0aba59c700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0abc0f6530 0x7f0abc108fd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f0aac007a60 tx=0x7f0aac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:47.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.822+0000 7f0aaaffd700 1 -- 172.21.15.8:0/1037331903 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aac018070 con 0x7f0abc0f6530 2023-10-18T21:28:47.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.823+0000 7f0aaaffd700 1 -- 172.21.15.8:0/1037331903 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0aac009630 con 0x7f0abc0f6530 2023-10-18T21:28:47.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.823+0000 7f0abb59e700 1 -- 172.21.15.8:0/1037331903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc10a4f0 con 0x7f0abc0f6530 2023-10-18T21:28:47.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.823+0000 7f0aaaffd700 1 -- 172.21.15.8:0/1037331903 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aac01c540 con 0x7f0abc0f6530 2023-10-18T21:28:47.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.823+0000 7f0abb59e700 1 -- 172.21.15.8:0/1037331903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc10aa50 con 0x7f0abc0f6530 2023-10-18T21:28:47.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.824+0000 7f0abb59e700 1 -- 172.21.15.8:0/1037331903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc045ad0 con 0x7f0abc0f6530 2023-10-18T21:28:47.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.825+0000 7f0aaaffd700 1 -- 172.21.15.8:0/1037331903 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0aac01c7b0 con 0x7f0abc0f6530 2023-10-18T21:28:47.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.825+0000 7f0aaaffd700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0aa4060f70 0x7f0aa4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:47.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.826+0000 7f0aaaffd700 1 -- 172.21.15.8:0/1037331903 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0aac07e760 con 0x7f0abc0f6530 2023-10-18T21:28:47.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.826+0000 7f0ab9d9b700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0aa4060f70 0x7f0aa4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:47.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.826+0000 7f0ab9d9b700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0aa4060f70 0x7f0aa4063430 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f0ab0009fd0 tx=0x7f0ab000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:47.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:47.830+0000 7f0aaaffd700 1 -- 172.21.15.8:0/1037331903 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0aac051d40 con 0x7f0abc0f6530 2023-10-18T21:28:48.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.083+0000 7f0abb59e700 1 -- 172.21.15.8:0/1037331903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0abc027a00 con 0x7f0abc0f6530 2023-10-18T21:28:48.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.083+0000 7f0aaaffd700 1 -- 172.21.15.8:0/1037331903 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f0aac051930 con 0x7f0abc0f6530 2023-10-18T21:28:48.084 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:28:48.085 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:28:48.085 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:28:48.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:28:48.085 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:28:48.085 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:28:48.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:28:48.086 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:28:48.086 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:28:48.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:28:48.086 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:28:48.087 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:28:48.087 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:28:48.087 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:28:48.087 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:28:48.087 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:28:48.087 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:28:48.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.085+0000 7f0abb59e700 1 -- 172.21.15.8:0/1037331903 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0aa4060f70 msgr2=0x7f0aa4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:48.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.085+0000 7f0abb59e700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0aa4060f70 0x7f0aa4063430 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f0ab0009fd0 tx=0x7f0ab000b040).stop 2023-10-18T21:28:48.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.085+0000 7f0abb59e700 1 -- 172.21.15.8:0/1037331903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0abc0f6530 msgr2=0x7f0abc108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:48.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.085+0000 7f0abb59e700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0abc0f6530 0x7f0abc108fd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f0aac007a60 tx=0x7f0aac009b30).stop 2023-10-18T21:28:48.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.085+0000 7f0abb59e700 1 -- 172.21.15.8:0/1037331903 shutdown_connections 2023-10-18T21:28:48.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.085+0000 7f0abb59e700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0aa4060f70 0x7f0aa4063430 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.085+0000 7f0abb59e700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0abc0f6530 0x7f0abc108fd0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.085+0000 7f0abb59e700 1 --2- 172.21.15.8:0/1037331903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0abc0f77d0 0x7f0abc1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.085+0000 7f0abb59e700 1 -- 172.21.15.8:0/1037331903 >> 172.21.15.8:0/1037331903 conn(0x7f0abc0f1c90 msgr2=0x7f0abc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:48.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.086+0000 7f0abb59e700 1 -- 172.21.15.8:0/1037331903 shutdown_connections 2023-10-18T21:28:48.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.086+0000 7f0abb59e700 1 -- 172.21.15.8:0/1037331903 wait complete. 2023-10-18T21:28:48.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.224+0000 7f8ecf59e700 1 -- 172.21.15.8:0/2167787171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed00f77d0 msgr2=0x7f8ed00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:48.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.224+0000 7f8ecf59e700 1 --2- 172.21.15.8:0/2167787171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed00f77d0 0x7f8ed00f7c30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f8ec4004660 tx=0x7f8ec4009b30).stop 2023-10-18T21:28:48.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.224+0000 7f8ecf59e700 1 -- 172.21.15.8:0/2167787171 shutdown_connections 2023-10-18T21:28:48.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.224+0000 7f8ecf59e700 1 --2- 172.21.15.8:0/2167787171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed00f77d0 0x7f8ed00f7c30 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.224+0000 7f8ecf59e700 1 --2- 172.21.15.8:0/2167787171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed00f6530 0x7f8ed00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.224+0000 7f8ecf59e700 1 -- 172.21.15.8:0/2167787171 >> 172.21.15.8:0/2167787171 conn(0x7f8ed00f1c90 msgr2=0x7f8ed00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:48.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.224+0000 7f8ecf59e700 1 -- 172.21.15.8:0/2167787171 shutdown_connections 2023-10-18T21:28:48.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.224+0000 7f8ecf59e700 1 -- 172.21.15.8:0/2167787171 wait complete. 2023-10-18T21:28:48.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.225+0000 7f8ecf59e700 1 Processor -- start 2023-10-18T21:28:48.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.225+0000 7f8ecf59e700 1 -- start start 2023-10-18T21:28:48.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.225+0000 7f8ecf59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed00f6530 0x7f8ed0108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:48.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.225+0000 7f8ecf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed00f77d0 0x7f8ed01093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:48.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.225+0000 7f8ecf59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed01099a0 con 0x7f8ed00f6530 2023-10-18T21:28:48.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.225+0000 7f8ecf59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0109ae0 con 0x7f8ed00f77d0 2023-10-18T21:28:48.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.226+0000 7f8ece59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed00f6530 0x7f8ed0108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:48.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.226+0000 7f8ece59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed00f6530 0x7f8ed0108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52516/0 (socket says 172.21.15.8:52516) 2023-10-18T21:28:48.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.226+0000 7f8ece59c700 1 -- 172.21.15.8:0/510373911 learned_addr learned my addr 172.21.15.8:0/510373911 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:48.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.226+0000 7f8ecdd9b700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed00f77d0 0x7f8ed01093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:48.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.226+0000 7f8ece59c700 1 -- 172.21.15.8:0/510373911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed00f77d0 msgr2=0x7f8ed01093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:48.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.226+0000 7f8ece59c700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed00f77d0 0x7f8ed01093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.226+0000 7f8ece59c700 1 -- 172.21.15.8:0/510373911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4005040 con 0x7f8ed00f6530 2023-10-18T21:28:48.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.226+0000 7f8ece59c700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed00f6530 0x7f8ed0108f00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f8ec000e7c0 tx=0x7f8ec000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:48.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.227+0000 7f8ebeffd700 1 -- 172.21.15.8:0/510373911 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec00092e0 con 0x7f8ed00f6530 2023-10-18T21:28:48.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.227+0000 7f8ebeffd700 1 -- 172.21.15.8:0/510373911 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8ec000f040 con 0x7f8ed00f6530 2023-10-18T21:28:48.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.227+0000 7f8ecf59e700 1 -- 172.21.15.8:0/510373911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed010a480 con 0x7f8ed00f6530 2023-10-18T21:28:48.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.227+0000 7f8ebeffd700 1 -- 172.21.15.8:0/510373911 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec0014810 con 0x7f8ed00f6530 2023-10-18T21:28:48.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.227+0000 7f8ecf59e700 1 -- 172.21.15.8:0/510373911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed010a9c0 con 0x7f8ed00f6530 2023-10-18T21:28:48.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.228+0000 7f8ecf59e700 1 -- 172.21.15.8:0/510373911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed0045ad0 con 0x7f8ed00f6530 2023-10-18T21:28:48.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.229+0000 7f8ebeffd700 1 -- 172.21.15.8:0/510373911 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8ec001b030 con 0x7f8ed00f6530 2023-10-18T21:28:48.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.230+0000 7f8ebeffd700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8eb8060f70 0x7f8eb8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:48.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.230+0000 7f8ebeffd700 1 -- 172.21.15.8:0/510373911 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8ec007c7c0 con 0x7f8ed00f6530 2023-10-18T21:28:48.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.230+0000 7f8ecdd9b700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8eb8060f70 0x7f8eb8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:48.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.231+0000 7f8ecdd9b700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8eb8060f70 0x7f8eb8063430 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f8ec4005010 tx=0x7f8ec4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:48.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.234+0000 7f8ebeffd700 1 -- 172.21.15.8:0/510373911 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8ec004fe60 con 0x7f8ed00f6530 2023-10-18T21:28:48.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.460+0000 7f8ecf59e700 1 -- 172.21.15.8:0/510373911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8ed00fed90 con 0x7f8ed00f6530 2023-10-18T21:28:48.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.461+0000 7f8ebeffd700 1 -- 172.21.15.8:0/510373911 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f8ec0019030 con 0x7f8ed00f6530 2023-10-18T21:28:48.462 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:28:48.462 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:28:48.463 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:28:48.463 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:28:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:28:48.463 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:28:48.463 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:28:48.464 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:28:48.464 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:28:48.464 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:28:48.464 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:28:48.464 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:28:48.465 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:28:48.465 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:28:48.465 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:28:48.465 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:28:48.465 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:28:48.465 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:28:48.466 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:28:48.466 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:28:48.466 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:28:48.466 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:28:48.466 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:28:48.467 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:28:48.467 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:28:48.467 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:28:48.467 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:28:48.467 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:28:48.467 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:28:48.468 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:28:48.468 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:28:48.468 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:28:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:28:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:28:48.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 -- 172.21.15.8:0/510373911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8eb8060f70 msgr2=0x7f8eb8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:48.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8eb8060f70 0x7f8eb8063430 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f8ec4005010 tx=0x7f8ec4016040).stop 2023-10-18T21:28:48.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 -- 172.21.15.8:0/510373911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed00f6530 msgr2=0x7f8ed0108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:48.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed00f6530 0x7f8ed0108f00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f8ec000e7c0 tx=0x7f8ec000b040).stop 2023-10-18T21:28:48.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 -- 172.21.15.8:0/510373911 shutdown_connections 2023-10-18T21:28:48.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8eb8060f70 0x7f8eb8063430 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed00f6530 0x7f8ed0108f00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 --2- 172.21.15.8:0/510373911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed00f77d0 0x7f8ed01093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 -- 172.21.15.8:0/510373911 >> 172.21.15.8:0/510373911 conn(0x7f8ed00f1c90 msgr2=0x7f8ed006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 -- 172.21.15.8:0/510373911 shutdown_connections 2023-10-18T21:28:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.463+0000 7f8ecf59e700 1 -- 172.21.15.8:0/510373911 wait complete. 2023-10-18T21:28:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:28:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.602+0000 7f137bfff700 1 -- 172.21.15.8:0/3259977484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f137c0602b0 msgr2=0x7f137c0f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.602+0000 7f137bfff700 1 --2- 172.21.15.8:0/3259977484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f137c0602b0 0x7f137c0f9170 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f136c004660 tx=0x7f136c009b30).stop 2023-10-18T21:28:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.602+0000 7f137bfff700 1 -- 172.21.15.8:0/3259977484 shutdown_connections 2023-10-18T21:28:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.602+0000 7f137bfff700 1 --2- 172.21.15.8:0/3259977484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f137c0f96f0 0x7f137c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.602+0000 7f137bfff700 1 --2- 172.21.15.8:0/3259977484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f137c0602b0 0x7f137c0f9170 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.602+0000 7f137bfff700 1 -- 172.21.15.8:0/3259977484 >> 172.21.15.8:0/3259977484 conn(0x7f137c0f0b90 msgr2=0x7f137c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.602+0000 7f137bfff700 1 -- 172.21.15.8:0/3259977484 shutdown_connections 2023-10-18T21:28:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.602+0000 7f137bfff700 1 -- 172.21.15.8:0/3259977484 wait complete. 2023-10-18T21:28:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.602+0000 7f137bfff700 1 Processor -- start 2023-10-18T21:28:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.603+0000 7f137bfff700 1 -- start start 2023-10-18T21:28:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.603+0000 7f137bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f137c0602b0 0x7f137c0f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.603+0000 7f137bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f137c0f96f0 0x7f137c0f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.603+0000 7f137bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0f55d0 con 0x7f137c0602b0 2023-10-18T21:28:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.603+0000 7f137bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0f5710 con 0x7f137c0f96f0 2023-10-18T21:28:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.603+0000 7f137affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f137c0602b0 0x7f137c0f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.603+0000 7f137affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f137c0602b0 0x7f137c0f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52534/0 (socket says 172.21.15.8:52534) 2023-10-18T21:28:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.603+0000 7f137affd700 1 -- 172.21.15.8:0/2826334315 learned_addr learned my addr 172.21.15.8:0/2826334315 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:28:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.604+0000 7f137a7fc700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f137c0f96f0 0x7f137c0f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.604+0000 7f137affd700 1 -- 172.21.15.8:0/2826334315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f137c0f96f0 msgr2=0x7f137c0f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.604+0000 7f137affd700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f137c0f96f0 0x7f137c0f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.604+0000 7f137affd700 1 -- 172.21.15.8:0/2826334315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370005040 con 0x7f137c0602b0 2023-10-18T21:28:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.604+0000 7f137affd700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f137c0602b0 0x7f137c0f6bf0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f136c004320 tx=0x7f136c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.604+0000 7f13637fe700 1 -- 172.21.15.8:0/2826334315 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136c019070 con 0x7f137c0602b0 2023-10-18T21:28:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.604+0000 7f13637fe700 1 -- 172.21.15.8:0/2826334315 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f136c01e420 con 0x7f137c0602b0 2023-10-18T21:28:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.604+0000 7f13637fe700 1 -- 172.21.15.8:0/2826334315 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136c014680 con 0x7f137c0602b0 2023-10-18T21:28:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.604+0000 7f137bfff700 1 -- 172.21.15.8:0/2826334315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c005040 con 0x7f137c0602b0 2023-10-18T21:28:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.604+0000 7f137bfff700 1 -- 172.21.15.8:0/2826334315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c0f5ce0 con 0x7f137c0602b0 2023-10-18T21:28:48.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.605+0000 7f137bfff700 1 -- 172.21.15.8:0/2826334315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137c059100 con 0x7f137c0602b0 2023-10-18T21:28:48.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.606+0000 7f13637fe700 1 -- 172.21.15.8:0/2826334315 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f136c01e590 con 0x7f137c0602b0 2023-10-18T21:28:48.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.608+0000 7f13637fe700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1364060f70 0x7f1364063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:28:48.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.608+0000 7f13637fe700 1 -- 172.21.15.8:0/2826334315 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f136c07dd10 con 0x7f137c0602b0 2023-10-18T21:28:48.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.608+0000 7f137a7fc700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1364060f70 0x7f1364063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:28:48.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.608+0000 7f137a7fc700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1364060f70 0x7f1364063430 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f137c060080 tx=0x7f137000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:28:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.612+0000 7f13637fe700 1 -- 172.21.15.8:0/2826334315 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f136c04d8e0 con 0x7f137c0602b0 2023-10-18T21:28:48.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.816+0000 7f137bfff700 1 -- 172.21.15.8:0/2826334315 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f137c0008d0 con 0x7f1364060f70 2023-10-18T21:28:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.817+0000 7f13637fe700 1 -- 172.21.15.8:0/2826334315 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f137c0008d0 con 0x7f1364060f70 2023-10-18T21:28:48.818 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:28:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:28:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:28:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:28:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:28:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:28:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:28:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:28:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:28:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:28:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:28:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:28:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:28:48.821 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:28:48.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.819+0000 7f137bfff700 1 -- 172.21.15.8:0/2826334315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1364060f70 msgr2=0x7f1364063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:48.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.819+0000 7f137bfff700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1364060f70 0x7f1364063430 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f137c060080 tx=0x7f137000b040).stop 2023-10-18T21:28:48.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.819+0000 7f137bfff700 1 -- 172.21.15.8:0/2826334315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f137c0602b0 msgr2=0x7f137c0f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:28:48.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.819+0000 7f137bfff700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f137c0602b0 0x7f137c0f6bf0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f136c004320 tx=0x7f136c00b040).stop 2023-10-18T21:28:48.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.820+0000 7f137bfff700 1 -- 172.21.15.8:0/2826334315 shutdown_connections 2023-10-18T21:28:48.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.820+0000 7f137bfff700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1364060f70 0x7f1364063430 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.820+0000 7f137bfff700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f137c0602b0 0x7f137c0f6bf0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.820+0000 7f137bfff700 1 --2- 172.21.15.8:0/2826334315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f137c0f96f0 0x7f137c0f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:28:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.820+0000 7f137bfff700 1 -- 172.21.15.8:0/2826334315 >> 172.21.15.8:0/2826334315 conn(0x7f137c0f0b90 msgr2=0x7f137c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:28:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.820+0000 7f137bfff700 1 -- 172.21.15.8:0/2826334315 shutdown_connections 2023-10-18T21:28:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:28:48.820+0000 7f137bfff700 1 -- 172.21.15.8:0/2826334315 wait complete. 2023-10-18T21:28:48.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:46.976270+0000 mgr.smithi008.flmjzp (mgr.14640) 1797 : audit [DBG] from='client.35608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:47.207875+0000 mgr.smithi008.flmjzp (mgr.14640) 1798 : cluster [DBG] pgmap v1245: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:47.330098+0000 mgr.smithi008.flmjzp (mgr.14640) 1799 : audit [DBG] from='client.35612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:47.674371+0000 mgr.smithi008.flmjzp (mgr.14640) 1800 : audit [DBG] from='client.35616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:48.083972+0000 mon.smithi008 (mon.0) 2253 : audit [DBG] from='client.? 172.21.15.8:0/1037331903' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:48.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:48.461705+0000 mon.smithi008 (mon.0) 2254 : audit [DBG] from='client.? 172.21.15.8:0/510373911' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:28:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:46.976270+0000 mgr.smithi008.flmjzp (mgr.14640) 1797 : audit [DBG] from='client.35608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:47.207875+0000 mgr.smithi008.flmjzp (mgr.14640) 1798 : cluster [DBG] pgmap v1245: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:47.330098+0000 mgr.smithi008.flmjzp (mgr.14640) 1799 : audit [DBG] from='client.35612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:47.674371+0000 mgr.smithi008.flmjzp (mgr.14640) 1800 : audit [DBG] from='client.35616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:48.083972+0000 mon.smithi008 (mon.0) 2253 : audit [DBG] from='client.? 172.21.15.8:0/1037331903' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:48.461705+0000 mon.smithi008 (mon.0) 2254 : audit [DBG] from='client.? 172.21.15.8:0/510373911' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:28:49.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:48.817880+0000 mgr.smithi008.flmjzp (mgr.14640) 1801 : audit [DBG] from='client.35628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:50.157 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:48.817880+0000 mgr.smithi008.flmjzp (mgr.14640) 1801 : audit [DBG] from='client.35628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:28:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:49.208585+0000 mgr.smithi008.flmjzp (mgr.14640) 1802 : cluster [DBG] pgmap v1246: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:49.208585+0000 mgr.smithi008.flmjzp (mgr.14640) 1802 : cluster [DBG] pgmap v1246: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:52.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:51.209165+0000 mgr.smithi008.flmjzp (mgr.14640) 1803 : cluster [DBG] pgmap v1247: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:51.209165+0000 mgr.smithi008.flmjzp (mgr.14640) 1803 : cluster [DBG] pgmap v1247: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:54.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:53.209718+0000 mgr.smithi008.flmjzp (mgr.14640) 1804 : cluster [DBG] pgmap v1248: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:55.151 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:53.209718+0000 mgr.smithi008.flmjzp (mgr.14640) 1804 : cluster [DBG] pgmap v1248: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:55.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:55.240878+0000 mon.smithi008 (mon.0) 2255 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:55.244135+0000 mon.smithi008 (mon.0) 2256 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:55.245156+0000 mon.smithi008 (mon.0) 2257 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:55.251553+0000 mon.smithi008 (mon.0) 2258 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:55.258186+0000 mon.smithi008 (mon.0) 2259 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:55.261271+0000 mon.smithi008 (mon.0) 2260 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:55.263046+0000 mon.smithi008 (mon.0) 2261 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:55.264738+0000 mon.smithi008 (mon.0) 2262 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:28:55.266684+0000 mon.smithi008 (mon.0) 2263 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:55.240878+0000 mon.smithi008 (mon.0) 2255 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:55.244135+0000 mon.smithi008 (mon.0) 2256 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:28:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:55.245156+0000 mon.smithi008 (mon.0) 2257 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:28:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:55.251553+0000 mon.smithi008 (mon.0) 2258 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:28:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:55.258186+0000 mon.smithi008 (mon.0) 2259 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:28:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:55.261271+0000 mon.smithi008 (mon.0) 2260 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:55.263046+0000 mon.smithi008 (mon.0) 2261 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:55.264738+0000 mon.smithi008 (mon.0) 2262 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:56.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:28:55.266684+0000 mon.smithi008 (mon.0) 2263 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:28:56.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:55.210475+0000 mgr.smithi008.flmjzp (mgr.14640) 1805 : cluster [DBG] pgmap v1249: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:55.246040+0000 mgr.smithi008.flmjzp (mgr.14640) 1806 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:55.246574+0000 mgr.smithi008.flmjzp (mgr.14640) 1807 : cluster [DBG] pgmap v1250: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:55.246802+0000 mgr.smithi008.flmjzp (mgr.14640) 1808 : cluster [DBG] pgmap v1251: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:28:55.268582+0000 mgr.smithi008.flmjzp (mgr.14640) 1809 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:55.210475+0000 mgr.smithi008.flmjzp (mgr.14640) 1805 : cluster [DBG] pgmap v1249: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:55.246040+0000 mgr.smithi008.flmjzp (mgr.14640) 1806 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:28:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:55.246574+0000 mgr.smithi008.flmjzp (mgr.14640) 1807 : cluster [DBG] pgmap v1250: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:55.246802+0000 mgr.smithi008.flmjzp (mgr.14640) 1808 : cluster [DBG] pgmap v1251: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:28:55.268582+0000 mgr.smithi008.flmjzp (mgr.14640) 1809 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:28:58.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:57.247444+0000 mgr.smithi008.flmjzp (mgr.14640) 1810 : cluster [DBG] pgmap v1252: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:28:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:57.247444+0000 mgr.smithi008.flmjzp (mgr.14640) 1810 : cluster [DBG] pgmap v1252: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:00.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:28:59.248224+0000 mgr.smithi008.flmjzp (mgr.14640) 1811 : cluster [DBG] pgmap v1253: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:28:59.248224+0000 mgr.smithi008.flmjzp (mgr.14640) 1811 : cluster [DBG] pgmap v1253: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:02.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:01.248900+0000 mgr.smithi008.flmjzp (mgr.14640) 1812 : cluster [DBG] pgmap v1254: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:03.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:01.248900+0000 mgr.smithi008.flmjzp (mgr.14640) 1812 : cluster [DBG] pgmap v1254: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:04.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:03.249544+0000 mgr.smithi008.flmjzp (mgr.14640) 1813 : cluster [DBG] pgmap v1255: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:05.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:03.249544+0000 mgr.smithi008.flmjzp (mgr.14640) 1813 : cluster [DBG] pgmap v1255: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:05.279373+0000 mon.smithi008 (mon.0) 2264 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:05.281620+0000 mon.smithi008 (mon.0) 2265 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:05.282625+0000 mon.smithi008 (mon.0) 2266 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:05.289427+0000 mon.smithi008 (mon.0) 2267 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:05.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:05.295862+0000 mon.smithi008 (mon.0) 2268 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:05.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:05.298993+0000 mon.smithi008 (mon.0) 2269 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:05.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:05.300730+0000 mon.smithi008 (mon.0) 2270 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:05.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:05.302385+0000 mon.smithi008 (mon.0) 2271 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:05.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:05.304441+0000 mon.smithi008 (mon.0) 2272 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:05.279373+0000 mon.smithi008 (mon.0) 2264 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:05.281620+0000 mon.smithi008 (mon.0) 2265 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:05.282625+0000 mon.smithi008 (mon.0) 2266 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:05.289427+0000 mon.smithi008 (mon.0) 2267 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:05.295862+0000 mon.smithi008 (mon.0) 2268 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:05.298993+0000 mon.smithi008 (mon.0) 2269 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:05.300730+0000 mon.smithi008 (mon.0) 2270 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:05.302385+0000 mon.smithi008 (mon.0) 2271 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:06.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:05.304441+0000 mon.smithi008 (mon.0) 2272 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:06.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:05.250121+0000 mgr.smithi008.flmjzp (mgr.14640) 1814 : cluster [DBG] pgmap v1256: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:06.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:05.283526+0000 mgr.smithi008.flmjzp (mgr.14640) 1815 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:06.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:05.284121+0000 mgr.smithi008.flmjzp (mgr.14640) 1816 : cluster [DBG] pgmap v1257: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:06.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:05.284368+0000 mgr.smithi008.flmjzp (mgr.14640) 1817 : cluster [DBG] pgmap v1258: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:06.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:05.306389+0000 mgr.smithi008.flmjzp (mgr.14640) 1818 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:07.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:05.250121+0000 mgr.smithi008.flmjzp (mgr.14640) 1814 : cluster [DBG] pgmap v1256: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:07.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:05.283526+0000 mgr.smithi008.flmjzp (mgr.14640) 1815 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:07.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:05.284121+0000 mgr.smithi008.flmjzp (mgr.14640) 1816 : cluster [DBG] pgmap v1257: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:07.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:05.284368+0000 mgr.smithi008.flmjzp (mgr.14640) 1817 : cluster [DBG] pgmap v1258: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:07.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:05.306389+0000 mgr.smithi008.flmjzp (mgr.14640) 1818 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:08.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:07.285130+0000 mgr.smithi008.flmjzp (mgr.14640) 1819 : cluster [DBG] pgmap v1259: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:09.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:07.285130+0000 mgr.smithi008.flmjzp (mgr.14640) 1819 : cluster [DBG] pgmap v1259: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:10.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:09.285665+0000 mgr.smithi008.flmjzp (mgr.14640) 1820 : cluster [DBG] pgmap v1260: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:09.285665+0000 mgr.smithi008.flmjzp (mgr.14640) 1820 : cluster [DBG] pgmap v1260: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:11.286377+0000 mgr.smithi008.flmjzp (mgr.14640) 1821 : cluster [DBG] pgmap v1261: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:13.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:11.286377+0000 mgr.smithi008.flmjzp (mgr.14640) 1821 : cluster [DBG] pgmap v1261: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:15.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:13.286998+0000 mgr.smithi008.flmjzp (mgr.14640) 1822 : cluster [DBG] pgmap v1262: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:15.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:13.286998+0000 mgr.smithi008.flmjzp (mgr.14640) 1822 : cluster [DBG] pgmap v1262: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:15.316639+0000 mon.smithi008 (mon.0) 2273 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:15.318804+0000 mon.smithi008 (mon.0) 2274 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:15.319786+0000 mon.smithi008 (mon.0) 2275 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:16.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:15.326281+0000 mon.smithi008 (mon.0) 2276 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:16.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:15.332949+0000 mon.smithi008 (mon.0) 2277 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:16.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:15.336233+0000 mon.smithi008 (mon.0) 2278 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:16.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:15.338047+0000 mon.smithi008 (mon.0) 2279 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:16.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:15.339763+0000 mon.smithi008 (mon.0) 2280 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:16.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:15.341839+0000 mon.smithi008 (mon.0) 2281 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:16.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:15.316639+0000 mon.smithi008 (mon.0) 2273 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:15.318804+0000 mon.smithi008 (mon.0) 2274 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:15.319786+0000 mon.smithi008 (mon.0) 2275 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:15.326281+0000 mon.smithi008 (mon.0) 2276 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:15.332949+0000 mon.smithi008 (mon.0) 2277 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:15.336233+0000 mon.smithi008 (mon.0) 2278 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:15.338047+0000 mon.smithi008 (mon.0) 2279 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:15.339763+0000 mon.smithi008 (mon.0) 2280 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:15.341839+0000 mon.smithi008 (mon.0) 2281 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:17.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:15.287816+0000 mgr.smithi008.flmjzp (mgr.14640) 1823 : cluster [DBG] pgmap v1263: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:17.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:15.320637+0000 mgr.smithi008.flmjzp (mgr.14640) 1824 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:17.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:15.321204+0000 mgr.smithi008.flmjzp (mgr.14640) 1825 : cluster [DBG] pgmap v1264: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:15.321502+0000 mgr.smithi008.flmjzp (mgr.14640) 1826 : cluster [DBG] pgmap v1265: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:15.343872+0000 mgr.smithi008.flmjzp (mgr.14640) 1827 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:17.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:15.287816+0000 mgr.smithi008.flmjzp (mgr.14640) 1823 : cluster [DBG] pgmap v1263: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:15.320637+0000 mgr.smithi008.flmjzp (mgr.14640) 1824 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:15.321204+0000 mgr.smithi008.flmjzp (mgr.14640) 1825 : cluster [DBG] pgmap v1264: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:15.321502+0000 mgr.smithi008.flmjzp (mgr.14640) 1826 : cluster [DBG] pgmap v1265: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:15.343872+0000 mgr.smithi008.flmjzp (mgr.14640) 1827 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:18.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.971+0000 7f76a5653700 1 -- 172.21.15.8:0/3143446509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a00f6530 msgr2=0x7f76a00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.971+0000 7f76a5653700 1 --2- 172.21.15.8:0/3143446509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a00f6530 0x7f76a00f6950 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f7690004660 tx=0x7f7690009b30).stop 2023-10-18T21:29:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.971+0000 7f76a5653700 1 -- 172.21.15.8:0/3143446509 shutdown_connections 2023-10-18T21:29:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.971+0000 7f76a5653700 1 --2- 172.21.15.8:0/3143446509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a00f77d0 0x7f76a00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.971+0000 7f76a5653700 1 --2- 172.21.15.8:0/3143446509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a00f6530 0x7f76a00f6950 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.971+0000 7f76a5653700 1 -- 172.21.15.8:0/3143446509 >> 172.21.15.8:0/3143446509 conn(0x7f76a00f1c90 msgr2=0x7f76a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:18.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.971+0000 7f76a5653700 1 -- 172.21.15.8:0/3143446509 shutdown_connections 2023-10-18T21:29:18.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.971+0000 7f76a5653700 1 -- 172.21.15.8:0/3143446509 wait complete. 2023-10-18T21:29:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.973+0000 7f76a5653700 1 Processor -- start 2023-10-18T21:29:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.973+0000 7f76a5653700 1 -- start start 2023-10-18T21:29:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.973+0000 7f76a5653700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a00f6530 0x7f76a0108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.973+0000 7f76a5653700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a00f77d0 0x7f76a01094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:18.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.973+0000 7f76a5653700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0109a70 con 0x7f76a00f77d0 2023-10-18T21:29:18.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.973+0000 7f76a5653700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0109bb0 con 0x7f76a00f6530 2023-10-18T21:29:18.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.974+0000 7f769f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a00f77d0 0x7f76a01094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:18.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.974+0000 7f769f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a00f77d0 0x7f76a01094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53172/0 (socket says 172.21.15.8:53172) 2023-10-18T21:29:18.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.974+0000 7f769f7fe700 1 -- 172.21.15.8:0/1459739540 learned_addr learned my addr 172.21.15.8:0/1459739540 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.974+0000 7f769ffff700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a00f6530 0x7f76a0108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.974+0000 7f769f7fe700 1 -- 172.21.15.8:0/1459739540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a00f6530 msgr2=0x7f76a0108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.974+0000 7f769f7fe700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a00f6530 0x7f76a0108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.974+0000 7f769f7fe700 1 -- 172.21.15.8:0/1459739540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690005040 con 0x7f76a00f77d0 2023-10-18T21:29:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.974+0000 7f769f7fe700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a00f77d0 0x7f76a01094c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f76940026d0 tx=0x7f7694009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:18.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.975+0000 7f769cff9700 1 -- 172.21.15.8:0/1459739540 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76940079c0 con 0x7f76a00f77d0 2023-10-18T21:29:18.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.975+0000 7f769cff9700 1 -- 172.21.15.8:0/1459739540 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f769400f040 con 0x7f76a00f77d0 2023-10-18T21:29:18.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.975+0000 7f76a5653700 1 -- 172.21.15.8:0/1459739540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a010a550 con 0x7f76a00f77d0 2023-10-18T21:29:18.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.975+0000 7f769cff9700 1 -- 172.21.15.8:0/1459739540 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7694014980 con 0x7f76a00f77d0 2023-10-18T21:29:18.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.975+0000 7f76a5653700 1 -- 172.21.15.8:0/1459739540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a010ab10 con 0x7f76a00f77d0 2023-10-18T21:29:18.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.976+0000 7f76a5653700 1 -- 172.21.15.8:0/1459739540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a0045ad0 con 0x7f76a00f77d0 2023-10-18T21:29:18.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.977+0000 7f769cff9700 1 -- 172.21.15.8:0/1459739540 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f76940090d0 con 0x7f76a00f77d0 2023-10-18T21:29:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.978+0000 7f769cff9700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7688060f70 0x7f7688063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.978+0000 7f769cff9700 1 -- 172.21.15.8:0/1459739540 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f769407c980 con 0x7f76a00f77d0 2023-10-18T21:29:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.978+0000 7f769ffff700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7688060f70 0x7f7688063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.979+0000 7f769ffff700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7688060f70 0x7f7688063430 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f7690004630 tx=0x7f7690009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:18.982+0000 7f769cff9700 1 -- 172.21.15.8:0/1459739540 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7694050010 con 0x7f76a00f77d0 2023-10-18T21:29:19.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:17.322042+0000 mgr.smithi008.flmjzp (mgr.14640) 1828 : cluster [DBG] pgmap v1266: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:19.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.180+0000 7f76a5653700 1 -- 172.21.15.8:0/1459739540 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76a010ad90 con 0x7f7688060f70 2023-10-18T21:29:19.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.181+0000 7f769cff9700 1 -- 172.21.15.8:0/1459739540 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f76a010ad90 con 0x7f7688060f70 2023-10-18T21:29:19.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 -- 172.21.15.8:0/1459739540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7688060f70 msgr2=0x7f7688063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:19.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7688060f70 0x7f7688063430 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f7690004630 tx=0x7f7690009b30).stop 2023-10-18T21:29:19.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 -- 172.21.15.8:0/1459739540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a00f77d0 msgr2=0x7f76a01094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:19.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a00f77d0 0x7f76a01094c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f76940026d0 tx=0x7f7694009de0).stop 2023-10-18T21:29:19.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 -- 172.21.15.8:0/1459739540 shutdown_connections 2023-10-18T21:29:19.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7688060f70 0x7f7688063430 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a00f6530 0x7f76a0108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 --2- 172.21.15.8:0/1459739540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a00f77d0 0x7f76a01094c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 -- 172.21.15.8:0/1459739540 >> 172.21.15.8:0/1459739540 conn(0x7f76a00f1c90 msgr2=0x7f76a006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:19.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 -- 172.21.15.8:0/1459739540 shutdown_connections 2023-10-18T21:29:19.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.183+0000 7f76a5653700 1 -- 172.21.15.8:0/1459739540 wait complete. 2023-10-18T21:29:19.200 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:29:19.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:17.322042+0000 mgr.smithi008.flmjzp (mgr.14640) 1828 : cluster [DBG] pgmap v1266: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.320+0000 7fe329bc3700 1 -- 172.21.15.8:0/2128902967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3240f6530 msgr2=0x7fe3240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.320+0000 7fe329bc3700 1 --2- 172.21.15.8:0/2128902967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3240f6530 0x7fe3240f6950 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fe318004660 tx=0x7fe318009b30).stop 2023-10-18T21:29:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.320+0000 7fe329bc3700 1 -- 172.21.15.8:0/2128902967 shutdown_connections 2023-10-18T21:29:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.320+0000 7fe329bc3700 1 --2- 172.21.15.8:0/2128902967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3240f77d0 0x7fe3240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.320+0000 7fe329bc3700 1 --2- 172.21.15.8:0/2128902967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3240f6530 0x7fe3240f6950 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.320+0000 7fe329bc3700 1 -- 172.21.15.8:0/2128902967 >> 172.21.15.8:0/2128902967 conn(0x7fe3240f1c90 msgr2=0x7fe3240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.320+0000 7fe329bc3700 1 -- 172.21.15.8:0/2128902967 shutdown_connections 2023-10-18T21:29:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.320+0000 7fe329bc3700 1 -- 172.21.15.8:0/2128902967 wait complete. 2023-10-18T21:29:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.322+0000 7fe329bc3700 1 Processor -- start 2023-10-18T21:29:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.322+0000 7fe329bc3700 1 -- start start 2023-10-18T21:29:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.322+0000 7fe329bc3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3240f6530 0x7fe32406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.322+0000 7fe329bc3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3240f77d0 0x7fe324069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:19.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.322+0000 7fe329bc3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32406a380 con 0x7fe3240f77d0 2023-10-18T21:29:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.322+0000 7fe329bc3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32406a4c0 con 0x7fe3240f6530 2023-10-18T21:29:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.323+0000 7fe323fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3240f77d0 0x7fe324069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.323+0000 7fe323fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3240f77d0 0x7fe324069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53188/0 (socket says 172.21.15.8:53188) 2023-10-18T21:29:19.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.323+0000 7fe323fff700 1 -- 172.21.15.8:0/2174885413 learned_addr learned my addr 172.21.15.8:0/2174885413 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.323+0000 7fe328bc1700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3240f6530 0x7fe32406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.323+0000 7fe323fff700 1 -- 172.21.15.8:0/2174885413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3240f6530 msgr2=0x7fe32406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.323+0000 7fe323fff700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3240f6530 0x7fe32406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.323+0000 7fe323fff700 1 -- 172.21.15.8:0/2174885413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318005040 con 0x7fe3240f77d0 2023-10-18T21:29:19.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.323+0000 7fe323fff700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3240f77d0 0x7fe324069e20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fe3100026d0 tx=0x7fe310009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.324+0000 7fe3217fa700 1 -- 172.21.15.8:0/2174885413 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3100079c0 con 0x7fe3240f77d0 2023-10-18T21:29:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.324+0000 7fe3217fa700 1 -- 172.21.15.8:0/2174885413 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe31000f040 con 0x7fe3240f77d0 2023-10-18T21:29:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.324+0000 7fe329bc3700 1 -- 172.21.15.8:0/2174885413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32406a7a0 con 0x7fe3240f77d0 2023-10-18T21:29:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.324+0000 7fe3217fa700 1 -- 172.21.15.8:0/2174885413 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe310014980 con 0x7fe3240f77d0 2023-10-18T21:29:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.324+0000 7fe329bc3700 1 -- 172.21.15.8:0/2174885413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32410ede0 con 0x7fe3240f77d0 2023-10-18T21:29:19.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.325+0000 7fe329bc3700 1 -- 172.21.15.8:0/2174885413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe324045ad0 con 0x7fe3240f77d0 2023-10-18T21:29:19.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.326+0000 7fe3217fa700 1 -- 172.21.15.8:0/2174885413 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe3100090d0 con 0x7fe3240f77d0 2023-10-18T21:29:19.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.327+0000 7fe3217fa700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe314060f70 0x7fe314063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:19.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.327+0000 7fe3217fa700 1 -- 172.21.15.8:0/2174885413 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe31007c8a0 con 0x7fe3240f77d0 2023-10-18T21:29:19.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.327+0000 7fe328bc1700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe314060f70 0x7fe314063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:19.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.327+0000 7fe328bc1700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe314060f70 0x7fe314063430 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fe318005010 tx=0x7fe318009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:19.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.331+0000 7fe3217fa700 1 -- 172.21.15.8:0/2174885413 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe31004c580 con 0x7fe3240f77d0 2023-10-18T21:29:19.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.530+0000 7fe329bc3700 1 -- 172.21.15.8:0/2174885413 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3240fedd0 con 0x7fe314060f70 2023-10-18T21:29:19.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.531+0000 7fe3217fa700 1 -- 172.21.15.8:0/2174885413 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe3240fedd0 con 0x7fe314060f70 2023-10-18T21:29:19.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.533+0000 7fe329bc3700 1 -- 172.21.15.8:0/2174885413 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe314060f70 msgr2=0x7fe314063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.533+0000 7fe329bc3700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe314060f70 0x7fe314063430 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fe318005010 tx=0x7fe318009b30).stop 2023-10-18T21:29:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.533+0000 7fe329bc3700 1 -- 172.21.15.8:0/2174885413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3240f77d0 msgr2=0x7fe324069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.533+0000 7fe329bc3700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3240f77d0 0x7fe324069e20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fe3100026d0 tx=0x7fe310009de0).stop 2023-10-18T21:29:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.533+0000 7fe329bc3700 1 -- 172.21.15.8:0/2174885413 shutdown_connections 2023-10-18T21:29:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.533+0000 7fe329bc3700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe314060f70 0x7fe314063430 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.533+0000 7fe329bc3700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3240f6530 0x7fe32406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.533+0000 7fe329bc3700 1 --2- 172.21.15.8:0/2174885413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3240f77d0 0x7fe324069e20 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.533+0000 7fe329bc3700 1 -- 172.21.15.8:0/2174885413 >> 172.21.15.8:0/2174885413 conn(0x7fe3240f1c90 msgr2=0x7fe3240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.534+0000 7fe329bc3700 1 -- 172.21.15.8:0/2174885413 shutdown_connections 2023-10-18T21:29:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.534+0000 7fe329bc3700 1 -- 172.21.15.8:0/2174885413 wait complete. 2023-10-18T21:29:19.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.670+0000 7f9d50c80700 1 -- 172.21.15.8:0/1840921788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c06a3b0 msgr2=0x7f9d4c06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:19.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.670+0000 7f9d50c80700 1 --2- 172.21.15.8:0/1840921788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c06a3b0 0x7f9d4c06a830 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f9d34004660 tx=0x7f9d34009b30).stop 2023-10-18T21:29:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.670+0000 7f9d50c80700 1 -- 172.21.15.8:0/1840921788 shutdown_connections 2023-10-18T21:29:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.670+0000 7f9d50c80700 1 --2- 172.21.15.8:0/1840921788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c06a3b0 0x7f9d4c06a830 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.670+0000 7f9d50c80700 1 --2- 172.21.15.8:0/1840921788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c06b9c0 0x7f9d4c069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.670+0000 7f9d50c80700 1 -- 172.21.15.8:0/1840921788 >> 172.21.15.8:0/1840921788 conn(0x7f9d4c0f1c70 msgr2=0x7f9d4c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.670+0000 7f9d50c80700 1 -- 172.21.15.8:0/1840921788 shutdown_connections 2023-10-18T21:29:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.670+0000 7f9d50c80700 1 -- 172.21.15.8:0/1840921788 wait complete. 2023-10-18T21:29:19.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.672+0000 7f9d50c80700 1 Processor -- start 2023-10-18T21:29:19.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.672+0000 7f9d50c80700 1 -- start start 2023-10-18T21:29:19.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.672+0000 7f9d50c80700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c06a3b0 0x7f9d4c108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:19.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.672+0000 7f9d50c80700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c06b9c0 0x7f9d4c1093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:19.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.672+0000 7f9d50c80700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c109950 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.672+0000 7f9d50c80700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c109a90 con 0x7f9d4c06b9c0 2023-10-18T21:29:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c06a3b0 0x7f9d4c108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c06a3b0 0x7f9d4c108eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53216/0 (socket says 172.21.15.8:53216) 2023-10-18T21:29:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d4b7fe700 1 -- 172.21.15.8:0/1005794157 learned_addr learned my addr 172.21.15.8:0/1005794157 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d43fff700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c06b9c0 0x7f9d4c1093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d4b7fe700 1 -- 172.21.15.8:0/1005794157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c06b9c0 msgr2=0x7f9d4c1093a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d4b7fe700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c06b9c0 0x7f9d4c1093a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d4b7fe700 1 -- 172.21.15.8:0/1005794157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c005040 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d43fff700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c06b9c0 0x7f9d4c1093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:29:19.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d4b7fe700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c06a3b0 0x7f9d4c108eb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f9d3c004870 tx=0x7f9d3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:19.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d48ff9700 1 -- 172.21.15.8:0/1005794157 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d3c00e030 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d50c80700 1 -- 172.21.15.8:0/1005794157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d34005040 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.673+0000 7f9d48ff9700 1 -- 172.21.15.8:0/1005794157 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9d3c00f040 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.674+0000 7f9d50c80700 1 -- 172.21.15.8:0/1005794157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c10a7e0 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.674+0000 7f9d48ff9700 1 -- 172.21.15.8:0/1005794157 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d3c014780 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.675+0000 7f9d50c80700 1 -- 172.21.15.8:0/1005794157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c045ad0 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.676+0000 7f9d48ff9700 1 -- 172.21.15.8:0/1005794157 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9d3c010530 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.676+0000 7f9d48ff9700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 0x7f9d38063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:19.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.677+0000 7f9d48ff9700 1 -- 172.21.15.8:0/1005794157 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9d3c07cd80 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.677+0000 7f9d43fff700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 0x7f9d38063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:19.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.677+0000 7f9d43fff700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 0x7f9d38063430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f9d34009880 tx=0x7f9d3400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:19.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.681+0000 7f9d48ff9700 1 -- 172.21.15.8:0/1005794157 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9d3c050420 con 0x7f9d4c06a3b0 2023-10-18T21:29:19.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.872+0000 7f9d50c80700 1 -- 172.21.15.8:0/1005794157 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d4c102f30 con 0x7f9d38060f70 2023-10-18T21:29:19.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.882+0000 7f9d48ff9700 1 -- 172.21.15.8:0/1005794157 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9d4c102f30 con 0x7f9d38060f70 2023-10-18T21:29:19.884 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:29:19.884 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (35m) 3m ago 37m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:29:19.884 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (29m) 3m ago 37m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:29:19.884 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (29m) 106s ago 36m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:29:19.885 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (35m) 3m ago 37m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:29:19.885 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 33m - - 2023-10-18T21:29:19.885 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 33m - - 2023-10-18T21:29:19.885 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 106s ago 33m - - 2023-10-18T21:29:19.885 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 106s ago 33m - - 2023-10-18T21:29:19.886 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (31m) 3m ago 38m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:29:19.886 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (30m) 106s ago 36m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:29:19.886 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (30m) 3m ago 38m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:29:19.886 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (30m) 106s ago 36m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:29:19.887 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (36m) 3m ago 36m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:29:19.887 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (36m) 106s ago 36m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:29:19.887 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (29m) 3m ago 36m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:29:19.887 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (27m) 3m ago 35m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:29:19.887 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (27m) 3m ago 35m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:29:19.887 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (26m) 106s ago 35m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:29:19.888 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (25m) 106s ago 34m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:29:19.888 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (25m) 106s ago 34m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:29:19.888 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (31m) 3m ago 36m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:29:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 -- 172.21.15.8:0/1005794157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 msgr2=0x7f9d38063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 0x7f9d38063430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f9d34009880 tx=0x7f9d3400b040).stop 2023-10-18T21:29:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 -- 172.21.15.8:0/1005794157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c06a3b0 msgr2=0x7f9d4c108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c06a3b0 0x7f9d4c108eb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f9d3c004870 tx=0x7f9d3c009b30).stop 2023-10-18T21:29:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 -- 172.21.15.8:0/1005794157 shutdown_connections 2023-10-18T21:29:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9d38060f70 0x7f9d38063430 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d4c06a3b0 0x7f9d4c108eb0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 --2- 172.21.15.8:0/1005794157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d4c06b9c0 0x7f9d4c1093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 -- 172.21.15.8:0/1005794157 >> 172.21.15.8:0/1005794157 conn(0x7f9d4c0f1c70 msgr2=0x7f9d4c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 -- 172.21.15.8:0/1005794157 shutdown_connections 2023-10-18T21:29:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:19.884+0000 7f9d50c80700 1 -- 172.21.15.8:0/1005794157 wait complete. 2023-10-18T21:29:20.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.019+0000 7f194ca51700 1 -- 172.21.15.8:0/2778091010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19480f77d0 msgr2=0x7f19480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:20.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.019+0000 7f194ca51700 1 --2- 172.21.15.8:0/2778091010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19480f77d0 0x7f19480f7c30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f193c004660 tx=0x7f193c009b30).stop 2023-10-18T21:29:20.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.019+0000 7f194ca51700 1 -- 172.21.15.8:0/2778091010 shutdown_connections 2023-10-18T21:29:20.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.019+0000 7f194ca51700 1 --2- 172.21.15.8:0/2778091010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19480f77d0 0x7f19480f7c30 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.019+0000 7f194ca51700 1 --2- 172.21.15.8:0/2778091010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19480f6530 0x7f19480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.019+0000 7f194ca51700 1 -- 172.21.15.8:0/2778091010 >> 172.21.15.8:0/2778091010 conn(0x7f19480f1c90 msgr2=0x7f19480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:20.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.019+0000 7f194ca51700 1 -- 172.21.15.8:0/2778091010 shutdown_connections 2023-10-18T21:29:20.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.019+0000 7f194ca51700 1 -- 172.21.15.8:0/2778091010 wait complete. 2023-10-18T21:29:20.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.020+0000 7f194ca51700 1 Processor -- start 2023-10-18T21:29:20.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.020+0000 7f194ca51700 1 -- start start 2023-10-18T21:29:20.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.020+0000 7f194ca51700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19480f6530 0x7f1948106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:20.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.020+0000 7f194ca51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19480f77d0 0x7f1948107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:20.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.020+0000 7f194ca51700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948107830 con 0x7f19480f6530 2023-10-18T21:29:20.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.020+0000 7f194ca51700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948108040 con 0x7f19480f77d0 2023-10-18T21:29:20.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f1946d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19480f6530 0x7f1948106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:20.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f1946d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19480f6530 0x7f1948106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53226/0 (socket says 172.21.15.8:53226) 2023-10-18T21:29:20.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f1946d9d700 1 -- 172.21.15.8:0/781889018 learned_addr learned my addr 172.21.15.8:0/781889018 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:20.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f194659c700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19480f77d0 0x7f1948107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:20.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f1946d9d700 1 -- 172.21.15.8:0/781889018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19480f77d0 msgr2=0x7f1948107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:20.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f1946d9d700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19480f77d0 0x7f1948107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f1946d9d700 1 -- 172.21.15.8:0/781889018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c005040 con 0x7f19480f6530 2023-10-18T21:29:20.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f194659c700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19480f77d0 0x7f1948107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:29:20.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f1946d9d700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19480f6530 0x7f1948106d40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f1938002700 tx=0x7f1938009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:20.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f192f7fe700 1 -- 172.21.15.8:0/781889018 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1938009320 con 0x7f19480f6530 2023-10-18T21:29:20.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f192f7fe700 1 -- 172.21.15.8:0/781889018 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f193800f040 con 0x7f19480f6530 2023-10-18T21:29:20.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.021+0000 7f194ca51700 1 -- 172.21.15.8:0/781889018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19481082c0 con 0x7f19480f6530 2023-10-18T21:29:20.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.022+0000 7f192f7fe700 1 -- 172.21.15.8:0/781889018 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1938014970 con 0x7f19480f6530 2023-10-18T21:29:20.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.022+0000 7f194ca51700 1 -- 172.21.15.8:0/781889018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1948108880 con 0x7f19480f6530 2023-10-18T21:29:20.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.023+0000 7f194ca51700 1 -- 172.21.15.8:0/781889018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1948059100 con 0x7f19480f6530 2023-10-18T21:29:20.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.024+0000 7f192f7fe700 1 -- 172.21.15.8:0/781889018 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1938009480 con 0x7f19480f6530 2023-10-18T21:29:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.024+0000 7f192f7fe700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1930060f70 0x7f1930063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.025+0000 7f192f7fe700 1 -- 172.21.15.8:0/781889018 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f193807cb90 con 0x7f19480f6530 2023-10-18T21:29:20.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.025+0000 7f194659c700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1930060f70 0x7f1930063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:20.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.025+0000 7f194659c700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1930060f70 0x7f1930063430 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f193c005010 tx=0x7f193c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:20.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.029+0000 7f192f7fe700 1 -- 172.21.15.8:0/781889018 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f193804c7c0 con 0x7f19480f6530 2023-10-18T21:29:20.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.283+0000 7f194ca51700 1 -- 172.21.15.8:0/781889018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19480fecc0 con 0x7f19480f6530 2023-10-18T21:29:20.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.284+0000 7f192f7fe700 1 -- 172.21.15.8:0/781889018 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f193804fde0 con 0x7f19480f6530 2023-10-18T21:29:20.286 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:29:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:29:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:29:20.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:29:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:29:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:29:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:29:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:29:20.287 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:29:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:29:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:29:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:29:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:29:20.288 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:29:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:29:20.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:29:20.289 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:29:20.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.285+0000 7f194ca51700 1 -- 172.21.15.8:0/781889018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1930060f70 msgr2=0x7f1930063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:20.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.285+0000 7f194ca51700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1930060f70 0x7f1930063430 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f193c005010 tx=0x7f193c009b30).stop 2023-10-18T21:29:20.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.285+0000 7f194ca51700 1 -- 172.21.15.8:0/781889018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19480f6530 msgr2=0x7f1948106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.285+0000 7f194ca51700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19480f6530 0x7f1948106d40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f1938002700 tx=0x7f1938009d80).stop 2023-10-18T21:29:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.286+0000 7f194ca51700 1 -- 172.21.15.8:0/781889018 shutdown_connections 2023-10-18T21:29:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.286+0000 7f194ca51700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1930060f70 0x7f1930063430 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.286+0000 7f194ca51700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19480f6530 0x7f1948106d40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.286+0000 7f194ca51700 1 --2- 172.21.15.8:0/781889018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19480f77d0 0x7f1948107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.286+0000 7f194ca51700 1 -- 172.21.15.8:0/781889018 >> 172.21.15.8:0/781889018 conn(0x7f19480f1c90 msgr2=0x7f19480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.286+0000 7f194ca51700 1 -- 172.21.15.8:0/781889018 shutdown_connections 2023-10-18T21:29:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.286+0000 7f194ca51700 1 -- 172.21.15.8:0/781889018 wait complete. 2023-10-18T21:29:20.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.423+0000 7faf48f1a700 1 -- 172.21.15.8:0/1967301000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf440f77d0 msgr2=0x7faf440f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:20.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.423+0000 7faf48f1a700 1 --2- 172.21.15.8:0/1967301000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf440f77d0 0x7faf440f7c30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7faf38004660 tx=0x7faf38009b30).stop 2023-10-18T21:29:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.423+0000 7faf48f1a700 1 -- 172.21.15.8:0/1967301000 shutdown_connections 2023-10-18T21:29:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.423+0000 7faf48f1a700 1 --2- 172.21.15.8:0/1967301000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf440f77d0 0x7faf440f7c30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.423+0000 7faf48f1a700 1 --2- 172.21.15.8:0/1967301000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440f6530 0x7faf440f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.423+0000 7faf48f1a700 1 -- 172.21.15.8:0/1967301000 >> 172.21.15.8:0/1967301000 conn(0x7faf440f1c90 msgr2=0x7faf440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.423+0000 7faf48f1a700 1 -- 172.21.15.8:0/1967301000 shutdown_connections 2023-10-18T21:29:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.423+0000 7faf48f1a700 1 -- 172.21.15.8:0/1967301000 wait complete. 2023-10-18T21:29:20.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.424+0000 7faf48f1a700 1 Processor -- start 2023-10-18T21:29:20.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.424+0000 7faf48f1a700 1 -- start start 2023-10-18T21:29:20.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.424+0000 7faf48f1a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf440f6530 0x7faf44106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:20.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.424+0000 7faf48f1a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440f77d0 0x7faf44107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:20.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.424+0000 7faf48f1a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf44107850 con 0x7faf440f6530 2023-10-18T21:29:20.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.424+0000 7faf48f1a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf44108060 con 0x7faf440f77d0 2023-10-18T21:29:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.425+0000 7faf437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf440f6530 0x7faf44106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.425+0000 7faf437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf440f6530 0x7faf44106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53248/0 (socket says 172.21.15.8:53248) 2023-10-18T21:29:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.425+0000 7faf437fe700 1 -- 172.21.15.8:0/914783225 learned_addr learned my addr 172.21.15.8:0/914783225 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.425+0000 7faf42ffd700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440f77d0 0x7faf44107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.425+0000 7faf437fe700 1 -- 172.21.15.8:0/914783225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440f77d0 msgr2=0x7faf44107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.425+0000 7faf437fe700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440f77d0 0x7faf44107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.425+0000 7faf437fe700 1 -- 172.21.15.8:0/914783225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf38005040 con 0x7faf440f6530 2023-10-18T21:29:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.425+0000 7faf437fe700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf440f6530 0x7faf44106d60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7faf3400e7c0 tx=0x7faf3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.426+0000 7faf2bfff700 1 -- 172.21.15.8:0/914783225 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf340092e0 con 0x7faf440f6530 2023-10-18T21:29:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.426+0000 7faf48f1a700 1 -- 172.21.15.8:0/914783225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf441082e0 con 0x7faf440f6530 2023-10-18T21:29:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.426+0000 7faf2bfff700 1 -- 172.21.15.8:0/914783225 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faf3400f040 con 0x7faf440f6530 2023-10-18T21:29:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.426+0000 7faf2bfff700 1 -- 172.21.15.8:0/914783225 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf34014810 con 0x7faf440f6530 2023-10-18T21:29:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.426+0000 7faf48f1a700 1 -- 172.21.15.8:0/914783225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf44108820 con 0x7faf440f6530 2023-10-18T21:29:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.427+0000 7faf48f1a700 1 -- 172.21.15.8:0/914783225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf44059100 con 0x7faf440f6530 2023-10-18T21:29:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.428+0000 7faf2bfff700 1 -- 172.21.15.8:0/914783225 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faf3401b030 con 0x7faf440f6530 2023-10-18T21:29:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.429+0000 7faf2bfff700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf2c060f70 0x7faf2c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.429+0000 7faf2bfff700 1 -- 172.21.15.8:0/914783225 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faf3407c860 con 0x7faf440f6530 2023-10-18T21:29:20.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.429+0000 7faf42ffd700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf2c060f70 0x7faf2c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:20.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.429+0000 7faf42ffd700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf2c060f70 0x7faf2c063430 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7faf38009720 tx=0x7faf38016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:20.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.433+0000 7faf2bfff700 1 -- 172.21.15.8:0/914783225 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faf3404c4d0 con 0x7faf440f6530 2023-10-18T21:29:20.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.660+0000 7faf48f1a700 1 -- 172.21.15.8:0/914783225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faf440008d0 con 0x7faf440f6530 2023-10-18T21:29:20.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.660+0000 7faf2bfff700 1 -- 172.21.15.8:0/914783225 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7faf34019030 con 0x7faf440f6530 2023-10-18T21:29:20.662 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:29:20.663 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:29:20.663 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:29:20.663 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:29:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:29:20.663 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:29:20.664 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:29:20.664 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:29:20.664 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:29:20.664 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:29:20.664 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:29:20.665 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:29:20.665 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:29:20.665 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:29:20.665 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:29:20.665 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:29:20.666 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:29:20.666 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:29:20.666 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:29:20.666 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:29:20.666 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:29:20.667 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:29:20.667 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:29:20.667 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:29:20.667 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:29:20.667 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:29:20.668 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:29:20.668 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:29:20.668 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:29:20.668 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:29:20.668 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:29:20.669 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:29:20.669 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:29:20.669 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:29:20.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.662+0000 7faf48f1a700 1 -- 172.21.15.8:0/914783225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf2c060f70 msgr2=0x7faf2c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:20.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.662+0000 7faf48f1a700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf2c060f70 0x7faf2c063430 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7faf38009720 tx=0x7faf38016040).stop 2023-10-18T21:29:20.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.662+0000 7faf48f1a700 1 -- 172.21.15.8:0/914783225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf440f6530 msgr2=0x7faf44106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:20.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.662+0000 7faf48f1a700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf440f6530 0x7faf44106d60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7faf3400e7c0 tx=0x7faf3400b040).stop 2023-10-18T21:29:20.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.662+0000 7faf48f1a700 1 -- 172.21.15.8:0/914783225 shutdown_connections 2023-10-18T21:29:20.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.662+0000 7faf48f1a700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf2c060f70 0x7faf2c063430 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.662+0000 7faf48f1a700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf440f6530 0x7faf44106d60 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.662+0000 7faf48f1a700 1 --2- 172.21.15.8:0/914783225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf440f77d0 0x7faf44107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.662+0000 7faf48f1a700 1 -- 172.21.15.8:0/914783225 >> 172.21.15.8:0/914783225 conn(0x7faf440f1c90 msgr2=0x7faf440fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:20.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.662+0000 7faf48f1a700 1 -- 172.21.15.8:0/914783225 shutdown_connections 2023-10-18T21:29:20.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.663+0000 7faf48f1a700 1 -- 172.21.15.8:0/914783225 wait complete. 2023-10-18T21:29:20.672 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:29:20.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.804+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/3988906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a080f6530 msgr2=0x7f8a080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:20.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.804+0000 7f8a0c9d8700 1 --2- 172.21.15.8:0/3988906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a080f6530 0x7f8a080f6950 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f89f8004660 tx=0x7f89f8009b30).stop 2023-10-18T21:29:20.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.804+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/3988906 shutdown_connections 2023-10-18T21:29:20.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.804+0000 7f8a0c9d8700 1 --2- 172.21.15.8:0/3988906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080f77d0 0x7f8a080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.804+0000 7f8a0c9d8700 1 --2- 172.21.15.8:0/3988906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a080f6530 0x7f8a080f6950 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.804+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/3988906 >> 172.21.15.8:0/3988906 conn(0x7f8a080f1c90 msgr2=0x7f8a080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.804+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/3988906 shutdown_connections 2023-10-18T21:29:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.805+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/3988906 wait complete. 2023-10-18T21:29:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.805+0000 7f8a0c9d8700 1 Processor -- start 2023-10-18T21:29:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.806+0000 7f8a0c9d8700 1 -- start start 2023-10-18T21:29:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.806+0000 7f8a0c9d8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a080f6530 0x7f8a08108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.806+0000 7f8a0c9d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080f77d0 0x7f8a08109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.806+0000 7f8a0c9d8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08109a00 con 0x7f8a080f6530 2023-10-18T21:29:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.806+0000 7f8a0c9d8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08109b40 con 0x7f8a080f77d0 2023-10-18T21:29:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.806+0000 7f8a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a080f6530 0x7f8a08108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.806+0000 7f8a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a080f6530 0x7f8a08108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53274/0 (socket says 172.21.15.8:53274) 2023-10-18T21:29:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.806+0000 7f8a077fe700 1 -- 172.21.15.8:0/1676039087 learned_addr learned my addr 172.21.15.8:0/1676039087 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.806+0000 7f8a06ffd700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080f77d0 0x7f8a08109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.807+0000 7f8a077fe700 1 -- 172.21.15.8:0/1676039087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080f77d0 msgr2=0x7f8a08109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.807+0000 7f8a077fe700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080f77d0 0x7f8a08109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.807+0000 7f8a077fe700 1 -- 172.21.15.8:0/1676039087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f8005040 con 0x7f8a080f6530 2023-10-18T21:29:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.807+0000 7f8a06ffd700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080f77d0 0x7f8a08109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:29:20.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.807+0000 7f8a077fe700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a080f6530 0x7f8a08108f60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f89f8014040 tx=0x7f89f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:20.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.807+0000 7f89effff700 1 -- 172.21.15.8:0/1676039087 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89f8019070 con 0x7f8a080f6530 2023-10-18T21:29:20.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.807+0000 7f89effff700 1 -- 172.21.15.8:0/1676039087 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f89f801e420 con 0x7f8a080f6530 2023-10-18T21:29:20.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.807+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/1676039087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0810a480 con 0x7f8a080f6530 2023-10-18T21:29:20.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.807+0000 7f89effff700 1 -- 172.21.15.8:0/1676039087 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89f8014660 con 0x7f8a080f6530 2023-10-18T21:29:20.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.808+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/1676039087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0810a960 con 0x7f8a080f6530 2023-10-18T21:29:20.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.809+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/1676039087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a08045ad0 con 0x7f8a080f6530 2023-10-18T21:29:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.809+0000 7f89effff700 1 -- 172.21.15.8:0/1676039087 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f89f801e9e0 con 0x7f8a080f6530 2023-10-18T21:29:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.810+0000 7f89effff700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89f0060f70 0x7f89f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.810+0000 7f89effff700 1 -- 172.21.15.8:0/1676039087 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f89f807dde0 con 0x7f8a080f6530 2023-10-18T21:29:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.810+0000 7f8a06ffd700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89f0060f70 0x7f89f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.811+0000 7f8a06ffd700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89f0060f70 0x7f89f0063430 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f89fc007fc0 tx=0x7f89fc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:20.814+0000 7f89effff700 1 -- 172.21.15.8:0/1676039087 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f89f8051440 con 0x7f8a080f6530 2023-10-18T21:29:21.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.015+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/1676039087 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a080fc1a0 con 0x7f89f0060f70 2023-10-18T21:29:21.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.016+0000 7f89effff700 1 -- 172.21.15.8:0/1676039087 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8a080fc1a0 con 0x7f89f0060f70 2023-10-18T21:29:21.018 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:29:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:29:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:29:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:29:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:29:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:29:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:29:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:29:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:29:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:29:21.021 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:29:21.021 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:29:21.021 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:29:21.021 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:29:21.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.018+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/1676039087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89f0060f70 msgr2=0x7f89f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:21.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.018+0000 7f8a0c9d8700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89f0060f70 0x7f89f0063430 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f89fc007fc0 tx=0x7f89fc00b040).stop 2023-10-18T21:29:21.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.018+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/1676039087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a080f6530 msgr2=0x7f8a08108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:21.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.018+0000 7f8a0c9d8700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a080f6530 0x7f8a08108f60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f89f8014040 tx=0x7f89f800b040).stop 2023-10-18T21:29:21.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.019+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/1676039087 shutdown_connections 2023-10-18T21:29:21.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.019+0000 7f8a0c9d8700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f89f0060f70 0x7f89f0063430 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:21.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.019+0000 7f8a0c9d8700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a080f6530 0x7f8a08108f60 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:21.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.019+0000 7f8a0c9d8700 1 --2- 172.21.15.8:0/1676039087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080f77d0 0x7f8a08109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:21.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.019+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/1676039087 >> 172.21.15.8:0/1676039087 conn(0x7f8a080f1c90 msgr2=0x7f8a0806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:21.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.019+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/1676039087 shutdown_connections 2023-10-18T21:29:21.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:21.019+0000 7f8a0c9d8700 1 -- 172.21.15.8:0/1676039087 wait complete. 2023-10-18T21:29:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:19.182348+0000 mgr.smithi008.flmjzp (mgr.14640) 1829 : audit [DBG] from='client.35632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:19.322602+0000 mgr.smithi008.flmjzp (mgr.14640) 1830 : cluster [DBG] pgmap v1267: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:19.532746+0000 mgr.smithi008.flmjzp (mgr.14640) 1831 : audit [DBG] from='client.35636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:19.874819+0000 mgr.smithi008.flmjzp (mgr.14640) 1832 : audit [DBG] from='client.35640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:20.285159+0000 mon.smithi008 (mon.0) 2282 : audit [DBG] from='client.? 172.21.15.8:0/781889018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:20.661835+0000 mon.smithi008 (mon.0) 2283 : audit [DBG] from='client.? 172.21.15.8:0/914783225' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:29:21.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:19.182348+0000 mgr.smithi008.flmjzp (mgr.14640) 1829 : audit [DBG] from='client.35632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:21.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:19.322602+0000 mgr.smithi008.flmjzp (mgr.14640) 1830 : cluster [DBG] pgmap v1267: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:19.532746+0000 mgr.smithi008.flmjzp (mgr.14640) 1831 : audit [DBG] from='client.35636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:19.874819+0000 mgr.smithi008.flmjzp (mgr.14640) 1832 : audit [DBG] from='client.35640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:20.285159+0000 mon.smithi008 (mon.0) 2282 : audit [DBG] from='client.? 172.21.15.8:0/781889018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:21.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:20.661835+0000 mon.smithi008 (mon.0) 2283 : audit [DBG] from='client.? 172.21.15.8:0/914783225' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:29:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:21.017791+0000 mgr.smithi008.flmjzp (mgr.14640) 1833 : audit [DBG] from='client.35652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:21.323018+0000 mgr.smithi008.flmjzp (mgr.14640) 1834 : cluster [DBG] pgmap v1268: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:23.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:21.017791+0000 mgr.smithi008.flmjzp (mgr.14640) 1833 : audit [DBG] from='client.35652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:23.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:21.323018+0000 mgr.smithi008.flmjzp (mgr.14640) 1834 : cluster [DBG] pgmap v1268: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:25.152 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:23.323589+0000 mgr.smithi008.flmjzp (mgr.14640) 1835 : cluster [DBG] pgmap v1269: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:25.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:23.323589+0000 mgr.smithi008.flmjzp (mgr.14640) 1835 : cluster [DBG] pgmap v1269: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:25.324132+0000 mgr.smithi008.flmjzp (mgr.14640) 1836 : cluster [DBG] pgmap v1270: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:25.354755+0000 mon.smithi008 (mon.0) 2284 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:25.914753+0000 mon.smithi008 (mon.0) 2285 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:25.915506+0000 mon.smithi008 (mon.0) 2286 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:25.921186+0000 mon.smithi008 (mon.0) 2287 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:25.927131+0000 mon.smithi008 (mon.0) 2288 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:25.929899+0000 mon.smithi008 (mon.0) 2289 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:25.931427+0000 mon.smithi008 (mon.0) 2290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:25.932940+0000 mon.smithi008 (mon.0) 2291 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:25.934919+0000 mon.smithi008 (mon.0) 2292 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:26.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:25.324132+0000 mgr.smithi008.flmjzp (mgr.14640) 1836 : cluster [DBG] pgmap v1270: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:25.354755+0000 mon.smithi008 (mon.0) 2284 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:25.914753+0000 mon.smithi008 (mon.0) 2285 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:25.915506+0000 mon.smithi008 (mon.0) 2286 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:25.921186+0000 mon.smithi008 (mon.0) 2287 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:25.927131+0000 mon.smithi008 (mon.0) 2288 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:25.929899+0000 mon.smithi008 (mon.0) 2289 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:25.931427+0000 mon.smithi008 (mon.0) 2290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:25.932940+0000 mon.smithi008 (mon.0) 2291 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:25.934919+0000 mon.smithi008 (mon.0) 2292 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:25.916125+0000 mgr.smithi008.flmjzp (mgr.14640) 1837 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:25.916652+0000 mgr.smithi008.flmjzp (mgr.14640) 1838 : cluster [DBG] pgmap v1271: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:25.916899+0000 mgr.smithi008.flmjzp (mgr.14640) 1839 : cluster [DBG] pgmap v1272: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:25.936645+0000 mgr.smithi008.flmjzp (mgr.14640) 1840 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:25.916125+0000 mgr.smithi008.flmjzp (mgr.14640) 1837 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:25.916652+0000 mgr.smithi008.flmjzp (mgr.14640) 1838 : cluster [DBG] pgmap v1271: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:25.916899+0000 mgr.smithi008.flmjzp (mgr.14640) 1839 : cluster [DBG] pgmap v1272: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:25.936645+0000 mgr.smithi008.flmjzp (mgr.14640) 1840 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:30.159 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:27.917552+0000 mgr.smithi008.flmjzp (mgr.14640) 1841 : cluster [DBG] pgmap v1273: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:30.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:27.917552+0000 mgr.smithi008.flmjzp (mgr.14640) 1841 : cluster [DBG] pgmap v1273: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:29.918203+0000 mgr.smithi008.flmjzp (mgr.14640) 1842 : cluster [DBG] pgmap v1274: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:32.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:29.918203+0000 mgr.smithi008.flmjzp (mgr.14640) 1842 : cluster [DBG] pgmap v1274: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:31.918784+0000 mgr.smithi008.flmjzp (mgr.14640) 1843 : cluster [DBG] pgmap v1275: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:34.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:31.918784+0000 mgr.smithi008.flmjzp (mgr.14640) 1843 : cluster [DBG] pgmap v1275: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:36.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:33.919325+0000 mgr.smithi008.flmjzp (mgr.14640) 1844 : cluster [DBG] pgmap v1276: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:36.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:33.919325+0000 mgr.smithi008.flmjzp (mgr.14640) 1844 : cluster [DBG] pgmap v1276: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:35.947481+0000 mon.smithi008 (mon.0) 2293 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:35.949696+0000 mon.smithi008 (mon.0) 2294 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:35.950732+0000 mon.smithi008 (mon.0) 2295 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:35.956940+0000 mon.smithi008 (mon.0) 2296 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:35.963553+0000 mon.smithi008 (mon.0) 2297 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:35.966717+0000 mon.smithi008 (mon.0) 2298 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:35.968404+0000 mon.smithi008 (mon.0) 2299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:35.970076+0000 mon.smithi008 (mon.0) 2300 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:37.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:35.972149+0000 mon.smithi008 (mon.0) 2301 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:37.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:35.947481+0000 mon.smithi008 (mon.0) 2293 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:35.949696+0000 mon.smithi008 (mon.0) 2294 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:35.950732+0000 mon.smithi008 (mon.0) 2295 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:35.956940+0000 mon.smithi008 (mon.0) 2296 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:35.963553+0000 mon.smithi008 (mon.0) 2297 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:35.966717+0000 mon.smithi008 (mon.0) 2298 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:35.968404+0000 mon.smithi008 (mon.0) 2299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:35.970076+0000 mon.smithi008 (mon.0) 2300 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:35.972149+0000 mon.smithi008 (mon.0) 2301 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:35.919983+0000 mgr.smithi008.flmjzp (mgr.14640) 1845 : cluster [DBG] pgmap v1277: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:35.951638+0000 mgr.smithi008.flmjzp (mgr.14640) 1846 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:35.952217+0000 mgr.smithi008.flmjzp (mgr.14640) 1847 : cluster [DBG] pgmap v1278: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:35.952503+0000 mgr.smithi008.flmjzp (mgr.14640) 1848 : cluster [DBG] pgmap v1279: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:35.974112+0000 mgr.smithi008.flmjzp (mgr.14640) 1849 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:38.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:35.919983+0000 mgr.smithi008.flmjzp (mgr.14640) 1845 : cluster [DBG] pgmap v1277: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:35.951638+0000 mgr.smithi008.flmjzp (mgr.14640) 1846 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:35.952217+0000 mgr.smithi008.flmjzp (mgr.14640) 1847 : cluster [DBG] pgmap v1278: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:35.952503+0000 mgr.smithi008.flmjzp (mgr.14640) 1848 : cluster [DBG] pgmap v1279: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:35.974112+0000 mgr.smithi008.flmjzp (mgr.14640) 1849 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:40.159 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:37.952986+0000 mgr.smithi008.flmjzp (mgr.14640) 1850 : cluster [DBG] pgmap v1280: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:40.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:37.952986+0000 mgr.smithi008.flmjzp (mgr.14640) 1850 : cluster [DBG] pgmap v1280: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:39.953679+0000 mgr.smithi008.flmjzp (mgr.14640) 1851 : cluster [DBG] pgmap v1281: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:42.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:39.953679+0000 mgr.smithi008.flmjzp (mgr.14640) 1851 : cluster [DBG] pgmap v1281: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:41.954207+0000 mgr.smithi008.flmjzp (mgr.14640) 1852 : cluster [DBG] pgmap v1282: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:41.954207+0000 mgr.smithi008.flmjzp (mgr.14640) 1852 : cluster [DBG] pgmap v1282: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:43.954788+0000 mgr.smithi008.flmjzp (mgr.14640) 1853 : cluster [DBG] pgmap v1283: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:46.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:43.954788+0000 mgr.smithi008.flmjzp (mgr.14640) 1853 : cluster [DBG] pgmap v1283: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:45.983749+0000 mon.smithi008 (mon.0) 2302 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:46.549751+0000 mon.smithi008 (mon.0) 2303 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:46.550912+0000 mon.smithi008 (mon.0) 2304 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:46.558087+0000 mon.smithi008 (mon.0) 2305 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:46.566218+0000 mon.smithi008 (mon.0) 2306 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:46.569625+0000 mon.smithi008 (mon.0) 2307 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:46.571614+0000 mon.smithi008 (mon.0) 2308 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:46.573468+0000 mon.smithi008 (mon.0) 2309 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:47.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:46.576070+0000 mon.smithi008 (mon.0) 2310 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:45.983749+0000 mon.smithi008 (mon.0) 2302 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:46.549751+0000 mon.smithi008 (mon.0) 2303 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:46.550912+0000 mon.smithi008 (mon.0) 2304 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:46.558087+0000 mon.smithi008 (mon.0) 2305 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:46.566218+0000 mon.smithi008 (mon.0) 2306 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:46.569625+0000 mon.smithi008 (mon.0) 2307 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:47.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:46.571614+0000 mon.smithi008 (mon.0) 2308 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:47.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:46.573468+0000 mon.smithi008 (mon.0) 2309 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:47.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:46.576070+0000 mon.smithi008 (mon.0) 2310 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:45.955372+0000 mgr.smithi008.flmjzp (mgr.14640) 1854 : cluster [DBG] pgmap v1284: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:46.551845+0000 mgr.smithi008.flmjzp (mgr.14640) 1855 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:46.552545+0000 mgr.smithi008.flmjzp (mgr.14640) 1856 : cluster [DBG] pgmap v1285: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:46.552840+0000 mgr.smithi008.flmjzp (mgr.14640) 1857 : cluster [DBG] pgmap v1286: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:48.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:46.578150+0000 mgr.smithi008.flmjzp (mgr.14640) 1858 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:48.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:45.955372+0000 mgr.smithi008.flmjzp (mgr.14640) 1854 : cluster [DBG] pgmap v1284: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:46.551845+0000 mgr.smithi008.flmjzp (mgr.14640) 1855 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:46.552545+0000 mgr.smithi008.flmjzp (mgr.14640) 1856 : cluster [DBG] pgmap v1285: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:46.552840+0000 mgr.smithi008.flmjzp (mgr.14640) 1857 : cluster [DBG] pgmap v1286: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:46.578150+0000 mgr.smithi008.flmjzp (mgr.14640) 1858 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:50.159 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:48.553500+0000 mgr.smithi008.flmjzp (mgr.14640) 1859 : cluster [DBG] pgmap v1287: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:48.553500+0000 mgr.smithi008.flmjzp (mgr.14640) 1859 : cluster [DBG] pgmap v1287: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:51.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.173+0000 7f691ae37700 1 -- 172.21.15.8:0/294513349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69140f6530 msgr2=0x7f69140f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:51.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.173+0000 7f691ae37700 1 --2- 172.21.15.8:0/294513349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69140f6530 0x7f69140f6950 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f6910004660 tx=0x7f6910009b30).stop 2023-10-18T21:29:51.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.173+0000 7f691ae37700 1 -- 172.21.15.8:0/294513349 shutdown_connections 2023-10-18T21:29:51.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.173+0000 7f691ae37700 1 --2- 172.21.15.8:0/294513349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69140f77d0 0x7f69140f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.173+0000 7f691ae37700 1 --2- 172.21.15.8:0/294513349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69140f6530 0x7f69140f6950 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.173+0000 7f691ae37700 1 -- 172.21.15.8:0/294513349 >> 172.21.15.8:0/294513349 conn(0x7f69140f1c90 msgr2=0x7f69140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:51.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.173+0000 7f691ae37700 1 -- 172.21.15.8:0/294513349 shutdown_connections 2023-10-18T21:29:51.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.173+0000 7f691ae37700 1 -- 172.21.15.8:0/294513349 wait complete. 2023-10-18T21:29:51.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.174+0000 7f691ae37700 1 Processor -- start 2023-10-18T21:29:51.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.174+0000 7f691ae37700 1 -- start start 2023-10-18T21:29:51.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.174+0000 7f691ae37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69140f6530 0x7f6914106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:51.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.174+0000 7f691ae37700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69140f77d0 0x7f6914107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:51.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.174+0000 7f691ae37700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6914107910 con 0x7f69140f6530 2023-10-18T21:29:51.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.174+0000 7f691ae37700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6914108120 con 0x7f69140f77d0 2023-10-18T21:29:51.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.175+0000 7f6919e35700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69140f6530 0x7f6914106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:51.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.175+0000 7f6919e35700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69140f6530 0x7f6914106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46626/0 (socket says 172.21.15.8:46626) 2023-10-18T21:29:51.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.175+0000 7f6919e35700 1 -- 172.21.15.8:0/919662751 learned_addr learned my addr 172.21.15.8:0/919662751 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:51.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.175+0000 7f6919634700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69140f77d0 0x7f6914107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:51.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.175+0000 7f6919e35700 1 -- 172.21.15.8:0/919662751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69140f77d0 msgr2=0x7f6914107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:51.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.175+0000 7f6919e35700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69140f77d0 0x7f6914107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.175+0000 7f6919e35700 1 -- 172.21.15.8:0/919662751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6910005040 con 0x7f69140f6530 2023-10-18T21:29:51.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.175+0000 7f6919634700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69140f77d0 0x7f6914107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:29:51.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.175+0000 7f6919e35700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69140f6530 0x7f6914106e20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f6910007a70 tx=0x7f6910009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:51.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.176+0000 7f690a7fc700 1 -- 172.21.15.8:0/919662751 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6910018070 con 0x7f69140f6530 2023-10-18T21:29:51.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.176+0000 7f690a7fc700 1 -- 172.21.15.8:0/919662751 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f691001d8e0 con 0x7f69140f6530 2023-10-18T21:29:51.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.176+0000 7f691ae37700 1 -- 172.21.15.8:0/919662751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6914108340 con 0x7f69140f6530 2023-10-18T21:29:51.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.176+0000 7f690a7fc700 1 -- 172.21.15.8:0/919662751 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f691001c660 con 0x7f69140f6530 2023-10-18T21:29:51.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.176+0000 7f691ae37700 1 -- 172.21.15.8:0/919662751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69141088a0 con 0x7f69140f6530 2023-10-18T21:29:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.177+0000 7f691ae37700 1 -- 172.21.15.8:0/919662751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6914059100 con 0x7f69140f6530 2023-10-18T21:29:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.178+0000 7f690a7fc700 1 -- 172.21.15.8:0/919662751 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f691001da50 con 0x7f69140f6530 2023-10-18T21:29:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.179+0000 7f690a7fc700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6900060f70 0x7f6900063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.179+0000 7f690a7fc700 1 -- 172.21.15.8:0/919662751 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f691007e8c0 con 0x7f69140f6530 2023-10-18T21:29:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.179+0000 7f6919634700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6900060f70 0x7f6900063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.179+0000 7f6919634700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6900060f70 0x7f6900063430 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f6904004a90 tx=0x7f6904009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:51.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.183+0000 7f690a7fc700 1 -- 172.21.15.8:0/919662751 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f691004e4f0 con 0x7f69140f6530 2023-10-18T21:29:51.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.380+0000 7f691ae37700 1 -- 172.21.15.8:0/919662751 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69140fecc0 con 0x7f6900060f70 2023-10-18T21:29:51.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.382+0000 7f690a7fc700 1 -- 172.21.15.8:0/919662751 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f69140fecc0 con 0x7f6900060f70 2023-10-18T21:29:51.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 -- 172.21.15.8:0/919662751 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6900060f70 msgr2=0x7f6900063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:51.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6900060f70 0x7f6900063430 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f6904004a90 tx=0x7f6904009040).stop 2023-10-18T21:29:51.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 -- 172.21.15.8:0/919662751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69140f6530 msgr2=0x7f6914106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:51.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69140f6530 0x7f6914106e20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f6910007a70 tx=0x7f6910009b30).stop 2023-10-18T21:29:51.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 -- 172.21.15.8:0/919662751 shutdown_connections 2023-10-18T21:29:51.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6900060f70 0x7f6900063430 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69140f6530 0x7f6914106e20 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 --2- 172.21.15.8:0/919662751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69140f77d0 0x7f6914107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 -- 172.21.15.8:0/919662751 >> 172.21.15.8:0/919662751 conn(0x7f69140f1c90 msgr2=0x7f69140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:51.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 -- 172.21.15.8:0/919662751 shutdown_connections 2023-10-18T21:29:51.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.384+0000 7f691ae37700 1 -- 172.21.15.8:0/919662751 wait complete. 2023-10-18T21:29:51.399 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:29:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:50.554204+0000 mgr.smithi008.flmjzp (mgr.14640) 1860 : cluster [DBG] pgmap v1288: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:51.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.522+0000 7f2bc32e0700 1 -- 172.21.15.8:0/300510173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bbc0f77d0 msgr2=0x7f2bbc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.522+0000 7f2bc32e0700 1 --2- 172.21.15.8:0/300510173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bbc0f77d0 0x7f2bbc0f7c30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f2bac004660 tx=0x7f2bac009b30).stop 2023-10-18T21:29:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.522+0000 7f2bc32e0700 1 -- 172.21.15.8:0/300510173 shutdown_connections 2023-10-18T21:29:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.522+0000 7f2bc32e0700 1 --2- 172.21.15.8:0/300510173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bbc0f77d0 0x7f2bbc0f7c30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.522+0000 7f2bc32e0700 1 --2- 172.21.15.8:0/300510173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bbc0f6530 0x7f2bbc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.522+0000 7f2bc32e0700 1 -- 172.21.15.8:0/300510173 >> 172.21.15.8:0/300510173 conn(0x7f2bbc0f1c90 msgr2=0x7f2bbc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.522+0000 7f2bc32e0700 1 -- 172.21.15.8:0/300510173 shutdown_connections 2023-10-18T21:29:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.522+0000 7f2bc32e0700 1 -- 172.21.15.8:0/300510173 wait complete. 2023-10-18T21:29:51.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.523+0000 7f2bc32e0700 1 Processor -- start 2023-10-18T21:29:51.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.523+0000 7f2bc32e0700 1 -- start start 2023-10-18T21:29:51.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc32e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bbc0f6530 0x7f2bbc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:51.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc32e0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bbc0f77d0 0x7f2bbc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:51.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc32e0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc107880 con 0x7f2bbc0f6530 2023-10-18T21:29:51.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc32e0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc1080c0 con 0x7f2bbc0f77d0 2023-10-18T21:29:51.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc22de700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bbc0f6530 0x7f2bbc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:51.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc22de700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bbc0f6530 0x7f2bbc106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46648/0 (socket says 172.21.15.8:46648) 2023-10-18T21:29:51.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc22de700 1 -- 172.21.15.8:0/2774768514 learned_addr learned my addr 172.21.15.8:0/2774768514 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:51.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc1add700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bbc0f77d0 0x7f2bbc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:51.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc22de700 1 -- 172.21.15.8:0/2774768514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bbc0f77d0 msgr2=0x7f2bbc107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:51.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc22de700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bbc0f77d0 0x7f2bbc107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.524+0000 7f2bc22de700 1 -- 172.21.15.8:0/2774768514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac005040 con 0x7f2bbc0f6530 2023-10-18T21:29:51.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.525+0000 7f2bc22de700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bbc0f6530 0x7f2bbc106d90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f2bb8002700 tx=0x7f2bb8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:51.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.525+0000 7f2bb2ffd700 1 -- 172.21.15.8:0/2774768514 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bb80079c0 con 0x7f2bbc0f6530 2023-10-18T21:29:51.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.525+0000 7f2bb2ffd700 1 -- 172.21.15.8:0/2774768514 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2bb800f040 con 0x7f2bbc0f6530 2023-10-18T21:29:51.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.525+0000 7f2bc32e0700 1 -- 172.21.15.8:0/2774768514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc1083a0 con 0x7f2bbc0f6530 2023-10-18T21:29:51.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.525+0000 7f2bb2ffd700 1 -- 172.21.15.8:0/2774768514 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bb80148d0 con 0x7f2bbc0f6530 2023-10-18T21:29:51.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.525+0000 7f2bc32e0700 1 -- 172.21.15.8:0/2774768514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc1088e0 con 0x7f2bbc0f6530 2023-10-18T21:29:51.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.526+0000 7f2bc32e0700 1 -- 172.21.15.8:0/2774768514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bbc059100 con 0x7f2bbc0f6530 2023-10-18T21:29:51.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.527+0000 7f2bb2ffd700 1 -- 172.21.15.8:0/2774768514 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2bb801b060 con 0x7f2bbc0f6530 2023-10-18T21:29:51.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.528+0000 7f2bb2ffd700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ba8060f70 0x7f2ba8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:51.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.528+0000 7f2bb2ffd700 1 -- 172.21.15.8:0/2774768514 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2bb807c7d0 con 0x7f2bbc0f6530 2023-10-18T21:29:51.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.528+0000 7f2bc1add700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ba8060f70 0x7f2ba8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:51.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.529+0000 7f2bc1add700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ba8060f70 0x7f2ba8063430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f2bac004630 tx=0x7f2bac009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.532+0000 7f2bb2ffd700 1 -- 172.21.15.8:0/2774768514 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2bb804c380 con 0x7f2bbc0f6530 2023-10-18T21:29:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:50.554204+0000 mgr.smithi008.flmjzp (mgr.14640) 1860 : cluster [DBG] pgmap v1288: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:51.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.732+0000 7f2bc32e0700 1 -- 172.21.15.8:0/2774768514 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bbc0fedd0 con 0x7f2ba8060f70 2023-10-18T21:29:51.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.733+0000 7f2bb2ffd700 1 -- 172.21.15.8:0/2774768514 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2bbc0fedd0 con 0x7f2ba8060f70 2023-10-18T21:29:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.735+0000 7f2bc32e0700 1 -- 172.21.15.8:0/2774768514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ba8060f70 msgr2=0x7f2ba8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.735+0000 7f2bc32e0700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ba8060f70 0x7f2ba8063430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f2bac004630 tx=0x7f2bac009b30).stop 2023-10-18T21:29:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.735+0000 7f2bc32e0700 1 -- 172.21.15.8:0/2774768514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bbc0f6530 msgr2=0x7f2bbc106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.735+0000 7f2bc32e0700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bbc0f6530 0x7f2bbc106d90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f2bb8002700 tx=0x7f2bb8009d80).stop 2023-10-18T21:29:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.735+0000 7f2bc32e0700 1 -- 172.21.15.8:0/2774768514 shutdown_connections 2023-10-18T21:29:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.735+0000 7f2bc32e0700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ba8060f70 0x7f2ba8063430 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.735+0000 7f2bc32e0700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bbc0f6530 0x7f2bbc106d90 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.735+0000 7f2bc32e0700 1 --2- 172.21.15.8:0/2774768514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bbc0f77d0 0x7f2bbc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.735+0000 7f2bc32e0700 1 -- 172.21.15.8:0/2774768514 >> 172.21.15.8:0/2774768514 conn(0x7f2bbc0f1c90 msgr2=0x7f2bbc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.736+0000 7f2bc32e0700 1 -- 172.21.15.8:0/2774768514 shutdown_connections 2023-10-18T21:29:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.736+0000 7f2bc32e0700 1 -- 172.21.15.8:0/2774768514 wait complete. 2023-10-18T21:29:51.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.872+0000 7f9343fff700 1 -- 172.21.15.8:0/1419927991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93440f6530 msgr2=0x7f93440f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:51.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.872+0000 7f9343fff700 1 --2- 172.21.15.8:0/1419927991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93440f6530 0x7f93440f6950 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f9334004660 tx=0x7f9334009b30).stop 2023-10-18T21:29:51.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.872+0000 7f9343fff700 1 -- 172.21.15.8:0/1419927991 shutdown_connections 2023-10-18T21:29:51.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.872+0000 7f9343fff700 1 --2- 172.21.15.8:0/1419927991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93440f77d0 0x7f93440f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.872+0000 7f9343fff700 1 --2- 172.21.15.8:0/1419927991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93440f6530 0x7f93440f6950 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.872+0000 7f9343fff700 1 -- 172.21.15.8:0/1419927991 >> 172.21.15.8:0/1419927991 conn(0x7f93440f1c90 msgr2=0x7f93440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:51.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.872+0000 7f9343fff700 1 -- 172.21.15.8:0/1419927991 shutdown_connections 2023-10-18T21:29:51.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.872+0000 7f9343fff700 1 -- 172.21.15.8:0/1419927991 wait complete. 2023-10-18T21:29:51.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.873+0000 7f9343fff700 1 Processor -- start 2023-10-18T21:29:51.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.873+0000 7f9343fff700 1 -- start start 2023-10-18T21:29:51.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.873+0000 7f9343fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93440f6530 0x7f9344106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:51.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.873+0000 7f9343fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93440f77d0 0x7f9344107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:51.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.873+0000 7f9343fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9344107880 con 0x7f93440f6530 2023-10-18T21:29:51.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.873+0000 7f9343fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93441080c0 con 0x7f93440f77d0 2023-10-18T21:29:51.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.873+0000 7f9342ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93440f6530 0x7f9344106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:51.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f9342ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93440f6530 0x7f9344106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46662/0 (socket says 172.21.15.8:46662) 2023-10-18T21:29:51.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f9342ffd700 1 -- 172.21.15.8:0/3387114330 learned_addr learned my addr 172.21.15.8:0/3387114330 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:51.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f93427fc700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93440f77d0 0x7f9344107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:51.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f9342ffd700 1 -- 172.21.15.8:0/3387114330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93440f77d0 msgr2=0x7f9344107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:51.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f9342ffd700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93440f77d0 0x7f9344107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:51.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f9342ffd700 1 -- 172.21.15.8:0/3387114330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9334005040 con 0x7f93440f6530 2023-10-18T21:29:51.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f93427fc700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93440f77d0 0x7f9344107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:29:51.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f9342ffd700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93440f6530 0x7f9344106d90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f9334014040 tx=0x7f933400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:51.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f932b7fe700 1 -- 172.21.15.8:0/3387114330 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9334019070 con 0x7f93440f6530 2023-10-18T21:29:51.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f9343fff700 1 -- 172.21.15.8:0/3387114330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9344108340 con 0x7f93440f6530 2023-10-18T21:29:51.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f932b7fe700 1 -- 172.21.15.8:0/3387114330 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f933401e420 con 0x7f93440f6530 2023-10-18T21:29:51.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.874+0000 7f932b7fe700 1 -- 172.21.15.8:0/3387114330 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9334014660 con 0x7f93440f6530 2023-10-18T21:29:51.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.875+0000 7f9343fff700 1 -- 172.21.15.8:0/3387114330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9344108820 con 0x7f93440f6530 2023-10-18T21:29:51.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.876+0000 7f9343fff700 1 -- 172.21.15.8:0/3387114330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9344059100 con 0x7f93440f6530 2023-10-18T21:29:51.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.877+0000 7f932b7fe700 1 -- 172.21.15.8:0/3387114330 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f933401e9e0 con 0x7f93440f6530 2023-10-18T21:29:51.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.877+0000 7f932b7fe700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f932c060f70 0x7f932c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.877+0000 7f932b7fe700 1 -- 172.21.15.8:0/3387114330 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f933407dd00 con 0x7f93440f6530 2023-10-18T21:29:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.878+0000 7f93427fc700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f932c060f70 0x7f932c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.878+0000 7f93427fc700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f932c060f70 0x7f932c063430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f9338009da0 tx=0x7f933800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:51.882+0000 7f932b7fe700 1 -- 172.21.15.8:0/3387114330 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9334081030 con 0x7f93440f6530 2023-10-18T21:29:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.072+0000 7f9343fff700 1 -- 172.21.15.8:0/3387114330 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f93440fecc0 con 0x7f932c060f70 2023-10-18T21:29:52.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.082+0000 7f932b7fe700 1 -- 172.21.15.8:0/3387114330 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f93440fecc0 con 0x7f932c060f70 2023-10-18T21:29:52.083 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:29:52.083 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (36m) 4m ago 38m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:29:52.083 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (30m) 4m ago 37m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:29:52.083 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (30m) 2m ago 37m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:29:52.084 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (36m) 4m ago 37m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:29:52.084 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 34m - - 2023-10-18T21:29:52.084 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 33m - - 2023-10-18T21:29:52.084 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 34m - - 2023-10-18T21:29:52.084 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 33m - - 2023-10-18T21:29:52.084 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (31m) 4m ago 39m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:29:52.085 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (31m) 2m ago 37m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:29:52.085 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (30m) 4m ago 39m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:29:52.085 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (30m) 2m ago 37m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:29:52.085 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (37m) 4m ago 37m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:29:52.085 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (36m) 2m ago 36m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:29:52.086 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (30m) 4m ago 36m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:29:52.086 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (28m) 4m ago 36m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:29:52.086 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (27m) 4m ago 35m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:29:52.086 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (27m) 2m ago 35m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:29:52.086 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (26m) 2m ago 35m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:29:52.087 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (26m) 2m ago 35m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:29:52.087 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (32m) 4m ago 37m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:29:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 -- 172.21.15.8:0/3387114330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f932c060f70 msgr2=0x7f932c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f932c060f70 0x7f932c063430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f9338009da0 tx=0x7f933800b040).stop 2023-10-18T21:29:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 -- 172.21.15.8:0/3387114330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93440f6530 msgr2=0x7f9344106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93440f6530 0x7f9344106d90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f9334014040 tx=0x7f933400b040).stop 2023-10-18T21:29:52.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 -- 172.21.15.8:0/3387114330 shutdown_connections 2023-10-18T21:29:52.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f932c060f70 0x7f932c063430 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93440f6530 0x7f9344106d90 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 --2- 172.21.15.8:0/3387114330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93440f77d0 0x7f9344107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 -- 172.21.15.8:0/3387114330 >> 172.21.15.8:0/3387114330 conn(0x7f93440f1c90 msgr2=0x7f93440fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:52.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 -- 172.21.15.8:0/3387114330 shutdown_connections 2023-10-18T21:29:52.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.084+0000 7f9343fff700 1 -- 172.21.15.8:0/3387114330 wait complete. 2023-10-18T21:29:52.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.220+0000 7f97fd80a700 1 -- 172.21.15.8:0/4069287180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f80f77d0 msgr2=0x7f97f80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:52.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.220+0000 7f97fd80a700 1 --2- 172.21.15.8:0/4069287180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f80f77d0 0x7f97f80f7c30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f97e4004660 tx=0x7f97e4009b30).stop 2023-10-18T21:29:52.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.220+0000 7f97fd80a700 1 -- 172.21.15.8:0/4069287180 shutdown_connections 2023-10-18T21:29:52.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.220+0000 7f97fd80a700 1 --2- 172.21.15.8:0/4069287180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f80f77d0 0x7f97f80f7c30 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.220+0000 7f97fd80a700 1 --2- 172.21.15.8:0/4069287180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f80f6530 0x7f97f80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.220+0000 7f97fd80a700 1 -- 172.21.15.8:0/4069287180 >> 172.21.15.8:0/4069287180 conn(0x7f97f80f1c90 msgr2=0x7f97f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:52.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.220+0000 7f97fd80a700 1 -- 172.21.15.8:0/4069287180 shutdown_connections 2023-10-18T21:29:52.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.220+0000 7f97fd80a700 1 -- 172.21.15.8:0/4069287180 wait complete. 2023-10-18T21:29:52.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.221+0000 7f97fd80a700 1 Processor -- start 2023-10-18T21:29:52.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.221+0000 7f97fd80a700 1 -- start start 2023-10-18T21:29:52.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.221+0000 7f97fd80a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f80f6530 0x7f97f8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:52.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.221+0000 7f97fd80a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f80f77d0 0x7f97f8109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:52.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.221+0000 7f97fd80a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f8109a20 con 0x7f97f80f77d0 2023-10-18T21:29:52.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.221+0000 7f97fd80a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f8109b60 con 0x7f97f80f6530 2023-10-18T21:29:52.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.221+0000 7f97f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f80f77d0 0x7f97f8109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:52.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f80f77d0 0x7f97f8109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46678/0 (socket says 172.21.15.8:46678) 2023-10-18T21:29:52.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97f7fff700 1 -- 172.21.15.8:0/1558207454 learned_addr learned my addr 172.21.15.8:0/1558207454 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:52.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97fc808700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f80f6530 0x7f97f8108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:52.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97f7fff700 1 -- 172.21.15.8:0/1558207454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f80f6530 msgr2=0x7f97f8108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:52.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97f7fff700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f80f6530 0x7f97f8108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97f7fff700 1 -- 172.21.15.8:0/1558207454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4005040 con 0x7f97f80f77d0 2023-10-18T21:29:52.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97f7fff700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f80f77d0 0x7f97f8109470 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f97e4009990 tx=0x7f97e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:52.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97f57fa700 1 -- 172.21.15.8:0/1558207454 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e4018070 con 0x7f97f80f77d0 2023-10-18T21:29:52.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97f57fa700 1 -- 172.21.15.8:0/1558207454 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f97e4009630 con 0x7f97f80f77d0 2023-10-18T21:29:52.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97f57fa700 1 -- 172.21.15.8:0/1558207454 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e401c3c0 con 0x7f97f80f77d0 2023-10-18T21:29:52.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.222+0000 7f97fd80a700 1 -- 172.21.15.8:0/1558207454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f810a4a0 con 0x7f97f80f77d0 2023-10-18T21:29:52.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.223+0000 7f97fd80a700 1 -- 172.21.15.8:0/1558207454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f810aa00 con 0x7f97f80f77d0 2023-10-18T21:29:52.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.224+0000 7f97fd80a700 1 -- 172.21.15.8:0/1558207454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f8045ad0 con 0x7f97f80f77d0 2023-10-18T21:29:52.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.225+0000 7f97f57fa700 1 -- 172.21.15.8:0/1558207454 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f97e401d970 con 0x7f97f80f77d0 2023-10-18T21:29:52.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.226+0000 7f97f57fa700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97e8060f70 0x7f97e8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:52.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.226+0000 7f97f57fa700 1 -- 172.21.15.8:0/1558207454 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f97e407e580 con 0x7f97f80f77d0 2023-10-18T21:29:52.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.227+0000 7f97fc808700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97e8060f70 0x7f97e8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:52.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.228+0000 7f97fc808700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97e8060f70 0x7f97e8063430 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f97f80f7630 tx=0x7f97ec00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:52.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.231+0000 7f97f57fa700 1 -- 172.21.15.8:0/1558207454 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f97e4051be0 con 0x7f97f80f77d0 2023-10-18T21:29:52.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.486+0000 7f97fd80a700 1 -- 172.21.15.8:0/1558207454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97f8027a00 con 0x7f97f80f77d0 2023-10-18T21:29:52.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.487+0000 7f97f57fa700 1 -- 172.21.15.8:0/1558207454 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f97e40517d0 con 0x7f97f80f77d0 2023-10-18T21:29:52.488 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:29:52.488 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:29:52.489 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:29:52.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:29:52.489 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:29:52.489 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:29:52.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:29:52.490 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:29:52.490 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:29:52.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:29:52.490 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:29:52.491 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:29:52.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:29:52.491 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:29:52.491 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:29:52.491 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:29:52.491 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:29:52.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.489+0000 7f97fd80a700 1 -- 172.21.15.8:0/1558207454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97e8060f70 msgr2=0x7f97e8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:52.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.489+0000 7f97fd80a700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97e8060f70 0x7f97e8063430 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f97f80f7630 tx=0x7f97ec00b040).stop 2023-10-18T21:29:52.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.489+0000 7f97fd80a700 1 -- 172.21.15.8:0/1558207454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f80f77d0 msgr2=0x7f97f8109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:52.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.489+0000 7f97fd80a700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f80f77d0 0x7f97f8109470 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f97e4009990 tx=0x7f97e4009b30).stop 2023-10-18T21:29:52.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.489+0000 7f97fd80a700 1 -- 172.21.15.8:0/1558207454 shutdown_connections 2023-10-18T21:29:52.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.489+0000 7f97fd80a700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97e8060f70 0x7f97e8063430 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.489+0000 7f97fd80a700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f80f6530 0x7f97f8108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.489+0000 7f97fd80a700 1 --2- 172.21.15.8:0/1558207454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f80f77d0 0x7f97f8109470 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.489+0000 7f97fd80a700 1 -- 172.21.15.8:0/1558207454 >> 172.21.15.8:0/1558207454 conn(0x7f97f80f1c90 msgr2=0x7f97f806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:52.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.489+0000 7f97fd80a700 1 -- 172.21.15.8:0/1558207454 shutdown_connections 2023-10-18T21:29:52.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.490+0000 7f97fd80a700 1 -- 172.21.15.8:0/1558207454 wait complete. 2023-10-18T21:29:52.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.627+0000 7f4e21bb8700 1 -- 172.21.15.8:0/1282775582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e1c0f77d0 msgr2=0x7f4e1c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:52.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.627+0000 7f4e21bb8700 1 --2- 172.21.15.8:0/1282775582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e1c0f77d0 0x7f4e1c0f7c30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f4e08004660 tx=0x7f4e08009b30).stop 2023-10-18T21:29:52.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.627+0000 7f4e21bb8700 1 -- 172.21.15.8:0/1282775582 shutdown_connections 2023-10-18T21:29:52.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.627+0000 7f4e21bb8700 1 --2- 172.21.15.8:0/1282775582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e1c0f77d0 0x7f4e1c0f7c30 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.627+0000 7f4e21bb8700 1 --2- 172.21.15.8:0/1282775582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e1c0f6530 0x7f4e1c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.627+0000 7f4e21bb8700 1 -- 172.21.15.8:0/1282775582 >> 172.21.15.8:0/1282775582 conn(0x7f4e1c0f1c90 msgr2=0x7f4e1c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:52.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.627+0000 7f4e21bb8700 1 -- 172.21.15.8:0/1282775582 shutdown_connections 2023-10-18T21:29:52.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.627+0000 7f4e21bb8700 1 -- 172.21.15.8:0/1282775582 wait complete. 2023-10-18T21:29:52.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.628+0000 7f4e21bb8700 1 Processor -- start 2023-10-18T21:29:52.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.628+0000 7f4e21bb8700 1 -- start start 2023-10-18T21:29:52.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.628+0000 7f4e21bb8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e1c0f6530 0x7f4e1c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:52.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.628+0000 7f4e21bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e1c0f77d0 0x7f4e1c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.628+0000 7f4e21bb8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c109a20 con 0x7f4e1c0f6530 2023-10-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.628+0000 7f4e21bb8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c109b60 con 0x7f4e1c0f77d0 2023-10-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.629+0000 7f4e20bb6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e1c0f6530 0x7f4e1c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.629+0000 7f4e20bb6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e1c0f6530 0x7f4e1c108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46704/0 (socket says 172.21.15.8:46704) 2023-10-18T21:29:52.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.629+0000 7f4e20bb6700 1 -- 172.21.15.8:0/301900494 learned_addr learned my addr 172.21.15.8:0/301900494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:52.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.629+0000 7f4e20bb6700 1 -- 172.21.15.8:0/301900494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e1c0f77d0 msgr2=0x7f4e1c109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:52.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.629+0000 7f4e20bb6700 1 --2- 172.21.15.8:0/301900494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e1c0f77d0 0x7f4e1c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:29:52.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.629+0000 7f4e20bb6700 1 -- 172.21.15.8:0/301900494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08005040 con 0x7f4e1c0f6530 2023-10-18T21:29:52.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.629+0000 7f4e20bb6700 1 --2- 172.21.15.8:0/301900494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e1c0f6530 0x7f4e1c108f80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f4e10002700 tx=0x7f4e10009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:52.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.629+0000 7f4e197fa700 1 -- 172.21.15.8:0/301900494 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e10009320 con 0x7f4e1c0f6530 2023-10-18T21:29:52.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.629+0000 7f4e197fa700 1 -- 172.21.15.8:0/301900494 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4e1000f040 con 0x7f4e1c0f6530 2023-10-18T21:29:52.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.629+0000 7f4e197fa700 1 -- 172.21.15.8:0/301900494 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e10014970 con 0x7f4e1c0f6530 2023-10-18T21:29:52.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.630+0000 7f4e21bb8700 1 -- 172.21.15.8:0/301900494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c10a500 con 0x7f4e1c0f6530 2023-10-18T21:29:52.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.630+0000 7f4e21bb8700 1 -- 172.21.15.8:0/301900494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c10aac0 con 0x7f4e1c0f6530 2023-10-18T21:29:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.631+0000 7f4e21bb8700 1 -- 172.21.15.8:0/301900494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c045ad0 con 0x7f4e1c0f6530 2023-10-18T21:29:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.632+0000 7f4e197fa700 1 -- 172.21.15.8:0/301900494 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4e10009480 con 0x7f4e1c0f6530 2023-10-18T21:29:52.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.633+0000 7f4e197fa700 1 --2- 172.21.15.8:0/301900494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e0c060f70 0x7f4e0c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:52.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.633+0000 7f4e197fa700 1 -- 172.21.15.8:0/301900494 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4e1007cc40 con 0x7f4e1c0f6530 2023-10-18T21:29:52.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.633+0000 7f4e1bfff700 1 --2- 172.21.15.8:0/301900494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e0c060f70 0x7f4e0c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:52.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.634+0000 7f4e1bfff700 1 --2- 172.21.15.8:0/301900494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e0c060f70 0x7f4e0c063430 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f4e08000c00 tx=0x7f4e08009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:52.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.637+0000 7f4e197fa700 1 -- 172.21.15.8:0/301900494 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4e10050220 con 0x7f4e1c0f6530 2023-10-18T21:29:52.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:51.382099+0000 mgr.smithi008.flmjzp (mgr.14640) 1861 : audit [DBG] from='client.35656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:51.733783+0000 mgr.smithi008.flmjzp (mgr.14640) 1862 : audit [DBG] from='client.35660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:52.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:51.382099+0000 mgr.smithi008.flmjzp (mgr.14640) 1861 : audit [DBG] from='client.35656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:52.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:51.733783+0000 mgr.smithi008.flmjzp (mgr.14640) 1862 : audit [DBG] from='client.35660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:52.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.866+0000 7f4e21bb8700 1 -- 172.21.15.8:0/301900494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4e1c10ad40 con 0x7f4e1c0f6530 2023-10-18T21:29:52.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.866+0000 7f4e197fa700 1 -- 172.21.15.8:0/301900494 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f4e1004fe10 con 0x7f4e1c0f6530 2023-10-18T21:29:52.867 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:29:52.868 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:29:52.868 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:29:52.868 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:29:52.868 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:29:52.868 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:29:52.869 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:29:52.869 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:29:52.869 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:29:52.869 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:29:52.869 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:29:52.870 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:29:52.870 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:29:52.870 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:29:52.870 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:29:52.870 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:29:52.871 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:29:52.871 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:29:52.871 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:29:52.871 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:29:52.871 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:29:52.872 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:29:52.872 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:29:52.872 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:29:52.872 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:29:52.872 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:29:52.873 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:29:52.873 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:29:52.873 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:29:52.873 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:29:52.873 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:29:52.874 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:29:52.874 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:29:52.874 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:29:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 -- 172.21.15.8:0/301900494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e0c060f70 msgr2=0x7f4e0c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 --2- 172.21.15.8:0/301900494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e0c060f70 0x7f4e0c063430 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f4e08000c00 tx=0x7f4e08009b30).stop 2023-10-18T21:29:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 -- 172.21.15.8:0/301900494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e1c0f6530 msgr2=0x7f4e1c108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 --2- 172.21.15.8:0/301900494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e1c0f6530 0x7f4e1c108f80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f4e10002700 tx=0x7f4e10009d80).stop 2023-10-18T21:29:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 -- 172.21.15.8:0/301900494 shutdown_connections 2023-10-18T21:29:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 --2- 172.21.15.8:0/301900494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e0c060f70 0x7f4e0c063430 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 --2- 172.21.15.8:0/301900494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e1c0f6530 0x7f4e1c108f80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 --2- 172.21.15.8:0/301900494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e1c0f77d0 0x7f4e1c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:29:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 -- 172.21.15.8:0/301900494 >> 172.21.15.8:0/301900494 conn(0x7f4e1c0f1c90 msgr2=0x7f4e1c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 -- 172.21.15.8:0/301900494 shutdown_connections 2023-10-18T21:29:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:52.868+0000 7f4e21bb8700 1 -- 172.21.15.8:0/301900494 wait complete. 2023-10-18T21:29:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:29:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.005+0000 7f1f7ffff700 1 -- 172.21.15.8:0/1886772920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f800f6530 msgr2=0x7f1f800f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.005+0000 7f1f7ffff700 1 --2- 172.21.15.8:0/1886772920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f800f6530 0x7f1f800f6950 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f1f70004660 tx=0x7f1f70009b30).stop 2023-10-18T21:29:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.005+0000 7f1f7ffff700 1 -- 172.21.15.8:0/1886772920 shutdown_connections 2023-10-18T21:29:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.005+0000 7f1f7ffff700 1 --2- 172.21.15.8:0/1886772920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f800f77d0 0x7f1f800f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.005+0000 7f1f7ffff700 1 --2- 172.21.15.8:0/1886772920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f800f6530 0x7f1f800f6950 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.005+0000 7f1f7ffff700 1 -- 172.21.15.8:0/1886772920 >> 172.21.15.8:0/1886772920 conn(0x7f1f800f1c90 msgr2=0x7f1f800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.006+0000 7f1f7ffff700 1 -- 172.21.15.8:0/1886772920 shutdown_connections 2023-10-18T21:29:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.006+0000 7f1f7ffff700 1 -- 172.21.15.8:0/1886772920 wait complete. 2023-10-18T21:29:53.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.006+0000 7f1f7ffff700 1 Processor -- start 2023-10-18T21:29:53.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.007+0000 7f1f7ffff700 1 -- start start 2023-10-18T21:29:53.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.007+0000 7f1f7ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f800f6530 0x7f1f8006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:53.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.007+0000 7f1f7ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f800f77d0 0x7f1f80069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:53.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.007+0000 7f1f7ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8006a380 con 0x7f1f800f6530 2023-10-18T21:29:53.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.007+0000 7f1f7ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8006a4c0 con 0x7f1f800f77d0 2023-10-18T21:29:53.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.007+0000 7f1f7effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f800f6530 0x7f1f8006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:53.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.007+0000 7f1f7e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f800f77d0 0x7f1f80069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:53.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.007+0000 7f1f7effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f800f6530 0x7f1f8006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46728/0 (socket says 172.21.15.8:46728) 2023-10-18T21:29:53.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.007+0000 7f1f7effd700 1 -- 172.21.15.8:0/474557827 learned_addr learned my addr 172.21.15.8:0/474557827 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:29:53.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.008+0000 7f1f7effd700 1 -- 172.21.15.8:0/474557827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f800f77d0 msgr2=0x7f1f80069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:53.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.008+0000 7f1f7effd700 1 --2- 172.21.15.8:0/474557827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f800f77d0 0x7f1f80069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:53.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.008+0000 7f1f7effd700 1 -- 172.21.15.8:0/474557827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f70005040 con 0x7f1f800f6530 2023-10-18T21:29:53.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.008+0000 7f1f7effd700 1 --2- 172.21.15.8:0/474557827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f800f6530 0x7f1f8006b9a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f1f70007a60 tx=0x7f1f70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:53.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.008+0000 7f1f677fe700 1 -- 172.21.15.8:0/474557827 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f70018070 con 0x7f1f800f6530 2023-10-18T21:29:53.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.008+0000 7f1f677fe700 1 -- 172.21.15.8:0/474557827 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1f70009630 con 0x7f1f800f6530 2023-10-18T21:29:53.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.008+0000 7f1f7ffff700 1 -- 172.21.15.8:0/474557827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8006a740 con 0x7f1f800f6530 2023-10-18T21:29:53.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.008+0000 7f1f677fe700 1 -- 172.21.15.8:0/474557827 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f7001c4d0 con 0x7f1f800f6530 2023-10-18T21:29:53.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.008+0000 7f1f7ffff700 1 -- 172.21.15.8:0/474557827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8006aca0 con 0x7f1f800f6530 2023-10-18T21:29:53.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.009+0000 7f1f7ffff700 1 -- 172.21.15.8:0/474557827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f80045ad0 con 0x7f1f800f6530 2023-10-18T21:29:53.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.010+0000 7f1f677fe700 1 -- 172.21.15.8:0/474557827 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1f7001d420 con 0x7f1f800f6530 2023-10-18T21:29:53.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.011+0000 7f1f677fe700 1 --2- 172.21.15.8:0/474557827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f68060f70 0x7f1f68063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:29:53.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.011+0000 7f1f677fe700 1 -- 172.21.15.8:0/474557827 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1f7007e590 con 0x7f1f800f6530 2023-10-18T21:29:53.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.011+0000 7f1f7e7fc700 1 --2- 172.21.15.8:0/474557827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f68060f70 0x7f1f68063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:29:53.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.012+0000 7f1f7e7fc700 1 --2- 172.21.15.8:0/474557827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f68060f70 0x7f1f68063430 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f1f74004e20 tx=0x7f1f7400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:29:53.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.015+0000 7f1f677fe700 1 -- 172.21.15.8:0/474557827 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1f7004e270 con 0x7f1f800f6530 2023-10-18T21:29:53.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.212+0000 7f1f7ffff700 1 -- 172.21.15.8:0/474557827 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f800fee00 con 0x7f1f68060f70 2023-10-18T21:29:53.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.214+0000 7f1f677fe700 1 -- 172.21.15.8:0/474557827 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1f800fee00 con 0x7f1f68060f70 2023-10-18T21:29:53.214 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:29:53.215 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:29:53.215 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:29:53.215 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:29:53.215 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:29:53.215 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:29:53.216 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:29:53.216 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:29:53.216 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:29:53.216 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:29:53.216 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:29:53.217 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:29:53.217 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:29:53.217 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:29:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 -- 172.21.15.8:0/474557827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f68060f70 msgr2=0x7f1f68063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 --2- 172.21.15.8:0/474557827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f68060f70 0x7f1f68063430 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f1f74004e20 tx=0x7f1f7400b040).stop 2023-10-18T21:29:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 -- 172.21.15.8:0/474557827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f800f6530 msgr2=0x7f1f8006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:29:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 --2- 172.21.15.8:0/474557827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f800f6530 0x7f1f8006b9a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f1f70007a60 tx=0x7f1f70009b30).stop 2023-10-18T21:29:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 -- 172.21.15.8:0/474557827 shutdown_connections 2023-10-18T21:29:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 --2- 172.21.15.8:0/474557827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f68060f70 0x7f1f68063430 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:53.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 --2- 172.21.15.8:0/474557827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f800f6530 0x7f1f8006b9a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:53.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 --2- 172.21.15.8:0/474557827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f800f77d0 0x7f1f80069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:29:53.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 -- 172.21.15.8:0/474557827 >> 172.21.15.8:0/474557827 conn(0x7f1f800f1c90 msgr2=0x7f1f800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:29:53.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 -- 172.21.15.8:0/474557827 shutdown_connections 2023-10-18T21:29:53.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:29:53.216+0000 7f1f7ffff700 1 -- 172.21.15.8:0/474557827 wait complete. 2023-10-18T21:29:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:52.073780+0000 mgr.smithi008.flmjzp (mgr.14640) 1863 : audit [DBG] from='client.35664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:52.487624+0000 mon.smithi008 (mon.0) 2311 : audit [DBG] from='client.? 172.21.15.8:0/1558207454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:52.554789+0000 mgr.smithi008.flmjzp (mgr.14640) 1864 : cluster [DBG] pgmap v1289: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:52.866850+0000 mon.smithi008 (mon.0) 2312 : audit [DBG] from='client.? 172.21.15.8:0/301900494' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:29:53.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:52.073780+0000 mgr.smithi008.flmjzp (mgr.14640) 1863 : audit [DBG] from='client.35664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:53.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:52.487624+0000 mon.smithi008 (mon.0) 2311 : audit [DBG] from='client.? 172.21.15.8:0/1558207454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:52.554789+0000 mgr.smithi008.flmjzp (mgr.14640) 1864 : cluster [DBG] pgmap v1289: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:52.866850+0000 mon.smithi008 (mon.0) 2312 : audit [DBG] from='client.? 172.21.15.8:0/301900494' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:29:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:53.213882+0000 mgr.smithi008.flmjzp (mgr.14640) 1865 : audit [DBG] from='client.35676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:54.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:53.213882+0000 mgr.smithi008.flmjzp (mgr.14640) 1865 : audit [DBG] from='client.35676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:29:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:54.555510+0000 mgr.smithi008.flmjzp (mgr.14640) 1866 : cluster [DBG] pgmap v1290: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:55.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:54.555510+0000 mgr.smithi008.flmjzp (mgr.14640) 1866 : cluster [DBG] pgmap v1290: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:56.583554+0000 mon.smithi008 (mon.0) 2313 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:56.585793+0000 mon.smithi008 (mon.0) 2314 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:56.586925+0000 mon.smithi008 (mon.0) 2315 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:56.593920+0000 mon.smithi008 (mon.0) 2316 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:56.600368+0000 mon.smithi008 (mon.0) 2317 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:56.604048+0000 mon.smithi008 (mon.0) 2318 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:56.606099+0000 mon.smithi008 (mon.0) 2319 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:56.608088+0000 mon.smithi008 (mon.0) 2320 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:29:56.612234+0000 mon.smithi008 (mon.0) 2321 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:56.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:56.583554+0000 mon.smithi008 (mon.0) 2313 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:56.585793+0000 mon.smithi008 (mon.0) 2314 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:29:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:56.586925+0000 mon.smithi008 (mon.0) 2315 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:29:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:56.593920+0000 mon.smithi008 (mon.0) 2316 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:29:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:56.600368+0000 mon.smithi008 (mon.0) 2317 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:29:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:56.604048+0000 mon.smithi008 (mon.0) 2318 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:56.606099+0000 mon.smithi008 (mon.0) 2319 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:56.608088+0000 mon.smithi008 (mon.0) 2320 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:29:56.612234+0000 mon.smithi008 (mon.0) 2321 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:29:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:56.556090+0000 mgr.smithi008.flmjzp (mgr.14640) 1867 : cluster [DBG] pgmap v1291: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:56.587852+0000 mgr.smithi008.flmjzp (mgr.14640) 1868 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:56.588409+0000 mgr.smithi008.flmjzp (mgr.14640) 1869 : cluster [DBG] pgmap v1292: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:56.588714+0000 mgr.smithi008.flmjzp (mgr.14640) 1870 : cluster [DBG] pgmap v1293: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:29:56.614298+0000 mgr.smithi008.flmjzp (mgr.14640) 1871 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:57.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:56.556090+0000 mgr.smithi008.flmjzp (mgr.14640) 1867 : cluster [DBG] pgmap v1291: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:56.587852+0000 mgr.smithi008.flmjzp (mgr.14640) 1868 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:29:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:56.588409+0000 mgr.smithi008.flmjzp (mgr.14640) 1869 : cluster [DBG] pgmap v1292: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:56.588714+0000 mgr.smithi008.flmjzp (mgr.14640) 1870 : cluster [DBG] pgmap v1293: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:29:56.614298+0000 mgr.smithi008.flmjzp (mgr.14640) 1871 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:29:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:29:58.589241+0000 mgr.smithi008.flmjzp (mgr.14640) 1872 : cluster [DBG] pgmap v1294: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:29:59.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:29:58.589241+0000 mgr.smithi008.flmjzp (mgr.14640) 1872 : cluster [DBG] pgmap v1294: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:00.000217+0000 mon.smithi008 (mon.0) 2322 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T21:30:00.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:00.000217+0000 mon.smithi008 (mon.0) 2322 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T21:30:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:00.589952+0000 mgr.smithi008.flmjzp (mgr.14640) 1873 : cluster [DBG] pgmap v1295: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:01.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:00.589952+0000 mgr.smithi008.flmjzp (mgr.14640) 1873 : cluster [DBG] pgmap v1295: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:02.590596+0000 mgr.smithi008.flmjzp (mgr.14640) 1874 : cluster [DBG] pgmap v1296: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:03.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:02.590596+0000 mgr.smithi008.flmjzp (mgr.14640) 1874 : cluster [DBG] pgmap v1296: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:04.591160+0000 mgr.smithi008.flmjzp (mgr.14640) 1875 : cluster [DBG] pgmap v1297: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:05.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:04.591160+0000 mgr.smithi008.flmjzp (mgr.14640) 1875 : cluster [DBG] pgmap v1297: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:06.623556+0000 mon.smithi008 (mon.0) 2323 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:06.625750+0000 mon.smithi008 (mon.0) 2324 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:06.626749+0000 mon.smithi008 (mon.0) 2325 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:06.633730+0000 mon.smithi008 (mon.0) 2326 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:06.640142+0000 mon.smithi008 (mon.0) 2327 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:06.643240+0000 mon.smithi008 (mon.0) 2328 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:06.644883+0000 mon.smithi008 (mon.0) 2329 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:06.646488+0000 mon.smithi008 (mon.0) 2330 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:06.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:06.648423+0000 mon.smithi008 (mon.0) 2331 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:06.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:06.623556+0000 mon.smithi008 (mon.0) 2323 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:06.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:06.625750+0000 mon.smithi008 (mon.0) 2324 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:06.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:06.626749+0000 mon.smithi008 (mon.0) 2325 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:06.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:06.633730+0000 mon.smithi008 (mon.0) 2326 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:06.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:06.640142+0000 mon.smithi008 (mon.0) 2327 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:06.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:06.643240+0000 mon.smithi008 (mon.0) 2328 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:06.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:06.644883+0000 mon.smithi008 (mon.0) 2329 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:06.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:06.646488+0000 mon.smithi008 (mon.0) 2330 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:06.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:06.648423+0000 mon.smithi008 (mon.0) 2331 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:06.591827+0000 mgr.smithi008.flmjzp (mgr.14640) 1876 : cluster [DBG] pgmap v1298: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:06.627629+0000 mgr.smithi008.flmjzp (mgr.14640) 1877 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:06.628147+0000 mgr.smithi008.flmjzp (mgr.14640) 1878 : cluster [DBG] pgmap v1299: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:06.628443+0000 mgr.smithi008.flmjzp (mgr.14640) 1879 : cluster [DBG] pgmap v1300: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:06.650281+0000 mgr.smithi008.flmjzp (mgr.14640) 1880 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:07.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:06.591827+0000 mgr.smithi008.flmjzp (mgr.14640) 1876 : cluster [DBG] pgmap v1298: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:06.627629+0000 mgr.smithi008.flmjzp (mgr.14640) 1877 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:06.628147+0000 mgr.smithi008.flmjzp (mgr.14640) 1878 : cluster [DBG] pgmap v1299: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:06.628443+0000 mgr.smithi008.flmjzp (mgr.14640) 1879 : cluster [DBG] pgmap v1300: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:06.650281+0000 mgr.smithi008.flmjzp (mgr.14640) 1880 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:08.629009+0000 mgr.smithi008.flmjzp (mgr.14640) 1881 : cluster [DBG] pgmap v1301: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:09.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:08.629009+0000 mgr.smithi008.flmjzp (mgr.14640) 1881 : cluster [DBG] pgmap v1301: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:10.629671+0000 mgr.smithi008.flmjzp (mgr.14640) 1882 : cluster [DBG] pgmap v1302: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:10.629671+0000 mgr.smithi008.flmjzp (mgr.14640) 1882 : cluster [DBG] pgmap v1302: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:12.630344+0000 mgr.smithi008.flmjzp (mgr.14640) 1883 : cluster [DBG] pgmap v1303: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:13.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:12.630344+0000 mgr.smithi008.flmjzp (mgr.14640) 1883 : cluster [DBG] pgmap v1303: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:15.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:14.631144+0000 mgr.smithi008.flmjzp (mgr.14640) 1884 : cluster [DBG] pgmap v1304: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:14.631144+0000 mgr.smithi008.flmjzp (mgr.14640) 1884 : cluster [DBG] pgmap v1304: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:16.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:16.660121+0000 mon.smithi008 (mon.0) 2332 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:16.662167+0000 mon.smithi008 (mon.0) 2333 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:16.663186+0000 mon.smithi008 (mon.0) 2334 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:16.669302+0000 mon.smithi008 (mon.0) 2335 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:16.675223+0000 mon.smithi008 (mon.0) 2336 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:16.677981+0000 mon.smithi008 (mon.0) 2337 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:16.679781+0000 mon.smithi008 (mon.0) 2338 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:16.681242+0000 mon.smithi008 (mon.0) 2339 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:16.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:16.683025+0000 mon.smithi008 (mon.0) 2340 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:17.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:16.660121+0000 mon.smithi008 (mon.0) 2332 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:17.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:16.662167+0000 mon.smithi008 (mon.0) 2333 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:17.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:16.663186+0000 mon.smithi008 (mon.0) 2334 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:16.669302+0000 mon.smithi008 (mon.0) 2335 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:16.675223+0000 mon.smithi008 (mon.0) 2336 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:16.677981+0000 mon.smithi008 (mon.0) 2337 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:16.679781+0000 mon.smithi008 (mon.0) 2338 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:17.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:16.681242+0000 mon.smithi008 (mon.0) 2339 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:17.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:16.683025+0000 mon.smithi008 (mon.0) 2340 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:17.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:16.631662+0000 mgr.smithi008.flmjzp (mgr.14640) 1885 : cluster [DBG] pgmap v1305: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:16.664066+0000 mgr.smithi008.flmjzp (mgr.14640) 1886 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:16.664629+0000 mgr.smithi008.flmjzp (mgr.14640) 1887 : cluster [DBG] pgmap v1306: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:16.664877+0000 mgr.smithi008.flmjzp (mgr.14640) 1888 : cluster [DBG] pgmap v1307: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:16.684775+0000 mgr.smithi008.flmjzp (mgr.14640) 1889 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:18.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:16.631662+0000 mgr.smithi008.flmjzp (mgr.14640) 1885 : cluster [DBG] pgmap v1305: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:18.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:16.664066+0000 mgr.smithi008.flmjzp (mgr.14640) 1886 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:18.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:16.664629+0000 mgr.smithi008.flmjzp (mgr.14640) 1887 : cluster [DBG] pgmap v1306: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:18.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:16.664877+0000 mgr.smithi008.flmjzp (mgr.14640) 1888 : cluster [DBG] pgmap v1307: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:18.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:16.684775+0000 mgr.smithi008.flmjzp (mgr.14640) 1889 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:18.665398+0000 mgr.smithi008.flmjzp (mgr.14640) 1890 : cluster [DBG] pgmap v1308: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:20.160 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:18.665398+0000 mgr.smithi008.flmjzp (mgr.14640) 1890 : cluster [DBG] pgmap v1308: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:21.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:20.666068+0000 mgr.smithi008.flmjzp (mgr.14640) 1891 : cluster [DBG] pgmap v1309: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:20.666068+0000 mgr.smithi008.flmjzp (mgr.14640) 1891 : cluster [DBG] pgmap v1309: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:23.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.371+0000 7fce9b59e700 1 -- 172.21.15.8:0/3559956143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0f77d0 msgr2=0x7fce9c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:23.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.371+0000 7fce9b59e700 1 --2- 172.21.15.8:0/3559956143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0f77d0 0x7fce9c0f7c30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fce90004660 tx=0x7fce90009b30).stop 2023-10-18T21:30:23.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.371+0000 7fce9b59e700 1 -- 172.21.15.8:0/3559956143 shutdown_connections 2023-10-18T21:30:23.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.371+0000 7fce9b59e700 1 --2- 172.21.15.8:0/3559956143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0f77d0 0x7fce9c0f7c30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.371+0000 7fce9b59e700 1 --2- 172.21.15.8:0/3559956143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9c0f6530 0x7fce9c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.371+0000 7fce9b59e700 1 -- 172.21.15.8:0/3559956143 >> 172.21.15.8:0/3559956143 conn(0x7fce9c0f1c90 msgr2=0x7fce9c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:23.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.371+0000 7fce9b59e700 1 -- 172.21.15.8:0/3559956143 shutdown_connections 2023-10-18T21:30:23.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.371+0000 7fce9b59e700 1 -- 172.21.15.8:0/3559956143 wait complete. 2023-10-18T21:30:23.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.372+0000 7fce9b59e700 1 Processor -- start 2023-10-18T21:30:23.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.372+0000 7fce9b59e700 1 -- start start 2023-10-18T21:30:23.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.372+0000 7fce9b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0f6530 0x7fce9c108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:23.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.372+0000 7fce9b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9c0f77d0 0x7fce9c109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:23.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.372+0000 7fce9b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c1099f0 con 0x7fce9c0f6530 2023-10-18T21:30:23.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.372+0000 7fce9b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c109b30 con 0x7fce9c0f77d0 2023-10-18T21:30:23.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.373+0000 7fce9a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0f6530 0x7fce9c108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:23.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.373+0000 7fce9a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0f6530 0x7fce9c108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35212/0 (socket says 172.21.15.8:35212) 2023-10-18T21:30:23.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.373+0000 7fce9a59c700 1 -- 172.21.15.8:0/2405276693 learned_addr learned my addr 172.21.15.8:0/2405276693 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:23.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.373+0000 7fce99d9b700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9c0f77d0 0x7fce9c109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:23.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.373+0000 7fce9a59c700 1 -- 172.21.15.8:0/2405276693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9c0f77d0 msgr2=0x7fce9c109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:23.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.373+0000 7fce9a59c700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9c0f77d0 0x7fce9c109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.373+0000 7fce9a59c700 1 -- 172.21.15.8:0/2405276693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90005040 con 0x7fce9c0f6530 2023-10-18T21:30:23.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.373+0000 7fce99d9b700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9c0f77d0 0x7fce9c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:30:23.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.373+0000 7fce9a59c700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0f6530 0x7fce9c108f50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fce8c002700 tx=0x7fce8c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:23.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.374+0000 7fce8affd700 1 -- 172.21.15.8:0/2405276693 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8c009320 con 0x7fce9c0f6530 2023-10-18T21:30:23.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.374+0000 7fce8affd700 1 -- 172.21.15.8:0/2405276693 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fce8c00f040 con 0x7fce9c0f6530 2023-10-18T21:30:23.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.374+0000 7fce9b59e700 1 -- 172.21.15.8:0/2405276693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c10a4d0 con 0x7fce9c0f6530 2023-10-18T21:30:23.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.374+0000 7fce8affd700 1 -- 172.21.15.8:0/2405276693 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8c014970 con 0x7fce9c0f6530 2023-10-18T21:30:23.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.374+0000 7fce9b59e700 1 -- 172.21.15.8:0/2405276693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c10aa90 con 0x7fce9c0f6530 2023-10-18T21:30:23.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.375+0000 7fce9b59e700 1 -- 172.21.15.8:0/2405276693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c045ad0 con 0x7fce9c0f6530 2023-10-18T21:30:23.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.376+0000 7fce8affd700 1 -- 172.21.15.8:0/2405276693 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fce8c009480 con 0x7fce9c0f6530 2023-10-18T21:30:23.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.376+0000 7fce8affd700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce84060f70 0x7fce84063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:23.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.377+0000 7fce8affd700 1 -- 172.21.15.8:0/2405276693 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fce8c07cad0 con 0x7fce9c0f6530 2023-10-18T21:30:23.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.377+0000 7fce99d9b700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce84060f70 0x7fce84063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:23.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.377+0000 7fce99d9b700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce84060f70 0x7fce84063430 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fce90005010 tx=0x7fce90009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:23.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.381+0000 7fce8affd700 1 -- 172.21.15.8:0/2405276693 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fce8c0501f0 con 0x7fce9c0f6530 2023-10-18T21:30:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.583+0000 7fce9b59e700 1 -- 172.21.15.8:0/2405276693 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce9c10ad60 con 0x7fce84060f70 2023-10-18T21:30:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.584+0000 7fce8affd700 1 -- 172.21.15.8:0/2405276693 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fce9c10ad60 con 0x7fce84060f70 2023-10-18T21:30:23.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.586+0000 7fce9b59e700 1 -- 172.21.15.8:0/2405276693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce84060f70 msgr2=0x7fce84063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:23.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.586+0000 7fce9b59e700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce84060f70 0x7fce84063430 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fce90005010 tx=0x7fce90009b30).stop 2023-10-18T21:30:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.586+0000 7fce9b59e700 1 -- 172.21.15.8:0/2405276693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0f6530 msgr2=0x7fce9c108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.586+0000 7fce9b59e700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0f6530 0x7fce9c108f50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fce8c002700 tx=0x7fce8c009d80).stop 2023-10-18T21:30:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.586+0000 7fce9b59e700 1 -- 172.21.15.8:0/2405276693 shutdown_connections 2023-10-18T21:30:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.586+0000 7fce9b59e700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce84060f70 0x7fce84063430 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.586+0000 7fce9b59e700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0f6530 0x7fce9c108f50 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.586+0000 7fce9b59e700 1 --2- 172.21.15.8:0/2405276693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9c0f77d0 0x7fce9c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.586+0000 7fce9b59e700 1 -- 172.21.15.8:0/2405276693 >> 172.21.15.8:0/2405276693 conn(0x7fce9c0f1c90 msgr2=0x7fce9c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.586+0000 7fce9b59e700 1 -- 172.21.15.8:0/2405276693 shutdown_connections 2023-10-18T21:30:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.587+0000 7fce9b59e700 1 -- 172.21.15.8:0/2405276693 wait complete. 2023-10-18T21:30:23.601 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:30:23.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.725+0000 7f27b514c700 1 -- 172.21.15.8:0/663236306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27b00f6530 msgr2=0x7f27b00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:23.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.725+0000 7f27b514c700 1 --2- 172.21.15.8:0/663236306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27b00f6530 0x7f27b00f6950 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f27a0004660 tx=0x7f27a0009b30).stop 2023-10-18T21:30:23.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.725+0000 7f27b514c700 1 -- 172.21.15.8:0/663236306 shutdown_connections 2023-10-18T21:30:23.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.725+0000 7f27b514c700 1 --2- 172.21.15.8:0/663236306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27b00f77d0 0x7f27b00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.725+0000 7f27b514c700 1 --2- 172.21.15.8:0/663236306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27b00f6530 0x7f27b00f6950 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.725+0000 7f27b514c700 1 -- 172.21.15.8:0/663236306 >> 172.21.15.8:0/663236306 conn(0x7f27b00f1c70 msgr2=0x7f27b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:23.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.725+0000 7f27b514c700 1 -- 172.21.15.8:0/663236306 shutdown_connections 2023-10-18T21:30:23.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.725+0000 7f27b514c700 1 -- 172.21.15.8:0/663236306 wait complete. 2023-10-18T21:30:23.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.726+0000 7f27b514c700 1 Processor -- start 2023-10-18T21:30:23.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.726+0000 7f27b514c700 1 -- start start 2023-10-18T21:30:23.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.726+0000 7f27b514c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27b00f6530 0x7f27b0106e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:23.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.726+0000 7f27b514c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27b00f77d0 0x7f27b0107330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:23.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.726+0000 7f27b514c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0107930 con 0x7f27b00f6530 2023-10-18T21:30:23.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.726+0000 7f27b514c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0108140 con 0x7f27b00f77d0 2023-10-18T21:30:23.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.727+0000 7f27affff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27b00f6530 0x7f27b0106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:23.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.727+0000 7f27affff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27b00f6530 0x7f27b0106e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35228/0 (socket says 172.21.15.8:35228) 2023-10-18T21:30:23.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.727+0000 7f27affff700 1 -- 172.21.15.8:0/2379624790 learned_addr learned my addr 172.21.15.8:0/2379624790 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:23.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.727+0000 7f27af7fe700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27b00f77d0 0x7f27b0107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:23.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.727+0000 7f27affff700 1 -- 172.21.15.8:0/2379624790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27b00f77d0 msgr2=0x7f27b0107330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:23.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.727+0000 7f27affff700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27b00f77d0 0x7f27b0107330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.727+0000 7f27affff700 1 -- 172.21.15.8:0/2379624790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a0005040 con 0x7f27b00f6530 2023-10-18T21:30:23.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.727+0000 7f27affff700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27b00f6530 0x7f27b0106e40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f27a0004e30 tx=0x7f27a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:23.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.727+0000 7f27acff9700 1 -- 172.21.15.8:0/2379624790 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27a0018070 con 0x7f27b00f6530 2023-10-18T21:30:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.728+0000 7f27acff9700 1 -- 172.21.15.8:0/2379624790 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f27a0009630 con 0x7f27b00f6530 2023-10-18T21:30:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.728+0000 7f27b514c700 1 -- 172.21.15.8:0/2379624790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b0108360 con 0x7f27b00f6530 2023-10-18T21:30:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.728+0000 7f27acff9700 1 -- 172.21.15.8:0/2379624790 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27a001c3c0 con 0x7f27b00f6530 2023-10-18T21:30:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.728+0000 7f27b514c700 1 -- 172.21.15.8:0/2379624790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b01088c0 con 0x7f27b00f6530 2023-10-18T21:30:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.729+0000 7f27b514c700 1 -- 172.21.15.8:0/2379624790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b0059100 con 0x7f27b00f6530 2023-10-18T21:30:23.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.730+0000 7f27acff9700 1 -- 172.21.15.8:0/2379624790 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f27a001d420 con 0x7f27b00f6530 2023-10-18T21:30:23.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.730+0000 7f27acff9700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2798060f70 0x7f2798063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:23.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.731+0000 7f27acff9700 1 -- 172.21.15.8:0/2379624790 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f27a007e470 con 0x7f27b00f6530 2023-10-18T21:30:23.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.731+0000 7f27af7fe700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2798060f70 0x7f2798063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:23.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.731+0000 7f27af7fe700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2798060f70 0x7f2798063430 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f27a4004c40 tx=0x7f27a400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:23.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.735+0000 7f27acff9700 1 -- 172.21.15.8:0/2379624790 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f27a004e0e0 con 0x7f27b00f6530 2023-10-18T21:30:23.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:22.666759+0000 mgr.smithi008.flmjzp (mgr.14640) 1892 : cluster [DBG] pgmap v1310: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:23.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.934+0000 7f27b514c700 1 -- 172.21.15.8:0/2379624790 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f27b00fed30 con 0x7f2798060f70 2023-10-18T21:30:23.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.936+0000 7f27acff9700 1 -- 172.21.15.8:0/2379624790 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f27b00fed30 con 0x7f2798060f70 2023-10-18T21:30:23.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 -- 172.21.15.8:0/2379624790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2798060f70 msgr2=0x7f2798063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:23.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2798060f70 0x7f2798063430 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f27a4004c40 tx=0x7f27a400b040).stop 2023-10-18T21:30:23.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 -- 172.21.15.8:0/2379624790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27b00f6530 msgr2=0x7f27b0106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:23.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27b00f6530 0x7f27b0106e40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f27a0004e30 tx=0x7f27a0009b30).stop 2023-10-18T21:30:23.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 -- 172.21.15.8:0/2379624790 shutdown_connections 2023-10-18T21:30:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2798060f70 0x7f2798063430 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27b00f6530 0x7f27b0106e40 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 --2- 172.21.15.8:0/2379624790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27b00f77d0 0x7f27b0107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 -- 172.21.15.8:0/2379624790 >> 172.21.15.8:0/2379624790 conn(0x7f27b00f1c70 msgr2=0x7f27b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 -- 172.21.15.8:0/2379624790 shutdown_connections 2023-10-18T21:30:23.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:23.938+0000 7f27b514c700 1 -- 172.21.15.8:0/2379624790 wait complete. 2023-10-18T21:30:23.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:22.666759+0000 mgr.smithi008.flmjzp (mgr.14640) 1892 : cluster [DBG] pgmap v1310: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:24.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.074+0000 7f4535ff5700 1 -- 172.21.15.8:0/3602845547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45300f77d0 msgr2=0x7f45300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:24.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.074+0000 7f4535ff5700 1 --2- 172.21.15.8:0/3602845547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45300f77d0 0x7f45300f7c30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f451c004660 tx=0x7f451c009b30).stop 2023-10-18T21:30:24.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.074+0000 7f4535ff5700 1 -- 172.21.15.8:0/3602845547 shutdown_connections 2023-10-18T21:30:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.074+0000 7f4535ff5700 1 --2- 172.21.15.8:0/3602845547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45300f77d0 0x7f45300f7c30 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.074+0000 7f4535ff5700 1 --2- 172.21.15.8:0/3602845547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45300f6530 0x7f45300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.074+0000 7f4535ff5700 1 -- 172.21.15.8:0/3602845547 >> 172.21.15.8:0/3602845547 conn(0x7f45300f1c90 msgr2=0x7f45300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.074+0000 7f4535ff5700 1 -- 172.21.15.8:0/3602845547 shutdown_connections 2023-10-18T21:30:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.074+0000 7f4535ff5700 1 -- 172.21.15.8:0/3602845547 wait complete. 2023-10-18T21:30:24.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.075+0000 7f4535ff5700 1 Processor -- start 2023-10-18T21:30:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.075+0000 7f4535ff5700 1 -- start start 2023-10-18T21:30:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.075+0000 7f4535ff5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45300f6530 0x7f4530108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.075+0000 7f4535ff5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45300f77d0 0x7f4530109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.075+0000 7f4535ff5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4530109a20 con 0x7f45300f77d0 2023-10-18T21:30:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.075+0000 7f4535ff5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4530109b60 con 0x7f45300f6530 2023-10-18T21:30:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.076+0000 7f452ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45300f77d0 0x7f4530109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.076+0000 7f452ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45300f77d0 0x7f4530109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35232/0 (socket says 172.21.15.8:35232) 2023-10-18T21:30:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.076+0000 7f452ffff700 1 -- 172.21.15.8:0/199844322 learned_addr learned my addr 172.21.15.8:0/199844322 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.076+0000 7f4534ff3700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45300f6530 0x7f4530108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:24.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.076+0000 7f452ffff700 1 -- 172.21.15.8:0/199844322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45300f6530 msgr2=0x7f4530108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:24.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.076+0000 7f452ffff700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45300f6530 0x7f4530108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.076+0000 7f452ffff700 1 -- 172.21.15.8:0/199844322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c005040 con 0x7f45300f77d0 2023-10-18T21:30:24.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.076+0000 7f452ffff700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45300f77d0 0x7f4530109470 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f451c009990 tx=0x7f451c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:24.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.076+0000 7f452d7fa700 1 -- 172.21.15.8:0/199844322 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f451c018070 con 0x7f45300f77d0 2023-10-18T21:30:24.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.076+0000 7f452d7fa700 1 -- 172.21.15.8:0/199844322 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f451c009630 con 0x7f45300f77d0 2023-10-18T21:30:24.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.077+0000 7f4535ff5700 1 -- 172.21.15.8:0/199844322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453010a4a0 con 0x7f45300f77d0 2023-10-18T21:30:24.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.077+0000 7f452d7fa700 1 -- 172.21.15.8:0/199844322 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f451c01c400 con 0x7f45300f77d0 2023-10-18T21:30:24.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.077+0000 7f4535ff5700 1 -- 172.21.15.8:0/199844322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453010aa00 con 0x7f45300f77d0 2023-10-18T21:30:24.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.078+0000 7f4535ff5700 1 -- 172.21.15.8:0/199844322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4530045ad0 con 0x7f45300f77d0 2023-10-18T21:30:24.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.079+0000 7f452d7fa700 1 -- 172.21.15.8:0/199844322 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f451c01d9e0 con 0x7f45300f77d0 2023-10-18T21:30:24.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.080+0000 7f452d7fa700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4520060f70 0x7f4520063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.080+0000 7f452d7fa700 1 -- 172.21.15.8:0/199844322 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f451c07e680 con 0x7f45300f77d0 2023-10-18T21:30:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.080+0000 7f4534ff3700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4520060f70 0x7f4520063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.080+0000 7f4534ff3700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4520060f70 0x7f4520063430 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f45300f7630 tx=0x7f4524009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.084+0000 7f452d7fa700 1 -- 172.21.15.8:0/199844322 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f451c051ce0 con 0x7f45300f77d0 2023-10-18T21:30:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.279+0000 7f4535ff5700 1 -- 172.21.15.8:0/199844322 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f45300fee00 con 0x7f4520060f70 2023-10-18T21:30:24.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.289+0000 7f452d7fa700 1 -- 172.21.15.8:0/199844322 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f45300fee00 con 0x7f4520060f70 2023-10-18T21:30:24.290 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:30:24.290 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (37m) 4m ago 38m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:30:24.290 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (30m) 4m ago 38m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:30:24.291 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (30m) 2m ago 37m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:30:24.291 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (36m) 4m ago 38m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:30:24.291 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 34m - - 2023-10-18T21:30:24.291 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 34m - - 2023-10-18T21:30:24.291 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 34m - - 2023-10-18T21:30:24.291 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 34m - - 2023-10-18T21:30:24.292 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (32m) 4m ago 39m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:30:24.292 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (31m) 2m ago 37m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:30:24.292 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (31m) 4m ago 39m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:30:24.292 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (31m) 2m ago 37m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:30:24.292 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (38m) 4m ago 38m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:30:24.293 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (37m) 2m ago 37m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:30:24.293 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (30m) 4m ago 37m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:30:24.293 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (28m) 4m ago 36m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:30:24.293 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (28m) 4m ago 36m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:30:24.293 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (27m) 2m ago 36m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:30:24.294 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (26m) 2m ago 35m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:30:24.294 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (26m) 2m ago 35m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:30:24.294 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (32m) 4m ago 37m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:30:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 -- 172.21.15.8:0/199844322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4520060f70 msgr2=0x7f4520063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4520060f70 0x7f4520063430 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f45300f7630 tx=0x7f4524009c00).stop 2023-10-18T21:30:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 -- 172.21.15.8:0/199844322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45300f77d0 msgr2=0x7f4530109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45300f77d0 0x7f4530109470 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f451c009990 tx=0x7f451c009b30).stop 2023-10-18T21:30:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 -- 172.21.15.8:0/199844322 shutdown_connections 2023-10-18T21:30:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4520060f70 0x7f4520063430 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45300f6530 0x7f4530108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 --2- 172.21.15.8:0/199844322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45300f77d0 0x7f4530109470 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 -- 172.21.15.8:0/199844322 >> 172.21.15.8:0/199844322 conn(0x7f45300f1c90 msgr2=0x7f453006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 -- 172.21.15.8:0/199844322 shutdown_connections 2023-10-18T21:30:24.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.291+0000 7f4535ff5700 1 -- 172.21.15.8:0/199844322 wait complete. 2023-10-18T21:30:24.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.426+0000 7f89ad301700 1 -- 172.21.15.8:0/4213317065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80f6530 msgr2=0x7f89a80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:24.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.426+0000 7f89ad301700 1 --2- 172.21.15.8:0/4213317065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80f6530 0x7f89a80f6950 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f8998004660 tx=0x7f8998009b30).stop 2023-10-18T21:30:24.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.426+0000 7f89ad301700 1 -- 172.21.15.8:0/4213317065 shutdown_connections 2023-10-18T21:30:24.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.426+0000 7f89ad301700 1 --2- 172.21.15.8:0/4213317065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a80f77d0 0x7f89a80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.426+0000 7f89ad301700 1 --2- 172.21.15.8:0/4213317065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80f6530 0x7f89a80f6950 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.426+0000 7f89ad301700 1 -- 172.21.15.8:0/4213317065 >> 172.21.15.8:0/4213317065 conn(0x7f89a80f1c90 msgr2=0x7f89a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:24.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.426+0000 7f89ad301700 1 -- 172.21.15.8:0/4213317065 shutdown_connections 2023-10-18T21:30:24.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.426+0000 7f89ad301700 1 -- 172.21.15.8:0/4213317065 wait complete. 2023-10-18T21:30:24.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.427+0000 7f89ad301700 1 Processor -- start 2023-10-18T21:30:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.427+0000 7f89ad301700 1 -- start start 2023-10-18T21:30:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89ad301700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80f6530 0x7f89a8106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89ad301700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a80f77d0 0x7f89a8107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89ad301700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8107910 con 0x7f89a80f6530 2023-10-18T21:30:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89ad301700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8108120 con 0x7f89a80f77d0 2023-10-18T21:30:24.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80f6530 0x7f89a8106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:24.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80f6530 0x7f89a8106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35244/0 (socket says 172.21.15.8:35244) 2023-10-18T21:30:24.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89a7fff700 1 -- 172.21.15.8:0/257525168 learned_addr learned my addr 172.21.15.8:0/257525168 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:24.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89a77fe700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a80f77d0 0x7f89a8107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:24.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89a7fff700 1 -- 172.21.15.8:0/257525168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a80f77d0 msgr2=0x7f89a8107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:24.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89a7fff700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a80f77d0 0x7f89a8107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89a7fff700 1 -- 172.21.15.8:0/257525168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8998005040 con 0x7f89a80f6530 2023-10-18T21:30:24.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.428+0000 7f89a77fe700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a80f77d0 0x7f89a8107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:30:24.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.429+0000 7f89a7fff700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80f6530 0x7f89a8106e20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f8998007a60 tx=0x7f8998009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:24.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.429+0000 7f89a4ff9700 1 -- 172.21.15.8:0/257525168 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8998018070 con 0x7f89a80f6530 2023-10-18T21:30:24.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.429+0000 7f89a4ff9700 1 -- 172.21.15.8:0/257525168 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8998009630 con 0x7f89a80f6530 2023-10-18T21:30:24.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.429+0000 7f89ad301700 1 -- 172.21.15.8:0/257525168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a8108340 con 0x7f89a80f6530 2023-10-18T21:30:24.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.429+0000 7f89a4ff9700 1 -- 172.21.15.8:0/257525168 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f899801c540 con 0x7f89a80f6530 2023-10-18T21:30:24.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.429+0000 7f89ad301700 1 -- 172.21.15.8:0/257525168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a81088a0 con 0x7f89a80f6530 2023-10-18T21:30:24.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.430+0000 7f89ad301700 1 -- 172.21.15.8:0/257525168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a8059100 con 0x7f89a80f6530 2023-10-18T21:30:24.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.431+0000 7f89a4ff9700 1 -- 172.21.15.8:0/257525168 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f899801d420 con 0x7f89a80f6530 2023-10-18T21:30:24.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.432+0000 7f89a4ff9700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8990060f70 0x7f8990063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:24.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.432+0000 7f89a4ff9700 1 -- 172.21.15.8:0/257525168 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f899807e6c0 con 0x7f89a80f6530 2023-10-18T21:30:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.432+0000 7f89a77fe700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8990060f70 0x7f8990063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.433+0000 7f89a77fe700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8990060f70 0x7f8990063430 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f899c009fd0 tx=0x7f899c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.436+0000 7f89a4ff9700 1 -- 172.21.15.8:0/257525168 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f899804e2f0 con 0x7f89a80f6530 2023-10-18T21:30:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.692+0000 7f89ad301700 1 -- 172.21.15.8:0/257525168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f89a80fed60 con 0x7f89a80f6530 2023-10-18T21:30:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.693+0000 7f89a4ff9700 1 -- 172.21.15.8:0/257525168 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f8998051910 con 0x7f89a80f6530 2023-10-18T21:30:24.694 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:30:24.694 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:30:24.694 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:30:24.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:30:24.695 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:30:24.695 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:30:24.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:30:24.695 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:30:24.696 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:30:24.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:30:24.696 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:30:24.696 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:30:24.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:30:24.697 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:30:24.697 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:30:24.697 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:30:24.697 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:30:24.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 -- 172.21.15.8:0/257525168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8990060f70 msgr2=0x7f8990063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:24.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8990060f70 0x7f8990063430 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f899c009fd0 tx=0x7f899c00b040).stop 2023-10-18T21:30:24.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 -- 172.21.15.8:0/257525168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80f6530 msgr2=0x7f89a8106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:24.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80f6530 0x7f89a8106e20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f8998007a60 tx=0x7f8998009b30).stop 2023-10-18T21:30:24.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 -- 172.21.15.8:0/257525168 shutdown_connections 2023-10-18T21:30:24.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8990060f70 0x7f8990063430 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80f6530 0x7f89a8106e20 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 --2- 172.21.15.8:0/257525168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a80f77d0 0x7f89a8107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 -- 172.21.15.8:0/257525168 >> 172.21.15.8:0/257525168 conn(0x7f89a80f1c90 msgr2=0x7f89a80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:24.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 -- 172.21.15.8:0/257525168 shutdown_connections 2023-10-18T21:30:24.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.695+0000 7f89ad301700 1 -- 172.21.15.8:0/257525168 wait complete. 2023-10-18T21:30:24.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.835+0000 7f9bdb59e700 1 -- 172.21.15.8:0/1752751129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bdc0f77d0 msgr2=0x7f9bdc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:24.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.835+0000 7f9bdb59e700 1 --2- 172.21.15.8:0/1752751129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bdc0f77d0 0x7f9bdc0f7c30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f9bd0004660 tx=0x7f9bd0009b30).stop 2023-10-18T21:30:24.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.835+0000 7f9bdb59e700 1 -- 172.21.15.8:0/1752751129 shutdown_connections 2023-10-18T21:30:24.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.835+0000 7f9bdb59e700 1 --2- 172.21.15.8:0/1752751129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bdc0f77d0 0x7f9bdc0f7c30 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.835+0000 7f9bdb59e700 1 --2- 172.21.15.8:0/1752751129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0f6530 0x7f9bdc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.835+0000 7f9bdb59e700 1 -- 172.21.15.8:0/1752751129 >> 172.21.15.8:0/1752751129 conn(0x7f9bdc0f1c90 msgr2=0x7f9bdc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:24.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.835+0000 7f9bdb59e700 1 -- 172.21.15.8:0/1752751129 shutdown_connections 2023-10-18T21:30:24.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.835+0000 7f9bdb59e700 1 -- 172.21.15.8:0/1752751129 wait complete. 2023-10-18T21:30:24.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.836+0000 7f9bdb59e700 1 Processor -- start 2023-10-18T21:30:24.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.837+0000 7f9bdb59e700 1 -- start start 2023-10-18T21:30:24.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.837+0000 7f9bdb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0f6530 0x7f9bdc06b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:24.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.837+0000 7f9bdb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bdc0f77d0 0x7f9bdc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:24.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.837+0000 7f9bdb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc06a360 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.837+0000 7f9bdb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc06a4a0 con 0x7f9bdc0f6530 2023-10-18T21:30:24.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.838+0000 7f9bd9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bdc0f77d0 0x7f9bdc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:24.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.838+0000 7f9bd9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bdc0f77d0 0x7f9bdc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35254/0 (socket says 172.21.15.8:35254) 2023-10-18T21:30:24.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.838+0000 7f9bd9d9b700 1 -- 172.21.15.8:0/879715209 learned_addr learned my addr 172.21.15.8:0/879715209 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:24.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.838+0000 7f9bda59c700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0f6530 0x7f9bdc06b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:24.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.838+0000 7f9bd9d9b700 1 -- 172.21.15.8:0/879715209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0f6530 msgr2=0x7f9bdc06b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.838+0000 7f9bd9d9b700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0f6530 0x7f9bdc06b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.838+0000 7f9bd9d9b700 1 -- 172.21.15.8:0/879715209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd0005040 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.838+0000 7f9bda59c700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0f6530 0x7f9bdc06b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:30:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.838+0000 7f9bd9d9b700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bdc0f77d0 0x7f9bdc069e20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f9bd0004d80 tx=0x7f9bd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.838+0000 7f9bcaffd700 1 -- 172.21.15.8:0/879715209 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bd0019070 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.839+0000 7f9bcaffd700 1 -- 172.21.15.8:0/879715209 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9bd001e420 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.839+0000 7f9bdb59e700 1 -- 172.21.15.8:0/879715209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bdc06a6f0 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.839+0000 7f9bcaffd700 1 -- 172.21.15.8:0/879715209 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bd0014680 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.839+0000 7f9bdb59e700 1 -- 172.21.15.8:0/879715209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bdc06abd0 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.840+0000 7f9bdb59e700 1 -- 172.21.15.8:0/879715209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bdc045ad0 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.841+0000 7f9bcaffd700 1 -- 172.21.15.8:0/879715209 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9bd001e9c0 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.841+0000 7f9bcaffd700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bc4060f70 0x7f9bc4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:24.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.842+0000 7f9bcaffd700 1 -- 172.21.15.8:0/879715209 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9bd007dde0 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.842+0000 7f9bda59c700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bc4060f70 0x7f9bc4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:24.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.842+0000 7f9bda59c700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bc4060f70 0x7f9bc4063430 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f9bdc06b6e0 tx=0x7f9bcc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:24.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:24.846+0000 7f9bcaffd700 1 -- 172.21.15.8:0/879715209 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9bd004da10 con 0x7f9bdc0f77d0 2023-10-18T21:30:24.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:23.584585+0000 mgr.smithi008.flmjzp (mgr.14640) 1893 : audit [DBG] from='client.35680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:24.693337+0000 mon.smithi008 (mon.0) 2341 : audit [DBG] from='client.? 172.21.15.8:0/257525168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.075+0000 7f9bdb59e700 1 -- 172.21.15.8:0/879715209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9bdc0586e0 con 0x7f9bdc0f77d0 2023-10-18T21:30:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.075+0000 7f9bcaffd700 1 -- 172.21.15.8:0/879715209 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f9bd0051030 con 0x7f9bdc0f77d0 2023-10-18T21:30:25.077 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:30:25.077 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:30:25.077 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:30:25.077 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:30:25.077 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:30:25.078 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:30:25.078 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:30:25.078 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:30:25.078 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:30:25.079 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:30:25.079 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:30:25.079 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:30:25.079 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:30:25.079 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:30:25.080 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:30:25.080 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:30:25.080 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:30:25.080 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:30:25.080 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:30:25.081 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:30:25.081 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:30:25.081 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:30:25.081 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:30:25.081 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:30:25.082 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:30:25.082 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:30:25.082 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:30:25.082 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:30:25.082 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:30:25.083 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:30:25.083 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:30:25.083 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:30:25.083 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:30:25.083 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:30:25.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.077+0000 7f9bdb59e700 1 -- 172.21.15.8:0/879715209 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bc4060f70 msgr2=0x7f9bc4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:25.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.077+0000 7f9bdb59e700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bc4060f70 0x7f9bc4063430 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f9bdc06b6e0 tx=0x7f9bcc00b040).stop 2023-10-18T21:30:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.077+0000 7f9bdb59e700 1 -- 172.21.15.8:0/879715209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bdc0f77d0 msgr2=0x7f9bdc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.077+0000 7f9bdb59e700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bdc0f77d0 0x7f9bdc069e20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f9bd0004d80 tx=0x7f9bd000b040).stop 2023-10-18T21:30:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.078+0000 7f9bdb59e700 1 -- 172.21.15.8:0/879715209 shutdown_connections 2023-10-18T21:30:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.078+0000 7f9bdb59e700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9bc4060f70 0x7f9bc4063430 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.078+0000 7f9bdb59e700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0f6530 0x7f9bdc06b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:25.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.078+0000 7f9bdb59e700 1 --2- 172.21.15.8:0/879715209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bdc0f77d0 0x7f9bdc069e20 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:25.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.078+0000 7f9bdb59e700 1 -- 172.21.15.8:0/879715209 >> 172.21.15.8:0/879715209 conn(0x7f9bdc0f1c90 msgr2=0x7f9bdc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:25.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.078+0000 7f9bdb59e700 1 -- 172.21.15.8:0/879715209 shutdown_connections 2023-10-18T21:30:25.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.078+0000 7f9bdb59e700 1 -- 172.21.15.8:0/879715209 wait complete. 2023-10-18T21:30:25.086 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:30:25.154 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:23.584585+0000 mgr.smithi008.flmjzp (mgr.14640) 1893 : audit [DBG] from='client.35680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:25.154 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:24.693337+0000 mon.smithi008 (mon.0) 2341 : audit [DBG] from='client.? 172.21.15.8:0/257525168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:25.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.215+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2957141419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1bc0f6530 msgr2=0x7ff1bc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:25.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.215+0000 7ff1c26cb700 1 --2- 172.21.15.8:0/2957141419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1bc0f6530 0x7ff1bc0f6950 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7ff1b8004660 tx=0x7ff1b8009b30).stop 2023-10-18T21:30:25.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.215+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2957141419 shutdown_connections 2023-10-18T21:30:25.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.215+0000 7ff1c26cb700 1 --2- 172.21.15.8:0/2957141419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1bc0f77d0 0x7ff1bc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:25.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.215+0000 7ff1c26cb700 1 --2- 172.21.15.8:0/2957141419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1bc0f6530 0x7ff1bc0f6950 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:25.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.215+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2957141419 >> 172.21.15.8:0/2957141419 conn(0x7ff1bc0f1c90 msgr2=0x7ff1bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:25.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.215+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2957141419 shutdown_connections 2023-10-18T21:30:25.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.215+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2957141419 wait complete. 2023-10-18T21:30:25.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.216+0000 7ff1c26cb700 1 Processor -- start 2023-10-18T21:30:25.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.216+0000 7ff1c26cb700 1 -- start start 2023-10-18T21:30:25.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.216+0000 7ff1c26cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1bc0f6530 0x7ff1bc108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:25.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.216+0000 7ff1c26cb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1bc0f77d0 0x7ff1bc1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:25.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.216+0000 7ff1c26cb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc109a70 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.216+0000 7ff1c26cb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc109bb0 con 0x7ff1bc0f6530 2023-10-18T21:30:25.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.216+0000 7ff1c0ec8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1bc0f77d0 0x7ff1bc1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:25.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.216+0000 7ff1c0ec8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1bc0f77d0 0x7ff1bc1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35284/0 (socket says 172.21.15.8:35284) 2023-10-18T21:30:25.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.216+0000 7ff1c0ec8700 1 -- 172.21.15.8:0/2986152251 learned_addr learned my addr 172.21.15.8:0/2986152251 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:25.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.216+0000 7ff1c16c9700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1bc0f6530 0x7ff1bc108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:25.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.217+0000 7ff1c0ec8700 1 -- 172.21.15.8:0/2986152251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1bc0f6530 msgr2=0x7ff1bc108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:25.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.217+0000 7ff1c0ec8700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1bc0f6530 0x7ff1bc108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:25.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.217+0000 7ff1c0ec8700 1 -- 172.21.15.8:0/2986152251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b8005040 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.217+0000 7ff1c0ec8700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1bc0f77d0 0x7ff1bc1094c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7ff1ac0026d0 tx=0x7ff1ac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:25.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.217+0000 7ff1b1ffb700 1 -- 172.21.15.8:0/2986152251 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1ac0079c0 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.217+0000 7ff1b1ffb700 1 -- 172.21.15.8:0/2986152251 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff1ac00f040 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.217+0000 7ff1b1ffb700 1 -- 172.21.15.8:0/2986152251 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1ac014980 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.217+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2986152251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc10a550 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.217+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2986152251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc10ab10 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.218+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2986152251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1bc045ad0 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.219+0000 7ff1b1ffb700 1 -- 172.21.15.8:0/2986152251 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff1ac0090d0 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.220+0000 7ff1b1ffb700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff1a8060f70 0x7ff1a8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:25.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.220+0000 7ff1b1ffb700 1 -- 172.21.15.8:0/2986152251 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff1ac07c8a0 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.220+0000 7ff1c16c9700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff1a8060f70 0x7ff1a8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:25.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.221+0000 7ff1c16c9700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff1a8060f70 0x7ff1a8063430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7ff1b8004630 tx=0x7ff1b8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:25.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.224+0000 7ff1b1ffb700 1 -- 172.21.15.8:0/2986152251 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff1ac04ffb0 con 0x7ff1bc0f77d0 2023-10-18T21:30:25.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.423+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2986152251 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1bc10ade0 con 0x7ff1a8060f70 2023-10-18T21:30:25.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.424+0000 7ff1b1ffb700 1 -- 172.21.15.8:0/2986152251 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff1bc10ade0 con 0x7ff1a8060f70 2023-10-18T21:30:25.425 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:30:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:30:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:30:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:30:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:30:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:30:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:30:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:30:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:30:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:30:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:30:25.428 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:30:25.428 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:30:25.428 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:30:25.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.426+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2986152251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff1a8060f70 msgr2=0x7ff1a8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:25.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.426+0000 7ff1c26cb700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff1a8060f70 0x7ff1a8063430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7ff1b8004630 tx=0x7ff1b8009b30).stop 2023-10-18T21:30:25.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.426+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2986152251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1bc0f77d0 msgr2=0x7ff1bc1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:25.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.426+0000 7ff1c26cb700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1bc0f77d0 0x7ff1bc1094c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7ff1ac0026d0 tx=0x7ff1ac009de0).stop 2023-10-18T21:30:25.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.426+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2986152251 shutdown_connections 2023-10-18T21:30:25.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.426+0000 7ff1c26cb700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff1a8060f70 0x7ff1a8063430 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:25.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.426+0000 7ff1c26cb700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1bc0f6530 0x7ff1bc108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:25.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.426+0000 7ff1c26cb700 1 --2- 172.21.15.8:0/2986152251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1bc0f77d0 0x7ff1bc1094c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:25.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.426+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2986152251 >> 172.21.15.8:0/2986152251 conn(0x7ff1bc0f1c90 msgr2=0x7ff1bc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:25.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.427+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2986152251 shutdown_connections 2023-10-18T21:30:25.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:25.427+0000 7ff1c26cb700 1 -- 172.21.15.8:0/2986152251 wait complete. 2023-10-18T21:30:25.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:23.936164+0000 mgr.smithi008.flmjzp (mgr.14640) 1894 : audit [DBG] from='client.35684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:24.280343+0000 mgr.smithi008.flmjzp (mgr.14640) 1895 : audit [DBG] from='client.35688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:24.667201+0000 mgr.smithi008.flmjzp (mgr.14640) 1896 : cluster [DBG] pgmap v1311: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:25.076163+0000 mon.smithi008 (mon.0) 2342 : audit [DBG] from='client.? 172.21.15.8:0/879715209' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:30:26.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:23.936164+0000 mgr.smithi008.flmjzp (mgr.14640) 1894 : audit [DBG] from='client.35684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:26.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:24.280343+0000 mgr.smithi008.flmjzp (mgr.14640) 1895 : audit [DBG] from='client.35688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:26.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:24.667201+0000 mgr.smithi008.flmjzp (mgr.14640) 1896 : cluster [DBG] pgmap v1311: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:26.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:25.076163+0000 mon.smithi008 (mon.0) 2342 : audit [DBG] from='client.? 172.21.15.8:0/879715209' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:30:27.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:25.424785+0000 mgr.smithi008.flmjzp (mgr.14640) 1897 : audit [DBG] from='client.35700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:27.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:26.695045+0000 mon.smithi008 (mon.0) 2343 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:27.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:25.424785+0000 mgr.smithi008.flmjzp (mgr.14640) 1897 : audit [DBG] from='client.35700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:26.695045+0000 mon.smithi008 (mon.0) 2343 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:26.667937+0000 mgr.smithi008.flmjzp (mgr.14640) 1898 : cluster [DBG] pgmap v1312: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:27.258278+0000 mon.smithi008 (mon.0) 2344 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:27.259143+0000 mon.smithi008 (mon.0) 2345 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:27.264684+0000 mon.smithi008 (mon.0) 2346 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:27.269563+0000 mon.smithi008 (mon.0) 2347 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:27.271904+0000 mon.smithi008 (mon.0) 2348 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:27.273189+0000 mon.smithi008 (mon.0) 2349 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:27.274359+0000 mon.smithi008 (mon.0) 2350 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:28.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:27.275862+0000 mon.smithi008 (mon.0) 2351 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:26.667937+0000 mgr.smithi008.flmjzp (mgr.14640) 1898 : cluster [DBG] pgmap v1312: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:27.258278+0000 mon.smithi008 (mon.0) 2344 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:27.259143+0000 mon.smithi008 (mon.0) 2345 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:27.264684+0000 mon.smithi008 (mon.0) 2346 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:27.269563+0000 mon.smithi008 (mon.0) 2347 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:27.271904+0000 mon.smithi008 (mon.0) 2348 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:28.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:27.273189+0000 mon.smithi008 (mon.0) 2349 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:28.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:27.274359+0000 mon.smithi008 (mon.0) 2350 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:28.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:27.275862+0000 mon.smithi008 (mon.0) 2351 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:29.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:27.259812+0000 mgr.smithi008.flmjzp (mgr.14640) 1899 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:29.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:27.260315+0000 mgr.smithi008.flmjzp (mgr.14640) 1900 : cluster [DBG] pgmap v1313: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:29.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:27.260569+0000 mgr.smithi008.flmjzp (mgr.14640) 1901 : cluster [DBG] pgmap v1314: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:29.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:27.277399+0000 mgr.smithi008.flmjzp (mgr.14640) 1902 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:29.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:27.259812+0000 mgr.smithi008.flmjzp (mgr.14640) 1899 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:29.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:27.260315+0000 mgr.smithi008.flmjzp (mgr.14640) 1900 : cluster [DBG] pgmap v1313: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:27.260569+0000 mgr.smithi008.flmjzp (mgr.14640) 1901 : cluster [DBG] pgmap v1314: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:27.277399+0000 mgr.smithi008.flmjzp (mgr.14640) 1902 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:29.261367+0000 mgr.smithi008.flmjzp (mgr.14640) 1903 : cluster [DBG] pgmap v1315: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:31.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:29.261367+0000 mgr.smithi008.flmjzp (mgr.14640) 1903 : cluster [DBG] pgmap v1315: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:31.261954+0000 mgr.smithi008.flmjzp (mgr.14640) 1904 : cluster [DBG] pgmap v1316: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:33.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:31.261954+0000 mgr.smithi008.flmjzp (mgr.14640) 1904 : cluster [DBG] pgmap v1316: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:35.154 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:33.262580+0000 mgr.smithi008.flmjzp (mgr.14640) 1905 : cluster [DBG] pgmap v1317: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:35.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:33.262580+0000 mgr.smithi008.flmjzp (mgr.14640) 1905 : cluster [DBG] pgmap v1317: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:35.263274+0000 mgr.smithi008.flmjzp (mgr.14640) 1906 : cluster [DBG] pgmap v1318: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:37.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:35.263274+0000 mgr.smithi008.flmjzp (mgr.14640) 1906 : cluster [DBG] pgmap v1318: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:37.288316+0000 mon.smithi008 (mon.0) 2352 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:37.290510+0000 mon.smithi008 (mon.0) 2353 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:37.291593+0000 mon.smithi008 (mon.0) 2354 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:37.297991+0000 mon.smithi008 (mon.0) 2355 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:37.304351+0000 mon.smithi008 (mon.0) 2356 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:37.307420+0000 mon.smithi008 (mon.0) 2357 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:37.309111+0000 mon.smithi008 (mon.0) 2358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:38.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:37.310674+0000 mon.smithi008 (mon.0) 2359 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:38.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:37.312652+0000 mon.smithi008 (mon.0) 2360 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:38.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:37.288316+0000 mon.smithi008 (mon.0) 2352 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:38.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:37.290510+0000 mon.smithi008 (mon.0) 2353 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:37.291593+0000 mon.smithi008 (mon.0) 2354 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:37.297991+0000 mon.smithi008 (mon.0) 2355 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:37.304351+0000 mon.smithi008 (mon.0) 2356 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:37.307420+0000 mon.smithi008 (mon.0) 2357 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:37.309111+0000 mon.smithi008 (mon.0) 2358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:38.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:37.310674+0000 mon.smithi008 (mon.0) 2359 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:38.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:37.312652+0000 mon.smithi008 (mon.0) 2360 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:37.264094+0000 mgr.smithi008.flmjzp (mgr.14640) 1907 : cluster [DBG] pgmap v1319: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:37.292569+0000 mgr.smithi008.flmjzp (mgr.14640) 1908 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:37.293174+0000 mgr.smithi008.flmjzp (mgr.14640) 1909 : cluster [DBG] pgmap v1320: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:37.293579+0000 mgr.smithi008.flmjzp (mgr.14640) 1910 : cluster [DBG] pgmap v1321: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:37.314574+0000 mgr.smithi008.flmjzp (mgr.14640) 1911 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:39.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:37.264094+0000 mgr.smithi008.flmjzp (mgr.14640) 1907 : cluster [DBG] pgmap v1319: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:39.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:37.292569+0000 mgr.smithi008.flmjzp (mgr.14640) 1908 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:37.293174+0000 mgr.smithi008.flmjzp (mgr.14640) 1909 : cluster [DBG] pgmap v1320: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:37.293579+0000 mgr.smithi008.flmjzp (mgr.14640) 1910 : cluster [DBG] pgmap v1321: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:37.314574+0000 mgr.smithi008.flmjzp (mgr.14640) 1911 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:39.294136+0000 mgr.smithi008.flmjzp (mgr.14640) 1912 : cluster [DBG] pgmap v1322: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:39.294136+0000 mgr.smithi008.flmjzp (mgr.14640) 1912 : cluster [DBG] pgmap v1322: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:41.294852+0000 mgr.smithi008.flmjzp (mgr.14640) 1913 : cluster [DBG] pgmap v1323: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:43.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:41.294852+0000 mgr.smithi008.flmjzp (mgr.14640) 1913 : cluster [DBG] pgmap v1323: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:45.154 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:43.295354+0000 mgr.smithi008.flmjzp (mgr.14640) 1914 : cluster [DBG] pgmap v1324: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:45.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:43.295354+0000 mgr.smithi008.flmjzp (mgr.14640) 1914 : cluster [DBG] pgmap v1324: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:45.295912+0000 mgr.smithi008.flmjzp (mgr.14640) 1915 : cluster [DBG] pgmap v1325: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:45.295912+0000 mgr.smithi008.flmjzp (mgr.14640) 1915 : cluster [DBG] pgmap v1325: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:47.322651+0000 mon.smithi008 (mon.0) 2361 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:48.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:47.322651+0000 mon.smithi008 (mon.0) 2361 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:47.296507+0000 mgr.smithi008.flmjzp (mgr.14640) 1916 : cluster [DBG] pgmap v1326: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:47.886997+0000 mon.smithi008 (mon.0) 2362 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:47.888160+0000 mon.smithi008 (mon.0) 2363 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:47.889027+0000 mgr.smithi008.flmjzp (mgr.14640) 1917 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:47.889709+0000 mgr.smithi008.flmjzp (mgr.14640) 1918 : cluster [DBG] pgmap v1327: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:47.889983+0000 mgr.smithi008.flmjzp (mgr.14640) 1919 : cluster [DBG] pgmap v1328: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:47.894647+0000 mon.smithi008 (mon.0) 2364 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:47.900980+0000 mon.smithi008 (mon.0) 2365 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:47.904058+0000 mon.smithi008 (mon.0) 2366 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:47.905686+0000 mon.smithi008 (mon.0) 2367 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:47.907266+0000 mon.smithi008 (mon.0) 2368 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:47.909273+0000 mon.smithi008 (mon.0) 2369 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:49.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:47.911108+0000 mgr.smithi008.flmjzp (mgr.14640) 1920 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:47.296507+0000 mgr.smithi008.flmjzp (mgr.14640) 1916 : cluster [DBG] pgmap v1326: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:47.886997+0000 mon.smithi008 (mon.0) 2362 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:47.888160+0000 mon.smithi008 (mon.0) 2363 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:47.889027+0000 mgr.smithi008.flmjzp (mgr.14640) 1917 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:47.889709+0000 mgr.smithi008.flmjzp (mgr.14640) 1918 : cluster [DBG] pgmap v1327: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:47.889983+0000 mgr.smithi008.flmjzp (mgr.14640) 1919 : cluster [DBG] pgmap v1328: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:47.894647+0000 mon.smithi008 (mon.0) 2364 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:47.900980+0000 mon.smithi008 (mon.0) 2365 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:47.904058+0000 mon.smithi008 (mon.0) 2366 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:47.905686+0000 mon.smithi008 (mon.0) 2367 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:49.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:47.907266+0000 mon.smithi008 (mon.0) 2368 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:49.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:47.909273+0000 mon.smithi008 (mon.0) 2369 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:49.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:47.911108+0000 mgr.smithi008.flmjzp (mgr.14640) 1920 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:49.890687+0000 mgr.smithi008.flmjzp (mgr.14640) 1921 : cluster [DBG] pgmap v1329: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:49.890687+0000 mgr.smithi008.flmjzp (mgr.14640) 1921 : cluster [DBG] pgmap v1329: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:52.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:51.891235+0000 mgr.smithi008.flmjzp (mgr.14640) 1922 : cluster [DBG] pgmap v1330: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:51.891235+0000 mgr.smithi008.flmjzp (mgr.14640) 1922 : cluster [DBG] pgmap v1330: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:53.892046+0000 mgr.smithi008.flmjzp (mgr.14640) 1923 : cluster [DBG] pgmap v1331: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:54.281 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:53.892046+0000 mgr.smithi008.flmjzp (mgr.14640) 1923 : cluster [DBG] pgmap v1331: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:55.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.579+0000 7f688d641700 1 -- 172.21.15.8:0/4083105137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f688806a3b0 msgr2=0x7f688806a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:55.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.579+0000 7f688d641700 1 --2- 172.21.15.8:0/4083105137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f688806a3b0 0x7f688806a830 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f687c004660 tx=0x7f687c009b30).stop 2023-10-18T21:30:55.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.579+0000 7f688d641700 1 -- 172.21.15.8:0/4083105137 shutdown_connections 2023-10-18T21:30:55.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.579+0000 7f688d641700 1 --2- 172.21.15.8:0/4083105137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f688806a3b0 0x7f688806a830 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:55.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.579+0000 7f688d641700 1 --2- 172.21.15.8:0/4083105137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688806b9c0 0x7f6888069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:55.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.579+0000 7f688d641700 1 -- 172.21.15.8:0/4083105137 >> 172.21.15.8:0/4083105137 conn(0x7f68880f1c90 msgr2=0x7f68880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:55.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.579+0000 7f688d641700 1 -- 172.21.15.8:0/4083105137 shutdown_connections 2023-10-18T21:30:55.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.579+0000 7f688d641700 1 -- 172.21.15.8:0/4083105137 wait complete. 2023-10-18T21:30:55.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.580+0000 7f688d641700 1 Processor -- start 2023-10-18T21:30:55.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.580+0000 7f688d641700 1 -- start start 2023-10-18T21:30:55.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f688d641700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688806a3b0 0x7f6888108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:55.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f688d641700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f688806b9c0 0x7f68881093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:55.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f688d641700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6888109970 con 0x7f688806b9c0 2023-10-18T21:30:55.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f688d641700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6888109ab0 con 0x7f688806a3b0 2023-10-18T21:30:55.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f68877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f688806b9c0 0x7f68881093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:55.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f68877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f688806b9c0 0x7f68881093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44464/0 (socket says 172.21.15.8:44464) 2023-10-18T21:30:55.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f68877fe700 1 -- 172.21.15.8:0/2520192481 learned_addr learned my addr 172.21.15.8:0/2520192481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:55.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f6887fff700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688806a3b0 0x7f6888108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:55.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f68877fe700 1 -- 172.21.15.8:0/2520192481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688806a3b0 msgr2=0x7f6888108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:55.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f68877fe700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688806a3b0 0x7f6888108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:55.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.581+0000 7f68877fe700 1 -- 172.21.15.8:0/2520192481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c005040 con 0x7f688806b9c0 2023-10-18T21:30:55.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.582+0000 7f68877fe700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f688806b9c0 0x7f68881093c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f687c004320 tx=0x7f687c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:55.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.582+0000 7f6884ff9700 1 -- 172.21.15.8:0/2520192481 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687c019070 con 0x7f688806b9c0 2023-10-18T21:30:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.582+0000 7f6884ff9700 1 -- 172.21.15.8:0/2520192481 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f687c01e420 con 0x7f688806b9c0 2023-10-18T21:30:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.582+0000 7f688d641700 1 -- 172.21.15.8:0/2520192481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688810a3f0 con 0x7f688806b9c0 2023-10-18T21:30:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.582+0000 7f6884ff9700 1 -- 172.21.15.8:0/2520192481 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687c014660 con 0x7f688806b9c0 2023-10-18T21:30:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.582+0000 7f688d641700 1 -- 172.21.15.8:0/2520192481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688810a8d0 con 0x7f688806b9c0 2023-10-18T21:30:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.583+0000 7f688d641700 1 -- 172.21.15.8:0/2520192481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6888045ad0 con 0x7f688806b9c0 2023-10-18T21:30:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.584+0000 7f6884ff9700 1 -- 172.21.15.8:0/2520192481 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f687c01e590 con 0x7f688806b9c0 2023-10-18T21:30:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.585+0000 7f6884ff9700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6870060f70 0x7f6870063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.585+0000 7f6884ff9700 1 -- 172.21.15.8:0/2520192481 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f687c07dd50 con 0x7f688806b9c0 2023-10-18T21:30:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.585+0000 7f6887fff700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6870060f70 0x7f6870063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.586+0000 7f6887fff700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6870060f70 0x7f6870063430 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f6878009da0 tx=0x7f687800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.589+0000 7f6884ff9700 1 -- 172.21.15.8:0/2520192481 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f687c051390 con 0x7f688806b9c0 2023-10-18T21:30:55.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.786+0000 7f688d641700 1 -- 172.21.15.8:0/2520192481 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f688810ab40 con 0x7f6870060f70 2023-10-18T21:30:55.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.787+0000 7f6884ff9700 1 -- 172.21.15.8:0/2520192481 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f688810ab40 con 0x7f6870060f70 2023-10-18T21:30:55.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 -- 172.21.15.8:0/2520192481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6870060f70 msgr2=0x7f6870063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:55.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6870060f70 0x7f6870063430 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f6878009da0 tx=0x7f687800b040).stop 2023-10-18T21:30:55.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 -- 172.21.15.8:0/2520192481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f688806b9c0 msgr2=0x7f68881093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:55.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f688806b9c0 0x7f68881093c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f687c004320 tx=0x7f687c00b040).stop 2023-10-18T21:30:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 -- 172.21.15.8:0/2520192481 shutdown_connections 2023-10-18T21:30:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6870060f70 0x7f6870063430 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688806a3b0 0x7f6888108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 --2- 172.21.15.8:0/2520192481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f688806b9c0 0x7f68881093c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 -- 172.21.15.8:0/2520192481 >> 172.21.15.8:0/2520192481 conn(0x7f68880f1c90 msgr2=0x7f68880fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:55.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 -- 172.21.15.8:0/2520192481 shutdown_connections 2023-10-18T21:30:55.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.789+0000 7f688d641700 1 -- 172.21.15.8:0/2520192481 wait complete. 2023-10-18T21:30:55.805 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:30:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.926+0000 7f149b51e700 1 -- 172.21.15.8:0/2918632175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14940f6530 msgr2=0x7f14940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.926+0000 7f149b51e700 1 --2- 172.21.15.8:0/2918632175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14940f6530 0x7f14940f6950 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f1490004660 tx=0x7f1490009b30).stop 2023-10-18T21:30:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.926+0000 7f149b51e700 1 -- 172.21.15.8:0/2918632175 shutdown_connections 2023-10-18T21:30:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.926+0000 7f149b51e700 1 --2- 172.21.15.8:0/2918632175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14940f77d0 0x7f14940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.926+0000 7f149b51e700 1 --2- 172.21.15.8:0/2918632175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14940f6530 0x7f14940f6950 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.926+0000 7f149b51e700 1 -- 172.21.15.8:0/2918632175 >> 172.21.15.8:0/2918632175 conn(0x7f14940f1c90 msgr2=0x7f14940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.926+0000 7f149b51e700 1 -- 172.21.15.8:0/2918632175 shutdown_connections 2023-10-18T21:30:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.926+0000 7f149b51e700 1 -- 172.21.15.8:0/2918632175 wait complete. 2023-10-18T21:30:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.927+0000 7f149b51e700 1 Processor -- start 2023-10-18T21:30:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.927+0000 7f149b51e700 1 -- start start 2023-10-18T21:30:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.928+0000 7f149b51e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14940f6530 0x7f1494108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.928+0000 7f149b51e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14940f77d0 0x7f14941094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.928+0000 7f149b51e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1494109a60 con 0x7f14940f77d0 2023-10-18T21:30:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.928+0000 7f149b51e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1494109ba0 con 0x7f14940f6530 2023-10-18T21:30:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.928+0000 7f1499d1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14940f77d0 0x7f14941094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.928+0000 7f1499d1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14940f77d0 0x7f14941094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44474/0 (socket says 172.21.15.8:44474) 2023-10-18T21:30:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.928+0000 7f1499d1b700 1 -- 172.21.15.8:0/818601641 learned_addr learned my addr 172.21.15.8:0/818601641 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:55.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.928+0000 7f149a51c700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14940f6530 0x7f1494108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:55.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.928+0000 7f1499d1b700 1 -- 172.21.15.8:0/818601641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14940f6530 msgr2=0x7f1494108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:55.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.928+0000 7f1499d1b700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14940f6530 0x7f1494108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:55.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.929+0000 7f1499d1b700 1 -- 172.21.15.8:0/818601641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490005040 con 0x7f14940f77d0 2023-10-18T21:30:55.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.929+0000 7f1499d1b700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14940f77d0 0x7f14941094b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f14840026d0 tx=0x7f1484009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.929+0000 7f148affd700 1 -- 172.21.15.8:0/818601641 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14840079c0 con 0x7f14940f77d0 2023-10-18T21:30:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.929+0000 7f148affd700 1 -- 172.21.15.8:0/818601641 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f148400f040 con 0x7f14940f77d0 2023-10-18T21:30:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.929+0000 7f148affd700 1 -- 172.21.15.8:0/818601641 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1484014980 con 0x7f14940f77d0 2023-10-18T21:30:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.929+0000 7f149b51e700 1 -- 172.21.15.8:0/818601641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149410a540 con 0x7f14940f77d0 2023-10-18T21:30:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.929+0000 7f149b51e700 1 -- 172.21.15.8:0/818601641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149410ab00 con 0x7f14940f77d0 2023-10-18T21:30:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.930+0000 7f149b51e700 1 -- 172.21.15.8:0/818601641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1494045ad0 con 0x7f14940f77d0 2023-10-18T21:30:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.931+0000 7f148affd700 1 -- 172.21.15.8:0/818601641 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f14840090d0 con 0x7f14940f77d0 2023-10-18T21:30:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.932+0000 7f148affd700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 0x7f1480063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.932+0000 7f148affd700 1 -- 172.21.15.8:0/818601641 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f148407c8a0 con 0x7f14940f77d0 2023-10-18T21:30:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.932+0000 7f149a51c700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 0x7f1480063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.933+0000 7f149a51c700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 0x7f1480063430 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f1490004630 tx=0x7f1490009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:55.936+0000 7f148affd700 1 -- 172.21.15.8:0/818601641 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f148404ffb0 con 0x7f14940f77d0 2023-10-18T21:30:56.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.136+0000 7f149b51e700 1 -- 172.21.15.8:0/818601641 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f149410add0 con 0x7f1480060f70 2023-10-18T21:30:56.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.137+0000 7f148affd700 1 -- 172.21.15.8:0/818601641 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f149410add0 con 0x7f1480060f70 2023-10-18T21:30:56.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 -- 172.21.15.8:0/818601641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 msgr2=0x7f1480063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:56.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 0x7f1480063430 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f1490004630 tx=0x7f1490009b30).stop 2023-10-18T21:30:56.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 -- 172.21.15.8:0/818601641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14940f77d0 msgr2=0x7f14941094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:56.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14940f77d0 0x7f14941094b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f14840026d0 tx=0x7f1484009de0).stop 2023-10-18T21:30:56.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 -- 172.21.15.8:0/818601641 shutdown_connections 2023-10-18T21:30:56.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1480060f70 0x7f1480063430 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14940f6530 0x7f1494108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 --2- 172.21.15.8:0/818601641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14940f77d0 0x7f14941094b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 -- 172.21.15.8:0/818601641 >> 172.21.15.8:0/818601641 conn(0x7f14940f1c90 msgr2=0x7f14940f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:56.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 -- 172.21.15.8:0/818601641 shutdown_connections 2023-10-18T21:30:56.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.139+0000 7f149b51e700 1 -- 172.21.15.8:0/818601641 wait complete. 2023-10-18T21:30:56.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.278+0000 7f483e361700 1 -- 172.21.15.8:0/3130941863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4838060310 msgr2=0x7f48380f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:56.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.278+0000 7f483e361700 1 --2- 172.21.15.8:0/3130941863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4838060310 0x7f48380f9110 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f4834004660 tx=0x7f4834009b30).stop 2023-10-18T21:30:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.278+0000 7f483e361700 1 -- 172.21.15.8:0/3130941863 shutdown_connections 2023-10-18T21:30:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.278+0000 7f483e361700 1 --2- 172.21.15.8:0/3130941863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48380f9690 0x7f48380fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.278+0000 7f483e361700 1 --2- 172.21.15.8:0/3130941863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4838060310 0x7f48380f9110 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.278+0000 7f483e361700 1 -- 172.21.15.8:0/3130941863 >> 172.21.15.8:0/3130941863 conn(0x7f48380f0b90 msgr2=0x7f48380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.278+0000 7f483e361700 1 -- 172.21.15.8:0/3130941863 shutdown_connections 2023-10-18T21:30:56.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.278+0000 7f483e361700 1 -- 172.21.15.8:0/3130941863 wait complete. 2023-10-18T21:30:56.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.279+0000 7f483e361700 1 Processor -- start 2023-10-18T21:30:56.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.279+0000 7f483e361700 1 -- start start 2023-10-18T21:30:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.279+0000 7f483e361700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4838060310 0x7f4838108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.279+0000 7f483e361700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48380f9690 0x7f4838109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.279+0000 7f483e361700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4838109a10 con 0x7f4838060310 2023-10-18T21:30:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.279+0000 7f483e361700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4838109b50 con 0x7f48380f9690 2023-10-18T21:30:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.280+0000 7f483d35f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4838060310 0x7f4838108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.280+0000 7f483d35f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4838060310 0x7f4838108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44502/0 (socket says 172.21.15.8:44502) 2023-10-18T21:30:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.280+0000 7f483d35f700 1 -- 172.21.15.8:0/4030387276 learned_addr learned my addr 172.21.15.8:0/4030387276 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.280+0000 7f483cb5e700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48380f9690 0x7f4838109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.280+0000 7f483d35f700 1 -- 172.21.15.8:0/4030387276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48380f9690 msgr2=0x7f4838109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.280+0000 7f483d35f700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48380f9690 0x7f4838109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.280+0000 7f483d35f700 1 -- 172.21.15.8:0/4030387276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4834005040 con 0x7f4838060310 2023-10-18T21:30:56.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.280+0000 7f483d35f700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4838060310 0x7f4838108f70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f4834009990 tx=0x7f4834009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:56.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.281+0000 7f482dffb700 1 -- 172.21.15.8:0/4030387276 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4834018070 con 0x7f4838060310 2023-10-18T21:30:56.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.281+0000 7f482dffb700 1 -- 172.21.15.8:0/4030387276 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4834009630 con 0x7f4838060310 2023-10-18T21:30:56.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.281+0000 7f483e361700 1 -- 172.21.15.8:0/4030387276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483810a490 con 0x7f4838060310 2023-10-18T21:30:56.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.281+0000 7f482dffb700 1 -- 172.21.15.8:0/4030387276 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f483401c400 con 0x7f4838060310 2023-10-18T21:30:56.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.281+0000 7f483e361700 1 -- 172.21.15.8:0/4030387276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483810a9f0 con 0x7f4838060310 2023-10-18T21:30:56.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.282+0000 7f483e361700 1 -- 172.21.15.8:0/4030387276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4838045ad0 con 0x7f4838060310 2023-10-18T21:30:56.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.283+0000 7f482dffb700 1 -- 172.21.15.8:0/4030387276 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f483401d9e0 con 0x7f4838060310 2023-10-18T21:30:56.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.284+0000 7f482dffb700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4824060f70 0x7f4824063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:56.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.284+0000 7f482dffb700 1 -- 172.21.15.8:0/4030387276 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f483407e710 con 0x7f4838060310 2023-10-18T21:30:56.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.284+0000 7f483cb5e700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4824060f70 0x7f4824063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:56.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.284+0000 7f483cb5e700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4824060f70 0x7f4824063430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f48380600e0 tx=0x7f4828009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:56.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.288+0000 7f482dffb700 1 -- 172.21.15.8:0/4030387276 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4834051cf0 con 0x7f4838060310 2023-10-18T21:30:56.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.480+0000 7f483e361700 1 -- 172.21.15.8:0/4030387276 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f483810b1e0 con 0x7f4824060f70 2023-10-18T21:30:56.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.489+0000 7f482dffb700 1 -- 172.21.15.8:0/4030387276 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4828009e20 con 0x7f4824060f70 2023-10-18T21:30:56.491 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:30:56.492 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (37m) 5m ago 39m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:30:56.492 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (31m) 5m ago 39m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:30:56.492 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (31m) 3m ago 38m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:30:56.492 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (37m) 5m ago 38m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:30:56.492 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 35m - - 2023-10-18T21:30:56.493 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 35m - - 2023-10-18T21:30:56.493 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 35m - - 2023-10-18T21:30:56.493 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 34m - - 2023-10-18T21:30:56.493 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (32m) 5m ago 40m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:30:56.493 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (32m) 3m ago 38m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:30:56.494 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (31m) 5m ago 40m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:30:56.494 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (31m) 3m ago 38m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:30:56.494 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (38m) 5m ago 38m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:30:56.494 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (37m) 3m ago 37m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:30:56.495 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (31m) 5m ago 37m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:30:56.495 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (29m) 5m ago 37m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:30:56.495 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (28m) 5m ago 37m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:30:56.495 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (28m) 3m ago 36m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:30:56.495 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (27m) 3m ago 36m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:30:56.496 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (27m) 3m ago 36m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:30:56.496 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (33m) 5m ago 38m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:30:56.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.491+0000 7f483e361700 1 -- 172.21.15.8:0/4030387276 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4824060f70 msgr2=0x7f4824063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:56.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.491+0000 7f483e361700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4824060f70 0x7f4824063430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f48380600e0 tx=0x7f4828009be0).stop 2023-10-18T21:30:56.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.491+0000 7f483e361700 1 -- 172.21.15.8:0/4030387276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4838060310 msgr2=0x7f4838108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:56.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.491+0000 7f483e361700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4838060310 0x7f4838108f70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f4834009990 tx=0x7f4834009b30).stop 2023-10-18T21:30:56.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.491+0000 7f483e361700 1 -- 172.21.15.8:0/4030387276 shutdown_connections 2023-10-18T21:30:56.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.491+0000 7f483e361700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4824060f70 0x7f4824063430 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.491+0000 7f483e361700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4838060310 0x7f4838108f70 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.491+0000 7f483e361700 1 --2- 172.21.15.8:0/4030387276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48380f9690 0x7f4838109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.491+0000 7f483e361700 1 -- 172.21.15.8:0/4030387276 >> 172.21.15.8:0/4030387276 conn(0x7f48380f0b90 msgr2=0x7f48380f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:56.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.492+0000 7f483e361700 1 -- 172.21.15.8:0/4030387276 shutdown_connections 2023-10-18T21:30:56.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.492+0000 7f483e361700 1 -- 172.21.15.8:0/4030387276 wait complete. 2023-10-18T21:30:56.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.629+0000 7f1711210700 1 -- 172.21.15.8:0/1188424825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f170c06a3b0 msgr2=0x7f170c06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:56.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.629+0000 7f1711210700 1 --2- 172.21.15.8:0/1188424825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f170c06a3b0 0x7f170c06a830 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f1700004660 tx=0x7f1700009b30).stop 2023-10-18T21:30:56.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.629+0000 7f1711210700 1 -- 172.21.15.8:0/1188424825 shutdown_connections 2023-10-18T21:30:56.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.629+0000 7f1711210700 1 --2- 172.21.15.8:0/1188424825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f170c06a3b0 0x7f170c06a830 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.629+0000 7f1711210700 1 --2- 172.21.15.8:0/1188424825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f170c06b9c0 0x7f170c069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.629+0000 7f1711210700 1 -- 172.21.15.8:0/1188424825 >> 172.21.15.8:0/1188424825 conn(0x7f170c0f1c90 msgr2=0x7f170c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:56.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.629+0000 7f1711210700 1 -- 172.21.15.8:0/1188424825 shutdown_connections 2023-10-18T21:30:56.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.630+0000 7f1711210700 1 -- 172.21.15.8:0/1188424825 wait complete. 2023-10-18T21:30:56.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.630+0000 7f1711210700 1 Processor -- start 2023-10-18T21:30:56.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.630+0000 7f1711210700 1 -- start start 2023-10-18T21:30:56.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.631+0000 7f1711210700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f170c06a3b0 0x7f170c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:56.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.631+0000 7f1711210700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f170c06b9c0 0x7f170c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:56.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.631+0000 7f1711210700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c109970 con 0x7f170c06b9c0 2023-10-18T21:30:56.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.631+0000 7f1711210700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c109ab0 con 0x7f170c06a3b0 2023-10-18T21:30:56.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.631+0000 7f170b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f170c06b9c0 0x7f170c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:56.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.631+0000 7f170b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f170c06b9c0 0x7f170c1093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44512/0 (socket says 172.21.15.8:44512) 2023-10-18T21:30:56.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.631+0000 7f170b7fe700 1 -- 172.21.15.8:0/2668565741 learned_addr learned my addr 172.21.15.8:0/2668565741 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:56.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.631+0000 7f170bfff700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f170c06a3b0 0x7f170c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:56.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.631+0000 7f170b7fe700 1 -- 172.21.15.8:0/2668565741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f170c06a3b0 msgr2=0x7f170c108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:56.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.631+0000 7f170b7fe700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f170c06a3b0 0x7f170c108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.632+0000 7f170b7fe700 1 -- 172.21.15.8:0/2668565741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700005040 con 0x7f170c06b9c0 2023-10-18T21:30:56.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.632+0000 7f170bfff700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f170c06a3b0 0x7f170c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:30:56.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.632+0000 7f170b7fe700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f170c06b9c0 0x7f170c1093c0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f1700004320 tx=0x7f170000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:56.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.632+0000 7f1708ff9700 1 -- 172.21.15.8:0/2668565741 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1700019070 con 0x7f170c06b9c0 2023-10-18T21:30:56.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.632+0000 7f1708ff9700 1 -- 172.21.15.8:0/2668565741 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f170001e420 con 0x7f170c06b9c0 2023-10-18T21:30:56.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.632+0000 7f1708ff9700 1 -- 172.21.15.8:0/2668565741 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1700014660 con 0x7f170c06b9c0 2023-10-18T21:30:56.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.632+0000 7f1711210700 1 -- 172.21.15.8:0/2668565741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c10a3f0 con 0x7f170c06b9c0 2023-10-18T21:30:56.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.632+0000 7f1711210700 1 -- 172.21.15.8:0/2668565741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c10a880 con 0x7f170c06b9c0 2023-10-18T21:30:56.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.633+0000 7f1711210700 1 -- 172.21.15.8:0/2668565741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c045ad0 con 0x7f170c06b9c0 2023-10-18T21:30:56.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.634+0000 7f1708ff9700 1 -- 172.21.15.8:0/2668565741 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f170001e590 con 0x7f170c06b9c0 2023-10-18T21:30:56.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.635+0000 7f1708ff9700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16f4060f70 0x7f16f4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:56.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.635+0000 7f1708ff9700 1 -- 172.21.15.8:0/2668565741 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f170007dec0 con 0x7f170c06b9c0 2023-10-18T21:30:56.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.635+0000 7f170bfff700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16f4060f70 0x7f16f4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:56.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.636+0000 7f170bfff700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16f4060f70 0x7f16f4063430 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f16fc007fc0 tx=0x7f16fc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:56.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.639+0000 7f1708ff9700 1 -- 172.21.15.8:0/2668565741 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1700051440 con 0x7f170c06b9c0 2023-10-18T21:30:56.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:55.788214+0000 mgr.smithi008.flmjzp (mgr.14640) 1924 : audit [DBG] from='client.35704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:55.892601+0000 mgr.smithi008.flmjzp (mgr.14640) 1925 : cluster [DBG] pgmap v1332: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:55.788214+0000 mgr.smithi008.flmjzp (mgr.14640) 1924 : audit [DBG] from='client.35704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:55.892601+0000 mgr.smithi008.flmjzp (mgr.14640) 1925 : cluster [DBG] pgmap v1332: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:56.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.896+0000 7f1711210700 1 -- 172.21.15.8:0/2668565741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f170c100eb0 con 0x7f170c06b9c0 2023-10-18T21:30:56.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.897+0000 7f1708ff9700 1 -- 172.21.15.8:0/2668565741 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f1700051030 con 0x7f170c06b9c0 2023-10-18T21:30:56.899 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:30:56.899 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:30:56.900 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:30:56.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:30:56.900 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:30:56.900 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:30:56.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:30:56.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:30:56.901 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:30:56.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:30:56.901 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:30:56.901 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:30:56.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:30:56.901 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:30:56.902 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:30:56.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:30:56.902 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:30:56.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 -- 172.21.15.8:0/2668565741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16f4060f70 msgr2=0x7f16f4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:56.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16f4060f70 0x7f16f4063430 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f16fc007fc0 tx=0x7f16fc00b040).stop 2023-10-18T21:30:56.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 -- 172.21.15.8:0/2668565741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f170c06b9c0 msgr2=0x7f170c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:56.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f170c06b9c0 0x7f170c1093c0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f1700004320 tx=0x7f170000b040).stop 2023-10-18T21:30:56.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 -- 172.21.15.8:0/2668565741 shutdown_connections 2023-10-18T21:30:56.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16f4060f70 0x7f16f4063430 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f170c06a3b0 0x7f170c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 --2- 172.21.15.8:0/2668565741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f170c06b9c0 0x7f170c1093c0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:56.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 -- 172.21.15.8:0/2668565741 >> 172.21.15.8:0/2668565741 conn(0x7f170c0f1c90 msgr2=0x7f170c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:56.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 -- 172.21.15.8:0/2668565741 shutdown_connections 2023-10-18T21:30:56.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:56.899+0000 7f1711210700 1 -- 172.21.15.8:0/2668565741 wait complete. 2023-10-18T21:30:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.042+0000 7f292759e700 1 -- 172.21.15.8:0/3677125345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29280f6530 msgr2=0x7f29280f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.042+0000 7f292759e700 1 --2- 172.21.15.8:0/3677125345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29280f6530 0x7f29280f6950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f2918004660 tx=0x7f2918009b30).stop 2023-10-18T21:30:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.042+0000 7f292759e700 1 -- 172.21.15.8:0/3677125345 shutdown_connections 2023-10-18T21:30:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.042+0000 7f292759e700 1 --2- 172.21.15.8:0/3677125345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29280f77d0 0x7f29280f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.042+0000 7f292759e700 1 --2- 172.21.15.8:0/3677125345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29280f6530 0x7f29280f6950 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.042+0000 7f292759e700 1 -- 172.21.15.8:0/3677125345 >> 172.21.15.8:0/3677125345 conn(0x7f29280f1c90 msgr2=0x7f29280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.042+0000 7f292759e700 1 -- 172.21.15.8:0/3677125345 shutdown_connections 2023-10-18T21:30:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.042+0000 7f292759e700 1 -- 172.21.15.8:0/3677125345 wait complete. 2023-10-18T21:30:57.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.043+0000 7f292759e700 1 Processor -- start 2023-10-18T21:30:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.043+0000 7f292759e700 1 -- start start 2023-10-18T21:30:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.043+0000 7f292759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29280f6530 0x7f2928108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.043+0000 7f292759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29280f77d0 0x7f29281094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.043+0000 7f292759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928109a50 con 0x7f29280f77d0 2023-10-18T21:30:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.043+0000 7f292759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928109b90 con 0x7f29280f6530 2023-10-18T21:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.043+0000 7f2925d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29280f77d0 0x7f29281094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.043+0000 7f292659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29280f6530 0x7f2928108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.043+0000 7f2925d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29280f77d0 0x7f29281094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52580/0 (socket says 172.21.15.8:52580) 2023-10-18T21:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.043+0000 7f2925d9b700 1 -- 172.21.15.8:0/1465466672 learned_addr learned my addr 172.21.15.8:0/1465466672 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.044+0000 7f2925d9b700 1 -- 172.21.15.8:0/1465466672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29280f6530 msgr2=0x7f2928108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.044+0000 7f2925d9b700 1 --2- 172.21.15.8:0/1465466672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29280f6530 0x7f2928108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.044+0000 7f2925d9b700 1 -- 172.21.15.8:0/1465466672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2918005040 con 0x7f29280f77d0 2023-10-18T21:30:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.044+0000 7f2925d9b700 1 --2- 172.21.15.8:0/1465466672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29280f77d0 0x7f29281094a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f291c0026d0 tx=0x7f291c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.044+0000 7f2916ffd700 1 -- 172.21.15.8:0/1465466672 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f291c0079c0 con 0x7f29280f77d0 2023-10-18T21:30:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.044+0000 7f292759e700 1 -- 172.21.15.8:0/1465466672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292810a530 con 0x7f29280f77d0 2023-10-18T21:30:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.044+0000 7f2916ffd700 1 -- 172.21.15.8:0/1465466672 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f291c00f040 con 0x7f29280f77d0 2023-10-18T21:30:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.044+0000 7f2916ffd700 1 -- 172.21.15.8:0/1465466672 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f291c014980 con 0x7f29280f77d0 2023-10-18T21:30:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.045+0000 7f292759e700 1 -- 172.21.15.8:0/1465466672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292810aaf0 con 0x7f29280f77d0 2023-10-18T21:30:57.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.046+0000 7f292759e700 1 -- 172.21.15.8:0/1465466672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2928045ad0 con 0x7f29280f77d0 2023-10-18T21:30:57.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.047+0000 7f2916ffd700 1 -- 172.21.15.8:0/1465466672 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f291c0090d0 con 0x7f29280f77d0 2023-10-18T21:30:57.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.047+0000 7f2916ffd700 1 --2- 172.21.15.8:0/1465466672 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2910060f70 0x7f2910063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:57.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.047+0000 7f2916ffd700 1 -- 172.21.15.8:0/1465466672 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f291c07c980 con 0x7f29280f77d0 2023-10-18T21:30:57.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.048+0000 7f292659c700 1 --2- 172.21.15.8:0/1465466672 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2910060f70 0x7f2910063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:57.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.048+0000 7f292659c700 1 --2- 172.21.15.8:0/1465466672 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2910060f70 0x7f2910063430 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f2918004630 tx=0x7f2918009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:57.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.051+0000 7f2916ffd700 1 -- 172.21.15.8:0/1465466672 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f291c050010 con 0x7f29280f77d0 2023-10-18T21:30:57.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.279+0000 7f292759e700 1 -- 172.21.15.8:0/1465466672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2928027a00 con 0x7f29280f77d0 2023-10-18T21:30:57.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.279+0000 7f2916ffd700 1 -- 172.21.15.8:0/1465466672 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f291c04fc00 con 0x7f29280f77d0 2023-10-18T21:30:57.281 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:30:57.281 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:30:57.282 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:30:57.282 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:30:57.282 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:30:57.282 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:30:57.283 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:30:57.283 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:30:57.283 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:30:57.283 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:30:57.283 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:30:57.284 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:30:57.284 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:30:57.284 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:30:57.284 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:30:57.284 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:30:57.285 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:30:57.285 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:30:57.285 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:30:57.285 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:30:57.285 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:30:57.286 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:30:57.286 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:30:57.286 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:30:57.286 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:30:57.286 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:30:57.287 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:30:57.287 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:30:57.287 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:30:57.287 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:30:57.287 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:30:57.287 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:30:57.288 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:30:57.288 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:30:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 -- 172.21.15.8:0/1465466672 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2910060f70 msgr2=0x7f2910063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 --2- 172.21.15.8:0/1465466672 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2910060f70 0x7f2910063430 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f2918004630 tx=0x7f2918009b30).stop 2023-10-18T21:30:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 -- 172.21.15.8:0/1465466672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29280f77d0 msgr2=0x7f29281094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 --2- 172.21.15.8:0/1465466672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29280f77d0 0x7f29281094a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f291c0026d0 tx=0x7f291c009de0).stop 2023-10-18T21:30:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 -- 172.21.15.8:0/1465466672 shutdown_connections 2023-10-18T21:30:57.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 --2- 172.21.15.8:0/1465466672 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2910060f70 0x7f2910063430 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 --2- 172.21.15.8:0/1465466672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29280f6530 0x7f2928108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 --2- 172.21.15.8:0/1465466672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29280f77d0 0x7f29281094a0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 -- 172.21.15.8:0/1465466672 >> 172.21.15.8:0/1465466672 conn(0x7f29280f1c90 msgr2=0x7f292806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:57.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 -- 172.21.15.8:0/1465466672 shutdown_connections 2023-10-18T21:30:57.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.281+0000 7f292759e700 1 -- 172.21.15.8:0/1465466672 wait complete. 2023-10-18T21:30:57.291 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:30:57.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.419+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/1404874661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d540f77d0 msgr2=0x7f8d540f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:57.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.419+0000 7f8d5b2e2700 1 --2- 172.21.15.8:0/1404874661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d540f77d0 0x7f8d540f7c30 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f8d44004660 tx=0x7f8d44009b30).stop 2023-10-18T21:30:57.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.419+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/1404874661 shutdown_connections 2023-10-18T21:30:57.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.419+0000 7f8d5b2e2700 1 --2- 172.21.15.8:0/1404874661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d540f77d0 0x7f8d540f7c30 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.419+0000 7f8d5b2e2700 1 --2- 172.21.15.8:0/1404874661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d540f6530 0x7f8d540f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.419+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/1404874661 >> 172.21.15.8:0/1404874661 conn(0x7f8d540f1c90 msgr2=0x7f8d540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:57.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.419+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/1404874661 shutdown_connections 2023-10-18T21:30:57.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.419+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/1404874661 wait complete. 2023-10-18T21:30:57.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.420+0000 7f8d5b2e2700 1 Processor -- start 2023-10-18T21:30:57.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.421+0000 7f8d5b2e2700 1 -- start start 2023-10-18T21:30:57.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.421+0000 7f8d5b2e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d540f6530 0x7f8d5406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:57.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.421+0000 7f8d5b2e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d540f77d0 0x7f8d54069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:57.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.421+0000 7f8d5b2e2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5406a380 con 0x7f8d540f6530 2023-10-18T21:30:57.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.421+0000 7f8d5b2e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5406a4c0 con 0x7f8d540f77d0 2023-10-18T21:30:57.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.421+0000 7f8d5a2e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d540f6530 0x7f8d5406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:57.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.421+0000 7f8d5a2e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d540f6530 0x7f8d5406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52604/0 (socket says 172.21.15.8:52604) 2023-10-18T21:30:57.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.421+0000 7f8d5a2e0700 1 -- 172.21.15.8:0/2866699872 learned_addr learned my addr 172.21.15.8:0/2866699872 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:30:57.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.422+0000 7f8d59adf700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d540f77d0 0x7f8d54069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:57.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.422+0000 7f8d5a2e0700 1 -- 172.21.15.8:0/2866699872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d540f77d0 msgr2=0x7f8d54069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:57.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.422+0000 7f8d5a2e0700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d540f77d0 0x7f8d54069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.422+0000 7f8d5a2e0700 1 -- 172.21.15.8:0/2866699872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44005040 con 0x7f8d540f6530 2023-10-18T21:30:57.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.422+0000 7f8d5a2e0700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d540f6530 0x7f8d5406b9a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f8d50002700 tx=0x7f8d50009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:57.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.422+0000 7f8d4affd700 1 -- 172.21.15.8:0/2866699872 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d500079c0 con 0x7f8d540f6530 2023-10-18T21:30:57.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.422+0000 7f8d4affd700 1 -- 172.21.15.8:0/2866699872 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8d5000f040 con 0x7f8d540f6530 2023-10-18T21:30:57.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.422+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/2866699872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5406a7a0 con 0x7f8d540f6530 2023-10-18T21:30:57.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.422+0000 7f8d4affd700 1 -- 172.21.15.8:0/2866699872 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d500148d0 con 0x7f8d540f6530 2023-10-18T21:30:57.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.423+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/2866699872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5410ed70 con 0x7f8d540f6530 2023-10-18T21:30:57.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.423+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/2866699872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d54045ad0 con 0x7f8d540f6530 2023-10-18T21:30:57.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.424+0000 7f8d4affd700 1 -- 172.21.15.8:0/2866699872 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8d5001b060 con 0x7f8d540f6530 2023-10-18T21:30:57.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.425+0000 7f8d4affd700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d40060f70 0x7f8d40063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:30:57.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.425+0000 7f8d4affd700 1 -- 172.21.15.8:0/2866699872 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8d5007c7d0 con 0x7f8d540f6530 2023-10-18T21:30:57.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.425+0000 7f8d59adf700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d40060f70 0x7f8d40063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:30:57.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.426+0000 7f8d59adf700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d40060f70 0x7f8d40063430 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f8d44004630 tx=0x7f8d44009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:30:57.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.430+0000 7f8d4affd700 1 -- 172.21.15.8:0/2866699872 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8d5004c380 con 0x7f8d540f6530 2023-10-18T21:30:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.627+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/2866699872 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d540fee70 con 0x7f8d40060f70 2023-10-18T21:30:57.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.628+0000 7f8d4affd700 1 -- 172.21.15.8:0/2866699872 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8d44019040 con 0x7f8d40060f70 2023-10-18T21:30:57.630 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:30:57.630 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:30:57.630 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:30:57.630 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:30:57.631 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:30:57.631 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:30:57.631 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:30:57.631 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:30:57.631 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:30:57.632 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:30:57.632 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:30:57.632 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:30:57.632 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:30:57.632 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:30:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/2866699872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d40060f70 msgr2=0x7f8d40063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d40060f70 0x7f8d40063430 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f8d44004630 tx=0x7f8d44009b30).stop 2023-10-18T21:30:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/2866699872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d540f6530 msgr2=0x7f8d5406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:30:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d540f6530 0x7f8d5406b9a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f8d50002700 tx=0x7f8d50009d80).stop 2023-10-18T21:30:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/2866699872 shutdown_connections 2023-10-18T21:30:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d40060f70 0x7f8d40063430 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d540f6530 0x7f8d5406b9a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 --2- 172.21.15.8:0/2866699872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d540f77d0 0x7f8d54069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:30:57.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/2866699872 >> 172.21.15.8:0/2866699872 conn(0x7f8d540f1c90 msgr2=0x7f8d540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:30:57.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/2866699872 shutdown_connections 2023-10-18T21:30:57.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:30:57.630+0000 7f8d5b2e2700 1 -- 172.21.15.8:0/2866699872 wait complete. 2023-10-18T21:30:57.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:56.138611+0000 mgr.smithi008.flmjzp (mgr.14640) 1926 : audit [DBG] from='client.35708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:56.482487+0000 mgr.smithi008.flmjzp (mgr.14640) 1927 : audit [DBG] from='client.35712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:56.898594+0000 mon.smithi008 (mon.0) 2370 : audit [DBG] from='client.? 172.21.15.8:0/2668565741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.280735+0000 mon.smithi008 (mon.0) 2371 : audit [DBG] from='client.? 172.21.15.8:0/1465466672' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:30:57.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:56.138611+0000 mgr.smithi008.flmjzp (mgr.14640) 1926 : audit [DBG] from='client.35708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:56.482487+0000 mgr.smithi008.flmjzp (mgr.14640) 1927 : audit [DBG] from='client.35712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:56.898594+0000 mon.smithi008 (mon.0) 2370 : audit [DBG] from='client.? 172.21.15.8:0/2668565741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.280735+0000 mon.smithi008 (mon.0) 2371 : audit [DBG] from='client.? 172.21.15.8:0/1465466672' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:30:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.629235+0000 mgr.smithi008.flmjzp (mgr.14640) 1928 : audit [DBG] from='client.35724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:57.893100+0000 mgr.smithi008.flmjzp (mgr.14640) 1929 : cluster [DBG] pgmap v1333: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.921287+0000 mon.smithi008 (mon.0) 2372 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.922945+0000 mon.smithi008 (mon.0) 2373 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.923671+0000 mon.smithi008 (mon.0) 2374 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.929271+0000 mon.smithi008 (mon.0) 2375 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.934278+0000 mon.smithi008 (mon.0) 2376 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.936868+0000 mon.smithi008 (mon.0) 2377 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.938258+0000 mon.smithi008 (mon.0) 2378 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.939580+0000 mon.smithi008 (mon.0) 2379 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:30:57.941240+0000 mon.smithi008 (mon.0) 2380 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:58.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.629235+0000 mgr.smithi008.flmjzp (mgr.14640) 1928 : audit [DBG] from='client.35724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:30:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:57.893100+0000 mgr.smithi008.flmjzp (mgr.14640) 1929 : cluster [DBG] pgmap v1333: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.921287+0000 mon.smithi008 (mon.0) 2372 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.922945+0000 mon.smithi008 (mon.0) 2373 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:30:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.923671+0000 mon.smithi008 (mon.0) 2374 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:30:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.929271+0000 mon.smithi008 (mon.0) 2375 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:30:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.934278+0000 mon.smithi008 (mon.0) 2376 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:30:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.936868+0000 mon.smithi008 (mon.0) 2377 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.938258+0000 mon.smithi008 (mon.0) 2378 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.939580+0000 mon.smithi008 (mon.0) 2379 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:30:57.941240+0000 mon.smithi008 (mon.0) 2380 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:30:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:57.924284+0000 mgr.smithi008.flmjzp (mgr.14640) 1930 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:57.924710+0000 mgr.smithi008.flmjzp (mgr.14640) 1931 : cluster [DBG] pgmap v1334: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:57.924942+0000 mgr.smithi008.flmjzp (mgr.14640) 1932 : cluster [DBG] pgmap v1335: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:30:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:30:57.942874+0000 mgr.smithi008.flmjzp (mgr.14640) 1933 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:30:59.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:57.924284+0000 mgr.smithi008.flmjzp (mgr.14640) 1930 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:30:59.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:57.924710+0000 mgr.smithi008.flmjzp (mgr.14640) 1931 : cluster [DBG] pgmap v1334: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:57.924942+0000 mgr.smithi008.flmjzp (mgr.14640) 1932 : cluster [DBG] pgmap v1335: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:30:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:30:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:30:57.942874+0000 mgr.smithi008.flmjzp (mgr.14640) 1933 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:30:59.925514+0000 mgr.smithi008.flmjzp (mgr.14640) 1934 : cluster [DBG] pgmap v1336: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:30:59.925514+0000 mgr.smithi008.flmjzp (mgr.14640) 1934 : cluster [DBG] pgmap v1336: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:01.926196+0000 mgr.smithi008.flmjzp (mgr.14640) 1935 : cluster [DBG] pgmap v1337: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:01.926196+0000 mgr.smithi008.flmjzp (mgr.14640) 1935 : cluster [DBG] pgmap v1337: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:03.926879+0000 mgr.smithi008.flmjzp (mgr.14640) 1936 : cluster [DBG] pgmap v1338: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:05.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:03.926879+0000 mgr.smithi008.flmjzp (mgr.14640) 1936 : cluster [DBG] pgmap v1338: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:05.927404+0000 mgr.smithi008.flmjzp (mgr.14640) 1937 : cluster [DBG] pgmap v1339: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:07.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:05.927404+0000 mgr.smithi008.flmjzp (mgr.14640) 1937 : cluster [DBG] pgmap v1339: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:07.952734+0000 mon.smithi008 (mon.0) 2381 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:07.955062+0000 mon.smithi008 (mon.0) 2382 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:31:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:07.956173+0000 mon.smithi008 (mon.0) 2383 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:31:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:07.962559+0000 mon.smithi008 (mon.0) 2384 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:31:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:07.969249+0000 mon.smithi008 (mon.0) 2385 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:07.972515+0000 mon.smithi008 (mon.0) 2386 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:07.974340+0000 mon.smithi008 (mon.0) 2387 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:07.976058+0000 mon.smithi008 (mon.0) 2388 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:07.978133+0000 mon.smithi008 (mon.0) 2389 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:08.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:07.952734+0000 mon.smithi008 (mon.0) 2381 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:07.955062+0000 mon.smithi008 (mon.0) 2382 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:31:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:07.956173+0000 mon.smithi008 (mon.0) 2383 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:31:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:07.962559+0000 mon.smithi008 (mon.0) 2384 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:31:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:07.969249+0000 mon.smithi008 (mon.0) 2385 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:07.972515+0000 mon.smithi008 (mon.0) 2386 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:07.974340+0000 mon.smithi008 (mon.0) 2387 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:07.976058+0000 mon.smithi008 (mon.0) 2388 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:07.978133+0000 mon.smithi008 (mon.0) 2389 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:07.928110+0000 mgr.smithi008.flmjzp (mgr.14640) 1938 : cluster [DBG] pgmap v1340: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:07.957084+0000 mgr.smithi008.flmjzp (mgr.14640) 1939 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:31:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:07.957650+0000 mgr.smithi008.flmjzp (mgr.14640) 1940 : cluster [DBG] pgmap v1341: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:07.957873+0000 mgr.smithi008.flmjzp (mgr.14640) 1941 : cluster [DBG] pgmap v1342: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:07.980156+0000 mgr.smithi008.flmjzp (mgr.14640) 1942 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:09.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:07.928110+0000 mgr.smithi008.flmjzp (mgr.14640) 1938 : cluster [DBG] pgmap v1340: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:07.957084+0000 mgr.smithi008.flmjzp (mgr.14640) 1939 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:31:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:07.957650+0000 mgr.smithi008.flmjzp (mgr.14640) 1940 : cluster [DBG] pgmap v1341: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:07.957873+0000 mgr.smithi008.flmjzp (mgr.14640) 1941 : cluster [DBG] pgmap v1342: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:07.980156+0000 mgr.smithi008.flmjzp (mgr.14640) 1942 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:09.958501+0000 mgr.smithi008.flmjzp (mgr.14640) 1943 : cluster [DBG] pgmap v1343: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:09.958501+0000 mgr.smithi008.flmjzp (mgr.14640) 1943 : cluster [DBG] pgmap v1343: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:13.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:11.959121+0000 mgr.smithi008.flmjzp (mgr.14640) 1944 : cluster [DBG] pgmap v1344: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:13.747 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:11.959121+0000 mgr.smithi008.flmjzp (mgr.14640) 1944 : cluster [DBG] pgmap v1344: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:15.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:13.959851+0000 mgr.smithi008.flmjzp (mgr.14640) 1945 : cluster [DBG] pgmap v1345: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:13.959851+0000 mgr.smithi008.flmjzp (mgr.14640) 1945 : cluster [DBG] pgmap v1345: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:17.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:15.960525+0000 mgr.smithi008.flmjzp (mgr.14640) 1946 : cluster [DBG] pgmap v1346: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:15.960525+0000 mgr.smithi008.flmjzp (mgr.14640) 1946 : cluster [DBG] pgmap v1346: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:17.991016+0000 mon.smithi008 (mon.0) 2390 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:17.993092+0000 mon.smithi008 (mon.0) 2391 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:31:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:17.994257+0000 mon.smithi008 (mon.0) 2392 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:31:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:18.000934+0000 mon.smithi008 (mon.0) 2393 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:31:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:18.007487+0000 mon.smithi008 (mon.0) 2394 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:18.010575+0000 mon.smithi008 (mon.0) 2395 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:18.012293+0000 mon.smithi008 (mon.0) 2396 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:18.013923+0000 mon.smithi008 (mon.0) 2397 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:18.015872+0000 mon.smithi008 (mon.0) 2398 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:18.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:17.991016+0000 mon.smithi008 (mon.0) 2390 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:18.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:17.993092+0000 mon.smithi008 (mon.0) 2391 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:31:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:17.994257+0000 mon.smithi008 (mon.0) 2392 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:31:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:18.000934+0000 mon.smithi008 (mon.0) 2393 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:31:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:18.007487+0000 mon.smithi008 (mon.0) 2394 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:18.010575+0000 mon.smithi008 (mon.0) 2395 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:18.012293+0000 mon.smithi008 (mon.0) 2396 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:18.013923+0000 mon.smithi008 (mon.0) 2397 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:18.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:18.015872+0000 mon.smithi008 (mon.0) 2398 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:19.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:17.960982+0000 mgr.smithi008.flmjzp (mgr.14640) 1947 : cluster [DBG] pgmap v1347: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:17.995208+0000 mgr.smithi008.flmjzp (mgr.14640) 1948 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:31:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:17.995838+0000 mgr.smithi008.flmjzp (mgr.14640) 1949 : cluster [DBG] pgmap v1348: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:17.996108+0000 mgr.smithi008.flmjzp (mgr.14640) 1950 : cluster [DBG] pgmap v1349: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:18.017806+0000 mgr.smithi008.flmjzp (mgr.14640) 1951 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:17.960982+0000 mgr.smithi008.flmjzp (mgr.14640) 1947 : cluster [DBG] pgmap v1347: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:17.995208+0000 mgr.smithi008.flmjzp (mgr.14640) 1948 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:31:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:17.995838+0000 mgr.smithi008.flmjzp (mgr.14640) 1949 : cluster [DBG] pgmap v1348: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:17.996108+0000 mgr.smithi008.flmjzp (mgr.14640) 1950 : cluster [DBG] pgmap v1349: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:18.017806+0000 mgr.smithi008.flmjzp (mgr.14640) 1951 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:21.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:19.996682+0000 mgr.smithi008.flmjzp (mgr.14640) 1952 : cluster [DBG] pgmap v1350: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:19.996682+0000 mgr.smithi008.flmjzp (mgr.14640) 1952 : cluster [DBG] pgmap v1350: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:23.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:21.997304+0000 mgr.smithi008.flmjzp (mgr.14640) 1953 : cluster [DBG] pgmap v1351: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:23.747 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:21.997304+0000 mgr.smithi008.flmjzp (mgr.14640) 1953 : cluster [DBG] pgmap v1351: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:25.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:23.997959+0000 mgr.smithi008.flmjzp (mgr.14640) 1954 : cluster [DBG] pgmap v1352: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:25.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:23.997959+0000 mgr.smithi008.flmjzp (mgr.14640) 1954 : cluster [DBG] pgmap v1352: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:27.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:25.998643+0000 mgr.smithi008.flmjzp (mgr.14640) 1955 : cluster [DBG] pgmap v1353: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:27.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.784+0000 7ff4ee822700 1 -- 172.21.15.8:0/3781520817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e80f9690 msgr2=0x7ff4e80fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:27.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.784+0000 7ff4ee822700 1 --2- 172.21.15.8:0/3781520817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e80f9690 0x7ff4e80fbae0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7ff4d8004660 tx=0x7ff4d8009b30).stop 2023-10-18T21:31:27.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.784+0000 7ff4ee822700 1 -- 172.21.15.8:0/3781520817 shutdown_connections 2023-10-18T21:31:27.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.784+0000 7ff4ee822700 1 --2- 172.21.15.8:0/3781520817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e80f9690 0x7ff4e80fbae0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:27.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.784+0000 7ff4ee822700 1 --2- 172.21.15.8:0/3781520817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4e8060310 0x7ff4e80f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:27.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.784+0000 7ff4ee822700 1 -- 172.21.15.8:0/3781520817 >> 172.21.15.8:0/3781520817 conn(0x7ff4e80f0b90 msgr2=0x7ff4e80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:27.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.784+0000 7ff4ee822700 1 -- 172.21.15.8:0/3781520817 shutdown_connections 2023-10-18T21:31:27.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.784+0000 7ff4ee822700 1 -- 172.21.15.8:0/3781520817 wait complete. 2023-10-18T21:31:27.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.785+0000 7ff4ee822700 1 Processor -- start 2023-10-18T21:31:27.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.785+0000 7ff4ee822700 1 -- start start 2023-10-18T21:31:27.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.785+0000 7ff4ee822700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4e8060310 0x7ff4e8106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:27.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.785+0000 7ff4ee822700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e80f9690 0x7ff4e81072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:27.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.785+0000 7ff4ee822700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e81078b0 con 0x7ff4e80f9690 2023-10-18T21:31:27.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.785+0000 7ff4ee822700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e81080f0 con 0x7ff4e8060310 2023-10-18T21:31:27.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.786+0000 7ff4ed01f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e80f9690 0x7ff4e81072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.786+0000 7ff4ed01f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e80f9690 0x7ff4e81072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58662/0 (socket says 172.21.15.8:58662) 2023-10-18T21:31:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.786+0000 7ff4ed01f700 1 -- 172.21.15.8:0/58568394 learned_addr learned my addr 172.21.15.8:0/58568394 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:31:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.786+0000 7ff4ed820700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4e8060310 0x7ff4e8106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.786+0000 7ff4ed01f700 1 -- 172.21.15.8:0/58568394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4e8060310 msgr2=0x7ff4e8106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.786+0000 7ff4ed01f700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4e8060310 0x7ff4e8106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.786+0000 7ff4ed01f700 1 -- 172.21.15.8:0/58568394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d8005040 con 0x7ff4e80f9690 2023-10-18T21:31:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.786+0000 7ff4ed01f700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e80f9690 0x7ff4e81072b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7ff4d8004e30 tx=0x7ff4d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.786+0000 7ff4de7fc700 1 -- 172.21.15.8:0/58568394 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4d8018070 con 0x7ff4e80f9690 2023-10-18T21:31:27.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.787+0000 7ff4de7fc700 1 -- 172.21.15.8:0/58568394 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff4d8009630 con 0x7ff4e80f9690 2023-10-18T21:31:27.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.787+0000 7ff4ee822700 1 -- 172.21.15.8:0/58568394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e8108370 con 0x7ff4e80f9690 2023-10-18T21:31:27.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.787+0000 7ff4de7fc700 1 -- 172.21.15.8:0/58568394 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4d801c3c0 con 0x7ff4e80f9690 2023-10-18T21:31:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.787+0000 7ff4ee822700 1 -- 172.21.15.8:0/58568394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e8108850 con 0x7ff4e80f9690 2023-10-18T21:31:27.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.788+0000 7ff4ee822700 1 -- 172.21.15.8:0/58568394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e8059100 con 0x7ff4e80f9690 2023-10-18T21:31:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.789+0000 7ff4de7fc700 1 -- 172.21.15.8:0/58568394 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff4d801d420 con 0x7ff4e80f9690 2023-10-18T21:31:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.790+0000 7ff4de7fc700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 0x7ff4d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.790+0000 7ff4de7fc700 1 -- 172.21.15.8:0/58568394 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff4d807e3d0 con 0x7ff4e80f9690 2023-10-18T21:31:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.790+0000 7ff4ed820700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 0x7ff4d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.790+0000 7ff4ed820700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 0x7ff4d4063430 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7ff4e8107b80 tx=0x7ff4e400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.794+0000 7ff4de7fc700 1 -- 172.21.15.8:0/58568394 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff4d804e0c0 con 0x7ff4e80f9690 2023-10-18T21:31:27.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:25.998643+0000 mgr.smithi008.flmjzp (mgr.14640) 1955 : cluster [DBG] pgmap v1353: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:27.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.994+0000 7ff4ee822700 1 -- 172.21.15.8:0/58568394 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4e80008d0 con 0x7ff4d4060f70 2023-10-18T21:31:27.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.995+0000 7ff4de7fc700 1 -- 172.21.15.8:0/58568394 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff4e80008d0 con 0x7ff4d4060f70 2023-10-18T21:31:27.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 -- 172.21.15.8:0/58568394 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 msgr2=0x7ff4d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:27.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 0x7ff4d4063430 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7ff4e8107b80 tx=0x7ff4e400b040).stop 2023-10-18T21:31:27.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 -- 172.21.15.8:0/58568394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e80f9690 msgr2=0x7ff4e81072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:27.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e80f9690 0x7ff4e81072b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7ff4d8004e30 tx=0x7ff4d8009b30).stop 2023-10-18T21:31:27.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 -- 172.21.15.8:0/58568394 shutdown_connections 2023-10-18T21:31:27.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff4d4060f70 0x7ff4d4063430 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4e8060310 0x7ff4e8106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 --2- 172.21.15.8:0/58568394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4e80f9690 0x7ff4e81072b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 -- 172.21.15.8:0/58568394 >> 172.21.15.8:0/58568394 conn(0x7ff4e80f0b90 msgr2=0x7ff4e80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:28.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 -- 172.21.15.8:0/58568394 shutdown_connections 2023-10-18T21:31:28.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:27.997+0000 7ff4ee822700 1 -- 172.21.15.8:0/58568394 wait complete. 2023-10-18T21:31:28.012 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:31:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.137+0000 7f84da14b700 1 -- 172.21.15.8:0/1958439386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84d40f77d0 msgr2=0x7f84d40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:28.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.137+0000 7f84da14b700 1 --2- 172.21.15.8:0/1958439386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84d40f77d0 0x7f84d40f7c30 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f84c4004660 tx=0x7f84c4009b30).stop 2023-10-18T21:31:28.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.137+0000 7f84da14b700 1 -- 172.21.15.8:0/1958439386 shutdown_connections 2023-10-18T21:31:28.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.137+0000 7f84da14b700 1 --2- 172.21.15.8:0/1958439386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84d40f77d0 0x7f84d40f7c30 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.137+0000 7f84da14b700 1 --2- 172.21.15.8:0/1958439386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84d40f6530 0x7f84d40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.137+0000 7f84da14b700 1 -- 172.21.15.8:0/1958439386 >> 172.21.15.8:0/1958439386 conn(0x7f84d40f1c90 msgr2=0x7f84d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:28.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.137+0000 7f84da14b700 1 -- 172.21.15.8:0/1958439386 shutdown_connections 2023-10-18T21:31:28.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.137+0000 7f84da14b700 1 -- 172.21.15.8:0/1958439386 wait complete. 2023-10-18T21:31:28.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.138+0000 7f84da14b700 1 Processor -- start 2023-10-18T21:31:28.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.138+0000 7f84da14b700 1 -- start start 2023-10-18T21:31:28.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.139+0000 7f84da14b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84d40f6530 0x7f84d406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:28.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.139+0000 7f84da14b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84d40f77d0 0x7f84d4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.139+0000 7f84da14b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d406a380 con 0x7f84d40f6530 2023-10-18T21:31:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.139+0000 7f84da14b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d406a4c0 con 0x7f84d40f77d0 2023-10-18T21:31:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.139+0000 7f84d9149700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84d40f6530 0x7f84d406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.139+0000 7f84d9149700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84d40f6530 0x7f84d406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58692/0 (socket says 172.21.15.8:58692) 2023-10-18T21:31:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.139+0000 7f84d9149700 1 -- 172.21.15.8:0/2128493622 learned_addr learned my addr 172.21.15.8:0/2128493622 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:31:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.139+0000 7f84d8948700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84d40f77d0 0x7f84d4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.140+0000 7f84d9149700 1 -- 172.21.15.8:0/2128493622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84d40f77d0 msgr2=0x7f84d4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.140+0000 7f84d9149700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84d40f77d0 0x7f84d4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.140+0000 7f84d9149700 1 -- 172.21.15.8:0/2128493622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4005040 con 0x7f84d40f6530 2023-10-18T21:31:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.140+0000 7f84d9149700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84d40f6530 0x7f84d406b9a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f84d0002700 tx=0x7f84d0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.140+0000 7f84c9ffb700 1 -- 172.21.15.8:0/2128493622 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84d00079c0 con 0x7f84d40f6530 2023-10-18T21:31:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.140+0000 7f84c9ffb700 1 -- 172.21.15.8:0/2128493622 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f84d000f040 con 0x7f84d40f6530 2023-10-18T21:31:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.140+0000 7f84c9ffb700 1 -- 172.21.15.8:0/2128493622 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84d00148d0 con 0x7f84d40f6530 2023-10-18T21:31:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.140+0000 7f84da14b700 1 -- 172.21.15.8:0/2128493622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d406a7a0 con 0x7f84d40f6530 2023-10-18T21:31:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.140+0000 7f84da14b700 1 -- 172.21.15.8:0/2128493622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d410ed20 con 0x7f84d40f6530 2023-10-18T21:31:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.142+0000 7f84da14b700 1 -- 172.21.15.8:0/2128493622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d4045ad0 con 0x7f84d40f6530 2023-10-18T21:31:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.143+0000 7f84c9ffb700 1 -- 172.21.15.8:0/2128493622 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f84d001b060 con 0x7f84d40f6530 2023-10-18T21:31:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.144+0000 7f84c9ffb700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f84c0060f70 0x7f84c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.144+0000 7f84c9ffb700 1 -- 172.21.15.8:0/2128493622 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f84d007c6e0 con 0x7f84d40f6530 2023-10-18T21:31:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.145+0000 7f84d8948700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f84c0060f70 0x7f84c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.145+0000 7f84d8948700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f84c0060f70 0x7f84c0063430 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f84c4004630 tx=0x7f84c4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.152+0000 7f84c9ffb700 1 -- 172.21.15.8:0/2128493622 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f84d004c3d0 con 0x7f84d40f6530 2023-10-18T21:31:28.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.360+0000 7f84da14b700 1 -- 172.21.15.8:0/2128493622 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84d40fee70 con 0x7f84c0060f70 2023-10-18T21:31:28.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.362+0000 7f84c9ffb700 1 -- 172.21.15.8:0/2128493622 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f84c4019040 con 0x7f84c0060f70 2023-10-18T21:31:28.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 -- 172.21.15.8:0/2128493622 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f84c0060f70 msgr2=0x7f84c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:28.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f84c0060f70 0x7f84c0063430 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f84c4004630 tx=0x7f84c4009b30).stop 2023-10-18T21:31:28.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 -- 172.21.15.8:0/2128493622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84d40f6530 msgr2=0x7f84d406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:28.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84d40f6530 0x7f84d406b9a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f84d0002700 tx=0x7f84d0009e00).stop 2023-10-18T21:31:28.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 -- 172.21.15.8:0/2128493622 shutdown_connections 2023-10-18T21:31:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f84c0060f70 0x7f84c0063430 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84d40f6530 0x7f84d406b9a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 --2- 172.21.15.8:0/2128493622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84d40f77d0 0x7f84d4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 -- 172.21.15.8:0/2128493622 >> 172.21.15.8:0/2128493622 conn(0x7f84d40f1c90 msgr2=0x7f84d40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 -- 172.21.15.8:0/2128493622 shutdown_connections 2023-10-18T21:31:28.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.364+0000 7f84da14b700 1 -- 172.21.15.8:0/2128493622 wait complete. 2023-10-18T21:31:28.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.503+0000 7f20af59e700 1 -- 172.21.15.8:0/533978759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20b006a350 msgr2=0x7f20b006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:28.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.503+0000 7f20af59e700 1 --2- 172.21.15.8:0/533978759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20b006a350 0x7f20b006a7d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f20a4004660 tx=0x7f20a4009b30).stop 2023-10-18T21:31:28.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.503+0000 7f20af59e700 1 -- 172.21.15.8:0/533978759 shutdown_connections 2023-10-18T21:31:28.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.503+0000 7f20af59e700 1 --2- 172.21.15.8:0/533978759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20b006a350 0x7f20b006a7d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.503+0000 7f20af59e700 1 --2- 172.21.15.8:0/533978759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20b006b960 0x7f20b0069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.503+0000 7f20af59e700 1 -- 172.21.15.8:0/533978759 >> 172.21.15.8:0/533978759 conn(0x7f20b00f1c90 msgr2=0x7f20b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:28.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.503+0000 7f20af59e700 1 -- 172.21.15.8:0/533978759 shutdown_connections 2023-10-18T21:31:28.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.504+0000 7f20af59e700 1 -- 172.21.15.8:0/533978759 wait complete. 2023-10-18T21:31:28.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.504+0000 7f20af59e700 1 Processor -- start 2023-10-18T21:31:28.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.505+0000 7f20af59e700 1 -- start start 2023-10-18T21:31:28.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.505+0000 7f20af59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20b006a350 0x7f20b0108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:28.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.505+0000 7f20af59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20b006b960 0x7f20b01093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:28.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.505+0000 7f20af59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b01099a0 con 0x7f20b006a350 2023-10-18T21:31:28.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.505+0000 7f20af59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0109ae0 con 0x7f20b006b960 2023-10-18T21:31:28.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.505+0000 7f20ae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20b006a350 0x7f20b0108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:28.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.505+0000 7f20ae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20b006a350 0x7f20b0108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58716/0 (socket says 172.21.15.8:58716) 2023-10-18T21:31:28.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.505+0000 7f20ae59c700 1 -- 172.21.15.8:0/991004408 learned_addr learned my addr 172.21.15.8:0/991004408 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:31:28.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.505+0000 7f20add9b700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20b006b960 0x7f20b01093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:28.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.506+0000 7f20ae59c700 1 -- 172.21.15.8:0/991004408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20b006b960 msgr2=0x7f20b01093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:28.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.506+0000 7f20ae59c700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20b006b960 0x7f20b01093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.506+0000 7f20ae59c700 1 -- 172.21.15.8:0/991004408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a4005040 con 0x7f20b006a350 2023-10-18T21:31:28.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.506+0000 7f20add9b700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20b006b960 0x7f20b01093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:31:28.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.506+0000 7f20ae59c700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20b006a350 0x7f20b0108f00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f20a000e7f0 tx=0x7f20a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:28.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.506+0000 7f209effd700 1 -- 172.21.15.8:0/991004408 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a00092e0 con 0x7f20b006a350 2023-10-18T21:31:28.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.506+0000 7f209effd700 1 -- 172.21.15.8:0/991004408 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f20a000f040 con 0x7f20b006a350 2023-10-18T21:31:28.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.506+0000 7f209effd700 1 -- 172.21.15.8:0/991004408 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a00147e0 con 0x7f20b006a350 2023-10-18T21:31:28.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.506+0000 7f20af59e700 1 -- 172.21.15.8:0/991004408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b010a480 con 0x7f20b006a350 2023-10-18T21:31:28.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.506+0000 7f20af59e700 1 -- 172.21.15.8:0/991004408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b010a9c0 con 0x7f20b006a350 2023-10-18T21:31:28.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.508+0000 7f20af59e700 1 -- 172.21.15.8:0/991004408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b0045ad0 con 0x7f20b006a350 2023-10-18T21:31:28.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.508+0000 7f209effd700 1 -- 172.21.15.8:0/991004408 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f20a001b030 con 0x7f20b006a350 2023-10-18T21:31:28.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.509+0000 7f209effd700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2098060f70 0x7f2098063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:28.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.509+0000 7f209effd700 1 -- 172.21.15.8:0/991004408 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f20a007c7b0 con 0x7f20b006a350 2023-10-18T21:31:28.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.509+0000 7f20add9b700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2098060f70 0x7f2098063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:28.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.510+0000 7f20add9b700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2098060f70 0x7f2098063430 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f20a4009880 tx=0x7f20a400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:28.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.513+0000 7f209effd700 1 -- 172.21.15.8:0/991004408 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f20a004fe80 con 0x7f20b006a350 2023-10-18T21:31:28.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.028062+0000 mon.smithi008 (mon.0) 2399 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.717+0000 7f20af59e700 1 -- 172.21.15.8:0/991004408 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f20b010abe0 con 0x7f2098060f70 2023-10-18T21:31:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.726+0000 7f209effd700 1 -- 172.21.15.8:0/991004408 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f20b010abe0 con 0x7f2098060f70 2023-10-18T21:31:28.727 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:31:28.727 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (38m) 6m ago 39m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:31:28.728 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (32m) 6m ago 39m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:31:28.728 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (31m) 3m ago 38m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:31:28.728 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (38m) 6m ago 39m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:31:28.728 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 35m - - 2023-10-18T21:31:28.729 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 35m - - 2023-10-18T21:31:28.729 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 35m - - 2023-10-18T21:31:28.729 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 35m - - 2023-10-18T21:31:28.729 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (33m) 6m ago 40m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:31:28.729 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (32m) 3m ago 38m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:31:28.730 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (32m) 6m ago 41m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:31:28.730 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (32m) 3m ago 38m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:31:28.730 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (39m) 6m ago 39m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:31:28.730 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (38m) 3m ago 38m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:31:28.730 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (31m) 6m ago 38m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:31:28.731 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (29m) 6m ago 37m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:31:28.731 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (29m) 6m ago 37m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:31:28.731 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (28m) 3m ago 37m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:31:28.731 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (28m) 3m ago 37m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:31:28.731 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (27m) 3m ago 36m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:31:28.732 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (33m) 6m ago 38m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:31:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.728+0000 7f20af59e700 1 -- 172.21.15.8:0/991004408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2098060f70 msgr2=0x7f2098063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:28.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.728+0000 7f20af59e700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2098060f70 0x7f2098063430 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f20a4009880 tx=0x7f20a400b040).stop 2023-10-18T21:31:28.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.728+0000 7f20af59e700 1 -- 172.21.15.8:0/991004408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20b006a350 msgr2=0x7f20b0108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:28.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.728+0000 7f20af59e700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20b006a350 0x7f20b0108f00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f20a000e7f0 tx=0x7f20a000b040).stop 2023-10-18T21:31:28.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.728+0000 7f20af59e700 1 -- 172.21.15.8:0/991004408 shutdown_connections 2023-10-18T21:31:28.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.728+0000 7f20af59e700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2098060f70 0x7f2098063430 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.729+0000 7f20af59e700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20b006a350 0x7f20b0108f00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.729+0000 7f20af59e700 1 --2- 172.21.15.8:0/991004408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20b006b960 0x7f20b01093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.729+0000 7f20af59e700 1 -- 172.21.15.8:0/991004408 >> 172.21.15.8:0/991004408 conn(0x7f20b00f1c90 msgr2=0x7f20b00fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:28.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.729+0000 7f20af59e700 1 -- 172.21.15.8:0/991004408 shutdown_connections 2023-10-18T21:31:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.729+0000 7f20af59e700 1 -- 172.21.15.8:0/991004408 wait complete. 2023-10-18T21:31:28.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.028062+0000 mon.smithi008 (mon.0) 2399 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:28.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.865+0000 7fded4997700 1 -- 172.21.15.8:0/1391504635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fded00f6530 msgr2=0x7fded00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.865+0000 7fded4997700 1 --2- 172.21.15.8:0/1391504635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fded00f6530 0x7fded00f6950 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fdec0004660 tx=0x7fdec0009b30).stop 2023-10-18T21:31:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.865+0000 7fded4997700 1 -- 172.21.15.8:0/1391504635 shutdown_connections 2023-10-18T21:31:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.865+0000 7fded4997700 1 --2- 172.21.15.8:0/1391504635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded00f77d0 0x7fded00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:31:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.865+0000 7fded4997700 1 --2- 172.21.15.8:0/1391504635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fded00f6530 0x7fded00f6950 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.865+0000 7fded4997700 1 -- 172.21.15.8:0/1391504635 >> 172.21.15.8:0/1391504635 conn(0x7fded00f1c90 msgr2=0x7fded00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.866+0000 7fded4997700 1 -- 172.21.15.8:0/1391504635 shutdown_connections 2023-10-18T21:31:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.866+0000 7fded4997700 1 -- 172.21.15.8:0/1391504635 wait complete. 2023-10-18T21:31:28.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.866+0000 7fded4997700 1 Processor -- start 2023-10-18T21:31:28.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.867+0000 7fded4997700 1 -- start start 2023-10-18T21:31:28.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.867+0000 7fded4997700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fded00f6530 0x7fded0108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:28.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.867+0000 7fded4997700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded00f77d0 0x7fded01094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:28.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.867+0000 7fded4997700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded0109af0 con 0x7fded00f6530 2023-10-18T21:31:28.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.867+0000 7fded4997700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded010a3a0 con 0x7fded00f77d0 2023-10-18T21:31:28.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.867+0000 7fdecf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fded00f6530 0x7fded0108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:28.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.867+0000 7fdecf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fded00f6530 0x7fded0108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58732/0 (socket says 172.21.15.8:58732) 2023-10-18T21:31:28.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.867+0000 7fdecf7fe700 1 -- 172.21.15.8:0/3814870601 learned_addr learned my addr 172.21.15.8:0/3814870601 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:31:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.867+0000 7fdeceffd700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded00f77d0 0x7fded01094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.868+0000 7fdecf7fe700 1 -- 172.21.15.8:0/3814870601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded00f77d0 msgr2=0x7fded01094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.868+0000 7fdecf7fe700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded00f77d0 0x7fded01094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.868+0000 7fdecf7fe700 1 -- 172.21.15.8:0/3814870601 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec0005040 con 0x7fded00f6530 2023-10-18T21:31:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.868+0000 7fdecf7fe700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fded00f6530 0x7fded0108fc0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fdec0007a70 tx=0x7fdec0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:28.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.868+0000 7fdeb7fff700 1 -- 172.21.15.8:0/3814870601 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec0018070 con 0x7fded00f6530 2023-10-18T21:31:28.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.868+0000 7fdeb7fff700 1 -- 172.21.15.8:0/3814870601 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdec001d8e0 con 0x7fded00f6530 2023-10-18T21:31:28.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.868+0000 7fdeb7fff700 1 -- 172.21.15.8:0/3814870601 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec001c660 con 0x7fded00f6530 2023-10-18T21:31:28.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.868+0000 7fded4997700 1 -- 172.21.15.8:0/3814870601 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded010a620 con 0x7fded00f6530 2023-10-18T21:31:28.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.868+0000 7fded4997700 1 -- 172.21.15.8:0/3814870601 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded010ab80 con 0x7fded00f6530 2023-10-18T21:31:28.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.869+0000 7fded4997700 1 -- 172.21.15.8:0/3814870601 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded0059100 con 0x7fded00f6530 2023-10-18T21:31:28.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.870+0000 7fdeb7fff700 1 -- 172.21.15.8:0/3814870601 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdec001da50 con 0x7fded00f6530 2023-10-18T21:31:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.871+0000 7fdeb7fff700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdeb8060f70 0x7fdeb8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.871+0000 7fdeb7fff700 1 -- 172.21.15.8:0/3814870601 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdec007e8c0 con 0x7fded00f6530 2023-10-18T21:31:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.871+0000 7fdeceffd700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdeb8060f70 0x7fdeb8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.872+0000 7fdeceffd700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdeb8060f70 0x7fdeb8063430 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fdec400b790 tx=0x7fdec4008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:28.876+0000 7fdeb7fff700 1 -- 172.21.15.8:0/3814870601 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdec0051f20 con 0x7fded00f6530 2023-10-18T21:31:29.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.125+0000 7fded4997700 1 -- 172.21.15.8:0/3814870601 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fded0045ad0 con 0x7fded00f6530 2023-10-18T21:31:29.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.126+0000 7fdeb7fff700 1 -- 172.21.15.8:0/3814870601 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fdec001dce0 con 0x7fded00f6530 2023-10-18T21:31:29.127 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:31:29.127 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:31:29.127 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:31:29.127 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:31:29.128 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:31:29.128 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:31:29.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:31:29.128 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:31:29.128 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:31:29.129 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:31:29.129 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:31:29.129 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:31:29.129 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:31:29.129 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:31:29.129 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:31:29.130 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:31:29.130 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:31:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 -- 172.21.15.8:0/3814870601 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdeb8060f70 msgr2=0x7fdeb8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdeb8060f70 0x7fdeb8063430 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fdec400b790 tx=0x7fdec4008040).stop 2023-10-18T21:31:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 -- 172.21.15.8:0/3814870601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fded00f6530 msgr2=0x7fded0108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fded00f6530 0x7fded0108fc0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fdec0007a70 tx=0x7fdec0009b30).stop 2023-10-18T21:31:29.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 -- 172.21.15.8:0/3814870601 shutdown_connections 2023-10-18T21:31:29.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdeb8060f70 0x7fdeb8063430 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fded00f6530 0x7fded0108fc0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 --2- 172.21.15.8:0/3814870601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded00f77d0 0x7fded01094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 -- 172.21.15.8:0/3814870601 >> 172.21.15.8:0/3814870601 conn(0x7fded00f1c90 msgr2=0x7fded006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:29.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 -- 172.21.15.8:0/3814870601 shutdown_connections 2023-10-18T21:31:29.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.128+0000 7fded4997700 1 -- 172.21.15.8:0/3814870601 wait complete. 2023-10-18T21:31:29.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.264+0000 7fa042859700 1 -- 172.21.15.8:0/3053191116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa03c0f6530 msgr2=0x7fa03c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:29.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.264+0000 7fa042859700 1 --2- 172.21.15.8:0/3053191116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa03c0f6530 0x7fa03c0f6950 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fa038004660 tx=0x7fa038009b30).stop 2023-10-18T21:31:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.264+0000 7fa042859700 1 -- 172.21.15.8:0/3053191116 shutdown_connections 2023-10-18T21:31:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.264+0000 7fa042859700 1 --2- 172.21.15.8:0/3053191116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa03c0f77d0 0x7fa03c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.264+0000 7fa042859700 1 --2- 172.21.15.8:0/3053191116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa03c0f6530 0x7fa03c0f6950 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.264+0000 7fa042859700 1 -- 172.21.15.8:0/3053191116 >> 172.21.15.8:0/3053191116 conn(0x7fa03c0f1c90 msgr2=0x7fa03c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.264+0000 7fa042859700 1 -- 172.21.15.8:0/3053191116 shutdown_connections 2023-10-18T21:31:29.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.264+0000 7fa042859700 1 -- 172.21.15.8:0/3053191116 wait complete. 2023-10-18T21:31:29.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.265+0000 7fa042859700 1 Processor -- start 2023-10-18T21:31:29.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.265+0000 7fa042859700 1 -- start start 2023-10-18T21:31:29.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa042859700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa03c0f6530 0x7fa03c106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:29.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa042859700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa03c0f77d0 0x7fa03c107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:29.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa042859700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c107870 con 0x7fa03c0f77d0 2023-10-18T21:31:29.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa042859700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c1080b0 con 0x7fa03c0f6530 2023-10-18T21:31:29.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa041056700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa03c0f77d0 0x7fa03c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa041056700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa03c0f77d0 0x7fa03c107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58748/0 (socket says 172.21.15.8:58748) 2023-10-18T21:31:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa041056700 1 -- 172.21.15.8:0/1372147175 learned_addr learned my addr 172.21.15.8:0/1372147175 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:31:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa041857700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa03c0f6530 0x7fa03c106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa041056700 1 -- 172.21.15.8:0/1372147175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa03c0f6530 msgr2=0x7fa03c106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa041056700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa03c0f6530 0x7fa03c106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa041056700 1 -- 172.21.15.8:0/1372147175 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa038005040 con 0x7fa03c0f77d0 2023-10-18T21:31:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.266+0000 7fa041056700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa03c0f77d0 0x7fa03c107270 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fa02c00e7f0 tx=0x7fa02c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.267+0000 7fa0327fc700 1 -- 172.21.15.8:0/1372147175 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa02c0092e0 con 0x7fa03c0f77d0 2023-10-18T21:31:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.267+0000 7fa0327fc700 1 -- 172.21.15.8:0/1372147175 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa02c00f040 con 0x7fa03c0f77d0 2023-10-18T21:31:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.267+0000 7fa0327fc700 1 -- 172.21.15.8:0/1372147175 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa02c0147e0 con 0x7fa03c0f77d0 2023-10-18T21:31:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.267+0000 7fa042859700 1 -- 172.21.15.8:0/1372147175 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c108390 con 0x7fa03c0f77d0 2023-10-18T21:31:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.267+0000 7fa042859700 1 -- 172.21.15.8:0/1372147175 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c1088d0 con 0x7fa03c0f77d0 2023-10-18T21:31:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.268+0000 7fa042859700 1 -- 172.21.15.8:0/1372147175 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c059100 con 0x7fa03c0f77d0 2023-10-18T21:31:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.269+0000 7fa0327fc700 1 -- 172.21.15.8:0/1372147175 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa02c01b030 con 0x7fa03c0f77d0 2023-10-18T21:31:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.270+0000 7fa0327fc700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa028060f70 0x7fa028063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.270+0000 7fa0327fc700 1 -- 172.21.15.8:0/1372147175 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa02c07c6b0 con 0x7fa03c0f77d0 2023-10-18T21:31:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.270+0000 7fa041857700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa028060f70 0x7fa028063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:29.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.271+0000 7fa041857700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa028060f70 0x7fa028063430 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fa038005010 tx=0x7fa038016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:29.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.274+0000 7fa0327fc700 1 -- 172.21.15.8:0/1372147175 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa02c04c310 con 0x7fa03c0f77d0 2023-10-18T21:31:29.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.504+0000 7fa042859700 1 -- 172.21.15.8:0/1372147175 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa03c0fecc0 con 0x7fa03c0f77d0 2023-10-18T21:31:29.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.505+0000 7fa0327fc700 1 -- 172.21.15.8:0/1372147175 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fa02c019070 con 0x7fa03c0f77d0 2023-10-18T21:31:29.506 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:31:29.506 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:31:29.506 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:31:29.507 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:31:29.507 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:31:29.507 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:31:29.507 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:31:29.507 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:31:29.508 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:31:29.508 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:31:29.508 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:31:29.508 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:31:29.508 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:31:29.509 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:31:29.509 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:31:29.509 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:31:29.509 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:31:29.510 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:31:29.510 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:31:29.510 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:31:29.510 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:31:29.511 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:31:29.511 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:31:29.511 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:31:29.511 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:31:29.511 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:31:29.511 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:31:29.512 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:31:29.512 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:31:29.512 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:31:29.512 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:31:29.513 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:31:29.513 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:31:29.513 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:31:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 -- 172.21.15.8:0/1372147175 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa028060f70 msgr2=0x7fa028063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa028060f70 0x7fa028063430 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fa038005010 tx=0x7fa038016040).stop 2023-10-18T21:31:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 -- 172.21.15.8:0/1372147175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa03c0f77d0 msgr2=0x7fa03c107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa03c0f77d0 0x7fa03c107270 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fa02c00e7f0 tx=0x7fa02c00b040).stop 2023-10-18T21:31:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 -- 172.21.15.8:0/1372147175 shutdown_connections 2023-10-18T21:31:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa028060f70 0x7fa028063430 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa03c0f6530 0x7fa03c106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 --2- 172.21.15.8:0/1372147175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa03c0f77d0 0x7fa03c107270 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 -- 172.21.15.8:0/1372147175 >> 172.21.15.8:0/1372147175 conn(0x7fa03c0f1c90 msgr2=0x7fa03c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 -- 172.21.15.8:0/1372147175 shutdown_connections 2023-10-18T21:31:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.507+0000 7fa042859700 1 -- 172.21.15.8:0/1372147175 wait complete. 2023-10-18T21:31:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:31:29.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.645+0000 7f24da209700 1 -- 172.21.15.8:0/2545858477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24d406a330 msgr2=0x7f24d406a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:29.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.645+0000 7f24da209700 1 --2- 172.21.15.8:0/2545858477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24d406a330 0x7f24d406a7b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f24c4004660 tx=0x7f24c4009b30).stop 2023-10-18T21:31:29.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.645+0000 7f24da209700 1 -- 172.21.15.8:0/2545858477 shutdown_connections 2023-10-18T21:31:29.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.645+0000 7f24da209700 1 --2- 172.21.15.8:0/2545858477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24d406a330 0x7f24d406a7b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.645+0000 7f24da209700 1 --2- 172.21.15.8:0/2545858477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24d406b940 0x7f24d4069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.645+0000 7f24da209700 1 -- 172.21.15.8:0/2545858477 >> 172.21.15.8:0/2545858477 conn(0x7f24d40f1c90 msgr2=0x7f24d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:29.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.645+0000 7f24da209700 1 -- 172.21.15.8:0/2545858477 shutdown_connections 2023-10-18T21:31:29.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.645+0000 7f24da209700 1 -- 172.21.15.8:0/2545858477 wait complete. 2023-10-18T21:31:29.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.646+0000 7f24da209700 1 Processor -- start 2023-10-18T21:31:29.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.646+0000 7f24da209700 1 -- start start 2023-10-18T21:31:29.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.647+0000 7f24da209700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24d406a330 0x7f24d4108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:29.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.647+0000 7f24da209700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24d406b940 0x7f24d4109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:29.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.647+0000 7f24da209700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41099d0 con 0x7f24d406b940 2023-10-18T21:31:29.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.647+0000 7f24da209700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4109b10 con 0x7f24d406a330 2023-10-18T21:31:29.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.647+0000 7f24d8a06700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24d406b940 0x7f24d4109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:29.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.647+0000 7f24d8a06700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24d406b940 0x7f24d4109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58774/0 (socket says 172.21.15.8:58774) 2023-10-18T21:31:29.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.647+0000 7f24d8a06700 1 -- 172.21.15.8:0/516331748 learned_addr learned my addr 172.21.15.8:0/516331748 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:31:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.647+0000 7f24d8a06700 1 -- 172.21.15.8:0/516331748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24d406a330 msgr2=0x7f24d4108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.647+0000 7f24d9207700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24d406a330 0x7f24d4108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.648+0000 7f24d8a06700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24d406a330 0x7f24d4108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.648+0000 7f24d8a06700 1 -- 172.21.15.8:0/516331748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4005040 con 0x7f24d406b940 2023-10-18T21:31:29.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.648+0000 7f24d9207700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24d406a330 0x7f24d4108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:31:29.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.648+0000 7f24d8a06700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24d406b940 0x7f24d4109420 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f24c4009990 tx=0x7f24c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:29.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.648+0000 7f24c9ffb700 1 -- 172.21.15.8:0/516331748 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c4018070 con 0x7f24d406b940 2023-10-18T21:31:29.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.648+0000 7f24c9ffb700 1 -- 172.21.15.8:0/516331748 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f24c4009630 con 0x7f24d406b940 2023-10-18T21:31:29.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.648+0000 7f24c9ffb700 1 -- 172.21.15.8:0/516331748 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c401c400 con 0x7f24d406b940 2023-10-18T21:31:29.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.648+0000 7f24da209700 1 -- 172.21.15.8:0/516331748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d410a450 con 0x7f24d406b940 2023-10-18T21:31:29.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.648+0000 7f24da209700 1 -- 172.21.15.8:0/516331748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d410a9b0 con 0x7f24d406b940 2023-10-18T21:31:29.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.649+0000 7f24da209700 1 -- 172.21.15.8:0/516331748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d4045ad0 con 0x7f24d406b940 2023-10-18T21:31:29.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.650+0000 7f24c9ffb700 1 -- 172.21.15.8:0/516331748 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f24c401d9e0 con 0x7f24d406b940 2023-10-18T21:31:29.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.651+0000 7f24c9ffb700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24c0060f70 0x7f24c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:31:29.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.651+0000 7f24c9ffb700 1 -- 172.21.15.8:0/516331748 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f24c407e680 con 0x7f24d406b940 2023-10-18T21:31:29.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.652+0000 7f24d9207700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24c0060f70 0x7f24c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:31:29.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.652+0000 7f24d9207700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24c0060f70 0x7f24c0063430 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f24d0009fd0 tx=0x7f24d000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:31:29.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.655+0000 7f24c9ffb700 1 -- 172.21.15.8:0/516331748 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f24c4051ce0 con 0x7f24d406b940 2023-10-18T21:31:29.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:27.995411+0000 mgr.smithi008.flmjzp (mgr.14640) 1956 : audit [DBG] from='client.35728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:31:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:27.999007+0000 mgr.smithi008.flmjzp (mgr.14640) 1957 : cluster [DBG] pgmap v1354: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.362110+0000 mgr.smithi008.flmjzp (mgr.14640) 1958 : audit [DBG] from='client.35732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:31:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.599787+0000 mon.smithi008 (mon.0) 2400 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:31:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.600736+0000 mon.smithi008 (mon.0) 2401 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:31:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:28.601549+0000 mgr.smithi008.flmjzp (mgr.14640) 1959 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:31:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:28.602129+0000 mgr.smithi008.flmjzp (mgr.14640) 1960 : cluster [DBG] pgmap v1355: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:28.602341+0000 mgr.smithi008.flmjzp (mgr.14640) 1961 : cluster [DBG] pgmap v1356: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.606331+0000 mon.smithi008 (mon.0) 2402 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:31:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.614654+0000 mon.smithi008 (mon.0) 2403 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:29.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.618253+0000 mon.smithi008 (mon.0) 2404 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:29.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.619839+0000 mon.smithi008 (mon.0) 2405 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:29.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.621249+0000 mon.smithi008 (mon.0) 2406 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:29.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.622960+0000 mon.smithi008 (mon.0) 2407 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:29.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:28.624659+0000 mgr.smithi008.flmjzp (mgr.14640) 1962 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:29.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:28.718198+0000 mgr.smithi008.flmjzp (mgr.14640) 1963 : audit [DBG] from='client.35736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:31:29.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:29.126190+0000 mon.smithi008 (mon.0) 2408 : audit [DBG] from='client.? 172.21.15.8:0/3814870601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:29.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.855+0000 7f24da209700 1 -- 172.21.15.8:0/516331748 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24d4100fc0 con 0x7f24c0060f70 2023-10-18T21:31:29.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.856+0000 7f24c9ffb700 1 -- 172.21.15.8:0/516331748 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f24d4100fc0 con 0x7f24c0060f70 2023-10-18T21:31:29.857 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:31:29.857 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:31:29.857 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:31:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:31:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:31:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:31:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:31:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:31:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:31:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:31:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:31:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:31:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:31:29.860 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:31:29.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.858+0000 7f24da209700 1 -- 172.21.15.8:0/516331748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24c0060f70 msgr2=0x7f24c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:29.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.858+0000 7f24da209700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24c0060f70 0x7f24c0063430 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f24d0009fd0 tx=0x7f24d000b040).stop 2023-10-18T21:31:29.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.858+0000 7f24da209700 1 -- 172.21.15.8:0/516331748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24d406b940 msgr2=0x7f24d4109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:31:29.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.858+0000 7f24da209700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24d406b940 0x7f24d4109420 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f24c4009990 tx=0x7f24c4009b30).stop 2023-10-18T21:31:29.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.859+0000 7f24da209700 1 -- 172.21.15.8:0/516331748 shutdown_connections 2023-10-18T21:31:29.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.859+0000 7f24da209700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24c0060f70 0x7f24c0063430 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.859+0000 7f24da209700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24d406a330 0x7f24d4108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.859+0000 7f24da209700 1 --2- 172.21.15.8:0/516331748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24d406b940 0x7f24d4109420 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:31:29.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.859+0000 7f24da209700 1 -- 172.21.15.8:0/516331748 >> 172.21.15.8:0/516331748 conn(0x7f24d40f1c90 msgr2=0x7f24d40fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:31:29.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.859+0000 7f24da209700 1 -- 172.21.15.8:0/516331748 shutdown_connections 2023-10-18T21:31:29.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:29.859+0000 7f24da209700 1 -- 172.21.15.8:0/516331748 wait complete. 2023-10-18T21:31:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:27.995411+0000 mgr.smithi008.flmjzp (mgr.14640) 1956 : audit [DBG] from='client.35728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:31:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:27.999007+0000 mgr.smithi008.flmjzp (mgr.14640) 1957 : cluster [DBG] pgmap v1354: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.362110+0000 mgr.smithi008.flmjzp (mgr.14640) 1958 : audit [DBG] from='client.35732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:31:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.599787+0000 mon.smithi008 (mon.0) 2400 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:31:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.600736+0000 mon.smithi008 (mon.0) 2401 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:31:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:28.601549+0000 mgr.smithi008.flmjzp (mgr.14640) 1959 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:31:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:28.602129+0000 mgr.smithi008.flmjzp (mgr.14640) 1960 : cluster [DBG] pgmap v1355: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:28.602341+0000 mgr.smithi008.flmjzp (mgr.14640) 1961 : cluster [DBG] pgmap v1356: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.606331+0000 mon.smithi008 (mon.0) 2402 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:31:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.614654+0000 mon.smithi008 (mon.0) 2403 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.618253+0000 mon.smithi008 (mon.0) 2404 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.619839+0000 mon.smithi008 (mon.0) 2405 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.621249+0000 mon.smithi008 (mon.0) 2406 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:29.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.622960+0000 mon.smithi008 (mon.0) 2407 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:29.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:28.624659+0000 mgr.smithi008.flmjzp (mgr.14640) 1962 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:29.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:28.718198+0000 mgr.smithi008.flmjzp (mgr.14640) 1963 : audit [DBG] from='client.35736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:31:29.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:29.126190+0000 mon.smithi008 (mon.0) 2408 : audit [DBG] from='client.? 172.21.15.8:0/3814870601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:30.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:29.505470+0000 mon.smithi008 (mon.0) 2409 : audit [DBG] from='client.? 172.21.15.8:0/1372147175' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:31:30.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:29.856548+0000 mgr.smithi008.flmjzp (mgr.14640) 1964 : audit [DBG] from='client.35748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:31:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:29.505470+0000 mon.smithi008 (mon.0) 2409 : audit [DBG] from='client.? 172.21.15.8:0/1372147175' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:31:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:29.856548+0000 mgr.smithi008.flmjzp (mgr.14640) 1964 : audit [DBG] from='client.35748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:31:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:30.602997+0000 mgr.smithi008.flmjzp (mgr.14640) 1965 : cluster [DBG] pgmap v1357: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:31.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:30.602997+0000 mgr.smithi008.flmjzp (mgr.14640) 1965 : cluster [DBG] pgmap v1357: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:32.603611+0000 mgr.smithi008.flmjzp (mgr.14640) 1966 : cluster [DBG] pgmap v1358: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:33.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:32.603611+0000 mgr.smithi008.flmjzp (mgr.14640) 1966 : cluster [DBG] pgmap v1358: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:34.604229+0000 mgr.smithi008.flmjzp (mgr.14640) 1967 : cluster [DBG] pgmap v1359: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:35.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:34.604229+0000 mgr.smithi008.flmjzp (mgr.14640) 1967 : cluster [DBG] pgmap v1359: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:36.604964+0000 mgr.smithi008.flmjzp (mgr.14640) 1968 : cluster [DBG] pgmap v1360: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:37.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:36.604964+0000 mgr.smithi008.flmjzp (mgr.14640) 1968 : cluster [DBG] pgmap v1360: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:38.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:38.635291+0000 mon.smithi008 (mon.0) 2410 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:38.637468+0000 mon.smithi008 (mon.0) 2411 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:31:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:38.638538+0000 mon.smithi008 (mon.0) 2412 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:31:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:38.645572+0000 mon.smithi008 (mon.0) 2413 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:31:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:38.651880+0000 mon.smithi008 (mon.0) 2414 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:38.655087+0000 mon.smithi008 (mon.0) 2415 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:38.656707+0000 mon.smithi008 (mon.0) 2416 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:38.658276+0000 mon.smithi008 (mon.0) 2417 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:38.660256+0000 mon.smithi008 (mon.0) 2418 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:38.635291+0000 mon.smithi008 (mon.0) 2410 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:38.637468+0000 mon.smithi008 (mon.0) 2411 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:31:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:38.638538+0000 mon.smithi008 (mon.0) 2412 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:31:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:38.645572+0000 mon.smithi008 (mon.0) 2413 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:31:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:38.651880+0000 mon.smithi008 (mon.0) 2414 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:38.655087+0000 mon.smithi008 (mon.0) 2415 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:38.656707+0000 mon.smithi008 (mon.0) 2416 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:38.658276+0000 mon.smithi008 (mon.0) 2417 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:39.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:38.660256+0000 mon.smithi008 (mon.0) 2418 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:38.605694+0000 mgr.smithi008.flmjzp (mgr.14640) 1969 : cluster [DBG] pgmap v1361: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:38.639491+0000 mgr.smithi008.flmjzp (mgr.14640) 1970 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:31:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:38.640061+0000 mgr.smithi008.flmjzp (mgr.14640) 1971 : cluster [DBG] pgmap v1362: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:38.640378+0000 mgr.smithi008.flmjzp (mgr.14640) 1972 : cluster [DBG] pgmap v1363: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:38.662185+0000 mgr.smithi008.flmjzp (mgr.14640) 1973 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:40.163 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:38.605694+0000 mgr.smithi008.flmjzp (mgr.14640) 1969 : cluster [DBG] pgmap v1361: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:40.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:38.639491+0000 mgr.smithi008.flmjzp (mgr.14640) 1970 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:31:40.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:38.640061+0000 mgr.smithi008.flmjzp (mgr.14640) 1971 : cluster [DBG] pgmap v1362: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:40.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:38.640378+0000 mgr.smithi008.flmjzp (mgr.14640) 1972 : cluster [DBG] pgmap v1363: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:40.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:38.662185+0000 mgr.smithi008.flmjzp (mgr.14640) 1973 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:40.640883+0000 mgr.smithi008.flmjzp (mgr.14640) 1974 : cluster [DBG] pgmap v1364: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:40.640883+0000 mgr.smithi008.flmjzp (mgr.14640) 1974 : cluster [DBG] pgmap v1364: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:42.641431+0000 mgr.smithi008.flmjzp (mgr.14640) 1975 : cluster [DBG] pgmap v1365: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:43.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:42.641431+0000 mgr.smithi008.flmjzp (mgr.14640) 1975 : cluster [DBG] pgmap v1365: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:45.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:44.641970+0000 mgr.smithi008.flmjzp (mgr.14640) 1976 : cluster [DBG] pgmap v1366: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:44.641970+0000 mgr.smithi008.flmjzp (mgr.14640) 1976 : cluster [DBG] pgmap v1366: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:47.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:46.642665+0000 mgr.smithi008.flmjzp (mgr.14640) 1977 : cluster [DBG] pgmap v1367: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:46.642665+0000 mgr.smithi008.flmjzp (mgr.14640) 1977 : cluster [DBG] pgmap v1367: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:48.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:48.672066+0000 mon.smithi008 (mon.0) 2419 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:48.672066+0000 mon.smithi008 (mon.0) 2419 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:49.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:48.643329+0000 mgr.smithi008.flmjzp (mgr.14640) 1978 : cluster [DBG] pgmap v1368: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:49.231120+0000 mon.smithi008 (mon.0) 2420 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:31:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:49.232251+0000 mon.smithi008 (mon.0) 2421 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:31:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:49.239024+0000 mon.smithi008 (mon.0) 2422 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:31:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:49.245829+0000 mon.smithi008 (mon.0) 2423 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:49.249180+0000 mon.smithi008 (mon.0) 2424 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:49.250981+0000 mon.smithi008 (mon.0) 2425 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:49.252689+0000 mon.smithi008 (mon.0) 2426 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:49.254846+0000 mon.smithi008 (mon.0) 2427 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:50.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:48.643329+0000 mgr.smithi008.flmjzp (mgr.14640) 1978 : cluster [DBG] pgmap v1368: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:50.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:49.231120+0000 mon.smithi008 (mon.0) 2420 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:31:50.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:49.232251+0000 mon.smithi008 (mon.0) 2421 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:31:50.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:49.239024+0000 mon.smithi008 (mon.0) 2422 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:31:50.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:49.245829+0000 mon.smithi008 (mon.0) 2423 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:31:50.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:49.249180+0000 mon.smithi008 (mon.0) 2424 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:50.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:49.250981+0000 mon.smithi008 (mon.0) 2425 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:50.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:49.252689+0000 mon.smithi008 (mon.0) 2426 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:50.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:49.254846+0000 mon.smithi008 (mon.0) 2427 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:31:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:49.233148+0000 mgr.smithi008.flmjzp (mgr.14640) 1979 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:31:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:49.233826+0000 mgr.smithi008.flmjzp (mgr.14640) 1980 : cluster [DBG] pgmap v1369: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:49.234212+0000 mgr.smithi008.flmjzp (mgr.14640) 1981 : cluster [DBG] pgmap v1370: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:49.256866+0000 mgr.smithi008.flmjzp (mgr.14640) 1982 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:49.233148+0000 mgr.smithi008.flmjzp (mgr.14640) 1979 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:31:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:49.233826+0000 mgr.smithi008.flmjzp (mgr.14640) 1980 : cluster [DBG] pgmap v1369: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:49.234212+0000 mgr.smithi008.flmjzp (mgr.14640) 1981 : cluster [DBG] pgmap v1370: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:51.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:49.256866+0000 mgr.smithi008.flmjzp (mgr.14640) 1982 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:31:52.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:51.234743+0000 mgr.smithi008.flmjzp (mgr.14640) 1983 : cluster [DBG] pgmap v1371: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:51.234743+0000 mgr.smithi008.flmjzp (mgr.14640) 1983 : cluster [DBG] pgmap v1371: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:54.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:53.235365+0000 mgr.smithi008.flmjzp (mgr.14640) 1984 : cluster [DBG] pgmap v1372: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:55.157 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:53.235365+0000 mgr.smithi008.flmjzp (mgr.14640) 1984 : cluster [DBG] pgmap v1372: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:56.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:55.236142+0000 mgr.smithi008.flmjzp (mgr.14640) 1985 : cluster [DBG] pgmap v1373: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:55.236142+0000 mgr.smithi008.flmjzp (mgr.14640) 1985 : cluster [DBG] pgmap v1373: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:58.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:57.236947+0000 mgr.smithi008.flmjzp (mgr.14640) 1986 : cluster [DBG] pgmap v1374: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:31:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:57.236947+0000 mgr.smithi008.flmjzp (mgr.14640) 1986 : cluster [DBG] pgmap v1374: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:00.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:59.998+0000 7fee15d12700 1 -- 172.21.15.8:0/1583628846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee100f6530 msgr2=0x7fee100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:59.998+0000 7fee15d12700 1 --2- 172.21.15.8:0/1583628846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee100f6530 0x7fee100f6950 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fee04004660 tx=0x7fee04009b30).stop 2023-10-18T21:32:00.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:59.998+0000 7fee15d12700 1 -- 172.21.15.8:0/1583628846 shutdown_connections 2023-10-18T21:32:00.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:59.998+0000 7fee15d12700 1 --2- 172.21.15.8:0/1583628846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee100f77d0 0x7fee100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:59.998+0000 7fee15d12700 1 --2- 172.21.15.8:0/1583628846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee100f6530 0x7fee100f6950 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:59.998+0000 7fee15d12700 1 -- 172.21.15.8:0/1583628846 >> 172.21.15.8:0/1583628846 conn(0x7fee100f1c90 msgr2=0x7fee100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:00.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:59.998+0000 7fee15d12700 1 -- 172.21.15.8:0/1583628846 shutdown_connections 2023-10-18T21:32:00.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:31:59.999+0000 7fee15d12700 1 -- 172.21.15.8:0/1583628846 wait complete. 2023-10-18T21:32:00.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.000+0000 7fee15d12700 1 Processor -- start 2023-10-18T21:32:00.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.000+0000 7fee15d12700 1 -- start start 2023-10-18T21:32:00.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.000+0000 7fee15d12700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee100f6530 0x7fee1006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:00.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.000+0000 7fee15d12700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.000+0000 7fee15d12700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1006a380 con 0x7fee100f77d0 2023-10-18T21:32:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.000+0000 7fee15d12700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1006a4c0 con 0x7fee100f6530 2023-10-18T21:32:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.001+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.001+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38654/0 (socket says 172.21.15.8:38654) 2023-10-18T21:32:00.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.001+0000 7fee0ffff700 1 -- 172.21.15.8:0/4001031414 learned_addr learned my addr 172.21.15.8:0/4001031414 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:00.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.001+0000 7fee14d10700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee100f6530 0x7fee1006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:00.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.001+0000 7fee0ffff700 1 -- 172.21.15.8:0/4001031414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee100f6530 msgr2=0x7fee1006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.001+0000 7fee0ffff700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee100f6530 0x7fee1006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.001+0000 7fee0ffff700 1 -- 172.21.15.8:0/4001031414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee04005040 con 0x7fee100f77d0 2023-10-18T21:32:00.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.001+0000 7fee0ffff700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fedfc00c790 tx=0x7fedfc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.002+0000 7fee0d7fa700 1 -- 172.21.15.8:0/4001031414 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedfc002590 con 0x7fee100f77d0 2023-10-18T21:32:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.002+0000 7fee0d7fa700 1 -- 172.21.15.8:0/4001031414 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fedfc002bb0 con 0x7fee100f77d0 2023-10-18T21:32:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.002+0000 7fee15d12700 1 -- 172.21.15.8:0/4001031414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1006a7a0 con 0x7fee100f77d0 2023-10-18T21:32:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.002+0000 7fee0d7fa700 1 -- 172.21.15.8:0/4001031414 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedfc013e10 con 0x7fee100f77d0 2023-10-18T21:32:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.002+0000 7fee15d12700 1 -- 172.21.15.8:0/4001031414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1010ede0 con 0x7fee100f77d0 2023-10-18T21:32:00.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.003+0000 7fee15d12700 1 -- 172.21.15.8:0/4001031414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee10045ad0 con 0x7fee100f77d0 2023-10-18T21:32:00.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.004+0000 7fee0d7fa700 1 -- 172.21.15.8:0/4001031414 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fedfc01a060 con 0x7fee100f77d0 2023-10-18T21:32:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.004+0000 7fee0d7fa700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee00060f70 0x7fee00063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.005+0000 7fee0d7fa700 1 -- 172.21.15.8:0/4001031414 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fedfc07cc10 con 0x7fee100f77d0 2023-10-18T21:32:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.005+0000 7fee14d10700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee00060f70 0x7fee00063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:00.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.005+0000 7fee14d10700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee00060f70 0x7fee00063430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fee1006b730 tx=0x7fee04009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:00.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.009+0000 7fee0d7fa700 1 -- 172.21.15.8:0/4001031414 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fedfc0502b0 con 0x7fee100f77d0 2023-10-18T21:32:00.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:59.258865+0000 mon.smithi008 (mon.0) 2428 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:00.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:59.612017+0000 mon.smithi008 (mon.0) 2429 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:00.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:59.612968+0000 mon.smithi008 (mon.0) 2430 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:00.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:59.613827+0000 mon.smithi008 (mon.0) 2431 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:00.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:59.619064+0000 mon.smithi008 (mon.0) 2432 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:00.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:59.624077+0000 mon.smithi008 (mon.0) 2433 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:00.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:59.626582+0000 mon.smithi008 (mon.0) 2434 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:00.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:59.627884+0000 mon.smithi008 (mon.0) 2435 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:00.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:59.629194+0000 mon.smithi008 (mon.0) 2436 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:00.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:31:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:31:59.630789+0000 mon.smithi008 (mon.0) 2437 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.207+0000 7fee15d12700 1 -- 172.21.15.8:0/4001031414 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee100fed90 con 0x7fee00060f70 2023-10-18T21:32:00.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.208+0000 7fee0d7fa700 1 -- 172.21.15.8:0/4001031414 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fee100fed90 con 0x7fee00060f70 2023-10-18T21:32:00.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 -- 172.21.15.8:0/4001031414 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee00060f70 msgr2=0x7fee00063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee00060f70 0x7fee00063430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fee1006b730 tx=0x7fee04009b30).stop 2023-10-18T21:32:00.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 -- 172.21.15.8:0/4001031414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee100f77d0 msgr2=0x7fee10069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fedfc00c790 tx=0x7fedfc007d70).stop 2023-10-18T21:32:00.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 -- 172.21.15.8:0/4001031414 shutdown_connections 2023-10-18T21:32:00.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee00060f70 0x7fee00063430 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee100f6530 0x7fee1006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 --2- 172.21.15.8:0/4001031414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee100f77d0 0x7fee10069e20 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 -- 172.21.15.8:0/4001031414 >> 172.21.15.8:0/4001031414 conn(0x7fee100f1c90 msgr2=0x7fee100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:00.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 -- 172.21.15.8:0/4001031414 shutdown_connections 2023-10-18T21:32:00.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.210+0000 7fee15d12700 1 -- 172.21.15.8:0/4001031414 wait complete. 2023-10-18T21:32:00.227 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:32:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:59.258865+0000 mon.smithi008 (mon.0) 2428 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:59.612017+0000 mon.smithi008 (mon.0) 2429 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:59.612968+0000 mon.smithi008 (mon.0) 2430 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:59.613827+0000 mon.smithi008 (mon.0) 2431 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:59.619064+0000 mon.smithi008 (mon.0) 2432 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:59.624077+0000 mon.smithi008 (mon.0) 2433 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:59.626582+0000 mon.smithi008 (mon.0) 2434 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:59.627884+0000 mon.smithi008 (mon.0) 2435 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:59.629194+0000 mon.smithi008 (mon.0) 2436 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:31:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:31:59.630789+0000 mon.smithi008 (mon.0) 2437 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.349+0000 7f179359e700 1 -- 172.21.15.8:0/3391377418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17940f6530 msgr2=0x7f17940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.349+0000 7f179359e700 1 --2- 172.21.15.8:0/3391377418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17940f6530 0x7f17940f6950 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f1784004660 tx=0x7f1784009b30).stop 2023-10-18T21:32:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.349+0000 7f179359e700 1 -- 172.21.15.8:0/3391377418 shutdown_connections 2023-10-18T21:32:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.349+0000 7f179359e700 1 --2- 172.21.15.8:0/3391377418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940f77d0 0x7f17940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.349+0000 7f179359e700 1 --2- 172.21.15.8:0/3391377418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17940f6530 0x7f17940f6950 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.349+0000 7f179359e700 1 -- 172.21.15.8:0/3391377418 >> 172.21.15.8:0/3391377418 conn(0x7f17940f1c90 msgr2=0x7f17940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.349+0000 7f179359e700 1 -- 172.21.15.8:0/3391377418 shutdown_connections 2023-10-18T21:32:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.349+0000 7f179359e700 1 -- 172.21.15.8:0/3391377418 wait complete. 2023-10-18T21:32:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.350+0000 7f179359e700 1 Processor -- start 2023-10-18T21:32:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.350+0000 7f179359e700 1 -- start start 2023-10-18T21:32:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f179359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17940f6530 0x7f1794108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f179359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940f77d0 0x7f17941094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f179359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1794109a70 con 0x7f17940f6530 2023-10-18T21:32:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f179359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1794109bb0 con 0x7f17940f77d0 2023-10-18T21:32:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f179259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17940f6530 0x7f1794108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f179259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17940f6530 0x7f1794108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38672/0 (socket says 172.21.15.8:38672) 2023-10-18T21:32:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f179259c700 1 -- 172.21.15.8:0/2746137764 learned_addr learned my addr 172.21.15.8:0/2746137764 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f1791d9b700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940f77d0 0x7f17941094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f179259c700 1 -- 172.21.15.8:0/2746137764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940f77d0 msgr2=0x7f17941094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f179259c700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940f77d0 0x7f17941094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f179259c700 1 -- 172.21.15.8:0/2746137764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784005040 con 0x7f17940f6530 2023-10-18T21:32:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.351+0000 7f1791d9b700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940f77d0 0x7f17941094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:32:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.352+0000 7f179259c700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17940f6530 0x7f1794108fd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f1784007a60 tx=0x7f1784009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.352+0000 7f1782ffd700 1 -- 172.21.15.8:0/2746137764 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1784018070 con 0x7f17940f6530 2023-10-18T21:32:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.352+0000 7f1782ffd700 1 -- 172.21.15.8:0/2746137764 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1784009630 con 0x7f17940f6530 2023-10-18T21:32:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.352+0000 7f1782ffd700 1 -- 172.21.15.8:0/2746137764 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178401c540 con 0x7f17940f6530 2023-10-18T21:32:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.352+0000 7f179359e700 1 -- 172.21.15.8:0/2746137764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179410a4f0 con 0x7f17940f6530 2023-10-18T21:32:00.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.352+0000 7f179359e700 1 -- 172.21.15.8:0/2746137764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179410aa50 con 0x7f17940f6530 2023-10-18T21:32:00.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.353+0000 7f179359e700 1 -- 172.21.15.8:0/2746137764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1794045ad0 con 0x7f17940f6530 2023-10-18T21:32:00.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.354+0000 7f1782ffd700 1 -- 172.21.15.8:0/2746137764 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f178401d420 con 0x7f17940f6530 2023-10-18T21:32:00.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.355+0000 7f1782ffd700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f177c060f70 0x7f177c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:00.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.355+0000 7f1782ffd700 1 -- 172.21.15.8:0/2746137764 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f178407e680 con 0x7f17940f6530 2023-10-18T21:32:00.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.355+0000 7f1791d9b700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f177c060f70 0x7f177c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:00.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.356+0000 7f1791d9b700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f177c060f70 0x7f177c063430 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f1788009740 tx=0x7f1788009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:00.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.359+0000 7f1782ffd700 1 -- 172.21.15.8:0/2746137764 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1784051ce0 con 0x7f17940f6530 2023-10-18T21:32:00.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.558+0000 7f179359e700 1 -- 172.21.15.8:0/2746137764 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17940fee00 con 0x7f177c060f70 2023-10-18T21:32:00.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.559+0000 7f1782ffd700 1 -- 172.21.15.8:0/2746137764 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f17940fee00 con 0x7f177c060f70 2023-10-18T21:32:00.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 -- 172.21.15.8:0/2746137764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f177c060f70 msgr2=0x7f177c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f177c060f70 0x7f177c063430 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f1788009740 tx=0x7f1788009be0).stop 2023-10-18T21:32:00.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 -- 172.21.15.8:0/2746137764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17940f6530 msgr2=0x7f1794108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17940f6530 0x7f1794108fd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f1784007a60 tx=0x7f1784009b30).stop 2023-10-18T21:32:00.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 -- 172.21.15.8:0/2746137764 shutdown_connections 2023-10-18T21:32:00.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f177c060f70 0x7f177c063430 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17940f6530 0x7f1794108fd0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 --2- 172.21.15.8:0/2746137764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940f77d0 0x7f17941094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 -- 172.21.15.8:0/2746137764 >> 172.21.15.8:0/2746137764 conn(0x7f17940f1c90 msgr2=0x7f179406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:00.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 -- 172.21.15.8:0/2746137764 shutdown_connections 2023-10-18T21:32:00.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.561+0000 7f179359e700 1 -- 172.21.15.8:0/2746137764 wait complete. 2023-10-18T21:32:00.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.698+0000 7f1bf3071700 1 -- 172.21.15.8:0/2911569546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bec0f77d0 msgr2=0x7f1bec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.698+0000 7f1bf3071700 1 --2- 172.21.15.8:0/2911569546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bec0f77d0 0x7f1bec0f7c30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f1bdc004660 tx=0x7f1bdc009b30).stop 2023-10-18T21:32:00.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.699+0000 7f1bf3071700 1 -- 172.21.15.8:0/2911569546 shutdown_connections 2023-10-18T21:32:00.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.699+0000 7f1bf3071700 1 --2- 172.21.15.8:0/2911569546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bec0f77d0 0x7f1bec0f7c30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.699+0000 7f1bf3071700 1 --2- 172.21.15.8:0/2911569546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bec0f6530 0x7f1bec0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.699+0000 7f1bf3071700 1 -- 172.21.15.8:0/2911569546 >> 172.21.15.8:0/2911569546 conn(0x7f1bec0f1c90 msgr2=0x7f1bec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.699+0000 7f1bf3071700 1 -- 172.21.15.8:0/2911569546 shutdown_connections 2023-10-18T21:32:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.699+0000 7f1bf3071700 1 -- 172.21.15.8:0/2911569546 wait complete. 2023-10-18T21:32:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.700+0000 7f1bf3071700 1 Processor -- start 2023-10-18T21:32:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.700+0000 7f1bf3071700 1 -- start start 2023-10-18T21:32:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.701+0000 7f1bf3071700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bec0f6530 0x7f1bec106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.701+0000 7f1bf3071700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bec0f77d0 0x7f1bec107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.701+0000 7f1bf3071700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec107880 con 0x7f1bec0f77d0 2023-10-18T21:32:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.701+0000 7f1bf3071700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec1080c0 con 0x7f1bec0f6530 2023-10-18T21:32:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.701+0000 7f1bf206f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bec0f6530 0x7f1bec106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.701+0000 7f1bf186e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bec0f77d0 0x7f1bec107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.701+0000 7f1bf206f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bec0f6530 0x7f1bec106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:35022/0 (socket says 172.21.15.8:35022) 2023-10-18T21:32:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.701+0000 7f1bf206f700 1 -- 172.21.15.8:0/3980863538 learned_addr learned my addr 172.21.15.8:0/3980863538 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.702+0000 7f1bf186e700 1 -- 172.21.15.8:0/3980863538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bec0f6530 msgr2=0x7f1bec106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.702+0000 7f1bf186e700 1 --2- 172.21.15.8:0/3980863538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bec0f6530 0x7f1bec106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.702+0000 7f1bf186e700 1 -- 172.21.15.8:0/3980863538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc005040 con 0x7f1bec0f77d0 2023-10-18T21:32:00.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.702+0000 7f1bf186e700 1 --2- 172.21.15.8:0/3980863538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bec0f77d0 0x7f1bec107280 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f1bdc009f50 tx=0x7f1bdc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.702+0000 7f1be2ffd700 1 -- 172.21.15.8:0/3980863538 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bdc018070 con 0x7f1bec0f77d0 2023-10-18T21:32:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.702+0000 7f1bf3071700 1 -- 172.21.15.8:0/3980863538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec108340 con 0x7f1bec0f77d0 2023-10-18T21:32:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.702+0000 7f1be2ffd700 1 -- 172.21.15.8:0/3980863538 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1bdc009630 con 0x7f1bec0f77d0 2023-10-18T21:32:00.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.702+0000 7f1be2ffd700 1 -- 172.21.15.8:0/3980863538 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bdc0123c0 con 0x7f1bec0f77d0 2023-10-18T21:32:00.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.702+0000 7f1bf3071700 1 -- 172.21.15.8:0/3980863538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec108820 con 0x7f1bec0f77d0 2023-10-18T21:32:00.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.703+0000 7f1bf3071700 1 -- 172.21.15.8:0/3980863538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec059100 con 0x7f1bec0f77d0 2023-10-18T21:32:00.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.704+0000 7f1be2ffd700 1 -- 172.21.15.8:0/3980863538 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1bdc01d420 con 0x7f1bec0f77d0 2023-10-18T21:32:00.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.705+0000 7f1be2ffd700 1 --2- 172.21.15.8:0/3980863538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bd8060f70 0x7f1bd8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:00.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.705+0000 7f1be2ffd700 1 -- 172.21.15.8:0/3980863538 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1bdc07e410 con 0x7f1bec0f77d0 2023-10-18T21:32:00.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.705+0000 7f1bf206f700 1 --2- 172.21.15.8:0/3980863538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bd8060f70 0x7f1bd8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:00.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.706+0000 7f1bf206f700 1 --2- 172.21.15.8:0/3980863538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bd8060f70 0x7f1bd8063430 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f1bec107b50 tx=0x7f1be800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:00.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.710+0000 7f1be2ffd700 1 -- 172.21.15.8:0/3980863538 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1bdc04dfe0 con 0x7f1bec0f77d0 2023-10-18T21:32:00.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.907+0000 7f1bf3071700 1 -- 172.21.15.8:0/3980863538 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bec0fee50 con 0x7f1bd8060f70 2023-10-18T21:32:00.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.917+0000 7f1be2ffd700 1 -- 172.21.15.8:0/3980863538 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1bec0fee50 con 0x7f1bd8060f70 2023-10-18T21:32:00.919 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:32:00.919 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (38m) 6m ago 40m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:32:00.920 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (32m) 6m ago 40m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:32:00.920 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (32m) 4m ago 39m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:32:00.920 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (38m) 6m ago 39m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:32:00.920 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 36m - - 2023-10-18T21:32:00.920 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 36m - - 2023-10-18T21:32:00.921 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 36m - - 2023-10-18T21:32:00.921 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 36m - - 2023-10-18T21:32:00.921 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (33m) 6m ago 41m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:32:00.921 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (33m) 4m ago 39m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:32:00.921 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (33m) 6m ago 41m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:32:00.922 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (32m) 4m ago 39m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:32:00.922 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (39m) 6m ago 39m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:32:00.922 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (38m) 4m ago 38m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:32:00.922 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (32m) 6m ago 38m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:32:00.922 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (30m) 6m ago 38m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:32:00.923 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (29m) 6m ago 38m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:32:00.923 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (29m) 4m ago 37m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:32:00.923 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (28m) 4m ago 37m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:32:00.923 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (28m) 4m ago 37m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:32:00.924 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (34m) 6m ago 39m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:32:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.919+0000 7f1bf3071700 1 -- 172.21.15.8:0/3980863538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bd8060f70 msgr2=0x7f1bd8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.919+0000 7f1bf3071700 1 --2- 172.21.15.8:0/3980863538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bd8060f70 0x7f1bd8063430 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f1bec107b50 tx=0x7f1be800b040).stop 2023-10-18T21:32:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.919+0000 7f1bf3071700 1 -- 172.21.15.8:0/3980863538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bec0f77d0 msgr2=0x7f1bec107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.919+0000 7f1bf3071700 1 --2- 172.21.15.8:0/3980863538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bec0f77d0 0x7f1bec107280 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f1bdc009f50 tx=0x7f1bdc009b30).stop 2023-10-18T21:32:00.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.919+0000 7f1bf3071700 1 -- 172.21.15.8:0/3980863538 shutdown_connections 2023-10-18T21:32:00.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.919+0000 7f1bf3071700 1 --2- 172.21.15.8:0/3980863538 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1bd8060f70 0x7f1bd8063430 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.919+0000 7f1bf3071700 1 --2- 172.21.15.8:0/3980863538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bec0f6530 0x7f1bec106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.919+0000 7f1bf3071700 1 --2- 172.21.15.8:0/3980863538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bec0f77d0 0x7f1bec107280 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:00.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.919+0000 7f1bf3071700 1 -- 172.21.15.8:0/3980863538 >> 172.21.15.8:0/3980863538 conn(0x7f1bec0f1c90 msgr2=0x7f1bec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:00.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.920+0000 7f1bf3071700 1 -- 172.21.15.8:0/3980863538 shutdown_connections 2023-10-18T21:32:00.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:00.920+0000 7f1bf3071700 1 -- 172.21.15.8:0/3980863538 wait complete. 2023-10-18T21:32:01.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.055+0000 7f412548d700 1 -- 172.21.15.8:0/1094757271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41200f6530 msgr2=0x7f41200f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.055+0000 7f412548d700 1 --2- 172.21.15.8:0/1094757271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41200f6530 0x7f41200f6950 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f4110004660 tx=0x7f4110009b30).stop 2023-10-18T21:32:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.055+0000 7f412548d700 1 -- 172.21.15.8:0/1094757271 shutdown_connections 2023-10-18T21:32:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.055+0000 7f412548d700 1 --2- 172.21.15.8:0/1094757271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41200f77d0 0x7f41200f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.055+0000 7f412548d700 1 --2- 172.21.15.8:0/1094757271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41200f6530 0x7f41200f6950 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.055+0000 7f412548d700 1 -- 172.21.15.8:0/1094757271 >> 172.21.15.8:0/1094757271 conn(0x7f41200f1c90 msgr2=0x7f41200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:01.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.055+0000 7f412548d700 1 -- 172.21.15.8:0/1094757271 shutdown_connections 2023-10-18T21:32:01.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.055+0000 7f412548d700 1 -- 172.21.15.8:0/1094757271 wait complete. 2023-10-18T21:32:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.056+0000 7f412548d700 1 Processor -- start 2023-10-18T21:32:01.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.056+0000 7f412548d700 1 -- start start 2023-10-18T21:32:01.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.056+0000 7f412548d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41200f6530 0x7f412006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:01.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.056+0000 7f412548d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41200f77d0 0x7f4120069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:01.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.056+0000 7f412548d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412006a380 con 0x7f41200f6530 2023-10-18T21:32:01.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.056+0000 7f412548d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412006a4c0 con 0x7f41200f77d0 2023-10-18T21:32:01.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.056+0000 7f411ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41200f6530 0x7f412006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:01.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.056+0000 7f411ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41200f6530 0x7f412006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38698/0 (socket says 172.21.15.8:38698) 2023-10-18T21:32:01.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.056+0000 7f411ffff700 1 -- 172.21.15.8:0/4082013795 learned_addr learned my addr 172.21.15.8:0/4082013795 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:01.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.057+0000 7f411f7fe700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41200f77d0 0x7f4120069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:01.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.057+0000 7f411ffff700 1 -- 172.21.15.8:0/4082013795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41200f77d0 msgr2=0x7f4120069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:01.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.057+0000 7f411ffff700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41200f77d0 0x7f4120069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.057+0000 7f411ffff700 1 -- 172.21.15.8:0/4082013795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4110005040 con 0x7f41200f6530 2023-10-18T21:32:01.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.057+0000 7f411ffff700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41200f6530 0x7f412006b9a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f4110007a70 tx=0x7f4110009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:01.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.057+0000 7f411cff9700 1 -- 172.21.15.8:0/4082013795 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4110018070 con 0x7f41200f6530 2023-10-18T21:32:01.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.057+0000 7f412548d700 1 -- 172.21.15.8:0/4082013795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412006a740 con 0x7f41200f6530 2023-10-18T21:32:01.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.057+0000 7f411cff9700 1 -- 172.21.15.8:0/4082013795 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f411001d8e0 con 0x7f41200f6530 2023-10-18T21:32:01.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.057+0000 7f411cff9700 1 -- 172.21.15.8:0/4082013795 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f411001c660 con 0x7f41200f6530 2023-10-18T21:32:01.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.058+0000 7f412548d700 1 -- 172.21.15.8:0/4082013795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412006aca0 con 0x7f41200f6530 2023-10-18T21:32:01.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.059+0000 7f412548d700 1 -- 172.21.15.8:0/4082013795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4120045ad0 con 0x7f41200f6530 2023-10-18T21:32:01.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.060+0000 7f411cff9700 1 -- 172.21.15.8:0/4082013795 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f411001da50 con 0x7f41200f6530 2023-10-18T21:32:01.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.060+0000 7f411cff9700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4108060f70 0x7f4108063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:01.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.061+0000 7f411cff9700 1 -- 172.21.15.8:0/4082013795 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f411007e8d0 con 0x7f41200f6530 2023-10-18T21:32:01.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.061+0000 7f411f7fe700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4108060f70 0x7f4108063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:01.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.061+0000 7f411f7fe700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4108060f70 0x7f4108063430 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f4114004a70 tx=0x7f4114009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:01.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.065+0000 7f411cff9700 1 -- 172.21.15.8:0/4082013795 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f411004e540 con 0x7f41200f6530 2023-10-18T21:32:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:59.237581+0000 mgr.smithi008.flmjzp (mgr.14640) 1987 : cluster [DBG] pgmap v1375: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:59.614543+0000 mgr.smithi008.flmjzp (mgr.14640) 1988 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:59.615077+0000 mgr.smithi008.flmjzp (mgr.14640) 1989 : cluster [DBG] pgmap v1376: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:31:59.615350+0000 mgr.smithi008.flmjzp (mgr.14640) 1990 : cluster [DBG] pgmap v1377: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:31:59.632332+0000 mgr.smithi008.flmjzp (mgr.14640) 1991 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:59.237581+0000 mgr.smithi008.flmjzp (mgr.14640) 1987 : cluster [DBG] pgmap v1375: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:59.614543+0000 mgr.smithi008.flmjzp (mgr.14640) 1988 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:59.615077+0000 mgr.smithi008.flmjzp (mgr.14640) 1989 : cluster [DBG] pgmap v1376: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:31:59.615350+0000 mgr.smithi008.flmjzp (mgr.14640) 1990 : cluster [DBG] pgmap v1377: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:31:59.632332+0000 mgr.smithi008.flmjzp (mgr.14640) 1991 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.322+0000 7f412548d700 1 -- 172.21.15.8:0/4082013795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f41200008d0 con 0x7f41200f6530 2023-10-18T21:32:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.323+0000 7f411cff9700 1 -- 172.21.15.8:0/4082013795 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f411001dce0 con 0x7f41200f6530 2023-10-18T21:32:01.325 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:32:01.325 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:32:01.325 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:32:01.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:32:01.326 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:32:01.326 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:32:01.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:32:01.326 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:32:01.326 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:32:01.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:32:01.327 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:32:01.327 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:32:01.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:32:01.327 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:32:01.328 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:32:01.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:32:01.328 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:32:01.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 -- 172.21.15.8:0/4082013795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4108060f70 msgr2=0x7f4108063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:01.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4108060f70 0x7f4108063430 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f4114004a70 tx=0x7f4114009040).stop 2023-10-18T21:32:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 -- 172.21.15.8:0/4082013795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41200f6530 msgr2=0x7f412006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41200f6530 0x7f412006b9a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f4110007a70 tx=0x7f4110009b30).stop 2023-10-18T21:32:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 -- 172.21.15.8:0/4082013795 shutdown_connections 2023-10-18T21:32:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4108060f70 0x7f4108063430 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41200f6530 0x7f412006b9a0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 --2- 172.21.15.8:0/4082013795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41200f77d0 0x7f4120069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 -- 172.21.15.8:0/4082013795 >> 172.21.15.8:0/4082013795 conn(0x7f41200f1c90 msgr2=0x7f41200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:01.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 -- 172.21.15.8:0/4082013795 shutdown_connections 2023-10-18T21:32:01.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.325+0000 7f412548d700 1 -- 172.21.15.8:0/4082013795 wait complete. 2023-10-18T21:32:01.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.461+0000 7f584759e700 1 -- 172.21.15.8:0/2614389927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58480f6530 msgr2=0x7f58480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:01.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.461+0000 7f584759e700 1 --2- 172.21.15.8:0/2614389927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58480f6530 0x7f58480f6950 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f5838004660 tx=0x7f5838009b30).stop 2023-10-18T21:32:01.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.462+0000 7f584759e700 1 -- 172.21.15.8:0/2614389927 shutdown_connections 2023-10-18T21:32:01.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.462+0000 7f584759e700 1 --2- 172.21.15.8:0/2614389927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58480f77d0 0x7f58480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.462+0000 7f584759e700 1 --2- 172.21.15.8:0/2614389927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58480f6530 0x7f58480f6950 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.462+0000 7f584759e700 1 -- 172.21.15.8:0/2614389927 >> 172.21.15.8:0/2614389927 conn(0x7f58480f1c90 msgr2=0x7f58480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:01.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.462+0000 7f584759e700 1 -- 172.21.15.8:0/2614389927 shutdown_connections 2023-10-18T21:32:01.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.462+0000 7f584759e700 1 -- 172.21.15.8:0/2614389927 wait complete. 2023-10-18T21:32:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.462+0000 7f584759e700 1 Processor -- start 2023-10-18T21:32:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.463+0000 7f584759e700 1 -- start start 2023-10-18T21:32:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.463+0000 7f584759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58480f6530 0x7f584806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.463+0000 7f584759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58480f77d0 0x7f5848069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.463+0000 7f584759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584806a380 con 0x7f58480f77d0 2023-10-18T21:32:01.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.463+0000 7f584759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584806a4c0 con 0x7f58480f6530 2023-10-18T21:32:01.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.463+0000 7f5845d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58480f77d0 0x7f5848069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:01.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.463+0000 7f5845d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58480f77d0 0x7f5848069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38724/0 (socket says 172.21.15.8:38724) 2023-10-18T21:32:01.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.463+0000 7f5845d9b700 1 -- 172.21.15.8:0/2243259800 learned_addr learned my addr 172.21.15.8:0/2243259800 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:01.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.463+0000 7f584659c700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58480f6530 0x7f584806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:01.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.464+0000 7f5845d9b700 1 -- 172.21.15.8:0/2243259800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58480f6530 msgr2=0x7f584806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:01.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.464+0000 7f5845d9b700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58480f6530 0x7f584806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.464+0000 7f5845d9b700 1 -- 172.21.15.8:0/2243259800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838005040 con 0x7f58480f77d0 2023-10-18T21:32:01.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.464+0000 7f5845d9b700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58480f77d0 0x7f5848069e20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f583c0026d0 tx=0x7f583c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:01.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.464+0000 7f5836ffd700 1 -- 172.21.15.8:0/2243259800 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f583c0079c0 con 0x7f58480f77d0 2023-10-18T21:32:01.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.464+0000 7f5836ffd700 1 -- 172.21.15.8:0/2243259800 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f583c00f040 con 0x7f58480f77d0 2023-10-18T21:32:01.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.464+0000 7f584759e700 1 -- 172.21.15.8:0/2243259800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584806a7a0 con 0x7f58480f77d0 2023-10-18T21:32:01.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.464+0000 7f5836ffd700 1 -- 172.21.15.8:0/2243259800 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f583c014980 con 0x7f58480f77d0 2023-10-18T21:32:01.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.464+0000 7f584759e700 1 -- 172.21.15.8:0/2243259800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584810ede0 con 0x7f58480f77d0 2023-10-18T21:32:01.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.465+0000 7f584759e700 1 -- 172.21.15.8:0/2243259800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5848045ad0 con 0x7f58480f77d0 2023-10-18T21:32:01.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.466+0000 7f5836ffd700 1 -- 172.21.15.8:0/2243259800 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f583c0090d0 con 0x7f58480f77d0 2023-10-18T21:32:01.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.467+0000 7f5836ffd700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5830060f70 0x7f5830063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:01.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.467+0000 7f5836ffd700 1 -- 172.21.15.8:0/2243259800 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f583c07c8a0 con 0x7f58480f77d0 2023-10-18T21:32:01.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.467+0000 7f584659c700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5830060f70 0x7f5830063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:01.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.468+0000 7f584659c700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5830060f70 0x7f5830063430 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f5838005010 tx=0x7f5838009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:01.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.471+0000 7f5836ffd700 1 -- 172.21.15.8:0/2243259800 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f583c04c580 con 0x7f58480f77d0 2023-10-18T21:32:01.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.696+0000 7f584759e700 1 -- 172.21.15.8:0/2243259800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5848027a00 con 0x7f58480f77d0 2023-10-18T21:32:01.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.696+0000 7f5836ffd700 1 -- 172.21.15.8:0/2243259800 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f583c04fba0 con 0x7f58480f77d0 2023-10-18T21:32:01.699 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:32:01.699 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:32:01.699 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:32:01.699 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:32:01.700 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:32:01.700 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:32:01.700 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:32:01.700 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:32:01.700 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:32:01.701 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:32:01.701 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:32:01.701 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:32:01.701 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:32:01.701 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:32:01.702 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:32:01.702 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:32:01.702 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:32:01.702 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:32:01.703 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:32:01.703 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:32:01.703 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:32:01.703 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:32:01.703 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:32:01.704 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:32:01.704 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:32:01.704 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:32:01.704 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:32:01.704 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:32:01.705 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:32:01.705 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:32:01.705 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:32:01.705 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:32:01.705 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:32:01.706 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:32:01.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.698+0000 7f584759e700 1 -- 172.21.15.8:0/2243259800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5830060f70 msgr2=0x7f5830063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:01.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.698+0000 7f584759e700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5830060f70 0x7f5830063430 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f5838005010 tx=0x7f5838009b30).stop 2023-10-18T21:32:01.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.698+0000 7f584759e700 1 -- 172.21.15.8:0/2243259800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58480f77d0 msgr2=0x7f5848069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:01.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.698+0000 7f584759e700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58480f77d0 0x7f5848069e20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f583c0026d0 tx=0x7f583c009de0).stop 2023-10-18T21:32:01.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.698+0000 7f584759e700 1 -- 172.21.15.8:0/2243259800 shutdown_connections 2023-10-18T21:32:01.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.698+0000 7f584759e700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5830060f70 0x7f5830063430 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.698+0000 7f584759e700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58480f6530 0x7f584806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.698+0000 7f584759e700 1 --2- 172.21.15.8:0/2243259800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58480f77d0 0x7f5848069e20 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.698+0000 7f584759e700 1 -- 172.21.15.8:0/2243259800 >> 172.21.15.8:0/2243259800 conn(0x7f58480f1c90 msgr2=0x7f58480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:01.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.699+0000 7f584759e700 1 -- 172.21.15.8:0/2243259800 shutdown_connections 2023-10-18T21:32:01.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.699+0000 7f584759e700 1 -- 172.21.15.8:0/2243259800 wait complete. 2023-10-18T21:32:01.709 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:32:01.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.837+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2796548479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec00f6530 msgr2=0x7f4ec00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.837+0000 7f4ec5b21700 1 --2- 172.21.15.8:0/2796548479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec00f6530 0x7f4ec00f6950 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f4eb4004660 tx=0x7f4eb4009b30).stop 2023-10-18T21:32:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.837+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2796548479 shutdown_connections 2023-10-18T21:32:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.837+0000 7f4ec5b21700 1 --2- 172.21.15.8:0/2796548479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00f77d0 0x7f4ec00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.837+0000 7f4ec5b21700 1 --2- 172.21.15.8:0/2796548479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec00f6530 0x7f4ec00f6950 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.837+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2796548479 >> 172.21.15.8:0/2796548479 conn(0x7f4ec00f1c70 msgr2=0x7f4ec00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.837+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2796548479 shutdown_connections 2023-10-18T21:32:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.837+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2796548479 wait complete. 2023-10-18T21:32:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.838+0000 7f4ec5b21700 1 Processor -- start 2023-10-18T21:32:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.838+0000 7f4ec5b21700 1 -- start start 2023-10-18T21:32:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ec5b21700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00f6530 0x7f4ec0106e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:01.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ec5b21700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec00f77d0 0x7f4ec0107330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:01.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ec5b21700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec0107930 con 0x7f4ec00f77d0 2023-10-18T21:32:01.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ec5b21700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec0108140 con 0x7f4ec00f6530 2023-10-18T21:32:01.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ebffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec00f77d0 0x7f4ec0107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:01.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ebffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec00f77d0 0x7f4ec0107330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38742/0 (socket says 172.21.15.8:38742) 2023-10-18T21:32:01.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ebffff700 1 -- 172.21.15.8:0/2046062065 learned_addr learned my addr 172.21.15.8:0/2046062065 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:01.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ec4b1f700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00f6530 0x7f4ec0106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:01.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ebffff700 1 -- 172.21.15.8:0/2046062065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00f6530 msgr2=0x7f4ec0106e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:01.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ebffff700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00f6530 0x7f4ec0106e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:01.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.839+0000 7f4ebffff700 1 -- 172.21.15.8:0/2046062065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb4005040 con 0x7f4ec00f77d0 2023-10-18T21:32:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.840+0000 7f4ebffff700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec00f77d0 0x7f4ec0107330 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f4eac0026d0 tx=0x7f4eac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.840+0000 7f4ebd7fa700 1 -- 172.21.15.8:0/2046062065 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eac0079c0 con 0x7f4ec00f77d0 2023-10-18T21:32:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.840+0000 7f4ebd7fa700 1 -- 172.21.15.8:0/2046062065 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4eac00f040 con 0x7f4ec00f77d0 2023-10-18T21:32:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.840+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2046062065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec01083c0 con 0x7f4ec00f77d0 2023-10-18T21:32:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.840+0000 7f4ebd7fa700 1 -- 172.21.15.8:0/2046062065 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eac014980 con 0x7f4ec00f77d0 2023-10-18T21:32:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.840+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2046062065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec0108980 con 0x7f4ec00f77d0 2023-10-18T21:32:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.841+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2046062065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec0059100 con 0x7f4ec00f77d0 2023-10-18T21:32:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.842+0000 7f4ebd7fa700 1 -- 172.21.15.8:0/2046062065 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4eac0090d0 con 0x7f4ec00f77d0 2023-10-18T21:32:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.843+0000 7f4ebd7fa700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4eb0060f70 0x7f4eb0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.843+0000 7f4ebd7fa700 1 -- 172.21.15.8:0/2046062065 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4eac07c7e0 con 0x7f4ec00f77d0 2023-10-18T21:32:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.843+0000 7f4ec4b1f700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4eb0060f70 0x7f4eb0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.844+0000 7f4ec4b1f700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4eb0060f70 0x7f4eb0063430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f4ec0106bb0 tx=0x7f4eb4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:01.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:01.847+0000 7f4ebd7fa700 1 -- 172.21.15.8:0/2046062065 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4eac04c580 con 0x7f4ec00f77d0 2023-10-18T21:32:02.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.045+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2046062065 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ec00fee50 con 0x7f4eb0060f70 2023-10-18T21:32:02.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.046+0000 7f4ebd7fa700 1 -- 172.21.15.8:0/2046062065 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4ec00fee50 con 0x7f4eb0060f70 2023-10-18T21:32:02.048 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:32:02.048 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:32:02.049 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:32:02.049 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:32:02.049 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:32:02.049 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:32:02.049 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:32:02.050 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:32:02.050 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:32:02.050 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:32:02.050 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:32:02.050 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:32:02.050 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:32:02.051 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:32:02.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2046062065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4eb0060f70 msgr2=0x7f4eb0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:02.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4eb0060f70 0x7f4eb0063430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f4ec0106bb0 tx=0x7f4eb4009b30).stop 2023-10-18T21:32:02.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2046062065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec00f77d0 msgr2=0x7f4ec0107330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:02.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec00f77d0 0x7f4ec0107330 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f4eac0026d0 tx=0x7f4eac009de0).stop 2023-10-18T21:32:02.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2046062065 shutdown_connections 2023-10-18T21:32:02.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4eb0060f70 0x7f4eb0063430 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:02.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00f6530 0x7f4ec0106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:02.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 --2- 172.21.15.8:0/2046062065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec00f77d0 0x7f4ec0107330 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:02.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2046062065 >> 172.21.15.8:0/2046062065 conn(0x7f4ec00f1c70 msgr2=0x7f4ec00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:02.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2046062065 shutdown_connections 2023-10-18T21:32:02.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:02.049+0000 7f4ec5b21700 1 -- 172.21.15.8:0/2046062065 wait complete. 2023-10-18T21:32:02.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:00.209706+0000 mgr.smithi008.flmjzp (mgr.14640) 1992 : audit [DBG] from='client.35752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:00.560383+0000 mgr.smithi008.flmjzp (mgr.14640) 1993 : audit [DBG] from='client.35756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:00.909608+0000 mgr.smithi008.flmjzp (mgr.14640) 1994 : audit [DBG] from='client.35760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:01.324166+0000 mon.smithi008 (mon.0) 2438 : audit [DBG] from='client.? 172.21.15.8:0/4082013795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:01.698238+0000 mon.smithi008 (mon.0) 2439 : audit [DBG] from='client.? 172.21.15.8:0/2243259800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:32:02.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:00.209706+0000 mgr.smithi008.flmjzp (mgr.14640) 1992 : audit [DBG] from='client.35752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:02.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:00.560383+0000 mgr.smithi008.flmjzp (mgr.14640) 1993 : audit [DBG] from='client.35756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:00.909608+0000 mgr.smithi008.flmjzp (mgr.14640) 1994 : audit [DBG] from='client.35760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:01.324166+0000 mon.smithi008 (mon.0) 2438 : audit [DBG] from='client.? 172.21.15.8:0/4082013795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:01.698238+0000 mon.smithi008 (mon.0) 2439 : audit [DBG] from='client.? 172.21.15.8:0/2243259800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:32:03.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:01.615799+0000 mgr.smithi008.flmjzp (mgr.14640) 1995 : cluster [DBG] pgmap v1378: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:03.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:01.615799+0000 mgr.smithi008.flmjzp (mgr.14640) 1995 : cluster [DBG] pgmap v1378: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:02.047781+0000 mgr.smithi008.flmjzp (mgr.14640) 1996 : audit [DBG] from='client.35772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:04.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:02.047781+0000 mgr.smithi008.flmjzp (mgr.14640) 1996 : audit [DBG] from='client.35772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:05.157 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:03.616465+0000 mgr.smithi008.flmjzp (mgr.14640) 1997 : cluster [DBG] pgmap v1379: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:05.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:03.616465+0000 mgr.smithi008.flmjzp (mgr.14640) 1997 : cluster [DBG] pgmap v1379: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:05.617080+0000 mgr.smithi008.flmjzp (mgr.14640) 1998 : cluster [DBG] pgmap v1380: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:06.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:05.617080+0000 mgr.smithi008.flmjzp (mgr.14640) 1998 : cluster [DBG] pgmap v1380: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:08.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:07.617583+0000 mgr.smithi008.flmjzp (mgr.14640) 1999 : cluster [DBG] pgmap v1381: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:09.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:07.617583+0000 mgr.smithi008.flmjzp (mgr.14640) 1999 : cluster [DBG] pgmap v1381: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:09.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:09.643071+0000 mon.smithi008 (mon.0) 2440 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:09.645346+0000 mon.smithi008 (mon.0) 2441 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:09.646431+0000 mon.smithi008 (mon.0) 2442 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:09.653079+0000 mon.smithi008 (mon.0) 2443 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:09.659758+0000 mon.smithi008 (mon.0) 2444 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:09.662932+0000 mon.smithi008 (mon.0) 2445 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:09.664830+0000 mon.smithi008 (mon.0) 2446 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:09.666848+0000 mon.smithi008 (mon.0) 2447 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:09.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:09.669505+0000 mon.smithi008 (mon.0) 2448 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:10.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:09.643071+0000 mon.smithi008 (mon.0) 2440 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:10.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:09.645346+0000 mon.smithi008 (mon.0) 2441 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:10.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:09.646431+0000 mon.smithi008 (mon.0) 2442 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:10.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:09.653079+0000 mon.smithi008 (mon.0) 2443 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:10.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:09.659758+0000 mon.smithi008 (mon.0) 2444 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:10.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:09.662932+0000 mon.smithi008 (mon.0) 2445 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:10.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:09.664830+0000 mon.smithi008 (mon.0) 2446 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:10.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:09.666848+0000 mon.smithi008 (mon.0) 2447 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:10.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:09.669505+0000 mon.smithi008 (mon.0) 2448 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:10.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:09.618308+0000 mgr.smithi008.flmjzp (mgr.14640) 2000 : cluster [DBG] pgmap v1382: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:32:09.647365+0000 mgr.smithi008.flmjzp (mgr.14640) 2001 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:09.648026+0000 mgr.smithi008.flmjzp (mgr.14640) 2002 : cluster [DBG] pgmap v1383: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:09.648349+0000 mgr.smithi008.flmjzp (mgr.14640) 2003 : cluster [DBG] pgmap v1384: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:32:09.671691+0000 mgr.smithi008.flmjzp (mgr.14640) 2004 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:09.618308+0000 mgr.smithi008.flmjzp (mgr.14640) 2000 : cluster [DBG] pgmap v1382: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:32:09.647365+0000 mgr.smithi008.flmjzp (mgr.14640) 2001 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:09.648026+0000 mgr.smithi008.flmjzp (mgr.14640) 2002 : cluster [DBG] pgmap v1383: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:09.648349+0000 mgr.smithi008.flmjzp (mgr.14640) 2003 : cluster [DBG] pgmap v1384: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:32:09.671691+0000 mgr.smithi008.flmjzp (mgr.14640) 2004 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:12.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:11.648976+0000 mgr.smithi008.flmjzp (mgr.14640) 2005 : cluster [DBG] pgmap v1385: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:11.648976+0000 mgr.smithi008.flmjzp (mgr.14640) 2005 : cluster [DBG] pgmap v1385: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:13.649634+0000 mgr.smithi008.flmjzp (mgr.14640) 2006 : cluster [DBG] pgmap v1386: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:15.158 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:13.649634+0000 mgr.smithi008.flmjzp (mgr.14640) 2006 : cluster [DBG] pgmap v1386: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:15.650115+0000 mgr.smithi008.flmjzp (mgr.14640) 2007 : cluster [DBG] pgmap v1387: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:15.650115+0000 mgr.smithi008.flmjzp (mgr.14640) 2007 : cluster [DBG] pgmap v1387: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:18.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:17.650742+0000 mgr.smithi008.flmjzp (mgr.14640) 2008 : cluster [DBG] pgmap v1388: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:19.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:17.650742+0000 mgr.smithi008.flmjzp (mgr.14640) 2008 : cluster [DBG] pgmap v1388: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:19.682425+0000 mon.smithi008 (mon.0) 2449 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:19.684664+0000 mon.smithi008 (mon.0) 2450 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:19.685660+0000 mon.smithi008 (mon.0) 2451 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:19.692039+0000 mon.smithi008 (mon.0) 2452 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:19.698621+0000 mon.smithi008 (mon.0) 2453 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:19.701830+0000 mon.smithi008 (mon.0) 2454 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:19.703539+0000 mon.smithi008 (mon.0) 2455 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:19.705240+0000 mon.smithi008 (mon.0) 2456 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:20.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:19.682425+0000 mon.smithi008 (mon.0) 2449 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:20.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:19.684664+0000 mon.smithi008 (mon.0) 2450 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:20.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:19.685660+0000 mon.smithi008 (mon.0) 2451 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:20.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:19.692039+0000 mon.smithi008 (mon.0) 2452 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:20.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:19.698621+0000 mon.smithi008 (mon.0) 2453 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:20.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:19.701830+0000 mon.smithi008 (mon.0) 2454 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:20.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:19.703539+0000 mon.smithi008 (mon.0) 2455 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:20.167 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:19.705240+0000 mon.smithi008 (mon.0) 2456 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:20.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:19.651413+0000 mgr.smithi008.flmjzp (mgr.14640) 2009 : cluster [DBG] pgmap v1389: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:32:19.686534+0000 mgr.smithi008.flmjzp (mgr.14640) 2010 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:19.687067+0000 mgr.smithi008.flmjzp (mgr.14640) 2011 : cluster [DBG] pgmap v1390: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:19.687309+0000 mgr.smithi008.flmjzp (mgr.14640) 2012 : cluster [DBG] pgmap v1391: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:19.709727+0000 mon.smithi008 (mon.0) 2457 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:32:19.712752+0000 mgr.smithi008.flmjzp (mgr.14640) 2013 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:19.651413+0000 mgr.smithi008.flmjzp (mgr.14640) 2009 : cluster [DBG] pgmap v1389: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:32:19.686534+0000 mgr.smithi008.flmjzp (mgr.14640) 2010 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:19.687067+0000 mgr.smithi008.flmjzp (mgr.14640) 2011 : cluster [DBG] pgmap v1390: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:19.687309+0000 mgr.smithi008.flmjzp (mgr.14640) 2012 : cluster [DBG] pgmap v1391: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:19.709727+0000 mon.smithi008 (mon.0) 2457 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:21.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:32:19.712752+0000 mgr.smithi008.flmjzp (mgr.14640) 2013 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:22.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:21.687815+0000 mgr.smithi008.flmjzp (mgr.14640) 2014 : cluster [DBG] pgmap v1392: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:21.687815+0000 mgr.smithi008.flmjzp (mgr.14640) 2014 : cluster [DBG] pgmap v1392: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:24.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:23.688341+0000 mgr.smithi008.flmjzp (mgr.14640) 2015 : cluster [DBG] pgmap v1393: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:25.158 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:23.688341+0000 mgr.smithi008.flmjzp (mgr.14640) 2015 : cluster [DBG] pgmap v1393: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:25.689047+0000 mgr.smithi008.flmjzp (mgr.14640) 2016 : cluster [DBG] pgmap v1394: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:26.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:25.689047+0000 mgr.smithi008.flmjzp (mgr.14640) 2016 : cluster [DBG] pgmap v1394: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:29.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:27.689694+0000 mgr.smithi008.flmjzp (mgr.14640) 2017 : cluster [DBG] pgmap v1395: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:29.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:27.689694+0000 mgr.smithi008.flmjzp (mgr.14640) 2017 : cluster [DBG] pgmap v1395: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:30.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:29.723394+0000 mon.smithi008 (mon.0) 2458 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:30.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:29.723394+0000 mon.smithi008 (mon.0) 2458 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:29.690274+0000 mgr.smithi008.flmjzp (mgr.14640) 2018 : cluster [DBG] pgmap v1396: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:30.285856+0000 mon.smithi008 (mon.0) 2459 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:30.286708+0000 mon.smithi008 (mon.0) 2460 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:30.292439+0000 mon.smithi008 (mon.0) 2461 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:30.297379+0000 mon.smithi008 (mon.0) 2462 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:30.299759+0000 mon.smithi008 (mon.0) 2463 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:30.301026+0000 mon.smithi008 (mon.0) 2464 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:31.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:30.302206+0000 mon.smithi008 (mon.0) 2465 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:31.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:30.303723+0000 mon.smithi008 (mon.0) 2466 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:31.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:29.690274+0000 mgr.smithi008.flmjzp (mgr.14640) 2018 : cluster [DBG] pgmap v1396: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:31.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:30.285856+0000 mon.smithi008 (mon.0) 2459 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:31.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:30.286708+0000 mon.smithi008 (mon.0) 2460 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:30.292439+0000 mon.smithi008 (mon.0) 2461 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:30.297379+0000 mon.smithi008 (mon.0) 2462 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:30.299759+0000 mon.smithi008 (mon.0) 2463 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:30.301026+0000 mon.smithi008 (mon.0) 2464 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:30.302206+0000 mon.smithi008 (mon.0) 2465 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:31.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:30.303723+0000 mon.smithi008 (mon.0) 2466 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:32:30.287375+0000 mgr.smithi008.flmjzp (mgr.14640) 2019 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:30.288086+0000 mgr.smithi008.flmjzp (mgr.14640) 2020 : cluster [DBG] pgmap v1397: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:30.288307+0000 mgr.smithi008.flmjzp (mgr.14640) 2021 : cluster [DBG] pgmap v1398: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:32:30.305240+0000 mgr.smithi008.flmjzp (mgr.14640) 2022 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:32.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.201+0000 7fb33e229700 1 -- 172.21.15.8:0/2711545944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3380f77d0 msgr2=0x7fb3380f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:32.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.201+0000 7fb33e229700 1 --2- 172.21.15.8:0/2711545944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3380f77d0 0x7fb3380f7c30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fb328004660 tx=0x7fb328009b30).stop 2023-10-18T21:32:32.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.201+0000 7fb33e229700 1 -- 172.21.15.8:0/2711545944 shutdown_connections 2023-10-18T21:32:32.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.201+0000 7fb33e229700 1 --2- 172.21.15.8:0/2711545944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3380f77d0 0x7fb3380f7c30 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.201+0000 7fb33e229700 1 --2- 172.21.15.8:0/2711545944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3380f6530 0x7fb3380f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.201+0000 7fb33e229700 1 -- 172.21.15.8:0/2711545944 >> 172.21.15.8:0/2711545944 conn(0x7fb3380f1c90 msgr2=0x7fb3380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:32.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.201+0000 7fb33e229700 1 -- 172.21.15.8:0/2711545944 shutdown_connections 2023-10-18T21:32:32.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.201+0000 7fb33e229700 1 -- 172.21.15.8:0/2711545944 wait complete. 2023-10-18T21:32:32.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.202+0000 7fb33e229700 1 Processor -- start 2023-10-18T21:32:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.202+0000 7fb33e229700 1 -- start start 2023-10-18T21:32:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.202+0000 7fb33e229700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3380f6530 0x7fb338106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.202+0000 7fb33e229700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3380f77d0 0x7fb338107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.202+0000 7fb33e229700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb338107880 con 0x7fb3380f77d0 2023-10-18T21:32:32.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.202+0000 7fb33e229700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3381080c0 con 0x7fb3380f6530 2023-10-18T21:32:32.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb33ca26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3380f77d0 0x7fb338107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:32.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb33ca26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3380f77d0 0x7fb338107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36358/0 (socket says 172.21.15.8:36358) 2023-10-18T21:32:32.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb33ca26700 1 -- 172.21.15.8:0/2424774457 learned_addr learned my addr 172.21.15.8:0/2424774457 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:32.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb33d227700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3380f6530 0x7fb338106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:32.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb33ca26700 1 -- 172.21.15.8:0/2424774457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3380f6530 msgr2=0x7fb338106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:32.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb33ca26700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3380f6530 0x7fb338106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb33ca26700 1 -- 172.21.15.8:0/2424774457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb328005040 con 0x7fb3380f77d0 2023-10-18T21:32:32.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb33ca26700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3380f77d0 0x7fb338107280 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7fb328009990 tx=0x7fb328009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:32.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb32dffb700 1 -- 172.21.15.8:0/2424774457 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb328018070 con 0x7fb3380f77d0 2023-10-18T21:32:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb32dffb700 1 -- 172.21.15.8:0/2424774457 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb328009780 con 0x7fb3380f77d0 2023-10-18T21:32:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb33e229700 1 -- 172.21.15.8:0/2424774457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb338108340 con 0x7fb3380f77d0 2023-10-18T21:32:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.203+0000 7fb32dffb700 1 -- 172.21.15.8:0/2424774457 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb32801c5e0 con 0x7fb3380f77d0 2023-10-18T21:32:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.204+0000 7fb33e229700 1 -- 172.21.15.8:0/2424774457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb338108820 con 0x7fb3380f77d0 2023-10-18T21:32:32.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.205+0000 7fb33e229700 1 -- 172.21.15.8:0/2424774457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb338059100 con 0x7fb3380f77d0 2023-10-18T21:32:32.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.206+0000 7fb32dffb700 1 -- 172.21.15.8:0/2424774457 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb32801dac0 con 0x7fb3380f77d0 2023-10-18T21:32:32.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.206+0000 7fb32dffb700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb324060f70 0x7fb324063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:32.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.206+0000 7fb32dffb700 1 -- 172.21.15.8:0/2424774457 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb32807e760 con 0x7fb3380f77d0 2023-10-18T21:32:32.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.207+0000 7fb33d227700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb324060f70 0x7fb324063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:32.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.207+0000 7fb33d227700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb324060f70 0x7fb324063430 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fb338107b50 tx=0x7fb334009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:32.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.211+0000 7fb32dffb700 1 -- 172.21.15.8:0/2424774457 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb32804e390 con 0x7fb3380f77d0 2023-10-18T21:32:32.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:32:30.287375+0000 mgr.smithi008.flmjzp (mgr.14640) 2019 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:30.288086+0000 mgr.smithi008.flmjzp (mgr.14640) 2020 : cluster [DBG] pgmap v1397: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:30.288307+0000 mgr.smithi008.flmjzp (mgr.14640) 2021 : cluster [DBG] pgmap v1398: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:32:30.305240+0000 mgr.smithi008.flmjzp (mgr.14640) 2022 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:32.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.409+0000 7fb33e229700 1 -- 172.21.15.8:0/2424774457 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3380008d0 con 0x7fb324060f70 2023-10-18T21:32:32.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.410+0000 7fb32dffb700 1 -- 172.21.15.8:0/2424774457 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb3380008d0 con 0x7fb324060f70 2023-10-18T21:32:32.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.412+0000 7fb33e229700 1 -- 172.21.15.8:0/2424774457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb324060f70 msgr2=0x7fb324063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:32.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.412+0000 7fb33e229700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb324060f70 0x7fb324063430 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fb338107b50 tx=0x7fb334009040).stop 2023-10-18T21:32:32.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.412+0000 7fb33e229700 1 -- 172.21.15.8:0/2424774457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3380f77d0 msgr2=0x7fb338107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:32.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.412+0000 7fb33e229700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3380f77d0 0x7fb338107280 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7fb328009990 tx=0x7fb328009b30).stop 2023-10-18T21:32:32.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.412+0000 7fb33e229700 1 -- 172.21.15.8:0/2424774457 shutdown_connections 2023-10-18T21:32:32.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.412+0000 7fb33e229700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb324060f70 0x7fb324063430 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.412+0000 7fb33e229700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3380f6530 0x7fb338106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.412+0000 7fb33e229700 1 --2- 172.21.15.8:0/2424774457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3380f77d0 0x7fb338107280 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.412+0000 7fb33e229700 1 -- 172.21.15.8:0/2424774457 >> 172.21.15.8:0/2424774457 conn(0x7fb3380f1c90 msgr2=0x7fb3380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:32.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.413+0000 7fb33e229700 1 -- 172.21.15.8:0/2424774457 shutdown_connections 2023-10-18T21:32:32.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.413+0000 7fb33e229700 1 -- 172.21.15.8:0/2424774457 wait complete. 2023-10-18T21:32:32.429 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:32:32.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.550+0000 7f15928cb700 1 -- 172.21.15.8:0/3247367545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c0f96a0 msgr2=0x7f158c0fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:32.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.550+0000 7f15928cb700 1 --2- 172.21.15.8:0/3247367545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c0f96a0 0x7f158c0fbaf0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f157c004660 tx=0x7f157c009b30).stop 2023-10-18T21:32:32.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.550+0000 7f15928cb700 1 -- 172.21.15.8:0/3247367545 shutdown_connections 2023-10-18T21:32:32.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.550+0000 7f15928cb700 1 --2- 172.21.15.8:0/3247367545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c0f96a0 0x7f158c0fbaf0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.550+0000 7f15928cb700 1 --2- 172.21.15.8:0/3247367545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c060310 0x7f158c0f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.550+0000 7f15928cb700 1 -- 172.21.15.8:0/3247367545 >> 172.21.15.8:0/3247367545 conn(0x7f158c0f0ba0 msgr2=0x7f158c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.550+0000 7f15928cb700 1 -- 172.21.15.8:0/3247367545 shutdown_connections 2023-10-18T21:32:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.551+0000 7f15928cb700 1 -- 172.21.15.8:0/3247367545 wait complete. 2023-10-18T21:32:32.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.551+0000 7f15928cb700 1 Processor -- start 2023-10-18T21:32:32.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.551+0000 7f15928cb700 1 -- start start 2023-10-18T21:32:32.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.552+0000 7f15928cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c060310 0x7f158c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:32.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.552+0000 7f15928cb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c0f96a0 0x7f158c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:32.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.552+0000 7f15928cb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c109970 con 0x7f158c0f96a0 2023-10-18T21:32:32.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.552+0000 7f15928cb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c109ab0 con 0x7f158c060310 2023-10-18T21:32:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.552+0000 7f15910c8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c0f96a0 0x7f158c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.552+0000 7f15910c8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c0f96a0 0x7f158c1093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36382/0 (socket says 172.21.15.8:36382) 2023-10-18T21:32:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.552+0000 7f15910c8700 1 -- 172.21.15.8:0/124887345 learned_addr learned my addr 172.21.15.8:0/124887345 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:32.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.552+0000 7f15918c9700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c060310 0x7f158c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:32.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.553+0000 7f15910c8700 1 -- 172.21.15.8:0/124887345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c060310 msgr2=0x7f158c108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:32.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.553+0000 7f15910c8700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c060310 0x7f158c108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.553+0000 7f15910c8700 1 -- 172.21.15.8:0/124887345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c005040 con 0x7f158c0f96a0 2023-10-18T21:32:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.553+0000 7f15910c8700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c0f96a0 0x7f158c1093c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f157c009870 tx=0x7f157c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.553+0000 7f15827fc700 1 -- 172.21.15.8:0/124887345 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157c019070 con 0x7f158c0f96a0 2023-10-18T21:32:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.553+0000 7f15827fc700 1 -- 172.21.15.8:0/124887345 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f157c013380 con 0x7f158c0f96a0 2023-10-18T21:32:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.553+0000 7f15928cb700 1 -- 172.21.15.8:0/124887345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c10a3f0 con 0x7f158c0f96a0 2023-10-18T21:32:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.553+0000 7f15827fc700 1 -- 172.21.15.8:0/124887345 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157c01edf0 con 0x7f158c0f96a0 2023-10-18T21:32:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.553+0000 7f15928cb700 1 -- 172.21.15.8:0/124887345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c10a8d0 con 0x7f158c0f96a0 2023-10-18T21:32:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.554+0000 7f15928cb700 1 -- 172.21.15.8:0/124887345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c045ad0 con 0x7f158c0f96a0 2023-10-18T21:32:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.555+0000 7f15827fc700 1 -- 172.21.15.8:0/124887345 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f157c01e420 con 0x7f158c0f96a0 2023-10-18T21:32:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.556+0000 7f15827fc700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1578060f70 0x7f1578063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.556+0000 7f15827fc700 1 -- 172.21.15.8:0/124887345 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f157c07dd00 con 0x7f158c0f96a0 2023-10-18T21:32:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.556+0000 7f15918c9700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1578060f70 0x7f1578063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:32.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.557+0000 7f15918c9700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1578060f70 0x7f1578063430 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f1588009fd0 tx=0x7f158800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:32.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.560+0000 7f15827fc700 1 -- 172.21.15.8:0/124887345 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f157c051360 con 0x7f158c0f96a0 2023-10-18T21:32:32.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.760+0000 7f15928cb700 1 -- 172.21.15.8:0/124887345 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f158c0f56c0 con 0x7f1578060f70 2023-10-18T21:32:32.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.761+0000 7f15827fc700 1 -- 172.21.15.8:0/124887345 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f158c0f56c0 con 0x7f1578060f70 2023-10-18T21:32:32.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.763+0000 7f15928cb700 1 -- 172.21.15.8:0/124887345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1578060f70 msgr2=0x7f1578063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:32.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.763+0000 7f15928cb700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1578060f70 0x7f1578063430 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f1588009fd0 tx=0x7f158800b040).stop 2023-10-18T21:32:32.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.763+0000 7f15928cb700 1 -- 172.21.15.8:0/124887345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c0f96a0 msgr2=0x7f158c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:32.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.763+0000 7f15928cb700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c0f96a0 0x7f158c1093c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f157c009870 tx=0x7f157c00b040).stop 2023-10-18T21:32:32.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.763+0000 7f15928cb700 1 -- 172.21.15.8:0/124887345 shutdown_connections 2023-10-18T21:32:32.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.763+0000 7f15928cb700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1578060f70 0x7f1578063430 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.763+0000 7f15928cb700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c060310 0x7f158c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.763+0000 7f15928cb700 1 --2- 172.21.15.8:0/124887345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c0f96a0 0x7f158c1093c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.764+0000 7f15928cb700 1 -- 172.21.15.8:0/124887345 >> 172.21.15.8:0/124887345 conn(0x7f158c0f0ba0 msgr2=0x7f158c0f4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:32.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.764+0000 7f15928cb700 1 -- 172.21.15.8:0/124887345 shutdown_connections 2023-10-18T21:32:32.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.764+0000 7f15928cb700 1 -- 172.21.15.8:0/124887345 wait complete. 2023-10-18T21:32:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.901+0000 7fcbabfff700 1 -- 172.21.15.8:0/84383283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbac0f77d0 msgr2=0x7fcbac0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.901+0000 7fcbabfff700 1 --2- 172.21.15.8:0/84383283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbac0f77d0 0x7fcbac0f7c30 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fcba0004660 tx=0x7fcba0009b30).stop 2023-10-18T21:32:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.901+0000 7fcbabfff700 1 -- 172.21.15.8:0/84383283 shutdown_connections 2023-10-18T21:32:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.901+0000 7fcbabfff700 1 --2- 172.21.15.8:0/84383283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbac0f77d0 0x7fcbac0f7c30 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.901+0000 7fcbabfff700 1 --2- 172.21.15.8:0/84383283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbac0f6530 0x7fcbac0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.901+0000 7fcbabfff700 1 -- 172.21.15.8:0/84383283 >> 172.21.15.8:0/84383283 conn(0x7fcbac0f1cd0 msgr2=0x7fcbac0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.901+0000 7fcbabfff700 1 -- 172.21.15.8:0/84383283 shutdown_connections 2023-10-18T21:32:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.901+0000 7fcbabfff700 1 -- 172.21.15.8:0/84383283 wait complete. 2023-10-18T21:32:32.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.902+0000 7fcbabfff700 1 Processor -- start 2023-10-18T21:32:32.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.902+0000 7fcbabfff700 1 -- start start 2023-10-18T21:32:32.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbabfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbac0f6530 0x7fcbac108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:32.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbabfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbac0f77d0 0x7fcbac1093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbabfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac109980 con 0x7fcbac0f6530 2023-10-18T21:32:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbabfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac109ac0 con 0x7fcbac0f77d0 2023-10-18T21:32:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbaaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbac0f6530 0x7fcbac108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbaaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbac0f6530 0x7fcbac108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36408/0 (socket says 172.21.15.8:36408) 2023-10-18T21:32:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbaaffd700 1 -- 172.21.15.8:0/2588700788 learned_addr learned my addr 172.21.15.8:0/2588700788 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbaa7fc700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbac0f77d0 0x7fcbac1093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbaaffd700 1 -- 172.21.15.8:0/2588700788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbac0f77d0 msgr2=0x7fcbac1093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbaaffd700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbac0f77d0 0x7fcbac1093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.903+0000 7fcbaaffd700 1 -- 172.21.15.8:0/2588700788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba0005040 con 0x7fcbac0f6530 2023-10-18T21:32:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.904+0000 7fcbaaffd700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbac0f6530 0x7fcbac108ee0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fcb9c002700 tx=0x7fcb9c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.904+0000 7fcb937fe700 1 -- 172.21.15.8:0/2588700788 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9c0079c0 con 0x7fcbac0f6530 2023-10-18T21:32:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.904+0000 7fcb937fe700 1 -- 172.21.15.8:0/2588700788 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcb9c00f040 con 0x7fcbac0f6530 2023-10-18T21:32:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.904+0000 7fcbabfff700 1 -- 172.21.15.8:0/2588700788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac10a460 con 0x7fcbac0f6530 2023-10-18T21:32:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.904+0000 7fcb937fe700 1 -- 172.21.15.8:0/2588700788 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9c0148d0 con 0x7fcbac0f6530 2023-10-18T21:32:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.904+0000 7fcbabfff700 1 -- 172.21.15.8:0/2588700788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac10aa20 con 0x7fcbac0f6530 2023-10-18T21:32:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.905+0000 7fcbabfff700 1 -- 172.21.15.8:0/2588700788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac045ad0 con 0x7fcbac0f6530 2023-10-18T21:32:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.906+0000 7fcb937fe700 1 -- 172.21.15.8:0/2588700788 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcb9c01b060 con 0x7fcbac0f6530 2023-10-18T21:32:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.907+0000 7fcb937fe700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb94060f70 0x7fcb94063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.907+0000 7fcb937fe700 1 -- 172.21.15.8:0/2588700788 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcb9c07c6b0 con 0x7fcbac0f6530 2023-10-18T21:32:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.907+0000 7fcbaa7fc700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb94060f70 0x7fcb94063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.908+0000 7fcbaa7fc700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb94060f70 0x7fcb94063430 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fcba0004630 tx=0x7fcba0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:32.911+0000 7fcb937fe700 1 -- 172.21.15.8:0/2588700788 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcb9c04fdd0 con 0x7fcbac0f6530 2023-10-18T21:32:33.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.105+0000 7fcbabfff700 1 -- 172.21.15.8:0/2588700788 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbac10acf0 con 0x7fcb94060f70 2023-10-18T21:32:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.115+0000 7fcb937fe700 1 -- 172.21.15.8:0/2588700788 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcbac10acf0 con 0x7fcb94060f70 2023-10-18T21:32:33.117 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:32:33.117 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (39m) 7m ago 40m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:32:33.117 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (33m) 7m ago 40m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:32:33.118 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (33m) 4m ago 39m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:32:33.118 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (39m) 7m ago 40m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:32:33.118 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 36m - - 2023-10-18T21:32:33.118 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 36m - - 2023-10-18T21:32:33.119 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 36m - - 2023-10-18T21:32:33.119 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 36m - - 2023-10-18T21:32:33.119 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (34m) 7m ago 42m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:32:33.119 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (33m) 4m ago 39m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:32:33.119 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (33m) 7m ago 42m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:32:33.119 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (33m) 4m ago 39m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:32:33.120 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (40m) 7m ago 40m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:32:33.120 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (39m) 4m ago 39m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:32:33.120 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (32m) 7m ago 39m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:32:33.120 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (30m) 7m ago 38m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:32:33.120 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (30m) 7m ago 38m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:32:33.121 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (29m) 4m ago 38m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:32:33.121 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (29m) 4m ago 38m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:32:33.121 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (28m) 4m ago 37m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:32:33.121 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (34m) 7m ago 39m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:32:33.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 -- 172.21.15.8:0/2588700788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb94060f70 msgr2=0x7fcb94063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:33.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb94060f70 0x7fcb94063430 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fcba0004630 tx=0x7fcba0009b30).stop 2023-10-18T21:32:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 -- 172.21.15.8:0/2588700788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbac0f6530 msgr2=0x7fcbac108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbac0f6530 0x7fcbac108ee0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fcb9c002700 tx=0x7fcb9c009d80).stop 2023-10-18T21:32:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 -- 172.21.15.8:0/2588700788 shutdown_connections 2023-10-18T21:32:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb94060f70 0x7fcb94063430 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbac0f6530 0x7fcbac108ee0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 --2- 172.21.15.8:0/2588700788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbac0f77d0 0x7fcbac1093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 -- 172.21.15.8:0/2588700788 >> 172.21.15.8:0/2588700788 conn(0x7fcbac0f1cd0 msgr2=0x7fcbac0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 -- 172.21.15.8:0/2588700788 shutdown_connections 2023-10-18T21:32:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.117+0000 7fcbabfff700 1 -- 172.21.15.8:0/2588700788 wait complete. 2023-10-18T21:32:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.253+0000 7fc9167fd700 1 -- 172.21.15.8:0/1584060909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9100f96a0 msgr2=0x7fc9100fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.253+0000 7fc9167fd700 1 --2- 172.21.15.8:0/1584060909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9100f96a0 0x7fc9100fbaf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fc900004660 tx=0x7fc900009b30).stop 2023-10-18T21:32:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.253+0000 7fc9167fd700 1 -- 172.21.15.8:0/1584060909 shutdown_connections 2023-10-18T21:32:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.253+0000 7fc9167fd700 1 --2- 172.21.15.8:0/1584060909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9100f96a0 0x7fc9100fbaf0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.253+0000 7fc9167fd700 1 --2- 172.21.15.8:0/1584060909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc910060270 0x7fc9100f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.253+0000 7fc9167fd700 1 -- 172.21.15.8:0/1584060909 >> 172.21.15.8:0/1584060909 conn(0x7fc9100f0b90 msgr2=0x7fc9100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.253+0000 7fc9167fd700 1 -- 172.21.15.8:0/1584060909 shutdown_connections 2023-10-18T21:32:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.253+0000 7fc9167fd700 1 -- 172.21.15.8:0/1584060909 wait complete. 2023-10-18T21:32:33.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.254+0000 7fc9167fd700 1 Processor -- start 2023-10-18T21:32:33.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.254+0000 7fc9167fd700 1 -- start start 2023-10-18T21:32:33.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.254+0000 7fc9167fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc910060270 0x7fc9100f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:33.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.254+0000 7fc9167fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100f96a0 0x7fc9100f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.254+0000 7fc9167fd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100f5610 con 0x7fc910060270 2023-10-18T21:32:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.254+0000 7fc9167fd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100f5750 con 0x7fc9100f96a0 2023-10-18T21:32:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.254+0000 7fc9157fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc910060270 0x7fc9100f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.254+0000 7fc9157fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc910060270 0x7fc9100f6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36424/0 (socket says 172.21.15.8:36424) 2023-10-18T21:32:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.254+0000 7fc9157fb700 1 -- 172.21.15.8:0/2598119500 learned_addr learned my addr 172.21.15.8:0/2598119500 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:33.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.255+0000 7fc914ffa700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100f96a0 0x7fc9100f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:33.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.255+0000 7fc9157fb700 1 -- 172.21.15.8:0/2598119500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100f96a0 msgr2=0x7fc9100f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:33.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.255+0000 7fc9157fb700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100f96a0 0x7fc9100f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.255+0000 7fc9157fb700 1 -- 172.21.15.8:0/2598119500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900005040 con 0x7fc910060270 2023-10-18T21:32:33.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.255+0000 7fc9157fb700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc910060270 0x7fc9100f6c30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fc90c0026d0 tx=0x7fc90c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:33.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.255+0000 7fc905ffb700 1 -- 172.21.15.8:0/2598119500 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc90c009320 con 0x7fc910060270 2023-10-18T21:32:33.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.255+0000 7fc905ffb700 1 -- 172.21.15.8:0/2598119500 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc90c00f040 con 0x7fc910060270 2023-10-18T21:32:33.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.255+0000 7fc9167fd700 1 -- 172.21.15.8:0/2598119500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9100f5a30 con 0x7fc910060270 2023-10-18T21:32:33.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.255+0000 7fc905ffb700 1 -- 172.21.15.8:0/2598119500 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc90c0148a0 con 0x7fc910060270 2023-10-18T21:32:33.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.256+0000 7fc9167fd700 1 -- 172.21.15.8:0/2598119500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91010ed90 con 0x7fc910060270 2023-10-18T21:32:33.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.257+0000 7fc9167fd700 1 -- 172.21.15.8:0/2598119500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc910045ad0 con 0x7fc910060270 2023-10-18T21:32:33.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.258+0000 7fc905ffb700 1 -- 172.21.15.8:0/2598119500 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc90c009480 con 0x7fc910060270 2023-10-18T21:32:33.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.258+0000 7fc905ffb700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc8fc060f70 0x7fc8fc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:33.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.259+0000 7fc905ffb700 1 -- 172.21.15.8:0/2598119500 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc90c07d090 con 0x7fc910060270 2023-10-18T21:32:33.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.259+0000 7fc914ffa700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc8fc060f70 0x7fc8fc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:33.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.259+0000 7fc914ffa700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc8fc060f70 0x7fc8fc063430 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fc900005010 tx=0x7fc900009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:33.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.263+0000 7fc905ffb700 1 -- 172.21.15.8:0/2598119500 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc90c04cc40 con 0x7fc910060270 2023-10-18T21:32:33.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.515+0000 7fc9167fd700 1 -- 172.21.15.8:0/2598119500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc9100fed70 con 0x7fc910060270 2023-10-18T21:32:33.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.516+0000 7fc905ffb700 1 -- 172.21.15.8:0/2598119500 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fc90c0181b0 con 0x7fc910060270 2023-10-18T21:32:33.518 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:32:33.519 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:32:33.519 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:32:33.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:32:33.519 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:32:33.520 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:32:33.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:32:33.520 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:32:33.520 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:32:33.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:32:33.521 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:32:33.521 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:32:33.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:32:33.521 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:32:33.521 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:32:33.522 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:32:33.522 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:32:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.518+0000 7fc9167fd700 1 -- 172.21.15.8:0/2598119500 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc8fc060f70 msgr2=0x7fc8fc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.518+0000 7fc9167fd700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc8fc060f70 0x7fc8fc063430 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fc900005010 tx=0x7fc900009b30).stop 2023-10-18T21:32:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.518+0000 7fc9167fd700 1 -- 172.21.15.8:0/2598119500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc910060270 msgr2=0x7fc9100f6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.518+0000 7fc9167fd700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc910060270 0x7fc9100f6c30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fc90c0026d0 tx=0x7fc90c009de0).stop 2023-10-18T21:32:33.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.518+0000 7fc9167fd700 1 -- 172.21.15.8:0/2598119500 shutdown_connections 2023-10-18T21:32:33.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.518+0000 7fc9167fd700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc8fc060f70 0x7fc8fc063430 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.518+0000 7fc9167fd700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc910060270 0x7fc9100f6c30 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.518+0000 7fc9167fd700 1 --2- 172.21.15.8:0/2598119500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100f96a0 0x7fc9100f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.518+0000 7fc9167fd700 1 -- 172.21.15.8:0/2598119500 >> 172.21.15.8:0/2598119500 conn(0x7fc9100f0b90 msgr2=0x7fc9100f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:33.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.519+0000 7fc9167fd700 1 -- 172.21.15.8:0/2598119500 shutdown_connections 2023-10-18T21:32:33.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.519+0000 7fc9167fd700 1 -- 172.21.15.8:0/2598119500 wait complete. 2023-10-18T21:32:33.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.655+0000 7fe03570f700 1 -- 172.21.15.8:0/3265325991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0300f77d0 msgr2=0x7fe0300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:33.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.655+0000 7fe03570f700 1 --2- 172.21.15.8:0/3265325991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0300f77d0 0x7fe0300f7c30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7fe024004660 tx=0x7fe024009b30).stop 2023-10-18T21:32:33.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.655+0000 7fe03570f700 1 -- 172.21.15.8:0/3265325991 shutdown_connections 2023-10-18T21:32:33.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.655+0000 7fe03570f700 1 --2- 172.21.15.8:0/3265325991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0300f77d0 0x7fe0300f7c30 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.655+0000 7fe03570f700 1 --2- 172.21.15.8:0/3265325991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0300f6530 0x7fe0300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.655+0000 7fe03570f700 1 -- 172.21.15.8:0/3265325991 >> 172.21.15.8:0/3265325991 conn(0x7fe0300f1c90 msgr2=0x7fe0300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:33.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.655+0000 7fe03570f700 1 -- 172.21.15.8:0/3265325991 shutdown_connections 2023-10-18T21:32:33.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.655+0000 7fe03570f700 1 -- 172.21.15.8:0/3265325991 wait complete. 2023-10-18T21:32:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.656+0000 7fe03570f700 1 Processor -- start 2023-10-18T21:32:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.656+0000 7fe03570f700 1 -- start start 2023-10-18T21:32:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.656+0000 7fe03570f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0300f6530 0x7fe030108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:33.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.656+0000 7fe03570f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0300f77d0 0x7fe030109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:33.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.656+0000 7fe03570f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe030109a20 con 0x7fe0300f77d0 2023-10-18T21:32:33.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.656+0000 7fe03570f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe030109b60 con 0x7fe0300f6530 2023-10-18T21:32:33.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.657+0000 7fe02f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0300f77d0 0x7fe030109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:33.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.657+0000 7fe02f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0300f77d0 0x7fe030109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36442/0 (socket says 172.21.15.8:36442) 2023-10-18T21:32:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.657+0000 7fe02f7fe700 1 -- 172.21.15.8:0/2126353542 learned_addr learned my addr 172.21.15.8:0/2126353542 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.657+0000 7fe02ffff700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0300f6530 0x7fe030108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.657+0000 7fe02f7fe700 1 -- 172.21.15.8:0/2126353542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0300f6530 msgr2=0x7fe030108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.657+0000 7fe02f7fe700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0300f6530 0x7fe030108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.657+0000 7fe02f7fe700 1 -- 172.21.15.8:0/2126353542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe024005040 con 0x7fe0300f77d0 2023-10-18T21:32:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.657+0000 7fe02f7fe700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0300f77d0 0x7fe030109470 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fe024009990 tx=0x7fe024009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.658+0000 7fe02cff9700 1 -- 172.21.15.8:0/2126353542 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe024018070 con 0x7fe0300f77d0 2023-10-18T21:32:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.658+0000 7fe02cff9700 1 -- 172.21.15.8:0/2126353542 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe024009630 con 0x7fe0300f77d0 2023-10-18T21:32:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.658+0000 7fe03570f700 1 -- 172.21.15.8:0/2126353542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03010a4a0 con 0x7fe0300f77d0 2023-10-18T21:32:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.658+0000 7fe02cff9700 1 -- 172.21.15.8:0/2126353542 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe02401c400 con 0x7fe0300f77d0 2023-10-18T21:32:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.658+0000 7fe03570f700 1 -- 172.21.15.8:0/2126353542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03010aa00 con 0x7fe0300f77d0 2023-10-18T21:32:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.659+0000 7fe03570f700 1 -- 172.21.15.8:0/2126353542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe030045ad0 con 0x7fe0300f77d0 2023-10-18T21:32:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.660+0000 7fe02cff9700 1 -- 172.21.15.8:0/2126353542 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe02401d9e0 con 0x7fe0300f77d0 2023-10-18T21:32:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.660+0000 7fe02cff9700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe018060f70 0x7fe018063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.661+0000 7fe02cff9700 1 -- 172.21.15.8:0/2126353542 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe02407e6d0 con 0x7fe0300f77d0 2023-10-18T21:32:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.661+0000 7fe02ffff700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe018060f70 0x7fe018063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.661+0000 7fe02ffff700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe018060f70 0x7fe018063430 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fe0300f7630 tx=0x7fe020009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.665+0000 7fe02cff9700 1 -- 172.21.15.8:0/2126353542 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe024051cf0 con 0x7fe0300f77d0 2023-10-18T21:32:33.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.899+0000 7fe03570f700 1 -- 172.21.15.8:0/2126353542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe0300fedc0 con 0x7fe0300f77d0 2023-10-18T21:32:33.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.899+0000 7fe02cff9700 1 -- 172.21.15.8:0/2126353542 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fe0240518e0 con 0x7fe0300f77d0 2023-10-18T21:32:33.902 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:32:33.902 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:32:33.902 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:32:33.902 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:32:33.903 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:32:33.903 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:32:33.903 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:32:33.903 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:32:33.903 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:32:33.904 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:32:33.904 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:32:33.904 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:32:33.904 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:32:33.905 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:32:33.905 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:32:33.905 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:32:33.905 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:32:33.905 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:32:33.906 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:32:33.906 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:32:33.906 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:32:33.906 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:32:33.906 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:32:33.907 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:32:33.907 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:32:33.907 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:32:33.907 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:32:33.907 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:32:33.908 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:32:33.908 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:32:33.908 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:32:33.909 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:32:33.909 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:32:33.909 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:32:33.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.901+0000 7fe03570f700 1 -- 172.21.15.8:0/2126353542 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe018060f70 msgr2=0x7fe018063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:33.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.901+0000 7fe03570f700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe018060f70 0x7fe018063430 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fe0300f7630 tx=0x7fe020009c00).stop 2023-10-18T21:32:33.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.901+0000 7fe03570f700 1 -- 172.21.15.8:0/2126353542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0300f77d0 msgr2=0x7fe030109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:33.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.901+0000 7fe03570f700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0300f77d0 0x7fe030109470 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fe024009990 tx=0x7fe024009b30).stop 2023-10-18T21:32:33.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.901+0000 7fe03570f700 1 -- 172.21.15.8:0/2126353542 shutdown_connections 2023-10-18T21:32:33.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.901+0000 7fe03570f700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe018060f70 0x7fe018063430 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.901+0000 7fe03570f700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0300f6530 0x7fe030108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.901+0000 7fe03570f700 1 --2- 172.21.15.8:0/2126353542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0300f77d0 0x7fe030109470 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:33.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.901+0000 7fe03570f700 1 -- 172.21.15.8:0/2126353542 >> 172.21.15.8:0/2126353542 conn(0x7fe0300f1c90 msgr2=0x7fe03006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:33.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.902+0000 7fe03570f700 1 -- 172.21.15.8:0/2126353542 shutdown_connections 2023-10-18T21:32:33.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:33.902+0000 7fe03570f700 1 -- 172.21.15.8:0/2126353542 wait complete. 2023-10-18T21:32:33.913 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:32:33.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:32.288715+0000 mgr.smithi008.flmjzp (mgr.14640) 2023 : cluster [DBG] pgmap v1399: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:32.411785+0000 mgr.smithi008.flmjzp (mgr.14640) 2024 : audit [DBG] from='client.35776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:32.762740+0000 mgr.smithi008.flmjzp (mgr.14640) 2025 : audit [DBG] from='client.35780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:33.517633+0000 mon.smithi008 (mon.0) 2467 : audit [DBG] from='client.? 172.21.15.8:0/2598119500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:34.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.040+0000 7fefdbfff700 1 -- 172.21.15.8:0/364324386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefdc0f77d0 msgr2=0x7fefdc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:34.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.040+0000 7fefdbfff700 1 --2- 172.21.15.8:0/364324386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefdc0f77d0 0x7fefdc0f7c30 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7fefd0004660 tx=0x7fefd0009b30).stop 2023-10-18T21:32:34.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.040+0000 7fefdbfff700 1 -- 172.21.15.8:0/364324386 shutdown_connections 2023-10-18T21:32:34.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.040+0000 7fefdbfff700 1 --2- 172.21.15.8:0/364324386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefdc0f77d0 0x7fefdc0f7c30 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:34.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.040+0000 7fefdbfff700 1 --2- 172.21.15.8:0/364324386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefdc0f6530 0x7fefdc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:34.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.040+0000 7fefdbfff700 1 -- 172.21.15.8:0/364324386 >> 172.21.15.8:0/364324386 conn(0x7fefdc0f1c90 msgr2=0x7fefdc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:34.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.040+0000 7fefdbfff700 1 -- 172.21.15.8:0/364324386 shutdown_connections 2023-10-18T21:32:34.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.040+0000 7fefdbfff700 1 -- 172.21.15.8:0/364324386 wait complete. 2023-10-18T21:32:34.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.041+0000 7fefdbfff700 1 Processor -- start 2023-10-18T21:32:34.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.041+0000 7fefdbfff700 1 -- start start 2023-10-18T21:32:34.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefdbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefdc0f6530 0x7fefdc108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:34.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefdbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefdc0f77d0 0x7fefdc109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:34.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefdbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc109a20 con 0x7fefdc0f6530 2023-10-18T21:32:34.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefdbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc109b60 con 0x7fefdc0f77d0 2023-10-18T21:32:34.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefdaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefdc0f6530 0x7fefdc108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:34.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefdaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefdc0f6530 0x7fefdc108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36454/0 (socket says 172.21.15.8:36454) 2023-10-18T21:32:34.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefdaffd700 1 -- 172.21.15.8:0/2719980788 learned_addr learned my addr 172.21.15.8:0/2719980788 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:32:34.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefda7fc700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefdc0f77d0 0x7fefdc109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:34.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefdaffd700 1 -- 172.21.15.8:0/2719980788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefdc0f77d0 msgr2=0x7fefdc109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefdaffd700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefdc0f77d0 0x7fefdc109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.042+0000 7fefdaffd700 1 -- 172.21.15.8:0/2719980788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0005040 con 0x7fefdc0f6530 2023-10-18T21:32:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.043+0000 7fefdaffd700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefdc0f6530 0x7fefdc108f80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7fefcc002700 tx=0x7fefcc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.043+0000 7fefc37fe700 1 -- 172.21.15.8:0/2719980788 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefcc009320 con 0x7fefdc0f6530 2023-10-18T21:32:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.043+0000 7fefc37fe700 1 -- 172.21.15.8:0/2719980788 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fefcc00f040 con 0x7fefdc0f6530 2023-10-18T21:32:34.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.043+0000 7fefc37fe700 1 -- 172.21.15.8:0/2719980788 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefcc014970 con 0x7fefdc0f6530 2023-10-18T21:32:34.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.043+0000 7fefdbfff700 1 -- 172.21.15.8:0/2719980788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc10a500 con 0x7fefdc0f6530 2023-10-18T21:32:34.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.043+0000 7fefdbfff700 1 -- 172.21.15.8:0/2719980788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc10aac0 con 0x7fefdc0f6530 2023-10-18T21:32:34.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.044+0000 7fefdbfff700 1 -- 172.21.15.8:0/2719980788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc045ad0 con 0x7fefdc0f6530 2023-10-18T21:32:34.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.045+0000 7fefc37fe700 1 -- 172.21.15.8:0/2719980788 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fefcc009480 con 0x7fefdc0f6530 2023-10-18T21:32:34.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.046+0000 7fefc37fe700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefc4060f70 0x7fefc4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:32:34.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.046+0000 7fefc37fe700 1 -- 172.21.15.8:0/2719980788 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fefcc07cad0 con 0x7fefdc0f6530 2023-10-18T21:32:34.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.046+0000 7fefda7fc700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefc4060f70 0x7fefc4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:32:34.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.046+0000 7fefda7fc700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefc4060f70 0x7fefc4063430 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fefd0004630 tx=0x7fefd0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:32:34.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.050+0000 7fefc37fe700 1 -- 172.21.15.8:0/2719980788 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fefcc0501f0 con 0x7fefdc0f6530 2023-10-18T21:32:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:32.288715+0000 mgr.smithi008.flmjzp (mgr.14640) 2023 : cluster [DBG] pgmap v1399: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:32.411785+0000 mgr.smithi008.flmjzp (mgr.14640) 2024 : audit [DBG] from='client.35776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:32.762740+0000 mgr.smithi008.flmjzp (mgr.14640) 2025 : audit [DBG] from='client.35780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:33.517633+0000 mon.smithi008 (mon.0) 2467 : audit [DBG] from='client.? 172.21.15.8:0/2598119500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.250+0000 7fefdbfff700 1 -- 172.21.15.8:0/2719980788 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fefdc10ad90 con 0x7fefc4060f70 2023-10-18T21:32:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.251+0000 7fefc37fe700 1 -- 172.21.15.8:0/2719980788 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fefdc10ad90 con 0x7fefc4060f70 2023-10-18T21:32:34.253 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:32:34.253 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:32:34.253 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:32:34.253 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:32:34.254 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:32:34.254 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:32:34.254 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:32:34.254 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:32:34.254 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:32:34.255 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:32:34.255 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:32:34.255 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:32:34.255 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:32:34.255 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:32:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.253+0000 7fefdbfff700 1 -- 172.21.15.8:0/2719980788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefc4060f70 msgr2=0x7fefc4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.253+0000 7fefdbfff700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefc4060f70 0x7fefc4063430 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fefd0004630 tx=0x7fefd0009b30).stop 2023-10-18T21:32:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.253+0000 7fefdbfff700 1 -- 172.21.15.8:0/2719980788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefdc0f6530 msgr2=0x7fefdc108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:32:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.253+0000 7fefdbfff700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefdc0f6530 0x7fefdc108f80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7fefcc002700 tx=0x7fefcc009d80).stop 2023-10-18T21:32:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.253+0000 7fefdbfff700 1 -- 172.21.15.8:0/2719980788 shutdown_connections 2023-10-18T21:32:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.253+0000 7fefdbfff700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefc4060f70 0x7fefc4063430 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.253+0000 7fefdbfff700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefdc0f6530 0x7fefdc108f80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.253+0000 7fefdbfff700 1 --2- 172.21.15.8:0/2719980788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefdc0f77d0 0x7fefdc109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:32:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.253+0000 7fefdbfff700 1 -- 172.21.15.8:0/2719980788 >> 172.21.15.8:0/2719980788 conn(0x7fefdc0f1c90 msgr2=0x7fefdc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:32:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.254+0000 7fefdbfff700 1 -- 172.21.15.8:0/2719980788 shutdown_connections 2023-10-18T21:32:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:32:34.254+0000 7fefdbfff700 1 -- 172.21.15.8:0/2719980788 wait complete. 2023-10-18T21:32:35.159 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:33.107900+0000 mgr.smithi008.flmjzp (mgr.14640) 2026 : audit [DBG] from='client.35784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:35.159 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:33.900904+0000 mon.smithi008 (mon.0) 2468 : audit [DBG] from='client.? 172.21.15.8:0/2126353542' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:32:35.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:33.107900+0000 mgr.smithi008.flmjzp (mgr.14640) 2026 : audit [DBG] from='client.35784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:33.900904+0000 mon.smithi008 (mon.0) 2468 : audit [DBG] from='client.? 172.21.15.8:0/2126353542' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:32:36.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:34.252262+0000 mgr.smithi008.flmjzp (mgr.14640) 2027 : audit [DBG] from='client.35796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:36.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:34.289205+0000 mgr.smithi008.flmjzp (mgr.14640) 2028 : cluster [DBG] pgmap v1400: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:36.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:34.252262+0000 mgr.smithi008.flmjzp (mgr.14640) 2027 : audit [DBG] from='client.35796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:32:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:34.289205+0000 mgr.smithi008.flmjzp (mgr.14640) 2028 : cluster [DBG] pgmap v1400: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:36.289923+0000 mgr.smithi008.flmjzp (mgr.14640) 2029 : cluster [DBG] pgmap v1401: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:38.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:36.289923+0000 mgr.smithi008.flmjzp (mgr.14640) 2029 : cluster [DBG] pgmap v1401: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:40.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:38.290632+0000 mgr.smithi008.flmjzp (mgr.14640) 2030 : cluster [DBG] pgmap v1402: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:40.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:38.290632+0000 mgr.smithi008.flmjzp (mgr.14640) 2030 : cluster [DBG] pgmap v1402: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:40.307621+0000 mon.smithi008 (mon.0) 2469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:40.309757+0000 mon.smithi008 (mon.0) 2470 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:40.310733+0000 mon.smithi008 (mon.0) 2471 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:41.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:40.317154+0000 mon.smithi008 (mon.0) 2472 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:41.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:40.323594+0000 mon.smithi008 (mon.0) 2473 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:41.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:40.326610+0000 mon.smithi008 (mon.0) 2474 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:41.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:40.328280+0000 mon.smithi008 (mon.0) 2475 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:41.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:40.329892+0000 mon.smithi008 (mon.0) 2476 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:41.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:40.331821+0000 mon.smithi008 (mon.0) 2477 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:40.307621+0000 mon.smithi008 (mon.0) 2469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:41.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:40.309757+0000 mon.smithi008 (mon.0) 2470 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:41.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:40.310733+0000 mon.smithi008 (mon.0) 2471 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:41.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:40.317154+0000 mon.smithi008 (mon.0) 2472 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:41.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:40.323594+0000 mon.smithi008 (mon.0) 2473 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:41.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:40.326610+0000 mon.smithi008 (mon.0) 2474 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:41.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:40.328280+0000 mon.smithi008 (mon.0) 2475 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:41.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:40.329892+0000 mon.smithi008 (mon.0) 2476 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:41.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:40.331821+0000 mon.smithi008 (mon.0) 2477 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:40.291384+0000 mgr.smithi008.flmjzp (mgr.14640) 2031 : cluster [DBG] pgmap v1403: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:32:40.311644+0000 mgr.smithi008.flmjzp (mgr.14640) 2032 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:40.312216+0000 mgr.smithi008.flmjzp (mgr.14640) 2033 : cluster [DBG] pgmap v1404: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:40.312635+0000 mgr.smithi008.flmjzp (mgr.14640) 2034 : cluster [DBG] pgmap v1405: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:32:40.333625+0000 mgr.smithi008.flmjzp (mgr.14640) 2035 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:42.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:40.291384+0000 mgr.smithi008.flmjzp (mgr.14640) 2031 : cluster [DBG] pgmap v1403: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:32:40.311644+0000 mgr.smithi008.flmjzp (mgr.14640) 2032 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:40.312216+0000 mgr.smithi008.flmjzp (mgr.14640) 2033 : cluster [DBG] pgmap v1404: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:40.312635+0000 mgr.smithi008.flmjzp (mgr.14640) 2034 : cluster [DBG] pgmap v1405: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:32:40.333625+0000 mgr.smithi008.flmjzp (mgr.14640) 2035 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:42.313282+0000 mgr.smithi008.flmjzp (mgr.14640) 2036 : cluster [DBG] pgmap v1406: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:42.313282+0000 mgr.smithi008.flmjzp (mgr.14640) 2036 : cluster [DBG] pgmap v1406: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:44.314065+0000 mgr.smithi008.flmjzp (mgr.14640) 2037 : cluster [DBG] pgmap v1407: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:46.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:44.314065+0000 mgr.smithi008.flmjzp (mgr.14640) 2037 : cluster [DBG] pgmap v1407: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:46.314841+0000 mgr.smithi008.flmjzp (mgr.14640) 2038 : cluster [DBG] pgmap v1408: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:48.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:46.314841+0000 mgr.smithi008.flmjzp (mgr.14640) 2038 : cluster [DBG] pgmap v1408: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:50.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:48.315521+0000 mgr.smithi008.flmjzp (mgr.14640) 2039 : cluster [DBG] pgmap v1409: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:48.315521+0000 mgr.smithi008.flmjzp (mgr.14640) 2039 : cluster [DBG] pgmap v1409: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:50.344227+0000 mon.smithi008 (mon.0) 2478 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:51.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:50.344227+0000 mon.smithi008 (mon.0) 2478 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:50.316062+0000 mgr.smithi008.flmjzp (mgr.14640) 2040 : cluster [DBG] pgmap v1410: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:50.901304+0000 mon.smithi008 (mon.0) 2479 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:50.902493+0000 mon.smithi008 (mon.0) 2480 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:32:50.903385+0000 mgr.smithi008.flmjzp (mgr.14640) 2041 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:50.904116+0000 mgr.smithi008.flmjzp (mgr.14640) 2042 : cluster [DBG] pgmap v1411: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:50.904465+0000 mgr.smithi008.flmjzp (mgr.14640) 2043 : cluster [DBG] pgmap v1412: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:50.909131+0000 mon.smithi008 (mon.0) 2481 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:52.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:50.915571+0000 mon.smithi008 (mon.0) 2482 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:52.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:50.918851+0000 mon.smithi008 (mon.0) 2483 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:52.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:50.920492+0000 mon.smithi008 (mon.0) 2484 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:52.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:50.922073+0000 mon.smithi008 (mon.0) 2485 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:52.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:32:50.924033+0000 mon.smithi008 (mon.0) 2486 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:52.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:32:50.925920+0000 mgr.smithi008.flmjzp (mgr.14640) 2044 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:52.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:50.316062+0000 mgr.smithi008.flmjzp (mgr.14640) 2040 : cluster [DBG] pgmap v1410: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:50.901304+0000 mon.smithi008 (mon.0) 2479 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:32:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:50.902493+0000 mon.smithi008 (mon.0) 2480 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:32:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:32:50.903385+0000 mgr.smithi008.flmjzp (mgr.14640) 2041 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:32:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:50.904116+0000 mgr.smithi008.flmjzp (mgr.14640) 2042 : cluster [DBG] pgmap v1411: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:50.904465+0000 mgr.smithi008.flmjzp (mgr.14640) 2043 : cluster [DBG] pgmap v1412: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:50.909131+0000 mon.smithi008 (mon.0) 2481 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:32:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:50.915571+0000 mon.smithi008 (mon.0) 2482 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:32:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:50.918851+0000 mon.smithi008 (mon.0) 2483 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:50.920492+0000 mon.smithi008 (mon.0) 2484 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:52.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:50.922073+0000 mon.smithi008 (mon.0) 2485 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:52.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:32:50.924033+0000 mon.smithi008 (mon.0) 2486 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:32:52.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:32:50.925920+0000 mgr.smithi008.flmjzp (mgr.14640) 2044 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:32:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:52.905091+0000 mgr.smithi008.flmjzp (mgr.14640) 2045 : cluster [DBG] pgmap v1413: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:53.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:52.905091+0000 mgr.smithi008.flmjzp (mgr.14640) 2045 : cluster [DBG] pgmap v1413: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:54.905891+0000 mgr.smithi008.flmjzp (mgr.14640) 2046 : cluster [DBG] pgmap v1414: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:55.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:54.905891+0000 mgr.smithi008.flmjzp (mgr.14640) 2046 : cluster [DBG] pgmap v1414: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:56.906406+0000 mgr.smithi008.flmjzp (mgr.14640) 2047 : cluster [DBG] pgmap v1415: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:57.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:56.906406+0000 mgr.smithi008.flmjzp (mgr.14640) 2047 : cluster [DBG] pgmap v1415: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:32:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:32:58.906894+0000 mgr.smithi008.flmjzp (mgr.14640) 2048 : cluster [DBG] pgmap v1416: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:32:59.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:32:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:32:58.906894+0000 mgr.smithi008.flmjzp (mgr.14640) 2048 : cluster [DBG] pgmap v1416: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:00.907593+0000 mgr.smithi008.flmjzp (mgr.14640) 2049 : cluster [DBG] pgmap v1417: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:00.928319+0000 mon.smithi008 (mon.0) 2487 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:01.284389+0000 mon.smithi008 (mon.0) 2488 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:01.285498+0000 mon.smithi008 (mon.0) 2489 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:01.286517+0000 mon.smithi008 (mon.0) 2490 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:01.292080+0000 mon.smithi008 (mon.0) 2491 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:01.298311+0000 mon.smithi008 (mon.0) 2492 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:01.301318+0000 mon.smithi008 (mon.0) 2493 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:01.302969+0000 mon.smithi008 (mon.0) 2494 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:01.304556+0000 mon.smithi008 (mon.0) 2495 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:01.306561+0000 mon.smithi008 (mon.0) 2496 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:00.907593+0000 mgr.smithi008.flmjzp (mgr.14640) 2049 : cluster [DBG] pgmap v1417: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:00.928319+0000 mon.smithi008 (mon.0) 2487 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:01.284389+0000 mon.smithi008 (mon.0) 2488 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:01.285498+0000 mon.smithi008 (mon.0) 2489 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:01.286517+0000 mon.smithi008 (mon.0) 2490 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:01.292080+0000 mon.smithi008 (mon.0) 2491 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:01.298311+0000 mon.smithi008 (mon.0) 2492 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:01.301318+0000 mon.smithi008 (mon.0) 2493 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:01.302969+0000 mon.smithi008 (mon.0) 2494 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:01.304556+0000 mon.smithi008 (mon.0) 2495 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:01.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:01.306561+0000 mon.smithi008 (mon.0) 2496 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:01.287352+0000 mgr.smithi008.flmjzp (mgr.14640) 2050 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:01.287948+0000 mgr.smithi008.flmjzp (mgr.14640) 2051 : cluster [DBG] pgmap v1418: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:01.288192+0000 mgr.smithi008.flmjzp (mgr.14640) 2052 : cluster [DBG] pgmap v1419: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:01.308480+0000 mgr.smithi008.flmjzp (mgr.14640) 2053 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:02.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:01.287352+0000 mgr.smithi008.flmjzp (mgr.14640) 2050 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:01.287948+0000 mgr.smithi008.flmjzp (mgr.14640) 2051 : cluster [DBG] pgmap v1418: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:01.288192+0000 mgr.smithi008.flmjzp (mgr.14640) 2052 : cluster [DBG] pgmap v1419: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:01.308480+0000 mgr.smithi008.flmjzp (mgr.14640) 2053 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:04.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.408+0000 7f384b59e700 1 -- 172.21.15.8:0/3269875634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384c0f6530 msgr2=0x7f384c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:04.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.408+0000 7f384b59e700 1 --2- 172.21.15.8:0/3269875634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384c0f6530 0x7f384c0f6950 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f383c004660 tx=0x7f383c009b30).stop 2023-10-18T21:33:04.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.408+0000 7f384b59e700 1 -- 172.21.15.8:0/3269875634 shutdown_connections 2023-10-18T21:33:04.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.408+0000 7f384b59e700 1 --2- 172.21.15.8:0/3269875634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f384c0f77d0 0x7f384c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.408+0000 7f384b59e700 1 --2- 172.21.15.8:0/3269875634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384c0f6530 0x7f384c0f6950 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.408+0000 7f384b59e700 1 -- 172.21.15.8:0/3269875634 >> 172.21.15.8:0/3269875634 conn(0x7f384c0f1c90 msgr2=0x7f384c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:04.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.408+0000 7f384b59e700 1 -- 172.21.15.8:0/3269875634 shutdown_connections 2023-10-18T21:33:04.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.409+0000 7f384b59e700 1 -- 172.21.15.8:0/3269875634 wait complete. 2023-10-18T21:33:04.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.409+0000 7f384b59e700 1 Processor -- start 2023-10-18T21:33:04.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.409+0000 7f384b59e700 1 -- start start 2023-10-18T21:33:04.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.410+0000 7f384b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f384c0f6530 0x7f384c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:04.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.410+0000 7f384b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384c0f77d0 0x7f384c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:04.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.410+0000 7f384b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c06a380 con 0x7f384c0f77d0 2023-10-18T21:33:04.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.410+0000 7f384b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c06a4c0 con 0x7f384c0f6530 2023-10-18T21:33:04.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.410+0000 7f3849d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384c0f77d0 0x7f384c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:04.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.410+0000 7f3849d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384c0f77d0 0x7f384c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53842/0 (socket says 172.21.15.8:53842) 2023-10-18T21:33:04.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.410+0000 7f3849d9b700 1 -- 172.21.15.8:0/1978725729 learned_addr learned my addr 172.21.15.8:0/1978725729 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:04.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.410+0000 7f384a59c700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f384c0f6530 0x7f384c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:04.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.411+0000 7f3849d9b700 1 -- 172.21.15.8:0/1978725729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f384c0f6530 msgr2=0x7f384c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:04.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.411+0000 7f3849d9b700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f384c0f6530 0x7f384c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.411+0000 7f3849d9b700 1 -- 172.21.15.8:0/1978725729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c005040 con 0x7f384c0f77d0 2023-10-18T21:33:04.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.411+0000 7f3849d9b700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384c0f77d0 0x7f384c069e20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f38400026d0 tx=0x7f3840009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:04.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.411+0000 7f383affd700 1 -- 172.21.15.8:0/1978725729 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38400079c0 con 0x7f384c0f77d0 2023-10-18T21:33:04.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.411+0000 7f383affd700 1 -- 172.21.15.8:0/1978725729 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f384000f040 con 0x7f384c0f77d0 2023-10-18T21:33:04.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.411+0000 7f383affd700 1 -- 172.21.15.8:0/1978725729 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3840014980 con 0x7f384c0f77d0 2023-10-18T21:33:04.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.411+0000 7f384b59e700 1 -- 172.21.15.8:0/1978725729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c06a7a0 con 0x7f384c0f77d0 2023-10-18T21:33:04.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.411+0000 7f384b59e700 1 -- 172.21.15.8:0/1978725729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c10ede0 con 0x7f384c0f77d0 2023-10-18T21:33:04.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.412+0000 7f384b59e700 1 -- 172.21.15.8:0/1978725729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c045ad0 con 0x7f384c0f77d0 2023-10-18T21:33:04.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.413+0000 7f383affd700 1 -- 172.21.15.8:0/1978725729 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f38400090d0 con 0x7f384c0f77d0 2023-10-18T21:33:04.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.415+0000 7f383affd700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3834060f70 0x7f3834063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:04.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.415+0000 7f383affd700 1 -- 172.21.15.8:0/1978725729 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f384007c8a0 con 0x7f384c0f77d0 2023-10-18T21:33:04.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.415+0000 7f384a59c700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3834060f70 0x7f3834063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:04.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.415+0000 7f384a59c700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3834060f70 0x7f3834063430 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f384c06b730 tx=0x7f383c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:04.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.419+0000 7f383affd700 1 -- 172.21.15.8:0/1978725729 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f384004c580 con 0x7f384c0f77d0 2023-10-18T21:33:04.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.621+0000 7f384b59e700 1 -- 172.21.15.8:0/1978725729 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f384c0fedd0 con 0x7f3834060f70 2023-10-18T21:33:04.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.622+0000 7f383affd700 1 -- 172.21.15.8:0/1978725729 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f384c0fedd0 con 0x7f3834060f70 2023-10-18T21:33:04.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.624+0000 7f384b59e700 1 -- 172.21.15.8:0/1978725729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3834060f70 msgr2=0x7f3834063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:04.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.624+0000 7f384b59e700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3834060f70 0x7f3834063430 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f384c06b730 tx=0x7f383c009b30).stop 2023-10-18T21:33:04.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.624+0000 7f384b59e700 1 -- 172.21.15.8:0/1978725729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384c0f77d0 msgr2=0x7f384c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:04.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.624+0000 7f384b59e700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384c0f77d0 0x7f384c069e20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f38400026d0 tx=0x7f3840009de0).stop 2023-10-18T21:33:04.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.624+0000 7f384b59e700 1 -- 172.21.15.8:0/1978725729 shutdown_connections 2023-10-18T21:33:04.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.624+0000 7f384b59e700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3834060f70 0x7f3834063430 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.624+0000 7f384b59e700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f384c0f6530 0x7f384c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.624+0000 7f384b59e700 1 --2- 172.21.15.8:0/1978725729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384c0f77d0 0x7f384c069e20 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.624+0000 7f384b59e700 1 -- 172.21.15.8:0/1978725729 >> 172.21.15.8:0/1978725729 conn(0x7f384c0f1c90 msgr2=0x7f384c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:04.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.625+0000 7f384b59e700 1 -- 172.21.15.8:0/1978725729 shutdown_connections 2023-10-18T21:33:04.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.625+0000 7f384b59e700 1 -- 172.21.15.8:0/1978725729 wait complete. 2023-10-18T21:33:04.640 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:33:04.669 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:03.288899+0000 mgr.smithi008.flmjzp (mgr.14640) 2054 : cluster [DBG] pgmap v1420: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:04.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:03.288899+0000 mgr.smithi008.flmjzp (mgr.14640) 2054 : cluster [DBG] pgmap v1420: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.765+0000 7faad7fff700 1 -- 172.21.15.8:0/3910986202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad80f9710 msgr2=0x7faad80fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.765+0000 7faad7fff700 1 --2- 172.21.15.8:0/3910986202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad80f9710 0x7faad80fbb00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7faacc004660 tx=0x7faacc009b30).stop 2023-10-18T21:33:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.765+0000 7faad7fff700 1 -- 172.21.15.8:0/3910986202 shutdown_connections 2023-10-18T21:33:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.765+0000 7faad7fff700 1 --2- 172.21.15.8:0/3910986202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad80f9710 0x7faad80fbb00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.765+0000 7faad7fff700 1 --2- 172.21.15.8:0/3910986202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faad8060290 0x7faad80f9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:33:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.765+0000 7faad7fff700 1 -- 172.21.15.8:0/3910986202 >> 172.21.15.8:0/3910986202 conn(0x7faad80f0b90 msgr2=0x7faad80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.765+0000 7faad7fff700 1 -- 172.21.15.8:0/3910986202 shutdown_connections 2023-10-18T21:33:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.766+0000 7faad7fff700 1 -- 172.21.15.8:0/3910986202 wait complete. 2023-10-18T21:33:04.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.766+0000 7faad7fff700 1 Processor -- start 2023-10-18T21:33:04.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.766+0000 7faad7fff700 1 -- start start 2023-10-18T21:33:04.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.767+0000 7faad7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8060290 0x7faad8106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:04.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.767+0000 7faad7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faad80f9710 0x7faad81072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:04.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.767+0000 7faad7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad8107980 con 0x7faad8060290 2023-10-18T21:33:04.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.767+0000 7faad7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad8108100 con 0x7faad80f9710 2023-10-18T21:33:04.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.767+0000 7faad6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8060290 0x7faad8106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:04.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.767+0000 7faad6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8060290 0x7faad8106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53858/0 (socket says 172.21.15.8:53858) 2023-10-18T21:33:04.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.767+0000 7faad6ffd700 1 -- 172.21.15.8:0/2663133161 learned_addr learned my addr 172.21.15.8:0/2663133161 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:04.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.767+0000 7faad67fc700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faad80f9710 0x7faad81072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:04.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.768+0000 7faad6ffd700 1 -- 172.21.15.8:0/2663133161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faad80f9710 msgr2=0x7faad81072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:04.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.768+0000 7faad6ffd700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faad80f9710 0x7faad81072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.768+0000 7faad6ffd700 1 -- 172.21.15.8:0/2663133161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc005040 con 0x7faad8060290 2023-10-18T21:33:04.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.768+0000 7faad6ffd700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8060290 0x7faad8106e00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7faac800b410 tx=0x7faac8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:04.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.768+0000 7faabf7fe700 1 -- 172.21.15.8:0/2663133161 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faac80125f0 con 0x7faad8060290 2023-10-18T21:33:04.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.768+0000 7faabf7fe700 1 -- 172.21.15.8:0/2663133161 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faac800be30 con 0x7faad8060290 2023-10-18T21:33:04.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.768+0000 7faad7fff700 1 -- 172.21.15.8:0/2663133161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad8108380 con 0x7faad8060290 2023-10-18T21:33:04.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.768+0000 7faabf7fe700 1 -- 172.21.15.8:0/2663133161 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faac8002a60 con 0x7faad8060290 2023-10-18T21:33:04.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.768+0000 7faad7fff700 1 -- 172.21.15.8:0/2663133161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad8108940 con 0x7faad8060290 2023-10-18T21:33:04.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.769+0000 7faad7fff700 1 -- 172.21.15.8:0/2663133161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad8045ad0 con 0x7faad8060290 2023-10-18T21:33:04.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.770+0000 7faabf7fe700 1 -- 172.21.15.8:0/2663133161 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faac800f030 con 0x7faad8060290 2023-10-18T21:33:04.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.771+0000 7faabf7fe700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faac0060f70 0x7faac0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:04.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.771+0000 7faabf7fe700 1 -- 172.21.15.8:0/2663133161 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faac807cd30 con 0x7faad8060290 2023-10-18T21:33:04.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.771+0000 7faad67fc700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faac0060f70 0x7faac0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:04.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.772+0000 7faad67fc700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faac0060f70 0x7faac0063430 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7faacc009f50 tx=0x7faacc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:04.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.775+0000 7faabf7fe700 1 -- 172.21.15.8:0/2663133161 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faac804c960 con 0x7faad8060290 2023-10-18T21:33:04.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.973+0000 7faad7fff700 1 -- 172.21.15.8:0/2663133161 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faad80feeb0 con 0x7faac0060f70 2023-10-18T21:33:04.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.975+0000 7faabf7fe700 1 -- 172.21.15.8:0/2663133161 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faad80feeb0 con 0x7faac0060f70 2023-10-18T21:33:04.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.976+0000 7faad7fff700 1 -- 172.21.15.8:0/2663133161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faac0060f70 msgr2=0x7faac0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:04.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.976+0000 7faad7fff700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faac0060f70 0x7faac0063430 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7faacc009f50 tx=0x7faacc009b30).stop 2023-10-18T21:33:04.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.976+0000 7faad7fff700 1 -- 172.21.15.8:0/2663133161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8060290 msgr2=0x7faad8106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:04.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.976+0000 7faad7fff700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8060290 0x7faad8106e00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7faac800b410 tx=0x7faac8006ef0).stop 2023-10-18T21:33:04.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.977+0000 7faad7fff700 1 -- 172.21.15.8:0/2663133161 shutdown_connections 2023-10-18T21:33:04.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.977+0000 7faad7fff700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faac0060f70 0x7faac0063430 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.977+0000 7faad7fff700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8060290 0x7faad8106e00 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.977+0000 7faad7fff700 1 --2- 172.21.15.8:0/2663133161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faad80f9710 0x7faad81072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:04.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.977+0000 7faad7fff700 1 -- 172.21.15.8:0/2663133161 >> 172.21.15.8:0/2663133161 conn(0x7faad80f0b90 msgr2=0x7faad80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:04.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.977+0000 7faad7fff700 1 -- 172.21.15.8:0/2663133161 shutdown_connections 2023-10-18T21:33:04.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:04.977+0000 7faad7fff700 1 -- 172.21.15.8:0/2663133161 wait complete. 2023-10-18T21:33:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.114+0000 7f95e881f700 1 -- 172.21.15.8:0/3546465719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95e40f6530 msgr2=0x7f95e40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.114+0000 7f95e881f700 1 --2- 172.21.15.8:0/3546465719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95e40f6530 0x7f95e40f6950 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f95d4004660 tx=0x7f95d4009b30).stop 2023-10-18T21:33:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.114+0000 7f95e881f700 1 -- 172.21.15.8:0/3546465719 shutdown_connections 2023-10-18T21:33:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.114+0000 7f95e881f700 1 --2- 172.21.15.8:0/3546465719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40f77d0 0x7f95e40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.114+0000 7f95e881f700 1 --2- 172.21.15.8:0/3546465719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95e40f6530 0x7f95e40f6950 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.114+0000 7f95e881f700 1 -- 172.21.15.8:0/3546465719 >> 172.21.15.8:0/3546465719 conn(0x7f95e40f1c90 msgr2=0x7f95e40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.114+0000 7f95e881f700 1 -- 172.21.15.8:0/3546465719 shutdown_connections 2023-10-18T21:33:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.114+0000 7f95e881f700 1 -- 172.21.15.8:0/3546465719 wait complete. 2023-10-18T21:33:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.115+0000 7f95e881f700 1 Processor -- start 2023-10-18T21:33:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.115+0000 7f95e881f700 1 -- start start 2023-10-18T21:33:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e881f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95e40f6530 0x7f95e406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e881f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40f77d0 0x7f95e4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e881f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e406a380 con 0x7f95e40f6530 2023-10-18T21:33:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e881f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e406a4c0 con 0x7f95e40f77d0 2023-10-18T21:33:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95e40f6530 0x7f95e406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95e40f6530 0x7f95e406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53878/0 (socket says 172.21.15.8:53878) 2023-10-18T21:33:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e37fe700 1 -- 172.21.15.8:0/4181100473 learned_addr learned my addr 172.21.15.8:0/4181100473 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e2ffd700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40f77d0 0x7f95e4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e37fe700 1 -- 172.21.15.8:0/4181100473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40f77d0 msgr2=0x7f95e4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e37fe700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40f77d0 0x7f95e4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e37fe700 1 -- 172.21.15.8:0/4181100473 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d4005040 con 0x7f95e40f6530 2023-10-18T21:33:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.116+0000 7f95e37fe700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95e40f6530 0x7f95e406b9a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f95d4009870 tx=0x7f95d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.117+0000 7f95cbfff700 1 -- 172.21.15.8:0/4181100473 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95d4019070 con 0x7f95e40f6530 2023-10-18T21:33:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.117+0000 7f95cbfff700 1 -- 172.21.15.8:0/4181100473 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f95d4013380 con 0x7f95e40f6530 2023-10-18T21:33:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.117+0000 7f95e881f700 1 -- 172.21.15.8:0/4181100473 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e406a740 con 0x7f95e40f6530 2023-10-18T21:33:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.117+0000 7f95cbfff700 1 -- 172.21.15.8:0/4181100473 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95d401edf0 con 0x7f95e40f6530 2023-10-18T21:33:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.117+0000 7f95e881f700 1 -- 172.21.15.8:0/4181100473 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e406ac20 con 0x7f95e40f6530 2023-10-18T21:33:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.118+0000 7f95e881f700 1 -- 172.21.15.8:0/4181100473 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e4045ad0 con 0x7f95e40f6530 2023-10-18T21:33:05.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.119+0000 7f95cbfff700 1 -- 172.21.15.8:0/4181100473 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f95d401e420 con 0x7f95e40f6530 2023-10-18T21:33:05.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.120+0000 7f95cbfff700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95cc060f70 0x7f95cc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:05.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.120+0000 7f95cbfff700 1 -- 172.21.15.8:0/4181100473 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f95d407dd00 con 0x7f95e40f6530 2023-10-18T21:33:05.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.120+0000 7f95e2ffd700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95cc060f70 0x7f95cc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:05.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.120+0000 7f95e2ffd700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95cc060f70 0x7f95cc063430 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f95d8009fd0 tx=0x7f95d800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:05.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.124+0000 7f95cbfff700 1 -- 172.21.15.8:0/4181100473 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f95d404d930 con 0x7f95e40f6530 2023-10-18T21:33:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.320+0000 7f95e881f700 1 -- 172.21.15.8:0/4181100473 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f95e4057f10 con 0x7f95cc060f70 2023-10-18T21:33:05.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.330+0000 7f95cbfff700 1 -- 172.21.15.8:0/4181100473 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f95e4057f10 con 0x7f95cc060f70 2023-10-18T21:33:05.331 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:33:05.332 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (39m) 7m ago 41m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:33:05.332 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (33m) 7m ago 41m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:33:05.333 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (33m) 5m ago 40m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:33:05.333 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (39m) 7m ago 40m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:33:05.333 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 37m - - 2023-10-18T21:33:05.334 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 37m - - 2023-10-18T21:33:05.334 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 37m - - 2023-10-18T21:33:05.334 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 37m - - 2023-10-18T21:33:05.335 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (34m) 7m ago 42m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:33:05.335 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (34m) 5m ago 40m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:33:05.335 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (34m) 7m ago 42m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:33:05.337 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (33m) 5m ago 40m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:33:05.337 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (40m) 7m ago 40m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:33:05.338 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (40m) 5m ago 40m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:33:05.338 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (33m) 7m ago 39m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:33:05.338 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (31m) 7m ago 39m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:33:05.339 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (30m) 7m ago 39m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:33:05.339 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (30m) 5m ago 38m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:33:05.339 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (29m) 5m ago 38m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:33:05.339 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (29m) 5m ago 38m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:33:05.339 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (35m) 7m ago 40m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:33:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.331+0000 7f95e881f700 1 -- 172.21.15.8:0/4181100473 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95cc060f70 msgr2=0x7f95cc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:05.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.331+0000 7f95e881f700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95cc060f70 0x7f95cc063430 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f95d8009fd0 tx=0x7f95d800b040).stop 2023-10-18T21:33:05.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.332+0000 7f95e881f700 1 -- 172.21.15.8:0/4181100473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95e40f6530 msgr2=0x7f95e406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:05.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.332+0000 7f95e881f700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95e40f6530 0x7f95e406b9a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f95d4009870 tx=0x7f95d400b040).stop 2023-10-18T21:33:05.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.332+0000 7f95e881f700 1 -- 172.21.15.8:0/4181100473 shutdown_connections 2023-10-18T21:33:05.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.332+0000 7f95e881f700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95cc060f70 0x7f95cc063430 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.332+0000 7f95e881f700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95e40f6530 0x7f95e406b9a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.332+0000 7f95e881f700 1 --2- 172.21.15.8:0/4181100473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40f77d0 0x7f95e4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.332+0000 7f95e881f700 1 -- 172.21.15.8:0/4181100473 >> 172.21.15.8:0/4181100473 conn(0x7f95e40f1c90 msgr2=0x7f95e40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:05.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.332+0000 7f95e881f700 1 -- 172.21.15.8:0/4181100473 shutdown_connections 2023-10-18T21:33:05.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.332+0000 7f95e881f700 1 -- 172.21.15.8:0/4181100473 wait complete. 2023-10-18T21:33:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.468+0000 7fa3720a4700 1 -- 172.21.15.8:0/866537765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa36c0f6530 msgr2=0x7fa36c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.468+0000 7fa3720a4700 1 --2- 172.21.15.8:0/866537765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa36c0f6530 0x7fa36c0f6950 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fa368004660 tx=0x7fa368009b30).stop 2023-10-18T21:33:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.468+0000 7fa3720a4700 1 -- 172.21.15.8:0/866537765 shutdown_connections 2023-10-18T21:33:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.468+0000 7fa3720a4700 1 --2- 172.21.15.8:0/866537765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa36c0f77d0 0x7fa36c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.468+0000 7fa3720a4700 1 --2- 172.21.15.8:0/866537765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa36c0f6530 0x7fa36c0f6950 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.468+0000 7fa3720a4700 1 -- 172.21.15.8:0/866537765 >> 172.21.15.8:0/866537765 conn(0x7fa36c0f1c90 msgr2=0x7fa36c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:05.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.468+0000 7fa3720a4700 1 -- 172.21.15.8:0/866537765 shutdown_connections 2023-10-18T21:33:05.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.468+0000 7fa3720a4700 1 -- 172.21.15.8:0/866537765 wait complete. 2023-10-18T21:33:05.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.469+0000 7fa3720a4700 1 Processor -- start 2023-10-18T21:33:05.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.469+0000 7fa3720a4700 1 -- start start 2023-10-18T21:33:05.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3720a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa36c0f6530 0x7fa36c108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:05.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3720a4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa36c0f77d0 0x7fa36c109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3720a4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c109a00 con 0x7fa36c0f77d0 2023-10-18T21:33:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3720a4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c109b40 con 0x7fa36c0f6530 2023-10-18T21:33:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3708a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa36c0f77d0 0x7fa36c109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3708a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa36c0f77d0 0x7fa36c109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53902/0 (socket says 172.21.15.8:53902) 2023-10-18T21:33:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3708a1700 1 -- 172.21.15.8:0/1300899090 learned_addr learned my addr 172.21.15.8:0/1300899090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3710a2700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa36c0f6530 0x7fa36c108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3708a1700 1 -- 172.21.15.8:0/1300899090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa36c0f6530 msgr2=0x7fa36c108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3708a1700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa36c0f6530 0x7fa36c108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.470+0000 7fa3708a1700 1 -- 172.21.15.8:0/1300899090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa368005040 con 0x7fa36c0f77d0 2023-10-18T21:33:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.471+0000 7fa3708a1700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa36c0f77d0 0x7fa36c109450 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fa35c00e7f0 tx=0x7fa35c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.471+0000 7fa361ffb700 1 -- 172.21.15.8:0/1300899090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c0092e0 con 0x7fa36c0f77d0 2023-10-18T21:33:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.471+0000 7fa361ffb700 1 -- 172.21.15.8:0/1300899090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa35c00f040 con 0x7fa36c0f77d0 2023-10-18T21:33:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.471+0000 7fa3720a4700 1 -- 172.21.15.8:0/1300899090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c10a4e0 con 0x7fa36c0f77d0 2023-10-18T21:33:05.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.471+0000 7fa361ffb700 1 -- 172.21.15.8:0/1300899090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c0147e0 con 0x7fa36c0f77d0 2023-10-18T21:33:05.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.471+0000 7fa3720a4700 1 -- 172.21.15.8:0/1300899090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c10aa20 con 0x7fa36c0f77d0 2023-10-18T21:33:05.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.472+0000 7fa3720a4700 1 -- 172.21.15.8:0/1300899090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c045ad0 con 0x7fa36c0f77d0 2023-10-18T21:33:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.473+0000 7fa361ffb700 1 -- 172.21.15.8:0/1300899090 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa35c01b030 con 0x7fa36c0f77d0 2023-10-18T21:33:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.474+0000 7fa361ffb700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa358060f70 0x7fa358063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.474+0000 7fa361ffb700 1 -- 172.21.15.8:0/1300899090 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa35c07c7c0 con 0x7fa36c0f77d0 2023-10-18T21:33:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.474+0000 7fa3710a2700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa358060f70 0x7fa358063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.475+0000 7fa3710a2700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa358060f70 0x7fa358063430 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fa368009720 tx=0x7fa368016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.478+0000 7fa361ffb700 1 -- 172.21.15.8:0/1300899090 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa35c04fe50 con 0x7fa36c0f77d0 2023-10-18T21:33:05.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.730+0000 7fa3720a4700 1 -- 172.21.15.8:0/1300899090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa36c027a00 con 0x7fa36c0f77d0 2023-10-18T21:33:05.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.730+0000 7fa361ffb700 1 -- 172.21.15.8:0/1300899090 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fa35c019020 con 0x7fa36c0f77d0 2023-10-18T21:33:05.731 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:33:05.732 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:33:05.732 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:33:05.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:33:05.732 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:33:05.733 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:33:05.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:33:05.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:33:05.733 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:33:05.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:33:05.734 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:33:05.734 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:33:05.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:33:05.734 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:33:05.734 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:33:05.735 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:33:05.735 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:33:05.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 -- 172.21.15.8:0/1300899090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa358060f70 msgr2=0x7fa358063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:05.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa358060f70 0x7fa358063430 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fa368009720 tx=0x7fa368016040).stop 2023-10-18T21:33:05.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 -- 172.21.15.8:0/1300899090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa36c0f77d0 msgr2=0x7fa36c109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:05.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa36c0f77d0 0x7fa36c109450 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fa35c00e7f0 tx=0x7fa35c00b040).stop 2023-10-18T21:33:05.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 -- 172.21.15.8:0/1300899090 shutdown_connections 2023-10-18T21:33:05.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa358060f70 0x7fa358063430 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa36c0f6530 0x7fa36c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 --2- 172.21.15.8:0/1300899090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa36c0f77d0 0x7fa36c109450 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 -- 172.21.15.8:0/1300899090 >> 172.21.15.8:0/1300899090 conn(0x7fa36c0f1c90 msgr2=0x7fa36c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:05.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 -- 172.21.15.8:0/1300899090 shutdown_connections 2023-10-18T21:33:05.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.732+0000 7fa3720a4700 1 -- 172.21.15.8:0/1300899090 wait complete. 2023-10-18T21:33:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:04.622716+0000 mgr.smithi008.flmjzp (mgr.14640) 2055 : audit [DBG] from='client.35800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:05.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.869+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3441511455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d00f77d0 msgr2=0x7fd1d00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:05.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.869+0000 7fd1cf59e700 1 --2- 172.21.15.8:0/3441511455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d00f77d0 0x7fd1d00f7c30 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fd1c40045a0 tx=0x7fd1c4009b30).stop 2023-10-18T21:33:05.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.869+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3441511455 shutdown_connections 2023-10-18T21:33:05.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.869+0000 7fd1cf59e700 1 --2- 172.21.15.8:0/3441511455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d00f77d0 0x7fd1d00f7c30 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.869+0000 7fd1cf59e700 1 --2- 172.21.15.8:0/3441511455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d00f6530 0x7fd1d00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.869+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3441511455 >> 172.21.15.8:0/3441511455 conn(0x7fd1d00f1c90 msgr2=0x7fd1d00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:05.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.869+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3441511455 shutdown_connections 2023-10-18T21:33:05.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.869+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3441511455 wait complete. 2023-10-18T21:33:05.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.870+0000 7fd1cf59e700 1 Processor -- start 2023-10-18T21:33:05.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.870+0000 7fd1cf59e700 1 -- start start 2023-10-18T21:33:05.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1cf59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d00f6530 0x7fd1d0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:05.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1cf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d00f77d0 0x7fd1d0107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:05.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1cf59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0107850 con 0x7fd1d00f6530 2023-10-18T21:33:05.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1cf59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0108060 con 0x7fd1d00f77d0 2023-10-18T21:33:05.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1ce59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d00f6530 0x7fd1d0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:05.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1ce59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d00f6530 0x7fd1d0106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53924/0 (socket says 172.21.15.8:53924) 2023-10-18T21:33:05.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1ce59c700 1 -- 172.21.15.8:0/3133377851 learned_addr learned my addr 172.21.15.8:0/3133377851 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:05.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1cdd9b700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d00f77d0 0x7fd1d0107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:05.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1ce59c700 1 -- 172.21.15.8:0/3133377851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d00f77d0 msgr2=0x7fd1d0107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:05.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1ce59c700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d00f77d0 0x7fd1d0107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:05.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.871+0000 7fd1ce59c700 1 -- 172.21.15.8:0/3133377851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c4005040 con 0x7fd1d00f6530 2023-10-18T21:33:05.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.872+0000 7fd1cdd9b700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d00f77d0 0x7fd1d0107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:33:05.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.872+0000 7fd1ce59c700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d00f6530 0x7fd1d0106d60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fd1c00041d0 tx=0x7fd1c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:05.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.872+0000 7fd1beffd700 1 -- 172.21.15.8:0/3133377851 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c00092e0 con 0x7fd1d00f6530 2023-10-18T21:33:05.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.872+0000 7fd1beffd700 1 -- 172.21.15.8:0/3133377851 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd1c000f040 con 0x7fd1d00f6530 2023-10-18T21:33:05.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.872+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3133377851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d01082e0 con 0x7fd1d00f6530 2023-10-18T21:33:05.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.872+0000 7fd1beffd700 1 -- 172.21.15.8:0/3133377851 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c0014920 con 0x7fd1d00f6530 2023-10-18T21:33:05.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.872+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3133377851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d0108820 con 0x7fd1d00f6530 2023-10-18T21:33:05.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.873+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3133377851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d0059100 con 0x7fd1d00f6530 2023-10-18T21:33:05.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.874+0000 7fd1beffd700 1 -- 172.21.15.8:0/3133377851 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd1c001b030 con 0x7fd1d00f6530 2023-10-18T21:33:05.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.875+0000 7fd1beffd700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1b8060f70 0x7fd1b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:05.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.875+0000 7fd1beffd700 1 -- 172.21.15.8:0/3133377851 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd1c007c9b0 con 0x7fd1d00f6530 2023-10-18T21:33:05.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.875+0000 7fd1cdd9b700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1b8060f70 0x7fd1b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:05.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.876+0000 7fd1cdd9b700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1b8060f70 0x7fd1b8063430 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fd1c4000c00 tx=0x7fd1c400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:05.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:05.879+0000 7fd1beffd700 1 -- 172.21.15.8:0/3133377851 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd1c004c560 con 0x7fd1d00f6530 2023-10-18T21:33:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:04.622716+0000 mgr.smithi008.flmjzp (mgr.14640) 2055 : audit [DBG] from='client.35800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:06.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.104+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3133377851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd1d00fedb0 con 0x7fd1d00f6530 2023-10-18T21:33:06.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.104+0000 7fd1beffd700 1 -- 172.21.15.8:0/3133377851 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fd1c004fb80 con 0x7fd1d00f6530 2023-10-18T21:33:06.109 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:33:06.110 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:33:06.110 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:33:06.110 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:33:06.111 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:33:06.111 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:33:06.111 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:33:06.111 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:33:06.112 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:33:06.112 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:33:06.112 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:33:06.112 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:33:06.112 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:33:06.113 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:33:06.113 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:33:06.113 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:33:06.113 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:33:06.113 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:33:06.114 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:33:06.114 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:33:06.114 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:33:06.114 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:33:06.115 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:33:06.115 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:33:06.115 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:33:06.115 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:33:06.115 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:33:06.116 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:33:06.116 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:33:06.116 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:33:06.116 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:33:06.117 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:33:06.117 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:33:06.117 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:33:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.106+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3133377851 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1b8060f70 msgr2=0x7fd1b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:06.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.106+0000 7fd1cf59e700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1b8060f70 0x7fd1b8063430 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fd1c4000c00 tx=0x7fd1c400b040).stop 2023-10-18T21:33:06.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.106+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3133377851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d00f6530 msgr2=0x7fd1d0106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:06.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.106+0000 7fd1cf59e700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d00f6530 0x7fd1d0106d60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fd1c00041d0 tx=0x7fd1c000b040).stop 2023-10-18T21:33:06.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.106+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3133377851 shutdown_connections 2023-10-18T21:33:06.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.106+0000 7fd1cf59e700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1b8060f70 0x7fd1b8063430 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:06.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.106+0000 7fd1cf59e700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1d00f6530 0x7fd1d0106d60 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:06.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.106+0000 7fd1cf59e700 1 --2- 172.21.15.8:0/3133377851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1d00f77d0 0x7fd1d0107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:06.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.106+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3133377851 >> 172.21.15.8:0/3133377851 conn(0x7fd1d00f1c90 msgr2=0x7fd1d00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:06.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.107+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3133377851 shutdown_connections 2023-10-18T21:33:06.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.107+0000 7fd1cf59e700 1 -- 172.21.15.8:0/3133377851 wait complete. 2023-10-18T21:33:06.121 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:33:06.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.244+0000 7f0c81588700 1 -- 172.21.15.8:0/1757404725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c7c0f6530 msgr2=0x7f0c7c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:06.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.244+0000 7f0c81588700 1 --2- 172.21.15.8:0/1757404725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c7c0f6530 0x7f0c7c0f6950 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f0c6c004660 tx=0x7f0c6c009b30).stop 2023-10-18T21:33:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.244+0000 7f0c81588700 1 -- 172.21.15.8:0/1757404725 shutdown_connections 2023-10-18T21:33:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.244+0000 7f0c81588700 1 --2- 172.21.15.8:0/1757404725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c0f77d0 0x7f0c7c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.244+0000 7f0c81588700 1 --2- 172.21.15.8:0/1757404725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c7c0f6530 0x7f0c7c0f6950 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.244+0000 7f0c81588700 1 -- 172.21.15.8:0/1757404725 >> 172.21.15.8:0/1757404725 conn(0x7f0c7c0f1c90 msgr2=0x7f0c7c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.244+0000 7f0c81588700 1 -- 172.21.15.8:0/1757404725 shutdown_connections 2023-10-18T21:33:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.244+0000 7f0c81588700 1 -- 172.21.15.8:0/1757404725 wait complete. 2023-10-18T21:33:06.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.245+0000 7f0c81588700 1 Processor -- start 2023-10-18T21:33:06.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.245+0000 7f0c81588700 1 -- start start 2023-10-18T21:33:06.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c81588700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c0f6530 0x7f0c7c106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:06.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c81588700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c7c0f77d0 0x7f0c7c107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:06.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c81588700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c107910 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c81588700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c108120 con 0x7f0c7c0f6530 2023-10-18T21:33:06.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c7b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c7c0f77d0 0x7f0c7c107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:06.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c7b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c7c0f77d0 0x7f0c7c107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53946/0 (socket says 172.21.15.8:53946) 2023-10-18T21:33:06.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c7b7fe700 1 -- 172.21.15.8:0/3565361599 learned_addr learned my addr 172.21.15.8:0/3565361599 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:06.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c7bfff700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c0f6530 0x7f0c7c106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c7b7fe700 1 -- 172.21.15.8:0/3565361599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c0f6530 msgr2=0x7f0c7c106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c7b7fe700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c0f6530 0x7f0c7c106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c7b7fe700 1 -- 172.21.15.8:0/3565361599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c005040 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.246+0000 7f0c7b7fe700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c7c0f77d0 0x7f0c7c107310 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f0c700026d0 tx=0x7f0c70009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.247+0000 7f0c78ff9700 1 -- 172.21.15.8:0/3565361599 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c700079c0 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.247+0000 7f0c78ff9700 1 -- 172.21.15.8:0/3565361599 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0c7000f040 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.247+0000 7f0c81588700 1 -- 172.21.15.8:0/3565361599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c1083a0 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.247+0000 7f0c78ff9700 1 -- 172.21.15.8:0/3565361599 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c70014980 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.247+0000 7f0c81588700 1 -- 172.21.15.8:0/3565361599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c108960 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.248+0000 7f0c81588700 1 -- 172.21.15.8:0/3565361599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7c059100 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.249+0000 7f0c78ff9700 1 -- 172.21.15.8:0/3565361599 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0c700090d0 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.250+0000 7f0c78ff9700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c64060f70 0x7f0c64063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:06.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.250+0000 7f0c78ff9700 1 -- 172.21.15.8:0/3565361599 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0c7007c8a0 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.250+0000 7f0c7bfff700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c64060f70 0x7f0c64063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:06.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.251+0000 7f0c7bfff700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c64060f70 0x7f0c64063430 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f0c7c106b90 tx=0x7f0c6c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:06.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.254+0000 7f0c78ff9700 1 -- 172.21.15.8:0/3565361599 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0c7004c580 con 0x7f0c7c0f77d0 2023-10-18T21:33:06.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.454+0000 7f0c81588700 1 -- 172.21.15.8:0/3565361599 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c7c0fee50 con 0x7f0c64060f70 2023-10-18T21:33:06.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.455+0000 7f0c78ff9700 1 -- 172.21.15.8:0/3565361599 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0c7c0fee50 con 0x7f0c64060f70 2023-10-18T21:33:06.456 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:33:06.457 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:33:06.457 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:33:06.457 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:33:06.457 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:33:06.458 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:33:06.458 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:33:06.458 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:33:06.458 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:33:06.458 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:33:06.459 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:33:06.459 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:33:06.459 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:33:06.459 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:33:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.457+0000 7f0c81588700 1 -- 172.21.15.8:0/3565361599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c64060f70 msgr2=0x7f0c64063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.457+0000 7f0c81588700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c64060f70 0x7f0c64063430 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f0c7c106b90 tx=0x7f0c6c009b30).stop 2023-10-18T21:33:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.457+0000 7f0c81588700 1 -- 172.21.15.8:0/3565361599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c7c0f77d0 msgr2=0x7f0c7c107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:06.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.457+0000 7f0c81588700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c7c0f77d0 0x7f0c7c107310 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f0c700026d0 tx=0x7f0c70009de0).stop 2023-10-18T21:33:06.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.458+0000 7f0c81588700 1 -- 172.21.15.8:0/3565361599 shutdown_connections 2023-10-18T21:33:06.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.458+0000 7f0c81588700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c64060f70 0x7f0c64063430 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:06.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.458+0000 7f0c81588700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c0f6530 0x7f0c7c106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:06.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.458+0000 7f0c81588700 1 --2- 172.21.15.8:0/3565361599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c7c0f77d0 0x7f0c7c107310 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:06.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.458+0000 7f0c81588700 1 -- 172.21.15.8:0/3565361599 >> 172.21.15.8:0/3565361599 conn(0x7f0c7c0f1c90 msgr2=0x7f0c7c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:06.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.458+0000 7f0c81588700 1 -- 172.21.15.8:0/3565361599 shutdown_connections 2023-10-18T21:33:06.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:06.458+0000 7f0c81588700 1 -- 172.21.15.8:0/3565361599 wait complete. 2023-10-18T21:33:06.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:04.975046+0000 mgr.smithi008.flmjzp (mgr.14640) 2056 : audit [DBG] from='client.35804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:05.289364+0000 mgr.smithi008.flmjzp (mgr.14640) 2057 : cluster [DBG] pgmap v1421: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:05.321670+0000 mgr.smithi008.flmjzp (mgr.14640) 2058 : audit [DBG] from='client.35808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:05.730782+0000 mon.smithi008 (mon.0) 2497 : audit [DBG] from='client.? 172.21.15.8:0/1300899090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:06.104931+0000 mon.smithi008 (mon.0) 2498 : audit [DBG] from='client.? 172.21.15.8:0/3133377851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:33:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:04.975046+0000 mgr.smithi008.flmjzp (mgr.14640) 2056 : audit [DBG] from='client.35804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:05.289364+0000 mgr.smithi008.flmjzp (mgr.14640) 2057 : cluster [DBG] pgmap v1421: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:05.321670+0000 mgr.smithi008.flmjzp (mgr.14640) 2058 : audit [DBG] from='client.35808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:05.730782+0000 mon.smithi008 (mon.0) 2497 : audit [DBG] from='client.? 172.21.15.8:0/1300899090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:06.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:06.104931+0000 mon.smithi008 (mon.0) 2498 : audit [DBG] from='client.? 172.21.15.8:0/3133377851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:33:07.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:06.455889+0000 mgr.smithi008.flmjzp (mgr.14640) 2059 : audit [DBG] from='client.35820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:06.455889+0000 mgr.smithi008.flmjzp (mgr.14640) 2059 : audit [DBG] from='client.35820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:07.289933+0000 mgr.smithi008.flmjzp (mgr.14640) 2060 : cluster [DBG] pgmap v1422: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:08.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:07.289933+0000 mgr.smithi008.flmjzp (mgr.14640) 2060 : cluster [DBG] pgmap v1422: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:09.290497+0000 mgr.smithi008.flmjzp (mgr.14640) 2061 : cluster [DBG] pgmap v1423: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:09.290497+0000 mgr.smithi008.flmjzp (mgr.14640) 2061 : cluster [DBG] pgmap v1423: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:11.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:11.319216+0000 mon.smithi008 (mon.0) 2499 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:11.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:11.321404+0000 mon.smithi008 (mon.0) 2500 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:11.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:11.322424+0000 mon.smithi008 (mon.0) 2501 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:11.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:11.329478+0000 mon.smithi008 (mon.0) 2502 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:11.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:11.336106+0000 mon.smithi008 (mon.0) 2503 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:11.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:11.339189+0000 mon.smithi008 (mon.0) 2504 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:11.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:11.340867+0000 mon.smithi008 (mon.0) 2505 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:11.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:11.342652+0000 mon.smithi008 (mon.0) 2506 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:11.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:11.344653+0000 mon.smithi008 (mon.0) 2507 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:11.319216+0000 mon.smithi008 (mon.0) 2499 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:11.321404+0000 mon.smithi008 (mon.0) 2500 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:11.322424+0000 mon.smithi008 (mon.0) 2501 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:11.329478+0000 mon.smithi008 (mon.0) 2502 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:11.336106+0000 mon.smithi008 (mon.0) 2503 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:11.339189+0000 mon.smithi008 (mon.0) 2504 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:11.340867+0000 mon.smithi008 (mon.0) 2505 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:11.342652+0000 mon.smithi008 (mon.0) 2506 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:11.344653+0000 mon.smithi008 (mon.0) 2507 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:11.291057+0000 mgr.smithi008.flmjzp (mgr.14640) 2062 : cluster [DBG] pgmap v1424: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:11.323292+0000 mgr.smithi008.flmjzp (mgr.14640) 2063 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:11.323844+0000 mgr.smithi008.flmjzp (mgr.14640) 2064 : cluster [DBG] pgmap v1425: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:11.324113+0000 mgr.smithi008.flmjzp (mgr.14640) 2065 : cluster [DBG] pgmap v1426: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:11.346508+0000 mgr.smithi008.flmjzp (mgr.14640) 2066 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:12.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:11.291057+0000 mgr.smithi008.flmjzp (mgr.14640) 2062 : cluster [DBG] pgmap v1424: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:11.323292+0000 mgr.smithi008.flmjzp (mgr.14640) 2063 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:11.323844+0000 mgr.smithi008.flmjzp (mgr.14640) 2064 : cluster [DBG] pgmap v1425: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:11.324113+0000 mgr.smithi008.flmjzp (mgr.14640) 2065 : cluster [DBG] pgmap v1426: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:11.346508+0000 mgr.smithi008.flmjzp (mgr.14640) 2066 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:13.324841+0000 mgr.smithi008.flmjzp (mgr.14640) 2067 : cluster [DBG] pgmap v1427: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:14.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:13.324841+0000 mgr.smithi008.flmjzp (mgr.14640) 2067 : cluster [DBG] pgmap v1427: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:15.325390+0000 mgr.smithi008.flmjzp (mgr.14640) 2068 : cluster [DBG] pgmap v1428: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:15.325390+0000 mgr.smithi008.flmjzp (mgr.14640) 2068 : cluster [DBG] pgmap v1428: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:17.325858+0000 mgr.smithi008.flmjzp (mgr.14640) 2069 : cluster [DBG] pgmap v1429: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:18.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:17.325858+0000 mgr.smithi008.flmjzp (mgr.14640) 2069 : cluster [DBG] pgmap v1429: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:20.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:19.326471+0000 mgr.smithi008.flmjzp (mgr.14640) 2070 : cluster [DBG] pgmap v1430: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:19.326471+0000 mgr.smithi008.flmjzp (mgr.14640) 2070 : cluster [DBG] pgmap v1430: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:21.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:21.357319+0000 mon.smithi008 (mon.0) 2508 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:21.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:21.359474+0000 mon.smithi008 (mon.0) 2509 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:21.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:21.360437+0000 mon.smithi008 (mon.0) 2510 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:21.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:21.366722+0000 mon.smithi008 (mon.0) 2511 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:21.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:21.373211+0000 mon.smithi008 (mon.0) 2512 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:21.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:21.376181+0000 mon.smithi008 (mon.0) 2513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:21.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:21.377833+0000 mon.smithi008 (mon.0) 2514 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:21.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:21.379501+0000 mon.smithi008 (mon.0) 2515 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:21.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:21.381502+0000 mon.smithi008 (mon.0) 2516 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:21.357319+0000 mon.smithi008 (mon.0) 2508 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:21.359474+0000 mon.smithi008 (mon.0) 2509 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:21.360437+0000 mon.smithi008 (mon.0) 2510 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:21.366722+0000 mon.smithi008 (mon.0) 2511 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:21.373211+0000 mon.smithi008 (mon.0) 2512 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:21.376181+0000 mon.smithi008 (mon.0) 2513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:21.377833+0000 mon.smithi008 (mon.0) 2514 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:21.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:21.379501+0000 mon.smithi008 (mon.0) 2515 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:21.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:21.381502+0000 mon.smithi008 (mon.0) 2516 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:21.327161+0000 mgr.smithi008.flmjzp (mgr.14640) 2071 : cluster [DBG] pgmap v1431: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:21.361351+0000 mgr.smithi008.flmjzp (mgr.14640) 2072 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:21.361913+0000 mgr.smithi008.flmjzp (mgr.14640) 2073 : cluster [DBG] pgmap v1432: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:21.362236+0000 mgr.smithi008.flmjzp (mgr.14640) 2074 : cluster [DBG] pgmap v1433: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:21.383408+0000 mgr.smithi008.flmjzp (mgr.14640) 2075 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:22.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:21.327161+0000 mgr.smithi008.flmjzp (mgr.14640) 2071 : cluster [DBG] pgmap v1431: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:21.361351+0000 mgr.smithi008.flmjzp (mgr.14640) 2072 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:21.361913+0000 mgr.smithi008.flmjzp (mgr.14640) 2073 : cluster [DBG] pgmap v1432: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:21.362236+0000 mgr.smithi008.flmjzp (mgr.14640) 2074 : cluster [DBG] pgmap v1433: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:21.383408+0000 mgr.smithi008.flmjzp (mgr.14640) 2075 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:23.363040+0000 mgr.smithi008.flmjzp (mgr.14640) 2076 : cluster [DBG] pgmap v1434: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:24.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:23.363040+0000 mgr.smithi008.flmjzp (mgr.14640) 2076 : cluster [DBG] pgmap v1434: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:26.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:25.363635+0000 mgr.smithi008.flmjzp (mgr.14640) 2077 : cluster [DBG] pgmap v1435: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:25.363635+0000 mgr.smithi008.flmjzp (mgr.14640) 2077 : cluster [DBG] pgmap v1435: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:27.364285+0000 mgr.smithi008.flmjzp (mgr.14640) 2078 : cluster [DBG] pgmap v1436: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:28.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:27.364285+0000 mgr.smithi008.flmjzp (mgr.14640) 2078 : cluster [DBG] pgmap v1436: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:29.364823+0000 mgr.smithi008.flmjzp (mgr.14640) 2079 : cluster [DBG] pgmap v1437: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:30.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:29.364823+0000 mgr.smithi008.flmjzp (mgr.14640) 2079 : cluster [DBG] pgmap v1437: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:31.394068+0000 mon.smithi008 (mon.0) 2517 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:31.394068+0000 mon.smithi008 (mon.0) 2517 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:31.365561+0000 mgr.smithi008.flmjzp (mgr.14640) 2080 : cluster [DBG] pgmap v1438: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:31.951685+0000 mon.smithi008 (mon.0) 2518 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:31.952458+0000 mon.smithi008 (mon.0) 2519 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:31.957608+0000 mon.smithi008 (mon.0) 2520 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:31.962855+0000 mon.smithi008 (mon.0) 2521 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:31.965329+0000 mon.smithi008 (mon.0) 2522 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:31.966627+0000 mon.smithi008 (mon.0) 2523 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:31.967875+0000 mon.smithi008 (mon.0) 2524 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:31.969464+0000 mon.smithi008 (mon.0) 2525 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:32.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:31.365561+0000 mgr.smithi008.flmjzp (mgr.14640) 2080 : cluster [DBG] pgmap v1438: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:31.951685+0000 mon.smithi008 (mon.0) 2518 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:31.952458+0000 mon.smithi008 (mon.0) 2519 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:31.957608+0000 mon.smithi008 (mon.0) 2520 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:31.962855+0000 mon.smithi008 (mon.0) 2521 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:31.965329+0000 mon.smithi008 (mon.0) 2522 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:31.966627+0000 mon.smithi008 (mon.0) 2523 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:31.967875+0000 mon.smithi008 (mon.0) 2524 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:31.969464+0000 mon.smithi008 (mon.0) 2525 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:31.953065+0000 mgr.smithi008.flmjzp (mgr.14640) 2081 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:31.953534+0000 mgr.smithi008.flmjzp (mgr.14640) 2082 : cluster [DBG] pgmap v1439: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:31.953750+0000 mgr.smithi008.flmjzp (mgr.14640) 2083 : cluster [DBG] pgmap v1440: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:31.971056+0000 mgr.smithi008.flmjzp (mgr.14640) 2084 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:33.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:31.953065+0000 mgr.smithi008.flmjzp (mgr.14640) 2081 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:31.953534+0000 mgr.smithi008.flmjzp (mgr.14640) 2082 : cluster [DBG] pgmap v1439: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:31.953750+0000 mgr.smithi008.flmjzp (mgr.14640) 2083 : cluster [DBG] pgmap v1440: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:31.971056+0000 mgr.smithi008.flmjzp (mgr.14640) 2084 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:33.954405+0000 mgr.smithi008.flmjzp (mgr.14640) 2085 : cluster [DBG] pgmap v1441: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:35.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:33.954405+0000 mgr.smithi008.flmjzp (mgr.14640) 2085 : cluster [DBG] pgmap v1441: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:36.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.610+0000 7fc80ce94700 1 -- 172.21.15.8:0/1282351857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8080f6530 msgr2=0x7fc8080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:36.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.610+0000 7fc80ce94700 1 --2- 172.21.15.8:0/1282351857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8080f6530 0x7fc8080f6950 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fc7f8004660 tx=0x7fc7f8009b30).stop 2023-10-18T21:33:36.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.610+0000 7fc80ce94700 1 -- 172.21.15.8:0/1282351857 shutdown_connections 2023-10-18T21:33:36.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.610+0000 7fc80ce94700 1 --2- 172.21.15.8:0/1282351857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8080f77d0 0x7fc8080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:36.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.610+0000 7fc80ce94700 1 --2- 172.21.15.8:0/1282351857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8080f6530 0x7fc8080f6950 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:36.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.610+0000 7fc80ce94700 1 -- 172.21.15.8:0/1282351857 >> 172.21.15.8:0/1282351857 conn(0x7fc8080f1c90 msgr2=0x7fc8080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:36.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.610+0000 7fc80ce94700 1 -- 172.21.15.8:0/1282351857 shutdown_connections 2023-10-18T21:33:36.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.610+0000 7fc80ce94700 1 -- 172.21.15.8:0/1282351857 wait complete. 2023-10-18T21:33:36.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.611+0000 7fc80ce94700 1 Processor -- start 2023-10-18T21:33:36.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.611+0000 7fc80ce94700 1 -- start start 2023-10-18T21:33:36.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.612+0000 7fc80ce94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8080f6530 0x7fc80806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:36.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.612+0000 7fc80ce94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8080f77d0 0x7fc808069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:36.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.612+0000 7fc80ce94700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80806a380 con 0x7fc8080f77d0 2023-10-18T21:33:36.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.612+0000 7fc80ce94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80806a4c0 con 0x7fc8080f6530 2023-10-18T21:33:36.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.612+0000 7fc806ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8080f77d0 0x7fc808069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:36.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.612+0000 7fc806ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8080f77d0 0x7fc808069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34972/0 (socket says 172.21.15.8:34972) 2023-10-18T21:33:36.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.612+0000 7fc806ffd700 1 -- 172.21.15.8:0/3360110826 learned_addr learned my addr 172.21.15.8:0/3360110826 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:36.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.612+0000 7fc8077fe700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8080f6530 0x7fc80806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:36.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.613+0000 7fc806ffd700 1 -- 172.21.15.8:0/3360110826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8080f6530 msgr2=0x7fc80806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:36.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.613+0000 7fc806ffd700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8080f6530 0x7fc80806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:36.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.613+0000 7fc806ffd700 1 -- 172.21.15.8:0/3360110826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8005040 con 0x7fc8080f77d0 2023-10-18T21:33:36.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.613+0000 7fc806ffd700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8080f77d0 0x7fc808069e20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fc7fc00e7f0 tx=0x7fc7fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:36.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.613+0000 7fc7effff700 1 -- 172.21.15.8:0/3360110826 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7fc0092e0 con 0x7fc8080f77d0 2023-10-18T21:33:36.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.613+0000 7fc7effff700 1 -- 172.21.15.8:0/3360110826 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc7fc00f040 con 0x7fc8080f77d0 2023-10-18T21:33:36.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.613+0000 7fc7effff700 1 -- 172.21.15.8:0/3360110826 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7fc0147e0 con 0x7fc8080f77d0 2023-10-18T21:33:36.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.613+0000 7fc80ce94700 1 -- 172.21.15.8:0/3360110826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80806a7a0 con 0x7fc8080f77d0 2023-10-18T21:33:36.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.613+0000 7fc80ce94700 1 -- 172.21.15.8:0/3360110826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80810ed70 con 0x7fc8080f77d0 2023-10-18T21:33:36.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.614+0000 7fc80ce94700 1 -- 172.21.15.8:0/3360110826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc808045ad0 con 0x7fc8080f77d0 2023-10-18T21:33:36.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.615+0000 7fc7effff700 1 -- 172.21.15.8:0/3360110826 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc7fc01b030 con 0x7fc8080f77d0 2023-10-18T21:33:36.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.616+0000 7fc7effff700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7f0060f70 0x7fc7f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:36.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.616+0000 7fc7effff700 1 -- 172.21.15.8:0/3360110826 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc7fc07c6b0 con 0x7fc8080f77d0 2023-10-18T21:33:36.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.616+0000 7fc8077fe700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7f0060f70 0x7fc7f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:36.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.617+0000 7fc8077fe700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7f0060f70 0x7fc7f0063430 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fc7f8005010 tx=0x7fc7f8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:36.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.621+0000 7fc7effff700 1 -- 172.21.15.8:0/3360110826 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc7fc04c310 con 0x7fc8080f77d0 2023-10-18T21:33:36.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.823+0000 7fc80ce94700 1 -- 172.21.15.8:0/3360110826 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc808057f10 con 0x7fc7f0060f70 2023-10-18T21:33:36.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.824+0000 7fc7effff700 1 -- 172.21.15.8:0/3360110826 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc808057f10 con 0x7fc7f0060f70 2023-10-18T21:33:36.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.826+0000 7fc80ce94700 1 -- 172.21.15.8:0/3360110826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7f0060f70 msgr2=0x7fc7f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:36.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.826+0000 7fc80ce94700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7f0060f70 0x7fc7f0063430 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fc7f8005010 tx=0x7fc7f8016040).stop 2023-10-18T21:33:36.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.826+0000 7fc80ce94700 1 -- 172.21.15.8:0/3360110826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8080f77d0 msgr2=0x7fc808069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:36.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.826+0000 7fc80ce94700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8080f77d0 0x7fc808069e20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fc7fc00e7f0 tx=0x7fc7fc00b040).stop 2023-10-18T21:33:36.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.827+0000 7fc80ce94700 1 -- 172.21.15.8:0/3360110826 shutdown_connections 2023-10-18T21:33:36.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.827+0000 7fc80ce94700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc7f0060f70 0x7fc7f0063430 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:36.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.827+0000 7fc80ce94700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8080f6530 0x7fc80806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:36.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.827+0000 7fc80ce94700 1 --2- 172.21.15.8:0/3360110826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8080f77d0 0x7fc808069e20 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:36.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.827+0000 7fc80ce94700 1 -- 172.21.15.8:0/3360110826 >> 172.21.15.8:0/3360110826 conn(0x7fc8080f1c90 msgr2=0x7fc8080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:36.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.827+0000 7fc80ce94700 1 -- 172.21.15.8:0/3360110826 shutdown_connections 2023-10-18T21:33:36.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.827+0000 7fc80ce94700 1 -- 172.21.15.8:0/3360110826 wait complete. 2023-10-18T21:33:36.846 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:33:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.968+0000 7f94db59e700 1 -- 172.21.15.8:0/3026254629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94dc0f77d0 msgr2=0x7f94dc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.968+0000 7f94db59e700 1 --2- 172.21.15.8:0/3026254629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94dc0f77d0 0x7f94dc0f7c30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f94d0004660 tx=0x7f94d0009b30).stop 2023-10-18T21:33:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.968+0000 7f94db59e700 1 -- 172.21.15.8:0/3026254629 shutdown_connections 2023-10-18T21:33:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.968+0000 7f94db59e700 1 --2- 172.21.15.8:0/3026254629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94dc0f77d0 0x7f94dc0f7c30 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.968+0000 7f94db59e700 1 --2- 172.21.15.8:0/3026254629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc0f6530 0x7f94dc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.968+0000 7f94db59e700 1 -- 172.21.15.8:0/3026254629 >> 172.21.15.8:0/3026254629 conn(0x7f94dc0f1c90 msgr2=0x7f94dc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.968+0000 7f94db59e700 1 -- 172.21.15.8:0/3026254629 shutdown_connections 2023-10-18T21:33:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.968+0000 7f94db59e700 1 -- 172.21.15.8:0/3026254629 wait complete. 2023-10-18T21:33:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.969+0000 7f94db59e700 1 Processor -- start 2023-10-18T21:33:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.969+0000 7f94db59e700 1 -- start start 2023-10-18T21:33:36.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.970+0000 7f94db59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94dc0f6530 0x7f94dc106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:36.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.970+0000 7f94db59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc0f77d0 0x7f94dc107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:36.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.970+0000 7f94db59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc107850 con 0x7f94dc0f6530 2023-10-18T21:33:36.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.970+0000 7f94db59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc108060 con 0x7f94dc0f77d0 2023-10-18T21:33:36.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.970+0000 7f94da59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94dc0f6530 0x7f94dc106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:36.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.970+0000 7f94da59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94dc0f6530 0x7f94dc106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55622/0 (socket says 172.21.15.8:55622) 2023-10-18T21:33:36.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.970+0000 7f94da59c700 1 -- 172.21.15.8:0/3030703377 learned_addr learned my addr 172.21.15.8:0/3030703377 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:36.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.971+0000 7f94d9d9b700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc0f77d0 0x7f94dc107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:36.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.971+0000 7f94da59c700 1 -- 172.21.15.8:0/3030703377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc0f77d0 msgr2=0x7f94dc107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:36.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.971+0000 7f94da59c700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc0f77d0 0x7f94dc107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:36.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.971+0000 7f94da59c700 1 -- 172.21.15.8:0/3030703377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0005040 con 0x7f94dc0f6530 2023-10-18T21:33:36.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.971+0000 7f94da59c700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94dc0f6530 0x7f94dc106d60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f94cc002700 tx=0x7f94cc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:36.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.971+0000 7f94caffd700 1 -- 172.21.15.8:0/3030703377 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94cc0079c0 con 0x7f94dc0f6530 2023-10-18T21:33:36.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.971+0000 7f94caffd700 1 -- 172.21.15.8:0/3030703377 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f94cc00f040 con 0x7f94dc0f6530 2023-10-18T21:33:36.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.971+0000 7f94db59e700 1 -- 172.21.15.8:0/3030703377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc1082e0 con 0x7f94dc0f6530 2023-10-18T21:33:36.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.971+0000 7f94caffd700 1 -- 172.21.15.8:0/3030703377 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94cc0148d0 con 0x7f94dc0f6530 2023-10-18T21:33:36.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.971+0000 7f94db59e700 1 -- 172.21.15.8:0/3030703377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc1088a0 con 0x7f94dc0f6530 2023-10-18T21:33:36.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.972+0000 7f94db59e700 1 -- 172.21.15.8:0/3030703377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc059100 con 0x7f94dc0f6530 2023-10-18T21:33:36.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.973+0000 7f94caffd700 1 -- 172.21.15.8:0/3030703377 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f94cc01b060 con 0x7f94dc0f6530 2023-10-18T21:33:36.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.974+0000 7f94caffd700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c4060f70 0x7f94c4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:36.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.975+0000 7f94caffd700 1 -- 172.21.15.8:0/3030703377 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f94cc07c6e0 con 0x7f94dc0f6530 2023-10-18T21:33:36.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.975+0000 7f94d9d9b700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c4060f70 0x7f94c4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:36.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.975+0000 7f94d9d9b700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c4060f70 0x7f94c4063430 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f94d0004630 tx=0x7f94d0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:36.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:36.979+0000 7f94caffd700 1 -- 172.21.15.8:0/3030703377 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f94cc04c3d0 con 0x7f94dc0f6530 2023-10-18T21:33:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.189+0000 7f94db59e700 1 -- 172.21.15.8:0/3030703377 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94dc0feda0 con 0x7f94c4060f70 2023-10-18T21:33:37.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.191+0000 7f94caffd700 1 -- 172.21.15.8:0/3030703377 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f94dc0feda0 con 0x7f94c4060f70 2023-10-18T21:33:37.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 -- 172.21.15.8:0/3030703377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c4060f70 msgr2=0x7f94c4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c4060f70 0x7f94c4063430 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f94d0004630 tx=0x7f94d0009b30).stop 2023-10-18T21:33:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 -- 172.21.15.8:0/3030703377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94dc0f6530 msgr2=0x7f94dc106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94dc0f6530 0x7f94dc106d60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f94cc002700 tx=0x7f94cc009e00).stop 2023-10-18T21:33:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 -- 172.21.15.8:0/3030703377 shutdown_connections 2023-10-18T21:33:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c4060f70 0x7f94c4063430 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94dc0f6530 0x7f94dc106d60 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 --2- 172.21.15.8:0/3030703377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc0f77d0 0x7f94dc107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 -- 172.21.15.8:0/3030703377 >> 172.21.15.8:0/3030703377 conn(0x7f94dc0f1c90 msgr2=0x7f94dc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 -- 172.21.15.8:0/3030703377 shutdown_connections 2023-10-18T21:33:37.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.193+0000 7f94db59e700 1 -- 172.21.15.8:0/3030703377 wait complete. 2023-10-18T21:33:37.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.329+0000 7f2dd528b700 1 -- 172.21.15.8:0/2516488164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd006a3b0 msgr2=0x7f2dd006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:37.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.329+0000 7f2dd528b700 1 --2- 172.21.15.8:0/2516488164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd006a3b0 0x7f2dd006a830 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f2dc4004660 tx=0x7f2dc4009b30).stop 2023-10-18T21:33:37.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.329+0000 7f2dd528b700 1 -- 172.21.15.8:0/2516488164 shutdown_connections 2023-10-18T21:33:37.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.329+0000 7f2dd528b700 1 --2- 172.21.15.8:0/2516488164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd006a3b0 0x7f2dd006a830 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.329+0000 7f2dd528b700 1 --2- 172.21.15.8:0/2516488164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dd006b9c0 0x7f2dd0069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.329+0000 7f2dd528b700 1 -- 172.21.15.8:0/2516488164 >> 172.21.15.8:0/2516488164 conn(0x7f2dd00f1c90 msgr2=0x7f2dd00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:37.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.329+0000 7f2dd528b700 1 -- 172.21.15.8:0/2516488164 shutdown_connections 2023-10-18T21:33:37.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.329+0000 7f2dd528b700 1 -- 172.21.15.8:0/2516488164 wait complete. 2023-10-18T21:33:37.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.330+0000 7f2dd528b700 1 Processor -- start 2023-10-18T21:33:37.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.330+0000 7f2dd528b700 1 -- start start 2023-10-18T21:33:37.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dd528b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dd006a3b0 0x7f2dd010d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:37.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dd528b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd006b9c0 0x7f2dd010d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:37.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dd528b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd010dd50 con 0x7f2dd006b9c0 2023-10-18T21:33:37.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dd528b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd010de90 con 0x7f2dd006a3b0 2023-10-18T21:33:37.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dcf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd006b9c0 0x7f2dd010d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:37.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dcf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd006b9c0 0x7f2dd010d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55640/0 (socket says 172.21.15.8:55640) 2023-10-18T21:33:37.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dcf7fe700 1 -- 172.21.15.8:0/1438750400 learned_addr learned my addr 172.21.15.8:0/1438750400 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:37.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dcffff700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dd006a3b0 0x7f2dd010d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:37.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dcf7fe700 1 -- 172.21.15.8:0/1438750400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dd006a3b0 msgr2=0x7f2dd010d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:37.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dcf7fe700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dd006a3b0 0x7f2dd010d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.331+0000 7f2dcf7fe700 1 -- 172.21.15.8:0/1438750400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4005040 con 0x7f2dd006b9c0 2023-10-18T21:33:37.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.332+0000 7f2dcf7fe700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd006b9c0 0x7f2dd010d7a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f2dc4004320 tx=0x7f2dc400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:37.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.332+0000 7f2dccff9700 1 -- 172.21.15.8:0/1438750400 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dc4019070 con 0x7f2dd006b9c0 2023-10-18T21:33:37.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.332+0000 7f2dccff9700 1 -- 172.21.15.8:0/1438750400 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2dc401e420 con 0x7f2dd006b9c0 2023-10-18T21:33:37.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.332+0000 7f2dd528b700 1 -- 172.21.15.8:0/1438750400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd010e7d0 con 0x7f2dd006b9c0 2023-10-18T21:33:37.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.332+0000 7f2dccff9700 1 -- 172.21.15.8:0/1438750400 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dc4014680 con 0x7f2dd006b9c0 2023-10-18T21:33:37.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.332+0000 7f2dd528b700 1 -- 172.21.15.8:0/1438750400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd010ecb0 con 0x7f2dd006b9c0 2023-10-18T21:33:37.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.333+0000 7f2dd528b700 1 -- 172.21.15.8:0/1438750400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd0045ad0 con 0x7f2dd006b9c0 2023-10-18T21:33:37.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.334+0000 7f2dccff9700 1 -- 172.21.15.8:0/1438750400 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2dc401e590 con 0x7f2dd006b9c0 2023-10-18T21:33:37.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.335+0000 7f2dccff9700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2db8060f70 0x7f2db8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:37.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.335+0000 7f2dccff9700 1 -- 172.21.15.8:0/1438750400 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2dc407dd10 con 0x7f2dd006b9c0 2023-10-18T21:33:37.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.335+0000 7f2dcffff700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2db8060f70 0x7f2db8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:37.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.336+0000 7f2dcffff700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2db8060f70 0x7f2db8063430 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f2dc0009fd0 tx=0x7f2dc000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:37.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.339+0000 7f2dccff9700 1 -- 172.21.15.8:0/1438750400 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2dc4051310 con 0x7f2dd006b9c0 2023-10-18T21:33:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.531+0000 7f2dd528b700 1 -- 172.21.15.8:0/1438750400 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dd01053f0 con 0x7f2db8060f70 2023-10-18T21:33:37.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.541+0000 7f2dccff9700 1 -- 172.21.15.8:0/1438750400 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2dd01053f0 con 0x7f2db8060f70 2023-10-18T21:33:37.543 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:33:37.543 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (40m) 8m ago 41m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:33:37.544 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (34m) 8m ago 41m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:33:37.544 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (34m) 6m ago 40m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:33:37.544 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (40m) 8m ago 41m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:33:37.544 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 37m - - 2023-10-18T21:33:37.544 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 37m - - 2023-10-18T21:33:37.545 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 37m - - 2023-10-18T21:33:37.545 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 37m - - 2023-10-18T21:33:37.545 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (35m) 8m ago 43m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:33:37.545 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (34m) 6m ago 40m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:33:37.545 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (34m) 8m ago 43m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:33:37.546 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (34m) 6m ago 40m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:33:37.546 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (41m) 8m ago 41m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:33:37.546 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (40m) 6m ago 40m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:33:37.546 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (33m) 8m ago 40m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:33:37.546 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (31m) 8m ago 40m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:33:37.547 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (31m) 8m ago 39m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:33:37.547 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (30m) 6m ago 39m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:33:37.547 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (30m) 6m ago 39m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:33:37.547 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (29m) 6m ago 38m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:33:37.547 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (35m) 8m ago 41m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:33:37.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.543+0000 7f2dd528b700 1 -- 172.21.15.8:0/1438750400 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2db8060f70 msgr2=0x7f2db8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:37.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.543+0000 7f2dd528b700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2db8060f70 0x7f2db8063430 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f2dc0009fd0 tx=0x7f2dc000b040).stop 2023-10-18T21:33:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.543+0000 7f2dd528b700 1 -- 172.21.15.8:0/1438750400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd006b9c0 msgr2=0x7f2dd010d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.543+0000 7f2dd528b700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd006b9c0 0x7f2dd010d7a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f2dc4004320 tx=0x7f2dc400b040).stop 2023-10-18T21:33:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.543+0000 7f2dd528b700 1 -- 172.21.15.8:0/1438750400 shutdown_connections 2023-10-18T21:33:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.543+0000 7f2dd528b700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2db8060f70 0x7f2db8063430 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.543+0000 7f2dd528b700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dd006a3b0 0x7f2dd010d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.543+0000 7f2dd528b700 1 --2- 172.21.15.8:0/1438750400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd006b9c0 0x7f2dd010d7a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.543+0000 7f2dd528b700 1 -- 172.21.15.8:0/1438750400 >> 172.21.15.8:0/1438750400 conn(0x7f2dd00f1c90 msgr2=0x7f2dd00f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.544+0000 7f2dd528b700 1 -- 172.21.15.8:0/1438750400 shutdown_connections 2023-10-18T21:33:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.544+0000 7f2dd528b700 1 -- 172.21.15.8:0/1438750400 wait complete. 2023-10-18T21:33:37.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.680+0000 7f8c1f217700 1 -- 172.21.15.8:0/4006660278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c180f77d0 msgr2=0x7f8c180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:37.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.680+0000 7f8c1f217700 1 --2- 172.21.15.8:0/4006660278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c180f77d0 0x7f8c180f7c30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f8c08004660 tx=0x7f8c08009b30).stop 2023-10-18T21:33:37.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.680+0000 7f8c1f217700 1 -- 172.21.15.8:0/4006660278 shutdown_connections 2023-10-18T21:33:37.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.680+0000 7f8c1f217700 1 --2- 172.21.15.8:0/4006660278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c180f77d0 0x7f8c180f7c30 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.680+0000 7f8c1f217700 1 --2- 172.21.15.8:0/4006660278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c180f6530 0x7f8c180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.680+0000 7f8c1f217700 1 -- 172.21.15.8:0/4006660278 >> 172.21.15.8:0/4006660278 conn(0x7f8c180f1c90 msgr2=0x7f8c180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:37.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.680+0000 7f8c1f217700 1 -- 172.21.15.8:0/4006660278 shutdown_connections 2023-10-18T21:33:37.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.680+0000 7f8c1f217700 1 -- 172.21.15.8:0/4006660278 wait complete. 2023-10-18T21:33:37.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.681+0000 7f8c1f217700 1 Processor -- start 2023-10-18T21:33:37.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.681+0000 7f8c1f217700 1 -- start start 2023-10-18T21:33:37.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.681+0000 7f8c1f217700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c180f6530 0x7f8c1806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:37.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.681+0000 7f8c1f217700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c180f77d0 0x7f8c18069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:37.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.681+0000 7f8c1f217700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1806a380 con 0x7f8c180f6530 2023-10-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.681+0000 7f8c1f217700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1806a4c0 con 0x7f8c180f77d0 2023-10-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c1e215700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c180f6530 0x7f8c1806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c1e215700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c180f6530 0x7f8c1806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55658/0 (socket says 172.21.15.8:55658) 2023-10-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c1e215700 1 -- 172.21.15.8:0/514083585 learned_addr learned my addr 172.21.15.8:0/514083585 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c1da14700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c180f77d0 0x7f8c18069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:37.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c1e215700 1 -- 172.21.15.8:0/514083585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c180f77d0 msgr2=0x7f8c18069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:37.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c1e215700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c180f77d0 0x7f8c18069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c1e215700 1 -- 172.21.15.8:0/514083585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c08005040 con 0x7f8c180f6530 2023-10-18T21:33:37.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c1e215700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c180f6530 0x7f8c1806b9a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f8c1400c790 tx=0x7f8c14007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:37.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c0effd700 1 -- 172.21.15.8:0/514083585 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c1400e680 con 0x7f8c180f6530 2023-10-18T21:33:37.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c0effd700 1 -- 172.21.15.8:0/514083585 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8c1400eca0 con 0x7f8c180f6530 2023-10-18T21:33:37.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c0effd700 1 -- 172.21.15.8:0/514083585 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c14012d80 con 0x7f8c180f6530 2023-10-18T21:33:37.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.682+0000 7f8c1f217700 1 -- 172.21.15.8:0/514083585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1806a7a0 con 0x7f8c180f6530 2023-10-18T21:33:37.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.683+0000 7f8c1f217700 1 -- 172.21.15.8:0/514083585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1810ed70 con 0x7f8c180f6530 2023-10-18T21:33:37.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.684+0000 7f8c1f217700 1 -- 172.21.15.8:0/514083585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c18045ad0 con 0x7f8c180f6530 2023-10-18T21:33:37.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.684+0000 7f8c0effd700 1 -- 172.21.15.8:0/514083585 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8c14010070 con 0x7f8c180f6530 2023-10-18T21:33:37.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.685+0000 7f8c0effd700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c04060f70 0x7f8c04063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:37.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.685+0000 7f8c0effd700 1 -- 172.21.15.8:0/514083585 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8c1407ca70 con 0x7f8c180f6530 2023-10-18T21:33:37.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.686+0000 7f8c1da14700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c04060f70 0x7f8c04063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:37.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.686+0000 7f8c1da14700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c04060f70 0x7f8c04063430 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f8c08009490 tx=0x7f8c08009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:37.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.689+0000 7f8c0effd700 1 -- 172.21.15.8:0/514083585 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8c1404c5c0 con 0x7f8c180f6530 2023-10-18T21:33:37.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:35.954999+0000 mgr.smithi008.flmjzp (mgr.14640) 2086 : cluster [DBG] pgmap v1442: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:36.825767+0000 mgr.smithi008.flmjzp (mgr.14640) 2087 : audit [DBG] from='client.35824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:37.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.944+0000 7f8c1f217700 1 -- 172.21.15.8:0/514083585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c180fed60 con 0x7f8c180f6530 2023-10-18T21:33:37.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.945+0000 7f8c0effd700 1 -- 172.21.15.8:0/514083585 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f8c1404fbe0 con 0x7f8c180f6530 2023-10-18T21:33:37.947 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:33:37.947 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:33:37.947 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:33:37.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:33:37.948 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:33:37.948 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:33:37.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:33:37.948 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:33:37.949 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:33:37.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:33:37.949 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:33:37.949 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:33:37.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:33:37.949 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:33:37.950 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:33:37.950 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:33:37.950 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:33:37.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 -- 172.21.15.8:0/514083585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c04060f70 msgr2=0x7f8c04063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:37.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c04060f70 0x7f8c04063430 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f8c08009490 tx=0x7f8c08009b30).stop 2023-10-18T21:33:37.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 -- 172.21.15.8:0/514083585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c180f6530 msgr2=0x7f8c1806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:37.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c180f6530 0x7f8c1806b9a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f8c1400c790 tx=0x7f8c14007d90).stop 2023-10-18T21:33:37.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 -- 172.21.15.8:0/514083585 shutdown_connections 2023-10-18T21:33:37.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8c04060f70 0x7f8c04063430 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c180f6530 0x7f8c1806b9a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 --2- 172.21.15.8:0/514083585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c180f77d0 0x7f8c18069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:37.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 -- 172.21.15.8:0/514083585 >> 172.21.15.8:0/514083585 conn(0x7f8c180f1c90 msgr2=0x7f8c180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:37.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 -- 172.21.15.8:0/514083585 shutdown_connections 2023-10-18T21:33:37.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:37.947+0000 7f8c1f217700 1 -- 172.21.15.8:0/514083585 wait complete. 2023-10-18T21:33:37.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:35.954999+0000 mgr.smithi008.flmjzp (mgr.14640) 2086 : cluster [DBG] pgmap v1442: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:37.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:36.825767+0000 mgr.smithi008.flmjzp (mgr.14640) 2087 : audit [DBG] from='client.35824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.083+0000 7fa77aaee700 1 -- 172.21.15.8:0/2768981174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7740f6530 msgr2=0x7fa7740f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.083+0000 7fa77aaee700 1 --2- 172.21.15.8:0/2768981174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7740f6530 0x7fa7740f6950 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fa770004660 tx=0x7fa770009b30).stop 2023-10-18T21:33:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.084+0000 7fa77aaee700 1 -- 172.21.15.8:0/2768981174 shutdown_connections 2023-10-18T21:33:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.084+0000 7fa77aaee700 1 --2- 172.21.15.8:0/2768981174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7740f77d0 0x7fa7740f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.084+0000 7fa77aaee700 1 --2- 172.21.15.8:0/2768981174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7740f6530 0x7fa7740f6950 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.084+0000 7fa77aaee700 1 -- 172.21.15.8:0/2768981174 >> 172.21.15.8:0/2768981174 conn(0x7fa7740f1c90 msgr2=0x7fa7740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.084+0000 7fa77aaee700 1 -- 172.21.15.8:0/2768981174 shutdown_connections 2023-10-18T21:33:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.084+0000 7fa77aaee700 1 -- 172.21.15.8:0/2768981174 wait complete. 2023-10-18T21:33:38.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.085+0000 7fa77aaee700 1 Processor -- start 2023-10-18T21:33:38.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.085+0000 7fa77aaee700 1 -- start start 2023-10-18T21:33:38.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa77aaee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7740f6530 0x7fa774106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:38.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa77aaee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7740f77d0 0x7fa774107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:38.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa77aaee700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa774107910 con 0x7fa7740f77d0 2023-10-18T21:33:38.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa77aaee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa774108120 con 0x7fa7740f6530 2023-10-18T21:33:38.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa7792eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7740f77d0 0x7fa774107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:38.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa7792eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7740f77d0 0x7fa774107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55674/0 (socket says 172.21.15.8:55674) 2023-10-18T21:33:38.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa7792eb700 1 -- 172.21.15.8:0/4145283370 learned_addr learned my addr 172.21.15.8:0/4145283370 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:38.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa779aec700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7740f6530 0x7fa774106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:38.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa7792eb700 1 -- 172.21.15.8:0/4145283370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7740f6530 msgr2=0x7fa774106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:38.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa7792eb700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7740f6530 0x7fa774106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.086+0000 7fa7792eb700 1 -- 172.21.15.8:0/4145283370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa770005040 con 0x7fa7740f77d0 2023-10-18T21:33:38.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.087+0000 7fa7792eb700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7740f77d0 0x7fa774107310 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fa7640026d0 tx=0x7fa764009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:38.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.087+0000 7fa76a7fc700 1 -- 172.21.15.8:0/4145283370 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7640079c0 con 0x7fa7740f77d0 2023-10-18T21:33:38.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.087+0000 7fa76a7fc700 1 -- 172.21.15.8:0/4145283370 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa76400f040 con 0x7fa7740f77d0 2023-10-18T21:33:38.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.087+0000 7fa76a7fc700 1 -- 172.21.15.8:0/4145283370 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa764014980 con 0x7fa7740f77d0 2023-10-18T21:33:38.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.087+0000 7fa77aaee700 1 -- 172.21.15.8:0/4145283370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7741083a0 con 0x7fa7740f77d0 2023-10-18T21:33:38.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.087+0000 7fa77aaee700 1 -- 172.21.15.8:0/4145283370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa774108960 con 0x7fa7740f77d0 2023-10-18T21:33:38.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.088+0000 7fa77aaee700 1 -- 172.21.15.8:0/4145283370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa774059100 con 0x7fa7740f77d0 2023-10-18T21:33:38.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.089+0000 7fa76a7fc700 1 -- 172.21.15.8:0/4145283370 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa7640090d0 con 0x7fa7740f77d0 2023-10-18T21:33:38.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.090+0000 7fa76a7fc700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa760060f70 0x7fa760063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:38.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.090+0000 7fa76a7fc700 1 -- 172.21.15.8:0/4145283370 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa76407c8a0 con 0x7fa7740f77d0 2023-10-18T21:33:38.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.090+0000 7fa779aec700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa760060f70 0x7fa760063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:38.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.091+0000 7fa779aec700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa760060f70 0x7fa760063430 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fa774106b90 tx=0x7fa770009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:38.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.094+0000 7fa76a7fc700 1 -- 172.21.15.8:0/4145283370 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa76404c580 con 0x7fa7740f77d0 2023-10-18T21:33:38.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.318+0000 7fa77aaee700 1 -- 172.21.15.8:0/4145283370 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa7740fee50 con 0x7fa7740f77d0 2023-10-18T21:33:38.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.319+0000 7fa76a7fc700 1 -- 172.21.15.8:0/4145283370 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fa7740fee50 con 0x7fa7740f77d0 2023-10-18T21:33:38.321 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:33:38.321 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:33:38.322 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:33:38.322 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:33:38.322 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:33:38.322 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:33:38.322 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:33:38.323 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:33:38.323 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:33:38.323 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:33:38.323 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:33:38.323 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:33:38.324 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:33:38.324 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:33:38.324 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:33:38.324 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:33:38.324 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:33:38.325 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:33:38.325 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:33:38.325 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:33:38.325 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:33:38.326 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:33:38.326 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:33:38.326 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:33:38.326 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:33:38.326 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:33:38.326 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:33:38.327 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:33:38.327 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:33:38.327 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:33:38.327 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:33:38.327 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:33:38.328 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:33:38.328 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:33:38.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 -- 172.21.15.8:0/4145283370 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa760060f70 msgr2=0x7fa760063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:38.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa760060f70 0x7fa760063430 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fa774106b90 tx=0x7fa770009b30).stop 2023-10-18T21:33:38.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 -- 172.21.15.8:0/4145283370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7740f77d0 msgr2=0x7fa774107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:38.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7740f77d0 0x7fa774107310 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fa7640026d0 tx=0x7fa764009de0).stop 2023-10-18T21:33:38.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 -- 172.21.15.8:0/4145283370 shutdown_connections 2023-10-18T21:33:38.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa760060f70 0x7fa760063430 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7740f6530 0x7fa774106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 --2- 172.21.15.8:0/4145283370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7740f77d0 0x7fa774107310 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 -- 172.21.15.8:0/4145283370 >> 172.21.15.8:0/4145283370 conn(0x7fa7740f1c90 msgr2=0x7fa7740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:38.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 -- 172.21.15.8:0/4145283370 shutdown_connections 2023-10-18T21:33:38.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.321+0000 7fa77aaee700 1 -- 172.21.15.8:0/4145283370 wait complete. 2023-10-18T21:33:38.331 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:33:38.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.458+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/1472335394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ebc0f6530 msgr2=0x7f0ebc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:38.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.458+0000 7f0ec0b9e700 1 --2- 172.21.15.8:0/1472335394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ebc0f6530 0x7f0ebc0f6950 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f0eac004660 tx=0x7f0eac009b30).stop 2023-10-18T21:33:38.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.459+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/1472335394 shutdown_connections 2023-10-18T21:33:38.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.459+0000 7f0ec0b9e700 1 --2- 172.21.15.8:0/1472335394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ebc0f77d0 0x7f0ebc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.459+0000 7f0ec0b9e700 1 --2- 172.21.15.8:0/1472335394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ebc0f6530 0x7f0ebc0f6950 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.459+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/1472335394 >> 172.21.15.8:0/1472335394 conn(0x7f0ebc0f1c90 msgr2=0x7f0ebc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:38.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.459+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/1472335394 shutdown_connections 2023-10-18T21:33:38.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.459+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/1472335394 wait complete. 2023-10-18T21:33:38.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.460+0000 7f0ec0b9e700 1 Processor -- start 2023-10-18T21:33:38.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.460+0000 7f0ec0b9e700 1 -- start start 2023-10-18T21:33:38.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ec0b9e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ebc0f6530 0x7f0ebc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:38.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ec0b9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ebc0f77d0 0x7f0ebc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:38.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ec0b9e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc107880 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ec0b9e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc1080c0 con 0x7f0ebc0f6530 2023-10-18T21:33:38.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ebaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ebc0f77d0 0x7f0ebc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:38.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ebaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ebc0f77d0 0x7f0ebc107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55694/0 (socket says 172.21.15.8:55694) 2023-10-18T21:33:38.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ebaffd700 1 -- 172.21.15.8:0/3067554469 learned_addr learned my addr 172.21.15.8:0/3067554469 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:33:38.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ebb7fe700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ebc0f6530 0x7f0ebc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:38.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ebaffd700 1 -- 172.21.15.8:0/3067554469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ebc0f6530 msgr2=0x7f0ebc106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:38.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ebaffd700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ebc0f6530 0x7f0ebc106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ebaffd700 1 -- 172.21.15.8:0/3067554469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac005040 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.461+0000 7f0ebb7fe700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ebc0f6530 0x7f0ebc106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:33:38.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.462+0000 7f0ebaffd700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ebc0f77d0 0x7f0ebc107280 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f0eb000e7f0 tx=0x7f0eb000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:38.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.462+0000 7f0ea3fff700 1 -- 172.21.15.8:0/3067554469 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb00092e0 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.462+0000 7f0ea3fff700 1 -- 172.21.15.8:0/3067554469 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0eb000f040 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.462+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/3067554469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc1083a0 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.462+0000 7f0ea3fff700 1 -- 172.21.15.8:0/3067554469 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb00147e0 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.462+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/3067554469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc1088e0 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.463+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/3067554469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ebc059100 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.464+0000 7f0ea3fff700 1 -- 172.21.15.8:0/3067554469 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0eb001b030 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.465+0000 7f0ea3fff700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ea4060f70 0x7f0ea4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:33:38.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.465+0000 7f0ea3fff700 1 -- 172.21.15.8:0/3067554469 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0eb007c740 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.465+0000 7f0ebb7fe700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ea4060f70 0x7f0ea4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:33:38.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.466+0000 7f0ebb7fe700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ea4060f70 0x7f0ea4063430 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f0eac004d80 tx=0x7f0eac00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:33:38.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.469+0000 7f0ea3fff700 1 -- 172.21.15.8:0/3067554469 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0eb004c340 con 0x7f0ebc0f77d0 2023-10-18T21:33:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:37.192151+0000 mgr.smithi008.flmjzp (mgr.14640) 2088 : audit [DBG] from='client.35828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:37.533734+0000 mgr.smithi008.flmjzp (mgr.14640) 2089 : audit [DBG] from='client.35832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:37.946532+0000 mon.smithi008 (mon.0) 2526 : audit [DBG] from='client.? 172.21.15.8:0/514083585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:38.320647+0000 mon.smithi008 (mon.0) 2527 : audit [DBG] from='client.? 172.21.15.8:0/4145283370' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:33:38.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.668+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/3067554469 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ebc0fedd0 con 0x7f0ea4060f70 2023-10-18T21:33:38.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.669+0000 7f0ea3fff700 1 -- 172.21.15.8:0/3067554469 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0ebc0fedd0 con 0x7f0ea4060f70 2023-10-18T21:33:38.672 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:33:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:33:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:33:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:33:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:33:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:33:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:33:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:33:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:33:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:33:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:33:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:33:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:33:38.675 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:33:38.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.671+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/3067554469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ea4060f70 msgr2=0x7f0ea4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:38.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.671+0000 7f0ec0b9e700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ea4060f70 0x7f0ea4063430 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f0eac004d80 tx=0x7f0eac00b040).stop 2023-10-18T21:33:38.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.671+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/3067554469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ebc0f77d0 msgr2=0x7f0ebc107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:33:38.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.671+0000 7f0ec0b9e700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ebc0f77d0 0x7f0ebc107280 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f0eb000e7f0 tx=0x7f0eb000b040).stop 2023-10-18T21:33:38.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.671+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/3067554469 shutdown_connections 2023-10-18T21:33:38.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.671+0000 7f0ec0b9e700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0ea4060f70 0x7f0ea4063430 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.671+0000 7f0ec0b9e700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ebc0f6530 0x7f0ebc106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.671+0000 7f0ec0b9e700 1 --2- 172.21.15.8:0/3067554469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ebc0f77d0 0x7f0ebc107280 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:33:38.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.671+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/3067554469 >> 172.21.15.8:0/3067554469 conn(0x7f0ebc0f1c90 msgr2=0x7f0ebc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:33:38.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.671+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/3067554469 shutdown_connections 2023-10-18T21:33:38.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:33:38.672+0000 7f0ec0b9e700 1 -- 172.21.15.8:0/3067554469 wait complete. 2023-10-18T21:33:38.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:37.192151+0000 mgr.smithi008.flmjzp (mgr.14640) 2088 : audit [DBG] from='client.35828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:37.533734+0000 mgr.smithi008.flmjzp (mgr.14640) 2089 : audit [DBG] from='client.35832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:37.946532+0000 mon.smithi008 (mon.0) 2526 : audit [DBG] from='client.? 172.21.15.8:0/514083585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:38.320647+0000 mon.smithi008 (mon.0) 2527 : audit [DBG] from='client.? 172.21.15.8:0/4145283370' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:33:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:37.955422+0000 mgr.smithi008.flmjzp (mgr.14640) 2090 : cluster [DBG] pgmap v1443: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:38.670733+0000 mgr.smithi008.flmjzp (mgr.14640) 2091 : audit [DBG] from='client.35844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:37.955422+0000 mgr.smithi008.flmjzp (mgr.14640) 2090 : cluster [DBG] pgmap v1443: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:38.670733+0000 mgr.smithi008.flmjzp (mgr.14640) 2091 : audit [DBG] from='client.35844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:33:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:39.955988+0000 mgr.smithi008.flmjzp (mgr.14640) 2092 : cluster [DBG] pgmap v1444: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:41.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:39.955988+0000 mgr.smithi008.flmjzp (mgr.14640) 2092 : cluster [DBG] pgmap v1444: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:41.978871+0000 mon.smithi008 (mon.0) 2528 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:41.981054+0000 mon.smithi008 (mon.0) 2529 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:41.982187+0000 mon.smithi008 (mon.0) 2530 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:41.989686+0000 mon.smithi008 (mon.0) 2531 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:41.996255+0000 mon.smithi008 (mon.0) 2532 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:41.999415+0000 mon.smithi008 (mon.0) 2533 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:42.001181+0000 mon.smithi008 (mon.0) 2534 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:42.002888+0000 mon.smithi008 (mon.0) 2535 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:42.004981+0000 mon.smithi008 (mon.0) 2536 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:42.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:41.978871+0000 mon.smithi008 (mon.0) 2528 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:41.981054+0000 mon.smithi008 (mon.0) 2529 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:41.982187+0000 mon.smithi008 (mon.0) 2530 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:41.989686+0000 mon.smithi008 (mon.0) 2531 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:41.996255+0000 mon.smithi008 (mon.0) 2532 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:41.999415+0000 mon.smithi008 (mon.0) 2533 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:42.001181+0000 mon.smithi008 (mon.0) 2534 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:42.002888+0000 mon.smithi008 (mon.0) 2535 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:42.004981+0000 mon.smithi008 (mon.0) 2536 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:41.956575+0000 mgr.smithi008.flmjzp (mgr.14640) 2093 : cluster [DBG] pgmap v1445: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:41.983164+0000 mgr.smithi008.flmjzp (mgr.14640) 2094 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:41.984065+0000 mgr.smithi008.flmjzp (mgr.14640) 2095 : cluster [DBG] pgmap v1446: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:41.984339+0000 mgr.smithi008.flmjzp (mgr.14640) 2096 : cluster [DBG] pgmap v1447: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:42.007028+0000 mgr.smithi008.flmjzp (mgr.14640) 2097 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:43.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:41.956575+0000 mgr.smithi008.flmjzp (mgr.14640) 2093 : cluster [DBG] pgmap v1445: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:41.983164+0000 mgr.smithi008.flmjzp (mgr.14640) 2094 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:41.984065+0000 mgr.smithi008.flmjzp (mgr.14640) 2095 : cluster [DBG] pgmap v1446: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:41.984339+0000 mgr.smithi008.flmjzp (mgr.14640) 2096 : cluster [DBG] pgmap v1447: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:42.007028+0000 mgr.smithi008.flmjzp (mgr.14640) 2097 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:43.985042+0000 mgr.smithi008.flmjzp (mgr.14640) 2098 : cluster [DBG] pgmap v1448: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:45.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:43.985042+0000 mgr.smithi008.flmjzp (mgr.14640) 2098 : cluster [DBG] pgmap v1448: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:45.985765+0000 mgr.smithi008.flmjzp (mgr.14640) 2099 : cluster [DBG] pgmap v1449: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:47.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:45.985765+0000 mgr.smithi008.flmjzp (mgr.14640) 2099 : cluster [DBG] pgmap v1449: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:47.986470+0000 mgr.smithi008.flmjzp (mgr.14640) 2100 : cluster [DBG] pgmap v1450: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:49.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:47.986470+0000 mgr.smithi008.flmjzp (mgr.14640) 2100 : cluster [DBG] pgmap v1450: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:49.986978+0000 mgr.smithi008.flmjzp (mgr.14640) 2101 : cluster [DBG] pgmap v1451: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:51.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:49.986978+0000 mgr.smithi008.flmjzp (mgr.14640) 2101 : cluster [DBG] pgmap v1451: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:52.017784+0000 mon.smithi008 (mon.0) 2537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:52.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:52.017784+0000 mon.smithi008 (mon.0) 2537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:51.987711+0000 mgr.smithi008.flmjzp (mgr.14640) 2102 : cluster [DBG] pgmap v1452: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:52.577870+0000 mon.smithi008 (mon.0) 2538 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:52.579082+0000 mon.smithi008 (mon.0) 2539 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:53.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:52.580057+0000 mgr.smithi008.flmjzp (mgr.14640) 2103 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:53.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:52.580793+0000 mgr.smithi008.flmjzp (mgr.14640) 2104 : cluster [DBG] pgmap v1453: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:53.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:52.581100+0000 mgr.smithi008.flmjzp (mgr.14640) 2105 : cluster [DBG] pgmap v1454: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:53.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:52.585865+0000 mon.smithi008 (mon.0) 2540 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:53.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:52.593329+0000 mon.smithi008 (mon.0) 2541 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:53.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:52.596484+0000 mon.smithi008 (mon.0) 2542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:53.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:52.598208+0000 mon.smithi008 (mon.0) 2543 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:53.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:52.599836+0000 mon.smithi008 (mon.0) 2544 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:53.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:33:52.601822+0000 mon.smithi008 (mon.0) 2545 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:53.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:33:52.603705+0000 mgr.smithi008.flmjzp (mgr.14640) 2106 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:53.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:51.987711+0000 mgr.smithi008.flmjzp (mgr.14640) 2102 : cluster [DBG] pgmap v1452: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:52.577870+0000 mon.smithi008 (mon.0) 2538 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:33:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:52.579082+0000 mon.smithi008 (mon.0) 2539 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:33:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:52.580057+0000 mgr.smithi008.flmjzp (mgr.14640) 2103 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:33:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:52.580793+0000 mgr.smithi008.flmjzp (mgr.14640) 2104 : cluster [DBG] pgmap v1453: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:52.581100+0000 mgr.smithi008.flmjzp (mgr.14640) 2105 : cluster [DBG] pgmap v1454: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:52.585865+0000 mon.smithi008 (mon.0) 2540 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:33:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:52.593329+0000 mon.smithi008 (mon.0) 2541 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:33:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:52.596484+0000 mon.smithi008 (mon.0) 2542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:52.598208+0000 mon.smithi008 (mon.0) 2543 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:53.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:52.599836+0000 mon.smithi008 (mon.0) 2544 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:53.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:33:52.601822+0000 mon.smithi008 (mon.0) 2545 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:33:53.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:33:52.603705+0000 mgr.smithi008.flmjzp (mgr.14640) 2106 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:33:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:54.581802+0000 mgr.smithi008.flmjzp (mgr.14640) 2107 : cluster [DBG] pgmap v1455: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:55.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:54.581802+0000 mgr.smithi008.flmjzp (mgr.14640) 2107 : cluster [DBG] pgmap v1455: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:56.582416+0000 mgr.smithi008.flmjzp (mgr.14640) 2108 : cluster [DBG] pgmap v1456: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:57.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:56.582416+0000 mgr.smithi008.flmjzp (mgr.14640) 2108 : cluster [DBG] pgmap v1456: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:33:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:33:58.582968+0000 mgr.smithi008.flmjzp (mgr.14640) 2109 : cluster [DBG] pgmap v1457: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:33:59.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:33:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:33:58.582968+0000 mgr.smithi008.flmjzp (mgr.14640) 2109 : cluster [DBG] pgmap v1457: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:01.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:00.583604+0000 mgr.smithi008.flmjzp (mgr.14640) 2110 : cluster [DBG] pgmap v1458: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:00.583604+0000 mgr.smithi008.flmjzp (mgr.14640) 2110 : cluster [DBG] pgmap v1458: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:02.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:02.607407+0000 mon.smithi008 (mon.0) 2546 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:02.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:02.609642+0000 mon.smithi008 (mon.0) 2547 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:02.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:02.610685+0000 mon.smithi008 (mon.0) 2548 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:02.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:02.617318+0000 mon.smithi008 (mon.0) 2549 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:02.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:02.625273+0000 mon.smithi008 (mon.0) 2550 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:02.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:02.628499+0000 mon.smithi008 (mon.0) 2551 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:02.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:02.630260+0000 mon.smithi008 (mon.0) 2552 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:02.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:02.631894+0000 mon.smithi008 (mon.0) 2553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:02.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:02.633903+0000 mon.smithi008 (mon.0) 2554 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:02.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:02.607407+0000 mon.smithi008 (mon.0) 2546 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:02.609642+0000 mon.smithi008 (mon.0) 2547 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:02.610685+0000 mon.smithi008 (mon.0) 2548 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:02.617318+0000 mon.smithi008 (mon.0) 2549 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:02.625273+0000 mon.smithi008 (mon.0) 2550 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:02.628499+0000 mon.smithi008 (mon.0) 2551 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:02.630260+0000 mon.smithi008 (mon.0) 2552 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:02.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:02.631894+0000 mon.smithi008 (mon.0) 2553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:02.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:02.633903+0000 mon.smithi008 (mon.0) 2554 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:02.584231+0000 mgr.smithi008.flmjzp (mgr.14640) 2111 : cluster [DBG] pgmap v1459: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:02.611590+0000 mgr.smithi008.flmjzp (mgr.14640) 2112 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:02.612156+0000 mgr.smithi008.flmjzp (mgr.14640) 2113 : cluster [DBG] pgmap v1460: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:02.612595+0000 mgr.smithi008.flmjzp (mgr.14640) 2114 : cluster [DBG] pgmap v1461: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:02.635964+0000 mgr.smithi008.flmjzp (mgr.14640) 2115 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:03.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:02.584231+0000 mgr.smithi008.flmjzp (mgr.14640) 2111 : cluster [DBG] pgmap v1459: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:02.611590+0000 mgr.smithi008.flmjzp (mgr.14640) 2112 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:02.612156+0000 mgr.smithi008.flmjzp (mgr.14640) 2113 : cluster [DBG] pgmap v1460: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:02.612595+0000 mgr.smithi008.flmjzp (mgr.14640) 2114 : cluster [DBG] pgmap v1461: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:02.635964+0000 mgr.smithi008.flmjzp (mgr.14640) 2115 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:04.613313+0000 mgr.smithi008.flmjzp (mgr.14640) 2116 : cluster [DBG] pgmap v1462: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:04.613313+0000 mgr.smithi008.flmjzp (mgr.14640) 2116 : cluster [DBG] pgmap v1462: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:06.613824+0000 mgr.smithi008.flmjzp (mgr.14640) 2117 : cluster [DBG] pgmap v1463: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:06.613824+0000 mgr.smithi008.flmjzp (mgr.14640) 2117 : cluster [DBG] pgmap v1463: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:08.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.828+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3138038390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0fc0f6530 msgr2=0x7fc0fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:08.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.828+0000 7fc0fb59e700 1 --2- 172.21.15.8:0/3138038390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0fc0f6530 0x7fc0fc0f6950 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fc0ec004660 tx=0x7fc0ec009b30).stop 2023-10-18T21:34:08.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.828+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3138038390 shutdown_connections 2023-10-18T21:34:08.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.828+0000 7fc0fb59e700 1 --2- 172.21.15.8:0/3138038390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0f77d0 0x7fc0fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:08.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.828+0000 7fc0fb59e700 1 --2- 172.21.15.8:0/3138038390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0fc0f6530 0x7fc0fc0f6950 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:08.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.828+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3138038390 >> 172.21.15.8:0/3138038390 conn(0x7fc0fc0f1c90 msgr2=0x7fc0fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:08.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.828+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3138038390 shutdown_connections 2023-10-18T21:34:08.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.828+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3138038390 wait complete. 2023-10-18T21:34:08.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.829+0000 7fc0fb59e700 1 Processor -- start 2023-10-18T21:34:08.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.829+0000 7fc0fb59e700 1 -- start start 2023-10-18T21:34:08.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.829+0000 7fc0fb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0fc0f6530 0x7fc0fc108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:08.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.829+0000 7fc0fb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0f77d0 0x7fc0fc109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.829+0000 7fc0fb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc109a00 con 0x7fc0fc0f6530 2023-10-18T21:34:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.829+0000 7fc0fb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc109b40 con 0x7fc0fc0f77d0 2023-10-18T21:34:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.830+0000 7fc0fa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0fc0f6530 0x7fc0fc108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.830+0000 7fc0fa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0fc0f6530 0x7fc0fc108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36572/0 (socket says 172.21.15.8:36572) 2023-10-18T21:34:08.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.830+0000 7fc0fa59c700 1 -- 172.21.15.8:0/3584299391 learned_addr learned my addr 172.21.15.8:0/3584299391 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:08.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.830+0000 7fc0f9d9b700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0f77d0 0x7fc0fc109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:08.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.830+0000 7fc0fa59c700 1 -- 172.21.15.8:0/3584299391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0f77d0 msgr2=0x7fc0fc109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:08.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.830+0000 7fc0fa59c700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0f77d0 0x7fc0fc109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:08.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.830+0000 7fc0fa59c700 1 -- 172.21.15.8:0/3584299391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec005040 con 0x7fc0fc0f6530 2023-10-18T21:34:08.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.830+0000 7fc0fa59c700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0fc0f6530 0x7fc0fc108f60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fc0ec014040 tx=0x7fc0ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.830+0000 7fc0eaffd700 1 -- 172.21.15.8:0/3584299391 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0ec019070 con 0x7fc0fc0f6530 2023-10-18T21:34:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.831+0000 7fc0eaffd700 1 -- 172.21.15.8:0/3584299391 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc0ec01e420 con 0x7fc0fc0f6530 2023-10-18T21:34:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.831+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3584299391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0fc10a480 con 0x7fc0fc0f6530 2023-10-18T21:34:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.831+0000 7fc0eaffd700 1 -- 172.21.15.8:0/3584299391 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0ec014660 con 0x7fc0fc0f6530 2023-10-18T21:34:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.831+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3584299391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc10a960 con 0x7fc0fc0f6530 2023-10-18T21:34:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.832+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3584299391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0fc045ad0 con 0x7fc0fc0f6530 2023-10-18T21:34:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.833+0000 7fc0eaffd700 1 -- 172.21.15.8:0/3584299391 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc0ec01e9e0 con 0x7fc0fc0f6530 2023-10-18T21:34:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.833+0000 7fc0eaffd700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0e4060f70 0x7fc0e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.834+0000 7fc0eaffd700 1 -- 172.21.15.8:0/3584299391 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc0ec07de90 con 0x7fc0fc0f6530 2023-10-18T21:34:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.834+0000 7fc0f9d9b700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0e4060f70 0x7fc0e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.834+0000 7fc0f9d9b700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0e4060f70 0x7fc0e4063430 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fc0f0007f80 tx=0x7fc0f000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:08.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:08.839+0000 7fc0eaffd700 1 -- 172.21.15.8:0/3584299391 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc0ec051470 con 0x7fc0fc0f6530 2023-10-18T21:34:09.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.037+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3584299391 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0fc0fc150 con 0x7fc0e4060f70 2023-10-18T21:34:09.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.038+0000 7fc0eaffd700 1 -- 172.21.15.8:0/3584299391 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc0fc0fc150 con 0x7fc0e4060f70 2023-10-18T21:34:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3584299391 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0e4060f70 msgr2=0x7fc0e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0e4060f70 0x7fc0e4063430 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fc0f0007f80 tx=0x7fc0f000b040).stop 2023-10-18T21:34:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3584299391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0fc0f6530 msgr2=0x7fc0fc108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0fc0f6530 0x7fc0fc108f60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fc0ec014040 tx=0x7fc0ec00b040).stop 2023-10-18T21:34:09.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3584299391 shutdown_connections 2023-10-18T21:34:09.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc0e4060f70 0x7fc0e4063430 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0fc0f6530 0x7fc0fc108f60 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 --2- 172.21.15.8:0/3584299391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0f77d0 0x7fc0fc109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3584299391 >> 172.21.15.8:0/3584299391 conn(0x7fc0fc0f1c90 msgr2=0x7fc0fc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:09.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3584299391 shutdown_connections 2023-10-18T21:34:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.040+0000 7fc0fb59e700 1 -- 172.21.15.8:0/3584299391 wait complete. 2023-10-18T21:34:09.056 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:34:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.178+0000 7f491ab1f700 1 -- 172.21.15.8:0/3900788886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49140f6530 msgr2=0x7f49140f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.178+0000 7f491ab1f700 1 --2- 172.21.15.8:0/3900788886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49140f6530 0x7f49140f6950 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f4910004660 tx=0x7f4910009b30).stop 2023-10-18T21:34:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.178+0000 7f491ab1f700 1 -- 172.21.15.8:0/3900788886 shutdown_connections 2023-10-18T21:34:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.178+0000 7f491ab1f700 1 --2- 172.21.15.8:0/3900788886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49140f77d0 0x7f49140f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.178+0000 7f491ab1f700 1 --2- 172.21.15.8:0/3900788886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49140f6530 0x7f49140f6950 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.178+0000 7f491ab1f700 1 -- 172.21.15.8:0/3900788886 >> 172.21.15.8:0/3900788886 conn(0x7f49140f1c90 msgr2=0x7f49140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.178+0000 7f491ab1f700 1 -- 172.21.15.8:0/3900788886 shutdown_connections 2023-10-18T21:34:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.178+0000 7f491ab1f700 1 -- 172.21.15.8:0/3900788886 wait complete. 2023-10-18T21:34:09.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.179+0000 7f491ab1f700 1 Processor -- start 2023-10-18T21:34:09.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.179+0000 7f491ab1f700 1 -- start start 2023-10-18T21:34:09.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.179+0000 7f491ab1f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49140f6530 0x7f4914106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:09.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.179+0000 7f491ab1f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49140f77d0 0x7f4914107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:09.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.179+0000 7f491ab1f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914107880 con 0x7f49140f77d0 2023-10-18T21:34:09.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.179+0000 7f491ab1f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49141080c0 con 0x7f49140f6530 2023-10-18T21:34:09.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f491931c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49140f77d0 0x7f4914107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:09.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f491931c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49140f77d0 0x7f4914107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36592/0 (socket says 172.21.15.8:36592) 2023-10-18T21:34:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f491931c700 1 -- 172.21.15.8:0/1474794927 learned_addr learned my addr 172.21.15.8:0/1474794927 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f4919b1d700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49140f6530 0x7f4914106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f491931c700 1 -- 172.21.15.8:0/1474794927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49140f6530 msgr2=0x7f4914106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f491931c700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49140f6530 0x7f4914106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f491931c700 1 -- 172.21.15.8:0/1474794927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4910005040 con 0x7f49140f77d0 2023-10-18T21:34:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f491931c700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49140f77d0 0x7f4914107280 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f4904002700 tx=0x7f4904009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f490a7fc700 1 -- 172.21.15.8:0/1474794927 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4904009320 con 0x7f49140f77d0 2023-10-18T21:34:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f491ab1f700 1 -- 172.21.15.8:0/1474794927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49141083a0 con 0x7f49140f77d0 2023-10-18T21:34:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.180+0000 7f490a7fc700 1 -- 172.21.15.8:0/1474794927 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f490400f040 con 0x7f49140f77d0 2023-10-18T21:34:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.181+0000 7f490a7fc700 1 -- 172.21.15.8:0/1474794927 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49040148f0 con 0x7f49140f77d0 2023-10-18T21:34:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.181+0000 7f491ab1f700 1 -- 172.21.15.8:0/1474794927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49141088e0 con 0x7f49140f77d0 2023-10-18T21:34:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.182+0000 7f491ab1f700 1 -- 172.21.15.8:0/1474794927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4914059100 con 0x7f49140f77d0 2023-10-18T21:34:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.183+0000 7f490a7fc700 1 -- 172.21.15.8:0/1474794927 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4904009480 con 0x7f49140f77d0 2023-10-18T21:34:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.183+0000 7f490a7fc700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4900060f70 0x7f4900063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.183+0000 7f490a7fc700 1 -- 172.21.15.8:0/1474794927 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f490407cc50 con 0x7f49140f77d0 2023-10-18T21:34:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.184+0000 7f4919b1d700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4900060f70 0x7f4900063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.184+0000 7f4919b1d700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4900060f70 0x7f4900063430 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f4914107b50 tx=0x7f4910009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.188+0000 7f490a7fc700 1 -- 172.21.15.8:0/1474794927 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f490404c800 con 0x7f49140f77d0 2023-10-18T21:34:09.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.386+0000 7f491ab1f700 1 -- 172.21.15.8:0/1474794927 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49140feda0 con 0x7f4900060f70 2023-10-18T21:34:09.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.387+0000 7f490a7fc700 1 -- 172.21.15.8:0/1474794927 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f49140feda0 con 0x7f4900060f70 2023-10-18T21:34:09.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 -- 172.21.15.8:0/1474794927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4900060f70 msgr2=0x7f4900063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4900060f70 0x7f4900063430 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f4914107b50 tx=0x7f4910009b30).stop 2023-10-18T21:34:09.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 -- 172.21.15.8:0/1474794927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49140f77d0 msgr2=0x7f4914107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49140f77d0 0x7f4914107280 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f4904002700 tx=0x7f4904009e00).stop 2023-10-18T21:34:09.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 -- 172.21.15.8:0/1474794927 shutdown_connections 2023-10-18T21:34:09.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4900060f70 0x7f4900063430 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49140f6530 0x7f4914106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 --2- 172.21.15.8:0/1474794927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49140f77d0 0x7f4914107280 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 -- 172.21.15.8:0/1474794927 >> 172.21.15.8:0/1474794927 conn(0x7f49140f1c90 msgr2=0x7f49140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:09.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 -- 172.21.15.8:0/1474794927 shutdown_connections 2023-10-18T21:34:09.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.390+0000 7f491ab1f700 1 -- 172.21.15.8:0/1474794927 wait complete. 2023-10-18T21:34:09.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.526+0000 7f817c8d6700 1 -- 172.21.15.8:0/282290119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81780f77d0 msgr2=0x7f81780f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.526+0000 7f817c8d6700 1 --2- 172.21.15.8:0/282290119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81780f77d0 0x7f81780f7c30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f816c004660 tx=0x7f816c009b30).stop 2023-10-18T21:34:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.526+0000 7f817c8d6700 1 -- 172.21.15.8:0/282290119 shutdown_connections 2023-10-18T21:34:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.526+0000 7f817c8d6700 1 --2- 172.21.15.8:0/282290119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81780f77d0 0x7f81780f7c30 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.526+0000 7f817c8d6700 1 --2- 172.21.15.8:0/282290119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81780f6530 0x7f81780f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.526+0000 7f817c8d6700 1 -- 172.21.15.8:0/282290119 >> 172.21.15.8:0/282290119 conn(0x7f81780f1c90 msgr2=0x7f81780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:09.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.526+0000 7f817c8d6700 1 -- 172.21.15.8:0/282290119 shutdown_connections 2023-10-18T21:34:09.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.526+0000 7f817c8d6700 1 -- 172.21.15.8:0/282290119 wait complete. 2023-10-18T21:34:09.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.527+0000 7f817c8d6700 1 Processor -- start 2023-10-18T21:34:09.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.527+0000 7f817c8d6700 1 -- start start 2023-10-18T21:34:09.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.528+0000 7f817c8d6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81780f6530 0x7f8178106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:09.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.528+0000 7f817c8d6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81780f77d0 0x7f8178107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:09.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.528+0000 7f817c8d6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8178107880 con 0x7f81780f6530 2023-10-18T21:34:09.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.528+0000 7f817c8d6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81781080c0 con 0x7f81780f77d0 2023-10-18T21:34:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.528+0000 7f8176d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81780f6530 0x7f8178106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.528+0000 7f8176d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81780f6530 0x7f8178106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36604/0 (socket says 172.21.15.8:36604) 2023-10-18T21:34:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.528+0000 7f8176d9d700 1 -- 172.21.15.8:0/3828636985 learned_addr learned my addr 172.21.15.8:0/3828636985 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.528+0000 7f817659c700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81780f77d0 0x7f8178107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:09.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.528+0000 7f8176d9d700 1 -- 172.21.15.8:0/3828636985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81780f77d0 msgr2=0x7f8178107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.528+0000 7f8176d9d700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81780f77d0 0x7f8178107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.529+0000 7f8176d9d700 1 -- 172.21.15.8:0/3828636985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c005040 con 0x7f81780f6530 2023-10-18T21:34:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.529+0000 7f8176d9d700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81780f6530 0x7f8178106d90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f8168002700 tx=0x7f8168009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.529+0000 7f815f7fe700 1 -- 172.21.15.8:0/3828636985 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81680079c0 con 0x7f81780f6530 2023-10-18T21:34:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.529+0000 7f815f7fe700 1 -- 172.21.15.8:0/3828636985 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f816800f040 con 0x7f81780f6530 2023-10-18T21:34:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.529+0000 7f817c8d6700 1 -- 172.21.15.8:0/3828636985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81781083a0 con 0x7f81780f6530 2023-10-18T21:34:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.529+0000 7f815f7fe700 1 -- 172.21.15.8:0/3828636985 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81680148d0 con 0x7f81780f6530 2023-10-18T21:34:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.529+0000 7f817c8d6700 1 -- 172.21.15.8:0/3828636985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81781088e0 con 0x7f81780f6530 2023-10-18T21:34:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.530+0000 7f817c8d6700 1 -- 172.21.15.8:0/3828636985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8178059100 con 0x7f81780f6530 2023-10-18T21:34:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.531+0000 7f815f7fe700 1 -- 172.21.15.8:0/3828636985 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f816801b060 con 0x7f81780f6530 2023-10-18T21:34:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.532+0000 7f815f7fe700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8160060f70 0x7f8160063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:09.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.532+0000 7f815f7fe700 1 -- 172.21.15.8:0/3828636985 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f816807c7d0 con 0x7f81780f6530 2023-10-18T21:34:09.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.532+0000 7f817659c700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8160060f70 0x7f8160063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:09.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.533+0000 7f817659c700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8160060f70 0x7f8160063430 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f816c004630 tx=0x7f816c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:09.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.536+0000 7f815f7fe700 1 -- 172.21.15.8:0/3828636985 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f816804c380 con 0x7f81780f6530 2023-10-18T21:34:09.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.726+0000 7f817c8d6700 1 -- 172.21.15.8:0/3828636985 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f81780fedd0 con 0x7f8160060f70 2023-10-18T21:34:09.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.736+0000 7f815f7fe700 1 -- 172.21.15.8:0/3828636985 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f81780fedd0 con 0x7f8160060f70 2023-10-18T21:34:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:34:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (40m) 8m ago 42m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:34:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (34m) 8m ago 42m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:34:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (34m) 6m ago 41m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:34:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (40m) 8m ago 41m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:34:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 38m - - 2023-10-18T21:34:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 38m - - 2023-10-18T21:34:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 38m - - 2023-10-18T21:34:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 38m - - 2023-10-18T21:34:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (35m) 8m ago 43m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:34:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (35m) 6m ago 41m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:34:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (35m) 8m ago 43m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:34:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (34m) 6m ago 41m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:34:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (41m) 8m ago 41m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:34:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (41m) 6m ago 41m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:34:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (34m) 8m ago 40m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:34:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (32m) 8m ago 40m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:34:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (31m) 8m ago 40m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:34:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (31m) 6m ago 39m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:34:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (30m) 6m ago 39m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:34:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (30m) 6m ago 39m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:34:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (36m) 8m ago 41m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:34:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 -- 172.21.15.8:0/3828636985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8160060f70 msgr2=0x7f8160063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8160060f70 0x7f8160063430 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f816c004630 tx=0x7f816c009b30).stop 2023-10-18T21:34:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 -- 172.21.15.8:0/3828636985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81780f6530 msgr2=0x7f8178106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81780f6530 0x7f8178106d90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f8168002700 tx=0x7f8168009d80).stop 2023-10-18T21:34:09.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 -- 172.21.15.8:0/3828636985 shutdown_connections 2023-10-18T21:34:09.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8160060f70 0x7f8160063430 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81780f6530 0x7f8178106d90 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 --2- 172.21.15.8:0/3828636985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81780f77d0 0x7f8178107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 -- 172.21.15.8:0/3828636985 >> 172.21.15.8:0/3828636985 conn(0x7f81780f1c90 msgr2=0x7f81780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:09.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 -- 172.21.15.8:0/3828636985 shutdown_connections 2023-10-18T21:34:09.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.738+0000 7f817c8d6700 1 -- 172.21.15.8:0/3828636985 wait complete. 2023-10-18T21:34:09.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.877+0000 7f5daad78700 1 -- 172.21.15.8:0/2814083411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5da406a3b0 msgr2=0x7f5da406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.877+0000 7f5daad78700 1 --2- 172.21.15.8:0/2814083411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5da406a3b0 0x7f5da406a830 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f5d94004660 tx=0x7f5d94009b30).stop 2023-10-18T21:34:09.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.877+0000 7f5daad78700 1 -- 172.21.15.8:0/2814083411 shutdown_connections 2023-10-18T21:34:09.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.877+0000 7f5daad78700 1 --2- 172.21.15.8:0/2814083411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5da406a3b0 0x7f5da406a830 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.877+0000 7f5daad78700 1 --2- 172.21.15.8:0/2814083411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5da406b9c0 0x7f5da4069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.877+0000 7f5daad78700 1 -- 172.21.15.8:0/2814083411 >> 172.21.15.8:0/2814083411 conn(0x7f5da40f1c70 msgr2=0x7f5da40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:09.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.877+0000 7f5daad78700 1 -- 172.21.15.8:0/2814083411 shutdown_connections 2023-10-18T21:34:09.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.878+0000 7f5daad78700 1 -- 172.21.15.8:0/2814083411 wait complete. 2023-10-18T21:34:09.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.879+0000 7f5daad78700 1 Processor -- start 2023-10-18T21:34:09.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.879+0000 7f5daad78700 1 -- start start 2023-10-18T21:34:09.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.879+0000 7f5daad78700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5da406a3b0 0x7f5da410d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:09.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.879+0000 7f5daad78700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5da406b9c0 0x7f5da410d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:09.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.879+0000 7f5daad78700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da410dd80 con 0x7f5da406a3b0 2023-10-18T21:34:09.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.879+0000 7f5daad78700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da410dec0 con 0x7f5da406b9c0 2023-10-18T21:34:09.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.880+0000 7f5da9d76700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5da406a3b0 0x7f5da410d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:09.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.880+0000 7f5da9d76700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5da406a3b0 0x7f5da410d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36616/0 (socket says 172.21.15.8:36616) 2023-10-18T21:34:09.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.880+0000 7f5da9d76700 1 -- 172.21.15.8:0/2421464481 learned_addr learned my addr 172.21.15.8:0/2421464481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:09.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.880+0000 7f5da9575700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5da406b9c0 0x7f5da410d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:09.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.880+0000 7f5da9d76700 1 -- 172.21.15.8:0/2421464481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5da406b9c0 msgr2=0x7f5da410d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:09.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.880+0000 7f5da9d76700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5da406b9c0 0x7f5da410d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:09.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.880+0000 7f5da9d76700 1 -- 172.21.15.8:0/2421464481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d94005040 con 0x7f5da406a3b0 2023-10-18T21:34:09.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.880+0000 7f5da9d76700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5da406a3b0 0x7f5da410d2e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f5da000e7f0 tx=0x7f5da000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.881+0000 7f5d9a7fc700 1 -- 172.21.15.8:0/2421464481 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5da00092e0 con 0x7f5da406a3b0 2023-10-18T21:34:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.881+0000 7f5d9a7fc700 1 -- 172.21.15.8:0/2421464481 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5da000f040 con 0x7f5da406a3b0 2023-10-18T21:34:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.881+0000 7f5daad78700 1 -- 172.21.15.8:0/2421464481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da410e860 con 0x7f5da406a3b0 2023-10-18T21:34:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.881+0000 7f5d9a7fc700 1 -- 172.21.15.8:0/2421464481 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5da00147e0 con 0x7f5da406a3b0 2023-10-18T21:34:09.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.881+0000 7f5daad78700 1 -- 172.21.15.8:0/2421464481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da410eda0 con 0x7f5da406a3b0 2023-10-18T21:34:09.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.882+0000 7f5daad78700 1 -- 172.21.15.8:0/2421464481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da4045ad0 con 0x7f5da406a3b0 2023-10-18T21:34:09.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.883+0000 7f5d9a7fc700 1 -- 172.21.15.8:0/2421464481 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5da001b030 con 0x7f5da406a3b0 2023-10-18T21:34:09.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.883+0000 7f5d9a7fc700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d90060f70 0x7f5d90063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:09.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.884+0000 7f5d9a7fc700 1 -- 172.21.15.8:0/2421464481 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5da007c740 con 0x7f5da406a3b0 2023-10-18T21:34:09.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.884+0000 7f5da9575700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d90060f70 0x7f5d90063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:09.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.884+0000 7f5da9575700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d90060f70 0x7f5d90063430 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f5d94009720 tx=0x7f5d9400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:09.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:09.888+0000 7f5d9a7fc700 1 -- 172.21.15.8:0/2421464481 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5da004fd70 con 0x7f5da406a3b0 2023-10-18T21:34:09.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:08.614525+0000 mgr.smithi008.flmjzp (mgr.14640) 2118 : cluster [DBG] pgmap v1464: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.139+0000 7f5daad78700 1 -- 172.21.15.8:0/2421464481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5da4105380 con 0x7f5da406a3b0 2023-10-18T21:34:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.140+0000 7f5d9a7fc700 1 -- 172.21.15.8:0/2421464481 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5da0019020 con 0x7f5da406a3b0 2023-10-18T21:34:10.141 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:34:10.141 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:34:10.141 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:34:10.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:34:10.142 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:34:10.142 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:34:10.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:34:10.142 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:34:10.143 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:34:10.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:34:10.143 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:34:10.143 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:34:10.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:34:10.143 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:34:10.144 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:34:10.144 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:34:10.144 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:34:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.141+0000 7f5daad78700 1 -- 172.21.15.8:0/2421464481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d90060f70 msgr2=0x7f5d90063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.141+0000 7f5daad78700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d90060f70 0x7f5d90063430 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f5d94009720 tx=0x7f5d9400b040).stop 2023-10-18T21:34:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.141+0000 7f5daad78700 1 -- 172.21.15.8:0/2421464481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5da406a3b0 msgr2=0x7f5da410d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.141+0000 7f5daad78700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5da406a3b0 0x7f5da410d2e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f5da000e7f0 tx=0x7f5da000b040).stop 2023-10-18T21:34:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.142+0000 7f5daad78700 1 -- 172.21.15.8:0/2421464481 shutdown_connections 2023-10-18T21:34:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.142+0000 7f5daad78700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d90060f70 0x7f5d90063430 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.142+0000 7f5daad78700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5da406a3b0 0x7f5da410d2e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.142+0000 7f5daad78700 1 --2- 172.21.15.8:0/2421464481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5da406b9c0 0x7f5da410d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.142+0000 7f5daad78700 1 -- 172.21.15.8:0/2421464481 >> 172.21.15.8:0/2421464481 conn(0x7f5da40f1c70 msgr2=0x7f5da40f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.142+0000 7f5daad78700 1 -- 172.21.15.8:0/2421464481 shutdown_connections 2023-10-18T21:34:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.142+0000 7f5daad78700 1 -- 172.21.15.8:0/2421464481 wait complete. 2023-10-18T21:34:10.168 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:08.614525+0000 mgr.smithi008.flmjzp (mgr.14640) 2118 : cluster [DBG] pgmap v1464: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.279+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/4219193179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3d80f6530 msgr2=0x7fb3d80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.279+0000 7fb3dc9d3700 1 --2- 172.21.15.8:0/4219193179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3d80f6530 0x7fb3d80f6950 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fb3c8004660 tx=0x7fb3c8009b30).stop 2023-10-18T21:34:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.279+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/4219193179 shutdown_connections 2023-10-18T21:34:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.279+0000 7fb3dc9d3700 1 --2- 172.21.15.8:0/4219193179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3d80f77d0 0x7fb3d80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.279+0000 7fb3dc9d3700 1 --2- 172.21.15.8:0/4219193179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3d80f6530 0x7fb3d80f6950 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.279+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/4219193179 >> 172.21.15.8:0/4219193179 conn(0x7fb3d80f1c90 msgr2=0x7fb3d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.279+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/4219193179 shutdown_connections 2023-10-18T21:34:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.280+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/4219193179 wait complete. 2023-10-18T21:34:10.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.280+0000 7fb3dc9d3700 1 Processor -- start 2023-10-18T21:34:10.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.280+0000 7fb3dc9d3700 1 -- start start 2023-10-18T21:34:10.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.281+0000 7fb3dc9d3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3d80f6530 0x7fb3d806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.281+0000 7fb3dc9d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3d80f77d0 0x7fb3d8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.281+0000 7fb3dc9d3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d806a380 con 0x7fb3d80f6530 2023-10-18T21:34:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.281+0000 7fb3dc9d3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d806a4c0 con 0x7fb3d80f77d0 2023-10-18T21:34:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.281+0000 7fb3d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3d80f6530 0x7fb3d806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.281+0000 7fb3d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3d80f6530 0x7fb3d806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36638/0 (socket says 172.21.15.8:36638) 2023-10-18T21:34:10.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.281+0000 7fb3d77fe700 1 -- 172.21.15.8:0/808611193 learned_addr learned my addr 172.21.15.8:0/808611193 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:10.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.281+0000 7fb3d6ffd700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3d80f77d0 0x7fb3d8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:10.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.281+0000 7fb3d77fe700 1 -- 172.21.15.8:0/808611193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3d80f77d0 msgr2=0x7fb3d8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:10.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.281+0000 7fb3d77fe700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3d80f77d0 0x7fb3d8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.282+0000 7fb3d77fe700 1 -- 172.21.15.8:0/808611193 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c8005040 con 0x7fb3d80f6530 2023-10-18T21:34:10.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.282+0000 7fb3d77fe700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3d80f6530 0x7fb3d806b9a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fb3c8007a60 tx=0x7fb3c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:10.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.282+0000 7fb3bffff700 1 -- 172.21.15.8:0/808611193 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3c8018070 con 0x7fb3d80f6530 2023-10-18T21:34:10.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.282+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/808611193 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d806a740 con 0x7fb3d80f6530 2023-10-18T21:34:10.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.282+0000 7fb3bffff700 1 -- 172.21.15.8:0/808611193 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb3c8009630 con 0x7fb3d80f6530 2023-10-18T21:34:10.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.282+0000 7fb3bffff700 1 -- 172.21.15.8:0/808611193 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3c801c4d0 con 0x7fb3d80f6530 2023-10-18T21:34:10.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.282+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/808611193 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d806aca0 con 0x7fb3d80f6530 2023-10-18T21:34:10.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.283+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/808611193 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d8045ad0 con 0x7fb3d80f6530 2023-10-18T21:34:10.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.284+0000 7fb3bffff700 1 -- 172.21.15.8:0/808611193 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb3c801d420 con 0x7fb3d80f6530 2023-10-18T21:34:10.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.285+0000 7fb3bffff700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3c0060f70 0x7fb3c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:10.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.285+0000 7fb3bffff700 1 -- 172.21.15.8:0/808611193 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb3c807e550 con 0x7fb3d80f6530 2023-10-18T21:34:10.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.285+0000 7fb3d6ffd700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3c0060f70 0x7fb3c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:10.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.286+0000 7fb3d6ffd700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3c0060f70 0x7fb3c0063430 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fb3cc004e20 tx=0x7fb3cc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.289+0000 7fb3bffff700 1 -- 172.21.15.8:0/808611193 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb3c804e180 con 0x7fb3d80f6530 2023-10-18T21:34:10.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.518+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/808611193 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb3d80fee00 con 0x7fb3d80f6530 2023-10-18T21:34:10.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.518+0000 7fb3bffff700 1 -- 172.21.15.8:0/808611193 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fb3c80517a0 con 0x7fb3d80f6530 2023-10-18T21:34:10.520 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:34:10.520 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:34:10.520 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:34:10.520 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:34:10.521 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:34:10.521 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:34:10.521 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:34:10.521 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:34:10.521 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:34:10.522 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:34:10.522 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:34:10.522 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:34:10.522 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:34:10.522 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:34:10.523 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:34:10.523 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:34:10.523 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:34:10.523 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:34:10.524 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:34:10.524 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:34:10.524 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:34:10.524 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:34:10.524 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:34:10.525 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:34:10.525 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:34:10.525 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:34:10.525 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:34:10.526 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:34:10.526 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:34:10.526 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:34:10.526 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:34:10.527 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:34:10.527 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:34:10.527 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:34:10.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/808611193 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3c0060f70 msgr2=0x7fb3c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:10.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3c0060f70 0x7fb3c0063430 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fb3cc004e20 tx=0x7fb3cc00b040).stop 2023-10-18T21:34:10.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/808611193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3d80f6530 msgr2=0x7fb3d806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:10.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3d80f6530 0x7fb3d806b9a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fb3c8007a60 tx=0x7fb3c8009b30).stop 2023-10-18T21:34:10.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/808611193 shutdown_connections 2023-10-18T21:34:10.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3c0060f70 0x7fb3c0063430 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3d80f6530 0x7fb3d806b9a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 --2- 172.21.15.8:0/808611193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3d80f77d0 0x7fb3d8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/808611193 >> 172.21.15.8:0/808611193 conn(0x7fb3d80f1c90 msgr2=0x7fb3d80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:10.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/808611193 shutdown_connections 2023-10-18T21:34:10.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.520+0000 7fb3dc9d3700 1 -- 172.21.15.8:0/808611193 wait complete. 2023-10-18T21:34:10.530 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:34:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.658+0000 7fc59705c700 1 -- 172.21.15.8:0/1413302714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5900f6530 msgr2=0x7fc5900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.658+0000 7fc59705c700 1 --2- 172.21.15.8:0/1413302714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5900f6530 0x7fc5900f6950 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fc58c004660 tx=0x7fc58c009b30).stop 2023-10-18T21:34:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.658+0000 7fc59705c700 1 -- 172.21.15.8:0/1413302714 shutdown_connections 2023-10-18T21:34:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.658+0000 7fc59705c700 1 --2- 172.21.15.8:0/1413302714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5900f77d0 0x7fc5900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:34:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.658+0000 7fc59705c700 1 --2- 172.21.15.8:0/1413302714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5900f6530 0x7fc5900f6950 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.658+0000 7fc59705c700 1 -- 172.21.15.8:0/1413302714 >> 172.21.15.8:0/1413302714 conn(0x7fc5900f1cd0 msgr2=0x7fc5900f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:10.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.658+0000 7fc59705c700 1 -- 172.21.15.8:0/1413302714 shutdown_connections 2023-10-18T21:34:10.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.658+0000 7fc59705c700 1 -- 172.21.15.8:0/1413302714 wait complete. 2023-10-18T21:34:10.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.659+0000 7fc59705c700 1 Processor -- start 2023-10-18T21:34:10.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.659+0000 7fc59705c700 1 -- start start 2023-10-18T21:34:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc59705c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5900f6530 0x7fc590106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc59705c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5900f77d0 0x7fc5901072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc59705c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc590107940 con 0x7fc5900f6530 2023-10-18T21:34:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc59705c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5901080f0 con 0x7fc5900f77d0 2023-10-18T21:34:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc59605a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5900f6530 0x7fc590106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc59605a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5900f6530 0x7fc590106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36656/0 (socket says 172.21.15.8:36656) 2023-10-18T21:34:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc59605a700 1 -- 172.21.15.8:0/2704597509 learned_addr learned my addr 172.21.15.8:0/2704597509 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc595859700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5900f77d0 0x7fc5901072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc59605a700 1 -- 172.21.15.8:0/2704597509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5900f77d0 msgr2=0x7fc5901072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc59605a700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5900f77d0 0x7fc5901072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.660+0000 7fc59605a700 1 -- 172.21.15.8:0/2704597509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c005040 con 0x7fc5900f6530 2023-10-18T21:34:10.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.661+0000 7fc59605a700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5900f6530 0x7fc590106dc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fc58c009f50 tx=0x7fc58c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:10.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.661+0000 7fc586ffd700 1 -- 172.21.15.8:0/2704597509 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc58c018070 con 0x7fc5900f6530 2023-10-18T21:34:10.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.661+0000 7fc59705c700 1 -- 172.21.15.8:0/2704597509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc590108370 con 0x7fc5900f6530 2023-10-18T21:34:10.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.661+0000 7fc586ffd700 1 -- 172.21.15.8:0/2704597509 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc58c01d8e0 con 0x7fc5900f6530 2023-10-18T21:34:10.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.661+0000 7fc59705c700 1 -- 172.21.15.8:0/2704597509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5901088d0 con 0x7fc5900f6530 2023-10-18T21:34:10.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.661+0000 7fc586ffd700 1 -- 172.21.15.8:0/2704597509 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc58c01c530 con 0x7fc5900f6530 2023-10-18T21:34:10.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.662+0000 7fc59705c700 1 -- 172.21.15.8:0/2704597509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc590059100 con 0x7fc5900f6530 2023-10-18T21:34:10.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.663+0000 7fc586ffd700 1 -- 172.21.15.8:0/2704597509 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc58c01d420 con 0x7fc5900f6530 2023-10-18T21:34:10.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.664+0000 7fc586ffd700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc57c060f70 0x7fc57c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.664+0000 7fc586ffd700 1 -- 172.21.15.8:0/2704597509 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc58c07e820 con 0x7fc5900f6530 2023-10-18T21:34:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.664+0000 7fc595859700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc57c060f70 0x7fc57c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.665+0000 7fc595859700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc57c060f70 0x7fc57c063430 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fc590106b50 tx=0x7fc580008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.668+0000 7fc586ffd700 1 -- 172.21.15.8:0/2704597509 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc58c04e3d0 con 0x7fc5900f6530 2023-10-18T21:34:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.867+0000 7fc59705c700 1 -- 172.21.15.8:0/2704597509 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5900fedb0 con 0x7fc57c060f70 2023-10-18T21:34:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.868+0000 7fc586ffd700 1 -- 172.21.15.8:0/2704597509 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc5900fedb0 con 0x7fc57c060f70 2023-10-18T21:34:10.869 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:34:10.869 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:34:10.869 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:34:10.869 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:34:10.869 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:34:10.870 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:34:10.870 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:34:10.870 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:34:10.870 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:34:10.870 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:34:10.871 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:34:10.871 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:34:10.871 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:34:10.871 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:34:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 -- 172.21.15.8:0/2704597509 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc57c060f70 msgr2=0x7fc57c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc57c060f70 0x7fc57c063430 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fc590106b50 tx=0x7fc580008040).stop 2023-10-18T21:34:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 -- 172.21.15.8:0/2704597509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5900f6530 msgr2=0x7fc590106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5900f6530 0x7fc590106dc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fc58c009f50 tx=0x7fc58c009b30).stop 2023-10-18T21:34:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 -- 172.21.15.8:0/2704597509 shutdown_connections 2023-10-18T21:34:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc57c060f70 0x7fc57c063430 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5900f6530 0x7fc590106dc0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 --2- 172.21.15.8:0/2704597509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5900f77d0 0x7fc5901072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 -- 172.21.15.8:0/2704597509 >> 172.21.15.8:0/2704597509 conn(0x7fc5900f1cd0 msgr2=0x7fc5900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:10.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 -- 172.21.15.8:0/2704597509 shutdown_connections 2023-10-18T21:34:10.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:10.870+0000 7fc59705c700 1 -- 172.21.15.8:0/2704597509 wait complete. 2023-10-18T21:34:10.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:09.039292+0000 mgr.smithi008.flmjzp (mgr.14640) 2119 : audit [DBG] from='client.35848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:09.388535+0000 mgr.smithi008.flmjzp (mgr.14640) 2120 : audit [DBG] from='client.35852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:09.728127+0000 mgr.smithi008.flmjzp (mgr.14640) 2121 : audit [DBG] from='client.35856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:10.140146+0000 mon.smithi008 (mon.0) 2555 : audit [DBG] from='client.? 172.21.15.8:0/2421464481' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:10.518917+0000 mon.smithi008 (mon.0) 2556 : audit [DBG] from='client.? 172.21.15.8:0/808611193' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:34:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:09.039292+0000 mgr.smithi008.flmjzp (mgr.14640) 2119 : audit [DBG] from='client.35848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:09.388535+0000 mgr.smithi008.flmjzp (mgr.14640) 2120 : audit [DBG] from='client.35852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:09.728127+0000 mgr.smithi008.flmjzp (mgr.14640) 2121 : audit [DBG] from='client.35856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:10.140146+0000 mon.smithi008 (mon.0) 2555 : audit [DBG] from='client.? 172.21.15.8:0/2421464481' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:10.518917+0000 mon.smithi008 (mon.0) 2556 : audit [DBG] from='client.? 172.21.15.8:0/808611193' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:34:11.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:10.615425+0000 mgr.smithi008.flmjzp (mgr.14640) 2122 : cluster [DBG] pgmap v1465: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:11.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:10.868224+0000 mgr.smithi008.flmjzp (mgr.14640) 2123 : audit [DBG] from='client.35868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:10.615425+0000 mgr.smithi008.flmjzp (mgr.14640) 2122 : cluster [DBG] pgmap v1465: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:10.868224+0000 mgr.smithi008.flmjzp (mgr.14640) 2123 : audit [DBG] from='client.35868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:12.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:12.637848+0000 mon.smithi008 (mon.0) 2557 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:12.639900+0000 mon.smithi008 (mon.0) 2558 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:12.640887+0000 mon.smithi008 (mon.0) 2559 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:12.647602+0000 mon.smithi008 (mon.0) 2560 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:12.654102+0000 mon.smithi008 (mon.0) 2561 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:12.657187+0000 mon.smithi008 (mon.0) 2562 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:12.658897+0000 mon.smithi008 (mon.0) 2563 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:12.660566+0000 mon.smithi008 (mon.0) 2564 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:12.662538+0000 mon.smithi008 (mon.0) 2565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:12.637848+0000 mon.smithi008 (mon.0) 2557 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:12.639900+0000 mon.smithi008 (mon.0) 2558 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:13.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:12.640887+0000 mon.smithi008 (mon.0) 2559 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:13.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:12.647602+0000 mon.smithi008 (mon.0) 2560 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:13.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:12.654102+0000 mon.smithi008 (mon.0) 2561 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:13.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:12.657187+0000 mon.smithi008 (mon.0) 2562 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:13.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:12.658897+0000 mon.smithi008 (mon.0) 2563 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:13.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:12.660566+0000 mon.smithi008 (mon.0) 2564 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:13.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:12.662538+0000 mon.smithi008 (mon.0) 2565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:12.616067+0000 mgr.smithi008.flmjzp (mgr.14640) 2124 : cluster [DBG] pgmap v1466: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:12.641759+0000 mgr.smithi008.flmjzp (mgr.14640) 2125 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:12.642388+0000 mgr.smithi008.flmjzp (mgr.14640) 2126 : cluster [DBG] pgmap v1467: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:12.642716+0000 mgr.smithi008.flmjzp (mgr.14640) 2127 : cluster [DBG] pgmap v1468: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:13.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:12.664472+0000 mgr.smithi008.flmjzp (mgr.14640) 2128 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:13.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:12.616067+0000 mgr.smithi008.flmjzp (mgr.14640) 2124 : cluster [DBG] pgmap v1466: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:12.641759+0000 mgr.smithi008.flmjzp (mgr.14640) 2125 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:12.642388+0000 mgr.smithi008.flmjzp (mgr.14640) 2126 : cluster [DBG] pgmap v1467: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:12.642716+0000 mgr.smithi008.flmjzp (mgr.14640) 2127 : cluster [DBG] pgmap v1468: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:12.664472+0000 mgr.smithi008.flmjzp (mgr.14640) 2128 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:15.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:14.643259+0000 mgr.smithi008.flmjzp (mgr.14640) 2129 : cluster [DBG] pgmap v1469: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:14.643259+0000 mgr.smithi008.flmjzp (mgr.14640) 2129 : cluster [DBG] pgmap v1469: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:17.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:16.643843+0000 mgr.smithi008.flmjzp (mgr.14640) 2130 : cluster [DBG] pgmap v1470: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:18.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:16.643843+0000 mgr.smithi008.flmjzp (mgr.14640) 2130 : cluster [DBG] pgmap v1470: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:18.644607+0000 mgr.smithi008.flmjzp (mgr.14640) 2131 : cluster [DBG] pgmap v1471: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:20.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:18.644607+0000 mgr.smithi008.flmjzp (mgr.14640) 2131 : cluster [DBG] pgmap v1471: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:21.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:20.645162+0000 mgr.smithi008.flmjzp (mgr.14640) 2132 : cluster [DBG] pgmap v1472: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:20.645162+0000 mgr.smithi008.flmjzp (mgr.14640) 2132 : cluster [DBG] pgmap v1472: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:22.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:22.675038+0000 mon.smithi008 (mon.0) 2566 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:22.677232+0000 mon.smithi008 (mon.0) 2567 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:22.678298+0000 mon.smithi008 (mon.0) 2568 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:22.685050+0000 mon.smithi008 (mon.0) 2569 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:22.691737+0000 mon.smithi008 (mon.0) 2570 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:22.694739+0000 mon.smithi008 (mon.0) 2571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:22.696409+0000 mon.smithi008 (mon.0) 2572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:22.700119+0000 mon.smithi008 (mon.0) 2573 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:22.702172+0000 mon.smithi008 (mon.0) 2574 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:22.675038+0000 mon.smithi008 (mon.0) 2566 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:22.677232+0000 mon.smithi008 (mon.0) 2567 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:22.678298+0000 mon.smithi008 (mon.0) 2568 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:22.685050+0000 mon.smithi008 (mon.0) 2569 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:22.691737+0000 mon.smithi008 (mon.0) 2570 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:22.694739+0000 mon.smithi008 (mon.0) 2571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:22.696409+0000 mon.smithi008 (mon.0) 2572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:23.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:22.700119+0000 mon.smithi008 (mon.0) 2573 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:23.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:22.702172+0000 mon.smithi008 (mon.0) 2574 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:22.645805+0000 mgr.smithi008.flmjzp (mgr.14640) 2133 : cluster [DBG] pgmap v1473: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:22.679231+0000 mgr.smithi008.flmjzp (mgr.14640) 2134 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:22.679879+0000 mgr.smithi008.flmjzp (mgr.14640) 2135 : cluster [DBG] pgmap v1474: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:22.680170+0000 mgr.smithi008.flmjzp (mgr.14640) 2136 : cluster [DBG] pgmap v1475: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:22.704144+0000 mgr.smithi008.flmjzp (mgr.14640) 2137 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:23.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:22.645805+0000 mgr.smithi008.flmjzp (mgr.14640) 2133 : cluster [DBG] pgmap v1473: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:23.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:22.679231+0000 mgr.smithi008.flmjzp (mgr.14640) 2134 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:22.679879+0000 mgr.smithi008.flmjzp (mgr.14640) 2135 : cluster [DBG] pgmap v1474: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:22.680170+0000 mgr.smithi008.flmjzp (mgr.14640) 2136 : cluster [DBG] pgmap v1475: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:22.704144+0000 mgr.smithi008.flmjzp (mgr.14640) 2137 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:25.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:24.680810+0000 mgr.smithi008.flmjzp (mgr.14640) 2138 : cluster [DBG] pgmap v1476: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:26.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:24.680810+0000 mgr.smithi008.flmjzp (mgr.14640) 2138 : cluster [DBG] pgmap v1476: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:26.681392+0000 mgr.smithi008.flmjzp (mgr.14640) 2139 : cluster [DBG] pgmap v1477: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:26.681392+0000 mgr.smithi008.flmjzp (mgr.14640) 2139 : cluster [DBG] pgmap v1477: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:30.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:28.681931+0000 mgr.smithi008.flmjzp (mgr.14640) 2140 : cluster [DBG] pgmap v1478: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:30.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:28.681931+0000 mgr.smithi008.flmjzp (mgr.14640) 2140 : cluster [DBG] pgmap v1478: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:31.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:30.682596+0000 mgr.smithi008.flmjzp (mgr.14640) 2141 : cluster [DBG] pgmap v1479: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:30.682596+0000 mgr.smithi008.flmjzp (mgr.14640) 2141 : cluster [DBG] pgmap v1479: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:32.706405+0000 mon.smithi008 (mon.0) 2575 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:33.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:32.706405+0000 mon.smithi008 (mon.0) 2575 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:32.683148+0000 mgr.smithi008.flmjzp (mgr.14640) 2142 : cluster [DBG] pgmap v1480: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:33.266882+0000 mon.smithi008 (mon.0) 2576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:33.268151+0000 mon.smithi008 (mon.0) 2577 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:33.273538+0000 mon.smithi008 (mon.0) 2578 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:33.278385+0000 mon.smithi008 (mon.0) 2579 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:33.280798+0000 mon.smithi008 (mon.0) 2580 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:33.282085+0000 mon.smithi008 (mon.0) 2581 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:33.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:33.283295+0000 mon.smithi008 (mon.0) 2582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:33.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:33.284834+0000 mon.smithi008 (mon.0) 2583 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:34.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:32.683148+0000 mgr.smithi008.flmjzp (mgr.14640) 2142 : cluster [DBG] pgmap v1480: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:33.266882+0000 mon.smithi008 (mon.0) 2576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:33.268151+0000 mon.smithi008 (mon.0) 2577 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:33.273538+0000 mon.smithi008 (mon.0) 2578 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:33.278385+0000 mon.smithi008 (mon.0) 2579 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:33.280798+0000 mon.smithi008 (mon.0) 2580 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:33.282085+0000 mon.smithi008 (mon.0) 2581 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:33.283295+0000 mon.smithi008 (mon.0) 2582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:33.284834+0000 mon.smithi008 (mon.0) 2583 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:35.161 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:33.268856+0000 mgr.smithi008.flmjzp (mgr.14640) 2143 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:35.162 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:33.269399+0000 mgr.smithi008.flmjzp (mgr.14640) 2144 : cluster [DBG] pgmap v1481: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:35.162 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:33.269592+0000 mgr.smithi008.flmjzp (mgr.14640) 2145 : cluster [DBG] pgmap v1482: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:35.162 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:33.286355+0000 mgr.smithi008.flmjzp (mgr.14640) 2146 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:35.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:33.268856+0000 mgr.smithi008.flmjzp (mgr.14640) 2143 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:33.269399+0000 mgr.smithi008.flmjzp (mgr.14640) 2144 : cluster [DBG] pgmap v1481: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:33.269592+0000 mgr.smithi008.flmjzp (mgr.14640) 2145 : cluster [DBG] pgmap v1482: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:33.286355+0000 mgr.smithi008.flmjzp (mgr.14640) 2146 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:35.270073+0000 mgr.smithi008.flmjzp (mgr.14640) 2147 : cluster [DBG] pgmap v1483: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:37.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:35.270073+0000 mgr.smithi008.flmjzp (mgr.14640) 2147 : cluster [DBG] pgmap v1483: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:37.270606+0000 mgr.smithi008.flmjzp (mgr.14640) 2148 : cluster [DBG] pgmap v1484: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:39.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:37.270606+0000 mgr.smithi008.flmjzp (mgr.14640) 2148 : cluster [DBG] pgmap v1484: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:41.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.022+0000 7f695d4e4700 1 -- 172.21.15.8:0/123832182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69580f77d0 msgr2=0x7f69580f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.022+0000 7f695d4e4700 1 --2- 172.21.15.8:0/123832182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69580f77d0 0x7f69580f7c30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f694c004660 tx=0x7f694c009b30).stop 2023-10-18T21:34:41.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.023+0000 7f695d4e4700 1 -- 172.21.15.8:0/123832182 shutdown_connections 2023-10-18T21:34:41.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.023+0000 7f695d4e4700 1 --2- 172.21.15.8:0/123832182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69580f77d0 0x7f69580f7c30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.023+0000 7f695d4e4700 1 --2- 172.21.15.8:0/123832182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69580f6530 0x7f69580f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.023+0000 7f695d4e4700 1 -- 172.21.15.8:0/123832182 >> 172.21.15.8:0/123832182 conn(0x7f69580f1c90 msgr2=0x7f69580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:41.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.023+0000 7f695d4e4700 1 -- 172.21.15.8:0/123832182 shutdown_connections 2023-10-18T21:34:41.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.023+0000 7f695d4e4700 1 -- 172.21.15.8:0/123832182 wait complete. 2023-10-18T21:34:41.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.023+0000 7f695d4e4700 1 Processor -- start 2023-10-18T21:34:41.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.024+0000 7f695d4e4700 1 -- start start 2023-10-18T21:34:41.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.024+0000 7f695d4e4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69580f6530 0x7f6958108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:41.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.024+0000 7f695d4e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69580f77d0 0x7f6958109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:41.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.024+0000 7f695d4e4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6958109a20 con 0x7f69580f6530 2023-10-18T21:34:41.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.024+0000 7f695d4e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6958109b60 con 0x7f69580f77d0 2023-10-18T21:34:41.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.024+0000 7f6957fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69580f6530 0x7f6958108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:41.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.024+0000 7f6957fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69580f6530 0x7f6958108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53616/0 (socket says 172.21.15.8:53616) 2023-10-18T21:34:41.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.024+0000 7f6957fff700 1 -- 172.21.15.8:0/2672741112 learned_addr learned my addr 172.21.15.8:0/2672741112 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:41.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.024+0000 7f69577fe700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69580f77d0 0x7f6958109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:41.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.025+0000 7f6957fff700 1 -- 172.21.15.8:0/2672741112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69580f77d0 msgr2=0x7f6958109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.025+0000 7f6957fff700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69580f77d0 0x7f6958109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.025+0000 7f6957fff700 1 -- 172.21.15.8:0/2672741112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c005040 con 0x7f69580f6530 2023-10-18T21:34:41.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.025+0000 7f6957fff700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69580f6530 0x7f6958108f80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f6948002700 tx=0x7f6948009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:41.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.025+0000 7f6954ff9700 1 -- 172.21.15.8:0/2672741112 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69480079c0 con 0x7f69580f6530 2023-10-18T21:34:41.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.025+0000 7f6954ff9700 1 -- 172.21.15.8:0/2672741112 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f694800f040 con 0x7f69580f6530 2023-10-18T21:34:41.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.025+0000 7f6954ff9700 1 -- 172.21.15.8:0/2672741112 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69480148d0 con 0x7f69580f6530 2023-10-18T21:34:41.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.025+0000 7f695d4e4700 1 -- 172.21.15.8:0/2672741112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695810a500 con 0x7f69580f6530 2023-10-18T21:34:41.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.025+0000 7f695d4e4700 1 -- 172.21.15.8:0/2672741112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695810aac0 con 0x7f69580f6530 2023-10-18T21:34:41.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.027+0000 7f695d4e4700 1 -- 172.21.15.8:0/2672741112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6958045ad0 con 0x7f69580f6530 2023-10-18T21:34:41.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.027+0000 7f6954ff9700 1 -- 172.21.15.8:0/2672741112 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f694801b060 con 0x7f69580f6530 2023-10-18T21:34:41.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.028+0000 7f6954ff9700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6940060f70 0x7f6940063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:41.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.028+0000 7f6954ff9700 1 -- 172.21.15.8:0/2672741112 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f694807c6b0 con 0x7f69580f6530 2023-10-18T21:34:41.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.029+0000 7f69577fe700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6940060f70 0x7f6940063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:41.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.029+0000 7f69577fe700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6940060f70 0x7f6940063430 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f694c004630 tx=0x7f694c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:41.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.033+0000 7f6954ff9700 1 -- 172.21.15.8:0/2672741112 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f694804fdd0 con 0x7f69580f6530 2023-10-18T21:34:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:39.271322+0000 mgr.smithi008.flmjzp (mgr.14640) 2149 : cluster [DBG] pgmap v1485: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:39.271322+0000 mgr.smithi008.flmjzp (mgr.14640) 2149 : cluster [DBG] pgmap v1485: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.231+0000 7f695d4e4700 1 -- 172.21.15.8:0/2672741112 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69580fee40 con 0x7f6940060f70 2023-10-18T21:34:41.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.232+0000 7f6954ff9700 1 -- 172.21.15.8:0/2672741112 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f69580fee40 con 0x7f6940060f70 2023-10-18T21:34:41.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.234+0000 7f695d4e4700 1 -- 172.21.15.8:0/2672741112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6940060f70 msgr2=0x7f6940063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.234+0000 7f695d4e4700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6940060f70 0x7f6940063430 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f694c004630 tx=0x7f694c009b30).stop 2023-10-18T21:34:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.234+0000 7f695d4e4700 1 -- 172.21.15.8:0/2672741112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69580f6530 msgr2=0x7f6958108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.234+0000 7f695d4e4700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69580f6530 0x7f6958108f80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f6948002700 tx=0x7f6948009d80).stop 2023-10-18T21:34:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.234+0000 7f695d4e4700 1 -- 172.21.15.8:0/2672741112 shutdown_connections 2023-10-18T21:34:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.234+0000 7f695d4e4700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6940060f70 0x7f6940063430 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.234+0000 7f695d4e4700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69580f6530 0x7f6958108f80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.234+0000 7f695d4e4700 1 --2- 172.21.15.8:0/2672741112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69580f77d0 0x7f6958109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.234+0000 7f695d4e4700 1 -- 172.21.15.8:0/2672741112 >> 172.21.15.8:0/2672741112 conn(0x7f69580f1c90 msgr2=0x7f695806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:41.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.234+0000 7f695d4e4700 1 -- 172.21.15.8:0/2672741112 shutdown_connections 2023-10-18T21:34:41.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.235+0000 7f695d4e4700 1 -- 172.21.15.8:0/2672741112 wait complete. 2023-10-18T21:34:41.250 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:34:41.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.374+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/1024507233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a9c0f6530 msgr2=0x7f1a9c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.374+0000 7f1aa2eaa700 1 --2- 172.21.15.8:0/1024507233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a9c0f6530 0x7f1a9c0f6950 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f1a98004660 tx=0x7f1a98009b30).stop 2023-10-18T21:34:41.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.374+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/1024507233 shutdown_connections 2023-10-18T21:34:41.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.374+0000 7f1aa2eaa700 1 --2- 172.21.15.8:0/1024507233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c0f77d0 0x7f1a9c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.374+0000 7f1aa2eaa700 1 --2- 172.21.15.8:0/1024507233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a9c0f6530 0x7f1a9c0f6950 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.374+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/1024507233 >> 172.21.15.8:0/1024507233 conn(0x7f1a9c0f1c90 msgr2=0x7f1a9c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:41.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.374+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/1024507233 shutdown_connections 2023-10-18T21:34:41.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.374+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/1024507233 wait complete. 2023-10-18T21:34:41.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.375+0000 7f1aa2eaa700 1 Processor -- start 2023-10-18T21:34:41.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.375+0000 7f1aa2eaa700 1 -- start start 2023-10-18T21:34:41.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.376+0000 7f1aa2eaa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a9c0f6530 0x7f1a9c106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:41.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.376+0000 7f1aa2eaa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c0f77d0 0x7f1a9c107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:41.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.376+0000 7f1aa2eaa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c107870 con 0x7f1a9c0f6530 2023-10-18T21:34:41.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.376+0000 7f1aa2eaa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c1080b0 con 0x7f1a9c0f77d0 2023-10-18T21:34:41.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.376+0000 7f1aa1ea8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a9c0f6530 0x7f1a9c106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:41.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.376+0000 7f1aa1ea8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a9c0f6530 0x7f1a9c106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53630/0 (socket says 172.21.15.8:53630) 2023-10-18T21:34:41.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.376+0000 7f1aa1ea8700 1 -- 172.21.15.8:0/2799529420 learned_addr learned my addr 172.21.15.8:0/2799529420 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:41.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.376+0000 7f1aa16a7700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c0f77d0 0x7f1a9c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:41.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.377+0000 7f1aa1ea8700 1 -- 172.21.15.8:0/2799529420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c0f77d0 msgr2=0x7f1a9c107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.377+0000 7f1aa1ea8700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c0f77d0 0x7f1a9c107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.377+0000 7f1aa1ea8700 1 -- 172.21.15.8:0/2799529420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a98005040 con 0x7f1a9c0f6530 2023-10-18T21:34:41.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.377+0000 7f1aa1ea8700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a9c0f6530 0x7f1a9c106d80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f1a98009870 tx=0x7f1a9800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:41.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.377+0000 7f1a927fc700 1 -- 172.21.15.8:0/2799529420 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a98019070 con 0x7f1a9c0f6530 2023-10-18T21:34:41.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.377+0000 7f1a927fc700 1 -- 172.21.15.8:0/2799529420 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1a98013380 con 0x7f1a9c0f6530 2023-10-18T21:34:41.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.377+0000 7f1a927fc700 1 -- 172.21.15.8:0/2799529420 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a9801edf0 con 0x7f1a9c0f6530 2023-10-18T21:34:41.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.377+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/2799529420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c108330 con 0x7f1a9c0f6530 2023-10-18T21:34:41.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.377+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/2799529420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c108810 con 0x7f1a9c0f6530 2023-10-18T21:34:41.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.378+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/2799529420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c059100 con 0x7f1a9c0f6530 2023-10-18T21:34:41.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.379+0000 7f1a927fc700 1 -- 172.21.15.8:0/2799529420 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1a9801e420 con 0x7f1a9c0f6530 2023-10-18T21:34:41.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.380+0000 7f1a927fc700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a88060f70 0x7f1a88063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:41.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.380+0000 7f1a927fc700 1 -- 172.21.15.8:0/2799529420 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1a9807dd00 con 0x7f1a9c0f6530 2023-10-18T21:34:41.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.380+0000 7f1aa16a7700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a88060f70 0x7f1a88063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:41.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.381+0000 7f1aa16a7700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a88060f70 0x7f1a88063430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f1a9c106b10 tx=0x7f1a8c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:41.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.384+0000 7f1a927fc700 1 -- 172.21.15.8:0/2799529420 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1a9804d930 con 0x7f1a9c0f6530 2023-10-18T21:34:41.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.581+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/2799529420 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a9c0fed30 con 0x7f1a88060f70 2023-10-18T21:34:41.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.583+0000 7f1a927fc700 1 -- 172.21.15.8:0/2799529420 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1a9c0fed30 con 0x7f1a88060f70 2023-10-18T21:34:41.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/2799529420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a88060f70 msgr2=0x7f1a88063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a88060f70 0x7f1a88063430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f1a9c106b10 tx=0x7f1a8c00b040).stop 2023-10-18T21:34:41.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/2799529420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a9c0f6530 msgr2=0x7f1a9c106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a9c0f6530 0x7f1a9c106d80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f1a98009870 tx=0x7f1a9800b040).stop 2023-10-18T21:34:41.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/2799529420 shutdown_connections 2023-10-18T21:34:41.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a88060f70 0x7f1a88063430 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a9c0f6530 0x7f1a9c106d80 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 --2- 172.21.15.8:0/2799529420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c0f77d0 0x7f1a9c107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/2799529420 >> 172.21.15.8:0/2799529420 conn(0x7f1a9c0f1c90 msgr2=0x7f1a9c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:41.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/2799529420 shutdown_connections 2023-10-18T21:34:41.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.585+0000 7f1aa2eaa700 1 -- 172.21.15.8:0/2799529420 wait complete. 2023-10-18T21:34:41.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.721+0000 7f651f413700 1 -- 172.21.15.8:0/3961847153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f651806a3b0 msgr2=0x7f651806a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.721+0000 7f651f413700 1 --2- 172.21.15.8:0/3961847153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f651806a3b0 0x7f651806a830 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f6508004660 tx=0x7f6508009b30).stop 2023-10-18T21:34:41.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.721+0000 7f651f413700 1 -- 172.21.15.8:0/3961847153 shutdown_connections 2023-10-18T21:34:41.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.721+0000 7f651f413700 1 --2- 172.21.15.8:0/3961847153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f651806a3b0 0x7f651806a830 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.721+0000 7f651f413700 1 --2- 172.21.15.8:0/3961847153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f651806b9c0 0x7f6518069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.721+0000 7f651f413700 1 -- 172.21.15.8:0/3961847153 >> 172.21.15.8:0/3961847153 conn(0x7f65180f1c90 msgr2=0x7f65180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:41.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.721+0000 7f651f413700 1 -- 172.21.15.8:0/3961847153 shutdown_connections 2023-10-18T21:34:41.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.721+0000 7f651f413700 1 -- 172.21.15.8:0/3961847153 wait complete. 2023-10-18T21:34:41.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.722+0000 7f651f413700 1 Processor -- start 2023-10-18T21:34:41.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.722+0000 7f651f413700 1 -- start start 2023-10-18T21:34:41.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651f413700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f651806a3b0 0x7f6518108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:41.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651f413700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f651806b9c0 0x7f65181093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:41.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651f413700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6518109970 con 0x7f651806a3b0 2023-10-18T21:34:41.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651f413700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6518109ab0 con 0x7f651806b9c0 2023-10-18T21:34:41.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651e411700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f651806a3b0 0x7f6518108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:41.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651e411700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f651806a3b0 0x7f6518108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53648/0 (socket says 172.21.15.8:53648) 2023-10-18T21:34:41.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651e411700 1 -- 172.21.15.8:0/468970830 learned_addr learned my addr 172.21.15.8:0/468970830 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:41.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651dc10700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f651806b9c0 0x7f65181093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:41.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651e411700 1 -- 172.21.15.8:0/468970830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f651806b9c0 msgr2=0x7f65181093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651e411700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f651806b9c0 0x7f65181093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.723+0000 7f651e411700 1 -- 172.21.15.8:0/468970830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6508005040 con 0x7f651806a3b0 2023-10-18T21:34:41.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.724+0000 7f651e411700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f651806a3b0 0x7f6518108ed0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f651400e7f0 tx=0x7f651400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:41.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.724+0000 7f650effd700 1 -- 172.21.15.8:0/468970830 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65140092e0 con 0x7f651806a3b0 2023-10-18T21:34:41.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.724+0000 7f650effd700 1 -- 172.21.15.8:0/468970830 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f651400f040 con 0x7f651806a3b0 2023-10-18T21:34:41.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.724+0000 7f651f413700 1 -- 172.21.15.8:0/468970830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651810a450 con 0x7f651806a3b0 2023-10-18T21:34:41.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.724+0000 7f650effd700 1 -- 172.21.15.8:0/468970830 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65140147e0 con 0x7f651806a3b0 2023-10-18T21:34:41.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.724+0000 7f651f413700 1 -- 172.21.15.8:0/468970830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651810a990 con 0x7f651806a3b0 2023-10-18T21:34:41.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.725+0000 7f651f413700 1 -- 172.21.15.8:0/468970830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6518045ad0 con 0x7f651806a3b0 2023-10-18T21:34:41.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.726+0000 7f650effd700 1 -- 172.21.15.8:0/468970830 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f651401b030 con 0x7f651806a3b0 2023-10-18T21:34:41.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.727+0000 7f650effd700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6504060f70 0x7f6504063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:41.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.727+0000 7f650effd700 1 -- 172.21.15.8:0/468970830 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f651407c700 con 0x7f651806a3b0 2023-10-18T21:34:41.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.727+0000 7f651dc10700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6504060f70 0x7f6504063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:41.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.727+0000 7f651dc10700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6504060f70 0x7f6504063430 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f6508009720 tx=0x7f6508016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:41.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.731+0000 7f650effd700 1 -- 172.21.15.8:0/468970830 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f651404fe50 con 0x7f651806a3b0 2023-10-18T21:34:41.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.922+0000 7f651f413700 1 -- 172.21.15.8:0/468970830 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6518101030 con 0x7f6504060f70 2023-10-18T21:34:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.932+0000 7f650effd700 1 -- 172.21.15.8:0/468970830 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6518101030 con 0x7f6504060f70 2023-10-18T21:34:41.933 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:34:41.933 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (41m) 9m ago 42m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:34:41.934 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (35m) 9m ago 42m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:34:41.934 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (35m) 7m ago 41m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:34:41.934 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (41m) 9m ago 42m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:34:41.934 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 38m - - 2023-10-18T21:34:41.934 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 38m - - 2023-10-18T21:34:41.935 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 38m - - 2023-10-18T21:34:41.935 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 38m - - 2023-10-18T21:34:41.935 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (36m) 9m ago 44m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:34:41.935 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (35m) 7m ago 41m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:34:41.935 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (35m) 9m ago 44m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:34:41.935 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (35m) 7m ago 41m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:34:41.936 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (42m) 9m ago 42m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:34:41.936 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (41m) 7m ago 41m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:34:41.936 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (34m) 9m ago 41m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:34:41.936 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (32m) 9m ago 41m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:34:41.936 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (32m) 9m ago 40m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:34:41.937 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (31m) 7m ago 40m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:34:41.937 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (31m) 7m ago 40m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:34:41.937 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (30m) 7m ago 39m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:34:41.937 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (36m) 9m ago 42m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:34:41.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 -- 172.21.15.8:0/468970830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6504060f70 msgr2=0x7f6504063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6504060f70 0x7f6504063430 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f6508009720 tx=0x7f6508016040).stop 2023-10-18T21:34:41.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 -- 172.21.15.8:0/468970830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f651806a3b0 msgr2=0x7f6518108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:41.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f651806a3b0 0x7f6518108ed0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f651400e7f0 tx=0x7f651400b040).stop 2023-10-18T21:34:41.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 -- 172.21.15.8:0/468970830 shutdown_connections 2023-10-18T21:34:41.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6504060f70 0x7f6504063430 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f651806a3b0 0x7f6518108ed0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 --2- 172.21.15.8:0/468970830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f651806b9c0 0x7f65181093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:41.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 -- 172.21.15.8:0/468970830 >> 172.21.15.8:0/468970830 conn(0x7f65180f1c90 msgr2=0x7f65180fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:41.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 -- 172.21.15.8:0/468970830 shutdown_connections 2023-10-18T21:34:41.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:41.934+0000 7f651f413700 1 -- 172.21.15.8:0/468970830 wait complete. 2023-10-18T21:34:42.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.069+0000 7fb3c6d44700 1 -- 172.21.15.8:0/3032011800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00f77d0 msgr2=0x7fb3c00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:42.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.069+0000 7fb3c6d44700 1 --2- 172.21.15.8:0/3032011800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00f77d0 0x7fb3c00f7c30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fb3b0004660 tx=0x7fb3b0009b30).stop 2023-10-18T21:34:42.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.069+0000 7fb3c6d44700 1 -- 172.21.15.8:0/3032011800 shutdown_connections 2023-10-18T21:34:42.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.069+0000 7fb3c6d44700 1 --2- 172.21.15.8:0/3032011800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00f77d0 0x7fb3c00f7c30 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.069+0000 7fb3c6d44700 1 --2- 172.21.15.8:0/3032011800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3c00f6530 0x7fb3c00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.069+0000 7fb3c6d44700 1 -- 172.21.15.8:0/3032011800 >> 172.21.15.8:0/3032011800 conn(0x7fb3c00f1c90 msgr2=0x7fb3c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:42.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.069+0000 7fb3c6d44700 1 -- 172.21.15.8:0/3032011800 shutdown_connections 2023-10-18T21:34:42.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.069+0000 7fb3c6d44700 1 -- 172.21.15.8:0/3032011800 wait complete. 2023-10-18T21:34:42.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.070+0000 7fb3c6d44700 1 Processor -- start 2023-10-18T21:34:42.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.070+0000 7fb3c6d44700 1 -- start start 2023-10-18T21:34:42.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.070+0000 7fb3c6d44700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00f6530 0x7fb3c0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:42.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.070+0000 7fb3c6d44700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3c00f77d0 0x7fb3c0107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:42.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.071+0000 7fb3c6d44700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0107850 con 0x7fb3c00f6530 2023-10-18T21:34:42.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.071+0000 7fb3c6d44700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0108060 con 0x7fb3c00f77d0 2023-10-18T21:34:42.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.071+0000 7fb3c5d42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00f6530 0x7fb3c0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:42.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.071+0000 7fb3c5d42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00f6530 0x7fb3c0106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53660/0 (socket says 172.21.15.8:53660) 2023-10-18T21:34:42.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.071+0000 7fb3c5d42700 1 -- 172.21.15.8:0/1035279157 learned_addr learned my addr 172.21.15.8:0/1035279157 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:42.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.071+0000 7fb3c5541700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3c00f77d0 0x7fb3c0107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:42.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.071+0000 7fb3c5d42700 1 -- 172.21.15.8:0/1035279157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3c00f77d0 msgr2=0x7fb3c0107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:42.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.071+0000 7fb3c5d42700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3c00f77d0 0x7fb3c0107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.071+0000 7fb3c5d42700 1 -- 172.21.15.8:0/1035279157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b0005040 con 0x7fb3c00f6530 2023-10-18T21:34:42.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.071+0000 7fb3c5d42700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00f6530 0x7fb3c0106d60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fb3bc002700 tx=0x7fb3bc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:42.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.072+0000 7fb3b67fc700 1 -- 172.21.15.8:0/1035279157 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3bc009320 con 0x7fb3c00f6530 2023-10-18T21:34:42.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.072+0000 7fb3b67fc700 1 -- 172.21.15.8:0/1035279157 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb3bc00f040 con 0x7fb3c00f6530 2023-10-18T21:34:42.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.072+0000 7fb3b67fc700 1 -- 172.21.15.8:0/1035279157 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3bc014950 con 0x7fb3c00f6530 2023-10-18T21:34:42.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.072+0000 7fb3c6d44700 1 -- 172.21.15.8:0/1035279157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c01082e0 con 0x7fb3c00f6530 2023-10-18T21:34:42.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.072+0000 7fb3c6d44700 1 -- 172.21.15.8:0/1035279157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c01088a0 con 0x7fb3c00f6530 2023-10-18T21:34:42.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.073+0000 7fb3c6d44700 1 -- 172.21.15.8:0/1035279157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c0059100 con 0x7fb3c00f6530 2023-10-18T21:34:42.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.074+0000 7fb3b67fc700 1 -- 172.21.15.8:0/1035279157 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb3bc009480 con 0x7fb3c00f6530 2023-10-18T21:34:42.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.075+0000 7fb3b67fc700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ac060f70 0x7fb3ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:42.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.075+0000 7fb3b67fc700 1 -- 172.21.15.8:0/1035279157 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb3bc07cc70 con 0x7fb3c00f6530 2023-10-18T21:34:42.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.075+0000 7fb3c5541700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ac060f70 0x7fb3ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:42.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.076+0000 7fb3c5541700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ac060f70 0x7fb3ac063430 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fb3b0004e30 tx=0x7fb3b0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:42.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.079+0000 7fb3b67fc700 1 -- 172.21.15.8:0/1035279157 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb3bc083080 con 0x7fb3c00f6530 2023-10-18T21:34:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.333+0000 7fb3c6d44700 1 -- 172.21.15.8:0/1035279157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb3c00fee50 con 0x7fb3c00f6530 2023-10-18T21:34:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.334+0000 7fb3b67fc700 1 -- 172.21.15.8:0/1035279157 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fb3c00fee50 con 0x7fb3c00f6530 2023-10-18T21:34:42.335 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:34:42.335 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:34:42.336 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:34:42.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:34:42.336 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:34:42.336 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:34:42.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:34:42.337 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:34:42.337 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:34:42.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:34:42.337 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:34:42.337 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:34:42.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:34:42.338 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:34:42.338 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:34:42.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:34:42.338 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:34:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 -- 172.21.15.8:0/1035279157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ac060f70 msgr2=0x7fb3ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ac060f70 0x7fb3ac063430 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fb3b0004e30 tx=0x7fb3b0009b30).stop 2023-10-18T21:34:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 -- 172.21.15.8:0/1035279157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00f6530 msgr2=0x7fb3c0106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00f6530 0x7fb3c0106d60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fb3bc002700 tx=0x7fb3bc009e00).stop 2023-10-18T21:34:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 -- 172.21.15.8:0/1035279157 shutdown_connections 2023-10-18T21:34:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ac060f70 0x7fb3ac063430 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3c00f6530 0x7fb3c0106d60 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 --2- 172.21.15.8:0/1035279157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3c00f77d0 0x7fb3c0107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 -- 172.21.15.8:0/1035279157 >> 172.21.15.8:0/1035279157 conn(0x7fb3c00f1c90 msgr2=0x7fb3c00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:42.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 -- 172.21.15.8:0/1035279157 shutdown_connections 2023-10-18T21:34:42.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.336+0000 7fb3c6d44700 1 -- 172.21.15.8:0/1035279157 wait complete. 2023-10-18T21:34:42.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.473+0000 7f7ecffff700 1 -- 172.21.15.8:0/2186759511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ed0060310 msgr2=0x7f7ed00f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:42.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.473+0000 7f7ecffff700 1 --2- 172.21.15.8:0/2186759511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ed0060310 0x7f7ed00f9110 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f7ec0004660 tx=0x7f7ec0009b30).stop 2023-10-18T21:34:42.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.473+0000 7f7ecffff700 1 -- 172.21.15.8:0/2186759511 shutdown_connections 2023-10-18T21:34:42.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.473+0000 7f7ecffff700 1 --2- 172.21.15.8:0/2186759511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed00f9690 0x7f7ed00fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.473+0000 7f7ecffff700 1 --2- 172.21.15.8:0/2186759511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ed0060310 0x7f7ed00f9110 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.473+0000 7f7ecffff700 1 -- 172.21.15.8:0/2186759511 >> 172.21.15.8:0/2186759511 conn(0x7f7ed00f0b90 msgr2=0x7f7ed00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:42.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.473+0000 7f7ecffff700 1 -- 172.21.15.8:0/2186759511 shutdown_connections 2023-10-18T21:34:42.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.473+0000 7f7ecffff700 1 -- 172.21.15.8:0/2186759511 wait complete. 2023-10-18T21:34:42.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.474+0000 7f7ecffff700 1 Processor -- start 2023-10-18T21:34:42.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.474+0000 7f7ecffff700 1 -- start start 2023-10-18T21:34:42.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.474+0000 7f7ecffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed0060310 0x7f7ed00f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:42.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.474+0000 7f7ecffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ed00f9690 0x7f7ed00f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:42.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.474+0000 7f7ecffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed00f5570 con 0x7f7ed00f9690 2023-10-18T21:34:42.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.474+0000 7f7ecffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed00f56b0 con 0x7f7ed0060310 2023-10-18T21:34:42.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.475+0000 7f7ece7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ed00f9690 0x7f7ed00f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:42.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.475+0000 7f7ece7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ed00f9690 0x7f7ed00f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53678/0 (socket says 172.21.15.8:53678) 2023-10-18T21:34:42.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.475+0000 7f7ece7fc700 1 -- 172.21.15.8:0/1203771461 learned_addr learned my addr 172.21.15.8:0/1203771461 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:42.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.475+0000 7f7eceffd700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed0060310 0x7f7ed00f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:42.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.475+0000 7f7ece7fc700 1 -- 172.21.15.8:0/1203771461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed0060310 msgr2=0x7f7ed00f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:42.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.475+0000 7f7ece7fc700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed0060310 0x7f7ed00f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.475+0000 7f7ece7fc700 1 -- 172.21.15.8:0/1203771461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0005040 con 0x7f7ed00f9690 2023-10-18T21:34:42.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.475+0000 7f7ece7fc700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ed00f9690 0x7f7ed00f5010 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f7ec400e7c0 tx=0x7f7ec400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:42.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.476+0000 7f7eb77fe700 1 -- 172.21.15.8:0/1203771461 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec40092e0 con 0x7f7ed00f9690 2023-10-18T21:34:42.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.476+0000 7f7eb77fe700 1 -- 172.21.15.8:0/1203771461 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7ec400f040 con 0x7f7ed00f9690 2023-10-18T21:34:42.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.476+0000 7f7eb77fe700 1 -- 172.21.15.8:0/1203771461 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec40147e0 con 0x7f7ed00f9690 2023-10-18T21:34:42.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.476+0000 7f7ecffff700 1 -- 172.21.15.8:0/1203771461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed00f5990 con 0x7f7ed00f9690 2023-10-18T21:34:42.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.476+0000 7f7ecffff700 1 -- 172.21.15.8:0/1203771461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed010ed20 con 0x7f7ed00f9690 2023-10-18T21:34:42.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.477+0000 7f7ecffff700 1 -- 172.21.15.8:0/1203771461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed0045ad0 con 0x7f7ed00f9690 2023-10-18T21:34:42.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.478+0000 7f7eb77fe700 1 -- 172.21.15.8:0/1203771461 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7ec4014a10 con 0x7f7ed00f9690 2023-10-18T21:34:42.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.479+0000 7f7eb77fe700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7eb8060f70 0x7f7eb8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:42.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.479+0000 7f7eb77fe700 1 -- 172.21.15.8:0/1203771461 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7ec407cb00 con 0x7f7ed00f9690 2023-10-18T21:34:42.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.479+0000 7f7eceffd700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7eb8060f70 0x7f7eb8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:42.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.480+0000 7f7eceffd700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7eb8060f70 0x7f7eb8063430 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f7ec0005010 tx=0x7f7ec0016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:42.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.483+0000 7f7eb77fe700 1 -- 172.21.15.8:0/1203771461 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7ec404c770 con 0x7f7ed00f9690 2023-10-18T21:34:42.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.708+0000 7f7ecffff700 1 -- 172.21.15.8:0/1203771461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7ed00fed80 con 0x7f7ed00f9690 2023-10-18T21:34:42.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.709+0000 7f7eb77fe700 1 -- 172.21.15.8:0/1203771461 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f7ec404fd90 con 0x7f7ed00f9690 2023-10-18T21:34:42.710 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:34:42.711 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:34:42.711 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:34:42.711 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:34:42.711 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:34:42.712 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:34:42.712 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:34:42.712 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:34:42.712 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:34:42.712 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:34:42.713 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:34:42.713 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:34:42.713 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:34:42.713 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:34:42.713 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:34:42.714 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:34:42.714 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:34:42.714 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:34:42.714 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:34:42.714 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:34:42.715 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:34:42.715 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:34:42.715 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:34:42.715 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:34:42.715 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:34:42.716 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:34:42.716 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:34:42.716 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:34:42.716 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:34:42.716 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:34:42.717 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:34:42.717 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:34:42.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:34:42.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:34:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 -- 172.21.15.8:0/1203771461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7eb8060f70 msgr2=0x7f7eb8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7eb8060f70 0x7f7eb8063430 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f7ec0005010 tx=0x7f7ec0016040).stop 2023-10-18T21:34:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 -- 172.21.15.8:0/1203771461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ed00f9690 msgr2=0x7f7ed00f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ed00f9690 0x7f7ed00f5010 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f7ec400e7c0 tx=0x7f7ec400b040).stop 2023-10-18T21:34:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 -- 172.21.15.8:0/1203771461 shutdown_connections 2023-10-18T21:34:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7eb8060f70 0x7f7eb8063430 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed0060310 0x7f7ed00f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 --2- 172.21.15.8:0/1203771461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ed00f9690 0x7f7ed00f5010 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 -- 172.21.15.8:0/1203771461 >> 172.21.15.8:0/1203771461 conn(0x7f7ed00f0b90 msgr2=0x7f7ed00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 -- 172.21.15.8:0/1203771461 shutdown_connections 2023-10-18T21:34:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.711+0000 7f7ecffff700 1 -- 172.21.15.8:0/1203771461 wait complete. 2023-10-18T21:34:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:34:42.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.850+0000 7f8d923f1700 1 -- 172.21.15.8:0/932855426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d8c0f6530 msgr2=0x7f8d8c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:42.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.850+0000 7f8d923f1700 1 --2- 172.21.15.8:0/932855426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d8c0f6530 0x7f8d8c0f6950 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f8d88004660 tx=0x7f8d88009b30).stop 2023-10-18T21:34:42.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.850+0000 7f8d923f1700 1 -- 172.21.15.8:0/932855426 shutdown_connections 2023-10-18T21:34:42.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.850+0000 7f8d923f1700 1 --2- 172.21.15.8:0/932855426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d8c0f77d0 0x7f8d8c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.850+0000 7f8d923f1700 1 --2- 172.21.15.8:0/932855426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d8c0f6530 0x7f8d8c0f6950 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.850+0000 7f8d923f1700 1 -- 172.21.15.8:0/932855426 >> 172.21.15.8:0/932855426 conn(0x7f8d8c0f1c90 msgr2=0x7f8d8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:42.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.850+0000 7f8d923f1700 1 -- 172.21.15.8:0/932855426 shutdown_connections 2023-10-18T21:34:42.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.850+0000 7f8d923f1700 1 -- 172.21.15.8:0/932855426 wait complete. 2023-10-18T21:34:42.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.851+0000 7f8d923f1700 1 Processor -- start 2023-10-18T21:34:42.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.851+0000 7f8d923f1700 1 -- start start 2023-10-18T21:34:42.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.851+0000 7f8d923f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d8c0f6530 0x7f8d8c108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:42.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.851+0000 7f8d923f1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d8c0f77d0 0x7f8d8c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:42.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.851+0000 7f8d923f1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c109a70 con 0x7f8d8c0f77d0 2023-10-18T21:34:42.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.851+0000 7f8d923f1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c109bb0 con 0x7f8d8c0f6530 2023-10-18T21:34:42.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.852+0000 7f8d90bee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d8c0f77d0 0x7f8d8c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:42.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.852+0000 7f8d90bee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d8c0f77d0 0x7f8d8c1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53696/0 (socket says 172.21.15.8:53696) 2023-10-18T21:34:42.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.852+0000 7f8d90bee700 1 -- 172.21.15.8:0/3331039357 learned_addr learned my addr 172.21.15.8:0/3331039357 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:34:42.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.852+0000 7f8d913ef700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d8c0f6530 0x7f8d8c108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:42.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.852+0000 7f8d90bee700 1 -- 172.21.15.8:0/3331039357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d8c0f6530 msgr2=0x7f8d8c108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:42.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.852+0000 7f8d90bee700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d8c0f6530 0x7f8d8c108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:42.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.852+0000 7f8d90bee700 1 -- 172.21.15.8:0/3331039357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88005040 con 0x7f8d8c0f77d0 2023-10-18T21:34:42.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.852+0000 7f8d913ef700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d8c0f6530 0x7f8d8c108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:34:42.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.852+0000 7f8d90bee700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d8c0f77d0 0x7f8d8c1094c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f8d7c00c790 tx=0x7f8d7c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:42.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.852+0000 7f8d81ffb700 1 -- 172.21.15.8:0/3331039357 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d7c00e680 con 0x7f8d8c0f77d0 2023-10-18T21:34:42.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.853+0000 7f8d81ffb700 1 -- 172.21.15.8:0/3331039357 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8d7c00eca0 con 0x7f8d8c0f77d0 2023-10-18T21:34:42.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.853+0000 7f8d81ffb700 1 -- 172.21.15.8:0/3331039357 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d7c013de0 con 0x7f8d8c0f77d0 2023-10-18T21:34:42.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.853+0000 7f8d923f1700 1 -- 172.21.15.8:0/3331039357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c10a550 con 0x7f8d8c0f77d0 2023-10-18T21:34:42.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.853+0000 7f8d923f1700 1 -- 172.21.15.8:0/3331039357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c10ab10 con 0x7f8d8c0f77d0 2023-10-18T21:34:42.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.854+0000 7f8d923f1700 1 -- 172.21.15.8:0/3331039357 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c045ad0 con 0x7f8d8c0f77d0 2023-10-18T21:34:42.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.855+0000 7f8d81ffb700 1 -- 172.21.15.8:0/3331039357 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8d7c01a060 con 0x7f8d8c0f77d0 2023-10-18T21:34:42.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.856+0000 7f8d81ffb700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d78060f70 0x7f8d78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:34:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.856+0000 7f8d81ffb700 1 -- 172.21.15.8:0/3331039357 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8d7c07cb70 con 0x7f8d8c0f77d0 2023-10-18T21:34:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.856+0000 7f8d913ef700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d78060f70 0x7f8d78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:34:42.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.857+0000 7f8d913ef700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d78060f70 0x7f8d78063430 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f8d88004e30 tx=0x7f8d88009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:34:42.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:42.860+0000 7f8d81ffb700 1 -- 172.21.15.8:0/3331039357 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8d7c0501d0 con 0x7f8d8c0f77d0 2023-10-18T21:34:43.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.058+0000 7f8d923f1700 1 -- 172.21.15.8:0/3331039357 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d8c0fee30 con 0x7f8d78060f70 2023-10-18T21:34:43.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.059+0000 7f8d81ffb700 1 -- 172.21.15.8:0/3331039357 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8d8c0fee30 con 0x7f8d78060f70 2023-10-18T21:34:43.060 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:34:43.060 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:34:43.061 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:34:43.061 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:34:43.061 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:34:43.061 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:34:43.061 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:34:43.062 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:34:43.062 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:34:43.062 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:34:43.062 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:34:43.063 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:34:43.063 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:34:43.063 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:34:43.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.061+0000 7f8d923f1700 1 -- 172.21.15.8:0/3331039357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d78060f70 msgr2=0x7f8d78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:43.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.061+0000 7f8d923f1700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d78060f70 0x7f8d78063430 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f8d88004e30 tx=0x7f8d88009b30).stop 2023-10-18T21:34:43.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.061+0000 7f8d923f1700 1 -- 172.21.15.8:0/3331039357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d8c0f77d0 msgr2=0x7f8d8c1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:34:43.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.061+0000 7f8d923f1700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d8c0f77d0 0x7f8d8c1094c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f8d7c00c790 tx=0x7f8d7c007d70).stop 2023-10-18T21:34:43.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.061+0000 7f8d923f1700 1 -- 172.21.15.8:0/3331039357 shutdown_connections 2023-10-18T21:34:43.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.061+0000 7f8d923f1700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d78060f70 0x7f8d78063430 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:43.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.061+0000 7f8d923f1700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d8c0f6530 0x7f8d8c108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:43.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.061+0000 7f8d923f1700 1 --2- 172.21.15.8:0/3331039357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d8c0f77d0 0x7f8d8c1094c0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:34:43.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.061+0000 7f8d923f1700 1 -- 172.21.15.8:0/3331039357 >> 172.21.15.8:0/3331039357 conn(0x7f8d8c0f1c90 msgr2=0x7f8d8c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:34:43.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.062+0000 7f8d923f1700 1 -- 172.21.15.8:0/3331039357 shutdown_connections 2023-10-18T21:34:43.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:34:43.062+0000 7f8d923f1700 1 -- 172.21.15.8:0/3331039357 wait complete. 2023-10-18T21:34:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:41.232703+0000 mgr.smithi008.flmjzp (mgr.14640) 2150 : audit [DBG] from='client.35872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:41.271960+0000 mgr.smithi008.flmjzp (mgr.14640) 2151 : cluster [DBG] pgmap v1486: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:41.583118+0000 mgr.smithi008.flmjzp (mgr.14640) 2152 : audit [DBG] from='client.35876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:41.923928+0000 mgr.smithi008.flmjzp (mgr.14640) 2153 : audit [DBG] from='client.35880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:42.334526+0000 mon.smithi008 (mon.0) 2584 : audit [DBG] from='client.? 172.21.15.8:0/1035279157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:42.709530+0000 mon.smithi008 (mon.0) 2585 : audit [DBG] from='client.? 172.21.15.8:0/1203771461' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:34:43.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:41.232703+0000 mgr.smithi008.flmjzp (mgr.14640) 2150 : audit [DBG] from='client.35872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:41.271960+0000 mgr.smithi008.flmjzp (mgr.14640) 2151 : cluster [DBG] pgmap v1486: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:41.583118+0000 mgr.smithi008.flmjzp (mgr.14640) 2152 : audit [DBG] from='client.35876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:41.923928+0000 mgr.smithi008.flmjzp (mgr.14640) 2153 : audit [DBG] from='client.35880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:42.334526+0000 mon.smithi008 (mon.0) 2584 : audit [DBG] from='client.? 172.21.15.8:0/1035279157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:43.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:42.709530+0000 mon.smithi008 (mon.0) 2585 : audit [DBG] from='client.? 172.21.15.8:0/1203771461' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:34:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:43.290438+0000 mon.smithi008 (mon.0) 2586 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:43.292185+0000 mon.smithi008 (mon.0) 2587 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:43.292925+0000 mon.smithi008 (mon.0) 2588 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:43.298463+0000 mon.smithi008 (mon.0) 2589 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:43.304752+0000 mon.smithi008 (mon.0) 2590 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:43.307586+0000 mon.smithi008 (mon.0) 2591 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:43.309218+0000 mon.smithi008 (mon.0) 2592 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:43.310751+0000 mon.smithi008 (mon.0) 2593 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:43.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:43.312887+0000 mon.smithi008 (mon.0) 2594 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:43.290438+0000 mon.smithi008 (mon.0) 2586 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:43.292185+0000 mon.smithi008 (mon.0) 2587 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:43.292925+0000 mon.smithi008 (mon.0) 2588 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:43.298463+0000 mon.smithi008 (mon.0) 2589 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:43.304752+0000 mon.smithi008 (mon.0) 2590 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:44.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:43.307586+0000 mon.smithi008 (mon.0) 2591 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:44.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:43.309218+0000 mon.smithi008 (mon.0) 2592 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:44.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:43.310751+0000 mon.smithi008 (mon.0) 2593 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:44.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:43.312887+0000 mon.smithi008 (mon.0) 2594 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:45.162 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:43.059693+0000 mgr.smithi008.flmjzp (mgr.14640) 2154 : audit [DBG] from='client.35892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:45.163 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:43.272440+0000 mgr.smithi008.flmjzp (mgr.14640) 2155 : cluster [DBG] pgmap v1487: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:45.163 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:43.293577+0000 mgr.smithi008.flmjzp (mgr.14640) 2156 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:45.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:43.294034+0000 mgr.smithi008.flmjzp (mgr.14640) 2157 : cluster [DBG] pgmap v1488: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:45.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:43.294260+0000 mgr.smithi008.flmjzp (mgr.14640) 2158 : cluster [DBG] pgmap v1489: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:45.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:43.314727+0000 mgr.smithi008.flmjzp (mgr.14640) 2159 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:45.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:43.059693+0000 mgr.smithi008.flmjzp (mgr.14640) 2154 : audit [DBG] from='client.35892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:34:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:43.272440+0000 mgr.smithi008.flmjzp (mgr.14640) 2155 : cluster [DBG] pgmap v1487: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:43.293577+0000 mgr.smithi008.flmjzp (mgr.14640) 2156 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:43.294034+0000 mgr.smithi008.flmjzp (mgr.14640) 2157 : cluster [DBG] pgmap v1488: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:45.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:43.294260+0000 mgr.smithi008.flmjzp (mgr.14640) 2158 : cluster [DBG] pgmap v1489: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:45.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:43.314727+0000 mgr.smithi008.flmjzp (mgr.14640) 2159 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:45.294856+0000 mgr.smithi008.flmjzp (mgr.14640) 2160 : cluster [DBG] pgmap v1490: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:45.294856+0000 mgr.smithi008.flmjzp (mgr.14640) 2160 : cluster [DBG] pgmap v1490: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:47.295473+0000 mgr.smithi008.flmjzp (mgr.14640) 2161 : cluster [DBG] pgmap v1491: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:47.295473+0000 mgr.smithi008.flmjzp (mgr.14640) 2161 : cluster [DBG] pgmap v1491: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:49.296068+0000 mgr.smithi008.flmjzp (mgr.14640) 2162 : cluster [DBG] pgmap v1492: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:51.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:49.296068+0000 mgr.smithi008.flmjzp (mgr.14640) 2162 : cluster [DBG] pgmap v1492: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:51.296687+0000 mgr.smithi008.flmjzp (mgr.14640) 2163 : cluster [DBG] pgmap v1493: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:53.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:51.296687+0000 mgr.smithi008.flmjzp (mgr.14640) 2163 : cluster [DBG] pgmap v1493: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:53.325518+0000 mon.smithi008 (mon.0) 2595 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:53.325518+0000 mon.smithi008 (mon.0) 2595 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:55.162 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:53.297232+0000 mgr.smithi008.flmjzp (mgr.14640) 2164 : cluster [DBG] pgmap v1494: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:55.163 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:53.881420+0000 mon.smithi008 (mon.0) 2596 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:55.163 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:53.882581+0000 mon.smithi008 (mon.0) 2597 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:55.163 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:53.883533+0000 mgr.smithi008.flmjzp (mgr.14640) 2165 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:55.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:53.884264+0000 mgr.smithi008.flmjzp (mgr.14640) 2166 : cluster [DBG] pgmap v1495: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:55.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:53.884503+0000 mgr.smithi008.flmjzp (mgr.14640) 2167 : cluster [DBG] pgmap v1496: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:55.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:53.889216+0000 mon.smithi008 (mon.0) 2598 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:55.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:53.895619+0000 mon.smithi008 (mon.0) 2599 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:55.164 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:53.898789+0000 mon.smithi008 (mon.0) 2600 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:55.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:53.900431+0000 mon.smithi008 (mon.0) 2601 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:55.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:53.901995+0000 mon.smithi008 (mon.0) 2602 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:55.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:34:53.904027+0000 mon.smithi008 (mon.0) 2603 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:55.165 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:34:53.905847+0000 mgr.smithi008.flmjzp (mgr.14640) 2168 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:55.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:53.297232+0000 mgr.smithi008.flmjzp (mgr.14640) 2164 : cluster [DBG] pgmap v1494: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:53.881420+0000 mon.smithi008 (mon.0) 2596 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:34:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:53.882581+0000 mon.smithi008 (mon.0) 2597 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:34:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:53.883533+0000 mgr.smithi008.flmjzp (mgr.14640) 2165 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:34:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:53.884264+0000 mgr.smithi008.flmjzp (mgr.14640) 2166 : cluster [DBG] pgmap v1495: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:55.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:53.884503+0000 mgr.smithi008.flmjzp (mgr.14640) 2167 : cluster [DBG] pgmap v1496: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:55.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:53.889216+0000 mon.smithi008 (mon.0) 2598 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:34:55.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:53.895619+0000 mon.smithi008 (mon.0) 2599 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:34:55.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:53.898789+0000 mon.smithi008 (mon.0) 2600 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:55.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:53.900431+0000 mon.smithi008 (mon.0) 2601 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:55.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:53.901995+0000 mon.smithi008 (mon.0) 2602 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:55.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:34:53.904027+0000 mon.smithi008 (mon.0) 2603 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:34:55.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:34:53.905847+0000 mgr.smithi008.flmjzp (mgr.14640) 2168 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:34:56.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:55.885178+0000 mgr.smithi008.flmjzp (mgr.14640) 2169 : cluster [DBG] pgmap v1497: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:55.885178+0000 mgr.smithi008.flmjzp (mgr.14640) 2169 : cluster [DBG] pgmap v1497: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:34:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:57.885850+0000 mgr.smithi008.flmjzp (mgr.14640) 2170 : cluster [DBG] pgmap v1498: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:34:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:34:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:57.885850+0000 mgr.smithi008.flmjzp (mgr.14640) 2170 : cluster [DBG] pgmap v1498: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:01.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:34:59.886562+0000 mgr.smithi008.flmjzp (mgr.14640) 2171 : cluster [DBG] pgmap v1499: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:34:59.886562+0000 mgr.smithi008.flmjzp (mgr.14640) 2171 : cluster [DBG] pgmap v1499: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:01.887088+0000 mgr.smithi008.flmjzp (mgr.14640) 2172 : cluster [DBG] pgmap v1500: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:03.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:01.887088+0000 mgr.smithi008.flmjzp (mgr.14640) 2172 : cluster [DBG] pgmap v1500: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:04.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:03.914653+0000 mon.smithi008 (mon.0) 2604 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:03.916847+0000 mon.smithi008 (mon.0) 2605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:35:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:03.917991+0000 mon.smithi008 (mon.0) 2606 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:35:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:03.924653+0000 mon.smithi008 (mon.0) 2607 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:03.931076+0000 mon.smithi008 (mon.0) 2608 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:03.934385+0000 mon.smithi008 (mon.0) 2609 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:03.936144+0000 mon.smithi008 (mon.0) 2610 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:03.937807+0000 mon.smithi008 (mon.0) 2611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:03.939952+0000 mon.smithi008 (mon.0) 2612 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:04.289 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:03.914653+0000 mon.smithi008 (mon.0) 2604 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:04.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:03.916847+0000 mon.smithi008 (mon.0) 2605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:35:04.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:03.917991+0000 mon.smithi008 (mon.0) 2606 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:35:04.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:03.924653+0000 mon.smithi008 (mon.0) 2607 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:04.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:03.931076+0000 mon.smithi008 (mon.0) 2608 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:04.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:03.934385+0000 mon.smithi008 (mon.0) 2609 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:04.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:03.936144+0000 mon.smithi008 (mon.0) 2610 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:04.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:03.937807+0000 mon.smithi008 (mon.0) 2611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:04.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:03.939952+0000 mon.smithi008 (mon.0) 2612 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:05.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:03.887738+0000 mgr.smithi008.flmjzp (mgr.14640) 2173 : cluster [DBG] pgmap v1501: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:03.918935+0000 mgr.smithi008.flmjzp (mgr.14640) 2174 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:35:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:03.919493+0000 mgr.smithi008.flmjzp (mgr.14640) 2175 : cluster [DBG] pgmap v1502: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:03.919742+0000 mgr.smithi008.flmjzp (mgr.14640) 2176 : cluster [DBG] pgmap v1503: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:03.941883+0000 mgr.smithi008.flmjzp (mgr.14640) 2177 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:35:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:03.887738+0000 mgr.smithi008.flmjzp (mgr.14640) 2173 : cluster [DBG] pgmap v1501: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:03.918935+0000 mgr.smithi008.flmjzp (mgr.14640) 2174 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:35:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:03.919493+0000 mgr.smithi008.flmjzp (mgr.14640) 2175 : cluster [DBG] pgmap v1502: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:03.919742+0000 mgr.smithi008.flmjzp (mgr.14640) 2176 : cluster [DBG] pgmap v1503: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:03.941883+0000 mgr.smithi008.flmjzp (mgr.14640) 2177 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:35:06.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:05.920285+0000 mgr.smithi008.flmjzp (mgr.14640) 2178 : cluster [DBG] pgmap v1504: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:05.920285+0000 mgr.smithi008.flmjzp (mgr.14640) 2178 : cluster [DBG] pgmap v1504: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:08.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:07.920971+0000 mgr.smithi008.flmjzp (mgr.14640) 2179 : cluster [DBG] pgmap v1505: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:08.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:07.920971+0000 mgr.smithi008.flmjzp (mgr.14640) 2179 : cluster [DBG] pgmap v1505: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:09.921706+0000 mgr.smithi008.flmjzp (mgr.14640) 2180 : cluster [DBG] pgmap v1506: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:10.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:09.921706+0000 mgr.smithi008.flmjzp (mgr.14640) 2180 : cluster [DBG] pgmap v1506: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:11.922287+0000 mgr.smithi008.flmjzp (mgr.14640) 2181 : cluster [DBG] pgmap v1507: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:12.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:11.922287+0000 mgr.smithi008.flmjzp (mgr.14640) 2181 : cluster [DBG] pgmap v1507: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.212+0000 7f76ec99c700 1 -- 172.21.15.8:0/3003891442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76e80f6530 msgr2=0x7f76e80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.212+0000 7f76ec99c700 1 --2- 172.21.15.8:0/3003891442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76e80f6530 0x7f76e80f6950 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f76d8004660 tx=0x7f76d8009b30).stop 2023-10-18T21:35:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.212+0000 7f76ec99c700 1 -- 172.21.15.8:0/3003891442 shutdown_connections 2023-10-18T21:35:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.212+0000 7f76ec99c700 1 --2- 172.21.15.8:0/3003891442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76e80f77d0 0x7f76e80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.212+0000 7f76ec99c700 1 --2- 172.21.15.8:0/3003891442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76e80f6530 0x7f76e80f6950 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.212+0000 7f76ec99c700 1 -- 172.21.15.8:0/3003891442 >> 172.21.15.8:0/3003891442 conn(0x7f76e80f1c90 msgr2=0x7f76e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:13.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.213+0000 7f76ec99c700 1 -- 172.21.15.8:0/3003891442 shutdown_connections 2023-10-18T21:35:13.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.213+0000 7f76ec99c700 1 -- 172.21.15.8:0/3003891442 wait complete. 2023-10-18T21:35:13.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.213+0000 7f76ec99c700 1 Processor -- start 2023-10-18T21:35:13.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.214+0000 7f76ec99c700 1 -- start start 2023-10-18T21:35:13.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.214+0000 7f76ec99c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76e80f6530 0x7f76e8108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:13.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.214+0000 7f76ec99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76e80f77d0 0x7f76e81094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:13.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.214+0000 7f76ec99c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e8109a50 con 0x7f76e80f77d0 2023-10-18T21:35:13.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.214+0000 7f76ec99c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e8109b90 con 0x7f76e80f6530 2023-10-18T21:35:13.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.214+0000 7f76e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76e80f77d0 0x7f76e81094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:13.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.214+0000 7f76e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76e80f77d0 0x7f76e81094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42316/0 (socket says 172.21.15.8:42316) 2023-10-18T21:35:13.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.214+0000 7f76e659c700 1 -- 172.21.15.8:0/1774831654 learned_addr learned my addr 172.21.15.8:0/1774831654 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:13.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.214+0000 7f76e6d9d700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76e80f6530 0x7f76e8108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:13.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.215+0000 7f76e659c700 1 -- 172.21.15.8:0/1774831654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76e80f6530 msgr2=0x7f76e8108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:13.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.215+0000 7f76e659c700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76e80f6530 0x7f76e8108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.215+0000 7f76e659c700 1 -- 172.21.15.8:0/1774831654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8005040 con 0x7f76e80f77d0 2023-10-18T21:35:13.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.215+0000 7f76e659c700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76e80f77d0 0x7f76e81094a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f76dc0026d0 tx=0x7f76dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:13.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.215+0000 7f76cf7fe700 1 -- 172.21.15.8:0/1774831654 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76dc0079c0 con 0x7f76e80f77d0 2023-10-18T21:35:13.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.215+0000 7f76ec99c700 1 -- 172.21.15.8:0/1774831654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e810a530 con 0x7f76e80f77d0 2023-10-18T21:35:13.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.215+0000 7f76cf7fe700 1 -- 172.21.15.8:0/1774831654 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f76dc00f040 con 0x7f76e80f77d0 2023-10-18T21:35:13.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.215+0000 7f76cf7fe700 1 -- 172.21.15.8:0/1774831654 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76dc014900 con 0x7f76e80f77d0 2023-10-18T21:35:13.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.216+0000 7f76ec99c700 1 -- 172.21.15.8:0/1774831654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e810aaf0 con 0x7f76e80f77d0 2023-10-18T21:35:13.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.217+0000 7f76ec99c700 1 -- 172.21.15.8:0/1774831654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e8045ad0 con 0x7f76e80f77d0 2023-10-18T21:35:13.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.218+0000 7f76cf7fe700 1 -- 172.21.15.8:0/1774831654 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f76dc0090d0 con 0x7f76e80f77d0 2023-10-18T21:35:13.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.218+0000 7f76cf7fe700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76d0060f70 0x7f76d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:13.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.218+0000 7f76cf7fe700 1 -- 172.21.15.8:0/1774831654 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f76dc07c8e0 con 0x7f76e80f77d0 2023-10-18T21:35:13.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.219+0000 7f76e6d9d700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76d0060f70 0x7f76d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:13.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.219+0000 7f76e6d9d700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76d0060f70 0x7f76d0063430 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f76d8004630 tx=0x7f76d8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:13.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.223+0000 7f76cf7fe700 1 -- 172.21.15.8:0/1774831654 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f76dc050030 con 0x7f76e80f77d0 2023-10-18T21:35:13.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.421+0000 7f76ec99c700 1 -- 172.21.15.8:0/1774831654 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76e810ad70 con 0x7f76d0060f70 2023-10-18T21:35:13.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.423+0000 7f76cf7fe700 1 -- 172.21.15.8:0/1774831654 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f76e810ad70 con 0x7f76d0060f70 2023-10-18T21:35:13.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.424+0000 7f76ec99c700 1 -- 172.21.15.8:0/1774831654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76d0060f70 msgr2=0x7f76d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:13.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.424+0000 7f76ec99c700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76d0060f70 0x7f76d0063430 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f76d8004630 tx=0x7f76d8009b30).stop 2023-10-18T21:35:13.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.425+0000 7f76ec99c700 1 -- 172.21.15.8:0/1774831654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76e80f77d0 msgr2=0x7f76e81094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:13.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.425+0000 7f76ec99c700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76e80f77d0 0x7f76e81094a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f76dc0026d0 tx=0x7f76dc009de0).stop 2023-10-18T21:35:13.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.425+0000 7f76ec99c700 1 -- 172.21.15.8:0/1774831654 shutdown_connections 2023-10-18T21:35:13.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.425+0000 7f76ec99c700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76d0060f70 0x7f76d0063430 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.425+0000 7f76ec99c700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76e80f6530 0x7f76e8108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.425+0000 7f76ec99c700 1 --2- 172.21.15.8:0/1774831654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76e80f77d0 0x7f76e81094a0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.425+0000 7f76ec99c700 1 -- 172.21.15.8:0/1774831654 >> 172.21.15.8:0/1774831654 conn(0x7f76e80f1c90 msgr2=0x7f76e806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:13.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.425+0000 7f76ec99c700 1 -- 172.21.15.8:0/1774831654 shutdown_connections 2023-10-18T21:35:13.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.425+0000 7f76ec99c700 1 -- 172.21.15.8:0/1774831654 wait complete. 2023-10-18T21:35:13.441 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:35:13.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.563+0000 7f6f393d2700 1 -- 172.21.15.8:0/3235355045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f340f77d0 msgr2=0x7f6f340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:13.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.563+0000 7f6f393d2700 1 --2- 172.21.15.8:0/3235355045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f340f77d0 0x7f6f340f7c30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f6f28004660 tx=0x7f6f28009b30).stop 2023-10-18T21:35:13.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.563+0000 7f6f393d2700 1 -- 172.21.15.8:0/3235355045 shutdown_connections 2023-10-18T21:35:13.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.563+0000 7f6f393d2700 1 --2- 172.21.15.8:0/3235355045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f340f77d0 0x7f6f340f7c30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.563+0000 7f6f393d2700 1 --2- 172.21.15.8:0/3235355045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340f6530 0x7f6f340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.563+0000 7f6f393d2700 1 -- 172.21.15.8:0/3235355045 >> 172.21.15.8:0/3235355045 conn(0x7f6f340f1c90 msgr2=0x7f6f340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.563+0000 7f6f393d2700 1 -- 172.21.15.8:0/3235355045 shutdown_connections 2023-10-18T21:35:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.563+0000 7f6f393d2700 1 -- 172.21.15.8:0/3235355045 wait complete. 2023-10-18T21:35:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.564+0000 7f6f393d2700 1 Processor -- start 2023-10-18T21:35:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.564+0000 7f6f393d2700 1 -- start start 2023-10-18T21:35:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f393d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340f6530 0x7f6f34108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f393d2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f340f77d0 0x7f6f34109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f393d2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f34109a20 con 0x7f6f340f77d0 2023-10-18T21:35:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f393d2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f34109b60 con 0x7f6f340f6530 2023-10-18T21:35:13.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f340f77d0 0x7f6f34109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:13.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f340f77d0 0x7f6f34109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42330/0 (socket says 172.21.15.8:42330) 2023-10-18T21:35:13.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f337fe700 1 -- 172.21.15.8:0/1366869056 learned_addr learned my addr 172.21.15.8:0/1366869056 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:13.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f33fff700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340f6530 0x7f6f34108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:13.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f337fe700 1 -- 172.21.15.8:0/1366869056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340f6530 msgr2=0x7f6f34108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f337fe700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340f6530 0x7f6f34108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.565+0000 7f6f337fe700 1 -- 172.21.15.8:0/1366869056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28005040 con 0x7f6f340f77d0 2023-10-18T21:35:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.566+0000 7f6f337fe700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f340f77d0 0x7f6f34109470 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f6f28009f50 tx=0x7f6f28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.566+0000 7f6f30ff9700 1 -- 172.21.15.8:0/1366869056 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f28018070 con 0x7f6f340f77d0 2023-10-18T21:35:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.566+0000 7f6f393d2700 1 -- 172.21.15.8:0/1366869056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3410a4a0 con 0x7f6f340f77d0 2023-10-18T21:35:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.566+0000 7f6f30ff9700 1 -- 172.21.15.8:0/1366869056 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6f28009630 con 0x7f6f340f77d0 2023-10-18T21:35:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.566+0000 7f6f30ff9700 1 -- 172.21.15.8:0/1366869056 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f2801c3c0 con 0x7f6f340f77d0 2023-10-18T21:35:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.566+0000 7f6f393d2700 1 -- 172.21.15.8:0/1366869056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3410aa00 con 0x7f6f340f77d0 2023-10-18T21:35:13.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.567+0000 7f6f393d2700 1 -- 172.21.15.8:0/1366869056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f34045ad0 con 0x7f6f340f77d0 2023-10-18T21:35:13.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.568+0000 7f6f30ff9700 1 -- 172.21.15.8:0/1366869056 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6f2801d420 con 0x7f6f340f77d0 2023-10-18T21:35:13.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.569+0000 7f6f30ff9700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f1c060f70 0x7f6f1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:13.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.569+0000 7f6f30ff9700 1 -- 172.21.15.8:0/1366869056 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6f2807e650 con 0x7f6f340f77d0 2023-10-18T21:35:13.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.569+0000 7f6f33fff700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f1c060f70 0x7f6f1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:13.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.570+0000 7f6f33fff700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f1c060f70 0x7f6f1c063430 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f6f340f7630 tx=0x7f6f24009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:13.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.573+0000 7f6f30ff9700 1 -- 172.21.15.8:0/1366869056 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6f28051cf0 con 0x7f6f340f77d0 2023-10-18T21:35:13.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.772+0000 7f6f393d2700 1 -- 172.21.15.8:0/1366869056 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f340fedd0 con 0x7f6f1c060f70 2023-10-18T21:35:13.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.773+0000 7f6f30ff9700 1 -- 172.21.15.8:0/1366869056 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6f340fedd0 con 0x7f6f1c060f70 2023-10-18T21:35:13.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.775+0000 7f6f393d2700 1 -- 172.21.15.8:0/1366869056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f1c060f70 msgr2=0x7f6f1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:13.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.775+0000 7f6f393d2700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f1c060f70 0x7f6f1c063430 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f6f340f7630 tx=0x7f6f24009c00).stop 2023-10-18T21:35:13.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.775+0000 7f6f393d2700 1 -- 172.21.15.8:0/1366869056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f340f77d0 msgr2=0x7f6f34109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:13.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.775+0000 7f6f393d2700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f340f77d0 0x7f6f34109470 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f6f28009f50 tx=0x7f6f28009b30).stop 2023-10-18T21:35:13.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.775+0000 7f6f393d2700 1 -- 172.21.15.8:0/1366869056 shutdown_connections 2023-10-18T21:35:13.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.775+0000 7f6f393d2700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6f1c060f70 0x7f6f1c063430 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.775+0000 7f6f393d2700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340f6530 0x7f6f34108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.775+0000 7f6f393d2700 1 --2- 172.21.15.8:0/1366869056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f340f77d0 0x7f6f34109470 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.775+0000 7f6f393d2700 1 -- 172.21.15.8:0/1366869056 >> 172.21.15.8:0/1366869056 conn(0x7f6f340f1c90 msgr2=0x7f6f3406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:13.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.776+0000 7f6f393d2700 1 -- 172.21.15.8:0/1366869056 shutdown_connections 2023-10-18T21:35:13.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.776+0000 7f6f393d2700 1 -- 172.21.15.8:0/1366869056 wait complete. 2023-10-18T21:35:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.912+0000 7fc5cb09c700 1 -- 172.21.15.8:0/695404281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c40f77d0 msgr2=0x7fc5c40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.912+0000 7fc5cb09c700 1 --2- 172.21.15.8:0/695404281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c40f77d0 0x7fc5c40f7c30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fc5b4004660 tx=0x7fc5b4009b30).stop 2023-10-18T21:35:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.912+0000 7fc5cb09c700 1 -- 172.21.15.8:0/695404281 shutdown_connections 2023-10-18T21:35:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.912+0000 7fc5cb09c700 1 --2- 172.21.15.8:0/695404281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c40f77d0 0x7fc5c40f7c30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.912+0000 7fc5cb09c700 1 --2- 172.21.15.8:0/695404281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c40f6530 0x7fc5c40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.912+0000 7fc5cb09c700 1 -- 172.21.15.8:0/695404281 >> 172.21.15.8:0/695404281 conn(0x7fc5c40f1c90 msgr2=0x7fc5c40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.912+0000 7fc5cb09c700 1 -- 172.21.15.8:0/695404281 shutdown_connections 2023-10-18T21:35:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.912+0000 7fc5cb09c700 1 -- 172.21.15.8:0/695404281 wait complete. 2023-10-18T21:35:13.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.913+0000 7fc5cb09c700 1 Processor -- start 2023-10-18T21:35:13.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.913+0000 7fc5cb09c700 1 -- start start 2023-10-18T21:35:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.913+0000 7fc5cb09c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c40f6530 0x7fc5c4108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.913+0000 7fc5cb09c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c40f77d0 0x7fc5c4109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.913+0000 7fc5cb09c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4109a20 con 0x7fc5c40f77d0 2023-10-18T21:35:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.913+0000 7fc5cb09c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4109b60 con 0x7fc5c40f6530 2023-10-18T21:35:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.914+0000 7fc5c9899700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c40f77d0 0x7fc5c4109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.914+0000 7fc5c9899700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c40f77d0 0x7fc5c4109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42344/0 (socket says 172.21.15.8:42344) 2023-10-18T21:35:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.914+0000 7fc5c9899700 1 -- 172.21.15.8:0/2624946398 learned_addr learned my addr 172.21.15.8:0/2624946398 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.914+0000 7fc5ca09a700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c40f6530 0x7fc5c4108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.914+0000 7fc5c9899700 1 -- 172.21.15.8:0/2624946398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c40f6530 msgr2=0x7fc5c4108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.914+0000 7fc5c9899700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c40f6530 0x7fc5c4108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.914+0000 7fc5c9899700 1 -- 172.21.15.8:0/2624946398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b4005040 con 0x7fc5c40f77d0 2023-10-18T21:35:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.914+0000 7fc5c9899700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c40f77d0 0x7fc5c4109470 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fc5b4009990 tx=0x7fc5b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.915+0000 7fc5baffd700 1 -- 172.21.15.8:0/2624946398 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b4018070 con 0x7fc5c40f77d0 2023-10-18T21:35:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.915+0000 7fc5baffd700 1 -- 172.21.15.8:0/2624946398 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc5b4009630 con 0x7fc5c40f77d0 2023-10-18T21:35:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.915+0000 7fc5cb09c700 1 -- 172.21.15.8:0/2624946398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c410a4a0 con 0x7fc5c40f77d0 2023-10-18T21:35:13.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.915+0000 7fc5baffd700 1 -- 172.21.15.8:0/2624946398 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b401c400 con 0x7fc5c40f77d0 2023-10-18T21:35:13.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.915+0000 7fc5cb09c700 1 -- 172.21.15.8:0/2624946398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c410aa00 con 0x7fc5c40f77d0 2023-10-18T21:35:13.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.916+0000 7fc5cb09c700 1 -- 172.21.15.8:0/2624946398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c4045ad0 con 0x7fc5c40f77d0 2023-10-18T21:35:13.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.917+0000 7fc5baffd700 1 -- 172.21.15.8:0/2624946398 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc5b401d9e0 con 0x7fc5c40f77d0 2023-10-18T21:35:13.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.918+0000 7fc5baffd700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b0060f70 0x7fc5b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:13.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.918+0000 7fc5baffd700 1 -- 172.21.15.8:0/2624946398 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc5b407e680 con 0x7fc5c40f77d0 2023-10-18T21:35:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.918+0000 7fc5ca09a700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b0060f70 0x7fc5b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.919+0000 7fc5ca09a700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b0060f70 0x7fc5b0063430 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fc5c40f7630 tx=0x7fc5c0009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:13.922+0000 7fc5baffd700 1 -- 172.21.15.8:0/2624946398 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc5b4051ce0 con 0x7fc5c40f77d0 2023-10-18T21:35:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.121+0000 7fc5cb09c700 1 -- 172.21.15.8:0/2624946398 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5c40fee30 con 0x7fc5b0060f70 2023-10-18T21:35:14.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.131+0000 7fc5baffd700 1 -- 172.21.15.8:0/2624946398 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc5c40fee30 con 0x7fc5b0060f70 2023-10-18T21:35:14.133 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:35:14.134 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (41m) 9m ago 43m 16.9M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:35:14.134 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (35m) 9m ago 43m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:35:14.134 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (35m) 7m ago 42m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:35:14.134 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (41m) 9m ago 43m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:35:14.134 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 39m - - 2023-10-18T21:35:14.135 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 39m - - 2023-10-18T21:35:14.135 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 39m - - 2023-10-18T21:35:14.135 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 39m - - 2023-10-18T21:35:14.135 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (37m) 9m ago 44m 490M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:35:14.135 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (36m) 7m ago 42m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:35:14.136 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (36m) 9m ago 44m 265M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:35:14.136 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (36m) 7m ago 42m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:35:14.136 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (42m) 9m ago 42m 10.2M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:35:14.136 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (42m) 7m ago 42m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:35:14.136 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (35m) 9m ago 41m 491M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:35:14.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (33m) 9m ago 41m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:35:14.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (32m) 9m ago 41m 294M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:35:14.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (32m) 7m ago 41m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:35:14.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (31m) 7m ago 40m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:35:14.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (31m) 7m ago 40m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:35:14.137 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (37m) 9m ago 42m 67.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:35:14.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 -- 172.21.15.8:0/2624946398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b0060f70 msgr2=0x7fc5b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:14.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b0060f70 0x7fc5b0063430 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fc5c40f7630 tx=0x7fc5c0009c00).stop 2023-10-18T21:35:14.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 -- 172.21.15.8:0/2624946398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c40f77d0 msgr2=0x7fc5c4109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:14.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c40f77d0 0x7fc5c4109470 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fc5b4009990 tx=0x7fc5b4009b30).stop 2023-10-18T21:35:14.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 -- 172.21.15.8:0/2624946398 shutdown_connections 2023-10-18T21:35:14.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b0060f70 0x7fc5b0063430 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c40f6530 0x7fc5c4108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 --2- 172.21.15.8:0/2624946398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c40f77d0 0x7fc5c4109470 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 -- 172.21.15.8:0/2624946398 >> 172.21.15.8:0/2624946398 conn(0x7fc5c40f1c90 msgr2=0x7fc5c406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:14.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 -- 172.21.15.8:0/2624946398 shutdown_connections 2023-10-18T21:35:14.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.133+0000 7fc5cb09c700 1 -- 172.21.15.8:0/2624946398 wait complete. 2023-10-18T21:35:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.269+0000 7f294daf1700 1 -- 172.21.15.8:0/3880141010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29480f77d0 msgr2=0x7f29480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.269+0000 7f294daf1700 1 --2- 172.21.15.8:0/3880141010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29480f77d0 0x7f29480f7c30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f2934004660 tx=0x7f2934009b30).stop 2023-10-18T21:35:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.270+0000 7f294daf1700 1 -- 172.21.15.8:0/3880141010 shutdown_connections 2023-10-18T21:35:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.270+0000 7f294daf1700 1 --2- 172.21.15.8:0/3880141010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29480f77d0 0x7f29480f7c30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.270+0000 7f294daf1700 1 --2- 172.21.15.8:0/3880141010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29480f6530 0x7f29480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.270+0000 7f294daf1700 1 -- 172.21.15.8:0/3880141010 >> 172.21.15.8:0/3880141010 conn(0x7f29480f1c90 msgr2=0x7f29480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.270+0000 7f294daf1700 1 -- 172.21.15.8:0/3880141010 shutdown_connections 2023-10-18T21:35:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.270+0000 7f294daf1700 1 -- 172.21.15.8:0/3880141010 wait complete. 2023-10-18T21:35:14.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.270+0000 7f294daf1700 1 Processor -- start 2023-10-18T21:35:14.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.271+0000 7f294daf1700 1 -- start start 2023-10-18T21:35:14.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.271+0000 7f294daf1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29480f6530 0x7f2948108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:14.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.271+0000 7f294daf1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29480f77d0 0x7f2948109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.271+0000 7f294daf1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29481099c0 con 0x7f29480f6530 2023-10-18T21:35:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.271+0000 7f294daf1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2948109b00 con 0x7f29480f77d0 2023-10-18T21:35:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.271+0000 7f294caef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29480f6530 0x7f2948108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.271+0000 7f2947fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29480f77d0 0x7f2948109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.271+0000 7f294caef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29480f6530 0x7f2948108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42354/0 (socket says 172.21.15.8:42354) 2023-10-18T21:35:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.271+0000 7f2947fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29480f77d0 0x7f2948109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:52132/0 (socket says 172.21.15.8:52132) 2023-10-18T21:35:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.271+0000 7f294caef700 1 -- 172.21.15.8:0/148310277 learned_addr learned my addr 172.21.15.8:0/148310277 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.272+0000 7f294caef700 1 -- 172.21.15.8:0/148310277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29480f77d0 msgr2=0x7f2948109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.272+0000 7f294caef700 1 --2- 172.21.15.8:0/148310277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29480f77d0 0x7f2948109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.272+0000 7f294caef700 1 -- 172.21.15.8:0/148310277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934005040 con 0x7f29480f6530 2023-10-18T21:35:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.272+0000 7f294caef700 1 --2- 172.21.15.8:0/148310277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29480f6530 0x7f2948108f20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f293c00e7c0 tx=0x7f293c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.272+0000 7f29457fa700 1 -- 172.21.15.8:0/148310277 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f293c0092e0 con 0x7f29480f6530 2023-10-18T21:35:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.272+0000 7f29457fa700 1 -- 172.21.15.8:0/148310277 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f293c00f040 con 0x7f29480f6530 2023-10-18T21:35:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.272+0000 7f29457fa700 1 -- 172.21.15.8:0/148310277 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f293c014810 con 0x7f29480f6530 2023-10-18T21:35:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.272+0000 7f294daf1700 1 -- 172.21.15.8:0/148310277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294810a4a0 con 0x7f29480f6530 2023-10-18T21:35:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.272+0000 7f294daf1700 1 -- 172.21.15.8:0/148310277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294810a9e0 con 0x7f29480f6530 2023-10-18T21:35:14.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.273+0000 7f294daf1700 1 -- 172.21.15.8:0/148310277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2948045ad0 con 0x7f29480f6530 2023-10-18T21:35:14.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.274+0000 7f29457fa700 1 -- 172.21.15.8:0/148310277 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f293c01b030 con 0x7f29480f6530 2023-10-18T21:35:14.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.275+0000 7f29457fa700 1 --2- 172.21.15.8:0/148310277 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2938060f70 0x7f2938063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:14.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.275+0000 7f29457fa700 1 -- 172.21.15.8:0/148310277 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f293c07c880 con 0x7f29480f6530 2023-10-18T21:35:14.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.276+0000 7f2947fff700 1 --2- 172.21.15.8:0/148310277 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2938060f70 0x7f2938063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:14.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.276+0000 7f2947fff700 1 --2- 172.21.15.8:0/148310277 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2938060f70 0x7f2938063430 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f2934009720 tx=0x7f2934016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.280+0000 7f29457fa700 1 -- 172.21.15.8:0/148310277 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f293c04fe60 con 0x7f29480f6530 2023-10-18T21:35:14.289 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.424085+0000 mgr.smithi008.flmjzp (mgr.14640) 2182 : audit [DBG] from='client.35896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:14.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.774688+0000 mgr.smithi008.flmjzp (mgr.14640) 2183 : audit [DBG] from='client.35900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:14.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:13.922742+0000 mgr.smithi008.flmjzp (mgr.14640) 2184 : cluster [DBG] pgmap v1508: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:14.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.952434+0000 mon.smithi008 (mon.0) 2613 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:14.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.954082+0000 mon.smithi008 (mon.0) 2614 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:35:14.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.954748+0000 mon.smithi008 (mon.0) 2615 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:35:14.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:13.955403+0000 mgr.smithi008.flmjzp (mgr.14640) 2185 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:35:14.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:13.955871+0000 mgr.smithi008.flmjzp (mgr.14640) 2186 : cluster [DBG] pgmap v1509: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:14.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:13.956111+0000 mgr.smithi008.flmjzp (mgr.14640) 2187 : cluster [DBG] pgmap v1510: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:14.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.960097+0000 mon.smithi008 (mon.0) 2616 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:14.292 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.965106+0000 mon.smithi008 (mon.0) 2617 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:14.292 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.967534+0000 mon.smithi008 (mon.0) 2618 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:14.292 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.968870+0000 mon.smithi008 (mon.0) 2619 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:14.292 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.970150+0000 mon.smithi008 (mon.0) 2620 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:14.292 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:13.971714+0000 mon.smithi008 (mon.0) 2621 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.424085+0000 mgr.smithi008.flmjzp (mgr.14640) 2182 : audit [DBG] from='client.35896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.774688+0000 mgr.smithi008.flmjzp (mgr.14640) 2183 : audit [DBG] from='client.35900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:13.922742+0000 mgr.smithi008.flmjzp (mgr.14640) 2184 : cluster [DBG] pgmap v1508: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.952434+0000 mon.smithi008 (mon.0) 2613 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.954082+0000 mon.smithi008 (mon.0) 2614 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:35:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.954748+0000 mon.smithi008 (mon.0) 2615 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:35:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:13.955403+0000 mgr.smithi008.flmjzp (mgr.14640) 2185 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:35:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:13.955871+0000 mgr.smithi008.flmjzp (mgr.14640) 2186 : cluster [DBG] pgmap v1509: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:13.956111+0000 mgr.smithi008.flmjzp (mgr.14640) 2187 : cluster [DBG] pgmap v1510: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:14.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.960097+0000 mon.smithi008 (mon.0) 2616 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:14.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.965106+0000 mon.smithi008 (mon.0) 2617 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:14.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.967534+0000 mon.smithi008 (mon.0) 2618 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:14.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.968870+0000 mon.smithi008 (mon.0) 2619 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:14.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.970150+0000 mon.smithi008 (mon.0) 2620 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:14.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:13.971714+0000 mon.smithi008 (mon.0) 2621 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.536+0000 7f294daf1700 1 -- 172.21.15.8:0/148310277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f294810acb0 con 0x7f29480f6530 2023-10-18T21:35:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.536+0000 7f29457fa700 1 -- 172.21.15.8:0/148310277 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f293c019070 con 0x7f29480f6530 2023-10-18T21:35:14.539 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:35:14.539 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:35:14.540 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:35:14.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:35:14.540 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:35:14.541 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:35:14.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:35:14.541 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:35:14.542 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:35:14.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:35:14.542 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:35:14.543 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:35:14.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:35:14.543 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:35:14.543 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:35:14.544 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:35:14.544 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:35:14.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.538+0000 7f294daf1700 1 -- 172.21.15.8:0/148310277 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2938060f70 msgr2=0x7f2938063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:14.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.538+0000 7f294daf1700 1 --2- 172.21.15.8:0/148310277 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2938060f70 0x7f2938063430 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f2934009720 tx=0x7f2934016040).stop 2023-10-18T21:35:14.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.538+0000 7f294daf1700 1 -- 172.21.15.8:0/148310277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29480f6530 msgr2=0x7f2948108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:14.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.538+0000 7f294daf1700 1 --2- 172.21.15.8:0/148310277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29480f6530 0x7f2948108f20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f293c00e7c0 tx=0x7f293c00b040).stop 2023-10-18T21:35:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.539+0000 7f294daf1700 1 -- 172.21.15.8:0/148310277 shutdown_connections 2023-10-18T21:35:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.539+0000 7f294daf1700 1 --2- 172.21.15.8:0/148310277 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2938060f70 0x7f2938063430 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.539+0000 7f294daf1700 1 --2- 172.21.15.8:0/148310277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29480f6530 0x7f2948108f20 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.539+0000 7f294daf1700 1 --2- 172.21.15.8:0/148310277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29480f77d0 0x7f2948109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.539+0000 7f294daf1700 1 -- 172.21.15.8:0/148310277 >> 172.21.15.8:0/148310277 conn(0x7f29480f1c90 msgr2=0x7f294806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.539+0000 7f294daf1700 1 -- 172.21.15.8:0/148310277 shutdown_connections 2023-10-18T21:35:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.539+0000 7f294daf1700 1 -- 172.21.15.8:0/148310277 wait complete. 2023-10-18T21:35:14.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.675+0000 7fe235b76700 1 -- 172.21.15.8:0/2132581600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2300f77d0 msgr2=0x7fe2300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:14.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.675+0000 7fe235b76700 1 --2- 172.21.15.8:0/2132581600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2300f77d0 0x7fe2300f7c30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fe21c004660 tx=0x7fe21c009b30).stop 2023-10-18T21:35:14.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.675+0000 7fe235b76700 1 -- 172.21.15.8:0/2132581600 shutdown_connections 2023-10-18T21:35:14.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.675+0000 7fe235b76700 1 --2- 172.21.15.8:0/2132581600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2300f77d0 0x7fe2300f7c30 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.675+0000 7fe235b76700 1 --2- 172.21.15.8:0/2132581600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2300f6530 0x7fe2300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.675+0000 7fe235b76700 1 -- 172.21.15.8:0/2132581600 >> 172.21.15.8:0/2132581600 conn(0x7fe2300f1c90 msgr2=0x7fe2300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:14.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.675+0000 7fe235b76700 1 -- 172.21.15.8:0/2132581600 shutdown_connections 2023-10-18T21:35:14.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.675+0000 7fe235b76700 1 -- 172.21.15.8:0/2132581600 wait complete. 2023-10-18T21:35:14.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.676+0000 7fe235b76700 1 Processor -- start 2023-10-18T21:35:14.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.676+0000 7fe235b76700 1 -- start start 2023-10-18T21:35:14.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe235b76700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2300f6530 0x7fe230108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:14.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe235b76700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2300f77d0 0x7fe230109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:14.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe235b76700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe230109a20 con 0x7fe2300f77d0 2023-10-18T21:35:14.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe235b76700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe230109b60 con 0x7fe2300f6530 2023-10-18T21:35:14.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe22ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2300f77d0 0x7fe230109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:14.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe22ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2300f77d0 0x7fe230109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42368/0 (socket says 172.21.15.8:42368) 2023-10-18T21:35:14.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe22ffff700 1 -- 172.21.15.8:0/1424943293 learned_addr learned my addr 172.21.15.8:0/1424943293 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:14.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe234b74700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2300f6530 0x7fe230108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:14.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe22ffff700 1 -- 172.21.15.8:0/1424943293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2300f6530 msgr2=0x7fe230108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:14.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe22ffff700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2300f6530 0x7fe230108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.677+0000 7fe22ffff700 1 -- 172.21.15.8:0/1424943293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c005040 con 0x7fe2300f77d0 2023-10-18T21:35:14.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.678+0000 7fe22ffff700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2300f77d0 0x7fe230109470 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fe21c009f50 tx=0x7fe21c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:14.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.678+0000 7fe22d7fa700 1 -- 172.21.15.8:0/1424943293 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21c018070 con 0x7fe2300f77d0 2023-10-18T21:35:14.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.678+0000 7fe22d7fa700 1 -- 172.21.15.8:0/1424943293 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe21c009630 con 0x7fe2300f77d0 2023-10-18T21:35:14.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.678+0000 7fe235b76700 1 -- 172.21.15.8:0/1424943293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23010a4a0 con 0x7fe2300f77d0 2023-10-18T21:35:14.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.678+0000 7fe22d7fa700 1 -- 172.21.15.8:0/1424943293 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21c01c3c0 con 0x7fe2300f77d0 2023-10-18T21:35:14.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.678+0000 7fe235b76700 1 -- 172.21.15.8:0/1424943293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23010aa00 con 0x7fe2300f77d0 2023-10-18T21:35:14.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.679+0000 7fe235b76700 1 -- 172.21.15.8:0/1424943293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe230045ad0 con 0x7fe2300f77d0 2023-10-18T21:35:14.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.680+0000 7fe22d7fa700 1 -- 172.21.15.8:0/1424943293 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe21c01d420 con 0x7fe2300f77d0 2023-10-18T21:35:14.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.681+0000 7fe22d7fa700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe220060f70 0x7fe220063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:14.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.681+0000 7fe22d7fa700 1 -- 172.21.15.8:0/1424943293 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe21c07e480 con 0x7fe2300f77d0 2023-10-18T21:35:14.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.681+0000 7fe234b74700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe220060f70 0x7fe220063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:14.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.682+0000 7fe234b74700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe220060f70 0x7fe220063430 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fe2300f7630 tx=0x7fe22400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:14.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.686+0000 7fe22d7fa700 1 -- 172.21.15.8:0/1424943293 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe21c051ba0 con 0x7fe2300f77d0 2023-10-18T21:35:14.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.912+0000 7fe235b76700 1 -- 172.21.15.8:0/1424943293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe2300fed60 con 0x7fe2300f77d0 2023-10-18T21:35:14.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.913+0000 7fe22d7fa700 1 -- 172.21.15.8:0/1424943293 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fe21c051790 con 0x7fe2300f77d0 2023-10-18T21:35:14.915 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:35:14.915 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:35:14.915 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:35:14.916 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:35:14.916 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:35:14.916 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:35:14.916 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:35:14.917 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:35:14.917 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:35:14.917 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:35:14.917 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:35:14.917 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:35:14.917 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:35:14.918 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:35:14.918 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:35:14.918 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:35:14.918 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:35:14.918 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:35:14.919 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:35:14.919 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:35:14.919 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:35:14.919 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:35:14.919 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:35:14.919 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:35:14.920 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:35:14.920 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:35:14.920 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:35:14.920 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:35:14.920 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:35:14.921 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:35:14.921 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:35:14.921 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:35:14.921 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:35:14.921 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:35:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 -- 172.21.15.8:0/1424943293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe220060f70 msgr2=0x7fe220063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe220060f70 0x7fe220063430 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fe2300f7630 tx=0x7fe22400b040).stop 2023-10-18T21:35:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 -- 172.21.15.8:0/1424943293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2300f77d0 msgr2=0x7fe230109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2300f77d0 0x7fe230109470 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fe21c009f50 tx=0x7fe21c009b30).stop 2023-10-18T21:35:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 -- 172.21.15.8:0/1424943293 shutdown_connections 2023-10-18T21:35:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe220060f70 0x7fe220063430 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2300f6530 0x7fe230108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 --2- 172.21.15.8:0/1424943293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2300f77d0 0x7fe230109470 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 -- 172.21.15.8:0/1424943293 >> 172.21.15.8:0/1424943293 conn(0x7fe2300f1c90 msgr2=0x7fe23006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 -- 172.21.15.8:0/1424943293 shutdown_connections 2023-10-18T21:35:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:14.915+0000 7fe235b76700 1 -- 172.21.15.8:0/1424943293 wait complete. 2023-10-18T21:35:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:35:15.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.052+0000 7f1c4229a700 1 -- 172.21.15.8:0/162167627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c3c0f77d0 msgr2=0x7f1c3c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:15.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.052+0000 7f1c4229a700 1 --2- 172.21.15.8:0/162167627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c3c0f77d0 0x7f1c3c0f7c30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f1c2c004660 tx=0x7f1c2c009b30).stop 2023-10-18T21:35:15.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.053+0000 7f1c4229a700 1 -- 172.21.15.8:0/162167627 shutdown_connections 2023-10-18T21:35:15.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.053+0000 7f1c4229a700 1 --2- 172.21.15.8:0/162167627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c3c0f77d0 0x7f1c3c0f7c30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.053+0000 7f1c4229a700 1 --2- 172.21.15.8:0/162167627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c3c0f6530 0x7f1c3c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.053+0000 7f1c4229a700 1 -- 172.21.15.8:0/162167627 >> 172.21.15.8:0/162167627 conn(0x7f1c3c0f1c90 msgr2=0x7f1c3c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.053+0000 7f1c4229a700 1 -- 172.21.15.8:0/162167627 shutdown_connections 2023-10-18T21:35:15.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.053+0000 7f1c4229a700 1 -- 172.21.15.8:0/162167627 wait complete. 2023-10-18T21:35:15.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.053+0000 7f1c4229a700 1 Processor -- start 2023-10-18T21:35:15.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.054+0000 7f1c4229a700 1 -- start start 2023-10-18T21:35:15.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.054+0000 7f1c4229a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c3c0f6530 0x7f1c3c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:15.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.054+0000 7f1c4229a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c3c0f77d0 0x7f1c3c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:15.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.054+0000 7f1c4229a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c06a380 con 0x7f1c3c0f6530 2023-10-18T21:35:15.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.054+0000 7f1c4229a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c06a4c0 con 0x7f1c3c0f77d0 2023-10-18T21:35:15.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.054+0000 7f1c41298700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c3c0f6530 0x7f1c3c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:15.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.054+0000 7f1c41298700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c3c0f6530 0x7f1c3c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42378/0 (socket says 172.21.15.8:42378) 2023-10-18T21:35:15.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.054+0000 7f1c41298700 1 -- 172.21.15.8:0/2806341800 learned_addr learned my addr 172.21.15.8:0/2806341800 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:15.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.054+0000 7f1c40a97700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c3c0f77d0 0x7f1c3c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:15.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.055+0000 7f1c41298700 1 -- 172.21.15.8:0/2806341800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c3c0f77d0 msgr2=0x7f1c3c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:15.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.055+0000 7f1c41298700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c3c0f77d0 0x7f1c3c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:15.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.055+0000 7f1c41298700 1 -- 172.21.15.8:0/2806341800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c005040 con 0x7f1c3c0f6530 2023-10-18T21:35:15.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.055+0000 7f1c41298700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c3c0f6530 0x7f1c3c06b9a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f1c38002700 tx=0x7f1c38009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:15.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.055+0000 7f1c31ffb700 1 -- 172.21.15.8:0/2806341800 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c380079c0 con 0x7f1c3c0f6530 2023-10-18T21:35:15.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.055+0000 7f1c31ffb700 1 -- 172.21.15.8:0/2806341800 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1c3800f040 con 0x7f1c3c0f6530 2023-10-18T21:35:15.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.055+0000 7f1c4229a700 1 -- 172.21.15.8:0/2806341800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c06a7a0 con 0x7f1c3c0f6530 2023-10-18T21:35:15.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.055+0000 7f1c31ffb700 1 -- 172.21.15.8:0/2806341800 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c380148d0 con 0x7f1c3c0f6530 2023-10-18T21:35:15.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.055+0000 7f1c4229a700 1 -- 172.21.15.8:0/2806341800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c10ed70 con 0x7f1c3c0f6530 2023-10-18T21:35:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.057+0000 7f1c4229a700 1 -- 172.21.15.8:0/2806341800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c045ad0 con 0x7f1c3c0f6530 2023-10-18T21:35:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.058+0000 7f1c31ffb700 1 -- 172.21.15.8:0/2806341800 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1c3801b060 con 0x7f1c3c0f6530 2023-10-18T21:35:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.058+0000 7f1c31ffb700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 0x7f1c28063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.058+0000 7f1c31ffb700 1 -- 172.21.15.8:0/2806341800 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1c3807c770 con 0x7f1c3c0f6530 2023-10-18T21:35:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.059+0000 7f1c40a97700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 0x7f1c28063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.059+0000 7f1c40a97700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 0x7f1c28063430 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f1c2c004630 tx=0x7f1c2c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:15.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.063+0000 7f1c31ffb700 1 -- 172.21.15.8:0/2806341800 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1c3804c3a0 con 0x7f1c3c0f6530 2023-10-18T21:35:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.264+0000 7f1c4229a700 1 -- 172.21.15.8:0/2806341800 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c3c0fee30 con 0x7f1c28060f70 2023-10-18T21:35:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.265+0000 7f1c31ffb700 1 -- 172.21.15.8:0/2806341800 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1c3c0fee30 con 0x7f1c28060f70 2023-10-18T21:35:15.267 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:35:15.267 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:35:15.268 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:35:15.268 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:35:15.268 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:35:15.268 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:35:15.268 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:35:15.269 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:35:15.269 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:35:15.269 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:35:15.269 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:35:15.269 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:35:15.270 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:35:15.270 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:35:15.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.267+0000 7f1c4229a700 1 -- 172.21.15.8:0/2806341800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 msgr2=0x7f1c28063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:15.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.267+0000 7f1c4229a700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 0x7f1c28063430 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f1c2c004630 tx=0x7f1c2c009b30).stop 2023-10-18T21:35:15.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.267+0000 7f1c4229a700 1 -- 172.21.15.8:0/2806341800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c3c0f6530 msgr2=0x7f1c3c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:15.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.267+0000 7f1c4229a700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c3c0f6530 0x7f1c3c06b9a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f1c38002700 tx=0x7f1c38009d80).stop 2023-10-18T21:35:15.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.267+0000 7f1c4229a700 1 -- 172.21.15.8:0/2806341800 shutdown_connections 2023-10-18T21:35:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.267+0000 7f1c4229a700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 0x7f1c28063430 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.267+0000 7f1c4229a700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c3c0f6530 0x7f1c3c06b9a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.267+0000 7f1c4229a700 1 --2- 172.21.15.8:0/2806341800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c3c0f77d0 0x7f1c3c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.267+0000 7f1c4229a700 1 -- 172.21.15.8:0/2806341800 >> 172.21.15.8:0/2806341800 conn(0x7f1c3c0f1c90 msgr2=0x7f1c3c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.267+0000 7f1c4229a700 1 -- 172.21.15.8:0/2806341800 shutdown_connections 2023-10-18T21:35:15.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:15.268+0000 7f1c4229a700 1 -- 172.21.15.8:0/2806341800 wait complete. 2023-10-18T21:35:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:13.973275+0000 mgr.smithi008.flmjzp (mgr.14640) 2188 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:35:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:14.123770+0000 mgr.smithi008.flmjzp (mgr.14640) 2189 : audit [DBG] from='client.35904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:14.537891+0000 mon.smithi008 (mon.0) 2622 : audit [DBG] from='client.? 172.21.15.8:0/148310277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:14.914354+0000 mon.smithi008 (mon.0) 2623 : audit [DBG] from='client.? 172.21.15.8:0/1424943293' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:35:15.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:13.973275+0000 mgr.smithi008.flmjzp (mgr.14640) 2188 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:35:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:14.123770+0000 mgr.smithi008.flmjzp (mgr.14640) 2189 : audit [DBG] from='client.35904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:14.537891+0000 mon.smithi008 (mon.0) 2622 : audit [DBG] from='client.? 172.21.15.8:0/148310277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:14.914354+0000 mon.smithi008 (mon.0) 2623 : audit [DBG] from='client.? 172.21.15.8:0/1424943293' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:35:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:15.266686+0000 mgr.smithi008.flmjzp (mgr.14640) 2190 : audit [DBG] from='client.35916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:15.956683+0000 mgr.smithi008.flmjzp (mgr.14640) 2191 : cluster [DBG] pgmap v1511: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:15.266686+0000 mgr.smithi008.flmjzp (mgr.14640) 2190 : audit [DBG] from='client.35916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:15.956683+0000 mgr.smithi008.flmjzp (mgr.14640) 2191 : cluster [DBG] pgmap v1511: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:18.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:17.957260+0000 mgr.smithi008.flmjzp (mgr.14640) 2192 : cluster [DBG] pgmap v1512: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:18.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:17.957260+0000 mgr.smithi008.flmjzp (mgr.14640) 2192 : cluster [DBG] pgmap v1512: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:19.957862+0000 mgr.smithi008.flmjzp (mgr.14640) 2193 : cluster [DBG] pgmap v1513: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:20.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:19.957862+0000 mgr.smithi008.flmjzp (mgr.14640) 2193 : cluster [DBG] pgmap v1513: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:22.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:21.958483+0000 mgr.smithi008.flmjzp (mgr.14640) 2194 : cluster [DBG] pgmap v1514: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:22.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:21.958483+0000 mgr.smithi008.flmjzp (mgr.14640) 2194 : cluster [DBG] pgmap v1514: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:24.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:23.959205+0000 mgr.smithi008.flmjzp (mgr.14640) 2195 : cluster [DBG] pgmap v1515: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:24.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:23.983998+0000 mon.smithi008 (mon.0) 2624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:24.290 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:23.986336+0000 mon.smithi008 (mon.0) 2625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:35:24.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:23.987421+0000 mon.smithi008 (mon.0) 2626 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:35:24.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:23.994202+0000 mon.smithi008 (mon.0) 2627 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:24.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:24.000674+0000 mon.smithi008 (mon.0) 2628 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:24.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:24.003770+0000 mon.smithi008 (mon.0) 2629 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:24.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:24.005456+0000 mon.smithi008 (mon.0) 2630 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:24.292 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:24.007153+0000 mon.smithi008 (mon.0) 2631 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:24.292 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:24.009059+0000 mon.smithi008 (mon.0) 2632 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:24.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:23.959205+0000 mgr.smithi008.flmjzp (mgr.14640) 2195 : cluster [DBG] pgmap v1515: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:24.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:23.983998+0000 mon.smithi008 (mon.0) 2624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:24.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:23.986336+0000 mon.smithi008 (mon.0) 2625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:35:24.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:23.987421+0000 mon.smithi008 (mon.0) 2626 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:35:24.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:23.994202+0000 mon.smithi008 (mon.0) 2627 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:24.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:24.000674+0000 mon.smithi008 (mon.0) 2628 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:24.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:24.003770+0000 mon.smithi008 (mon.0) 2629 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:24.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:24.005456+0000 mon.smithi008 (mon.0) 2630 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:24.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:24.007153+0000 mon.smithi008 (mon.0) 2631 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:24.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:24.009059+0000 mon.smithi008 (mon.0) 2632 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:23.988374+0000 mgr.smithi008.flmjzp (mgr.14640) 2196 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:35:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:23.989064+0000 mgr.smithi008.flmjzp (mgr.14640) 2197 : cluster [DBG] pgmap v1516: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:23.989328+0000 mgr.smithi008.flmjzp (mgr.14640) 2198 : cluster [DBG] pgmap v1517: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:24.011031+0000 mgr.smithi008.flmjzp (mgr.14640) 2199 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:35:25.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:23.988374+0000 mgr.smithi008.flmjzp (mgr.14640) 2196 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:35:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:23.989064+0000 mgr.smithi008.flmjzp (mgr.14640) 2197 : cluster [DBG] pgmap v1516: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:23.989328+0000 mgr.smithi008.flmjzp (mgr.14640) 2198 : cluster [DBG] pgmap v1517: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:24.011031+0000 mgr.smithi008.flmjzp (mgr.14640) 2199 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:35:27.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:25.990012+0000 mgr.smithi008.flmjzp (mgr.14640) 2200 : cluster [DBG] pgmap v1518: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:25.990012+0000 mgr.smithi008.flmjzp (mgr.14640) 2200 : cluster [DBG] pgmap v1518: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:29.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:27.990498+0000 mgr.smithi008.flmjzp (mgr.14640) 2201 : cluster [DBG] pgmap v1519: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:27.990498+0000 mgr.smithi008.flmjzp (mgr.14640) 2201 : cluster [DBG] pgmap v1519: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:31.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:29.991249+0000 mgr.smithi008.flmjzp (mgr.14640) 2202 : cluster [DBG] pgmap v1520: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:29.991249+0000 mgr.smithi008.flmjzp (mgr.14640) 2202 : cluster [DBG] pgmap v1520: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:33.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:31.991787+0000 mgr.smithi008.flmjzp (mgr.14640) 2203 : cluster [DBG] pgmap v1521: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:33.756 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:31.991787+0000 mgr.smithi008.flmjzp (mgr.14640) 2203 : cluster [DBG] pgmap v1521: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:34.018989+0000 mon.smithi008 (mon.0) 2633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:34.018989+0000 mon.smithi008 (mon.0) 2633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:33.992363+0000 mgr.smithi008.flmjzp (mgr.14640) 2204 : cluster [DBG] pgmap v1522: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:35.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:33.992363+0000 mgr.smithi008.flmjzp (mgr.14640) 2204 : cluster [DBG] pgmap v1522: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:35.992889+0000 mgr.smithi008.flmjzp (mgr.14640) 2205 : cluster [DBG] pgmap v1523: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:37.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:35.992889+0000 mgr.smithi008.flmjzp (mgr.14640) 2205 : cluster [DBG] pgmap v1523: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:37.993290+0000 mgr.smithi008.flmjzp (mgr.14640) 2206 : cluster [DBG] pgmap v1524: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:38.299862+0000 mon.smithi008 (mon.0) 2634 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:38.848660+0000 mon.smithi008 (mon.0) 2635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:35:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:38.849545+0000 mon.smithi008 (mon.0) 2636 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:35:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:38.850235+0000 mgr.smithi008.flmjzp (mgr.14640) 2207 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:35:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:38.850843+0000 mgr.smithi008.flmjzp (mgr.14640) 2208 : cluster [DBG] pgmap v1525: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:38.851065+0000 mgr.smithi008.flmjzp (mgr.14640) 2209 : cluster [DBG] pgmap v1526: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:38.855591+0000 mon.smithi008 (mon.0) 2637 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:38.860571+0000 mon.smithi008 (mon.0) 2638 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:38.863055+0000 mon.smithi008 (mon.0) 2639 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:38.864403+0000 mon.smithi008 (mon.0) 2640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:38.865720+0000 mon.smithi008 (mon.0) 2641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:39.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:38.867373+0000 mon.smithi008 (mon.0) 2642 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:39.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:38.868994+0000 mgr.smithi008.flmjzp (mgr.14640) 2210 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:35:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:37.993290+0000 mgr.smithi008.flmjzp (mgr.14640) 2206 : cluster [DBG] pgmap v1524: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:38.299862+0000 mon.smithi008 (mon.0) 2634 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:38.848660+0000 mon.smithi008 (mon.0) 2635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:35:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:38.849545+0000 mon.smithi008 (mon.0) 2636 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:35:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:38.850235+0000 mgr.smithi008.flmjzp (mgr.14640) 2207 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:35:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:38.850843+0000 mgr.smithi008.flmjzp (mgr.14640) 2208 : cluster [DBG] pgmap v1525: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:38.851065+0000 mgr.smithi008.flmjzp (mgr.14640) 2209 : cluster [DBG] pgmap v1526: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:38.855591+0000 mon.smithi008 (mon.0) 2637 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:38.860571+0000 mon.smithi008 (mon.0) 2638 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:38.863055+0000 mon.smithi008 (mon.0) 2639 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:38.864403+0000 mon.smithi008 (mon.0) 2640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:38.865720+0000 mon.smithi008 (mon.0) 2641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:38.867373+0000 mon.smithi008 (mon.0) 2642 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:38.868994+0000 mgr.smithi008.flmjzp (mgr.14640) 2210 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:35:41.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:40.851699+0000 mgr.smithi008.flmjzp (mgr.14640) 2211 : cluster [DBG] pgmap v1527: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:40.851699+0000 mgr.smithi008.flmjzp (mgr.14640) 2211 : cluster [DBG] pgmap v1527: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:42.852381+0000 mgr.smithi008.flmjzp (mgr.14640) 2212 : cluster [DBG] pgmap v1528: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:42.852381+0000 mgr.smithi008.flmjzp (mgr.14640) 2212 : cluster [DBG] pgmap v1528: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:45.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.422+0000 7f0fce1a5700 1 -- 172.21.15.8:0/4052886627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc80f6530 msgr2=0x7f0fc80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:45.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.422+0000 7f0fce1a5700 1 --2- 172.21.15.8:0/4052886627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc80f6530 0x7f0fc80f6950 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f0fc4004660 tx=0x7f0fc4009b30).stop 2023-10-18T21:35:45.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.422+0000 7f0fce1a5700 1 -- 172.21.15.8:0/4052886627 shutdown_connections 2023-10-18T21:35:45.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.422+0000 7f0fce1a5700 1 --2- 172.21.15.8:0/4052886627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc80f77d0 0x7f0fc80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.422+0000 7f0fce1a5700 1 --2- 172.21.15.8:0/4052886627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc80f6530 0x7f0fc80f6950 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.422+0000 7f0fce1a5700 1 -- 172.21.15.8:0/4052886627 >> 172.21.15.8:0/4052886627 conn(0x7f0fc80f1c90 msgr2=0x7f0fc80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.422+0000 7f0fce1a5700 1 -- 172.21.15.8:0/4052886627 shutdown_connections 2023-10-18T21:35:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.422+0000 7f0fce1a5700 1 -- 172.21.15.8:0/4052886627 wait complete. 2023-10-18T21:35:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.423+0000 7f0fce1a5700 1 Processor -- start 2023-10-18T21:35:45.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.423+0000 7f0fce1a5700 1 -- start start 2023-10-18T21:35:45.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.423+0000 7f0fce1a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc80f6530 0x7f0fc8106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:45.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.423+0000 7f0fce1a5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc80f77d0 0x7f0fc8107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:45.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.423+0000 7f0fce1a5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8107910 con 0x7f0fc80f77d0 2023-10-18T21:35:45.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.423+0000 7f0fce1a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8108120 con 0x7f0fc80f6530 2023-10-18T21:35:45.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fcc9a2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc80f77d0 0x7f0fc8107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:45.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fcc9a2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc80f77d0 0x7f0fc8107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55550/0 (socket says 172.21.15.8:55550) 2023-10-18T21:35:45.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fcc9a2700 1 -- 172.21.15.8:0/3418482939 learned_addr learned my addr 172.21.15.8:0/3418482939 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:45.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fcd1a3700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc80f6530 0x7f0fc8106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:45.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fcc9a2700 1 -- 172.21.15.8:0/3418482939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc80f6530 msgr2=0x7f0fc8106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:45.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fcc9a2700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc80f6530 0x7f0fc8106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fcc9a2700 1 -- 172.21.15.8:0/3418482939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc4005040 con 0x7f0fc80f77d0 2023-10-18T21:35:45.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fcc9a2700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc80f77d0 0x7f0fc8107310 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f0fb800c790 tx=0x7f0fb8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:45.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fbdffb700 1 -- 172.21.15.8:0/3418482939 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fb800e680 con 0x7f0fc80f77d0 2023-10-18T21:35:45.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fce1a5700 1 -- 172.21.15.8:0/3418482939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc81083a0 con 0x7f0fc80f77d0 2023-10-18T21:35:45.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.424+0000 7f0fbdffb700 1 -- 172.21.15.8:0/3418482939 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0fb800eca0 con 0x7f0fc80f77d0 2023-10-18T21:35:45.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.425+0000 7f0fbdffb700 1 -- 172.21.15.8:0/3418482939 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fb8013de0 con 0x7f0fc80f77d0 2023-10-18T21:35:45.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.425+0000 7f0fce1a5700 1 -- 172.21.15.8:0/3418482939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc8108960 con 0x7f0fc80f77d0 2023-10-18T21:35:45.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.426+0000 7f0fce1a5700 1 -- 172.21.15.8:0/3418482939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc8059100 con 0x7f0fc80f77d0 2023-10-18T21:35:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.427+0000 7f0fbdffb700 1 -- 172.21.15.8:0/3418482939 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0fb801a060 con 0x7f0fc80f77d0 2023-10-18T21:35:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.427+0000 7f0fbdffb700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fb4060f70 0x7f0fb4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.428+0000 7f0fbdffb700 1 -- 172.21.15.8:0/3418482939 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0fb807cc00 con 0x7f0fc80f77d0 2023-10-18T21:35:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.428+0000 7f0fcd1a3700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fb4060f70 0x7f0fb4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.428+0000 7f0fcd1a3700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fb4060f70 0x7f0fb4063430 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f0fc4009490 tx=0x7f0fc4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.432+0000 7f0fbdffb700 1 -- 172.21.15.8:0/3418482939 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0fb804c7c0 con 0x7f0fc80f77d0 2023-10-18T21:35:45.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.632+0000 7f0fce1a5700 1 -- 172.21.15.8:0/3418482939 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fc80fed30 con 0x7f0fb4060f70 2023-10-18T21:35:45.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.634+0000 7f0fbdffb700 1 -- 172.21.15.8:0/3418482939 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0fc80fed30 con 0x7f0fb4060f70 2023-10-18T21:35:45.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 -- 172.21.15.8:0/3418482939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fb4060f70 msgr2=0x7f0fb4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:45.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fb4060f70 0x7f0fb4063430 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f0fc4009490 tx=0x7f0fc4009b30).stop 2023-10-18T21:35:45.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 -- 172.21.15.8:0/3418482939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc80f77d0 msgr2=0x7f0fc8107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:45.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc80f77d0 0x7f0fc8107310 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f0fb800c790 tx=0x7f0fb8007d70).stop 2023-10-18T21:35:45.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 -- 172.21.15.8:0/3418482939 shutdown_connections 2023-10-18T21:35:45.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fb4060f70 0x7f0fb4063430 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc80f6530 0x7f0fc8106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 --2- 172.21.15.8:0/3418482939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc80f77d0 0x7f0fc8107310 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 -- 172.21.15.8:0/3418482939 >> 172.21.15.8:0/3418482939 conn(0x7f0fc80f1c90 msgr2=0x7f0fc80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:45.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 -- 172.21.15.8:0/3418482939 shutdown_connections 2023-10-18T21:35:45.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.636+0000 7f0fce1a5700 1 -- 172.21.15.8:0/3418482939 wait complete. 2023-10-18T21:35:45.652 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:35:45.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.773+0000 7fa14a4bf700 1 -- 172.21.15.8:0/688840736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa14406a3b0 msgr2=0x7fa14406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:45.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.773+0000 7fa14a4bf700 1 --2- 172.21.15.8:0/688840736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa14406a3b0 0x7fa14406a830 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fa134004660 tx=0x7fa134009b30).stop 2023-10-18T21:35:45.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.773+0000 7fa14a4bf700 1 -- 172.21.15.8:0/688840736 shutdown_connections 2023-10-18T21:35:45.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.773+0000 7fa14a4bf700 1 --2- 172.21.15.8:0/688840736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa14406a3b0 0x7fa14406a830 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.773+0000 7fa14a4bf700 1 --2- 172.21.15.8:0/688840736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14406b9c0 0x7fa144069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.773+0000 7fa14a4bf700 1 -- 172.21.15.8:0/688840736 >> 172.21.15.8:0/688840736 conn(0x7fa1440f1c90 msgr2=0x7fa1440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:45.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.773+0000 7fa14a4bf700 1 -- 172.21.15.8:0/688840736 shutdown_connections 2023-10-18T21:35:45.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.773+0000 7fa14a4bf700 1 -- 172.21.15.8:0/688840736 wait complete. 2023-10-18T21:35:45.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.774+0000 7fa14a4bf700 1 Processor -- start 2023-10-18T21:35:45.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.774+0000 7fa14a4bf700 1 -- start start 2023-10-18T21:35:45.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.774+0000 7fa14a4bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14406a3b0 0x7fa144108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:45.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.774+0000 7fa14a4bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa14406b9c0 0x7fa144109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:45.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.774+0000 7fa14a4bf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa144109a10 con 0x7fa14406b9c0 2023-10-18T21:35:45.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.774+0000 7fa14a4bf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa144109b50 con 0x7fa14406a3b0 2023-10-18T21:35:45.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.775+0000 7fa148cbc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa14406b9c0 0x7fa144109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:45.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.775+0000 7fa148cbc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa14406b9c0 0x7fa144109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55560/0 (socket says 172.21.15.8:55560) 2023-10-18T21:35:45.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.775+0000 7fa148cbc700 1 -- 172.21.15.8:0/4245804031 learned_addr learned my addr 172.21.15.8:0/4245804031 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:45.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.775+0000 7fa1494bd700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14406a3b0 0x7fa144108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:45.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.775+0000 7fa148cbc700 1 -- 172.21.15.8:0/4245804031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14406a3b0 msgr2=0x7fa144108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:45.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.775+0000 7fa148cbc700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14406a3b0 0x7fa144108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.775+0000 7fa148cbc700 1 -- 172.21.15.8:0/4245804031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa134005040 con 0x7fa14406b9c0 2023-10-18T21:35:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.775+0000 7fa148cbc700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa14406b9c0 0x7fa144109460 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7fa134009f50 tx=0x7fa134009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.775+0000 7fa139ffb700 1 -- 172.21.15.8:0/4245804031 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa134018070 con 0x7fa14406b9c0 2023-10-18T21:35:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.776+0000 7fa139ffb700 1 -- 172.21.15.8:0/4245804031 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa134009630 con 0x7fa14406b9c0 2023-10-18T21:35:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.776+0000 7fa139ffb700 1 -- 172.21.15.8:0/4245804031 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa13401c3c0 con 0x7fa14406b9c0 2023-10-18T21:35:45.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.776+0000 7fa14a4bf700 1 -- 172.21.15.8:0/4245804031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14410a490 con 0x7fa14406b9c0 2023-10-18T21:35:45.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.776+0000 7fa14a4bf700 1 -- 172.21.15.8:0/4245804031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14410a9f0 con 0x7fa14406b9c0 2023-10-18T21:35:45.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.777+0000 7fa14a4bf700 1 -- 172.21.15.8:0/4245804031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa144045ad0 con 0x7fa14406b9c0 2023-10-18T21:35:45.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.778+0000 7fa139ffb700 1 -- 172.21.15.8:0/4245804031 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa13401d420 con 0x7fa14406b9c0 2023-10-18T21:35:45.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.780+0000 7fa139ffb700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa130060f70 0x7fa130063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:45.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.780+0000 7fa139ffb700 1 -- 172.21.15.8:0/4245804031 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa13407e600 con 0x7fa14406b9c0 2023-10-18T21:35:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.780+0000 7fa1494bd700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa130060f70 0x7fa130063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.780+0000 7fa1494bd700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa130060f70 0x7fa130063430 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fa1400096c0 tx=0x7fa140009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.784+0000 7fa139ffb700 1 -- 172.21.15.8:0/4245804031 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa134051d40 con 0x7fa14406b9c0 2023-10-18T21:35:45.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.983+0000 7fa14a4bf700 1 -- 172.21.15.8:0/4245804031 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa144100fc0 con 0x7fa130060f70 2023-10-18T21:35:45.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.985+0000 7fa139ffb700 1 -- 172.21.15.8:0/4245804031 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa144100fc0 con 0x7fa130060f70 2023-10-18T21:35:45.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 -- 172.21.15.8:0/4245804031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa130060f70 msgr2=0x7fa130063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:45.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa130060f70 0x7fa130063430 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fa1400096c0 tx=0x7fa140009be0).stop 2023-10-18T21:35:45.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 -- 172.21.15.8:0/4245804031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa14406b9c0 msgr2=0x7fa144109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:45.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa14406b9c0 0x7fa144109460 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7fa134009f50 tx=0x7fa134009b30).stop 2023-10-18T21:35:45.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 -- 172.21.15.8:0/4245804031 shutdown_connections 2023-10-18T21:35:45.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa130060f70 0x7fa130063430 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14406a3b0 0x7fa144108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 --2- 172.21.15.8:0/4245804031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa14406b9c0 0x7fa144109460 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:45.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 -- 172.21.15.8:0/4245804031 >> 172.21.15.8:0/4245804031 conn(0x7fa1440f1c90 msgr2=0x7fa1440fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:45.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 -- 172.21.15.8:0/4245804031 shutdown_connections 2023-10-18T21:35:45.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:45.987+0000 7fa14a4bf700 1 -- 172.21.15.8:0/4245804031 wait complete. 2023-10-18T21:35:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.125+0000 7f828dee2700 1 -- 172.21.15.8:0/1652870769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82880f6530 msgr2=0x7f82880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.125+0000 7f828dee2700 1 --2- 172.21.15.8:0/1652870769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82880f6530 0x7f82880f6950 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f827c004660 tx=0x7f827c009b30).stop 2023-10-18T21:35:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.125+0000 7f828dee2700 1 -- 172.21.15.8:0/1652870769 shutdown_connections 2023-10-18T21:35:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.125+0000 7f828dee2700 1 --2- 172.21.15.8:0/1652870769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82880f77d0 0x7f82880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.125+0000 7f828dee2700 1 --2- 172.21.15.8:0/1652870769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82880f6530 0x7f82880f6950 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.125+0000 7f828dee2700 1 -- 172.21.15.8:0/1652870769 >> 172.21.15.8:0/1652870769 conn(0x7f82880f1c90 msgr2=0x7f82880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.125+0000 7f828dee2700 1 -- 172.21.15.8:0/1652870769 shutdown_connections 2023-10-18T21:35:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.125+0000 7f828dee2700 1 -- 172.21.15.8:0/1652870769 wait complete. 2023-10-18T21:35:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.126+0000 7f828dee2700 1 Processor -- start 2023-10-18T21:35:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.126+0000 7f828dee2700 1 -- start start 2023-10-18T21:35:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.126+0000 7f828dee2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82880f6530 0x7f8288106e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.126+0000 7f828dee2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82880f77d0 0x7f8288107350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.126+0000 7f828dee2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8288107950 con 0x7f82880f6530 2023-10-18T21:35:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.126+0000 7f828dee2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8288108160 con 0x7f82880f77d0 2023-10-18T21:35:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.126+0000 7f828cee0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82880f6530 0x7f8288106e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.126+0000 7f828cee0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82880f6530 0x7f8288106e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55588/0 (socket says 172.21.15.8:55588) 2023-10-18T21:35:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.126+0000 7f828cee0700 1 -- 172.21.15.8:0/3008504591 learned_addr learned my addr 172.21.15.8:0/3008504591 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.127+0000 7f8287fff700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82880f77d0 0x7f8288107350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.127+0000 7f828cee0700 1 -- 172.21.15.8:0/3008504591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82880f77d0 msgr2=0x7f8288107350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:46.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.127+0000 7f828cee0700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82880f77d0 0x7f8288107350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.127+0000 7f828cee0700 1 -- 172.21.15.8:0/3008504591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c005040 con 0x7f82880f6530 2023-10-18T21:35:46.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.127+0000 7f828cee0700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82880f6530 0x7f8288106e60 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f827c004e30 tx=0x7f827c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:46.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.127+0000 7f82857fa700 1 -- 172.21.15.8:0/3008504591 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f827c018070 con 0x7f82880f6530 2023-10-18T21:35:46.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.127+0000 7f82857fa700 1 -- 172.21.15.8:0/3008504591 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f827c009630 con 0x7f82880f6530 2023-10-18T21:35:46.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.127+0000 7f828dee2700 1 -- 172.21.15.8:0/3008504591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8288108380 con 0x7f82880f6530 2023-10-18T21:35:46.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.127+0000 7f82857fa700 1 -- 172.21.15.8:0/3008504591 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f827c01c3c0 con 0x7f82880f6530 2023-10-18T21:35:46.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.128+0000 7f828dee2700 1 -- 172.21.15.8:0/3008504591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82881088e0 con 0x7f82880f6530 2023-10-18T21:35:46.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.129+0000 7f828dee2700 1 -- 172.21.15.8:0/3008504591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8288059100 con 0x7f82880f6530 2023-10-18T21:35:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.129+0000 7f82857fa700 1 -- 172.21.15.8:0/3008504591 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f827c01d420 con 0x7f82880f6530 2023-10-18T21:35:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.131+0000 7f82857fa700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8278060f70 0x7f8278063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.131+0000 7f82857fa700 1 -- 172.21.15.8:0/3008504591 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f827c07e3c0 con 0x7f82880f6530 2023-10-18T21:35:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.131+0000 7f8287fff700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8278060f70 0x7f8278063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.132+0000 7f8287fff700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8278060f70 0x7f8278063430 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f8274004c60 tx=0x7f827400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.135+0000 7f82857fa700 1 -- 172.21.15.8:0/3008504591 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f827c04e0b0 con 0x7f82880f6530 2023-10-18T21:35:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:44.853039+0000 mgr.smithi008.flmjzp (mgr.14640) 2213 : cluster [DBG] pgmap v1529: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:46.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:44.853039+0000 mgr.smithi008.flmjzp (mgr.14640) 2213 : cluster [DBG] pgmap v1529: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:46.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.329+0000 7f828dee2700 1 -- 172.21.15.8:0/3008504591 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f82880fece0 con 0x7f8278060f70 2023-10-18T21:35:46.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.338+0000 7f82857fa700 1 -- 172.21.15.8:0/3008504591 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f82880fece0 con 0x7f8278060f70 2023-10-18T21:35:46.339 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:35:46.340 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (42m) 8s ago 43m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:35:46.340 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (36m) 8s ago 43m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:35:46.340 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (36m) 8m ago 43m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:35:46.340 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (42m) 8s ago 43m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:35:46.341 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8s ago 39m - - 2023-10-18T21:35:46.341 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8s ago 39m - - 2023-10-18T21:35:46.341 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 39m - - 2023-10-18T21:35:46.341 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 39m - - 2023-10-18T21:35:46.341 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (37m) 8s ago 45m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:35:46.342 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (36m) 8m ago 42m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:35:46.342 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (36m) 8s ago 45m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:35:46.342 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (36m) 8m ago 42m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:35:46.342 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (43m) 8s ago 43m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:35:46.342 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (42m) 8m ago 42m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:35:46.343 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (36m) 8s ago 42m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:35:46.343 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (33m) 8s ago 42m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:35:46.343 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (33m) 8s ago 41m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:35:46.343 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (33m) 8m ago 41m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:35:46.343 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (32m) 8m ago 41m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:35:46.344 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (31m) 8m ago 41m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:35:46.344 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (37m) 8s ago 43m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:35:46.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.340+0000 7f828dee2700 1 -- 172.21.15.8:0/3008504591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8278060f70 msgr2=0x7f8278063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:46.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.340+0000 7f828dee2700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8278060f70 0x7f8278063430 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f8274004c60 tx=0x7f827400b040).stop 2023-10-18T21:35:46.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.340+0000 7f828dee2700 1 -- 172.21.15.8:0/3008504591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82880f6530 msgr2=0x7f8288106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:46.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.340+0000 7f828dee2700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82880f6530 0x7f8288106e60 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f827c004e30 tx=0x7f827c009b30).stop 2023-10-18T21:35:46.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.340+0000 7f828dee2700 1 -- 172.21.15.8:0/3008504591 shutdown_connections 2023-10-18T21:35:46.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.340+0000 7f828dee2700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8278060f70 0x7f8278063430 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.340+0000 7f828dee2700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82880f6530 0x7f8288106e60 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.340+0000 7f828dee2700 1 --2- 172.21.15.8:0/3008504591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82880f77d0 0x7f8288107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.340+0000 7f828dee2700 1 -- 172.21.15.8:0/3008504591 >> 172.21.15.8:0/3008504591 conn(0x7f82880f1c90 msgr2=0x7f82880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:46.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.341+0000 7f828dee2700 1 -- 172.21.15.8:0/3008504591 shutdown_connections 2023-10-18T21:35:46.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.341+0000 7f828dee2700 1 -- 172.21.15.8:0/3008504591 wait complete. 2023-10-18T21:35:46.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.476+0000 7f6bacb48700 1 -- 172.21.15.8:0/3946477036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba80f6530 msgr2=0x7f6ba80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:46.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.476+0000 7f6bacb48700 1 --2- 172.21.15.8:0/3946477036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba80f6530 0x7f6ba80f6950 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f6b98004660 tx=0x7f6b98009b30).stop 2023-10-18T21:35:46.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.476+0000 7f6bacb48700 1 -- 172.21.15.8:0/3946477036 shutdown_connections 2023-10-18T21:35:46.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.476+0000 7f6bacb48700 1 --2- 172.21.15.8:0/3946477036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba80f77d0 0x7f6ba80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.476+0000 7f6bacb48700 1 --2- 172.21.15.8:0/3946477036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba80f6530 0x7f6ba80f6950 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.476+0000 7f6bacb48700 1 -- 172.21.15.8:0/3946477036 >> 172.21.15.8:0/3946477036 conn(0x7f6ba80f1c90 msgr2=0x7f6ba80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.476+0000 7f6bacb48700 1 -- 172.21.15.8:0/3946477036 shutdown_connections 2023-10-18T21:35:46.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.476+0000 7f6bacb48700 1 -- 172.21.15.8:0/3946477036 wait complete. 2023-10-18T21:35:46.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.477+0000 7f6bacb48700 1 Processor -- start 2023-10-18T21:35:46.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.477+0000 7f6bacb48700 1 -- start start 2023-10-18T21:35:46.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6bacb48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba80f6530 0x7f6ba8106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:46.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6bacb48700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba80f77d0 0x7f6ba8107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:46.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6bacb48700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8107900 con 0x7f6ba80f6530 2023-10-18T21:35:46.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6bacb48700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8108110 con 0x7f6ba80f77d0 2023-10-18T21:35:46.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6ba77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba80f6530 0x7f6ba8106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6ba77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba80f6530 0x7f6ba8106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55616/0 (socket says 172.21.15.8:55616) 2023-10-18T21:35:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6ba77fe700 1 -- 172.21.15.8:0/2686320011 learned_addr learned my addr 172.21.15.8:0/2686320011 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6ba6ffd700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba80f77d0 0x7f6ba8107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:46.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6ba77fe700 1 -- 172.21.15.8:0/2686320011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba80f77d0 msgr2=0x7f6ba8107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:46.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6ba77fe700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba80f77d0 0x7f6ba8107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.478+0000 7f6ba77fe700 1 -- 172.21.15.8:0/2686320011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98005040 con 0x7f6ba80f6530 2023-10-18T21:35:46.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.479+0000 7f6ba6ffd700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba80f77d0 0x7f6ba8107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:35:46.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.479+0000 7f6ba77fe700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba80f6530 0x7f6ba8106e10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f6b98007a70 tx=0x7f6b98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:46.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.479+0000 7f6b8ffff700 1 -- 172.21.15.8:0/2686320011 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b98018070 con 0x7f6ba80f6530 2023-10-18T21:35:46.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.479+0000 7f6b8ffff700 1 -- 172.21.15.8:0/2686320011 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6b9801d8e0 con 0x7f6ba80f6530 2023-10-18T21:35:46.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.479+0000 7f6b8ffff700 1 -- 172.21.15.8:0/2686320011 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9801c660 con 0x7f6ba80f6530 2023-10-18T21:35:46.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.479+0000 7f6bacb48700 1 -- 172.21.15.8:0/2686320011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba8108330 con 0x7f6ba80f6530 2023-10-18T21:35:46.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.479+0000 7f6bacb48700 1 -- 172.21.15.8:0/2686320011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba8108890 con 0x7f6ba80f6530 2023-10-18T21:35:46.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.480+0000 7f6bacb48700 1 -- 172.21.15.8:0/2686320011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba8059100 con 0x7f6ba80f6530 2023-10-18T21:35:46.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.481+0000 7f6b8ffff700 1 -- 172.21.15.8:0/2686320011 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6b9801da50 con 0x7f6ba80f6530 2023-10-18T21:35:46.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.482+0000 7f6b8ffff700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b90060f70 0x7f6b90063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:46.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.482+0000 7f6b8ffff700 1 -- 172.21.15.8:0/2686320011 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6b9807e990 con 0x7f6ba80f6530 2023-10-18T21:35:46.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.482+0000 7f6ba6ffd700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b90060f70 0x7f6b90063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:46.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.483+0000 7f6ba6ffd700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b90060f70 0x7f6b90063430 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f6b9c004a90 tx=0x7f6b9c009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:46.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.486+0000 7f6b8ffff700 1 -- 172.21.15.8:0/2686320011 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6b9804e540 con 0x7f6ba80f6530 2023-10-18T21:35:46.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.741+0000 7f6bacb48700 1 -- 172.21.15.8:0/2686320011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ba8045ad0 con 0x7f6ba80f6530 2023-10-18T21:35:46.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.741+0000 7f6b8ffff700 1 -- 172.21.15.8:0/2686320011 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f6b9801dce0 con 0x7f6ba80f6530 2023-10-18T21:35:46.742 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:35:46.743 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:35:46.743 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:35:46.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:35:46.743 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:35:46.743 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:35:46.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:35:46.744 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:35:46.744 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:35:46.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:35:46.745 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:35:46.745 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:35:46.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:35:46.745 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:35:46.745 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:35:46.746 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:35:46.746 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:35:46.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.743+0000 7f6bacb48700 1 -- 172.21.15.8:0/2686320011 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b90060f70 msgr2=0x7f6b90063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:46.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.743+0000 7f6bacb48700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b90060f70 0x7f6b90063430 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f6b9c004a90 tx=0x7f6b9c009040).stop 2023-10-18T21:35:46.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.743+0000 7f6bacb48700 1 -- 172.21.15.8:0/2686320011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba80f6530 msgr2=0x7f6ba8106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:46.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.743+0000 7f6bacb48700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba80f6530 0x7f6ba8106e10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f6b98007a70 tx=0x7f6b98009b30).stop 2023-10-18T21:35:46.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.743+0000 7f6bacb48700 1 -- 172.21.15.8:0/2686320011 shutdown_connections 2023-10-18T21:35:46.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.743+0000 7f6bacb48700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b90060f70 0x7f6b90063430 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.743+0000 7f6bacb48700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba80f6530 0x7f6ba8106e10 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.743+0000 7f6bacb48700 1 --2- 172.21.15.8:0/2686320011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba80f77d0 0x7f6ba8107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.743+0000 7f6bacb48700 1 -- 172.21.15.8:0/2686320011 >> 172.21.15.8:0/2686320011 conn(0x7f6ba80f1c90 msgr2=0x7f6ba80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.744+0000 7f6bacb48700 1 -- 172.21.15.8:0/2686320011 shutdown_connections 2023-10-18T21:35:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.744+0000 7f6bacb48700 1 -- 172.21.15.8:0/2686320011 wait complete. 2023-10-18T21:35:46.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.882+0000 7f9ff724a700 1 -- 172.21.15.8:0/4238544881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ff00f6530 msgr2=0x7f9ff00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:46.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.882+0000 7f9ff724a700 1 --2- 172.21.15.8:0/4238544881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ff00f6530 0x7f9ff00f6950 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f9fec004660 tx=0x7f9fec009b30).stop 2023-10-18T21:35:46.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.882+0000 7f9ff724a700 1 -- 172.21.15.8:0/4238544881 shutdown_connections 2023-10-18T21:35:46.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.882+0000 7f9ff724a700 1 --2- 172.21.15.8:0/4238544881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff00f77d0 0x7f9ff00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.882+0000 7f9ff724a700 1 --2- 172.21.15.8:0/4238544881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ff00f6530 0x7f9ff00f6950 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.882+0000 7f9ff724a700 1 -- 172.21.15.8:0/4238544881 >> 172.21.15.8:0/4238544881 conn(0x7f9ff00f1c90 msgr2=0x7f9ff00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:46.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.882+0000 7f9ff724a700 1 -- 172.21.15.8:0/4238544881 shutdown_connections 2023-10-18T21:35:46.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.882+0000 7f9ff724a700 1 -- 172.21.15.8:0/4238544881 wait complete. 2023-10-18T21:35:46.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.883+0000 7f9ff724a700 1 Processor -- start 2023-10-18T21:35:46.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.883+0000 7f9ff724a700 1 -- start start 2023-10-18T21:35:46.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.883+0000 7f9ff724a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ff00f6530 0x7f9ff0106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:46.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.883+0000 7f9ff724a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff00f77d0 0x7f9ff0107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:46.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.883+0000 7f9ff724a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0107900 con 0x7f9ff00f6530 2023-10-18T21:35:46.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.883+0000 7f9ff724a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0108110 con 0x7f9ff00f77d0 2023-10-18T21:35:46.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.883+0000 7f9ff6248700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ff00f6530 0x7f9ff0106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:46.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.883+0000 7f9ff6248700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ff00f6530 0x7f9ff0106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48632/0 (socket says 172.21.15.8:48632) 2023-10-18T21:35:46.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.883+0000 7f9ff6248700 1 -- 172.21.15.8:0/765424632 learned_addr learned my addr 172.21.15.8:0/765424632 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:46.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.883+0000 7f9ff5a47700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff00f77d0 0x7f9ff0107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:46.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.884+0000 7f9ff6248700 1 -- 172.21.15.8:0/765424632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff00f77d0 msgr2=0x7f9ff0107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:46.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.884+0000 7f9ff6248700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff00f77d0 0x7f9ff0107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:46.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.884+0000 7f9ff6248700 1 -- 172.21.15.8:0/765424632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec005040 con 0x7f9ff00f6530 2023-10-18T21:35:46.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.884+0000 7f9ff6248700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ff00f6530 0x7f9ff0106e10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f9fec007a60 tx=0x7f9fec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:46.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.884+0000 7f9fe6ffd700 1 -- 172.21.15.8:0/765424632 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fec018070 con 0x7f9ff00f6530 2023-10-18T21:35:46.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.884+0000 7f9fe6ffd700 1 -- 172.21.15.8:0/765424632 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9fec009630 con 0x7f9ff00f6530 2023-10-18T21:35:46.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.884+0000 7f9fe6ffd700 1 -- 172.21.15.8:0/765424632 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fec01c540 con 0x7f9ff00f6530 2023-10-18T21:35:46.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.884+0000 7f9ff724a700 1 -- 172.21.15.8:0/765424632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff0108330 con 0x7f9ff00f6530 2023-10-18T21:35:46.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.884+0000 7f9ff724a700 1 -- 172.21.15.8:0/765424632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff0108890 con 0x7f9ff00f6530 2023-10-18T21:35:46.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.885+0000 7f9ff724a700 1 -- 172.21.15.8:0/765424632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff0059100 con 0x7f9ff00f6530 2023-10-18T21:35:46.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.886+0000 7f9fe6ffd700 1 -- 172.21.15.8:0/765424632 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9fec01d420 con 0x7f9ff00f6530 2023-10-18T21:35:46.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.887+0000 7f9fe6ffd700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9fdc060f70 0x7f9fdc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:46.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.888+0000 7f9fe6ffd700 1 -- 172.21.15.8:0/765424632 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9fec07e600 con 0x7f9ff00f6530 2023-10-18T21:35:46.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.888+0000 7f9ff5a47700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9fdc060f70 0x7f9fdc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:46.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.888+0000 7f9ff5a47700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9fdc060f70 0x7f9fdc063430 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f9fe00096c0 tx=0x7f9fe0009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:46.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:46.892+0000 7f9fe6ffd700 1 -- 172.21.15.8:0/765424632 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9fec04e2f0 con 0x7f9ff00f6530 2023-10-18T21:35:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.128+0000 7f9ff724a700 1 -- 172.21.15.8:0/765424632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9ff00fecc0 con 0x7f9ff00f6530 2023-10-18T21:35:47.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.129+0000 7f9fe6ffd700 1 -- 172.21.15.8:0/765424632 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f9fec051910 con 0x7f9ff00f6530 2023-10-18T21:35:47.131 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:35:47.131 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:35:47.131 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:35:47.131 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:35:47.132 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:35:47.133 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:35:47.133 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:35:47.133 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:35:47.133 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:35:47.133 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:35:47.134 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:35:47.134 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:35:47.134 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:35:47.134 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:35:47.134 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:35:47.135 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:35:47.135 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:35:47.135 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:35:47.135 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:35:47.135 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:35:47.135 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:35:47.136 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:35:47.136 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:35:47.136 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:35:47.136 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:35:47.136 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:35:47.137 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:35:47.137 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:35:47.137 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:35:47.137 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:35:47.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.131+0000 7f9ff724a700 1 -- 172.21.15.8:0/765424632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9fdc060f70 msgr2=0x7f9fdc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:47.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.131+0000 7f9ff724a700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9fdc060f70 0x7f9fdc063430 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f9fe00096c0 tx=0x7f9fe0009be0).stop 2023-10-18T21:35:47.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.131+0000 7f9ff724a700 1 -- 172.21.15.8:0/765424632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ff00f6530 msgr2=0x7f9ff0106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:47.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.131+0000 7f9ff724a700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ff00f6530 0x7f9ff0106e10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f9fec007a60 tx=0x7f9fec009b30).stop 2023-10-18T21:35:47.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.131+0000 7f9ff724a700 1 -- 172.21.15.8:0/765424632 shutdown_connections 2023-10-18T21:35:47.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.131+0000 7f9ff724a700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9fdc060f70 0x7f9fdc063430 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:47.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.131+0000 7f9ff724a700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ff00f6530 0x7f9ff0106e10 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:47.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.131+0000 7f9ff724a700 1 --2- 172.21.15.8:0/765424632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff00f77d0 0x7f9ff0107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:47.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.131+0000 7f9ff724a700 1 -- 172.21.15.8:0/765424632 >> 172.21.15.8:0/765424632 conn(0x7f9ff00f1c90 msgr2=0x7f9ff00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:47.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.132+0000 7f9ff724a700 1 -- 172.21.15.8:0/765424632 shutdown_connections 2023-10-18T21:35:47.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.132+0000 7f9ff724a700 1 -- 172.21.15.8:0/765424632 wait complete. 2023-10-18T21:35:47.141 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:35:47.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:45.634201+0000 mgr.smithi008.flmjzp (mgr.14640) 2214 : audit [DBG] from='client.35920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:46.741765+0000 mon.smithi008 (mon.0) 2643 : audit [DBG] from='client.? 172.21.15.8:0/2686320011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:45.634201+0000 mgr.smithi008.flmjzp (mgr.14640) 2214 : audit [DBG] from='client.35920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:46.741765+0000 mon.smithi008 (mon.0) 2643 : audit [DBG] from='client.? 172.21.15.8:0/2686320011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:47.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.269+0000 7f53926ff700 1 -- 172.21.15.8:0/1825468191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f538c0f77d0 msgr2=0x7f538c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:47.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.269+0000 7f53926ff700 1 --2- 172.21.15.8:0/1825468191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f538c0f77d0 0x7f538c0f7c30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f537c004660 tx=0x7f537c009b30).stop 2023-10-18T21:35:47.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.269+0000 7f53926ff700 1 -- 172.21.15.8:0/1825468191 shutdown_connections 2023-10-18T21:35:47.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.269+0000 7f53926ff700 1 --2- 172.21.15.8:0/1825468191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f538c0f77d0 0x7f538c0f7c30 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:47.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.269+0000 7f53926ff700 1 --2- 172.21.15.8:0/1825468191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0f6530 0x7f538c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:47.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.269+0000 7f53926ff700 1 -- 172.21.15.8:0/1825468191 >> 172.21.15.8:0/1825468191 conn(0x7f538c0f1c90 msgr2=0x7f538c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:47.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.269+0000 7f53926ff700 1 -- 172.21.15.8:0/1825468191 shutdown_connections 2023-10-18T21:35:47.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.269+0000 7f53926ff700 1 -- 172.21.15.8:0/1825468191 wait complete. 2023-10-18T21:35:47.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.270+0000 7f53926ff700 1 Processor -- start 2023-10-18T21:35:47.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.270+0000 7f53926ff700 1 -- start start 2023-10-18T21:35:47.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.270+0000 7f53926ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f538c0f6530 0x7f538c108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:47.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.270+0000 7f53926ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0f77d0 0x7f538c109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:47.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.270+0000 7f53926ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c1099f0 con 0x7f538c0f6530 2023-10-18T21:35:47.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.270+0000 7f53926ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c109b30 con 0x7f538c0f77d0 2023-10-18T21:35:47.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f53916fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f538c0f6530 0x7f538c108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:47.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f53916fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f538c0f6530 0x7f538c108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48662/0 (socket says 172.21.15.8:48662) 2023-10-18T21:35:47.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f53916fd700 1 -- 172.21.15.8:0/656444761 learned_addr learned my addr 172.21.15.8:0/656444761 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:35:47.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f5390efc700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0f77d0 0x7f538c109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:47.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f53916fd700 1 -- 172.21.15.8:0/656444761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0f77d0 msgr2=0x7f538c109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:47.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f53916fd700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0f77d0 0x7f538c109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:47.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f53916fd700 1 -- 172.21.15.8:0/656444761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c005040 con 0x7f538c0f6530 2023-10-18T21:35:47.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f53916fd700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f538c0f6530 0x7f538c108f50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f5388002700 tx=0x7f5388009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:47.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f5381ffb700 1 -- 172.21.15.8:0/656444761 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5388009320 con 0x7f538c0f6530 2023-10-18T21:35:47.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f5381ffb700 1 -- 172.21.15.8:0/656444761 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f538800f040 con 0x7f538c0f6530 2023-10-18T21:35:47.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f5381ffb700 1 -- 172.21.15.8:0/656444761 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5388014970 con 0x7f538c0f6530 2023-10-18T21:35:47.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.271+0000 7f53926ff700 1 -- 172.21.15.8:0/656444761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c10a4d0 con 0x7f538c0f6530 2023-10-18T21:35:47.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.272+0000 7f53926ff700 1 -- 172.21.15.8:0/656444761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c10aa90 con 0x7f538c0f6530 2023-10-18T21:35:47.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.273+0000 7f53926ff700 1 -- 172.21.15.8:0/656444761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c045ad0 con 0x7f538c0f6530 2023-10-18T21:35:47.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.273+0000 7f5381ffb700 1 -- 172.21.15.8:0/656444761 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5388009480 con 0x7f538c0f6530 2023-10-18T21:35:47.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.274+0000 7f5381ffb700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5378060f70 0x7f5378063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:35:47.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.274+0000 7f5381ffb700 1 -- 172.21.15.8:0/656444761 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f538807cc40 con 0x7f538c0f6530 2023-10-18T21:35:47.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.275+0000 7f5390efc700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5378060f70 0x7f5378063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:35:47.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.275+0000 7f5390efc700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5378060f70 0x7f5378063430 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f537c004e30 tx=0x7f537c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:35:47.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.278+0000 7f5381ffb700 1 -- 172.21.15.8:0/656444761 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5388050220 con 0x7f538c0f6530 2023-10-18T21:35:47.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.476+0000 7f53926ff700 1 -- 172.21.15.8:0/656444761 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f538c10ad10 con 0x7f5378060f70 2023-10-18T21:35:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.477+0000 7f5381ffb700 1 -- 172.21.15.8:0/656444761 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f538c10ad10 con 0x7f5378060f70 2023-10-18T21:35:47.478 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:35:47.478 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:35:47.478 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:35:47.479 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:35:47.479 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:35:47.479 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:35:47.479 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:35:47.480 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:35:47.480 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:35:47.480 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:35:47.480 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:35:47.480 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:35:47.480 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:35:47.481 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:35:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 -- 172.21.15.8:0/656444761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5378060f70 msgr2=0x7f5378063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5378060f70 0x7f5378063430 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f537c004e30 tx=0x7f537c009b30).stop 2023-10-18T21:35:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 -- 172.21.15.8:0/656444761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f538c0f6530 msgr2=0x7f538c108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:35:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f538c0f6530 0x7f538c108f50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f5388002700 tx=0x7f5388009d80).stop 2023-10-18T21:35:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 -- 172.21.15.8:0/656444761 shutdown_connections 2023-10-18T21:35:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5378060f70 0x7f5378063430 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f538c0f6530 0x7f538c108f50 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 --2- 172.21.15.8:0/656444761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0f77d0 0x7f538c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:35:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 -- 172.21.15.8:0/656444761 >> 172.21.15.8:0/656444761 conn(0x7f538c0f1c90 msgr2=0x7f538c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:35:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 -- 172.21.15.8:0/656444761 shutdown_connections 2023-10-18T21:35:47.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:35:47.479+0000 7f53926ff700 1 -- 172.21.15.8:0/656444761 wait complete. 2023-10-18T21:35:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:45.985131+0000 mgr.smithi008.flmjzp (mgr.14640) 2215 : audit [DBG] from='client.35924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:46.330659+0000 mgr.smithi008.flmjzp (mgr.14640) 2216 : audit [DBG] from='client.35928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:48.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:46.853477+0000 mgr.smithi008.flmjzp (mgr.14640) 2217 : cluster [DBG] pgmap v1530: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:48.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:47.129742+0000 mon.smithi008 (mon.0) 2644 : audit [DBG] from='client.? 172.21.15.8:0/765424632' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:35:48.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:45.985131+0000 mgr.smithi008.flmjzp (mgr.14640) 2215 : audit [DBG] from='client.35924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:46.330659+0000 mgr.smithi008.flmjzp (mgr.14640) 2216 : audit [DBG] from='client.35928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:46.853477+0000 mgr.smithi008.flmjzp (mgr.14640) 2217 : cluster [DBG] pgmap v1530: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:47.129742+0000 mon.smithi008 (mon.0) 2644 : audit [DBG] from='client.? 172.21.15.8:0/765424632' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:35:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:47.477316+0000 mgr.smithi008.flmjzp (mgr.14640) 2218 : audit [DBG] from='client.35940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:48.871557+0000 mon.smithi008 (mon.0) 2645 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:48.873550+0000 mon.smithi008 (mon.0) 2646 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:35:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:48.874432+0000 mon.smithi008 (mon.0) 2647 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:35:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:48.880757+0000 mon.smithi008 (mon.0) 2648 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:48.887032+0000 mon.smithi008 (mon.0) 2649 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:48.889883+0000 mon.smithi008 (mon.0) 2650 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:48.891443+0000 mon.smithi008 (mon.0) 2651 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:48.892962+0000 mon.smithi008 (mon.0) 2652 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:48.894830+0000 mon.smithi008 (mon.0) 2653 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:47.477316+0000 mgr.smithi008.flmjzp (mgr.14640) 2218 : audit [DBG] from='client.35940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:35:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:48.871557+0000 mon.smithi008 (mon.0) 2645 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:48.873550+0000 mon.smithi008 (mon.0) 2646 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:35:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:48.874432+0000 mon.smithi008 (mon.0) 2647 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:35:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:48.880757+0000 mon.smithi008 (mon.0) 2648 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:35:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:48.887032+0000 mon.smithi008 (mon.0) 2649 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:48.889883+0000 mon.smithi008 (mon.0) 2650 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:49.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:48.891443+0000 mon.smithi008 (mon.0) 2651 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:49.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:48.892962+0000 mon.smithi008 (mon.0) 2652 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:49.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:48.894830+0000 mon.smithi008 (mon.0) 2653 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:35:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:48.854065+0000 mgr.smithi008.flmjzp (mgr.14640) 2219 : cluster [DBG] pgmap v1531: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:48.875234+0000 mgr.smithi008.flmjzp (mgr.14640) 2220 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:35:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:48.875737+0000 mgr.smithi008.flmjzp (mgr.14640) 2221 : cluster [DBG] pgmap v1532: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:48.875991+0000 mgr.smithi008.flmjzp (mgr.14640) 2222 : cluster [DBG] pgmap v1533: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:48.896625+0000 mgr.smithi008.flmjzp (mgr.14640) 2223 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:35:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:48.854065+0000 mgr.smithi008.flmjzp (mgr.14640) 2219 : cluster [DBG] pgmap v1531: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:50.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:48.875234+0000 mgr.smithi008.flmjzp (mgr.14640) 2220 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:35:50.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:48.875737+0000 mgr.smithi008.flmjzp (mgr.14640) 2221 : cluster [DBG] pgmap v1532: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:50.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:48.875991+0000 mgr.smithi008.flmjzp (mgr.14640) 2222 : cluster [DBG] pgmap v1533: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:50.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:48.896625+0000 mgr.smithi008.flmjzp (mgr.14640) 2223 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:35:51.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:50.876670+0000 mgr.smithi008.flmjzp (mgr.14640) 2224 : cluster [DBG] pgmap v1534: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:50.876670+0000 mgr.smithi008.flmjzp (mgr.14640) 2224 : cluster [DBG] pgmap v1534: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:52.877109+0000 mgr.smithi008.flmjzp (mgr.14640) 2225 : cluster [DBG] pgmap v1535: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:54.291 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:52.877109+0000 mgr.smithi008.flmjzp (mgr.14640) 2225 : cluster [DBG] pgmap v1535: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:56.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:54.877772+0000 mgr.smithi008.flmjzp (mgr.14640) 2226 : cluster [DBG] pgmap v1536: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:54.877772+0000 mgr.smithi008.flmjzp (mgr.14640) 2226 : cluster [DBG] pgmap v1536: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:56.878470+0000 mgr.smithi008.flmjzp (mgr.14640) 2227 : cluster [DBG] pgmap v1537: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:58.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:56.878470+0000 mgr.smithi008.flmjzp (mgr.14640) 2227 : cluster [DBG] pgmap v1537: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:35:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:58.907243+0000 mon.smithi008 (mon.0) 2654 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:35:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:58.907243+0000 mon.smithi008 (mon.0) 2654 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:58.879070+0000 mgr.smithi008.flmjzp (mgr.14640) 2228 : cluster [DBG] pgmap v1538: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:59.463446+0000 mon.smithi008 (mon.0) 2655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:59.464629+0000 mon.smithi008 (mon.0) 2656 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:59.471872+0000 mon.smithi008 (mon.0) 2657 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:59.478698+0000 mon.smithi008 (mon.0) 2658 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:59.481960+0000 mon.smithi008 (mon.0) 2659 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:59.483668+0000 mon.smithi008 (mon.0) 2660 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:59.485356+0000 mon.smithi008 (mon.0) 2661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:35:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:35:59.487353+0000 mon.smithi008 (mon.0) 2662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:58.879070+0000 mgr.smithi008.flmjzp (mgr.14640) 2228 : cluster [DBG] pgmap v1538: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:59.463446+0000 mon.smithi008 (mon.0) 2655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:59.464629+0000 mon.smithi008 (mon.0) 2656 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:59.471872+0000 mon.smithi008 (mon.0) 2657 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:59.478698+0000 mon.smithi008 (mon.0) 2658 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:59.481960+0000 mon.smithi008 (mon.0) 2659 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:59.483668+0000 mon.smithi008 (mon.0) 2660 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:59.485356+0000 mon.smithi008 (mon.0) 2661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:00.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:35:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:35:59.487353+0000 mon.smithi008 (mon.0) 2662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:01.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:59.465513+0000 mgr.smithi008.flmjzp (mgr.14640) 2229 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:59.466176+0000 mgr.smithi008.flmjzp (mgr.14640) 2230 : cluster [DBG] pgmap v1539: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:35:59.466442+0000 mgr.smithi008.flmjzp (mgr.14640) 2231 : cluster [DBG] pgmap v1540: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:35:59.489305+0000 mgr.smithi008.flmjzp (mgr.14640) 2232 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:59.465513+0000 mgr.smithi008.flmjzp (mgr.14640) 2229 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:59.466176+0000 mgr.smithi008.flmjzp (mgr.14640) 2230 : cluster [DBG] pgmap v1539: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:35:59.466442+0000 mgr.smithi008.flmjzp (mgr.14640) 2231 : cluster [DBG] pgmap v1540: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:35:59.489305+0000 mgr.smithi008.flmjzp (mgr.14640) 2232 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:03.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:01.466960+0000 mgr.smithi008.flmjzp (mgr.14640) 2233 : cluster [DBG] pgmap v1541: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:03.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:01.466960+0000 mgr.smithi008.flmjzp (mgr.14640) 2233 : cluster [DBG] pgmap v1541: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:05.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:03.467602+0000 mgr.smithi008.flmjzp (mgr.14640) 2234 : cluster [DBG] pgmap v1542: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:03.467602+0000 mgr.smithi008.flmjzp (mgr.14640) 2234 : cluster [DBG] pgmap v1542: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:07.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:05.468101+0000 mgr.smithi008.flmjzp (mgr.14640) 2235 : cluster [DBG] pgmap v1543: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:05.468101+0000 mgr.smithi008.flmjzp (mgr.14640) 2235 : cluster [DBG] pgmap v1543: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:09.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:07.468793+0000 mgr.smithi008.flmjzp (mgr.14640) 2236 : cluster [DBG] pgmap v1544: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:07.468793+0000 mgr.smithi008.flmjzp (mgr.14640) 2236 : cluster [DBG] pgmap v1544: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:10.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:09.495986+0000 mon.smithi008 (mon.0) 2663 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:09.498146+0000 mon.smithi008 (mon.0) 2664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:09.499212+0000 mon.smithi008 (mon.0) 2665 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:09.505803+0000 mon.smithi008 (mon.0) 2666 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:09.512152+0000 mon.smithi008 (mon.0) 2667 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:09.515274+0000 mon.smithi008 (mon.0) 2668 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:09.517002+0000 mon.smithi008 (mon.0) 2669 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:09.518687+0000 mon.smithi008 (mon.0) 2670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:09.520843+0000 mon.smithi008 (mon.0) 2671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:09.495986+0000 mon.smithi008 (mon.0) 2663 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:09.498146+0000 mon.smithi008 (mon.0) 2664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:09.499212+0000 mon.smithi008 (mon.0) 2665 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:09.505803+0000 mon.smithi008 (mon.0) 2666 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:09.512152+0000 mon.smithi008 (mon.0) 2667 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:09.515274+0000 mon.smithi008 (mon.0) 2668 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:09.517002+0000 mon.smithi008 (mon.0) 2669 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:09.518687+0000 mon.smithi008 (mon.0) 2670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:10.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:09.520843+0000 mon.smithi008 (mon.0) 2671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:11.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:09.469302+0000 mgr.smithi008.flmjzp (mgr.14640) 2237 : cluster [DBG] pgmap v1545: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:36:09.500123+0000 mgr.smithi008.flmjzp (mgr.14640) 2238 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:09.500726+0000 mgr.smithi008.flmjzp (mgr.14640) 2239 : cluster [DBG] pgmap v1546: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:09.500961+0000 mgr.smithi008.flmjzp (mgr.14640) 2240 : cluster [DBG] pgmap v1547: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:11.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:36:09.522853+0000 mgr.smithi008.flmjzp (mgr.14640) 2241 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:09.469302+0000 mgr.smithi008.flmjzp (mgr.14640) 2237 : cluster [DBG] pgmap v1545: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:36:09.500123+0000 mgr.smithi008.flmjzp (mgr.14640) 2238 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:09.500726+0000 mgr.smithi008.flmjzp (mgr.14640) 2239 : cluster [DBG] pgmap v1546: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:09.500961+0000 mgr.smithi008.flmjzp (mgr.14640) 2240 : cluster [DBG] pgmap v1547: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:36:09.522853+0000 mgr.smithi008.flmjzp (mgr.14640) 2241 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:11.501477+0000 mgr.smithi008.flmjzp (mgr.14640) 2242 : cluster [DBG] pgmap v1548: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:12.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:11.501477+0000 mgr.smithi008.flmjzp (mgr.14640) 2242 : cluster [DBG] pgmap v1548: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:14.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:13.502086+0000 mgr.smithi008.flmjzp (mgr.14640) 2243 : cluster [DBG] pgmap v1549: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:13.502086+0000 mgr.smithi008.flmjzp (mgr.14640) 2243 : cluster [DBG] pgmap v1549: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:15.502570+0000 mgr.smithi008.flmjzp (mgr.14640) 2244 : cluster [DBG] pgmap v1550: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:15.502570+0000 mgr.smithi008.flmjzp (mgr.14640) 2244 : cluster [DBG] pgmap v1550: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.631+0000 7f42ed348700 1 -- 172.21.15.8:0/662477868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e80f8740 msgr2=0x7f42e80f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.631+0000 7f42ed348700 1 --2- 172.21.15.8:0/662477868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e80f8740 0x7f42e80f8b60 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f42d8004660 tx=0x7f42d8009b30).stop 2023-10-18T21:36:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.631+0000 7f42ed348700 1 -- 172.21.15.8:0/662477868 shutdown_connections 2023-10-18T21:36:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.631+0000 7f42ed348700 1 --2- 172.21.15.8:0/662477868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e80f99e0 0x7f42e80f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.631+0000 7f42ed348700 1 --2- 172.21.15.8:0/662477868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e80f8740 0x7f42e80f8b60 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.631+0000 7f42ed348700 1 -- 172.21.15.8:0/662477868 >> 172.21.15.8:0/662477868 conn(0x7f42e80f40e0 msgr2=0x7f42e80f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.632+0000 7f42ed348700 1 -- 172.21.15.8:0/662477868 shutdown_connections 2023-10-18T21:36:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.632+0000 7f42ed348700 1 -- 172.21.15.8:0/662477868 wait complete. 2023-10-18T21:36:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.632+0000 7f42ed348700 1 Processor -- start 2023-10-18T21:36:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.633+0000 7f42ed348700 1 -- start start 2023-10-18T21:36:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.633+0000 7f42ed348700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e80f8740 0x7f42e8108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.633+0000 7f42ed348700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e80f99e0 0x7f42e8109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.633+0000 7f42ed348700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e81099e0 con 0x7f42e80f99e0 2023-10-18T21:36:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.633+0000 7f42ed348700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8109b20 con 0x7f42e80f8740 2023-10-18T21:36:17.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.633+0000 7f42e77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e80f99e0 0x7f42e8109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:17.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.633+0000 7f42e77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e80f99e0 0x7f42e8109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35778/0 (socket says 172.21.15.8:35778) 2023-10-18T21:36:17.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.633+0000 7f42e77fe700 1 -- 172.21.15.8:0/3393464058 learned_addr learned my addr 172.21.15.8:0/3393464058 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:17.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.634+0000 7f42e7fff700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e80f8740 0x7f42e8108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:17.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.634+0000 7f42e77fe700 1 -- 172.21.15.8:0/3393464058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e80f8740 msgr2=0x7f42e8108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:17.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.634+0000 7f42e77fe700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e80f8740 0x7f42e8108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:17.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.634+0000 7f42e77fe700 1 -- 172.21.15.8:0/3393464058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d8005040 con 0x7f42e80f99e0 2023-10-18T21:36:17.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.634+0000 7f42e77fe700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e80f99e0 0x7f42e8109430 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f42dc00e7f0 tx=0x7f42dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:17.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.634+0000 7f42e4ff9700 1 -- 172.21.15.8:0/3393464058 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42dc0092e0 con 0x7f42e80f99e0 2023-10-18T21:36:17.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.634+0000 7f42e4ff9700 1 -- 172.21.15.8:0/3393464058 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f42dc00f040 con 0x7f42e80f99e0 2023-10-18T21:36:17.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.634+0000 7f42e4ff9700 1 -- 172.21.15.8:0/3393464058 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42dc0147e0 con 0x7f42e80f99e0 2023-10-18T21:36:17.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.634+0000 7f42ed348700 1 -- 172.21.15.8:0/3393464058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e810a4c0 con 0x7f42e80f99e0 2023-10-18T21:36:17.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.635+0000 7f42ed348700 1 -- 172.21.15.8:0/3393464058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e810aa00 con 0x7f42e80f99e0 2023-10-18T21:36:17.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.636+0000 7f42ed348700 1 -- 172.21.15.8:0/3393464058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e8045ad0 con 0x7f42e80f99e0 2023-10-18T21:36:17.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.636+0000 7f42e4ff9700 1 -- 172.21.15.8:0/3393464058 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f42dc01b030 con 0x7f42e80f99e0 2023-10-18T21:36:17.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.637+0000 7f42e4ff9700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42d0060f70 0x7f42d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:17.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.637+0000 7f42e4ff9700 1 -- 172.21.15.8:0/3393464058 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f42dc07c6b0 con 0x7f42e80f99e0 2023-10-18T21:36:17.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.638+0000 7f42e7fff700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42d0060f70 0x7f42d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:17.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.638+0000 7f42e7fff700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42d0060f70 0x7f42d0063430 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f42d8009720 tx=0x7f42d8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:17.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.642+0000 7f42e4ff9700 1 -- 172.21.15.8:0/3393464058 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f42dc04fd40 con 0x7f42e80f99e0 2023-10-18T21:36:17.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.840+0000 7f42ed348700 1 -- 172.21.15.8:0/3393464058 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42e810ac70 con 0x7f42d0060f70 2023-10-18T21:36:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.842+0000 7f42e4ff9700 1 -- 172.21.15.8:0/3393464058 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f42e810ac70 con 0x7f42d0060f70 2023-10-18T21:36:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 -- 172.21.15.8:0/3393464058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42d0060f70 msgr2=0x7f42d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42d0060f70 0x7f42d0063430 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f42d8009720 tx=0x7f42d8016040).stop 2023-10-18T21:36:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 -- 172.21.15.8:0/3393464058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e80f99e0 msgr2=0x7f42e8109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:17.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e80f99e0 0x7f42e8109430 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f42dc00e7f0 tx=0x7f42dc00b040).stop 2023-10-18T21:36:17.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 -- 172.21.15.8:0/3393464058 shutdown_connections 2023-10-18T21:36:17.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42d0060f70 0x7f42d0063430 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:17.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e80f8740 0x7f42e8108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:17.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 --2- 172.21.15.8:0/3393464058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e80f99e0 0x7f42e8109430 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:17.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 -- 172.21.15.8:0/3393464058 >> 172.21.15.8:0/3393464058 conn(0x7f42e80f40e0 msgr2=0x7f42e80fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:17.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 -- 172.21.15.8:0/3393464058 shutdown_connections 2023-10-18T21:36:17.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.844+0000 7f42ed348700 1 -- 172.21.15.8:0/3393464058 wait complete. 2023-10-18T21:36:17.860 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:36:17.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.982+0000 7fe6010d8700 1 -- 172.21.15.8:0/1404693734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5fc0f77d0 msgr2=0x7fe5fc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:17.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.982+0000 7fe6010d8700 1 --2- 172.21.15.8:0/1404693734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5fc0f77d0 0x7fe5fc0f7c30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fe5f0004660 tx=0x7fe5f0009b30).stop 2023-10-18T21:36:17.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.982+0000 7fe6010d8700 1 -- 172.21.15.8:0/1404693734 shutdown_connections 2023-10-18T21:36:17.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.982+0000 7fe6010d8700 1 --2- 172.21.15.8:0/1404693734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5fc0f77d0 0x7fe5fc0f7c30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:17.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.982+0000 7fe6010d8700 1 --2- 172.21.15.8:0/1404693734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5fc0f6530 0x7fe5fc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:17.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.982+0000 7fe6010d8700 1 -- 172.21.15.8:0/1404693734 >> 172.21.15.8:0/1404693734 conn(0x7fe5fc0f1c90 msgr2=0x7fe5fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:17.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.982+0000 7fe6010d8700 1 -- 172.21.15.8:0/1404693734 shutdown_connections 2023-10-18T21:36:17.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.982+0000 7fe6010d8700 1 -- 172.21.15.8:0/1404693734 wait complete. 2023-10-18T21:36:17.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.983+0000 7fe6010d8700 1 Processor -- start 2023-10-18T21:36:17.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.983+0000 7fe6010d8700 1 -- start start 2023-10-18T21:36:17.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.983+0000 7fe6010d8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5fc0f6530 0x7fe5fc106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:17.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.983+0000 7fe6010d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5fc0f77d0 0x7fe5fc107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:17.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.983+0000 7fe6010d8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc1077d0 con 0x7fe5fc0f6530 2023-10-18T21:36:17.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.983+0000 7fe6010d8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc107fd0 con 0x7fe5fc0f77d0 2023-10-18T21:36:17.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.983+0000 7fe5fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5fc0f6530 0x7fe5fc106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5fc0f6530 0x7fe5fc106d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35796/0 (socket says 172.21.15.8:35796) 2023-10-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5fb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5fc0f77d0 0x7fe5fc107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5fbfff700 1 -- 172.21.15.8:0/1425856992 learned_addr learned my addr 172.21.15.8:0/1425856992 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5fbfff700 1 -- 172.21.15.8:0/1425856992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5fc0f77d0 msgr2=0x7fe5fc107220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:17.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5fbfff700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5fc0f77d0 0x7fe5fc107220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:17.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5fbfff700 1 -- 172.21.15.8:0/1425856992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f0005040 con 0x7fe5fc0f6530 2023-10-18T21:36:17.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5fb7fe700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5fc0f77d0 0x7fe5fc107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:36:17.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5fbfff700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5fc0f6530 0x7fe5fc106d30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fe5ec00e7c0 tx=0x7fe5ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:17.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5f8ff9700 1 -- 172.21.15.8:0/1425856992 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec0092e0 con 0x7fe5fc0f6530 2023-10-18T21:36:17.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe6010d8700 1 -- 172.21.15.8:0/1425856992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc1082b0 con 0x7fe5fc0f6530 2023-10-18T21:36:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5f8ff9700 1 -- 172.21.15.8:0/1425856992 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe5ec00f040 con 0x7fe5fc0f6530 2023-10-18T21:36:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.984+0000 7fe5f8ff9700 1 -- 172.21.15.8:0/1425856992 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec014810 con 0x7fe5fc0f6530 2023-10-18T21:36:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.985+0000 7fe6010d8700 1 -- 172.21.15.8:0/1425856992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc1087f0 con 0x7fe5fc0f6530 2023-10-18T21:36:17.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.986+0000 7fe6010d8700 1 -- 172.21.15.8:0/1425856992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc059100 con 0x7fe5fc0f6530 2023-10-18T21:36:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.987+0000 7fe5f8ff9700 1 -- 172.21.15.8:0/1425856992 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe5ec01b030 con 0x7fe5fc0f6530 2023-10-18T21:36:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.987+0000 7fe5f8ff9700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5e4060f70 0x7fe5e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:17.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.988+0000 7fe5f8ff9700 1 -- 172.21.15.8:0/1425856992 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe5ec07c6e0 con 0x7fe5fc0f6530 2023-10-18T21:36:17.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.988+0000 7fe5fb7fe700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5e4060f70 0x7fe5e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:17.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.988+0000 7fe5fb7fe700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5e4060f70 0x7fe5e4063430 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fe5f0000c00 tx=0x7fe5f0016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:17.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:17.992+0000 7fe5f8ff9700 1 -- 172.21.15.8:0/1425856992 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe5ec04fd70 con 0x7fe5fc0f6530 2023-10-18T21:36:18.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.190+0000 7fe6010d8700 1 -- 172.21.15.8:0/1425856992 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5fc0fee50 con 0x7fe5e4060f70 2023-10-18T21:36:18.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.192+0000 7fe5f8ff9700 1 -- 172.21.15.8:0/1425856992 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe5fc0fee50 con 0x7fe5e4060f70 2023-10-18T21:36:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 -- 172.21.15.8:0/1425856992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5e4060f70 msgr2=0x7fe5e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5e4060f70 0x7fe5e4063430 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fe5f0000c00 tx=0x7fe5f0016040).stop 2023-10-18T21:36:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 -- 172.21.15.8:0/1425856992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5fc0f6530 msgr2=0x7fe5fc106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5fc0f6530 0x7fe5fc106d30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fe5ec00e7c0 tx=0x7fe5ec00b040).stop 2023-10-18T21:36:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 -- 172.21.15.8:0/1425856992 shutdown_connections 2023-10-18T21:36:18.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5e4060f70 0x7fe5e4063430 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5fc0f6530 0x7fe5fc106d30 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 --2- 172.21.15.8:0/1425856992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5fc0f77d0 0x7fe5fc107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 -- 172.21.15.8:0/1425856992 >> 172.21.15.8:0/1425856992 conn(0x7fe5fc0f1c90 msgr2=0x7fe5fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 -- 172.21.15.8:0/1425856992 shutdown_connections 2023-10-18T21:36:18.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.194+0000 7fe6010d8700 1 -- 172.21.15.8:0/1425856992 wait complete. 2023-10-18T21:36:18.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.331+0000 7f3dcd11e700 1 -- 172.21.15.8:0/2884119610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80f6530 msgr2=0x7f3dc80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:18.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.331+0000 7f3dcd11e700 1 --2- 172.21.15.8:0/2884119610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80f6530 0x7f3dc80f6950 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f3db8004660 tx=0x7f3db8009b30).stop 2023-10-18T21:36:18.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.331+0000 7f3dcd11e700 1 -- 172.21.15.8:0/2884119610 shutdown_connections 2023-10-18T21:36:18.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.331+0000 7f3dcd11e700 1 --2- 172.21.15.8:0/2884119610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc80f77d0 0x7f3dc80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.331+0000 7f3dcd11e700 1 --2- 172.21.15.8:0/2884119610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80f6530 0x7f3dc80f6950 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.331+0000 7f3dcd11e700 1 -- 172.21.15.8:0/2884119610 >> 172.21.15.8:0/2884119610 conn(0x7f3dc80f1c90 msgr2=0x7f3dc80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:18.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.331+0000 7f3dcd11e700 1 -- 172.21.15.8:0/2884119610 shutdown_connections 2023-10-18T21:36:18.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.331+0000 7f3dcd11e700 1 -- 172.21.15.8:0/2884119610 wait complete. 2023-10-18T21:36:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.332+0000 7f3dcd11e700 1 Processor -- start 2023-10-18T21:36:18.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.332+0000 7f3dcd11e700 1 -- start start 2023-10-18T21:36:18.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.332+0000 7f3dcd11e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc80f6530 0x7f3dc8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:18.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.332+0000 7f3dcd11e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80f77d0 0x7f3dc81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:18.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.332+0000 7f3dcd11e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc8109a70 con 0x7f3dc80f77d0 2023-10-18T21:36:18.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.332+0000 7f3dcd11e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc8109bb0 con 0x7f3dc80f6530 2023-10-18T21:36:18.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.332+0000 7f3dc77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80f77d0 0x7f3dc81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:18.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dc77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80f77d0 0x7f3dc81094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35812/0 (socket says 172.21.15.8:35812) 2023-10-18T21:36:18.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dc77fe700 1 -- 172.21.15.8:0/3701886018 learned_addr learned my addr 172.21.15.8:0/3701886018 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:18.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dc7fff700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc80f6530 0x7f3dc8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:18.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dc77fe700 1 -- 172.21.15.8:0/3701886018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc80f6530 msgr2=0x7f3dc8108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:18.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dc77fe700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc80f6530 0x7f3dc8108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dc77fe700 1 -- 172.21.15.8:0/3701886018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db8005040 con 0x7f3dc80f77d0 2023-10-18T21:36:18.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dc77fe700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80f77d0 0x7f3dc81094c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f3dbc00c790 tx=0x7f3dbc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:18.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dc4ff9700 1 -- 172.21.15.8:0/3701886018 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dbc00e680 con 0x7f3dc80f77d0 2023-10-18T21:36:18.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dc4ff9700 1 -- 172.21.15.8:0/3701886018 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3dbc00eca0 con 0x7f3dc80f77d0 2023-10-18T21:36:18.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dc4ff9700 1 -- 172.21.15.8:0/3701886018 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dbc013de0 con 0x7f3dc80f77d0 2023-10-18T21:36:18.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.333+0000 7f3dcd11e700 1 -- 172.21.15.8:0/3701886018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc810a550 con 0x7f3dc80f77d0 2023-10-18T21:36:18.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.334+0000 7f3dcd11e700 1 -- 172.21.15.8:0/3701886018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc810ab10 con 0x7f3dc80f77d0 2023-10-18T21:36:18.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.335+0000 7f3dcd11e700 1 -- 172.21.15.8:0/3701886018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc8045ad0 con 0x7f3dc80f77d0 2023-10-18T21:36:18.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.335+0000 7f3dc4ff9700 1 -- 172.21.15.8:0/3701886018 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3dbc01a060 con 0x7f3dc80f77d0 2023-10-18T21:36:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.337+0000 7f3dc4ff9700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db0060f70 0x7f3db0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.337+0000 7f3dc4ff9700 1 -- 172.21.15.8:0/3701886018 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3dbc07cb70 con 0x7f3dc80f77d0 2023-10-18T21:36:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.337+0000 7f3dc7fff700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db0060f70 0x7f3db0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:18.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.337+0000 7f3dc7fff700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db0060f70 0x7f3db0063430 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f3db8009490 tx=0x7f3db8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:18.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.341+0000 7f3dc4ff9700 1 -- 172.21.15.8:0/3701886018 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3dbc0501d0 con 0x7f3dc80f77d0 2023-10-18T21:36:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.533+0000 7f3dcd11e700 1 -- 172.21.15.8:0/3701886018 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dc80fee30 con 0x7f3db0060f70 2023-10-18T21:36:18.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.543+0000 7f3dc4ff9700 1 -- 172.21.15.8:0/3701886018 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3dc80fee30 con 0x7f3db0060f70 2023-10-18T21:36:18.545 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:36:18.545 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (42m) 40s ago 44m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:36:18.545 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (36m) 40s ago 44m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:36:18.546 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (36m) 8m ago 43m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:36:18.546 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (42m) 40s ago 44m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:36:18.546 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 40s ago 40m - - 2023-10-18T21:36:18.546 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 40s ago 40m - - 2023-10-18T21:36:18.546 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 40m - - 2023-10-18T21:36:18.547 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 40m - - 2023-10-18T21:36:18.547 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (38m) 40s ago 45m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:36:18.547 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (37m) 8m ago 43m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:36:18.547 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (37m) 40s ago 45m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:36:18.547 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (37m) 8m ago 43m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:36:18.548 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (43m) 40s ago 43m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:36:18.548 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (43m) 8m ago 43m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:36:18.548 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (36m) 40s ago 43m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:36:18.548 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (34m) 40s ago 42m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:36:18.548 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (34m) 40s ago 42m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:36:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (33m) 8m ago 42m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:36:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (32m) 8m ago 41m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:36:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (32m) 8m ago 41m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:36:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (38m) 40s ago 43m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:36:18.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 -- 172.21.15.8:0/3701886018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db0060f70 msgr2=0x7f3db0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:18.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db0060f70 0x7f3db0063430 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f3db8009490 tx=0x7f3db8009b30).stop 2023-10-18T21:36:18.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 -- 172.21.15.8:0/3701886018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80f77d0 msgr2=0x7f3dc81094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:18.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80f77d0 0x7f3dc81094c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f3dbc00c790 tx=0x7f3dbc007d70).stop 2023-10-18T21:36:18.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 -- 172.21.15.8:0/3701886018 shutdown_connections 2023-10-18T21:36:18.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db0060f70 0x7f3db0063430 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc80f6530 0x7f3dc8108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 --2- 172.21.15.8:0/3701886018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80f77d0 0x7f3dc81094c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 -- 172.21.15.8:0/3701886018 >> 172.21.15.8:0/3701886018 conn(0x7f3dc80f1c90 msgr2=0x7f3dc806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:18.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 -- 172.21.15.8:0/3701886018 shutdown_connections 2023-10-18T21:36:18.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.545+0000 7f3dcd11e700 1 -- 172.21.15.8:0/3701886018 wait complete. 2023-10-18T21:36:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.681+0000 7fbad359e700 1 -- 172.21.15.8:0/1040119351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad40f77d0 msgr2=0x7fbad40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.681+0000 7fbad359e700 1 --2- 172.21.15.8:0/1040119351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad40f77d0 0x7fbad40f7c30 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7fbac8004660 tx=0x7fbac8009b30).stop 2023-10-18T21:36:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.682+0000 7fbad359e700 1 -- 172.21.15.8:0/1040119351 shutdown_connections 2023-10-18T21:36:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.682+0000 7fbad359e700 1 --2- 172.21.15.8:0/1040119351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad40f77d0 0x7fbad40f7c30 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.682+0000 7fbad359e700 1 --2- 172.21.15.8:0/1040119351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad40f6530 0x7fbad40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.682+0000 7fbad359e700 1 -- 172.21.15.8:0/1040119351 >> 172.21.15.8:0/1040119351 conn(0x7fbad40f1c90 msgr2=0x7fbad40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:18.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.682+0000 7fbad359e700 1 -- 172.21.15.8:0/1040119351 shutdown_connections 2023-10-18T21:36:18.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.682+0000 7fbad359e700 1 -- 172.21.15.8:0/1040119351 wait complete. 2023-10-18T21:36:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.682+0000 7fbad359e700 1 Processor -- start 2023-10-18T21:36:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.683+0000 7fbad359e700 1 -- start start 2023-10-18T21:36:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.683+0000 7fbad359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad40f6530 0x7fbad4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.683+0000 7fbad359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad40f77d0 0x7fbad4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.683+0000 7fbad359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad4107880 con 0x7fbad40f77d0 2023-10-18T21:36:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.683+0000 7fbad359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad41080c0 con 0x7fbad40f6530 2023-10-18T21:36:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.683+0000 7fbad1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad40f77d0 0x7fbad4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.683+0000 7fbad1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad40f77d0 0x7fbad4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35826/0 (socket says 172.21.15.8:35826) 2023-10-18T21:36:18.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.683+0000 7fbad1d9b700 1 -- 172.21.15.8:0/3769197478 learned_addr learned my addr 172.21.15.8:0/3769197478 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:18.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.683+0000 7fbad259c700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad40f6530 0x7fbad4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:18.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.684+0000 7fbad1d9b700 1 -- 172.21.15.8:0/3769197478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad40f6530 msgr2=0x7fbad4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:18.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.684+0000 7fbad1d9b700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad40f6530 0x7fbad4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.684+0000 7fbad1d9b700 1 -- 172.21.15.8:0/3769197478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8005040 con 0x7fbad40f77d0 2023-10-18T21:36:18.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.684+0000 7fbad1d9b700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad40f77d0 0x7fbad4107280 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fbac8009f50 tx=0x7fbac8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:18.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.684+0000 7fbac2ffd700 1 -- 172.21.15.8:0/3769197478 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbac8018070 con 0x7fbad40f77d0 2023-10-18T21:36:18.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.684+0000 7fbac2ffd700 1 -- 172.21.15.8:0/3769197478 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbac8009630 con 0x7fbad40f77d0 2023-10-18T21:36:18.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.684+0000 7fbad359e700 1 -- 172.21.15.8:0/3769197478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad4108340 con 0x7fbad40f77d0 2023-10-18T21:36:18.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.684+0000 7fbac2ffd700 1 -- 172.21.15.8:0/3769197478 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbac801c3c0 con 0x7fbad40f77d0 2023-10-18T21:36:18.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.684+0000 7fbad359e700 1 -- 172.21.15.8:0/3769197478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad4108820 con 0x7fbad40f77d0 2023-10-18T21:36:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.685+0000 7fbad359e700 1 -- 172.21.15.8:0/3769197478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad4059100 con 0x7fbad40f77d0 2023-10-18T21:36:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.686+0000 7fbac2ffd700 1 -- 172.21.15.8:0/3769197478 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbac801d420 con 0x7fbad40f77d0 2023-10-18T21:36:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.688+0000 7fbac2ffd700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbabc060f70 0x7fbabc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.688+0000 7fbac2ffd700 1 -- 172.21.15.8:0/3769197478 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbac807e540 con 0x7fbad40f77d0 2023-10-18T21:36:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.688+0000 7fbad259c700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbabc060f70 0x7fbabc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.688+0000 7fbad259c700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbabc060f70 0x7fbabc063430 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fbad4107b50 tx=0x7fbac400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.692+0000 7fbac2ffd700 1 -- 172.21.15.8:0/3769197478 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbac804e170 con 0x7fbad40f77d0 2023-10-18T21:36:18.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:17.503046+0000 mgr.smithi008.flmjzp (mgr.14640) 2245 : cluster [DBG] pgmap v1551: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:18.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:17.843089+0000 mgr.smithi008.flmjzp (mgr.14640) 2246 : audit [DBG] from='client.35944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.949+0000 7fbad359e700 1 -- 172.21.15.8:0/3769197478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbad4045ad0 con 0x7fbad40f77d0 2023-10-18T21:36:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.950+0000 7fbac2ffd700 1 -- 172.21.15.8:0/3769197478 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fbac8051790 con 0x7fbad40f77d0 2023-10-18T21:36:18.952 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:36:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:36:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:36:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:36:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:36:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:36:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:36:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:36:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:36:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:36:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:36:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:36:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:36:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:36:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:36:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:36:18.955 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:36:18.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 -- 172.21.15.8:0/3769197478 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbabc060f70 msgr2=0x7fbabc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:18.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbabc060f70 0x7fbabc063430 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fbad4107b50 tx=0x7fbac400b040).stop 2023-10-18T21:36:18.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 -- 172.21.15.8:0/3769197478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad40f77d0 msgr2=0x7fbad4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:18.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad40f77d0 0x7fbad4107280 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fbac8009f50 tx=0x7fbac8009b30).stop 2023-10-18T21:36:18.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 -- 172.21.15.8:0/3769197478 shutdown_connections 2023-10-18T21:36:18.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbabc060f70 0x7fbabc063430 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad40f6530 0x7fbad4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 --2- 172.21.15.8:0/3769197478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad40f77d0 0x7fbad4107280 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:18.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 -- 172.21.15.8:0/3769197478 >> 172.21.15.8:0/3769197478 conn(0x7fbad40f1c90 msgr2=0x7fbad40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:18.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 -- 172.21.15.8:0/3769197478 shutdown_connections 2023-10-18T21:36:18.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:18.952+0000 7fbad359e700 1 -- 172.21.15.8:0/3769197478 wait complete. 2023-10-18T21:36:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:17.503046+0000 mgr.smithi008.flmjzp (mgr.14640) 2245 : cluster [DBG] pgmap v1551: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:17.843089+0000 mgr.smithi008.flmjzp (mgr.14640) 2246 : audit [DBG] from='client.35944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:19.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.089+0000 7f5f5359e700 1 -- 172.21.15.8:0/321355332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f540f77d0 msgr2=0x7f5f540f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:19.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.089+0000 7f5f5359e700 1 --2- 172.21.15.8:0/321355332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f540f77d0 0x7f5f540f7c30 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f5f48004660 tx=0x7f5f48009b30).stop 2023-10-18T21:36:19.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.089+0000 7f5f5359e700 1 -- 172.21.15.8:0/321355332 shutdown_connections 2023-10-18T21:36:19.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.089+0000 7f5f5359e700 1 --2- 172.21.15.8:0/321355332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f540f77d0 0x7f5f540f7c30 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.089+0000 7f5f5359e700 1 --2- 172.21.15.8:0/321355332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f540f6530 0x7f5f540f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.089+0000 7f5f5359e700 1 -- 172.21.15.8:0/321355332 >> 172.21.15.8:0/321355332 conn(0x7f5f540f1c90 msgr2=0x7f5f540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:19.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.089+0000 7f5f5359e700 1 -- 172.21.15.8:0/321355332 shutdown_connections 2023-10-18T21:36:19.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.089+0000 7f5f5359e700 1 -- 172.21.15.8:0/321355332 wait complete. 2023-10-18T21:36:19.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.090+0000 7f5f5359e700 1 Processor -- start 2023-10-18T21:36:19.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.090+0000 7f5f5359e700 1 -- start start 2023-10-18T21:36:19.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.090+0000 7f5f5359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f540f6530 0x7f5f54106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:19.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.090+0000 7f5f5359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f540f77d0 0x7f5f54107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:19.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.090+0000 7f5f5359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541077d0 con 0x7f5f540f77d0 2023-10-18T21:36:19.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.091+0000 7f5f5359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54107fd0 con 0x7f5f540f6530 2023-10-18T21:36:19.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.091+0000 7f5f51d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f540f77d0 0x7f5f54107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:19.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.091+0000 7f5f51d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f540f77d0 0x7f5f54107220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35836/0 (socket says 172.21.15.8:35836) 2023-10-18T21:36:19.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.091+0000 7f5f51d9b700 1 -- 172.21.15.8:0/3476558384 learned_addr learned my addr 172.21.15.8:0/3476558384 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:19.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.091+0000 7f5f5259c700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f540f6530 0x7f5f54106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:19.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.091+0000 7f5f51d9b700 1 -- 172.21.15.8:0/3476558384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f540f6530 msgr2=0x7f5f54106d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:19.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.091+0000 7f5f51d9b700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f540f6530 0x7f5f54106d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.091+0000 7f5f51d9b700 1 -- 172.21.15.8:0/3476558384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48005040 con 0x7f5f540f77d0 2023-10-18T21:36:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.091+0000 7f5f51d9b700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f540f77d0 0x7f5f54107220 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f5f48004320 tx=0x7f5f4800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.092+0000 7f5f42ffd700 1 -- 172.21.15.8:0/3476558384 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f48019070 con 0x7f5f540f77d0 2023-10-18T21:36:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.092+0000 7f5f42ffd700 1 -- 172.21.15.8:0/3476558384 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5f4801e420 con 0x7f5f540f77d0 2023-10-18T21:36:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.092+0000 7f5f5359e700 1 -- 172.21.15.8:0/3476558384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f54108250 con 0x7f5f540f77d0 2023-10-18T21:36:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.092+0000 7f5f42ffd700 1 -- 172.21.15.8:0/3476558384 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f48014660 con 0x7f5f540f77d0 2023-10-18T21:36:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.092+0000 7f5f5359e700 1 -- 172.21.15.8:0/3476558384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f54108730 con 0x7f5f540f77d0 2023-10-18T21:36:19.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.093+0000 7f5f5359e700 1 -- 172.21.15.8:0/3476558384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f54059100 con 0x7f5f540f77d0 2023-10-18T21:36:19.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.094+0000 7f5f42ffd700 1 -- 172.21.15.8:0/3476558384 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5f4801e590 con 0x7f5f540f77d0 2023-10-18T21:36:19.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.095+0000 7f5f42ffd700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f3c060f70 0x7f5f3c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:19.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.095+0000 7f5f42ffd700 1 -- 172.21.15.8:0/3476558384 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5f4807dec0 con 0x7f5f540f77d0 2023-10-18T21:36:19.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.095+0000 7f5f5259c700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f3c060f70 0x7f5f3c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:19.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.096+0000 7f5f5259c700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f3c060f70 0x7f5f3c063430 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f5f540f7630 tx=0x7f5f4400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:19.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.099+0000 7f5f42ffd700 1 -- 172.21.15.8:0/3476558384 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5f48051440 con 0x7f5f540f77d0 2023-10-18T21:36:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.327+0000 7f5f5359e700 1 -- 172.21.15.8:0/3476558384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5f54045ad0 con 0x7f5f540f77d0 2023-10-18T21:36:19.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.327+0000 7f5f42ffd700 1 -- 172.21.15.8:0/3476558384 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f5f48051030 con 0x7f5f540f77d0 2023-10-18T21:36:19.330 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:36:19.330 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:36:19.330 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:36:19.330 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:36:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:36:19.331 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:36:19.331 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:36:19.331 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:36:19.331 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:36:19.332 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:36:19.332 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:36:19.332 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:36:19.332 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:36:19.332 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:36:19.333 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:36:19.333 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:36:19.333 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:36:19.333 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:36:19.333 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:36:19.334 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:36:19.334 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:36:19.334 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:36:19.334 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:36:19.334 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:36:19.335 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:36:19.335 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:36:19.335 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:36:19.335 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:36:19.335 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:36:19.336 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:36:19.336 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:36:19.336 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:36:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:36:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:36:19.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 -- 172.21.15.8:0/3476558384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f3c060f70 msgr2=0x7f5f3c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:19.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f3c060f70 0x7f5f3c063430 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f5f540f7630 tx=0x7f5f4400b040).stop 2023-10-18T21:36:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 -- 172.21.15.8:0/3476558384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f540f77d0 msgr2=0x7f5f54107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f540f77d0 0x7f5f54107220 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f5f48004320 tx=0x7f5f4800b040).stop 2023-10-18T21:36:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 -- 172.21.15.8:0/3476558384 shutdown_connections 2023-10-18T21:36:19.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f3c060f70 0x7f5f3c063430 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f540f6530 0x7f5f54106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 --2- 172.21.15.8:0/3476558384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f540f77d0 0x7f5f54107220 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 -- 172.21.15.8:0/3476558384 >> 172.21.15.8:0/3476558384 conn(0x7f5f540f1c90 msgr2=0x7f5f540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 -- 172.21.15.8:0/3476558384 shutdown_connections 2023-10-18T21:36:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.329+0000 7f5f5359e700 1 -- 172.21.15.8:0/3476558384 wait complete. 2023-10-18T21:36:19.340 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:36:19.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.467+0000 7fe98ab81700 1 -- 172.21.15.8:0/316584124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9840f77d0 msgr2=0x7fe9840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:19.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.467+0000 7fe98ab81700 1 --2- 172.21.15.8:0/316584124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9840f77d0 0x7fe9840f7c30 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fe974004660 tx=0x7fe974009b30).stop 2023-10-18T21:36:19.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.467+0000 7fe98ab81700 1 -- 172.21.15.8:0/316584124 shutdown_connections 2023-10-18T21:36:19.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.467+0000 7fe98ab81700 1 --2- 172.21.15.8:0/316584124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9840f77d0 0x7fe9840f7c30 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.467+0000 7fe98ab81700 1 --2- 172.21.15.8:0/316584124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9840f6530 0x7fe9840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.467+0000 7fe98ab81700 1 -- 172.21.15.8:0/316584124 >> 172.21.15.8:0/316584124 conn(0x7fe9840f1c90 msgr2=0x7fe9840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:19.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.467+0000 7fe98ab81700 1 -- 172.21.15.8:0/316584124 shutdown_connections 2023-10-18T21:36:19.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.467+0000 7fe98ab81700 1 -- 172.21.15.8:0/316584124 wait complete. 2023-10-18T21:36:19.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.468+0000 7fe98ab81700 1 Processor -- start 2023-10-18T21:36:19.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.468+0000 7fe98ab81700 1 -- start start 2023-10-18T21:36:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.469+0000 7fe98ab81700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9840f6530 0x7fe98406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.469+0000 7fe98ab81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9840f77d0 0x7fe984069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.469+0000 7fe98ab81700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98406a380 con 0x7fe9840f6530 2023-10-18T21:36:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.469+0000 7fe98ab81700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98406a4c0 con 0x7fe9840f77d0 2023-10-18T21:36:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.469+0000 7fe989b7f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9840f6530 0x7fe98406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.469+0000 7fe989b7f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9840f6530 0x7fe98406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35864/0 (socket says 172.21.15.8:35864) 2023-10-18T21:36:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.469+0000 7fe989b7f700 1 -- 172.21.15.8:0/512874382 learned_addr learned my addr 172.21.15.8:0/512874382 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.469+0000 7fe98937e700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9840f77d0 0x7fe984069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.470+0000 7fe989b7f700 1 -- 172.21.15.8:0/512874382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9840f77d0 msgr2=0x7fe984069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.470+0000 7fe989b7f700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9840f77d0 0x7fe984069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.470+0000 7fe989b7f700 1 -- 172.21.15.8:0/512874382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe974005040 con 0x7fe9840f6530 2023-10-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.470+0000 7fe98937e700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9840f77d0 0x7fe984069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.470+0000 7fe989b7f700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9840f6530 0x7fe98406b9a0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fe98000e7c0 tx=0x7fe98000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.470+0000 7fe97a7fc700 1 -- 172.21.15.8:0/512874382 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9800092e0 con 0x7fe9840f6530 2023-10-18T21:36:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.470+0000 7fe97a7fc700 1 -- 172.21.15.8:0/512874382 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe98000f040 con 0x7fe9840f6530 2023-10-18T21:36:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.470+0000 7fe98ab81700 1 -- 172.21.15.8:0/512874382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98406a7a0 con 0x7fe9840f6530 2023-10-18T21:36:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.470+0000 7fe97a7fc700 1 -- 172.21.15.8:0/512874382 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9800147e0 con 0x7fe9840f6530 2023-10-18T21:36:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.470+0000 7fe98ab81700 1 -- 172.21.15.8:0/512874382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98410ed20 con 0x7fe9840f6530 2023-10-18T21:36:19.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.471+0000 7fe98ab81700 1 -- 172.21.15.8:0/512874382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe984045ad0 con 0x7fe9840f6530 2023-10-18T21:36:19.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.472+0000 7fe97a7fc700 1 -- 172.21.15.8:0/512874382 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe98001b030 con 0x7fe9840f6530 2023-10-18T21:36:19.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.473+0000 7fe97a7fc700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe970060f70 0x7fe970063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:19.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.473+0000 7fe97a7fc700 1 -- 172.21.15.8:0/512874382 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe98007c990 con 0x7fe9840f6530 2023-10-18T21:36:19.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.473+0000 7fe98937e700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe970060f70 0x7fe970063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:19.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.474+0000 7fe98937e700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe970060f70 0x7fe970063430 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fe974009720 tx=0x7fe97400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:19.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.477+0000 7fe97a7fc700 1 -- 172.21.15.8:0/512874382 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe98004c4e0 con 0x7fe9840f6530 2023-10-18T21:36:19.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.679+0000 7fe98ab81700 1 -- 172.21.15.8:0/512874382 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9840fee30 con 0x7fe970060f70 2023-10-18T21:36:19.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.680+0000 7fe97a7fc700 1 -- 172.21.15.8:0/512874382 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe9840fee30 con 0x7fe970060f70 2023-10-18T21:36:19.682 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:36:19.682 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:36:19.682 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:36:19.683 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:36:19.683 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:36:19.683 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:36:19.683 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:36:19.683 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:36:19.684 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:36:19.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 -- 172.21.15.8:0/512874382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe970060f70 msgr2=0x7fe970063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:19.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe970060f70 0x7fe970063430 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fe974009720 tx=0x7fe97400b040).stop 2023-10-18T21:36:19.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 -- 172.21.15.8:0/512874382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9840f6530 msgr2=0x7fe98406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:19.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9840f6530 0x7fe98406b9a0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fe98000e7c0 tx=0x7fe98000b040).stop 2023-10-18T21:36:19.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 -- 172.21.15.8:0/512874382 shutdown_connections 2023-10-18T21:36:19.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe970060f70 0x7fe970063430 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9840f6530 0x7fe98406b9a0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 --2- 172.21.15.8:0/512874382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9840f77d0 0x7fe984069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 -- 172.21.15.8:0/512874382 >> 172.21.15.8:0/512874382 conn(0x7fe9840f1c90 msgr2=0x7fe9840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 -- 172.21.15.8:0/512874382 shutdown_connections 2023-10-18T21:36:19.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:19.682+0000 7fe98ab81700 1 -- 172.21.15.8:0/512874382 wait complete. 2023-10-18T21:36:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:18.193146+0000 mgr.smithi008.flmjzp (mgr.14640) 2247 : audit [DBG] from='client.35948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:18.535733+0000 mgr.smithi008.flmjzp (mgr.14640) 2248 : audit [DBG] from='client.35952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:18.951192+0000 mon.smithi008 (mon.0) 2672 : audit [DBG] from='client.? 172.21.15.8:0/3769197478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.328997+0000 mon.smithi008 (mon.0) 2673 : audit [DBG] from='client.? 172.21.15.8:0/3476558384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:36:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.533366+0000 mon.smithi008 (mon.0) 2674 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.535048+0000 mon.smithi008 (mon.0) 2675 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.535745+0000 mon.smithi008 (mon.0) 2676 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.541102+0000 mon.smithi008 (mon.0) 2677 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.546154+0000 mon.smithi008 (mon.0) 2678 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.548700+0000 mon.smithi008 (mon.0) 2679 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.549984+0000 mon.smithi008 (mon.0) 2680 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:19.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.551217+0000 mon.smithi008 (mon.0) 2681 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:19.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.552835+0000 mon.smithi008 (mon.0) 2682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:18.193146+0000 mgr.smithi008.flmjzp (mgr.14640) 2247 : audit [DBG] from='client.35948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:18.535733+0000 mgr.smithi008.flmjzp (mgr.14640) 2248 : audit [DBG] from='client.35952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:18.951192+0000 mon.smithi008 (mon.0) 2672 : audit [DBG] from='client.? 172.21.15.8:0/3769197478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.328997+0000 mon.smithi008 (mon.0) 2673 : audit [DBG] from='client.? 172.21.15.8:0/3476558384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:36:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.533366+0000 mon.smithi008 (mon.0) 2674 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.535048+0000 mon.smithi008 (mon.0) 2675 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.535745+0000 mon.smithi008 (mon.0) 2676 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.541102+0000 mon.smithi008 (mon.0) 2677 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.546154+0000 mon.smithi008 (mon.0) 2678 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.548700+0000 mon.smithi008 (mon.0) 2679 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.549984+0000 mon.smithi008 (mon.0) 2680 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.551217+0000 mon.smithi008 (mon.0) 2681 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:19.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.552835+0000 mon.smithi008 (mon.0) 2682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:19.503518+0000 mgr.smithi008.flmjzp (mgr.14640) 2249 : cluster [DBG] pgmap v1552: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:36:19.536384+0000 mgr.smithi008.flmjzp (mgr.14640) 2250 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:19.536833+0000 mgr.smithi008.flmjzp (mgr.14640) 2251 : cluster [DBG] pgmap v1553: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:20.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:19.537041+0000 mgr.smithi008.flmjzp (mgr.14640) 2252 : cluster [DBG] pgmap v1554: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:20.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:36:19.554363+0000 mgr.smithi008.flmjzp (mgr.14640) 2253 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:20.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:19.681351+0000 mgr.smithi008.flmjzp (mgr.14640) 2254 : audit [DBG] from='client.35964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:20.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:19.503518+0000 mgr.smithi008.flmjzp (mgr.14640) 2249 : cluster [DBG] pgmap v1552: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:36:19.536384+0000 mgr.smithi008.flmjzp (mgr.14640) 2250 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:19.536833+0000 mgr.smithi008.flmjzp (mgr.14640) 2251 : cluster [DBG] pgmap v1553: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:19.537041+0000 mgr.smithi008.flmjzp (mgr.14640) 2252 : cluster [DBG] pgmap v1554: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:36:19.554363+0000 mgr.smithi008.flmjzp (mgr.14640) 2253 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:19.681351+0000 mgr.smithi008.flmjzp (mgr.14640) 2254 : audit [DBG] from='client.35964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:22.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:21.537676+0000 mgr.smithi008.flmjzp (mgr.14640) 2255 : cluster [DBG] pgmap v1555: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:22.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:21.537676+0000 mgr.smithi008.flmjzp (mgr.14640) 2255 : cluster [DBG] pgmap v1555: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:23.538156+0000 mgr.smithi008.flmjzp (mgr.14640) 2256 : cluster [DBG] pgmap v1556: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:24.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:23.538156+0000 mgr.smithi008.flmjzp (mgr.14640) 2256 : cluster [DBG] pgmap v1556: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:25.538691+0000 mgr.smithi008.flmjzp (mgr.14640) 2257 : cluster [DBG] pgmap v1557: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:25.538691+0000 mgr.smithi008.flmjzp (mgr.14640) 2257 : cluster [DBG] pgmap v1557: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:27.539304+0000 mgr.smithi008.flmjzp (mgr.14640) 2258 : cluster [DBG] pgmap v1558: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:28.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:27.539304+0000 mgr.smithi008.flmjzp (mgr.14640) 2258 : cluster [DBG] pgmap v1558: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:29.565202+0000 mon.smithi008 (mon.0) 2683 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:29.567355+0000 mon.smithi008 (mon.0) 2684 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:29.568360+0000 mon.smithi008 (mon.0) 2685 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:29.574871+0000 mon.smithi008 (mon.0) 2686 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:29.581262+0000 mon.smithi008 (mon.0) 2687 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:29.584361+0000 mon.smithi008 (mon.0) 2688 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:29.586016+0000 mon.smithi008 (mon.0) 2689 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:29.587629+0000 mon.smithi008 (mon.0) 2690 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:29.589611+0000 mon.smithi008 (mon.0) 2691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:29.565202+0000 mon.smithi008 (mon.0) 2683 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:29.567355+0000 mon.smithi008 (mon.0) 2684 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:29.568360+0000 mon.smithi008 (mon.0) 2685 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:29.574871+0000 mon.smithi008 (mon.0) 2686 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:29.581262+0000 mon.smithi008 (mon.0) 2687 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:29.584361+0000 mon.smithi008 (mon.0) 2688 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:29.586016+0000 mon.smithi008 (mon.0) 2689 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:29.587629+0000 mon.smithi008 (mon.0) 2690 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:29.589611+0000 mon.smithi008 (mon.0) 2691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:29.539901+0000 mgr.smithi008.flmjzp (mgr.14640) 2259 : cluster [DBG] pgmap v1559: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:36:29.569250+0000 mgr.smithi008.flmjzp (mgr.14640) 2260 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:29.569855+0000 mgr.smithi008.flmjzp (mgr.14640) 2261 : cluster [DBG] pgmap v1560: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:29.570253+0000 mgr.smithi008.flmjzp (mgr.14640) 2262 : cluster [DBG] pgmap v1561: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:36:29.591517+0000 mgr.smithi008.flmjzp (mgr.14640) 2263 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:30.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:29.539901+0000 mgr.smithi008.flmjzp (mgr.14640) 2259 : cluster [DBG] pgmap v1559: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:36:29.569250+0000 mgr.smithi008.flmjzp (mgr.14640) 2260 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:29.569855+0000 mgr.smithi008.flmjzp (mgr.14640) 2261 : cluster [DBG] pgmap v1560: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:29.570253+0000 mgr.smithi008.flmjzp (mgr.14640) 2262 : cluster [DBG] pgmap v1561: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:36:29.591517+0000 mgr.smithi008.flmjzp (mgr.14640) 2263 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:32.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:31.570853+0000 mgr.smithi008.flmjzp (mgr.14640) 2264 : cluster [DBG] pgmap v1562: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:32.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:31.570853+0000 mgr.smithi008.flmjzp (mgr.14640) 2264 : cluster [DBG] pgmap v1562: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:33.571425+0000 mgr.smithi008.flmjzp (mgr.14640) 2265 : cluster [DBG] pgmap v1563: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:33.571425+0000 mgr.smithi008.flmjzp (mgr.14640) 2265 : cluster [DBG] pgmap v1563: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:35.572090+0000 mgr.smithi008.flmjzp (mgr.14640) 2266 : cluster [DBG] pgmap v1564: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:36.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:35.572090+0000 mgr.smithi008.flmjzp (mgr.14640) 2266 : cluster [DBG] pgmap v1564: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:38.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:37.572593+0000 mgr.smithi008.flmjzp (mgr.14640) 2267 : cluster [DBG] pgmap v1565: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:38.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:37.572593+0000 mgr.smithi008.flmjzp (mgr.14640) 2267 : cluster [DBG] pgmap v1565: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:39.601178+0000 mon.smithi008 (mon.0) 2692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:39.601178+0000 mon.smithi008 (mon.0) 2692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:39.573114+0000 mgr.smithi008.flmjzp (mgr.14640) 2268 : cluster [DBG] pgmap v1566: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:40.163472+0000 mon.smithi008 (mon.0) 2693 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:40.164223+0000 mon.smithi008 (mon.0) 2694 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:40.169612+0000 mon.smithi008 (mon.0) 2695 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:40.175646+0000 mon.smithi008 (mon.0) 2696 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:40.178650+0000 mon.smithi008 (mon.0) 2697 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:40.179856+0000 mon.smithi008 (mon.0) 2698 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:40.180995+0000 mon.smithi008 (mon.0) 2699 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:40.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:40.182424+0000 mon.smithi008 (mon.0) 2700 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:40.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:39.573114+0000 mgr.smithi008.flmjzp (mgr.14640) 2268 : cluster [DBG] pgmap v1566: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:40.163472+0000 mon.smithi008 (mon.0) 2693 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:40.164223+0000 mon.smithi008 (mon.0) 2694 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:40.169612+0000 mon.smithi008 (mon.0) 2695 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:40.175646+0000 mon.smithi008 (mon.0) 2696 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:40.178650+0000 mon.smithi008 (mon.0) 2697 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:40.179856+0000 mon.smithi008 (mon.0) 2698 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:40.180995+0000 mon.smithi008 (mon.0) 2699 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:40.182424+0000 mon.smithi008 (mon.0) 2700 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:36:40.164858+0000 mgr.smithi008.flmjzp (mgr.14640) 2269 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:40.165323+0000 mgr.smithi008.flmjzp (mgr.14640) 2270 : cluster [DBG] pgmap v1567: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:40.165605+0000 mgr.smithi008.flmjzp (mgr.14640) 2271 : cluster [DBG] pgmap v1568: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:36:40.183912+0000 mgr.smithi008.flmjzp (mgr.14640) 2272 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:41.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:36:40.164858+0000 mgr.smithi008.flmjzp (mgr.14640) 2269 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:40.165323+0000 mgr.smithi008.flmjzp (mgr.14640) 2270 : cluster [DBG] pgmap v1567: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:40.165605+0000 mgr.smithi008.flmjzp (mgr.14640) 2271 : cluster [DBG] pgmap v1568: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:36:40.183912+0000 mgr.smithi008.flmjzp (mgr.14640) 2272 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:42.166130+0000 mgr.smithi008.flmjzp (mgr.14640) 2273 : cluster [DBG] pgmap v1569: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:43.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:42.166130+0000 mgr.smithi008.flmjzp (mgr.14640) 2273 : cluster [DBG] pgmap v1569: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:44.166802+0000 mgr.smithi008.flmjzp (mgr.14640) 2274 : cluster [DBG] pgmap v1570: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:45.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:44.166802+0000 mgr.smithi008.flmjzp (mgr.14640) 2274 : cluster [DBG] pgmap v1570: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:46.167490+0000 mgr.smithi008.flmjzp (mgr.14640) 2275 : cluster [DBG] pgmap v1571: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:46.167490+0000 mgr.smithi008.flmjzp (mgr.14640) 2275 : cluster [DBG] pgmap v1571: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.834+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/2016293688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7bc0f6530 msgr2=0x7ff7bc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.835+0000 7ff7c1b3e700 1 --2- 172.21.15.8:0/2016293688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7bc0f6530 0x7ff7bc0f6950 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7ff7b0004660 tx=0x7ff7b0009b30).stop 2023-10-18T21:36:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.835+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/2016293688 shutdown_connections 2023-10-18T21:36:49.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.835+0000 7ff7c1b3e700 1 --2- 172.21.15.8:0/2016293688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7bc0f77d0 0x7ff7bc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:49.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.835+0000 7ff7c1b3e700 1 --2- 172.21.15.8:0/2016293688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7bc0f6530 0x7ff7bc0f6950 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:49.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.835+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/2016293688 >> 172.21.15.8:0/2016293688 conn(0x7ff7bc0f1c90 msgr2=0x7ff7bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:49.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.835+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/2016293688 shutdown_connections 2023-10-18T21:36:49.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.835+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/2016293688 wait complete. 2023-10-18T21:36:49.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.836+0000 7ff7c1b3e700 1 Processor -- start 2023-10-18T21:36:49.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.836+0000 7ff7c1b3e700 1 -- start start 2023-10-18T21:36:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.836+0000 7ff7c1b3e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7bc0f6530 0x7ff7bc108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.836+0000 7ff7c1b3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7bc0f77d0 0x7ff7bc109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.836+0000 7ff7c1b3e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc109a00 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.836+0000 7ff7c1b3e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc109b40 con 0x7ff7bc0f6530 2023-10-18T21:36:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.836+0000 7ff7bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7bc0f77d0 0x7ff7bc109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:49.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.836+0000 7ff7bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7bc0f77d0 0x7ff7bc109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55222/0 (socket says 172.21.15.8:55222) 2023-10-18T21:36:49.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.836+0000 7ff7bbfff700 1 -- 172.21.15.8:0/965064680 learned_addr learned my addr 172.21.15.8:0/965064680 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:49.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.837+0000 7ff7c0b3c700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7bc0f6530 0x7ff7bc108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:49.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.837+0000 7ff7bbfff700 1 -- 172.21.15.8:0/965064680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7bc0f6530 msgr2=0x7ff7bc108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:49.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.837+0000 7ff7bbfff700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7bc0f6530 0x7ff7bc108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:49.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.837+0000 7ff7bbfff700 1 -- 172.21.15.8:0/965064680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0005040 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.837+0000 7ff7c0b3c700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7bc0f6530 0x7ff7bc108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:36:49.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.837+0000 7ff7bbfff700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7bc0f77d0 0x7ff7bc109450 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7ff7a800e7f0 tx=0x7ff7a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:49.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.837+0000 7ff7b97fa700 1 -- 172.21.15.8:0/965064680 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a80092e0 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.837+0000 7ff7b97fa700 1 -- 172.21.15.8:0/965064680 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff7a800f040 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.837+0000 7ff7b97fa700 1 -- 172.21.15.8:0/965064680 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a80147e0 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.837+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/965064680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc10a4e0 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.838+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/965064680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc10a9d0 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.839+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/965064680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc045ad0 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.840+0000 7ff7b97fa700 1 -- 172.21.15.8:0/965064680 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff7a801b030 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.840+0000 7ff7b97fa700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff7ac060f70 0x7ff7ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:49.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.840+0000 7ff7b97fa700 1 -- 172.21.15.8:0/965064680 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff7a807c730 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.841+0000 7ff7c0b3c700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff7ac060f70 0x7ff7ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:49.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.841+0000 7ff7c0b3c700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff7ac060f70 0x7ff7ac063430 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7ff7b00043d0 tx=0x7ff7b000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:49.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:49.845+0000 7ff7b97fa700 1 -- 172.21.15.8:0/965064680 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff7a804fe80 con 0x7ff7bc0f77d0 2023-10-18T21:36:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:48.168130+0000 mgr.smithi008.flmjzp (mgr.14640) 2276 : cluster [DBG] pgmap v1572: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:49.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:48.168130+0000 mgr.smithi008.flmjzp (mgr.14640) 2276 : cluster [DBG] pgmap v1572: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:50.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.045+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/965064680 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7bc10ac40 con 0x7ff7ac060f70 2023-10-18T21:36:50.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.047+0000 7ff7b97fa700 1 -- 172.21.15.8:0/965064680 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff7bc10ac40 con 0x7ff7ac060f70 2023-10-18T21:36:50.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/965064680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff7ac060f70 msgr2=0x7ff7ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff7ac060f70 0x7ff7ac063430 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7ff7b00043d0 tx=0x7ff7b000b040).stop 2023-10-18T21:36:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/965064680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7bc0f77d0 msgr2=0x7ff7bc109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7bc0f77d0 0x7ff7bc109450 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7ff7a800e7f0 tx=0x7ff7a800b040).stop 2023-10-18T21:36:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/965064680 shutdown_connections 2023-10-18T21:36:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff7ac060f70 0x7ff7ac063430 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7bc0f6530 0x7ff7bc108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 --2- 172.21.15.8:0/965064680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7bc0f77d0 0x7ff7bc109450 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/965064680 >> 172.21.15.8:0/965064680 conn(0x7ff7bc0f1c90 msgr2=0x7ff7bc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:50.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/965064680 shutdown_connections 2023-10-18T21:36:50.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.049+0000 7ff7c1b3e700 1 -- 172.21.15.8:0/965064680 wait complete. 2023-10-18T21:36:50.065 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:36:50.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.190+0000 7f132ea24700 1 -- 172.21.15.8:0/4211034310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13280f77d0 msgr2=0x7f13280f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.190+0000 7f132ea24700 1 --2- 172.21.15.8:0/4211034310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13280f77d0 0x7f13280f7c30 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f1318004660 tx=0x7f1318009b30).stop 2023-10-18T21:36:50.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.190+0000 7f132ea24700 1 -- 172.21.15.8:0/4211034310 shutdown_connections 2023-10-18T21:36:50.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.190+0000 7f132ea24700 1 --2- 172.21.15.8:0/4211034310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13280f77d0 0x7f13280f7c30 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.190+0000 7f132ea24700 1 --2- 172.21.15.8:0/4211034310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13280f6530 0x7f13280f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.190+0000 7f132ea24700 1 -- 172.21.15.8:0/4211034310 >> 172.21.15.8:0/4211034310 conn(0x7f13280f1c90 msgr2=0x7f13280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:50.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.190+0000 7f132ea24700 1 -- 172.21.15.8:0/4211034310 shutdown_connections 2023-10-18T21:36:50.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.190+0000 7f132ea24700 1 -- 172.21.15.8:0/4211034310 wait complete. 2023-10-18T21:36:50.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.191+0000 7f132ea24700 1 Processor -- start 2023-10-18T21:36:50.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.191+0000 7f132ea24700 1 -- start start 2023-10-18T21:36:50.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.191+0000 7f132ea24700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13280f6530 0x7f1328106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:50.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.191+0000 7f132ea24700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13280f77d0 0x7f1328107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:50.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.191+0000 7f132ea24700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1328107850 con 0x7f13280f6530 2023-10-18T21:36:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.191+0000 7f132ea24700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1328108060 con 0x7f13280f77d0 2023-10-18T21:36:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.192+0000 7f132da22700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13280f6530 0x7f1328106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.192+0000 7f132da22700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13280f6530 0x7f1328106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55242/0 (socket says 172.21.15.8:55242) 2023-10-18T21:36:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.192+0000 7f132da22700 1 -- 172.21.15.8:0/2679650709 learned_addr learned my addr 172.21.15.8:0/2679650709 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.192+0000 7f132d221700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13280f77d0 0x7f1328107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.192+0000 7f132da22700 1 -- 172.21.15.8:0/2679650709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13280f77d0 msgr2=0x7f1328107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.192+0000 7f132da22700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13280f77d0 0x7f1328107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.192+0000 7f132da22700 1 -- 172.21.15.8:0/2679650709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1318005040 con 0x7f13280f6530 2023-10-18T21:36:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.192+0000 7f132da22700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13280f6530 0x7f1328106d60 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f132400e7c0 tx=0x7f132400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.193+0000 7f131e7fc700 1 -- 172.21.15.8:0/2679650709 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13240092e0 con 0x7f13280f6530 2023-10-18T21:36:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.193+0000 7f131e7fc700 1 -- 172.21.15.8:0/2679650709 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f132400f040 con 0x7f13280f6530 2023-10-18T21:36:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.193+0000 7f131e7fc700 1 -- 172.21.15.8:0/2679650709 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1324014810 con 0x7f13280f6530 2023-10-18T21:36:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.193+0000 7f132ea24700 1 -- 172.21.15.8:0/2679650709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13281082e0 con 0x7f13280f6530 2023-10-18T21:36:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.193+0000 7f132ea24700 1 -- 172.21.15.8:0/2679650709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1328108820 con 0x7f13280f6530 2023-10-18T21:36:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.194+0000 7f132ea24700 1 -- 172.21.15.8:0/2679650709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1328059100 con 0x7f13280f6530 2023-10-18T21:36:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.195+0000 7f131e7fc700 1 -- 172.21.15.8:0/2679650709 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f132401b030 con 0x7f13280f6530 2023-10-18T21:36:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.197+0000 7f131e7fc700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1314060f70 0x7f1314063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.197+0000 7f131e7fc700 1 -- 172.21.15.8:0/2679650709 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f132407c7c0 con 0x7f13280f6530 2023-10-18T21:36:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.197+0000 7f132d221700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1314060f70 0x7f1314063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.198+0000 7f132d221700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1314060f70 0x7f1314063430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f1318009720 tx=0x7f1318016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:50.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.201+0000 7f131e7fc700 1 -- 172.21.15.8:0/2679650709 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f132404c430 con 0x7f13280f6530 2023-10-18T21:36:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.401+0000 7f132ea24700 1 -- 172.21.15.8:0/2679650709 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13280008d0 con 0x7f1314060f70 2023-10-18T21:36:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.402+0000 7f131e7fc700 1 -- 172.21.15.8:0/2679650709 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f13280008d0 con 0x7f1314060f70 2023-10-18T21:36:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 -- 172.21.15.8:0/2679650709 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1314060f70 msgr2=0x7f1314063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1314060f70 0x7f1314063430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f1318009720 tx=0x7f1318016040).stop 2023-10-18T21:36:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 -- 172.21.15.8:0/2679650709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13280f6530 msgr2=0x7f1328106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13280f6530 0x7f1328106d60 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f132400e7c0 tx=0x7f132400b040).stop 2023-10-18T21:36:50.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 -- 172.21.15.8:0/2679650709 shutdown_connections 2023-10-18T21:36:50.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1314060f70 0x7f1314063430 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13280f6530 0x7f1328106d60 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 --2- 172.21.15.8:0/2679650709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13280f77d0 0x7f1328107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 -- 172.21.15.8:0/2679650709 >> 172.21.15.8:0/2679650709 conn(0x7f13280f1c90 msgr2=0x7f13280fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:50.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 -- 172.21.15.8:0/2679650709 shutdown_connections 2023-10-18T21:36:50.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.404+0000 7f132ea24700 1 -- 172.21.15.8:0/2679650709 wait complete. 2023-10-18T21:36:50.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.540+0000 7f8b6daed700 1 -- 172.21.15.8:0/3942497120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b68060310 msgr2=0x7f8b680f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.540+0000 7f8b6daed700 1 --2- 172.21.15.8:0/3942497120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b68060310 0x7f8b680f9110 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f8b5c004660 tx=0x7f8b5c009b30).stop 2023-10-18T21:36:50.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.540+0000 7f8b6daed700 1 -- 172.21.15.8:0/3942497120 shutdown_connections 2023-10-18T21:36:50.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.540+0000 7f8b6daed700 1 --2- 172.21.15.8:0/3942497120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b680f9690 0x7f8b680fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.540+0000 7f8b6daed700 1 --2- 172.21.15.8:0/3942497120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b68060310 0x7f8b680f9110 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.540+0000 7f8b6daed700 1 -- 172.21.15.8:0/3942497120 >> 172.21.15.8:0/3942497120 conn(0x7f8b680f0b90 msgr2=0x7f8b680f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:50.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.540+0000 7f8b6daed700 1 -- 172.21.15.8:0/3942497120 shutdown_connections 2023-10-18T21:36:50.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.540+0000 7f8b6daed700 1 -- 172.21.15.8:0/3942497120 wait complete. 2023-10-18T21:36:50.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.541+0000 7f8b6daed700 1 Processor -- start 2023-10-18T21:36:50.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.541+0000 7f8b6daed700 1 -- start start 2023-10-18T21:36:50.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.541+0000 7f8b6daed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b68060310 0x7f8b680f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:50.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.541+0000 7f8b6daed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b680f9690 0x7f8b680f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:50.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.541+0000 7f8b6daed700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680f5570 con 0x7f8b68060310 2023-10-18T21:36:50.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.541+0000 7f8b6daed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680f56b0 con 0x7f8b680f9690 2023-10-18T21:36:50.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.542+0000 7f8b6caeb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b68060310 0x7f8b680f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:50.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.542+0000 7f8b6caeb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b68060310 0x7f8b680f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55256/0 (socket says 172.21.15.8:55256) 2023-10-18T21:36:50.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.542+0000 7f8b6caeb700 1 -- 172.21.15.8:0/641951656 learned_addr learned my addr 172.21.15.8:0/641951656 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:50.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.542+0000 7f8b67fff700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b680f9690 0x7f8b680f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:50.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.542+0000 7f8b6caeb700 1 -- 172.21.15.8:0/641951656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b680f9690 msgr2=0x7f8b680f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.542+0000 7f8b6caeb700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b680f9690 0x7f8b680f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.542+0000 7f8b6caeb700 1 -- 172.21.15.8:0/641951656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c005040 con 0x7f8b68060310 2023-10-18T21:36:50.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.542+0000 7f8b6caeb700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b68060310 0x7f8b680f6b90 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f8b5c009f50 tx=0x7f8b5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:50.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.542+0000 7f8b657fa700 1 -- 172.21.15.8:0/641951656 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5c018070 con 0x7f8b68060310 2023-10-18T21:36:50.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.543+0000 7f8b657fa700 1 -- 172.21.15.8:0/641951656 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8b5c009630 con 0x7f8b68060310 2023-10-18T21:36:50.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.543+0000 7f8b6daed700 1 -- 172.21.15.8:0/641951656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b680f5930 con 0x7f8b68060310 2023-10-18T21:36:50.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.543+0000 7f8b657fa700 1 -- 172.21.15.8:0/641951656 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5c01c3c0 con 0x7f8b68060310 2023-10-18T21:36:50.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.543+0000 7f8b6daed700 1 -- 172.21.15.8:0/641951656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b680f5e90 con 0x7f8b68060310 2023-10-18T21:36:50.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.544+0000 7f8b6daed700 1 -- 172.21.15.8:0/641951656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b68045ad0 con 0x7f8b68060310 2023-10-18T21:36:50.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.545+0000 7f8b657fa700 1 -- 172.21.15.8:0/641951656 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8b5c01d420 con 0x7f8b68060310 2023-10-18T21:36:50.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.545+0000 7f8b657fa700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b58060f70 0x7f8b58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:50.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.546+0000 7f8b657fa700 1 -- 172.21.15.8:0/641951656 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8b5c07e650 con 0x7f8b68060310 2023-10-18T21:36:50.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.546+0000 7f8b67fff700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b58060f70 0x7f8b58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:50.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.546+0000 7f8b67fff700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b58060f70 0x7f8b58063430 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f8b680600e0 tx=0x7f8b54009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:50.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.550+0000 7f8b657fa700 1 -- 172.21.15.8:0/641951656 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8b5c04e2c0 con 0x7f8b68060310 2023-10-18T21:36:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.744+0000 7f8b6daed700 1 -- 172.21.15.8:0/641951656 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b680fedf0 con 0x7f8b58060f70 2023-10-18T21:36:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.754+0000 7f8b657fa700 1 -- 172.21.15.8:0/641951656 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8b680fedf0 con 0x7f8b58060f70 2023-10-18T21:36:50.756 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:36:50.756 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (43m) 72s ago 44m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:36:50.756 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (37m) 72s ago 44m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:36:50.756 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (37m) 9m ago 44m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:36:50.756 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (43m) 72s ago 44m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:36:50.757 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 72s ago 41m - - 2023-10-18T21:36:50.757 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 72s ago 40m - - 2023-10-18T21:36:50.757 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 40m - - 2023-10-18T21:36:50.757 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 40m - - 2023-10-18T21:36:50.757 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (38m) 72s ago 46m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:36:50.758 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (38m) 9m ago 44m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:36:50.758 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (37m) 72s ago 46m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:36:50.758 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (37m) 9m ago 44m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:36:50.758 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (44m) 72s ago 44m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:36:50.758 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (43m) 9m ago 43m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:36:50.759 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (37m) 72s ago 43m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:36:50.759 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (35m) 72s ago 43m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:36:50.759 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (34m) 72s ago 42m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:36:50.759 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (34m) 9m ago 42m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:36:50.759 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (33m) 9m ago 42m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:36:50.759 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (32m) 9m ago 42m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:36:50.760 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (39m) 72s ago 44m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:36:50.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 -- 172.21.15.8:0/641951656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b58060f70 msgr2=0x7f8b58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b58060f70 0x7f8b58063430 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f8b680600e0 tx=0x7f8b54009c60).stop 2023-10-18T21:36:50.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 -- 172.21.15.8:0/641951656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b68060310 msgr2=0x7f8b680f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b68060310 0x7f8b680f6b90 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f8b5c009f50 tx=0x7f8b5c009b30).stop 2023-10-18T21:36:50.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 -- 172.21.15.8:0/641951656 shutdown_connections 2023-10-18T21:36:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b58060f70 0x7f8b58063430 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b68060310 0x7f8b680f6b90 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 --2- 172.21.15.8:0/641951656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b680f9690 0x7f8b680f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 -- 172.21.15.8:0/641951656 >> 172.21.15.8:0/641951656 conn(0x7f8b680f0b90 msgr2=0x7f8b680f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 -- 172.21.15.8:0/641951656 shutdown_connections 2023-10-18T21:36:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.756+0000 7f8b6daed700 1 -- 172.21.15.8:0/641951656 wait complete. 2023-10-18T21:36:50.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.891+0000 7f3645f47700 1 -- 172.21.15.8:0/3900393084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36400f77d0 msgr2=0x7f36400f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.891+0000 7f3645f47700 1 --2- 172.21.15.8:0/3900393084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36400f77d0 0x7f36400f7c30 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f362c004660 tx=0x7f362c009b30).stop 2023-10-18T21:36:50.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.891+0000 7f3645f47700 1 -- 172.21.15.8:0/3900393084 shutdown_connections 2023-10-18T21:36:50.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.891+0000 7f3645f47700 1 --2- 172.21.15.8:0/3900393084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36400f77d0 0x7f36400f7c30 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.891+0000 7f3645f47700 1 --2- 172.21.15.8:0/3900393084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36400f6530 0x7f36400f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.891+0000 7f3645f47700 1 -- 172.21.15.8:0/3900393084 >> 172.21.15.8:0/3900393084 conn(0x7f36400f1c90 msgr2=0x7f36400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:50.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.891+0000 7f3645f47700 1 -- 172.21.15.8:0/3900393084 shutdown_connections 2023-10-18T21:36:50.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.891+0000 7f3645f47700 1 -- 172.21.15.8:0/3900393084 wait complete. 2023-10-18T21:36:50.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.892+0000 7f3645f47700 1 Processor -- start 2023-10-18T21:36:50.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.892+0000 7f3645f47700 1 -- start start 2023-10-18T21:36:50.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f3645f47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36400f6530 0x7f3640108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:50.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f3645f47700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36400f77d0 0x7f3640109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:50.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f3645f47700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36401099d0 con 0x7f36400f77d0 2023-10-18T21:36:50.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f3645f47700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3640109b10 con 0x7f36400f6530 2023-10-18T21:36:50.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f363ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36400f77d0 0x7f3640109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:50.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f363ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36400f77d0 0x7f3640109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55276/0 (socket says 172.21.15.8:55276) 2023-10-18T21:36:50.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f363ffff700 1 -- 172.21.15.8:0/3508692022 learned_addr learned my addr 172.21.15.8:0/3508692022 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:50.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f3644f45700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36400f6530 0x7f3640108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:50.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f363ffff700 1 -- 172.21.15.8:0/3508692022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36400f6530 msgr2=0x7f3640108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:50.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f363ffff700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36400f6530 0x7f3640108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:50.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.893+0000 7f363ffff700 1 -- 172.21.15.8:0/3508692022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c005040 con 0x7f36400f77d0 2023-10-18T21:36:50.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.894+0000 7f363ffff700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36400f77d0 0x7f3640109420 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f362c009990 tx=0x7f362c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:50.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.894+0000 7f363d7fa700 1 -- 172.21.15.8:0/3508692022 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362c018070 con 0x7f36400f77d0 2023-10-18T21:36:50.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.894+0000 7f363d7fa700 1 -- 172.21.15.8:0/3508692022 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f362c009630 con 0x7f36400f77d0 2023-10-18T21:36:50.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.894+0000 7f363d7fa700 1 -- 172.21.15.8:0/3508692022 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362c01c3c0 con 0x7f36400f77d0 2023-10-18T21:36:50.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.894+0000 7f3645f47700 1 -- 172.21.15.8:0/3508692022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364010a450 con 0x7f36400f77d0 2023-10-18T21:36:50.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.894+0000 7f3645f47700 1 -- 172.21.15.8:0/3508692022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364010a960 con 0x7f36400f77d0 2023-10-18T21:36:50.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.895+0000 7f3645f47700 1 -- 172.21.15.8:0/3508692022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3640045ad0 con 0x7f36400f77d0 2023-10-18T21:36:50.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.896+0000 7f363d7fa700 1 -- 172.21.15.8:0/3508692022 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f362c01d970 con 0x7f36400f77d0 2023-10-18T21:36:50.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.897+0000 7f363d7fa700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3630060f70 0x7f3630063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:50.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.897+0000 7f363d7fa700 1 -- 172.21.15.8:0/3508692022 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f362c07e660 con 0x7f36400f77d0 2023-10-18T21:36:50.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.897+0000 7f3644f45700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3630060f70 0x7f3630063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:50.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.898+0000 7f3644f45700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3630060f70 0x7f3630063430 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f36400f7630 tx=0x7f363400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:50.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:50.901+0000 7f363d7fa700 1 -- 172.21.15.8:0/3508692022 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f362c051c40 con 0x7f36400f77d0 2023-10-18T21:36:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.194465+0000 mon.smithi008 (mon.0) 2701 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.196482+0000 mon.smithi008 (mon.0) 2702 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.197301+0000 mon.smithi008 (mon.0) 2703 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.207024+0000 mon.smithi008 (mon.0) 2704 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.212532+0000 mon.smithi008 (mon.0) 2705 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.214959+0000 mon.smithi008 (mon.0) 2706 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.216319+0000 mon.smithi008 (mon.0) 2707 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.217576+0000 mon.smithi008 (mon.0) 2708 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:50.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.219216+0000 mon.smithi008 (mon.0) 2709 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.194465+0000 mon.smithi008 (mon.0) 2701 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.196482+0000 mon.smithi008 (mon.0) 2702 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:36:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.197301+0000 mon.smithi008 (mon.0) 2703 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:36:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.207024+0000 mon.smithi008 (mon.0) 2704 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:36:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.212532+0000 mon.smithi008 (mon.0) 2705 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:36:50.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.214959+0000 mon.smithi008 (mon.0) 2706 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:50.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.216319+0000 mon.smithi008 (mon.0) 2707 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:50.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.217576+0000 mon.smithi008 (mon.0) 2708 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:50.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.219216+0000 mon.smithi008 (mon.0) 2709 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.154+0000 7f3645f47700 1 -- 172.21.15.8:0/3508692022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3640027a00 con 0x7f36400f77d0 2023-10-18T21:36:51.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.154+0000 7f363d7fa700 1 -- 172.21.15.8:0/3508692022 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f362c051830 con 0x7f36400f77d0 2023-10-18T21:36:51.157 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:36:51.157 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:36:51.157 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:36:51.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:36:51.158 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:36:51.158 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:36:51.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:36:51.158 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:36:51.159 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:36:51.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:36:51.159 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:36:51.159 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:36:51.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:36:51.160 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:36:51.160 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:36:51.160 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:36:51.160 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.156+0000 7f3645f47700 1 -- 172.21.15.8:0/3508692022 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3630060f70 msgr2=0x7f3630063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.156+0000 7f3645f47700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3630060f70 0x7f3630063430 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f36400f7630 tx=0x7f363400b040).stop 2023-10-18T21:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.156+0000 7f3645f47700 1 -- 172.21.15.8:0/3508692022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36400f77d0 msgr2=0x7f3640109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.156+0000 7f3645f47700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36400f77d0 0x7f3640109420 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f362c009990 tx=0x7f362c009b30).stop 2023-10-18T21:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.157+0000 7f3645f47700 1 -- 172.21.15.8:0/3508692022 shutdown_connections 2023-10-18T21:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.157+0000 7f3645f47700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3630060f70 0x7f3630063430 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.157+0000 7f3645f47700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36400f6530 0x7f3640108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.157+0000 7f3645f47700 1 --2- 172.21.15.8:0/3508692022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36400f77d0 0x7f3640109420 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.157+0000 7f3645f47700 1 -- 172.21.15.8:0/3508692022 >> 172.21.15.8:0/3508692022 conn(0x7f36400f1c90 msgr2=0x7f364006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:51.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.157+0000 7f3645f47700 1 -- 172.21.15.8:0/3508692022 shutdown_connections 2023-10-18T21:36:51.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.157+0000 7f3645f47700 1 -- 172.21.15.8:0/3508692022 wait complete. 2023-10-18T21:36:51.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.293+0000 7f8685e18700 1 -- 172.21.15.8:0/2654988767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86800f77d0 msgr2=0x7f86800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:51.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.293+0000 7f8685e18700 1 --2- 172.21.15.8:0/2654988767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86800f77d0 0x7f86800f7c30 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f866c004660 tx=0x7f866c009b30).stop 2023-10-18T21:36:51.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.293+0000 7f8685e18700 1 -- 172.21.15.8:0/2654988767 shutdown_connections 2023-10-18T21:36:51.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.293+0000 7f8685e18700 1 --2- 172.21.15.8:0/2654988767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86800f77d0 0x7f86800f7c30 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.293+0000 7f8685e18700 1 --2- 172.21.15.8:0/2654988767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86800f6530 0x7f86800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.293+0000 7f8685e18700 1 -- 172.21.15.8:0/2654988767 >> 172.21.15.8:0/2654988767 conn(0x7f86800f1c90 msgr2=0x7f86800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:51.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.293+0000 7f8685e18700 1 -- 172.21.15.8:0/2654988767 shutdown_connections 2023-10-18T21:36:51.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.293+0000 7f8685e18700 1 -- 172.21.15.8:0/2654988767 wait complete. 2023-10-18T21:36:51.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.294+0000 7f8685e18700 1 Processor -- start 2023-10-18T21:36:51.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.294+0000 7f8685e18700 1 -- start start 2023-10-18T21:36:51.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f8685e18700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86800f6530 0x7f868006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:51.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f8685e18700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86800f77d0 0x7f8680069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:51.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f8685e18700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868010a920 con 0x7f86800f77d0 2023-10-18T21:36:51.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f8685e18700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868010aa60 con 0x7f86800f6530 2023-10-18T21:36:51.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f867ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86800f77d0 0x7f8680069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:51.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f867ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86800f77d0 0x7f8680069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55302/0 (socket says 172.21.15.8:55302) 2023-10-18T21:36:51.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f867ffff700 1 -- 172.21.15.8:0/54891345 learned_addr learned my addr 172.21.15.8:0/54891345 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:51.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f8684e16700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86800f6530 0x7f868006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:51.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f867ffff700 1 -- 172.21.15.8:0/54891345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86800f6530 msgr2=0x7f868006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:51.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f867ffff700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86800f6530 0x7f868006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.295+0000 7f867ffff700 1 -- 172.21.15.8:0/54891345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c005040 con 0x7f86800f77d0 2023-10-18T21:36:51.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.296+0000 7f867ffff700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86800f77d0 0x7f8680069e20 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f866c004320 tx=0x7f866c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:51.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.296+0000 7f867d7fa700 1 -- 172.21.15.8:0/54891345 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f866c019070 con 0x7f86800f77d0 2023-10-18T21:36:51.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.296+0000 7f867d7fa700 1 -- 172.21.15.8:0/54891345 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f866c01e420 con 0x7f86800f77d0 2023-10-18T21:36:51.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.296+0000 7f867d7fa700 1 -- 172.21.15.8:0/54891345 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f866c014660 con 0x7f86800f77d0 2023-10-18T21:36:51.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.296+0000 7f8685e18700 1 -- 172.21.15.8:0/54891345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868006a370 con 0x7f86800f77d0 2023-10-18T21:36:51.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.296+0000 7f8685e18700 1 -- 172.21.15.8:0/54891345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868006a850 con 0x7f86800f77d0 2023-10-18T21:36:51.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.297+0000 7f8685e18700 1 -- 172.21.15.8:0/54891345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8680045ad0 con 0x7f86800f77d0 2023-10-18T21:36:51.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.298+0000 7f867d7fa700 1 -- 172.21.15.8:0/54891345 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f866c01e590 con 0x7f86800f77d0 2023-10-18T21:36:51.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.299+0000 7f867d7fa700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8670060f70 0x7f8670063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:51.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.299+0000 7f867d7fa700 1 -- 172.21.15.8:0/54891345 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f866c07dd90 con 0x7f86800f77d0 2023-10-18T21:36:51.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.299+0000 7f8684e16700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8670060f70 0x7f8670063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:51.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.300+0000 7f8684e16700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8670060f70 0x7f8670063430 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f868006b730 tx=0x7f867400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:51.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.303+0000 7f867d7fa700 1 -- 172.21.15.8:0/54891345 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f866c04d960 con 0x7f86800f77d0 2023-10-18T21:36:51.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.532+0000 7f8685e18700 1 -- 172.21.15.8:0/54891345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f868006acc0 con 0x7f86800f77d0 2023-10-18T21:36:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.533+0000 7f867d7fa700 1 -- 172.21.15.8:0/54891345 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f866c050f80 con 0x7f86800f77d0 2023-10-18T21:36:51.535 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:36:51.535 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:36:51.536 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:36:51.536 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:36:51.536 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:36:51.536 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:36:51.536 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:36:51.537 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:36:51.537 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:36:51.537 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:36:51.537 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:36:51.538 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:36:51.538 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:36:51.538 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:36:51.538 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:36:51.539 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:36:51.539 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:36:51.539 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:36:51.539 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:36:51.540 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:36:51.540 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:36:51.540 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:36:51.540 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:36:51.540 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:36:51.541 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:36:51.541 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:36:51.541 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:36:51.541 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:36:51.542 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:36:51.542 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:36:51.542 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:36:51.543 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:36:51.543 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:36:51.543 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:36:51.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 -- 172.21.15.8:0/54891345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8670060f70 msgr2=0x7f8670063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8670060f70 0x7f8670063430 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f868006b730 tx=0x7f867400b040).stop 2023-10-18T21:36:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 -- 172.21.15.8:0/54891345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86800f77d0 msgr2=0x7f8680069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86800f77d0 0x7f8680069e20 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f866c004320 tx=0x7f866c00b040).stop 2023-10-18T21:36:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 -- 172.21.15.8:0/54891345 shutdown_connections 2023-10-18T21:36:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8670060f70 0x7f8670063430 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86800f6530 0x7f868006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 --2- 172.21.15.8:0/54891345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86800f77d0 0x7f8680069e20 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 -- 172.21.15.8:0/54891345 >> 172.21.15.8:0/54891345 conn(0x7f86800f1c90 msgr2=0x7f86800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 -- 172.21.15.8:0/54891345 shutdown_connections 2023-10-18T21:36:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.535+0000 7f8685e18700 1 -- 172.21.15.8:0/54891345 wait complete. 2023-10-18T21:36:51.547 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:36:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.673+0000 7f4af1cb7700 1 -- 172.21.15.8:0/3099162793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aec0f6530 msgr2=0x7f4aec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.673+0000 7f4af1cb7700 1 --2- 172.21.15.8:0/3099162793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aec0f6530 0x7f4aec0f6950 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f4ae0004660 tx=0x7f4ae0009b30).stop 2023-10-18T21:36:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.673+0000 7f4af1cb7700 1 -- 172.21.15.8:0/3099162793 shutdown_connections 2023-10-18T21:36:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.673+0000 7f4af1cb7700 1 --2- 172.21.15.8:0/3099162793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0f77d0 0x7f4aec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.673+0000 7f4af1cb7700 1 --2- 172.21.15.8:0/3099162793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aec0f6530 0x7f4aec0f6950 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.673+0000 7f4af1cb7700 1 -- 172.21.15.8:0/3099162793 >> 172.21.15.8:0/3099162793 conn(0x7f4aec0f1cd0 msgr2=0x7f4aec0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.673+0000 7f4af1cb7700 1 -- 172.21.15.8:0/3099162793 shutdown_connections 2023-10-18T21:36:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.673+0000 7f4af1cb7700 1 -- 172.21.15.8:0/3099162793 wait complete. 2023-10-18T21:36:51.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.674+0000 7f4af1cb7700 1 Processor -- start 2023-10-18T21:36:51.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.674+0000 7f4af1cb7700 1 -- start start 2023-10-18T21:36:51.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4af1cb7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aec0f6530 0x7f4aec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:51.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4af1cb7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0f77d0 0x7f4aec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4af1cb7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec06a380 con 0x7f4aec0f6530 2023-10-18T21:36:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4af1cb7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec06a4c0 con 0x7f4aec0f77d0 2023-10-18T21:36:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4af0cb5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aec0f6530 0x7f4aec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4af0cb5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aec0f6530 0x7f4aec06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55320/0 (socket says 172.21.15.8:55320) 2023-10-18T21:36:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4af0cb5700 1 -- 172.21.15.8:0/1492031898 learned_addr learned my addr 172.21.15.8:0/1492031898 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:36:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4aebfff700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0f77d0 0x7f4aec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4af0cb5700 1 -- 172.21.15.8:0/1492031898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0f77d0 msgr2=0x7f4aec069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4af0cb5700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0f77d0 0x7f4aec069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.675+0000 7f4af0cb5700 1 -- 172.21.15.8:0/1492031898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae0005040 con 0x7f4aec0f6530 2023-10-18T21:36:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.676+0000 7f4af0cb5700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aec0f6530 0x7f4aec06b9a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f4ae0009870 tx=0x7f4ae000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:51.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.676+0000 7f4ae97fa700 1 -- 172.21.15.8:0/1492031898 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ae0019070 con 0x7f4aec0f6530 2023-10-18T21:36:51.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.676+0000 7f4ae97fa700 1 -- 172.21.15.8:0/1492031898 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4ae001e420 con 0x7f4aec0f6530 2023-10-18T21:36:51.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.676+0000 7f4ae97fa700 1 -- 172.21.15.8:0/1492031898 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ae0014660 con 0x7f4aec0f6530 2023-10-18T21:36:51.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.676+0000 7f4af1cb7700 1 -- 172.21.15.8:0/1492031898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec06a740 con 0x7f4aec0f6530 2023-10-18T21:36:51.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.676+0000 7f4af1cb7700 1 -- 172.21.15.8:0/1492031898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec06ac20 con 0x7f4aec0f6530 2023-10-18T21:36:51.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.677+0000 7f4af1cb7700 1 -- 172.21.15.8:0/1492031898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec045ad0 con 0x7f4aec0f6530 2023-10-18T21:36:51.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.678+0000 7f4ae97fa700 1 -- 172.21.15.8:0/1492031898 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4ae001e9c0 con 0x7f4aec0f6530 2023-10-18T21:36:51.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.679+0000 7f4ae97fa700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4adc060f70 0x7f4adc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:36:51.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.679+0000 7f4ae97fa700 1 -- 172.21.15.8:0/1492031898 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4ae007dcc0 con 0x7f4aec0f6530 2023-10-18T21:36:51.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.679+0000 7f4aebfff700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4adc060f70 0x7f4adc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:36:51.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.680+0000 7f4aebfff700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4adc060f70 0x7f4adc063430 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f4ad8007fd0 tx=0x7f4ad800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:36:51.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.683+0000 7f4ae97fa700 1 -- 172.21.15.8:0/1492031898 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4ae004d9b0 con 0x7f4aec0f6530 2023-10-18T21:36:51.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.881+0000 7f4af1cb7700 1 -- 172.21.15.8:0/1492031898 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aec0fedd0 con 0x7f4adc060f70 2023-10-18T21:36:51.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.882+0000 7f4ae97fa700 1 -- 172.21.15.8:0/1492031898 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4aec0fedd0 con 0x7f4adc060f70 2023-10-18T21:36:51.884 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:36:51.884 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:36:51.884 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:36:51.885 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:36:51.885 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:36:51.885 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:36:51.885 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:36:51.885 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:36:51.885 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:36:51.886 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:36:51.886 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:36:51.886 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:36:51.886 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:36:51.886 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:36:51.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 -- 172.21.15.8:0/1492031898 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4adc060f70 msgr2=0x7f4adc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:51.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4adc060f70 0x7f4adc063430 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f4ad8007fd0 tx=0x7f4ad800b040).stop 2023-10-18T21:36:51.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 -- 172.21.15.8:0/1492031898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aec0f6530 msgr2=0x7f4aec06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:36:51.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aec0f6530 0x7f4aec06b9a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f4ae0009870 tx=0x7f4ae000b040).stop 2023-10-18T21:36:51.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 -- 172.21.15.8:0/1492031898 shutdown_connections 2023-10-18T21:36:51.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4adc060f70 0x7f4adc063430 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aec0f6530 0x7f4aec06b9a0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 --2- 172.21.15.8:0/1492031898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0f77d0 0x7f4aec069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:36:51.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 -- 172.21.15.8:0/1492031898 >> 172.21.15.8:0/1492031898 conn(0x7f4aec0f1cd0 msgr2=0x7f4aec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:36:51.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 -- 172.21.15.8:0/1492031898 shutdown_connections 2023-10-18T21:36:51.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:36:51.884+0000 7f4af1cb7700 1 -- 172.21.15.8:0/1492031898 wait complete. 2023-10-18T21:36:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.048161+0000 mgr.smithi008.flmjzp (mgr.14640) 2277 : audit [DBG] from='client.35968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:50.168667+0000 mgr.smithi008.flmjzp (mgr.14640) 2278 : cluster [DBG] pgmap v1573: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:36:50.198043+0000 mgr.smithi008.flmjzp (mgr.14640) 2279 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:50.198529+0000 mgr.smithi008.flmjzp (mgr.14640) 2280 : cluster [DBG] pgmap v1574: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:50.198771+0000 mgr.smithi008.flmjzp (mgr.14640) 2281 : cluster [DBG] pgmap v1575: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:51.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:36:50.220797+0000 mgr.smithi008.flmjzp (mgr.14640) 2282 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:51.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.403264+0000 mgr.smithi008.flmjzp (mgr.14640) 2283 : audit [DBG] from='client.35972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:51.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:50.746563+0000 mgr.smithi008.flmjzp (mgr.14640) 2284 : audit [DBG] from='client.35976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:51.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:51.155907+0000 mon.smithi008 (mon.0) 2710 : audit [DBG] from='client.? 172.21.15.8:0/3508692022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:51.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:51.534541+0000 mon.smithi008 (mon.0) 2711 : audit [DBG] from='client.? 172.21.15.8:0/54891345' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:36:51.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.048161+0000 mgr.smithi008.flmjzp (mgr.14640) 2277 : audit [DBG] from='client.35968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:50.168667+0000 mgr.smithi008.flmjzp (mgr.14640) 2278 : cluster [DBG] pgmap v1573: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:36:50.198043+0000 mgr.smithi008.flmjzp (mgr.14640) 2279 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:36:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:50.198529+0000 mgr.smithi008.flmjzp (mgr.14640) 2280 : cluster [DBG] pgmap v1574: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:50.198771+0000 mgr.smithi008.flmjzp (mgr.14640) 2281 : cluster [DBG] pgmap v1575: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:36:50.220797+0000 mgr.smithi008.flmjzp (mgr.14640) 2282 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:36:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.403264+0000 mgr.smithi008.flmjzp (mgr.14640) 2283 : audit [DBG] from='client.35972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:50.746563+0000 mgr.smithi008.flmjzp (mgr.14640) 2284 : audit [DBG] from='client.35976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:51.155907+0000 mon.smithi008 (mon.0) 2710 : audit [DBG] from='client.? 172.21.15.8:0/3508692022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:36:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:51.534541+0000 mon.smithi008 (mon.0) 2711 : audit [DBG] from='client.? 172.21.15.8:0/54891345' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:36:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:36:51.883389+0000 mgr.smithi008.flmjzp (mgr.14640) 2285 : audit [DBG] from='client.35988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:36:51.883389+0000 mgr.smithi008.flmjzp (mgr.14640) 2285 : audit [DBG] from='client.35988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:36:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:52.199250+0000 mgr.smithi008.flmjzp (mgr.14640) 2286 : cluster [DBG] pgmap v1576: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:53.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:52.199250+0000 mgr.smithi008.flmjzp (mgr.14640) 2286 : cluster [DBG] pgmap v1576: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:55.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:54.199950+0000 mgr.smithi008.flmjzp (mgr.14640) 2287 : cluster [DBG] pgmap v1577: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:54.199950+0000 mgr.smithi008.flmjzp (mgr.14640) 2287 : cluster [DBG] pgmap v1577: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:57.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:56.200413+0000 mgr.smithi008.flmjzp (mgr.14640) 2288 : cluster [DBG] pgmap v1578: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:58.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:56.200413+0000 mgr.smithi008.flmjzp (mgr.14640) 2288 : cluster [DBG] pgmap v1578: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:36:59.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:36:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:36:58.200979+0000 mgr.smithi008.flmjzp (mgr.14640) 2289 : cluster [DBG] pgmap v1579: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:00.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:36:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:36:58.200979+0000 mgr.smithi008.flmjzp (mgr.14640) 2289 : cluster [DBG] pgmap v1579: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:00.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:00.231510+0000 mon.smithi008 (mon.0) 2712 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:00.231510+0000 mon.smithi008 (mon.0) 2712 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:01.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:00.201768+0000 mgr.smithi008.flmjzp (mgr.14640) 2290 : cluster [DBG] pgmap v1580: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:00.790030+0000 mon.smithi008 (mon.0) 2713 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:00.791192+0000 mon.smithi008 (mon.0) 2714 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:00.792122+0000 mgr.smithi008.flmjzp (mgr.14640) 2291 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:00.792781+0000 mgr.smithi008.flmjzp (mgr.14640) 2292 : cluster [DBG] pgmap v1581: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:01.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:00.793100+0000 mgr.smithi008.flmjzp (mgr.14640) 2293 : cluster [DBG] pgmap v1582: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:01.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:00.798177+0000 mon.smithi008 (mon.0) 2715 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:01.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:00.806278+0000 mon.smithi008 (mon.0) 2716 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:01.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:00.809769+0000 mon.smithi008 (mon.0) 2717 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:01.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:00.811736+0000 mon.smithi008 (mon.0) 2718 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:01.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:00.813485+0000 mon.smithi008 (mon.0) 2719 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:01.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:00.815528+0000 mon.smithi008 (mon.0) 2720 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:01.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:00.817402+0000 mgr.smithi008.flmjzp (mgr.14640) 2294 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:00.201768+0000 mgr.smithi008.flmjzp (mgr.14640) 2290 : cluster [DBG] pgmap v1580: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:02.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:00.790030+0000 mon.smithi008 (mon.0) 2713 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:02.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:00.791192+0000 mon.smithi008 (mon.0) 2714 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:02.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:00.792122+0000 mgr.smithi008.flmjzp (mgr.14640) 2291 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:02.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:00.792781+0000 mgr.smithi008.flmjzp (mgr.14640) 2292 : cluster [DBG] pgmap v1581: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:02.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:00.793100+0000 mgr.smithi008.flmjzp (mgr.14640) 2293 : cluster [DBG] pgmap v1582: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:02.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:00.798177+0000 mon.smithi008 (mon.0) 2715 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:02.175 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:00.806278+0000 mon.smithi008 (mon.0) 2716 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:02.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:00.809769+0000 mon.smithi008 (mon.0) 2717 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:02.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:00.811736+0000 mon.smithi008 (mon.0) 2718 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:02.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:00.813485+0000 mon.smithi008 (mon.0) 2719 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:02.176 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:00.815528+0000 mon.smithi008 (mon.0) 2720 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:02.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:00.817402+0000 mgr.smithi008.flmjzp (mgr.14640) 2294 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:02.793601+0000 mgr.smithi008.flmjzp (mgr.14640) 2295 : cluster [DBG] pgmap v1583: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:04.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:02.793601+0000 mgr.smithi008.flmjzp (mgr.14640) 2295 : cluster [DBG] pgmap v1583: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:04.794151+0000 mgr.smithi008.flmjzp (mgr.14640) 2296 : cluster [DBG] pgmap v1584: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:06.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:04.794151+0000 mgr.smithi008.flmjzp (mgr.14640) 2296 : cluster [DBG] pgmap v1584: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:06.794631+0000 mgr.smithi008.flmjzp (mgr.14640) 2297 : cluster [DBG] pgmap v1585: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:08.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:06.794631+0000 mgr.smithi008.flmjzp (mgr.14640) 2297 : cluster [DBG] pgmap v1585: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:10.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:08.795171+0000 mgr.smithi008.flmjzp (mgr.14640) 2298 : cluster [DBG] pgmap v1586: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:10.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:08.795171+0000 mgr.smithi008.flmjzp (mgr.14640) 2298 : cluster [DBG] pgmap v1586: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:10.795787+0000 mgr.smithi008.flmjzp (mgr.14640) 2299 : cluster [DBG] pgmap v1587: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:10.819991+0000 mon.smithi008 (mon.0) 2721 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:10.822148+0000 mon.smithi008 (mon.0) 2722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:10.823155+0000 mon.smithi008 (mon.0) 2723 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:10.824044+0000 mgr.smithi008.flmjzp (mgr.14640) 2300 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:10.824661+0000 mgr.smithi008.flmjzp (mgr.14640) 2301 : cluster [DBG] pgmap v1588: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:10.824927+0000 mgr.smithi008.flmjzp (mgr.14640) 2302 : cluster [DBG] pgmap v1589: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:10.829621+0000 mon.smithi008 (mon.0) 2724 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:10.836161+0000 mon.smithi008 (mon.0) 2725 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:10.839233+0000 mon.smithi008 (mon.0) 2726 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:10.840976+0000 mon.smithi008 (mon.0) 2727 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:10.842549+0000 mon.smithi008 (mon.0) 2728 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:10.844550+0000 mon.smithi008 (mon.0) 2729 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:11.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:10.846422+0000 mgr.smithi008.flmjzp (mgr.14640) 2303 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:11.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:10.795787+0000 mgr.smithi008.flmjzp (mgr.14640) 2299 : cluster [DBG] pgmap v1587: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:10.819991+0000 mon.smithi008 (mon.0) 2721 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:10.822148+0000 mon.smithi008 (mon.0) 2722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:10.823155+0000 mon.smithi008 (mon.0) 2723 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:10.824044+0000 mgr.smithi008.flmjzp (mgr.14640) 2300 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:10.824661+0000 mgr.smithi008.flmjzp (mgr.14640) 2301 : cluster [DBG] pgmap v1588: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:10.824927+0000 mgr.smithi008.flmjzp (mgr.14640) 2302 : cluster [DBG] pgmap v1589: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:10.829621+0000 mon.smithi008 (mon.0) 2724 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:10.836161+0000 mon.smithi008 (mon.0) 2725 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:10.839233+0000 mon.smithi008 (mon.0) 2726 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:10.840976+0000 mon.smithi008 (mon.0) 2727 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:10.842549+0000 mon.smithi008 (mon.0) 2728 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:10.844550+0000 mon.smithi008 (mon.0) 2729 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:11.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:10.846422+0000 mgr.smithi008.flmjzp (mgr.14640) 2303 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:12.825394+0000 mgr.smithi008.flmjzp (mgr.14640) 2304 : cluster [DBG] pgmap v1590: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:14.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:12.825394+0000 mgr.smithi008.flmjzp (mgr.14640) 2304 : cluster [DBG] pgmap v1590: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:14.826098+0000 mgr.smithi008.flmjzp (mgr.14640) 2305 : cluster [DBG] pgmap v1591: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:16.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:14.826098+0000 mgr.smithi008.flmjzp (mgr.14640) 2305 : cluster [DBG] pgmap v1591: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:18.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:16.826764+0000 mgr.smithi008.flmjzp (mgr.14640) 2306 : cluster [DBG] pgmap v1592: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:18.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:16.826764+0000 mgr.smithi008.flmjzp (mgr.14640) 2306 : cluster [DBG] pgmap v1592: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:20.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:18.827314+0000 mgr.smithi008.flmjzp (mgr.14640) 2307 : cluster [DBG] pgmap v1593: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:20.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:18.827314+0000 mgr.smithi008.flmjzp (mgr.14640) 2307 : cluster [DBG] pgmap v1593: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:20.827910+0000 mgr.smithi008.flmjzp (mgr.14640) 2308 : cluster [DBG] pgmap v1594: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:20.856122+0000 mon.smithi008 (mon.0) 2730 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:20.858186+0000 mon.smithi008 (mon.0) 2731 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:20.859162+0000 mon.smithi008 (mon.0) 2732 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:20.860023+0000 mgr.smithi008.flmjzp (mgr.14640) 2309 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:20.860583+0000 mgr.smithi008.flmjzp (mgr.14640) 2310 : cluster [DBG] pgmap v1595: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:20.860826+0000 mgr.smithi008.flmjzp (mgr.14640) 2311 : cluster [DBG] pgmap v1596: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:20.865999+0000 mon.smithi008 (mon.0) 2733 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:20.872342+0000 mon.smithi008 (mon.0) 2734 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:20.875562+0000 mon.smithi008 (mon.0) 2735 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:20.877275+0000 mon.smithi008 (mon.0) 2736 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:20.878894+0000 mon.smithi008 (mon.0) 2737 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:21.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:20.880911+0000 mon.smithi008 (mon.0) 2738 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:21.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:20.882811+0000 mgr.smithi008.flmjzp (mgr.14640) 2312 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:20.827910+0000 mgr.smithi008.flmjzp (mgr.14640) 2308 : cluster [DBG] pgmap v1594: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:20.856122+0000 mon.smithi008 (mon.0) 2730 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:20.858186+0000 mon.smithi008 (mon.0) 2731 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:20.859162+0000 mon.smithi008 (mon.0) 2732 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:20.860023+0000 mgr.smithi008.flmjzp (mgr.14640) 2309 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:20.860583+0000 mgr.smithi008.flmjzp (mgr.14640) 2310 : cluster [DBG] pgmap v1595: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:20.860826+0000 mgr.smithi008.flmjzp (mgr.14640) 2311 : cluster [DBG] pgmap v1596: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:20.865999+0000 mon.smithi008 (mon.0) 2733 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:20.872342+0000 mon.smithi008 (mon.0) 2734 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:21.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:20.875562+0000 mon.smithi008 (mon.0) 2735 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:21.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:20.877275+0000 mon.smithi008 (mon.0) 2736 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:21.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:20.878894+0000 mon.smithi008 (mon.0) 2737 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:21.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:20.880911+0000 mon.smithi008 (mon.0) 2738 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:21.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:20.882811+0000 mgr.smithi008.flmjzp (mgr.14640) 2312 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.038+0000 7fbc9759e700 1 -- 172.21.15.8:0/3371921966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc980f77d0 msgr2=0x7fbc980f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.038+0000 7fbc9759e700 1 --2- 172.21.15.8:0/3371921966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc980f77d0 0x7fbc980f7c30 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7fbc8c004660 tx=0x7fbc8c009b30).stop 2023-10-18T21:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.038+0000 7fbc9759e700 1 -- 172.21.15.8:0/3371921966 shutdown_connections 2023-10-18T21:37:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.038+0000 7fbc9759e700 1 --2- 172.21.15.8:0/3371921966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc980f77d0 0x7fbc980f7c30 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.038+0000 7fbc9759e700 1 --2- 172.21.15.8:0/3371921966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc980f6530 0x7fbc980f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.038+0000 7fbc9759e700 1 -- 172.21.15.8:0/3371921966 >> 172.21.15.8:0/3371921966 conn(0x7fbc980f1c90 msgr2=0x7fbc980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.038+0000 7fbc9759e700 1 -- 172.21.15.8:0/3371921966 shutdown_connections 2023-10-18T21:37:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.038+0000 7fbc9759e700 1 -- 172.21.15.8:0/3371921966 wait complete. 2023-10-18T21:37:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.039+0000 7fbc9759e700 1 Processor -- start 2023-10-18T21:37:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.039+0000 7fbc9759e700 1 -- start start 2023-10-18T21:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.040+0000 7fbc9759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc980f6530 0x7fbc98108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.040+0000 7fbc9759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc980f77d0 0x7fbc98109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.040+0000 7fbc9759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98109a20 con 0x7fbc980f6530 2023-10-18T21:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.040+0000 7fbc9759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98109b60 con 0x7fbc980f77d0 2023-10-18T21:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.040+0000 7fbc9659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc980f6530 0x7fbc98108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.040+0000 7fbc9659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc980f6530 0x7fbc98108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48224/0 (socket says 172.21.15.8:48224) 2023-10-18T21:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.040+0000 7fbc9659c700 1 -- 172.21.15.8:0/958324714 learned_addr learned my addr 172.21.15.8:0/958324714 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.040+0000 7fbc95d9b700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc980f77d0 0x7fbc98109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.041+0000 7fbc9659c700 1 -- 172.21.15.8:0/958324714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc980f77d0 msgr2=0x7fbc98109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.041+0000 7fbc9659c700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc980f77d0 0x7fbc98109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.041+0000 7fbc9659c700 1 -- 172.21.15.8:0/958324714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c005040 con 0x7fbc980f6530 2023-10-18T21:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.041+0000 7fbc9659c700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc980f6530 0x7fbc98108f80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fbc88002700 tx=0x7fbc88009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.041+0000 7fbc86ffd700 1 -- 172.21.15.8:0/958324714 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc880079c0 con 0x7fbc980f6530 2023-10-18T21:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.041+0000 7fbc86ffd700 1 -- 172.21.15.8:0/958324714 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbc8800f040 con 0x7fbc980f6530 2023-10-18T21:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.041+0000 7fbc86ffd700 1 -- 172.21.15.8:0/958324714 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc880148d0 con 0x7fbc980f6530 2023-10-18T21:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.041+0000 7fbc9759e700 1 -- 172.21.15.8:0/958324714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9810a500 con 0x7fbc980f6530 2023-10-18T21:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.041+0000 7fbc9759e700 1 -- 172.21.15.8:0/958324714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9810aac0 con 0x7fbc980f6530 2023-10-18T21:37:22.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.042+0000 7fbc9759e700 1 -- 172.21.15.8:0/958324714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc98045ad0 con 0x7fbc980f6530 2023-10-18T21:37:22.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.043+0000 7fbc86ffd700 1 -- 172.21.15.8:0/958324714 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbc8801b060 con 0x7fbc980f6530 2023-10-18T21:37:22.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.044+0000 7fbc86ffd700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc80060f70 0x7fbc80063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:22.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.044+0000 7fbc86ffd700 1 -- 172.21.15.8:0/958324714 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbc8807c710 con 0x7fbc980f6530 2023-10-18T21:37:22.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.044+0000 7fbc95d9b700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc80060f70 0x7fbc80063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:22.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.045+0000 7fbc95d9b700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc80060f70 0x7fbc80063430 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fbc8c004630 tx=0x7fbc8c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.049+0000 7fbc86ffd700 1 -- 172.21.15.8:0/958324714 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbc8804fdb0 con 0x7fbc980f6530 2023-10-18T21:37:22.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.249+0000 7fbc9759e700 1 -- 172.21.15.8:0/958324714 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc9810ad40 con 0x7fbc80060f70 2023-10-18T21:37:22.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.250+0000 7fbc86ffd700 1 -- 172.21.15.8:0/958324714 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbc9810ad40 con 0x7fbc80060f70 2023-10-18T21:37:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 -- 172.21.15.8:0/958324714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc80060f70 msgr2=0x7fbc80063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc80060f70 0x7fbc80063430 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fbc8c004630 tx=0x7fbc8c009b30).stop 2023-10-18T21:37:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 -- 172.21.15.8:0/958324714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc980f6530 msgr2=0x7fbc98108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc980f6530 0x7fbc98108f80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fbc88002700 tx=0x7fbc88009d80).stop 2023-10-18T21:37:22.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 -- 172.21.15.8:0/958324714 shutdown_connections 2023-10-18T21:37:22.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc80060f70 0x7fbc80063430 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc980f6530 0x7fbc98108f80 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 --2- 172.21.15.8:0/958324714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc980f77d0 0x7fbc98109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 -- 172.21.15.8:0/958324714 >> 172.21.15.8:0/958324714 conn(0x7fbc980f1c90 msgr2=0x7fbc9806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:22.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 -- 172.21.15.8:0/958324714 shutdown_connections 2023-10-18T21:37:22.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.252+0000 7fbc9759e700 1 -- 172.21.15.8:0/958324714 wait complete. 2023-10-18T21:37:22.267 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:37:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.389+0000 7f6095b36700 1 -- 172.21.15.8:0/1461648220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60900f77d0 msgr2=0x7f60900f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.389+0000 7f6095b36700 1 --2- 172.21.15.8:0/1461648220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60900f77d0 0x7f60900f7c30 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f607c004660 tx=0x7f607c009b30).stop 2023-10-18T21:37:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.390+0000 7f6095b36700 1 -- 172.21.15.8:0/1461648220 shutdown_connections 2023-10-18T21:37:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.390+0000 7f6095b36700 1 --2- 172.21.15.8:0/1461648220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60900f77d0 0x7f60900f7c30 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.390+0000 7f6095b36700 1 --2- 172.21.15.8:0/1461648220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900f6530 0x7f60900f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.390+0000 7f6095b36700 1 -- 172.21.15.8:0/1461648220 >> 172.21.15.8:0/1461648220 conn(0x7f60900f1c90 msgr2=0x7f60900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:22.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.390+0000 7f6095b36700 1 -- 172.21.15.8:0/1461648220 shutdown_connections 2023-10-18T21:37:22.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.390+0000 7f6095b36700 1 -- 172.21.15.8:0/1461648220 wait complete. 2023-10-18T21:37:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.390+0000 7f6095b36700 1 Processor -- start 2023-10-18T21:37:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.391+0000 7f6095b36700 1 -- start start 2023-10-18T21:37:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.391+0000 7f6095b36700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900f6530 0x7f6090108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:22.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.391+0000 7f6095b36700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60900f77d0 0x7f60901093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:22.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.391+0000 7f6095b36700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6090109970 con 0x7f60900f77d0 2023-10-18T21:37:22.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.391+0000 7f6095b36700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6090109ab0 con 0x7f60900f6530 2023-10-18T21:37:22.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.391+0000 7f608ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60900f77d0 0x7f60901093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.391+0000 7f608ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60900f77d0 0x7f60901093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48228/0 (socket says 172.21.15.8:48228) 2023-10-18T21:37:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.391+0000 7f608ffff700 1 -- 172.21.15.8:0/2817155952 learned_addr learned my addr 172.21.15.8:0/2817155952 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f6094b34700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900f6530 0x7f6090108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f608ffff700 1 -- 172.21.15.8:0/2817155952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900f6530 msgr2=0x7f6090108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f608ffff700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900f6530 0x7f6090108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f608ffff700 1 -- 172.21.15.8:0/2817155952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c005040 con 0x7f60900f77d0 2023-10-18T21:37:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f6094b34700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900f6530 0x7f6090108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:37:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f608ffff700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60900f77d0 0x7f60901093c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f607c004320 tx=0x7f607c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f608d7fa700 1 -- 172.21.15.8:0/2817155952 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f607c019070 con 0x7f60900f77d0 2023-10-18T21:37:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f608d7fa700 1 -- 172.21.15.8:0/2817155952 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f607c01e420 con 0x7f60900f77d0 2023-10-18T21:37:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f6095b36700 1 -- 172.21.15.8:0/2817155952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609010a3f0 con 0x7f60900f77d0 2023-10-18T21:37:22.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f608d7fa700 1 -- 172.21.15.8:0/2817155952 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f607c014660 con 0x7f60900f77d0 2023-10-18T21:37:22.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.392+0000 7f6095b36700 1 -- 172.21.15.8:0/2817155952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609010a8d0 con 0x7f60900f77d0 2023-10-18T21:37:22.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.393+0000 7f6095b36700 1 -- 172.21.15.8:0/2817155952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6090045ad0 con 0x7f60900f77d0 2023-10-18T21:37:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.394+0000 7f608d7fa700 1 -- 172.21.15.8:0/2817155952 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f607c01e590 con 0x7f60900f77d0 2023-10-18T21:37:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.396+0000 7f608d7fa700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6080060f70 0x7f6080063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.396+0000 7f608d7fa700 1 -- 172.21.15.8:0/2817155952 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f607c07dec0 con 0x7f60900f77d0 2023-10-18T21:37:22.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.396+0000 7f6094b34700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6080060f70 0x7f6080063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:22.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.396+0000 7f6094b34700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6080060f70 0x7f6080063430 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f60900f7630 tx=0x7f608400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:22.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.400+0000 7f608d7fa700 1 -- 172.21.15.8:0/2817155952 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f607c051440 con 0x7f60900f77d0 2023-10-18T21:37:22.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.597+0000 7f6095b36700 1 -- 172.21.15.8:0/2817155952 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60900fedd0 con 0x7f6080060f70 2023-10-18T21:37:22.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.599+0000 7f608d7fa700 1 -- 172.21.15.8:0/2817155952 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f60900fedd0 con 0x7f6080060f70 2023-10-18T21:37:22.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 -- 172.21.15.8:0/2817155952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6080060f70 msgr2=0x7f6080063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6080060f70 0x7f6080063430 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f60900f7630 tx=0x7f608400b040).stop 2023-10-18T21:37:22.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 -- 172.21.15.8:0/2817155952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60900f77d0 msgr2=0x7f60901093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60900f77d0 0x7f60901093c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f607c004320 tx=0x7f607c00b040).stop 2023-10-18T21:37:22.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 -- 172.21.15.8:0/2817155952 shutdown_connections 2023-10-18T21:37:22.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6080060f70 0x7f6080063430 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900f6530 0x7f6090108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 --2- 172.21.15.8:0/2817155952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60900f77d0 0x7f60901093c0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 -- 172.21.15.8:0/2817155952 >> 172.21.15.8:0/2817155952 conn(0x7f60900f1c90 msgr2=0x7f609006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:22.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 -- 172.21.15.8:0/2817155952 shutdown_connections 2023-10-18T21:37:22.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.601+0000 7f6095b36700 1 -- 172.21.15.8:0/2817155952 wait complete. 2023-10-18T21:37:22.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.737+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/3297088982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 msgr2=0x7f2a080f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.737+0000 7f2a0cbe5700 1 --2- 172.21.15.8:0/3297088982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 0x7f2a080f7c30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f29fc004660 tx=0x7f29fc009b30).stop 2023-10-18T21:37:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.737+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/3297088982 shutdown_connections 2023-10-18T21:37:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.737+0000 7f2a0cbe5700 1 --2- 172.21.15.8:0/3297088982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f77d0 0x7f2a080f7c30 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.737+0000 7f2a0cbe5700 1 --2- 172.21.15.8:0/3297088982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f6530 0x7f2a080f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.737+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/3297088982 >> 172.21.15.8:0/3297088982 conn(0x7f2a080f1c90 msgr2=0x7f2a080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.737+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/3297088982 shutdown_connections 2023-10-18T21:37:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.737+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/3297088982 wait complete. 2023-10-18T21:37:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.738+0000 7f2a0cbe5700 1 Processor -- start 2023-10-18T21:37:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.739+0000 7f2a0cbe5700 1 -- start start 2023-10-18T21:37:22.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.739+0000 7f2a0cbe5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f6530 0x7f2a08106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.739+0000 7f2a0cbe5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f77d0 0x7f2a08107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.739+0000 7f2a0cbe5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08107850 con 0x7f2a080f6530 2023-10-18T21:37:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.739+0000 7f2a0cbe5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08108060 con 0x7f2a080f77d0 2023-10-18T21:37:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.739+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f6530 0x7f2a08106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.739+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f6530 0x7f2a08106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48246/0 (socket says 172.21.15.8:48246) 2023-10-18T21:37:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.739+0000 7f2a077fe700 1 -- 172.21.15.8:0/463264368 learned_addr learned my addr 172.21.15.8:0/463264368 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f77d0 0x7f2a08107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f2a077fe700 1 -- 172.21.15.8:0/463264368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f77d0 msgr2=0x7f2a08107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f2a077fe700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f77d0 0x7f2a08107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f2a077fe700 1 -- 172.21.15.8:0/463264368 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc005040 con 0x7f2a080f6530 2023-10-18T21:37:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f77d0 0x7f2a08107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:37:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f2a077fe700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f6530 0x7f2a08106d60 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f29f8002700 tx=0x7f29f8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f29effff700 1 -- 172.21.15.8:0/463264368 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f8009320 con 0x7f2a080f6530 2023-10-18T21:37:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f29effff700 1 -- 172.21.15.8:0/463264368 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f29f800f040 con 0x7f2a080f6530 2023-10-18T21:37:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/463264368 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a081082e0 con 0x7f2a080f6530 2023-10-18T21:37:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f29effff700 1 -- 172.21.15.8:0/463264368 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f8014950 con 0x7f2a080f6530 2023-10-18T21:37:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.740+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/463264368 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a081088a0 con 0x7f2a080f6530 2023-10-18T21:37:22.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.742+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/463264368 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a08059100 con 0x7f2a080f6530 2023-10-18T21:37:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.742+0000 7f29effff700 1 -- 172.21.15.8:0/463264368 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f29f8009480 con 0x7f2a080f6530 2023-10-18T21:37:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.743+0000 7f29effff700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f0060f70 0x7f29f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.743+0000 7f29effff700 1 -- 172.21.15.8:0/463264368 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f29f807cd00 con 0x7f2a080f6530 2023-10-18T21:37:22.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.743+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f0060f70 0x7f29f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.744+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f0060f70 0x7f29f0063430 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f29fc005010 tx=0x7f29fc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:22.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.747+0000 7f29effff700 1 -- 172.21.15.8:0/463264368 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f29f804c8b0 con 0x7f2a080f6530 2023-10-18T21:37:22.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.941+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/463264368 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a080fee50 con 0x7f29f0060f70 2023-10-18T21:37:22.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.951+0000 7f29effff700 1 -- 172.21.15.8:0/463264368 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2a080fee50 con 0x7f29f0060f70 2023-10-18T21:37:22.952 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:37:22.952 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (44m) 104s ago 45m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:37:22.952 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (37m) 104s ago 45m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:37:22.952 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (37m) 9m ago 44m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:37:22.953 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (43m) 104s ago 45m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:37:22.953 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 104s ago 41m - - 2023-10-18T21:37:22.953 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 104s ago 41m - - 2023-10-18T21:37:22.953 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 41m - - 2023-10-18T21:37:22.953 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 41m - - 2023-10-18T21:37:22.954 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (39m) 104s ago 46m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:37:22.954 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (38m) 9m ago 44m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:37:22.954 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (38m) 104s ago 46m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:37:22.954 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (38m) 9m ago 44m 168M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (45m) 104s ago 45m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (44m) 9m ago 44m 10.5M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (37m) 104s ago 44m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (35m) 104s ago 43m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (35m) 104s ago 43m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:37:22.955 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (34m) 9m ago 43m 416M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:37:22.956 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (33m) 9m ago 42m 370M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:37:22.956 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (33m) 9m ago 42m 291M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:37:22.956 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (39m) 104s ago 44m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:37:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/463264368 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f0060f70 msgr2=0x7f29f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f0060f70 0x7f29f0063430 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f29fc005010 tx=0x7f29fc009b30).stop 2023-10-18T21:37:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/463264368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f6530 msgr2=0x7f2a08106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f6530 0x7f2a08106d60 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f29f8002700 tx=0x7f29f8009e00).stop 2023-10-18T21:37:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/463264368 shutdown_connections 2023-10-18T21:37:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f29f0060f70 0x7f29f0063430 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080f6530 0x7f2a08106d60 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 --2- 172.21.15.8:0/463264368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a080f77d0 0x7f2a08107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/463264368 >> 172.21.15.8:0/463264368 conn(0x7f2a080f1c90 msgr2=0x7f2a080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:22.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/463264368 shutdown_connections 2023-10-18T21:37:22.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:22.953+0000 7f2a0cbe5700 1 -- 172.21.15.8:0/463264368 wait complete. 2023-10-18T21:37:23.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.087+0000 7fc19f598700 1 -- 172.21.15.8:0/2568388290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1980f77d0 msgr2=0x7fc1980f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:23.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.087+0000 7fc19f598700 1 --2- 172.21.15.8:0/2568388290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1980f77d0 0x7fc1980f7c30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fc188004660 tx=0x7fc188009b30).stop 2023-10-18T21:37:23.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.087+0000 7fc19f598700 1 -- 172.21.15.8:0/2568388290 shutdown_connections 2023-10-18T21:37:23.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.087+0000 7fc19f598700 1 --2- 172.21.15.8:0/2568388290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1980f77d0 0x7fc1980f7c30 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.087+0000 7fc19f598700 1 --2- 172.21.15.8:0/2568388290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1980f6530 0x7fc1980f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.087+0000 7fc19f598700 1 -- 172.21.15.8:0/2568388290 >> 172.21.15.8:0/2568388290 conn(0x7fc1980f1c90 msgr2=0x7fc1980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:23.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.088+0000 7fc19f598700 1 -- 172.21.15.8:0/2568388290 shutdown_connections 2023-10-18T21:37:23.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.088+0000 7fc19f598700 1 -- 172.21.15.8:0/2568388290 wait complete. 2023-10-18T21:37:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.089+0000 7fc19f598700 1 Processor -- start 2023-10-18T21:37:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.089+0000 7fc19f598700 1 -- start start 2023-10-18T21:37:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.089+0000 7fc19f598700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1980f6530 0x7fc19806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.089+0000 7fc19f598700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1980f77d0 0x7fc198069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.089+0000 7fc19f598700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19806a380 con 0x7fc1980f6530 2023-10-18T21:37:23.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.089+0000 7fc19f598700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19806a4c0 con 0x7fc1980f77d0 2023-10-18T21:37:23.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.090+0000 7fc19e596700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1980f6530 0x7fc19806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:23.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.090+0000 7fc19e596700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1980f6530 0x7fc19806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48260/0 (socket says 172.21.15.8:48260) 2023-10-18T21:37:23.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.090+0000 7fc19e596700 1 -- 172.21.15.8:0/3980937562 learned_addr learned my addr 172.21.15.8:0/3980937562 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:23.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.090+0000 7fc19dd95700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1980f77d0 0x7fc198069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:23.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.090+0000 7fc19e596700 1 -- 172.21.15.8:0/3980937562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1980f77d0 msgr2=0x7fc198069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:23.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.090+0000 7fc19e596700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1980f77d0 0x7fc198069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.090+0000 7fc19e596700 1 -- 172.21.15.8:0/3980937562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188005040 con 0x7fc1980f6530 2023-10-18T21:37:23.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.090+0000 7fc19dd95700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1980f77d0 0x7fc198069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:37:23.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.090+0000 7fc19e596700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1980f6530 0x7fc19806b9a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7fc19400c790 tx=0x7fc194007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:23.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.091+0000 7fc18effd700 1 -- 172.21.15.8:0/3980937562 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc19400e680 con 0x7fc1980f6530 2023-10-18T21:37:23.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.091+0000 7fc18effd700 1 -- 172.21.15.8:0/3980937562 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc19400eca0 con 0x7fc1980f6530 2023-10-18T21:37:23.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.091+0000 7fc18effd700 1 -- 172.21.15.8:0/3980937562 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc194012d80 con 0x7fc1980f6530 2023-10-18T21:37:23.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.091+0000 7fc19f598700 1 -- 172.21.15.8:0/3980937562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19806a7a0 con 0x7fc1980f6530 2023-10-18T21:37:23.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.091+0000 7fc19f598700 1 -- 172.21.15.8:0/3980937562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19810ed70 con 0x7fc1980f6530 2023-10-18T21:37:23.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.092+0000 7fc19f598700 1 -- 172.21.15.8:0/3980937562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc198045ad0 con 0x7fc1980f6530 2023-10-18T21:37:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.093+0000 7fc18effd700 1 -- 172.21.15.8:0/3980937562 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc194010070 con 0x7fc1980f6530 2023-10-18T21:37:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.093+0000 7fc18effd700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc184060f70 0x7fc184063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.094+0000 7fc18effd700 1 -- 172.21.15.8:0/3980937562 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc19407c9b0 con 0x7fc1980f6530 2023-10-18T21:37:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.094+0000 7fc19dd95700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc184060f70 0x7fc184063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.094+0000 7fc19dd95700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc184060f70 0x7fc184063430 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fc188004630 tx=0x7fc188009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:23.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.098+0000 7fc18effd700 1 -- 172.21.15.8:0/3980937562 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc19404c5c0 con 0x7fc1980f6530 2023-10-18T21:37:23.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.349+0000 7fc19f598700 1 -- 172.21.15.8:0/3980937562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc1980fed60 con 0x7fc1980f6530 2023-10-18T21:37:23.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.350+0000 7fc18effd700 1 -- 172.21.15.8:0/3980937562 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fc19404fbe0 con 0x7fc1980f6530 2023-10-18T21:37:23.351 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:37:23.351 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:37:23.351 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:37:23.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:37:23.352 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:37:23.352 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:37:23.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:37:23.352 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:37:23.353 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:37:23.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:37:23.353 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:37:23.353 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:37:23.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:37:23.353 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:37:23.354 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:37:23.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:37:23.354 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:37:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 -- 172.21.15.8:0/3980937562 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc184060f70 msgr2=0x7fc184063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc184060f70 0x7fc184063430 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fc188004630 tx=0x7fc188009b30).stop 2023-10-18T21:37:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 -- 172.21.15.8:0/3980937562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1980f6530 msgr2=0x7fc19806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1980f6530 0x7fc19806b9a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7fc19400c790 tx=0x7fc194007d90).stop 2023-10-18T21:37:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 -- 172.21.15.8:0/3980937562 shutdown_connections 2023-10-18T21:37:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc184060f70 0x7fc184063430 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1980f6530 0x7fc19806b9a0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 --2- 172.21.15.8:0/3980937562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1980f77d0 0x7fc198069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 -- 172.21.15.8:0/3980937562 >> 172.21.15.8:0/3980937562 conn(0x7fc1980f1c90 msgr2=0x7fc1980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:23.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 -- 172.21.15.8:0/3980937562 shutdown_connections 2023-10-18T21:37:23.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.352+0000 7fc19f598700 1 -- 172.21.15.8:0/3980937562 wait complete. 2023-10-18T21:37:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.487+0000 7f001dd0f700 1 -- 172.21.15.8:0/2975410748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00180f6530 msgr2=0x7f00180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.487+0000 7f001dd0f700 1 --2- 172.21.15.8:0/2975410748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00180f6530 0x7f00180f6950 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f000c004660 tx=0x7f000c009b30).stop 2023-10-18T21:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.487+0000 7f001dd0f700 1 -- 172.21.15.8:0/2975410748 shutdown_connections 2023-10-18T21:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.487+0000 7f001dd0f700 1 --2- 172.21.15.8:0/2975410748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00180f77d0 0x7f00180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.487+0000 7f001dd0f700 1 --2- 172.21.15.8:0/2975410748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00180f6530 0x7f00180f6950 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.487+0000 7f001dd0f700 1 -- 172.21.15.8:0/2975410748 >> 172.21.15.8:0/2975410748 conn(0x7f00180f1c90 msgr2=0x7f00180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.488+0000 7f001dd0f700 1 -- 172.21.15.8:0/2975410748 shutdown_connections 2023-10-18T21:37:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.488+0000 7f001dd0f700 1 -- 172.21.15.8:0/2975410748 wait complete. 2023-10-18T21:37:23.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.488+0000 7f001dd0f700 1 Processor -- start 2023-10-18T21:37:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.489+0000 7f001dd0f700 1 -- start start 2023-10-18T21:37:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.489+0000 7f001dd0f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00180f6530 0x7f001806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.489+0000 7f001dd0f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00180f77d0 0x7f0018069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.489+0000 7f001dd0f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001806a380 con 0x7f00180f77d0 2023-10-18T21:37:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.489+0000 7f001dd0f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001806a4c0 con 0x7f00180f6530 2023-10-18T21:37:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.489+0000 7f0017fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00180f77d0 0x7f0018069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:23.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.489+0000 7f0017fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00180f77d0 0x7f0018069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48268/0 (socket says 172.21.15.8:48268) 2023-10-18T21:37:23.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.489+0000 7f0017fff700 1 -- 172.21.15.8:0/3822809297 learned_addr learned my addr 172.21.15.8:0/3822809297 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:23.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.489+0000 7f001cd0d700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00180f6530 0x7f001806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:23.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.490+0000 7f0017fff700 1 -- 172.21.15.8:0/3822809297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00180f6530 msgr2=0x7f001806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:23.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.490+0000 7f0017fff700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00180f6530 0x7f001806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.490+0000 7f0017fff700 1 -- 172.21.15.8:0/3822809297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c005040 con 0x7f00180f77d0 2023-10-18T21:37:23.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.490+0000 7f0017fff700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00180f77d0 0x7f0018069e20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f00040026d0 tx=0x7f0004009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:23.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.490+0000 7f00157fa700 1 -- 172.21.15.8:0/3822809297 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00040079c0 con 0x7f00180f77d0 2023-10-18T21:37:23.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.490+0000 7f001dd0f700 1 -- 172.21.15.8:0/3822809297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001806a7a0 con 0x7f00180f77d0 2023-10-18T21:37:23.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.490+0000 7f00157fa700 1 -- 172.21.15.8:0/3822809297 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f000400f040 con 0x7f00180f77d0 2023-10-18T21:37:23.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.490+0000 7f00157fa700 1 -- 172.21.15.8:0/3822809297 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0004014900 con 0x7f00180f77d0 2023-10-18T21:37:23.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.490+0000 7f001dd0f700 1 -- 172.21.15.8:0/3822809297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001810ede0 con 0x7f00180f77d0 2023-10-18T21:37:23.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.491+0000 7f001dd0f700 1 -- 172.21.15.8:0/3822809297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0018045ad0 con 0x7f00180f77d0 2023-10-18T21:37:23.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.492+0000 7f00157fa700 1 -- 172.21.15.8:0/3822809297 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f00040090d0 con 0x7f00180f77d0 2023-10-18T21:37:23.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.493+0000 7f00157fa700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0008060f70 0x7f0008063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:23.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.494+0000 7f00157fa700 1 -- 172.21.15.8:0/3822809297 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f000407c9a0 con 0x7f00180f77d0 2023-10-18T21:37:23.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.494+0000 7f001cd0d700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0008060f70 0x7f0008063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:23.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.494+0000 7f001cd0d700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0008060f70 0x7f0008063430 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f001806b730 tx=0x7f000c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:23.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.498+0000 7f00157fa700 1 -- 172.21.15.8:0/3822809297 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f000404c600 con 0x7f00180f77d0 2023-10-18T21:37:23.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.728+0000 7f001dd0f700 1 -- 172.21.15.8:0/3822809297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f00180586e0 con 0x7f00180f77d0 2023-10-18T21:37:23.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.728+0000 7f00157fa700 1 -- 172.21.15.8:0/3822809297 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f000404fc20 con 0x7f00180f77d0 2023-10-18T21:37:23.730 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:37:23.730 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:37:23.730 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:37:23.730 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:37:23.730 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:37:23.731 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:37:23.731 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:37:23.731 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:37:23.731 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:37:23.731 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:37:23.732 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:37:23.732 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:37:23.732 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:37:23.732 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:37:23.732 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:37:23.732 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:37:23.733 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:37:23.733 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:37:23.733 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:37:23.733 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:37:23.733 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:37:23.733 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:37:23.734 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:37:23.734 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:37:23.734 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:37:23.734 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:37:23.735 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:37:23.735 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:37:23.735 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:37:23.735 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:37:23.735 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:37:23.735 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:37:23.736 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:37:23.736 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:37:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.730+0000 7f001dd0f700 1 -- 172.21.15.8:0/3822809297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0008060f70 msgr2=0x7f0008063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.730+0000 7f001dd0f700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0008060f70 0x7f0008063430 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f001806b730 tx=0x7f000c009b30).stop 2023-10-18T21:37:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.730+0000 7f001dd0f700 1 -- 172.21.15.8:0/3822809297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00180f77d0 msgr2=0x7f0018069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.730+0000 7f001dd0f700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00180f77d0 0x7f0018069e20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f00040026d0 tx=0x7f0004009de0).stop 2023-10-18T21:37:23.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.730+0000 7f001dd0f700 1 -- 172.21.15.8:0/3822809297 shutdown_connections 2023-10-18T21:37:23.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.730+0000 7f001dd0f700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0008060f70 0x7f0008063430 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.730+0000 7f001dd0f700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00180f6530 0x7f001806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.730+0000 7f001dd0f700 1 --2- 172.21.15.8:0/3822809297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00180f77d0 0x7f0018069e20 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.730+0000 7f001dd0f700 1 -- 172.21.15.8:0/3822809297 >> 172.21.15.8:0/3822809297 conn(0x7f00180f1c90 msgr2=0x7f00180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:23.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.730+0000 7f001dd0f700 1 -- 172.21.15.8:0/3822809297 shutdown_connections 2023-10-18T21:37:23.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.731+0000 7f001dd0f700 1 -- 172.21.15.8:0/3822809297 wait complete. 2023-10-18T21:37:23.739 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:37:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.869+0000 7ff63ab07700 1 -- 172.21.15.8:0/1358449615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6340f6530 msgr2=0x7ff6340f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.869+0000 7ff63ab07700 1 --2- 172.21.15.8:0/1358449615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6340f6530 0x7ff6340f6950 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7ff630004660 tx=0x7ff630009b30).stop 2023-10-18T21:37:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.869+0000 7ff63ab07700 1 -- 172.21.15.8:0/1358449615 shutdown_connections 2023-10-18T21:37:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.869+0000 7ff63ab07700 1 --2- 172.21.15.8:0/1358449615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6340f77d0 0x7ff6340f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:37:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.869+0000 7ff63ab07700 1 --2- 172.21.15.8:0/1358449615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6340f6530 0x7ff6340f6950 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.869+0000 7ff63ab07700 1 -- 172.21.15.8:0/1358449615 >> 172.21.15.8:0/1358449615 conn(0x7ff6340f1c90 msgr2=0x7ff6340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.869+0000 7ff63ab07700 1 -- 172.21.15.8:0/1358449615 shutdown_connections 2023-10-18T21:37:23.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.869+0000 7ff63ab07700 1 -- 172.21.15.8:0/1358449615 wait complete. 2023-10-18T21:37:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.870+0000 7ff63ab07700 1 Processor -- start 2023-10-18T21:37:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.870+0000 7ff63ab07700 1 -- start start 2023-10-18T21:37:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.870+0000 7ff63ab07700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6340f6530 0x7ff634106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.870+0000 7ff63ab07700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6340f77d0 0x7ff634107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.870+0000 7ff63ab07700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6341079b0 con 0x7ff6340f77d0 2023-10-18T21:37:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.870+0000 7ff63ab07700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634108130 con 0x7ff6340f6530 2023-10-18T21:37:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.870+0000 7ff639304700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6340f77d0 0x7ff634107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff639304700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6340f77d0 0x7ff634107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48292/0 (socket says 172.21.15.8:48292) 2023-10-18T21:37:23.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff639b05700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6340f6530 0x7ff634106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:23.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff639304700 1 -- 172.21.15.8:0/3112389575 learned_addr learned my addr 172.21.15.8:0/3112389575 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:23.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff639304700 1 -- 172.21.15.8:0/3112389575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6340f6530 msgr2=0x7ff634106e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:23.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff639304700 1 --2- 172.21.15.8:0/3112389575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6340f6530 0x7ff634106e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:23.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff639304700 1 -- 172.21.15.8:0/3112389575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff630005040 con 0x7ff6340f77d0 2023-10-18T21:37:23.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff639304700 1 --2- 172.21.15.8:0/3112389575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6340f77d0 0x7ff634107320 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7ff62400b410 tx=0x7ff624006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:23.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff62a7fc700 1 -- 172.21.15.8:0/3112389575 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6240125f0 con 0x7ff6340f77d0 2023-10-18T21:37:23.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff62a7fc700 1 -- 172.21.15.8:0/3112389575 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff62400be30 con 0x7ff6340f77d0 2023-10-18T21:37:23.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff62a7fc700 1 -- 172.21.15.8:0/3112389575 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff624002a60 con 0x7ff6340f77d0 2023-10-18T21:37:23.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.871+0000 7ff63ab07700 1 -- 172.21.15.8:0/3112389575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6341083b0 con 0x7ff6340f77d0 2023-10-18T21:37:23.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.872+0000 7ff63ab07700 1 -- 172.21.15.8:0/3112389575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff634108970 con 0x7ff6340f77d0 2023-10-18T21:37:23.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.873+0000 7ff63ab07700 1 -- 172.21.15.8:0/3112389575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff634045ad0 con 0x7ff6340f77d0 2023-10-18T21:37:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.874+0000 7ff62a7fc700 1 -- 172.21.15.8:0/3112389575 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff62400f030 con 0x7ff6340f77d0 2023-10-18T21:37:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.874+0000 7ff62a7fc700 1 --2- 172.21.15.8:0/3112389575 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff620060f70 0x7ff620063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.875+0000 7ff62a7fc700 1 -- 172.21.15.8:0/3112389575 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff62407cd20 con 0x7ff6340f77d0 2023-10-18T21:37:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.875+0000 7ff639b05700 1 --2- 172.21.15.8:0/3112389575 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff620060f70 0x7ff620063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.875+0000 7ff639b05700 1 --2- 172.21.15.8:0/3112389575 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff620060f70 0x7ff620063430 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ff630009490 tx=0x7ff630009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:23.879+0000 7ff62a7fc700 1 -- 172.21.15.8:0/3112389575 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff62404c8f0 con 0x7ff6340f77d0 2023-10-18T21:37:24.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.081+0000 7ff63ab07700 1 -- 172.21.15.8:0/3112389575 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff634108be0 con 0x7ff620060f70 2023-10-18T21:37:24.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.083+0000 7ff62a7fc700 1 -- 172.21.15.8:0/3112389575 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff634108be0 con 0x7ff620060f70 2023-10-18T21:37:24.083 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:37:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:37:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:37:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:37:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:37:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:37:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:37:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:37:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:37:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:37:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:37:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:37:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:37:24.086 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:37:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 -- 172.21.15.8:0/3112389575 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff620060f70 msgr2=0x7ff620063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 --2- 172.21.15.8:0/3112389575 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff620060f70 0x7ff620063430 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ff630009490 tx=0x7ff630009b30).stop 2023-10-18T21:37:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 -- 172.21.15.8:0/3112389575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6340f77d0 msgr2=0x7ff634107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 --2- 172.21.15.8:0/3112389575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6340f77d0 0x7ff634107320 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7ff62400b410 tx=0x7ff624006ef0).stop 2023-10-18T21:37:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 -- 172.21.15.8:0/3112389575 shutdown_connections 2023-10-18T21:37:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 --2- 172.21.15.8:0/3112389575 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff620060f70 0x7ff620063430 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 --2- 172.21.15.8:0/3112389575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6340f6530 0x7ff634106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 --2- 172.21.15.8:0/3112389575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6340f77d0 0x7ff634107320 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 -- 172.21.15.8:0/3112389575 >> 172.21.15.8:0/3112389575 conn(0x7ff6340f1c90 msgr2=0x7ff6340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 -- 172.21.15.8:0/3112389575 shutdown_connections 2023-10-18T21:37:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:24.085+0000 7ff63ab07700 1 -- 172.21.15.8:0/3112389575 wait complete. 2023-10-18T21:37:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:22.250256+0000 mgr.smithi008.flmjzp (mgr.14640) 2313 : audit [DBG] from='client.35992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:22.598953+0000 mgr.smithi008.flmjzp (mgr.14640) 2314 : audit [DBG] from='client.35996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:22.861269+0000 mgr.smithi008.flmjzp (mgr.14640) 2315 : cluster [DBG] pgmap v1597: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:22.942571+0000 mgr.smithi008.flmjzp (mgr.14640) 2316 : audit [DBG] from='client.36000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:24.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:23.350235+0000 mon.smithi008 (mon.0) 2739 : audit [DBG] from='client.? 172.21.15.8:0/3980937562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:24.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:23.729006+0000 mon.smithi008 (mon.0) 2740 : audit [DBG] from='client.? 172.21.15.8:0/3822809297' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:37:24.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:22.250256+0000 mgr.smithi008.flmjzp (mgr.14640) 2313 : audit [DBG] from='client.35992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:22.598953+0000 mgr.smithi008.flmjzp (mgr.14640) 2314 : audit [DBG] from='client.35996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:22.861269+0000 mgr.smithi008.flmjzp (mgr.14640) 2315 : cluster [DBG] pgmap v1597: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:22.942571+0000 mgr.smithi008.flmjzp (mgr.14640) 2316 : audit [DBG] from='client.36000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:23.350235+0000 mon.smithi008 (mon.0) 2739 : audit [DBG] from='client.? 172.21.15.8:0/3980937562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:23.729006+0000 mon.smithi008 (mon.0) 2740 : audit [DBG] from='client.? 172.21.15.8:0/3822809297' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:37:26.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:24.083015+0000 mgr.smithi008.flmjzp (mgr.14640) 2317 : audit [DBG] from='client.36012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:26.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:24.861925+0000 mgr.smithi008.flmjzp (mgr.14640) 2318 : cluster [DBG] pgmap v1598: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:24.083015+0000 mgr.smithi008.flmjzp (mgr.14640) 2317 : audit [DBG] from='client.36012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:24.861925+0000 mgr.smithi008.flmjzp (mgr.14640) 2318 : cluster [DBG] pgmap v1598: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:26.862506+0000 mgr.smithi008.flmjzp (mgr.14640) 2319 : cluster [DBG] pgmap v1599: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:28.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:26.862506+0000 mgr.smithi008.flmjzp (mgr.14640) 2319 : cluster [DBG] pgmap v1599: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:30.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:28.863257+0000 mgr.smithi008.flmjzp (mgr.14640) 2320 : cluster [DBG] pgmap v1600: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:28.863257+0000 mgr.smithi008.flmjzp (mgr.14640) 2320 : cluster [DBG] pgmap v1600: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:30.863770+0000 mgr.smithi008.flmjzp (mgr.14640) 2321 : cluster [DBG] pgmap v1601: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:30.893080+0000 mon.smithi008 (mon.0) 2741 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:30.895210+0000 mon.smithi008 (mon.0) 2742 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:30.896214+0000 mon.smithi008 (mon.0) 2743 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:30.897087+0000 mgr.smithi008.flmjzp (mgr.14640) 2322 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:30.897642+0000 mgr.smithi008.flmjzp (mgr.14640) 2323 : cluster [DBG] pgmap v1602: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:30.897878+0000 mgr.smithi008.flmjzp (mgr.14640) 2324 : cluster [DBG] pgmap v1603: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:31.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:30.902434+0000 mon.smithi008 (mon.0) 2744 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:31.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:30.908873+0000 mon.smithi008 (mon.0) 2745 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:31.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:30.911834+0000 mon.smithi008 (mon.0) 2746 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:31.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:30.913425+0000 mon.smithi008 (mon.0) 2747 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:31.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:30.914979+0000 mon.smithi008 (mon.0) 2748 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:31.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:30.917065+0000 mon.smithi008 (mon.0) 2749 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:31.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:30.918997+0000 mgr.smithi008.flmjzp (mgr.14640) 2325 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:30.863770+0000 mgr.smithi008.flmjzp (mgr.14640) 2321 : cluster [DBG] pgmap v1601: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:30.893080+0000 mon.smithi008 (mon.0) 2741 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:30.895210+0000 mon.smithi008 (mon.0) 2742 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:30.896214+0000 mon.smithi008 (mon.0) 2743 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:30.897087+0000 mgr.smithi008.flmjzp (mgr.14640) 2322 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:30.897642+0000 mgr.smithi008.flmjzp (mgr.14640) 2323 : cluster [DBG] pgmap v1602: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:30.897878+0000 mgr.smithi008.flmjzp (mgr.14640) 2324 : cluster [DBG] pgmap v1603: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:30.902434+0000 mon.smithi008 (mon.0) 2744 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:30.908873+0000 mon.smithi008 (mon.0) 2745 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:31.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:30.911834+0000 mon.smithi008 (mon.0) 2746 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:31.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:30.913425+0000 mon.smithi008 (mon.0) 2747 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:31.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:30.914979+0000 mon.smithi008 (mon.0) 2748 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:31.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:30.917065+0000 mon.smithi008 (mon.0) 2749 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:31.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:30.918997+0000 mgr.smithi008.flmjzp (mgr.14640) 2325 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:34.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:32.898359+0000 mgr.smithi008.flmjzp (mgr.14640) 2326 : cluster [DBG] pgmap v1604: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:34.294 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:32.898359+0000 mgr.smithi008.flmjzp (mgr.14640) 2326 : cluster [DBG] pgmap v1604: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:36.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:34.898971+0000 mgr.smithi008.flmjzp (mgr.14640) 2327 : cluster [DBG] pgmap v1605: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:34.898971+0000 mgr.smithi008.flmjzp (mgr.14640) 2327 : cluster [DBG] pgmap v1605: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:38.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:36.899628+0000 mgr.smithi008.flmjzp (mgr.14640) 2328 : cluster [DBG] pgmap v1606: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:36.899628+0000 mgr.smithi008.flmjzp (mgr.14640) 2328 : cluster [DBG] pgmap v1606: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:40.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:38.900178+0000 mgr.smithi008.flmjzp (mgr.14640) 2329 : cluster [DBG] pgmap v1607: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:38.900178+0000 mgr.smithi008.flmjzp (mgr.14640) 2329 : cluster [DBG] pgmap v1607: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:40.900861+0000 mgr.smithi008.flmjzp (mgr.14640) 2330 : cluster [DBG] pgmap v1608: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:40.926012+0000 mon.smithi008 (mon.0) 2750 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:40.900861+0000 mgr.smithi008.flmjzp (mgr.14640) 2330 : cluster [DBG] pgmap v1608: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:40.926012+0000 mon.smithi008 (mon.0) 2750 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:42.901517+0000 mgr.smithi008.flmjzp (mgr.14640) 2331 : cluster [DBG] pgmap v1609: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:43.454901+0000 mon.smithi008 (mon.0) 2751 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:43.455895+0000 mon.smithi008 (mon.0) 2752 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:43.457061+0000 mon.smithi008 (mon.0) 2753 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:43.463143+0000 mon.smithi008 (mon.0) 2754 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:44.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:43.469400+0000 mon.smithi008 (mon.0) 2755 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:44.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:43.472603+0000 mon.smithi008 (mon.0) 2756 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:44.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:43.474258+0000 mon.smithi008 (mon.0) 2757 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:44.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:43.475878+0000 mon.smithi008 (mon.0) 2758 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:44.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:43.478706+0000 mon.smithi008 (mon.0) 2759 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:44.295 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:42.901517+0000 mgr.smithi008.flmjzp (mgr.14640) 2331 : cluster [DBG] pgmap v1609: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:44.295 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:43.454901+0000 mon.smithi008 (mon.0) 2751 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:44.295 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:43.455895+0000 mon.smithi008 (mon.0) 2752 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:44.296 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:43.457061+0000 mon.smithi008 (mon.0) 2753 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:44.296 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:43.463143+0000 mon.smithi008 (mon.0) 2754 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:44.296 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:43.469400+0000 mon.smithi008 (mon.0) 2755 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:44.296 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:43.472603+0000 mon.smithi008 (mon.0) 2756 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:44.296 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:43.474258+0000 mon.smithi008 (mon.0) 2757 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:44.297 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:43.475878+0000 mon.smithi008 (mon.0) 2758 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:44.297 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:43.478706+0000 mon.smithi008 (mon.0) 2759 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:45.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:43.458039+0000 mgr.smithi008.flmjzp (mgr.14640) 2332 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:43.458782+0000 mgr.smithi008.flmjzp (mgr.14640) 2333 : cluster [DBG] pgmap v1610: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:43.459039+0000 mgr.smithi008.flmjzp (mgr.14640) 2334 : cluster [DBG] pgmap v1611: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:43.480749+0000 mgr.smithi008.flmjzp (mgr.14640) 2335 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:43.458039+0000 mgr.smithi008.flmjzp (mgr.14640) 2332 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:43.458782+0000 mgr.smithi008.flmjzp (mgr.14640) 2333 : cluster [DBG] pgmap v1610: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:43.459039+0000 mgr.smithi008.flmjzp (mgr.14640) 2334 : cluster [DBG] pgmap v1611: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:43.480749+0000 mgr.smithi008.flmjzp (mgr.14640) 2335 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:45.459564+0000 mgr.smithi008.flmjzp (mgr.14640) 2336 : cluster [DBG] pgmap v1612: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:45.459564+0000 mgr.smithi008.flmjzp (mgr.14640) 2336 : cluster [DBG] pgmap v1612: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:47.460144+0000 mgr.smithi008.flmjzp (mgr.14640) 2337 : cluster [DBG] pgmap v1613: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:47.460144+0000 mgr.smithi008.flmjzp (mgr.14640) 2337 : cluster [DBG] pgmap v1613: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:51.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:49.460808+0000 mgr.smithi008.flmjzp (mgr.14640) 2338 : cluster [DBG] pgmap v1614: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:49.460808+0000 mgr.smithi008.flmjzp (mgr.14640) 2338 : cluster [DBG] pgmap v1614: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:53.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:51.461336+0000 mgr.smithi008.flmjzp (mgr.14640) 2339 : cluster [DBG] pgmap v1615: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:51.461336+0000 mgr.smithi008.flmjzp (mgr.14640) 2339 : cluster [DBG] pgmap v1615: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:53.489883+0000 mon.smithi008 (mon.0) 2760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:53.492055+0000 mon.smithi008 (mon.0) 2761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:53.493123+0000 mon.smithi008 (mon.0) 2762 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:53.499560+0000 mon.smithi008 (mon.0) 2763 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:53.506216+0000 mon.smithi008 (mon.0) 2764 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:53.509258+0000 mon.smithi008 (mon.0) 2765 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:54.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:53.510940+0000 mon.smithi008 (mon.0) 2766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:54.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:53.512552+0000 mon.smithi008 (mon.0) 2767 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:54.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:53.514518+0000 mon.smithi008 (mon.0) 2768 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.238+0000 7f297b59e700 1 -- 172.21.15.8:0/2210108607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f297c0f77d0 msgr2=0x7f297c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.238+0000 7f297b59e700 1 --2- 172.21.15.8:0/2210108607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f297c0f77d0 0x7f297c0f7c30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f2970004660 tx=0x7f2970009b30).stop 2023-10-18T21:37:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.238+0000 7f297b59e700 1 -- 172.21.15.8:0/2210108607 shutdown_connections 2023-10-18T21:37:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.238+0000 7f297b59e700 1 --2- 172.21.15.8:0/2210108607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f297c0f77d0 0x7f297c0f7c30 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.238+0000 7f297b59e700 1 --2- 172.21.15.8:0/2210108607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f297c0f6530 0x7f297c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.238+0000 7f297b59e700 1 -- 172.21.15.8:0/2210108607 >> 172.21.15.8:0/2210108607 conn(0x7f297c0f1c90 msgr2=0x7f297c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.238+0000 7f297b59e700 1 -- 172.21.15.8:0/2210108607 shutdown_connections 2023-10-18T21:37:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.238+0000 7f297b59e700 1 -- 172.21.15.8:0/2210108607 wait complete. 2023-10-18T21:37:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.239+0000 7f297b59e700 1 Processor -- start 2023-10-18T21:37:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.239+0000 7f297b59e700 1 -- start start 2023-10-18T21:37:54.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f297b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f297c0f6530 0x7f297c108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:54.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f297b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f297c0f77d0 0x7f297c109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:54.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f297b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c1099c0 con 0x7f297c0f6530 2023-10-18T21:37:54.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f297b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c109b00 con 0x7f297c0f77d0 2023-10-18T21:37:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f297a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f297c0f6530 0x7f297c108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f297a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f297c0f6530 0x7f297c108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33174/0 (socket says 172.21.15.8:33174) 2023-10-18T21:37:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f297a59c700 1 -- 172.21.15.8:0/3745579217 learned_addr learned my addr 172.21.15.8:0/3745579217 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f2979d9b700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f297c0f77d0 0x7f297c109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f297a59c700 1 -- 172.21.15.8:0/3745579217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f297c0f77d0 msgr2=0x7f297c109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:54.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f297a59c700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f297c0f77d0 0x7f297c109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.240+0000 7f297a59c700 1 -- 172.21.15.8:0/3745579217 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970005040 con 0x7f297c0f6530 2023-10-18T21:37:54.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.241+0000 7f297a59c700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f297c0f6530 0x7f297c108f20 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f296c00e7c0 tx=0x7f296c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:54.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.241+0000 7f296affd700 1 -- 172.21.15.8:0/3745579217 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f296c0092e0 con 0x7f297c0f6530 2023-10-18T21:37:54.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.241+0000 7f296affd700 1 -- 172.21.15.8:0/3745579217 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f296c00f040 con 0x7f297c0f6530 2023-10-18T21:37:54.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.241+0000 7f296affd700 1 -- 172.21.15.8:0/3745579217 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f296c014810 con 0x7f297c0f6530 2023-10-18T21:37:54.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.241+0000 7f297b59e700 1 -- 172.21.15.8:0/3745579217 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c10a4a0 con 0x7f297c0f6530 2023-10-18T21:37:54.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.241+0000 7f297b59e700 1 -- 172.21.15.8:0/3745579217 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297c10a9e0 con 0x7f297c0f6530 2023-10-18T21:37:54.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.242+0000 7f297b59e700 1 -- 172.21.15.8:0/3745579217 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c045ad0 con 0x7f297c0f6530 2023-10-18T21:37:54.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.243+0000 7f296affd700 1 -- 172.21.15.8:0/3745579217 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f296c01b030 con 0x7f297c0f6530 2023-10-18T21:37:54.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.244+0000 7f296affd700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2964060f70 0x7f2964063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:54.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.244+0000 7f296affd700 1 -- 172.21.15.8:0/3745579217 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f296c07c7c0 con 0x7f297c0f6530 2023-10-18T21:37:54.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.244+0000 7f2979d9b700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2964060f70 0x7f2964063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:54.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.245+0000 7f2979d9b700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2964060f70 0x7f2964063430 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f2970009720 tx=0x7f2970016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:54.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.249+0000 7f296affd700 1 -- 172.21.15.8:0/3745579217 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f296c04fe60 con 0x7f297c0f6530 2023-10-18T21:37:54.295 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:53.489883+0000 mon.smithi008 (mon.0) 2760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:54.295 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:53.492055+0000 mon.smithi008 (mon.0) 2761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:37:54.295 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:53.493123+0000 mon.smithi008 (mon.0) 2762 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:37:54.296 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:53.499560+0000 mon.smithi008 (mon.0) 2763 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:37:54.296 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:53.506216+0000 mon.smithi008 (mon.0) 2764 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:37:54.296 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:53.509258+0000 mon.smithi008 (mon.0) 2765 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:54.296 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:53.510940+0000 mon.smithi008 (mon.0) 2766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:54.296 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:53.512552+0000 mon.smithi008 (mon.0) 2767 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:54.297 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:53.514518+0000 mon.smithi008 (mon.0) 2768 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:54.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.448+0000 7f297b59e700 1 -- 172.21.15.8:0/3745579217 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f297c10acb0 con 0x7f2964060f70 2023-10-18T21:37:54.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.450+0000 7f296affd700 1 -- 172.21.15.8:0/3745579217 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f297c10acb0 con 0x7f2964060f70 2023-10-18T21:37:54.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.452+0000 7f297b59e700 1 -- 172.21.15.8:0/3745579217 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2964060f70 msgr2=0x7f2964063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.452+0000 7f297b59e700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2964060f70 0x7f2964063430 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f2970009720 tx=0x7f2970016040).stop 2023-10-18T21:37:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.452+0000 7f297b59e700 1 -- 172.21.15.8:0/3745579217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f297c0f6530 msgr2=0x7f297c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.452+0000 7f297b59e700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f297c0f6530 0x7f297c108f20 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f296c00e7c0 tx=0x7f296c00b040).stop 2023-10-18T21:37:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.452+0000 7f297b59e700 1 -- 172.21.15.8:0/3745579217 shutdown_connections 2023-10-18T21:37:54.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.452+0000 7f297b59e700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2964060f70 0x7f2964063430 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.452+0000 7f297b59e700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f297c0f6530 0x7f297c108f20 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.452+0000 7f297b59e700 1 --2- 172.21.15.8:0/3745579217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f297c0f77d0 0x7f297c109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.452+0000 7f297b59e700 1 -- 172.21.15.8:0/3745579217 >> 172.21.15.8:0/3745579217 conn(0x7f297c0f1c90 msgr2=0x7f297c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:54.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.453+0000 7f297b59e700 1 -- 172.21.15.8:0/3745579217 shutdown_connections 2023-10-18T21:37:54.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.453+0000 7f297b59e700 1 -- 172.21.15.8:0/3745579217 wait complete. 2023-10-18T21:37:54.469 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:37:54.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.590+0000 7fa800f85700 1 -- 172.21.15.8:0/1386243035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7fc0f77d0 msgr2=0x7fa7fc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:54.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.590+0000 7fa800f85700 1 --2- 172.21.15.8:0/1386243035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7fc0f77d0 0x7fa7fc0f7c30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fa7f0004660 tx=0x7fa7f0009b30).stop 2023-10-18T21:37:54.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.590+0000 7fa800f85700 1 -- 172.21.15.8:0/1386243035 shutdown_connections 2023-10-18T21:37:54.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.590+0000 7fa800f85700 1 --2- 172.21.15.8:0/1386243035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7fc0f77d0 0x7fa7fc0f7c30 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.590+0000 7fa800f85700 1 --2- 172.21.15.8:0/1386243035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7fc0f6530 0x7fa7fc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.590+0000 7fa800f85700 1 -- 172.21.15.8:0/1386243035 >> 172.21.15.8:0/1386243035 conn(0x7fa7fc0f1c90 msgr2=0x7fa7fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:54.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.590+0000 7fa800f85700 1 -- 172.21.15.8:0/1386243035 shutdown_connections 2023-10-18T21:37:54.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.590+0000 7fa800f85700 1 -- 172.21.15.8:0/1386243035 wait complete. 2023-10-18T21:37:54.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.591+0000 7fa800f85700 1 Processor -- start 2023-10-18T21:37:54.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.591+0000 7fa800f85700 1 -- start start 2023-10-18T21:37:54.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa800f85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7fc0f6530 0x7fa7fc108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:54.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa800f85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7fc0f77d0 0x7fa7fc109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa800f85700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc109a20 con 0x7fa7fc0f6530 2023-10-18T21:37:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa800f85700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc109b60 con 0x7fa7fc0f77d0 2023-10-18T21:37:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa7fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7fc0f6530 0x7fa7fc108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa7fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7fc0f6530 0x7fa7fc108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33186/0 (socket says 172.21.15.8:33186) 2023-10-18T21:37:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa7fb7fe700 1 -- 172.21.15.8:0/1123823748 learned_addr learned my addr 172.21.15.8:0/1123823748 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:54.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa7faffd700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7fc0f77d0 0x7fa7fc109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:54.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa7fb7fe700 1 -- 172.21.15.8:0/1123823748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7fc0f77d0 msgr2=0x7fa7fc109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:54.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa7fb7fe700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7fc0f77d0 0x7fa7fc109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.592+0000 7fa7fb7fe700 1 -- 172.21.15.8:0/1123823748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0005040 con 0x7fa7fc0f6530 2023-10-18T21:37:54.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.593+0000 7fa7fb7fe700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7fc0f6530 0x7fa7fc108f80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fa7ec002700 tx=0x7fa7ec009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:54.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.593+0000 7fa7e3fff700 1 -- 172.21.15.8:0/1123823748 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7ec009320 con 0x7fa7fc0f6530 2023-10-18T21:37:54.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.593+0000 7fa7e3fff700 1 -- 172.21.15.8:0/1123823748 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa7ec00f040 con 0x7fa7fc0f6530 2023-10-18T21:37:54.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.593+0000 7fa7e3fff700 1 -- 172.21.15.8:0/1123823748 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7ec014970 con 0x7fa7fc0f6530 2023-10-18T21:37:54.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.593+0000 7fa800f85700 1 -- 172.21.15.8:0/1123823748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7fc10a500 con 0x7fa7fc0f6530 2023-10-18T21:37:54.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.593+0000 7fa800f85700 1 -- 172.21.15.8:0/1123823748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7fc10aac0 con 0x7fa7fc0f6530 2023-10-18T21:37:54.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.594+0000 7fa800f85700 1 -- 172.21.15.8:0/1123823748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7fc045ad0 con 0x7fa7fc0f6530 2023-10-18T21:37:54.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.595+0000 7fa7e3fff700 1 -- 172.21.15.8:0/1123823748 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa7ec009480 con 0x7fa7fc0f6530 2023-10-18T21:37:54.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.596+0000 7fa7e3fff700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa7e4060f70 0x7fa7e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:54.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.596+0000 7fa7e3fff700 1 -- 172.21.15.8:0/1123823748 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa7ec07cad0 con 0x7fa7fc0f6530 2023-10-18T21:37:54.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.596+0000 7fa7faffd700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa7e4060f70 0x7fa7e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:54.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.597+0000 7fa7faffd700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa7e4060f70 0x7fa7e4063430 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fa7f0004630 tx=0x7fa7f0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:54.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.600+0000 7fa7e3fff700 1 -- 172.21.15.8:0/1123823748 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa7ec0501f0 con 0x7fa7fc0f6530 2023-10-18T21:37:54.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.798+0000 7fa800f85700 1 -- 172.21.15.8:0/1123823748 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7fc10ad90 con 0x7fa7e4060f70 2023-10-18T21:37:54.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.799+0000 7fa7e3fff700 1 -- 172.21.15.8:0/1123823748 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa7fc10ad90 con 0x7fa7e4060f70 2023-10-18T21:37:54.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.801+0000 7fa800f85700 1 -- 172.21.15.8:0/1123823748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa7e4060f70 msgr2=0x7fa7e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:54.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.801+0000 7fa800f85700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa7e4060f70 0x7fa7e4063430 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fa7f0004630 tx=0x7fa7f0009b30).stop 2023-10-18T21:37:54.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.802+0000 7fa800f85700 1 -- 172.21.15.8:0/1123823748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7fc0f6530 msgr2=0x7fa7fc108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:54.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.802+0000 7fa800f85700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7fc0f6530 0x7fa7fc108f80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fa7ec002700 tx=0x7fa7ec009d80).stop 2023-10-18T21:37:54.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.802+0000 7fa800f85700 1 -- 172.21.15.8:0/1123823748 shutdown_connections 2023-10-18T21:37:54.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.802+0000 7fa800f85700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa7e4060f70 0x7fa7e4063430 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.802+0000 7fa800f85700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7fc0f6530 0x7fa7fc108f80 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.802+0000 7fa800f85700 1 --2- 172.21.15.8:0/1123823748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7fc0f77d0 0x7fa7fc109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.802+0000 7fa800f85700 1 -- 172.21.15.8:0/1123823748 >> 172.21.15.8:0/1123823748 conn(0x7fa7fc0f1c90 msgr2=0x7fa7fc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:54.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.802+0000 7fa800f85700 1 -- 172.21.15.8:0/1123823748 shutdown_connections 2023-10-18T21:37:54.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.802+0000 7fa800f85700 1 -- 172.21.15.8:0/1123823748 wait complete. 2023-10-18T21:37:54.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.939+0000 7f5047fff700 1 -- 172.21.15.8:0/2234343938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50480f6530 msgr2=0x7f50480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:54.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.939+0000 7f5047fff700 1 --2- 172.21.15.8:0/2234343938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50480f6530 0x7f50480f6950 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f5038004660 tx=0x7f5038009b30).stop 2023-10-18T21:37:54.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.939+0000 7f5047fff700 1 -- 172.21.15.8:0/2234343938 shutdown_connections 2023-10-18T21:37:54.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.939+0000 7f5047fff700 1 --2- 172.21.15.8:0/2234343938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50480f77d0 0x7f50480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.939+0000 7f5047fff700 1 --2- 172.21.15.8:0/2234343938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50480f6530 0x7f50480f6950 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.939+0000 7f5047fff700 1 -- 172.21.15.8:0/2234343938 >> 172.21.15.8:0/2234343938 conn(0x7f50480f1c90 msgr2=0x7f50480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:54.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.940+0000 7f5047fff700 1 -- 172.21.15.8:0/2234343938 shutdown_connections 2023-10-18T21:37:54.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.940+0000 7f5047fff700 1 -- 172.21.15.8:0/2234343938 wait complete. 2023-10-18T21:37:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.940+0000 7f5047fff700 1 Processor -- start 2023-10-18T21:37:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.940+0000 7f5047fff700 1 -- start start 2023-10-18T21:37:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.941+0000 7f5047fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50480f6530 0x7f5048108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.941+0000 7f5047fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50480f77d0 0x7f5048109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:54.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.941+0000 7f5047fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048109a00 con 0x7f50480f77d0 2023-10-18T21:37:54.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.941+0000 7f5047fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048109b40 con 0x7f50480f6530 2023-10-18T21:37:54.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.941+0000 7f50467fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50480f77d0 0x7f5048109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:54.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.941+0000 7f50467fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50480f77d0 0x7f5048109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33210/0 (socket says 172.21.15.8:33210) 2023-10-18T21:37:54.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.941+0000 7f50467fc700 1 -- 172.21.15.8:0/612845771 learned_addr learned my addr 172.21.15.8:0/612845771 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:54.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.941+0000 7f5046ffd700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50480f6530 0x7f5048108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.941+0000 7f50467fc700 1 -- 172.21.15.8:0/612845771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50480f6530 msgr2=0x7f5048108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.941+0000 7f50467fc700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50480f6530 0x7f5048108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.942+0000 7f50467fc700 1 -- 172.21.15.8:0/612845771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038005040 con 0x7f50480f77d0 2023-10-18T21:37:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.942+0000 7f50467fc700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50480f77d0 0x7f5048109450 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f503c002700 tx=0x7f503c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.942+0000 7f502f7fe700 1 -- 172.21.15.8:0/612845771 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f503c009320 con 0x7f50480f77d0 2023-10-18T21:37:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.942+0000 7f502f7fe700 1 -- 172.21.15.8:0/612845771 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f503c00f040 con 0x7f50480f77d0 2023-10-18T21:37:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.942+0000 7f5047fff700 1 -- 172.21.15.8:0/612845771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504810a4e0 con 0x7f50480f77d0 2023-10-18T21:37:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.942+0000 7f502f7fe700 1 -- 172.21.15.8:0/612845771 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f503c0148f0 con 0x7f50480f77d0 2023-10-18T21:37:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.942+0000 7f5047fff700 1 -- 172.21.15.8:0/612845771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504810aaa0 con 0x7f50480f77d0 2023-10-18T21:37:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.943+0000 7f5047fff700 1 -- 172.21.15.8:0/612845771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5048045ad0 con 0x7f50480f77d0 2023-10-18T21:37:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.944+0000 7f502f7fe700 1 -- 172.21.15.8:0/612845771 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f503c009480 con 0x7f50480f77d0 2023-10-18T21:37:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.945+0000 7f502f7fe700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5030060f70 0x7f5030063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.945+0000 7f502f7fe700 1 -- 172.21.15.8:0/612845771 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f503c07cc50 con 0x7f50480f77d0 2023-10-18T21:37:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.945+0000 7f5046ffd700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5030060f70 0x7f5030063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.946+0000 7f5046ffd700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5030060f70 0x7f5030063430 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f5038004630 tx=0x7f5038009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:54.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:54.949+0000 7f502f7fe700 1 -- 172.21.15.8:0/612845771 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f503c050230 con 0x7f50480f77d0 2023-10-18T21:37:55.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.142+0000 7f5047fff700 1 -- 172.21.15.8:0/612845771 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f50480fee40 con 0x7f5030060f70 2023-10-18T21:37:55.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.151+0000 7f502f7fe700 1 -- 172.21.15.8:0/612845771 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f50480fee40 con 0x7f5030060f70 2023-10-18T21:37:55.153 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:37:55.154 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (44m) 2m ago 46m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:37:55.154 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (38m) 2m ago 46m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:37:55.154 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (38m) 11s ago 45m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:37:55.154 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (44m) 2m ago 45m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:37:55.154 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 42m - - 2023-10-18T21:37:55.155 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 42m - - 2023-10-18T21:37:55.155 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 11s ago 42m - - 2023-10-18T21:37:55.155 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 11s ago 41m - - 2023-10-18T21:37:55.155 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (39m) 2m ago 47m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:37:55.155 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (39m) 11s ago 45m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:37:55.156 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (38m) 2m ago 47m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:37:55.156 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (38m) 11s ago 45m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:37:55.156 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (45m) 2m ago 45m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:37:55.156 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (44m) 11s ago 44m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:37:55.156 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (38m) 2m ago 44m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:37:55.157 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (36m) 2m ago 44m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:37:55.157 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (35m) 2m ago 43m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:37:55.157 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (35m) 11s ago 43m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:37:55.157 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (34m) 11s ago 43m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:37:55.157 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (34m) 11s ago 43m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:37:55.157 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (40m) 2m ago 45m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:37:55.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 -- 172.21.15.8:0/612845771 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5030060f70 msgr2=0x7f5030063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:55.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5030060f70 0x7f5030063430 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f5038004630 tx=0x7f5038009b30).stop 2023-10-18T21:37:55.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 -- 172.21.15.8:0/612845771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50480f77d0 msgr2=0x7f5048109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:55.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50480f77d0 0x7f5048109450 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f503c002700 tx=0x7f503c009e00).stop 2023-10-18T21:37:55.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 -- 172.21.15.8:0/612845771 shutdown_connections 2023-10-18T21:37:55.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5030060f70 0x7f5030063430 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50480f6530 0x7f5048108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 --2- 172.21.15.8:0/612845771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50480f77d0 0x7f5048109450 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 -- 172.21.15.8:0/612845771 >> 172.21.15.8:0/612845771 conn(0x7f50480f1c90 msgr2=0x7f504806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:55.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 -- 172.21.15.8:0/612845771 shutdown_connections 2023-10-18T21:37:55.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.153+0000 7f5047fff700 1 -- 172.21.15.8:0/612845771 wait complete. 2023-10-18T21:37:55.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:53.461951+0000 mgr.smithi008.flmjzp (mgr.14640) 2340 : cluster [DBG] pgmap v1616: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:53.494026+0000 mgr.smithi008.flmjzp (mgr.14640) 2341 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:53.494629+0000 mgr.smithi008.flmjzp (mgr.14640) 2342 : cluster [DBG] pgmap v1617: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:53.494896+0000 mgr.smithi008.flmjzp (mgr.14640) 2343 : cluster [DBG] pgmap v1618: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:37:53.516513+0000 mgr.smithi008.flmjzp (mgr.14640) 2344 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:55.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.290+0000 7f577359e700 1 -- 172.21.15.8:0/1029370761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f577406b9c0 msgr2=0x7f5774069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:55.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.290+0000 7f577359e700 1 --2- 172.21.15.8:0/1029370761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f577406b9c0 0x7f5774069ec0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f5764004660 tx=0x7f5764009b30).stop 2023-10-18T21:37:55.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.290+0000 7f577359e700 1 -- 172.21.15.8:0/1029370761 shutdown_connections 2023-10-18T21:37:55.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.290+0000 7f577359e700 1 --2- 172.21.15.8:0/1029370761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f577406a3b0 0x7f577406a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.290+0000 7f577359e700 1 --2- 172.21.15.8:0/1029370761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f577406b9c0 0x7f5774069ec0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.290+0000 7f577359e700 1 -- 172.21.15.8:0/1029370761 >> 172.21.15.8:0/1029370761 conn(0x7f57740f1c90 msgr2=0x7f57740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:55.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.290+0000 7f577359e700 1 -- 172.21.15.8:0/1029370761 shutdown_connections 2023-10-18T21:37:55.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.290+0000 7f577359e700 1 -- 172.21.15.8:0/1029370761 wait complete. 2023-10-18T21:37:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.291+0000 7f577359e700 1 Processor -- start 2023-10-18T21:37:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.291+0000 7f577359e700 1 -- start start 2023-10-18T21:37:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f577359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f577406a3b0 0x7f5774108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f577359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f577406b9c0 0x7f57741094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f577359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774109a50 con 0x7f577406a3b0 2023-10-18T21:37:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f577359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774109b90 con 0x7f577406b9c0 2023-10-18T21:37:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f577259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f577406a3b0 0x7f5774108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f577259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f577406a3b0 0x7f5774108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33234/0 (socket says 172.21.15.8:33234) 2023-10-18T21:37:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f577259c700 1 -- 172.21.15.8:0/1504703909 learned_addr learned my addr 172.21.15.8:0/1504703909 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f5771d9b700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f577406b9c0 0x7f57741094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f577259c700 1 -- 172.21.15.8:0/1504703909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f577406b9c0 msgr2=0x7f57741094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f577259c700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f577406b9c0 0x7f57741094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f577259c700 1 -- 172.21.15.8:0/1504703909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5764005040 con 0x7f577406a3b0 2023-10-18T21:37:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.292+0000 7f5771d9b700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f577406b9c0 0x7f57741094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:37:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.293+0000 7f577259c700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f577406a3b0 0x7f5774108fb0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f5764009830 tx=0x7f5764009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.293+0000 7f5762ffd700 1 -- 172.21.15.8:0/1504703909 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5764018070 con 0x7f577406a3b0 2023-10-18T21:37:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.293+0000 7f5762ffd700 1 -- 172.21.15.8:0/1504703909 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f576401d8e0 con 0x7f577406a3b0 2023-10-18T21:37:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.293+0000 7f577359e700 1 -- 172.21.15.8:0/1504703909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577410a4d0 con 0x7f577406a3b0 2023-10-18T21:37:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.293+0000 7f5762ffd700 1 -- 172.21.15.8:0/1504703909 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f576401c540 con 0x7f577406a3b0 2023-10-18T21:37:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.293+0000 7f577359e700 1 -- 172.21.15.8:0/1504703909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577410aa30 con 0x7f577406a3b0 2023-10-18T21:37:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.294+0000 7f577359e700 1 -- 172.21.15.8:0/1504703909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5774045ad0 con 0x7f577406a3b0 2023-10-18T21:37:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.295+0000 7f5762ffd700 1 -- 172.21.15.8:0/1504703909 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f576401da50 con 0x7f577406a3b0 2023-10-18T21:37:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.296+0000 7f5762ffd700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f575c060f70 0x7f575c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.296+0000 7f5762ffd700 1 -- 172.21.15.8:0/1504703909 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f576407e930 con 0x7f577406a3b0 2023-10-18T21:37:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.296+0000 7f5771d9b700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f575c060f70 0x7f575c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.296+0000 7f5771d9b700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f575c060f70 0x7f575c063430 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f5768004a70 tx=0x7f5768009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.300+0000 7f5762ffd700 1 -- 172.21.15.8:0/1504703909 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5764051f10 con 0x7f577406a3b0 2023-10-18T21:37:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:53.461951+0000 mgr.smithi008.flmjzp (mgr.14640) 2340 : cluster [DBG] pgmap v1616: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:53.494026+0000 mgr.smithi008.flmjzp (mgr.14640) 2341 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:37:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:53.494629+0000 mgr.smithi008.flmjzp (mgr.14640) 2342 : cluster [DBG] pgmap v1617: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:53.494896+0000 mgr.smithi008.flmjzp (mgr.14640) 2343 : cluster [DBG] pgmap v1618: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:37:53.516513+0000 mgr.smithi008.flmjzp (mgr.14640) 2344 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:37:55.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.557+0000 7f577359e700 1 -- 172.21.15.8:0/1504703909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5774100eb0 con 0x7f577406a3b0 2023-10-18T21:37:55.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.558+0000 7f5762ffd700 1 -- 172.21.15.8:0/1504703909 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5764051b00 con 0x7f577406a3b0 2023-10-18T21:37:55.560 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:37:55.560 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:37:55.561 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:37:55.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:37:55.561 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:37:55.561 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:37:55.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:37:55.562 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:37:55.562 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:37:55.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:37:55.562 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:37:55.562 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:37:55.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:37:55.563 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:37:55.563 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:37:55.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:37:55.563 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:37:55.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 -- 172.21.15.8:0/1504703909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f575c060f70 msgr2=0x7f575c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:55.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f575c060f70 0x7f575c063430 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f5768004a70 tx=0x7f5768009040).stop 2023-10-18T21:37:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 -- 172.21.15.8:0/1504703909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f577406a3b0 msgr2=0x7f5774108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f577406a3b0 0x7f5774108fb0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f5764009830 tx=0x7f5764009b30).stop 2023-10-18T21:37:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 -- 172.21.15.8:0/1504703909 shutdown_connections 2023-10-18T21:37:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f575c060f70 0x7f575c063430 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f577406a3b0 0x7f5774108fb0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 --2- 172.21.15.8:0/1504703909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f577406b9c0 0x7f57741094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 -- 172.21.15.8:0/1504703909 >> 172.21.15.8:0/1504703909 conn(0x7f57740f1c90 msgr2=0x7f57740fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 -- 172.21.15.8:0/1504703909 shutdown_connections 2023-10-18T21:37:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.560+0000 7f577359e700 1 -- 172.21.15.8:0/1504703909 wait complete. 2023-10-18T21:37:55.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.697+0000 7f70a081c700 1 -- 172.21.15.8:0/1589411997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f709c0f77d0 msgr2=0x7f709c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:55.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.697+0000 7f70a081c700 1 --2- 172.21.15.8:0/1589411997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f709c0f77d0 0x7f709c0f7c30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f7090004660 tx=0x7f7090009b30).stop 2023-10-18T21:37:55.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.697+0000 7f70a081c700 1 -- 172.21.15.8:0/1589411997 shutdown_connections 2023-10-18T21:37:55.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.697+0000 7f70a081c700 1 --2- 172.21.15.8:0/1589411997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f709c0f77d0 0x7f709c0f7c30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.697+0000 7f70a081c700 1 --2- 172.21.15.8:0/1589411997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f709c0f6530 0x7f709c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.697+0000 7f70a081c700 1 -- 172.21.15.8:0/1589411997 >> 172.21.15.8:0/1589411997 conn(0x7f709c0f1c90 msgr2=0x7f709c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:55.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.697+0000 7f70a081c700 1 -- 172.21.15.8:0/1589411997 shutdown_connections 2023-10-18T21:37:55.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.697+0000 7f70a081c700 1 -- 172.21.15.8:0/1589411997 wait complete. 2023-10-18T21:37:55.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.698+0000 7f70a081c700 1 Processor -- start 2023-10-18T21:37:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.698+0000 7f70a081c700 1 -- start start 2023-10-18T21:37:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f70a081c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f709c0f6530 0x7f709c106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f70a081c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f709c0f77d0 0x7f709c107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f70a081c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1077d0 con 0x7f709c0f77d0 2023-10-18T21:37:55.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f70a081c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c107fd0 con 0x7f709c0f6530 2023-10-18T21:37:55.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f709a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f709c0f77d0 0x7f709c107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:55.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f709a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f709c0f77d0 0x7f709c107220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33250/0 (socket says 172.21.15.8:33250) 2023-10-18T21:37:55.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f709a59c700 1 -- 172.21.15.8:0/2917400255 learned_addr learned my addr 172.21.15.8:0/2917400255 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:55.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f709ad9d700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f709c0f6530 0x7f709c106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:55.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f709a59c700 1 -- 172.21.15.8:0/2917400255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f709c0f6530 msgr2=0x7f709c106d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:55.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f709a59c700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f709c0f6530 0x7f709c106d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.699+0000 7f709a59c700 1 -- 172.21.15.8:0/2917400255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090005040 con 0x7f709c0f77d0 2023-10-18T21:37:55.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.700+0000 7f709a59c700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f709c0f77d0 0x7f709c107220 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f7090004320 tx=0x7f709000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:55.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.700+0000 7f70837fe700 1 -- 172.21.15.8:0/2917400255 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7090019070 con 0x7f709c0f77d0 2023-10-18T21:37:55.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.700+0000 7f70837fe700 1 -- 172.21.15.8:0/2917400255 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f709001e420 con 0x7f709c0f77d0 2023-10-18T21:37:55.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.700+0000 7f70837fe700 1 -- 172.21.15.8:0/2917400255 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7090014680 con 0x7f709c0f77d0 2023-10-18T21:37:55.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.700+0000 7f70a081c700 1 -- 172.21.15.8:0/2917400255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c108250 con 0x7f709c0f77d0 2023-10-18T21:37:55.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.700+0000 7f70a081c700 1 -- 172.21.15.8:0/2917400255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c108730 con 0x7f709c0f77d0 2023-10-18T21:37:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.701+0000 7f70a081c700 1 -- 172.21.15.8:0/2917400255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c059100 con 0x7f709c0f77d0 2023-10-18T21:37:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.702+0000 7f70837fe700 1 -- 172.21.15.8:0/2917400255 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f709001e590 con 0x7f709c0f77d0 2023-10-18T21:37:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.703+0000 7f70837fe700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7084060f70 0x7f7084063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.703+0000 7f70837fe700 1 -- 172.21.15.8:0/2917400255 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f709007dd10 con 0x7f709c0f77d0 2023-10-18T21:37:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.703+0000 7f709ad9d700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7084060f70 0x7f7084063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.704+0000 7f709ad9d700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7084060f70 0x7f7084063430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f708c009fd0 tx=0x7f708c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:55.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.707+0000 7f70837fe700 1 -- 172.21.15.8:0/2917400255 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7090051310 con 0x7f709c0f77d0 2023-10-18T21:37:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.935+0000 7f70a081c700 1 -- 172.21.15.8:0/2917400255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f709c0008d0 con 0x7f709c0f77d0 2023-10-18T21:37:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.936+0000 7f70837fe700 1 -- 172.21.15.8:0/2917400255 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f7090050f00 con 0x7f709c0f77d0 2023-10-18T21:37:55.938 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:37:55.938 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:37:55.939 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:37:55.939 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:37:55.939 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:37:55.939 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:37:55.939 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:37:55.940 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:37:55.940 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:37:55.940 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:37:55.940 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:37:55.940 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:37:55.941 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:37:55.941 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:37:55.941 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:37:55.941 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:37:55.941 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:37:55.942 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:37:55.942 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:37:55.942 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:37:55.942 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:37:55.942 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:37:55.943 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:37:55.943 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:37:55.943 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:37:55.943 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:37:55.943 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:37:55.943 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:37:55.944 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:37:55.944 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:37:55.944 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:37:55.944 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:37:55.944 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:37:55.945 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 -- 172.21.15.8:0/2917400255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7084060f70 msgr2=0x7f7084063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7084060f70 0x7f7084063430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f708c009fd0 tx=0x7f708c00b040).stop 2023-10-18T21:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 -- 172.21.15.8:0/2917400255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f709c0f77d0 msgr2=0x7f709c107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:55.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f709c0f77d0 0x7f709c107220 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f7090004320 tx=0x7f709000b040).stop 2023-10-18T21:37:55.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 -- 172.21.15.8:0/2917400255 shutdown_connections 2023-10-18T21:37:55.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7084060f70 0x7f7084063430 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f709c0f6530 0x7f709c106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 --2- 172.21.15.8:0/2917400255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f709c0f77d0 0x7f709c107220 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:55.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 -- 172.21.15.8:0/2917400255 >> 172.21.15.8:0/2917400255 conn(0x7f709c0f1c90 msgr2=0x7f709c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:55.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 -- 172.21.15.8:0/2917400255 shutdown_connections 2023-10-18T21:37:55.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:55.938+0000 7f70a081c700 1 -- 172.21.15.8:0/2917400255 wait complete. 2023-10-18T21:37:55.948 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:37:56.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.076+0000 7f9e518a5700 1 -- 172.21.15.8:0/2180036873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e4c060310 msgr2=0x7f9e4c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:56.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.076+0000 7f9e518a5700 1 --2- 172.21.15.8:0/2180036873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e4c060310 0x7f9e4c0f9110 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f9e40004660 tx=0x7f9e40009b30).stop 2023-10-18T21:37:56.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.077+0000 7f9e518a5700 1 -- 172.21.15.8:0/2180036873 shutdown_connections 2023-10-18T21:37:56.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.077+0000 7f9e518a5700 1 --2- 172.21.15.8:0/2180036873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c0f9690 0x7f9e4c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:56.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.077+0000 7f9e518a5700 1 --2- 172.21.15.8:0/2180036873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e4c060310 0x7f9e4c0f9110 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:56.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.077+0000 7f9e518a5700 1 -- 172.21.15.8:0/2180036873 >> 172.21.15.8:0/2180036873 conn(0x7f9e4c0f0b90 msgr2=0x7f9e4c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:56.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.077+0000 7f9e518a5700 1 -- 172.21.15.8:0/2180036873 shutdown_connections 2023-10-18T21:37:56.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.077+0000 7f9e518a5700 1 -- 172.21.15.8:0/2180036873 wait complete. 2023-10-18T21:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.078+0000 7f9e518a5700 1 Processor -- start 2023-10-18T21:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.078+0000 7f9e518a5700 1 -- start start 2023-10-18T21:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e518a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c060310 0x7f9e4c108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e518a5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e4c0f9690 0x7f9e4c109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e518a5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c109a30 con 0x7f9e4c0f9690 2023-10-18T21:37:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e518a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c109b70 con 0x7f9e4c060310 2023-10-18T21:37:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e4bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e4c0f9690 0x7f9e4c109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:56.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e4bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e4c0f9690 0x7f9e4c109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33270/0 (socket says 172.21.15.8:33270) 2023-10-18T21:37:56.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e4bfff700 1 -- 172.21.15.8:0/1140271902 learned_addr learned my addr 172.21.15.8:0/1140271902 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:37:56.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e508a3700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c060310 0x7f9e4c108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:56.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e4bfff700 1 -- 172.21.15.8:0/1140271902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c060310 msgr2=0x7f9e4c108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:56.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e4bfff700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c060310 0x7f9e4c108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e4bfff700 1 -- 172.21.15.8:0/1140271902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40005040 con 0x7f9e4c0f9690 2023-10-18T21:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.079+0000 7f9e508a3700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c060310 0x7f9e4c108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.080+0000 7f9e4bfff700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e4c0f9690 0x7f9e4c109480 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f9e3800c790 tx=0x7f9e38007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.080+0000 7f9e497fa700 1 -- 172.21.15.8:0/1140271902 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e3800e680 con 0x7f9e4c0f9690 2023-10-18T21:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.080+0000 7f9e497fa700 1 -- 172.21.15.8:0/1140271902 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9e3800eca0 con 0x7f9e4c0f9690 2023-10-18T21:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.080+0000 7f9e497fa700 1 -- 172.21.15.8:0/1140271902 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e38013d50 con 0x7f9e4c0f9690 2023-10-18T21:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.080+0000 7f9e518a5700 1 -- 172.21.15.8:0/1140271902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c10a510 con 0x7f9e4c0f9690 2023-10-18T21:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.080+0000 7f9e518a5700 1 -- 172.21.15.8:0/1140271902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c10aad0 con 0x7f9e4c0f9690 2023-10-18T21:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.081+0000 7f9e518a5700 1 -- 172.21.15.8:0/1140271902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c045ad0 con 0x7f9e4c0f9690 2023-10-18T21:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.082+0000 7f9e497fa700 1 -- 172.21.15.8:0/1140271902 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9e3801a060 con 0x7f9e4c0f9690 2023-10-18T21:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.083+0000 7f9e497fa700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e3c060f70 0x7f9e3c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.083+0000 7f9e497fa700 1 -- 172.21.15.8:0/1140271902 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9e3807cb10 con 0x7f9e4c0f9690 2023-10-18T21:37:56.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.083+0000 7f9e508a3700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e3c060f70 0x7f9e3c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:37:56.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.083+0000 7f9e508a3700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e3c060f70 0x7f9e3c063430 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f9e40004e30 tx=0x7f9e40009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:37:56.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.087+0000 7f9e497fa700 1 -- 172.21.15.8:0/1140271902 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9e38050170 con 0x7f9e4c0f9690 2023-10-18T21:37:56.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.285+0000 7f9e518a5700 1 -- 172.21.15.8:0/1140271902 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e4c0f5630 con 0x7f9e3c060f70 2023-10-18T21:37:56.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.287+0000 7f9e497fa700 1 -- 172.21.15.8:0/1140271902 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9e4c0f5630 con 0x7f9e3c060f70 2023-10-18T21:37:56.289 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:37:56.289 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:37:56.289 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:37:56.289 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:37:56.289 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:37:56.290 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:37:56.290 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:37:56.290 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:37:56.290 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:37:56.290 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:37:56.291 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:37:56.291 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:37:56.291 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:37:56.291 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:37:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.288+0000 7f9e518a5700 1 -- 172.21.15.8:0/1140271902 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e3c060f70 msgr2=0x7f9e3c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.288+0000 7f9e518a5700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e3c060f70 0x7f9e3c063430 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f9e40004e30 tx=0x7f9e40009b30).stop 2023-10-18T21:37:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.288+0000 7f9e518a5700 1 -- 172.21.15.8:0/1140271902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e4c0f9690 msgr2=0x7f9e4c109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:37:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.288+0000 7f9e518a5700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e4c0f9690 0x7f9e4c109480 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f9e3800c790 tx=0x7f9e38007d40).stop 2023-10-18T21:37:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.289+0000 7f9e518a5700 1 -- 172.21.15.8:0/1140271902 shutdown_connections 2023-10-18T21:37:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.289+0000 7f9e518a5700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e3c060f70 0x7f9e3c063430 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.289+0000 7f9e518a5700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c060310 0x7f9e4c108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.289+0000 7f9e518a5700 1 --2- 172.21.15.8:0/1140271902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e4c0f9690 0x7f9e4c109480 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:37:56.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.289+0000 7f9e518a5700 1 -- 172.21.15.8:0/1140271902 >> 172.21.15.8:0/1140271902 conn(0x7f9e4c0f0b90 msgr2=0x7f9e4c0f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:37:56.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.289+0000 7f9e518a5700 1 -- 172.21.15.8:0/1140271902 shutdown_connections 2023-10-18T21:37:56.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:37:56.289+0000 7f9e518a5700 1 -- 172.21.15.8:0/1140271902 wait complete. 2023-10-18T21:37:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:54.451045+0000 mgr.smithi008.flmjzp (mgr.14640) 2345 : audit [DBG] from='client.36016 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:54.800929+0000 mgr.smithi008.flmjzp (mgr.14640) 2346 : audit [DBG] from='client.36020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:55.559510+0000 mon.smithi008 (mon.0) 2769 : audit [DBG] from='client.? 172.21.15.8:0/1504703909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:55.937316+0000 mon.smithi008 (mon.0) 2770 : audit [DBG] from='client.? 172.21.15.8:0/2917400255' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:37:56.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:54.451045+0000 mgr.smithi008.flmjzp (mgr.14640) 2345 : audit [DBG] from='client.36016 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:54.800929+0000 mgr.smithi008.flmjzp (mgr.14640) 2346 : audit [DBG] from='client.36020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:55.559510+0000 mon.smithi008 (mon.0) 2769 : audit [DBG] from='client.? 172.21.15.8:0/1504703909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:37:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:55.937316+0000 mon.smithi008 (mon.0) 2770 : audit [DBG] from='client.? 172.21.15.8:0/2917400255' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:37:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:55.144304+0000 mgr.smithi008.flmjzp (mgr.14640) 2347 : audit [DBG] from='client.36024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:55.495337+0000 mgr.smithi008.flmjzp (mgr.14640) 2348 : cluster [DBG] pgmap v1619: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:57.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:55.144304+0000 mgr.smithi008.flmjzp (mgr.14640) 2347 : audit [DBG] from='client.36024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:55.495337+0000 mgr.smithi008.flmjzp (mgr.14640) 2348 : cluster [DBG] pgmap v1619: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:58.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:37:56.288028+0000 mgr.smithi008.flmjzp (mgr.14640) 2349 : audit [DBG] from='client.36036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:58.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:37:56.288028+0000 mgr.smithi008.flmjzp (mgr.14640) 2349 : audit [DBG] from='client.36036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:37:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:37:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:57.496016+0000 mgr.smithi008.flmjzp (mgr.14640) 2350 : cluster [DBG] pgmap v1620: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:37:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:37:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:57.496016+0000 mgr.smithi008.flmjzp (mgr.14640) 2350 : cluster [DBG] pgmap v1620: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:37:59.496712+0000 mgr.smithi008.flmjzp (mgr.14640) 2351 : cluster [DBG] pgmap v1621: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:37:59.496712+0000 mgr.smithi008.flmjzp (mgr.14640) 2351 : cluster [DBG] pgmap v1621: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:01.497340+0000 mgr.smithi008.flmjzp (mgr.14640) 2352 : cluster [DBG] pgmap v1622: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:02.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:01.497340+0000 mgr.smithi008.flmjzp (mgr.14640) 2352 : cluster [DBG] pgmap v1622: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:03.497945+0000 mgr.smithi008.flmjzp (mgr.14640) 2353 : cluster [DBG] pgmap v1623: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:03.527299+0000 mon.smithi008 (mon.0) 2771 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:04.087418+0000 mon.smithi008 (mon.0) 2772 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:04.088516+0000 mon.smithi008 (mon.0) 2773 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:04.095044+0000 mon.smithi008 (mon.0) 2774 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:04.101149+0000 mon.smithi008 (mon.0) 2775 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:04.103976+0000 mon.smithi008 (mon.0) 2776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:04.105464+0000 mon.smithi008 (mon.0) 2777 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:04.106839+0000 mon.smithi008 (mon.0) 2778 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:04.108634+0000 mon.smithi008 (mon.0) 2779 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:04.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:03.497945+0000 mgr.smithi008.flmjzp (mgr.14640) 2353 : cluster [DBG] pgmap v1623: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:03.527299+0000 mon.smithi008 (mon.0) 2771 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:04.087418+0000 mon.smithi008 (mon.0) 2772 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:04.088516+0000 mon.smithi008 (mon.0) 2773 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:04.095044+0000 mon.smithi008 (mon.0) 2774 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:04.101149+0000 mon.smithi008 (mon.0) 2775 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:04.103976+0000 mon.smithi008 (mon.0) 2776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:04.105464+0000 mon.smithi008 (mon.0) 2777 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:04.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:04.106839+0000 mon.smithi008 (mon.0) 2778 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:04.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:04.108634+0000 mon.smithi008 (mon.0) 2779 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:04.089337+0000 mgr.smithi008.flmjzp (mgr.14640) 2354 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:04.089984+0000 mgr.smithi008.flmjzp (mgr.14640) 2355 : cluster [DBG] pgmap v1624: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:04.090329+0000 mgr.smithi008.flmjzp (mgr.14640) 2356 : cluster [DBG] pgmap v1625: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:04.110343+0000 mgr.smithi008.flmjzp (mgr.14640) 2357 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:05.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:04.089337+0000 mgr.smithi008.flmjzp (mgr.14640) 2354 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:04.089984+0000 mgr.smithi008.flmjzp (mgr.14640) 2355 : cluster [DBG] pgmap v1624: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:04.090329+0000 mgr.smithi008.flmjzp (mgr.14640) 2356 : cluster [DBG] pgmap v1625: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:04.110343+0000 mgr.smithi008.flmjzp (mgr.14640) 2357 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:06.090920+0000 mgr.smithi008.flmjzp (mgr.14640) 2358 : cluster [DBG] pgmap v1626: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:07.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:06.090920+0000 mgr.smithi008.flmjzp (mgr.14640) 2358 : cluster [DBG] pgmap v1626: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:08.091566+0000 mgr.smithi008.flmjzp (mgr.14640) 2359 : cluster [DBG] pgmap v1627: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:09.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:08.091566+0000 mgr.smithi008.flmjzp (mgr.14640) 2359 : cluster [DBG] pgmap v1627: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:10.092387+0000 mgr.smithi008.flmjzp (mgr.14640) 2360 : cluster [DBG] pgmap v1628: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:11.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:10.092387+0000 mgr.smithi008.flmjzp (mgr.14640) 2360 : cluster [DBG] pgmap v1628: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:12.093105+0000 mgr.smithi008.flmjzp (mgr.14640) 2361 : cluster [DBG] pgmap v1629: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:13.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:12.093105+0000 mgr.smithi008.flmjzp (mgr.14640) 2361 : cluster [DBG] pgmap v1629: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:14.120625+0000 mon.smithi008 (mon.0) 2780 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:14.122686+0000 mon.smithi008 (mon.0) 2781 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:14.123671+0000 mon.smithi008 (mon.0) 2782 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:14.130033+0000 mon.smithi008 (mon.0) 2783 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:14.136713+0000 mon.smithi008 (mon.0) 2784 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:14.139889+0000 mon.smithi008 (mon.0) 2785 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:14.141795+0000 mon.smithi008 (mon.0) 2786 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:14.143387+0000 mon.smithi008 (mon.0) 2787 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:14.146094+0000 mon.smithi008 (mon.0) 2788 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:14.120625+0000 mon.smithi008 (mon.0) 2780 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:14.122686+0000 mon.smithi008 (mon.0) 2781 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:14.123671+0000 mon.smithi008 (mon.0) 2782 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:14.130033+0000 mon.smithi008 (mon.0) 2783 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:14.136713+0000 mon.smithi008 (mon.0) 2784 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:14.139889+0000 mon.smithi008 (mon.0) 2785 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:14.141795+0000 mon.smithi008 (mon.0) 2786 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:14.143387+0000 mon.smithi008 (mon.0) 2787 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:14.146094+0000 mon.smithi008 (mon.0) 2788 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:14.093726+0000 mgr.smithi008.flmjzp (mgr.14640) 2362 : cluster [DBG] pgmap v1630: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:14.124578+0000 mgr.smithi008.flmjzp (mgr.14640) 2363 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:14.125146+0000 mgr.smithi008.flmjzp (mgr.14640) 2364 : cluster [DBG] pgmap v1631: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:14.125416+0000 mgr.smithi008.flmjzp (mgr.14640) 2365 : cluster [DBG] pgmap v1632: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:14.148221+0000 mgr.smithi008.flmjzp (mgr.14640) 2366 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:15.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:14.093726+0000 mgr.smithi008.flmjzp (mgr.14640) 2362 : cluster [DBG] pgmap v1630: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:14.124578+0000 mgr.smithi008.flmjzp (mgr.14640) 2363 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:14.125146+0000 mgr.smithi008.flmjzp (mgr.14640) 2364 : cluster [DBG] pgmap v1631: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:14.125416+0000 mgr.smithi008.flmjzp (mgr.14640) 2365 : cluster [DBG] pgmap v1632: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:15.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:14.148221+0000 mgr.smithi008.flmjzp (mgr.14640) 2366 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:16.125959+0000 mgr.smithi008.flmjzp (mgr.14640) 2367 : cluster [DBG] pgmap v1633: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:17.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:16.125959+0000 mgr.smithi008.flmjzp (mgr.14640) 2367 : cluster [DBG] pgmap v1633: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:18.126614+0000 mgr.smithi008.flmjzp (mgr.14640) 2368 : cluster [DBG] pgmap v1634: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:18.126614+0000 mgr.smithi008.flmjzp (mgr.14640) 2368 : cluster [DBG] pgmap v1634: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:20.127281+0000 mgr.smithi008.flmjzp (mgr.14640) 2369 : cluster [DBG] pgmap v1635: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:21.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:20.127281+0000 mgr.smithi008.flmjzp (mgr.14640) 2369 : cluster [DBG] pgmap v1635: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:22.128033+0000 mgr.smithi008.flmjzp (mgr.14640) 2370 : cluster [DBG] pgmap v1636: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:23.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:22.128033+0000 mgr.smithi008.flmjzp (mgr.14640) 2370 : cluster [DBG] pgmap v1636: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:24.158992+0000 mon.smithi008 (mon.0) 2789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:24.161177+0000 mon.smithi008 (mon.0) 2790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:24.162207+0000 mon.smithi008 (mon.0) 2791 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:24.168684+0000 mon.smithi008 (mon.0) 2792 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:24.175169+0000 mon.smithi008 (mon.0) 2793 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:24.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:24.178340+0000 mon.smithi008 (mon.0) 2794 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:24.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:24.180029+0000 mon.smithi008 (mon.0) 2795 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:24.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:24.181617+0000 mon.smithi008 (mon.0) 2796 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:24.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:24.183603+0000 mon.smithi008 (mon.0) 2797 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:24.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:24.158992+0000 mon.smithi008 (mon.0) 2789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:24.161177+0000 mon.smithi008 (mon.0) 2790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:24.162207+0000 mon.smithi008 (mon.0) 2791 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:24.168684+0000 mon.smithi008 (mon.0) 2792 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:24.175169+0000 mon.smithi008 (mon.0) 2793 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:24.178340+0000 mon.smithi008 (mon.0) 2794 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:24.180029+0000 mon.smithi008 (mon.0) 2795 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:24.181617+0000 mon.smithi008 (mon.0) 2796 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:24.183603+0000 mon.smithi008 (mon.0) 2797 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:24.128597+0000 mgr.smithi008.flmjzp (mgr.14640) 2371 : cluster [DBG] pgmap v1637: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:24.163083+0000 mgr.smithi008.flmjzp (mgr.14640) 2372 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:24.163795+0000 mgr.smithi008.flmjzp (mgr.14640) 2373 : cluster [DBG] pgmap v1638: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:24.164171+0000 mgr.smithi008.flmjzp (mgr.14640) 2374 : cluster [DBG] pgmap v1639: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:25.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:24.185434+0000 mgr.smithi008.flmjzp (mgr.14640) 2375 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:25.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:24.128597+0000 mgr.smithi008.flmjzp (mgr.14640) 2371 : cluster [DBG] pgmap v1637: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:24.163083+0000 mgr.smithi008.flmjzp (mgr.14640) 2372 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:24.163795+0000 mgr.smithi008.flmjzp (mgr.14640) 2373 : cluster [DBG] pgmap v1638: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:24.164171+0000 mgr.smithi008.flmjzp (mgr.14640) 2374 : cluster [DBG] pgmap v1639: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:24.185434+0000 mgr.smithi008.flmjzp (mgr.14640) 2375 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:26.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.441+0000 7fe484bd4700 1 -- 172.21.15.8:0/3719155803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4800f77d0 msgr2=0x7fe4800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:26.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.441+0000 7fe484bd4700 1 --2- 172.21.15.8:0/3719155803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4800f77d0 0x7fe4800f7c30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fe474004660 tx=0x7fe474009b30).stop 2023-10-18T21:38:26.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.441+0000 7fe484bd4700 1 -- 172.21.15.8:0/3719155803 shutdown_connections 2023-10-18T21:38:26.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.441+0000 7fe484bd4700 1 --2- 172.21.15.8:0/3719155803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4800f77d0 0x7fe4800f7c30 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:26.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.441+0000 7fe484bd4700 1 --2- 172.21.15.8:0/3719155803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4800f6530 0x7fe4800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:26.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.441+0000 7fe484bd4700 1 -- 172.21.15.8:0/3719155803 >> 172.21.15.8:0/3719155803 conn(0x7fe4800f1c90 msgr2=0x7fe4800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:26.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.441+0000 7fe484bd4700 1 -- 172.21.15.8:0/3719155803 shutdown_connections 2023-10-18T21:38:26.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.441+0000 7fe484bd4700 1 -- 172.21.15.8:0/3719155803 wait complete. 2023-10-18T21:38:26.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.442+0000 7fe484bd4700 1 Processor -- start 2023-10-18T21:38:26.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.442+0000 7fe484bd4700 1 -- start start 2023-10-18T21:38:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe484bd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4800f6530 0x7fe480106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe484bd4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4800f77d0 0x7fe480107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe484bd4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480107850 con 0x7fe4800f77d0 2023-10-18T21:38:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe484bd4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480108060 con 0x7fe4800f6530 2023-10-18T21:38:26.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe47effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4800f77d0 0x7fe480107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:26.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe47effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4800f77d0 0x7fe480107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34008/0 (socket says 172.21.15.8:34008) 2023-10-18T21:38:26.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe47effd700 1 -- 172.21.15.8:0/1663225986 learned_addr learned my addr 172.21.15.8:0/1663225986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:38:26.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe47f7fe700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4800f6530 0x7fe480106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:26.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe47effd700 1 -- 172.21.15.8:0/1663225986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4800f6530 msgr2=0x7fe480106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:26.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe47effd700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4800f6530 0x7fe480106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:26.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.443+0000 7fe47effd700 1 -- 172.21.15.8:0/1663225986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe474005040 con 0x7fe4800f77d0 2023-10-18T21:38:26.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.444+0000 7fe47effd700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4800f77d0 0x7fe480107250 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fe474004320 tx=0x7fe47400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:26.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.444+0000 7fe467fff700 1 -- 172.21.15.8:0/1663225986 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe474019070 con 0x7fe4800f77d0 2023-10-18T21:38:26.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.444+0000 7fe467fff700 1 -- 172.21.15.8:0/1663225986 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe47401e420 con 0x7fe4800f77d0 2023-10-18T21:38:26.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.444+0000 7fe484bd4700 1 -- 172.21.15.8:0/1663225986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480108280 con 0x7fe4800f77d0 2023-10-18T21:38:26.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.444+0000 7fe467fff700 1 -- 172.21.15.8:0/1663225986 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe474014660 con 0x7fe4800f77d0 2023-10-18T21:38:26.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.444+0000 7fe484bd4700 1 -- 172.21.15.8:0/1663225986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe480108760 con 0x7fe4800f77d0 2023-10-18T21:38:26.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.445+0000 7fe484bd4700 1 -- 172.21.15.8:0/1663225986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe480059100 con 0x7fe4800f77d0 2023-10-18T21:38:26.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.446+0000 7fe467fff700 1 -- 172.21.15.8:0/1663225986 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe47401e590 con 0x7fe4800f77d0 2023-10-18T21:38:26.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.447+0000 7fe467fff700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe468060f70 0x7fe468063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:26.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.447+0000 7fe467fff700 1 -- 172.21.15.8:0/1663225986 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe47407dec0 con 0x7fe4800f77d0 2023-10-18T21:38:26.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.448+0000 7fe47f7fe700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe468060f70 0x7fe468063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:26.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.448+0000 7fe47f7fe700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe468060f70 0x7fe468063430 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fe480106ad0 tx=0x7fe47000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:26.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.452+0000 7fe467fff700 1 -- 172.21.15.8:0/1663225986 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe47404da10 con 0x7fe4800f77d0 2023-10-18T21:38:26.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.654+0000 7fe484bd4700 1 -- 172.21.15.8:0/1663225986 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4800fee30 con 0x7fe468060f70 2023-10-18T21:38:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.655+0000 7fe467fff700 1 -- 172.21.15.8:0/1663225986 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe4800fee30 con 0x7fe468060f70 2023-10-18T21:38:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 -- 172.21.15.8:0/1663225986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe468060f70 msgr2=0x7fe468063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe468060f70 0x7fe468063430 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fe480106ad0 tx=0x7fe47000b040).stop 2023-10-18T21:38:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 -- 172.21.15.8:0/1663225986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4800f77d0 msgr2=0x7fe480107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4800f77d0 0x7fe480107250 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fe474004320 tx=0x7fe47400b040).stop 2023-10-18T21:38:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 -- 172.21.15.8:0/1663225986 shutdown_connections 2023-10-18T21:38:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe468060f70 0x7fe468063430 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4800f6530 0x7fe480106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 --2- 172.21.15.8:0/1663225986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4800f77d0 0x7fe480107250 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 -- 172.21.15.8:0/1663225986 >> 172.21.15.8:0/1663225986 conn(0x7fe4800f1c90 msgr2=0x7fe4800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:26.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 -- 172.21.15.8:0/1663225986 shutdown_connections 2023-10-18T21:38:26.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.657+0000 7fe484bd4700 1 -- 172.21.15.8:0/1663225986 wait complete. 2023-10-18T21:38:26.673 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:38:26.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.794+0000 7f2ad3fff700 1 -- 172.21.15.8:0/1573891315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad40f77d0 msgr2=0x7f2ad40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.794+0000 7f2ad3fff700 1 --2- 172.21.15.8:0/1573891315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad40f77d0 0x7f2ad40f7c30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f2ac8004660 tx=0x7f2ac8009b30).stop 2023-10-18T21:38:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.794+0000 7f2ad3fff700 1 -- 172.21.15.8:0/1573891315 shutdown_connections 2023-10-18T21:38:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.794+0000 7f2ad3fff700 1 --2- 172.21.15.8:0/1573891315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad40f77d0 0x7f2ad40f7c30 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.794+0000 7f2ad3fff700 1 --2- 172.21.15.8:0/1573891315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad40f6530 0x7f2ad40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.794+0000 7f2ad3fff700 1 -- 172.21.15.8:0/1573891315 >> 172.21.15.8:0/1573891315 conn(0x7f2ad40f1c90 msgr2=0x7f2ad40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.794+0000 7f2ad3fff700 1 -- 172.21.15.8:0/1573891315 shutdown_connections 2023-10-18T21:38:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.794+0000 7f2ad3fff700 1 -- 172.21.15.8:0/1573891315 wait complete. 2023-10-18T21:38:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.795+0000 7f2ad3fff700 1 Processor -- start 2023-10-18T21:38:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.795+0000 7f2ad3fff700 1 -- start start 2023-10-18T21:38:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad40f6530 0x7f2ad4108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad40f77d0 0x7f2ad4109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4109a20 con 0x7f2ad40f6530 2023-10-18T21:38:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4109b60 con 0x7f2ad40f77d0 2023-10-18T21:38:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad40f6530 0x7f2ad4108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad40f6530 0x7f2ad4108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34028/0 (socket says 172.21.15.8:34028) 2023-10-18T21:38:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad2ffd700 1 -- 172.21.15.8:0/4040065891 learned_addr learned my addr 172.21.15.8:0/4040065891 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:38:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad27fc700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad40f77d0 0x7f2ad4109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad2ffd700 1 -- 172.21.15.8:0/4040065891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad40f77d0 msgr2=0x7f2ad4109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad2ffd700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad40f77d0 0x7f2ad4109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad2ffd700 1 -- 172.21.15.8:0/4040065891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8005040 con 0x7f2ad40f6530 2023-10-18T21:38:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.796+0000 7f2ad27fc700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad40f77d0 0x7f2ad4109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:38:26.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.797+0000 7f2ad2ffd700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad40f6530 0x7f2ad4108f80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f2ac400c790 tx=0x7f2ac4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:26.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.797+0000 7f2abb7fe700 1 -- 172.21.15.8:0/4040065891 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac400e680 con 0x7f2ad40f6530 2023-10-18T21:38:26.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.797+0000 7f2abb7fe700 1 -- 172.21.15.8:0/4040065891 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2ac400eca0 con 0x7f2ad40f6530 2023-10-18T21:38:26.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.797+0000 7f2abb7fe700 1 -- 172.21.15.8:0/4040065891 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac4012d80 con 0x7f2ad40f6530 2023-10-18T21:38:26.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.797+0000 7f2ad3fff700 1 -- 172.21.15.8:0/4040065891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad410a500 con 0x7f2ad40f6530 2023-10-18T21:38:26.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.797+0000 7f2ad3fff700 1 -- 172.21.15.8:0/4040065891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad410aac0 con 0x7f2ad40f6530 2023-10-18T21:38:26.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.798+0000 7f2ad3fff700 1 -- 172.21.15.8:0/4040065891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad4045ad0 con 0x7f2ad40f6530 2023-10-18T21:38:26.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.799+0000 7f2abb7fe700 1 -- 172.21.15.8:0/4040065891 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2ac4010070 con 0x7f2ad40f6530 2023-10-18T21:38:26.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.800+0000 7f2abb7fe700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 0x7f2abc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:26.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.800+0000 7f2abb7fe700 1 -- 172.21.15.8:0/4040065891 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2ac407c9d0 con 0x7f2ad40f6530 2023-10-18T21:38:26.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.800+0000 7f2ad27fc700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 0x7f2abc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:26.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.801+0000 7f2ad27fc700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 0x7f2abc063430 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f2ac8004e30 tx=0x7f2ac8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:26.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:26.804+0000 7f2abb7fe700 1 -- 172.21.15.8:0/4040065891 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2ac4050030 con 0x7f2ad40f6530 2023-10-18T21:38:27.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.002+0000 7f2ad3fff700 1 -- 172.21.15.8:0/4040065891 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ad40fedd0 con 0x7f2abc060f70 2023-10-18T21:38:27.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.003+0000 7f2abb7fe700 1 -- 172.21.15.8:0/4040065891 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2ad40fedd0 con 0x7f2abc060f70 2023-10-18T21:38:27.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.005+0000 7f2ad3fff700 1 -- 172.21.15.8:0/4040065891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 msgr2=0x7f2abc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.005+0000 7f2ad3fff700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 0x7f2abc063430 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f2ac8004e30 tx=0x7f2ac8009b30).stop 2023-10-18T21:38:27.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.005+0000 7f2ad3fff700 1 -- 172.21.15.8:0/4040065891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad40f6530 msgr2=0x7f2ad4108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.005+0000 7f2ad3fff700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad40f6530 0x7f2ad4108f80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f2ac400c790 tx=0x7f2ac4007d90).stop 2023-10-18T21:38:27.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.005+0000 7f2ad3fff700 1 -- 172.21.15.8:0/4040065891 shutdown_connections 2023-10-18T21:38:27.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.005+0000 7f2ad3fff700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 0x7f2abc063430 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.005+0000 7f2ad3fff700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad40f6530 0x7f2ad4108f80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.005+0000 7f2ad3fff700 1 --2- 172.21.15.8:0/4040065891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad40f77d0 0x7f2ad4109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.005+0000 7f2ad3fff700 1 -- 172.21.15.8:0/4040065891 >> 172.21.15.8:0/4040065891 conn(0x7f2ad40f1c90 msgr2=0x7f2ad406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:27.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.006+0000 7f2ad3fff700 1 -- 172.21.15.8:0/4040065891 shutdown_connections 2023-10-18T21:38:27.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.006+0000 7f2ad3fff700 1 -- 172.21.15.8:0/4040065891 wait complete. 2023-10-18T21:38:27.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.147+0000 7f81e5586700 1 -- 172.21.15.8:0/428272492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81e00f77d0 msgr2=0x7f81e00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.147+0000 7f81e5586700 1 --2- 172.21.15.8:0/428272492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81e00f77d0 0x7f81e00f7c30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f81d4004660 tx=0x7f81d4009b30).stop 2023-10-18T21:38:27.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.147+0000 7f81e5586700 1 -- 172.21.15.8:0/428272492 shutdown_connections 2023-10-18T21:38:27.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.147+0000 7f81e5586700 1 --2- 172.21.15.8:0/428272492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81e00f77d0 0x7f81e00f7c30 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.147+0000 7f81e5586700 1 --2- 172.21.15.8:0/428272492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81e00f6530 0x7f81e00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.147+0000 7f81e5586700 1 -- 172.21.15.8:0/428272492 >> 172.21.15.8:0/428272492 conn(0x7f81e00f1c90 msgr2=0x7f81e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:27.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.147+0000 7f81e5586700 1 -- 172.21.15.8:0/428272492 shutdown_connections 2023-10-18T21:38:27.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.147+0000 7f81e5586700 1 -- 172.21.15.8:0/428272492 wait complete. 2023-10-18T21:38:27.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.148+0000 7f81e5586700 1 Processor -- start 2023-10-18T21:38:27.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.148+0000 7f81e5586700 1 -- start start 2023-10-18T21:38:27.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.148+0000 7f81e5586700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81e00f6530 0x7f81e006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:27.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.148+0000 7f81e5586700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81e00f77d0 0x7f81e0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:27.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.148+0000 7f81e5586700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e006a380 con 0x7f81e00f6530 2023-10-18T21:38:27.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.148+0000 7f81e5586700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e006a4c0 con 0x7f81e00f77d0 2023-10-18T21:38:27.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.149+0000 7f81dffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81e00f6530 0x7f81e006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:27.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.149+0000 7f81dffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81e00f6530 0x7f81e006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60828/0 (socket says 172.21.15.8:60828) 2023-10-18T21:38:27.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.149+0000 7f81dffff700 1 -- 172.21.15.8:0/1704498895 learned_addr learned my addr 172.21.15.8:0/1704498895 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:38:27.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.149+0000 7f81dffff700 1 -- 172.21.15.8:0/1704498895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81e00f77d0 msgr2=0x7f81e0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.149+0000 7f81dffff700 1 --2- 172.21.15.8:0/1704498895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81e00f77d0 0x7f81e0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:38:27.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.149+0000 7f81dffff700 1 -- 172.21.15.8:0/1704498895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4005040 con 0x7f81e00f6530 2023-10-18T21:38:27.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.149+0000 7f81dffff700 1 --2- 172.21.15.8:0/1704498895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81e00f6530 0x7f81e006b9a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f81d0002700 tx=0x7f81d0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:27.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.149+0000 7f81dcff9700 1 -- 172.21.15.8:0/1704498895 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d0009320 con 0x7f81e00f6530 2023-10-18T21:38:27.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.150+0000 7f81dcff9700 1 -- 172.21.15.8:0/1704498895 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f81d000f040 con 0x7f81e00f6530 2023-10-18T21:38:27.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.150+0000 7f81dcff9700 1 -- 172.21.15.8:0/1704498895 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d0014950 con 0x7f81e00f6530 2023-10-18T21:38:27.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.150+0000 7f81e5586700 1 -- 172.21.15.8:0/1704498895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e006a7a0 con 0x7f81e00f6530 2023-10-18T21:38:27.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.150+0000 7f81e5586700 1 -- 172.21.15.8:0/1704498895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e010ecc0 con 0x7f81e00f6530 2023-10-18T21:38:27.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.151+0000 7f81e5586700 1 -- 172.21.15.8:0/1704498895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e0045ad0 con 0x7f81e00f6530 2023-10-18T21:38:27.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.152+0000 7f81dcff9700 1 -- 172.21.15.8:0/1704498895 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f81d0009480 con 0x7f81e00f6530 2023-10-18T21:38:27.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.152+0000 7f81dcff9700 1 --2- 172.21.15.8:0/1704498895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81c8060f70 0x7f81c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:27.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.152+0000 7f81dcff9700 1 -- 172.21.15.8:0/1704498895 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f81d007cc70 con 0x7f81e00f6530 2023-10-18T21:38:27.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.153+0000 7f81df7fe700 1 --2- 172.21.15.8:0/1704498895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81c8060f70 0x7f81c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:27.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.153+0000 7f81df7fe700 1 --2- 172.21.15.8:0/1704498895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81c8060f70 0x7f81c8063430 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f81d4009f50 tx=0x7f81d4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:27.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.156+0000 7f81dcff9700 1 -- 172.21.15.8:0/1704498895 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f81d0083080 con 0x7f81e00f6530 2023-10-18T21:38:27.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.348+0000 7f81e5586700 1 -- 172.21.15.8:0/1704498895 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f81e00fee30 con 0x7f81c8060f70 2023-10-18T21:38:27.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.358+0000 7f81dcff9700 1 -- 172.21.15.8:0/1704498895 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f81e00fee30 con 0x7f81c8060f70 2023-10-18T21:38:27.360 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:38:27.360 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (45m) 2m ago 46m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:38:27.360 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (39m) 2m ago 46m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:38:27.360 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (38m) 43s ago 45m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:38:27.361 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (45m) 2m ago 46m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:38:27.361 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 42m - - 2023-10-18T21:38:27.361 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 42m - - 2023-10-18T21:38:27.361 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 43s ago 42m - - 2023-10-18T21:38:27.361 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 43s ago 42m - - 2023-10-18T21:38:27.362 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (40m) 2m ago 47m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:38:27.362 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (39m) 43s ago 45m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:38:27.362 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (39m) 2m ago 48m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:38:27.362 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (39m) 43s ago 45m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:38:27.362 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (46m) 2m ago 46m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:38:27.363 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (45m) 43s ago 45m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:38:27.363 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (38m) 2m ago 45m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:38:27.363 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (36m) 2m ago 44m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:38:27.363 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (36m) 2m ago 44m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:38:27.363 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (35m) 43s ago 44m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:38:27.364 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (35m) 43s ago 44m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:38:27.364 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (34m) 43s ago 43m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:38:27.364 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (40m) 2m ago 45m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:38:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 -- 172.21.15.8:0/1704498895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81c8060f70 msgr2=0x7f81c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 --2- 172.21.15.8:0/1704498895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81c8060f70 0x7f81c8063430 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f81d4009f50 tx=0x7f81d4009b30).stop 2023-10-18T21:38:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 -- 172.21.15.8:0/1704498895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81e00f6530 msgr2=0x7f81e006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 --2- 172.21.15.8:0/1704498895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81e00f6530 0x7f81e006b9a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f81d0002700 tx=0x7f81d0009e00).stop 2023-10-18T21:38:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 -- 172.21.15.8:0/1704498895 shutdown_connections 2023-10-18T21:38:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 --2- 172.21.15.8:0/1704498895 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81c8060f70 0x7f81c8063430 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 --2- 172.21.15.8:0/1704498895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81e00f6530 0x7f81e006b9a0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 --2- 172.21.15.8:0/1704498895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81e00f77d0 0x7f81e0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:38:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 -- 172.21.15.8:0/1704498895 >> 172.21.15.8:0/1704498895 conn(0x7f81e00f1c90 msgr2=0x7f81e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 -- 172.21.15.8:0/1704498895 shutdown_connections 2023-10-18T21:38:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.360+0000 7f81e5586700 1 -- 172.21.15.8:0/1704498895 wait complete. 2023-10-18T21:38:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.495+0000 7f17e759e700 1 -- 172.21.15.8:0/721960788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e80f6530 msgr2=0x7f17e80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.495+0000 7f17e759e700 1 --2- 172.21.15.8:0/721960788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e80f6530 0x7f17e80f6950 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f17d8004660 tx=0x7f17d8009b30).stop 2023-10-18T21:38:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.495+0000 7f17e759e700 1 -- 172.21.15.8:0/721960788 shutdown_connections 2023-10-18T21:38:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.495+0000 7f17e759e700 1 --2- 172.21.15.8:0/721960788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17e80f77d0 0x7f17e80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.495+0000 7f17e759e700 1 --2- 172.21.15.8:0/721960788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e80f6530 0x7f17e80f6950 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.495+0000 7f17e759e700 1 -- 172.21.15.8:0/721960788 >> 172.21.15.8:0/721960788 conn(0x7f17e80f1c90 msgr2=0x7f17e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.496+0000 7f17e759e700 1 -- 172.21.15.8:0/721960788 shutdown_connections 2023-10-18T21:38:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.496+0000 7f17e759e700 1 -- 172.21.15.8:0/721960788 wait complete. 2023-10-18T21:38:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.496+0000 7f17e759e700 1 Processor -- start 2023-10-18T21:38:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.497+0000 7f17e759e700 1 -- start start 2023-10-18T21:38:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.497+0000 7f17e759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17e80f6530 0x7f17e8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.497+0000 7f17e759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e80f77d0 0x7f17e81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.497+0000 7f17e759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8109a70 con 0x7f17e80f77d0 2023-10-18T21:38:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.497+0000 7f17e759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8109bb0 con 0x7f17e80f6530 2023-10-18T21:38:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.497+0000 7f17e5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e80f77d0 0x7f17e81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.497+0000 7f17e5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e80f77d0 0x7f17e81094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60852/0 (socket says 172.21.15.8:60852) 2023-10-18T21:38:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.497+0000 7f17e5d9b700 1 -- 172.21.15.8:0/2685311411 learned_addr learned my addr 172.21.15.8:0/2685311411 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:38:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.497+0000 7f17e659c700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17e80f6530 0x7f17e8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.498+0000 7f17e5d9b700 1 -- 172.21.15.8:0/2685311411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17e80f6530 msgr2=0x7f17e8108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.498+0000 7f17e5d9b700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17e80f6530 0x7f17e8108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.498+0000 7f17e5d9b700 1 -- 172.21.15.8:0/2685311411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8005040 con 0x7f17e80f77d0 2023-10-18T21:38:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.498+0000 7f17e5d9b700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e80f77d0 0x7f17e81094c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f17dc0026d0 tx=0x7f17dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:27.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.498+0000 7f17d6ffd700 1 -- 172.21.15.8:0/2685311411 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17dc0079c0 con 0x7f17e80f77d0 2023-10-18T21:38:27.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.498+0000 7f17d6ffd700 1 -- 172.21.15.8:0/2685311411 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f17dc00f040 con 0x7f17e80f77d0 2023-10-18T21:38:27.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.498+0000 7f17d6ffd700 1 -- 172.21.15.8:0/2685311411 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17dc014980 con 0x7f17e80f77d0 2023-10-18T21:38:27.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.498+0000 7f17e759e700 1 -- 172.21.15.8:0/2685311411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e810a550 con 0x7f17e80f77d0 2023-10-18T21:38:27.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.498+0000 7f17e759e700 1 -- 172.21.15.8:0/2685311411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e810ab10 con 0x7f17e80f77d0 2023-10-18T21:38:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.499+0000 7f17e759e700 1 -- 172.21.15.8:0/2685311411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e8045ad0 con 0x7f17e80f77d0 2023-10-18T21:38:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.500+0000 7f17d6ffd700 1 -- 172.21.15.8:0/2685311411 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f17dc0090d0 con 0x7f17e80f77d0 2023-10-18T21:38:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.501+0000 7f17d6ffd700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17d0060f70 0x7f17d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.501+0000 7f17d6ffd700 1 -- 172.21.15.8:0/2685311411 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f17dc07c8a0 con 0x7f17e80f77d0 2023-10-18T21:38:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.501+0000 7f17e659c700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17d0060f70 0x7f17d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:27.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.502+0000 7f17e659c700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17d0060f70 0x7f17d0063430 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f17d8004630 tx=0x7f17d8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:27.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.505+0000 7f17d6ffd700 1 -- 172.21.15.8:0/2685311411 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f17dc04ffb0 con 0x7f17e80f77d0 2023-10-18T21:38:27.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.759+0000 7f17e759e700 1 -- 172.21.15.8:0/2685311411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f17e8027a00 con 0x7f17e80f77d0 2023-10-18T21:38:27.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.759+0000 7f17d6ffd700 1 -- 172.21.15.8:0/2685311411 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f17dc04fba0 con 0x7f17e80f77d0 2023-10-18T21:38:27.762 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:38:27.762 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:38:27.762 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:38:27.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:38:27.763 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:38:27.763 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:38:27.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:38:27.763 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:38:27.763 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:38:27.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:38:27.764 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:38:27.764 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:38:27.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:38:27.764 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:38:27.765 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:38:27.765 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:38:27.765 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:38:27.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.761+0000 7f17e759e700 1 -- 172.21.15.8:0/2685311411 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17d0060f70 msgr2=0x7f17d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.761+0000 7f17e759e700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17d0060f70 0x7f17d0063430 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f17d8004630 tx=0x7f17d8009b30).stop 2023-10-18T21:38:27.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.761+0000 7f17e759e700 1 -- 172.21.15.8:0/2685311411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e80f77d0 msgr2=0x7f17e81094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.761+0000 7f17e759e700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e80f77d0 0x7f17e81094c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f17dc0026d0 tx=0x7f17dc009de0).stop 2023-10-18T21:38:27.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.761+0000 7f17e759e700 1 -- 172.21.15.8:0/2685311411 shutdown_connections 2023-10-18T21:38:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.761+0000 7f17e759e700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17d0060f70 0x7f17d0063430 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.761+0000 7f17e759e700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17e80f6530 0x7f17e8108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.761+0000 7f17e759e700 1 --2- 172.21.15.8:0/2685311411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17e80f77d0 0x7f17e81094c0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.761+0000 7f17e759e700 1 -- 172.21.15.8:0/2685311411 >> 172.21.15.8:0/2685311411 conn(0x7f17e80f1c90 msgr2=0x7f17e806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.762+0000 7f17e759e700 1 -- 172.21.15.8:0/2685311411 shutdown_connections 2023-10-18T21:38:27.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.762+0000 7f17e759e700 1 -- 172.21.15.8:0/2685311411 wait complete. 2023-10-18T21:38:27.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.898+0000 7fd6e52c1700 1 -- 172.21.15.8:0/3458992862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6e00f77d0 msgr2=0x7fd6e00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.898+0000 7fd6e52c1700 1 --2- 172.21.15.8:0/3458992862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6e00f77d0 0x7fd6e00f7c30 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7fd6d4004660 tx=0x7fd6d4009b30).stop 2023-10-18T21:38:27.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.898+0000 7fd6e52c1700 1 -- 172.21.15.8:0/3458992862 shutdown_connections 2023-10-18T21:38:27.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.898+0000 7fd6e52c1700 1 --2- 172.21.15.8:0/3458992862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6e00f77d0 0x7fd6e00f7c30 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.898+0000 7fd6e52c1700 1 --2- 172.21.15.8:0/3458992862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6e00f6530 0x7fd6e00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.898+0000 7fd6e52c1700 1 -- 172.21.15.8:0/3458992862 >> 172.21.15.8:0/3458992862 conn(0x7fd6e00f1c90 msgr2=0x7fd6e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:27.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.898+0000 7fd6e52c1700 1 -- 172.21.15.8:0/3458992862 shutdown_connections 2023-10-18T21:38:27.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.898+0000 7fd6e52c1700 1 -- 172.21.15.8:0/3458992862 wait complete. 2023-10-18T21:38:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.899+0000 7fd6e52c1700 1 Processor -- start 2023-10-18T21:38:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.899+0000 7fd6e52c1700 1 -- start start 2023-10-18T21:38:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6e52c1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6e00f6530 0x7fd6e0108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6e52c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6e00f77d0 0x7fd6e0109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:27.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6e52c1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e01099c0 con 0x7fd6e00f77d0 2023-10-18T21:38:27.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6e52c1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0109b00 con 0x7fd6e00f6530 2023-10-18T21:38:27.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6e00f77d0 0x7fd6e0109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:27.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6e00f77d0 0x7fd6e0109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60862/0 (socket says 172.21.15.8:60862) 2023-10-18T21:38:27.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6df7fe700 1 -- 172.21.15.8:0/1921066379 learned_addr learned my addr 172.21.15.8:0/1921066379 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:38:27.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6dffff700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6e00f6530 0x7fd6e0108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:27.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6df7fe700 1 -- 172.21.15.8:0/1921066379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6e00f6530 msgr2=0x7fd6e0108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:27.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6df7fe700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6e00f6530 0x7fd6e0108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:27.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.900+0000 7fd6df7fe700 1 -- 172.21.15.8:0/1921066379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4005040 con 0x7fd6e00f77d0 2023-10-18T21:38:27.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.901+0000 7fd6df7fe700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6e00f77d0 0x7fd6e0109410 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fd6d4004320 tx=0x7fd6d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:27.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.901+0000 7fd6dcff9700 1 -- 172.21.15.8:0/1921066379 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6d4019070 con 0x7fd6e00f77d0 2023-10-18T21:38:27.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.901+0000 7fd6dcff9700 1 -- 172.21.15.8:0/1921066379 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd6d401e420 con 0x7fd6e00f77d0 2023-10-18T21:38:27.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.901+0000 7fd6dcff9700 1 -- 172.21.15.8:0/1921066379 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6d4014660 con 0x7fd6e00f77d0 2023-10-18T21:38:27.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.901+0000 7fd6e52c1700 1 -- 172.21.15.8:0/1921066379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e010a440 con 0x7fd6e00f77d0 2023-10-18T21:38:27.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.901+0000 7fd6e52c1700 1 -- 172.21.15.8:0/1921066379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e010a920 con 0x7fd6e00f77d0 2023-10-18T21:38:27.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.902+0000 7fd6e52c1700 1 -- 172.21.15.8:0/1921066379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e0045ad0 con 0x7fd6e00f77d0 2023-10-18T21:38:27.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.903+0000 7fd6dcff9700 1 -- 172.21.15.8:0/1921066379 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd6d401e590 con 0x7fd6e00f77d0 2023-10-18T21:38:27.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.904+0000 7fd6dcff9700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd6c8060f70 0x7fd6c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:27.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.904+0000 7fd6dcff9700 1 -- 172.21.15.8:0/1921066379 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd6d407dd90 con 0x7fd6e00f77d0 2023-10-18T21:38:27.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.904+0000 7fd6dffff700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd6c8060f70 0x7fd6c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:27.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.905+0000 7fd6dffff700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd6c8060f70 0x7fd6c8063430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fd6e00f7630 tx=0x7fd6d000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:27.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:27.908+0000 7fd6dcff9700 1 -- 172.21.15.8:0/1921066379 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd6d4051390 con 0x7fd6e00f77d0 2023-10-18T21:38:27.919 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:26.164713+0000 mgr.smithi008.flmjzp (mgr.14640) 2376 : cluster [DBG] pgmap v1640: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:26.656340+0000 mgr.smithi008.flmjzp (mgr.14640) 2377 : audit [DBG] from='client.36040 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:38:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:27.004825+0000 mgr.smithi008.flmjzp (mgr.14640) 2378 : audit [DBG] from='client.36044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:38:27.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:26.164713+0000 mgr.smithi008.flmjzp (mgr.14640) 2376 : cluster [DBG] pgmap v1640: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:27.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:26.656340+0000 mgr.smithi008.flmjzp (mgr.14640) 2377 : audit [DBG] from='client.36040 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:38:27.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:27.004825+0000 mgr.smithi008.flmjzp (mgr.14640) 2378 : audit [DBG] from='client.36044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:38:28.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.132+0000 7fd6e52c1700 1 -- 172.21.15.8:0/1921066379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd6e0027a00 con 0x7fd6e00f77d0 2023-10-18T21:38:28.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.132+0000 7fd6dcff9700 1 -- 172.21.15.8:0/1921066379 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fd6d4050f80 con 0x7fd6e00f77d0 2023-10-18T21:38:28.135 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:38:28.135 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:38:28.135 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:38:28.136 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:38:28.136 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:38:28.136 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:38:28.136 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:38:28.137 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:38:28.137 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:38:28.137 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:38:28.137 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:38:28.137 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:38:28.138 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:38:28.138 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:38:28.138 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:38:28.138 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:38:28.138 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:38:28.139 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:38:28.139 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:38:28.139 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:38:28.139 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:38:28.139 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:38:28.140 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:38:28.140 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:38:28.140 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:38:28.140 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:38:28.140 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:38:28.141 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:38:28.141 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:38:28.141 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:38:28.141 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:38:28.141 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:38:28.142 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:38:28.142 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:38:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.134+0000 7fd6e52c1700 1 -- 172.21.15.8:0/1921066379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd6c8060f70 msgr2=0x7fd6c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.134+0000 7fd6e52c1700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd6c8060f70 0x7fd6c8063430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fd6e00f7630 tx=0x7fd6d000b040).stop 2023-10-18T21:38:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.134+0000 7fd6e52c1700 1 -- 172.21.15.8:0/1921066379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6e00f77d0 msgr2=0x7fd6e0109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.134+0000 7fd6e52c1700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6e00f77d0 0x7fd6e0109410 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fd6d4004320 tx=0x7fd6d400b040).stop 2023-10-18T21:38:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.134+0000 7fd6e52c1700 1 -- 172.21.15.8:0/1921066379 shutdown_connections 2023-10-18T21:38:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.134+0000 7fd6e52c1700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd6c8060f70 0x7fd6c8063430 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.134+0000 7fd6e52c1700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6e00f6530 0x7fd6e0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.134+0000 7fd6e52c1700 1 --2- 172.21.15.8:0/1921066379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6e00f77d0 0x7fd6e0109410 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.135+0000 7fd6e52c1700 1 -- 172.21.15.8:0/1921066379 >> 172.21.15.8:0/1921066379 conn(0x7fd6e00f1c90 msgr2=0x7fd6e006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.135+0000 7fd6e52c1700 1 -- 172.21.15.8:0/1921066379 shutdown_connections 2023-10-18T21:38:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.135+0000 7fd6e52c1700 1 -- 172.21.15.8:0/1921066379 wait complete. 2023-10-18T21:38:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:38:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.272+0000 7f1a1ffff700 1 -- 172.21.15.8:0/1492066399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a200f77d0 msgr2=0x7f1a200f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:28.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.272+0000 7f1a1ffff700 1 --2- 172.21.15.8:0/1492066399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a200f77d0 0x7f1a200f7c30 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f1a14004660 tx=0x7f1a14009b30).stop 2023-10-18T21:38:28.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.272+0000 7f1a1ffff700 1 -- 172.21.15.8:0/1492066399 shutdown_connections 2023-10-18T21:38:28.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.272+0000 7f1a1ffff700 1 --2- 172.21.15.8:0/1492066399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a200f77d0 0x7f1a200f7c30 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:28.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.272+0000 7f1a1ffff700 1 --2- 172.21.15.8:0/1492066399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a200f6530 0x7f1a200f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:28.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.272+0000 7f1a1ffff700 1 -- 172.21.15.8:0/1492066399 >> 172.21.15.8:0/1492066399 conn(0x7f1a200f1c90 msgr2=0x7f1a200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:28.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.272+0000 7f1a1ffff700 1 -- 172.21.15.8:0/1492066399 shutdown_connections 2023-10-18T21:38:28.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.272+0000 7f1a1ffff700 1 -- 172.21.15.8:0/1492066399 wait complete. 2023-10-18T21:38:28.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.274+0000 7f1a1ffff700 1 Processor -- start 2023-10-18T21:38:28.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.274+0000 7f1a1ffff700 1 -- start start 2023-10-18T21:38:28.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.274+0000 7f1a1ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a200f6530 0x7f1a20106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:28.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.274+0000 7f1a1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a200f77d0 0x7f1a20107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:28.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.274+0000 7f1a1ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20107830 con 0x7f1a200f6530 2023-10-18T21:38:28.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.274+0000 7f1a1ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20108040 con 0x7f1a200f77d0 2023-10-18T21:38:28.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.275+0000 7f1a1effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a200f6530 0x7f1a20106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:28.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.275+0000 7f1a1effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a200f6530 0x7f1a20106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60880/0 (socket says 172.21.15.8:60880) 2023-10-18T21:38:28.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.275+0000 7f1a1effd700 1 -- 172.21.15.8:0/3525239062 learned_addr learned my addr 172.21.15.8:0/3525239062 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:38:28.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.275+0000 7f1a1e7fc700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a200f77d0 0x7f1a20107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:28.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.275+0000 7f1a1effd700 1 -- 172.21.15.8:0/3525239062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a200f77d0 msgr2=0x7f1a20107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:28.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.275+0000 7f1a1effd700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a200f77d0 0x7f1a20107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:28.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.275+0000 7f1a1effd700 1 -- 172.21.15.8:0/3525239062 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14005040 con 0x7f1a200f6530 2023-10-18T21:38:28.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.275+0000 7f1a1e7fc700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a200f77d0 0x7f1a20107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:38:28.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.275+0000 7f1a1effd700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a200f6530 0x7f1a20106d40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f1a10002700 tx=0x7f1a10009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:28.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.276+0000 7f1a077fe700 1 -- 172.21.15.8:0/3525239062 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a10009320 con 0x7f1a200f6530 2023-10-18T21:38:28.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.276+0000 7f1a077fe700 1 -- 172.21.15.8:0/3525239062 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1a1000f040 con 0x7f1a200f6530 2023-10-18T21:38:28.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.276+0000 7f1a077fe700 1 -- 172.21.15.8:0/3525239062 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a10014970 con 0x7f1a200f6530 2023-10-18T21:38:28.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.276+0000 7f1a1ffff700 1 -- 172.21.15.8:0/3525239062 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a201082c0 con 0x7f1a200f6530 2023-10-18T21:38:28.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.276+0000 7f1a1ffff700 1 -- 172.21.15.8:0/3525239062 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a20108880 con 0x7f1a200f6530 2023-10-18T21:38:28.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.277+0000 7f1a1ffff700 1 -- 172.21.15.8:0/3525239062 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a20059100 con 0x7f1a200f6530 2023-10-18T21:38:28.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.278+0000 7f1a077fe700 1 -- 172.21.15.8:0/3525239062 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1a10009480 con 0x7f1a200f6530 2023-10-18T21:38:28.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.279+0000 7f1a077fe700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a08060f70 0x7f1a08063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:28.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.279+0000 7f1a077fe700 1 -- 172.21.15.8:0/3525239062 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1a1007cb90 con 0x7f1a200f6530 2023-10-18T21:38:28.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.279+0000 7f1a1e7fc700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a08060f70 0x7f1a08063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:28.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.279+0000 7f1a1e7fc700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a08060f70 0x7f1a08063430 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f1a14005010 tx=0x7f1a14009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:28.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.283+0000 7f1a077fe700 1 -- 172.21.15.8:0/3525239062 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1a1004c7c0 con 0x7f1a200f6530 2023-10-18T21:38:28.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.483+0000 7f1a1ffff700 1 -- 172.21.15.8:0/3525239062 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a200fee50 con 0x7f1a08060f70 2023-10-18T21:38:28.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.485+0000 7f1a077fe700 1 -- 172.21.15.8:0/3525239062 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1a200fee50 con 0x7f1a08060f70 2023-10-18T21:38:28.487 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:38:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:38:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:38:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:38:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:38:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:38:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:38:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:38:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:38:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:38:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:38:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:38:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:38:28.490 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:38:28.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 -- 172.21.15.8:0/3525239062 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a08060f70 msgr2=0x7f1a08063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:28.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a08060f70 0x7f1a08063430 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f1a14005010 tx=0x7f1a14009b30).stop 2023-10-18T21:38:28.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 -- 172.21.15.8:0/3525239062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a200f6530 msgr2=0x7f1a20106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:28.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a200f6530 0x7f1a20106d40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f1a10002700 tx=0x7f1a10009d80).stop 2023-10-18T21:38:28.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 -- 172.21.15.8:0/3525239062 shutdown_connections 2023-10-18T21:38:28.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a08060f70 0x7f1a08063430 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:28.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a200f6530 0x7f1a20106d40 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:28.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 --2- 172.21.15.8:0/3525239062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a200f77d0 0x7f1a20107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:28.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 -- 172.21.15.8:0/3525239062 >> 172.21.15.8:0/3525239062 conn(0x7f1a200f1c90 msgr2=0x7f1a200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:28.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 -- 172.21.15.8:0/3525239062 shutdown_connections 2023-10-18T21:38:28.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:28.487+0000 7f1a1ffff700 1 -- 172.21.15.8:0/3525239062 wait complete. 2023-10-18T21:38:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:27.350812+0000 mgr.smithi008.flmjzp (mgr.14640) 2379 : audit [DBG] from='client.36048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:38:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:27.761019+0000 mon.smithi008 (mon.0) 2798 : audit [DBG] from='client.? 172.21.15.8:0/2685311411' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:28.134168+0000 mon.smithi008 (mon.0) 2799 : audit [DBG] from='client.? 172.21.15.8:0/1921066379' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:38:28.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:27.350812+0000 mgr.smithi008.flmjzp (mgr.14640) 2379 : audit [DBG] from='client.36048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:38:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:27.761019+0000 mon.smithi008 (mon.0) 2798 : audit [DBG] from='client.? 172.21.15.8:0/2685311411' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:28.134168+0000 mon.smithi008 (mon.0) 2799 : audit [DBG] from='client.? 172.21.15.8:0/1921066379' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:38:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:28.165290+0000 mgr.smithi008.flmjzp (mgr.14640) 2380 : cluster [DBG] pgmap v1641: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:28.486098+0000 mgr.smithi008.flmjzp (mgr.14640) 2381 : audit [DBG] from='client.36060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:38:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:28.165290+0000 mgr.smithi008.flmjzp (mgr.14640) 2380 : cluster [DBG] pgmap v1641: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:29.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:28.486098+0000 mgr.smithi008.flmjzp (mgr.14640) 2381 : audit [DBG] from='client.36060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:38:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:30.165865+0000 mgr.smithi008.flmjzp (mgr.14640) 2382 : cluster [DBG] pgmap v1642: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:31.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:30.165865+0000 mgr.smithi008.flmjzp (mgr.14640) 2382 : cluster [DBG] pgmap v1642: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:32.166408+0000 mgr.smithi008.flmjzp (mgr.14640) 2383 : cluster [DBG] pgmap v1643: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:33.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:32.166408+0000 mgr.smithi008.flmjzp (mgr.14640) 2383 : cluster [DBG] pgmap v1643: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:34.196209+0000 mon.smithi008 (mon.0) 2800 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:34.198401+0000 mon.smithi008 (mon.0) 2801 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:34.199493+0000 mon.smithi008 (mon.0) 2802 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:34.206175+0000 mon.smithi008 (mon.0) 2803 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:34.212568+0000 mon.smithi008 (mon.0) 2804 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:34.216136+0000 mon.smithi008 (mon.0) 2805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:34.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:34.218187+0000 mon.smithi008 (mon.0) 2806 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:34.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:34.220140+0000 mon.smithi008 (mon.0) 2807 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:34.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:34.222826+0000 mon.smithi008 (mon.0) 2808 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:34.196209+0000 mon.smithi008 (mon.0) 2800 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:34.198401+0000 mon.smithi008 (mon.0) 2801 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:34.199493+0000 mon.smithi008 (mon.0) 2802 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:34.206175+0000 mon.smithi008 (mon.0) 2803 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:34.212568+0000 mon.smithi008 (mon.0) 2804 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:34.216136+0000 mon.smithi008 (mon.0) 2805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:34.218187+0000 mon.smithi008 (mon.0) 2806 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:34.220140+0000 mon.smithi008 (mon.0) 2807 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:34.222826+0000 mon.smithi008 (mon.0) 2808 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:34.167000+0000 mgr.smithi008.flmjzp (mgr.14640) 2384 : cluster [DBG] pgmap v1644: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:34.200376+0000 mgr.smithi008.flmjzp (mgr.14640) 2385 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:34.200945+0000 mgr.smithi008.flmjzp (mgr.14640) 2386 : cluster [DBG] pgmap v1645: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:34.201312+0000 mgr.smithi008.flmjzp (mgr.14640) 2387 : cluster [DBG] pgmap v1646: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:34.225102+0000 mgr.smithi008.flmjzp (mgr.14640) 2388 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:35.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:34.167000+0000 mgr.smithi008.flmjzp (mgr.14640) 2384 : cluster [DBG] pgmap v1644: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:34.200376+0000 mgr.smithi008.flmjzp (mgr.14640) 2385 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:34.200945+0000 mgr.smithi008.flmjzp (mgr.14640) 2386 : cluster [DBG] pgmap v1645: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:34.201312+0000 mgr.smithi008.flmjzp (mgr.14640) 2387 : cluster [DBG] pgmap v1646: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:34.225102+0000 mgr.smithi008.flmjzp (mgr.14640) 2388 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:36.202088+0000 mgr.smithi008.flmjzp (mgr.14640) 2389 : cluster [DBG] pgmap v1647: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:37.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:36.202088+0000 mgr.smithi008.flmjzp (mgr.14640) 2389 : cluster [DBG] pgmap v1647: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:38.202537+0000 mgr.smithi008.flmjzp (mgr.14640) 2390 : cluster [DBG] pgmap v1648: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:38.202537+0000 mgr.smithi008.flmjzp (mgr.14640) 2390 : cluster [DBG] pgmap v1648: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:40.203153+0000 mgr.smithi008.flmjzp (mgr.14640) 2391 : cluster [DBG] pgmap v1649: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:41.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:40.203153+0000 mgr.smithi008.flmjzp (mgr.14640) 2391 : cluster [DBG] pgmap v1649: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:42.203785+0000 mgr.smithi008.flmjzp (mgr.14640) 2392 : cluster [DBG] pgmap v1650: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:43.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:42.203785+0000 mgr.smithi008.flmjzp (mgr.14640) 2392 : cluster [DBG] pgmap v1650: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:44.235968+0000 mon.smithi008 (mon.0) 2809 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:44.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:44.235968+0000 mon.smithi008 (mon.0) 2809 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:44.204514+0000 mgr.smithi008.flmjzp (mgr.14640) 2393 : cluster [DBG] pgmap v1651: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:44.803206+0000 mon.smithi008 (mon.0) 2810 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:44.804009+0000 mon.smithi008 (mon.0) 2811 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:44.804661+0000 mgr.smithi008.flmjzp (mgr.14640) 2394 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:44.805146+0000 mgr.smithi008.flmjzp (mgr.14640) 2395 : cluster [DBG] pgmap v1652: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:44.805400+0000 mgr.smithi008.flmjzp (mgr.14640) 2396 : cluster [DBG] pgmap v1653: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:44.809287+0000 mon.smithi008 (mon.0) 2812 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:45.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:44.815201+0000 mon.smithi008 (mon.0) 2813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:45.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:44.817816+0000 mon.smithi008 (mon.0) 2814 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:45.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:44.819310+0000 mon.smithi008 (mon.0) 2815 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:45.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:44.820726+0000 mon.smithi008 (mon.0) 2816 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:45.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:44.822687+0000 mon.smithi008 (mon.0) 2817 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:45.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:44.824374+0000 mgr.smithi008.flmjzp (mgr.14640) 2397 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:45.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:44.204514+0000 mgr.smithi008.flmjzp (mgr.14640) 2393 : cluster [DBG] pgmap v1651: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:44.803206+0000 mon.smithi008 (mon.0) 2810 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:44.804009+0000 mon.smithi008 (mon.0) 2811 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:44.804661+0000 mgr.smithi008.flmjzp (mgr.14640) 2394 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:44.805146+0000 mgr.smithi008.flmjzp (mgr.14640) 2395 : cluster [DBG] pgmap v1652: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:44.805400+0000 mgr.smithi008.flmjzp (mgr.14640) 2396 : cluster [DBG] pgmap v1653: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:44.809287+0000 mon.smithi008 (mon.0) 2812 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:44.815201+0000 mon.smithi008 (mon.0) 2813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:44.817816+0000 mon.smithi008 (mon.0) 2814 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:44.819310+0000 mon.smithi008 (mon.0) 2815 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:45.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:44.820726+0000 mon.smithi008 (mon.0) 2816 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:45.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:44.822687+0000 mon.smithi008 (mon.0) 2817 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:45.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:44.824374+0000 mgr.smithi008.flmjzp (mgr.14640) 2397 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:46.805963+0000 mgr.smithi008.flmjzp (mgr.14640) 2398 : cluster [DBG] pgmap v1654: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:46.805963+0000 mgr.smithi008.flmjzp (mgr.14640) 2398 : cluster [DBG] pgmap v1654: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:50.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:48.806535+0000 mgr.smithi008.flmjzp (mgr.14640) 2399 : cluster [DBG] pgmap v1655: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:48.806535+0000 mgr.smithi008.flmjzp (mgr.14640) 2399 : cluster [DBG] pgmap v1655: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:50.807222+0000 mgr.smithi008.flmjzp (mgr.14640) 2400 : cluster [DBG] pgmap v1656: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:51.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:50.807222+0000 mgr.smithi008.flmjzp (mgr.14640) 2400 : cluster [DBG] pgmap v1656: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:52.807813+0000 mgr.smithi008.flmjzp (mgr.14640) 2401 : cluster [DBG] pgmap v1657: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:52.807813+0000 mgr.smithi008.flmjzp (mgr.14640) 2401 : cluster [DBG] pgmap v1657: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:55.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:54.835099+0000 mon.smithi008 (mon.0) 2818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:55.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:54.837844+0000 mon.smithi008 (mon.0) 2819 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:55.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:54.839004+0000 mon.smithi008 (mon.0) 2820 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:55.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:54.845832+0000 mon.smithi008 (mon.0) 2821 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:55.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:54.853704+0000 mon.smithi008 (mon.0) 2822 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:55.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:54.857249+0000 mon.smithi008 (mon.0) 2823 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:55.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:54.859227+0000 mon.smithi008 (mon.0) 2824 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:55.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:54.861170+0000 mon.smithi008 (mon.0) 2825 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:55.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:54.835099+0000 mon.smithi008 (mon.0) 2818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:55.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:54.837844+0000 mon.smithi008 (mon.0) 2819 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:38:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:54.839004+0000 mon.smithi008 (mon.0) 2820 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:38:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:54.845832+0000 mon.smithi008 (mon.0) 2821 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:38:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:54.853704+0000 mon.smithi008 (mon.0) 2822 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:38:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:54.857249+0000 mon.smithi008 (mon.0) 2823 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:54.859227+0000 mon.smithi008 (mon.0) 2824 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:55.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:54.861170+0000 mon.smithi008 (mon.0) 2825 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:54.808529+0000 mgr.smithi008.flmjzp (mgr.14640) 2402 : cluster [DBG] pgmap v1658: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:54.839954+0000 mgr.smithi008.flmjzp (mgr.14640) 2403 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:54.840612+0000 mgr.smithi008.flmjzp (mgr.14640) 2404 : cluster [DBG] pgmap v1659: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:54.840842+0000 mgr.smithi008.flmjzp (mgr.14640) 2405 : cluster [DBG] pgmap v1660: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:54.863842+0000 mon.smithi008 (mon.0) 2826 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:38:54.865940+0000 mgr.smithi008.flmjzp (mgr.14640) 2406 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:56.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:54.808529+0000 mgr.smithi008.flmjzp (mgr.14640) 2402 : cluster [DBG] pgmap v1658: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:56.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:54.839954+0000 mgr.smithi008.flmjzp (mgr.14640) 2403 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:38:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:54.840612+0000 mgr.smithi008.flmjzp (mgr.14640) 2404 : cluster [DBG] pgmap v1659: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:54.840842+0000 mgr.smithi008.flmjzp (mgr.14640) 2405 : cluster [DBG] pgmap v1660: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:54.863842+0000 mon.smithi008 (mon.0) 2826 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:38:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:38:54.865940+0000 mgr.smithi008.flmjzp (mgr.14640) 2406 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:38:58.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:56.841430+0000 mgr.smithi008.flmjzp (mgr.14640) 2407 : cluster [DBG] pgmap v1661: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:58.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:56.841430+0000 mgr.smithi008.flmjzp (mgr.14640) 2407 : cluster [DBG] pgmap v1661: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:38:58.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.640+0000 7f943d8d0700 1 -- 172.21.15.8:0/2825720858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94380f6530 msgr2=0x7f94380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:58.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.640+0000 7f943d8d0700 1 --2- 172.21.15.8:0/2825720858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94380f6530 0x7f94380f6950 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f942c004660 tx=0x7f942c009b30).stop 2023-10-18T21:38:58.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.640+0000 7f943d8d0700 1 -- 172.21.15.8:0/2825720858 shutdown_connections 2023-10-18T21:38:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.640+0000 7f943d8d0700 1 --2- 172.21.15.8:0/2825720858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94380f77d0 0x7f94380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.640+0000 7f943d8d0700 1 --2- 172.21.15.8:0/2825720858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94380f6530 0x7f94380f6950 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.640+0000 7f943d8d0700 1 -- 172.21.15.8:0/2825720858 >> 172.21.15.8:0/2825720858 conn(0x7f94380f1c90 msgr2=0x7f94380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.641+0000 7f943d8d0700 1 -- 172.21.15.8:0/2825720858 shutdown_connections 2023-10-18T21:38:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.641+0000 7f943d8d0700 1 -- 172.21.15.8:0/2825720858 wait complete. 2023-10-18T21:38:58.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.641+0000 7f943d8d0700 1 Processor -- start 2023-10-18T21:38:58.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.642+0000 7f943d8d0700 1 -- start start 2023-10-18T21:38:58.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.642+0000 7f943d8d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94380f6530 0x7f943806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:58.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.642+0000 7f943d8d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94380f77d0 0x7f9438069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.642+0000 7f943d8d0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943806a380 con 0x7f94380f6530 2023-10-18T21:38:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.642+0000 7f943d8d0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943806a4c0 con 0x7f94380f77d0 2023-10-18T21:38:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.642+0000 7f943c8ce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94380f6530 0x7f943806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.642+0000 7f943c8ce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94380f6530 0x7f943806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34696/0 (socket says 172.21.15.8:34696) 2023-10-18T21:38:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.642+0000 7f943c8ce700 1 -- 172.21.15.8:0/3787820195 learned_addr learned my addr 172.21.15.8:0/3787820195 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:38:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.642+0000 7f9437fff700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94380f77d0 0x7f9438069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.643+0000 7f943c8ce700 1 -- 172.21.15.8:0/3787820195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94380f77d0 msgr2=0x7f9438069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.643+0000 7f943c8ce700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94380f77d0 0x7f9438069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.643+0000 7f943c8ce700 1 -- 172.21.15.8:0/3787820195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c005040 con 0x7f94380f6530 2023-10-18T21:38:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.643+0000 7f943c8ce700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94380f6530 0x7f943806b9a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f942c007a70 tx=0x7f942c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.643+0000 7f94357fa700 1 -- 172.21.15.8:0/3787820195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f942c018070 con 0x7f94380f6530 2023-10-18T21:38:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.643+0000 7f94357fa700 1 -- 172.21.15.8:0/3787820195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f942c01d8e0 con 0x7f94380f6530 2023-10-18T21:38:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.643+0000 7f94357fa700 1 -- 172.21.15.8:0/3787820195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f942c01c5c0 con 0x7f94380f6530 2023-10-18T21:38:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.643+0000 7f943d8d0700 1 -- 172.21.15.8:0/3787820195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943806a740 con 0x7f94380f6530 2023-10-18T21:38:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.644+0000 7f943d8d0700 1 -- 172.21.15.8:0/3787820195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943806aca0 con 0x7f94380f6530 2023-10-18T21:38:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.645+0000 7f943d8d0700 1 -- 172.21.15.8:0/3787820195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9438045ad0 con 0x7f94380f6530 2023-10-18T21:38:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.646+0000 7f94357fa700 1 -- 172.21.15.8:0/3787820195 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f942c01da50 con 0x7f94380f6530 2023-10-18T21:38:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.646+0000 7f94357fa700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9428060f70 0x7f9428063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.646+0000 7f94357fa700 1 -- 172.21.15.8:0/3787820195 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f942c07e840 con 0x7f94380f6530 2023-10-18T21:38:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.647+0000 7f9437fff700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9428060f70 0x7f9428063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.647+0000 7f9437fff700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9428060f70 0x7f9428063430 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f9424007fd0 tx=0x7f9424009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.651+0000 7f94357fa700 1 -- 172.21.15.8:0/3787820195 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f942c04e470 con 0x7f94380f6530 2023-10-18T21:38:58.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.849+0000 7f943d8d0700 1 -- 172.21.15.8:0/3787820195 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94380fedd0 con 0x7f9428060f70 2023-10-18T21:38:58.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.851+0000 7f94357fa700 1 -- 172.21.15.8:0/3787820195 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f94380fedd0 con 0x7f9428060f70 2023-10-18T21:38:58.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 -- 172.21.15.8:0/3787820195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9428060f70 msgr2=0x7f9428063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:58.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9428060f70 0x7f9428063430 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f9424007fd0 tx=0x7f9424009040).stop 2023-10-18T21:38:58.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 -- 172.21.15.8:0/3787820195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94380f6530 msgr2=0x7f943806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:58.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94380f6530 0x7f943806b9a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f942c007a70 tx=0x7f942c009b30).stop 2023-10-18T21:38:58.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 -- 172.21.15.8:0/3787820195 shutdown_connections 2023-10-18T21:38:58.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9428060f70 0x7f9428063430 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:58.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94380f6530 0x7f943806b9a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:58.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 --2- 172.21.15.8:0/3787820195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94380f77d0 0x7f9438069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:58.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 -- 172.21.15.8:0/3787820195 >> 172.21.15.8:0/3787820195 conn(0x7f94380f1c90 msgr2=0x7f94380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:58.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 -- 172.21.15.8:0/3787820195 shutdown_connections 2023-10-18T21:38:58.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.853+0000 7f943d8d0700 1 -- 172.21.15.8:0/3787820195 wait complete. 2023-10-18T21:38:58.868 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:38:58.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.991+0000 7f45f5156700 1 -- 172.21.15.8:0/4106028345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f00f77d0 msgr2=0x7f45f00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:58.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.991+0000 7f45f5156700 1 --2- 172.21.15.8:0/4106028345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f00f77d0 0x7f45f00f7c30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f45e4004660 tx=0x7f45e4009b30).stop 2023-10-18T21:38:58.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.991+0000 7f45f5156700 1 -- 172.21.15.8:0/4106028345 shutdown_connections 2023-10-18T21:38:58.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.992+0000 7f45f5156700 1 --2- 172.21.15.8:0/4106028345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f00f77d0 0x7f45f00f7c30 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:58.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.992+0000 7f45f5156700 1 --2- 172.21.15.8:0/4106028345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45f00f6530 0x7f45f00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:58.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.992+0000 7f45f5156700 1 -- 172.21.15.8:0/4106028345 >> 172.21.15.8:0/4106028345 conn(0x7f45f00f1c90 msgr2=0x7f45f00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:58.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.992+0000 7f45f5156700 1 -- 172.21.15.8:0/4106028345 shutdown_connections 2023-10-18T21:38:58.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.992+0000 7f45f5156700 1 -- 172.21.15.8:0/4106028345 wait complete. 2023-10-18T21:38:58.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.992+0000 7f45f5156700 1 Processor -- start 2023-10-18T21:38:58.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.993+0000 7f45f5156700 1 -- start start 2023-10-18T21:38:58.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.993+0000 7f45f5156700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f00f6530 0x7f45f0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:58.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.993+0000 7f45f5156700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45f00f77d0 0x7f45f0107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:58.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.993+0000 7f45f5156700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0107850 con 0x7f45f00f6530 2023-10-18T21:38:58.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.993+0000 7f45f5156700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0108060 con 0x7f45f00f77d0 2023-10-18T21:38:58.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.993+0000 7f45effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f00f6530 0x7f45f0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:58.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.993+0000 7f45effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f00f6530 0x7f45f0106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34702/0 (socket says 172.21.15.8:34702) 2023-10-18T21:38:58.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.993+0000 7f45effff700 1 -- 172.21.15.8:0/20639100 learned_addr learned my addr 172.21.15.8:0/20639100 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:38:58.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.993+0000 7f45ef7fe700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45f00f77d0 0x7f45f0107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:59.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.994+0000 7f45effff700 1 -- 172.21.15.8:0/20639100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45f00f77d0 msgr2=0x7f45f0107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.994+0000 7f45effff700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45f00f77d0 0x7f45f0107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.994+0000 7f45effff700 1 -- 172.21.15.8:0/20639100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e4005040 con 0x7f45f00f6530 2023-10-18T21:38:59.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.994+0000 7f45effff700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f00f6530 0x7f45f0106d60 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f45e000e7c0 tx=0x7f45e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:59.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.994+0000 7f45ecff9700 1 -- 172.21.15.8:0/20639100 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45e00092e0 con 0x7f45f00f6530 2023-10-18T21:38:59.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.994+0000 7f45ecff9700 1 -- 172.21.15.8:0/20639100 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f45e000f040 con 0x7f45f00f6530 2023-10-18T21:38:59.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.994+0000 7f45ecff9700 1 -- 172.21.15.8:0/20639100 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45e0014810 con 0x7f45f00f6530 2023-10-18T21:38:59.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.994+0000 7f45f5156700 1 -- 172.21.15.8:0/20639100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f01082e0 con 0x7f45f00f6530 2023-10-18T21:38:59.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.994+0000 7f45f5156700 1 -- 172.21.15.8:0/20639100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f0108820 con 0x7f45f00f6530 2023-10-18T21:38:59.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.995+0000 7f45f5156700 1 -- 172.21.15.8:0/20639100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f0059100 con 0x7f45f00f6530 2023-10-18T21:38:59.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.996+0000 7f45ecff9700 1 -- 172.21.15.8:0/20639100 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f45e001b030 con 0x7f45f00f6530 2023-10-18T21:38:59.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.997+0000 7f45ecff9700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45d8060f70 0x7f45d8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:59.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.997+0000 7f45ecff9700 1 -- 172.21.15.8:0/20639100 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f45e007c7c0 con 0x7f45f00f6530 2023-10-18T21:38:59.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.997+0000 7f45ef7fe700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45d8060f70 0x7f45d8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:59.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:58.998+0000 7f45ef7fe700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45d8060f70 0x7f45d8063430 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f45e4005010 tx=0x7f45e4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.001+0000 7f45ecff9700 1 -- 172.21.15.8:0/20639100 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f45e004c430 con 0x7f45f00f6530 2023-10-18T21:38:59.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.199+0000 7f45f5156700 1 -- 172.21.15.8:0/20639100 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45f00008d0 con 0x7f45d8060f70 2023-10-18T21:38:59.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.200+0000 7f45ecff9700 1 -- 172.21.15.8:0/20639100 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f45f00008d0 con 0x7f45d8060f70 2023-10-18T21:38:59.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 -- 172.21.15.8:0/20639100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45d8060f70 msgr2=0x7f45d8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45d8060f70 0x7f45d8063430 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f45e4005010 tx=0x7f45e4016040).stop 2023-10-18T21:38:59.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 -- 172.21.15.8:0/20639100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f00f6530 msgr2=0x7f45f0106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f00f6530 0x7f45f0106d60 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f45e000e7c0 tx=0x7f45e000b040).stop 2023-10-18T21:38:59.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 -- 172.21.15.8:0/20639100 shutdown_connections 2023-10-18T21:38:59.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45d8060f70 0x7f45d8063430 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f00f6530 0x7f45f0106d60 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 --2- 172.21.15.8:0/20639100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45f00f77d0 0x7f45f0107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 -- 172.21.15.8:0/20639100 >> 172.21.15.8:0/20639100 conn(0x7f45f00f1c90 msgr2=0x7f45f00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:59.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 -- 172.21.15.8:0/20639100 shutdown_connections 2023-10-18T21:38:59.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.202+0000 7f45f5156700 1 -- 172.21.15.8:0/20639100 wait complete. 2023-10-18T21:38:59.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.338+0000 7faa734aa700 1 -- 172.21.15.8:0/2159453648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa6c06b9c0 msgr2=0x7faa6c069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.338+0000 7faa734aa700 1 --2- 172.21.15.8:0/2159453648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa6c06b9c0 0x7faa6c069ec0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7faa68004660 tx=0x7faa68009b30).stop 2023-10-18T21:38:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.338+0000 7faa734aa700 1 -- 172.21.15.8:0/2159453648 shutdown_connections 2023-10-18T21:38:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.338+0000 7faa734aa700 1 --2- 172.21.15.8:0/2159453648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa6c06a3b0 0x7faa6c06a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.338+0000 7faa734aa700 1 --2- 172.21.15.8:0/2159453648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa6c06b9c0 0x7faa6c069ec0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.338+0000 7faa734aa700 1 -- 172.21.15.8:0/2159453648 >> 172.21.15.8:0/2159453648 conn(0x7faa6c0f1c90 msgr2=0x7faa6c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:59.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.338+0000 7faa734aa700 1 -- 172.21.15.8:0/2159453648 shutdown_connections 2023-10-18T21:38:59.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.338+0000 7faa734aa700 1 -- 172.21.15.8:0/2159453648 wait complete. 2023-10-18T21:38:59.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.339+0000 7faa734aa700 1 Processor -- start 2023-10-18T21:38:59.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.339+0000 7faa734aa700 1 -- start start 2023-10-18T21:38:59.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.339+0000 7faa734aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa6c06a3b0 0x7faa6c108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:59.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.339+0000 7faa734aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa6c06b9c0 0x7faa6c109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:59.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.339+0000 7faa734aa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c1099e0 con 0x7faa6c06b9c0 2023-10-18T21:38:59.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.339+0000 7faa734aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c109b20 con 0x7faa6c06a3b0 2023-10-18T21:38:59.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.340+0000 7faa71ca7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa6c06b9c0 0x7faa6c109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:59.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.340+0000 7faa71ca7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa6c06b9c0 0x7faa6c109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34716/0 (socket says 172.21.15.8:34716) 2023-10-18T21:38:59.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.340+0000 7faa71ca7700 1 -- 172.21.15.8:0/2519089843 learned_addr learned my addr 172.21.15.8:0/2519089843 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:38:59.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.340+0000 7faa724a8700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa6c06a3b0 0x7faa6c108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:59.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.340+0000 7faa71ca7700 1 -- 172.21.15.8:0/2519089843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa6c06a3b0 msgr2=0x7faa6c108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.340+0000 7faa71ca7700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa6c06a3b0 0x7faa6c108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.340+0000 7faa71ca7700 1 -- 172.21.15.8:0/2519089843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa68005040 con 0x7faa6c06b9c0 2023-10-18T21:38:59.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.340+0000 7faa71ca7700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa6c06b9c0 0x7faa6c109430 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7faa5c002700 tx=0x7faa5c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:59.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.340+0000 7faa62ffd700 1 -- 172.21.15.8:0/2519089843 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5c009320 con 0x7faa6c06b9c0 2023-10-18T21:38:59.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.341+0000 7faa62ffd700 1 -- 172.21.15.8:0/2519089843 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faa5c00f040 con 0x7faa6c06b9c0 2023-10-18T21:38:59.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.341+0000 7faa734aa700 1 -- 172.21.15.8:0/2519089843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c10a4c0 con 0x7faa6c06b9c0 2023-10-18T21:38:59.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.341+0000 7faa62ffd700 1 -- 172.21.15.8:0/2519089843 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5c0148f0 con 0x7faa6c06b9c0 2023-10-18T21:38:59.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.341+0000 7faa734aa700 1 -- 172.21.15.8:0/2519089843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c10aa80 con 0x7faa6c06b9c0 2023-10-18T21:38:59.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.342+0000 7faa734aa700 1 -- 172.21.15.8:0/2519089843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c045ad0 con 0x7faa6c06b9c0 2023-10-18T21:38:59.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.343+0000 7faa62ffd700 1 -- 172.21.15.8:0/2519089843 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faa5c009480 con 0x7faa6c06b9c0 2023-10-18T21:38:59.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.343+0000 7faa62ffd700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa58060f70 0x7faa58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:59.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.344+0000 7faa62ffd700 1 -- 172.21.15.8:0/2519089843 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faa5c07cb80 con 0x7faa6c06b9c0 2023-10-18T21:38:59.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.344+0000 7faa724a8700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa58060f70 0x7faa58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:59.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.344+0000 7faa724a8700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa58060f70 0x7faa58063430 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7faa68004630 tx=0x7faa68009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:59.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.348+0000 7faa62ffd700 1 -- 172.21.15.8:0/2519089843 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faa5c0501e0 con 0x7faa6c06b9c0 2023-10-18T21:38:59.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.538+0000 7faa734aa700 1 -- 172.21.15.8:0/2519089843 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faa6c101020 con 0x7faa58060f70 2023-10-18T21:38:59.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.547+0000 7faa62ffd700 1 -- 172.21.15.8:0/2519089843 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7faa6c101020 con 0x7faa58060f70 2023-10-18T21:38:59.548 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:38:59.549 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (45m) 3m ago 47m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:38:59.549 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (39m) 3m ago 47m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:38:59.549 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (39m) 76s ago 46m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:38:59.549 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (45m) 3m ago 46m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:38:59.550 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 43m - - 2023-10-18T21:38:59.550 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 43m - - 2023-10-18T21:38:59.550 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 76s ago 43m - - 2023-10-18T21:38:59.550 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 76s ago 43m - - 2023-10-18T21:38:59.550 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (40m) 3m ago 48m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:38:59.551 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (40m) 76s ago 46m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:38:59.551 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (40m) 3m ago 48m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:38:59.551 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (39m) 76s ago 46m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:38:59.551 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (46m) 3m ago 46m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:38:59.551 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (45m) 76s ago 45m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:38:59.552 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (39m) 3m ago 45m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:38:59.552 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (37m) 3m ago 45m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:38:59.552 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (36m) 3m ago 45m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:38:59.552 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (36m) 76s ago 44m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:38:59.552 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (35m) 76s ago 44m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:38:59.553 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (35m) 76s ago 44m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:38:59.553 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (41m) 3m ago 46m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:38:59.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.549+0000 7faa734aa700 1 -- 172.21.15.8:0/2519089843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa58060f70 msgr2=0x7faa58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.549+0000 7faa734aa700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa58060f70 0x7faa58063430 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7faa68004630 tx=0x7faa68009b30).stop 2023-10-18T21:38:59.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.549+0000 7faa734aa700 1 -- 172.21.15.8:0/2519089843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa6c06b9c0 msgr2=0x7faa6c109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.549+0000 7faa734aa700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa6c06b9c0 0x7faa6c109430 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7faa5c002700 tx=0x7faa5c009e00).stop 2023-10-18T21:38:59.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.549+0000 7faa734aa700 1 -- 172.21.15.8:0/2519089843 shutdown_connections 2023-10-18T21:38:59.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.549+0000 7faa734aa700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa58060f70 0x7faa58063430 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.549+0000 7faa734aa700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa6c06a3b0 0x7faa6c108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.549+0000 7faa734aa700 1 --2- 172.21.15.8:0/2519089843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa6c06b9c0 0x7faa6c109430 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.549+0000 7faa734aa700 1 -- 172.21.15.8:0/2519089843 >> 172.21.15.8:0/2519089843 conn(0x7faa6c0f1c90 msgr2=0x7faa6c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:59.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.549+0000 7faa734aa700 1 -- 172.21.15.8:0/2519089843 shutdown_connections 2023-10-18T21:38:59.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.550+0000 7faa734aa700 1 -- 172.21.15.8:0/2519089843 wait complete. 2023-10-18T21:38:59.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.685+0000 7ff631dda700 1 -- 172.21.15.8:0/1023485469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c0f99e0 msgr2=0x7ff62c0f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.685+0000 7ff631dda700 1 --2- 172.21.15.8:0/1023485469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c0f99e0 0x7ff62c0f9e40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7ff618004660 tx=0x7ff618009b30).stop 2023-10-18T21:38:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.685+0000 7ff631dda700 1 -- 172.21.15.8:0/1023485469 shutdown_connections 2023-10-18T21:38:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.685+0000 7ff631dda700 1 --2- 172.21.15.8:0/1023485469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c0f99e0 0x7ff62c0f9e40 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.685+0000 7ff631dda700 1 --2- 172.21.15.8:0/1023485469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff62c0f8740 0x7ff62c0f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.685+0000 7ff631dda700 1 -- 172.21.15.8:0/1023485469 >> 172.21.15.8:0/1023485469 conn(0x7ff62c0f40e0 msgr2=0x7ff62c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.685+0000 7ff631dda700 1 -- 172.21.15.8:0/1023485469 shutdown_connections 2023-10-18T21:38:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.685+0000 7ff631dda700 1 -- 172.21.15.8:0/1023485469 wait complete. 2023-10-18T21:38:59.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.686+0000 7ff631dda700 1 Processor -- start 2023-10-18T21:38:59.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.687+0000 7ff631dda700 1 -- start start 2023-10-18T21:38:59.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.687+0000 7ff631dda700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c0f8740 0x7ff62c108ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:59.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.687+0000 7ff631dda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff62c0f99e0 0x7ff62c1093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:59.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.687+0000 7ff631dda700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c109960 con 0x7ff62c0f8740 2023-10-18T21:38:59.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.687+0000 7ff631dda700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c109aa0 con 0x7ff62c0f99e0 2023-10-18T21:38:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.687+0000 7ff630dd8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c0f8740 0x7ff62c108ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff630dd8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c0f8740 0x7ff62c108ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34730/0 (socket says 172.21.15.8:34730) 2023-10-18T21:38:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff630dd8700 1 -- 172.21.15.8:0/2264455042 learned_addr learned my addr 172.21.15.8:0/2264455042 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:38:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff62bfff700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff62c0f99e0 0x7ff62c1093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff630dd8700 1 -- 172.21.15.8:0/2264455042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff62c0f99e0 msgr2=0x7ff62c1093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff630dd8700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff62c0f99e0 0x7ff62c1093b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff630dd8700 1 -- 172.21.15.8:0/2264455042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618005040 con 0x7ff62c0f8740 2023-10-18T21:38:59.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff630dd8700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c0f8740 0x7ff62c108ec0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7ff620002700 tx=0x7ff620009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:59.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff6297fa700 1 -- 172.21.15.8:0/2264455042 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6200079c0 con 0x7ff62c0f8740 2023-10-18T21:38:59.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff6297fa700 1 -- 172.21.15.8:0/2264455042 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff62000f040 con 0x7ff62c0f8740 2023-10-18T21:38:59.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff631dda700 1 -- 172.21.15.8:0/2264455042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c10a440 con 0x7ff62c0f8740 2023-10-18T21:38:59.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.688+0000 7ff6297fa700 1 -- 172.21.15.8:0/2264455042 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6200148d0 con 0x7ff62c0f8740 2023-10-18T21:38:59.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.689+0000 7ff631dda700 1 -- 172.21.15.8:0/2264455042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62c10aa00 con 0x7ff62c0f8740 2023-10-18T21:38:59.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.690+0000 7ff631dda700 1 -- 172.21.15.8:0/2264455042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62c045ad0 con 0x7ff62c0f8740 2023-10-18T21:38:59.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.690+0000 7ff6297fa700 1 -- 172.21.15.8:0/2264455042 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff62001b060 con 0x7ff62c0f8740 2023-10-18T21:38:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.691+0000 7ff6297fa700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff61c060f70 0x7ff61c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:38:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.691+0000 7ff6297fa700 1 -- 172.21.15.8:0/2264455042 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff62007c7f0 con 0x7ff62c0f8740 2023-10-18T21:38:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.691+0000 7ff62bfff700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff61c060f70 0x7ff61c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:38:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.692+0000 7ff62bfff700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff61c060f70 0x7ff61c063430 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7ff618004630 tx=0x7ff618009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:38:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.695+0000 7ff6297fa700 1 -- 172.21.15.8:0/2264455042 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff62004fe90 con 0x7ff62c0f8740 2023-10-18T21:38:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.949+0000 7ff631dda700 1 -- 172.21.15.8:0/2264455042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff62c101050 con 0x7ff62c0f8740 2023-10-18T21:38:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.949+0000 7ff6297fa700 1 -- 172.21.15.8:0/2264455042 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7ff62000e1a0 con 0x7ff62c0f8740 2023-10-18T21:38:59.951 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:38:59.951 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:38:59.951 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:38:59.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:38:59.952 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:38:59.952 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:38:59.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:38:59.952 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:38:59.952 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:38:59.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:38:59.953 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:38:59.953 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:38:59.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:38:59.954 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:38:59.954 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:38:59.954 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:38:59.954 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:38:59.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.951+0000 7ff631dda700 1 -- 172.21.15.8:0/2264455042 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff61c060f70 msgr2=0x7ff61c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.951+0000 7ff631dda700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff61c060f70 0x7ff61c063430 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7ff618004630 tx=0x7ff618009b30).stop 2023-10-18T21:38:59.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.951+0000 7ff631dda700 1 -- 172.21.15.8:0/2264455042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c0f8740 msgr2=0x7ff62c108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:38:59.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.951+0000 7ff631dda700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c0f8740 0x7ff62c108ec0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7ff620002700 tx=0x7ff620009e00).stop 2023-10-18T21:38:59.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.952+0000 7ff631dda700 1 -- 172.21.15.8:0/2264455042 shutdown_connections 2023-10-18T21:38:59.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.952+0000 7ff631dda700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff61c060f70 0x7ff61c063430 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.952+0000 7ff631dda700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c0f8740 0x7ff62c108ec0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.952+0000 7ff631dda700 1 --2- 172.21.15.8:0/2264455042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff62c0f99e0 0x7ff62c1093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:38:59.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.952+0000 7ff631dda700 1 -- 172.21.15.8:0/2264455042 >> 172.21.15.8:0/2264455042 conn(0x7ff62c0f40e0 msgr2=0x7ff62c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:38:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.952+0000 7ff631dda700 1 -- 172.21.15.8:0/2264455042 shutdown_connections 2023-10-18T21:38:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:38:59.952+0000 7ff631dda700 1 -- 172.21.15.8:0/2264455042 wait complete. 2023-10-18T21:39:00.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.088+0000 7f765ffff700 1 -- 172.21.15.8:0/1933546678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76600f6530 msgr2=0x7f76600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:00.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.088+0000 7f765ffff700 1 --2- 172.21.15.8:0/1933546678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76600f6530 0x7f76600f6950 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f7650004660 tx=0x7f7650009b30).stop 2023-10-18T21:39:00.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.089+0000 7f765ffff700 1 -- 172.21.15.8:0/1933546678 shutdown_connections 2023-10-18T21:39:00.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.089+0000 7f765ffff700 1 --2- 172.21.15.8:0/1933546678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76600f77d0 0x7f76600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.089+0000 7f765ffff700 1 --2- 172.21.15.8:0/1933546678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76600f6530 0x7f76600f6950 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.089+0000 7f765ffff700 1 -- 172.21.15.8:0/1933546678 >> 172.21.15.8:0/1933546678 conn(0x7f76600f1c90 msgr2=0x7f76600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:00.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.089+0000 7f765ffff700 1 -- 172.21.15.8:0/1933546678 shutdown_connections 2023-10-18T21:39:00.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.089+0000 7f765ffff700 1 -- 172.21.15.8:0/1933546678 wait complete. 2023-10-18T21:39:00.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.090+0000 7f765ffff700 1 Processor -- start 2023-10-18T21:39:00.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.090+0000 7f765ffff700 1 -- start start 2023-10-18T21:39:00.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.090+0000 7f765ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76600f6530 0x7f7660106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.090+0000 7f765ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76600f77d0 0x7f7660107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.090+0000 7f765ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7660107910 con 0x7f76600f6530 2023-10-18T21:39:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.090+0000 7f765ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7660108120 con 0x7f76600f77d0 2023-10-18T21:39:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.090+0000 7f765effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76600f6530 0x7f7660106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:00.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.090+0000 7f765effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76600f6530 0x7f7660106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34750/0 (socket says 172.21.15.8:34750) 2023-10-18T21:39:00.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.090+0000 7f765effd700 1 -- 172.21.15.8:0/2738570651 learned_addr learned my addr 172.21.15.8:0/2738570651 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:39:00.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.091+0000 7f765e7fc700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76600f77d0 0x7f7660107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:00.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.091+0000 7f765effd700 1 -- 172.21.15.8:0/2738570651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76600f77d0 msgr2=0x7f7660107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:00.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.091+0000 7f765effd700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76600f77d0 0x7f7660107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.091+0000 7f765effd700 1 -- 172.21.15.8:0/2738570651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650005040 con 0x7f76600f6530 2023-10-18T21:39:00.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.091+0000 7f765effd700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76600f6530 0x7f7660106e20 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f7650007a70 tx=0x7f7650009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:00.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.091+0000 7f76477fe700 1 -- 172.21.15.8:0/2738570651 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7650018070 con 0x7f76600f6530 2023-10-18T21:39:00.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.091+0000 7f76477fe700 1 -- 172.21.15.8:0/2738570651 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f765001d8e0 con 0x7f76600f6530 2023-10-18T21:39:00.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.091+0000 7f76477fe700 1 -- 172.21.15.8:0/2738570651 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f765001c660 con 0x7f76600f6530 2023-10-18T21:39:00.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.091+0000 7f765ffff700 1 -- 172.21.15.8:0/2738570651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7660108340 con 0x7f76600f6530 2023-10-18T21:39:00.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.091+0000 7f765ffff700 1 -- 172.21.15.8:0/2738570651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76601088a0 con 0x7f76600f6530 2023-10-18T21:39:00.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.092+0000 7f765ffff700 1 -- 172.21.15.8:0/2738570651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7660059100 con 0x7f76600f6530 2023-10-18T21:39:00.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.093+0000 7f76477fe700 1 -- 172.21.15.8:0/2738570651 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f765001da50 con 0x7f76600f6530 2023-10-18T21:39:00.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.094+0000 7f76477fe700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7648060f70 0x7f7648063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:00.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.094+0000 7f76477fe700 1 -- 172.21.15.8:0/2738570651 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f765007e8c0 con 0x7f76600f6530 2023-10-18T21:39:00.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.094+0000 7f765e7fc700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7648060f70 0x7f7648063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:00.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.095+0000 7f765e7fc700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7648060f70 0x7f7648063430 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f7654007fd0 tx=0x7f7654009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.098+0000 7f76477fe700 1 -- 172.21.15.8:0/2738570651 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f765004e4f0 con 0x7f76600f6530 2023-10-18T21:39:00.169 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:38:58.841919+0000 mgr.smithi008.flmjzp (mgr.14640) 2408 : cluster [DBG] pgmap v1662: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:00.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:38:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:58.850959+0000 mgr.smithi008.flmjzp (mgr.14640) 2409 : audit [DBG] from='client.36064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:38:58.841919+0000 mgr.smithi008.flmjzp (mgr.14640) 2408 : cluster [DBG] pgmap v1662: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:38:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:58.850959+0000 mgr.smithi008.flmjzp (mgr.14640) 2409 : audit [DBG] from='client.36064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:00.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.324+0000 7f765ffff700 1 -- 172.21.15.8:0/2738570651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76600fecc0 con 0x7f76600f6530 2023-10-18T21:39:00.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.325+0000 7f76477fe700 1 -- 172.21.15.8:0/2738570651 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f765001dce0 con 0x7f76600f6530 2023-10-18T21:39:00.326 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:39:00.327 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:39:00.327 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:39:00.327 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:39:00.327 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:39:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:39:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:39:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:39:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:39:00.328 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:39:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:39:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:39:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:39:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:39:00.329 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:39:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:39:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:39:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:39:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:39:00.330 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:39:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:39:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:39:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:39:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:39:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:39:00.331 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:39:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:39:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:39:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:39:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:39:00.332 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:39:00.333 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:39:00.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:39:00.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:39:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 -- 172.21.15.8:0/2738570651 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7648060f70 msgr2=0x7f7648063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7648060f70 0x7f7648063430 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f7654007fd0 tx=0x7f7654009040).stop 2023-10-18T21:39:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 -- 172.21.15.8:0/2738570651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76600f6530 msgr2=0x7f7660106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76600f6530 0x7f7660106e20 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f7650007a70 tx=0x7f7650009b30).stop 2023-10-18T21:39:00.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 -- 172.21.15.8:0/2738570651 shutdown_connections 2023-10-18T21:39:00.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7648060f70 0x7f7648063430 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76600f6530 0x7f7660106e20 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 --2- 172.21.15.8:0/2738570651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76600f77d0 0x7f7660107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 -- 172.21.15.8:0/2738570651 >> 172.21.15.8:0/2738570651 conn(0x7f76600f1c90 msgr2=0x7f76600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 -- 172.21.15.8:0/2738570651 shutdown_connections 2023-10-18T21:39:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.327+0000 7f765ffff700 1 -- 172.21.15.8:0/2738570651 wait complete. 2023-10-18T21:39:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:39:00.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.464+0000 7fa3910a8700 1 -- 172.21.15.8:0/4187257150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa38c0f77d0 msgr2=0x7fa38c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:00.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.464+0000 7fa3910a8700 1 --2- 172.21.15.8:0/4187257150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa38c0f77d0 0x7fa38c0f7c30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fa380004660 tx=0x7fa380009b30).stop 2023-10-18T21:39:00.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.464+0000 7fa3910a8700 1 -- 172.21.15.8:0/4187257150 shutdown_connections 2023-10-18T21:39:00.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.464+0000 7fa3910a8700 1 --2- 172.21.15.8:0/4187257150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa38c0f77d0 0x7fa38c0f7c30 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.464+0000 7fa3910a8700 1 --2- 172.21.15.8:0/4187257150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c0f6530 0x7fa38c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.464+0000 7fa3910a8700 1 -- 172.21.15.8:0/4187257150 >> 172.21.15.8:0/4187257150 conn(0x7fa38c0f1c90 msgr2=0x7fa38c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:00.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.464+0000 7fa3910a8700 1 -- 172.21.15.8:0/4187257150 shutdown_connections 2023-10-18T21:39:00.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.464+0000 7fa3910a8700 1 -- 172.21.15.8:0/4187257150 wait complete. 2023-10-18T21:39:00.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.465+0000 7fa3910a8700 1 Processor -- start 2023-10-18T21:39:00.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.465+0000 7fa3910a8700 1 -- start start 2023-10-18T21:39:00.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.466+0000 7fa3910a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c0f6530 0x7fa38c106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.466+0000 7fa3910a8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa38c0f77d0 0x7fa38c107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.466+0000 7fa3910a8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c1077d0 con 0x7fa38c0f77d0 2023-10-18T21:39:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.466+0000 7fa3910a8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c107fd0 con 0x7fa38c0f6530 2023-10-18T21:39:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.466+0000 7fa38b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa38c0f77d0 0x7fa38c107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.466+0000 7fa38b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa38c0f77d0 0x7fa38c107220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34764/0 (socket says 172.21.15.8:34764) 2023-10-18T21:39:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.466+0000 7fa38b7fe700 1 -- 172.21.15.8:0/1968781420 learned_addr learned my addr 172.21.15.8:0/1968781420 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:39:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.466+0000 7fa38bfff700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c0f6530 0x7fa38c106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.466+0000 7fa38b7fe700 1 -- 172.21.15.8:0/1968781420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c0f6530 msgr2=0x7fa38c106d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.466+0000 7fa38b7fe700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c0f6530 0x7fa38c106d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.467+0000 7fa38b7fe700 1 -- 172.21.15.8:0/1968781420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380005040 con 0x7fa38c0f77d0 2023-10-18T21:39:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.467+0000 7fa38b7fe700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa38c0f77d0 0x7fa38c107220 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fa380004320 tx=0x7fa38000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.467+0000 7fa388ff9700 1 -- 172.21.15.8:0/1968781420 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa380019070 con 0x7fa38c0f77d0 2023-10-18T21:39:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.467+0000 7fa388ff9700 1 -- 172.21.15.8:0/1968781420 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa38001e420 con 0x7fa38c0f77d0 2023-10-18T21:39:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.467+0000 7fa3910a8700 1 -- 172.21.15.8:0/1968781420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c108250 con 0x7fa38c0f77d0 2023-10-18T21:39:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.467+0000 7fa388ff9700 1 -- 172.21.15.8:0/1968781420 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa380014680 con 0x7fa38c0f77d0 2023-10-18T21:39:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.467+0000 7fa3910a8700 1 -- 172.21.15.8:0/1968781420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c108730 con 0x7fa38c0f77d0 2023-10-18T21:39:00.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.468+0000 7fa3910a8700 1 -- 172.21.15.8:0/1968781420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c059100 con 0x7fa38c0f77d0 2023-10-18T21:39:00.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.469+0000 7fa388ff9700 1 -- 172.21.15.8:0/1968781420 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa38001e590 con 0x7fa38c0f77d0 2023-10-18T21:39:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.470+0000 7fa388ff9700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa374060f70 0x7fa374063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.470+0000 7fa388ff9700 1 -- 172.21.15.8:0/1968781420 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa38007ddc0 con 0x7fa38c0f77d0 2023-10-18T21:39:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.470+0000 7fa38bfff700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa374060f70 0x7fa374063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.471+0000 7fa38bfff700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa374060f70 0x7fa374063430 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fa37c009fd0 tx=0x7fa37c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.474+0000 7fa388ff9700 1 -- 172.21.15.8:0/1968781420 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa380081030 con 0x7fa38c0f77d0 2023-10-18T21:39:00.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.673+0000 7fa3910a8700 1 -- 172.21.15.8:0/1968781420 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa38c0fed30 con 0x7fa374060f70 2023-10-18T21:39:00.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.674+0000 7fa388ff9700 1 -- 172.21.15.8:0/1968781420 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa38c0fed30 con 0x7fa374060f70 2023-10-18T21:39:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:39:00.675 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:39:00.675 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:39:00.676 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:39:00.676 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:39:00.676 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:39:00.676 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:39:00.676 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:39:00.677 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:39:00.677 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:39:00.677 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:39:00.677 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:39:00.678 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:39:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:39:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 -- 172.21.15.8:0/1968781420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa374060f70 msgr2=0x7fa374063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa374060f70 0x7fa374063430 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fa37c009fd0 tx=0x7fa37c00b040).stop 2023-10-18T21:39:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 -- 172.21.15.8:0/1968781420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa38c0f77d0 msgr2=0x7fa38c107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa38c0f77d0 0x7fa38c107220 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fa380004320 tx=0x7fa38000b040).stop 2023-10-18T21:39:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 -- 172.21.15.8:0/1968781420 shutdown_connections 2023-10-18T21:39:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa374060f70 0x7fa374063430 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c0f6530 0x7fa38c106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 --2- 172.21.15.8:0/1968781420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa38c0f77d0 0x7fa38c107220 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 -- 172.21.15.8:0/1968781420 >> 172.21.15.8:0/1968781420 conn(0x7fa38c0f1c90 msgr2=0x7fa38c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 -- 172.21.15.8:0/1968781420 shutdown_connections 2023-10-18T21:39:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:00.676+0000 7fa3910a8700 1 -- 172.21.15.8:0/1968781420 wait complete. 2023-10-18T21:39:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:59.200335+0000 mgr.smithi008.flmjzp (mgr.14640) 2410 : audit [DBG] from='client.36068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:59.539493+0000 mgr.smithi008.flmjzp (mgr.14640) 2411 : audit [DBG] from='client.36072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:38:59.950026+0000 mon.smithi008 (mon.0) 2827 : audit [DBG] from='client.? 172.21.15.8:0/2264455042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:00.325661+0000 mon.smithi008 (mon.0) 2828 : audit [DBG] from='client.? 172.21.15.8:0/2738570651' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:39:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:59.200335+0000 mgr.smithi008.flmjzp (mgr.14640) 2410 : audit [DBG] from='client.36068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:59.539493+0000 mgr.smithi008.flmjzp (mgr.14640) 2411 : audit [DBG] from='client.36072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:38:59.950026+0000 mon.smithi008 (mon.0) 2827 : audit [DBG] from='client.? 172.21.15.8:0/2264455042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:01.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:00.325661+0000 mon.smithi008 (mon.0) 2828 : audit [DBG] from='client.? 172.21.15.8:0/2738570651' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:39:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:00.674318+0000 mgr.smithi008.flmjzp (mgr.14640) 2412 : audit [DBG] from='client.36084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:00.842423+0000 mgr.smithi008.flmjzp (mgr.14640) 2413 : cluster [DBG] pgmap v1663: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:02.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:00.674318+0000 mgr.smithi008.flmjzp (mgr.14640) 2412 : audit [DBG] from='client.36084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:02.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:00.842423+0000 mgr.smithi008.flmjzp (mgr.14640) 2413 : cluster [DBG] pgmap v1663: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:02.842979+0000 mgr.smithi008.flmjzp (mgr.14640) 2414 : cluster [DBG] pgmap v1664: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:04.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:02.842979+0000 mgr.smithi008.flmjzp (mgr.14640) 2414 : cluster [DBG] pgmap v1664: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:05.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:04.876672+0000 mon.smithi008 (mon.0) 2829 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:05.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:04.876672+0000 mon.smithi008 (mon.0) 2829 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:04.843521+0000 mgr.smithi008.flmjzp (mgr.14640) 2415 : cluster [DBG] pgmap v1665: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:05.436270+0000 mon.smithi008 (mon.0) 2830 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:05.437422+0000 mon.smithi008 (mon.0) 2831 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:05.444066+0000 mon.smithi008 (mon.0) 2832 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:05.451721+0000 mon.smithi008 (mon.0) 2833 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:05.454972+0000 mon.smithi008 (mon.0) 2834 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:05.456685+0000 mon.smithi008 (mon.0) 2835 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:06.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:05.458217+0000 mon.smithi008 (mon.0) 2836 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:06.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:05.460170+0000 mon.smithi008 (mon.0) 2837 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:06.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:04.843521+0000 mgr.smithi008.flmjzp (mgr.14640) 2415 : cluster [DBG] pgmap v1665: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:05.436270+0000 mon.smithi008 (mon.0) 2830 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:05.437422+0000 mon.smithi008 (mon.0) 2831 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:05.444066+0000 mon.smithi008 (mon.0) 2832 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:05.451721+0000 mon.smithi008 (mon.0) 2833 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:05.454972+0000 mon.smithi008 (mon.0) 2834 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:05.456685+0000 mon.smithi008 (mon.0) 2835 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:05.458217+0000 mon.smithi008 (mon.0) 2836 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:05.460170+0000 mon.smithi008 (mon.0) 2837 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:07.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:05.438378+0000 mgr.smithi008.flmjzp (mgr.14640) 2416 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:07.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:05.439058+0000 mgr.smithi008.flmjzp (mgr.14640) 2417 : cluster [DBG] pgmap v1666: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:07.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:05.439355+0000 mgr.smithi008.flmjzp (mgr.14640) 2418 : cluster [DBG] pgmap v1667: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:07.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:05.462054+0000 mgr.smithi008.flmjzp (mgr.14640) 2419 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:07.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:05.438378+0000 mgr.smithi008.flmjzp (mgr.14640) 2416 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:05.439058+0000 mgr.smithi008.flmjzp (mgr.14640) 2417 : cluster [DBG] pgmap v1666: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:05.439355+0000 mgr.smithi008.flmjzp (mgr.14640) 2418 : cluster [DBG] pgmap v1667: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:05.462054+0000 mgr.smithi008.flmjzp (mgr.14640) 2419 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:09.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:07.439893+0000 mgr.smithi008.flmjzp (mgr.14640) 2420 : cluster [DBG] pgmap v1668: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:09.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:07.439893+0000 mgr.smithi008.flmjzp (mgr.14640) 2420 : cluster [DBG] pgmap v1668: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:09.440547+0000 mgr.smithi008.flmjzp (mgr.14640) 2421 : cluster [DBG] pgmap v1669: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:11.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:09.440547+0000 mgr.smithi008.flmjzp (mgr.14640) 2421 : cluster [DBG] pgmap v1669: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:11.441214+0000 mgr.smithi008.flmjzp (mgr.14640) 2422 : cluster [DBG] pgmap v1670: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:13.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:11.441214+0000 mgr.smithi008.flmjzp (mgr.14640) 2422 : cluster [DBG] pgmap v1670: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:15.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:13.441939+0000 mgr.smithi008.flmjzp (mgr.14640) 2423 : cluster [DBG] pgmap v1671: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:13.441939+0000 mgr.smithi008.flmjzp (mgr.14640) 2423 : cluster [DBG] pgmap v1671: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:16.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:15.470749+0000 mon.smithi008 (mon.0) 2838 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:15.472930+0000 mon.smithi008 (mon.0) 2839 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:15.473932+0000 mon.smithi008 (mon.0) 2840 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:15.480538+0000 mon.smithi008 (mon.0) 2841 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:15.496699+0000 mon.smithi008 (mon.0) 2842 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:15.500139+0000 mon.smithi008 (mon.0) 2843 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:15.501884+0000 mon.smithi008 (mon.0) 2844 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:15.503640+0000 mon.smithi008 (mon.0) 2845 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:15.506140+0000 mon.smithi008 (mon.0) 2846 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:15.470749+0000 mon.smithi008 (mon.0) 2838 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:15.472930+0000 mon.smithi008 (mon.0) 2839 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:15.473932+0000 mon.smithi008 (mon.0) 2840 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:15.480538+0000 mon.smithi008 (mon.0) 2841 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:15.496699+0000 mon.smithi008 (mon.0) 2842 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:15.500139+0000 mon.smithi008 (mon.0) 2843 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:15.501884+0000 mon.smithi008 (mon.0) 2844 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:15.503640+0000 mon.smithi008 (mon.0) 2845 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:15.506140+0000 mon.smithi008 (mon.0) 2846 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:17.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:15.442496+0000 mgr.smithi008.flmjzp (mgr.14640) 2424 : cluster [DBG] pgmap v1672: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:15.474785+0000 mgr.smithi008.flmjzp (mgr.14640) 2425 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:15.475364+0000 mgr.smithi008.flmjzp (mgr.14640) 2426 : cluster [DBG] pgmap v1673: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:15.475608+0000 mgr.smithi008.flmjzp (mgr.14640) 2427 : cluster [DBG] pgmap v1674: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:15.515882+0000 mgr.smithi008.flmjzp (mgr.14640) 2428 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:15.442496+0000 mgr.smithi008.flmjzp (mgr.14640) 2424 : cluster [DBG] pgmap v1672: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:15.474785+0000 mgr.smithi008.flmjzp (mgr.14640) 2425 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:15.475364+0000 mgr.smithi008.flmjzp (mgr.14640) 2426 : cluster [DBG] pgmap v1673: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:15.475608+0000 mgr.smithi008.flmjzp (mgr.14640) 2427 : cluster [DBG] pgmap v1674: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:15.515882+0000 mgr.smithi008.flmjzp (mgr.14640) 2428 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:19.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:17.476310+0000 mgr.smithi008.flmjzp (mgr.14640) 2429 : cluster [DBG] pgmap v1675: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:17.476310+0000 mgr.smithi008.flmjzp (mgr.14640) 2429 : cluster [DBG] pgmap v1675: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:21.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:19.476811+0000 mgr.smithi008.flmjzp (mgr.14640) 2430 : cluster [DBG] pgmap v1676: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:19.476811+0000 mgr.smithi008.flmjzp (mgr.14640) 2430 : cluster [DBG] pgmap v1676: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:23.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:21.477331+0000 mgr.smithi008.flmjzp (mgr.14640) 2431 : cluster [DBG] pgmap v1677: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:21.477331+0000 mgr.smithi008.flmjzp (mgr.14640) 2431 : cluster [DBG] pgmap v1677: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:25.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:23.477886+0000 mgr.smithi008.flmjzp (mgr.14640) 2432 : cluster [DBG] pgmap v1678: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:23.477886+0000 mgr.smithi008.flmjzp (mgr.14640) 2432 : cluster [DBG] pgmap v1678: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:25.478365+0000 mgr.smithi008.flmjzp (mgr.14640) 2433 : cluster [DBG] pgmap v1679: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:25.526587+0000 mon.smithi008 (mon.0) 2847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:25.528716+0000 mon.smithi008 (mon.0) 2848 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:25.529701+0000 mon.smithi008 (mon.0) 2849 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:25.530589+0000 mgr.smithi008.flmjzp (mgr.14640) 2434 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:25.531167+0000 mgr.smithi008.flmjzp (mgr.14640) 2435 : cluster [DBG] pgmap v1680: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:25.531402+0000 mgr.smithi008.flmjzp (mgr.14640) 2436 : cluster [DBG] pgmap v1681: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:26.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:25.535842+0000 mon.smithi008 (mon.0) 2850 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:26.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:25.542035+0000 mon.smithi008 (mon.0) 2851 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:26.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:25.545146+0000 mon.smithi008 (mon.0) 2852 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:26.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:25.546715+0000 mon.smithi008 (mon.0) 2853 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:26.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:25.548271+0000 mon.smithi008 (mon.0) 2854 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:26.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:25.550254+0000 mon.smithi008 (mon.0) 2855 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:26.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:25.552151+0000 mgr.smithi008.flmjzp (mgr.14640) 2437 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:26.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:25.478365+0000 mgr.smithi008.flmjzp (mgr.14640) 2433 : cluster [DBG] pgmap v1679: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:25.526587+0000 mon.smithi008 (mon.0) 2847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:25.528716+0000 mon.smithi008 (mon.0) 2848 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:25.529701+0000 mon.smithi008 (mon.0) 2849 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:25.530589+0000 mgr.smithi008.flmjzp (mgr.14640) 2434 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:25.531167+0000 mgr.smithi008.flmjzp (mgr.14640) 2435 : cluster [DBG] pgmap v1680: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:25.531402+0000 mgr.smithi008.flmjzp (mgr.14640) 2436 : cluster [DBG] pgmap v1681: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:25.535842+0000 mon.smithi008 (mon.0) 2850 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:25.542035+0000 mon.smithi008 (mon.0) 2851 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:25.545146+0000 mon.smithi008 (mon.0) 2852 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:25.546715+0000 mon.smithi008 (mon.0) 2853 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:26.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:25.548271+0000 mon.smithi008 (mon.0) 2854 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:26.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:25.550254+0000 mon.smithi008 (mon.0) 2855 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:26.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:25.552151+0000 mgr.smithi008.flmjzp (mgr.14640) 2437 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:27.531957+0000 mgr.smithi008.flmjzp (mgr.14640) 2438 : cluster [DBG] pgmap v1682: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:28.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:27.531957+0000 mgr.smithi008.flmjzp (mgr.14640) 2438 : cluster [DBG] pgmap v1682: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:30.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.829+0000 7ff0d7fff700 1 -- 172.21.15.8:0/2744700987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f77d0 msgr2=0x7ff0d80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:30.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.829+0000 7ff0d7fff700 1 --2- 172.21.15.8:0/2744700987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f77d0 0x7ff0d80f7c30 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7ff0cc004660 tx=0x7ff0cc009b30).stop 2023-10-18T21:39:30.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.829+0000 7ff0d7fff700 1 -- 172.21.15.8:0/2744700987 shutdown_connections 2023-10-18T21:39:30.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.830+0000 7ff0d7fff700 1 --2- 172.21.15.8:0/2744700987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f77d0 0x7ff0d80f7c30 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:30.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.830+0000 7ff0d7fff700 1 --2- 172.21.15.8:0/2744700987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f6530 0x7ff0d80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:30.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.830+0000 7ff0d7fff700 1 -- 172.21.15.8:0/2744700987 >> 172.21.15.8:0/2744700987 conn(0x7ff0d80f1c90 msgr2=0x7ff0d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:30.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.830+0000 7ff0d7fff700 1 -- 172.21.15.8:0/2744700987 shutdown_connections 2023-10-18T21:39:30.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.830+0000 7ff0d7fff700 1 -- 172.21.15.8:0/2744700987 wait complete. 2023-10-18T21:39:30.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.831+0000 7ff0d7fff700 1 Processor -- start 2023-10-18T21:39:30.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.831+0000 7ff0d7fff700 1 -- start start 2023-10-18T21:39:30.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.831+0000 7ff0d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:30.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.831+0000 7ff0d7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 0x7ff0d8109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:30.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.831+0000 7ff0d7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81099f0 con 0x7ff0d80f6530 2023-10-18T21:39:30.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.831+0000 7ff0d7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8109b30 con 0x7ff0d80f77d0 2023-10-18T21:39:30.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.831+0000 7ff0d6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:30.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.831+0000 7ff0d6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53594/0 (socket says 172.21.15.8:53594) 2023-10-18T21:39:30.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.831+0000 7ff0d6ffd700 1 -- 172.21.15.8:0/646198684 learned_addr learned my addr 172.21.15.8:0/646198684 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:39:30.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.832+0000 7ff0d67fc700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 0x7ff0d8109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:30.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.832+0000 7ff0d6ffd700 1 -- 172.21.15.8:0/646198684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 msgr2=0x7ff0d8109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:30.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.832+0000 7ff0d6ffd700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 0x7ff0d8109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:30.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.832+0000 7ff0d6ffd700 1 -- 172.21.15.8:0/646198684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc005040 con 0x7ff0d80f6530 2023-10-18T21:39:30.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.832+0000 7ff0d6ffd700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8108f50 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7ff0c8002700 tx=0x7ff0c8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:30.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.832+0000 7ff0bf7fe700 1 -- 172.21.15.8:0/646198684 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0c80079c0 con 0x7ff0d80f6530 2023-10-18T21:39:30.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.833+0000 7ff0bf7fe700 1 -- 172.21.15.8:0/646198684 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff0c800f040 con 0x7ff0d80f6530 2023-10-18T21:39:30.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.833+0000 7ff0d7fff700 1 -- 172.21.15.8:0/646198684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d810a4d0 con 0x7ff0d80f6530 2023-10-18T21:39:30.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.833+0000 7ff0bf7fe700 1 -- 172.21.15.8:0/646198684 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0c80148d0 con 0x7ff0d80f6530 2023-10-18T21:39:30.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.833+0000 7ff0d7fff700 1 -- 172.21.15.8:0/646198684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d810aa90 con 0x7ff0d80f6530 2023-10-18T21:39:30.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.834+0000 7ff0d7fff700 1 -- 172.21.15.8:0/646198684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8045ad0 con 0x7ff0d80f6530 2023-10-18T21:39:30.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.836+0000 7ff0bf7fe700 1 -- 172.21.15.8:0/646198684 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff0c801b060 con 0x7ff0d80f6530 2023-10-18T21:39:30.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.836+0000 7ff0bf7fe700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c0060f70 0x7ff0c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:30.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.836+0000 7ff0bf7fe700 1 -- 172.21.15.8:0/646198684 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff0c807c790 con 0x7ff0d80f6530 2023-10-18T21:39:30.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.837+0000 7ff0d67fc700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c0060f70 0x7ff0c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:30.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.837+0000 7ff0d67fc700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c0060f70 0x7ff0c0063430 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7ff0cc004630 tx=0x7ff0cc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:30.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:30.841+0000 7ff0bf7fe700 1 -- 172.21.15.8:0/646198684 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff0c804fdb0 con 0x7ff0d80f6530 2023-10-18T21:39:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:29.532524+0000 mgr.smithi008.flmjzp (mgr.14640) 2439 : cluster [DBG] pgmap v1683: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:30.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:29.532524+0000 mgr.smithi008.flmjzp (mgr.14640) 2439 : cluster [DBG] pgmap v1683: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:31.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.041+0000 7ff0d7fff700 1 -- 172.21.15.8:0/646198684 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0d810ad10 con 0x7ff0c0060f70 2023-10-18T21:39:31.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.043+0000 7ff0bf7fe700 1 -- 172.21.15.8:0/646198684 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff0d810ad10 con 0x7ff0c0060f70 2023-10-18T21:39:31.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.044+0000 7ff0d7fff700 1 -- 172.21.15.8:0/646198684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c0060f70 msgr2=0x7ff0c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.044+0000 7ff0d7fff700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c0060f70 0x7ff0c0063430 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7ff0cc004630 tx=0x7ff0cc009b30).stop 2023-10-18T21:39:31.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.044+0000 7ff0d7fff700 1 -- 172.21.15.8:0/646198684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 msgr2=0x7ff0d8108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.045+0000 7ff0d7fff700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8108f50 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7ff0c8002700 tx=0x7ff0c8009d80).stop 2023-10-18T21:39:31.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.045+0000 7ff0d7fff700 1 -- 172.21.15.8:0/646198684 shutdown_connections 2023-10-18T21:39:31.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.045+0000 7ff0d7fff700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c0060f70 0x7ff0c0063430 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.045+0000 7ff0d7fff700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8108f50 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.045+0000 7ff0d7fff700 1 --2- 172.21.15.8:0/646198684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 0x7ff0d8109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.045+0000 7ff0d7fff700 1 -- 172.21.15.8:0/646198684 >> 172.21.15.8:0/646198684 conn(0x7ff0d80f1c90 msgr2=0x7ff0d80f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:31.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.045+0000 7ff0d7fff700 1 -- 172.21.15.8:0/646198684 shutdown_connections 2023-10-18T21:39:31.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.045+0000 7ff0d7fff700 1 -- 172.21.15.8:0/646198684 wait complete. 2023-10-18T21:39:31.061 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:39:31.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.183+0000 7f606e5c5700 1 -- 172.21.15.8:0/2305475668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60680f6530 msgr2=0x7f60680f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.183+0000 7f606e5c5700 1 --2- 172.21.15.8:0/2305475668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60680f6530 0x7f60680f6950 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f6064004660 tx=0x7f6064009b30).stop 2023-10-18T21:39:31.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.183+0000 7f606e5c5700 1 -- 172.21.15.8:0/2305475668 shutdown_connections 2023-10-18T21:39:31.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.183+0000 7f606e5c5700 1 --2- 172.21.15.8:0/2305475668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680f77d0 0x7f60680f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.183+0000 7f606e5c5700 1 --2- 172.21.15.8:0/2305475668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60680f6530 0x7f60680f6950 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.183+0000 7f606e5c5700 1 -- 172.21.15.8:0/2305475668 >> 172.21.15.8:0/2305475668 conn(0x7f60680f1c90 msgr2=0x7f60680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:31.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.183+0000 7f606e5c5700 1 -- 172.21.15.8:0/2305475668 shutdown_connections 2023-10-18T21:39:31.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.183+0000 7f606e5c5700 1 -- 172.21.15.8:0/2305475668 wait complete. 2023-10-18T21:39:31.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.184+0000 7f606e5c5700 1 Processor -- start 2023-10-18T21:39:31.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.184+0000 7f606e5c5700 1 -- start start 2023-10-18T21:39:31.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.185+0000 7f606e5c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60680f6530 0x7f606806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.185+0000 7f606e5c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680f77d0 0x7f6068069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.185+0000 7f606e5c5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606806a380 con 0x7f60680f6530 2023-10-18T21:39:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.185+0000 7f606e5c5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606806a4c0 con 0x7f60680f77d0 2023-10-18T21:39:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.185+0000 7f606d5c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60680f6530 0x7f606806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:31.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.185+0000 7f606d5c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60680f6530 0x7f606806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53616/0 (socket says 172.21.15.8:53616) 2023-10-18T21:39:31.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.185+0000 7f606d5c3700 1 -- 172.21.15.8:0/3527697599 learned_addr learned my addr 172.21.15.8:0/3527697599 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:39:31.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.186+0000 7f606cdc2700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680f77d0 0x7f6068069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:31.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.186+0000 7f606d5c3700 1 -- 172.21.15.8:0/3527697599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680f77d0 msgr2=0x7f6068069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.186+0000 7f606d5c3700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680f77d0 0x7f6068069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.186+0000 7f606d5c3700 1 -- 172.21.15.8:0/3527697599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6064005040 con 0x7f60680f6530 2023-10-18T21:39:31.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.186+0000 7f606d5c3700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60680f6530 0x7f606806b9a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f6064009870 tx=0x7f606400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:31.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.186+0000 7f605dffb700 1 -- 172.21.15.8:0/3527697599 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6064019070 con 0x7f60680f6530 2023-10-18T21:39:31.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.186+0000 7f606e5c5700 1 -- 172.21.15.8:0/3527697599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606806a740 con 0x7f60680f6530 2023-10-18T21:39:31.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.186+0000 7f605dffb700 1 -- 172.21.15.8:0/3527697599 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f606401e420 con 0x7f60680f6530 2023-10-18T21:39:31.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.186+0000 7f605dffb700 1 -- 172.21.15.8:0/3527697599 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6064014660 con 0x7f60680f6530 2023-10-18T21:39:31.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.186+0000 7f606e5c5700 1 -- 172.21.15.8:0/3527697599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606806ac20 con 0x7f60680f6530 2023-10-18T21:39:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.188+0000 7f606e5c5700 1 -- 172.21.15.8:0/3527697599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6068045ad0 con 0x7f60680f6530 2023-10-18T21:39:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.188+0000 7f605dffb700 1 -- 172.21.15.8:0/3527697599 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f606401e9c0 con 0x7f60680f6530 2023-10-18T21:39:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.189+0000 7f605dffb700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6054060f70 0x7f6054063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:31.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.189+0000 7f605dffb700 1 -- 172.21.15.8:0/3527697599 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f606407ddd0 con 0x7f60680f6530 2023-10-18T21:39:31.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.189+0000 7f606cdc2700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6054060f70 0x7f6054063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:31.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.190+0000 7f606cdc2700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6054060f70 0x7f6054063430 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f6058007fd0 tx=0x7f605800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:31.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.194+0000 7f605dffb700 1 -- 172.21.15.8:0/3527697599 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f606404da40 con 0x7f60680f6530 2023-10-18T21:39:31.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.391+0000 7f606e5c5700 1 -- 172.21.15.8:0/3527697599 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60680fee00 con 0x7f6054060f70 2023-10-18T21:39:31.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.392+0000 7f605dffb700 1 -- 172.21.15.8:0/3527697599 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f60680fee00 con 0x7f6054060f70 2023-10-18T21:39:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.394+0000 7f606e5c5700 1 -- 172.21.15.8:0/3527697599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6054060f70 msgr2=0x7f6054063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.394+0000 7f606e5c5700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6054060f70 0x7f6054063430 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f6058007fd0 tx=0x7f605800b040).stop 2023-10-18T21:39:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.394+0000 7f606e5c5700 1 -- 172.21.15.8:0/3527697599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60680f6530 msgr2=0x7f606806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.394+0000 7f606e5c5700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60680f6530 0x7f606806b9a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f6064009870 tx=0x7f606400b040).stop 2023-10-18T21:39:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.395+0000 7f606e5c5700 1 -- 172.21.15.8:0/3527697599 shutdown_connections 2023-10-18T21:39:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.395+0000 7f606e5c5700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6054060f70 0x7f6054063430 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.395+0000 7f606e5c5700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60680f6530 0x7f606806b9a0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.395+0000 7f606e5c5700 1 --2- 172.21.15.8:0/3527697599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680f77d0 0x7f6068069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.395+0000 7f606e5c5700 1 -- 172.21.15.8:0/3527697599 >> 172.21.15.8:0/3527697599 conn(0x7f60680f1c90 msgr2=0x7f60680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.395+0000 7f606e5c5700 1 -- 172.21.15.8:0/3527697599 shutdown_connections 2023-10-18T21:39:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.395+0000 7f606e5c5700 1 -- 172.21.15.8:0/3527697599 wait complete. 2023-10-18T21:39:31.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.532+0000 7fbe3359e700 1 -- 172.21.15.8:0/71134901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe340f77d0 msgr2=0x7fbe340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.532+0000 7fbe3359e700 1 --2- 172.21.15.8:0/71134901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe340f77d0 0x7fbe340f7c30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7fbe28004660 tx=0x7fbe28009b30).stop 2023-10-18T21:39:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.532+0000 7fbe3359e700 1 -- 172.21.15.8:0/71134901 shutdown_connections 2023-10-18T21:39:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.532+0000 7fbe3359e700 1 --2- 172.21.15.8:0/71134901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe340f77d0 0x7fbe340f7c30 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.532+0000 7fbe3359e700 1 --2- 172.21.15.8:0/71134901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe340f6530 0x7fbe340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.532+0000 7fbe3359e700 1 -- 172.21.15.8:0/71134901 >> 172.21.15.8:0/71134901 conn(0x7fbe340f1c90 msgr2=0x7fbe340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.532+0000 7fbe3359e700 1 -- 172.21.15.8:0/71134901 shutdown_connections 2023-10-18T21:39:31.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.532+0000 7fbe3359e700 1 -- 172.21.15.8:0/71134901 wait complete. 2023-10-18T21:39:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.533+0000 7fbe3359e700 1 Processor -- start 2023-10-18T21:39:31.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.533+0000 7fbe3359e700 1 -- start start 2023-10-18T21:39:31.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.533+0000 7fbe3359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe340f6530 0x7fbe34108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:31.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.533+0000 7fbe3359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe340f77d0 0x7fbe34109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:31.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.533+0000 7fbe3359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe341099d0 con 0x7fbe340f6530 2023-10-18T21:39:31.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.533+0000 7fbe3359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe34109b10 con 0x7fbe340f77d0 2023-10-18T21:39:31.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe3259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe340f6530 0x7fbe34108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:31.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe3259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe340f6530 0x7fbe34108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53636/0 (socket says 172.21.15.8:53636) 2023-10-18T21:39:31.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe3259c700 1 -- 172.21.15.8:0/2123794537 learned_addr learned my addr 172.21.15.8:0/2123794537 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:39:31.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe31d9b700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe340f77d0 0x7fbe34109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:31.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe3259c700 1 -- 172.21.15.8:0/2123794537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe340f77d0 msgr2=0x7fbe34109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe3259c700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe340f77d0 0x7fbe34109420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe3259c700 1 -- 172.21.15.8:0/2123794537 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe28005040 con 0x7fbe340f6530 2023-10-18T21:39:31.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe3259c700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe340f6530 0x7fbe34108f30 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fbe2400c790 tx=0x7fbe24007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe22ffd700 1 -- 172.21.15.8:0/2123794537 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe24013630 con 0x7fbe340f6530 2023-10-18T21:39:31.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe22ffd700 1 -- 172.21.15.8:0/2123794537 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbe24012870 con 0x7fbe340f6530 2023-10-18T21:39:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.534+0000 7fbe3359e700 1 -- 172.21.15.8:0/2123794537 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3410a4b0 con 0x7fbe340f6530 2023-10-18T21:39:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.535+0000 7fbe22ffd700 1 -- 172.21.15.8:0/2123794537 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe24002830 con 0x7fbe340f6530 2023-10-18T21:39:31.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.535+0000 7fbe3359e700 1 -- 172.21.15.8:0/2123794537 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3410aa70 con 0x7fbe340f6530 2023-10-18T21:39:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.536+0000 7fbe3359e700 1 -- 172.21.15.8:0/2123794537 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe34045ad0 con 0x7fbe340f6530 2023-10-18T21:39:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.537+0000 7fbe22ffd700 1 -- 172.21.15.8:0/2123794537 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbe24010070 con 0x7fbe340f6530 2023-10-18T21:39:31.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.537+0000 7fbe22ffd700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe1c060f70 0x7fbe1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.538+0000 7fbe22ffd700 1 -- 172.21.15.8:0/2123794537 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbe2407c9c0 con 0x7fbe340f6530 2023-10-18T21:39:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.538+0000 7fbe31d9b700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe1c060f70 0x7fbe1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:31.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.538+0000 7fbe31d9b700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe1c060f70 0x7fbe1c063430 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fbe28004630 tx=0x7fbe28009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:31.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.542+0000 7fbe22ffd700 1 -- 172.21.15.8:0/2123794537 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbe2404ffc0 con 0x7fbe340f6530 2023-10-18T21:39:31.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.735+0000 7fbe3359e700 1 -- 172.21.15.8:0/2123794537 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe340fee00 con 0x7fbe1c060f70 2023-10-18T21:39:31.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.745+0000 7fbe22ffd700 1 -- 172.21.15.8:0/2123794537 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fbe340fee00 con 0x7fbe1c060f70 2023-10-18T21:39:31.747 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:39:31.747 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (46m) 3m ago 47m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:39:31.747 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (40m) 3m ago 47m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:39:31.747 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (39m) 108s ago 46m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:39:31.747 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (46m) 3m ago 47m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:39:31.748 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 43m - - 2023-10-18T21:39:31.748 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 43m - - 2023-10-18T21:39:31.748 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 108s ago 43m - - 2023-10-18T21:39:31.748 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 108s ago 43m - - 2023-10-18T21:39:31.748 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (41m) 3m ago 49m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:39:31.749 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (40m) 108s ago 46m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:39:31.749 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (40m) 3m ago 49m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:39:31.749 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (40m) 108s ago 46m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:39:31.749 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (47m) 3m ago 47m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:39:31.749 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (46m) 108s ago 46m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:39:31.750 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (39m) 3m ago 46m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:39:31.750 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (37m) 3m ago 45m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:39:31.750 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (37m) 3m ago 45m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:39:31.750 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (36m) 108s ago 45m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:39:31.750 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (36m) 108s ago 45m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:39:31.751 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (35m) 108s ago 44m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:39:31.751 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (41m) 3m ago 46m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:39:31.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 -- 172.21.15.8:0/2123794537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe1c060f70 msgr2=0x7fbe1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe1c060f70 0x7fbe1c063430 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fbe28004630 tx=0x7fbe28009b30).stop 2023-10-18T21:39:31.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 -- 172.21.15.8:0/2123794537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe340f6530 msgr2=0x7fbe34108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe340f6530 0x7fbe34108f30 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fbe2400c790 tx=0x7fbe24007d90).stop 2023-10-18T21:39:31.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 -- 172.21.15.8:0/2123794537 shutdown_connections 2023-10-18T21:39:31.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbe1c060f70 0x7fbe1c063430 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe340f6530 0x7fbe34108f30 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 --2- 172.21.15.8:0/2123794537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe340f77d0 0x7fbe34109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 -- 172.21.15.8:0/2123794537 >> 172.21.15.8:0/2123794537 conn(0x7fbe340f1c90 msgr2=0x7fbe3406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:31.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 -- 172.21.15.8:0/2123794537 shutdown_connections 2023-10-18T21:39:31.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.747+0000 7fbe3359e700 1 -- 172.21.15.8:0/2123794537 wait complete. 2023-10-18T21:39:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.882+0000 7f09b13a7700 1 -- 172.21.15.8:0/4166697068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09ac0f77d0 msgr2=0x7f09ac0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.882+0000 7f09b13a7700 1 --2- 172.21.15.8:0/4166697068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09ac0f77d0 0x7f09ac0f7c30 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f09a0004660 tx=0x7f09a0009b30).stop 2023-10-18T21:39:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.882+0000 7f09b13a7700 1 -- 172.21.15.8:0/4166697068 shutdown_connections 2023-10-18T21:39:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.882+0000 7f09b13a7700 1 --2- 172.21.15.8:0/4166697068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09ac0f77d0 0x7f09ac0f7c30 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.882+0000 7f09b13a7700 1 --2- 172.21.15.8:0/4166697068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09ac0f6530 0x7f09ac0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:39:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.882+0000 7f09b13a7700 1 -- 172.21.15.8:0/4166697068 >> 172.21.15.8:0/4166697068 conn(0x7f09ac0f1c90 msgr2=0x7f09ac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.882+0000 7f09b13a7700 1 -- 172.21.15.8:0/4166697068 shutdown_connections 2023-10-18T21:39:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.882+0000 7f09b13a7700 1 -- 172.21.15.8:0/4166697068 wait complete. 2023-10-18T21:39:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.883+0000 7f09b13a7700 1 Processor -- start 2023-10-18T21:39:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.883+0000 7f09b13a7700 1 -- start start 2023-10-18T21:39:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09b13a7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09ac0f6530 0x7f09ac108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09b13a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09ac0f77d0 0x7f09ac1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09b13a7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac109b00 con 0x7f09ac0f6530 2023-10-18T21:39:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09b13a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac10a3b0 con 0x7f09ac0f77d0 2023-10-18T21:39:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09ac0f6530 0x7f09ac108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09ac0f6530 0x7f09ac108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53668/0 (socket says 172.21.15.8:53668) 2023-10-18T21:39:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09abfff700 1 -- 172.21.15.8:0/1144220059 learned_addr learned my addr 172.21.15.8:0/1144220059 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:39:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09ab7fe700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09ac0f77d0 0x7f09ac1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09abfff700 1 -- 172.21.15.8:0/1144220059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09ac0f77d0 msgr2=0x7f09ac1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09abfff700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09ac0f77d0 0x7f09ac1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.884+0000 7f09abfff700 1 -- 172.21.15.8:0/1144220059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0005040 con 0x7f09ac0f6530 2023-10-18T21:39:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.885+0000 7f09abfff700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09ac0f6530 0x7f09ac108fd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f099c0093f0 tx=0x7f099c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.885+0000 7f09a8ff9700 1 -- 172.21.15.8:0/1144220059 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099c013640 con 0x7f09ac0f6530 2023-10-18T21:39:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.885+0000 7f09a8ff9700 1 -- 172.21.15.8:0/1144220059 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f099c013c60 con 0x7f09ac0f6530 2023-10-18T21:39:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.885+0000 7f09b13a7700 1 -- 172.21.15.8:0/1144220059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac10a690 con 0x7f09ac0f6530 2023-10-18T21:39:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.885+0000 7f09a8ff9700 1 -- 172.21.15.8:0/1144220059 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099c012ce0 con 0x7f09ac0f6530 2023-10-18T21:39:31.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.885+0000 7f09b13a7700 1 -- 172.21.15.8:0/1144220059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ac10ac50 con 0x7f09ac0f6530 2023-10-18T21:39:31.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.886+0000 7f09b13a7700 1 -- 172.21.15.8:0/1144220059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ac059100 con 0x7f09ac0f6530 2023-10-18T21:39:31.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.887+0000 7f09a8ff9700 1 -- 172.21.15.8:0/1144220059 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f099c01a060 con 0x7f09ac0f6530 2023-10-18T21:39:31.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.888+0000 7f09a8ff9700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0994060f70 0x7f0994063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:31.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.888+0000 7f09a8ff9700 1 -- 172.21.15.8:0/1144220059 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f099c07c940 con 0x7f09ac0f6530 2023-10-18T21:39:31.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.888+0000 7f09ab7fe700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0994060f70 0x7f0994063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:31.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.889+0000 7f09ab7fe700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0994060f70 0x7f0994063430 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f09a0004630 tx=0x7f09a0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:31.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:31.892+0000 7f09a8ff9700 1 -- 172.21.15.8:0/1144220059 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f099c04fec0 con 0x7f09ac0f6530 2023-10-18T21:39:32.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.144+0000 7f09b13a7700 1 -- 172.21.15.8:0/1144220059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f09ac027a00 con 0x7f09ac0f6530 2023-10-18T21:39:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.145+0000 7f09a8ff9700 1 -- 172.21.15.8:0/1144220059 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f099c04fab0 con 0x7f09ac0f6530 2023-10-18T21:39:32.148 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:39:32.148 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:39:32.148 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:39:32.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:39:32.148 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:39:32.149 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:39:32.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:39:32.149 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:39:32.149 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:39:32.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:39:32.150 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:39:32.150 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:39:32.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:39:32.150 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:39:32.150 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:39:32.151 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:39:32.151 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:39:32.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 -- 172.21.15.8:0/1144220059 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0994060f70 msgr2=0x7f0994063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:32.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0994060f70 0x7f0994063430 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f09a0004630 tx=0x7f09a0009b30).stop 2023-10-18T21:39:32.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 -- 172.21.15.8:0/1144220059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09ac0f6530 msgr2=0x7f09ac108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:32.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09ac0f6530 0x7f09ac108fd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f099c0093f0 tx=0x7f099c006ec0).stop 2023-10-18T21:39:32.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 -- 172.21.15.8:0/1144220059 shutdown_connections 2023-10-18T21:39:32.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0994060f70 0x7f0994063430 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09ac0f6530 0x7f09ac108fd0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 --2- 172.21.15.8:0/1144220059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09ac0f77d0 0x7f09ac1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 -- 172.21.15.8:0/1144220059 >> 172.21.15.8:0/1144220059 conn(0x7f09ac0f1c90 msgr2=0x7f09ac06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:32.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 -- 172.21.15.8:0/1144220059 shutdown_connections 2023-10-18T21:39:32.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.147+0000 7f09b13a7700 1 -- 172.21.15.8:0/1144220059 wait complete. 2023-10-18T21:39:32.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.283+0000 7fbd2a47a700 1 -- 172.21.15.8:0/613280247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240f6530 msgr2=0x7fbd240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:32.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.283+0000 7fbd2a47a700 1 --2- 172.21.15.8:0/613280247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240f6530 0x7fbd240f6950 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fbd20004660 tx=0x7fbd20009b30).stop 2023-10-18T21:39:32.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.283+0000 7fbd2a47a700 1 -- 172.21.15.8:0/613280247 shutdown_connections 2023-10-18T21:39:32.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.283+0000 7fbd2a47a700 1 --2- 172.21.15.8:0/613280247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd240f77d0 0x7fbd240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.283+0000 7fbd2a47a700 1 --2- 172.21.15.8:0/613280247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240f6530 0x7fbd240f6950 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.283+0000 7fbd2a47a700 1 -- 172.21.15.8:0/613280247 >> 172.21.15.8:0/613280247 conn(0x7fbd240f1c90 msgr2=0x7fbd240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:32.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.283+0000 7fbd2a47a700 1 -- 172.21.15.8:0/613280247 shutdown_connections 2023-10-18T21:39:32.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.283+0000 7fbd2a47a700 1 -- 172.21.15.8:0/613280247 wait complete. 2023-10-18T21:39:32.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.284+0000 7fbd2a47a700 1 Processor -- start 2023-10-18T21:39:32.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.285+0000 7fbd2a47a700 1 -- start start 2023-10-18T21:39:32.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.285+0000 7fbd2a47a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240f6530 0x7fbd24106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:32.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.285+0000 7fbd2a47a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd240f77d0 0x7fbd24107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:32.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.285+0000 7fbd2a47a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd24107870 con 0x7fbd240f6530 2023-10-18T21:39:32.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.285+0000 7fbd2a47a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd241080b0 con 0x7fbd240f77d0 2023-10-18T21:39:32.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd29478700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240f6530 0x7fbd24106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:32.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd29478700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240f6530 0x7fbd24106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53680/0 (socket says 172.21.15.8:53680) 2023-10-18T21:39:32.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd29478700 1 -- 172.21.15.8:0/1625729643 learned_addr learned my addr 172.21.15.8:0/1625729643 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:39:32.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd28c77700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd240f77d0 0x7fbd24107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:32.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd29478700 1 -- 172.21.15.8:0/1625729643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd240f77d0 msgr2=0x7fbd24107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:32.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd29478700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd240f77d0 0x7fbd24107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd29478700 1 -- 172.21.15.8:0/1625729643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd20005040 con 0x7fbd240f6530 2023-10-18T21:39:32.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd28c77700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd240f77d0 0x7fbd24107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:39:32.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd29478700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240f6530 0x7fbd24106d80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fbd20014040 tx=0x7fbd2000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:32.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd19ffb700 1 -- 172.21.15.8:0/1625729643 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd20019070 con 0x7fbd240f6530 2023-10-18T21:39:32.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd19ffb700 1 -- 172.21.15.8:0/1625729643 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbd2001e420 con 0x7fbd240f6530 2023-10-18T21:39:32.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.286+0000 7fbd2a47a700 1 -- 172.21.15.8:0/1625729643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd24108330 con 0x7fbd240f6530 2023-10-18T21:39:32.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.287+0000 7fbd19ffb700 1 -- 172.21.15.8:0/1625729643 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd20014660 con 0x7fbd240f6530 2023-10-18T21:39:32.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.287+0000 7fbd2a47a700 1 -- 172.21.15.8:0/1625729643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd24108810 con 0x7fbd240f6530 2023-10-18T21:39:32.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.288+0000 7fbd2a47a700 1 -- 172.21.15.8:0/1625729643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd24059100 con 0x7fbd240f6530 2023-10-18T21:39:32.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.289+0000 7fbd19ffb700 1 -- 172.21.15.8:0/1625729643 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbd2001e9e0 con 0x7fbd240f6530 2023-10-18T21:39:32.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.289+0000 7fbd19ffb700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd10060f70 0x7fbd10063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:32.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.289+0000 7fbd19ffb700 1 -- 172.21.15.8:0/1625729643 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbd2007de90 con 0x7fbd240f6530 2023-10-18T21:39:32.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.290+0000 7fbd28c77700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd10060f70 0x7fbd10063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:32.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.290+0000 7fbd28c77700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd10060f70 0x7fbd10063430 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fbd24106b10 tx=0x7fbd1400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:32.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.294+0000 7fbd19ffb700 1 -- 172.21.15.8:0/1625729643 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbd2004da40 con 0x7fbd240f6530 2023-10-18T21:39:32.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.520+0000 7fbd2a47a700 1 -- 172.21.15.8:0/1625729643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbd240fecc0 con 0x7fbd240f6530 2023-10-18T21:39:32.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.521+0000 7fbd19ffb700 1 -- 172.21.15.8:0/1625729643 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fbd20051060 con 0x7fbd240f6530 2023-10-18T21:39:32.523 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:39:32.523 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:39:32.523 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:39:32.524 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:39:32.524 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:39:32.524 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:39:32.524 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:39:32.525 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:39:32.525 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:39:32.525 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:39:32.525 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:39:32.525 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:39:32.525 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:39:32.526 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:39:32.526 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:39:32.526 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:39:32.526 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:39:32.526 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:39:32.527 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:39:32.527 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:39:32.527 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:39:32.527 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:39:32.527 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:39:32.527 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:39:32.528 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:39:32.528 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:39:32.528 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:39:32.528 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:39:32.528 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:39:32.528 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:39:32.529 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:39:32.529 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:39:32.529 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:39:32.529 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:39:32.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 -- 172.21.15.8:0/1625729643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd10060f70 msgr2=0x7fbd10063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:32.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd10060f70 0x7fbd10063430 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fbd24106b10 tx=0x7fbd1400b040).stop 2023-10-18T21:39:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 -- 172.21.15.8:0/1625729643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240f6530 msgr2=0x7fbd24106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240f6530 0x7fbd24106d80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fbd20014040 tx=0x7fbd2000b040).stop 2023-10-18T21:39:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 -- 172.21.15.8:0/1625729643 shutdown_connections 2023-10-18T21:39:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbd10060f70 0x7fbd10063430 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240f6530 0x7fbd24106d80 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 --2- 172.21.15.8:0/1625729643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd240f77d0 0x7fbd24107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 -- 172.21.15.8:0/1625729643 >> 172.21.15.8:0/1625729643 conn(0x7fbd240f1c90 msgr2=0x7fbd240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 -- 172.21.15.8:0/1625729643 shutdown_connections 2023-10-18T21:39:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.523+0000 7fbd2a47a700 1 -- 172.21.15.8:0/1625729643 wait complete. 2023-10-18T21:39:32.532 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:39:32.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.661+0000 7f4ddb59e700 1 -- 172.21.15.8:0/1065865677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0f8740 msgr2=0x7f4ddc0f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:32.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.661+0000 7f4ddb59e700 1 --2- 172.21.15.8:0/1065865677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0f8740 0x7f4ddc0f8b60 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f4dcc004660 tx=0x7f4dcc009b30).stop 2023-10-18T21:39:32.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.661+0000 7f4ddb59e700 1 -- 172.21.15.8:0/1065865677 shutdown_connections 2023-10-18T21:39:32.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.661+0000 7f4ddb59e700 1 --2- 172.21.15.8:0/1065865677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ddc0f99e0 0x7f4ddc0f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.661+0000 7f4ddb59e700 1 --2- 172.21.15.8:0/1065865677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0f8740 0x7f4ddc0f8b60 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.661+0000 7f4ddb59e700 1 -- 172.21.15.8:0/1065865677 >> 172.21.15.8:0/1065865677 conn(0x7f4ddc0f40e0 msgr2=0x7f4ddc0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:32.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.661+0000 7f4ddb59e700 1 -- 172.21.15.8:0/1065865677 shutdown_connections 2023-10-18T21:39:32.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.661+0000 7f4ddb59e700 1 -- 172.21.15.8:0/1065865677 wait complete. 2023-10-18T21:39:32.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.662+0000 7f4ddb59e700 1 Processor -- start 2023-10-18T21:39:32.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.662+0000 7f4ddb59e700 1 -- start start 2023-10-18T21:39:32.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4ddb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ddc0f8740 0x7f4ddc108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:32.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4ddb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0f99e0 0x7f4ddc109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:32.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4ddb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1099e0 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4ddb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc109b20 con 0x7f4ddc0f8740 2023-10-18T21:39:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4dd9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0f99e0 0x7f4ddc109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4dd9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0f99e0 0x7f4ddc109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53694/0 (socket says 172.21.15.8:53694) 2023-10-18T21:39:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4dd9d9b700 1 -- 172.21.15.8:0/4192172387 learned_addr learned my addr 172.21.15.8:0/4192172387 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:39:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4dda59c700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ddc0f8740 0x7f4ddc108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:32.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4dd9d9b700 1 -- 172.21.15.8:0/4192172387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ddc0f8740 msgr2=0x7f4ddc108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:32.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4dd9d9b700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ddc0f8740 0x7f4ddc108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.663+0000 7f4dd9d9b700 1 -- 172.21.15.8:0/4192172387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc005040 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.664+0000 7f4dd9d9b700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0f99e0 0x7f4ddc109430 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f4dd000e7f0 tx=0x7f4dd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:32.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.664+0000 7f4dcaffd700 1 -- 172.21.15.8:0/4192172387 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dd00092e0 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.664+0000 7f4dcaffd700 1 -- 172.21.15.8:0/4192172387 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4dd000f040 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.664+0000 7f4ddb59e700 1 -- 172.21.15.8:0/4192172387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc10a4c0 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.664+0000 7f4dcaffd700 1 -- 172.21.15.8:0/4192172387 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dd00147e0 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.664+0000 7f4ddb59e700 1 -- 172.21.15.8:0/4192172387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc10aa00 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.665+0000 7f4ddb59e700 1 -- 172.21.15.8:0/4192172387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc045ad0 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.666+0000 7f4dcaffd700 1 -- 172.21.15.8:0/4192172387 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4dd001b030 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.667+0000 7f4dcaffd700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4dc4060f70 0x7f4dc4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:39:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.667+0000 7f4dcaffd700 1 -- 172.21.15.8:0/4192172387 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4dd007c7f0 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.667+0000 7f4dda59c700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4dc4060f70 0x7f4dc4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:39:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.668+0000 7f4dda59c700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4dc4060f70 0x7f4dc4063430 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f4dcc004630 tx=0x7f4dcc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:39:32.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.671+0000 7f4dcaffd700 1 -- 172.21.15.8:0/4192172387 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4dd004fe80 con 0x7f4ddc0f99e0 2023-10-18T21:39:32.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.869+0000 7f4ddb59e700 1 -- 172.21.15.8:0/4192172387 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ddc10ac20 con 0x7f4dc4060f70 2023-10-18T21:39:32.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.870+0000 7f4dcaffd700 1 -- 172.21.15.8:0/4192172387 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4ddc10ac20 con 0x7f4dc4060f70 2023-10-18T21:39:32.872 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:39:32.872 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:39:32.872 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:39:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:39:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:39:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:39:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:39:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:39:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:39:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:39:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:39:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:39:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:39:32.875 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:39:32.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 -- 172.21.15.8:0/4192172387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4dc4060f70 msgr2=0x7f4dc4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:32.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4dc4060f70 0x7f4dc4063430 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f4dcc004630 tx=0x7f4dcc00b040).stop 2023-10-18T21:39:32.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 -- 172.21.15.8:0/4192172387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0f99e0 msgr2=0x7f4ddc109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:39:32.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0f99e0 0x7f4ddc109430 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f4dd000e7f0 tx=0x7f4dd000b040).stop 2023-10-18T21:39:32.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 -- 172.21.15.8:0/4192172387 shutdown_connections 2023-10-18T21:39:32.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4dc4060f70 0x7f4dc4063430 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ddc0f8740 0x7f4ddc108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 --2- 172.21.15.8:0/4192172387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0f99e0 0x7f4ddc109430 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:39:32.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 -- 172.21.15.8:0/4192172387 >> 172.21.15.8:0/4192172387 conn(0x7f4ddc0f40e0 msgr2=0x7f4ddc0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:39:32.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 -- 172.21.15.8:0/4192172387 shutdown_connections 2023-10-18T21:39:32.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:39:32.872+0000 7f4ddb59e700 1 -- 172.21.15.8:0/4192172387 wait complete. 2023-10-18T21:39:32.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:31.044038+0000 mgr.smithi008.flmjzp (mgr.14640) 2440 : audit [DBG] from='client.36088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:32.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:31.393869+0000 mgr.smithi008.flmjzp (mgr.14640) 2441 : audit [DBG] from='client.36092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:32.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:31.533084+0000 mgr.smithi008.flmjzp (mgr.14640) 2442 : cluster [DBG] pgmap v1684: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:31.737743+0000 mgr.smithi008.flmjzp (mgr.14640) 2443 : audit [DBG] from='client.36096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:32.146608+0000 mon.smithi008 (mon.0) 2856 : audit [DBG] from='client.? 172.21.15.8:0/1144220059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:32.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:32.522349+0000 mon.smithi008 (mon.0) 2857 : audit [DBG] from='client.? 172.21.15.8:0/1625729643' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:39:32.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:31.044038+0000 mgr.smithi008.flmjzp (mgr.14640) 2440 : audit [DBG] from='client.36088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:31.393869+0000 mgr.smithi008.flmjzp (mgr.14640) 2441 : audit [DBG] from='client.36092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:31.533084+0000 mgr.smithi008.flmjzp (mgr.14640) 2442 : cluster [DBG] pgmap v1684: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:31.737743+0000 mgr.smithi008.flmjzp (mgr.14640) 2443 : audit [DBG] from='client.36096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:32.146608+0000 mon.smithi008 (mon.0) 2856 : audit [DBG] from='client.? 172.21.15.8:0/1144220059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:32.522349+0000 mon.smithi008 (mon.0) 2857 : audit [DBG] from='client.? 172.21.15.8:0/1625729643' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:39:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:32.871354+0000 mgr.smithi008.flmjzp (mgr.14640) 2444 : audit [DBG] from='client.36108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:33.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:32.871354+0000 mgr.smithi008.flmjzp (mgr.14640) 2444 : audit [DBG] from='client.36108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:39:34.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:33.533681+0000 mgr.smithi008.flmjzp (mgr.14640) 2445 : cluster [DBG] pgmap v1685: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:33.533681+0000 mgr.smithi008.flmjzp (mgr.14640) 2445 : cluster [DBG] pgmap v1685: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:35.534343+0000 mgr.smithi008.flmjzp (mgr.14640) 2446 : cluster [DBG] pgmap v1686: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:35.556559+0000 mon.smithi008 (mon.0) 2858 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:35.558687+0000 mon.smithi008 (mon.0) 2859 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:35.559745+0000 mon.smithi008 (mon.0) 2860 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:35.560666+0000 mgr.smithi008.flmjzp (mgr.14640) 2447 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:35.561259+0000 mgr.smithi008.flmjzp (mgr.14640) 2448 : cluster [DBG] pgmap v1687: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:35.561511+0000 mgr.smithi008.flmjzp (mgr.14640) 2449 : cluster [DBG] pgmap v1688: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:35.566340+0000 mon.smithi008 (mon.0) 2861 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:35.572870+0000 mon.smithi008 (mon.0) 2862 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:35.575958+0000 mon.smithi008 (mon.0) 2863 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:35.577862+0000 mon.smithi008 (mon.0) 2864 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:35.579506+0000 mon.smithi008 (mon.0) 2865 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:35.581546+0000 mon.smithi008 (mon.0) 2866 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:36.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:35.583566+0000 mgr.smithi008.flmjzp (mgr.14640) 2450 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:36.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:35.534343+0000 mgr.smithi008.flmjzp (mgr.14640) 2446 : cluster [DBG] pgmap v1686: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:35.556559+0000 mon.smithi008 (mon.0) 2858 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:35.558687+0000 mon.smithi008 (mon.0) 2859 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:35.559745+0000 mon.smithi008 (mon.0) 2860 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:35.560666+0000 mgr.smithi008.flmjzp (mgr.14640) 2447 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:35.561259+0000 mgr.smithi008.flmjzp (mgr.14640) 2448 : cluster [DBG] pgmap v1687: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:35.561511+0000 mgr.smithi008.flmjzp (mgr.14640) 2449 : cluster [DBG] pgmap v1688: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:35.566340+0000 mon.smithi008 (mon.0) 2861 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:35.572870+0000 mon.smithi008 (mon.0) 2862 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:35.575958+0000 mon.smithi008 (mon.0) 2863 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:36.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:35.577862+0000 mon.smithi008 (mon.0) 2864 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:36.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:35.579506+0000 mon.smithi008 (mon.0) 2865 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:36.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:35.581546+0000 mon.smithi008 (mon.0) 2866 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:36.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:35.583566+0000 mgr.smithi008.flmjzp (mgr.14640) 2450 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:38.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:37.562120+0000 mgr.smithi008.flmjzp (mgr.14640) 2451 : cluster [DBG] pgmap v1689: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:38.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:37.562120+0000 mgr.smithi008.flmjzp (mgr.14640) 2451 : cluster [DBG] pgmap v1689: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:39.562745+0000 mgr.smithi008.flmjzp (mgr.14640) 2452 : cluster [DBG] pgmap v1690: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:40.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:39.562745+0000 mgr.smithi008.flmjzp (mgr.14640) 2452 : cluster [DBG] pgmap v1690: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:42.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:41.563537+0000 mgr.smithi008.flmjzp (mgr.14640) 2453 : cluster [DBG] pgmap v1691: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:42.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:41.563537+0000 mgr.smithi008.flmjzp (mgr.14640) 2453 : cluster [DBG] pgmap v1691: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:44.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:43.564105+0000 mgr.smithi008.flmjzp (mgr.14640) 2454 : cluster [DBG] pgmap v1692: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:44.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:43.564105+0000 mgr.smithi008.flmjzp (mgr.14640) 2454 : cluster [DBG] pgmap v1692: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:45.564738+0000 mgr.smithi008.flmjzp (mgr.14640) 2455 : cluster [DBG] pgmap v1693: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:45.584355+0000 mon.smithi008 (mon.0) 2867 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:46.141661+0000 mon.smithi008 (mon.0) 2868 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:46.142468+0000 mon.smithi008 (mon.0) 2869 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:46.147837+0000 mon.smithi008 (mon.0) 2870 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:46.152740+0000 mon.smithi008 (mon.0) 2871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:46.155149+0000 mon.smithi008 (mon.0) 2872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:46.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:46.156376+0000 mon.smithi008 (mon.0) 2873 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:46.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:46.157598+0000 mon.smithi008 (mon.0) 2874 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:46.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:46.159128+0000 mon.smithi008 (mon.0) 2875 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:45.564738+0000 mgr.smithi008.flmjzp (mgr.14640) 2455 : cluster [DBG] pgmap v1693: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:45.584355+0000 mon.smithi008 (mon.0) 2867 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:46.141661+0000 mon.smithi008 (mon.0) 2868 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:46.142468+0000 mon.smithi008 (mon.0) 2869 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:46.147837+0000 mon.smithi008 (mon.0) 2870 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:46.152740+0000 mon.smithi008 (mon.0) 2871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:46.155149+0000 mon.smithi008 (mon.0) 2872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:46.156376+0000 mon.smithi008 (mon.0) 2873 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:46.157598+0000 mon.smithi008 (mon.0) 2874 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:46.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:46.159128+0000 mon.smithi008 (mon.0) 2875 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:46.143098+0000 mgr.smithi008.flmjzp (mgr.14640) 2456 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:46.143680+0000 mgr.smithi008.flmjzp (mgr.14640) 2457 : cluster [DBG] pgmap v1694: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:46.143934+0000 mgr.smithi008.flmjzp (mgr.14640) 2458 : cluster [DBG] pgmap v1695: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:46.160672+0000 mgr.smithi008.flmjzp (mgr.14640) 2459 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:46.143098+0000 mgr.smithi008.flmjzp (mgr.14640) 2456 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:46.143680+0000 mgr.smithi008.flmjzp (mgr.14640) 2457 : cluster [DBG] pgmap v1694: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:46.143934+0000 mgr.smithi008.flmjzp (mgr.14640) 2458 : cluster [DBG] pgmap v1695: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:46.160672+0000 mgr.smithi008.flmjzp (mgr.14640) 2459 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:48.144687+0000 mgr.smithi008.flmjzp (mgr.14640) 2460 : cluster [DBG] pgmap v1696: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:49.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:48.144687+0000 mgr.smithi008.flmjzp (mgr.14640) 2460 : cluster [DBG] pgmap v1696: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:50.145575+0000 mgr.smithi008.flmjzp (mgr.14640) 2461 : cluster [DBG] pgmap v1697: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:51.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:50.145575+0000 mgr.smithi008.flmjzp (mgr.14640) 2461 : cluster [DBG] pgmap v1697: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:52.146199+0000 mgr.smithi008.flmjzp (mgr.14640) 2462 : cluster [DBG] pgmap v1698: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:53.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:52.146199+0000 mgr.smithi008.flmjzp (mgr.14640) 2462 : cluster [DBG] pgmap v1698: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:54.146948+0000 mgr.smithi008.flmjzp (mgr.14640) 2463 : cluster [DBG] pgmap v1699: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:55.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:54.146948+0000 mgr.smithi008.flmjzp (mgr.14640) 2463 : cluster [DBG] pgmap v1699: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:56.171332+0000 mon.smithi008 (mon.0) 2876 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:56.173542+0000 mon.smithi008 (mon.0) 2877 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:56.174554+0000 mon.smithi008 (mon.0) 2878 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:56.181091+0000 mon.smithi008 (mon.0) 2879 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:56.187415+0000 mon.smithi008 (mon.0) 2880 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:56.190408+0000 mon.smithi008 (mon.0) 2881 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:56.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:56.192072+0000 mon.smithi008 (mon.0) 2882 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:56.193623+0000 mon.smithi008 (mon.0) 2883 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:39:56.195665+0000 mon.smithi008 (mon.0) 2884 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:56.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:56.171332+0000 mon.smithi008 (mon.0) 2876 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:56.173542+0000 mon.smithi008 (mon.0) 2877 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:39:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:56.174554+0000 mon.smithi008 (mon.0) 2878 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:39:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:56.181091+0000 mon.smithi008 (mon.0) 2879 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:39:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:56.187415+0000 mon.smithi008 (mon.0) 2880 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:39:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:56.190408+0000 mon.smithi008 (mon.0) 2881 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:56.192072+0000 mon.smithi008 (mon.0) 2882 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:56.193623+0000 mon.smithi008 (mon.0) 2883 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:56.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:39:56.195665+0000 mon.smithi008 (mon.0) 2884 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:39:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:56.147549+0000 mgr.smithi008.flmjzp (mgr.14640) 2464 : cluster [DBG] pgmap v1700: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:56.175411+0000 mgr.smithi008.flmjzp (mgr.14640) 2465 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:56.176033+0000 mgr.smithi008.flmjzp (mgr.14640) 2466 : cluster [DBG] pgmap v1701: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:56.176291+0000 mgr.smithi008.flmjzp (mgr.14640) 2467 : cluster [DBG] pgmap v1702: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:39:56.197548+0000 mgr.smithi008.flmjzp (mgr.14640) 2468 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:57.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:56.147549+0000 mgr.smithi008.flmjzp (mgr.14640) 2464 : cluster [DBG] pgmap v1700: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:56.175411+0000 mgr.smithi008.flmjzp (mgr.14640) 2465 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:39:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:56.176033+0000 mgr.smithi008.flmjzp (mgr.14640) 2466 : cluster [DBG] pgmap v1701: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:56.176291+0000 mgr.smithi008.flmjzp (mgr.14640) 2467 : cluster [DBG] pgmap v1702: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:39:56.197548+0000 mgr.smithi008.flmjzp (mgr.14640) 2468 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:39:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:39:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:39:58.177031+0000 mgr.smithi008.flmjzp (mgr.14640) 2469 : cluster [DBG] pgmap v1703: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:39:59.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:39:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:39:58.177031+0000 mgr.smithi008.flmjzp (mgr.14640) 2469 : cluster [DBG] pgmap v1703: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:00.000201+0000 mon.smithi008 (mon.0) 2885 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T21:40:00.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:00.000201+0000 mon.smithi008 (mon.0) 2885 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T21:40:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:00.177762+0000 mgr.smithi008.flmjzp (mgr.14640) 2470 : cluster [DBG] pgmap v1704: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:01.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:00.177762+0000 mgr.smithi008.flmjzp (mgr.14640) 2470 : cluster [DBG] pgmap v1704: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:03.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.025+0000 7f805e81b700 1 -- 172.21.15.8:0/4165369711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80580f6530 msgr2=0x7f80580f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.025+0000 7f805e81b700 1 --2- 172.21.15.8:0/4165369711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80580f6530 0x7f80580f6950 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f8054004660 tx=0x7f8054009b30).stop 2023-10-18T21:40:03.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.025+0000 7f805e81b700 1 -- 172.21.15.8:0/4165369711 shutdown_connections 2023-10-18T21:40:03.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.025+0000 7f805e81b700 1 --2- 172.21.15.8:0/4165369711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80580f77d0 0x7f80580f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.025+0000 7f805e81b700 1 --2- 172.21.15.8:0/4165369711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80580f6530 0x7f80580f6950 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.025+0000 7f805e81b700 1 -- 172.21.15.8:0/4165369711 >> 172.21.15.8:0/4165369711 conn(0x7f80580f1c90 msgr2=0x7f80580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:03.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.026+0000 7f805e81b700 1 -- 172.21.15.8:0/4165369711 shutdown_connections 2023-10-18T21:40:03.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.026+0000 7f805e81b700 1 -- 172.21.15.8:0/4165369711 wait complete. 2023-10-18T21:40:03.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.026+0000 7f805e81b700 1 Processor -- start 2023-10-18T21:40:03.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.027+0000 7f805e81b700 1 -- start start 2023-10-18T21:40:03.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.027+0000 7f805e81b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80580f6530 0x7f8058108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.027+0000 7f805e81b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80580f77d0 0x7f80581094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.027+0000 7f805e81b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8058109a70 con 0x7f80580f77d0 2023-10-18T21:40:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.027+0000 7f805e81b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8058109bb0 con 0x7f80580f6530 2023-10-18T21:40:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.027+0000 7f805d018700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80580f77d0 0x7f80581094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.027+0000 7f805d018700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80580f77d0 0x7f80581094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37604/0 (socket says 172.21.15.8:37604) 2023-10-18T21:40:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.027+0000 7f805d018700 1 -- 172.21.15.8:0/445619196 learned_addr learned my addr 172.21.15.8:0/445619196 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.027+0000 7f805d819700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80580f6530 0x7f8058108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.028+0000 7f805d018700 1 -- 172.21.15.8:0/445619196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80580f6530 msgr2=0x7f8058108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.028+0000 7f805d018700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80580f6530 0x7f8058108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.028+0000 7f805d018700 1 -- 172.21.15.8:0/445619196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8054005040 con 0x7f80580f77d0 2023-10-18T21:40:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.028+0000 7f805d018700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80580f77d0 0x7f80581094c0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f80480026d0 tx=0x7f8048009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.028+0000 7f804e7fc700 1 -- 172.21.15.8:0/445619196 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80480079c0 con 0x7f80580f77d0 2023-10-18T21:40:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.028+0000 7f804e7fc700 1 -- 172.21.15.8:0/445619196 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f804800f040 con 0x7f80580f77d0 2023-10-18T21:40:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.028+0000 7f805e81b700 1 -- 172.21.15.8:0/445619196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805810a550 con 0x7f80580f77d0 2023-10-18T21:40:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.028+0000 7f804e7fc700 1 -- 172.21.15.8:0/445619196 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8048014980 con 0x7f80580f77d0 2023-10-18T21:40:03.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.029+0000 7f805e81b700 1 -- 172.21.15.8:0/445619196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805810ab10 con 0x7f80580f77d0 2023-10-18T21:40:03.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.029+0000 7f805e81b700 1 -- 172.21.15.8:0/445619196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8058045ad0 con 0x7f80580f77d0 2023-10-18T21:40:03.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.030+0000 7f804e7fc700 1 -- 172.21.15.8:0/445619196 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f80480090d0 con 0x7f80580f77d0 2023-10-18T21:40:03.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.031+0000 7f804e7fc700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8044060f70 0x7f8044063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:03.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.031+0000 7f804e7fc700 1 -- 172.21.15.8:0/445619196 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f804807c8a0 con 0x7f80580f77d0 2023-10-18T21:40:03.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.032+0000 7f805d819700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8044060f70 0x7f8044063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:03.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.032+0000 7f805d819700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8044060f70 0x7f8044063430 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f8054004630 tx=0x7f8054009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:03.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.036+0000 7f804e7fc700 1 -- 172.21.15.8:0/445619196 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f804804ffb0 con 0x7f80580f77d0 2023-10-18T21:40:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.232+0000 7f805e81b700 1 -- 172.21.15.8:0/445619196 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f805810ade0 con 0x7f8044060f70 2023-10-18T21:40:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.234+0000 7f804e7fc700 1 -- 172.21.15.8:0/445619196 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f805810ade0 con 0x7f8044060f70 2023-10-18T21:40:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 -- 172.21.15.8:0/445619196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8044060f70 msgr2=0x7f8044063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8044060f70 0x7f8044063430 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f8054004630 tx=0x7f8054009b30).stop 2023-10-18T21:40:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 -- 172.21.15.8:0/445619196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80580f77d0 msgr2=0x7f80581094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80580f77d0 0x7f80581094c0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f80480026d0 tx=0x7f8048009de0).stop 2023-10-18T21:40:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 -- 172.21.15.8:0/445619196 shutdown_connections 2023-10-18T21:40:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8044060f70 0x7f8044063430 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80580f6530 0x7f8058108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 --2- 172.21.15.8:0/445619196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80580f77d0 0x7f80581094c0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 -- 172.21.15.8:0/445619196 >> 172.21.15.8:0/445619196 conn(0x7f80580f1c90 msgr2=0x7f805806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 -- 172.21.15.8:0/445619196 shutdown_connections 2023-10-18T21:40:03.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.236+0000 7f805e81b700 1 -- 172.21.15.8:0/445619196 wait complete. 2023-10-18T21:40:03.251 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:40:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.373+0000 7f4cbcd56700 1 -- 172.21.15.8:0/3494209899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb80f6530 msgr2=0x7f4cb80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.373+0000 7f4cbcd56700 1 --2- 172.21.15.8:0/3494209899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb80f6530 0x7f4cb80f6950 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f4ca8004660 tx=0x7f4ca8009b30).stop 2023-10-18T21:40:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.373+0000 7f4cbcd56700 1 -- 172.21.15.8:0/3494209899 shutdown_connections 2023-10-18T21:40:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.373+0000 7f4cbcd56700 1 --2- 172.21.15.8:0/3494209899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb80f77d0 0x7f4cb80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.373+0000 7f4cbcd56700 1 --2- 172.21.15.8:0/3494209899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb80f6530 0x7f4cb80f6950 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.373+0000 7f4cbcd56700 1 -- 172.21.15.8:0/3494209899 >> 172.21.15.8:0/3494209899 conn(0x7f4cb80f1c90 msgr2=0x7f4cb80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.373+0000 7f4cbcd56700 1 -- 172.21.15.8:0/3494209899 shutdown_connections 2023-10-18T21:40:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.374+0000 7f4cbcd56700 1 -- 172.21.15.8:0/3494209899 wait complete. 2023-10-18T21:40:03.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.374+0000 7f4cbcd56700 1 Processor -- start 2023-10-18T21:40:03.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.374+0000 7f4cbcd56700 1 -- start start 2023-10-18T21:40:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cbcd56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb80f6530 0x7f4cb8108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cbcd56700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb80f77d0 0x7f4cb8109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cbcd56700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb81099c0 con 0x7f4cb80f77d0 2023-10-18T21:40:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cbcd56700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8109b00 con 0x7f4cb80f6530 2023-10-18T21:40:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cb6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb80f77d0 0x7f4cb8109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cb6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb80f77d0 0x7f4cb8109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37614/0 (socket says 172.21.15.8:37614) 2023-10-18T21:40:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cb6ffd700 1 -- 172.21.15.8:0/2661400037 learned_addr learned my addr 172.21.15.8:0/2661400037 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cb6ffd700 1 -- 172.21.15.8:0/2661400037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb80f6530 msgr2=0x7f4cb8108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cb77fe700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb80f6530 0x7f4cb8108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cb6ffd700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb80f6530 0x7f4cb8108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cb6ffd700 1 -- 172.21.15.8:0/2661400037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8005040 con 0x7f4cb80f77d0 2023-10-18T21:40:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.375+0000 7f4cb77fe700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb80f6530 0x7f4cb8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:40:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.376+0000 7f4cb6ffd700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb80f77d0 0x7f4cb8109410 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f4cac002700 tx=0x7f4cac009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.376+0000 7f4c9ffff700 1 -- 172.21.15.8:0/2661400037 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cac009320 con 0x7f4cb80f77d0 2023-10-18T21:40:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.376+0000 7f4c9ffff700 1 -- 172.21.15.8:0/2661400037 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4cac00f040 con 0x7f4cb80f77d0 2023-10-18T21:40:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.376+0000 7f4c9ffff700 1 -- 172.21.15.8:0/2661400037 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cac0148a0 con 0x7f4cb80f77d0 2023-10-18T21:40:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.376+0000 7f4cbcd56700 1 -- 172.21.15.8:0/2661400037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb810a4a0 con 0x7f4cb80f77d0 2023-10-18T21:40:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.376+0000 7f4cbcd56700 1 -- 172.21.15.8:0/2661400037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb810aa60 con 0x7f4cb80f77d0 2023-10-18T21:40:03.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.377+0000 7f4cbcd56700 1 -- 172.21.15.8:0/2661400037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb8045ad0 con 0x7f4cb80f77d0 2023-10-18T21:40:03.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.378+0000 7f4c9ffff700 1 -- 172.21.15.8:0/2661400037 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4cac009480 con 0x7f4cb80f77d0 2023-10-18T21:40:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.379+0000 7f4c9ffff700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ca0060f70 0x7f4ca0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.379+0000 7f4c9ffff700 1 -- 172.21.15.8:0/2661400037 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4cac07cd80 con 0x7f4cb80f77d0 2023-10-18T21:40:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.379+0000 7f4cb77fe700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ca0060f70 0x7f4ca0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.380+0000 7f4cb77fe700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ca0060f70 0x7f4ca0063430 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f4ca8005010 tx=0x7f4ca8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.383+0000 7f4c9ffff700 1 -- 172.21.15.8:0/2661400037 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4cac0503d0 con 0x7f4cb80f77d0 2023-10-18T21:40:03.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.582+0000 7f4cbcd56700 1 -- 172.21.15.8:0/2661400037 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cb810ace0 con 0x7f4ca0060f70 2023-10-18T21:40:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.583+0000 7f4c9ffff700 1 -- 172.21.15.8:0/2661400037 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4cb810ace0 con 0x7f4ca0060f70 2023-10-18T21:40:03.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.585+0000 7f4cbcd56700 1 -- 172.21.15.8:0/2661400037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ca0060f70 msgr2=0x7f4ca0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.585+0000 7f4cbcd56700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ca0060f70 0x7f4ca0063430 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f4ca8005010 tx=0x7f4ca8009b30).stop 2023-10-18T21:40:03.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.585+0000 7f4cbcd56700 1 -- 172.21.15.8:0/2661400037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb80f77d0 msgr2=0x7f4cb8109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.585+0000 7f4cbcd56700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb80f77d0 0x7f4cb8109410 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f4cac002700 tx=0x7f4cac009e00).stop 2023-10-18T21:40:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.586+0000 7f4cbcd56700 1 -- 172.21.15.8:0/2661400037 shutdown_connections 2023-10-18T21:40:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.586+0000 7f4cbcd56700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ca0060f70 0x7f4ca0063430 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.586+0000 7f4cbcd56700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cb80f6530 0x7f4cb8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.586+0000 7f4cbcd56700 1 --2- 172.21.15.8:0/2661400037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cb80f77d0 0x7f4cb8109410 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.586+0000 7f4cbcd56700 1 -- 172.21.15.8:0/2661400037 >> 172.21.15.8:0/2661400037 conn(0x7f4cb80f1c90 msgr2=0x7f4cb80f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.586+0000 7f4cbcd56700 1 -- 172.21.15.8:0/2661400037 shutdown_connections 2023-10-18T21:40:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.586+0000 7f4cbcd56700 1 -- 172.21.15.8:0/2661400037 wait complete. 2023-10-18T21:40:03.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.723+0000 7fa015d33700 1 -- 172.21.15.8:0/1217895564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0100f77d0 msgr2=0x7fa0100f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.723+0000 7fa015d33700 1 --2- 172.21.15.8:0/1217895564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0100f77d0 0x7fa0100f7c30 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f9ffc004660 tx=0x7f9ffc009b30).stop 2023-10-18T21:40:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.723+0000 7fa015d33700 1 -- 172.21.15.8:0/1217895564 shutdown_connections 2023-10-18T21:40:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.723+0000 7fa015d33700 1 --2- 172.21.15.8:0/1217895564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0100f77d0 0x7fa0100f7c30 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.723+0000 7fa015d33700 1 --2- 172.21.15.8:0/1217895564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0100f6530 0x7fa0100f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.723+0000 7fa015d33700 1 -- 172.21.15.8:0/1217895564 >> 172.21.15.8:0/1217895564 conn(0x7fa0100f1c90 msgr2=0x7fa0100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.723+0000 7fa015d33700 1 -- 172.21.15.8:0/1217895564 shutdown_connections 2023-10-18T21:40:03.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.723+0000 7fa015d33700 1 -- 172.21.15.8:0/1217895564 wait complete. 2023-10-18T21:40:03.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.724+0000 7fa015d33700 1 Processor -- start 2023-10-18T21:40:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.724+0000 7fa015d33700 1 -- start start 2023-10-18T21:40:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.724+0000 7fa015d33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0100f6530 0x7fa010106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.724+0000 7fa015d33700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0100f77d0 0x7fa010107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.724+0000 7fa015d33700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010107880 con 0x7fa0100f6530 2023-10-18T21:40:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.724+0000 7fa015d33700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0101080c0 con 0x7fa0100f77d0 2023-10-18T21:40:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.724+0000 7fa014d31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0100f6530 0x7fa010106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa014d31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0100f6530 0x7fa010106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37642/0 (socket says 172.21.15.8:37642) 2023-10-18T21:40:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa014d31700 1 -- 172.21.15.8:0/602404366 learned_addr learned my addr 172.21.15.8:0/602404366 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa00ffff700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0100f77d0 0x7fa010107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa014d31700 1 -- 172.21.15.8:0/602404366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0100f77d0 msgr2=0x7fa010107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa014d31700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0100f77d0 0x7fa010107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa014d31700 1 -- 172.21.15.8:0/602404366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc005040 con 0x7fa0100f6530 2023-10-18T21:40:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa014d31700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0100f6530 0x7fa010106d90 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fa004002700 tx=0x7fa004009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa00d7fa700 1 -- 172.21.15.8:0/602404366 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0040079c0 con 0x7fa0100f6530 2023-10-18T21:40:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa00d7fa700 1 -- 172.21.15.8:0/602404366 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa00400f040 con 0x7fa0100f6530 2023-10-18T21:40:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa00d7fa700 1 -- 172.21.15.8:0/602404366 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0040148d0 con 0x7fa0100f6530 2023-10-18T21:40:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.725+0000 7fa015d33700 1 -- 172.21.15.8:0/602404366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0101083a0 con 0x7fa0100f6530 2023-10-18T21:40:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.726+0000 7fa015d33700 1 -- 172.21.15.8:0/602404366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0101088e0 con 0x7fa0100f6530 2023-10-18T21:40:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.727+0000 7fa015d33700 1 -- 172.21.15.8:0/602404366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa010059100 con 0x7fa0100f6530 2023-10-18T21:40:03.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.728+0000 7fa00d7fa700 1 -- 172.21.15.8:0/602404366 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa00401b060 con 0x7fa0100f6530 2023-10-18T21:40:03.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.728+0000 7fa00d7fa700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa000060f70 0x7fa000063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:03.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.728+0000 7fa00d7fa700 1 -- 172.21.15.8:0/602404366 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa00407c770 con 0x7fa0100f6530 2023-10-18T21:40:03.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.729+0000 7fa00ffff700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa000060f70 0x7fa000063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:03.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.729+0000 7fa00ffff700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa000060f70 0x7fa000063430 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f9ffc004630 tx=0x7f9ffc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:03.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.732+0000 7fa00d7fa700 1 -- 172.21.15.8:0/602404366 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa00404c3a0 con 0x7fa0100f6530 2023-10-18T21:40:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:02.178341+0000 mgr.smithi008.flmjzp (mgr.14640) 2471 : cluster [DBG] pgmap v1705: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:03.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.926+0000 7fa015d33700 1 -- 172.21.15.8:0/602404366 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0100fedd0 con 0x7fa000060f70 2023-10-18T21:40:03.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.935+0000 7fa00d7fa700 1 -- 172.21.15.8:0/602404366 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa0100fedd0 con 0x7fa000060f70 2023-10-18T21:40:03.936 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:40:03.936 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (46m) 4m ago 48m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:40:03.937 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (40m) 4m ago 48m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:40:03.937 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (40m) 2m ago 47m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:40:03.937 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (46m) 4m ago 47m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:40:03.937 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 44m - - 2023-10-18T21:40:03.938 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 44m - - 2023-10-18T21:40:03.938 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 44m - - 2023-10-18T21:40:03.938 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 44m - - 2023-10-18T21:40:03.938 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (41m) 4m ago 49m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:40:03.938 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (41m) 2m ago 47m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:40:03.939 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (41m) 4m ago 49m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:40:03.939 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (40m) 2m ago 47m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:40:03.939 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (47m) 4m ago 47m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:40:03.939 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (46m) 2m ago 46m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:40:03.939 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (40m) 4m ago 46m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:40:03.939 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (38m) 4m ago 46m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:40:03.940 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (37m) 4m ago 46m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:40:03.940 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (37m) 2m ago 45m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:40:03.940 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (36m) 2m ago 45m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:40:03.940 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (36m) 2m ago 45m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:40:03.940 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (42m) 4m ago 47m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:40:03.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 -- 172.21.15.8:0/602404366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa000060f70 msgr2=0x7fa000063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa000060f70 0x7fa000063430 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f9ffc004630 tx=0x7f9ffc009b30).stop 2023-10-18T21:40:03.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 -- 172.21.15.8:0/602404366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0100f6530 msgr2=0x7fa010106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:03.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0100f6530 0x7fa010106d90 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fa004002700 tx=0x7fa004009d80).stop 2023-10-18T21:40:03.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 -- 172.21.15.8:0/602404366 shutdown_connections 2023-10-18T21:40:03.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa000060f70 0x7fa000063430 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0100f6530 0x7fa010106d90 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 --2- 172.21.15.8:0/602404366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0100f77d0 0x7fa010107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:03.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 -- 172.21.15.8:0/602404366 >> 172.21.15.8:0/602404366 conn(0x7fa0100f1c90 msgr2=0x7fa0100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:03.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 -- 172.21.15.8:0/602404366 shutdown_connections 2023-10-18T21:40:03.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:03.937+0000 7fa015d33700 1 -- 172.21.15.8:0/602404366 wait complete. 2023-10-18T21:40:03.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:02.178341+0000 mgr.smithi008.flmjzp (mgr.14640) 2471 : cluster [DBG] pgmap v1705: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:04.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.073+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/424137190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f80f77d0 msgr2=0x7fa0f80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:04.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.073+0000 7fa0fe2d5700 1 --2- 172.21.15.8:0/424137190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f80f77d0 0x7fa0f80f7c30 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7fa0e8004660 tx=0x7fa0e8009b30).stop 2023-10-18T21:40:04.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.074+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/424137190 shutdown_connections 2023-10-18T21:40:04.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.074+0000 7fa0fe2d5700 1 --2- 172.21.15.8:0/424137190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f80f77d0 0x7fa0f80f7c30 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.074+0000 7fa0fe2d5700 1 --2- 172.21.15.8:0/424137190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f80f6530 0x7fa0f80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.074+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/424137190 >> 172.21.15.8:0/424137190 conn(0x7fa0f80f1c90 msgr2=0x7fa0f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:04.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.074+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/424137190 shutdown_connections 2023-10-18T21:40:04.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.074+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/424137190 wait complete. 2023-10-18T21:40:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.074+0000 7fa0fe2d5700 1 Processor -- start 2023-10-18T21:40:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.075+0000 7fa0fe2d5700 1 -- start start 2023-10-18T21:40:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.075+0000 7fa0fe2d5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f80f6530 0x7fa0f8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.075+0000 7fa0fe2d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f80f77d0 0x7fa0f8109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.075+0000 7fa0fe2d5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8109a20 con 0x7fa0f80f77d0 2023-10-18T21:40:04.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.075+0000 7fa0fe2d5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8109b60 con 0x7fa0f80f6530 2023-10-18T21:40:04.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.075+0000 7fa0fcad2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f80f77d0 0x7fa0f8109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:04.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.075+0000 7fa0fcad2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f80f77d0 0x7fa0f8109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37656/0 (socket says 172.21.15.8:37656) 2023-10-18T21:40:04.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.075+0000 7fa0fcad2700 1 -- 172.21.15.8:0/3591425788 learned_addr learned my addr 172.21.15.8:0/3591425788 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:04.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.075+0000 7fa0fd2d3700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f80f6530 0x7fa0f8108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.076+0000 7fa0fcad2700 1 -- 172.21.15.8:0/3591425788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f80f6530 msgr2=0x7fa0f8108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.076+0000 7fa0fcad2700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f80f6530 0x7fa0f8108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.076+0000 7fa0fcad2700 1 -- 172.21.15.8:0/3591425788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e8005040 con 0x7fa0f80f77d0 2023-10-18T21:40:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.076+0000 7fa0fcad2700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f80f77d0 0x7fa0f8109470 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fa0e8009f50 tx=0x7fa0e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.076+0000 7fa0edffb700 1 -- 172.21.15.8:0/3591425788 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0e8018070 con 0x7fa0f80f77d0 2023-10-18T21:40:04.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.076+0000 7fa0edffb700 1 -- 172.21.15.8:0/3591425788 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa0e8009630 con 0x7fa0f80f77d0 2023-10-18T21:40:04.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.076+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/3591425788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f810a4a0 con 0x7fa0f80f77d0 2023-10-18T21:40:04.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.076+0000 7fa0edffb700 1 -- 172.21.15.8:0/3591425788 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0e801c3c0 con 0x7fa0f80f77d0 2023-10-18T21:40:04.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.076+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/3591425788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f810aa00 con 0x7fa0f80f77d0 2023-10-18T21:40:04.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.078+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/3591425788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f8045ad0 con 0x7fa0f80f77d0 2023-10-18T21:40:04.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.078+0000 7fa0edffb700 1 -- 172.21.15.8:0/3591425788 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa0e801d420 con 0x7fa0f80f77d0 2023-10-18T21:40:04.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.079+0000 7fa0edffb700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0e4060f70 0x7fa0e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:04.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.079+0000 7fa0edffb700 1 -- 172.21.15.8:0/3591425788 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa0e807e580 con 0x7fa0f80f77d0 2023-10-18T21:40:04.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.079+0000 7fa0fd2d3700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0e4060f70 0x7fa0e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:04.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.080+0000 7fa0fd2d3700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0e4060f70 0x7fa0e4063430 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fa0f80f7630 tx=0x7fa0f400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:04.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.083+0000 7fa0edffb700 1 -- 172.21.15.8:0/3591425788 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa0e8051be0 con 0x7fa0f80f77d0 2023-10-18T21:40:04.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.342+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/3591425788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0f810ac70 con 0x7fa0f80f77d0 2023-10-18T21:40:04.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.342+0000 7fa0edffb700 1 -- 172.21.15.8:0/3591425788 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fa0e80517d0 con 0x7fa0f80f77d0 2023-10-18T21:40:04.344 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:40:04.344 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:40:04.344 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:40:04.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:40:04.345 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:40:04.345 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:40:04.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:40:04.345 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:40:04.345 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:40:04.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:40:04.346 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:40:04.346 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:40:04.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:40:04.346 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:40:04.347 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:40:04.347 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:40:04.347 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:40:04.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.344+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/3591425788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0e4060f70 msgr2=0x7fa0e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:04.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.344+0000 7fa0fe2d5700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0e4060f70 0x7fa0e4063430 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fa0f80f7630 tx=0x7fa0f400b040).stop 2023-10-18T21:40:04.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.344+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/3591425788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f80f77d0 msgr2=0x7fa0f8109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:04.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.344+0000 7fa0fe2d5700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f80f77d0 0x7fa0f8109470 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fa0e8009f50 tx=0x7fa0e8009b30).stop 2023-10-18T21:40:04.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.344+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/3591425788 shutdown_connections 2023-10-18T21:40:04.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.344+0000 7fa0fe2d5700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa0e4060f70 0x7fa0e4063430 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.344+0000 7fa0fe2d5700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f80f6530 0x7fa0f8108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.344+0000 7fa0fe2d5700 1 --2- 172.21.15.8:0/3591425788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f80f77d0 0x7fa0f8109470 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.344+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/3591425788 >> 172.21.15.8:0/3591425788 conn(0x7fa0f80f1c90 msgr2=0x7fa0f806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:04.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.345+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/3591425788 shutdown_connections 2023-10-18T21:40:04.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.345+0000 7fa0fe2d5700 1 -- 172.21.15.8:0/3591425788 wait complete. 2023-10-18T21:40:04.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.480+0000 7fdc5959a700 1 -- 172.21.15.8:0/1284259877 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc50013b20 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.481+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1284259877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc5c0f77d0 msgr2=0x7fdc5c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:04.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.481+0000 7fdc5b59e700 1 --2- 172.21.15.8:0/1284259877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc5c0f77d0 0x7fdc5c0f7c30 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fdc50004660 tx=0x7fdc50009b30).stop 2023-10-18T21:40:04.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.481+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1284259877 shutdown_connections 2023-10-18T21:40:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.481+0000 7fdc5b59e700 1 --2- 172.21.15.8:0/1284259877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc5c0f77d0 0x7fdc5c0f7c30 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.481+0000 7fdc5b59e700 1 --2- 172.21.15.8:0/1284259877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc5c0f6530 0x7fdc5c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.481+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1284259877 >> 172.21.15.8:0/1284259877 conn(0x7fdc5c0f1c90 msgr2=0x7fdc5c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.481+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1284259877 shutdown_connections 2023-10-18T21:40:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.481+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1284259877 wait complete. 2023-10-18T21:40:04.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.482+0000 7fdc5b59e700 1 Processor -- start 2023-10-18T21:40:04.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.482+0000 7fdc5b59e700 1 -- start start 2023-10-18T21:40:04.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.482+0000 7fdc5b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc5c0f6530 0x7fdc5c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:04.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.482+0000 7fdc5b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc5c0f77d0 0x7fdc5c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:04.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.482+0000 7fdc5b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c109a20 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.482+0000 7fdc5b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c109b60 con 0x7fdc5c0f6530 2023-10-18T21:40:04.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.482+0000 7fdc59d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc5c0f77d0 0x7fdc5c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:04.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.482+0000 7fdc59d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc5c0f77d0 0x7fdc5c109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37678/0 (socket says 172.21.15.8:37678) 2023-10-18T21:40:04.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.482+0000 7fdc59d9b700 1 -- 172.21.15.8:0/1259897568 learned_addr learned my addr 172.21.15.8:0/1259897568 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:04.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.483+0000 7fdc5a59c700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc5c0f6530 0x7fdc5c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:04.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.483+0000 7fdc59d9b700 1 -- 172.21.15.8:0/1259897568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc5c0f6530 msgr2=0x7fdc5c108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:04.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.483+0000 7fdc59d9b700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc5c0f6530 0x7fdc5c108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.483+0000 7fdc59d9b700 1 -- 172.21.15.8:0/1259897568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50005040 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.483+0000 7fdc59d9b700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc5c0f77d0 0x7fdc5c109470 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fdc50009830 tx=0x7fdc50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:04.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.483+0000 7fdc4affd700 1 -- 172.21.15.8:0/1259897568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc50018070 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.483+0000 7fdc4affd700 1 -- 172.21.15.8:0/1259897568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdc5001d8e0 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.483+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1259897568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5c10a4a0 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.483+0000 7fdc4affd700 1 -- 172.21.15.8:0/1259897568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc5001c540 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.484+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1259897568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c10aa00 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.485+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1259897568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5c045ad0 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.485+0000 7fdc4affd700 1 -- 172.21.15.8:0/1259897568 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdc5001da50 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.486+0000 7fdc4affd700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc44060f70 0x7fdc44063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:04.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.486+0000 7fdc4affd700 1 -- 172.21.15.8:0/1259897568 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdc5007e930 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.487+0000 7fdc5a59c700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc44060f70 0x7fdc44063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:04.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.487+0000 7fdc5a59c700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc44060f70 0x7fdc44063430 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fdc4c007fd0 tx=0x7fdc4c009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:04.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.491+0000 7fdc4affd700 1 -- 172.21.15.8:0/1259897568 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdc50051f10 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.717+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1259897568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdc5c0fecc0 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.718+0000 7fdc4affd700 1 -- 172.21.15.8:0/1259897568 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fdc50051b00 con 0x7fdc5c0f77d0 2023-10-18T21:40:04.719 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:40:04.719 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:40:04.720 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:40:04.720 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:40:04.720 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:40:04.720 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:40:04.720 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:40:04.721 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:40:04.721 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:40:04.721 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:40:04.721 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:40:04.721 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:40:04.722 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:40:04.722 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:40:04.722 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:40:04.722 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:40:04.722 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:40:04.723 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:40:04.723 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:40:04.723 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:40:04.723 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:40:04.723 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:40:04.724 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:40:04.724 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:40:04.724 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:40:04.724 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:40:04.724 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:40:04.725 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:40:04.725 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:40:04.725 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:40:04.725 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:40:04.725 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:40:04.725 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:40:04.726 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:40:04.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1259897568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc44060f70 msgr2=0x7fdc44063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:04.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc44060f70 0x7fdc44063430 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fdc4c007fd0 tx=0x7fdc4c009040).stop 2023-10-18T21:40:04.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1259897568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc5c0f77d0 msgr2=0x7fdc5c109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:04.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc5c0f77d0 0x7fdc5c109470 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fdc50009830 tx=0x7fdc50009b30).stop 2023-10-18T21:40:04.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1259897568 shutdown_connections 2023-10-18T21:40:04.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc44060f70 0x7fdc44063430 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc5c0f6530 0x7fdc5c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 --2- 172.21.15.8:0/1259897568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc5c0f77d0 0x7fdc5c109470 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1259897568 >> 172.21.15.8:0/1259897568 conn(0x7fdc5c0f1c90 msgr2=0x7fdc5c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:04.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1259897568 shutdown_connections 2023-10-18T21:40:04.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.720+0000 7fdc5b59e700 1 -- 172.21.15.8:0/1259897568 wait complete. 2023-10-18T21:40:04.729 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:40:04.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.858+0000 7fc389d25700 1 -- 172.21.15.8:0/819454815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3840f99e0 msgr2=0x7fc3840f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:04.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.858+0000 7fc389d25700 1 --2- 172.21.15.8:0/819454815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3840f99e0 0x7fc3840f9e40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7fc370004660 tx=0x7fc370009b30).stop 2023-10-18T21:40:04.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.858+0000 7fc389d25700 1 -- 172.21.15.8:0/819454815 shutdown_connections 2023-10-18T21:40:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.858+0000 7fc389d25700 1 --2- 172.21.15.8:0/819454815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3840f99e0 0x7fc3840f9e40 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.858+0000 7fc389d25700 1 --2- 172.21.15.8:0/819454815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3840f8740 0x7fc3840f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.858+0000 7fc389d25700 1 -- 172.21.15.8:0/819454815 >> 172.21.15.8:0/819454815 conn(0x7fc3840f40e0 msgr2=0x7fc3840f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.858+0000 7fc389d25700 1 -- 172.21.15.8:0/819454815 shutdown_connections 2023-10-18T21:40:04.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.858+0000 7fc389d25700 1 -- 172.21.15.8:0/819454815 wait complete. 2023-10-18T21:40:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.859+0000 7fc389d25700 1 Processor -- start 2023-10-18T21:40:04.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.859+0000 7fc389d25700 1 -- start start 2023-10-18T21:40:04.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.859+0000 7fc389d25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3840f8740 0x7fc384108e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:04.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.859+0000 7fc389d25700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3840f99e0 0x7fc384109380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:04.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.859+0000 7fc389d25700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc384109930 con 0x7fc3840f8740 2023-10-18T21:40:04.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.859+0000 7fc389d25700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc384109a70 con 0x7fc3840f99e0 2023-10-18T21:40:04.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.859+0000 7fc388d23700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3840f8740 0x7fc384108e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:04.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc388d23700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3840f8740 0x7fc384108e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37702/0 (socket says 172.21.15.8:37702) 2023-10-18T21:40:04.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc388d23700 1 -- 172.21.15.8:0/2438905 learned_addr learned my addr 172.21.15.8:0/2438905 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:04.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc383fff700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3840f99e0 0x7fc384109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:04.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc388d23700 1 -- 172.21.15.8:0/2438905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3840f99e0 msgr2=0x7fc384109380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:04.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc388d23700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3840f99e0 0x7fc384109380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:04.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc388d23700 1 -- 172.21.15.8:0/2438905 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370005040 con 0x7fc3840f8740 2023-10-18T21:40:04.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc388d23700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3840f8740 0x7fc384108e90 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fc378002700 tx=0x7fc378009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:04.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc3817fa700 1 -- 172.21.15.8:0/2438905 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc378009320 con 0x7fc3840f8740 2023-10-18T21:40:04.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc3817fa700 1 -- 172.21.15.8:0/2438905 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc37800f040 con 0x7fc3840f8740 2023-10-18T21:40:04.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc389d25700 1 -- 172.21.15.8:0/2438905 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38410a410 con 0x7fc3840f8740 2023-10-18T21:40:04.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.860+0000 7fc3817fa700 1 -- 172.21.15.8:0/2438905 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc378014950 con 0x7fc3840f8740 2023-10-18T21:40:04.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.861+0000 7fc389d25700 1 -- 172.21.15.8:0/2438905 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38410a9d0 con 0x7fc3840f8740 2023-10-18T21:40:04.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.862+0000 7fc389d25700 1 -- 172.21.15.8:0/2438905 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc384045ad0 con 0x7fc3840f8740 2023-10-18T21:40:04.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.862+0000 7fc3817fa700 1 -- 172.21.15.8:0/2438905 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc378009480 con 0x7fc3840f8740 2023-10-18T21:40:04.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.863+0000 7fc3817fa700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc374060f70 0x7fc374063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:04.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.863+0000 7fc3817fa700 1 -- 172.21.15.8:0/2438905 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc37807cc40 con 0x7fc3840f8740 2023-10-18T21:40:04.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.863+0000 7fc383fff700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc374060f70 0x7fc374063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:04.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.864+0000 7fc383fff700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc374060f70 0x7fc374063430 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fc370004e30 tx=0x7fc370009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:04.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:04.867+0000 7fc3817fa700 1 -- 172.21.15.8:0/2438905 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc3780502e0 con 0x7fc3840f8740 2023-10-18T21:40:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:03.234108+0000 mgr.smithi008.flmjzp (mgr.14640) 2472 : audit [DBG] from='client.36112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:03.583626+0000 mgr.smithi008.flmjzp (mgr.14640) 2473 : audit [DBG] from='client.36116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:03.927351+0000 mgr.smithi008.flmjzp (mgr.14640) 2474 : audit [DBG] from='client.36120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:04.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:04.342795+0000 mon.smithi008 (mon.0) 2886 : audit [DBG] from='client.? 172.21.15.8:0/3591425788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:04.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:03.234108+0000 mgr.smithi008.flmjzp (mgr.14640) 2472 : audit [DBG] from='client.36112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:04.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:03.583626+0000 mgr.smithi008.flmjzp (mgr.14640) 2473 : audit [DBG] from='client.36116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:04.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:03.927351+0000 mgr.smithi008.flmjzp (mgr.14640) 2474 : audit [DBG] from='client.36120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:04.342795+0000 mon.smithi008 (mon.0) 2886 : audit [DBG] from='client.? 172.21.15.8:0/3591425788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.065+0000 7fc389d25700 1 -- 172.21.15.8:0/2438905 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc38410ac50 con 0x7fc374060f70 2023-10-18T21:40:05.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.067+0000 7fc3817fa700 1 -- 172.21.15.8:0/2438905 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc38410ac50 con 0x7fc374060f70 2023-10-18T21:40:05.067 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:40:05.068 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:40:05.068 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:40:05.068 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:40:05.068 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:40:05.068 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:40:05.069 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:40:05.069 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:40:05.069 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:40:05.069 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:40:05.069 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:40:05.069 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:40:05.070 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:40:05.070 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:40:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.068+0000 7fc389d25700 1 -- 172.21.15.8:0/2438905 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc374060f70 msgr2=0x7fc374063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.068+0000 7fc389d25700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc374060f70 0x7fc374063430 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fc370004e30 tx=0x7fc370009b30).stop 2023-10-18T21:40:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.068+0000 7fc389d25700 1 -- 172.21.15.8:0/2438905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3840f8740 msgr2=0x7fc384108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.068+0000 7fc389d25700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3840f8740 0x7fc384108e90 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fc378002700 tx=0x7fc378009e00).stop 2023-10-18T21:40:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.069+0000 7fc389d25700 1 -- 172.21.15.8:0/2438905 shutdown_connections 2023-10-18T21:40:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.069+0000 7fc389d25700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc374060f70 0x7fc374063430 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.069+0000 7fc389d25700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3840f8740 0x7fc384108e90 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.069+0000 7fc389d25700 1 --2- 172.21.15.8:0/2438905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3840f99e0 0x7fc384109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.069+0000 7fc389d25700 1 -- 172.21.15.8:0/2438905 >> 172.21.15.8:0/2438905 conn(0x7fc3840f40e0 msgr2=0x7fc3840fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.069+0000 7fc389d25700 1 -- 172.21.15.8:0/2438905 shutdown_connections 2023-10-18T21:40:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:05.069+0000 7fc389d25700 1 -- 172.21.15.8:0/2438905 wait complete. 2023-10-18T21:40:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:04.178845+0000 mgr.smithi008.flmjzp (mgr.14640) 2475 : cluster [DBG] pgmap v1706: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:04.718426+0000 mon.smithi008 (mon.0) 2887 : audit [DBG] from='client.? 172.21.15.8:0/1259897568' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:40:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:04.178845+0000 mgr.smithi008.flmjzp (mgr.14640) 2475 : cluster [DBG] pgmap v1706: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:04.718426+0000 mon.smithi008 (mon.0) 2887 : audit [DBG] from='client.? 172.21.15.8:0/1259897568' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:40:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:05.066902+0000 mgr.smithi008.flmjzp (mgr.14640) 2476 : audit [DBG] from='client.36132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:06.208240+0000 mon.smithi008 (mon.0) 2888 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:06.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:05.066902+0000 mgr.smithi008.flmjzp (mgr.14640) 2476 : audit [DBG] from='client.36132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:06.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:06.208240+0000 mon.smithi008 (mon.0) 2888 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:06.179567+0000 mgr.smithi008.flmjzp (mgr.14640) 2477 : cluster [DBG] pgmap v1707: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:06.771961+0000 mon.smithi008 (mon.0) 2889 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:06.773178+0000 mon.smithi008 (mon.0) 2890 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:06.774160+0000 mgr.smithi008.flmjzp (mgr.14640) 2478 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:06.774862+0000 mgr.smithi008.flmjzp (mgr.14640) 2479 : cluster [DBG] pgmap v1708: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:06.775191+0000 mgr.smithi008.flmjzp (mgr.14640) 2480 : cluster [DBG] pgmap v1709: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:06.779936+0000 mon.smithi008 (mon.0) 2891 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:06.786628+0000 mon.smithi008 (mon.0) 2892 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:06.789967+0000 mon.smithi008 (mon.0) 2893 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:07.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:06.791660+0000 mon.smithi008 (mon.0) 2894 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:07.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:06.793312+0000 mon.smithi008 (mon.0) 2895 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:07.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:06.795429+0000 mon.smithi008 (mon.0) 2896 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:07.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:06.797348+0000 mgr.smithi008.flmjzp (mgr.14640) 2481 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:06.179567+0000 mgr.smithi008.flmjzp (mgr.14640) 2477 : cluster [DBG] pgmap v1707: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:06.771961+0000 mon.smithi008 (mon.0) 2889 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:06.773178+0000 mon.smithi008 (mon.0) 2890 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:06.774160+0000 mgr.smithi008.flmjzp (mgr.14640) 2478 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:06.774862+0000 mgr.smithi008.flmjzp (mgr.14640) 2479 : cluster [DBG] pgmap v1708: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:06.775191+0000 mgr.smithi008.flmjzp (mgr.14640) 2480 : cluster [DBG] pgmap v1709: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:06.779936+0000 mon.smithi008 (mon.0) 2891 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:06.786628+0000 mon.smithi008 (mon.0) 2892 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:06.789967+0000 mon.smithi008 (mon.0) 2893 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:06.791660+0000 mon.smithi008 (mon.0) 2894 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:06.793312+0000 mon.smithi008 (mon.0) 2895 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:06.795429+0000 mon.smithi008 (mon.0) 2896 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:06.797348+0000 mgr.smithi008.flmjzp (mgr.14640) 2481 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:10.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:08.775890+0000 mgr.smithi008.flmjzp (mgr.14640) 2482 : cluster [DBG] pgmap v1710: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:08.775890+0000 mgr.smithi008.flmjzp (mgr.14640) 2482 : cluster [DBG] pgmap v1710: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:10.776381+0000 mgr.smithi008.flmjzp (mgr.14640) 2483 : cluster [DBG] pgmap v1711: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:11.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:10.776381+0000 mgr.smithi008.flmjzp (mgr.14640) 2483 : cluster [DBG] pgmap v1711: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:12.777017+0000 mgr.smithi008.flmjzp (mgr.14640) 2484 : cluster [DBG] pgmap v1712: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:12.777017+0000 mgr.smithi008.flmjzp (mgr.14640) 2484 : cluster [DBG] pgmap v1712: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:14.777830+0000 mgr.smithi008.flmjzp (mgr.14640) 2485 : cluster [DBG] pgmap v1713: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:16.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:14.777830+0000 mgr.smithi008.flmjzp (mgr.14640) 2485 : cluster [DBG] pgmap v1713: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:17.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:16.807034+0000 mon.smithi008 (mon.0) 2897 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:17.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:16.809144+0000 mon.smithi008 (mon.0) 2898 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:16.810163+0000 mon.smithi008 (mon.0) 2899 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:16.816813+0000 mon.smithi008 (mon.0) 2900 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:16.823550+0000 mon.smithi008 (mon.0) 2901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:16.827142+0000 mon.smithi008 (mon.0) 2902 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:17.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:16.829112+0000 mon.smithi008 (mon.0) 2903 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:17.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:16.831042+0000 mon.smithi008 (mon.0) 2904 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:17.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:16.833682+0000 mon.smithi008 (mon.0) 2905 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:17.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:16.807034+0000 mon.smithi008 (mon.0) 2897 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:16.809144+0000 mon.smithi008 (mon.0) 2898 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:16.810163+0000 mon.smithi008 (mon.0) 2899 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:16.816813+0000 mon.smithi008 (mon.0) 2900 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:16.823550+0000 mon.smithi008 (mon.0) 2901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:16.827142+0000 mon.smithi008 (mon.0) 2902 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:16.829112+0000 mon.smithi008 (mon.0) 2903 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:16.831042+0000 mon.smithi008 (mon.0) 2904 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:16.833682+0000 mon.smithi008 (mon.0) 2905 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:18.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:16.778380+0000 mgr.smithi008.flmjzp (mgr.14640) 2486 : cluster [DBG] pgmap v1714: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:18.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:16.811012+0000 mgr.smithi008.flmjzp (mgr.14640) 2487 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:18.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:16.811588+0000 mgr.smithi008.flmjzp (mgr.14640) 2488 : cluster [DBG] pgmap v1715: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:18.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:16.811912+0000 mgr.smithi008.flmjzp (mgr.14640) 2489 : cluster [DBG] pgmap v1716: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:18.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:16.835784+0000 mgr.smithi008.flmjzp (mgr.14640) 2490 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:18.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:16.778380+0000 mgr.smithi008.flmjzp (mgr.14640) 2486 : cluster [DBG] pgmap v1714: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:18.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:16.811012+0000 mgr.smithi008.flmjzp (mgr.14640) 2487 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:18.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:16.811588+0000 mgr.smithi008.flmjzp (mgr.14640) 2488 : cluster [DBG] pgmap v1715: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:18.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:16.811912+0000 mgr.smithi008.flmjzp (mgr.14640) 2489 : cluster [DBG] pgmap v1716: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:18.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:16.835784+0000 mgr.smithi008.flmjzp (mgr.14640) 2490 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:20.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:18.812610+0000 mgr.smithi008.flmjzp (mgr.14640) 2491 : cluster [DBG] pgmap v1717: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:20.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:18.812610+0000 mgr.smithi008.flmjzp (mgr.14640) 2491 : cluster [DBG] pgmap v1717: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:20.813266+0000 mgr.smithi008.flmjzp (mgr.14640) 2492 : cluster [DBG] pgmap v1718: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:21.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:20.813266+0000 mgr.smithi008.flmjzp (mgr.14640) 2492 : cluster [DBG] pgmap v1718: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:22.813888+0000 mgr.smithi008.flmjzp (mgr.14640) 2493 : cluster [DBG] pgmap v1719: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:24.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:22.813888+0000 mgr.smithi008.flmjzp (mgr.14640) 2493 : cluster [DBG] pgmap v1719: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:26.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:24.814541+0000 mgr.smithi008.flmjzp (mgr.14640) 2494 : cluster [DBG] pgmap v1720: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:26.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:24.814541+0000 mgr.smithi008.flmjzp (mgr.14640) 2494 : cluster [DBG] pgmap v1720: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:27.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:26.841961+0000 mon.smithi008 (mon.0) 2906 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:27.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:26.844387+0000 mon.smithi008 (mon.0) 2907 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:27.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:26.845538+0000 mon.smithi008 (mon.0) 2908 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:27.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:26.852036+0000 mon.smithi008 (mon.0) 2909 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:27.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:26.860157+0000 mon.smithi008 (mon.0) 2910 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:27.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:26.863345+0000 mon.smithi008 (mon.0) 2911 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:27.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:26.865321+0000 mon.smithi008 (mon.0) 2912 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:27.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:26.867228+0000 mon.smithi008 (mon.0) 2913 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:27.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:26.869876+0000 mon.smithi008 (mon.0) 2914 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:27.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:26.841961+0000 mon.smithi008 (mon.0) 2906 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:26.844387+0000 mon.smithi008 (mon.0) 2907 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:26.845538+0000 mon.smithi008 (mon.0) 2908 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:26.852036+0000 mon.smithi008 (mon.0) 2909 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:26.860157+0000 mon.smithi008 (mon.0) 2910 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:26.863345+0000 mon.smithi008 (mon.0) 2911 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:26.865321+0000 mon.smithi008 (mon.0) 2912 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:26.867228+0000 mon.smithi008 (mon.0) 2913 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:26.869876+0000 mon.smithi008 (mon.0) 2914 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:26.814997+0000 mgr.smithi008.flmjzp (mgr.14640) 2495 : cluster [DBG] pgmap v1721: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:26.846415+0000 mgr.smithi008.flmjzp (mgr.14640) 2496 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:26.847019+0000 mgr.smithi008.flmjzp (mgr.14640) 2497 : cluster [DBG] pgmap v1722: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:26.847266+0000 mgr.smithi008.flmjzp (mgr.14640) 2498 : cluster [DBG] pgmap v1723: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:26.871959+0000 mgr.smithi008.flmjzp (mgr.14640) 2499 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:26.814997+0000 mgr.smithi008.flmjzp (mgr.14640) 2495 : cluster [DBG] pgmap v1721: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:26.846415+0000 mgr.smithi008.flmjzp (mgr.14640) 2496 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:26.847019+0000 mgr.smithi008.flmjzp (mgr.14640) 2497 : cluster [DBG] pgmap v1722: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:26.847266+0000 mgr.smithi008.flmjzp (mgr.14640) 2498 : cluster [DBG] pgmap v1723: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:28.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:26.871959+0000 mgr.smithi008.flmjzp (mgr.14640) 2499 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:28.848033+0000 mgr.smithi008.flmjzp (mgr.14640) 2500 : cluster [DBG] pgmap v1724: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:30.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:28.848033+0000 mgr.smithi008.flmjzp (mgr.14640) 2500 : cluster [DBG] pgmap v1724: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:30.848637+0000 mgr.smithi008.flmjzp (mgr.14640) 2501 : cluster [DBG] pgmap v1725: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:31.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:30.848637+0000 mgr.smithi008.flmjzp (mgr.14640) 2501 : cluster [DBG] pgmap v1725: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:32.849206+0000 mgr.smithi008.flmjzp (mgr.14640) 2502 : cluster [DBG] pgmap v1726: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:34.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:32.849206+0000 mgr.smithi008.flmjzp (mgr.14640) 2502 : cluster [DBG] pgmap v1726: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:35.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.222+0000 7f0e8ffff700 1 -- 172.21.15.8:0/570401168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e900f6530 msgr2=0x7f0e900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:35.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.222+0000 7f0e8ffff700 1 --2- 172.21.15.8:0/570401168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e900f6530 0x7f0e900f6950 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f0e80004660 tx=0x7f0e80009b30).stop 2023-10-18T21:40:35.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.222+0000 7f0e8ffff700 1 -- 172.21.15.8:0/570401168 shutdown_connections 2023-10-18T21:40:35.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.222+0000 7f0e8ffff700 1 --2- 172.21.15.8:0/570401168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e900f77d0 0x7f0e900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.222+0000 7f0e8ffff700 1 --2- 172.21.15.8:0/570401168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e900f6530 0x7f0e900f6950 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.222+0000 7f0e8ffff700 1 -- 172.21.15.8:0/570401168 >> 172.21.15.8:0/570401168 conn(0x7f0e900f1c90 msgr2=0x7f0e900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:35.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.222+0000 7f0e8ffff700 1 -- 172.21.15.8:0/570401168 shutdown_connections 2023-10-18T21:40:35.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.222+0000 7f0e8ffff700 1 -- 172.21.15.8:0/570401168 wait complete. 2023-10-18T21:40:35.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.223+0000 7f0e8ffff700 1 Processor -- start 2023-10-18T21:40:35.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.223+0000 7f0e8ffff700 1 -- start start 2023-10-18T21:40:35.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.223+0000 7f0e8ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e900f6530 0x7f0e90108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:35.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.223+0000 7f0e8ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e900f77d0 0x7f0e90109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:35.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.223+0000 7f0e8ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90109a00 con 0x7f0e900f6530 2023-10-18T21:40:35.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.223+0000 7f0e8ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90109b40 con 0x7f0e900f77d0 2023-10-18T21:40:35.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e8effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e900f6530 0x7f0e90108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:35.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e8effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e900f6530 0x7f0e90108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46844/0 (socket says 172.21.15.8:46844) 2023-10-18T21:40:35.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e8effd700 1 -- 172.21.15.8:0/3851364498 learned_addr learned my addr 172.21.15.8:0/3851364498 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:35.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e8effd700 1 -- 172.21.15.8:0/3851364498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e900f77d0 msgr2=0x7f0e90109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:35.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e8effd700 1 --2- 172.21.15.8:0/3851364498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e900f77d0 0x7f0e90109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:40:35.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e8effd700 1 -- 172.21.15.8:0/3851364498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80005040 con 0x7f0e900f6530 2023-10-18T21:40:35.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e8effd700 1 --2- 172.21.15.8:0/3851364498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e900f6530 0x7f0e90108f60 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f0e80009870 tx=0x7f0e8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:35.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e777fe700 1 -- 172.21.15.8:0/3851364498 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e80019070 con 0x7f0e900f6530 2023-10-18T21:40:35.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e777fe700 1 -- 172.21.15.8:0/3851364498 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0e8001e420 con 0x7f0e900f6530 2023-10-18T21:40:35.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e8ffff700 1 -- 172.21.15.8:0/3851364498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9010a480 con 0x7f0e900f6530 2023-10-18T21:40:35.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.224+0000 7f0e777fe700 1 -- 172.21.15.8:0/3851364498 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e80014660 con 0x7f0e900f6530 2023-10-18T21:40:35.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.225+0000 7f0e8ffff700 1 -- 172.21.15.8:0/3851364498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9010a960 con 0x7f0e900f6530 2023-10-18T21:40:35.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.226+0000 7f0e8ffff700 1 -- 172.21.15.8:0/3851364498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e90045ad0 con 0x7f0e900f6530 2023-10-18T21:40:35.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.227+0000 7f0e777fe700 1 -- 172.21.15.8:0/3851364498 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0e8001e9c0 con 0x7f0e900f6530 2023-10-18T21:40:35.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.228+0000 7f0e777fe700 1 --2- 172.21.15.8:0/3851364498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e78060f70 0x7f0e78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:35.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.228+0000 7f0e777fe700 1 -- 172.21.15.8:0/3851364498 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0e8007e470 con 0x7f0e900f6530 2023-10-18T21:40:35.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.228+0000 7f0e8e7fc700 1 --2- 172.21.15.8:0/3851364498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e78060f70 0x7f0e78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:35.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.229+0000 7f0e8e7fc700 1 --2- 172.21.15.8:0/3851364498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e78060f70 0x7f0e78063430 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f0e84004b70 tx=0x7f0e8400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:35.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.231+0000 7f0e777fe700 1 -- 172.21.15.8:0/3851364498 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0e80051ad0 con 0x7f0e900f6530 2023-10-18T21:40:35.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.429+0000 7f0e8ffff700 1 -- 172.21.15.8:0/3851364498 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e9010ac40 con 0x7f0e78060f70 2023-10-18T21:40:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.431+0000 7f0e777fe700 1 -- 172.21.15.8:0/3851364498 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0e9010ac40 con 0x7f0e78060f70 2023-10-18T21:40:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 -- 172.21.15.8:0/3851364498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e78060f70 msgr2=0x7f0e78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 --2- 172.21.15.8:0/3851364498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e78060f70 0x7f0e78063430 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f0e84004b70 tx=0x7f0e8400b040).stop 2023-10-18T21:40:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 -- 172.21.15.8:0/3851364498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e900f6530 msgr2=0x7f0e90108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 --2- 172.21.15.8:0/3851364498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e900f6530 0x7f0e90108f60 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f0e80009870 tx=0x7f0e8000b040).stop 2023-10-18T21:40:35.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 -- 172.21.15.8:0/3851364498 shutdown_connections 2023-10-18T21:40:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 --2- 172.21.15.8:0/3851364498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e78060f70 0x7f0e78063430 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 --2- 172.21.15.8:0/3851364498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e900f6530 0x7f0e90108f60 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 --2- 172.21.15.8:0/3851364498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e900f77d0 0x7f0e90109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:40:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 -- 172.21.15.8:0/3851364498 >> 172.21.15.8:0/3851364498 conn(0x7f0e900f1c90 msgr2=0x7f0e9006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 -- 172.21.15.8:0/3851364498 shutdown_connections 2023-10-18T21:40:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.433+0000 7f0e8ffff700 1 -- 172.21.15.8:0/3851364498 wait complete. 2023-10-18T21:40:35.448 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:40:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.573+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/1653688123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c580f88e0 msgr2=0x7f2c580f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:35.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.573+0000 7f2c5e5d5700 1 --2- 172.21.15.8:0/1653688123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c580f88e0 0x7f2c580f8d00 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f2c48004660 tx=0x7f2c48009b30).stop 2023-10-18T21:40:35.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.573+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/1653688123 shutdown_connections 2023-10-18T21:40:35.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.573+0000 7f2c5e5d5700 1 --2- 172.21.15.8:0/1653688123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c580f9b80 0x7f2c580f9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.573+0000 7f2c5e5d5700 1 --2- 172.21.15.8:0/1653688123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c580f88e0 0x7f2c580f8d00 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.573+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/1653688123 >> 172.21.15.8:0/1653688123 conn(0x7f2c580f42a0 msgr2=0x7f2c580f6690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.573+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/1653688123 shutdown_connections 2023-10-18T21:40:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.573+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/1653688123 wait complete. 2023-10-18T21:40:35.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.574+0000 7f2c5e5d5700 1 Processor -- start 2023-10-18T21:40:35.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.575+0000 7f2c5e5d5700 1 -- start start 2023-10-18T21:40:35.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.575+0000 7f2c5e5d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c580f88e0 0x7f2c581091c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:35.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.575+0000 7f2c5e5d5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c580f9b80 0x7f2c581096b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:35.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.575+0000 7f2c5e5d5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c58109c60 con 0x7f2c580f88e0 2023-10-18T21:40:35.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.575+0000 7f2c5e5d5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c58109da0 con 0x7f2c580f9b80 2023-10-18T21:40:35.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.576+0000 7f2c57fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c580f88e0 0x7f2c581091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:35.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.576+0000 7f2c57fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c580f88e0 0x7f2c581091c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46854/0 (socket says 172.21.15.8:46854) 2023-10-18T21:40:35.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.576+0000 7f2c57fff700 1 -- 172.21.15.8:0/3030185822 learned_addr learned my addr 172.21.15.8:0/3030185822 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:35.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.576+0000 7f2c577fe700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c580f9b80 0x7f2c581096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:35.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.576+0000 7f2c57fff700 1 -- 172.21.15.8:0/3030185822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c580f9b80 msgr2=0x7f2c581096b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:35.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.576+0000 7f2c57fff700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c580f9b80 0x7f2c581096b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.576+0000 7f2c57fff700 1 -- 172.21.15.8:0/3030185822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c48005040 con 0x7f2c580f88e0 2023-10-18T21:40:35.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.576+0000 7f2c57fff700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c580f88e0 0x7f2c581091c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f2c48004e30 tx=0x7f2c48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:35.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.577+0000 7f2c54ff9700 1 -- 172.21.15.8:0/3030185822 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c48018070 con 0x7f2c580f88e0 2023-10-18T21:40:35.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.577+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/3030185822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5810a6e0 con 0x7f2c580f88e0 2023-10-18T21:40:35.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.577+0000 7f2c54ff9700 1 -- 172.21.15.8:0/3030185822 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2c48009630 con 0x7f2c580f88e0 2023-10-18T21:40:35.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.577+0000 7f2c54ff9700 1 -- 172.21.15.8:0/3030185822 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c4801c3c0 con 0x7f2c580f88e0 2023-10-18T21:40:35.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.577+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/3030185822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5810ac40 con 0x7f2c580f88e0 2023-10-18T21:40:35.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.578+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/3030185822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c58045ad0 con 0x7f2c580f88e0 2023-10-18T21:40:35.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.579+0000 7f2c54ff9700 1 -- 172.21.15.8:0/3030185822 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2c4801d420 con 0x7f2c580f88e0 2023-10-18T21:40:35.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.579+0000 7f2c54ff9700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c40060f20 0x7f2c400633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:35.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.580+0000 7f2c54ff9700 1 -- 172.21.15.8:0/3030185822 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2c4807e530 con 0x7f2c580f88e0 2023-10-18T21:40:35.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.580+0000 7f2c577fe700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c40060f20 0x7f2c400633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:35.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.580+0000 7f2c577fe700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c40060f20 0x7f2c400633e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f2c4c004c40 tx=0x7f2c4c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:35.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.584+0000 7f2c54ff9700 1 -- 172.21.15.8:0/3030185822 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2c48051b10 con 0x7f2c580f88e0 2023-10-18T21:40:35.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.782+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/3030185822 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c581011b0 con 0x7f2c40060f20 2023-10-18T21:40:35.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.783+0000 7f2c54ff9700 1 -- 172.21.15.8:0/3030185822 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2c581011b0 con 0x7f2c40060f20 2023-10-18T21:40:35.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.785+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/3030185822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c40060f20 msgr2=0x7f2c400633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:35.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.785+0000 7f2c5e5d5700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c40060f20 0x7f2c400633e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f2c4c004c40 tx=0x7f2c4c00b040).stop 2023-10-18T21:40:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.785+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/3030185822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c580f88e0 msgr2=0x7f2c581091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.785+0000 7f2c5e5d5700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c580f88e0 0x7f2c581091c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f2c48004e30 tx=0x7f2c48009b30).stop 2023-10-18T21:40:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.785+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/3030185822 shutdown_connections 2023-10-18T21:40:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.785+0000 7f2c5e5d5700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2c40060f20 0x7f2c400633e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.785+0000 7f2c5e5d5700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c580f88e0 0x7f2c581091c0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.785+0000 7f2c5e5d5700 1 --2- 172.21.15.8:0/3030185822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c580f9b80 0x7f2c581096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.785+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/3030185822 >> 172.21.15.8:0/3030185822 conn(0x7f2c580f42a0 msgr2=0x7f2c580fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.786+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/3030185822 shutdown_connections 2023-10-18T21:40:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.786+0000 7f2c5e5d5700 1 -- 172.21.15.8:0/3030185822 wait complete. 2023-10-18T21:40:35.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.922+0000 7fbb53fff700 1 -- 172.21.15.8:0/1521861225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb540f6530 msgr2=0x7fbb540f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:35.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.922+0000 7fbb53fff700 1 --2- 172.21.15.8:0/1521861225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb540f6530 0x7fbb540f6950 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fbb44004660 tx=0x7fbb44009b30).stop 2023-10-18T21:40:35.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.922+0000 7fbb53fff700 1 -- 172.21.15.8:0/1521861225 shutdown_connections 2023-10-18T21:40:35.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.922+0000 7fbb53fff700 1 --2- 172.21.15.8:0/1521861225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb540f77d0 0x7fbb540f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.922+0000 7fbb53fff700 1 --2- 172.21.15.8:0/1521861225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb540f6530 0x7fbb540f6950 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.922+0000 7fbb53fff700 1 -- 172.21.15.8:0/1521861225 >> 172.21.15.8:0/1521861225 conn(0x7fbb540f1c90 msgr2=0x7fbb540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:35.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.922+0000 7fbb53fff700 1 -- 172.21.15.8:0/1521861225 shutdown_connections 2023-10-18T21:40:35.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.923+0000 7fbb53fff700 1 -- 172.21.15.8:0/1521861225 wait complete. 2023-10-18T21:40:35.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.923+0000 7fbb53fff700 1 Processor -- start 2023-10-18T21:40:35.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.923+0000 7fbb53fff700 1 -- start start 2023-10-18T21:40:35.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.924+0000 7fbb53fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb540f6530 0x7fbb54108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:35.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.924+0000 7fbb53fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb540f77d0 0x7fbb54109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:35.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.924+0000 7fbb53fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54109a00 con 0x7fbb540f77d0 2023-10-18T21:40:35.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.924+0000 7fbb53fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54109b40 con 0x7fbb540f6530 2023-10-18T21:40:35.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.924+0000 7fbb527fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb540f77d0 0x7fbb54109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:35.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.924+0000 7fbb527fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb540f77d0 0x7fbb54109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46878/0 (socket says 172.21.15.8:46878) 2023-10-18T21:40:35.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.924+0000 7fbb527fc700 1 -- 172.21.15.8:0/922094629 learned_addr learned my addr 172.21.15.8:0/922094629 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:35.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.924+0000 7fbb52ffd700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb540f6530 0x7fbb54108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:35.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.925+0000 7fbb527fc700 1 -- 172.21.15.8:0/922094629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb540f6530 msgr2=0x7fbb54108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:35.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.925+0000 7fbb527fc700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb540f6530 0x7fbb54108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:35.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.925+0000 7fbb527fc700 1 -- 172.21.15.8:0/922094629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44005040 con 0x7fbb540f77d0 2023-10-18T21:40:35.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.925+0000 7fbb527fc700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb540f77d0 0x7fbb54109450 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fbb48002700 tx=0x7fbb48009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:35.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.925+0000 7fbb3b7fe700 1 -- 172.21.15.8:0/922094629 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb48009320 con 0x7fbb540f77d0 2023-10-18T21:40:35.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.925+0000 7fbb3b7fe700 1 -- 172.21.15.8:0/922094629 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbb4800f040 con 0x7fbb540f77d0 2023-10-18T21:40:35.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.925+0000 7fbb53fff700 1 -- 172.21.15.8:0/922094629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5410a4e0 con 0x7fbb540f77d0 2023-10-18T21:40:35.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.925+0000 7fbb3b7fe700 1 -- 172.21.15.8:0/922094629 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb480148f0 con 0x7fbb540f77d0 2023-10-18T21:40:35.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.925+0000 7fbb53fff700 1 -- 172.21.15.8:0/922094629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5410aaa0 con 0x7fbb540f77d0 2023-10-18T21:40:35.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.926+0000 7fbb53fff700 1 -- 172.21.15.8:0/922094629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb54045ad0 con 0x7fbb540f77d0 2023-10-18T21:40:35.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.927+0000 7fbb3b7fe700 1 -- 172.21.15.8:0/922094629 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbb48009480 con 0x7fbb540f77d0 2023-10-18T21:40:35.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.928+0000 7fbb3b7fe700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb3c060f70 0x7fbb3c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:35.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.928+0000 7fbb3b7fe700 1 -- 172.21.15.8:0/922094629 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbb4807cb80 con 0x7fbb540f77d0 2023-10-18T21:40:35.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.928+0000 7fbb52ffd700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb3c060f70 0x7fbb3c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:35.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.929+0000 7fbb52ffd700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb3c060f70 0x7fbb3c063430 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fbb44004630 tx=0x7fbb44009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:35.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:35.932+0000 7fbb3b7fe700 1 -- 172.21.15.8:0/922094629 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbb480501e0 con 0x7fbb540f77d0 2023-10-18T21:40:36.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.124+0000 7fbb53fff700 1 -- 172.21.15.8:0/922094629 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb540fee40 con 0x7fbb3c060f70 2023-10-18T21:40:36.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.134+0000 7fbb3b7fe700 1 -- 172.21.15.8:0/922094629 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fbb540fee40 con 0x7fbb3c060f70 2023-10-18T21:40:36.135 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:40:36.135 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (47m) 4m ago 48m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:40:36.135 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (41m) 4m ago 48m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:40:36.135 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (41m) 2m ago 47m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:40:36.136 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (47m) 4m ago 48m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:40:36.136 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 44m - - 2023-10-18T21:40:36.136 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 44m - - 2023-10-18T21:40:36.136 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 44m - - 2023-10-18T21:40:36.136 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 44m - - 2023-10-18T21:40:36.137 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (42m) 4m ago 50m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:40:36.137 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (41m) 2m ago 47m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:40:36.137 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (41m) 4m ago 50m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:40:36.137 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (41m) 2m ago 47m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:40:36.137 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (48m) 4m ago 48m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:40:36.137 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (47m) 2m ago 47m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:40:36.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (40m) 4m ago 47m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:40:36.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (38m) 4m ago 46m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:40:36.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (38m) 4m ago 46m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:40:36.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (37m) 2m ago 46m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:40:36.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (37m) 2m ago 46m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:40:36.139 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (36m) 2m ago 45m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:40:36.139 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (42m) 4m ago 48m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:40:36.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 -- 172.21.15.8:0/922094629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb3c060f70 msgr2=0x7fbb3c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:36.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb3c060f70 0x7fbb3c063430 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fbb44004630 tx=0x7fbb44009b30).stop 2023-10-18T21:40:36.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 -- 172.21.15.8:0/922094629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb540f77d0 msgr2=0x7fbb54109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:36.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb540f77d0 0x7fbb54109450 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fbb48002700 tx=0x7fbb48009e00).stop 2023-10-18T21:40:36.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 -- 172.21.15.8:0/922094629 shutdown_connections 2023-10-18T21:40:36.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb3c060f70 0x7fbb3c063430 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb540f6530 0x7fbb54108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 --2- 172.21.15.8:0/922094629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb540f77d0 0x7fbb54109450 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 -- 172.21.15.8:0/922094629 >> 172.21.15.8:0/922094629 conn(0x7fbb540f1c90 msgr2=0x7fbb5406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:36.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 -- 172.21.15.8:0/922094629 shutdown_connections 2023-10-18T21:40:36.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.136+0000 7fbb53fff700 1 -- 172.21.15.8:0/922094629 wait complete. 2023-10-18T21:40:36.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:34.849896+0000 mgr.smithi008.flmjzp (mgr.14640) 2503 : cluster [DBG] pgmap v1727: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:36.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:34.849896+0000 mgr.smithi008.flmjzp (mgr.14640) 2503 : cluster [DBG] pgmap v1727: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:36.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.272+0000 7fcd4cc77700 1 -- 172.21.15.8:0/3587345319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd480f96a0 msgr2=0x7fcd480fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:36.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.272+0000 7fcd4cc77700 1 --2- 172.21.15.8:0/3587345319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd480f96a0 0x7fcd480fbaf0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fcd3c004660 tx=0x7fcd3c009b30).stop 2023-10-18T21:40:36.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.272+0000 7fcd4cc77700 1 -- 172.21.15.8:0/3587345319 shutdown_connections 2023-10-18T21:40:36.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.272+0000 7fcd4cc77700 1 --2- 172.21.15.8:0/3587345319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd480f96a0 0x7fcd480fbaf0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.272+0000 7fcd4cc77700 1 --2- 172.21.15.8:0/3587345319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd48060310 0x7fcd480f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.272+0000 7fcd4cc77700 1 -- 172.21.15.8:0/3587345319 >> 172.21.15.8:0/3587345319 conn(0x7fcd480f0ba0 msgr2=0x7fcd480f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:36.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.272+0000 7fcd4cc77700 1 -- 172.21.15.8:0/3587345319 shutdown_connections 2023-10-18T21:40:36.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.273+0000 7fcd4cc77700 1 -- 172.21.15.8:0/3587345319 wait complete. 2023-10-18T21:40:36.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.273+0000 7fcd4cc77700 1 Processor -- start 2023-10-18T21:40:36.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.273+0000 7fcd4cc77700 1 -- start start 2023-10-18T21:40:36.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.274+0000 7fcd4cc77700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd48060310 0x7fcd480f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:36.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.274+0000 7fcd4cc77700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd480f96a0 0x7fcd480f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:36.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.274+0000 7fcd4cc77700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480f5580 con 0x7fcd480f96a0 2023-10-18T21:40:36.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.274+0000 7fcd4cc77700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480f56c0 con 0x7fcd48060310 2023-10-18T21:40:36.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.274+0000 7fcd46ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd480f96a0 0x7fcd480f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:36.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.274+0000 7fcd46ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd480f96a0 0x7fcd480f5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46910/0 (socket says 172.21.15.8:46910) 2023-10-18T21:40:36.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.274+0000 7fcd46ffd700 1 -- 172.21.15.8:0/689392266 learned_addr learned my addr 172.21.15.8:0/689392266 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:36.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.274+0000 7fcd477fe700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd48060310 0x7fcd480f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:36.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.275+0000 7fcd46ffd700 1 -- 172.21.15.8:0/689392266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd48060310 msgr2=0x7fcd480f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:36.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.275+0000 7fcd46ffd700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd48060310 0x7fcd480f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.275+0000 7fcd46ffd700 1 -- 172.21.15.8:0/689392266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c005040 con 0x7fcd480f96a0 2023-10-18T21:40:36.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.275+0000 7fcd46ffd700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd480f96a0 0x7fcd480f5020 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fcd3c007a60 tx=0x7fcd3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:36.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.275+0000 7fcd2ffff700 1 -- 172.21.15.8:0/689392266 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd3c018070 con 0x7fcd480f96a0 2023-10-18T21:40:36.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.275+0000 7fcd2ffff700 1 -- 172.21.15.8:0/689392266 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcd3c009630 con 0x7fcd480f96a0 2023-10-18T21:40:36.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.275+0000 7fcd2ffff700 1 -- 172.21.15.8:0/689392266 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd3c01c4d0 con 0x7fcd480f96a0 2023-10-18T21:40:36.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.275+0000 7fcd4cc77700 1 -- 172.21.15.8:0/689392266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd480f5940 con 0x7fcd480f96a0 2023-10-18T21:40:36.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.275+0000 7fcd4cc77700 1 -- 172.21.15.8:0/689392266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd480f5e50 con 0x7fcd480f96a0 2023-10-18T21:40:36.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.276+0000 7fcd4cc77700 1 -- 172.21.15.8:0/689392266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd48045ad0 con 0x7fcd480f96a0 2023-10-18T21:40:36.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.277+0000 7fcd2ffff700 1 -- 172.21.15.8:0/689392266 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcd3c01d420 con 0x7fcd480f96a0 2023-10-18T21:40:36.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.278+0000 7fcd2ffff700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd30060f70 0x7fcd30063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:36.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.278+0000 7fcd2ffff700 1 -- 172.21.15.8:0/689392266 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcd3c07e650 con 0x7fcd480f96a0 2023-10-18T21:40:36.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.278+0000 7fcd477fe700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd30060f70 0x7fcd30063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:36.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.279+0000 7fcd477fe700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd30060f70 0x7fcd30063430 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fcd480f6930 tx=0x7fcd3800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:36.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.282+0000 7fcd2ffff700 1 -- 172.21.15.8:0/689392266 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcd3c04e270 con 0x7fcd480f96a0 2023-10-18T21:40:36.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.534+0000 7fcd4cc77700 1 -- 172.21.15.8:0/689392266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcd48027a00 con 0x7fcd480f96a0 2023-10-18T21:40:36.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.535+0000 7fcd2ffff700 1 -- 172.21.15.8:0/689392266 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fcd3c051890 con 0x7fcd480f96a0 2023-10-18T21:40:36.536 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:40:36.536 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:40:36.537 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:40:36.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:40:36.537 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:40:36.537 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:40:36.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:40:36.538 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:40:36.538 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:40:36.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:40:36.538 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:40:36.539 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:40:36.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:40:36.539 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:40:36.539 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:40:36.540 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:40:36.540 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:40:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 -- 172.21.15.8:0/689392266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd30060f70 msgr2=0x7fcd30063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd30060f70 0x7fcd30063430 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fcd480f6930 tx=0x7fcd3800b040).stop 2023-10-18T21:40:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 -- 172.21.15.8:0/689392266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd480f96a0 msgr2=0x7fcd480f5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd480f96a0 0x7fcd480f5020 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fcd3c007a60 tx=0x7fcd3c009b30).stop 2023-10-18T21:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 -- 172.21.15.8:0/689392266 shutdown_connections 2023-10-18T21:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd30060f70 0x7fcd30063430 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd48060310 0x7fcd480f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 --2- 172.21.15.8:0/689392266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd480f96a0 0x7fcd480f5020 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 -- 172.21.15.8:0/689392266 >> 172.21.15.8:0/689392266 conn(0x7fcd480f0ba0 msgr2=0x7fcd480f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:36.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 -- 172.21.15.8:0/689392266 shutdown_connections 2023-10-18T21:40:36.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.537+0000 7fcd4cc77700 1 -- 172.21.15.8:0/689392266 wait complete. 2023-10-18T21:40:36.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.674+0000 7fc072fd7700 1 -- 172.21.15.8:0/122489783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc06c0f77d0 msgr2=0x7fc06c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:36.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.674+0000 7fc072fd7700 1 --2- 172.21.15.8:0/122489783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc06c0f77d0 0x7fc06c0f7c30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fc05c004660 tx=0x7fc05c009b30).stop 2023-10-18T21:40:36.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.674+0000 7fc072fd7700 1 -- 172.21.15.8:0/122489783 shutdown_connections 2023-10-18T21:40:36.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.674+0000 7fc072fd7700 1 --2- 172.21.15.8:0/122489783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc06c0f77d0 0x7fc06c0f7c30 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.674+0000 7fc072fd7700 1 --2- 172.21.15.8:0/122489783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc06c0f6530 0x7fc06c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.674+0000 7fc072fd7700 1 -- 172.21.15.8:0/122489783 >> 172.21.15.8:0/122489783 conn(0x7fc06c0f1c90 msgr2=0x7fc06c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:36.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.675+0000 7fc072fd7700 1 -- 172.21.15.8:0/122489783 shutdown_connections 2023-10-18T21:40:36.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.675+0000 7fc072fd7700 1 -- 172.21.15.8:0/122489783 wait complete. 2023-10-18T21:40:36.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.675+0000 7fc072fd7700 1 Processor -- start 2023-10-18T21:40:36.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.676+0000 7fc072fd7700 1 -- start start 2023-10-18T21:40:36.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.676+0000 7fc072fd7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc06c0f6530 0x7fc06c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:36.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.676+0000 7fc072fd7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc06c0f77d0 0x7fc06c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:36.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.676+0000 7fc072fd7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c107880 con 0x7fc06c0f6530 2023-10-18T21:40:36.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.676+0000 7fc072fd7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c1080c0 con 0x7fc06c0f77d0 2023-10-18T21:40:36.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.676+0000 7fc071fd5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc06c0f6530 0x7fc06c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:36.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.676+0000 7fc071fd5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc06c0f6530 0x7fc06c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46930/0 (socket says 172.21.15.8:46930) 2023-10-18T21:40:36.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.676+0000 7fc071fd5700 1 -- 172.21.15.8:0/2992006255 learned_addr learned my addr 172.21.15.8:0/2992006255 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:36.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.676+0000 7fc0717d4700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc06c0f77d0 0x7fc06c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:36.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.677+0000 7fc071fd5700 1 -- 172.21.15.8:0/2992006255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc06c0f77d0 msgr2=0x7fc06c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:36.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.677+0000 7fc071fd5700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc06c0f77d0 0x7fc06c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.677+0000 7fc071fd5700 1 -- 172.21.15.8:0/2992006255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c005040 con 0x7fc06c0f6530 2023-10-18T21:40:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.677+0000 7fc071fd5700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc06c0f6530 0x7fc06c106d90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fc06800c790 tx=0x7fc068007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.677+0000 7fc0627fc700 1 -- 172.21.15.8:0/2992006255 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc068013630 con 0x7fc06c0f6530 2023-10-18T21:40:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.677+0000 7fc0627fc700 1 -- 172.21.15.8:0/2992006255 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc068012870 con 0x7fc06c0f6530 2023-10-18T21:40:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.677+0000 7fc072fd7700 1 -- 172.21.15.8:0/2992006255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c1083a0 con 0x7fc06c0f6530 2023-10-18T21:40:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.677+0000 7fc0627fc700 1 -- 172.21.15.8:0/2992006255 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc068002830 con 0x7fc06c0f6530 2023-10-18T21:40:36.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.677+0000 7fc072fd7700 1 -- 172.21.15.8:0/2992006255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c1088e0 con 0x7fc06c0f6530 2023-10-18T21:40:36.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.678+0000 7fc072fd7700 1 -- 172.21.15.8:0/2992006255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c059100 con 0x7fc06c0f6530 2023-10-18T21:40:36.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.679+0000 7fc0627fc700 1 -- 172.21.15.8:0/2992006255 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc068010070 con 0x7fc06c0f6530 2023-10-18T21:40:36.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.680+0000 7fc0627fc700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc058060f70 0x7fc058063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:36.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.680+0000 7fc0627fc700 1 -- 172.21.15.8:0/2992006255 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc06807ca50 con 0x7fc06c0f6530 2023-10-18T21:40:36.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.680+0000 7fc0717d4700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc058060f70 0x7fc058063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:36.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.681+0000 7fc0717d4700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc058060f70 0x7fc058063430 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fc05c004630 tx=0x7fc05c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:36.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.684+0000 7fc0627fc700 1 -- 172.21.15.8:0/2992006255 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc06804c5a0 con 0x7fc06c0f6530 2023-10-18T21:40:36.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.914+0000 7fc072fd7700 1 -- 172.21.15.8:0/2992006255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc06c0fed60 con 0x7fc06c0f6530 2023-10-18T21:40:36.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.915+0000 7fc0627fc700 1 -- 172.21.15.8:0/2992006255 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fc06804fbc0 con 0x7fc06c0f6530 2023-10-18T21:40:36.916 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:40:36.916 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:40:36.916 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:40:36.916 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:40:36.916 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:40:36.917 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:40:36.917 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:40:36.917 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:40:36.917 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:40:36.918 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:40:36.918 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:40:36.918 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:40:36.918 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:40:36.918 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:40:36.919 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:40:36.919 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:40:36.919 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:40:36.919 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:40:36.919 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:40:36.919 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:40:36.920 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:40:36.920 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:40:36.920 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:40:36.920 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:40:36.920 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:40:36.921 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:40:36.921 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:40:36.921 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:40:36.921 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:40:36.921 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:40:36.922 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:40:36.922 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:40:36.922 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:40:36.922 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:40:36.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 -- 172.21.15.8:0/2992006255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc058060f70 msgr2=0x7fc058063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:36.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc058060f70 0x7fc058063430 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fc05c004630 tx=0x7fc05c009b30).stop 2023-10-18T21:40:36.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 -- 172.21.15.8:0/2992006255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc06c0f6530 msgr2=0x7fc06c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:36.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc06c0f6530 0x7fc06c106d90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fc06800c790 tx=0x7fc068007d90).stop 2023-10-18T21:40:36.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 -- 172.21.15.8:0/2992006255 shutdown_connections 2023-10-18T21:40:36.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc058060f70 0x7fc058063430 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc06c0f6530 0x7fc06c106d90 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 --2- 172.21.15.8:0/2992006255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc06c0f77d0 0x7fc06c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:36.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 -- 172.21.15.8:0/2992006255 >> 172.21.15.8:0/2992006255 conn(0x7fc06c0f1c90 msgr2=0x7fc06c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:36.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 -- 172.21.15.8:0/2992006255 shutdown_connections 2023-10-18T21:40:36.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:36.917+0000 7fc072fd7700 1 -- 172.21.15.8:0/2992006255 wait complete. 2023-10-18T21:40:36.926 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:40:37.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.057+0000 7f15dbfff700 1 -- 172.21.15.8:0/1120290516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15dc0f6530 msgr2=0x7f15dc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:37.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.057+0000 7f15dbfff700 1 --2- 172.21.15.8:0/1120290516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15dc0f6530 0x7f15dc0f6950 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f15cc004660 tx=0x7f15cc009b30).stop 2023-10-18T21:40:37.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.058+0000 7f15dbfff700 1 -- 172.21.15.8:0/1120290516 shutdown_connections 2023-10-18T21:40:37.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.058+0000 7f15dbfff700 1 --2- 172.21.15.8:0/1120290516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15dc0f77d0 0x7f15dc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.058+0000 7f15dbfff700 1 --2- 172.21.15.8:0/1120290516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15dc0f6530 0x7f15dc0f6950 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.058+0000 7f15dbfff700 1 -- 172.21.15.8:0/1120290516 >> 172.21.15.8:0/1120290516 conn(0x7f15dc0f1c90 msgr2=0x7f15dc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.058+0000 7f15dbfff700 1 -- 172.21.15.8:0/1120290516 shutdown_connections 2023-10-18T21:40:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.058+0000 7f15dbfff700 1 -- 172.21.15.8:0/1120290516 wait complete. 2023-10-18T21:40:37.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.059+0000 7f15dbfff700 1 Processor -- start 2023-10-18T21:40:37.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.059+0000 7f15dbfff700 1 -- start start 2023-10-18T21:40:37.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15dbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15dc0f6530 0x7f15dc108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:37.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15dc0f77d0 0x7f15dc109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:37.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15dbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc1099e0 con 0x7f15dc0f77d0 2023-10-18T21:40:37.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15dbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc109b20 con 0x7f15dc0f6530 2023-10-18T21:40:37.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15da7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15dc0f77d0 0x7f15dc109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:37.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15da7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15dc0f77d0 0x7f15dc109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45718/0 (socket says 172.21.15.8:45718) 2023-10-18T21:40:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15da7fc700 1 -- 172.21.15.8:0/3780834142 learned_addr learned my addr 172.21.15.8:0/3780834142 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:40:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15daffd700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15dc0f6530 0x7f15dc108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15da7fc700 1 -- 172.21.15.8:0/3780834142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15dc0f6530 msgr2=0x7f15dc108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15da7fc700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15dc0f6530 0x7f15dc108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:37.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.060+0000 7f15da7fc700 1 -- 172.21.15.8:0/3780834142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc005040 con 0x7f15dc0f77d0 2023-10-18T21:40:37.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.061+0000 7f15da7fc700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15dc0f77d0 0x7f15dc109430 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f15d000e7f0 tx=0x7f15d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:37.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.061+0000 7f15c37fe700 1 -- 172.21.15.8:0/3780834142 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15d00092e0 con 0x7f15dc0f77d0 2023-10-18T21:40:37.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.061+0000 7f15c37fe700 1 -- 172.21.15.8:0/3780834142 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f15d000f040 con 0x7f15dc0f77d0 2023-10-18T21:40:37.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.061+0000 7f15dbfff700 1 -- 172.21.15.8:0/3780834142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc10a4c0 con 0x7f15dc0f77d0 2023-10-18T21:40:37.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.061+0000 7f15c37fe700 1 -- 172.21.15.8:0/3780834142 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15d00147e0 con 0x7f15dc0f77d0 2023-10-18T21:40:37.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.061+0000 7f15dbfff700 1 -- 172.21.15.8:0/3780834142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc10aa00 con 0x7f15dc0f77d0 2023-10-18T21:40:37.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.062+0000 7f15dbfff700 1 -- 172.21.15.8:0/3780834142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15dc045ad0 con 0x7f15dc0f77d0 2023-10-18T21:40:37.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.063+0000 7f15c37fe700 1 -- 172.21.15.8:0/3780834142 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f15d001b030 con 0x7f15dc0f77d0 2023-10-18T21:40:37.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.064+0000 7f15c37fe700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15c4060f70 0x7f15c4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:40:37.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.064+0000 7f15c37fe700 1 -- 172.21.15.8:0/3780834142 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f15d007c6b0 con 0x7f15dc0f77d0 2023-10-18T21:40:37.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.064+0000 7f15daffd700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15c4060f70 0x7f15c4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:40:37.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.065+0000 7f15daffd700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15c4060f70 0x7f15c4063430 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f15cc005010 tx=0x7f15cc016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:40:37.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.068+0000 7f15c37fe700 1 -- 172.21.15.8:0/3780834142 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f15d004fd40 con 0x7f15dc0f77d0 2023-10-18T21:40:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:35.431109+0000 mgr.smithi008.flmjzp (mgr.14640) 2504 : audit [DBG] from='client.36136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:35.783721+0000 mgr.smithi008.flmjzp (mgr.14640) 2505 : audit [DBG] from='client.36140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.535528+0000 mon.smithi008 (mon.0) 2915 : audit [DBG] from='client.? 172.21.15.8:0/689392266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.879188+0000 mon.smithi008 (mon.0) 2916 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.880868+0000 mon.smithi008 (mon.0) 2917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.881636+0000 mon.smithi008 (mon.0) 2918 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.886934+0000 mon.smithi008 (mon.0) 2919 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.892095+0000 mon.smithi008 (mon.0) 2920 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:37.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.894536+0000 mon.smithi008 (mon.0) 2921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:37.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.895847+0000 mon.smithi008 (mon.0) 2922 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:37.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.897207+0000 mon.smithi008 (mon.0) 2923 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:37.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.898789+0000 mon.smithi008 (mon.0) 2924 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:35.431109+0000 mgr.smithi008.flmjzp (mgr.14640) 2504 : audit [DBG] from='client.36136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:35.783721+0000 mgr.smithi008.flmjzp (mgr.14640) 2505 : audit [DBG] from='client.36140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.535528+0000 mon.smithi008 (mon.0) 2915 : audit [DBG] from='client.? 172.21.15.8:0/689392266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.879188+0000 mon.smithi008 (mon.0) 2916 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.880868+0000 mon.smithi008 (mon.0) 2917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.881636+0000 mon.smithi008 (mon.0) 2918 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.886934+0000 mon.smithi008 (mon.0) 2919 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.892095+0000 mon.smithi008 (mon.0) 2920 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.894536+0000 mon.smithi008 (mon.0) 2921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:37.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.895847+0000 mon.smithi008 (mon.0) 2922 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:37.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.897207+0000 mon.smithi008 (mon.0) 2923 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:37.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.898789+0000 mon.smithi008 (mon.0) 2924 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.267+0000 7f15dbfff700 1 -- 172.21.15.8:0/3780834142 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15dc10ac70 con 0x7f15c4060f70 2023-10-18T21:40:37.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.268+0000 7f15c37fe700 1 -- 172.21.15.8:0/3780834142 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f15dc10ac70 con 0x7f15c4060f70 2023-10-18T21:40:37.269 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:40:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:40:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:40:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:40:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:40:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:40:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:40:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:40:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:40:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:40:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:40:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:40:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:40:37.272 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:40:37.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 -- 172.21.15.8:0/3780834142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15c4060f70 msgr2=0x7f15c4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:37.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15c4060f70 0x7f15c4063430 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f15cc005010 tx=0x7f15cc016040).stop 2023-10-18T21:40:37.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 -- 172.21.15.8:0/3780834142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15dc0f77d0 msgr2=0x7f15dc109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:40:37.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15dc0f77d0 0x7f15dc109430 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f15d000e7f0 tx=0x7f15d000b040).stop 2023-10-18T21:40:37.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 -- 172.21.15.8:0/3780834142 shutdown_connections 2023-10-18T21:40:37.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15c4060f70 0x7f15c4063430 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:37.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15dc0f6530 0x7f15dc108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:37.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 --2- 172.21.15.8:0/3780834142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15dc0f77d0 0x7f15dc109430 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:40:37.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 -- 172.21.15.8:0/3780834142 >> 172.21.15.8:0/3780834142 conn(0x7f15dc0f1c90 msgr2=0x7f15dc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:40:37.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 -- 172.21.15.8:0/3780834142 shutdown_connections 2023-10-18T21:40:37.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:40:37.270+0000 7f15dbfff700 1 -- 172.21.15.8:0/3780834142 wait complete. 2023-10-18T21:40:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.125801+0000 mgr.smithi008.flmjzp (mgr.14640) 2506 : audit [DBG] from='client.36144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:36.850403+0000 mgr.smithi008.flmjzp (mgr.14640) 2507 : cluster [DBG] pgmap v1728: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:36.882303+0000 mgr.smithi008.flmjzp (mgr.14640) 2508 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:36.882746+0000 mgr.smithi008.flmjzp (mgr.14640) 2509 : cluster [DBG] pgmap v1729: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:36.882965+0000 mgr.smithi008.flmjzp (mgr.14640) 2510 : cluster [DBG] pgmap v1730: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:36.900385+0000 mgr.smithi008.flmjzp (mgr.14640) 2511 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:38.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:36.915279+0000 mon.smithi008 (mon.0) 2925 : audit [DBG] from='client.? 172.21.15.8:0/2992006255' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:40:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.125801+0000 mgr.smithi008.flmjzp (mgr.14640) 2506 : audit [DBG] from='client.36144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:36.850403+0000 mgr.smithi008.flmjzp (mgr.14640) 2507 : cluster [DBG] pgmap v1728: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:36.882303+0000 mgr.smithi008.flmjzp (mgr.14640) 2508 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:36.882746+0000 mgr.smithi008.flmjzp (mgr.14640) 2509 : cluster [DBG] pgmap v1729: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:36.882965+0000 mgr.smithi008.flmjzp (mgr.14640) 2510 : cluster [DBG] pgmap v1730: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:38.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:36.900385+0000 mgr.smithi008.flmjzp (mgr.14640) 2511 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:38.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:36.915279+0000 mon.smithi008 (mon.0) 2925 : audit [DBG] from='client.? 172.21.15.8:0/2992006255' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:40:39.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:37.268509+0000 mgr.smithi008.flmjzp (mgr.14640) 2512 : audit [DBG] from='client.36156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:37.268509+0000 mgr.smithi008.flmjzp (mgr.14640) 2512 : audit [DBG] from='client.36156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:40:40.182 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:38.883513+0000 mgr.smithi008.flmjzp (mgr.14640) 2513 : cluster [DBG] pgmap v1731: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:38.883513+0000 mgr.smithi008.flmjzp (mgr.14640) 2513 : cluster [DBG] pgmap v1731: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:40.884122+0000 mgr.smithi008.flmjzp (mgr.14640) 2514 : cluster [DBG] pgmap v1732: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:40.884122+0000 mgr.smithi008.flmjzp (mgr.14640) 2514 : cluster [DBG] pgmap v1732: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:42.884697+0000 mgr.smithi008.flmjzp (mgr.14640) 2515 : cluster [DBG] pgmap v1733: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:44.300 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:42.884697+0000 mgr.smithi008.flmjzp (mgr.14640) 2515 : cluster [DBG] pgmap v1733: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:46.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:44.885334+0000 mgr.smithi008.flmjzp (mgr.14640) 2516 : cluster [DBG] pgmap v1734: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:44.885334+0000 mgr.smithi008.flmjzp (mgr.14640) 2516 : cluster [DBG] pgmap v1734: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:46.908123+0000 mon.smithi008 (mon.0) 2926 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:46.908123+0000 mon.smithi008 (mon.0) 2926 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:48.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:46.885984+0000 mgr.smithi008.flmjzp (mgr.14640) 2517 : cluster [DBG] pgmap v1735: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:47.474388+0000 mon.smithi008 (mon.0) 2927 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:47.475636+0000 mon.smithi008 (mon.0) 2928 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:47.480994+0000 mon.smithi008 (mon.0) 2929 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:47.486078+0000 mon.smithi008 (mon.0) 2930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:47.488425+0000 mon.smithi008 (mon.0) 2931 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:47.489730+0000 mon.smithi008 (mon.0) 2932 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:47.491029+0000 mon.smithi008 (mon.0) 2933 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:47.492638+0000 mon.smithi008 (mon.0) 2934 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:46.885984+0000 mgr.smithi008.flmjzp (mgr.14640) 2517 : cluster [DBG] pgmap v1735: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:47.474388+0000 mon.smithi008 (mon.0) 2927 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:47.475636+0000 mon.smithi008 (mon.0) 2928 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:47.480994+0000 mon.smithi008 (mon.0) 2929 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:47.486078+0000 mon.smithi008 (mon.0) 2930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:47.488425+0000 mon.smithi008 (mon.0) 2931 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:47.489730+0000 mon.smithi008 (mon.0) 2932 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:47.491029+0000 mon.smithi008 (mon.0) 2933 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:47.492638+0000 mon.smithi008 (mon.0) 2934 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:47.476231+0000 mgr.smithi008.flmjzp (mgr.14640) 2518 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:47.476728+0000 mgr.smithi008.flmjzp (mgr.14640) 2519 : cluster [DBG] pgmap v1736: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:47.476977+0000 mgr.smithi008.flmjzp (mgr.14640) 2520 : cluster [DBG] pgmap v1737: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:47.494260+0000 mgr.smithi008.flmjzp (mgr.14640) 2521 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:47.476231+0000 mgr.smithi008.flmjzp (mgr.14640) 2518 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:47.476728+0000 mgr.smithi008.flmjzp (mgr.14640) 2519 : cluster [DBG] pgmap v1736: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:47.476977+0000 mgr.smithi008.flmjzp (mgr.14640) 2520 : cluster [DBG] pgmap v1737: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:47.494260+0000 mgr.smithi008.flmjzp (mgr.14640) 2521 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:51.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:49.477666+0000 mgr.smithi008.flmjzp (mgr.14640) 2522 : cluster [DBG] pgmap v1738: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:49.477666+0000 mgr.smithi008.flmjzp (mgr.14640) 2522 : cluster [DBG] pgmap v1738: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:53.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:51.478162+0000 mgr.smithi008.flmjzp (mgr.14640) 2523 : cluster [DBG] pgmap v1739: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:51.478162+0000 mgr.smithi008.flmjzp (mgr.14640) 2523 : cluster [DBG] pgmap v1739: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:55.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:53.478664+0000 mgr.smithi008.flmjzp (mgr.14640) 2524 : cluster [DBG] pgmap v1740: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:53.478664+0000 mgr.smithi008.flmjzp (mgr.14640) 2524 : cluster [DBG] pgmap v1740: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:57.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:55.479192+0000 mgr.smithi008.flmjzp (mgr.14640) 2525 : cluster [DBG] pgmap v1741: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:55.479192+0000 mgr.smithi008.flmjzp (mgr.14640) 2525 : cluster [DBG] pgmap v1741: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:57.504885+0000 mon.smithi008 (mon.0) 2935 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:57.507104+0000 mon.smithi008 (mon.0) 2936 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:57.508216+0000 mon.smithi008 (mon.0) 2937 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:57.515005+0000 mon.smithi008 (mon.0) 2938 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:57.521412+0000 mon.smithi008 (mon.0) 2939 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:57.524605+0000 mon.smithi008 (mon.0) 2940 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:57.526350+0000 mon.smithi008 (mon.0) 2941 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:57.528048+0000 mon.smithi008 (mon.0) 2942 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:40:57.530094+0000 mon.smithi008 (mon.0) 2943 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:58.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:57.504885+0000 mon.smithi008 (mon.0) 2935 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:57.507104+0000 mon.smithi008 (mon.0) 2936 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:40:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:57.508216+0000 mon.smithi008 (mon.0) 2937 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:40:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:57.515005+0000 mon.smithi008 (mon.0) 2938 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:40:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:57.521412+0000 mon.smithi008 (mon.0) 2939 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:40:58.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:57.524605+0000 mon.smithi008 (mon.0) 2940 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:58.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:57.526350+0000 mon.smithi008 (mon.0) 2941 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:58.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:57.528048+0000 mon.smithi008 (mon.0) 2942 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:58.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:40:57.530094+0000 mon.smithi008 (mon.0) 2943 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:40:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:57.479926+0000 mgr.smithi008.flmjzp (mgr.14640) 2526 : cluster [DBG] pgmap v1742: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:57.509163+0000 mgr.smithi008.flmjzp (mgr.14640) 2527 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:57.509736+0000 mgr.smithi008.flmjzp (mgr.14640) 2528 : cluster [DBG] pgmap v1743: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:57.509967+0000 mgr.smithi008.flmjzp (mgr.14640) 2529 : cluster [DBG] pgmap v1744: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:40:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:40:57.532026+0000 mgr.smithi008.flmjzp (mgr.14640) 2530 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:40:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:57.479926+0000 mgr.smithi008.flmjzp (mgr.14640) 2526 : cluster [DBG] pgmap v1742: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:57.509163+0000 mgr.smithi008.flmjzp (mgr.14640) 2527 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:40:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:57.509736+0000 mgr.smithi008.flmjzp (mgr.14640) 2528 : cluster [DBG] pgmap v1743: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:57.509967+0000 mgr.smithi008.flmjzp (mgr.14640) 2529 : cluster [DBG] pgmap v1744: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:40:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:40:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:40:57.532026+0000 mgr.smithi008.flmjzp (mgr.14640) 2530 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:40:59.510680+0000 mgr.smithi008.flmjzp (mgr.14640) 2531 : cluster [DBG] pgmap v1745: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:40:59.510680+0000 mgr.smithi008.flmjzp (mgr.14640) 2531 : cluster [DBG] pgmap v1745: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:03.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:01.511195+0000 mgr.smithi008.flmjzp (mgr.14640) 2532 : cluster [DBG] pgmap v1746: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:03.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:01.511195+0000 mgr.smithi008.flmjzp (mgr.14640) 2532 : cluster [DBG] pgmap v1746: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:03.511820+0000 mgr.smithi008.flmjzp (mgr.14640) 2533 : cluster [DBG] pgmap v1747: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:05.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:03.511820+0000 mgr.smithi008.flmjzp (mgr.14640) 2533 : cluster [DBG] pgmap v1747: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:05.512340+0000 mgr.smithi008.flmjzp (mgr.14640) 2534 : cluster [DBG] pgmap v1748: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:07.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.423+0000 7ff36654f700 1 -- 172.21.15.8:0/1012312157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3600f6530 msgr2=0x7ff3600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:07.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.423+0000 7ff36654f700 1 --2- 172.21.15.8:0/1012312157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3600f6530 0x7ff3600f6950 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7ff35c004660 tx=0x7ff35c009b30).stop 2023-10-18T21:41:07.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.423+0000 7ff36654f700 1 -- 172.21.15.8:0/1012312157 shutdown_connections 2023-10-18T21:41:07.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.423+0000 7ff36654f700 1 --2- 172.21.15.8:0/1012312157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3600f77d0 0x7ff3600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.423+0000 7ff36654f700 1 --2- 172.21.15.8:0/1012312157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3600f6530 0x7ff3600f6950 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.423+0000 7ff36654f700 1 -- 172.21.15.8:0/1012312157 >> 172.21.15.8:0/1012312157 conn(0x7ff3600f1c90 msgr2=0x7ff3600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:07.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.423+0000 7ff36654f700 1 -- 172.21.15.8:0/1012312157 shutdown_connections 2023-10-18T21:41:07.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.423+0000 7ff36654f700 1 -- 172.21.15.8:0/1012312157 wait complete. 2023-10-18T21:41:07.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.424+0000 7ff36654f700 1 Processor -- start 2023-10-18T21:41:07.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.424+0000 7ff36654f700 1 -- start start 2023-10-18T21:41:07.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.424+0000 7ff36654f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3600f6530 0x7ff36006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.425+0000 7ff36654f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3600f77d0 0x7ff360069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.425+0000 7ff36654f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36006a380 con 0x7ff3600f77d0 2023-10-18T21:41:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.425+0000 7ff36654f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36006a4c0 con 0x7ff3600f6530 2023-10-18T21:41:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.425+0000 7ff364d4c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3600f77d0 0x7ff360069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.425+0000 7ff364d4c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3600f77d0 0x7ff360069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35888/0 (socket says 172.21.15.8:35888) 2023-10-18T21:41:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.425+0000 7ff364d4c700 1 -- 172.21.15.8:0/2186787182 learned_addr learned my addr 172.21.15.8:0/2186787182 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.425+0000 7ff36554d700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3600f6530 0x7ff36006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.425+0000 7ff364d4c700 1 -- 172.21.15.8:0/2186787182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3600f6530 msgr2=0x7ff36006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.425+0000 7ff364d4c700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3600f6530 0x7ff36006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.425+0000 7ff364d4c700 1 -- 172.21.15.8:0/2186787182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c005040 con 0x7ff3600f77d0 2023-10-18T21:41:07.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.426+0000 7ff364d4c700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3600f77d0 0x7ff360069e20 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7ff350002700 tx=0x7ff350009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:07.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.426+0000 7ff355ffb700 1 -- 172.21.15.8:0/2186787182 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff350009320 con 0x7ff3600f77d0 2023-10-18T21:41:07.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.426+0000 7ff355ffb700 1 -- 172.21.15.8:0/2186787182 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff35000f040 con 0x7ff3600f77d0 2023-10-18T21:41:07.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.426+0000 7ff355ffb700 1 -- 172.21.15.8:0/2186787182 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3500148f0 con 0x7ff3600f77d0 2023-10-18T21:41:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.426+0000 7ff36654f700 1 -- 172.21.15.8:0/2186787182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36006a7a0 con 0x7ff3600f77d0 2023-10-18T21:41:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.426+0000 7ff36654f700 1 -- 172.21.15.8:0/2186787182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36010ed70 con 0x7ff3600f77d0 2023-10-18T21:41:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.427+0000 7ff36654f700 1 -- 172.21.15.8:0/2186787182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff360045ad0 con 0x7ff3600f77d0 2023-10-18T21:41:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.428+0000 7ff355ffb700 1 -- 172.21.15.8:0/2186787182 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff350009480 con 0x7ff3600f77d0 2023-10-18T21:41:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.429+0000 7ff355ffb700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff34c060f70 0x7ff34c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.429+0000 7ff355ffb700 1 -- 172.21.15.8:0/2186787182 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff35007cc50 con 0x7ff3600f77d0 2023-10-18T21:41:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.429+0000 7ff36554d700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff34c060f70 0x7ff34c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.430+0000 7ff36554d700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff34c060f70 0x7ff34c063430 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7ff36006b730 tx=0x7ff35c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:07.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.433+0000 7ff355ffb700 1 -- 172.21.15.8:0/2186787182 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff35004c800 con 0x7ff3600f77d0 2023-10-18T21:41:07.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:05.512340+0000 mgr.smithi008.flmjzp (mgr.14640) 2534 : cluster [DBG] pgmap v1748: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.633+0000 7ff36654f700 1 -- 172.21.15.8:0/2186787182 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff360057f10 con 0x7ff34c060f70 2023-10-18T21:41:07.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.634+0000 7ff355ffb700 1 -- 172.21.15.8:0/2186787182 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff360057f10 con 0x7ff34c060f70 2023-10-18T21:41:07.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 -- 172.21.15.8:0/2186787182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff34c060f70 msgr2=0x7ff34c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:07.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff34c060f70 0x7ff34c063430 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7ff36006b730 tx=0x7ff35c009b30).stop 2023-10-18T21:41:07.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 -- 172.21.15.8:0/2186787182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3600f77d0 msgr2=0x7ff360069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:07.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3600f77d0 0x7ff360069e20 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7ff350002700 tx=0x7ff350009e00).stop 2023-10-18T21:41:07.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 -- 172.21.15.8:0/2186787182 shutdown_connections 2023-10-18T21:41:07.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff34c060f70 0x7ff34c063430 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3600f6530 0x7ff36006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 --2- 172.21.15.8:0/2186787182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3600f77d0 0x7ff360069e20 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 -- 172.21.15.8:0/2186787182 >> 172.21.15.8:0/2186787182 conn(0x7ff3600f1c90 msgr2=0x7ff3600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:07.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 -- 172.21.15.8:0/2186787182 shutdown_connections 2023-10-18T21:41:07.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.636+0000 7ff36654f700 1 -- 172.21.15.8:0/2186787182 wait complete. 2023-10-18T21:41:07.652 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:41:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.774+0000 7f54ff331700 1 -- 172.21.15.8:0/2230279545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54f80f77d0 msgr2=0x7f54f80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.774+0000 7f54ff331700 1 --2- 172.21.15.8:0/2230279545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54f80f77d0 0x7f54f80f7c30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f54e8004660 tx=0x7f54e8009b30).stop 2023-10-18T21:41:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.774+0000 7f54ff331700 1 -- 172.21.15.8:0/2230279545 shutdown_connections 2023-10-18T21:41:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.774+0000 7f54ff331700 1 --2- 172.21.15.8:0/2230279545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54f80f77d0 0x7f54f80f7c30 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.774+0000 7f54ff331700 1 --2- 172.21.15.8:0/2230279545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f80f6530 0x7f54f80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.774+0000 7f54ff331700 1 -- 172.21.15.8:0/2230279545 >> 172.21.15.8:0/2230279545 conn(0x7f54f80f1c90 msgr2=0x7f54f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.774+0000 7f54ff331700 1 -- 172.21.15.8:0/2230279545 shutdown_connections 2023-10-18T21:41:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.774+0000 7f54ff331700 1 -- 172.21.15.8:0/2230279545 wait complete. 2023-10-18T21:41:07.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.775+0000 7f54ff331700 1 Processor -- start 2023-10-18T21:41:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.775+0000 7f54ff331700 1 -- start start 2023-10-18T21:41:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.775+0000 7f54ff331700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f80f6530 0x7f54f8108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.775+0000 7f54ff331700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54f80f77d0 0x7f54f81093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.775+0000 7f54ff331700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f81099a0 con 0x7f54f80f77d0 2023-10-18T21:41:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.775+0000 7f54ff331700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f8109ae0 con 0x7f54f80f6530 2023-10-18T21:41:07.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.775+0000 7f54fdb2e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54f80f77d0 0x7f54f81093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:07.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54fdb2e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54f80f77d0 0x7f54f81093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35900/0 (socket says 172.21.15.8:35900) 2023-10-18T21:41:07.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54fdb2e700 1 -- 172.21.15.8:0/3497529075 learned_addr learned my addr 172.21.15.8:0/3497529075 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:07.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54fe32f700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f80f6530 0x7f54f8108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:07.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54fdb2e700 1 -- 172.21.15.8:0/3497529075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f80f6530 msgr2=0x7f54f8108f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:07.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54fdb2e700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f80f6530 0x7f54f8108f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54fdb2e700 1 -- 172.21.15.8:0/3497529075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e8005040 con 0x7f54f80f77d0 2023-10-18T21:41:07.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54fdb2e700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54f80f77d0 0x7f54f81093f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f54e8004d80 tx=0x7f54e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54eeffd700 1 -- 172.21.15.8:0/3497529075 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54e8019070 con 0x7f54f80f77d0 2023-10-18T21:41:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54eeffd700 1 -- 172.21.15.8:0/3497529075 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f54e801e420 con 0x7f54f80f77d0 2023-10-18T21:41:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54eeffd700 1 -- 172.21.15.8:0/3497529075 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54e8014660 con 0x7f54f80f77d0 2023-10-18T21:41:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54ff331700 1 -- 172.21.15.8:0/3497529075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f810a420 con 0x7f54f80f77d0 2023-10-18T21:41:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.776+0000 7f54ff331700 1 -- 172.21.15.8:0/3497529075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f810a900 con 0x7f54f80f77d0 2023-10-18T21:41:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.778+0000 7f54ff331700 1 -- 172.21.15.8:0/3497529075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f8045ad0 con 0x7f54f80f77d0 2023-10-18T21:41:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.778+0000 7f54eeffd700 1 -- 172.21.15.8:0/3497529075 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f54e801e590 con 0x7f54f80f77d0 2023-10-18T21:41:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.779+0000 7f54eeffd700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54e4060f70 0x7f54e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.779+0000 7f54eeffd700 1 -- 172.21.15.8:0/3497529075 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f54e807dd80 con 0x7f54f80f77d0 2023-10-18T21:41:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.779+0000 7f54fe32f700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54e4060f70 0x7f54e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:07.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.780+0000 7f54fe32f700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54e4060f70 0x7f54e4063430 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f54f4009fd0 tx=0x7f54f400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:07.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.783+0000 7f54eeffd700 1 -- 172.21.15.8:0/3497529075 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f54e80513e0 con 0x7f54f80f77d0 2023-10-18T21:41:07.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.981+0000 7f54ff331700 1 -- 172.21.15.8:0/3497529075 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54f810ab20 con 0x7f54e4060f70 2023-10-18T21:41:07.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.982+0000 7f54eeffd700 1 -- 172.21.15.8:0/3497529075 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f54f810ab20 con 0x7f54e4060f70 2023-10-18T21:41:07.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 -- 172.21.15.8:0/3497529075 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54e4060f70 msgr2=0x7f54e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:07.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54e4060f70 0x7f54e4063430 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f54f4009fd0 tx=0x7f54f400b040).stop 2023-10-18T21:41:07.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 -- 172.21.15.8:0/3497529075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54f80f77d0 msgr2=0x7f54f81093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:07.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54f80f77d0 0x7f54f81093f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f54e8004d80 tx=0x7f54e800b040).stop 2023-10-18T21:41:07.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 -- 172.21.15.8:0/3497529075 shutdown_connections 2023-10-18T21:41:07.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f54e4060f70 0x7f54e4063430 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f80f6530 0x7f54f8108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 --2- 172.21.15.8:0/3497529075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54f80f77d0 0x7f54f81093f0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:07.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 -- 172.21.15.8:0/3497529075 >> 172.21.15.8:0/3497529075 conn(0x7f54f80f1c90 msgr2=0x7f54f806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:07.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 -- 172.21.15.8:0/3497529075 shutdown_connections 2023-10-18T21:41:07.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:07.984+0000 7f54ff331700 1 -- 172.21.15.8:0/3497529075 wait complete. 2023-10-18T21:41:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.123+0000 7f50ddb80700 1 -- 172.21.15.8:0/2760154546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80f66d0 msgr2=0x7f50d80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.123+0000 7f50ddb80700 1 --2- 172.21.15.8:0/2760154546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80f66d0 0x7f50d80f6b30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f50c8004660 tx=0x7f50c8009b30).stop 2023-10-18T21:41:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.123+0000 7f50ddb80700 1 -- 172.21.15.8:0/2760154546 shutdown_connections 2023-10-18T21:41:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.123+0000 7f50ddb80700 1 --2- 172.21.15.8:0/2760154546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80f66d0 0x7f50d80f6b30 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.123+0000 7f50ddb80700 1 --2- 172.21.15.8:0/2760154546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80f5430 0x7f50d80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.123+0000 7f50ddb80700 1 -- 172.21.15.8:0/2760154546 >> 172.21.15.8:0/2760154546 conn(0x7f50d80f0b90 msgr2=0x7f50d80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.123+0000 7f50ddb80700 1 -- 172.21.15.8:0/2760154546 shutdown_connections 2023-10-18T21:41:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.123+0000 7f50ddb80700 1 -- 172.21.15.8:0/2760154546 wait complete. 2023-10-18T21:41:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.124+0000 7f50ddb80700 1 Processor -- start 2023-10-18T21:41:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.124+0000 7f50ddb80700 1 -- start start 2023-10-18T21:41:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.124+0000 7f50ddb80700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80f5430 0x7f50d8108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.124+0000 7f50ddb80700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80f66d0 0x7f50d81093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.124+0000 7f50ddb80700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8109990 con 0x7f50d80f5430 2023-10-18T21:41:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.124+0000 7f50ddb80700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8109ad0 con 0x7f50d80f66d0 2023-10-18T21:41:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.125+0000 7f50dcb7e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80f5430 0x7f50d8108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.125+0000 7f50dcb7e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80f5430 0x7f50d8108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35928/0 (socket says 172.21.15.8:35928) 2023-10-18T21:41:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.125+0000 7f50dcb7e700 1 -- 172.21.15.8:0/2133681959 learned_addr learned my addr 172.21.15.8:0/2133681959 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.125+0000 7f50dcb7e700 1 -- 172.21.15.8:0/2133681959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80f66d0 msgr2=0x7f50d81093e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.125+0000 7f50dcb7e700 1 --2- 172.21.15.8:0/2133681959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80f66d0 0x7f50d81093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:41:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.125+0000 7f50dcb7e700 1 -- 172.21.15.8:0/2133681959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c8005040 con 0x7f50d80f5430 2023-10-18T21:41:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.125+0000 7f50dcb7e700 1 --2- 172.21.15.8:0/2133681959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80f5430 0x7f50d8108ef0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f50d400e7c0 tx=0x7f50d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.125+0000 7f50cd7fa700 1 -- 172.21.15.8:0/2133681959 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50d40092e0 con 0x7f50d80f5430 2023-10-18T21:41:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.126+0000 7f50cd7fa700 1 -- 172.21.15.8:0/2133681959 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f50d400f040 con 0x7f50d80f5430 2023-10-18T21:41:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.126+0000 7f50ddb80700 1 -- 172.21.15.8:0/2133681959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d810a470 con 0x7f50d80f5430 2023-10-18T21:41:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.126+0000 7f50cd7fa700 1 -- 172.21.15.8:0/2133681959 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50d40147e0 con 0x7f50d80f5430 2023-10-18T21:41:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.126+0000 7f50ddb80700 1 -- 172.21.15.8:0/2133681959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d810a9b0 con 0x7f50d80f5430 2023-10-18T21:41:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.127+0000 7f50ddb80700 1 -- 172.21.15.8:0/2133681959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d8045ad0 con 0x7f50d80f5430 2023-10-18T21:41:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.128+0000 7f50cd7fa700 1 -- 172.21.15.8:0/2133681959 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f50d401b030 con 0x7f50d80f5430 2023-10-18T21:41:08.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.128+0000 7f50cd7fa700 1 --2- 172.21.15.8:0/2133681959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50c0060f70 0x7f50c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:08.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.128+0000 7f50cd7fa700 1 -- 172.21.15.8:0/2133681959 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f50d407c8d0 con 0x7f50d80f5430 2023-10-18T21:41:08.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.129+0000 7f50cffff700 1 --2- 172.21.15.8:0/2133681959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50c0060f70 0x7f50c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.129+0000 7f50cffff700 1 --2- 172.21.15.8:0/2133681959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50c0060f70 0x7f50c0063430 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f50c8004d80 tx=0x7f50c800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.132+0000 7f50cd7fa700 1 -- 172.21.15.8:0/2133681959 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f50d404ff10 con 0x7f50d80f5430 2023-10-18T21:41:08.307 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:07.542588+0000 mon.smithi008 (mon.0) 2944 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:08.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.327+0000 7f50ddb80700 1 -- 172.21.15.8:0/2133681959 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f50d80fa910 con 0x7f50c0060f70 2023-10-18T21:41:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.337+0000 7f50cd7fa700 1 -- 172.21.15.8:0/2133681959 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f50d80fa910 con 0x7f50c0060f70 2023-10-18T21:41:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:41:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (47m) 5m ago 49m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:41:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (41m) 5m ago 49m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:41:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (41m) 3m ago 48m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:41:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (47m) 5m ago 48m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:41:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 45m - - 2023-10-18T21:41:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 45m - - 2023-10-18T21:41:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 45m - - 2023-10-18T21:41:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 45m - - 2023-10-18T21:41:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (42m) 5m ago 50m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:41:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (42m) 3m ago 48m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:41:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (42m) 5m ago 50m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:41:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (41m) 3m ago 48m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:41:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (48m) 5m ago 48m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:41:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (48m) 3m ago 48m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:41:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (41m) 5m ago 47m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:41:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (39m) 5m ago 47m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:41:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (38m) 5m ago 47m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:41:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (38m) 3m ago 46m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:41:08.344 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (37m) 3m ago 46m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:41:08.344 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (37m) 3m ago 46m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:41:08.344 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (43m) 5m ago 48m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:41:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 -- 172.21.15.8:0/2133681959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50c0060f70 msgr2=0x7f50c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 --2- 172.21.15.8:0/2133681959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50c0060f70 0x7f50c0063430 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f50c8004d80 tx=0x7f50c800b040).stop 2023-10-18T21:41:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 -- 172.21.15.8:0/2133681959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80f5430 msgr2=0x7f50d8108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 --2- 172.21.15.8:0/2133681959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80f5430 0x7f50d8108ef0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f50d400e7c0 tx=0x7f50d400b040).stop 2023-10-18T21:41:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 -- 172.21.15.8:0/2133681959 shutdown_connections 2023-10-18T21:41:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 --2- 172.21.15.8:0/2133681959 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50c0060f70 0x7f50c0063430 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 --2- 172.21.15.8:0/2133681959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80f5430 0x7f50d8108ef0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 --2- 172.21.15.8:0/2133681959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80f66d0 0x7f50d81093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:41:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 -- 172.21.15.8:0/2133681959 >> 172.21.15.8:0/2133681959 conn(0x7f50d80f0b90 msgr2=0x7f50d805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 -- 172.21.15.8:0/2133681959 shutdown_connections 2023-10-18T21:41:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.339+0000 7f50ddb80700 1 -- 172.21.15.8:0/2133681959 wait complete. 2023-10-18T21:41:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.474+0000 7fce00be4700 1 -- 172.21.15.8:0/1984681873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcdfc0f6530 msgr2=0x7fcdfc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.474+0000 7fce00be4700 1 --2- 172.21.15.8:0/1984681873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcdfc0f6530 0x7fcdfc0f6950 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7fcdec004660 tx=0x7fcdec009b30).stop 2023-10-18T21:41:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.475+0000 7fce00be4700 1 -- 172.21.15.8:0/1984681873 shutdown_connections 2023-10-18T21:41:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.475+0000 7fce00be4700 1 --2- 172.21.15.8:0/1984681873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdfc0f77d0 0x7fcdfc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.475+0000 7fce00be4700 1 --2- 172.21.15.8:0/1984681873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcdfc0f6530 0x7fcdfc0f6950 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.475+0000 7fce00be4700 1 -- 172.21.15.8:0/1984681873 >> 172.21.15.8:0/1984681873 conn(0x7fcdfc0f1c90 msgr2=0x7fcdfc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.475+0000 7fce00be4700 1 -- 172.21.15.8:0/1984681873 shutdown_connections 2023-10-18T21:41:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.475+0000 7fce00be4700 1 -- 172.21.15.8:0/1984681873 wait complete. 2023-10-18T21:41:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.475+0000 7fce00be4700 1 Processor -- start 2023-10-18T21:41:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.476+0000 7fce00be4700 1 -- start start 2023-10-18T21:41:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.476+0000 7fce00be4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcdfc0f6530 0x7fcdfc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.476+0000 7fce00be4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdfc0f77d0 0x7fcdfc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.476+0000 7fce00be4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc06a380 con 0x7fcdfc0f6530 2023-10-18T21:41:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.476+0000 7fce00be4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc06a4c0 con 0x7fcdfc0f77d0 2023-10-18T21:41:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.476+0000 7fcdfb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcdfc0f6530 0x7fcdfc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.476+0000 7fcdfb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcdfc0f6530 0x7fcdfc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35944/0 (socket says 172.21.15.8:35944) 2023-10-18T21:41:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.476+0000 7fcdfb7fe700 1 -- 172.21.15.8:0/1222294197 learned_addr learned my addr 172.21.15.8:0/1222294197 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:08.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.476+0000 7fcdfaffd700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdfc0f77d0 0x7fcdfc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.477+0000 7fcdfb7fe700 1 -- 172.21.15.8:0/1222294197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdfc0f77d0 msgr2=0x7fcdfc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.477+0000 7fcdfb7fe700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdfc0f77d0 0x7fcdfc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.477+0000 7fcdfb7fe700 1 -- 172.21.15.8:0/1222294197 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec005040 con 0x7fcdfc0f6530 2023-10-18T21:41:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.477+0000 7fcdfb7fe700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcdfc0f6530 0x7fcdfc06b9a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fcdec007a70 tx=0x7fcdec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.477+0000 7fcde3fff700 1 -- 172.21.15.8:0/1222294197 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdec018070 con 0x7fcdfc0f6530 2023-10-18T21:41:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.477+0000 7fcde3fff700 1 -- 172.21.15.8:0/1222294197 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcdec01d8e0 con 0x7fcdfc0f6530 2023-10-18T21:41:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.477+0000 7fce00be4700 1 -- 172.21.15.8:0/1222294197 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc06a740 con 0x7fcdfc0f6530 2023-10-18T21:41:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.477+0000 7fcde3fff700 1 -- 172.21.15.8:0/1222294197 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdec01c5c0 con 0x7fcdfc0f6530 2023-10-18T21:41:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.477+0000 7fce00be4700 1 -- 172.21.15.8:0/1222294197 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc06aca0 con 0x7fcdfc0f6530 2023-10-18T21:41:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.478+0000 7fce00be4700 1 -- 172.21.15.8:0/1222294197 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc045ad0 con 0x7fcdfc0f6530 2023-10-18T21:41:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.479+0000 7fcde3fff700 1 -- 172.21.15.8:0/1222294197 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcdec01da50 con 0x7fcdfc0f6530 2023-10-18T21:41:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.480+0000 7fcde3fff700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcde4060f70 0x7fcde4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.480+0000 7fcde3fff700 1 -- 172.21.15.8:0/1222294197 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcdec07e840 con 0x7fcdfc0f6530 2023-10-18T21:41:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.480+0000 7fcdfaffd700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcde4060f70 0x7fcde4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:08.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.481+0000 7fcdfaffd700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcde4060f70 0x7fcde4063430 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fcdf0007fd0 tx=0x7fcdf0009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:07.542588+0000 mon.smithi008 (mon.0) 2944 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:08.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.484+0000 7fcde3fff700 1 -- 172.21.15.8:0/1222294197 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcdec04e470 con 0x7fcdfc0f6530 2023-10-18T21:41:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.735+0000 7fce00be4700 1 -- 172.21.15.8:0/1222294197 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcdfc0fedd0 con 0x7fcdfc0f6530 2023-10-18T21:41:08.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.736+0000 7fcde3fff700 1 -- 172.21.15.8:0/1222294197 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fcdec01dce0 con 0x7fcdfc0f6530 2023-10-18T21:41:08.738 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:41:08.739 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:41:08.739 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:41:08.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:41:08.739 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:41:08.740 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:41:08.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:41:08.740 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:41:08.740 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:41:08.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:41:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:41:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:41:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:41:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:41:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:41:08.741 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:41:08.742 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:41:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 -- 172.21.15.8:0/1222294197 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcde4060f70 msgr2=0x7fcde4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcde4060f70 0x7fcde4063430 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fcdf0007fd0 tx=0x7fcdf0009040).stop 2023-10-18T21:41:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 -- 172.21.15.8:0/1222294197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcdfc0f6530 msgr2=0x7fcdfc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:08.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcdfc0f6530 0x7fcdfc06b9a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fcdec007a70 tx=0x7fcdec009b30).stop 2023-10-18T21:41:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 -- 172.21.15.8:0/1222294197 shutdown_connections 2023-10-18T21:41:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcde4060f70 0x7fcde4063430 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcdfc0f6530 0x7fcdfc06b9a0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 --2- 172.21.15.8:0/1222294197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdfc0f77d0 0x7fcdfc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 -- 172.21.15.8:0/1222294197 >> 172.21.15.8:0/1222294197 conn(0x7fcdfc0f1c90 msgr2=0x7fcdfc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 -- 172.21.15.8:0/1222294197 shutdown_connections 2023-10-18T21:41:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.738+0000 7fce00be4700 1 -- 172.21.15.8:0/1222294197 wait complete. 2023-10-18T21:41:08.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.874+0000 7f97c759e700 1 -- 172.21.15.8:0/1893786538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f77d0 msgr2=0x7f97c80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:08.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.874+0000 7f97c759e700 1 --2- 172.21.15.8:0/1893786538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f77d0 0x7f97c80f7c30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f97bc004660 tx=0x7f97bc009b30).stop 2023-10-18T21:41:08.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.874+0000 7f97c759e700 1 -- 172.21.15.8:0/1893786538 shutdown_connections 2023-10-18T21:41:08.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.874+0000 7f97c759e700 1 --2- 172.21.15.8:0/1893786538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f77d0 0x7f97c80f7c30 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.874+0000 7f97c759e700 1 --2- 172.21.15.8:0/1893786538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f6530 0x7f97c80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:08.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.874+0000 7f97c759e700 1 -- 172.21.15.8:0/1893786538 >> 172.21.15.8:0/1893786538 conn(0x7f97c80f1c90 msgr2=0x7f97c80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:08.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.875+0000 7f97c759e700 1 -- 172.21.15.8:0/1893786538 shutdown_connections 2023-10-18T21:41:08.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.875+0000 7f97c759e700 1 -- 172.21.15.8:0/1893786538 wait complete. 2023-10-18T21:41:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.875+0000 7f97c759e700 1 Processor -- start 2023-10-18T21:41:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.876+0000 7f97c759e700 1 -- start start 2023-10-18T21:41:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.876+0000 7f97c759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.876+0000 7f97c759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f77d0 0x7f97c8107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.876+0000 7f97c759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8107830 con 0x7f97c80f6530 2023-10-18T21:41:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.876+0000 7f97c759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8108040 con 0x7f97c80f77d0 2023-10-18T21:41:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.876+0000 7f97c659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.876+0000 7f97c659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35966/0 (socket says 172.21.15.8:35966) 2023-10-18T21:41:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.876+0000 7f97c659c700 1 -- 172.21.15.8:0/2034291017 learned_addr learned my addr 172.21.15.8:0/2034291017 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.876+0000 7f97c659c700 1 -- 172.21.15.8:0/2034291017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f77d0 msgr2=0x7f97c8107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.876+0000 7f97c659c700 1 --2- 172.21.15.8:0/2034291017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f77d0 0x7f97c8107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:41:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.877+0000 7f97c659c700 1 -- 172.21.15.8:0/2034291017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc005040 con 0x7f97c80f6530 2023-10-18T21:41:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.877+0000 7f97c659c700 1 --2- 172.21.15.8:0/2034291017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8106d40 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f97b8002700 tx=0x7f97b8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.877+0000 7f97b6ffd700 1 -- 172.21.15.8:0/2034291017 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b8009320 con 0x7f97c80f6530 2023-10-18T21:41:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.877+0000 7f97b6ffd700 1 -- 172.21.15.8:0/2034291017 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f97b800f040 con 0x7f97c80f6530 2023-10-18T21:41:08.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.877+0000 7f97c759e700 1 -- 172.21.15.8:0/2034291017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c81082c0 con 0x7f97c80f6530 2023-10-18T21:41:08.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.877+0000 7f97b6ffd700 1 -- 172.21.15.8:0/2034291017 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b8014970 con 0x7f97c80f6530 2023-10-18T21:41:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.877+0000 7f97c759e700 1 -- 172.21.15.8:0/2034291017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c8108880 con 0x7f97c80f6530 2023-10-18T21:41:08.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.878+0000 7f97c759e700 1 -- 172.21.15.8:0/2034291017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c8059100 con 0x7f97c80f6530 2023-10-18T21:41:08.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.879+0000 7f97b6ffd700 1 -- 172.21.15.8:0/2034291017 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f97b8009480 con 0x7f97c80f6530 2023-10-18T21:41:08.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.880+0000 7f97b6ffd700 1 --2- 172.21.15.8:0/2034291017 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 0x7f97b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:08.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.880+0000 7f97b6ffd700 1 -- 172.21.15.8:0/2034291017 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f97b807cb80 con 0x7f97c80f6530 2023-10-18T21:41:08.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.880+0000 7f97c5d9b700 1 --2- 172.21.15.8:0/2034291017 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 0x7f97b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:08.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.881+0000 7f97c5d9b700 1 --2- 172.21.15.8:0/2034291017 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 0x7f97b0063430 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f97bc009f50 tx=0x7f97bc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:08.884+0000 7f97b6ffd700 1 -- 172.21.15.8:0/2034291017 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f97b804c7f0 con 0x7f97c80f6530 2023-10-18T21:41:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.118+0000 7f97c759e700 1 -- 172.21.15.8:0/2034291017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f97c80fee00 con 0x7f97c80f6530 2023-10-18T21:41:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.119+0000 7f97b6ffd700 1 -- 172.21.15.8:0/2034291017 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f97b804fe10 con 0x7f97c80f6530 2023-10-18T21:41:09.121 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:41:09.121 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:41:09.122 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:41:09.122 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:41:09.122 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:41:09.122 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:41:09.123 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:41:09.123 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:41:09.123 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:41:09.123 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:41:09.123 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:41:09.124 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:41:09.124 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:41:09.124 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:41:09.124 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:41:09.124 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:41:09.125 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:41:09.125 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:41:09.125 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:41:09.125 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:41:09.125 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:41:09.126 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:41:09.126 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:41:09.126 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:41:09.126 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:41:09.126 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:41:09.127 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:41:09.127 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:41:09.127 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:41:09.127 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:41:09.127 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:41:09.128 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:41:09.128 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:41:09.128 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:41:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 -- 172.21.15.8:0/2034291017 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 msgr2=0x7f97b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 --2- 172.21.15.8:0/2034291017 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 0x7f97b0063430 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f97bc009f50 tx=0x7f97bc009b30).stop 2023-10-18T21:41:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 -- 172.21.15.8:0/2034291017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 msgr2=0x7f97c8106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:09.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 --2- 172.21.15.8:0/2034291017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8106d40 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f97b8002700 tx=0x7f97b8009d80).stop 2023-10-18T21:41:09.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 -- 172.21.15.8:0/2034291017 shutdown_connections 2023-10-18T21:41:09.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 --2- 172.21.15.8:0/2034291017 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97b0060f70 0x7f97b0063430 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:09.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 --2- 172.21.15.8:0/2034291017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97c80f6530 0x7f97c8106d40 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:09.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 --2- 172.21.15.8:0/2034291017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c80f77d0 0x7f97c8107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:41:09.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 -- 172.21.15.8:0/2034291017 >> 172.21.15.8:0/2034291017 conn(0x7f97c80f1c90 msgr2=0x7f97c80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:09.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 -- 172.21.15.8:0/2034291017 shutdown_connections 2023-10-18T21:41:09.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.121+0000 7f97c759e700 1 -- 172.21.15.8:0/2034291017 wait complete. 2023-10-18T21:41:09.131 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:41:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.258+0000 7f0a7f59e700 1 -- 172.21.15.8:0/3553180827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a800f77d0 msgr2=0x7f0a800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.258+0000 7f0a7f59e700 1 --2- 172.21.15.8:0/3553180827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a800f77d0 0x7f0a800f7c30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f0a74004660 tx=0x7f0a74009b30).stop 2023-10-18T21:41:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.258+0000 7f0a7f59e700 1 -- 172.21.15.8:0/3553180827 shutdown_connections 2023-10-18T21:41:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.258+0000 7f0a7f59e700 1 --2- 172.21.15.8:0/3553180827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a800f77d0 0x7f0a800f7c30 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.258+0000 7f0a7f59e700 1 --2- 172.21.15.8:0/3553180827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a800f6530 0x7f0a800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.258+0000 7f0a7f59e700 1 -- 172.21.15.8:0/3553180827 >> 172.21.15.8:0/3553180827 conn(0x7f0a800f1c70 msgr2=0x7f0a800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.258+0000 7f0a7f59e700 1 -- 172.21.15.8:0/3553180827 shutdown_connections 2023-10-18T21:41:09.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.258+0000 7f0a7f59e700 1 -- 172.21.15.8:0/3553180827 wait complete. 2023-10-18T21:41:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.259+0000 7f0a7f59e700 1 Processor -- start 2023-10-18T21:41:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.259+0000 7f0a7f59e700 1 -- start start 2023-10-18T21:41:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a800f6530 0x7f0a80108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a800f77d0 0x7f0a801093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a801099a0 con 0x7f0a800f77d0 2023-10-18T21:41:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a80109ae0 con 0x7f0a800f6530 2023-10-18T21:41:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a800f77d0 0x7f0a801093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a800f77d0 0x7f0a801093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35992/0 (socket says 172.21.15.8:35992) 2023-10-18T21:41:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7dd9b700 1 -- 172.21.15.8:0/2820905397 learned_addr learned my addr 172.21.15.8:0/2820905397 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7e59c700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a800f6530 0x7f0a80108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7dd9b700 1 -- 172.21.15.8:0/2820905397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a800f6530 msgr2=0x7f0a80108f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7dd9b700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a800f6530 0x7f0a80108f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.260+0000 7f0a7dd9b700 1 -- 172.21.15.8:0/2820905397 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a74005040 con 0x7f0a800f77d0 2023-10-18T21:41:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.261+0000 7f0a7dd9b700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a800f77d0 0x7f0a801093f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f0a74004d80 tx=0x7f0a7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.261+0000 7f0a6effd700 1 -- 172.21.15.8:0/2820905397 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a74019070 con 0x7f0a800f77d0 2023-10-18T21:41:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.261+0000 7f0a6effd700 1 -- 172.21.15.8:0/2820905397 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0a7401e420 con 0x7f0a800f77d0 2023-10-18T21:41:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.261+0000 7f0a7f59e700 1 -- 172.21.15.8:0/2820905397 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8010a420 con 0x7f0a800f77d0 2023-10-18T21:41:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.261+0000 7f0a6effd700 1 -- 172.21.15.8:0/2820905397 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a74014660 con 0x7f0a800f77d0 2023-10-18T21:41:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.261+0000 7f0a7f59e700 1 -- 172.21.15.8:0/2820905397 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8010a900 con 0x7f0a800f77d0 2023-10-18T21:41:09.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.262+0000 7f0a7f59e700 1 -- 172.21.15.8:0/2820905397 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a80045ad0 con 0x7f0a800f77d0 2023-10-18T21:41:09.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.263+0000 7f0a6effd700 1 -- 172.21.15.8:0/2820905397 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0a7401e590 con 0x7f0a800f77d0 2023-10-18T21:41:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.264+0000 7f0a6effd700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a68060f70 0x7f0a68063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.264+0000 7f0a6effd700 1 -- 172.21.15.8:0/2820905397 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0a7407dd70 con 0x7f0a800f77d0 2023-10-18T21:41:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.264+0000 7f0a7e59c700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a68060f70 0x7f0a68063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.265+0000 7f0a7e59c700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a68060f70 0x7f0a68063430 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f0a70009fd0 tx=0x7f0a7000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:09.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.268+0000 7f0a6effd700 1 -- 172.21.15.8:0/2820905397 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0a740513d0 con 0x7f0a800f77d0 2023-10-18T21:41:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:07.512784+0000 mgr.smithi008.flmjzp (mgr.14640) 2535 : cluster [DBG] pgmap v1749: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:07.635379+0000 mgr.smithi008.flmjzp (mgr.14640) 2536 : audit [DBG] from='client.36160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:07.983205+0000 mgr.smithi008.flmjzp (mgr.14640) 2537 : audit [DBG] from='client.36164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:08.101188+0000 mon.smithi008 (mon.0) 2945 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:08.102035+0000 mon.smithi008 (mon.0) 2946 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:08.108232+0000 mon.smithi008 (mon.0) 2947 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:08.113189+0000 mon.smithi008 (mon.0) 2948 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:08.115933+0000 mon.smithi008 (mon.0) 2949 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:08.117187+0000 mon.smithi008 (mon.0) 2950 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:08.118415+0000 mon.smithi008 (mon.0) 2951 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:08.120018+0000 mon.smithi008 (mon.0) 2952 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:08.737696+0000 mon.smithi008 (mon.0) 2953 : audit [DBG] from='client.? 172.21.15.8:0/1222294197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:09.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.466+0000 7f0a7f59e700 1 -- 172.21.15.8:0/2820905397 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a800fedd0 con 0x7f0a68060f70 2023-10-18T21:41:09.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.467+0000 7f0a6effd700 1 -- 172.21.15.8:0/2820905397 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0a800fedd0 con 0x7f0a68060f70 2023-10-18T21:41:09.469 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:41:09.469 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:41:09.470 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:41:09.470 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:41:09.470 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:41:09.470 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:41:09.471 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:41:09.471 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:41:09.471 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:41:09.471 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:41:09.472 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:41:09.472 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:41:09.472 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:41:09.472 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:41:09.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 -- 172.21.15.8:0/2820905397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a68060f70 msgr2=0x7f0a68063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:09.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a68060f70 0x7f0a68063430 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f0a70009fd0 tx=0x7f0a7000b040).stop 2023-10-18T21:41:09.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 -- 172.21.15.8:0/2820905397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a800f77d0 msgr2=0x7f0a801093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:09.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a800f77d0 0x7f0a801093f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f0a74004d80 tx=0x7f0a7400b040).stop 2023-10-18T21:41:09.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 -- 172.21.15.8:0/2820905397 shutdown_connections 2023-10-18T21:41:09.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a68060f70 0x7f0a68063430 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:09.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a800f6530 0x7f0a80108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:09.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 --2- 172.21.15.8:0/2820905397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a800f77d0 0x7f0a801093f0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:09.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 -- 172.21.15.8:0/2820905397 >> 172.21.15.8:0/2820905397 conn(0x7f0a800f1c70 msgr2=0x7f0a8006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:09.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 -- 172.21.15.8:0/2820905397 shutdown_connections 2023-10-18T21:41:09.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:09.469+0000 7f0a7f59e700 1 -- 172.21.15.8:0/2820905397 wait complete. 2023-10-18T21:41:09.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:07.512784+0000 mgr.smithi008.flmjzp (mgr.14640) 2535 : cluster [DBG] pgmap v1749: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:07.635379+0000 mgr.smithi008.flmjzp (mgr.14640) 2536 : audit [DBG] from='client.36160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:07.983205+0000 mgr.smithi008.flmjzp (mgr.14640) 2537 : audit [DBG] from='client.36164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:08.101188+0000 mon.smithi008 (mon.0) 2945 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:08.102035+0000 mon.smithi008 (mon.0) 2946 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:08.108232+0000 mon.smithi008 (mon.0) 2947 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:08.113189+0000 mon.smithi008 (mon.0) 2948 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:08.115933+0000 mon.smithi008 (mon.0) 2949 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:08.117187+0000 mon.smithi008 (mon.0) 2950 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:08.118415+0000 mon.smithi008 (mon.0) 2951 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:09.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:08.120018+0000 mon.smithi008 (mon.0) 2952 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:09.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:08.737696+0000 mon.smithi008 (mon.0) 2953 : audit [DBG] from='client.? 172.21.15.8:0/1222294197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:08.102685+0000 mgr.smithi008.flmjzp (mgr.14640) 2538 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:41:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:08.103192+0000 mgr.smithi008.flmjzp (mgr.14640) 2539 : cluster [DBG] pgmap v1750: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:08.103405+0000 mgr.smithi008.flmjzp (mgr.14640) 2540 : cluster [DBG] pgmap v1751: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:08.121621+0000 mgr.smithi008.flmjzp (mgr.14640) 2541 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:08.329978+0000 mgr.smithi008.flmjzp (mgr.14640) 2542 : audit [DBG] from='client.36168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:09.120656+0000 mon.smithi008 (mon.0) 2954 : audit [DBG] from='client.? 172.21.15.8:0/2034291017' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:41:10.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:08.102685+0000 mgr.smithi008.flmjzp (mgr.14640) 2538 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:41:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:08.103192+0000 mgr.smithi008.flmjzp (mgr.14640) 2539 : cluster [DBG] pgmap v1750: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:08.103405+0000 mgr.smithi008.flmjzp (mgr.14640) 2540 : cluster [DBG] pgmap v1751: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:08.121621+0000 mgr.smithi008.flmjzp (mgr.14640) 2541 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:08.329978+0000 mgr.smithi008.flmjzp (mgr.14640) 2542 : audit [DBG] from='client.36168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:09.120656+0000 mon.smithi008 (mon.0) 2954 : audit [DBG] from='client.? 172.21.15.8:0/2034291017' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:41:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:09.468363+0000 mgr.smithi008.flmjzp (mgr.14640) 2543 : audit [DBG] from='client.36180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:09.468363+0000 mgr.smithi008.flmjzp (mgr.14640) 2543 : audit [DBG] from='client.36180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:10.104027+0000 mgr.smithi008.flmjzp (mgr.14640) 2544 : cluster [DBG] pgmap v1752: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:12.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:10.104027+0000 mgr.smithi008.flmjzp (mgr.14640) 2544 : cluster [DBG] pgmap v1752: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:14.301 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:12.104561+0000 mgr.smithi008.flmjzp (mgr.14640) 2545 : cluster [DBG] pgmap v1753: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:14.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:12.104561+0000 mgr.smithi008.flmjzp (mgr.14640) 2545 : cluster [DBG] pgmap v1753: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:14.105219+0000 mgr.smithi008.flmjzp (mgr.14640) 2546 : cluster [DBG] pgmap v1754: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:16.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:14.105219+0000 mgr.smithi008.flmjzp (mgr.14640) 2546 : cluster [DBG] pgmap v1754: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:18.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:16.105976+0000 mgr.smithi008.flmjzp (mgr.14640) 2547 : cluster [DBG] pgmap v1755: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:18.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:16.105976+0000 mgr.smithi008.flmjzp (mgr.14640) 2547 : cluster [DBG] pgmap v1755: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:18.129348+0000 mon.smithi008 (mon.0) 2955 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:18.131513+0000 mon.smithi008 (mon.0) 2956 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:18.132573+0000 mon.smithi008 (mon.0) 2957 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:18.138477+0000 mon.smithi008 (mon.0) 2958 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:18.145074+0000 mon.smithi008 (mon.0) 2959 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:18.148371+0000 mon.smithi008 (mon.0) 2960 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:18.150216+0000 mon.smithi008 (mon.0) 2961 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:19.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:18.152010+0000 mon.smithi008 (mon.0) 2962 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:19.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:18.154104+0000 mon.smithi008 (mon.0) 2963 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:19.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:18.129348+0000 mon.smithi008 (mon.0) 2955 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:18.131513+0000 mon.smithi008 (mon.0) 2956 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:18.132573+0000 mon.smithi008 (mon.0) 2957 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:18.138477+0000 mon.smithi008 (mon.0) 2958 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:18.145074+0000 mon.smithi008 (mon.0) 2959 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:18.148371+0000 mon.smithi008 (mon.0) 2960 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:18.150216+0000 mon.smithi008 (mon.0) 2961 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:18.152010+0000 mon.smithi008 (mon.0) 2962 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:18.154104+0000 mon.smithi008 (mon.0) 2963 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:18.106534+0000 mgr.smithi008.flmjzp (mgr.14640) 2548 : cluster [DBG] pgmap v1756: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:18.133497+0000 mgr.smithi008.flmjzp (mgr.14640) 2549 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:41:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:18.134050+0000 mgr.smithi008.flmjzp (mgr.14640) 2550 : cluster [DBG] pgmap v1757: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:18.134304+0000 mgr.smithi008.flmjzp (mgr.14640) 2551 : cluster [DBG] pgmap v1758: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:18.156094+0000 mgr.smithi008.flmjzp (mgr.14640) 2552 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:18.106534+0000 mgr.smithi008.flmjzp (mgr.14640) 2548 : cluster [DBG] pgmap v1756: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:18.133497+0000 mgr.smithi008.flmjzp (mgr.14640) 2549 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:41:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:18.134050+0000 mgr.smithi008.flmjzp (mgr.14640) 2550 : cluster [DBG] pgmap v1757: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:18.134304+0000 mgr.smithi008.flmjzp (mgr.14640) 2551 : cluster [DBG] pgmap v1758: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:18.156094+0000 mgr.smithi008.flmjzp (mgr.14640) 2552 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:20.134820+0000 mgr.smithi008.flmjzp (mgr.14640) 2553 : cluster [DBG] pgmap v1759: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:21.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:20.134820+0000 mgr.smithi008.flmjzp (mgr.14640) 2553 : cluster [DBG] pgmap v1759: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:22.135440+0000 mgr.smithi008.flmjzp (mgr.14640) 2554 : cluster [DBG] pgmap v1760: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:23.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:22.135440+0000 mgr.smithi008.flmjzp (mgr.14640) 2554 : cluster [DBG] pgmap v1760: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:24.136094+0000 mgr.smithi008.flmjzp (mgr.14640) 2555 : cluster [DBG] pgmap v1761: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:25.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:24.136094+0000 mgr.smithi008.flmjzp (mgr.14640) 2555 : cluster [DBG] pgmap v1761: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:26.136720+0000 mgr.smithi008.flmjzp (mgr.14640) 2556 : cluster [DBG] pgmap v1762: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:27.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:26.136720+0000 mgr.smithi008.flmjzp (mgr.14640) 2556 : cluster [DBG] pgmap v1762: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:28.165412+0000 mon.smithi008 (mon.0) 2964 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:28.167579+0000 mon.smithi008 (mon.0) 2965 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:28.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:28.168607+0000 mon.smithi008 (mon.0) 2966 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:28.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:28.175043+0000 mon.smithi008 (mon.0) 2967 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:28.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:28.181540+0000 mon.smithi008 (mon.0) 2968 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:28.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:28.184631+0000 mon.smithi008 (mon.0) 2969 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:28.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:28.186398+0000 mon.smithi008 (mon.0) 2970 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:28.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:28.188056+0000 mon.smithi008 (mon.0) 2971 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:28.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:28.190063+0000 mon.smithi008 (mon.0) 2972 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:28.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:28.165412+0000 mon.smithi008 (mon.0) 2964 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:28.167579+0000 mon.smithi008 (mon.0) 2965 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:28.168607+0000 mon.smithi008 (mon.0) 2966 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:28.175043+0000 mon.smithi008 (mon.0) 2967 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:28.181540+0000 mon.smithi008 (mon.0) 2968 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:28.184631+0000 mon.smithi008 (mon.0) 2969 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:28.186398+0000 mon.smithi008 (mon.0) 2970 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:28.188056+0000 mon.smithi008 (mon.0) 2971 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:28.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:28.190063+0000 mon.smithi008 (mon.0) 2972 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:28.137278+0000 mgr.smithi008.flmjzp (mgr.14640) 2557 : cluster [DBG] pgmap v1763: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:28.169526+0000 mgr.smithi008.flmjzp (mgr.14640) 2558 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:41:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:28.170131+0000 mgr.smithi008.flmjzp (mgr.14640) 2559 : cluster [DBG] pgmap v1764: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:28.170484+0000 mgr.smithi008.flmjzp (mgr.14640) 2560 : cluster [DBG] pgmap v1765: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:28.191956+0000 mgr.smithi008.flmjzp (mgr.14640) 2561 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:28.137278+0000 mgr.smithi008.flmjzp (mgr.14640) 2557 : cluster [DBG] pgmap v1763: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:28.169526+0000 mgr.smithi008.flmjzp (mgr.14640) 2558 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:41:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:28.170131+0000 mgr.smithi008.flmjzp (mgr.14640) 2559 : cluster [DBG] pgmap v1764: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:28.170484+0000 mgr.smithi008.flmjzp (mgr.14640) 2560 : cluster [DBG] pgmap v1765: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:28.191956+0000 mgr.smithi008.flmjzp (mgr.14640) 2561 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:30.171059+0000 mgr.smithi008.flmjzp (mgr.14640) 2562 : cluster [DBG] pgmap v1766: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:31.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:30.171059+0000 mgr.smithi008.flmjzp (mgr.14640) 2562 : cluster [DBG] pgmap v1766: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:32.171585+0000 mgr.smithi008.flmjzp (mgr.14640) 2563 : cluster [DBG] pgmap v1767: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:33.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:32.171585+0000 mgr.smithi008.flmjzp (mgr.14640) 2563 : cluster [DBG] pgmap v1767: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:34.172210+0000 mgr.smithi008.flmjzp (mgr.14640) 2564 : cluster [DBG] pgmap v1768: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:35.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:34.172210+0000 mgr.smithi008.flmjzp (mgr.14640) 2564 : cluster [DBG] pgmap v1768: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:36.172790+0000 mgr.smithi008.flmjzp (mgr.14640) 2565 : cluster [DBG] pgmap v1769: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:37.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:36.172790+0000 mgr.smithi008.flmjzp (mgr.14640) 2565 : cluster [DBG] pgmap v1769: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:38.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:38.196314+0000 mon.smithi008 (mon.0) 2973 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:38.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:38.198574+0000 mon.smithi008 (mon.0) 2974 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:38.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:38.199612+0000 mon.smithi008 (mon.0) 2975 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:38.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:38.206356+0000 mon.smithi008 (mon.0) 2976 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:38.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:38.212974+0000 mon.smithi008 (mon.0) 2977 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:38.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:38.215950+0000 mon.smithi008 (mon.0) 2978 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:38.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:38.217576+0000 mon.smithi008 (mon.0) 2979 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:38.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:38.219173+0000 mon.smithi008 (mon.0) 2980 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:38.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:38.221335+0000 mon.smithi008 (mon.0) 2981 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:38.196314+0000 mon.smithi008 (mon.0) 2973 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:38.198574+0000 mon.smithi008 (mon.0) 2974 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:38.199612+0000 mon.smithi008 (mon.0) 2975 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:38.206356+0000 mon.smithi008 (mon.0) 2976 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:38.212974+0000 mon.smithi008 (mon.0) 2977 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:38.215950+0000 mon.smithi008 (mon.0) 2978 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:38.217576+0000 mon.smithi008 (mon.0) 2979 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:38.219173+0000 mon.smithi008 (mon.0) 2980 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:38.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:38.221335+0000 mon.smithi008 (mon.0) 2981 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:39.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.622+0000 7fd276266700 1 -- 172.21.15.8:0/2291454233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2700f6530 msgr2=0x7fd2700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.622+0000 7fd276266700 1 --2- 172.21.15.8:0/2291454233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2700f6530 0x7fd2700f6950 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7fd26c004660 tx=0x7fd26c009b30).stop 2023-10-18T21:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.622+0000 7fd276266700 1 -- 172.21.15.8:0/2291454233 shutdown_connections 2023-10-18T21:41:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.623+0000 7fd276266700 1 --2- 172.21.15.8:0/2291454233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2700f77d0 0x7fd2700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:41:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.623+0000 7fd276266700 1 --2- 172.21.15.8:0/2291454233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2700f6530 0x7fd2700f6950 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.623+0000 7fd276266700 1 -- 172.21.15.8:0/2291454233 >> 172.21.15.8:0/2291454233 conn(0x7fd2700f1c90 msgr2=0x7fd2700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.623+0000 7fd276266700 1 -- 172.21.15.8:0/2291454233 shutdown_connections 2023-10-18T21:41:39.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.623+0000 7fd276266700 1 -- 172.21.15.8:0/2291454233 wait complete. 2023-10-18T21:41:39.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.623+0000 7fd276266700 1 Processor -- start 2023-10-18T21:41:39.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.624+0000 7fd276266700 1 -- start start 2023-10-18T21:41:39.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.624+0000 7fd276266700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2700f6530 0x7fd27006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:39.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.624+0000 7fd276266700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2700f77d0 0x7fd270069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:39.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.624+0000 7fd276266700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27006a410 con 0x7fd2700f77d0 2023-10-18T21:41:39.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.624+0000 7fd276266700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27006a550 con 0x7fd2700f6530 2023-10-18T21:41:39.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.624+0000 7fd274a63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2700f77d0 0x7fd270069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:39.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.624+0000 7fd274a63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2700f77d0 0x7fd270069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52940/0 (socket says 172.21.15.8:52940) 2023-10-18T21:41:39.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.624+0000 7fd274a63700 1 -- 172.21.15.8:0/376298638 learned_addr learned my addr 172.21.15.8:0/376298638 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:39.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.624+0000 7fd275264700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2700f6530 0x7fd27006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:39.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.625+0000 7fd274a63700 1 -- 172.21.15.8:0/376298638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2700f6530 msgr2=0x7fd27006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:39.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.625+0000 7fd274a63700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2700f6530 0x7fd27006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:39.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.625+0000 7fd274a63700 1 -- 172.21.15.8:0/376298638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c005040 con 0x7fd2700f77d0 2023-10-18T21:41:39.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.625+0000 7fd274a63700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2700f77d0 0x7fd270069e20 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7fd26000b410 tx=0x7fd260006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:39.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.625+0000 7fd265ffb700 1 -- 172.21.15.8:0/376298638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2600125f0 con 0x7fd2700f77d0 2023-10-18T21:41:39.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.625+0000 7fd265ffb700 1 -- 172.21.15.8:0/376298638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd26000be30 con 0x7fd2700f77d0 2023-10-18T21:41:39.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.625+0000 7fd265ffb700 1 -- 172.21.15.8:0/376298638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd260002a60 con 0x7fd2700f77d0 2023-10-18T21:41:39.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.625+0000 7fd276266700 1 -- 172.21.15.8:0/376298638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27006a830 con 0x7fd2700f77d0 2023-10-18T21:41:39.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.625+0000 7fd276266700 1 -- 172.21.15.8:0/376298638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27010ee00 con 0x7fd2700f77d0 2023-10-18T21:41:39.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.626+0000 7fd276266700 1 -- 172.21.15.8:0/376298638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd270045ad0 con 0x7fd2700f77d0 2023-10-18T21:41:39.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.627+0000 7fd265ffb700 1 -- 172.21.15.8:0/376298638 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd26000f030 con 0x7fd2700f77d0 2023-10-18T21:41:39.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.628+0000 7fd265ffb700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd25c060f70 0x7fd25c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:39.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.628+0000 7fd265ffb700 1 -- 172.21.15.8:0/376298638 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd26007cc50 con 0x7fd2700f77d0 2023-10-18T21:41:39.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.628+0000 7fd275264700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd25c060f70 0x7fd25c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:39.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.629+0000 7fd275264700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd25c060f70 0x7fd25c063430 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fd26c009490 tx=0x7fd26c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:39.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.633+0000 7fd265ffb700 1 -- 172.21.15.8:0/376298638 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd26004c8e0 con 0x7fd2700f77d0 2023-10-18T21:41:39.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.830+0000 7fd276266700 1 -- 172.21.15.8:0/376298638 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2700feeb0 con 0x7fd25c060f70 2023-10-18T21:41:39.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.831+0000 7fd265ffb700 1 -- 172.21.15.8:0/376298638 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd2700feeb0 con 0x7fd25c060f70 2023-10-18T21:41:39.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 -- 172.21.15.8:0/376298638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd25c060f70 msgr2=0x7fd25c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:39.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd25c060f70 0x7fd25c063430 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fd26c009490 tx=0x7fd26c009b30).stop 2023-10-18T21:41:39.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 -- 172.21.15.8:0/376298638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2700f77d0 msgr2=0x7fd270069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:39.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2700f77d0 0x7fd270069e20 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7fd26000b410 tx=0x7fd260006ef0).stop 2023-10-18T21:41:39.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 -- 172.21.15.8:0/376298638 shutdown_connections 2023-10-18T21:41:39.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd25c060f70 0x7fd25c063430 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:39.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2700f6530 0x7fd27006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:39.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 --2- 172.21.15.8:0/376298638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2700f77d0 0x7fd270069e20 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:39.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 -- 172.21.15.8:0/376298638 >> 172.21.15.8:0/376298638 conn(0x7fd2700f1c90 msgr2=0x7fd2700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:39.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 -- 172.21.15.8:0/376298638 shutdown_connections 2023-10-18T21:41:39.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.834+0000 7fd276266700 1 -- 172.21.15.8:0/376298638 wait complete. 2023-10-18T21:41:39.882 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:41:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:38.173367+0000 mgr.smithi008.flmjzp (mgr.14640) 2566 : cluster [DBG] pgmap v1770: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:38.200538+0000 mgr.smithi008.flmjzp (mgr.14640) 2567 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:41:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:38.201146+0000 mgr.smithi008.flmjzp (mgr.14640) 2568 : cluster [DBG] pgmap v1771: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:38.201512+0000 mgr.smithi008.flmjzp (mgr.14640) 2569 : cluster [DBG] pgmap v1772: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:38.223217+0000 mgr.smithi008.flmjzp (mgr.14640) 2570 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.972+0000 7f3cedd0f700 1 -- 172.21.15.8:0/2578442230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 msgr2=0x7f3ce80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.972+0000 7f3cedd0f700 1 --2- 172.21.15.8:0/2578442230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 0x7f3ce80f7c30 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f3cd4004660 tx=0x7f3cd4009b30).stop 2023-10-18T21:41:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.972+0000 7f3cedd0f700 1 -- 172.21.15.8:0/2578442230 shutdown_connections 2023-10-18T21:41:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.972+0000 7f3cedd0f700 1 --2- 172.21.15.8:0/2578442230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 0x7f3ce80f7c30 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.972+0000 7f3cedd0f700 1 --2- 172.21.15.8:0/2578442230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f6530 0x7f3ce80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.972+0000 7f3cedd0f700 1 -- 172.21.15.8:0/2578442230 >> 172.21.15.8:0/2578442230 conn(0x7f3ce80f1c90 msgr2=0x7f3ce80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.972+0000 7f3cedd0f700 1 -- 172.21.15.8:0/2578442230 shutdown_connections 2023-10-18T21:41:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.972+0000 7f3cedd0f700 1 -- 172.21.15.8:0/2578442230 wait complete. 2023-10-18T21:41:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.973+0000 7f3cedd0f700 1 Processor -- start 2023-10-18T21:41:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.973+0000 7f3cedd0f700 1 -- start start 2023-10-18T21:41:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.973+0000 7f3cedd0f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f6530 0x7f3ce8106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.973+0000 7f3cedd0f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f77d0 0x7f3ce8107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.974+0000 7f3cedd0f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8107850 con 0x7f3ce80f6530 2023-10-18T21:41:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.974+0000 7f3cedd0f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8108060 con 0x7f3ce80f77d0 2023-10-18T21:41:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.974+0000 7f3cecd0d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f6530 0x7f3ce8106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.974+0000 7f3cecd0d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f6530 0x7f3ce8106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52964/0 (socket says 172.21.15.8:52964) 2023-10-18T21:41:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.974+0000 7f3cecd0d700 1 -- 172.21.15.8:0/1345076689 learned_addr learned my addr 172.21.15.8:0/1345076689 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.974+0000 7f3cecd0d700 1 -- 172.21.15.8:0/1345076689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f77d0 msgr2=0x7f3ce8107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.974+0000 7f3cecd0d700 1 --2- 172.21.15.8:0/1345076689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f77d0 0x7f3ce8107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:41:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.974+0000 7f3cecd0d700 1 -- 172.21.15.8:0/1345076689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4005040 con 0x7f3ce80f6530 2023-10-18T21:41:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.974+0000 7f3cecd0d700 1 --2- 172.21.15.8:0/1345076689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f6530 0x7f3ce8106d60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f3cdc00e7c0 tx=0x7f3cdc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.974+0000 7f3ce57fa700 1 -- 172.21.15.8:0/1345076689 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cdc0092e0 con 0x7f3ce80f6530 2023-10-18T21:41:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.975+0000 7f3ce57fa700 1 -- 172.21.15.8:0/1345076689 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3cdc00f040 con 0x7f3ce80f6530 2023-10-18T21:41:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.975+0000 7f3cedd0f700 1 -- 172.21.15.8:0/1345076689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce81082e0 con 0x7f3ce80f6530 2023-10-18T21:41:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.975+0000 7f3ce57fa700 1 -- 172.21.15.8:0/1345076689 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cdc0147e0 con 0x7f3ce80f6530 2023-10-18T21:41:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.975+0000 7f3cedd0f700 1 -- 172.21.15.8:0/1345076689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce8108820 con 0x7f3ce80f6530 2023-10-18T21:41:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.976+0000 7f3cedd0f700 1 -- 172.21.15.8:0/1345076689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce8059100 con 0x7f3ce80f6530 2023-10-18T21:41:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.977+0000 7f3ce57fa700 1 -- 172.21.15.8:0/1345076689 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3cdc01b030 con 0x7f3ce80f6530 2023-10-18T21:41:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.977+0000 7f3ce57fa700 1 --2- 172.21.15.8:0/1345076689 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 0x7f3cd8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.977+0000 7f3ce57fa700 1 -- 172.21.15.8:0/1345076689 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3cdc07c9b0 con 0x7f3ce80f6530 2023-10-18T21:41:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.978+0000 7f3ce7fff700 1 --2- 172.21.15.8:0/1345076689 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 0x7f3cd8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.978+0000 7f3ce7fff700 1 --2- 172.21.15.8:0/1345076689 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 0x7f3cd8063430 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f3cd4004d80 tx=0x7f3cd400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:39.982+0000 7f3ce57fa700 1 -- 172.21.15.8:0/1345076689 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3cdc04c620 con 0x7f3ce80f6530 2023-10-18T21:41:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:38.173367+0000 mgr.smithi008.flmjzp (mgr.14640) 2566 : cluster [DBG] pgmap v1770: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:38.200538+0000 mgr.smithi008.flmjzp (mgr.14640) 2567 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:41:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:38.201146+0000 mgr.smithi008.flmjzp (mgr.14640) 2568 : cluster [DBG] pgmap v1771: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:38.201512+0000 mgr.smithi008.flmjzp (mgr.14640) 2569 : cluster [DBG] pgmap v1772: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:38.223217+0000 mgr.smithi008.flmjzp (mgr.14640) 2570 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:40.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.180+0000 7f3cedd0f700 1 -- 172.21.15.8:0/1345076689 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ce80fee00 con 0x7f3cd8060f70 2023-10-18T21:41:40.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.181+0000 7f3ce57fa700 1 -- 172.21.15.8:0/1345076689 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3ce80fee00 con 0x7f3cd8060f70 2023-10-18T21:41:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.183+0000 7f3cedd0f700 1 -- 172.21.15.8:0/1345076689 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 msgr2=0x7f3cd8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.183+0000 7f3cedd0f700 1 --2- 172.21.15.8:0/1345076689 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 0x7f3cd8063430 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f3cd4004d80 tx=0x7f3cd400b040).stop 2023-10-18T21:41:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.183+0000 7f3cedd0f700 1 -- 172.21.15.8:0/1345076689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f6530 msgr2=0x7f3ce8106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.183+0000 7f3cedd0f700 1 --2- 172.21.15.8:0/1345076689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f6530 0x7f3ce8106d60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f3cdc00e7c0 tx=0x7f3cdc00b040).stop 2023-10-18T21:41:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.183+0000 7f3cedd0f700 1 -- 172.21.15.8:0/1345076689 shutdown_connections 2023-10-18T21:41:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.183+0000 7f3cedd0f700 1 --2- 172.21.15.8:0/1345076689 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 0x7f3cd8063430 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.183+0000 7f3cedd0f700 1 --2- 172.21.15.8:0/1345076689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f6530 0x7f3ce8106d60 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.183+0000 7f3cedd0f700 1 --2- 172.21.15.8:0/1345076689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f77d0 0x7f3ce8107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:41:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.183+0000 7f3cedd0f700 1 -- 172.21.15.8:0/1345076689 >> 172.21.15.8:0/1345076689 conn(0x7f3ce80f1c90 msgr2=0x7f3ce80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.183+0000 7f3cedd0f700 1 -- 172.21.15.8:0/1345076689 shutdown_connections 2023-10-18T21:41:40.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.184+0000 7f3cedd0f700 1 -- 172.21.15.8:0/1345076689 wait complete. 2023-10-18T21:41:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.321+0000 7f676759e700 1 -- 172.21.15.8:0/729495284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67680f77d0 msgr2=0x7f67680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.321+0000 7f676759e700 1 --2- 172.21.15.8:0/729495284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67680f77d0 0x7f67680f7c30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f675c004660 tx=0x7f675c009b30).stop 2023-10-18T21:41:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.321+0000 7f676759e700 1 -- 172.21.15.8:0/729495284 shutdown_connections 2023-10-18T21:41:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.321+0000 7f676759e700 1 --2- 172.21.15.8:0/729495284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67680f77d0 0x7f67680f7c30 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.321+0000 7f676759e700 1 --2- 172.21.15.8:0/729495284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67680f6530 0x7f67680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.321+0000 7f676759e700 1 -- 172.21.15.8:0/729495284 >> 172.21.15.8:0/729495284 conn(0x7f67680f1c90 msgr2=0x7f67680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:40.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.321+0000 7f676759e700 1 -- 172.21.15.8:0/729495284 shutdown_connections 2023-10-18T21:41:40.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.321+0000 7f676759e700 1 -- 172.21.15.8:0/729495284 wait complete. 2023-10-18T21:41:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.322+0000 7f676759e700 1 Processor -- start 2023-10-18T21:41:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.322+0000 7f676759e700 1 -- start start 2023-10-18T21:41:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.322+0000 7f676759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67680f6530 0x7f6768106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.322+0000 7f676759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67680f77d0 0x7f6768107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.322+0000 7f676759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6768107830 con 0x7f67680f6530 2023-10-18T21:41:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.322+0000 7f676759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6768108040 con 0x7f67680f77d0 2023-10-18T21:41:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.322+0000 7f676659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67680f6530 0x7f6768106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.322+0000 7f676659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67680f6530 0x7f6768106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52980/0 (socket says 172.21.15.8:52980) 2023-10-18T21:41:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.322+0000 7f676659c700 1 -- 172.21.15.8:0/1803373675 learned_addr learned my addr 172.21.15.8:0/1803373675 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.323+0000 7f6765d9b700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67680f77d0 0x7f6768107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.323+0000 7f676659c700 1 -- 172.21.15.8:0/1803373675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67680f77d0 msgr2=0x7f6768107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.323+0000 7f676659c700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67680f77d0 0x7f6768107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.323+0000 7f676659c700 1 -- 172.21.15.8:0/1803373675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c005040 con 0x7f67680f6530 2023-10-18T21:41:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.323+0000 7f676659c700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67680f6530 0x7f6768106d40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f6758002700 tx=0x7f6758009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.323+0000 7f6756ffd700 1 -- 172.21.15.8:0/1803373675 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6758009320 con 0x7f67680f6530 2023-10-18T21:41:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.323+0000 7f6756ffd700 1 -- 172.21.15.8:0/1803373675 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f675800f040 con 0x7f67680f6530 2023-10-18T21:41:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.323+0000 7f676759e700 1 -- 172.21.15.8:0/1803373675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67681082c0 con 0x7f67680f6530 2023-10-18T21:41:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.323+0000 7f6756ffd700 1 -- 172.21.15.8:0/1803373675 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6758014970 con 0x7f67680f6530 2023-10-18T21:41:40.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.323+0000 7f676759e700 1 -- 172.21.15.8:0/1803373675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6768108880 con 0x7f67680f6530 2023-10-18T21:41:40.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.324+0000 7f676759e700 1 -- 172.21.15.8:0/1803373675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6768059100 con 0x7f67680f6530 2023-10-18T21:41:40.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.325+0000 7f6756ffd700 1 -- 172.21.15.8:0/1803373675 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6758009480 con 0x7f67680f6530 2023-10-18T21:41:40.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.326+0000 7f6756ffd700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6750060f70 0x7f6750063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.326+0000 7f6756ffd700 1 -- 172.21.15.8:0/1803373675 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f675807cb80 con 0x7f67680f6530 2023-10-18T21:41:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.326+0000 7f6765d9b700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6750060f70 0x7f6750063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.327+0000 7f6765d9b700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6750060f70 0x7f6750063430 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f675c004630 tx=0x7f675c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.330+0000 7f6756ffd700 1 -- 172.21.15.8:0/1803373675 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f675804c7f0 con 0x7f67680f6530 2023-10-18T21:41:40.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.527+0000 7f676759e700 1 -- 172.21.15.8:0/1803373675 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f67680feda0 con 0x7f6750060f70 2023-10-18T21:41:40.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.537+0000 7f6756ffd700 1 -- 172.21.15.8:0/1803373675 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f67680feda0 con 0x7f6750060f70 2023-10-18T21:41:40.538 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:41:40.538 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (48m) 6m ago 49m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:41:40.539 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (42m) 6m ago 49m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:41:40.539 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (42m) 3m ago 48m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:41:40.539 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (48m) 6m ago 49m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:41:40.539 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 45m - - 2023-10-18T21:41:40.539 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 45m - - 2023-10-18T21:41:40.540 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 45m - - 2023-10-18T21:41:40.540 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 45m - - 2023-10-18T21:41:40.540 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (43m) 6m ago 51m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:41:40.540 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (42m) 3m ago 48m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:41:40.540 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (42m) 6m ago 51m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:41:40.541 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (42m) 3m ago 48m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:41:40.541 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (49m) 6m ago 49m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:41:40.541 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (48m) 3m ago 48m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:41:40.541 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (41m) 6m ago 48m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:41:40.541 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (39m) 6m ago 48m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:41:40.542 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (39m) 6m ago 47m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:41:40.542 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (38m) 3m ago 47m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:41:40.542 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (38m) 3m ago 47m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:41:40.542 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (37m) 3m ago 46m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:41:40.543 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (43m) 6m ago 49m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:41:40.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.538+0000 7f676759e700 1 -- 172.21.15.8:0/1803373675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6750060f70 msgr2=0x7f6750063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:40.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.538+0000 7f676759e700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6750060f70 0x7f6750063430 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f675c004630 tx=0x7f675c009b30).stop 2023-10-18T21:41:40.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.539+0000 7f676759e700 1 -- 172.21.15.8:0/1803373675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67680f6530 msgr2=0x7f6768106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:40.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.539+0000 7f676759e700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67680f6530 0x7f6768106d40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f6758002700 tx=0x7f6758009d80).stop 2023-10-18T21:41:40.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.539+0000 7f676759e700 1 -- 172.21.15.8:0/1803373675 shutdown_connections 2023-10-18T21:41:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.539+0000 7f676759e700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6750060f70 0x7f6750063430 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.539+0000 7f676759e700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67680f6530 0x7f6768106d40 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.539+0000 7f676759e700 1 --2- 172.21.15.8:0/1803373675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67680f77d0 0x7f6768107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.539+0000 7f676759e700 1 -- 172.21.15.8:0/1803373675 >> 172.21.15.8:0/1803373675 conn(0x7f67680f1c90 msgr2=0x7f67680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.539+0000 7f676759e700 1 -- 172.21.15.8:0/1803373675 shutdown_connections 2023-10-18T21:41:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.539+0000 7f676759e700 1 -- 172.21.15.8:0/1803373675 wait complete. 2023-10-18T21:41:40.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.675+0000 7f40e4827700 1 -- 172.21.15.8:0/3879562803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e00f6530 msgr2=0x7f40e00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:40.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.675+0000 7f40e4827700 1 --2- 172.21.15.8:0/3879562803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e00f6530 0x7f40e00f6950 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f40d0004660 tx=0x7f40d0009b30).stop 2023-10-18T21:41:40.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.675+0000 7f40e4827700 1 -- 172.21.15.8:0/3879562803 shutdown_connections 2023-10-18T21:41:40.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.675+0000 7f40e4827700 1 --2- 172.21.15.8:0/3879562803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40e00f77d0 0x7f40e00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.675+0000 7f40e4827700 1 --2- 172.21.15.8:0/3879562803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e00f6530 0x7f40e00f6950 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.675+0000 7f40e4827700 1 -- 172.21.15.8:0/3879562803 >> 172.21.15.8:0/3879562803 conn(0x7f40e00f1c90 msgr2=0x7f40e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:40.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.675+0000 7f40e4827700 1 -- 172.21.15.8:0/3879562803 shutdown_connections 2023-10-18T21:41:40.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.675+0000 7f40e4827700 1 -- 172.21.15.8:0/3879562803 wait complete. 2023-10-18T21:41:40.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.676+0000 7f40e4827700 1 Processor -- start 2023-10-18T21:41:40.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.676+0000 7f40e4827700 1 -- start start 2023-10-18T21:41:40.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40e4827700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40e00f6530 0x7f40e0106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:40.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40e4827700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e00f77d0 0x7f40e0107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:40.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40e4827700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0107900 con 0x7f40e00f77d0 2023-10-18T21:41:40.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40e4827700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0108110 con 0x7f40e00f6530 2023-10-18T21:41:40.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40deffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e00f77d0 0x7f40e0107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:40.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40deffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e00f77d0 0x7f40e0107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53004/0 (socket says 172.21.15.8:53004) 2023-10-18T21:41:40.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40deffd700 1 -- 172.21.15.8:0/1389413469 learned_addr learned my addr 172.21.15.8:0/1389413469 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:40.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40df7fe700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40e00f6530 0x7f40e0106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:40.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40deffd700 1 -- 172.21.15.8:0/1389413469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40e00f6530 msgr2=0x7f40e0106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:40.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40deffd700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40e00f6530 0x7f40e0106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.677+0000 7f40deffd700 1 -- 172.21.15.8:0/1389413469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0005040 con 0x7f40e00f77d0 2023-10-18T21:41:40.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.678+0000 7f40deffd700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e00f77d0 0x7f40e0107300 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f40d40026d0 tx=0x7f40d4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:40.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.678+0000 7f40c7fff700 1 -- 172.21.15.8:0/1389413469 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40d40079c0 con 0x7f40e00f77d0 2023-10-18T21:41:40.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.678+0000 7f40e4827700 1 -- 172.21.15.8:0/1389413469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e0108390 con 0x7f40e00f77d0 2023-10-18T21:41:40.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.678+0000 7f40c7fff700 1 -- 172.21.15.8:0/1389413469 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f40d400f040 con 0x7f40e00f77d0 2023-10-18T21:41:40.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.678+0000 7f40c7fff700 1 -- 172.21.15.8:0/1389413469 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40d4014980 con 0x7f40e00f77d0 2023-10-18T21:41:40.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.678+0000 7f40e4827700 1 -- 172.21.15.8:0/1389413469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e0108950 con 0x7f40e00f77d0 2023-10-18T21:41:40.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.679+0000 7f40e4827700 1 -- 172.21.15.8:0/1389413469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e0059100 con 0x7f40e00f77d0 2023-10-18T21:41:40.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.680+0000 7f40c7fff700 1 -- 172.21.15.8:0/1389413469 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f40d40090d0 con 0x7f40e00f77d0 2023-10-18T21:41:40.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.681+0000 7f40c7fff700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f40c8060f70 0x7f40c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:40.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.681+0000 7f40c7fff700 1 -- 172.21.15.8:0/1389413469 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f40d407c980 con 0x7f40e00f77d0 2023-10-18T21:41:40.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.681+0000 7f40df7fe700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f40c8060f70 0x7f40c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:40.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.682+0000 7f40df7fe700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f40c8060f70 0x7f40c8063430 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f40d0005010 tx=0x7f40d0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:40.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.685+0000 7f40c7fff700 1 -- 172.21.15.8:0/1389413469 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f40d404c5e0 con 0x7f40e00f77d0 2023-10-18T21:41:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:39.831362+0000 mgr.smithi008.flmjzp (mgr.14640) 2571 : audit [DBG] from='client.36184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.937+0000 7f40e4827700 1 -- 172.21.15.8:0/1389413469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f40e00fee50 con 0x7f40e00f77d0 2023-10-18T21:41:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.938+0000 7f40c7fff700 1 -- 172.21.15.8:0/1389413469 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f40e00fee50 con 0x7f40e00f77d0 2023-10-18T21:41:40.939 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:41:40.939 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:41:40.939 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:41:40.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:41:40.940 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:41:40.940 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:41:40.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:41:40.940 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:41:40.941 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:41:40.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:41:40.941 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:41:40.941 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:41:40.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:41:40.942 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:41:40.942 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:41:40.942 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:41:40.942 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:41:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 -- 172.21.15.8:0/1389413469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f40c8060f70 msgr2=0x7f40c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f40c8060f70 0x7f40c8063430 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f40d0005010 tx=0x7f40d0009b30).stop 2023-10-18T21:41:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 -- 172.21.15.8:0/1389413469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e00f77d0 msgr2=0x7f40e0107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e00f77d0 0x7f40e0107300 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f40d40026d0 tx=0x7f40d4009de0).stop 2023-10-18T21:41:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 -- 172.21.15.8:0/1389413469 shutdown_connections 2023-10-18T21:41:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f40c8060f70 0x7f40c8063430 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40e00f6530 0x7f40e0106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 --2- 172.21.15.8:0/1389413469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e00f77d0 0x7f40e0107300 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:40.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 -- 172.21.15.8:0/1389413469 >> 172.21.15.8:0/1389413469 conn(0x7f40e00f1c90 msgr2=0x7f40e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:40.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 -- 172.21.15.8:0/1389413469 shutdown_connections 2023-10-18T21:41:40.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:40.940+0000 7f40e4827700 1 -- 172.21.15.8:0/1389413469 wait complete. 2023-10-18T21:41:40.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:39.831362+0000 mgr.smithi008.flmjzp (mgr.14640) 2571 : audit [DBG] from='client.36184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:41.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.076+0000 7f3300e64700 1 -- 172.21.15.8:0/1592095677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32fc0f77d0 msgr2=0x7f32fc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:41.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.076+0000 7f3300e64700 1 --2- 172.21.15.8:0/1592095677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32fc0f77d0 0x7f32fc0f7c30 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f32f0004660 tx=0x7f32f0009b30).stop 2023-10-18T21:41:41.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.076+0000 7f3300e64700 1 -- 172.21.15.8:0/1592095677 shutdown_connections 2023-10-18T21:41:41.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.076+0000 7f3300e64700 1 --2- 172.21.15.8:0/1592095677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32fc0f77d0 0x7f32fc0f7c30 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.076+0000 7f3300e64700 1 --2- 172.21.15.8:0/1592095677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0f6530 0x7f32fc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.076+0000 7f3300e64700 1 -- 172.21.15.8:0/1592095677 >> 172.21.15.8:0/1592095677 conn(0x7f32fc0f1c90 msgr2=0x7f32fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:41.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.076+0000 7f3300e64700 1 -- 172.21.15.8:0/1592095677 shutdown_connections 2023-10-18T21:41:41.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.076+0000 7f3300e64700 1 -- 172.21.15.8:0/1592095677 wait complete. 2023-10-18T21:41:41.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.077+0000 7f3300e64700 1 Processor -- start 2023-10-18T21:41:41.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.077+0000 7f3300e64700 1 -- start start 2023-10-18T21:41:41.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f3300e64700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0f6530 0x7f32fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:41.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f3300e64700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32fc0f77d0 0x7f32fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:41.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f3300e64700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc06a380 con 0x7f32fc0f77d0 2023-10-18T21:41:41.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f3300e64700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc06a4c0 con 0x7f32fc0f6530 2023-10-18T21:41:41.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f32faffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32fc0f77d0 0x7f32fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:41.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f32faffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32fc0f77d0 0x7f32fc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53012/0 (socket says 172.21.15.8:53012) 2023-10-18T21:41:41.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f32faffd700 1 -- 172.21.15.8:0/4150754263 learned_addr learned my addr 172.21.15.8:0/4150754263 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:41.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f32fb7fe700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0f6530 0x7f32fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:41.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f32faffd700 1 -- 172.21.15.8:0/4150754263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0f6530 msgr2=0x7f32fc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f32faffd700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0f6530 0x7f32fc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.078+0000 7f32faffd700 1 -- 172.21.15.8:0/4150754263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f0005040 con 0x7f32fc0f77d0 2023-10-18T21:41:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.079+0000 7f32faffd700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32fc0f77d0 0x7f32fc069e20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f32f0009f50 tx=0x7f32f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.079+0000 7f32e3fff700 1 -- 172.21.15.8:0/4150754263 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f0018070 con 0x7f32fc0f77d0 2023-10-18T21:41:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.079+0000 7f32e3fff700 1 -- 172.21.15.8:0/4150754263 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f32f0009630 con 0x7f32fc0f77d0 2023-10-18T21:41:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.079+0000 7f3300e64700 1 -- 172.21.15.8:0/4150754263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc06a740 con 0x7f32fc0f77d0 2023-10-18T21:41:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.079+0000 7f32e3fff700 1 -- 172.21.15.8:0/4150754263 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f001c3c0 con 0x7f32fc0f77d0 2023-10-18T21:41:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.079+0000 7f3300e64700 1 -- 172.21.15.8:0/4150754263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc06aca0 con 0x7f32fc0f77d0 2023-10-18T21:41:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.080+0000 7f3300e64700 1 -- 172.21.15.8:0/4150754263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc045ad0 con 0x7f32fc0f77d0 2023-10-18T21:41:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.081+0000 7f32e3fff700 1 -- 172.21.15.8:0/4150754263 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f32f001d420 con 0x7f32fc0f77d0 2023-10-18T21:41:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.082+0000 7f32e3fff700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e4060f70 0x7f32e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:41.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.082+0000 7f32e3fff700 1 -- 172.21.15.8:0/4150754263 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f32f007e580 con 0x7f32fc0f77d0 2023-10-18T21:41:41.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.083+0000 7f32fb7fe700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e4060f70 0x7f32e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:41.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.083+0000 7f32fb7fe700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e4060f70 0x7f32e4063430 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f32fc06b730 tx=0x7f32ec00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:41.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.087+0000 7f32e3fff700 1 -- 172.21.15.8:0/4150754263 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f32f004e1b0 con 0x7f32fc0f77d0 2023-10-18T21:41:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.314+0000 7f3300e64700 1 -- 172.21.15.8:0/4150754263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f32fc027a00 con 0x7f32fc0f77d0 2023-10-18T21:41:41.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.315+0000 7f32e3fff700 1 -- 172.21.15.8:0/4150754263 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f32f00517d0 con 0x7f32fc0f77d0 2023-10-18T21:41:41.316 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:41:41.316 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:41:41.317 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:41:41.317 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:41:41.317 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:41:41.317 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:41:41.317 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:41:41.318 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:41:41.318 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:41:41.318 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:41:41.318 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:41:41.318 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:41:41.319 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:41:41.319 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:41:41.319 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:41:41.319 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:41:41.319 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:41:41.320 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:41:41.320 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:41:41.320 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:41:41.320 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:41:41.320 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:41:41.320 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:41:41.321 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:41:41.321 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:41:41.321 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:41:41.321 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:41:41.321 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:41:41.322 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:41:41.322 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:41:41.322 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:41:41.322 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:41:41.322 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:41:41.322 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:41:41.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 -- 172.21.15.8:0/4150754263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e4060f70 msgr2=0x7f32e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:41.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e4060f70 0x7f32e4063430 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f32fc06b730 tx=0x7f32ec00b040).stop 2023-10-18T21:41:41.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 -- 172.21.15.8:0/4150754263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32fc0f77d0 msgr2=0x7f32fc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:41.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32fc0f77d0 0x7f32fc069e20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f32f0009f50 tx=0x7f32f0009b30).stop 2023-10-18T21:41:41.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 -- 172.21.15.8:0/4150754263 shutdown_connections 2023-10-18T21:41:41.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e4060f70 0x7f32e4063430 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0f6530 0x7f32fc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 --2- 172.21.15.8:0/4150754263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32fc0f77d0 0x7f32fc069e20 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 -- 172.21.15.8:0/4150754263 >> 172.21.15.8:0/4150754263 conn(0x7f32fc0f1c90 msgr2=0x7f32fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:41.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 -- 172.21.15.8:0/4150754263 shutdown_connections 2023-10-18T21:41:41.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.317+0000 7f3300e64700 1 -- 172.21.15.8:0/4150754263 wait complete. 2023-10-18T21:41:41.325 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:41:41.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.454+0000 7ff702d4c700 1 -- 172.21.15.8:0/2874418317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc0f6530 msgr2=0x7ff6fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:41.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.454+0000 7ff702d4c700 1 --2- 172.21.15.8:0/2874418317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc0f6530 0x7ff6fc0f6950 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7ff6f8004660 tx=0x7ff6f8009b30).stop 2023-10-18T21:41:41.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.454+0000 7ff702d4c700 1 -- 172.21.15.8:0/2874418317 shutdown_connections 2023-10-18T21:41:41.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.454+0000 7ff702d4c700 1 --2- 172.21.15.8:0/2874418317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc0f77d0 0x7ff6fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.454+0000 7ff702d4c700 1 --2- 172.21.15.8:0/2874418317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc0f6530 0x7ff6fc0f6950 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.454+0000 7ff702d4c700 1 -- 172.21.15.8:0/2874418317 >> 172.21.15.8:0/2874418317 conn(0x7ff6fc0f1c90 msgr2=0x7ff6fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:41.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.455+0000 7ff702d4c700 1 -- 172.21.15.8:0/2874418317 shutdown_connections 2023-10-18T21:41:41.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.455+0000 7ff702d4c700 1 -- 172.21.15.8:0/2874418317 wait complete. 2023-10-18T21:41:41.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.455+0000 7ff702d4c700 1 Processor -- start 2023-10-18T21:41:41.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.456+0000 7ff702d4c700 1 -- start start 2023-10-18T21:41:41.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.456+0000 7ff702d4c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc0f6530 0x7ff6fc108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:41.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.456+0000 7ff702d4c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc0f77d0 0x7ff6fc109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:41.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.456+0000 7ff702d4c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1099f0 con 0x7ff6fc0f6530 2023-10-18T21:41:41.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.456+0000 7ff702d4c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc109b30 con 0x7ff6fc0f77d0 2023-10-18T21:41:41.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.456+0000 7ff701d4a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc0f6530 0x7ff6fc108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:41.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.456+0000 7ff701d4a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc0f6530 0x7ff6fc108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53038/0 (socket says 172.21.15.8:53038) 2023-10-18T21:41:41.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.456+0000 7ff701d4a700 1 -- 172.21.15.8:0/2686186160 learned_addr learned my addr 172.21.15.8:0/2686186160 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:41:41.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff701549700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc0f77d0 0x7ff6fc109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:41.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff701d4a700 1 -- 172.21.15.8:0/2686186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc0f77d0 msgr2=0x7ff6fc109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:41.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff701d4a700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc0f77d0 0x7ff6fc109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff701d4a700 1 -- 172.21.15.8:0/2686186160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8005040 con 0x7ff6fc0f6530 2023-10-18T21:41:41.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff701549700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc0f77d0 0x7ff6fc109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:41:41.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff701d4a700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc0f6530 0x7ff6fc108f50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7ff6f8009870 tx=0x7ff6f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:41.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff6f27fc700 1 -- 172.21.15.8:0/2686186160 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f8019070 con 0x7ff6fc0f6530 2023-10-18T21:41:41.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff6f27fc700 1 -- 172.21.15.8:0/2686186160 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff6f801e420 con 0x7ff6fc0f6530 2023-10-18T21:41:41.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff702d4c700 1 -- 172.21.15.8:0/2686186160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc10a470 con 0x7ff6fc0f6530 2023-10-18T21:41:41.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff6f27fc700 1 -- 172.21.15.8:0/2686186160 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f8014660 con 0x7ff6fc0f6530 2023-10-18T21:41:41.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.457+0000 7ff702d4c700 1 -- 172.21.15.8:0/2686186160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc10a950 con 0x7ff6fc0f6530 2023-10-18T21:41:41.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.458+0000 7ff702d4c700 1 -- 172.21.15.8:0/2686186160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc045ad0 con 0x7ff6fc0f6530 2023-10-18T21:41:41.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.459+0000 7ff6f27fc700 1 -- 172.21.15.8:0/2686186160 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff6f801e9c0 con 0x7ff6fc0f6530 2023-10-18T21:41:41.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.460+0000 7ff6f27fc700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6e8060f70 0x7ff6e8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:41:41.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.460+0000 7ff6f27fc700 1 -- 172.21.15.8:0/2686186160 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff6f807ddd0 con 0x7ff6fc0f6530 2023-10-18T21:41:41.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.461+0000 7ff701549700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6e8060f70 0x7ff6e8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:41:41.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.461+0000 7ff701549700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6e8060f70 0x7ff6e8063430 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7ff6ec009da0 tx=0x7ff6ec00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:41:41.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.465+0000 7ff6f27fc700 1 -- 172.21.15.8:0/2686186160 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff6f8051470 con 0x7ff6fc0f6530 2023-10-18T21:41:41.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.663+0000 7ff702d4c700 1 -- 172.21.15.8:0/2686186160 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6fc0fc0d0 con 0x7ff6e8060f70 2023-10-18T21:41:41.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.664+0000 7ff6f27fc700 1 -- 172.21.15.8:0/2686186160 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff6fc0fc0d0 con 0x7ff6e8060f70 2023-10-18T21:41:41.665 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:41:41.665 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:41:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:41:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:41:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:41:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:41:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:41:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:41:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:41:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:41:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:41:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:41:41.668 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:41:41.668 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:41:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 -- 172.21.15.8:0/2686186160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6e8060f70 msgr2=0x7ff6e8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6e8060f70 0x7ff6e8063430 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7ff6ec009da0 tx=0x7ff6ec00b040).stop 2023-10-18T21:41:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 -- 172.21.15.8:0/2686186160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc0f6530 msgr2=0x7ff6fc108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:41:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc0f6530 0x7ff6fc108f50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7ff6f8009870 tx=0x7ff6f800b040).stop 2023-10-18T21:41:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 -- 172.21.15.8:0/2686186160 shutdown_connections 2023-10-18T21:41:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6e8060f70 0x7ff6e8063430 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc0f6530 0x7ff6fc108f50 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 --2- 172.21.15.8:0/2686186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc0f77d0 0x7ff6fc109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:41:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 -- 172.21.15.8:0/2686186160 >> 172.21.15.8:0/2686186160 conn(0x7ff6fc0f1c90 msgr2=0x7ff6fc0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:41:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 -- 172.21.15.8:0/2686186160 shutdown_connections 2023-10-18T21:41:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:41:41.666+0000 7ff702d4c700 1 -- 172.21.15.8:0/2686186160 wait complete. 2023-10-18T21:41:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:40.181249+0000 mgr.smithi008.flmjzp (mgr.14640) 2572 : audit [DBG] from='client.36188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:40.201982+0000 mgr.smithi008.flmjzp (mgr.14640) 2573 : cluster [DBG] pgmap v1773: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:40.528764+0000 mgr.smithi008.flmjzp (mgr.14640) 2574 : audit [DBG] from='client.36192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:40.938438+0000 mon.smithi008 (mon.0) 2982 : audit [DBG] from='client.? 172.21.15.8:0/1389413469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:41.315433+0000 mon.smithi008 (mon.0) 2983 : audit [DBG] from='client.? 172.21.15.8:0/4150754263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:41:41.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:40.181249+0000 mgr.smithi008.flmjzp (mgr.14640) 2572 : audit [DBG] from='client.36188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:40.201982+0000 mgr.smithi008.flmjzp (mgr.14640) 2573 : cluster [DBG] pgmap v1773: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:40.528764+0000 mgr.smithi008.flmjzp (mgr.14640) 2574 : audit [DBG] from='client.36192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:40.938438+0000 mon.smithi008 (mon.0) 2982 : audit [DBG] from='client.? 172.21.15.8:0/1389413469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:41.315433+0000 mon.smithi008 (mon.0) 2983 : audit [DBG] from='client.? 172.21.15.8:0/4150754263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:41:42.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:41.664553+0000 mgr.smithi008.flmjzp (mgr.14640) 2575 : audit [DBG] from='client.36204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:42.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:41.664553+0000 mgr.smithi008.flmjzp (mgr.14640) 2575 : audit [DBG] from='client.36204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:41:43.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:42.202694+0000 mgr.smithi008.flmjzp (mgr.14640) 2576 : cluster [DBG] pgmap v1774: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:43.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:42.202694+0000 mgr.smithi008.flmjzp (mgr.14640) 2576 : cluster [DBG] pgmap v1774: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:44.203341+0000 mgr.smithi008.flmjzp (mgr.14640) 2577 : cluster [DBG] pgmap v1775: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:45.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:44.203341+0000 mgr.smithi008.flmjzp (mgr.14640) 2577 : cluster [DBG] pgmap v1775: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:46.203904+0000 mgr.smithi008.flmjzp (mgr.14640) 2578 : cluster [DBG] pgmap v1776: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:47.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:46.203904+0000 mgr.smithi008.flmjzp (mgr.14640) 2578 : cluster [DBG] pgmap v1776: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:48.234006+0000 mon.smithi008 (mon.0) 2984 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:48.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:48.234006+0000 mon.smithi008 (mon.0) 2984 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:48.204547+0000 mgr.smithi008.flmjzp (mgr.14640) 2579 : cluster [DBG] pgmap v1777: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:48.798295+0000 mon.smithi008 (mon.0) 2985 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:48.799113+0000 mon.smithi008 (mon.0) 2986 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:48.799765+0000 mgr.smithi008.flmjzp (mgr.14640) 2580 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:41:49.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:48.800328+0000 mgr.smithi008.flmjzp (mgr.14640) 2581 : cluster [DBG] pgmap v1778: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:49.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:48.800645+0000 mgr.smithi008.flmjzp (mgr.14640) 2582 : cluster [DBG] pgmap v1779: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:49.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:48.804274+0000 mon.smithi008 (mon.0) 2987 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:49.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:48.810197+0000 mon.smithi008 (mon.0) 2988 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:49.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:48.812952+0000 mon.smithi008 (mon.0) 2989 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:49.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:48.814437+0000 mon.smithi008 (mon.0) 2990 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:49.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:48.815886+0000 mon.smithi008 (mon.0) 2991 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:49.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:48.817861+0000 mon.smithi008 (mon.0) 2992 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:49.924 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:48.819566+0000 mgr.smithi008.flmjzp (mgr.14640) 2583 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:48.204547+0000 mgr.smithi008.flmjzp (mgr.14640) 2579 : cluster [DBG] pgmap v1777: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:48.798295+0000 mon.smithi008 (mon.0) 2985 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:48.799113+0000 mon.smithi008 (mon.0) 2986 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:48.799765+0000 mgr.smithi008.flmjzp (mgr.14640) 2580 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:41:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:48.800328+0000 mgr.smithi008.flmjzp (mgr.14640) 2581 : cluster [DBG] pgmap v1778: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:48.800645+0000 mgr.smithi008.flmjzp (mgr.14640) 2582 : cluster [DBG] pgmap v1779: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:48.804274+0000 mon.smithi008 (mon.0) 2987 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:48.810197+0000 mon.smithi008 (mon.0) 2988 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:48.812952+0000 mon.smithi008 (mon.0) 2989 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:48.814437+0000 mon.smithi008 (mon.0) 2990 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:48.815886+0000 mon.smithi008 (mon.0) 2991 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:48.817861+0000 mon.smithi008 (mon.0) 2992 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:48.819566+0000 mgr.smithi008.flmjzp (mgr.14640) 2583 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:41:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:50.801387+0000 mgr.smithi008.flmjzp (mgr.14640) 2584 : cluster [DBG] pgmap v1780: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:51.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:50.801387+0000 mgr.smithi008.flmjzp (mgr.14640) 2584 : cluster [DBG] pgmap v1780: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:52.801844+0000 mgr.smithi008.flmjzp (mgr.14640) 2585 : cluster [DBG] pgmap v1781: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:52.801844+0000 mgr.smithi008.flmjzp (mgr.14640) 2585 : cluster [DBG] pgmap v1781: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:54.802499+0000 mgr.smithi008.flmjzp (mgr.14640) 2586 : cluster [DBG] pgmap v1782: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:54.802499+0000 mgr.smithi008.flmjzp (mgr.14640) 2586 : cluster [DBG] pgmap v1782: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:58.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:56.803219+0000 mgr.smithi008.flmjzp (mgr.14640) 2587 : cluster [DBG] pgmap v1783: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:58.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:56.803219+0000 mgr.smithi008.flmjzp (mgr.14640) 2587 : cluster [DBG] pgmap v1783: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:41:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:58.830355+0000 mon.smithi008 (mon.0) 2993 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:58.832661+0000 mon.smithi008 (mon.0) 2994 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:58.833747+0000 mon.smithi008 (mon.0) 2995 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:58.840747+0000 mon.smithi008 (mon.0) 2996 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:58.847164+0000 mon.smithi008 (mon.0) 2997 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:58.850090+0000 mon.smithi008 (mon.0) 2998 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:59.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:58.851820+0000 mon.smithi008 (mon.0) 2999 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:59.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:58.853294+0000 mon.smithi008 (mon.0) 3000 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:59.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:41:58.855157+0000 mon.smithi008 (mon.0) 3001 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:58.830355+0000 mon.smithi008 (mon.0) 2993 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:58.832661+0000 mon.smithi008 (mon.0) 2994 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:41:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:58.833747+0000 mon.smithi008 (mon.0) 2995 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:41:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:58.840747+0000 mon.smithi008 (mon.0) 2996 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:41:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:58.847164+0000 mon.smithi008 (mon.0) 2997 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:41:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:58.850090+0000 mon.smithi008 (mon.0) 2998 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:58.851820+0000 mon.smithi008 (mon.0) 2999 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:58.853294+0000 mon.smithi008 (mon.0) 3000 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:41:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:41:58.855157+0000 mon.smithi008 (mon.0) 3001 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:00.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:58.803940+0000 mgr.smithi008.flmjzp (mgr.14640) 2588 : cluster [DBG] pgmap v1784: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:00.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:58.834691+0000 mgr.smithi008.flmjzp (mgr.14640) 2589 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:00.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:58.835308+0000 mgr.smithi008.flmjzp (mgr.14640) 2590 : cluster [DBG] pgmap v1785: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:00.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:41:58.835589+0000 mgr.smithi008.flmjzp (mgr.14640) 2591 : cluster [DBG] pgmap v1786: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:00.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:41:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:41:58.857010+0000 mgr.smithi008.flmjzp (mgr.14640) 2592 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:58.803940+0000 mgr.smithi008.flmjzp (mgr.14640) 2588 : cluster [DBG] pgmap v1784: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:58.834691+0000 mgr.smithi008.flmjzp (mgr.14640) 2589 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:58.835308+0000 mgr.smithi008.flmjzp (mgr.14640) 2590 : cluster [DBG] pgmap v1785: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:41:58.835589+0000 mgr.smithi008.flmjzp (mgr.14640) 2591 : cluster [DBG] pgmap v1786: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:41:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:41:58.857010+0000 mgr.smithi008.flmjzp (mgr.14640) 2592 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:00.836102+0000 mgr.smithi008.flmjzp (mgr.14640) 2593 : cluster [DBG] pgmap v1787: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:01.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:00.836102+0000 mgr.smithi008.flmjzp (mgr.14640) 2593 : cluster [DBG] pgmap v1787: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:02.836761+0000 mgr.smithi008.flmjzp (mgr.14640) 2594 : cluster [DBG] pgmap v1788: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:04.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:02.836761+0000 mgr.smithi008.flmjzp (mgr.14640) 2594 : cluster [DBG] pgmap v1788: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:04.837546+0000 mgr.smithi008.flmjzp (mgr.14640) 2595 : cluster [DBG] pgmap v1789: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:06.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:04.837546+0000 mgr.smithi008.flmjzp (mgr.14640) 2595 : cluster [DBG] pgmap v1789: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:06.838045+0000 mgr.smithi008.flmjzp (mgr.14640) 2596 : cluster [DBG] pgmap v1790: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:08.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:06.838045+0000 mgr.smithi008.flmjzp (mgr.14640) 2596 : cluster [DBG] pgmap v1790: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:09.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:08.866101+0000 mon.smithi008 (mon.0) 3002 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:09.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:08.866101+0000 mon.smithi008 (mon.0) 3002 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:10.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:08.838763+0000 mgr.smithi008.flmjzp (mgr.14640) 2597 : cluster [DBG] pgmap v1791: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:10.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:09.217354+0000 mon.smithi008 (mon.0) 3003 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:10.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:09.424302+0000 mon.smithi008 (mon.0) 3004 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:42:10.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:09.425145+0000 mon.smithi008 (mon.0) 3005 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:42:10.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:09.430472+0000 mon.smithi008 (mon.0) 3006 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:10.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:09.435576+0000 mon.smithi008 (mon.0) 3007 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:10.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:09.438028+0000 mon.smithi008 (mon.0) 3008 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:10.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:09.439396+0000 mon.smithi008 (mon.0) 3009 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:10.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:09.440676+0000 mon.smithi008 (mon.0) 3010 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:10.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:09.442220+0000 mon.smithi008 (mon.0) 3011 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:10.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:08.838763+0000 mgr.smithi008.flmjzp (mgr.14640) 2597 : cluster [DBG] pgmap v1791: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:09.217354+0000 mon.smithi008 (mon.0) 3003 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:09.424302+0000 mon.smithi008 (mon.0) 3004 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:42:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:09.425145+0000 mon.smithi008 (mon.0) 3005 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:42:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:09.430472+0000 mon.smithi008 (mon.0) 3006 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:09.435576+0000 mon.smithi008 (mon.0) 3007 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:09.438028+0000 mon.smithi008 (mon.0) 3008 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:09.439396+0000 mon.smithi008 (mon.0) 3009 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:09.440676+0000 mon.smithi008 (mon.0) 3010 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:09.442220+0000 mon.smithi008 (mon.0) 3011 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:42:09.425793+0000 mgr.smithi008.flmjzp (mgr.14640) 2598 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:09.426323+0000 mgr.smithi008.flmjzp (mgr.14640) 2599 : cluster [DBG] pgmap v1792: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:09.426620+0000 mgr.smithi008.flmjzp (mgr.14640) 2600 : cluster [DBG] pgmap v1793: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:42:09.443767+0000 mgr.smithi008.flmjzp (mgr.14640) 2601 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:11.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:42:09.425793+0000 mgr.smithi008.flmjzp (mgr.14640) 2598 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:11.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:09.426323+0000 mgr.smithi008.flmjzp (mgr.14640) 2599 : cluster [DBG] pgmap v1792: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:11.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:09.426620+0000 mgr.smithi008.flmjzp (mgr.14640) 2600 : cluster [DBG] pgmap v1793: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:11.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:42:09.443767+0000 mgr.smithi008.flmjzp (mgr.14640) 2601 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:11.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.818+0000 7fe6f6301700 1 -- 172.21.15.8:0/3660935970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6f00f6530 msgr2=0x7fe6f00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.818+0000 7fe6f6301700 1 --2- 172.21.15.8:0/3660935970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6f00f6530 0x7fe6f00f6950 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fe6ec004660 tx=0x7fe6ec009b30).stop 2023-10-18T21:42:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.818+0000 7fe6f6301700 1 -- 172.21.15.8:0/3660935970 shutdown_connections 2023-10-18T21:42:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.818+0000 7fe6f6301700 1 --2- 172.21.15.8:0/3660935970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00f77d0 0x7fe6f00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.818+0000 7fe6f6301700 1 --2- 172.21.15.8:0/3660935970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6f00f6530 0x7fe6f00f6950 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.818+0000 7fe6f6301700 1 -- 172.21.15.8:0/3660935970 >> 172.21.15.8:0/3660935970 conn(0x7fe6f00f1c90 msgr2=0x7fe6f00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:11.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.818+0000 7fe6f6301700 1 -- 172.21.15.8:0/3660935970 shutdown_connections 2023-10-18T21:42:11.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.818+0000 7fe6f6301700 1 -- 172.21.15.8:0/3660935970 wait complete. 2023-10-18T21:42:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.819+0000 7fe6f6301700 1 Processor -- start 2023-10-18T21:42:11.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.820+0000 7fe6f6301700 1 -- start start 2023-10-18T21:42:11.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.820+0000 7fe6f6301700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6f00f6530 0x7fe6f0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:11.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.820+0000 7fe6f6301700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00f77d0 0x7fe6f0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:11.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.820+0000 7fe6f6301700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0107910 con 0x7fe6f00f6530 2023-10-18T21:42:11.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.820+0000 7fe6f6301700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0108120 con 0x7fe6f00f77d0 2023-10-18T21:42:11.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.820+0000 7fe6f52ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6f00f6530 0x7fe6f0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:11.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.820+0000 7fe6f52ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6f00f6530 0x7fe6f0106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43880/0 (socket says 172.21.15.8:43880) 2023-10-18T21:42:11.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.820+0000 7fe6f52ff700 1 -- 172.21.15.8:0/1842539342 learned_addr learned my addr 172.21.15.8:0/1842539342 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:11.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.821+0000 7fe6f4afe700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00f77d0 0x7fe6f0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:11.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.821+0000 7fe6f52ff700 1 -- 172.21.15.8:0/1842539342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00f77d0 msgr2=0x7fe6f0107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:11.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.821+0000 7fe6f52ff700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00f77d0 0x7fe6f0107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:11.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.821+0000 7fe6f52ff700 1 -- 172.21.15.8:0/1842539342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec005040 con 0x7fe6f00f6530 2023-10-18T21:42:11.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.821+0000 7fe6f52ff700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6f00f6530 0x7fe6f0106e20 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fe6ec004e30 tx=0x7fe6ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:11.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.821+0000 7fe6e5ffb700 1 -- 172.21.15.8:0/1842539342 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ec018070 con 0x7fe6f00f6530 2023-10-18T21:42:11.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.821+0000 7fe6e5ffb700 1 -- 172.21.15.8:0/1842539342 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe6ec009630 con 0x7fe6f00f6530 2023-10-18T21:42:11.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.821+0000 7fe6f6301700 1 -- 172.21.15.8:0/1842539342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f0108340 con 0x7fe6f00f6530 2023-10-18T21:42:11.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.821+0000 7fe6e5ffb700 1 -- 172.21.15.8:0/1842539342 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ec01c3c0 con 0x7fe6f00f6530 2023-10-18T21:42:11.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.822+0000 7fe6f6301700 1 -- 172.21.15.8:0/1842539342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f01088a0 con 0x7fe6f00f6530 2023-10-18T21:42:11.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.822+0000 7fe6f6301700 1 -- 172.21.15.8:0/1842539342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f0059100 con 0x7fe6f00f6530 2023-10-18T21:42:11.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.824+0000 7fe6e5ffb700 1 -- 172.21.15.8:0/1842539342 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe6ec01d420 con 0x7fe6f00f6530 2023-10-18T21:42:11.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.824+0000 7fe6e5ffb700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6dc060f70 0x7fe6dc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:11.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.824+0000 7fe6e5ffb700 1 -- 172.21.15.8:0/1842539342 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe6ec07e670 con 0x7fe6f00f6530 2023-10-18T21:42:11.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.825+0000 7fe6f4afe700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6dc060f70 0x7fe6dc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:11.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.825+0000 7fe6f4afe700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6dc060f70 0x7fe6dc063430 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fe6e00096c0 tx=0x7fe6e0009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:11.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:11.829+0000 7fe6e5ffb700 1 -- 172.21.15.8:0/1842539342 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe6ec04e310 con 0x7fe6f00f6530 2023-10-18T21:42:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.028+0000 7fe6f6301700 1 -- 172.21.15.8:0/1842539342 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6f00fedd0 con 0x7fe6dc060f70 2023-10-18T21:42:12.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.029+0000 7fe6e5ffb700 1 -- 172.21.15.8:0/1842539342 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe6f00fedd0 con 0x7fe6dc060f70 2023-10-18T21:42:12.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 -- 172.21.15.8:0/1842539342 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6dc060f70 msgr2=0x7fe6dc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6dc060f70 0x7fe6dc063430 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fe6e00096c0 tx=0x7fe6e0009be0).stop 2023-10-18T21:42:12.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 -- 172.21.15.8:0/1842539342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6f00f6530 msgr2=0x7fe6f0106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6f00f6530 0x7fe6f0106e20 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fe6ec004e30 tx=0x7fe6ec009b30).stop 2023-10-18T21:42:12.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 -- 172.21.15.8:0/1842539342 shutdown_connections 2023-10-18T21:42:12.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6dc060f70 0x7fe6dc063430 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6f00f6530 0x7fe6f0106e20 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 --2- 172.21.15.8:0/1842539342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00f77d0 0x7fe6f0107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 -- 172.21.15.8:0/1842539342 >> 172.21.15.8:0/1842539342 conn(0x7fe6f00f1c90 msgr2=0x7fe6f00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:12.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 -- 172.21.15.8:0/1842539342 shutdown_connections 2023-10-18T21:42:12.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.031+0000 7fe6f6301700 1 -- 172.21.15.8:0/1842539342 wait complete. 2023-10-18T21:42:12.048 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:42:12.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.168+0000 7f9efbfff700 1 -- 172.21.15.8:0/1335081968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9efc0f77d0 msgr2=0x7f9efc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.168+0000 7f9efbfff700 1 --2- 172.21.15.8:0/1335081968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9efc0f77d0 0x7f9efc0f7c30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f9ef0004660 tx=0x7f9ef0009b30).stop 2023-10-18T21:42:12.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.168+0000 7f9efbfff700 1 -- 172.21.15.8:0/1335081968 shutdown_connections 2023-10-18T21:42:12.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.168+0000 7f9efbfff700 1 --2- 172.21.15.8:0/1335081968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9efc0f77d0 0x7f9efc0f7c30 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.168+0000 7f9efbfff700 1 --2- 172.21.15.8:0/1335081968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9efc0f6530 0x7f9efc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.168+0000 7f9efbfff700 1 -- 172.21.15.8:0/1335081968 >> 172.21.15.8:0/1335081968 conn(0x7f9efc0f1c90 msgr2=0x7f9efc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:12.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.168+0000 7f9efbfff700 1 -- 172.21.15.8:0/1335081968 shutdown_connections 2023-10-18T21:42:12.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.168+0000 7f9efbfff700 1 -- 172.21.15.8:0/1335081968 wait complete. 2023-10-18T21:42:12.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.169+0000 7f9efbfff700 1 Processor -- start 2023-10-18T21:42:12.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.169+0000 7f9efbfff700 1 -- start start 2023-10-18T21:42:12.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.169+0000 7f9efbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9efc0f6530 0x7f9efc108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9efc0f77d0 0x7f9efc109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc109a20 con 0x7f9efc0f6530 2023-10-18T21:42:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc109b60 con 0x7f9efc0f77d0 2023-10-18T21:42:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9efc0f6530 0x7f9efc108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9efc0f6530 0x7f9efc108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43888/0 (socket says 172.21.15.8:43888) 2023-10-18T21:42:12.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efaffd700 1 -- 172.21.15.8:0/688489865 learned_addr learned my addr 172.21.15.8:0/688489865 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:12.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efa7fc700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9efc0f77d0 0x7f9efc109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:12.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efaffd700 1 -- 172.21.15.8:0/688489865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9efc0f77d0 msgr2=0x7f9efc109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efaffd700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9efc0f77d0 0x7f9efc109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efaffd700 1 -- 172.21.15.8:0/688489865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef0005040 con 0x7f9efc0f6530 2023-10-18T21:42:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efa7fc700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9efc0f77d0 0x7f9efc109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:42:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.170+0000 7f9efaffd700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9efc0f6530 0x7f9efc108f80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f9eec00c790 tx=0x7f9eec007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.171+0000 7f9ee37fe700 1 -- 172.21.15.8:0/688489865 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec00e680 con 0x7f9efc0f6530 2023-10-18T21:42:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.171+0000 7f9ee37fe700 1 -- 172.21.15.8:0/688489865 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9eec00eca0 con 0x7f9efc0f6530 2023-10-18T21:42:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.171+0000 7f9ee37fe700 1 -- 172.21.15.8:0/688489865 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec012d80 con 0x7f9efc0f6530 2023-10-18T21:42:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.171+0000 7f9efbfff700 1 -- 172.21.15.8:0/688489865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc10a500 con 0x7f9efc0f6530 2023-10-18T21:42:12.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.171+0000 7f9efbfff700 1 -- 172.21.15.8:0/688489865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc10aac0 con 0x7f9efc0f6530 2023-10-18T21:42:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.172+0000 7f9efbfff700 1 -- 172.21.15.8:0/688489865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc045ad0 con 0x7f9efc0f6530 2023-10-18T21:42:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.173+0000 7f9ee37fe700 1 -- 172.21.15.8:0/688489865 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9eec010070 con 0x7f9efc0f6530 2023-10-18T21:42:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.174+0000 7f9ee37fe700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 0x7f9ee4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.174+0000 7f9ee37fe700 1 -- 172.21.15.8:0/688489865 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9eec07c9d0 con 0x7f9efc0f6530 2023-10-18T21:42:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.174+0000 7f9efa7fc700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 0x7f9ee4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.174+0000 7f9efa7fc700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 0x7f9ee4063430 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f9ef0004630 tx=0x7f9ef0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.177+0000 7f9ee37fe700 1 -- 172.21.15.8:0/688489865 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9eec050030 con 0x7f9efc0f6530 2023-10-18T21:42:12.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.376+0000 7f9efbfff700 1 -- 172.21.15.8:0/688489865 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9efc0fee00 con 0x7f9ee4060f70 2023-10-18T21:42:12.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.377+0000 7f9ee37fe700 1 -- 172.21.15.8:0/688489865 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9efc0fee00 con 0x7f9ee4060f70 2023-10-18T21:42:12.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.379+0000 7f9efbfff700 1 -- 172.21.15.8:0/688489865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 msgr2=0x7f9ee4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.379+0000 7f9efbfff700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 0x7f9ee4063430 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f9ef0004630 tx=0x7f9ef0009b30).stop 2023-10-18T21:42:12.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.379+0000 7f9efbfff700 1 -- 172.21.15.8:0/688489865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9efc0f6530 msgr2=0x7f9efc108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.379+0000 7f9efbfff700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9efc0f6530 0x7f9efc108f80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f9eec00c790 tx=0x7f9eec007d90).stop 2023-10-18T21:42:12.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.379+0000 7f9efbfff700 1 -- 172.21.15.8:0/688489865 shutdown_connections 2023-10-18T21:42:12.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.379+0000 7f9efbfff700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9ee4060f70 0x7f9ee4063430 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.379+0000 7f9efbfff700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9efc0f6530 0x7f9efc108f80 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.379+0000 7f9efbfff700 1 --2- 172.21.15.8:0/688489865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9efc0f77d0 0x7f9efc109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.379+0000 7f9efbfff700 1 -- 172.21.15.8:0/688489865 >> 172.21.15.8:0/688489865 conn(0x7f9efc0f1c90 msgr2=0x7f9efc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:12.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.380+0000 7f9efbfff700 1 -- 172.21.15.8:0/688489865 shutdown_connections 2023-10-18T21:42:12.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.380+0000 7f9efbfff700 1 -- 172.21.15.8:0/688489865 wait complete. 2023-10-18T21:42:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.516+0000 7f290359e700 1 -- 172.21.15.8:0/1946132439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290406b940 msgr2=0x7f2904069e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.516+0000 7f290359e700 1 --2- 172.21.15.8:0/1946132439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290406b940 0x7f2904069e40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f28f4004660 tx=0x7f28f4009b30).stop 2023-10-18T21:42:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.516+0000 7f290359e700 1 -- 172.21.15.8:0/1946132439 shutdown_connections 2023-10-18T21:42:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.516+0000 7f290359e700 1 --2- 172.21.15.8:0/1946132439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f290406a330 0x7f290406a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.516+0000 7f290359e700 1 --2- 172.21.15.8:0/1946132439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290406b940 0x7f2904069e40 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.516+0000 7f290359e700 1 -- 172.21.15.8:0/1946132439 >> 172.21.15.8:0/1946132439 conn(0x7f29040f1c90 msgr2=0x7f29040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.516+0000 7f290359e700 1 -- 172.21.15.8:0/1946132439 shutdown_connections 2023-10-18T21:42:12.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.516+0000 7f290359e700 1 -- 172.21.15.8:0/1946132439 wait complete. 2023-10-18T21:42:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.517+0000 7f290359e700 1 Processor -- start 2023-10-18T21:42:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.517+0000 7f290359e700 1 -- start start 2023-10-18T21:42:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.517+0000 7f290359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f290406a330 0x7f2904108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.517+0000 7f290359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290406b940 0x7f29041093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.517+0000 7f290359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904109980 con 0x7f290406b940 2023-10-18T21:42:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.517+0000 7f290359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904109ac0 con 0x7f290406a330 2023-10-18T21:42:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.517+0000 7f2901d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290406b940 0x7f29041093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.517+0000 7f2901d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290406b940 0x7f29041093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43904/0 (socket says 172.21.15.8:43904) 2023-10-18T21:42:12.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.517+0000 7f2901d9b700 1 -- 172.21.15.8:0/2348467086 learned_addr learned my addr 172.21.15.8:0/2348467086 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.518+0000 7f290259c700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f290406a330 0x7f2904108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.518+0000 7f2901d9b700 1 -- 172.21.15.8:0/2348467086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f290406a330 msgr2=0x7f2904108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.518+0000 7f2901d9b700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f290406a330 0x7f2904108ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.518+0000 7f2901d9b700 1 -- 172.21.15.8:0/2348467086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f4005040 con 0x7f290406b940 2023-10-18T21:42:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.518+0000 7f2901d9b700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290406b940 0x7f29041093d0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f28f800e7f0 tx=0x7f28f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.518+0000 7f28f2ffd700 1 -- 172.21.15.8:0/2348467086 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28f80092e0 con 0x7f290406b940 2023-10-18T21:42:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.518+0000 7f28f2ffd700 1 -- 172.21.15.8:0/2348467086 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f28f800f040 con 0x7f290406b940 2023-10-18T21:42:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.518+0000 7f290359e700 1 -- 172.21.15.8:0/2348467086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290410a460 con 0x7f290406b940 2023-10-18T21:42:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.518+0000 7f28f2ffd700 1 -- 172.21.15.8:0/2348467086 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28f80147e0 con 0x7f290406b940 2023-10-18T21:42:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.518+0000 7f290359e700 1 -- 172.21.15.8:0/2348467086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290410a9a0 con 0x7f290406b940 2023-10-18T21:42:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.519+0000 7f290359e700 1 -- 172.21.15.8:0/2348467086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2904045ad0 con 0x7f290406b940 2023-10-18T21:42:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.520+0000 7f28f2ffd700 1 -- 172.21.15.8:0/2348467086 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f28f801b030 con 0x7f290406b940 2023-10-18T21:42:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.521+0000 7f28f2ffd700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28ec060f70 0x7f28ec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.521+0000 7f28f2ffd700 1 -- 172.21.15.8:0/2348467086 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f28f807c7c0 con 0x7f290406b940 2023-10-18T21:42:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.521+0000 7f290259c700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28ec060f70 0x7f28ec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.522+0000 7f290259c700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28ec060f70 0x7f28ec063430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f28f4009720 tx=0x7f28f4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.525+0000 7f28f2ffd700 1 -- 172.21.15.8:0/2348467086 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f28f804fe50 con 0x7f290406b940 2023-10-18T21:42:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.717+0000 7f290359e700 1 -- 172.21.15.8:0/2348467086 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f290410abc0 con 0x7f28ec060f70 2023-10-18T21:42:12.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.727+0000 7f28f2ffd700 1 -- 172.21.15.8:0/2348467086 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f290410abc0 con 0x7f28ec060f70 2023-10-18T21:42:12.729 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:42:12.729 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (48m) 6m ago 50m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:42:12.729 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (42m) 6m ago 50m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:42:12.730 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (42m) 4m ago 49m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:42:12.730 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (48m) 6m ago 50m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:42:12.730 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 46m - - 2023-10-18T21:42:12.730 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 46m - - 2023-10-18T21:42:12.730 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 46m - - 2023-10-18T21:42:12.731 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 46m - - 2023-10-18T21:42:12.731 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (44m) 6m ago 51m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:42:12.731 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (43m) 4m ago 49m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:42:12.731 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (43m) 6m ago 51m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:42:12.731 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (43m) 4m ago 49m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:42:12.731 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (49m) 6m ago 49m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:42:12.732 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (49m) 4m ago 49m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:42:12.732 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (42m) 6m ago 48m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:42:12.732 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (40m) 6m ago 48m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:42:12.732 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (39m) 6m ago 48m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:42:12.732 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (39m) 4m ago 48m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:42:12.733 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (38m) 4m ago 47m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:42:12.733 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (38m) 4m ago 47m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:42:12.733 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (44m) 6m ago 49m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:42:12.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 -- 172.21.15.8:0/2348467086 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28ec060f70 msgr2=0x7f28ec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28ec060f70 0x7f28ec063430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f28f4009720 tx=0x7f28f4016040).stop 2023-10-18T21:42:12.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 -- 172.21.15.8:0/2348467086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290406b940 msgr2=0x7f29041093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290406b940 0x7f29041093d0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f28f800e7f0 tx=0x7f28f800b040).stop 2023-10-18T21:42:12.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 -- 172.21.15.8:0/2348467086 shutdown_connections 2023-10-18T21:42:12.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28ec060f70 0x7f28ec063430 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f290406a330 0x7f2904108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 --2- 172.21.15.8:0/2348467086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290406b940 0x7f29041093d0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 -- 172.21.15.8:0/2348467086 >> 172.21.15.8:0/2348467086 conn(0x7f29040f1c90 msgr2=0x7f29040fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:12.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 -- 172.21.15.8:0/2348467086 shutdown_connections 2023-10-18T21:42:12.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.729+0000 7f290359e700 1 -- 172.21.15.8:0/2348467086 wait complete. 2023-10-18T21:42:12.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.865+0000 7fc1da06f700 1 -- 172.21.15.8:0/95003965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d40f77d0 msgr2=0x7fc1d40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.865+0000 7fc1da06f700 1 --2- 172.21.15.8:0/95003965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d40f77d0 0x7fc1d40f7c30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7fc1c4004660 tx=0x7fc1c4009b30).stop 2023-10-18T21:42:12.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.866+0000 7fc1da06f700 1 -- 172.21.15.8:0/95003965 shutdown_connections 2023-10-18T21:42:12.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.866+0000 7fc1da06f700 1 --2- 172.21.15.8:0/95003965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d40f77d0 0x7fc1d40f7c30 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.866+0000 7fc1da06f700 1 --2- 172.21.15.8:0/95003965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1d40f6530 0x7fc1d40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.866+0000 7fc1da06f700 1 -- 172.21.15.8:0/95003965 >> 172.21.15.8:0/95003965 conn(0x7fc1d40f1c90 msgr2=0x7fc1d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:12.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.866+0000 7fc1da06f700 1 -- 172.21.15.8:0/95003965 shutdown_connections 2023-10-18T21:42:12.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.866+0000 7fc1da06f700 1 -- 172.21.15.8:0/95003965 wait complete. 2023-10-18T21:42:12.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.866+0000 7fc1da06f700 1 Processor -- start 2023-10-18T21:42:12.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.867+0000 7fc1da06f700 1 -- start start 2023-10-18T21:42:12.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.867+0000 7fc1da06f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d40f6530 0x7fc1d4108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:12.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.867+0000 7fc1da06f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1d40f77d0 0x7fc1d4109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:12.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.867+0000 7fc1da06f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41099f0 con 0x7fc1d40f6530 2023-10-18T21:42:12.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.867+0000 7fc1da06f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d4109b30 con 0x7fc1d40f77d0 2023-10-18T21:42:12.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.867+0000 7fc1d906d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d40f6530 0x7fc1d4108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:12.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.867+0000 7fc1d906d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d40f6530 0x7fc1d4108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43914/0 (socket says 172.21.15.8:43914) 2023-10-18T21:42:12.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.867+0000 7fc1d906d700 1 -- 172.21.15.8:0/107371458 learned_addr learned my addr 172.21.15.8:0/107371458 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:12.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.868+0000 7fc1d886c700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1d40f77d0 0x7fc1d4109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:12.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.868+0000 7fc1d906d700 1 -- 172.21.15.8:0/107371458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1d40f77d0 msgr2=0x7fc1d4109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:12.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.868+0000 7fc1d906d700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1d40f77d0 0x7fc1d4109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:12.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.868+0000 7fc1d906d700 1 -- 172.21.15.8:0/107371458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c4005040 con 0x7fc1d40f6530 2023-10-18T21:42:12.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.868+0000 7fc1d906d700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d40f6530 0x7fc1d4108f50 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7fc1d0002700 tx=0x7fc1d0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:12.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.868+0000 7fc1c9ffb700 1 -- 172.21.15.8:0/107371458 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d00079c0 con 0x7fc1d40f6530 2023-10-18T21:42:12.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.868+0000 7fc1c9ffb700 1 -- 172.21.15.8:0/107371458 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc1d000f040 con 0x7fc1d40f6530 2023-10-18T21:42:12.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.868+0000 7fc1c9ffb700 1 -- 172.21.15.8:0/107371458 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d00148d0 con 0x7fc1d40f6530 2023-10-18T21:42:12.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.868+0000 7fc1da06f700 1 -- 172.21.15.8:0/107371458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d410a4d0 con 0x7fc1d40f6530 2023-10-18T21:42:12.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.868+0000 7fc1da06f700 1 -- 172.21.15.8:0/107371458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d410aa90 con 0x7fc1d40f6530 2023-10-18T21:42:12.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.869+0000 7fc1da06f700 1 -- 172.21.15.8:0/107371458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d4045ad0 con 0x7fc1d40f6530 2023-10-18T21:42:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.870+0000 7fc1c9ffb700 1 -- 172.21.15.8:0/107371458 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc1d001b060 con 0x7fc1d40f6530 2023-10-18T21:42:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.872+0000 7fc1c9ffb700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc1c0060f70 0x7fc1c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.872+0000 7fc1c9ffb700 1 -- 172.21.15.8:0/107371458 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc1d007c730 con 0x7fc1d40f6530 2023-10-18T21:42:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.872+0000 7fc1d886c700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc1c0060f70 0x7fc1c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:12.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.872+0000 7fc1d886c700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc1c0060f70 0x7fc1c0063430 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fc1c4004630 tx=0x7fc1c4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:12.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:12.876+0000 7fc1c9ffb700 1 -- 172.21.15.8:0/107371458 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc1d004fdd0 con 0x7fc1d40f6530 2023-10-18T21:42:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.131+0000 7fc1da06f700 1 -- 172.21.15.8:0/107371458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc1d4027a00 con 0x7fc1d40f6530 2023-10-18T21:42:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.131+0000 7fc1c9ffb700 1 -- 172.21.15.8:0/107371458 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fc1d004f9c0 con 0x7fc1d40f6530 2023-10-18T21:42:13.134 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:42:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:42:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:42:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:42:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:42:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:42:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:42:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:42:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:42:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:42:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:42:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:42:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:42:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:42:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:42:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:42:13.137 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:42:13.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.133+0000 7fc1da06f700 1 -- 172.21.15.8:0/107371458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc1c0060f70 msgr2=0x7fc1c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:13.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.133+0000 7fc1da06f700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc1c0060f70 0x7fc1c0063430 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fc1c4004630 tx=0x7fc1c4009b30).stop 2023-10-18T21:42:13.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.133+0000 7fc1da06f700 1 -- 172.21.15.8:0/107371458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d40f6530 msgr2=0x7fc1d4108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:13.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.133+0000 7fc1da06f700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d40f6530 0x7fc1d4108f50 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7fc1d0002700 tx=0x7fc1d0009d80).stop 2023-10-18T21:42:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.133+0000 7fc1da06f700 1 -- 172.21.15.8:0/107371458 shutdown_connections 2023-10-18T21:42:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.133+0000 7fc1da06f700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc1c0060f70 0x7fc1c0063430 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.133+0000 7fc1da06f700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d40f6530 0x7fc1d4108f50 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.133+0000 7fc1da06f700 1 --2- 172.21.15.8:0/107371458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1d40f77d0 0x7fc1d4109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.133+0000 7fc1da06f700 1 -- 172.21.15.8:0/107371458 >> 172.21.15.8:0/107371458 conn(0x7fc1d40f1c90 msgr2=0x7fc1d40f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:13.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.133+0000 7fc1da06f700 1 -- 172.21.15.8:0/107371458 shutdown_connections 2023-10-18T21:42:13.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.134+0000 7fc1da06f700 1 -- 172.21.15.8:0/107371458 wait complete. 2023-10-18T21:42:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:11.427133+0000 mgr.smithi008.flmjzp (mgr.14640) 2602 : cluster [DBG] pgmap v1794: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:12.030480+0000 mgr.smithi008.flmjzp (mgr.14640) 2603 : audit [DBG] from='client.36208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:13.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:11.427133+0000 mgr.smithi008.flmjzp (mgr.14640) 2602 : cluster [DBG] pgmap v1794: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:13.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:12.030480+0000 mgr.smithi008.flmjzp (mgr.14640) 2603 : audit [DBG] from='client.36208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:13.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.269+0000 7fedf359e700 1 -- 172.21.15.8:0/4247585161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedf40f6530 msgr2=0x7fedf40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:13.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.269+0000 7fedf359e700 1 --2- 172.21.15.8:0/4247585161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedf40f6530 0x7fedf40f6950 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fede4004660 tx=0x7fede4009b30).stop 2023-10-18T21:42:13.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.269+0000 7fedf359e700 1 -- 172.21.15.8:0/4247585161 shutdown_connections 2023-10-18T21:42:13.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.269+0000 7fedf359e700 1 --2- 172.21.15.8:0/4247585161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedf40f77d0 0x7fedf40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.269+0000 7fedf359e700 1 --2- 172.21.15.8:0/4247585161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedf40f6530 0x7fedf40f6950 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.269+0000 7fedf359e700 1 -- 172.21.15.8:0/4247585161 >> 172.21.15.8:0/4247585161 conn(0x7fedf40f1c90 msgr2=0x7fedf40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:13.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.269+0000 7fedf359e700 1 -- 172.21.15.8:0/4247585161 shutdown_connections 2023-10-18T21:42:13.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.269+0000 7fedf359e700 1 -- 172.21.15.8:0/4247585161 wait complete. 2023-10-18T21:42:13.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.270+0000 7fedf359e700 1 Processor -- start 2023-10-18T21:42:13.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.270+0000 7fedf359e700 1 -- start start 2023-10-18T21:42:13.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedf40f6530 0x7fedf4106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:13.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedf40f77d0 0x7fedf4107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:13.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4107900 con 0x7fedf40f77d0 2023-10-18T21:42:13.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4108110 con 0x7fedf40f6530 2023-10-18T21:42:13.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedf40f77d0 0x7fedf4107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:13.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedf40f77d0 0x7fedf4107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43934/0 (socket says 172.21.15.8:43934) 2023-10-18T21:42:13.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf1d9b700 1 -- 172.21.15.8:0/1971081652 learned_addr learned my addr 172.21.15.8:0/1971081652 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:13.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf259c700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedf40f6530 0x7fedf4106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf1d9b700 1 -- 172.21.15.8:0/1971081652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedf40f6530 msgr2=0x7fedf4106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf1d9b700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedf40f6530 0x7fedf4106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.271+0000 7fedf1d9b700 1 -- 172.21.15.8:0/1971081652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4005040 con 0x7fedf40f77d0 2023-10-18T21:42:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.272+0000 7fedf1d9b700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedf40f77d0 0x7fedf4107300 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fede80026d0 tx=0x7fede8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:13.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.272+0000 7fede2ffd700 1 -- 172.21.15.8:0/1971081652 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede80079c0 con 0x7fedf40f77d0 2023-10-18T21:42:13.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.272+0000 7fede2ffd700 1 -- 172.21.15.8:0/1971081652 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fede800f040 con 0x7fedf40f77d0 2023-10-18T21:42:13.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.272+0000 7fede2ffd700 1 -- 172.21.15.8:0/1971081652 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede8014980 con 0x7fedf40f77d0 2023-10-18T21:42:13.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.272+0000 7fedf359e700 1 -- 172.21.15.8:0/1971081652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf4108390 con 0x7fedf40f77d0 2023-10-18T21:42:13.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.272+0000 7fedf359e700 1 -- 172.21.15.8:0/1971081652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf4108950 con 0x7fedf40f77d0 2023-10-18T21:42:13.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.273+0000 7fedf359e700 1 -- 172.21.15.8:0/1971081652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf4059100 con 0x7fedf40f77d0 2023-10-18T21:42:13.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.274+0000 7fede2ffd700 1 -- 172.21.15.8:0/1971081652 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fede80090d0 con 0x7fedf40f77d0 2023-10-18T21:42:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.275+0000 7fede2ffd700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feddc060f70 0x7feddc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.275+0000 7fede2ffd700 1 -- 172.21.15.8:0/1971081652 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fede807c8a0 con 0x7fedf40f77d0 2023-10-18T21:42:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.275+0000 7fedf259c700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feddc060f70 0x7feddc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:13.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.276+0000 7fedf259c700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feddc060f70 0x7feddc063430 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fede4005010 tx=0x7fede4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:13.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.279+0000 7fede2ffd700 1 -- 172.21.15.8:0/1971081652 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fede804c580 con 0x7fedf40f77d0 2023-10-18T21:42:13.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.504+0000 7fedf359e700 1 -- 172.21.15.8:0/1971081652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fedf40008d0 con 0x7fedf40f77d0 2023-10-18T21:42:13.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.504+0000 7fede2ffd700 1 -- 172.21.15.8:0/1971081652 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fede804fba0 con 0x7fedf40f77d0 2023-10-18T21:42:13.507 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:42:13.507 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:42:13.507 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:42:13.508 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:42:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:42:13.508 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:42:13.508 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:42:13.508 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:42:13.509 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:42:13.509 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:42:13.509 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:42:13.509 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:42:13.509 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:42:13.509 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:42:13.510 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:42:13.510 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:42:13.510 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:42:13.510 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:42:13.511 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:42:13.511 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:42:13.511 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:42:13.511 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:42:13.512 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:42:13.512 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:42:13.512 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:42:13.512 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:42:13.512 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:42:13.513 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:42:13.513 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:42:13.513 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:42:13.513 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:42:13.513 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:42:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:42:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:42:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.506+0000 7fedf359e700 1 -- 172.21.15.8:0/1971081652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feddc060f70 msgr2=0x7feddc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.506+0000 7fedf359e700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feddc060f70 0x7feddc063430 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fede4005010 tx=0x7fede4009b30).stop 2023-10-18T21:42:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.506+0000 7fedf359e700 1 -- 172.21.15.8:0/1971081652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedf40f77d0 msgr2=0x7fedf4107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.506+0000 7fedf359e700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedf40f77d0 0x7fedf4107300 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fede80026d0 tx=0x7fede8009de0).stop 2023-10-18T21:42:13.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.506+0000 7fedf359e700 1 -- 172.21.15.8:0/1971081652 shutdown_connections 2023-10-18T21:42:13.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.507+0000 7fedf359e700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feddc060f70 0x7feddc063430 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.507+0000 7fedf359e700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedf40f6530 0x7fedf4106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.507+0000 7fedf359e700 1 --2- 172.21.15.8:0/1971081652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedf40f77d0 0x7fedf4107300 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.507+0000 7fedf359e700 1 -- 172.21.15.8:0/1971081652 >> 172.21.15.8:0/1971081652 conn(0x7fedf40f1c90 msgr2=0x7fedf40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:13.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.507+0000 7fedf359e700 1 -- 172.21.15.8:0/1971081652 shutdown_connections 2023-10-18T21:42:13.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.507+0000 7fedf359e700 1 -- 172.21.15.8:0/1971081652 wait complete. 2023-10-18T21:42:13.517 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:42:13.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.644+0000 7f8d7da44700 1 -- 172.21.15.8:0/3328632864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d780f77d0 msgr2=0x7f8d780f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:13.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.644+0000 7f8d7da44700 1 --2- 172.21.15.8:0/3328632864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d780f77d0 0x7f8d780f7c30 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f8d64004660 tx=0x7f8d64009b30).stop 2023-10-18T21:42:13.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.644+0000 7f8d7da44700 1 -- 172.21.15.8:0/3328632864 shutdown_connections 2023-10-18T21:42:13.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.644+0000 7f8d7da44700 1 --2- 172.21.15.8:0/3328632864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d780f77d0 0x7f8d780f7c30 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.644+0000 7f8d7da44700 1 --2- 172.21.15.8:0/3328632864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d780f6530 0x7f8d780f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.644+0000 7f8d7da44700 1 -- 172.21.15.8:0/3328632864 >> 172.21.15.8:0/3328632864 conn(0x7f8d780f1c90 msgr2=0x7f8d780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.644+0000 7f8d7da44700 1 -- 172.21.15.8:0/3328632864 shutdown_connections 2023-10-18T21:42:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.644+0000 7f8d7da44700 1 -- 172.21.15.8:0/3328632864 wait complete. 2023-10-18T21:42:13.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.645+0000 7f8d7da44700 1 Processor -- start 2023-10-18T21:42:13.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.646+0000 7f8d7da44700 1 -- start start 2023-10-18T21:42:13.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.646+0000 7f8d7da44700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d780f6530 0x7f8d78106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.646+0000 7f8d7da44700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d780f77d0 0x7f8d78107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.646+0000 7f8d7da44700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78107880 con 0x7f8d780f6530 2023-10-18T21:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.646+0000 7f8d7da44700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d781080c0 con 0x7f8d780f77d0 2023-10-18T21:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.646+0000 7f8d7ca42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d780f6530 0x7f8d78106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.646+0000 7f8d7ca42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d780f6530 0x7f8d78106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43950/0 (socket says 172.21.15.8:43950) 2023-10-18T21:42:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.646+0000 7f8d7ca42700 1 -- 172.21.15.8:0/2872509318 learned_addr learned my addr 172.21.15.8:0/2872509318 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.647+0000 7f8d77fff700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d780f77d0 0x7f8d78107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.647+0000 7f8d7ca42700 1 -- 172.21.15.8:0/2872509318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d780f77d0 msgr2=0x7f8d78107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.647+0000 7f8d7ca42700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d780f77d0 0x7f8d78107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.647+0000 7f8d7ca42700 1 -- 172.21.15.8:0/2872509318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64005040 con 0x7f8d780f6530 2023-10-18T21:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.647+0000 7f8d7ca42700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d780f6530 0x7f8d78106d90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f8d6c002700 tx=0x7f8d6c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.647+0000 7f8d757fa700 1 -- 172.21.15.8:0/2872509318 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6c0079c0 con 0x7f8d780f6530 2023-10-18T21:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.647+0000 7f8d7da44700 1 -- 172.21.15.8:0/2872509318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d781083a0 con 0x7f8d780f6530 2023-10-18T21:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.647+0000 7f8d757fa700 1 -- 172.21.15.8:0/2872509318 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8d6c00f040 con 0x7f8d780f6530 2023-10-18T21:42:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.647+0000 7f8d757fa700 1 -- 172.21.15.8:0/2872509318 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6c0148d0 con 0x7f8d780f6530 2023-10-18T21:42:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.648+0000 7f8d7da44700 1 -- 172.21.15.8:0/2872509318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d781088e0 con 0x7f8d780f6530 2023-10-18T21:42:13.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.649+0000 7f8d7da44700 1 -- 172.21.15.8:0/2872509318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d78059100 con 0x7f8d780f6530 2023-10-18T21:42:13.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.650+0000 7f8d757fa700 1 -- 172.21.15.8:0/2872509318 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8d6c01b060 con 0x7f8d780f6530 2023-10-18T21:42:13.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.650+0000 7f8d757fa700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d68060f70 0x7f8d68063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:13.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.650+0000 7f8d757fa700 1 -- 172.21.15.8:0/2872509318 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8d6c07c710 con 0x7f8d780f6530 2023-10-18T21:42:13.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.651+0000 7f8d77fff700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d68060f70 0x7f8d68063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:13.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.651+0000 7f8d77fff700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d68060f70 0x7f8d68063430 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f8d64004630 tx=0x7f8d64009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:13.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.655+0000 7f8d757fa700 1 -- 172.21.15.8:0/2872509318 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8d6c04c380 con 0x7f8d780f6530 2023-10-18T21:42:13.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.856+0000 7f8d7da44700 1 -- 172.21.15.8:0/2872509318 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d780fee30 con 0x7f8d68060f70 2023-10-18T21:42:13.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.858+0000 7f8d757fa700 1 -- 172.21.15.8:0/2872509318 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8d780fee30 con 0x7f8d68060f70 2023-10-18T21:42:13.860 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:42:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:42:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:42:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:42:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:42:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:42:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:42:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:42:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:42:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:42:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:42:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:42:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:42:13.862 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:42:13.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 -- 172.21.15.8:0/2872509318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d68060f70 msgr2=0x7f8d68063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:13.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d68060f70 0x7f8d68063430 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f8d64004630 tx=0x7f8d64009b30).stop 2023-10-18T21:42:13.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 -- 172.21.15.8:0/2872509318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d780f6530 msgr2=0x7f8d78106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d780f6530 0x7f8d78106d90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f8d6c002700 tx=0x7f8d6c009d80).stop 2023-10-18T21:42:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 -- 172.21.15.8:0/2872509318 shutdown_connections 2023-10-18T21:42:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d68060f70 0x7f8d68063430 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d780f6530 0x7f8d78106d90 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 --2- 172.21.15.8:0/2872509318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d780f77d0 0x7f8d78107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 -- 172.21.15.8:0/2872509318 >> 172.21.15.8:0/2872509318 conn(0x7f8d780f1c90 msgr2=0x7f8d780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 -- 172.21.15.8:0/2872509318 shutdown_connections 2023-10-18T21:42:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:13.860+0000 7f8d7da44700 1 -- 172.21.15.8:0/2872509318 wait complete. 2023-10-18T21:42:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:12.378776+0000 mgr.smithi008.flmjzp (mgr.14640) 2604 : audit [DBG] from='client.36212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:12.720101+0000 mgr.smithi008.flmjzp (mgr.14640) 2605 : audit [DBG] from='client.36216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:13.132967+0000 mon.smithi008 (mon.0) 3012 : audit [DBG] from='client.? 172.21.15.8:0/107371458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:14.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:13.506080+0000 mon.smithi008 (mon.0) 3013 : audit [DBG] from='client.? 172.21.15.8:0/1971081652' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:42:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:12.378776+0000 mgr.smithi008.flmjzp (mgr.14640) 2604 : audit [DBG] from='client.36212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:12.720101+0000 mgr.smithi008.flmjzp (mgr.14640) 2605 : audit [DBG] from='client.36216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:13.132967+0000 mon.smithi008 (mon.0) 3012 : audit [DBG] from='client.? 172.21.15.8:0/107371458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:13.506080+0000 mon.smithi008 (mon.0) 3013 : audit [DBG] from='client.? 172.21.15.8:0/1971081652' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:42:15.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:13.427587+0000 mgr.smithi008.flmjzp (mgr.14640) 2606 : cluster [DBG] pgmap v1795: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:15.177 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:13.859173+0000 mgr.smithi008.flmjzp (mgr.14640) 2607 : audit [DBG] from='client.36228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:13.427587+0000 mgr.smithi008.flmjzp (mgr.14640) 2606 : cluster [DBG] pgmap v1795: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:13.859173+0000 mgr.smithi008.flmjzp (mgr.14640) 2607 : audit [DBG] from='client.36228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:17.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:15.428129+0000 mgr.smithi008.flmjzp (mgr.14640) 2608 : cluster [DBG] pgmap v1796: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:15.428129+0000 mgr.smithi008.flmjzp (mgr.14640) 2608 : cluster [DBG] pgmap v1796: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:19.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:17.428610+0000 mgr.smithi008.flmjzp (mgr.14640) 2609 : cluster [DBG] pgmap v1797: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:17.428610+0000 mgr.smithi008.flmjzp (mgr.14640) 2609 : cluster [DBG] pgmap v1797: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:20.187 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:19.450408+0000 mon.smithi008 (mon.0) 3014 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:20.187 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:19.452611+0000 mon.smithi008 (mon.0) 3015 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:42:20.187 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:19.453671+0000 mon.smithi008 (mon.0) 3016 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:42:20.187 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:19.460343+0000 mon.smithi008 (mon.0) 3017 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:20.188 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:19.466866+0000 mon.smithi008 (mon.0) 3018 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:20.188 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:19.469942+0000 mon.smithi008 (mon.0) 3019 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:20.188 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:19.471643+0000 mon.smithi008 (mon.0) 3020 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:20.188 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:19.473281+0000 mon.smithi008 (mon.0) 3021 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:20.188 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:19.475279+0000 mon.smithi008 (mon.0) 3022 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:19.450408+0000 mon.smithi008 (mon.0) 3014 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:19.452611+0000 mon.smithi008 (mon.0) 3015 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:42:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:19.453671+0000 mon.smithi008 (mon.0) 3016 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:42:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:19.460343+0000 mon.smithi008 (mon.0) 3017 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:19.466866+0000 mon.smithi008 (mon.0) 3018 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:19.469942+0000 mon.smithi008 (mon.0) 3019 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:19.471643+0000 mon.smithi008 (mon.0) 3020 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:19.473281+0000 mon.smithi008 (mon.0) 3021 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:19.475279+0000 mon.smithi008 (mon.0) 3022 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:21.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:19.429302+0000 mgr.smithi008.flmjzp (mgr.14640) 2610 : cluster [DBG] pgmap v1798: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:21.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:42:19.454604+0000 mgr.smithi008.flmjzp (mgr.14640) 2611 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:21.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:19.455158+0000 mgr.smithi008.flmjzp (mgr.14640) 2612 : cluster [DBG] pgmap v1799: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:21.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:19.455527+0000 mgr.smithi008.flmjzp (mgr.14640) 2613 : cluster [DBG] pgmap v1800: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:21.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:42:19.477182+0000 mgr.smithi008.flmjzp (mgr.14640) 2614 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:19.429302+0000 mgr.smithi008.flmjzp (mgr.14640) 2610 : cluster [DBG] pgmap v1798: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:42:19.454604+0000 mgr.smithi008.flmjzp (mgr.14640) 2611 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:19.455158+0000 mgr.smithi008.flmjzp (mgr.14640) 2612 : cluster [DBG] pgmap v1799: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:19.455527+0000 mgr.smithi008.flmjzp (mgr.14640) 2613 : cluster [DBG] pgmap v1800: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:42:19.477182+0000 mgr.smithi008.flmjzp (mgr.14640) 2614 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:23.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:21.456075+0000 mgr.smithi008.flmjzp (mgr.14640) 2615 : cluster [DBG] pgmap v1801: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:21.456075+0000 mgr.smithi008.flmjzp (mgr.14640) 2615 : cluster [DBG] pgmap v1801: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:25.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:23.456643+0000 mgr.smithi008.flmjzp (mgr.14640) 2616 : cluster [DBG] pgmap v1802: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:23.456643+0000 mgr.smithi008.flmjzp (mgr.14640) 2616 : cluster [DBG] pgmap v1802: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:27.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:25.457228+0000 mgr.smithi008.flmjzp (mgr.14640) 2617 : cluster [DBG] pgmap v1803: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:25.457228+0000 mgr.smithi008.flmjzp (mgr.14640) 2617 : cluster [DBG] pgmap v1803: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:29.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:27.457755+0000 mgr.smithi008.flmjzp (mgr.14640) 2618 : cluster [DBG] pgmap v1804: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:27.457755+0000 mgr.smithi008.flmjzp (mgr.14640) 2618 : cluster [DBG] pgmap v1804: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:30.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:29.481824+0000 mon.smithi008 (mon.0) 3023 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:30.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:29.483969+0000 mon.smithi008 (mon.0) 3024 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:42:30.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:29.485037+0000 mon.smithi008 (mon.0) 3025 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:42:30.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:29.491572+0000 mon.smithi008 (mon.0) 3026 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:30.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:29.498028+0000 mon.smithi008 (mon.0) 3027 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:30.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:29.501119+0000 mon.smithi008 (mon.0) 3028 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:30.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:29.502850+0000 mon.smithi008 (mon.0) 3029 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:30.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:29.504490+0000 mon.smithi008 (mon.0) 3030 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:30.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:29.506516+0000 mon.smithi008 (mon.0) 3031 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:29.481824+0000 mon.smithi008 (mon.0) 3023 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:29.483969+0000 mon.smithi008 (mon.0) 3024 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:42:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:29.485037+0000 mon.smithi008 (mon.0) 3025 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:42:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:29.491572+0000 mon.smithi008 (mon.0) 3026 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:29.498028+0000 mon.smithi008 (mon.0) 3027 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:29.501119+0000 mon.smithi008 (mon.0) 3028 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:29.502850+0000 mon.smithi008 (mon.0) 3029 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:29.504490+0000 mon.smithi008 (mon.0) 3030 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:30.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:29.506516+0000 mon.smithi008 (mon.0) 3031 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:31.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:29.458529+0000 mgr.smithi008.flmjzp (mgr.14640) 2619 : cluster [DBG] pgmap v1805: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:42:29.485922+0000 mgr.smithi008.flmjzp (mgr.14640) 2620 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:29.486480+0000 mgr.smithi008.flmjzp (mgr.14640) 2621 : cluster [DBG] pgmap v1806: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:29.486829+0000 mgr.smithi008.flmjzp (mgr.14640) 2622 : cluster [DBG] pgmap v1807: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:42:29.508445+0000 mgr.smithi008.flmjzp (mgr.14640) 2623 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:29.458529+0000 mgr.smithi008.flmjzp (mgr.14640) 2619 : cluster [DBG] pgmap v1805: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:42:29.485922+0000 mgr.smithi008.flmjzp (mgr.14640) 2620 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:29.486480+0000 mgr.smithi008.flmjzp (mgr.14640) 2621 : cluster [DBG] pgmap v1806: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:29.486829+0000 mgr.smithi008.flmjzp (mgr.14640) 2622 : cluster [DBG] pgmap v1807: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:42:29.508445+0000 mgr.smithi008.flmjzp (mgr.14640) 2623 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:33.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:31.487378+0000 mgr.smithi008.flmjzp (mgr.14640) 2624 : cluster [DBG] pgmap v1808: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:31.487378+0000 mgr.smithi008.flmjzp (mgr.14640) 2624 : cluster [DBG] pgmap v1808: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:35.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:33.488073+0000 mgr.smithi008.flmjzp (mgr.14640) 2625 : cluster [DBG] pgmap v1809: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:33.488073+0000 mgr.smithi008.flmjzp (mgr.14640) 2625 : cluster [DBG] pgmap v1809: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:37.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:35.488595+0000 mgr.smithi008.flmjzp (mgr.14640) 2626 : cluster [DBG] pgmap v1810: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:35.488595+0000 mgr.smithi008.flmjzp (mgr.14640) 2626 : cluster [DBG] pgmap v1810: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:39.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:37.489129+0000 mgr.smithi008.flmjzp (mgr.14640) 2627 : cluster [DBG] pgmap v1811: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:37.489129+0000 mgr.smithi008.flmjzp (mgr.14640) 2627 : cluster [DBG] pgmap v1811: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:39.519061+0000 mon.smithi008 (mon.0) 3032 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:39.521236+0000 mon.smithi008 (mon.0) 3033 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:42:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:39.522282+0000 mon.smithi008 (mon.0) 3034 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:42:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:39.528899+0000 mon.smithi008 (mon.0) 3035 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:39.536419+0000 mon.smithi008 (mon.0) 3036 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:39.539519+0000 mon.smithi008 (mon.0) 3037 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:39.541191+0000 mon.smithi008 (mon.0) 3038 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:40.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:39.542935+0000 mon.smithi008 (mon.0) 3039 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:40.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:39.545064+0000 mon.smithi008 (mon.0) 3040 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:40.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:39.519061+0000 mon.smithi008 (mon.0) 3032 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:39.521236+0000 mon.smithi008 (mon.0) 3033 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:42:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:39.522282+0000 mon.smithi008 (mon.0) 3034 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:42:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:39.528899+0000 mon.smithi008 (mon.0) 3035 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:39.536419+0000 mon.smithi008 (mon.0) 3036 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:39.539519+0000 mon.smithi008 (mon.0) 3037 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:39.541191+0000 mon.smithi008 (mon.0) 3038 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:39.542935+0000 mon.smithi008 (mon.0) 3039 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:39.545064+0000 mon.smithi008 (mon.0) 3040 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:39.489631+0000 mgr.smithi008.flmjzp (mgr.14640) 2628 : cluster [DBG] pgmap v1812: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:42:39.523268+0000 mgr.smithi008.flmjzp (mgr.14640) 2629 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:39.523843+0000 mgr.smithi008.flmjzp (mgr.14640) 2630 : cluster [DBG] pgmap v1813: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:39.524345+0000 mgr.smithi008.flmjzp (mgr.14640) 2631 : cluster [DBG] pgmap v1814: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:42:39.547274+0000 mgr.smithi008.flmjzp (mgr.14640) 2632 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:39.489631+0000 mgr.smithi008.flmjzp (mgr.14640) 2628 : cluster [DBG] pgmap v1812: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:42:39.523268+0000 mgr.smithi008.flmjzp (mgr.14640) 2629 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:39.523843+0000 mgr.smithi008.flmjzp (mgr.14640) 2630 : cluster [DBG] pgmap v1813: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:39.524345+0000 mgr.smithi008.flmjzp (mgr.14640) 2631 : cluster [DBG] pgmap v1814: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:42:39.547274+0000 mgr.smithi008.flmjzp (mgr.14640) 2632 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:43.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:41.524916+0000 mgr.smithi008.flmjzp (mgr.14640) 2633 : cluster [DBG] pgmap v1815: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:43.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:41.524916+0000 mgr.smithi008.flmjzp (mgr.14640) 2633 : cluster [DBG] pgmap v1815: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:44.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.014+0000 7f756d295700 1 -- 172.21.15.8:0/4042386154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75680f6530 msgr2=0x7f75680f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.014+0000 7f756d295700 1 --2- 172.21.15.8:0/4042386154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75680f6530 0x7f75680f6950 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f7558004660 tx=0x7f7558009b30).stop 2023-10-18T21:42:44.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.014+0000 7f756d295700 1 -- 172.21.15.8:0/4042386154 shutdown_connections 2023-10-18T21:42:44.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.014+0000 7f756d295700 1 --2- 172.21.15.8:0/4042386154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75680f77d0 0x7f75680f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.014+0000 7f756d295700 1 --2- 172.21.15.8:0/4042386154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75680f6530 0x7f75680f6950 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.014+0000 7f756d295700 1 -- 172.21.15.8:0/4042386154 >> 172.21.15.8:0/4042386154 conn(0x7f75680f1c90 msgr2=0x7f75680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:44.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.014+0000 7f756d295700 1 -- 172.21.15.8:0/4042386154 shutdown_connections 2023-10-18T21:42:44.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.015+0000 7f756d295700 1 -- 172.21.15.8:0/4042386154 wait complete. 2023-10-18T21:42:44.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.015+0000 7f756d295700 1 Processor -- start 2023-10-18T21:42:44.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.016+0000 7f756d295700 1 -- start start 2023-10-18T21:42:44.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.016+0000 7f756d295700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75680f6530 0x7f7568108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:44.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.016+0000 7f756d295700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75680f77d0 0x7f7568109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:44.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.016+0000 7f756d295700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75681099f0 con 0x7f75680f6530 2023-10-18T21:42:44.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.016+0000 7f756d295700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7568109b30 con 0x7f75680f77d0 2023-10-18T21:42:44.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.016+0000 7f7567fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75680f6530 0x7f7568108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:44.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.016+0000 7f7567fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75680f6530 0x7f7568108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60020/0 (socket says 172.21.15.8:60020) 2023-10-18T21:42:44.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.016+0000 7f7567fff700 1 -- 172.21.15.8:0/515881527 learned_addr learned my addr 172.21.15.8:0/515881527 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:44.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.016+0000 7f75677fe700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75680f77d0 0x7f7568109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:44.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.017+0000 7f7567fff700 1 -- 172.21.15.8:0/515881527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75680f77d0 msgr2=0x7f7568109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.017+0000 7f7567fff700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75680f77d0 0x7f7568109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.017+0000 7f7567fff700 1 -- 172.21.15.8:0/515881527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558005040 con 0x7f75680f6530 2023-10-18T21:42:44.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.017+0000 7f7567fff700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75680f6530 0x7f7568108f50 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f7558009870 tx=0x7f755800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:44.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.017+0000 7f7564ff9700 1 -- 172.21.15.8:0/515881527 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7558019070 con 0x7f75680f6530 2023-10-18T21:42:44.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.017+0000 7f7564ff9700 1 -- 172.21.15.8:0/515881527 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7558013380 con 0x7f75680f6530 2023-10-18T21:42:44.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.017+0000 7f7564ff9700 1 -- 172.21.15.8:0/515881527 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755801edf0 con 0x7f75680f6530 2023-10-18T21:42:44.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.017+0000 7f756d295700 1 -- 172.21.15.8:0/515881527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756810a470 con 0x7f75680f6530 2023-10-18T21:42:44.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.017+0000 7f756d295700 1 -- 172.21.15.8:0/515881527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756810a950 con 0x7f75680f6530 2023-10-18T21:42:44.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.018+0000 7f756d295700 1 -- 172.21.15.8:0/515881527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7568045ad0 con 0x7f75680f6530 2023-10-18T21:42:44.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.019+0000 7f7564ff9700 1 -- 172.21.15.8:0/515881527 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f755801e420 con 0x7f75680f6530 2023-10-18T21:42:44.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.020+0000 7f7564ff9700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7550060f70 0x7f7550063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:44.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.020+0000 7f7564ff9700 1 -- 172.21.15.8:0/515881527 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f755807dd00 con 0x7f75680f6530 2023-10-18T21:42:44.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.021+0000 7f75677fe700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7550060f70 0x7f7550063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:44.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.021+0000 7f75677fe700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7550060f70 0x7f7550063430 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f755c009fd0 tx=0x7f755c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:44.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.025+0000 7f7564ff9700 1 -- 172.21.15.8:0/515881527 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7558051360 con 0x7f75680f6530 2023-10-18T21:42:44.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.222+0000 7f756d295700 1 -- 172.21.15.8:0/515881527 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f756810abc0 con 0x7f7550060f70 2023-10-18T21:42:44.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.223+0000 7f7564ff9700 1 -- 172.21.15.8:0/515881527 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f756810abc0 con 0x7f7550060f70 2023-10-18T21:42:44.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.225+0000 7f756d295700 1 -- 172.21.15.8:0/515881527 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7550060f70 msgr2=0x7f7550063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.225+0000 7f756d295700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7550060f70 0x7f7550063430 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f755c009fd0 tx=0x7f755c00b040).stop 2023-10-18T21:42:44.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.225+0000 7f756d295700 1 -- 172.21.15.8:0/515881527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75680f6530 msgr2=0x7f7568108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.225+0000 7f756d295700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75680f6530 0x7f7568108f50 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f7558009870 tx=0x7f755800b040).stop 2023-10-18T21:42:44.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.226+0000 7f756d295700 1 -- 172.21.15.8:0/515881527 shutdown_connections 2023-10-18T21:42:44.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.226+0000 7f756d295700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7550060f70 0x7f7550063430 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.226+0000 7f756d295700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75680f6530 0x7f7568108f50 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.226+0000 7f756d295700 1 --2- 172.21.15.8:0/515881527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75680f77d0 0x7f7568109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.226+0000 7f756d295700 1 -- 172.21.15.8:0/515881527 >> 172.21.15.8:0/515881527 conn(0x7f75680f1c90 msgr2=0x7f75680f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:44.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.226+0000 7f756d295700 1 -- 172.21.15.8:0/515881527 shutdown_connections 2023-10-18T21:42:44.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.226+0000 7f756d295700 1 -- 172.21.15.8:0/515881527 wait complete. 2023-10-18T21:42:44.242 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:42:44.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.364+0000 7f8f9b59e700 1 -- 172.21.15.8:0/2249818163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f9c0f77d0 msgr2=0x7f8f9c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.364+0000 7f8f9b59e700 1 --2- 172.21.15.8:0/2249818163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f9c0f77d0 0x7f8f9c0f7c30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f8f90004660 tx=0x7f8f90009b30).stop 2023-10-18T21:42:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.364+0000 7f8f9b59e700 1 -- 172.21.15.8:0/2249818163 shutdown_connections 2023-10-18T21:42:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.364+0000 7f8f9b59e700 1 --2- 172.21.15.8:0/2249818163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f9c0f77d0 0x7f8f9c0f7c30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.364+0000 7f8f9b59e700 1 --2- 172.21.15.8:0/2249818163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f9c0f6530 0x7f8f9c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.364+0000 7f8f9b59e700 1 -- 172.21.15.8:0/2249818163 >> 172.21.15.8:0/2249818163 conn(0x7f8f9c0f1c90 msgr2=0x7f8f9c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.364+0000 7f8f9b59e700 1 -- 172.21.15.8:0/2249818163 shutdown_connections 2023-10-18T21:42:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.364+0000 7f8f9b59e700 1 -- 172.21.15.8:0/2249818163 wait complete. 2023-10-18T21:42:44.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.365+0000 7f8f9b59e700 1 Processor -- start 2023-10-18T21:42:44.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.365+0000 7f8f9b59e700 1 -- start start 2023-10-18T21:42:44.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.365+0000 7f8f9b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f9c0f6530 0x7f8f9c108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:44.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.365+0000 7f8f9b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f9c0f77d0 0x7f8f9c109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:44.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.365+0000 7f8f9b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c1099c0 con 0x7f8f9c0f6530 2023-10-18T21:42:44.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.365+0000 7f8f9b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c109b00 con 0x7f8f9c0f77d0 2023-10-18T21:42:44.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f9a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f9c0f6530 0x7f8f9c108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:44.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f9a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f9c0f6530 0x7f8f9c108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60040/0 (socket says 172.21.15.8:60040) 2023-10-18T21:42:44.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f9a59c700 1 -- 172.21.15.8:0/3579934313 learned_addr learned my addr 172.21.15.8:0/3579934313 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:44.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f99d9b700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f9c0f77d0 0x7f8f9c109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:44.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f9a59c700 1 -- 172.21.15.8:0/3579934313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f9c0f77d0 msgr2=0x7f8f9c109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f9a59c700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f9c0f77d0 0x7f8f9c109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f9a59c700 1 -- 172.21.15.8:0/3579934313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90005040 con 0x7f8f9c0f6530 2023-10-18T21:42:44.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f9a59c700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f9c0f6530 0x7f8f9c108f20 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f8f8c00e7c0 tx=0x7f8f8c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:44.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f8affd700 1 -- 172.21.15.8:0/3579934313 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8c0092e0 con 0x7f8f9c0f6530 2023-10-18T21:42:44.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f8affd700 1 -- 172.21.15.8:0/3579934313 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8f8c00f040 con 0x7f8f9c0f6530 2023-10-18T21:42:44.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f9b59e700 1 -- 172.21.15.8:0/3579934313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c10a4a0 con 0x7f8f9c0f6530 2023-10-18T21:42:44.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.366+0000 7f8f8affd700 1 -- 172.21.15.8:0/3579934313 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8c0147e0 con 0x7f8f9c0f6530 2023-10-18T21:42:44.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.367+0000 7f8f9b59e700 1 -- 172.21.15.8:0/3579934313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9c10a9e0 con 0x7f8f9c0f6530 2023-10-18T21:42:44.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.368+0000 7f8f9b59e700 1 -- 172.21.15.8:0/3579934313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9c045ad0 con 0x7f8f9c0f6530 2023-10-18T21:42:44.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.369+0000 7f8f8affd700 1 -- 172.21.15.8:0/3579934313 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8f8c01b030 con 0x7f8f9c0f6530 2023-10-18T21:42:44.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.369+0000 7f8f8affd700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f84060f70 0x7f8f84063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:44.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.369+0000 7f8f8affd700 1 -- 172.21.15.8:0/3579934313 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8f8c07c9a0 con 0x7f8f9c0f6530 2023-10-18T21:42:44.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.370+0000 7f8f99d9b700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f84060f70 0x7f8f84063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:44.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.370+0000 7f8f99d9b700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f84060f70 0x7f8f84063430 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f8f90005010 tx=0x7f8f9000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:44.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.374+0000 7f8f8affd700 1 -- 172.21.15.8:0/3579934313 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8f8c050040 con 0x7f8f9c0f6530 2023-10-18T21:42:44.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.577+0000 7f8f9b59e700 1 -- 172.21.15.8:0/3579934313 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f9c10ac00 con 0x7f8f84060f70 2023-10-18T21:42:44.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.578+0000 7f8f8affd700 1 -- 172.21.15.8:0/3579934313 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8f9c10ac00 con 0x7f8f84060f70 2023-10-18T21:42:44.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.580+0000 7f8f9b59e700 1 -- 172.21.15.8:0/3579934313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f84060f70 msgr2=0x7f8f84063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.580+0000 7f8f9b59e700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f84060f70 0x7f8f84063430 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f8f90005010 tx=0x7f8f9000b040).stop 2023-10-18T21:42:44.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.580+0000 7f8f9b59e700 1 -- 172.21.15.8:0/3579934313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f9c0f6530 msgr2=0x7f8f9c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.580+0000 7f8f9b59e700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f9c0f6530 0x7f8f9c108f20 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f8f8c00e7c0 tx=0x7f8f8c00b040).stop 2023-10-18T21:42:44.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.580+0000 7f8f9b59e700 1 -- 172.21.15.8:0/3579934313 shutdown_connections 2023-10-18T21:42:44.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.580+0000 7f8f9b59e700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8f84060f70 0x7f8f84063430 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.580+0000 7f8f9b59e700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f9c0f6530 0x7f8f9c108f20 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.580+0000 7f8f9b59e700 1 --2- 172.21.15.8:0/3579934313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f9c0f77d0 0x7f8f9c109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.580+0000 7f8f9b59e700 1 -- 172.21.15.8:0/3579934313 >> 172.21.15.8:0/3579934313 conn(0x7f8f9c0f1c90 msgr2=0x7f8f9c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:44.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.581+0000 7f8f9b59e700 1 -- 172.21.15.8:0/3579934313 shutdown_connections 2023-10-18T21:42:44.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.581+0000 7f8f9b59e700 1 -- 172.21.15.8:0/3579934313 wait complete. 2023-10-18T21:42:44.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.717+0000 7fc2c34ee700 1 -- 172.21.15.8:0/2880938765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc0f77d0 msgr2=0x7fc2bc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.717+0000 7fc2c34ee700 1 --2- 172.21.15.8:0/2880938765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc0f77d0 0x7fc2bc0f7c30 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fc2ac004660 tx=0x7fc2ac009b30).stop 2023-10-18T21:42:44.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.717+0000 7fc2c34ee700 1 -- 172.21.15.8:0/2880938765 shutdown_connections 2023-10-18T21:42:44.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.717+0000 7fc2c34ee700 1 --2- 172.21.15.8:0/2880938765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc0f77d0 0x7fc2bc0f7c30 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.717+0000 7fc2c34ee700 1 --2- 172.21.15.8:0/2880938765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc0f6530 0x7fc2bc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.717+0000 7fc2c34ee700 1 -- 172.21.15.8:0/2880938765 >> 172.21.15.8:0/2880938765 conn(0x7fc2bc0f1c70 msgr2=0x7fc2bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:44.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.717+0000 7fc2c34ee700 1 -- 172.21.15.8:0/2880938765 shutdown_connections 2023-10-18T21:42:44.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.717+0000 7fc2c34ee700 1 -- 172.21.15.8:0/2880938765 wait complete. 2023-10-18T21:42:44.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.718+0000 7fc2c34ee700 1 Processor -- start 2023-10-18T21:42:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.718+0000 7fc2c34ee700 1 -- start start 2023-10-18T21:42:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c34ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc0f6530 0x7fc2bc108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c34ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc0f77d0 0x7fc2bc1093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c34ee700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc109990 con 0x7fc2bc0f6530 2023-10-18T21:42:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c34ee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc109ad0 con 0x7fc2bc0f77d0 2023-10-18T21:42:44.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c24ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc0f6530 0x7fc2bc108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:44.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c24ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc0f6530 0x7fc2bc108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60054/0 (socket says 172.21.15.8:60054) 2023-10-18T21:42:44.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c24ec700 1 -- 172.21.15.8:0/372613338 learned_addr learned my addr 172.21.15.8:0/372613338 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:44.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c1ceb700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc0f77d0 0x7fc2bc1093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:44.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c24ec700 1 -- 172.21.15.8:0/372613338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc0f77d0 msgr2=0x7fc2bc1093e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c24ec700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc0f77d0 0x7fc2bc1093e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c24ec700 1 -- 172.21.15.8:0/372613338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac005040 con 0x7fc2bc0f6530 2023-10-18T21:42:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.719+0000 7fc2c24ec700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc0f6530 0x7fc2bc108ef0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fc2b800e7c0 tx=0x7fc2b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.720+0000 7fc2b2ffd700 1 -- 172.21.15.8:0/372613338 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b80092e0 con 0x7fc2bc0f6530 2023-10-18T21:42:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.720+0000 7fc2b2ffd700 1 -- 172.21.15.8:0/372613338 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc2b800f040 con 0x7fc2bc0f6530 2023-10-18T21:42:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.720+0000 7fc2b2ffd700 1 -- 172.21.15.8:0/372613338 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b80147e0 con 0x7fc2bc0f6530 2023-10-18T21:42:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.720+0000 7fc2c34ee700 1 -- 172.21.15.8:0/372613338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2bc10a470 con 0x7fc2bc0f6530 2023-10-18T21:42:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.720+0000 7fc2c34ee700 1 -- 172.21.15.8:0/372613338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2bc10a9b0 con 0x7fc2bc0f6530 2023-10-18T21:42:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.721+0000 7fc2c34ee700 1 -- 172.21.15.8:0/372613338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2bc045ad0 con 0x7fc2bc0f6530 2023-10-18T21:42:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.722+0000 7fc2b2ffd700 1 -- 172.21.15.8:0/372613338 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc2b801b030 con 0x7fc2bc0f6530 2023-10-18T21:42:44.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.722+0000 7fc2b2ffd700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc2a8060f70 0x7fc2a8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:44.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.723+0000 7fc2b2ffd700 1 -- 172.21.15.8:0/372613338 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc2b807c8d0 con 0x7fc2bc0f6530 2023-10-18T21:42:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.723+0000 7fc2c1ceb700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc2a8060f70 0x7fc2a8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.723+0000 7fc2c1ceb700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc2a8060f70 0x7fc2a8063430 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fc2ac009720 tx=0x7fc2ac00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.727+0000 7fc2b2ffd700 1 -- 172.21.15.8:0/372613338 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc2b804ff10 con 0x7fc2bc0f6530 2023-10-18T21:42:44.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.920+0000 7fc2c34ee700 1 -- 172.21.15.8:0/372613338 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2bc10ac20 con 0x7fc2a8060f70 2023-10-18T21:42:44.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.930+0000 7fc2b2ffd700 1 -- 172.21.15.8:0/372613338 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc2bc10ac20 con 0x7fc2a8060f70 2023-10-18T21:42:44.932 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:42:44.932 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (49m) 7m ago 50m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:42:44.932 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (43m) 7m ago 50m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:42:44.933 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (43m) 5m ago 50m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:42:44.933 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (49m) 7m ago 50m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:42:44.933 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 46m - - 2023-10-18T21:42:44.933 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 46m - - 2023-10-18T21:42:44.933 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 46m - - 2023-10-18T21:42:44.934 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 46m - - 2023-10-18T21:42:44.934 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (44m) 7m ago 52m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:42:44.934 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (43m) 5m ago 49m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:42:44.934 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (43m) 7m ago 52m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:42:44.934 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (43m) 5m ago 49m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:42:44.935 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (50m) 7m ago 50m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:42:44.935 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (49m) 5m ago 49m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:42:44.935 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (42m) 7m ago 49m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:42:44.935 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (40m) 7m ago 49m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:42:44.935 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (40m) 7m ago 48m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:42:44.936 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (40m) 5m ago 48m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:42:44.936 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (39m) 5m ago 48m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:42:44.936 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (38m) 5m ago 48m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:42:44.936 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (44m) 7m ago 50m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:42:44.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 -- 172.21.15.8:0/372613338 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc2a8060f70 msgr2=0x7fc2a8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc2a8060f70 0x7fc2a8063430 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fc2ac009720 tx=0x7fc2ac00b040).stop 2023-10-18T21:42:44.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 -- 172.21.15.8:0/372613338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc0f6530 msgr2=0x7fc2bc108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:44.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc0f6530 0x7fc2bc108ef0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fc2b800e7c0 tx=0x7fc2b800b040).stop 2023-10-18T21:42:44.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 -- 172.21.15.8:0/372613338 shutdown_connections 2023-10-18T21:42:44.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc2a8060f70 0x7fc2a8063430 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc0f6530 0x7fc2bc108ef0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 --2- 172.21.15.8:0/372613338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc0f77d0 0x7fc2bc1093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:44.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 -- 172.21.15.8:0/372613338 >> 172.21.15.8:0/372613338 conn(0x7fc2bc0f1c70 msgr2=0x7fc2bc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:44.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 -- 172.21.15.8:0/372613338 shutdown_connections 2023-10-18T21:42:44.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:44.932+0000 7fc2c34ee700 1 -- 172.21.15.8:0/372613338 wait complete. 2023-10-18T21:42:45.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.068+0000 7fa5c72ca700 1 -- 172.21.15.8:0/1907355956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5c0060310 msgr2=0x7fa5c00f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:45.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.068+0000 7fa5c72ca700 1 --2- 172.21.15.8:0/1907355956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5c0060310 0x7fa5c00f9110 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fa5bc004660 tx=0x7fa5bc009b30).stop 2023-10-18T21:42:45.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.068+0000 7fa5c72ca700 1 -- 172.21.15.8:0/1907355956 shutdown_connections 2023-10-18T21:42:45.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.068+0000 7fa5c72ca700 1 --2- 172.21.15.8:0/1907355956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c00f9690 0x7fa5c00fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.068+0000 7fa5c72ca700 1 --2- 172.21.15.8:0/1907355956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5c0060310 0x7fa5c00f9110 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.068+0000 7fa5c72ca700 1 -- 172.21.15.8:0/1907355956 >> 172.21.15.8:0/1907355956 conn(0x7fa5c00f0b90 msgr2=0x7fa5c00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:45.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.068+0000 7fa5c72ca700 1 -- 172.21.15.8:0/1907355956 shutdown_connections 2023-10-18T21:42:45.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.068+0000 7fa5c72ca700 1 -- 172.21.15.8:0/1907355956 wait complete. 2023-10-18T21:42:45.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.069+0000 7fa5c72ca700 1 Processor -- start 2023-10-18T21:42:45.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.069+0000 7fa5c72ca700 1 -- start start 2023-10-18T21:42:45.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c72ca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c0060310 0x7fa5c0108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:45.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c72ca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5c00f9690 0x7fa5c0109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:45.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c72ca700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0109a30 con 0x7fa5c00f9690 2023-10-18T21:42:45.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c72ca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0109b70 con 0x7fa5c0060310 2023-10-18T21:42:45.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c5ac7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5c00f9690 0x7fa5c0109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:45.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c5ac7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5c00f9690 0x7fa5c0109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60076/0 (socket says 172.21.15.8:60076) 2023-10-18T21:42:45.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c5ac7700 1 -- 172.21.15.8:0/2106736586 learned_addr learned my addr 172.21.15.8:0/2106736586 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:45.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c62c8700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c0060310 0x7fa5c0108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:45.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c5ac7700 1 -- 172.21.15.8:0/2106736586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c0060310 msgr2=0x7fa5c0108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:45.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c5ac7700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c0060310 0x7fa5c0108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c5ac7700 1 -- 172.21.15.8:0/2106736586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc005040 con 0x7fa5c00f9690 2023-10-18T21:42:45.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.070+0000 7fa5c62c8700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c0060310 0x7fa5c0108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:42:45.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.071+0000 7fa5c5ac7700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5c00f9690 0x7fa5c0109480 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fa5b0002700 tx=0x7fa5b0009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:45.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.071+0000 7fa5b6ffd700 1 -- 172.21.15.8:0/2106736586 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b0009320 con 0x7fa5c00f9690 2023-10-18T21:42:45.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.071+0000 7fa5b6ffd700 1 -- 172.21.15.8:0/2106736586 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa5b000f040 con 0x7fa5c00f9690 2023-10-18T21:42:45.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.071+0000 7fa5c72ca700 1 -- 172.21.15.8:0/2106736586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c010a510 con 0x7fa5c00f9690 2023-10-18T21:42:45.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.071+0000 7fa5b6ffd700 1 -- 172.21.15.8:0/2106736586 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b0014860 con 0x7fa5c00f9690 2023-10-18T21:42:45.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.071+0000 7fa5c72ca700 1 -- 172.21.15.8:0/2106736586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c010aad0 con 0x7fa5c00f9690 2023-10-18T21:42:45.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.072+0000 7fa5c72ca700 1 -- 172.21.15.8:0/2106736586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c0045ad0 con 0x7fa5c00f9690 2023-10-18T21:42:45.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.073+0000 7fa5b6ffd700 1 -- 172.21.15.8:0/2106736586 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa5b00077b0 con 0x7fa5c00f9690 2023-10-18T21:42:45.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.074+0000 7fa5b6ffd700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5ac060f70 0x7fa5ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:45.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.074+0000 7fa5b6ffd700 1 -- 172.21.15.8:0/2106736586 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa5b007cfa0 con 0x7fa5c00f9690 2023-10-18T21:42:45.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.074+0000 7fa5c62c8700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5ac060f70 0x7fa5ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:45.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.075+0000 7fa5c62c8700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5ac060f70 0x7fa5ac063430 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fa5bc005010 tx=0x7fa5bc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:45.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.078+0000 7fa5b6ffd700 1 -- 172.21.15.8:0/2106736586 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa5b0050580 con 0x7fa5c00f9690 2023-10-18T21:42:45.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.331+0000 7fa5c72ca700 1 -- 172.21.15.8:0/2106736586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5c010f5b0 con 0x7fa5c00f9690 2023-10-18T21:42:45.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.332+0000 7fa5b6ffd700 1 -- 172.21.15.8:0/2106736586 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fa5b00181b0 con 0x7fa5c00f9690 2023-10-18T21:42:45.335 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:42:45.335 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:42:45.335 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:42:45.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:42:45.335 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:42:45.336 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:42:45.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:42:45.336 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:42:45.337 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:42:45.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:42:45.337 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:42:45.337 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:42:45.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:42:45.338 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:42:45.338 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:42:45.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:42:45.338 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:42:45.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 -- 172.21.15.8:0/2106736586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5ac060f70 msgr2=0x7fa5ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:45.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5ac060f70 0x7fa5ac063430 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fa5bc005010 tx=0x7fa5bc009b30).stop 2023-10-18T21:42:45.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 -- 172.21.15.8:0/2106736586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5c00f9690 msgr2=0x7fa5c0109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:45.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5c00f9690 0x7fa5c0109480 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fa5b0002700 tx=0x7fa5b0009d60).stop 2023-10-18T21:42:45.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 -- 172.21.15.8:0/2106736586 shutdown_connections 2023-10-18T21:42:45.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5ac060f70 0x7fa5ac063430 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c0060310 0x7fa5c0108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 --2- 172.21.15.8:0/2106736586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5c00f9690 0x7fa5c0109480 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 -- 172.21.15.8:0/2106736586 >> 172.21.15.8:0/2106736586 conn(0x7fa5c00f0b90 msgr2=0x7fa5c00f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:45.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 -- 172.21.15.8:0/2106736586 shutdown_connections 2023-10-18T21:42:45.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.334+0000 7fa5c72ca700 1 -- 172.21.15.8:0/2106736586 wait complete. 2023-10-18T21:42:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:43.525771+0000 mgr.smithi008.flmjzp (mgr.14640) 2634 : cluster [DBG] pgmap v1816: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:45.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.470+0000 7f5f873b6700 1 -- 172.21.15.8:0/3239161057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8006b9c0 msgr2=0x7f5f80069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:45.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.470+0000 7f5f873b6700 1 --2- 172.21.15.8:0/3239161057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8006b9c0 0x7f5f80069ec0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f5f7c004660 tx=0x7f5f7c009b30).stop 2023-10-18T21:42:45.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.470+0000 7f5f873b6700 1 -- 172.21.15.8:0/3239161057 shutdown_connections 2023-10-18T21:42:45.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.470+0000 7f5f873b6700 1 --2- 172.21.15.8:0/3239161057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8006a3b0 0x7f5f8006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.470+0000 7f5f873b6700 1 --2- 172.21.15.8:0/3239161057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8006b9c0 0x7f5f80069ec0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.470+0000 7f5f873b6700 1 -- 172.21.15.8:0/3239161057 >> 172.21.15.8:0/3239161057 conn(0x7f5f800f1c90 msgr2=0x7f5f800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:45.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.470+0000 7f5f873b6700 1 -- 172.21.15.8:0/3239161057 shutdown_connections 2023-10-18T21:42:45.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.470+0000 7f5f873b6700 1 -- 172.21.15.8:0/3239161057 wait complete. 2023-10-18T21:42:45.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.471+0000 7f5f873b6700 1 Processor -- start 2023-10-18T21:42:45.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.471+0000 7f5f873b6700 1 -- start start 2023-10-18T21:42:45.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f873b6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8006a3b0 0x7f5f80108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:45.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f873b6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8006b9c0 0x7f5f801094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:45.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f873b6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80109a50 con 0x7f5f8006a3b0 2023-10-18T21:42:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f873b6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80109b90 con 0x7f5f8006b9c0 2023-10-18T21:42:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f863b4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8006a3b0 0x7f5f80108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f863b4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8006a3b0 0x7f5f80108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60088/0 (socket says 172.21.15.8:60088) 2023-10-18T21:42:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f863b4700 1 -- 172.21.15.8:0/3923135093 learned_addr learned my addr 172.21.15.8:0/3923135093 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:45.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f85bb3700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8006b9c0 0x7f5f801094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:45.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f863b4700 1 -- 172.21.15.8:0/3923135093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8006b9c0 msgr2=0x7f5f801094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:45.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f863b4700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8006b9c0 0x7f5f801094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.472+0000 7f5f863b4700 1 -- 172.21.15.8:0/3923135093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c005040 con 0x7f5f8006a3b0 2023-10-18T21:42:45.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.473+0000 7f5f863b4700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8006a3b0 0x7f5f80108fb0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f5f7c009f50 tx=0x7f5f7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:45.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.473+0000 7f5f76ffd700 1 -- 172.21.15.8:0/3923135093 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7c018070 con 0x7f5f8006a3b0 2023-10-18T21:42:45.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.473+0000 7f5f76ffd700 1 -- 172.21.15.8:0/3923135093 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5f7c009630 con 0x7f5f8006a3b0 2023-10-18T21:42:45.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.473+0000 7f5f873b6700 1 -- 172.21.15.8:0/3923135093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8010a4d0 con 0x7f5f8006a3b0 2023-10-18T21:42:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.473+0000 7f5f76ffd700 1 -- 172.21.15.8:0/3923135093 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7c01c3c0 con 0x7f5f8006a3b0 2023-10-18T21:42:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.473+0000 7f5f873b6700 1 -- 172.21.15.8:0/3923135093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8010aa30 con 0x7f5f8006a3b0 2023-10-18T21:42:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.474+0000 7f5f873b6700 1 -- 172.21.15.8:0/3923135093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f80045ad0 con 0x7f5f8006a3b0 2023-10-18T21:42:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.475+0000 7f5f76ffd700 1 -- 172.21.15.8:0/3923135093 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5f7c01d420 con 0x7f5f8006a3b0 2023-10-18T21:42:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.476+0000 7f5f76ffd700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f6c060f70 0x7f5f6c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:45.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.476+0000 7f5f76ffd700 1 -- 172.21.15.8:0/3923135093 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5f7c07e480 con 0x7f5f8006a3b0 2023-10-18T21:42:45.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.476+0000 7f5f85bb3700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f6c060f70 0x7f5f6c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:45.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.477+0000 7f5f85bb3700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f6c060f70 0x7f5f6c063430 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f5f70004c40 tx=0x7f5f7000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:45.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.480+0000 7f5f76ffd700 1 -- 172.21.15.8:0/3923135093 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5f7c051ba0 con 0x7f5f8006a3b0 2023-10-18T21:42:45.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:43.525771+0000 mgr.smithi008.flmjzp (mgr.14640) 2634 : cluster [DBG] pgmap v1816: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:45.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.706+0000 7f5f873b6700 1 -- 172.21.15.8:0/3923135093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5f80100f80 con 0x7f5f8006a3b0 2023-10-18T21:42:45.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.706+0000 7f5f76ffd700 1 -- 172.21.15.8:0/3923135093 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f5f7c051790 con 0x7f5f8006a3b0 2023-10-18T21:42:45.709 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:42:45.709 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:42:45.709 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:42:45.710 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:42:45.710 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:42:45.710 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:42:45.711 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:42:45.711 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:42:45.711 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:42:45.711 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:42:45.711 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:42:45.712 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:42:45.712 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:42:45.712 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:42:45.712 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:42:45.713 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:42:45.713 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:42:45.713 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:42:45.713 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:42:45.714 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:42:45.714 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:42:45.714 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:42:45.714 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:42:45.715 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:42:45.715 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:42:45.715 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:42:45.715 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:42:45.716 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:42:45.716 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:42:45.716 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:42:45.716 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:42:45.717 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:42:45.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:42:45.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:42:45.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.708+0000 7f5f873b6700 1 -- 172.21.15.8:0/3923135093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f6c060f70 msgr2=0x7f5f6c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:45.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.708+0000 7f5f873b6700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f6c060f70 0x7f5f6c063430 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f5f70004c40 tx=0x7f5f7000b040).stop 2023-10-18T21:42:45.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.708+0000 7f5f873b6700 1 -- 172.21.15.8:0/3923135093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8006a3b0 msgr2=0x7f5f80108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:45.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.708+0000 7f5f873b6700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8006a3b0 0x7f5f80108fb0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f5f7c009f50 tx=0x7f5f7c009b30).stop 2023-10-18T21:42:45.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.708+0000 7f5f873b6700 1 -- 172.21.15.8:0/3923135093 shutdown_connections 2023-10-18T21:42:45.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.708+0000 7f5f873b6700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f6c060f70 0x7f5f6c063430 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.708+0000 7f5f873b6700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8006a3b0 0x7f5f80108fb0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.708+0000 7f5f873b6700 1 --2- 172.21.15.8:0/3923135093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8006b9c0 0x7f5f801094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.708+0000 7f5f873b6700 1 -- 172.21.15.8:0/3923135093 >> 172.21.15.8:0/3923135093 conn(0x7f5f800f1c90 msgr2=0x7f5f800fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:45.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.709+0000 7f5f873b6700 1 -- 172.21.15.8:0/3923135093 shutdown_connections 2023-10-18T21:42:45.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.709+0000 7f5f873b6700 1 -- 172.21.15.8:0/3923135093 wait complete. 2023-10-18T21:42:45.721 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:42:45.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.847+0000 7f1c367f6700 1 -- 172.21.15.8:0/3114342997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c300f77d0 msgr2=0x7f1c300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:45.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.847+0000 7f1c367f6700 1 --2- 172.21.15.8:0/3114342997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c300f77d0 0x7f1c300f7c30 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f1c20004660 tx=0x7f1c20009b30).stop 2023-10-18T21:42:45.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.847+0000 7f1c367f6700 1 -- 172.21.15.8:0/3114342997 shutdown_connections 2023-10-18T21:42:45.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.847+0000 7f1c367f6700 1 --2- 172.21.15.8:0/3114342997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c300f77d0 0x7f1c300f7c30 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.847+0000 7f1c367f6700 1 --2- 172.21.15.8:0/3114342997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c300f6530 0x7f1c300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.847+0000 7f1c367f6700 1 -- 172.21.15.8:0/3114342997 >> 172.21.15.8:0/3114342997 conn(0x7f1c300f1c90 msgr2=0x7f1c300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:45.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.847+0000 7f1c367f6700 1 -- 172.21.15.8:0/3114342997 shutdown_connections 2023-10-18T21:42:45.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.847+0000 7f1c367f6700 1 -- 172.21.15.8:0/3114342997 wait complete. 2023-10-18T21:42:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.848+0000 7f1c367f6700 1 Processor -- start 2023-10-18T21:42:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.848+0000 7f1c367f6700 1 -- start start 2023-10-18T21:42:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c367f6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c300f6530 0x7f1c3006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c367f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c300f77d0 0x7f1c30069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c367f6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3006a380 con 0x7f1c300f77d0 2023-10-18T21:42:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c367f6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3006a4c0 con 0x7f1c300f6530 2023-10-18T21:42:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c34ff3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c300f77d0 0x7f1c30069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c34ff3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c300f77d0 0x7f1c30069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60108/0 (socket says 172.21.15.8:60108) 2023-10-18T21:42:45.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c34ff3700 1 -- 172.21.15.8:0/3021969989 learned_addr learned my addr 172.21.15.8:0/3021969989 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:42:45.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c357f4700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c300f6530 0x7f1c3006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:45.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c34ff3700 1 -- 172.21.15.8:0/3021969989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c300f6530 msgr2=0x7f1c3006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:45.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c34ff3700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c300f6530 0x7f1c3006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:45.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c34ff3700 1 -- 172.21.15.8:0/3021969989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20005040 con 0x7f1c300f77d0 2023-10-18T21:42:45.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.849+0000 7f1c357f4700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c300f6530 0x7f1c3006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:42:45.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.850+0000 7f1c34ff3700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c300f77d0 0x7f1c30069e20 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f1c20009f50 tx=0x7f1c20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:45.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.850+0000 7f1c25ffb700 1 -- 172.21.15.8:0/3021969989 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c20018070 con 0x7f1c300f77d0 2023-10-18T21:42:45.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.850+0000 7f1c25ffb700 1 -- 172.21.15.8:0/3021969989 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1c20009630 con 0x7f1c300f77d0 2023-10-18T21:42:45.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.850+0000 7f1c367f6700 1 -- 172.21.15.8:0/3021969989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3006a740 con 0x7f1c300f77d0 2023-10-18T21:42:45.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.850+0000 7f1c25ffb700 1 -- 172.21.15.8:0/3021969989 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c2001c3c0 con 0x7f1c300f77d0 2023-10-18T21:42:45.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.850+0000 7f1c367f6700 1 -- 172.21.15.8:0/3021969989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3006aca0 con 0x7f1c300f77d0 2023-10-18T21:42:45.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.851+0000 7f1c367f6700 1 -- 172.21.15.8:0/3021969989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c30045ad0 con 0x7f1c300f77d0 2023-10-18T21:42:45.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.852+0000 7f1c25ffb700 1 -- 172.21.15.8:0/3021969989 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1c2001d420 con 0x7f1c300f77d0 2023-10-18T21:42:45.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.853+0000 7f1c25ffb700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c1c060f70 0x7f1c1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:42:45.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.853+0000 7f1c25ffb700 1 -- 172.21.15.8:0/3021969989 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1c2007e650 con 0x7f1c300f77d0 2023-10-18T21:42:45.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.853+0000 7f1c357f4700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c1c060f70 0x7f1c1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:42:45.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.854+0000 7f1c357f4700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c1c060f70 0x7f1c1c063430 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f1c3006b730 tx=0x7f1c2c009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:42:45.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:45.857+0000 7f1c25ffb700 1 -- 172.21.15.8:0/3021969989 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1c2004e2c0 con 0x7f1c300f77d0 2023-10-18T21:42:46.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.060+0000 7f1c367f6700 1 -- 172.21.15.8:0/3021969989 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c300fedd0 con 0x7f1c1c060f70 2023-10-18T21:42:46.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.062+0000 7f1c25ffb700 1 -- 172.21.15.8:0/3021969989 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1c300fedd0 con 0x7f1c1c060f70 2023-10-18T21:42:46.064 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:42:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:42:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:42:46.064 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:42:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:42:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:42:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:42:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:42:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:42:46.065 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:42:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:42:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:42:46.066 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:42:46.066 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:42:46.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 -- 172.21.15.8:0/3021969989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c1c060f70 msgr2=0x7f1c1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:46.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c1c060f70 0x7f1c1c063430 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f1c3006b730 tx=0x7f1c2c009c00).stop 2023-10-18T21:42:46.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 -- 172.21.15.8:0/3021969989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c300f77d0 msgr2=0x7f1c30069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:42:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c300f77d0 0x7f1c30069e20 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f1c20009f50 tx=0x7f1c20009b30).stop 2023-10-18T21:42:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 -- 172.21.15.8:0/3021969989 shutdown_connections 2023-10-18T21:42:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c1c060f70 0x7f1c1c063430 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c300f6530 0x7f1c3006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:46.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 --2- 172.21.15.8:0/3021969989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c300f77d0 0x7f1c30069e20 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:42:46.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 -- 172.21.15.8:0/3021969989 >> 172.21.15.8:0/3021969989 conn(0x7f1c300f1c90 msgr2=0x7f1c300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:42:46.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 -- 172.21.15.8:0/3021969989 shutdown_connections 2023-10-18T21:42:46.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:42:46.064+0000 7f1c367f6700 1 -- 172.21.15.8:0/3021969989 wait complete. 2023-10-18T21:42:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:44.224790+0000 mgr.smithi008.flmjzp (mgr.14640) 2635 : audit [DBG] from='client.36232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:44.579765+0000 mgr.smithi008.flmjzp (mgr.14640) 2636 : audit [DBG] from='client.36236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:44.922958+0000 mgr.smithi008.flmjzp (mgr.14640) 2637 : audit [DBG] from='client.36240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:45.333441+0000 mon.smithi008 (mon.0) 3041 : audit [DBG] from='client.? 172.21.15.8:0/2106736586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:45.708005+0000 mon.smithi008 (mon.0) 3042 : audit [DBG] from='client.? 172.21.15.8:0/3923135093' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:42:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:44.224790+0000 mgr.smithi008.flmjzp (mgr.14640) 2635 : audit [DBG] from='client.36232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:44.579765+0000 mgr.smithi008.flmjzp (mgr.14640) 2636 : audit [DBG] from='client.36236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:44.922958+0000 mgr.smithi008.flmjzp (mgr.14640) 2637 : audit [DBG] from='client.36240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:45.333441+0000 mon.smithi008 (mon.0) 3041 : audit [DBG] from='client.? 172.21.15.8:0/2106736586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:45.708005+0000 mon.smithi008 (mon.0) 3042 : audit [DBG] from='client.? 172.21.15.8:0/3923135093' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:42:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:45.526209+0000 mgr.smithi008.flmjzp (mgr.14640) 2638 : cluster [DBG] pgmap v1817: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:47.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:45.526209+0000 mgr.smithi008.flmjzp (mgr.14640) 2638 : cluster [DBG] pgmap v1817: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:46.063129+0000 mgr.smithi008.flmjzp (mgr.14640) 2639 : audit [DBG] from='client.36252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:48.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:46.063129+0000 mgr.smithi008.flmjzp (mgr.14640) 2639 : audit [DBG] from='client.36252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:42:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:47.526897+0000 mgr.smithi008.flmjzp (mgr.14640) 2640 : cluster [DBG] pgmap v1818: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:49.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:47.526897+0000 mgr.smithi008.flmjzp (mgr.14640) 2640 : cluster [DBG] pgmap v1818: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:49.552557+0000 mon.smithi008 (mon.0) 3043 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:50.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:49.552557+0000 mon.smithi008 (mon.0) 3043 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:49.527493+0000 mgr.smithi008.flmjzp (mgr.14640) 2641 : cluster [DBG] pgmap v1819: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:50.126406+0000 mon.smithi008 (mon.0) 3044 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:42:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:50.127287+0000 mon.smithi008 (mon.0) 3045 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:42:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:50.133034+0000 mon.smithi008 (mon.0) 3046 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:50.137973+0000 mon.smithi008 (mon.0) 3047 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:50.140308+0000 mon.smithi008 (mon.0) 3048 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:50.141621+0000 mon.smithi008 (mon.0) 3049 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:50.142903+0000 mon.smithi008 (mon.0) 3050 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:42:50.144514+0000 mon.smithi008 (mon.0) 3051 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:49.527493+0000 mgr.smithi008.flmjzp (mgr.14640) 2641 : cluster [DBG] pgmap v1819: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:50.126406+0000 mon.smithi008 (mon.0) 3044 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:42:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:50.127287+0000 mon.smithi008 (mon.0) 3045 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:42:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:50.133034+0000 mon.smithi008 (mon.0) 3046 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:42:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:50.137973+0000 mon.smithi008 (mon.0) 3047 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:42:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:50.140308+0000 mon.smithi008 (mon.0) 3048 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:50.141621+0000 mon.smithi008 (mon.0) 3049 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:50.142903+0000 mon.smithi008 (mon.0) 3050 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:42:50.144514+0000 mon.smithi008 (mon.0) 3051 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:42:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:42:50.127967+0000 mgr.smithi008.flmjzp (mgr.14640) 2642 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:50.128432+0000 mgr.smithi008.flmjzp (mgr.14640) 2643 : cluster [DBG] pgmap v1820: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:52.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:50.128637+0000 mgr.smithi008.flmjzp (mgr.14640) 2644 : cluster [DBG] pgmap v1821: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:52.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:42:50.146111+0000 mgr.smithi008.flmjzp (mgr.14640) 2645 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:52.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:42:50.127967+0000 mgr.smithi008.flmjzp (mgr.14640) 2642 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:42:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:50.128432+0000 mgr.smithi008.flmjzp (mgr.14640) 2643 : cluster [DBG] pgmap v1820: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:50.128637+0000 mgr.smithi008.flmjzp (mgr.14640) 2644 : cluster [DBG] pgmap v1821: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:42:50.146111+0000 mgr.smithi008.flmjzp (mgr.14640) 2645 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:42:54.304 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:52.129136+0000 mgr.smithi008.flmjzp (mgr.14640) 2646 : cluster [DBG] pgmap v1822: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:54.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:52.129136+0000 mgr.smithi008.flmjzp (mgr.14640) 2646 : cluster [DBG] pgmap v1822: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:54.129672+0000 mgr.smithi008.flmjzp (mgr.14640) 2647 : cluster [DBG] pgmap v1823: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:56.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:54.129672+0000 mgr.smithi008.flmjzp (mgr.14640) 2647 : cluster [DBG] pgmap v1823: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:58.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:42:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:56.130173+0000 mgr.smithi008.flmjzp (mgr.14640) 2648 : cluster [DBG] pgmap v1824: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:42:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:42:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:56.130173+0000 mgr.smithi008.flmjzp (mgr.14640) 2648 : cluster [DBG] pgmap v1824: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:42:58.130798+0000 mgr.smithi008.flmjzp (mgr.14640) 2649 : cluster [DBG] pgmap v1825: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:00.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:42:58.130798+0000 mgr.smithi008.flmjzp (mgr.14640) 2649 : cluster [DBG] pgmap v1825: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:00.155045+0000 mon.smithi008 (mon.0) 3052 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:00.157173+0000 mon.smithi008 (mon.0) 3053 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:00.158228+0000 mon.smithi008 (mon.0) 3054 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:00.164986+0000 mon.smithi008 (mon.0) 3055 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:00.171494+0000 mon.smithi008 (mon.0) 3056 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:00.174561+0000 mon.smithi008 (mon.0) 3057 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:00.176229+0000 mon.smithi008 (mon.0) 3058 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:01.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:00.177861+0000 mon.smithi008 (mon.0) 3059 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:01.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:00.179933+0000 mon.smithi008 (mon.0) 3060 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:00.155045+0000 mon.smithi008 (mon.0) 3052 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:00.157173+0000 mon.smithi008 (mon.0) 3053 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:00.158228+0000 mon.smithi008 (mon.0) 3054 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:00.164986+0000 mon.smithi008 (mon.0) 3055 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:00.171494+0000 mon.smithi008 (mon.0) 3056 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:00.174561+0000 mon.smithi008 (mon.0) 3057 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:00.176229+0000 mon.smithi008 (mon.0) 3058 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:00.177861+0000 mon.smithi008 (mon.0) 3059 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:00.179933+0000 mon.smithi008 (mon.0) 3060 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:02.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:00.131357+0000 mgr.smithi008.flmjzp (mgr.14640) 2650 : cluster [DBG] pgmap v1826: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:02.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:00.159161+0000 mgr.smithi008.flmjzp (mgr.14640) 2651 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:02.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:00.159973+0000 mgr.smithi008.flmjzp (mgr.14640) 2652 : cluster [DBG] pgmap v1827: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:02.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:00.160273+0000 mgr.smithi008.flmjzp (mgr.14640) 2653 : cluster [DBG] pgmap v1828: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:02.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:00.181883+0000 mgr.smithi008.flmjzp (mgr.14640) 2654 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:00.131357+0000 mgr.smithi008.flmjzp (mgr.14640) 2650 : cluster [DBG] pgmap v1826: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:00.159161+0000 mgr.smithi008.flmjzp (mgr.14640) 2651 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:00.159973+0000 mgr.smithi008.flmjzp (mgr.14640) 2652 : cluster [DBG] pgmap v1827: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:00.160273+0000 mgr.smithi008.flmjzp (mgr.14640) 2653 : cluster [DBG] pgmap v1828: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:00.181883+0000 mgr.smithi008.flmjzp (mgr.14640) 2654 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:04.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:02.160984+0000 mgr.smithi008.flmjzp (mgr.14640) 2655 : cluster [DBG] pgmap v1829: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:02.160984+0000 mgr.smithi008.flmjzp (mgr.14640) 2655 : cluster [DBG] pgmap v1829: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:04.161594+0000 mgr.smithi008.flmjzp (mgr.14640) 2656 : cluster [DBG] pgmap v1830: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:05.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:04.161594+0000 mgr.smithi008.flmjzp (mgr.14640) 2656 : cluster [DBG] pgmap v1830: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:06.162140+0000 mgr.smithi008.flmjzp (mgr.14640) 2657 : cluster [DBG] pgmap v1831: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:07.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:06.162140+0000 mgr.smithi008.flmjzp (mgr.14640) 2657 : cluster [DBG] pgmap v1831: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:08.162710+0000 mgr.smithi008.flmjzp (mgr.14640) 2658 : cluster [DBG] pgmap v1832: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:09.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:08.162710+0000 mgr.smithi008.flmjzp (mgr.14640) 2658 : cluster [DBG] pgmap v1832: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:10.185763+0000 mon.smithi008 (mon.0) 3061 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:10.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:10.540185+0000 mon.smithi008 (mon.0) 3062 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:10.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:10.185763+0000 mon.smithi008 (mon.0) 3061 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:10.540185+0000 mon.smithi008 (mon.0) 3062 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:10.163269+0000 mgr.smithi008.flmjzp (mgr.14640) 2659 : cluster [DBG] pgmap v1833: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:11.087750+0000 mon.smithi008 (mon.0) 3063 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:11.088916+0000 mon.smithi008 (mon.0) 3064 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:11.095781+0000 mon.smithi008 (mon.0) 3065 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:11.102376+0000 mon.smithi008 (mon.0) 3066 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:11.105470+0000 mon.smithi008 (mon.0) 3067 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:11.107155+0000 mon.smithi008 (mon.0) 3068 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:11.108864+0000 mon.smithi008 (mon.0) 3069 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:11.110933+0000 mon.smithi008 (mon.0) 3070 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:10.163269+0000 mgr.smithi008.flmjzp (mgr.14640) 2659 : cluster [DBG] pgmap v1833: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:11.087750+0000 mon.smithi008 (mon.0) 3063 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:11.088916+0000 mon.smithi008 (mon.0) 3064 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:11.095781+0000 mon.smithi008 (mon.0) 3065 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:11.102376+0000 mon.smithi008 (mon.0) 3066 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:11.105470+0000 mon.smithi008 (mon.0) 3067 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:11.107155+0000 mon.smithi008 (mon.0) 3068 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:11.108864+0000 mon.smithi008 (mon.0) 3069 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:11.110933+0000 mon.smithi008 (mon.0) 3070 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:12.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:11.089839+0000 mgr.smithi008.flmjzp (mgr.14640) 2660 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:12.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:11.090574+0000 mgr.smithi008.flmjzp (mgr.14640) 2661 : cluster [DBG] pgmap v1834: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:12.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:11.090821+0000 mgr.smithi008.flmjzp (mgr.14640) 2662 : cluster [DBG] pgmap v1835: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:12.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:11.112924+0000 mgr.smithi008.flmjzp (mgr.14640) 2663 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:12.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:11.089839+0000 mgr.smithi008.flmjzp (mgr.14640) 2660 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:11.090574+0000 mgr.smithi008.flmjzp (mgr.14640) 2661 : cluster [DBG] pgmap v1834: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:11.090821+0000 mgr.smithi008.flmjzp (mgr.14640) 2662 : cluster [DBG] pgmap v1835: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:11.112924+0000 mgr.smithi008.flmjzp (mgr.14640) 2663 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:14.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:13.091414+0000 mgr.smithi008.flmjzp (mgr.14640) 2664 : cluster [DBG] pgmap v1836: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:13.091414+0000 mgr.smithi008.flmjzp (mgr.14640) 2664 : cluster [DBG] pgmap v1836: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:16.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.217+0000 7f107759e700 1 -- 172.21.15.8:0/301944182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10780f77d0 msgr2=0x7f10780f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:16.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.217+0000 7f107759e700 1 --2- 172.21.15.8:0/301944182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10780f77d0 0x7f10780f7c30 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f106c004660 tx=0x7f106c009b30).stop 2023-10-18T21:43:16.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.217+0000 7f107759e700 1 -- 172.21.15.8:0/301944182 shutdown_connections 2023-10-18T21:43:16.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.217+0000 7f107759e700 1 --2- 172.21.15.8:0/301944182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10780f77d0 0x7f10780f7c30 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.217+0000 7f107759e700 1 --2- 172.21.15.8:0/301944182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10780f6530 0x7f10780f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.217+0000 7f107759e700 1 -- 172.21.15.8:0/301944182 >> 172.21.15.8:0/301944182 conn(0x7f10780f1c90 msgr2=0x7f10780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:16.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.217+0000 7f107759e700 1 -- 172.21.15.8:0/301944182 shutdown_connections 2023-10-18T21:43:16.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.217+0000 7f107759e700 1 -- 172.21.15.8:0/301944182 wait complete. 2023-10-18T21:43:16.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.218+0000 7f107759e700 1 Processor -- start 2023-10-18T21:43:16.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.218+0000 7f107759e700 1 -- start start 2023-10-18T21:43:16.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f107759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10780f6530 0x7f1078108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:16.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f107759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10780f77d0 0x7f1078109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:16.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f107759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10781099f0 con 0x7f10780f6530 2023-10-18T21:43:16.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f107759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1078109b30 con 0x7f10780f77d0 2023-10-18T21:43:16.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f107659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10780f6530 0x7f1078108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:16.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f107659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10780f6530 0x7f1078108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46986/0 (socket says 172.21.15.8:46986) 2023-10-18T21:43:16.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f107659c700 1 -- 172.21.15.8:0/1355669404 learned_addr learned my addr 172.21.15.8:0/1355669404 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f1075d9b700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10780f77d0 0x7f1078109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f107659c700 1 -- 172.21.15.8:0/1355669404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10780f77d0 msgr2=0x7f1078109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f107659c700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10780f77d0 0x7f1078109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.219+0000 7f107659c700 1 -- 172.21.15.8:0/1355669404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c005040 con 0x7f10780f6530 2023-10-18T21:43:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.220+0000 7f107659c700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10780f6530 0x7f1078108f50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f1068002700 tx=0x7f1068009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.220+0000 7f1066ffd700 1 -- 172.21.15.8:0/1355669404 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1068009320 con 0x7f10780f6530 2023-10-18T21:43:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.220+0000 7f1066ffd700 1 -- 172.21.15.8:0/1355669404 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f106800f040 con 0x7f10780f6530 2023-10-18T21:43:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.220+0000 7f1066ffd700 1 -- 172.21.15.8:0/1355669404 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1068014970 con 0x7f10780f6530 2023-10-18T21:43:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.220+0000 7f107759e700 1 -- 172.21.15.8:0/1355669404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107810a4d0 con 0x7f10780f6530 2023-10-18T21:43:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.220+0000 7f107759e700 1 -- 172.21.15.8:0/1355669404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107810aa90 con 0x7f10780f6530 2023-10-18T21:43:16.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.221+0000 7f107759e700 1 -- 172.21.15.8:0/1355669404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1078045ad0 con 0x7f10780f6530 2023-10-18T21:43:16.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.222+0000 7f1066ffd700 1 -- 172.21.15.8:0/1355669404 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1068009480 con 0x7f10780f6530 2023-10-18T21:43:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.223+0000 7f1066ffd700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1060060f70 0x7f1060063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.223+0000 7f1066ffd700 1 -- 172.21.15.8:0/1355669404 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f106807cb50 con 0x7f10780f6530 2023-10-18T21:43:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.223+0000 7f1075d9b700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1060060f70 0x7f1060063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.224+0000 7f1075d9b700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1060060f70 0x7f1060063430 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f106c004630 tx=0x7f106c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.227+0000 7f1066ffd700 1 -- 172.21.15.8:0/1355669404 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f10680501f0 con 0x7f10780f6530 2023-10-18T21:43:16.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.425+0000 7f107759e700 1 -- 172.21.15.8:0/1355669404 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f107810ad60 con 0x7f1060060f70 2023-10-18T21:43:16.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.427+0000 7f1066ffd700 1 -- 172.21.15.8:0/1355669404 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f107810ad60 con 0x7f1060060f70 2023-10-18T21:43:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 -- 172.21.15.8:0/1355669404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1060060f70 msgr2=0x7f1060063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1060060f70 0x7f1060063430 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f106c004630 tx=0x7f106c009b30).stop 2023-10-18T21:43:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 -- 172.21.15.8:0/1355669404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10780f6530 msgr2=0x7f1078108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10780f6530 0x7f1078108f50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f1068002700 tx=0x7f1068009d80).stop 2023-10-18T21:43:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 -- 172.21.15.8:0/1355669404 shutdown_connections 2023-10-18T21:43:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1060060f70 0x7f1060063430 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10780f6530 0x7f1078108f50 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 --2- 172.21.15.8:0/1355669404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10780f77d0 0x7f1078109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 -- 172.21.15.8:0/1355669404 >> 172.21.15.8:0/1355669404 conn(0x7f10780f1c90 msgr2=0x7f10780f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 -- 172.21.15.8:0/1355669404 shutdown_connections 2023-10-18T21:43:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.429+0000 7f107759e700 1 -- 172.21.15.8:0/1355669404 wait complete. 2023-10-18T21:43:16.445 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:43:16.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.567+0000 7ff94bfff700 1 -- 172.21.15.8:0/4042696676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94c0f77d0 msgr2=0x7ff94c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:16.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.567+0000 7ff94bfff700 1 --2- 172.21.15.8:0/4042696676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94c0f77d0 0x7ff94c0f7c30 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7ff934004660 tx=0x7ff934009b30).stop 2023-10-18T21:43:16.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.567+0000 7ff94bfff700 1 -- 172.21.15.8:0/4042696676 shutdown_connections 2023-10-18T21:43:16.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.567+0000 7ff94bfff700 1 --2- 172.21.15.8:0/4042696676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94c0f77d0 0x7ff94c0f7c30 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.567+0000 7ff94bfff700 1 --2- 172.21.15.8:0/4042696676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff94c0f6530 0x7ff94c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.567+0000 7ff94bfff700 1 -- 172.21.15.8:0/4042696676 >> 172.21.15.8:0/4042696676 conn(0x7ff94c0f1c90 msgr2=0x7ff94c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:16.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.567+0000 7ff94bfff700 1 -- 172.21.15.8:0/4042696676 shutdown_connections 2023-10-18T21:43:16.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.567+0000 7ff94bfff700 1 -- 172.21.15.8:0/4042696676 wait complete. 2023-10-18T21:43:16.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.568+0000 7ff94bfff700 1 Processor -- start 2023-10-18T21:43:16.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.568+0000 7ff94bfff700 1 -- start start 2023-10-18T21:43:16.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.568+0000 7ff94bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94c0f6530 0x7ff94c108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:16.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.569+0000 7ff94bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff94c0f77d0 0x7ff94c109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:16.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.569+0000 7ff94bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c1099c0 con 0x7ff94c0f6530 2023-10-18T21:43:16.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.569+0000 7ff94bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c109b00 con 0x7ff94c0f77d0 2023-10-18T21:43:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.569+0000 7ff94affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94c0f6530 0x7ff94c108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.569+0000 7ff94affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94c0f6530 0x7ff94c108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47000/0 (socket says 172.21.15.8:47000) 2023-10-18T21:43:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.569+0000 7ff94affd700 1 -- 172.21.15.8:0/250251845 learned_addr learned my addr 172.21.15.8:0/250251845 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.569+0000 7ff94affd700 1 -- 172.21.15.8:0/250251845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff94c0f77d0 msgr2=0x7ff94c109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.569+0000 7ff94affd700 1 --2- 172.21.15.8:0/250251845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff94c0f77d0 0x7ff94c109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:43:16.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.569+0000 7ff94affd700 1 -- 172.21.15.8:0/250251845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934005040 con 0x7ff94c0f6530 2023-10-18T21:43:16.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.569+0000 7ff94affd700 1 --2- 172.21.15.8:0/250251845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94c0f6530 0x7ff94c108f20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7ff93c00eb70 tx=0x7ff93c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:16.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.570+0000 7ff943fff700 1 -- 172.21.15.8:0/250251845 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93c0092e0 con 0x7ff94c0f6530 2023-10-18T21:43:16.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.570+0000 7ff943fff700 1 -- 172.21.15.8:0/250251845 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff93c00f040 con 0x7ff94c0f6530 2023-10-18T21:43:16.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.570+0000 7ff94bfff700 1 -- 172.21.15.8:0/250251845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c10a4a0 con 0x7ff94c0f6530 2023-10-18T21:43:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.570+0000 7ff943fff700 1 -- 172.21.15.8:0/250251845 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93c00ca70 con 0x7ff94c0f6530 2023-10-18T21:43:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.570+0000 7ff94bfff700 1 -- 172.21.15.8:0/250251845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c10a9e0 con 0x7ff94c0f6530 2023-10-18T21:43:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.571+0000 7ff94bfff700 1 -- 172.21.15.8:0/250251845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c045ad0 con 0x7ff94c0f6530 2023-10-18T21:43:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.572+0000 7ff943fff700 1 -- 172.21.15.8:0/250251845 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff93c01b030 con 0x7ff94c0f6530 2023-10-18T21:43:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.573+0000 7ff943fff700 1 --2- 172.21.15.8:0/250251845 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff938060f70 0x7ff938063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.573+0000 7ff943fff700 1 -- 172.21.15.8:0/250251845 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff93c07ca80 con 0x7ff94c0f6530 2023-10-18T21:43:16.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.573+0000 7ff9427fc700 1 --2- 172.21.15.8:0/250251845 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff938060f70 0x7ff938063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:16.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.574+0000 7ff9427fc700 1 --2- 172.21.15.8:0/250251845 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff938060f70 0x7ff938063430 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7ff934004d80 tx=0x7ff93400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:16.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.577+0000 7ff943fff700 1 -- 172.21.15.8:0/250251845 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff93c0500e0 con 0x7ff94c0f6530 2023-10-18T21:43:16.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.779+0000 7ff94bfff700 1 -- 172.21.15.8:0/250251845 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff94c10ac50 con 0x7ff938060f70 2023-10-18T21:43:16.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.781+0000 7ff943fff700 1 -- 172.21.15.8:0/250251845 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff94c10ac50 con 0x7ff938060f70 2023-10-18T21:43:16.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 -- 172.21.15.8:0/250251845 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff938060f70 msgr2=0x7ff938063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:16.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 --2- 172.21.15.8:0/250251845 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff938060f70 0x7ff938063430 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7ff934004d80 tx=0x7ff93400b040).stop 2023-10-18T21:43:16.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 -- 172.21.15.8:0/250251845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94c0f6530 msgr2=0x7ff94c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:16.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 --2- 172.21.15.8:0/250251845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94c0f6530 0x7ff94c108f20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7ff93c00eb70 tx=0x7ff93c00b040).stop 2023-10-18T21:43:16.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 -- 172.21.15.8:0/250251845 shutdown_connections 2023-10-18T21:43:16.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 --2- 172.21.15.8:0/250251845 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff938060f70 0x7ff938063430 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 --2- 172.21.15.8:0/250251845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94c0f6530 0x7ff94c108f20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 --2- 172.21.15.8:0/250251845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff94c0f77d0 0x7ff94c109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:43:16.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 -- 172.21.15.8:0/250251845 >> 172.21.15.8:0/250251845 conn(0x7ff94c0f1c90 msgr2=0x7ff94c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:16.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 -- 172.21.15.8:0/250251845 shutdown_connections 2023-10-18T21:43:16.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.783+0000 7ff94bfff700 1 -- 172.21.15.8:0/250251845 wait complete. 2023-10-18T21:43:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:15.091988+0000 mgr.smithi008.flmjzp (mgr.14640) 2665 : cluster [DBG] pgmap v1837: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:16.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.920+0000 7f71eb511700 1 -- 172.21.15.8:0/2311825605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71e4060310 msgr2=0x7f71e40f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:16.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.920+0000 7f71eb511700 1 --2- 172.21.15.8:0/2311825605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71e4060310 0x7f71e40f9110 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f71e0004660 tx=0x7f71e0009b30).stop 2023-10-18T21:43:16.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.920+0000 7f71eb511700 1 -- 172.21.15.8:0/2311825605 shutdown_connections 2023-10-18T21:43:16.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.920+0000 7f71eb511700 1 --2- 172.21.15.8:0/2311825605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e40f9690 0x7f71e40fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.920+0000 7f71eb511700 1 --2- 172.21.15.8:0/2311825605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71e4060310 0x7f71e40f9110 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.920+0000 7f71eb511700 1 -- 172.21.15.8:0/2311825605 >> 172.21.15.8:0/2311825605 conn(0x7f71e40f0b90 msgr2=0x7f71e40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:16.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.920+0000 7f71eb511700 1 -- 172.21.15.8:0/2311825605 shutdown_connections 2023-10-18T21:43:16.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.920+0000 7f71eb511700 1 -- 172.21.15.8:0/2311825605 wait complete. 2023-10-18T21:43:16.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.921+0000 7f71eb511700 1 Processor -- start 2023-10-18T21:43:16.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.921+0000 7f71eb511700 1 -- start start 2023-10-18T21:43:16.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71eb511700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71e4060310 0x7f71e4108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:16.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71eb511700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e40f9690 0x7f71e4109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:16.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71eb511700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4109a30 con 0x7f71e4060310 2023-10-18T21:43:16.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71eb511700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4109b70 con 0x7f71e40f9690 2023-10-18T21:43:16.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71ea50f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71e4060310 0x7f71e4108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:16.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71ea50f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71e4060310 0x7f71e4108f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33670/0 (socket says 172.21.15.8:33670) 2023-10-18T21:43:16.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71ea50f700 1 -- 172.21.15.8:0/3368756316 learned_addr learned my addr 172.21.15.8:0/3368756316 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:16.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71e9d0e700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e40f9690 0x7f71e4109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:16.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71ea50f700 1 -- 172.21.15.8:0/3368756316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e40f9690 msgr2=0x7f71e4109480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:16.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71ea50f700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e40f9690 0x7f71e4109480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:16.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71ea50f700 1 -- 172.21.15.8:0/3368756316 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0005040 con 0x7f71e4060310 2023-10-18T21:43:16.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71e9d0e700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e40f9690 0x7f71e4109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:43:16.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.922+0000 7f71ea50f700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71e4060310 0x7f71e4108f90 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f71e0009990 tx=0x7f71e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:16.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.923+0000 7f71daffd700 1 -- 172.21.15.8:0/3368756316 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71e0018070 con 0x7f71e4060310 2023-10-18T21:43:16.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.923+0000 7f71daffd700 1 -- 172.21.15.8:0/3368756316 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f71e0009630 con 0x7f71e4060310 2023-10-18T21:43:16.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.923+0000 7f71daffd700 1 -- 172.21.15.8:0/3368756316 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71e001c400 con 0x7f71e4060310 2023-10-18T21:43:16.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.923+0000 7f71eb511700 1 -- 172.21.15.8:0/3368756316 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e410a4b0 con 0x7f71e4060310 2023-10-18T21:43:16.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.923+0000 7f71eb511700 1 -- 172.21.15.8:0/3368756316 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e410aa10 con 0x7f71e4060310 2023-10-18T21:43:16.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.924+0000 7f71eb511700 1 -- 172.21.15.8:0/3368756316 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e4045ad0 con 0x7f71e4060310 2023-10-18T21:43:16.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.925+0000 7f71daffd700 1 -- 172.21.15.8:0/3368756316 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f71e001d9e0 con 0x7f71e4060310 2023-10-18T21:43:16.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.926+0000 7f71daffd700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71d0060f70 0x7f71d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:16.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.926+0000 7f71daffd700 1 -- 172.21.15.8:0/3368756316 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f71e007e670 con 0x7f71e4060310 2023-10-18T21:43:16.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.926+0000 7f71e9d0e700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71d0060f70 0x7f71d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:16.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.926+0000 7f71e9d0e700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71d0060f70 0x7f71d0063430 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f71d4009fd0 tx=0x7f71d400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:16.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:16.930+0000 7f71daffd700 1 -- 172.21.15.8:0/3368756316 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f71e0051cd0 con 0x7f71e4060310 2023-10-18T21:43:16.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:15.091988+0000 mgr.smithi008.flmjzp (mgr.14640) 2665 : cluster [DBG] pgmap v1837: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:17.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.124+0000 7f71eb511700 1 -- 172.21.15.8:0/3368756316 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f71e40f5650 con 0x7f71d0060f70 2023-10-18T21:43:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.133+0000 7f71daffd700 1 -- 172.21.15.8:0/3368756316 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f71e40f5650 con 0x7f71d0060f70 2023-10-18T21:43:17.134 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:43:17.134 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (49m) 7m ago 51m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:43:17.135 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (43m) 7m ago 51m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:43:17.135 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (43m) 5m ago 50m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:43:17.135 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (49m) 7m ago 51m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:43:17.135 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 47m - - 2023-10-18T21:43:17.135 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 47m - - 2023-10-18T21:43:17.136 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 47m - - 2023-10-18T21:43:17.136 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 47m - - 2023-10-18T21:43:17.136 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (45m) 7m ago 52m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:43:17.136 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (44m) 5m ago 50m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:43:17.136 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (44m) 7m ago 52m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:43:17.137 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (44m) 5m ago 50m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:43:17.137 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (50m) 7m ago 50m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:43:17.137 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (50m) 5m ago 50m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:43:17.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (43m) 7m ago 49m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:43:17.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (41m) 7m ago 49m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:43:17.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (41m) 7m ago 49m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:43:17.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (40m) 5m ago 49m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:43:17.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (39m) 5m ago 48m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:43:17.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (39m) 5m ago 48m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:43:17.138 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (45m) 7m ago 50m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:43:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.135+0000 7f71eb511700 1 -- 172.21.15.8:0/3368756316 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71d0060f70 msgr2=0x7f71d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.135+0000 7f71eb511700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71d0060f70 0x7f71d0063430 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f71d4009fd0 tx=0x7f71d400b040).stop 2023-10-18T21:43:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.135+0000 7f71eb511700 1 -- 172.21.15.8:0/3368756316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71e4060310 msgr2=0x7f71e4108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.135+0000 7f71eb511700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71e4060310 0x7f71e4108f90 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f71e0009990 tx=0x7f71e0009b30).stop 2023-10-18T21:43:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.135+0000 7f71eb511700 1 -- 172.21.15.8:0/3368756316 shutdown_connections 2023-10-18T21:43:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.135+0000 7f71eb511700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71d0060f70 0x7f71d0063430 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.135+0000 7f71eb511700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71e4060310 0x7f71e4108f90 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.135+0000 7f71eb511700 1 --2- 172.21.15.8:0/3368756316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e40f9690 0x7f71e4109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.135+0000 7f71eb511700 1 -- 172.21.15.8:0/3368756316 >> 172.21.15.8:0/3368756316 conn(0x7f71e40f0b90 msgr2=0x7f71e40f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:17.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.136+0000 7f71eb511700 1 -- 172.21.15.8:0/3368756316 shutdown_connections 2023-10-18T21:43:17.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.136+0000 7f71eb511700 1 -- 172.21.15.8:0/3368756316 wait complete. 2023-10-18T21:43:17.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.271+0000 7f165943c700 1 -- 172.21.15.8:0/648819830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16540f9690 msgr2=0x7f16540fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:17.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.271+0000 7f165943c700 1 --2- 172.21.15.8:0/648819830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16540f9690 0x7f16540fbae0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f1648004660 tx=0x7f1648009b30).stop 2023-10-18T21:43:17.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.271+0000 7f165943c700 1 -- 172.21.15.8:0/648819830 shutdown_connections 2023-10-18T21:43:17.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.271+0000 7f165943c700 1 --2- 172.21.15.8:0/648819830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16540f9690 0x7f16540fbae0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.271+0000 7f165943c700 1 --2- 172.21.15.8:0/648819830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1654060310 0x7f16540f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.271+0000 7f165943c700 1 -- 172.21.15.8:0/648819830 >> 172.21.15.8:0/648819830 conn(0x7f16540f0b90 msgr2=0x7f16540f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:17.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.272+0000 7f165943c700 1 -- 172.21.15.8:0/648819830 shutdown_connections 2023-10-18T21:43:17.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.272+0000 7f165943c700 1 -- 172.21.15.8:0/648819830 wait complete. 2023-10-18T21:43:17.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.272+0000 7f165943c700 1 Processor -- start 2023-10-18T21:43:17.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.273+0000 7f165943c700 1 -- start start 2023-10-18T21:43:17.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.273+0000 7f165943c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654060310 0x7f1654106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:17.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.273+0000 7f165943c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16540f9690 0x7f1654107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:17.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.273+0000 7f165943c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654107840 con 0x7f1654060310 2023-10-18T21:43:17.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.273+0000 7f165943c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654108050 con 0x7f16540f9690 2023-10-18T21:43:17.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.273+0000 7f1653fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654060310 0x7f1654106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:17.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.273+0000 7f1653fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654060310 0x7f1654106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33688/0 (socket says 172.21.15.8:33688) 2023-10-18T21:43:17.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.273+0000 7f1653fff700 1 -- 172.21.15.8:0/772228366 learned_addr learned my addr 172.21.15.8:0/772228366 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:17.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.273+0000 7f16537fe700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16540f9690 0x7f1654107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:17.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.274+0000 7f1653fff700 1 -- 172.21.15.8:0/772228366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16540f9690 msgr2=0x7f1654107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:17.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.274+0000 7f1653fff700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16540f9690 0x7f1654107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.274+0000 7f1653fff700 1 -- 172.21.15.8:0/772228366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1648005040 con 0x7f1654060310 2023-10-18T21:43:17.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.274+0000 7f1653fff700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654060310 0x7f1654106d50 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f164400e7f0 tx=0x7f164400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:17.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.274+0000 7f1650ff9700 1 -- 172.21.15.8:0/772228366 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16440092e0 con 0x7f1654060310 2023-10-18T21:43:17.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.274+0000 7f1650ff9700 1 -- 172.21.15.8:0/772228366 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f164400f040 con 0x7f1654060310 2023-10-18T21:43:17.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.274+0000 7f165943c700 1 -- 172.21.15.8:0/772228366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16541082d0 con 0x7f1654060310 2023-10-18T21:43:17.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.274+0000 7f1650ff9700 1 -- 172.21.15.8:0/772228366 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16440147e0 con 0x7f1654060310 2023-10-18T21:43:17.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.274+0000 7f165943c700 1 -- 172.21.15.8:0/772228366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1654108810 con 0x7f1654060310 2023-10-18T21:43:17.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.276+0000 7f165943c700 1 -- 172.21.15.8:0/772228366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1654059100 con 0x7f1654060310 2023-10-18T21:43:17.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.276+0000 7f1650ff9700 1 -- 172.21.15.8:0/772228366 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f164401b030 con 0x7f1654060310 2023-10-18T21:43:17.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.277+0000 7f1650ff9700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f163c060f70 0x7f163c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:17.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.278+0000 7f1650ff9700 1 -- 172.21.15.8:0/772228366 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f164407c7c0 con 0x7f1654060310 2023-10-18T21:43:17.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.278+0000 7f16537fe700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f163c060f70 0x7f163c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:17.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.278+0000 7f16537fe700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f163c060f70 0x7f163c063430 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f1648005010 tx=0x7f1648016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:17.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.282+0000 7f1650ff9700 1 -- 172.21.15.8:0/772228366 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f164404c420 con 0x7f1654060310 2023-10-18T21:43:17.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.536+0000 7f165943c700 1 -- 172.21.15.8:0/772228366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f16540fecf0 con 0x7f1654060310 2023-10-18T21:43:17.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.537+0000 7f1650ff9700 1 -- 172.21.15.8:0/772228366 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f1644019020 con 0x7f1654060310 2023-10-18T21:43:17.538 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:43:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:43:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:43:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:43:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:43:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:43:17.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:43:17.540 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:43:17.540 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:43:17.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:43:17.540 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:43:17.541 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:43:17.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:43:17.541 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:43:17.541 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:43:17.541 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:43:17.542 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:43:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 -- 172.21.15.8:0/772228366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f163c060f70 msgr2=0x7f163c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f163c060f70 0x7f163c063430 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f1648005010 tx=0x7f1648016040).stop 2023-10-18T21:43:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 -- 172.21.15.8:0/772228366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654060310 msgr2=0x7f1654106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654060310 0x7f1654106d50 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f164400e7f0 tx=0x7f164400b040).stop 2023-10-18T21:43:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 -- 172.21.15.8:0/772228366 shutdown_connections 2023-10-18T21:43:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f163c060f70 0x7f163c063430 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654060310 0x7f1654106d50 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 --2- 172.21.15.8:0/772228366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16540f9690 0x7f1654107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 -- 172.21.15.8:0/772228366 >> 172.21.15.8:0/772228366 conn(0x7f16540f0b90 msgr2=0x7f16540f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:17.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 -- 172.21.15.8:0/772228366 shutdown_connections 2023-10-18T21:43:17.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.539+0000 7f165943c700 1 -- 172.21.15.8:0/772228366 wait complete. 2023-10-18T21:43:17.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.676+0000 7fe8250e1700 1 -- 172.21.15.8:0/2423375529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8200f9690 msgr2=0x7fe8200fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:17.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.676+0000 7fe8250e1700 1 --2- 172.21.15.8:0/2423375529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8200f9690 0x7fe8200fbae0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fe814004660 tx=0x7fe814009b30).stop 2023-10-18T21:43:17.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.676+0000 7fe8250e1700 1 -- 172.21.15.8:0/2423375529 shutdown_connections 2023-10-18T21:43:17.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.676+0000 7fe8250e1700 1 --2- 172.21.15.8:0/2423375529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8200f9690 0x7fe8200fbae0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.676+0000 7fe8250e1700 1 --2- 172.21.15.8:0/2423375529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe820060310 0x7fe8200f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.676+0000 7fe8250e1700 1 -- 172.21.15.8:0/2423375529 >> 172.21.15.8:0/2423375529 conn(0x7fe8200f0b90 msgr2=0x7fe8200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:17.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.676+0000 7fe8250e1700 1 -- 172.21.15.8:0/2423375529 shutdown_connections 2023-10-18T21:43:17.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.676+0000 7fe8250e1700 1 -- 172.21.15.8:0/2423375529 wait complete. 2023-10-18T21:43:17.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.677+0000 7fe8250e1700 1 Processor -- start 2023-10-18T21:43:17.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.677+0000 7fe8250e1700 1 -- start start 2023-10-18T21:43:17.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe8250e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe820060310 0x7fe820106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:17.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe8250e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8200f9690 0x7fe8201072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:17.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe8250e1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8201078b0 con 0x7fe820060310 2023-10-18T21:43:17.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe8250e1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8201080f0 con 0x7fe8200f9690 2023-10-18T21:43:17.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe820060310 0x7fe820106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:17.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe820060310 0x7fe820106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33710/0 (socket says 172.21.15.8:33710) 2023-10-18T21:43:17.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe81ffff700 1 -- 172.21.15.8:0/1838186215 learned_addr learned my addr 172.21.15.8:0/1838186215 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:17.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe81f7fe700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8200f9690 0x7fe8201072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:17.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe81ffff700 1 -- 172.21.15.8:0/1838186215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8200f9690 msgr2=0x7fe8201072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:17.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe81ffff700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8200f9690 0x7fe8201072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe81ffff700 1 -- 172.21.15.8:0/1838186215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe814005040 con 0x7fe820060310 2023-10-18T21:43:17.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe81f7fe700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8200f9690 0x7fe8201072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:43:17.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.678+0000 7fe81ffff700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe820060310 0x7fe820106dc0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fe8100026d0 tx=0x7fe810009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:17.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.679+0000 7fe81cff9700 1 -- 172.21.15.8:0/1838186215 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe810009320 con 0x7fe820060310 2023-10-18T21:43:17.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.679+0000 7fe81cff9700 1 -- 172.21.15.8:0/1838186215 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe81000f040 con 0x7fe820060310 2023-10-18T21:43:17.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.679+0000 7fe8250e1700 1 -- 172.21.15.8:0/1838186215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8201083d0 con 0x7fe820060310 2023-10-18T21:43:17.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.679+0000 7fe81cff9700 1 -- 172.21.15.8:0/1838186215 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe810014680 con 0x7fe820060310 2023-10-18T21:43:17.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.679+0000 7fe8250e1700 1 -- 172.21.15.8:0/1838186215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe820108910 con 0x7fe820060310 2023-10-18T21:43:17.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.680+0000 7fe8250e1700 1 -- 172.21.15.8:0/1838186215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe820059100 con 0x7fe820060310 2023-10-18T21:43:17.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.681+0000 7fe81cff9700 1 -- 172.21.15.8:0/1838186215 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe810009480 con 0x7fe820060310 2023-10-18T21:43:17.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.682+0000 7fe81cff9700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe808060f70 0x7fe808063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:17.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.682+0000 7fe81cff9700 1 -- 172.21.15.8:0/1838186215 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe81007ce40 con 0x7fe820060310 2023-10-18T21:43:17.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.682+0000 7fe81f7fe700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe808060f70 0x7fe808063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:17.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.683+0000 7fe81f7fe700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe808060f70 0x7fe808063430 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fe814009d60 tx=0x7fe814009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:17.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.686+0000 7fe81cff9700 1 -- 172.21.15.8:0/1838186215 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe81004c9f0 con 0x7fe820060310 2023-10-18T21:43:17.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.912+0000 7fe8250e1700 1 -- 172.21.15.8:0/1838186215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe8200fee00 con 0x7fe820060310 2023-10-18T21:43:17.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.913+0000 7fe81cff9700 1 -- 172.21.15.8:0/1838186215 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fe810050010 con 0x7fe820060310 2023-10-18T21:43:17.914 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:43:17.915 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:43:17.915 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:43:17.915 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:43:17.915 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:43:17.915 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:43:17.916 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:43:17.916 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:43:17.916 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:43:17.916 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:43:17.917 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:43:17.917 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:43:17.917 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:43:17.917 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:43:17.917 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:43:17.917 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:43:17.918 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:43:17.918 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:43:17.918 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:43:17.918 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:43:17.918 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:43:17.919 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:43:17.919 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:43:17.919 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:43:17.919 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:43:17.919 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:43:17.920 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:43:17.920 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:43:17.920 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:43:17.920 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:43:17.920 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:43:17.921 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:43:17.921 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:43:17.921 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:43:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 -- 172.21.15.8:0/1838186215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe808060f70 msgr2=0x7fe808063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe808060f70 0x7fe808063430 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fe814009d60 tx=0x7fe814009b30).stop 2023-10-18T21:43:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 -- 172.21.15.8:0/1838186215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe820060310 msgr2=0x7fe820106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe820060310 0x7fe820106dc0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fe8100026d0 tx=0x7fe810009de0).stop 2023-10-18T21:43:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 -- 172.21.15.8:0/1838186215 shutdown_connections 2023-10-18T21:43:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe808060f70 0x7fe808063430 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe820060310 0x7fe820106dc0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 --2- 172.21.15.8:0/1838186215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8200f9690 0x7fe8201072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 -- 172.21.15.8:0/1838186215 >> 172.21.15.8:0/1838186215 conn(0x7fe8200f0b90 msgr2=0x7fe8200f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 -- 172.21.15.8:0/1838186215 shutdown_connections 2023-10-18T21:43:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:17.915+0000 7fe8250e1700 1 -- 172.21.15.8:0/1838186215 wait complete. 2023-10-18T21:43:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:43:17.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:16.427136+0000 mgr.smithi008.flmjzp (mgr.14640) 2666 : audit [DBG] from='client.36256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:17.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:16.781092+0000 mgr.smithi008.flmjzp (mgr.14640) 2667 : audit [DBG] from='client.36260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:17.925 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:17.537357+0000 mon.smithi008 (mon.0) 3071 : audit [DBG] from='client.? 172.21.15.8:0/772228366' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:17.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:16.427136+0000 mgr.smithi008.flmjzp (mgr.14640) 2666 : audit [DBG] from='client.36256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:17.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:16.781092+0000 mgr.smithi008.flmjzp (mgr.14640) 2667 : audit [DBG] from='client.36260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:17.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:17.537357+0000 mon.smithi008 (mon.0) 3071 : audit [DBG] from='client.? 172.21.15.8:0/772228366' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.051+0000 7f6200b96700 1 -- 172.21.15.8:0/2841477640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61fc0f77d0 msgr2=0x7f61fc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.051+0000 7f6200b96700 1 --2- 172.21.15.8:0/2841477640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61fc0f77d0 0x7f61fc0f7c30 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f61f0004660 tx=0x7f61f0009b30).stop 2023-10-18T21:43:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.051+0000 7f6200b96700 1 -- 172.21.15.8:0/2841477640 shutdown_connections 2023-10-18T21:43:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.051+0000 7f6200b96700 1 --2- 172.21.15.8:0/2841477640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61fc0f77d0 0x7f61fc0f7c30 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.051+0000 7f6200b96700 1 --2- 172.21.15.8:0/2841477640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61fc0f6530 0x7f61fc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:18.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.051+0000 7f6200b96700 1 -- 172.21.15.8:0/2841477640 >> 172.21.15.8:0/2841477640 conn(0x7f61fc0f1c90 msgr2=0x7f61fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:18.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.051+0000 7f6200b96700 1 -- 172.21.15.8:0/2841477640 shutdown_connections 2023-10-18T21:43:18.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.051+0000 7f6200b96700 1 -- 172.21.15.8:0/2841477640 wait complete. 2023-10-18T21:43:18.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.052+0000 7f6200b96700 1 Processor -- start 2023-10-18T21:43:18.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.052+0000 7f6200b96700 1 -- start start 2023-10-18T21:43:18.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f6200b96700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61fc0f6530 0x7f61fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:18.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f6200b96700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61fc0f77d0 0x7f61fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:18.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f6200b96700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc06a380 con 0x7f61fc0f6530 2023-10-18T21:43:18.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f6200b96700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc06a4c0 con 0x7f61fc0f77d0 2023-10-18T21:43:18.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f61fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61fc0f6530 0x7f61fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:18.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f61fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61fc0f6530 0x7f61fc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33742/0 (socket says 172.21.15.8:33742) 2023-10-18T21:43:18.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f61fb7fe700 1 -- 172.21.15.8:0/2466493858 learned_addr learned my addr 172.21.15.8:0/2466493858 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:18.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f61faffd700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61fc0f77d0 0x7f61fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:18.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f61fb7fe700 1 -- 172.21.15.8:0/2466493858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61fc0f77d0 msgr2=0x7f61fc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:18.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f61fb7fe700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61fc0f77d0 0x7f61fc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:18.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.053+0000 7f61fb7fe700 1 -- 172.21.15.8:0/2466493858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0005040 con 0x7f61fc0f6530 2023-10-18T21:43:18.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.054+0000 7f61fb7fe700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61fc0f6530 0x7f61fc06b9a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f61ec002700 tx=0x7f61ec009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:18.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.054+0000 7f61e3fff700 1 -- 172.21.15.8:0/2466493858 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61ec0079c0 con 0x7f61fc0f6530 2023-10-18T21:43:18.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.054+0000 7f61e3fff700 1 -- 172.21.15.8:0/2466493858 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f61ec00f040 con 0x7f61fc0f6530 2023-10-18T21:43:18.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.054+0000 7f6200b96700 1 -- 172.21.15.8:0/2466493858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61fc06a7a0 con 0x7f61fc0f6530 2023-10-18T21:43:18.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.054+0000 7f61e3fff700 1 -- 172.21.15.8:0/2466493858 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61ec0148d0 con 0x7f61fc0f6530 2023-10-18T21:43:18.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.054+0000 7f6200b96700 1 -- 172.21.15.8:0/2466493858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61fc10ed70 con 0x7f61fc0f6530 2023-10-18T21:43:18.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.055+0000 7f6200b96700 1 -- 172.21.15.8:0/2466493858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61fc045ad0 con 0x7f61fc0f6530 2023-10-18T21:43:18.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.056+0000 7f61e3fff700 1 -- 172.21.15.8:0/2466493858 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f61ec01b060 con 0x7f61fc0f6530 2023-10-18T21:43:18.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.057+0000 7f61e3fff700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61e4060f70 0x7f61e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:18.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.057+0000 7f61e3fff700 1 -- 172.21.15.8:0/2466493858 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f61ec07c770 con 0x7f61fc0f6530 2023-10-18T21:43:18.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.057+0000 7f61faffd700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61e4060f70 0x7f61e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:18.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.058+0000 7f61faffd700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61e4060f70 0x7f61e4063430 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f61f0004630 tx=0x7f61f0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:18.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.061+0000 7f61e3fff700 1 -- 172.21.15.8:0/2466493858 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f61ec04c3a0 con 0x7f61fc0f6530 2023-10-18T21:43:18.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.260+0000 7f6200b96700 1 -- 172.21.15.8:0/2466493858 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f61fc0fee00 con 0x7f61e4060f70 2023-10-18T21:43:18.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.262+0000 7f61e3fff700 1 -- 172.21.15.8:0/2466493858 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f61fc0fee00 con 0x7f61e4060f70 2023-10-18T21:43:18.263 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:43:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:43:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:43:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:43:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:43:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:43:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:43:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:43:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:43:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:43:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:43:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:43:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:43:18.266 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:43:18.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.263+0000 7f6200b96700 1 -- 172.21.15.8:0/2466493858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61e4060f70 msgr2=0x7f61e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:18.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.263+0000 7f6200b96700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61e4060f70 0x7f61e4063430 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f61f0004630 tx=0x7f61f0009b30).stop 2023-10-18T21:43:18.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.263+0000 7f6200b96700 1 -- 172.21.15.8:0/2466493858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61fc0f6530 msgr2=0x7f61fc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:18.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.263+0000 7f6200b96700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61fc0f6530 0x7f61fc06b9a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f61ec002700 tx=0x7f61ec009d80).stop 2023-10-18T21:43:18.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.264+0000 7f6200b96700 1 -- 172.21.15.8:0/2466493858 shutdown_connections 2023-10-18T21:43:18.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.264+0000 7f6200b96700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61e4060f70 0x7f61e4063430 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:18.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.264+0000 7f6200b96700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61fc0f6530 0x7f61fc06b9a0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:18.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.264+0000 7f6200b96700 1 --2- 172.21.15.8:0/2466493858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61fc0f77d0 0x7f61fc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:18.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.264+0000 7f6200b96700 1 -- 172.21.15.8:0/2466493858 >> 172.21.15.8:0/2466493858 conn(0x7f61fc0f1c90 msgr2=0x7f61fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:18.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.264+0000 7f6200b96700 1 -- 172.21.15.8:0/2466493858 shutdown_connections 2023-10-18T21:43:18.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:18.264+0000 7f6200b96700 1 -- 172.21.15.8:0/2466493858 wait complete. 2023-10-18T21:43:18.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:17.092406+0000 mgr.smithi008.flmjzp (mgr.14640) 2668 : cluster [DBG] pgmap v1838: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:18.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:17.125244+0000 mgr.smithi008.flmjzp (mgr.14640) 2669 : audit [DBG] from='client.36264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:17.913676+0000 mon.smithi008 (mon.0) 3072 : audit [DBG] from='client.? 172.21.15.8:0/1838186215' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:43:18.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:17.092406+0000 mgr.smithi008.flmjzp (mgr.14640) 2668 : cluster [DBG] pgmap v1838: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:17.125244+0000 mgr.smithi008.flmjzp (mgr.14640) 2669 : audit [DBG] from='client.36264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:17.913676+0000 mon.smithi008 (mon.0) 3072 : audit [DBG] from='client.? 172.21.15.8:0/1838186215' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:43:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:18.261900+0000 mgr.smithi008.flmjzp (mgr.14640) 2670 : audit [DBG] from='client.36276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:19.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:18.261900+0000 mgr.smithi008.flmjzp (mgr.14640) 2670 : audit [DBG] from='client.36276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:19.092945+0000 mgr.smithi008.flmjzp (mgr.14640) 2671 : cluster [DBG] pgmap v1839: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:20.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:19.092945+0000 mgr.smithi008.flmjzp (mgr.14640) 2671 : cluster [DBG] pgmap v1839: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:21.123736+0000 mon.smithi008 (mon.0) 3073 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:21.125822+0000 mon.smithi008 (mon.0) 3074 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:21.126867+0000 mon.smithi008 (mon.0) 3075 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:21.133805+0000 mon.smithi008 (mon.0) 3076 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:21.140379+0000 mon.smithi008 (mon.0) 3077 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:21.143431+0000 mon.smithi008 (mon.0) 3078 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:21.145206+0000 mon.smithi008 (mon.0) 3079 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:21.146867+0000 mon.smithi008 (mon.0) 3080 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:21.148952+0000 mon.smithi008 (mon.0) 3081 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:21.123736+0000 mon.smithi008 (mon.0) 3073 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:21.125822+0000 mon.smithi008 (mon.0) 3074 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:21.126867+0000 mon.smithi008 (mon.0) 3075 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:21.133805+0000 mon.smithi008 (mon.0) 3076 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:21.140379+0000 mon.smithi008 (mon.0) 3077 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:21.143431+0000 mon.smithi008 (mon.0) 3078 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:21.145206+0000 mon.smithi008 (mon.0) 3079 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:21.146867+0000 mon.smithi008 (mon.0) 3080 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:21.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:21.148952+0000 mon.smithi008 (mon.0) 3081 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:22.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:21.093587+0000 mgr.smithi008.flmjzp (mgr.14640) 2672 : cluster [DBG] pgmap v1840: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:22.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:21.127739+0000 mgr.smithi008.flmjzp (mgr.14640) 2673 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:21.128294+0000 mgr.smithi008.flmjzp (mgr.14640) 2674 : cluster [DBG] pgmap v1841: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:21.128535+0000 mgr.smithi008.flmjzp (mgr.14640) 2675 : cluster [DBG] pgmap v1842: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:22.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:21.150866+0000 mgr.smithi008.flmjzp (mgr.14640) 2676 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:22.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:21.093587+0000 mgr.smithi008.flmjzp (mgr.14640) 2672 : cluster [DBG] pgmap v1840: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:21.127739+0000 mgr.smithi008.flmjzp (mgr.14640) 2673 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:21.128294+0000 mgr.smithi008.flmjzp (mgr.14640) 2674 : cluster [DBG] pgmap v1841: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:21.128535+0000 mgr.smithi008.flmjzp (mgr.14640) 2675 : cluster [DBG] pgmap v1842: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:21.150866+0000 mgr.smithi008.flmjzp (mgr.14640) 2676 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:24.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:23.129116+0000 mgr.smithi008.flmjzp (mgr.14640) 2677 : cluster [DBG] pgmap v1843: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:24.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:23.129116+0000 mgr.smithi008.flmjzp (mgr.14640) 2677 : cluster [DBG] pgmap v1843: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:25.129751+0000 mgr.smithi008.flmjzp (mgr.14640) 2678 : cluster [DBG] pgmap v1844: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:26.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:25.129751+0000 mgr.smithi008.flmjzp (mgr.14640) 2678 : cluster [DBG] pgmap v1844: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:28.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:27.130415+0000 mgr.smithi008.flmjzp (mgr.14640) 2679 : cluster [DBG] pgmap v1845: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:29.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:27.130415+0000 mgr.smithi008.flmjzp (mgr.14640) 2679 : cluster [DBG] pgmap v1845: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:30.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:29.130954+0000 mgr.smithi008.flmjzp (mgr.14640) 2680 : cluster [DBG] pgmap v1846: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:29.130954+0000 mgr.smithi008.flmjzp (mgr.14640) 2680 : cluster [DBG] pgmap v1846: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:31.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:31.161176+0000 mon.smithi008 (mon.0) 3082 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:31.163286+0000 mon.smithi008 (mon.0) 3083 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:31.164265+0000 mon.smithi008 (mon.0) 3084 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:31.170960+0000 mon.smithi008 (mon.0) 3085 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:31.178877+0000 mon.smithi008 (mon.0) 3086 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:31.182417+0000 mon.smithi008 (mon.0) 3087 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:31.184358+0000 mon.smithi008 (mon.0) 3088 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:31.186287+0000 mon.smithi008 (mon.0) 3089 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:31.188932+0000 mon.smithi008 (mon.0) 3090 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:31.161176+0000 mon.smithi008 (mon.0) 3082 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:31.163286+0000 mon.smithi008 (mon.0) 3083 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:31.164265+0000 mon.smithi008 (mon.0) 3084 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:31.170960+0000 mon.smithi008 (mon.0) 3085 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:31.178877+0000 mon.smithi008 (mon.0) 3086 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:31.182417+0000 mon.smithi008 (mon.0) 3087 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:31.184358+0000 mon.smithi008 (mon.0) 3088 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:31.186287+0000 mon.smithi008 (mon.0) 3089 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:31.188932+0000 mon.smithi008 (mon.0) 3090 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:32.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:31.131686+0000 mgr.smithi008.flmjzp (mgr.14640) 2681 : cluster [DBG] pgmap v1847: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:31.165137+0000 mgr.smithi008.flmjzp (mgr.14640) 2682 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:31.165680+0000 mgr.smithi008.flmjzp (mgr.14640) 2683 : cluster [DBG] pgmap v1848: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:31.165954+0000 mgr.smithi008.flmjzp (mgr.14640) 2684 : cluster [DBG] pgmap v1849: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:31.191042+0000 mgr.smithi008.flmjzp (mgr.14640) 2685 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:31.131686+0000 mgr.smithi008.flmjzp (mgr.14640) 2681 : cluster [DBG] pgmap v1847: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:31.165137+0000 mgr.smithi008.flmjzp (mgr.14640) 2682 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:31.165680+0000 mgr.smithi008.flmjzp (mgr.14640) 2683 : cluster [DBG] pgmap v1848: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:31.165954+0000 mgr.smithi008.flmjzp (mgr.14640) 2684 : cluster [DBG] pgmap v1849: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:31.191042+0000 mgr.smithi008.flmjzp (mgr.14640) 2685 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:33.166339+0000 mgr.smithi008.flmjzp (mgr.14640) 2686 : cluster [DBG] pgmap v1850: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:35.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:33.166339+0000 mgr.smithi008.flmjzp (mgr.14640) 2686 : cluster [DBG] pgmap v1850: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:36.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:35.167059+0000 mgr.smithi008.flmjzp (mgr.14640) 2687 : cluster [DBG] pgmap v1851: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:35.167059+0000 mgr.smithi008.flmjzp (mgr.14640) 2687 : cluster [DBG] pgmap v1851: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:38.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:37.167713+0000 mgr.smithi008.flmjzp (mgr.14640) 2688 : cluster [DBG] pgmap v1852: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:37.167713+0000 mgr.smithi008.flmjzp (mgr.14640) 2688 : cluster [DBG] pgmap v1852: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:39.168370+0000 mgr.smithi008.flmjzp (mgr.14640) 2689 : cluster [DBG] pgmap v1853: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:39.168370+0000 mgr.smithi008.flmjzp (mgr.14640) 2689 : cluster [DBG] pgmap v1853: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:41.198767+0000 mon.smithi008 (mon.0) 3091 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:41.200897+0000 mon.smithi008 (mon.0) 3092 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:41.201969+0000 mon.smithi008 (mon.0) 3093 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:41.208851+0000 mon.smithi008 (mon.0) 3094 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:41.215283+0000 mon.smithi008 (mon.0) 3095 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:41.218516+0000 mon.smithi008 (mon.0) 3096 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:41.220100+0000 mon.smithi008 (mon.0) 3097 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:41.221647+0000 mon.smithi008 (mon.0) 3098 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:41.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:41.223547+0000 mon.smithi008 (mon.0) 3099 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:41.198767+0000 mon.smithi008 (mon.0) 3091 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:41.200897+0000 mon.smithi008 (mon.0) 3092 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:41.201969+0000 mon.smithi008 (mon.0) 3093 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:41.208851+0000 mon.smithi008 (mon.0) 3094 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:41.215283+0000 mon.smithi008 (mon.0) 3095 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:41.218516+0000 mon.smithi008 (mon.0) 3096 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:41.220100+0000 mon.smithi008 (mon.0) 3097 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:41.221647+0000 mon.smithi008 (mon.0) 3098 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:42.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:41.223547+0000 mon.smithi008 (mon.0) 3099 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:41.168859+0000 mgr.smithi008.flmjzp (mgr.14640) 2690 : cluster [DBG] pgmap v1854: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:41.202860+0000 mgr.smithi008.flmjzp (mgr.14640) 2691 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:41.203483+0000 mgr.smithi008.flmjzp (mgr.14640) 2692 : cluster [DBG] pgmap v1855: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:41.203844+0000 mgr.smithi008.flmjzp (mgr.14640) 2693 : cluster [DBG] pgmap v1856: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:41.225386+0000 mgr.smithi008.flmjzp (mgr.14640) 2694 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:41.168859+0000 mgr.smithi008.flmjzp (mgr.14640) 2690 : cluster [DBG] pgmap v1854: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:41.202860+0000 mgr.smithi008.flmjzp (mgr.14640) 2691 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:41.203483+0000 mgr.smithi008.flmjzp (mgr.14640) 2692 : cluster [DBG] pgmap v1855: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:41.203844+0000 mgr.smithi008.flmjzp (mgr.14640) 2693 : cluster [DBG] pgmap v1856: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:41.225386+0000 mgr.smithi008.flmjzp (mgr.14640) 2694 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:44.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:43.204421+0000 mgr.smithi008.flmjzp (mgr.14640) 2695 : cluster [DBG] pgmap v1857: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:45.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:43.204421+0000 mgr.smithi008.flmjzp (mgr.14640) 2695 : cluster [DBG] pgmap v1857: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:46.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:45.205064+0000 mgr.smithi008.flmjzp (mgr.14640) 2696 : cluster [DBG] pgmap v1858: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:45.205064+0000 mgr.smithi008.flmjzp (mgr.14640) 2696 : cluster [DBG] pgmap v1858: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:48.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.416+0000 7f204a5ea700 1 -- 172.21.15.8:0/1328850036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f204406a3b0 msgr2=0x7f204406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:48.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.416+0000 7f204a5ea700 1 --2- 172.21.15.8:0/1328850036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f204406a3b0 0x7f204406a830 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f2034004660 tx=0x7f2034009b30).stop 2023-10-18T21:43:48.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.416+0000 7f204a5ea700 1 -- 172.21.15.8:0/1328850036 shutdown_connections 2023-10-18T21:43:48.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.416+0000 7f204a5ea700 1 --2- 172.21.15.8:0/1328850036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f204406a3b0 0x7f204406a830 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.416+0000 7f204a5ea700 1 --2- 172.21.15.8:0/1328850036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204406b9c0 0x7f2044069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.416+0000 7f204a5ea700 1 -- 172.21.15.8:0/1328850036 >> 172.21.15.8:0/1328850036 conn(0x7f20440f1c90 msgr2=0x7f20440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:48.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.416+0000 7f204a5ea700 1 -- 172.21.15.8:0/1328850036 shutdown_connections 2023-10-18T21:43:48.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.416+0000 7f204a5ea700 1 -- 172.21.15.8:0/1328850036 wait complete. 2023-10-18T21:43:48.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.417+0000 7f204a5ea700 1 Processor -- start 2023-10-18T21:43:48.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.417+0000 7f204a5ea700 1 -- start start 2023-10-18T21:43:48.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.417+0000 7f204a5ea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204406a3b0 0x7f2044108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:48.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.417+0000 7f204a5ea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f204406b9c0 0x7f2044109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:48.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.417+0000 7f204a5ea700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2044109a10 con 0x7f204406b9c0 2023-10-18T21:43:48.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.417+0000 7f204a5ea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2044109b50 con 0x7f204406a3b0 2023-10-18T21:43:48.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.418+0000 7f2048de7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f204406b9c0 0x7f2044109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:48.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.418+0000 7f2048de7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f204406b9c0 0x7f2044109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40378/0 (socket says 172.21.15.8:40378) 2023-10-18T21:43:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.418+0000 7f2048de7700 1 -- 172.21.15.8:0/616562404 learned_addr learned my addr 172.21.15.8:0/616562404 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.418+0000 7f20495e8700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204406a3b0 0x7f2044108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:48.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.418+0000 7f2048de7700 1 -- 172.21.15.8:0/616562404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204406a3b0 msgr2=0x7f2044108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:48.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.418+0000 7f2048de7700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204406a3b0 0x7f2044108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.418+0000 7f2048de7700 1 -- 172.21.15.8:0/616562404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2034005040 con 0x7f204406b9c0 2023-10-18T21:43:48.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.418+0000 7f2048de7700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f204406b9c0 0x7f2044109460 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f2034009f50 tx=0x7f2034009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:48.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.418+0000 7f2039ffb700 1 -- 172.21.15.8:0/616562404 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2034018070 con 0x7f204406b9c0 2023-10-18T21:43:48.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.418+0000 7f2039ffb700 1 -- 172.21.15.8:0/616562404 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2034009630 con 0x7f204406b9c0 2023-10-18T21:43:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.419+0000 7f2039ffb700 1 -- 172.21.15.8:0/616562404 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f203401c3c0 con 0x7f204406b9c0 2023-10-18T21:43:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.419+0000 7f204a5ea700 1 -- 172.21.15.8:0/616562404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204410a490 con 0x7f204406b9c0 2023-10-18T21:43:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.419+0000 7f204a5ea700 1 -- 172.21.15.8:0/616562404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204410a9f0 con 0x7f204406b9c0 2023-10-18T21:43:48.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.420+0000 7f204a5ea700 1 -- 172.21.15.8:0/616562404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2044045ad0 con 0x7f204406b9c0 2023-10-18T21:43:48.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.421+0000 7f2039ffb700 1 -- 172.21.15.8:0/616562404 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f203401d420 con 0x7f204406b9c0 2023-10-18T21:43:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.422+0000 7f2039ffb700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2030060f70 0x7f2030063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.422+0000 7f2039ffb700 1 -- 172.21.15.8:0/616562404 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f203407e580 con 0x7f204406b9c0 2023-10-18T21:43:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.422+0000 7f20495e8700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2030060f70 0x7f2030063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:48.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.423+0000 7f20495e8700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2030060f70 0x7f2030063430 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f2040004c40 tx=0x7f204000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:48.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.426+0000 7f2039ffb700 1 -- 172.21.15.8:0/616562404 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2034051be0 con 0x7f204406b9c0 2023-10-18T21:43:48.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.624+0000 7f204a5ea700 1 -- 172.21.15.8:0/616562404 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f204410ac60 con 0x7f2030060f70 2023-10-18T21:43:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.625+0000 7f2039ffb700 1 -- 172.21.15.8:0/616562404 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f204410ac60 con 0x7f2030060f70 2023-10-18T21:43:48.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.627+0000 7f204a5ea700 1 -- 172.21.15.8:0/616562404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2030060f70 msgr2=0x7f2030063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:48.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.627+0000 7f204a5ea700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2030060f70 0x7f2030063430 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f2040004c40 tx=0x7f204000b040).stop 2023-10-18T21:43:48.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.627+0000 7f204a5ea700 1 -- 172.21.15.8:0/616562404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f204406b9c0 msgr2=0x7f2044109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:48.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.627+0000 7f204a5ea700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f204406b9c0 0x7f2044109460 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f2034009f50 tx=0x7f2034009b30).stop 2023-10-18T21:43:48.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.627+0000 7f204a5ea700 1 -- 172.21.15.8:0/616562404 shutdown_connections 2023-10-18T21:43:48.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.627+0000 7f204a5ea700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2030060f70 0x7f2030063430 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.627+0000 7f204a5ea700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f204406a3b0 0x7f2044108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.627+0000 7f204a5ea700 1 --2- 172.21.15.8:0/616562404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f204406b9c0 0x7f2044109460 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.627+0000 7f204a5ea700 1 -- 172.21.15.8:0/616562404 >> 172.21.15.8:0/616562404 conn(0x7f20440f1c90 msgr2=0x7f20440fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:48.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.628+0000 7f204a5ea700 1 -- 172.21.15.8:0/616562404 shutdown_connections 2023-10-18T21:43:48.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.628+0000 7f204a5ea700 1 -- 172.21.15.8:0/616562404 wait complete. 2023-10-18T21:43:48.644 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:43:48.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.766+0000 7f0c12420700 1 -- 172.21.15.8:0/1191440230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c0c0f77d0 msgr2=0x7f0c0c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:48.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.766+0000 7f0c12420700 1 --2- 172.21.15.8:0/1191440230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c0c0f77d0 0x7f0c0c0f7c30 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f0bfc004660 tx=0x7f0bfc009b30).stop 2023-10-18T21:43:48.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.766+0000 7f0c12420700 1 -- 172.21.15.8:0/1191440230 shutdown_connections 2023-10-18T21:43:48.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.766+0000 7f0c12420700 1 --2- 172.21.15.8:0/1191440230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c0c0f77d0 0x7f0c0c0f7c30 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.766+0000 7f0c12420700 1 --2- 172.21.15.8:0/1191440230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c0c0f6530 0x7f0c0c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.766+0000 7f0c12420700 1 -- 172.21.15.8:0/1191440230 >> 172.21.15.8:0/1191440230 conn(0x7f0c0c0f1c90 msgr2=0x7f0c0c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:48.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.766+0000 7f0c12420700 1 -- 172.21.15.8:0/1191440230 shutdown_connections 2023-10-18T21:43:48.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.766+0000 7f0c12420700 1 -- 172.21.15.8:0/1191440230 wait complete. 2023-10-18T21:43:48.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.767+0000 7f0c12420700 1 Processor -- start 2023-10-18T21:43:48.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.767+0000 7f0c12420700 1 -- start start 2023-10-18T21:43:48.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.767+0000 7f0c12420700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c0c0f6530 0x7f0c0c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:48.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.767+0000 7f0c12420700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c0c0f77d0 0x7f0c0c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:48.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.767+0000 7f0c12420700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c109970 con 0x7f0c0c0f6530 2023-10-18T21:43:48.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.767+0000 7f0c12420700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c109ab0 con 0x7f0c0c0f77d0 2023-10-18T21:43:48.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.767+0000 7f0c1141e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c0c0f6530 0x7f0c0c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:48.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.767+0000 7f0c1141e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c0c0f6530 0x7f0c0c108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40404/0 (socket says 172.21.15.8:40404) 2023-10-18T21:43:48.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.767+0000 7f0c1141e700 1 -- 172.21.15.8:0/3384514199 learned_addr learned my addr 172.21.15.8:0/3384514199 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:48.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.767+0000 7f0c10c1d700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c0c0f77d0 0x7f0c0c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:48.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.768+0000 7f0c1141e700 1 -- 172.21.15.8:0/3384514199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c0c0f77d0 msgr2=0x7f0c0c1093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:48.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.768+0000 7f0c1141e700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c0c0f77d0 0x7f0c0c1093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.768+0000 7f0c1141e700 1 -- 172.21.15.8:0/3384514199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc005040 con 0x7f0c0c0f6530 2023-10-18T21:43:48.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.768+0000 7f0c1141e700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c0c0f6530 0x7f0c0c108ed0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f0c0800e7c0 tx=0x7f0c0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.768+0000 7f0c01ffb700 1 -- 172.21.15.8:0/3384514199 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c080092e0 con 0x7f0c0c0f6530 2023-10-18T21:43:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.768+0000 7f0c01ffb700 1 -- 172.21.15.8:0/3384514199 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0c0800f040 con 0x7f0c0c0f6530 2023-10-18T21:43:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.768+0000 7f0c01ffb700 1 -- 172.21.15.8:0/3384514199 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c08014810 con 0x7f0c0c0f6530 2023-10-18T21:43:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.768+0000 7f0c12420700 1 -- 172.21.15.8:0/3384514199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c10a450 con 0x7f0c0c0f6530 2023-10-18T21:43:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.768+0000 7f0c12420700 1 -- 172.21.15.8:0/3384514199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c10a990 con 0x7f0c0c0f6530 2023-10-18T21:43:48.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.769+0000 7f0c12420700 1 -- 172.21.15.8:0/3384514199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0c045ad0 con 0x7f0c0c0f6530 2023-10-18T21:43:48.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.770+0000 7f0c01ffb700 1 -- 172.21.15.8:0/3384514199 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0c0801b030 con 0x7f0c0c0f6530 2023-10-18T21:43:48.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.771+0000 7f0c01ffb700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bf8060f70 0x7f0bf8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:48.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.771+0000 7f0c01ffb700 1 -- 172.21.15.8:0/3384514199 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0c0807c920 con 0x7f0c0c0f6530 2023-10-18T21:43:48.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.771+0000 7f0c10c1d700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bf8060f70 0x7f0bf8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:48.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.772+0000 7f0c10c1d700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bf8060f70 0x7f0bf8063430 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f0bfc005010 tx=0x7f0bfc016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:48.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.775+0000 7f0c01ffb700 1 -- 172.21.15.8:0/3384514199 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0c0804ff00 con 0x7f0c0c0f6530 2023-10-18T21:43:48.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.974+0000 7f0c12420700 1 -- 172.21.15.8:0/3384514199 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c0c10ac10 con 0x7f0bf8060f70 2023-10-18T21:43:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.975+0000 7f0c01ffb700 1 -- 172.21.15.8:0/3384514199 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0c0c10ac10 con 0x7f0bf8060f70 2023-10-18T21:43:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 -- 172.21.15.8:0/3384514199 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bf8060f70 msgr2=0x7f0bf8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bf8060f70 0x7f0bf8063430 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f0bfc005010 tx=0x7f0bfc016040).stop 2023-10-18T21:43:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 -- 172.21.15.8:0/3384514199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c0c0f6530 msgr2=0x7f0c0c108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c0c0f6530 0x7f0c0c108ed0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f0c0800e7c0 tx=0x7f0c0800b040).stop 2023-10-18T21:43:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 -- 172.21.15.8:0/3384514199 shutdown_connections 2023-10-18T21:43:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0bf8060f70 0x7f0bf8063430 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c0c0f6530 0x7f0c0c108ed0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 --2- 172.21.15.8:0/3384514199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c0c0f77d0 0x7f0c0c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 -- 172.21.15.8:0/3384514199 >> 172.21.15.8:0/3384514199 conn(0x7f0c0c0f1c90 msgr2=0x7f0c0c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 -- 172.21.15.8:0/3384514199 shutdown_connections 2023-10-18T21:43:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:48.977+0000 7f0c12420700 1 -- 172.21.15.8:0/3384514199 wait complete. 2023-10-18T21:43:48.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:47.205749+0000 mgr.smithi008.flmjzp (mgr.14640) 2697 : cluster [DBG] pgmap v1859: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.114+0000 7fa4709d0700 1 -- 172.21.15.8:0/1766580764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa46c0f77d0 msgr2=0x7fa46c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.114+0000 7fa4709d0700 1 --2- 172.21.15.8:0/1766580764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa46c0f77d0 0x7fa46c0f7c30 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fa460004660 tx=0x7fa460009b30).stop 2023-10-18T21:43:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.114+0000 7fa4709d0700 1 -- 172.21.15.8:0/1766580764 shutdown_connections 2023-10-18T21:43:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.114+0000 7fa4709d0700 1 --2- 172.21.15.8:0/1766580764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa46c0f77d0 0x7fa46c0f7c30 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.114+0000 7fa4709d0700 1 --2- 172.21.15.8:0/1766580764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c0f6530 0x7fa46c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.114+0000 7fa4709d0700 1 -- 172.21.15.8:0/1766580764 >> 172.21.15.8:0/1766580764 conn(0x7fa46c0f1c90 msgr2=0x7fa46c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:49.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.114+0000 7fa4709d0700 1 -- 172.21.15.8:0/1766580764 shutdown_connections 2023-10-18T21:43:49.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.114+0000 7fa4709d0700 1 -- 172.21.15.8:0/1766580764 wait complete. 2023-10-18T21:43:49.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.115+0000 7fa4709d0700 1 Processor -- start 2023-10-18T21:43:49.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.116+0000 7fa4709d0700 1 -- start start 2023-10-18T21:43:49.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.116+0000 7fa4709d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa46c0f6530 0x7fa46c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:49.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.116+0000 7fa4709d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c0f77d0 0x7fa46c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:49.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.116+0000 7fa4709d0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c06a380 con 0x7fa46c0f6530 2023-10-18T21:43:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.116+0000 7fa4709d0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c06a4c0 con 0x7fa46c0f77d0 2023-10-18T21:43:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.116+0000 7fa46ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa46c0f6530 0x7fa46c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.116+0000 7fa46ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa46c0f6530 0x7fa46c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40422/0 (socket says 172.21.15.8:40422) 2023-10-18T21:43:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.116+0000 7fa46ad9d700 1 -- 172.21.15.8:0/3982631510 learned_addr learned my addr 172.21.15.8:0/3982631510 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.116+0000 7fa46a59c700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c0f77d0 0x7fa46c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.117+0000 7fa46ad9d700 1 -- 172.21.15.8:0/3982631510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c0f77d0 msgr2=0x7fa46c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.117+0000 7fa46ad9d700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c0f77d0 0x7fa46c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.117+0000 7fa46ad9d700 1 -- 172.21.15.8:0/3982631510 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460005040 con 0x7fa46c0f6530 2023-10-18T21:43:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.117+0000 7fa46ad9d700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa46c0f6530 0x7fa46c06b9a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7fa45c00e7c0 tx=0x7fa45c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.117+0000 7fa4537fe700 1 -- 172.21.15.8:0/3982631510 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa45c0092e0 con 0x7fa46c0f6530 2023-10-18T21:43:49.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.117+0000 7fa4537fe700 1 -- 172.21.15.8:0/3982631510 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa45c00f040 con 0x7fa46c0f6530 2023-10-18T21:43:49.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.117+0000 7fa4709d0700 1 -- 172.21.15.8:0/3982631510 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c06a7a0 con 0x7fa46c0f6530 2023-10-18T21:43:49.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.117+0000 7fa4537fe700 1 -- 172.21.15.8:0/3982631510 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa45c014810 con 0x7fa46c0f6530 2023-10-18T21:43:49.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.117+0000 7fa4709d0700 1 -- 172.21.15.8:0/3982631510 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c10ed20 con 0x7fa46c0f6530 2023-10-18T21:43:49.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.119+0000 7fa4709d0700 1 -- 172.21.15.8:0/3982631510 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c045ad0 con 0x7fa46c0f6530 2023-10-18T21:43:49.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.119+0000 7fa4537fe700 1 -- 172.21.15.8:0/3982631510 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa45c01b030 con 0x7fa46c0f6530 2023-10-18T21:43:49.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.120+0000 7fa4537fe700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa454060f70 0x7fa454063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:49.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.120+0000 7fa4537fe700 1 -- 172.21.15.8:0/3982631510 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa45c07c860 con 0x7fa46c0f6530 2023-10-18T21:43:49.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.120+0000 7fa46a59c700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa454060f70 0x7fa454063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:49.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.121+0000 7fa46a59c700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa454060f70 0x7fa454063430 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fa460005010 tx=0x7fa460016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:49.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.124+0000 7fa4537fe700 1 -- 172.21.15.8:0/3982631510 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa45c04c4d0 con 0x7fa46c0f6530 2023-10-18T21:43:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:47.205749+0000 mgr.smithi008.flmjzp (mgr.14640) 2697 : cluster [DBG] pgmap v1859: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:49.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.319+0000 7fa4709d0700 1 -- 172.21.15.8:0/3982631510 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa46c0fedd0 con 0x7fa454060f70 2023-10-18T21:43:49.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.328+0000 7fa4537fe700 1 -- 172.21.15.8:0/3982631510 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa46c0fedd0 con 0x7fa454060f70 2023-10-18T21:43:49.745 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:43:49.745 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (50m) 8m ago 51m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:43:49.745 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (44m) 8m ago 51m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:43:49.745 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (44m) 6m ago 51m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:43:49.745 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (50m) 8m ago 51m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:43:49.746 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 47m - - 2023-10-18T21:43:49.746 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 47m - - 2023-10-18T21:43:49.746 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 47m - - 2023-10-18T21:43:49.746 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 47m - - 2023-10-18T21:43:49.747 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (45m) 8m ago 53m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:43:49.747 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (44m) 6m ago 51m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:43:49.747 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (44m) 8m ago 53m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:43:49.747 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (44m) 6m ago 50m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:43:49.747 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (51m) 8m ago 51m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:43:49.747 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (50m) 6m ago 50m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:43:49.748 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (44m) 8m ago 50m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:43:49.748 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (42m) 8m ago 50m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:43:49.748 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (41m) 8m ago 49m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:43:49.748 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (41m) 6m ago 49m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:43:49.748 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (40m) 6m ago 49m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:43:49.749 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (39m) 6m ago 49m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:43:49.749 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (46m) 8m ago 51m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:43:49.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 -- 172.21.15.8:0/3982631510 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa454060f70 msgr2=0x7fa454063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:49.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa454060f70 0x7fa454063430 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fa460005010 tx=0x7fa460016040).stop 2023-10-18T21:43:49.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 -- 172.21.15.8:0/3982631510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa46c0f6530 msgr2=0x7fa46c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:49.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa46c0f6530 0x7fa46c06b9a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7fa45c00e7c0 tx=0x7fa45c00b040).stop 2023-10-18T21:43:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 -- 172.21.15.8:0/3982631510 shutdown_connections 2023-10-18T21:43:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa454060f70 0x7fa454063430 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa46c0f6530 0x7fa46c06b9a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 --2- 172.21.15.8:0/3982631510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c0f77d0 0x7fa46c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 -- 172.21.15.8:0/3982631510 >> 172.21.15.8:0/3982631510 conn(0x7fa46c0f1c90 msgr2=0x7fa46c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:49.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 -- 172.21.15.8:0/3982631510 shutdown_connections 2023-10-18T21:43:49.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.331+0000 7fa4709d0700 1 -- 172.21.15.8:0/3982631510 wait complete. 2023-10-18T21:43:49.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.465+0000 7f5c3159a700 1 -- 172.21.15.8:0/1220664584 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c24013a50 con 0x7f5c340f6530 2023-10-18T21:43:49.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.465+0000 7f5c3359e700 1 -- 172.21.15.8:0/1220664584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c340f6530 msgr2=0x7f5c340f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:49.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.465+0000 7f5c3359e700 1 --2- 172.21.15.8:0/1220664584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c340f6530 0x7f5c340f6950 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f5c24004660 tx=0x7f5c24009b30).stop 2023-10-18T21:43:49.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.465+0000 7f5c3359e700 1 -- 172.21.15.8:0/1220664584 shutdown_connections 2023-10-18T21:43:49.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.465+0000 7f5c3359e700 1 --2- 172.21.15.8:0/1220664584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c340f77d0 0x7f5c340f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.465+0000 7f5c3359e700 1 --2- 172.21.15.8:0/1220664584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c340f6530 0x7f5c340f6950 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.465+0000 7f5c3359e700 1 -- 172.21.15.8:0/1220664584 >> 172.21.15.8:0/1220664584 conn(0x7f5c340f1c90 msgr2=0x7f5c340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:49.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.465+0000 7f5c3359e700 1 -- 172.21.15.8:0/1220664584 shutdown_connections 2023-10-18T21:43:49.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.465+0000 7f5c3359e700 1 -- 172.21.15.8:0/1220664584 wait complete. 2023-10-18T21:43:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.466+0000 7f5c3359e700 1 Processor -- start 2023-10-18T21:43:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.467+0000 7f5c3359e700 1 -- start start 2023-10-18T21:43:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.467+0000 7f5c3359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c340f6530 0x7f5c3410d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.467+0000 7f5c3359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c340f77d0 0x7f5c3410d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.467+0000 7f5c3359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3410ddb0 con 0x7f5c340f6530 2023-10-18T21:43:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.467+0000 7f5c3359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3410def0 con 0x7f5c340f77d0 2023-10-18T21:43:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c3259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c340f6530 0x7f5c3410d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c3259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c340f6530 0x7f5c3410d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40430/0 (socket says 172.21.15.8:40430) 2023-10-18T21:43:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c3259c700 1 -- 172.21.15.8:0/1566230648 learned_addr learned my addr 172.21.15.8:0/1566230648 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c31d9b700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c340f77d0 0x7f5c3410d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:49.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c3259c700 1 -- 172.21.15.8:0/1566230648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c340f77d0 msgr2=0x7f5c3410d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:49.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c3259c700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c340f77d0 0x7f5c3410d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c3259c700 1 -- 172.21.15.8:0/1566230648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c24005040 con 0x7f5c340f6530 2023-10-18T21:43:49.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c3259c700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c340f6530 0x7f5c3410d310 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f5c24014040 tx=0x7f5c2400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:49.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c22ffd700 1 -- 172.21.15.8:0/1566230648 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c24019070 con 0x7f5c340f6530 2023-10-18T21:43:49.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c22ffd700 1 -- 172.21.15.8:0/1566230648 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5c2401e420 con 0x7f5c340f6530 2023-10-18T21:43:49.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c3359e700 1 -- 172.21.15.8:0/1566230648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3410e830 con 0x7f5c340f6530 2023-10-18T21:43:49.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.468+0000 7f5c22ffd700 1 -- 172.21.15.8:0/1566230648 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c24014660 con 0x7f5c340f6530 2023-10-18T21:43:49.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.469+0000 7f5c3359e700 1 -- 172.21.15.8:0/1566230648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3410ed10 con 0x7f5c340f6530 2023-10-18T21:43:49.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.470+0000 7f5c3359e700 1 -- 172.21.15.8:0/1566230648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c34045ad0 con 0x7f5c340f6530 2023-10-18T21:43:49.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.471+0000 7f5c22ffd700 1 -- 172.21.15.8:0/1566230648 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5c2401e9e0 con 0x7f5c340f6530 2023-10-18T21:43:49.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.471+0000 7f5c22ffd700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c1c060f70 0x7f5c1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:49.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.471+0000 7f5c22ffd700 1 -- 172.21.15.8:0/1566230648 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5c2407dd00 con 0x7f5c340f6530 2023-10-18T21:43:49.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.472+0000 7f5c31d9b700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c1c060f70 0x7f5c1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:49.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.472+0000 7f5c31d9b700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c1c060f70 0x7f5c1c063430 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f5c28007f80 tx=0x7f5c2800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:49.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.475+0000 7f5c22ffd700 1 -- 172.21.15.8:0/1566230648 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5c24081030 con 0x7f5c340f6530 2023-10-18T21:43:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.727+0000 7f5c3359e700 1 -- 172.21.15.8:0/1566230648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c34027a00 con 0x7f5c340f6530 2023-10-18T21:43:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.728+0000 7f5c22ffd700 1 -- 172.21.15.8:0/1566230648 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5c24051420 con 0x7f5c340f6530 2023-10-18T21:43:49.761 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:43:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:43:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:43:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:43:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:43:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:43:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:43:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:43:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:43:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:43:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:43:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:43:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:43:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:43:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:43:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:43:49.764 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:43:49.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.730+0000 7f5c3359e700 1 -- 172.21.15.8:0/1566230648 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c1c060f70 msgr2=0x7f5c1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:49.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.730+0000 7f5c3359e700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c1c060f70 0x7f5c1c063430 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f5c28007f80 tx=0x7f5c2800b040).stop 2023-10-18T21:43:49.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.730+0000 7f5c3359e700 1 -- 172.21.15.8:0/1566230648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c340f6530 msgr2=0x7f5c3410d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:49.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.730+0000 7f5c3359e700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c340f6530 0x7f5c3410d310 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f5c24014040 tx=0x7f5c2400b040).stop 2023-10-18T21:43:49.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.731+0000 7f5c3359e700 1 -- 172.21.15.8:0/1566230648 shutdown_connections 2023-10-18T21:43:49.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.731+0000 7f5c3359e700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c1c060f70 0x7f5c1c063430 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.731+0000 7f5c3359e700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c340f6530 0x7f5c3410d310 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.731+0000 7f5c3359e700 1 --2- 172.21.15.8:0/1566230648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c340f77d0 0x7f5c3410d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.731+0000 7f5c3359e700 1 -- 172.21.15.8:0/1566230648 >> 172.21.15.8:0/1566230648 conn(0x7f5c340f1c90 msgr2=0x7f5c340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.731+0000 7f5c3359e700 1 -- 172.21.15.8:0/1566230648 shutdown_connections 2023-10-18T21:43:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.731+0000 7f5c3359e700 1 -- 172.21.15.8:0/1566230648 wait complete. 2023-10-18T21:43:49.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.867+0000 7f138b59e700 1 -- 172.21.15.8:0/4438024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0f99e0 msgr2=0x7f138c0f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:49.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.867+0000 7f138b59e700 1 --2- 172.21.15.8:0/4438024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0f99e0 0x7f138c0f9e40 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f1380004660 tx=0x7f1380009b30).stop 2023-10-18T21:43:49.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.867+0000 7f138b59e700 1 -- 172.21.15.8:0/4438024 shutdown_connections 2023-10-18T21:43:49.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.867+0000 7f138b59e700 1 --2- 172.21.15.8:0/4438024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0f99e0 0x7f138c0f9e40 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.867+0000 7f138b59e700 1 --2- 172.21.15.8:0/4438024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138c0f8740 0x7f138c0f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.867+0000 7f138b59e700 1 -- 172.21.15.8:0/4438024 >> 172.21.15.8:0/4438024 conn(0x7f138c0f40e0 msgr2=0x7f138c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:49.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.867+0000 7f138b59e700 1 -- 172.21.15.8:0/4438024 shutdown_connections 2023-10-18T21:43:49.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.868+0000 7f138b59e700 1 -- 172.21.15.8:0/4438024 wait complete. 2023-10-18T21:43:49.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.869+0000 7f138b59e700 1 Processor -- start 2023-10-18T21:43:49.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.869+0000 7f138b59e700 1 -- start start 2023-10-18T21:43:49.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.869+0000 7f138b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138c0f8740 0x7f138c108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:49.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.869+0000 7f138b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0f99e0 0x7f138c109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:49.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.869+0000 7f138b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c1099e0 con 0x7f138c0f99e0 2023-10-18T21:43:49.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.869+0000 7f138b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c109b20 con 0x7f138c0f8740 2023-10-18T21:43:49.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.870+0000 7f1389d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0f99e0 0x7f138c109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:49.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.870+0000 7f1389d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0f99e0 0x7f138c109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40460/0 (socket says 172.21.15.8:40460) 2023-10-18T21:43:49.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.870+0000 7f1389d9b700 1 -- 172.21.15.8:0/2240294985 learned_addr learned my addr 172.21.15.8:0/2240294985 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:49.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.870+0000 7f138a59c700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138c0f8740 0x7f138c108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:49.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.870+0000 7f1389d9b700 1 -- 172.21.15.8:0/2240294985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138c0f8740 msgr2=0x7f138c108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:49.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.870+0000 7f1389d9b700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138c0f8740 0x7f138c108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:49.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.870+0000 7f1389d9b700 1 -- 172.21.15.8:0/2240294985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380005040 con 0x7f138c0f99e0 2023-10-18T21:43:49.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.870+0000 7f1389d9b700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0f99e0 0x7f138c109430 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f1380009990 tx=0x7f1380009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:49.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.871+0000 7f137affd700 1 -- 172.21.15.8:0/2240294985 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1380018070 con 0x7f138c0f99e0 2023-10-18T21:43:49.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.871+0000 7f138b59e700 1 -- 172.21.15.8:0/2240294985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c10a460 con 0x7f138c0f99e0 2023-10-18T21:43:49.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.871+0000 7f137affd700 1 -- 172.21.15.8:0/2240294985 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1380009630 con 0x7f138c0f99e0 2023-10-18T21:43:49.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.871+0000 7f137affd700 1 -- 172.21.15.8:0/2240294985 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138001c400 con 0x7f138c0f99e0 2023-10-18T21:43:49.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.871+0000 7f138b59e700 1 -- 172.21.15.8:0/2240294985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c10a9c0 con 0x7f138c0f99e0 2023-10-18T21:43:49.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.872+0000 7f138b59e700 1 -- 172.21.15.8:0/2240294985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c045ad0 con 0x7f138c0f99e0 2023-10-18T21:43:49.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.873+0000 7f137affd700 1 -- 172.21.15.8:0/2240294985 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f138001d9e0 con 0x7f138c0f99e0 2023-10-18T21:43:49.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.873+0000 7f137affd700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1374060f70 0x7f1374063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:49.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.874+0000 7f137affd700 1 -- 172.21.15.8:0/2240294985 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f138007e680 con 0x7f138c0f99e0 2023-10-18T21:43:49.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.874+0000 7f138a59c700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1374060f70 0x7f1374063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:49.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.874+0000 7f138a59c700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1374060f70 0x7f1374063430 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f138c0f9840 tx=0x7f137c009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:49.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:49.877+0000 7f137affd700 1 -- 172.21.15.8:0/2240294985 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1380051d20 con 0x7f138c0f99e0 2023-10-18T21:43:49.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:48.626415+0000 mgr.smithi008.flmjzp (mgr.14640) 2698 : audit [DBG] from='client.36280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:48.976382+0000 mgr.smithi008.flmjzp (mgr.14640) 2699 : audit [DBG] from='client.36284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:50.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.104+0000 7f138b59e700 1 -- 172.21.15.8:0/2240294985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f138c027a00 con 0x7f138c0f99e0 2023-10-18T21:43:50.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.105+0000 7f137affd700 1 -- 172.21.15.8:0/2240294985 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1380051910 con 0x7f138c0f99e0 2023-10-18T21:43:50.107 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:43:50.107 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:43:50.108 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:43:50.108 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:43:50.108 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:43:50.108 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:43:50.108 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:43:50.109 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:43:50.109 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:43:50.109 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:43:50.109 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:43:50.109 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:43:50.110 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:43:50.110 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:43:50.110 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:43:50.110 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:43:50.110 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:43:50.111 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:43:50.111 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:43:50.111 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:43:50.111 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:43:50.111 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:43:50.112 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:43:50.112 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:43:50.112 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:43:50.112 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:43:50.112 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:43:50.112 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:43:50.113 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:43:50.113 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:43:50.113 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:43:50.113 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:43:50.113 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:43:50.114 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:43:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 -- 172.21.15.8:0/2240294985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1374060f70 msgr2=0x7f1374063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1374060f70 0x7f1374063430 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f138c0f9840 tx=0x7f137c009c00).stop 2023-10-18T21:43:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 -- 172.21.15.8:0/2240294985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0f99e0 msgr2=0x7f138c109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0f99e0 0x7f138c109430 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f1380009990 tx=0x7f1380009b30).stop 2023-10-18T21:43:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 -- 172.21.15.8:0/2240294985 shutdown_connections 2023-10-18T21:43:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1374060f70 0x7f1374063430 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138c0f8740 0x7f138c108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 --2- 172.21.15.8:0/2240294985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f138c0f99e0 0x7f138c109430 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 -- 172.21.15.8:0/2240294985 >> 172.21.15.8:0/2240294985 conn(0x7f138c0f40e0 msgr2=0x7f138c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 -- 172.21.15.8:0/2240294985 shutdown_connections 2023-10-18T21:43:50.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.107+0000 7f138b59e700 1 -- 172.21.15.8:0/2240294985 wait complete. 2023-10-18T21:43:50.117 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:43:50.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:48.626415+0000 mgr.smithi008.flmjzp (mgr.14640) 2698 : audit [DBG] from='client.36280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:50.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:48.976382+0000 mgr.smithi008.flmjzp (mgr.14640) 2699 : audit [DBG] from='client.36284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:50.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.244+0000 7f640f59e700 1 -- 172.21.15.8:0/2796892112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64100f77d0 msgr2=0x7f64100f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:50.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.244+0000 7f640f59e700 1 --2- 172.21.15.8:0/2796892112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64100f77d0 0x7f64100f7c30 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f6404004660 tx=0x7f6404009b30).stop 2023-10-18T21:43:50.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.244+0000 7f640f59e700 1 -- 172.21.15.8:0/2796892112 shutdown_connections 2023-10-18T21:43:50.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.244+0000 7f640f59e700 1 --2- 172.21.15.8:0/2796892112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64100f77d0 0x7f64100f7c30 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:50.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.244+0000 7f640f59e700 1 --2- 172.21.15.8:0/2796892112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64100f6530 0x7f64100f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:50.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.244+0000 7f640f59e700 1 -- 172.21.15.8:0/2796892112 >> 172.21.15.8:0/2796892112 conn(0x7f64100f1c90 msgr2=0x7f64100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:50.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.244+0000 7f640f59e700 1 -- 172.21.15.8:0/2796892112 shutdown_connections 2023-10-18T21:43:50.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.245+0000 7f640f59e700 1 -- 172.21.15.8:0/2796892112 wait complete. 2023-10-18T21:43:50.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.245+0000 7f640f59e700 1 Processor -- start 2023-10-18T21:43:50.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.246+0000 7f640f59e700 1 -- start start 2023-10-18T21:43:50.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.246+0000 7f640f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64100f6530 0x7f6410108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:50.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.246+0000 7f640f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64100f77d0 0x7f6410109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:50.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.246+0000 7f640f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64101099c0 con 0x7f64100f77d0 2023-10-18T21:43:50.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.246+0000 7f640f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6410109b00 con 0x7f64100f6530 2023-10-18T21:43:50.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.246+0000 7f640dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64100f77d0 0x7f6410109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:50.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.246+0000 7f640dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64100f77d0 0x7f6410109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40486/0 (socket says 172.21.15.8:40486) 2023-10-18T21:43:50.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.246+0000 7f640dd9b700 1 -- 172.21.15.8:0/1930319425 learned_addr learned my addr 172.21.15.8:0/1930319425 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:43:50.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.246+0000 7f640e59c700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64100f6530 0x7f6410108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:50.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.247+0000 7f640dd9b700 1 -- 172.21.15.8:0/1930319425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64100f6530 msgr2=0x7f6410108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:50.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.247+0000 7f640dd9b700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64100f6530 0x7f6410108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:50.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.247+0000 7f640dd9b700 1 -- 172.21.15.8:0/1930319425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404005040 con 0x7f64100f77d0 2023-10-18T21:43:50.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.247+0000 7f640dd9b700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64100f77d0 0x7f6410109410 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f6404004320 tx=0x7f640400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:50.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.247+0000 7f63feffd700 1 -- 172.21.15.8:0/1930319425 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6404019070 con 0x7f64100f77d0 2023-10-18T21:43:50.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.247+0000 7f63feffd700 1 -- 172.21.15.8:0/1930319425 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f640401e420 con 0x7f64100f77d0 2023-10-18T21:43:50.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.247+0000 7f640f59e700 1 -- 172.21.15.8:0/1930319425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641010a440 con 0x7f64100f77d0 2023-10-18T21:43:50.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.247+0000 7f63feffd700 1 -- 172.21.15.8:0/1930319425 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6404014680 con 0x7f64100f77d0 2023-10-18T21:43:50.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.247+0000 7f640f59e700 1 -- 172.21.15.8:0/1930319425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641010a920 con 0x7f64100f77d0 2023-10-18T21:43:50.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.248+0000 7f640f59e700 1 -- 172.21.15.8:0/1930319425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6410045ad0 con 0x7f64100f77d0 2023-10-18T21:43:50.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.249+0000 7f63feffd700 1 -- 172.21.15.8:0/1930319425 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f640401e590 con 0x7f64100f77d0 2023-10-18T21:43:50.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.250+0000 7f63feffd700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f63f8060f70 0x7f63f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:43:50.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.250+0000 7f63feffd700 1 -- 172.21.15.8:0/1930319425 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f640407dd10 con 0x7f64100f77d0 2023-10-18T21:43:50.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.250+0000 7f640e59c700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f63f8060f70 0x7f63f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:43:50.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.251+0000 7f640e59c700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f63f8060f70 0x7f63f8063430 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f6400009fd0 tx=0x7f640000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:43:50.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.254+0000 7f63feffd700 1 -- 172.21.15.8:0/1930319425 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6404051310 con 0x7f64100f77d0 2023-10-18T21:43:50.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.451+0000 7f640f59e700 1 -- 172.21.15.8:0/1930319425 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64100fee30 con 0x7f63f8060f70 2023-10-18T21:43:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.452+0000 7f63feffd700 1 -- 172.21.15.8:0/1930319425 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f64100fee30 con 0x7f63f8060f70 2023-10-18T21:43:50.455 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:43:50.455 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:43:50.455 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:43:50.455 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:43:50.455 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:43:50.456 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:43:50.456 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:43:50.456 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:43:50.456 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:43:50.456 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:43:50.457 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:43:50.457 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:43:50.457 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:43:50.457 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:43:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.454+0000 7f640f59e700 1 -- 172.21.15.8:0/1930319425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f63f8060f70 msgr2=0x7f63f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.454+0000 7f640f59e700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f63f8060f70 0x7f63f8063430 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f6400009fd0 tx=0x7f640000b040).stop 2023-10-18T21:43:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.454+0000 7f640f59e700 1 -- 172.21.15.8:0/1930319425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64100f77d0 msgr2=0x7f6410109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:43:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.454+0000 7f640f59e700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64100f77d0 0x7f6410109410 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f6404004320 tx=0x7f640400b040).stop 2023-10-18T21:43:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.455+0000 7f640f59e700 1 -- 172.21.15.8:0/1930319425 shutdown_connections 2023-10-18T21:43:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.455+0000 7f640f59e700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f63f8060f70 0x7f63f8063430 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.455+0000 7f640f59e700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64100f6530 0x7f6410108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.455+0000 7f640f59e700 1 --2- 172.21.15.8:0/1930319425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64100f77d0 0x7f6410109410 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:43:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.455+0000 7f640f59e700 1 -- 172.21.15.8:0/1930319425 >> 172.21.15.8:0/1930319425 conn(0x7f64100f1c90 msgr2=0x7f641006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:43:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.455+0000 7f640f59e700 1 -- 172.21.15.8:0/1930319425 shutdown_connections 2023-10-18T21:43:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:43:50.455+0000 7f640f59e700 1 -- 172.21.15.8:0/1930319425 wait complete. 2023-10-18T21:43:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:49.206187+0000 mgr.smithi008.flmjzp (mgr.14640) 2700 : cluster [DBG] pgmap v1860: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:49.321600+0000 mgr.smithi008.flmjzp (mgr.14640) 2701 : audit [DBG] from='client.36288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:49.730078+0000 mon.smithi008 (mon.0) 3100 : audit [DBG] from='client.? 172.21.15.8:0/1566230648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:50.106508+0000 mon.smithi008 (mon.0) 3101 : audit [DBG] from='client.? 172.21.15.8:0/2240294985' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:43:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:49.206187+0000 mgr.smithi008.flmjzp (mgr.14640) 2700 : cluster [DBG] pgmap v1860: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:49.321600+0000 mgr.smithi008.flmjzp (mgr.14640) 2701 : audit [DBG] from='client.36288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:49.730078+0000 mon.smithi008 (mon.0) 3100 : audit [DBG] from='client.? 172.21.15.8:0/1566230648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:51.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:50.106508+0000 mon.smithi008 (mon.0) 3101 : audit [DBG] from='client.? 172.21.15.8:0/2240294985' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:43:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:50.453837+0000 mgr.smithi008.flmjzp (mgr.14640) 2702 : audit [DBG] from='client.36300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:51.231071+0000 mon.smithi008 (mon.0) 3102 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:52.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:50.453837+0000 mgr.smithi008.flmjzp (mgr.14640) 2702 : audit [DBG] from='client.36300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:43:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:51.231071+0000 mon.smithi008 (mon.0) 3102 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:51.206985+0000 mgr.smithi008.flmjzp (mgr.14640) 2703 : cluster [DBG] pgmap v1861: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:51.798582+0000 mon.smithi008 (mon.0) 3103 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:51.799357+0000 mon.smithi008 (mon.0) 3104 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:51.800005+0000 mgr.smithi008.flmjzp (mgr.14640) 2704 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:51.800514+0000 mgr.smithi008.flmjzp (mgr.14640) 2705 : cluster [DBG] pgmap v1862: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:51.800778+0000 mgr.smithi008.flmjzp (mgr.14640) 2706 : cluster [DBG] pgmap v1863: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:51.804750+0000 mon.smithi008 (mon.0) 3105 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:51.809672+0000 mon.smithi008 (mon.0) 3106 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:51.812181+0000 mon.smithi008 (mon.0) 3107 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:51.813504+0000 mon.smithi008 (mon.0) 3108 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:51.814738+0000 mon.smithi008 (mon.0) 3109 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:53.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:43:51.816294+0000 mon.smithi008 (mon.0) 3110 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:53.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:43:51.817833+0000 mgr.smithi008.flmjzp (mgr.14640) 2707 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:53.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:51.206985+0000 mgr.smithi008.flmjzp (mgr.14640) 2703 : cluster [DBG] pgmap v1861: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:51.798582+0000 mon.smithi008 (mon.0) 3103 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:43:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:51.799357+0000 mon.smithi008 (mon.0) 3104 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:43:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:51.800005+0000 mgr.smithi008.flmjzp (mgr.14640) 2704 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:43:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:51.800514+0000 mgr.smithi008.flmjzp (mgr.14640) 2705 : cluster [DBG] pgmap v1862: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:51.800778+0000 mgr.smithi008.flmjzp (mgr.14640) 2706 : cluster [DBG] pgmap v1863: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:51.804750+0000 mon.smithi008 (mon.0) 3105 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:43:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:51.809672+0000 mon.smithi008 (mon.0) 3106 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:43:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:51.812181+0000 mon.smithi008 (mon.0) 3107 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:53.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:51.813504+0000 mon.smithi008 (mon.0) 3108 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:53.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:51.814738+0000 mon.smithi008 (mon.0) 3109 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:53.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:43:51.816294+0000 mon.smithi008 (mon.0) 3110 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:43:53.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:43:51.817833+0000 mgr.smithi008.flmjzp (mgr.14640) 2707 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:43:55.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:53.801414+0000 mgr.smithi008.flmjzp (mgr.14640) 2708 : cluster [DBG] pgmap v1864: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:55.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:53.801414+0000 mgr.smithi008.flmjzp (mgr.14640) 2708 : cluster [DBG] pgmap v1864: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:55.802005+0000 mgr.smithi008.flmjzp (mgr.14640) 2709 : cluster [DBG] pgmap v1865: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:56.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:55.802005+0000 mgr.smithi008.flmjzp (mgr.14640) 2709 : cluster [DBG] pgmap v1865: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:43:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:57.802594+0000 mgr.smithi008.flmjzp (mgr.14640) 2710 : cluster [DBG] pgmap v1866: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:43:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:43:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:57.802594+0000 mgr.smithi008.flmjzp (mgr.14640) 2710 : cluster [DBG] pgmap v1866: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:43:59.803218+0000 mgr.smithi008.flmjzp (mgr.14640) 2711 : cluster [DBG] pgmap v1867: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:43:59.803218+0000 mgr.smithi008.flmjzp (mgr.14640) 2711 : cluster [DBG] pgmap v1867: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:01.826363+0000 mon.smithi008 (mon.0) 3111 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:01.828581+0000 mon.smithi008 (mon.0) 3112 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:01.829584+0000 mon.smithi008 (mon.0) 3113 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:01.836052+0000 mon.smithi008 (mon.0) 3114 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:01.842556+0000 mon.smithi008 (mon.0) 3115 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:01.845597+0000 mon.smithi008 (mon.0) 3116 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:01.847311+0000 mon.smithi008 (mon.0) 3117 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:01.848891+0000 mon.smithi008 (mon.0) 3118 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:01.850808+0000 mon.smithi008 (mon.0) 3119 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:01.826363+0000 mon.smithi008 (mon.0) 3111 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:01.828581+0000 mon.smithi008 (mon.0) 3112 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:01.829584+0000 mon.smithi008 (mon.0) 3113 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:01.836052+0000 mon.smithi008 (mon.0) 3114 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:01.842556+0000 mon.smithi008 (mon.0) 3115 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:01.845597+0000 mon.smithi008 (mon.0) 3116 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:01.847311+0000 mon.smithi008 (mon.0) 3117 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:01.848891+0000 mon.smithi008 (mon.0) 3118 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:01.850808+0000 mon.smithi008 (mon.0) 3119 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:03.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:01.803722+0000 mgr.smithi008.flmjzp (mgr.14640) 2712 : cluster [DBG] pgmap v1868: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:03.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:01.830458+0000 mgr.smithi008.flmjzp (mgr.14640) 2713 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:03.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:01.831053+0000 mgr.smithi008.flmjzp (mgr.14640) 2714 : cluster [DBG] pgmap v1869: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:03.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:01.831369+0000 mgr.smithi008.flmjzp (mgr.14640) 2715 : cluster [DBG] pgmap v1870: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:03.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:01.852681+0000 mgr.smithi008.flmjzp (mgr.14640) 2716 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:03.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:01.803722+0000 mgr.smithi008.flmjzp (mgr.14640) 2712 : cluster [DBG] pgmap v1868: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:01.830458+0000 mgr.smithi008.flmjzp (mgr.14640) 2713 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:01.831053+0000 mgr.smithi008.flmjzp (mgr.14640) 2714 : cluster [DBG] pgmap v1869: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:01.831369+0000 mgr.smithi008.flmjzp (mgr.14640) 2715 : cluster [DBG] pgmap v1870: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:01.852681+0000 mgr.smithi008.flmjzp (mgr.14640) 2716 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:05.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:03.831877+0000 mgr.smithi008.flmjzp (mgr.14640) 2717 : cluster [DBG] pgmap v1871: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:05.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:03.831877+0000 mgr.smithi008.flmjzp (mgr.14640) 2717 : cluster [DBG] pgmap v1871: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:05.832528+0000 mgr.smithi008.flmjzp (mgr.14640) 2718 : cluster [DBG] pgmap v1872: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:06.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:05.832528+0000 mgr.smithi008.flmjzp (mgr.14640) 2718 : cluster [DBG] pgmap v1872: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:09.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:07.833116+0000 mgr.smithi008.flmjzp (mgr.14640) 2719 : cluster [DBG] pgmap v1873: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:09.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:07.833116+0000 mgr.smithi008.flmjzp (mgr.14640) 2719 : cluster [DBG] pgmap v1873: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:09.833787+0000 mgr.smithi008.flmjzp (mgr.14640) 2720 : cluster [DBG] pgmap v1874: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:11.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:09.833787+0000 mgr.smithi008.flmjzp (mgr.14640) 2720 : cluster [DBG] pgmap v1874: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:11.863059+0000 mon.smithi008 (mon.0) 3120 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:12.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:11.863059+0000 mon.smithi008 (mon.0) 3120 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:11.834357+0000 mgr.smithi008.flmjzp (mgr.14640) 2721 : cluster [DBG] pgmap v1875: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:13.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:12.420308+0000 mon.smithi008 (mon.0) 3121 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:13.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:12.421406+0000 mon.smithi008 (mon.0) 3122 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:13.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:12.428293+0000 mon.smithi008 (mon.0) 3123 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:13.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:12.434715+0000 mon.smithi008 (mon.0) 3124 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:13.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:12.437794+0000 mon.smithi008 (mon.0) 3125 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:13.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:12.439474+0000 mon.smithi008 (mon.0) 3126 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:13.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:12.441093+0000 mon.smithi008 (mon.0) 3127 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:13.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:12.443166+0000 mon.smithi008 (mon.0) 3128 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:13.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:11.834357+0000 mgr.smithi008.flmjzp (mgr.14640) 2721 : cluster [DBG] pgmap v1875: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:13.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:12.420308+0000 mon.smithi008 (mon.0) 3121 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:13.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:12.421406+0000 mon.smithi008 (mon.0) 3122 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:13.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:12.428293+0000 mon.smithi008 (mon.0) 3123 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:13.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:12.434715+0000 mon.smithi008 (mon.0) 3124 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:13.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:12.437794+0000 mon.smithi008 (mon.0) 3125 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:13.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:12.439474+0000 mon.smithi008 (mon.0) 3126 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:13.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:12.441093+0000 mon.smithi008 (mon.0) 3127 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:13.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:12.443166+0000 mon.smithi008 (mon.0) 3128 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:12.422307+0000 mgr.smithi008.flmjzp (mgr.14640) 2722 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:14.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:12.423022+0000 mgr.smithi008.flmjzp (mgr.14640) 2723 : cluster [DBG] pgmap v1876: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:14.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:12.423385+0000 mgr.smithi008.flmjzp (mgr.14640) 2724 : cluster [DBG] pgmap v1877: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:14.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:12.445060+0000 mgr.smithi008.flmjzp (mgr.14640) 2725 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:14.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:12.422307+0000 mgr.smithi008.flmjzp (mgr.14640) 2722 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:12.423022+0000 mgr.smithi008.flmjzp (mgr.14640) 2723 : cluster [DBG] pgmap v1876: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:12.423385+0000 mgr.smithi008.flmjzp (mgr.14640) 2724 : cluster [DBG] pgmap v1877: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:12.445060+0000 mgr.smithi008.flmjzp (mgr.14640) 2725 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:14.424072+0000 mgr.smithi008.flmjzp (mgr.14640) 2726 : cluster [DBG] pgmap v1878: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:16.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:14.424072+0000 mgr.smithi008.flmjzp (mgr.14640) 2726 : cluster [DBG] pgmap v1878: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:18.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:16.424630+0000 mgr.smithi008.flmjzp (mgr.14640) 2727 : cluster [DBG] pgmap v1879: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:18.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:16.424630+0000 mgr.smithi008.flmjzp (mgr.14640) 2727 : cluster [DBG] pgmap v1879: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:20.190 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:18.425291+0000 mgr.smithi008.flmjzp (mgr.14640) 2728 : cluster [DBG] pgmap v1880: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:20.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:18.425291+0000 mgr.smithi008.flmjzp (mgr.14640) 2728 : cluster [DBG] pgmap v1880: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:20.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.609+0000 7fe33ffff700 1 -- 172.21.15.8:0/771843075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3400f77d0 msgr2=0x7fe3400f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:20.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.609+0000 7fe33ffff700 1 --2- 172.21.15.8:0/771843075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3400f77d0 0x7fe3400f7c30 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7fe334004660 tx=0x7fe334009b30).stop 2023-10-18T21:44:20.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.609+0000 7fe33ffff700 1 -- 172.21.15.8:0/771843075 shutdown_connections 2023-10-18T21:44:20.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.609+0000 7fe33ffff700 1 --2- 172.21.15.8:0/771843075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3400f77d0 0x7fe3400f7c30 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:20.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.609+0000 7fe33ffff700 1 --2- 172.21.15.8:0/771843075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3400f6530 0x7fe3400f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:20.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.609+0000 7fe33ffff700 1 -- 172.21.15.8:0/771843075 >> 172.21.15.8:0/771843075 conn(0x7fe3400f1c90 msgr2=0x7fe3400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:20.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.609+0000 7fe33ffff700 1 -- 172.21.15.8:0/771843075 shutdown_connections 2023-10-18T21:44:20.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.609+0000 7fe33ffff700 1 -- 172.21.15.8:0/771843075 wait complete. 2023-10-18T21:44:20.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.610+0000 7fe33ffff700 1 Processor -- start 2023-10-18T21:44:20.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.610+0000 7fe33ffff700 1 -- start start 2023-10-18T21:44:20.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.611+0000 7fe33ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3400f6530 0x7fe340108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:20.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.611+0000 7fe33ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3400f77d0 0x7fe340109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:20.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.611+0000 7fe33ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3401099b0 con 0x7fe3400f77d0 2023-10-18T21:44:20.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.611+0000 7fe33ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe340109af0 con 0x7fe3400f6530 2023-10-18T21:44:20.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.611+0000 7fe33e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3400f77d0 0x7fe340109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:20.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.611+0000 7fe33e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3400f77d0 0x7fe340109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38870/0 (socket says 172.21.15.8:38870) 2023-10-18T21:44:20.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.611+0000 7fe33e7fc700 1 -- 172.21.15.8:0/1269922162 learned_addr learned my addr 172.21.15.8:0/1269922162 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:20.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.611+0000 7fe33effd700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3400f6530 0x7fe340108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:20.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.612+0000 7fe33e7fc700 1 -- 172.21.15.8:0/1269922162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3400f6530 msgr2=0x7fe340108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:20.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.612+0000 7fe33e7fc700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3400f6530 0x7fe340108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:20.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.612+0000 7fe33e7fc700 1 -- 172.21.15.8:0/1269922162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe334005040 con 0x7fe3400f77d0 2023-10-18T21:44:20.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.612+0000 7fe33e7fc700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3400f77d0 0x7fe340109400 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fe334009990 tx=0x7fe334009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:20.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.612+0000 7fe3277fe700 1 -- 172.21.15.8:0/1269922162 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe334018070 con 0x7fe3400f77d0 2023-10-18T21:44:20.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.612+0000 7fe3277fe700 1 -- 172.21.15.8:0/1269922162 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe334009630 con 0x7fe3400f77d0 2023-10-18T21:44:20.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.612+0000 7fe3277fe700 1 -- 172.21.15.8:0/1269922162 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe33401c400 con 0x7fe3400f77d0 2023-10-18T21:44:20.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.612+0000 7fe33ffff700 1 -- 172.21.15.8:0/1269922162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34010a430 con 0x7fe3400f77d0 2023-10-18T21:44:20.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.612+0000 7fe33ffff700 1 -- 172.21.15.8:0/1269922162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34010a940 con 0x7fe3400f77d0 2023-10-18T21:44:20.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.613+0000 7fe33ffff700 1 -- 172.21.15.8:0/1269922162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe340045ad0 con 0x7fe3400f77d0 2023-10-18T21:44:20.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.614+0000 7fe3277fe700 1 -- 172.21.15.8:0/1269922162 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe33401d9e0 con 0x7fe3400f77d0 2023-10-18T21:44:20.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.615+0000 7fe3277fe700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe328060f70 0x7fe328063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:20.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.615+0000 7fe3277fe700 1 -- 172.21.15.8:0/1269922162 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe33407e700 con 0x7fe3400f77d0 2023-10-18T21:44:20.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.615+0000 7fe33effd700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe328060f70 0x7fe328063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:20.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.616+0000 7fe33effd700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe328060f70 0x7fe328063430 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fe3400f7630 tx=0x7fe330009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:20.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.621+0000 7fe3277fe700 1 -- 172.21.15.8:0/1269922162 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe334051ce0 con 0x7fe3400f77d0 2023-10-18T21:44:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.821+0000 7fe33ffff700 1 -- 172.21.15.8:0/1269922162 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3400fedd0 con 0x7fe328060f70 2023-10-18T21:44:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.822+0000 7fe3277fe700 1 -- 172.21.15.8:0/1269922162 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe3400fedd0 con 0x7fe328060f70 2023-10-18T21:44:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 -- 172.21.15.8:0/1269922162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe328060f70 msgr2=0x7fe328063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe328060f70 0x7fe328063430 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fe3400f7630 tx=0x7fe330009c00).stop 2023-10-18T21:44:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 -- 172.21.15.8:0/1269922162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3400f77d0 msgr2=0x7fe340109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3400f77d0 0x7fe340109400 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fe334009990 tx=0x7fe334009b30).stop 2023-10-18T21:44:20.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 -- 172.21.15.8:0/1269922162 shutdown_connections 2023-10-18T21:44:20.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe328060f70 0x7fe328063430 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:20.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3400f6530 0x7fe340108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:20.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 --2- 172.21.15.8:0/1269922162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3400f77d0 0x7fe340109400 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 -- 172.21.15.8:0/1269922162 >> 172.21.15.8:0/1269922162 conn(0x7fe3400f1c90 msgr2=0x7fe34006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 -- 172.21.15.8:0/1269922162 shutdown_connections 2023-10-18T21:44:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.824+0000 7fe33ffff700 1 -- 172.21.15.8:0/1269922162 wait complete. 2023-10-18T21:44:20.839 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:44:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.962+0000 7fc31bfff700 1 -- 172.21.15.8:0/4136172433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31c0f77d0 msgr2=0x7fc31c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.962+0000 7fc31bfff700 1 --2- 172.21.15.8:0/4136172433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31c0f77d0 0x7fc31c0f7c30 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fc310004660 tx=0x7fc310009b30).stop 2023-10-18T21:44:20.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.962+0000 7fc31bfff700 1 -- 172.21.15.8:0/4136172433 shutdown_connections 2023-10-18T21:44:20.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.962+0000 7fc31bfff700 1 --2- 172.21.15.8:0/4136172433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31c0f77d0 0x7fc31c0f7c30 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:20.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.962+0000 7fc31bfff700 1 --2- 172.21.15.8:0/4136172433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc31c0f6530 0x7fc31c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:20.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.962+0000 7fc31bfff700 1 -- 172.21.15.8:0/4136172433 >> 172.21.15.8:0/4136172433 conn(0x7fc31c0f1c90 msgr2=0x7fc31c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:20.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.962+0000 7fc31bfff700 1 -- 172.21.15.8:0/4136172433 shutdown_connections 2023-10-18T21:44:20.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.962+0000 7fc31bfff700 1 -- 172.21.15.8:0/4136172433 wait complete. 2023-10-18T21:44:20.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.963+0000 7fc31bfff700 1 Processor -- start 2023-10-18T21:44:20.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.963+0000 7fc31bfff700 1 -- start start 2023-10-18T21:44:20.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc31c0f6530 0x7fc31c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:20.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31c0f77d0 0x7fc31c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:20.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c107880 con 0x7fc31c0f77d0 2023-10-18T21:44:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c1080c0 con 0x7fc31c0f6530 2023-10-18T21:44:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31c0f77d0 0x7fc31c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31c0f77d0 0x7fc31c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38888/0 (socket says 172.21.15.8:38888) 2023-10-18T21:44:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31a7fc700 1 -- 172.21.15.8:0/3868679619 learned_addr learned my addr 172.21.15.8:0/3868679619 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:20.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31affd700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc31c0f6530 0x7fc31c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:20.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31a7fc700 1 -- 172.21.15.8:0/3868679619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc31c0f6530 msgr2=0x7fc31c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:20.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31a7fc700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc31c0f6530 0x7fc31c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:20.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.964+0000 7fc31a7fc700 1 -- 172.21.15.8:0/3868679619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310005040 con 0x7fc31c0f77d0 2023-10-18T21:44:20.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.965+0000 7fc31a7fc700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31c0f77d0 0x7fc31c107280 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fc310009990 tx=0x7fc310009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:20.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.965+0000 7fc3037fe700 1 -- 172.21.15.8:0/3868679619 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc310018070 con 0x7fc31c0f77d0 2023-10-18T21:44:20.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.965+0000 7fc3037fe700 1 -- 172.21.15.8:0/3868679619 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc310009630 con 0x7fc31c0f77d0 2023-10-18T21:44:20.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.965+0000 7fc3037fe700 1 -- 172.21.15.8:0/3868679619 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc31001c400 con 0x7fc31c0f77d0 2023-10-18T21:44:20.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.965+0000 7fc31bfff700 1 -- 172.21.15.8:0/3868679619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c108340 con 0x7fc31c0f77d0 2023-10-18T21:44:20.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.965+0000 7fc31bfff700 1 -- 172.21.15.8:0/3868679619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c108820 con 0x7fc31c0f77d0 2023-10-18T21:44:20.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.966+0000 7fc31bfff700 1 -- 172.21.15.8:0/3868679619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c059100 con 0x7fc31c0f77d0 2023-10-18T21:44:20.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.967+0000 7fc3037fe700 1 -- 172.21.15.8:0/3868679619 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc31001d9e0 con 0x7fc31c0f77d0 2023-10-18T21:44:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.968+0000 7fc3037fe700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc304060f70 0x7fc304063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.968+0000 7fc3037fe700 1 -- 172.21.15.8:0/3868679619 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc31007e6f0 con 0x7fc31c0f77d0 2023-10-18T21:44:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.969+0000 7fc31affd700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc304060f70 0x7fc304063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:20.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.969+0000 7fc31affd700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc304060f70 0x7fc304063430 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fc31c107b50 tx=0x7fc30c009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:20.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:20.973+0000 7fc3037fe700 1 -- 172.21.15.8:0/3868679619 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc31004e2a0 con 0x7fc31c0f77d0 2023-10-18T21:44:21.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.171+0000 7fc31bfff700 1 -- 172.21.15.8:0/3868679619 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc31c0feda0 con 0x7fc304060f70 2023-10-18T21:44:21.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.172+0000 7fc3037fe700 1 -- 172.21.15.8:0/3868679619 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc31c0feda0 con 0x7fc304060f70 2023-10-18T21:44:21.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 -- 172.21.15.8:0/3868679619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc304060f70 msgr2=0x7fc304063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:21.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc304060f70 0x7fc304063430 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fc31c107b50 tx=0x7fc30c009c00).stop 2023-10-18T21:44:21.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 -- 172.21.15.8:0/3868679619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31c0f77d0 msgr2=0x7fc31c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:21.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31c0f77d0 0x7fc31c107280 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fc310009990 tx=0x7fc310009b30).stop 2023-10-18T21:44:21.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 -- 172.21.15.8:0/3868679619 shutdown_connections 2023-10-18T21:44:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc304060f70 0x7fc304063430 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc31c0f6530 0x7fc31c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 --2- 172.21.15.8:0/3868679619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31c0f77d0 0x7fc31c107280 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 -- 172.21.15.8:0/3868679619 >> 172.21.15.8:0/3868679619 conn(0x7fc31c0f1c90 msgr2=0x7fc31c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:21.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 -- 172.21.15.8:0/3868679619 shutdown_connections 2023-10-18T21:44:21.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.174+0000 7fc31bfff700 1 -- 172.21.15.8:0/3868679619 wait complete. 2023-10-18T21:44:21.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.309+0000 7fb7a951d700 1 -- 172.21.15.8:0/2412443009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7a40f6530 msgr2=0x7fb7a40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:21.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.309+0000 7fb7a951d700 1 --2- 172.21.15.8:0/2412443009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7a40f6530 0x7fb7a40f6950 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7fb794004660 tx=0x7fb794009b30).stop 2023-10-18T21:44:21.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.310+0000 7fb7a951d700 1 -- 172.21.15.8:0/2412443009 shutdown_connections 2023-10-18T21:44:21.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.310+0000 7fb7a951d700 1 --2- 172.21.15.8:0/2412443009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a40f77d0 0x7fb7a40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.310+0000 7fb7a951d700 1 --2- 172.21.15.8:0/2412443009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7a40f6530 0x7fb7a40f6950 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.310+0000 7fb7a951d700 1 -- 172.21.15.8:0/2412443009 >> 172.21.15.8:0/2412443009 conn(0x7fb7a40f1c90 msgr2=0x7fb7a40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:21.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.310+0000 7fb7a951d700 1 -- 172.21.15.8:0/2412443009 shutdown_connections 2023-10-18T21:44:21.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.310+0000 7fb7a951d700 1 -- 172.21.15.8:0/2412443009 wait complete. 2023-10-18T21:44:21.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.311+0000 7fb7a951d700 1 Processor -- start 2023-10-18T21:44:21.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.311+0000 7fb7a951d700 1 -- start start 2023-10-18T21:44:21.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.311+0000 7fb7a951d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7a40f77d0 0x7fb7a41090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:21.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.311+0000 7fb7a951d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a41095d0 0x7fb7a410a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:21.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.311+0000 7fb7a951d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4109aa0 con 0x7fb7a40f77d0 2023-10-18T21:44:21.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.311+0000 7fb7a951d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4109be0 con 0x7fb7a41095d0 2023-10-18T21:44:21.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.311+0000 7fb7a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7a40f77d0 0x7fb7a41090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:21.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.311+0000 7fb7a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7a40f77d0 0x7fb7a41090e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38904/0 (socket says 172.21.15.8:38904) 2023-10-18T21:44:21.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.311+0000 7fb7a3fff700 1 -- 172.21.15.8:0/3396008741 learned_addr learned my addr 172.21.15.8:0/3396008741 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:21.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.312+0000 7fb7a37fe700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a41095d0 0x7fb7a410a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:21.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.312+0000 7fb7a3fff700 1 -- 172.21.15.8:0/3396008741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a41095d0 msgr2=0x7fb7a410a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:21.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.312+0000 7fb7a3fff700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a41095d0 0x7fb7a410a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.312+0000 7fb7a3fff700 1 -- 172.21.15.8:0/3396008741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794005040 con 0x7fb7a40f77d0 2023-10-18T21:44:21.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.312+0000 7fb7a3fff700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7a40f77d0 0x7fb7a41090e0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7fb794011000 tx=0x7fb794009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:21.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.312+0000 7fb7a0ff9700 1 -- 172.21.15.8:0/3396008741 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb794013380 con 0x7fb7a40f77d0 2023-10-18T21:44:21.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.312+0000 7fb7a951d700 1 -- 172.21.15.8:0/3396008741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a410aa10 con 0x7fb7a40f77d0 2023-10-18T21:44:21.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.312+0000 7fb7a0ff9700 1 -- 172.21.15.8:0/3396008741 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb79401e440 con 0x7fb7a40f77d0 2023-10-18T21:44:21.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.312+0000 7fb7a0ff9700 1 -- 172.21.15.8:0/3396008741 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb794014680 con 0x7fb7a40f77d0 2023-10-18T21:44:21.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.313+0000 7fb7a951d700 1 -- 172.21.15.8:0/3396008741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a410aef0 con 0x7fb7a40f77d0 2023-10-18T21:44:21.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.313+0000 7fb7a951d700 1 -- 172.21.15.8:0/3396008741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a4059100 con 0x7fb7a40f77d0 2023-10-18T21:44:21.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.314+0000 7fb7a0ff9700 1 -- 172.21.15.8:0/3396008741 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb794025060 con 0x7fb7a40f77d0 2023-10-18T21:44:21.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.315+0000 7fb7a0ff9700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb78c060f70 0x7fb78c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:21.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.315+0000 7fb7a0ff9700 1 -- 172.21.15.8:0/3396008741 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb79407dd20 con 0x7fb7a40f77d0 2023-10-18T21:44:21.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.316+0000 7fb7a37fe700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb78c060f70 0x7fb78c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:21.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.316+0000 7fb7a37fe700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb78c060f70 0x7fb78c063430 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fb798009fd0 tx=0x7fb79800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:21.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.319+0000 7fb7a0ff9700 1 -- 172.21.15.8:0/3396008741 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb794082070 con 0x7fb7a40f77d0 2023-10-18T21:44:21.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.510+0000 7fb7a951d700 1 -- 172.21.15.8:0/3396008741 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7a4027aa0 con 0x7fb78c060f70 2023-10-18T21:44:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.519+0000 7fb7a0ff9700 1 -- 172.21.15.8:0/3396008741 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb7a4027aa0 con 0x7fb78c060f70 2023-10-18T21:44:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:44:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (51m) 8m ago 52m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:44:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (44m) 8m ago 52m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:44:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (44m) 6m ago 51m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:44:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (50m) 8m ago 52m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:44:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 48m - - 2023-10-18T21:44:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 48m - - 2023-10-18T21:44:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 48m - - 2023-10-18T21:44:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 48m - - 2023-10-18T21:44:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (46m) 8m ago 53m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:44:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (45m) 6m ago 51m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:44:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (45m) 8m ago 53m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:44:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (45m) 6m ago 51m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:44:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (52m) 8m ago 51m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:44:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (51m) 6m ago 51m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:44:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (44m) 8m ago 51m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:44:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (42m) 8m ago 50m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:44:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (42m) 8m ago 50m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:44:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (41m) 6m ago 50m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:44:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (40m) 6m ago 49m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:44:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (40m) 6m ago 49m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:44:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (46m) 8m ago 51m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:44:21.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.521+0000 7fb7a951d700 1 -- 172.21.15.8:0/3396008741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb78c060f70 msgr2=0x7fb78c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:21.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.521+0000 7fb7a951d700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb78c060f70 0x7fb78c063430 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fb798009fd0 tx=0x7fb79800b040).stop 2023-10-18T21:44:21.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.521+0000 7fb7a951d700 1 -- 172.21.15.8:0/3396008741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7a40f77d0 msgr2=0x7fb7a41090e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.521+0000 7fb7a951d700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7a40f77d0 0x7fb7a41090e0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7fb794011000 tx=0x7fb794009b30).stop 2023-10-18T21:44:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.521+0000 7fb7a951d700 1 -- 172.21.15.8:0/3396008741 shutdown_connections 2023-10-18T21:44:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.521+0000 7fb7a951d700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb78c060f70 0x7fb78c063430 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.521+0000 7fb7a951d700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7a40f77d0 0x7fb7a41090e0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.521+0000 7fb7a951d700 1 --2- 172.21.15.8:0/3396008741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a41095d0 0x7fb7a410a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.522+0000 7fb7a951d700 1 -- 172.21.15.8:0/3396008741 >> 172.21.15.8:0/3396008741 conn(0x7fb7a40f1c90 msgr2=0x7fb7a406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.522+0000 7fb7a951d700 1 -- 172.21.15.8:0/3396008741 shutdown_connections 2023-10-18T21:44:21.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.522+0000 7fb7a951d700 1 -- 172.21.15.8:0/3396008741 wait complete. 2023-10-18T21:44:21.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.658+0000 7f826bfff700 1 -- 172.21.15.8:0/235962747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c0f6530 msgr2=0x7f826c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:21.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.658+0000 7f826bfff700 1 --2- 172.21.15.8:0/235962747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c0f6530 0x7f826c0f6950 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f825c004660 tx=0x7f825c009b30).stop 2023-10-18T21:44:21.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.658+0000 7f826bfff700 1 -- 172.21.15.8:0/235962747 shutdown_connections 2023-10-18T21:44:21.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.658+0000 7f826bfff700 1 --2- 172.21.15.8:0/235962747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f826c0f77d0 0x7f826c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.658+0000 7f826bfff700 1 --2- 172.21.15.8:0/235962747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c0f6530 0x7f826c0f6950 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.658+0000 7f826bfff700 1 -- 172.21.15.8:0/235962747 >> 172.21.15.8:0/235962747 conn(0x7f826c0f1c90 msgr2=0x7f826c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:21.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.658+0000 7f826bfff700 1 -- 172.21.15.8:0/235962747 shutdown_connections 2023-10-18T21:44:21.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.658+0000 7f826bfff700 1 -- 172.21.15.8:0/235962747 wait complete. 2023-10-18T21:44:21.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.659+0000 7f826bfff700 1 Processor -- start 2023-10-18T21:44:21.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.659+0000 7f826bfff700 1 -- start start 2023-10-18T21:44:21.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.659+0000 7f826bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c0f6530 0x7f826c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:21.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.659+0000 7f826bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f826c0f77d0 0x7f826c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:21.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.660+0000 7f826bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c06a380 con 0x7f826c0f6530 2023-10-18T21:44:21.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.660+0000 7f826bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c06a4c0 con 0x7f826c0f77d0 2023-10-18T21:44:21.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.660+0000 7f826affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c0f6530 0x7f826c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:21.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.660+0000 7f826affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c0f6530 0x7f826c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38924/0 (socket says 172.21.15.8:38924) 2023-10-18T21:44:21.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.660+0000 7f826affd700 1 -- 172.21.15.8:0/3639841979 learned_addr learned my addr 172.21.15.8:0/3639841979 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:21.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.660+0000 7f826a7fc700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f826c0f77d0 0x7f826c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.660+0000 7f826affd700 1 -- 172.21.15.8:0/3639841979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f826c0f77d0 msgr2=0x7f826c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.660+0000 7f826affd700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f826c0f77d0 0x7f826c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.660+0000 7f826affd700 1 -- 172.21.15.8:0/3639841979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c005040 con 0x7f826c0f6530 2023-10-18T21:44:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.661+0000 7f826affd700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c0f6530 0x7f826c06b9a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f825c009f50 tx=0x7f825c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:21.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.661+0000 7f82537fe700 1 -- 172.21.15.8:0/3639841979 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f825c018070 con 0x7f826c0f6530 2023-10-18T21:44:21.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.661+0000 7f82537fe700 1 -- 172.21.15.8:0/3639841979 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f825c01d8e0 con 0x7f826c0f6530 2023-10-18T21:44:21.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.661+0000 7f826bfff700 1 -- 172.21.15.8:0/3639841979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c06a740 con 0x7f826c0f6530 2023-10-18T21:44:21.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.661+0000 7f82537fe700 1 -- 172.21.15.8:0/3639841979 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f825c01c440 con 0x7f826c0f6530 2023-10-18T21:44:21.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.661+0000 7f826bfff700 1 -- 172.21.15.8:0/3639841979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c06aca0 con 0x7f826c0f6530 2023-10-18T21:44:21.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.662+0000 7f826bfff700 1 -- 172.21.15.8:0/3639841979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826c045ad0 con 0x7f826c0f6530 2023-10-18T21:44:21.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.663+0000 7f82537fe700 1 -- 172.21.15.8:0/3639841979 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f825c01da50 con 0x7f826c0f6530 2023-10-18T21:44:21.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.664+0000 7f82537fe700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8254060f70 0x7f8254063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:21.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.664+0000 7f82537fe700 1 -- 172.21.15.8:0/3639841979 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f825c07e7c0 con 0x7f826c0f6530 2023-10-18T21:44:21.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.664+0000 7f826a7fc700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8254060f70 0x7f8254063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:21.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.665+0000 7f826a7fc700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8254060f70 0x7f8254063430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f8260007fd0 tx=0x7f8260009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:21.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.668+0000 7f82537fe700 1 -- 172.21.15.8:0/3639841979 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f825c04e370 con 0x7f826c0f6530 2023-10-18T21:44:21.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.922+0000 7f826bfff700 1 -- 172.21.15.8:0/3639841979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f826c0fed60 con 0x7f826c0f6530 2023-10-18T21:44:21.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.922+0000 7f82537fe700 1 -- 172.21.15.8:0/3639841979 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f825c051990 con 0x7f826c0f6530 2023-10-18T21:44:21.923 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:44:21.924 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:44:21.924 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:44:21.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:44:21.924 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:44:21.924 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:44:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:44:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:44:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:44:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:44:21.925 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:44:21.926 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:44:21.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:44:21.926 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:44:21.926 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:44:21.926 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:44:21.927 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:44:21.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.924+0000 7f826bfff700 1 -- 172.21.15.8:0/3639841979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8254060f70 msgr2=0x7f8254063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:21.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.924+0000 7f826bfff700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8254060f70 0x7f8254063430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f8260007fd0 tx=0x7f8260009040).stop 2023-10-18T21:44:21.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.924+0000 7f826bfff700 1 -- 172.21.15.8:0/3639841979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c0f6530 msgr2=0x7f826c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:21.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.924+0000 7f826bfff700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c0f6530 0x7f826c06b9a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f825c009f50 tx=0x7f825c009b30).stop 2023-10-18T21:44:21.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.924+0000 7f826bfff700 1 -- 172.21.15.8:0/3639841979 shutdown_connections 2023-10-18T21:44:21.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.924+0000 7f826bfff700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8254060f70 0x7f8254063430 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.924+0000 7f826bfff700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f826c0f6530 0x7f826c06b9a0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.924+0000 7f826bfff700 1 --2- 172.21.15.8:0/3639841979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f826c0f77d0 0x7f826c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:21.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.924+0000 7f826bfff700 1 -- 172.21.15.8:0/3639841979 >> 172.21.15.8:0/3639841979 conn(0x7f826c0f1c90 msgr2=0x7f826c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:21.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.925+0000 7f826bfff700 1 -- 172.21.15.8:0/3639841979 shutdown_connections 2023-10-18T21:44:21.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:21.925+0000 7f826bfff700 1 -- 172.21.15.8:0/3639841979 wait complete. 2023-10-18T21:44:22.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.062+0000 7f494d127700 1 -- 172.21.15.8:0/242509920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49480f77d0 msgr2=0x7f49480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:22.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.062+0000 7f494d127700 1 --2- 172.21.15.8:0/242509920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49480f77d0 0x7f49480f7c30 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f493c004660 tx=0x7f493c009b30).stop 2023-10-18T21:44:22.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.062+0000 7f494d127700 1 -- 172.21.15.8:0/242509920 shutdown_connections 2023-10-18T21:44:22.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.062+0000 7f494d127700 1 --2- 172.21.15.8:0/242509920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49480f77d0 0x7f49480f7c30 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.062+0000 7f494d127700 1 --2- 172.21.15.8:0/242509920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49480f6530 0x7f49480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.062+0000 7f494d127700 1 -- 172.21.15.8:0/242509920 >> 172.21.15.8:0/242509920 conn(0x7f49480f1c90 msgr2=0x7f49480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:22.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.062+0000 7f494d127700 1 -- 172.21.15.8:0/242509920 shutdown_connections 2023-10-18T21:44:22.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.062+0000 7f494d127700 1 -- 172.21.15.8:0/242509920 wait complete. 2023-10-18T21:44:22.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.063+0000 7f494d127700 1 Processor -- start 2023-10-18T21:44:22.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.063+0000 7f494d127700 1 -- start start 2023-10-18T21:44:22.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.063+0000 7f494d127700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49480f6530 0x7f494806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:22.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f494d127700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49480f77d0 0x7f4948069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:22.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f494d127700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494806a380 con 0x7f49480f77d0 2023-10-18T21:44:22.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f494d127700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494806a4c0 con 0x7f49480f6530 2023-10-18T21:44:22.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f49477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49480f77d0 0x7f4948069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:22.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f49477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49480f77d0 0x7f4948069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38948/0 (socket says 172.21.15.8:38948) 2023-10-18T21:44:22.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f49477fe700 1 -- 172.21.15.8:0/2571551720 learned_addr learned my addr 172.21.15.8:0/2571551720 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:22.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f4947fff700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49480f6530 0x7f494806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:22.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f49477fe700 1 -- 172.21.15.8:0/2571551720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49480f6530 msgr2=0x7f494806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:22.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f49477fe700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49480f6530 0x7f494806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f49477fe700 1 -- 172.21.15.8:0/2571551720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c005040 con 0x7f49480f77d0 2023-10-18T21:44:22.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.064+0000 7f49477fe700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49480f77d0 0x7f4948069e20 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f493c009f50 tx=0x7f493c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:22.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.065+0000 7f4944ff9700 1 -- 172.21.15.8:0/2571551720 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f493c018070 con 0x7f49480f77d0 2023-10-18T21:44:22.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.065+0000 7f4944ff9700 1 -- 172.21.15.8:0/2571551720 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f493c009630 con 0x7f49480f77d0 2023-10-18T21:44:22.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.065+0000 7f4944ff9700 1 -- 172.21.15.8:0/2571551720 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f493c01c3c0 con 0x7f49480f77d0 2023-10-18T21:44:22.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.065+0000 7f494d127700 1 -- 172.21.15.8:0/2571551720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494806a740 con 0x7f49480f77d0 2023-10-18T21:44:22.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.065+0000 7f494d127700 1 -- 172.21.15.8:0/2571551720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494806aca0 con 0x7f49480f77d0 2023-10-18T21:44:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.066+0000 7f494d127700 1 -- 172.21.15.8:0/2571551720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4948045ad0 con 0x7f49480f77d0 2023-10-18T21:44:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.067+0000 7f4944ff9700 1 -- 172.21.15.8:0/2571551720 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f493c01d420 con 0x7f49480f77d0 2023-10-18T21:44:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.067+0000 7f4944ff9700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4930060f70 0x7f4930063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.068+0000 7f4944ff9700 1 -- 172.21.15.8:0/2571551720 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f493c07e600 con 0x7f49480f77d0 2023-10-18T21:44:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.068+0000 7f4947fff700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4930060f70 0x7f4930063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.068+0000 7f4947fff700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4930060f70 0x7f4930063430 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f494806b730 tx=0x7f4938009c80).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.072+0000 7f4944ff9700 1 -- 172.21.15.8:0/2571551720 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f493c04e310 con 0x7f49480f77d0 2023-10-18T21:44:22.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:20.425921+0000 mgr.smithi008.flmjzp (mgr.14640) 2729 : cluster [DBG] pgmap v1881: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:20.822206+0000 mgr.smithi008.flmjzp (mgr.14640) 2730 : audit [DBG] from='client.36304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:21.922843+0000 mon.smithi008 (mon.0) 3129 : audit [DBG] from='client.? 172.21.15.8:0/3639841979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.303+0000 7f494d127700 1 -- 172.21.15.8:0/2571551720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4948027a00 con 0x7f49480f77d0 2023-10-18T21:44:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.303+0000 7f4944ff9700 1 -- 172.21.15.8:0/2571551720 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f493c051930 con 0x7f49480f77d0 2023-10-18T21:44:22.304 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:44:22.305 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:44:22.305 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:44:22.305 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:44:22.305 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:44:22.306 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:44:22.306 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:44:22.306 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:44:22.306 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:44:22.306 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:44:22.306 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:44:22.307 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:44:22.307 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:44:22.307 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:44:22.307 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:44:22.307 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:44:22.308 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:44:22.308 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:44:22.308 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:44:22.308 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:44:22.308 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:44:22.309 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:44:22.309 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:44:22.309 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:44:22.309 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:44:22.309 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:44:22.310 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:44:22.310 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:44:22.310 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:44:22.310 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:44:22.310 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:44:22.311 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:44:22.311 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:44:22.311 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:44:22.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 -- 172.21.15.8:0/2571551720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4930060f70 msgr2=0x7f4930063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:22.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4930060f70 0x7f4930063430 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f494806b730 tx=0x7f4938009c80).stop 2023-10-18T21:44:22.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 -- 172.21.15.8:0/2571551720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49480f77d0 msgr2=0x7f4948069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:22.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49480f77d0 0x7f4948069e20 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f493c009f50 tx=0x7f493c009b30).stop 2023-10-18T21:44:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 -- 172.21.15.8:0/2571551720 shutdown_connections 2023-10-18T21:44:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4930060f70 0x7f4930063430 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49480f6530 0x7f494806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 --2- 172.21.15.8:0/2571551720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49480f77d0 0x7f4948069e20 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 -- 172.21.15.8:0/2571551720 >> 172.21.15.8:0/2571551720 conn(0x7f49480f1c90 msgr2=0x7f49480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 -- 172.21.15.8:0/2571551720 shutdown_connections 2023-10-18T21:44:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.305+0000 7f494d127700 1 -- 172.21.15.8:0/2571551720 wait complete. 2023-10-18T21:44:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:44:22.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:20.425921+0000 mgr.smithi008.flmjzp (mgr.14640) 2729 : cluster [DBG] pgmap v1881: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:22.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:20.822206+0000 mgr.smithi008.flmjzp (mgr.14640) 2730 : audit [DBG] from='client.36304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:22.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:21.922843+0000 mon.smithi008 (mon.0) 3129 : audit [DBG] from='client.? 172.21.15.8:0/3639841979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:22.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.442+0000 7fbecffff700 1 -- 172.21.15.8:0/4641985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbed00f6530 msgr2=0x7fbed00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:22.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.442+0000 7fbecffff700 1 --2- 172.21.15.8:0/4641985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbed00f6530 0x7fbed00f6950 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7fbec0004660 tx=0x7fbec0009b30).stop 2023-10-18T21:44:22.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.442+0000 7fbecffff700 1 -- 172.21.15.8:0/4641985 shutdown_connections 2023-10-18T21:44:22.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.442+0000 7fbecffff700 1 --2- 172.21.15.8:0/4641985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed00f77d0 0x7fbed00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.442+0000 7fbecffff700 1 --2- 172.21.15.8:0/4641985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbed00f6530 0x7fbed00f6950 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.442+0000 7fbecffff700 1 -- 172.21.15.8:0/4641985 >> 172.21.15.8:0/4641985 conn(0x7fbed00f1c90 msgr2=0x7fbed00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:22.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.442+0000 7fbecffff700 1 -- 172.21.15.8:0/4641985 shutdown_connections 2023-10-18T21:44:22.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.443+0000 7fbecffff700 1 -- 172.21.15.8:0/4641985 wait complete. 2023-10-18T21:44:22.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.444+0000 7fbecffff700 1 Processor -- start 2023-10-18T21:44:22.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.444+0000 7fbecffff700 1 -- start start 2023-10-18T21:44:22.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.444+0000 7fbecffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbed00f6530 0x7fbed0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:22.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.444+0000 7fbecffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed00f77d0 0x7fbed0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:22.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.444+0000 7fbecffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0107910 con 0x7fbed00f6530 2023-10-18T21:44:22.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.444+0000 7fbecffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0108120 con 0x7fbed00f77d0 2023-10-18T21:44:22.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.445+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbed00f6530 0x7fbed0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:22.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.445+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbed00f6530 0x7fbed0106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38972/0 (socket says 172.21.15.8:38972) 2023-10-18T21:44:22.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.445+0000 7fbeceffd700 1 -- 172.21.15.8:0/4280095986 learned_addr learned my addr 172.21.15.8:0/4280095986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:22.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.445+0000 7fbece7fc700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed00f77d0 0x7fbed0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:22.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.445+0000 7fbeceffd700 1 -- 172.21.15.8:0/4280095986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed00f77d0 msgr2=0x7fbed0107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:22.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.445+0000 7fbeceffd700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed00f77d0 0x7fbed0107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.445+0000 7fbeceffd700 1 -- 172.21.15.8:0/4280095986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0005040 con 0x7fbed00f6530 2023-10-18T21:44:22.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.445+0000 7fbeceffd700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbed00f6530 0x7fbed0106e20 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fbec0007a60 tx=0x7fbec0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:22.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.446+0000 7fbeb77fe700 1 -- 172.21.15.8:0/4280095986 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbec0018070 con 0x7fbed00f6530 2023-10-18T21:44:22.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.446+0000 7fbeb77fe700 1 -- 172.21.15.8:0/4280095986 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbec0009630 con 0x7fbed00f6530 2023-10-18T21:44:22.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.446+0000 7fbeb77fe700 1 -- 172.21.15.8:0/4280095986 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbec001c540 con 0x7fbed00f6530 2023-10-18T21:44:22.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.446+0000 7fbecffff700 1 -- 172.21.15.8:0/4280095986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed0108340 con 0x7fbed00f6530 2023-10-18T21:44:22.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.446+0000 7fbecffff700 1 -- 172.21.15.8:0/4280095986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed01088a0 con 0x7fbed00f6530 2023-10-18T21:44:22.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.447+0000 7fbecffff700 1 -- 172.21.15.8:0/4280095986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed0059100 con 0x7fbed00f6530 2023-10-18T21:44:22.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.448+0000 7fbeb77fe700 1 -- 172.21.15.8:0/4280095986 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbec001d420 con 0x7fbed00f6530 2023-10-18T21:44:22.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.448+0000 7fbeb77fe700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeb8060f70 0x7fbeb8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:22.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.449+0000 7fbeb77fe700 1 -- 172.21.15.8:0/4280095986 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbec007e6c0 con 0x7fbed00f6530 2023-10-18T21:44:22.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.449+0000 7fbece7fc700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeb8060f70 0x7fbeb8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:22.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.449+0000 7fbece7fc700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeb8060f70 0x7fbeb8063430 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fbec40096c0 tx=0x7fbec4009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:22.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.453+0000 7fbeb77fe700 1 -- 172.21.15.8:0/4280095986 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbec004e2f0 con 0x7fbed00f6530 2023-10-18T21:44:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.663+0000 7fbecffff700 1 -- 172.21.15.8:0/4280095986 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbed00fed30 con 0x7fbeb8060f70 2023-10-18T21:44:22.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.664+0000 7fbeb77fe700 1 -- 172.21.15.8:0/4280095986 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbed00fed30 con 0x7fbeb8060f70 2023-10-18T21:44:22.665 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:44:22.666 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:44:22.666 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:44:22.666 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:44:22.666 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:44:22.667 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:44:22.667 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:44:22.667 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:44:22.667 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:44:22.667 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:44:22.668 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:44:22.668 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:44:22.668 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:44:22.668 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:44:22.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.666+0000 7fbecffff700 1 -- 172.21.15.8:0/4280095986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeb8060f70 msgr2=0x7fbeb8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:22.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.666+0000 7fbecffff700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeb8060f70 0x7fbeb8063430 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fbec40096c0 tx=0x7fbec4009be0).stop 2023-10-18T21:44:22.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.666+0000 7fbecffff700 1 -- 172.21.15.8:0/4280095986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbed00f6530 msgr2=0x7fbed0106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:22.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.666+0000 7fbecffff700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbed00f6530 0x7fbed0106e20 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fbec0007a60 tx=0x7fbec0009b30).stop 2023-10-18T21:44:22.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.667+0000 7fbecffff700 1 -- 172.21.15.8:0/4280095986 shutdown_connections 2023-10-18T21:44:22.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.667+0000 7fbecffff700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeb8060f70 0x7fbeb8063430 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.667+0000 7fbecffff700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbed00f6530 0x7fbed0106e20 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.667+0000 7fbecffff700 1 --2- 172.21.15.8:0/4280095986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed00f77d0 0x7fbed0107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.667+0000 7fbecffff700 1 -- 172.21.15.8:0/4280095986 >> 172.21.15.8:0/4280095986 conn(0x7fbed00f1c90 msgr2=0x7fbed00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.667+0000 7fbecffff700 1 -- 172.21.15.8:0/4280095986 shutdown_connections 2023-10-18T21:44:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:22.667+0000 7fbecffff700 1 -- 172.21.15.8:0/4280095986 wait complete. 2023-10-18T21:44:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:21.172205+0000 mgr.smithi008.flmjzp (mgr.14640) 2731 : audit [DBG] from='client.36308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:21.511278+0000 mgr.smithi008.flmjzp (mgr.14640) 2732 : audit [DBG] from='client.36312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.303743+0000 mon.smithi008 (mon.0) 3130 : audit [DBG] from='client.? 172.21.15.8:0/2571551720' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:44:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.455013+0000 mon.smithi008 (mon.0) 3131 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:23.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.457151+0000 mon.smithi008 (mon.0) 3132 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:23.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.458026+0000 mon.smithi008 (mon.0) 3133 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:23.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.463883+0000 mon.smithi008 (mon.0) 3134 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:23.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.472576+0000 mon.smithi008 (mon.0) 3135 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:23.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.475607+0000 mon.smithi008 (mon.0) 3136 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:23.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.477317+0000 mon.smithi008 (mon.0) 3137 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:23.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.478994+0000 mon.smithi008 (mon.0) 3138 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:23.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.481299+0000 mon.smithi008 (mon.0) 3139 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:21.172205+0000 mgr.smithi008.flmjzp (mgr.14640) 2731 : audit [DBG] from='client.36308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:21.511278+0000 mgr.smithi008.flmjzp (mgr.14640) 2732 : audit [DBG] from='client.36312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.303743+0000 mon.smithi008 (mon.0) 3130 : audit [DBG] from='client.? 172.21.15.8:0/2571551720' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:44:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.455013+0000 mon.smithi008 (mon.0) 3131 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.457151+0000 mon.smithi008 (mon.0) 3132 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.458026+0000 mon.smithi008 (mon.0) 3133 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.463883+0000 mon.smithi008 (mon.0) 3134 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.472576+0000 mon.smithi008 (mon.0) 3135 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.475607+0000 mon.smithi008 (mon.0) 3136 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.477317+0000 mon.smithi008 (mon.0) 3137 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.478994+0000 mon.smithi008 (mon.0) 3138 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.481299+0000 mon.smithi008 (mon.0) 3139 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:22.426435+0000 mgr.smithi008.flmjzp (mgr.14640) 2733 : cluster [DBG] pgmap v1882: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:22.458796+0000 mgr.smithi008.flmjzp (mgr.14640) 2734 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:22.459338+0000 mgr.smithi008.flmjzp (mgr.14640) 2735 : cluster [DBG] pgmap v1883: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:22.459611+0000 mgr.smithi008.flmjzp (mgr.14640) 2736 : cluster [DBG] pgmap v1884: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:24.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:22.483666+0000 mgr.smithi008.flmjzp (mgr.14640) 2737 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:24.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:22.664769+0000 mgr.smithi008.flmjzp (mgr.14640) 2738 : audit [DBG] from='client.36324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:24.307 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:22.426435+0000 mgr.smithi008.flmjzp (mgr.14640) 2733 : cluster [DBG] pgmap v1882: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:24.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:22.458796+0000 mgr.smithi008.flmjzp (mgr.14640) 2734 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:24.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:22.459338+0000 mgr.smithi008.flmjzp (mgr.14640) 2735 : cluster [DBG] pgmap v1883: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:24.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:22.459611+0000 mgr.smithi008.flmjzp (mgr.14640) 2736 : cluster [DBG] pgmap v1884: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:24.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:22.483666+0000 mgr.smithi008.flmjzp (mgr.14640) 2737 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:24.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:22.664769+0000 mgr.smithi008.flmjzp (mgr.14640) 2738 : audit [DBG] from='client.36324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:26.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:24.460135+0000 mgr.smithi008.flmjzp (mgr.14640) 2739 : cluster [DBG] pgmap v1885: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:24.460135+0000 mgr.smithi008.flmjzp (mgr.14640) 2739 : cluster [DBG] pgmap v1885: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:26.460777+0000 mgr.smithi008.flmjzp (mgr.14640) 2740 : cluster [DBG] pgmap v1886: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:28.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:26.460777+0000 mgr.smithi008.flmjzp (mgr.14640) 2740 : cluster [DBG] pgmap v1886: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:30.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:28.461384+0000 mgr.smithi008.flmjzp (mgr.14640) 2741 : cluster [DBG] pgmap v1887: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:28.461384+0000 mgr.smithi008.flmjzp (mgr.14640) 2741 : cluster [DBG] pgmap v1887: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:30.462147+0000 mgr.smithi008.flmjzp (mgr.14640) 2742 : cluster [DBG] pgmap v1888: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:32.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:30.462147+0000 mgr.smithi008.flmjzp (mgr.14640) 2742 : cluster [DBG] pgmap v1888: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:32.492235+0000 mon.smithi008 (mon.0) 3140 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:32.494386+0000 mon.smithi008 (mon.0) 3141 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:32.495662+0000 mon.smithi008 (mon.0) 3142 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:32.502285+0000 mon.smithi008 (mon.0) 3143 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:33.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:32.508819+0000 mon.smithi008 (mon.0) 3144 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:33.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:32.512032+0000 mon.smithi008 (mon.0) 3145 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:33.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:32.513818+0000 mon.smithi008 (mon.0) 3146 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:33.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:32.515522+0000 mon.smithi008 (mon.0) 3147 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:33.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:32.517591+0000 mon.smithi008 (mon.0) 3148 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:32.492235+0000 mon.smithi008 (mon.0) 3140 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:32.494386+0000 mon.smithi008 (mon.0) 3141 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:32.495662+0000 mon.smithi008 (mon.0) 3142 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:32.502285+0000 mon.smithi008 (mon.0) 3143 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:32.508819+0000 mon.smithi008 (mon.0) 3144 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:33.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:32.512032+0000 mon.smithi008 (mon.0) 3145 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:33.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:32.513818+0000 mon.smithi008 (mon.0) 3146 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:33.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:32.515522+0000 mon.smithi008 (mon.0) 3147 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:33.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:32.517591+0000 mon.smithi008 (mon.0) 3148 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:34.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:32.462814+0000 mgr.smithi008.flmjzp (mgr.14640) 2743 : cluster [DBG] pgmap v1889: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:32.496560+0000 mgr.smithi008.flmjzp (mgr.14640) 2744 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:32.497152+0000 mgr.smithi008.flmjzp (mgr.14640) 2745 : cluster [DBG] pgmap v1890: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:32.497477+0000 mgr.smithi008.flmjzp (mgr.14640) 2746 : cluster [DBG] pgmap v1891: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:32.519561+0000 mgr.smithi008.flmjzp (mgr.14640) 2747 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:34.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:32.462814+0000 mgr.smithi008.flmjzp (mgr.14640) 2743 : cluster [DBG] pgmap v1889: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:34.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:32.496560+0000 mgr.smithi008.flmjzp (mgr.14640) 2744 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:34.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:32.497152+0000 mgr.smithi008.flmjzp (mgr.14640) 2745 : cluster [DBG] pgmap v1890: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:34.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:32.497477+0000 mgr.smithi008.flmjzp (mgr.14640) 2746 : cluster [DBG] pgmap v1891: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:34.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:32.519561+0000 mgr.smithi008.flmjzp (mgr.14640) 2747 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:34.498088+0000 mgr.smithi008.flmjzp (mgr.14640) 2748 : cluster [DBG] pgmap v1892: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:34.498088+0000 mgr.smithi008.flmjzp (mgr.14640) 2748 : cluster [DBG] pgmap v1892: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:38.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:36.498658+0000 mgr.smithi008.flmjzp (mgr.14640) 2749 : cluster [DBG] pgmap v1893: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:36.498658+0000 mgr.smithi008.flmjzp (mgr.14640) 2749 : cluster [DBG] pgmap v1893: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:40.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:38.499204+0000 mgr.smithi008.flmjzp (mgr.14640) 2750 : cluster [DBG] pgmap v1894: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:38.499204+0000 mgr.smithi008.flmjzp (mgr.14640) 2750 : cluster [DBG] pgmap v1894: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:42.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:40.499769+0000 mgr.smithi008.flmjzp (mgr.14640) 2751 : cluster [DBG] pgmap v1895: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:42.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:40.499769+0000 mgr.smithi008.flmjzp (mgr.14640) 2751 : cluster [DBG] pgmap v1895: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:43.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:42.521257+0000 mon.smithi008 (mon.0) 3149 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:42.523524+0000 mon.smithi008 (mon.0) 3150 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:42.524536+0000 mon.smithi008 (mon.0) 3151 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:42.530975+0000 mon.smithi008 (mon.0) 3152 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:42.537428+0000 mon.smithi008 (mon.0) 3153 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:43.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:42.540307+0000 mon.smithi008 (mon.0) 3154 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:43.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:42.542053+0000 mon.smithi008 (mon.0) 3155 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:43.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:42.543629+0000 mon.smithi008 (mon.0) 3156 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:43.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:42.545574+0000 mon.smithi008 (mon.0) 3157 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:43.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:42.521257+0000 mon.smithi008 (mon.0) 3149 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:42.523524+0000 mon.smithi008 (mon.0) 3150 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:42.524536+0000 mon.smithi008 (mon.0) 3151 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:42.530975+0000 mon.smithi008 (mon.0) 3152 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:42.537428+0000 mon.smithi008 (mon.0) 3153 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:42.540307+0000 mon.smithi008 (mon.0) 3154 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:42.542053+0000 mon.smithi008 (mon.0) 3155 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:42.543629+0000 mon.smithi008 (mon.0) 3156 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:42.545574+0000 mon.smithi008 (mon.0) 3157 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:44.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:42.500218+0000 mgr.smithi008.flmjzp (mgr.14640) 2752 : cluster [DBG] pgmap v1896: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:44.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:42.525425+0000 mgr.smithi008.flmjzp (mgr.14640) 2753 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:44.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:42.526025+0000 mgr.smithi008.flmjzp (mgr.14640) 2754 : cluster [DBG] pgmap v1897: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:44.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:42.526413+0000 mgr.smithi008.flmjzp (mgr.14640) 2755 : cluster [DBG] pgmap v1898: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:44.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:42.547421+0000 mgr.smithi008.flmjzp (mgr.14640) 2756 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:44.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:42.500218+0000 mgr.smithi008.flmjzp (mgr.14640) 2752 : cluster [DBG] pgmap v1896: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:42.525425+0000 mgr.smithi008.flmjzp (mgr.14640) 2753 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:42.526025+0000 mgr.smithi008.flmjzp (mgr.14640) 2754 : cluster [DBG] pgmap v1897: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:42.526413+0000 mgr.smithi008.flmjzp (mgr.14640) 2755 : cluster [DBG] pgmap v1898: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:42.547421+0000 mgr.smithi008.flmjzp (mgr.14640) 2756 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:44.526998+0000 mgr.smithi008.flmjzp (mgr.14640) 2757 : cluster [DBG] pgmap v1899: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:44.526998+0000 mgr.smithi008.flmjzp (mgr.14640) 2757 : cluster [DBG] pgmap v1899: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:46.527512+0000 mgr.smithi008.flmjzp (mgr.14640) 2758 : cluster [DBG] pgmap v1900: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:48.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:46.527512+0000 mgr.smithi008.flmjzp (mgr.14640) 2758 : cluster [DBG] pgmap v1900: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:48.528228+0000 mgr.smithi008.flmjzp (mgr.14640) 2759 : cluster [DBG] pgmap v1901: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:50.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:48.528228+0000 mgr.smithi008.flmjzp (mgr.14640) 2759 : cluster [DBG] pgmap v1901: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:50.528780+0000 mgr.smithi008.flmjzp (mgr.14640) 2760 : cluster [DBG] pgmap v1902: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:50.528780+0000 mgr.smithi008.flmjzp (mgr.14640) 2760 : cluster [DBG] pgmap v1902: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:52.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.811+0000 7fcde9642700 1 -- 172.21.15.8:0/262989483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcde40f77d0 msgr2=0x7fcde40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:52.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.811+0000 7fcde9642700 1 --2- 172.21.15.8:0/262989483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcde40f77d0 0x7fcde40f7c30 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fcdd8004660 tx=0x7fcdd8009b30).stop 2023-10-18T21:44:52.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.811+0000 7fcde9642700 1 -- 172.21.15.8:0/262989483 shutdown_connections 2023-10-18T21:44:52.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.811+0000 7fcde9642700 1 --2- 172.21.15.8:0/262989483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcde40f77d0 0x7fcde40f7c30 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:52.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.811+0000 7fcde9642700 1 --2- 172.21.15.8:0/262989483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40f6530 0x7fcde40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:52.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.811+0000 7fcde9642700 1 -- 172.21.15.8:0/262989483 >> 172.21.15.8:0/262989483 conn(0x7fcde40f1c90 msgr2=0x7fcde40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:52.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.811+0000 7fcde9642700 1 -- 172.21.15.8:0/262989483 shutdown_connections 2023-10-18T21:44:52.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.811+0000 7fcde9642700 1 -- 172.21.15.8:0/262989483 wait complete. 2023-10-18T21:44:52.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.812+0000 7fcde9642700 1 Processor -- start 2023-10-18T21:44:52.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.812+0000 7fcde9642700 1 -- start start 2023-10-18T21:44:52.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.812+0000 7fcde9642700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40f6530 0x7fcde406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:52.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.812+0000 7fcde9642700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcde40f77d0 0x7fcde4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:52.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.812+0000 7fcde9642700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde406a380 con 0x7fcde40f77d0 2023-10-18T21:44:52.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.812+0000 7fcde9642700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde406a4c0 con 0x7fcde40f6530 2023-10-18T21:44:52.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.813+0000 7fcde37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcde40f77d0 0x7fcde4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:52.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.813+0000 7fcde37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcde40f77d0 0x7fcde4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47772/0 (socket says 172.21.15.8:47772) 2023-10-18T21:44:52.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.813+0000 7fcde37fe700 1 -- 172.21.15.8:0/1127234719 learned_addr learned my addr 172.21.15.8:0/1127234719 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:52.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.813+0000 7fcde3fff700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40f6530 0x7fcde406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:52.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.813+0000 7fcde37fe700 1 -- 172.21.15.8:0/1127234719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40f6530 msgr2=0x7fcde406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:52.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.813+0000 7fcde37fe700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40f6530 0x7fcde406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:52.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.813+0000 7fcde37fe700 1 -- 172.21.15.8:0/1127234719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd8005040 con 0x7fcde40f77d0 2023-10-18T21:44:52.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.813+0000 7fcde37fe700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcde40f77d0 0x7fcde4069e20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7fcdd8009f50 tx=0x7fcdd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:52.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.814+0000 7fcde0ff9700 1 -- 172.21.15.8:0/1127234719 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd8018070 con 0x7fcde40f77d0 2023-10-18T21:44:52.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.814+0000 7fcde0ff9700 1 -- 172.21.15.8:0/1127234719 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcdd8009630 con 0x7fcde40f77d0 2023-10-18T21:44:52.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.814+0000 7fcde0ff9700 1 -- 172.21.15.8:0/1127234719 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd801c3c0 con 0x7fcde40f77d0 2023-10-18T21:44:52.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.814+0000 7fcde9642700 1 -- 172.21.15.8:0/1127234719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde406a740 con 0x7fcde40f77d0 2023-10-18T21:44:52.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.814+0000 7fcde9642700 1 -- 172.21.15.8:0/1127234719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde406aca0 con 0x7fcde40f77d0 2023-10-18T21:44:52.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.815+0000 7fcde9642700 1 -- 172.21.15.8:0/1127234719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde4045ad0 con 0x7fcde40f77d0 2023-10-18T21:44:52.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.816+0000 7fcde0ff9700 1 -- 172.21.15.8:0/1127234719 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcdd801d420 con 0x7fcde40f77d0 2023-10-18T21:44:52.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.817+0000 7fcde0ff9700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcdcc060f70 0x7fcdcc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.817+0000 7fcde0ff9700 1 -- 172.21.15.8:0/1127234719 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcdd807e540 con 0x7fcde40f77d0 2023-10-18T21:44:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.818+0000 7fcde3fff700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcdcc060f70 0x7fcdcc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.818+0000 7fcde3fff700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcdcc060f70 0x7fcdcc063430 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fcde406b730 tx=0x7fcdd400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:52.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:52.823+0000 7fcde0ff9700 1 -- 172.21.15.8:0/1127234719 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcdd804e170 con 0x7fcde40f77d0 2023-10-18T21:44:53.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.057+0000 7fcde9642700 1 -- 172.21.15.8:0/1127234719 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcde40fedd0 con 0x7fcdcc060f70 2023-10-18T21:44:53.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.058+0000 7fcde0ff9700 1 -- 172.21.15.8:0/1127234719 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcde40fedd0 con 0x7fcdcc060f70 2023-10-18T21:44:53.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 -- 172.21.15.8:0/1127234719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcdcc060f70 msgr2=0x7fcdcc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcdcc060f70 0x7fcdcc063430 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fcde406b730 tx=0x7fcdd400b040).stop 2023-10-18T21:44:53.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 -- 172.21.15.8:0/1127234719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcde40f77d0 msgr2=0x7fcde4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcde40f77d0 0x7fcde4069e20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7fcdd8009f50 tx=0x7fcdd8009b30).stop 2023-10-18T21:44:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 -- 172.21.15.8:0/1127234719 shutdown_connections 2023-10-18T21:44:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcdcc060f70 0x7fcdcc063430 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde40f6530 0x7fcde406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 --2- 172.21.15.8:0/1127234719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcde40f77d0 0x7fcde4069e20 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 -- 172.21.15.8:0/1127234719 >> 172.21.15.8:0/1127234719 conn(0x7fcde40f1c90 msgr2=0x7fcde40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:53.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 -- 172.21.15.8:0/1127234719 shutdown_connections 2023-10-18T21:44:53.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.060+0000 7fcde9642700 1 -- 172.21.15.8:0/1127234719 wait complete. 2023-10-18T21:44:53.075 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:44:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.204+0000 7f510131b700 1 -- 172.21.15.8:0/3389367891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc0f6530 msgr2=0x7f50fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.204+0000 7f510131b700 1 --2- 172.21.15.8:0/3389367891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc0f6530 0x7f50fc0f6950 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f50ec004660 tx=0x7f50ec009b30).stop 2023-10-18T21:44:53.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.204+0000 7f510131b700 1 -- 172.21.15.8:0/3389367891 shutdown_connections 2023-10-18T21:44:53.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.204+0000 7f510131b700 1 --2- 172.21.15.8:0/3389367891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0f77d0 0x7f50fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.204+0000 7f510131b700 1 --2- 172.21.15.8:0/3389367891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc0f6530 0x7f50fc0f6950 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.204+0000 7f510131b700 1 -- 172.21.15.8:0/3389367891 >> 172.21.15.8:0/3389367891 conn(0x7f50fc0f1c70 msgr2=0x7f50fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:53.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.204+0000 7f510131b700 1 -- 172.21.15.8:0/3389367891 shutdown_connections 2023-10-18T21:44:53.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.204+0000 7f510131b700 1 -- 172.21.15.8:0/3389367891 wait complete. 2023-10-18T21:44:53.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.205+0000 7f510131b700 1 Processor -- start 2023-10-18T21:44:53.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.205+0000 7f510131b700 1 -- start start 2023-10-18T21:44:53.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f510131b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc0f6530 0x7f50fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:53.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f510131b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0f77d0 0x7f50fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:53.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f510131b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc06a380 con 0x7f50fc0f6530 2023-10-18T21:44:53.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f510131b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc06a4c0 con 0x7f50fc0f77d0 2023-10-18T21:44:53.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f50fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc0f6530 0x7f50fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:53.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f50fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc0f6530 0x7f50fc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47778/0 (socket says 172.21.15.8:47778) 2023-10-18T21:44:53.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f50fbfff700 1 -- 172.21.15.8:0/10515623 learned_addr learned my addr 172.21.15.8:0/10515623 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:53.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f50fb7fe700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0f77d0 0x7f50fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f50fbfff700 1 -- 172.21.15.8:0/10515623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0f77d0 msgr2=0x7f50fc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f50fbfff700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0f77d0 0x7f50fc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.206+0000 7f50fbfff700 1 -- 172.21.15.8:0/10515623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec005040 con 0x7f50fc0f6530 2023-10-18T21:44:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.207+0000 7f50fbfff700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc0f6530 0x7f50fc06b9a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f50ec007a60 tx=0x7f50ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.207+0000 7f50f8ff9700 1 -- 172.21.15.8:0/10515623 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50ec018070 con 0x7f50fc0f6530 2023-10-18T21:44:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.207+0000 7f50f8ff9700 1 -- 172.21.15.8:0/10515623 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f50ec009630 con 0x7f50fc0f6530 2023-10-18T21:44:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.207+0000 7f510131b700 1 -- 172.21.15.8:0/10515623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc06a740 con 0x7f50fc0f6530 2023-10-18T21:44:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.207+0000 7f50f8ff9700 1 -- 172.21.15.8:0/10515623 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50ec01c540 con 0x7f50fc0f6530 2023-10-18T21:44:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.207+0000 7f510131b700 1 -- 172.21.15.8:0/10515623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc06aca0 con 0x7f50fc0f6530 2023-10-18T21:44:53.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.208+0000 7f510131b700 1 -- 172.21.15.8:0/10515623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50fc045ad0 con 0x7f50fc0f6530 2023-10-18T21:44:53.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.209+0000 7f50f8ff9700 1 -- 172.21.15.8:0/10515623 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f50ec01c7b0 con 0x7f50fc0f6530 2023-10-18T21:44:53.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.210+0000 7f50f8ff9700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e4060f70 0x7f50e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:53.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.210+0000 7f50f8ff9700 1 -- 172.21.15.8:0/10515623 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f50ec07e760 con 0x7f50fc0f6530 2023-10-18T21:44:53.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.210+0000 7f50fb7fe700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e4060f70 0x7f50e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:53.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.210+0000 7f50fb7fe700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e4060f70 0x7f50e4063430 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f50f0009760 tx=0x7f50f0009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:53.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.214+0000 7f50f8ff9700 1 -- 172.21.15.8:0/10515623 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f50ec04e310 con 0x7f50fc0f6530 2023-10-18T21:44:53.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.412+0000 7f510131b700 1 -- 172.21.15.8:0/10515623 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50fc0fee00 con 0x7f50e4060f70 2023-10-18T21:44:53.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.413+0000 7f50f8ff9700 1 -- 172.21.15.8:0/10515623 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f50fc0fee00 con 0x7f50e4060f70 2023-10-18T21:44:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.415+0000 7f510131b700 1 -- 172.21.15.8:0/10515623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e4060f70 msgr2=0x7f50e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.415+0000 7f510131b700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e4060f70 0x7f50e4063430 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f50f0009760 tx=0x7f50f0009c60).stop 2023-10-18T21:44:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.415+0000 7f510131b700 1 -- 172.21.15.8:0/10515623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc0f6530 msgr2=0x7f50fc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.415+0000 7f510131b700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc0f6530 0x7f50fc06b9a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f50ec007a60 tx=0x7f50ec009b30).stop 2023-10-18T21:44:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.416+0000 7f510131b700 1 -- 172.21.15.8:0/10515623 shutdown_connections 2023-10-18T21:44:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.416+0000 7f510131b700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e4060f70 0x7f50e4063430 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.416+0000 7f510131b700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc0f6530 0x7f50fc06b9a0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.416+0000 7f510131b700 1 --2- 172.21.15.8:0/10515623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0f77d0 0x7f50fc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.416+0000 7f510131b700 1 -- 172.21.15.8:0/10515623 >> 172.21.15.8:0/10515623 conn(0x7f50fc0f1c70 msgr2=0x7f50fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:53.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.416+0000 7f510131b700 1 -- 172.21.15.8:0/10515623 shutdown_connections 2023-10-18T21:44:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.416+0000 7f510131b700 1 -- 172.21.15.8:0/10515623 wait complete. 2023-10-18T21:44:53.419 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:52.558229+0000 mon.smithi008 (mon.0) 3158 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:53.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:52.558229+0000 mon.smithi008 (mon.0) 3158 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:53.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.553+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/3092615768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fb80f6530 msgr2=0x7f3fb80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.553+0000 7f3fbd4e2700 1 --2- 172.21.15.8:0/3092615768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fb80f6530 0x7f3fb80f6950 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f3fa8004660 tx=0x7f3fa8009b30).stop 2023-10-18T21:44:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.553+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/3092615768 shutdown_connections 2023-10-18T21:44:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.553+0000 7f3fbd4e2700 1 --2- 172.21.15.8:0/3092615768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb80f77d0 0x7f3fb80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.553+0000 7f3fbd4e2700 1 --2- 172.21.15.8:0/3092615768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fb80f6530 0x7f3fb80f6950 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.553+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/3092615768 >> 172.21.15.8:0/3092615768 conn(0x7f3fb80f1c90 msgr2=0x7f3fb80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.553+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/3092615768 shutdown_connections 2023-10-18T21:44:53.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.553+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/3092615768 wait complete. 2023-10-18T21:44:53.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.554+0000 7f3fbd4e2700 1 Processor -- start 2023-10-18T21:44:53.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.554+0000 7f3fbd4e2700 1 -- start start 2023-10-18T21:44:53.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.555+0000 7f3fbd4e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fb80f6530 0x7f3fb806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:53.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.555+0000 7f3fbd4e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb80f77d0 0x7f3fb8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:53.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.555+0000 7f3fbd4e2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb806a380 con 0x7f3fb80f6530 2023-10-18T21:44:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.555+0000 7f3fbd4e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb806a4c0 con 0x7f3fb80f77d0 2023-10-18T21:44:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.555+0000 7f3fb7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fb80f6530 0x7f3fb806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.555+0000 7f3fb7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fb80f6530 0x7f3fb806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47796/0 (socket says 172.21.15.8:47796) 2023-10-18T21:44:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.555+0000 7f3fb7fff700 1 -- 172.21.15.8:0/1011465436 learned_addr learned my addr 172.21.15.8:0/1011465436 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.555+0000 7f3fb77fe700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb80f77d0 0x7f3fb8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.556+0000 7f3fb7fff700 1 -- 172.21.15.8:0/1011465436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb80f77d0 msgr2=0x7f3fb8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.556+0000 7f3fb7fff700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb80f77d0 0x7f3fb8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.556+0000 7f3fb7fff700 1 -- 172.21.15.8:0/1011465436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa8005040 con 0x7f3fb80f6530 2023-10-18T21:44:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.556+0000 7f3fb7fff700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fb80f6530 0x7f3fb806b9a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f3fa8009f50 tx=0x7f3fa8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.556+0000 7f3fb4ff9700 1 -- 172.21.15.8:0/1011465436 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa8018070 con 0x7f3fb80f6530 2023-10-18T21:44:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.556+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/1011465436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb806a740 con 0x7f3fb80f6530 2023-10-18T21:44:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.556+0000 7f3fb4ff9700 1 -- 172.21.15.8:0/1011465436 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3fa801d8e0 con 0x7f3fb80f6530 2023-10-18T21:44:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.556+0000 7f3fb4ff9700 1 -- 172.21.15.8:0/1011465436 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa801c440 con 0x7f3fb80f6530 2023-10-18T21:44:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.556+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/1011465436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb806aca0 con 0x7f3fb80f6530 2023-10-18T21:44:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.557+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/1011465436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb8045ad0 con 0x7f3fb80f6530 2023-10-18T21:44:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.558+0000 7f3fb4ff9700 1 -- 172.21.15.8:0/1011465436 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3fa801da50 con 0x7f3fb80f6530 2023-10-18T21:44:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.559+0000 7f3fb4ff9700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fa0060f70 0x7f3fa0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.559+0000 7f3fb4ff9700 1 -- 172.21.15.8:0/1011465436 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3fa807e7c0 con 0x7f3fb80f6530 2023-10-18T21:44:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.559+0000 7f3fb77fe700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fa0060f70 0x7f3fa0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.560+0000 7f3fb77fe700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fa0060f70 0x7f3fa0063430 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f3fac007fd0 tx=0x7f3fac009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:53.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.563+0000 7f3fb4ff9700 1 -- 172.21.15.8:0/1011465436 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3fa804e370 con 0x7f3fb80f6530 2023-10-18T21:44:53.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.758+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/1011465436 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fb80008d0 con 0x7f3fa0060f70 2023-10-18T21:44:53.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.768+0000 7f3fb4ff9700 1 -- 172.21.15.8:0/1011465436 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3fb80008d0 con 0x7f3fa0060f70 2023-10-18T21:44:53.769 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:44:53.769 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (51m) 9m ago 53m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:44:53.769 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (45m) 9m ago 53m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:44:53.770 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (45m) 7m ago 52m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:44:53.770 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (51m) 9m ago 52m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:44:53.770 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 49m - - 2023-10-18T21:44:53.770 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 48m - - 2023-10-18T21:44:53.770 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 49m - - 2023-10-18T21:44:53.771 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 48m - - 2023-10-18T21:44:53.771 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (46m) 9m ago 54m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:44:53.771 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (46m) 7m ago 52m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:44:53.771 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (45m) 9m ago 54m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:44:53.771 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (45m) 7m ago 52m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:44:53.772 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (52m) 9m ago 52m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:44:53.772 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (51m) 7m ago 51m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:44:53.772 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (45m) 9m ago 51m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:44:53.772 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (43m) 9m ago 51m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:44:53.772 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (42m) 9m ago 50m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:44:53.773 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (42m) 7m ago 50m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:44:53.773 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (41m) 7m ago 50m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:44:53.773 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (41m) 7m ago 50m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:44:53.773 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (47m) 9m ago 52m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:44:53.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/1011465436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fa0060f70 msgr2=0x7f3fa0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fa0060f70 0x7f3fa0063430 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f3fac007fd0 tx=0x7f3fac009040).stop 2023-10-18T21:44:53.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/1011465436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fb80f6530 msgr2=0x7f3fb806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fb80f6530 0x7f3fb806b9a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f3fa8009f50 tx=0x7f3fa8009b30).stop 2023-10-18T21:44:53.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/1011465436 shutdown_connections 2023-10-18T21:44:53.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fa0060f70 0x7f3fa0063430 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fb80f6530 0x7f3fb806b9a0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 --2- 172.21.15.8:0/1011465436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb80f77d0 0x7f3fb8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/1011465436 >> 172.21.15.8:0/1011465436 conn(0x7f3fb80f1c90 msgr2=0x7f3fb80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:53.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/1011465436 shutdown_connections 2023-10-18T21:44:53.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.770+0000 7f3fbd4e2700 1 -- 172.21.15.8:0/1011465436 wait complete. 2023-10-18T21:44:53.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.906+0000 7f0e4096f700 1 -- 172.21.15.8:0/2994149298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e3c06a3b0 msgr2=0x7f0e3c06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.906+0000 7f0e4096f700 1 --2- 172.21.15.8:0/2994149298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e3c06a3b0 0x7f0e3c06a830 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f0e30004660 tx=0x7f0e30009b30).stop 2023-10-18T21:44:53.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.906+0000 7f0e4096f700 1 -- 172.21.15.8:0/2994149298 shutdown_connections 2023-10-18T21:44:53.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.906+0000 7f0e4096f700 1 --2- 172.21.15.8:0/2994149298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e3c06a3b0 0x7f0e3c06a830 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.906+0000 7f0e4096f700 1 --2- 172.21.15.8:0/2994149298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e3c06b9c0 0x7f0e3c069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.906+0000 7f0e4096f700 1 -- 172.21.15.8:0/2994149298 >> 172.21.15.8:0/2994149298 conn(0x7f0e3c0f1c90 msgr2=0x7f0e3c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:53.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.906+0000 7f0e4096f700 1 -- 172.21.15.8:0/2994149298 shutdown_connections 2023-10-18T21:44:53.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.907+0000 7f0e4096f700 1 -- 172.21.15.8:0/2994149298 wait complete. 2023-10-18T21:44:53.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.907+0000 7f0e4096f700 1 Processor -- start 2023-10-18T21:44:53.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.907+0000 7f0e4096f700 1 -- start start 2023-10-18T21:44:53.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e4096f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e3c06a3b0 0x7f0e3c108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:53.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e4096f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e3c06b9c0 0x7f0e3c109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:53.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e4096f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c109a10 con 0x7f0e3c06b9c0 2023-10-18T21:44:53.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e4096f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c109b50 con 0x7f0e3c06a3b0 2023-10-18T21:44:53.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e3a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e3c06b9c0 0x7f0e3c109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:53.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e3a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e3c06b9c0 0x7f0e3c109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47806/0 (socket says 172.21.15.8:47806) 2023-10-18T21:44:53.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e3a59c700 1 -- 172.21.15.8:0/2132239238 learned_addr learned my addr 172.21.15.8:0/2132239238 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:53.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e3ad9d700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e3c06a3b0 0x7f0e3c108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:53.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e3a59c700 1 -- 172.21.15.8:0/2132239238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e3c06a3b0 msgr2=0x7f0e3c108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:53.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e3a59c700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e3c06a3b0 0x7f0e3c108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:53.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.908+0000 7f0e3a59c700 1 -- 172.21.15.8:0/2132239238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e30005040 con 0x7f0e3c06b9c0 2023-10-18T21:44:53.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.909+0000 7f0e3a59c700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e3c06b9c0 0x7f0e3c109460 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f0e30009990 tx=0x7f0e30009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:53.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.909+0000 7f0e237fe700 1 -- 172.21.15.8:0/2132239238 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e30018070 con 0x7f0e3c06b9c0 2023-10-18T21:44:53.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.909+0000 7f0e237fe700 1 -- 172.21.15.8:0/2132239238 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0e30009630 con 0x7f0e3c06b9c0 2023-10-18T21:44:53.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.909+0000 7f0e4096f700 1 -- 172.21.15.8:0/2132239238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c10a490 con 0x7f0e3c06b9c0 2023-10-18T21:44:53.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.909+0000 7f0e237fe700 1 -- 172.21.15.8:0/2132239238 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3001c3c0 con 0x7f0e3c06b9c0 2023-10-18T21:44:53.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.909+0000 7f0e4096f700 1 -- 172.21.15.8:0/2132239238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c10a9f0 con 0x7f0e3c06b9c0 2023-10-18T21:44:53.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.910+0000 7f0e4096f700 1 -- 172.21.15.8:0/2132239238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c045ad0 con 0x7f0e3c06b9c0 2023-10-18T21:44:53.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.911+0000 7f0e237fe700 1 -- 172.21.15.8:0/2132239238 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0e3001d970 con 0x7f0e3c06b9c0 2023-10-18T21:44:53.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.912+0000 7f0e237fe700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e24060f70 0x7f0e24063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:53.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.912+0000 7f0e237fe700 1 -- 172.21.15.8:0/2132239238 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0e3007e5a0 con 0x7f0e3c06b9c0 2023-10-18T21:44:53.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.912+0000 7f0e3ad9d700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e24060f70 0x7f0e24063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:53.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.913+0000 7f0e3ad9d700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e24060f70 0x7f0e24063430 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f0e2c004c40 tx=0x7f0e2c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:53.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:53.916+0000 7f0e237fe700 1 -- 172.21.15.8:0/2132239238 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0e30051c00 con 0x7f0e3c06b9c0 2023-10-18T21:44:54.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.169+0000 7f0e4096f700 1 -- 172.21.15.8:0/2132239238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0e3c027a00 con 0x7f0e3c06b9c0 2023-10-18T21:44:54.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.170+0000 7f0e237fe700 1 -- 172.21.15.8:0/2132239238 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f0e300517f0 con 0x7f0e3c06b9c0 2023-10-18T21:44:54.171 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:44:54.172 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:44:54.172 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:44:54.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:44:54.173 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:44:54.173 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:44:54.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:44:54.174 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:44:54.175 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:44:54.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:44:54.175 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:44:54.176 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:44:54.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:44:54.176 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:44:54.176 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:44:54.177 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:44:54.177 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:44:54.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 -- 172.21.15.8:0/2132239238 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e24060f70 msgr2=0x7f0e24063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:54.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e24060f70 0x7f0e24063430 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f0e2c004c40 tx=0x7f0e2c00b040).stop 2023-10-18T21:44:54.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 -- 172.21.15.8:0/2132239238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e3c06b9c0 msgr2=0x7f0e3c109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:54.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e3c06b9c0 0x7f0e3c109460 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f0e30009990 tx=0x7f0e30009b30).stop 2023-10-18T21:44:54.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 -- 172.21.15.8:0/2132239238 shutdown_connections 2023-10-18T21:44:54.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e24060f70 0x7f0e24063430 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e3c06a3b0 0x7f0e3c108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 --2- 172.21.15.8:0/2132239238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e3c06b9c0 0x7f0e3c109460 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 -- 172.21.15.8:0/2132239238 >> 172.21.15.8:0/2132239238 conn(0x7f0e3c0f1c90 msgr2=0x7f0e3c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:54.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 -- 172.21.15.8:0/2132239238 shutdown_connections 2023-10-18T21:44:54.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.172+0000 7f0e4096f700 1 -- 172.21.15.8:0/2132239238 wait complete. 2023-10-18T21:44:54.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:52.529473+0000 mgr.smithi008.flmjzp (mgr.14640) 2761 : cluster [DBG] pgmap v1903: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:54.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.058244+0000 mgr.smithi008.flmjzp (mgr.14640) 2762 : audit [DBG] from='client.36328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:54.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.148211+0000 mon.smithi008 (mon.0) 3159 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:54.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.149078+0000 mon.smithi008 (mon.0) 3160 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:54.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.154562+0000 mon.smithi008 (mon.0) 3161 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:54.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.159753+0000 mon.smithi008 (mon.0) 3162 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:54.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.162255+0000 mon.smithi008 (mon.0) 3163 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:54.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.163549+0000 mon.smithi008 (mon.0) 3164 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:54.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.164743+0000 mon.smithi008 (mon.0) 3165 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:54.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.166289+0000 mon.smithi008 (mon.0) 3166 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:54.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.310+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/3421844745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f0806b9c0 msgr2=0x7f6f08069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:54.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.310+0000 7f6f0d2ee700 1 --2- 172.21.15.8:0/3421844745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f0806b9c0 0x7f6f08069ec0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f6ef8004660 tx=0x7f6ef8009b30).stop 2023-10-18T21:44:54.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.310+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/3421844745 shutdown_connections 2023-10-18T21:44:54.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.310+0000 7f6f0d2ee700 1 --2- 172.21.15.8:0/3421844745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f0806a3b0 0x7f6f0806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.310+0000 7f6f0d2ee700 1 --2- 172.21.15.8:0/3421844745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f0806b9c0 0x7f6f08069ec0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.310+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/3421844745 >> 172.21.15.8:0/3421844745 conn(0x7f6f080f1c90 msgr2=0x7f6f080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:54.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.310+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/3421844745 shutdown_connections 2023-10-18T21:44:54.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.310+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/3421844745 wait complete. 2023-10-18T21:44:54.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.311+0000 7f6f0d2ee700 1 Processor -- start 2023-10-18T21:44:54.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.311+0000 7f6f0d2ee700 1 -- start start 2023-10-18T21:44:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f0d2ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f0806a3b0 0x7f6f0810d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f0d2ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f0806b9c0 0x7f6f0810d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f0d2ee700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0810ddc0 con 0x7f6f0806a3b0 2023-10-18T21:44:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f0d2ee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0810df00 con 0x7f6f0806b9c0 2023-10-18T21:44:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f07fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f0806a3b0 0x7f6f0810d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:54.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f07fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f0806a3b0 0x7f6f0810d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47836/0 (socket says 172.21.15.8:47836) 2023-10-18T21:44:54.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f07fff700 1 -- 172.21.15.8:0/2152344997 learned_addr learned my addr 172.21.15.8:0/2152344997 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:54.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f07fff700 1 -- 172.21.15.8:0/2152344997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f0806b9c0 msgr2=0x7f6f0810d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:54.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f07fff700 1 --2- 172.21.15.8:0/2152344997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f0806b9c0 0x7f6f0810d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:44:54.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f07fff700 1 -- 172.21.15.8:0/2152344997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8005040 con 0x7f6f0806a3b0 2023-10-18T21:44:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.312+0000 7f6f07fff700 1 --2- 172.21.15.8:0/2152344997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f0806a3b0 0x7f6f0810d320 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f6ef8004320 tx=0x7f6ef800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.313+0000 7f6f04ff9700 1 -- 172.21.15.8:0/2152344997 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ef8019070 con 0x7f6f0806a3b0 2023-10-18T21:44:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.313+0000 7f6f04ff9700 1 -- 172.21.15.8:0/2152344997 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6ef801e420 con 0x7f6f0806a3b0 2023-10-18T21:44:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.313+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/2152344997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0810e840 con 0x7f6f0806a3b0 2023-10-18T21:44:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.313+0000 7f6f04ff9700 1 -- 172.21.15.8:0/2152344997 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ef8014660 con 0x7f6f0806a3b0 2023-10-18T21:44:54.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.313+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/2152344997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0810ed20 con 0x7f6f0806a3b0 2023-10-18T21:44:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.314+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/2152344997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f08045ad0 con 0x7f6f0806a3b0 2023-10-18T21:44:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.315+0000 7f6f04ff9700 1 -- 172.21.15.8:0/2152344997 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6ef80079c0 con 0x7f6f0806a3b0 2023-10-18T21:44:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.315+0000 7f6f04ff9700 1 --2- 172.21.15.8:0/2152344997 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ef0060f70 0x7f6ef0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.316+0000 7f6f04ff9700 1 -- 172.21.15.8:0/2152344997 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6ef807dd20 con 0x7f6f0806a3b0 2023-10-18T21:44:54.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.316+0000 7f6f077fe700 1 --2- 172.21.15.8:0/2152344997 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ef0060f70 0x7f6ef0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:54.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.316+0000 7f6f077fe700 1 --2- 172.21.15.8:0/2152344997 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ef0060f70 0x7f6ef0063430 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f6efc004b70 tx=0x7f6efc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:54.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.320+0000 7f6f04ff9700 1 -- 172.21.15.8:0/2152344997 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6ef8051440 con 0x7f6f0806a3b0 2023-10-18T21:44:54.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:52.529473+0000 mgr.smithi008.flmjzp (mgr.14640) 2761 : cluster [DBG] pgmap v1903: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.058244+0000 mgr.smithi008.flmjzp (mgr.14640) 2762 : audit [DBG] from='client.36328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.148211+0000 mon.smithi008 (mon.0) 3159 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:44:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.149078+0000 mon.smithi008 (mon.0) 3160 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:44:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.154562+0000 mon.smithi008 (mon.0) 3161 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:44:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.159753+0000 mon.smithi008 (mon.0) 3162 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:44:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.162255+0000 mon.smithi008 (mon.0) 3163 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.163549+0000 mon.smithi008 (mon.0) 3164 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:54.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.164743+0000 mon.smithi008 (mon.0) 3165 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:54.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.166289+0000 mon.smithi008 (mon.0) 3166 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:54.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.544+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/2152344997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6f08027a00 con 0x7f6f0806a3b0 2023-10-18T21:44:54.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.544+0000 7f6f04ff9700 1 -- 172.21.15.8:0/2152344997 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f6ef8051030 con 0x7f6f0806a3b0 2023-10-18T21:44:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:44:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:44:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:44:54.546 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:44:54.546 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:44:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:44:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:44:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:44:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:44:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:44:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:44:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:44:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:44:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:44:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:44:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:44:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:44:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:44:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:44:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:44:54.549 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:44:54.550 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:44:54.550 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:44:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:44:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:44:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:44:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:44:54.551 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:44:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:44:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:44:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:44:54.552 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:44:54.552 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:44:54.552 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:44:54.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/2152344997 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ef0060f70 msgr2=0x7f6ef0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 --2- 172.21.15.8:0/2152344997 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ef0060f70 0x7f6ef0063430 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f6efc004b70 tx=0x7f6efc00b040).stop 2023-10-18T21:44:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/2152344997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f0806a3b0 msgr2=0x7f6f0810d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 --2- 172.21.15.8:0/2152344997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f0806a3b0 0x7f6f0810d320 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f6ef8004320 tx=0x7f6ef800b040).stop 2023-10-18T21:44:54.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/2152344997 shutdown_connections 2023-10-18T21:44:54.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 --2- 172.21.15.8:0/2152344997 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6ef0060f70 0x7f6ef0063430 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 --2- 172.21.15.8:0/2152344997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f0806a3b0 0x7f6f0810d320 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 --2- 172.21.15.8:0/2152344997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f0806b9c0 0x7f6f0810d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:44:54.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/2152344997 >> 172.21.15.8:0/2152344997 conn(0x7f6f080f1c90 msgr2=0x7f6f080f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:54.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/2152344997 shutdown_connections 2023-10-18T21:44:54.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.546+0000 7f6f0d2ee700 1 -- 172.21.15.8:0/2152344997 wait complete. 2023-10-18T21:44:54.556 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:44:54.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.684+0000 7f752529f700 1 -- 172.21.15.8:0/2345234394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7520060310 msgr2=0x7f75200f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:54.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.684+0000 7f752529f700 1 --2- 172.21.15.8:0/2345234394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7520060310 0x7f75200f9110 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f7510004660 tx=0x7f7510009b30).stop 2023-10-18T21:44:54.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.684+0000 7f752529f700 1 -- 172.21.15.8:0/2345234394 shutdown_connections 2023-10-18T21:44:54.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.684+0000 7f752529f700 1 --2- 172.21.15.8:0/2345234394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75200f9690 0x7f75200fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.684+0000 7f752529f700 1 --2- 172.21.15.8:0/2345234394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7520060310 0x7f75200f9110 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.684+0000 7f752529f700 1 -- 172.21.15.8:0/2345234394 >> 172.21.15.8:0/2345234394 conn(0x7f75200f0b90 msgr2=0x7f75200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:54.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.684+0000 7f752529f700 1 -- 172.21.15.8:0/2345234394 shutdown_connections 2023-10-18T21:44:54.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.684+0000 7f752529f700 1 -- 172.21.15.8:0/2345234394 wait complete. 2023-10-18T21:44:54.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.685+0000 7f752529f700 1 Processor -- start 2023-10-18T21:44:54.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.685+0000 7f752529f700 1 -- start start 2023-10-18T21:44:54.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.685+0000 7f752529f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7520060310 0x7f7520106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:54.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.685+0000 7f752529f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75200f9690 0x7f75201072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:54.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.685+0000 7f752529f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75201078a0 con 0x7f75200f9690 2023-10-18T21:44:54.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.685+0000 7f752529f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75201080e0 con 0x7f7520060310 2023-10-18T21:44:54.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.685+0000 7f751f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75200f9690 0x7f75201072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:54.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.685+0000 7f751f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75200f9690 0x7f75201072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47844/0 (socket says 172.21.15.8:47844) 2023-10-18T21:44:54.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.685+0000 7f751f7fe700 1 -- 172.21.15.8:0/789439842 learned_addr learned my addr 172.21.15.8:0/789439842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:44:54.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.686+0000 7f751ffff700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7520060310 0x7f7520106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:54.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.686+0000 7f751f7fe700 1 -- 172.21.15.8:0/789439842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7520060310 msgr2=0x7f7520106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:54.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.686+0000 7f751f7fe700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7520060310 0x7f7520106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.686+0000 7f751f7fe700 1 -- 172.21.15.8:0/789439842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7510005040 con 0x7f75200f9690 2023-10-18T21:44:54.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.686+0000 7f751ffff700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7520060310 0x7f7520106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:44:54.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.686+0000 7f751f7fe700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75200f9690 0x7f75201072a0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f7514002700 tx=0x7f7514009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:54.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.686+0000 7f751cff9700 1 -- 172.21.15.8:0/789439842 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7514009320 con 0x7f75200f9690 2023-10-18T21:44:54.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.686+0000 7f751cff9700 1 -- 172.21.15.8:0/789439842 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f751400f040 con 0x7f75200f9690 2023-10-18T21:44:54.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.686+0000 7f751cff9700 1 -- 172.21.15.8:0/789439842 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7514014860 con 0x7f75200f9690 2023-10-18T21:44:54.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.686+0000 7f752529f700 1 -- 172.21.15.8:0/789439842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75201083c0 con 0x7f75200f9690 2023-10-18T21:44:54.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.687+0000 7f752529f700 1 -- 172.21.15.8:0/789439842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75201088b0 con 0x7f75200f9690 2023-10-18T21:44:54.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.687+0000 7f752529f700 1 -- 172.21.15.8:0/789439842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7520059100 con 0x7f75200f9690 2023-10-18T21:44:54.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.689+0000 7f751cff9700 1 -- 172.21.15.8:0/789439842 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f75140077b0 con 0x7f75200f9690 2023-10-18T21:44:54.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.690+0000 7f751cff9700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7508060f70 0x7f7508063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:44:54.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.690+0000 7f751cff9700 1 -- 172.21.15.8:0/789439842 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f751407cfa0 con 0x7f75200f9690 2023-10-18T21:44:54.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.690+0000 7f751ffff700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7508060f70 0x7f7508063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:44:54.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.691+0000 7f751ffff700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7508060f70 0x7f7508063430 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f7510009d60 tx=0x7f7510009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:44:54.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.694+0000 7f751cff9700 1 -- 172.21.15.8:0/789439842 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f751404cb50 con 0x7f75200f9690 2023-10-18T21:44:54.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.892+0000 7f752529f700 1 -- 172.21.15.8:0/789439842 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75200fee90 con 0x7f7508060f70 2023-10-18T21:44:54.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.894+0000 7f751cff9700 1 -- 172.21.15.8:0/789439842 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7510013410 con 0x7f7508060f70 2023-10-18T21:44:54.895 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:44:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:44:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:44:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:44:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:44:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:44:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:44:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:44:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:44:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:44:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:44:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:44:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:44:54.897 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:44:54.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.895+0000 7f752529f700 1 -- 172.21.15.8:0/789439842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7508060f70 msgr2=0x7f7508063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:54.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.896+0000 7f752529f700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7508060f70 0x7f7508063430 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f7510009d60 tx=0x7f7510009b30).stop 2023-10-18T21:44:54.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.896+0000 7f752529f700 1 -- 172.21.15.8:0/789439842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75200f9690 msgr2=0x7f75201072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:44:54.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.896+0000 7f752529f700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75200f9690 0x7f75201072a0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f7514002700 tx=0x7f7514009d60).stop 2023-10-18T21:44:54.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.896+0000 7f752529f700 1 -- 172.21.15.8:0/789439842 shutdown_connections 2023-10-18T21:44:54.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.896+0000 7f752529f700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7508060f70 0x7f7508063430 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.896+0000 7f752529f700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7520060310 0x7f7520106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.896+0000 7f752529f700 1 --2- 172.21.15.8:0/789439842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75200f9690 0x7f75201072a0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:44:54.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.896+0000 7f752529f700 1 -- 172.21.15.8:0/789439842 >> 172.21.15.8:0/789439842 conn(0x7f75200f0b90 msgr2=0x7f75200f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:44:54.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.896+0000 7f752529f700 1 -- 172.21.15.8:0/789439842 shutdown_connections 2023-10-18T21:44:54.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:44:54.896+0000 7f752529f700 1 -- 172.21.15.8:0/789439842 wait complete. 2023-10-18T21:44:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:53.149743+0000 mgr.smithi008.flmjzp (mgr.14640) 2763 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:53.150231+0000 mgr.smithi008.flmjzp (mgr.14640) 2764 : cluster [DBG] pgmap v1904: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:53.150525+0000 mgr.smithi008.flmjzp (mgr.14640) 2765 : cluster [DBG] pgmap v1905: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:44:53.167852+0000 mgr.smithi008.flmjzp (mgr.14640) 2766 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.413882+0000 mgr.smithi008.flmjzp (mgr.14640) 2767 : audit [DBG] from='client.36332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:53.759657+0000 mgr.smithi008.flmjzp (mgr.14640) 2768 : audit [DBG] from='client.36336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:54.170287+0000 mon.smithi008 (mon.0) 3167 : audit [DBG] from='client.? 172.21.15.8:0/2132239238' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:54.544801+0000 mon.smithi008 (mon.0) 3168 : audit [DBG] from='client.? 172.21.15.8:0/2152344997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:44:55.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:53.149743+0000 mgr.smithi008.flmjzp (mgr.14640) 2763 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:44:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:53.150231+0000 mgr.smithi008.flmjzp (mgr.14640) 2764 : cluster [DBG] pgmap v1904: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:53.150525+0000 mgr.smithi008.flmjzp (mgr.14640) 2765 : cluster [DBG] pgmap v1905: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:44:53.167852+0000 mgr.smithi008.flmjzp (mgr.14640) 2766 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:44:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.413882+0000 mgr.smithi008.flmjzp (mgr.14640) 2767 : audit [DBG] from='client.36332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:53.759657+0000 mgr.smithi008.flmjzp (mgr.14640) 2768 : audit [DBG] from='client.36336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:54.170287+0000 mon.smithi008 (mon.0) 3167 : audit [DBG] from='client.? 172.21.15.8:0/2132239238' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:44:55.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:54.544801+0000 mon.smithi008 (mon.0) 3168 : audit [DBG] from='client.? 172.21.15.8:0/2152344997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:44:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:44:54.893979+0000 mgr.smithi008.flmjzp (mgr.14640) 2769 : audit [DBG] from='client.36348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:56.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:44:54.893979+0000 mgr.smithi008.flmjzp (mgr.14640) 2769 : audit [DBG] from='client.36348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:44:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:55.151018+0000 mgr.smithi008.flmjzp (mgr.14640) 2770 : cluster [DBG] pgmap v1906: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:57.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:55.151018+0000 mgr.smithi008.flmjzp (mgr.14640) 2770 : cluster [DBG] pgmap v1906: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:44:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:57.151747+0000 mgr.smithi008.flmjzp (mgr.14640) 2771 : cluster [DBG] pgmap v1907: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:44:59.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:44:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:57.151747+0000 mgr.smithi008.flmjzp (mgr.14640) 2771 : cluster [DBG] pgmap v1907: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:44:59.152319+0000 mgr.smithi008.flmjzp (mgr.14640) 2772 : cluster [DBG] pgmap v1908: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:44:59.152319+0000 mgr.smithi008.flmjzp (mgr.14640) 2772 : cluster [DBG] pgmap v1908: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:03.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:01.152856+0000 mgr.smithi008.flmjzp (mgr.14640) 2773 : cluster [DBG] pgmap v1909: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:03.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:01.152856+0000 mgr.smithi008.flmjzp (mgr.14640) 2773 : cluster [DBG] pgmap v1909: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:04.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:03.170085+0000 mon.smithi008 (mon.0) 3169 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:04.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:03.172129+0000 mon.smithi008 (mon.0) 3170 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:45:04.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:03.173148+0000 mon.smithi008 (mon.0) 3171 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:45:04.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:03.179821+0000 mon.smithi008 (mon.0) 3172 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:04.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:03.186444+0000 mon.smithi008 (mon.0) 3173 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:04.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:03.189495+0000 mon.smithi008 (mon.0) 3174 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:04.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:03.191165+0000 mon.smithi008 (mon.0) 3175 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:04.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:03.192814+0000 mon.smithi008 (mon.0) 3176 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:04.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:03.194834+0000 mon.smithi008 (mon.0) 3177 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:04.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:03.170085+0000 mon.smithi008 (mon.0) 3169 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:03.172129+0000 mon.smithi008 (mon.0) 3170 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:45:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:03.173148+0000 mon.smithi008 (mon.0) 3171 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:45:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:03.179821+0000 mon.smithi008 (mon.0) 3172 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:03.186444+0000 mon.smithi008 (mon.0) 3173 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:04.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:03.189495+0000 mon.smithi008 (mon.0) 3174 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:04.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:03.191165+0000 mon.smithi008 (mon.0) 3175 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:04.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:03.192814+0000 mon.smithi008 (mon.0) 3176 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:04.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:03.194834+0000 mon.smithi008 (mon.0) 3177 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:03.153461+0000 mgr.smithi008.flmjzp (mgr.14640) 2774 : cluster [DBG] pgmap v1910: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:03.174031+0000 mgr.smithi008.flmjzp (mgr.14640) 2775 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:45:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:03.174664+0000 mgr.smithi008.flmjzp (mgr.14640) 2776 : cluster [DBG] pgmap v1911: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:03.174991+0000 mgr.smithi008.flmjzp (mgr.14640) 2777 : cluster [DBG] pgmap v1912: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:03.196702+0000 mgr.smithi008.flmjzp (mgr.14640) 2778 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:45:05.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:03.153461+0000 mgr.smithi008.flmjzp (mgr.14640) 2774 : cluster [DBG] pgmap v1910: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:03.174031+0000 mgr.smithi008.flmjzp (mgr.14640) 2775 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:45:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:03.174664+0000 mgr.smithi008.flmjzp (mgr.14640) 2776 : cluster [DBG] pgmap v1911: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:03.174991+0000 mgr.smithi008.flmjzp (mgr.14640) 2777 : cluster [DBG] pgmap v1912: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:03.196702+0000 mgr.smithi008.flmjzp (mgr.14640) 2778 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:45:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:05.175592+0000 mgr.smithi008.flmjzp (mgr.14640) 2779 : cluster [DBG] pgmap v1913: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:07.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:05.175592+0000 mgr.smithi008.flmjzp (mgr.14640) 2779 : cluster [DBG] pgmap v1913: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:07.176122+0000 mgr.smithi008.flmjzp (mgr.14640) 2780 : cluster [DBG] pgmap v1914: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:09.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:07.176122+0000 mgr.smithi008.flmjzp (mgr.14640) 2780 : cluster [DBG] pgmap v1914: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:09.176817+0000 mgr.smithi008.flmjzp (mgr.14640) 2781 : cluster [DBG] pgmap v1915: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:09.176817+0000 mgr.smithi008.flmjzp (mgr.14640) 2781 : cluster [DBG] pgmap v1915: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:11.177466+0000 mgr.smithi008.flmjzp (mgr.14640) 2782 : cluster [DBG] pgmap v1916: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:13.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:11.177466+0000 mgr.smithi008.flmjzp (mgr.14640) 2782 : cluster [DBG] pgmap v1916: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:14.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:13.203999+0000 mon.smithi008 (mon.0) 3178 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:14.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:13.760158+0000 mon.smithi008 (mon.0) 3179 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:45:14.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:13.761358+0000 mon.smithi008 (mon.0) 3180 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:45:14.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:13.768625+0000 mon.smithi008 (mon.0) 3181 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:14.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:13.775731+0000 mon.smithi008 (mon.0) 3182 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:14.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:13.779605+0000 mon.smithi008 (mon.0) 3183 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:14.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:13.781332+0000 mon.smithi008 (mon.0) 3184 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:14.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:13.782870+0000 mon.smithi008 (mon.0) 3185 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:14.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:13.784863+0000 mon.smithi008 (mon.0) 3186 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:14.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:13.203999+0000 mon.smithi008 (mon.0) 3178 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:13.760158+0000 mon.smithi008 (mon.0) 3179 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:45:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:13.761358+0000 mon.smithi008 (mon.0) 3180 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:45:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:13.768625+0000 mon.smithi008 (mon.0) 3181 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:13.775731+0000 mon.smithi008 (mon.0) 3182 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:13.779605+0000 mon.smithi008 (mon.0) 3183 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:13.781332+0000 mon.smithi008 (mon.0) 3184 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:13.782870+0000 mon.smithi008 (mon.0) 3185 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:13.784863+0000 mon.smithi008 (mon.0) 3186 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:13.178010+0000 mgr.smithi008.flmjzp (mgr.14640) 2783 : cluster [DBG] pgmap v1917: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:13.762375+0000 mgr.smithi008.flmjzp (mgr.14640) 2784 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:45:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:13.763119+0000 mgr.smithi008.flmjzp (mgr.14640) 2785 : cluster [DBG] pgmap v1918: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:13.763531+0000 mgr.smithi008.flmjzp (mgr.14640) 2786 : cluster [DBG] pgmap v1919: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:13.786844+0000 mgr.smithi008.flmjzp (mgr.14640) 2787 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:45:15.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:13.178010+0000 mgr.smithi008.flmjzp (mgr.14640) 2783 : cluster [DBG] pgmap v1917: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:13.762375+0000 mgr.smithi008.flmjzp (mgr.14640) 2784 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:45:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:13.763119+0000 mgr.smithi008.flmjzp (mgr.14640) 2785 : cluster [DBG] pgmap v1918: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:13.763531+0000 mgr.smithi008.flmjzp (mgr.14640) 2786 : cluster [DBG] pgmap v1919: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:13.786844+0000 mgr.smithi008.flmjzp (mgr.14640) 2787 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:45:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:15.764217+0000 mgr.smithi008.flmjzp (mgr.14640) 2788 : cluster [DBG] pgmap v1920: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:16.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:15.764217+0000 mgr.smithi008.flmjzp (mgr.14640) 2788 : cluster [DBG] pgmap v1920: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:19.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:17.764742+0000 mgr.smithi008.flmjzp (mgr.14640) 2789 : cluster [DBG] pgmap v1921: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:19.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:17.764742+0000 mgr.smithi008.flmjzp (mgr.14640) 2789 : cluster [DBG] pgmap v1921: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:19.765221+0000 mgr.smithi008.flmjzp (mgr.14640) 2790 : cluster [DBG] pgmap v1922: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:21.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:19.765221+0000 mgr.smithi008.flmjzp (mgr.14640) 2790 : cluster [DBG] pgmap v1922: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:21.765774+0000 mgr.smithi008.flmjzp (mgr.14640) 2791 : cluster [DBG] pgmap v1923: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:23.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:21.765774+0000 mgr.smithi008.flmjzp (mgr.14640) 2791 : cluster [DBG] pgmap v1923: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:23.797762+0000 mon.smithi008 (mon.0) 3187 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:23.799997+0000 mon.smithi008 (mon.0) 3188 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:45:23.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:23.801091+0000 mon.smithi008 (mon.0) 3189 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:45:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:23.807829+0000 mon.smithi008 (mon.0) 3190 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:23.813997+0000 mon.smithi008 (mon.0) 3191 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:23.817251+0000 mon.smithi008 (mon.0) 3192 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:23.818951+0000 mon.smithi008 (mon.0) 3193 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:23.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:23.820629+0000 mon.smithi008 (mon.0) 3194 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:23.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:23.822665+0000 mon.smithi008 (mon.0) 3195 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:23.797762+0000 mon.smithi008 (mon.0) 3187 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:23.799997+0000 mon.smithi008 (mon.0) 3188 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:45:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:23.801091+0000 mon.smithi008 (mon.0) 3189 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:45:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:23.807829+0000 mon.smithi008 (mon.0) 3190 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:24.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:23.813997+0000 mon.smithi008 (mon.0) 3191 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:24.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:23.817251+0000 mon.smithi008 (mon.0) 3192 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:24.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:23.818951+0000 mon.smithi008 (mon.0) 3193 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:24.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:23.820629+0000 mon.smithi008 (mon.0) 3194 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:24.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:23.822665+0000 mon.smithi008 (mon.0) 3195 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:25.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.047+0000 7fa825c97700 1 -- 172.21.15.8:0/1366932629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa82006a3b0 msgr2=0x7fa82006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.047+0000 7fa825c97700 1 --2- 172.21.15.8:0/1366932629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa82006a3b0 0x7fa82006a830 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7fa80c004660 tx=0x7fa80c009b30).stop 2023-10-18T21:45:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.047+0000 7fa825c97700 1 -- 172.21.15.8:0/1366932629 shutdown_connections 2023-10-18T21:45:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.047+0000 7fa825c97700 1 --2- 172.21.15.8:0/1366932629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa82006a3b0 0x7fa82006a830 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.047+0000 7fa825c97700 1 --2- 172.21.15.8:0/1366932629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa82006b9c0 0x7fa820069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.047+0000 7fa825c97700 1 -- 172.21.15.8:0/1366932629 >> 172.21.15.8:0/1366932629 conn(0x7fa8200f1c90 msgr2=0x7fa8200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:25.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.047+0000 7fa825c97700 1 -- 172.21.15.8:0/1366932629 shutdown_connections 2023-10-18T21:45:25.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.047+0000 7fa825c97700 1 -- 172.21.15.8:0/1366932629 wait complete. 2023-10-18T21:45:25.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.048+0000 7fa825c97700 1 Processor -- start 2023-10-18T21:45:25.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.048+0000 7fa825c97700 1 -- start start 2023-10-18T21:45:25.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.049+0000 7fa825c97700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa82006a3b0 0x7fa820108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:25.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.049+0000 7fa825c97700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa82006b9c0 0x7fa820109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:25.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.049+0000 7fa825c97700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820109a10 con 0x7fa82006a3b0 2023-10-18T21:45:25.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.049+0000 7fa825c97700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820109b50 con 0x7fa82006b9c0 2023-10-18T21:45:25.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.049+0000 7fa824c95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa82006a3b0 0x7fa820108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:25.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.049+0000 7fa824c95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa82006a3b0 0x7fa820108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40074/0 (socket says 172.21.15.8:40074) 2023-10-18T21:45:25.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.049+0000 7fa824c95700 1 -- 172.21.15.8:0/617686855 learned_addr learned my addr 172.21.15.8:0/617686855 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:25.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.049+0000 7fa81ffff700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa82006b9c0 0x7fa820109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:25.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.050+0000 7fa824c95700 1 -- 172.21.15.8:0/617686855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa82006b9c0 msgr2=0x7fa820109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.050+0000 7fa824c95700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa82006b9c0 0x7fa820109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.050+0000 7fa824c95700 1 -- 172.21.15.8:0/617686855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c005040 con 0x7fa82006a3b0 2023-10-18T21:45:25.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.050+0000 7fa824c95700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa82006a3b0 0x7fa820108f70 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fa8140026d0 tx=0x7fa814009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:25.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.050+0000 7fa81d7fa700 1 -- 172.21.15.8:0/617686855 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8140079c0 con 0x7fa82006a3b0 2023-10-18T21:45:25.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.050+0000 7fa81d7fa700 1 -- 172.21.15.8:0/617686855 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa81400f040 con 0x7fa82006a3b0 2023-10-18T21:45:25.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.050+0000 7fa825c97700 1 -- 172.21.15.8:0/617686855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82010a4f0 con 0x7fa82006a3b0 2023-10-18T21:45:25.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.050+0000 7fa81d7fa700 1 -- 172.21.15.8:0/617686855 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa814014980 con 0x7fa82006a3b0 2023-10-18T21:45:25.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.050+0000 7fa825c97700 1 -- 172.21.15.8:0/617686855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82010aab0 con 0x7fa82006a3b0 2023-10-18T21:45:25.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.051+0000 7fa825c97700 1 -- 172.21.15.8:0/617686855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa820045ad0 con 0x7fa82006a3b0 2023-10-18T21:45:25.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.052+0000 7fa81d7fa700 1 -- 172.21.15.8:0/617686855 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa8140090d0 con 0x7fa82006a3b0 2023-10-18T21:45:25.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.053+0000 7fa81d7fa700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa810060f70 0x7fa810063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:25.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.053+0000 7fa81d7fa700 1 -- 172.21.15.8:0/617686855 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa81407c8a0 con 0x7fa82006a3b0 2023-10-18T21:45:25.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.053+0000 7fa81ffff700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa810060f70 0x7fa810063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:25.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.054+0000 7fa81ffff700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa810060f70 0x7fa810063430 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fa80c004630 tx=0x7fa80c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:25.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.057+0000 7fa81d7fa700 1 -- 172.21.15.8:0/617686855 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa81404ffb0 con 0x7fa82006a3b0 2023-10-18T21:45:25.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:23.766382+0000 mgr.smithi008.flmjzp (mgr.14640) 2792 : cluster [DBG] pgmap v1924: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:25.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:23.802067+0000 mgr.smithi008.flmjzp (mgr.14640) 2793 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:45:25.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:23.802686+0000 mgr.smithi008.flmjzp (mgr.14640) 2794 : cluster [DBG] pgmap v1925: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:25.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:23.803088+0000 mgr.smithi008.flmjzp (mgr.14640) 2795 : cluster [DBG] pgmap v1926: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:25.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:23.824627+0000 mgr.smithi008.flmjzp (mgr.14640) 2796 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:45:25.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:23.766382+0000 mgr.smithi008.flmjzp (mgr.14640) 2792 : cluster [DBG] pgmap v1924: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:25.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:23.802067+0000 mgr.smithi008.flmjzp (mgr.14640) 2793 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:45:25.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:23.802686+0000 mgr.smithi008.flmjzp (mgr.14640) 2794 : cluster [DBG] pgmap v1925: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:25.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:23.803088+0000 mgr.smithi008.flmjzp (mgr.14640) 2795 : cluster [DBG] pgmap v1926: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:25.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:23.824627+0000 mgr.smithi008.flmjzp (mgr.14640) 2796 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:45:25.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.264+0000 7fa825c97700 1 -- 172.21.15.8:0/617686855 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa820100ff0 con 0x7fa810060f70 2023-10-18T21:45:25.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.265+0000 7fa81d7fa700 1 -- 172.21.15.8:0/617686855 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa820100ff0 con 0x7fa810060f70 2023-10-18T21:45:25.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 -- 172.21.15.8:0/617686855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa810060f70 msgr2=0x7fa810063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa810060f70 0x7fa810063430 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fa80c004630 tx=0x7fa80c009b30).stop 2023-10-18T21:45:25.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 -- 172.21.15.8:0/617686855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa82006a3b0 msgr2=0x7fa820108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa82006a3b0 0x7fa820108f70 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fa8140026d0 tx=0x7fa814009de0).stop 2023-10-18T21:45:25.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 -- 172.21.15.8:0/617686855 shutdown_connections 2023-10-18T21:45:25.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa810060f70 0x7fa810063430 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa82006a3b0 0x7fa820108f70 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 --2- 172.21.15.8:0/617686855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa82006b9c0 0x7fa820109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 -- 172.21.15.8:0/617686855 >> 172.21.15.8:0/617686855 conn(0x7fa8200f1c90 msgr2=0x7fa8200fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:25.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 -- 172.21.15.8:0/617686855 shutdown_connections 2023-10-18T21:45:25.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.267+0000 7fa825c97700 1 -- 172.21.15.8:0/617686855 wait complete. 2023-10-18T21:45:25.283 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:45:25.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.404+0000 7f962949f700 1 -- 172.21.15.8:0/3487236054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96240f6530 msgr2=0x7f96240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.404+0000 7f962949f700 1 --2- 172.21.15.8:0/3487236054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96240f6530 0x7f96240f6950 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f9614004660 tx=0x7f9614009b30).stop 2023-10-18T21:45:25.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.404+0000 7f962949f700 1 -- 172.21.15.8:0/3487236054 shutdown_connections 2023-10-18T21:45:25.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.404+0000 7f962949f700 1 --2- 172.21.15.8:0/3487236054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96240f77d0 0x7f96240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.404+0000 7f962949f700 1 --2- 172.21.15.8:0/3487236054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96240f6530 0x7f96240f6950 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.404+0000 7f962949f700 1 -- 172.21.15.8:0/3487236054 >> 172.21.15.8:0/3487236054 conn(0x7f96240f1c90 msgr2=0x7f96240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:25.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.404+0000 7f962949f700 1 -- 172.21.15.8:0/3487236054 shutdown_connections 2023-10-18T21:45:25.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.404+0000 7f962949f700 1 -- 172.21.15.8:0/3487236054 wait complete. 2023-10-18T21:45:25.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.405+0000 7f962949f700 1 Processor -- start 2023-10-18T21:45:25.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.405+0000 7f962949f700 1 -- start start 2023-10-18T21:45:25.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f962949f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96240f6530 0x7f9624108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:25.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f962949f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96240f77d0 0x7f96241094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:25.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f962949f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9624109a70 con 0x7f96240f77d0 2023-10-18T21:45:25.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f962949f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9624109bb0 con 0x7f96240f6530 2023-10-18T21:45:25.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f96237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96240f77d0 0x7f96241094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:25.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f96237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96240f77d0 0x7f96241094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40090/0 (socket says 172.21.15.8:40090) 2023-10-18T21:45:25.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f96237fe700 1 -- 172.21.15.8:0/3429001116 learned_addr learned my addr 172.21.15.8:0/3429001116 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:25.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f9623fff700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96240f6530 0x7f9624108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:25.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f96237fe700 1 -- 172.21.15.8:0/3429001116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96240f6530 msgr2=0x7f9624108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f96237fe700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96240f6530 0x7f9624108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.406+0000 7f96237fe700 1 -- 172.21.15.8:0/3429001116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614005040 con 0x7f96240f77d0 2023-10-18T21:45:25.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.407+0000 7f96237fe700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96240f77d0 0x7f96241094c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f96180026d0 tx=0x7f9618009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:25.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.407+0000 7f9620ff9700 1 -- 172.21.15.8:0/3429001116 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96180079c0 con 0x7f96240f77d0 2023-10-18T21:45:25.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.407+0000 7f9620ff9700 1 -- 172.21.15.8:0/3429001116 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f961800f040 con 0x7f96240f77d0 2023-10-18T21:45:25.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.407+0000 7f9620ff9700 1 -- 172.21.15.8:0/3429001116 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9618014980 con 0x7f96240f77d0 2023-10-18T21:45:25.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.407+0000 7f962949f700 1 -- 172.21.15.8:0/3429001116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962410a550 con 0x7f96240f77d0 2023-10-18T21:45:25.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.407+0000 7f962949f700 1 -- 172.21.15.8:0/3429001116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962410ab10 con 0x7f96240f77d0 2023-10-18T21:45:25.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.408+0000 7f962949f700 1 -- 172.21.15.8:0/3429001116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9624045ad0 con 0x7f96240f77d0 2023-10-18T21:45:25.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.409+0000 7f9620ff9700 1 -- 172.21.15.8:0/3429001116 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f96180090d0 con 0x7f96240f77d0 2023-10-18T21:45:25.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.410+0000 7f9620ff9700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f960c060f70 0x7f960c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:25.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.410+0000 7f9620ff9700 1 -- 172.21.15.8:0/3429001116 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f961807c8a0 con 0x7f96240f77d0 2023-10-18T21:45:25.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.410+0000 7f9623fff700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f960c060f70 0x7f960c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:25.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.411+0000 7f9623fff700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f960c060f70 0x7f960c063430 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f9614004630 tx=0x7f9614009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:25.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.414+0000 7f9620ff9700 1 -- 172.21.15.8:0/3429001116 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f961804ffb0 con 0x7f96240f77d0 2023-10-18T21:45:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.612+0000 7f962949f700 1 -- 172.21.15.8:0/3429001116 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f96240fee40 con 0x7f960c060f70 2023-10-18T21:45:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.614+0000 7f9620ff9700 1 -- 172.21.15.8:0/3429001116 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f96240fee40 con 0x7f960c060f70 2023-10-18T21:45:25.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 -- 172.21.15.8:0/3429001116 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f960c060f70 msgr2=0x7f960c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f960c060f70 0x7f960c063430 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f9614004630 tx=0x7f9614009b30).stop 2023-10-18T21:45:25.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 -- 172.21.15.8:0/3429001116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96240f77d0 msgr2=0x7f96241094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96240f77d0 0x7f96241094c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f96180026d0 tx=0x7f9618009de0).stop 2023-10-18T21:45:25.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 -- 172.21.15.8:0/3429001116 shutdown_connections 2023-10-18T21:45:25.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f960c060f70 0x7f960c063430 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96240f6530 0x7f9624108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 --2- 172.21.15.8:0/3429001116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96240f77d0 0x7f96241094c0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 -- 172.21.15.8:0/3429001116 >> 172.21.15.8:0/3429001116 conn(0x7f96240f1c90 msgr2=0x7f962406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:25.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 -- 172.21.15.8:0/3429001116 shutdown_connections 2023-10-18T21:45:25.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.616+0000 7f962949f700 1 -- 172.21.15.8:0/3429001116 wait complete. 2023-10-18T21:45:25.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.753+0000 7f734b59e700 1 -- 172.21.15.8:0/2455058468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734c0f77d0 msgr2=0x7f734c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.753+0000 7f734b59e700 1 --2- 172.21.15.8:0/2455058468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734c0f77d0 0x7f734c0f7c30 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f7340004660 tx=0x7f7340009b30).stop 2023-10-18T21:45:25.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.753+0000 7f734b59e700 1 -- 172.21.15.8:0/2455058468 shutdown_connections 2023-10-18T21:45:25.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.753+0000 7f734b59e700 1 --2- 172.21.15.8:0/2455058468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734c0f77d0 0x7f734c0f7c30 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.753+0000 7f734b59e700 1 --2- 172.21.15.8:0/2455058468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0f6530 0x7f734c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.753+0000 7f734b59e700 1 -- 172.21.15.8:0/2455058468 >> 172.21.15.8:0/2455058468 conn(0x7f734c0f1c90 msgr2=0x7f734c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:25.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.754+0000 7f734b59e700 1 -- 172.21.15.8:0/2455058468 shutdown_connections 2023-10-18T21:45:25.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.754+0000 7f734b59e700 1 -- 172.21.15.8:0/2455058468 wait complete. 2023-10-18T21:45:25.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.754+0000 7f734b59e700 1 Processor -- start 2023-10-18T21:45:25.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.754+0000 7f734b59e700 1 -- start start 2023-10-18T21:45:25.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f734b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734c0f6530 0x7f734c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:25.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f734b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0f77d0 0x7f734c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:25.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f734b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c107880 con 0x7f734c0f6530 2023-10-18T21:45:25.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f734b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c1080c0 con 0x7f734c0f77d0 2023-10-18T21:45:25.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f734a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734c0f6530 0x7f734c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:25.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f734a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734c0f6530 0x7f734c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40104/0 (socket says 172.21.15.8:40104) 2023-10-18T21:45:25.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f734a59c700 1 -- 172.21.15.8:0/179123203 learned_addr learned my addr 172.21.15.8:0/179123203 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:25.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f7349d9b700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0f77d0 0x7f734c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:25.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f734a59c700 1 -- 172.21.15.8:0/179123203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0f77d0 msgr2=0x7f734c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f734a59c700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0f77d0 0x7f734c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f734a59c700 1 -- 172.21.15.8:0/179123203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340005040 con 0x7f734c0f6530 2023-10-18T21:45:25.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.755+0000 7f7349d9b700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0f77d0 0x7f734c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:45:25.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.756+0000 7f734a59c700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734c0f6530 0x7f734c106d90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f733c002700 tx=0x7f733c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:25.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.756+0000 7f733affd700 1 -- 172.21.15.8:0/179123203 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733c009320 con 0x7f734c0f6530 2023-10-18T21:45:25.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.756+0000 7f733affd700 1 -- 172.21.15.8:0/179123203 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f733c00f040 con 0x7f734c0f6530 2023-10-18T21:45:25.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.756+0000 7f733affd700 1 -- 172.21.15.8:0/179123203 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733c014970 con 0x7f734c0f6530 2023-10-18T21:45:25.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.756+0000 7f734b59e700 1 -- 172.21.15.8:0/179123203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c1083a0 con 0x7f734c0f6530 2023-10-18T21:45:25.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.756+0000 7f734b59e700 1 -- 172.21.15.8:0/179123203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c108890 con 0x7f734c0f6530 2023-10-18T21:45:25.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.757+0000 7f734b59e700 1 -- 172.21.15.8:0/179123203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c059100 con 0x7f734c0f6530 2023-10-18T21:45:25.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.758+0000 7f733affd700 1 -- 172.21.15.8:0/179123203 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f733c009480 con 0x7f734c0f6530 2023-10-18T21:45:25.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.759+0000 7f733affd700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7334060f70 0x7f7334063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:25.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.759+0000 7f733affd700 1 -- 172.21.15.8:0/179123203 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f733c07cc40 con 0x7f734c0f6530 2023-10-18T21:45:25.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.759+0000 7f7349d9b700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7334060f70 0x7f7334063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:25.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.760+0000 7f7349d9b700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7334060f70 0x7f7334063430 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f7340009d60 tx=0x7f7340009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:25.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.763+0000 7f733affd700 1 -- 172.21.15.8:0/179123203 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f733c04c7f0 con 0x7f734c0f6530 2023-10-18T21:45:25.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.956+0000 7f734b59e700 1 -- 172.21.15.8:0/179123203 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f734c0fee70 con 0x7f7334060f70 2023-10-18T21:45:25.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.966+0000 7f733affd700 1 -- 172.21.15.8:0/179123203 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7340013410 con 0x7f7334060f70 2023-10-18T21:45:25.969 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:45:25.969 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (52m) 9m ago 53m 17.1M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:45:25.969 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (45m) 9m ago 53m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:45:25.970 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (45m) 7m ago 52m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:45:25.970 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (52m) 9m ago 53m 27.3M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:45:25.970 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 49m - - 2023-10-18T21:45:25.970 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 49m - - 2023-10-18T21:45:25.971 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 49m - - 2023-10-18T21:45:25.971 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 49m - - 2023-10-18T21:45:25.971 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (47m) 9m ago 54m 503M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:45:25.972 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (46m) 7m ago 52m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:45:25.972 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (46m) 9m ago 55m 333M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:45:25.972 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (46m) 7m ago 52m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:45:25.973 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (53m) 9m ago 53m 10.3M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:45:25.973 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (52m) 7m ago 52m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:45:25.973 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (45m) 9m ago 52m 511M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:45:25.973 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (43m) 9m ago 51m 400M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:45:25.974 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (43m) 9m ago 51m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:45:25.974 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (42m) 7m ago 51m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:45:25.974 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (42m) 7m ago 50m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:45:25.974 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (41m) 7m ago 50m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:45:25.975 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (47m) 9m ago 52m 73.0M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:45:25.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 -- 172.21.15.8:0/179123203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7334060f70 msgr2=0x7f7334063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7334060f70 0x7f7334063430 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f7340009d60 tx=0x7f7340009b30).stop 2023-10-18T21:45:25.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 -- 172.21.15.8:0/179123203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734c0f6530 msgr2=0x7f734c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:25.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734c0f6530 0x7f734c106d90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f733c002700 tx=0x7f733c009d80).stop 2023-10-18T21:45:25.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 -- 172.21.15.8:0/179123203 shutdown_connections 2023-10-18T21:45:25.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7334060f70 0x7f7334063430 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734c0f6530 0x7f734c106d90 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 --2- 172.21.15.8:0/179123203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0f77d0 0x7f734c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:25.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 -- 172.21.15.8:0/179123203 >> 172.21.15.8:0/179123203 conn(0x7f734c0f1c90 msgr2=0x7f734c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:25.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 -- 172.21.15.8:0/179123203 shutdown_connections 2023-10-18T21:45:25.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:25.968+0000 7f734b59e700 1 -- 172.21.15.8:0/179123203 wait complete. 2023-10-18T21:45:26.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.103+0000 7fbf90dcb700 1 -- 172.21.15.8:0/197460614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf8c0f77d0 msgr2=0x7fbf8c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:26.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.103+0000 7fbf90dcb700 1 --2- 172.21.15.8:0/197460614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf8c0f77d0 0x7fbf8c0f7c30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fbf80004660 tx=0x7fbf80009b30).stop 2023-10-18T21:45:26.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.103+0000 7fbf90dcb700 1 -- 172.21.15.8:0/197460614 shutdown_connections 2023-10-18T21:45:26.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.103+0000 7fbf90dcb700 1 --2- 172.21.15.8:0/197460614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf8c0f77d0 0x7fbf8c0f7c30 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.103+0000 7fbf90dcb700 1 --2- 172.21.15.8:0/197460614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8c0f6530 0x7fbf8c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.103+0000 7fbf90dcb700 1 -- 172.21.15.8:0/197460614 >> 172.21.15.8:0/197460614 conn(0x7fbf8c0f1c90 msgr2=0x7fbf8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.103+0000 7fbf90dcb700 1 -- 172.21.15.8:0/197460614 shutdown_connections 2023-10-18T21:45:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.103+0000 7fbf90dcb700 1 -- 172.21.15.8:0/197460614 wait complete. 2023-10-18T21:45:26.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.104+0000 7fbf90dcb700 1 Processor -- start 2023-10-18T21:45:26.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.104+0000 7fbf90dcb700 1 -- start start 2023-10-18T21:45:26.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf90dcb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf8c0f6530 0x7fbf8c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:26.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf90dcb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8c0f77d0 0x7fbf8c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:26.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf90dcb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c109970 con 0x7fbf8c0f6530 2023-10-18T21:45:26.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf90dcb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c109ab0 con 0x7fbf8c0f77d0 2023-10-18T21:45:26.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf8c0f6530 0x7fbf8c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:26.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf8c0f6530 0x7fbf8c108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40118/0 (socket says 172.21.15.8:40118) 2023-10-18T21:45:26.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf8b7fe700 1 -- 172.21.15.8:0/613586481 learned_addr learned my addr 172.21.15.8:0/613586481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:26.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf8affd700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8c0f77d0 0x7fbf8c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:26.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf8b7fe700 1 -- 172.21.15.8:0/613586481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8c0f77d0 msgr2=0x7fbf8c1093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:26.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf8b7fe700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8c0f77d0 0x7fbf8c1093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.105+0000 7fbf8b7fe700 1 -- 172.21.15.8:0/613586481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf80005040 con 0x7fbf8c0f6530 2023-10-18T21:45:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.106+0000 7fbf8b7fe700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf8c0f6530 0x7fbf8c108ed0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fbf7c00e7c0 tx=0x7fbf7c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.106+0000 7fbf73fff700 1 -- 172.21.15.8:0/613586481 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf7c0092e0 con 0x7fbf8c0f6530 2023-10-18T21:45:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.106+0000 7fbf73fff700 1 -- 172.21.15.8:0/613586481 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbf7c00f040 con 0x7fbf8c0f6530 2023-10-18T21:45:26.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.106+0000 7fbf90dcb700 1 -- 172.21.15.8:0/613586481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c10a450 con 0x7fbf8c0f6530 2023-10-18T21:45:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.106+0000 7fbf73fff700 1 -- 172.21.15.8:0/613586481 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf7c0147e0 con 0x7fbf8c0f6530 2023-10-18T21:45:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.106+0000 7fbf90dcb700 1 -- 172.21.15.8:0/613586481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c10a990 con 0x7fbf8c0f6530 2023-10-18T21:45:26.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.107+0000 7fbf90dcb700 1 -- 172.21.15.8:0/613586481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c045ad0 con 0x7fbf8c0f6530 2023-10-18T21:45:26.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.108+0000 7fbf73fff700 1 -- 172.21.15.8:0/613586481 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbf7c01b030 con 0x7fbf8c0f6530 2023-10-18T21:45:26.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.109+0000 7fbf73fff700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf74060f70 0x7fbf74063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:26.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.109+0000 7fbf73fff700 1 -- 172.21.15.8:0/613586481 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbf7c07c8d0 con 0x7fbf8c0f6530 2023-10-18T21:45:26.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.109+0000 7fbf8affd700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf74060f70 0x7fbf74063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.110+0000 7fbf8affd700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf74060f70 0x7fbf74063430 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fbf80009720 tx=0x7fbf8000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:26.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.113+0000 7fbf73fff700 1 -- 172.21.15.8:0/613586481 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbf7c04ff10 con 0x7fbf8c0f6530 2023-10-18T21:45:26.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.372+0000 7fbf90dcb700 1 -- 172.21.15.8:0/613586481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbf8c0fee40 con 0x7fbf8c0f6530 2023-10-18T21:45:26.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.373+0000 7fbf73fff700 1 -- 172.21.15.8:0/613586481 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fbf7c019020 con 0x7fbf8c0f6530 2023-10-18T21:45:26.376 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:45:26.376 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:45:26.376 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:45:26.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:45:26.377 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:45:26.377 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:45:26.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:45:26.378 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:45:26.378 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:45:26.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:45:26.379 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:45:26.379 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:45:26.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:45:26.379 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:45:26.379 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:45:26.380 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:45:26.380 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:45:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 -- 172.21.15.8:0/613586481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf74060f70 msgr2=0x7fbf74063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:26.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf74060f70 0x7fbf74063430 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fbf80009720 tx=0x7fbf8000b040).stop 2023-10-18T21:45:26.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 -- 172.21.15.8:0/613586481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf8c0f6530 msgr2=0x7fbf8c108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:26.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf8c0f6530 0x7fbf8c108ed0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fbf7c00e7c0 tx=0x7fbf7c00b040).stop 2023-10-18T21:45:26.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 -- 172.21.15.8:0/613586481 shutdown_connections 2023-10-18T21:45:26.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf74060f70 0x7fbf74063430 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf8c0f6530 0x7fbf8c108ed0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 --2- 172.21.15.8:0/613586481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8c0f77d0 0x7fbf8c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 -- 172.21.15.8:0/613586481 >> 172.21.15.8:0/613586481 conn(0x7fbf8c0f1c90 msgr2=0x7fbf8c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:26.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 -- 172.21.15.8:0/613586481 shutdown_connections 2023-10-18T21:45:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.375+0000 7fbf90dcb700 1 -- 172.21.15.8:0/613586481 wait complete. 2023-10-18T21:45:26.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.512+0000 7f7da6514700 1 -- 172.21.15.8:0/324912131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da00f77d0 msgr2=0x7f7da00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:26.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.512+0000 7f7da6514700 1 --2- 172.21.15.8:0/324912131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da00f77d0 0x7f7da00f7c30 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f7d90004660 tx=0x7f7d90009b30).stop 2023-10-18T21:45:26.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.512+0000 7f7da6514700 1 -- 172.21.15.8:0/324912131 shutdown_connections 2023-10-18T21:45:26.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.512+0000 7f7da6514700 1 --2- 172.21.15.8:0/324912131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da00f77d0 0x7f7da00f7c30 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.512+0000 7f7da6514700 1 --2- 172.21.15.8:0/324912131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7da00f6530 0x7f7da00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.512+0000 7f7da6514700 1 -- 172.21.15.8:0/324912131 >> 172.21.15.8:0/324912131 conn(0x7f7da00f1c90 msgr2=0x7f7da00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:26.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.512+0000 7f7da6514700 1 -- 172.21.15.8:0/324912131 shutdown_connections 2023-10-18T21:45:26.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.512+0000 7f7da6514700 1 -- 172.21.15.8:0/324912131 wait complete. 2023-10-18T21:45:26.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.513+0000 7f7da6514700 1 Processor -- start 2023-10-18T21:45:26.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.513+0000 7f7da6514700 1 -- start start 2023-10-18T21:45:26.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da6514700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da00f6530 0x7f7da0106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:26.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da6514700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7da00f77d0 0x7f7da0107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:26.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da6514700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0107830 con 0x7f7da00f6530 2023-10-18T21:45:26.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da6514700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0108040 con 0x7f7da00f77d0 2023-10-18T21:45:26.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da5512700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da00f6530 0x7f7da0106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:26.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da4d11700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7da00f77d0 0x7f7da0107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:26.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da5512700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da00f6530 0x7f7da0106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40138/0 (socket says 172.21.15.8:40138) 2023-10-18T21:45:26.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da5512700 1 -- 172.21.15.8:0/1350513693 learned_addr learned my addr 172.21.15.8:0/1350513693 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da4d11700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7da00f77d0 0x7f7da0107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:53878/0 (socket says 172.21.15.8:53878) 2023-10-18T21:45:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da5512700 1 -- 172.21.15.8:0/1350513693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7da00f77d0 msgr2=0x7f7da0107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da5512700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7da00f77d0 0x7f7da0107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.514+0000 7f7da5512700 1 -- 172.21.15.8:0/1350513693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90005040 con 0x7f7da00f6530 2023-10-18T21:45:26.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.515+0000 7f7da5512700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da00f6530 0x7f7da0106d40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f7d9c002700 tx=0x7f7d9c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.515+0000 7f7d95ffb700 1 -- 172.21.15.8:0/1350513693 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9c0079c0 con 0x7f7da00f6530 2023-10-18T21:45:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.515+0000 7f7d95ffb700 1 -- 172.21.15.8:0/1350513693 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7d9c00f040 con 0x7f7da00f6530 2023-10-18T21:45:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.515+0000 7f7da6514700 1 -- 172.21.15.8:0/1350513693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da01082c0 con 0x7f7da00f6530 2023-10-18T21:45:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.515+0000 7f7d95ffb700 1 -- 172.21.15.8:0/1350513693 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9c0148d0 con 0x7f7da00f6530 2023-10-18T21:45:26.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.515+0000 7f7da6514700 1 -- 172.21.15.8:0/1350513693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da0108880 con 0x7f7da00f6530 2023-10-18T21:45:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.516+0000 7f7da6514700 1 -- 172.21.15.8:0/1350513693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da0059100 con 0x7f7da00f6530 2023-10-18T21:45:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.517+0000 7f7d95ffb700 1 -- 172.21.15.8:0/1350513693 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7d9c01b060 con 0x7f7da00f6530 2023-10-18T21:45:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.518+0000 7f7d95ffb700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7d8c060f70 0x7f7d8c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.518+0000 7f7d95ffb700 1 -- 172.21.15.8:0/1350513693 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7d9c07c6b0 con 0x7f7da00f6530 2023-10-18T21:45:26.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.518+0000 7f7da4d11700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7d8c060f70 0x7f7d8c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:26.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.519+0000 7f7da4d11700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7d8c060f70 0x7f7d8c063430 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f7d90004630 tx=0x7f7d90009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:26.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.522+0000 7f7d95ffb700 1 -- 172.21.15.8:0/1350513693 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7d9c04c3a0 con 0x7f7da00f6530 2023-10-18T21:45:26.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.746+0000 7f7da6514700 1 -- 172.21.15.8:0/1350513693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7da0045ad0 con 0x7f7da00f6530 2023-10-18T21:45:26.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.746+0000 7f7d95ffb700 1 -- 172.21.15.8:0/1350513693 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f7d9c04f9c0 con 0x7f7da00f6530 2023-10-18T21:45:26.749 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:45:26.749 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:45:26.749 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:45:26.750 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:45:26.750 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:45:26.750 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:45:26.750 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:45:26.750 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:45:26.751 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:45:26.751 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:45:26.751 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:45:26.751 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:45:26.751 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:45:26.752 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:45:26.752 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:45:26.752 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:45:26.752 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:45:26.752 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:45:26.753 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:45:26.753 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:45:26.753 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:45:26.753 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:45:26.753 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:45:26.753 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:45:26.754 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:45:26.754 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:45:26.754 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:45:26.754 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:45:26.754 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:45:26.755 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:45:26.755 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:45:26.755 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:45:26.755 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:45:26.755 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:45:26.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.748+0000 7f7da6514700 1 -- 172.21.15.8:0/1350513693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7d8c060f70 msgr2=0x7f7d8c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:26.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.748+0000 7f7da6514700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7d8c060f70 0x7f7d8c063430 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f7d90004630 tx=0x7f7d90009b30).stop 2023-10-18T21:45:26.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.748+0000 7f7da6514700 1 -- 172.21.15.8:0/1350513693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da00f6530 msgr2=0x7f7da0106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:26.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.748+0000 7f7da6514700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da00f6530 0x7f7da0106d40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f7d9c002700 tx=0x7f7d9c009d80).stop 2023-10-18T21:45:26.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.749+0000 7f7da6514700 1 -- 172.21.15.8:0/1350513693 shutdown_connections 2023-10-18T21:45:26.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.749+0000 7f7da6514700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7d8c060f70 0x7f7d8c063430 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.749+0000 7f7da6514700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da00f6530 0x7f7da0106d40 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.749+0000 7f7da6514700 1 --2- 172.21.15.8:0/1350513693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7da00f77d0 0x7f7da0107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.749+0000 7f7da6514700 1 -- 172.21.15.8:0/1350513693 >> 172.21.15.8:0/1350513693 conn(0x7f7da00f1c90 msgr2=0x7f7da00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:26.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.749+0000 7f7da6514700 1 -- 172.21.15.8:0/1350513693 shutdown_connections 2023-10-18T21:45:26.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.749+0000 7f7da6514700 1 -- 172.21.15.8:0/1350513693 wait complete. 2023-10-18T21:45:26.759 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:45:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.886+0000 7fab0759e700 1 -- 172.21.15.8:0/119464840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab080f6530 msgr2=0x7fab080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.886+0000 7fab0759e700 1 --2- 172.21.15.8:0/119464840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab080f6530 0x7fab080f6950 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7faaf8004660 tx=0x7faaf8009b30).stop 2023-10-18T21:45:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.886+0000 7fab0759e700 1 -- 172.21.15.8:0/119464840 shutdown_connections 2023-10-18T21:45:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.886+0000 7fab0759e700 1 --2- 172.21.15.8:0/119464840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab080f77d0 0x7fab080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.886+0000 7fab0759e700 1 --2- 172.21.15.8:0/119464840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab080f6530 0x7fab080f6950 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.886+0000 7fab0759e700 1 -- 172.21.15.8:0/119464840 >> 172.21.15.8:0/119464840 conn(0x7fab080f1c90 msgr2=0x7fab080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.886+0000 7fab0759e700 1 -- 172.21.15.8:0/119464840 shutdown_connections 2023-10-18T21:45:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.886+0000 7fab0759e700 1 -- 172.21.15.8:0/119464840 wait complete. 2023-10-18T21:45:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.887+0000 7fab0759e700 1 Processor -- start 2023-10-18T21:45:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.887+0000 7fab0759e700 1 -- start start 2023-10-18T21:45:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.888+0000 7fab0759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab080f6530 0x7fab0806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:26.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.888+0000 7fab0759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab080f77d0 0x7fab08069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:26.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.888+0000 7fab0759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0806a380 con 0x7fab080f6530 2023-10-18T21:45:26.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.888+0000 7fab0759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0806a4c0 con 0x7fab080f77d0 2023-10-18T21:45:26.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.888+0000 7fab0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab080f6530 0x7fab0806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:26.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.888+0000 7fab0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab080f6530 0x7fab0806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48150/0 (socket says 172.21.15.8:48150) 2023-10-18T21:45:26.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.888+0000 7fab0659c700 1 -- 172.21.15.8:0/206821804 learned_addr learned my addr 172.21.15.8:0/206821804 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:26.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.888+0000 7fab05d9b700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab080f77d0 0x7fab08069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:26.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.889+0000 7fab0659c700 1 -- 172.21.15.8:0/206821804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab080f77d0 msgr2=0x7fab08069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:26.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.889+0000 7fab0659c700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab080f77d0 0x7fab08069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:26.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.889+0000 7fab0659c700 1 -- 172.21.15.8:0/206821804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf8005040 con 0x7fab080f6530 2023-10-18T21:45:26.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.889+0000 7fab05d9b700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab080f77d0 0x7fab08069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:45:26.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.889+0000 7fab0659c700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab080f6530 0x7fab0806b9a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7faaf8009f50 tx=0x7faaf8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:26.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.889+0000 7faaf6ffd700 1 -- 172.21.15.8:0/206821804 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaf8018070 con 0x7fab080f6530 2023-10-18T21:45:26.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.889+0000 7faaf6ffd700 1 -- 172.21.15.8:0/206821804 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faaf801d8e0 con 0x7fab080f6530 2023-10-18T21:45:26.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.889+0000 7faaf6ffd700 1 -- 172.21.15.8:0/206821804 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaf801c4c0 con 0x7fab080f6530 2023-10-18T21:45:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.889+0000 7fab0759e700 1 -- 172.21.15.8:0/206821804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0806a740 con 0x7fab080f6530 2023-10-18T21:45:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.889+0000 7fab0759e700 1 -- 172.21.15.8:0/206821804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0806aca0 con 0x7fab080f6530 2023-10-18T21:45:26.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.890+0000 7fab0759e700 1 -- 172.21.15.8:0/206821804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab08045ad0 con 0x7fab080f6530 2023-10-18T21:45:26.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.891+0000 7faaf6ffd700 1 -- 172.21.15.8:0/206821804 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faaf801d420 con 0x7fab080f6530 2023-10-18T21:45:26.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.892+0000 7faaf6ffd700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faaf0060f70 0x7faaf0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:26.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.892+0000 7faaf6ffd700 1 -- 172.21.15.8:0/206821804 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faaf807e710 con 0x7fab080f6530 2023-10-18T21:45:26.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.892+0000 7fab05d9b700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faaf0060f70 0x7faaf0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:26.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.893+0000 7fab05d9b700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faaf0060f70 0x7faaf0063430 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7faafc004a90 tx=0x7faafc009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:26.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:26.896+0000 7faaf6ffd700 1 -- 172.21.15.8:0/206821804 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faaf804e400 con 0x7fab080f6530 2023-10-18T21:45:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:25.266499+0000 mgr.smithi008.flmjzp (mgr.14640) 2797 : audit [DBG] from='client.36352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:25.615194+0000 mgr.smithi008.flmjzp (mgr.14640) 2798 : audit [DBG] from='client.36356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:25.803531+0000 mgr.smithi008.flmjzp (mgr.14640) 2799 : cluster [DBG] pgmap v1927: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:25.958633+0000 mgr.smithi008.flmjzp (mgr.14640) 2800 : audit [DBG] from='client.36360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:26.374630+0000 mon.smithi008 (mon.0) 3196 : audit [DBG] from='client.? 172.21.15.8:0/613586481' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:25.266499+0000 mgr.smithi008.flmjzp (mgr.14640) 2797 : audit [DBG] from='client.36352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:25.615194+0000 mgr.smithi008.flmjzp (mgr.14640) 2798 : audit [DBG] from='client.36356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:25.803531+0000 mgr.smithi008.flmjzp (mgr.14640) 2799 : cluster [DBG] pgmap v1927: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:25.958633+0000 mgr.smithi008.flmjzp (mgr.14640) 2800 : audit [DBG] from='client.36360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:26.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:26.374630+0000 mon.smithi008 (mon.0) 3196 : audit [DBG] from='client.? 172.21.15.8:0/613586481' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:27.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.104+0000 7fab0759e700 1 -- 172.21.15.8:0/206821804 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab080feda0 con 0x7faaf0060f70 2023-10-18T21:45:27.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.105+0000 7faaf6ffd700 1 -- 172.21.15.8:0/206821804 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fab080feda0 con 0x7faaf0060f70 2023-10-18T21:45:27.107 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:45:27.108 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:45:27.108 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:45:27.108 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:45:27.108 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:45:27.109 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:45:27.109 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:45:27.109 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:45:27.109 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:45:27.109 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:45:27.109 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:45:27.110 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:45:27.110 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:45:27.110 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:45:27.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.107+0000 7fab0759e700 1 -- 172.21.15.8:0/206821804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faaf0060f70 msgr2=0x7faaf0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:27.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.107+0000 7fab0759e700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faaf0060f70 0x7faaf0063430 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7faafc004a90 tx=0x7faafc009040).stop 2023-10-18T21:45:27.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.107+0000 7fab0759e700 1 -- 172.21.15.8:0/206821804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab080f6530 msgr2=0x7fab0806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:27.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.107+0000 7fab0759e700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab080f6530 0x7fab0806b9a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7faaf8009f50 tx=0x7faaf8009b30).stop 2023-10-18T21:45:27.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.107+0000 7fab0759e700 1 -- 172.21.15.8:0/206821804 shutdown_connections 2023-10-18T21:45:27.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.107+0000 7fab0759e700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faaf0060f70 0x7faaf0063430 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:27.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.107+0000 7fab0759e700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab080f6530 0x7fab0806b9a0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:27.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.107+0000 7fab0759e700 1 --2- 172.21.15.8:0/206821804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab080f77d0 0x7fab08069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:27.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.107+0000 7fab0759e700 1 -- 172.21.15.8:0/206821804 >> 172.21.15.8:0/206821804 conn(0x7fab080f1c90 msgr2=0x7fab080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:27.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.108+0000 7fab0759e700 1 -- 172.21.15.8:0/206821804 shutdown_connections 2023-10-18T21:45:27.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:27.108+0000 7fab0759e700 1 -- 172.21.15.8:0/206821804 wait complete. 2023-10-18T21:45:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:26.748173+0000 mon.smithi008 (mon.0) 3197 : audit [DBG] from='client.? 172.21.15.8:0/1350513693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:45:27.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:26.748173+0000 mon.smithi008 (mon.0) 3197 : audit [DBG] from='client.? 172.21.15.8:0/1350513693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:45:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:27.106693+0000 mgr.smithi008.flmjzp (mgr.14640) 2801 : audit [DBG] from='client.36372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:28.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:27.804254+0000 mgr.smithi008.flmjzp (mgr.14640) 2802 : cluster [DBG] pgmap v1928: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:27.106693+0000 mgr.smithi008.flmjzp (mgr.14640) 2801 : audit [DBG] from='client.36372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:27.804254+0000 mgr.smithi008.flmjzp (mgr.14640) 2802 : cluster [DBG] pgmap v1928: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:29.804868+0000 mgr.smithi008.flmjzp (mgr.14640) 2803 : cluster [DBG] pgmap v1929: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:31.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:29.804868+0000 mgr.smithi008.flmjzp (mgr.14640) 2803 : cluster [DBG] pgmap v1929: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:31.805581+0000 mgr.smithi008.flmjzp (mgr.14640) 2804 : cluster [DBG] pgmap v1930: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:33.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:31.805581+0000 mgr.smithi008.flmjzp (mgr.14640) 2804 : cluster [DBG] pgmap v1930: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:33.831659+0000 mon.smithi008 (mon.0) 3198 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:33.833960+0000 mon.smithi008 (mon.0) 3199 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:45:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:33.834966+0000 mon.smithi008 (mon.0) 3200 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:45:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:33.841943+0000 mon.smithi008 (mon.0) 3201 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:33.848537+0000 mon.smithi008 (mon.0) 3202 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:33.851815+0000 mon.smithi008 (mon.0) 3203 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:33.853519+0000 mon.smithi008 (mon.0) 3204 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:34.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:33.855199+0000 mon.smithi008 (mon.0) 3205 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:34.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:33.857238+0000 mon.smithi008 (mon.0) 3206 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:33.831659+0000 mon.smithi008 (mon.0) 3198 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:33.833960+0000 mon.smithi008 (mon.0) 3199 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:45:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:33.834966+0000 mon.smithi008 (mon.0) 3200 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:45:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:33.841943+0000 mon.smithi008 (mon.0) 3201 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:33.848537+0000 mon.smithi008 (mon.0) 3202 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:33.851815+0000 mon.smithi008 (mon.0) 3203 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:34.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:33.853519+0000 mon.smithi008 (mon.0) 3204 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:34.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:33.855199+0000 mon.smithi008 (mon.0) 3205 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:34.241 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:33.857238+0000 mon.smithi008 (mon.0) 3206 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:35.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:33.806345+0000 mgr.smithi008.flmjzp (mgr.14640) 2805 : cluster [DBG] pgmap v1931: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:35.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:33.835836+0000 mgr.smithi008.flmjzp (mgr.14640) 2806 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:45:35.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:33.836396+0000 mgr.smithi008.flmjzp (mgr.14640) 2807 : cluster [DBG] pgmap v1932: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:35.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:33.836699+0000 mgr.smithi008.flmjzp (mgr.14640) 2808 : cluster [DBG] pgmap v1933: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:35.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:33.859198+0000 mgr.smithi008.flmjzp (mgr.14640) 2809 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:45:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:33.806345+0000 mgr.smithi008.flmjzp (mgr.14640) 2805 : cluster [DBG] pgmap v1931: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:33.835836+0000 mgr.smithi008.flmjzp (mgr.14640) 2806 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:45:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:33.836396+0000 mgr.smithi008.flmjzp (mgr.14640) 2807 : cluster [DBG] pgmap v1932: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:33.836699+0000 mgr.smithi008.flmjzp (mgr.14640) 2808 : cluster [DBG] pgmap v1933: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:35.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:33.859198+0000 mgr.smithi008.flmjzp (mgr.14640) 2809 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:45:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:35.837269+0000 mgr.smithi008.flmjzp (mgr.14640) 2810 : cluster [DBG] pgmap v1934: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:36.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:35.837269+0000 mgr.smithi008.flmjzp (mgr.14640) 2810 : cluster [DBG] pgmap v1934: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:37.837862+0000 mgr.smithi008.flmjzp (mgr.14640) 2811 : cluster [DBG] pgmap v1935: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:39.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:37.837862+0000 mgr.smithi008.flmjzp (mgr.14640) 2811 : cluster [DBG] pgmap v1935: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:39.838346+0000 mgr.smithi008.flmjzp (mgr.14640) 2812 : cluster [DBG] pgmap v1936: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:39.838346+0000 mgr.smithi008.flmjzp (mgr.14640) 2812 : cluster [DBG] pgmap v1936: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:41.838937+0000 mgr.smithi008.flmjzp (mgr.14640) 2813 : cluster [DBG] pgmap v1937: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:43.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:41.838937+0000 mgr.smithi008.flmjzp (mgr.14640) 2813 : cluster [DBG] pgmap v1937: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:43.860954+0000 mon.smithi008 (mon.0) 3207 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:43.860954+0000 mon.smithi008 (mon.0) 3207 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:45.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:43.839720+0000 mgr.smithi008.flmjzp (mgr.14640) 2814 : cluster [DBG] pgmap v1938: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:43.839720+0000 mgr.smithi008.flmjzp (mgr.14640) 2814 : cluster [DBG] pgmap v1938: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:45.840185+0000 mgr.smithi008.flmjzp (mgr.14640) 2815 : cluster [DBG] pgmap v1939: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:46.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:45.840185+0000 mgr.smithi008.flmjzp (mgr.14640) 2815 : cluster [DBG] pgmap v1939: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:47.840706+0000 mgr.smithi008.flmjzp (mgr.14640) 2816 : cluster [DBG] pgmap v1940: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:48.375150+0000 mon.smithi008 (mon.0) 3208 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:48.376046+0000 mon.smithi008 (mon.0) 3209 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:45:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:48.376819+0000 mon.smithi008 (mon.0) 3210 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:45:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:48.381744+0000 mon.smithi008 (mon.0) 3211 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:48.386687+0000 mon.smithi008 (mon.0) 3212 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:48.389228+0000 mon.smithi008 (mon.0) 3213 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:48.390576+0000 mon.smithi008 (mon.0) 3214 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:48.391854+0000 mon.smithi008 (mon.0) 3215 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:48.393463+0000 mon.smithi008 (mon.0) 3216 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:47.840706+0000 mgr.smithi008.flmjzp (mgr.14640) 2816 : cluster [DBG] pgmap v1940: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:48.375150+0000 mon.smithi008 (mon.0) 3208 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:48.376046+0000 mon.smithi008 (mon.0) 3209 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:45:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:48.376819+0000 mon.smithi008 (mon.0) 3210 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:45:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:48.381744+0000 mon.smithi008 (mon.0) 3211 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:45:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:48.386687+0000 mon.smithi008 (mon.0) 3212 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:48.389228+0000 mon.smithi008 (mon.0) 3213 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:48.390576+0000 mon.smithi008 (mon.0) 3214 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:48.391854+0000 mon.smithi008 (mon.0) 3215 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:48.393463+0000 mon.smithi008 (mon.0) 3216 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:50.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:48.377526+0000 mgr.smithi008.flmjzp (mgr.14640) 2817 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:45:50.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:48.378032+0000 mgr.smithi008.flmjzp (mgr.14640) 2818 : cluster [DBG] pgmap v1941: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:50.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:48.378241+0000 mgr.smithi008.flmjzp (mgr.14640) 2819 : cluster [DBG] pgmap v1942: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:50.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:48.395056+0000 mgr.smithi008.flmjzp (mgr.14640) 2820 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:45:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:48.377526+0000 mgr.smithi008.flmjzp (mgr.14640) 2817 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:45:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:48.378032+0000 mgr.smithi008.flmjzp (mgr.14640) 2818 : cluster [DBG] pgmap v1941: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:48.378241+0000 mgr.smithi008.flmjzp (mgr.14640) 2819 : cluster [DBG] pgmap v1942: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:48.395056+0000 mgr.smithi008.flmjzp (mgr.14640) 2820 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:45:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:50.378766+0000 mgr.smithi008.flmjzp (mgr.14640) 2821 : cluster [DBG] pgmap v1943: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:50.378766+0000 mgr.smithi008.flmjzp (mgr.14640) 2821 : cluster [DBG] pgmap v1943: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:52.379424+0000 mgr.smithi008.flmjzp (mgr.14640) 2822 : cluster [DBG] pgmap v1944: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:52.379424+0000 mgr.smithi008.flmjzp (mgr.14640) 2822 : cluster [DBG] pgmap v1944: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:54.380021+0000 mgr.smithi008.flmjzp (mgr.14640) 2823 : cluster [DBG] pgmap v1945: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:56.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:54.380021+0000 mgr.smithi008.flmjzp (mgr.14640) 2823 : cluster [DBG] pgmap v1945: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:57.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.262+0000 7fb406fd8700 1 -- 172.21.15.8:0/1855270777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4000f77d0 msgr2=0x7fb4000f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:57.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.262+0000 7fb406fd8700 1 --2- 172.21.15.8:0/1855270777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4000f77d0 0x7fb4000f7c30 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fb3f0004660 tx=0x7fb3f0009b30).stop 2023-10-18T21:45:57.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.262+0000 7fb406fd8700 1 -- 172.21.15.8:0/1855270777 shutdown_connections 2023-10-18T21:45:57.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.262+0000 7fb406fd8700 1 --2- 172.21.15.8:0/1855270777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4000f77d0 0x7fb4000f7c30 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.262+0000 7fb406fd8700 1 --2- 172.21.15.8:0/1855270777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4000f6530 0x7fb4000f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.262+0000 7fb406fd8700 1 -- 172.21.15.8:0/1855270777 >> 172.21.15.8:0/1855270777 conn(0x7fb4000f1c90 msgr2=0x7fb4000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:57.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.262+0000 7fb406fd8700 1 -- 172.21.15.8:0/1855270777 shutdown_connections 2023-10-18T21:45:57.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.262+0000 7fb406fd8700 1 -- 172.21.15.8:0/1855270777 wait complete. 2023-10-18T21:45:57.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.263+0000 7fb406fd8700 1 Processor -- start 2023-10-18T21:45:57.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.263+0000 7fb406fd8700 1 -- start start 2023-10-18T21:45:57.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.263+0000 7fb406fd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4000f6530 0x7fb400108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:57.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.263+0000 7fb406fd8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4000f77d0 0x7fb400109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:57.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.263+0000 7fb406fd8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4001099d0 con 0x7fb4000f77d0 2023-10-18T21:45:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.263+0000 7fb406fd8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb400109b10 con 0x7fb4000f6530 2023-10-18T21:45:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.263+0000 7fb4057d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4000f77d0 0x7fb400109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb4057d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4000f77d0 0x7fb400109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38060/0 (socket says 172.21.15.8:38060) 2023-10-18T21:45:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb4057d5700 1 -- 172.21.15.8:0/1365026788 learned_addr learned my addr 172.21.15.8:0/1365026788 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb405fd6700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4000f6530 0x7fb400108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb4057d5700 1 -- 172.21.15.8:0/1365026788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4000f6530 msgr2=0x7fb400108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb4057d5700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4000f6530 0x7fb400108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb4057d5700 1 -- 172.21.15.8:0/1365026788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f0005040 con 0x7fb4000f77d0 2023-10-18T21:45:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb4057d5700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4000f77d0 0x7fb400109420 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fb3f0009990 tx=0x7fb3f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb3f67fc700 1 -- 172.21.15.8:0/1365026788 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3f0018070 con 0x7fb4000f77d0 2023-10-18T21:45:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb3f67fc700 1 -- 172.21.15.8:0/1365026788 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb3f0009630 con 0x7fb4000f77d0 2023-10-18T21:45:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb406fd8700 1 -- 172.21.15.8:0/1365026788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40010a450 con 0x7fb4000f77d0 2023-10-18T21:45:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.264+0000 7fb3f67fc700 1 -- 172.21.15.8:0/1365026788 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3f001c3c0 con 0x7fb4000f77d0 2023-10-18T21:45:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.265+0000 7fb406fd8700 1 -- 172.21.15.8:0/1365026788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40010a9b0 con 0x7fb4000f77d0 2023-10-18T21:45:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.266+0000 7fb406fd8700 1 -- 172.21.15.8:0/1365026788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb400045ad0 con 0x7fb4000f77d0 2023-10-18T21:45:57.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.266+0000 7fb3f67fc700 1 -- 172.21.15.8:0/1365026788 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb3f001d970 con 0x7fb4000f77d0 2023-10-18T21:45:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.267+0000 7fb3f67fc700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ec060f70 0x7fb3ec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.267+0000 7fb3f67fc700 1 -- 172.21.15.8:0/1365026788 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb3f007e660 con 0x7fb4000f77d0 2023-10-18T21:45:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.268+0000 7fb405fd6700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ec060f70 0x7fb3ec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.268+0000 7fb405fd6700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ec060f70 0x7fb3ec063430 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fb4000f7630 tx=0x7fb3fc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.272+0000 7fb3f67fc700 1 -- 172.21.15.8:0/1365026788 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb3f0051c40 con 0x7fb4000f77d0 2023-10-18T21:45:57.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.469+0000 7fb406fd8700 1 -- 172.21.15.8:0/1365026788 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4000fedd0 con 0x7fb3ec060f70 2023-10-18T21:45:57.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.470+0000 7fb3f67fc700 1 -- 172.21.15.8:0/1365026788 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb4000fedd0 con 0x7fb3ec060f70 2023-10-18T21:45:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.472+0000 7fb406fd8700 1 -- 172.21.15.8:0/1365026788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ec060f70 msgr2=0x7fb3ec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.472+0000 7fb406fd8700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ec060f70 0x7fb3ec063430 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fb4000f7630 tx=0x7fb3fc00b040).stop 2023-10-18T21:45:57.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.472+0000 7fb406fd8700 1 -- 172.21.15.8:0/1365026788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4000f77d0 msgr2=0x7fb400109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:57.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.472+0000 7fb406fd8700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4000f77d0 0x7fb400109420 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fb3f0009990 tx=0x7fb3f0009b30).stop 2023-10-18T21:45:57.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.472+0000 7fb406fd8700 1 -- 172.21.15.8:0/1365026788 shutdown_connections 2023-10-18T21:45:57.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.472+0000 7fb406fd8700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb3ec060f70 0x7fb3ec063430 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.472+0000 7fb406fd8700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4000f6530 0x7fb400108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.472+0000 7fb406fd8700 1 --2- 172.21.15.8:0/1365026788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4000f77d0 0x7fb400109420 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.472+0000 7fb406fd8700 1 -- 172.21.15.8:0/1365026788 >> 172.21.15.8:0/1365026788 conn(0x7fb4000f1c90 msgr2=0x7fb40006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.472+0000 7fb406fd8700 1 -- 172.21.15.8:0/1365026788 shutdown_connections 2023-10-18T21:45:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.473+0000 7fb406fd8700 1 -- 172.21.15.8:0/1365026788 wait complete. 2023-10-18T21:45:57.488 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:45:57.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.611+0000 7f2b4990f700 1 -- 172.21.15.8:0/2901399207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b440f6530 msgr2=0x7f2b440f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:57.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.611+0000 7f2b4990f700 1 --2- 172.21.15.8:0/2901399207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b440f6530 0x7f2b440f6950 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f2b38004660 tx=0x7f2b38009b30).stop 2023-10-18T21:45:57.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.611+0000 7f2b4990f700 1 -- 172.21.15.8:0/2901399207 shutdown_connections 2023-10-18T21:45:57.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.611+0000 7f2b4990f700 1 --2- 172.21.15.8:0/2901399207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b440f77d0 0x7f2b440f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.611+0000 7f2b4990f700 1 --2- 172.21.15.8:0/2901399207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b440f6530 0x7f2b440f6950 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.611+0000 7f2b4990f700 1 -- 172.21.15.8:0/2901399207 >> 172.21.15.8:0/2901399207 conn(0x7f2b440f1c90 msgr2=0x7f2b440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:57.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.611+0000 7f2b4990f700 1 -- 172.21.15.8:0/2901399207 shutdown_connections 2023-10-18T21:45:57.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.611+0000 7f2b4990f700 1 -- 172.21.15.8:0/2901399207 wait complete. 2023-10-18T21:45:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.612+0000 7f2b4990f700 1 Processor -- start 2023-10-18T21:45:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.612+0000 7f2b4990f700 1 -- start start 2023-10-18T21:45:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.613+0000 7f2b4990f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b440f6530 0x7f2b44106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.613+0000 7f2b4990f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b440f77d0 0x7f2b44107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.613+0000 7f2b4990f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44107880 con 0x7f2b440f77d0 2023-10-18T21:45:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.613+0000 7f2b4990f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b441080c0 con 0x7f2b440f6530 2023-10-18T21:45:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.613+0000 7f2b43fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b440f77d0 0x7f2b44107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.613+0000 7f2b43fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b440f77d0 0x7f2b44107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38066/0 (socket says 172.21.15.8:38066) 2023-10-18T21:45:57.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.613+0000 7f2b43fff700 1 -- 172.21.15.8:0/761997945 learned_addr learned my addr 172.21.15.8:0/761997945 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:57.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.613+0000 7f2b4890d700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b440f6530 0x7f2b44106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:57.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.614+0000 7f2b43fff700 1 -- 172.21.15.8:0/761997945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b440f6530 msgr2=0x7f2b44106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:57.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.614+0000 7f2b43fff700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b440f6530 0x7f2b44106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.614+0000 7f2b43fff700 1 -- 172.21.15.8:0/761997945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b38005040 con 0x7f2b440f77d0 2023-10-18T21:45:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.614+0000 7f2b43fff700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b440f77d0 0x7f2b44107280 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f2b30002700 tx=0x7f2b30009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.614+0000 7f2b417fa700 1 -- 172.21.15.8:0/761997945 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b30009320 con 0x7f2b440f77d0 2023-10-18T21:45:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.614+0000 7f2b417fa700 1 -- 172.21.15.8:0/761997945 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2b3000f040 con 0x7f2b440f77d0 2023-10-18T21:45:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.614+0000 7f2b417fa700 1 -- 172.21.15.8:0/761997945 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b300148f0 con 0x7f2b440f77d0 2023-10-18T21:45:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.614+0000 7f2b4990f700 1 -- 172.21.15.8:0/761997945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b441083a0 con 0x7f2b440f77d0 2023-10-18T21:45:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.614+0000 7f2b4990f700 1 -- 172.21.15.8:0/761997945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b44108890 con 0x7f2b440f77d0 2023-10-18T21:45:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.615+0000 7f2b4990f700 1 -- 172.21.15.8:0/761997945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b44059100 con 0x7f2b440f77d0 2023-10-18T21:45:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.616+0000 7f2b417fa700 1 -- 172.21.15.8:0/761997945 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2b30009480 con 0x7f2b440f77d0 2023-10-18T21:45:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.617+0000 7f2b417fa700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b34060f70 0x7f2b34063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.617+0000 7f2b417fa700 1 -- 172.21.15.8:0/761997945 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2b3007cc50 con 0x7f2b440f77d0 2023-10-18T21:45:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.617+0000 7f2b4890d700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b34060f70 0x7f2b34063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.618+0000 7f2b4890d700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b34060f70 0x7f2b34063430 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f2b38005010 tx=0x7f2b38009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.621+0000 7f2b417fa700 1 -- 172.21.15.8:0/761997945 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2b3004c800 con 0x7f2b440f77d0 2023-10-18T21:45:57.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.816+0000 7f2b4990f700 1 -- 172.21.15.8:0/761997945 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b440feda0 con 0x7f2b34060f70 2023-10-18T21:45:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.818+0000 7f2b417fa700 1 -- 172.21.15.8:0/761997945 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2b440feda0 con 0x7f2b34060f70 2023-10-18T21:45:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.819+0000 7f2b4990f700 1 -- 172.21.15.8:0/761997945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b34060f70 msgr2=0x7f2b34063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.819+0000 7f2b4990f700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b34060f70 0x7f2b34063430 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f2b38005010 tx=0x7f2b38009b30).stop 2023-10-18T21:45:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.819+0000 7f2b4990f700 1 -- 172.21.15.8:0/761997945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b440f77d0 msgr2=0x7f2b44107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.819+0000 7f2b4990f700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b440f77d0 0x7f2b44107280 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f2b30002700 tx=0x7f2b30009e00).stop 2023-10-18T21:45:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.820+0000 7f2b4990f700 1 -- 172.21.15.8:0/761997945 shutdown_connections 2023-10-18T21:45:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.820+0000 7f2b4990f700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b34060f70 0x7f2b34063430 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.820+0000 7f2b4990f700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b440f6530 0x7f2b44106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.820+0000 7f2b4990f700 1 --2- 172.21.15.8:0/761997945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b440f77d0 0x7f2b44107280 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.820+0000 7f2b4990f700 1 -- 172.21.15.8:0/761997945 >> 172.21.15.8:0/761997945 conn(0x7f2b440f1c90 msgr2=0x7f2b440fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.820+0000 7f2b4990f700 1 -- 172.21.15.8:0/761997945 shutdown_connections 2023-10-18T21:45:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.820+0000 7f2b4990f700 1 -- 172.21.15.8:0/761997945 wait complete. 2023-10-18T21:45:57.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.957+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/3685611047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d380f6530 msgr2=0x7f4d380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:57.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.957+0000 7f4d3cf6e700 1 --2- 172.21.15.8:0/3685611047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d380f6530 0x7f4d380f6950 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f4d28004660 tx=0x7f4d28009b30).stop 2023-10-18T21:45:57.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.957+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/3685611047 shutdown_connections 2023-10-18T21:45:57.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.957+0000 7f4d3cf6e700 1 --2- 172.21.15.8:0/3685611047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d380f77d0 0x7f4d380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.957+0000 7f4d3cf6e700 1 --2- 172.21.15.8:0/3685611047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d380f6530 0x7f4d380f6950 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.957+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/3685611047 >> 172.21.15.8:0/3685611047 conn(0x7f4d380f1c90 msgr2=0x7f4d380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:57.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.957+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/3685611047 shutdown_connections 2023-10-18T21:45:57.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.957+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/3685611047 wait complete. 2023-10-18T21:45:57.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.958+0000 7f4d3cf6e700 1 Processor -- start 2023-10-18T21:45:57.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.958+0000 7f4d3cf6e700 1 -- start start 2023-10-18T21:45:57.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d3cf6e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d380f6530 0x7f4d38108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:57.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d3cf6e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d380f77d0 0x7f4d381094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:57.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d3cf6e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d38109a70 con 0x7f4d380f6530 2023-10-18T21:45:57.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d3cf6e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d38109bb0 con 0x7f4d380f77d0 2023-10-18T21:45:57.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d380f6530 0x7f4d38108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:57.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d380f6530 0x7f4d38108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38076/0 (socket says 172.21.15.8:38076) 2023-10-18T21:45:57.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d377fe700 1 -- 172.21.15.8:0/1356323752 learned_addr learned my addr 172.21.15.8:0/1356323752 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:57.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d36ffd700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d380f77d0 0x7f4d381094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:57.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d377fe700 1 -- 172.21.15.8:0/1356323752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d380f77d0 msgr2=0x7f4d381094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:57.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d377fe700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d380f77d0 0x7f4d381094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:57.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d377fe700 1 -- 172.21.15.8:0/1356323752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d28005040 con 0x7f4d380f6530 2023-10-18T21:45:57.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.959+0000 7f4d377fe700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d380f6530 0x7f4d38108fd0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f4d28004e30 tx=0x7f4d28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:57.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.960+0000 7f4d1ffff700 1 -- 172.21.15.8:0/1356323752 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d28018070 con 0x7f4d380f6530 2023-10-18T21:45:57.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.960+0000 7f4d1ffff700 1 -- 172.21.15.8:0/1356323752 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4d28009630 con 0x7f4d380f6530 2023-10-18T21:45:57.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.960+0000 7f4d1ffff700 1 -- 172.21.15.8:0/1356323752 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d2801c3c0 con 0x7f4d380f6530 2023-10-18T21:45:57.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.960+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/1356323752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3810a4f0 con 0x7f4d380f6530 2023-10-18T21:45:57.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.960+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/1356323752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3810aa50 con 0x7f4d380f6530 2023-10-18T21:45:57.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.961+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/1356323752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d38045ad0 con 0x7f4d380f6530 2023-10-18T21:45:57.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.962+0000 7f4d1ffff700 1 -- 172.21.15.8:0/1356323752 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4d2801d420 con 0x7f4d380f6530 2023-10-18T21:45:57.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.963+0000 7f4d1ffff700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d20060f70 0x7f4d20063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:57.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.963+0000 7f4d1ffff700 1 -- 172.21.15.8:0/1356323752 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4d2807e3c0 con 0x7f4d380f6530 2023-10-18T21:45:57.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.963+0000 7f4d36ffd700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d20060f70 0x7f4d20063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:57.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.963+0000 7f4d36ffd700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d20060f70 0x7f4d20063430 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f4d2c004c40 tx=0x7f4d2c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:57.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:57.967+0000 7f4d1ffff700 1 -- 172.21.15.8:0/1356323752 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4d28051ae0 con 0x7f4d380f6530 2023-10-18T21:45:58.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.159+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/1356323752 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d380fedd0 con 0x7f4d20060f70 2023-10-18T21:45:58.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.168+0000 7f4d1ffff700 1 -- 172.21.15.8:0/1356323752 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4d380fedd0 con 0x7f4d20060f70 2023-10-18T21:45:58.169 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:45:58.170 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (52m) 9s ago 54m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:45:58.170 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (46m) 9s ago 54m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:45:58.170 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (46m) 8m ago 53m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:45:58.170 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (52m) 9s ago 53m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:45:58.171 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9s ago 50m - - 2023-10-18T21:45:58.171 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9s ago 50m - - 2023-10-18T21:45:58.171 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 50m - - 2023-10-18T21:45:58.171 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 50m - - 2023-10-18T21:45:58.171 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (47m) 9s ago 55m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:45:58.172 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (47m) 8m ago 53m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:45:58.172 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (46m) 9s ago 55m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:45:58.172 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (46m) 8m ago 53m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:45:58.172 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (53m) 9s ago 53m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:45:58.172 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (52m) 8m ago 52m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:45:58.173 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (46m) 9s ago 52m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:45:58.173 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (44m) 9s ago 52m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:45:58.173 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (43m) 9s ago 52m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:45:58.173 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (43m) 8m ago 51m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:45:58.173 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (42m) 8m ago 51m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:45:58.173 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (42m) 8m ago 51m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:45:58.174 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (48m) 9s ago 53m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:45:58.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:56.380768+0000 mgr.smithi008.flmjzp (mgr.14640) 2824 : cluster [DBG] pgmap v1946: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.170+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/1356323752 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d20060f70 msgr2=0x7f4d20063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.170+0000 7f4d3cf6e700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d20060f70 0x7f4d20063430 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f4d2c004c40 tx=0x7f4d2c00b040).stop 2023-10-18T21:45:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.170+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/1356323752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d380f6530 msgr2=0x7f4d38108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.170+0000 7f4d3cf6e700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d380f6530 0x7f4d38108fd0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f4d28004e30 tx=0x7f4d28009b30).stop 2023-10-18T21:45:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.170+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/1356323752 shutdown_connections 2023-10-18T21:45:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.170+0000 7f4d3cf6e700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d20060f70 0x7f4d20063430 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.170+0000 7f4d3cf6e700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d380f6530 0x7f4d38108fd0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.170+0000 7f4d3cf6e700 1 --2- 172.21.15.8:0/1356323752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d380f77d0 0x7f4d381094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.170+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/1356323752 >> 172.21.15.8:0/1356323752 conn(0x7f4d380f1c90 msgr2=0x7f4d3806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.171+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/1356323752 shutdown_connections 2023-10-18T21:45:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.171+0000 7f4d3cf6e700 1 -- 172.21.15.8:0/1356323752 wait complete. 2023-10-18T21:45:58.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:56.380768+0000 mgr.smithi008.flmjzp (mgr.14640) 2824 : cluster [DBG] pgmap v1946: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:45:58.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.306+0000 7ff1a14f7700 1 -- 172.21.15.8:0/940393453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 msgr2=0x7ff19c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:58.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.306+0000 7ff1a14f7700 1 --2- 172.21.15.8:0/940393453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 0x7ff19c0f6950 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7ff18c004660 tx=0x7ff18c009b30).stop 2023-10-18T21:45:58.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.306+0000 7ff1a14f7700 1 -- 172.21.15.8:0/940393453 shutdown_connections 2023-10-18T21:45:58.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.306+0000 7ff1a14f7700 1 --2- 172.21.15.8:0/940393453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f77d0 0x7ff19c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.306+0000 7ff1a14f7700 1 --2- 172.21.15.8:0/940393453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f6530 0x7ff19c0f6950 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.306+0000 7ff1a14f7700 1 -- 172.21.15.8:0/940393453 >> 172.21.15.8:0/940393453 conn(0x7ff19c0f1cd0 msgr2=0x7ff19c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:58.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.306+0000 7ff1a14f7700 1 -- 172.21.15.8:0/940393453 shutdown_connections 2023-10-18T21:45:58.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.306+0000 7ff1a14f7700 1 -- 172.21.15.8:0/940393453 wait complete. 2023-10-18T21:45:58.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.307+0000 7ff1a14f7700 1 Processor -- start 2023-10-18T21:45:58.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.307+0000 7ff1a14f7700 1 -- start start 2023-10-18T21:45:58.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff1a14f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f6530 0x7ff19c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:58.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff1a14f7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f77d0 0x7ff19c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:58.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff1a14f7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c107880 con 0x7ff19c0f77d0 2023-10-18T21:45:58.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff1a14f7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c108090 con 0x7ff19c0f6530 2023-10-18T21:45:58.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff19b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f77d0 0x7ff19c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:58.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff19b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f77d0 0x7ff19c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38100/0 (socket says 172.21.15.8:38100) 2023-10-18T21:45:58.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff19b7fe700 1 -- 172.21.15.8:0/3768678293 learned_addr learned my addr 172.21.15.8:0/3768678293 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:58.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff19bfff700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f6530 0x7ff19c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:58.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff19b7fe700 1 -- 172.21.15.8:0/3768678293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f6530 msgr2=0x7ff19c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:58.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff19b7fe700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f6530 0x7ff19c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.308+0000 7ff19b7fe700 1 -- 172.21.15.8:0/3768678293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c005040 con 0x7ff19c0f77d0 2023-10-18T21:45:58.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.309+0000 7ff19b7fe700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f77d0 0x7ff19c107280 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7ff19000e7f0 tx=0x7ff19000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:58.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.309+0000 7ff198ff9700 1 -- 172.21.15.8:0/3768678293 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1900092e0 con 0x7ff19c0f77d0 2023-10-18T21:45:58.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.309+0000 7ff198ff9700 1 -- 172.21.15.8:0/3768678293 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff19000f040 con 0x7ff19c0f77d0 2023-10-18T21:45:58.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.309+0000 7ff198ff9700 1 -- 172.21.15.8:0/3768678293 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1900147e0 con 0x7ff19c0f77d0 2023-10-18T21:45:58.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.309+0000 7ff1a14f7700 1 -- 172.21.15.8:0/3768678293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c108310 con 0x7ff19c0f77d0 2023-10-18T21:45:58.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.309+0000 7ff1a14f7700 1 -- 172.21.15.8:0/3768678293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c108850 con 0x7ff19c0f77d0 2023-10-18T21:45:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.311+0000 7ff1a14f7700 1 -- 172.21.15.8:0/3768678293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c059100 con 0x7ff19c0f77d0 2023-10-18T21:45:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.311+0000 7ff198ff9700 1 -- 172.21.15.8:0/3768678293 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff19001b030 con 0x7ff19c0f77d0 2023-10-18T21:45:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.312+0000 7ff198ff9700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 0x7ff184063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.312+0000 7ff198ff9700 1 -- 172.21.15.8:0/3768678293 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff19007c7c0 con 0x7ff19c0f77d0 2023-10-18T21:45:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.312+0000 7ff19bfff700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 0x7ff184063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.313+0000 7ff19bfff700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 0x7ff184063430 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7ff18c005010 tx=0x7ff18c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.316+0000 7ff198ff9700 1 -- 172.21.15.8:0/3768678293 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff19004c420 con 0x7ff19c0f77d0 2023-10-18T21:45:58.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.574+0000 7ff1a14f7700 1 -- 172.21.15.8:0/3768678293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff19c0fee50 con 0x7ff19c0f77d0 2023-10-18T21:45:58.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.575+0000 7ff198ff9700 1 -- 172.21.15.8:0/3768678293 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7ff19c0fee50 con 0x7ff19c0f77d0 2023-10-18T21:45:58.577 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:45:58.577 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:45:58.577 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:45:58.577 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:45:58.578 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:45:58.578 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:45:58.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:45:58.578 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:45:58.578 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:45:58.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:45:58.579 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:45:58.579 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:45:58.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:45:58.580 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:45:58.580 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:45:58.580 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:45:58.580 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:45:58.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.577+0000 7ff1a14f7700 1 -- 172.21.15.8:0/3768678293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 msgr2=0x7ff184063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:58.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.577+0000 7ff1a14f7700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 0x7ff184063430 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7ff18c005010 tx=0x7ff18c016040).stop 2023-10-18T21:45:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.577+0000 7ff1a14f7700 1 -- 172.21.15.8:0/3768678293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f77d0 msgr2=0x7ff19c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.577+0000 7ff1a14f7700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f77d0 0x7ff19c107280 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7ff19000e7f0 tx=0x7ff19000b040).stop 2023-10-18T21:45:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.577+0000 7ff1a14f7700 1 -- 172.21.15.8:0/3768678293 shutdown_connections 2023-10-18T21:45:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.577+0000 7ff1a14f7700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff184060f70 0x7ff184063430 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.577+0000 7ff1a14f7700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff19c0f6530 0x7ff19c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.577+0000 7ff1a14f7700 1 --2- 172.21.15.8:0/3768678293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff19c0f77d0 0x7ff19c107280 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.577+0000 7ff1a14f7700 1 -- 172.21.15.8:0/3768678293 >> 172.21.15.8:0/3768678293 conn(0x7ff19c0f1cd0 msgr2=0x7ff19c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:58.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.578+0000 7ff1a14f7700 1 -- 172.21.15.8:0/3768678293 shutdown_connections 2023-10-18T21:45:58.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.578+0000 7ff1a14f7700 1 -- 172.21.15.8:0/3768678293 wait complete. 2023-10-18T21:45:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.721+0000 7f125ffff700 1 -- 172.21.15.8:0/1026838602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12600f6530 msgr2=0x7f12600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.721+0000 7f125ffff700 1 --2- 172.21.15.8:0/1026838602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12600f6530 0x7f12600f6950 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f1250004660 tx=0x7f1250009b30).stop 2023-10-18T21:45:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.721+0000 7f125ffff700 1 -- 172.21.15.8:0/1026838602 shutdown_connections 2023-10-18T21:45:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.721+0000 7f125ffff700 1 --2- 172.21.15.8:0/1026838602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12600f77d0 0x7f12600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.721+0000 7f125ffff700 1 --2- 172.21.15.8:0/1026838602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12600f6530 0x7f12600f6950 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.721+0000 7f125ffff700 1 -- 172.21.15.8:0/1026838602 >> 172.21.15.8:0/1026838602 conn(0x7f12600f1c70 msgr2=0x7f12600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.722+0000 7f125ffff700 1 -- 172.21.15.8:0/1026838602 shutdown_connections 2023-10-18T21:45:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.722+0000 7f125ffff700 1 -- 172.21.15.8:0/1026838602 wait complete. 2023-10-18T21:45:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.722+0000 7f125ffff700 1 Processor -- start 2023-10-18T21:45:58.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.723+0000 7f125ffff700 1 -- start start 2023-10-18T21:45:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.723+0000 7f125ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12600f6530 0x7f1260108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.723+0000 7f125ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12600f77d0 0x7f12601094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.723+0000 7f125ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1260109a80 con 0x7f12600f77d0 2023-10-18T21:45:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.723+0000 7f125ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1260109bc0 con 0x7f12600f6530 2023-10-18T21:45:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.723+0000 7f125e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12600f77d0 0x7f12601094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.723+0000 7f125e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12600f77d0 0x7f12601094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38122/0 (socket says 172.21.15.8:38122) 2023-10-18T21:45:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.723+0000 7f125e7fc700 1 -- 172.21.15.8:0/2470581731 learned_addr learned my addr 172.21.15.8:0/2470581731 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.723+0000 7f125effd700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12600f6530 0x7f1260108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.724+0000 7f125e7fc700 1 -- 172.21.15.8:0/2470581731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12600f6530 msgr2=0x7f1260108fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.724+0000 7f125e7fc700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12600f6530 0x7f1260108fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.724+0000 7f125e7fc700 1 -- 172.21.15.8:0/2470581731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1250005040 con 0x7f12600f77d0 2023-10-18T21:45:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.724+0000 7f125e7fc700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12600f77d0 0x7f12601094d0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f12540026d0 tx=0x7f1254009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:58.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.724+0000 7f12477fe700 1 -- 172.21.15.8:0/2470581731 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12540079c0 con 0x7f12600f77d0 2023-10-18T21:45:58.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.724+0000 7f12477fe700 1 -- 172.21.15.8:0/2470581731 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f125400f040 con 0x7f12600f77d0 2023-10-18T21:45:58.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.724+0000 7f12477fe700 1 -- 172.21.15.8:0/2470581731 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1254014980 con 0x7f12600f77d0 2023-10-18T21:45:58.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.724+0000 7f125ffff700 1 -- 172.21.15.8:0/2470581731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126010a560 con 0x7f12600f77d0 2023-10-18T21:45:58.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.724+0000 7f125ffff700 1 -- 172.21.15.8:0/2470581731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126010ab20 con 0x7f12600f77d0 2023-10-18T21:45:58.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.726+0000 7f125ffff700 1 -- 172.21.15.8:0/2470581731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1260045ad0 con 0x7f12600f77d0 2023-10-18T21:45:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.727+0000 7f12477fe700 1 -- 172.21.15.8:0/2470581731 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f12540090d0 con 0x7f12600f77d0 2023-10-18T21:45:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.727+0000 7f12477fe700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1248060f70 0x7f1248063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.728+0000 7f12477fe700 1 -- 172.21.15.8:0/2470581731 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f125407c8a0 con 0x7f12600f77d0 2023-10-18T21:45:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.728+0000 7f125effd700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1248060f70 0x7f1248063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.728+0000 7f125effd700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1248060f70 0x7f1248063430 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f1250004630 tx=0x7f1250009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:58.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.736+0000 7f12477fe700 1 -- 172.21.15.8:0/2470581731 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f125404ffb0 con 0x7f12600f77d0 2023-10-18T21:45:58.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.962+0000 7f125ffff700 1 -- 172.21.15.8:0/2470581731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1260027a00 con 0x7f12600f77d0 2023-10-18T21:45:58.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.963+0000 7f12477fe700 1 -- 172.21.15.8:0/2470581731 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f125404fba0 con 0x7f12600f77d0 2023-10-18T21:45:58.964 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:45:58.964 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:45:58.965 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:45:58.965 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:45:58.965 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:45:58.965 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:45:58.965 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:45:58.966 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:45:58.966 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:45:58.966 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:45:58.966 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:45:58.966 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:45:58.967 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:45:58.967 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:45:58.967 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:45:58.967 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:45:58.967 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:45:58.967 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:45:58.968 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:45:58.968 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:45:58.968 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:45:58.968 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:45:58.968 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:45:58.969 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:45:58.969 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:45:58.969 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:45:58.969 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:45:58.969 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:45:58.970 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:45:58.970 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:45:58.970 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:45:58.970 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:45:58.970 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:45:58.970 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:45:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 -- 172.21.15.8:0/2470581731 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1248060f70 msgr2=0x7f1248063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1248060f70 0x7f1248063430 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f1250004630 tx=0x7f1250009b30).stop 2023-10-18T21:45:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 -- 172.21.15.8:0/2470581731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12600f77d0 msgr2=0x7f12601094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12600f77d0 0x7f12601094d0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f12540026d0 tx=0x7f1254009de0).stop 2023-10-18T21:45:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 -- 172.21.15.8:0/2470581731 shutdown_connections 2023-10-18T21:45:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1248060f70 0x7f1248063430 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12600f6530 0x7f1260108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 --2- 172.21.15.8:0/2470581731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12600f77d0 0x7f12601094d0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 -- 172.21.15.8:0/2470581731 >> 172.21.15.8:0/2470581731 conn(0x7f12600f1c70 msgr2=0x7f126006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 -- 172.21.15.8:0/2470581731 shutdown_connections 2023-10-18T21:45:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:58.966+0000 7f125ffff700 1 -- 172.21.15.8:0/2470581731 wait complete. 2023-10-18T21:45:58.974 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:45:59.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.105+0000 7f8819da2700 1 -- 172.21.15.8:0/3233362251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140f77d0 msgr2=0x7f88140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:59.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.105+0000 7f8819da2700 1 --2- 172.21.15.8:0/3233362251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140f77d0 0x7f88140f7c30 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f8800004660 tx=0x7f8800009b30).stop 2023-10-18T21:45:59.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.105+0000 7f8819da2700 1 -- 172.21.15.8:0/3233362251 shutdown_connections 2023-10-18T21:45:59.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.105+0000 7f8819da2700 1 --2- 172.21.15.8:0/3233362251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140f77d0 0x7f88140f7c30 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:59.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.105+0000 7f8819da2700 1 --2- 172.21.15.8:0/3233362251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88140f6530 0x7f88140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:59.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.105+0000 7f8819da2700 1 -- 172.21.15.8:0/3233362251 >> 172.21.15.8:0/3233362251 conn(0x7f88140f1c90 msgr2=0x7f88140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:59.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.106+0000 7f8819da2700 1 -- 172.21.15.8:0/3233362251 shutdown_connections 2023-10-18T21:45:59.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.106+0000 7f8819da2700 1 -- 172.21.15.8:0/3233362251 wait complete. 2023-10-18T21:45:59.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.106+0000 7f8819da2700 1 Processor -- start 2023-10-18T21:45:59.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.106+0000 7f8819da2700 1 -- start start 2023-10-18T21:45:59.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8819da2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88140f6530 0x7f8814108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:59.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8819da2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140f77d0 0x7f8814109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:59.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8819da2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8814109a20 con 0x7f88140f77d0 2023-10-18T21:45:59.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8819da2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8814109b60 con 0x7f88140f6530 2023-10-18T21:45:59.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8813fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140f77d0 0x7f8814109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:59.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8813fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140f77d0 0x7f8814109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38140/0 (socket says 172.21.15.8:38140) 2023-10-18T21:45:59.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8813fff700 1 -- 172.21.15.8:0/3997838005 learned_addr learned my addr 172.21.15.8:0/3997838005 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:45:59.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8818da0700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88140f6530 0x7f8814108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:59.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8813fff700 1 -- 172.21.15.8:0/3997838005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88140f6530 msgr2=0x7f8814108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:59.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8813fff700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88140f6530 0x7f8814108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:59.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.107+0000 7f8813fff700 1 -- 172.21.15.8:0/3997838005 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800005040 con 0x7f88140f77d0 2023-10-18T21:45:59.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.108+0000 7f8813fff700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140f77d0 0x7f8814109470 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f8800009990 tx=0x7f8800009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:59.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.108+0000 7f88117fa700 1 -- 172.21.15.8:0/3997838005 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8800018070 con 0x7f88140f77d0 2023-10-18T21:45:59.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.108+0000 7f88117fa700 1 -- 172.21.15.8:0/3997838005 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8800009630 con 0x7f88140f77d0 2023-10-18T21:45:59.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.108+0000 7f8819da2700 1 -- 172.21.15.8:0/3997838005 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881410a4a0 con 0x7f88140f77d0 2023-10-18T21:45:59.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.108+0000 7f88117fa700 1 -- 172.21.15.8:0/3997838005 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f880001c400 con 0x7f88140f77d0 2023-10-18T21:45:59.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.108+0000 7f8819da2700 1 -- 172.21.15.8:0/3997838005 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881410aa00 con 0x7f88140f77d0 2023-10-18T21:45:59.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.109+0000 7f8819da2700 1 -- 172.21.15.8:0/3997838005 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8814045ad0 con 0x7f88140f77d0 2023-10-18T21:45:59.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.110+0000 7f88117fa700 1 -- 172.21.15.8:0/3997838005 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f880001d9e0 con 0x7f88140f77d0 2023-10-18T21:45:59.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.111+0000 7f88117fa700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8804060f70 0x7f8804063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:45:59.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.111+0000 7f88117fa700 1 -- 172.21.15.8:0/3997838005 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f880007e680 con 0x7f88140f77d0 2023-10-18T21:45:59.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.111+0000 7f8818da0700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8804060f70 0x7f8804063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:45:59.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.112+0000 7f8818da0700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8804060f70 0x7f8804063430 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f88140f7630 tx=0x7f8808009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:45:59.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.115+0000 7f88117fa700 1 -- 172.21.15.8:0/3997838005 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8800051ce0 con 0x7f88140f77d0 2023-10-18T21:45:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:57.470662+0000 mgr.smithi008.flmjzp (mgr.14640) 2825 : audit [DBG] from='client.36376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:57.818024+0000 mgr.smithi008.flmjzp (mgr.14640) 2826 : audit [DBG] from='client.36380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.397039+0000 mon.smithi008 (mon.0) 3217 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.575682+0000 mon.smithi008 (mon.0) 3218 : audit [DBG] from='client.? 172.21.15.8:0/3768678293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:45:59.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.310+0000 7f8819da2700 1 -- 172.21.15.8:0/3997838005 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88140fedd0 con 0x7f8804060f70 2023-10-18T21:45:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.312+0000 7f88117fa700 1 -- 172.21.15.8:0/3997838005 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f88140fedd0 con 0x7f8804060f70 2023-10-18T21:45:59.313 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:45:59.313 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:45:59.313 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:45:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:45:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:45:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:45:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:45:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:45:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:45:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:45:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:45:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:45:59.316 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:45:59.316 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:45:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 -- 172.21.15.8:0/3997838005 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8804060f70 msgr2=0x7f8804063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8804060f70 0x7f8804063430 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f88140f7630 tx=0x7f8808009c00).stop 2023-10-18T21:45:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 -- 172.21.15.8:0/3997838005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140f77d0 msgr2=0x7f8814109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:45:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140f77d0 0x7f8814109470 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f8800009990 tx=0x7f8800009b30).stop 2023-10-18T21:45:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 -- 172.21.15.8:0/3997838005 shutdown_connections 2023-10-18T21:45:59.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8804060f70 0x7f8804063430 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:59.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88140f6530 0x7f8814108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:59.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 --2- 172.21.15.8:0/3997838005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140f77d0 0x7f8814109470 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:45:59.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 -- 172.21.15.8:0/3997838005 >> 172.21.15.8:0/3997838005 conn(0x7f88140f1c90 msgr2=0x7f881406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:45:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 -- 172.21.15.8:0/3997838005 shutdown_connections 2023-10-18T21:45:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:45:59.314+0000 7f8819da2700 1 -- 172.21.15.8:0/3997838005 wait complete. 2023-10-18T21:45:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:57.470662+0000 mgr.smithi008.flmjzp (mgr.14640) 2825 : audit [DBG] from='client.36376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:57.818024+0000 mgr.smithi008.flmjzp (mgr.14640) 2826 : audit [DBG] from='client.36380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:45:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.397039+0000 mon.smithi008 (mon.0) 3217 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:45:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.575682+0000 mon.smithi008 (mon.0) 3218 : audit [DBG] from='client.? 172.21.15.8:0/3768678293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:00.193 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.160257+0000 mgr.smithi008.flmjzp (mgr.14640) 2827 : audit [DBG] from='client.36384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:00.194 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:58.381243+0000 mgr.smithi008.flmjzp (mgr.14640) 2828 : cluster [DBG] pgmap v1947: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:00.194 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.963549+0000 mon.smithi008 (mon.0) 3219 : audit [DBG] from='client.? 172.21.15.8:0/2470581731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:46:00.194 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.968141+0000 mon.smithi008 (mon.0) 3220 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:00.194 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.968976+0000 mon.smithi008 (mon.0) 3221 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:00.195 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:58.969637+0000 mgr.smithi008.flmjzp (mgr.14640) 2829 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:00.195 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:58.970169+0000 mgr.smithi008.flmjzp (mgr.14640) 2830 : cluster [DBG] pgmap v1948: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:00.195 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:45:58.970420+0000 mgr.smithi008.flmjzp (mgr.14640) 2831 : cluster [DBG] pgmap v1949: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:00.195 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.974655+0000 mon.smithi008 (mon.0) 3222 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:00.195 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.979855+0000 mon.smithi008 (mon.0) 3223 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:00.196 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.982482+0000 mon.smithi008 (mon.0) 3224 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:00.196 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.983965+0000 mon.smithi008 (mon.0) 3225 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:00.196 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.985284+0000 mon.smithi008 (mon.0) 3226 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:00.196 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:58.986869+0000 mon.smithi008 (mon.0) 3227 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:00.197 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:45:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:45:58.988529+0000 mgr.smithi008.flmjzp (mgr.14640) 2832 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.160257+0000 mgr.smithi008.flmjzp (mgr.14640) 2827 : audit [DBG] from='client.36384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:58.381243+0000 mgr.smithi008.flmjzp (mgr.14640) 2828 : cluster [DBG] pgmap v1947: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.963549+0000 mon.smithi008 (mon.0) 3219 : audit [DBG] from='client.? 172.21.15.8:0/2470581731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:46:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.968141+0000 mon.smithi008 (mon.0) 3220 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.968976+0000 mon.smithi008 (mon.0) 3221 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:58.969637+0000 mgr.smithi008.flmjzp (mgr.14640) 2829 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:58.970169+0000 mgr.smithi008.flmjzp (mgr.14640) 2830 : cluster [DBG] pgmap v1948: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:45:58.970420+0000 mgr.smithi008.flmjzp (mgr.14640) 2831 : cluster [DBG] pgmap v1949: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.974655+0000 mon.smithi008 (mon.0) 3222 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.979855+0000 mon.smithi008 (mon.0) 3223 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:00.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.982482+0000 mon.smithi008 (mon.0) 3224 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:00.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.983965+0000 mon.smithi008 (mon.0) 3225 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:00.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.985284+0000 mon.smithi008 (mon.0) 3226 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:00.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:58.986869+0000 mon.smithi008 (mon.0) 3227 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:00.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:45:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:45:58.988529+0000 mgr.smithi008.flmjzp (mgr.14640) 2832 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:45:59.312137+0000 mgr.smithi008.flmjzp (mgr.14640) 2833 : audit [DBG] from='client.36396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:45:59.312137+0000 mgr.smithi008.flmjzp (mgr.14640) 2833 : audit [DBG] from='client.36396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:02.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:00.970935+0000 mgr.smithi008.flmjzp (mgr.14640) 2834 : cluster [DBG] pgmap v1950: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:02.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:00.970935+0000 mgr.smithi008.flmjzp (mgr.14640) 2834 : cluster [DBG] pgmap v1950: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:04.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:02.971520+0000 mgr.smithi008.flmjzp (mgr.14640) 2835 : cluster [DBG] pgmap v1951: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:04.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:02.971520+0000 mgr.smithi008.flmjzp (mgr.14640) 2835 : cluster [DBG] pgmap v1951: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:04.972228+0000 mgr.smithi008.flmjzp (mgr.14640) 2836 : cluster [DBG] pgmap v1952: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:06.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:04.972228+0000 mgr.smithi008.flmjzp (mgr.14640) 2836 : cluster [DBG] pgmap v1952: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:08.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:06.972890+0000 mgr.smithi008.flmjzp (mgr.14640) 2837 : cluster [DBG] pgmap v1953: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:08.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:06.972890+0000 mgr.smithi008.flmjzp (mgr.14640) 2837 : cluster [DBG] pgmap v1953: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:08.999138+0000 mon.smithi008 (mon.0) 3228 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:09.001334+0000 mon.smithi008 (mon.0) 3229 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:09.002346+0000 mon.smithi008 (mon.0) 3230 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:09.008778+0000 mon.smithi008 (mon.0) 3231 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:09.015229+0000 mon.smithi008 (mon.0) 3232 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:09.018426+0000 mon.smithi008 (mon.0) 3233 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:09.020150+0000 mon.smithi008 (mon.0) 3234 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:09.021832+0000 mon.smithi008 (mon.0) 3235 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:09.023868+0000 mon.smithi008 (mon.0) 3236 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:08.999138+0000 mon.smithi008 (mon.0) 3228 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:09.001334+0000 mon.smithi008 (mon.0) 3229 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:09.002346+0000 mon.smithi008 (mon.0) 3230 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:09.008778+0000 mon.smithi008 (mon.0) 3231 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:09.015229+0000 mon.smithi008 (mon.0) 3232 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:09.018426+0000 mon.smithi008 (mon.0) 3233 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:09.020150+0000 mon.smithi008 (mon.0) 3234 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:09.021832+0000 mon.smithi008 (mon.0) 3235 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:09.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:09.023868+0000 mon.smithi008 (mon.0) 3236 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:08.973566+0000 mgr.smithi008.flmjzp (mgr.14640) 2838 : cluster [DBG] pgmap v1954: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:46:09.003211+0000 mgr.smithi008.flmjzp (mgr.14640) 2839 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:09.003777+0000 mgr.smithi008.flmjzp (mgr.14640) 2840 : cluster [DBG] pgmap v1955: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:09.004030+0000 mgr.smithi008.flmjzp (mgr.14640) 2841 : cluster [DBG] pgmap v1956: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:46:09.025833+0000 mgr.smithi008.flmjzp (mgr.14640) 2842 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:10.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:08.973566+0000 mgr.smithi008.flmjzp (mgr.14640) 2838 : cluster [DBG] pgmap v1954: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:46:09.003211+0000 mgr.smithi008.flmjzp (mgr.14640) 2839 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:09.003777+0000 mgr.smithi008.flmjzp (mgr.14640) 2840 : cluster [DBG] pgmap v1955: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:09.004030+0000 mgr.smithi008.flmjzp (mgr.14640) 2841 : cluster [DBG] pgmap v1956: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:46:09.025833+0000 mgr.smithi008.flmjzp (mgr.14640) 2842 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:11.004610+0000 mgr.smithi008.flmjzp (mgr.14640) 2843 : cluster [DBG] pgmap v1957: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:11.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:11.004610+0000 mgr.smithi008.flmjzp (mgr.14640) 2843 : cluster [DBG] pgmap v1957: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:14.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:13.005054+0000 mgr.smithi008.flmjzp (mgr.14640) 2844 : cluster [DBG] pgmap v1958: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:14.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:13.005054+0000 mgr.smithi008.flmjzp (mgr.14640) 2844 : cluster [DBG] pgmap v1958: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:15.005778+0000 mgr.smithi008.flmjzp (mgr.14640) 2845 : cluster [DBG] pgmap v1959: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:15.005778+0000 mgr.smithi008.flmjzp (mgr.14640) 2845 : cluster [DBG] pgmap v1959: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:18.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:17.006357+0000 mgr.smithi008.flmjzp (mgr.14640) 2846 : cluster [DBG] pgmap v1960: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:17.006357+0000 mgr.smithi008.flmjzp (mgr.14640) 2846 : cluster [DBG] pgmap v1960: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:19.033531+0000 mon.smithi008 (mon.0) 3237 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:19.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:19.033531+0000 mon.smithi008 (mon.0) 3237 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:19.006938+0000 mgr.smithi008.flmjzp (mgr.14640) 2847 : cluster [DBG] pgmap v1961: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:19.591582+0000 mon.smithi008 (mon.0) 3238 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:19.592732+0000 mon.smithi008 (mon.0) 3239 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:19.599573+0000 mon.smithi008 (mon.0) 3240 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:19.606197+0000 mon.smithi008 (mon.0) 3241 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:19.609266+0000 mon.smithi008 (mon.0) 3242 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:19.610964+0000 mon.smithi008 (mon.0) 3243 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:19.612592+0000 mon.smithi008 (mon.0) 3244 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:19.614629+0000 mon.smithi008 (mon.0) 3245 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:19.006938+0000 mgr.smithi008.flmjzp (mgr.14640) 2847 : cluster [DBG] pgmap v1961: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:19.591582+0000 mon.smithi008 (mon.0) 3238 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:19.592732+0000 mon.smithi008 (mon.0) 3239 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:19.599573+0000 mon.smithi008 (mon.0) 3240 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:19.606197+0000 mon.smithi008 (mon.0) 3241 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:19.609266+0000 mon.smithi008 (mon.0) 3242 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:19.610964+0000 mon.smithi008 (mon.0) 3243 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:19.612592+0000 mon.smithi008 (mon.0) 3244 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:19.614629+0000 mon.smithi008 (mon.0) 3245 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:46:19.593640+0000 mgr.smithi008.flmjzp (mgr.14640) 2848 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:19.594363+0000 mgr.smithi008.flmjzp (mgr.14640) 2849 : cluster [DBG] pgmap v1962: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:19.594632+0000 mgr.smithi008.flmjzp (mgr.14640) 2850 : cluster [DBG] pgmap v1963: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:46:19.616522+0000 mgr.smithi008.flmjzp (mgr.14640) 2851 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:46:19.593640+0000 mgr.smithi008.flmjzp (mgr.14640) 2848 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:19.594363+0000 mgr.smithi008.flmjzp (mgr.14640) 2849 : cluster [DBG] pgmap v1962: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:19.594632+0000 mgr.smithi008.flmjzp (mgr.14640) 2850 : cluster [DBG] pgmap v1963: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:46:19.616522+0000 mgr.smithi008.flmjzp (mgr.14640) 2851 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:21.595301+0000 mgr.smithi008.flmjzp (mgr.14640) 2852 : cluster [DBG] pgmap v1964: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:23.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:21.595301+0000 mgr.smithi008.flmjzp (mgr.14640) 2852 : cluster [DBG] pgmap v1964: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:23.595988+0000 mgr.smithi008.flmjzp (mgr.14640) 2853 : cluster [DBG] pgmap v1965: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:23.595988+0000 mgr.smithi008.flmjzp (mgr.14640) 2853 : cluster [DBG] pgmap v1965: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:25.596710+0000 mgr.smithi008.flmjzp (mgr.14640) 2854 : cluster [DBG] pgmap v1966: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:27.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:25.596710+0000 mgr.smithi008.flmjzp (mgr.14640) 2854 : cluster [DBG] pgmap v1966: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:28.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:27.597217+0000 mgr.smithi008.flmjzp (mgr.14640) 2855 : cluster [DBG] pgmap v1967: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:28.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:27.597217+0000 mgr.smithi008.flmjzp (mgr.14640) 2855 : cluster [DBG] pgmap v1967: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:29.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.465+0000 7fc380892700 1 -- 172.21.15.8:0/2946363783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc37c0f77d0 msgr2=0x7fc37c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:29.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.465+0000 7fc380892700 1 --2- 172.21.15.8:0/2946363783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc37c0f77d0 0x7fc37c0f7c30 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fc370004660 tx=0x7fc370009b30).stop 2023-10-18T21:46:29.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.465+0000 7fc380892700 1 -- 172.21.15.8:0/2946363783 shutdown_connections 2023-10-18T21:46:29.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.465+0000 7fc380892700 1 --2- 172.21.15.8:0/2946363783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc37c0f77d0 0x7fc37c0f7c30 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:29.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.465+0000 7fc380892700 1 --2- 172.21.15.8:0/2946363783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc37c0f6530 0x7fc37c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:29.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.465+0000 7fc380892700 1 -- 172.21.15.8:0/2946363783 >> 172.21.15.8:0/2946363783 conn(0x7fc37c0f1c90 msgr2=0x7fc37c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:29.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.465+0000 7fc380892700 1 -- 172.21.15.8:0/2946363783 shutdown_connections 2023-10-18T21:46:29.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.465+0000 7fc380892700 1 -- 172.21.15.8:0/2946363783 wait complete. 2023-10-18T21:46:29.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.466+0000 7fc380892700 1 Processor -- start 2023-10-18T21:46:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.466+0000 7fc380892700 1 -- start start 2023-10-18T21:46:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.467+0000 7fc380892700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc37c0f6530 0x7fc37c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.467+0000 7fc380892700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc37c0f77d0 0x7fc37c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.467+0000 7fc380892700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c06a380 con 0x7fc37c0f77d0 2023-10-18T21:46:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.467+0000 7fc380892700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c06a4c0 con 0x7fc37c0f6530 2023-10-18T21:46:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.467+0000 7fc37affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc37c0f77d0 0x7fc37c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.467+0000 7fc37affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc37c0f77d0 0x7fc37c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43884/0 (socket says 172.21.15.8:43884) 2023-10-18T21:46:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.467+0000 7fc37affd700 1 -- 172.21.15.8:0/3200240482 learned_addr learned my addr 172.21.15.8:0/3200240482 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:46:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.467+0000 7fc37b7fe700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc37c0f6530 0x7fc37c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.468+0000 7fc37affd700 1 -- 172.21.15.8:0/3200240482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc37c0f6530 msgr2=0x7fc37c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.468+0000 7fc37affd700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc37c0f6530 0x7fc37c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.468+0000 7fc37affd700 1 -- 172.21.15.8:0/3200240482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370005040 con 0x7fc37c0f77d0 2023-10-18T21:46:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.468+0000 7fc37affd700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc37c0f77d0 0x7fc37c069e20 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7fc370009f50 tx=0x7fc370009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.468+0000 7fc363fff700 1 -- 172.21.15.8:0/3200240482 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc370018070 con 0x7fc37c0f77d0 2023-10-18T21:46:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.468+0000 7fc363fff700 1 -- 172.21.15.8:0/3200240482 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc370009630 con 0x7fc37c0f77d0 2023-10-18T21:46:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.468+0000 7fc380892700 1 -- 172.21.15.8:0/3200240482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c06a740 con 0x7fc37c0f77d0 2023-10-18T21:46:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.468+0000 7fc363fff700 1 -- 172.21.15.8:0/3200240482 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc37001c3c0 con 0x7fc37c0f77d0 2023-10-18T21:46:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.468+0000 7fc380892700 1 -- 172.21.15.8:0/3200240482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c06aca0 con 0x7fc37c0f77d0 2023-10-18T21:46:29.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.470+0000 7fc380892700 1 -- 172.21.15.8:0/3200240482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c045ad0 con 0x7fc37c0f77d0 2023-10-18T21:46:29.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.470+0000 7fc363fff700 1 -- 172.21.15.8:0/3200240482 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc37001d420 con 0x7fc37c0f77d0 2023-10-18T21:46:29.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.471+0000 7fc363fff700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc364060f70 0x7fc364063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:29.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.471+0000 7fc363fff700 1 -- 172.21.15.8:0/3200240482 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc37007e480 con 0x7fc37c0f77d0 2023-10-18T21:46:29.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.472+0000 7fc37b7fe700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc364060f70 0x7fc364063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.472+0000 7fc37b7fe700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc364060f70 0x7fc364063430 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fc37c06b730 tx=0x7fc36c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.476+0000 7fc363fff700 1 -- 172.21.15.8:0/3200240482 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc37004e170 con 0x7fc37c0f77d0 2023-10-18T21:46:29.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.685+0000 7fc380892700 1 -- 172.21.15.8:0/3200240482 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc37c0fedd0 con 0x7fc364060f70 2023-10-18T21:46:29.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.686+0000 7fc363fff700 1 -- 172.21.15.8:0/3200240482 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc37c0fedd0 con 0x7fc364060f70 2023-10-18T21:46:29.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 -- 172.21.15.8:0/3200240482 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc364060f70 msgr2=0x7fc364063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:29.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc364060f70 0x7fc364063430 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fc37c06b730 tx=0x7fc36c00b040).stop 2023-10-18T21:46:29.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 -- 172.21.15.8:0/3200240482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc37c0f77d0 msgr2=0x7fc37c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:29.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc37c0f77d0 0x7fc37c069e20 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7fc370009f50 tx=0x7fc370009b30).stop 2023-10-18T21:46:29.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 -- 172.21.15.8:0/3200240482 shutdown_connections 2023-10-18T21:46:29.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc364060f70 0x7fc364063430 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:29.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc37c0f6530 0x7fc37c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:29.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 --2- 172.21.15.8:0/3200240482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc37c0f77d0 0x7fc37c069e20 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:29.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 -- 172.21.15.8:0/3200240482 >> 172.21.15.8:0/3200240482 conn(0x7fc37c0f1c90 msgr2=0x7fc37c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:29.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 -- 172.21.15.8:0/3200240482 shutdown_connections 2023-10-18T21:46:29.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.688+0000 7fc380892700 1 -- 172.21.15.8:0/3200240482 wait complete. 2023-10-18T21:46:29.705 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:46:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.826+0000 7f6e1898f700 1 -- 172.21.15.8:0/172773583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e140f77d0 msgr2=0x7f6e140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.826+0000 7f6e1898f700 1 --2- 172.21.15.8:0/172773583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e140f77d0 0x7f6e140f7c30 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f6e08004660 tx=0x7f6e08009b30).stop 2023-10-18T21:46:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.826+0000 7f6e1898f700 1 -- 172.21.15.8:0/172773583 shutdown_connections 2023-10-18T21:46:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.826+0000 7f6e1898f700 1 --2- 172.21.15.8:0/172773583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e140f77d0 0x7f6e140f7c30 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.826+0000 7f6e1898f700 1 --2- 172.21.15.8:0/172773583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e140f6530 0x7f6e140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.826+0000 7f6e1898f700 1 -- 172.21.15.8:0/172773583 >> 172.21.15.8:0/172773583 conn(0x7f6e140f1c90 msgr2=0x7f6e140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.826+0000 7f6e1898f700 1 -- 172.21.15.8:0/172773583 shutdown_connections 2023-10-18T21:46:29.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.826+0000 7f6e1898f700 1 -- 172.21.15.8:0/172773583 wait complete. 2023-10-18T21:46:29.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.827+0000 7f6e1898f700 1 Processor -- start 2023-10-18T21:46:29.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.828+0000 7f6e1898f700 1 -- start start 2023-10-18T21:46:29.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.828+0000 7f6e1898f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e140f6530 0x7f6e1406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:29.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.828+0000 7f6e1898f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e140f77d0 0x7f6e14069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:29.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.828+0000 7f6e1898f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1406a380 con 0x7f6e140f6530 2023-10-18T21:46:29.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.828+0000 7f6e1898f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1406a4c0 con 0x7f6e140f77d0 2023-10-18T21:46:29.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.828+0000 7f6e12d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e140f6530 0x7f6e1406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:29.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.828+0000 7f6e12d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e140f6530 0x7f6e1406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43904/0 (socket says 172.21.15.8:43904) 2023-10-18T21:46:29.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.828+0000 7f6e12d9d700 1 -- 172.21.15.8:0/201648701 learned_addr learned my addr 172.21.15.8:0/201648701 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:46:29.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.828+0000 7f6e1259c700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e140f77d0 0x7f6e14069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:29.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.829+0000 7f6e12d9d700 1 -- 172.21.15.8:0/201648701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e140f77d0 msgr2=0x7f6e14069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:29.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.829+0000 7f6e12d9d700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e140f77d0 0x7f6e14069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:29.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.829+0000 7f6e12d9d700 1 -- 172.21.15.8:0/201648701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e08005040 con 0x7f6e140f6530 2023-10-18T21:46:29.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.829+0000 7f6e12d9d700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e140f6530 0x7f6e1406b9a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f6e04002700 tx=0x7f6e04009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:29.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.829+0000 7f6dfb7fe700 1 -- 172.21.15.8:0/201648701 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e040079c0 con 0x7f6e140f6530 2023-10-18T21:46:29.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.829+0000 7f6dfb7fe700 1 -- 172.21.15.8:0/201648701 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6e0400f040 con 0x7f6e140f6530 2023-10-18T21:46:29.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.829+0000 7f6dfb7fe700 1 -- 172.21.15.8:0/201648701 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e040148d0 con 0x7f6e140f6530 2023-10-18T21:46:29.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.829+0000 7f6e1898f700 1 -- 172.21.15.8:0/201648701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1406a7a0 con 0x7f6e140f6530 2023-10-18T21:46:29.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.830+0000 7f6e1898f700 1 -- 172.21.15.8:0/201648701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1410ed70 con 0x7f6e140f6530 2023-10-18T21:46:29.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.831+0000 7f6e1898f700 1 -- 172.21.15.8:0/201648701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e14045ad0 con 0x7f6e140f6530 2023-10-18T21:46:29.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.832+0000 7f6dfb7fe700 1 -- 172.21.15.8:0/201648701 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6e0401b060 con 0x7f6e140f6530 2023-10-18T21:46:29.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.832+0000 7f6dfb7fe700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dfc060f70 0x7f6dfc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:29.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.832+0000 7f6dfb7fe700 1 -- 172.21.15.8:0/201648701 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6e0407c6b0 con 0x7f6e140f6530 2023-10-18T21:46:29.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.833+0000 7f6e1259c700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dfc060f70 0x7f6dfc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:29.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.833+0000 7f6e1259c700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dfc060f70 0x7f6dfc063430 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f6e08004630 tx=0x7f6e08009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:29.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:29.836+0000 7f6dfb7fe700 1 -- 172.21.15.8:0/201648701 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6e0404c3a0 con 0x7f6e140f6530 2023-10-18T21:46:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:29.626966+0000 mon.smithi008 (mon.0) 3246 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:29.628926+0000 mon.smithi008 (mon.0) 3247 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:29.629782+0000 mon.smithi008 (mon.0) 3248 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:29.636141+0000 mon.smithi008 (mon.0) 3249 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:29.641044+0000 mon.smithi008 (mon.0) 3250 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:29.643469+0000 mon.smithi008 (mon.0) 3251 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:29.644736+0000 mon.smithi008 (mon.0) 3252 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:29.645988+0000 mon.smithi008 (mon.0) 3253 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:29.647661+0000 mon.smithi008 (mon.0) 3254 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.033+0000 7f6e1898f700 1 -- 172.21.15.8:0/201648701 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e140fee30 con 0x7f6dfc060f70 2023-10-18T21:46:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.035+0000 7f6dfb7fe700 1 -- 172.21.15.8:0/201648701 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6e140fee30 con 0x7f6dfc060f70 2023-10-18T21:46:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.036+0000 7f6e1898f700 1 -- 172.21.15.8:0/201648701 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dfc060f70 msgr2=0x7f6dfc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.036+0000 7f6e1898f700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dfc060f70 0x7f6dfc063430 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f6e08004630 tx=0x7f6e08009b30).stop 2023-10-18T21:46:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.036+0000 7f6e1898f700 1 -- 172.21.15.8:0/201648701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e140f6530 msgr2=0x7f6e1406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.036+0000 7f6e1898f700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e140f6530 0x7f6e1406b9a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f6e04002700 tx=0x7f6e04009d80).stop 2023-10-18T21:46:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.037+0000 7f6e1898f700 1 -- 172.21.15.8:0/201648701 shutdown_connections 2023-10-18T21:46:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.037+0000 7f6e1898f700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6dfc060f70 0x7f6dfc063430 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.037+0000 7f6e1898f700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e140f6530 0x7f6e1406b9a0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.037+0000 7f6e1898f700 1 --2- 172.21.15.8:0/201648701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e140f77d0 0x7f6e14069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.037+0000 7f6e1898f700 1 -- 172.21.15.8:0/201648701 >> 172.21.15.8:0/201648701 conn(0x7f6e140f1c90 msgr2=0x7f6e140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.037+0000 7f6e1898f700 1 -- 172.21.15.8:0/201648701 shutdown_connections 2023-10-18T21:46:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.037+0000 7f6e1898f700 1 -- 172.21.15.8:0/201648701 wait complete. 2023-10-18T21:46:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:29.626966+0000 mon.smithi008 (mon.0) 3246 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:29.628926+0000 mon.smithi008 (mon.0) 3247 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:29.629782+0000 mon.smithi008 (mon.0) 3248 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:29.636141+0000 mon.smithi008 (mon.0) 3249 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:29.641044+0000 mon.smithi008 (mon.0) 3250 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:29.643469+0000 mon.smithi008 (mon.0) 3251 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:29.644736+0000 mon.smithi008 (mon.0) 3252 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:30.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:29.645988+0000 mon.smithi008 (mon.0) 3253 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:30.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:29.647661+0000 mon.smithi008 (mon.0) 3254 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:30.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.173+0000 7fcd78835700 1 -- 172.21.15.8:0/2193077524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd740f77d0 msgr2=0x7fcd740f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.173+0000 7fcd78835700 1 --2- 172.21.15.8:0/2193077524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd740f77d0 0x7fcd740f7c30 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fcd68004660 tx=0x7fcd68009b30).stop 2023-10-18T21:46:30.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.174+0000 7fcd78835700 1 -- 172.21.15.8:0/2193077524 shutdown_connections 2023-10-18T21:46:30.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.174+0000 7fcd78835700 1 --2- 172.21.15.8:0/2193077524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd740f77d0 0x7fcd740f7c30 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.174+0000 7fcd78835700 1 --2- 172.21.15.8:0/2193077524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd740f6530 0x7fcd740f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.174+0000 7fcd78835700 1 -- 172.21.15.8:0/2193077524 >> 172.21.15.8:0/2193077524 conn(0x7fcd740f1c90 msgr2=0x7fcd740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:30.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.174+0000 7fcd78835700 1 -- 172.21.15.8:0/2193077524 shutdown_connections 2023-10-18T21:46:30.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.174+0000 7fcd78835700 1 -- 172.21.15.8:0/2193077524 wait complete. 2023-10-18T21:46:30.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.174+0000 7fcd78835700 1 Processor -- start 2023-10-18T21:46:30.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.175+0000 7fcd78835700 1 -- start start 2023-10-18T21:46:30.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.175+0000 7fcd78835700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd740f6530 0x7fcd74108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:30.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.175+0000 7fcd78835700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd740f77d0 0x7fcd74109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:30.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.175+0000 7fcd78835700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74109a20 con 0x7fcd740f77d0 2023-10-18T21:46:30.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.175+0000 7fcd78835700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74109b60 con 0x7fcd740f6530 2023-10-18T21:46:30.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.175+0000 7fcd72ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd740f77d0 0x7fcd74109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:30.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.175+0000 7fcd72ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd740f77d0 0x7fcd74109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43920/0 (socket says 172.21.15.8:43920) 2023-10-18T21:46:30.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.175+0000 7fcd72ffd700 1 -- 172.21.15.8:0/3408215008 learned_addr learned my addr 172.21.15.8:0/3408215008 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:46:30.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.176+0000 7fcd737fe700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd740f6530 0x7fcd74108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:30.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.176+0000 7fcd72ffd700 1 -- 172.21.15.8:0/3408215008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd740f6530 msgr2=0x7fcd74108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.176+0000 7fcd72ffd700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd740f6530 0x7fcd74108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.176+0000 7fcd72ffd700 1 -- 172.21.15.8:0/3408215008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68005040 con 0x7fcd740f77d0 2023-10-18T21:46:30.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.176+0000 7fcd72ffd700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd740f77d0 0x7fcd74109470 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fcd68009990 tx=0x7fcd68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:30.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.176+0000 7fcd5bfff700 1 -- 172.21.15.8:0/3408215008 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd68018070 con 0x7fcd740f77d0 2023-10-18T21:46:30.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.176+0000 7fcd5bfff700 1 -- 172.21.15.8:0/3408215008 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcd68009630 con 0x7fcd740f77d0 2023-10-18T21:46:30.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.176+0000 7fcd78835700 1 -- 172.21.15.8:0/3408215008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7410a4a0 con 0x7fcd740f77d0 2023-10-18T21:46:30.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.176+0000 7fcd5bfff700 1 -- 172.21.15.8:0/3408215008 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd6801c3c0 con 0x7fcd740f77d0 2023-10-18T21:46:30.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.176+0000 7fcd78835700 1 -- 172.21.15.8:0/3408215008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7410aa00 con 0x7fcd740f77d0 2023-10-18T21:46:30.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.178+0000 7fcd78835700 1 -- 172.21.15.8:0/3408215008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd74045ad0 con 0x7fcd740f77d0 2023-10-18T21:46:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.178+0000 7fcd5bfff700 1 -- 172.21.15.8:0/3408215008 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcd6801d970 con 0x7fcd740f77d0 2023-10-18T21:46:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.179+0000 7fcd5bfff700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd5c060f70 0x7fcd5c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.179+0000 7fcd5bfff700 1 -- 172.21.15.8:0/3408215008 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcd6807e660 con 0x7fcd740f77d0 2023-10-18T21:46:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.180+0000 7fcd737fe700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd5c060f70 0x7fcd5c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.180+0000 7fcd737fe700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd5c060f70 0x7fcd5c063430 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fcd740f7630 tx=0x7fcd6400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:30.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.184+0000 7fcd5bfff700 1 -- 172.21.15.8:0/3408215008 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcd68051c40 con 0x7fcd740f77d0 2023-10-18T21:46:30.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.377+0000 7fcd78835700 1 -- 172.21.15.8:0/3408215008 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd740fee00 con 0x7fcd5c060f70 2023-10-18T21:46:30.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.387+0000 7fcd5bfff700 1 -- 172.21.15.8:0/3408215008 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcd740fee00 con 0x7fcd5c060f70 2023-10-18T21:46:30.389 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:46:30.390 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (53m) 42s ago 54m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:46:30.390 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (47m) 42s ago 54m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:46:30.390 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (46m) 8m ago 53m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:46:30.390 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (53m) 42s ago 54m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:46:30.390 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 42s ago 50m - - 2023-10-18T21:46:30.391 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 42s ago 50m - - 2023-10-18T21:46:30.391 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 50m - - 2023-10-18T21:46:30.391 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 50m - - 2023-10-18T21:46:30.391 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (48m) 42s ago 56m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:46:30.392 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (47m) 8m ago 53m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:46:30.392 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (47m) 42s ago 56m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:46:30.392 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (47m) 8m ago 53m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:46:30.392 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (54m) 42s ago 54m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:46:30.392 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (53m) 8m ago 53m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:46:30.393 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (46m) 42s ago 53m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:46:30.393 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (44m) 42s ago 52m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:46:30.393 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (44m) 42s ago 52m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:46:30.393 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (43m) 8m ago 52m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:46:30.393 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (43m) 8m ago 52m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:46:30.393 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (42m) 8m ago 51m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:46:30.394 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (48m) 42s ago 53m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:46:30.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 -- 172.21.15.8:0/3408215008 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd5c060f70 msgr2=0x7fcd5c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd5c060f70 0x7fcd5c063430 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fcd740f7630 tx=0x7fcd6400b040).stop 2023-10-18T21:46:30.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 -- 172.21.15.8:0/3408215008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd740f77d0 msgr2=0x7fcd74109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd740f77d0 0x7fcd74109470 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fcd68009990 tx=0x7fcd68009b30).stop 2023-10-18T21:46:30.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 -- 172.21.15.8:0/3408215008 shutdown_connections 2023-10-18T21:46:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcd5c060f70 0x7fcd5c063430 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd740f6530 0x7fcd74108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 --2- 172.21.15.8:0/3408215008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd740f77d0 0x7fcd74109470 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 -- 172.21.15.8:0/3408215008 >> 172.21.15.8:0/3408215008 conn(0x7fcd740f1c90 msgr2=0x7fcd7406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:30.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 -- 172.21.15.8:0/3408215008 shutdown_connections 2023-10-18T21:46:30.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.389+0000 7fcd78835700 1 -- 172.21.15.8:0/3408215008 wait complete. 2023-10-18T21:46:30.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.525+0000 7f16c5d09700 1 -- 172.21.15.8:0/3534362162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c00f77d0 msgr2=0x7f16c00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.525+0000 7f16c5d09700 1 --2- 172.21.15.8:0/3534362162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c00f77d0 0x7f16c00f7c30 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f16ac004660 tx=0x7f16ac009b30).stop 2023-10-18T21:46:30.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.525+0000 7f16c5d09700 1 -- 172.21.15.8:0/3534362162 shutdown_connections 2023-10-18T21:46:30.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.525+0000 7f16c5d09700 1 --2- 172.21.15.8:0/3534362162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c00f77d0 0x7f16c00f7c30 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.525+0000 7f16c5d09700 1 --2- 172.21.15.8:0/3534362162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00f6530 0x7f16c00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.525+0000 7f16c5d09700 1 -- 172.21.15.8:0/3534362162 >> 172.21.15.8:0/3534362162 conn(0x7f16c00f1c70 msgr2=0x7f16c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:30.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.525+0000 7f16c5d09700 1 -- 172.21.15.8:0/3534362162 shutdown_connections 2023-10-18T21:46:30.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.525+0000 7f16c5d09700 1 -- 172.21.15.8:0/3534362162 wait complete. 2023-10-18T21:46:30.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.526+0000 7f16c5d09700 1 Processor -- start 2023-10-18T21:46:30.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.526+0000 7f16c5d09700 1 -- start start 2023-10-18T21:46:30.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16c5d09700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00f6530 0x7f16c0106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:30.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16c5d09700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c00f77d0 0x7f16c01072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:30.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16c5d09700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01078a0 con 0x7f16c00f77d0 2023-10-18T21:46:30.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16c5d09700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01080e0 con 0x7f16c00f6530 2023-10-18T21:46:30.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16bffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c00f77d0 0x7f16c01072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:30.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16bffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c00f77d0 0x7f16c01072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43934/0 (socket says 172.21.15.8:43934) 2023-10-18T21:46:30.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16bffff700 1 -- 172.21.15.8:0/1847449433 learned_addr learned my addr 172.21.15.8:0/1847449433 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:46:30.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16c4d07700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00f6530 0x7f16c0106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:30.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16bffff700 1 -- 172.21.15.8:0/1847449433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00f6530 msgr2=0x7f16c0106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16bffff700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00f6530 0x7f16c0106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.527+0000 7f16bffff700 1 -- 172.21.15.8:0/1847449433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac005040 con 0x7f16c00f77d0 2023-10-18T21:46:30.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.528+0000 7f16bffff700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c00f77d0 0x7f16c01072a0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f16ac009990 tx=0x7f16ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:30.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.528+0000 7f16bd7fa700 1 -- 172.21.15.8:0/1847449433 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16ac018070 con 0x7f16c00f77d0 2023-10-18T21:46:30.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.528+0000 7f16bd7fa700 1 -- 172.21.15.8:0/1847449433 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f16ac009630 con 0x7f16c00f77d0 2023-10-18T21:46:30.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.528+0000 7f16bd7fa700 1 -- 172.21.15.8:0/1847449433 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16ac01c400 con 0x7f16c00f77d0 2023-10-18T21:46:30.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.528+0000 7f16c5d09700 1 -- 172.21.15.8:0/1847449433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c0108360 con 0x7f16c00f77d0 2023-10-18T21:46:30.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.528+0000 7f16c5d09700 1 -- 172.21.15.8:0/1847449433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c0108840 con 0x7f16c00f77d0 2023-10-18T21:46:30.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.529+0000 7f16c5d09700 1 -- 172.21.15.8:0/1847449433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c0059100 con 0x7f16c00f77d0 2023-10-18T21:46:30.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.530+0000 7f16bd7fa700 1 -- 172.21.15.8:0/1847449433 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f16ac01d9e0 con 0x7f16c00f77d0 2023-10-18T21:46:30.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.531+0000 7f16bd7fa700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16b0060f70 0x7f16b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:30.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.531+0000 7f16bd7fa700 1 -- 172.21.15.8:0/1847449433 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f16ac07e700 con 0x7f16c00f77d0 2023-10-18T21:46:30.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.531+0000 7f16c4d07700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16b0060f70 0x7f16b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:30.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.532+0000 7f16c4d07700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16b0060f70 0x7f16b0063430 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f16c0107b70 tx=0x7f16b4009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:30.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.536+0000 7f16bd7fa700 1 -- 172.21.15.8:0/1847449433 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f16ac04e2b0 con 0x7f16c00f77d0 2023-10-18T21:46:30.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.792+0000 7f16c5d09700 1 -- 172.21.15.8:0/1847449433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f16c0027a00 con 0x7f16c00f77d0 2023-10-18T21:46:30.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.792+0000 7f16bd7fa700 1 -- 172.21.15.8:0/1847449433 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f16ac0518d0 con 0x7f16c00f77d0 2023-10-18T21:46:30.795 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:46:30.795 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:46:30.795 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:46:30.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:46:30.796 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:46:30.796 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:46:30.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:46:30.796 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:46:30.797 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:46:30.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:46:30.797 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:46:30.797 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:46:30.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:46:30.798 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:46:30.798 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:46:30.798 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:46:30.798 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:46:30.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.794+0000 7f16c5d09700 1 -- 172.21.15.8:0/1847449433 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16b0060f70 msgr2=0x7f16b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.794+0000 7f16c5d09700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16b0060f70 0x7f16b0063430 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f16c0107b70 tx=0x7f16b4009c00).stop 2023-10-18T21:46:30.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.794+0000 7f16c5d09700 1 -- 172.21.15.8:0/1847449433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c00f77d0 msgr2=0x7f16c01072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.794+0000 7f16c5d09700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c00f77d0 0x7f16c01072a0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f16ac009990 tx=0x7f16ac009b30).stop 2023-10-18T21:46:30.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.794+0000 7f16c5d09700 1 -- 172.21.15.8:0/1847449433 shutdown_connections 2023-10-18T21:46:30.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.794+0000 7f16c5d09700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f16b0060f70 0x7f16b0063430 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.794+0000 7f16c5d09700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16c00f6530 0x7f16c0106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.794+0000 7f16c5d09700 1 --2- 172.21.15.8:0/1847449433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c00f77d0 0x7f16c01072a0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.794+0000 7f16c5d09700 1 -- 172.21.15.8:0/1847449433 >> 172.21.15.8:0/1847449433 conn(0x7f16c00f1c70 msgr2=0x7f16c00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:30.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.795+0000 7f16c5d09700 1 -- 172.21.15.8:0/1847449433 shutdown_connections 2023-10-18T21:46:30.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.795+0000 7f16c5d09700 1 -- 172.21.15.8:0/1847449433 wait complete. 2023-10-18T21:46:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.931+0000 7f5c86958700 1 -- 172.21.15.8:0/3604159743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c800f6530 msgr2=0x7f5c800f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.931+0000 7f5c86958700 1 --2- 172.21.15.8:0/3604159743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c800f6530 0x7f5c800f6950 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f5c7c004660 tx=0x7f5c7c009b30).stop 2023-10-18T21:46:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.931+0000 7f5c86958700 1 -- 172.21.15.8:0/3604159743 shutdown_connections 2023-10-18T21:46:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.931+0000 7f5c86958700 1 --2- 172.21.15.8:0/3604159743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c800f77d0 0x7f5c800f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.931+0000 7f5c86958700 1 --2- 172.21.15.8:0/3604159743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c800f6530 0x7f5c800f6950 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.931+0000 7f5c86958700 1 -- 172.21.15.8:0/3604159743 >> 172.21.15.8:0/3604159743 conn(0x7f5c800f1c90 msgr2=0x7f5c800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.931+0000 7f5c86958700 1 -- 172.21.15.8:0/3604159743 shutdown_connections 2023-10-18T21:46:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.931+0000 7f5c86958700 1 -- 172.21.15.8:0/3604159743 wait complete. 2023-10-18T21:46:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.932+0000 7f5c86958700 1 Processor -- start 2023-10-18T21:46:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.932+0000 7f5c86958700 1 -- start start 2023-10-18T21:46:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c86958700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c800f6530 0x7f5c8006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c86958700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c800f77d0 0x7f5c80069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c86958700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8006a380 con 0x7f5c800f6530 2023-10-18T21:46:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c86958700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8006a4c0 con 0x7f5c800f77d0 2023-10-18T21:46:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c85956700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c800f6530 0x7f5c8006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c85956700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c800f6530 0x7f5c8006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43954/0 (socket says 172.21.15.8:43954) 2023-10-18T21:46:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c85956700 1 -- 172.21.15.8:0/3259457814 learned_addr learned my addr 172.21.15.8:0/3259457814 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:46:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c85155700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c800f77d0 0x7f5c80069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c85956700 1 -- 172.21.15.8:0/3259457814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c800f77d0 msgr2=0x7f5c80069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c85956700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c800f77d0 0x7f5c80069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.933+0000 7f5c85956700 1 -- 172.21.15.8:0/3259457814 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c005040 con 0x7f5c800f6530 2023-10-18T21:46:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.934+0000 7f5c85956700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c800f6530 0x7f5c8006b9a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f5c7c007a60 tx=0x7f5c7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.934+0000 7f5c767fc700 1 -- 172.21.15.8:0/3259457814 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c7c018070 con 0x7f5c800f6530 2023-10-18T21:46:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.934+0000 7f5c767fc700 1 -- 172.21.15.8:0/3259457814 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5c7c009630 con 0x7f5c800f6530 2023-10-18T21:46:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.934+0000 7f5c86958700 1 -- 172.21.15.8:0/3259457814 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8006a740 con 0x7f5c800f6530 2023-10-18T21:46:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.934+0000 7f5c767fc700 1 -- 172.21.15.8:0/3259457814 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c7c01c540 con 0x7f5c800f6530 2023-10-18T21:46:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.934+0000 7f5c86958700 1 -- 172.21.15.8:0/3259457814 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8006aca0 con 0x7f5c800f6530 2023-10-18T21:46:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.935+0000 7f5c86958700 1 -- 172.21.15.8:0/3259457814 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c80045ad0 con 0x7f5c800f6530 2023-10-18T21:46:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.936+0000 7f5c767fc700 1 -- 172.21.15.8:0/3259457814 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5c7c01d420 con 0x7f5c800f6530 2023-10-18T21:46:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.937+0000 7f5c767fc700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c6c060f70 0x7f5c6c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.937+0000 7f5c767fc700 1 -- 172.21.15.8:0/3259457814 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5c7c07e6c0 con 0x7f5c800f6530 2023-10-18T21:46:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.937+0000 7f5c85155700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c6c060f70 0x7f5c6c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.938+0000 7f5c85155700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c6c060f70 0x7f5c6c063430 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f5c70009760 tx=0x7f5c70009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:30.942+0000 7f5c767fc700 1 -- 172.21.15.8:0/3259457814 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5c7c04e2f0 con 0x7f5c800f6530 2023-10-18T21:46:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:29.597675+0000 mgr.smithi008.flmjzp (mgr.14640) 2856 : cluster [DBG] pgmap v1968: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:46:29.630553+0000 mgr.smithi008.flmjzp (mgr.14640) 2857 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:29.630996+0000 mgr.smithi008.flmjzp (mgr.14640) 2858 : cluster [DBG] pgmap v1969: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:29.631188+0000 mgr.smithi008.flmjzp (mgr.14640) 2859 : cluster [DBG] pgmap v1970: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:46:29.649348+0000 mgr.smithi008.flmjzp (mgr.14640) 2860 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:29.687213+0000 mgr.smithi008.flmjzp (mgr.14640) 2861 : audit [DBG] from='client.36400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:30.035962+0000 mgr.smithi008.flmjzp (mgr.14640) 2862 : audit [DBG] from='client.36404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:31.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.168+0000 7f5c86958700 1 -- 172.21.15.8:0/3259457814 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5c800fedd0 con 0x7f5c800f6530 2023-10-18T21:46:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:29.597675+0000 mgr.smithi008.flmjzp (mgr.14640) 2856 : cluster [DBG] pgmap v1968: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:46:29.630553+0000 mgr.smithi008.flmjzp (mgr.14640) 2857 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:29.630996+0000 mgr.smithi008.flmjzp (mgr.14640) 2858 : cluster [DBG] pgmap v1969: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:29.631188+0000 mgr.smithi008.flmjzp (mgr.14640) 2859 : cluster [DBG] pgmap v1970: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:31.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:46:29.649348+0000 mgr.smithi008.flmjzp (mgr.14640) 2860 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:31.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:29.687213+0000 mgr.smithi008.flmjzp (mgr.14640) 2861 : audit [DBG] from='client.36400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:31.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:30.035962+0000 mgr.smithi008.flmjzp (mgr.14640) 2862 : audit [DBG] from='client.36404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:31.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.168+0000 7f5c767fc700 1 -- 172.21.15.8:0/3259457814 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f5c7c051910 con 0x7f5c800f6530 2023-10-18T21:46:31.173 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:46:31.173 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:46:31.173 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:46:31.173 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:46:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:46:31.174 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:46:31.174 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:46:31.174 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:46:31.175 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:46:31.175 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:46:31.175 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:46:31.175 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:46:31.176 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:46:31.176 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:46:31.176 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:46:31.176 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:46:31.176 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:46:31.177 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:46:31.177 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:46:31.177 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:46:31.177 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:46:31.177 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:46:31.178 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:46:31.178 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:46:31.178 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:46:31.178 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:46:31.178 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:46:31.179 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:46:31.179 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:46:31.179 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:46:31.179 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:46:31.179 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:46:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:46:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:46:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.170+0000 7f5c86958700 1 -- 172.21.15.8:0/3259457814 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c6c060f70 msgr2=0x7f5c6c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.170+0000 7f5c86958700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c6c060f70 0x7f5c6c063430 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f5c70009760 tx=0x7f5c70009c60).stop 2023-10-18T21:46:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.170+0000 7f5c86958700 1 -- 172.21.15.8:0/3259457814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c800f6530 msgr2=0x7f5c8006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.170+0000 7f5c86958700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c800f6530 0x7f5c8006b9a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f5c7c007a60 tx=0x7f5c7c009b30).stop 2023-10-18T21:46:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.170+0000 7f5c86958700 1 -- 172.21.15.8:0/3259457814 shutdown_connections 2023-10-18T21:46:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.170+0000 7f5c86958700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c6c060f70 0x7f5c6c063430 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.170+0000 7f5c86958700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c800f6530 0x7f5c8006b9a0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.170+0000 7f5c86958700 1 --2- 172.21.15.8:0/3259457814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c800f77d0 0x7f5c80069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.170+0000 7f5c86958700 1 -- 172.21.15.8:0/3259457814 >> 172.21.15.8:0/3259457814 conn(0x7f5c800f1c90 msgr2=0x7f5c800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.171+0000 7f5c86958700 1 -- 172.21.15.8:0/3259457814 shutdown_connections 2023-10-18T21:46:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.171+0000 7f5c86958700 1 -- 172.21.15.8:0/3259457814 wait complete. 2023-10-18T21:46:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:46:31.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.307+0000 7f69ecee0700 1 -- 172.21.15.8:0/2180330111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69e80f6530 msgr2=0x7f69e80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:31.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.307+0000 7f69ecee0700 1 --2- 172.21.15.8:0/2180330111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69e80f6530 0x7f69e80f6950 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f69d8004660 tx=0x7f69d8009b30).stop 2023-10-18T21:46:31.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.307+0000 7f69ecee0700 1 -- 172.21.15.8:0/2180330111 shutdown_connections 2023-10-18T21:46:31.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.307+0000 7f69ecee0700 1 --2- 172.21.15.8:0/2180330111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e80f77d0 0x7f69e80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:31.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.307+0000 7f69ecee0700 1 --2- 172.21.15.8:0/2180330111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69e80f6530 0x7f69e80f6950 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:31.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.307+0000 7f69ecee0700 1 -- 172.21.15.8:0/2180330111 >> 172.21.15.8:0/2180330111 conn(0x7f69e80f1c90 msgr2=0x7f69e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:31.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.308+0000 7f69ecee0700 1 -- 172.21.15.8:0/2180330111 shutdown_connections 2023-10-18T21:46:31.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.308+0000 7f69ecee0700 1 -- 172.21.15.8:0/2180330111 wait complete. 2023-10-18T21:46:31.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.308+0000 7f69ecee0700 1 Processor -- start 2023-10-18T21:46:31.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.309+0000 7f69ecee0700 1 -- start start 2023-10-18T21:46:31.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.309+0000 7f69ecee0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e80f6530 0x7f69e8106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:31.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.309+0000 7f69ecee0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69e80f77d0 0x7f69e8107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:31.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.309+0000 7f69ecee0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8107910 con 0x7f69e80f77d0 2023-10-18T21:46:31.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.309+0000 7f69ecee0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8108120 con 0x7f69e80f6530 2023-10-18T21:46:31.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.309+0000 7f69e6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69e80f77d0 0x7f69e8107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:31.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.309+0000 7f69e6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69e80f77d0 0x7f69e8107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43972/0 (socket says 172.21.15.8:43972) 2023-10-18T21:46:31.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.309+0000 7f69e6ffd700 1 -- 172.21.15.8:0/3623738746 learned_addr learned my addr 172.21.15.8:0/3623738746 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:46:31.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.309+0000 7f69e77fe700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e80f6530 0x7f69e8106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:31.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.310+0000 7f69e6ffd700 1 -- 172.21.15.8:0/3623738746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e80f6530 msgr2=0x7f69e8106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:31.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.310+0000 7f69e6ffd700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e80f6530 0x7f69e8106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:31.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.310+0000 7f69e6ffd700 1 -- 172.21.15.8:0/3623738746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d8005040 con 0x7f69e80f77d0 2023-10-18T21:46:31.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.310+0000 7f69e6ffd700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69e80f77d0 0x7f69e8107310 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f69dc0026d0 tx=0x7f69dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:31.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.310+0000 7f69cffff700 1 -- 172.21.15.8:0/3623738746 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69dc0079c0 con 0x7f69e80f77d0 2023-10-18T21:46:31.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.310+0000 7f69ecee0700 1 -- 172.21.15.8:0/3623738746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e81083a0 con 0x7f69e80f77d0 2023-10-18T21:46:31.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.310+0000 7f69cffff700 1 -- 172.21.15.8:0/3623738746 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f69dc00f040 con 0x7f69e80f77d0 2023-10-18T21:46:31.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.310+0000 7f69cffff700 1 -- 172.21.15.8:0/3623738746 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69dc014980 con 0x7f69e80f77d0 2023-10-18T21:46:31.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.310+0000 7f69ecee0700 1 -- 172.21.15.8:0/3623738746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e8108960 con 0x7f69e80f77d0 2023-10-18T21:46:31.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.311+0000 7f69ecee0700 1 -- 172.21.15.8:0/3623738746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e8059100 con 0x7f69e80f77d0 2023-10-18T21:46:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.312+0000 7f69cffff700 1 -- 172.21.15.8:0/3623738746 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f69dc0090d0 con 0x7f69e80f77d0 2023-10-18T21:46:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.313+0000 7f69cffff700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69d0060f70 0x7f69d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:46:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.313+0000 7f69cffff700 1 -- 172.21.15.8:0/3623738746 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f69dc07c980 con 0x7f69e80f77d0 2023-10-18T21:46:31.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.314+0000 7f69e77fe700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69d0060f70 0x7f69d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:46:31.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.314+0000 7f69e77fe700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69d0060f70 0x7f69d0063430 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f69e8106b90 tx=0x7f69d8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:46:31.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.317+0000 7f69cffff700 1 -- 172.21.15.8:0/3623738746 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f69dc04c5e0 con 0x7f69e80f77d0 2023-10-18T21:46:31.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.517+0000 7f69ecee0700 1 -- 172.21.15.8:0/3623738746 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69e80fee30 con 0x7f69d0060f70 2023-10-18T21:46:31.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.518+0000 7f69cffff700 1 -- 172.21.15.8:0/3623738746 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f69e80fee30 con 0x7f69d0060f70 2023-10-18T21:46:31.521 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:46:31.521 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:46:31.521 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:46:31.521 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:46:31.521 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:46:31.522 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:46:31.522 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:46:31.522 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:46:31.522 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:46:31.523 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:46:31.523 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:46:31.523 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:46:31.523 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:46:31.523 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:46:31.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.520+0000 7f69ecee0700 1 -- 172.21.15.8:0/3623738746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69d0060f70 msgr2=0x7f69d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:31.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.520+0000 7f69ecee0700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69d0060f70 0x7f69d0063430 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f69e8106b90 tx=0x7f69d8009b30).stop 2023-10-18T21:46:31.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.520+0000 7f69ecee0700 1 -- 172.21.15.8:0/3623738746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69e80f77d0 msgr2=0x7f69e8107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:46:31.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.520+0000 7f69ecee0700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69e80f77d0 0x7f69e8107310 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f69dc0026d0 tx=0x7f69dc009de0).stop 2023-10-18T21:46:31.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.521+0000 7f69ecee0700 1 -- 172.21.15.8:0/3623738746 shutdown_connections 2023-10-18T21:46:31.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.521+0000 7f69ecee0700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69d0060f70 0x7f69d0063430 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:31.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.521+0000 7f69ecee0700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e80f6530 0x7f69e8106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:31.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.521+0000 7f69ecee0700 1 --2- 172.21.15.8:0/3623738746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69e80f77d0 0x7f69e8107310 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:46:31.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.521+0000 7f69ecee0700 1 -- 172.21.15.8:0/3623738746 >> 172.21.15.8:0/3623738746 conn(0x7f69e80f1c90 msgr2=0x7f69e80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:46:31.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.521+0000 7f69ecee0700 1 -- 172.21.15.8:0/3623738746 shutdown_connections 2023-10-18T21:46:31.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:46:31.521+0000 7f69ecee0700 1 -- 172.21.15.8:0/3623738746 wait complete. 2023-10-18T21:46:31.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:30.379869+0000 mgr.smithi008.flmjzp (mgr.14640) 2863 : audit [DBG] from='client.36408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:30.794055+0000 mon.smithi008 (mon.0) 3255 : audit [DBG] from='client.? 172.21.15.8:0/1847449433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:31.169887+0000 mon.smithi008 (mon.0) 3256 : audit [DBG] from='client.? 172.21.15.8:0/3259457814' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:46:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:30.379869+0000 mgr.smithi008.flmjzp (mgr.14640) 2863 : audit [DBG] from='client.36408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:30.794055+0000 mon.smithi008 (mon.0) 3255 : audit [DBG] from='client.? 172.21.15.8:0/1847449433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:31.169887+0000 mon.smithi008 (mon.0) 3256 : audit [DBG] from='client.? 172.21.15.8:0/3259457814' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:46:32.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:31.519865+0000 mgr.smithi008.flmjzp (mgr.14640) 2864 : audit [DBG] from='client.36420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:31.631726+0000 mgr.smithi008.flmjzp (mgr.14640) 2865 : cluster [DBG] pgmap v1971: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:31.519865+0000 mgr.smithi008.flmjzp (mgr.14640) 2864 : audit [DBG] from='client.36420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:46:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:31.631726+0000 mgr.smithi008.flmjzp (mgr.14640) 2865 : cluster [DBG] pgmap v1971: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:34.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:33.632506+0000 mgr.smithi008.flmjzp (mgr.14640) 2866 : cluster [DBG] pgmap v1972: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:35.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:33.632506+0000 mgr.smithi008.flmjzp (mgr.14640) 2866 : cluster [DBG] pgmap v1972: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:36.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:35.633208+0000 mgr.smithi008.flmjzp (mgr.14640) 2867 : cluster [DBG] pgmap v1973: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:35.633208+0000 mgr.smithi008.flmjzp (mgr.14640) 2867 : cluster [DBG] pgmap v1973: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:37.633807+0000 mgr.smithi008.flmjzp (mgr.14640) 2868 : cluster [DBG] pgmap v1974: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:37.633807+0000 mgr.smithi008.flmjzp (mgr.14640) 2868 : cluster [DBG] pgmap v1974: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:39.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:39.660194+0000 mon.smithi008 (mon.0) 3257 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:39.662490+0000 mon.smithi008 (mon.0) 3258 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:39.663607+0000 mon.smithi008 (mon.0) 3259 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:39.670292+0000 mon.smithi008 (mon.0) 3260 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:39.676759+0000 mon.smithi008 (mon.0) 3261 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:39.679935+0000 mon.smithi008 (mon.0) 3262 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:39.681629+0000 mon.smithi008 (mon.0) 3263 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:39.683174+0000 mon.smithi008 (mon.0) 3264 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:39.685095+0000 mon.smithi008 (mon.0) 3265 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:40.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:39.660194+0000 mon.smithi008 (mon.0) 3257 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:40.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:39.662490+0000 mon.smithi008 (mon.0) 3258 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:40.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:39.663607+0000 mon.smithi008 (mon.0) 3259 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:40.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:39.670292+0000 mon.smithi008 (mon.0) 3260 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:40.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:39.676759+0000 mon.smithi008 (mon.0) 3261 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:40.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:39.679935+0000 mon.smithi008 (mon.0) 3262 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:40.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:39.681629+0000 mon.smithi008 (mon.0) 3263 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:40.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:39.683174+0000 mon.smithi008 (mon.0) 3264 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:40.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:39.685095+0000 mon.smithi008 (mon.0) 3265 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:40.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:39.634381+0000 mgr.smithi008.flmjzp (mgr.14640) 2869 : cluster [DBG] pgmap v1975: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:46:39.664516+0000 mgr.smithi008.flmjzp (mgr.14640) 2870 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:39.665046+0000 mgr.smithi008.flmjzp (mgr.14640) 2871 : cluster [DBG] pgmap v1976: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:39.665401+0000 mgr.smithi008.flmjzp (mgr.14640) 2872 : cluster [DBG] pgmap v1977: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:46:39.687117+0000 mgr.smithi008.flmjzp (mgr.14640) 2873 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:39.634381+0000 mgr.smithi008.flmjzp (mgr.14640) 2869 : cluster [DBG] pgmap v1975: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:46:39.664516+0000 mgr.smithi008.flmjzp (mgr.14640) 2870 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:41.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:39.665046+0000 mgr.smithi008.flmjzp (mgr.14640) 2871 : cluster [DBG] pgmap v1976: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:41.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:39.665401+0000 mgr.smithi008.flmjzp (mgr.14640) 2872 : cluster [DBG] pgmap v1977: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:41.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:46:39.687117+0000 mgr.smithi008.flmjzp (mgr.14640) 2873 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:42.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:41.666005+0000 mgr.smithi008.flmjzp (mgr.14640) 2874 : cluster [DBG] pgmap v1978: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:41.666005+0000 mgr.smithi008.flmjzp (mgr.14640) 2874 : cluster [DBG] pgmap v1978: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:44.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:43.666753+0000 mgr.smithi008.flmjzp (mgr.14640) 2875 : cluster [DBG] pgmap v1979: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:45.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:43.666753+0000 mgr.smithi008.flmjzp (mgr.14640) 2875 : cluster [DBG] pgmap v1979: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:45.667275+0000 mgr.smithi008.flmjzp (mgr.14640) 2876 : cluster [DBG] pgmap v1980: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:46.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:45.667275+0000 mgr.smithi008.flmjzp (mgr.14640) 2876 : cluster [DBG] pgmap v1980: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:47.667950+0000 mgr.smithi008.flmjzp (mgr.14640) 2877 : cluster [DBG] pgmap v1981: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:47.667950+0000 mgr.smithi008.flmjzp (mgr.14640) 2877 : cluster [DBG] pgmap v1981: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:49.690818+0000 mon.smithi008 (mon.0) 3266 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:49.693044+0000 mon.smithi008 (mon.0) 3267 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:49.694128+0000 mon.smithi008 (mon.0) 3268 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:49.700922+0000 mon.smithi008 (mon.0) 3269 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:49.707389+0000 mon.smithi008 (mon.0) 3270 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:49.710391+0000 mon.smithi008 (mon.0) 3271 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:49.712060+0000 mon.smithi008 (mon.0) 3272 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:49.713609+0000 mon.smithi008 (mon.0) 3273 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:49.715586+0000 mon.smithi008 (mon.0) 3274 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:50.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:49.690818+0000 mon.smithi008 (mon.0) 3266 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:50.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:49.693044+0000 mon.smithi008 (mon.0) 3267 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:46:50.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:49.694128+0000 mon.smithi008 (mon.0) 3268 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:46:50.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:49.700922+0000 mon.smithi008 (mon.0) 3269 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:46:50.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:49.707389+0000 mon.smithi008 (mon.0) 3270 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:46:50.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:49.710391+0000 mon.smithi008 (mon.0) 3271 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:50.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:49.712060+0000 mon.smithi008 (mon.0) 3272 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:50.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:49.713609+0000 mon.smithi008 (mon.0) 3273 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:50.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:49.715586+0000 mon.smithi008 (mon.0) 3274 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:46:50.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:49.668589+0000 mgr.smithi008.flmjzp (mgr.14640) 2878 : cluster [DBG] pgmap v1982: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:46:49.695141+0000 mgr.smithi008.flmjzp (mgr.14640) 2879 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:49.695695+0000 mgr.smithi008.flmjzp (mgr.14640) 2880 : cluster [DBG] pgmap v1983: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:49.696029+0000 mgr.smithi008.flmjzp (mgr.14640) 2881 : cluster [DBG] pgmap v1984: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:46:49.717472+0000 mgr.smithi008.flmjzp (mgr.14640) 2882 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:49.668589+0000 mgr.smithi008.flmjzp (mgr.14640) 2878 : cluster [DBG] pgmap v1982: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:46:49.695141+0000 mgr.smithi008.flmjzp (mgr.14640) 2879 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:46:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:49.695695+0000 mgr.smithi008.flmjzp (mgr.14640) 2880 : cluster [DBG] pgmap v1983: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:51.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:49.696029+0000 mgr.smithi008.flmjzp (mgr.14640) 2881 : cluster [DBG] pgmap v1984: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:51.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:46:49.717472+0000 mgr.smithi008.flmjzp (mgr.14640) 2882 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:46:52.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:51.696525+0000 mgr.smithi008.flmjzp (mgr.14640) 2883 : cluster [DBG] pgmap v1985: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:51.696525+0000 mgr.smithi008.flmjzp (mgr.14640) 2883 : cluster [DBG] pgmap v1985: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:55.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:53.697109+0000 mgr.smithi008.flmjzp (mgr.14640) 2884 : cluster [DBG] pgmap v1986: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:53.697109+0000 mgr.smithi008.flmjzp (mgr.14640) 2884 : cluster [DBG] pgmap v1986: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:56.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:55.697745+0000 mgr.smithi008.flmjzp (mgr.14640) 2885 : cluster [DBG] pgmap v1987: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:55.697745+0000 mgr.smithi008.flmjzp (mgr.14640) 2885 : cluster [DBG] pgmap v1987: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:57.698234+0000 mgr.smithi008.flmjzp (mgr.14640) 2886 : cluster [DBG] pgmap v1988: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:46:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:57.698234+0000 mgr.smithi008.flmjzp (mgr.14640) 2886 : cluster [DBG] pgmap v1988: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:00.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:46:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:46:59.719847+0000 mon.smithi008 (mon.0) 3275 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:46:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:46:59.719847+0000 mon.smithi008 (mon.0) 3275 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:46:59.698951+0000 mgr.smithi008.flmjzp (mgr.14640) 2887 : cluster [DBG] pgmap v1989: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:00.282609+0000 mon.smithi008 (mon.0) 3276 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:00.283363+0000 mon.smithi008 (mon.0) 3277 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:00.288697+0000 mon.smithi008 (mon.0) 3278 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:00.293551+0000 mon.smithi008 (mon.0) 3279 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:01.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:00.296134+0000 mon.smithi008 (mon.0) 3280 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:01.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:00.297439+0000 mon.smithi008 (mon.0) 3281 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:01.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:00.298737+0000 mon.smithi008 (mon.0) 3282 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:01.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:00.300309+0000 mon.smithi008 (mon.0) 3283 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:46:59.698951+0000 mgr.smithi008.flmjzp (mgr.14640) 2887 : cluster [DBG] pgmap v1989: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:01.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:00.282609+0000 mon.smithi008 (mon.0) 3276 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:01.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:00.283363+0000 mon.smithi008 (mon.0) 3277 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:01.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:00.288697+0000 mon.smithi008 (mon.0) 3278 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:01.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:00.293551+0000 mon.smithi008 (mon.0) 3279 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:01.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:00.296134+0000 mon.smithi008 (mon.0) 3280 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:01.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:00.297439+0000 mon.smithi008 (mon.0) 3281 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:01.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:00.298737+0000 mon.smithi008 (mon.0) 3282 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:01.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:00.300309+0000 mon.smithi008 (mon.0) 3283 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:01.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.675+0000 7fe1e19be700 1 -- 172.21.15.8:0/719039530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc0f6530 msgr2=0x7fe1dc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:01.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.675+0000 7fe1e19be700 1 --2- 172.21.15.8:0/719039530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc0f6530 0x7fe1dc0f6950 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fe1d0004660 tx=0x7fe1d0009b30).stop 2023-10-18T21:47:01.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.675+0000 7fe1e19be700 1 -- 172.21.15.8:0/719039530 shutdown_connections 2023-10-18T21:47:01.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.675+0000 7fe1e19be700 1 --2- 172.21.15.8:0/719039530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1dc0f77d0 0x7fe1dc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:01.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.675+0000 7fe1e19be700 1 --2- 172.21.15.8:0/719039530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc0f6530 0x7fe1dc0f6950 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:01.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.675+0000 7fe1e19be700 1 -- 172.21.15.8:0/719039530 >> 172.21.15.8:0/719039530 conn(0x7fe1dc0f1c90 msgr2=0x7fe1dc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:01.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.675+0000 7fe1e19be700 1 -- 172.21.15.8:0/719039530 shutdown_connections 2023-10-18T21:47:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.675+0000 7fe1e19be700 1 -- 172.21.15.8:0/719039530 wait complete. 2023-10-18T21:47:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.676+0000 7fe1e19be700 1 Processor -- start 2023-10-18T21:47:01.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.676+0000 7fe1e19be700 1 -- start start 2023-10-18T21:47:01.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.676+0000 7fe1e19be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc0f6530 0x7fe1dc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:01.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.676+0000 7fe1e19be700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1dc0f77d0 0x7fe1dc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:01.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.676+0000 7fe1e19be700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc06a380 con 0x7fe1dc0f6530 2023-10-18T21:47:01.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.676+0000 7fe1e19be700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc06a4c0 con 0x7fe1dc0f77d0 2023-10-18T21:47:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.677+0000 7fe1e09bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc0f6530 0x7fe1dc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.677+0000 7fe1e09bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc0f6530 0x7fe1dc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41410/0 (socket says 172.21.15.8:41410) 2023-10-18T21:47:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.677+0000 7fe1e09bc700 1 -- 172.21.15.8:0/2708939656 learned_addr learned my addr 172.21.15.8:0/2708939656 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.677+0000 7fe1dbfff700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1dc0f77d0 0x7fe1dc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.677+0000 7fe1e09bc700 1 -- 172.21.15.8:0/2708939656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1dc0f77d0 msgr2=0x7fe1dc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.677+0000 7fe1e09bc700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1dc0f77d0 0x7fe1dc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.677+0000 7fe1e09bc700 1 -- 172.21.15.8:0/2708939656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0005040 con 0x7fe1dc0f6530 2023-10-18T21:47:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.677+0000 7fe1e09bc700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc0f6530 0x7fe1dc06b9a0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fe1d0014040 tx=0x7fe1d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.677+0000 7fe1d97fa700 1 -- 172.21.15.8:0/2708939656 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d0019070 con 0x7fe1dc0f6530 2023-10-18T21:47:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.677+0000 7fe1d97fa700 1 -- 172.21.15.8:0/2708939656 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe1d001e420 con 0x7fe1dc0f6530 2023-10-18T21:47:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.678+0000 7fe1d97fa700 1 -- 172.21.15.8:0/2708939656 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d0014660 con 0x7fe1dc0f6530 2023-10-18T21:47:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.678+0000 7fe1e19be700 1 -- 172.21.15.8:0/2708939656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1dc06a740 con 0x7fe1dc0f6530 2023-10-18T21:47:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.678+0000 7fe1e19be700 1 -- 172.21.15.8:0/2708939656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1dc06ac20 con 0x7fe1dc0f6530 2023-10-18T21:47:01.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.679+0000 7fe1e19be700 1 -- 172.21.15.8:0/2708939656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1dc045ad0 con 0x7fe1dc0f6530 2023-10-18T21:47:01.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.680+0000 7fe1d97fa700 1 -- 172.21.15.8:0/2708939656 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe1d001e9e0 con 0x7fe1dc0f6530 2023-10-18T21:47:01.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.680+0000 7fe1d97fa700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1cc060f70 0x7fe1cc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:01.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.681+0000 7fe1d97fa700 1 -- 172.21.15.8:0/2708939656 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe1d007ddc0 con 0x7fe1dc0f6530 2023-10-18T21:47:01.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.681+0000 7fe1dbfff700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1cc060f70 0x7fe1cc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:01.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.681+0000 7fe1dbfff700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1cc060f70 0x7fe1cc063430 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fe1c8007fd0 tx=0x7fe1c800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:01.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.685+0000 7fe1d97fa700 1 -- 172.21.15.8:0/2708939656 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe1d0081030 con 0x7fe1dc0f6530 2023-10-18T21:47:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.886+0000 7fe1e19be700 1 -- 172.21.15.8:0/2708939656 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1dc0fed30 con 0x7fe1cc060f70 2023-10-18T21:47:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.888+0000 7fe1d97fa700 1 -- 172.21.15.8:0/2708939656 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe1dc0fed30 con 0x7fe1cc060f70 2023-10-18T21:47:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 -- 172.21.15.8:0/2708939656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1cc060f70 msgr2=0x7fe1cc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1cc060f70 0x7fe1cc063430 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fe1c8007fd0 tx=0x7fe1c800b040).stop 2023-10-18T21:47:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 -- 172.21.15.8:0/2708939656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc0f6530 msgr2=0x7fe1dc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc0f6530 0x7fe1dc06b9a0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fe1d0014040 tx=0x7fe1d000b040).stop 2023-10-18T21:47:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 -- 172.21.15.8:0/2708939656 shutdown_connections 2023-10-18T21:47:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe1cc060f70 0x7fe1cc063430 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc0f6530 0x7fe1dc06b9a0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 --2- 172.21.15.8:0/2708939656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1dc0f77d0 0x7fe1dc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 -- 172.21.15.8:0/2708939656 >> 172.21.15.8:0/2708939656 conn(0x7fe1dc0f1c90 msgr2=0x7fe1dc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 -- 172.21.15.8:0/2708939656 shutdown_connections 2023-10-18T21:47:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:01.890+0000 7fe1e19be700 1 -- 172.21.15.8:0/2708939656 wait complete. 2023-10-18T21:47:01.907 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:47:01.911 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:00.283973+0000 mgr.smithi008.flmjzp (mgr.14640) 2888 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:01.911 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:00.284496+0000 mgr.smithi008.flmjzp (mgr.14640) 2889 : cluster [DBG] pgmap v1990: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:01.912 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:00.284708+0000 mgr.smithi008.flmjzp (mgr.14640) 2890 : cluster [DBG] pgmap v1991: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:01.912 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:00.301876+0000 mgr.smithi008.flmjzp (mgr.14640) 2891 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:02.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.028+0000 7efd2b410700 1 -- 172.21.15.8:0/391812763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd240f6530 msgr2=0x7efd240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.028+0000 7efd2b410700 1 --2- 172.21.15.8:0/391812763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd240f6530 0x7efd240f6950 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7efd20004660 tx=0x7efd20009b30).stop 2023-10-18T21:47:02.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.028+0000 7efd2b410700 1 -- 172.21.15.8:0/391812763 shutdown_connections 2023-10-18T21:47:02.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.028+0000 7efd2b410700 1 --2- 172.21.15.8:0/391812763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240f77d0 0x7efd240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.028+0000 7efd2b410700 1 --2- 172.21.15.8:0/391812763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd240f6530 0x7efd240f6950 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.028+0000 7efd2b410700 1 -- 172.21.15.8:0/391812763 >> 172.21.15.8:0/391812763 conn(0x7efd240f1c90 msgr2=0x7efd240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:02.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.028+0000 7efd2b410700 1 -- 172.21.15.8:0/391812763 shutdown_connections 2023-10-18T21:47:02.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.028+0000 7efd2b410700 1 -- 172.21.15.8:0/391812763 wait complete. 2023-10-18T21:47:02.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.029+0000 7efd2b410700 1 Processor -- start 2023-10-18T21:47:02.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.029+0000 7efd2b410700 1 -- start start 2023-10-18T21:47:02.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.029+0000 7efd2b410700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd240f6530 0x7efd24106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:02.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.029+0000 7efd2b410700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240f77d0 0x7efd24107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:02.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.029+0000 7efd2b410700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd24107910 con 0x7efd240f6530 2023-10-18T21:47:02.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.029+0000 7efd2b410700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd24108120 con 0x7efd240f77d0 2023-10-18T21:47:02.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.029+0000 7efd2a40e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd240f6530 0x7efd24106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:02.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd2a40e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd240f6530 0x7efd24106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41420/0 (socket says 172.21.15.8:41420) 2023-10-18T21:47:02.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd2a40e700 1 -- 172.21.15.8:0/3335352839 learned_addr learned my addr 172.21.15.8:0/3335352839 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:02.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd29c0d700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240f77d0 0x7efd24107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:02.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd2a40e700 1 -- 172.21.15.8:0/3335352839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240f77d0 msgr2=0x7efd24107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd2a40e700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240f77d0 0x7efd24107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd2a40e700 1 -- 172.21.15.8:0/3335352839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd20005040 con 0x7efd240f6530 2023-10-18T21:47:02.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd2a40e700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd240f6530 0x7efd24106e20 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7efd20004e30 tx=0x7efd20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:02.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd1affd700 1 -- 172.21.15.8:0/3335352839 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd20018070 con 0x7efd240f6530 2023-10-18T21:47:02.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd1affd700 1 -- 172.21.15.8:0/3335352839 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efd20009630 con 0x7efd240f6530 2023-10-18T21:47:02.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd2b410700 1 -- 172.21.15.8:0/3335352839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd24108340 con 0x7efd240f6530 2023-10-18T21:47:02.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.030+0000 7efd1affd700 1 -- 172.21.15.8:0/3335352839 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2001c3c0 con 0x7efd240f6530 2023-10-18T21:47:02.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.031+0000 7efd2b410700 1 -- 172.21.15.8:0/3335352839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd241088a0 con 0x7efd240f6530 2023-10-18T21:47:02.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.032+0000 7efd2b410700 1 -- 172.21.15.8:0/3335352839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd24059100 con 0x7efd240f6530 2023-10-18T21:47:02.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.032+0000 7efd1affd700 1 -- 172.21.15.8:0/3335352839 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7efd2001d420 con 0x7efd240f6530 2023-10-18T21:47:02.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.033+0000 7efd1affd700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd10060f70 0x7efd10063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:02.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.033+0000 7efd1affd700 1 -- 172.21.15.8:0/3335352839 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7efd2007e480 con 0x7efd240f6530 2023-10-18T21:47:02.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.033+0000 7efd29c0d700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd10060f70 0x7efd10063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:02.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.034+0000 7efd29c0d700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd10060f70 0x7efd10063430 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7efd140096c0 tx=0x7efd14009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:02.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.037+0000 7efd1affd700 1 -- 172.21.15.8:0/3335352839 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efd2004e220 con 0x7efd240f6530 2023-10-18T21:47:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:00.283973+0000 mgr.smithi008.flmjzp (mgr.14640) 2888 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:00.284496+0000 mgr.smithi008.flmjzp (mgr.14640) 2889 : cluster [DBG] pgmap v1990: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:00.284708+0000 mgr.smithi008.flmjzp (mgr.14640) 2890 : cluster [DBG] pgmap v1991: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:00.301876+0000 mgr.smithi008.flmjzp (mgr.14640) 2891 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:02.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.236+0000 7efd2b410700 1 -- 172.21.15.8:0/3335352839 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd240fed30 con 0x7efd10060f70 2023-10-18T21:47:02.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.237+0000 7efd1affd700 1 -- 172.21.15.8:0/3335352839 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efd240fed30 con 0x7efd10060f70 2023-10-18T21:47:02.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.239+0000 7efd2b410700 1 -- 172.21.15.8:0/3335352839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd10060f70 msgr2=0x7efd10063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.239+0000 7efd2b410700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd10060f70 0x7efd10063430 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7efd140096c0 tx=0x7efd14009be0).stop 2023-10-18T21:47:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.239+0000 7efd2b410700 1 -- 172.21.15.8:0/3335352839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd240f6530 msgr2=0x7efd24106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.239+0000 7efd2b410700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd240f6530 0x7efd24106e20 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7efd20004e30 tx=0x7efd20009b30).stop 2023-10-18T21:47:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.239+0000 7efd2b410700 1 -- 172.21.15.8:0/3335352839 shutdown_connections 2023-10-18T21:47:02.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.239+0000 7efd2b410700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd10060f70 0x7efd10063430 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.239+0000 7efd2b410700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd240f6530 0x7efd24106e20 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.239+0000 7efd2b410700 1 --2- 172.21.15.8:0/3335352839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240f77d0 0x7efd24107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.239+0000 7efd2b410700 1 -- 172.21.15.8:0/3335352839 >> 172.21.15.8:0/3335352839 conn(0x7efd240f1c90 msgr2=0x7efd240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:02.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.239+0000 7efd2b410700 1 -- 172.21.15.8:0/3335352839 shutdown_connections 2023-10-18T21:47:02.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.240+0000 7efd2b410700 1 -- 172.21.15.8:0/3335352839 wait complete. 2023-10-18T21:47:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.376+0000 7f59750e2700 1 -- 172.21.15.8:0/1360159892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59700f77d0 msgr2=0x7f59700f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.376+0000 7f59750e2700 1 --2- 172.21.15.8:0/1360159892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59700f77d0 0x7f59700f7c30 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f5964004660 tx=0x7f5964009b30).stop 2023-10-18T21:47:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.376+0000 7f59750e2700 1 -- 172.21.15.8:0/1360159892 shutdown_connections 2023-10-18T21:47:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.376+0000 7f59750e2700 1 --2- 172.21.15.8:0/1360159892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59700f77d0 0x7f59700f7c30 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.376+0000 7f59750e2700 1 --2- 172.21.15.8:0/1360159892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59700f6530 0x7f59700f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.376+0000 7f59750e2700 1 -- 172.21.15.8:0/1360159892 >> 172.21.15.8:0/1360159892 conn(0x7f59700f1c90 msgr2=0x7f59700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.376+0000 7f59750e2700 1 -- 172.21.15.8:0/1360159892 shutdown_connections 2023-10-18T21:47:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.376+0000 7f59750e2700 1 -- 172.21.15.8:0/1360159892 wait complete. 2023-10-18T21:47:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.377+0000 7f59750e2700 1 Processor -- start 2023-10-18T21:47:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.377+0000 7f59750e2700 1 -- start start 2023-10-18T21:47:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.377+0000 7f59750e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59700f6530 0x7f5970106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:02.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.377+0000 7f59750e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59700f77d0 0x7f5970107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:02.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.377+0000 7f59750e2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5970107880 con 0x7f59700f77d0 2023-10-18T21:47:02.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.377+0000 7f59750e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59701080c0 con 0x7f59700f6530 2023-10-18T21:47:02.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.378+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59700f77d0 0x7f5970107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:02.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.378+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59700f77d0 0x7f5970107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41436/0 (socket says 172.21.15.8:41436) 2023-10-18T21:47:02.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.378+0000 7f596f7fe700 1 -- 172.21.15.8:0/1831689922 learned_addr learned my addr 172.21.15.8:0/1831689922 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:02.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.378+0000 7f596ffff700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59700f6530 0x7f5970106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:02.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.378+0000 7f596f7fe700 1 -- 172.21.15.8:0/1831689922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59700f6530 msgr2=0x7f5970106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.378+0000 7f596f7fe700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59700f6530 0x7f5970106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.378+0000 7f596f7fe700 1 -- 172.21.15.8:0/1831689922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5964005040 con 0x7f59700f77d0 2023-10-18T21:47:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.378+0000 7f596f7fe700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59700f77d0 0x7f5970107280 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f5964009f50 tx=0x7f5964009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.379+0000 7f596cff9700 1 -- 172.21.15.8:0/1831689922 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5964018070 con 0x7f59700f77d0 2023-10-18T21:47:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.379+0000 7f596cff9700 1 -- 172.21.15.8:0/1831689922 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5964009630 con 0x7f59700f77d0 2023-10-18T21:47:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.379+0000 7f596cff9700 1 -- 172.21.15.8:0/1831689922 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f596401c3c0 con 0x7f59700f77d0 2023-10-18T21:47:02.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.379+0000 7f59750e2700 1 -- 172.21.15.8:0/1831689922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5970108340 con 0x7f59700f77d0 2023-10-18T21:47:02.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.379+0000 7f59750e2700 1 -- 172.21.15.8:0/1831689922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5970108820 con 0x7f59700f77d0 2023-10-18T21:47:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.380+0000 7f59750e2700 1 -- 172.21.15.8:0/1831689922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5970059100 con 0x7f59700f77d0 2023-10-18T21:47:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.381+0000 7f596cff9700 1 -- 172.21.15.8:0/1831689922 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f596401d420 con 0x7f59700f77d0 2023-10-18T21:47:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.381+0000 7f596cff9700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5958060f70 0x7f5958063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.382+0000 7f596cff9700 1 -- 172.21.15.8:0/1831689922 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f596407e710 con 0x7f59700f77d0 2023-10-18T21:47:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.382+0000 7f596ffff700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5958060f70 0x7f5958063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.382+0000 7f596ffff700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5958060f70 0x7f5958063430 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f5970107b50 tx=0x7f5960009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:02.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.386+0000 7f596cff9700 1 -- 172.21.15.8:0/1831689922 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f596404e2c0 con 0x7f59700f77d0 2023-10-18T21:47:02.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.577+0000 7f59750e2700 1 -- 172.21.15.8:0/1831689922 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f59700fee50 con 0x7f5958060f70 2023-10-18T21:47:02.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.587+0000 7f596cff9700 1 -- 172.21.15.8:0/1831689922 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f59700fee50 con 0x7f5958060f70 2023-10-18T21:47:02.589 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:47:02.589 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (53m) 74s ago 55m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:47:02.589 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (47m) 74s ago 55m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:47:02.589 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (47m) 9m ago 54m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:47:02.590 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (53m) 74s ago 54m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:47:02.590 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 74s ago 51m - - 2023-10-18T21:47:02.590 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 74s ago 51m - - 2023-10-18T21:47:02.590 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 51m - - 2023-10-18T21:47:02.591 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 51m - - 2023-10-18T21:47:02.591 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (48m) 74s ago 56m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:47:02.591 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (48m) 9m ago 54m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:47:02.591 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (48m) 74s ago 56m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:47:02.591 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (47m) 9m ago 54m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:47:02.591 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (54m) 74s ago 54m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:47:02.592 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (53m) 9m ago 53m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:47:02.592 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (47m) 74s ago 53m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:47:02.592 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (45m) 74s ago 53m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:47:02.592 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (44m) 74s ago 53m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:47:02.592 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (44m) 9m ago 52m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:47:02.593 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (43m) 9m ago 52m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:47:02.593 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (43m) 9m ago 52m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:47:02.593 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (49m) 74s ago 54m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:47:02.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 -- 172.21.15.8:0/1831689922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5958060f70 msgr2=0x7f5958063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5958060f70 0x7f5958063430 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f5970107b50 tx=0x7f5960009c00).stop 2023-10-18T21:47:02.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 -- 172.21.15.8:0/1831689922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59700f77d0 msgr2=0x7f5970107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59700f77d0 0x7f5970107280 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f5964009f50 tx=0x7f5964009b30).stop 2023-10-18T21:47:02.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 -- 172.21.15.8:0/1831689922 shutdown_connections 2023-10-18T21:47:02.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5958060f70 0x7f5958063430 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59700f6530 0x7f5970106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 --2- 172.21.15.8:0/1831689922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59700f77d0 0x7f5970107280 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 -- 172.21.15.8:0/1831689922 >> 172.21.15.8:0/1831689922 conn(0x7f59700f1c90 msgr2=0x7f59700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:02.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 -- 172.21.15.8:0/1831689922 shutdown_connections 2023-10-18T21:47:02.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.589+0000 7f59750e2700 1 -- 172.21.15.8:0/1831689922 wait complete. 2023-10-18T21:47:02.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.724+0000 7f65c3529700 1 -- 172.21.15.8:0/3781558475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc0f77d0 msgr2=0x7f65bc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.724+0000 7f65c3529700 1 --2- 172.21.15.8:0/3781558475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc0f77d0 0x7f65bc0f7c30 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f65ac004660 tx=0x7f65ac009b30).stop 2023-10-18T21:47:02.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.725+0000 7f65c3529700 1 -- 172.21.15.8:0/3781558475 shutdown_connections 2023-10-18T21:47:02.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.725+0000 7f65c3529700 1 --2- 172.21.15.8:0/3781558475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc0f77d0 0x7f65bc0f7c30 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.725+0000 7f65c3529700 1 --2- 172.21.15.8:0/3781558475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0f6530 0x7f65bc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.725+0000 7f65c3529700 1 -- 172.21.15.8:0/3781558475 >> 172.21.15.8:0/3781558475 conn(0x7f65bc0f1c90 msgr2=0x7f65bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:02.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.725+0000 7f65c3529700 1 -- 172.21.15.8:0/3781558475 shutdown_connections 2023-10-18T21:47:02.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.725+0000 7f65c3529700 1 -- 172.21.15.8:0/3781558475 wait complete. 2023-10-18T21:47:02.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.726+0000 7f65c3529700 1 Processor -- start 2023-10-18T21:47:02.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.726+0000 7f65c3529700 1 -- start start 2023-10-18T21:47:02.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c3529700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc0f6530 0x7f65bc106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:02.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c3529700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0f77d0 0x7f65bc107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:02.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c3529700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc1077d0 con 0x7f65bc0f6530 2023-10-18T21:47:02.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c3529700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc107fd0 con 0x7f65bc0f77d0 2023-10-18T21:47:02.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c2527700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc0f6530 0x7f65bc106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:02.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c2527700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc0f6530 0x7f65bc106d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41444/0 (socket says 172.21.15.8:41444) 2023-10-18T21:47:02.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c2527700 1 -- 172.21.15.8:0/2841677058 learned_addr learned my addr 172.21.15.8:0/2841677058 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:02.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c1d26700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0f77d0 0x7f65bc107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:02.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c2527700 1 -- 172.21.15.8:0/2841677058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0f77d0 msgr2=0x7f65bc107220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c2527700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0f77d0 0x7f65bc107220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.727+0000 7f65c2527700 1 -- 172.21.15.8:0/2841677058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac005040 con 0x7f65bc0f6530 2023-10-18T21:47:02.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.728+0000 7f65c2527700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc0f6530 0x7f65bc106d30 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f65b800e7c0 tx=0x7f65b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:02.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.728+0000 7f65b2ffd700 1 -- 172.21.15.8:0/2841677058 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65b80092e0 con 0x7f65bc0f6530 2023-10-18T21:47:02.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.728+0000 7f65b2ffd700 1 -- 172.21.15.8:0/2841677058 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f65b800f040 con 0x7f65bc0f6530 2023-10-18T21:47:02.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.728+0000 7f65c3529700 1 -- 172.21.15.8:0/2841677058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc1082b0 con 0x7f65bc0f6530 2023-10-18T21:47:02.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.728+0000 7f65b2ffd700 1 -- 172.21.15.8:0/2841677058 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65b8014810 con 0x7f65bc0f6530 2023-10-18T21:47:02.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.728+0000 7f65c3529700 1 -- 172.21.15.8:0/2841677058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc1087f0 con 0x7f65bc0f6530 2023-10-18T21:47:02.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.729+0000 7f65c3529700 1 -- 172.21.15.8:0/2841677058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc059100 con 0x7f65bc0f6530 2023-10-18T21:47:02.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.730+0000 7f65b2ffd700 1 -- 172.21.15.8:0/2841677058 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f65b801b030 con 0x7f65bc0f6530 2023-10-18T21:47:02.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.731+0000 7f65b2ffd700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65a8060f70 0x7f65a8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:02.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.731+0000 7f65b2ffd700 1 -- 172.21.15.8:0/2841677058 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f65b807c920 con 0x7f65bc0f6530 2023-10-18T21:47:02.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.731+0000 7f65c1d26700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65a8060f70 0x7f65a8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:02.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.731+0000 7f65c1d26700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65a8060f70 0x7f65a8063430 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f65ac009720 tx=0x7f65ac016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:02.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.735+0000 7f65b2ffd700 1 -- 172.21.15.8:0/2841677058 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f65b804ff00 con 0x7f65bc0f6530 2023-10-18T21:47:02.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.988+0000 7f65c3529700 1 -- 172.21.15.8:0/2841677058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f65bc0008d0 con 0x7f65bc0f6530 2023-10-18T21:47:02.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.988+0000 7f65b2ffd700 1 -- 172.21.15.8:0/2841677058 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f65b8019070 con 0x7f65bc0f6530 2023-10-18T21:47:02.991 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:47:02.991 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:47:02.991 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:47:02.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:47:02.992 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:47:02.992 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:47:02.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:47:02.992 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:47:02.992 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:47:02.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:47:02.993 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:47:02.993 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:47:02.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:47:02.993 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:47:02.993 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:47:02.994 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:47:02.994 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:47:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 -- 172.21.15.8:0/2841677058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65a8060f70 msgr2=0x7f65a8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65a8060f70 0x7f65a8063430 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f65ac009720 tx=0x7f65ac016040).stop 2023-10-18T21:47:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 -- 172.21.15.8:0/2841677058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc0f6530 msgr2=0x7f65bc106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc0f6530 0x7f65bc106d30 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f65b800e7c0 tx=0x7f65b800b040).stop 2023-10-18T21:47:02.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 -- 172.21.15.8:0/2841677058 shutdown_connections 2023-10-18T21:47:02.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65a8060f70 0x7f65a8063430 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc0f6530 0x7f65bc106d30 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 --2- 172.21.15.8:0/2841677058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0f77d0 0x7f65bc107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:02.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 -- 172.21.15.8:0/2841677058 >> 172.21.15.8:0/2841677058 conn(0x7f65bc0f1c90 msgr2=0x7f65bc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:02.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 -- 172.21.15.8:0/2841677058 shutdown_connections 2023-10-18T21:47:02.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:02.990+0000 7f65c3529700 1 -- 172.21.15.8:0/2841677058 wait complete. 2023-10-18T21:47:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.126+0000 7f4a4df69700 1 -- 172.21.15.8:0/3242080304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a480f6530 msgr2=0x7f4a480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.126+0000 7f4a4df69700 1 --2- 172.21.15.8:0/3242080304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a480f6530 0x7f4a480f6950 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f4a3c004660 tx=0x7f4a3c009b30).stop 2023-10-18T21:47:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.127+0000 7f4a4df69700 1 -- 172.21.15.8:0/3242080304 shutdown_connections 2023-10-18T21:47:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.127+0000 7f4a4df69700 1 --2- 172.21.15.8:0/3242080304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a480f77d0 0x7f4a480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.127+0000 7f4a4df69700 1 --2- 172.21.15.8:0/3242080304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a480f6530 0x7f4a480f6950 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.127+0000 7f4a4df69700 1 -- 172.21.15.8:0/3242080304 >> 172.21.15.8:0/3242080304 conn(0x7f4a480f1c90 msgr2=0x7f4a480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.127+0000 7f4a4df69700 1 -- 172.21.15.8:0/3242080304 shutdown_connections 2023-10-18T21:47:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.127+0000 7f4a4df69700 1 -- 172.21.15.8:0/3242080304 wait complete. 2023-10-18T21:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.127+0000 7f4a4df69700 1 Processor -- start 2023-10-18T21:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.128+0000 7f4a4df69700 1 -- start start 2023-10-18T21:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.128+0000 7f4a4df69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a480f6530 0x7f4a48108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.128+0000 7f4a4df69700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a480f77d0 0x7f4a48109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.128+0000 7f4a4df69700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a481099f0 con 0x7f4a480f6530 2023-10-18T21:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.128+0000 7f4a4df69700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a48109b30 con 0x7f4a480f77d0 2023-10-18T21:47:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.128+0000 7f4a4cf67700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a480f6530 0x7f4a48108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.128+0000 7f4a4cf67700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a480f6530 0x7f4a48108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41460/0 (socket says 172.21.15.8:41460) 2023-10-18T21:47:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.128+0000 7f4a4cf67700 1 -- 172.21.15.8:0/2903422464 learned_addr learned my addr 172.21.15.8:0/2903422464 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a47fff700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a480f77d0 0x7f4a48109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a4cf67700 1 -- 172.21.15.8:0/2903422464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a480f77d0 msgr2=0x7f4a48109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a4cf67700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a480f77d0 0x7f4a48109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a4cf67700 1 -- 172.21.15.8:0/2903422464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c005040 con 0x7f4a480f6530 2023-10-18T21:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a47fff700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a480f77d0 0x7f4a48109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a4cf67700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a480f6530 0x7f4a48108f50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f4a3c009870 tx=0x7f4a3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a457fa700 1 -- 172.21.15.8:0/2903422464 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a3c019070 con 0x7f4a480f6530 2023-10-18T21:47:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a457fa700 1 -- 172.21.15.8:0/2903422464 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4a3c01e420 con 0x7f4a480f6530 2023-10-18T21:47:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a457fa700 1 -- 172.21.15.8:0/2903422464 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a3c014660 con 0x7f4a480f6530 2023-10-18T21:47:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a4df69700 1 -- 172.21.15.8:0/2903422464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4810a470 con 0x7f4a480f6530 2023-10-18T21:47:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.129+0000 7f4a4df69700 1 -- 172.21.15.8:0/2903422464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4810a950 con 0x7f4a480f6530 2023-10-18T21:47:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.130+0000 7f4a4df69700 1 -- 172.21.15.8:0/2903422464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a48045ad0 con 0x7f4a480f6530 2023-10-18T21:47:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.131+0000 7f4a457fa700 1 -- 172.21.15.8:0/2903422464 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4a3c01e9c0 con 0x7f4a480f6530 2023-10-18T21:47:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.132+0000 7f4a457fa700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a38060f70 0x7f4a38063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.132+0000 7f4a457fa700 1 -- 172.21.15.8:0/2903422464 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4a3c07de90 con 0x7f4a480f6530 2023-10-18T21:47:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.132+0000 7f4a47fff700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a38060f70 0x7f4a38063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.133+0000 7f4a47fff700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a38060f70 0x7f4a38063430 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f4a34009da0 tx=0x7f4a3400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.136+0000 7f4a457fa700 1 -- 172.21.15.8:0/2903422464 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4a3c051470 con 0x7f4a480f6530 2023-10-18T21:47:03.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:01.889006+0000 mgr.smithi008.flmjzp (mgr.14640) 2892 : audit [DBG] from='client.36424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:03.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:01.889006+0000 mgr.smithi008.flmjzp (mgr.14640) 2892 : audit [DBG] from='client.36424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:03.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.362+0000 7f4a4df69700 1 -- 172.21.15.8:0/2903422464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a480fc010 con 0x7f4a480f6530 2023-10-18T21:47:03.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.362+0000 7f4a457fa700 1 -- 172.21.15.8:0/2903422464 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f4a3c051060 con 0x7f4a480f6530 2023-10-18T21:47:03.365 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:47:03.365 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:47:03.365 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:47:03.365 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:47:03.366 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:47:03.366 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:47:03.366 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:47:03.366 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:47:03.366 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:47:03.367 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:47:03.367 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:47:03.367 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:47:03.367 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:47:03.368 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:47:03.368 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:47:03.368 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:47:03.368 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:47:03.368 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:47:03.369 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:47:03.369 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:47:03.369 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:47:03.369 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:47:03.369 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:47:03.369 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:47:03.370 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:47:03.370 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:47:03.370 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:47:03.370 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:47:03.370 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:47:03.371 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:47:03.371 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:47:03.371 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:47:03.371 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:47:03.371 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:47:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 -- 172.21.15.8:0/2903422464 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a38060f70 msgr2=0x7f4a38063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a38060f70 0x7f4a38063430 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f4a34009da0 tx=0x7f4a3400b040).stop 2023-10-18T21:47:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 -- 172.21.15.8:0/2903422464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a480f6530 msgr2=0x7f4a48108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a480f6530 0x7f4a48108f50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f4a3c009870 tx=0x7f4a3c00b040).stop 2023-10-18T21:47:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 -- 172.21.15.8:0/2903422464 shutdown_connections 2023-10-18T21:47:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4a38060f70 0x7f4a38063430 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a480f6530 0x7f4a48108f50 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 --2- 172.21.15.8:0/2903422464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a480f77d0 0x7f4a48109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 -- 172.21.15.8:0/2903422464 >> 172.21.15.8:0/2903422464 conn(0x7f4a480f1c90 msgr2=0x7f4a480f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 -- 172.21.15.8:0/2903422464 shutdown_connections 2023-10-18T21:47:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.365+0000 7f4a4df69700 1 -- 172.21.15.8:0/2903422464 wait complete. 2023-10-18T21:47:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:47:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.503+0000 7f8722120700 1 -- 172.21.15.8:0/3502076642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f871c0f77d0 msgr2=0x7f871c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.503+0000 7f8722120700 1 --2- 172.21.15.8:0/3502076642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f871c0f77d0 0x7f871c0f7c30 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f870c004660 tx=0x7f870c009b30).stop 2023-10-18T21:47:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.503+0000 7f8722120700 1 -- 172.21.15.8:0/3502076642 shutdown_connections 2023-10-18T21:47:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.503+0000 7f8722120700 1 --2- 172.21.15.8:0/3502076642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f871c0f77d0 0x7f871c0f7c30 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.503+0000 7f8722120700 1 --2- 172.21.15.8:0/3502076642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f871c0f6530 0x7f871c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.503+0000 7f8722120700 1 -- 172.21.15.8:0/3502076642 >> 172.21.15.8:0/3502076642 conn(0x7f871c0f1c90 msgr2=0x7f871c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.503+0000 7f8722120700 1 -- 172.21.15.8:0/3502076642 shutdown_connections 2023-10-18T21:47:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.503+0000 7f8722120700 1 -- 172.21.15.8:0/3502076642 wait complete. 2023-10-18T21:47:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.504+0000 7f8722120700 1 Processor -- start 2023-10-18T21:47:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.508+0000 7f8722120700 1 -- start start 2023-10-18T21:47:03.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.508+0000 7f8722120700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f871c0f6530 0x7f871c0ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:03.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.508+0000 7f8722120700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f871c0f77d0 0x7f871c0ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:03.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.508+0000 7f8722120700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c100440 con 0x7f871c0f6530 2023-10-18T21:47:03.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.508+0000 7f8722120700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c100580 con 0x7f871c0f77d0 2023-10-18T21:47:03.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.509+0000 7f872111e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f871c0f6530 0x7f871c0ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:03.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.509+0000 7f872091d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f871c0f77d0 0x7f871c0ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:03.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.509+0000 7f872111e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f871c0f6530 0x7f871c0ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41474/0 (socket says 172.21.15.8:41474) 2023-10-18T21:47:03.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.509+0000 7f872111e700 1 -- 172.21.15.8:0/1973321418 learned_addr learned my addr 172.21.15.8:0/1973321418 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:03.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.510+0000 7f872111e700 1 -- 172.21.15.8:0/1973321418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f871c0f77d0 msgr2=0x7f871c0ffe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:03.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.510+0000 7f872111e700 1 --2- 172.21.15.8:0/1973321418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f871c0f77d0 0x7f871c0ffe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.510+0000 7f872111e700 1 -- 172.21.15.8:0/1973321418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c005040 con 0x7f871c0f6530 2023-10-18T21:47:03.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.510+0000 7f872111e700 1 --2- 172.21.15.8:0/1973321418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f871c0f6530 0x7f871c0ff950 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f871800e7c0 tx=0x7f871800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:03.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.510+0000 7f8711ffb700 1 -- 172.21.15.8:0/1973321418 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87180092e0 con 0x7f871c0f6530 2023-10-18T21:47:03.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.510+0000 7f8711ffb700 1 -- 172.21.15.8:0/1973321418 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f871800f040 con 0x7f871c0f6530 2023-10-18T21:47:03.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.510+0000 7f8711ffb700 1 -- 172.21.15.8:0/1973321418 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8718014810 con 0x7f871c0f6530 2023-10-18T21:47:03.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.510+0000 7f8722120700 1 -- 172.21.15.8:0/1973321418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c100ef0 con 0x7f871c0f6530 2023-10-18T21:47:03.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.510+0000 7f8722120700 1 -- 172.21.15.8:0/1973321418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c101430 con 0x7f871c0f6530 2023-10-18T21:47:03.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.512+0000 7f8722120700 1 -- 172.21.15.8:0/1973321418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c045ad0 con 0x7f871c0f6530 2023-10-18T21:47:03.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.512+0000 7f8711ffb700 1 -- 172.21.15.8:0/1973321418 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f871801b030 con 0x7f871c0f6530 2023-10-18T21:47:03.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.513+0000 7f8711ffb700 1 --2- 172.21.15.8:0/1973321418 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8708060f70 0x7f8708063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:03.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.513+0000 7f8711ffb700 1 -- 172.21.15.8:0/1973321418 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f871807c880 con 0x7f871c0f6530 2023-10-18T21:47:03.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.513+0000 7f872091d700 1 --2- 172.21.15.8:0/1973321418 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8708060f70 0x7f8708063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:03.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.514+0000 7f872091d700 1 --2- 172.21.15.8:0/1973321418 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8708060f70 0x7f8708063430 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f870c005010 tx=0x7f870c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.517+0000 7f8711ffb700 1 -- 172.21.15.8:0/1973321418 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f871804c430 con 0x7f871c0f6530 2023-10-18T21:47:03.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.721+0000 7f8722120700 1 -- 172.21.15.8:0/1973321418 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f871c0fee00 con 0x7f8708060f70 2023-10-18T21:47:03.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.722+0000 7f8711ffb700 1 -- 172.21.15.8:0/1973321418 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f871c0fee00 con 0x7f8708060f70 2023-10-18T21:47:03.724 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:47:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:47:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:47:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:47:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:47:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:47:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:47:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:47:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:47:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:47:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:47:03.727 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:47:03.727 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:47:03.727 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:47:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.724+0000 7f8722120700 1 -- 172.21.15.8:0/1973321418 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8708060f70 msgr2=0x7f8708063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.724+0000 7f8722120700 1 --2- 172.21.15.8:0/1973321418 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8708060f70 0x7f8708063430 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f870c005010 tx=0x7f870c016040).stop 2023-10-18T21:47:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.724+0000 7f8722120700 1 -- 172.21.15.8:0/1973321418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f871c0f6530 msgr2=0x7f871c0ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.724+0000 7f8722120700 1 --2- 172.21.15.8:0/1973321418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f871c0f6530 0x7f871c0ff950 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f871800e7c0 tx=0x7f871800b040).stop 2023-10-18T21:47:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.724+0000 7f8722120700 1 -- 172.21.15.8:0/1973321418 shutdown_connections 2023-10-18T21:47:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.724+0000 7f8722120700 1 --2- 172.21.15.8:0/1973321418 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8708060f70 0x7f8708063430 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.724+0000 7f8722120700 1 --2- 172.21.15.8:0/1973321418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f871c0f6530 0x7f871c0ff950 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.724+0000 7f8722120700 1 --2- 172.21.15.8:0/1973321418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f871c0f77d0 0x7f871c0ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.724+0000 7f8722120700 1 -- 172.21.15.8:0/1973321418 >> 172.21.15.8:0/1973321418 conn(0x7f871c0f1c90 msgr2=0x7f871c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.724+0000 7f8722120700 1 -- 172.21.15.8:0/1973321418 shutdown_connections 2023-10-18T21:47:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:03.725+0000 7f8722120700 1 -- 172.21.15.8:0/1973321418 wait complete. 2023-10-18T21:47:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:02.238737+0000 mgr.smithi008.flmjzp (mgr.14640) 2893 : audit [DBG] from='client.36428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:02.285085+0000 mgr.smithi008.flmjzp (mgr.14640) 2894 : cluster [DBG] pgmap v1992: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:02.579757+0000 mgr.smithi008.flmjzp (mgr.14640) 2895 : audit [DBG] from='client.36432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:02.989782+0000 mon.smithi008 (mon.0) 3284 : audit [DBG] from='client.? 172.21.15.8:0/2841677058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:03.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:03.364053+0000 mon.smithi008 (mon.0) 3285 : audit [DBG] from='client.? 172.21.15.8:0/2903422464' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:47:04.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:02.238737+0000 mgr.smithi008.flmjzp (mgr.14640) 2893 : audit [DBG] from='client.36428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:02.285085+0000 mgr.smithi008.flmjzp (mgr.14640) 2894 : cluster [DBG] pgmap v1992: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:02.579757+0000 mgr.smithi008.flmjzp (mgr.14640) 2895 : audit [DBG] from='client.36432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:02.989782+0000 mon.smithi008 (mon.0) 3284 : audit [DBG] from='client.? 172.21.15.8:0/2841677058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:03.364053+0000 mon.smithi008 (mon.0) 3285 : audit [DBG] from='client.? 172.21.15.8:0/2903422464' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:47:05.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:03.723744+0000 mgr.smithi008.flmjzp (mgr.14640) 2896 : audit [DBG] from='client.36444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:05.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:03.723744+0000 mgr.smithi008.flmjzp (mgr.14640) 2896 : audit [DBG] from='client.36444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:04.285557+0000 mgr.smithi008.flmjzp (mgr.14640) 2897 : cluster [DBG] pgmap v1993: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:06.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:04.285557+0000 mgr.smithi008.flmjzp (mgr.14640) 2897 : cluster [DBG] pgmap v1993: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:06.286266+0000 mgr.smithi008.flmjzp (mgr.14640) 2898 : cluster [DBG] pgmap v1994: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:08.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:06.286266+0000 mgr.smithi008.flmjzp (mgr.14640) 2898 : cluster [DBG] pgmap v1994: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:10.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:08.286892+0000 mgr.smithi008.flmjzp (mgr.14640) 2899 : cluster [DBG] pgmap v1995: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:10.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:08.286892+0000 mgr.smithi008.flmjzp (mgr.14640) 2899 : cluster [DBG] pgmap v1995: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:10.309403+0000 mon.smithi008 (mon.0) 3286 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:10.311612+0000 mon.smithi008 (mon.0) 3287 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:10.312574+0000 mon.smithi008 (mon.0) 3288 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:10.318815+0000 mon.smithi008 (mon.0) 3289 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:10.325378+0000 mon.smithi008 (mon.0) 3290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:10.328464+0000 mon.smithi008 (mon.0) 3291 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:11.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:10.330286+0000 mon.smithi008 (mon.0) 3292 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:11.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:10.331986+0000 mon.smithi008 (mon.0) 3293 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:11.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:10.334044+0000 mon.smithi008 (mon.0) 3294 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:11.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:10.309403+0000 mon.smithi008 (mon.0) 3286 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:11.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:10.311612+0000 mon.smithi008 (mon.0) 3287 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:11.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:10.312574+0000 mon.smithi008 (mon.0) 3288 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:11.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:10.318815+0000 mon.smithi008 (mon.0) 3289 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:11.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:10.325378+0000 mon.smithi008 (mon.0) 3290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:11.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:10.328464+0000 mon.smithi008 (mon.0) 3291 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:11.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:10.330286+0000 mon.smithi008 (mon.0) 3292 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:11.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:10.331986+0000 mon.smithi008 (mon.0) 3293 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:11.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:10.334044+0000 mon.smithi008 (mon.0) 3294 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:10.287670+0000 mgr.smithi008.flmjzp (mgr.14640) 2900 : cluster [DBG] pgmap v1996: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:10.313415+0000 mgr.smithi008.flmjzp (mgr.14640) 2901 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:10.313985+0000 mgr.smithi008.flmjzp (mgr.14640) 2902 : cluster [DBG] pgmap v1997: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:12.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:10.314341+0000 mgr.smithi008.flmjzp (mgr.14640) 2903 : cluster [DBG] pgmap v1998: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:12.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:10.335958+0000 mgr.smithi008.flmjzp (mgr.14640) 2904 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:10.287670+0000 mgr.smithi008.flmjzp (mgr.14640) 2900 : cluster [DBG] pgmap v1996: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:10.313415+0000 mgr.smithi008.flmjzp (mgr.14640) 2901 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:10.313985+0000 mgr.smithi008.flmjzp (mgr.14640) 2902 : cluster [DBG] pgmap v1997: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:10.314341+0000 mgr.smithi008.flmjzp (mgr.14640) 2903 : cluster [DBG] pgmap v1998: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:10.335958+0000 mgr.smithi008.flmjzp (mgr.14640) 2904 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:12.314810+0000 mgr.smithi008.flmjzp (mgr.14640) 2905 : cluster [DBG] pgmap v1999: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:14.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:12.314810+0000 mgr.smithi008.flmjzp (mgr.14640) 2905 : cluster [DBG] pgmap v1999: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:14.315410+0000 mgr.smithi008.flmjzp (mgr.14640) 2906 : cluster [DBG] pgmap v2000: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:16.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:14.315410+0000 mgr.smithi008.flmjzp (mgr.14640) 2906 : cluster [DBG] pgmap v2000: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:18.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:16.315966+0000 mgr.smithi008.flmjzp (mgr.14640) 2907 : cluster [DBG] pgmap v2001: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:18.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:16.315966+0000 mgr.smithi008.flmjzp (mgr.14640) 2907 : cluster [DBG] pgmap v2001: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:20.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:18.316677+0000 mgr.smithi008.flmjzp (mgr.14640) 2908 : cluster [DBG] pgmap v2002: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:18.316677+0000 mgr.smithi008.flmjzp (mgr.14640) 2908 : cluster [DBG] pgmap v2002: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:21.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:20.345732+0000 mon.smithi008 (mon.0) 3295 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:21.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:20.345732+0000 mon.smithi008 (mon.0) 3295 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:22.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:20.317228+0000 mgr.smithi008.flmjzp (mgr.14640) 2909 : cluster [DBG] pgmap v2003: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:20.912333+0000 mon.smithi008 (mon.0) 3296 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:20.913488+0000 mon.smithi008 (mon.0) 3297 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:20.914442+0000 mgr.smithi008.flmjzp (mgr.14640) 2910 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:20.915156+0000 mgr.smithi008.flmjzp (mgr.14640) 2911 : cluster [DBG] pgmap v2004: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:20.915462+0000 mgr.smithi008.flmjzp (mgr.14640) 2912 : cluster [DBG] pgmap v2005: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:20.919958+0000 mon.smithi008 (mon.0) 3298 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:20.926354+0000 mon.smithi008 (mon.0) 3299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:20.929395+0000 mon.smithi008 (mon.0) 3300 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:20.931058+0000 mon.smithi008 (mon.0) 3301 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:20.932619+0000 mon.smithi008 (mon.0) 3302 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:22.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:20.934549+0000 mon.smithi008 (mon.0) 3303 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:22.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:20.936358+0000 mgr.smithi008.flmjzp (mgr.14640) 2913 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:22.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:20.317228+0000 mgr.smithi008.flmjzp (mgr.14640) 2909 : cluster [DBG] pgmap v2003: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:20.912333+0000 mon.smithi008 (mon.0) 3296 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:20.913488+0000 mon.smithi008 (mon.0) 3297 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:20.914442+0000 mgr.smithi008.flmjzp (mgr.14640) 2910 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:20.915156+0000 mgr.smithi008.flmjzp (mgr.14640) 2911 : cluster [DBG] pgmap v2004: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:20.915462+0000 mgr.smithi008.flmjzp (mgr.14640) 2912 : cluster [DBG] pgmap v2005: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:20.919958+0000 mon.smithi008 (mon.0) 3298 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:20.926354+0000 mon.smithi008 (mon.0) 3299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:20.929395+0000 mon.smithi008 (mon.0) 3300 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:20.931058+0000 mon.smithi008 (mon.0) 3301 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:20.932619+0000 mon.smithi008 (mon.0) 3302 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:20.934549+0000 mon.smithi008 (mon.0) 3303 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:22.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:20.936358+0000 mgr.smithi008.flmjzp (mgr.14640) 2913 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:22.915983+0000 mgr.smithi008.flmjzp (mgr.14640) 2914 : cluster [DBG] pgmap v2006: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:24.313 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:22.915983+0000 mgr.smithi008.flmjzp (mgr.14640) 2914 : cluster [DBG] pgmap v2006: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:26.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:24.916579+0000 mgr.smithi008.flmjzp (mgr.14640) 2915 : cluster [DBG] pgmap v2007: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:24.916579+0000 mgr.smithi008.flmjzp (mgr.14640) 2915 : cluster [DBG] pgmap v2007: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:26.917205+0000 mgr.smithi008.flmjzp (mgr.14640) 2916 : cluster [DBG] pgmap v2008: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:28.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:26.917205+0000 mgr.smithi008.flmjzp (mgr.14640) 2916 : cluster [DBG] pgmap v2008: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:28.917802+0000 mgr.smithi008.flmjzp (mgr.14640) 2917 : cluster [DBG] pgmap v2009: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:28.917802+0000 mgr.smithi008.flmjzp (mgr.14640) 2917 : cluster [DBG] pgmap v2009: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:30.918507+0000 mgr.smithi008.flmjzp (mgr.14640) 2918 : cluster [DBG] pgmap v2010: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:30.943693+0000 mon.smithi008 (mon.0) 3304 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:30.945816+0000 mon.smithi008 (mon.0) 3305 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:30.946880+0000 mon.smithi008 (mon.0) 3306 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:30.947831+0000 mgr.smithi008.flmjzp (mgr.14640) 2919 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:30.948417+0000 mgr.smithi008.flmjzp (mgr.14640) 2920 : cluster [DBG] pgmap v2011: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:31.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:30.948718+0000 mgr.smithi008.flmjzp (mgr.14640) 2921 : cluster [DBG] pgmap v2012: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:31.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:30.953326+0000 mon.smithi008 (mon.0) 3307 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:31.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:30.959715+0000 mon.smithi008 (mon.0) 3308 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:31.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:30.962751+0000 mon.smithi008 (mon.0) 3309 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:31.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:30.964486+0000 mon.smithi008 (mon.0) 3310 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:31.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:30.966132+0000 mon.smithi008 (mon.0) 3311 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:31.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:30.968132+0000 mon.smithi008 (mon.0) 3312 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:31.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:30.969999+0000 mgr.smithi008.flmjzp (mgr.14640) 2922 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:30.918507+0000 mgr.smithi008.flmjzp (mgr.14640) 2918 : cluster [DBG] pgmap v2010: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:30.943693+0000 mon.smithi008 (mon.0) 3304 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:30.945816+0000 mon.smithi008 (mon.0) 3305 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:30.946880+0000 mon.smithi008 (mon.0) 3306 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:30.947831+0000 mgr.smithi008.flmjzp (mgr.14640) 2919 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:30.948417+0000 mgr.smithi008.flmjzp (mgr.14640) 2920 : cluster [DBG] pgmap v2011: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:30.948718+0000 mgr.smithi008.flmjzp (mgr.14640) 2921 : cluster [DBG] pgmap v2012: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:30.953326+0000 mon.smithi008 (mon.0) 3307 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:30.959715+0000 mon.smithi008 (mon.0) 3308 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:30.962751+0000 mon.smithi008 (mon.0) 3309 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:30.964486+0000 mon.smithi008 (mon.0) 3310 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:32.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:30.966132+0000 mon.smithi008 (mon.0) 3311 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:32.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:30.968132+0000 mon.smithi008 (mon.0) 3312 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:32.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:30.969999+0000 mgr.smithi008.flmjzp (mgr.14640) 2922 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.883+0000 7f808e7e7700 1 -- 172.21.15.8:0/26217187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f808806b9c0 msgr2=0x7f8088069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.883+0000 7f808e7e7700 1 --2- 172.21.15.8:0/26217187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f808806b9c0 0x7f8088069ec0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f8084004660 tx=0x7f8084009b30).stop 2023-10-18T21:47:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.883+0000 7f808e7e7700 1 -- 172.21.15.8:0/26217187 shutdown_connections 2023-10-18T21:47:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.883+0000 7f808e7e7700 1 --2- 172.21.15.8:0/26217187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808806a3b0 0x7f808806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.883+0000 7f808e7e7700 1 --2- 172.21.15.8:0/26217187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f808806b9c0 0x7f8088069ec0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.883+0000 7f808e7e7700 1 -- 172.21.15.8:0/26217187 >> 172.21.15.8:0/26217187 conn(0x7f80880f1c90 msgr2=0x7f80880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.883+0000 7f808e7e7700 1 -- 172.21.15.8:0/26217187 shutdown_connections 2023-10-18T21:47:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.883+0000 7f808e7e7700 1 -- 172.21.15.8:0/26217187 wait complete. 2023-10-18T21:47:33.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.884+0000 7f808e7e7700 1 Processor -- start 2023-10-18T21:47:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.885+0000 7f808e7e7700 1 -- start start 2023-10-18T21:47:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.885+0000 7f808e7e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f808806a3b0 0x7f8088108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.885+0000 7f808e7e7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808806b9c0 0x7f80881094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.885+0000 7f808e7e7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8088109a50 con 0x7f808806a3b0 2023-10-18T21:47:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.885+0000 7f808e7e7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8088109b90 con 0x7f808806b9c0 2023-10-18T21:47:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.885+0000 7f808d7e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f808806a3b0 0x7f8088108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.885+0000 7f808d7e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f808806a3b0 0x7f8088108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54814/0 (socket says 172.21.15.8:54814) 2023-10-18T21:47:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.885+0000 7f808d7e5700 1 -- 172.21.15.8:0/2349572198 learned_addr learned my addr 172.21.15.8:0/2349572198 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.886+0000 7f808cfe4700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808806b9c0 0x7f80881094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.886+0000 7f808d7e5700 1 -- 172.21.15.8:0/2349572198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808806b9c0 msgr2=0x7f80881094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.886+0000 7f808d7e5700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808806b9c0 0x7f80881094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.886+0000 7f808d7e5700 1 -- 172.21.15.8:0/2349572198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8084005040 con 0x7f808806a3b0 2023-10-18T21:47:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.886+0000 7f808d7e5700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f808806a3b0 0x7f8088108fb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f8084009990 tx=0x7f8084009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.886+0000 7f807dffb700 1 -- 172.21.15.8:0/2349572198 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8084018070 con 0x7f808806a3b0 2023-10-18T21:47:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.886+0000 7f807dffb700 1 -- 172.21.15.8:0/2349572198 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8084009630 con 0x7f808806a3b0 2023-10-18T21:47:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.886+0000 7f808e7e7700 1 -- 172.21.15.8:0/2349572198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808810a4d0 con 0x7f808806a3b0 2023-10-18T21:47:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.886+0000 7f807dffb700 1 -- 172.21.15.8:0/2349572198 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f808401c3c0 con 0x7f808806a3b0 2023-10-18T21:47:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.887+0000 7f808e7e7700 1 -- 172.21.15.8:0/2349572198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808810aa30 con 0x7f808806a3b0 2023-10-18T21:47:33.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.888+0000 7f808e7e7700 1 -- 172.21.15.8:0/2349572198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8088045ad0 con 0x7f808806a3b0 2023-10-18T21:47:33.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.888+0000 7f807dffb700 1 -- 172.21.15.8:0/2349572198 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f808401d970 con 0x7f808806a3b0 2023-10-18T21:47:33.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.889+0000 7f807dffb700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8074060f70 0x7f8074063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:33.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.889+0000 7f807dffb700 1 -- 172.21.15.8:0/2349572198 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f808407e4c0 con 0x7f808806a3b0 2023-10-18T21:47:33.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.890+0000 7f808cfe4700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8074060f70 0x7f8074063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:33.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.890+0000 7f808cfe4700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8074060f70 0x7f8074063430 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f8078004c40 tx=0x7f807800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:33.894+0000 7f807dffb700 1 -- 172.21.15.8:0/2349572198 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8084051be0 con 0x7f808806a3b0 2023-10-18T21:47:34.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.100+0000 7f808e7e7700 1 -- 172.21.15.8:0/2349572198 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8088101030 con 0x7f8074060f70 2023-10-18T21:47:34.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.102+0000 7f807dffb700 1 -- 172.21.15.8:0/2349572198 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8088101030 con 0x7f8074060f70 2023-10-18T21:47:34.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.103+0000 7f808e7e7700 1 -- 172.21.15.8:0/2349572198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8074060f70 msgr2=0x7f8074063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.103+0000 7f808e7e7700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8074060f70 0x7f8074063430 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f8078004c40 tx=0x7f807800b040).stop 2023-10-18T21:47:34.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.103+0000 7f808e7e7700 1 -- 172.21.15.8:0/2349572198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f808806a3b0 msgr2=0x7f8088108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.103+0000 7f808e7e7700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f808806a3b0 0x7f8088108fb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f8084009990 tx=0x7f8084009b30).stop 2023-10-18T21:47:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.104+0000 7f808e7e7700 1 -- 172.21.15.8:0/2349572198 shutdown_connections 2023-10-18T21:47:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.104+0000 7f808e7e7700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8074060f70 0x7f8074063430 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.104+0000 7f808e7e7700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f808806a3b0 0x7f8088108fb0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.104+0000 7f808e7e7700 1 --2- 172.21.15.8:0/2349572198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808806b9c0 0x7f80881094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.104+0000 7f808e7e7700 1 -- 172.21.15.8:0/2349572198 >> 172.21.15.8:0/2349572198 conn(0x7f80880f1c90 msgr2=0x7f80880fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:34.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.104+0000 7f808e7e7700 1 -- 172.21.15.8:0/2349572198 shutdown_connections 2023-10-18T21:47:34.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.104+0000 7f808e7e7700 1 -- 172.21.15.8:0/2349572198 wait complete. 2023-10-18T21:47:34.119 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:47:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:32.949289+0000 mgr.smithi008.flmjzp (mgr.14640) 2923 : cluster [DBG] pgmap v2013: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:34.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.242+0000 7f32e3fff700 1 -- 172.21.15.8:0/338645593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32e40f77d0 msgr2=0x7f32e40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.242+0000 7f32e3fff700 1 --2- 172.21.15.8:0/338645593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32e40f77d0 0x7f32e40f7c30 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f32d8004660 tx=0x7f32d8009b30).stop 2023-10-18T21:47:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.242+0000 7f32e3fff700 1 -- 172.21.15.8:0/338645593 shutdown_connections 2023-10-18T21:47:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.242+0000 7f32e3fff700 1 --2- 172.21.15.8:0/338645593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32e40f77d0 0x7f32e40f7c30 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.242+0000 7f32e3fff700 1 --2- 172.21.15.8:0/338645593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e40f6530 0x7f32e40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.242+0000 7f32e3fff700 1 -- 172.21.15.8:0/338645593 >> 172.21.15.8:0/338645593 conn(0x7f32e40f1c90 msgr2=0x7f32e40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.242+0000 7f32e3fff700 1 -- 172.21.15.8:0/338645593 shutdown_connections 2023-10-18T21:47:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.242+0000 7f32e3fff700 1 -- 172.21.15.8:0/338645593 wait complete. 2023-10-18T21:47:34.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.243+0000 7f32e3fff700 1 Processor -- start 2023-10-18T21:47:34.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.244+0000 7f32e3fff700 1 -- start start 2023-10-18T21:47:34.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.244+0000 7f32e3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32e40f6530 0x7f32e406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:34.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.244+0000 7f32e3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e40f77d0 0x7f32e4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:34.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.244+0000 7f32e3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e406a380 con 0x7f32e40f6530 2023-10-18T21:47:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.244+0000 7f32e3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e406a4c0 con 0x7f32e40f77d0 2023-10-18T21:47:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.244+0000 7f32e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32e40f6530 0x7f32e406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.244+0000 7f32e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32e40f6530 0x7f32e406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54834/0 (socket says 172.21.15.8:54834) 2023-10-18T21:47:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.244+0000 7f32e2ffd700 1 -- 172.21.15.8:0/3501829607 learned_addr learned my addr 172.21.15.8:0/3501829607 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.245+0000 7f32e27fc700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e40f77d0 0x7f32e4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.245+0000 7f32e2ffd700 1 -- 172.21.15.8:0/3501829607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e40f77d0 msgr2=0x7f32e4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.245+0000 7f32e2ffd700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e40f77d0 0x7f32e4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.245+0000 7f32e2ffd700 1 -- 172.21.15.8:0/3501829607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d8005040 con 0x7f32e40f6530 2023-10-18T21:47:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.245+0000 7f32e2ffd700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32e40f6530 0x7f32e406b9a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f32d4002700 tx=0x7f32d4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.245+0000 7f32cb7fe700 1 -- 172.21.15.8:0/3501829607 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32d40079c0 con 0x7f32e40f6530 2023-10-18T21:47:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.245+0000 7f32cb7fe700 1 -- 172.21.15.8:0/3501829607 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f32d400f040 con 0x7f32e40f6530 2023-10-18T21:47:34.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.245+0000 7f32cb7fe700 1 -- 172.21.15.8:0/3501829607 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32d40148d0 con 0x7f32e40f6530 2023-10-18T21:47:34.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.245+0000 7f32e3fff700 1 -- 172.21.15.8:0/3501829607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e406a7a0 con 0x7f32e40f6530 2023-10-18T21:47:34.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.246+0000 7f32e3fff700 1 -- 172.21.15.8:0/3501829607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e410ed70 con 0x7f32e40f6530 2023-10-18T21:47:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.247+0000 7f32e3fff700 1 -- 172.21.15.8:0/3501829607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e4045ad0 con 0x7f32e40f6530 2023-10-18T21:47:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.247+0000 7f32cb7fe700 1 -- 172.21.15.8:0/3501829607 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f32d401b060 con 0x7f32e40f6530 2023-10-18T21:47:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.248+0000 7f32cb7fe700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32cc060f70 0x7f32cc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.248+0000 7f32cb7fe700 1 -- 172.21.15.8:0/3501829607 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f32d407c6b0 con 0x7f32e40f6530 2023-10-18T21:47:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.249+0000 7f32e27fc700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32cc060f70 0x7f32cc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.249+0000 7f32e27fc700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32cc060f70 0x7f32cc063430 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f32d8004630 tx=0x7f32d8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.252+0000 7f32cb7fe700 1 -- 172.21.15.8:0/3501829607 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f32d404c3a0 con 0x7f32e40f6530 2023-10-18T21:47:34.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.454+0000 7f32e3fff700 1 -- 172.21.15.8:0/3501829607 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32e40fee30 con 0x7f32cc060f70 2023-10-18T21:47:34.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.455+0000 7f32cb7fe700 1 -- 172.21.15.8:0/3501829607 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f32e40fee30 con 0x7f32cc060f70 2023-10-18T21:47:34.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 -- 172.21.15.8:0/3501829607 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32cc060f70 msgr2=0x7f32cc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32cc060f70 0x7f32cc063430 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f32d8004630 tx=0x7f32d8009b30).stop 2023-10-18T21:47:34.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 -- 172.21.15.8:0/3501829607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32e40f6530 msgr2=0x7f32e406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32e40f6530 0x7f32e406b9a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f32d4002700 tx=0x7f32d4009d80).stop 2023-10-18T21:47:34.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 -- 172.21.15.8:0/3501829607 shutdown_connections 2023-10-18T21:47:34.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32cc060f70 0x7f32cc063430 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32e40f6530 0x7f32e406b9a0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 --2- 172.21.15.8:0/3501829607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e40f77d0 0x7f32e4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 -- 172.21.15.8:0/3501829607 >> 172.21.15.8:0/3501829607 conn(0x7f32e40f1c90 msgr2=0x7f32e40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:34.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 -- 172.21.15.8:0/3501829607 shutdown_connections 2023-10-18T21:47:34.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.457+0000 7f32e3fff700 1 -- 172.21.15.8:0/3501829607 wait complete. 2023-10-18T21:47:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:32.949289+0000 mgr.smithi008.flmjzp (mgr.14640) 2923 : cluster [DBG] pgmap v2013: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:34.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.595+0000 7fd06e5b2700 1 -- 172.21.15.8:0/467249956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd068060310 msgr2=0x7fd0680f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.595+0000 7fd06e5b2700 1 --2- 172.21.15.8:0/467249956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd068060310 0x7fd0680f9110 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fd064004660 tx=0x7fd064009b30).stop 2023-10-18T21:47:34.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.595+0000 7fd06e5b2700 1 -- 172.21.15.8:0/467249956 shutdown_connections 2023-10-18T21:47:34.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.595+0000 7fd06e5b2700 1 --2- 172.21.15.8:0/467249956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680f9690 0x7fd0680fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.595+0000 7fd06e5b2700 1 --2- 172.21.15.8:0/467249956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd068060310 0x7fd0680f9110 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.595+0000 7fd06e5b2700 1 -- 172.21.15.8:0/467249956 >> 172.21.15.8:0/467249956 conn(0x7fd0680f0b90 msgr2=0x7fd0680f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:34.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.595+0000 7fd06e5b2700 1 -- 172.21.15.8:0/467249956 shutdown_connections 2023-10-18T21:47:34.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.595+0000 7fd06e5b2700 1 -- 172.21.15.8:0/467249956 wait complete. 2023-10-18T21:47:34.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.596+0000 7fd06e5b2700 1 Processor -- start 2023-10-18T21:47:34.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.596+0000 7fd06e5b2700 1 -- start start 2023-10-18T21:47:34.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06e5b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd068060310 0x7fd068106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:34.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06e5b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680f9690 0x7fd068107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:34.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06e5b2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd068107850 con 0x7fd068060310 2023-10-18T21:47:34.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06e5b2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd068108060 con 0x7fd0680f9690 2023-10-18T21:47:34.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06d5b0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd068060310 0x7fd068106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:34.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06d5b0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd068060310 0x7fd068106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54838/0 (socket says 172.21.15.8:54838) 2023-10-18T21:47:34.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06d5b0700 1 -- 172.21.15.8:0/2238696302 learned_addr learned my addr 172.21.15.8:0/2238696302 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:34.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06cdaf700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680f9690 0x7fd068107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:34.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06d5b0700 1 -- 172.21.15.8:0/2238696302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680f9690 msgr2=0x7fd068107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06d5b0700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680f9690 0x7fd068107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06d5b0700 1 -- 172.21.15.8:0/2238696302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd064005040 con 0x7fd068060310 2023-10-18T21:47:34.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.597+0000 7fd06d5b0700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd068060310 0x7fd068106d60 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fd064004d80 tx=0x7fd06400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:34.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.598+0000 7fd05dffb700 1 -- 172.21.15.8:0/2238696302 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd064019070 con 0x7fd068060310 2023-10-18T21:47:34.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.598+0000 7fd05dffb700 1 -- 172.21.15.8:0/2238696302 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd06401e420 con 0x7fd068060310 2023-10-18T21:47:34.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.598+0000 7fd05dffb700 1 -- 172.21.15.8:0/2238696302 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd064014680 con 0x7fd068060310 2023-10-18T21:47:34.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.598+0000 7fd06e5b2700 1 -- 172.21.15.8:0/2238696302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd068108280 con 0x7fd068060310 2023-10-18T21:47:34.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.598+0000 7fd06e5b2700 1 -- 172.21.15.8:0/2238696302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd068108760 con 0x7fd068060310 2023-10-18T21:47:34.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.599+0000 7fd06e5b2700 1 -- 172.21.15.8:0/2238696302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd068059100 con 0x7fd068060310 2023-10-18T21:47:34.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.600+0000 7fd05dffb700 1 -- 172.21.15.8:0/2238696302 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd06401e9c0 con 0x7fd068060310 2023-10-18T21:47:34.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.600+0000 7fd05dffb700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd054060f70 0x7fd054063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:34.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.601+0000 7fd05dffb700 1 -- 172.21.15.8:0/2238696302 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd06407dd20 con 0x7fd068060310 2023-10-18T21:47:34.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.601+0000 7fd06cdaf700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd054060f70 0x7fd054063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:34.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.601+0000 7fd06cdaf700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd054060f70 0x7fd054063430 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fd0680600e0 tx=0x7fd05800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:34.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.605+0000 7fd05dffb700 1 -- 172.21.15.8:0/2238696302 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd06404da10 con 0x7fd068060310 2023-10-18T21:47:34.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.797+0000 7fd06e5b2700 1 -- 172.21.15.8:0/2238696302 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0680fed50 con 0x7fd054060f70 2023-10-18T21:47:34.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.807+0000 7fd05dffb700 1 -- 172.21.15.8:0/2238696302 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd0680fed50 con 0x7fd054060f70 2023-10-18T21:47:34.809 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:47:34.809 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (54m) 106s ago 55m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:47:34.809 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (48m) 106s ago 55m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:47:34.809 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (48m) 9m ago 54m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:47:34.810 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (54m) 106s ago 55m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:47:34.810 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 106s ago 51m - - 2023-10-18T21:47:34.810 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 106s ago 51m - - 2023-10-18T21:47:34.810 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 51m - - 2023-10-18T21:47:34.810 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 51m - - 2023-10-18T21:47:34.811 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (49m) 106s ago 57m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:47:34.811 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (48m) 9m ago 54m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:47:34.811 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (48m) 106s ago 57m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:47:34.811 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (48m) 9m ago 54m 189M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:47:34.811 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (55m) 106s ago 55m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:47:34.812 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (54m) 9m ago 54m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:47:34.812 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (47m) 106s ago 54m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:47:34.812 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (45m) 106s ago 53m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:47:34.812 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (45m) 106s ago 53m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:47:34.813 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (44m) 9m ago 53m 440M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:47:34.813 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (44m) 9m ago 53m 388M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:47:34.813 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (43m) 9m ago 52m 311M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:47:34.813 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (49m) 106s ago 54m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:47:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.809+0000 7fd06e5b2700 1 -- 172.21.15.8:0/2238696302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd054060f70 msgr2=0x7fd054063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.809+0000 7fd06e5b2700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd054060f70 0x7fd054063430 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fd0680600e0 tx=0x7fd05800b040).stop 2023-10-18T21:47:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.809+0000 7fd06e5b2700 1 -- 172.21.15.8:0/2238696302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd068060310 msgr2=0x7fd068106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.809+0000 7fd06e5b2700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd068060310 0x7fd068106d60 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fd064004d80 tx=0x7fd06400b040).stop 2023-10-18T21:47:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.810+0000 7fd06e5b2700 1 -- 172.21.15.8:0/2238696302 shutdown_connections 2023-10-18T21:47:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.810+0000 7fd06e5b2700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd054060f70 0x7fd054063430 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.810+0000 7fd06e5b2700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd068060310 0x7fd068106d60 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.810+0000 7fd06e5b2700 1 --2- 172.21.15.8:0/2238696302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680f9690 0x7fd068107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.810+0000 7fd06e5b2700 1 -- 172.21.15.8:0/2238696302 >> 172.21.15.8:0/2238696302 conn(0x7fd0680f0b90 msgr2=0x7fd0680f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.810+0000 7fd06e5b2700 1 -- 172.21.15.8:0/2238696302 shutdown_connections 2023-10-18T21:47:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.810+0000 7fd06e5b2700 1 -- 172.21.15.8:0/2238696302 wait complete. 2023-10-18T21:47:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.944+0000 7f0e2757e700 1 -- 172.21.15.8:0/2046942953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e200f77d0 msgr2=0x7f0e200f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.944+0000 7f0e2757e700 1 --2- 172.21.15.8:0/2046942953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e200f77d0 0x7f0e200f7c30 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f0e10004660 tx=0x7f0e10009b30).stop 2023-10-18T21:47:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.945+0000 7f0e2757e700 1 -- 172.21.15.8:0/2046942953 shutdown_connections 2023-10-18T21:47:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.945+0000 7f0e2757e700 1 --2- 172.21.15.8:0/2046942953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e200f77d0 0x7f0e200f7c30 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.945+0000 7f0e2757e700 1 --2- 172.21.15.8:0/2046942953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e200f6530 0x7f0e200f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.945+0000 7f0e2757e700 1 -- 172.21.15.8:0/2046942953 >> 172.21.15.8:0/2046942953 conn(0x7f0e200f1c90 msgr2=0x7f0e200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.945+0000 7f0e2757e700 1 -- 172.21.15.8:0/2046942953 shutdown_connections 2023-10-18T21:47:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.945+0000 7f0e2757e700 1 -- 172.21.15.8:0/2046942953 wait complete. 2023-10-18T21:47:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.945+0000 7f0e2757e700 1 Processor -- start 2023-10-18T21:47:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.946+0000 7f0e2757e700 1 -- start start 2023-10-18T21:47:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.946+0000 7f0e2757e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e200f6530 0x7f0e20108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.946+0000 7f0e2757e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e200f77d0 0x7f0e20109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.946+0000 7f0e2757e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e201099b0 con 0x7f0e200f77d0 2023-10-18T21:47:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.946+0000 7f0e2757e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e20109af0 con 0x7f0e200f6530 2023-10-18T21:47:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.946+0000 7f0e25d7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e200f77d0 0x7f0e20109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.946+0000 7f0e2657c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e200f6530 0x7f0e20108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.946+0000 7f0e25d7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e200f77d0 0x7f0e20109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54850/0 (socket says 172.21.15.8:54850) 2023-10-18T21:47:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.946+0000 7f0e25d7b700 1 -- 172.21.15.8:0/391567713 learned_addr learned my addr 172.21.15.8:0/391567713 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.947+0000 7f0e25d7b700 1 -- 172.21.15.8:0/391567713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e200f6530 msgr2=0x7f0e20108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.947+0000 7f0e25d7b700 1 --2- 172.21.15.8:0/391567713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e200f6530 0x7f0e20108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.947+0000 7f0e25d7b700 1 -- 172.21.15.8:0/391567713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e10005040 con 0x7f0e200f77d0 2023-10-18T21:47:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.947+0000 7f0e25d7b700 1 --2- 172.21.15.8:0/391567713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e200f77d0 0x7f0e20109400 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f0e10009990 tx=0x7f0e10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.947+0000 7f0e16ffd700 1 -- 172.21.15.8:0/391567713 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e10018070 con 0x7f0e200f77d0 2023-10-18T21:47:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.947+0000 7f0e16ffd700 1 -- 172.21.15.8:0/391567713 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0e10009630 con 0x7f0e200f77d0 2023-10-18T21:47:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.947+0000 7f0e2757e700 1 -- 172.21.15.8:0/391567713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2010a430 con 0x7f0e200f77d0 2023-10-18T21:47:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.947+0000 7f0e16ffd700 1 -- 172.21.15.8:0/391567713 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e1001c3c0 con 0x7f0e200f77d0 2023-10-18T21:47:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.947+0000 7f0e2757e700 1 -- 172.21.15.8:0/391567713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2010a990 con 0x7f0e200f77d0 2023-10-18T21:47:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.948+0000 7f0e2757e700 1 -- 172.21.15.8:0/391567713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e20045ad0 con 0x7f0e200f77d0 2023-10-18T21:47:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.949+0000 7f0e16ffd700 1 -- 172.21.15.8:0/391567713 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0e1001d970 con 0x7f0e200f77d0 2023-10-18T21:47:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.950+0000 7f0e16ffd700 1 --2- 172.21.15.8:0/391567713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e0c060f70 0x7f0e0c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.950+0000 7f0e16ffd700 1 -- 172.21.15.8:0/391567713 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0e1007e620 con 0x7f0e200f77d0 2023-10-18T21:47:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.951+0000 7f0e2657c700 1 --2- 172.21.15.8:0/391567713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e0c060f70 0x7f0e0c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.951+0000 7f0e2657c700 1 --2- 172.21.15.8:0/391567713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e0c060f70 0x7f0e0c063430 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f0e200f7630 tx=0x7f0e1c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:34.954+0000 7f0e16ffd700 1 -- 172.21.15.8:0/391567713 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0e10051c40 con 0x7f0e200f77d0 2023-10-18T21:47:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.210+0000 7f0e2757e700 1 -- 172.21.15.8:0/391567713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0e20027a00 con 0x7f0e200f77d0 2023-10-18T21:47:35.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.210+0000 7f0e16ffd700 1 -- 172.21.15.8:0/391567713 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f0e10051830 con 0x7f0e200f77d0 2023-10-18T21:47:35.211 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:47:35.212 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:47:35.212 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:47:35.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:47:35.212 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:47:35.213 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:47:35.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:47:35.213 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:47:35.213 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:47:35.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:47:35.214 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:47:35.214 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:47:35.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:47:35.214 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:47:35.215 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:47:35.215 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:47:35.215 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:47:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 -- 172.21.15.8:0/391567713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e0c060f70 msgr2=0x7f0e0c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 --2- 172.21.15.8:0/391567713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e0c060f70 0x7f0e0c063430 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f0e200f7630 tx=0x7f0e1c00b040).stop 2023-10-18T21:47:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 -- 172.21.15.8:0/391567713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e200f77d0 msgr2=0x7f0e20109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 --2- 172.21.15.8:0/391567713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e200f77d0 0x7f0e20109400 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f0e10009990 tx=0x7f0e10009b30).stop 2023-10-18T21:47:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 -- 172.21.15.8:0/391567713 shutdown_connections 2023-10-18T21:47:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 --2- 172.21.15.8:0/391567713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e0c060f70 0x7f0e0c063430 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 --2- 172.21.15.8:0/391567713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e200f6530 0x7f0e20108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 --2- 172.21.15.8:0/391567713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e200f77d0 0x7f0e20109400 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 -- 172.21.15.8:0/391567713 >> 172.21.15.8:0/391567713 conn(0x7f0e200f1c90 msgr2=0x7f0e2006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:35.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 -- 172.21.15.8:0/391567713 shutdown_connections 2023-10-18T21:47:35.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.212+0000 7f0e2757e700 1 -- 172.21.15.8:0/391567713 wait complete. 2023-10-18T21:47:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.349+0000 7fcc928c0700 1 -- 172.21.15.8:0/2178597792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc8c0f77d0 msgr2=0x7fcc8c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:35.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.349+0000 7fcc928c0700 1 --2- 172.21.15.8:0/2178597792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc8c0f77d0 0x7fcc8c0f7c30 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fcc7c004660 tx=0x7fcc7c009b30).stop 2023-10-18T21:47:35.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.349+0000 7fcc928c0700 1 -- 172.21.15.8:0/2178597792 shutdown_connections 2023-10-18T21:47:35.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.349+0000 7fcc928c0700 1 --2- 172.21.15.8:0/2178597792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc8c0f77d0 0x7fcc8c0f7c30 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.349+0000 7fcc928c0700 1 --2- 172.21.15.8:0/2178597792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8c0f6530 0x7fcc8c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.349+0000 7fcc928c0700 1 -- 172.21.15.8:0/2178597792 >> 172.21.15.8:0/2178597792 conn(0x7fcc8c0f1c90 msgr2=0x7fcc8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:35.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.349+0000 7fcc928c0700 1 -- 172.21.15.8:0/2178597792 shutdown_connections 2023-10-18T21:47:35.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.349+0000 7fcc928c0700 1 -- 172.21.15.8:0/2178597792 wait complete. 2023-10-18T21:47:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.350+0000 7fcc928c0700 1 Processor -- start 2023-10-18T21:47:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.350+0000 7fcc928c0700 1 -- start start 2023-10-18T21:47:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc928c0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8c0f6530 0x7fcc8c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc928c0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc8c0f77d0 0x7fcc8c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc928c0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c109a20 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc928c0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c109b60 con 0x7fcc8c0f6530 2023-10-18T21:47:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc910bd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc8c0f77d0 0x7fcc8c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc910bd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc8c0f77d0 0x7fcc8c109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54868/0 (socket says 172.21.15.8:54868) 2023-10-18T21:47:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc910bd700 1 -- 172.21.15.8:0/624342263 learned_addr learned my addr 172.21.15.8:0/624342263 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc918be700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8c0f6530 0x7fcc8c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc910bd700 1 -- 172.21.15.8:0/624342263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8c0f6530 msgr2=0x7fcc8c108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc910bd700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8c0f6530 0x7fcc8c108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc910bd700 1 -- 172.21.15.8:0/624342263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c005040 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc918be700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8c0f6530 0x7fcc8c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:47:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.351+0000 7fcc910bd700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc8c0f77d0 0x7fcc8c109470 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fcc7c009990 tx=0x7fcc7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.352+0000 7fcc827fc700 1 -- 172.21.15.8:0/624342263 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7c018070 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.352+0000 7fcc827fc700 1 -- 172.21.15.8:0/624342263 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcc7c009630 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.352+0000 7fcc827fc700 1 -- 172.21.15.8:0/624342263 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7c01c400 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.352+0000 7fcc928c0700 1 -- 172.21.15.8:0/624342263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c10a4a0 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.352+0000 7fcc928c0700 1 -- 172.21.15.8:0/624342263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c10aa00 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.353+0000 7fcc928c0700 1 -- 172.21.15.8:0/624342263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8c045ad0 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.354+0000 7fcc827fc700 1 -- 172.21.15.8:0/624342263 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcc7c01d9e0 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.355+0000 7fcc827fc700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc78060f70 0x7fcc78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.355+0000 7fcc827fc700 1 -- 172.21.15.8:0/624342263 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcc7c07e700 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.355+0000 7fcc918be700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc78060f70 0x7fcc78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.355+0000 7fcc918be700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc78060f70 0x7fcc78063430 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fcc8c0f7630 tx=0x7fcc8800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.359+0000 7fcc827fc700 1 -- 172.21.15.8:0/624342263 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcc7c051ce0 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:34.102039+0000 mgr.smithi008.flmjzp (mgr.14640) 2924 : audit [DBG] from='client.36448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:35.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:34.102039+0000 mgr.smithi008.flmjzp (mgr.14640) 2924 : audit [DBG] from='client.36448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:35.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.585+0000 7fcc928c0700 1 -- 172.21.15.8:0/624342263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc8c0fed60 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.586+0000 7fcc827fc700 1 -- 172.21.15.8:0/624342263 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fcc7c0518d0 con 0x7fcc8c0f77d0 2023-10-18T21:47:35.587 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:47:35.588 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:47:35.588 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:47:35.588 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:47:35.588 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:47:35.588 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:47:35.588 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:47:35.589 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:47:35.589 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:47:35.589 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:47:35.589 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:47:35.590 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:47:35.590 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:47:35.590 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:47:35.590 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:47:35.590 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:47:35.591 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:47:35.591 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:47:35.591 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:47:35.591 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:47:35.591 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:47:35.591 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:47:35.592 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:47:35.592 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:47:35.592 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:47:35.592 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:47:35.592 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:47:35.592 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:47:35.593 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:47:35.593 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:47:35.593 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:47:35.593 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:47:35.593 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:47:35.594 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:47:35.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 -- 172.21.15.8:0/624342263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc78060f70 msgr2=0x7fcc78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc78060f70 0x7fcc78063430 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fcc8c0f7630 tx=0x7fcc8800b040).stop 2023-10-18T21:47:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 -- 172.21.15.8:0/624342263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc8c0f77d0 msgr2=0x7fcc8c109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc8c0f77d0 0x7fcc8c109470 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fcc7c009990 tx=0x7fcc7c009b30).stop 2023-10-18T21:47:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 -- 172.21.15.8:0/624342263 shutdown_connections 2023-10-18T21:47:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc78060f70 0x7fcc78063430 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8c0f6530 0x7fcc8c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 --2- 172.21.15.8:0/624342263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc8c0f77d0 0x7fcc8c109470 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 -- 172.21.15.8:0/624342263 >> 172.21.15.8:0/624342263 conn(0x7fcc8c0f1c90 msgr2=0x7fcc8c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:35.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 -- 172.21.15.8:0/624342263 shutdown_connections 2023-10-18T21:47:35.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.588+0000 7fcc928c0700 1 -- 172.21.15.8:0/624342263 wait complete. 2023-10-18T21:47:35.596 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:47:35.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.726+0000 7f35d5838700 1 -- 172.21.15.8:0/1794777796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d00f77d0 msgr2=0x7f35d00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:35.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.726+0000 7f35d5838700 1 --2- 172.21.15.8:0/1794777796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d00f77d0 0x7f35d00f7c30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f35bc004660 tx=0x7f35bc009b30).stop 2023-10-18T21:47:35.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.727+0000 7f35d5838700 1 -- 172.21.15.8:0/1794777796 shutdown_connections 2023-10-18T21:47:35.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.727+0000 7f35d5838700 1 --2- 172.21.15.8:0/1794777796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d00f77d0 0x7f35d00f7c30 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.727+0000 7f35d5838700 1 --2- 172.21.15.8:0/1794777796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d00f6530 0x7f35d00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.727+0000 7f35d5838700 1 -- 172.21.15.8:0/1794777796 >> 172.21.15.8:0/1794777796 conn(0x7f35d00f1c90 msgr2=0x7f35d00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:35.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.727+0000 7f35d5838700 1 -- 172.21.15.8:0/1794777796 shutdown_connections 2023-10-18T21:47:35.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.727+0000 7f35d5838700 1 -- 172.21.15.8:0/1794777796 wait complete. 2023-10-18T21:47:35.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.727+0000 7f35d5838700 1 Processor -- start 2023-10-18T21:47:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.728+0000 7f35d5838700 1 -- start start 2023-10-18T21:47:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.728+0000 7f35d5838700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d00f6530 0x7f35d0108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.728+0000 7f35d5838700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d00f77d0 0x7f35d0109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.728+0000 7f35d5838700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0109a20 con 0x7f35d00f6530 2023-10-18T21:47:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.728+0000 7f35d5838700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0109b60 con 0x7f35d00f77d0 2023-10-18T21:47:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.728+0000 7f35d4836700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d00f6530 0x7f35d0108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.728+0000 7f35d4836700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d00f6530 0x7f35d0108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54884/0 (socket says 172.21.15.8:54884) 2023-10-18T21:47:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.728+0000 7f35d4836700 1 -- 172.21.15.8:0/1177370051 learned_addr learned my addr 172.21.15.8:0/1177370051 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:47:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.728+0000 7f35cffff700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d00f77d0 0x7f35d0109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.729+0000 7f35d4836700 1 -- 172.21.15.8:0/1177370051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d00f77d0 msgr2=0x7f35d0109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.729+0000 7f35d4836700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d00f77d0 0x7f35d0109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.729+0000 7f35d4836700 1 -- 172.21.15.8:0/1177370051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc005040 con 0x7f35d00f6530 2023-10-18T21:47:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.729+0000 7f35d4836700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d00f6530 0x7f35d0108f80 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f35c4002700 tx=0x7f35c4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.729+0000 7f35cd7fa700 1 -- 172.21.15.8:0/1177370051 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c40079c0 con 0x7f35d00f6530 2023-10-18T21:47:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.729+0000 7f35cd7fa700 1 -- 172.21.15.8:0/1177370051 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f35c400f040 con 0x7f35d00f6530 2023-10-18T21:47:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.729+0000 7f35d5838700 1 -- 172.21.15.8:0/1177370051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d010a500 con 0x7f35d00f6530 2023-10-18T21:47:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.729+0000 7f35cd7fa700 1 -- 172.21.15.8:0/1177370051 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c40148d0 con 0x7f35d00f6530 2023-10-18T21:47:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.729+0000 7f35d5838700 1 -- 172.21.15.8:0/1177370051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d010aac0 con 0x7f35d00f6530 2023-10-18T21:47:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.730+0000 7f35d5838700 1 -- 172.21.15.8:0/1177370051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d0045ad0 con 0x7f35d00f6530 2023-10-18T21:47:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.731+0000 7f35cd7fa700 1 -- 172.21.15.8:0/1177370051 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f35c401b060 con 0x7f35d00f6530 2023-10-18T21:47:35.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.732+0000 7f35cd7fa700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35c0060f70 0x7f35c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:47:35.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.732+0000 7f35cd7fa700 1 -- 172.21.15.8:0/1177370051 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f35c407c690 con 0x7f35d00f6530 2023-10-18T21:47:35.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.732+0000 7f35cffff700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35c0060f70 0x7f35c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:47:35.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.733+0000 7f35cffff700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35c0060f70 0x7f35c0063430 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f35bc004630 tx=0x7f35bc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:47:35.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.737+0000 7f35cd7fa700 1 -- 172.21.15.8:0/1177370051 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f35c404fdb0 con 0x7f35d00f6530 2023-10-18T21:47:35.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.934+0000 7f35d5838700 1 -- 172.21.15.8:0/1177370051 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35d010ad90 con 0x7f35c0060f70 2023-10-18T21:47:35.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.935+0000 7f35cd7fa700 1 -- 172.21.15.8:0/1177370051 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f35d010ad90 con 0x7f35c0060f70 2023-10-18T21:47:35.936 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:47:35.936 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:47:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:47:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:47:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:47:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:47:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:47:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:47:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:47:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:47:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:47:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:47:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:47:35.939 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:47:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 -- 172.21.15.8:0/1177370051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35c0060f70 msgr2=0x7f35c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35c0060f70 0x7f35c0063430 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f35bc004630 tx=0x7f35bc009b30).stop 2023-10-18T21:47:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 -- 172.21.15.8:0/1177370051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d00f6530 msgr2=0x7f35d0108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:47:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d00f6530 0x7f35d0108f80 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f35c4002700 tx=0x7f35c4009d80).stop 2023-10-18T21:47:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 -- 172.21.15.8:0/1177370051 shutdown_connections 2023-10-18T21:47:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f35c0060f70 0x7f35c0063430 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d00f6530 0x7f35d0108f80 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 --2- 172.21.15.8:0/1177370051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d00f77d0 0x7f35d0109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:47:35.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 -- 172.21.15.8:0/1177370051 >> 172.21.15.8:0/1177370051 conn(0x7f35d00f1c90 msgr2=0x7f35d006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:47:35.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 -- 172.21.15.8:0/1177370051 shutdown_connections 2023-10-18T21:47:35.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:47:35.937+0000 7f35d5838700 1 -- 172.21.15.8:0/1177370051 wait complete. 2023-10-18T21:47:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:34.455212+0000 mgr.smithi008.flmjzp (mgr.14640) 2925 : audit [DBG] from='client.36452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:34.799140+0000 mgr.smithi008.flmjzp (mgr.14640) 2926 : audit [DBG] from='client.36456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:34.949777+0000 mgr.smithi008.flmjzp (mgr.14640) 2927 : cluster [DBG] pgmap v2014: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:35.210737+0000 mon.smithi008 (mon.0) 3313 : audit [DBG] from='client.? 172.21.15.8:0/391567713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:35.586560+0000 mon.smithi008 (mon.0) 3314 : audit [DBG] from='client.? 172.21.15.8:0/624342263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:47:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:34.455212+0000 mgr.smithi008.flmjzp (mgr.14640) 2925 : audit [DBG] from='client.36452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:34.799140+0000 mgr.smithi008.flmjzp (mgr.14640) 2926 : audit [DBG] from='client.36456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:34.949777+0000 mgr.smithi008.flmjzp (mgr.14640) 2927 : cluster [DBG] pgmap v2014: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:35.210737+0000 mon.smithi008 (mon.0) 3313 : audit [DBG] from='client.? 172.21.15.8:0/391567713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:35.586560+0000 mon.smithi008 (mon.0) 3314 : audit [DBG] from='client.? 172.21.15.8:0/624342263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:47:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:35.935226+0000 mgr.smithi008.flmjzp (mgr.14640) 2928 : audit [DBG] from='client.36468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:37.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:35.935226+0000 mgr.smithi008.flmjzp (mgr.14640) 2928 : audit [DBG] from='client.36468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:47:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:36.950347+0000 mgr.smithi008.flmjzp (mgr.14640) 2929 : cluster [DBG] pgmap v2015: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:38.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:36.950347+0000 mgr.smithi008.flmjzp (mgr.14640) 2929 : cluster [DBG] pgmap v2015: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:38.950950+0000 mgr.smithi008.flmjzp (mgr.14640) 2930 : cluster [DBG] pgmap v2016: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:40.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:38.950950+0000 mgr.smithi008.flmjzp (mgr.14640) 2930 : cluster [DBG] pgmap v2016: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:40.951593+0000 mgr.smithi008.flmjzp (mgr.14640) 2931 : cluster [DBG] pgmap v2017: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:40.974385+0000 mon.smithi008 (mon.0) 3315 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:40.976583+0000 mon.smithi008 (mon.0) 3316 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:40.977566+0000 mon.smithi008 (mon.0) 3317 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:40.978415+0000 mgr.smithi008.flmjzp (mgr.14640) 2932 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:40.978986+0000 mgr.smithi008.flmjzp (mgr.14640) 2933 : cluster [DBG] pgmap v2018: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:40.979346+0000 mgr.smithi008.flmjzp (mgr.14640) 2934 : cluster [DBG] pgmap v2019: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:40.983929+0000 mon.smithi008 (mon.0) 3318 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:40.990394+0000 mon.smithi008 (mon.0) 3319 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:40.993554+0000 mon.smithi008 (mon.0) 3320 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:40.995310+0000 mon.smithi008 (mon.0) 3321 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:40.996905+0000 mon.smithi008 (mon.0) 3322 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:40.998840+0000 mon.smithi008 (mon.0) 3323 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:41.000717+0000 mgr.smithi008.flmjzp (mgr.14640) 2935 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:40.951593+0000 mgr.smithi008.flmjzp (mgr.14640) 2931 : cluster [DBG] pgmap v2017: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:40.974385+0000 mon.smithi008 (mon.0) 3315 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:40.976583+0000 mon.smithi008 (mon.0) 3316 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:40.977566+0000 mon.smithi008 (mon.0) 3317 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:40.978415+0000 mgr.smithi008.flmjzp (mgr.14640) 2932 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:40.978986+0000 mgr.smithi008.flmjzp (mgr.14640) 2933 : cluster [DBG] pgmap v2018: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:42.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:40.979346+0000 mgr.smithi008.flmjzp (mgr.14640) 2934 : cluster [DBG] pgmap v2019: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:42.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:40.983929+0000 mon.smithi008 (mon.0) 3318 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:42.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:40.990394+0000 mon.smithi008 (mon.0) 3319 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:42.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:40.993554+0000 mon.smithi008 (mon.0) 3320 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:42.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:40.995310+0000 mon.smithi008 (mon.0) 3321 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:42.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:40.996905+0000 mon.smithi008 (mon.0) 3322 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:42.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:40.998840+0000 mon.smithi008 (mon.0) 3323 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:42.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:41.000717+0000 mgr.smithi008.flmjzp (mgr.14640) 2935 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:44.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:42.979849+0000 mgr.smithi008.flmjzp (mgr.14640) 2936 : cluster [DBG] pgmap v2020: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:44.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:42.979849+0000 mgr.smithi008.flmjzp (mgr.14640) 2936 : cluster [DBG] pgmap v2020: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:44.980435+0000 mgr.smithi008.flmjzp (mgr.14640) 2937 : cluster [DBG] pgmap v2021: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:46.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:44.980435+0000 mgr.smithi008.flmjzp (mgr.14640) 2937 : cluster [DBG] pgmap v2021: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:46.980980+0000 mgr.smithi008.flmjzp (mgr.14640) 2938 : cluster [DBG] pgmap v2022: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:48.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:46.980980+0000 mgr.smithi008.flmjzp (mgr.14640) 2938 : cluster [DBG] pgmap v2022: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:48.981598+0000 mgr.smithi008.flmjzp (mgr.14640) 2939 : cluster [DBG] pgmap v2023: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:50.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:48.981598+0000 mgr.smithi008.flmjzp (mgr.14640) 2939 : cluster [DBG] pgmap v2023: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:50.982111+0000 mgr.smithi008.flmjzp (mgr.14640) 2940 : cluster [DBG] pgmap v2024: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:51.003311+0000 mon.smithi008 (mon.0) 3324 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:50.982111+0000 mgr.smithi008.flmjzp (mgr.14640) 2940 : cluster [DBG] pgmap v2024: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:51.003311+0000 mon.smithi008 (mon.0) 3324 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:54.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:52.982838+0000 mgr.smithi008.flmjzp (mgr.14640) 2941 : cluster [DBG] pgmap v2025: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:54.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:53.616846+0000 mon.smithi008 (mon.0) 3325 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:54.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:53.617843+0000 mon.smithi008 (mon.0) 3326 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:54.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:53.618967+0000 mon.smithi008 (mon.0) 3327 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:54.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:53.624869+0000 mon.smithi008 (mon.0) 3328 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:54.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:53.631645+0000 mon.smithi008 (mon.0) 3329 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:54.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:53.634686+0000 mon.smithi008 (mon.0) 3330 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:54.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:53.636281+0000 mon.smithi008 (mon.0) 3331 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:54.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:53.637852+0000 mon.smithi008 (mon.0) 3332 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:54.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:47:53.639823+0000 mon.smithi008 (mon.0) 3333 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:54.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:52.982838+0000 mgr.smithi008.flmjzp (mgr.14640) 2941 : cluster [DBG] pgmap v2025: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:53.616846+0000 mon.smithi008 (mon.0) 3325 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:53.617843+0000 mon.smithi008 (mon.0) 3326 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:47:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:53.618967+0000 mon.smithi008 (mon.0) 3327 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:47:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:53.624869+0000 mon.smithi008 (mon.0) 3328 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:47:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:53.631645+0000 mon.smithi008 (mon.0) 3329 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:47:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:53.634686+0000 mon.smithi008 (mon.0) 3330 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:53.636281+0000 mon.smithi008 (mon.0) 3331 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:53.637852+0000 mon.smithi008 (mon.0) 3332 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:47:53.639823+0000 mon.smithi008 (mon.0) 3333 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:47:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:53.619828+0000 mgr.smithi008.flmjzp (mgr.14640) 2942 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:53.620583+0000 mgr.smithi008.flmjzp (mgr.14640) 2943 : cluster [DBG] pgmap v2026: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:53.620928+0000 mgr.smithi008.flmjzp (mgr.14640) 2944 : cluster [DBG] pgmap v2027: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:47:53.641681+0000 mgr.smithi008.flmjzp (mgr.14640) 2945 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:55.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:53.619828+0000 mgr.smithi008.flmjzp (mgr.14640) 2942 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:47:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:53.620583+0000 mgr.smithi008.flmjzp (mgr.14640) 2943 : cluster [DBG] pgmap v2026: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:53.620928+0000 mgr.smithi008.flmjzp (mgr.14640) 2944 : cluster [DBG] pgmap v2027: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:47:53.641681+0000 mgr.smithi008.flmjzp (mgr.14640) 2945 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:47:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:55.621640+0000 mgr.smithi008.flmjzp (mgr.14640) 2946 : cluster [DBG] pgmap v2028: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:57.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:55.621640+0000 mgr.smithi008.flmjzp (mgr.14640) 2946 : cluster [DBG] pgmap v2028: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:47:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:57.622321+0000 mgr.smithi008.flmjzp (mgr.14640) 2947 : cluster [DBG] pgmap v2029: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:47:59.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:47:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:57.622321+0000 mgr.smithi008.flmjzp (mgr.14640) 2947 : cluster [DBG] pgmap v2029: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:47:59.623070+0000 mgr.smithi008.flmjzp (mgr.14640) 2948 : cluster [DBG] pgmap v2030: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:47:59.623070+0000 mgr.smithi008.flmjzp (mgr.14640) 2948 : cluster [DBG] pgmap v2030: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:03.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:01.623621+0000 mgr.smithi008.flmjzp (mgr.14640) 2949 : cluster [DBG] pgmap v2031: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:03.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:01.623621+0000 mgr.smithi008.flmjzp (mgr.14640) 2949 : cluster [DBG] pgmap v2031: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:04.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:03.652469+0000 mon.smithi008 (mon.0) 3334 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:03.652469+0000 mon.smithi008 (mon.0) 3334 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:03.624196+0000 mgr.smithi008.flmjzp (mgr.14640) 2950 : cluster [DBG] pgmap v2032: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:04.216021+0000 mon.smithi008 (mon.0) 3335 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:04.216888+0000 mon.smithi008 (mon.0) 3336 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:04.222297+0000 mon.smithi008 (mon.0) 3337 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:04.227290+0000 mon.smithi008 (mon.0) 3338 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:04.229715+0000 mon.smithi008 (mon.0) 3339 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:05.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:04.230995+0000 mon.smithi008 (mon.0) 3340 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:05.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:04.232236+0000 mon.smithi008 (mon.0) 3341 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:05.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:04.233850+0000 mon.smithi008 (mon.0) 3342 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:03.624196+0000 mgr.smithi008.flmjzp (mgr.14640) 2950 : cluster [DBG] pgmap v2032: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:04.216021+0000 mon.smithi008 (mon.0) 3335 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:04.216888+0000 mon.smithi008 (mon.0) 3336 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:04.222297+0000 mon.smithi008 (mon.0) 3337 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:04.227290+0000 mon.smithi008 (mon.0) 3338 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:04.229715+0000 mon.smithi008 (mon.0) 3339 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:04.230995+0000 mon.smithi008 (mon.0) 3340 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:04.232236+0000 mon.smithi008 (mon.0) 3341 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:04.233850+0000 mon.smithi008 (mon.0) 3342 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.090+0000 7f026cdf5700 1 -- 172.21.15.8:0/2404386900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026806a3b0 msgr2=0x7f026806a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:06.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.090+0000 7f026cdf5700 1 --2- 172.21.15.8:0/2404386900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026806a3b0 0x7f026806a830 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f025c004660 tx=0x7f025c009b30).stop 2023-10-18T21:48:06.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.090+0000 7f026cdf5700 1 -- 172.21.15.8:0/2404386900 shutdown_connections 2023-10-18T21:48:06.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.090+0000 7f026cdf5700 1 --2- 172.21.15.8:0/2404386900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026806a3b0 0x7f026806a830 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.090+0000 7f026cdf5700 1 --2- 172.21.15.8:0/2404386900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026806b9c0 0x7f0268069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.090+0000 7f026cdf5700 1 -- 172.21.15.8:0/2404386900 >> 172.21.15.8:0/2404386900 conn(0x7f02680f1c30 msgr2=0x7f02680f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:06.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.090+0000 7f026cdf5700 1 -- 172.21.15.8:0/2404386900 shutdown_connections 2023-10-18T21:48:06.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.090+0000 7f026cdf5700 1 -- 172.21.15.8:0/2404386900 wait complete. 2023-10-18T21:48:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.091+0000 7f026cdf5700 1 Processor -- start 2023-10-18T21:48:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.091+0000 7f026cdf5700 1 -- start start 2023-10-18T21:48:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f026cdf5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026806a3b0 0x7f0268108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f026cdf5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026806b9c0 0x7f02681093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f026cdf5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02681099c0 con 0x7f026806b9c0 2023-10-18T21:48:06.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f026cdf5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026810a1d0 con 0x7f026806a3b0 2023-10-18T21:48:06.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f0266ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026806b9c0 0x7f02681093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:06.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f0266ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026806b9c0 0x7f02681093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38334/0 (socket says 172.21.15.8:38334) 2023-10-18T21:48:06.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f0266ffd700 1 -- 172.21.15.8:0/607766664 learned_addr learned my addr 172.21.15.8:0/607766664 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:06.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f02677fe700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026806a3b0 0x7f0268108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:06.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f0266ffd700 1 -- 172.21.15.8:0/607766664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026806a3b0 msgr2=0x7f0268108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:06.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f0266ffd700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026806a3b0 0x7f0268108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.092+0000 7f0266ffd700 1 -- 172.21.15.8:0/607766664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c005040 con 0x7f026806b9c0 2023-10-18T21:48:06.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.093+0000 7f0266ffd700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026806b9c0 0x7f02681093c0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f025c004320 tx=0x7f025c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:06.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.093+0000 7f024ffff700 1 -- 172.21.15.8:0/607766664 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025c019070 con 0x7f026806b9c0 2023-10-18T21:48:06.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.093+0000 7f024ffff700 1 -- 172.21.15.8:0/607766664 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f025c01e420 con 0x7f026806b9c0 2023-10-18T21:48:06.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.093+0000 7f026cdf5700 1 -- 172.21.15.8:0/607766664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026810a3f0 con 0x7f026806b9c0 2023-10-18T21:48:06.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.093+0000 7f024ffff700 1 -- 172.21.15.8:0/607766664 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025c014660 con 0x7f026806b9c0 2023-10-18T21:48:06.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.093+0000 7f026cdf5700 1 -- 172.21.15.8:0/607766664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026810a8d0 con 0x7f026806b9c0 2023-10-18T21:48:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.094+0000 7f026cdf5700 1 -- 172.21.15.8:0/607766664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0268059100 con 0x7f026806b9c0 2023-10-18T21:48:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.095+0000 7f024ffff700 1 -- 172.21.15.8:0/607766664 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f025c01e590 con 0x7f026806b9c0 2023-10-18T21:48:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.096+0000 7f024ffff700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0250060f70 0x7f0250063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.096+0000 7f024ffff700 1 -- 172.21.15.8:0/607766664 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f025c07dd90 con 0x7f026806b9c0 2023-10-18T21:48:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.096+0000 7f02677fe700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0250060f70 0x7f0250063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.097+0000 7f02677fe700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0250060f70 0x7f0250063430 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f0258004170 tx=0x7f025800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.101+0000 7f024ffff700 1 -- 172.21.15.8:0/607766664 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f025c04d960 con 0x7f026806b9c0 2023-10-18T21:48:06.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.301+0000 7f026cdf5700 1 -- 172.21.15.8:0/607766664 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0268100f20 con 0x7f0250060f70 2023-10-18T21:48:06.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.302+0000 7f024ffff700 1 -- 172.21.15.8:0/607766664 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0268100f20 con 0x7f0250060f70 2023-10-18T21:48:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.304+0000 7f026cdf5700 1 -- 172.21.15.8:0/607766664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0250060f70 msgr2=0x7f0250063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.304+0000 7f026cdf5700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0250060f70 0x7f0250063430 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f0258004170 tx=0x7f025800b040).stop 2023-10-18T21:48:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.304+0000 7f026cdf5700 1 -- 172.21.15.8:0/607766664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026806b9c0 msgr2=0x7f02681093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.304+0000 7f026cdf5700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026806b9c0 0x7f02681093c0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f025c004320 tx=0x7f025c00b040).stop 2023-10-18T21:48:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.304+0000 7f026cdf5700 1 -- 172.21.15.8:0/607766664 shutdown_connections 2023-10-18T21:48:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.304+0000 7f026cdf5700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0250060f70 0x7f0250063430 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.304+0000 7f026cdf5700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026806a3b0 0x7f0268108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.304+0000 7f026cdf5700 1 --2- 172.21.15.8:0/607766664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026806b9c0 0x7f02681093c0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.304+0000 7f026cdf5700 1 -- 172.21.15.8:0/607766664 >> 172.21.15.8:0/607766664 conn(0x7f02680f1c30 msgr2=0x7f02680fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.305+0000 7f026cdf5700 1 -- 172.21.15.8:0/607766664 shutdown_connections 2023-10-18T21:48:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.305+0000 7f026cdf5700 1 -- 172.21.15.8:0/607766664 wait complete. 2023-10-18T21:48:06.321 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:48:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:04.217600+0000 mgr.smithi008.flmjzp (mgr.14640) 2951 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:04.218173+0000 mgr.smithi008.flmjzp (mgr.14640) 2952 : cluster [DBG] pgmap v2033: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:04.218497+0000 mgr.smithi008.flmjzp (mgr.14640) 2953 : cluster [DBG] pgmap v2034: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:04.235337+0000 mgr.smithi008.flmjzp (mgr.14640) 2954 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:06.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.442+0000 7fe586855700 1 -- 172.21.15.8:0/2025418569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5800f77d0 msgr2=0x7fe5800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:06.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.442+0000 7fe586855700 1 --2- 172.21.15.8:0/2025418569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5800f77d0 0x7fe5800f7c30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fe570004660 tx=0x7fe570009b30).stop 2023-10-18T21:48:06.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.442+0000 7fe586855700 1 -- 172.21.15.8:0/2025418569 shutdown_connections 2023-10-18T21:48:06.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.442+0000 7fe586855700 1 --2- 172.21.15.8:0/2025418569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5800f77d0 0x7fe5800f7c30 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.442+0000 7fe586855700 1 --2- 172.21.15.8:0/2025418569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5800f6530 0x7fe5800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.442+0000 7fe586855700 1 -- 172.21.15.8:0/2025418569 >> 172.21.15.8:0/2025418569 conn(0x7fe5800f1c90 msgr2=0x7fe5800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:06.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.442+0000 7fe586855700 1 -- 172.21.15.8:0/2025418569 shutdown_connections 2023-10-18T21:48:06.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.442+0000 7fe586855700 1 -- 172.21.15.8:0/2025418569 wait complete. 2023-10-18T21:48:06.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.443+0000 7fe586855700 1 Processor -- start 2023-10-18T21:48:06.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.443+0000 7fe586855700 1 -- start start 2023-10-18T21:48:06.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.443+0000 7fe586855700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5800f6530 0x7fe580106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:06.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.443+0000 7fe586855700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5800f77d0 0x7fe580107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:06.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.443+0000 7fe586855700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580107830 con 0x7fe5800f6530 2023-10-18T21:48:06.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.443+0000 7fe586855700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580108040 con 0x7fe5800f77d0 2023-10-18T21:48:06.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.443+0000 7fe585853700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5800f6530 0x7fe580106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:06.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.443+0000 7fe585853700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5800f6530 0x7fe580106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38352/0 (socket says 172.21.15.8:38352) 2023-10-18T21:48:06.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.443+0000 7fe585853700 1 -- 172.21.15.8:0/4027425635 learned_addr learned my addr 172.21.15.8:0/4027425635 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.444+0000 7fe585853700 1 -- 172.21.15.8:0/4027425635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5800f77d0 msgr2=0x7fe580107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.444+0000 7fe585052700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5800f77d0 0x7fe580107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.444+0000 7fe585853700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5800f77d0 0x7fe580107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.444+0000 7fe585853700 1 -- 172.21.15.8:0/4027425635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe570005040 con 0x7fe5800f6530 2023-10-18T21:48:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.444+0000 7fe585052700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5800f77d0 0x7fe580107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:48:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.444+0000 7fe585853700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5800f6530 0x7fe580106d40 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fe57c002700 tx=0x7fe57c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.444+0000 7fe5767fc700 1 -- 172.21.15.8:0/4027425635 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57c009320 con 0x7fe5800f6530 2023-10-18T21:48:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.444+0000 7fe5767fc700 1 -- 172.21.15.8:0/4027425635 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe57c00f040 con 0x7fe5800f6530 2023-10-18T21:48:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.444+0000 7fe5767fc700 1 -- 172.21.15.8:0/4027425635 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57c014970 con 0x7fe5800f6530 2023-10-18T21:48:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.444+0000 7fe586855700 1 -- 172.21.15.8:0/4027425635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5801082c0 con 0x7fe5800f6530 2023-10-18T21:48:06.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.445+0000 7fe586855700 1 -- 172.21.15.8:0/4027425635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe580108880 con 0x7fe5800f6530 2023-10-18T21:48:06.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.445+0000 7fe586855700 1 -- 172.21.15.8:0/4027425635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580059100 con 0x7fe5800f6530 2023-10-18T21:48:06.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.446+0000 7fe5767fc700 1 -- 172.21.15.8:0/4027425635 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe57c009480 con 0x7fe5800f6530 2023-10-18T21:48:06.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.447+0000 7fe5767fc700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe56c060f70 0x7fe56c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:06.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.447+0000 7fe5767fc700 1 -- 172.21.15.8:0/4027425635 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe57c07cad0 con 0x7fe5800f6530 2023-10-18T21:48:06.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.447+0000 7fe585052700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe56c060f70 0x7fe56c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:06.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.448+0000 7fe585052700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe56c060f70 0x7fe56c063430 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fe570009d60 tx=0x7fe570009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:06.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.451+0000 7fe5767fc700 1 -- 172.21.15.8:0/4027425635 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe57c04c7c0 con 0x7fe5800f6530 2023-10-18T21:48:06.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:04.217600+0000 mgr.smithi008.flmjzp (mgr.14640) 2951 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:04.218173+0000 mgr.smithi008.flmjzp (mgr.14640) 2952 : cluster [DBG] pgmap v2033: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:04.218497+0000 mgr.smithi008.flmjzp (mgr.14640) 2953 : cluster [DBG] pgmap v2034: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:04.235337+0000 mgr.smithi008.flmjzp (mgr.14640) 2954 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:06.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.648+0000 7fe586855700 1 -- 172.21.15.8:0/4027425635 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5800fee50 con 0x7fe56c060f70 2023-10-18T21:48:06.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.649+0000 7fe5767fc700 1 -- 172.21.15.8:0/4027425635 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe5800fee50 con 0x7fe56c060f70 2023-10-18T21:48:06.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.651+0000 7fe586855700 1 -- 172.21.15.8:0/4027425635 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe56c060f70 msgr2=0x7fe56c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:06.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.651+0000 7fe586855700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe56c060f70 0x7fe56c063430 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fe570009d60 tx=0x7fe570009b30).stop 2023-10-18T21:48:06.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.651+0000 7fe586855700 1 -- 172.21.15.8:0/4027425635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5800f6530 msgr2=0x7fe580106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:06.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.651+0000 7fe586855700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5800f6530 0x7fe580106d40 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fe57c002700 tx=0x7fe57c009d80).stop 2023-10-18T21:48:06.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.651+0000 7fe586855700 1 -- 172.21.15.8:0/4027425635 shutdown_connections 2023-10-18T21:48:06.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.652+0000 7fe586855700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe56c060f70 0x7fe56c063430 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.652+0000 7fe586855700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5800f6530 0x7fe580106d40 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.652+0000 7fe586855700 1 --2- 172.21.15.8:0/4027425635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5800f77d0 0x7fe580107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.652+0000 7fe586855700 1 -- 172.21.15.8:0/4027425635 >> 172.21.15.8:0/4027425635 conn(0x7fe5800f1c90 msgr2=0x7fe5800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:06.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.652+0000 7fe586855700 1 -- 172.21.15.8:0/4027425635 shutdown_connections 2023-10-18T21:48:06.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.652+0000 7fe586855700 1 -- 172.21.15.8:0/4027425635 wait complete. 2023-10-18T21:48:06.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.787+0000 7f92d3138700 1 -- 172.21.15.8:0/3617421032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92cc0f6530 msgr2=0x7f92cc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:06.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.787+0000 7f92d3138700 1 --2- 172.21.15.8:0/3617421032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92cc0f6530 0x7f92cc0f6950 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f92c8004660 tx=0x7f92c8009b30).stop 2023-10-18T21:48:06.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.787+0000 7f92d3138700 1 -- 172.21.15.8:0/3617421032 shutdown_connections 2023-10-18T21:48:06.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.787+0000 7f92d3138700 1 --2- 172.21.15.8:0/3617421032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc0f77d0 0x7f92cc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.787+0000 7f92d3138700 1 --2- 172.21.15.8:0/3617421032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92cc0f6530 0x7f92cc0f6950 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.787+0000 7f92d3138700 1 -- 172.21.15.8:0/3617421032 >> 172.21.15.8:0/3617421032 conn(0x7f92cc0f1c90 msgr2=0x7f92cc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:06.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.787+0000 7f92d3138700 1 -- 172.21.15.8:0/3617421032 shutdown_connections 2023-10-18T21:48:06.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.787+0000 7f92d3138700 1 -- 172.21.15.8:0/3617421032 wait complete. 2023-10-18T21:48:06.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.788+0000 7f92d3138700 1 Processor -- start 2023-10-18T21:48:06.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.789+0000 7f92d3138700 1 -- start start 2023-10-18T21:48:06.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.789+0000 7f92d3138700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92cc0f6530 0x7f92cc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:06.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.789+0000 7f92d3138700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc0f77d0 0x7f92cc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:06.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.789+0000 7f92d3138700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc06a380 con 0x7f92cc0f6530 2023-10-18T21:48:06.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.789+0000 7f92d3138700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc06a4c0 con 0x7f92cc0f77d0 2023-10-18T21:48:06.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.789+0000 7f92d2136700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92cc0f6530 0x7f92cc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92d2136700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92cc0f6530 0x7f92cc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38370/0 (socket says 172.21.15.8:38370) 2023-10-18T21:48:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92d2136700 1 -- 172.21.15.8:0/713363448 learned_addr learned my addr 172.21.15.8:0/713363448 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92d1935700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc0f77d0 0x7f92cc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92d2136700 1 -- 172.21.15.8:0/713363448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc0f77d0 msgr2=0x7f92cc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92d2136700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc0f77d0 0x7f92cc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92d2136700 1 -- 172.21.15.8:0/713363448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8005040 con 0x7f92cc0f6530 2023-10-18T21:48:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92d2136700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92cc0f6530 0x7f92cc06b9a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f92c8004e30 tx=0x7f92c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92c2ffd700 1 -- 172.21.15.8:0/713363448 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92c8018070 con 0x7f92cc0f6530 2023-10-18T21:48:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92d3138700 1 -- 172.21.15.8:0/713363448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc06a740 con 0x7f92cc0f6530 2023-10-18T21:48:06.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92c2ffd700 1 -- 172.21.15.8:0/713363448 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f92c8009630 con 0x7f92cc0f6530 2023-10-18T21:48:06.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.790+0000 7f92c2ffd700 1 -- 172.21.15.8:0/713363448 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92c801c3c0 con 0x7f92cc0f6530 2023-10-18T21:48:06.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.791+0000 7f92d3138700 1 -- 172.21.15.8:0/713363448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc06aca0 con 0x7f92cc0f6530 2023-10-18T21:48:06.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.792+0000 7f92d3138700 1 -- 172.21.15.8:0/713363448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc045ad0 con 0x7f92cc0f6530 2023-10-18T21:48:06.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.793+0000 7f92c2ffd700 1 -- 172.21.15.8:0/713363448 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f92c801d420 con 0x7f92cc0f6530 2023-10-18T21:48:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.793+0000 7f92c2ffd700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92b8060f70 0x7f92b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.794+0000 7f92c2ffd700 1 -- 172.21.15.8:0/713363448 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f92c807e470 con 0x7f92cc0f6530 2023-10-18T21:48:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.794+0000 7f92d1935700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92b8060f70 0x7f92b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.794+0000 7f92d1935700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92b8060f70 0x7f92b8063430 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f92bc004d80 tx=0x7f92bc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:06.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.798+0000 7f92c2ffd700 1 -- 172.21.15.8:0/713363448 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f92c804e0e0 con 0x7f92cc0f6530 2023-10-18T21:48:06.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:06.995+0000 7f92d3138700 1 -- 172.21.15.8:0/713363448 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f92cc0fee70 con 0x7f92b8060f70 2023-10-18T21:48:07.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.005+0000 7f92c2ffd700 1 -- 172.21.15.8:0/713363448 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f92bc00f040 con 0x7f92b8060f70 2023-10-18T21:48:07.007 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:48:07.007 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (54m) 2m ago 56m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:48:07.008 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (48m) 2m ago 56m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:48:07.008 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (48m) 13s ago 55m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:48:07.008 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (54m) 2m ago 55m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:48:07.008 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 52m - - 2023-10-18T21:48:07.008 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 52m - - 2023-10-18T21:48:07.009 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 13s ago 52m - - 2023-10-18T21:48:07.009 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 13s ago 52m - - 2023-10-18T21:48:07.009 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (49m) 2m ago 57m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:48:07.009 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (49m) 13s ago 55m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:48:07.009 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (49m) 2m ago 57m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:48:07.010 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (48m) 13s ago 55m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:48:07.010 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (55m) 2m ago 55m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:48:07.010 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (55m) 13s ago 55m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:48:07.010 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (48m) 2m ago 54m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:48:07.010 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (46m) 2m ago 54m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:48:07.011 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (45m) 2m ago 54m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:48:07.011 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (45m) 13s ago 53m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:48:07.011 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (44m) 13s ago 53m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:48:07.011 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (44m) 13s ago 53m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:48:07.011 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (50m) 2m ago 55m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:48:07.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.007+0000 7f92d3138700 1 -- 172.21.15.8:0/713363448 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92b8060f70 msgr2=0x7f92b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.007+0000 7f92d3138700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92b8060f70 0x7f92b8063430 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f92bc004d80 tx=0x7f92bc00b040).stop 2023-10-18T21:48:07.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.007+0000 7f92d3138700 1 -- 172.21.15.8:0/713363448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92cc0f6530 msgr2=0x7f92cc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.007+0000 7f92d3138700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92cc0f6530 0x7f92cc06b9a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f92c8004e30 tx=0x7f92c8009b30).stop 2023-10-18T21:48:07.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.008+0000 7f92d3138700 1 -- 172.21.15.8:0/713363448 shutdown_connections 2023-10-18T21:48:07.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.008+0000 7f92d3138700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92b8060f70 0x7f92b8063430 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.008+0000 7f92d3138700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92cc0f6530 0x7f92cc06b9a0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.008+0000 7f92d3138700 1 --2- 172.21.15.8:0/713363448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc0f77d0 0x7f92cc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.008+0000 7f92d3138700 1 -- 172.21.15.8:0/713363448 >> 172.21.15.8:0/713363448 conn(0x7f92cc0f1c90 msgr2=0x7f92cc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:07.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.008+0000 7f92d3138700 1 -- 172.21.15.8:0/713363448 shutdown_connections 2023-10-18T21:48:07.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.008+0000 7f92d3138700 1 -- 172.21.15.8:0/713363448 wait complete. 2023-10-18T21:48:07.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.146+0000 7ff85ee2a700 1 -- 172.21.15.8:0/307806013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8580f77d0 msgr2=0x7ff8580f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.146+0000 7ff85ee2a700 1 --2- 172.21.15.8:0/307806013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8580f77d0 0x7ff8580f7c30 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7ff848004660 tx=0x7ff848009b30).stop 2023-10-18T21:48:07.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.146+0000 7ff85ee2a700 1 -- 172.21.15.8:0/307806013 shutdown_connections 2023-10-18T21:48:07.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.146+0000 7ff85ee2a700 1 --2- 172.21.15.8:0/307806013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8580f77d0 0x7ff8580f7c30 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.146+0000 7ff85ee2a700 1 --2- 172.21.15.8:0/307806013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8580f6530 0x7ff8580f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.146+0000 7ff85ee2a700 1 -- 172.21.15.8:0/307806013 >> 172.21.15.8:0/307806013 conn(0x7ff8580f1c90 msgr2=0x7ff8580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:07.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.146+0000 7ff85ee2a700 1 -- 172.21.15.8:0/307806013 shutdown_connections 2023-10-18T21:48:07.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.146+0000 7ff85ee2a700 1 -- 172.21.15.8:0/307806013 wait complete. 2023-10-18T21:48:07.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.147+0000 7ff85ee2a700 1 Processor -- start 2023-10-18T21:48:07.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.147+0000 7ff85ee2a700 1 -- start start 2023-10-18T21:48:07.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.147+0000 7ff85ee2a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8580f6530 0x7ff858106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:07.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.147+0000 7ff85ee2a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8580f77d0 0x7ff858107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:07.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.147+0000 7ff85ee2a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff858107850 con 0x7ff8580f6530 2023-10-18T21:48:07.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.147+0000 7ff85ee2a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff858108060 con 0x7ff8580f77d0 2023-10-18T21:48:07.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.147+0000 7ff85de28700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8580f6530 0x7ff858106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:07.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.147+0000 7ff85de28700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8580f6530 0x7ff858106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39386/0 (socket says 172.21.15.8:39386) 2023-10-18T21:48:07.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.147+0000 7ff85de28700 1 -- 172.21.15.8:0/2871607260 learned_addr learned my addr 172.21.15.8:0/2871607260 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:07.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.148+0000 7ff85d627700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8580f77d0 0x7ff858107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:07.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.148+0000 7ff85de28700 1 -- 172.21.15.8:0/2871607260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8580f77d0 msgr2=0x7ff858107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.148+0000 7ff85de28700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8580f77d0 0x7ff858107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.148+0000 7ff85de28700 1 -- 172.21.15.8:0/2871607260 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff848005040 con 0x7ff8580f6530 2023-10-18T21:48:07.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.148+0000 7ff85de28700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8580f6530 0x7ff858106d60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7ff85400e7c0 tx=0x7ff85400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:07.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.148+0000 7ff84e7fc700 1 -- 172.21.15.8:0/2871607260 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8540092e0 con 0x7ff8580f6530 2023-10-18T21:48:07.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.148+0000 7ff85ee2a700 1 -- 172.21.15.8:0/2871607260 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8581082e0 con 0x7ff8580f6530 2023-10-18T21:48:07.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.148+0000 7ff84e7fc700 1 -- 172.21.15.8:0/2871607260 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff85400f040 con 0x7ff8580f6530 2023-10-18T21:48:07.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.148+0000 7ff84e7fc700 1 -- 172.21.15.8:0/2871607260 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8540147e0 con 0x7ff8580f6530 2023-10-18T21:48:07.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.148+0000 7ff85ee2a700 1 -- 172.21.15.8:0/2871607260 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff858108820 con 0x7ff8580f6530 2023-10-18T21:48:07.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.149+0000 7ff85ee2a700 1 -- 172.21.15.8:0/2871607260 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff858059100 con 0x7ff8580f6530 2023-10-18T21:48:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.150+0000 7ff84e7fc700 1 -- 172.21.15.8:0/2871607260 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff85401b030 con 0x7ff8580f6530 2023-10-18T21:48:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.151+0000 7ff84e7fc700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 0x7ff844063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.151+0000 7ff84e7fc700 1 -- 172.21.15.8:0/2871607260 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff85407c9b0 con 0x7ff8580f6530 2023-10-18T21:48:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.151+0000 7ff85d627700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 0x7ff844063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.152+0000 7ff85d627700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 0x7ff844063430 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7ff848009720 tx=0x7ff84800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:07.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.155+0000 7ff84e7fc700 1 -- 172.21.15.8:0/2871607260 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff85404c620 con 0x7ff8580f6530 2023-10-18T21:48:07.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.412+0000 7ff85ee2a700 1 -- 172.21.15.8:0/2871607260 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff8580fed60 con 0x7ff8580f6530 2023-10-18T21:48:07.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.413+0000 7ff84e7fc700 1 -- 172.21.15.8:0/2871607260 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7ff854019020 con 0x7ff8580f6530 2023-10-18T21:48:07.415 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:48:07.415 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:48:07.416 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:48:07.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:48:07.416 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:48:07.416 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:48:07.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:48:07.417 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:48:07.417 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:48:07.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:48:07.417 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:48:07.417 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:48:07.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:48:07.418 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:48:07.418 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:48:07.418 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:48:07.418 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:48:07.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 -- 172.21.15.8:0/2871607260 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 msgr2=0x7ff844063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 0x7ff844063430 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7ff848009720 tx=0x7ff84800b040).stop 2023-10-18T21:48:07.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 -- 172.21.15.8:0/2871607260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8580f6530 msgr2=0x7ff858106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8580f6530 0x7ff858106d60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7ff85400e7c0 tx=0x7ff85400b040).stop 2023-10-18T21:48:07.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 -- 172.21.15.8:0/2871607260 shutdown_connections 2023-10-18T21:48:07.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 0x7ff844063430 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8580f6530 0x7ff858106d60 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 --2- 172.21.15.8:0/2871607260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8580f77d0 0x7ff858107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 -- 172.21.15.8:0/2871607260 >> 172.21.15.8:0/2871607260 conn(0x7ff8580f1c90 msgr2=0x7ff8580fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:07.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 -- 172.21.15.8:0/2871607260 shutdown_connections 2023-10-18T21:48:07.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.415+0000 7ff85ee2a700 1 -- 172.21.15.8:0/2871607260 wait complete. 2023-10-18T21:48:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.553+0000 7fec6e284700 1 -- 172.21.15.8:0/3051612869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec680f77d0 msgr2=0x7fec680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.553+0000 7fec6e284700 1 --2- 172.21.15.8:0/3051612869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec680f77d0 0x7fec680f7c30 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fec58004660 tx=0x7fec58009b30).stop 2023-10-18T21:48:07.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.553+0000 7fec6e284700 1 -- 172.21.15.8:0/3051612869 shutdown_connections 2023-10-18T21:48:07.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.553+0000 7fec6e284700 1 --2- 172.21.15.8:0/3051612869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec680f77d0 0x7fec680f7c30 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.553+0000 7fec6e284700 1 --2- 172.21.15.8:0/3051612869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec680f6530 0x7fec680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.553+0000 7fec6e284700 1 -- 172.21.15.8:0/3051612869 >> 172.21.15.8:0/3051612869 conn(0x7fec680f1c90 msgr2=0x7fec680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:07.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.553+0000 7fec6e284700 1 -- 172.21.15.8:0/3051612869 shutdown_connections 2023-10-18T21:48:07.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.553+0000 7fec6e284700 1 -- 172.21.15.8:0/3051612869 wait complete. 2023-10-18T21:48:07.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.554+0000 7fec6e284700 1 Processor -- start 2023-10-18T21:48:07.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.554+0000 7fec6e284700 1 -- start start 2023-10-18T21:48:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.555+0000 7fec6e284700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec680f6530 0x7fec68104a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.555+0000 7fec6e284700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec680f77d0 0x7fec68104f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.555+0000 7fec6e284700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec68105580 con 0x7fec680f77d0 2023-10-18T21:48:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.555+0000 7fec6e284700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec681056c0 con 0x7fec680f6530 2023-10-18T21:48:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.555+0000 7fec6ca81700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec680f77d0 0x7fec68104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:07.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.555+0000 7fec6ca81700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec680f77d0 0x7fec68104f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39398/0 (socket says 172.21.15.8:39398) 2023-10-18T21:48:07.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.555+0000 7fec6ca81700 1 -- 172.21.15.8:0/1682759992 learned_addr learned my addr 172.21.15.8:0/1682759992 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:07.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.555+0000 7fec6d282700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec680f6530 0x7fec68104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:07.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.555+0000 7fec6ca81700 1 -- 172.21.15.8:0/1682759992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec680f6530 msgr2=0x7fec68104a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.556+0000 7fec6ca81700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec680f6530 0x7fec68104a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.556+0000 7fec6ca81700 1 -- 172.21.15.8:0/1682759992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58005040 con 0x7fec680f77d0 2023-10-18T21:48:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.556+0000 7fec6ca81700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec680f77d0 0x7fec68104f80 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fec58009990 tx=0x7fec58009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.556+0000 7fec5dffb700 1 -- 172.21.15.8:0/1682759992 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec58018070 con 0x7fec680f77d0 2023-10-18T21:48:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.556+0000 7fec5dffb700 1 -- 172.21.15.8:0/1682759992 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fec58009630 con 0x7fec680f77d0 2023-10-18T21:48:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.556+0000 7fec6e284700 1 -- 172.21.15.8:0/1682759992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec68105fd0 con 0x7fec680f77d0 2023-10-18T21:48:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.556+0000 7fec5dffb700 1 -- 172.21.15.8:0/1682759992 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec5801c3c0 con 0x7fec680f77d0 2023-10-18T21:48:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.556+0000 7fec6e284700 1 -- 172.21.15.8:0/1682759992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec68106530 con 0x7fec680f77d0 2023-10-18T21:48:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.557+0000 7fec6e284700 1 -- 172.21.15.8:0/1682759992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec68045ad0 con 0x7fec680f77d0 2023-10-18T21:48:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.558+0000 7fec5dffb700 1 -- 172.21.15.8:0/1682759992 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fec5801d970 con 0x7fec680f77d0 2023-10-18T21:48:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.559+0000 7fec5dffb700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec54060f70 0x7fec54063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.559+0000 7fec5dffb700 1 -- 172.21.15.8:0/1682759992 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fec5807e5a0 con 0x7fec680f77d0 2023-10-18T21:48:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.559+0000 7fec6d282700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec54060f70 0x7fec54063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.560+0000 7fec6d282700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec54060f70 0x7fec54063430 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fec68104820 tx=0x7fec6400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.563+0000 7fec5dffb700 1 -- 172.21.15.8:0/1682759992 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fec5804e210 con 0x7fec680f77d0 2023-10-18T21:48:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.788+0000 7fec6e284700 1 -- 172.21.15.8:0/1682759992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fec680fecc0 con 0x7fec680f77d0 2023-10-18T21:48:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.789+0000 7fec5dffb700 1 -- 172.21.15.8:0/1682759992 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fec58051830 con 0x7fec680f77d0 2023-10-18T21:48:07.791 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:48:07.791 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:48:07.792 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:48:07.792 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:48:07.792 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:48:07.792 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:48:07.792 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:48:07.793 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:48:07.793 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:48:07.793 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:48:07.793 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:48:07.793 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:48:07.794 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:48:07.794 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:48:07.794 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:48:07.794 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:48:07.794 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:48:07.795 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:48:07.795 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:48:07.795 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:48:07.795 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:48:07.795 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:48:07.796 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:48:07.796 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:48:07.796 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:48:07.796 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:48:07.796 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:48:07.796 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:48:07.797 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:48:07.797 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:48:07.797 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:48:07.797 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:48:07.797 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:48:07.798 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:48:07.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 -- 172.21.15.8:0/1682759992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec54060f70 msgr2=0x7fec54063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec54060f70 0x7fec54063430 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fec68104820 tx=0x7fec6400b040).stop 2023-10-18T21:48:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 -- 172.21.15.8:0/1682759992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec680f77d0 msgr2=0x7fec68104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec680f77d0 0x7fec68104f80 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fec58009990 tx=0x7fec58009b30).stop 2023-10-18T21:48:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 -- 172.21.15.8:0/1682759992 shutdown_connections 2023-10-18T21:48:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec54060f70 0x7fec54063430 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec680f6530 0x7fec68104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 --2- 172.21.15.8:0/1682759992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec680f77d0 0x7fec68104f80 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 -- 172.21.15.8:0/1682759992 >> 172.21.15.8:0/1682759992 conn(0x7fec680f1c90 msgr2=0x7fec6806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 -- 172.21.15.8:0/1682759992 shutdown_connections 2023-10-18T21:48:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.791+0000 7fec6e284700 1 -- 172.21.15.8:0/1682759992 wait complete. 2023-10-18T21:48:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:48:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.928+0000 7fd1fed47700 1 -- 172.21.15.8:0/139376349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f80f6530 msgr2=0x7fd1f80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.928+0000 7fd1fed47700 1 --2- 172.21.15.8:0/139376349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f80f6530 0x7fd1f80f6950 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7fd1f4004660 tx=0x7fd1f4009b30).stop 2023-10-18T21:48:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.928+0000 7fd1fed47700 1 -- 172.21.15.8:0/139376349 shutdown_connections 2023-10-18T21:48:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.928+0000 7fd1fed47700 1 --2- 172.21.15.8:0/139376349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1f80f77d0 0x7fd1f80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.928+0000 7fd1fed47700 1 --2- 172.21.15.8:0/139376349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f80f6530 0x7fd1f80f6950 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.928+0000 7fd1fed47700 1 -- 172.21.15.8:0/139376349 >> 172.21.15.8:0/139376349 conn(0x7fd1f80f1c90 msgr2=0x7fd1f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:07.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.928+0000 7fd1fed47700 1 -- 172.21.15.8:0/139376349 shutdown_connections 2023-10-18T21:48:07.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.928+0000 7fd1fed47700 1 -- 172.21.15.8:0/139376349 wait complete. 2023-10-18T21:48:07.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.929+0000 7fd1fed47700 1 Processor -- start 2023-10-18T21:48:07.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.929+0000 7fd1fed47700 1 -- start start 2023-10-18T21:48:07.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.929+0000 7fd1fed47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1f80f6530 0x7fd1f8108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:07.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fed47700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f80f77d0 0x7fd1f8109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:07.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fed47700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f8109a00 con 0x7fd1f80f77d0 2023-10-18T21:48:07.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fed47700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f8109b40 con 0x7fd1f80f6530 2023-10-18T21:48:07.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fd544700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f80f77d0 0x7fd1f8109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:07.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fd544700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f80f77d0 0x7fd1f8109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39408/0 (socket says 172.21.15.8:39408) 2023-10-18T21:48:07.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fd544700 1 -- 172.21.15.8:0/2822836732 learned_addr learned my addr 172.21.15.8:0/2822836732 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:07.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fdd45700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1f80f6530 0x7fd1f8108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:07.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fd544700 1 -- 172.21.15.8:0/2822836732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1f80f6530 msgr2=0x7fd1f8108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:07.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fd544700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1f80f6530 0x7fd1f8108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:07.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fd544700 1 -- 172.21.15.8:0/2822836732 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4005040 con 0x7fd1f80f77d0 2023-10-18T21:48:07.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.930+0000 7fd1fd544700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f80f77d0 0x7fd1f8109450 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fd1e800e7f0 tx=0x7fd1e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:07.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.931+0000 7fd1ee7fc700 1 -- 172.21.15.8:0/2822836732 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1e80092e0 con 0x7fd1f80f77d0 2023-10-18T21:48:07.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.931+0000 7fd1ee7fc700 1 -- 172.21.15.8:0/2822836732 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd1e800f040 con 0x7fd1f80f77d0 2023-10-18T21:48:07.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.931+0000 7fd1fed47700 1 -- 172.21.15.8:0/2822836732 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f810a4e0 con 0x7fd1f80f77d0 2023-10-18T21:48:07.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.931+0000 7fd1ee7fc700 1 -- 172.21.15.8:0/2822836732 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1e80147e0 con 0x7fd1f80f77d0 2023-10-18T21:48:07.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.931+0000 7fd1fed47700 1 -- 172.21.15.8:0/2822836732 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f810aa20 con 0x7fd1f80f77d0 2023-10-18T21:48:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.932+0000 7fd1fed47700 1 -- 172.21.15.8:0/2822836732 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f8045ad0 con 0x7fd1f80f77d0 2023-10-18T21:48:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.933+0000 7fd1ee7fc700 1 -- 172.21.15.8:0/2822836732 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd1e801b030 con 0x7fd1f80f77d0 2023-10-18T21:48:07.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.934+0000 7fd1ee7fc700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1e4060f70 0x7fd1e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:07.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.934+0000 7fd1ee7fc700 1 -- 172.21.15.8:0/2822836732 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd1e807c7f0 con 0x7fd1f80f77d0 2023-10-18T21:48:07.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.934+0000 7fd1fdd45700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1e4060f70 0x7fd1e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:07.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.934+0000 7fd1fdd45700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1e4060f70 0x7fd1e4063430 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fd1f4009720 tx=0x7fd1f400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:07.938+0000 7fd1ee7fc700 1 -- 172.21.15.8:0/2822836732 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd1e804fe80 con 0x7fd1f80f77d0 2023-10-18T21:48:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.136+0000 7fd1fed47700 1 -- 172.21.15.8:0/2822836732 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1f810ac40 con 0x7fd1e4060f70 2023-10-18T21:48:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.137+0000 7fd1ee7fc700 1 -- 172.21.15.8:0/2822836732 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd1f810ac40 con 0x7fd1e4060f70 2023-10-18T21:48:08.139 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:48:08.140 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:48:08.140 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:48:08.140 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:48:08.140 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:48:08.141 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:48:08.141 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:48:08.142 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:48:08.142 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:48:08.142 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:48:08.142 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:48:08.143 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:48:08.143 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:48:08.143 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:48:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.139+0000 7fd1fed47700 1 -- 172.21.15.8:0/2822836732 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1e4060f70 msgr2=0x7fd1e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.139+0000 7fd1fed47700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1e4060f70 0x7fd1e4063430 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fd1f4009720 tx=0x7fd1f400b040).stop 2023-10-18T21:48:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.139+0000 7fd1fed47700 1 -- 172.21.15.8:0/2822836732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f80f77d0 msgr2=0x7fd1f8109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.139+0000 7fd1fed47700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f80f77d0 0x7fd1f8109450 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fd1e800e7f0 tx=0x7fd1e800b040).stop 2023-10-18T21:48:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.139+0000 7fd1fed47700 1 -- 172.21.15.8:0/2822836732 shutdown_connections 2023-10-18T21:48:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.139+0000 7fd1fed47700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd1e4060f70 0x7fd1e4063430 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.139+0000 7fd1fed47700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1f80f6530 0x7fd1f8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.139+0000 7fd1fed47700 1 --2- 172.21.15.8:0/2822836732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f80f77d0 0x7fd1f8109450 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.139+0000 7fd1fed47700 1 -- 172.21.15.8:0/2822836732 >> 172.21.15.8:0/2822836732 conn(0x7fd1f80f1c90 msgr2=0x7fd1f806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.140+0000 7fd1fed47700 1 -- 172.21.15.8:0/2822836732 shutdown_connections 2023-10-18T21:48:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:08.140+0000 7fd1fed47700 1 -- 172.21.15.8:0/2822836732 wait complete. 2023-10-18T21:48:08.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:06.218927+0000 mgr.smithi008.flmjzp (mgr.14640) 2955 : cluster [DBG] pgmap v2035: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:08.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:06.303714+0000 mgr.smithi008.flmjzp (mgr.14640) 2956 : audit [DBG] from='client.36472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:08.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:06.650885+0000 mgr.smithi008.flmjzp (mgr.14640) 2957 : audit [DBG] from='client.36476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:08.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:06.997213+0000 mgr.smithi008.flmjzp (mgr.14640) 2958 : audit [DBG] from='client.36480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:08.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:07.414369+0000 mon.smithi008 (mon.0) 3343 : audit [DBG] from='client.? 172.21.15.8:0/2871607260' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:08.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:07.790412+0000 mon.smithi008 (mon.0) 3344 : audit [DBG] from='client.? 172.21.15.8:0/1682759992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:48:08.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:06.218927+0000 mgr.smithi008.flmjzp (mgr.14640) 2955 : cluster [DBG] pgmap v2035: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:06.303714+0000 mgr.smithi008.flmjzp (mgr.14640) 2956 : audit [DBG] from='client.36472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:06.650885+0000 mgr.smithi008.flmjzp (mgr.14640) 2957 : audit [DBG] from='client.36476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:06.997213+0000 mgr.smithi008.flmjzp (mgr.14640) 2958 : audit [DBG] from='client.36480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:07.414369+0000 mon.smithi008 (mon.0) 3343 : audit [DBG] from='client.? 172.21.15.8:0/2871607260' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:07.790412+0000 mon.smithi008 (mon.0) 3344 : audit [DBG] from='client.? 172.21.15.8:0/1682759992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:48:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:08.138625+0000 mgr.smithi008.flmjzp (mgr.14640) 2959 : audit [DBG] from='client.36492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:08.219529+0000 mgr.smithi008.flmjzp (mgr.14640) 2960 : cluster [DBG] pgmap v2036: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:10.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:08.138625+0000 mgr.smithi008.flmjzp (mgr.14640) 2959 : audit [DBG] from='client.36492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:08.219529+0000 mgr.smithi008.flmjzp (mgr.14640) 2960 : cluster [DBG] pgmap v2036: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:12.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:10.220357+0000 mgr.smithi008.flmjzp (mgr.14640) 2961 : cluster [DBG] pgmap v2037: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:12.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:10.220357+0000 mgr.smithi008.flmjzp (mgr.14640) 2961 : cluster [DBG] pgmap v2037: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:14.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:12.221047+0000 mgr.smithi008.flmjzp (mgr.14640) 2962 : cluster [DBG] pgmap v2038: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:14.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:12.221047+0000 mgr.smithi008.flmjzp (mgr.14640) 2962 : cluster [DBG] pgmap v2038: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:14.237663+0000 mon.smithi008 (mon.0) 3345 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:14.239917+0000 mon.smithi008 (mon.0) 3346 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:14.240940+0000 mon.smithi008 (mon.0) 3347 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:14.247149+0000 mon.smithi008 (mon.0) 3348 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:14.255312+0000 mon.smithi008 (mon.0) 3349 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:14.258371+0000 mon.smithi008 (mon.0) 3350 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:14.259980+0000 mon.smithi008 (mon.0) 3351 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:15.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:14.261509+0000 mon.smithi008 (mon.0) 3352 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:15.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:14.263477+0000 mon.smithi008 (mon.0) 3353 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:15.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:14.237663+0000 mon.smithi008 (mon.0) 3345 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:14.239917+0000 mon.smithi008 (mon.0) 3346 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:14.240940+0000 mon.smithi008 (mon.0) 3347 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:14.247149+0000 mon.smithi008 (mon.0) 3348 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:14.255312+0000 mon.smithi008 (mon.0) 3349 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:14.258371+0000 mon.smithi008 (mon.0) 3350 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:14.259980+0000 mon.smithi008 (mon.0) 3351 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:14.261509+0000 mon.smithi008 (mon.0) 3352 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:14.263477+0000 mon.smithi008 (mon.0) 3353 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:14.221863+0000 mgr.smithi008.flmjzp (mgr.14640) 2963 : cluster [DBG] pgmap v2039: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:14.241792+0000 mgr.smithi008.flmjzp (mgr.14640) 2964 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:14.242365+0000 mgr.smithi008.flmjzp (mgr.14640) 2965 : cluster [DBG] pgmap v2040: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:14.242688+0000 mgr.smithi008.flmjzp (mgr.14640) 2966 : cluster [DBG] pgmap v2041: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:14.265359+0000 mgr.smithi008.flmjzp (mgr.14640) 2967 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:14.221863+0000 mgr.smithi008.flmjzp (mgr.14640) 2963 : cluster [DBG] pgmap v2039: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:14.241792+0000 mgr.smithi008.flmjzp (mgr.14640) 2964 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:14.242365+0000 mgr.smithi008.flmjzp (mgr.14640) 2965 : cluster [DBG] pgmap v2040: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:14.242688+0000 mgr.smithi008.flmjzp (mgr.14640) 2966 : cluster [DBG] pgmap v2041: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:14.265359+0000 mgr.smithi008.flmjzp (mgr.14640) 2967 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:18.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:16.243302+0000 mgr.smithi008.flmjzp (mgr.14640) 2968 : cluster [DBG] pgmap v2042: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:18.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:16.243302+0000 mgr.smithi008.flmjzp (mgr.14640) 2968 : cluster [DBG] pgmap v2042: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:18.243791+0000 mgr.smithi008.flmjzp (mgr.14640) 2969 : cluster [DBG] pgmap v2043: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:20.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:18.243791+0000 mgr.smithi008.flmjzp (mgr.14640) 2969 : cluster [DBG] pgmap v2043: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:22.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:20.244364+0000 mgr.smithi008.flmjzp (mgr.14640) 2970 : cluster [DBG] pgmap v2044: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:20.244364+0000 mgr.smithi008.flmjzp (mgr.14640) 2970 : cluster [DBG] pgmap v2044: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:24.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:22.245265+0000 mgr.smithi008.flmjzp (mgr.14640) 2971 : cluster [DBG] pgmap v2045: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:24.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:22.245265+0000 mgr.smithi008.flmjzp (mgr.14640) 2971 : cluster [DBG] pgmap v2045: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:24.245912+0000 mgr.smithi008.flmjzp (mgr.14640) 2972 : cluster [DBG] pgmap v2046: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:24.267578+0000 mon.smithi008 (mon.0) 3354 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:24.833681+0000 mon.smithi008 (mon.0) 3355 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:24.834819+0000 mon.smithi008 (mon.0) 3356 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:24.835733+0000 mgr.smithi008.flmjzp (mgr.14640) 2973 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:24.836401+0000 mgr.smithi008.flmjzp (mgr.14640) 2974 : cluster [DBG] pgmap v2047: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:24.836761+0000 mgr.smithi008.flmjzp (mgr.14640) 2975 : cluster [DBG] pgmap v2048: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:24.841947+0000 mon.smithi008 (mon.0) 3357 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:24.848490+0000 mon.smithi008 (mon.0) 3358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:24.851673+0000 mon.smithi008 (mon.0) 3359 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:24.853296+0000 mon.smithi008 (mon.0) 3360 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:25.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:24.854821+0000 mon.smithi008 (mon.0) 3361 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:25.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:24.856694+0000 mon.smithi008 (mon.0) 3362 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:25.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:24.858572+0000 mgr.smithi008.flmjzp (mgr.14640) 2976 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:25.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:24.245912+0000 mgr.smithi008.flmjzp (mgr.14640) 2972 : cluster [DBG] pgmap v2046: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:24.267578+0000 mon.smithi008 (mon.0) 3354 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:24.833681+0000 mon.smithi008 (mon.0) 3355 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:24.834819+0000 mon.smithi008 (mon.0) 3356 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:24.835733+0000 mgr.smithi008.flmjzp (mgr.14640) 2973 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:24.836401+0000 mgr.smithi008.flmjzp (mgr.14640) 2974 : cluster [DBG] pgmap v2047: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:24.836761+0000 mgr.smithi008.flmjzp (mgr.14640) 2975 : cluster [DBG] pgmap v2048: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:24.841947+0000 mon.smithi008 (mon.0) 3357 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:24.848490+0000 mon.smithi008 (mon.0) 3358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:24.851673+0000 mon.smithi008 (mon.0) 3359 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:25.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:24.853296+0000 mon.smithi008 (mon.0) 3360 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:25.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:24.854821+0000 mon.smithi008 (mon.0) 3361 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:25.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:24.856694+0000 mon.smithi008 (mon.0) 3362 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:25.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:24.858572+0000 mgr.smithi008.flmjzp (mgr.14640) 2976 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:26.837349+0000 mgr.smithi008.flmjzp (mgr.14640) 2977 : cluster [DBG] pgmap v2049: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:28.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:26.837349+0000 mgr.smithi008.flmjzp (mgr.14640) 2977 : cluster [DBG] pgmap v2049: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:28.838138+0000 mgr.smithi008.flmjzp (mgr.14640) 2978 : cluster [DBG] pgmap v2050: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:30.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:28.838138+0000 mgr.smithi008.flmjzp (mgr.14640) 2978 : cluster [DBG] pgmap v2050: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:31.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:30.838895+0000 mgr.smithi008.flmjzp (mgr.14640) 2979 : cluster [DBG] pgmap v2051: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:30.838895+0000 mgr.smithi008.flmjzp (mgr.14640) 2979 : cluster [DBG] pgmap v2051: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:32.839596+0000 mgr.smithi008.flmjzp (mgr.14640) 2980 : cluster [DBG] pgmap v2052: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:34.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:32.839596+0000 mgr.smithi008.flmjzp (mgr.14640) 2980 : cluster [DBG] pgmap v2052: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:35.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:34.864791+0000 mon.smithi008 (mon.0) 3363 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:35.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:34.866922+0000 mon.smithi008 (mon.0) 3364 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:35.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:34.868014+0000 mon.smithi008 (mon.0) 3365 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:35.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:34.874784+0000 mon.smithi008 (mon.0) 3366 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:35.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:34.881477+0000 mon.smithi008 (mon.0) 3367 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:35.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:34.884411+0000 mon.smithi008 (mon.0) 3368 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:35.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:34.886125+0000 mon.smithi008 (mon.0) 3369 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:35.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:34.887683+0000 mon.smithi008 (mon.0) 3370 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:35.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:34.889637+0000 mon.smithi008 (mon.0) 3371 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:34.864791+0000 mon.smithi008 (mon.0) 3363 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:34.866922+0000 mon.smithi008 (mon.0) 3364 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:34.868014+0000 mon.smithi008 (mon.0) 3365 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:34.874784+0000 mon.smithi008 (mon.0) 3366 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:35.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:34.881477+0000 mon.smithi008 (mon.0) 3367 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:35.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:34.884411+0000 mon.smithi008 (mon.0) 3368 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:35.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:34.886125+0000 mon.smithi008 (mon.0) 3369 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:35.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:34.887683+0000 mon.smithi008 (mon.0) 3370 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:35.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:34.889637+0000 mon.smithi008 (mon.0) 3371 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:36.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:34.840281+0000 mgr.smithi008.flmjzp (mgr.14640) 2981 : cluster [DBG] pgmap v2053: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:36.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:34.868948+0000 mgr.smithi008.flmjzp (mgr.14640) 2982 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:36.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:34.869595+0000 mgr.smithi008.flmjzp (mgr.14640) 2983 : cluster [DBG] pgmap v2054: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:36.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:34.869829+0000 mgr.smithi008.flmjzp (mgr.14640) 2984 : cluster [DBG] pgmap v2055: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:36.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:34.891483+0000 mgr.smithi008.flmjzp (mgr.14640) 2985 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:34.840281+0000 mgr.smithi008.flmjzp (mgr.14640) 2981 : cluster [DBG] pgmap v2053: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:34.868948+0000 mgr.smithi008.flmjzp (mgr.14640) 2982 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:34.869595+0000 mgr.smithi008.flmjzp (mgr.14640) 2983 : cluster [DBG] pgmap v2054: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:34.869829+0000 mgr.smithi008.flmjzp (mgr.14640) 2984 : cluster [DBG] pgmap v2055: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:36.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:34.891483+0000 mgr.smithi008.flmjzp (mgr.14640) 2985 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:36.870493+0000 mgr.smithi008.flmjzp (mgr.14640) 2986 : cluster [DBG] pgmap v2056: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:38.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:36.870493+0000 mgr.smithi008.flmjzp (mgr.14640) 2986 : cluster [DBG] pgmap v2056: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.293+0000 7f792bfff700 1 -- 172.21.15.8:0/594244548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c0f77d0 msgr2=0x7f792c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.293+0000 7f792bfff700 1 --2- 172.21.15.8:0/594244548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c0f77d0 0x7f792c0f7c30 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f7920004660 tx=0x7f7920009b30).stop 2023-10-18T21:48:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.293+0000 7f792bfff700 1 -- 172.21.15.8:0/594244548 shutdown_connections 2023-10-18T21:48:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.293+0000 7f792bfff700 1 --2- 172.21.15.8:0/594244548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c0f77d0 0x7f792c0f7c30 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.293+0000 7f792bfff700 1 --2- 172.21.15.8:0/594244548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c0f6530 0x7f792c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.293+0000 7f792bfff700 1 -- 172.21.15.8:0/594244548 >> 172.21.15.8:0/594244548 conn(0x7f792c0f1c90 msgr2=0x7f792c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:38.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.293+0000 7f792bfff700 1 -- 172.21.15.8:0/594244548 shutdown_connections 2023-10-18T21:48:38.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.293+0000 7f792bfff700 1 -- 172.21.15.8:0/594244548 wait complete. 2023-10-18T21:48:38.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.294+0000 7f792bfff700 1 Processor -- start 2023-10-18T21:48:38.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.294+0000 7f792bfff700 1 -- start start 2023-10-18T21:48:38.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.294+0000 7f792bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c0f6530 0x7f792c108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:38.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.294+0000 7f792bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c0f77d0 0x7f792c109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:38.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.294+0000 7f792bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c1099c0 con 0x7f792c0f77d0 2023-10-18T21:48:38.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.294+0000 7f792bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c109b00 con 0x7f792c0f6530 2023-10-18T21:48:38.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.295+0000 7f792a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c0f77d0 0x7f792c109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:38.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.295+0000 7f792a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c0f77d0 0x7f792c109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54274/0 (socket says 172.21.15.8:54274) 2023-10-18T21:48:38.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.295+0000 7f792a7fc700 1 -- 172.21.15.8:0/1332620891 learned_addr learned my addr 172.21.15.8:0/1332620891 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:38.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.295+0000 7f792affd700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c0f6530 0x7f792c108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.295+0000 7f792a7fc700 1 -- 172.21.15.8:0/1332620891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c0f6530 msgr2=0x7f792c108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.295+0000 7f792a7fc700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c0f6530 0x7f792c108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.295+0000 7f792a7fc700 1 -- 172.21.15.8:0/1332620891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7920005040 con 0x7f792c0f77d0 2023-10-18T21:48:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.295+0000 7f792a7fc700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c0f77d0 0x7f792c109410 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f7920004320 tx=0x7f792000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:38.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.295+0000 7f79137fe700 1 -- 172.21.15.8:0/1332620891 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7920019070 con 0x7f792c0f77d0 2023-10-18T21:48:38.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.296+0000 7f79137fe700 1 -- 172.21.15.8:0/1332620891 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f792001e420 con 0x7f792c0f77d0 2023-10-18T21:48:38.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.296+0000 7f792bfff700 1 -- 172.21.15.8:0/1332620891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c10a440 con 0x7f792c0f77d0 2023-10-18T21:48:38.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.296+0000 7f79137fe700 1 -- 172.21.15.8:0/1332620891 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7920014680 con 0x7f792c0f77d0 2023-10-18T21:48:38.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.296+0000 7f792bfff700 1 -- 172.21.15.8:0/1332620891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c10a920 con 0x7f792c0f77d0 2023-10-18T21:48:38.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.297+0000 7f792bfff700 1 -- 172.21.15.8:0/1332620891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792c045ad0 con 0x7f792c0f77d0 2023-10-18T21:48:38.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.298+0000 7f79137fe700 1 -- 172.21.15.8:0/1332620891 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f792001e590 con 0x7f792c0f77d0 2023-10-18T21:48:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.298+0000 7f79137fe700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7914060f70 0x7f7914063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.299+0000 7f79137fe700 1 -- 172.21.15.8:0/1332620891 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f792007ddc0 con 0x7f792c0f77d0 2023-10-18T21:48:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.299+0000 7f792affd700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7914060f70 0x7f7914063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:38.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.299+0000 7f792affd700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7914060f70 0x7f7914063430 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f791c009fd0 tx=0x7f791c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.303+0000 7f79137fe700 1 -- 172.21.15.8:0/1332620891 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7920081030 con 0x7f792c0f77d0 2023-10-18T21:48:38.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.503+0000 7f792bfff700 1 -- 172.21.15.8:0/1332620891 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f792c0fc190 con 0x7f7914060f70 2023-10-18T21:48:38.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.504+0000 7f79137fe700 1 -- 172.21.15.8:0/1332620891 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f792c0fc190 con 0x7f7914060f70 2023-10-18T21:48:38.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 -- 172.21.15.8:0/1332620891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7914060f70 msgr2=0x7f7914063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:38.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7914060f70 0x7f7914063430 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f791c009fd0 tx=0x7f791c00b040).stop 2023-10-18T21:48:38.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 -- 172.21.15.8:0/1332620891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c0f77d0 msgr2=0x7f792c109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:38.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c0f77d0 0x7f792c109410 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f7920004320 tx=0x7f792000b040).stop 2023-10-18T21:48:38.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 -- 172.21.15.8:0/1332620891 shutdown_connections 2023-10-18T21:48:38.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7914060f70 0x7f7914063430 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c0f6530 0x7f792c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 --2- 172.21.15.8:0/1332620891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c0f77d0 0x7f792c109410 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 -- 172.21.15.8:0/1332620891 >> 172.21.15.8:0/1332620891 conn(0x7f792c0f1c90 msgr2=0x7f792c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:38.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 -- 172.21.15.8:0/1332620891 shutdown_connections 2023-10-18T21:48:38.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.506+0000 7f792bfff700 1 -- 172.21.15.8:0/1332620891 wait complete. 2023-10-18T21:48:38.523 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:48:38.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.644+0000 7fc391ada700 1 -- 172.21.15.8:0/617805179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc38c06a3b0 msgr2=0x7fc38c06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:38.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.644+0000 7fc391ada700 1 --2- 172.21.15.8:0/617805179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc38c06a3b0 0x7fc38c06a830 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fc378004660 tx=0x7fc378009b30).stop 2023-10-18T21:48:38.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.644+0000 7fc391ada700 1 -- 172.21.15.8:0/617805179 shutdown_connections 2023-10-18T21:48:38.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.644+0000 7fc391ada700 1 --2- 172.21.15.8:0/617805179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc38c06a3b0 0x7fc38c06a830 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.644+0000 7fc391ada700 1 --2- 172.21.15.8:0/617805179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc38c06b9c0 0x7fc38c069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.644+0000 7fc391ada700 1 -- 172.21.15.8:0/617805179 >> 172.21.15.8:0/617805179 conn(0x7fc38c0f1c90 msgr2=0x7fc38c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:38.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.644+0000 7fc391ada700 1 -- 172.21.15.8:0/617805179 shutdown_connections 2023-10-18T21:48:38.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.644+0000 7fc391ada700 1 -- 172.21.15.8:0/617805179 wait complete. 2023-10-18T21:48:38.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.645+0000 7fc391ada700 1 Processor -- start 2023-10-18T21:48:38.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.645+0000 7fc391ada700 1 -- start start 2023-10-18T21:48:38.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc391ada700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc38c06a3b0 0x7fc38c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:38.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc391ada700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc38c06b9c0 0x7fc38c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:38.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc391ada700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c109970 con 0x7fc38c06b9c0 2023-10-18T21:48:38.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc391ada700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c109ab0 con 0x7fc38c06a3b0 2023-10-18T21:48:38.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc38c06b9c0 0x7fc38c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:38.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc38c06b9c0 0x7fc38c1093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54294/0 (socket says 172.21.15.8:54294) 2023-10-18T21:48:38.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc38bfff700 1 -- 172.21.15.8:0/1237916639 learned_addr learned my addr 172.21.15.8:0/1237916639 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:38.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc390ad8700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc38c06a3b0 0x7fc38c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc38bfff700 1 -- 172.21.15.8:0/1237916639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc38c06a3b0 msgr2=0x7fc38c108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc38bfff700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc38c06a3b0 0x7fc38c108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.646+0000 7fc38bfff700 1 -- 172.21.15.8:0/1237916639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc378005040 con 0x7fc38c06b9c0 2023-10-18T21:48:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.647+0000 7fc38bfff700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc38c06b9c0 0x7fc38c1093c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fc378004d80 tx=0x7fc37800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.647+0000 7fc3897fa700 1 -- 172.21.15.8:0/1237916639 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc378019070 con 0x7fc38c06b9c0 2023-10-18T21:48:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.647+0000 7fc3897fa700 1 -- 172.21.15.8:0/1237916639 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc37801e420 con 0x7fc38c06b9c0 2023-10-18T21:48:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.647+0000 7fc391ada700 1 -- 172.21.15.8:0/1237916639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c10a3f0 con 0x7fc38c06b9c0 2023-10-18T21:48:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.647+0000 7fc3897fa700 1 -- 172.21.15.8:0/1237916639 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc378014680 con 0x7fc38c06b9c0 2023-10-18T21:48:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.647+0000 7fc391ada700 1 -- 172.21.15.8:0/1237916639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c10a8d0 con 0x7fc38c06b9c0 2023-10-18T21:48:38.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.648+0000 7fc391ada700 1 -- 172.21.15.8:0/1237916639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c045ad0 con 0x7fc38c06b9c0 2023-10-18T21:48:38.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.649+0000 7fc3897fa700 1 -- 172.21.15.8:0/1237916639 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc37801e9c0 con 0x7fc38c06b9c0 2023-10-18T21:48:38.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.650+0000 7fc3897fa700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc37c060f70 0x7fc37c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:38.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.650+0000 7fc3897fa700 1 -- 172.21.15.8:0/1237916639 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc37807dea0 con 0x7fc38c06b9c0 2023-10-18T21:48:38.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.650+0000 7fc390ad8700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc37c060f70 0x7fc37c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:38.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.651+0000 7fc390ad8700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc37c060f70 0x7fc37c063430 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fc380007f80 tx=0x7fc38000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:38.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.654+0000 7fc3897fa700 1 -- 172.21.15.8:0/1237916639 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc378051480 con 0x7fc38c06b9c0 2023-10-18T21:48:38.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.854+0000 7fc391ada700 1 -- 172.21.15.8:0/1237916639 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc38c10aaf0 con 0x7fc37c060f70 2023-10-18T21:48:38.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.856+0000 7fc3897fa700 1 -- 172.21.15.8:0/1237916639 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc38c10aaf0 con 0x7fc37c060f70 2023-10-18T21:48:38.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 -- 172.21.15.8:0/1237916639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc37c060f70 msgr2=0x7fc37c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:38.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc37c060f70 0x7fc37c063430 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fc380007f80 tx=0x7fc38000b040).stop 2023-10-18T21:48:38.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 -- 172.21.15.8:0/1237916639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc38c06b9c0 msgr2=0x7fc38c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:38.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc38c06b9c0 0x7fc38c1093c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fc378004d80 tx=0x7fc37800b040).stop 2023-10-18T21:48:38.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 -- 172.21.15.8:0/1237916639 shutdown_connections 2023-10-18T21:48:38.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc37c060f70 0x7fc37c063430 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc38c06a3b0 0x7fc38c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 --2- 172.21.15.8:0/1237916639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc38c06b9c0 0x7fc38c1093c0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 -- 172.21.15.8:0/1237916639 >> 172.21.15.8:0/1237916639 conn(0x7fc38c0f1c90 msgr2=0x7fc38c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:38.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 -- 172.21.15.8:0/1237916639 shutdown_connections 2023-10-18T21:48:38.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.858+0000 7fc391ada700 1 -- 172.21.15.8:0/1237916639 wait complete. 2023-10-18T21:48:38.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.996+0000 7efd98bdd700 1 -- 172.21.15.8:0/3976204352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd940f6530 msgr2=0x7efd940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.996+0000 7efd98bdd700 1 --2- 172.21.15.8:0/3976204352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd940f6530 0x7efd940f6950 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7efd84004660 tx=0x7efd84009b30).stop 2023-10-18T21:48:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.996+0000 7efd98bdd700 1 -- 172.21.15.8:0/3976204352 shutdown_connections 2023-10-18T21:48:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.996+0000 7efd98bdd700 1 --2- 172.21.15.8:0/3976204352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd940f77d0 0x7efd940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.996+0000 7efd98bdd700 1 --2- 172.21.15.8:0/3976204352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd940f6530 0x7efd940f6950 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.996+0000 7efd98bdd700 1 -- 172.21.15.8:0/3976204352 >> 172.21.15.8:0/3976204352 conn(0x7efd940f1c90 msgr2=0x7efd940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.996+0000 7efd98bdd700 1 -- 172.21.15.8:0/3976204352 shutdown_connections 2023-10-18T21:48:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.996+0000 7efd98bdd700 1 -- 172.21.15.8:0/3976204352 wait complete. 2023-10-18T21:48:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.997+0000 7efd98bdd700 1 Processor -- start 2023-10-18T21:48:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.997+0000 7efd98bdd700 1 -- start start 2023-10-18T21:48:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd98bdd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd940f6530 0x7efd9406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd98bdd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd940f77d0 0x7efd94069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd98bdd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9406a380 con 0x7efd940f77d0 2023-10-18T21:48:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd98bdd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9406a4c0 con 0x7efd940f6530 2023-10-18T21:48:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd940f77d0 0x7efd94069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd940f77d0 0x7efd94069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54314/0 (socket says 172.21.15.8:54314) 2023-10-18T21:48:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd92ffd700 1 -- 172.21.15.8:0/417889093 learned_addr learned my addr 172.21.15.8:0/417889093 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd937fe700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd940f6530 0x7efd9406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd92ffd700 1 -- 172.21.15.8:0/417889093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd940f6530 msgr2=0x7efd9406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd92ffd700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd940f6530 0x7efd9406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd92ffd700 1 -- 172.21.15.8:0/417889093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84005040 con 0x7efd940f77d0 2023-10-18T21:48:39.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.998+0000 7efd92ffd700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd940f77d0 0x7efd94069e20 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7efd880026d0 tx=0x7efd88009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.999+0000 7efd7bfff700 1 -- 172.21.15.8:0/417889093 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd880079c0 con 0x7efd940f77d0 2023-10-18T21:48:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.999+0000 7efd7bfff700 1 -- 172.21.15.8:0/417889093 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efd8800f040 con 0x7efd940f77d0 2023-10-18T21:48:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.999+0000 7efd7bfff700 1 -- 172.21.15.8:0/417889093 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd88014980 con 0x7efd940f77d0 2023-10-18T21:48:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.999+0000 7efd98bdd700 1 -- 172.21.15.8:0/417889093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9406a7a0 con 0x7efd940f77d0 2023-10-18T21:48:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:38.999+0000 7efd98bdd700 1 -- 172.21.15.8:0/417889093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9410ede0 con 0x7efd940f77d0 2023-10-18T21:48:39.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.000+0000 7efd98bdd700 1 -- 172.21.15.8:0/417889093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd94045ad0 con 0x7efd940f77d0 2023-10-18T21:48:39.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.001+0000 7efd7bfff700 1 -- 172.21.15.8:0/417889093 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7efd880090d0 con 0x7efd940f77d0 2023-10-18T21:48:39.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.002+0000 7efd7bfff700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 0x7efd7c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:39.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.002+0000 7efd7bfff700 1 -- 172.21.15.8:0/417889093 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7efd8807c8a0 con 0x7efd940f77d0 2023-10-18T21:48:39.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.002+0000 7efd937fe700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 0x7efd7c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:39.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.003+0000 7efd937fe700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 0x7efd7c063430 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7efd84005010 tx=0x7efd84009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:39.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.006+0000 7efd7bfff700 1 -- 172.21.15.8:0/417889093 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efd8804c580 con 0x7efd940f77d0 2023-10-18T21:48:39.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.200+0000 7efd98bdd700 1 -- 172.21.15.8:0/417889093 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd940fedd0 con 0x7efd7c060f70 2023-10-18T21:48:39.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.210+0000 7efd7bfff700 1 -- 172.21.15.8:0/417889093 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7efd940fedd0 con 0x7efd7c060f70 2023-10-18T21:48:39.212 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:48:39.212 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (55m) 2m ago 56m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:48:39.212 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (49m) 2m ago 56m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:48:39.212 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (49m) 45s ago 55m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:48:39.213 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (55m) 2m ago 56m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:48:39.213 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 52m - - 2023-10-18T21:48:39.213 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 52m - - 2023-10-18T21:48:39.213 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 45s ago 52m - - 2023-10-18T21:48:39.213 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 45s ago 52m - - 2023-10-18T21:48:39.214 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (50m) 2m ago 58m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:48:39.214 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (49m) 45s ago 55m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:48:39.214 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (49m) 2m ago 58m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:48:39.214 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (49m) 45s ago 55m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:48:39.214 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (56m) 2m ago 56m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:48:39.215 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (55m) 45s ago 55m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:48:39.215 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (48m) 2m ago 55m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:48:39.215 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (46m) 2m ago 55m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:48:39.215 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (46m) 2m ago 54m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:48:39.215 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (45m) 45s ago 54m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:48:39.216 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (45m) 45s ago 54m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:48:39.216 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (44m) 45s ago 53m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:48:39.216 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (50m) 2m ago 56m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:48:39.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 -- 172.21.15.8:0/417889093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 msgr2=0x7efd7c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:39.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 0x7efd7c063430 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7efd84005010 tx=0x7efd84009b30).stop 2023-10-18T21:48:39.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 -- 172.21.15.8:0/417889093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd940f77d0 msgr2=0x7efd94069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:39.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd940f77d0 0x7efd94069e20 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7efd880026d0 tx=0x7efd88009de0).stop 2023-10-18T21:48:39.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 -- 172.21.15.8:0/417889093 shutdown_connections 2023-10-18T21:48:39.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd7c060f70 0x7efd7c063430 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd940f6530 0x7efd9406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 --2- 172.21.15.8:0/417889093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd940f77d0 0x7efd94069e20 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 -- 172.21.15.8:0/417889093 >> 172.21.15.8:0/417889093 conn(0x7efd940f1c90 msgr2=0x7efd940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:39.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 -- 172.21.15.8:0/417889093 shutdown_connections 2023-10-18T21:48:39.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.212+0000 7efd98bdd700 1 -- 172.21.15.8:0/417889093 wait complete. 2023-10-18T21:48:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.347+0000 7fecfa37c700 1 -- 172.21.15.8:0/3069477345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf4060310 msgr2=0x7fecf40fb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.347+0000 7fecfa37c700 1 --2- 172.21.15.8:0/3069477345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf4060310 0x7fecf40fb520 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fecf0004660 tx=0x7fecf0009b30).stop 2023-10-18T21:48:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.347+0000 7fecfa37c700 1 -- 172.21.15.8:0/3069477345 shutdown_connections 2023-10-18T21:48:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.347+0000 7fecfa37c700 1 --2- 172.21.15.8:0/3069477345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecf40fba10 0x7fecf40fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.347+0000 7fecfa37c700 1 --2- 172.21.15.8:0/3069477345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf4060310 0x7fecf40fb520 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.347+0000 7fecfa37c700 1 -- 172.21.15.8:0/3069477345 >> 172.21.15.8:0/3069477345 conn(0x7fecf40f0ba0 msgr2=0x7fecf40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.347+0000 7fecfa37c700 1 -- 172.21.15.8:0/3069477345 shutdown_connections 2023-10-18T21:48:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.347+0000 7fecfa37c700 1 -- 172.21.15.8:0/3069477345 wait complete. 2023-10-18T21:48:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.348+0000 7fecfa37c700 1 Processor -- start 2023-10-18T21:48:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.349+0000 7fecfa37c700 1 -- start start 2023-10-18T21:48:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.349+0000 7fecfa37c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf4060310 0x7fecf4108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.349+0000 7fecfa37c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecf40fba10 0x7fecf4109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.349+0000 7fecfa37c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4109a30 con 0x7fecf4060310 2023-10-18T21:48:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.349+0000 7fecfa37c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4109b70 con 0x7fecf40fba10 2023-10-18T21:48:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.349+0000 7fecf937a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf4060310 0x7fecf4108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.349+0000 7fecf937a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf4060310 0x7fecf4108f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54334/0 (socket says 172.21.15.8:54334) 2023-10-18T21:48:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.349+0000 7fecf937a700 1 -- 172.21.15.8:0/337356909 learned_addr learned my addr 172.21.15.8:0/337356909 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.350+0000 7fecf8b79700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecf40fba10 0x7fecf4109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.350+0000 7fecf937a700 1 -- 172.21.15.8:0/337356909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecf40fba10 msgr2=0x7fecf4109480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.350+0000 7fecf937a700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecf40fba10 0x7fecf4109480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.350+0000 7fecf937a700 1 -- 172.21.15.8:0/337356909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0005040 con 0x7fecf4060310 2023-10-18T21:48:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.350+0000 7fecf8b79700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecf40fba10 0x7fecf4109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:48:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.350+0000 7fecf937a700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf4060310 0x7fecf4108f90 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fecf0009f50 tx=0x7fecf0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.350+0000 7fece9ffb700 1 -- 172.21.15.8:0/337356909 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf0018070 con 0x7fecf4060310 2023-10-18T21:48:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.350+0000 7fece9ffb700 1 -- 172.21.15.8:0/337356909 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fecf0009630 con 0x7fecf4060310 2023-10-18T21:48:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.350+0000 7fecfa37c700 1 -- 172.21.15.8:0/337356909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf410a4b0 con 0x7fecf4060310 2023-10-18T21:48:39.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.350+0000 7fece9ffb700 1 -- 172.21.15.8:0/337356909 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf001c3c0 con 0x7fecf4060310 2023-10-18T21:48:39.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.351+0000 7fecfa37c700 1 -- 172.21.15.8:0/337356909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf410aa10 con 0x7fecf4060310 2023-10-18T21:48:39.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.352+0000 7fecfa37c700 1 -- 172.21.15.8:0/337356909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf4045ad0 con 0x7fecf4060310 2023-10-18T21:48:39.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.352+0000 7fece9ffb700 1 -- 172.21.15.8:0/337356909 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fecf001d9e0 con 0x7fecf4060310 2023-10-18T21:48:39.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.353+0000 7fece9ffb700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fece0060f70 0x7fece0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:39.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.353+0000 7fece9ffb700 1 -- 172.21.15.8:0/337356909 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fecf007e750 con 0x7fecf4060310 2023-10-18T21:48:39.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.354+0000 7fecf8b79700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fece0060f70 0x7fece0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:39.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.354+0000 7fecf8b79700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fece0060f70 0x7fece0063430 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fecf40600e0 tx=0x7fece4009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:39.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.358+0000 7fece9ffb700 1 -- 172.21.15.8:0/337356909 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fecf0051d30 con 0x7fecf4060310 2023-10-18T21:48:39.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.615+0000 7fecfa37c700 1 -- 172.21.15.8:0/337356909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fecf4100fd0 con 0x7fecf4060310 2023-10-18T21:48:39.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.616+0000 7fece9ffb700 1 -- 172.21.15.8:0/337356909 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fecf0051920 con 0x7fecf4060310 2023-10-18T21:48:39.618 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:48:39.618 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:48:39.619 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:48:39.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:48:39.619 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:48:39.619 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:48:39.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:48:39.620 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:48:39.620 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:48:39.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:48:39.620 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:48:39.620 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:48:39.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:48:39.621 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:48:39.621 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:48:39.621 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:48:39.621 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:48:39.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 -- 172.21.15.8:0/337356909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fece0060f70 msgr2=0x7fece0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:39.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fece0060f70 0x7fece0063430 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fecf40600e0 tx=0x7fece4009be0).stop 2023-10-18T21:48:39.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 -- 172.21.15.8:0/337356909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf4060310 msgr2=0x7fecf4108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:39.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf4060310 0x7fecf4108f90 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fecf0009f50 tx=0x7fecf0009b30).stop 2023-10-18T21:48:39.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 -- 172.21.15.8:0/337356909 shutdown_connections 2023-10-18T21:48:39.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fece0060f70 0x7fece0063430 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf4060310 0x7fecf4108f90 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 --2- 172.21.15.8:0/337356909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecf40fba10 0x7fecf4109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 -- 172.21.15.8:0/337356909 >> 172.21.15.8:0/337356909 conn(0x7fecf40f0ba0 msgr2=0x7fecf40f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:39.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 -- 172.21.15.8:0/337356909 shutdown_connections 2023-10-18T21:48:39.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.618+0000 7fecfa37c700 1 -- 172.21.15.8:0/337356909 wait complete. 2023-10-18T21:48:39.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.754+0000 7f9e6b59e700 1 -- 172.21.15.8:0/2511021121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e6c0f6530 msgr2=0x7f9e6c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:39.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.754+0000 7f9e6b59e700 1 --2- 172.21.15.8:0/2511021121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e6c0f6530 0x7f9e6c0f6950 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f9e5c004660 tx=0x7f9e5c009b30).stop 2023-10-18T21:48:39.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.755+0000 7f9e6b59e700 1 -- 172.21.15.8:0/2511021121 shutdown_connections 2023-10-18T21:48:39.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.755+0000 7f9e6b59e700 1 --2- 172.21.15.8:0/2511021121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e6c0f77d0 0x7f9e6c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.755+0000 7f9e6b59e700 1 --2- 172.21.15.8:0/2511021121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e6c0f6530 0x7f9e6c0f6950 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.755+0000 7f9e6b59e700 1 -- 172.21.15.8:0/2511021121 >> 172.21.15.8:0/2511021121 conn(0x7f9e6c0f1c90 msgr2=0x7f9e6c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:39.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.755+0000 7f9e6b59e700 1 -- 172.21.15.8:0/2511021121 shutdown_connections 2023-10-18T21:48:39.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.755+0000 7f9e6b59e700 1 -- 172.21.15.8:0/2511021121 wait complete. 2023-10-18T21:48:39.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.755+0000 7f9e6b59e700 1 Processor -- start 2023-10-18T21:48:39.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.756+0000 7f9e6b59e700 1 -- start start 2023-10-18T21:48:39.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.756+0000 7f9e6b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e6c0f6530 0x7f9e6c108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:39.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.756+0000 7f9e6b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e6c0f77d0 0x7f9e6c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:39.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.756+0000 7f9e6b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c109a70 con 0x7f9e6c0f6530 2023-10-18T21:48:39.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.756+0000 7f9e6b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c109bb0 con 0x7f9e6c0f77d0 2023-10-18T21:48:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.756+0000 7f9e6a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e6c0f6530 0x7f9e6c108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.756+0000 7f9e6a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e6c0f6530 0x7f9e6c108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54350/0 (socket says 172.21.15.8:54350) 2023-10-18T21:48:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.756+0000 7f9e6a59c700 1 -- 172.21.15.8:0/3565956457 learned_addr learned my addr 172.21.15.8:0/3565956457 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.756+0000 7f9e69d9b700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e6c0f77d0 0x7f9e6c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.757+0000 7f9e6a59c700 1 -- 172.21.15.8:0/3565956457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e6c0f77d0 msgr2=0x7f9e6c1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.757+0000 7f9e6a59c700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e6c0f77d0 0x7f9e6c1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.757+0000 7f9e6a59c700 1 -- 172.21.15.8:0/3565956457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c005040 con 0x7f9e6c0f6530 2023-10-18T21:48:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.757+0000 7f9e6a59c700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e6c0f6530 0x7f9e6c108fd0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f9e5c009f50 tx=0x7f9e5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.757+0000 7f9e5affd700 1 -- 172.21.15.8:0/3565956457 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e5c018070 con 0x7f9e6c0f6530 2023-10-18T21:48:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.757+0000 7f9e5affd700 1 -- 172.21.15.8:0/3565956457 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9e5c01d8e0 con 0x7f9e6c0f6530 2023-10-18T21:48:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.757+0000 7f9e6b59e700 1 -- 172.21.15.8:0/3565956457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c10a4f0 con 0x7f9e6c0f6530 2023-10-18T21:48:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.757+0000 7f9e5affd700 1 -- 172.21.15.8:0/3565956457 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e5c01c440 con 0x7f9e6c0f6530 2023-10-18T21:48:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.757+0000 7f9e6b59e700 1 -- 172.21.15.8:0/3565956457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c10aa50 con 0x7f9e6c0f6530 2023-10-18T21:48:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.758+0000 7f9e6b59e700 1 -- 172.21.15.8:0/3565956457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c045ad0 con 0x7f9e6c0f6530 2023-10-18T21:48:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.759+0000 7f9e5affd700 1 -- 172.21.15.8:0/3565956457 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9e5c01da50 con 0x7f9e6c0f6530 2023-10-18T21:48:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.761+0000 7f9e5affd700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e54060f70 0x7f9e54063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.761+0000 7f9e5affd700 1 -- 172.21.15.8:0/3565956457 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9e5c07e720 con 0x7f9e6c0f6530 2023-10-18T21:48:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.761+0000 7f9e69d9b700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e54060f70 0x7f9e54063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.762+0000 7f9e69d9b700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e54060f70 0x7f9e54063430 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f9e60007fd0 tx=0x7f9e60009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.765+0000 7f9e5affd700 1 -- 172.21.15.8:0/3565956457 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9e5c051d80 con 0x7f9e6c0f6530 2023-10-18T21:48:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.990+0000 7f9e6b59e700 1 -- 172.21.15.8:0/3565956457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e6c0008d0 con 0x7f9e6c0f6530 2023-10-18T21:48:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.991+0000 7f9e5affd700 1 -- 172.21.15.8:0/3565956457 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f9e5c051970 con 0x7f9e6c0f6530 2023-10-18T21:48:39.993 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:48:39.993 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:48:39.994 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:48:39.994 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:48:39.994 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:48:39.994 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:48:39.994 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:48:39.995 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:48:39.995 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:48:39.995 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:48:39.995 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:48:39.995 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:48:39.996 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:48:39.996 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:48:39.996 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:48:39.996 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:48:39.996 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:48:39.997 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:48:39.997 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:48:39.997 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:48:39.997 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:48:39.997 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:48:39.998 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:48:39.998 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:48:39.998 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:48:39.998 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:48:39.998 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:48:39.999 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:48:39.999 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:48:39.999 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:48:39.999 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:48:39.999 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:48:39.999 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:48:40.000 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:48:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 -- 172.21.15.8:0/3565956457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e54060f70 msgr2=0x7f9e54063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e54060f70 0x7f9e54063430 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f9e60007fd0 tx=0x7f9e60009040).stop 2023-10-18T21:48:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 -- 172.21.15.8:0/3565956457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e6c0f6530 msgr2=0x7f9e6c108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e6c0f6530 0x7f9e6c108fd0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f9e5c009f50 tx=0x7f9e5c009b30).stop 2023-10-18T21:48:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 -- 172.21.15.8:0/3565956457 shutdown_connections 2023-10-18T21:48:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9e54060f70 0x7f9e54063430 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e6c0f6530 0x7f9e6c108fd0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 --2- 172.21.15.8:0/3565956457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e6c0f77d0 0x7f9e6c1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 -- 172.21.15.8:0/3565956457 >> 172.21.15.8:0/3565956457 conn(0x7f9e6c0f1c90 msgr2=0x7f9e6c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 -- 172.21.15.8:0/3565956457 shutdown_connections 2023-10-18T21:48:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:39.993+0000 7f9e6b59e700 1 -- 172.21.15.8:0/3565956457 wait complete. 2023-10-18T21:48:40.003 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:48:40.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.130+0000 7f79289c0700 1 -- 172.21.15.8:0/2920058755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7924060250 msgr2=0x7f79240f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:40.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.130+0000 7f79289c0700 1 --2- 172.21.15.8:0/2920058755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7924060250 0x7f79240f91d0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f7914004660 tx=0x7f7914009b30).stop 2023-10-18T21:48:40.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.130+0000 7f79289c0700 1 -- 172.21.15.8:0/2920058755 shutdown_connections 2023-10-18T21:48:40.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.130+0000 7f79289c0700 1 --2- 172.21.15.8:0/2920058755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79240f96c0 0x7f79240fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:40.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.130+0000 7f79289c0700 1 --2- 172.21.15.8:0/2920058755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7924060250 0x7f79240f91d0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:40.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.130+0000 7f79289c0700 1 -- 172.21.15.8:0/2920058755 >> 172.21.15.8:0/2920058755 conn(0x7f79240f0b90 msgr2=0x7f79240f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:40.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.130+0000 7f79289c0700 1 -- 172.21.15.8:0/2920058755 shutdown_connections 2023-10-18T21:48:40.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.130+0000 7f79289c0700 1 -- 172.21.15.8:0/2920058755 wait complete. 2023-10-18T21:48:40.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.131+0000 7f79289c0700 1 Processor -- start 2023-10-18T21:48:40.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.131+0000 7f79289c0700 1 -- start start 2023-10-18T21:48:40.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.131+0000 7f79289c0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7924060250 0x7f7924106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:40.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.131+0000 7f79289c0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79240f96c0 0x7f7924107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:40.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.131+0000 7f79289c0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7924107870 con 0x7f79240f96c0 2023-10-18T21:48:40.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.131+0000 7f79289c0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7924108080 con 0x7f7924060250 2023-10-18T21:48:40.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f792259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79240f96c0 0x7f7924107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:40.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f7922d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7924060250 0x7f7924106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:40.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f792259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79240f96c0 0x7f7924107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54370/0 (socket says 172.21.15.8:54370) 2023-10-18T21:48:40.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f792259c700 1 -- 172.21.15.8:0/1764647632 learned_addr learned my addr 172.21.15.8:0/1764647632 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:48:40.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f792259c700 1 -- 172.21.15.8:0/1764647632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7924060250 msgr2=0x7f7924106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:40.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f792259c700 1 --2- 172.21.15.8:0/1764647632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7924060250 0x7f7924106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:40.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f792259c700 1 -- 172.21.15.8:0/1764647632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914005040 con 0x7f79240f96c0 2023-10-18T21:48:40.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f792259c700 1 --2- 172.21.15.8:0/1764647632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79240f96c0 0x7f7924107270 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f791800e7c0 tx=0x7f791800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:40.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f790b7fe700 1 -- 172.21.15.8:0/1764647632 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79180092e0 con 0x7f79240f96c0 2023-10-18T21:48:40.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f790b7fe700 1 -- 172.21.15.8:0/1764647632 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f791800f040 con 0x7f79240f96c0 2023-10-18T21:48:40.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f790b7fe700 1 -- 172.21.15.8:0/1764647632 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7918014920 con 0x7f79240f96c0 2023-10-18T21:48:40.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.132+0000 7f79289c0700 1 -- 172.21.15.8:0/1764647632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7924108300 con 0x7f79240f96c0 2023-10-18T21:48:40.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.133+0000 7f79289c0700 1 -- 172.21.15.8:0/1764647632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7924108840 con 0x7f79240f96c0 2023-10-18T21:48:40.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.134+0000 7f79289c0700 1 -- 172.21.15.8:0/1764647632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7924059100 con 0x7f79240f96c0 2023-10-18T21:48:40.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.134+0000 7f790b7fe700 1 -- 172.21.15.8:0/1764647632 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f791801b030 con 0x7f79240f96c0 2023-10-18T21:48:40.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.135+0000 7f790b7fe700 1 --2- 172.21.15.8:0/1764647632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f790c060f70 0x7f790c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:48:40.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.135+0000 7f790b7fe700 1 -- 172.21.15.8:0/1764647632 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f791807c7a0 con 0x7f79240f96c0 2023-10-18T21:48:40.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.136+0000 7f7922d9d700 1 --2- 172.21.15.8:0/1764647632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f790c060f70 0x7f790c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:48:40.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.136+0000 7f7922d9d700 1 --2- 172.21.15.8:0/1764647632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f790c060f70 0x7f790c063430 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f7914009720 tx=0x7f7914016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:48:40.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.140+0000 7f790b7fe700 1 -- 172.21.15.8:0/1764647632 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f791804c370 con 0x7f79240f96c0 2023-10-18T21:48:40.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:38.505225+0000 mgr.smithi008.flmjzp (mgr.14640) 2987 : audit [DBG] from='client.36496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:40.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:38.857078+0000 mgr.smithi008.flmjzp (mgr.14640) 2988 : audit [DBG] from='client.36500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:40.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:38.870987+0000 mgr.smithi008.flmjzp (mgr.14640) 2989 : cluster [DBG] pgmap v2057: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:40.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:39.617406+0000 mon.smithi008 (mon.0) 3372 : audit [DBG] from='client.? 172.21.15.8:0/337356909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:40.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:38.505225+0000 mgr.smithi008.flmjzp (mgr.14640) 2987 : audit [DBG] from='client.36496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:40.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:38.857078+0000 mgr.smithi008.flmjzp (mgr.14640) 2988 : audit [DBG] from='client.36500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:38.870987+0000 mgr.smithi008.flmjzp (mgr.14640) 2989 : cluster [DBG] pgmap v2057: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:39.617406+0000 mon.smithi008 (mon.0) 3372 : audit [DBG] from='client.? 172.21.15.8:0/337356909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:40.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.337+0000 7f79289c0700 1 -- 172.21.15.8:0/1764647632 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79240008d0 con 0x7f790c060f70 2023-10-18T21:48:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.338+0000 7f790b7fe700 1 -- 172.21.15.8:0/1764647632 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f79240008d0 con 0x7f790c060f70 2023-10-18T21:48:40.340 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:48:40.341 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:48:40.341 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:48:40.341 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:48:40.341 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:48:40.341 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:48:40.342 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:48:40.342 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:48:40.342 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:48:40.342 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:48:40.342 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:48:40.343 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:48:40.343 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:48:40.343 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:48:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.340+0000 7f79289c0700 1 -- 172.21.15.8:0/1764647632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f790c060f70 msgr2=0x7f790c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.340+0000 7f79289c0700 1 --2- 172.21.15.8:0/1764647632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f790c060f70 0x7f790c063430 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f7914009720 tx=0x7f7914016040).stop 2023-10-18T21:48:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.340+0000 7f79289c0700 1 -- 172.21.15.8:0/1764647632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79240f96c0 msgr2=0x7f7924107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:48:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.340+0000 7f79289c0700 1 --2- 172.21.15.8:0/1764647632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79240f96c0 0x7f7924107270 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f791800e7c0 tx=0x7f791800b040).stop 2023-10-18T21:48:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.341+0000 7f79289c0700 1 -- 172.21.15.8:0/1764647632 shutdown_connections 2023-10-18T21:48:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.341+0000 7f79289c0700 1 --2- 172.21.15.8:0/1764647632 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f790c060f70 0x7f790c063430 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.341+0000 7f79289c0700 1 --2- 172.21.15.8:0/1764647632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7924060250 0x7f7924106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.341+0000 7f79289c0700 1 --2- 172.21.15.8:0/1764647632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79240f96c0 0x7f7924107270 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:48:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.341+0000 7f79289c0700 1 -- 172.21.15.8:0/1764647632 >> 172.21.15.8:0/1764647632 conn(0x7f79240f0b90 msgr2=0x7f79240f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:48:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.341+0000 7f79289c0700 1 -- 172.21.15.8:0/1764647632 shutdown_connections 2023-10-18T21:48:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:48:40.341+0000 7f79289c0700 1 -- 172.21.15.8:0/1764647632 wait complete. 2023-10-18T21:48:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:39.202850+0000 mgr.smithi008.flmjzp (mgr.14640) 2990 : audit [DBG] from='client.36504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:39.992337+0000 mon.smithi008 (mon.0) 3373 : audit [DBG] from='client.? 172.21.15.8:0/3565956457' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:48:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:39.202850+0000 mgr.smithi008.flmjzp (mgr.14640) 2990 : audit [DBG] from='client.36504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:39.992337+0000 mon.smithi008 (mon.0) 3373 : audit [DBG] from='client.? 172.21.15.8:0/3565956457' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:48:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:40.339776+0000 mgr.smithi008.flmjzp (mgr.14640) 2991 : audit [DBG] from='client.36516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:40.871475+0000 mgr.smithi008.flmjzp (mgr.14640) 2992 : cluster [DBG] pgmap v2058: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:42.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:40.339776+0000 mgr.smithi008.flmjzp (mgr.14640) 2991 : audit [DBG] from='client.36516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:48:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:40.871475+0000 mgr.smithi008.flmjzp (mgr.14640) 2992 : cluster [DBG] pgmap v2058: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:42.872014+0000 mgr.smithi008.flmjzp (mgr.14640) 2993 : cluster [DBG] pgmap v2059: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:42.872014+0000 mgr.smithi008.flmjzp (mgr.14640) 2993 : cluster [DBG] pgmap v2059: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:45.190 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:44.901074+0000 mon.smithi008 (mon.0) 3374 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:45.190 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:44.903176+0000 mon.smithi008 (mon.0) 3375 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:45.190 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:44.904206+0000 mon.smithi008 (mon.0) 3376 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:45.190 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:44.910966+0000 mon.smithi008 (mon.0) 3377 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:45.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:44.901074+0000 mon.smithi008 (mon.0) 3374 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:44.903176+0000 mon.smithi008 (mon.0) 3375 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:44.904206+0000 mon.smithi008 (mon.0) 3376 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:44.910966+0000 mon.smithi008 (mon.0) 3377 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:46.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:44.872723+0000 mgr.smithi008.flmjzp (mgr.14640) 2994 : cluster [DBG] pgmap v2060: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:46.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:44.905110+0000 mgr.smithi008.flmjzp (mgr.14640) 2995 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:46.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:44.905643+0000 mgr.smithi008.flmjzp (mgr.14640) 2996 : cluster [DBG] pgmap v2061: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:46.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:44.905987+0000 mgr.smithi008.flmjzp (mgr.14640) 2997 : cluster [DBG] pgmap v2062: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:46.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:44.919124+0000 mon.smithi008 (mon.0) 3378 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:46.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:44.926425+0000 mon.smithi008 (mon.0) 3379 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:46.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:44.928536+0000 mon.smithi008 (mon.0) 3380 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:46.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:44.930472+0000 mon.smithi008 (mon.0) 3381 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:46.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:44.933123+0000 mon.smithi008 (mon.0) 3382 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:46.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:44.935369+0000 mgr.smithi008.flmjzp (mgr.14640) 2998 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:44.872723+0000 mgr.smithi008.flmjzp (mgr.14640) 2994 : cluster [DBG] pgmap v2060: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:44.905110+0000 mgr.smithi008.flmjzp (mgr.14640) 2995 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:44.905643+0000 mgr.smithi008.flmjzp (mgr.14640) 2996 : cluster [DBG] pgmap v2061: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:44.905987+0000 mgr.smithi008.flmjzp (mgr.14640) 2997 : cluster [DBG] pgmap v2062: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:44.919124+0000 mon.smithi008 (mon.0) 3378 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:44.926425+0000 mon.smithi008 (mon.0) 3379 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:44.928536+0000 mon.smithi008 (mon.0) 3380 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:46.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:44.930472+0000 mon.smithi008 (mon.0) 3381 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:46.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:44.933123+0000 mon.smithi008 (mon.0) 3382 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:46.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:44.935369+0000 mgr.smithi008.flmjzp (mgr.14640) 2998 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:48.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:46.906626+0000 mgr.smithi008.flmjzp (mgr.14640) 2999 : cluster [DBG] pgmap v2063: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:46.906626+0000 mgr.smithi008.flmjzp (mgr.14640) 2999 : cluster [DBG] pgmap v2063: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:50.199 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:48.907178+0000 mgr.smithi008.flmjzp (mgr.14640) 3000 : cluster [DBG] pgmap v2064: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:48.907178+0000 mgr.smithi008.flmjzp (mgr.14640) 3000 : cluster [DBG] pgmap v2064: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:50.907935+0000 mgr.smithi008.flmjzp (mgr.14640) 3001 : cluster [DBG] pgmap v2065: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:50.907935+0000 mgr.smithi008.flmjzp (mgr.14640) 3001 : cluster [DBG] pgmap v2065: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:52.908492+0000 mgr.smithi008.flmjzp (mgr.14640) 3002 : cluster [DBG] pgmap v2066: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:54.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:52.908492+0000 mgr.smithi008.flmjzp (mgr.14640) 3002 : cluster [DBG] pgmap v2066: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:54.946178+0000 mon.smithi008 (mon.0) 3383 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:54.948471+0000 mon.smithi008 (mon.0) 3384 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:54.949506+0000 mon.smithi008 (mon.0) 3385 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:54.956356+0000 mon.smithi008 (mon.0) 3386 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:55.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:54.963289+0000 mon.smithi008 (mon.0) 3387 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:54.946178+0000 mon.smithi008 (mon.0) 3383 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:54.948471+0000 mon.smithi008 (mon.0) 3384 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:48:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:54.949506+0000 mon.smithi008 (mon.0) 3385 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:48:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:54.956356+0000 mon.smithi008 (mon.0) 3386 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:48:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:54.963289+0000 mon.smithi008 (mon.0) 3387 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:48:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:54.909144+0000 mgr.smithi008.flmjzp (mgr.14640) 3003 : cluster [DBG] pgmap v2067: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:54.950444+0000 mgr.smithi008.flmjzp (mgr.14640) 3004 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:54.951012+0000 mgr.smithi008.flmjzp (mgr.14640) 3005 : cluster [DBG] pgmap v2068: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:54.951332+0000 mgr.smithi008.flmjzp (mgr.14640) 3006 : cluster [DBG] pgmap v2069: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:56.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:54.971457+0000 mon.smithi008 (mon.0) 3388 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:56.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:54.973507+0000 mon.smithi008 (mon.0) 3389 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:56.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:54.975386+0000 mon.smithi008 (mon.0) 3390 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:56.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:48:54.978367+0000 mon.smithi008 (mon.0) 3391 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:56.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:48:54.980671+0000 mgr.smithi008.flmjzp (mgr.14640) 3007 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:54.909144+0000 mgr.smithi008.flmjzp (mgr.14640) 3003 : cluster [DBG] pgmap v2067: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:54.950444+0000 mgr.smithi008.flmjzp (mgr.14640) 3004 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:48:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:54.951012+0000 mgr.smithi008.flmjzp (mgr.14640) 3005 : cluster [DBG] pgmap v2068: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:54.951332+0000 mgr.smithi008.flmjzp (mgr.14640) 3006 : cluster [DBG] pgmap v2069: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:54.971457+0000 mon.smithi008 (mon.0) 3388 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:54.973507+0000 mon.smithi008 (mon.0) 3389 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:54.975386+0000 mon.smithi008 (mon.0) 3390 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:48:54.978367+0000 mon.smithi008 (mon.0) 3391 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:48:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:48:54.980671+0000 mgr.smithi008.flmjzp (mgr.14640) 3007 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:48:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:56.952000+0000 mgr.smithi008.flmjzp (mgr.14640) 3008 : cluster [DBG] pgmap v2070: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:48:58.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:56.952000+0000 mgr.smithi008.flmjzp (mgr.14640) 3008 : cluster [DBG] pgmap v2070: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:48:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:48:58.952515+0000 mgr.smithi008.flmjzp (mgr.14640) 3009 : cluster [DBG] pgmap v2071: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:48:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:48:58.952515+0000 mgr.smithi008.flmjzp (mgr.14640) 3009 : cluster [DBG] pgmap v2071: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:01.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:00.953007+0000 mgr.smithi008.flmjzp (mgr.14640) 3010 : cluster [DBG] pgmap v2072: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:00.953007+0000 mgr.smithi008.flmjzp (mgr.14640) 3010 : cluster [DBG] pgmap v2072: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:02.953612+0000 mgr.smithi008.flmjzp (mgr.14640) 3011 : cluster [DBG] pgmap v2073: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:04.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:02.953612+0000 mgr.smithi008.flmjzp (mgr.14640) 3011 : cluster [DBG] pgmap v2073: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:04.982069+0000 mon.smithi008 (mon.0) 3392 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:05.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:04.982069+0000 mon.smithi008 (mon.0) 3392 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:04.954237+0000 mgr.smithi008.flmjzp (mgr.14640) 3012 : cluster [DBG] pgmap v2074: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:05.543662+0000 mon.smithi008 (mon.0) 3393 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:05.544529+0000 mon.smithi008 (mon.0) 3394 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:05.549967+0000 mon.smithi008 (mon.0) 3395 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:05.555852+0000 mon.smithi008 (mon.0) 3396 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:05.558606+0000 mon.smithi008 (mon.0) 3397 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:05.560225+0000 mon.smithi008 (mon.0) 3398 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:06.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:05.561688+0000 mon.smithi008 (mon.0) 3399 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:06.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:05.563686+0000 mon.smithi008 (mon.0) 3400 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:04.954237+0000 mgr.smithi008.flmjzp (mgr.14640) 3012 : cluster [DBG] pgmap v2074: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:05.543662+0000 mon.smithi008 (mon.0) 3393 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:05.544529+0000 mon.smithi008 (mon.0) 3394 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:05.549967+0000 mon.smithi008 (mon.0) 3395 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:05.555852+0000 mon.smithi008 (mon.0) 3396 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:05.558606+0000 mon.smithi008 (mon.0) 3397 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:05.560225+0000 mon.smithi008 (mon.0) 3398 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:05.561688+0000 mon.smithi008 (mon.0) 3399 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:05.563686+0000 mon.smithi008 (mon.0) 3400 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:05.545210+0000 mgr.smithi008.flmjzp (mgr.14640) 3013 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:05.545715+0000 mgr.smithi008.flmjzp (mgr.14640) 3014 : cluster [DBG] pgmap v2075: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:05.545941+0000 mgr.smithi008.flmjzp (mgr.14640) 3015 : cluster [DBG] pgmap v2076: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:05.565371+0000 mgr.smithi008.flmjzp (mgr.14640) 3016 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:07.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:05.545210+0000 mgr.smithi008.flmjzp (mgr.14640) 3013 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:07.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:05.545715+0000 mgr.smithi008.flmjzp (mgr.14640) 3014 : cluster [DBG] pgmap v2075: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:07.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:05.545941+0000 mgr.smithi008.flmjzp (mgr.14640) 3015 : cluster [DBG] pgmap v2076: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:07.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:05.565371+0000 mgr.smithi008.flmjzp (mgr.14640) 3016 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:07.546438+0000 mgr.smithi008.flmjzp (mgr.14640) 3017 : cluster [DBG] pgmap v2077: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:09.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:07.546438+0000 mgr.smithi008.flmjzp (mgr.14640) 3017 : cluster [DBG] pgmap v2077: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:10.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.495+0000 7f7ca3fff700 1 -- 172.21.15.8:0/3752127000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 msgr2=0x7f7ca40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:10.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.495+0000 7f7ca3fff700 1 --2- 172.21.15.8:0/3752127000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca40f7c30 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f7c98004660 tx=0x7f7c98009b30).stop 2023-10-18T21:49:10.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.495+0000 7f7ca3fff700 1 -- 172.21.15.8:0/3752127000 shutdown_connections 2023-10-18T21:49:10.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.495+0000 7f7ca3fff700 1 --2- 172.21.15.8:0/3752127000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca40f7c30 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:10.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.495+0000 7f7ca3fff700 1 --2- 172.21.15.8:0/3752127000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 0x7f7ca40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:10.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.495+0000 7f7ca3fff700 1 -- 172.21.15.8:0/3752127000 >> 172.21.15.8:0/3752127000 conn(0x7f7ca40f1c90 msgr2=0x7f7ca40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:10.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.495+0000 7f7ca3fff700 1 -- 172.21.15.8:0/3752127000 shutdown_connections 2023-10-18T21:49:10.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.495+0000 7f7ca3fff700 1 -- 172.21.15.8:0/3752127000 wait complete. 2023-10-18T21:49:10.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.496+0000 7f7ca3fff700 1 Processor -- start 2023-10-18T21:49:10.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.496+0000 7f7ca3fff700 1 -- start start 2023-10-18T21:49:10.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 0x7f7ca4108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:10.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:10.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41099c0 con 0x7f7ca40f77d0 2023-10-18T21:49:10.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4109b00 con 0x7f7ca40f6530 2023-10-18T21:49:10.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:10.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56284/0 (socket says 172.21.15.8:56284) 2023-10-18T21:49:10.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca27fc700 1 -- 172.21.15.8:0/2519446996 learned_addr learned my addr 172.21.15.8:0/2519446996 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:10.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca2ffd700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 0x7f7ca4108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:10.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca27fc700 1 -- 172.21.15.8:0/2519446996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 msgr2=0x7f7ca4108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:10.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca27fc700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 0x7f7ca4108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:10.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.497+0000 7f7ca27fc700 1 -- 172.21.15.8:0/2519446996 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98005040 con 0x7f7ca40f77d0 2023-10-18T21:49:10.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.498+0000 7f7ca27fc700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4109410 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f7c98004320 tx=0x7f7c9800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:10.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.498+0000 7f7c8b7fe700 1 -- 172.21.15.8:0/2519446996 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c98019070 con 0x7f7ca40f77d0 2023-10-18T21:49:10.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.498+0000 7f7ca3fff700 1 -- 172.21.15.8:0/2519446996 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca410a440 con 0x7f7ca40f77d0 2023-10-18T21:49:10.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.498+0000 7f7c8b7fe700 1 -- 172.21.15.8:0/2519446996 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7c9801e420 con 0x7f7ca40f77d0 2023-10-18T21:49:10.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.498+0000 7f7c8b7fe700 1 -- 172.21.15.8:0/2519446996 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c98014660 con 0x7f7ca40f77d0 2023-10-18T21:49:10.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.498+0000 7f7ca3fff700 1 -- 172.21.15.8:0/2519446996 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca410a920 con 0x7f7ca40f77d0 2023-10-18T21:49:10.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.499+0000 7f7ca3fff700 1 -- 172.21.15.8:0/2519446996 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca4045ad0 con 0x7f7ca40f77d0 2023-10-18T21:49:10.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.500+0000 7f7c8b7fe700 1 -- 172.21.15.8:0/2519446996 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7c9801e590 con 0x7f7ca40f77d0 2023-10-18T21:49:10.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.501+0000 7f7c8b7fe700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 0x7f7c8c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:10.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.501+0000 7f7c8b7fe700 1 -- 172.21.15.8:0/2519446996 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7c9807dd90 con 0x7f7ca40f77d0 2023-10-18T21:49:10.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.501+0000 7f7ca2ffd700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 0x7f7c8c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:10.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.502+0000 7f7ca2ffd700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 0x7f7c8c063430 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f7ca40f7630 tx=0x7f7c9400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:10.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.505+0000 7f7c8b7fe700 1 -- 172.21.15.8:0/2519446996 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7c98051390 con 0x7f7ca40f77d0 2023-10-18T21:49:10.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.706+0000 7f7ca3fff700 1 -- 172.21.15.8:0/2519446996 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ca410ab90 con 0x7f7c8c060f70 2023-10-18T21:49:10.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.708+0000 7f7c8b7fe700 1 -- 172.21.15.8:0/2519446996 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7ca410ab90 con 0x7f7c8c060f70 2023-10-18T21:49:10.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 -- 172.21.15.8:0/2519446996 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 msgr2=0x7f7c8c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:10.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 0x7f7c8c063430 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f7ca40f7630 tx=0x7f7c9400b040).stop 2023-10-18T21:49:10.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 -- 172.21.15.8:0/2519446996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 msgr2=0x7f7ca4109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:10.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4109410 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f7c98004320 tx=0x7f7c9800b040).stop 2023-10-18T21:49:10.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 -- 172.21.15.8:0/2519446996 shutdown_connections 2023-10-18T21:49:10.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c8c060f70 0x7f7c8c063430 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:10.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ca40f6530 0x7f7ca4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:10.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 --2- 172.21.15.8:0/2519446996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca40f77d0 0x7f7ca4109410 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:10.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 -- 172.21.15.8:0/2519446996 >> 172.21.15.8:0/2519446996 conn(0x7f7ca40f1c90 msgr2=0x7f7ca406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:10.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 -- 172.21.15.8:0/2519446996 shutdown_connections 2023-10-18T21:49:10.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.710+0000 7f7ca3fff700 1 -- 172.21.15.8:0/2519446996 wait complete. 2023-10-18T21:49:10.726 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:49:10.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.848+0000 7fcf48dda700 1 -- 172.21.15.8:0/1147492676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf440f9690 msgr2=0x7fcf440fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:10.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.848+0000 7fcf48dda700 1 --2- 172.21.15.8:0/1147492676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf440f9690 0x7fcf440fbae0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fcf38004660 tx=0x7fcf38009b30).stop 2023-10-18T21:49:10.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.849+0000 7fcf48dda700 1 -- 172.21.15.8:0/1147492676 shutdown_connections 2023-10-18T21:49:10.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.849+0000 7fcf48dda700 1 --2- 172.21.15.8:0/1147492676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf440f9690 0x7fcf440fbae0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:10.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.849+0000 7fcf48dda700 1 --2- 172.21.15.8:0/1147492676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf44060310 0x7fcf440f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:10.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.849+0000 7fcf48dda700 1 -- 172.21.15.8:0/1147492676 >> 172.21.15.8:0/1147492676 conn(0x7fcf440f0b90 msgr2=0x7fcf440f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:10.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.849+0000 7fcf48dda700 1 -- 172.21.15.8:0/1147492676 shutdown_connections 2023-10-18T21:49:10.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.849+0000 7fcf48dda700 1 -- 172.21.15.8:0/1147492676 wait complete. 2023-10-18T21:49:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.850+0000 7fcf48dda700 1 Processor -- start 2023-10-18T21:49:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.850+0000 7fcf48dda700 1 -- start start 2023-10-18T21:49:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.850+0000 7fcf48dda700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf44060310 0x7fcf44108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.850+0000 7fcf48dda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf440f9690 0x7fcf441093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.850+0000 7fcf48dda700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44109980 con 0x7fcf44060310 2023-10-18T21:49:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.850+0000 7fcf48dda700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44109ac0 con 0x7fcf440f9690 2023-10-18T21:49:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.850+0000 7fcf437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf44060310 0x7fcf44108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.850+0000 7fcf437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf44060310 0x7fcf44108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56316/0 (socket says 172.21.15.8:56316) 2023-10-18T21:49:10.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.850+0000 7fcf437fe700 1 -- 172.21.15.8:0/3980924299 learned_addr learned my addr 172.21.15.8:0/3980924299 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:10.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.851+0000 7fcf42ffd700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf440f9690 0x7fcf441093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:10.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.851+0000 7fcf437fe700 1 -- 172.21.15.8:0/3980924299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf440f9690 msgr2=0x7fcf441093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:10.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.851+0000 7fcf437fe700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf440f9690 0x7fcf441093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.851+0000 7fcf437fe700 1 -- 172.21.15.8:0/3980924299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf38005040 con 0x7fcf44060310 2023-10-18T21:49:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.851+0000 7fcf437fe700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf44060310 0x7fcf44108ee0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fcf3400e7f0 tx=0x7fcf3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.851+0000 7fcf2bfff700 1 -- 172.21.15.8:0/3980924299 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf340092e0 con 0x7fcf44060310 2023-10-18T21:49:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.851+0000 7fcf2bfff700 1 -- 172.21.15.8:0/3980924299 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcf3400f040 con 0x7fcf44060310 2023-10-18T21:49:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.851+0000 7fcf48dda700 1 -- 172.21.15.8:0/3980924299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4410a460 con 0x7fcf44060310 2023-10-18T21:49:10.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.851+0000 7fcf2bfff700 1 -- 172.21.15.8:0/3980924299 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf340147e0 con 0x7fcf44060310 2023-10-18T21:49:10.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.851+0000 7fcf48dda700 1 -- 172.21.15.8:0/3980924299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4410a9a0 con 0x7fcf44060310 2023-10-18T21:49:10.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.853+0000 7fcf48dda700 1 -- 172.21.15.8:0/3980924299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf44045ad0 con 0x7fcf44060310 2023-10-18T21:49:10.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.854+0000 7fcf2bfff700 1 -- 172.21.15.8:0/3980924299 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcf3401b030 con 0x7fcf44060310 2023-10-18T21:49:10.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.855+0000 7fcf2bfff700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf2c060f70 0x7fcf2c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:10.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.855+0000 7fcf2bfff700 1 -- 172.21.15.8:0/3980924299 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcf3407c780 con 0x7fcf44060310 2023-10-18T21:49:10.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.855+0000 7fcf42ffd700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf2c060f70 0x7fcf2c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:10.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.856+0000 7fcf42ffd700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf2c060f70 0x7fcf2c063430 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fcf38009720 tx=0x7fcf38016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:10.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:10.859+0000 7fcf2bfff700 1 -- 172.21.15.8:0/3980924299 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcf3404fe50 con 0x7fcf44060310 2023-10-18T21:49:11.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.058+0000 7fcf48dda700 1 -- 172.21.15.8:0/3980924299 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf440fa4d0 con 0x7fcf2c060f70 2023-10-18T21:49:11.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.059+0000 7fcf2bfff700 1 -- 172.21.15.8:0/3980924299 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcf440fa4d0 con 0x7fcf2c060f70 2023-10-18T21:49:11.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.061+0000 7fcf48dda700 1 -- 172.21.15.8:0/3980924299 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf2c060f70 msgr2=0x7fcf2c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.061+0000 7fcf48dda700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf2c060f70 0x7fcf2c063430 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fcf38009720 tx=0x7fcf38016040).stop 2023-10-18T21:49:11.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.061+0000 7fcf48dda700 1 -- 172.21.15.8:0/3980924299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf44060310 msgr2=0x7fcf44108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.061+0000 7fcf48dda700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf44060310 0x7fcf44108ee0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fcf3400e7f0 tx=0x7fcf3400b040).stop 2023-10-18T21:49:11.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.062+0000 7fcf48dda700 1 -- 172.21.15.8:0/3980924299 shutdown_connections 2023-10-18T21:49:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.062+0000 7fcf48dda700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf2c060f70 0x7fcf2c063430 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.062+0000 7fcf48dda700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf44060310 0x7fcf44108ee0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.062+0000 7fcf48dda700 1 --2- 172.21.15.8:0/3980924299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf440f9690 0x7fcf441093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.062+0000 7fcf48dda700 1 -- 172.21.15.8:0/3980924299 >> 172.21.15.8:0/3980924299 conn(0x7fcf440f0b90 msgr2=0x7fcf440f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.062+0000 7fcf48dda700 1 -- 172.21.15.8:0/3980924299 shutdown_connections 2023-10-18T21:49:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.062+0000 7fcf48dda700 1 -- 172.21.15.8:0/3980924299 wait complete. 2023-10-18T21:49:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.197+0000 7fb841062700 1 -- 172.21.15.8:0/2743659088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83c0f77d0 msgr2=0x7fb83c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.197+0000 7fb841062700 1 --2- 172.21.15.8:0/2743659088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83c0f77d0 0x7fb83c0f7c30 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fb830004660 tx=0x7fb830009b30).stop 2023-10-18T21:49:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.197+0000 7fb841062700 1 -- 172.21.15.8:0/2743659088 shutdown_connections 2023-10-18T21:49:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.197+0000 7fb841062700 1 --2- 172.21.15.8:0/2743659088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83c0f77d0 0x7fb83c0f7c30 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.197+0000 7fb841062700 1 --2- 172.21.15.8:0/2743659088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83c0f6530 0x7fb83c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.197+0000 7fb841062700 1 -- 172.21.15.8:0/2743659088 >> 172.21.15.8:0/2743659088 conn(0x7fb83c0f1c90 msgr2=0x7fb83c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.198+0000 7fb841062700 1 -- 172.21.15.8:0/2743659088 shutdown_connections 2023-10-18T21:49:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.198+0000 7fb841062700 1 -- 172.21.15.8:0/2743659088 wait complete. 2023-10-18T21:49:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.199+0000 7fb841062700 1 Processor -- start 2023-10-18T21:49:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.199+0000 7fb841062700 1 -- start start 2023-10-18T21:49:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb841062700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83c0f6530 0x7fb83c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:11.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb841062700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83c0f77d0 0x7fb83c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:11.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb841062700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c107880 con 0x7fb83c0f6530 2023-10-18T21:49:11.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb841062700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c1080c0 con 0x7fb83c0f77d0 2023-10-18T21:49:11.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb83bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83c0f6530 0x7fb83c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:11.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb83bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83c0f6530 0x7fb83c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56340/0 (socket says 172.21.15.8:56340) 2023-10-18T21:49:11.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb83bfff700 1 -- 172.21.15.8:0/971551218 learned_addr learned my addr 172.21.15.8:0/971551218 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:11.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb83b7fe700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83c0f77d0 0x7fb83c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:11.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb83bfff700 1 -- 172.21.15.8:0/971551218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83c0f77d0 msgr2=0x7fb83c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb83bfff700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83c0f77d0 0x7fb83c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.200+0000 7fb83bfff700 1 -- 172.21.15.8:0/971551218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb830005040 con 0x7fb83c0f6530 2023-10-18T21:49:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.201+0000 7fb83bfff700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83c0f6530 0x7fb83c106d90 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fb82c002700 tx=0x7fb82c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.201+0000 7fb838ff9700 1 -- 172.21.15.8:0/971551218 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb82c0079c0 con 0x7fb83c0f6530 2023-10-18T21:49:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.201+0000 7fb838ff9700 1 -- 172.21.15.8:0/971551218 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb82c00f040 con 0x7fb83c0f6530 2023-10-18T21:49:11.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.201+0000 7fb841062700 1 -- 172.21.15.8:0/971551218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c1083a0 con 0x7fb83c0f6530 2023-10-18T21:49:11.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.201+0000 7fb838ff9700 1 -- 172.21.15.8:0/971551218 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb82c0148d0 con 0x7fb83c0f6530 2023-10-18T21:49:11.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.201+0000 7fb841062700 1 -- 172.21.15.8:0/971551218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c1088e0 con 0x7fb83c0f6530 2023-10-18T21:49:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.202+0000 7fb841062700 1 -- 172.21.15.8:0/971551218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c059100 con 0x7fb83c0f6530 2023-10-18T21:49:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.203+0000 7fb838ff9700 1 -- 172.21.15.8:0/971551218 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb82c01b060 con 0x7fb83c0f6530 2023-10-18T21:49:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.204+0000 7fb838ff9700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb824060f70 0x7fb824063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:11.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.204+0000 7fb838ff9700 1 -- 172.21.15.8:0/971551218 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb82c07c710 con 0x7fb83c0f6530 2023-10-18T21:49:11.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.204+0000 7fb83b7fe700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb824060f70 0x7fb824063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:11.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.205+0000 7fb83b7fe700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb824060f70 0x7fb824063430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fb830004630 tx=0x7fb830009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:11.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.208+0000 7fb838ff9700 1 -- 172.21.15.8:0/971551218 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb82c04c380 con 0x7fb83c0f6530 2023-10-18T21:49:11.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.403+0000 7fb841062700 1 -- 172.21.15.8:0/971551218 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb83c0fee30 con 0x7fb824060f70 2023-10-18T21:49:11.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.413+0000 7fb838ff9700 1 -- 172.21.15.8:0/971551218 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb83c0fee30 con 0x7fb824060f70 2023-10-18T21:49:11.414 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:49:11.414 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (55m) 3m ago 57m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:49:11.414 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (49m) 3m ago 57m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:49:11.414 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (49m) 77s ago 56m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:49:11.415 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (55m) 3m ago 56m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:49:11.415 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 53m - - 2023-10-18T21:49:11.415 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 53m - - 2023-10-18T21:49:11.415 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 77s ago 53m - - 2023-10-18T21:49:11.415 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 77s ago 53m - - 2023-10-18T21:49:11.416 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (51m) 3m ago 58m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:49:11.416 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (50m) 77s ago 56m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:49:11.416 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (50m) 3m ago 58m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:49:11.416 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (49m) 77s ago 56m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:49:11.416 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (56m) 3m ago 56m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:49:11.417 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (56m) 77s ago 56m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:49:11.417 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (49m) 3m ago 55m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:49:11.417 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (47m) 3m ago 55m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:49:11.417 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (46m) 3m ago 55m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:49:11.417 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (46m) 77s ago 55m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:49:11.417 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (45m) 77s ago 54m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:49:11.418 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (45m) 77s ago 54m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:49:11.418 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (51m) 3m ago 56m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:49:11.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 -- 172.21.15.8:0/971551218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb824060f70 msgr2=0x7fb824063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb824060f70 0x7fb824063430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fb830004630 tx=0x7fb830009b30).stop 2023-10-18T21:49:11.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 -- 172.21.15.8:0/971551218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83c0f6530 msgr2=0x7fb83c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83c0f6530 0x7fb83c106d90 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fb82c002700 tx=0x7fb82c009d80).stop 2023-10-18T21:49:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 -- 172.21.15.8:0/971551218 shutdown_connections 2023-10-18T21:49:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb824060f70 0x7fb824063430 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb83c0f6530 0x7fb83c106d90 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 --2- 172.21.15.8:0/971551218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83c0f77d0 0x7fb83c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 -- 172.21.15.8:0/971551218 >> 172.21.15.8:0/971551218 conn(0x7fb83c0f1c90 msgr2=0x7fb83c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 -- 172.21.15.8:0/971551218 shutdown_connections 2023-10-18T21:49:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.415+0000 7fb841062700 1 -- 172.21.15.8:0/971551218 wait complete. 2023-10-18T21:49:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:09.546969+0000 mgr.smithi008.flmjzp (mgr.14640) 3018 : cluster [DBG] pgmap v2078: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:09.546969+0000 mgr.smithi008.flmjzp (mgr.14640) 3018 : cluster [DBG] pgmap v2078: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:11.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.551+0000 7f5f91079700 1 -- 172.21.15.8:0/1302730759 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7c013b20 con 0x7f5f8c06a3b0 2023-10-18T21:49:11.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.551+0000 7f5f9307d700 1 -- 172.21.15.8:0/1302730759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8c06a3b0 msgr2=0x7f5f8c06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.551+0000 7f5f9307d700 1 --2- 172.21.15.8:0/1302730759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8c06a3b0 0x7f5f8c06a830 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f5f7c004660 tx=0x7f5f7c009b30).stop 2023-10-18T21:49:11.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.551+0000 7f5f9307d700 1 -- 172.21.15.8:0/1302730759 shutdown_connections 2023-10-18T21:49:11.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.551+0000 7f5f9307d700 1 --2- 172.21.15.8:0/1302730759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8c06a3b0 0x7f5f8c06a830 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.551+0000 7f5f9307d700 1 --2- 172.21.15.8:0/1302730759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8c06b9c0 0x7f5f8c069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:49:11.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.551+0000 7f5f9307d700 1 -- 172.21.15.8:0/1302730759 >> 172.21.15.8:0/1302730759 conn(0x7f5f8c0f1c90 msgr2=0x7f5f8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:11.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.551+0000 7f5f9307d700 1 -- 172.21.15.8:0/1302730759 shutdown_connections 2023-10-18T21:49:11.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.552+0000 7f5f9307d700 1 -- 172.21.15.8:0/1302730759 wait complete. 2023-10-18T21:49:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.552+0000 7f5f9307d700 1 Processor -- start 2023-10-18T21:49:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.552+0000 7f5f9307d700 1 -- start start 2023-10-18T21:49:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9307d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8c06a3b0 0x7f5f8c108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9307d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8c06b9c0 0x7f5f8c109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9307d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c109a90 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9307d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c10a340 con 0x7f5f8c06a3b0 2023-10-18T21:49:11.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9187a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8c06b9c0 0x7f5f8c109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:11.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9187a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8c06b9c0 0x7f5f8c109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56354/0 (socket says 172.21.15.8:56354) 2023-10-18T21:49:11.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9187a700 1 -- 172.21.15.8:0/235253775 learned_addr learned my addr 172.21.15.8:0/235253775 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:11.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9207b700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8c06a3b0 0x7f5f8c108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9187a700 1 -- 172.21.15.8:0/235253775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8c06a3b0 msgr2=0x7f5f8c108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9187a700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8c06a3b0 0x7f5f8c108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.553+0000 7f5f9187a700 1 -- 172.21.15.8:0/235253775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c005040 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.554+0000 7f5f9187a700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8c06b9c0 0x7f5f8c109450 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f5f7c009830 tx=0x7f5f7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.554+0000 7f5f82ffd700 1 -- 172.21.15.8:0/235253775 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7c018070 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.554+0000 7f5f82ffd700 1 -- 172.21.15.8:0/235253775 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5f7c01d8e0 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.554+0000 7f5f82ffd700 1 -- 172.21.15.8:0/235253775 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7c01c540 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.554+0000 7f5f9307d700 1 -- 172.21.15.8:0/235253775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8c10a5c0 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.554+0000 7f5f9307d700 1 -- 172.21.15.8:0/235253775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c10ab20 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.555+0000 7f5f9307d700 1 -- 172.21.15.8:0/235253775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c059100 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.556+0000 7f5f82ffd700 1 -- 172.21.15.8:0/235253775 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5f7c01da50 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.557+0000 7f5f82ffd700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f78060f70 0x7f5f78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.557+0000 7f5f82ffd700 1 -- 172.21.15.8:0/235253775 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5f7c07e7c0 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.558+0000 7f5f9207b700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f78060f70 0x7f5f78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.558+0000 7f5f9207b700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f78060f70 0x7f5f78063430 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f5f8800b790 tx=0x7f5f88008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.561+0000 7f5f82ffd700 1 -- 172.21.15.8:0/235253775 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5f7c051e20 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.814+0000 7f5f9307d700 1 -- 172.21.15.8:0/235253775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5f8c100f30 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.815+0000 7f5f82ffd700 1 -- 172.21.15.8:0/235253775 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5f7c051a10 con 0x7f5f8c06b9c0 2023-10-18T21:49:11.816 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:49:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:49:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:49:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:49:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:49:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:49:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:49:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:49:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:49:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:49:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:49:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:49:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:49:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:49:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:49:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:49:11.820 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:49:11.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 -- 172.21.15.8:0/235253775 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f78060f70 msgr2=0x7f5f78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f78060f70 0x7f5f78063430 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f5f8800b790 tx=0x7f5f88008040).stop 2023-10-18T21:49:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 -- 172.21.15.8:0/235253775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8c06b9c0 msgr2=0x7f5f8c109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8c06b9c0 0x7f5f8c109450 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f5f7c009830 tx=0x7f5f7c009b30).stop 2023-10-18T21:49:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 -- 172.21.15.8:0/235253775 shutdown_connections 2023-10-18T21:49:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f78060f70 0x7f5f78063430 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f8c06a3b0 0x7f5f8c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 --2- 172.21.15.8:0/235253775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8c06b9c0 0x7f5f8c109450 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 -- 172.21.15.8:0/235253775 >> 172.21.15.8:0/235253775 conn(0x7f5f8c0f1c90 msgr2=0x7f5f8c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:11.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 -- 172.21.15.8:0/235253775 shutdown_connections 2023-10-18T21:49:11.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.817+0000 7f5f9307d700 1 -- 172.21.15.8:0/235253775 wait complete. 2023-10-18T21:49:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.955+0000 7f94d5ffc700 1 -- 172.21.15.8:0/102424894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00f96a0 msgr2=0x7f94d00fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.955+0000 7f94d5ffc700 1 --2- 172.21.15.8:0/102424894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00f96a0 0x7f94d00fbaf0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f94bc004660 tx=0x7f94bc009b30).stop 2023-10-18T21:49:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.955+0000 7f94d5ffc700 1 -- 172.21.15.8:0/102424894 shutdown_connections 2023-10-18T21:49:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.955+0000 7f94d5ffc700 1 --2- 172.21.15.8:0/102424894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00f96a0 0x7f94d00fbaf0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.955+0000 7f94d5ffc700 1 --2- 172.21.15.8:0/102424894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d0060310 0x7f94d00f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.955+0000 7f94d5ffc700 1 -- 172.21.15.8:0/102424894 >> 172.21.15.8:0/102424894 conn(0x7f94d00f0ba0 msgr2=0x7f94d00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.955+0000 7f94d5ffc700 1 -- 172.21.15.8:0/102424894 shutdown_connections 2023-10-18T21:49:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.955+0000 7f94d5ffc700 1 -- 172.21.15.8:0/102424894 wait complete. 2023-10-18T21:49:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.956+0000 7f94d5ffc700 1 Processor -- start 2023-10-18T21:49:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.956+0000 7f94d5ffc700 1 -- start start 2023-10-18T21:49:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94d5ffc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d0060310 0x7f94d00f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94d5ffc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00f96a0 0x7f94d00f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94d5ffc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00f5580 con 0x7f94d00f96a0 2023-10-18T21:49:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94d5ffc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00f56c0 con 0x7f94d0060310 2023-10-18T21:49:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00f96a0 0x7f94d00f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00f96a0 0x7f94d00f5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56370/0 (socket says 172.21.15.8:56370) 2023-10-18T21:49:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94cffff700 1 -- 172.21.15.8:0/2479867056 learned_addr learned my addr 172.21.15.8:0/2479867056 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94d4ffa700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d0060310 0x7f94d00f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94cffff700 1 -- 172.21.15.8:0/2479867056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d0060310 msgr2=0x7f94d00f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94cffff700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d0060310 0x7f94d00f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.957+0000 7f94cffff700 1 -- 172.21.15.8:0/2479867056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc005040 con 0x7f94d00f96a0 2023-10-18T21:49:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.958+0000 7f94cffff700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00f96a0 0x7f94d00f5020 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f94bc007a60 tx=0x7f94bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.958+0000 7f94cd7fa700 1 -- 172.21.15.8:0/2479867056 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94bc018070 con 0x7f94d00f96a0 2023-10-18T21:49:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.958+0000 7f94cd7fa700 1 -- 172.21.15.8:0/2479867056 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f94bc009630 con 0x7f94d00f96a0 2023-10-18T21:49:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.958+0000 7f94d5ffc700 1 -- 172.21.15.8:0/2479867056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d00f5940 con 0x7f94d00f96a0 2023-10-18T21:49:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.958+0000 7f94cd7fa700 1 -- 172.21.15.8:0/2479867056 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94bc01c540 con 0x7f94d00f96a0 2023-10-18T21:49:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.958+0000 7f94d5ffc700 1 -- 172.21.15.8:0/2479867056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d00f5ea0 con 0x7f94d00f96a0 2023-10-18T21:49:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.959+0000 7f94d5ffc700 1 -- 172.21.15.8:0/2479867056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d0045ad0 con 0x7f94d00f96a0 2023-10-18T21:49:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.960+0000 7f94cd7fa700 1 -- 172.21.15.8:0/2479867056 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f94bc01c7b0 con 0x7f94d00f96a0 2023-10-18T21:49:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.961+0000 7f94cd7fa700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c0060f70 0x7f94c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:11.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.961+0000 7f94cd7fa700 1 -- 172.21.15.8:0/2479867056 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f94bc07e690 con 0x7f94d00f96a0 2023-10-18T21:49:11.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.961+0000 7f94d4ffa700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c0060f70 0x7f94c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:11.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.962+0000 7f94d4ffa700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c0060f70 0x7f94c0063430 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f94c4009fd0 tx=0x7f94c400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:11.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:11.965+0000 7f94cd7fa700 1 -- 172.21.15.8:0/2479867056 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f94bc04e300 con 0x7f94d00f96a0 2023-10-18T21:49:12.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.192+0000 7f94d5ffc700 1 -- 172.21.15.8:0/2479867056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f94d00fedd0 con 0x7f94d00f96a0 2023-10-18T21:49:12.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.193+0000 7f94cd7fa700 1 -- 172.21.15.8:0/2479867056 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f94bc051920 con 0x7f94d00f96a0 2023-10-18T21:49:12.194 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:49:12.195 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:49:12.195 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:49:12.195 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:49:12.195 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:49:12.195 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:49:12.196 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:49:12.196 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:49:12.196 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:49:12.196 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:49:12.196 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:49:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:49:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:49:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:49:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:49:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:49:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:49:12.198 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:49:12.198 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:49:12.198 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:49:12.198 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:49:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:49:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:49:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:49:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:49:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:49:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:49:12.200 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:49:12.200 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:49:12.200 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:49:12.200 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:49:12.200 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:49:12.201 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:49:12.201 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:49:12.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 -- 172.21.15.8:0/2479867056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c0060f70 msgr2=0x7f94c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:12.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c0060f70 0x7f94c0063430 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f94c4009fd0 tx=0x7f94c400b040).stop 2023-10-18T21:49:12.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 -- 172.21.15.8:0/2479867056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00f96a0 msgr2=0x7f94d00f5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:12.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00f96a0 0x7f94d00f5020 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f94bc007a60 tx=0x7f94bc009b30).stop 2023-10-18T21:49:12.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 -- 172.21.15.8:0/2479867056 shutdown_connections 2023-10-18T21:49:12.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94c0060f70 0x7f94c0063430 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:12.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d0060310 0x7f94d00f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:12.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 --2- 172.21.15.8:0/2479867056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00f96a0 0x7f94d00f5020 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:12.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 -- 172.21.15.8:0/2479867056 >> 172.21.15.8:0/2479867056 conn(0x7f94d00f0ba0 msgr2=0x7f94d00f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:12.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 -- 172.21.15.8:0/2479867056 shutdown_connections 2023-10-18T21:49:12.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.195+0000 7f94d5ffc700 1 -- 172.21.15.8:0/2479867056 wait complete. 2023-10-18T21:49:12.204 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:49:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:10.707893+0000 mgr.smithi008.flmjzp (mgr.14640) 3019 : audit [DBG] from='client.36520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:11.059843+0000 mgr.smithi008.flmjzp (mgr.14640) 3020 : audit [DBG] from='client.36524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:11.815420+0000 mon.smithi008 (mon.0) 3401 : audit [DBG] from='client.? 172.21.15.8:0/235253775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:12.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.333+0000 7f1a66b52700 1 -- 172.21.15.8:0/216035475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a600f9690 msgr2=0x7f1a600fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:12.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.333+0000 7f1a66b52700 1 --2- 172.21.15.8:0/216035475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a600f9690 0x7f1a600fbae0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f1a50004660 tx=0x7f1a50009b30).stop 2023-10-18T21:49:12.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.333+0000 7f1a66b52700 1 -- 172.21.15.8:0/216035475 shutdown_connections 2023-10-18T21:49:12.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.333+0000 7f1a66b52700 1 --2- 172.21.15.8:0/216035475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a600f9690 0x7f1a600fbae0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:12.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.333+0000 7f1a66b52700 1 --2- 172.21.15.8:0/216035475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a60060310 0x7f1a600f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:12.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.333+0000 7f1a66b52700 1 -- 172.21.15.8:0/216035475 >> 172.21.15.8:0/216035475 conn(0x7f1a600f0b90 msgr2=0x7f1a600f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:12.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.333+0000 7f1a66b52700 1 -- 172.21.15.8:0/216035475 shutdown_connections 2023-10-18T21:49:12.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.333+0000 7f1a66b52700 1 -- 172.21.15.8:0/216035475 wait complete. 2023-10-18T21:49:12.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.334+0000 7f1a66b52700 1 Processor -- start 2023-10-18T21:49:12.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.334+0000 7f1a66b52700 1 -- start start 2023-10-18T21:49:12.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.334+0000 7f1a66b52700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a60060310 0x7f1a60108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:12.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.334+0000 7f1a66b52700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a600f9690 0x7f1a60109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:12.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.334+0000 7f1a66b52700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a601099b0 con 0x7f1a60060310 2023-10-18T21:49:12.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.334+0000 7f1a66b52700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a60109af0 con 0x7f1a600f9690 2023-10-18T21:49:12.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.334+0000 7f1a65b50700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a60060310 0x7f1a60108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:12.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a65b50700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a60060310 0x7f1a60108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56384/0 (socket says 172.21.15.8:56384) 2023-10-18T21:49:12.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a65b50700 1 -- 172.21.15.8:0/4112228119 learned_addr learned my addr 172.21.15.8:0/4112228119 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:12.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a6534f700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a600f9690 0x7f1a60109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:12.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a65b50700 1 -- 172.21.15.8:0/4112228119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a600f9690 msgr2=0x7f1a60109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:12.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a65b50700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a600f9690 0x7f1a60109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:12.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a65b50700 1 -- 172.21.15.8:0/4112228119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a50005040 con 0x7f1a60060310 2023-10-18T21:49:12.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a6534f700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a600f9690 0x7f1a60109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:49:12.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a65b50700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a60060310 0x7f1a60108f10 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f1a5c002700 tx=0x7f1a5c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:12.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a567fc700 1 -- 172.21.15.8:0/4112228119 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c009320 con 0x7f1a60060310 2023-10-18T21:49:12.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a567fc700 1 -- 172.21.15.8:0/4112228119 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1a5c00f040 con 0x7f1a60060310 2023-10-18T21:49:12.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a567fc700 1 -- 172.21.15.8:0/4112228119 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c0148a0 con 0x7f1a60060310 2023-10-18T21:49:12.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.335+0000 7f1a66b52700 1 -- 172.21.15.8:0/4112228119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6010a490 con 0x7f1a60060310 2023-10-18T21:49:12.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.336+0000 7f1a66b52700 1 -- 172.21.15.8:0/4112228119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6010aa50 con 0x7f1a60060310 2023-10-18T21:49:12.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.337+0000 7f1a66b52700 1 -- 172.21.15.8:0/4112228119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a60045ad0 con 0x7f1a60060310 2023-10-18T21:49:12.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.337+0000 7f1a567fc700 1 -- 172.21.15.8:0/4112228119 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1a5c009480 con 0x7f1a60060310 2023-10-18T21:49:12.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.338+0000 7f1a567fc700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a4c060f70 0x7f1a4c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:12.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.338+0000 7f1a567fc700 1 -- 172.21.15.8:0/4112228119 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1a5c07cb40 con 0x7f1a60060310 2023-10-18T21:49:12.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.339+0000 7f1a6534f700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a4c060f70 0x7f1a4c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:12.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.339+0000 7f1a6534f700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a4c060f70 0x7f1a4c063430 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f1a50005010 tx=0x7f1a50009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:12.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.342+0000 7f1a567fc700 1 -- 172.21.15.8:0/4112228119 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1a5c0501e0 con 0x7f1a60060310 2023-10-18T21:49:12.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:10.707893+0000 mgr.smithi008.flmjzp (mgr.14640) 3019 : audit [DBG] from='client.36520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:11.059843+0000 mgr.smithi008.flmjzp (mgr.14640) 3020 : audit [DBG] from='client.36524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:11.815420+0000 mon.smithi008 (mon.0) 3401 : audit [DBG] from='client.? 172.21.15.8:0/235253775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:12.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.540+0000 7f1a66b52700 1 -- 172.21.15.8:0/4112228119 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a600f5650 con 0x7f1a4c060f70 2023-10-18T21:49:12.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.541+0000 7f1a567fc700 1 -- 172.21.15.8:0/4112228119 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1a600f5650 con 0x7f1a4c060f70 2023-10-18T21:49:12.543 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:49:12.543 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:49:12.543 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:49:12.543 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:49:12.543 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:49:12.544 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:49:12.544 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:49:12.544 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:49:12.544 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:49:12.544 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:49:12.545 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:49:12.545 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:49:12.545 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:49:12.545 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:49:12.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 -- 172.21.15.8:0/4112228119 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a4c060f70 msgr2=0x7f1a4c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:12.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a4c060f70 0x7f1a4c063430 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f1a50005010 tx=0x7f1a50009b30).stop 2023-10-18T21:49:12.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 -- 172.21.15.8:0/4112228119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a60060310 msgr2=0x7f1a60108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a60060310 0x7f1a60108f10 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f1a5c002700 tx=0x7f1a5c009e00).stop 2023-10-18T21:49:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 -- 172.21.15.8:0/4112228119 shutdown_connections 2023-10-18T21:49:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a4c060f70 0x7f1a4c063430 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a60060310 0x7f1a60108f10 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:12.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 --2- 172.21.15.8:0/4112228119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a600f9690 0x7f1a60109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:12.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 -- 172.21.15.8:0/4112228119 >> 172.21.15.8:0/4112228119 conn(0x7f1a600f0b90 msgr2=0x7f1a600f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:12.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 -- 172.21.15.8:0/4112228119 shutdown_connections 2023-10-18T21:49:12.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:12.544+0000 7f1a66b52700 1 -- 172.21.15.8:0/4112228119 wait complete. 2023-10-18T21:49:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:11.404699+0000 mgr.smithi008.flmjzp (mgr.14640) 3021 : audit [DBG] from='client.36528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:11.547418+0000 mgr.smithi008.flmjzp (mgr.14640) 3022 : cluster [DBG] pgmap v2079: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:12.193636+0000 mon.smithi008 (mon.0) 3402 : audit [DBG] from='client.? 172.21.15.8:0/2479867056' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:49:13.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:11.404699+0000 mgr.smithi008.flmjzp (mgr.14640) 3021 : audit [DBG] from='client.36528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:11.547418+0000 mgr.smithi008.flmjzp (mgr.14640) 3022 : cluster [DBG] pgmap v2079: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:12.193636+0000 mon.smithi008 (mon.0) 3402 : audit [DBG] from='client.? 172.21.15.8:0/2479867056' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:49:14.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:12.541902+0000 mgr.smithi008.flmjzp (mgr.14640) 3023 : audit [DBG] from='client.36540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:14.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:12.541902+0000 mgr.smithi008.flmjzp (mgr.14640) 3023 : audit [DBG] from='client.36540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:13.548083+0000 mgr.smithi008.flmjzp (mgr.14640) 3024 : cluster [DBG] pgmap v2080: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:15.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:13.548083+0000 mgr.smithi008.flmjzp (mgr.14640) 3024 : cluster [DBG] pgmap v2080: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:15.576012+0000 mon.smithi008 (mon.0) 3403 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:15.578370+0000 mon.smithi008 (mon.0) 3404 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:15.579279+0000 mon.smithi008 (mon.0) 3405 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:15.585300+0000 mon.smithi008 (mon.0) 3406 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:15.591326+0000 mon.smithi008 (mon.0) 3407 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:15.594144+0000 mon.smithi008 (mon.0) 3408 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:15.595646+0000 mon.smithi008 (mon.0) 3409 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:15.597113+0000 mon.smithi008 (mon.0) 3410 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:15.598939+0000 mon.smithi008 (mon.0) 3411 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:15.576012+0000 mon.smithi008 (mon.0) 3403 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:15.578370+0000 mon.smithi008 (mon.0) 3404 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:15.579279+0000 mon.smithi008 (mon.0) 3405 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:15.585300+0000 mon.smithi008 (mon.0) 3406 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:15.591326+0000 mon.smithi008 (mon.0) 3407 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:15.594144+0000 mon.smithi008 (mon.0) 3408 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:15.595646+0000 mon.smithi008 (mon.0) 3409 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:15.597113+0000 mon.smithi008 (mon.0) 3410 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:16.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:15.598939+0000 mon.smithi008 (mon.0) 3411 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:15.548692+0000 mgr.smithi008.flmjzp (mgr.14640) 3025 : cluster [DBG] pgmap v2081: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:15.580037+0000 mgr.smithi008.flmjzp (mgr.14640) 3026 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:15.580594+0000 mgr.smithi008.flmjzp (mgr.14640) 3027 : cluster [DBG] pgmap v2082: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:15.580881+0000 mgr.smithi008.flmjzp (mgr.14640) 3028 : cluster [DBG] pgmap v2083: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:15.600680+0000 mgr.smithi008.flmjzp (mgr.14640) 3029 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:17.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:15.548692+0000 mgr.smithi008.flmjzp (mgr.14640) 3025 : cluster [DBG] pgmap v2081: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:15.580037+0000 mgr.smithi008.flmjzp (mgr.14640) 3026 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:15.580594+0000 mgr.smithi008.flmjzp (mgr.14640) 3027 : cluster [DBG] pgmap v2082: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:15.580881+0000 mgr.smithi008.flmjzp (mgr.14640) 3028 : cluster [DBG] pgmap v2083: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:15.600680+0000 mgr.smithi008.flmjzp (mgr.14640) 3029 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:17.581467+0000 mgr.smithi008.flmjzp (mgr.14640) 3030 : cluster [DBG] pgmap v2084: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:19.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:17.581467+0000 mgr.smithi008.flmjzp (mgr.14640) 3030 : cluster [DBG] pgmap v2084: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:19.582109+0000 mgr.smithi008.flmjzp (mgr.14640) 3031 : cluster [DBG] pgmap v2085: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:19.582109+0000 mgr.smithi008.flmjzp (mgr.14640) 3031 : cluster [DBG] pgmap v2085: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:21.582878+0000 mgr.smithi008.flmjzp (mgr.14640) 3032 : cluster [DBG] pgmap v2086: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:21.582878+0000 mgr.smithi008.flmjzp (mgr.14640) 3032 : cluster [DBG] pgmap v2086: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:23.583603+0000 mgr.smithi008.flmjzp (mgr.14640) 3033 : cluster [DBG] pgmap v2087: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:25.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:23.583603+0000 mgr.smithi008.flmjzp (mgr.14640) 3033 : cluster [DBG] pgmap v2087: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:25.611269+0000 mon.smithi008 (mon.0) 3412 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:26.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:25.611269+0000 mon.smithi008 (mon.0) 3412 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:25.584143+0000 mgr.smithi008.flmjzp (mgr.14640) 3034 : cluster [DBG] pgmap v2088: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:26.170838+0000 mon.smithi008 (mon.0) 3413 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:26.171991+0000 mon.smithi008 (mon.0) 3414 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:26.178445+0000 mon.smithi008 (mon.0) 3415 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:26.185013+0000 mon.smithi008 (mon.0) 3416 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:26.188128+0000 mon.smithi008 (mon.0) 3417 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:26.189843+0000 mon.smithi008 (mon.0) 3418 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:26.191413+0000 mon.smithi008 (mon.0) 3419 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:27.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:26.193410+0000 mon.smithi008 (mon.0) 3420 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:25.584143+0000 mgr.smithi008.flmjzp (mgr.14640) 3034 : cluster [DBG] pgmap v2088: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:26.170838+0000 mon.smithi008 (mon.0) 3413 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:26.171991+0000 mon.smithi008 (mon.0) 3414 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:26.178445+0000 mon.smithi008 (mon.0) 3415 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:27.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:26.185013+0000 mon.smithi008 (mon.0) 3416 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:27.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:26.188128+0000 mon.smithi008 (mon.0) 3417 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:27.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:26.189843+0000 mon.smithi008 (mon.0) 3418 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:27.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:26.191413+0000 mon.smithi008 (mon.0) 3419 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:27.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:26.193410+0000 mon.smithi008 (mon.0) 3420 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:28.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:26.172952+0000 mgr.smithi008.flmjzp (mgr.14640) 3035 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:28.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:26.173643+0000 mgr.smithi008.flmjzp (mgr.14640) 3036 : cluster [DBG] pgmap v2089: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:28.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:26.173972+0000 mgr.smithi008.flmjzp (mgr.14640) 3037 : cluster [DBG] pgmap v2090: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:28.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:26.195308+0000 mgr.smithi008.flmjzp (mgr.14640) 3038 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:28.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:26.172952+0000 mgr.smithi008.flmjzp (mgr.14640) 3035 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:28.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:26.173643+0000 mgr.smithi008.flmjzp (mgr.14640) 3036 : cluster [DBG] pgmap v2089: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:28.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:26.173972+0000 mgr.smithi008.flmjzp (mgr.14640) 3037 : cluster [DBG] pgmap v2090: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:28.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:26.195308+0000 mgr.smithi008.flmjzp (mgr.14640) 3038 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:28.174583+0000 mgr.smithi008.flmjzp (mgr.14640) 3039 : cluster [DBG] pgmap v2091: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:28.174583+0000 mgr.smithi008.flmjzp (mgr.14640) 3039 : cluster [DBG] pgmap v2091: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:32.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:30.175355+0000 mgr.smithi008.flmjzp (mgr.14640) 3040 : cluster [DBG] pgmap v2092: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:30.175355+0000 mgr.smithi008.flmjzp (mgr.14640) 3040 : cluster [DBG] pgmap v2092: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:34.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:32.176041+0000 mgr.smithi008.flmjzp (mgr.14640) 3041 : cluster [DBG] pgmap v2093: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:34.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:32.176041+0000 mgr.smithi008.flmjzp (mgr.14640) 3041 : cluster [DBG] pgmap v2093: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:34.176630+0000 mgr.smithi008.flmjzp (mgr.14640) 3042 : cluster [DBG] pgmap v2094: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:36.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:34.176630+0000 mgr.smithi008.flmjzp (mgr.14640) 3042 : cluster [DBG] pgmap v2094: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:36.206142+0000 mon.smithi008 (mon.0) 3421 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:36.208332+0000 mon.smithi008 (mon.0) 3422 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:36.209358+0000 mon.smithi008 (mon.0) 3423 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:36.216776+0000 mon.smithi008 (mon.0) 3424 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:36.223359+0000 mon.smithi008 (mon.0) 3425 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:36.226382+0000 mon.smithi008 (mon.0) 3426 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:36.228068+0000 mon.smithi008 (mon.0) 3427 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:36.229682+0000 mon.smithi008 (mon.0) 3428 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:36.231680+0000 mon.smithi008 (mon.0) 3429 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:36.206142+0000 mon.smithi008 (mon.0) 3421 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:36.208332+0000 mon.smithi008 (mon.0) 3422 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:36.209358+0000 mon.smithi008 (mon.0) 3423 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:36.216776+0000 mon.smithi008 (mon.0) 3424 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:36.223359+0000 mon.smithi008 (mon.0) 3425 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:36.226382+0000 mon.smithi008 (mon.0) 3426 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:36.228068+0000 mon.smithi008 (mon.0) 3427 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:36.229682+0000 mon.smithi008 (mon.0) 3428 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:36.231680+0000 mon.smithi008 (mon.0) 3429 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:38.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:36.177319+0000 mgr.smithi008.flmjzp (mgr.14640) 3043 : cluster [DBG] pgmap v2095: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:38.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:36.210255+0000 mgr.smithi008.flmjzp (mgr.14640) 3044 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:38.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:36.210798+0000 mgr.smithi008.flmjzp (mgr.14640) 3045 : cluster [DBG] pgmap v2096: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:38.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:36.211037+0000 mgr.smithi008.flmjzp (mgr.14640) 3046 : cluster [DBG] pgmap v2097: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:38.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:36.233632+0000 mgr.smithi008.flmjzp (mgr.14640) 3047 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:38.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:36.177319+0000 mgr.smithi008.flmjzp (mgr.14640) 3043 : cluster [DBG] pgmap v2095: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:36.210255+0000 mgr.smithi008.flmjzp (mgr.14640) 3044 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:36.210798+0000 mgr.smithi008.flmjzp (mgr.14640) 3045 : cluster [DBG] pgmap v2096: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:36.211037+0000 mgr.smithi008.flmjzp (mgr.14640) 3046 : cluster [DBG] pgmap v2097: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:36.233632+0000 mgr.smithi008.flmjzp (mgr.14640) 3047 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:38.211603+0000 mgr.smithi008.flmjzp (mgr.14640) 3048 : cluster [DBG] pgmap v2098: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:40.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:38.211603+0000 mgr.smithi008.flmjzp (mgr.14640) 3048 : cluster [DBG] pgmap v2098: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:42.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:40.212141+0000 mgr.smithi008.flmjzp (mgr.14640) 3049 : cluster [DBG] pgmap v2099: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:42.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:40.212141+0000 mgr.smithi008.flmjzp (mgr.14640) 3049 : cluster [DBG] pgmap v2099: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.695+0000 7f20e5e14700 1 -- 172.21.15.8:0/1705514082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20e00f77d0 msgr2=0x7f20e00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.695+0000 7f20e5e14700 1 --2- 172.21.15.8:0/1705514082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20e00f77d0 0x7f20e00f7c30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f20cc004660 tx=0x7f20cc009b30).stop 2023-10-18T21:49:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.695+0000 7f20e5e14700 1 -- 172.21.15.8:0/1705514082 shutdown_connections 2023-10-18T21:49:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.695+0000 7f20e5e14700 1 --2- 172.21.15.8:0/1705514082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20e00f77d0 0x7f20e00f7c30 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.695+0000 7f20e5e14700 1 --2- 172.21.15.8:0/1705514082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20e00f6530 0x7f20e00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:49:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.695+0000 7f20e5e14700 1 -- 172.21.15.8:0/1705514082 >> 172.21.15.8:0/1705514082 conn(0x7f20e00f1c90 msgr2=0x7f20e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.695+0000 7f20e5e14700 1 -- 172.21.15.8:0/1705514082 shutdown_connections 2023-10-18T21:49:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.695+0000 7f20e5e14700 1 -- 172.21.15.8:0/1705514082 wait complete. 2023-10-18T21:49:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.696+0000 7f20e5e14700 1 Processor -- start 2023-10-18T21:49:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.696+0000 7f20e5e14700 1 -- start start 2023-10-18T21:49:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20e5e14700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20e00f6530 0x7f20e0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20e5e14700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20e00f77d0 0x7f20e0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20e5e14700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e01079a0 con 0x7f20e00f77d0 2023-10-18T21:49:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20e5e14700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0108120 con 0x7f20e00f6530 2023-10-18T21:49:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20dffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20e00f77d0 0x7f20e0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20dffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20e00f77d0 0x7f20e0107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38528/0 (socket says 172.21.15.8:38528) 2023-10-18T21:49:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20dffff700 1 -- 172.21.15.8:0/2514618223 learned_addr learned my addr 172.21.15.8:0/2514618223 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20e4e12700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20e00f6530 0x7f20e0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20dffff700 1 -- 172.21.15.8:0/2514618223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20e00f6530 msgr2=0x7f20e0106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:42.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20dffff700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20e00f6530 0x7f20e0106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:42.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20dffff700 1 -- 172.21.15.8:0/2514618223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc005040 con 0x7f20e00f77d0 2023-10-18T21:49:42.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.697+0000 7f20dffff700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20e00f77d0 0x7f20e0107310 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f20cc009990 tx=0x7f20cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:42.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.698+0000 7f20dd7fa700 1 -- 172.21.15.8:0/2514618223 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20cc018070 con 0x7f20e00f77d0 2023-10-18T21:49:42.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.698+0000 7f20e5e14700 1 -- 172.21.15.8:0/2514618223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e0108340 con 0x7f20e00f77d0 2023-10-18T21:49:42.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.698+0000 7f20dd7fa700 1 -- 172.21.15.8:0/2514618223 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f20cc009780 con 0x7f20e00f77d0 2023-10-18T21:49:42.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.698+0000 7f20dd7fa700 1 -- 172.21.15.8:0/2514618223 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20cc01c5a0 con 0x7f20e00f77d0 2023-10-18T21:49:42.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.698+0000 7f20e5e14700 1 -- 172.21.15.8:0/2514618223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e01088a0 con 0x7f20e00f77d0 2023-10-18T21:49:42.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.699+0000 7f20e5e14700 1 -- 172.21.15.8:0/2514618223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e0045ad0 con 0x7f20e00f77d0 2023-10-18T21:49:42.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.700+0000 7f20dd7fa700 1 -- 172.21.15.8:0/2514618223 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f20cc01db30 con 0x7f20e00f77d0 2023-10-18T21:49:42.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.701+0000 7f20dd7fa700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20d0060f70 0x7f20d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:42.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.701+0000 7f20dd7fa700 1 -- 172.21.15.8:0/2514618223 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f20cc07e940 con 0x7f20e00f77d0 2023-10-18T21:49:42.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.701+0000 7f20e4e12700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20d0060f70 0x7f20d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:42.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.702+0000 7f20e4e12700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20d0060f70 0x7f20d0063430 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f20e0106b90 tx=0x7f20d4008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:42.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.705+0000 7f20dd7fa700 1 -- 172.21.15.8:0/2514618223 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f20cc04e4f0 con 0x7f20e00f77d0 2023-10-18T21:49:42.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.903+0000 7f20e5e14700 1 -- 172.21.15.8:0/2514618223 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f20e00feed0 con 0x7f20d0060f70 2023-10-18T21:49:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.904+0000 7f20dd7fa700 1 -- 172.21.15.8:0/2514618223 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f20e00feed0 con 0x7f20d0060f70 2023-10-18T21:49:42.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 -- 172.21.15.8:0/2514618223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20d0060f70 msgr2=0x7f20d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:42.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20d0060f70 0x7f20d0063430 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f20e0106b90 tx=0x7f20d4008040).stop 2023-10-18T21:49:42.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 -- 172.21.15.8:0/2514618223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20e00f77d0 msgr2=0x7f20e0107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:42.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20e00f77d0 0x7f20e0107310 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f20cc009990 tx=0x7f20cc009b30).stop 2023-10-18T21:49:42.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 -- 172.21.15.8:0/2514618223 shutdown_connections 2023-10-18T21:49:42.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f20d0060f70 0x7f20d0063430 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:42.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20e00f6530 0x7f20e0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:42.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 --2- 172.21.15.8:0/2514618223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20e00f77d0 0x7f20e0107310 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:42.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 -- 172.21.15.8:0/2514618223 >> 172.21.15.8:0/2514618223 conn(0x7f20e00f1c90 msgr2=0x7f20e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:42.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 -- 172.21.15.8:0/2514618223 shutdown_connections 2023-10-18T21:49:42.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:42.906+0000 7f20e5e14700 1 -- 172.21.15.8:0/2514618223 wait complete. 2023-10-18T21:49:42.923 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:49:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.044+0000 7fb81359e700 1 -- 172.21.15.8:0/1738012321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8140f77d0 msgr2=0x7fb8140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.044+0000 7fb81359e700 1 --2- 172.21.15.8:0/1738012321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8140f77d0 0x7fb8140f7c30 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fb8080045a0 tx=0x7fb808009b30).stop 2023-10-18T21:49:43.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.044+0000 7fb81359e700 1 -- 172.21.15.8:0/1738012321 shutdown_connections 2023-10-18T21:49:43.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.044+0000 7fb81359e700 1 --2- 172.21.15.8:0/1738012321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8140f77d0 0x7fb8140f7c30 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.044+0000 7fb81359e700 1 --2- 172.21.15.8:0/1738012321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8140f6530 0x7fb8140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.044+0000 7fb81359e700 1 -- 172.21.15.8:0/1738012321 >> 172.21.15.8:0/1738012321 conn(0x7fb8140f1c90 msgr2=0x7fb8140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.044+0000 7fb81359e700 1 -- 172.21.15.8:0/1738012321 shutdown_connections 2023-10-18T21:49:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.044+0000 7fb81359e700 1 -- 172.21.15.8:0/1738012321 wait complete. 2023-10-18T21:49:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.045+0000 7fb81359e700 1 Processor -- start 2023-10-18T21:49:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.045+0000 7fb81359e700 1 -- start start 2023-10-18T21:49:43.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.045+0000 7fb81359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8140f6530 0x7fb814108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:43.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.045+0000 7fb81359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8140f77d0 0x7fb814109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:43.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.045+0000 7fb81359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8141099c0 con 0x7fb8140f6530 2023-10-18T21:49:43.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.045+0000 7fb81359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb814109b00 con 0x7fb8140f77d0 2023-10-18T21:49:43.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.046+0000 7fb81259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8140f6530 0x7fb814108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:43.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.046+0000 7fb81259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8140f6530 0x7fb814108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38542/0 (socket says 172.21.15.8:38542) 2023-10-18T21:49:43.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.046+0000 7fb81259c700 1 -- 172.21.15.8:0/2694040971 learned_addr learned my addr 172.21.15.8:0/2694040971 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:43.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.046+0000 7fb811d9b700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8140f77d0 0x7fb814109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:43.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.046+0000 7fb81259c700 1 -- 172.21.15.8:0/2694040971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8140f77d0 msgr2=0x7fb814109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:43.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.046+0000 7fb81259c700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8140f77d0 0x7fb814109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.046+0000 7fb81259c700 1 -- 172.21.15.8:0/2694040971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804005040 con 0x7fb8140f6530 2023-10-18T21:49:43.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.046+0000 7fb811d9b700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8140f77d0 0x7fb814109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:49:43.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.046+0000 7fb81259c700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8140f6530 0x7fb814108f20 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fb804004960 tx=0x7fb804009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:43.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.047+0000 7fb802ffd700 1 -- 172.21.15.8:0/2694040971 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb804007e30 con 0x7fb8140f6530 2023-10-18T21:49:43.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.047+0000 7fb802ffd700 1 -- 172.21.15.8:0/2694040971 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb80400f040 con 0x7fb8140f6530 2023-10-18T21:49:43.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.047+0000 7fb81359e700 1 -- 172.21.15.8:0/2694040971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb808005040 con 0x7fb8140f6530 2023-10-18T21:49:43.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.047+0000 7fb802ffd700 1 -- 172.21.15.8:0/2694040971 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8040149d0 con 0x7fb8140f6530 2023-10-18T21:49:43.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.047+0000 7fb81359e700 1 -- 172.21.15.8:0/2694040971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81410a850 con 0x7fb8140f6530 2023-10-18T21:49:43.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.048+0000 7fb81359e700 1 -- 172.21.15.8:0/2694040971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb814045ad0 con 0x7fb8140f6530 2023-10-18T21:49:43.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.049+0000 7fb802ffd700 1 -- 172.21.15.8:0/2694040971 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb804014c40 con 0x7fb8140f6530 2023-10-18T21:49:43.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.050+0000 7fb802ffd700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7fc060f70 0x7fb7fc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:43.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.050+0000 7fb802ffd700 1 -- 172.21.15.8:0/2694040971 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb80407cc80 con 0x7fb8140f6530 2023-10-18T21:49:43.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.050+0000 7fb811d9b700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7fc060f70 0x7fb7fc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:43.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.051+0000 7fb811d9b700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7fc060f70 0x7fb7fc063430 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fb808000c00 tx=0x7fb80800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:43.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.054+0000 7fb802ffd700 1 -- 172.21.15.8:0/2694040971 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb804049f20 con 0x7fb8140f6530 2023-10-18T21:49:43.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.254+0000 7fb81359e700 1 -- 172.21.15.8:0/2694040971 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8140fc120 con 0x7fb7fc060f70 2023-10-18T21:49:43.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.255+0000 7fb802ffd700 1 -- 172.21.15.8:0/2694040971 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb8140fc120 con 0x7fb7fc060f70 2023-10-18T21:49:43.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.257+0000 7fb81359e700 1 -- 172.21.15.8:0/2694040971 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7fc060f70 msgr2=0x7fb7fc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.257+0000 7fb81359e700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7fc060f70 0x7fb7fc063430 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fb808000c00 tx=0x7fb80800b040).stop 2023-10-18T21:49:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.257+0000 7fb81359e700 1 -- 172.21.15.8:0/2694040971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8140f6530 msgr2=0x7fb814108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.257+0000 7fb81359e700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8140f6530 0x7fb814108f20 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fb804004960 tx=0x7fb804009b30).stop 2023-10-18T21:49:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.257+0000 7fb81359e700 1 -- 172.21.15.8:0/2694040971 shutdown_connections 2023-10-18T21:49:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.257+0000 7fb81359e700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7fc060f70 0x7fb7fc063430 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.257+0000 7fb81359e700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8140f6530 0x7fb814108f20 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.257+0000 7fb81359e700 1 --2- 172.21.15.8:0/2694040971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8140f77d0 0x7fb814109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.257+0000 7fb81359e700 1 -- 172.21.15.8:0/2694040971 >> 172.21.15.8:0/2694040971 conn(0x7fb8140f1c90 msgr2=0x7fb81406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.257+0000 7fb81359e700 1 -- 172.21.15.8:0/2694040971 shutdown_connections 2023-10-18T21:49:43.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.258+0000 7fb81359e700 1 -- 172.21.15.8:0/2694040971 wait complete. 2023-10-18T21:49:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.395+0000 7f7c3e126700 1 -- 172.21.15.8:0/2915991637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380f77d0 msgr2=0x7f7c380f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.395+0000 7f7c3e126700 1 --2- 172.21.15.8:0/2915991637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380f77d0 0x7f7c380f7c30 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7f7c28004660 tx=0x7f7c28009b30).stop 2023-10-18T21:49:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.395+0000 7f7c3e126700 1 -- 172.21.15.8:0/2915991637 shutdown_connections 2023-10-18T21:49:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.395+0000 7f7c3e126700 1 --2- 172.21.15.8:0/2915991637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380f77d0 0x7f7c380f7c30 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.395+0000 7f7c3e126700 1 --2- 172.21.15.8:0/2915991637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c380f6530 0x7f7c380f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.395+0000 7f7c3e126700 1 -- 172.21.15.8:0/2915991637 >> 172.21.15.8:0/2915991637 conn(0x7f7c380f1c90 msgr2=0x7f7c380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.395+0000 7f7c3e126700 1 -- 172.21.15.8:0/2915991637 shutdown_connections 2023-10-18T21:49:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.395+0000 7f7c3e126700 1 -- 172.21.15.8:0/2915991637 wait complete. 2023-10-18T21:49:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.396+0000 7f7c3e126700 1 Processor -- start 2023-10-18T21:49:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.396+0000 7f7c3e126700 1 -- start start 2023-10-18T21:49:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.396+0000 7f7c3e126700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380f6530 0x7f7c38108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.396+0000 7f7c3e126700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c380f77d0 0x7f7c38109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.396+0000 7f7c3e126700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c381099d0 con 0x7f7c380f6530 2023-10-18T21:49:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.396+0000 7f7c3e126700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c38109b10 con 0x7f7c380f77d0 2023-10-18T21:49:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.396+0000 7f7c3d124700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380f6530 0x7f7c38108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:43.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c3d124700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380f6530 0x7f7c38108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38552/0 (socket says 172.21.15.8:38552) 2023-10-18T21:49:43.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c3d124700 1 -- 172.21.15.8:0/271852982 learned_addr learned my addr 172.21.15.8:0/271852982 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:43.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c3c923700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c380f77d0 0x7f7c38109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:43.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c3d124700 1 -- 172.21.15.8:0/271852982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c380f77d0 msgr2=0x7f7c38109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:43.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c3d124700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c380f77d0 0x7f7c38109420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c3d124700 1 -- 172.21.15.8:0/271852982 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28005040 con 0x7f7c380f6530 2023-10-18T21:49:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c3d124700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380f6530 0x7f7c38108f30 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f7c34002700 tx=0x7f7c34009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c2dffb700 1 -- 172.21.15.8:0/271852982 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c34009320 con 0x7f7c380f6530 2023-10-18T21:49:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c2dffb700 1 -- 172.21.15.8:0/271852982 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7c3400f040 con 0x7f7c380f6530 2023-10-18T21:49:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c3e126700 1 -- 172.21.15.8:0/271852982 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3810a4b0 con 0x7f7c380f6530 2023-10-18T21:49:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.397+0000 7f7c2dffb700 1 -- 172.21.15.8:0/271852982 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c34014970 con 0x7f7c380f6530 2023-10-18T21:49:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.398+0000 7f7c3e126700 1 -- 172.21.15.8:0/271852982 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3810aa70 con 0x7f7c380f6530 2023-10-18T21:49:43.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.399+0000 7f7c3e126700 1 -- 172.21.15.8:0/271852982 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c38045ad0 con 0x7f7c380f6530 2023-10-18T21:49:43.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.399+0000 7f7c2dffb700 1 -- 172.21.15.8:0/271852982 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7c34009480 con 0x7f7c380f6530 2023-10-18T21:49:43.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.400+0000 7f7c2dffb700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c24060f70 0x7f7c24063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:43.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.400+0000 7f7c2dffb700 1 -- 172.21.15.8:0/271852982 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7c3407cb80 con 0x7f7c380f6530 2023-10-18T21:49:43.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.401+0000 7f7c3c923700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c24060f70 0x7f7c24063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:43.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.401+0000 7f7c3c923700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c24060f70 0x7f7c24063430 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f7c28004e30 tx=0x7f7c28009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:43.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.404+0000 7f7c2dffb700 1 -- 172.21.15.8:0/271852982 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7c34050220 con 0x7f7c380f6530 2023-10-18T21:49:43.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.598+0000 7f7c3e126700 1 -- 172.21.15.8:0/271852982 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c3810acf0 con 0x7f7c24060f70 2023-10-18T21:49:43.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.608+0000 7f7c2dffb700 1 -- 172.21.15.8:0/271852982 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7c3810acf0 con 0x7f7c24060f70 2023-10-18T21:49:43.610 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:49:43.611 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (56m) 3m ago 57m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:49:43.611 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (50m) 3m ago 57m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:49:43.611 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (50m) 109s ago 56m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:49:43.611 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (56m) 3m ago 57m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:49:43.612 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 53m - - 2023-10-18T21:49:43.612 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 53m - - 2023-10-18T21:49:43.612 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 109s ago 53m - - 2023-10-18T21:49:43.612 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 109s ago 53m - - 2023-10-18T21:49:43.612 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (51m) 3m ago 59m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:49:43.612 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (50m) 109s ago 56m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:49:43.613 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (50m) 3m ago 59m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:49:43.613 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (50m) 109s ago 56m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:49:43.613 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (57m) 3m ago 57m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:49:43.613 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (56m) 109s ago 56m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:49:43.613 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (49m) 3m ago 56m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:49:43.614 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (47m) 3m ago 56m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:49:43.614 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (47m) 3m ago 55m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:49:43.614 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (47m) 109s ago 55m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:49:43.614 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (46m) 109s ago 55m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:49:43.614 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (45m) 109s ago 55m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:49:43.615 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (51m) 3m ago 57m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:49:43.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 -- 172.21.15.8:0/271852982 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c24060f70 msgr2=0x7f7c24063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:43.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c24060f70 0x7f7c24063430 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f7c28004e30 tx=0x7f7c28009b30).stop 2023-10-18T21:49:43.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 -- 172.21.15.8:0/271852982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380f6530 msgr2=0x7f7c38108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:43.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380f6530 0x7f7c38108f30 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f7c34002700 tx=0x7f7c34009d80).stop 2023-10-18T21:49:43.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 -- 172.21.15.8:0/271852982 shutdown_connections 2023-10-18T21:49:43.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c24060f70 0x7f7c24063430 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380f6530 0x7f7c38108f30 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 --2- 172.21.15.8:0/271852982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c380f77d0 0x7f7c38109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 -- 172.21.15.8:0/271852982 >> 172.21.15.8:0/271852982 conn(0x7f7c380f1c90 msgr2=0x7f7c3806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:43.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 -- 172.21.15.8:0/271852982 shutdown_connections 2023-10-18T21:49:43.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.610+0000 7f7c3e126700 1 -- 172.21.15.8:0/271852982 wait complete. 2023-10-18T21:49:43.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.745+0000 7fd0cffff700 1 -- 172.21.15.8:0/3325364925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d00f77d0 msgr2=0x7fd0d00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:43.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.745+0000 7fd0cffff700 1 --2- 172.21.15.8:0/3325364925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d00f77d0 0x7fd0d00f7c30 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fd0c4004660 tx=0x7fd0c4009b30).stop 2023-10-18T21:49:43.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.745+0000 7fd0cffff700 1 -- 172.21.15.8:0/3325364925 shutdown_connections 2023-10-18T21:49:43.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.745+0000 7fd0cffff700 1 --2- 172.21.15.8:0/3325364925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d00f77d0 0x7fd0d00f7c30 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.745+0000 7fd0cffff700 1 --2- 172.21.15.8:0/3325364925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d00f6530 0x7fd0d00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:49:43.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.745+0000 7fd0cffff700 1 -- 172.21.15.8:0/3325364925 >> 172.21.15.8:0/3325364925 conn(0x7fd0d00f1c90 msgr2=0x7fd0d00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:43.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.745+0000 7fd0cffff700 1 -- 172.21.15.8:0/3325364925 shutdown_connections 2023-10-18T21:49:43.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.745+0000 7fd0cffff700 1 -- 172.21.15.8:0/3325364925 wait complete. 2023-10-18T21:49:43.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.746+0000 7fd0cffff700 1 Processor -- start 2023-10-18T21:49:43.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.746+0000 7fd0cffff700 1 -- start start 2023-10-18T21:49:43.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d00f6530 0x7fd0d006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:43.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d00f77d0 0x7fd0d0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:43.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0cffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d006a410 con 0x7fd0d00f6530 2023-10-18T21:49:43.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0cffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d006a550 con 0x7fd0d00f77d0 2023-10-18T21:49:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0ceffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d00f6530 0x7fd0d006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0ceffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d00f6530 0x7fd0d006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38562/0 (socket says 172.21.15.8:38562) 2023-10-18T21:49:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0ceffd700 1 -- 172.21.15.8:0/2178910537 learned_addr learned my addr 172.21.15.8:0/2178910537 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0ce7fc700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d00f77d0 0x7fd0d0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0ceffd700 1 -- 172.21.15.8:0/2178910537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d00f77d0 msgr2=0x7fd0d0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0ceffd700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d00f77d0 0x7fd0d0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0ceffd700 1 -- 172.21.15.8:0/2178910537 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4005040 con 0x7fd0d00f6530 2023-10-18T21:49:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.747+0000 7fd0ce7fc700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d00f77d0 0x7fd0d0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:49:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.748+0000 7fd0ceffd700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d00f6530 0x7fd0d006b9a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fd0c00093f0 tx=0x7fd0c0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.748+0000 7fd0b77fe700 1 -- 172.21.15.8:0/2178910537 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c0009ea0 con 0x7fd0d00f6530 2023-10-18T21:49:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.748+0000 7fd0b77fe700 1 -- 172.21.15.8:0/2178910537 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd0c0013b00 con 0x7fd0d00f6530 2023-10-18T21:49:43.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.748+0000 7fd0cffff700 1 -- 172.21.15.8:0/2178910537 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d006a830 con 0x7fd0d00f6530 2023-10-18T21:49:43.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.748+0000 7fd0b77fe700 1 -- 172.21.15.8:0/2178910537 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c000dbf0 con 0x7fd0d00f6530 2023-10-18T21:49:43.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.748+0000 7fd0cffff700 1 -- 172.21.15.8:0/2178910537 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d010ede0 con 0x7fd0d00f6530 2023-10-18T21:49:43.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.749+0000 7fd0cffff700 1 -- 172.21.15.8:0/2178910537 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d0045ad0 con 0x7fd0d00f6530 2023-10-18T21:49:43.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.750+0000 7fd0b77fe700 1 -- 172.21.15.8:0/2178910537 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd0c001a060 con 0x7fd0d00f6530 2023-10-18T21:49:43.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.751+0000 7fd0b77fe700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0b8060f70 0x7fd0b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:43.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.751+0000 7fd0b77fe700 1 -- 172.21.15.8:0/2178910537 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd0c007c890 con 0x7fd0d00f6530 2023-10-18T21:49:43.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.751+0000 7fd0ce7fc700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0b8060f70 0x7fd0b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:43.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.751+0000 7fd0ce7fc700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0b8060f70 0x7fd0b8063430 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fd0c4004e30 tx=0x7fd0c4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:43.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:43.755+0000 7fd0b77fe700 1 -- 172.21.15.8:0/2178910537 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd0c004c520 con 0x7fd0d00f6530 2023-10-18T21:49:44.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.009+0000 7fd0cffff700 1 -- 172.21.15.8:0/2178910537 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0d0027a00 con 0x7fd0d00f6530 2023-10-18T21:49:44.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.009+0000 7fd0b77fe700 1 -- 172.21.15.8:0/2178910537 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fd0c004fb40 con 0x7fd0d00f6530 2023-10-18T21:49:44.012 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:49:44.012 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:49:44.012 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:49:44.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:49:44.012 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:49:44.012 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:49:44.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:49:44.013 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:49:44.013 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:49:44.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:49:44.013 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:49:44.014 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:49:44.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:49:44.014 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:49:44.014 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:49:44.014 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:49:44.015 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:49:44.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 -- 172.21.15.8:0/2178910537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0b8060f70 msgr2=0x7fd0b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:44.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0b8060f70 0x7fd0b8063430 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fd0c4004e30 tx=0x7fd0c4009b30).stop 2023-10-18T21:49:44.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 -- 172.21.15.8:0/2178910537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d00f6530 msgr2=0x7fd0d006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:44.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d00f6530 0x7fd0d006b9a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fd0c00093f0 tx=0x7fd0c0006ec0).stop 2023-10-18T21:49:44.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 -- 172.21.15.8:0/2178910537 shutdown_connections 2023-10-18T21:49:44.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0b8060f70 0x7fd0b8063430 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d00f6530 0x7fd0d006b9a0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 --2- 172.21.15.8:0/2178910537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d00f77d0 0x7fd0d0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 -- 172.21.15.8:0/2178910537 >> 172.21.15.8:0/2178910537 conn(0x7fd0d00f1c90 msgr2=0x7fd0d00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:44.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 -- 172.21.15.8:0/2178910537 shutdown_connections 2023-10-18T21:49:44.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.011+0000 7fd0cffff700 1 -- 172.21.15.8:0/2178910537 wait complete. 2023-10-18T21:49:44.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.149+0000 7f5b14df9700 1 -- 172.21.15.8:0/2705392058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b100f77d0 msgr2=0x7f5b100f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.149+0000 7f5b14df9700 1 --2- 172.21.15.8:0/2705392058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b100f77d0 0x7f5b100f7c30 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f5b04004660 tx=0x7f5b04009b30).stop 2023-10-18T21:49:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.149+0000 7f5b14df9700 1 -- 172.21.15.8:0/2705392058 shutdown_connections 2023-10-18T21:49:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.149+0000 7f5b14df9700 1 --2- 172.21.15.8:0/2705392058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b100f77d0 0x7f5b100f7c30 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.149+0000 7f5b14df9700 1 --2- 172.21.15.8:0/2705392058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b100f6530 0x7f5b100f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:49:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.149+0000 7f5b14df9700 1 -- 172.21.15.8:0/2705392058 >> 172.21.15.8:0/2705392058 conn(0x7f5b100f1c90 msgr2=0x7f5b100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.149+0000 7f5b14df9700 1 -- 172.21.15.8:0/2705392058 shutdown_connections 2023-10-18T21:49:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.149+0000 7f5b14df9700 1 -- 172.21.15.8:0/2705392058 wait complete. 2023-10-18T21:49:44.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.150+0000 7f5b14df9700 1 Processor -- start 2023-10-18T21:49:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.150+0000 7f5b14df9700 1 -- start start 2023-10-18T21:49:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.150+0000 7f5b14df9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b100f6530 0x7f5b10108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b14df9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b100f77d0 0x7f5b101094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b14df9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b10109b00 con 0x7f5b100f77d0 2023-10-18T21:49:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b14df9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1010a3b0 con 0x7f5b100f6530 2023-10-18T21:49:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b0effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b100f77d0 0x7f5b101094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b0effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b100f77d0 0x7f5b101094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38590/0 (socket says 172.21.15.8:38590) 2023-10-18T21:49:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b0effd700 1 -- 172.21.15.8:0/820678173 learned_addr learned my addr 172.21.15.8:0/820678173 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b0f7fe700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b100f6530 0x7f5b10108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b0effd700 1 -- 172.21.15.8:0/820678173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b100f6530 msgr2=0x7f5b10108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b0effd700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b100f6530 0x7f5b10108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b0effd700 1 -- 172.21.15.8:0/820678173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b04005040 con 0x7f5b100f77d0 2023-10-18T21:49:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b0f7fe700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b100f6530 0x7f5b10108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:49:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.151+0000 7f5b0effd700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b100f77d0 0x7f5b101094c0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f5b04009830 tx=0x7f5b04009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.152+0000 7f5af7fff700 1 -- 172.21.15.8:0/820678173 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b04018070 con 0x7f5b100f77d0 2023-10-18T21:49:44.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.152+0000 7f5af7fff700 1 -- 172.21.15.8:0/820678173 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5b0401d8e0 con 0x7f5b100f77d0 2023-10-18T21:49:44.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.152+0000 7f5b14df9700 1 -- 172.21.15.8:0/820678173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1010a630 con 0x7f5b100f77d0 2023-10-18T21:49:44.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.152+0000 7f5af7fff700 1 -- 172.21.15.8:0/820678173 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b0401c540 con 0x7f5b100f77d0 2023-10-18T21:49:44.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.152+0000 7f5b14df9700 1 -- 172.21.15.8:0/820678173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1010ab90 con 0x7f5b100f77d0 2023-10-18T21:49:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.153+0000 7f5b14df9700 1 -- 172.21.15.8:0/820678173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b10059100 con 0x7f5b100f77d0 2023-10-18T21:49:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.154+0000 7f5af7fff700 1 -- 172.21.15.8:0/820678173 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5b0401da50 con 0x7f5b100f77d0 2023-10-18T21:49:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.155+0000 7f5af7fff700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5af8060f70 0x7f5af8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.155+0000 7f5af7fff700 1 -- 172.21.15.8:0/820678173 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5b0407e7c0 con 0x7f5b100f77d0 2023-10-18T21:49:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.155+0000 7f5b0f7fe700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5af8060f70 0x7f5af8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.156+0000 7f5b0f7fe700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5af8060f70 0x7f5af8063430 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f5b100f7630 tx=0x7f5b00008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.159+0000 7f5af7fff700 1 -- 172.21.15.8:0/820678173 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5b04051e20 con 0x7f5b100f77d0 2023-10-18T21:49:44.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.388+0000 7f5b14df9700 1 -- 172.21.15.8:0/820678173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5b100fed60 con 0x7f5b100f77d0 2023-10-18T21:49:44.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.388+0000 7f5af7fff700 1 -- 172.21.15.8:0/820678173 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f5b04051a10 con 0x7f5b100f77d0 2023-10-18T21:49:44.391 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:49:44.391 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:49:44.391 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:49:44.391 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:49:44.392 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:49:44.392 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:49:44.392 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:49:44.392 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:49:44.392 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:49:44.393 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:49:44.393 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:49:44.393 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:49:44.393 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:49:44.393 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:49:44.394 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:49:44.394 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:49:44.394 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:49:44.394 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:49:44.394 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:49:44.395 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:49:44.395 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:49:44.395 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:49:44.395 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:49:44.395 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:49:44.395 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:49:44.396 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:49:44.396 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:49:44.396 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:49:44.396 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:49:44.396 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:49:44.397 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:49:44.397 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:49:44.397 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:49:44.397 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:49:44.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.390+0000 7f5b14df9700 1 -- 172.21.15.8:0/820678173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5af8060f70 msgr2=0x7f5af8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:44.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.390+0000 7f5b14df9700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5af8060f70 0x7f5af8063430 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f5b100f7630 tx=0x7f5b00008040).stop 2023-10-18T21:49:44.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.390+0000 7f5b14df9700 1 -- 172.21.15.8:0/820678173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b100f77d0 msgr2=0x7f5b101094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:44.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.390+0000 7f5b14df9700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b100f77d0 0x7f5b101094c0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f5b04009830 tx=0x7f5b04009b30).stop 2023-10-18T21:49:44.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.390+0000 7f5b14df9700 1 -- 172.21.15.8:0/820678173 shutdown_connections 2023-10-18T21:49:44.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.390+0000 7f5b14df9700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5af8060f70 0x7f5af8063430 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.390+0000 7f5b14df9700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b100f6530 0x7f5b10108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.390+0000 7f5b14df9700 1 --2- 172.21.15.8:0/820678173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b100f77d0 0x7f5b101094c0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.390+0000 7f5b14df9700 1 -- 172.21.15.8:0/820678173 >> 172.21.15.8:0/820678173 conn(0x7f5b100f1c90 msgr2=0x7f5b1006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:44.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.391+0000 7f5b14df9700 1 -- 172.21.15.8:0/820678173 shutdown_connections 2023-10-18T21:49:44.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.391+0000 7f5b14df9700 1 -- 172.21.15.8:0/820678173 wait complete. 2023-10-18T21:49:44.400 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:49:44.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:42.212744+0000 mgr.smithi008.flmjzp (mgr.14640) 3050 : cluster [DBG] pgmap v2100: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:44.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:42.905547+0000 mgr.smithi008.flmjzp (mgr.14640) 3051 : audit [DBG] from='client.36544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:44.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:44.010817+0000 mon.smithi008 (mon.0) 3430 : audit [DBG] from='client.? 172.21.15.8:0/2178910537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:44.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:42.212744+0000 mgr.smithi008.flmjzp (mgr.14640) 3050 : cluster [DBG] pgmap v2100: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:42.905547+0000 mgr.smithi008.flmjzp (mgr.14640) 3051 : audit [DBG] from='client.36544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:44.010817+0000 mon.smithi008 (mon.0) 3430 : audit [DBG] from='client.? 172.21.15.8:0/2178910537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:44.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.528+0000 7fd5d7fff700 1 -- 172.21.15.8:0/2192746925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5d80f6530 msgr2=0x7fd5d80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:44.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.528+0000 7fd5d7fff700 1 --2- 172.21.15.8:0/2192746925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5d80f6530 0x7fd5d80f6950 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7fd5c8004660 tx=0x7fd5c8009b30).stop 2023-10-18T21:49:44.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.528+0000 7fd5d7fff700 1 -- 172.21.15.8:0/2192746925 shutdown_connections 2023-10-18T21:49:44.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.528+0000 7fd5d7fff700 1 --2- 172.21.15.8:0/2192746925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d80f77d0 0x7fd5d80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.528+0000 7fd5d7fff700 1 --2- 172.21.15.8:0/2192746925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5d80f6530 0x7fd5d80f6950 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.528+0000 7fd5d7fff700 1 -- 172.21.15.8:0/2192746925 >> 172.21.15.8:0/2192746925 conn(0x7fd5d80f1c90 msgr2=0x7fd5d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:44.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.528+0000 7fd5d7fff700 1 -- 172.21.15.8:0/2192746925 shutdown_connections 2023-10-18T21:49:44.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.528+0000 7fd5d7fff700 1 -- 172.21.15.8:0/2192746925 wait complete. 2023-10-18T21:49:44.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.529+0000 7fd5d7fff700 1 Processor -- start 2023-10-18T21:49:44.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.529+0000 7fd5d7fff700 1 -- start start 2023-10-18T21:49:44.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.529+0000 7fd5d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5d80f6530 0x7fd5d8106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:44.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.529+0000 7fd5d7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d80f77d0 0x7fd5d8107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:44.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.529+0000 7fd5d7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8107900 con 0x7fd5d80f6530 2023-10-18T21:49:44.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.529+0000 7fd5d7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8108110 con 0x7fd5d80f77d0 2023-10-18T21:49:44.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.530+0000 7fd5d6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5d80f6530 0x7fd5d8106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:44.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.530+0000 7fd5d6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5d80f6530 0x7fd5d8106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38612/0 (socket says 172.21.15.8:38612) 2023-10-18T21:49:44.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.530+0000 7fd5d6ffd700 1 -- 172.21.15.8:0/1052218444 learned_addr learned my addr 172.21.15.8:0/1052218444 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:49:44.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.530+0000 7fd5d67fc700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d80f77d0 0x7fd5d8107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:44.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.530+0000 7fd5d6ffd700 1 -- 172.21.15.8:0/1052218444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d80f77d0 msgr2=0x7fd5d8107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:44.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.530+0000 7fd5d6ffd700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d80f77d0 0x7fd5d8107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.530+0000 7fd5d6ffd700 1 -- 172.21.15.8:0/1052218444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c8005040 con 0x7fd5d80f6530 2023-10-18T21:49:44.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.530+0000 7fd5d6ffd700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5d80f6530 0x7fd5d8106e10 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fd5c8007a70 tx=0x7fd5c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:44.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.530+0000 7fd5bf7fe700 1 -- 172.21.15.8:0/1052218444 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c8018070 con 0x7fd5d80f6530 2023-10-18T21:49:44.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.531+0000 7fd5bf7fe700 1 -- 172.21.15.8:0/1052218444 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd5c801d8e0 con 0x7fd5d80f6530 2023-10-18T21:49:44.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.531+0000 7fd5bf7fe700 1 -- 172.21.15.8:0/1052218444 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c801c660 con 0x7fd5d80f6530 2023-10-18T21:49:44.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.531+0000 7fd5d7fff700 1 -- 172.21.15.8:0/1052218444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d8108330 con 0x7fd5d80f6530 2023-10-18T21:49:44.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.531+0000 7fd5d7fff700 1 -- 172.21.15.8:0/1052218444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d8108890 con 0x7fd5d80f6530 2023-10-18T21:49:44.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.532+0000 7fd5d7fff700 1 -- 172.21.15.8:0/1052218444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d8059100 con 0x7fd5d80f6530 2023-10-18T21:49:44.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.533+0000 7fd5bf7fe700 1 -- 172.21.15.8:0/1052218444 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd5c801da50 con 0x7fd5d80f6530 2023-10-18T21:49:44.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.533+0000 7fd5bf7fe700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd5c0060f70 0x7fd5c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:49:44.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.534+0000 7fd5bf7fe700 1 -- 172.21.15.8:0/1052218444 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd5c807e8c0 con 0x7fd5d80f6530 2023-10-18T21:49:44.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.534+0000 7fd5d67fc700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd5c0060f70 0x7fd5c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:49:44.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.534+0000 7fd5d67fc700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd5c0060f70 0x7fd5c0063430 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fd5cc007fd0 tx=0x7fd5cc009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:49:44.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.538+0000 7fd5bf7fe700 1 -- 172.21.15.8:0/1052218444 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd5c804e4f0 con 0x7fd5d80f6530 2023-10-18T21:49:44.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.742+0000 7fd5d7fff700 1 -- 172.21.15.8:0/1052218444 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5d80fecc0 con 0x7fd5c0060f70 2023-10-18T21:49:44.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.744+0000 7fd5bf7fe700 1 -- 172.21.15.8:0/1052218444 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd5d80fecc0 con 0x7fd5c0060f70 2023-10-18T21:49:44.746 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:49:44.746 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:49:44.746 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:49:44.747 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:49:44.747 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:49:44.747 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:49:44.747 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:49:44.747 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:49:44.747 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:49:44.748 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:49:44.748 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:49:44.748 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:49:44.748 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:49:44.748 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:49:44.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 -- 172.21.15.8:0/1052218444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd5c0060f70 msgr2=0x7fd5c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:44.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd5c0060f70 0x7fd5c0063430 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fd5cc007fd0 tx=0x7fd5cc009040).stop 2023-10-18T21:49:44.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 -- 172.21.15.8:0/1052218444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5d80f6530 msgr2=0x7fd5d8106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:49:44.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5d80f6530 0x7fd5d8106e10 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fd5c8007a70 tx=0x7fd5c8009b30).stop 2023-10-18T21:49:44.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 -- 172.21.15.8:0/1052218444 shutdown_connections 2023-10-18T21:49:44.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd5c0060f70 0x7fd5c0063430 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5d80f6530 0x7fd5d8106e10 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 --2- 172.21.15.8:0/1052218444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d80f77d0 0x7fd5d8107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:49:44.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 -- 172.21.15.8:0/1052218444 >> 172.21.15.8:0/1052218444 conn(0x7fd5d80f1c90 msgr2=0x7fd5d80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:49:44.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 -- 172.21.15.8:0/1052218444 shutdown_connections 2023-10-18T21:49:44.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:49:44.746+0000 7fd5d7fff700 1 -- 172.21.15.8:0/1052218444 wait complete. 2023-10-18T21:49:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:43.256682+0000 mgr.smithi008.flmjzp (mgr.14640) 3052 : audit [DBG] from='client.36548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:43.600973+0000 mgr.smithi008.flmjzp (mgr.14640) 3053 : audit [DBG] from='client.36552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:44.390084+0000 mon.smithi008 (mon.0) 3431 : audit [DBG] from='client.? 172.21.15.8:0/820678173' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:49:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:43.256682+0000 mgr.smithi008.flmjzp (mgr.14640) 3052 : audit [DBG] from='client.36548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:43.600973+0000 mgr.smithi008.flmjzp (mgr.14640) 3053 : audit [DBG] from='client.36552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:44.390084+0000 mon.smithi008 (mon.0) 3431 : audit [DBG] from='client.? 172.21.15.8:0/820678173' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:49:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:44.213190+0000 mgr.smithi008.flmjzp (mgr.14640) 3054 : cluster [DBG] pgmap v2101: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:44.745106+0000 mgr.smithi008.flmjzp (mgr.14640) 3055 : audit [DBG] from='client.36564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:44.213190+0000 mgr.smithi008.flmjzp (mgr.14640) 3054 : cluster [DBG] pgmap v2101: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:44.745106+0000 mgr.smithi008.flmjzp (mgr.14640) 3055 : audit [DBG] from='client.36564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:49:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:46.213914+0000 mgr.smithi008.flmjzp (mgr.14640) 3056 : cluster [DBG] pgmap v2102: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:46.244350+0000 mon.smithi008 (mon.0) 3432 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:46.246512+0000 mon.smithi008 (mon.0) 3433 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:46.247541+0000 mon.smithi008 (mon.0) 3434 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:46.248415+0000 mgr.smithi008.flmjzp (mgr.14640) 3057 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:46.249027+0000 mgr.smithi008.flmjzp (mgr.14640) 3058 : cluster [DBG] pgmap v2103: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:46.249339+0000 mgr.smithi008.flmjzp (mgr.14640) 3059 : cluster [DBG] pgmap v2104: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:46.253754+0000 mon.smithi008 (mon.0) 3435 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:46.260367+0000 mon.smithi008 (mon.0) 3436 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:46.263555+0000 mon.smithi008 (mon.0) 3437 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:46.265591+0000 mon.smithi008 (mon.0) 3438 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:46.267508+0000 mon.smithi008 (mon.0) 3439 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:46.269542+0000 mon.smithi008 (mon.0) 3440 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:46.271405+0000 mgr.smithi008.flmjzp (mgr.14640) 3060 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:47.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:46.213914+0000 mgr.smithi008.flmjzp (mgr.14640) 3056 : cluster [DBG] pgmap v2102: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:46.244350+0000 mon.smithi008 (mon.0) 3432 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:46.246512+0000 mon.smithi008 (mon.0) 3433 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:46.247541+0000 mon.smithi008 (mon.0) 3434 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:46.248415+0000 mgr.smithi008.flmjzp (mgr.14640) 3057 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:46.249027+0000 mgr.smithi008.flmjzp (mgr.14640) 3058 : cluster [DBG] pgmap v2103: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:46.249339+0000 mgr.smithi008.flmjzp (mgr.14640) 3059 : cluster [DBG] pgmap v2104: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:46.253754+0000 mon.smithi008 (mon.0) 3435 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:46.260367+0000 mon.smithi008 (mon.0) 3436 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:46.263555+0000 mon.smithi008 (mon.0) 3437 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:46.265591+0000 mon.smithi008 (mon.0) 3438 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:46.267508+0000 mon.smithi008 (mon.0) 3439 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:46.269542+0000 mon.smithi008 (mon.0) 3440 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:46.271405+0000 mgr.smithi008.flmjzp (mgr.14640) 3060 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:48.249815+0000 mgr.smithi008.flmjzp (mgr.14640) 3061 : cluster [DBG] pgmap v2105: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:49.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:48.249815+0000 mgr.smithi008.flmjzp (mgr.14640) 3061 : cluster [DBG] pgmap v2105: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:51.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:50.250478+0000 mgr.smithi008.flmjzp (mgr.14640) 3062 : cluster [DBG] pgmap v2106: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:50.250478+0000 mgr.smithi008.flmjzp (mgr.14640) 3062 : cluster [DBG] pgmap v2106: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:52.250987+0000 mgr.smithi008.flmjzp (mgr.14640) 3063 : cluster [DBG] pgmap v2107: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:52.250987+0000 mgr.smithi008.flmjzp (mgr.14640) 3063 : cluster [DBG] pgmap v2107: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:54.251640+0000 mgr.smithi008.flmjzp (mgr.14640) 3064 : cluster [DBG] pgmap v2108: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:56.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:54.251640+0000 mgr.smithi008.flmjzp (mgr.14640) 3064 : cluster [DBG] pgmap v2108: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:56.273097+0000 mon.smithi008 (mon.0) 3441 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:56.275546+0000 mon.smithi008 (mon.0) 3442 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:56.276531+0000 mon.smithi008 (mon.0) 3443 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:56.283379+0000 mon.smithi008 (mon.0) 3444 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:57.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:56.289927+0000 mon.smithi008 (mon.0) 3445 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:57.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:56.293055+0000 mon.smithi008 (mon.0) 3446 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:57.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:56.294702+0000 mon.smithi008 (mon.0) 3447 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:57.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:56.296305+0000 mon.smithi008 (mon.0) 3448 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:57.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:49:56.298297+0000 mon.smithi008 (mon.0) 3449 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:56.273097+0000 mon.smithi008 (mon.0) 3441 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:56.275546+0000 mon.smithi008 (mon.0) 3442 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:49:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:56.276531+0000 mon.smithi008 (mon.0) 3443 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:49:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:56.283379+0000 mon.smithi008 (mon.0) 3444 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:49:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:56.289927+0000 mon.smithi008 (mon.0) 3445 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:49:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:56.293055+0000 mon.smithi008 (mon.0) 3446 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:57.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:56.294702+0000 mon.smithi008 (mon.0) 3447 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:57.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:56.296305+0000 mon.smithi008 (mon.0) 3448 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:57.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:49:56.298297+0000 mon.smithi008 (mon.0) 3449 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:49:58.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:56.252346+0000 mgr.smithi008.flmjzp (mgr.14640) 3065 : cluster [DBG] pgmap v2109: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:56.277396+0000 mgr.smithi008.flmjzp (mgr.14640) 3066 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:56.277964+0000 mgr.smithi008.flmjzp (mgr.14640) 3067 : cluster [DBG] pgmap v2110: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:56.278240+0000 mgr.smithi008.flmjzp (mgr.14640) 3068 : cluster [DBG] pgmap v2111: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:58.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:49:56.300190+0000 mgr.smithi008.flmjzp (mgr.14640) 3069 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:49:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:56.252346+0000 mgr.smithi008.flmjzp (mgr.14640) 3065 : cluster [DBG] pgmap v2109: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:56.277396+0000 mgr.smithi008.flmjzp (mgr.14640) 3066 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:49:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:56.277964+0000 mgr.smithi008.flmjzp (mgr.14640) 3067 : cluster [DBG] pgmap v2110: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:56.278240+0000 mgr.smithi008.flmjzp (mgr.14640) 3068 : cluster [DBG] pgmap v2111: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:49:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:49:56.300190+0000 mgr.smithi008.flmjzp (mgr.14640) 3069 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:00.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:49:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:49:58.278937+0000 mgr.smithi008.flmjzp (mgr.14640) 3070 : cluster [DBG] pgmap v2112: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:49:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:49:58.278937+0000 mgr.smithi008.flmjzp (mgr.14640) 3070 : cluster [DBG] pgmap v2112: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:00.000202+0000 mon.smithi008 (mon.0) 3450 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T21:50:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:00.000202+0000 mon.smithi008 (mon.0) 3450 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T21:50:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:00.279553+0000 mgr.smithi008.flmjzp (mgr.14640) 3071 : cluster [DBG] pgmap v2113: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:02.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:00.279553+0000 mgr.smithi008.flmjzp (mgr.14640) 3071 : cluster [DBG] pgmap v2113: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:02.280247+0000 mgr.smithi008.flmjzp (mgr.14640) 3072 : cluster [DBG] pgmap v2114: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:04.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:02.280247+0000 mgr.smithi008.flmjzp (mgr.14640) 3072 : cluster [DBG] pgmap v2114: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:04.280880+0000 mgr.smithi008.flmjzp (mgr.14640) 3073 : cluster [DBG] pgmap v2115: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:06.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:04.280880+0000 mgr.smithi008.flmjzp (mgr.14640) 3073 : cluster [DBG] pgmap v2115: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:07.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:06.301064+0000 mon.smithi008 (mon.0) 3451 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:07.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:06.301064+0000 mon.smithi008 (mon.0) 3451 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:06.281519+0000 mgr.smithi008.flmjzp (mgr.14640) 3074 : cluster [DBG] pgmap v2116: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:06.863906+0000 mon.smithi008 (mon.0) 3452 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:08.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:06.864719+0000 mon.smithi008 (mon.0) 3453 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:08.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:06.865339+0000 mgr.smithi008.flmjzp (mgr.14640) 3075 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:08.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:06.865824+0000 mgr.smithi008.flmjzp (mgr.14640) 3076 : cluster [DBG] pgmap v2117: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:08.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:06.866079+0000 mgr.smithi008.flmjzp (mgr.14640) 3077 : cluster [DBG] pgmap v2118: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:08.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:06.870076+0000 mon.smithi008 (mon.0) 3454 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:08.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:06.875096+0000 mon.smithi008 (mon.0) 3455 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:08.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:06.877362+0000 mon.smithi008 (mon.0) 3456 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:08.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:06.878626+0000 mon.smithi008 (mon.0) 3457 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:08.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:06.879884+0000 mon.smithi008 (mon.0) 3458 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:08.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:06.881393+0000 mon.smithi008 (mon.0) 3459 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:08.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:06.882982+0000 mgr.smithi008.flmjzp (mgr.14640) 3078 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:06.281519+0000 mgr.smithi008.flmjzp (mgr.14640) 3074 : cluster [DBG] pgmap v2116: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:06.863906+0000 mon.smithi008 (mon.0) 3452 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:06.864719+0000 mon.smithi008 (mon.0) 3453 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:06.865339+0000 mgr.smithi008.flmjzp (mgr.14640) 3075 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:08.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:06.865824+0000 mgr.smithi008.flmjzp (mgr.14640) 3076 : cluster [DBG] pgmap v2117: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:08.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:06.866079+0000 mgr.smithi008.flmjzp (mgr.14640) 3077 : cluster [DBG] pgmap v2118: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:08.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:06.870076+0000 mon.smithi008 (mon.0) 3454 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:08.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:06.875096+0000 mon.smithi008 (mon.0) 3455 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:08.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:06.877362+0000 mon.smithi008 (mon.0) 3456 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:08.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:06.878626+0000 mon.smithi008 (mon.0) 3457 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:08.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:06.879884+0000 mon.smithi008 (mon.0) 3458 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:08.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:06.881393+0000 mon.smithi008 (mon.0) 3459 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:08.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:06.882982+0000 mgr.smithi008.flmjzp (mgr.14640) 3078 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:10.201 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:08.866681+0000 mgr.smithi008.flmjzp (mgr.14640) 3079 : cluster [DBG] pgmap v2119: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:10.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:08.866681+0000 mgr.smithi008.flmjzp (mgr.14640) 3079 : cluster [DBG] pgmap v2119: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:10.867315+0000 mgr.smithi008.flmjzp (mgr.14640) 3080 : cluster [DBG] pgmap v2120: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:12.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:10.867315+0000 mgr.smithi008.flmjzp (mgr.14640) 3080 : cluster [DBG] pgmap v2120: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:12.867845+0000 mgr.smithi008.flmjzp (mgr.14640) 3081 : cluster [DBG] pgmap v2121: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:14.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:12.867845+0000 mgr.smithi008.flmjzp (mgr.14640) 3081 : cluster [DBG] pgmap v2121: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.902+0000 7fea197af700 1 -- 172.21.15.8:0/1691055690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea140f6530 msgr2=0x7fea140f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.902+0000 7fea197af700 1 --2- 172.21.15.8:0/1691055690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea140f6530 0x7fea140f6950 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fea08004660 tx=0x7fea08009b30).stop 2023-10-18T21:50:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.902+0000 7fea197af700 1 -- 172.21.15.8:0/1691055690 shutdown_connections 2023-10-18T21:50:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.902+0000 7fea197af700 1 --2- 172.21.15.8:0/1691055690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea140f77d0 0x7fea140f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.902+0000 7fea197af700 1 --2- 172.21.15.8:0/1691055690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea140f6530 0x7fea140f6950 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.902+0000 7fea197af700 1 -- 172.21.15.8:0/1691055690 >> 172.21.15.8:0/1691055690 conn(0x7fea140f1c90 msgr2=0x7fea140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.902+0000 7fea197af700 1 -- 172.21.15.8:0/1691055690 shutdown_connections 2023-10-18T21:50:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.902+0000 7fea197af700 1 -- 172.21.15.8:0/1691055690 wait complete. 2023-10-18T21:50:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.903+0000 7fea197af700 1 Processor -- start 2023-10-18T21:50:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.903+0000 7fea197af700 1 -- start start 2023-10-18T21:50:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.904+0000 7fea197af700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea140f6530 0x7fea14108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.904+0000 7fea197af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea140f77d0 0x7fea141094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.904+0000 7fea197af700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea14109a70 con 0x7fea140f6530 2023-10-18T21:50:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.904+0000 7fea197af700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea14109bb0 con 0x7fea140f77d0 2023-10-18T21:50:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.904+0000 7fea13fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea140f6530 0x7fea14108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.904+0000 7fea13fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea140f6530 0x7fea14108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41438/0 (socket says 172.21.15.8:41438) 2023-10-18T21:50:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.904+0000 7fea13fff700 1 -- 172.21.15.8:0/1485513940 learned_addr learned my addr 172.21.15.8:0/1485513940 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.904+0000 7fea137fe700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea140f77d0 0x7fea141094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.905+0000 7fea13fff700 1 -- 172.21.15.8:0/1485513940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea140f77d0 msgr2=0x7fea141094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.905+0000 7fea13fff700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea140f77d0 0x7fea141094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:14.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.905+0000 7fea13fff700 1 -- 172.21.15.8:0/1485513940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea08005040 con 0x7fea140f6530 2023-10-18T21:50:14.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.905+0000 7fea13fff700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea140f6530 0x7fea14108fd0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fea08007a60 tx=0x7fea08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:14.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.905+0000 7fea10ff9700 1 -- 172.21.15.8:0/1485513940 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea08018070 con 0x7fea140f6530 2023-10-18T21:50:14.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.905+0000 7fea10ff9700 1 -- 172.21.15.8:0/1485513940 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fea08009630 con 0x7fea140f6530 2023-10-18T21:50:14.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.905+0000 7fea197af700 1 -- 172.21.15.8:0/1485513940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1410a4f0 con 0x7fea140f6530 2023-10-18T21:50:14.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.905+0000 7fea10ff9700 1 -- 172.21.15.8:0/1485513940 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0801c4d0 con 0x7fea140f6530 2023-10-18T21:50:14.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.905+0000 7fea197af700 1 -- 172.21.15.8:0/1485513940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1410aa50 con 0x7fea140f6530 2023-10-18T21:50:14.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.906+0000 7fea197af700 1 -- 172.21.15.8:0/1485513940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea14045ad0 con 0x7fea140f6530 2023-10-18T21:50:14.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.907+0000 7fea10ff9700 1 -- 172.21.15.8:0/1485513940 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fea0801d420 con 0x7fea140f6530 2023-10-18T21:50:14.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.908+0000 7fea10ff9700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9fc060f70 0x7fe9fc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:14.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.908+0000 7fea10ff9700 1 -- 172.21.15.8:0/1485513940 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fea0807e650 con 0x7fea140f6530 2023-10-18T21:50:14.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.909+0000 7fea137fe700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9fc060f70 0x7fe9fc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:14.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.909+0000 7fea137fe700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9fc060f70 0x7fe9fc063430 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fea04004c40 tx=0x7fea0400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:14.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:14.913+0000 7fea10ff9700 1 -- 172.21.15.8:0/1485513940 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fea08051ca0 con 0x7fea140f6530 2023-10-18T21:50:15.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.113+0000 7fea197af700 1 -- 172.21.15.8:0/1485513940 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea140fee00 con 0x7fe9fc060f70 2023-10-18T21:50:15.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.114+0000 7fea10ff9700 1 -- 172.21.15.8:0/1485513940 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fea140fee00 con 0x7fe9fc060f70 2023-10-18T21:50:15.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.116+0000 7fea197af700 1 -- 172.21.15.8:0/1485513940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9fc060f70 msgr2=0x7fe9fc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.116+0000 7fea197af700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9fc060f70 0x7fe9fc063430 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fea04004c40 tx=0x7fea0400b040).stop 2023-10-18T21:50:15.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.116+0000 7fea197af700 1 -- 172.21.15.8:0/1485513940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea140f6530 msgr2=0x7fea14108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.116+0000 7fea197af700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea140f6530 0x7fea14108fd0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fea08007a60 tx=0x7fea08009b30).stop 2023-10-18T21:50:15.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.117+0000 7fea197af700 1 -- 172.21.15.8:0/1485513940 shutdown_connections 2023-10-18T21:50:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.117+0000 7fea197af700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9fc060f70 0x7fe9fc063430 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.117+0000 7fea197af700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea140f6530 0x7fea14108fd0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.117+0000 7fea197af700 1 --2- 172.21.15.8:0/1485513940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea140f77d0 0x7fea141094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.117+0000 7fea197af700 1 -- 172.21.15.8:0/1485513940 >> 172.21.15.8:0/1485513940 conn(0x7fea140f1c90 msgr2=0x7fea1406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.117+0000 7fea197af700 1 -- 172.21.15.8:0/1485513940 shutdown_connections 2023-10-18T21:50:15.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.117+0000 7fea197af700 1 -- 172.21.15.8:0/1485513940 wait complete. 2023-10-18T21:50:15.132 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:50:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.255+0000 7f0f19cc8700 1 -- 172.21.15.8:0/297789602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140f6530 msgr2=0x7f0f140f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.255+0000 7f0f19cc8700 1 --2- 172.21.15.8:0/297789602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140f6530 0x7f0f140f6950 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f0f08004660 tx=0x7f0f08009b30).stop 2023-10-18T21:50:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.256+0000 7f0f19cc8700 1 -- 172.21.15.8:0/297789602 shutdown_connections 2023-10-18T21:50:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.256+0000 7f0f19cc8700 1 --2- 172.21.15.8:0/297789602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f140f77d0 0x7f0f140f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.256+0000 7f0f19cc8700 1 --2- 172.21.15.8:0/297789602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140f6530 0x7f0f140f6950 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.256+0000 7f0f19cc8700 1 -- 172.21.15.8:0/297789602 >> 172.21.15.8:0/297789602 conn(0x7f0f140f1c90 msgr2=0x7f0f140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.256+0000 7f0f19cc8700 1 -- 172.21.15.8:0/297789602 shutdown_connections 2023-10-18T21:50:15.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.256+0000 7f0f19cc8700 1 -- 172.21.15.8:0/297789602 wait complete. 2023-10-18T21:50:15.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.256+0000 7f0f19cc8700 1 Processor -- start 2023-10-18T21:50:15.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.257+0000 7f0f19cc8700 1 -- start start 2023-10-18T21:50:15.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.257+0000 7f0f19cc8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140f6530 0x7f0f14106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:15.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.257+0000 7f0f19cc8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f140f77d0 0x7f0f14107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:15.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.257+0000 7f0f19cc8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14107870 con 0x7f0f140f6530 2023-10-18T21:50:15.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.257+0000 7f0f19cc8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f141080b0 con 0x7f0f140f77d0 2023-10-18T21:50:15.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.257+0000 7f0f18cc6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140f6530 0x7f0f14106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:15.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.257+0000 7f0f18cc6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140f6530 0x7f0f14106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41454/0 (socket says 172.21.15.8:41454) 2023-10-18T21:50:15.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.257+0000 7f0f18cc6700 1 -- 172.21.15.8:0/3552646768 learned_addr learned my addr 172.21.15.8:0/3552646768 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:15.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.257+0000 7f0f13fff700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f140f77d0 0x7f0f14107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.258+0000 7f0f18cc6700 1 -- 172.21.15.8:0/3552646768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f140f77d0 msgr2=0x7f0f14107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.258+0000 7f0f18cc6700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f140f77d0 0x7f0f14107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.258+0000 7f0f18cc6700 1 -- 172.21.15.8:0/3552646768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f08005040 con 0x7f0f140f6530 2023-10-18T21:50:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.258+0000 7f0f18cc6700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140f6530 0x7f0f14106d80 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f0f08007a60 tx=0x7f0f08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.258+0000 7f0f117fa700 1 -- 172.21.15.8:0/3552646768 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f08018070 con 0x7f0f140f6530 2023-10-18T21:50:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.258+0000 7f0f19cc8700 1 -- 172.21.15.8:0/3552646768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f14108330 con 0x7f0f140f6530 2023-10-18T21:50:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.258+0000 7f0f117fa700 1 -- 172.21.15.8:0/3552646768 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0f08009630 con 0x7f0f140f6530 2023-10-18T21:50:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.258+0000 7f0f117fa700 1 -- 172.21.15.8:0/3552646768 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f0801c4d0 con 0x7f0f140f6530 2023-10-18T21:50:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.258+0000 7f0f19cc8700 1 -- 172.21.15.8:0/3552646768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f14108810 con 0x7f0f140f6530 2023-10-18T21:50:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.259+0000 7f0f19cc8700 1 -- 172.21.15.8:0/3552646768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f14059100 con 0x7f0f140f6530 2023-10-18T21:50:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.260+0000 7f0f117fa700 1 -- 172.21.15.8:0/3552646768 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0f0801d420 con 0x7f0f140f6530 2023-10-18T21:50:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.261+0000 7f0f117fa700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0f04060f70 0x7f0f04063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.261+0000 7f0f117fa700 1 -- 172.21.15.8:0/3552646768 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0f0807e550 con 0x7f0f140f6530 2023-10-18T21:50:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.261+0000 7f0f13fff700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0f04060f70 0x7f0f04063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.262+0000 7f0f13fff700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0f04060f70 0x7f0f04063430 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f0f14106b10 tx=0x7f0f0000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.266+0000 7f0f117fa700 1 -- 172.21.15.8:0/3552646768 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0f0804e180 con 0x7f0f140f6530 2023-10-18T21:50:15.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.466+0000 7f0f19cc8700 1 -- 172.21.15.8:0/3552646768 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f140fee00 con 0x7f0f04060f70 2023-10-18T21:50:15.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.467+0000 7f0f117fa700 1 -- 172.21.15.8:0/3552646768 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0f140fee00 con 0x7f0f04060f70 2023-10-18T21:50:15.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.469+0000 7f0f19cc8700 1 -- 172.21.15.8:0/3552646768 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0f04060f70 msgr2=0x7f0f04063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.469+0000 7f0f19cc8700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0f04060f70 0x7f0f04063430 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f0f14106b10 tx=0x7f0f0000b040).stop 2023-10-18T21:50:15.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.469+0000 7f0f19cc8700 1 -- 172.21.15.8:0/3552646768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140f6530 msgr2=0x7f0f14106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.469+0000 7f0f19cc8700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140f6530 0x7f0f14106d80 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f0f08007a60 tx=0x7f0f08009b30).stop 2023-10-18T21:50:15.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.469+0000 7f0f19cc8700 1 -- 172.21.15.8:0/3552646768 shutdown_connections 2023-10-18T21:50:15.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.469+0000 7f0f19cc8700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0f04060f70 0x7f0f04063430 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.469+0000 7f0f19cc8700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140f6530 0x7f0f14106d80 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.469+0000 7f0f19cc8700 1 --2- 172.21.15.8:0/3552646768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f140f77d0 0x7f0f14107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.469+0000 7f0f19cc8700 1 -- 172.21.15.8:0/3552646768 >> 172.21.15.8:0/3552646768 conn(0x7f0f140f1c90 msgr2=0x7f0f140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:15.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.470+0000 7f0f19cc8700 1 -- 172.21.15.8:0/3552646768 shutdown_connections 2023-10-18T21:50:15.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.470+0000 7f0f19cc8700 1 -- 172.21.15.8:0/3552646768 wait complete. 2023-10-18T21:50:15.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.607+0000 7fea0ccfd700 1 -- 172.21.15.8:0/4088954361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea080f77d0 msgr2=0x7fea080f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.607+0000 7fea0ccfd700 1 --2- 172.21.15.8:0/4088954361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea080f77d0 0x7fea080f7c30 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7fe9fc004660 tx=0x7fe9fc009b30).stop 2023-10-18T21:50:15.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.607+0000 7fea0ccfd700 1 -- 172.21.15.8:0/4088954361 shutdown_connections 2023-10-18T21:50:15.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.607+0000 7fea0ccfd700 1 --2- 172.21.15.8:0/4088954361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea080f77d0 0x7fea080f7c30 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.607+0000 7fea0ccfd700 1 --2- 172.21.15.8:0/4088954361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea080f6530 0x7fea080f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.607+0000 7fea0ccfd700 1 -- 172.21.15.8:0/4088954361 >> 172.21.15.8:0/4088954361 conn(0x7fea080f1c90 msgr2=0x7fea080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:15.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.607+0000 7fea0ccfd700 1 -- 172.21.15.8:0/4088954361 shutdown_connections 2023-10-18T21:50:15.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.607+0000 7fea0ccfd700 1 -- 172.21.15.8:0/4088954361 wait complete. 2023-10-18T21:50:15.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.608+0000 7fea0ccfd700 1 Processor -- start 2023-10-18T21:50:15.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.608+0000 7fea0ccfd700 1 -- start start 2023-10-18T21:50:15.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea0ccfd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea080f6530 0x7fea08108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:15.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea0ccfd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea080f77d0 0x7fea08109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:15.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea0ccfd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea081099c0 con 0x7fea080f6530 2023-10-18T21:50:15.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea0ccfd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea08109b00 con 0x7fea080f77d0 2023-10-18T21:50:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea080f6530 0x7fea08108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea080f6530 0x7fea08108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41476/0 (socket says 172.21.15.8:41476) 2023-10-18T21:50:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea077fe700 1 -- 172.21.15.8:0/2330107865 learned_addr learned my addr 172.21.15.8:0/2330107865 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea06ffd700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea080f77d0 0x7fea08109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea077fe700 1 -- 172.21.15.8:0/2330107865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea080f77d0 msgr2=0x7fea08109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea077fe700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea080f77d0 0x7fea08109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.609+0000 7fea077fe700 1 -- 172.21.15.8:0/2330107865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc005040 con 0x7fea080f6530 2023-10-18T21:50:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.610+0000 7fea077fe700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea080f6530 0x7fea08108f20 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fe9f800e7c0 tx=0x7fe9f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.610+0000 7fe9effff700 1 -- 172.21.15.8:0/2330107865 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9f80092e0 con 0x7fea080f6530 2023-10-18T21:50:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.610+0000 7fe9effff700 1 -- 172.21.15.8:0/2330107865 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe9f800f040 con 0x7fea080f6530 2023-10-18T21:50:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.610+0000 7fea0ccfd700 1 -- 172.21.15.8:0/2330107865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0810a4a0 con 0x7fea080f6530 2023-10-18T21:50:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.610+0000 7fe9effff700 1 -- 172.21.15.8:0/2330107865 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9f8014810 con 0x7fea080f6530 2023-10-18T21:50:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.610+0000 7fea0ccfd700 1 -- 172.21.15.8:0/2330107865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0810a9e0 con 0x7fea080f6530 2023-10-18T21:50:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.611+0000 7fea0ccfd700 1 -- 172.21.15.8:0/2330107865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea08045ad0 con 0x7fea080f6530 2023-10-18T21:50:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.612+0000 7fe9effff700 1 -- 172.21.15.8:0/2330107865 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe9f801b030 con 0x7fea080f6530 2023-10-18T21:50:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.613+0000 7fe9effff700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9f0060f70 0x7fe9f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:15.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.613+0000 7fe9effff700 1 -- 172.21.15.8:0/2330107865 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe9f807c880 con 0x7fea080f6530 2023-10-18T21:50:15.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.613+0000 7fea06ffd700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9f0060f70 0x7fe9f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:15.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.614+0000 7fea06ffd700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9f0060f70 0x7fe9f0063430 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fe9fc005010 tx=0x7fe9fc016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:15.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.617+0000 7fe9effff700 1 -- 172.21.15.8:0/2330107865 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe9f804fe60 con 0x7fea080f6530 2023-10-18T21:50:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.811+0000 7fea0ccfd700 1 -- 172.21.15.8:0/2330107865 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea080fee00 con 0x7fe9f0060f70 2023-10-18T21:50:15.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.821+0000 7fe9effff700 1 -- 172.21.15.8:0/2330107865 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fea080fee00 con 0x7fe9f0060f70 2023-10-18T21:50:15.822 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:50:15.822 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (56m) 4m ago 58m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:50:15.822 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (50m) 4m ago 58m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:50:15.823 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (50m) 2m ago 57m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:50:15.823 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (56m) 4m ago 58m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:50:15.823 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 54m - - 2023-10-18T21:50:15.823 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 54m - - 2023-10-18T21:50:15.824 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 54m - - 2023-10-18T21:50:15.824 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 54m - - 2023-10-18T21:50:15.824 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (52m) 4m ago 59m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:50:15.824 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (51m) 2m ago 57m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:50:15.824 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (51m) 4m ago 59m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:50:15.824 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (51m) 2m ago 57m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:50:15.825 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (57m) 4m ago 57m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:50:15.825 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (57m) 2m ago 57m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:50:15.825 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (50m) 4m ago 56m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:50:15.825 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (48m) 4m ago 56m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:50:15.825 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (48m) 4m ago 56m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:50:15.826 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (47m) 2m ago 56m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:50:15.826 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (46m) 2m ago 55m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:50:15.826 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (46m) 2m ago 55m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:50:15.826 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (52m) 4m ago 57m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:50:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 -- 172.21.15.8:0/2330107865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9f0060f70 msgr2=0x7fe9f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9f0060f70 0x7fe9f0063430 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fe9fc005010 tx=0x7fe9fc016040).stop 2023-10-18T21:50:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 -- 172.21.15.8:0/2330107865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea080f6530 msgr2=0x7fea08108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea080f6530 0x7fea08108f20 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fe9f800e7c0 tx=0x7fe9f800b040).stop 2023-10-18T21:50:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 -- 172.21.15.8:0/2330107865 shutdown_connections 2023-10-18T21:50:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9f0060f70 0x7fe9f0063430 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea080f6530 0x7fea08108f20 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 --2- 172.21.15.8:0/2330107865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea080f77d0 0x7fea08109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 -- 172.21.15.8:0/2330107865 >> 172.21.15.8:0/2330107865 conn(0x7fea080f1c90 msgr2=0x7fea0806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 -- 172.21.15.8:0/2330107865 shutdown_connections 2023-10-18T21:50:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.823+0000 7fea0ccfd700 1 -- 172.21.15.8:0/2330107865 wait complete. 2023-10-18T21:50:15.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.960+0000 7f95fd05c700 1 -- 172.21.15.8:0/4045965631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f80f77d0 msgr2=0x7f95f80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.960+0000 7f95fd05c700 1 --2- 172.21.15.8:0/4045965631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f80f77d0 0x7f95f80f7c30 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f95ec004660 tx=0x7f95ec009b30).stop 2023-10-18T21:50:15.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.960+0000 7f95fd05c700 1 -- 172.21.15.8:0/4045965631 shutdown_connections 2023-10-18T21:50:15.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.960+0000 7f95fd05c700 1 --2- 172.21.15.8:0/4045965631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f80f77d0 0x7f95f80f7c30 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.960+0000 7f95fd05c700 1 --2- 172.21.15.8:0/4045965631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f80f6530 0x7f95f80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.960+0000 7f95fd05c700 1 -- 172.21.15.8:0/4045965631 >> 172.21.15.8:0/4045965631 conn(0x7f95f80f1c90 msgr2=0x7f95f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:15.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.960+0000 7f95fd05c700 1 -- 172.21.15.8:0/4045965631 shutdown_connections 2023-10-18T21:50:15.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.960+0000 7f95fd05c700 1 -- 172.21.15.8:0/4045965631 wait complete. 2023-10-18T21:50:15.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.961+0000 7f95fd05c700 1 Processor -- start 2023-10-18T21:50:15.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.961+0000 7f95fd05c700 1 -- start start 2023-10-18T21:50:15.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95fd05c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f80f6530 0x7f95f8109120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:15.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95fd05c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8109610 0x7f95f810a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:15.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95fd05c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8109ae0 con 0x7f95f8109610 2023-10-18T21:50:15.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95fd05c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8109c20 con 0x7f95f80f6530 2023-10-18T21:50:15.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95f77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8109610 0x7f95f810a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:15.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95f77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8109610 0x7f95f810a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41498/0 (socket says 172.21.15.8:41498) 2023-10-18T21:50:15.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95f77fe700 1 -- 172.21.15.8:0/288883916 learned_addr learned my addr 172.21.15.8:0/288883916 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:15.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95f7fff700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f80f6530 0x7f95f8109120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:15.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95f77fe700 1 -- 172.21.15.8:0/288883916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f80f6530 msgr2=0x7f95f8109120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:15.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95f77fe700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f80f6530 0x7f95f8109120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:15.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.962+0000 7f95f77fe700 1 -- 172.21.15.8:0/288883916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec005040 con 0x7f95f8109610 2023-10-18T21:50:15.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.963+0000 7f95f77fe700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8109610 0x7f95f810a500 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f95ec009f50 tx=0x7f95ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:15.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.963+0000 7f95f4ff9700 1 -- 172.21.15.8:0/288883916 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95ec019070 con 0x7f95f8109610 2023-10-18T21:50:15.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.963+0000 7f95f4ff9700 1 -- 172.21.15.8:0/288883916 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f95ec009630 con 0x7f95f8109610 2023-10-18T21:50:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.963+0000 7f95f4ff9700 1 -- 172.21.15.8:0/288883916 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95ec014650 con 0x7f95f8109610 2023-10-18T21:50:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.963+0000 7f95fd05c700 1 -- 172.21.15.8:0/288883916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f810aa50 con 0x7f95f8109610 2023-10-18T21:50:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.963+0000 7f95fd05c700 1 -- 172.21.15.8:0/288883916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f810af20 con 0x7f95f8109610 2023-10-18T21:50:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.964+0000 7f95fd05c700 1 -- 172.21.15.8:0/288883916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f8059100 con 0x7f95f8109610 2023-10-18T21:50:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.965+0000 7f95f4ff9700 1 -- 172.21.15.8:0/288883916 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f95ec014000 con 0x7f95f8109610 2023-10-18T21:50:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.966+0000 7f95f4ff9700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95e0060f70 0x7f95e0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.966+0000 7f95f4ff9700 1 -- 172.21.15.8:0/288883916 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f95ec07dd80 con 0x7f95f8109610 2023-10-18T21:50:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.966+0000 7f95f7fff700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95e0060f70 0x7f95e0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.967+0000 7f95f7fff700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95e0060f70 0x7f95e0063430 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f95f80f7630 tx=0x7f95e8009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:15.971+0000 7f95f4ff9700 1 -- 172.21.15.8:0/288883916 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f95ec0514d0 con 0x7f95f8109610 2023-10-18T21:50:16.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.220+0000 7f95fd05c700 1 -- 172.21.15.8:0/288883916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f95f8027aa0 con 0x7f95f8109610 2023-10-18T21:50:16.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.221+0000 7f95f4ff9700 1 -- 172.21.15.8:0/288883916 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f95ec0510c0 con 0x7f95f8109610 2023-10-18T21:50:16.222 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:50:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:50:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:50:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:50:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:50:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:50:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:50:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:50:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:50:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:50:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:50:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:50:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:50:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:50:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:50:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:50:16.226 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:50:16.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 -- 172.21.15.8:0/288883916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95e0060f70 msgr2=0x7f95e0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:16.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95e0060f70 0x7f95e0063430 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f95f80f7630 tx=0x7f95e8009c00).stop 2023-10-18T21:50:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 -- 172.21.15.8:0/288883916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8109610 msgr2=0x7f95f810a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8109610 0x7f95f810a500 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f95ec009f50 tx=0x7f95ec009b30).stop 2023-10-18T21:50:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 -- 172.21.15.8:0/288883916 shutdown_connections 2023-10-18T21:50:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f95e0060f70 0x7f95e0063430 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f80f6530 0x7f95f8109120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 --2- 172.21.15.8:0/288883916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8109610 0x7f95f810a500 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 -- 172.21.15.8:0/288883916 >> 172.21.15.8:0/288883916 conn(0x7f95f80f1c90 msgr2=0x7f95f80f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 -- 172.21.15.8:0/288883916 shutdown_connections 2023-10-18T21:50:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.223+0000 7f95fd05c700 1 -- 172.21.15.8:0/288883916 wait complete. 2023-10-18T21:50:16.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:14.868391+0000 mgr.smithi008.flmjzp (mgr.14640) 3082 : cluster [DBG] pgmap v2122: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:16.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:15.114835+0000 mgr.smithi008.flmjzp (mgr.14640) 3083 : audit [DBG] from='client.36568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:16.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.360+0000 7f401da56700 1 -- 172.21.15.8:0/2864489003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40180f6530 msgr2=0x7f40180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.360+0000 7f401da56700 1 --2- 172.21.15.8:0/2864489003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40180f6530 0x7f40180f6950 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f400c004660 tx=0x7f400c009b30).stop 2023-10-18T21:50:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.360+0000 7f401da56700 1 -- 172.21.15.8:0/2864489003 shutdown_connections 2023-10-18T21:50:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.360+0000 7f401da56700 1 --2- 172.21.15.8:0/2864489003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40180f77d0 0x7f40180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.360+0000 7f401da56700 1 --2- 172.21.15.8:0/2864489003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40180f6530 0x7f40180f6950 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.360+0000 7f401da56700 1 -- 172.21.15.8:0/2864489003 >> 172.21.15.8:0/2864489003 conn(0x7f40180f1c90 msgr2=0x7f40180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.360+0000 7f401da56700 1 -- 172.21.15.8:0/2864489003 shutdown_connections 2023-10-18T21:50:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.360+0000 7f401da56700 1 -- 172.21.15.8:0/2864489003 wait complete. 2023-10-18T21:50:16.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.361+0000 7f401da56700 1 Processor -- start 2023-10-18T21:50:16.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.361+0000 7f401da56700 1 -- start start 2023-10-18T21:50:16.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f401da56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40180f6530 0x7f4018108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:16.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f401da56700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40180f77d0 0x7f40181094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:16.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f401da56700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4018109a60 con 0x7f40180f77d0 2023-10-18T21:50:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f401da56700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4018109ba0 con 0x7f40180f6530 2023-10-18T21:50:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f4017fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40180f77d0 0x7f40181094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f4017fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40180f77d0 0x7f40181094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41520/0 (socket says 172.21.15.8:41520) 2023-10-18T21:50:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f4017fff700 1 -- 172.21.15.8:0/1078708034 learned_addr learned my addr 172.21.15.8:0/1078708034 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f401ca54700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40180f6530 0x7f4018108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f4017fff700 1 -- 172.21.15.8:0/1078708034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40180f6530 msgr2=0x7f4018108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f4017fff700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40180f6530 0x7f4018108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.362+0000 7f4017fff700 1 -- 172.21.15.8:0/1078708034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c005040 con 0x7f40180f77d0 2023-10-18T21:50:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.363+0000 7f4017fff700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40180f77d0 0x7f40181094b0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f400400c790 tx=0x7f4004007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.363+0000 7f40157fa700 1 -- 172.21.15.8:0/1078708034 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4004002590 con 0x7f40180f77d0 2023-10-18T21:50:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.363+0000 7f40157fa700 1 -- 172.21.15.8:0/1078708034 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4004002bb0 con 0x7f40180f77d0 2023-10-18T21:50:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.363+0000 7f40157fa700 1 -- 172.21.15.8:0/1078708034 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4004013e10 con 0x7f40180f77d0 2023-10-18T21:50:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.363+0000 7f401da56700 1 -- 172.21.15.8:0/1078708034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401810a540 con 0x7f40180f77d0 2023-10-18T21:50:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.363+0000 7f401da56700 1 -- 172.21.15.8:0/1078708034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401810ab00 con 0x7f40180f77d0 2023-10-18T21:50:16.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.364+0000 7f401da56700 1 -- 172.21.15.8:0/1078708034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4018045ad0 con 0x7f40180f77d0 2023-10-18T21:50:16.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.365+0000 7f40157fa700 1 -- 172.21.15.8:0/1078708034 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f400401a060 con 0x7f40180f77d0 2023-10-18T21:50:16.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.366+0000 7f40157fa700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4008060f70 0x7f4008063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.366+0000 7f40157fa700 1 -- 172.21.15.8:0/1078708034 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f400407cbe0 con 0x7f40180f77d0 2023-10-18T21:50:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.366+0000 7f401ca54700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4008060f70 0x7f4008063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.367+0000 7f401ca54700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4008060f70 0x7f4008063430 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f400c009f50 tx=0x7f400c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.370+0000 7f40157fa700 1 -- 172.21.15.8:0/1078708034 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4004050240 con 0x7f40180f77d0 2023-10-18T21:50:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:14.868391+0000 mgr.smithi008.flmjzp (mgr.14640) 3082 : cluster [DBG] pgmap v2122: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:15.114835+0000 mgr.smithi008.flmjzp (mgr.14640) 3083 : audit [DBG] from='client.36568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:16.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.599+0000 7f401da56700 1 -- 172.21.15.8:0/1078708034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4018027a00 con 0x7f40180f77d0 2023-10-18T21:50:16.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.600+0000 7f40157fa700 1 -- 172.21.15.8:0/1078708034 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f400404fe30 con 0x7f40180f77d0 2023-10-18T21:50:16.601 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:50:16.602 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:50:16.602 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:50:16.602 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:50:16.602 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:50:16.602 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:50:16.603 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:50:16.603 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:50:16.603 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:50:16.603 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:50:16.604 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:50:16.604 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:50:16.604 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:50:16.604 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:50:16.604 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:50:16.605 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:50:16.605 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:50:16.605 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:50:16.605 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:50:16.605 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:50:16.606 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:50:16.606 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:50:16.606 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:50:16.606 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:50:16.606 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:50:16.607 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:50:16.607 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:50:16.607 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:50:16.607 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:50:16.607 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:50:16.608 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:50:16.608 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:50:16.608 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:50:16.608 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:50:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 -- 172.21.15.8:0/1078708034 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4008060f70 msgr2=0x7f4008063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4008060f70 0x7f4008063430 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f400c009f50 tx=0x7f400c009b30).stop 2023-10-18T21:50:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 -- 172.21.15.8:0/1078708034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40180f77d0 msgr2=0x7f40181094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40180f77d0 0x7f40181094b0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f400400c790 tx=0x7f4004007d70).stop 2023-10-18T21:50:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 -- 172.21.15.8:0/1078708034 shutdown_connections 2023-10-18T21:50:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4008060f70 0x7f4008063430 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40180f6530 0x7f4018108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 --2- 172.21.15.8:0/1078708034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40180f77d0 0x7f40181094b0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 -- 172.21.15.8:0/1078708034 >> 172.21.15.8:0/1078708034 conn(0x7f40180f1c90 msgr2=0x7f40180f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 -- 172.21.15.8:0/1078708034 shutdown_connections 2023-10-18T21:50:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.602+0000 7f401da56700 1 -- 172.21.15.8:0/1078708034 wait complete. 2023-10-18T21:50:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:50:16.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.740+0000 7fcb38a65700 1 -- 172.21.15.8:0/3619094962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb340f77d0 msgr2=0x7fcb340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:16.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.740+0000 7fcb38a65700 1 --2- 172.21.15.8:0/3619094962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb340f77d0 0x7fcb340f7c30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7fcb28004660 tx=0x7fcb28009b30).stop 2023-10-18T21:50:16.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.740+0000 7fcb38a65700 1 -- 172.21.15.8:0/3619094962 shutdown_connections 2023-10-18T21:50:16.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.740+0000 7fcb38a65700 1 --2- 172.21.15.8:0/3619094962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb340f77d0 0x7fcb340f7c30 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.740+0000 7fcb38a65700 1 --2- 172.21.15.8:0/3619094962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb340f6530 0x7fcb340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.740+0000 7fcb38a65700 1 -- 172.21.15.8:0/3619094962 >> 172.21.15.8:0/3619094962 conn(0x7fcb340f1c90 msgr2=0x7fcb340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:16.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.740+0000 7fcb38a65700 1 -- 172.21.15.8:0/3619094962 shutdown_connections 2023-10-18T21:50:16.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.740+0000 7fcb38a65700 1 -- 172.21.15.8:0/3619094962 wait complete. 2023-10-18T21:50:16.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.741+0000 7fcb38a65700 1 Processor -- start 2023-10-18T21:50:16.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.741+0000 7fcb38a65700 1 -- start start 2023-10-18T21:50:16.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb38a65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb340f6530 0x7fcb34108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:16.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb38a65700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb340f77d0 0x7fcb34109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:16.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb38a65700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34109a20 con 0x7fcb340f77d0 2023-10-18T21:50:16.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb38a65700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34109b60 con 0x7fcb340f6530 2023-10-18T21:50:16.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb32ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb340f77d0 0x7fcb34109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:16.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb32ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb340f77d0 0x7fcb34109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41526/0 (socket says 172.21.15.8:41526) 2023-10-18T21:50:16.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb32ffd700 1 -- 172.21.15.8:0/1772535171 learned_addr learned my addr 172.21.15.8:0/1772535171 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:16.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb337fe700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb340f6530 0x7fcb34108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:16.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb32ffd700 1 -- 172.21.15.8:0/1772535171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb340f6530 msgr2=0x7fcb34108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:16.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb32ffd700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb340f6530 0x7fcb34108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.742+0000 7fcb32ffd700 1 -- 172.21.15.8:0/1772535171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28005040 con 0x7fcb340f77d0 2023-10-18T21:50:16.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.743+0000 7fcb32ffd700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb340f77d0 0x7fcb34109470 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fcb28009990 tx=0x7fcb28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:16.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.743+0000 7fcb1bfff700 1 -- 172.21.15.8:0/1772535171 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb28018070 con 0x7fcb340f77d0 2023-10-18T21:50:16.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.743+0000 7fcb38a65700 1 -- 172.21.15.8:0/1772535171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3410a4a0 con 0x7fcb340f77d0 2023-10-18T21:50:16.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.743+0000 7fcb1bfff700 1 -- 172.21.15.8:0/1772535171 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcb28009630 con 0x7fcb340f77d0 2023-10-18T21:50:16.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.743+0000 7fcb1bfff700 1 -- 172.21.15.8:0/1772535171 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb2801c400 con 0x7fcb340f77d0 2023-10-18T21:50:16.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.743+0000 7fcb38a65700 1 -- 172.21.15.8:0/1772535171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3410aa00 con 0x7fcb340f77d0 2023-10-18T21:50:16.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.744+0000 7fcb38a65700 1 -- 172.21.15.8:0/1772535171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb34045ad0 con 0x7fcb340f77d0 2023-10-18T21:50:16.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.745+0000 7fcb1bfff700 1 -- 172.21.15.8:0/1772535171 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcb2801d9e0 con 0x7fcb340f77d0 2023-10-18T21:50:16.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.746+0000 7fcb1bfff700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb1c060f70 0x7fcb1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:16.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.746+0000 7fcb1bfff700 1 -- 172.21.15.8:0/1772535171 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcb2807e740 con 0x7fcb340f77d0 2023-10-18T21:50:16.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.747+0000 7fcb337fe700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb1c060f70 0x7fcb1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:16.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.747+0000 7fcb337fe700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb1c060f70 0x7fcb1c063430 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fcb340f7630 tx=0x7fcb24009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:16.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.751+0000 7fcb1bfff700 1 -- 172.21.15.8:0/1772535171 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcb28051d20 con 0x7fcb340f77d0 2023-10-18T21:50:16.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.958+0000 7fcb38a65700 1 -- 172.21.15.8:0/1772535171 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb340fee00 con 0x7fcb1c060f70 2023-10-18T21:50:16.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.959+0000 7fcb1bfff700 1 -- 172.21.15.8:0/1772535171 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcb340fee00 con 0x7fcb1c060f70 2023-10-18T21:50:16.960 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:50:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:50:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:50:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:50:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:50:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:50:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:50:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:50:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:50:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:50:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:50:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:50:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:50:16.963 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:50:16.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.961+0000 7fcb38a65700 1 -- 172.21.15.8:0/1772535171 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb1c060f70 msgr2=0x7fcb1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:16.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.961+0000 7fcb38a65700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb1c060f70 0x7fcb1c063430 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fcb340f7630 tx=0x7fcb24009c00).stop 2023-10-18T21:50:16.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.961+0000 7fcb38a65700 1 -- 172.21.15.8:0/1772535171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb340f77d0 msgr2=0x7fcb34109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:16.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.961+0000 7fcb38a65700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb340f77d0 0x7fcb34109470 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fcb28009990 tx=0x7fcb28009b30).stop 2023-10-18T21:50:16.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.961+0000 7fcb38a65700 1 -- 172.21.15.8:0/1772535171 shutdown_connections 2023-10-18T21:50:16.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.961+0000 7fcb38a65700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb1c060f70 0x7fcb1c063430 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.961+0000 7fcb38a65700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb340f6530 0x7fcb34108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.961+0000 7fcb38a65700 1 --2- 172.21.15.8:0/1772535171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb340f77d0 0x7fcb34109470 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:16.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.961+0000 7fcb38a65700 1 -- 172.21.15.8:0/1772535171 >> 172.21.15.8:0/1772535171 conn(0x7fcb340f1c90 msgr2=0x7fcb3406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:16.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.962+0000 7fcb38a65700 1 -- 172.21.15.8:0/1772535171 shutdown_connections 2023-10-18T21:50:16.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:16.962+0000 7fcb38a65700 1 -- 172.21.15.8:0/1772535171 wait complete. 2023-10-18T21:50:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:15.467730+0000 mgr.smithi008.flmjzp (mgr.14640) 3084 : audit [DBG] from='client.36572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:15.812855+0000 mgr.smithi008.flmjzp (mgr.14640) 3085 : audit [DBG] from='client.36576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.221477+0000 mon.smithi008 (mon.0) 3460 : audit [DBG] from='client.? 172.21.15.8:0/288883916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.600510+0000 mon.smithi008 (mon.0) 3461 : audit [DBG] from='client.? 172.21.15.8:0/1078708034' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:50:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.892923+0000 mon.smithi008 (mon.0) 3462 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.894526+0000 mon.smithi008 (mon.0) 3463 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.895228+0000 mon.smithi008 (mon.0) 3464 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.900721+0000 mon.smithi008 (mon.0) 3465 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.906893+0000 mon.smithi008 (mon.0) 3466 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:17.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.909867+0000 mon.smithi008 (mon.0) 3467 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:17.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.911612+0000 mon.smithi008 (mon.0) 3468 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:17.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.913308+0000 mon.smithi008 (mon.0) 3469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:17.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.915627+0000 mon.smithi008 (mon.0) 3470 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:15.467730+0000 mgr.smithi008.flmjzp (mgr.14640) 3084 : audit [DBG] from='client.36572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:15.812855+0000 mgr.smithi008.flmjzp (mgr.14640) 3085 : audit [DBG] from='client.36576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.221477+0000 mon.smithi008 (mon.0) 3460 : audit [DBG] from='client.? 172.21.15.8:0/288883916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.600510+0000 mon.smithi008 (mon.0) 3461 : audit [DBG] from='client.? 172.21.15.8:0/1078708034' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:50:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.892923+0000 mon.smithi008 (mon.0) 3462 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.894526+0000 mon.smithi008 (mon.0) 3463 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.895228+0000 mon.smithi008 (mon.0) 3464 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:17.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.900721+0000 mon.smithi008 (mon.0) 3465 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:17.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.906893+0000 mon.smithi008 (mon.0) 3466 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:17.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.909867+0000 mon.smithi008 (mon.0) 3467 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:17.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.911612+0000 mon.smithi008 (mon.0) 3468 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:17.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.913308+0000 mon.smithi008 (mon.0) 3469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:17.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.915627+0000 mon.smithi008 (mon.0) 3470 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:18.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:16.868824+0000 mgr.smithi008.flmjzp (mgr.14640) 3086 : cluster [DBG] pgmap v2123: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:18.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:16.895875+0000 mgr.smithi008.flmjzp (mgr.14640) 3087 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:18.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:16.896367+0000 mgr.smithi008.flmjzp (mgr.14640) 3088 : cluster [DBG] pgmap v2124: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:18.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:16.896654+0000 mgr.smithi008.flmjzp (mgr.14640) 3089 : cluster [DBG] pgmap v2125: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:18.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:16.917965+0000 mgr.smithi008.flmjzp (mgr.14640) 3090 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:18.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:16.959656+0000 mgr.smithi008.flmjzp (mgr.14640) 3091 : audit [DBG] from='client.36588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:18.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:16.868824+0000 mgr.smithi008.flmjzp (mgr.14640) 3086 : cluster [DBG] pgmap v2123: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:18.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:16.895875+0000 mgr.smithi008.flmjzp (mgr.14640) 3087 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:18.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:16.896367+0000 mgr.smithi008.flmjzp (mgr.14640) 3088 : cluster [DBG] pgmap v2124: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:18.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:16.896654+0000 mgr.smithi008.flmjzp (mgr.14640) 3089 : cluster [DBG] pgmap v2125: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:18.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:16.917965+0000 mgr.smithi008.flmjzp (mgr.14640) 3090 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:18.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:16.959656+0000 mgr.smithi008.flmjzp (mgr.14640) 3091 : audit [DBG] from='client.36588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:20.202 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:18.897208+0000 mgr.smithi008.flmjzp (mgr.14640) 3092 : cluster [DBG] pgmap v2126: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:20.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:18.897208+0000 mgr.smithi008.flmjzp (mgr.14640) 3092 : cluster [DBG] pgmap v2126: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:22.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:20.897773+0000 mgr.smithi008.flmjzp (mgr.14640) 3093 : cluster [DBG] pgmap v2127: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:22.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:20.897773+0000 mgr.smithi008.flmjzp (mgr.14640) 3093 : cluster [DBG] pgmap v2127: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:22.898261+0000 mgr.smithi008.flmjzp (mgr.14640) 3094 : cluster [DBG] pgmap v2128: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:24.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:22.898261+0000 mgr.smithi008.flmjzp (mgr.14640) 3094 : cluster [DBG] pgmap v2128: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:26.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:24.898891+0000 mgr.smithi008.flmjzp (mgr.14640) 3095 : cluster [DBG] pgmap v2129: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:24.898891+0000 mgr.smithi008.flmjzp (mgr.14640) 3095 : cluster [DBG] pgmap v2129: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:27.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:26.924250+0000 mon.smithi008 (mon.0) 3471 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:26.924250+0000 mon.smithi008 (mon.0) 3471 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:26.899398+0000 mgr.smithi008.flmjzp (mgr.14640) 3096 : cluster [DBG] pgmap v2130: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:27.485542+0000 mon.smithi008 (mon.0) 3472 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:27.486656+0000 mon.smithi008 (mon.0) 3473 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:28.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:27.493222+0000 mon.smithi008 (mon.0) 3474 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:28.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:27.499742+0000 mon.smithi008 (mon.0) 3475 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:28.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:27.502822+0000 mon.smithi008 (mon.0) 3476 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:28.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:27.504564+0000 mon.smithi008 (mon.0) 3477 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:28.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:27.506261+0000 mon.smithi008 (mon.0) 3478 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:28.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:27.508352+0000 mon.smithi008 (mon.0) 3479 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:28.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:26.899398+0000 mgr.smithi008.flmjzp (mgr.14640) 3096 : cluster [DBG] pgmap v2130: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:28.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:27.485542+0000 mon.smithi008 (mon.0) 3472 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:28.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:27.486656+0000 mon.smithi008 (mon.0) 3473 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:28.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:27.493222+0000 mon.smithi008 (mon.0) 3474 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:28.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:27.499742+0000 mon.smithi008 (mon.0) 3475 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:28.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:27.502822+0000 mon.smithi008 (mon.0) 3476 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:28.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:27.504564+0000 mon.smithi008 (mon.0) 3477 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:28.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:27.506261+0000 mon.smithi008 (mon.0) 3478 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:28.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:27.508352+0000 mon.smithi008 (mon.0) 3479 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:27.487531+0000 mgr.smithi008.flmjzp (mgr.14640) 3097 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:27.488262+0000 mgr.smithi008.flmjzp (mgr.14640) 3098 : cluster [DBG] pgmap v2131: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:27.488570+0000 mgr.smithi008.flmjzp (mgr.14640) 3099 : cluster [DBG] pgmap v2132: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:27.510241+0000 mgr.smithi008.flmjzp (mgr.14640) 3100 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:27.487531+0000 mgr.smithi008.flmjzp (mgr.14640) 3097 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:27.488262+0000 mgr.smithi008.flmjzp (mgr.14640) 3098 : cluster [DBG] pgmap v2131: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:27.488570+0000 mgr.smithi008.flmjzp (mgr.14640) 3099 : cluster [DBG] pgmap v2132: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:27.510241+0000 mgr.smithi008.flmjzp (mgr.14640) 3100 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:31.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:29.489103+0000 mgr.smithi008.flmjzp (mgr.14640) 3101 : cluster [DBG] pgmap v2133: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:29.489103+0000 mgr.smithi008.flmjzp (mgr.14640) 3101 : cluster [DBG] pgmap v2133: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:33.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:31.489648+0000 mgr.smithi008.flmjzp (mgr.14640) 3102 : cluster [DBG] pgmap v2134: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:31.489648+0000 mgr.smithi008.flmjzp (mgr.14640) 3102 : cluster [DBG] pgmap v2134: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:33.490279+0000 mgr.smithi008.flmjzp (mgr.14640) 3103 : cluster [DBG] pgmap v2135: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:33.490279+0000 mgr.smithi008.flmjzp (mgr.14640) 3103 : cluster [DBG] pgmap v2135: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:35.490859+0000 mgr.smithi008.flmjzp (mgr.14640) 3104 : cluster [DBG] pgmap v2136: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:37.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:35.490859+0000 mgr.smithi008.flmjzp (mgr.14640) 3104 : cluster [DBG] pgmap v2136: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:38.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:37.520908+0000 mon.smithi008 (mon.0) 3480 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:38.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:37.523050+0000 mon.smithi008 (mon.0) 3481 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:38.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:37.524034+0000 mon.smithi008 (mon.0) 3482 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:38.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:37.530717+0000 mon.smithi008 (mon.0) 3483 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:38.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:37.538735+0000 mon.smithi008 (mon.0) 3484 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:38.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:37.542257+0000 mon.smithi008 (mon.0) 3485 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:38.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:37.544305+0000 mon.smithi008 (mon.0) 3486 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:38.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:37.546240+0000 mon.smithi008 (mon.0) 3487 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:38.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:37.548849+0000 mon.smithi008 (mon.0) 3488 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:37.520908+0000 mon.smithi008 (mon.0) 3480 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:38.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:37.523050+0000 mon.smithi008 (mon.0) 3481 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:38.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:37.524034+0000 mon.smithi008 (mon.0) 3482 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:38.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:37.530717+0000 mon.smithi008 (mon.0) 3483 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:38.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:37.538735+0000 mon.smithi008 (mon.0) 3484 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:38.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:37.542257+0000 mon.smithi008 (mon.0) 3485 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:38.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:37.544305+0000 mon.smithi008 (mon.0) 3486 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:38.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:37.546240+0000 mon.smithi008 (mon.0) 3487 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:38.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:37.548849+0000 mon.smithi008 (mon.0) 3488 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:37.491625+0000 mgr.smithi008.flmjzp (mgr.14640) 3105 : cluster [DBG] pgmap v2137: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:37.524917+0000 mgr.smithi008.flmjzp (mgr.14640) 3106 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:37.525504+0000 mgr.smithi008.flmjzp (mgr.14640) 3107 : cluster [DBG] pgmap v2138: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:37.525863+0000 mgr.smithi008.flmjzp (mgr.14640) 3108 : cluster [DBG] pgmap v2139: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:37.550941+0000 mgr.smithi008.flmjzp (mgr.14640) 3109 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:39.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:37.491625+0000 mgr.smithi008.flmjzp (mgr.14640) 3105 : cluster [DBG] pgmap v2137: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:37.524917+0000 mgr.smithi008.flmjzp (mgr.14640) 3106 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:37.525504+0000 mgr.smithi008.flmjzp (mgr.14640) 3107 : cluster [DBG] pgmap v2138: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:37.525863+0000 mgr.smithi008.flmjzp (mgr.14640) 3108 : cluster [DBG] pgmap v2139: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:37.550941+0000 mgr.smithi008.flmjzp (mgr.14640) 3109 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:39.526519+0000 mgr.smithi008.flmjzp (mgr.14640) 3110 : cluster [DBG] pgmap v2140: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:41.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:39.526519+0000 mgr.smithi008.flmjzp (mgr.14640) 3110 : cluster [DBG] pgmap v2140: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:43.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:41.527180+0000 mgr.smithi008.flmjzp (mgr.14640) 3111 : cluster [DBG] pgmap v2141: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:41.527180+0000 mgr.smithi008.flmjzp (mgr.14640) 3111 : cluster [DBG] pgmap v2141: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:43.527922+0000 mgr.smithi008.flmjzp (mgr.14640) 3112 : cluster [DBG] pgmap v2142: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:43.527922+0000 mgr.smithi008.flmjzp (mgr.14640) 3112 : cluster [DBG] pgmap v2142: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.120+0000 7f329f59e700 1 -- 172.21.15.8:0/2235126747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a00f6530 msgr2=0x7f32a00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.120+0000 7f329f59e700 1 --2- 172.21.15.8:0/2235126747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a00f6530 0x7f32a00f6950 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f3290004660 tx=0x7f3290009b30).stop 2023-10-18T21:50:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.120+0000 7f329f59e700 1 -- 172.21.15.8:0/2235126747 shutdown_connections 2023-10-18T21:50:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.120+0000 7f329f59e700 1 --2- 172.21.15.8:0/2235126747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a00f77d0 0x7f32a00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.120+0000 7f329f59e700 1 --2- 172.21.15.8:0/2235126747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a00f6530 0x7f32a00f6950 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.120+0000 7f329f59e700 1 -- 172.21.15.8:0/2235126747 >> 172.21.15.8:0/2235126747 conn(0x7f32a00f1c90 msgr2=0x7f32a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.120+0000 7f329f59e700 1 -- 172.21.15.8:0/2235126747 shutdown_connections 2023-10-18T21:50:47.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.120+0000 7f329f59e700 1 -- 172.21.15.8:0/2235126747 wait complete. 2023-10-18T21:50:47.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.121+0000 7f329f59e700 1 Processor -- start 2023-10-18T21:50:47.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.121+0000 7f329f59e700 1 -- start start 2023-10-18T21:50:47.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a00f6530 0x7f32a0108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a00f77d0 0x7f32a0109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a01099e0 con 0x7f32a00f77d0 2023-10-18T21:50:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a0109b20 con 0x7f32a00f6530 2023-10-18T21:50:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a00f77d0 0x7f32a0109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a00f77d0 0x7f32a0109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52454/0 (socket says 172.21.15.8:52454) 2023-10-18T21:50:47.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329dd9b700 1 -- 172.21.15.8:0/3273697663 learned_addr learned my addr 172.21.15.8:0/3273697663 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:47.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329e59c700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a00f6530 0x7f32a0108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:47.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329dd9b700 1 -- 172.21.15.8:0/3273697663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a00f6530 msgr2=0x7f32a0108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:47.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329dd9b700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a00f6530 0x7f32a0108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.122+0000 7f329dd9b700 1 -- 172.21.15.8:0/3273697663 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290005040 con 0x7f32a00f77d0 2023-10-18T21:50:47.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.123+0000 7f329dd9b700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a00f77d0 0x7f32a0109430 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f329400e7f0 tx=0x7f329400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:47.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.123+0000 7f328effd700 1 -- 172.21.15.8:0/3273697663 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32940092e0 con 0x7f32a00f77d0 2023-10-18T21:50:47.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.123+0000 7f328effd700 1 -- 172.21.15.8:0/3273697663 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f329400f040 con 0x7f32a00f77d0 2023-10-18T21:50:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.123+0000 7f329f59e700 1 -- 172.21.15.8:0/3273697663 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a010a4c0 con 0x7f32a00f77d0 2023-10-18T21:50:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.123+0000 7f328effd700 1 -- 172.21.15.8:0/3273697663 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32940147e0 con 0x7f32a00f77d0 2023-10-18T21:50:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.123+0000 7f329f59e700 1 -- 172.21.15.8:0/3273697663 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a010aa00 con 0x7f32a00f77d0 2023-10-18T21:50:47.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.124+0000 7f329f59e700 1 -- 172.21.15.8:0/3273697663 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a0045ad0 con 0x7f32a00f77d0 2023-10-18T21:50:47.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.125+0000 7f328effd700 1 -- 172.21.15.8:0/3273697663 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f329401b030 con 0x7f32a00f77d0 2023-10-18T21:50:47.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.126+0000 7f328effd700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3288060f70 0x7f3288063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:47.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.126+0000 7f328effd700 1 -- 172.21.15.8:0/3273697663 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f329407c700 con 0x7f32a00f77d0 2023-10-18T21:50:47.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.126+0000 7f329e59c700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3288060f70 0x7f3288063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:47.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.127+0000 7f329e59c700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3288060f70 0x7f3288063430 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f3290005010 tx=0x7f3290016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:47.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.130+0000 7f328effd700 1 -- 172.21.15.8:0/3273697663 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f329404fe50 con 0x7f32a00f77d0 2023-10-18T21:50:47.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.330+0000 7f329f59e700 1 -- 172.21.15.8:0/3273697663 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32a010ac20 con 0x7f3288060f70 2023-10-18T21:50:47.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.332+0000 7f328effd700 1 -- 172.21.15.8:0/3273697663 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f32a010ac20 con 0x7f3288060f70 2023-10-18T21:50:47.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 -- 172.21.15.8:0/3273697663 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3288060f70 msgr2=0x7f3288063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:47.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3288060f70 0x7f3288063430 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f3290005010 tx=0x7f3290016040).stop 2023-10-18T21:50:47.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 -- 172.21.15.8:0/3273697663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a00f77d0 msgr2=0x7f32a0109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:47.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a00f77d0 0x7f32a0109430 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f329400e7f0 tx=0x7f329400b040).stop 2023-10-18T21:50:47.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 -- 172.21.15.8:0/3273697663 shutdown_connections 2023-10-18T21:50:47.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3288060f70 0x7f3288063430 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a00f6530 0x7f32a0108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 --2- 172.21.15.8:0/3273697663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a00f77d0 0x7f32a0109430 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 -- 172.21.15.8:0/3273697663 >> 172.21.15.8:0/3273697663 conn(0x7f32a00f1c90 msgr2=0x7f32a006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:47.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 -- 172.21.15.8:0/3273697663 shutdown_connections 2023-10-18T21:50:47.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.334+0000 7f329f59e700 1 -- 172.21.15.8:0/3273697663 wait complete. 2023-10-18T21:50:47.349 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:50:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:45.528562+0000 mgr.smithi008.flmjzp (mgr.14640) 3113 : cluster [DBG] pgmap v2143: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:47.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.472+0000 7fb4dcb01700 1 -- 172.21.15.8:0/1196416307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d80f6530 msgr2=0x7fb4d80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:47.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.472+0000 7fb4dcb01700 1 --2- 172.21.15.8:0/1196416307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d80f6530 0x7fb4d80f6950 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fb4c8004660 tx=0x7fb4c8009b30).stop 2023-10-18T21:50:47.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.472+0000 7fb4dcb01700 1 -- 172.21.15.8:0/1196416307 shutdown_connections 2023-10-18T21:50:47.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.472+0000 7fb4dcb01700 1 --2- 172.21.15.8:0/1196416307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4d80f77d0 0x7fb4d80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.472+0000 7fb4dcb01700 1 --2- 172.21.15.8:0/1196416307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d80f6530 0x7fb4d80f6950 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.472+0000 7fb4dcb01700 1 -- 172.21.15.8:0/1196416307 >> 172.21.15.8:0/1196416307 conn(0x7fb4d80f1c90 msgr2=0x7fb4d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:47.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.472+0000 7fb4dcb01700 1 -- 172.21.15.8:0/1196416307 shutdown_connections 2023-10-18T21:50:47.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.472+0000 7fb4dcb01700 1 -- 172.21.15.8:0/1196416307 wait complete. 2023-10-18T21:50:47.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.473+0000 7fb4dcb01700 1 Processor -- start 2023-10-18T21:50:47.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.473+0000 7fb4dcb01700 1 -- start start 2023-10-18T21:50:47.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.473+0000 7fb4dcb01700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d80f6530 0x7fb4d8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:47.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.473+0000 7fb4dcb01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4d80f77d0 0x7fb4d81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:47.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.473+0000 7fb4dcb01700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d8109a70 con 0x7fb4d80f6530 2023-10-18T21:50:47.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.473+0000 7fb4dcb01700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d8109bb0 con 0x7fb4d80f77d0 2023-10-18T21:50:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d80f6530 0x7fb4d8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d80f6530 0x7fb4d8108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52472/0 (socket says 172.21.15.8:52472) 2023-10-18T21:50:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4d77fe700 1 -- 172.21.15.8:0/2903613033 learned_addr learned my addr 172.21.15.8:0/2903613033 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4d77fe700 1 -- 172.21.15.8:0/2903613033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4d80f77d0 msgr2=0x7fb4d81094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4d77fe700 1 --2- 172.21.15.8:0/2903613033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4d80f77d0 0x7fb4d81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:50:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4d77fe700 1 -- 172.21.15.8:0/2903613033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c8005040 con 0x7fb4d80f6530 2023-10-18T21:50:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4d77fe700 1 --2- 172.21.15.8:0/2903613033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d80f6530 0x7fb4d8108fd0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fb4c8009f50 tx=0x7fb4c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4bffff700 1 -- 172.21.15.8:0/2903613033 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4c8018070 con 0x7fb4d80f6530 2023-10-18T21:50:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4bffff700 1 -- 172.21.15.8:0/2903613033 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb4c801d8e0 con 0x7fb4d80f6530 2023-10-18T21:50:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4dcb01700 1 -- 172.21.15.8:0/2903613033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d810a4f0 con 0x7fb4d80f6530 2023-10-18T21:50:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.474+0000 7fb4bffff700 1 -- 172.21.15.8:0/2903613033 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4c801c4c0 con 0x7fb4d80f6530 2023-10-18T21:50:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.475+0000 7fb4dcb01700 1 -- 172.21.15.8:0/2903613033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d810aa50 con 0x7fb4d80f6530 2023-10-18T21:50:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.476+0000 7fb4dcb01700 1 -- 172.21.15.8:0/2903613033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d8045ad0 con 0x7fb4d80f6530 2023-10-18T21:50:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.476+0000 7fb4bffff700 1 -- 172.21.15.8:0/2903613033 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb4c801d420 con 0x7fb4d80f6530 2023-10-18T21:50:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.477+0000 7fb4bffff700 1 --2- 172.21.15.8:0/2903613033 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb4c0060f70 0x7fb4c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:47.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.478+0000 7fb4bffff700 1 -- 172.21.15.8:0/2903613033 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb4c807e8a0 con 0x7fb4d80f6530 2023-10-18T21:50:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.478+0000 7fb4d6ffd700 1 --2- 172.21.15.8:0/2903613033 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb4c0060f70 0x7fb4c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.479+0000 7fb4d6ffd700 1 --2- 172.21.15.8:0/2903613033 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb4c0060f70 0x7fb4c0063430 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fb4cc0047d0 tx=0x7fb4cc007a40).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.482+0000 7fb4bffff700 1 -- 172.21.15.8:0/2903613033 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb4c8051e80 con 0x7fb4d80f6530 2023-10-18T21:50:47.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:45.528562+0000 mgr.smithi008.flmjzp (mgr.14640) 3113 : cluster [DBG] pgmap v2143: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.694+0000 7fb4dcb01700 1 -- 172.21.15.8:0/2903613033 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4d80fee70 con 0x7fb4c0060f70 2023-10-18T21:50:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.695+0000 7fb4bffff700 1 -- 172.21.15.8:0/2903613033 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb4cc004450 con 0x7fb4c0060f70 2023-10-18T21:50:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 -- 172.21.15.8:0/2903613033 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb4c0060f70 msgr2=0x7fb4c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 --2- 172.21.15.8:0/2903613033 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb4c0060f70 0x7fb4c0063430 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fb4cc0047d0 tx=0x7fb4cc007a40).stop 2023-10-18T21:50:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 -- 172.21.15.8:0/2903613033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d80f6530 msgr2=0x7fb4d8108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 --2- 172.21.15.8:0/2903613033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d80f6530 0x7fb4d8108fd0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fb4c8009f50 tx=0x7fb4c8009b30).stop 2023-10-18T21:50:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 -- 172.21.15.8:0/2903613033 shutdown_connections 2023-10-18T21:50:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 --2- 172.21.15.8:0/2903613033 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb4c0060f70 0x7fb4c0063430 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 --2- 172.21.15.8:0/2903613033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d80f6530 0x7fb4d8108fd0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 --2- 172.21.15.8:0/2903613033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4d80f77d0 0x7fb4d81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:50:47.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 -- 172.21.15.8:0/2903613033 >> 172.21.15.8:0/2903613033 conn(0x7fb4d80f1c90 msgr2=0x7fb4d806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:47.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 -- 172.21.15.8:0/2903613033 shutdown_connections 2023-10-18T21:50:47.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.697+0000 7fb4dcb01700 1 -- 172.21.15.8:0/2903613033 wait complete. 2023-10-18T21:50:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.833+0000 7f15f5258700 1 -- 172.21.15.8:0/1692514383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15f00f7980 msgr2=0x7f15f00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.833+0000 7f15f5258700 1 --2- 172.21.15.8:0/1692514383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15f00f7980 0x7f15f00f7de0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f15e4004660 tx=0x7f15e4009b30).stop 2023-10-18T21:50:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.834+0000 7f15f5258700 1 -- 172.21.15.8:0/1692514383 shutdown_connections 2023-10-18T21:50:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.834+0000 7f15f5258700 1 --2- 172.21.15.8:0/1692514383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15f00f7980 0x7f15f00f7de0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.834+0000 7f15f5258700 1 --2- 172.21.15.8:0/1692514383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15f00f66e0 0x7f15f00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.834+0000 7f15f5258700 1 -- 172.21.15.8:0/1692514383 >> 172.21.15.8:0/1692514383 conn(0x7f15f00f1e40 msgr2=0x7f15f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.834+0000 7f15f5258700 1 -- 172.21.15.8:0/1692514383 shutdown_connections 2023-10-18T21:50:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.834+0000 7f15f5258700 1 -- 172.21.15.8:0/1692514383 wait complete. 2023-10-18T21:50:47.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.834+0000 7f15f5258700 1 Processor -- start 2023-10-18T21:50:47.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.835+0000 7f15f5258700 1 -- start start 2023-10-18T21:50:47.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.835+0000 7f15f5258700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15f00f66e0 0x7f15f0106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.835+0000 7f15f5258700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15f00f7980 0x7f15f0107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.835+0000 7f15f5258700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0107a20 con 0x7f15f00f7980 2023-10-18T21:50:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.835+0000 7f15f5258700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0107b60 con 0x7f15f00f66e0 2023-10-18T21:50:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.835+0000 7f15ee59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15f00f7980 0x7f15f0107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.835+0000 7f15ee59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15f00f7980 0x7f15f0107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52488/0 (socket says 172.21.15.8:52488) 2023-10-18T21:50:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.835+0000 7f15ee59c700 1 -- 172.21.15.8:0/2379343945 learned_addr learned my addr 172.21.15.8:0/2379343945 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15eed9d700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15f00f66e0 0x7f15f0106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15ee59c700 1 -- 172.21.15.8:0/2379343945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15f00f66e0 msgr2=0x7f15f0106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15ee59c700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15f00f66e0 0x7f15f0106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15ee59c700 1 -- 172.21.15.8:0/2379343945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e4005040 con 0x7f15f00f7980 2023-10-18T21:50:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15eed9d700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15f00f66e0 0x7f15f0106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:50:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15ee59c700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15f00f7980 0x7f15f0107470 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f15e4009990 tx=0x7f15e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15d77fe700 1 -- 172.21.15.8:0/2379343945 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15e4018070 con 0x7f15f00f7980 2023-10-18T21:50:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15d77fe700 1 -- 172.21.15.8:0/2379343945 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f15e4009780 con 0x7f15f00f7980 2023-10-18T21:50:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15d77fe700 1 -- 172.21.15.8:0/2379343945 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15e401c5a0 con 0x7f15f00f7980 2023-10-18T21:50:47.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15f5258700 1 -- 172.21.15.8:0/2379343945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f01084a0 con 0x7f15f00f7980 2023-10-18T21:50:47.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.836+0000 7f15f5258700 1 -- 172.21.15.8:0/2379343945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f0108a00 con 0x7f15f00f7980 2023-10-18T21:50:47.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.837+0000 7f15f5258700 1 -- 172.21.15.8:0/2379343945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f0045ad0 con 0x7f15f00f7980 2023-10-18T21:50:47.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.838+0000 7f15d77fe700 1 -- 172.21.15.8:0/2379343945 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f15e401db30 con 0x7f15f00f7980 2023-10-18T21:50:47.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.839+0000 7f15d77fe700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15d8060f20 0x7f15d80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:47.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.839+0000 7f15d77fe700 1 -- 172.21.15.8:0/2379343945 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f15e407e870 con 0x7f15f00f7980 2023-10-18T21:50:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.839+0000 7f15eed9d700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15d8060f20 0x7f15d80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.840+0000 7f15eed9d700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15d8060f20 0x7f15d80633e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f15f00f77e0 tx=0x7f15e0009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:47.843+0000 7f15d77fe700 1 -- 172.21.15.8:0/2379343945 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f15e4051ed0 con 0x7f15f00f7980 2023-10-18T21:50:48.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.036+0000 7f15f5258700 1 -- 172.21.15.8:0/2379343945 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f15f00fef80 con 0x7f15d8060f20 2023-10-18T21:50:48.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.046+0000 7f15d77fe700 1 -- 172.21.15.8:0/2379343945 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f15f00fef80 con 0x7f15d8060f20 2023-10-18T21:50:48.047 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:50:48.047 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (57m) 4m ago 58m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:50:48.047 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (51m) 4m ago 58m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:50:48.048 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (51m) 2m ago 58m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:50:48.048 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (57m) 4m ago 58m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:50:48.048 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 54m - - 2023-10-18T21:50:48.048 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 54m - - 2023-10-18T21:50:48.048 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 54m - - 2023-10-18T21:50:48.049 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 54m - - 2023-10-18T21:50:48.049 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (52m) 4m ago 60m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:50:48.049 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (51m) 2m ago 58m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:50:48.049 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (51m) 4m ago 60m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:50:48.049 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (51m) 2m ago 57m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:50:48.049 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (58m) 4m ago 58m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:50:48.050 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (57m) 2m ago 57m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:50:48.050 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (51m) 4m ago 57m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:50:48.050 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (49m) 4m ago 57m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:50:48.050 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (48m) 4m ago 56m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:50:48.050 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (48m) 2m ago 56m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:50:48.051 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (47m) 2m ago 56m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:50:48.051 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (46m) 2m ago 56m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:50:48.051 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (52m) 4m ago 58m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:50:48.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 -- 172.21.15.8:0/2379343945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15d8060f20 msgr2=0x7f15d80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15d8060f20 0x7f15d80633e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f15f00f77e0 tx=0x7f15e0009040).stop 2023-10-18T21:50:48.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 -- 172.21.15.8:0/2379343945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15f00f7980 msgr2=0x7f15f0107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15f00f7980 0x7f15f0107470 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f15e4009990 tx=0x7f15e4009b30).stop 2023-10-18T21:50:48.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 -- 172.21.15.8:0/2379343945 shutdown_connections 2023-10-18T21:50:48.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15d8060f20 0x7f15d80633e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15f00f66e0 0x7f15f0106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 --2- 172.21.15.8:0/2379343945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15f00f7980 0x7f15f0107470 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 -- 172.21.15.8:0/2379343945 >> 172.21.15.8:0/2379343945 conn(0x7f15f00f1e40 msgr2=0x7f15f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:48.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 -- 172.21.15.8:0/2379343945 shutdown_connections 2023-10-18T21:50:48.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.048+0000 7f15f5258700 1 -- 172.21.15.8:0/2379343945 wait complete. 2023-10-18T21:50:48.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.183+0000 7f7a5ffff700 1 -- 172.21.15.8:0/1303938672 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a58013a50 con 0x7f7a680f77d0 2023-10-18T21:50:48.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.184+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/1303938672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a680f77d0 msgr2=0x7f7a680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.184+0000 7f7a6e2d7700 1 --2- 172.21.15.8:0/1303938672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a680f77d0 0x7f7a680f7c30 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f7a58004660 tx=0x7f7a58009b30).stop 2023-10-18T21:50:48.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.184+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/1303938672 shutdown_connections 2023-10-18T21:50:48.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.184+0000 7f7a6e2d7700 1 --2- 172.21.15.8:0/1303938672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a680f77d0 0x7f7a680f7c30 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.184+0000 7f7a6e2d7700 1 --2- 172.21.15.8:0/1303938672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a680f6530 0x7f7a680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.184+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/1303938672 >> 172.21.15.8:0/1303938672 conn(0x7f7a680f1c90 msgr2=0x7f7a680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:48.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.184+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/1303938672 shutdown_connections 2023-10-18T21:50:48.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.184+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/1303938672 wait complete. 2023-10-18T21:50:48.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.185+0000 7f7a6e2d7700 1 Processor -- start 2023-10-18T21:50:48.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.185+0000 7f7a6e2d7700 1 -- start start 2023-10-18T21:50:48.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.185+0000 7f7a6e2d7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a680f6530 0x7f7a68108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:48.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.185+0000 7f7a6e2d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a680f77d0 0x7f7a68109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:48.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.185+0000 7f7a6e2d7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a681099d0 con 0x7f7a680f6530 2023-10-18T21:50:48.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.185+0000 7f7a6e2d7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68109b10 con 0x7f7a680f77d0 2023-10-18T21:50:48.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.185+0000 7f7a6d2d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a680f6530 0x7f7a68108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:48.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.185+0000 7f7a6d2d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a680f6530 0x7f7a68108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52494/0 (socket says 172.21.15.8:52494) 2023-10-18T21:50:48.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.185+0000 7f7a6d2d5700 1 -- 172.21.15.8:0/3486479293 learned_addr learned my addr 172.21.15.8:0/3486479293 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:48.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.186+0000 7f7a6cad4700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a680f77d0 0x7f7a68109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:48.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.186+0000 7f7a6d2d5700 1 -- 172.21.15.8:0/3486479293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a680f77d0 msgr2=0x7f7a68109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.186+0000 7f7a6d2d5700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a680f77d0 0x7f7a68109420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.186+0000 7f7a6d2d5700 1 -- 172.21.15.8:0/3486479293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58005040 con 0x7f7a680f6530 2023-10-18T21:50:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.186+0000 7f7a6d2d5700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a680f6530 0x7f7a68108f30 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f7a6400e7c0 tx=0x7f7a6400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.186+0000 7f7a5dffb700 1 -- 172.21.15.8:0/3486479293 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a640092e0 con 0x7f7a680f6530 2023-10-18T21:50:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.186+0000 7f7a5dffb700 1 -- 172.21.15.8:0/3486479293 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7a6400f040 con 0x7f7a680f6530 2023-10-18T21:50:48.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.186+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/3486479293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6810a4b0 con 0x7f7a680f6530 2023-10-18T21:50:48.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.186+0000 7f7a5dffb700 1 -- 172.21.15.8:0/3486479293 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a64014810 con 0x7f7a680f6530 2023-10-18T21:50:48.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.187+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/3486479293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6810a9f0 con 0x7f7a680f6530 2023-10-18T21:50:48.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.188+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/3486479293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a68045ad0 con 0x7f7a680f6530 2023-10-18T21:50:48.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.189+0000 7f7a5dffb700 1 -- 172.21.15.8:0/3486479293 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7a6401b030 con 0x7f7a680f6530 2023-10-18T21:50:48.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.189+0000 7f7a5dffb700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a54060f70 0x7f7a54063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:48.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.189+0000 7f7a5dffb700 1 -- 172.21.15.8:0/3486479293 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7a6407c910 con 0x7f7a680f6530 2023-10-18T21:50:48.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.190+0000 7f7a6cad4700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a54060f70 0x7f7a54063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:48.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.190+0000 7f7a6cad4700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a54060f70 0x7f7a54063430 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f7a58005010 tx=0x7f7a58016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:48.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.194+0000 7f7a5dffb700 1 -- 172.21.15.8:0/3486479293 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7a6404ff30 con 0x7f7a680f6530 2023-10-18T21:50:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.561640+0000 mon.smithi008 (mon.0) 3489 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.563823+0000 mon.smithi008 (mon.0) 3490 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.564599+0000 mon.smithi008 (mon.0) 3491 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.569768+0000 mon.smithi008 (mon.0) 3492 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.578047+0000 mon.smithi008 (mon.0) 3493 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.581512+0000 mon.smithi008 (mon.0) 3494 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.583410+0000 mon.smithi008 (mon.0) 3495 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.585253+0000 mon.smithi008 (mon.0) 3496 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.587766+0000 mon.smithi008 (mon.0) 3497 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:48.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.448+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/3486479293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7a6810f550 con 0x7f7a680f6530 2023-10-18T21:50:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.448+0000 7f7a5dffb700 1 -- 172.21.15.8:0/3486479293 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f7a64019070 con 0x7f7a680f6530 2023-10-18T21:50:48.450 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:50:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:50:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:50:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:50:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:50:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:50:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:50:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:50:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:50:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:50:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:50:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:50:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:50:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:50:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:50:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:50:48.453 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:50:48.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.450+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/3486479293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a54060f70 msgr2=0x7f7a54063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.450+0000 7f7a6e2d7700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a54060f70 0x7f7a54063430 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f7a58005010 tx=0x7f7a58016040).stop 2023-10-18T21:50:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.450+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/3486479293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a680f6530 msgr2=0x7f7a68108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.450+0000 7f7a6e2d7700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a680f6530 0x7f7a68108f30 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f7a6400e7c0 tx=0x7f7a6400b040).stop 2023-10-18T21:50:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.450+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/3486479293 shutdown_connections 2023-10-18T21:50:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.450+0000 7f7a6e2d7700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a54060f70 0x7f7a54063430 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.450+0000 7f7a6e2d7700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a680f6530 0x7f7a68108f30 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.450+0000 7f7a6e2d7700 1 --2- 172.21.15.8:0/3486479293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a680f77d0 0x7f7a68109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.450+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/3486479293 >> 172.21.15.8:0/3486479293 conn(0x7f7a680f1c90 msgr2=0x7f7a680f3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:48.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.451+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/3486479293 shutdown_connections 2023-10-18T21:50:48.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.451+0000 7f7a6e2d7700 1 -- 172.21.15.8:0/3486479293 wait complete. 2023-10-18T21:50:48.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.561640+0000 mon.smithi008 (mon.0) 3489 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.563823+0000 mon.smithi008 (mon.0) 3490 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.564599+0000 mon.smithi008 (mon.0) 3491 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.569768+0000 mon.smithi008 (mon.0) 3492 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.578047+0000 mon.smithi008 (mon.0) 3493 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.581512+0000 mon.smithi008 (mon.0) 3494 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.583410+0000 mon.smithi008 (mon.0) 3495 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.585253+0000 mon.smithi008 (mon.0) 3496 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.587766+0000 mon.smithi008 (mon.0) 3497 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:48.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.587+0000 7fcf8da36700 1 -- 172.21.15.8:0/1726884598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf880f6530 msgr2=0x7fcf880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.587+0000 7fcf8da36700 1 --2- 172.21.15.8:0/1726884598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf880f6530 0x7fcf880f6950 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fcf7c004660 tx=0x7fcf7c009b30).stop 2023-10-18T21:50:48.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.587+0000 7fcf8da36700 1 -- 172.21.15.8:0/1726884598 shutdown_connections 2023-10-18T21:50:48.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.587+0000 7fcf8da36700 1 --2- 172.21.15.8:0/1726884598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf880f77d0 0x7fcf880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.587+0000 7fcf8da36700 1 --2- 172.21.15.8:0/1726884598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf880f6530 0x7fcf880f6950 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.587+0000 7fcf8da36700 1 -- 172.21.15.8:0/1726884598 >> 172.21.15.8:0/1726884598 conn(0x7fcf880f1c90 msgr2=0x7fcf880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:48.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.587+0000 7fcf8da36700 1 -- 172.21.15.8:0/1726884598 shutdown_connections 2023-10-18T21:50:48.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.587+0000 7fcf8da36700 1 -- 172.21.15.8:0/1726884598 wait complete. 2023-10-18T21:50:48.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.588+0000 7fcf8da36700 1 Processor -- start 2023-10-18T21:50:48.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.588+0000 7fcf8da36700 1 -- start start 2023-10-18T21:50:48.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.589+0000 7fcf8da36700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf880f6530 0x7fcf8806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:48.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.589+0000 7fcf8da36700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf880f77d0 0x7fcf88069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:48.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.589+0000 7fcf8da36700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8806a380 con 0x7fcf880f6530 2023-10-18T21:50:48.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.589+0000 7fcf8da36700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8806a4c0 con 0x7fcf880f77d0 2023-10-18T21:50:48.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.589+0000 7fcf8ca34700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf880f6530 0x7fcf8806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:48.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.589+0000 7fcf8ca34700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf880f6530 0x7fcf8806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52518/0 (socket says 172.21.15.8:52518) 2023-10-18T21:50:48.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.589+0000 7fcf8ca34700 1 -- 172.21.15.8:0/3289512243 learned_addr learned my addr 172.21.15.8:0/3289512243 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.589+0000 7fcf87fff700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf880f77d0 0x7fcf88069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.589+0000 7fcf8ca34700 1 -- 172.21.15.8:0/3289512243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf880f77d0 msgr2=0x7fcf88069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.589+0000 7fcf8ca34700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf880f77d0 0x7fcf88069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.590+0000 7fcf8ca34700 1 -- 172.21.15.8:0/3289512243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c005040 con 0x7fcf880f6530 2023-10-18T21:50:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.590+0000 7fcf87fff700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf880f77d0 0x7fcf88069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:50:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.590+0000 7fcf8ca34700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf880f6530 0x7fcf8806b9a0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fcf7c004e30 tx=0x7fcf7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.590+0000 7fcf857fa700 1 -- 172.21.15.8:0/3289512243 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf7c018070 con 0x7fcf880f6530 2023-10-18T21:50:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.590+0000 7fcf857fa700 1 -- 172.21.15.8:0/3289512243 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcf7c009630 con 0x7fcf880f6530 2023-10-18T21:50:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.590+0000 7fcf857fa700 1 -- 172.21.15.8:0/3289512243 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf7c01c3c0 con 0x7fcf880f6530 2023-10-18T21:50:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.590+0000 7fcf8da36700 1 -- 172.21.15.8:0/3289512243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8806a740 con 0x7fcf880f6530 2023-10-18T21:50:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.590+0000 7fcf8da36700 1 -- 172.21.15.8:0/3289512243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8806aca0 con 0x7fcf880f6530 2023-10-18T21:50:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.591+0000 7fcf8da36700 1 -- 172.21.15.8:0/3289512243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf88045ad0 con 0x7fcf880f6530 2023-10-18T21:50:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.592+0000 7fcf857fa700 1 -- 172.21.15.8:0/3289512243 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcf7c01d420 con 0x7fcf880f6530 2023-10-18T21:50:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.593+0000 7fcf857fa700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf78060f70 0x7fcf78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.594+0000 7fcf857fa700 1 -- 172.21.15.8:0/3289512243 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcf7c07e540 con 0x7fcf880f6530 2023-10-18T21:50:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.594+0000 7fcf87fff700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf78060f70 0x7fcf78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.594+0000 7fcf87fff700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf78060f70 0x7fcf78063430 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fcf74004b90 tx=0x7fcf7400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.598+0000 7fcf857fa700 1 -- 172.21.15.8:0/3289512243 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcf7c04e220 con 0x7fcf880f6530 2023-10-18T21:50:48.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.830+0000 7fcf8da36700 1 -- 172.21.15.8:0/3289512243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcf880fee10 con 0x7fcf880f6530 2023-10-18T21:50:48.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.831+0000 7fcf857fa700 1 -- 172.21.15.8:0/3289512243 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fcf7c051840 con 0x7fcf880f6530 2023-10-18T21:50:48.832 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:50:48.832 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:50:48.833 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:50:48.833 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:50:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:50:48.833 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:50:48.834 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:50:48.834 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:50:48.834 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:50:48.834 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:50:48.834 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:50:48.835 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:50:48.835 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:50:48.835 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:50:48.835 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:50:48.835 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:50:48.836 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:50:48.836 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:50:48.836 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:50:48.836 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:50:48.836 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:50:48.836 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:50:48.837 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:50:48.837 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:50:48.837 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:50:48.837 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:50:48.837 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:50:48.838 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:50:48.838 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:50:48.838 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:50:48.838 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:50:48.838 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:50:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:50:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:50:48.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 -- 172.21.15.8:0/3289512243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf78060f70 msgr2=0x7fcf78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf78060f70 0x7fcf78063430 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fcf74004b90 tx=0x7fcf7400b040).stop 2023-10-18T21:50:48.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 -- 172.21.15.8:0/3289512243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf880f6530 msgr2=0x7fcf8806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf880f6530 0x7fcf8806b9a0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fcf7c004e30 tx=0x7fcf7c009b30).stop 2023-10-18T21:50:48.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 -- 172.21.15.8:0/3289512243 shutdown_connections 2023-10-18T21:50:48.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcf78060f70 0x7fcf78063430 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf880f6530 0x7fcf8806b9a0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 --2- 172.21.15.8:0/3289512243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf880f77d0 0x7fcf88069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 -- 172.21.15.8:0/3289512243 >> 172.21.15.8:0/3289512243 conn(0x7fcf880f1c90 msgr2=0x7fcf880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:48.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 -- 172.21.15.8:0/3289512243 shutdown_connections 2023-10-18T21:50:48.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.833+0000 7fcf8da36700 1 -- 172.21.15.8:0/3289512243 wait complete. 2023-10-18T21:50:48.842 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:50:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.972+0000 7fb7e514a700 1 -- 172.21.15.8:0/3285679465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e00f77d0 msgr2=0x7fb7e00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.972+0000 7fb7e514a700 1 --2- 172.21.15.8:0/3285679465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e00f77d0 0x7fb7e00f7c30 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fb7d4004660 tx=0x7fb7d4009b30).stop 2023-10-18T21:50:48.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.972+0000 7fb7e514a700 1 -- 172.21.15.8:0/3285679465 shutdown_connections 2023-10-18T21:50:48.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.972+0000 7fb7e514a700 1 --2- 172.21.15.8:0/3285679465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e00f77d0 0x7fb7e00f7c30 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.972+0000 7fb7e514a700 1 --2- 172.21.15.8:0/3285679465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00f6530 0x7fb7e00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.972+0000 7fb7e514a700 1 -- 172.21.15.8:0/3285679465 >> 172.21.15.8:0/3285679465 conn(0x7fb7e00f1c90 msgr2=0x7fb7e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:48.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.972+0000 7fb7e514a700 1 -- 172.21.15.8:0/3285679465 shutdown_connections 2023-10-18T21:50:48.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.972+0000 7fb7e514a700 1 -- 172.21.15.8:0/3285679465 wait complete. 2023-10-18T21:50:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.973+0000 7fb7e514a700 1 Processor -- start 2023-10-18T21:50:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.973+0000 7fb7e514a700 1 -- start start 2023-10-18T21:50:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7e514a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00f6530 0x7fb7e0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7e514a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e00f77d0 0x7fb7e0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7e514a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0107880 con 0x7fb7e00f77d0 2023-10-18T21:50:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7e514a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e01080c0 con 0x7fb7e00f6530 2023-10-18T21:50:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e00f77d0 0x7fb7e0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e00f77d0 0x7fb7e0107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52544/0 (socket says 172.21.15.8:52544) 2023-10-18T21:50:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7df7fe700 1 -- 172.21.15.8:0/1007751494 learned_addr learned my addr 172.21.15.8:0/1007751494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:50:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7dffff700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00f6530 0x7fb7e0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7df7fe700 1 -- 172.21.15.8:0/1007751494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00f6530 msgr2=0x7fb7e0106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7df7fe700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00f6530 0x7fb7e0106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7df7fe700 1 -- 172.21.15.8:0/1007751494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4005040 con 0x7fb7e00f77d0 2023-10-18T21:50:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7dffff700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00f6530 0x7fb7e0106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:50:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.974+0000 7fb7df7fe700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e00f77d0 0x7fb7e0107280 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fb7d4009990 tx=0x7fb7d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.975+0000 7fb7dcff9700 1 -- 172.21.15.8:0/1007751494 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7d4018070 con 0x7fb7e00f77d0 2023-10-18T21:50:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.975+0000 7fb7dcff9700 1 -- 172.21.15.8:0/1007751494 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb7d4009630 con 0x7fb7e00f77d0 2023-10-18T21:50:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.975+0000 7fb7e514a700 1 -- 172.21.15.8:0/1007751494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e0108340 con 0x7fb7e00f77d0 2023-10-18T21:50:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.975+0000 7fb7dcff9700 1 -- 172.21.15.8:0/1007751494 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7d401c400 con 0x7fb7e00f77d0 2023-10-18T21:50:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.975+0000 7fb7e514a700 1 -- 172.21.15.8:0/1007751494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e0108820 con 0x7fb7e00f77d0 2023-10-18T21:50:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.976+0000 7fb7e514a700 1 -- 172.21.15.8:0/1007751494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e0059100 con 0x7fb7e00f77d0 2023-10-18T21:50:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.977+0000 7fb7dcff9700 1 -- 172.21.15.8:0/1007751494 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb7d401d9e0 con 0x7fb7e00f77d0 2023-10-18T21:50:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.978+0000 7fb7dcff9700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7c8060f70 0x7fb7c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:50:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.978+0000 7fb7dcff9700 1 -- 172.21.15.8:0/1007751494 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb7d407e680 con 0x7fb7e00f77d0 2023-10-18T21:50:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.978+0000 7fb7dffff700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7c8060f70 0x7fb7c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:50:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.979+0000 7fb7dffff700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7c8060f70 0x7fb7c8063430 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fb7e0107b50 tx=0x7fb7d0009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:50:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:48.982+0000 7fb7dcff9700 1 -- 172.21.15.8:0/1007751494 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb7d404e2b0 con 0x7fb7e00f77d0 2023-10-18T21:50:49.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.185+0000 7fb7e514a700 1 -- 172.21.15.8:0/1007751494 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7e00feda0 con 0x7fb7c8060f70 2023-10-18T21:50:49.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.186+0000 7fb7dcff9700 1 -- 172.21.15.8:0/1007751494 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb7e00feda0 con 0x7fb7c8060f70 2023-10-18T21:50:49.188 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:50:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:50:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:50:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:50:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:50:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:50:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:50:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:50:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:50:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:50:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:50:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:50:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:50:49.191 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:50:49.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.188+0000 7fb7e514a700 1 -- 172.21.15.8:0/1007751494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7c8060f70 msgr2=0x7fb7c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:49.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.188+0000 7fb7e514a700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7c8060f70 0x7fb7c8063430 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fb7e0107b50 tx=0x7fb7d0009c00).stop 2023-10-18T21:50:49.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.188+0000 7fb7e514a700 1 -- 172.21.15.8:0/1007751494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e00f77d0 msgr2=0x7fb7e0107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:50:49.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.188+0000 7fb7e514a700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e00f77d0 0x7fb7e0107280 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fb7d4009990 tx=0x7fb7d4009b30).stop 2023-10-18T21:50:49.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.188+0000 7fb7e514a700 1 -- 172.21.15.8:0/1007751494 shutdown_connections 2023-10-18T21:50:49.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.188+0000 7fb7e514a700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb7c8060f70 0x7fb7c8063430 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:49.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.188+0000 7fb7e514a700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e00f6530 0x7fb7e0106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:49.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.188+0000 7fb7e514a700 1 --2- 172.21.15.8:0/1007751494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7e00f77d0 0x7fb7e0107280 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:50:49.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.188+0000 7fb7e514a700 1 -- 172.21.15.8:0/1007751494 >> 172.21.15.8:0/1007751494 conn(0x7fb7e00f1c90 msgr2=0x7fb7e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:50:49.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.188+0000 7fb7e514a700 1 -- 172.21.15.8:0/1007751494 shutdown_connections 2023-10-18T21:50:49.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:50:49.189+0000 7fb7e514a700 1 -- 172.21.15.8:0/1007751494 wait complete. 2023-10-18T21:50:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.332088+0000 mgr.smithi008.flmjzp (mgr.14640) 3114 : audit [DBG] from='client.36592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:47.528980+0000 mgr.smithi008.flmjzp (mgr.14640) 3115 : cluster [DBG] pgmap v2144: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:47.565311+0000 mgr.smithi008.flmjzp (mgr.14640) 3116 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:47.565783+0000 mgr.smithi008.flmjzp (mgr.14640) 3117 : cluster [DBG] pgmap v2145: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:47.566010+0000 mgr.smithi008.flmjzp (mgr.14640) 3118 : cluster [DBG] pgmap v2146: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:47.590202+0000 mgr.smithi008.flmjzp (mgr.14640) 3119 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:47.695240+0000 mgr.smithi008.flmjzp (mgr.14640) 3120 : audit [DBG] from='client.36596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:48.037606+0000 mgr.smithi008.flmjzp (mgr.14640) 3121 : audit [DBG] from='client.36600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:49.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:48.448982+0000 mon.smithi008 (mon.0) 3498 : audit [DBG] from='client.? 172.21.15.8:0/3486479293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:49.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:48.831391+0000 mon.smithi008 (mon.0) 3499 : audit [DBG] from='client.? 172.21.15.8:0/3289512243' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:50:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.332088+0000 mgr.smithi008.flmjzp (mgr.14640) 3114 : audit [DBG] from='client.36592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:47.528980+0000 mgr.smithi008.flmjzp (mgr.14640) 3115 : cluster [DBG] pgmap v2144: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:47.565311+0000 mgr.smithi008.flmjzp (mgr.14640) 3116 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:47.565783+0000 mgr.smithi008.flmjzp (mgr.14640) 3117 : cluster [DBG] pgmap v2145: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:47.566010+0000 mgr.smithi008.flmjzp (mgr.14640) 3118 : cluster [DBG] pgmap v2146: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:49.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:47.590202+0000 mgr.smithi008.flmjzp (mgr.14640) 3119 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:49.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:47.695240+0000 mgr.smithi008.flmjzp (mgr.14640) 3120 : audit [DBG] from='client.36596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:49.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:48.037606+0000 mgr.smithi008.flmjzp (mgr.14640) 3121 : audit [DBG] from='client.36600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:49.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:48.448982+0000 mon.smithi008 (mon.0) 3498 : audit [DBG] from='client.? 172.21.15.8:0/3486479293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:49.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:48.831391+0000 mon.smithi008 (mon.0) 3499 : audit [DBG] from='client.? 172.21.15.8:0/3289512243' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:50:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:49.187340+0000 mgr.smithi008.flmjzp (mgr.14640) 3122 : audit [DBG] from='client.36612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:49.566705+0000 mgr.smithi008.flmjzp (mgr.14640) 3123 : cluster [DBG] pgmap v2147: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:49.187340+0000 mgr.smithi008.flmjzp (mgr.14640) 3122 : audit [DBG] from='client.36612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:50:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:49.566705+0000 mgr.smithi008.flmjzp (mgr.14640) 3123 : cluster [DBG] pgmap v2147: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:51.567315+0000 mgr.smithi008.flmjzp (mgr.14640) 3124 : cluster [DBG] pgmap v2148: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:53.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:51.567315+0000 mgr.smithi008.flmjzp (mgr.14640) 3124 : cluster [DBG] pgmap v2148: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:53.567897+0000 mgr.smithi008.flmjzp (mgr.14640) 3125 : cluster [DBG] pgmap v2149: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:55.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:53.567897+0000 mgr.smithi008.flmjzp (mgr.14640) 3125 : cluster [DBG] pgmap v2149: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:55.568385+0000 mgr.smithi008.flmjzp (mgr.14640) 3126 : cluster [DBG] pgmap v2150: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:57.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:55.568385+0000 mgr.smithi008.flmjzp (mgr.14640) 3126 : cluster [DBG] pgmap v2150: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:58.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:57.598964+0000 mon.smithi008 (mon.0) 3500 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:57.601199+0000 mon.smithi008 (mon.0) 3501 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:57.602223+0000 mon.smithi008 (mon.0) 3502 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:57.608857+0000 mon.smithi008 (mon.0) 3503 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:57.615340+0000 mon.smithi008 (mon.0) 3504 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:58.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:57.618538+0000 mon.smithi008 (mon.0) 3505 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:58.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:57.620262+0000 mon.smithi008 (mon.0) 3506 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:58.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:57.621891+0000 mon.smithi008 (mon.0) 3507 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:58.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:50:57.623849+0000 mon.smithi008 (mon.0) 3508 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:58.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:57.598964+0000 mon.smithi008 (mon.0) 3500 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:57.601199+0000 mon.smithi008 (mon.0) 3501 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:50:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:57.602223+0000 mon.smithi008 (mon.0) 3502 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:50:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:57.608857+0000 mon.smithi008 (mon.0) 3503 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:50:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:57.615340+0000 mon.smithi008 (mon.0) 3504 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:50:58.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:57.618538+0000 mon.smithi008 (mon.0) 3505 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:58.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:57.620262+0000 mon.smithi008 (mon.0) 3506 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:58.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:57.621891+0000 mon.smithi008 (mon.0) 3507 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:58.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:50:57.623849+0000 mon.smithi008 (mon.0) 3508 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:50:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:57.568815+0000 mgr.smithi008.flmjzp (mgr.14640) 3127 : cluster [DBG] pgmap v2151: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:57.603119+0000 mgr.smithi008.flmjzp (mgr.14640) 3128 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:57.603648+0000 mgr.smithi008.flmjzp (mgr.14640) 3129 : cluster [DBG] pgmap v2152: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:57.603971+0000 mgr.smithi008.flmjzp (mgr.14640) 3130 : cluster [DBG] pgmap v2153: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:50:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:50:57.625791+0000 mgr.smithi008.flmjzp (mgr.14640) 3131 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:50:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:57.568815+0000 mgr.smithi008.flmjzp (mgr.14640) 3127 : cluster [DBG] pgmap v2151: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:57.603119+0000 mgr.smithi008.flmjzp (mgr.14640) 3128 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:50:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:57.603648+0000 mgr.smithi008.flmjzp (mgr.14640) 3129 : cluster [DBG] pgmap v2152: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:57.603971+0000 mgr.smithi008.flmjzp (mgr.14640) 3130 : cluster [DBG] pgmap v2153: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:50:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:50:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:50:57.625791+0000 mgr.smithi008.flmjzp (mgr.14640) 3131 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:50:59.604568+0000 mgr.smithi008.flmjzp (mgr.14640) 3132 : cluster [DBG] pgmap v2154: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:50:59.604568+0000 mgr.smithi008.flmjzp (mgr.14640) 3132 : cluster [DBG] pgmap v2154: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:03.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:01.605237+0000 mgr.smithi008.flmjzp (mgr.14640) 3133 : cluster [DBG] pgmap v2155: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:03.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:01.605237+0000 mgr.smithi008.flmjzp (mgr.14640) 3133 : cluster [DBG] pgmap v2155: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:03.605935+0000 mgr.smithi008.flmjzp (mgr.14640) 3134 : cluster [DBG] pgmap v2156: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:05.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:03.605935+0000 mgr.smithi008.flmjzp (mgr.14640) 3134 : cluster [DBG] pgmap v2156: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:05.606517+0000 mgr.smithi008.flmjzp (mgr.14640) 3135 : cluster [DBG] pgmap v2157: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:07.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:05.606517+0000 mgr.smithi008.flmjzp (mgr.14640) 3135 : cluster [DBG] pgmap v2157: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:08.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:07.636567+0000 mon.smithi008 (mon.0) 3509 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:08.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:07.636567+0000 mon.smithi008 (mon.0) 3509 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:07.607147+0000 mgr.smithi008.flmjzp (mgr.14640) 3136 : cluster [DBG] pgmap v2158: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:08.194614+0000 mon.smithi008 (mon.0) 3510 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:08.195389+0000 mon.smithi008 (mon.0) 3511 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:08.200936+0000 mon.smithi008 (mon.0) 3512 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:08.205918+0000 mon.smithi008 (mon.0) 3513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:08.208225+0000 mon.smithi008 (mon.0) 3514 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:08.209445+0000 mon.smithi008 (mon.0) 3515 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:08.210631+0000 mon.smithi008 (mon.0) 3516 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:08.212129+0000 mon.smithi008 (mon.0) 3517 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:07.607147+0000 mgr.smithi008.flmjzp (mgr.14640) 3136 : cluster [DBG] pgmap v2158: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:08.194614+0000 mon.smithi008 (mon.0) 3510 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:08.195389+0000 mon.smithi008 (mon.0) 3511 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:08.200936+0000 mon.smithi008 (mon.0) 3512 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:08.205918+0000 mon.smithi008 (mon.0) 3513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:08.208225+0000 mon.smithi008 (mon.0) 3514 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:08.209445+0000 mon.smithi008 (mon.0) 3515 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:08.210631+0000 mon.smithi008 (mon.0) 3516 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:08.212129+0000 mon.smithi008 (mon.0) 3517 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:08.196027+0000 mgr.smithi008.flmjzp (mgr.14640) 3137 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:51:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:08.196503+0000 mgr.smithi008.flmjzp (mgr.14640) 3138 : cluster [DBG] pgmap v2159: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:08.196718+0000 mgr.smithi008.flmjzp (mgr.14640) 3139 : cluster [DBG] pgmap v2160: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:08.213630+0000 mgr.smithi008.flmjzp (mgr.14640) 3140 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:10.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:08.196027+0000 mgr.smithi008.flmjzp (mgr.14640) 3137 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:51:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:08.196503+0000 mgr.smithi008.flmjzp (mgr.14640) 3138 : cluster [DBG] pgmap v2159: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:08.196718+0000 mgr.smithi008.flmjzp (mgr.14640) 3139 : cluster [DBG] pgmap v2160: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:08.213630+0000 mgr.smithi008.flmjzp (mgr.14640) 3140 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:12.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:10.197167+0000 mgr.smithi008.flmjzp (mgr.14640) 3141 : cluster [DBG] pgmap v2161: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:10.197167+0000 mgr.smithi008.flmjzp (mgr.14640) 3141 : cluster [DBG] pgmap v2161: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:14.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:12.197799+0000 mgr.smithi008.flmjzp (mgr.14640) 3142 : cluster [DBG] pgmap v2162: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:14.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:12.197799+0000 mgr.smithi008.flmjzp (mgr.14640) 3142 : cluster [DBG] pgmap v2162: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:14.198556+0000 mgr.smithi008.flmjzp (mgr.14640) 3143 : cluster [DBG] pgmap v2163: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:16.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:14.198556+0000 mgr.smithi008.flmjzp (mgr.14640) 3143 : cluster [DBG] pgmap v2163: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:18.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:16.199174+0000 mgr.smithi008.flmjzp (mgr.14640) 3144 : cluster [DBG] pgmap v2164: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:16.199174+0000 mgr.smithi008.flmjzp (mgr.14640) 3144 : cluster [DBG] pgmap v2164: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:19.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.341+0000 7f6b423a1700 1 -- 172.21.15.8:0/1421559062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c060310 msgr2=0x7f6b3c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:19.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.341+0000 7f6b423a1700 1 --2- 172.21.15.8:0/1421559062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c060310 0x7f6b3c0f9110 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f6b38004660 tx=0x7f6b38009b30).stop 2023-10-18T21:51:19.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.341+0000 7f6b423a1700 1 -- 172.21.15.8:0/1421559062 shutdown_connections 2023-10-18T21:51:19.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.341+0000 7f6b423a1700 1 --2- 172.21.15.8:0/1421559062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3c0f9690 0x7f6b3c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:19.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.341+0000 7f6b423a1700 1 --2- 172.21.15.8:0/1421559062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c060310 0x7f6b3c0f9110 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:19.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.341+0000 7f6b423a1700 1 -- 172.21.15.8:0/1421559062 >> 172.21.15.8:0/1421559062 conn(0x7f6b3c0f0b90 msgr2=0x7f6b3c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:19.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.341+0000 7f6b423a1700 1 -- 172.21.15.8:0/1421559062 shutdown_connections 2023-10-18T21:51:19.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.341+0000 7f6b423a1700 1 -- 172.21.15.8:0/1421559062 wait complete. 2023-10-18T21:51:19.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.342+0000 7f6b423a1700 1 Processor -- start 2023-10-18T21:51:19.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.342+0000 7f6b423a1700 1 -- start start 2023-10-18T21:51:19.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.342+0000 7f6b423a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c060310 0x7f6b3c108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:19.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.342+0000 7f6b423a1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3c0f9690 0x7f6b3c109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:19.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.342+0000 7f6b423a1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c109a00 con 0x7f6b3c060310 2023-10-18T21:51:19.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.342+0000 7f6b423a1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c109b40 con 0x7f6b3c0f9690 2023-10-18T21:51:19.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.343+0000 7f6b4139f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c060310 0x7f6b3c108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:19.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.343+0000 7f6b4139f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c060310 0x7f6b3c108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42856/0 (socket says 172.21.15.8:42856) 2023-10-18T21:51:19.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.343+0000 7f6b4139f700 1 -- 172.21.15.8:0/3233521954 learned_addr learned my addr 172.21.15.8:0/3233521954 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.343+0000 7f6b4139f700 1 -- 172.21.15.8:0/3233521954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3c0f9690 msgr2=0x7f6b3c109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.343+0000 7f6b4139f700 1 --2- 172.21.15.8:0/3233521954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3c0f9690 0x7f6b3c109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:51:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.343+0000 7f6b4139f700 1 -- 172.21.15.8:0/3233521954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b38005040 con 0x7f6b3c060310 2023-10-18T21:51:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.343+0000 7f6b4139f700 1 --2- 172.21.15.8:0/3233521954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c060310 0x7f6b3c108f60 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f6b38009f50 tx=0x7f6b38009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.343+0000 7f6b31ffb700 1 -- 172.21.15.8:0/3233521954 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b38018070 con 0x7f6b3c060310 2023-10-18T21:51:19.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.344+0000 7f6b31ffb700 1 -- 172.21.15.8:0/3233521954 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6b38009630 con 0x7f6b3c060310 2023-10-18T21:51:19.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.344+0000 7f6b423a1700 1 -- 172.21.15.8:0/3233521954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3c10a480 con 0x7f6b3c060310 2023-10-18T21:51:19.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.344+0000 7f6b31ffb700 1 -- 172.21.15.8:0/3233521954 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b3801c3c0 con 0x7f6b3c060310 2023-10-18T21:51:19.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.344+0000 7f6b423a1700 1 -- 172.21.15.8:0/3233521954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c10a9e0 con 0x7f6b3c060310 2023-10-18T21:51:19.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.345+0000 7f6b423a1700 1 -- 172.21.15.8:0/3233521954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c045ad0 con 0x7f6b3c060310 2023-10-18T21:51:19.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.346+0000 7f6b31ffb700 1 -- 172.21.15.8:0/3233521954 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6b3801d420 con 0x7f6b3c060310 2023-10-18T21:51:19.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.346+0000 7f6b31ffb700 1 --2- 172.21.15.8:0/3233521954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 0x7f6b28063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.346+0000 7f6b31ffb700 1 -- 172.21.15.8:0/3233521954 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6b3807e650 con 0x7f6b3c060310 2023-10-18T21:51:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.347+0000 7f6b40b9e700 1 --2- 172.21.15.8:0/3233521954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 0x7f6b28063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.347+0000 7f6b40b9e700 1 --2- 172.21.15.8:0/3233521954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 0x7f6b28063430 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f6b3c0600e0 tx=0x7f6b2c0099e0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.351+0000 7f6b31ffb700 1 -- 172.21.15.8:0/3233521954 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6b38051cf0 con 0x7f6b3c060310 2023-10-18T21:51:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:18.220231+0000 mon.smithi008 (mon.0) 3518 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:18.222288+0000 mon.smithi008 (mon.0) 3519 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:18.223312+0000 mon.smithi008 (mon.0) 3520 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:18.229833+0000 mon.smithi008 (mon.0) 3521 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:18.236868+0000 mon.smithi008 (mon.0) 3522 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:18.240414+0000 mon.smithi008 (mon.0) 3523 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:18.242403+0000 mon.smithi008 (mon.0) 3524 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:18.244318+0000 mon.smithi008 (mon.0) 3525 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:19.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:18.246900+0000 mon.smithi008 (mon.0) 3526 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:18.220231+0000 mon.smithi008 (mon.0) 3518 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:18.222288+0000 mon.smithi008 (mon.0) 3519 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:18.223312+0000 mon.smithi008 (mon.0) 3520 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:18.229833+0000 mon.smithi008 (mon.0) 3521 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:18.236868+0000 mon.smithi008 (mon.0) 3522 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:18.240414+0000 mon.smithi008 (mon.0) 3523 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:19.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:18.242403+0000 mon.smithi008 (mon.0) 3524 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:19.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:18.244318+0000 mon.smithi008 (mon.0) 3525 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:19.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:18.246900+0000 mon.smithi008 (mon.0) 3526 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:19.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.553+0000 7f6b423a1700 1 -- 172.21.15.8:0/3233521954 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b3c0fa530 con 0x7f6b28060f70 2023-10-18T21:51:19.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.554+0000 7f6b31ffb700 1 -- 172.21.15.8:0/3233521954 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6b3c0fa530 con 0x7f6b28060f70 2023-10-18T21:51:19.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 -- 172.21.15.8:0/3233521954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 msgr2=0x7f6b28063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:19.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 --2- 172.21.15.8:0/3233521954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 0x7f6b28063430 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f6b3c0600e0 tx=0x7f6b2c0099e0).stop 2023-10-18T21:51:19.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 -- 172.21.15.8:0/3233521954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c060310 msgr2=0x7f6b3c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:19.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 --2- 172.21.15.8:0/3233521954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c060310 0x7f6b3c108f60 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f6b38009f50 tx=0x7f6b38009b30).stop 2023-10-18T21:51:19.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 -- 172.21.15.8:0/3233521954 shutdown_connections 2023-10-18T21:51:19.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 --2- 172.21.15.8:0/3233521954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b28060f70 0x7f6b28063430 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:19.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 --2- 172.21.15.8:0/3233521954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c060310 0x7f6b3c108f60 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:19.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 --2- 172.21.15.8:0/3233521954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3c0f9690 0x7f6b3c109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:51:19.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 -- 172.21.15.8:0/3233521954 >> 172.21.15.8:0/3233521954 conn(0x7f6b3c0f0b90 msgr2=0x7f6b3c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:19.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 -- 172.21.15.8:0/3233521954 shutdown_connections 2023-10-18T21:51:19.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.556+0000 7f6b423a1700 1 -- 172.21.15.8:0/3233521954 wait complete. 2023-10-18T21:51:19.573 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:51:19.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.693+0000 7fd676e8f700 1 -- 172.21.15.8:0/4212219017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6700f77d0 msgr2=0x7fd6700f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:19.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.693+0000 7fd676e8f700 1 --2- 172.21.15.8:0/4212219017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6700f77d0 0x7fd6700f7c30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fd660004660 tx=0x7fd660009b30).stop 2023-10-18T21:51:19.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.693+0000 7fd676e8f700 1 -- 172.21.15.8:0/4212219017 shutdown_connections 2023-10-18T21:51:19.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.693+0000 7fd676e8f700 1 --2- 172.21.15.8:0/4212219017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6700f77d0 0x7fd6700f7c30 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:19.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.693+0000 7fd676e8f700 1 --2- 172.21.15.8:0/4212219017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6700f6530 0x7fd6700f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:19.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.693+0000 7fd676e8f700 1 -- 172.21.15.8:0/4212219017 >> 172.21.15.8:0/4212219017 conn(0x7fd6700f1c90 msgr2=0x7fd6700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:19.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.693+0000 7fd676e8f700 1 -- 172.21.15.8:0/4212219017 shutdown_connections 2023-10-18T21:51:19.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.693+0000 7fd676e8f700 1 -- 172.21.15.8:0/4212219017 wait complete. 2023-10-18T21:51:19.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.694+0000 7fd676e8f700 1 Processor -- start 2023-10-18T21:51:19.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.694+0000 7fd676e8f700 1 -- start start 2023-10-18T21:51:19.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd676e8f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6700f6530 0x7fd670108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:19.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd676e8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6700f77d0 0x7fd670109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:19.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd676e8f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6701099c0 con 0x7fd6700f77d0 2023-10-18T21:51:19.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd676e8f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670109b00 con 0x7fd6700f6530 2023-10-18T21:51:19.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd67568c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6700f77d0 0x7fd670109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:19.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd67568c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6700f77d0 0x7fd670109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42882/0 (socket says 172.21.15.8:42882) 2023-10-18T21:51:19.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd67568c700 1 -- 172.21.15.8:0/348432039 learned_addr learned my addr 172.21.15.8:0/348432039 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:19.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd675e8d700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6700f6530 0x7fd670108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:19.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd67568c700 1 -- 172.21.15.8:0/348432039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6700f6530 msgr2=0x7fd670108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:19.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd67568c700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6700f6530 0x7fd670108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:19.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.695+0000 7fd67568c700 1 -- 172.21.15.8:0/348432039 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd660005040 con 0x7fd6700f77d0 2023-10-18T21:51:19.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.696+0000 7fd67568c700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6700f77d0 0x7fd670109410 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fd660004d80 tx=0x7fd66000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:19.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.696+0000 7fd6667fc700 1 -- 172.21.15.8:0/348432039 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd660019070 con 0x7fd6700f77d0 2023-10-18T21:51:19.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.696+0000 7fd6667fc700 1 -- 172.21.15.8:0/348432039 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd66001e420 con 0x7fd6700f77d0 2023-10-18T21:51:19.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.696+0000 7fd676e8f700 1 -- 172.21.15.8:0/348432039 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67010a440 con 0x7fd6700f77d0 2023-10-18T21:51:19.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.696+0000 7fd6667fc700 1 -- 172.21.15.8:0/348432039 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd660014680 con 0x7fd6700f77d0 2023-10-18T21:51:19.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.696+0000 7fd676e8f700 1 -- 172.21.15.8:0/348432039 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67010a920 con 0x7fd6700f77d0 2023-10-18T21:51:19.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.697+0000 7fd676e8f700 1 -- 172.21.15.8:0/348432039 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd670045ad0 con 0x7fd6700f77d0 2023-10-18T21:51:19.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.698+0000 7fd6667fc700 1 -- 172.21.15.8:0/348432039 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd66001e9c0 con 0x7fd6700f77d0 2023-10-18T21:51:19.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.699+0000 7fd6667fc700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd65c060f70 0x7fd65c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:19.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.699+0000 7fd6667fc700 1 -- 172.21.15.8:0/348432039 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd66007dde0 con 0x7fd6700f77d0 2023-10-18T21:51:19.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.699+0000 7fd675e8d700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd65c060f70 0x7fd65c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:19.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.700+0000 7fd675e8d700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd65c060f70 0x7fd65c063430 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fd6700f7630 tx=0x7fd66c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:19.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.703+0000 7fd6667fc700 1 -- 172.21.15.8:0/348432039 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd660051440 con 0x7fd6700f77d0 2023-10-18T21:51:19.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.899+0000 7fd676e8f700 1 -- 172.21.15.8:0/348432039 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6700fee30 con 0x7fd65c060f70 2023-10-18T21:51:19.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.900+0000 7fd6667fc700 1 -- 172.21.15.8:0/348432039 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd6700fee30 con 0x7fd65c060f70 2023-10-18T21:51:19.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 -- 172.21.15.8:0/348432039 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd65c060f70 msgr2=0x7fd65c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:19.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd65c060f70 0x7fd65c063430 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fd6700f7630 tx=0x7fd66c00b040).stop 2023-10-18T21:51:19.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 -- 172.21.15.8:0/348432039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6700f77d0 msgr2=0x7fd670109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:19.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6700f77d0 0x7fd670109410 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fd660004d80 tx=0x7fd66000b040).stop 2023-10-18T21:51:19.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 -- 172.21.15.8:0/348432039 shutdown_connections 2023-10-18T21:51:19.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd65c060f70 0x7fd65c063430 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:19.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6700f6530 0x7fd670108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:19.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 --2- 172.21.15.8:0/348432039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6700f77d0 0x7fd670109410 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:19.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 -- 172.21.15.8:0/348432039 >> 172.21.15.8:0/348432039 conn(0x7fd6700f1c90 msgr2=0x7fd67006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:19.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 -- 172.21.15.8:0/348432039 shutdown_connections 2023-10-18T21:51:19.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:19.902+0000 7fd676e8f700 1 -- 172.21.15.8:0/348432039 wait complete. 2023-10-18T21:51:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.038+0000 7f278a957700 1 -- 172.21.15.8:0/3017571925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27840f77d0 msgr2=0x7f27840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.038+0000 7f278a957700 1 --2- 172.21.15.8:0/3017571925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27840f77d0 0x7f27840f7c30 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f2774004660 tx=0x7f2774009b30).stop 2023-10-18T21:51:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.038+0000 7f278a957700 1 -- 172.21.15.8:0/3017571925 shutdown_connections 2023-10-18T21:51:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.038+0000 7f278a957700 1 --2- 172.21.15.8:0/3017571925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27840f77d0 0x7f27840f7c30 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.038+0000 7f278a957700 1 --2- 172.21.15.8:0/3017571925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840f6530 0x7f27840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.038+0000 7f278a957700 1 -- 172.21.15.8:0/3017571925 >> 172.21.15.8:0/3017571925 conn(0x7f27840f1c90 msgr2=0x7f27840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.038+0000 7f278a957700 1 -- 172.21.15.8:0/3017571925 shutdown_connections 2023-10-18T21:51:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.038+0000 7f278a957700 1 -- 172.21.15.8:0/3017571925 wait complete. 2023-10-18T21:51:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.039+0000 7f278a957700 1 Processor -- start 2023-10-18T21:51:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.039+0000 7f278a957700 1 -- start start 2023-10-18T21:51:20.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.040+0000 7f278a957700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840f6530 0x7f2784108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:20.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.040+0000 7f278a957700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27840f77d0 0x7f27841093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:20.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.040+0000 7f278a957700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784109970 con 0x7f27840f77d0 2023-10-18T21:51:20.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.040+0000 7f278a957700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784109ab0 con 0x7f27840f6530 2023-10-18T21:51:20.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.040+0000 7f2789154700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27840f77d0 0x7f27841093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.040+0000 7f2789955700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840f6530 0x7f2784108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.040+0000 7f2789955700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840f6530 0x7f2784108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:42728/0 (socket says 172.21.15.8:42728) 2023-10-18T21:51:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.040+0000 7f2789955700 1 -- 172.21.15.8:0/1819131517 learned_addr learned my addr 172.21.15.8:0/1819131517 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.041+0000 7f2789154700 1 -- 172.21.15.8:0/1819131517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840f6530 msgr2=0x7f2784108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.041+0000 7f2789154700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840f6530 0x7f2784108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.041+0000 7f2789154700 1 -- 172.21.15.8:0/1819131517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2774005040 con 0x7f27840f77d0 2023-10-18T21:51:20.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.041+0000 7f2789955700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840f6530 0x7f2784108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:51:20.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.041+0000 7f2789154700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27840f77d0 0x7f27841093c0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f2774011000 tx=0x7f277400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:20.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.041+0000 7f277a7fc700 1 -- 172.21.15.8:0/1819131517 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2774019070 con 0x7f27840f77d0 2023-10-18T21:51:20.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.041+0000 7f277a7fc700 1 -- 172.21.15.8:0/1819131517 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2774013e70 con 0x7f27840f77d0 2023-10-18T21:51:20.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.041+0000 7f278a957700 1 -- 172.21.15.8:0/1819131517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278410a3f0 con 0x7f27840f77d0 2023-10-18T21:51:20.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.041+0000 7f277a7fc700 1 -- 172.21.15.8:0/1819131517 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2774014d30 con 0x7f27840f77d0 2023-10-18T21:51:20.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.041+0000 7f278a957700 1 -- 172.21.15.8:0/1819131517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278410a8d0 con 0x7f27840f77d0 2023-10-18T21:51:20.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.042+0000 7f278a957700 1 -- 172.21.15.8:0/1819131517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2784045ad0 con 0x7f27840f77d0 2023-10-18T21:51:20.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.043+0000 7f277a7fc700 1 -- 172.21.15.8:0/1819131517 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2774014420 con 0x7f27840f77d0 2023-10-18T21:51:20.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.044+0000 7f277a7fc700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2770060f70 0x7f2770063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:20.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.044+0000 7f277a7fc700 1 -- 172.21.15.8:0/1819131517 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f277407dd20 con 0x7f27840f77d0 2023-10-18T21:51:20.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.044+0000 7f2789955700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2770060f70 0x7f2770063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:20.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.045+0000 7f2789955700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2770060f70 0x7f2770063430 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f27800041d0 tx=0x7f278000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:20.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.048+0000 7f277a7fc700 1 -- 172.21.15.8:0/1819131517 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2774051440 con 0x7f27840f77d0 2023-10-18T21:51:20.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.242+0000 7f278a957700 1 -- 172.21.15.8:0/1819131517 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f27840fedd0 con 0x7f2770060f70 2023-10-18T21:51:20.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.251+0000 7f277a7fc700 1 -- 172.21.15.8:0/1819131517 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f27840fedd0 con 0x7f2770060f70 2023-10-18T21:51:20.254 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:51:20.254 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (58m) 5m ago 59m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:51:20.255 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (51m) 5m ago 59m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:51:20.255 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (51m) 3m ago 58m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:51:20.256 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (57m) 5m ago 59m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:51:20.256 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 55m - - 2023-10-18T21:51:20.256 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 55m - - 2023-10-18T21:51:20.257 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 55m - - 2023-10-18T21:51:20.257 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 55m - - 2023-10-18T21:51:20.257 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (53m) 5m ago 60m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:51:20.258 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (52m) 3m ago 58m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:51:20.258 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (52m) 5m ago 60m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:51:20.258 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (52m) 3m ago 58m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:51:20.259 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (58m) 5m ago 58m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:51:20.259 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (58m) 3m ago 58m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:51:20.259 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (51m) 5m ago 58m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:51:20.260 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (49m) 5m ago 57m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:51:20.260 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (49m) 5m ago 57m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:51:20.260 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (48m) 3m ago 57m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:51:20.261 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (47m) 3m ago 56m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:51:20.261 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (47m) 3m ago 56m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:51:20.262 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (53m) 5m ago 58m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:51:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 -- 172.21.15.8:0/1819131517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2770060f70 msgr2=0x7f2770063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2770060f70 0x7f2770063430 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f27800041d0 tx=0x7f278000b040).stop 2023-10-18T21:51:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 -- 172.21.15.8:0/1819131517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27840f77d0 msgr2=0x7f27841093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27840f77d0 0x7f27841093c0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f2774011000 tx=0x7f277400b040).stop 2023-10-18T21:51:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 -- 172.21.15.8:0/1819131517 shutdown_connections 2023-10-18T21:51:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2770060f70 0x7f2770063430 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840f6530 0x7f2784108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 --2- 172.21.15.8:0/1819131517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27840f77d0 0x7f27841093c0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 -- 172.21.15.8:0/1819131517 >> 172.21.15.8:0/1819131517 conn(0x7f27840f1c90 msgr2=0x7f27840f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:20.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 -- 172.21.15.8:0/1819131517 shutdown_connections 2023-10-18T21:51:20.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.253+0000 7f278a957700 1 -- 172.21.15.8:0/1819131517 wait complete. 2023-10-18T21:51:20.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.388+0000 7f679e8ed700 1 -- 172.21.15.8:0/1252951586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67980f8740 msgr2=0x7f67980f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:20.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.388+0000 7f679e8ed700 1 --2- 172.21.15.8:0/1252951586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67980f8740 0x7f67980f8b60 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f6794004660 tx=0x7f6794009b30).stop 2023-10-18T21:51:20.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.388+0000 7f679e8ed700 1 -- 172.21.15.8:0/1252951586 shutdown_connections 2023-10-18T21:51:20.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.388+0000 7f679e8ed700 1 --2- 172.21.15.8:0/1252951586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67980f99e0 0x7f67980f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.388+0000 7f679e8ed700 1 --2- 172.21.15.8:0/1252951586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67980f8740 0x7f67980f8b60 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.388+0000 7f679e8ed700 1 -- 172.21.15.8:0/1252951586 >> 172.21.15.8:0/1252951586 conn(0x7f67980f40e0 msgr2=0x7f67980f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:20.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.388+0000 7f679e8ed700 1 -- 172.21.15.8:0/1252951586 shutdown_connections 2023-10-18T21:51:20.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.389+0000 7f679e8ed700 1 -- 172.21.15.8:0/1252951586 wait complete. 2023-10-18T21:51:20.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.389+0000 7f679e8ed700 1 Processor -- start 2023-10-18T21:51:20.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.389+0000 7f679e8ed700 1 -- start start 2023-10-18T21:51:20.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679e8ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67980f8740 0x7f6798108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:20.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679e8ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67980f99e0 0x7f6798109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:20.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679e8ed700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67981099f0 con 0x7f67980f8740 2023-10-18T21:51:20.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679e8ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6798109b30 con 0x7f67980f99e0 2023-10-18T21:51:20.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679d8eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67980f8740 0x7f6798108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:20.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679d8eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67980f8740 0x7f6798108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42930/0 (socket says 172.21.15.8:42930) 2023-10-18T21:51:20.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679d8eb700 1 -- 172.21.15.8:0/3269864568 learned_addr learned my addr 172.21.15.8:0/3269864568 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:20.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679d0ea700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67980f99e0 0x7f6798109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:20.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679d8eb700 1 -- 172.21.15.8:0/3269864568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67980f99e0 msgr2=0x7f6798109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:20.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679d8eb700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67980f99e0 0x7f6798109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.390+0000 7f679d8eb700 1 -- 172.21.15.8:0/3269864568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6794005040 con 0x7f67980f8740 2023-10-18T21:51:20.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.391+0000 7f679d8eb700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67980f8740 0x7f6798108f50 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f6794009870 tx=0x7f679400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:20.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.391+0000 7f678e7fc700 1 -- 172.21.15.8:0/3269864568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6794019070 con 0x7f67980f8740 2023-10-18T21:51:20.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.391+0000 7f678e7fc700 1 -- 172.21.15.8:0/3269864568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f679401e420 con 0x7f67980f8740 2023-10-18T21:51:20.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.391+0000 7f678e7fc700 1 -- 172.21.15.8:0/3269864568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6794014660 con 0x7f67980f8740 2023-10-18T21:51:20.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.391+0000 7f679e8ed700 1 -- 172.21.15.8:0/3269864568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679810a470 con 0x7f67980f8740 2023-10-18T21:51:20.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.391+0000 7f679e8ed700 1 -- 172.21.15.8:0/3269864568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679810a950 con 0x7f67980f8740 2023-10-18T21:51:20.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.392+0000 7f679e8ed700 1 -- 172.21.15.8:0/3269864568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6798045ad0 con 0x7f67980f8740 2023-10-18T21:51:20.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.393+0000 7f678e7fc700 1 -- 172.21.15.8:0/3269864568 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f679401e9c0 con 0x7f67980f8740 2023-10-18T21:51:20.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.394+0000 7f678e7fc700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6784060f70 0x7f6784063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:20.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.394+0000 7f678e7fc700 1 -- 172.21.15.8:0/3269864568 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f679407dd80 con 0x7f67980f8740 2023-10-18T21:51:20.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.394+0000 7f679d0ea700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6784060f70 0x7f6784063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:20.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.395+0000 7f679d0ea700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6784060f70 0x7f6784063430 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f6788007f80 tx=0x7f678800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:20.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.398+0000 7f678e7fc700 1 -- 172.21.15.8:0/3269864568 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f67940513e0 con 0x7f67980f8740 2023-10-18T21:51:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:18.199715+0000 mgr.smithi008.flmjzp (mgr.14640) 3145 : cluster [DBG] pgmap v2165: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:18.224183+0000 mgr.smithi008.flmjzp (mgr.14640) 3146 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:51:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:18.224766+0000 mgr.smithi008.flmjzp (mgr.14640) 3147 : cluster [DBG] pgmap v2166: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:18.225111+0000 mgr.smithi008.flmjzp (mgr.14640) 3148 : cluster [DBG] pgmap v2167: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:18.248977+0000 mgr.smithi008.flmjzp (mgr.14640) 3149 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:18.199715+0000 mgr.smithi008.flmjzp (mgr.14640) 3145 : cluster [DBG] pgmap v2165: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:18.224183+0000 mgr.smithi008.flmjzp (mgr.14640) 3146 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:51:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:18.224766+0000 mgr.smithi008.flmjzp (mgr.14640) 3147 : cluster [DBG] pgmap v2166: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:18.225111+0000 mgr.smithi008.flmjzp (mgr.14640) 3148 : cluster [DBG] pgmap v2167: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:18.248977+0000 mgr.smithi008.flmjzp (mgr.14640) 3149 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:20.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.649+0000 7f679e8ed700 1 -- 172.21.15.8:0/3269864568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6798100fe0 con 0x7f67980f8740 2023-10-18T21:51:20.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.650+0000 7f678e7fc700 1 -- 172.21.15.8:0/3269864568 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f6794050fd0 con 0x7f67980f8740 2023-10-18T21:51:20.652 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:51:20.652 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:51:20.652 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:51:20.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:51:20.653 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:51:20.653 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:51:20.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:51:20.654 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:51:20.654 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:51:20.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:51:20.654 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:51:20.654 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:51:20.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:51:20.655 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:51:20.655 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:51:20.655 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:51:20.655 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:51:20.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.651+0000 7f679e8ed700 1 -- 172.21.15.8:0/3269864568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6784060f70 msgr2=0x7f6784063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:20.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.651+0000 7f679e8ed700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6784060f70 0x7f6784063430 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f6788007f80 tx=0x7f678800b040).stop 2023-10-18T21:51:20.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.651+0000 7f679e8ed700 1 -- 172.21.15.8:0/3269864568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67980f8740 msgr2=0x7f6798108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:20.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.651+0000 7f679e8ed700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67980f8740 0x7f6798108f50 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f6794009870 tx=0x7f679400b040).stop 2023-10-18T21:51:20.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.652+0000 7f679e8ed700 1 -- 172.21.15.8:0/3269864568 shutdown_connections 2023-10-18T21:51:20.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.652+0000 7f679e8ed700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6784060f70 0x7f6784063430 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.652+0000 7f679e8ed700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67980f8740 0x7f6798108f50 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.652+0000 7f679e8ed700 1 --2- 172.21.15.8:0/3269864568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67980f99e0 0x7f6798109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.652+0000 7f679e8ed700 1 -- 172.21.15.8:0/3269864568 >> 172.21.15.8:0/3269864568 conn(0x7f67980f40e0 msgr2=0x7f67980fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:20.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.652+0000 7f679e8ed700 1 -- 172.21.15.8:0/3269864568 shutdown_connections 2023-10-18T21:51:20.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.652+0000 7f679e8ed700 1 -- 172.21.15.8:0/3269864568 wait complete. 2023-10-18T21:51:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.792+0000 7f2b30c0a700 1 -- 172.21.15.8:0/2521155641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b2c0f7750 msgr2=0x7f2b2c0f7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.792+0000 7f2b30c0a700 1 --2- 172.21.15.8:0/2521155641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b2c0f7750 0x7f2b2c0f7bb0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f2b20004660 tx=0x7f2b20009b30).stop 2023-10-18T21:51:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.792+0000 7f2b30c0a700 1 -- 172.21.15.8:0/2521155641 shutdown_connections 2023-10-18T21:51:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.792+0000 7f2b30c0a700 1 --2- 172.21.15.8:0/2521155641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b2c0f7750 0x7f2b2c0f7bb0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.792+0000 7f2b30c0a700 1 --2- 172.21.15.8:0/2521155641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b2c0f64b0 0x7f2b2c0f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.792+0000 7f2b30c0a700 1 -- 172.21.15.8:0/2521155641 >> 172.21.15.8:0/2521155641 conn(0x7f2b2c0f1c30 msgr2=0x7f2b2c0f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.792+0000 7f2b30c0a700 1 -- 172.21.15.8:0/2521155641 shutdown_connections 2023-10-18T21:51:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.792+0000 7f2b30c0a700 1 -- 172.21.15.8:0/2521155641 wait complete. 2023-10-18T21:51:20.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.793+0000 7f2b30c0a700 1 Processor -- start 2023-10-18T21:51:20.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.793+0000 7f2b30c0a700 1 -- start start 2023-10-18T21:51:20.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.793+0000 7f2b30c0a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b2c0f64b0 0x7f2b2c108e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.793+0000 7f2b30c0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b2c0f7750 0x7f2b2c109360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.793+0000 7f2b30c0a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c109910 con 0x7f2b2c0f64b0 2023-10-18T21:51:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.793+0000 7f2b30c0a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c109a50 con 0x7f2b2c0f7750 2023-10-18T21:51:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.793+0000 7f2b2b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b2c0f64b0 0x7f2b2c108e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.793+0000 7f2b2b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b2c0f64b0 0x7f2b2c108e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42954/0 (socket says 172.21.15.8:42954) 2023-10-18T21:51:20.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.793+0000 7f2b2b7fe700 1 -- 172.21.15.8:0/1858813104 learned_addr learned my addr 172.21.15.8:0/1858813104 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:20.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.794+0000 7f2b2affd700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b2c0f7750 0x7f2b2c109360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:20.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.794+0000 7f2b2b7fe700 1 -- 172.21.15.8:0/1858813104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b2c0f7750 msgr2=0x7f2b2c109360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:20.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.794+0000 7f2b2b7fe700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b2c0f7750 0x7f2b2c109360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:20.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.794+0000 7f2b2b7fe700 1 -- 172.21.15.8:0/1858813104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20005040 con 0x7f2b2c0f64b0 2023-10-18T21:51:20.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.794+0000 7f2b2b7fe700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b2c0f64b0 0x7f2b2c108e70 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f2b1c00e7c0 tx=0x7f2b1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:20.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.794+0000 7f2b13fff700 1 -- 172.21.15.8:0/1858813104 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b1c0092e0 con 0x7f2b2c0f64b0 2023-10-18T21:51:20.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.794+0000 7f2b30c0a700 1 -- 172.21.15.8:0/1858813104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c10a3f0 con 0x7f2b2c0f64b0 2023-10-18T21:51:20.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.794+0000 7f2b13fff700 1 -- 172.21.15.8:0/1858813104 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2b1c00f040 con 0x7f2b2c0f64b0 2023-10-18T21:51:20.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.794+0000 7f2b13fff700 1 -- 172.21.15.8:0/1858813104 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b1c014850 con 0x7f2b2c0f64b0 2023-10-18T21:51:20.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.795+0000 7f2b30c0a700 1 -- 172.21.15.8:0/1858813104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c10a930 con 0x7f2b2c0f64b0 2023-10-18T21:51:20.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.796+0000 7f2b30c0a700 1 -- 172.21.15.8:0/1858813104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c045ad0 con 0x7f2b2c0f64b0 2023-10-18T21:51:20.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.797+0000 7f2b13fff700 1 -- 172.21.15.8:0/1858813104 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2b1c01b030 con 0x7f2b2c0f64b0 2023-10-18T21:51:20.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.797+0000 7f2b13fff700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b14060f70 0x7f2b14063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:20.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.797+0000 7f2b13fff700 1 -- 172.21.15.8:0/1858813104 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2b1c07c8d0 con 0x7f2b2c0f64b0 2023-10-18T21:51:20.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.798+0000 7f2b2affd700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b14060f70 0x7f2b14063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:20.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.798+0000 7f2b2affd700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b14060f70 0x7f2b14063430 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f2b20009720 tx=0x7f2b20016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:20.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:20.802+0000 7f2b13fff700 1 -- 172.21.15.8:0/1858813104 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2b1c04ff10 con 0x7f2b2c0f64b0 2023-10-18T21:51:21.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.029+0000 7f2b30c0a700 1 -- 172.21.15.8:0/1858813104 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2b2c0fed10 con 0x7f2b2c0f64b0 2023-10-18T21:51:21.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.030+0000 7f2b13fff700 1 -- 172.21.15.8:0/1858813104 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f2b1c019030 con 0x7f2b2c0f64b0 2023-10-18T21:51:21.032 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:51:21.033 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:51:21.033 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:51:21.033 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:51:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:51:21.033 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:51:21.034 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:51:21.034 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:51:21.034 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:51:21.034 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:51:21.035 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:51:21.035 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:51:21.035 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:51:21.035 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:51:21.035 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:51:21.035 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:51:21.036 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:51:21.036 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:51:21.036 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:51:21.036 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:51:21.036 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:51:21.037 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:51:21.037 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:51:21.037 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:51:21.037 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:51:21.037 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:51:21.038 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:51:21.038 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:51:21.038 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:51:21.039 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:51:21.039 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:51:21.039 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:51:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:51:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:51:21.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 -- 172.21.15.8:0/1858813104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b14060f70 msgr2=0x7f2b14063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:21.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b14060f70 0x7f2b14063430 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f2b20009720 tx=0x7f2b20016040).stop 2023-10-18T21:51:21.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 -- 172.21.15.8:0/1858813104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b2c0f64b0 msgr2=0x7f2b2c108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:21.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b2c0f64b0 0x7f2b2c108e70 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f2b1c00e7c0 tx=0x7f2b1c00b040).stop 2023-10-18T21:51:21.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 -- 172.21.15.8:0/1858813104 shutdown_connections 2023-10-18T21:51:21.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b14060f70 0x7f2b14063430 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:21.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b2c0f64b0 0x7f2b2c108e70 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:21.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 --2- 172.21.15.8:0/1858813104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b2c0f7750 0x7f2b2c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:21.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 -- 172.21.15.8:0/1858813104 >> 172.21.15.8:0/1858813104 conn(0x7f2b2c0f1c30 msgr2=0x7f2b2c0f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:21.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 -- 172.21.15.8:0/1858813104 shutdown_connections 2023-10-18T21:51:21.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.032+0000 7f2b30c0a700 1 -- 172.21.15.8:0/1858813104 wait complete. 2023-10-18T21:51:21.042 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:51:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.177+0000 7fea1759e700 1 -- 172.21.15.8:0/1414853583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea180f77d0 msgr2=0x7fea180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:21.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.177+0000 7fea1759e700 1 --2- 172.21.15.8:0/1414853583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea180f77d0 0x7fea180f7c30 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7fea0c004660 tx=0x7fea0c009b30).stop 2023-10-18T21:51:21.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.178+0000 7fea1759e700 1 -- 172.21.15.8:0/1414853583 shutdown_connections 2023-10-18T21:51:21.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.178+0000 7fea1759e700 1 --2- 172.21.15.8:0/1414853583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea180f77d0 0x7fea180f7c30 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:21.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.178+0000 7fea1759e700 1 --2- 172.21.15.8:0/1414853583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea180f6530 0x7fea180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:21.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.178+0000 7fea1759e700 1 -- 172.21.15.8:0/1414853583 >> 172.21.15.8:0/1414853583 conn(0x7fea180f1c90 msgr2=0x7fea180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:21.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.178+0000 7fea1759e700 1 -- 172.21.15.8:0/1414853583 shutdown_connections 2023-10-18T21:51:21.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.178+0000 7fea1759e700 1 -- 172.21.15.8:0/1414853583 wait complete. 2023-10-18T21:51:21.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.178+0000 7fea1759e700 1 Processor -- start 2023-10-18T21:51:21.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.179+0000 7fea1759e700 1 -- start start 2023-10-18T21:51:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.179+0000 7fea1759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea180f6530 0x7fea18108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.179+0000 7fea1759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea180f77d0 0x7fea181093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.179+0000 7fea1759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea181099a0 con 0x7fea180f6530 2023-10-18T21:51:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.179+0000 7fea1759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18109ae0 con 0x7fea180f77d0 2023-10-18T21:51:21.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.179+0000 7fea1659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea180f6530 0x7fea18108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.179+0000 7fea1659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea180f6530 0x7fea18108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42968/0 (socket says 172.21.15.8:42968) 2023-10-18T21:51:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.179+0000 7fea1659c700 1 -- 172.21.15.8:0/327007930 learned_addr learned my addr 172.21.15.8:0/327007930 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.179+0000 7fea15d9b700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea180f77d0 0x7fea181093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.180+0000 7fea1659c700 1 -- 172.21.15.8:0/327007930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea180f77d0 msgr2=0x7fea181093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:21.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.180+0000 7fea1659c700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea180f77d0 0x7fea181093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:21.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.180+0000 7fea1659c700 1 -- 172.21.15.8:0/327007930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c005040 con 0x7fea180f6530 2023-10-18T21:51:21.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.180+0000 7fea15d9b700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea180f77d0 0x7fea181093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:51:21.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.180+0000 7fea1659c700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea180f6530 0x7fea18108f00 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7fea0800e7c0 tx=0x7fea0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:21.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.180+0000 7fea06ffd700 1 -- 172.21.15.8:0/327007930 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea080092e0 con 0x7fea180f6530 2023-10-18T21:51:21.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.180+0000 7fea06ffd700 1 -- 172.21.15.8:0/327007930 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fea0800f040 con 0x7fea180f6530 2023-10-18T21:51:21.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.180+0000 7fea1759e700 1 -- 172.21.15.8:0/327007930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1810a480 con 0x7fea180f6530 2023-10-18T21:51:21.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.180+0000 7fea06ffd700 1 -- 172.21.15.8:0/327007930 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea080147e0 con 0x7fea180f6530 2023-10-18T21:51:21.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.180+0000 7fea1759e700 1 -- 172.21.15.8:0/327007930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1810a9c0 con 0x7fea180f6530 2023-10-18T21:51:21.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.182+0000 7fea1759e700 1 -- 172.21.15.8:0/327007930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea18045ad0 con 0x7fea180f6530 2023-10-18T21:51:21.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.182+0000 7fea06ffd700 1 -- 172.21.15.8:0/327007930 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fea0801b030 con 0x7fea180f6530 2023-10-18T21:51:21.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.183+0000 7fea06ffd700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea00060f70 0x7fea00063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:21.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.183+0000 7fea06ffd700 1 -- 172.21.15.8:0/327007930 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fea0807ca70 con 0x7fea180f6530 2023-10-18T21:51:21.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.183+0000 7fea15d9b700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea00060f70 0x7fea00063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:21.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.184+0000 7fea15d9b700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea00060f70 0x7fea00063430 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fea0c0043d0 tx=0x7fea0c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:21.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.187+0000 7fea06ffd700 1 -- 172.21.15.8:0/327007930 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fea08050050 con 0x7fea180f6530 2023-10-18T21:51:21.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.384+0000 7fea1759e700 1 -- 172.21.15.8:0/327007930 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea1810abe0 con 0x7fea00060f70 2023-10-18T21:51:21.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.385+0000 7fea06ffd700 1 -- 172.21.15.8:0/327007930 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fea1810abe0 con 0x7fea00060f70 2023-10-18T21:51:21.388 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:51:21.388 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:51:21.388 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:51:21.389 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:51:21.389 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:51:21.389 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:51:21.390 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:51:21.390 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:51:21.390 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:51:21.391 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:51:21.391 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:51:21.391 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:51:21.392 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:51:21.392 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:51:21.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 -- 172.21.15.8:0/327007930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea00060f70 msgr2=0x7fea00063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:21.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea00060f70 0x7fea00063430 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fea0c0043d0 tx=0x7fea0c00b040).stop 2023-10-18T21:51:21.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 -- 172.21.15.8:0/327007930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea180f6530 msgr2=0x7fea18108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:21.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea180f6530 0x7fea18108f00 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7fea0800e7c0 tx=0x7fea0800b040).stop 2023-10-18T21:51:21.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 -- 172.21.15.8:0/327007930 shutdown_connections 2023-10-18T21:51:21.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea00060f70 0x7fea00063430 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:21.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea180f6530 0x7fea18108f00 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:21.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 --2- 172.21.15.8:0/327007930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea180f77d0 0x7fea181093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:21.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 -- 172.21.15.8:0/327007930 >> 172.21.15.8:0/327007930 conn(0x7fea180f1c90 msgr2=0x7fea1806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:21.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 -- 172.21.15.8:0/327007930 shutdown_connections 2023-10-18T21:51:21.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:21.387+0000 7fea1759e700 1 -- 172.21.15.8:0/327007930 wait complete. 2023-10-18T21:51:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:19.555312+0000 mgr.smithi008.flmjzp (mgr.14640) 3150 : audit [DBG] from='client.36616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:19.901431+0000 mgr.smithi008.flmjzp (mgr.14640) 3151 : audit [DBG] from='client.36620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:20.651137+0000 mon.smithi008 (mon.0) 3527 : audit [DBG] from='client.? 172.21.15.8:0/3269864568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:21.031467+0000 mon.smithi008 (mon.0) 3528 : audit [DBG] from='client.? 172.21.15.8:0/1858813104' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:51:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:19.555312+0000 mgr.smithi008.flmjzp (mgr.14640) 3150 : audit [DBG] from='client.36616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:19.901431+0000 mgr.smithi008.flmjzp (mgr.14640) 3151 : audit [DBG] from='client.36620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:20.651137+0000 mon.smithi008 (mon.0) 3527 : audit [DBG] from='client.? 172.21.15.8:0/3269864568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:21.031467+0000 mon.smithi008 (mon.0) 3528 : audit [DBG] from='client.? 172.21.15.8:0/1858813104' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:51:22.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:20.225594+0000 mgr.smithi008.flmjzp (mgr.14640) 3152 : cluster [DBG] pgmap v2168: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:22.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:20.244341+0000 mgr.smithi008.flmjzp (mgr.14640) 3153 : audit [DBG] from='client.36624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:20.225594+0000 mgr.smithi008.flmjzp (mgr.14640) 3152 : cluster [DBG] pgmap v2168: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:20.244341+0000 mgr.smithi008.flmjzp (mgr.14640) 3153 : audit [DBG] from='client.36624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:21.386334+0000 mgr.smithi008.flmjzp (mgr.14640) 3154 : audit [DBG] from='client.36636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:21.386334+0000 mgr.smithi008.flmjzp (mgr.14640) 3154 : audit [DBG] from='client.36636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:24.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:22.226322+0000 mgr.smithi008.flmjzp (mgr.14640) 3155 : cluster [DBG] pgmap v2169: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:24.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:22.226322+0000 mgr.smithi008.flmjzp (mgr.14640) 3155 : cluster [DBG] pgmap v2169: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:24.227001+0000 mgr.smithi008.flmjzp (mgr.14640) 3156 : cluster [DBG] pgmap v2170: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:26.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:24.227001+0000 mgr.smithi008.flmjzp (mgr.14640) 3156 : cluster [DBG] pgmap v2170: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:28.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:26.227675+0000 mgr.smithi008.flmjzp (mgr.14640) 3157 : cluster [DBG] pgmap v2171: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:28.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:26.227675+0000 mgr.smithi008.flmjzp (mgr.14640) 3157 : cluster [DBG] pgmap v2171: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:28.253089+0000 mon.smithi008 (mon.0) 3529 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:28.812977+0000 mon.smithi008 (mon.0) 3530 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:28.814183+0000 mon.smithi008 (mon.0) 3531 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:28.821278+0000 mon.smithi008 (mon.0) 3532 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:28.829182+0000 mon.smithi008 (mon.0) 3533 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:28.832797+0000 mon.smithi008 (mon.0) 3534 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:28.834819+0000 mon.smithi008 (mon.0) 3535 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:28.836435+0000 mon.smithi008 (mon.0) 3536 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:29.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:28.838501+0000 mon.smithi008 (mon.0) 3537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:28.253089+0000 mon.smithi008 (mon.0) 3529 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:28.812977+0000 mon.smithi008 (mon.0) 3530 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:28.814183+0000 mon.smithi008 (mon.0) 3531 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:28.821278+0000 mon.smithi008 (mon.0) 3532 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:28.829182+0000 mon.smithi008 (mon.0) 3533 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:28.832797+0000 mon.smithi008 (mon.0) 3534 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:28.834819+0000 mon.smithi008 (mon.0) 3535 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:28.836435+0000 mon.smithi008 (mon.0) 3536 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:29.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:28.838501+0000 mon.smithi008 (mon.0) 3537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:28.228475+0000 mgr.smithi008.flmjzp (mgr.14640) 3158 : cluster [DBG] pgmap v2172: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:28.815142+0000 mgr.smithi008.flmjzp (mgr.14640) 3159 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:51:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:28.816022+0000 mgr.smithi008.flmjzp (mgr.14640) 3160 : cluster [DBG] pgmap v2173: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:28.816383+0000 mgr.smithi008.flmjzp (mgr.14640) 3161 : cluster [DBG] pgmap v2174: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:28.840421+0000 mgr.smithi008.flmjzp (mgr.14640) 3162 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:28.228475+0000 mgr.smithi008.flmjzp (mgr.14640) 3158 : cluster [DBG] pgmap v2172: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:28.815142+0000 mgr.smithi008.flmjzp (mgr.14640) 3159 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:51:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:28.816022+0000 mgr.smithi008.flmjzp (mgr.14640) 3160 : cluster [DBG] pgmap v2173: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:28.816383+0000 mgr.smithi008.flmjzp (mgr.14640) 3161 : cluster [DBG] pgmap v2174: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:28.840421+0000 mgr.smithi008.flmjzp (mgr.14640) 3162 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:30.816961+0000 mgr.smithi008.flmjzp (mgr.14640) 3163 : cluster [DBG] pgmap v2175: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:30.816961+0000 mgr.smithi008.flmjzp (mgr.14640) 3163 : cluster [DBG] pgmap v2175: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:32.817542+0000 mgr.smithi008.flmjzp (mgr.14640) 3164 : cluster [DBG] pgmap v2176: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:32.817542+0000 mgr.smithi008.flmjzp (mgr.14640) 3164 : cluster [DBG] pgmap v2176: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:36.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:34.818068+0000 mgr.smithi008.flmjzp (mgr.14640) 3165 : cluster [DBG] pgmap v2177: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:34.818068+0000 mgr.smithi008.flmjzp (mgr.14640) 3165 : cluster [DBG] pgmap v2177: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:36.818753+0000 mgr.smithi008.flmjzp (mgr.14640) 3166 : cluster [DBG] pgmap v2178: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:38.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:36.818753+0000 mgr.smithi008.flmjzp (mgr.14640) 3166 : cluster [DBG] pgmap v2178: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:38.843167+0000 mon.smithi008 (mon.0) 3538 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:38.845347+0000 mon.smithi008 (mon.0) 3539 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:38.846318+0000 mon.smithi008 (mon.0) 3540 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:38.852845+0000 mon.smithi008 (mon.0) 3541 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:38.859202+0000 mon.smithi008 (mon.0) 3542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:39.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:38.862229+0000 mon.smithi008 (mon.0) 3543 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:39.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:38.863873+0000 mon.smithi008 (mon.0) 3544 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:39.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:38.865463+0000 mon.smithi008 (mon.0) 3545 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:39.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:38.867475+0000 mon.smithi008 (mon.0) 3546 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:38.843167+0000 mon.smithi008 (mon.0) 3538 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:38.845347+0000 mon.smithi008 (mon.0) 3539 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:38.846318+0000 mon.smithi008 (mon.0) 3540 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:38.852845+0000 mon.smithi008 (mon.0) 3541 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:38.859202+0000 mon.smithi008 (mon.0) 3542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:39.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:38.862229+0000 mon.smithi008 (mon.0) 3543 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:39.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:38.863873+0000 mon.smithi008 (mon.0) 3544 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:39.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:38.865463+0000 mon.smithi008 (mon.0) 3545 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:39.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:38.867475+0000 mon.smithi008 (mon.0) 3546 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:40.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:38.819341+0000 mgr.smithi008.flmjzp (mgr.14640) 3167 : cluster [DBG] pgmap v2179: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:40.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:38.847155+0000 mgr.smithi008.flmjzp (mgr.14640) 3168 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:51:40.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:38.847752+0000 mgr.smithi008.flmjzp (mgr.14640) 3169 : cluster [DBG] pgmap v2180: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:40.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:38.848126+0000 mgr.smithi008.flmjzp (mgr.14640) 3170 : cluster [DBG] pgmap v2181: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:40.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:38.869403+0000 mgr.smithi008.flmjzp (mgr.14640) 3171 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:40.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:38.819341+0000 mgr.smithi008.flmjzp (mgr.14640) 3167 : cluster [DBG] pgmap v2179: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:38.847155+0000 mgr.smithi008.flmjzp (mgr.14640) 3168 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:51:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:38.847752+0000 mgr.smithi008.flmjzp (mgr.14640) 3169 : cluster [DBG] pgmap v2180: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:38.848126+0000 mgr.smithi008.flmjzp (mgr.14640) 3170 : cluster [DBG] pgmap v2181: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:40.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:38.869403+0000 mgr.smithi008.flmjzp (mgr.14640) 3171 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:40.848641+0000 mgr.smithi008.flmjzp (mgr.14640) 3172 : cluster [DBG] pgmap v2182: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:42.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:40.848641+0000 mgr.smithi008.flmjzp (mgr.14640) 3172 : cluster [DBG] pgmap v2182: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:42.849323+0000 mgr.smithi008.flmjzp (mgr.14640) 3173 : cluster [DBG] pgmap v2183: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:42.849323+0000 mgr.smithi008.flmjzp (mgr.14640) 3173 : cluster [DBG] pgmap v2183: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:44.850107+0000 mgr.smithi008.flmjzp (mgr.14640) 3174 : cluster [DBG] pgmap v2184: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:46.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:44.850107+0000 mgr.smithi008.flmjzp (mgr.14640) 3174 : cluster [DBG] pgmap v2184: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:48.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:46.850806+0000 mgr.smithi008.flmjzp (mgr.14640) 3175 : cluster [DBG] pgmap v2185: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:48.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:46.850806+0000 mgr.smithi008.flmjzp (mgr.14640) 3175 : cluster [DBG] pgmap v2185: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:48.870370+0000 mon.smithi008 (mon.0) 3547 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:48.872326+0000 mon.smithi008 (mon.0) 3548 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:48.873244+0000 mon.smithi008 (mon.0) 3549 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:48.879306+0000 mon.smithi008 (mon.0) 3550 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:48.885207+0000 mon.smithi008 (mon.0) 3551 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:49.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:48.888152+0000 mon.smithi008 (mon.0) 3552 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:48.889687+0000 mon.smithi008 (mon.0) 3553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:48.891156+0000 mon.smithi008 (mon.0) 3554 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:49.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:48.893038+0000 mon.smithi008 (mon.0) 3555 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:48.870370+0000 mon.smithi008 (mon.0) 3547 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:48.872326+0000 mon.smithi008 (mon.0) 3548 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:48.873244+0000 mon.smithi008 (mon.0) 3549 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:48.879306+0000 mon.smithi008 (mon.0) 3550 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:48.885207+0000 mon.smithi008 (mon.0) 3551 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:48.888152+0000 mon.smithi008 (mon.0) 3552 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:48.889687+0000 mon.smithi008 (mon.0) 3553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:48.891156+0000 mon.smithi008 (mon.0) 3554 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:49.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:48.893038+0000 mon.smithi008 (mon.0) 3555 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:50.204 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:48.851396+0000 mgr.smithi008.flmjzp (mgr.14640) 3176 : cluster [DBG] pgmap v2186: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:50.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:48.874102+0000 mgr.smithi008.flmjzp (mgr.14640) 3177 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:51:50.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:48.874642+0000 mgr.smithi008.flmjzp (mgr.14640) 3178 : cluster [DBG] pgmap v2187: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:50.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:48.874856+0000 mgr.smithi008.flmjzp (mgr.14640) 3179 : cluster [DBG] pgmap v2188: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:50.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:48.895008+0000 mgr.smithi008.flmjzp (mgr.14640) 3180 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:48.851396+0000 mgr.smithi008.flmjzp (mgr.14640) 3176 : cluster [DBG] pgmap v2186: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:48.874102+0000 mgr.smithi008.flmjzp (mgr.14640) 3177 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:51:50.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:48.874642+0000 mgr.smithi008.flmjzp (mgr.14640) 3178 : cluster [DBG] pgmap v2187: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:50.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:48.874856+0000 mgr.smithi008.flmjzp (mgr.14640) 3179 : cluster [DBG] pgmap v2188: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:50.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:48.895008+0000 mgr.smithi008.flmjzp (mgr.14640) 3180 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:51:51.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.542+0000 7f3a5b59e700 1 -- 172.21.15.8:0/3371867256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a5c0f77d0 msgr2=0x7f3a5c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:51.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.542+0000 7f3a5b59e700 1 --2- 172.21.15.8:0/3371867256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a5c0f77d0 0x7f3a5c0f7c30 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f3a50004660 tx=0x7f3a50009b30).stop 2023-10-18T21:51:51.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.543+0000 7f3a5b59e700 1 -- 172.21.15.8:0/3371867256 shutdown_connections 2023-10-18T21:51:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.543+0000 7f3a5b59e700 1 --2- 172.21.15.8:0/3371867256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a5c0f77d0 0x7f3a5c0f7c30 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.543+0000 7f3a5b59e700 1 --2- 172.21.15.8:0/3371867256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0f6530 0x7f3a5c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.543+0000 7f3a5b59e700 1 -- 172.21.15.8:0/3371867256 >> 172.21.15.8:0/3371867256 conn(0x7f3a5c0f1c90 msgr2=0x7f3a5c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.543+0000 7f3a5b59e700 1 -- 172.21.15.8:0/3371867256 shutdown_connections 2023-10-18T21:51:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.543+0000 7f3a5b59e700 1 -- 172.21.15.8:0/3371867256 wait complete. 2023-10-18T21:51:51.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.543+0000 7f3a5b59e700 1 Processor -- start 2023-10-18T21:51:51.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.544+0000 7f3a5b59e700 1 -- start start 2023-10-18T21:51:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.544+0000 7f3a5b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a5c0f6530 0x7f3a5c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.544+0000 7f3a5b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0f77d0 0x7f3a5c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.544+0000 7f3a5b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c107880 con 0x7f3a5c0f6530 2023-10-18T21:51:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.544+0000 7f3a5b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c1080c0 con 0x7f3a5c0f77d0 2023-10-18T21:51:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.544+0000 7f3a5a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a5c0f6530 0x7f3a5c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.544+0000 7f3a5a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a5c0f6530 0x7f3a5c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43300/0 (socket says 172.21.15.8:43300) 2023-10-18T21:51:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.544+0000 7f3a5a59c700 1 -- 172.21.15.8:0/2366412352 learned_addr learned my addr 172.21.15.8:0/2366412352 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.545+0000 7f3a59d9b700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0f77d0 0x7f3a5c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.545+0000 7f3a5a59c700 1 -- 172.21.15.8:0/2366412352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0f77d0 msgr2=0x7f3a5c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.545+0000 7f3a5a59c700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0f77d0 0x7f3a5c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:51.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.545+0000 7f3a5a59c700 1 -- 172.21.15.8:0/2366412352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50005040 con 0x7f3a5c0f6530 2023-10-18T21:51:51.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.545+0000 7f3a5a59c700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a5c0f6530 0x7f3a5c106d90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f3a4c002700 tx=0x7f3a4c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:51.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.545+0000 7f3a4affd700 1 -- 172.21.15.8:0/2366412352 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a4c009320 con 0x7f3a5c0f6530 2023-10-18T21:51:51.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.545+0000 7f3a4affd700 1 -- 172.21.15.8:0/2366412352 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3a4c00f040 con 0x7f3a5c0f6530 2023-10-18T21:51:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.545+0000 7f3a5b59e700 1 -- 172.21.15.8:0/2366412352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c1083a0 con 0x7f3a5c0f6530 2023-10-18T21:51:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.545+0000 7f3a4affd700 1 -- 172.21.15.8:0/2366412352 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a4c014970 con 0x7f3a5c0f6530 2023-10-18T21:51:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.545+0000 7f3a5b59e700 1 -- 172.21.15.8:0/2366412352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c1088e0 con 0x7f3a5c0f6530 2023-10-18T21:51:51.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.547+0000 7f3a5b59e700 1 -- 172.21.15.8:0/2366412352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c059100 con 0x7f3a5c0f6530 2023-10-18T21:51:51.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.547+0000 7f3a4affd700 1 -- 172.21.15.8:0/2366412352 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3a4c009480 con 0x7f3a5c0f6530 2023-10-18T21:51:51.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.548+0000 7f3a4affd700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a44060f70 0x7f3a44063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:51.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.548+0000 7f3a4affd700 1 -- 172.21.15.8:0/2366412352 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3a4c07cc40 con 0x7f3a5c0f6530 2023-10-18T21:51:51.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.548+0000 7f3a59d9b700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a44060f70 0x7f3a44063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:51.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.549+0000 7f3a59d9b700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a44060f70 0x7f3a44063430 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f3a50004630 tx=0x7f3a50009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:51.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.552+0000 7f3a4affd700 1 -- 172.21.15.8:0/2366412352 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3a4c04c7f0 con 0x7f3a5c0f6530 2023-10-18T21:51:51.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.750+0000 7f3a5b59e700 1 -- 172.21.15.8:0/2366412352 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a5c0fee30 con 0x7f3a44060f70 2023-10-18T21:51:51.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.751+0000 7f3a4affd700 1 -- 172.21.15.8:0/2366412352 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3a5c0fee30 con 0x7f3a44060f70 2023-10-18T21:51:51.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 -- 172.21.15.8:0/2366412352 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a44060f70 msgr2=0x7f3a44063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:51.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a44060f70 0x7f3a44063430 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f3a50004630 tx=0x7f3a50009b30).stop 2023-10-18T21:51:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 -- 172.21.15.8:0/2366412352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a5c0f6530 msgr2=0x7f3a5c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a5c0f6530 0x7f3a5c106d90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f3a4c002700 tx=0x7f3a4c009d80).stop 2023-10-18T21:51:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 -- 172.21.15.8:0/2366412352 shutdown_connections 2023-10-18T21:51:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a44060f70 0x7f3a44063430 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a5c0f6530 0x7f3a5c106d90 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 --2- 172.21.15.8:0/2366412352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0f77d0 0x7f3a5c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 -- 172.21.15.8:0/2366412352 >> 172.21.15.8:0/2366412352 conn(0x7f3a5c0f1c90 msgr2=0x7f3a5c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 -- 172.21.15.8:0/2366412352 shutdown_connections 2023-10-18T21:51:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.753+0000 7f3a5b59e700 1 -- 172.21.15.8:0/2366412352 wait complete. 2023-10-18T21:51:51.771 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:51:51.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.893+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3302460527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c80f6530 msgr2=0x7ff9c80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:51.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.893+0000 7ff9c7fff700 1 --2- 172.21.15.8:0/3302460527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c80f6530 0x7ff9c80f6950 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7ff9b8004660 tx=0x7ff9b8009b30).stop 2023-10-18T21:51:51.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.893+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3302460527 shutdown_connections 2023-10-18T21:51:51.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.893+0000 7ff9c7fff700 1 --2- 172.21.15.8:0/3302460527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c80f77d0 0x7ff9c80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:51.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.893+0000 7ff9c7fff700 1 --2- 172.21.15.8:0/3302460527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c80f6530 0x7ff9c80f6950 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:51.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.893+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3302460527 >> 172.21.15.8:0/3302460527 conn(0x7ff9c80f1c90 msgr2=0x7ff9c80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:51.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.893+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3302460527 shutdown_connections 2023-10-18T21:51:51.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.893+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3302460527 wait complete. 2023-10-18T21:51:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.894+0000 7ff9c7fff700 1 Processor -- start 2023-10-18T21:51:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.894+0000 7ff9c7fff700 1 -- start start 2023-10-18T21:51:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.894+0000 7ff9c7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c80f6530 0x7ff9c8108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.894+0000 7ff9c7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c80f77d0 0x7ff9c81094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.894+0000 7ff9c7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c8109a50 con 0x7ff9c80f77d0 2023-10-18T21:51:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.894+0000 7ff9c7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c8109b90 con 0x7ff9c80f6530 2023-10-18T21:51:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.895+0000 7ff9c67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c80f77d0 0x7ff9c81094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.895+0000 7ff9c67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c80f77d0 0x7ff9c81094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43322/0 (socket says 172.21.15.8:43322) 2023-10-18T21:51:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.895+0000 7ff9c67fc700 1 -- 172.21.15.8:0/3224355505 learned_addr learned my addr 172.21.15.8:0/3224355505 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.895+0000 7ff9c6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c80f6530 0x7ff9c8108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.895+0000 7ff9c67fc700 1 -- 172.21.15.8:0/3224355505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c80f6530 msgr2=0x7ff9c8108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.895+0000 7ff9c67fc700 1 --2- 172.21.15.8:0/3224355505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c80f6530 0x7ff9c8108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.895+0000 7ff9c67fc700 1 -- 172.21.15.8:0/3224355505 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8005040 con 0x7ff9c80f77d0 2023-10-18T21:51:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.895+0000 7ff9c67fc700 1 --2- 172.21.15.8:0/3224355505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c80f77d0 0x7ff9c81094a0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7ff9bc0026d0 tx=0x7ff9bc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.895+0000 7ff9af7fe700 1 -- 172.21.15.8:0/3224355505 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9bc0079c0 con 0x7ff9c80f77d0 2023-10-18T21:51:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.896+0000 7ff9af7fe700 1 -- 172.21.15.8:0/3224355505 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff9bc00f040 con 0x7ff9c80f77d0 2023-10-18T21:51:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.896+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3224355505 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c810a530 con 0x7ff9c80f77d0 2023-10-18T21:51:51.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.896+0000 7ff9af7fe700 1 -- 172.21.15.8:0/3224355505 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9bc014980 con 0x7ff9c80f77d0 2023-10-18T21:51:51.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.896+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3224355505 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c810aaf0 con 0x7ff9c80f77d0 2023-10-18T21:51:51.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.897+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3224355505 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c8045ad0 con 0x7ff9c80f77d0 2023-10-18T21:51:51.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.898+0000 7ff9af7fe700 1 -- 172.21.15.8:0/3224355505 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff9bc0090d0 con 0x7ff9c80f77d0 2023-10-18T21:51:51.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.899+0000 7ff9af7fe700 1 --2- 172.21.15.8:0/3224355505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff9b0060f70 0x7ff9b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.899+0000 7ff9af7fe700 1 -- 172.21.15.8:0/3224355505 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff9bc07c8a0 con 0x7ff9c80f77d0 2023-10-18T21:51:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.899+0000 7ff9c6ffd700 1 --2- 172.21.15.8:0/3224355505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff9b0060f70 0x7ff9b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.899+0000 7ff9c6ffd700 1 --2- 172.21.15.8:0/3224355505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff9b0060f70 0x7ff9b0063430 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff9b8004630 tx=0x7ff9b8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:51.903+0000 7ff9af7fe700 1 -- 172.21.15.8:0/3224355505 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff9bc04ffb0 con 0x7ff9c80f77d0 2023-10-18T21:51:52.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.099+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3224355505 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9c80fee30 con 0x7ff9b0060f70 2023-10-18T21:51:52.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.100+0000 7ff9af7fe700 1 -- 172.21.15.8:0/3224355505 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff9c80fee30 con 0x7ff9b0060f70 2023-10-18T21:51:52.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3224355505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff9b0060f70 msgr2=0x7ff9b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:52.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 --2- 172.21.15.8:0/3224355505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff9b0060f70 0x7ff9b0063430 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff9b8004630 tx=0x7ff9b8009b30).stop 2023-10-18T21:51:52.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3224355505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c80f77d0 msgr2=0x7ff9c81094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:52.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 --2- 172.21.15.8:0/3224355505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c80f77d0 0x7ff9c81094a0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7ff9bc0026d0 tx=0x7ff9bc009de0).stop 2023-10-18T21:51:52.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3224355505 shutdown_connections 2023-10-18T21:51:52.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 --2- 172.21.15.8:0/3224355505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff9b0060f70 0x7ff9b0063430 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 --2- 172.21.15.8:0/3224355505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c80f6530 0x7ff9c8108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 --2- 172.21.15.8:0/3224355505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c80f77d0 0x7ff9c81094a0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3224355505 >> 172.21.15.8:0/3224355505 conn(0x7ff9c80f1c90 msgr2=0x7ff9c806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:52.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3224355505 shutdown_connections 2023-10-18T21:51:52.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.102+0000 7ff9c7fff700 1 -- 172.21.15.8:0/3224355505 wait complete. 2023-10-18T21:51:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:50.875351+0000 mgr.smithi008.flmjzp (mgr.14640) 3181 : cluster [DBG] pgmap v2189: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:50.875351+0000 mgr.smithi008.flmjzp (mgr.14640) 3181 : cluster [DBG] pgmap v2189: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:52.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.239+0000 7f807084a700 1 -- 172.21.15.8:0/855049334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f806c0f77d0 msgr2=0x7f806c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:52.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.239+0000 7f807084a700 1 --2- 172.21.15.8:0/855049334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f806c0f77d0 0x7f806c0f7c30 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f8060004660 tx=0x7f8060009b30).stop 2023-10-18T21:51:52.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.239+0000 7f807084a700 1 -- 172.21.15.8:0/855049334 shutdown_connections 2023-10-18T21:51:52.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.239+0000 7f807084a700 1 --2- 172.21.15.8:0/855049334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f806c0f77d0 0x7f806c0f7c30 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.239+0000 7f807084a700 1 --2- 172.21.15.8:0/855049334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f806c0f6530 0x7f806c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.239+0000 7f807084a700 1 -- 172.21.15.8:0/855049334 >> 172.21.15.8:0/855049334 conn(0x7f806c0f1c90 msgr2=0x7f806c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:52.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.239+0000 7f807084a700 1 -- 172.21.15.8:0/855049334 shutdown_connections 2023-10-18T21:51:52.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.239+0000 7f807084a700 1 -- 172.21.15.8:0/855049334 wait complete. 2023-10-18T21:51:52.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.240+0000 7f807084a700 1 Processor -- start 2023-10-18T21:51:52.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.240+0000 7f807084a700 1 -- start start 2023-10-18T21:51:52.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.240+0000 7f807084a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f806c0f6530 0x7f806c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:52.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.240+0000 7f807084a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f806c0f77d0 0x7f806c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:52.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.241+0000 7f807084a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c107880 con 0x7f806c0f6530 2023-10-18T21:51:52.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.241+0000 7f807084a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c1080c0 con 0x7f806c0f77d0 2023-10-18T21:51:52.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.241+0000 7f806ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f806c0f6530 0x7f806c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:52.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.241+0000 7f806ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f806c0f6530 0x7f806c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43330/0 (socket says 172.21.15.8:43330) 2023-10-18T21:51:52.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.241+0000 7f806ad9d700 1 -- 172.21.15.8:0/4281068650 learned_addr learned my addr 172.21.15.8:0/4281068650 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:52.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.241+0000 7f806ad9d700 1 -- 172.21.15.8:0/4281068650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f806c0f77d0 msgr2=0x7f806c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:52.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.241+0000 7f806ad9d700 1 --2- 172.21.15.8:0/4281068650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f806c0f77d0 0x7f806c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:51:52.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.241+0000 7f806ad9d700 1 -- 172.21.15.8:0/4281068650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060005040 con 0x7f806c0f6530 2023-10-18T21:51:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.241+0000 7f806ad9d700 1 --2- 172.21.15.8:0/4281068650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f806c0f6530 0x7f806c106d90 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f805c002700 tx=0x7f805c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.242+0000 7f80537fe700 1 -- 172.21.15.8:0/4281068650 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f805c009320 con 0x7f806c0f6530 2023-10-18T21:51:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.242+0000 7f80537fe700 1 -- 172.21.15.8:0/4281068650 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f805c00f040 con 0x7f806c0f6530 2023-10-18T21:51:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.242+0000 7f807084a700 1 -- 172.21.15.8:0/4281068650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806c1083a0 con 0x7f806c0f6530 2023-10-18T21:51:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.242+0000 7f80537fe700 1 -- 172.21.15.8:0/4281068650 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f805c014970 con 0x7f806c0f6530 2023-10-18T21:51:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.242+0000 7f807084a700 1 -- 172.21.15.8:0/4281068650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806c1088e0 con 0x7f806c0f6530 2023-10-18T21:51:52.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.243+0000 7f807084a700 1 -- 172.21.15.8:0/4281068650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806c059100 con 0x7f806c0f6530 2023-10-18T21:51:52.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.244+0000 7f80537fe700 1 -- 172.21.15.8:0/4281068650 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f805c009480 con 0x7f806c0f6530 2023-10-18T21:51:52.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.245+0000 7f80537fe700 1 --2- 172.21.15.8:0/4281068650 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8054060f70 0x7f8054063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:52.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.245+0000 7f80537fe700 1 -- 172.21.15.8:0/4281068650 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f805c07cb90 con 0x7f806c0f6530 2023-10-18T21:51:52.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.245+0000 7f806a59c700 1 --2- 172.21.15.8:0/4281068650 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8054060f70 0x7f8054063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:52.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.245+0000 7f806a59c700 1 --2- 172.21.15.8:0/4281068650 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8054060f70 0x7f8054063430 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f8060000c00 tx=0x7f8060009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:52.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.249+0000 7f80537fe700 1 -- 172.21.15.8:0/4281068650 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f805c04c7c0 con 0x7f806c0f6530 2023-10-18T21:51:52.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.442+0000 7f807084a700 1 -- 172.21.15.8:0/4281068650 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f806c0fee30 con 0x7f8054060f70 2023-10-18T21:51:52.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.451+0000 7f80537fe700 1 -- 172.21.15.8:0/4281068650 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f806c0fee30 con 0x7f8054060f70 2023-10-18T21:51:52.453 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:51:52.453 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (58m) 6m ago 60m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:51:52.453 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (52m) 6m ago 59m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:51:52.453 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (52m) 3m ago 59m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:51:52.454 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (58m) 6m ago 59m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:51:52.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 56m - - 2023-10-18T21:51:52.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 55m - - 2023-10-18T21:51:52.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 56m - - 2023-10-18T21:51:52.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 55m - - 2023-10-18T21:51:52.455 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (53m) 6m ago 61m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:51:52.455 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (53m) 3m ago 59m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:51:52.455 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (52m) 6m ago 61m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:51:52.455 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (52m) 3m ago 59m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:51:52.456 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (59m) 6m ago 59m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:51:52.456 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (58m) 3m ago 58m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:51:52.456 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (52m) 6m ago 58m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:51:52.456 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (50m) 6m ago 58m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:51:52.456 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (49m) 6m ago 57m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:51:52.457 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (49m) 3m ago 57m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:51:52.457 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (48m) 3m ago 57m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:51:52.457 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (48m) 3m ago 57m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:51:52.457 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (54m) 6m ago 59m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:51:52.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 -- 172.21.15.8:0/4281068650 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8054060f70 msgr2=0x7f8054063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:52.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 --2- 172.21.15.8:0/4281068650 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8054060f70 0x7f8054063430 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f8060000c00 tx=0x7f8060009b30).stop 2023-10-18T21:51:52.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 -- 172.21.15.8:0/4281068650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f806c0f6530 msgr2=0x7f806c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:52.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 --2- 172.21.15.8:0/4281068650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f806c0f6530 0x7f806c106d90 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f805c002700 tx=0x7f805c009d80).stop 2023-10-18T21:51:52.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 -- 172.21.15.8:0/4281068650 shutdown_connections 2023-10-18T21:51:52.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 --2- 172.21.15.8:0/4281068650 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8054060f70 0x7f8054063430 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 --2- 172.21.15.8:0/4281068650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f806c0f6530 0x7f806c106d90 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 --2- 172.21.15.8:0/4281068650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f806c0f77d0 0x7f806c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:51:52.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 -- 172.21.15.8:0/4281068650 >> 172.21.15.8:0/4281068650 conn(0x7f806c0f1c90 msgr2=0x7f806c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:52.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 -- 172.21.15.8:0/4281068650 shutdown_connections 2023-10-18T21:51:52.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.453+0000 7f807084a700 1 -- 172.21.15.8:0/4281068650 wait complete. 2023-10-18T21:51:52.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.589+0000 7f6da273b700 1 -- 172.21.15.8:0/117169244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d9c0f77d0 msgr2=0x7f6d9c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:52.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.589+0000 7f6da273b700 1 --2- 172.21.15.8:0/117169244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d9c0f77d0 0x7f6d9c0f7c30 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f6d8c004660 tx=0x7f6d8c009b30).stop 2023-10-18T21:51:52.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.589+0000 7f6da273b700 1 -- 172.21.15.8:0/117169244 shutdown_connections 2023-10-18T21:51:52.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.589+0000 7f6da273b700 1 --2- 172.21.15.8:0/117169244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d9c0f77d0 0x7f6d9c0f7c30 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.589+0000 7f6da273b700 1 --2- 172.21.15.8:0/117169244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d9c0f6530 0x7f6d9c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.589+0000 7f6da273b700 1 -- 172.21.15.8:0/117169244 >> 172.21.15.8:0/117169244 conn(0x7f6d9c0f1c90 msgr2=0x7f6d9c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:52.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.589+0000 7f6da273b700 1 -- 172.21.15.8:0/117169244 shutdown_connections 2023-10-18T21:51:52.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.589+0000 7f6da273b700 1 -- 172.21.15.8:0/117169244 wait complete. 2023-10-18T21:51:52.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.590+0000 7f6da273b700 1 Processor -- start 2023-10-18T21:51:52.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.590+0000 7f6da273b700 1 -- start start 2023-10-18T21:51:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.590+0000 7f6da273b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d9c0f6530 0x7f6d9c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.590+0000 7f6da273b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d9c0f77d0 0x7f6d9c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.590+0000 7f6da273b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c109970 con 0x7f6d9c0f6530 2023-10-18T21:51:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.590+0000 7f6da273b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c109ab0 con 0x7f6d9c0f77d0 2023-10-18T21:51:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6da1739700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d9c0f6530 0x7f6d9c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6da1739700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d9c0f6530 0x7f6d9c108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43352/0 (socket says 172.21.15.8:43352) 2023-10-18T21:51:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6da1739700 1 -- 172.21.15.8:0/1306449907 learned_addr learned my addr 172.21.15.8:0/1306449907 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6da0f38700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d9c0f77d0 0x7f6d9c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6da1739700 1 -- 172.21.15.8:0/1306449907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d9c0f77d0 msgr2=0x7f6d9c1093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6da1739700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d9c0f77d0 0x7f6d9c1093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6da1739700 1 -- 172.21.15.8:0/1306449907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c005040 con 0x7f6d9c0f6530 2023-10-18T21:51:52.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6da1739700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d9c0f6530 0x7f6d9c108ed0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f6d9800e7c0 tx=0x7f6d9800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:52.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6d91ffb700 1 -- 172.21.15.8:0/1306449907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d980092e0 con 0x7f6d9c0f6530 2023-10-18T21:51:52.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6d91ffb700 1 -- 172.21.15.8:0/1306449907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6d9800f040 con 0x7f6d9c0f6530 2023-10-18T21:51:52.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6da273b700 1 -- 172.21.15.8:0/1306449907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c10a450 con 0x7f6d9c0f6530 2023-10-18T21:51:52.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.591+0000 7f6d91ffb700 1 -- 172.21.15.8:0/1306449907 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d980147e0 con 0x7f6d9c0f6530 2023-10-18T21:51:52.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.592+0000 7f6da273b700 1 -- 172.21.15.8:0/1306449907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c10a990 con 0x7f6d9c0f6530 2023-10-18T21:51:52.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.593+0000 7f6da273b700 1 -- 172.21.15.8:0/1306449907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c045ad0 con 0x7f6d9c0f6530 2023-10-18T21:51:52.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.593+0000 7f6d91ffb700 1 -- 172.21.15.8:0/1306449907 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6d9801b030 con 0x7f6d9c0f6530 2023-10-18T21:51:52.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.595+0000 7f6d91ffb700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d88060f70 0x7f6d88063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:52.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.595+0000 7f6d91ffb700 1 -- 172.21.15.8:0/1306449907 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6d9807c950 con 0x7f6d9c0f6530 2023-10-18T21:51:52.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.595+0000 7f6da0f38700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d88060f70 0x7f6d88063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:52.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.596+0000 7f6da0f38700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d88060f70 0x7f6d88063430 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f6d8c009720 tx=0x7f6d8c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:52.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.599+0000 7f6d91ffb700 1 -- 172.21.15.8:0/1306449907 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6d9804ff10 con 0x7f6d9c0f6530 2023-10-18T21:51:52.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.858+0000 7f6da273b700 1 -- 172.21.15.8:0/1306449907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d9c0fee40 con 0x7f6d9c0f6530 2023-10-18T21:51:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.859+0000 7f6d91ffb700 1 -- 172.21.15.8:0/1306449907 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f6d98019020 con 0x7f6d9c0f6530 2023-10-18T21:51:52.860 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:51:52.861 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:51:52.861 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:51:52.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:51:52.861 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:51:52.861 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:51:52.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:51:52.862 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:51:52.862 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:51:52.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:51:52.862 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:51:52.863 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:51:52.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:51:52.863 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:51:52.863 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:51:52.863 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:51:52.864 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:51:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 -- 172.21.15.8:0/1306449907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d88060f70 msgr2=0x7f6d88063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d88060f70 0x7f6d88063430 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f6d8c009720 tx=0x7f6d8c00b040).stop 2023-10-18T21:51:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 -- 172.21.15.8:0/1306449907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d9c0f6530 msgr2=0x7f6d9c108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d9c0f6530 0x7f6d9c108ed0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f6d9800e7c0 tx=0x7f6d9800b040).stop 2023-10-18T21:51:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 -- 172.21.15.8:0/1306449907 shutdown_connections 2023-10-18T21:51:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d88060f70 0x7f6d88063430 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d9c0f6530 0x7f6d9c108ed0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 --2- 172.21.15.8:0/1306449907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d9c0f77d0 0x7f6d9c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:52.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 -- 172.21.15.8:0/1306449907 >> 172.21.15.8:0/1306449907 conn(0x7f6d9c0f1c90 msgr2=0x7f6d9c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:52.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 -- 172.21.15.8:0/1306449907 shutdown_connections 2023-10-18T21:51:52.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.861+0000 7f6da273b700 1 -- 172.21.15.8:0/1306449907 wait complete. 2023-10-18T21:51:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.998+0000 7f238c90e700 1 -- 172.21.15.8:0/197597472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23880f6530 msgr2=0x7f23880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.998+0000 7f238c90e700 1 --2- 172.21.15.8:0/197597472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23880f6530 0x7f23880f6950 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f2378004660 tx=0x7f2378009b30).stop 2023-10-18T21:51:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.998+0000 7f238c90e700 1 -- 172.21.15.8:0/197597472 shutdown_connections 2023-10-18T21:51:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.998+0000 7f238c90e700 1 --2- 172.21.15.8:0/197597472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23880f77d0 0x7f23880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.998+0000 7f238c90e700 1 --2- 172.21.15.8:0/197597472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23880f6530 0x7f23880f6950 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.998+0000 7f238c90e700 1 -- 172.21.15.8:0/197597472 >> 172.21.15.8:0/197597472 conn(0x7f23880f1c90 msgr2=0x7f23880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.998+0000 7f238c90e700 1 -- 172.21.15.8:0/197597472 shutdown_connections 2023-10-18T21:51:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.998+0000 7f238c90e700 1 -- 172.21.15.8:0/197597472 wait complete. 2023-10-18T21:51:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.999+0000 7f238c90e700 1 Processor -- start 2023-10-18T21:51:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:52.999+0000 7f238c90e700 1 -- start start 2023-10-18T21:51:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f238c90e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23880f6530 0x7f2388106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f238c90e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23880f77d0 0x7f2388107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f238c90e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388107910 con 0x7f23880f77d0 2023-10-18T21:51:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f238c90e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388108120 con 0x7f23880f6530 2023-10-18T21:51:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f2386ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23880f77d0 0x7f2388107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f2386ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23880f77d0 0x7f2388107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43374/0 (socket says 172.21.15.8:43374) 2023-10-18T21:51:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f2386ffd700 1 -- 172.21.15.8:0/2065561712 learned_addr learned my addr 172.21.15.8:0/2065561712 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f2386ffd700 1 -- 172.21.15.8:0/2065561712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23880f6530 msgr2=0x7f2388106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f23877fe700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23880f6530 0x7f2388106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f2386ffd700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23880f6530 0x7f2388106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f2386ffd700 1 -- 172.21.15.8:0/2065561712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2378005040 con 0x7f23880f77d0 2023-10-18T21:51:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.000+0000 7f23877fe700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23880f6530 0x7f2388106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:51:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.001+0000 7f2386ffd700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23880f77d0 0x7f2388107310 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f237c0026d0 tx=0x7f237c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.001+0000 7f236ffff700 1 -- 172.21.15.8:0/2065561712 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f237c009320 con 0x7f23880f77d0 2023-10-18T21:51:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.001+0000 7f236ffff700 1 -- 172.21.15.8:0/2065561712 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f237c00f040 con 0x7f23880f77d0 2023-10-18T21:51:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.001+0000 7f238c90e700 1 -- 172.21.15.8:0/2065561712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23881083a0 con 0x7f23880f77d0 2023-10-18T21:51:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.001+0000 7f236ffff700 1 -- 172.21.15.8:0/2065561712 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f237c0148a0 con 0x7f23880f77d0 2023-10-18T21:51:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.001+0000 7f238c90e700 1 -- 172.21.15.8:0/2065561712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2388108960 con 0x7f23880f77d0 2023-10-18T21:51:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.002+0000 7f238c90e700 1 -- 172.21.15.8:0/2065561712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2388059100 con 0x7f23880f77d0 2023-10-18T21:51:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.003+0000 7f236ffff700 1 -- 172.21.15.8:0/2065561712 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f237c009480 con 0x7f23880f77d0 2023-10-18T21:51:53.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.004+0000 7f236ffff700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2370060f70 0x7f2370063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:53.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.004+0000 7f236ffff700 1 -- 172.21.15.8:0/2065561712 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f237c07d090 con 0x7f23880f77d0 2023-10-18T21:51:53.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.004+0000 7f23877fe700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2370060f70 0x7f2370063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:53.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.005+0000 7f23877fe700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2370060f70 0x7f2370063430 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f2378009d60 tx=0x7f2378009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:53.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.008+0000 7f236ffff700 1 -- 172.21.15.8:0/2065561712 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f237c04cc40 con 0x7f23880f77d0 2023-10-18T21:51:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:51.751513+0000 mgr.smithi008.flmjzp (mgr.14640) 3182 : audit [DBG] from='client.36640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:52.100625+0000 mgr.smithi008.flmjzp (mgr.14640) 3183 : audit [DBG] from='client.36644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:53.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.233+0000 7f238c90e700 1 -- 172.21.15.8:0/2065561712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f23880fedc0 con 0x7f23880f77d0 2023-10-18T21:51:53.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.234+0000 7f236ffff700 1 -- 172.21.15.8:0/2065561712 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f237c0181b0 con 0x7f23880f77d0 2023-10-18T21:51:53.235 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:51:53.235 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:51:53.236 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:51:53.236 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:51:53.236 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:51:53.236 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:51:53.236 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:51:53.237 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:51:53.237 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:51:53.237 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:51:53.237 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:51:53.237 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:51:53.237 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:51:53.238 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:51:53.238 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:51:53.238 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:51:53.238 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:51:53.239 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:51:53.239 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:51:53.239 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:51:53.239 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:51:53.239 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:51:53.239 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:51:53.240 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:51:53.240 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:51:53.240 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:51:53.240 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:51:53.240 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:51:53.241 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:51:53.241 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:51:53.241 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:51:53.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:51:53.241 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:51:53.242 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:51:53.242 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:51.751513+0000 mgr.smithi008.flmjzp (mgr.14640) 3182 : audit [DBG] from='client.36640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:53.243 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:52.100625+0000 mgr.smithi008.flmjzp (mgr.14640) 3183 : audit [DBG] from='client.36644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.235+0000 7f238c90e700 1 -- 172.21.15.8:0/2065561712 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2370060f70 msgr2=0x7f2370063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.235+0000 7f238c90e700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2370060f70 0x7f2370063430 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f2378009d60 tx=0x7f2378009b30).stop 2023-10-18T21:51:53.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.235+0000 7f238c90e700 1 -- 172.21.15.8:0/2065561712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23880f77d0 msgr2=0x7f2388107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:53.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.235+0000 7f238c90e700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23880f77d0 0x7f2388107310 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f237c0026d0 tx=0x7f237c009de0).stop 2023-10-18T21:51:53.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.236+0000 7f238c90e700 1 -- 172.21.15.8:0/2065561712 shutdown_connections 2023-10-18T21:51:53.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.236+0000 7f238c90e700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2370060f70 0x7f2370063430 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.236+0000 7f238c90e700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23880f6530 0x7f2388106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.236+0000 7f238c90e700 1 --2- 172.21.15.8:0/2065561712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23880f77d0 0x7f2388107310 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.236+0000 7f238c90e700 1 -- 172.21.15.8:0/2065561712 >> 172.21.15.8:0/2065561712 conn(0x7f23880f1c90 msgr2=0x7f23880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.236+0000 7f238c90e700 1 -- 172.21.15.8:0/2065561712 shutdown_connections 2023-10-18T21:51:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.236+0000 7f238c90e700 1 -- 172.21.15.8:0/2065561712 wait complete. 2023-10-18T21:51:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:51:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.373+0000 7fe47126e700 1 -- 172.21.15.8:0/2569392198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe46c0f6530 msgr2=0x7fe46c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.373+0000 7fe47126e700 1 --2- 172.21.15.8:0/2569392198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe46c0f6530 0x7fe46c0f6950 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fe45c004660 tx=0x7fe45c009b30).stop 2023-10-18T21:51:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.373+0000 7fe47126e700 1 -- 172.21.15.8:0/2569392198 shutdown_connections 2023-10-18T21:51:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.373+0000 7fe47126e700 1 --2- 172.21.15.8:0/2569392198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe46c0f77d0 0x7fe46c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.373+0000 7fe47126e700 1 --2- 172.21.15.8:0/2569392198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe46c0f6530 0x7fe46c0f6950 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.373+0000 7fe47126e700 1 -- 172.21.15.8:0/2569392198 >> 172.21.15.8:0/2569392198 conn(0x7fe46c0f1c90 msgr2=0x7fe46c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.373+0000 7fe47126e700 1 -- 172.21.15.8:0/2569392198 shutdown_connections 2023-10-18T21:51:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.373+0000 7fe47126e700 1 -- 172.21.15.8:0/2569392198 wait complete. 2023-10-18T21:51:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.374+0000 7fe47126e700 1 Processor -- start 2023-10-18T21:51:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.374+0000 7fe47126e700 1 -- start start 2023-10-18T21:51:53.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.375+0000 7fe47126e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe46c0f6530 0x7fe46c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:53.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.375+0000 7fe47126e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe46c0f77d0 0x7fe46c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:53.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.375+0000 7fe47126e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c107880 con 0x7fe46c0f6530 2023-10-18T21:51:53.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.375+0000 7fe47126e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1080c0 con 0x7fe46c0f77d0 2023-10-18T21:51:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.375+0000 7fe46bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe46c0f6530 0x7fe46c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.375+0000 7fe46bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe46c0f6530 0x7fe46c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43394/0 (socket says 172.21.15.8:43394) 2023-10-18T21:51:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.375+0000 7fe46bfff700 1 -- 172.21.15.8:0/2274488817 learned_addr learned my addr 172.21.15.8:0/2274488817 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:51:53.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.375+0000 7fe46b7fe700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe46c0f77d0 0x7fe46c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:53.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.375+0000 7fe46bfff700 1 -- 172.21.15.8:0/2274488817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe46c0f77d0 msgr2=0x7fe46c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:53.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.375+0000 7fe46bfff700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe46c0f77d0 0x7fe46c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.376+0000 7fe46bfff700 1 -- 172.21.15.8:0/2274488817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c005040 con 0x7fe46c0f6530 2023-10-18T21:51:53.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.376+0000 7fe46bfff700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe46c0f6530 0x7fe46c106d90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fe45c009870 tx=0x7fe45c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:53.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.376+0000 7fe468ff9700 1 -- 172.21.15.8:0/2274488817 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe45c019070 con 0x7fe46c0f6530 2023-10-18T21:51:53.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.376+0000 7fe468ff9700 1 -- 172.21.15.8:0/2274488817 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe45c013380 con 0x7fe46c0f6530 2023-10-18T21:51:53.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.376+0000 7fe47126e700 1 -- 172.21.15.8:0/2274488817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c108340 con 0x7fe46c0f6530 2023-10-18T21:51:53.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.376+0000 7fe468ff9700 1 -- 172.21.15.8:0/2274488817 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe45c01edf0 con 0x7fe46c0f6530 2023-10-18T21:51:53.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.376+0000 7fe47126e700 1 -- 172.21.15.8:0/2274488817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c108820 con 0x7fe46c0f6530 2023-10-18T21:51:53.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.377+0000 7fe47126e700 1 -- 172.21.15.8:0/2274488817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c059100 con 0x7fe46c0f6530 2023-10-18T21:51:53.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.378+0000 7fe468ff9700 1 -- 172.21.15.8:0/2274488817 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe45c01e420 con 0x7fe46c0f6530 2023-10-18T21:51:53.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.379+0000 7fe468ff9700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe454060f70 0x7fe454063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:51:53.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.379+0000 7fe468ff9700 1 -- 172.21.15.8:0/2274488817 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe45c07dce0 con 0x7fe46c0f6530 2023-10-18T21:51:53.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.379+0000 7fe46b7fe700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe454060f70 0x7fe454063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:51:53.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.380+0000 7fe46b7fe700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe454060f70 0x7fe454063430 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fe46c106b20 tx=0x7fe46000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:51:53.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.383+0000 7fe468ff9700 1 -- 172.21.15.8:0/2274488817 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe45c04d910 con 0x7fe46c0f6530 2023-10-18T21:51:53.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.583+0000 7fe47126e700 1 -- 172.21.15.8:0/2274488817 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe46c0fed30 con 0x7fe454060f70 2023-10-18T21:51:53.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.585+0000 7fe468ff9700 1 -- 172.21.15.8:0/2274488817 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe46c0fed30 con 0x7fe454060f70 2023-10-18T21:51:53.586 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:51:53.586 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:51:53.586 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:51:53.587 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:51:53.587 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:51:53.587 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:51:53.587 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:51:53.588 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:51:53.588 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:51:53.588 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:51:53.588 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:51:53.588 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:51:53.589 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:51:53.589 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:51:53.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 -- 172.21.15.8:0/2274488817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe454060f70 msgr2=0x7fe454063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:53.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe454060f70 0x7fe454063430 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fe46c106b20 tx=0x7fe46000b040).stop 2023-10-18T21:51:53.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 -- 172.21.15.8:0/2274488817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe46c0f6530 msgr2=0x7fe46c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:51:53.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe46c0f6530 0x7fe46c106d90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fe45c009870 tx=0x7fe45c00b040).stop 2023-10-18T21:51:53.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 -- 172.21.15.8:0/2274488817 shutdown_connections 2023-10-18T21:51:53.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe454060f70 0x7fe454063430 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe46c0f6530 0x7fe46c106d90 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 --2- 172.21.15.8:0/2274488817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe46c0f77d0 0x7fe46c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:51:53.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 -- 172.21.15.8:0/2274488817 >> 172.21.15.8:0/2274488817 conn(0x7fe46c0f1c90 msgr2=0x7fe46c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:51:53.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 -- 172.21.15.8:0/2274488817 shutdown_connections 2023-10-18T21:51:53.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:51:53.587+0000 7fe47126e700 1 -- 172.21.15.8:0/2274488817 wait complete. 2023-10-18T21:51:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:52.443341+0000 mgr.smithi008.flmjzp (mgr.14640) 3184 : audit [DBG] from='client.36648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:52.859537+0000 mon.smithi008 (mon.0) 3556 : audit [DBG] from='client.? 172.21.15.8:0/1306449907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:52.875761+0000 mgr.smithi008.flmjzp (mgr.14640) 3185 : cluster [DBG] pgmap v2190: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:53.234250+0000 mon.smithi008 (mon.0) 3557 : audit [DBG] from='client.? 172.21.15.8:0/2065561712' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:51:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:52.443341+0000 mgr.smithi008.flmjzp (mgr.14640) 3184 : audit [DBG] from='client.36648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:52.859537+0000 mon.smithi008 (mon.0) 3556 : audit [DBG] from='client.? 172.21.15.8:0/1306449907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:52.875761+0000 mgr.smithi008.flmjzp (mgr.14640) 3185 : cluster [DBG] pgmap v2190: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:54.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:53.234250+0000 mon.smithi008 (mon.0) 3557 : audit [DBG] from='client.? 172.21.15.8:0/2065561712' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:51:55.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:53.585172+0000 mgr.smithi008.flmjzp (mgr.14640) 3186 : audit [DBG] from='client.36660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:55.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:53.585172+0000 mgr.smithi008.flmjzp (mgr.14640) 3186 : audit [DBG] from='client.36660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:51:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:54.876288+0000 mgr.smithi008.flmjzp (mgr.14640) 3187 : cluster [DBG] pgmap v2191: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:54.876288+0000 mgr.smithi008.flmjzp (mgr.14640) 3187 : cluster [DBG] pgmap v2191: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:56.877048+0000 mgr.smithi008.flmjzp (mgr.14640) 3188 : cluster [DBG] pgmap v2192: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:58.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:56.877048+0000 mgr.smithi008.flmjzp (mgr.14640) 3188 : cluster [DBG] pgmap v2192: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:51:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:58.900087+0000 mon.smithi008 (mon.0) 3558 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:58.902281+0000 mon.smithi008 (mon.0) 3559 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:58.903402+0000 mon.smithi008 (mon.0) 3560 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:58.910188+0000 mon.smithi008 (mon.0) 3561 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:58.916568+0000 mon.smithi008 (mon.0) 3562 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:58.919530+0000 mon.smithi008 (mon.0) 3563 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:58.921146+0000 mon.smithi008 (mon.0) 3564 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:59.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:58.922785+0000 mon.smithi008 (mon.0) 3565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:59.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:51:58.924778+0000 mon.smithi008 (mon.0) 3566 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:58.900087+0000 mon.smithi008 (mon.0) 3558 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:58.902281+0000 mon.smithi008 (mon.0) 3559 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:51:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:58.903402+0000 mon.smithi008 (mon.0) 3560 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:51:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:58.910188+0000 mon.smithi008 (mon.0) 3561 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:51:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:58.916568+0000 mon.smithi008 (mon.0) 3562 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:51:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:58.919530+0000 mon.smithi008 (mon.0) 3563 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:58.921146+0000 mon.smithi008 (mon.0) 3564 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:59.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:58.922785+0000 mon.smithi008 (mon.0) 3565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:51:59.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:51:58.924778+0000 mon.smithi008 (mon.0) 3566 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:00.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:58.877786+0000 mgr.smithi008.flmjzp (mgr.14640) 3189 : cluster [DBG] pgmap v2193: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:00.205 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:58.904367+0000 mgr.smithi008.flmjzp (mgr.14640) 3190 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:00.206 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:58.904920+0000 mgr.smithi008.flmjzp (mgr.14640) 3191 : cluster [DBG] pgmap v2194: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:00.206 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:51:58.905194+0000 mgr.smithi008.flmjzp (mgr.14640) 3192 : cluster [DBG] pgmap v2195: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:00.206 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:51:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:51:58.926640+0000 mgr.smithi008.flmjzp (mgr.14640) 3193 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:58.877786+0000 mgr.smithi008.flmjzp (mgr.14640) 3189 : cluster [DBG] pgmap v2193: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:58.904367+0000 mgr.smithi008.flmjzp (mgr.14640) 3190 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:58.904920+0000 mgr.smithi008.flmjzp (mgr.14640) 3191 : cluster [DBG] pgmap v2194: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:51:58.905194+0000 mgr.smithi008.flmjzp (mgr.14640) 3192 : cluster [DBG] pgmap v2195: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:00.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:51:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:51:58.926640+0000 mgr.smithi008.flmjzp (mgr.14640) 3193 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:00.905867+0000 mgr.smithi008.flmjzp (mgr.14640) 3194 : cluster [DBG] pgmap v2196: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:00.905867+0000 mgr.smithi008.flmjzp (mgr.14640) 3194 : cluster [DBG] pgmap v2196: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:02.906425+0000 mgr.smithi008.flmjzp (mgr.14640) 3195 : cluster [DBG] pgmap v2197: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:02.906425+0000 mgr.smithi008.flmjzp (mgr.14640) 3195 : cluster [DBG] pgmap v2197: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:04.907205+0000 mgr.smithi008.flmjzp (mgr.14640) 3196 : cluster [DBG] pgmap v2198: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:04.907205+0000 mgr.smithi008.flmjzp (mgr.14640) 3196 : cluster [DBG] pgmap v2198: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:08.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:06.907781+0000 mgr.smithi008.flmjzp (mgr.14640) 3197 : cluster [DBG] pgmap v2199: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:08.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:06.907781+0000 mgr.smithi008.flmjzp (mgr.14640) 3197 : cluster [DBG] pgmap v2199: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:08.936612+0000 mon.smithi008 (mon.0) 3567 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:08.936612+0000 mon.smithi008 (mon.0) 3567 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:08.908312+0000 mgr.smithi008.flmjzp (mgr.14640) 3198 : cluster [DBG] pgmap v2200: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:09.497369+0000 mon.smithi008 (mon.0) 3568 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:52:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:09.498704+0000 mon.smithi008 (mon.0) 3569 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:52:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:09.504142+0000 mon.smithi008 (mon.0) 3570 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:09.509010+0000 mon.smithi008 (mon.0) 3571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:09.511255+0000 mon.smithi008 (mon.0) 3572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:09.512468+0000 mon.smithi008 (mon.0) 3573 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:09.513620+0000 mon.smithi008 (mon.0) 3574 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:09.515122+0000 mon.smithi008 (mon.0) 3575 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:08.908312+0000 mgr.smithi008.flmjzp (mgr.14640) 3198 : cluster [DBG] pgmap v2200: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:09.497369+0000 mon.smithi008 (mon.0) 3568 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:52:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:09.498704+0000 mon.smithi008 (mon.0) 3569 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:52:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:09.504142+0000 mon.smithi008 (mon.0) 3570 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:09.509010+0000 mon.smithi008 (mon.0) 3571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:09.511255+0000 mon.smithi008 (mon.0) 3572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:10.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:09.512468+0000 mon.smithi008 (mon.0) 3573 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:10.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:09.513620+0000 mon.smithi008 (mon.0) 3574 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:10.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:09.515122+0000 mon.smithi008 (mon.0) 3575 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:52:09.499384+0000 mgr.smithi008.flmjzp (mgr.14640) 3199 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:09.499883+0000 mgr.smithi008.flmjzp (mgr.14640) 3200 : cluster [DBG] pgmap v2201: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:09.500072+0000 mgr.smithi008.flmjzp (mgr.14640) 3201 : cluster [DBG] pgmap v2202: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:52:09.516620+0000 mgr.smithi008.flmjzp (mgr.14640) 3202 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:52:09.499384+0000 mgr.smithi008.flmjzp (mgr.14640) 3199 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:09.499883+0000 mgr.smithi008.flmjzp (mgr.14640) 3200 : cluster [DBG] pgmap v2201: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:09.500072+0000 mgr.smithi008.flmjzp (mgr.14640) 3201 : cluster [DBG] pgmap v2202: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:52:09.516620+0000 mgr.smithi008.flmjzp (mgr.14640) 3202 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:11.500620+0000 mgr.smithi008.flmjzp (mgr.14640) 3203 : cluster [DBG] pgmap v2203: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:13.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:11.500620+0000 mgr.smithi008.flmjzp (mgr.14640) 3203 : cluster [DBG] pgmap v2203: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:13.501201+0000 mgr.smithi008.flmjzp (mgr.14640) 3204 : cluster [DBG] pgmap v2204: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:13.501201+0000 mgr.smithi008.flmjzp (mgr.14640) 3204 : cluster [DBG] pgmap v2204: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:15.502205+0000 mgr.smithi008.flmjzp (mgr.14640) 3205 : cluster [DBG] pgmap v2205: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:15.502205+0000 mgr.smithi008.flmjzp (mgr.14640) 3205 : cluster [DBG] pgmap v2205: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:17.502786+0000 mgr.smithi008.flmjzp (mgr.14640) 3206 : cluster [DBG] pgmap v2206: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:17.502786+0000 mgr.smithi008.flmjzp (mgr.14640) 3206 : cluster [DBG] pgmap v2206: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:19.527388+0000 mon.smithi008 (mon.0) 3576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:19.876756+0000 mon.smithi008 (mon.0) 3577 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:19.877671+0000 mon.smithi008 (mon.0) 3578 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:52:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:19.878384+0000 mon.smithi008 (mon.0) 3579 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:52:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:19.883291+0000 mon.smithi008 (mon.0) 3580 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:19.888138+0000 mon.smithi008 (mon.0) 3581 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:19.890895+0000 mon.smithi008 (mon.0) 3582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:19.892099+0000 mon.smithi008 (mon.0) 3583 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:19.893288+0000 mon.smithi008 (mon.0) 3584 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:19.894773+0000 mon.smithi008 (mon.0) 3585 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:20.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:19.527388+0000 mon.smithi008 (mon.0) 3576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:19.876756+0000 mon.smithi008 (mon.0) 3577 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:19.877671+0000 mon.smithi008 (mon.0) 3578 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:52:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:19.878384+0000 mon.smithi008 (mon.0) 3579 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:52:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:19.883291+0000 mon.smithi008 (mon.0) 3580 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:19.888138+0000 mon.smithi008 (mon.0) 3581 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:19.890895+0000 mon.smithi008 (mon.0) 3582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:19.892099+0000 mon.smithi008 (mon.0) 3583 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:19.893288+0000 mon.smithi008 (mon.0) 3584 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:20.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:19.894773+0000 mon.smithi008 (mon.0) 3585 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:19.503355+0000 mgr.smithi008.flmjzp (mgr.14640) 3207 : cluster [DBG] pgmap v2207: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:52:19.879032+0000 mgr.smithi008.flmjzp (mgr.14640) 3208 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:19.879569+0000 mgr.smithi008.flmjzp (mgr.14640) 3209 : cluster [DBG] pgmap v2208: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:21.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:19.879849+0000 mgr.smithi008.flmjzp (mgr.14640) 3210 : cluster [DBG] pgmap v2209: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:21.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:52:19.896251+0000 mgr.smithi008.flmjzp (mgr.14640) 3211 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:19.503355+0000 mgr.smithi008.flmjzp (mgr.14640) 3207 : cluster [DBG] pgmap v2207: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:52:19.879032+0000 mgr.smithi008.flmjzp (mgr.14640) 3208 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:19.879569+0000 mgr.smithi008.flmjzp (mgr.14640) 3209 : cluster [DBG] pgmap v2208: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:19.879849+0000 mgr.smithi008.flmjzp (mgr.14640) 3210 : cluster [DBG] pgmap v2209: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:52:19.896251+0000 mgr.smithi008.flmjzp (mgr.14640) 3211 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:21.880565+0000 mgr.smithi008.flmjzp (mgr.14640) 3212 : cluster [DBG] pgmap v2210: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:23.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:21.880565+0000 mgr.smithi008.flmjzp (mgr.14640) 3212 : cluster [DBG] pgmap v2210: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:23.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.740+0000 7fe6f2385700 1 -- 172.21.15.8:0/2106434524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6ec0f6530 msgr2=0x7fe6ec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:23.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.740+0000 7fe6f2385700 1 --2- 172.21.15.8:0/2106434524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6ec0f6530 0x7fe6ec0f6950 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fe6e8004660 tx=0x7fe6e8009b30).stop 2023-10-18T21:52:23.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.740+0000 7fe6f2385700 1 -- 172.21.15.8:0/2106434524 shutdown_connections 2023-10-18T21:52:23.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.740+0000 7fe6f2385700 1 --2- 172.21.15.8:0/2106434524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6ec0f77d0 0x7fe6ec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:23.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.740+0000 7fe6f2385700 1 --2- 172.21.15.8:0/2106434524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6ec0f6530 0x7fe6ec0f6950 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:23.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.740+0000 7fe6f2385700 1 -- 172.21.15.8:0/2106434524 >> 172.21.15.8:0/2106434524 conn(0x7fe6ec0f1c90 msgr2=0x7fe6ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:23.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.740+0000 7fe6f2385700 1 -- 172.21.15.8:0/2106434524 shutdown_connections 2023-10-18T21:52:23.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.740+0000 7fe6f2385700 1 -- 172.21.15.8:0/2106434524 wait complete. 2023-10-18T21:52:23.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.741+0000 7fe6f2385700 1 Processor -- start 2023-10-18T21:52:23.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.741+0000 7fe6f2385700 1 -- start start 2023-10-18T21:52:23.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.741+0000 7fe6f2385700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6ec0f6530 0x7fe6ec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:23.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.741+0000 7fe6f2385700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6ec0f77d0 0x7fe6ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:23.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.741+0000 7fe6f2385700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec06a380 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.741+0000 7fe6f2385700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec06a4c0 con 0x7fe6ec0f6530 2023-10-18T21:52:23.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.741+0000 7fe6f0b82700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6ec0f77d0 0x7fe6ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:23.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.742+0000 7fe6f0b82700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6ec0f77d0 0x7fe6ec069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56626/0 (socket says 172.21.15.8:56626) 2023-10-18T21:52:23.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.742+0000 7fe6f0b82700 1 -- 172.21.15.8:0/1409027420 learned_addr learned my addr 172.21.15.8:0/1409027420 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:23.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.742+0000 7fe6f1383700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6ec0f6530 0x7fe6ec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:23.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.742+0000 7fe6f0b82700 1 -- 172.21.15.8:0/1409027420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6ec0f6530 msgr2=0x7fe6ec06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:23.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.742+0000 7fe6f0b82700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6ec0f6530 0x7fe6ec06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:23.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.742+0000 7fe6f0b82700 1 -- 172.21.15.8:0/1409027420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8005040 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.742+0000 7fe6f0b82700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6ec0f77d0 0x7fe6ec069e20 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7fe6dc002700 tx=0x7fe6dc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:23.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.742+0000 7fe6e1ffb700 1 -- 172.21.15.8:0/1409027420 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6dc009320 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.742+0000 7fe6e1ffb700 1 -- 172.21.15.8:0/1409027420 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe6dc00f040 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.743+0000 7fe6f2385700 1 -- 172.21.15.8:0/1409027420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ec06a7a0 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.743+0000 7fe6e1ffb700 1 -- 172.21.15.8:0/1409027420 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6dc0148f0 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.743+0000 7fe6f2385700 1 -- 172.21.15.8:0/1409027420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec10ed70 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.744+0000 7fe6f2385700 1 -- 172.21.15.8:0/1409027420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ec045ad0 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.744+0000 7fe6e1ffb700 1 -- 172.21.15.8:0/1409027420 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe6dc0077b0 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.746+0000 7fe6e1ffb700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6d8060f70 0x7fe6d8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:23.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.746+0000 7fe6e1ffb700 1 -- 172.21.15.8:0/1409027420 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe6dc07cb00 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.746+0000 7fe6f1383700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6d8060f70 0x7fe6d8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.747+0000 7fe6f1383700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6d8060f70 0x7fe6d8063430 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fe6e8005010 tx=0x7fe6e8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.750+0000 7fe6e1ffb700 1 -- 172.21.15.8:0/1409027420 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe6dc04c7f0 con 0x7fe6ec0f77d0 2023-10-18T21:52:23.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.952+0000 7fe6f2385700 1 -- 172.21.15.8:0/1409027420 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6ec0fedd0 con 0x7fe6d8060f70 2023-10-18T21:52:23.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.954+0000 7fe6e1ffb700 1 -- 172.21.15.8:0/1409027420 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe6ec0fedd0 con 0x7fe6d8060f70 2023-10-18T21:52:23.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 -- 172.21.15.8:0/1409027420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6d8060f70 msgr2=0x7fe6d8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:23.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6d8060f70 0x7fe6d8063430 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fe6e8005010 tx=0x7fe6e8009b30).stop 2023-10-18T21:52:23.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 -- 172.21.15.8:0/1409027420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6ec0f77d0 msgr2=0x7fe6ec069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6ec0f77d0 0x7fe6ec069e20 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7fe6dc002700 tx=0x7fe6dc009e00).stop 2023-10-18T21:52:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 -- 172.21.15.8:0/1409027420 shutdown_connections 2023-10-18T21:52:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe6d8060f70 0x7fe6d8063430 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6ec0f6530 0x7fe6ec06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 --2- 172.21.15.8:0/1409027420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6ec0f77d0 0x7fe6ec069e20 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:23.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 -- 172.21.15.8:0/1409027420 >> 172.21.15.8:0/1409027420 conn(0x7fe6ec0f1c90 msgr2=0x7fe6ec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:23.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 -- 172.21.15.8:0/1409027420 shutdown_connections 2023-10-18T21:52:23.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:23.956+0000 7fe6f2385700 1 -- 172.21.15.8:0/1409027420 wait complete. 2023-10-18T21:52:23.973 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:52:24.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.094+0000 7f3767132700 1 -- 172.21.15.8:0/2610116878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37600f77d0 msgr2=0x7f37600f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:24.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.094+0000 7f3767132700 1 --2- 172.21.15.8:0/2610116878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37600f77d0 0x7f37600f7c30 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f3750004660 tx=0x7f3750009b30).stop 2023-10-18T21:52:24.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.094+0000 7f3767132700 1 -- 172.21.15.8:0/2610116878 shutdown_connections 2023-10-18T21:52:24.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.094+0000 7f3767132700 1 --2- 172.21.15.8:0/2610116878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37600f77d0 0x7f37600f7c30 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.094+0000 7f3767132700 1 --2- 172.21.15.8:0/2610116878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37600f6530 0x7f37600f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.094+0000 7f3767132700 1 -- 172.21.15.8:0/2610116878 >> 172.21.15.8:0/2610116878 conn(0x7f37600f1c90 msgr2=0x7f37600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:24.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.094+0000 7f3767132700 1 -- 172.21.15.8:0/2610116878 shutdown_connections 2023-10-18T21:52:24.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.094+0000 7f3767132700 1 -- 172.21.15.8:0/2610116878 wait complete. 2023-10-18T21:52:24.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.095+0000 7f3767132700 1 Processor -- start 2023-10-18T21:52:24.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.095+0000 7f3767132700 1 -- start start 2023-10-18T21:52:24.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.095+0000 7f3767132700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37600f6530 0x7f376006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:24.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.095+0000 7f3767132700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37600f77d0 0x7f3760069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:24.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.095+0000 7f3767132700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376006a380 con 0x7f37600f6530 2023-10-18T21:52:24.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.095+0000 7f3767132700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376006a4c0 con 0x7f37600f77d0 2023-10-18T21:52:24.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.096+0000 7f3766130700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37600f6530 0x7f376006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:24.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.096+0000 7f3766130700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37600f6530 0x7f376006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56654/0 (socket says 172.21.15.8:56654) 2023-10-18T21:52:24.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.096+0000 7f3766130700 1 -- 172.21.15.8:0/646539191 learned_addr learned my addr 172.21.15.8:0/646539191 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:24.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.096+0000 7f376592f700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37600f77d0 0x7f3760069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:24.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.096+0000 7f3766130700 1 -- 172.21.15.8:0/646539191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37600f77d0 msgr2=0x7f3760069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:24.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.096+0000 7f3766130700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37600f77d0 0x7f3760069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.096+0000 7f3766130700 1 -- 172.21.15.8:0/646539191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750005040 con 0x7f37600f6530 2023-10-18T21:52:24.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.096+0000 7f3766130700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37600f6530 0x7f376006b9a0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f375c002700 tx=0x7f375c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:24.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.097+0000 7f3756ffd700 1 -- 172.21.15.8:0/646539191 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f375c0079c0 con 0x7f37600f6530 2023-10-18T21:52:24.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.097+0000 7f3756ffd700 1 -- 172.21.15.8:0/646539191 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f375c00f040 con 0x7f37600f6530 2023-10-18T21:52:24.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.097+0000 7f3767132700 1 -- 172.21.15.8:0/646539191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376006a7a0 con 0x7f37600f6530 2023-10-18T21:52:24.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.097+0000 7f3756ffd700 1 -- 172.21.15.8:0/646539191 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f375c0148d0 con 0x7f37600f6530 2023-10-18T21:52:24.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.097+0000 7f3767132700 1 -- 172.21.15.8:0/646539191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376010ed70 con 0x7f37600f6530 2023-10-18T21:52:24.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.098+0000 7f3767132700 1 -- 172.21.15.8:0/646539191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3760045ad0 con 0x7f37600f6530 2023-10-18T21:52:24.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.099+0000 7f3756ffd700 1 -- 172.21.15.8:0/646539191 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f375c01b060 con 0x7f37600f6530 2023-10-18T21:52:24.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.099+0000 7f3756ffd700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f374c060f70 0x7f374c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:24.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.099+0000 7f3756ffd700 1 -- 172.21.15.8:0/646539191 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f375c07c710 con 0x7f37600f6530 2023-10-18T21:52:24.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.100+0000 7f376592f700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f374c060f70 0x7f374c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:24.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.100+0000 7f376592f700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f374c060f70 0x7f374c063430 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f3750004630 tx=0x7f3750009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:24.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.103+0000 7f3756ffd700 1 -- 172.21.15.8:0/646539191 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f375c04c380 con 0x7f37600f6530 2023-10-18T21:52:24.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.301+0000 7f3767132700 1 -- 172.21.15.8:0/646539191 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37600fee70 con 0x7f374c060f70 2023-10-18T21:52:24.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.303+0000 7f3756ffd700 1 -- 172.21.15.8:0/646539191 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3750019040 con 0x7f374c060f70 2023-10-18T21:52:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 -- 172.21.15.8:0/646539191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f374c060f70 msgr2=0x7f374c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f374c060f70 0x7f374c063430 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f3750004630 tx=0x7f3750009b30).stop 2023-10-18T21:52:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 -- 172.21.15.8:0/646539191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37600f6530 msgr2=0x7f376006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:24.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37600f6530 0x7f376006b9a0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f375c002700 tx=0x7f375c009d80).stop 2023-10-18T21:52:24.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 -- 172.21.15.8:0/646539191 shutdown_connections 2023-10-18T21:52:24.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f374c060f70 0x7f374c063430 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37600f6530 0x7f376006b9a0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 --2- 172.21.15.8:0/646539191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37600f77d0 0x7f3760069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 -- 172.21.15.8:0/646539191 >> 172.21.15.8:0/646539191 conn(0x7f37600f1c90 msgr2=0x7f37600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:24.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 -- 172.21.15.8:0/646539191 shutdown_connections 2023-10-18T21:52:24.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.305+0000 7f3767132700 1 -- 172.21.15.8:0/646539191 wait complete. 2023-10-18T21:52:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.442+0000 7fee8214a700 1 -- 172.21.15.8:0/1916747867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee7c0f6530 msgr2=0x7fee7c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.442+0000 7fee8214a700 1 --2- 172.21.15.8:0/1916747867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee7c0f6530 0x7fee7c0f6950 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7fee78004660 tx=0x7fee78009b30).stop 2023-10-18T21:52:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.442+0000 7fee8214a700 1 -- 172.21.15.8:0/1916747867 shutdown_connections 2023-10-18T21:52:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.442+0000 7fee8214a700 1 --2- 172.21.15.8:0/1916747867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee7c0f77d0 0x7fee7c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.442+0000 7fee8214a700 1 --2- 172.21.15.8:0/1916747867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee7c0f6530 0x7fee7c0f6950 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.442+0000 7fee8214a700 1 -- 172.21.15.8:0/1916747867 >> 172.21.15.8:0/1916747867 conn(0x7fee7c0f1c90 msgr2=0x7fee7c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:24.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.442+0000 7fee8214a700 1 -- 172.21.15.8:0/1916747867 shutdown_connections 2023-10-18T21:52:24.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.442+0000 7fee8214a700 1 -- 172.21.15.8:0/1916747867 wait complete. 2023-10-18T21:52:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.443+0000 7fee8214a700 1 Processor -- start 2023-10-18T21:52:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.443+0000 7fee8214a700 1 -- start start 2023-10-18T21:52:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.443+0000 7fee8214a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee7c0f6530 0x7fee7c108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.443+0000 7fee8214a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee7c0f77d0 0x7fee7c1094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.443+0000 7fee8214a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c109a50 con 0x7fee7c0f77d0 2023-10-18T21:52:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.443+0000 7fee8214a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c109b90 con 0x7fee7c0f6530 2023-10-18T21:52:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.444+0000 7fee80947700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee7c0f77d0 0x7fee7c1094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.444+0000 7fee80947700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee7c0f77d0 0x7fee7c1094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56668/0 (socket says 172.21.15.8:56668) 2023-10-18T21:52:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.444+0000 7fee80947700 1 -- 172.21.15.8:0/2742546781 learned_addr learned my addr 172.21.15.8:0/2742546781 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.444+0000 7fee81148700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee7c0f6530 0x7fee7c108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.444+0000 7fee80947700 1 -- 172.21.15.8:0/2742546781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee7c0f6530 msgr2=0x7fee7c108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.444+0000 7fee80947700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee7c0f6530 0x7fee7c108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.444+0000 7fee80947700 1 -- 172.21.15.8:0/2742546781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78005040 con 0x7fee7c0f77d0 2023-10-18T21:52:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.444+0000 7fee80947700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee7c0f77d0 0x7fee7c1094a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fee6c0026d0 tx=0x7fee6c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.445+0000 7fee71ffb700 1 -- 172.21.15.8:0/2742546781 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee6c0079c0 con 0x7fee7c0f77d0 2023-10-18T21:52:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.445+0000 7fee71ffb700 1 -- 172.21.15.8:0/2742546781 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fee6c00f040 con 0x7fee7c0f77d0 2023-10-18T21:52:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.445+0000 7fee8214a700 1 -- 172.21.15.8:0/2742546781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c10a530 con 0x7fee7c0f77d0 2023-10-18T21:52:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.445+0000 7fee71ffb700 1 -- 172.21.15.8:0/2742546781 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee6c014980 con 0x7fee7c0f77d0 2023-10-18T21:52:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.445+0000 7fee8214a700 1 -- 172.21.15.8:0/2742546781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c10aaf0 con 0x7fee7c0f77d0 2023-10-18T21:52:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.446+0000 7fee8214a700 1 -- 172.21.15.8:0/2742546781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c045ad0 con 0x7fee7c0f77d0 2023-10-18T21:52:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.447+0000 7fee71ffb700 1 -- 172.21.15.8:0/2742546781 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fee6c0090d0 con 0x7fee7c0f77d0 2023-10-18T21:52:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.447+0000 7fee71ffb700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee68060f70 0x7fee68063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.447+0000 7fee71ffb700 1 -- 172.21.15.8:0/2742546781 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fee6c07c980 con 0x7fee7c0f77d0 2023-10-18T21:52:24.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.448+0000 7fee81148700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee68060f70 0x7fee68063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:24.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.448+0000 7fee81148700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee68060f70 0x7fee68063430 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fee78004630 tx=0x7fee78009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:24.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.452+0000 7fee71ffb700 1 -- 172.21.15.8:0/2742546781 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fee6c050010 con 0x7fee7c0f77d0 2023-10-18T21:52:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.646+0000 7fee8214a700 1 -- 172.21.15.8:0/2742546781 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee7c10ad70 con 0x7fee68060f70 2023-10-18T21:52:24.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.656+0000 7fee71ffb700 1 -- 172.21.15.8:0/2742546781 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fee7c10ad70 con 0x7fee68060f70 2023-10-18T21:52:24.658 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:52:24.659 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (59m) 6m ago 60m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:52:24.659 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (52m) 6m ago 60m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:52:24.659 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (52m) 4m ago 59m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:52:24.659 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (59m) 6m ago 60m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:52:24.659 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 56m - - 2023-10-18T21:52:24.660 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 56m - - 2023-10-18T21:52:24.660 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 56m - - 2023-10-18T21:52:24.660 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 56m - - 2023-10-18T21:52:24.660 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (54m) 6m ago 61m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:52:24.660 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (53m) 4m ago 59m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:52:24.661 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (53m) 6m ago 62m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:52:24.661 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (53m) 4m ago 59m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:52:24.661 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (60m) 6m ago 60m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:52:24.661 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (59m) 4m ago 59m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:52:24.661 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (52m) 6m ago 59m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:52:24.662 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (50m) 6m ago 58m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:52:24.662 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (50m) 6m ago 58m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:52:24.662 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (49m) 4m ago 58m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:52:24.662 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (48m) 4m ago 57m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:52:24.662 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (48m) 4m ago 57m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:52:24.663 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (54m) 6m ago 59m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:52:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 -- 172.21.15.8:0/2742546781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee68060f70 msgr2=0x7fee68063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee68060f70 0x7fee68063430 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fee78004630 tx=0x7fee78009b30).stop 2023-10-18T21:52:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 -- 172.21.15.8:0/2742546781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee7c0f77d0 msgr2=0x7fee7c1094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee7c0f77d0 0x7fee7c1094a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fee6c0026d0 tx=0x7fee6c009de0).stop 2023-10-18T21:52:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 -- 172.21.15.8:0/2742546781 shutdown_connections 2023-10-18T21:52:24.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fee68060f70 0x7fee68063430 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee7c0f6530 0x7fee7c108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 --2- 172.21.15.8:0/2742546781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee7c0f77d0 0x7fee7c1094a0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 -- 172.21.15.8:0/2742546781 >> 172.21.15.8:0/2742546781 conn(0x7fee7c0f1c90 msgr2=0x7fee7c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:24.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 -- 172.21.15.8:0/2742546781 shutdown_connections 2023-10-18T21:52:24.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.658+0000 7fee8214a700 1 -- 172.21.15.8:0/2742546781 wait complete. 2023-10-18T21:52:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.797+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2268536334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00f6530 msgr2=0x7fc0a00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.797+0000 7fc0a65a8700 1 --2- 172.21.15.8:0/2268536334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00f6530 0x7fc0a00f6950 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fc09c004660 tx=0x7fc09c009b30).stop 2023-10-18T21:52:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.797+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2268536334 shutdown_connections 2023-10-18T21:52:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.797+0000 7fc0a65a8700 1 --2- 172.21.15.8:0/2268536334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a00f77d0 0x7fc0a00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.797+0000 7fc0a65a8700 1 --2- 172.21.15.8:0/2268536334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00f6530 0x7fc0a00f6950 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.797+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2268536334 >> 172.21.15.8:0/2268536334 conn(0x7fc0a00f1c90 msgr2=0x7fc0a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.797+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2268536334 shutdown_connections 2023-10-18T21:52:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.797+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2268536334 wait complete. 2023-10-18T21:52:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.798+0000 7fc0a65a8700 1 Processor -- start 2023-10-18T21:52:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.798+0000 7fc0a65a8700 1 -- start start 2023-10-18T21:52:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.798+0000 7fc0a65a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a00f6530 0x7fc0a0106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.798+0000 7fc0a65a8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00f77d0 0x7fc0a0107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.798+0000 7fc0a65a8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0107870 con 0x7fc0a00f77d0 2023-10-18T21:52:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.798+0000 7fc0a65a8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a01080b0 con 0x7fc0a00f6530 2023-10-18T21:52:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc0a4da5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00f77d0 0x7fc0a0107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc0a4da5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00f77d0 0x7fc0a0107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56682/0 (socket says 172.21.15.8:56682) 2023-10-18T21:52:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc0a4da5700 1 -- 172.21.15.8:0/2211001021 learned_addr learned my addr 172.21.15.8:0/2211001021 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc0a55a6700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a00f6530 0x7fc0a0106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc0a4da5700 1 -- 172.21.15.8:0/2211001021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a00f6530 msgr2=0x7fc0a0106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc0a4da5700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a00f6530 0x7fc0a0106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc0a4da5700 1 -- 172.21.15.8:0/2211001021 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090005040 con 0x7fc0a00f77d0 2023-10-18T21:52:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc0a4da5700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00f77d0 0x7fc0a0107270 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fc090004870 tx=0x7fc090009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc095ffb700 1 -- 172.21.15.8:0/2211001021 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc09000e030 con 0x7fc0a00f77d0 2023-10-18T21:52:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc095ffb700 1 -- 172.21.15.8:0/2211001021 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc09000f040 con 0x7fc0a00f77d0 2023-10-18T21:52:24.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc095ffb700 1 -- 172.21.15.8:0/2211001021 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc090014940 con 0x7fc0a00f77d0 2023-10-18T21:52:24.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.799+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2211001021 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c005040 con 0x7fc0a00f77d0 2023-10-18T21:52:24.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.800+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2211001021 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a0108740 con 0x7fc0a00f77d0 2023-10-18T21:52:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.801+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2211001021 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a0059100 con 0x7fc0a00f77d0 2023-10-18T21:52:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.802+0000 7fc095ffb700 1 -- 172.21.15.8:0/2211001021 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc090010530 con 0x7fc0a00f77d0 2023-10-18T21:52:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.803+0000 7fc095ffb700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc08c060f70 0x7fc08c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.803+0000 7fc095ffb700 1 -- 172.21.15.8:0/2211001021 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc09007cff0 con 0x7fc0a00f77d0 2023-10-18T21:52:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.803+0000 7fc0a55a6700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc08c060f70 0x7fc08c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.804+0000 7fc0a55a6700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc08c060f70 0x7fc08c063430 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fc09c0043d0 tx=0x7fc09c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:24.807+0000 7fc095ffb700 1 -- 172.21.15.8:0/2211001021 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc09004cbc0 con 0x7fc0a00f77d0 2023-10-18T21:52:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.066+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2211001021 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc0a00fed80 con 0x7fc0a00f77d0 2023-10-18T21:52:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.066+0000 7fc095ffb700 1 -- 172.21.15.8:0/2211001021 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fc0900501e0 con 0x7fc0a00f77d0 2023-10-18T21:52:25.069 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:52:25.070 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:52:25.070 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:52:25.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:52:25.070 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:52:25.070 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:52:25.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:52:25.071 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:52:25.071 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:52:25.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:52:25.071 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:52:25.072 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:52:25.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:52:25.072 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:52:25.072 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:52:25.072 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:52:25.073 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:52:25.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2211001021 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc08c060f70 msgr2=0x7fc08c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc08c060f70 0x7fc08c063430 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fc09c0043d0 tx=0x7fc09c00b040).stop 2023-10-18T21:52:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2211001021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00f77d0 msgr2=0x7fc0a0107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00f77d0 0x7fc0a0107270 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fc090004870 tx=0x7fc090009b30).stop 2023-10-18T21:52:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2211001021 shutdown_connections 2023-10-18T21:52:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc08c060f70 0x7fc08c063430 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a00f6530 0x7fc0a0106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 --2- 172.21.15.8:0/2211001021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00f77d0 0x7fc0a0107270 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2211001021 >> 172.21.15.8:0/2211001021 conn(0x7fc0a00f1c90 msgr2=0x7fc0a00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2211001021 shutdown_connections 2023-10-18T21:52:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.069+0000 7fc0a65a8700 1 -- 172.21.15.8:0/2211001021 wait complete. 2023-10-18T21:52:25.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.206+0000 7f8768af1700 1 -- 172.21.15.8:0/955949531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87640f77d0 msgr2=0x7f87640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:25.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.206+0000 7f8768af1700 1 --2- 172.21.15.8:0/955949531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87640f77d0 0x7f87640f7c30 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f8758004660 tx=0x7f8758009b30).stop 2023-10-18T21:52:25.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.206+0000 7f8768af1700 1 -- 172.21.15.8:0/955949531 shutdown_connections 2023-10-18T21:52:25.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.206+0000 7f8768af1700 1 --2- 172.21.15.8:0/955949531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87640f77d0 0x7f87640f7c30 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.206+0000 7f8768af1700 1 --2- 172.21.15.8:0/955949531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87640f6530 0x7f87640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.206+0000 7f8768af1700 1 -- 172.21.15.8:0/955949531 >> 172.21.15.8:0/955949531 conn(0x7f87640f1c90 msgr2=0x7f87640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:25.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.206+0000 7f8768af1700 1 -- 172.21.15.8:0/955949531 shutdown_connections 2023-10-18T21:52:25.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.206+0000 7f8768af1700 1 -- 172.21.15.8:0/955949531 wait complete. 2023-10-18T21:52:25.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.207+0000 7f8768af1700 1 Processor -- start 2023-10-18T21:52:25.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.207+0000 7f8768af1700 1 -- start start 2023-10-18T21:52:25.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f8768af1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87640f6530 0x7f876406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:25.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f8768af1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87640f77d0 0x7f8764069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:25.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f8768af1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876410a960 con 0x7f87640f77d0 2023-10-18T21:52:25.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f8768af1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876410aaa0 con 0x7f87640f6530 2023-10-18T21:52:25.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f8762ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87640f77d0 0x7f8764069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:25.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f87637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87640f6530 0x7f876406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:25.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f8762ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87640f77d0 0x7f8764069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56692/0 (socket says 172.21.15.8:56692) 2023-10-18T21:52:25.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f87637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87640f6530 0x7f876406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:46368/0 (socket says 172.21.15.8:46368) 2023-10-18T21:52:25.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f8762ffd700 1 -- 172.21.15.8:0/228986049 learned_addr learned my addr 172.21.15.8:0/228986049 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:25.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f8762ffd700 1 -- 172.21.15.8:0/228986049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87640f6530 msgr2=0x7f876406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:25.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f8762ffd700 1 --2- 172.21.15.8:0/228986049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87640f6530 0x7f876406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.208+0000 7f8762ffd700 1 -- 172.21.15.8:0/228986049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758005040 con 0x7f87640f77d0 2023-10-18T21:52:25.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.209+0000 7f8762ffd700 1 --2- 172.21.15.8:0/228986049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87640f77d0 0x7f8764069e20 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f8758009990 tx=0x7f8758009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:25.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.209+0000 7f874bfff700 1 -- 172.21.15.8:0/228986049 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8758018070 con 0x7f87640f77d0 2023-10-18T21:52:25.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.209+0000 7f874bfff700 1 -- 172.21.15.8:0/228986049 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8758009630 con 0x7f87640f77d0 2023-10-18T21:52:25.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.209+0000 7f874bfff700 1 -- 172.21.15.8:0/228986049 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f875801c3c0 con 0x7f87640f77d0 2023-10-18T21:52:25.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.209+0000 7f8768af1700 1 -- 172.21.15.8:0/228986049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876406a370 con 0x7f87640f77d0 2023-10-18T21:52:25.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.209+0000 7f8768af1700 1 -- 172.21.15.8:0/228986049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876406a8d0 con 0x7f87640f77d0 2023-10-18T21:52:25.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.210+0000 7f8768af1700 1 -- 172.21.15.8:0/228986049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8764045ad0 con 0x7f87640f77d0 2023-10-18T21:52:25.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.211+0000 7f874bfff700 1 -- 172.21.15.8:0/228986049 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f875801d970 con 0x7f87640f77d0 2023-10-18T21:52:25.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.212+0000 7f874bfff700 1 --2- 172.21.15.8:0/228986049 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f874c060f70 0x7f874c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:25.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.212+0000 7f874bfff700 1 -- 172.21.15.8:0/228986049 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f875807e4c0 con 0x7f87640f77d0 2023-10-18T21:52:25.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.212+0000 7f87637fe700 1 --2- 172.21.15.8:0/228986049 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f874c060f70 0x7f874c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:25.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.213+0000 7f87637fe700 1 --2- 172.21.15.8:0/228986049 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f874c060f70 0x7f874c063430 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f876406b730 tx=0x7f875400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:25.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.216+0000 7f874bfff700 1 -- 172.21.15.8:0/228986049 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f875804e1b0 con 0x7f87640f77d0 2023-10-18T21:52:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:23.881093+0000 mgr.smithi008.flmjzp (mgr.14640) 3213 : cluster [DBG] pgmap v2211: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:23.955052+0000 mgr.smithi008.flmjzp (mgr.14640) 3214 : audit [DBG] from='client.36664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:25.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.443+0000 7f8768af1700 1 -- 172.21.15.8:0/228986049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8764027b40 con 0x7f87640f77d0 2023-10-18T21:52:25.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.443+0000 7f874bfff700 1 -- 172.21.15.8:0/228986049 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f8764027b40 con 0x7f87640f77d0 2023-10-18T21:52:25.446 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:52:25.446 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:52:25.446 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:52:25.446 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:52:25.447 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:52:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:52:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:52:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:52:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:52:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:52:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:52:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:52:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:52:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:52:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:52:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:52:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:52:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:52:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:52:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:52:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:52:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:52:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:52:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:52:25.451 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:52:25.451 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:52:25.451 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:52:25.451 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:52:25.451 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:52:25.452 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:52:25.452 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:52:25.452 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:52:25.452 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:52:25.452 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:52:25.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 -- 172.21.15.8:0/228986049 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f874c060f70 msgr2=0x7f874c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:25.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 --2- 172.21.15.8:0/228986049 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f874c060f70 0x7f874c063430 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f876406b730 tx=0x7f875400b040).stop 2023-10-18T21:52:25.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 -- 172.21.15.8:0/228986049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87640f77d0 msgr2=0x7f8764069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:25.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 --2- 172.21.15.8:0/228986049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87640f77d0 0x7f8764069e20 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f8758009990 tx=0x7f8758009b30).stop 2023-10-18T21:52:25.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 -- 172.21.15.8:0/228986049 shutdown_connections 2023-10-18T21:52:25.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 --2- 172.21.15.8:0/228986049 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f874c060f70 0x7f874c063430 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 --2- 172.21.15.8:0/228986049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87640f6530 0x7f876406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 --2- 172.21.15.8:0/228986049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87640f77d0 0x7f8764069e20 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 -- 172.21.15.8:0/228986049 >> 172.21.15.8:0/228986049 conn(0x7f87640f1c90 msgr2=0x7f87640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:25.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 -- 172.21.15.8:0/228986049 shutdown_connections 2023-10-18T21:52:25.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.446+0000 7f8768af1700 1 -- 172.21.15.8:0/228986049 wait complete. 2023-10-18T21:52:25.455 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:52:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:23.881093+0000 mgr.smithi008.flmjzp (mgr.14640) 3213 : cluster [DBG] pgmap v2211: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:23.955052+0000 mgr.smithi008.flmjzp (mgr.14640) 3214 : audit [DBG] from='client.36664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.583+0000 7f26061e8700 1 -- 172.21.15.8:0/2413749087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f9680 msgr2=0x7f26000fbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.583+0000 7f26061e8700 1 --2- 172.21.15.8:0/2413749087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f9680 0x7f26000fbad0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f25f0004660 tx=0x7f25f0009b30).stop 2023-10-18T21:52:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.583+0000 7f26061e8700 1 -- 172.21.15.8:0/2413749087 shutdown_connections 2023-10-18T21:52:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.583+0000 7f26061e8700 1 --2- 172.21.15.8:0/2413749087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f9680 0x7f26000fbad0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.583+0000 7f26061e8700 1 --2- 172.21.15.8:0/2413749087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2600060310 0x7f26000f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.583+0000 7f26061e8700 1 -- 172.21.15.8:0/2413749087 >> 172.21.15.8:0/2413749087 conn(0x7f26000f0b60 msgr2=0x7f26000f2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:25.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.583+0000 7f26061e8700 1 -- 172.21.15.8:0/2413749087 shutdown_connections 2023-10-18T21:52:25.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.583+0000 7f26061e8700 1 -- 172.21.15.8:0/2413749087 wait complete. 2023-10-18T21:52:25.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.584+0000 7f26061e8700 1 Processor -- start 2023-10-18T21:52:25.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.584+0000 7f26061e8700 1 -- start start 2023-10-18T21:52:25.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.584+0000 7f26061e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2600060310 0x7f2600108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:25.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.584+0000 7f26061e8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f9680 0x7f26001093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:25.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.584+0000 7f26061e8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600109980 con 0x7f26000f9680 2023-10-18T21:52:25.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.584+0000 7f26061e8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600109ac0 con 0x7f2600060310 2023-10-18T21:52:25.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.585+0000 7f26049e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f9680 0x7f26001093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:25.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.585+0000 7f26051e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2600060310 0x7f2600108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:25.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.585+0000 7f26051e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2600060310 0x7f2600108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:46390/0 (socket says 172.21.15.8:46390) 2023-10-18T21:52:25.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.585+0000 7f26049e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f9680 0x7f26001093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56716/0 (socket says 172.21.15.8:56716) 2023-10-18T21:52:25.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.585+0000 7f26051e6700 1 -- 172.21.15.8:0/577552297 learned_addr learned my addr 172.21.15.8:0/577552297 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:25.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.585+0000 7f26049e5700 1 -- 172.21.15.8:0/577552297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2600060310 msgr2=0x7f2600108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:25.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.585+0000 7f26049e5700 1 --2- 172.21.15.8:0/577552297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2600060310 0x7f2600108ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.585+0000 7f26049e5700 1 -- 172.21.15.8:0/577552297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0005040 con 0x7f26000f9680 2023-10-18T21:52:25.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.585+0000 7f26049e5700 1 --2- 172.21.15.8:0/577552297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f9680 0x7f26001093d0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f25f0004660 tx=0x7f25f000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:25.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.586+0000 7f25f5ffb700 1 -- 172.21.15.8:0/577552297 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f0019070 con 0x7f26000f9680 2023-10-18T21:52:25.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.586+0000 7f25f5ffb700 1 -- 172.21.15.8:0/577552297 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f25f0013380 con 0x7f26000f9680 2023-10-18T21:52:25.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.586+0000 7f25f5ffb700 1 -- 172.21.15.8:0/577552297 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f001ed00 con 0x7f26000f9680 2023-10-18T21:52:25.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.586+0000 7f26061e8700 1 -- 172.21.15.8:0/577552297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260010a400 con 0x7f26000f9680 2023-10-18T21:52:25.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.586+0000 7f26061e8700 1 -- 172.21.15.8:0/577552297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260010a8e0 con 0x7f26000f9680 2023-10-18T21:52:25.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.587+0000 7f26061e8700 1 -- 172.21.15.8:0/577552297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2600045ad0 con 0x7f26000f9680 2023-10-18T21:52:25.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.588+0000 7f25f5ffb700 1 -- 172.21.15.8:0/577552297 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f25f001e420 con 0x7f26000f9680 2023-10-18T21:52:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.589+0000 7f25f5ffb700 1 --2- 172.21.15.8:0/577552297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25ec060f70 0x7f25ec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.589+0000 7f25f5ffb700 1 -- 172.21.15.8:0/577552297 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f25f007dda0 con 0x7f26000f9680 2023-10-18T21:52:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.589+0000 7f26051e6700 1 --2- 172.21.15.8:0/577552297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25ec060f70 0x7f25ec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.590+0000 7f26051e6700 1 --2- 172.21.15.8:0/577552297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25ec060f70 0x7f25ec063430 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f25fc004cf0 tx=0x7f25fc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:25.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.593+0000 7f25f5ffb700 1 -- 172.21.15.8:0/577552297 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f25f0051320 con 0x7f26000f9680 2023-10-18T21:52:25.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.791+0000 7f26061e8700 1 -- 172.21.15.8:0/577552297 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26000f5600 con 0x7f25ec060f70 2023-10-18T21:52:25.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.792+0000 7f25f5ffb700 1 -- 172.21.15.8:0/577552297 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f26000f5600 con 0x7f25ec060f70 2023-10-18T21:52:25.794 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:52:25.795 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:52:25.795 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:52:25.795 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:52:25.795 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:52:25.795 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:52:25.796 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:52:25.796 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:52:25.796 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:52:25.796 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:52:25.796 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:52:25.797 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:52:25.797 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:52:25.797 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:52:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 -- 172.21.15.8:0/577552297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25ec060f70 msgr2=0x7f25ec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 --2- 172.21.15.8:0/577552297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25ec060f70 0x7f25ec063430 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f25fc004cf0 tx=0x7f25fc00b040).stop 2023-10-18T21:52:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 -- 172.21.15.8:0/577552297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f9680 msgr2=0x7f26001093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 --2- 172.21.15.8:0/577552297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f9680 0x7f26001093d0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f25f0004660 tx=0x7f25f000b040).stop 2023-10-18T21:52:25.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 -- 172.21.15.8:0/577552297 shutdown_connections 2023-10-18T21:52:25.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 --2- 172.21.15.8:0/577552297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25ec060f70 0x7f25ec063430 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 --2- 172.21.15.8:0/577552297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2600060310 0x7f2600108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 --2- 172.21.15.8:0/577552297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26000f9680 0x7f26001093d0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:25.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 -- 172.21.15.8:0/577552297 >> 172.21.15.8:0/577552297 conn(0x7f26000f0b60 msgr2=0x7f26000f4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:25.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 -- 172.21.15.8:0/577552297 shutdown_connections 2023-10-18T21:52:25.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:25.794+0000 7f26061e8700 1 -- 172.21.15.8:0/577552297 wait complete. 2023-10-18T21:52:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:24.303996+0000 mgr.smithi008.flmjzp (mgr.14640) 3215 : audit [DBG] from='client.36668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:24.648815+0000 mgr.smithi008.flmjzp (mgr.14640) 3216 : audit [DBG] from='client.36672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:25.067981+0000 mon.smithi008 (mon.0) 3586 : audit [DBG] from='client.? 172.21.15.8:0/2211001021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:25.444973+0000 mon.smithi008 (mon.0) 3587 : audit [DBG] from='client.? 172.21.15.8:0/228986049' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:52:26.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:24.303996+0000 mgr.smithi008.flmjzp (mgr.14640) 3215 : audit [DBG] from='client.36668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:24.648815+0000 mgr.smithi008.flmjzp (mgr.14640) 3216 : audit [DBG] from='client.36672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:25.067981+0000 mon.smithi008 (mon.0) 3586 : audit [DBG] from='client.? 172.21.15.8:0/2211001021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:25.444973+0000 mon.smithi008 (mon.0) 3587 : audit [DBG] from='client.? 172.21.15.8:0/228986049' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:52:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:25.793327+0000 mgr.smithi008.flmjzp (mgr.14640) 3217 : audit [DBG] from='client.36684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:25.881696+0000 mgr.smithi008.flmjzp (mgr.14640) 3218 : cluster [DBG] pgmap v2212: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:27.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:25.793327+0000 mgr.smithi008.flmjzp (mgr.14640) 3217 : audit [DBG] from='client.36684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:25.881696+0000 mgr.smithi008.flmjzp (mgr.14640) 3218 : cluster [DBG] pgmap v2212: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:29.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:27.882326+0000 mgr.smithi008.flmjzp (mgr.14640) 3219 : cluster [DBG] pgmap v2213: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:29.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:27.882326+0000 mgr.smithi008.flmjzp (mgr.14640) 3219 : cluster [DBG] pgmap v2213: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:29.906954+0000 mon.smithi008 (mon.0) 3588 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:30.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:29.906954+0000 mon.smithi008 (mon.0) 3588 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:29.883049+0000 mgr.smithi008.flmjzp (mgr.14640) 3220 : cluster [DBG] pgmap v2214: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:30.471258+0000 mon.smithi008 (mon.0) 3589 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:52:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:30.472383+0000 mon.smithi008 (mon.0) 3590 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:52:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:30.479164+0000 mon.smithi008 (mon.0) 3591 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:30.487286+0000 mon.smithi008 (mon.0) 3592 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:30.490983+0000 mon.smithi008 (mon.0) 3593 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:31.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:30.493022+0000 mon.smithi008 (mon.0) 3594 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:31.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:30.494963+0000 mon.smithi008 (mon.0) 3595 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:31.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:30.497617+0000 mon.smithi008 (mon.0) 3596 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:29.883049+0000 mgr.smithi008.flmjzp (mgr.14640) 3220 : cluster [DBG] pgmap v2214: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:30.471258+0000 mon.smithi008 (mon.0) 3589 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:52:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:30.472383+0000 mon.smithi008 (mon.0) 3590 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:52:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:30.479164+0000 mon.smithi008 (mon.0) 3591 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:30.487286+0000 mon.smithi008 (mon.0) 3592 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:30.490983+0000 mon.smithi008 (mon.0) 3593 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:30.493022+0000 mon.smithi008 (mon.0) 3594 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:30.494963+0000 mon.smithi008 (mon.0) 3595 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:30.497617+0000 mon.smithi008 (mon.0) 3596 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:32.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:52:30.473277+0000 mgr.smithi008.flmjzp (mgr.14640) 3221 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:32.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:30.474032+0000 mgr.smithi008.flmjzp (mgr.14640) 3222 : cluster [DBG] pgmap v2215: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:32.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:30.474279+0000 mgr.smithi008.flmjzp (mgr.14640) 3223 : cluster [DBG] pgmap v2216: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:32.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:52:30.500543+0000 mgr.smithi008.flmjzp (mgr.14640) 3224 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:52:30.473277+0000 mgr.smithi008.flmjzp (mgr.14640) 3221 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:30.474032+0000 mgr.smithi008.flmjzp (mgr.14640) 3222 : cluster [DBG] pgmap v2215: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:30.474279+0000 mgr.smithi008.flmjzp (mgr.14640) 3223 : cluster [DBG] pgmap v2216: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:32.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:52:30.500543+0000 mgr.smithi008.flmjzp (mgr.14640) 3224 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:34.323 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:32.474818+0000 mgr.smithi008.flmjzp (mgr.14640) 3225 : cluster [DBG] pgmap v2217: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:34.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:32.474818+0000 mgr.smithi008.flmjzp (mgr.14640) 3225 : cluster [DBG] pgmap v2217: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:34.475614+0000 mgr.smithi008.flmjzp (mgr.14640) 3226 : cluster [DBG] pgmap v2218: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:36.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:34.475614+0000 mgr.smithi008.flmjzp (mgr.14640) 3226 : cluster [DBG] pgmap v2218: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:36.476174+0000 mgr.smithi008.flmjzp (mgr.14640) 3227 : cluster [DBG] pgmap v2219: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:38.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:36.476174+0000 mgr.smithi008.flmjzp (mgr.14640) 3227 : cluster [DBG] pgmap v2219: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:38.476880+0000 mgr.smithi008.flmjzp (mgr.14640) 3228 : cluster [DBG] pgmap v2220: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:38.476880+0000 mgr.smithi008.flmjzp (mgr.14640) 3228 : cluster [DBG] pgmap v2220: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:40.504782+0000 mon.smithi008 (mon.0) 3597 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:40.506994+0000 mon.smithi008 (mon.0) 3598 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:52:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:40.508041+0000 mon.smithi008 (mon.0) 3599 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:52:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:40.514672+0000 mon.smithi008 (mon.0) 3600 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:40.521210+0000 mon.smithi008 (mon.0) 3601 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:40.524589+0000 mon.smithi008 (mon.0) 3602 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:40.526253+0000 mon.smithi008 (mon.0) 3603 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:40.527858+0000 mon.smithi008 (mon.0) 3604 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:40.529850+0000 mon.smithi008 (mon.0) 3605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:40.504782+0000 mon.smithi008 (mon.0) 3597 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:40.506994+0000 mon.smithi008 (mon.0) 3598 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:52:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:40.508041+0000 mon.smithi008 (mon.0) 3599 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:52:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:40.514672+0000 mon.smithi008 (mon.0) 3600 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:40.521210+0000 mon.smithi008 (mon.0) 3601 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:40.524589+0000 mon.smithi008 (mon.0) 3602 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:40.526253+0000 mon.smithi008 (mon.0) 3603 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:40.527858+0000 mon.smithi008 (mon.0) 3604 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:40.529850+0000 mon.smithi008 (mon.0) 3605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:42.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:40.477526+0000 mgr.smithi008.flmjzp (mgr.14640) 3229 : cluster [DBG] pgmap v2221: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:42.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:52:40.508950+0000 mgr.smithi008.flmjzp (mgr.14640) 3230 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:40.509548+0000 mgr.smithi008.flmjzp (mgr.14640) 3231 : cluster [DBG] pgmap v2222: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:40.509833+0000 mgr.smithi008.flmjzp (mgr.14640) 3232 : cluster [DBG] pgmap v2223: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:52:40.531702+0000 mgr.smithi008.flmjzp (mgr.14640) 3233 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:40.477526+0000 mgr.smithi008.flmjzp (mgr.14640) 3229 : cluster [DBG] pgmap v2221: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:52:40.508950+0000 mgr.smithi008.flmjzp (mgr.14640) 3230 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:40.509548+0000 mgr.smithi008.flmjzp (mgr.14640) 3231 : cluster [DBG] pgmap v2222: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:40.509833+0000 mgr.smithi008.flmjzp (mgr.14640) 3232 : cluster [DBG] pgmap v2223: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:52:40.531702+0000 mgr.smithi008.flmjzp (mgr.14640) 3233 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:44.324 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:42.510564+0000 mgr.smithi008.flmjzp (mgr.14640) 3234 : cluster [DBG] pgmap v2224: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:42.510564+0000 mgr.smithi008.flmjzp (mgr.14640) 3234 : cluster [DBG] pgmap v2224: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:44.511098+0000 mgr.smithi008.flmjzp (mgr.14640) 3235 : cluster [DBG] pgmap v2225: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:44.511098+0000 mgr.smithi008.flmjzp (mgr.14640) 3235 : cluster [DBG] pgmap v2225: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:48.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:46.511723+0000 mgr.smithi008.flmjzp (mgr.14640) 3236 : cluster [DBG] pgmap v2226: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:46.511723+0000 mgr.smithi008.flmjzp (mgr.14640) 3236 : cluster [DBG] pgmap v2226: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:48.512266+0000 mgr.smithi008.flmjzp (mgr.14640) 3237 : cluster [DBG] pgmap v2227: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:50.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:48.512266+0000 mgr.smithi008.flmjzp (mgr.14640) 3237 : cluster [DBG] pgmap v2227: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:50.534911+0000 mon.smithi008 (mon.0) 3606 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:50.537079+0000 mon.smithi008 (mon.0) 3607 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:52:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:50.538177+0000 mon.smithi008 (mon.0) 3608 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:52:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:50.544847+0000 mon.smithi008 (mon.0) 3609 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:50.551696+0000 mon.smithi008 (mon.0) 3610 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:50.554873+0000 mon.smithi008 (mon.0) 3611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:50.556417+0000 mon.smithi008 (mon.0) 3612 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:50.558006+0000 mon.smithi008 (mon.0) 3613 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:50.559951+0000 mon.smithi008 (mon.0) 3614 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:50.534911+0000 mon.smithi008 (mon.0) 3606 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:50.537079+0000 mon.smithi008 (mon.0) 3607 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:52:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:50.538177+0000 mon.smithi008 (mon.0) 3608 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:52:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:50.544847+0000 mon.smithi008 (mon.0) 3609 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:52:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:50.551696+0000 mon.smithi008 (mon.0) 3610 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:52:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:50.554873+0000 mon.smithi008 (mon.0) 3611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:50.556417+0000 mon.smithi008 (mon.0) 3612 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:50.558006+0000 mon.smithi008 (mon.0) 3613 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:50.559951+0000 mon.smithi008 (mon.0) 3614 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:52.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:50.512815+0000 mgr.smithi008.flmjzp (mgr.14640) 3238 : cluster [DBG] pgmap v2228: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:52.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:52:50.539174+0000 mgr.smithi008.flmjzp (mgr.14640) 3239 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:52.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:50.539726+0000 mgr.smithi008.flmjzp (mgr.14640) 3240 : cluster [DBG] pgmap v2229: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:52.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:50.540029+0000 mgr.smithi008.flmjzp (mgr.14640) 3241 : cluster [DBG] pgmap v2230: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:52.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:52:50.561806+0000 mgr.smithi008.flmjzp (mgr.14640) 3242 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:50.512815+0000 mgr.smithi008.flmjzp (mgr.14640) 3238 : cluster [DBG] pgmap v2228: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:52:50.539174+0000 mgr.smithi008.flmjzp (mgr.14640) 3239 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:52:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:50.539726+0000 mgr.smithi008.flmjzp (mgr.14640) 3240 : cluster [DBG] pgmap v2229: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:50.540029+0000 mgr.smithi008.flmjzp (mgr.14640) 3241 : cluster [DBG] pgmap v2230: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:52:50.561806+0000 mgr.smithi008.flmjzp (mgr.14640) 3242 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:52:54.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:52.540631+0000 mgr.smithi008.flmjzp (mgr.14640) 3243 : cluster [DBG] pgmap v2231: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:54.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:52.540631+0000 mgr.smithi008.flmjzp (mgr.14640) 3243 : cluster [DBG] pgmap v2231: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:55.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.947+0000 7ff140f64700 1 -- 172.21.15.8:0/2344042874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0f6530 msgr2=0x7ff13c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:55.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.947+0000 7ff140f64700 1 --2- 172.21.15.8:0/2344042874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0f6530 0x7ff13c0f6950 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7ff12c004660 tx=0x7ff12c009b30).stop 2023-10-18T21:52:55.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.947+0000 7ff140f64700 1 -- 172.21.15.8:0/2344042874 shutdown_connections 2023-10-18T21:52:55.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.947+0000 7ff140f64700 1 --2- 172.21.15.8:0/2344042874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13c0f77d0 0x7ff13c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:55.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.947+0000 7ff140f64700 1 --2- 172.21.15.8:0/2344042874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0f6530 0x7ff13c0f6950 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:55.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.947+0000 7ff140f64700 1 -- 172.21.15.8:0/2344042874 >> 172.21.15.8:0/2344042874 conn(0x7ff13c0f1c90 msgr2=0x7ff13c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:55.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.948+0000 7ff140f64700 1 -- 172.21.15.8:0/2344042874 shutdown_connections 2023-10-18T21:52:55.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.948+0000 7ff140f64700 1 -- 172.21.15.8:0/2344042874 wait complete. 2023-10-18T21:52:55.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.948+0000 7ff140f64700 1 Processor -- start 2023-10-18T21:52:55.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.949+0000 7ff140f64700 1 -- start start 2023-10-18T21:52:55.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.949+0000 7ff140f64700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0f6530 0x7ff13c108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:55.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.949+0000 7ff140f64700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13c0f77d0 0x7ff13c109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:55.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.949+0000 7ff140f64700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c109a00 con 0x7ff13c0f6530 2023-10-18T21:52:55.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.949+0000 7ff140f64700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c109b40 con 0x7ff13c0f77d0 2023-10-18T21:52:55.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.949+0000 7ff13b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0f6530 0x7ff13c108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:55.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.949+0000 7ff13b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0f6530 0x7ff13c108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46338/0 (socket says 172.21.15.8:46338) 2023-10-18T21:52:55.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.949+0000 7ff13b7fe700 1 -- 172.21.15.8:0/1007743561 learned_addr learned my addr 172.21.15.8:0/1007743561 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:55.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.949+0000 7ff13affd700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13c0f77d0 0x7ff13c109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:55.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.950+0000 7ff13b7fe700 1 -- 172.21.15.8:0/1007743561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13c0f77d0 msgr2=0x7ff13c109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:55.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.950+0000 7ff13b7fe700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13c0f77d0 0x7ff13c109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:55.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.950+0000 7ff13b7fe700 1 -- 172.21.15.8:0/1007743561 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c005040 con 0x7ff13c0f6530 2023-10-18T21:52:55.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.950+0000 7ff13b7fe700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0f6530 0x7ff13c108f60 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7ff12c004e30 tx=0x7ff12c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:55.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.950+0000 7ff123fff700 1 -- 172.21.15.8:0/1007743561 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff12c018070 con 0x7ff13c0f6530 2023-10-18T21:52:55.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.950+0000 7ff123fff700 1 -- 172.21.15.8:0/1007743561 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff12c009630 con 0x7ff13c0f6530 2023-10-18T21:52:55.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.950+0000 7ff123fff700 1 -- 172.21.15.8:0/1007743561 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff12c01c3c0 con 0x7ff13c0f6530 2023-10-18T21:52:55.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.950+0000 7ff140f64700 1 -- 172.21.15.8:0/1007743561 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c10a480 con 0x7ff13c0f6530 2023-10-18T21:52:55.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.951+0000 7ff140f64700 1 -- 172.21.15.8:0/1007743561 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c10a9e0 con 0x7ff13c0f6530 2023-10-18T21:52:55.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.952+0000 7ff140f64700 1 -- 172.21.15.8:0/1007743561 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c045ad0 con 0x7ff13c0f6530 2023-10-18T21:52:55.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.952+0000 7ff123fff700 1 -- 172.21.15.8:0/1007743561 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff12c01d420 con 0x7ff13c0f6530 2023-10-18T21:52:55.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.953+0000 7ff123fff700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff124060f70 0x7ff124063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:55.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.953+0000 7ff123fff700 1 -- 172.21.15.8:0/1007743561 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff12c07e3d0 con 0x7ff13c0f6530 2023-10-18T21:52:55.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.954+0000 7ff13affd700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff124060f70 0x7ff124063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:55.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.954+0000 7ff13affd700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff124060f70 0x7ff124063430 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7ff130004ce0 tx=0x7ff13000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:55.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:55.958+0000 7ff123fff700 1 -- 172.21.15.8:0/1007743561 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff12c051af0 con 0x7ff13c0f6530 2023-10-18T21:52:56.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.158+0000 7ff140f64700 1 -- 172.21.15.8:0/1007743561 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff13c0fee40 con 0x7ff124060f70 2023-10-18T21:52:56.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.160+0000 7ff123fff700 1 -- 172.21.15.8:0/1007743561 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff13c0fee40 con 0x7ff124060f70 2023-10-18T21:52:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 -- 172.21.15.8:0/1007743561 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff124060f70 msgr2=0x7ff124063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff124060f70 0x7ff124063430 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7ff130004ce0 tx=0x7ff13000b040).stop 2023-10-18T21:52:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 -- 172.21.15.8:0/1007743561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0f6530 msgr2=0x7ff13c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0f6530 0x7ff13c108f60 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7ff12c004e30 tx=0x7ff12c009b30).stop 2023-10-18T21:52:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 -- 172.21.15.8:0/1007743561 shutdown_connections 2023-10-18T21:52:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff124060f70 0x7ff124063430 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0f6530 0x7ff13c108f60 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 --2- 172.21.15.8:0/1007743561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13c0f77d0 0x7ff13c109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 -- 172.21.15.8:0/1007743561 >> 172.21.15.8:0/1007743561 conn(0x7ff13c0f1c90 msgr2=0x7ff13c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 -- 172.21.15.8:0/1007743561 shutdown_connections 2023-10-18T21:52:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.162+0000 7ff140f64700 1 -- 172.21.15.8:0/1007743561 wait complete. 2023-10-18T21:52:56.178 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:52:56.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.300+0000 7f4f51145700 1 -- 172.21.15.8:0/3239228801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f4c0f77d0 msgr2=0x7f4f4c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:56.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.300+0000 7f4f51145700 1 --2- 172.21.15.8:0/3239228801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f4c0f77d0 0x7f4f4c0f7c30 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f4f40004660 tx=0x7f4f40009b30).stop 2023-10-18T21:52:56.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.300+0000 7f4f51145700 1 -- 172.21.15.8:0/3239228801 shutdown_connections 2023-10-18T21:52:56.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.300+0000 7f4f51145700 1 --2- 172.21.15.8:0/3239228801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f4c0f77d0 0x7f4f4c0f7c30 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.300+0000 7f4f51145700 1 --2- 172.21.15.8:0/3239228801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f4c0f6530 0x7f4f4c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.300+0000 7f4f51145700 1 -- 172.21.15.8:0/3239228801 >> 172.21.15.8:0/3239228801 conn(0x7f4f4c0f1c90 msgr2=0x7f4f4c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:56.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.300+0000 7f4f51145700 1 -- 172.21.15.8:0/3239228801 shutdown_connections 2023-10-18T21:52:56.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.300+0000 7f4f51145700 1 -- 172.21.15.8:0/3239228801 wait complete. 2023-10-18T21:52:56.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.301+0000 7f4f51145700 1 Processor -- start 2023-10-18T21:52:56.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.301+0000 7f4f51145700 1 -- start start 2023-10-18T21:52:56.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.301+0000 7f4f51145700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f4c0f6530 0x7f4f4c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:56.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.301+0000 7f4f51145700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f4c0f77d0 0x7f4f4c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:56.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.301+0000 7f4f51145700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c109a20 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.301+0000 7f4f51145700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c109b60 con 0x7f4f4c0f6530 2023-10-18T21:52:56.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.301+0000 7f4f4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f4c0f77d0 0x7f4f4c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:56.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f4c0f77d0 0x7f4f4c109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46356/0 (socket says 172.21.15.8:46356) 2023-10-18T21:52:56.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f4b7fe700 1 -- 172.21.15.8:0/3384907124 learned_addr learned my addr 172.21.15.8:0/3384907124 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:56.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f4bfff700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f4c0f6530 0x7f4f4c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:56.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f4b7fe700 1 -- 172.21.15.8:0/3384907124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f4c0f6530 msgr2=0x7f4f4c108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:56.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f4b7fe700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f4c0f6530 0x7f4f4c108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f4b7fe700 1 -- 172.21.15.8:0/3384907124 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40005040 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f4b7fe700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f4c0f77d0 0x7f4f4c109470 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f4f40009990 tx=0x7f4f40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:56.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f48ff9700 1 -- 172.21.15.8:0/3384907124 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f40018070 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f48ff9700 1 -- 172.21.15.8:0/3384907124 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4f40009630 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f51145700 1 -- 172.21.15.8:0/3384907124 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c10a4a0 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.302+0000 7f4f48ff9700 1 -- 172.21.15.8:0/3384907124 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4001c400 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.303+0000 7f4f51145700 1 -- 172.21.15.8:0/3384907124 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c10aa00 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.304+0000 7f4f51145700 1 -- 172.21.15.8:0/3384907124 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c045ad0 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.304+0000 7f4f48ff9700 1 -- 172.21.15.8:0/3384907124 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4f4001d9e0 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.305+0000 7f4f48ff9700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f34060f70 0x7f4f34063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:56.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.305+0000 7f4f48ff9700 1 -- 172.21.15.8:0/3384907124 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4f4007e680 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.306+0000 7f4f4bfff700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f34060f70 0x7f4f34063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:56.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.306+0000 7f4f4bfff700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f34060f70 0x7f4f34063430 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f4f4c0f7630 tx=0x7f4f3c009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:56.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.310+0000 7f4f48ff9700 1 -- 172.21.15.8:0/3384907124 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4f40051ce0 con 0x7f4f4c0f77d0 2023-10-18T21:52:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:54.541258+0000 mgr.smithi008.flmjzp (mgr.14640) 3244 : cluster [DBG] pgmap v2232: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:56.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:54.541258+0000 mgr.smithi008.flmjzp (mgr.14640) 3244 : cluster [DBG] pgmap v2232: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:56.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.508+0000 7f4f51145700 1 -- 172.21.15.8:0/3384907124 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f4c0fee30 con 0x7f4f34060f70 2023-10-18T21:52:56.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.509+0000 7f4f48ff9700 1 -- 172.21.15.8:0/3384907124 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4f4c0fee30 con 0x7f4f34060f70 2023-10-18T21:52:56.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 -- 172.21.15.8:0/3384907124 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f34060f70 msgr2=0x7f4f34063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:56.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f34060f70 0x7f4f34063430 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f4f4c0f7630 tx=0x7f4f3c009c00).stop 2023-10-18T21:52:56.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 -- 172.21.15.8:0/3384907124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f4c0f77d0 msgr2=0x7f4f4c109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:56.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f4c0f77d0 0x7f4f4c109470 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f4f40009990 tx=0x7f4f40009b30).stop 2023-10-18T21:52:56.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 -- 172.21.15.8:0/3384907124 shutdown_connections 2023-10-18T21:52:56.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f34060f70 0x7f4f34063430 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f4c0f6530 0x7f4f4c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 --2- 172.21.15.8:0/3384907124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f4c0f77d0 0x7f4f4c109470 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 -- 172.21.15.8:0/3384907124 >> 172.21.15.8:0/3384907124 conn(0x7f4f4c0f1c90 msgr2=0x7f4f4c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:56.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 -- 172.21.15.8:0/3384907124 shutdown_connections 2023-10-18T21:52:56.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.511+0000 7f4f51145700 1 -- 172.21.15.8:0/3384907124 wait complete. 2023-10-18T21:52:56.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.648+0000 7f94be44d700 1 -- 172.21.15.8:0/3701442952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94b80f77d0 msgr2=0x7f94b80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:56.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.648+0000 7f94be44d700 1 --2- 172.21.15.8:0/3701442952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94b80f77d0 0x7f94b80f7c30 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f94a8004660 tx=0x7f94a8009b30).stop 2023-10-18T21:52:56.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.648+0000 7f94be44d700 1 -- 172.21.15.8:0/3701442952 shutdown_connections 2023-10-18T21:52:56.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.648+0000 7f94be44d700 1 --2- 172.21.15.8:0/3701442952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94b80f77d0 0x7f94b80f7c30 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.648+0000 7f94be44d700 1 --2- 172.21.15.8:0/3701442952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94b80f6530 0x7f94b80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.648+0000 7f94be44d700 1 -- 172.21.15.8:0/3701442952 >> 172.21.15.8:0/3701442952 conn(0x7f94b80f1c90 msgr2=0x7f94b80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:56.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.648+0000 7f94be44d700 1 -- 172.21.15.8:0/3701442952 shutdown_connections 2023-10-18T21:52:56.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.648+0000 7f94be44d700 1 -- 172.21.15.8:0/3701442952 wait complete. 2023-10-18T21:52:56.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.649+0000 7f94be44d700 1 Processor -- start 2023-10-18T21:52:56.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.649+0000 7f94be44d700 1 -- start start 2023-10-18T21:52:56.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94be44d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94b80f6530 0x7f94b8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:56.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94be44d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94b80f77d0 0x7f94b8109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:56.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94be44d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8109a20 con 0x7f94b80f77d0 2023-10-18T21:52:56.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94be44d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8109b60 con 0x7f94b80f6530 2023-10-18T21:52:56.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94bcc4a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94b80f77d0 0x7f94b8109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:56.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94bcc4a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94b80f77d0 0x7f94b8109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46380/0 (socket says 172.21.15.8:46380) 2023-10-18T21:52:56.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94bcc4a700 1 -- 172.21.15.8:0/1667395837 learned_addr learned my addr 172.21.15.8:0/1667395837 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:56.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94bd44b700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94b80f6530 0x7f94b8108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:56.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94bcc4a700 1 -- 172.21.15.8:0/1667395837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94b80f6530 msgr2=0x7f94b8108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:56.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94bcc4a700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94b80f6530 0x7f94b8108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94bcc4a700 1 -- 172.21.15.8:0/1667395837 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8005040 con 0x7f94b80f77d0 2023-10-18T21:52:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.650+0000 7f94bcc4a700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94b80f77d0 0x7f94b8109470 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f94a8009f50 tx=0x7f94a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.651+0000 7f94adffb700 1 -- 172.21.15.8:0/1667395837 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94a8018070 con 0x7f94b80f77d0 2023-10-18T21:52:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.651+0000 7f94adffb700 1 -- 172.21.15.8:0/1667395837 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f94a8009630 con 0x7f94b80f77d0 2023-10-18T21:52:56.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.651+0000 7f94be44d700 1 -- 172.21.15.8:0/1667395837 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b810a4a0 con 0x7f94b80f77d0 2023-10-18T21:52:56.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.651+0000 7f94adffb700 1 -- 172.21.15.8:0/1667395837 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94a801c3c0 con 0x7f94b80f77d0 2023-10-18T21:52:56.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.651+0000 7f94be44d700 1 -- 172.21.15.8:0/1667395837 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b810aa00 con 0x7f94b80f77d0 2023-10-18T21:52:56.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.652+0000 7f94be44d700 1 -- 172.21.15.8:0/1667395837 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b8045ad0 con 0x7f94b80f77d0 2023-10-18T21:52:56.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.653+0000 7f94adffb700 1 -- 172.21.15.8:0/1667395837 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f94a801d420 con 0x7f94b80f77d0 2023-10-18T21:52:56.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.654+0000 7f94adffb700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94a4060f70 0x7f94a4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:56.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.654+0000 7f94adffb700 1 -- 172.21.15.8:0/1667395837 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f94a807e6d0 con 0x7f94b80f77d0 2023-10-18T21:52:56.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.654+0000 7f94bd44b700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94a4060f70 0x7f94a4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:56.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.655+0000 7f94bd44b700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94a4060f70 0x7f94a4063430 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f94b80f7630 tx=0x7f94b4009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:56.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.659+0000 7f94adffb700 1 -- 172.21.15.8:0/1667395837 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f94a8051d20 con 0x7f94b80f77d0 2023-10-18T21:52:56.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.853+0000 7f94be44d700 1 -- 172.21.15.8:0/1667395837 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f94b810ac20 con 0x7f94a4060f70 2023-10-18T21:52:56.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.863+0000 7f94adffb700 1 -- 172.21.15.8:0/1667395837 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f94b810ac20 con 0x7f94a4060f70 2023-10-18T21:52:56.865 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:52:56.865 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (59m) 7m ago 61m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:52:56.866 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (53m) 7m ago 61m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:52:56.866 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (53m) 5m ago 60m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:52:56.866 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (59m) 7m ago 60m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:52:56.866 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 57m - - 2023-10-18T21:52:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 57m - - 2023-10-18T21:52:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 57m - - 2023-10-18T21:52:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 57m - - 2023-10-18T21:52:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (54m) 7m ago 62m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:52:56.867 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (54m) 5m ago 60m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:52:56.868 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (53m) 7m ago 62m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:52:56.868 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (53m) 5m ago 60m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:52:56.868 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (60m) 7m ago 60m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:52:56.868 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (59m) 5m ago 59m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:52:56.869 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (53m) 7m ago 59m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:52:56.869 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (51m) 7m ago 59m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:52:56.869 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (50m) 7m ago 59m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:52:56.869 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (50m) 5m ago 58m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:52:56.869 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (49m) 5m ago 58m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:52:56.870 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (49m) 5m ago 58m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:52:56.870 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (55m) 7m ago 60m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:52:56.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 -- 172.21.15.8:0/1667395837 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94a4060f70 msgr2=0x7f94a4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:56.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94a4060f70 0x7f94a4063430 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f94b80f7630 tx=0x7f94b4009c00).stop 2023-10-18T21:52:56.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 -- 172.21.15.8:0/1667395837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94b80f77d0 msgr2=0x7f94b8109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:56.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94b80f77d0 0x7f94b8109470 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f94a8009f50 tx=0x7f94a8009b30).stop 2023-10-18T21:52:56.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 -- 172.21.15.8:0/1667395837 shutdown_connections 2023-10-18T21:52:56.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f94a4060f70 0x7f94a4063430 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94b80f6530 0x7f94b8108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 --2- 172.21.15.8:0/1667395837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94b80f77d0 0x7f94b8109470 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:56.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 -- 172.21.15.8:0/1667395837 >> 172.21.15.8:0/1667395837 conn(0x7f94b80f1c90 msgr2=0x7f94b806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:56.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 -- 172.21.15.8:0/1667395837 shutdown_connections 2023-10-18T21:52:56.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:56.865+0000 7f94be44d700 1 -- 172.21.15.8:0/1667395837 wait complete. 2023-10-18T21:52:57.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.001+0000 7f1495319700 1 -- 172.21.15.8:0/3180142151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 msgr2=0x7f14900f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.001+0000 7f1495319700 1 --2- 172.21.15.8:0/3180142151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f14900f7c30 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f1484004660 tx=0x7f1484009b30).stop 2023-10-18T21:52:57.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.001+0000 7f1495319700 1 -- 172.21.15.8:0/3180142151 shutdown_connections 2023-10-18T21:52:57.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.001+0000 7f1495319700 1 --2- 172.21.15.8:0/3180142151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f14900f7c30 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.001+0000 7f1495319700 1 --2- 172.21.15.8:0/3180142151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 0x7f14900f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.001+0000 7f1495319700 1 -- 172.21.15.8:0/3180142151 >> 172.21.15.8:0/3180142151 conn(0x7f14900f1c90 msgr2=0x7f14900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:57.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.001+0000 7f1495319700 1 -- 172.21.15.8:0/3180142151 shutdown_connections 2023-10-18T21:52:57.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.001+0000 7f1495319700 1 -- 172.21.15.8:0/3180142151 wait complete. 2023-10-18T21:52:57.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.002+0000 7f1495319700 1 Processor -- start 2023-10-18T21:52:57.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.002+0000 7f1495319700 1 -- start start 2023-10-18T21:52:57.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.002+0000 7f1495319700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 0x7f1490108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:57.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f1495319700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:57.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f1495319700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1490109a20 con 0x7f14900f77d0 2023-10-18T21:52:57.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f1495319700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1490109b60 con 0x7f14900f6530 2023-10-18T21:52:57.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f148f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:57.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f148f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36862/0 (socket says 172.21.15.8:36862) 2023-10-18T21:52:57.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f148f7fe700 1 -- 172.21.15.8:0/2788037605 learned_addr learned my addr 172.21.15.8:0/2788037605 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:57.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f148ffff700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 0x7f1490108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:57.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f148f7fe700 1 -- 172.21.15.8:0/2788037605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 msgr2=0x7f1490108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f148f7fe700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 0x7f1490108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f148f7fe700 1 -- 172.21.15.8:0/2788037605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484005040 con 0x7f14900f77d0 2023-10-18T21:52:57.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.003+0000 7f148f7fe700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109470 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f1484009990 tx=0x7f1484009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:57.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.004+0000 7f148cff9700 1 -- 172.21.15.8:0/2788037605 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1484018070 con 0x7f14900f77d0 2023-10-18T21:52:57.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.004+0000 7f148cff9700 1 -- 172.21.15.8:0/2788037605 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1484009630 con 0x7f14900f77d0 2023-10-18T21:52:57.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.004+0000 7f148cff9700 1 -- 172.21.15.8:0/2788037605 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f148401c400 con 0x7f14900f77d0 2023-10-18T21:52:57.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.004+0000 7f1495319700 1 -- 172.21.15.8:0/2788037605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149010a4a0 con 0x7f14900f77d0 2023-10-18T21:52:57.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.004+0000 7f1495319700 1 -- 172.21.15.8:0/2788037605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149010a9b0 con 0x7f14900f77d0 2023-10-18T21:52:57.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.005+0000 7f1495319700 1 -- 172.21.15.8:0/2788037605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1490045ad0 con 0x7f14900f77d0 2023-10-18T21:52:57.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.006+0000 7f148cff9700 1 -- 172.21.15.8:0/2788037605 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f148401d9e0 con 0x7f14900f77d0 2023-10-18T21:52:57.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.007+0000 7f148cff9700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1478060f70 0x7f1478063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:57.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.007+0000 7f148cff9700 1 -- 172.21.15.8:0/2788037605 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f148407e680 con 0x7f14900f77d0 2023-10-18T21:52:57.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.007+0000 7f148ffff700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1478060f70 0x7f1478063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:57.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.007+0000 7f148ffff700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1478060f70 0x7f1478063430 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f14900f7630 tx=0x7f1480009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:57.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.011+0000 7f148cff9700 1 -- 172.21.15.8:0/2788037605 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1484051ce0 con 0x7f14900f77d0 2023-10-18T21:52:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.266+0000 7f1495319700 1 -- 172.21.15.8:0/2788037605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1490027a00 con 0x7f14900f77d0 2023-10-18T21:52:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.267+0000 7f148cff9700 1 -- 172.21.15.8:0/2788037605 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f14840518d0 con 0x7f14900f77d0 2023-10-18T21:52:57.269 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:52:57.269 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:52:57.270 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:52:57.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:52:57.270 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:52:57.270 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:52:57.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:52:57.271 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:52:57.271 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:52:57.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:52:57.271 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:52:57.271 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:52:57.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:52:57.272 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:52:57.272 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:52:57.272 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:52:57.272 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:52:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 -- 172.21.15.8:0/2788037605 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1478060f70 msgr2=0x7f1478063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1478060f70 0x7f1478063430 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f14900f7630 tx=0x7f1480009c00).stop 2023-10-18T21:52:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 -- 172.21.15.8:0/2788037605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 msgr2=0x7f1490109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109470 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f1484009990 tx=0x7f1484009b30).stop 2023-10-18T21:52:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 -- 172.21.15.8:0/2788037605 shutdown_connections 2023-10-18T21:52:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1478060f70 0x7f1478063430 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900f6530 0x7f1490108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 --2- 172.21.15.8:0/2788037605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14900f77d0 0x7f1490109470 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 -- 172.21.15.8:0/2788037605 >> 172.21.15.8:0/2788037605 conn(0x7f14900f1c90 msgr2=0x7f149006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:57.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 -- 172.21.15.8:0/2788037605 shutdown_connections 2023-10-18T21:52:57.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.269+0000 7f1495319700 1 -- 172.21.15.8:0/2788037605 wait complete. 2023-10-18T21:52:57.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.406+0000 7f818120a700 1 -- 172.21.15.8:0/3063015703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f817c0f77d0 msgr2=0x7f817c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.406+0000 7f818120a700 1 --2- 172.21.15.8:0/3063015703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f817c0f77d0 0x7f817c0f7c30 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f8170004660 tx=0x7f8170009b30).stop 2023-10-18T21:52:57.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.406+0000 7f818120a700 1 -- 172.21.15.8:0/3063015703 shutdown_connections 2023-10-18T21:52:57.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.406+0000 7f818120a700 1 --2- 172.21.15.8:0/3063015703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f817c0f77d0 0x7f817c0f7c30 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.406+0000 7f818120a700 1 --2- 172.21.15.8:0/3063015703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f817c0f6530 0x7f817c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.406+0000 7f818120a700 1 -- 172.21.15.8:0/3063015703 >> 172.21.15.8:0/3063015703 conn(0x7f817c0f1c90 msgr2=0x7f817c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:57.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.406+0000 7f818120a700 1 -- 172.21.15.8:0/3063015703 shutdown_connections 2023-10-18T21:52:57.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.406+0000 7f818120a700 1 -- 172.21.15.8:0/3063015703 wait complete. 2023-10-18T21:52:57.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.407+0000 7f818120a700 1 Processor -- start 2023-10-18T21:52:57.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.407+0000 7f818120a700 1 -- start start 2023-10-18T21:52:57.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f818120a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f817c0f6530 0x7f817c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:57.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f818120a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f817c0f77d0 0x7f817c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:57.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f818120a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c109a20 con 0x7f817c0f6530 2023-10-18T21:52:57.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f818120a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c109b60 con 0x7f817c0f77d0 2023-10-18T21:52:57.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f817bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f817c0f6530 0x7f817c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:57.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f817bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f817c0f6530 0x7f817c108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36880/0 (socket says 172.21.15.8:36880) 2023-10-18T21:52:57.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f817bfff700 1 -- 172.21.15.8:0/3527350471 learned_addr learned my addr 172.21.15.8:0/3527350471 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:57.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f817b7fe700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f817c0f77d0 0x7f817c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:57.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f817bfff700 1 -- 172.21.15.8:0/3527350471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f817c0f77d0 msgr2=0x7f817c109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f817bfff700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f817c0f77d0 0x7f817c109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.408+0000 7f817bfff700 1 -- 172.21.15.8:0/3527350471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170005040 con 0x7f817c0f6530 2023-10-18T21:52:57.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.409+0000 7f817bfff700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f817c0f6530 0x7f817c108f80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f816c002700 tx=0x7f816c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:57.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.409+0000 7f8178ff9700 1 -- 172.21.15.8:0/3527350471 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816c0079c0 con 0x7f817c0f6530 2023-10-18T21:52:57.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.409+0000 7f8178ff9700 1 -- 172.21.15.8:0/3527350471 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f816c00f040 con 0x7f817c0f6530 2023-10-18T21:52:57.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.409+0000 7f8178ff9700 1 -- 172.21.15.8:0/3527350471 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816c0148d0 con 0x7f817c0f6530 2023-10-18T21:52:57.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.409+0000 7f818120a700 1 -- 172.21.15.8:0/3527350471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c10a500 con 0x7f817c0f6530 2023-10-18T21:52:57.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.409+0000 7f818120a700 1 -- 172.21.15.8:0/3527350471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c10aac0 con 0x7f817c0f6530 2023-10-18T21:52:57.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.410+0000 7f818120a700 1 -- 172.21.15.8:0/3527350471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c045ad0 con 0x7f817c0f6530 2023-10-18T21:52:57.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.411+0000 7f8178ff9700 1 -- 172.21.15.8:0/3527350471 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f816c01b060 con 0x7f817c0f6530 2023-10-18T21:52:57.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.412+0000 7f8178ff9700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8164060f70 0x7f8164063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:57.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.412+0000 7f8178ff9700 1 -- 172.21.15.8:0/3527350471 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f816c07c6b0 con 0x7f817c0f6530 2023-10-18T21:52:57.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.412+0000 7f817b7fe700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8164060f70 0x7f8164063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:57.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.413+0000 7f817b7fe700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8164060f70 0x7f8164063430 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f8170004630 tx=0x7f8170009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:57.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.416+0000 7f8178ff9700 1 -- 172.21.15.8:0/3527350471 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f816c04fdd0 con 0x7f817c0f6530 2023-10-18T21:52:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:56.161170+0000 mgr.smithi008.flmjzp (mgr.14640) 3245 : audit [DBG] from='client.36688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:56.161170+0000 mgr.smithi008.flmjzp (mgr.14640) 3245 : audit [DBG] from='client.36688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:57.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.641+0000 7f818120a700 1 -- 172.21.15.8:0/3527350471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f817c027a00 con 0x7f817c0f6530 2023-10-18T21:52:57.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.641+0000 7f8178ff9700 1 -- 172.21.15.8:0/3527350471 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f816c04f9c0 con 0x7f817c0f6530 2023-10-18T21:52:57.644 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:52:57.644 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:52:57.645 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:52:57.645 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:52:57.645 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:52:57.645 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:52:57.646 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:52:57.646 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:52:57.646 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:52:57.646 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:52:57.647 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:52:57.647 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:52:57.647 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:52:57.647 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:52:57.647 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:52:57.648 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:52:57.648 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:52:57.648 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:52:57.648 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:52:57.648 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:52:57.649 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:52:57.649 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:52:57.649 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:52:57.649 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:52:57.649 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:52:57.650 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:52:57.650 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:52:57.650 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:52:57.650 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:52:57.651 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:52:57.651 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:52:57.651 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:52:57.651 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:52:57.651 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:52:57.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.643+0000 7f818120a700 1 -- 172.21.15.8:0/3527350471 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8164060f70 msgr2=0x7f8164063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.643+0000 7f818120a700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8164060f70 0x7f8164063430 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f8170004630 tx=0x7f8170009b30).stop 2023-10-18T21:52:57.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.643+0000 7f818120a700 1 -- 172.21.15.8:0/3527350471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f817c0f6530 msgr2=0x7f817c108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.643+0000 7f818120a700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f817c0f6530 0x7f817c108f80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f816c002700 tx=0x7f816c009d80).stop 2023-10-18T21:52:57.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.643+0000 7f818120a700 1 -- 172.21.15.8:0/3527350471 shutdown_connections 2023-10-18T21:52:57.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.643+0000 7f818120a700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8164060f70 0x7f8164063430 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.643+0000 7f818120a700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f817c0f6530 0x7f817c108f80 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.643+0000 7f818120a700 1 --2- 172.21.15.8:0/3527350471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f817c0f77d0 0x7f817c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.643+0000 7f818120a700 1 -- 172.21.15.8:0/3527350471 >> 172.21.15.8:0/3527350471 conn(0x7f817c0f1c90 msgr2=0x7f817c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:57.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.644+0000 7f818120a700 1 -- 172.21.15.8:0/3527350471 shutdown_connections 2023-10-18T21:52:57.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.644+0000 7f818120a700 1 -- 172.21.15.8:0/3527350471 wait complete. 2023-10-18T21:52:57.655 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:52:57.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.781+0000 7effd8c23700 1 -- 172.21.15.8:0/1040987313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd406b9c0 msgr2=0x7effd4069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.781+0000 7effd8c23700 1 --2- 172.21.15.8:0/1040987313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd406b9c0 0x7effd4069ec0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7effc4004660 tx=0x7effc4009b30).stop 2023-10-18T21:52:57.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.781+0000 7effd8c23700 1 -- 172.21.15.8:0/1040987313 shutdown_connections 2023-10-18T21:52:57.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.781+0000 7effd8c23700 1 --2- 172.21.15.8:0/1040987313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd406a3b0 0x7effd406a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.781+0000 7effd8c23700 1 --2- 172.21.15.8:0/1040987313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd406b9c0 0x7effd4069ec0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.781+0000 7effd8c23700 1 -- 172.21.15.8:0/1040987313 >> 172.21.15.8:0/1040987313 conn(0x7effd40f1c90 msgr2=0x7effd40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:57.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.781+0000 7effd8c23700 1 -- 172.21.15.8:0/1040987313 shutdown_connections 2023-10-18T21:52:57.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.781+0000 7effd8c23700 1 -- 172.21.15.8:0/1040987313 wait complete. 2023-10-18T21:52:57.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.782+0000 7effd8c23700 1 Processor -- start 2023-10-18T21:52:57.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.782+0000 7effd8c23700 1 -- start start 2023-10-18T21:52:57.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd8c23700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd406a3b0 0x7effd410d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:57.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd8c23700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd406b9c0 0x7effd410d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:57.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd8c23700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd410de20 con 0x7effd406a3b0 2023-10-18T21:52:57.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd8c23700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd410df60 con 0x7effd406b9c0 2023-10-18T21:52:57.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd406a3b0 0x7effd410d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:57.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd406a3b0 0x7effd410d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36902/0 (socket says 172.21.15.8:36902) 2023-10-18T21:52:57.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd37fe700 1 -- 172.21.15.8:0/1612909795 learned_addr learned my addr 172.21.15.8:0/1612909795 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:52:57.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd2ffd700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd406b9c0 0x7effd410d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:57.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd37fe700 1 -- 172.21.15.8:0/1612909795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd406b9c0 msgr2=0x7effd410d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd37fe700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd406b9c0 0x7effd410d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd37fe700 1 -- 172.21.15.8:0/1612909795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4005040 con 0x7effd406a3b0 2023-10-18T21:52:57.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.783+0000 7effd2ffd700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd406b9c0 0x7effd410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:52:57.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.784+0000 7effd37fe700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd406a3b0 0x7effd410d380 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7effc4009f50 tx=0x7effc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:57.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.784+0000 7effbbfff700 1 -- 172.21.15.8:0/1612909795 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effc4018070 con 0x7effd406a3b0 2023-10-18T21:52:57.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.784+0000 7effbbfff700 1 -- 172.21.15.8:0/1612909795 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7effc4009630 con 0x7effd406a3b0 2023-10-18T21:52:57.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.784+0000 7effd8c23700 1 -- 172.21.15.8:0/1612909795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd410e8a0 con 0x7effd406a3b0 2023-10-18T21:52:57.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.784+0000 7effbbfff700 1 -- 172.21.15.8:0/1612909795 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effc401c3c0 con 0x7effd406a3b0 2023-10-18T21:52:57.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.784+0000 7effd8c23700 1 -- 172.21.15.8:0/1612909795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd410ee00 con 0x7effd406a3b0 2023-10-18T21:52:57.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.785+0000 7effd8c23700 1 -- 172.21.15.8:0/1612909795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd4045ad0 con 0x7effd406a3b0 2023-10-18T21:52:57.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.786+0000 7effbbfff700 1 -- 172.21.15.8:0/1612909795 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7effc401d420 con 0x7effd406a3b0 2023-10-18T21:52:57.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.787+0000 7effbbfff700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7effbc060f70 0x7effbc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:52:57.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.787+0000 7effbbfff700 1 -- 172.21.15.8:0/1612909795 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7effc407e580 con 0x7effd406a3b0 2023-10-18T21:52:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.787+0000 7effd2ffd700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7effbc060f70 0x7effbc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:52:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.788+0000 7effd2ffd700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7effbc060f70 0x7effbc063430 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7effc8009740 tx=0x7effc8009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:52:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.791+0000 7effbbfff700 1 -- 172.21.15.8:0/1612909795 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7effc4051d10 con 0x7effd406a3b0 2023-10-18T21:52:57.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.991+0000 7effd8c23700 1 -- 172.21.15.8:0/1612909795 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7effd4105420 con 0x7effbc060f70 2023-10-18T21:52:57.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.992+0000 7effbbfff700 1 -- 172.21.15.8:0/1612909795 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7effd4105420 con 0x7effbc060f70 2023-10-18T21:52:57.994 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:52:57.994 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:52:57.995 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:52:57.995 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:52:57.995 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:52:57.995 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:52:57.996 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:52:57.996 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:52:57.996 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:52:57.996 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:52:57.996 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:52:57.996 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:52:57.997 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:52:57.997 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:52:57.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 -- 172.21.15.8:0/1612909795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7effbc060f70 msgr2=0x7effbc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7effbc060f70 0x7effbc063430 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7effc8009740 tx=0x7effc8009be0).stop 2023-10-18T21:52:57.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 -- 172.21.15.8:0/1612909795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd406a3b0 msgr2=0x7effd410d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:52:57.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd406a3b0 0x7effd410d380 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7effc4009f50 tx=0x7effc4009b30).stop 2023-10-18T21:52:57.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 -- 172.21.15.8:0/1612909795 shutdown_connections 2023-10-18T21:52:57.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7effbc060f70 0x7effbc063430 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd406a3b0 0x7effd410d380 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:57.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 --2- 172.21.15.8:0/1612909795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd406b9c0 0x7effd410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:52:58.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 -- 172.21.15.8:0/1612909795 >> 172.21.15.8:0/1612909795 conn(0x7effd40f1c90 msgr2=0x7effd40f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:52:58.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 -- 172.21.15.8:0/1612909795 shutdown_connections 2023-10-18T21:52:58.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:52:57.994+0000 7effd8c23700 1 -- 172.21.15.8:0/1612909795 wait complete. 2023-10-18T21:52:58.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:56.510359+0000 mgr.smithi008.flmjzp (mgr.14640) 3246 : audit [DBG] from='client.36692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:58.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:56.541709+0000 mgr.smithi008.flmjzp (mgr.14640) 3247 : cluster [DBG] pgmap v2233: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:58.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:56.855708+0000 mgr.smithi008.flmjzp (mgr.14640) 3248 : audit [DBG] from='client.36696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:58.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:57.268311+0000 mon.smithi008 (mon.0) 3615 : audit [DBG] from='client.? 172.21.15.8:0/2788037605' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:58.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:57.643051+0000 mon.smithi008 (mon.0) 3616 : audit [DBG] from='client.? 172.21.15.8:0/3527350471' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:52:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:56.510359+0000 mgr.smithi008.flmjzp (mgr.14640) 3246 : audit [DBG] from='client.36692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:56.541709+0000 mgr.smithi008.flmjzp (mgr.14640) 3247 : cluster [DBG] pgmap v2233: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:52:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:56.855708+0000 mgr.smithi008.flmjzp (mgr.14640) 3248 : audit [DBG] from='client.36696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:57.268311+0000 mon.smithi008 (mon.0) 3615 : audit [DBG] from='client.? 172.21.15.8:0/2788037605' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:52:58.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:57.643051+0000 mon.smithi008 (mon.0) 3616 : audit [DBG] from='client.? 172.21.15.8:0/3527350471' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:52:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:52:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:52:57.993485+0000 mgr.smithi008.flmjzp (mgr.14640) 3249 : audit [DBG] from='client.36708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:52:59.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:52:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:52:57.993485+0000 mgr.smithi008.flmjzp (mgr.14640) 3249 : audit [DBG] from='client.36708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:53:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:52:58.542383+0000 mgr.smithi008.flmjzp (mgr.14640) 3250 : cluster [DBG] pgmap v2234: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:52:58.542383+0000 mgr.smithi008.flmjzp (mgr.14640) 3250 : cluster [DBG] pgmap v2234: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:00.564634+0000 mon.smithi008 (mon.0) 3617 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:00.566712+0000 mon.smithi008 (mon.0) 3618 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:00.567741+0000 mon.smithi008 (mon.0) 3619 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:00.574184+0000 mon.smithi008 (mon.0) 3620 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:00.581759+0000 mon.smithi008 (mon.0) 3621 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:01.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:00.585141+0000 mon.smithi008 (mon.0) 3622 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:01.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:00.587009+0000 mon.smithi008 (mon.0) 3623 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:01.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:00.588796+0000 mon.smithi008 (mon.0) 3624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:01.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:00.591335+0000 mon.smithi008 (mon.0) 3625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:00.564634+0000 mon.smithi008 (mon.0) 3617 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:00.566712+0000 mon.smithi008 (mon.0) 3618 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:00.567741+0000 mon.smithi008 (mon.0) 3619 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:00.574184+0000 mon.smithi008 (mon.0) 3620 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:00.581759+0000 mon.smithi008 (mon.0) 3621 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:00.585141+0000 mon.smithi008 (mon.0) 3622 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:00.587009+0000 mon.smithi008 (mon.0) 3623 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:00.588796+0000 mon.smithi008 (mon.0) 3624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:00.591335+0000 mon.smithi008 (mon.0) 3625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:02.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:00.542979+0000 mgr.smithi008.flmjzp (mgr.14640) 3251 : cluster [DBG] pgmap v2235: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:02.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:00.568702+0000 mgr.smithi008.flmjzp (mgr.14640) 3252 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:02.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:00.569239+0000 mgr.smithi008.flmjzp (mgr.14640) 3253 : cluster [DBG] pgmap v2236: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:02.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:00.569497+0000 mgr.smithi008.flmjzp (mgr.14640) 3254 : cluster [DBG] pgmap v2237: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:02.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:00.593424+0000 mgr.smithi008.flmjzp (mgr.14640) 3255 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:02.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:00.542979+0000 mgr.smithi008.flmjzp (mgr.14640) 3251 : cluster [DBG] pgmap v2235: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:00.568702+0000 mgr.smithi008.flmjzp (mgr.14640) 3252 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:00.569239+0000 mgr.smithi008.flmjzp (mgr.14640) 3253 : cluster [DBG] pgmap v2236: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:00.569497+0000 mgr.smithi008.flmjzp (mgr.14640) 3254 : cluster [DBG] pgmap v2237: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:00.593424+0000 mgr.smithi008.flmjzp (mgr.14640) 3255 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:04.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:02.570138+0000 mgr.smithi008.flmjzp (mgr.14640) 3256 : cluster [DBG] pgmap v2238: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:04.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:02.570138+0000 mgr.smithi008.flmjzp (mgr.14640) 3256 : cluster [DBG] pgmap v2238: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:04.570758+0000 mgr.smithi008.flmjzp (mgr.14640) 3257 : cluster [DBG] pgmap v2239: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:04.570758+0000 mgr.smithi008.flmjzp (mgr.14640) 3257 : cluster [DBG] pgmap v2239: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:08.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:06.571614+0000 mgr.smithi008.flmjzp (mgr.14640) 3258 : cluster [DBG] pgmap v2240: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:06.571614+0000 mgr.smithi008.flmjzp (mgr.14640) 3258 : cluster [DBG] pgmap v2240: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:08.572199+0000 mgr.smithi008.flmjzp (mgr.14640) 3259 : cluster [DBG] pgmap v2241: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:08.572199+0000 mgr.smithi008.flmjzp (mgr.14640) 3259 : cluster [DBG] pgmap v2241: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:10.600314+0000 mon.smithi008 (mon.0) 3626 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:10.953177+0000 mon.smithi008 (mon.0) 3627 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:10.600314+0000 mon.smithi008 (mon.0) 3626 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:10.953177+0000 mon.smithi008 (mon.0) 3627 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:12.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:10.572761+0000 mgr.smithi008.flmjzp (mgr.14640) 3260 : cluster [DBG] pgmap v2242: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:12.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:11.164211+0000 mon.smithi008 (mon.0) 3628 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:11.165078+0000 mon.smithi008 (mon.0) 3629 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:11.165747+0000 mgr.smithi008.flmjzp (mgr.14640) 3261 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:11.166238+0000 mgr.smithi008.flmjzp (mgr.14640) 3262 : cluster [DBG] pgmap v2243: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:11.166489+0000 mgr.smithi008.flmjzp (mgr.14640) 3263 : cluster [DBG] pgmap v2244: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:11.170196+0000 mon.smithi008 (mon.0) 3630 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:12.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:11.175689+0000 mon.smithi008 (mon.0) 3631 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:12.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:11.178100+0000 mon.smithi008 (mon.0) 3632 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:12.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:11.179331+0000 mon.smithi008 (mon.0) 3633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:12.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:11.180509+0000 mon.smithi008 (mon.0) 3634 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:12.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:11.181986+0000 mon.smithi008 (mon.0) 3635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:10.572761+0000 mgr.smithi008.flmjzp (mgr.14640) 3260 : cluster [DBG] pgmap v2242: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:11.164211+0000 mon.smithi008 (mon.0) 3628 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:11.165078+0000 mon.smithi008 (mon.0) 3629 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:11.165747+0000 mgr.smithi008.flmjzp (mgr.14640) 3261 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:11.166238+0000 mgr.smithi008.flmjzp (mgr.14640) 3262 : cluster [DBG] pgmap v2243: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:11.166489+0000 mgr.smithi008.flmjzp (mgr.14640) 3263 : cluster [DBG] pgmap v2244: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:11.170196+0000 mon.smithi008 (mon.0) 3630 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:11.175689+0000 mon.smithi008 (mon.0) 3631 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:11.178100+0000 mon.smithi008 (mon.0) 3632 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:11.179331+0000 mon.smithi008 (mon.0) 3633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:11.180509+0000 mon.smithi008 (mon.0) 3634 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:11.181986+0000 mon.smithi008 (mon.0) 3635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:11.183459+0000 mgr.smithi008.flmjzp (mgr.14640) 3264 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:13.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:11.183459+0000 mgr.smithi008.flmjzp (mgr.14640) 3264 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:14.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:13.167151+0000 mgr.smithi008.flmjzp (mgr.14640) 3265 : cluster [DBG] pgmap v2245: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:13.167151+0000 mgr.smithi008.flmjzp (mgr.14640) 3265 : cluster [DBG] pgmap v2245: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:15.167922+0000 mgr.smithi008.flmjzp (mgr.14640) 3266 : cluster [DBG] pgmap v2246: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:15.167922+0000 mgr.smithi008.flmjzp (mgr.14640) 3266 : cluster [DBG] pgmap v2246: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:17.168391+0000 mgr.smithi008.flmjzp (mgr.14640) 3267 : cluster [DBG] pgmap v2247: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:17.168391+0000 mgr.smithi008.flmjzp (mgr.14640) 3267 : cluster [DBG] pgmap v2247: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:19.169119+0000 mgr.smithi008.flmjzp (mgr.14640) 3268 : cluster [DBG] pgmap v2248: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:19.169119+0000 mgr.smithi008.flmjzp (mgr.14640) 3268 : cluster [DBG] pgmap v2248: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:22.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:21.169691+0000 mgr.smithi008.flmjzp (mgr.14640) 3269 : cluster [DBG] pgmap v2249: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:21.188139+0000 mon.smithi008 (mon.0) 3636 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:21.190331+0000 mon.smithi008 (mon.0) 3637 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:21.191388+0000 mon.smithi008 (mon.0) 3638 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:21.197944+0000 mon.smithi008 (mon.0) 3639 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:21.204412+0000 mon.smithi008 (mon.0) 3640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:21.207330+0000 mon.smithi008 (mon.0) 3641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:21.208934+0000 mon.smithi008 (mon.0) 3642 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:21.210539+0000 mon.smithi008 (mon.0) 3643 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:21.212570+0000 mon.smithi008 (mon.0) 3644 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:21.169691+0000 mgr.smithi008.flmjzp (mgr.14640) 3269 : cluster [DBG] pgmap v2249: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:21.188139+0000 mon.smithi008 (mon.0) 3636 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:21.190331+0000 mon.smithi008 (mon.0) 3637 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:21.191388+0000 mon.smithi008 (mon.0) 3638 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:21.197944+0000 mon.smithi008 (mon.0) 3639 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:21.204412+0000 mon.smithi008 (mon.0) 3640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:21.207330+0000 mon.smithi008 (mon.0) 3641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:21.208934+0000 mon.smithi008 (mon.0) 3642 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:21.210539+0000 mon.smithi008 (mon.0) 3643 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:21.212570+0000 mon.smithi008 (mon.0) 3644 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:21.192240+0000 mgr.smithi008.flmjzp (mgr.14640) 3270 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:21.192802+0000 mgr.smithi008.flmjzp (mgr.14640) 3271 : cluster [DBG] pgmap v2250: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:21.193052+0000 mgr.smithi008.flmjzp (mgr.14640) 3272 : cluster [DBG] pgmap v2251: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:21.214430+0000 mgr.smithi008.flmjzp (mgr.14640) 3273 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:21.192240+0000 mgr.smithi008.flmjzp (mgr.14640) 3270 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:21.192802+0000 mgr.smithi008.flmjzp (mgr.14640) 3271 : cluster [DBG] pgmap v2250: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:21.193052+0000 mgr.smithi008.flmjzp (mgr.14640) 3272 : cluster [DBG] pgmap v2251: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:23.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:21.214430+0000 mgr.smithi008.flmjzp (mgr.14640) 3273 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:25.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:23.193660+0000 mgr.smithi008.flmjzp (mgr.14640) 3274 : cluster [DBG] pgmap v2252: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:25.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:23.193660+0000 mgr.smithi008.flmjzp (mgr.14640) 3274 : cluster [DBG] pgmap v2252: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:27.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:25.194171+0000 mgr.smithi008.flmjzp (mgr.14640) 3275 : cluster [DBG] pgmap v2253: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:25.194171+0000 mgr.smithi008.flmjzp (mgr.14640) 3275 : cluster [DBG] pgmap v2253: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.148+0000 7f7587fff700 1 -- 172.21.15.8:0/3604693274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75880f77d0 msgr2=0x7f75880f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.148+0000 7f7587fff700 1 --2- 172.21.15.8:0/3604693274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75880f77d0 0x7f75880f7c30 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f757c004660 tx=0x7f757c009b30).stop 2023-10-18T21:53:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.148+0000 7f7587fff700 1 -- 172.21.15.8:0/3604693274 shutdown_connections 2023-10-18T21:53:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.148+0000 7f7587fff700 1 --2- 172.21.15.8:0/3604693274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75880f77d0 0x7f75880f7c30 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.148+0000 7f7587fff700 1 --2- 172.21.15.8:0/3604693274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75880f6530 0x7f75880f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.148+0000 7f7587fff700 1 -- 172.21.15.8:0/3604693274 >> 172.21.15.8:0/3604693274 conn(0x7f75880f1c90 msgr2=0x7f75880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:28.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.148+0000 7f7587fff700 1 -- 172.21.15.8:0/3604693274 shutdown_connections 2023-10-18T21:53:28.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.148+0000 7f7587fff700 1 -- 172.21.15.8:0/3604693274 wait complete. 2023-10-18T21:53:28.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.149+0000 7f7587fff700 1 Processor -- start 2023-10-18T21:53:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.149+0000 7f7587fff700 1 -- start start 2023-10-18T21:53:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f7587fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75880f6530 0x7f7588108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f7587fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75880f77d0 0x7f7588109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f7587fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75881099f0 con 0x7f75880f77d0 2023-10-18T21:53:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f7587fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7588109b30 con 0x7f75880f6530 2023-10-18T21:53:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f75867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75880f77d0 0x7f7588109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f75867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75880f77d0 0x7f7588109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41004/0 (socket says 172.21.15.8:41004) 2023-10-18T21:53:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f75867fc700 1 -- 172.21.15.8:0/1962801585 learned_addr learned my addr 172.21.15.8:0/1962801585 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:53:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f7586ffd700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75880f6530 0x7f7588108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f75867fc700 1 -- 172.21.15.8:0/1962801585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75880f6530 msgr2=0x7f7588108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:28.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f75867fc700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75880f6530 0x7f7588108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f75867fc700 1 -- 172.21.15.8:0/1962801585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c005040 con 0x7f75880f77d0 2023-10-18T21:53:28.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.150+0000 7f7586ffd700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75880f6530 0x7f7588108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:53:28.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.151+0000 7f75867fc700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75880f77d0 0x7f7588109440 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f757c009990 tx=0x7f757c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:28.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.151+0000 7f756f7fe700 1 -- 172.21.15.8:0/1962801585 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f757c018070 con 0x7f75880f77d0 2023-10-18T21:53:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.151+0000 7f756f7fe700 1 -- 172.21.15.8:0/1962801585 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f757c009630 con 0x7f75880f77d0 2023-10-18T21:53:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.151+0000 7f756f7fe700 1 -- 172.21.15.8:0/1962801585 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f757c01c400 con 0x7f75880f77d0 2023-10-18T21:53:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.151+0000 7f7587fff700 1 -- 172.21.15.8:0/1962801585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758810a470 con 0x7f75880f77d0 2023-10-18T21:53:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.151+0000 7f7587fff700 1 -- 172.21.15.8:0/1962801585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758810a9d0 con 0x7f75880f77d0 2023-10-18T21:53:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.152+0000 7f7587fff700 1 -- 172.21.15.8:0/1962801585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7588045ad0 con 0x7f75880f77d0 2023-10-18T21:53:28.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.153+0000 7f756f7fe700 1 -- 172.21.15.8:0/1962801585 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f757c01d9e0 con 0x7f75880f77d0 2023-10-18T21:53:28.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.154+0000 7f756f7fe700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7570060f70 0x7f7570063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:28.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.154+0000 7f756f7fe700 1 -- 172.21.15.8:0/1962801585 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f757c07e6f0 con 0x7f75880f77d0 2023-10-18T21:53:28.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.154+0000 7f7586ffd700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7570060f70 0x7f7570063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:28.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.155+0000 7f7586ffd700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7570060f70 0x7f7570063430 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f75880f7630 tx=0x7f7578009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:28.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.158+0000 7f756f7fe700 1 -- 172.21.15.8:0/1962801585 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f757c051cd0 con 0x7f75880f77d0 2023-10-18T21:53:28.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.357+0000 7f7587fff700 1 -- 172.21.15.8:0/1962801585 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f758810abf0 con 0x7f7570060f70 2023-10-18T21:53:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.358+0000 7f756f7fe700 1 -- 172.21.15.8:0/1962801585 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f758810abf0 con 0x7f7570060f70 2023-10-18T21:53:28.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 -- 172.21.15.8:0/1962801585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7570060f70 msgr2=0x7f7570063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:28.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7570060f70 0x7f7570063430 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f75880f7630 tx=0x7f7578009c00).stop 2023-10-18T21:53:28.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 -- 172.21.15.8:0/1962801585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75880f77d0 msgr2=0x7f7588109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:28.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75880f77d0 0x7f7588109440 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f757c009990 tx=0x7f757c009b30).stop 2023-10-18T21:53:28.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 -- 172.21.15.8:0/1962801585 shutdown_connections 2023-10-18T21:53:28.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7570060f70 0x7f7570063430 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75880f6530 0x7f7588108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 --2- 172.21.15.8:0/1962801585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75880f77d0 0x7f7588109440 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 -- 172.21.15.8:0/1962801585 >> 172.21.15.8:0/1962801585 conn(0x7f75880f1c90 msgr2=0x7f75880f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:28.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 -- 172.21.15.8:0/1962801585 shutdown_connections 2023-10-18T21:53:28.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.360+0000 7f7587fff700 1 -- 172.21.15.8:0/1962801585 wait complete. 2023-10-18T21:53:28.375 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:53:28.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.498+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1329727708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b240f77d0 msgr2=0x7f3b240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:28.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.498+0000 7f3b2a2de700 1 --2- 172.21.15.8:0/1329727708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b240f77d0 0x7f3b240f7c30 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f3b140045a0 tx=0x7f3b14009b30).stop 2023-10-18T21:53:28.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.498+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1329727708 shutdown_connections 2023-10-18T21:53:28.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.498+0000 7f3b2a2de700 1 --2- 172.21.15.8:0/1329727708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b240f77d0 0x7f3b240f7c30 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.498+0000 7f3b2a2de700 1 --2- 172.21.15.8:0/1329727708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b240f6530 0x7f3b240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.498+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1329727708 >> 172.21.15.8:0/1329727708 conn(0x7f3b240f1c90 msgr2=0x7f3b240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:28.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.498+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1329727708 shutdown_connections 2023-10-18T21:53:28.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.498+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1329727708 wait complete. 2023-10-18T21:53:28.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.499+0000 7f3b2a2de700 1 Processor -- start 2023-10-18T21:53:28.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.499+0000 7f3b2a2de700 1 -- start start 2023-10-18T21:53:28.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.499+0000 7f3b2a2de700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b240f6530 0x7f3b24108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:28.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.499+0000 7f3b2a2de700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b240f77d0 0x7f3b241093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:28.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.499+0000 7f3b2a2de700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24109970 con 0x7f3b240f6530 2023-10-18T21:53:28.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.499+0000 7f3b2a2de700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24109ab0 con 0x7f3b240f77d0 2023-10-18T21:53:28.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.500+0000 7f3b292dc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b240f6530 0x7f3b24108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:28.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.500+0000 7f3b292dc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b240f6530 0x7f3b24108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41012/0 (socket says 172.21.15.8:41012) 2023-10-18T21:53:28.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.500+0000 7f3b292dc700 1 -- 172.21.15.8:0/1409884334 learned_addr learned my addr 172.21.15.8:0/1409884334 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:53:28.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.500+0000 7f3b28adb700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b240f77d0 0x7f3b241093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:28.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.500+0000 7f3b292dc700 1 -- 172.21.15.8:0/1409884334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b240f77d0 msgr2=0x7f3b241093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:28.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.500+0000 7f3b292dc700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b240f77d0 0x7f3b241093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.500+0000 7f3b292dc700 1 -- 172.21.15.8:0/1409884334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14005040 con 0x7f3b240f6530 2023-10-18T21:53:28.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.500+0000 7f3b292dc700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b240f6530 0x7f3b24108ed0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f3b200041d0 tx=0x7f3b2000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:28.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.501+0000 7f3b19ffb700 1 -- 172.21.15.8:0/1409884334 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b200092e0 con 0x7f3b240f6530 2023-10-18T21:53:28.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.501+0000 7f3b19ffb700 1 -- 172.21.15.8:0/1409884334 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3b2000f040 con 0x7f3b240f6530 2023-10-18T21:53:28.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.501+0000 7f3b19ffb700 1 -- 172.21.15.8:0/1409884334 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b20014920 con 0x7f3b240f6530 2023-10-18T21:53:28.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.501+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1409884334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2410a450 con 0x7f3b240f6530 2023-10-18T21:53:28.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.501+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1409884334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2410a990 con 0x7f3b240f6530 2023-10-18T21:53:28.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.502+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1409884334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b24045ad0 con 0x7f3b240f6530 2023-10-18T21:53:28.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.503+0000 7f3b19ffb700 1 -- 172.21.15.8:0/1409884334 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3b2001b030 con 0x7f3b240f6530 2023-10-18T21:53:28.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.503+0000 7f3b19ffb700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3b10060f70 0x7f3b10063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:28.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.504+0000 7f3b19ffb700 1 -- 172.21.15.8:0/1409884334 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3b2007c920 con 0x7f3b240f6530 2023-10-18T21:53:28.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.504+0000 7f3b28adb700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3b10060f70 0x7f3b10063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:28.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.504+0000 7f3b28adb700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3b10060f70 0x7f3b10063430 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f3b14004fd0 tx=0x7f3b1400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:28.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.508+0000 7f3b19ffb700 1 -- 172.21.15.8:0/1409884334 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3b2004ff80 con 0x7f3b240f6530 2023-10-18T21:53:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.710+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1409884334 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b240fee00 con 0x7f3b10060f70 2023-10-18T21:53:28.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.711+0000 7f3b19ffb700 1 -- 172.21.15.8:0/1409884334 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3b240fee00 con 0x7f3b10060f70 2023-10-18T21:53:28.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1409884334 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3b10060f70 msgr2=0x7f3b10063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3b10060f70 0x7f3b10063430 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f3b14004fd0 tx=0x7f3b1400b040).stop 2023-10-18T21:53:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1409884334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b240f6530 msgr2=0x7f3b24108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b240f6530 0x7f3b24108ed0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f3b200041d0 tx=0x7f3b2000b040).stop 2023-10-18T21:53:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1409884334 shutdown_connections 2023-10-18T21:53:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3b10060f70 0x7f3b10063430 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b240f6530 0x7f3b24108ed0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 --2- 172.21.15.8:0/1409884334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b240f77d0 0x7f3b241093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1409884334 >> 172.21.15.8:0/1409884334 conn(0x7f3b240f1c90 msgr2=0x7f3b240f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1409884334 shutdown_connections 2023-10-18T21:53:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.713+0000 7f3b2a2de700 1 -- 172.21.15.8:0/1409884334 wait complete. 2023-10-18T21:53:28.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.852+0000 7fc6895d4700 1 -- 172.21.15.8:0/2201807956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6840f6530 msgr2=0x7fc6840f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:28.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.852+0000 7fc6895d4700 1 --2- 172.21.15.8:0/2201807956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6840f6530 0x7fc6840f6950 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fc674004660 tx=0x7fc674009b30).stop 2023-10-18T21:53:28.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.852+0000 7fc6895d4700 1 -- 172.21.15.8:0/2201807956 shutdown_connections 2023-10-18T21:53:28.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.852+0000 7fc6895d4700 1 --2- 172.21.15.8:0/2201807956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6840f77d0 0x7fc6840f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.852+0000 7fc6895d4700 1 --2- 172.21.15.8:0/2201807956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6840f6530 0x7fc6840f6950 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:28.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.852+0000 7fc6895d4700 1 -- 172.21.15.8:0/2201807956 >> 172.21.15.8:0/2201807956 conn(0x7fc6840f1c90 msgr2=0x7fc6840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:28.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.852+0000 7fc6895d4700 1 -- 172.21.15.8:0/2201807956 shutdown_connections 2023-10-18T21:53:28.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.852+0000 7fc6895d4700 1 -- 172.21.15.8:0/2201807956 wait complete. 2023-10-18T21:53:28.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.853+0000 7fc6895d4700 1 Processor -- start 2023-10-18T21:53:28.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.853+0000 7fc6895d4700 1 -- start start 2023-10-18T21:53:28.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc6895d4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6840f6530 0x7fc68406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:28.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc6895d4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6840f77d0 0x7fc684069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:28.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc6895d4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68406a380 con 0x7fc6840f6530 2023-10-18T21:53:28.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc6895d4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68406a4c0 con 0x7fc6840f77d0 2023-10-18T21:53:28.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc683fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6840f6530 0x7fc68406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:28.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc683fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6840f6530 0x7fc68406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41018/0 (socket says 172.21.15.8:41018) 2023-10-18T21:53:28.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc683fff700 1 -- 172.21.15.8:0/3159669164 learned_addr learned my addr 172.21.15.8:0/3159669164 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:53:28.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc683fff700 1 -- 172.21.15.8:0/3159669164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6840f77d0 msgr2=0x7fc684069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:28.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc683fff700 1 --2- 172.21.15.8:0/3159669164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6840f77d0 0x7fc684069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:53:28.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc683fff700 1 -- 172.21.15.8:0/3159669164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674005040 con 0x7fc6840f6530 2023-10-18T21:53:28.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.854+0000 7fc683fff700 1 --2- 172.21.15.8:0/3159669164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6840f6530 0x7fc68406b9a0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fc674009f50 tx=0x7fc674009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:28.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.855+0000 7fc680ff9700 1 -- 172.21.15.8:0/3159669164 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc674018070 con 0x7fc6840f6530 2023-10-18T21:53:28.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.855+0000 7fc680ff9700 1 -- 172.21.15.8:0/3159669164 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc67401d8e0 con 0x7fc6840f6530 2023-10-18T21:53:28.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.855+0000 7fc680ff9700 1 -- 172.21.15.8:0/3159669164 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc67401c4c0 con 0x7fc6840f6530 2023-10-18T21:53:28.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.855+0000 7fc6895d4700 1 -- 172.21.15.8:0/3159669164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68406a740 con 0x7fc6840f6530 2023-10-18T21:53:28.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.855+0000 7fc6895d4700 1 -- 172.21.15.8:0/3159669164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68406aca0 con 0x7fc6840f6530 2023-10-18T21:53:28.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.856+0000 7fc6895d4700 1 -- 172.21.15.8:0/3159669164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc684045ad0 con 0x7fc6840f6530 2023-10-18T21:53:28.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.857+0000 7fc680ff9700 1 -- 172.21.15.8:0/3159669164 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc67401d420 con 0x7fc6840f6530 2023-10-18T21:53:28.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.858+0000 7fc680ff9700 1 --2- 172.21.15.8:0/3159669164 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc66c060f70 0x7fc66c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:28.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.858+0000 7fc680ff9700 1 -- 172.21.15.8:0/3159669164 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc67407e8a0 con 0x7fc6840f6530 2023-10-18T21:53:28.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.858+0000 7fc6837fe700 1 --2- 172.21.15.8:0/3159669164 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc66c060f70 0x7fc66c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:28.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.858+0000 7fc6837fe700 1 --2- 172.21.15.8:0/3159669164 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc66c060f70 0x7fc66c063430 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fc678004970 tx=0x7fc678007a60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:28.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:28.862+0000 7fc680ff9700 1 -- 172.21.15.8:0/3159669164 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc67404e450 con 0x7fc6840f6530 2023-10-18T21:53:29.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.053+0000 7fc6895d4700 1 -- 172.21.15.8:0/3159669164 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6840fedd0 con 0x7fc66c060f70 2023-10-18T21:53:29.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.063+0000 7fc680ff9700 1 -- 172.21.15.8:0/3159669164 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc6840fedd0 con 0x7fc66c060f70 2023-10-18T21:53:29.065 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:53:29.065 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (60m) 7m ago 61m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:53:29.065 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (54m) 7m ago 61m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:53:29.065 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (53m) 5m ago 60m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:53:29.065 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (60m) 7m ago 61m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:53:29.066 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 57m - - 2023-10-18T21:53:29.066 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 57m - - 2023-10-18T21:53:29.066 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 57m - - 2023-10-18T21:53:29.066 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 57m - - 2023-10-18T21:53:29.067 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (55m) 7m ago 62m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:53:29.067 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (54m) 5m ago 60m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:53:29.067 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (54m) 7m ago 63m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:53:29.067 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (54m) 5m ago 60m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:53:29.067 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (61m) 7m ago 61m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:53:29.068 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (60m) 5m ago 60m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:53:29.068 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (53m) 7m ago 60m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:53:29.068 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (51m) 7m ago 59m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:53:29.068 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (51m) 7m ago 59m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:53:29.068 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (50m) 5m ago 59m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:53:29.069 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (50m) 5m ago 59m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:53:29.069 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (49m) 5m ago 58m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:53:29.069 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (55m) 7m ago 60m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:53:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.065+0000 7fc6895d4700 1 -- 172.21.15.8:0/3159669164 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc66c060f70 msgr2=0x7fc66c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.065+0000 7fc6895d4700 1 --2- 172.21.15.8:0/3159669164 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc66c060f70 0x7fc66c063430 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fc678004970 tx=0x7fc678007a60).stop 2023-10-18T21:53:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.065+0000 7fc6895d4700 1 -- 172.21.15.8:0/3159669164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6840f6530 msgr2=0x7fc68406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.065+0000 7fc6895d4700 1 --2- 172.21.15.8:0/3159669164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6840f6530 0x7fc68406b9a0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fc674009f50 tx=0x7fc674009b30).stop 2023-10-18T21:53:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.065+0000 7fc6895d4700 1 -- 172.21.15.8:0/3159669164 shutdown_connections 2023-10-18T21:53:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.065+0000 7fc6895d4700 1 --2- 172.21.15.8:0/3159669164 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc66c060f70 0x7fc66c063430 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.065+0000 7fc6895d4700 1 --2- 172.21.15.8:0/3159669164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6840f6530 0x7fc68406b9a0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.065+0000 7fc6895d4700 1 --2- 172.21.15.8:0/3159669164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6840f77d0 0x7fc684069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:53:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.065+0000 7fc6895d4700 1 -- 172.21.15.8:0/3159669164 >> 172.21.15.8:0/3159669164 conn(0x7fc6840f1c90 msgr2=0x7fc6840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.066+0000 7fc6895d4700 1 -- 172.21.15.8:0/3159669164 shutdown_connections 2023-10-18T21:53:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.066+0000 7fc6895d4700 1 -- 172.21.15.8:0/3159669164 wait complete. 2023-10-18T21:53:29.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:27.194842+0000 mgr.smithi008.flmjzp (mgr.14640) 3276 : cluster [DBG] pgmap v2254: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:29.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.201+0000 7f2fcd899700 1 -- 172.21.15.8:0/457753237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc80f96a0 msgr2=0x7f2fc80fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.201+0000 7f2fcd899700 1 --2- 172.21.15.8:0/457753237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc80f96a0 0x7f2fc80fbaf0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f2fb4004660 tx=0x7f2fb4009b30).stop 2023-10-18T21:53:29.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.201+0000 7f2fcd899700 1 -- 172.21.15.8:0/457753237 shutdown_connections 2023-10-18T21:53:29.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.201+0000 7f2fcd899700 1 --2- 172.21.15.8:0/457753237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc80f96a0 0x7f2fc80fbaf0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.201+0000 7f2fcd899700 1 --2- 172.21.15.8:0/457753237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fc8060310 0x7f2fc80f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.201+0000 7f2fcd899700 1 -- 172.21.15.8:0/457753237 >> 172.21.15.8:0/457753237 conn(0x7f2fc80f0ba0 msgr2=0x7f2fc80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:29.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.201+0000 7f2fcd899700 1 -- 172.21.15.8:0/457753237 shutdown_connections 2023-10-18T21:53:29.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.201+0000 7f2fcd899700 1 -- 172.21.15.8:0/457753237 wait complete. 2023-10-18T21:53:29.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.202+0000 7f2fcd899700 1 Processor -- start 2023-10-18T21:53:29.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.202+0000 7f2fcd899700 1 -- start start 2023-10-18T21:53:29.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.202+0000 7f2fcd899700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fc8060310 0x7f2fc8108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:29.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.202+0000 7f2fcd899700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc80f96a0 0x7f2fc81093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:29.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.202+0000 7f2fcd899700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc8109980 con 0x7f2fc80f96a0 2023-10-18T21:53:29.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.202+0000 7f2fcd899700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc8109ac0 con 0x7f2fc8060310 2023-10-18T21:53:29.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.203+0000 7f2fc7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc80f96a0 0x7f2fc81093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:29.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.203+0000 7f2fc7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc80f96a0 0x7f2fc81093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41044/0 (socket says 172.21.15.8:41044) 2023-10-18T21:53:29.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.203+0000 7f2fc7fff700 1 -- 172.21.15.8:0/3365093738 learned_addr learned my addr 172.21.15.8:0/3365093738 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:53:29.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.203+0000 7f2fc7fff700 1 -- 172.21.15.8:0/3365093738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fc8060310 msgr2=0x7f2fc8108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.203+0000 7f2fcc897700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fc8060310 0x7f2fc8108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:29.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.203+0000 7f2fc7fff700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fc8060310 0x7f2fc8108ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.203+0000 7f2fc7fff700 1 -- 172.21.15.8:0/3365093738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb4005040 con 0x7f2fc80f96a0 2023-10-18T21:53:29.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.203+0000 7f2fcc897700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fc8060310 0x7f2fc8108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:53:29.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.203+0000 7f2fc7fff700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc80f96a0 0x7f2fc81093d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f2fb4009870 tx=0x7f2fb400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.204+0000 7f2fc57fa700 1 -- 172.21.15.8:0/3365093738 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fb4019070 con 0x7f2fc80f96a0 2023-10-18T21:53:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.204+0000 7f2fc57fa700 1 -- 172.21.15.8:0/3365093738 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2fb401e420 con 0x7f2fc80f96a0 2023-10-18T21:53:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.204+0000 7f2fcd899700 1 -- 172.21.15.8:0/3365093738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc810a400 con 0x7f2fc80f96a0 2023-10-18T21:53:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.204+0000 7f2fc57fa700 1 -- 172.21.15.8:0/3365093738 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fb4014660 con 0x7f2fc80f96a0 2023-10-18T21:53:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.204+0000 7f2fcd899700 1 -- 172.21.15.8:0/3365093738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc810a8e0 con 0x7f2fc80f96a0 2023-10-18T21:53:29.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.205+0000 7f2fcd899700 1 -- 172.21.15.8:0/3365093738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc8045ad0 con 0x7f2fc80f96a0 2023-10-18T21:53:29.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.206+0000 7f2fc57fa700 1 -- 172.21.15.8:0/3365093738 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2fb401e9c0 con 0x7f2fc80f96a0 2023-10-18T21:53:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.207+0000 7f2fc57fa700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fb8060f70 0x7f2fb8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.207+0000 7f2fc57fa700 1 -- 172.21.15.8:0/3365093738 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2fb407de90 con 0x7f2fc80f96a0 2023-10-18T21:53:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.207+0000 7f2fcc897700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fb8060f70 0x7f2fb8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.207+0000 7f2fcc897700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fb8060f70 0x7f2fb8063430 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f2fbc009da0 tx=0x7f2fbc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.211+0000 7f2fc57fa700 1 -- 172.21.15.8:0/3365093738 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2fb4051470 con 0x7f2fc80f96a0 2023-10-18T21:53:29.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:27.194842+0000 mgr.smithi008.flmjzp (mgr.14640) 3276 : cluster [DBG] pgmap v2254: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.464+0000 7f2fcd899700 1 -- 172.21.15.8:0/3365093738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2fc810afe0 con 0x7f2fc80f96a0 2023-10-18T21:53:29.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.465+0000 7f2fc57fa700 1 -- 172.21.15.8:0/3365093738 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f2fb4051060 con 0x7f2fc80f96a0 2023-10-18T21:53:29.466 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:53:29.467 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:53:29.467 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:53:29.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:53:29.467 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:53:29.468 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:53:29.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:53:29.468 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:53:29.468 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:53:29.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:53:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:53:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:53:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:53:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:53:29.469 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:53:29.470 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:53:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:53:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 -- 172.21.15.8:0/3365093738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fb8060f70 msgr2=0x7f2fb8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fb8060f70 0x7f2fb8063430 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f2fbc009da0 tx=0x7f2fbc00b040).stop 2023-10-18T21:53:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 -- 172.21.15.8:0/3365093738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc80f96a0 msgr2=0x7f2fc81093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc80f96a0 0x7f2fc81093d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f2fb4009870 tx=0x7f2fb400b040).stop 2023-10-18T21:53:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 -- 172.21.15.8:0/3365093738 shutdown_connections 2023-10-18T21:53:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fb8060f70 0x7f2fb8063430 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fc8060310 0x7f2fc8108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 --2- 172.21.15.8:0/3365093738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc80f96a0 0x7f2fc81093d0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 -- 172.21.15.8:0/3365093738 >> 172.21.15.8:0/3365093738 conn(0x7f2fc80f0ba0 msgr2=0x7f2fc80f4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 -- 172.21.15.8:0/3365093738 shutdown_connections 2023-10-18T21:53:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.467+0000 7f2fcd899700 1 -- 172.21.15.8:0/3365093738 wait complete. 2023-10-18T21:53:29.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.602+0000 7f8238897700 1 -- 172.21.15.8:0/648008651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82340f77d0 msgr2=0x7f82340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.602+0000 7f8238897700 1 --2- 172.21.15.8:0/648008651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82340f77d0 0x7f82340f7c30 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f8228004660 tx=0x7f8228009b30).stop 2023-10-18T21:53:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.602+0000 7f8238897700 1 -- 172.21.15.8:0/648008651 shutdown_connections 2023-10-18T21:53:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.602+0000 7f8238897700 1 --2- 172.21.15.8:0/648008651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82340f77d0 0x7f82340f7c30 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.603+0000 7f8238897700 1 --2- 172.21.15.8:0/648008651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340f6530 0x7f82340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.603+0000 7f8238897700 1 -- 172.21.15.8:0/648008651 >> 172.21.15.8:0/648008651 conn(0x7f82340f1c90 msgr2=0x7f82340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.603+0000 7f8238897700 1 -- 172.21.15.8:0/648008651 shutdown_connections 2023-10-18T21:53:29.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.603+0000 7f8238897700 1 -- 172.21.15.8:0/648008651 wait complete. 2023-10-18T21:53:29.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.603+0000 7f8238897700 1 Processor -- start 2023-10-18T21:53:29.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.604+0000 7f8238897700 1 -- start start 2023-10-18T21:53:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.604+0000 7f8238897700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82340f6530 0x7f8234108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.604+0000 7f8238897700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340f77d0 0x7f8234109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.604+0000 7f8238897700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8234109a20 con 0x7f82340f6530 2023-10-18T21:53:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.604+0000 7f8238897700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8234109b60 con 0x7f82340f77d0 2023-10-18T21:53:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.604+0000 7f82337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82340f6530 0x7f8234108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.604+0000 7f82337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82340f6530 0x7f8234108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41070/0 (socket says 172.21.15.8:41070) 2023-10-18T21:53:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.604+0000 7f82337fe700 1 -- 172.21.15.8:0/4226184729 learned_addr learned my addr 172.21.15.8:0/4226184729 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:53:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.604+0000 7f8232ffd700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340f77d0 0x7f8234109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.605+0000 7f82337fe700 1 -- 172.21.15.8:0/4226184729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340f77d0 msgr2=0x7f8234109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.605+0000 7f82337fe700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340f77d0 0x7f8234109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.605+0000 7f82337fe700 1 -- 172.21.15.8:0/4226184729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228005040 con 0x7f82340f6530 2023-10-18T21:53:29.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.605+0000 7f82337fe700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82340f6530 0x7f8234108f80 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f8224002700 tx=0x7f8224009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:29.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.605+0000 7f821bfff700 1 -- 172.21.15.8:0/4226184729 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82240079c0 con 0x7f82340f6530 2023-10-18T21:53:29.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.605+0000 7f821bfff700 1 -- 172.21.15.8:0/4226184729 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f822400f040 con 0x7f82340f6530 2023-10-18T21:53:29.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.605+0000 7f821bfff700 1 -- 172.21.15.8:0/4226184729 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82240148d0 con 0x7f82340f6530 2023-10-18T21:53:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.605+0000 7f8238897700 1 -- 172.21.15.8:0/4226184729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823410a500 con 0x7f82340f6530 2023-10-18T21:53:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.605+0000 7f8238897700 1 -- 172.21.15.8:0/4226184729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823410aac0 con 0x7f82340f6530 2023-10-18T21:53:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.606+0000 7f8238897700 1 -- 172.21.15.8:0/4226184729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8234045ad0 con 0x7f82340f6530 2023-10-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.607+0000 7f821bfff700 1 -- 172.21.15.8:0/4226184729 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f822401b060 con 0x7f82340f6530 2023-10-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.608+0000 7f821bfff700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f821c060f70 0x7f821c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.608+0000 7f821bfff700 1 -- 172.21.15.8:0/4226184729 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f822407c6b0 con 0x7f82340f6530 2023-10-18T21:53:29.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.608+0000 7f8232ffd700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f821c060f70 0x7f821c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:29.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.609+0000 7f8232ffd700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f821c060f70 0x7f821c063430 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f8228004630 tx=0x7f8228009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:29.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.612+0000 7f821bfff700 1 -- 172.21.15.8:0/4226184729 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f822404fdd0 con 0x7f82340f6530 2023-10-18T21:53:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.838+0000 7f8238897700 1 -- 172.21.15.8:0/4226184729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f82340fee40 con 0x7f82340f6530 2023-10-18T21:53:29.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.838+0000 7f821bfff700 1 -- 172.21.15.8:0/4226184729 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f822404f9c0 con 0x7f82340f6530 2023-10-18T21:53:29.840 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:53:29.840 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:53:29.840 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:53:29.840 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:53:29.840 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:53:29.841 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:53:29.841 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:53:29.841 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:53:29.841 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:53:29.841 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:53:29.842 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:53:29.842 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:53:29.842 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:53:29.842 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:53:29.842 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:53:29.843 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:53:29.843 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:53:29.843 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:53:29.843 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:53:29.843 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:53:29.843 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:53:29.844 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:53:29.844 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:53:29.844 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:53:29.844 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:53:29.844 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:53:29.845 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:53:29.845 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:53:29.845 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:53:29.845 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:53:29.845 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:53:29.846 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:53:29.846 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:53:29.846 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:53:29.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 -- 172.21.15.8:0/4226184729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f821c060f70 msgr2=0x7f821c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f821c060f70 0x7f821c063430 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f8228004630 tx=0x7f8228009b30).stop 2023-10-18T21:53:29.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 -- 172.21.15.8:0/4226184729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82340f6530 msgr2=0x7f8234108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82340f6530 0x7f8234108f80 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f8224002700 tx=0x7f8224009d80).stop 2023-10-18T21:53:29.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 -- 172.21.15.8:0/4226184729 shutdown_connections 2023-10-18T21:53:29.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f821c060f70 0x7f821c063430 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82340f6530 0x7f8234108f80 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 --2- 172.21.15.8:0/4226184729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340f77d0 0x7f8234109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 -- 172.21.15.8:0/4226184729 >> 172.21.15.8:0/4226184729 conn(0x7f82340f1c90 msgr2=0x7f823406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:29.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 -- 172.21.15.8:0/4226184729 shutdown_connections 2023-10-18T21:53:29.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.840+0000 7f8238897700 1 -- 172.21.15.8:0/4226184729 wait complete. 2023-10-18T21:53:29.849 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:53:29.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.977+0000 7f2300e70700 1 -- 172.21.15.8:0/3208094576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22fc0f77d0 msgr2=0x7f22fc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.978+0000 7f2300e70700 1 --2- 172.21.15.8:0/3208094576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22fc0f77d0 0x7f22fc0f7c30 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f22f0004660 tx=0x7f22f0009b30).stop 2023-10-18T21:53:29.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.978+0000 7f2300e70700 1 -- 172.21.15.8:0/3208094576 shutdown_connections 2023-10-18T21:53:29.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.978+0000 7f2300e70700 1 --2- 172.21.15.8:0/3208094576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22fc0f77d0 0x7f22fc0f7c30 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.978+0000 7f2300e70700 1 --2- 172.21.15.8:0/3208094576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22fc0f6530 0x7f22fc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.978+0000 7f2300e70700 1 -- 172.21.15.8:0/3208094576 >> 172.21.15.8:0/3208094576 conn(0x7f22fc0f1c90 msgr2=0x7f22fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:29.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.978+0000 7f2300e70700 1 -- 172.21.15.8:0/3208094576 shutdown_connections 2023-10-18T21:53:29.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.978+0000 7f2300e70700 1 -- 172.21.15.8:0/3208094576 wait complete. 2023-10-18T21:53:29.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.978+0000 7f2300e70700 1 Processor -- start 2023-10-18T21:53:29.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.979+0000 7f2300e70700 1 -- start start 2023-10-18T21:53:29.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.979+0000 7f2300e70700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22fc0f6530 0x7f22fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:29.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.979+0000 7f2300e70700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22fc0f77d0 0x7f22fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:29.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.979+0000 7f2300e70700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc06a380 con 0x7f22fc0f6530 2023-10-18T21:53:29.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.979+0000 7f2300e70700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc06a4c0 con 0x7f22fc0f77d0 2023-10-18T21:53:29.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.979+0000 7f22fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22fc0f6530 0x7f22fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:29.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.979+0000 7f22faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22fc0f77d0 0x7f22fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:29.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.979+0000 7f22fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22fc0f6530 0x7f22fc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41086/0 (socket says 172.21.15.8:41086) 2023-10-18T21:53:29.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.979+0000 7f22fb7fe700 1 -- 172.21.15.8:0/2477644303 learned_addr learned my addr 172.21.15.8:0/2477644303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:53:29.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.980+0000 7f22fb7fe700 1 -- 172.21.15.8:0/2477644303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22fc0f77d0 msgr2=0x7f22fc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:29.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.980+0000 7f22fb7fe700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22fc0f77d0 0x7f22fc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:29.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.980+0000 7f22fb7fe700 1 -- 172.21.15.8:0/2477644303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0005040 con 0x7f22fc0f6530 2023-10-18T21:53:29.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.980+0000 7f22faffd700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22fc0f77d0 0x7f22fc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:53:29.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.980+0000 7f22fb7fe700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22fc0f6530 0x7f22fc06b9a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f22ec00c530 tx=0x7f22ec007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:29.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.980+0000 7f22e3fff700 1 -- 172.21.15.8:0/2477644303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22ec00f650 con 0x7f22fc0f6530 2023-10-18T21:53:29.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.980+0000 7f22e3fff700 1 -- 172.21.15.8:0/2477644303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f22ec00fc70 con 0x7f22fc0f6530 2023-10-18T21:53:29.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.980+0000 7f22e3fff700 1 -- 172.21.15.8:0/2477644303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22ec012d90 con 0x7f22fc0f6530 2023-10-18T21:53:29.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.980+0000 7f2300e70700 1 -- 172.21.15.8:0/2477644303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc06a7a0 con 0x7f22fc0f6530 2023-10-18T21:53:29.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.981+0000 7f2300e70700 1 -- 172.21.15.8:0/2477644303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc10ed70 con 0x7f22fc0f6530 2023-10-18T21:53:29.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.982+0000 7f2300e70700 1 -- 172.21.15.8:0/2477644303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc045ad0 con 0x7f22fc0f6530 2023-10-18T21:53:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.983+0000 7f22e3fff700 1 -- 172.21.15.8:0/2477644303 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f22ec019030 con 0x7f22fc0f6530 2023-10-18T21:53:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.983+0000 7f22e3fff700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22e4060f70 0x7f22e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:53:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.984+0000 7f22e3fff700 1 -- 172.21.15.8:0/2477644303 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f22ec07c4d0 con 0x7f22fc0f6530 2023-10-18T21:53:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.984+0000 7f22faffd700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22e4060f70 0x7f22e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:53:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.984+0000 7f22faffd700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22e4060f70 0x7f22e4063430 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f22f0004e30 tx=0x7f22f0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:53:29.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:29.988+0000 7f22e3fff700 1 -- 172.21.15.8:0/2477644303 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f22ec048f20 con 0x7f22fc0f6530 2023-10-18T21:53:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:28.358240+0000 mgr.smithi008.flmjzp (mgr.14640) 3277 : audit [DBG] from='client.36712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:53:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:28.711549+0000 mgr.smithi008.flmjzp (mgr.14640) 3278 : audit [DBG] from='client.36716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:53:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:29.055188+0000 mgr.smithi008.flmjzp (mgr.14640) 3279 : audit [DBG] from='client.36720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:53:30.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:29.465413+0000 mon.smithi008 (mon.0) 3645 : audit [DBG] from='client.? 172.21.15.8:0/3365093738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:30.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.185+0000 7f2300e70700 1 -- 172.21.15.8:0/2477644303 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22fc0fee30 con 0x7f22e4060f70 2023-10-18T21:53:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.187+0000 7f22e3fff700 1 -- 172.21.15.8:0/2477644303 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f22fc0fee30 con 0x7f22e4060f70 2023-10-18T21:53:30.188 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:53:30.188 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:53:30.188 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:53:30.189 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:53:30.189 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:53:30.189 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:53:30.189 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:53:30.189 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:53:30.189 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:53:30.190 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:53:30.190 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:53:30.190 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:53:30.190 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:53:30.190 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:53:30.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 -- 172.21.15.8:0/2477644303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22e4060f70 msgr2=0x7f22e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:30.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22e4060f70 0x7f22e4063430 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f22f0004e30 tx=0x7f22f0009b30).stop 2023-10-18T21:53:30.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 -- 172.21.15.8:0/2477644303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22fc0f6530 msgr2=0x7f22fc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:53:30.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22fc0f6530 0x7f22fc06b9a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f22ec00c530 tx=0x7f22ec007e10).stop 2023-10-18T21:53:30.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 -- 172.21.15.8:0/2477644303 shutdown_connections 2023-10-18T21:53:30.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22e4060f70 0x7f22e4063430 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:30.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22fc0f6530 0x7f22fc06b9a0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 --2- 172.21.15.8:0/2477644303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22fc0f77d0 0x7f22fc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:53:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 -- 172.21.15.8:0/2477644303 >> 172.21.15.8:0/2477644303 conn(0x7f22fc0f1c90 msgr2=0x7f22fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:53:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 -- 172.21.15.8:0/2477644303 shutdown_connections 2023-10-18T21:53:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:53:30.189+0000 7f2300e70700 1 -- 172.21.15.8:0/2477644303 wait complete. 2023-10-18T21:53:30.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:28.358240+0000 mgr.smithi008.flmjzp (mgr.14640) 3277 : audit [DBG] from='client.36712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:53:30.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:28.711549+0000 mgr.smithi008.flmjzp (mgr.14640) 3278 : audit [DBG] from='client.36716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:53:30.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:29.055188+0000 mgr.smithi008.flmjzp (mgr.14640) 3279 : audit [DBG] from='client.36720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:53:30.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:29.465413+0000 mon.smithi008 (mon.0) 3645 : audit [DBG] from='client.? 172.21.15.8:0/3365093738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:29.195341+0000 mgr.smithi008.flmjzp (mgr.14640) 3280 : cluster [DBG] pgmap v2255: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:31.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:29.838734+0000 mon.smithi008 (mon.0) 3646 : audit [DBG] from='client.? 172.21.15.8:0/4226184729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:53:31.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:29.195341+0000 mgr.smithi008.flmjzp (mgr.14640) 3280 : cluster [DBG] pgmap v2255: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:31.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:29.838734+0000 mon.smithi008 (mon.0) 3646 : audit [DBG] from='client.? 172.21.15.8:0/4226184729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:53:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:30.187148+0000 mgr.smithi008.flmjzp (mgr.14640) 3281 : audit [DBG] from='client.36732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:53:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:31.218051+0000 mon.smithi008 (mon.0) 3647 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:31.776962+0000 mon.smithi008 (mon.0) 3648 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:31.778224+0000 mon.smithi008 (mon.0) 3649 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:31.785166+0000 mon.smithi008 (mon.0) 3650 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:32.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:31.791923+0000 mon.smithi008 (mon.0) 3651 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:31.795248+0000 mon.smithi008 (mon.0) 3652 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:31.797025+0000 mon.smithi008 (mon.0) 3653 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:31.799124+0000 mon.smithi008 (mon.0) 3654 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:32.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:31.801890+0000 mon.smithi008 (mon.0) 3655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:30.187148+0000 mgr.smithi008.flmjzp (mgr.14640) 3281 : audit [DBG] from='client.36732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:53:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:31.218051+0000 mon.smithi008 (mon.0) 3647 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:31.776962+0000 mon.smithi008 (mon.0) 3648 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:31.778224+0000 mon.smithi008 (mon.0) 3649 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:32.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:31.785166+0000 mon.smithi008 (mon.0) 3650 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:32.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:31.791923+0000 mon.smithi008 (mon.0) 3651 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:32.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:31.795248+0000 mon.smithi008 (mon.0) 3652 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:32.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:31.797025+0000 mon.smithi008 (mon.0) 3653 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:32.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:31.799124+0000 mon.smithi008 (mon.0) 3654 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:32.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:31.801890+0000 mon.smithi008 (mon.0) 3655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:33.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:31.195846+0000 mgr.smithi008.flmjzp (mgr.14640) 3282 : cluster [DBG] pgmap v2256: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:31.779212+0000 mgr.smithi008.flmjzp (mgr.14640) 3283 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:31.779859+0000 mgr.smithi008.flmjzp (mgr.14640) 3284 : cluster [DBG] pgmap v2257: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:31.780096+0000 mgr.smithi008.flmjzp (mgr.14640) 3285 : cluster [DBG] pgmap v2258: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:33.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:31.804085+0000 mgr.smithi008.flmjzp (mgr.14640) 3286 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:31.195846+0000 mgr.smithi008.flmjzp (mgr.14640) 3282 : cluster [DBG] pgmap v2256: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:31.779212+0000 mgr.smithi008.flmjzp (mgr.14640) 3283 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:31.779859+0000 mgr.smithi008.flmjzp (mgr.14640) 3284 : cluster [DBG] pgmap v2257: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:31.780096+0000 mgr.smithi008.flmjzp (mgr.14640) 3285 : cluster [DBG] pgmap v2258: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:33.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:31.804085+0000 mgr.smithi008.flmjzp (mgr.14640) 3286 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:35.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:33.780880+0000 mgr.smithi008.flmjzp (mgr.14640) 3287 : cluster [DBG] pgmap v2259: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:33.780880+0000 mgr.smithi008.flmjzp (mgr.14640) 3287 : cluster [DBG] pgmap v2259: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:35.781502+0000 mgr.smithi008.flmjzp (mgr.14640) 3288 : cluster [DBG] pgmap v2260: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:35.781502+0000 mgr.smithi008.flmjzp (mgr.14640) 3288 : cluster [DBG] pgmap v2260: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:39.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:37.781988+0000 mgr.smithi008.flmjzp (mgr.14640) 3289 : cluster [DBG] pgmap v2261: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:39.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:37.781988+0000 mgr.smithi008.flmjzp (mgr.14640) 3289 : cluster [DBG] pgmap v2261: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:41.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:39.782726+0000 mgr.smithi008.flmjzp (mgr.14640) 3290 : cluster [DBG] pgmap v2262: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:41.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:39.782726+0000 mgr.smithi008.flmjzp (mgr.14640) 3290 : cluster [DBG] pgmap v2262: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:41.805501+0000 mon.smithi008 (mon.0) 3656 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:41.807572+0000 mon.smithi008 (mon.0) 3657 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:41.808607+0000 mon.smithi008 (mon.0) 3658 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:41.815269+0000 mon.smithi008 (mon.0) 3659 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:41.821728+0000 mon.smithi008 (mon.0) 3660 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:41.824772+0000 mon.smithi008 (mon.0) 3661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:42.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:41.826418+0000 mon.smithi008 (mon.0) 3662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:42.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:41.828064+0000 mon.smithi008 (mon.0) 3663 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:42.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:41.830063+0000 mon.smithi008 (mon.0) 3664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:41.805501+0000 mon.smithi008 (mon.0) 3656 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:41.807572+0000 mon.smithi008 (mon.0) 3657 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:41.808607+0000 mon.smithi008 (mon.0) 3658 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:41.815269+0000 mon.smithi008 (mon.0) 3659 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:41.821728+0000 mon.smithi008 (mon.0) 3660 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:41.824772+0000 mon.smithi008 (mon.0) 3661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:41.826418+0000 mon.smithi008 (mon.0) 3662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:42.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:41.828064+0000 mon.smithi008 (mon.0) 3663 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:42.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:41.830063+0000 mon.smithi008 (mon.0) 3664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:41.783466+0000 mgr.smithi008.flmjzp (mgr.14640) 3291 : cluster [DBG] pgmap v2263: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:41.809469+0000 mgr.smithi008.flmjzp (mgr.14640) 3292 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:41.810003+0000 mgr.smithi008.flmjzp (mgr.14640) 3293 : cluster [DBG] pgmap v2264: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:41.810344+0000 mgr.smithi008.flmjzp (mgr.14640) 3294 : cluster [DBG] pgmap v2265: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:43.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:41.831928+0000 mgr.smithi008.flmjzp (mgr.14640) 3295 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:43.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:41.783466+0000 mgr.smithi008.flmjzp (mgr.14640) 3291 : cluster [DBG] pgmap v2263: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:41.809469+0000 mgr.smithi008.flmjzp (mgr.14640) 3292 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:41.810003+0000 mgr.smithi008.flmjzp (mgr.14640) 3293 : cluster [DBG] pgmap v2264: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:41.810344+0000 mgr.smithi008.flmjzp (mgr.14640) 3294 : cluster [DBG] pgmap v2265: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:41.831928+0000 mgr.smithi008.flmjzp (mgr.14640) 3295 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:45.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:43.810934+0000 mgr.smithi008.flmjzp (mgr.14640) 3296 : cluster [DBG] pgmap v2266: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:43.810934+0000 mgr.smithi008.flmjzp (mgr.14640) 3296 : cluster [DBG] pgmap v2266: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:45.811581+0000 mgr.smithi008.flmjzp (mgr.14640) 3297 : cluster [DBG] pgmap v2267: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:45.811581+0000 mgr.smithi008.flmjzp (mgr.14640) 3297 : cluster [DBG] pgmap v2267: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:47.812074+0000 mgr.smithi008.flmjzp (mgr.14640) 3298 : cluster [DBG] pgmap v2268: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:47.812074+0000 mgr.smithi008.flmjzp (mgr.14640) 3298 : cluster [DBG] pgmap v2268: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:49.812654+0000 mgr.smithi008.flmjzp (mgr.14640) 3299 : cluster [DBG] pgmap v2269: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:51.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:49.812654+0000 mgr.smithi008.flmjzp (mgr.14640) 3299 : cluster [DBG] pgmap v2269: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:51.842884+0000 mon.smithi008 (mon.0) 3665 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:51.845126+0000 mon.smithi008 (mon.0) 3666 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:51.846250+0000 mon.smithi008 (mon.0) 3667 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:51.853112+0000 mon.smithi008 (mon.0) 3668 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:51.859466+0000 mon.smithi008 (mon.0) 3669 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:52.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:51.862776+0000 mon.smithi008 (mon.0) 3670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:52.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:51.864531+0000 mon.smithi008 (mon.0) 3671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:52.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:51.866223+0000 mon.smithi008 (mon.0) 3672 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:52.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:53:51.868295+0000 mon.smithi008 (mon.0) 3673 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:52.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:51.842884+0000 mon.smithi008 (mon.0) 3665 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:51.845126+0000 mon.smithi008 (mon.0) 3666 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:53:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:51.846250+0000 mon.smithi008 (mon.0) 3667 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:53:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:51.853112+0000 mon.smithi008 (mon.0) 3668 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:53:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:51.859466+0000 mon.smithi008 (mon.0) 3669 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:53:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:51.862776+0000 mon.smithi008 (mon.0) 3670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:51.864531+0000 mon.smithi008 (mon.0) 3671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:51.866223+0000 mon.smithi008 (mon.0) 3672 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:52.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:53:51.868295+0000 mon.smithi008 (mon.0) 3673 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:53:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:51.813275+0000 mgr.smithi008.flmjzp (mgr.14640) 3300 : cluster [DBG] pgmap v2270: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:51.847190+0000 mgr.smithi008.flmjzp (mgr.14640) 3301 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:51.847818+0000 mgr.smithi008.flmjzp (mgr.14640) 3302 : cluster [DBG] pgmap v2271: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:51.848124+0000 mgr.smithi008.flmjzp (mgr.14640) 3303 : cluster [DBG] pgmap v2272: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:53.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:53:51.870255+0000 mgr.smithi008.flmjzp (mgr.14640) 3304 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:53.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:51.813275+0000 mgr.smithi008.flmjzp (mgr.14640) 3300 : cluster [DBG] pgmap v2270: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:51.847190+0000 mgr.smithi008.flmjzp (mgr.14640) 3301 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:53:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:51.847818+0000 mgr.smithi008.flmjzp (mgr.14640) 3302 : cluster [DBG] pgmap v2271: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:51.848124+0000 mgr.smithi008.flmjzp (mgr.14640) 3303 : cluster [DBG] pgmap v2272: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:53:51.870255+0000 mgr.smithi008.flmjzp (mgr.14640) 3304 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:53:55.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:53.848719+0000 mgr.smithi008.flmjzp (mgr.14640) 3305 : cluster [DBG] pgmap v2273: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:53.848719+0000 mgr.smithi008.flmjzp (mgr.14640) 3305 : cluster [DBG] pgmap v2273: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:55.849233+0000 mgr.smithi008.flmjzp (mgr.14640) 3306 : cluster [DBG] pgmap v2274: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:55.849233+0000 mgr.smithi008.flmjzp (mgr.14640) 3306 : cluster [DBG] pgmap v2274: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:53:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:57.849924+0000 mgr.smithi008.flmjzp (mgr.14640) 3307 : cluster [DBG] pgmap v2275: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:53:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:53:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:57.849924+0000 mgr.smithi008.flmjzp (mgr.14640) 3307 : cluster [DBG] pgmap v2275: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:00.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.342+0000 7f984aac5700 1 -- 172.21.15.8:0/2413525556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98440f6530 msgr2=0x7f98440f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:00.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.342+0000 7f984aac5700 1 --2- 172.21.15.8:0/2413525556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98440f6530 0x7f98440f6950 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f9840004660 tx=0x7f9840009b30).stop 2023-10-18T21:54:00.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.342+0000 7f984aac5700 1 -- 172.21.15.8:0/2413525556 shutdown_connections 2023-10-18T21:54:00.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.342+0000 7f984aac5700 1 --2- 172.21.15.8:0/2413525556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98440f77d0 0x7f98440f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.342+0000 7f984aac5700 1 --2- 172.21.15.8:0/2413525556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98440f6530 0x7f98440f6950 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.342+0000 7f984aac5700 1 -- 172.21.15.8:0/2413525556 >> 172.21.15.8:0/2413525556 conn(0x7f98440f1c90 msgr2=0x7f98440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:00.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.342+0000 7f984aac5700 1 -- 172.21.15.8:0/2413525556 shutdown_connections 2023-10-18T21:54:00.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.342+0000 7f984aac5700 1 -- 172.21.15.8:0/2413525556 wait complete. 2023-10-18T21:54:00.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.343+0000 7f984aac5700 1 Processor -- start 2023-10-18T21:54:00.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.343+0000 7f984aac5700 1 -- start start 2023-10-18T21:54:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.343+0000 7f984aac5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98440f6530 0x7f984406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.343+0000 7f984aac5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98440f77d0 0x7f9844069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.343+0000 7f984aac5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984406a380 con 0x7f98440f77d0 2023-10-18T21:54:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.343+0000 7f984aac5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984406a4c0 con 0x7f98440f6530 2023-10-18T21:54:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.343+0000 7f98492c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98440f77d0 0x7f9844069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.343+0000 7f98492c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98440f77d0 0x7f9844069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58378/0 (socket says 172.21.15.8:58378) 2023-10-18T21:54:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.344+0000 7f98492c2700 1 -- 172.21.15.8:0/2363328827 learned_addr learned my addr 172.21.15.8:0/2363328827 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.344+0000 7f9849ac3700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98440f6530 0x7f984406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.344+0000 7f98492c2700 1 -- 172.21.15.8:0/2363328827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98440f6530 msgr2=0x7f984406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.344+0000 7f98492c2700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98440f6530 0x7f984406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.344+0000 7f98492c2700 1 -- 172.21.15.8:0/2363328827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840005040 con 0x7f98440f77d0 2023-10-18T21:54:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.344+0000 7f98492c2700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98440f77d0 0x7f9844069e20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f98340026d0 tx=0x7f9834009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.344+0000 7f983a7fc700 1 -- 172.21.15.8:0/2363328827 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98340079c0 con 0x7f98440f77d0 2023-10-18T21:54:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.345+0000 7f983a7fc700 1 -- 172.21.15.8:0/2363328827 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f983400f040 con 0x7f98440f77d0 2023-10-18T21:54:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.345+0000 7f983a7fc700 1 -- 172.21.15.8:0/2363328827 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9834014980 con 0x7f98440f77d0 2023-10-18T21:54:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.345+0000 7f984aac5700 1 -- 172.21.15.8:0/2363328827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984406a7a0 con 0x7f98440f77d0 2023-10-18T21:54:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.345+0000 7f984aac5700 1 -- 172.21.15.8:0/2363328827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984410ede0 con 0x7f98440f77d0 2023-10-18T21:54:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.346+0000 7f984aac5700 1 -- 172.21.15.8:0/2363328827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9844045ad0 con 0x7f98440f77d0 2023-10-18T21:54:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.347+0000 7f983a7fc700 1 -- 172.21.15.8:0/2363328827 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f98340090d0 con 0x7f98440f77d0 2023-10-18T21:54:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.347+0000 7f983a7fc700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9830060f70 0x7f9830063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.348+0000 7f983a7fc700 1 -- 172.21.15.8:0/2363328827 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f983407c7e0 con 0x7f98440f77d0 2023-10-18T21:54:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.348+0000 7f9849ac3700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9830060f70 0x7f9830063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.348+0000 7f9849ac3700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9830060f70 0x7f9830063430 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f9840005010 tx=0x7f9840009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.352+0000 7f983a7fc700 1 -- 172.21.15.8:0/2363328827 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f983404c580 con 0x7f98440f77d0 2023-10-18T21:54:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.551+0000 7f984aac5700 1 -- 172.21.15.8:0/2363328827 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9844057f10 con 0x7f9830060f70 2023-10-18T21:54:00.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.553+0000 7f983a7fc700 1 -- 172.21.15.8:0/2363328827 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9844057f10 con 0x7f9830060f70 2023-10-18T21:54:00.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 -- 172.21.15.8:0/2363328827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9830060f70 msgr2=0x7f9830063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:00.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9830060f70 0x7f9830063430 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f9840005010 tx=0x7f9840009b30).stop 2023-10-18T21:54:00.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 -- 172.21.15.8:0/2363328827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98440f77d0 msgr2=0x7f9844069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:00.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98440f77d0 0x7f9844069e20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f98340026d0 tx=0x7f9834009de0).stop 2023-10-18T21:54:00.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 -- 172.21.15.8:0/2363328827 shutdown_connections 2023-10-18T21:54:00.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9830060f70 0x7f9830063430 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98440f6530 0x7f984406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 --2- 172.21.15.8:0/2363328827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98440f77d0 0x7f9844069e20 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 -- 172.21.15.8:0/2363328827 >> 172.21.15.8:0/2363328827 conn(0x7f98440f1c90 msgr2=0x7f98440fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:00.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 -- 172.21.15.8:0/2363328827 shutdown_connections 2023-10-18T21:54:00.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.555+0000 7f984aac5700 1 -- 172.21.15.8:0/2363328827 wait complete. 2023-10-18T21:54:00.572 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:54:00.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.694+0000 7f97f6f69700 1 -- 172.21.15.8:0/3357828006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f00f6530 msgr2=0x7f97f00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:00.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.694+0000 7f97f6f69700 1 --2- 172.21.15.8:0/3357828006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f00f6530 0x7f97f00f6950 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f97ec004660 tx=0x7f97ec009b30).stop 2023-10-18T21:54:00.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.694+0000 7f97f6f69700 1 -- 172.21.15.8:0/3357828006 shutdown_connections 2023-10-18T21:54:00.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.694+0000 7f97f6f69700 1 --2- 172.21.15.8:0/3357828006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f00f77d0 0x7f97f00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.694+0000 7f97f6f69700 1 --2- 172.21.15.8:0/3357828006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f00f6530 0x7f97f00f6950 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.694+0000 7f97f6f69700 1 -- 172.21.15.8:0/3357828006 >> 172.21.15.8:0/3357828006 conn(0x7f97f00f1c90 msgr2=0x7f97f00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:00.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.694+0000 7f97f6f69700 1 -- 172.21.15.8:0/3357828006 shutdown_connections 2023-10-18T21:54:00.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.694+0000 7f97f6f69700 1 -- 172.21.15.8:0/3357828006 wait complete. 2023-10-18T21:54:00.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.695+0000 7f97f6f69700 1 Processor -- start 2023-10-18T21:54:00.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.695+0000 7f97f6f69700 1 -- start start 2023-10-18T21:54:00.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f6f69700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f00f6530 0x7f97f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:00.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f6f69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f00f77d0 0x7f97f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:00.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f6f69700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f006a380 con 0x7f97f00f77d0 2023-10-18T21:54:00.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f6f69700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f006a4c0 con 0x7f97f00f6530 2023-10-18T21:54:00.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f5766700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f00f77d0 0x7f97f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:00.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f5766700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f00f77d0 0x7f97f0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58386/0 (socket says 172.21.15.8:58386) 2023-10-18T21:54:00.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f5766700 1 -- 172.21.15.8:0/3898765229 learned_addr learned my addr 172.21.15.8:0/3898765229 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:00.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f5f67700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f00f6530 0x7f97f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f5766700 1 -- 172.21.15.8:0/3898765229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f00f6530 msgr2=0x7f97f006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f5766700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f00f6530 0x7f97f006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.696+0000 7f97f5766700 1 -- 172.21.15.8:0/3898765229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec005040 con 0x7f97f00f77d0 2023-10-18T21:54:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.697+0000 7f97f5766700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f00f77d0 0x7f97f0069e20 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f97e00026d0 tx=0x7f97e0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:00.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.697+0000 7f97e67fc700 1 -- 172.21.15.8:0/3898765229 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e00079c0 con 0x7f97f00f77d0 2023-10-18T21:54:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.697+0000 7f97e67fc700 1 -- 172.21.15.8:0/3898765229 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f97e000f040 con 0x7f97f00f77d0 2023-10-18T21:54:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.697+0000 7f97e67fc700 1 -- 172.21.15.8:0/3898765229 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e0014980 con 0x7f97f00f77d0 2023-10-18T21:54:00.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.697+0000 7f97f6f69700 1 -- 172.21.15.8:0/3898765229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f006a7a0 con 0x7f97f00f77d0 2023-10-18T21:54:00.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.697+0000 7f97f6f69700 1 -- 172.21.15.8:0/3898765229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f010ede0 con 0x7f97f00f77d0 2023-10-18T21:54:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.698+0000 7f97f6f69700 1 -- 172.21.15.8:0/3898765229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f0045ad0 con 0x7f97f00f77d0 2023-10-18T21:54:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.699+0000 7f97e67fc700 1 -- 172.21.15.8:0/3898765229 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f97e00090d0 con 0x7f97f00f77d0 2023-10-18T21:54:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.700+0000 7f97e67fc700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97dc060f70 0x7f97dc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.700+0000 7f97e67fc700 1 -- 172.21.15.8:0/3898765229 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f97e007c8a0 con 0x7f97f00f77d0 2023-10-18T21:54:00.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.700+0000 7f97f5f67700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97dc060f70 0x7f97dc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:00.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.701+0000 7f97f5f67700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97dc060f70 0x7f97dc063430 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f97ec005010 tx=0x7f97ec009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:00.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.704+0000 7f97e67fc700 1 -- 172.21.15.8:0/3898765229 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f97e004c580 con 0x7f97f00f77d0 2023-10-18T21:54:00.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.908+0000 7f97f6f69700 1 -- 172.21.15.8:0/3898765229 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97f00fedd0 con 0x7f97dc060f70 2023-10-18T21:54:00.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.910+0000 7f97e67fc700 1 -- 172.21.15.8:0/3898765229 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f97f00fedd0 con 0x7f97dc060f70 2023-10-18T21:54:00.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 -- 172.21.15.8:0/3898765229 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97dc060f70 msgr2=0x7f97dc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:00.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97dc060f70 0x7f97dc063430 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f97ec005010 tx=0x7f97ec009b30).stop 2023-10-18T21:54:00.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 -- 172.21.15.8:0/3898765229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f00f77d0 msgr2=0x7f97f0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:00.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f00f77d0 0x7f97f0069e20 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f97e00026d0 tx=0x7f97e0009de0).stop 2023-10-18T21:54:00.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 -- 172.21.15.8:0/3898765229 shutdown_connections 2023-10-18T21:54:00.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f97dc060f70 0x7f97dc063430 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97f00f6530 0x7f97f006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 --2- 172.21.15.8:0/3898765229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f00f77d0 0x7f97f0069e20 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:00.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 -- 172.21.15.8:0/3898765229 >> 172.21.15.8:0/3898765229 conn(0x7f97f00f1c90 msgr2=0x7f97f00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:00.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 -- 172.21.15.8:0/3898765229 shutdown_connections 2023-10-18T21:54:00.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:00.912+0000 7f97f6f69700 1 -- 172.21.15.8:0/3898765229 wait complete. 2023-10-18T21:54:01.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.048+0000 7fbff204d700 1 -- 172.21.15.8:0/3451215625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfec0f77d0 msgr2=0x7fbfec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:01.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.048+0000 7fbff204d700 1 --2- 172.21.15.8:0/3451215625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfec0f77d0 0x7fbfec0f7c30 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fbfdc004660 tx=0x7fbfdc009b30).stop 2023-10-18T21:54:01.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.048+0000 7fbff204d700 1 -- 172.21.15.8:0/3451215625 shutdown_connections 2023-10-18T21:54:01.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.048+0000 7fbff204d700 1 --2- 172.21.15.8:0/3451215625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfec0f77d0 0x7fbfec0f7c30 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.048+0000 7fbff204d700 1 --2- 172.21.15.8:0/3451215625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfec0f6530 0x7fbfec0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.048+0000 7fbff204d700 1 -- 172.21.15.8:0/3451215625 >> 172.21.15.8:0/3451215625 conn(0x7fbfec0f1c90 msgr2=0x7fbfec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:01.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.048+0000 7fbff204d700 1 -- 172.21.15.8:0/3451215625 shutdown_connections 2023-10-18T21:54:01.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.048+0000 7fbff204d700 1 -- 172.21.15.8:0/3451215625 wait complete. 2023-10-18T21:54:01.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.049+0000 7fbff204d700 1 Processor -- start 2023-10-18T21:54:01.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.049+0000 7fbff204d700 1 -- start start 2023-10-18T21:54:01.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.049+0000 7fbff204d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfec0f6530 0x7fbfec106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:01.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.049+0000 7fbff204d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfec0f77d0 0x7fbfec107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:01.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.049+0000 7fbff204d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec107850 con 0x7fbfec0f6530 2023-10-18T21:54:01.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.049+0000 7fbff204d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec108060 con 0x7fbfec0f77d0 2023-10-18T21:54:01.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.049+0000 7fbff104b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfec0f6530 0x7fbfec106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:01.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.049+0000 7fbff104b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfec0f6530 0x7fbfec106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58398/0 (socket says 172.21.15.8:58398) 2023-10-18T21:54:01.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.049+0000 7fbff104b700 1 -- 172.21.15.8:0/1581846660 learned_addr learned my addr 172.21.15.8:0/1581846660 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:01.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbff084a700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfec0f77d0 0x7fbfec107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:01.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbff104b700 1 -- 172.21.15.8:0/1581846660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfec0f77d0 msgr2=0x7fbfec107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:01.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbff104b700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfec0f77d0 0x7fbfec107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbff104b700 1 -- 172.21.15.8:0/1581846660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc005040 con 0x7fbfec0f6530 2023-10-18T21:54:01.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbff084a700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfec0f77d0 0x7fbfec107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:54:01.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbff104b700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfec0f6530 0x7fbfec106d60 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fbfe8002700 tx=0x7fbfe8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbfe1ffb700 1 -- 172.21.15.8:0/1581846660 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe8009320 con 0x7fbfec0f6530 2023-10-18T21:54:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbfe1ffb700 1 -- 172.21.15.8:0/1581846660 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbfe800f040 con 0x7fbfec0f6530 2023-10-18T21:54:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbff204d700 1 -- 172.21.15.8:0/1581846660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfec1082e0 con 0x7fbfec0f6530 2023-10-18T21:54:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbfe1ffb700 1 -- 172.21.15.8:0/1581846660 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe8014950 con 0x7fbfec0f6530 2023-10-18T21:54:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.050+0000 7fbff204d700 1 -- 172.21.15.8:0/1581846660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfec1088a0 con 0x7fbfec0f6530 2023-10-18T21:54:01.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.051+0000 7fbff204d700 1 -- 172.21.15.8:0/1581846660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfec059100 con 0x7fbfec0f6530 2023-10-18T21:54:01.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.052+0000 7fbfe1ffb700 1 -- 172.21.15.8:0/1581846660 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbfe8009480 con 0x7fbfec0f6530 2023-10-18T21:54:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.054+0000 7fbfe1ffb700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbfd8060f70 0x7fbfd8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.054+0000 7fbfe1ffb700 1 -- 172.21.15.8:0/1581846660 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbfe807cc40 con 0x7fbfec0f6530 2023-10-18T21:54:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.054+0000 7fbff084a700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbfd8060f70 0x7fbfd8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.054+0000 7fbff084a700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbfd8060f70 0x7fbfd8063430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fbfdc005010 tx=0x7fbfdc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:01.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.058+0000 7fbfe1ffb700 1 -- 172.21.15.8:0/1581846660 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbfe804c8b0 con 0x7fbfec0f6530 2023-10-18T21:54:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:53:59.850642+0000 mgr.smithi008.flmjzp (mgr.14640) 3308 : cluster [DBG] pgmap v2276: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:01.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:53:59.850642+0000 mgr.smithi008.flmjzp (mgr.14640) 3308 : cluster [DBG] pgmap v2276: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:01.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.249+0000 7fbff204d700 1 -- 172.21.15.8:0/1581846660 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfec0feda0 con 0x7fbfd8060f70 2023-10-18T21:54:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.258+0000 7fbfe1ffb700 1 -- 172.21.15.8:0/1581846660 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fbfec0feda0 con 0x7fbfd8060f70 2023-10-18T21:54:01.261 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:54:01.261 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (60m) 8m ago 62m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:54:01.261 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (54m) 8m ago 62m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:54:01.261 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (54m) 6m ago 61m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:54:01.262 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (60m) 8m ago 61m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:54:01.262 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 58m - - 2023-10-18T21:54:01.262 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 58m - - 2023-10-18T21:54:01.262 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 58m - - 2023-10-18T21:54:01.262 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 58m - - 2023-10-18T21:54:01.263 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (55m) 8m ago 63m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:54:01.263 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (55m) 6m ago 61m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:54:01.263 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (55m) 8m ago 63m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:54:01.263 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (54m) 6m ago 61m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:54:01.263 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (61m) 8m ago 61m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:54:01.264 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (60m) 6m ago 60m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:54:01.264 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (54m) 8m ago 60m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:54:01.264 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (52m) 8m ago 60m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:54:01.264 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (51m) 8m ago 60m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:54:01.264 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (51m) 6m ago 59m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:54:01.265 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (50m) 6m ago 59m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:54:01.265 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (50m) 6m ago 59m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:54:01.265 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (56m) 8m ago 61m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:54:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.260+0000 7fbff204d700 1 -- 172.21.15.8:0/1581846660 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbfd8060f70 msgr2=0x7fbfd8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.260+0000 7fbff204d700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbfd8060f70 0x7fbfd8063430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fbfdc005010 tx=0x7fbfdc009b30).stop 2023-10-18T21:54:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.260+0000 7fbff204d700 1 -- 172.21.15.8:0/1581846660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfec0f6530 msgr2=0x7fbfec106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.260+0000 7fbff204d700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfec0f6530 0x7fbfec106d60 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fbfe8002700 tx=0x7fbfe8009e00).stop 2023-10-18T21:54:01.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.260+0000 7fbff204d700 1 -- 172.21.15.8:0/1581846660 shutdown_connections 2023-10-18T21:54:01.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.260+0000 7fbff204d700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbfd8060f70 0x7fbfd8063430 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.260+0000 7fbff204d700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfec0f6530 0x7fbfec106d60 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.260+0000 7fbff204d700 1 --2- 172.21.15.8:0/1581846660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfec0f77d0 0x7fbfec107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.260+0000 7fbff204d700 1 -- 172.21.15.8:0/1581846660 >> 172.21.15.8:0/1581846660 conn(0x7fbfec0f1c90 msgr2=0x7fbfec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:01.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.261+0000 7fbff204d700 1 -- 172.21.15.8:0/1581846660 shutdown_connections 2023-10-18T21:54:01.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.261+0000 7fbff204d700 1 -- 172.21.15.8:0/1581846660 wait complete. 2023-10-18T21:54:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.396+0000 7f05723d9700 1 -- 172.21.15.8:0/971310868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c0f99e0 msgr2=0x7f056c0f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.396+0000 7f05723d9700 1 --2- 172.21.15.8:0/971310868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c0f99e0 0x7f056c0f9e40 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f055c004660 tx=0x7f055c009b30).stop 2023-10-18T21:54:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.396+0000 7f05723d9700 1 -- 172.21.15.8:0/971310868 shutdown_connections 2023-10-18T21:54:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.396+0000 7f05723d9700 1 --2- 172.21.15.8:0/971310868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c0f99e0 0x7f056c0f9e40 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.396+0000 7f05723d9700 1 --2- 172.21.15.8:0/971310868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f056c0f8740 0x7f056c0f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.396+0000 7f05723d9700 1 -- 172.21.15.8:0/971310868 >> 172.21.15.8:0/971310868 conn(0x7f056c0f40e0 msgr2=0x7f056c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.396+0000 7f05723d9700 1 -- 172.21.15.8:0/971310868 shutdown_connections 2023-10-18T21:54:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.397+0000 7f05723d9700 1 -- 172.21.15.8:0/971310868 wait complete. 2023-10-18T21:54:01.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.397+0000 7f05723d9700 1 Processor -- start 2023-10-18T21:54:01.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.397+0000 7f05723d9700 1 -- start start 2023-10-18T21:54:01.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.398+0000 7f05723d9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f056c0f8740 0x7f056c108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:01.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.398+0000 7f05723d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c0f99e0 0x7f056c109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:01.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.398+0000 7f05723d9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c1099f0 con 0x7f056c0f99e0 2023-10-18T21:54:01.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.398+0000 7f05723d9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c109b30 con 0x7f056c0f8740 2023-10-18T21:54:01.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.398+0000 7f0570bd6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c0f99e0 0x7f056c109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:01.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.398+0000 7f0570bd6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c0f99e0 0x7f056c109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58424/0 (socket says 172.21.15.8:58424) 2023-10-18T21:54:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.398+0000 7f0570bd6700 1 -- 172.21.15.8:0/3840136455 learned_addr learned my addr 172.21.15.8:0/3840136455 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.398+0000 7f05713d7700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f056c0f8740 0x7f056c108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.398+0000 7f0570bd6700 1 -- 172.21.15.8:0/3840136455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f056c0f8740 msgr2=0x7f056c108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.398+0000 7f0570bd6700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f056c0f8740 0x7f056c108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.399+0000 7f0570bd6700 1 -- 172.21.15.8:0/3840136455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c005040 con 0x7f056c0f99e0 2023-10-18T21:54:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.399+0000 7f05713d7700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f056c0f8740 0x7f056c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:54:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.399+0000 7f0570bd6700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c0f99e0 0x7f056c109440 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f055c009990 tx=0x7f055c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.399+0000 7f0561ffb700 1 -- 172.21.15.8:0/3840136455 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055c018070 con 0x7f056c0f99e0 2023-10-18T21:54:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.399+0000 7f0561ffb700 1 -- 172.21.15.8:0/3840136455 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f055c009630 con 0x7f056c0f99e0 2023-10-18T21:54:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.399+0000 7f05723d9700 1 -- 172.21.15.8:0/3840136455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c10a470 con 0x7f056c0f99e0 2023-10-18T21:54:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.399+0000 7f0561ffb700 1 -- 172.21.15.8:0/3840136455 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055c01c400 con 0x7f056c0f99e0 2023-10-18T21:54:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.399+0000 7f05723d9700 1 -- 172.21.15.8:0/3840136455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c10a9d0 con 0x7f056c0f99e0 2023-10-18T21:54:01.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.400+0000 7f05723d9700 1 -- 172.21.15.8:0/3840136455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c045ad0 con 0x7f056c0f99e0 2023-10-18T21:54:01.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.401+0000 7f0561ffb700 1 -- 172.21.15.8:0/3840136455 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f055c01d9e0 con 0x7f056c0f99e0 2023-10-18T21:54:01.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.402+0000 7f0561ffb700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 0x7f0558063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:01.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.402+0000 7f0561ffb700 1 -- 172.21.15.8:0/3840136455 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f055c07e6f0 con 0x7f056c0f99e0 2023-10-18T21:54:01.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.403+0000 7f05713d7700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 0x7f0558063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:01.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.403+0000 7f05713d7700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 0x7f0558063430 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f056c0f9840 tx=0x7f0568009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:01.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.407+0000 7f0561ffb700 1 -- 172.21.15.8:0/3840136455 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f055c051cd0 con 0x7f056c0f99e0 2023-10-18T21:54:01.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.657+0000 7f05723d9700 1 -- 172.21.15.8:0/3840136455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f056c027a00 con 0x7f056c0f99e0 2023-10-18T21:54:01.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.658+0000 7f0561ffb700 1 -- 172.21.15.8:0/3840136455 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f055c0518c0 con 0x7f056c0f99e0 2023-10-18T21:54:01.661 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:54:01.661 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:54:01.661 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:54:01.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:54:01.662 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:54:01.662 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:54:01.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:54:01.662 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:54:01.663 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:54:01.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:54:01.663 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:54:01.663 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:54:01.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:54:01.664 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:54:01.664 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:54:01.664 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:54:01.664 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:54:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 -- 172.21.15.8:0/3840136455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 msgr2=0x7f0558063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 0x7f0558063430 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f056c0f9840 tx=0x7f0568009c00).stop 2023-10-18T21:54:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 -- 172.21.15.8:0/3840136455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c0f99e0 msgr2=0x7f056c109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c0f99e0 0x7f056c109440 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f055c009990 tx=0x7f055c009b30).stop 2023-10-18T21:54:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 -- 172.21.15.8:0/3840136455 shutdown_connections 2023-10-18T21:54:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 0x7f0558063430 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f056c0f8740 0x7f056c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 --2- 172.21.15.8:0/3840136455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f056c0f99e0 0x7f056c109440 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 -- 172.21.15.8:0/3840136455 >> 172.21.15.8:0/3840136455 conn(0x7f056c0f40e0 msgr2=0x7f056c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:01.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 -- 172.21.15.8:0/3840136455 shutdown_connections 2023-10-18T21:54:01.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.660+0000 7f05723d9700 1 -- 172.21.15.8:0/3840136455 wait complete. 2023-10-18T21:54:01.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.796+0000 7f495eeb6700 1 -- 172.21.15.8:0/1486240175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49580f77d0 msgr2=0x7f49580f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:01.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.796+0000 7f495eeb6700 1 --2- 172.21.15.8:0/1486240175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49580f77d0 0x7f49580f7c30 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f4948004660 tx=0x7f4948009b30).stop 2023-10-18T21:54:01.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.796+0000 7f495eeb6700 1 -- 172.21.15.8:0/1486240175 shutdown_connections 2023-10-18T21:54:01.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.796+0000 7f495eeb6700 1 --2- 172.21.15.8:0/1486240175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49580f77d0 0x7f49580f7c30 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.796+0000 7f495eeb6700 1 --2- 172.21.15.8:0/1486240175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49580f6530 0x7f49580f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.796+0000 7f495eeb6700 1 -- 172.21.15.8:0/1486240175 >> 172.21.15.8:0/1486240175 conn(0x7f49580f1c90 msgr2=0x7f49580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:01.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.796+0000 7f495eeb6700 1 -- 172.21.15.8:0/1486240175 shutdown_connections 2023-10-18T21:54:01.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.796+0000 7f495eeb6700 1 -- 172.21.15.8:0/1486240175 wait complete. 2023-10-18T21:54:01.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.797+0000 7f495eeb6700 1 Processor -- start 2023-10-18T21:54:01.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.797+0000 7f495eeb6700 1 -- start start 2023-10-18T21:54:01.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495eeb6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49580f6530 0x7f4958108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:01.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495eeb6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49580f77d0 0x7f49581093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:01.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495eeb6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4958109980 con 0x7f49580f6530 2023-10-18T21:54:01.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495eeb6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4958109ac0 con 0x7f49580f77d0 2023-10-18T21:54:01.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495deb4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49580f6530 0x7f4958108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:01.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495deb4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49580f6530 0x7f4958108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58436/0 (socket says 172.21.15.8:58436) 2023-10-18T21:54:01.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495deb4700 1 -- 172.21.15.8:0/1565267952 learned_addr learned my addr 172.21.15.8:0/1565267952 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:01.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495d6b3700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49580f77d0 0x7f49581093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:01.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495deb4700 1 -- 172.21.15.8:0/1565267952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49580f77d0 msgr2=0x7f49581093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:01.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495deb4700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49580f77d0 0x7f49581093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:01.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495deb4700 1 -- 172.21.15.8:0/1565267952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4948005040 con 0x7f49580f6530 2023-10-18T21:54:01.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.798+0000 7f495d6b3700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49580f77d0 0x7f49581093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:54:01.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.799+0000 7f495deb4700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49580f6530 0x7f4958108ee0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f4954002700 tx=0x7f4954009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:01.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.799+0000 7f494e7fc700 1 -- 172.21.15.8:0/1565267952 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4954009320 con 0x7f49580f6530 2023-10-18T21:54:01.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.799+0000 7f495eeb6700 1 -- 172.21.15.8:0/1565267952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495810a460 con 0x7f49580f6530 2023-10-18T21:54:01.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.799+0000 7f494e7fc700 1 -- 172.21.15.8:0/1565267952 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f495400f040 con 0x7f49580f6530 2023-10-18T21:54:01.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.799+0000 7f494e7fc700 1 -- 172.21.15.8:0/1565267952 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4954014950 con 0x7f49580f6530 2023-10-18T21:54:01.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.799+0000 7f495eeb6700 1 -- 172.21.15.8:0/1565267952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495810aa20 con 0x7f49580f6530 2023-10-18T21:54:01.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.800+0000 7f495eeb6700 1 -- 172.21.15.8:0/1565267952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4958045ad0 con 0x7f49580f6530 2023-10-18T21:54:01.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.801+0000 7f494e7fc700 1 -- 172.21.15.8:0/1565267952 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4954009480 con 0x7f49580f6530 2023-10-18T21:54:01.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.802+0000 7f494e7fc700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4944060f70 0x7f4944063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:01.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.802+0000 7f494e7fc700 1 -- 172.21.15.8:0/1565267952 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f495407cd00 con 0x7f49580f6530 2023-10-18T21:54:01.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.802+0000 7f495d6b3700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4944060f70 0x7f4944063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:01.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.803+0000 7f495d6b3700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4944060f70 0x7f4944063430 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f4948005010 tx=0x7f4948009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:01.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:01.806+0000 7f494e7fc700 1 -- 172.21.15.8:0/1565267952 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f49540502e0 con 0x7f49580f6530 2023-10-18T21:54:02.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.042+0000 7f495eeb6700 1 -- 172.21.15.8:0/1565267952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49580fee40 con 0x7f49580f6530 2023-10-18T21:54:02.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.042+0000 7f494e7fc700 1 -- 172.21.15.8:0/1565267952 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f495404fed0 con 0x7f49580f6530 2023-10-18T21:54:02.045 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:54:02.045 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:54:02.046 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:54:02.046 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:54:02.046 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:54:02.047 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:54:02.047 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:54:02.047 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:54:02.047 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:54:02.048 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:54:02.048 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:54:02.048 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:54:02.048 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:54:02.049 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:54:02.049 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:54:02.049 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:54:02.049 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:54:02.049 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:54:02.050 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:54:02.050 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:54:02.050 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:54:02.051 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:54:02.051 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:54:02.051 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:54:02.051 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:54:02.052 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:54:02.052 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:54:02.052 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:54:02.052 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:54:02.052 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:54:02.053 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:54:02.053 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:54:02.053 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:54:02.053 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:54:02.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.044+0000 7f495eeb6700 1 -- 172.21.15.8:0/1565267952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4944060f70 msgr2=0x7f4944063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:02.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.044+0000 7f495eeb6700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4944060f70 0x7f4944063430 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f4948005010 tx=0x7f4948009b30).stop 2023-10-18T21:54:02.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.044+0000 7f495eeb6700 1 -- 172.21.15.8:0/1565267952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49580f6530 msgr2=0x7f4958108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:02.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.044+0000 7f495eeb6700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49580f6530 0x7f4958108ee0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f4954002700 tx=0x7f4954009e00).stop 2023-10-18T21:54:02.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.044+0000 7f495eeb6700 1 -- 172.21.15.8:0/1565267952 shutdown_connections 2023-10-18T21:54:02.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.044+0000 7f495eeb6700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4944060f70 0x7f4944063430 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:02.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.044+0000 7f495eeb6700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49580f6530 0x7f4958108ee0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:02.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.044+0000 7f495eeb6700 1 --2- 172.21.15.8:0/1565267952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49580f77d0 0x7f49581093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:02.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.044+0000 7f495eeb6700 1 -- 172.21.15.8:0/1565267952 >> 172.21.15.8:0/1565267952 conn(0x7f49580f1c90 msgr2=0x7f495806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.045+0000 7f495eeb6700 1 -- 172.21.15.8:0/1565267952 shutdown_connections 2023-10-18T21:54:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.045+0000 7f495eeb6700 1 -- 172.21.15.8:0/1565267952 wait complete. 2023-10-18T21:54:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:54:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:00.554166+0000 mgr.smithi008.flmjzp (mgr.14640) 3309 : audit [DBG] from='client.36736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:00.911124+0000 mgr.smithi008.flmjzp (mgr.14640) 3310 : audit [DBG] from='client.36740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.659681+0000 mon.smithi008 (mon.0) 3674 : audit [DBG] from='client.? 172.21.15.8:0/3840136455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.875675+0000 mon.smithi008 (mon.0) 3675 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.877577+0000 mon.smithi008 (mon.0) 3676 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.878335+0000 mon.smithi008 (mon.0) 3677 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.883690+0000 mon.smithi008 (mon.0) 3678 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.892018+0000 mon.smithi008 (mon.0) 3679 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.894395+0000 mon.smithi008 (mon.0) 3680 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.895678+0000 mon.smithi008 (mon.0) 3681 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.896891+0000 mon.smithi008 (mon.0) 3682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:02.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.898404+0000 mon.smithi008 (mon.0) 3683 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:02.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.182+0000 7f7483fff700 1 -- 172.21.15.8:0/3855025470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7484060310 msgr2=0x7f74840f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:02.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.182+0000 7f7483fff700 1 --2- 172.21.15.8:0/3855025470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7484060310 0x7f74840f9120 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f7474004660 tx=0x7f7474009b30).stop 2023-10-18T21:54:02.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.182+0000 7f7483fff700 1 -- 172.21.15.8:0/3855025470 shutdown_connections 2023-10-18T21:54:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.182+0000 7f7483fff700 1 --2- 172.21.15.8:0/3855025470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74840f96a0 0x7f74840fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.182+0000 7f7483fff700 1 --2- 172.21.15.8:0/3855025470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7484060310 0x7f74840f9120 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.182+0000 7f7483fff700 1 -- 172.21.15.8:0/3855025470 >> 172.21.15.8:0/3855025470 conn(0x7f74840f0ba0 msgr2=0x7f74840f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.182+0000 7f7483fff700 1 -- 172.21.15.8:0/3855025470 shutdown_connections 2023-10-18T21:54:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.182+0000 7f7483fff700 1 -- 172.21.15.8:0/3855025470 wait complete. 2023-10-18T21:54:02.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.183+0000 7f7483fff700 1 Processor -- start 2023-10-18T21:54:02.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.183+0000 7f7483fff700 1 -- start start 2023-10-18T21:54:02.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.184+0000 7f7483fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7484060310 0x7f7484106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:02.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.184+0000 7f7483fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74840f96a0 0x7f74841072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:02.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.184+0000 7f7483fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74841078b0 con 0x7f74840f96a0 2023-10-18T21:54:02.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.184+0000 7f7483fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74841080f0 con 0x7f7484060310 2023-10-18T21:54:02.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.184+0000 7f74827fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74840f96a0 0x7f74841072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:02.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.184+0000 7f74827fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74840f96a0 0x7f74841072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58446/0 (socket says 172.21.15.8:58446) 2023-10-18T21:54:02.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.184+0000 7f74827fc700 1 -- 172.21.15.8:0/134418377 learned_addr learned my addr 172.21.15.8:0/134418377 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:02.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.184+0000 7f7482ffd700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7484060310 0x7f7484106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:02.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.185+0000 7f74827fc700 1 -- 172.21.15.8:0/134418377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7484060310 msgr2=0x7f7484106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.185+0000 7f74827fc700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7484060310 0x7f7484106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.185+0000 7f74827fc700 1 -- 172.21.15.8:0/134418377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474005040 con 0x7f74840f96a0 2023-10-18T21:54:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.185+0000 7f74827fc700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74840f96a0 0x7f74841072b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f747800c790 tx=0x7f7478007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.185+0000 7f746b7fe700 1 -- 172.21.15.8:0/134418377 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7478013630 con 0x7f74840f96a0 2023-10-18T21:54:02.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.185+0000 7f746b7fe700 1 -- 172.21.15.8:0/134418377 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7478013c50 con 0x7f74840f96a0 2023-10-18T21:54:02.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.185+0000 7f7483fff700 1 -- 172.21.15.8:0/134418377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74841083d0 con 0x7f74840f96a0 2023-10-18T21:54:02.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.185+0000 7f746b7fe700 1 -- 172.21.15.8:0/134418377 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7478002c10 con 0x7f74840f96a0 2023-10-18T21:54:02.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.185+0000 7f7483fff700 1 -- 172.21.15.8:0/134418377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7484108910 con 0x7f74840f96a0 2023-10-18T21:54:02.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.186+0000 7f7483fff700 1 -- 172.21.15.8:0/134418377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7484059100 con 0x7f74840f96a0 2023-10-18T21:54:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.187+0000 7f746b7fe700 1 -- 172.21.15.8:0/134418377 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f747801a060 con 0x7f74840f96a0 2023-10-18T21:54:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.188+0000 7f746b7fe700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f746c060f70 0x7f746c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.188+0000 7f746b7fe700 1 -- 172.21.15.8:0/134418377 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f747807cbe0 con 0x7f74840f96a0 2023-10-18T21:54:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.188+0000 7f7482ffd700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f746c060f70 0x7f746c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:02.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.189+0000 7f7482ffd700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f746c060f70 0x7f746c063430 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f7484107b80 tx=0x7f7474009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:02.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.192+0000 7f746b7fe700 1 -- 172.21.15.8:0/134418377 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f747804c790 con 0x7f74840f96a0 2023-10-18T21:54:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:00.554166+0000 mgr.smithi008.flmjzp (mgr.14640) 3309 : audit [DBG] from='client.36736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:00.911124+0000 mgr.smithi008.flmjzp (mgr.14640) 3310 : audit [DBG] from='client.36740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.659681+0000 mon.smithi008 (mon.0) 3674 : audit [DBG] from='client.? 172.21.15.8:0/3840136455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.875675+0000 mon.smithi008 (mon.0) 3675 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.877577+0000 mon.smithi008 (mon.0) 3676 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.878335+0000 mon.smithi008 (mon.0) 3677 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.883690+0000 mon.smithi008 (mon.0) 3678 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:02.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.892018+0000 mon.smithi008 (mon.0) 3679 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:02.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.894395+0000 mon.smithi008 (mon.0) 3680 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:02.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.895678+0000 mon.smithi008 (mon.0) 3681 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:02.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.896891+0000 mon.smithi008 (mon.0) 3682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:02.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.898404+0000 mon.smithi008 (mon.0) 3683 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:02.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.392+0000 7f7483fff700 1 -- 172.21.15.8:0/134418377 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74840fedf0 con 0x7f746c060f70 2023-10-18T21:54:02.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.393+0000 7f746b7fe700 1 -- 172.21.15.8:0/134418377 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f74840fedf0 con 0x7f746c060f70 2023-10-18T21:54:02.396 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:54:02.396 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:54:02.396 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:54:02.396 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:54:02.397 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:54:02.397 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:54:02.397 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:54:02.397 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:54:02.398 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:54:02.398 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:54:02.398 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:54:02.399 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:54:02.399 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:54:02.399 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:54:02.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.395+0000 7f7483fff700 1 -- 172.21.15.8:0/134418377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f746c060f70 msgr2=0x7f746c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:02.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.395+0000 7f7483fff700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f746c060f70 0x7f746c063430 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f7484107b80 tx=0x7f7474009b30).stop 2023-10-18T21:54:02.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.395+0000 7f7483fff700 1 -- 172.21.15.8:0/134418377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74840f96a0 msgr2=0x7f74841072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:02.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.395+0000 7f7483fff700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74840f96a0 0x7f74841072b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f747800c790 tx=0x7f7478007d40).stop 2023-10-18T21:54:02.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.395+0000 7f7483fff700 1 -- 172.21.15.8:0/134418377 shutdown_connections 2023-10-18T21:54:02.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.395+0000 7f7483fff700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f746c060f70 0x7f746c063430 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:02.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.395+0000 7f7483fff700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7484060310 0x7f7484106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:02.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.395+0000 7f7483fff700 1 --2- 172.21.15.8:0/134418377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74840f96a0 0x7f74841072b0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:02.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.395+0000 7f7483fff700 1 -- 172.21.15.8:0/134418377 >> 172.21.15.8:0/134418377 conn(0x7f74840f0ba0 msgr2=0x7f74840f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:02.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.396+0000 7f7483fff700 1 -- 172.21.15.8:0/134418377 shutdown_connections 2023-10-18T21:54:02.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:02.396+0000 7f7483fff700 1 -- 172.21.15.8:0/134418377 wait complete. 2023-10-18T21:54:03.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:01.251400+0000 mgr.smithi008.flmjzp (mgr.14640) 3311 : audit [DBG] from='client.36744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:03.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:01.851088+0000 mgr.smithi008.flmjzp (mgr.14640) 3312 : cluster [DBG] pgmap v2277: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:03.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:01.878995+0000 mgr.smithi008.flmjzp (mgr.14640) 3313 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:54:03.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:01.879440+0000 mgr.smithi008.flmjzp (mgr.14640) 3314 : cluster [DBG] pgmap v2278: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:03.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:01.879669+0000 mgr.smithi008.flmjzp (mgr.14640) 3315 : cluster [DBG] pgmap v2279: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:03.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:01.899962+0000 mgr.smithi008.flmjzp (mgr.14640) 3316 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:54:03.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:02.044007+0000 mon.smithi008 (mon.0) 3684 : audit [DBG] from='client.? 172.21.15.8:0/1565267952' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:54:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:01.251400+0000 mgr.smithi008.flmjzp (mgr.14640) 3311 : audit [DBG] from='client.36744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:01.851088+0000 mgr.smithi008.flmjzp (mgr.14640) 3312 : cluster [DBG] pgmap v2277: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:01.878995+0000 mgr.smithi008.flmjzp (mgr.14640) 3313 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:54:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:01.879440+0000 mgr.smithi008.flmjzp (mgr.14640) 3314 : cluster [DBG] pgmap v2278: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:03.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:01.879669+0000 mgr.smithi008.flmjzp (mgr.14640) 3315 : cluster [DBG] pgmap v2279: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:03.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:01.899962+0000 mgr.smithi008.flmjzp (mgr.14640) 3316 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:54:03.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:02.044007+0000 mon.smithi008 (mon.0) 3684 : audit [DBG] from='client.? 172.21.15.8:0/1565267952' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:54:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:02.394736+0000 mgr.smithi008.flmjzp (mgr.14640) 3317 : audit [DBG] from='client.36756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:04.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:02.394736+0000 mgr.smithi008.flmjzp (mgr.14640) 3317 : audit [DBG] from='client.36756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:05.201 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:03.880154+0000 mgr.smithi008.flmjzp (mgr.14640) 3318 : cluster [DBG] pgmap v2280: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:03.880154+0000 mgr.smithi008.flmjzp (mgr.14640) 3318 : cluster [DBG] pgmap v2280: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:07.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:05.880668+0000 mgr.smithi008.flmjzp (mgr.14640) 3319 : cluster [DBG] pgmap v2281: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:07.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:05.880668+0000 mgr.smithi008.flmjzp (mgr.14640) 3319 : cluster [DBG] pgmap v2281: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:07.881281+0000 mgr.smithi008.flmjzp (mgr.14640) 3320 : cluster [DBG] pgmap v2282: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:07.881281+0000 mgr.smithi008.flmjzp (mgr.14640) 3320 : cluster [DBG] pgmap v2282: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:11.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:09.881854+0000 mgr.smithi008.flmjzp (mgr.14640) 3321 : cluster [DBG] pgmap v2283: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:09.881854+0000 mgr.smithi008.flmjzp (mgr.14640) 3321 : cluster [DBG] pgmap v2283: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:11.906719+0000 mon.smithi008 (mon.0) 3685 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:11.906719+0000 mon.smithi008 (mon.0) 3685 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:13.166 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:11.882483+0000 mgr.smithi008.flmjzp (mgr.14640) 3322 : cluster [DBG] pgmap v2284: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:13.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:11.882483+0000 mgr.smithi008.flmjzp (mgr.14640) 3322 : cluster [DBG] pgmap v2284: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:13.883032+0000 mgr.smithi008.flmjzp (mgr.14640) 3323 : cluster [DBG] pgmap v2285: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:14.815087+0000 mon.smithi008 (mon.0) 3686 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:13.883032+0000 mgr.smithi008.flmjzp (mgr.14640) 3323 : cluster [DBG] pgmap v2285: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:14.815087+0000 mon.smithi008 (mon.0) 3686 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:15.368119+0000 mon.smithi008 (mon.0) 3687 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:15.368972+0000 mon.smithi008 (mon.0) 3688 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:15.374192+0000 mon.smithi008 (mon.0) 3689 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:15.379095+0000 mon.smithi008 (mon.0) 3690 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:15.381341+0000 mon.smithi008 (mon.0) 3691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:15.382657+0000 mon.smithi008 (mon.0) 3692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:15.383849+0000 mon.smithi008 (mon.0) 3693 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:15.385353+0000 mon.smithi008 (mon.0) 3694 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:15.368119+0000 mon.smithi008 (mon.0) 3687 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:15.368972+0000 mon.smithi008 (mon.0) 3688 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:15.374192+0000 mon.smithi008 (mon.0) 3689 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:15.379095+0000 mon.smithi008 (mon.0) 3690 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:15.381341+0000 mon.smithi008 (mon.0) 3691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:15.382657+0000 mon.smithi008 (mon.0) 3692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:15.383849+0000 mon.smithi008 (mon.0) 3693 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:15.385353+0000 mon.smithi008 (mon.0) 3694 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:15.369631+0000 mgr.smithi008.flmjzp (mgr.14640) 3324 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:54:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:15.370200+0000 mgr.smithi008.flmjzp (mgr.14640) 3325 : cluster [DBG] pgmap v2286: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:15.370501+0000 mgr.smithi008.flmjzp (mgr.14640) 3326 : cluster [DBG] pgmap v2287: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:15.386876+0000 mgr.smithi008.flmjzp (mgr.14640) 3327 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:54:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:15.369631+0000 mgr.smithi008.flmjzp (mgr.14640) 3324 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:54:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:15.370200+0000 mgr.smithi008.flmjzp (mgr.14640) 3325 : cluster [DBG] pgmap v2286: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:15.370501+0000 mgr.smithi008.flmjzp (mgr.14640) 3326 : cluster [DBG] pgmap v2287: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:15.386876+0000 mgr.smithi008.flmjzp (mgr.14640) 3327 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:54:19.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:17.370939+0000 mgr.smithi008.flmjzp (mgr.14640) 3328 : cluster [DBG] pgmap v2288: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:17.370939+0000 mgr.smithi008.flmjzp (mgr.14640) 3328 : cluster [DBG] pgmap v2288: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:21.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:19.371441+0000 mgr.smithi008.flmjzp (mgr.14640) 3329 : cluster [DBG] pgmap v2289: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:19.371441+0000 mgr.smithi008.flmjzp (mgr.14640) 3329 : cluster [DBG] pgmap v2289: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:21.372095+0000 mgr.smithi008.flmjzp (mgr.14640) 3330 : cluster [DBG] pgmap v2290: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:21.372095+0000 mgr.smithi008.flmjzp (mgr.14640) 3330 : cluster [DBG] pgmap v2290: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:25.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:23.372602+0000 mgr.smithi008.flmjzp (mgr.14640) 3331 : cluster [DBG] pgmap v2291: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:23.372602+0000 mgr.smithi008.flmjzp (mgr.14640) 3331 : cluster [DBG] pgmap v2291: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:25.397512+0000 mon.smithi008 (mon.0) 3695 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:25.399668+0000 mon.smithi008 (mon.0) 3696 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:25.400684+0000 mon.smithi008 (mon.0) 3697 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:25.407096+0000 mon.smithi008 (mon.0) 3698 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:25.413532+0000 mon.smithi008 (mon.0) 3699 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:25.416658+0000 mon.smithi008 (mon.0) 3700 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:25.418331+0000 mon.smithi008 (mon.0) 3701 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:25.420104+0000 mon.smithi008 (mon.0) 3702 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:25.422150+0000 mon.smithi008 (mon.0) 3703 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:25.397512+0000 mon.smithi008 (mon.0) 3695 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:25.399668+0000 mon.smithi008 (mon.0) 3696 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:25.400684+0000 mon.smithi008 (mon.0) 3697 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:25.407096+0000 mon.smithi008 (mon.0) 3698 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:25.413532+0000 mon.smithi008 (mon.0) 3699 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:25.416658+0000 mon.smithi008 (mon.0) 3700 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:25.418331+0000 mon.smithi008 (mon.0) 3701 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:25.420104+0000 mon.smithi008 (mon.0) 3702 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:25.422150+0000 mon.smithi008 (mon.0) 3703 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:25.373226+0000 mgr.smithi008.flmjzp (mgr.14640) 3332 : cluster [DBG] pgmap v2292: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:25.401570+0000 mgr.smithi008.flmjzp (mgr.14640) 3333 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:54:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:25.402128+0000 mgr.smithi008.flmjzp (mgr.14640) 3334 : cluster [DBG] pgmap v2293: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:25.402401+0000 mgr.smithi008.flmjzp (mgr.14640) 3335 : cluster [DBG] pgmap v2294: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:25.424076+0000 mgr.smithi008.flmjzp (mgr.14640) 3336 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:54:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:25.373226+0000 mgr.smithi008.flmjzp (mgr.14640) 3332 : cluster [DBG] pgmap v2292: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:25.401570+0000 mgr.smithi008.flmjzp (mgr.14640) 3333 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:54:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:25.402128+0000 mgr.smithi008.flmjzp (mgr.14640) 3334 : cluster [DBG] pgmap v2293: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:25.402401+0000 mgr.smithi008.flmjzp (mgr.14640) 3335 : cluster [DBG] pgmap v2294: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:27.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:25.424076+0000 mgr.smithi008.flmjzp (mgr.14640) 3336 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:54:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:27.402912+0000 mgr.smithi008.flmjzp (mgr.14640) 3337 : cluster [DBG] pgmap v2295: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:29.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:27.402912+0000 mgr.smithi008.flmjzp (mgr.14640) 3337 : cluster [DBG] pgmap v2295: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:29.403430+0000 mgr.smithi008.flmjzp (mgr.14640) 3338 : cluster [DBG] pgmap v2296: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:31.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:29.403430+0000 mgr.smithi008.flmjzp (mgr.14640) 3338 : cluster [DBG] pgmap v2296: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:32.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.550+0000 7f89b6c54700 1 -- 172.21.15.8:0/3986435344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b00f6530 msgr2=0x7f89b00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:32.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.550+0000 7f89b6c54700 1 --2- 172.21.15.8:0/3986435344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b00f6530 0x7f89b00f6950 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f89ac004660 tx=0x7f89ac009b30).stop 2023-10-18T21:54:32.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.550+0000 7f89b6c54700 1 -- 172.21.15.8:0/3986435344 shutdown_connections 2023-10-18T21:54:32.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.550+0000 7f89b6c54700 1 --2- 172.21.15.8:0/3986435344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89b00f77d0 0x7f89b00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:32.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.550+0000 7f89b6c54700 1 --2- 172.21.15.8:0/3986435344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b00f6530 0x7f89b00f6950 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:32.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.550+0000 7f89b6c54700 1 -- 172.21.15.8:0/3986435344 >> 172.21.15.8:0/3986435344 conn(0x7f89b00f1c90 msgr2=0x7f89b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:32.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.550+0000 7f89b6c54700 1 -- 172.21.15.8:0/3986435344 shutdown_connections 2023-10-18T21:54:32.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.550+0000 7f89b6c54700 1 -- 172.21.15.8:0/3986435344 wait complete. 2023-10-18T21:54:32.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.551+0000 7f89b6c54700 1 Processor -- start 2023-10-18T21:54:32.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.552+0000 7f89b6c54700 1 -- start start 2023-10-18T21:54:32.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.552+0000 7f89b6c54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89b00f6530 0x7f89b0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:32.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.552+0000 7f89b6c54700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b00f77d0 0x7f89b0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:32.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.552+0000 7f89b6c54700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b0107880 con 0x7f89b00f77d0 2023-10-18T21:54:32.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.552+0000 7f89b6c54700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b01080c0 con 0x7f89b00f6530 2023-10-18T21:54:32.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.552+0000 7f89b5451700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b00f77d0 0x7f89b0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:32.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.552+0000 7f89b5451700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b00f77d0 0x7f89b0107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49206/0 (socket says 172.21.15.8:49206) 2023-10-18T21:54:32.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.553+0000 7f89b5451700 1 -- 172.21.15.8:0/3104239700 learned_addr learned my addr 172.21.15.8:0/3104239700 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:32.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.553+0000 7f89b5c52700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89b00f6530 0x7f89b0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:32.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.553+0000 7f89b5451700 1 -- 172.21.15.8:0/3104239700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89b00f6530 msgr2=0x7f89b0106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:32.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.553+0000 7f89b5451700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89b00f6530 0x7f89b0106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:32.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.553+0000 7f89b5451700 1 -- 172.21.15.8:0/3104239700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac005040 con 0x7f89b00f77d0 2023-10-18T21:54:32.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.553+0000 7f89b5451700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b00f77d0 0x7f89b0107280 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f89a000e7f0 tx=0x7f89a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.553+0000 7f89a67fc700 1 -- 172.21.15.8:0/3104239700 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a00092e0 con 0x7f89b00f77d0 2023-10-18T21:54:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.553+0000 7f89b6c54700 1 -- 172.21.15.8:0/3104239700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b01083a0 con 0x7f89b00f77d0 2023-10-18T21:54:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.553+0000 7f89a67fc700 1 -- 172.21.15.8:0/3104239700 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f89a000f040 con 0x7f89b00f77d0 2023-10-18T21:54:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.554+0000 7f89a67fc700 1 -- 172.21.15.8:0/3104239700 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a00147e0 con 0x7f89b00f77d0 2023-10-18T21:54:32.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.554+0000 7f89b6c54700 1 -- 172.21.15.8:0/3104239700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b01088e0 con 0x7f89b00f77d0 2023-10-18T21:54:32.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.555+0000 7f89b6c54700 1 -- 172.21.15.8:0/3104239700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b0059100 con 0x7f89b00f77d0 2023-10-18T21:54:32.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.555+0000 7f89a67fc700 1 -- 172.21.15.8:0/3104239700 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f89a001b030 con 0x7f89b00f77d0 2023-10-18T21:54:32.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.556+0000 7f89a67fc700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f899c060f70 0x7f899c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:32.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.556+0000 7f89a67fc700 1 -- 172.21.15.8:0/3104239700 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f89a007c7c0 con 0x7f89b00f77d0 2023-10-18T21:54:32.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.557+0000 7f89b5c52700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f899c060f70 0x7f899c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:32.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.557+0000 7f89b5c52700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f899c060f70 0x7f899c063430 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f89ac005010 tx=0x7f89ac016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:32.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.560+0000 7f89a67fc700 1 -- 172.21.15.8:0/3104239700 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f89a004c420 con 0x7f89b00f77d0 2023-10-18T21:54:32.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.759+0000 7f89b6c54700 1 -- 172.21.15.8:0/3104239700 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89b00fed90 con 0x7f899c060f70 2023-10-18T21:54:32.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.761+0000 7f89a67fc700 1 -- 172.21.15.8:0/3104239700 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f89b00fed90 con 0x7f899c060f70 2023-10-18T21:54:32.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.763+0000 7f89b6c54700 1 -- 172.21.15.8:0/3104239700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f899c060f70 msgr2=0x7f899c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:32.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.763+0000 7f89b6c54700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f899c060f70 0x7f899c063430 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f89ac005010 tx=0x7f89ac016040).stop 2023-10-18T21:54:32.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.763+0000 7f89b6c54700 1 -- 172.21.15.8:0/3104239700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b00f77d0 msgr2=0x7f89b0107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:32.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.763+0000 7f89b6c54700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b00f77d0 0x7f89b0107280 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f89a000e7f0 tx=0x7f89a000b040).stop 2023-10-18T21:54:32.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.763+0000 7f89b6c54700 1 -- 172.21.15.8:0/3104239700 shutdown_connections 2023-10-18T21:54:32.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.763+0000 7f89b6c54700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f899c060f70 0x7f899c063430 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:32.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.763+0000 7f89b6c54700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89b00f6530 0x7f89b0106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:32.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.763+0000 7f89b6c54700 1 --2- 172.21.15.8:0/3104239700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89b00f77d0 0x7f89b0107280 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:32.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.763+0000 7f89b6c54700 1 -- 172.21.15.8:0/3104239700 >> 172.21.15.8:0/3104239700 conn(0x7f89b00f1c90 msgr2=0x7f89b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:32.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.764+0000 7f89b6c54700 1 -- 172.21.15.8:0/3104239700 shutdown_connections 2023-10-18T21:54:32.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.764+0000 7f89b6c54700 1 -- 172.21.15.8:0/3104239700 wait complete. 2023-10-18T21:54:32.779 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:54:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.903+0000 7fce964ab700 1 -- 172.21.15.8:0/3770133663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f8740 msgr2=0x7fce900f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.903+0000 7fce964ab700 1 --2- 172.21.15.8:0/3770133663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f8740 0x7fce900f8b60 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7fce8c004660 tx=0x7fce8c009b30).stop 2023-10-18T21:54:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.903+0000 7fce964ab700 1 -- 172.21.15.8:0/3770133663 shutdown_connections 2023-10-18T21:54:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.903+0000 7fce964ab700 1 --2- 172.21.15.8:0/3770133663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f99e0 0x7fce900f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.903+0000 7fce964ab700 1 --2- 172.21.15.8:0/3770133663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f8740 0x7fce900f8b60 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.903+0000 7fce964ab700 1 -- 172.21.15.8:0/3770133663 >> 172.21.15.8:0/3770133663 conn(0x7fce900f40e0 msgr2=0x7fce900f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.903+0000 7fce964ab700 1 -- 172.21.15.8:0/3770133663 shutdown_connections 2023-10-18T21:54:32.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.903+0000 7fce964ab700 1 -- 172.21.15.8:0/3770133663 wait complete. 2023-10-18T21:54:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.904+0000 7fce964ab700 1 Processor -- start 2023-10-18T21:54:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.905+0000 7fce964ab700 1 -- start start 2023-10-18T21:54:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.905+0000 7fce964ab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f8740 0x7fce90108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.905+0000 7fce964ab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f99e0 0x7fce901094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.905+0000 7fce964ab700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce90109a80 con 0x7fce900f8740 2023-10-18T21:54:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.905+0000 7fce964ab700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce90109bc0 con 0x7fce900f99e0 2023-10-18T21:54:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.905+0000 7fce954a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f8740 0x7fce90108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.905+0000 7fce954a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f8740 0x7fce90108fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49220/0 (socket says 172.21.15.8:49220) 2023-10-18T21:54:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.905+0000 7fce954a9700 1 -- 172.21.15.8:0/3421806029 learned_addr learned my addr 172.21.15.8:0/3421806029 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce94ca8700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f99e0 0x7fce901094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce954a9700 1 -- 172.21.15.8:0/3421806029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f99e0 msgr2=0x7fce901094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce954a9700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f99e0 0x7fce901094d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce954a9700 1 -- 172.21.15.8:0/3421806029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c005040 con 0x7fce900f8740 2023-10-18T21:54:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce94ca8700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f99e0 0x7fce901094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:54:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce954a9700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f8740 0x7fce90108fe0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fce8c007a60 tx=0x7fce8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce85ffb700 1 -- 172.21.15.8:0/3421806029 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8c018070 con 0x7fce900f8740 2023-10-18T21:54:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce85ffb700 1 -- 172.21.15.8:0/3421806029 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fce8c009630 con 0x7fce900f8740 2023-10-18T21:54:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce85ffb700 1 -- 172.21.15.8:0/3421806029 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8c01c540 con 0x7fce900f8740 2023-10-18T21:54:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce964ab700 1 -- 172.21.15.8:0/3421806029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9010a500 con 0x7fce900f8740 2023-10-18T21:54:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.906+0000 7fce964ab700 1 -- 172.21.15.8:0/3421806029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9010aa60 con 0x7fce900f8740 2023-10-18T21:54:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.908+0000 7fce964ab700 1 -- 172.21.15.8:0/3421806029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce90045ad0 con 0x7fce900f8740 2023-10-18T21:54:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.908+0000 7fce85ffb700 1 -- 172.21.15.8:0/3421806029 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fce8c01d420 con 0x7fce900f8740 2023-10-18T21:54:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.909+0000 7fce85ffb700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce7c060f70 0x7fce7c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.909+0000 7fce85ffb700 1 -- 172.21.15.8:0/3421806029 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fce8c07e5c0 con 0x7fce900f8740 2023-10-18T21:54:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.910+0000 7fce94ca8700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce7c060f70 0x7fce7c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.910+0000 7fce94ca8700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce7c060f70 0x7fce7c063430 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fce80009740 tx=0x7fce80009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:32.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:32.914+0000 7fce85ffb700 1 -- 172.21.15.8:0/3421806029 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fce8c051ce0 con 0x7fce900f8740 2023-10-18T21:54:33.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.114+0000 7fce964ab700 1 -- 172.21.15.8:0/3421806029 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce90101050 con 0x7fce7c060f70 2023-10-18T21:54:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.115+0000 7fce85ffb700 1 -- 172.21.15.8:0/3421806029 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fce90101050 con 0x7fce7c060f70 2023-10-18T21:54:33.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 -- 172.21.15.8:0/3421806029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce7c060f70 msgr2=0x7fce7c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:33.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce7c060f70 0x7fce7c063430 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fce80009740 tx=0x7fce80009be0).stop 2023-10-18T21:54:33.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 -- 172.21.15.8:0/3421806029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f8740 msgr2=0x7fce90108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:33.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f8740 0x7fce90108fe0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fce8c007a60 tx=0x7fce8c009b30).stop 2023-10-18T21:54:33.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 -- 172.21.15.8:0/3421806029 shutdown_connections 2023-10-18T21:54:33.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce7c060f70 0x7fce7c063430 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce900f8740 0x7fce90108fe0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 --2- 172.21.15.8:0/3421806029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce900f99e0 0x7fce901094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 -- 172.21.15.8:0/3421806029 >> 172.21.15.8:0/3421806029 conn(0x7fce900f40e0 msgr2=0x7fce900fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 -- 172.21.15.8:0/3421806029 shutdown_connections 2023-10-18T21:54:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.117+0000 7fce964ab700 1 -- 172.21.15.8:0/3421806029 wait complete. 2023-10-18T21:54:33.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.253+0000 7fb393fff700 1 -- 172.21.15.8:0/740872050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3940f6530 msgr2=0x7fb3940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.253+0000 7fb393fff700 1 --2- 172.21.15.8:0/740872050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3940f6530 0x7fb3940f6950 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fb384004660 tx=0x7fb384009b30).stop 2023-10-18T21:54:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.253+0000 7fb393fff700 1 -- 172.21.15.8:0/740872050 shutdown_connections 2023-10-18T21:54:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.253+0000 7fb393fff700 1 --2- 172.21.15.8:0/740872050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3940f77d0 0x7fb3940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.253+0000 7fb393fff700 1 --2- 172.21.15.8:0/740872050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3940f6530 0x7fb3940f6950 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.253+0000 7fb393fff700 1 -- 172.21.15.8:0/740872050 >> 172.21.15.8:0/740872050 conn(0x7fb3940f1c70 msgr2=0x7fb3940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.253+0000 7fb393fff700 1 -- 172.21.15.8:0/740872050 shutdown_connections 2023-10-18T21:54:33.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.253+0000 7fb393fff700 1 -- 172.21.15.8:0/740872050 wait complete. 2023-10-18T21:54:33.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.254+0000 7fb393fff700 1 Processor -- start 2023-10-18T21:54:33.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.254+0000 7fb393fff700 1 -- start start 2023-10-18T21:54:33.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb393fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3940f6530 0x7fb394108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:33.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb393fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3940f77d0 0x7fb3941094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:33.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb393fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb394109a80 con 0x7fb3940f6530 2023-10-18T21:54:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb393fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb394109bc0 con 0x7fb3940f77d0 2023-10-18T21:54:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb392ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3940f6530 0x7fb394108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb392ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3940f6530 0x7fb394108fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49230/0 (socket says 172.21.15.8:49230) 2023-10-18T21:54:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb392ffd700 1 -- 172.21.15.8:0/3246808101 learned_addr learned my addr 172.21.15.8:0/3246808101 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb3927fc700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3940f77d0 0x7fb3941094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:33.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb392ffd700 1 -- 172.21.15.8:0/3246808101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3940f77d0 msgr2=0x7fb3941094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:33.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb392ffd700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3940f77d0 0x7fb3941094d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.255+0000 7fb392ffd700 1 -- 172.21.15.8:0/3246808101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384005040 con 0x7fb3940f6530 2023-10-18T21:54:33.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.256+0000 7fb392ffd700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3940f6530 0x7fb394108fe0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7fb384004e30 tx=0x7fb384009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:33.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.256+0000 7fb37b7fe700 1 -- 172.21.15.8:0/3246808101 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb384018070 con 0x7fb3940f6530 2023-10-18T21:54:33.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.256+0000 7fb37b7fe700 1 -- 172.21.15.8:0/3246808101 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb384009630 con 0x7fb3940f6530 2023-10-18T21:54:33.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.256+0000 7fb393fff700 1 -- 172.21.15.8:0/3246808101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39410a500 con 0x7fb3940f6530 2023-10-18T21:54:33.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.256+0000 7fb37b7fe700 1 -- 172.21.15.8:0/3246808101 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb38401c3c0 con 0x7fb3940f6530 2023-10-18T21:54:33.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.256+0000 7fb393fff700 1 -- 172.21.15.8:0/3246808101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39410aa60 con 0x7fb3940f6530 2023-10-18T21:54:33.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.257+0000 7fb393fff700 1 -- 172.21.15.8:0/3246808101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb394045ad0 con 0x7fb3940f6530 2023-10-18T21:54:33.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.258+0000 7fb37b7fe700 1 -- 172.21.15.8:0/3246808101 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb38401d420 con 0x7fb3940f6530 2023-10-18T21:54:33.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.259+0000 7fb37b7fe700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb37c060f70 0x7fb37c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:33.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.259+0000 7fb37b7fe700 1 -- 172.21.15.8:0/3246808101 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb38407e530 con 0x7fb3940f6530 2023-10-18T21:54:33.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.259+0000 7fb3927fc700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb37c060f70 0x7fb37c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:33.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.260+0000 7fb3927fc700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb37c060f70 0x7fb37c063430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fb388004c40 tx=0x7fb38800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:33.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.263+0000 7fb37b7fe700 1 -- 172.21.15.8:0/3246808101 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb384051b10 con 0x7fb3940f6530 2023-10-18T21:54:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:31.404184+0000 mgr.smithi008.flmjzp (mgr.14640) 3339 : cluster [DBG] pgmap v2297: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:33.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.456+0000 7fb393fff700 1 -- 172.21.15.8:0/3246808101 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3940fee00 con 0x7fb37c060f70 2023-10-18T21:54:33.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.465+0000 7fb37b7fe700 1 -- 172.21.15.8:0/3246808101 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb3940fee00 con 0x7fb37c060f70 2023-10-18T21:54:33.466 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:54:33.467 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (61m) 8m ago 62m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:54:33.467 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (55m) 8m ago 62m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:54:33.467 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (55m) 6m ago 61m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:54:33.467 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (61m) 8m ago 62m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:54:33.467 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 58m - - 2023-10-18T21:54:33.468 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 58m - - 2023-10-18T21:54:33.468 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 58m - - 2023-10-18T21:54:33.468 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 58m - - 2023-10-18T21:54:33.468 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (56m) 8m ago 64m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:54:33.468 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (55m) 6m ago 61m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:54:33.468 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (55m) 8m ago 64m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:54:33.469 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (55m) 6m ago 61m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:54:33.469 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (62m) 8m ago 62m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:54:33.469 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (61m) 6m ago 61m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:54:33.469 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (54m) 8m ago 61m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:54:33.470 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (52m) 8m ago 60m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:54:33.470 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (52m) 8m ago 60m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:54:33.470 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (51m) 6m ago 60m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:54:33.470 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (51m) 6m ago 60m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:54:33.470 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (50m) 6m ago 59m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:54:33.471 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (56m) 8m ago 61m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:54:33.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 -- 172.21.15.8:0/3246808101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb37c060f70 msgr2=0x7fb37c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:33.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb37c060f70 0x7fb37c063430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fb388004c40 tx=0x7fb38800b040).stop 2023-10-18T21:54:33.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 -- 172.21.15.8:0/3246808101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3940f6530 msgr2=0x7fb394108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:33.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3940f6530 0x7fb394108fe0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7fb384004e30 tx=0x7fb384009b30).stop 2023-10-18T21:54:33.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 -- 172.21.15.8:0/3246808101 shutdown_connections 2023-10-18T21:54:33.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb37c060f70 0x7fb37c063430 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3940f6530 0x7fb394108fe0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 --2- 172.21.15.8:0/3246808101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3940f77d0 0x7fb3941094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 -- 172.21.15.8:0/3246808101 >> 172.21.15.8:0/3246808101 conn(0x7fb3940f1c70 msgr2=0x7fb39406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:33.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 -- 172.21.15.8:0/3246808101 shutdown_connections 2023-10-18T21:54:33.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.467+0000 7fb393fff700 1 -- 172.21.15.8:0/3246808101 wait complete. 2023-10-18T21:54:33.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:31.404184+0000 mgr.smithi008.flmjzp (mgr.14640) 3339 : cluster [DBG] pgmap v2297: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:33.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.604+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/2947264535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcf40f77d0 msgr2=0x7fdcf40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:33.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.604+0000 7fdcf9dc2700 1 --2- 172.21.15.8:0/2947264535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcf40f77d0 0x7fdcf40f7c30 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fdce0004660 tx=0x7fdce0009b30).stop 2023-10-18T21:54:33.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.604+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/2947264535 shutdown_connections 2023-10-18T21:54:33.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.604+0000 7fdcf9dc2700 1 --2- 172.21.15.8:0/2947264535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcf40f77d0 0x7fdcf40f7c30 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.604+0000 7fdcf9dc2700 1 --2- 172.21.15.8:0/2947264535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf40f6530 0x7fdcf40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.604+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/2947264535 >> 172.21.15.8:0/2947264535 conn(0x7fdcf40f1c90 msgr2=0x7fdcf40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:33.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.604+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/2947264535 shutdown_connections 2023-10-18T21:54:33.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.605+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/2947264535 wait complete. 2023-10-18T21:54:33.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.605+0000 7fdcf9dc2700 1 Processor -- start 2023-10-18T21:54:33.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.605+0000 7fdcf9dc2700 1 -- start start 2023-10-18T21:54:33.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.606+0000 7fdcf9dc2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf40f6530 0x7fdcf4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:33.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.606+0000 7fdcf9dc2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcf40f77d0 0x7fdcf4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:33.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.606+0000 7fdcf9dc2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4107880 con 0x7fdcf40f77d0 2023-10-18T21:54:33.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.606+0000 7fdcf9dc2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf41080c0 con 0x7fdcf40f6530 2023-10-18T21:54:33.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.606+0000 7fdcf3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcf40f77d0 0x7fdcf4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:33.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.606+0000 7fdcf3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcf40f77d0 0x7fdcf4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49244/0 (socket says 172.21.15.8:49244) 2023-10-18T21:54:33.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.606+0000 7fdcf3fff700 1 -- 172.21.15.8:0/3307658466 learned_addr learned my addr 172.21.15.8:0/3307658466 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:33.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.606+0000 7fdcf8dc0700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf40f6530 0x7fdcf4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:33.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.606+0000 7fdcf3fff700 1 -- 172.21.15.8:0/3307658466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf40f6530 msgr2=0x7fdcf4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:33.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.607+0000 7fdcf3fff700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf40f6530 0x7fdcf4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.607+0000 7fdcf3fff700 1 -- 172.21.15.8:0/3307658466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce0005040 con 0x7fdcf40f77d0 2023-10-18T21:54:33.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.607+0000 7fdcf3fff700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcf40f77d0 0x7fdcf4107280 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fdce0009990 tx=0x7fdce0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:33.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.607+0000 7fdcf17fa700 1 -- 172.21.15.8:0/3307658466 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdce0018070 con 0x7fdcf40f77d0 2023-10-18T21:54:33.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.607+0000 7fdcf17fa700 1 -- 172.21.15.8:0/3307658466 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdce0009780 con 0x7fdcf40f77d0 2023-10-18T21:54:33.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.607+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/3307658466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf4108340 con 0x7fdcf40f77d0 2023-10-18T21:54:33.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.607+0000 7fdcf17fa700 1 -- 172.21.15.8:0/3307658466 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdce001c5e0 con 0x7fdcf40f77d0 2023-10-18T21:54:33.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.607+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/3307658466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf4108820 con 0x7fdcf40f77d0 2023-10-18T21:54:33.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.608+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/3307658466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf4059100 con 0x7fdcf40f77d0 2023-10-18T21:54:33.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.609+0000 7fdcf17fa700 1 -- 172.21.15.8:0/3307658466 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdce001dac0 con 0x7fdcf40f77d0 2023-10-18T21:54:33.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.610+0000 7fdcf17fa700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdce4060f70 0x7fdce4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:33.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.610+0000 7fdcf17fa700 1 -- 172.21.15.8:0/3307658466 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdce007e810 con 0x7fdcf40f77d0 2023-10-18T21:54:33.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.610+0000 7fdcf8dc0700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdce4060f70 0x7fdce4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:33.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.611+0000 7fdcf8dc0700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdce4060f70 0x7fdce4063430 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fdcf4107b50 tx=0x7fdce8009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:33.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.614+0000 7fdcf17fa700 1 -- 172.21.15.8:0/3307658466 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdce004e3c0 con 0x7fdcf40f77d0 2023-10-18T21:54:33.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.870+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/3307658466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdcf4045ad0 con 0x7fdcf40f77d0 2023-10-18T21:54:33.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.870+0000 7fdcf17fa700 1 -- 172.21.15.8:0/3307658466 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fdce00519e0 con 0x7fdcf40f77d0 2023-10-18T21:54:33.872 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:54:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:54:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:54:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:54:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:54:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:54:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:54:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:54:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:54:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:54:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:54:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:54:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:54:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:54:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:54:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:54:33.875 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:54:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.872+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/3307658466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdce4060f70 msgr2=0x7fdce4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.872+0000 7fdcf9dc2700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdce4060f70 0x7fdce4063430 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fdcf4107b50 tx=0x7fdce8009040).stop 2023-10-18T21:54:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.872+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/3307658466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcf40f77d0 msgr2=0x7fdcf4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.872+0000 7fdcf9dc2700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcf40f77d0 0x7fdcf4107280 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fdce0009990 tx=0x7fdce0009b30).stop 2023-10-18T21:54:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.872+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/3307658466 shutdown_connections 2023-10-18T21:54:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.872+0000 7fdcf9dc2700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdce4060f70 0x7fdce4063430 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.872+0000 7fdcf9dc2700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcf40f6530 0x7fdcf4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.872+0000 7fdcf9dc2700 1 --2- 172.21.15.8:0/3307658466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcf40f77d0 0x7fdcf4107280 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.872+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/3307658466 >> 172.21.15.8:0/3307658466 conn(0x7fdcf40f1c90 msgr2=0x7fdcf40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.873+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/3307658466 shutdown_connections 2023-10-18T21:54:33.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:33.873+0000 7fdcf9dc2700 1 -- 172.21.15.8:0/3307658466 wait complete. 2023-10-18T21:54:34.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.009+0000 7f1b8942c700 1 -- 172.21.15.8:0/3414724774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f6530 msgr2=0x7f1b840f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:34.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.009+0000 7f1b8942c700 1 --2- 172.21.15.8:0/3414724774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f6530 0x7f1b840f6950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1b74004660 tx=0x7f1b74009b30).stop 2023-10-18T21:54:34.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.010+0000 7f1b8942c700 1 -- 172.21.15.8:0/3414724774 shutdown_connections 2023-10-18T21:54:34.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.010+0000 7f1b8942c700 1 --2- 172.21.15.8:0/3414724774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f77d0 0x7f1b840f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.010+0000 7f1b8942c700 1 --2- 172.21.15.8:0/3414724774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f6530 0x7f1b840f6950 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.010+0000 7f1b8942c700 1 -- 172.21.15.8:0/3414724774 >> 172.21.15.8:0/3414724774 conn(0x7f1b840f1c90 msgr2=0x7f1b840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:34.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.010+0000 7f1b8942c700 1 -- 172.21.15.8:0/3414724774 shutdown_connections 2023-10-18T21:54:34.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.010+0000 7f1b8942c700 1 -- 172.21.15.8:0/3414724774 wait complete. 2023-10-18T21:54:34.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.010+0000 7f1b8942c700 1 Processor -- start 2023-10-18T21:54:34.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.011+0000 7f1b8942c700 1 -- start start 2023-10-18T21:54:34.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.011+0000 7f1b8942c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f6530 0x7f1b8406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:34.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.011+0000 7f1b8942c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f77d0 0x7f1b84069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:34.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.011+0000 7f1b8942c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8406a380 con 0x7f1b840f6530 2023-10-18T21:54:34.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.011+0000 7f1b8942c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8406a4c0 con 0x7f1b840f77d0 2023-10-18T21:54:34.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.011+0000 7f1b83fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f6530 0x7f1b8406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:34.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.011+0000 7f1b83fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f6530 0x7f1b8406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49270/0 (socket says 172.21.15.8:49270) 2023-10-18T21:54:34.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.011+0000 7f1b83fff700 1 -- 172.21.15.8:0/1950199831 learned_addr learned my addr 172.21.15.8:0/1950199831 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:34.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.011+0000 7f1b837fe700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f77d0 0x7f1b84069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:34.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.012+0000 7f1b83fff700 1 -- 172.21.15.8:0/1950199831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f77d0 msgr2=0x7f1b84069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:34.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.012+0000 7f1b83fff700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f77d0 0x7f1b84069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.012+0000 7f1b83fff700 1 -- 172.21.15.8:0/1950199831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b78005040 con 0x7f1b840f6530 2023-10-18T21:54:34.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.012+0000 7f1b83fff700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f6530 0x7f1b8406b9a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f1b74014040 tx=0x7f1b7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:34.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.012+0000 7f1b80ff9700 1 -- 172.21.15.8:0/1950199831 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b74019070 con 0x7f1b840f6530 2023-10-18T21:54:34.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.012+0000 7f1b80ff9700 1 -- 172.21.15.8:0/1950199831 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1b7401e420 con 0x7f1b840f6530 2023-10-18T21:54:34.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.012+0000 7f1b80ff9700 1 -- 172.21.15.8:0/1950199831 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b74014620 con 0x7f1b840f6530 2023-10-18T21:54:34.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.012+0000 7f1b8942c700 1 -- 172.21.15.8:0/1950199831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b74005040 con 0x7f1b840f6530 2023-10-18T21:54:34.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.012+0000 7f1b8942c700 1 -- 172.21.15.8:0/1950199831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8406aa90 con 0x7f1b840f6530 2023-10-18T21:54:34.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.014+0000 7f1b8942c700 1 -- 172.21.15.8:0/1950199831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b84059100 con 0x7f1b840f6530 2023-10-18T21:54:34.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.014+0000 7f1b80ff9700 1 -- 172.21.15.8:0/1950199831 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1b7401e9e0 con 0x7f1b840f6530 2023-10-18T21:54:34.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.015+0000 7f1b80ff9700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b6c060f70 0x7f1b6c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:34.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.015+0000 7f1b80ff9700 1 -- 172.21.15.8:0/1950199831 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1b7407dcc0 con 0x7f1b840f6530 2023-10-18T21:54:34.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.015+0000 7f1b837fe700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b6c060f70 0x7f1b6c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:34.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.016+0000 7f1b837fe700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b6c060f70 0x7f1b6c063430 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f1b78009170 tx=0x7f1b7800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:34.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.019+0000 7f1b80ff9700 1 -- 172.21.15.8:0/1950199831 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1b7404d930 con 0x7f1b840f6530 2023-10-18T21:54:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:32.761681+0000 mgr.smithi008.flmjzp (mgr.14640) 3340 : audit [DBG] from='client.36760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:33.115469+0000 mgr.smithi008.flmjzp (mgr.14640) 3341 : audit [DBG] from='client.36764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:34.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:33.870885+0000 mon.smithi008 (mon.0) 3704 : audit [DBG] from='client.? 172.21.15.8:0/3307658466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.247+0000 7f1b8942c700 1 -- 172.21.15.8:0/1950199831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1b84045ad0 con 0x7f1b840f6530 2023-10-18T21:54:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.247+0000 7f1b80ff9700 1 -- 172.21.15.8:0/1950199831 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1b74050f50 con 0x7f1b840f6530 2023-10-18T21:54:34.249 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:54:34.249 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:54:34.249 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:54:34.249 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:54:34.249 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:54:34.250 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:54:34.250 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:54:34.250 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:54:34.250 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:54:34.250 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:54:34.251 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:54:34.251 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:54:34.251 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:54:34.251 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:54:34.251 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:54:34.252 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:54:34.252 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:54:34.252 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:54:34.252 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:54:34.252 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:54:34.253 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:54:34.253 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:54:34.253 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:54:34.253 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:54:34.253 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:54:34.253 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:54:34.254 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:54:34.254 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:54:34.254 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:54:34.254 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:54:34.254 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:54:34.255 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:54:34.255 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:54:34.255 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:54:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 -- 172.21.15.8:0/1950199831 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b6c060f70 msgr2=0x7f1b6c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b6c060f70 0x7f1b6c063430 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f1b78009170 tx=0x7f1b7800b040).stop 2023-10-18T21:54:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 -- 172.21.15.8:0/1950199831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f6530 msgr2=0x7f1b8406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f6530 0x7f1b8406b9a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f1b74014040 tx=0x7f1b7400b040).stop 2023-10-18T21:54:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 -- 172.21.15.8:0/1950199831 shutdown_connections 2023-10-18T21:54:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1b6c060f70 0x7f1b6c063430 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b840f6530 0x7f1b8406b9a0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 --2- 172.21.15.8:0/1950199831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b840f77d0 0x7f1b84069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 -- 172.21.15.8:0/1950199831 >> 172.21.15.8:0/1950199831 conn(0x7f1b840f1c90 msgr2=0x7f1b840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 -- 172.21.15.8:0/1950199831 shutdown_connections 2023-10-18T21:54:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.249+0000 7f1b8942c700 1 -- 172.21.15.8:0/1950199831 wait complete. 2023-10-18T21:54:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:54:34.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.387+0000 7fa639053700 1 -- 172.21.15.8:0/945873951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6340f77d0 msgr2=0x7fa6340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:34.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.387+0000 7fa639053700 1 --2- 172.21.15.8:0/945873951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6340f77d0 0x7fa6340f7c30 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7fa61c004660 tx=0x7fa61c009b30).stop 2023-10-18T21:54:34.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.387+0000 7fa639053700 1 -- 172.21.15.8:0/945873951 shutdown_connections 2023-10-18T21:54:34.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.387+0000 7fa639053700 1 --2- 172.21.15.8:0/945873951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6340f77d0 0x7fa6340f7c30 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.387+0000 7fa639053700 1 --2- 172.21.15.8:0/945873951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6340f6530 0x7fa6340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.387+0000 7fa639053700 1 -- 172.21.15.8:0/945873951 >> 172.21.15.8:0/945873951 conn(0x7fa6340f1c90 msgr2=0x7fa6340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:34.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.388+0000 7fa639053700 1 -- 172.21.15.8:0/945873951 shutdown_connections 2023-10-18T21:54:34.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.388+0000 7fa639053700 1 -- 172.21.15.8:0/945873951 wait complete. 2023-10-18T21:54:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.388+0000 7fa639053700 1 Processor -- start 2023-10-18T21:54:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.389+0000 7fa639053700 1 -- start start 2023-10-18T21:54:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.389+0000 7fa639053700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6340f6530 0x7fa634108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.389+0000 7fa639053700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6340f77d0 0x7fa634109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.389+0000 7fa639053700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa634109a20 con 0x7fa6340f77d0 2023-10-18T21:54:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.389+0000 7fa639053700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa634109b60 con 0x7fa6340f6530 2023-10-18T21:54:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.389+0000 7fa62bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6340f77d0 0x7fa634109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.389+0000 7fa62bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6340f77d0 0x7fa634109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49278/0 (socket says 172.21.15.8:49278) 2023-10-18T21:54:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.389+0000 7fa62bfff700 1 -- 172.21.15.8:0/3474199257 learned_addr learned my addr 172.21.15.8:0/3474199257 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:54:34.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.389+0000 7fa633fff700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6340f6530 0x7fa634108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:34.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.390+0000 7fa62bfff700 1 -- 172.21.15.8:0/3474199257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6340f6530 msgr2=0x7fa634108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:34.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.390+0000 7fa62bfff700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6340f6530 0x7fa634108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.390+0000 7fa62bfff700 1 -- 172.21.15.8:0/3474199257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c005040 con 0x7fa6340f77d0 2023-10-18T21:54:34.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.390+0000 7fa62bfff700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6340f77d0 0x7fa634109470 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7fa61c009990 tx=0x7fa61c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.390+0000 7fa6317fa700 1 -- 172.21.15.8:0/3474199257 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61c018070 con 0x7fa6340f77d0 2023-10-18T21:54:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.390+0000 7fa6317fa700 1 -- 172.21.15.8:0/3474199257 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa61c009630 con 0x7fa6340f77d0 2023-10-18T21:54:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.390+0000 7fa639053700 1 -- 172.21.15.8:0/3474199257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63410a4a0 con 0x7fa6340f77d0 2023-10-18T21:54:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.390+0000 7fa6317fa700 1 -- 172.21.15.8:0/3474199257 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61c01c3c0 con 0x7fa6340f77d0 2023-10-18T21:54:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.390+0000 7fa639053700 1 -- 172.21.15.8:0/3474199257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63410aa00 con 0x7fa6340f77d0 2023-10-18T21:54:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.391+0000 7fa639053700 1 -- 172.21.15.8:0/3474199257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa634045ad0 con 0x7fa6340f77d0 2023-10-18T21:54:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.392+0000 7fa6317fa700 1 -- 172.21.15.8:0/3474199257 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa61c01d970 con 0x7fa6340f77d0 2023-10-18T21:54:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.393+0000 7fa6317fa700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa620060f70 0x7fa620063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:54:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.394+0000 7fa6317fa700 1 -- 172.21.15.8:0/3474199257 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa61c07e660 con 0x7fa6340f77d0 2023-10-18T21:54:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.394+0000 7fa633fff700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa620060f70 0x7fa620063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:54:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.394+0000 7fa633fff700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa620060f70 0x7fa620063430 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fa6340f7630 tx=0x7fa62400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:54:34.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.398+0000 7fa6317fa700 1 -- 172.21.15.8:0/3474199257 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa61c051c40 con 0x7fa6340f77d0 2023-10-18T21:54:34.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:32.761681+0000 mgr.smithi008.flmjzp (mgr.14640) 3340 : audit [DBG] from='client.36760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:33.115469+0000 mgr.smithi008.flmjzp (mgr.14640) 3341 : audit [DBG] from='client.36764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:33.870885+0000 mon.smithi008 (mon.0) 3704 : audit [DBG] from='client.? 172.21.15.8:0/3307658466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:34.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.594+0000 7fa639053700 1 -- 172.21.15.8:0/3474199257 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6340fee00 con 0x7fa620060f70 2023-10-18T21:54:34.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.595+0000 7fa6317fa700 1 -- 172.21.15.8:0/3474199257 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa6340fee00 con 0x7fa620060f70 2023-10-18T21:54:34.597 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:54:34.597 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:54:34.597 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:54:34.597 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:54:34.598 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:54:34.598 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:54:34.598 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:54:34.598 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:54:34.598 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:54:34.599 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:54:34.599 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:54:34.599 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:54:34.599 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:54:34.599 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:54:34.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.597+0000 7fa639053700 1 -- 172.21.15.8:0/3474199257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa620060f70 msgr2=0x7fa620063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:34.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.597+0000 7fa639053700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa620060f70 0x7fa620063430 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fa6340f7630 tx=0x7fa62400b040).stop 2023-10-18T21:54:34.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.597+0000 7fa639053700 1 -- 172.21.15.8:0/3474199257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6340f77d0 msgr2=0x7fa634109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:54:34.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.597+0000 7fa639053700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6340f77d0 0x7fa634109470 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7fa61c009990 tx=0x7fa61c009b30).stop 2023-10-18T21:54:34.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.598+0000 7fa639053700 1 -- 172.21.15.8:0/3474199257 shutdown_connections 2023-10-18T21:54:34.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.598+0000 7fa639053700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa620060f70 0x7fa620063430 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.598+0000 7fa639053700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6340f6530 0x7fa634108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.598+0000 7fa639053700 1 --2- 172.21.15.8:0/3474199257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6340f77d0 0x7fa634109470 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:54:34.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.598+0000 7fa639053700 1 -- 172.21.15.8:0/3474199257 >> 172.21.15.8:0/3474199257 conn(0x7fa6340f1c90 msgr2=0x7fa63406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:54:34.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.598+0000 7fa639053700 1 -- 172.21.15.8:0/3474199257 shutdown_connections 2023-10-18T21:54:34.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:54:34.598+0000 7fa639053700 1 -- 172.21.15.8:0/3474199257 wait complete. 2023-10-18T21:54:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:33.404689+0000 mgr.smithi008.flmjzp (mgr.14640) 3342 : cluster [DBG] pgmap v2298: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:33.457253+0000 mgr.smithi008.flmjzp (mgr.14640) 3343 : audit [DBG] from='client.36768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:34.247812+0000 mon.smithi008 (mon.0) 3705 : audit [DBG] from='client.? 172.21.15.8:0/1950199831' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:54:35.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:33.404689+0000 mgr.smithi008.flmjzp (mgr.14640) 3342 : cluster [DBG] pgmap v2298: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:33.457253+0000 mgr.smithi008.flmjzp (mgr.14640) 3343 : audit [DBG] from='client.36768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:34.247812+0000 mon.smithi008 (mon.0) 3705 : audit [DBG] from='client.? 172.21.15.8:0/1950199831' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:54:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:34.595846+0000 mgr.smithi008.flmjzp (mgr.14640) 3344 : audit [DBG] from='client.36780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:35.432194+0000 mon.smithi008 (mon.0) 3706 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:35.987532+0000 mon.smithi008 (mon.0) 3707 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:35.988634+0000 mon.smithi008 (mon.0) 3708 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:35.995297+0000 mon.smithi008 (mon.0) 3709 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:36.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:36.001795+0000 mon.smithi008 (mon.0) 3710 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:36.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:36.004950+0000 mon.smithi008 (mon.0) 3711 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:36.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:36.006637+0000 mon.smithi008 (mon.0) 3712 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:34.595846+0000 mgr.smithi008.flmjzp (mgr.14640) 3344 : audit [DBG] from='client.36780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:54:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:35.432194+0000 mon.smithi008 (mon.0) 3706 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:35.987532+0000 mon.smithi008 (mon.0) 3707 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:35.988634+0000 mon.smithi008 (mon.0) 3708 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:35.995297+0000 mon.smithi008 (mon.0) 3709 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:36.001795+0000 mon.smithi008 (mon.0) 3710 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:36.004950+0000 mon.smithi008 (mon.0) 3711 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:36.006637+0000 mon.smithi008 (mon.0) 3712 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:35.405249+0000 mgr.smithi008.flmjzp (mgr.14640) 3345 : cluster [DBG] pgmap v2299: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:35.989537+0000 mgr.smithi008.flmjzp (mgr.14640) 3346 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:54:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:35.990154+0000 mgr.smithi008.flmjzp (mgr.14640) 3347 : cluster [DBG] pgmap v2300: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:35.990386+0000 mgr.smithi008.flmjzp (mgr.14640) 3348 : cluster [DBG] pgmap v2301: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:36.008679+0000 mon.smithi008 (mon.0) 3713 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:36.011960+0000 mon.smithi008 (mon.0) 3714 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:36.014187+0000 mgr.smithi008.flmjzp (mgr.14640) 3349 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:54:37.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:35.405249+0000 mgr.smithi008.flmjzp (mgr.14640) 3345 : cluster [DBG] pgmap v2299: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:35.989537+0000 mgr.smithi008.flmjzp (mgr.14640) 3346 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:54:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:35.990154+0000 mgr.smithi008.flmjzp (mgr.14640) 3347 : cluster [DBG] pgmap v2300: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:35.990386+0000 mgr.smithi008.flmjzp (mgr.14640) 3348 : cluster [DBG] pgmap v2301: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:36.008679+0000 mon.smithi008 (mon.0) 3713 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:36.011960+0000 mon.smithi008 (mon.0) 3714 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:36.014187+0000 mgr.smithi008.flmjzp (mgr.14640) 3349 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:54:39.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:37.990978+0000 mgr.smithi008.flmjzp (mgr.14640) 3350 : cluster [DBG] pgmap v2302: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:39.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:37.990978+0000 mgr.smithi008.flmjzp (mgr.14640) 3350 : cluster [DBG] pgmap v2302: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:39.991539+0000 mgr.smithi008.flmjzp (mgr.14640) 3351 : cluster [DBG] pgmap v2303: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:39.991539+0000 mgr.smithi008.flmjzp (mgr.14640) 3351 : cluster [DBG] pgmap v2303: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:43.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:41.992027+0000 mgr.smithi008.flmjzp (mgr.14640) 3352 : cluster [DBG] pgmap v2304: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:41.992027+0000 mgr.smithi008.flmjzp (mgr.14640) 3352 : cluster [DBG] pgmap v2304: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:43.992637+0000 mgr.smithi008.flmjzp (mgr.14640) 3353 : cluster [DBG] pgmap v2305: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:43.992637+0000 mgr.smithi008.flmjzp (mgr.14640) 3353 : cluster [DBG] pgmap v2305: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:45.993267+0000 mgr.smithi008.flmjzp (mgr.14640) 3354 : cluster [DBG] pgmap v2306: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:46.024466+0000 mon.smithi008 (mon.0) 3715 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:46.026602+0000 mon.smithi008 (mon.0) 3716 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:46.027536+0000 mon.smithi008 (mon.0) 3717 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:46.028339+0000 mgr.smithi008.flmjzp (mgr.14640) 3355 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:54:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:46.028868+0000 mgr.smithi008.flmjzp (mgr.14640) 3356 : cluster [DBG] pgmap v2307: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:47.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:46.029135+0000 mgr.smithi008.flmjzp (mgr.14640) 3357 : cluster [DBG] pgmap v2308: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:47.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:46.033673+0000 mon.smithi008 (mon.0) 3718 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:47.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:46.040048+0000 mon.smithi008 (mon.0) 3719 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:47.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:46.042963+0000 mon.smithi008 (mon.0) 3720 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:47.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:46.044538+0000 mon.smithi008 (mon.0) 3721 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:47.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:46.046090+0000 mon.smithi008 (mon.0) 3722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:47.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:46.047980+0000 mon.smithi008 (mon.0) 3723 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:47.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:46.049770+0000 mgr.smithi008.flmjzp (mgr.14640) 3358 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:54:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:45.993267+0000 mgr.smithi008.flmjzp (mgr.14640) 3354 : cluster [DBG] pgmap v2306: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:46.024466+0000 mon.smithi008 (mon.0) 3715 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:46.026602+0000 mon.smithi008 (mon.0) 3716 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:47.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:46.027536+0000 mon.smithi008 (mon.0) 3717 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:47.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:46.028339+0000 mgr.smithi008.flmjzp (mgr.14640) 3355 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:54:47.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:46.028868+0000 mgr.smithi008.flmjzp (mgr.14640) 3356 : cluster [DBG] pgmap v2307: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:47.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:46.029135+0000 mgr.smithi008.flmjzp (mgr.14640) 3357 : cluster [DBG] pgmap v2308: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:47.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:46.033673+0000 mon.smithi008 (mon.0) 3718 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:47.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:46.040048+0000 mon.smithi008 (mon.0) 3719 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:47.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:46.042963+0000 mon.smithi008 (mon.0) 3720 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:47.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:46.044538+0000 mon.smithi008 (mon.0) 3721 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:47.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:46.046090+0000 mon.smithi008 (mon.0) 3722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:47.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:46.047980+0000 mon.smithi008 (mon.0) 3723 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:47.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:46.049770+0000 mgr.smithi008.flmjzp (mgr.14640) 3358 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:54:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:48.029624+0000 mgr.smithi008.flmjzp (mgr.14640) 3359 : cluster [DBG] pgmap v2309: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:48.029624+0000 mgr.smithi008.flmjzp (mgr.14640) 3359 : cluster [DBG] pgmap v2309: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:50.030109+0000 mgr.smithi008.flmjzp (mgr.14640) 3360 : cluster [DBG] pgmap v2310: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:50.030109+0000 mgr.smithi008.flmjzp (mgr.14640) 3360 : cluster [DBG] pgmap v2310: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:52.030817+0000 mgr.smithi008.flmjzp (mgr.14640) 3361 : cluster [DBG] pgmap v2311: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:53.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:52.030817+0000 mgr.smithi008.flmjzp (mgr.14640) 3361 : cluster [DBG] pgmap v2311: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:54.031404+0000 mgr.smithi008.flmjzp (mgr.14640) 3362 : cluster [DBG] pgmap v2312: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:55.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:54.031404+0000 mgr.smithi008.flmjzp (mgr.14640) 3362 : cluster [DBG] pgmap v2312: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:56.974 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:56.031967+0000 mgr.smithi008.flmjzp (mgr.14640) 3363 : cluster [DBG] pgmap v2313: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:56.974 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:56.055710+0000 mon.smithi008 (mon.0) 3724 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:56.031967+0000 mgr.smithi008.flmjzp (mgr.14640) 3363 : cluster [DBG] pgmap v2313: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:56.055710+0000 mon.smithi008 (mon.0) 3724 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:58.032596+0000 mgr.smithi008.flmjzp (mgr.14640) 3364 : cluster [DBG] pgmap v2314: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:58.935739+0000 mon.smithi008 (mon.0) 3725 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:58.936743+0000 mon.smithi008 (mon.0) 3726 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:58.937783+0000 mon.smithi008 (mon.0) 3727 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:58.943514+0000 mon.smithi008 (mon.0) 3728 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:58.949906+0000 mon.smithi008 (mon.0) 3729 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:59.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:58.952980+0000 mon.smithi008 (mon.0) 3730 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:59.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:58.954655+0000 mon.smithi008 (mon.0) 3731 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:59.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:58.956261+0000 mon.smithi008 (mon.0) 3732 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:59.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:54:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:54:58.958176+0000 mon.smithi008 (mon.0) 3733 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:58.032596+0000 mgr.smithi008.flmjzp (mgr.14640) 3364 : cluster [DBG] pgmap v2314: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:54:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:58.935739+0000 mon.smithi008 (mon.0) 3725 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:58.936743+0000 mon.smithi008 (mon.0) 3726 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:54:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:58.937783+0000 mon.smithi008 (mon.0) 3727 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:54:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:58.943514+0000 mon.smithi008 (mon.0) 3728 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:54:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:58.949906+0000 mon.smithi008 (mon.0) 3729 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:54:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:58.952980+0000 mon.smithi008 (mon.0) 3730 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:58.954655+0000 mon.smithi008 (mon.0) 3731 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:58.956261+0000 mon.smithi008 (mon.0) 3732 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:54:59.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:54:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:54:58.958176+0000 mon.smithi008 (mon.0) 3733 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:58.938669+0000 mgr.smithi008.flmjzp (mgr.14640) 3365 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:58.939381+0000 mgr.smithi008.flmjzp (mgr.14640) 3366 : cluster [DBG] pgmap v2315: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:54:58.939661+0000 mgr.smithi008.flmjzp (mgr.14640) 3367 : cluster [DBG] pgmap v2316: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:54:58.960096+0000 mgr.smithi008.flmjzp (mgr.14640) 3368 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:58.938669+0000 mgr.smithi008.flmjzp (mgr.14640) 3365 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:58.939381+0000 mgr.smithi008.flmjzp (mgr.14640) 3366 : cluster [DBG] pgmap v2315: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:54:58.939661+0000 mgr.smithi008.flmjzp (mgr.14640) 3367 : cluster [DBG] pgmap v2316: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:54:58.960096+0000 mgr.smithi008.flmjzp (mgr.14640) 3368 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:00.940191+0000 mgr.smithi008.flmjzp (mgr.14640) 3369 : cluster [DBG] pgmap v2317: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:00.940191+0000 mgr.smithi008.flmjzp (mgr.14640) 3369 : cluster [DBG] pgmap v2317: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:02.940768+0000 mgr.smithi008.flmjzp (mgr.14640) 3370 : cluster [DBG] pgmap v2318: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:04.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:02.940768+0000 mgr.smithi008.flmjzp (mgr.14640) 3370 : cluster [DBG] pgmap v2318: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:04.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.751+0000 7f054359e700 1 -- 172.21.15.8:0/3670889373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440f77d0 msgr2=0x7f05440f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:04.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.751+0000 7f054359e700 1 --2- 172.21.15.8:0/3670889373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440f77d0 0x7f05440f7c30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f0538004660 tx=0x7f0538009b30).stop 2023-10-18T21:55:04.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.751+0000 7f054359e700 1 -- 172.21.15.8:0/3670889373 shutdown_connections 2023-10-18T21:55:04.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.751+0000 7f054359e700 1 --2- 172.21.15.8:0/3670889373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440f77d0 0x7f05440f7c30 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:04.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.751+0000 7f054359e700 1 --2- 172.21.15.8:0/3670889373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05440f6530 0x7f05440f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:55:04.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.751+0000 7f054359e700 1 -- 172.21.15.8:0/3670889373 >> 172.21.15.8:0/3670889373 conn(0x7f05440f1c90 msgr2=0x7f05440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:04.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.751+0000 7f054359e700 1 -- 172.21.15.8:0/3670889373 shutdown_connections 2023-10-18T21:55:04.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.751+0000 7f054359e700 1 -- 172.21.15.8:0/3670889373 wait complete. 2023-10-18T21:55:04.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.752+0000 7f054359e700 1 Processor -- start 2023-10-18T21:55:04.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.752+0000 7f054359e700 1 -- start start 2023-10-18T21:55:04.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.752+0000 7f054359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05440f6530 0x7f054406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:04.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.752+0000 7f054359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440f77d0 0x7f0544069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:04.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.752+0000 7f054359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054406a410 con 0x7f05440f77d0 2023-10-18T21:55:04.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.752+0000 7f054359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054406a550 con 0x7f05440f6530 2023-10-18T21:55:04.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.753+0000 7f0541d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440f77d0 0x7f0544069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:04.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.753+0000 7f0541d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440f77d0 0x7f0544069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59364/0 (socket says 172.21.15.8:59364) 2023-10-18T21:55:04.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.753+0000 7f0541d9b700 1 -- 172.21.15.8:0/1824317421 learned_addr learned my addr 172.21.15.8:0/1824317421 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:04.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.753+0000 7f054259c700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05440f6530 0x7f054406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:04.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.753+0000 7f0541d9b700 1 -- 172.21.15.8:0/1824317421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05440f6530 msgr2=0x7f054406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:04.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.753+0000 7f0541d9b700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05440f6530 0x7f054406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.753+0000 7f0541d9b700 1 -- 172.21.15.8:0/1824317421 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538005040 con 0x7f05440f77d0 2023-10-18T21:55:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.753+0000 7f054259c700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05440f6530 0x7f054406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:55:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.753+0000 7f0541d9b700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440f77d0 0x7f0544069e20 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f0538009990 tx=0x7f0538009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.753+0000 7f0532ffd700 1 -- 172.21.15.8:0/1824317421 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0538018070 con 0x7f05440f77d0 2023-10-18T21:55:04.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.754+0000 7f0532ffd700 1 -- 172.21.15.8:0/1824317421 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0538009780 con 0x7f05440f77d0 2023-10-18T21:55:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.754+0000 7f0532ffd700 1 -- 172.21.15.8:0/1824317421 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053801c5a0 con 0x7f05440f77d0 2023-10-18T21:55:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.754+0000 7f054359e700 1 -- 172.21.15.8:0/1824317421 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054406a7d0 con 0x7f05440f77d0 2023-10-18T21:55:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.754+0000 7f054359e700 1 -- 172.21.15.8:0/1824317421 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054410edc0 con 0x7f05440f77d0 2023-10-18T21:55:04.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.755+0000 7f054359e700 1 -- 172.21.15.8:0/1824317421 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0544045ad0 con 0x7f05440f77d0 2023-10-18T21:55:04.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.756+0000 7f0532ffd700 1 -- 172.21.15.8:0/1824317421 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f053801db30 con 0x7f05440f77d0 2023-10-18T21:55:04.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.756+0000 7f0532ffd700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f052c060f70 0x7f052c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:04.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.756+0000 7f0532ffd700 1 -- 172.21.15.8:0/1824317421 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f053807e7b0 con 0x7f05440f77d0 2023-10-18T21:55:04.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.757+0000 7f054259c700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f052c060f70 0x7f052c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:04.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.757+0000 7f054259c700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f052c060f70 0x7f052c063430 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f054406b730 tx=0x7f0534008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.761+0000 7f0532ffd700 1 -- 172.21.15.8:0/1824317421 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f053804e4a0 con 0x7f05440f77d0 2023-10-18T21:55:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.963+0000 7f054359e700 1 -- 172.21.15.8:0/1824317421 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05440fee70 con 0x7f052c060f70 2023-10-18T21:55:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.964+0000 7f0532ffd700 1 -- 172.21.15.8:0/1824317421 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f05440fee70 con 0x7f052c060f70 2023-10-18T21:55:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.966+0000 7f054359e700 1 -- 172.21.15.8:0/1824317421 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f052c060f70 msgr2=0x7f052c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.966+0000 7f054359e700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f052c060f70 0x7f052c063430 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f054406b730 tx=0x7f0534008040).stop 2023-10-18T21:55:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.966+0000 7f054359e700 1 -- 172.21.15.8:0/1824317421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440f77d0 msgr2=0x7f0544069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.966+0000 7f054359e700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440f77d0 0x7f0544069e20 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f0538009990 tx=0x7f0538009b30).stop 2023-10-18T21:55:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.966+0000 7f054359e700 1 -- 172.21.15.8:0/1824317421 shutdown_connections 2023-10-18T21:55:04.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.966+0000 7f054359e700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f052c060f70 0x7f052c063430 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:04.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.966+0000 7f054359e700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05440f6530 0x7f054406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:04.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.966+0000 7f054359e700 1 --2- 172.21.15.8:0/1824317421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440f77d0 0x7f0544069e20 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:04.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.966+0000 7f054359e700 1 -- 172.21.15.8:0/1824317421 >> 172.21.15.8:0/1824317421 conn(0x7f05440f1c90 msgr2=0x7f05440fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:04.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.967+0000 7f054359e700 1 -- 172.21.15.8:0/1824317421 shutdown_connections 2023-10-18T21:55:04.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:04.967+0000 7f054359e700 1 -- 172.21.15.8:0/1824317421 wait complete. 2023-10-18T21:55:04.983 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:55:05.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.105+0000 7fa38c813700 1 -- 172.21.15.8:0/4061065951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3880f77d0 msgr2=0x7fa3880f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:05.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.105+0000 7fa38c813700 1 --2- 172.21.15.8:0/4061065951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3880f77d0 0x7fa3880f7c30 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fa37c004660 tx=0x7fa37c009b30).stop 2023-10-18T21:55:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.106+0000 7fa38c813700 1 -- 172.21.15.8:0/4061065951 shutdown_connections 2023-10-18T21:55:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.106+0000 7fa38c813700 1 --2- 172.21.15.8:0/4061065951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3880f77d0 0x7fa3880f7c30 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.106+0000 7fa38c813700 1 --2- 172.21.15.8:0/4061065951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3880f6530 0x7fa3880f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.106+0000 7fa38c813700 1 -- 172.21.15.8:0/4061065951 >> 172.21.15.8:0/4061065951 conn(0x7fa3880f1c90 msgr2=0x7fa3880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.106+0000 7fa38c813700 1 -- 172.21.15.8:0/4061065951 shutdown_connections 2023-10-18T21:55:05.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.106+0000 7fa38c813700 1 -- 172.21.15.8:0/4061065951 wait complete. 2023-10-18T21:55:05.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.106+0000 7fa38c813700 1 Processor -- start 2023-10-18T21:55:05.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.107+0000 7fa38c813700 1 -- start start 2023-10-18T21:55:05.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.107+0000 7fa38c813700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3880f6530 0x7fa388108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:05.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.107+0000 7fa38c813700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3880f77d0 0x7fa388109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:05.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.107+0000 7fa38c813700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa388109a20 con 0x7fa3880f77d0 2023-10-18T21:55:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.107+0000 7fa38c813700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa388109b60 con 0x7fa3880f6530 2023-10-18T21:55:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.107+0000 7fa386ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3880f77d0 0x7fa388109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.107+0000 7fa386ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3880f77d0 0x7fa388109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59386/0 (socket says 172.21.15.8:59386) 2023-10-18T21:55:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.107+0000 7fa386ffd700 1 -- 172.21.15.8:0/2825640617 learned_addr learned my addr 172.21.15.8:0/2825640617 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.107+0000 7fa3877fe700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3880f6530 0x7fa388108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.108+0000 7fa386ffd700 1 -- 172.21.15.8:0/2825640617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3880f6530 msgr2=0x7fa388108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.108+0000 7fa386ffd700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3880f6530 0x7fa388108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.108+0000 7fa386ffd700 1 -- 172.21.15.8:0/2825640617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c005040 con 0x7fa3880f77d0 2023-10-18T21:55:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.108+0000 7fa386ffd700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3880f77d0 0x7fa388109470 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7fa37c009830 tx=0x7fa37c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.108+0000 7fa36ffff700 1 -- 172.21.15.8:0/2825640617 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa37c018070 con 0x7fa3880f77d0 2023-10-18T21:55:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.108+0000 7fa36ffff700 1 -- 172.21.15.8:0/2825640617 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa37c01d8e0 con 0x7fa3880f77d0 2023-10-18T21:55:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.108+0000 7fa38c813700 1 -- 172.21.15.8:0/2825640617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38810a4a0 con 0x7fa3880f77d0 2023-10-18T21:55:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.108+0000 7fa36ffff700 1 -- 172.21.15.8:0/2825640617 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa37c01c480 con 0x7fa3880f77d0 2023-10-18T21:55:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.108+0000 7fa38c813700 1 -- 172.21.15.8:0/2825640617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38810aa00 con 0x7fa3880f77d0 2023-10-18T21:55:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.109+0000 7fa38c813700 1 -- 172.21.15.8:0/2825640617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa388045ad0 con 0x7fa3880f77d0 2023-10-18T21:55:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.110+0000 7fa36ffff700 1 -- 172.21.15.8:0/2825640617 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa37c01da50 con 0x7fa3880f77d0 2023-10-18T21:55:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.111+0000 7fa36ffff700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa370060f70 0x7fa370063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.111+0000 7fa36ffff700 1 -- 172.21.15.8:0/2825640617 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa37c07e7c0 con 0x7fa3880f77d0 2023-10-18T21:55:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.111+0000 7fa3877fe700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa370060f70 0x7fa370063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.112+0000 7fa3877fe700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa370060f70 0x7fa370063430 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fa3880f7630 tx=0x7fa378009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:05.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.115+0000 7fa36ffff700 1 -- 172.21.15.8:0/2825640617 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa37c051e20 con 0x7fa3880f77d0 2023-10-18T21:55:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.316+0000 7fa38c813700 1 -- 172.21.15.8:0/2825640617 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3880fee00 con 0x7fa370060f70 2023-10-18T21:55:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.317+0000 7fa36ffff700 1 -- 172.21.15.8:0/2825640617 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa3880fee00 con 0x7fa370060f70 2023-10-18T21:55:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 -- 172.21.15.8:0/2825640617 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa370060f70 msgr2=0x7fa370063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa370060f70 0x7fa370063430 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fa3880f7630 tx=0x7fa378009040).stop 2023-10-18T21:55:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 -- 172.21.15.8:0/2825640617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3880f77d0 msgr2=0x7fa388109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3880f77d0 0x7fa388109470 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7fa37c009830 tx=0x7fa37c009b30).stop 2023-10-18T21:55:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 -- 172.21.15.8:0/2825640617 shutdown_connections 2023-10-18T21:55:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa370060f70 0x7fa370063430 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3880f6530 0x7fa388108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 --2- 172.21.15.8:0/2825640617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3880f77d0 0x7fa388109470 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 -- 172.21.15.8:0/2825640617 >> 172.21.15.8:0/2825640617 conn(0x7fa3880f1c90 msgr2=0x7fa38806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:05.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 -- 172.21.15.8:0/2825640617 shutdown_connections 2023-10-18T21:55:05.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.319+0000 7fa38c813700 1 -- 172.21.15.8:0/2825640617 wait complete. 2023-10-18T21:55:05.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.458+0000 7efda3fff700 1 -- 172.21.15.8:0/1579938954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda406a3b0 msgr2=0x7efda406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.458+0000 7efda3fff700 1 --2- 172.21.15.8:0/1579938954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda406a3b0 0x7efda406a830 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7efd98004660 tx=0x7efd98009b30).stop 2023-10-18T21:55:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.458+0000 7efda3fff700 1 -- 172.21.15.8:0/1579938954 shutdown_connections 2023-10-18T21:55:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.458+0000 7efda3fff700 1 --2- 172.21.15.8:0/1579938954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda406a3b0 0x7efda406a830 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.458+0000 7efda3fff700 1 --2- 172.21.15.8:0/1579938954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efda406b9c0 0x7efda4069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.458+0000 7efda3fff700 1 -- 172.21.15.8:0/1579938954 >> 172.21.15.8:0/1579938954 conn(0x7efda40f1c90 msgr2=0x7efda40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.458+0000 7efda3fff700 1 -- 172.21.15.8:0/1579938954 shutdown_connections 2023-10-18T21:55:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.458+0000 7efda3fff700 1 -- 172.21.15.8:0/1579938954 wait complete. 2023-10-18T21:55:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.459+0000 7efda3fff700 1 Processor -- start 2023-10-18T21:55:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.459+0000 7efda3fff700 1 -- start start 2023-10-18T21:55:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.459+0000 7efda3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda406a3b0 0x7efda4108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.459+0000 7efda3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efda406b9c0 0x7efda4109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.459+0000 7efda3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda4109a10 con 0x7efda406a3b0 2023-10-18T21:55:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.459+0000 7efda3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda4109b50 con 0x7efda406b9c0 2023-10-18T21:55:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.460+0000 7efda2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda406a3b0 0x7efda4108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.460+0000 7efda2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda406a3b0 0x7efda4108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59406/0 (socket says 172.21.15.8:59406) 2023-10-18T21:55:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.460+0000 7efda2ffd700 1 -- 172.21.15.8:0/3977186639 learned_addr learned my addr 172.21.15.8:0/3977186639 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.460+0000 7efda2ffd700 1 -- 172.21.15.8:0/3977186639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efda406b9c0 msgr2=0x7efda4109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.460+0000 7efda2ffd700 1 --2- 172.21.15.8:0/3977186639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efda406b9c0 0x7efda4109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:55:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.460+0000 7efda2ffd700 1 -- 172.21.15.8:0/3977186639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98005040 con 0x7efda406a3b0 2023-10-18T21:55:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.460+0000 7efda2ffd700 1 --2- 172.21.15.8:0/3977186639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda406a3b0 0x7efda4108f70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7efd940026d0 tx=0x7efd94009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.460+0000 7efd8b7fe700 1 -- 172.21.15.8:0/3977186639 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd94009320 con 0x7efda406a3b0 2023-10-18T21:55:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.461+0000 7efd8b7fe700 1 -- 172.21.15.8:0/3977186639 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efd9400f040 con 0x7efda406a3b0 2023-10-18T21:55:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.461+0000 7efd8b7fe700 1 -- 172.21.15.8:0/3977186639 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd940148a0 con 0x7efda406a3b0 2023-10-18T21:55:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.461+0000 7efda3fff700 1 -- 172.21.15.8:0/3977186639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda410a4f0 con 0x7efda406a3b0 2023-10-18T21:55:05.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.461+0000 7efda3fff700 1 -- 172.21.15.8:0/3977186639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda410aab0 con 0x7efda406a3b0 2023-10-18T21:55:05.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.462+0000 7efda3fff700 1 -- 172.21.15.8:0/3977186639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda4045ad0 con 0x7efda406a3b0 2023-10-18T21:55:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.463+0000 7efd8b7fe700 1 -- 172.21.15.8:0/3977186639 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7efd94009480 con 0x7efda406a3b0 2023-10-18T21:55:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.463+0000 7efd8b7fe700 1 --2- 172.21.15.8:0/3977186639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd8c060f70 0x7efd8c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.464+0000 7efd8b7fe700 1 -- 172.21.15.8:0/3977186639 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7efd9407cea0 con 0x7efda406a3b0 2023-10-18T21:55:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.464+0000 7efda27fc700 1 --2- 172.21.15.8:0/3977186639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd8c060f70 0x7efd8c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.464+0000 7efda27fc700 1 --2- 172.21.15.8:0/3977186639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd8c060f70 0x7efd8c063430 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7efd98009f50 tx=0x7efd98009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.468+0000 7efd8b7fe700 1 -- 172.21.15.8:0/3977186639 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efd940505c0 con 0x7efda406a3b0 2023-10-18T21:55:05.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.659+0000 7efda3fff700 1 -- 172.21.15.8:0/3977186639 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efda410ad80 con 0x7efd8c060f70 2023-10-18T21:55:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.668+0000 7efd8b7fe700 1 -- 172.21.15.8:0/3977186639 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7efda410ad80 con 0x7efd8c060f70 2023-10-18T21:55:05.670 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:55:05.670 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (61m) 9m ago 63m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:55:05.670 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (55m) 9m ago 63m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:55:05.671 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (55m) 7m ago 62m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:55:05.671 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (61m) 9m ago 62m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:55:05.671 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 59m - - 2023-10-18T21:55:05.671 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 59m - - 2023-10-18T21:55:05.671 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 59m - - 2023-10-18T21:55:05.672 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 59m - - 2023-10-18T21:55:05.672 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (56m) 9m ago 64m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:55:05.672 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (56m) 7m ago 62m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:55:05.672 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (56m) 9m ago 64m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:55:05.672 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (55m) 7m ago 62m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:55:05.673 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (62m) 9m ago 62m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:55:05.673 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (62m) 7m ago 62m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:55:05.673 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (55m) 9m ago 61m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:55:05.673 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (53m) 9m ago 61m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:55:05.673 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (52m) 9m ago 61m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:55:05.674 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (52m) 7m ago 60m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:55:05.674 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (51m) 7m ago 60m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:55:05.674 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (51m) 7m ago 60m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:55:05.674 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (57m) 9m ago 62m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:55:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.670+0000 7efda3fff700 1 -- 172.21.15.8:0/3977186639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd8c060f70 msgr2=0x7efd8c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.670+0000 7efda3fff700 1 --2- 172.21.15.8:0/3977186639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd8c060f70 0x7efd8c063430 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7efd98009f50 tx=0x7efd98009b30).stop 2023-10-18T21:55:05.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.670+0000 7efda3fff700 1 -- 172.21.15.8:0/3977186639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda406a3b0 msgr2=0x7efda4108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:05.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.670+0000 7efda3fff700 1 --2- 172.21.15.8:0/3977186639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda406a3b0 0x7efda4108f70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7efd940026d0 tx=0x7efd94009de0).stop 2023-10-18T21:55:05.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.670+0000 7efda3fff700 1 -- 172.21.15.8:0/3977186639 shutdown_connections 2023-10-18T21:55:05.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.670+0000 7efda3fff700 1 --2- 172.21.15.8:0/3977186639 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd8c060f70 0x7efd8c063430 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.670+0000 7efda3fff700 1 --2- 172.21.15.8:0/3977186639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda406a3b0 0x7efda4108f70 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.670+0000 7efda3fff700 1 --2- 172.21.15.8:0/3977186639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efda406b9c0 0x7efda4109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:55:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.670+0000 7efda3fff700 1 -- 172.21.15.8:0/3977186639 >> 172.21.15.8:0/3977186639 conn(0x7efda40f1c90 msgr2=0x7efda40fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.671+0000 7efda3fff700 1 -- 172.21.15.8:0/3977186639 shutdown_connections 2023-10-18T21:55:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.671+0000 7efda3fff700 1 -- 172.21.15.8:0/3977186639 wait complete. 2023-10-18T21:55:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.806+0000 7fdd929d2700 1 -- 172.21.15.8:0/1762521916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8c0f6530 msgr2=0x7fdd8c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.806+0000 7fdd929d2700 1 --2- 172.21.15.8:0/1762521916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8c0f6530 0x7fdd8c0f6950 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fdd88004660 tx=0x7fdd88009b30).stop 2023-10-18T21:55:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.807+0000 7fdd929d2700 1 -- 172.21.15.8:0/1762521916 shutdown_connections 2023-10-18T21:55:05.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.807+0000 7fdd929d2700 1 --2- 172.21.15.8:0/1762521916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd8c0f77d0 0x7fdd8c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.807+0000 7fdd929d2700 1 --2- 172.21.15.8:0/1762521916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8c0f6530 0x7fdd8c0f6950 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.807+0000 7fdd929d2700 1 -- 172.21.15.8:0/1762521916 >> 172.21.15.8:0/1762521916 conn(0x7fdd8c0f1c90 msgr2=0x7fdd8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:05.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.807+0000 7fdd929d2700 1 -- 172.21.15.8:0/1762521916 shutdown_connections 2023-10-18T21:55:05.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.807+0000 7fdd929d2700 1 -- 172.21.15.8:0/1762521916 wait complete. 2023-10-18T21:55:05.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.808+0000 7fdd929d2700 1 Processor -- start 2023-10-18T21:55:05.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.808+0000 7fdd929d2700 1 -- start start 2023-10-18T21:55:05.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.808+0000 7fdd929d2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8c0f6530 0x7fdd8c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:05.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.808+0000 7fdd929d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd8c0f77d0 0x7fdd8c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:05.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.808+0000 7fdd929d2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c06a380 con 0x7fdd8c0f6530 2023-10-18T21:55:05.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.808+0000 7fdd929d2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c06a4c0 con 0x7fdd8c0f77d0 2023-10-18T21:55:05.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.808+0000 7fdd919d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8c0f6530 0x7fdd8c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:05.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.808+0000 7fdd919d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8c0f6530 0x7fdd8c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59424/0 (socket says 172.21.15.8:59424) 2023-10-18T21:55:05.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.808+0000 7fdd919d0700 1 -- 172.21.15.8:0/3514384437 learned_addr learned my addr 172.21.15.8:0/3514384437 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:05.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.808+0000 7fdd911cf700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd8c0f77d0 0x7fdd8c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:05.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.809+0000 7fdd919d0700 1 -- 172.21.15.8:0/3514384437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd8c0f77d0 msgr2=0x7fdd8c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:05.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.809+0000 7fdd919d0700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd8c0f77d0 0x7fdd8c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:05.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.809+0000 7fdd919d0700 1 -- 172.21.15.8:0/3514384437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88005040 con 0x7fdd8c0f6530 2023-10-18T21:55:05.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.809+0000 7fdd919d0700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8c0f6530 0x7fdd8c06b9a0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7fdd88004e30 tx=0x7fdd88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:05.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.809+0000 7fdd827fc700 1 -- 172.21.15.8:0/3514384437 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd88018070 con 0x7fdd8c0f6530 2023-10-18T21:55:05.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.809+0000 7fdd929d2700 1 -- 172.21.15.8:0/3514384437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c06a740 con 0x7fdd8c0f6530 2023-10-18T21:55:05.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.809+0000 7fdd827fc700 1 -- 172.21.15.8:0/3514384437 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdd88009630 con 0x7fdd8c0f6530 2023-10-18T21:55:05.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.810+0000 7fdd929d2700 1 -- 172.21.15.8:0/3514384437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c06aca0 con 0x7fdd8c0f6530 2023-10-18T21:55:05.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.810+0000 7fdd827fc700 1 -- 172.21.15.8:0/3514384437 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd88027440 con 0x7fdd8c0f6530 2023-10-18T21:55:05.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.811+0000 7fdd929d2700 1 -- 172.21.15.8:0/3514384437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c045ad0 con 0x7fdd8c0f6530 2023-10-18T21:55:05.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.812+0000 7fdd827fc700 1 -- 172.21.15.8:0/3514384437 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdd8801d420 con 0x7fdd8c0f6530 2023-10-18T21:55:05.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.813+0000 7fdd827fc700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd78060f70 0x7fdd78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:05.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.813+0000 7fdd827fc700 1 -- 172.21.15.8:0/3514384437 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdd8807e440 con 0x7fdd8c0f6530 2023-10-18T21:55:05.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.813+0000 7fdd911cf700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd78060f70 0x7fdd78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:05.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.814+0000 7fdd911cf700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd78060f70 0x7fdd78063430 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fdd7c004d80 tx=0x7fdd7c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:05.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:05.817+0000 7fdd827fc700 1 -- 172.21.15.8:0/3514384437 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdd8804e0b0 con 0x7fdd8c0f6530 2023-10-18T21:55:06.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.073+0000 7fdd929d2700 1 -- 172.21.15.8:0/3514384437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdd8c0fed90 con 0x7fdd8c0f6530 2023-10-18T21:55:06.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.074+0000 7fdd827fc700 1 -- 172.21.15.8:0/3514384437 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fdd880516d0 con 0x7fdd8c0f6530 2023-10-18T21:55:06.075 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:55:06.075 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:55:06.076 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:55:06.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:55:06.076 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:55:06.076 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:55:06.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:55:06.077 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:55:06.077 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:55:06.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:55:06.077 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:55:06.077 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:55:06.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:55:06.078 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:55:06.078 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:55:06.078 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:55:06.078 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:55:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.075+0000 7fdd929d2700 1 -- 172.21.15.8:0/3514384437 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd78060f70 msgr2=0x7fdd78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.075+0000 7fdd929d2700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd78060f70 0x7fdd78063430 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fdd7c004d80 tx=0x7fdd7c00b040).stop 2023-10-18T21:55:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.075+0000 7fdd929d2700 1 -- 172.21.15.8:0/3514384437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8c0f6530 msgr2=0x7fdd8c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.075+0000 7fdd929d2700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8c0f6530 0x7fdd8c06b9a0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7fdd88004e30 tx=0x7fdd88009b30).stop 2023-10-18T21:55:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.076+0000 7fdd929d2700 1 -- 172.21.15.8:0/3514384437 shutdown_connections 2023-10-18T21:55:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.076+0000 7fdd929d2700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdd78060f70 0x7fdd78063430 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.076+0000 7fdd929d2700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8c0f6530 0x7fdd8c06b9a0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.076+0000 7fdd929d2700 1 --2- 172.21.15.8:0/3514384437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd8c0f77d0 0x7fdd8c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.076+0000 7fdd929d2700 1 -- 172.21.15.8:0/3514384437 >> 172.21.15.8:0/3514384437 conn(0x7fdd8c0f1c90 msgr2=0x7fdd8c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.076+0000 7fdd929d2700 1 -- 172.21.15.8:0/3514384437 shutdown_connections 2023-10-18T21:55:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.076+0000 7fdd929d2700 1 -- 172.21.15.8:0/3514384437 wait complete. 2023-10-18T21:55:06.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.213+0000 7ffad2df8700 1 -- 172.21.15.8:0/450536631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffacc0f8740 msgr2=0x7ffacc0f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:06.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.213+0000 7ffad2df8700 1 --2- 172.21.15.8:0/450536631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffacc0f8740 0x7ffacc0f8b60 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7ffac8004660 tx=0x7ffac8009b30).stop 2023-10-18T21:55:06.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.213+0000 7ffad2df8700 1 -- 172.21.15.8:0/450536631 shutdown_connections 2023-10-18T21:55:06.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.213+0000 7ffad2df8700 1 --2- 172.21.15.8:0/450536631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffacc0f99e0 0x7ffacc0f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.213+0000 7ffad2df8700 1 --2- 172.21.15.8:0/450536631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffacc0f8740 0x7ffacc0f8b60 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.213+0000 7ffad2df8700 1 -- 172.21.15.8:0/450536631 >> 172.21.15.8:0/450536631 conn(0x7ffacc0f40e0 msgr2=0x7ffacc0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:06.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.213+0000 7ffad2df8700 1 -- 172.21.15.8:0/450536631 shutdown_connections 2023-10-18T21:55:06.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.213+0000 7ffad2df8700 1 -- 172.21.15.8:0/450536631 wait complete. 2023-10-18T21:55:06.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.214+0000 7ffad2df8700 1 Processor -- start 2023-10-18T21:55:06.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.214+0000 7ffad2df8700 1 -- start start 2023-10-18T21:55:06.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.214+0000 7ffad2df8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffacc0f8740 0x7ffacc108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:06.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad2df8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffacc0f99e0 0x7ffacc1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:06.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad2df8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc109a60 con 0x7ffacc0f8740 2023-10-18T21:55:06.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad2df8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc109ba0 con 0x7ffacc0f99e0 2023-10-18T21:55:06.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad1df6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffacc0f8740 0x7ffacc108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:06.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad1df6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffacc0f8740 0x7ffacc108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59446/0 (socket says 172.21.15.8:59446) 2023-10-18T21:55:06.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad1df6700 1 -- 172.21.15.8:0/3408098843 learned_addr learned my addr 172.21.15.8:0/3408098843 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:06.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad15f5700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffacc0f99e0 0x7ffacc1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:06.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad1df6700 1 -- 172.21.15.8:0/3408098843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffacc0f99e0 msgr2=0x7ffacc1094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:06.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad1df6700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffacc0f99e0 0x7ffacc1094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad1df6700 1 -- 172.21.15.8:0/3408098843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac8005040 con 0x7ffacc0f8740 2023-10-18T21:55:06.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.215+0000 7ffad1df6700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffacc0f8740 0x7ffacc108fc0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7ffac8007a70 tx=0x7ffac8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:06.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.216+0000 7ffac27fc700 1 -- 172.21.15.8:0/3408098843 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac8018070 con 0x7ffacc0f8740 2023-10-18T21:55:06.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.216+0000 7ffac27fc700 1 -- 172.21.15.8:0/3408098843 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ffac801d8e0 con 0x7ffacc0f8740 2023-10-18T21:55:06.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.216+0000 7ffac27fc700 1 -- 172.21.15.8:0/3408098843 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac801c660 con 0x7ffacc0f8740 2023-10-18T21:55:06.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.216+0000 7ffad2df8700 1 -- 172.21.15.8:0/3408098843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc10a4e0 con 0x7ffacc0f8740 2023-10-18T21:55:06.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.216+0000 7ffad2df8700 1 -- 172.21.15.8:0/3408098843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc10aa40 con 0x7ffacc0f8740 2023-10-18T21:55:06.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.217+0000 7ffad2df8700 1 -- 172.21.15.8:0/3408098843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc045ad0 con 0x7ffacc0f8740 2023-10-18T21:55:06.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.218+0000 7ffac27fc700 1 -- 172.21.15.8:0/3408098843 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ffac801da50 con 0x7ffacc0f8740 2023-10-18T21:55:06.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.219+0000 7ffac27fc700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffab8060f70 0x7ffab8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:06.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.219+0000 7ffac27fc700 1 -- 172.21.15.8:0/3408098843 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ffac807e990 con 0x7ffacc0f8740 2023-10-18T21:55:06.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.219+0000 7ffad15f5700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffab8060f70 0x7ffab8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:06.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.220+0000 7ffad15f5700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffab8060f70 0x7ffab8063430 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7ffabc0041d0 tx=0x7ffabc009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:06.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.224+0000 7ffac27fc700 1 -- 172.21.15.8:0/3408098843 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ffac8051f70 con 0x7ffacc0f8740 2023-10-18T21:55:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:04.941385+0000 mgr.smithi008.flmjzp (mgr.14640) 3371 : cluster [DBG] pgmap v2319: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:04.964615+0000 mgr.smithi008.flmjzp (mgr.14640) 3372 : audit [DBG] from='client.36784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.448+0000 7ffad2df8700 1 -- 172.21.15.8:0/3408098843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffacc100fa0 con 0x7ffacc0f8740 2023-10-18T21:55:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.449+0000 7ffac27fc700 1 -- 172.21.15.8:0/3408098843 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7ffac801dce0 con 0x7ffacc0f8740 2023-10-18T21:55:06.450 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:55:06.451 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:55:06.451 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:55:06.451 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:55:06.451 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:55:06.451 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:55:06.452 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:55:06.452 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:55:06.452 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:55:06.452 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:55:06.452 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:55:06.453 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:55:06.453 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:55:06.453 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:55:06.453 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:55:06.453 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:55:06.454 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:55:06.454 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:55:06.454 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:55:06.454 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:55:06.454 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:55:06.455 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:55:06.455 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:55:06.455 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:55:06.455 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:55:06.455 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:55:06.456 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:55:06.456 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:55:06.456 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:55:06.456 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:55:06.456 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:55:06.456 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:55:06.457 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:55:06.457 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:55:06.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 -- 172.21.15.8:0/3408098843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffab8060f70 msgr2=0x7ffab8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:06.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffab8060f70 0x7ffab8063430 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7ffabc0041d0 tx=0x7ffabc009040).stop 2023-10-18T21:55:06.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 -- 172.21.15.8:0/3408098843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffacc0f8740 msgr2=0x7ffacc108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:06.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffacc0f8740 0x7ffacc108fc0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7ffac8007a70 tx=0x7ffac8009b30).stop 2023-10-18T21:55:06.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 -- 172.21.15.8:0/3408098843 shutdown_connections 2023-10-18T21:55:06.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffab8060f70 0x7ffab8063430 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffacc0f8740 0x7ffacc108fc0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 --2- 172.21.15.8:0/3408098843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffacc0f99e0 0x7ffacc1094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 -- 172.21.15.8:0/3408098843 >> 172.21.15.8:0/3408098843 conn(0x7ffacc0f40e0 msgr2=0x7ffacc0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 -- 172.21.15.8:0/3408098843 shutdown_connections 2023-10-18T21:55:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.451+0000 7ffad2df8700 1 -- 172.21.15.8:0/3408098843 wait complete. 2023-10-18T21:55:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:55:06.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:04.941385+0000 mgr.smithi008.flmjzp (mgr.14640) 3371 : cluster [DBG] pgmap v2319: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:04.964615+0000 mgr.smithi008.flmjzp (mgr.14640) 3372 : audit [DBG] from='client.36784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:06.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.588+0000 7f7e65ecc700 1 -- 172.21.15.8:0/4021538374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e600f99e0 msgr2=0x7f7e600f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.588+0000 7f7e65ecc700 1 --2- 172.21.15.8:0/4021538374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e600f99e0 0x7f7e600f9e40 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f7e4c004660 tx=0x7f7e4c009b30).stop 2023-10-18T21:55:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.588+0000 7f7e65ecc700 1 -- 172.21.15.8:0/4021538374 shutdown_connections 2023-10-18T21:55:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.588+0000 7f7e65ecc700 1 --2- 172.21.15.8:0/4021538374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e600f99e0 0x7f7e600f9e40 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.588+0000 7f7e65ecc700 1 --2- 172.21.15.8:0/4021538374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e600f8740 0x7f7e600f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.588+0000 7f7e65ecc700 1 -- 172.21.15.8:0/4021538374 >> 172.21.15.8:0/4021538374 conn(0x7f7e600f40e0 msgr2=0x7f7e600f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:06.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.588+0000 7f7e65ecc700 1 -- 172.21.15.8:0/4021538374 shutdown_connections 2023-10-18T21:55:06.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.588+0000 7f7e65ecc700 1 -- 172.21.15.8:0/4021538374 wait complete. 2023-10-18T21:55:06.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.589+0000 7f7e65ecc700 1 Processor -- start 2023-10-18T21:55:06.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.590+0000 7f7e65ecc700 1 -- start start 2023-10-18T21:55:06.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.590+0000 7f7e65ecc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e600f8740 0x7f7e60108ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:06.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.590+0000 7f7e65ecc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e600f99e0 0x7f7e601093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:06.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.590+0000 7f7e65ecc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60109960 con 0x7f7e600f99e0 2023-10-18T21:55:06.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.590+0000 7f7e65ecc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60109aa0 con 0x7f7e600f8740 2023-10-18T21:55:06.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.591+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e600f99e0 0x7f7e601093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:06.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.591+0000 7f7e64eca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e600f8740 0x7f7e60108ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:06.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.591+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e600f99e0 0x7f7e601093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59464/0 (socket says 172.21.15.8:59464) 2023-10-18T21:55:06.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.591+0000 7f7e5ffff700 1 -- 172.21.15.8:0/1013355031 learned_addr learned my addr 172.21.15.8:0/1013355031 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:06.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.591+0000 7f7e5ffff700 1 -- 172.21.15.8:0/1013355031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e600f8740 msgr2=0x7f7e60108ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:06.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.591+0000 7f7e5ffff700 1 --2- 172.21.15.8:0/1013355031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e600f8740 0x7f7e60108ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.591+0000 7f7e5ffff700 1 -- 172.21.15.8:0/1013355031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c005040 con 0x7f7e600f99e0 2023-10-18T21:55:06.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.591+0000 7f7e5ffff700 1 --2- 172.21.15.8:0/1013355031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e600f99e0 0x7f7e601093b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f7e4c009f50 tx=0x7f7e4c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:06.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.591+0000 7f7e5d7fa700 1 -- 172.21.15.8:0/1013355031 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4c018070 con 0x7f7e600f99e0 2023-10-18T21:55:06.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.591+0000 7f7e65ecc700 1 -- 172.21.15.8:0/1013355031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6010a3e0 con 0x7f7e600f99e0 2023-10-18T21:55:06.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.592+0000 7f7e5d7fa700 1 -- 172.21.15.8:0/1013355031 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7e4c009630 con 0x7f7e600f99e0 2023-10-18T21:55:06.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.592+0000 7f7e5d7fa700 1 -- 172.21.15.8:0/1013355031 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4c01c3c0 con 0x7f7e600f99e0 2023-10-18T21:55:06.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.592+0000 7f7e65ecc700 1 -- 172.21.15.8:0/1013355031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6010a940 con 0x7f7e600f99e0 2023-10-18T21:55:06.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.593+0000 7f7e65ecc700 1 -- 172.21.15.8:0/1013355031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e60045ad0 con 0x7f7e600f99e0 2023-10-18T21:55:06.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.594+0000 7f7e5d7fa700 1 -- 172.21.15.8:0/1013355031 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7e4c01d420 con 0x7f7e600f99e0 2023-10-18T21:55:06.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.594+0000 7f7e5d7fa700 1 --2- 172.21.15.8:0/1013355031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e50060f70 0x7f7e50063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:06.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.595+0000 7f7e5d7fa700 1 -- 172.21.15.8:0/1013355031 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7e4c07e530 con 0x7f7e600f99e0 2023-10-18T21:55:06.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.595+0000 7f7e64eca700 1 --2- 172.21.15.8:0/1013355031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e50060f70 0x7f7e50063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:06.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.595+0000 7f7e64eca700 1 --2- 172.21.15.8:0/1013355031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e50060f70 0x7f7e50063430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f7e600f9840 tx=0x7f7e5400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:06.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.599+0000 7f7e5d7fa700 1 -- 172.21.15.8:0/1013355031 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7e4c051bd0 con 0x7f7e600f99e0 2023-10-18T21:55:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.795+0000 7f7e65ecc700 1 -- 172.21.15.8:0/1013355031 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e60100fe0 con 0x7f7e50060f70 2023-10-18T21:55:06.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.796+0000 7f7e5d7fa700 1 -- 172.21.15.8:0/1013355031 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7e60100fe0 con 0x7f7e50060f70 2023-10-18T21:55:06.798 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:55:06.798 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:55:06.798 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:55:06.798 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:55:06.799 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:55:06.799 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:55:06.799 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:55:06.799 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:55:06.799 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:55:06.800 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:55:06.800 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:55:06.800 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:55:06.800 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:55:06.800 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:55:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.798+0000 7f7e65ecc700 1 -- 172.21.15.8:0/1013355031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e50060f70 msgr2=0x7f7e50063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.798+0000 7f7e65ecc700 1 --2- 172.21.15.8:0/1013355031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e50060f70 0x7f7e50063430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f7e600f9840 tx=0x7f7e5400b040).stop 2023-10-18T21:55:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.798+0000 7f7e65ecc700 1 -- 172.21.15.8:0/1013355031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e600f99e0 msgr2=0x7f7e601093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.798+0000 7f7e65ecc700 1 --2- 172.21.15.8:0/1013355031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e600f99e0 0x7f7e601093b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f7e4c009f50 tx=0x7f7e4c009b30).stop 2023-10-18T21:55:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.799+0000 7f7e65ecc700 1 -- 172.21.15.8:0/1013355031 shutdown_connections 2023-10-18T21:55:06.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.799+0000 7f7e65ecc700 1 --2- 172.21.15.8:0/1013355031 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7e50060f70 0x7f7e50063430 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.799+0000 7f7e65ecc700 1 --2- 172.21.15.8:0/1013355031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e600f8740 0x7f7e60108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.799+0000 7f7e65ecc700 1 --2- 172.21.15.8:0/1013355031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e600f99e0 0x7f7e601093b0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:06.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.799+0000 7f7e65ecc700 1 -- 172.21.15.8:0/1013355031 >> 172.21.15.8:0/1013355031 conn(0x7f7e600f40e0 msgr2=0x7f7e600fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:06.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.799+0000 7f7e65ecc700 1 -- 172.21.15.8:0/1013355031 shutdown_connections 2023-10-18T21:55:06.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:06.799+0000 7f7e65ecc700 1 -- 172.21.15.8:0/1013355031 wait complete. 2023-10-18T21:55:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:05.317226+0000 mgr.smithi008.flmjzp (mgr.14640) 3373 : audit [DBG] from='client.36788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:05.660474+0000 mgr.smithi008.flmjzp (mgr.14640) 3374 : audit [DBG] from='client.36792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:06.074133+0000 mon.smithi008 (mon.0) 3734 : audit [DBG] from='client.? 172.21.15.8:0/3514384437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:06.449400+0000 mon.smithi008 (mon.0) 3735 : audit [DBG] from='client.? 172.21.15.8:0/3408098843' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:55:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:05.317226+0000 mgr.smithi008.flmjzp (mgr.14640) 3373 : audit [DBG] from='client.36788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:05.660474+0000 mgr.smithi008.flmjzp (mgr.14640) 3374 : audit [DBG] from='client.36792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:06.074133+0000 mon.smithi008 (mon.0) 3734 : audit [DBG] from='client.? 172.21.15.8:0/3514384437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:06.449400+0000 mon.smithi008 (mon.0) 3735 : audit [DBG] from='client.? 172.21.15.8:0/3408098843' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:55:08.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:06.796772+0000 mgr.smithi008.flmjzp (mgr.14640) 3375 : audit [DBG] from='client.36804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:08.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:06.942046+0000 mgr.smithi008.flmjzp (mgr.14640) 3376 : cluster [DBG] pgmap v2320: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:06.796772+0000 mgr.smithi008.flmjzp (mgr.14640) 3375 : audit [DBG] from='client.36804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:06.942046+0000 mgr.smithi008.flmjzp (mgr.14640) 3376 : cluster [DBG] pgmap v2320: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:08.970818+0000 mon.smithi008 (mon.0) 3736 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:08.973019+0000 mon.smithi008 (mon.0) 3737 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:55:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:08.974101+0000 mon.smithi008 (mon.0) 3738 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:55:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:08.980592+0000 mon.smithi008 (mon.0) 3739 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:08.988577+0000 mon.smithi008 (mon.0) 3740 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:08.992006+0000 mon.smithi008 (mon.0) 3741 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:08.993978+0000 mon.smithi008 (mon.0) 3742 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:08.995839+0000 mon.smithi008 (mon.0) 3743 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:08.998366+0000 mon.smithi008 (mon.0) 3744 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:08.970818+0000 mon.smithi008 (mon.0) 3736 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:08.973019+0000 mon.smithi008 (mon.0) 3737 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:55:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:08.974101+0000 mon.smithi008 (mon.0) 3738 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:55:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:08.980592+0000 mon.smithi008 (mon.0) 3739 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:08.988577+0000 mon.smithi008 (mon.0) 3740 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:08.992006+0000 mon.smithi008 (mon.0) 3741 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:08.993978+0000 mon.smithi008 (mon.0) 3742 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:08.995839+0000 mon.smithi008 (mon.0) 3743 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:08.998366+0000 mon.smithi008 (mon.0) 3744 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:08.942607+0000 mgr.smithi008.flmjzp (mgr.14640) 3377 : cluster [DBG] pgmap v2321: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:55:08.975010+0000 mgr.smithi008.flmjzp (mgr.14640) 3378 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:08.975579+0000 mgr.smithi008.flmjzp (mgr.14640) 3379 : cluster [DBG] pgmap v2322: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:08.975811+0000 mgr.smithi008.flmjzp (mgr.14640) 3380 : cluster [DBG] pgmap v2323: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:55:09.000467+0000 mgr.smithi008.flmjzp (mgr.14640) 3381 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:08.942607+0000 mgr.smithi008.flmjzp (mgr.14640) 3377 : cluster [DBG] pgmap v2321: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:55:08.975010+0000 mgr.smithi008.flmjzp (mgr.14640) 3378 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:08.975579+0000 mgr.smithi008.flmjzp (mgr.14640) 3379 : cluster [DBG] pgmap v2322: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:08.975811+0000 mgr.smithi008.flmjzp (mgr.14640) 3380 : cluster [DBG] pgmap v2323: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:55:09.000467+0000 mgr.smithi008.flmjzp (mgr.14640) 3381 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:10.976289+0000 mgr.smithi008.flmjzp (mgr.14640) 3382 : cluster [DBG] pgmap v2324: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:10.976289+0000 mgr.smithi008.flmjzp (mgr.14640) 3382 : cluster [DBG] pgmap v2324: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:12.976935+0000 mgr.smithi008.flmjzp (mgr.14640) 3383 : cluster [DBG] pgmap v2325: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:14.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:12.976935+0000 mgr.smithi008.flmjzp (mgr.14640) 3383 : cluster [DBG] pgmap v2325: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:14.977517+0000 mgr.smithi008.flmjzp (mgr.14640) 3384 : cluster [DBG] pgmap v2326: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:14.977517+0000 mgr.smithi008.flmjzp (mgr.14640) 3384 : cluster [DBG] pgmap v2326: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:18.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:16.978083+0000 mgr.smithi008.flmjzp (mgr.14640) 3385 : cluster [DBG] pgmap v2327: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:16.978083+0000 mgr.smithi008.flmjzp (mgr.14640) 3385 : cluster [DBG] pgmap v2327: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:19.006915+0000 mon.smithi008 (mon.0) 3745 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:19.006915+0000 mon.smithi008 (mon.0) 3745 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:18.978689+0000 mgr.smithi008.flmjzp (mgr.14640) 3386 : cluster [DBG] pgmap v2328: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:19.572153+0000 mon.smithi008 (mon.0) 3746 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:55:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:19.573020+0000 mon.smithi008 (mon.0) 3747 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:55:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:19.578940+0000 mon.smithi008 (mon.0) 3748 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:19.583941+0000 mon.smithi008 (mon.0) 3749 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:19.586276+0000 mon.smithi008 (mon.0) 3750 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:19.587556+0000 mon.smithi008 (mon.0) 3751 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:19.588728+0000 mon.smithi008 (mon.0) 3752 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:19.590251+0000 mon.smithi008 (mon.0) 3753 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:18.978689+0000 mgr.smithi008.flmjzp (mgr.14640) 3386 : cluster [DBG] pgmap v2328: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:19.572153+0000 mon.smithi008 (mon.0) 3746 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:55:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:19.573020+0000 mon.smithi008 (mon.0) 3747 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:55:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:19.578940+0000 mon.smithi008 (mon.0) 3748 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:19.583941+0000 mon.smithi008 (mon.0) 3749 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:19.586276+0000 mon.smithi008 (mon.0) 3750 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:19.587556+0000 mon.smithi008 (mon.0) 3751 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:19.588728+0000 mon.smithi008 (mon.0) 3752 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:19.590251+0000 mon.smithi008 (mon.0) 3753 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:55:19.573679+0000 mgr.smithi008.flmjzp (mgr.14640) 3387 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:19.574134+0000 mgr.smithi008.flmjzp (mgr.14640) 3388 : cluster [DBG] pgmap v2329: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:19.574344+0000 mgr.smithi008.flmjzp (mgr.14640) 3389 : cluster [DBG] pgmap v2330: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:55:19.591732+0000 mgr.smithi008.flmjzp (mgr.14640) 3390 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:55:19.573679+0000 mgr.smithi008.flmjzp (mgr.14640) 3387 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:19.574134+0000 mgr.smithi008.flmjzp (mgr.14640) 3388 : cluster [DBG] pgmap v2329: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:19.574344+0000 mgr.smithi008.flmjzp (mgr.14640) 3389 : cluster [DBG] pgmap v2330: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:55:19.591732+0000 mgr.smithi008.flmjzp (mgr.14640) 3390 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:21.574856+0000 mgr.smithi008.flmjzp (mgr.14640) 3391 : cluster [DBG] pgmap v2331: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:21.574856+0000 mgr.smithi008.flmjzp (mgr.14640) 3391 : cluster [DBG] pgmap v2331: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:23.575315+0000 mgr.smithi008.flmjzp (mgr.14640) 3392 : cluster [DBG] pgmap v2332: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:23.575315+0000 mgr.smithi008.flmjzp (mgr.14640) 3392 : cluster [DBG] pgmap v2332: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:25.576043+0000 mgr.smithi008.flmjzp (mgr.14640) 3393 : cluster [DBG] pgmap v2333: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:27.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:25.576043+0000 mgr.smithi008.flmjzp (mgr.14640) 3393 : cluster [DBG] pgmap v2333: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:27.576511+0000 mgr.smithi008.flmjzp (mgr.14640) 3394 : cluster [DBG] pgmap v2334: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:29.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:27.576511+0000 mgr.smithi008.flmjzp (mgr.14640) 3394 : cluster [DBG] pgmap v2334: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:29.595721+0000 mon.smithi008 (mon.0) 3754 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:29.597803+0000 mon.smithi008 (mon.0) 3755 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:55:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:29.598860+0000 mon.smithi008 (mon.0) 3756 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:55:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:29.605530+0000 mon.smithi008 (mon.0) 3757 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:29.611955+0000 mon.smithi008 (mon.0) 3758 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:29.614969+0000 mon.smithi008 (mon.0) 3759 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:30.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:29.616646+0000 mon.smithi008 (mon.0) 3760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:30.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:29.618319+0000 mon.smithi008 (mon.0) 3761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:30.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:29.620344+0000 mon.smithi008 (mon.0) 3762 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:30.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:29.595721+0000 mon.smithi008 (mon.0) 3754 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:29.597803+0000 mon.smithi008 (mon.0) 3755 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:55:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:29.598860+0000 mon.smithi008 (mon.0) 3756 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:55:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:29.605530+0000 mon.smithi008 (mon.0) 3757 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:29.611955+0000 mon.smithi008 (mon.0) 3758 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:29.614969+0000 mon.smithi008 (mon.0) 3759 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:29.616646+0000 mon.smithi008 (mon.0) 3760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:29.618319+0000 mon.smithi008 (mon.0) 3761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:29.620344+0000 mon.smithi008 (mon.0) 3762 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:29.576980+0000 mgr.smithi008.flmjzp (mgr.14640) 3395 : cluster [DBG] pgmap v2335: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:55:29.599775+0000 mgr.smithi008.flmjzp (mgr.14640) 3396 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:29.600369+0000 mgr.smithi008.flmjzp (mgr.14640) 3397 : cluster [DBG] pgmap v2336: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:29.600709+0000 mgr.smithi008.flmjzp (mgr.14640) 3398 : cluster [DBG] pgmap v2337: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:55:29.622270+0000 mgr.smithi008.flmjzp (mgr.14640) 3399 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:29.576980+0000 mgr.smithi008.flmjzp (mgr.14640) 3395 : cluster [DBG] pgmap v2335: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:55:29.599775+0000 mgr.smithi008.flmjzp (mgr.14640) 3396 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:29.600369+0000 mgr.smithi008.flmjzp (mgr.14640) 3397 : cluster [DBG] pgmap v2336: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:29.600709+0000 mgr.smithi008.flmjzp (mgr.14640) 3398 : cluster [DBG] pgmap v2337: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:55:29.622270+0000 mgr.smithi008.flmjzp (mgr.14640) 3399 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:31.601474+0000 mgr.smithi008.flmjzp (mgr.14640) 3400 : cluster [DBG] pgmap v2338: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:31.601474+0000 mgr.smithi008.flmjzp (mgr.14640) 3400 : cluster [DBG] pgmap v2338: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:33.602028+0000 mgr.smithi008.flmjzp (mgr.14640) 3401 : cluster [DBG] pgmap v2339: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:35.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:33.602028+0000 mgr.smithi008.flmjzp (mgr.14640) 3401 : cluster [DBG] pgmap v2339: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.951+0000 7f87c759e700 1 -- 172.21.15.8:0/2269648562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c80f77d0 msgr2=0x7f87c80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.951+0000 7f87c759e700 1 --2- 172.21.15.8:0/2269648562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c80f77d0 0x7f87c80f7c30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f87bc004660 tx=0x7f87bc009b30).stop 2023-10-18T21:55:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.952+0000 7f87c759e700 1 -- 172.21.15.8:0/2269648562 shutdown_connections 2023-10-18T21:55:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.952+0000 7f87c759e700 1 --2- 172.21.15.8:0/2269648562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c80f77d0 0x7f87c80f7c30 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.952+0000 7f87c759e700 1 --2- 172.21.15.8:0/2269648562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87c80f6530 0x7f87c80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.952+0000 7f87c759e700 1 -- 172.21.15.8:0/2269648562 >> 172.21.15.8:0/2269648562 conn(0x7f87c80f1c90 msgr2=0x7f87c80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.952+0000 7f87c759e700 1 -- 172.21.15.8:0/2269648562 shutdown_connections 2023-10-18T21:55:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.952+0000 7f87c759e700 1 -- 172.21.15.8:0/2269648562 wait complete. 2023-10-18T21:55:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.952+0000 7f87c759e700 1 Processor -- start 2023-10-18T21:55:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.953+0000 7f87c759e700 1 -- start start 2023-10-18T21:55:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.953+0000 7f87c759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87c80f6530 0x7f87c806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.953+0000 7f87c759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c80f77d0 0x7f87c8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.953+0000 7f87c759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c806a380 con 0x7f87c80f77d0 2023-10-18T21:55:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.953+0000 7f87c759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c806a4c0 con 0x7f87c80f6530 2023-10-18T21:55:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.953+0000 7f87c5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c80f77d0 0x7f87c8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.953+0000 7f87c5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c80f77d0 0x7f87c8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43796/0 (socket says 172.21.15.8:43796) 2023-10-18T21:55:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.953+0000 7f87c5d9b700 1 -- 172.21.15.8:0/3635019555 learned_addr learned my addr 172.21.15.8:0/3635019555 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.953+0000 7f87c659c700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87c80f6530 0x7f87c806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.954+0000 7f87c5d9b700 1 -- 172.21.15.8:0/3635019555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87c80f6530 msgr2=0x7f87c806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.954+0000 7f87c5d9b700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87c80f6530 0x7f87c806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.954+0000 7f87c5d9b700 1 -- 172.21.15.8:0/3635019555 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc005040 con 0x7f87c80f77d0 2023-10-18T21:55:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.954+0000 7f87c5d9b700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c80f77d0 0x7f87c8069e20 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f87bc004320 tx=0x7f87bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.954+0000 7f87b6ffd700 1 -- 172.21.15.8:0/3635019555 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87bc019070 con 0x7f87c80f77d0 2023-10-18T21:55:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.954+0000 7f87b6ffd700 1 -- 172.21.15.8:0/3635019555 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f87bc01e420 con 0x7f87c80f77d0 2023-10-18T21:55:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.954+0000 7f87b6ffd700 1 -- 172.21.15.8:0/3635019555 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87bc014680 con 0x7f87c80f77d0 2023-10-18T21:55:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.954+0000 7f87c759e700 1 -- 172.21.15.8:0/3635019555 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c806a740 con 0x7f87c80f77d0 2023-10-18T21:55:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.954+0000 7f87c759e700 1 -- 172.21.15.8:0/3635019555 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c806ac20 con 0x7f87c80f77d0 2023-10-18T21:55:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.956+0000 7f87c759e700 1 -- 172.21.15.8:0/3635019555 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c8045ad0 con 0x7f87c80f77d0 2023-10-18T21:55:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.956+0000 7f87b6ffd700 1 -- 172.21.15.8:0/3635019555 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f87bc01e590 con 0x7f87c80f77d0 2023-10-18T21:55:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.957+0000 7f87b6ffd700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87b0060f70 0x7f87b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.957+0000 7f87b6ffd700 1 -- 172.21.15.8:0/3635019555 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f87bc07dc50 con 0x7f87c80f77d0 2023-10-18T21:55:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.957+0000 7f87c659c700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87b0060f70 0x7f87b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.958+0000 7f87c659c700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87b0060f70 0x7f87b0063430 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f87c806b730 tx=0x7f87b800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:36.962+0000 7f87b6ffd700 1 -- 172.21.15.8:0/3635019555 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f87bc04d8e0 con 0x7f87c80f77d0 2023-10-18T21:55:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.164+0000 7f87c759e700 1 -- 172.21.15.8:0/3635019555 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87c8057f10 con 0x7f87b0060f70 2023-10-18T21:55:37.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.166+0000 7f87b6ffd700 1 -- 172.21.15.8:0/3635019555 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f87c8057f10 con 0x7f87b0060f70 2023-10-18T21:55:37.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 -- 172.21.15.8:0/3635019555 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87b0060f70 msgr2=0x7f87b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:37.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87b0060f70 0x7f87b0063430 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f87c806b730 tx=0x7f87b800b040).stop 2023-10-18T21:55:37.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 -- 172.21.15.8:0/3635019555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c80f77d0 msgr2=0x7f87c8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c80f77d0 0x7f87c8069e20 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f87bc004320 tx=0x7f87bc00b040).stop 2023-10-18T21:55:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 -- 172.21.15.8:0/3635019555 shutdown_connections 2023-10-18T21:55:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87b0060f70 0x7f87b0063430 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87c80f6530 0x7f87c806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 --2- 172.21.15.8:0/3635019555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c80f77d0 0x7f87c8069e20 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 -- 172.21.15.8:0/3635019555 >> 172.21.15.8:0/3635019555 conn(0x7f87c80f1c90 msgr2=0x7f87c80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 -- 172.21.15.8:0/3635019555 shutdown_connections 2023-10-18T21:55:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.168+0000 7f87c759e700 1 -- 172.21.15.8:0/3635019555 wait complete. 2023-10-18T21:55:37.184 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:55:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.307+0000 7f230f59e700 1 -- 172.21.15.8:0/394943398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f231006a3b0 msgr2=0x7f231006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.307+0000 7f230f59e700 1 --2- 172.21.15.8:0/394943398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f231006a3b0 0x7f231006a830 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f2304004660 tx=0x7f2304009b30).stop 2023-10-18T21:55:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.307+0000 7f230f59e700 1 -- 172.21.15.8:0/394943398 shutdown_connections 2023-10-18T21:55:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.307+0000 7f230f59e700 1 --2- 172.21.15.8:0/394943398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f231006a3b0 0x7f231006a830 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.307+0000 7f230f59e700 1 --2- 172.21.15.8:0/394943398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f231006b9c0 0x7f2310069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.307+0000 7f230f59e700 1 -- 172.21.15.8:0/394943398 >> 172.21.15.8:0/394943398 conn(0x7f23100f1c30 msgr2=0x7f23100f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.307+0000 7f230f59e700 1 -- 172.21.15.8:0/394943398 shutdown_connections 2023-10-18T21:55:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.307+0000 7f230f59e700 1 -- 172.21.15.8:0/394943398 wait complete. 2023-10-18T21:55:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.308+0000 7f230f59e700 1 Processor -- start 2023-10-18T21:55:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.308+0000 7f230f59e700 1 -- start start 2023-10-18T21:55:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.308+0000 7f230f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f231006a3b0 0x7f231010d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.308+0000 7f230f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f231006b9c0 0x7f231010d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.308+0000 7f230f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231010dd30 con 0x7f231006a3b0 2023-10-18T21:55:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.308+0000 7f230f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231010de70 con 0x7f231006b9c0 2023-10-18T21:55:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f230e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f231006a3b0 0x7f231010d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f230e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f231006a3b0 0x7f231010d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43822/0 (socket says 172.21.15.8:43822) 2023-10-18T21:55:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f230e59c700 1 -- 172.21.15.8:0/1538810836 learned_addr learned my addr 172.21.15.8:0/1538810836 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f230dd9b700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f231006b9c0 0x7f231010d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f230e59c700 1 -- 172.21.15.8:0/1538810836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f231006b9c0 msgr2=0x7f231010d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f230e59c700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f231006b9c0 0x7f231010d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f230e59c700 1 -- 172.21.15.8:0/1538810836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304005040 con 0x7f231006a3b0 2023-10-18T21:55:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f230e59c700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f231006a3b0 0x7f231010d290 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f230000e7c0 tx=0x7f230000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f22feffd700 1 -- 172.21.15.8:0/1538810836 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2300004510 con 0x7f231006a3b0 2023-10-18T21:55:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f22feffd700 1 -- 172.21.15.8:0/1538810836 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f230000f040 con 0x7f231006a3b0 2023-10-18T21:55:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.309+0000 7f22feffd700 1 -- 172.21.15.8:0/1538810836 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23000147e0 con 0x7f231006a3b0 2023-10-18T21:55:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.310+0000 7f230f59e700 1 -- 172.21.15.8:0/1538810836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231010e810 con 0x7f231006a3b0 2023-10-18T21:55:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.310+0000 7f230f59e700 1 -- 172.21.15.8:0/1538810836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231010ed50 con 0x7f231006a3b0 2023-10-18T21:55:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.311+0000 7f230f59e700 1 -- 172.21.15.8:0/1538810836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2310045ad0 con 0x7f231006a3b0 2023-10-18T21:55:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.312+0000 7f22feffd700 1 -- 172.21.15.8:0/1538810836 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f230001b030 con 0x7f231006a3b0 2023-10-18T21:55:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.312+0000 7f22feffd700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22f8060f70 0x7f22f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.313+0000 7f22feffd700 1 -- 172.21.15.8:0/1538810836 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f230007c970 con 0x7f231006a3b0 2023-10-18T21:55:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.313+0000 7f230dd9b700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22f8060f70 0x7f22f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.313+0000 7f230dd9b700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22f8060f70 0x7f22f8063430 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f2304004630 tx=0x7f230400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.317+0000 7f22feffd700 1 -- 172.21.15.8:0/1538810836 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f230004fef0 con 0x7f231006a3b0 2023-10-18T21:55:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:35.602619+0000 mgr.smithi008.flmjzp (mgr.14640) 3402 : cluster [DBG] pgmap v2340: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:35.602619+0000 mgr.smithi008.flmjzp (mgr.14640) 3402 : cluster [DBG] pgmap v2340: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:37.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.514+0000 7f230f59e700 1 -- 172.21.15.8:0/1538810836 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f231010efc0 con 0x7f22f8060f70 2023-10-18T21:55:37.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.516+0000 7f22feffd700 1 -- 172.21.15.8:0/1538810836 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f231010efc0 con 0x7f22f8060f70 2023-10-18T21:55:37.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.517+0000 7f230f59e700 1 -- 172.21.15.8:0/1538810836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22f8060f70 msgr2=0x7f22f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:37.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.517+0000 7f230f59e700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22f8060f70 0x7f22f8063430 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f2304004630 tx=0x7f230400b040).stop 2023-10-18T21:55:37.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.517+0000 7f230f59e700 1 -- 172.21.15.8:0/1538810836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f231006a3b0 msgr2=0x7f231010d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:37.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.517+0000 7f230f59e700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f231006a3b0 0x7f231010d290 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f230000e7c0 tx=0x7f230000b040).stop 2023-10-18T21:55:37.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.518+0000 7f230f59e700 1 -- 172.21.15.8:0/1538810836 shutdown_connections 2023-10-18T21:55:37.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.518+0000 7f230f59e700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f22f8060f70 0x7f22f8063430 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.518+0000 7f230f59e700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f231006a3b0 0x7f231010d290 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.518+0000 7f230f59e700 1 --2- 172.21.15.8:0/1538810836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f231006b9c0 0x7f231010d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.518+0000 7f230f59e700 1 -- 172.21.15.8:0/1538810836 >> 172.21.15.8:0/1538810836 conn(0x7f23100f1c30 msgr2=0x7f23100f8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:37.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.518+0000 7f230f59e700 1 -- 172.21.15.8:0/1538810836 shutdown_connections 2023-10-18T21:55:37.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.518+0000 7f230f59e700 1 -- 172.21.15.8:0/1538810836 wait complete. 2023-10-18T21:55:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.654+0000 7f05748dd700 1 -- 172.21.15.8:0/2711283442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05700f77d0 msgr2=0x7f05700f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.654+0000 7f05748dd700 1 --2- 172.21.15.8:0/2711283442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05700f77d0 0x7f05700f7c30 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f0564004660 tx=0x7f0564009b30).stop 2023-10-18T21:55:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.654+0000 7f05748dd700 1 -- 172.21.15.8:0/2711283442 shutdown_connections 2023-10-18T21:55:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.654+0000 7f05748dd700 1 --2- 172.21.15.8:0/2711283442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05700f77d0 0x7f05700f7c30 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.654+0000 7f05748dd700 1 --2- 172.21.15.8:0/2711283442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05700f6530 0x7f05700f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.654+0000 7f05748dd700 1 -- 172.21.15.8:0/2711283442 >> 172.21.15.8:0/2711283442 conn(0x7f05700f1c90 msgr2=0x7f05700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.655+0000 7f05748dd700 1 -- 172.21.15.8:0/2711283442 shutdown_connections 2023-10-18T21:55:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.655+0000 7f05748dd700 1 -- 172.21.15.8:0/2711283442 wait complete. 2023-10-18T21:55:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.655+0000 7f05748dd700 1 Processor -- start 2023-10-18T21:55:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.656+0000 7f05748dd700 1 -- start start 2023-10-18T21:55:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.656+0000 7f05748dd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05700f6530 0x7f0570108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.656+0000 7f05748dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05700f77d0 0x7f0570109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.656+0000 7f05748dd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701099c0 con 0x7f05700f77d0 2023-10-18T21:55:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.656+0000 7f05748dd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570109b00 con 0x7f05700f6530 2023-10-18T21:55:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.656+0000 7f056effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05700f77d0 0x7f0570109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:37.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.656+0000 7f056effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05700f77d0 0x7f0570109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43832/0 (socket says 172.21.15.8:43832) 2023-10-18T21:55:37.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.656+0000 7f056effd700 1 -- 172.21.15.8:0/2621726972 learned_addr learned my addr 172.21.15.8:0/2621726972 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:37.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.656+0000 7f056f7fe700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05700f6530 0x7f0570108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:37.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.657+0000 7f056effd700 1 -- 172.21.15.8:0/2621726972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05700f6530 msgr2=0x7f0570108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.657+0000 7f056effd700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05700f6530 0x7f0570108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.657+0000 7f056effd700 1 -- 172.21.15.8:0/2621726972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564005040 con 0x7f05700f77d0 2023-10-18T21:55:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.657+0000 7f056effd700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05700f77d0 0x7f0570109410 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f0564004d80 tx=0x7f056400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.657+0000 7f0557fff700 1 -- 172.21.15.8:0/2621726972 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0564019070 con 0x7f05700f77d0 2023-10-18T21:55:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.657+0000 7f0557fff700 1 -- 172.21.15.8:0/2621726972 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f056401e420 con 0x7f05700f77d0 2023-10-18T21:55:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.657+0000 7f05748dd700 1 -- 172.21.15.8:0/2621726972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057010a440 con 0x7f05700f77d0 2023-10-18T21:55:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.657+0000 7f0557fff700 1 -- 172.21.15.8:0/2621726972 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0564014660 con 0x7f05700f77d0 2023-10-18T21:55:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.657+0000 7f05748dd700 1 -- 172.21.15.8:0/2621726972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057010a920 con 0x7f05700f77d0 2023-10-18T21:55:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.658+0000 7f05748dd700 1 -- 172.21.15.8:0/2621726972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0570045ad0 con 0x7f05700f77d0 2023-10-18T21:55:37.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.659+0000 7f0557fff700 1 -- 172.21.15.8:0/2621726972 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f056401e590 con 0x7f05700f77d0 2023-10-18T21:55:37.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.660+0000 7f0557fff700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 0x7f0558063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:37.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.660+0000 7f0557fff700 1 -- 172.21.15.8:0/2621726972 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f056407de00 con 0x7f05700f77d0 2023-10-18T21:55:37.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.661+0000 7f056f7fe700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 0x7f0558063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:37.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.661+0000 7f056f7fe700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 0x7f0558063430 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f0560009fd0 tx=0x7f056000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:37.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.665+0000 7f0557fff700 1 -- 172.21.15.8:0/2621726972 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f05640513e0 con 0x7f05700f77d0 2023-10-18T21:55:37.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.855+0000 7f05748dd700 1 -- 172.21.15.8:0/2621726972 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f05700fee30 con 0x7f0558060f70 2023-10-18T21:55:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.864+0000 7f0557fff700 1 -- 172.21.15.8:0/2621726972 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f05700fee30 con 0x7f0558060f70 2023-10-18T21:55:37.867 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:55:37.867 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (62m) 9m ago 63m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:55:37.867 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (56m) 9m ago 63m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:55:37.867 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (56m) 7m ago 62m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:55:37.868 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (62m) 9m ago 63m 27.4M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:55:37.868 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 59m - - 2023-10-18T21:55:37.868 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 59m - - 2023-10-18T21:55:37.868 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 59m - - 2023-10-18T21:55:37.868 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 59m - - 2023-10-18T21:55:37.869 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (57m) 9m ago 65m 515M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:55:37.869 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (56m) 7m ago 62m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:55:37.869 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (56m) 9m ago 65m 411M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:55:37.869 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (56m) 7m ago 62m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:55:37.869 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (63m) 9m ago 63m 10.4M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:55:37.870 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (62m) 7m ago 62m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:55:37.870 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (55m) 9m ago 62m 531M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:55:37.870 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (53m) 9m ago 62m 420M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:55:37.870 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (53m) 9m ago 61m 328M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:55:37.870 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (52m) 7m ago 61m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:55:37.871 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (52m) 7m ago 61m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:55:37.871 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (51m) 7m ago 60m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:55:37.871 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (57m) 9m ago 63m 75.8M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:55:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.866+0000 7f05748dd700 1 -- 172.21.15.8:0/2621726972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 msgr2=0x7f0558063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.866+0000 7f05748dd700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 0x7f0558063430 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f0560009fd0 tx=0x7f056000b040).stop 2023-10-18T21:55:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.866+0000 7f05748dd700 1 -- 172.21.15.8:0/2621726972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05700f77d0 msgr2=0x7f0570109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.866+0000 7f05748dd700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05700f77d0 0x7f0570109410 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f0564004d80 tx=0x7f056400b040).stop 2023-10-18T21:55:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.867+0000 7f05748dd700 1 -- 172.21.15.8:0/2621726972 shutdown_connections 2023-10-18T21:55:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.867+0000 7f05748dd700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0558060f70 0x7f0558063430 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.867+0000 7f05748dd700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05700f6530 0x7f0570108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.867+0000 7f05748dd700 1 --2- 172.21.15.8:0/2621726972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05700f77d0 0x7f0570109410 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.867+0000 7f05748dd700 1 -- 172.21.15.8:0/2621726972 >> 172.21.15.8:0/2621726972 conn(0x7f05700f1c90 msgr2=0x7f057006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.867+0000 7f05748dd700 1 -- 172.21.15.8:0/2621726972 shutdown_connections 2023-10-18T21:55:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:37.867+0000 7f05748dd700 1 -- 172.21.15.8:0/2621726972 wait complete. 2023-10-18T21:55:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.001+0000 7fa5eee35700 1 -- 172.21.15.8:0/3401666712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5e80f6530 msgr2=0x7fa5e80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.001+0000 7fa5eee35700 1 --2- 172.21.15.8:0/3401666712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5e80f6530 0x7fa5e80f6950 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fa5e4004660 tx=0x7fa5e4009b30).stop 2023-10-18T21:55:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.001+0000 7fa5eee35700 1 -- 172.21.15.8:0/3401666712 shutdown_connections 2023-10-18T21:55:38.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.001+0000 7fa5eee35700 1 --2- 172.21.15.8:0/3401666712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e80f77d0 0x7fa5e80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.001+0000 7fa5eee35700 1 --2- 172.21.15.8:0/3401666712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5e80f6530 0x7fa5e80f6950 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.001+0000 7fa5eee35700 1 -- 172.21.15.8:0/3401666712 >> 172.21.15.8:0/3401666712 conn(0x7fa5e80f1c90 msgr2=0x7fa5e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:38.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.001+0000 7fa5eee35700 1 -- 172.21.15.8:0/3401666712 shutdown_connections 2023-10-18T21:55:38.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.001+0000 7fa5eee35700 1 -- 172.21.15.8:0/3401666712 wait complete. 2023-10-18T21:55:38.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.002+0000 7fa5eee35700 1 Processor -- start 2023-10-18T21:55:38.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.002+0000 7fa5eee35700 1 -- start start 2023-10-18T21:55:38.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5eee35700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e80f6530 0x7fa5e8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:38.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5eee35700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5e80f77d0 0x7fa5e8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:38.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5eee35700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e8107880 con 0x7fa5e80f77d0 2023-10-18T21:55:38.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5eee35700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e81080c0 con 0x7fa5e80f6530 2023-10-18T21:55:38.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5ed632700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5e80f77d0 0x7fa5e8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:38.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5ed632700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5e80f77d0 0x7fa5e8107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43848/0 (socket says 172.21.15.8:43848) 2023-10-18T21:55:38.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5ed632700 1 -- 172.21.15.8:0/3503924626 learned_addr learned my addr 172.21.15.8:0/3503924626 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:38.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5ede33700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e80f6530 0x7fa5e8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:38.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5ed632700 1 -- 172.21.15.8:0/3503924626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e80f6530 msgr2=0x7fa5e8106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5ed632700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e80f6530 0x7fa5e8106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5ed632700 1 -- 172.21.15.8:0/3503924626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e4005040 con 0x7fa5e80f77d0 2023-10-18T21:55:38.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5ede33700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e80f6530 0x7fa5e8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:55:38.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.003+0000 7fa5ed632700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5e80f77d0 0x7fa5e8107280 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fa5d800e7f0 tx=0x7fa5d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:38.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.004+0000 7fa5de7fc700 1 -- 172.21.15.8:0/3503924626 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5d80092e0 con 0x7fa5e80f77d0 2023-10-18T21:55:38.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.004+0000 7fa5de7fc700 1 -- 172.21.15.8:0/3503924626 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa5d800f040 con 0x7fa5e80f77d0 2023-10-18T21:55:38.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.004+0000 7fa5de7fc700 1 -- 172.21.15.8:0/3503924626 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5d80147e0 con 0x7fa5e80f77d0 2023-10-18T21:55:38.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.004+0000 7fa5eee35700 1 -- 172.21.15.8:0/3503924626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e81083a0 con 0x7fa5e80f77d0 2023-10-18T21:55:38.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.004+0000 7fa5eee35700 1 -- 172.21.15.8:0/3503924626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e81088e0 con 0x7fa5e80f77d0 2023-10-18T21:55:38.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.005+0000 7fa5eee35700 1 -- 172.21.15.8:0/3503924626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e8059100 con 0x7fa5e80f77d0 2023-10-18T21:55:38.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.006+0000 7fa5de7fc700 1 -- 172.21.15.8:0/3503924626 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa5d801b030 con 0x7fa5e80f77d0 2023-10-18T21:55:38.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.007+0000 7fa5de7fc700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 0x7fa5d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:38.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.007+0000 7fa5de7fc700 1 -- 172.21.15.8:0/3503924626 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa5d807c740 con 0x7fa5e80f77d0 2023-10-18T21:55:38.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.007+0000 7fa5ede33700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 0x7fa5d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:38.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.008+0000 7fa5ede33700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 0x7fa5d4063430 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fa5e4000c00 tx=0x7fa5e400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:38.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.011+0000 7fa5de7fc700 1 -- 172.21.15.8:0/3503924626 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa5d804c340 con 0x7fa5e80f77d0 2023-10-18T21:55:38.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.265+0000 7fa5eee35700 1 -- 172.21.15.8:0/3503924626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5e80fed80 con 0x7fa5e80f77d0 2023-10-18T21:55:38.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.266+0000 7fa5de7fc700 1 -- 172.21.15.8:0/3503924626 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fa5d8019020 con 0x7fa5e80f77d0 2023-10-18T21:55:38.268 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:55:38.269 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:55:38.269 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:55:38.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:55:38.269 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:55:38.269 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:55:38.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:55:38.270 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:55:38.270 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:55:38.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:55:38.270 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:55:38.271 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:55:38.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:55:38.271 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:55:38.271 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:55:38.271 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:55:38.272 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:55:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 -- 172.21.15.8:0/3503924626 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 msgr2=0x7fa5d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 0x7fa5d4063430 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fa5e4000c00 tx=0x7fa5e400b040).stop 2023-10-18T21:55:38.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 -- 172.21.15.8:0/3503924626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5e80f77d0 msgr2=0x7fa5e8107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5e80f77d0 0x7fa5e8107280 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fa5d800e7f0 tx=0x7fa5d800b040).stop 2023-10-18T21:55:38.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 -- 172.21.15.8:0/3503924626 shutdown_connections 2023-10-18T21:55:38.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa5d4060f70 0x7fa5d4063430 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e80f6530 0x7fa5e8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 --2- 172.21.15.8:0/3503924626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5e80f77d0 0x7fa5e8107280 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 -- 172.21.15.8:0/3503924626 >> 172.21.15.8:0/3503924626 conn(0x7fa5e80f1c90 msgr2=0x7fa5e80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:38.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 -- 172.21.15.8:0/3503924626 shutdown_connections 2023-10-18T21:55:38.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.268+0000 7fa5eee35700 1 -- 172.21.15.8:0/3503924626 wait complete. 2023-10-18T21:55:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.406+0000 7f119ab2e700 1 -- 172.21.15.8:0/1205154671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11940f6530 msgr2=0x7f11940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.406+0000 7f119ab2e700 1 --2- 172.21.15.8:0/1205154671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11940f6530 0x7f11940f6950 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f1190004660 tx=0x7f1190009b30).stop 2023-10-18T21:55:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.406+0000 7f119ab2e700 1 -- 172.21.15.8:0/1205154671 shutdown_connections 2023-10-18T21:55:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.406+0000 7f119ab2e700 1 --2- 172.21.15.8:0/1205154671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940f77d0 0x7f11940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.406+0000 7f119ab2e700 1 --2- 172.21.15.8:0/1205154671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11940f6530 0x7f11940f6950 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.406+0000 7f119ab2e700 1 -- 172.21.15.8:0/1205154671 >> 172.21.15.8:0/1205154671 conn(0x7f11940f1c90 msgr2=0x7f11940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.407+0000 7f119ab2e700 1 -- 172.21.15.8:0/1205154671 shutdown_connections 2023-10-18T21:55:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.407+0000 7f119ab2e700 1 -- 172.21.15.8:0/1205154671 wait complete. 2023-10-18T21:55:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.407+0000 7f119ab2e700 1 Processor -- start 2023-10-18T21:55:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.408+0000 7f119ab2e700 1 -- start start 2023-10-18T21:55:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.408+0000 7f119ab2e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11940f6530 0x7f1194109000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.408+0000 7f119ab2e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940f77d0 0x7f11941094f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.408+0000 7f119ab2e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1194109aa0 con 0x7f11940f6530 2023-10-18T21:55:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.408+0000 7f119ab2e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1194109be0 con 0x7f11940f77d0 2023-10-18T21:55:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.408+0000 7f1199b2c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11940f6530 0x7f1194109000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.408+0000 7f1199b2c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11940f6530 0x7f1194109000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43864/0 (socket says 172.21.15.8:43864) 2023-10-18T21:55:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.408+0000 7f1199b2c700 1 -- 172.21.15.8:0/4218932684 learned_addr learned my addr 172.21.15.8:0/4218932684 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.408+0000 7f119932b700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940f77d0 0x7f11941094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.409+0000 7f1199b2c700 1 -- 172.21.15.8:0/4218932684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940f77d0 msgr2=0x7f11941094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.409+0000 7f1199b2c700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940f77d0 0x7f11941094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.409+0000 7f1199b2c700 1 -- 172.21.15.8:0/4218932684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190005040 con 0x7f11940f6530 2023-10-18T21:55:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.409+0000 7f1199b2c700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11940f6530 0x7f1194109000 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f1190007a60 tx=0x7f1190009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.409+0000 7f118a7fc700 1 -- 172.21.15.8:0/4218932684 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1190018070 con 0x7f11940f6530 2023-10-18T21:55:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.409+0000 7f118a7fc700 1 -- 172.21.15.8:0/4218932684 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1190009630 con 0x7f11940f6530 2023-10-18T21:55:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.409+0000 7f119ab2e700 1 -- 172.21.15.8:0/4218932684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119410a520 con 0x7f11940f6530 2023-10-18T21:55:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.409+0000 7f118a7fc700 1 -- 172.21.15.8:0/4218932684 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f119001c540 con 0x7f11940f6530 2023-10-18T21:55:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.409+0000 7f119ab2e700 1 -- 172.21.15.8:0/4218932684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119410aa80 con 0x7f11940f6530 2023-10-18T21:55:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.410+0000 7f119ab2e700 1 -- 172.21.15.8:0/4218932684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1194045ad0 con 0x7f11940f6530 2023-10-18T21:55:38.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.411+0000 7f118a7fc700 1 -- 172.21.15.8:0/4218932684 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f119001c7b0 con 0x7f11940f6530 2023-10-18T21:55:38.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.412+0000 7f118a7fc700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1180060f70 0x7f1180063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:38.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.412+0000 7f118a7fc700 1 -- 172.21.15.8:0/4218932684 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f119007e760 con 0x7f11940f6530 2023-10-18T21:55:38.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.412+0000 7f119932b700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1180060f70 0x7f1180063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:38.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.413+0000 7f119932b700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1180060f70 0x7f1180063430 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f11840096c0 tx=0x7f1184009c20).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:38.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.416+0000 7f118a7fc700 1 -- 172.21.15.8:0/4218932684 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1190051d40 con 0x7f11940f6530 2023-10-18T21:55:38.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:37.167153+0000 mgr.smithi008.flmjzp (mgr.14640) 3403 : audit [DBG] from='client.36808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:37.167153+0000 mgr.smithi008.flmjzp (mgr.14640) 3403 : audit [DBG] from='client.36808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:38.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.640+0000 7f119ab2e700 1 -- 172.21.15.8:0/4218932684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f11940fedb0 con 0x7f11940f6530 2023-10-18T21:55:38.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.641+0000 7f118a7fc700 1 -- 172.21.15.8:0/4218932684 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1190051930 con 0x7f11940f6530 2023-10-18T21:55:38.643 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:55:38.644 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:55:38.644 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:55:38.644 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:55:38.644 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:55:38.644 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:55:38.645 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:55:38.645 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:55:38.645 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:55:38.645 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:55:38.646 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:55:38.646 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:55:38.646 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:55:38.646 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:55:38.646 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:55:38.647 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:55:38.647 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:55:38.647 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:55:38.647 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:55:38.648 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:55:38.648 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:55:38.648 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:55:38.648 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:55:38.648 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:55:38.648 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:55:38.649 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:55:38.649 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:55:38.649 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:55:38.649 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:55:38.650 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:55:38.650 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:55:38.650 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:55:38.650 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:55:38.651 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:55:38.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 -- 172.21.15.8:0/4218932684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1180060f70 msgr2=0x7f1180063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1180060f70 0x7f1180063430 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f11840096c0 tx=0x7f1184009c20).stop 2023-10-18T21:55:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 -- 172.21.15.8:0/4218932684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11940f6530 msgr2=0x7f1194109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11940f6530 0x7f1194109000 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f1190007a60 tx=0x7f1190009b30).stop 2023-10-18T21:55:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 -- 172.21.15.8:0/4218932684 shutdown_connections 2023-10-18T21:55:38.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1180060f70 0x7f1180063430 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11940f6530 0x7f1194109000 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 --2- 172.21.15.8:0/4218932684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940f77d0 0x7f11941094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 -- 172.21.15.8:0/4218932684 >> 172.21.15.8:0/4218932684 conn(0x7f11940f1c90 msgr2=0x7f119406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 -- 172.21.15.8:0/4218932684 shutdown_connections 2023-10-18T21:55:38.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.643+0000 7f119ab2e700 1 -- 172.21.15.8:0/4218932684 wait complete. 2023-10-18T21:55:38.654 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:55:38.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.780+0000 7f3c04f72700 1 -- 172.21.15.8:0/524891619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c000f77d0 msgr2=0x7f3c000f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.780+0000 7f3c04f72700 1 --2- 172.21.15.8:0/524891619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c000f77d0 0x7f3c000f7c30 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f3bf4004660 tx=0x7f3bf4009b30).stop 2023-10-18T21:55:38.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.780+0000 7f3c04f72700 1 -- 172.21.15.8:0/524891619 shutdown_connections 2023-10-18T21:55:38.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.780+0000 7f3c04f72700 1 --2- 172.21.15.8:0/524891619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c000f77d0 0x7f3c000f7c30 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.780+0000 7f3c04f72700 1 --2- 172.21.15.8:0/524891619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c000f6530 0x7f3c000f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:55:38.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.780+0000 7f3c04f72700 1 -- 172.21.15.8:0/524891619 >> 172.21.15.8:0/524891619 conn(0x7f3c000f1c90 msgr2=0x7f3c000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:38.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.780+0000 7f3c04f72700 1 -- 172.21.15.8:0/524891619 shutdown_connections 2023-10-18T21:55:38.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.780+0000 7f3c04f72700 1 -- 172.21.15.8:0/524891619 wait complete. 2023-10-18T21:55:38.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.781+0000 7f3c04f72700 1 Processor -- start 2023-10-18T21:55:38.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.781+0000 7f3c04f72700 1 -- start start 2023-10-18T21:55:38.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.781+0000 7f3c04f72700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c000f6530 0x7f3c00106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:38.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3c04f72700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c000f77d0 0x7f3c00107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:38.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3c04f72700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001079a0 con 0x7f3c000f6530 2023-10-18T21:55:38.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3c04f72700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00108120 con 0x7f3c000f77d0 2023-10-18T21:55:38.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3bff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c000f6530 0x7f3c00106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:38.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3bff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c000f6530 0x7f3c00106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43876/0 (socket says 172.21.15.8:43876) 2023-10-18T21:55:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3bff7fe700 1 -- 172.21.15.8:0/2965153038 learned_addr learned my addr 172.21.15.8:0/2965153038 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:55:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3bfeffd700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c000f77d0 0x7f3c00107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3bff7fe700 1 -- 172.21.15.8:0/2965153038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c000f77d0 msgr2=0x7f3c00107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3bff7fe700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c000f77d0 0x7f3c00107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3bff7fe700 1 -- 172.21.15.8:0/2965153038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4005040 con 0x7f3c000f6530 2023-10-18T21:55:38.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3bfeffd700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c000f77d0 0x7f3c00107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:55:38.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.782+0000 7f3bff7fe700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c000f6530 0x7f3c00106e20 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f3bf00093f0 tx=0x7f3bf0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:38.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.783+0000 7f3be7fff700 1 -- 172.21.15.8:0/2965153038 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf0009ea0 con 0x7f3c000f6530 2023-10-18T21:55:38.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.783+0000 7f3be7fff700 1 -- 172.21.15.8:0/2965153038 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3bf0013b00 con 0x7f3c000f6530 2023-10-18T21:55:38.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.783+0000 7f3c04f72700 1 -- 172.21.15.8:0/2965153038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c001083a0 con 0x7f3c000f6530 2023-10-18T21:55:38.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.783+0000 7f3be7fff700 1 -- 172.21.15.8:0/2965153038 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf000dbf0 con 0x7f3c000f6530 2023-10-18T21:55:38.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.783+0000 7f3c04f72700 1 -- 172.21.15.8:0/2965153038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c00108960 con 0x7f3c000f6530 2023-10-18T21:55:38.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.784+0000 7f3c04f72700 1 -- 172.21.15.8:0/2965153038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c00045ad0 con 0x7f3c000f6530 2023-10-18T21:55:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.785+0000 7f3be7fff700 1 -- 172.21.15.8:0/2965153038 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3bf001a060 con 0x7f3c000f6530 2023-10-18T21:55:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.785+0000 7f3be7fff700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3be8060f70 0x7f3be8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:55:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.786+0000 7f3be7fff700 1 -- 172.21.15.8:0/2965153038 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3bf007c890 con 0x7f3c000f6530 2023-10-18T21:55:38.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.786+0000 7f3bfeffd700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3be8060f70 0x7f3be8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:55:38.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.786+0000 7f3bfeffd700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3be8060f70 0x7f3be8063430 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f3bf4004630 tx=0x7f3bf4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:55:38.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.789+0000 7f3be7fff700 1 -- 172.21.15.8:0/2965153038 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3bf004c5f0 con 0x7f3c000f6530 2023-10-18T21:55:38.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.989+0000 7f3c04f72700 1 -- 172.21.15.8:0/2965153038 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c000fef10 con 0x7f3be8060f70 2023-10-18T21:55:38.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.991+0000 7f3be7fff700 1 -- 172.21.15.8:0/2965153038 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3bf4019040 con 0x7f3be8060f70 2023-10-18T21:55:38.993 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:55:38.993 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:55:38.993 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:55:38.994 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:55:38.994 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:55:38.994 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:55:38.994 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:55:38.994 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:55:38.995 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:55:38.995 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:55:38.995 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:55:38.995 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:55:38.995 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:55:38.996 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:55:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.992+0000 7f3c04f72700 1 -- 172.21.15.8:0/2965153038 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3be8060f70 msgr2=0x7f3be8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.992+0000 7f3c04f72700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3be8060f70 0x7f3be8063430 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f3bf4004630 tx=0x7f3bf4009b30).stop 2023-10-18T21:55:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.992+0000 7f3c04f72700 1 -- 172.21.15.8:0/2965153038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c000f6530 msgr2=0x7f3c00106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:55:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.993+0000 7f3c04f72700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c000f6530 0x7f3c00106e20 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f3bf00093f0 tx=0x7f3bf0006ec0).stop 2023-10-18T21:55:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.993+0000 7f3c04f72700 1 -- 172.21.15.8:0/2965153038 shutdown_connections 2023-10-18T21:55:38.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.993+0000 7f3c04f72700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3be8060f70 0x7f3be8063430 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.993+0000 7f3c04f72700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c000f6530 0x7f3c00106e20 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.993+0000 7f3c04f72700 1 --2- 172.21.15.8:0/2965153038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c000f77d0 0x7f3c00107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:55:38.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.993+0000 7f3c04f72700 1 -- 172.21.15.8:0/2965153038 >> 172.21.15.8:0/2965153038 conn(0x7f3c000f1c90 msgr2=0x7f3c000fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:55:38.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.993+0000 7f3c04f72700 1 -- 172.21.15.8:0/2965153038 shutdown_connections 2023-10-18T21:55:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:55:38.993+0000 7f3c04f72700 1 -- 172.21.15.8:0/2965153038 wait complete. 2023-10-18T21:55:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:37.516940+0000 mgr.smithi008.flmjzp (mgr.14640) 3404 : audit [DBG] from='client.36812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:37.603073+0000 mgr.smithi008.flmjzp (mgr.14640) 3405 : cluster [DBG] pgmap v2341: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:37.857346+0000 mgr.smithi008.flmjzp (mgr.14640) 3406 : audit [DBG] from='client.36816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:38.267462+0000 mon.smithi008 (mon.0) 3763 : audit [DBG] from='client.? 172.21.15.8:0/3503924626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:39.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:38.642405+0000 mon.smithi008 (mon.0) 3764 : audit [DBG] from='client.? 172.21.15.8:0/4218932684' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:55:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:37.516940+0000 mgr.smithi008.flmjzp (mgr.14640) 3404 : audit [DBG] from='client.36812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:37.603073+0000 mgr.smithi008.flmjzp (mgr.14640) 3405 : cluster [DBG] pgmap v2341: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:37.857346+0000 mgr.smithi008.flmjzp (mgr.14640) 3406 : audit [DBG] from='client.36816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:38.267462+0000 mon.smithi008 (mon.0) 3763 : audit [DBG] from='client.? 172.21.15.8:0/3503924626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:39.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:38.642405+0000 mon.smithi008 (mon.0) 3764 : audit [DBG] from='client.? 172.21.15.8:0/4218932684' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:55:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:38.991957+0000 mgr.smithi008.flmjzp (mgr.14640) 3407 : audit [DBG] from='client.36828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:39.633129+0000 mon.smithi008 (mon.0) 3765 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:40.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:38.991957+0000 mgr.smithi008.flmjzp (mgr.14640) 3407 : audit [DBG] from='client.36828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:55:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:39.633129+0000 mon.smithi008 (mon.0) 3765 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:39.603666+0000 mgr.smithi008.flmjzp (mgr.14640) 3408 : cluster [DBG] pgmap v2342: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:40.195650+0000 mon.smithi008 (mon.0) 3766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:55:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:40.196776+0000 mon.smithi008 (mon.0) 3767 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:55:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:55:40.197687+0000 mgr.smithi008.flmjzp (mgr.14640) 3409 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:40.198362+0000 mgr.smithi008.flmjzp (mgr.14640) 3410 : cluster [DBG] pgmap v2343: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:40.198690+0000 mgr.smithi008.flmjzp (mgr.14640) 3411 : cluster [DBG] pgmap v2344: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:40.203543+0000 mon.smithi008 (mon.0) 3768 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:40.210021+0000 mon.smithi008 (mon.0) 3769 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:40.213775+0000 mon.smithi008 (mon.0) 3770 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:40.215670+0000 mon.smithi008 (mon.0) 3771 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:41.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:40.217297+0000 mon.smithi008 (mon.0) 3772 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:41.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:40.219288+0000 mon.smithi008 (mon.0) 3773 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:39.603666+0000 mgr.smithi008.flmjzp (mgr.14640) 3408 : cluster [DBG] pgmap v2342: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:40.195650+0000 mon.smithi008 (mon.0) 3766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:55:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:40.196776+0000 mon.smithi008 (mon.0) 3767 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:55:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:55:40.197687+0000 mgr.smithi008.flmjzp (mgr.14640) 3409 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:40.198362+0000 mgr.smithi008.flmjzp (mgr.14640) 3410 : cluster [DBG] pgmap v2343: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:40.198690+0000 mgr.smithi008.flmjzp (mgr.14640) 3411 : cluster [DBG] pgmap v2344: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:40.203543+0000 mon.smithi008 (mon.0) 3768 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:40.210021+0000 mon.smithi008 (mon.0) 3769 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:41.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:40.213775+0000 mon.smithi008 (mon.0) 3770 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:41.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:40.215670+0000 mon.smithi008 (mon.0) 3771 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:41.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:40.217297+0000 mon.smithi008 (mon.0) 3772 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:41.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:40.219288+0000 mon.smithi008 (mon.0) 3773 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:42.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:55:40.221208+0000 mgr.smithi008.flmjzp (mgr.14640) 3412 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:55:40.221208+0000 mgr.smithi008.flmjzp (mgr.14640) 3412 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:43.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:42.199399+0000 mgr.smithi008.flmjzp (mgr.14640) 3413 : cluster [DBG] pgmap v2345: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:42.199399+0000 mgr.smithi008.flmjzp (mgr.14640) 3413 : cluster [DBG] pgmap v2345: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:44.200012+0000 mgr.smithi008.flmjzp (mgr.14640) 3414 : cluster [DBG] pgmap v2346: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:44.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:44.200012+0000 mgr.smithi008.flmjzp (mgr.14640) 3414 : cluster [DBG] pgmap v2346: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:46.200768+0000 mgr.smithi008.flmjzp (mgr.14640) 3415 : cluster [DBG] pgmap v2347: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:46.200768+0000 mgr.smithi008.flmjzp (mgr.14640) 3415 : cluster [DBG] pgmap v2347: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:48.201310+0000 mgr.smithi008.flmjzp (mgr.14640) 3416 : cluster [DBG] pgmap v2348: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:48.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:48.201310+0000 mgr.smithi008.flmjzp (mgr.14640) 3416 : cluster [DBG] pgmap v2348: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:50.202008+0000 mgr.smithi008.flmjzp (mgr.14640) 3417 : cluster [DBG] pgmap v2349: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:50.231950+0000 mon.smithi008 (mon.0) 3774 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:50.202008+0000 mgr.smithi008.flmjzp (mgr.14640) 3417 : cluster [DBG] pgmap v2349: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:50.231950+0000 mon.smithi008 (mon.0) 3774 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:52.202583+0000 mgr.smithi008.flmjzp (mgr.14640) 3418 : cluster [DBG] pgmap v2350: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:52.202583+0000 mgr.smithi008.flmjzp (mgr.14640) 3418 : cluster [DBG] pgmap v2350: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:54.203044+0000 mgr.smithi008.flmjzp (mgr.14640) 3419 : cluster [DBG] pgmap v2351: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:54.203044+0000 mgr.smithi008.flmjzp (mgr.14640) 3419 : cluster [DBG] pgmap v2351: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:54.498951+0000 mon.smithi008 (mon.0) 3775 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:54.499835+0000 mon.smithi008 (mon.0) 3776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:55:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:54.500578+0000 mon.smithi008 (mon.0) 3777 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:55:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:55:54.501170+0000 mgr.smithi008.flmjzp (mgr.14640) 3420 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:54.501641+0000 mgr.smithi008.flmjzp (mgr.14640) 3421 : cluster [DBG] pgmap v2352: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:54.501855+0000 mgr.smithi008.flmjzp (mgr.14640) 3422 : cluster [DBG] pgmap v2353: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:54.505288+0000 mon.smithi008 (mon.0) 3778 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:54.510199+0000 mon.smithi008 (mon.0) 3779 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:54.513608+0000 mon.smithi008 (mon.0) 3780 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:54.514903+0000 mon.smithi008 (mon.0) 3781 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:54.516114+0000 mon.smithi008 (mon.0) 3782 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:55.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:55:54.517661+0000 mon.smithi008 (mon.0) 3783 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:55.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:55:54.519341+0000 mgr.smithi008.flmjzp (mgr.14640) 3423 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:55.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:54.498951+0000 mon.smithi008 (mon.0) 3775 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:54.499835+0000 mon.smithi008 (mon.0) 3776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:55:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:54.500578+0000 mon.smithi008 (mon.0) 3777 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:55:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:55:54.501170+0000 mgr.smithi008.flmjzp (mgr.14640) 3420 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:55:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:54.501641+0000 mgr.smithi008.flmjzp (mgr.14640) 3421 : cluster [DBG] pgmap v2352: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:54.501855+0000 mgr.smithi008.flmjzp (mgr.14640) 3422 : cluster [DBG] pgmap v2353: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:54.505288+0000 mon.smithi008 (mon.0) 3778 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:55:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:54.510199+0000 mon.smithi008 (mon.0) 3779 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:55:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:54.513608+0000 mon.smithi008 (mon.0) 3780 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:54.514903+0000 mon.smithi008 (mon.0) 3781 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:54.516114+0000 mon.smithi008 (mon.0) 3782 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:55.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:55:54.517661+0000 mon.smithi008 (mon.0) 3783 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:55:55.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:55:54.519341+0000 mgr.smithi008.flmjzp (mgr.14640) 3423 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:55:58.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:56.502444+0000 mgr.smithi008.flmjzp (mgr.14640) 3424 : cluster [DBG] pgmap v2354: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:55:58.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:56.502444+0000 mgr.smithi008.flmjzp (mgr.14640) 3424 : cluster [DBG] pgmap v2354: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:00.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:55:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:55:58.503140+0000 mgr.smithi008.flmjzp (mgr.14640) 3425 : cluster [DBG] pgmap v2355: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:00.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:55:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:55:58.503140+0000 mgr.smithi008.flmjzp (mgr.14640) 3425 : cluster [DBG] pgmap v2355: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:00.503752+0000 mgr.smithi008.flmjzp (mgr.14640) 3426 : cluster [DBG] pgmap v2356: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:00.503752+0000 mgr.smithi008.flmjzp (mgr.14640) 3426 : cluster [DBG] pgmap v2356: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:02.504421+0000 mgr.smithi008.flmjzp (mgr.14640) 3427 : cluster [DBG] pgmap v2357: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:02.504421+0000 mgr.smithi008.flmjzp (mgr.14640) 3427 : cluster [DBG] pgmap v2357: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:05.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:04.530053+0000 mon.smithi008 (mon.0) 3784 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:05.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:04.532138+0000 mon.smithi008 (mon.0) 3785 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:05.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:04.533159+0000 mon.smithi008 (mon.0) 3786 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:05.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:04.539810+0000 mon.smithi008 (mon.0) 3787 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:05.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:04.546239+0000 mon.smithi008 (mon.0) 3788 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:05.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:04.549389+0000 mon.smithi008 (mon.0) 3789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:05.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:04.551043+0000 mon.smithi008 (mon.0) 3790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:05.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:04.552688+0000 mon.smithi008 (mon.0) 3791 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:05.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:04.554621+0000 mon.smithi008 (mon.0) 3792 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:04.530053+0000 mon.smithi008 (mon.0) 3784 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:04.532138+0000 mon.smithi008 (mon.0) 3785 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:04.533159+0000 mon.smithi008 (mon.0) 3786 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:05.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:04.539810+0000 mon.smithi008 (mon.0) 3787 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:05.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:04.546239+0000 mon.smithi008 (mon.0) 3788 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:05.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:04.549389+0000 mon.smithi008 (mon.0) 3789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:05.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:04.551043+0000 mon.smithi008 (mon.0) 3790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:05.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:04.552688+0000 mon.smithi008 (mon.0) 3791 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:05.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:04.554621+0000 mon.smithi008 (mon.0) 3792 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:06.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:04.505057+0000 mgr.smithi008.flmjzp (mgr.14640) 3428 : cluster [DBG] pgmap v2358: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:04.534065+0000 mgr.smithi008.flmjzp (mgr.14640) 3429 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:04.534594+0000 mgr.smithi008.flmjzp (mgr.14640) 3430 : cluster [DBG] pgmap v2359: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:04.534865+0000 mgr.smithi008.flmjzp (mgr.14640) 3431 : cluster [DBG] pgmap v2360: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:04.556489+0000 mgr.smithi008.flmjzp (mgr.14640) 3432 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:04.505057+0000 mgr.smithi008.flmjzp (mgr.14640) 3428 : cluster [DBG] pgmap v2358: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:04.534065+0000 mgr.smithi008.flmjzp (mgr.14640) 3429 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:04.534594+0000 mgr.smithi008.flmjzp (mgr.14640) 3430 : cluster [DBG] pgmap v2359: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:04.534865+0000 mgr.smithi008.flmjzp (mgr.14640) 3431 : cluster [DBG] pgmap v2360: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:04.556489+0000 mgr.smithi008.flmjzp (mgr.14640) 3432 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:08.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:06.535508+0000 mgr.smithi008.flmjzp (mgr.14640) 3433 : cluster [DBG] pgmap v2361: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:08.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:06.535508+0000 mgr.smithi008.flmjzp (mgr.14640) 3433 : cluster [DBG] pgmap v2361: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:09.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.147+0000 7f8803fff700 1 -- 172.21.15.8:0/2712714590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040f6530 msgr2=0x7f88040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:09.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.147+0000 7f8803fff700 1 --2- 172.21.15.8:0/2712714590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040f6530 0x7f88040f6950 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f87f4004660 tx=0x7f87f4009b30).stop 2023-10-18T21:56:09.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.147+0000 7f8803fff700 1 -- 172.21.15.8:0/2712714590 shutdown_connections 2023-10-18T21:56:09.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.147+0000 7f8803fff700 1 --2- 172.21.15.8:0/2712714590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88040f77d0 0x7f88040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.147+0000 7f8803fff700 1 --2- 172.21.15.8:0/2712714590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040f6530 0x7f88040f6950 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.147+0000 7f8803fff700 1 -- 172.21.15.8:0/2712714590 >> 172.21.15.8:0/2712714590 conn(0x7f88040f1c90 msgr2=0x7f88040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:09.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.147+0000 7f8803fff700 1 -- 172.21.15.8:0/2712714590 shutdown_connections 2023-10-18T21:56:09.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.147+0000 7f8803fff700 1 -- 172.21.15.8:0/2712714590 wait complete. 2023-10-18T21:56:09.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.148+0000 7f8803fff700 1 Processor -- start 2023-10-18T21:56:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.148+0000 7f8803fff700 1 -- start start 2023-10-18T21:56:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f8803fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88040f6530 0x7f8804108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f8803fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040f77d0 0x7f8804109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f8803fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804109a00 con 0x7f88040f77d0 2023-10-18T21:56:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f8803fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804109b40 con 0x7f88040f6530 2023-10-18T21:56:09.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f88027fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040f77d0 0x7f8804109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:09.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f88027fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040f77d0 0x7f8804109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46314/0 (socket says 172.21.15.8:46314) 2023-10-18T21:56:09.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f88027fc700 1 -- 172.21.15.8:0/3148291847 learned_addr learned my addr 172.21.15.8:0/3148291847 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:09.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f8802ffd700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88040f6530 0x7f8804108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:09.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f88027fc700 1 -- 172.21.15.8:0/3148291847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88040f6530 msgr2=0x7f8804108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f88027fc700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88040f6530 0x7f8804108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.149+0000 7f88027fc700 1 -- 172.21.15.8:0/3148291847 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4005040 con 0x7f88040f77d0 2023-10-18T21:56:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.150+0000 7f88027fc700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040f77d0 0x7f8804109450 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f87f800e7f0 tx=0x7f87f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.150+0000 7f87eb7fe700 1 -- 172.21.15.8:0/3148291847 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f80092e0 con 0x7f88040f77d0 2023-10-18T21:56:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.150+0000 7f8803fff700 1 -- 172.21.15.8:0/3148291847 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880410a4e0 con 0x7f88040f77d0 2023-10-18T21:56:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.150+0000 7f87eb7fe700 1 -- 172.21.15.8:0/3148291847 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f87f800f040 con 0x7f88040f77d0 2023-10-18T21:56:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.150+0000 7f87eb7fe700 1 -- 172.21.15.8:0/3148291847 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f80147e0 con 0x7f88040f77d0 2023-10-18T21:56:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.150+0000 7f8803fff700 1 -- 172.21.15.8:0/3148291847 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880410aa20 con 0x7f88040f77d0 2023-10-18T21:56:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.151+0000 7f8803fff700 1 -- 172.21.15.8:0/3148291847 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8804045ad0 con 0x7f88040f77d0 2023-10-18T21:56:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.152+0000 7f87eb7fe700 1 -- 172.21.15.8:0/3148291847 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f87f801b030 con 0x7f88040f77d0 2023-10-18T21:56:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.153+0000 7f87eb7fe700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87ec060f70 0x7f87ec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.153+0000 7f87eb7fe700 1 -- 172.21.15.8:0/3148291847 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f87f807c780 con 0x7f88040f77d0 2023-10-18T21:56:09.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.153+0000 7f8802ffd700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87ec060f70 0x7f87ec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:09.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.154+0000 7f8802ffd700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87ec060f70 0x7f87ec063430 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f87f4005010 tx=0x7f87f4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:09.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.158+0000 7f87eb7fe700 1 -- 172.21.15.8:0/3148291847 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f87f804fe50 con 0x7f88040f77d0 2023-10-18T21:56:09.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.355+0000 7f8803fff700 1 -- 172.21.15.8:0/3148291847 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f880410ac40 con 0x7f87ec060f70 2023-10-18T21:56:09.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.356+0000 7f87eb7fe700 1 -- 172.21.15.8:0/3148291847 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f880410ac40 con 0x7f87ec060f70 2023-10-18T21:56:09.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 -- 172.21.15.8:0/3148291847 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87ec060f70 msgr2=0x7f87ec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:09.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87ec060f70 0x7f87ec063430 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f87f4005010 tx=0x7f87f4016040).stop 2023-10-18T21:56:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 -- 172.21.15.8:0/3148291847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040f77d0 msgr2=0x7f8804109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040f77d0 0x7f8804109450 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f87f800e7f0 tx=0x7f87f800b040).stop 2023-10-18T21:56:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 -- 172.21.15.8:0/3148291847 shutdown_connections 2023-10-18T21:56:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f87ec060f70 0x7f87ec063430 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88040f6530 0x7f8804108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 --2- 172.21.15.8:0/3148291847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040f77d0 0x7f8804109450 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 -- 172.21.15.8:0/3148291847 >> 172.21.15.8:0/3148291847 conn(0x7f88040f1c90 msgr2=0x7f880406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 -- 172.21.15.8:0/3148291847 shutdown_connections 2023-10-18T21:56:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.358+0000 7f8803fff700 1 -- 172.21.15.8:0/3148291847 wait complete. 2023-10-18T21:56:09.374 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:56:09.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.495+0000 7fea734fa700 1 -- 172.21.15.8:0/4003817040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea6c0f77d0 msgr2=0x7fea6c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:09.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.495+0000 7fea734fa700 1 --2- 172.21.15.8:0/4003817040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea6c0f77d0 0x7fea6c0f7c30 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fea5c004660 tx=0x7fea5c009b30).stop 2023-10-18T21:56:09.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.495+0000 7fea734fa700 1 -- 172.21.15.8:0/4003817040 shutdown_connections 2023-10-18T21:56:09.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.495+0000 7fea734fa700 1 --2- 172.21.15.8:0/4003817040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea6c0f77d0 0x7fea6c0f7c30 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.495+0000 7fea734fa700 1 --2- 172.21.15.8:0/4003817040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c0f6530 0x7fea6c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.495+0000 7fea734fa700 1 -- 172.21.15.8:0/4003817040 >> 172.21.15.8:0/4003817040 conn(0x7fea6c0f1c90 msgr2=0x7fea6c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:09.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.496+0000 7fea734fa700 1 -- 172.21.15.8:0/4003817040 shutdown_connections 2023-10-18T21:56:09.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.496+0000 7fea734fa700 1 -- 172.21.15.8:0/4003817040 wait complete. 2023-10-18T21:56:09.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.496+0000 7fea734fa700 1 Processor -- start 2023-10-18T21:56:09.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.497+0000 7fea734fa700 1 -- start start 2023-10-18T21:56:09.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.497+0000 7fea734fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea6c0f6530 0x7fea6c108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:09.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.497+0000 7fea734fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c0f77d0 0x7fea6c109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:09.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.497+0000 7fea734fa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c1099c0 con 0x7fea6c0f6530 2023-10-18T21:56:09.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.497+0000 7fea734fa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c109b00 con 0x7fea6c0f77d0 2023-10-18T21:56:09.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.497+0000 7fea724f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea6c0f6530 0x7fea6c108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:09.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.497+0000 7fea724f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea6c0f6530 0x7fea6c108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46330/0 (socket says 172.21.15.8:46330) 2023-10-18T21:56:09.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.497+0000 7fea724f8700 1 -- 172.21.15.8:0/493764446 learned_addr learned my addr 172.21.15.8:0/493764446 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:09.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.497+0000 7fea71cf7700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c0f77d0 0x7fea6c109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:09.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.498+0000 7fea724f8700 1 -- 172.21.15.8:0/493764446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c0f77d0 msgr2=0x7fea6c109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:09.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.498+0000 7fea724f8700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c0f77d0 0x7fea6c109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.498+0000 7fea724f8700 1 -- 172.21.15.8:0/493764446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c005040 con 0x7fea6c0f6530 2023-10-18T21:56:09.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.498+0000 7fea724f8700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea6c0f6530 0x7fea6c108f20 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7fea6800e7c0 tx=0x7fea6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:09.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.498+0000 7fea62ffd700 1 -- 172.21.15.8:0/493764446 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea680092e0 con 0x7fea6c0f6530 2023-10-18T21:56:09.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.498+0000 7fea62ffd700 1 -- 172.21.15.8:0/493764446 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fea6800f040 con 0x7fea6c0f6530 2023-10-18T21:56:09.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.498+0000 7fea734fa700 1 -- 172.21.15.8:0/493764446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c10a4a0 con 0x7fea6c0f6530 2023-10-18T21:56:09.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.498+0000 7fea62ffd700 1 -- 172.21.15.8:0/493764446 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea68014810 con 0x7fea6c0f6530 2023-10-18T21:56:09.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.498+0000 7fea734fa700 1 -- 172.21.15.8:0/493764446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c10a9e0 con 0x7fea6c0f6530 2023-10-18T21:56:09.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.499+0000 7fea734fa700 1 -- 172.21.15.8:0/493764446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c045ad0 con 0x7fea6c0f6530 2023-10-18T21:56:09.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.500+0000 7fea62ffd700 1 -- 172.21.15.8:0/493764446 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fea6801b030 con 0x7fea6c0f6530 2023-10-18T21:56:09.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.501+0000 7fea62ffd700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea58060f70 0x7fea58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:09.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.501+0000 7fea62ffd700 1 -- 172.21.15.8:0/493764446 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fea6807c880 con 0x7fea6c0f6530 2023-10-18T21:56:09.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.501+0000 7fea71cf7700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea58060f70 0x7fea58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:09.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.502+0000 7fea71cf7700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea58060f70 0x7fea58063430 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fea5c005010 tx=0x7fea5c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:09.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.505+0000 7fea62ffd700 1 -- 172.21.15.8:0/493764446 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fea6804fe60 con 0x7fea6c0f6530 2023-10-18T21:56:09.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.705+0000 7fea734fa700 1 -- 172.21.15.8:0/493764446 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea6c0fee00 con 0x7fea58060f70 2023-10-18T21:56:09.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.707+0000 7fea62ffd700 1 -- 172.21.15.8:0/493764446 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fea6c0fee00 con 0x7fea58060f70 2023-10-18T21:56:09.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 -- 172.21.15.8:0/493764446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea58060f70 msgr2=0x7fea58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:09.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea58060f70 0x7fea58063430 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fea5c005010 tx=0x7fea5c016040).stop 2023-10-18T21:56:09.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 -- 172.21.15.8:0/493764446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea6c0f6530 msgr2=0x7fea6c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea6c0f6530 0x7fea6c108f20 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7fea6800e7c0 tx=0x7fea6800b040).stop 2023-10-18T21:56:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 -- 172.21.15.8:0/493764446 shutdown_connections 2023-10-18T21:56:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fea58060f70 0x7fea58063430 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea6c0f6530 0x7fea6c108f20 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 --2- 172.21.15.8:0/493764446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea6c0f77d0 0x7fea6c109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 -- 172.21.15.8:0/493764446 >> 172.21.15.8:0/493764446 conn(0x7fea6c0f1c90 msgr2=0x7fea6c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:09.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 -- 172.21.15.8:0/493764446 shutdown_connections 2023-10-18T21:56:09.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.709+0000 7fea734fa700 1 -- 172.21.15.8:0/493764446 wait complete. 2023-10-18T21:56:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.845+0000 7f84b4e56700 1 -- 172.21.15.8:0/3112488115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b00f6530 msgr2=0x7f84b00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.845+0000 7f84b4e56700 1 --2- 172.21.15.8:0/3112488115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b00f6530 0x7f84b00f6950 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f84a0004660 tx=0x7f84a0009b30).stop 2023-10-18T21:56:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.845+0000 7f84b4e56700 1 -- 172.21.15.8:0/3112488115 shutdown_connections 2023-10-18T21:56:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.845+0000 7f84b4e56700 1 --2- 172.21.15.8:0/3112488115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84b00f77d0 0x7f84b00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.845+0000 7f84b4e56700 1 --2- 172.21.15.8:0/3112488115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b00f6530 0x7f84b00f6950 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.845+0000 7f84b4e56700 1 -- 172.21.15.8:0/3112488115 >> 172.21.15.8:0/3112488115 conn(0x7f84b00f1c90 msgr2=0x7f84b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.845+0000 7f84b4e56700 1 -- 172.21.15.8:0/3112488115 shutdown_connections 2023-10-18T21:56:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.845+0000 7f84b4e56700 1 -- 172.21.15.8:0/3112488115 wait complete. 2023-10-18T21:56:09.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.846+0000 7f84b4e56700 1 Processor -- start 2023-10-18T21:56:09.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.846+0000 7f84b4e56700 1 -- start start 2023-10-18T21:56:09.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84b4e56700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b00f6530 0x7f84b0108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84b4e56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84b00f77d0 0x7f84b01094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84b4e56700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0109a50 con 0x7f84b00f6530 2023-10-18T21:56:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84b4e56700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0109b90 con 0x7f84b00f77d0 2023-10-18T21:56:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b00f6530 0x7f84b0108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b00f6530 0x7f84b0108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46348/0 (socket says 172.21.15.8:46348) 2023-10-18T21:56:09.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84af7fe700 1 -- 172.21.15.8:0/3754306347 learned_addr learned my addr 172.21.15.8:0/3754306347 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84aeffd700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84b00f77d0 0x7f84b01094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84af7fe700 1 -- 172.21.15.8:0/3754306347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84b00f77d0 msgr2=0x7f84b01094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84af7fe700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84b00f77d0 0x7f84b01094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:09.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84af7fe700 1 -- 172.21.15.8:0/3754306347 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0005040 con 0x7f84b00f6530 2023-10-18T21:56:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.847+0000 7f84aeffd700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84b00f77d0 0x7f84b01094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:56:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.848+0000 7f84af7fe700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b00f6530 0x7f84b0108fb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f84a0009f50 tx=0x7f84a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.848+0000 7f8497fff700 1 -- 172.21.15.8:0/3754306347 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a0018070 con 0x7f84b00f6530 2023-10-18T21:56:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.848+0000 7f8497fff700 1 -- 172.21.15.8:0/3754306347 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f84a001d8e0 con 0x7f84b00f6530 2023-10-18T21:56:09.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.848+0000 7f8497fff700 1 -- 172.21.15.8:0/3754306347 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a001c4c0 con 0x7f84b00f6530 2023-10-18T21:56:09.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.848+0000 7f84b4e56700 1 -- 172.21.15.8:0/3754306347 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b010a4d0 con 0x7f84b00f6530 2023-10-18T21:56:09.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.848+0000 7f84b4e56700 1 -- 172.21.15.8:0/3754306347 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b010aa30 con 0x7f84b00f6530 2023-10-18T21:56:09.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.849+0000 7f84b4e56700 1 -- 172.21.15.8:0/3754306347 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b0045ad0 con 0x7f84b00f6530 2023-10-18T21:56:09.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.850+0000 7f8497fff700 1 -- 172.21.15.8:0/3754306347 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f84a001d420 con 0x7f84b00f6530 2023-10-18T21:56:09.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.851+0000 7f8497fff700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8498060f70 0x7f8498063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:09.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.851+0000 7f8497fff700 1 -- 172.21.15.8:0/3754306347 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f84a007e710 con 0x7f84b00f6530 2023-10-18T21:56:09.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.851+0000 7f84aeffd700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8498060f70 0x7f8498063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:09.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.852+0000 7f84aeffd700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8498060f70 0x7f8498063430 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f84a4004a70 tx=0x7f84a4009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:09.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:09.855+0000 7f8497fff700 1 -- 172.21.15.8:0/3754306347 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f84a0051e30 con 0x7f84b00f6530 2023-10-18T21:56:10.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.048+0000 7f84b4e56700 1 -- 172.21.15.8:0/3754306347 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f84b00fed30 con 0x7f8498060f70 2023-10-18T21:56:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.058+0000 7f8497fff700 1 -- 172.21.15.8:0/3754306347 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f84b00fed30 con 0x7f8498060f70 2023-10-18T21:56:10.060 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:56:10.060 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (62m) 15s ago 64m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:56:10.060 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (56m) 15s ago 64m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:56:10.060 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (56m) 8m ago 63m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:56:10.060 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (62m) 15s ago 63m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:56:10.061 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 15s ago 60m - - 2023-10-18T21:56:10.061 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 15s ago 60m - - 2023-10-18T21:56:10.061 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 60m - - 2023-10-18T21:56:10.061 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 60m - - 2023-10-18T21:56:10.061 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (57m) 15s ago 65m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:56:10.062 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (57m) 8m ago 63m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:56:10.062 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (57m) 15s ago 65m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:56:10.062 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (56m) 8m ago 63m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:56:10.062 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (63m) 15s ago 63m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:56:10.062 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (63m) 8m ago 63m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:56:10.063 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (56m) 15s ago 62m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:56:10.063 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (54m) 15s ago 62m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:56:10.063 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (53m) 15s ago 62m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:56:10.063 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (53m) 8m ago 61m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:56:10.063 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (52m) 8m ago 61m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:56:10.064 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (52m) 8m ago 61m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:56:10.064 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (58m) 15s ago 63m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:56:10.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 -- 172.21.15.8:0/3754306347 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8498060f70 msgr2=0x7f8498063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8498060f70 0x7f8498063430 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f84a4004a70 tx=0x7f84a4009040).stop 2023-10-18T21:56:10.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 -- 172.21.15.8:0/3754306347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b00f6530 msgr2=0x7f84b0108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b00f6530 0x7f84b0108fb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f84a0009f50 tx=0x7f84a0009b30).stop 2023-10-18T21:56:10.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 -- 172.21.15.8:0/3754306347 shutdown_connections 2023-10-18T21:56:10.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8498060f70 0x7f8498063430 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b00f6530 0x7f84b0108fb0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 --2- 172.21.15.8:0/3754306347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84b00f77d0 0x7f84b01094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 -- 172.21.15.8:0/3754306347 >> 172.21.15.8:0/3754306347 conn(0x7f84b00f1c90 msgr2=0x7f84b006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:10.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 -- 172.21.15.8:0/3754306347 shutdown_connections 2023-10-18T21:56:10.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.060+0000 7f84b4e56700 1 -- 172.21.15.8:0/3754306347 wait complete. 2023-10-18T21:56:10.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:08.536080+0000 mgr.smithi008.flmjzp (mgr.14640) 3434 : cluster [DBG] pgmap v2362: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:10.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.196+0000 7f4316077700 1 -- 172.21.15.8:0/315018363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43100f6530 msgr2=0x7f43100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.196+0000 7f4316077700 1 --2- 172.21.15.8:0/315018363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43100f6530 0x7f43100f6950 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f430c004660 tx=0x7f430c009b30).stop 2023-10-18T21:56:10.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.196+0000 7f4316077700 1 -- 172.21.15.8:0/315018363 shutdown_connections 2023-10-18T21:56:10.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.196+0000 7f4316077700 1 --2- 172.21.15.8:0/315018363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43100f77d0 0x7f43100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.196+0000 7f4316077700 1 --2- 172.21.15.8:0/315018363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43100f6530 0x7f43100f6950 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.196+0000 7f4316077700 1 -- 172.21.15.8:0/315018363 >> 172.21.15.8:0/315018363 conn(0x7f43100f1c90 msgr2=0x7f43100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.196+0000 7f4316077700 1 -- 172.21.15.8:0/315018363 shutdown_connections 2023-10-18T21:56:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.196+0000 7f4316077700 1 -- 172.21.15.8:0/315018363 wait complete. 2023-10-18T21:56:10.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.197+0000 7f4316077700 1 Processor -- start 2023-10-18T21:56:10.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.197+0000 7f4316077700 1 -- start start 2023-10-18T21:56:10.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.197+0000 7f4316077700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43100f6530 0x7f4310108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:10.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.197+0000 7f4316077700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43100f77d0 0x7f43101094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:10.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.198+0000 7f4316077700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4310109a50 con 0x7f43100f6530 2023-10-18T21:56:10.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.198+0000 7f4316077700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4310109b90 con 0x7f43100f77d0 2023-10-18T21:56:10.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.198+0000 7f4315075700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43100f6530 0x7f4310108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:10.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.198+0000 7f4315075700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43100f6530 0x7f4310108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46374/0 (socket says 172.21.15.8:46374) 2023-10-18T21:56:10.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.198+0000 7f4315075700 1 -- 172.21.15.8:0/3970907174 learned_addr learned my addr 172.21.15.8:0/3970907174 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:10.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.198+0000 7f4314874700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43100f77d0 0x7f43101094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:10.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.198+0000 7f4315075700 1 -- 172.21.15.8:0/3970907174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43100f77d0 msgr2=0x7f43101094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.198+0000 7f4315075700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43100f77d0 0x7f43101094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.198+0000 7f4315075700 1 -- 172.21.15.8:0/3970907174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c005040 con 0x7f43100f6530 2023-10-18T21:56:10.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.198+0000 7f4315075700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43100f6530 0x7f4310108fb0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f430c004e30 tx=0x7f430c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:10.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.199+0000 7f4305ffb700 1 -- 172.21.15.8:0/3970907174 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430c018070 con 0x7f43100f6530 2023-10-18T21:56:10.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.199+0000 7f4305ffb700 1 -- 172.21.15.8:0/3970907174 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f430c009630 con 0x7f43100f6530 2023-10-18T21:56:10.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.199+0000 7f4316077700 1 -- 172.21.15.8:0/3970907174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431010a4d0 con 0x7f43100f6530 2023-10-18T21:56:10.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.199+0000 7f4305ffb700 1 -- 172.21.15.8:0/3970907174 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430c01c3c0 con 0x7f43100f6530 2023-10-18T21:56:10.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.199+0000 7f4316077700 1 -- 172.21.15.8:0/3970907174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431010aa30 con 0x7f43100f6530 2023-10-18T21:56:10.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.200+0000 7f4316077700 1 -- 172.21.15.8:0/3970907174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4310045ad0 con 0x7f43100f6530 2023-10-18T21:56:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.201+0000 7f4305ffb700 1 -- 172.21.15.8:0/3970907174 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f430c01d420 con 0x7f43100f6530 2023-10-18T21:56:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.201+0000 7f4305ffb700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42fc060f70 0x7f42fc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.202+0000 7f4305ffb700 1 -- 172.21.15.8:0/3970907174 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f430c07e540 con 0x7f43100f6530 2023-10-18T21:56:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.202+0000 7f4314874700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42fc060f70 0x7f42fc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.202+0000 7f4314874700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42fc060f70 0x7f42fc063430 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f43000096c0 tx=0x7f4300009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:10.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.206+0000 7f4305ffb700 1 -- 172.21.15.8:0/3970907174 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f430c051c50 con 0x7f43100f6530 2023-10-18T21:56:10.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:08.536080+0000 mgr.smithi008.flmjzp (mgr.14640) 3434 : cluster [DBG] pgmap v2362: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:10.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.460+0000 7f4316077700 1 -- 172.21.15.8:0/3970907174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f43100fedd0 con 0x7f43100f6530 2023-10-18T21:56:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.460+0000 7f4305ffb700 1 -- 172.21.15.8:0/3970907174 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f430c051840 con 0x7f43100f6530 2023-10-18T21:56:10.462 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:56:10.462 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:56:10.462 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:56:10.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:56:10.463 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:56:10.463 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:56:10.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:56:10.464 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:56:10.464 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:56:10.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:56:10.464 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:56:10.464 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:56:10.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:56:10.465 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:56:10.465 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:56:10.465 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:56:10.465 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:56:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 -- 172.21.15.8:0/3970907174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42fc060f70 msgr2=0x7f42fc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42fc060f70 0x7f42fc063430 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f43000096c0 tx=0x7f4300009be0).stop 2023-10-18T21:56:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 -- 172.21.15.8:0/3970907174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43100f6530 msgr2=0x7f4310108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43100f6530 0x7f4310108fb0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f430c004e30 tx=0x7f430c009b30).stop 2023-10-18T21:56:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 -- 172.21.15.8:0/3970907174 shutdown_connections 2023-10-18T21:56:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f42fc060f70 0x7f42fc063430 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43100f6530 0x7f4310108fb0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 --2- 172.21.15.8:0/3970907174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43100f77d0 0x7f43101094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 -- 172.21.15.8:0/3970907174 >> 172.21.15.8:0/3970907174 conn(0x7f43100f1c90 msgr2=0x7f431006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 -- 172.21.15.8:0/3970907174 shutdown_connections 2023-10-18T21:56:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.462+0000 7f4316077700 1 -- 172.21.15.8:0/3970907174 wait complete. 2023-10-18T21:56:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.599+0000 7f7687fff700 1 -- 172.21.15.8:0/3249086668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76880f77d0 msgr2=0x7f76880f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.599+0000 7f7687fff700 1 --2- 172.21.15.8:0/3249086668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76880f77d0 0x7f76880f7c30 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f767c004660 tx=0x7f767c009b30).stop 2023-10-18T21:56:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.599+0000 7f7687fff700 1 -- 172.21.15.8:0/3249086668 shutdown_connections 2023-10-18T21:56:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.599+0000 7f7687fff700 1 --2- 172.21.15.8:0/3249086668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76880f77d0 0x7f76880f7c30 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.599+0000 7f7687fff700 1 --2- 172.21.15.8:0/3249086668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76880f6530 0x7f76880f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.599+0000 7f7687fff700 1 -- 172.21.15.8:0/3249086668 >> 172.21.15.8:0/3249086668 conn(0x7f76880f1c90 msgr2=0x7f76880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.599+0000 7f7687fff700 1 -- 172.21.15.8:0/3249086668 shutdown_connections 2023-10-18T21:56:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.599+0000 7f7687fff700 1 -- 172.21.15.8:0/3249086668 wait complete. 2023-10-18T21:56:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.600+0000 7f7687fff700 1 Processor -- start 2023-10-18T21:56:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.600+0000 7f7687fff700 1 -- start start 2023-10-18T21:56:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.600+0000 7f7687fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76880f6530 0x7f7688106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.600+0000 7f7687fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76880f77d0 0x7f7688107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.600+0000 7f7687fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7688107850 con 0x7f76880f77d0 2023-10-18T21:56:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.600+0000 7f7687fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7688108060 con 0x7f76880f6530 2023-10-18T21:56:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.600+0000 7f76867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76880f77d0 0x7f7688107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.600+0000 7f76867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76880f77d0 0x7f7688107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46388/0 (socket says 172.21.15.8:46388) 2023-10-18T21:56:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.600+0000 7f76867fc700 1 -- 172.21.15.8:0/1125371207 learned_addr learned my addr 172.21.15.8:0/1125371207 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.601+0000 7f7686ffd700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76880f6530 0x7f7688106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.601+0000 7f76867fc700 1 -- 172.21.15.8:0/1125371207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76880f6530 msgr2=0x7f7688106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.601+0000 7f76867fc700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76880f6530 0x7f7688106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.601+0000 7f76867fc700 1 -- 172.21.15.8:0/1125371207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c005040 con 0x7f76880f77d0 2023-10-18T21:56:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.601+0000 7f76867fc700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76880f77d0 0x7f7688107250 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f767c004320 tx=0x7f767c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.601+0000 7f766f7fe700 1 -- 172.21.15.8:0/1125371207 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f767c019070 con 0x7f76880f77d0 2023-10-18T21:56:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.601+0000 7f766f7fe700 1 -- 172.21.15.8:0/1125371207 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f767c01e420 con 0x7f76880f77d0 2023-10-18T21:56:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.601+0000 7f7687fff700 1 -- 172.21.15.8:0/1125371207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7688108280 con 0x7f76880f77d0 2023-10-18T21:56:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.601+0000 7f766f7fe700 1 -- 172.21.15.8:0/1125371207 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f767c014680 con 0x7f76880f77d0 2023-10-18T21:56:10.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.602+0000 7f7687fff700 1 -- 172.21.15.8:0/1125371207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7688108760 con 0x7f76880f77d0 2023-10-18T21:56:10.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.603+0000 7f7687fff700 1 -- 172.21.15.8:0/1125371207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7688059100 con 0x7f76880f77d0 2023-10-18T21:56:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.604+0000 7f766f7fe700 1 -- 172.21.15.8:0/1125371207 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f767c01e590 con 0x7f76880f77d0 2023-10-18T21:56:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.605+0000 7f766f7fe700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7670060f70 0x7f7670063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.605+0000 7f766f7fe700 1 -- 172.21.15.8:0/1125371207 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f767c07dd10 con 0x7f76880f77d0 2023-10-18T21:56:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.605+0000 7f7686ffd700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7670060f70 0x7f7670063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.606+0000 7f7686ffd700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7670060f70 0x7f7670063430 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f7688106ad0 tx=0x7f767800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.610+0000 7f766f7fe700 1 -- 172.21.15.8:0/1125371207 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f767c04d8e0 con 0x7f76880f77d0 2023-10-18T21:56:10.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.841+0000 7f7687fff700 1 -- 172.21.15.8:0/1125371207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76880fedc0 con 0x7f76880f77d0 2023-10-18T21:56:10.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.842+0000 7f766f7fe700 1 -- 172.21.15.8:0/1125371207 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f767c050f00 con 0x7f76880f77d0 2023-10-18T21:56:10.843 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:56:10.844 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:56:10.844 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:56:10.844 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:56:10.844 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:56:10.844 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:56:10.845 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:56:10.845 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:56:10.845 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:56:10.845 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:56:10.846 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:56:10.846 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:56:10.846 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:56:10.846 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:56:10.846 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:56:10.847 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:56:10.847 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:56:10.847 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:56:10.847 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:56:10.848 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:56:10.848 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:56:10.848 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:56:10.848 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:56:10.848 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:56:10.849 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:56:10.849 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:56:10.849 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:56:10.849 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:56:10.849 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:56:10.850 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:56:10.850 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:56:10.850 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:56:10.850 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:56:10.850 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:56:10.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 -- 172.21.15.8:0/1125371207 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7670060f70 msgr2=0x7f7670063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7670060f70 0x7f7670063430 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f7688106ad0 tx=0x7f767800b040).stop 2023-10-18T21:56:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 -- 172.21.15.8:0/1125371207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76880f77d0 msgr2=0x7f7688107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76880f77d0 0x7f7688107250 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f767c004320 tx=0x7f767c00b040).stop 2023-10-18T21:56:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 -- 172.21.15.8:0/1125371207 shutdown_connections 2023-10-18T21:56:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7670060f70 0x7f7670063430 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76880f6530 0x7f7688106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 --2- 172.21.15.8:0/1125371207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76880f77d0 0x7f7688107250 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 -- 172.21.15.8:0/1125371207 >> 172.21.15.8:0/1125371207 conn(0x7f76880f1c90 msgr2=0x7f76880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 -- 172.21.15.8:0/1125371207 shutdown_connections 2023-10-18T21:56:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.844+0000 7f7687fff700 1 -- 172.21.15.8:0/1125371207 wait complete. 2023-10-18T21:56:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:56:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.983+0000 7f90a69fc700 1 -- 172.21.15.8:0/764491285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a00f6530 msgr2=0x7f90a00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.983+0000 7f90a69fc700 1 --2- 172.21.15.8:0/764491285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a00f6530 0x7f90a00f6950 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f909c004660 tx=0x7f909c009b30).stop 2023-10-18T21:56:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.983+0000 7f90a69fc700 1 -- 172.21.15.8:0/764491285 shutdown_connections 2023-10-18T21:56:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.983+0000 7f90a69fc700 1 --2- 172.21.15.8:0/764491285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00f77d0 0x7f90a00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.983+0000 7f90a69fc700 1 --2- 172.21.15.8:0/764491285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a00f6530 0x7f90a00f6950 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.983+0000 7f90a69fc700 1 -- 172.21.15.8:0/764491285 >> 172.21.15.8:0/764491285 conn(0x7f90a00f1c90 msgr2=0x7f90a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.983+0000 7f90a69fc700 1 -- 172.21.15.8:0/764491285 shutdown_connections 2023-10-18T21:56:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.983+0000 7f90a69fc700 1 -- 172.21.15.8:0/764491285 wait complete. 2023-10-18T21:56:10.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.984+0000 7f90a69fc700 1 Processor -- start 2023-10-18T21:56:10.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.984+0000 7f90a69fc700 1 -- start start 2023-10-18T21:56:10.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.985+0000 7f90a69fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00f6530 0x7f90a0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:10.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.985+0000 7f90a69fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a00f77d0 0x7f90a0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:10.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.985+0000 7f90a69fc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0107910 con 0x7f90a00f77d0 2023-10-18T21:56:10.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.985+0000 7f90a69fc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0108120 con 0x7f90a00f6530 2023-10-18T21:56:10.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.985+0000 7f90a51f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a00f77d0 0x7f90a0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:10.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.985+0000 7f90a59fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00f6530 0x7f90a0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:10.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.985+0000 7f90a51f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a00f77d0 0x7f90a0107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46402/0 (socket says 172.21.15.8:46402) 2023-10-18T21:56:10.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.985+0000 7f90a51f9700 1 -- 172.21.15.8:0/2494660365 learned_addr learned my addr 172.21.15.8:0/2494660365 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:10.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.985+0000 7f90a51f9700 1 -- 172.21.15.8:0/2494660365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00f6530 msgr2=0x7f90a0106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:10.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.986+0000 7f90a51f9700 1 --2- 172.21.15.8:0/2494660365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00f6530 0x7f90a0106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:10.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.986+0000 7f90a51f9700 1 -- 172.21.15.8:0/2494660365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c005040 con 0x7f90a00f77d0 2023-10-18T21:56:10.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.986+0000 7f90a51f9700 1 --2- 172.21.15.8:0/2494660365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a00f77d0 0x7f90a0107310 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f90900026d0 tx=0x7f9090009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:10.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.986+0000 7f90967fc700 1 -- 172.21.15.8:0/2494660365 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90900079c0 con 0x7f90a00f77d0 2023-10-18T21:56:10.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.986+0000 7f90967fc700 1 -- 172.21.15.8:0/2494660365 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f909000f040 con 0x7f90a00f77d0 2023-10-18T21:56:10.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.986+0000 7f90967fc700 1 -- 172.21.15.8:0/2494660365 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9090014980 con 0x7f90a00f77d0 2023-10-18T21:56:10.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.986+0000 7f90a69fc700 1 -- 172.21.15.8:0/2494660365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a01083a0 con 0x7f90a00f77d0 2023-10-18T21:56:10.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.986+0000 7f90a69fc700 1 -- 172.21.15.8:0/2494660365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a0108960 con 0x7f90a00f77d0 2023-10-18T21:56:10.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.987+0000 7f90a69fc700 1 -- 172.21.15.8:0/2494660365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a0059100 con 0x7f90a00f77d0 2023-10-18T21:56:10.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.988+0000 7f90967fc700 1 -- 172.21.15.8:0/2494660365 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f90900090d0 con 0x7f90a00f77d0 2023-10-18T21:56:10.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.989+0000 7f90967fc700 1 --2- 172.21.15.8:0/2494660365 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f908c060f70 0x7f908c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:10.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.989+0000 7f90967fc700 1 -- 172.21.15.8:0/2494660365 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f909007c8c0 con 0x7f90a00f77d0 2023-10-18T21:56:10.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.989+0000 7f90a59fa700 1 --2- 172.21.15.8:0/2494660365 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f908c060f70 0x7f908c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:10.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.990+0000 7f90a59fa700 1 --2- 172.21.15.8:0/2494660365 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f908c060f70 0x7f908c063430 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f909c005010 tx=0x7f909c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:10.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:10.993+0000 7f90967fc700 1 -- 172.21.15.8:0/2494660365 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f909004c5e0 con 0x7f90a00f77d0 2023-10-18T21:56:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:09.356243+0000 mgr.smithi008.flmjzp (mgr.14640) 3435 : audit [DBG] from='client.36832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:11.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:09.706964+0000 mgr.smithi008.flmjzp (mgr.14640) 3436 : audit [DBG] from='client.36836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:10.049849+0000 mgr.smithi008.flmjzp (mgr.14640) 3437 : audit [DBG] from='client.36840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:10.460833+0000 mon.smithi008 (mon.0) 3793 : audit [DBG] from='client.? 172.21.15.8:0/3970907174' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:11.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:10.842511+0000 mon.smithi008 (mon.0) 3794 : audit [DBG] from='client.? 172.21.15.8:0/1125371207' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:56:11.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:09.356243+0000 mgr.smithi008.flmjzp (mgr.14640) 3435 : audit [DBG] from='client.36832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:11.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:09.706964+0000 mgr.smithi008.flmjzp (mgr.14640) 3436 : audit [DBG] from='client.36836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:11.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:10.049849+0000 mgr.smithi008.flmjzp (mgr.14640) 3437 : audit [DBG] from='client.36840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:11.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:10.460833+0000 mon.smithi008 (mon.0) 3793 : audit [DBG] from='client.? 172.21.15.8:0/3970907174' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:11.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:10.842511+0000 mon.smithi008 (mon.0) 3794 : audit [DBG] from='client.? 172.21.15.8:0/1125371207' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:56:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.191+0000 7f90a69fc700 1 -- 172.21.15.8:0/2494660365 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90a00fee50 con 0x7f908c060f70 2023-10-18T21:56:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.192+0000 7f90967fc700 1 -- 172.21.15.8:0/2494660365 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f90a00fee50 con 0x7f908c060f70 2023-10-18T21:56:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:56:11.194 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:56:11.194 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:56:11.194 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:56:11.194 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:56:11.194 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:56:11.195 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:56:11.195 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:56:11.195 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:56:11.195 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:56:11.196 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:56:11.196 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:56:11.196 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:56:11.196 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:56:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 -- 172.21.15.8:0/2494660365 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f908c060f70 msgr2=0x7f908c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 --2- 172.21.15.8:0/2494660365 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f908c060f70 0x7f908c063430 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f909c005010 tx=0x7f909c009b30).stop 2023-10-18T21:56:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 -- 172.21.15.8:0/2494660365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a00f77d0 msgr2=0x7f90a0107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 --2- 172.21.15.8:0/2494660365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a00f77d0 0x7f90a0107310 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f90900026d0 tx=0x7f9090009de0).stop 2023-10-18T21:56:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 -- 172.21.15.8:0/2494660365 shutdown_connections 2023-10-18T21:56:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 --2- 172.21.15.8:0/2494660365 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f908c060f70 0x7f908c063430 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 --2- 172.21.15.8:0/2494660365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00f6530 0x7f90a0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 --2- 172.21.15.8:0/2494660365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a00f77d0 0x7f90a0107310 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 -- 172.21.15.8:0/2494660365 >> 172.21.15.8:0/2494660365 conn(0x7f90a00f1c90 msgr2=0x7f90a00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 -- 172.21.15.8:0/2494660365 shutdown_connections 2023-10-18T21:56:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:11.194+0000 7f90a69fc700 1 -- 172.21.15.8:0/2494660365 wait complete. 2023-10-18T21:56:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:10.536547+0000 mgr.smithi008.flmjzp (mgr.14640) 3438 : cluster [DBG] pgmap v2363: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:11.192351+0000 mgr.smithi008.flmjzp (mgr.14640) 3439 : audit [DBG] from='client.36852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:10.536547+0000 mgr.smithi008.flmjzp (mgr.14640) 3438 : cluster [DBG] pgmap v2363: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:11.192351+0000 mgr.smithi008.flmjzp (mgr.14640) 3439 : audit [DBG] from='client.36852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:12.537066+0000 mgr.smithi008.flmjzp (mgr.14640) 3440 : cluster [DBG] pgmap v2364: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:12.537066+0000 mgr.smithi008.flmjzp (mgr.14640) 3440 : cluster [DBG] pgmap v2364: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:15.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:14.567329+0000 mon.smithi008 (mon.0) 3795 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:15.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:14.569501+0000 mon.smithi008 (mon.0) 3796 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:15.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:14.570483+0000 mon.smithi008 (mon.0) 3797 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:15.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:14.577331+0000 mon.smithi008 (mon.0) 3798 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:15.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:14.583674+0000 mon.smithi008 (mon.0) 3799 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:15.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:14.586936+0000 mon.smithi008 (mon.0) 3800 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:15.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:14.588670+0000 mon.smithi008 (mon.0) 3801 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:15.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:14.590380+0000 mon.smithi008 (mon.0) 3802 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:15.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:14.592441+0000 mon.smithi008 (mon.0) 3803 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:14.567329+0000 mon.smithi008 (mon.0) 3795 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:14.569501+0000 mon.smithi008 (mon.0) 3796 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:14.570483+0000 mon.smithi008 (mon.0) 3797 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:14.577331+0000 mon.smithi008 (mon.0) 3798 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:14.583674+0000 mon.smithi008 (mon.0) 3799 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:14.586936+0000 mon.smithi008 (mon.0) 3800 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:14.588670+0000 mon.smithi008 (mon.0) 3801 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:14.590380+0000 mon.smithi008 (mon.0) 3802 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:14.592441+0000 mon.smithi008 (mon.0) 3803 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:14.537596+0000 mgr.smithi008.flmjzp (mgr.14640) 3441 : cluster [DBG] pgmap v2365: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:16.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:14.571430+0000 mgr.smithi008.flmjzp (mgr.14640) 3442 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:16.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:14.571985+0000 mgr.smithi008.flmjzp (mgr.14640) 3443 : cluster [DBG] pgmap v2366: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:16.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:14.572234+0000 mgr.smithi008.flmjzp (mgr.14640) 3444 : cluster [DBG] pgmap v2367: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:16.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:14.594389+0000 mgr.smithi008.flmjzp (mgr.14640) 3445 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:14.537596+0000 mgr.smithi008.flmjzp (mgr.14640) 3441 : cluster [DBG] pgmap v2365: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:14.571430+0000 mgr.smithi008.flmjzp (mgr.14640) 3442 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:14.571985+0000 mgr.smithi008.flmjzp (mgr.14640) 3443 : cluster [DBG] pgmap v2366: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:14.572234+0000 mgr.smithi008.flmjzp (mgr.14640) 3444 : cluster [DBG] pgmap v2367: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:14.594389+0000 mgr.smithi008.flmjzp (mgr.14640) 3445 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:18.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:16.572894+0000 mgr.smithi008.flmjzp (mgr.14640) 3446 : cluster [DBG] pgmap v2368: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:18.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:16.572894+0000 mgr.smithi008.flmjzp (mgr.14640) 3446 : cluster [DBG] pgmap v2368: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:20.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:18.573711+0000 mgr.smithi008.flmjzp (mgr.14640) 3447 : cluster [DBG] pgmap v2369: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:20.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:18.573711+0000 mgr.smithi008.flmjzp (mgr.14640) 3447 : cluster [DBG] pgmap v2369: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:22.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:20.574499+0000 mgr.smithi008.flmjzp (mgr.14640) 3448 : cluster [DBG] pgmap v2370: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:20.574499+0000 mgr.smithi008.flmjzp (mgr.14640) 3448 : cluster [DBG] pgmap v2370: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:22.574974+0000 mgr.smithi008.flmjzp (mgr.14640) 3449 : cluster [DBG] pgmap v2371: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:22.574974+0000 mgr.smithi008.flmjzp (mgr.14640) 3449 : cluster [DBG] pgmap v2371: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:25.206 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:24.605241+0000 mon.smithi008 (mon.0) 3804 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:25.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:24.605241+0000 mon.smithi008 (mon.0) 3804 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:26.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:24.575756+0000 mgr.smithi008.flmjzp (mgr.14640) 3450 : cluster [DBG] pgmap v2372: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:26.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:25.174865+0000 mon.smithi008 (mon.0) 3805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:26.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:25.175692+0000 mon.smithi008 (mon.0) 3806 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:26.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:25.176356+0000 mgr.smithi008.flmjzp (mgr.14640) 3451 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:26.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:25.176862+0000 mgr.smithi008.flmjzp (mgr.14640) 3452 : cluster [DBG] pgmap v2373: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:26.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:25.177101+0000 mgr.smithi008.flmjzp (mgr.14640) 3453 : cluster [DBG] pgmap v2374: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:26.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:25.181062+0000 mon.smithi008 (mon.0) 3807 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:26.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:25.186132+0000 mon.smithi008 (mon.0) 3808 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:26.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:25.188539+0000 mon.smithi008 (mon.0) 3809 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:26.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:25.189825+0000 mon.smithi008 (mon.0) 3810 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:26.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:25.191089+0000 mon.smithi008 (mon.0) 3811 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:26.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:25.192675+0000 mon.smithi008 (mon.0) 3812 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:26.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:25.194232+0000 mgr.smithi008.flmjzp (mgr.14640) 3454 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:24.575756+0000 mgr.smithi008.flmjzp (mgr.14640) 3450 : cluster [DBG] pgmap v2372: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:25.174865+0000 mon.smithi008 (mon.0) 3805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:25.175692+0000 mon.smithi008 (mon.0) 3806 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:25.176356+0000 mgr.smithi008.flmjzp (mgr.14640) 3451 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:25.176862+0000 mgr.smithi008.flmjzp (mgr.14640) 3452 : cluster [DBG] pgmap v2373: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:25.177101+0000 mgr.smithi008.flmjzp (mgr.14640) 3453 : cluster [DBG] pgmap v2374: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:25.181062+0000 mon.smithi008 (mon.0) 3807 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:25.186132+0000 mon.smithi008 (mon.0) 3808 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:25.188539+0000 mon.smithi008 (mon.0) 3809 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:25.189825+0000 mon.smithi008 (mon.0) 3810 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:26.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:25.191089+0000 mon.smithi008 (mon.0) 3811 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:26.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:25.192675+0000 mon.smithi008 (mon.0) 3812 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:26.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:25.194232+0000 mgr.smithi008.flmjzp (mgr.14640) 3454 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:27.177718+0000 mgr.smithi008.flmjzp (mgr.14640) 3455 : cluster [DBG] pgmap v2375: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:27.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:27.177718+0000 mgr.smithi008.flmjzp (mgr.14640) 3455 : cluster [DBG] pgmap v2375: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:29.178268+0000 mgr.smithi008.flmjzp (mgr.14640) 3456 : cluster [DBG] pgmap v2376: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:29.178268+0000 mgr.smithi008.flmjzp (mgr.14640) 3456 : cluster [DBG] pgmap v2376: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:31.178820+0000 mgr.smithi008.flmjzp (mgr.14640) 3457 : cluster [DBG] pgmap v2377: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:31.178820+0000 mgr.smithi008.flmjzp (mgr.14640) 3457 : cluster [DBG] pgmap v2377: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:33.179491+0000 mgr.smithi008.flmjzp (mgr.14640) 3458 : cluster [DBG] pgmap v2378: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:33.179491+0000 mgr.smithi008.flmjzp (mgr.14640) 3458 : cluster [DBG] pgmap v2378: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:35.180221+0000 mgr.smithi008.flmjzp (mgr.14640) 3459 : cluster [DBG] pgmap v2379: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:35.202147+0000 mon.smithi008 (mon.0) 3813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:35.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:35.204382+0000 mon.smithi008 (mon.0) 3814 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:35.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:35.205468+0000 mon.smithi008 (mon.0) 3815 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:35.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:35.206702+0000 mgr.smithi008.flmjzp (mgr.14640) 3460 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:35.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:35.207535+0000 mgr.smithi008.flmjzp (mgr.14640) 3461 : cluster [DBG] pgmap v2380: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:35.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:35.207881+0000 mgr.smithi008.flmjzp (mgr.14640) 3462 : cluster [DBG] pgmap v2381: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:35.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:35.213361+0000 mon.smithi008 (mon.0) 3816 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:35.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:35.219777+0000 mon.smithi008 (mon.0) 3817 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:35.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:35.223251+0000 mon.smithi008 (mon.0) 3818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:35.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:35.224979+0000 mon.smithi008 (mon.0) 3819 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:35.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:35.226633+0000 mon.smithi008 (mon.0) 3820 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:35.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:35.228735+0000 mon.smithi008 (mon.0) 3821 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:35.180221+0000 mgr.smithi008.flmjzp (mgr.14640) 3459 : cluster [DBG] pgmap v2379: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:35.202147+0000 mon.smithi008 (mon.0) 3813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:35.204382+0000 mon.smithi008 (mon.0) 3814 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:35.205468+0000 mon.smithi008 (mon.0) 3815 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:35.206702+0000 mgr.smithi008.flmjzp (mgr.14640) 3460 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:35.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:35.207535+0000 mgr.smithi008.flmjzp (mgr.14640) 3461 : cluster [DBG] pgmap v2380: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:35.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:35.207881+0000 mgr.smithi008.flmjzp (mgr.14640) 3462 : cluster [DBG] pgmap v2381: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:35.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:35.213361+0000 mon.smithi008 (mon.0) 3816 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:35.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:35.219777+0000 mon.smithi008 (mon.0) 3817 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:35.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:35.223251+0000 mon.smithi008 (mon.0) 3818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:35.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:35.224979+0000 mon.smithi008 (mon.0) 3819 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:35.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:35.226633+0000 mon.smithi008 (mon.0) 3820 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:35.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:35.228735+0000 mon.smithi008 (mon.0) 3821 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:35.230724+0000 mgr.smithi008.flmjzp (mgr.14640) 3463 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:35.230724+0000 mgr.smithi008.flmjzp (mgr.14640) 3463 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:37.208522+0000 mgr.smithi008.flmjzp (mgr.14640) 3464 : cluster [DBG] pgmap v2382: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:38.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:37.208522+0000 mgr.smithi008.flmjzp (mgr.14640) 3464 : cluster [DBG] pgmap v2382: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:39.209221+0000 mgr.smithi008.flmjzp (mgr.14640) 3465 : cluster [DBG] pgmap v2383: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:39.209221+0000 mgr.smithi008.flmjzp (mgr.14640) 3465 : cluster [DBG] pgmap v2383: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.347+0000 7f89031d0700 1 -- 172.21.15.8:0/1052461968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88fc0f6530 msgr2=0x7f88fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.347+0000 7f89031d0700 1 --2- 172.21.15.8:0/1052461968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88fc0f6530 0x7f88fc0f6950 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f88f8004660 tx=0x7f88f8009b30).stop 2023-10-18T21:56:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.347+0000 7f89031d0700 1 -- 172.21.15.8:0/1052461968 shutdown_connections 2023-10-18T21:56:41.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.347+0000 7f89031d0700 1 --2- 172.21.15.8:0/1052461968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc0f77d0 0x7f88fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.347+0000 7f89031d0700 1 --2- 172.21.15.8:0/1052461968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88fc0f6530 0x7f88fc0f6950 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.347+0000 7f89031d0700 1 -- 172.21.15.8:0/1052461968 >> 172.21.15.8:0/1052461968 conn(0x7f88fc0f1c90 msgr2=0x7f88fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:41.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.347+0000 7f89031d0700 1 -- 172.21.15.8:0/1052461968 shutdown_connections 2023-10-18T21:56:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.347+0000 7f89031d0700 1 -- 172.21.15.8:0/1052461968 wait complete. 2023-10-18T21:56:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.348+0000 7f89031d0700 1 Processor -- start 2023-10-18T21:56:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.348+0000 7f89031d0700 1 -- start start 2023-10-18T21:56:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89031d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88fc0f6530 0x7f88fc108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89031d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc0f77d0 0x7f88fc109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89031d0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc109a00 con 0x7f88fc0f6530 2023-10-18T21:56:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89031d0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc109b40 con 0x7f88fc0f77d0 2023-10-18T21:56:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89021ce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88fc0f6530 0x7f88fc108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89021ce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88fc0f6530 0x7f88fc108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38384/0 (socket says 172.21.15.8:38384) 2023-10-18T21:56:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89021ce700 1 -- 172.21.15.8:0/670648921 learned_addr learned my addr 172.21.15.8:0/670648921 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89019cd700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc0f77d0 0x7f88fc109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89021ce700 1 -- 172.21.15.8:0/670648921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc0f77d0 msgr2=0x7f88fc109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89021ce700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc0f77d0 0x7f88fc109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89021ce700 1 -- 172.21.15.8:0/670648921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f8005040 con 0x7f88fc0f6530 2023-10-18T21:56:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.349+0000 7f89019cd700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc0f77d0 0x7f88fc109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:56:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.350+0000 7f89021ce700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88fc0f6530 0x7f88fc108f60 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f88f8014040 tx=0x7f88f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.350+0000 7f88f2ffd700 1 -- 172.21.15.8:0/670648921 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88f8019070 con 0x7f88fc0f6530 2023-10-18T21:56:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.350+0000 7f88f2ffd700 1 -- 172.21.15.8:0/670648921 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f88f801e420 con 0x7f88fc0f6530 2023-10-18T21:56:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.350+0000 7f89031d0700 1 -- 172.21.15.8:0/670648921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88fc10a480 con 0x7f88fc0f6530 2023-10-18T21:56:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.350+0000 7f88f2ffd700 1 -- 172.21.15.8:0/670648921 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88f8014660 con 0x7f88fc0f6530 2023-10-18T21:56:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.350+0000 7f89031d0700 1 -- 172.21.15.8:0/670648921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88fc10a960 con 0x7f88fc0f6530 2023-10-18T21:56:41.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.351+0000 7f89031d0700 1 -- 172.21.15.8:0/670648921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88fc045ad0 con 0x7f88fc0f6530 2023-10-18T21:56:41.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.352+0000 7f88f2ffd700 1 -- 172.21.15.8:0/670648921 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f88f801e9e0 con 0x7f88fc0f6530 2023-10-18T21:56:41.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.353+0000 7f88f2ffd700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88e8060f70 0x7f88e8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:41.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.353+0000 7f88f2ffd700 1 -- 172.21.15.8:0/670648921 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f88f807dd00 con 0x7f88fc0f6530 2023-10-18T21:56:41.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.353+0000 7f89019cd700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88e8060f70 0x7f88e8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.354+0000 7f89019cd700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88e8060f70 0x7f88e8063430 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f88ec007fc0 tx=0x7f88ec00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.357+0000 7f88f2ffd700 1 -- 172.21.15.8:0/670648921 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f88f8081030 con 0x7f88fc0f6530 2023-10-18T21:56:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.555+0000 7f89031d0700 1 -- 172.21.15.8:0/670648921 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88fc0fee00 con 0x7f88e8060f70 2023-10-18T21:56:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.556+0000 7f88f2ffd700 1 -- 172.21.15.8:0/670648921 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f88fc0fee00 con 0x7f88e8060f70 2023-10-18T21:56:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 -- 172.21.15.8:0/670648921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88e8060f70 msgr2=0x7f88e8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88e8060f70 0x7f88e8063430 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f88ec007fc0 tx=0x7f88ec00b040).stop 2023-10-18T21:56:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 -- 172.21.15.8:0/670648921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88fc0f6530 msgr2=0x7f88fc108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:41.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88fc0f6530 0x7f88fc108f60 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f88f8014040 tx=0x7f88f800b040).stop 2023-10-18T21:56:41.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 -- 172.21.15.8:0/670648921 shutdown_connections 2023-10-18T21:56:41.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88e8060f70 0x7f88e8063430 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88fc0f6530 0x7f88fc108f60 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 --2- 172.21.15.8:0/670648921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc0f77d0 0x7f88fc109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 -- 172.21.15.8:0/670648921 >> 172.21.15.8:0/670648921 conn(0x7f88fc0f1c90 msgr2=0x7f88fc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:41.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 -- 172.21.15.8:0/670648921 shutdown_connections 2023-10-18T21:56:41.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.558+0000 7f89031d0700 1 -- 172.21.15.8:0/670648921 wait complete. 2023-10-18T21:56:41.574 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:56:41.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.695+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2492050478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e00f6530 msgr2=0x7fc5e00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:41.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.695+0000 7fc5e4a00700 1 --2- 172.21.15.8:0/2492050478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e00f6530 0x7fc5e00f6950 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7fc5d0004660 tx=0x7fc5d0009b30).stop 2023-10-18T21:56:41.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.695+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2492050478 shutdown_connections 2023-10-18T21:56:41.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.695+0000 7fc5e4a00700 1 --2- 172.21.15.8:0/2492050478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e00f77d0 0x7fc5e00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.695+0000 7fc5e4a00700 1 --2- 172.21.15.8:0/2492050478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e00f6530 0x7fc5e00f6950 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.695+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2492050478 >> 172.21.15.8:0/2492050478 conn(0x7fc5e00f1c90 msgr2=0x7fc5e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.695+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2492050478 shutdown_connections 2023-10-18T21:56:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.695+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2492050478 wait complete. 2023-10-18T21:56:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.696+0000 7fc5e4a00700 1 Processor -- start 2023-10-18T21:56:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.696+0000 7fc5e4a00700 1 -- start start 2023-10-18T21:56:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.696+0000 7fc5e4a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e00f6530 0x7fc5e006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5e4a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e00f77d0 0x7fc5e0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5e4a00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e006a380 con 0x7fc5e00f6530 2023-10-18T21:56:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5e4a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e006a4c0 con 0x7fc5e00f77d0 2023-10-18T21:56:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e00f6530 0x7fc5e006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e00f6530 0x7fc5e006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38406/0 (socket says 172.21.15.8:38406) 2023-10-18T21:56:41.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5df7fe700 1 -- 172.21.15.8:0/2337880842 learned_addr learned my addr 172.21.15.8:0/2337880842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:41.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5deffd700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e00f77d0 0x7fc5e0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:41.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5df7fe700 1 -- 172.21.15.8:0/2337880842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e00f77d0 msgr2=0x7fc5e0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:41.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5df7fe700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e00f77d0 0x7fc5e0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5df7fe700 1 -- 172.21.15.8:0/2337880842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d0005040 con 0x7fc5e00f6530 2023-10-18T21:56:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5deffd700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e00f77d0 0x7fc5e0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:56:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.697+0000 7fc5df7fe700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e00f6530 0x7fc5e006b9a0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fc5d0009870 tx=0x7fc5d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.698+0000 7fc5c7fff700 1 -- 172.21.15.8:0/2337880842 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d0019070 con 0x7fc5e00f6530 2023-10-18T21:56:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.698+0000 7fc5c7fff700 1 -- 172.21.15.8:0/2337880842 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc5d001e420 con 0x7fc5e00f6530 2023-10-18T21:56:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.698+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2337880842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e006a740 con 0x7fc5e00f6530 2023-10-18T21:56:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.698+0000 7fc5c7fff700 1 -- 172.21.15.8:0/2337880842 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d0014660 con 0x7fc5e00f6530 2023-10-18T21:56:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.698+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2337880842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e006ac20 con 0x7fc5e00f6530 2023-10-18T21:56:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.699+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2337880842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e0045ad0 con 0x7fc5e00f6530 2023-10-18T21:56:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.700+0000 7fc5c7fff700 1 -- 172.21.15.8:0/2337880842 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc5d001e9c0 con 0x7fc5e00f6530 2023-10-18T21:56:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.701+0000 7fc5c7fff700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5c8060f70 0x7fc5c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.701+0000 7fc5c7fff700 1 -- 172.21.15.8:0/2337880842 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc5d007dcc0 con 0x7fc5e00f6530 2023-10-18T21:56:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.701+0000 7fc5deffd700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5c8060f70 0x7fc5c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.702+0000 7fc5deffd700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5c8060f70 0x7fc5c8063430 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fc5d4009fd0 tx=0x7fc5d400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.705+0000 7fc5c7fff700 1 -- 172.21.15.8:0/2337880842 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc5d004d9b0 con 0x7fc5e00f6530 2023-10-18T21:56:41.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.908+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2337880842 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5e0057f10 con 0x7fc5c8060f70 2023-10-18T21:56:41.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.909+0000 7fc5c7fff700 1 -- 172.21.15.8:0/2337880842 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc5e0057f10 con 0x7fc5c8060f70 2023-10-18T21:56:41.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.911+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2337880842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5c8060f70 msgr2=0x7fc5c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:41.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.911+0000 7fc5e4a00700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5c8060f70 0x7fc5c8063430 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fc5d4009fd0 tx=0x7fc5d400b040).stop 2023-10-18T21:56:41.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.911+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2337880842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e00f6530 msgr2=0x7fc5e006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:41.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.911+0000 7fc5e4a00700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e00f6530 0x7fc5e006b9a0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fc5d0009870 tx=0x7fc5d000b040).stop 2023-10-18T21:56:41.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.911+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2337880842 shutdown_connections 2023-10-18T21:56:41.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.911+0000 7fc5e4a00700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5c8060f70 0x7fc5c8063430 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.911+0000 7fc5e4a00700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e00f6530 0x7fc5e006b9a0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.911+0000 7fc5e4a00700 1 --2- 172.21.15.8:0/2337880842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e00f77d0 0x7fc5e0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:41.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.911+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2337880842 >> 172.21.15.8:0/2337880842 conn(0x7fc5e00f1c90 msgr2=0x7fc5e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.911+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2337880842 shutdown_connections 2023-10-18T21:56:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:41.912+0000 7fc5e4a00700 1 -- 172.21.15.8:0/2337880842 wait complete. 2023-10-18T21:56:42.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.048+0000 7f7755294700 1 -- 172.21.15.8:0/606520313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500f6530 msgr2=0x7f77500f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.048+0000 7f7755294700 1 --2- 172.21.15.8:0/606520313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500f6530 0x7f77500f6950 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f7740004660 tx=0x7f7740009b30).stop 2023-10-18T21:56:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.048+0000 7f7755294700 1 -- 172.21.15.8:0/606520313 shutdown_connections 2023-10-18T21:56:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.048+0000 7f7755294700 1 --2- 172.21.15.8:0/606520313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77500f77d0 0x7f77500f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.048+0000 7f7755294700 1 --2- 172.21.15.8:0/606520313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500f6530 0x7f77500f6950 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.048+0000 7f7755294700 1 -- 172.21.15.8:0/606520313 >> 172.21.15.8:0/606520313 conn(0x7f77500f1c90 msgr2=0x7f77500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.048+0000 7f7755294700 1 -- 172.21.15.8:0/606520313 shutdown_connections 2023-10-18T21:56:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.048+0000 7f7755294700 1 -- 172.21.15.8:0/606520313 wait complete. 2023-10-18T21:56:42.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.049+0000 7f7755294700 1 Processor -- start 2023-10-18T21:56:42.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.049+0000 7f7755294700 1 -- start start 2023-10-18T21:56:42.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.049+0000 7f7755294700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500f6530 0x7f7750106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:42.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.049+0000 7f7755294700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77500f77d0 0x7f7750107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:42.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.049+0000 7f7755294700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7750107880 con 0x7f77500f6530 2023-10-18T21:56:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.049+0000 7f7755294700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77501080c0 con 0x7f77500f77d0 2023-10-18T21:56:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.050+0000 7f774ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500f6530 0x7f7750106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.050+0000 7f774ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500f6530 0x7f7750106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38424/0 (socket says 172.21.15.8:38424) 2023-10-18T21:56:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.050+0000 7f774ffff700 1 -- 172.21.15.8:0/2122928185 learned_addr learned my addr 172.21.15.8:0/2122928185 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.050+0000 7f774f7fe700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77500f77d0 0x7f7750107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.050+0000 7f774ffff700 1 -- 172.21.15.8:0/2122928185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77500f77d0 msgr2=0x7f7750107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.050+0000 7f774ffff700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77500f77d0 0x7f7750107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.050+0000 7f774ffff700 1 -- 172.21.15.8:0/2122928185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7740005040 con 0x7f77500f6530 2023-10-18T21:56:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.050+0000 7f774ffff700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500f6530 0x7f7750106d90 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f7740014040 tx=0x7f774000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.051+0000 7f774cff9700 1 -- 172.21.15.8:0/2122928185 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7740019070 con 0x7f77500f6530 2023-10-18T21:56:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.051+0000 7f774cff9700 1 -- 172.21.15.8:0/2122928185 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f774001e420 con 0x7f77500f6530 2023-10-18T21:56:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.051+0000 7f7755294700 1 -- 172.21.15.8:0/2122928185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7750108340 con 0x7f77500f6530 2023-10-18T21:56:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.051+0000 7f774cff9700 1 -- 172.21.15.8:0/2122928185 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7740014620 con 0x7f77500f6530 2023-10-18T21:56:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.051+0000 7f7755294700 1 -- 172.21.15.8:0/2122928185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7750108820 con 0x7f77500f6530 2023-10-18T21:56:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.052+0000 7f7755294700 1 -- 172.21.15.8:0/2122928185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7750059100 con 0x7f77500f6530 2023-10-18T21:56:42.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.053+0000 7f774cff9700 1 -- 172.21.15.8:0/2122928185 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f774001e9e0 con 0x7f77500f6530 2023-10-18T21:56:42.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.053+0000 7f774cff9700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7738060f70 0x7f7738063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:42.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.054+0000 7f774cff9700 1 -- 172.21.15.8:0/2122928185 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f774007dcc0 con 0x7f77500f6530 2023-10-18T21:56:42.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.054+0000 7f774f7fe700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7738060f70 0x7f7738063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:42.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.054+0000 7f774f7fe700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7738060f70 0x7f7738063430 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f7750106b20 tx=0x7f774400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.058+0000 7f774cff9700 1 -- 172.21.15.8:0/2122928185 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7740083020 con 0x7f77500f6530 2023-10-18T21:56:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:41.209932+0000 mgr.smithi008.flmjzp (mgr.14640) 3466 : cluster [DBG] pgmap v2384: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:41.209932+0000 mgr.smithi008.flmjzp (mgr.14640) 3466 : cluster [DBG] pgmap v2384: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:42.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.252+0000 7f7755294700 1 -- 172.21.15.8:0/2122928185 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f77500fedd0 con 0x7f7738060f70 2023-10-18T21:56:42.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.262+0000 7f774cff9700 1 -- 172.21.15.8:0/2122928185 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f77500fedd0 con 0x7f7738060f70 2023-10-18T21:56:42.264 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:56:42.264 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (63m) 47s ago 64m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:56:42.264 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (57m) 47s ago 64m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:56:42.265 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (57m) 8m ago 63m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:56:42.265 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (63m) 47s ago 64m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:56:42.265 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 47s ago 60m - - 2023-10-18T21:56:42.265 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 47s ago 60m - - 2023-10-18T21:56:42.265 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 60m - - 2023-10-18T21:56:42.265 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 60m - - 2023-10-18T21:56:42.266 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (58m) 47s ago 66m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:56:42.266 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (57m) 8m ago 63m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:56:42.266 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (57m) 47s ago 66m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:56:42.266 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (57m) 8m ago 63m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:56:42.267 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (64m) 47s ago 64m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:56:42.267 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (63m) 8m ago 63m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:56:42.267 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (56m) 47s ago 63m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:56:42.267 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (54m) 47s ago 63m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:56:42.267 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (54m) 47s ago 62m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:56:42.268 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (53m) 8m ago 62m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:56:42.268 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (53m) 8m ago 62m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:56:42.268 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (52m) 8m ago 61m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:56:42.268 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (58m) 47s ago 64m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:56:42.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 -- 172.21.15.8:0/2122928185 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7738060f70 msgr2=0x7f7738063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:42.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7738060f70 0x7f7738063430 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f7750106b20 tx=0x7f774400b040).stop 2023-10-18T21:56:42.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 -- 172.21.15.8:0/2122928185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500f6530 msgr2=0x7f7750106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:42.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500f6530 0x7f7750106d90 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f7740014040 tx=0x7f774000b040).stop 2023-10-18T21:56:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 -- 172.21.15.8:0/2122928185 shutdown_connections 2023-10-18T21:56:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7738060f70 0x7f7738063430 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500f6530 0x7f7750106d90 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 --2- 172.21.15.8:0/2122928185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77500f77d0 0x7f7750107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 -- 172.21.15.8:0/2122928185 >> 172.21.15.8:0/2122928185 conn(0x7f77500f1c90 msgr2=0x7f77500fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:42.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 -- 172.21.15.8:0/2122928185 shutdown_connections 2023-10-18T21:56:42.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.264+0000 7f7755294700 1 -- 172.21.15.8:0/2122928185 wait complete. 2023-10-18T21:56:42.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.399+0000 7f5f1ce74700 1 -- 172.21.15.8:0/618184758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180f77d0 msgr2=0x7f5f180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:42.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.399+0000 7f5f1ce74700 1 --2- 172.21.15.8:0/618184758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180f77d0 0x7f5f180f7c30 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f5f0c004660 tx=0x7f5f0c009b30).stop 2023-10-18T21:56:42.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.399+0000 7f5f1ce74700 1 -- 172.21.15.8:0/618184758 shutdown_connections 2023-10-18T21:56:42.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.399+0000 7f5f1ce74700 1 --2- 172.21.15.8:0/618184758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180f77d0 0x7f5f180f7c30 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.399+0000 7f5f1ce74700 1 --2- 172.21.15.8:0/618184758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f180f6530 0x7f5f180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.399+0000 7f5f1ce74700 1 -- 172.21.15.8:0/618184758 >> 172.21.15.8:0/618184758 conn(0x7f5f180f1c90 msgr2=0x7f5f180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:42.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.399+0000 7f5f1ce74700 1 -- 172.21.15.8:0/618184758 shutdown_connections 2023-10-18T21:56:42.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.399+0000 7f5f1ce74700 1 -- 172.21.15.8:0/618184758 wait complete. 2023-10-18T21:56:42.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.400+0000 7f5f1ce74700 1 Processor -- start 2023-10-18T21:56:42.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.400+0000 7f5f1ce74700 1 -- start start 2023-10-18T21:56:42.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.400+0000 7f5f1ce74700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f180f6530 0x7f5f18109120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:42.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.400+0000 7f5f1ce74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f18109610 0x7f5f1810a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:42.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.400+0000 7f5f1ce74700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18109ae0 con 0x7f5f18109610 2023-10-18T21:56:42.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.401+0000 7f5f1ce74700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18109c20 con 0x7f5f180f6530 2023-10-18T21:56:42.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.401+0000 7f5f16ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f18109610 0x7f5f1810a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:42.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.401+0000 7f5f16ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f18109610 0x7f5f1810a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38432/0 (socket says 172.21.15.8:38432) 2023-10-18T21:56:42.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.401+0000 7f5f16ffd700 1 -- 172.21.15.8:0/4199213993 learned_addr learned my addr 172.21.15.8:0/4199213993 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:42.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.401+0000 7f5f177fe700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f180f6530 0x7f5f18109120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:42.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.401+0000 7f5f16ffd700 1 -- 172.21.15.8:0/4199213993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f180f6530 msgr2=0x7f5f18109120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:42.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.401+0000 7f5f16ffd700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f180f6530 0x7f5f18109120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.401+0000 7f5f16ffd700 1 -- 172.21.15.8:0/4199213993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c005040 con 0x7f5f18109610 2023-10-18T21:56:42.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.401+0000 7f5f16ffd700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f18109610 0x7f5f1810a500 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f5f0c009f50 tx=0x7f5f0c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:42.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.402+0000 7f5efffff700 1 -- 172.21.15.8:0/4199213993 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f0c019070 con 0x7f5f18109610 2023-10-18T21:56:42.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.402+0000 7f5efffff700 1 -- 172.21.15.8:0/4199213993 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5f0c009630 con 0x7f5f18109610 2023-10-18T21:56:42.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.402+0000 7f5f1ce74700 1 -- 172.21.15.8:0/4199213993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1810aa50 con 0x7f5f18109610 2023-10-18T21:56:42.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.402+0000 7f5efffff700 1 -- 172.21.15.8:0/4199213993 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f0c0145b0 con 0x7f5f18109610 2023-10-18T21:56:42.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.402+0000 7f5f1ce74700 1 -- 172.21.15.8:0/4199213993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1810af20 con 0x7f5f18109610 2023-10-18T21:56:42.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.403+0000 7f5f1ce74700 1 -- 172.21.15.8:0/4199213993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f18045ad0 con 0x7f5f18109610 2023-10-18T21:56:42.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.404+0000 7f5efffff700 1 -- 172.21.15.8:0/4199213993 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5f0c014710 con 0x7f5f18109610 2023-10-18T21:56:42.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.405+0000 7f5efffff700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f00060f70 0x7f5f00063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:42.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.405+0000 7f5efffff700 1 -- 172.21.15.8:0/4199213993 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5f0c07dd60 con 0x7f5f18109610 2023-10-18T21:56:42.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.405+0000 7f5f177fe700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f00060f70 0x7f5f00063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:42.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.405+0000 7f5f177fe700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f00060f70 0x7f5f00063430 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f5f180f7630 tx=0x7f5f0800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:42.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.409+0000 7f5efffff700 1 -- 172.21.15.8:0/4199213993 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5f0c082070 con 0x7f5f18109610 2023-10-18T21:56:42.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.660+0000 7f5f1ce74700 1 -- 172.21.15.8:0/4199213993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5f180feda0 con 0x7f5f18109610 2023-10-18T21:56:42.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.661+0000 7f5efffff700 1 -- 172.21.15.8:0/4199213993 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5f0c051340 con 0x7f5f18109610 2023-10-18T21:56:42.664 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:56:42.664 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:56:42.664 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:56:42.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:56:42.664 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:56:42.665 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:56:42.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:56:42.665 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:56:42.665 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:56:42.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:56:42.666 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:56:42.666 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:56:42.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:56:42.666 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:56:42.666 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:56:42.667 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:56:42.667 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:56:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 -- 172.21.15.8:0/4199213993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f00060f70 msgr2=0x7f5f00063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f00060f70 0x7f5f00063430 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f5f180f7630 tx=0x7f5f0800b040).stop 2023-10-18T21:56:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 -- 172.21.15.8:0/4199213993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f18109610 msgr2=0x7f5f1810a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f18109610 0x7f5f1810a500 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f5f0c009f50 tx=0x7f5f0c009b30).stop 2023-10-18T21:56:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 -- 172.21.15.8:0/4199213993 shutdown_connections 2023-10-18T21:56:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f00060f70 0x7f5f00063430 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f180f6530 0x7f5f18109120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 --2- 172.21.15.8:0/4199213993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f18109610 0x7f5f1810a500 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 -- 172.21.15.8:0/4199213993 >> 172.21.15.8:0/4199213993 conn(0x7f5f180f1c90 msgr2=0x7f5f1806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 -- 172.21.15.8:0/4199213993 shutdown_connections 2023-10-18T21:56:42.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.663+0000 7f5f1ce74700 1 -- 172.21.15.8:0/4199213993 wait complete. 2023-10-18T21:56:42.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.800+0000 7fb81bfff700 1 -- 172.21.15.8:0/601669919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81c0f6530 msgr2=0x7fb81c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.800+0000 7fb81bfff700 1 --2- 172.21.15.8:0/601669919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81c0f6530 0x7fb81c0f6950 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fb80c004660 tx=0x7fb80c009b30).stop 2023-10-18T21:56:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.800+0000 7fb81bfff700 1 -- 172.21.15.8:0/601669919 shutdown_connections 2023-10-18T21:56:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.800+0000 7fb81bfff700 1 --2- 172.21.15.8:0/601669919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb81c0f77d0 0x7fb81c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.800+0000 7fb81bfff700 1 --2- 172.21.15.8:0/601669919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81c0f6530 0x7fb81c0f6950 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:42.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.800+0000 7fb81bfff700 1 -- 172.21.15.8:0/601669919 >> 172.21.15.8:0/601669919 conn(0x7fb81c0f1c90 msgr2=0x7fb81c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:42.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.800+0000 7fb81bfff700 1 -- 172.21.15.8:0/601669919 shutdown_connections 2023-10-18T21:56:42.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.800+0000 7fb81bfff700 1 -- 172.21.15.8:0/601669919 wait complete. 2023-10-18T21:56:42.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.801+0000 7fb81bfff700 1 Processor -- start 2023-10-18T21:56:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.802+0000 7fb81bfff700 1 -- start start 2023-10-18T21:56:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.802+0000 7fb81bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81c0f6530 0x7fb81c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.802+0000 7fb81bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb81c0f77d0 0x7fb81c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.802+0000 7fb81bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c06a380 con 0x7fb81c0f6530 2023-10-18T21:56:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.802+0000 7fb81bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c06a4c0 con 0x7fb81c0f77d0 2023-10-18T21:56:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.802+0000 7fb81affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81c0f6530 0x7fb81c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.803+0000 7fb81affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81c0f6530 0x7fb81c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38452/0 (socket says 172.21.15.8:38452) 2023-10-18T21:56:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.803+0000 7fb81affd700 1 -- 172.21.15.8:0/527098192 learned_addr learned my addr 172.21.15.8:0/527098192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.803+0000 7fb81affd700 1 -- 172.21.15.8:0/527098192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb81c0f77d0 msgr2=0x7fb81c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:42.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.803+0000 7fb81affd700 1 --2- 172.21.15.8:0/527098192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb81c0f77d0 0x7fb81c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:56:42.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.803+0000 7fb81affd700 1 -- 172.21.15.8:0/527098192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c005040 con 0x7fb81c0f6530 2023-10-18T21:56:42.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.803+0000 7fb81affd700 1 --2- 172.21.15.8:0/527098192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81c0f6530 0x7fb81c06b9a0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fb80c007a60 tx=0x7fb80c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:42.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.803+0000 7fb8037fe700 1 -- 172.21.15.8:0/527098192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb80c018070 con 0x7fb81c0f6530 2023-10-18T21:56:42.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.803+0000 7fb8037fe700 1 -- 172.21.15.8:0/527098192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb80c009630 con 0x7fb81c0f6530 2023-10-18T21:56:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.803+0000 7fb81bfff700 1 -- 172.21.15.8:0/527098192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81c06a740 con 0x7fb81c0f6530 2023-10-18T21:56:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.803+0000 7fb8037fe700 1 -- 172.21.15.8:0/527098192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb80c01c540 con 0x7fb81c0f6530 2023-10-18T21:56:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.804+0000 7fb81bfff700 1 -- 172.21.15.8:0/527098192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81c06aca0 con 0x7fb81c0f6530 2023-10-18T21:56:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.805+0000 7fb81bfff700 1 -- 172.21.15.8:0/527098192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81c045ad0 con 0x7fb81c0f6530 2023-10-18T21:56:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.805+0000 7fb8037fe700 1 -- 172.21.15.8:0/527098192 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb80c01c7b0 con 0x7fb81c0f6530 2023-10-18T21:56:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.806+0000 7fb8037fe700 1 --2- 172.21.15.8:0/527098192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb804060f70 0x7fb804063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.806+0000 7fb8037fe700 1 -- 172.21.15.8:0/527098192 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb80c07e720 con 0x7fb81c0f6530 2023-10-18T21:56:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.807+0000 7fb81a7fc700 1 --2- 172.21.15.8:0/527098192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb804060f70 0x7fb804063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.807+0000 7fb81a7fc700 1 --2- 172.21.15.8:0/527098192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb804060f70 0x7fb804063430 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7fb810004bd0 tx=0x7fb810009b10).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:42.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:42.811+0000 7fb8037fe700 1 -- 172.21.15.8:0/527098192 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb80c04e310 con 0x7fb81c0f6530 2023-10-18T21:56:43.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.038+0000 7fb81bfff700 1 -- 172.21.15.8:0/527098192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb81c0fed90 con 0x7fb81c0f6530 2023-10-18T21:56:43.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.038+0000 7fb8037fe700 1 -- 172.21.15.8:0/527098192 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fb80c051930 con 0x7fb81c0f6530 2023-10-18T21:56:43.041 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:56:43.041 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:56:43.041 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:56:43.042 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:56:43.042 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:56:43.042 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:56:43.042 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:56:43.042 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:56:43.043 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:56:43.043 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:56:43.043 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:56:43.043 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:56:43.043 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:56:43.044 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:56:43.044 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:56:43.044 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:56:43.044 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:56:43.044 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:56:43.045 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:56:43.045 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:56:43.045 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:56:43.045 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:56:43.045 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:56:43.046 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:56:43.046 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:56:43.046 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:56:43.046 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:56:43.046 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:56:43.047 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:56:43.047 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:56:43.047 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:56:43.047 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:56:43.047 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:56:43.047 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:56:43.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 -- 172.21.15.8:0/527098192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb804060f70 msgr2=0x7fb804063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 --2- 172.21.15.8:0/527098192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb804060f70 0x7fb804063430 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7fb810004bd0 tx=0x7fb810009b10).stop 2023-10-18T21:56:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 -- 172.21.15.8:0/527098192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81c0f6530 msgr2=0x7fb81c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 --2- 172.21.15.8:0/527098192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81c0f6530 0x7fb81c06b9a0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fb80c007a60 tx=0x7fb80c009b30).stop 2023-10-18T21:56:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 -- 172.21.15.8:0/527098192 shutdown_connections 2023-10-18T21:56:43.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 --2- 172.21.15.8:0/527098192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb804060f70 0x7fb804063430 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 --2- 172.21.15.8:0/527098192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb81c0f6530 0x7fb81c06b9a0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 --2- 172.21.15.8:0/527098192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb81c0f77d0 0x7fb81c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:56:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 -- 172.21.15.8:0/527098192 >> 172.21.15.8:0/527098192 conn(0x7fb81c0f1c90 msgr2=0x7fb81c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 -- 172.21.15.8:0/527098192 shutdown_connections 2023-10-18T21:56:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.040+0000 7fb81bfff700 1 -- 172.21.15.8:0/527098192 wait complete. 2023-10-18T21:56:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:56:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:41.557270+0000 mgr.smithi008.flmjzp (mgr.14640) 3467 : audit [DBG] from='client.36856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:41.910488+0000 mgr.smithi008.flmjzp (mgr.14640) 3468 : audit [DBG] from='client.36860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:43.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:42.662722+0000 mon.smithi008 (mon.0) 3822 : audit [DBG] from='client.? 172.21.15.8:0/4199213993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:43.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.178+0000 7f15c5353700 1 -- 172.21.15.8:0/3754692480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00f77d0 msgr2=0x7f15c00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:43.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.178+0000 7f15c5353700 1 --2- 172.21.15.8:0/3754692480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00f77d0 0x7f15c00f7c30 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f15b4004660 tx=0x7f15b4009b30).stop 2023-10-18T21:56:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.178+0000 7f15c5353700 1 -- 172.21.15.8:0/3754692480 shutdown_connections 2023-10-18T21:56:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.178+0000 7f15c5353700 1 --2- 172.21.15.8:0/3754692480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00f77d0 0x7f15c00f7c30 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.178+0000 7f15c5353700 1 --2- 172.21.15.8:0/3754692480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15c00f6530 0x7f15c00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.178+0000 7f15c5353700 1 -- 172.21.15.8:0/3754692480 >> 172.21.15.8:0/3754692480 conn(0x7f15c00f1c90 msgr2=0x7f15c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.178+0000 7f15c5353700 1 -- 172.21.15.8:0/3754692480 shutdown_connections 2023-10-18T21:56:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.178+0000 7f15c5353700 1 -- 172.21.15.8:0/3754692480 wait complete. 2023-10-18T21:56:43.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.179+0000 7f15c5353700 1 Processor -- start 2023-10-18T21:56:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.179+0000 7f15c5353700 1 -- start start 2023-10-18T21:56:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.180+0000 7f15c5353700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00f6530 0x7f15c0108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.180+0000 7f15c5353700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15c00f77d0 0x7f15c0109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.180+0000 7f15c5353700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0109a20 con 0x7f15c00f6530 2023-10-18T21:56:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.180+0000 7f15c5353700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0109b60 con 0x7f15c00f77d0 2023-10-18T21:56:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.180+0000 7f15bffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00f6530 0x7f15c0108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.180+0000 7f15bffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00f6530 0x7f15c0108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38470/0 (socket says 172.21.15.8:38470) 2023-10-18T21:56:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.180+0000 7f15bffff700 1 -- 172.21.15.8:0/1106370354 learned_addr learned my addr 172.21.15.8:0/1106370354 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:56:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.180+0000 7f15bf7fe700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15c00f77d0 0x7f15c0109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.180+0000 7f15bffff700 1 -- 172.21.15.8:0/1106370354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15c00f77d0 msgr2=0x7f15c0109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:43.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.180+0000 7f15bffff700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15c00f77d0 0x7f15c0109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:43.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.181+0000 7f15bffff700 1 -- 172.21.15.8:0/1106370354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4005040 con 0x7f15c00f6530 2023-10-18T21:56:43.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.181+0000 7f15bffff700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00f6530 0x7f15c0108f80 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f15b0002700 tx=0x7f15b0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:43.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.181+0000 7f15bcff9700 1 -- 172.21.15.8:0/1106370354 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15b00079c0 con 0x7f15c00f6530 2023-10-18T21:56:43.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.181+0000 7f15c5353700 1 -- 172.21.15.8:0/1106370354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c010a500 con 0x7f15c00f6530 2023-10-18T21:56:43.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.181+0000 7f15bcff9700 1 -- 172.21.15.8:0/1106370354 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f15b000f040 con 0x7f15c00f6530 2023-10-18T21:56:43.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.181+0000 7f15bcff9700 1 -- 172.21.15.8:0/1106370354 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15b00148d0 con 0x7f15c00f6530 2023-10-18T21:56:43.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.181+0000 7f15c5353700 1 -- 172.21.15.8:0/1106370354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c010aac0 con 0x7f15c00f6530 2023-10-18T21:56:43.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.182+0000 7f15c5353700 1 -- 172.21.15.8:0/1106370354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c0045ad0 con 0x7f15c00f6530 2023-10-18T21:56:43.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.183+0000 7f15bcff9700 1 -- 172.21.15.8:0/1106370354 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f15b001b060 con 0x7f15c00f6530 2023-10-18T21:56:43.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.184+0000 7f15bcff9700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15a8060f70 0x7f15a8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:56:43.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.184+0000 7f15bcff9700 1 -- 172.21.15.8:0/1106370354 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f15b007c7d0 con 0x7f15c00f6530 2023-10-18T21:56:43.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.184+0000 7f15bf7fe700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15a8060f70 0x7f15a8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:56:43.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.185+0000 7f15bf7fe700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15a8060f70 0x7f15a8063430 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f15b4004630 tx=0x7f15b4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:56:43.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.188+0000 7f15bcff9700 1 -- 172.21.15.8:0/1106370354 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f15b004fdb0 con 0x7f15c00f6530 2023-10-18T21:56:43.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:41.557270+0000 mgr.smithi008.flmjzp (mgr.14640) 3467 : audit [DBG] from='client.36856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:41.910488+0000 mgr.smithi008.flmjzp (mgr.14640) 3468 : audit [DBG] from='client.36860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:42.662722+0000 mon.smithi008 (mon.0) 3822 : audit [DBG] from='client.? 172.21.15.8:0/4199213993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:43.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.390+0000 7f15c5353700 1 -- 172.21.15.8:0/1106370354 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15c00fee00 con 0x7f15a8060f70 2023-10-18T21:56:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.391+0000 7f15bcff9700 1 -- 172.21.15.8:0/1106370354 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f15c00fee00 con 0x7f15a8060f70 2023-10-18T21:56:43.393 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:56:43.393 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:56:43.393 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:56:43.394 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:56:43.394 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:56:43.394 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:56:43.394 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:56:43.394 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:56:43.395 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:56:43.395 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:56:43.395 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:56:43.395 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:56:43.395 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:56:43.396 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:56:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 -- 172.21.15.8:0/1106370354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15a8060f70 msgr2=0x7f15a8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15a8060f70 0x7f15a8063430 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f15b4004630 tx=0x7f15b4009b30).stop 2023-10-18T21:56:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 -- 172.21.15.8:0/1106370354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00f6530 msgr2=0x7f15c0108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:56:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00f6530 0x7f15c0108f80 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f15b0002700 tx=0x7f15b0009d80).stop 2023-10-18T21:56:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 -- 172.21.15.8:0/1106370354 shutdown_connections 2023-10-18T21:56:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f15a8060f70 0x7f15a8063430 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00f6530 0x7f15c0108f80 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 --2- 172.21.15.8:0/1106370354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15c00f77d0 0x7f15c0109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:56:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 -- 172.21.15.8:0/1106370354 >> 172.21.15.8:0/1106370354 conn(0x7f15c00f1c90 msgr2=0x7f15c006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:56:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 -- 172.21.15.8:0/1106370354 shutdown_connections 2023-10-18T21:56:43.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:56:43.393+0000 7f15c5353700 1 -- 172.21.15.8:0/1106370354 wait complete. 2023-10-18T21:56:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:42.254806+0000 mgr.smithi008.flmjzp (mgr.14640) 3469 : audit [DBG] from='client.36864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:43.039937+0000 mon.smithi008 (mon.0) 3823 : audit [DBG] from='client.? 172.21.15.8:0/527098192' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:56:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:43.210336+0000 mgr.smithi008.flmjzp (mgr.14640) 3470 : cluster [DBG] pgmap v2385: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:44.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:42.254806+0000 mgr.smithi008.flmjzp (mgr.14640) 3469 : audit [DBG] from='client.36864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:43.039937+0000 mon.smithi008 (mon.0) 3823 : audit [DBG] from='client.? 172.21.15.8:0/527098192' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:56:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:43.210336+0000 mgr.smithi008.flmjzp (mgr.14640) 3470 : cluster [DBG] pgmap v2385: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:45.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:43.392245+0000 mgr.smithi008.flmjzp (mgr.14640) 3471 : audit [DBG] from='client.36876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:43.392245+0000 mgr.smithi008.flmjzp (mgr.14640) 3471 : audit [DBG] from='client.36876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:56:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:45.210958+0000 mgr.smithi008.flmjzp (mgr.14640) 3472 : cluster [DBG] pgmap v2386: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:46.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:45.241315+0000 mon.smithi008 (mon.0) 3824 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:46.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:45.799169+0000 mon.smithi008 (mon.0) 3825 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:46.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:45.800300+0000 mon.smithi008 (mon.0) 3826 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:46.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:45.807333+0000 mon.smithi008 (mon.0) 3827 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:46.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:45.814104+0000 mon.smithi008 (mon.0) 3828 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:46.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:45.817192+0000 mon.smithi008 (mon.0) 3829 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:46.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:45.818909+0000 mon.smithi008 (mon.0) 3830 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:46.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:45.820556+0000 mon.smithi008 (mon.0) 3831 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:46.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:45.822595+0000 mon.smithi008 (mon.0) 3832 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:46.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:45.210958+0000 mgr.smithi008.flmjzp (mgr.14640) 3472 : cluster [DBG] pgmap v2386: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:46.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:45.241315+0000 mon.smithi008 (mon.0) 3824 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:46.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:45.799169+0000 mon.smithi008 (mon.0) 3825 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:46.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:45.800300+0000 mon.smithi008 (mon.0) 3826 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:46.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:45.807333+0000 mon.smithi008 (mon.0) 3827 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:46.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:45.814104+0000 mon.smithi008 (mon.0) 3828 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:46.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:45.817192+0000 mon.smithi008 (mon.0) 3829 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:46.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:45.818909+0000 mon.smithi008 (mon.0) 3830 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:46.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:45.820556+0000 mon.smithi008 (mon.0) 3831 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:46.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:45.822595+0000 mon.smithi008 (mon.0) 3832 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:47.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:45.801185+0000 mgr.smithi008.flmjzp (mgr.14640) 3473 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:45.801948+0000 mgr.smithi008.flmjzp (mgr.14640) 3474 : cluster [DBG] pgmap v2387: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:45.802325+0000 mgr.smithi008.flmjzp (mgr.14640) 3475 : cluster [DBG] pgmap v2388: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:47.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:45.824563+0000 mgr.smithi008.flmjzp (mgr.14640) 3476 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:45.801185+0000 mgr.smithi008.flmjzp (mgr.14640) 3473 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:45.801948+0000 mgr.smithi008.flmjzp (mgr.14640) 3474 : cluster [DBG] pgmap v2387: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:45.802325+0000 mgr.smithi008.flmjzp (mgr.14640) 3475 : cluster [DBG] pgmap v2388: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:45.824563+0000 mgr.smithi008.flmjzp (mgr.14640) 3476 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:49.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:47.802831+0000 mgr.smithi008.flmjzp (mgr.14640) 3477 : cluster [DBG] pgmap v2389: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:47.802831+0000 mgr.smithi008.flmjzp (mgr.14640) 3477 : cluster [DBG] pgmap v2389: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:51.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:49.803315+0000 mgr.smithi008.flmjzp (mgr.14640) 3478 : cluster [DBG] pgmap v2390: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:51.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:49.803315+0000 mgr.smithi008.flmjzp (mgr.14640) 3478 : cluster [DBG] pgmap v2390: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:53.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:51.803798+0000 mgr.smithi008.flmjzp (mgr.14640) 3479 : cluster [DBG] pgmap v2391: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:53.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:51.803798+0000 mgr.smithi008.flmjzp (mgr.14640) 3479 : cluster [DBG] pgmap v2391: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:55.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:53.804556+0000 mgr.smithi008.flmjzp (mgr.14640) 3480 : cluster [DBG] pgmap v2392: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:55.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:53.804556+0000 mgr.smithi008.flmjzp (mgr.14640) 3480 : cluster [DBG] pgmap v2392: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:56.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:55.835325+0000 mon.smithi008 (mon.0) 3833 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:55.837556+0000 mon.smithi008 (mon.0) 3834 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:55.838521+0000 mon.smithi008 (mon.0) 3835 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:55.845254+0000 mon.smithi008 (mon.0) 3836 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:55.851755+0000 mon.smithi008 (mon.0) 3837 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:56.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:55.854822+0000 mon.smithi008 (mon.0) 3838 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:56.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:55.856520+0000 mon.smithi008 (mon.0) 3839 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:56.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:55.858217+0000 mon.smithi008 (mon.0) 3840 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:56.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:56:55.860250+0000 mon.smithi008 (mon.0) 3841 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:55.835325+0000 mon.smithi008 (mon.0) 3833 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:55.837556+0000 mon.smithi008 (mon.0) 3834 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:56:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:55.838521+0000 mon.smithi008 (mon.0) 3835 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:56:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:55.845254+0000 mon.smithi008 (mon.0) 3836 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:56:56.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:55.851755+0000 mon.smithi008 (mon.0) 3837 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:56:56.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:55.854822+0000 mon.smithi008 (mon.0) 3838 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:56.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:55.856520+0000 mon.smithi008 (mon.0) 3839 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:56.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:55.858217+0000 mon.smithi008 (mon.0) 3840 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:56.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:56:55.860250+0000 mon.smithi008 (mon.0) 3841 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:56:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:55.805158+0000 mgr.smithi008.flmjzp (mgr.14640) 3481 : cluster [DBG] pgmap v2393: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:57.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:55.839364+0000 mgr.smithi008.flmjzp (mgr.14640) 3482 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:55.839991+0000 mgr.smithi008.flmjzp (mgr.14640) 3483 : cluster [DBG] pgmap v2394: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:55.840303+0000 mgr.smithi008.flmjzp (mgr.14640) 3484 : cluster [DBG] pgmap v2395: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:57.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:56:55.863073+0000 mgr.smithi008.flmjzp (mgr.14640) 3485 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:55.805158+0000 mgr.smithi008.flmjzp (mgr.14640) 3481 : cluster [DBG] pgmap v2393: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:55.839364+0000 mgr.smithi008.flmjzp (mgr.14640) 3482 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:56:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:55.839991+0000 mgr.smithi008.flmjzp (mgr.14640) 3483 : cluster [DBG] pgmap v2394: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:55.840303+0000 mgr.smithi008.flmjzp (mgr.14640) 3484 : cluster [DBG] pgmap v2395: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:56:55.863073+0000 mgr.smithi008.flmjzp (mgr.14640) 3485 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:56:59.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:56:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:57.840968+0000 mgr.smithi008.flmjzp (mgr.14640) 3486 : cluster [DBG] pgmap v2396: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:56:59.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:56:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:57.840968+0000 mgr.smithi008.flmjzp (mgr.14640) 3486 : cluster [DBG] pgmap v2396: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:01.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:56:59.841757+0000 mgr.smithi008.flmjzp (mgr.14640) 3487 : cluster [DBG] pgmap v2397: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:01.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:56:59.841757+0000 mgr.smithi008.flmjzp (mgr.14640) 3487 : cluster [DBG] pgmap v2397: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:01.842261+0000 mgr.smithi008.flmjzp (mgr.14640) 3488 : cluster [DBG] pgmap v2398: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:03.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:01.842261+0000 mgr.smithi008.flmjzp (mgr.14640) 3488 : cluster [DBG] pgmap v2398: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:05.207 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:03.842843+0000 mgr.smithi008.flmjzp (mgr.14640) 3489 : cluster [DBG] pgmap v2399: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:03.842843+0000 mgr.smithi008.flmjzp (mgr.14640) 3489 : cluster [DBG] pgmap v2399: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:07.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:05.843535+0000 mgr.smithi008.flmjzp (mgr.14640) 3490 : cluster [DBG] pgmap v2400: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:07.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:05.873722+0000 mon.smithi008 (mon.0) 3842 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:07.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:05.875850+0000 mon.smithi008 (mon.0) 3843 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:57:07.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:05.876920+0000 mon.smithi008 (mon.0) 3844 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:57:07.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:05.877880+0000 mgr.smithi008.flmjzp (mgr.14640) 3491 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:57:07.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:05.878474+0000 mgr.smithi008.flmjzp (mgr.14640) 3492 : cluster [DBG] pgmap v2401: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:07.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:05.878769+0000 mgr.smithi008.flmjzp (mgr.14640) 3493 : cluster [DBG] pgmap v2402: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:07.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:05.883032+0000 mon.smithi008 (mon.0) 3845 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:57:07.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:05.890809+0000 mon.smithi008 (mon.0) 3846 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:07.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:05.894232+0000 mon.smithi008 (mon.0) 3847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:07.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:05.896230+0000 mon.smithi008 (mon.0) 3848 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:07.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:05.898147+0000 mon.smithi008 (mon.0) 3849 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:07.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:05.900655+0000 mon.smithi008 (mon.0) 3850 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:07.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:05.902639+0000 mgr.smithi008.flmjzp (mgr.14640) 3494 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:57:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:05.843535+0000 mgr.smithi008.flmjzp (mgr.14640) 3490 : cluster [DBG] pgmap v2400: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:05.873722+0000 mon.smithi008 (mon.0) 3842 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:05.875850+0000 mon.smithi008 (mon.0) 3843 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:57:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:05.876920+0000 mon.smithi008 (mon.0) 3844 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:57:07.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:05.877880+0000 mgr.smithi008.flmjzp (mgr.14640) 3491 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:57:07.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:05.878474+0000 mgr.smithi008.flmjzp (mgr.14640) 3492 : cluster [DBG] pgmap v2401: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:07.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:05.878769+0000 mgr.smithi008.flmjzp (mgr.14640) 3493 : cluster [DBG] pgmap v2402: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:07.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:05.883032+0000 mon.smithi008 (mon.0) 3845 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:57:07.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:05.890809+0000 mon.smithi008 (mon.0) 3846 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:07.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:05.894232+0000 mon.smithi008 (mon.0) 3847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:07.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:05.896230+0000 mon.smithi008 (mon.0) 3848 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:07.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:05.898147+0000 mon.smithi008 (mon.0) 3849 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:07.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:05.900655+0000 mon.smithi008 (mon.0) 3850 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:07.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:05.902639+0000 mgr.smithi008.flmjzp (mgr.14640) 3494 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:57:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:07.879511+0000 mgr.smithi008.flmjzp (mgr.14640) 3495 : cluster [DBG] pgmap v2403: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:07.879511+0000 mgr.smithi008.flmjzp (mgr.14640) 3495 : cluster [DBG] pgmap v2403: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:09.880223+0000 mgr.smithi008.flmjzp (mgr.14640) 3496 : cluster [DBG] pgmap v2404: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:09.880223+0000 mgr.smithi008.flmjzp (mgr.14640) 3496 : cluster [DBG] pgmap v2404: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:13.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:11.880757+0000 mgr.smithi008.flmjzp (mgr.14640) 3497 : cluster [DBG] pgmap v2405: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:11.880757+0000 mgr.smithi008.flmjzp (mgr.14640) 3497 : cluster [DBG] pgmap v2405: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:13.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.547+0000 7f909a247700 1 -- 172.21.15.8:0/3130693748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90940f6530 msgr2=0x7f90940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:13.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.547+0000 7f909a247700 1 --2- 172.21.15.8:0/3130693748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90940f6530 0x7f90940f6950 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f9090004660 tx=0x7f9090009b30).stop 2023-10-18T21:57:13.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.547+0000 7f909a247700 1 -- 172.21.15.8:0/3130693748 shutdown_connections 2023-10-18T21:57:13.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.547+0000 7f909a247700 1 --2- 172.21.15.8:0/3130693748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90940f77d0 0x7f90940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:13.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.547+0000 7f909a247700 1 --2- 172.21.15.8:0/3130693748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90940f6530 0x7f90940f6950 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.547+0000 7f909a247700 1 -- 172.21.15.8:0/3130693748 >> 172.21.15.8:0/3130693748 conn(0x7f90940f1c90 msgr2=0x7f90940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.547+0000 7f909a247700 1 -- 172.21.15.8:0/3130693748 shutdown_connections 2023-10-18T21:57:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.547+0000 7f909a247700 1 -- 172.21.15.8:0/3130693748 wait complete. 2023-10-18T21:57:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.548+0000 7f909a247700 1 Processor -- start 2023-10-18T21:57:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.548+0000 7f909a247700 1 -- start start 2023-10-18T21:57:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f909a247700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90940f6530 0x7f9094106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f909a247700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90940f77d0 0x7f9094107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:13.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f909a247700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9094107910 con 0x7f90940f6530 2023-10-18T21:57:13.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f909a247700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9094108120 con 0x7f90940f77d0 2023-10-18T21:57:13.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f9099245700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90940f6530 0x7f9094106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:13.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f9099245700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90940f6530 0x7f9094106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40940/0 (socket says 172.21.15.8:40940) 2023-10-18T21:57:13.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f9099245700 1 -- 172.21.15.8:0/674312703 learned_addr learned my addr 172.21.15.8:0/674312703 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:13.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f9098a44700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90940f77d0 0x7f9094107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:13.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f9099245700 1 -- 172.21.15.8:0/674312703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90940f77d0 msgr2=0x7f9094107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:13.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f9099245700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90940f77d0 0x7f9094107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:13.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f9099245700 1 -- 172.21.15.8:0/674312703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090005040 con 0x7f90940f6530 2023-10-18T21:57:13.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f9098a44700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90940f77d0 0x7f9094107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:57:13.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.549+0000 7f9099245700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90940f6530 0x7f9094106e20 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f9090007a60 tx=0x7f9090009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:13.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.550+0000 7f9089ffb700 1 -- 172.21.15.8:0/674312703 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9090018070 con 0x7f90940f6530 2023-10-18T21:57:13.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.550+0000 7f9089ffb700 1 -- 172.21.15.8:0/674312703 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9090009630 con 0x7f90940f6530 2023-10-18T21:57:13.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.550+0000 7f9089ffb700 1 -- 172.21.15.8:0/674312703 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f909001c540 con 0x7f90940f6530 2023-10-18T21:57:13.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.550+0000 7f909a247700 1 -- 172.21.15.8:0/674312703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9094108340 con 0x7f90940f6530 2023-10-18T21:57:13.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.550+0000 7f909a247700 1 -- 172.21.15.8:0/674312703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90941088a0 con 0x7f90940f6530 2023-10-18T21:57:13.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.551+0000 7f909a247700 1 -- 172.21.15.8:0/674312703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9094059100 con 0x7f90940f6530 2023-10-18T21:57:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.552+0000 7f9089ffb700 1 -- 172.21.15.8:0/674312703 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f909001d420 con 0x7f90940f6530 2023-10-18T21:57:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.552+0000 7f9089ffb700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9080060f70 0x7f9080063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.553+0000 7f9089ffb700 1 -- 172.21.15.8:0/674312703 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f909007e600 con 0x7f90940f6530 2023-10-18T21:57:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.553+0000 7f9098a44700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9080060f70 0x7f9080063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.553+0000 7f9098a44700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9080060f70 0x7f9080063430 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f9084009fd0 tx=0x7f908400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:13.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.557+0000 7f9089ffb700 1 -- 172.21.15.8:0/674312703 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f909004e2f0 con 0x7f90940f6530 2023-10-18T21:57:13.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.758+0000 7f909a247700 1 -- 172.21.15.8:0/674312703 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90940fed30 con 0x7f9080060f70 2023-10-18T21:57:13.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.759+0000 7f9089ffb700 1 -- 172.21.15.8:0/674312703 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f90940fed30 con 0x7f9080060f70 2023-10-18T21:57:13.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.761+0000 7f909a247700 1 -- 172.21.15.8:0/674312703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9080060f70 msgr2=0x7f9080063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:13.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.761+0000 7f909a247700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9080060f70 0x7f9080063430 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f9084009fd0 tx=0x7f908400b040).stop 2023-10-18T21:57:13.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.761+0000 7f909a247700 1 -- 172.21.15.8:0/674312703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90940f6530 msgr2=0x7f9094106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:13.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.761+0000 7f909a247700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90940f6530 0x7f9094106e20 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f9090007a60 tx=0x7f9090009b30).stop 2023-10-18T21:57:13.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.762+0000 7f909a247700 1 -- 172.21.15.8:0/674312703 shutdown_connections 2023-10-18T21:57:13.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.762+0000 7f909a247700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9080060f70 0x7f9080063430 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:13.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.762+0000 7f909a247700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90940f6530 0x7f9094106e20 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:13.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.762+0000 7f909a247700 1 --2- 172.21.15.8:0/674312703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90940f77d0 0x7f9094107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:13.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.762+0000 7f909a247700 1 -- 172.21.15.8:0/674312703 >> 172.21.15.8:0/674312703 conn(0x7f90940f1c90 msgr2=0x7f90940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:13.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.762+0000 7f909a247700 1 -- 172.21.15.8:0/674312703 shutdown_connections 2023-10-18T21:57:13.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.762+0000 7f909a247700 1 -- 172.21.15.8:0/674312703 wait complete. 2023-10-18T21:57:13.778 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:57:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.901+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/1580540117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a340f77d0 msgr2=0x7f9a340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.901+0000 7f9a3a8b3700 1 --2- 172.21.15.8:0/1580540117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a340f77d0 0x7f9a340f7c30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f9a24004660 tx=0x7f9a24009b30).stop 2023-10-18T21:57:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.901+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/1580540117 shutdown_connections 2023-10-18T21:57:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.901+0000 7f9a3a8b3700 1 --2- 172.21.15.8:0/1580540117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a340f77d0 0x7f9a340f7c30 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.901+0000 7f9a3a8b3700 1 --2- 172.21.15.8:0/1580540117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a340f6530 0x7f9a340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.901+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/1580540117 >> 172.21.15.8:0/1580540117 conn(0x7f9a340f1c90 msgr2=0x7f9a340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:13.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.901+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/1580540117 shutdown_connections 2023-10-18T21:57:13.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.901+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/1580540117 wait complete. 2023-10-18T21:57:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.902+0000 7f9a3a8b3700 1 Processor -- start 2023-10-18T21:57:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.902+0000 7f9a3a8b3700 1 -- start start 2023-10-18T21:57:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.902+0000 7f9a3a8b3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a340f6530 0x7f9a3406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.902+0000 7f9a3a8b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a340f77d0 0x7f9a34069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.902+0000 7f9a3a8b3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3410a9d0 con 0x7f9a340f77d0 2023-10-18T21:57:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.902+0000 7f9a3a8b3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3410ab10 con 0x7f9a340f6530 2023-10-18T21:57:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.903+0000 7f9a390b0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a340f77d0 0x7f9a34069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.903+0000 7f9a390b0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a340f77d0 0x7f9a34069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40954/0 (socket says 172.21.15.8:40954) 2023-10-18T21:57:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.903+0000 7f9a390b0700 1 -- 172.21.15.8:0/3275108691 learned_addr learned my addr 172.21.15.8:0/3275108691 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.903+0000 7f9a398b1700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a340f6530 0x7f9a3406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.903+0000 7f9a390b0700 1 -- 172.21.15.8:0/3275108691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a340f6530 msgr2=0x7f9a3406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.903+0000 7f9a390b0700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a340f6530 0x7f9a3406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.903+0000 7f9a390b0700 1 -- 172.21.15.8:0/3275108691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a24005040 con 0x7f9a340f77d0 2023-10-18T21:57:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.903+0000 7f9a390b0700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a340f77d0 0x7f9a34069e20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f9a24009f50 tx=0x7f9a24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.904+0000 7f9a2a7fc700 1 -- 172.21.15.8:0/3275108691 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a24018070 con 0x7f9a340f77d0 2023-10-18T21:57:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.904+0000 7f9a2a7fc700 1 -- 172.21.15.8:0/3275108691 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9a24009630 con 0x7f9a340f77d0 2023-10-18T21:57:13.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.904+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/3275108691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3406a370 con 0x7f9a340f77d0 2023-10-18T21:57:13.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.904+0000 7f9a2a7fc700 1 -- 172.21.15.8:0/3275108691 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2401c3c0 con 0x7f9a340f77d0 2023-10-18T21:57:13.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.904+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/3275108691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3406a8d0 con 0x7f9a340f77d0 2023-10-18T21:57:13.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.905+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/3275108691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a34045ad0 con 0x7f9a340f77d0 2023-10-18T21:57:13.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.906+0000 7f9a2a7fc700 1 -- 172.21.15.8:0/3275108691 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9a2401d420 con 0x7f9a340f77d0 2023-10-18T21:57:13.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.907+0000 7f9a2a7fc700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a20060f70 0x7f9a20063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:13.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.907+0000 7f9a2a7fc700 1 -- 172.21.15.8:0/3275108691 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9a2407e530 con 0x7f9a340f77d0 2023-10-18T21:57:13.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.907+0000 7f9a398b1700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a20060f70 0x7f9a20063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:13.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.907+0000 7f9a398b1700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a20060f70 0x7f9a20063430 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f9a3406b730 tx=0x7f9a3000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:13.911+0000 7f9a2a7fc700 1 -- 172.21.15.8:0/3275108691 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9a2404e1a0 con 0x7f9a340f77d0 2023-10-18T21:57:14.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.111+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/3275108691 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a34027b10 con 0x7f9a20060f70 2023-10-18T21:57:14.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.112+0000 7f9a2a7fc700 1 -- 172.21.15.8:0/3275108691 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9a34027b10 con 0x7f9a20060f70 2023-10-18T21:57:14.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.114+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/3275108691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a20060f70 msgr2=0x7f9a20063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:14.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.114+0000 7f9a3a8b3700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a20060f70 0x7f9a20063430 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f9a3406b730 tx=0x7f9a3000b040).stop 2023-10-18T21:57:14.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.114+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/3275108691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a340f77d0 msgr2=0x7f9a34069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:14.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.114+0000 7f9a3a8b3700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a340f77d0 0x7f9a34069e20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f9a24009f50 tx=0x7f9a24009b30).stop 2023-10-18T21:57:14.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.114+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/3275108691 shutdown_connections 2023-10-18T21:57:14.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.114+0000 7f9a3a8b3700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a20060f70 0x7f9a20063430 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.114+0000 7f9a3a8b3700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a340f6530 0x7f9a3406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.114+0000 7f9a3a8b3700 1 --2- 172.21.15.8:0/3275108691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a340f77d0 0x7f9a34069e20 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.114+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/3275108691 >> 172.21.15.8:0/3275108691 conn(0x7f9a340f1c90 msgr2=0x7f9a340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:14.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.114+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/3275108691 shutdown_connections 2023-10-18T21:57:14.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.115+0000 7f9a3a8b3700 1 -- 172.21.15.8:0/3275108691 wait complete. 2023-10-18T21:57:14.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.252+0000 7f131aefb700 1 -- 172.21.15.8:0/811403718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13140f77d0 msgr2=0x7f13140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.252+0000 7f131aefb700 1 --2- 172.21.15.8:0/811403718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13140f77d0 0x7f13140f7c30 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f1304004660 tx=0x7f1304009b30).stop 2023-10-18T21:57:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.252+0000 7f131aefb700 1 -- 172.21.15.8:0/811403718 shutdown_connections 2023-10-18T21:57:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.252+0000 7f131aefb700 1 --2- 172.21.15.8:0/811403718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13140f77d0 0x7f13140f7c30 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.252+0000 7f131aefb700 1 --2- 172.21.15.8:0/811403718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13140f6530 0x7f13140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.252+0000 7f131aefb700 1 -- 172.21.15.8:0/811403718 >> 172.21.15.8:0/811403718 conn(0x7f13140f1c90 msgr2=0x7f13140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:14.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.252+0000 7f131aefb700 1 -- 172.21.15.8:0/811403718 shutdown_connections 2023-10-18T21:57:14.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.252+0000 7f131aefb700 1 -- 172.21.15.8:0/811403718 wait complete. 2023-10-18T21:57:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.253+0000 7f131aefb700 1 Processor -- start 2023-10-18T21:57:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.253+0000 7f131aefb700 1 -- start start 2023-10-18T21:57:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f131aefb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13140f6530 0x7f1314106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f131aefb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13140f77d0 0x7f1314107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f131aefb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314107880 con 0x7f13140f6530 2023-10-18T21:57:14.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f131aefb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13141080c0 con 0x7f13140f77d0 2023-10-18T21:57:14.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f1319ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13140f6530 0x7f1314106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:14.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f1319ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13140f6530 0x7f1314106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40972/0 (socket says 172.21.15.8:40972) 2023-10-18T21:57:14.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f1319ef9700 1 -- 172.21.15.8:0/935353801 learned_addr learned my addr 172.21.15.8:0/935353801 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:14.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f13196f8700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13140f77d0 0x7f1314107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:14.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f1319ef9700 1 -- 172.21.15.8:0/935353801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13140f77d0 msgr2=0x7f1314107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:14.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f1319ef9700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13140f77d0 0x7f1314107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.254+0000 7f1319ef9700 1 -- 172.21.15.8:0/935353801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304005040 con 0x7f13140f6530 2023-10-18T21:57:14.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.255+0000 7f1319ef9700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13140f6530 0x7f1314106d90 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f1310002700 tx=0x7f1310009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:14.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.255+0000 7f130a7fc700 1 -- 172.21.15.8:0/935353801 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13100079c0 con 0x7f13140f6530 2023-10-18T21:57:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.255+0000 7f130a7fc700 1 -- 172.21.15.8:0/935353801 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f131000f040 con 0x7f13140f6530 2023-10-18T21:57:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.255+0000 7f131aefb700 1 -- 172.21.15.8:0/935353801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13141083a0 con 0x7f13140f6530 2023-10-18T21:57:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.255+0000 7f130a7fc700 1 -- 172.21.15.8:0/935353801 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13100148d0 con 0x7f13140f6530 2023-10-18T21:57:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.255+0000 7f131aefb700 1 -- 172.21.15.8:0/935353801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13141088e0 con 0x7f13140f6530 2023-10-18T21:57:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.256+0000 7f131aefb700 1 -- 172.21.15.8:0/935353801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1314059100 con 0x7f13140f6530 2023-10-18T21:57:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.257+0000 7f130a7fc700 1 -- 172.21.15.8:0/935353801 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f131001b060 con 0x7f13140f6530 2023-10-18T21:57:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.258+0000 7f130a7fc700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1300060f70 0x7f1300063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.258+0000 7f130a7fc700 1 -- 172.21.15.8:0/935353801 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f131007c7d0 con 0x7f13140f6530 2023-10-18T21:57:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.258+0000 7f13196f8700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1300060f70 0x7f1300063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.259+0000 7f13196f8700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1300060f70 0x7f1300063430 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1304004630 tx=0x7f1304009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:14.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.262+0000 7f130a7fc700 1 -- 172.21.15.8:0/935353801 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f131004c380 con 0x7f13140f6530 2023-10-18T21:57:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.456+0000 7f131aefb700 1 -- 172.21.15.8:0/935353801 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f13140fee70 con 0x7f1300060f70 2023-10-18T21:57:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.465+0000 7f130a7fc700 1 -- 172.21.15.8:0/935353801 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1304019040 con 0x7f1300060f70 2023-10-18T21:57:14.468 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:57:14.468 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (63m) 79s ago 65m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:57:14.468 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (57m) 79s ago 65m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:57:14.468 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (57m) 9m ago 64m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:57:14.468 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (63m) 79s ago 65m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:57:14.469 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 79s ago 61m - - 2023-10-18T21:57:14.469 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 79s ago 61m - - 2023-10-18T21:57:14.469 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 61m - - 2023-10-18T21:57:14.469 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 61m - - 2023-10-18T21:57:14.469 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (59m) 79s ago 66m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:57:14.470 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (58m) 9m ago 64m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:57:14.470 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (58m) 79s ago 66m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:57:14.470 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (58m) 9m ago 64m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:57:14.470 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (64m) 79s ago 64m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:57:14.470 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (64m) 9m ago 64m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:57:14.471 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (57m) 79s ago 63m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:57:14.471 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (55m) 79s ago 63m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:57:14.471 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (54m) 79s ago 63m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:57:14.471 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (54m) 9m ago 63m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:57:14.471 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (53m) 9m ago 62m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:57:14.472 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (53m) 9m ago 62m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:57:14.472 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (59m) 79s ago 64m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:57:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.467+0000 7f131aefb700 1 -- 172.21.15.8:0/935353801 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1300060f70 msgr2=0x7f1300063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.467+0000 7f131aefb700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1300060f70 0x7f1300063430 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1304004630 tx=0x7f1304009b30).stop 2023-10-18T21:57:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.467+0000 7f131aefb700 1 -- 172.21.15.8:0/935353801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13140f6530 msgr2=0x7f1314106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.467+0000 7f131aefb700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13140f6530 0x7f1314106d90 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f1310002700 tx=0x7f1310009d80).stop 2023-10-18T21:57:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.467+0000 7f131aefb700 1 -- 172.21.15.8:0/935353801 shutdown_connections 2023-10-18T21:57:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.467+0000 7f131aefb700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1300060f70 0x7f1300063430 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.467+0000 7f131aefb700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13140f6530 0x7f1314106d90 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.467+0000 7f131aefb700 1 --2- 172.21.15.8:0/935353801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13140f77d0 0x7f1314107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.467+0000 7f131aefb700 1 -- 172.21.15.8:0/935353801 >> 172.21.15.8:0/935353801 conn(0x7f13140f1c90 msgr2=0x7f13140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.468+0000 7f131aefb700 1 -- 172.21.15.8:0/935353801 shutdown_connections 2023-10-18T21:57:14.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.468+0000 7f131aefb700 1 -- 172.21.15.8:0/935353801 wait complete. 2023-10-18T21:57:14.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.603+0000 7f5bd957a700 1 -- 172.21.15.8:0/123674336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd40f6530 msgr2=0x7f5bd40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:14.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.603+0000 7f5bd957a700 1 --2- 172.21.15.8:0/123674336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd40f6530 0x7f5bd40f6950 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f5bc4004660 tx=0x7f5bc4009b30).stop 2023-10-18T21:57:14.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.603+0000 7f5bd957a700 1 -- 172.21.15.8:0/123674336 shutdown_connections 2023-10-18T21:57:14.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.603+0000 7f5bd957a700 1 --2- 172.21.15.8:0/123674336 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bd40f77d0 0x7f5bd40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.603+0000 7f5bd957a700 1 --2- 172.21.15.8:0/123674336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd40f6530 0x7f5bd40f6950 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.603+0000 7f5bd957a700 1 -- 172.21.15.8:0/123674336 >> 172.21.15.8:0/123674336 conn(0x7f5bd40f1c90 msgr2=0x7f5bd40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:14.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.603+0000 7f5bd957a700 1 -- 172.21.15.8:0/123674336 shutdown_connections 2023-10-18T21:57:14.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.603+0000 7f5bd957a700 1 -- 172.21.15.8:0/123674336 wait complete. 2023-10-18T21:57:14.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.604+0000 7f5bd957a700 1 Processor -- start 2023-10-18T21:57:14.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.604+0000 7f5bd957a700 1 -- start start 2023-10-18T21:57:14.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.605+0000 7f5bd957a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bd40f6530 0x7f5bd4108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:14.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.605+0000 7f5bd957a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd40f77d0 0x7f5bd4109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:14.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.605+0000 7f5bd957a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd41099c0 con 0x7f5bd40f77d0 2023-10-18T21:57:14.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.605+0000 7f5bd957a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd4109b00 con 0x7f5bd40f6530 2023-10-18T21:57:14.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.605+0000 7f5bd37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd40f77d0 0x7f5bd4109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:14.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.605+0000 7f5bd37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd40f77d0 0x7f5bd4109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40980/0 (socket says 172.21.15.8:40980) 2023-10-18T21:57:14.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.605+0000 7f5bd37fe700 1 -- 172.21.15.8:0/3699062459 learned_addr learned my addr 172.21.15.8:0/3699062459 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:14.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.605+0000 7f5bd3fff700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bd40f6530 0x7f5bd4108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:14.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.606+0000 7f5bd37fe700 1 -- 172.21.15.8:0/3699062459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bd40f6530 msgr2=0x7f5bd4108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:14.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.606+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bd40f6530 0x7f5bd4108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.606+0000 7f5bd37fe700 1 -- 172.21.15.8:0/3699062459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4005040 con 0x7f5bd40f77d0 2023-10-18T21:57:14.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.606+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd40f77d0 0x7f5bd4109410 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f5bc800e7f0 tx=0x7f5bc800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.606+0000 7f5bd0ff9700 1 -- 172.21.15.8:0/3699062459 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bc80092e0 con 0x7f5bd40f77d0 2023-10-18T21:57:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.606+0000 7f5bd0ff9700 1 -- 172.21.15.8:0/3699062459 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5bc800f040 con 0x7f5bd40f77d0 2023-10-18T21:57:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.606+0000 7f5bd0ff9700 1 -- 172.21.15.8:0/3699062459 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bc80147e0 con 0x7f5bd40f77d0 2023-10-18T21:57:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.606+0000 7f5bd957a700 1 -- 172.21.15.8:0/3699062459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd410a4a0 con 0x7f5bd40f77d0 2023-10-18T21:57:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.606+0000 7f5bd957a700 1 -- 172.21.15.8:0/3699062459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd410a9e0 con 0x7f5bd40f77d0 2023-10-18T21:57:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.607+0000 7f5bd957a700 1 -- 172.21.15.8:0/3699062459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd4045ad0 con 0x7f5bd40f77d0 2023-10-18T21:57:14.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.608+0000 7f5bd0ff9700 1 -- 172.21.15.8:0/3699062459 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5bc801b030 con 0x7f5bd40f77d0 2023-10-18T21:57:14.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.609+0000 7f5bd0ff9700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bbc060f70 0x7f5bbc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:14.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.609+0000 7f5bd0ff9700 1 -- 172.21.15.8:0/3699062459 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5bc807c5f0 con 0x7f5bd40f77d0 2023-10-18T21:57:14.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.609+0000 7f5bd3fff700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bbc060f70 0x7f5bbc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:14.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.610+0000 7f5bd3fff700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bbc060f70 0x7f5bbc063430 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f5bc4009720 tx=0x7f5bc4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:14.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.613+0000 7f5bd0ff9700 1 -- 172.21.15.8:0/3699062459 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5bc804fd40 con 0x7f5bd40f77d0 2023-10-18T21:57:14.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.866+0000 7f5bd957a700 1 -- 172.21.15.8:0/3699062459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5bd4027a00 con 0x7f5bd40f77d0 2023-10-18T21:57:14.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.867+0000 7f5bd0ff9700 1 -- 172.21.15.8:0/3699062459 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5bc8019020 con 0x7f5bd40f77d0 2023-10-18T21:57:14.869 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:57:14.869 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:57:14.869 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:57:14.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:57:14.870 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:57:14.870 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:57:14.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:57:14.870 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:57:14.871 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:57:14.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:57:14.871 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:57:14.871 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:57:14.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:57:14.872 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:57:14.872 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:57:14.872 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:57:14.872 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:57:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.868+0000 7f5bd957a700 1 -- 172.21.15.8:0/3699062459 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bbc060f70 msgr2=0x7f5bbc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.868+0000 7f5bd957a700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bbc060f70 0x7f5bbc063430 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f5bc4009720 tx=0x7f5bc4016040).stop 2023-10-18T21:57:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.868+0000 7f5bd957a700 1 -- 172.21.15.8:0/3699062459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd40f77d0 msgr2=0x7f5bd4109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.868+0000 7f5bd957a700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd40f77d0 0x7f5bd4109410 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f5bc800e7f0 tx=0x7f5bc800b040).stop 2023-10-18T21:57:14.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.869+0000 7f5bd957a700 1 -- 172.21.15.8:0/3699062459 shutdown_connections 2023-10-18T21:57:14.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.869+0000 7f5bd957a700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bbc060f70 0x7f5bbc063430 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.869+0000 7f5bd957a700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bd40f6530 0x7f5bd4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.869+0000 7f5bd957a700 1 --2- 172.21.15.8:0/3699062459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd40f77d0 0x7f5bd4109410 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:14.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.869+0000 7f5bd957a700 1 -- 172.21.15.8:0/3699062459 >> 172.21.15.8:0/3699062459 conn(0x7f5bd40f1c90 msgr2=0x7f5bd40f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:14.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.869+0000 7f5bd957a700 1 -- 172.21.15.8:0/3699062459 shutdown_connections 2023-10-18T21:57:14.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:14.869+0000 7f5bd957a700 1 -- 172.21.15.8:0/3699062459 wait complete. 2023-10-18T21:57:15.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.006+0000 7fbde9680700 1 -- 172.21.15.8:0/3405112359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde40f77d0 msgr2=0x7fbde40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:15.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.006+0000 7fbde9680700 1 --2- 172.21.15.8:0/3405112359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde40f77d0 0x7fbde40f7c30 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fbdd8004660 tx=0x7fbdd8009b30).stop 2023-10-18T21:57:15.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.006+0000 7fbde9680700 1 -- 172.21.15.8:0/3405112359 shutdown_connections 2023-10-18T21:57:15.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.006+0000 7fbde9680700 1 --2- 172.21.15.8:0/3405112359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde40f77d0 0x7fbde40f7c30 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.006+0000 7fbde9680700 1 --2- 172.21.15.8:0/3405112359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde40f6530 0x7fbde40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.006+0000 7fbde9680700 1 -- 172.21.15.8:0/3405112359 >> 172.21.15.8:0/3405112359 conn(0x7fbde40f1c90 msgr2=0x7fbde40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:15.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.006+0000 7fbde9680700 1 -- 172.21.15.8:0/3405112359 shutdown_connections 2023-10-18T21:57:15.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.006+0000 7fbde9680700 1 -- 172.21.15.8:0/3405112359 wait complete. 2023-10-18T21:57:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.007+0000 7fbde9680700 1 Processor -- start 2023-10-18T21:57:15.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.007+0000 7fbde9680700 1 -- start start 2023-10-18T21:57:15.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.007+0000 7fbde9680700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde40f6530 0x7fbde4108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:15.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.007+0000 7fbde9680700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde40f77d0 0x7fbde4109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:15.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.007+0000 7fbde9680700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde41099b0 con 0x7fbde40f77d0 2023-10-18T21:57:15.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.007+0000 7fbde9680700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde4109af0 con 0x7fbde40f6530 2023-10-18T21:57:15.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.008+0000 7fbde37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde40f77d0 0x7fbde4109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:15.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.008+0000 7fbde37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde40f77d0 0x7fbde4109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40994/0 (socket says 172.21.15.8:40994) 2023-10-18T21:57:15.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.008+0000 7fbde37fe700 1 -- 172.21.15.8:0/1810859998 learned_addr learned my addr 172.21.15.8:0/1810859998 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:15.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.008+0000 7fbde3fff700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde40f6530 0x7fbde4108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:15.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.008+0000 7fbde37fe700 1 -- 172.21.15.8:0/1810859998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde40f6530 msgr2=0x7fbde4108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:15.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.008+0000 7fbde37fe700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde40f6530 0x7fbde4108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.008+0000 7fbde37fe700 1 -- 172.21.15.8:0/1810859998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd8005040 con 0x7fbde40f77d0 2023-10-18T21:57:15.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.008+0000 7fbde3fff700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde40f6530 0x7fbde4108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:57:15.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.008+0000 7fbde37fe700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde40f77d0 0x7fbde4109400 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7fbdd8009f50 tx=0x7fbdd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:15.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.008+0000 7fbde0ff9700 1 -- 172.21.15.8:0/1810859998 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdd8018070 con 0x7fbde40f77d0 2023-10-18T21:57:15.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.009+0000 7fbde9680700 1 -- 172.21.15.8:0/1810859998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde410a430 con 0x7fbde40f77d0 2023-10-18T21:57:15.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.009+0000 7fbde0ff9700 1 -- 172.21.15.8:0/1810859998 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbdd8009630 con 0x7fbde40f77d0 2023-10-18T21:57:15.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.009+0000 7fbde0ff9700 1 -- 172.21.15.8:0/1810859998 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdd801c3c0 con 0x7fbde40f77d0 2023-10-18T21:57:15.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.009+0000 7fbde9680700 1 -- 172.21.15.8:0/1810859998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde410a990 con 0x7fbde40f77d0 2023-10-18T21:57:15.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.010+0000 7fbde9680700 1 -- 172.21.15.8:0/1810859998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde4045ad0 con 0x7fbde40f77d0 2023-10-18T21:57:15.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.011+0000 7fbde0ff9700 1 -- 172.21.15.8:0/1810859998 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbdd801d420 con 0x7fbde40f77d0 2023-10-18T21:57:15.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.012+0000 7fbde0ff9700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdcc060f70 0x7fbdcc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:15.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.012+0000 7fbde0ff9700 1 -- 172.21.15.8:0/1810859998 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbdd807e710 con 0x7fbde40f77d0 2023-10-18T21:57:15.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.012+0000 7fbde3fff700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdcc060f70 0x7fbdcc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:15.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.013+0000 7fbde3fff700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdcc060f70 0x7fbdcc063430 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fbde40f7630 tx=0x7fbdd400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:15.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.016+0000 7fbde0ff9700 1 -- 172.21.15.8:0/1810859998 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbdd8051cf0 con 0x7fbde40f77d0 2023-10-18T21:57:15.207 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:13.760791+0000 mgr.smithi008.flmjzp (mgr.14640) 3498 : audit [DBG] from='client.36880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:15.208 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:13.881230+0000 mgr.smithi008.flmjzp (mgr.14640) 3499 : cluster [DBG] pgmap v2406: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:15.208 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:14.113595+0000 mgr.smithi008.flmjzp (mgr.14640) 3500 : audit [DBG] from='client.36884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:15.208 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:14.868184+0000 mon.smithi008 (mon.0) 3851 : audit [DBG] from='client.? 172.21.15.8:0/3699062459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:15.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:13.760791+0000 mgr.smithi008.flmjzp (mgr.14640) 3498 : audit [DBG] from='client.36880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:13.881230+0000 mgr.smithi008.flmjzp (mgr.14640) 3499 : cluster [DBG] pgmap v2406: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:14.113595+0000 mgr.smithi008.flmjzp (mgr.14640) 3500 : audit [DBG] from='client.36884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:14.868184+0000 mon.smithi008 (mon.0) 3851 : audit [DBG] from='client.? 172.21.15.8:0/3699062459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:15.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.243+0000 7fbde9680700 1 -- 172.21.15.8:0/1810859998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbde40fed90 con 0x7fbde40f77d0 2023-10-18T21:57:15.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.243+0000 7fbde0ff9700 1 -- 172.21.15.8:0/1810859998 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fbdd80518e0 con 0x7fbde40f77d0 2023-10-18T21:57:15.246 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:57:15.246 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:57:15.246 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:57:15.247 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:57:15.247 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:57:15.247 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:57:15.247 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:57:15.247 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:57:15.248 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:57:15.248 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:57:15.248 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:57:15.248 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:57:15.248 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:57:15.249 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:57:15.249 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:57:15.249 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:57:15.249 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:57:15.249 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:57:15.250 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:57:15.250 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:57:15.250 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:57:15.250 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:57:15.251 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:57:15.251 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:57:15.251 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:57:15.251 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:57:15.251 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:57:15.252 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:57:15.252 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:57:15.252 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:57:15.252 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:57:15.252 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:57:15.253 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:57:15.253 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:57:15.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.245+0000 7fbde9680700 1 -- 172.21.15.8:0/1810859998 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdcc060f70 msgr2=0x7fbdcc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:15.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.245+0000 7fbde9680700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdcc060f70 0x7fbdcc063430 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fbde40f7630 tx=0x7fbdd400b040).stop 2023-10-18T21:57:15.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.245+0000 7fbde9680700 1 -- 172.21.15.8:0/1810859998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde40f77d0 msgr2=0x7fbde4109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:15.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.245+0000 7fbde9680700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde40f77d0 0x7fbde4109400 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7fbdd8009f50 tx=0x7fbdd8009b30).stop 2023-10-18T21:57:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.246+0000 7fbde9680700 1 -- 172.21.15.8:0/1810859998 shutdown_connections 2023-10-18T21:57:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.246+0000 7fbde9680700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdcc060f70 0x7fbdcc063430 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.246+0000 7fbde9680700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde40f6530 0x7fbde4108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.246+0000 7fbde9680700 1 --2- 172.21.15.8:0/1810859998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde40f77d0 0x7fbde4109400 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.246+0000 7fbde9680700 1 -- 172.21.15.8:0/1810859998 >> 172.21.15.8:0/1810859998 conn(0x7fbde40f1c90 msgr2=0x7fbde406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.246+0000 7fbde9680700 1 -- 172.21.15.8:0/1810859998 shutdown_connections 2023-10-18T21:57:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.246+0000 7fbde9680700 1 -- 172.21.15.8:0/1810859998 wait complete. 2023-10-18T21:57:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:57:15.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.385+0000 7fd37341b700 1 -- 172.21.15.8:0/3076418649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd36c0f6530 msgr2=0x7fd36c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:15.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.385+0000 7fd37341b700 1 --2- 172.21.15.8:0/3076418649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd36c0f6530 0x7fd36c0f6950 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fd368004660 tx=0x7fd368009b30).stop 2023-10-18T21:57:15.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.385+0000 7fd37341b700 1 -- 172.21.15.8:0/3076418649 shutdown_connections 2023-10-18T21:57:15.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.385+0000 7fd37341b700 1 --2- 172.21.15.8:0/3076418649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c0f77d0 0x7fd36c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.385+0000 7fd37341b700 1 --2- 172.21.15.8:0/3076418649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd36c0f6530 0x7fd36c0f6950 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.385+0000 7fd37341b700 1 -- 172.21.15.8:0/3076418649 >> 172.21.15.8:0/3076418649 conn(0x7fd36c0f1c90 msgr2=0x7fd36c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:15.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.385+0000 7fd37341b700 1 -- 172.21.15.8:0/3076418649 shutdown_connections 2023-10-18T21:57:15.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.385+0000 7fd37341b700 1 -- 172.21.15.8:0/3076418649 wait complete. 2023-10-18T21:57:15.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.386+0000 7fd37341b700 1 Processor -- start 2023-10-18T21:57:15.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.386+0000 7fd37341b700 1 -- start start 2023-10-18T21:57:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd37341b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c0f6530 0x7fd36c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd37341b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd36c0f77d0 0x7fd36c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd37341b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c107880 con 0x7fd36c0f77d0 2023-10-18T21:57:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd37341b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1080c0 con 0x7fd36c0f6530 2023-10-18T21:57:15.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd371c18700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd36c0f77d0 0x7fd36c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:15.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd371c18700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd36c0f77d0 0x7fd36c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41004/0 (socket says 172.21.15.8:41004) 2023-10-18T21:57:15.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd371c18700 1 -- 172.21.15.8:0/419224426 learned_addr learned my addr 172.21.15.8:0/419224426 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:15.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd372419700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c0f6530 0x7fd36c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:15.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd371c18700 1 -- 172.21.15.8:0/419224426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c0f6530 msgr2=0x7fd36c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:15.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd371c18700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c0f6530 0x7fd36c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.387+0000 7fd371c18700 1 -- 172.21.15.8:0/419224426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368005040 con 0x7fd36c0f77d0 2023-10-18T21:57:15.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.388+0000 7fd371c18700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd36c0f77d0 0x7fd36c107280 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fd35c00e7f0 tx=0x7fd35c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:15.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.388+0000 7fd362ffd700 1 -- 172.21.15.8:0/419224426 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd35c0092e0 con 0x7fd36c0f77d0 2023-10-18T21:57:15.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.388+0000 7fd362ffd700 1 -- 172.21.15.8:0/419224426 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd35c00f040 con 0x7fd36c0f77d0 2023-10-18T21:57:15.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.388+0000 7fd37341b700 1 -- 172.21.15.8:0/419224426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36c1083a0 con 0x7fd36c0f77d0 2023-10-18T21:57:15.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.388+0000 7fd362ffd700 1 -- 172.21.15.8:0/419224426 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd35c0147e0 con 0x7fd36c0f77d0 2023-10-18T21:57:15.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.388+0000 7fd37341b700 1 -- 172.21.15.8:0/419224426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c1088e0 con 0x7fd36c0f77d0 2023-10-18T21:57:15.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.389+0000 7fd37341b700 1 -- 172.21.15.8:0/419224426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c059100 con 0x7fd36c0f77d0 2023-10-18T21:57:15.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.390+0000 7fd362ffd700 1 -- 172.21.15.8:0/419224426 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd35c01b030 con 0x7fd36c0f77d0 2023-10-18T21:57:15.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.391+0000 7fd362ffd700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd358060f70 0x7fd358063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:15.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.391+0000 7fd362ffd700 1 -- 172.21.15.8:0/419224426 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd35c07c7c0 con 0x7fd36c0f77d0 2023-10-18T21:57:15.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.391+0000 7fd372419700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd358060f70 0x7fd358063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:15.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.391+0000 7fd372419700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd358060f70 0x7fd358063430 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7fd368005010 tx=0x7fd368016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:15.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.395+0000 7fd362ffd700 1 -- 172.21.15.8:0/419224426 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd35c04c420 con 0x7fd36c0f77d0 2023-10-18T21:57:15.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.592+0000 7fd37341b700 1 -- 172.21.15.8:0/419224426 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd36c0fed80 con 0x7fd358060f70 2023-10-18T21:57:15.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.593+0000 7fd362ffd700 1 -- 172.21.15.8:0/419224426 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd36c0fed80 con 0x7fd358060f70 2023-10-18T21:57:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:57:15.596 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:57:15.596 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:57:15.596 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:57:15.596 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:57:15.596 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:57:15.597 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:57:15.597 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:57:15.597 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:57:15.597 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:57:15.597 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:57:15.598 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:57:15.598 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:57:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:57:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.595+0000 7fd37341b700 1 -- 172.21.15.8:0/419224426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd358060f70 msgr2=0x7fd358063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.595+0000 7fd37341b700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd358060f70 0x7fd358063430 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7fd368005010 tx=0x7fd368016040).stop 2023-10-18T21:57:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.595+0000 7fd37341b700 1 -- 172.21.15.8:0/419224426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd36c0f77d0 msgr2=0x7fd36c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.595+0000 7fd37341b700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd36c0f77d0 0x7fd36c107280 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fd35c00e7f0 tx=0x7fd35c00b040).stop 2023-10-18T21:57:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.595+0000 7fd37341b700 1 -- 172.21.15.8:0/419224426 shutdown_connections 2023-10-18T21:57:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.595+0000 7fd37341b700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd358060f70 0x7fd358063430 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.595+0000 7fd37341b700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c0f6530 0x7fd36c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.595+0000 7fd37341b700 1 --2- 172.21.15.8:0/419224426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd36c0f77d0 0x7fd36c107280 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.595+0000 7fd37341b700 1 -- 172.21.15.8:0/419224426 >> 172.21.15.8:0/419224426 conn(0x7fd36c0f1c90 msgr2=0x7fd36c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.595+0000 7fd37341b700 1 -- 172.21.15.8:0/419224426 shutdown_connections 2023-10-18T21:57:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:15.596+0000 7fd37341b700 1 -- 172.21.15.8:0/419224426 wait complete. 2023-10-18T21:57:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:14.458294+0000 mgr.smithi008.flmjzp (mgr.14640) 3501 : audit [DBG] from='client.36888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.245211+0000 mon.smithi008 (mon.0) 3852 : audit [DBG] from='client.? 172.21.15.8:0/1810859998' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:57:16.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.907032+0000 mon.smithi008 (mon.0) 3853 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.908618+0000 mon.smithi008 (mon.0) 3854 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:57:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.909323+0000 mon.smithi008 (mon.0) 3855 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:57:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.914666+0000 mon.smithi008 (mon.0) 3856 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:57:16.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.919598+0000 mon.smithi008 (mon.0) 3857 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:16.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.921974+0000 mon.smithi008 (mon.0) 3858 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:16.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.923231+0000 mon.smithi008 (mon.0) 3859 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:16.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.924439+0000 mon.smithi008 (mon.0) 3860 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:16.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.925957+0000 mon.smithi008 (mon.0) 3861 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:14.458294+0000 mgr.smithi008.flmjzp (mgr.14640) 3501 : audit [DBG] from='client.36888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.245211+0000 mon.smithi008 (mon.0) 3852 : audit [DBG] from='client.? 172.21.15.8:0/1810859998' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:57:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.907032+0000 mon.smithi008 (mon.0) 3853 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.908618+0000 mon.smithi008 (mon.0) 3854 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:57:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.909323+0000 mon.smithi008 (mon.0) 3855 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:57:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.914666+0000 mon.smithi008 (mon.0) 3856 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:57:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.919598+0000 mon.smithi008 (mon.0) 3857 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.921974+0000 mon.smithi008 (mon.0) 3858 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.923231+0000 mon.smithi008 (mon.0) 3859 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.924439+0000 mon.smithi008 (mon.0) 3860 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:16.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.925957+0000 mon.smithi008 (mon.0) 3861 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:15.594662+0000 mgr.smithi008.flmjzp (mgr.14640) 3502 : audit [DBG] from='client.36900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:15.881934+0000 mgr.smithi008.flmjzp (mgr.14640) 3503 : cluster [DBG] pgmap v2407: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:15.909959+0000 mgr.smithi008.flmjzp (mgr.14640) 3504 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:57:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:15.910416+0000 mgr.smithi008.flmjzp (mgr.14640) 3505 : cluster [DBG] pgmap v2408: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:15.910615+0000 mgr.smithi008.flmjzp (mgr.14640) 3506 : cluster [DBG] pgmap v2409: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:17.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:15.927507+0000 mgr.smithi008.flmjzp (mgr.14640) 3507 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:57:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:15.594662+0000 mgr.smithi008.flmjzp (mgr.14640) 3502 : audit [DBG] from='client.36900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:15.881934+0000 mgr.smithi008.flmjzp (mgr.14640) 3503 : cluster [DBG] pgmap v2407: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:15.909959+0000 mgr.smithi008.flmjzp (mgr.14640) 3504 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:57:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:15.910416+0000 mgr.smithi008.flmjzp (mgr.14640) 3505 : cluster [DBG] pgmap v2408: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:15.910615+0000 mgr.smithi008.flmjzp (mgr.14640) 3506 : cluster [DBG] pgmap v2409: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:15.927507+0000 mgr.smithi008.flmjzp (mgr.14640) 3507 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:57:19.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:17.911054+0000 mgr.smithi008.flmjzp (mgr.14640) 3508 : cluster [DBG] pgmap v2410: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:17.911054+0000 mgr.smithi008.flmjzp (mgr.14640) 3508 : cluster [DBG] pgmap v2410: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:21.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:19.911831+0000 mgr.smithi008.flmjzp (mgr.14640) 3509 : cluster [DBG] pgmap v2411: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:19.911831+0000 mgr.smithi008.flmjzp (mgr.14640) 3509 : cluster [DBG] pgmap v2411: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:21.912554+0000 mgr.smithi008.flmjzp (mgr.14640) 3510 : cluster [DBG] pgmap v2412: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:21.912554+0000 mgr.smithi008.flmjzp (mgr.14640) 3510 : cluster [DBG] pgmap v2412: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:25.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:23.913202+0000 mgr.smithi008.flmjzp (mgr.14640) 3511 : cluster [DBG] pgmap v2413: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:23.913202+0000 mgr.smithi008.flmjzp (mgr.14640) 3511 : cluster [DBG] pgmap v2413: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:27.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:25.913765+0000 mgr.smithi008.flmjzp (mgr.14640) 3512 : cluster [DBG] pgmap v2414: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:27.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:25.938190+0000 mon.smithi008 (mon.0) 3862 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:27.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:26.499102+0000 mon.smithi008 (mon.0) 3863 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:57:27.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:26.499918+0000 mon.smithi008 (mon.0) 3864 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:57:27.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:26.505403+0000 mon.smithi008 (mon.0) 3865 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:57:27.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:26.510345+0000 mon.smithi008 (mon.0) 3866 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:27.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:26.512689+0000 mon.smithi008 (mon.0) 3867 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:27.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:26.513922+0000 mon.smithi008 (mon.0) 3868 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:27.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:26.515117+0000 mon.smithi008 (mon.0) 3869 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:27.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:26.516621+0000 mon.smithi008 (mon.0) 3870 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:25.913765+0000 mgr.smithi008.flmjzp (mgr.14640) 3512 : cluster [DBG] pgmap v2414: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:25.938190+0000 mon.smithi008 (mon.0) 3862 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:26.499102+0000 mon.smithi008 (mon.0) 3863 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:57:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:26.499918+0000 mon.smithi008 (mon.0) 3864 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:57:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:26.505403+0000 mon.smithi008 (mon.0) 3865 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:57:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:26.510345+0000 mon.smithi008 (mon.0) 3866 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:26.512689+0000 mon.smithi008 (mon.0) 3867 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:26.513922+0000 mon.smithi008 (mon.0) 3868 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:27.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:26.515117+0000 mon.smithi008 (mon.0) 3869 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:27.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:26.516621+0000 mon.smithi008 (mon.0) 3870 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:26.500563+0000 mgr.smithi008.flmjzp (mgr.14640) 3513 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:57:28.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:26.501048+0000 mgr.smithi008.flmjzp (mgr.14640) 3514 : cluster [DBG] pgmap v2415: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:26.501270+0000 mgr.smithi008.flmjzp (mgr.14640) 3515 : cluster [DBG] pgmap v2416: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:28.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:26.518156+0000 mgr.smithi008.flmjzp (mgr.14640) 3516 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:57:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:26.500563+0000 mgr.smithi008.flmjzp (mgr.14640) 3513 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:57:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:26.501048+0000 mgr.smithi008.flmjzp (mgr.14640) 3514 : cluster [DBG] pgmap v2415: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:26.501270+0000 mgr.smithi008.flmjzp (mgr.14640) 3515 : cluster [DBG] pgmap v2416: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:28.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:26.518156+0000 mgr.smithi008.flmjzp (mgr.14640) 3516 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:57:30.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:28.501961+0000 mgr.smithi008.flmjzp (mgr.14640) 3517 : cluster [DBG] pgmap v2417: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:30.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:28.501961+0000 mgr.smithi008.flmjzp (mgr.14640) 3517 : cluster [DBG] pgmap v2417: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:32.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:30.502537+0000 mgr.smithi008.flmjzp (mgr.14640) 3518 : cluster [DBG] pgmap v2418: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:30.502537+0000 mgr.smithi008.flmjzp (mgr.14640) 3518 : cluster [DBG] pgmap v2418: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:32.503009+0000 mgr.smithi008.flmjzp (mgr.14640) 3519 : cluster [DBG] pgmap v2419: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:34.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:32.503009+0000 mgr.smithi008.flmjzp (mgr.14640) 3519 : cluster [DBG] pgmap v2419: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:36.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:34.503682+0000 mgr.smithi008.flmjzp (mgr.14640) 3520 : cluster [DBG] pgmap v2420: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:34.503682+0000 mgr.smithi008.flmjzp (mgr.14640) 3520 : cluster [DBG] pgmap v2420: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:36.525318+0000 mon.smithi008 (mon.0) 3871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:37.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:36.527488+0000 mon.smithi008 (mon.0) 3872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:57:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:36.528523+0000 mon.smithi008 (mon.0) 3873 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:57:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:36.535228+0000 mon.smithi008 (mon.0) 3874 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:57:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:36.541912+0000 mon.smithi008 (mon.0) 3875 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:37.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:36.545212+0000 mon.smithi008 (mon.0) 3876 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:37.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:36.546951+0000 mon.smithi008 (mon.0) 3877 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:37.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:36.548665+0000 mon.smithi008 (mon.0) 3878 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:37.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:36.550762+0000 mon.smithi008 (mon.0) 3879 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:36.525318+0000 mon.smithi008 (mon.0) 3871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:36.527488+0000 mon.smithi008 (mon.0) 3872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:57:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:36.528523+0000 mon.smithi008 (mon.0) 3873 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:57:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:36.535228+0000 mon.smithi008 (mon.0) 3874 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:57:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:36.541912+0000 mon.smithi008 (mon.0) 3875 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:36.545212+0000 mon.smithi008 (mon.0) 3876 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:36.546951+0000 mon.smithi008 (mon.0) 3877 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:37.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:36.548665+0000 mon.smithi008 (mon.0) 3878 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:37.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:36.550762+0000 mon.smithi008 (mon.0) 3879 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:38.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:36.504371+0000 mgr.smithi008.flmjzp (mgr.14640) 3521 : cluster [DBG] pgmap v2421: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:36.529387+0000 mgr.smithi008.flmjzp (mgr.14640) 3522 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:57:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:36.529999+0000 mgr.smithi008.flmjzp (mgr.14640) 3523 : cluster [DBG] pgmap v2422: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:36.530224+0000 mgr.smithi008.flmjzp (mgr.14640) 3524 : cluster [DBG] pgmap v2423: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:38.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:36.552782+0000 mgr.smithi008.flmjzp (mgr.14640) 3525 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:57:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:36.504371+0000 mgr.smithi008.flmjzp (mgr.14640) 3521 : cluster [DBG] pgmap v2421: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:36.529387+0000 mgr.smithi008.flmjzp (mgr.14640) 3522 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:57:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:36.529999+0000 mgr.smithi008.flmjzp (mgr.14640) 3523 : cluster [DBG] pgmap v2422: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:38.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:36.530224+0000 mgr.smithi008.flmjzp (mgr.14640) 3524 : cluster [DBG] pgmap v2423: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:38.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:36.552782+0000 mgr.smithi008.flmjzp (mgr.14640) 3525 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:57:40.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:38.530807+0000 mgr.smithi008.flmjzp (mgr.14640) 3526 : cluster [DBG] pgmap v2424: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:40.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:38.530807+0000 mgr.smithi008.flmjzp (mgr.14640) 3526 : cluster [DBG] pgmap v2424: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:42.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:40.531552+0000 mgr.smithi008.flmjzp (mgr.14640) 3527 : cluster [DBG] pgmap v2425: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:42.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:40.531552+0000 mgr.smithi008.flmjzp (mgr.14640) 3527 : cluster [DBG] pgmap v2425: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:42.532157+0000 mgr.smithi008.flmjzp (mgr.14640) 3528 : cluster [DBG] pgmap v2426: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:42.532157+0000 mgr.smithi008.flmjzp (mgr.14640) 3528 : cluster [DBG] pgmap v2426: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:45.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.749+0000 7fdbaadc9700 1 -- 172.21.15.8:0/531662957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdba406b9c0 msgr2=0x7fdba4069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:45.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.749+0000 7fdbaadc9700 1 --2- 172.21.15.8:0/531662957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdba406b9c0 0x7fdba4069ec0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fdba0004660 tx=0x7fdba0009b30).stop 2023-10-18T21:57:45.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.749+0000 7fdbaadc9700 1 -- 172.21.15.8:0/531662957 shutdown_connections 2023-10-18T21:57:45.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.749+0000 7fdbaadc9700 1 --2- 172.21.15.8:0/531662957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba406a3b0 0x7fdba406a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:45.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.749+0000 7fdbaadc9700 1 --2- 172.21.15.8:0/531662957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdba406b9c0 0x7fdba4069ec0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:45.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.749+0000 7fdbaadc9700 1 -- 172.21.15.8:0/531662957 >> 172.21.15.8:0/531662957 conn(0x7fdba40f1c90 msgr2=0x7fdba40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:45.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.749+0000 7fdbaadc9700 1 -- 172.21.15.8:0/531662957 shutdown_connections 2023-10-18T21:57:45.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.750+0000 7fdbaadc9700 1 -- 172.21.15.8:0/531662957 wait complete. 2023-10-18T21:57:45.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.751+0000 7fdbaadc9700 1 Processor -- start 2023-10-18T21:57:45.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.751+0000 7fdbaadc9700 1 -- start start 2023-10-18T21:57:45.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.751+0000 7fdbaadc9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdba406a3b0 0x7fdba4108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:45.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.751+0000 7fdbaadc9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba406b9c0 0x7fdba4109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:45.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.751+0000 7fdbaadc9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba41099e0 con 0x7fdba406a3b0 2023-10-18T21:57:45.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.751+0000 7fdbaadc9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba4109b20 con 0x7fdba406b9c0 2023-10-18T21:57:45.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.752+0000 7fdba9dc7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdba406a3b0 0x7fdba4108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:45.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.752+0000 7fdba9dc7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdba406a3b0 0x7fdba4108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60734/0 (socket says 172.21.15.8:60734) 2023-10-18T21:57:45.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.752+0000 7fdba9dc7700 1 -- 172.21.15.8:0/4100192324 learned_addr learned my addr 172.21.15.8:0/4100192324 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:45.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.752+0000 7fdba95c6700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba406b9c0 0x7fdba4109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:45.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.752+0000 7fdba9dc7700 1 -- 172.21.15.8:0/4100192324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba406b9c0 msgr2=0x7fdba4109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:45.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.752+0000 7fdba9dc7700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba406b9c0 0x7fdba4109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:45.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.752+0000 7fdba9dc7700 1 -- 172.21.15.8:0/4100192324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0005040 con 0x7fdba406a3b0 2023-10-18T21:57:45.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.752+0000 7fdba9dc7700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdba406a3b0 0x7fdba4108f40 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fdba0004320 tx=0x7fdba000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:45.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.752+0000 7fdb9a7fc700 1 -- 172.21.15.8:0/4100192324 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba0019070 con 0x7fdba406a3b0 2023-10-18T21:57:45.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.753+0000 7fdb9a7fc700 1 -- 172.21.15.8:0/4100192324 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdba001e420 con 0x7fdba406a3b0 2023-10-18T21:57:45.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.753+0000 7fdb9a7fc700 1 -- 172.21.15.8:0/4100192324 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba0014680 con 0x7fdba406a3b0 2023-10-18T21:57:45.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.753+0000 7fdbaadc9700 1 -- 172.21.15.8:0/4100192324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba410a460 con 0x7fdba406a3b0 2023-10-18T21:57:45.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.753+0000 7fdbaadc9700 1 -- 172.21.15.8:0/4100192324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba410a8f0 con 0x7fdba406a3b0 2023-10-18T21:57:45.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.754+0000 7fdbaadc9700 1 -- 172.21.15.8:0/4100192324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba4045ad0 con 0x7fdba406a3b0 2023-10-18T21:57:45.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.755+0000 7fdb9a7fc700 1 -- 172.21.15.8:0/4100192324 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdba001e590 con 0x7fdba406a3b0 2023-10-18T21:57:45.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.755+0000 7fdb9a7fc700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb90060f70 0x7fdb90063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:45.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.756+0000 7fdb9a7fc700 1 -- 172.21.15.8:0/4100192324 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdba007dd00 con 0x7fdba406a3b0 2023-10-18T21:57:45.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.756+0000 7fdba95c6700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb90060f70 0x7fdb90063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:45.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.756+0000 7fdba95c6700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb90060f70 0x7fdb90063430 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fdb94009fd0 tx=0x7fdb9400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:45.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.760+0000 7fdb9a7fc700 1 -- 172.21.15.8:0/4100192324 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdba0081030 con 0x7fdba406a3b0 2023-10-18T21:57:45.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.959+0000 7fdbaadc9700 1 -- 172.21.15.8:0/4100192324 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdba4102f20 con 0x7fdb90060f70 2023-10-18T21:57:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.960+0000 7fdb9a7fc700 1 -- 172.21.15.8:0/4100192324 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdba4102f20 con 0x7fdb90060f70 2023-10-18T21:57:45.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.962+0000 7fdbaadc9700 1 -- 172.21.15.8:0/4100192324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb90060f70 msgr2=0x7fdb90063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:45.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.962+0000 7fdbaadc9700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb90060f70 0x7fdb90063430 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fdb94009fd0 tx=0x7fdb9400b040).stop 2023-10-18T21:57:45.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.962+0000 7fdbaadc9700 1 -- 172.21.15.8:0/4100192324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdba406a3b0 msgr2=0x7fdba4108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:45.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.962+0000 7fdbaadc9700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdba406a3b0 0x7fdba4108f40 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fdba0004320 tx=0x7fdba000b040).stop 2023-10-18T21:57:45.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.962+0000 7fdbaadc9700 1 -- 172.21.15.8:0/4100192324 shutdown_connections 2023-10-18T21:57:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.962+0000 7fdbaadc9700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdb90060f70 0x7fdb90063430 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.962+0000 7fdbaadc9700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdba406a3b0 0x7fdba4108f40 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.962+0000 7fdbaadc9700 1 --2- 172.21.15.8:0/4100192324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba406b9c0 0x7fdba4109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.962+0000 7fdbaadc9700 1 -- 172.21.15.8:0/4100192324 >> 172.21.15.8:0/4100192324 conn(0x7fdba40f1c90 msgr2=0x7fdba40fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:45.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.963+0000 7fdbaadc9700 1 -- 172.21.15.8:0/4100192324 shutdown_connections 2023-10-18T21:57:45.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:45.963+0000 7fdbaadc9700 1 -- 172.21.15.8:0/4100192324 wait complete. 2023-10-18T21:57:45.978 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:57:46.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.100+0000 7f0aad13c700 1 -- 172.21.15.8:0/3475497927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa80f6530 msgr2=0x7f0aa80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:46.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.100+0000 7f0aad13c700 1 --2- 172.21.15.8:0/3475497927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa80f6530 0x7f0aa80f6950 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f0a98004660 tx=0x7f0a98009b30).stop 2023-10-18T21:57:46.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.100+0000 7f0aad13c700 1 -- 172.21.15.8:0/3475497927 shutdown_connections 2023-10-18T21:57:46.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.100+0000 7f0aad13c700 1 --2- 172.21.15.8:0/3475497927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aa80f77d0 0x7f0aa80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.100+0000 7f0aad13c700 1 --2- 172.21.15.8:0/3475497927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa80f6530 0x7f0aa80f6950 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.100+0000 7f0aad13c700 1 -- 172.21.15.8:0/3475497927 >> 172.21.15.8:0/3475497927 conn(0x7f0aa80f1c70 msgr2=0x7f0aa80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.100+0000 7f0aad13c700 1 -- 172.21.15.8:0/3475497927 shutdown_connections 2023-10-18T21:57:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.100+0000 7f0aad13c700 1 -- 172.21.15.8:0/3475497927 wait complete. 2023-10-18T21:57:46.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.101+0000 7f0aad13c700 1 Processor -- start 2023-10-18T21:57:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.101+0000 7f0aad13c700 1 -- start start 2023-10-18T21:57:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aad13c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa80f6530 0x7f0aa8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aad13c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aa80f77d0 0x7f0aa8109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aad13c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8109a20 con 0x7f0aa80f6530 2023-10-18T21:57:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aad13c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8109b60 con 0x7f0aa80f77d0 2023-10-18T21:57:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aa7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa80f6530 0x7f0aa8108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aa7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa80f6530 0x7f0aa8108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60764/0 (socket says 172.21.15.8:60764) 2023-10-18T21:57:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aa7fff700 1 -- 172.21.15.8:0/3438570714 learned_addr learned my addr 172.21.15.8:0/3438570714 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aa77fe700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aa80f77d0 0x7f0aa8109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aa7fff700 1 -- 172.21.15.8:0/3438570714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aa80f77d0 msgr2=0x7f0aa8109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aa7fff700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aa80f77d0 0x7f0aa8109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aa7fff700 1 -- 172.21.15.8:0/3438570714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a98005040 con 0x7f0aa80f6530 2023-10-18T21:57:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.102+0000 7f0aa7fff700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa80f6530 0x7f0aa8108f80 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f0a98004e30 tx=0x7f0a98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.103+0000 7f0aa4ff9700 1 -- 172.21.15.8:0/3438570714 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a98018070 con 0x7f0aa80f6530 2023-10-18T21:57:46.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.103+0000 7f0aa4ff9700 1 -- 172.21.15.8:0/3438570714 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0a98009630 con 0x7f0aa80f6530 2023-10-18T21:57:46.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.103+0000 7f0aa4ff9700 1 -- 172.21.15.8:0/3438570714 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a9801c3c0 con 0x7f0aa80f6530 2023-10-18T21:57:46.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.103+0000 7f0aad13c700 1 -- 172.21.15.8:0/3438570714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa810a4a0 con 0x7f0aa80f6530 2023-10-18T21:57:46.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.103+0000 7f0aad13c700 1 -- 172.21.15.8:0/3438570714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa810aa00 con 0x7f0aa80f6530 2023-10-18T21:57:46.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.104+0000 7f0aad13c700 1 -- 172.21.15.8:0/3438570714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa8045ad0 con 0x7f0aa80f6530 2023-10-18T21:57:46.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.105+0000 7f0aa4ff9700 1 -- 172.21.15.8:0/3438570714 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0a9801d420 con 0x7f0aa80f6530 2023-10-18T21:57:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.106+0000 7f0aa4ff9700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a90060f70 0x7f0a90063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.106+0000 7f0aa4ff9700 1 -- 172.21.15.8:0/3438570714 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0a9807e540 con 0x7f0aa80f6530 2023-10-18T21:57:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.106+0000 7f0aa77fe700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a90060f70 0x7f0a90063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.107+0000 7f0aa77fe700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a90060f70 0x7f0a90063430 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f0a9c009740 tx=0x7f0a9c009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.110+0000 7f0aa4ff9700 1 -- 172.21.15.8:0/3438570714 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0a98051c50 con 0x7f0aa80f6530 2023-10-18T21:57:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:44.532714+0000 mgr.smithi008.flmjzp (mgr.14640) 3529 : cluster [DBG] pgmap v2427: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:46.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:44.532714+0000 mgr.smithi008.flmjzp (mgr.14640) 3529 : cluster [DBG] pgmap v2427: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.312+0000 7f0aad13c700 1 -- 172.21.15.8:0/3438570714 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0aa80fedd0 con 0x7f0a90060f70 2023-10-18T21:57:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.313+0000 7f0aa4ff9700 1 -- 172.21.15.8:0/3438570714 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0aa80fedd0 con 0x7f0a90060f70 2023-10-18T21:57:46.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.315+0000 7f0aad13c700 1 -- 172.21.15.8:0/3438570714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a90060f70 msgr2=0x7f0a90063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:46.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.315+0000 7f0aad13c700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a90060f70 0x7f0a90063430 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f0a9c009740 tx=0x7f0a9c009c60).stop 2023-10-18T21:57:46.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.315+0000 7f0aad13c700 1 -- 172.21.15.8:0/3438570714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa80f6530 msgr2=0x7f0aa8108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:46.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.315+0000 7f0aad13c700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa80f6530 0x7f0aa8108f80 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f0a98004e30 tx=0x7f0a98009b30).stop 2023-10-18T21:57:46.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.315+0000 7f0aad13c700 1 -- 172.21.15.8:0/3438570714 shutdown_connections 2023-10-18T21:57:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.315+0000 7f0aad13c700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a90060f70 0x7f0a90063430 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.315+0000 7f0aad13c700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa80f6530 0x7f0aa8108f80 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.315+0000 7f0aad13c700 1 --2- 172.21.15.8:0/3438570714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aa80f77d0 0x7f0aa8109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.315+0000 7f0aad13c700 1 -- 172.21.15.8:0/3438570714 >> 172.21.15.8:0/3438570714 conn(0x7f0aa80f1c70 msgr2=0x7f0aa80f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:46.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.315+0000 7f0aad13c700 1 -- 172.21.15.8:0/3438570714 shutdown_connections 2023-10-18T21:57:46.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.316+0000 7f0aad13c700 1 -- 172.21.15.8:0/3438570714 wait complete. 2023-10-18T21:57:46.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.452+0000 7f8b97fff700 1 -- 172.21.15.8:0/1167450113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b980f77d0 msgr2=0x7f8b980f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:46.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.452+0000 7f8b97fff700 1 --2- 172.21.15.8:0/1167450113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b980f77d0 0x7f8b980f7c30 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f8b8c004660 tx=0x7f8b8c009b30).stop 2023-10-18T21:57:46.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.452+0000 7f8b97fff700 1 -- 172.21.15.8:0/1167450113 shutdown_connections 2023-10-18T21:57:46.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.452+0000 7f8b97fff700 1 --2- 172.21.15.8:0/1167450113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b980f77d0 0x7f8b980f7c30 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.452+0000 7f8b97fff700 1 --2- 172.21.15.8:0/1167450113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980f6530 0x7f8b980f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:57:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.452+0000 7f8b97fff700 1 -- 172.21.15.8:0/1167450113 >> 172.21.15.8:0/1167450113 conn(0x7f8b980f1c90 msgr2=0x7f8b980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.452+0000 7f8b97fff700 1 -- 172.21.15.8:0/1167450113 shutdown_connections 2023-10-18T21:57:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.452+0000 7f8b97fff700 1 -- 172.21.15.8:0/1167450113 wait complete. 2023-10-18T21:57:46.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.453+0000 7f8b97fff700 1 Processor -- start 2023-10-18T21:57:46.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.453+0000 7f8b97fff700 1 -- start start 2023-10-18T21:57:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.454+0000 7f8b97fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b980f6530 0x7f8b9806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.454+0000 7f8b97fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980f77d0 0x7f8b98069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.454+0000 7f8b97fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9806a410 con 0x7f8b980f6530 2023-10-18T21:57:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.454+0000 7f8b97fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9806a550 con 0x7f8b980f77d0 2023-10-18T21:57:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.454+0000 7f8b96ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b980f6530 0x7f8b9806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.454+0000 7f8b967fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980f77d0 0x7f8b98069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.454+0000 7f8b96ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b980f6530 0x7f8b9806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60784/0 (socket says 172.21.15.8:60784) 2023-10-18T21:57:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.454+0000 7f8b96ffd700 1 -- 172.21.15.8:0/529056266 learned_addr learned my addr 172.21.15.8:0/529056266 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:46.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.455+0000 7f8b967fc700 1 -- 172.21.15.8:0/529056266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b980f6530 msgr2=0x7f8b9806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:46.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.455+0000 7f8b967fc700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b980f6530 0x7f8b9806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.455+0000 7f8b967fc700 1 -- 172.21.15.8:0/529056266 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c005040 con 0x7f8b980f77d0 2023-10-18T21:57:46.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.455+0000 7f8b96ffd700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b980f6530 0x7f8b9806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:57:46.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.455+0000 7f8b967fc700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980f77d0 0x7f8b98069e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f8b8c004660 tx=0x7f8b8c009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.455+0000 7f8b7f7fe700 1 -- 172.21.15.8:0/529056266 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b8c018070 con 0x7f8b980f77d0 2023-10-18T21:57:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.455+0000 7f8b97fff700 1 -- 172.21.15.8:0/529056266 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9806a7d0 con 0x7f8b980f77d0 2023-10-18T21:57:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.455+0000 7f8b7f7fe700 1 -- 172.21.15.8:0/529056266 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8b8c007e80 con 0x7f8b980f77d0 2023-10-18T21:57:46.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.455+0000 7f8b7f7fe700 1 -- 172.21.15.8:0/529056266 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b8c01c560 con 0x7f8b980f77d0 2023-10-18T21:57:46.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.455+0000 7f8b97fff700 1 -- 172.21.15.8:0/529056266 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9810ede0 con 0x7f8b980f77d0 2023-10-18T21:57:46.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.456+0000 7f8b97fff700 1 -- 172.21.15.8:0/529056266 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b98045ad0 con 0x7f8b980f77d0 2023-10-18T21:57:46.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.457+0000 7f8b7f7fe700 1 -- 172.21.15.8:0/529056266 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8b8c01d420 con 0x7f8b980f77d0 2023-10-18T21:57:46.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.458+0000 7f8b7f7fe700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b80060f70 0x7f8b80063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:46.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.458+0000 7f8b7f7fe700 1 -- 172.21.15.8:0/529056266 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8b8c07eb70 con 0x7f8b980f77d0 2023-10-18T21:57:46.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.459+0000 7f8b96ffd700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b80060f70 0x7f8b80063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:46.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.459+0000 7f8b96ffd700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b80060f70 0x7f8b80063430 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f8b9806b730 tx=0x7f8b88006ec0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:46.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.462+0000 7f8b7f7fe700 1 -- 172.21.15.8:0/529056266 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8b8c04e780 con 0x7f8b980f77d0 2023-10-18T21:57:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.660+0000 7f8b97fff700 1 -- 172.21.15.8:0/529056266 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b98057f10 con 0x7f8b80060f70 2023-10-18T21:57:46.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.669+0000 7f8b7f7fe700 1 -- 172.21.15.8:0/529056266 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8b98057f10 con 0x7f8b80060f70 2023-10-18T21:57:46.671 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:57:46.671 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (64m) 112s ago 65m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:57:46.671 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (58m) 112s ago 65m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:57:46.671 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (58m) 9m ago 65m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:57:46.671 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (64m) 112s ago 65m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:57:46.672 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 112s ago 61m - - 2023-10-18T21:57:46.672 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 112s ago 61m - - 2023-10-18T21:57:46.672 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 61m - - 2023-10-18T21:57:46.672 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 61m - - 2023-10-18T21:57:46.672 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (59m) 112s ago 67m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:57:46.673 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (58m) 9m ago 65m 405M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:57:46.673 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (58m) 112s ago 67m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:57:46.673 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (58m) 9m ago 64m 234M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:57:46.673 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (65m) 112s ago 65m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:57:46.673 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (64m) 9m ago 64m 10.6M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:57:46.674 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (58m) 112s ago 64m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:57:46.674 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (56m) 112s ago 64m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:57:46.674 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (55m) 112s ago 63m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:57:46.674 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (55m) 9m ago 63m 464M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:57:46.674 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (54m) 9m ago 63m 406M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:57:46.675 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (53m) 9m ago 63m 330M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:57:46.675 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (59m) 112s ago 65m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:57:46.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.671+0000 7f8b97fff700 1 -- 172.21.15.8:0/529056266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b80060f70 msgr2=0x7f8b80063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:46.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.671+0000 7f8b97fff700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b80060f70 0x7f8b80063430 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f8b9806b730 tx=0x7f8b88006ec0).stop 2023-10-18T21:57:46.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.671+0000 7f8b97fff700 1 -- 172.21.15.8:0/529056266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980f77d0 msgr2=0x7f8b98069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:46.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.671+0000 7f8b97fff700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980f77d0 0x7f8b98069e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f8b8c004660 tx=0x7f8b8c009b30).stop 2023-10-18T21:57:46.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.671+0000 7f8b97fff700 1 -- 172.21.15.8:0/529056266 shutdown_connections 2023-10-18T21:57:46.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.671+0000 7f8b97fff700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b80060f70 0x7f8b80063430 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.671+0000 7f8b97fff700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b980f6530 0x7f8b9806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.671+0000 7f8b97fff700 1 --2- 172.21.15.8:0/529056266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980f77d0 0x7f8b98069e20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.671+0000 7f8b97fff700 1 -- 172.21.15.8:0/529056266 >> 172.21.15.8:0/529056266 conn(0x7f8b980f1c90 msgr2=0x7f8b980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:46.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.671+0000 7f8b97fff700 1 -- 172.21.15.8:0/529056266 shutdown_connections 2023-10-18T21:57:46.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.672+0000 7f8b97fff700 1 -- 172.21.15.8:0/529056266 wait complete. 2023-10-18T21:57:46.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.807+0000 7f911eb18700 1 -- 172.21.15.8:0/3084532429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91180f6530 msgr2=0x7f91180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:46.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.807+0000 7f911eb18700 1 --2- 172.21.15.8:0/3084532429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91180f6530 0x7f91180f6950 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f9114004660 tx=0x7f9114009b30).stop 2023-10-18T21:57:46.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.807+0000 7f911eb18700 1 -- 172.21.15.8:0/3084532429 shutdown_connections 2023-10-18T21:57:46.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.807+0000 7f911eb18700 1 --2- 172.21.15.8:0/3084532429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91180f77d0 0x7f91180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.807+0000 7f911eb18700 1 --2- 172.21.15.8:0/3084532429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91180f6530 0x7f91180f6950 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.807+0000 7f911eb18700 1 -- 172.21.15.8:0/3084532429 >> 172.21.15.8:0/3084532429 conn(0x7f91180f1c90 msgr2=0x7f91180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:46.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.808+0000 7f911eb18700 1 -- 172.21.15.8:0/3084532429 shutdown_connections 2023-10-18T21:57:46.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.808+0000 7f911eb18700 1 -- 172.21.15.8:0/3084532429 wait complete. 2023-10-18T21:57:46.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.808+0000 7f911eb18700 1 Processor -- start 2023-10-18T21:57:46.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.809+0000 7f911eb18700 1 -- start start 2023-10-18T21:57:46.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.809+0000 7f911eb18700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91180f6530 0x7f9118108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:46.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.809+0000 7f911eb18700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91180f77d0 0x7f9118109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:46.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.809+0000 7f911eb18700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91181099e0 con 0x7f91180f6530 2023-10-18T21:57:46.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.809+0000 7f911eb18700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9118109b20 con 0x7f91180f77d0 2023-10-18T21:57:46.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.809+0000 7f911db16700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91180f6530 0x7f9118108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:46.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.809+0000 7f911d315700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91180f77d0 0x7f9118109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:46.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.809+0000 7f911d315700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91180f77d0 0x7f9118109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:58100/0 (socket says 172.21.15.8:58100) 2023-10-18T21:57:46.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.809+0000 7f911d315700 1 -- 172.21.15.8:0/2747748781 learned_addr learned my addr 172.21.15.8:0/2747748781 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:46.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.810+0000 7f911d315700 1 -- 172.21.15.8:0/2747748781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91180f6530 msgr2=0x7f9118108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:46.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.810+0000 7f911d315700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91180f6530 0x7f9118108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:46.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.810+0000 7f911d315700 1 -- 172.21.15.8:0/2747748781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114005040 con 0x7f91180f77d0 2023-10-18T21:57:46.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.810+0000 7f911db16700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91180f6530 0x7f9118108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T21:57:46.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.810+0000 7f911d315700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91180f77d0 0x7f9118109430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f910800e7f0 tx=0x7f910800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:46.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.810+0000 7f910e7fc700 1 -- 172.21.15.8:0/2747748781 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91080092e0 con 0x7f91180f77d0 2023-10-18T21:57:46.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.810+0000 7f911eb18700 1 -- 172.21.15.8:0/2747748781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911810a4c0 con 0x7f91180f77d0 2023-10-18T21:57:46.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.810+0000 7f910e7fc700 1 -- 172.21.15.8:0/2747748781 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f910800f040 con 0x7f91180f77d0 2023-10-18T21:57:46.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.810+0000 7f910e7fc700 1 -- 172.21.15.8:0/2747748781 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91080147e0 con 0x7f91180f77d0 2023-10-18T21:57:46.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.810+0000 7f911eb18700 1 -- 172.21.15.8:0/2747748781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911810aa00 con 0x7f91180f77d0 2023-10-18T21:57:46.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.811+0000 7f911eb18700 1 -- 172.21.15.8:0/2747748781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9118045ad0 con 0x7f91180f77d0 2023-10-18T21:57:46.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.812+0000 7f910e7fc700 1 -- 172.21.15.8:0/2747748781 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f910801b030 con 0x7f91180f77d0 2023-10-18T21:57:46.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.813+0000 7f910e7fc700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9104060f70 0x7f9104063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:46.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.813+0000 7f910e7fc700 1 -- 172.21.15.8:0/2747748781 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f910807c8f0 con 0x7f91180f77d0 2023-10-18T21:57:46.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.813+0000 7f911db16700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9104060f70 0x7f9104063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:46.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.814+0000 7f911db16700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9104060f70 0x7f9104063430 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f9114000c00 tx=0x7f9114016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:46.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:46.821+0000 7f910e7fc700 1 -- 172.21.15.8:0/2747748781 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f910804fed0 con 0x7f91180f77d0 2023-10-18T21:57:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.080+0000 7f911eb18700 1 -- 172.21.15.8:0/2747748781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f91180fedc0 con 0x7f91180f77d0 2023-10-18T21:57:47.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.081+0000 7f910e7fc700 1 -- 172.21.15.8:0/2747748781 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f9108019070 con 0x7f91180f77d0 2023-10-18T21:57:47.083 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:57:47.083 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:57:47.083 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:57:47.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:57:47.083 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:57:47.084 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:57:47.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:57:47.084 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:57:47.084 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:57:47.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:57:47.085 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:57:47.085 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:57:47.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:57:47.085 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:57:47.085 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:57:47.086 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:57:47.086 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:57:47.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 -- 172.21.15.8:0/2747748781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9104060f70 msgr2=0x7f9104063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:47.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9104060f70 0x7f9104063430 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f9114000c00 tx=0x7f9114016040).stop 2023-10-18T21:57:47.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 -- 172.21.15.8:0/2747748781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91180f77d0 msgr2=0x7f9118109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:47.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91180f77d0 0x7f9118109430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f910800e7f0 tx=0x7f910800b040).stop 2023-10-18T21:57:47.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 -- 172.21.15.8:0/2747748781 shutdown_connections 2023-10-18T21:57:47.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9104060f70 0x7f9104063430 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91180f6530 0x7f9118108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 --2- 172.21.15.8:0/2747748781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91180f77d0 0x7f9118109430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 -- 172.21.15.8:0/2747748781 >> 172.21.15.8:0/2747748781 conn(0x7f91180f1c90 msgr2=0x7f911806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 -- 172.21.15.8:0/2747748781 shutdown_connections 2023-10-18T21:57:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.084+0000 7f911eb18700 1 -- 172.21.15.8:0/2747748781 wait complete. 2023-10-18T21:57:47.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.223+0000 7f91996cb700 1 -- 172.21.15.8:0/1822052923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91940f99e0 msgr2=0x7f91940f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:47.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.223+0000 7f91996cb700 1 --2- 172.21.15.8:0/1822052923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91940f99e0 0x7f91940f9e40 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f9188004660 tx=0x7f9188009b30).stop 2023-10-18T21:57:47.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.223+0000 7f91996cb700 1 -- 172.21.15.8:0/1822052923 shutdown_connections 2023-10-18T21:57:47.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.223+0000 7f91996cb700 1 --2- 172.21.15.8:0/1822052923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91940f99e0 0x7f91940f9e40 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.223+0000 7f91996cb700 1 --2- 172.21.15.8:0/1822052923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91940f8740 0x7f91940f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.223+0000 7f91996cb700 1 -- 172.21.15.8:0/1822052923 >> 172.21.15.8:0/1822052923 conn(0x7f91940f40e0 msgr2=0x7f91940f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:47.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.223+0000 7f91996cb700 1 -- 172.21.15.8:0/1822052923 shutdown_connections 2023-10-18T21:57:47.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.223+0000 7f91996cb700 1 -- 172.21.15.8:0/1822052923 wait complete. 2023-10-18T21:57:47.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.224+0000 7f91996cb700 1 Processor -- start 2023-10-18T21:57:47.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.224+0000 7f91996cb700 1 -- start start 2023-10-18T21:57:47.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.224+0000 7f91996cb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91940f8740 0x7f9194108ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:47.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.224+0000 7f91996cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91940f99e0 0x7f91941093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:47.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.224+0000 7f91996cb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194109960 con 0x7f91940f8740 2023-10-18T21:57:47.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.224+0000 7f91996cb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194109aa0 con 0x7f91940f99e0 2023-10-18T21:57:47.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.224+0000 7f9193fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91940f8740 0x7f9194108ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:47.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.224+0000 7f9193fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91940f8740 0x7f9194108ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52530/0 (socket says 172.21.15.8:52530) 2023-10-18T21:57:47.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.224+0000 7f9193fff700 1 -- 172.21.15.8:0/3019759587 learned_addr learned my addr 172.21.15.8:0/3019759587 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:47.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.224+0000 7f91937fe700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91940f99e0 0x7f91941093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:47.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.225+0000 7f9193fff700 1 -- 172.21.15.8:0/3019759587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91940f99e0 msgr2=0x7f91941093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:47.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.225+0000 7f9193fff700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91940f99e0 0x7f91941093b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.225+0000 7f9193fff700 1 -- 172.21.15.8:0/3019759587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188005040 con 0x7f91940f8740 2023-10-18T21:57:47.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.225+0000 7f9193fff700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91940f8740 0x7f9194108ec0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f918400e7c0 tx=0x7f918400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:47.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.225+0000 7f9190ff9700 1 -- 172.21.15.8:0/3019759587 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91840092e0 con 0x7f91940f8740 2023-10-18T21:57:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.225+0000 7f9190ff9700 1 -- 172.21.15.8:0/3019759587 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f918400f040 con 0x7f91940f8740 2023-10-18T21:57:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.225+0000 7f91996cb700 1 -- 172.21.15.8:0/3019759587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919410a440 con 0x7f91940f8740 2023-10-18T21:57:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.225+0000 7f9190ff9700 1 -- 172.21.15.8:0/3019759587 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9184014810 con 0x7f91940f8740 2023-10-18T21:57:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.226+0000 7f91996cb700 1 -- 172.21.15.8:0/3019759587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919410a980 con 0x7f91940f8740 2023-10-18T21:57:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.227+0000 7f91996cb700 1 -- 172.21.15.8:0/3019759587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9194045ad0 con 0x7f91940f8740 2023-10-18T21:57:47.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.227+0000 7f9190ff9700 1 -- 172.21.15.8:0/3019759587 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f918401b030 con 0x7f91940f8740 2023-10-18T21:57:47.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.228+0000 7f9190ff9700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f917c060f70 0x7f917c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:47.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.228+0000 7f9190ff9700 1 -- 172.21.15.8:0/3019759587 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f918407c860 con 0x7f91940f8740 2023-10-18T21:57:47.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.228+0000 7f91937fe700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f917c060f70 0x7f917c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:47.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.229+0000 7f91937fe700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f917c060f70 0x7f917c063430 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f9188005010 tx=0x7f9188016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:47.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.233+0000 7f9190ff9700 1 -- 172.21.15.8:0/3019759587 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f918404ff00 con 0x7f91940f8740 2023-10-18T21:57:47.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:45.960743+0000 mgr.smithi008.flmjzp (mgr.14640) 3530 : audit [DBG] from='client.36904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:46.563316+0000 mon.smithi008 (mon.0) 3880 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:45.960743+0000 mgr.smithi008.flmjzp (mgr.14640) 3530 : audit [DBG] from='client.36904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:46.563316+0000 mon.smithi008 (mon.0) 3880 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:47.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.456+0000 7f91996cb700 1 -- 172.21.15.8:0/3019759587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9194100fa0 con 0x7f91940f8740 2023-10-18T21:57:47.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.456+0000 7f9190ff9700 1 -- 172.21.15.8:0/3019759587 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f9184019030 con 0x7f91940f8740 2023-10-18T21:57:47.458 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:57:47.458 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:57:47.459 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:57:47.459 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:57:47.459 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:57:47.459 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:57:47.459 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:57:47.460 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:57:47.460 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:57:47.460 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:57:47.460 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:57:47.460 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:57:47.461 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:57:47.461 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:57:47.461 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:57:47.461 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:57:47.461 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:57:47.462 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:57:47.462 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:57:47.462 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:57:47.462 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:57:47.462 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:57:47.463 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:57:47.463 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:57:47.463 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:57:47.463 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:57:47.463 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:57:47.464 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:57:47.464 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:57:47.464 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:57:47.464 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:57:47.464 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:57:47.465 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:57:47.465 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:57:47.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.458+0000 7f91996cb700 1 -- 172.21.15.8:0/3019759587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f917c060f70 msgr2=0x7f917c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:47.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.458+0000 7f91996cb700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f917c060f70 0x7f917c063430 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f9188005010 tx=0x7f9188016040).stop 2023-10-18T21:57:47.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.458+0000 7f91996cb700 1 -- 172.21.15.8:0/3019759587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91940f8740 msgr2=0x7f9194108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:47.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.458+0000 7f91996cb700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91940f8740 0x7f9194108ec0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f918400e7c0 tx=0x7f918400b040).stop 2023-10-18T21:57:47.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.458+0000 7f91996cb700 1 -- 172.21.15.8:0/3019759587 shutdown_connections 2023-10-18T21:57:47.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.458+0000 7f91996cb700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f917c060f70 0x7f917c063430 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.458+0000 7f91996cb700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91940f8740 0x7f9194108ec0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.458+0000 7f91996cb700 1 --2- 172.21.15.8:0/3019759587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91940f99e0 0x7f91941093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.458+0000 7f91996cb700 1 -- 172.21.15.8:0/3019759587 >> 172.21.15.8:0/3019759587 conn(0x7f91940f40e0 msgr2=0x7f91940fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:47.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.459+0000 7f91996cb700 1 -- 172.21.15.8:0/3019759587 shutdown_connections 2023-10-18T21:57:47.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.459+0000 7f91996cb700 1 -- 172.21.15.8:0/3019759587 wait complete. 2023-10-18T21:57:47.468 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:57:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.596+0000 7f42149a2700 1 -- 172.21.15.8:0/3823666363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42100f6530 msgr2=0x7f42100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.596+0000 7f42149a2700 1 --2- 172.21.15.8:0/3823666363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42100f6530 0x7f42100f6950 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f4200004660 tx=0x7f4200009b30).stop 2023-10-18T21:57:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.596+0000 7f42149a2700 1 -- 172.21.15.8:0/3823666363 shutdown_connections 2023-10-18T21:57:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.596+0000 7f42149a2700 1 --2- 172.21.15.8:0/3823666363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42100f77d0 0x7f42100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.596+0000 7f42149a2700 1 --2- 172.21.15.8:0/3823666363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42100f6530 0x7f42100f6950 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.596+0000 7f42149a2700 1 -- 172.21.15.8:0/3823666363 >> 172.21.15.8:0/3823666363 conn(0x7f42100f1c90 msgr2=0x7f42100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:47.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.596+0000 7f42149a2700 1 -- 172.21.15.8:0/3823666363 shutdown_connections 2023-10-18T21:57:47.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.596+0000 7f42149a2700 1 -- 172.21.15.8:0/3823666363 wait complete. 2023-10-18T21:57:47.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.597+0000 7f42149a2700 1 Processor -- start 2023-10-18T21:57:47.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.597+0000 7f42149a2700 1 -- start start 2023-10-18T21:57:47.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.598+0000 7f42149a2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42100f6530 0x7f4210106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:47.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.598+0000 7f42149a2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42100f77d0 0x7f4210107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:47.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.598+0000 7f42149a2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4210107880 con 0x7f42100f6530 2023-10-18T21:57:47.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.598+0000 7f42149a2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42101080c0 con 0x7f42100f77d0 2023-10-18T21:57:47.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.598+0000 7f420ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42100f6530 0x7f4210106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:47.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.598+0000 7f420ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42100f6530 0x7f4210106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52546/0 (socket says 172.21.15.8:52546) 2023-10-18T21:57:47.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.598+0000 7f420ed9d700 1 -- 172.21.15.8:0/1914886746 learned_addr learned my addr 172.21.15.8:0/1914886746 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:57:47.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.598+0000 7f420e59c700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42100f77d0 0x7f4210107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:47.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.599+0000 7f420ed9d700 1 -- 172.21.15.8:0/1914886746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42100f77d0 msgr2=0x7f4210107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:47.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.599+0000 7f420ed9d700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42100f77d0 0x7f4210107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.599+0000 7f420ed9d700 1 -- 172.21.15.8:0/1914886746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200005040 con 0x7f42100f6530 2023-10-18T21:57:47.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.599+0000 7f420ed9d700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42100f6530 0x7f4210106d90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f4200014040 tx=0x7f420000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:47.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.599+0000 7f41f77fe700 1 -- 172.21.15.8:0/1914886746 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4200019070 con 0x7f42100f6530 2023-10-18T21:57:47.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.599+0000 7f41f77fe700 1 -- 172.21.15.8:0/1914886746 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f420001e420 con 0x7f42100f6530 2023-10-18T21:57:47.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.599+0000 7f42149a2700 1 -- 172.21.15.8:0/1914886746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4210108340 con 0x7f42100f6530 2023-10-18T21:57:47.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.599+0000 7f41f77fe700 1 -- 172.21.15.8:0/1914886746 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4200014620 con 0x7f42100f6530 2023-10-18T21:57:47.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.599+0000 7f42149a2700 1 -- 172.21.15.8:0/1914886746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4210108820 con 0x7f42100f6530 2023-10-18T21:57:47.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.600+0000 7f42149a2700 1 -- 172.21.15.8:0/1914886746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4210059100 con 0x7f42100f6530 2023-10-18T21:57:47.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.601+0000 7f41f77fe700 1 -- 172.21.15.8:0/1914886746 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f420001e9e0 con 0x7f42100f6530 2023-10-18T21:57:47.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.602+0000 7f41f77fe700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41f8060f70 0x7f41f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:57:47.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.602+0000 7f41f77fe700 1 -- 172.21.15.8:0/1914886746 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f420007dcf0 con 0x7f42100f6530 2023-10-18T21:57:47.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.602+0000 7f420e59c700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41f8060f70 0x7f41f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:57:47.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.603+0000 7f420e59c700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41f8060f70 0x7f41f8063430 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f4210106b20 tx=0x7f420400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:57:47.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.606+0000 7f41f77fe700 1 -- 172.21.15.8:0/1914886746 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f420004d960 con 0x7f42100f6530 2023-10-18T21:57:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.804+0000 7f42149a2700 1 -- 172.21.15.8:0/1914886746 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42100fedd0 con 0x7f41f8060f70 2023-10-18T21:57:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.806+0000 7f41f77fe700 1 -- 172.21.15.8:0/1914886746 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f42100fedd0 con 0x7f41f8060f70 2023-10-18T21:57:47.807 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:57:47.807 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:57:47.808 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:57:47.808 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:57:47.808 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:57:47.808 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:57:47.809 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:57:47.809 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:57:47.809 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:57:47.809 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:57:47.809 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:57:47.810 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:57:47.810 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:57:47.810 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:57:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 -- 172.21.15.8:0/1914886746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41f8060f70 msgr2=0x7f41f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41f8060f70 0x7f41f8063430 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f4210106b20 tx=0x7f420400b040).stop 2023-10-18T21:57:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 -- 172.21.15.8:0/1914886746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42100f6530 msgr2=0x7f4210106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:57:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42100f6530 0x7f4210106d90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f4200014040 tx=0x7f420000b040).stop 2023-10-18T21:57:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 -- 172.21.15.8:0/1914886746 shutdown_connections 2023-10-18T21:57:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41f8060f70 0x7f41f8063430 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42100f6530 0x7f4210106d90 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 --2- 172.21.15.8:0/1914886746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42100f77d0 0x7f4210107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:57:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 -- 172.21.15.8:0/1914886746 >> 172.21.15.8:0/1914886746 conn(0x7f42100f1c90 msgr2=0x7f42100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:57:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 -- 172.21.15.8:0/1914886746 shutdown_connections 2023-10-18T21:57:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:57:47.808+0000 7f42149a2700 1 -- 172.21.15.8:0/1914886746 wait complete. 2023-10-18T21:57:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:46.313559+0000 mgr.smithi008.flmjzp (mgr.14640) 3531 : audit [DBG] from='client.36908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:46.533302+0000 mgr.smithi008.flmjzp (mgr.14640) 3532 : cluster [DBG] pgmap v2428: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:48.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:46.661345+0000 mgr.smithi008.flmjzp (mgr.14640) 3533 : audit [DBG] from='client.46571 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.081700+0000 mon.smithi060 (mon.1) 9 : audit [DBG] from='client.? 172.21.15.8:0/2747748781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.124829+0000 mon.smithi008 (mon.0) 3881 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:57:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.125704+0000 mon.smithi008 (mon.0) 3882 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:57:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:47.126389+0000 mgr.smithi008.flmjzp (mgr.14640) 3534 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:57:48.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:47.127020+0000 mgr.smithi008.flmjzp (mgr.14640) 3535 : cluster [DBG] pgmap v2429: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:48.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:47.127345+0000 mgr.smithi008.flmjzp (mgr.14640) 3536 : cluster [DBG] pgmap v2430: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:48.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.131428+0000 mon.smithi008 (mon.0) 3883 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:57:48.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.136582+0000 mon.smithi008 (mon.0) 3884 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:48.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.139481+0000 mon.smithi008 (mon.0) 3885 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:48.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.140928+0000 mon.smithi008 (mon.0) 3886 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:48.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.142361+0000 mon.smithi008 (mon.0) 3887 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:48.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.144081+0000 mon.smithi008 (mon.0) 3888 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:48.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:47.145883+0000 mgr.smithi008.flmjzp (mgr.14640) 3537 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:57:48.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.457063+0000 mon.smithi008 (mon.0) 3889 : audit [DBG] from='client.? 172.21.15.8:0/3019759587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:57:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:46.313559+0000 mgr.smithi008.flmjzp (mgr.14640) 3531 : audit [DBG] from='client.36908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:46.533302+0000 mgr.smithi008.flmjzp (mgr.14640) 3532 : cluster [DBG] pgmap v2428: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:46.661345+0000 mgr.smithi008.flmjzp (mgr.14640) 3533 : audit [DBG] from='client.46571 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.081700+0000 mon.smithi060 (mon.1) 9 : audit [DBG] from='client.? 172.21.15.8:0/2747748781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.124829+0000 mon.smithi008 (mon.0) 3881 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:57:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.125704+0000 mon.smithi008 (mon.0) 3882 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:57:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:47.126389+0000 mgr.smithi008.flmjzp (mgr.14640) 3534 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:57:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:47.127020+0000 mgr.smithi008.flmjzp (mgr.14640) 3535 : cluster [DBG] pgmap v2429: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:47.127345+0000 mgr.smithi008.flmjzp (mgr.14640) 3536 : cluster [DBG] pgmap v2430: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.131428+0000 mon.smithi008 (mon.0) 3883 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:57:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.136582+0000 mon.smithi008 (mon.0) 3884 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:48.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.139481+0000 mon.smithi008 (mon.0) 3885 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:48.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.140928+0000 mon.smithi008 (mon.0) 3886 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:48.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.142361+0000 mon.smithi008 (mon.0) 3887 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:48.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.144081+0000 mon.smithi008 (mon.0) 3888 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:57:48.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:47.145883+0000 mgr.smithi008.flmjzp (mgr.14640) 3537 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:57:48.312 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.457063+0000 mon.smithi008 (mon.0) 3889 : audit [DBG] from='client.? 172.21.15.8:0/3019759587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:57:49.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:47.806156+0000 mgr.smithi008.flmjzp (mgr.14640) 3538 : audit [DBG] from='client.36924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:47.806156+0000 mgr.smithi008.flmjzp (mgr.14640) 3538 : audit [DBG] from='client.36924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:57:50.216 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:49.128029+0000 mgr.smithi008.flmjzp (mgr.14640) 3539 : cluster [DBG] pgmap v2431: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:50.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:49.128029+0000 mgr.smithi008.flmjzp (mgr.14640) 3539 : cluster [DBG] pgmap v2431: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:52.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:51.128659+0000 mgr.smithi008.flmjzp (mgr.14640) 3540 : cluster [DBG] pgmap v2432: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:51.128659+0000 mgr.smithi008.flmjzp (mgr.14640) 3540 : cluster [DBG] pgmap v2432: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:53.129222+0000 mgr.smithi008.flmjzp (mgr.14640) 3541 : cluster [DBG] pgmap v2433: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:53.129222+0000 mgr.smithi008.flmjzp (mgr.14640) 3541 : cluster [DBG] pgmap v2433: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:56.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:55.129804+0000 mgr.smithi008.flmjzp (mgr.14640) 3542 : cluster [DBG] pgmap v2434: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:55.129804+0000 mgr.smithi008.flmjzp (mgr.14640) 3542 : cluster [DBG] pgmap v2434: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:57.156015+0000 mon.smithi008 (mon.0) 3890 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:57.156015+0000 mon.smithi008 (mon.0) 3890 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:57:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:57:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:57.130344+0000 mgr.smithi008.flmjzp (mgr.14640) 3543 : cluster [DBG] pgmap v2435: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:57:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:57:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:57.130344+0000 mgr.smithi008.flmjzp (mgr.14640) 3543 : cluster [DBG] pgmap v2435: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:59.130938+0000 mgr.smithi008.flmjzp (mgr.14640) 3544 : cluster [DBG] pgmap v2436: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:59.836350+0000 mon.smithi008 (mon.0) 3891 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:59.837444+0000 mon.smithi008 (mon.0) 3892 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:00.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:59.838526+0000 mon.smithi008 (mon.0) 3893 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:00.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:59.844807+0000 mon.smithi008 (mon.0) 3894 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:00.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:59.851210+0000 mon.smithi008 (mon.0) 3895 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:00.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:59.854218+0000 mon.smithi008 (mon.0) 3896 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:00.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:59.855915+0000 mon.smithi008 (mon.0) 3897 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:00.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:59.857561+0000 mon.smithi008 (mon.0) 3898 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:00.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:57:59.859626+0000 mon.smithi008 (mon.0) 3899 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:59.130938+0000 mgr.smithi008.flmjzp (mgr.14640) 3544 : cluster [DBG] pgmap v2436: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:59.836350+0000 mon.smithi008 (mon.0) 3891 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:59.837444+0000 mon.smithi008 (mon.0) 3892 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:59.838526+0000 mon.smithi008 (mon.0) 3893 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:59.844807+0000 mon.smithi008 (mon.0) 3894 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:59.851210+0000 mon.smithi008 (mon.0) 3895 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:59.854218+0000 mon.smithi008 (mon.0) 3896 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:59.855915+0000 mon.smithi008 (mon.0) 3897 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:59.857561+0000 mon.smithi008 (mon.0) 3898 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:57:59.859626+0000 mon.smithi008 (mon.0) 3899 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:59.839413+0000 mgr.smithi008.flmjzp (mgr.14640) 3545 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:59.840117+0000 mgr.smithi008.flmjzp (mgr.14640) 3546 : cluster [DBG] pgmap v2437: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:57:59.840408+0000 mgr.smithi008.flmjzp (mgr.14640) 3547 : cluster [DBG] pgmap v2438: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:57:59.861612+0000 mgr.smithi008.flmjzp (mgr.14640) 3548 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:59.839413+0000 mgr.smithi008.flmjzp (mgr.14640) 3545 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:59.840117+0000 mgr.smithi008.flmjzp (mgr.14640) 3546 : cluster [DBG] pgmap v2437: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:57:59.840408+0000 mgr.smithi008.flmjzp (mgr.14640) 3547 : cluster [DBG] pgmap v2438: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:57:59.861612+0000 mgr.smithi008.flmjzp (mgr.14640) 3548 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:03.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:01.841086+0000 mgr.smithi008.flmjzp (mgr.14640) 3549 : cluster [DBG] pgmap v2439: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:01.841086+0000 mgr.smithi008.flmjzp (mgr.14640) 3549 : cluster [DBG] pgmap v2439: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:05.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:03.841809+0000 mgr.smithi008.flmjzp (mgr.14640) 3550 : cluster [DBG] pgmap v2440: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:03.841809+0000 mgr.smithi008.flmjzp (mgr.14640) 3550 : cluster [DBG] pgmap v2440: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:05.842290+0000 mgr.smithi008.flmjzp (mgr.14640) 3551 : cluster [DBG] pgmap v2441: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:05.842290+0000 mgr.smithi008.flmjzp (mgr.14640) 3551 : cluster [DBG] pgmap v2441: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:07.842967+0000 mgr.smithi008.flmjzp (mgr.14640) 3552 : cluster [DBG] pgmap v2442: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:07.842967+0000 mgr.smithi008.flmjzp (mgr.14640) 3552 : cluster [DBG] pgmap v2442: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:09.872331+0000 mon.smithi008 (mon.0) 3900 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:09.874304+0000 mon.smithi008 (mon.0) 3901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:09.875279+0000 mon.smithi008 (mon.0) 3902 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:09.881431+0000 mon.smithi008 (mon.0) 3903 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:09.887672+0000 mon.smithi008 (mon.0) 3904 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:09.890661+0000 mon.smithi008 (mon.0) 3905 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:09.892318+0000 mon.smithi008 (mon.0) 3906 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:10.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:09.893887+0000 mon.smithi008 (mon.0) 3907 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:10.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:09.895869+0000 mon.smithi008 (mon.0) 3908 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:09.872331+0000 mon.smithi008 (mon.0) 3900 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:09.874304+0000 mon.smithi008 (mon.0) 3901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:09.875279+0000 mon.smithi008 (mon.0) 3902 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:09.881431+0000 mon.smithi008 (mon.0) 3903 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:09.887672+0000 mon.smithi008 (mon.0) 3904 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:09.890661+0000 mon.smithi008 (mon.0) 3905 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:09.892318+0000 mon.smithi008 (mon.0) 3906 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:09.893887+0000 mon.smithi008 (mon.0) 3907 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:09.895869+0000 mon.smithi008 (mon.0) 3908 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:09.843556+0000 mgr.smithi008.flmjzp (mgr.14640) 3553 : cluster [DBG] pgmap v2443: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:58:09.876186+0000 mgr.smithi008.flmjzp (mgr.14640) 3554 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:09.876722+0000 mgr.smithi008.flmjzp (mgr.14640) 3555 : cluster [DBG] pgmap v2444: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:09.876935+0000 mgr.smithi008.flmjzp (mgr.14640) 3556 : cluster [DBG] pgmap v2445: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:58:09.897714+0000 mgr.smithi008.flmjzp (mgr.14640) 3557 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:09.843556+0000 mgr.smithi008.flmjzp (mgr.14640) 3553 : cluster [DBG] pgmap v2443: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:58:09.876186+0000 mgr.smithi008.flmjzp (mgr.14640) 3554 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:09.876722+0000 mgr.smithi008.flmjzp (mgr.14640) 3555 : cluster [DBG] pgmap v2444: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:09.876935+0000 mgr.smithi008.flmjzp (mgr.14640) 3556 : cluster [DBG] pgmap v2445: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:58:09.897714+0000 mgr.smithi008.flmjzp (mgr.14640) 3557 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:11.877485+0000 mgr.smithi008.flmjzp (mgr.14640) 3558 : cluster [DBG] pgmap v2446: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:11.877485+0000 mgr.smithi008.flmjzp (mgr.14640) 3558 : cluster [DBG] pgmap v2446: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:13.878047+0000 mgr.smithi008.flmjzp (mgr.14640) 3559 : cluster [DBG] pgmap v2447: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:13.878047+0000 mgr.smithi008.flmjzp (mgr.14640) 3559 : cluster [DBG] pgmap v2447: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:17.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:15.878765+0000 mgr.smithi008.flmjzp (mgr.14640) 3560 : cluster [DBG] pgmap v2448: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:15.878765+0000 mgr.smithi008.flmjzp (mgr.14640) 3560 : cluster [DBG] pgmap v2448: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:17.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.961+0000 7fbf33fff700 1 -- 172.21.15.8:0/273047480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf34060310 msgr2=0x7fbf340f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:17.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.961+0000 7fbf33fff700 1 --2- 172.21.15.8:0/273047480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf34060310 0x7fbf340f9110 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fbf24004660 tx=0x7fbf24009b30).stop 2023-10-18T21:58:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.961+0000 7fbf33fff700 1 -- 172.21.15.8:0/273047480 shutdown_connections 2023-10-18T21:58:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.961+0000 7fbf33fff700 1 --2- 172.21.15.8:0/273047480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf340f9690 0x7fbf340fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T21:58:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.961+0000 7fbf33fff700 1 --2- 172.21.15.8:0/273047480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf34060310 0x7fbf340f9110 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.961+0000 7fbf33fff700 1 -- 172.21.15.8:0/273047480 >> 172.21.15.8:0/273047480 conn(0x7fbf340f0b90 msgr2=0x7fbf340f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.961+0000 7fbf33fff700 1 -- 172.21.15.8:0/273047480 shutdown_connections 2023-10-18T21:58:17.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.961+0000 7fbf33fff700 1 -- 172.21.15.8:0/273047480 wait complete. 2023-10-18T21:58:17.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.962+0000 7fbf33fff700 1 Processor -- start 2023-10-18T21:58:17.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.962+0000 7fbf33fff700 1 -- start start 2023-10-18T21:58:17.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.962+0000 7fbf33fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf34060310 0x7fbf34108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:17.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.962+0000 7fbf33fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf340f9690 0x7fbf34109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:17.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.962+0000 7fbf33fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf34109ad0 con 0x7fbf34060310 2023-10-18T21:58:17.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.962+0000 7fbf33fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3410a380 con 0x7fbf340f9690 2023-10-18T21:58:17.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.962+0000 7fbf32ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf34060310 0x7fbf34108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:17.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.963+0000 7fbf32ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf34060310 0x7fbf34108fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52782/0 (socket says 172.21.15.8:52782) 2023-10-18T21:58:17.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.963+0000 7fbf32ffd700 1 -- 172.21.15.8:0/2790642099 learned_addr learned my addr 172.21.15.8:0/2790642099 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:17.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.963+0000 7fbf327fc700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf340f9690 0x7fbf34109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:17.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.963+0000 7fbf32ffd700 1 -- 172.21.15.8:0/2790642099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf340f9690 msgr2=0x7fbf34109490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:17.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.963+0000 7fbf32ffd700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf340f9690 0x7fbf34109490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:17.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.963+0000 7fbf32ffd700 1 -- 172.21.15.8:0/2790642099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf24005040 con 0x7fbf34060310 2023-10-18T21:58:17.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.963+0000 7fbf32ffd700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf34060310 0x7fbf34108fa0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7fbf24009990 tx=0x7fbf24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:17.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.964+0000 7fbf1b7fe700 1 -- 172.21.15.8:0/2790642099 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf24018070 con 0x7fbf34060310 2023-10-18T21:58:17.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.964+0000 7fbf1b7fe700 1 -- 172.21.15.8:0/2790642099 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbf24009780 con 0x7fbf34060310 2023-10-18T21:58:17.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.964+0000 7fbf1b7fe700 1 -- 172.21.15.8:0/2790642099 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf2401c5e0 con 0x7fbf34060310 2023-10-18T21:58:17.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.964+0000 7fbf33fff700 1 -- 172.21.15.8:0/2790642099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3410a600 con 0x7fbf34060310 2023-10-18T21:58:17.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.964+0000 7fbf33fff700 1 -- 172.21.15.8:0/2790642099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3410ab60 con 0x7fbf34060310 2023-10-18T21:58:17.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.965+0000 7fbf33fff700 1 -- 172.21.15.8:0/2790642099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf34059100 con 0x7fbf34060310 2023-10-18T21:58:17.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.966+0000 7fbf1b7fe700 1 -- 172.21.15.8:0/2790642099 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbf2401dac0 con 0x7fbf34060310 2023-10-18T21:58:17.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.967+0000 7fbf1b7fe700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf1c060f70 0x7fbf1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:17.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.967+0000 7fbf1b7fe700 1 -- 172.21.15.8:0/2790642099 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbf2407e750 con 0x7fbf34060310 2023-10-18T21:58:17.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.967+0000 7fbf327fc700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf1c060f70 0x7fbf1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:17.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.967+0000 7fbf327fc700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf1c060f70 0x7fbf1c063430 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fbf28006fd0 tx=0x7fbf28008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:17.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:17.971+0000 7fbf1b7fe700 1 -- 172.21.15.8:0/2790642099 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbf24051df0 con 0x7fbf34060310 2023-10-18T21:58:18.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.170+0000 7fbf33fff700 1 -- 172.21.15.8:0/2790642099 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf340f5630 con 0x7fbf1c060f70 2023-10-18T21:58:18.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.171+0000 7fbf1b7fe700 1 -- 172.21.15.8:0/2790642099 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbf340f5630 con 0x7fbf1c060f70 2023-10-18T21:58:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 -- 172.21.15.8:0/2790642099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf1c060f70 msgr2=0x7fbf1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf1c060f70 0x7fbf1c063430 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fbf28006fd0 tx=0x7fbf28008040).stop 2023-10-18T21:58:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 -- 172.21.15.8:0/2790642099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf34060310 msgr2=0x7fbf34108fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf34060310 0x7fbf34108fa0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7fbf24009990 tx=0x7fbf24009b30).stop 2023-10-18T21:58:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 -- 172.21.15.8:0/2790642099 shutdown_connections 2023-10-18T21:58:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbf1c060f70 0x7fbf1c063430 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf34060310 0x7fbf34108fa0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 --2- 172.21.15.8:0/2790642099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf340f9690 0x7fbf34109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 -- 172.21.15.8:0/2790642099 >> 172.21.15.8:0/2790642099 conn(0x7fbf340f0b90 msgr2=0x7fbf340f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:18.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 -- 172.21.15.8:0/2790642099 shutdown_connections 2023-10-18T21:58:18.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.173+0000 7fbf33fff700 1 -- 172.21.15.8:0/2790642099 wait complete. 2023-10-18T21:58:18.190 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:58:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.311+0000 7f7b16a63700 1 -- 172.21.15.8:0/1800613543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b10060250 msgr2=0x7f7b100f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.311+0000 7f7b16a63700 1 --2- 172.21.15.8:0/1800613543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b10060250 0x7f7b100f91d0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f7b0c004660 tx=0x7f7b0c009b30).stop 2023-10-18T21:58:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.311+0000 7f7b16a63700 1 -- 172.21.15.8:0/1800613543 shutdown_connections 2023-10-18T21:58:18.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.311+0000 7f7b16a63700 1 --2- 172.21.15.8:0/1800613543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b100f96c0 0x7f7b100fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.311+0000 7f7b16a63700 1 --2- 172.21.15.8:0/1800613543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b10060250 0x7f7b100f91d0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.311+0000 7f7b16a63700 1 -- 172.21.15.8:0/1800613543 >> 172.21.15.8:0/1800613543 conn(0x7f7b100f0b90 msgr2=0x7f7b100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:18.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.311+0000 7f7b16a63700 1 -- 172.21.15.8:0/1800613543 shutdown_connections 2023-10-18T21:58:18.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.311+0000 7f7b16a63700 1 -- 172.21.15.8:0/1800613543 wait complete. 2023-10-18T21:58:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.312+0000 7f7b16a63700 1 Processor -- start 2023-10-18T21:58:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.312+0000 7f7b16a63700 1 -- start start 2023-10-18T21:58:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b16a63700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b10060250 0x7f7b10108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b16a63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b100f96c0 0x7f7b10109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b16a63700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10109a10 con 0x7f7b100f96c0 2023-10-18T21:58:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b16a63700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10109b50 con 0x7f7b10060250 2023-10-18T21:58:18.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b15260700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b100f96c0 0x7f7b10109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:18.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b15260700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b100f96c0 0x7f7b10109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52796/0 (socket says 172.21.15.8:52796) 2023-10-18T21:58:18.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b15260700 1 -- 172.21.15.8:0/3856976565 learned_addr learned my addr 172.21.15.8:0/3856976565 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b15a61700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b10060250 0x7f7b10108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b15260700 1 -- 172.21.15.8:0/3856976565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b10060250 msgr2=0x7f7b10108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b15260700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b10060250 0x7f7b10108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.313+0000 7f7b15260700 1 -- 172.21.15.8:0/3856976565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c005040 con 0x7f7b100f96c0 2023-10-18T21:58:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.314+0000 7f7b15260700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b100f96c0 0x7f7b10109460 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f7b000026d0 tx=0x7f7b00009d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.314+0000 7f7b067fc700 1 -- 172.21.15.8:0/3856976565 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b000079c0 con 0x7f7b100f96c0 2023-10-18T21:58:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.314+0000 7f7b16a63700 1 -- 172.21.15.8:0/3856976565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1010a4a0 con 0x7f7b100f96c0 2023-10-18T21:58:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.314+0000 7f7b067fc700 1 -- 172.21.15.8:0/3856976565 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7b0000f040 con 0x7f7b100f96c0 2023-10-18T21:58:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.314+0000 7f7b067fc700 1 -- 172.21.15.8:0/3856976565 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b000147c0 con 0x7f7b100f96c0 2023-10-18T21:58:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.314+0000 7f7b16a63700 1 -- 172.21.15.8:0/3856976565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1010aa60 con 0x7f7b100f96c0 2023-10-18T21:58:18.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.315+0000 7f7b16a63700 1 -- 172.21.15.8:0/3856976565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b10045ad0 con 0x7f7b100f96c0 2023-10-18T21:58:18.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.316+0000 7f7b067fc700 1 -- 172.21.15.8:0/3856976565 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7b0001b060 con 0x7f7b100f96c0 2023-10-18T21:58:18.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.317+0000 7f7b067fc700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7afc060f70 0x7f7afc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:18.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.317+0000 7f7b067fc700 1 -- 172.21.15.8:0/3856976565 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7b0007c8d0 con 0x7f7b100f96c0 2023-10-18T21:58:18.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.317+0000 7f7b15a61700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7afc060f70 0x7f7afc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:18.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.318+0000 7f7b15a61700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7afc060f70 0x7f7afc063430 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f7b0c004630 tx=0x7f7b0c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:18.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.321+0000 7f7b067fc700 1 -- 172.21.15.8:0/3856976565 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7b0004feb0 con 0x7f7b100f96c0 2023-10-18T21:58:18.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.520+0000 7f7b16a63700 1 -- 172.21.15.8:0/3856976565 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b100f56f0 con 0x7f7afc060f70 2023-10-18T21:58:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.522+0000 7f7b067fc700 1 -- 172.21.15.8:0/3856976565 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7b100f56f0 con 0x7f7afc060f70 2023-10-18T21:58:18.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 -- 172.21.15.8:0/3856976565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7afc060f70 msgr2=0x7f7afc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:18.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7afc060f70 0x7f7afc063430 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f7b0c004630 tx=0x7f7b0c009b30).stop 2023-10-18T21:58:18.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 -- 172.21.15.8:0/3856976565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b100f96c0 msgr2=0x7f7b10109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:18.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b100f96c0 0x7f7b10109460 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f7b000026d0 tx=0x7f7b00009d40).stop 2023-10-18T21:58:18.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 -- 172.21.15.8:0/3856976565 shutdown_connections 2023-10-18T21:58:18.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7afc060f70 0x7f7afc063430 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b10060250 0x7f7b10108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 --2- 172.21.15.8:0/3856976565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b100f96c0 0x7f7b10109460 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 -- 172.21.15.8:0/3856976565 >> 172.21.15.8:0/3856976565 conn(0x7f7b100f0b90 msgr2=0x7f7b100f4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:18.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 -- 172.21.15.8:0/3856976565 shutdown_connections 2023-10-18T21:58:18.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.524+0000 7f7b16a63700 1 -- 172.21.15.8:0/3856976565 wait complete. 2023-10-18T21:58:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.660+0000 7f44bffff700 1 -- 172.21.15.8:0/4022584634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 msgr2=0x7f44c00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.660+0000 7f44bffff700 1 --2- 172.21.15.8:0/4022584634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c00f7c30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f44b4004660 tx=0x7f44b4009b30).stop 2023-10-18T21:58:18.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.660+0000 7f44bffff700 1 -- 172.21.15.8:0/4022584634 shutdown_connections 2023-10-18T21:58:18.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.660+0000 7f44bffff700 1 --2- 172.21.15.8:0/4022584634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c00f7c30 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.660+0000 7f44bffff700 1 --2- 172.21.15.8:0/4022584634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 0x7f44c00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.660+0000 7f44bffff700 1 -- 172.21.15.8:0/4022584634 >> 172.21.15.8:0/4022584634 conn(0x7f44c00f1c90 msgr2=0x7f44c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:18.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.660+0000 7f44bffff700 1 -- 172.21.15.8:0/4022584634 shutdown_connections 2023-10-18T21:58:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.660+0000 7f44bffff700 1 -- 172.21.15.8:0/4022584634 wait complete. 2023-10-18T21:58:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.661+0000 7f44bffff700 1 Processor -- start 2023-10-18T21:58:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.661+0000 7f44bffff700 1 -- start start 2023-10-18T21:58:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.661+0000 7f44bffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 0x7f44c0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:18.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.661+0000 7f44bffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:18.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.661+0000 7f44bffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0107850 con 0x7f44c00f77d0 2023-10-18T21:58:18.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.661+0000 7f44bffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0108060 con 0x7f44c00f6530 2023-10-18T21:58:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.661+0000 7f44be7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.661+0000 7f44be7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52808/0 (socket says 172.21.15.8:52808) 2023-10-18T21:58:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.661+0000 7f44be7fc700 1 -- 172.21.15.8:0/2879076909 learned_addr learned my addr 172.21.15.8:0/2879076909 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.661+0000 7f44beffd700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 0x7f44c0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.662+0000 7f44be7fc700 1 -- 172.21.15.8:0/2879076909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 msgr2=0x7f44c0106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.662+0000 7f44be7fc700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 0x7f44c0106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.662+0000 7f44be7fc700 1 -- 172.21.15.8:0/2879076909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4005040 con 0x7f44c00f77d0 2023-10-18T21:58:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.662+0000 7f44be7fc700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0107250 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f44b4004d80 tx=0x7f44b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.662+0000 7f44a77fe700 1 -- 172.21.15.8:0/2879076909 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b4019070 con 0x7f44c00f77d0 2023-10-18T21:58:18.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.662+0000 7f44a77fe700 1 -- 172.21.15.8:0/2879076909 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f44b401e420 con 0x7f44c00f77d0 2023-10-18T21:58:18.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.662+0000 7f44a77fe700 1 -- 172.21.15.8:0/2879076909 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b4014660 con 0x7f44c00f77d0 2023-10-18T21:58:18.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.662+0000 7f44bffff700 1 -- 172.21.15.8:0/2879076909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c0108280 con 0x7f44c00f77d0 2023-10-18T21:58:18.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.662+0000 7f44bffff700 1 -- 172.21.15.8:0/2879076909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c0108710 con 0x7f44c00f77d0 2023-10-18T21:58:18.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.663+0000 7f44bffff700 1 -- 172.21.15.8:0/2879076909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c0059100 con 0x7f44c00f77d0 2023-10-18T21:58:18.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.664+0000 7f44a77fe700 1 -- 172.21.15.8:0/2879076909 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f44b401e590 con 0x7f44c00f77d0 2023-10-18T21:58:18.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.665+0000 7f44a77fe700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 0x7f44a8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:18.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.665+0000 7f44a77fe700 1 -- 172.21.15.8:0/2879076909 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f44b407ddd0 con 0x7f44c00f77d0 2023-10-18T21:58:18.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.665+0000 7f44beffd700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 0x7f44a8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:18.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.666+0000 7f44beffd700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 0x7f44a8063430 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f44c0106ad0 tx=0x7f44b000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:18.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.669+0000 7f44a77fe700 1 -- 172.21.15.8:0/2879076909 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f44b404d9c0 con 0x7f44c00f77d0 2023-10-18T21:58:18.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.861+0000 7f44bffff700 1 -- 172.21.15.8:0/2879076909 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f44c00fedb0 con 0x7f44a8060f70 2023-10-18T21:58:18.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.871+0000 7f44a77fe700 1 -- 172.21.15.8:0/2879076909 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f44c00fedb0 con 0x7f44a8060f70 2023-10-18T21:58:18.874 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:58:18.874 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (64m) 2m ago 66m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:58:18.875 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (58m) 2m ago 66m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:58:18.875 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (58m) 19s ago 65m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:58:18.876 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (64m) 2m ago 66m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:58:18.876 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 62m - - 2023-10-18T21:58:18.876 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 62m - - 2023-10-18T21:58:18.877 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 19s ago 62m - - 2023-10-18T21:58:18.877 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 19s ago 62m - - 2023-10-18T21:58:18.877 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (60m) 2m ago 67m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:58:18.878 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (59m) 19s ago 65m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:58:18.878 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (59m) 2m ago 67m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:58:18.878 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (59m) 19s ago 65m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:58:18.879 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (65m) 2m ago 65m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:58:18.879 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (65m) 19s ago 65m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:58:18.879 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (58m) 2m ago 65m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:58:18.879 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (56m) 2m ago 64m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:58:18.880 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (56m) 2m ago 64m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:58:18.880 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (55m) 19s ago 64m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:58:18.880 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (54m) 19s ago 63m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:58:18.881 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (54m) 19s ago 63m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:58:18.881 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (60m) 2m ago 65m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:58:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.873+0000 7f44bffff700 1 -- 172.21.15.8:0/2879076909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 msgr2=0x7f44a8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.873+0000 7f44bffff700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 0x7f44a8063430 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f44c0106ad0 tx=0x7f44b000b040).stop 2023-10-18T21:58:18.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.873+0000 7f44bffff700 1 -- 172.21.15.8:0/2879076909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 msgr2=0x7f44c0107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:18.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.873+0000 7f44bffff700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0107250 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f44b4004d80 tx=0x7f44b400b040).stop 2023-10-18T21:58:18.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.874+0000 7f44bffff700 1 -- 172.21.15.8:0/2879076909 shutdown_connections 2023-10-18T21:58:18.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.874+0000 7f44bffff700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 0x7f44a8063430 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.874+0000 7f44bffff700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 0x7f44c0106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.874+0000 7f44bffff700 1 --2- 172.21.15.8:0/2879076909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0107250 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:18.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.874+0000 7f44bffff700 1 -- 172.21.15.8:0/2879076909 >> 172.21.15.8:0/2879076909 conn(0x7f44c00f1c90 msgr2=0x7f44c00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:18.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.874+0000 7f44bffff700 1 -- 172.21.15.8:0/2879076909 shutdown_connections 2023-10-18T21:58:18.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:18.874+0000 7f44bffff700 1 -- 172.21.15.8:0/2879076909 wait complete. 2023-10-18T21:58:19.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.010+0000 7f2fbd64a700 1 -- 172.21.15.8:0/1719335126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fb80f6530 msgr2=0x7f2fb80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.010+0000 7f2fbd64a700 1 --2- 172.21.15.8:0/1719335126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fb80f6530 0x7f2fb80f6950 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f2fa8004660 tx=0x7f2fa8009b30).stop 2023-10-18T21:58:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.010+0000 7f2fbd64a700 1 -- 172.21.15.8:0/1719335126 shutdown_connections 2023-10-18T21:58:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.010+0000 7f2fbd64a700 1 --2- 172.21.15.8:0/1719335126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb80f77d0 0x7f2fb80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.010+0000 7f2fbd64a700 1 --2- 172.21.15.8:0/1719335126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fb80f6530 0x7f2fb80f6950 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.010+0000 7f2fbd64a700 1 -- 172.21.15.8:0/1719335126 >> 172.21.15.8:0/1719335126 conn(0x7f2fb80f1c90 msgr2=0x7f2fb80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:19.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.010+0000 7f2fbd64a700 1 -- 172.21.15.8:0/1719335126 shutdown_connections 2023-10-18T21:58:19.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.010+0000 7f2fbd64a700 1 -- 172.21.15.8:0/1719335126 wait complete. 2023-10-18T21:58:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.011+0000 7f2fbd64a700 1 Processor -- start 2023-10-18T21:58:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.011+0000 7f2fbd64a700 1 -- start start 2023-10-18T21:58:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.011+0000 7f2fbd64a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb80f6530 0x7f2fb806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.011+0000 7f2fbd64a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fb80f77d0 0x7f2fb8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:19.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.011+0000 7f2fbd64a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb806a380 con 0x7f2fb80f77d0 2023-10-18T21:58:19.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.011+0000 7f2fbd64a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb806a4c0 con 0x7f2fb80f6530 2023-10-18T21:58:19.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.012+0000 7f2fb77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fb80f77d0 0x7f2fb8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:19.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.012+0000 7f2fb77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fb80f77d0 0x7f2fb8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52826/0 (socket says 172.21.15.8:52826) 2023-10-18T21:58:19.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.012+0000 7f2fb77fe700 1 -- 172.21.15.8:0/3383687091 learned_addr learned my addr 172.21.15.8:0/3383687091 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.012+0000 7f2fb7fff700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb80f6530 0x7f2fb806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.012+0000 7f2fb77fe700 1 -- 172.21.15.8:0/3383687091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb80f6530 msgr2=0x7f2fb806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.012+0000 7f2fb77fe700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb80f6530 0x7f2fb806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.012+0000 7f2fb77fe700 1 -- 172.21.15.8:0/3383687091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8005040 con 0x7f2fb80f77d0 2023-10-18T21:58:19.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.012+0000 7f2fb77fe700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fb80f77d0 0x7f2fb8069e20 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f2fac00e7f0 tx=0x7f2fac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:19.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.012+0000 7f2fb4ff9700 1 -- 172.21.15.8:0/3383687091 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fac0092e0 con 0x7f2fb80f77d0 2023-10-18T21:58:19.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.013+0000 7f2fb4ff9700 1 -- 172.21.15.8:0/3383687091 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2fac00f040 con 0x7f2fb80f77d0 2023-10-18T21:58:19.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.013+0000 7f2fbd64a700 1 -- 172.21.15.8:0/3383687091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb806a7a0 con 0x7f2fb80f77d0 2023-10-18T21:58:19.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.013+0000 7f2fb4ff9700 1 -- 172.21.15.8:0/3383687091 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fac0147e0 con 0x7f2fb80f77d0 2023-10-18T21:58:19.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.013+0000 7f2fbd64a700 1 -- 172.21.15.8:0/3383687091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb810ed60 con 0x7f2fb80f77d0 2023-10-18T21:58:19.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.014+0000 7f2fbd64a700 1 -- 172.21.15.8:0/3383687091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb8045ad0 con 0x7f2fb80f77d0 2023-10-18T21:58:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.014+0000 7f2fb4ff9700 1 -- 172.21.15.8:0/3383687091 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2fac01b030 con 0x7f2fb80f77d0 2023-10-18T21:58:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.015+0000 7f2fb4ff9700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fa0060f70 0x7f2fa0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.015+0000 7f2fb4ff9700 1 -- 172.21.15.8:0/3383687091 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2fac07c6b0 con 0x7f2fb80f77d0 2023-10-18T21:58:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.016+0000 7f2fb7fff700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fa0060f70 0x7f2fa0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.016+0000 7f2fb7fff700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fa0060f70 0x7f2fa0063430 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f2fa8004d80 tx=0x7f2fa8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:19.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.019+0000 7f2fb4ff9700 1 -- 172.21.15.8:0/3383687091 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2fac04c310 con 0x7f2fb80f77d0 2023-10-18T21:58:19.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:17.879259+0000 mgr.smithi008.flmjzp (mgr.14640) 3561 : cluster [DBG] pgmap v2449: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:19.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:18.172248+0000 mgr.smithi008.flmjzp (mgr.14640) 3562 : audit [DBG] from='client.36928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:19.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.274+0000 7f2fbd64a700 1 -- 172.21.15.8:0/3383687091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2fb8027a00 con 0x7f2fb80f77d0 2023-10-18T21:58:19.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.274+0000 7f2fb4ff9700 1 -- 172.21.15.8:0/3383687091 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f2fac019020 con 0x7f2fb80f77d0 2023-10-18T21:58:19.277 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:58:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:58:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:58:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:58:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:58:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:58:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:58:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:58:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:58:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:58:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:58:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:58:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:58:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:58:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:58:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:58:19.281 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:58:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 -- 172.21.15.8:0/3383687091 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fa0060f70 msgr2=0x7f2fa0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fa0060f70 0x7f2fa0063430 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f2fa8004d80 tx=0x7f2fa8016040).stop 2023-10-18T21:58:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 -- 172.21.15.8:0/3383687091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fb80f77d0 msgr2=0x7f2fb8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fb80f77d0 0x7f2fb8069e20 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f2fac00e7f0 tx=0x7f2fac00b040).stop 2023-10-18T21:58:19.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 -- 172.21.15.8:0/3383687091 shutdown_connections 2023-10-18T21:58:19.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2fa0060f70 0x7f2fa0063430 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb80f6530 0x7f2fb806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 --2- 172.21.15.8:0/3383687091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fb80f77d0 0x7f2fb8069e20 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 -- 172.21.15.8:0/3383687091 >> 172.21.15.8:0/3383687091 conn(0x7f2fb80f1c90 msgr2=0x7f2fb80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:19.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 -- 172.21.15.8:0/3383687091 shutdown_connections 2023-10-18T21:58:19.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.277+0000 7f2fbd64a700 1 -- 172.21.15.8:0/3383687091 wait complete. 2023-10-18T21:58:19.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.413+0000 7fa52f59b700 1 -- 172.21.15.8:0/3925358293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5280f6530 msgr2=0x7fa5280f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:19.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.413+0000 7fa52f59b700 1 --2- 172.21.15.8:0/3925358293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5280f6530 0x7fa5280f6950 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7fa524004660 tx=0x7fa524009b30).stop 2023-10-18T21:58:19.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.414+0000 7fa52f59b700 1 -- 172.21.15.8:0/3925358293 shutdown_connections 2023-10-18T21:58:19.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.414+0000 7fa52f59b700 1 --2- 172.21.15.8:0/3925358293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280f77d0 0x7fa5280f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.414+0000 7fa52f59b700 1 --2- 172.21.15.8:0/3925358293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5280f6530 0x7fa5280f6950 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.414+0000 7fa52f59b700 1 -- 172.21.15.8:0/3925358293 >> 172.21.15.8:0/3925358293 conn(0x7fa5280f1c90 msgr2=0x7fa5280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:19.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.414+0000 7fa52f59b700 1 -- 172.21.15.8:0/3925358293 shutdown_connections 2023-10-18T21:58:19.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.414+0000 7fa52f59b700 1 -- 172.21.15.8:0/3925358293 wait complete. 2023-10-18T21:58:19.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.415+0000 7fa52f59b700 1 Processor -- start 2023-10-18T21:58:19.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.415+0000 7fa52f59b700 1 -- start start 2023-10-18T21:58:19.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.415+0000 7fa52f59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5280f6530 0x7fa528108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:19.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.415+0000 7fa52f59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280f77d0 0x7fa5281094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:19.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.415+0000 7fa52f59b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa528109a50 con 0x7fa5280f6530 2023-10-18T21:58:19.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.415+0000 7fa52f59b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa528109b90 con 0x7fa5280f77d0 2023-10-18T21:58:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.415+0000 7fa52e599700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5280f6530 0x7fa528108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.415+0000 7fa52e599700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5280f6530 0x7fa528108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52846/0 (socket says 172.21.15.8:52846) 2023-10-18T21:58:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.415+0000 7fa52e599700 1 -- 172.21.15.8:0/3106108922 learned_addr learned my addr 172.21.15.8:0/3106108922 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.416+0000 7fa52dd98700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280f77d0 0x7fa5281094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:19.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.416+0000 7fa52e599700 1 -- 172.21.15.8:0/3106108922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280f77d0 msgr2=0x7fa5281094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:19.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.416+0000 7fa52e599700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280f77d0 0x7fa5281094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.416+0000 7fa52e599700 1 -- 172.21.15.8:0/3106108922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa524005040 con 0x7fa5280f6530 2023-10-18T21:58:19.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.416+0000 7fa52e599700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5280f6530 0x7fa528108fb0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7fa524007a60 tx=0x7fa524009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:19.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.416+0000 7fa51effd700 1 -- 172.21.15.8:0/3106108922 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa524018070 con 0x7fa5280f6530 2023-10-18T21:58:19.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.416+0000 7fa51effd700 1 -- 172.21.15.8:0/3106108922 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa524009630 con 0x7fa5280f6530 2023-10-18T21:58:19.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.416+0000 7fa52f59b700 1 -- 172.21.15.8:0/3106108922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52810a4d0 con 0x7fa5280f6530 2023-10-18T21:58:19.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.416+0000 7fa51effd700 1 -- 172.21.15.8:0/3106108922 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa52401c4d0 con 0x7fa5280f6530 2023-10-18T21:58:19.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.417+0000 7fa52f59b700 1 -- 172.21.15.8:0/3106108922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52810aa30 con 0x7fa5280f6530 2023-10-18T21:58:19.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.418+0000 7fa52f59b700 1 -- 172.21.15.8:0/3106108922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa528045ad0 con 0x7fa5280f6530 2023-10-18T21:58:19.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:17.879259+0000 mgr.smithi008.flmjzp (mgr.14640) 3561 : cluster [DBG] pgmap v2449: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:19.425 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:18.172248+0000 mgr.smithi008.flmjzp (mgr.14640) 3562 : audit [DBG] from='client.36928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:19.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.418+0000 7fa51effd700 1 -- 172.21.15.8:0/3106108922 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa52401d420 con 0x7fa5280f6530 2023-10-18T21:58:19.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.419+0000 7fa51effd700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa514060f70 0x7fa514063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:19.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.419+0000 7fa51effd700 1 -- 172.21.15.8:0/3106108922 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa52407e650 con 0x7fa5280f6530 2023-10-18T21:58:19.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.420+0000 7fa52dd98700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa514060f70 0x7fa514063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:19.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.420+0000 7fa52dd98700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa514060f70 0x7fa514063430 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fa518004c40 tx=0x7fa51800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:19.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.423+0000 7fa51effd700 1 -- 172.21.15.8:0/3106108922 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa524051ca0 con 0x7fa5280f6530 2023-10-18T21:58:19.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.649+0000 7fa52f59b700 1 -- 172.21.15.8:0/3106108922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa5280fedd0 con 0x7fa5280f6530 2023-10-18T21:58:19.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.650+0000 7fa51effd700 1 -- 172.21.15.8:0/3106108922 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fa524051890 con 0x7fa5280f6530 2023-10-18T21:58:19.653 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:58:19.653 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:58:19.653 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:58:19.654 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:58:19.654 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:58:19.654 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:58:19.654 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:58:19.654 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:58:19.655 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:58:19.655 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:58:19.655 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:58:19.655 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:58:19.655 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:58:19.656 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:58:19.656 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:58:19.656 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:58:19.656 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:58:19.656 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:58:19.656 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:58:19.657 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:58:19.657 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:58:19.657 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:58:19.657 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:58:19.657 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:58:19.657 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:58:19.658 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:58:19.658 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:58:19.658 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:58:19.658 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:58:19.658 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:58:19.659 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:58:19.659 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:58:19.659 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:58:19.659 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:58:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 -- 172.21.15.8:0/3106108922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa514060f70 msgr2=0x7fa514063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa514060f70 0x7fa514063430 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fa518004c40 tx=0x7fa51800b040).stop 2023-10-18T21:58:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 -- 172.21.15.8:0/3106108922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5280f6530 msgr2=0x7fa528108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5280f6530 0x7fa528108fb0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7fa524007a60 tx=0x7fa524009b30).stop 2023-10-18T21:58:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 -- 172.21.15.8:0/3106108922 shutdown_connections 2023-10-18T21:58:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa514060f70 0x7fa514063430 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5280f6530 0x7fa528108fb0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 --2- 172.21.15.8:0/3106108922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280f77d0 0x7fa5281094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 -- 172.21.15.8:0/3106108922 >> 172.21.15.8:0/3106108922 conn(0x7fa5280f1c90 msgr2=0x7fa52806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:19.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 -- 172.21.15.8:0/3106108922 shutdown_connections 2023-10-18T21:58:19.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.652+0000 7fa52f59b700 1 -- 172.21.15.8:0/3106108922 wait complete. 2023-10-18T21:58:19.662 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:58:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.789+0000 7fcceb219700 1 -- 172.21.15.8:0/4026794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcce40f77d0 msgr2=0x7fcce40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:19.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.789+0000 7fcceb219700 1 --2- 172.21.15.8:0/4026794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcce40f77d0 0x7fcce40f7c30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7fccd4004660 tx=0x7fccd4009b30).stop 2023-10-18T21:58:19.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.789+0000 7fcceb219700 1 -- 172.21.15.8:0/4026794 shutdown_connections 2023-10-18T21:58:19.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.789+0000 7fcceb219700 1 --2- 172.21.15.8:0/4026794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcce40f77d0 0x7fcce40f7c30 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.789+0000 7fcceb219700 1 --2- 172.21.15.8:0/4026794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce40f6530 0x7fcce40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.789+0000 7fcceb219700 1 -- 172.21.15.8:0/4026794 >> 172.21.15.8:0/4026794 conn(0x7fcce40f1c90 msgr2=0x7fcce40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:19.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.789+0000 7fcceb219700 1 -- 172.21.15.8:0/4026794 shutdown_connections 2023-10-18T21:58:19.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.789+0000 7fcceb219700 1 -- 172.21.15.8:0/4026794 wait complete. 2023-10-18T21:58:19.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.790+0000 7fcceb219700 1 Processor -- start 2023-10-18T21:58:19.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.790+0000 7fcceb219700 1 -- start start 2023-10-18T21:58:19.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.791+0000 7fcceb219700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce40f6530 0x7fcce4108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:19.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.791+0000 7fcceb219700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcce40f77d0 0x7fcce41093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:19.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.791+0000 7fcceb219700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4109980 con 0x7fcce40f77d0 2023-10-18T21:58:19.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.791+0000 7fcceb219700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4109ac0 con 0x7fcce40f6530 2023-10-18T21:58:19.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.791+0000 7fcce9a16700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcce40f77d0 0x7fcce41093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:19.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.791+0000 7fccea217700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce40f6530 0x7fcce4108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:19.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.791+0000 7fccea217700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce40f6530 0x7fcce4108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:38546/0 (socket says 172.21.15.8:38546) 2023-10-18T21:58:19.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.791+0000 7fccea217700 1 -- 172.21.15.8:0/2528307935 learned_addr learned my addr 172.21.15.8:0/2528307935 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:19.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.792+0000 7fccea217700 1 -- 172.21.15.8:0/2528307935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcce40f77d0 msgr2=0x7fcce41093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:19.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.792+0000 7fccea217700 1 --2- 172.21.15.8:0/2528307935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcce40f77d0 0x7fcce41093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:19.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.792+0000 7fccea217700 1 -- 172.21.15.8:0/2528307935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4005040 con 0x7fcce40f6530 2023-10-18T21:58:19.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.792+0000 7fccea217700 1 --2- 172.21.15.8:0/2528307935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce40f6530 0x7fcce4108ee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcce000e7c0 tx=0x7fcce000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:19.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.792+0000 7fccdaffd700 1 -- 172.21.15.8:0/2528307935 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce00092e0 con 0x7fcce40f6530 2023-10-18T21:58:19.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.792+0000 7fcceb219700 1 -- 172.21.15.8:0/2528307935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce410a460 con 0x7fcce40f6530 2023-10-18T21:58:19.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.792+0000 7fccdaffd700 1 -- 172.21.15.8:0/2528307935 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcce000f040 con 0x7fcce40f6530 2023-10-18T21:58:19.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.792+0000 7fccdaffd700 1 -- 172.21.15.8:0/2528307935 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce0014810 con 0x7fcce40f6530 2023-10-18T21:58:19.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.792+0000 7fcceb219700 1 -- 172.21.15.8:0/2528307935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce410a9a0 con 0x7fcce40f6530 2023-10-18T21:58:19.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.793+0000 7fcceb219700 1 -- 172.21.15.8:0/2528307935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce4045ad0 con 0x7fcce40f6530 2023-10-18T21:58:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.794+0000 7fccdaffd700 1 -- 172.21.15.8:0/2528307935 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcce001b030 con 0x7fcce40f6530 2023-10-18T21:58:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.795+0000 7fccdaffd700 1 --2- 172.21.15.8:0/2528307935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd0060f70 0x7fccd0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.795+0000 7fccdaffd700 1 -- 172.21.15.8:0/2528307935 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcce007c920 con 0x7fcce40f6530 2023-10-18T21:58:19.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.795+0000 7fcce9a16700 1 --2- 172.21.15.8:0/2528307935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd0060f70 0x7fccd0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:19.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.796+0000 7fcce9a16700 1 --2- 172.21.15.8:0/2528307935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd0060f70 0x7fccd0063430 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fccd4005010 tx=0x7fccd4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:19.800+0000 7fccdaffd700 1 -- 172.21.15.8:0/2528307935 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcce004ff00 con 0x7fcce40f6530 2023-10-18T21:58:20.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.004+0000 7fcceb219700 1 -- 172.21.15.8:0/2528307935 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcce410ac20 con 0x7fccd0060f70 2023-10-18T21:58:20.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.005+0000 7fccdaffd700 1 -- 172.21.15.8:0/2528307935 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcce410ac20 con 0x7fccd0060f70 2023-10-18T21:58:20.007 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:58:20.007 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:58:20.008 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:58:20.008 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:58:20.008 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:58:20.008 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:58:20.008 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:58:20.008 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:58:20.009 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:58:20.009 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:58:20.009 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:58:20.009 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:58:20.009 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:58:20.010 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:58:20.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 -- 172.21.15.8:0/2528307935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd0060f70 msgr2=0x7fccd0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:20.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 --2- 172.21.15.8:0/2528307935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd0060f70 0x7fccd0063430 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fccd4005010 tx=0x7fccd4016040).stop 2023-10-18T21:58:20.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 -- 172.21.15.8:0/2528307935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce40f6530 msgr2=0x7fcce4108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:20.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 --2- 172.21.15.8:0/2528307935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce40f6530 0x7fcce4108ee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcce000e7c0 tx=0x7fcce000b040).stop 2023-10-18T21:58:20.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 -- 172.21.15.8:0/2528307935 shutdown_connections 2023-10-18T21:58:20.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 --2- 172.21.15.8:0/2528307935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccd0060f70 0x7fccd0063430 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:20.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 --2- 172.21.15.8:0/2528307935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce40f6530 0x7fcce4108ee0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:20.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 --2- 172.21.15.8:0/2528307935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcce40f77d0 0x7fcce41093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:20.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 -- 172.21.15.8:0/2528307935 >> 172.21.15.8:0/2528307935 conn(0x7fcce40f1c90 msgr2=0x7fcce406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:20.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 -- 172.21.15.8:0/2528307935 shutdown_connections 2023-10-18T21:58:20.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:20.007+0000 7fcceb219700 1 -- 172.21.15.8:0/2528307935 wait complete. 2023-10-18T21:58:20.217 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:18.523120+0000 mgr.smithi008.flmjzp (mgr.14640) 3563 : audit [DBG] from='client.36932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:20.218 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:18.864108+0000 mgr.smithi008.flmjzp (mgr.14640) 3564 : audit [DBG] from='client.36936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:20.218 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.276065+0000 mon.smithi008 (mon.0) 3909 : audit [DBG] from='client.? 172.21.15.8:0/3383687091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:20.218 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.651714+0000 mon.smithi008 (mon.0) 3910 : audit [DBG] from='client.? 172.21.15.8:0/3106108922' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:58:20.218 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.908193+0000 mon.smithi008 (mon.0) 3911 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:20.219 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.909878+0000 mon.smithi008 (mon.0) 3912 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:20.219 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.910637+0000 mon.smithi008 (mon.0) 3913 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:20.219 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.915968+0000 mon.smithi008 (mon.0) 3914 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:20.219 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.920869+0000 mon.smithi008 (mon.0) 3915 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:20.219 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.923322+0000 mon.smithi008 (mon.0) 3916 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:20.220 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.924578+0000 mon.smithi008 (mon.0) 3917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:20.220 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.925918+0000 mon.smithi008 (mon.0) 3918 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:20.220 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:19.927479+0000 mon.smithi008 (mon.0) 3919 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:18.523120+0000 mgr.smithi008.flmjzp (mgr.14640) 3563 : audit [DBG] from='client.36932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:18.864108+0000 mgr.smithi008.flmjzp (mgr.14640) 3564 : audit [DBG] from='client.36936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.276065+0000 mon.smithi008 (mon.0) 3909 : audit [DBG] from='client.? 172.21.15.8:0/3383687091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.651714+0000 mon.smithi008 (mon.0) 3910 : audit [DBG] from='client.? 172.21.15.8:0/3106108922' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:58:20.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.908193+0000 mon.smithi008 (mon.0) 3911 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.909878+0000 mon.smithi008 (mon.0) 3912 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.910637+0000 mon.smithi008 (mon.0) 3913 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.915968+0000 mon.smithi008 (mon.0) 3914 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:20.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.920869+0000 mon.smithi008 (mon.0) 3915 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:20.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.923322+0000 mon.smithi008 (mon.0) 3916 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:20.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.924578+0000 mon.smithi008 (mon.0) 3917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:20.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.925918+0000 mon.smithi008 (mon.0) 3918 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:20.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:19.927479+0000 mon.smithi008 (mon.0) 3919 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:21.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:19.879720+0000 mgr.smithi008.flmjzp (mgr.14640) 3565 : cluster [DBG] pgmap v2450: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:21.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:58:19.911321+0000 mgr.smithi008.flmjzp (mgr.14640) 3566 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:21.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:19.911769+0000 mgr.smithi008.flmjzp (mgr.14640) 3567 : cluster [DBG] pgmap v2451: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:21.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:19.911986+0000 mgr.smithi008.flmjzp (mgr.14640) 3568 : cluster [DBG] pgmap v2452: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:21.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:58:19.929002+0000 mgr.smithi008.flmjzp (mgr.14640) 3569 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:21.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:20.006313+0000 mgr.smithi008.flmjzp (mgr.14640) 3570 : audit [DBG] from='client.46605 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:19.879720+0000 mgr.smithi008.flmjzp (mgr.14640) 3565 : cluster [DBG] pgmap v2450: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:58:19.911321+0000 mgr.smithi008.flmjzp (mgr.14640) 3566 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:19.911769+0000 mgr.smithi008.flmjzp (mgr.14640) 3567 : cluster [DBG] pgmap v2451: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:19.911986+0000 mgr.smithi008.flmjzp (mgr.14640) 3568 : cluster [DBG] pgmap v2452: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:58:19.929002+0000 mgr.smithi008.flmjzp (mgr.14640) 3569 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:20.006313+0000 mgr.smithi008.flmjzp (mgr.14640) 3570 : audit [DBG] from='client.46605 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:21.912659+0000 mgr.smithi008.flmjzp (mgr.14640) 3571 : cluster [DBG] pgmap v2453: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:21.912659+0000 mgr.smithi008.flmjzp (mgr.14640) 3571 : cluster [DBG] pgmap v2453: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:25.210 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:23.913281+0000 mgr.smithi008.flmjzp (mgr.14640) 3572 : cluster [DBG] pgmap v2454: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:25.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:23.913281+0000 mgr.smithi008.flmjzp (mgr.14640) 3572 : cluster [DBG] pgmap v2454: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:27.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:25.913899+0000 mgr.smithi008.flmjzp (mgr.14640) 3573 : cluster [DBG] pgmap v2455: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:25.913899+0000 mgr.smithi008.flmjzp (mgr.14640) 3573 : cluster [DBG] pgmap v2455: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:29.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:27.914639+0000 mgr.smithi008.flmjzp (mgr.14640) 3574 : cluster [DBG] pgmap v2456: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:27.914639+0000 mgr.smithi008.flmjzp (mgr.14640) 3574 : cluster [DBG] pgmap v2456: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:30.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:29.939870+0000 mon.smithi008 (mon.0) 3920 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:29.939870+0000 mon.smithi008 (mon.0) 3920 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:29.915421+0000 mgr.smithi008.flmjzp (mgr.14640) 3575 : cluster [DBG] pgmap v2457: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:30.500328+0000 mon.smithi008 (mon.0) 3921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:30.501578+0000 mon.smithi008 (mon.0) 3922 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:30.507194+0000 mon.smithi008 (mon.0) 3923 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:31.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:30.517057+0000 mon.smithi008 (mon.0) 3924 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:31.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:30.520150+0000 mon.smithi008 (mon.0) 3925 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:31.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:30.522085+0000 mon.smithi008 (mon.0) 3926 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:31.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:30.523475+0000 mon.smithi008 (mon.0) 3927 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:31.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:30.525152+0000 mon.smithi008 (mon.0) 3928 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:29.915421+0000 mgr.smithi008.flmjzp (mgr.14640) 3575 : cluster [DBG] pgmap v2457: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:30.500328+0000 mon.smithi008 (mon.0) 3921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:30.501578+0000 mon.smithi008 (mon.0) 3922 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:30.507194+0000 mon.smithi008 (mon.0) 3923 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:30.517057+0000 mon.smithi008 (mon.0) 3924 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:30.520150+0000 mon.smithi008 (mon.0) 3925 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:30.522085+0000 mon.smithi008 (mon.0) 3926 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:31.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:30.523475+0000 mon.smithi008 (mon.0) 3927 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:31.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:30.525152+0000 mon.smithi008 (mon.0) 3928 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:58:30.502276+0000 mgr.smithi008.flmjzp (mgr.14640) 3576 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:30.502845+0000 mgr.smithi008.flmjzp (mgr.14640) 3577 : cluster [DBG] pgmap v2458: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:30.503120+0000 mgr.smithi008.flmjzp (mgr.14640) 3578 : cluster [DBG] pgmap v2459: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:58:30.527097+0000 mgr.smithi008.flmjzp (mgr.14640) 3579 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:32.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:58:30.502276+0000 mgr.smithi008.flmjzp (mgr.14640) 3576 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:32.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:30.502845+0000 mgr.smithi008.flmjzp (mgr.14640) 3577 : cluster [DBG] pgmap v2458: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:32.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:30.503120+0000 mgr.smithi008.flmjzp (mgr.14640) 3578 : cluster [DBG] pgmap v2459: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:32.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:58:30.527097+0000 mgr.smithi008.flmjzp (mgr.14640) 3579 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:32.503668+0000 mgr.smithi008.flmjzp (mgr.14640) 3580 : cluster [DBG] pgmap v2460: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:32.503668+0000 mgr.smithi008.flmjzp (mgr.14640) 3580 : cluster [DBG] pgmap v2460: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:34.504231+0000 mgr.smithi008.flmjzp (mgr.14640) 3581 : cluster [DBG] pgmap v2461: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:34.504231+0000 mgr.smithi008.flmjzp (mgr.14640) 3581 : cluster [DBG] pgmap v2461: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:36.504878+0000 mgr.smithi008.flmjzp (mgr.14640) 3582 : cluster [DBG] pgmap v2462: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:36.504878+0000 mgr.smithi008.flmjzp (mgr.14640) 3582 : cluster [DBG] pgmap v2462: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:38.505423+0000 mgr.smithi008.flmjzp (mgr.14640) 3583 : cluster [DBG] pgmap v2463: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:38.505423+0000 mgr.smithi008.flmjzp (mgr.14640) 3583 : cluster [DBG] pgmap v2463: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:40.536039+0000 mon.smithi008 (mon.0) 3929 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:40.538437+0000 mon.smithi008 (mon.0) 3930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:40.539444+0000 mon.smithi008 (mon.0) 3931 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:40.545961+0000 mon.smithi008 (mon.0) 3932 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:40.552364+0000 mon.smithi008 (mon.0) 3933 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:40.555478+0000 mon.smithi008 (mon.0) 3934 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:40.557151+0000 mon.smithi008 (mon.0) 3935 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:40.558813+0000 mon.smithi008 (mon.0) 3936 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:40.560792+0000 mon.smithi008 (mon.0) 3937 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:40.536039+0000 mon.smithi008 (mon.0) 3929 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:40.538437+0000 mon.smithi008 (mon.0) 3930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:40.539444+0000 mon.smithi008 (mon.0) 3931 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:40.545961+0000 mon.smithi008 (mon.0) 3932 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:40.552364+0000 mon.smithi008 (mon.0) 3933 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:40.555478+0000 mon.smithi008 (mon.0) 3934 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:40.557151+0000 mon.smithi008 (mon.0) 3935 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:40.558813+0000 mon.smithi008 (mon.0) 3936 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:40.560792+0000 mon.smithi008 (mon.0) 3937 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:42.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:40.505993+0000 mgr.smithi008.flmjzp (mgr.14640) 3584 : cluster [DBG] pgmap v2464: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:58:40.540330+0000 mgr.smithi008.flmjzp (mgr.14640) 3585 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:40.540916+0000 mgr.smithi008.flmjzp (mgr.14640) 3586 : cluster [DBG] pgmap v2465: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:40.541174+0000 mgr.smithi008.flmjzp (mgr.14640) 3587 : cluster [DBG] pgmap v2466: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:58:40.562642+0000 mgr.smithi008.flmjzp (mgr.14640) 3588 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:40.505993+0000 mgr.smithi008.flmjzp (mgr.14640) 3584 : cluster [DBG] pgmap v2464: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:58:40.540330+0000 mgr.smithi008.flmjzp (mgr.14640) 3585 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:40.540916+0000 mgr.smithi008.flmjzp (mgr.14640) 3586 : cluster [DBG] pgmap v2465: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:40.541174+0000 mgr.smithi008.flmjzp (mgr.14640) 3587 : cluster [DBG] pgmap v2466: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:42.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:58:40.562642+0000 mgr.smithi008.flmjzp (mgr.14640) 3588 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:42.541869+0000 mgr.smithi008.flmjzp (mgr.14640) 3589 : cluster [DBG] pgmap v2467: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:42.541869+0000 mgr.smithi008.flmjzp (mgr.14640) 3589 : cluster [DBG] pgmap v2467: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:44.542493+0000 mgr.smithi008.flmjzp (mgr.14640) 3590 : cluster [DBG] pgmap v2468: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:44.542493+0000 mgr.smithi008.flmjzp (mgr.14640) 3590 : cluster [DBG] pgmap v2468: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:46.543081+0000 mgr.smithi008.flmjzp (mgr.14640) 3591 : cluster [DBG] pgmap v2469: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:46.543081+0000 mgr.smithi008.flmjzp (mgr.14640) 3591 : cluster [DBG] pgmap v2469: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.160+0000 7fc9e1265700 1 -- 172.21.15.8:0/972522778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9dc0f77d0 msgr2=0x7fc9dc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.160+0000 7fc9e1265700 1 --2- 172.21.15.8:0/972522778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9dc0f77d0 0x7fc9dc0f7c30 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7fc9d0004660 tx=0x7fc9d0009b30).stop 2023-10-18T21:58:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.160+0000 7fc9e1265700 1 -- 172.21.15.8:0/972522778 shutdown_connections 2023-10-18T21:58:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.160+0000 7fc9e1265700 1 --2- 172.21.15.8:0/972522778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9dc0f77d0 0x7fc9dc0f7c30 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.160+0000 7fc9e1265700 1 --2- 172.21.15.8:0/972522778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9dc0f6530 0x7fc9dc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.160+0000 7fc9e1265700 1 -- 172.21.15.8:0/972522778 >> 172.21.15.8:0/972522778 conn(0x7fc9dc0f1c90 msgr2=0x7fc9dc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.160+0000 7fc9e1265700 1 -- 172.21.15.8:0/972522778 shutdown_connections 2023-10-18T21:58:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.160+0000 7fc9e1265700 1 -- 172.21.15.8:0/972522778 wait complete. 2023-10-18T21:58:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.161+0000 7fc9e1265700 1 Processor -- start 2023-10-18T21:58:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.161+0000 7fc9e1265700 1 -- start start 2023-10-18T21:58:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.161+0000 7fc9e1265700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9dc0f6530 0x7fc9dc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.161+0000 7fc9e1265700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9dc0f77d0 0x7fc9dc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.161+0000 7fc9e1265700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc06a380 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.161+0000 7fc9e1265700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc06a4c0 con 0x7fc9dc0f6530 2023-10-18T21:58:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.161+0000 7fc9db7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9dc0f77d0 0x7fc9dc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.162+0000 7fc9db7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9dc0f77d0 0x7fc9dc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48278/0 (socket says 172.21.15.8:48278) 2023-10-18T21:58:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.162+0000 7fc9db7fe700 1 -- 172.21.15.8:0/932489514 learned_addr learned my addr 172.21.15.8:0/932489514 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.162+0000 7fc9dbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9dc0f6530 0x7fc9dc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.162+0000 7fc9db7fe700 1 -- 172.21.15.8:0/932489514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9dc0f6530 msgr2=0x7fc9dc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.162+0000 7fc9db7fe700 1 --2- 172.21.15.8:0/932489514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9dc0f6530 0x7fc9dc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.162+0000 7fc9db7fe700 1 -- 172.21.15.8:0/932489514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0005040 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.162+0000 7fc9db7fe700 1 --2- 172.21.15.8:0/932489514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9dc0f77d0 0x7fc9dc069e20 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fc9d0009990 tx=0x7fc9d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.162+0000 7fc9d8ff9700 1 -- 172.21.15.8:0/932489514 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9d0018070 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.163+0000 7fc9d8ff9700 1 -- 172.21.15.8:0/932489514 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc9d0009630 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.163+0000 7fc9d8ff9700 1 -- 172.21.15.8:0/932489514 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9d001c3c0 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.163+0000 7fc9e1265700 1 -- 172.21.15.8:0/932489514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc06a740 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.163+0000 7fc9e1265700 1 -- 172.21.15.8:0/932489514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc06aca0 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.164+0000 7fc9e1265700 1 -- 172.21.15.8:0/932489514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc045ad0 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.165+0000 7fc9d8ff9700 1 -- 172.21.15.8:0/932489514 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc9d001d970 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.165+0000 7fc9d8ff9700 1 --2- 172.21.15.8:0/932489514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9c4060f70 0x7fc9c4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.166+0000 7fc9d8ff9700 1 -- 172.21.15.8:0/932489514 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc9d007e5a0 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.166+0000 7fc9dbfff700 1 --2- 172.21.15.8:0/932489514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9c4060f70 0x7fc9c4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.166+0000 7fc9dbfff700 1 --2- 172.21.15.8:0/932489514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9c4060f70 0x7fc9c4063430 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fc9dc06b730 tx=0x7fc9cc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:50.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.170+0000 7fc9d8ff9700 1 -- 172.21.15.8:0/932489514 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc9d004e210 con 0x7fc9dc0f77d0 2023-10-18T21:58:50.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.369+0000 7fc9e1265700 1 -- 172.21.15.8:0/932489514 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9dc057f10 con 0x7fc9c4060f70 2023-10-18T21:58:50.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.370+0000 7fc9d8ff9700 1 -- 172.21.15.8:0/932489514 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc9dc057f10 con 0x7fc9c4060f70 2023-10-18T21:58:50.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 -- 172.21.15.8:0/932489514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9c4060f70 msgr2=0x7fc9c4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:50.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 --2- 172.21.15.8:0/932489514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9c4060f70 0x7fc9c4063430 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fc9dc06b730 tx=0x7fc9cc00b040).stop 2023-10-18T21:58:50.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 -- 172.21.15.8:0/932489514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9dc0f77d0 msgr2=0x7fc9dc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:50.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 --2- 172.21.15.8:0/932489514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9dc0f77d0 0x7fc9dc069e20 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fc9d0009990 tx=0x7fc9d0009b30).stop 2023-10-18T21:58:50.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 -- 172.21.15.8:0/932489514 shutdown_connections 2023-10-18T21:58:50.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 --2- 172.21.15.8:0/932489514 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc9c4060f70 0x7fc9c4063430 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 --2- 172.21.15.8:0/932489514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9dc0f6530 0x7fc9dc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 --2- 172.21.15.8:0/932489514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9dc0f77d0 0x7fc9dc069e20 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 -- 172.21.15.8:0/932489514 >> 172.21.15.8:0/932489514 conn(0x7fc9dc0f1c90 msgr2=0x7fc9dc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 -- 172.21.15.8:0/932489514 shutdown_connections 2023-10-18T21:58:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.372+0000 7fc9e1265700 1 -- 172.21.15.8:0/932489514 wait complete. 2023-10-18T21:58:50.389 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:58:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:48.543601+0000 mgr.smithi008.flmjzp (mgr.14640) 3592 : cluster [DBG] pgmap v2470: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:50.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:48.543601+0000 mgr.smithi008.flmjzp (mgr.14640) 3592 : cluster [DBG] pgmap v2470: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:50.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.509+0000 7fefece95700 1 -- 172.21.15.8:0/383407390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe80f6530 msgr2=0x7fefe80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.509+0000 7fefece95700 1 --2- 172.21.15.8:0/383407390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe80f6530 0x7fefe80f6950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fefd8004660 tx=0x7fefd8009b30).stop 2023-10-18T21:58:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.509+0000 7fefece95700 1 -- 172.21.15.8:0/383407390 shutdown_connections 2023-10-18T21:58:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.509+0000 7fefece95700 1 --2- 172.21.15.8:0/383407390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefe80f77d0 0x7fefe80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.509+0000 7fefece95700 1 --2- 172.21.15.8:0/383407390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe80f6530 0x7fefe80f6950 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.509+0000 7fefece95700 1 -- 172.21.15.8:0/383407390 >> 172.21.15.8:0/383407390 conn(0x7fefe80f1c90 msgr2=0x7fefe80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:50.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.510+0000 7fefece95700 1 -- 172.21.15.8:0/383407390 shutdown_connections 2023-10-18T21:58:50.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.510+0000 7fefece95700 1 -- 172.21.15.8:0/383407390 wait complete. 2023-10-18T21:58:50.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.510+0000 7fefece95700 1 Processor -- start 2023-10-18T21:58:50.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.511+0000 7fefece95700 1 -- start start 2023-10-18T21:58:50.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.511+0000 7fefece95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefe80f6530 0x7fefe8108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:50.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.511+0000 7fefece95700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe80f77d0 0x7fefe8109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:50.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.511+0000 7fefece95700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe81099e0 con 0x7fefe80f6530 2023-10-18T21:58:50.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.511+0000 7fefece95700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8109b20 con 0x7fefe80f77d0 2023-10-18T21:58:50.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.511+0000 7fefe77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefe80f6530 0x7fefe8108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:50.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.511+0000 7fefe77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefe80f6530 0x7fefe8108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48288/0 (socket says 172.21.15.8:48288) 2023-10-18T21:58:50.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.511+0000 7fefe77fe700 1 -- 172.21.15.8:0/1352995393 learned_addr learned my addr 172.21.15.8:0/1352995393 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:50.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.511+0000 7fefe6ffd700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe80f77d0 0x7fefe8109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:50.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.512+0000 7fefe77fe700 1 -- 172.21.15.8:0/1352995393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe80f77d0 msgr2=0x7fefe8109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:50.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.512+0000 7fefe77fe700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe80f77d0 0x7fefe8109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.512+0000 7fefe77fe700 1 -- 172.21.15.8:0/1352995393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc005040 con 0x7fefe80f6530 2023-10-18T21:58:50.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.512+0000 7fefe77fe700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefe80f6530 0x7fefe8108f40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fefd8014040 tx=0x7fefd800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:50.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.512+0000 7fefcffff700 1 -- 172.21.15.8:0/1352995393 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefd8019070 con 0x7fefe80f6530 2023-10-18T21:58:50.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.512+0000 7fefcffff700 1 -- 172.21.15.8:0/1352995393 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fefd801e420 con 0x7fefe80f6530 2023-10-18T21:58:50.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.512+0000 7fefece95700 1 -- 172.21.15.8:0/1352995393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd8005040 con 0x7fefe80f6530 2023-10-18T21:58:50.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.512+0000 7fefcffff700 1 -- 172.21.15.8:0/1352995393 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefd8014620 con 0x7fefe80f6530 2023-10-18T21:58:50.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.512+0000 7fefece95700 1 -- 172.21.15.8:0/1352995393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe810a7b0 con 0x7fefe80f6530 2023-10-18T21:58:50.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.513+0000 7fefece95700 1 -- 172.21.15.8:0/1352995393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe8059100 con 0x7fefe80f6530 2023-10-18T21:58:50.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.514+0000 7fefcffff700 1 -- 172.21.15.8:0/1352995393 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fefd801e9e0 con 0x7fefe80f6530 2023-10-18T21:58:50.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.515+0000 7fefcffff700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefd0060f70 0x7fefd0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:50.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.515+0000 7fefcffff700 1 -- 172.21.15.8:0/1352995393 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fefd807ddb0 con 0x7fefe80f6530 2023-10-18T21:58:50.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.515+0000 7fefe6ffd700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefd0060f70 0x7fefd0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:50.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.516+0000 7fefe6ffd700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefd0060f70 0x7fefd0063430 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fefdc009050 tx=0x7fefdc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:50.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.519+0000 7fefcffff700 1 -- 172.21.15.8:0/1352995393 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fefd8051390 con 0x7fefe80f6530 2023-10-18T21:58:50.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.718+0000 7fefece95700 1 -- 172.21.15.8:0/1352995393 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fefe80fc010 con 0x7fefd0060f70 2023-10-18T21:58:50.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.720+0000 7fefcffff700 1 -- 172.21.15.8:0/1352995393 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fefe80fc010 con 0x7fefd0060f70 2023-10-18T21:58:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 -- 172.21.15.8:0/1352995393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefd0060f70 msgr2=0x7fefd0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefd0060f70 0x7fefd0063430 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fefdc009050 tx=0x7fefdc00b040).stop 2023-10-18T21:58:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 -- 172.21.15.8:0/1352995393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefe80f6530 msgr2=0x7fefe8108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefe80f6530 0x7fefe8108f40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fefd8014040 tx=0x7fefd800b040).stop 2023-10-18T21:58:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 -- 172.21.15.8:0/1352995393 shutdown_connections 2023-10-18T21:58:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fefd0060f70 0x7fefd0063430 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefe80f6530 0x7fefe8108f40 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 --2- 172.21.15.8:0/1352995393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe80f77d0 0x7fefe8109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 -- 172.21.15.8:0/1352995393 >> 172.21.15.8:0/1352995393 conn(0x7fefe80f1c90 msgr2=0x7fefe806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:50.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 -- 172.21.15.8:0/1352995393 shutdown_connections 2023-10-18T21:58:50.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.722+0000 7fefece95700 1 -- 172.21.15.8:0/1352995393 wait complete. 2023-10-18T21:58:50.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.858+0000 7f959cecf700 1 -- 172.21.15.8:0/4262680462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95980f9690 msgr2=0x7f95980fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:50.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.858+0000 7f959cecf700 1 --2- 172.21.15.8:0/4262680462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95980f9690 0x7f95980fbae0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f958c004660 tx=0x7f958c009b30).stop 2023-10-18T21:58:50.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.858+0000 7f959cecf700 1 -- 172.21.15.8:0/4262680462 shutdown_connections 2023-10-18T21:58:50.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.858+0000 7f959cecf700 1 --2- 172.21.15.8:0/4262680462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95980f9690 0x7f95980fbae0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.858+0000 7f959cecf700 1 --2- 172.21.15.8:0/4262680462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598060310 0x7f95980f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.858+0000 7f959cecf700 1 -- 172.21.15.8:0/4262680462 >> 172.21.15.8:0/4262680462 conn(0x7f95980f0b90 msgr2=0x7f95980f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:50.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.858+0000 7f959cecf700 1 -- 172.21.15.8:0/4262680462 shutdown_connections 2023-10-18T21:58:50.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.858+0000 7f959cecf700 1 -- 172.21.15.8:0/4262680462 wait complete. 2023-10-18T21:58:50.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.859+0000 7f959cecf700 1 Processor -- start 2023-10-18T21:58:50.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.859+0000 7f959cecf700 1 -- start start 2023-10-18T21:58:50.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f959cecf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598060310 0x7f9598106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:50.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f959cecf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95980f9690 0x7f9598107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:50.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f959cecf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9598107840 con 0x7f95980f9690 2023-10-18T21:58:50.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f959cecf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9598108050 con 0x7f9598060310 2023-10-18T21:58:50.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f9596ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95980f9690 0x7f9598107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:50.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f9596ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95980f9690 0x7f9598107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48304/0 (socket says 172.21.15.8:48304) 2023-10-18T21:58:50.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f9596ffd700 1 -- 172.21.15.8:0/2572270935 learned_addr learned my addr 172.21.15.8:0/2572270935 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:50.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f95977fe700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598060310 0x7f9598106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:50.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f9596ffd700 1 -- 172.21.15.8:0/2572270935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598060310 msgr2=0x7f9598106d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:50.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f9596ffd700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598060310 0x7f9598106d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:50.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.860+0000 7f9596ffd700 1 -- 172.21.15.8:0/2572270935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c005040 con 0x7f95980f9690 2023-10-18T21:58:50.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.861+0000 7f9596ffd700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95980f9690 0x7f9598107240 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f958c009870 tx=0x7f958c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:50.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.861+0000 7f957ffff700 1 -- 172.21.15.8:0/2572270935 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f958c019070 con 0x7f95980f9690 2023-10-18T21:58:50.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.861+0000 7f957ffff700 1 -- 172.21.15.8:0/2572270935 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f958c013380 con 0x7f95980f9690 2023-10-18T21:58:50.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.861+0000 7f959cecf700 1 -- 172.21.15.8:0/2572270935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9598108270 con 0x7f95980f9690 2023-10-18T21:58:50.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.861+0000 7f957ffff700 1 -- 172.21.15.8:0/2572270935 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f958c01edf0 con 0x7f95980f9690 2023-10-18T21:58:50.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.861+0000 7f959cecf700 1 -- 172.21.15.8:0/2572270935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9598108750 con 0x7f95980f9690 2023-10-18T21:58:50.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.862+0000 7f959cecf700 1 -- 172.21.15.8:0/2572270935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9598059100 con 0x7f95980f9690 2023-10-18T21:58:50.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.863+0000 7f957ffff700 1 -- 172.21.15.8:0/2572270935 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f958c01e420 con 0x7f95980f9690 2023-10-18T21:58:50.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.864+0000 7f957ffff700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9580060f70 0x7f9580063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:50.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.864+0000 7f957ffff700 1 -- 172.21.15.8:0/2572270935 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f958c07ddb0 con 0x7f95980f9690 2023-10-18T21:58:50.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.864+0000 7f95977fe700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9580060f70 0x7f9580063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:50.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.865+0000 7f95977fe700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9580060f70 0x7f9580063430 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f9598106ac0 tx=0x7f958800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:50.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:50.868+0000 7f957ffff700 1 -- 172.21.15.8:0/2572270935 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f958c04d960 con 0x7f95980f9690 2023-10-18T21:58:51.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.061+0000 7f959cecf700 1 -- 172.21.15.8:0/2572270935 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f95980fee00 con 0x7f9580060f70 2023-10-18T21:58:51.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.071+0000 7f957ffff700 1 -- 172.21.15.8:0/2572270935 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f95980fee00 con 0x7f9580060f70 2023-10-18T21:58:51.073 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:58:51.073 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (65m) 2m ago 67m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:58:51.074 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (59m) 2m ago 66m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:58:51.074 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (59m) 51s ago 66m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:58:51.074 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (65m) 2m ago 66m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:58:51.074 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 63m - - 2023-10-18T21:58:51.074 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 62m - - 2023-10-18T21:58:51.075 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 51s ago 62m - - 2023-10-18T21:58:51.075 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 51s ago 62m - - 2023-10-18T21:58:51.075 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (60m) 2m ago 68m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:58:51.075 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (60m) 51s ago 66m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:58:51.075 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (59m) 2m ago 68m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:58:51.075 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (59m) 51s ago 66m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:58:51.076 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (66m) 2m ago 66m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:58:51.076 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (65m) 51s ago 65m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:58:51.076 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (59m) 2m ago 65m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:58:51.076 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (57m) 2m ago 65m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:58:51.076 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (56m) 2m ago 64m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:58:51.077 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (56m) 51s ago 64m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:58:51.077 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (55m) 51s ago 64m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:58:51.077 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (54m) 51s ago 64m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:58:51.077 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (61m) 2m ago 66m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:58:51.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 -- 172.21.15.8:0/2572270935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9580060f70 msgr2=0x7f9580063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:51.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9580060f70 0x7f9580063430 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f9598106ac0 tx=0x7f958800b040).stop 2023-10-18T21:58:51.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 -- 172.21.15.8:0/2572270935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95980f9690 msgr2=0x7f9598107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:51.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95980f9690 0x7f9598107240 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f958c009870 tx=0x7f958c00b040).stop 2023-10-18T21:58:51.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 -- 172.21.15.8:0/2572270935 shutdown_connections 2023-10-18T21:58:51.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9580060f70 0x7f9580063430 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598060310 0x7f9598106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 --2- 172.21.15.8:0/2572270935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95980f9690 0x7f9598107240 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 -- 172.21.15.8:0/2572270935 >> 172.21.15.8:0/2572270935 conn(0x7f95980f0b90 msgr2=0x7f95980f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 -- 172.21.15.8:0/2572270935 shutdown_connections 2023-10-18T21:58:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.073+0000 7f959cecf700 1 -- 172.21.15.8:0/2572270935 wait complete. 2023-10-18T21:58:51.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.212+0000 7f009ebbc700 1 -- 172.21.15.8:0/2209754013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00980f6530 msgr2=0x7f00980f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:51.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.212+0000 7f009ebbc700 1 --2- 172.21.15.8:0/2209754013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00980f6530 0x7f00980f6950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f00940045a0 tx=0x7f0094009b30).stop 2023-10-18T21:58:51.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.212+0000 7f009ebbc700 1 -- 172.21.15.8:0/2209754013 shutdown_connections 2023-10-18T21:58:51.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.212+0000 7f009ebbc700 1 --2- 172.21.15.8:0/2209754013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00980f77d0 0x7f00980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.212+0000 7f009ebbc700 1 --2- 172.21.15.8:0/2209754013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00980f6530 0x7f00980f6950 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.212+0000 7f009ebbc700 1 -- 172.21.15.8:0/2209754013 >> 172.21.15.8:0/2209754013 conn(0x7f00980f1c90 msgr2=0x7f00980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:51.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.212+0000 7f009ebbc700 1 -- 172.21.15.8:0/2209754013 shutdown_connections 2023-10-18T21:58:51.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.212+0000 7f009ebbc700 1 -- 172.21.15.8:0/2209754013 wait complete. 2023-10-18T21:58:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.213+0000 7f009ebbc700 1 Processor -- start 2023-10-18T21:58:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.213+0000 7f009ebbc700 1 -- start start 2023-10-18T21:58:51.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.213+0000 7f009ebbc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00980f6530 0x7f0098108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:51.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.213+0000 7f009ebbc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00980f77d0 0x7f0098109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:51.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.213+0000 7f009ebbc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00981099d0 con 0x7f00980f6530 2023-10-18T21:58:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.213+0000 7f009ebbc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098109b10 con 0x7f00980f77d0 2023-10-18T21:58:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.213+0000 7f009dbba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00980f6530 0x7f0098108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.213+0000 7f009dbba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00980f6530 0x7f0098108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48322/0 (socket says 172.21.15.8:48322) 2023-10-18T21:58:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.213+0000 7f009dbba700 1 -- 172.21.15.8:0/1498549914 learned_addr learned my addr 172.21.15.8:0/1498549914 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f009d3b9700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00980f77d0 0x7f0098109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f009dbba700 1 -- 172.21.15.8:0/1498549914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00980f77d0 msgr2=0x7f0098109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f009dbba700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00980f77d0 0x7f0098109420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f009dbba700 1 -- 172.21.15.8:0/1498549914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094005040 con 0x7f00980f6530 2023-10-18T21:58:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f009d3b9700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00980f77d0 0x7f0098109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:58:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f009dbba700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00980f6530 0x7f0098108f30 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f0094004cc0 tx=0x7f009400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:51.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f008e7fc700 1 -- 172.21.15.8:0/1498549914 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f009400e070 con 0x7f00980f6530 2023-10-18T21:58:51.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f008e7fc700 1 -- 172.21.15.8:0/1498549914 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0094007e80 con 0x7f00980f6530 2023-10-18T21:58:51.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f008e7fc700 1 -- 172.21.15.8:0/1498549914 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0094019070 con 0x7f00980f6530 2023-10-18T21:58:51.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f009ebbc700 1 -- 172.21.15.8:0/1498549914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009810a450 con 0x7f00980f6530 2023-10-18T21:58:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.214+0000 7f009ebbc700 1 -- 172.21.15.8:0/1498549914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009810a930 con 0x7f00980f6530 2023-10-18T21:58:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.215+0000 7f009ebbc700 1 -- 172.21.15.8:0/1498549914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0098045ad0 con 0x7f00980f6530 2023-10-18T21:58:51.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.216+0000 7f008e7fc700 1 -- 172.21.15.8:0/1498549914 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0094025070 con 0x7f00980f6530 2023-10-18T21:58:51.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.217+0000 7f008e7fc700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0084060f10 0x7f00840633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:51.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.217+0000 7f008e7fc700 1 -- 172.21.15.8:0/1498549914 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f009407d700 con 0x7f00980f6530 2023-10-18T21:58:51.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.218+0000 7f009d3b9700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0084060f10 0x7f00840633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:51.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.218+0000 7f009d3b9700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0084060f10 0x7f00840633d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f0088009da0 tx=0x7f008800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:51.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.222+0000 7f008e7fc700 1 -- 172.21.15.8:0/1498549914 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0094050c80 con 0x7f00980f6530 2023-10-18T21:58:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:50.572954+0000 mon.smithi008 (mon.0) 3938 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:51.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.476+0000 7f009ebbc700 1 -- 172.21.15.8:0/1498549914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f00980008d0 con 0x7f00980f6530 2023-10-18T21:58:51.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.477+0000 7f008e7fc700 1 -- 172.21.15.8:0/1498549914 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f0094023070 con 0x7f00980f6530 2023-10-18T21:58:51.479 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:58:51.480 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:58:51.480 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:58:51.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:58:51.481 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:58:51.481 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:58:51.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:58:51.481 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:58:51.481 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:58:51.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:58:51.482 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:58:51.482 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:58:51.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:58:51.482 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:58:51.482 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:58:51.483 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:58:51.483 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:58:51.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 -- 172.21.15.8:0/1498549914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0084060f10 msgr2=0x7f00840633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:51.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0084060f10 0x7f00840633d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f0088009da0 tx=0x7f008800b040).stop 2023-10-18T21:58:51.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 -- 172.21.15.8:0/1498549914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00980f6530 msgr2=0x7f0098108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:51.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00980f6530 0x7f0098108f30 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f0094004cc0 tx=0x7f009400b040).stop 2023-10-18T21:58:51.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 -- 172.21.15.8:0/1498549914 shutdown_connections 2023-10-18T21:58:51.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0084060f10 0x7f00840633d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00980f6530 0x7f0098108f30 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 --2- 172.21.15.8:0/1498549914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00980f77d0 0x7f0098109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 -- 172.21.15.8:0/1498549914 >> 172.21.15.8:0/1498549914 conn(0x7f00980f1c90 msgr2=0x7f009806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:51.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 -- 172.21.15.8:0/1498549914 shutdown_connections 2023-10-18T21:58:51.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.479+0000 7f009ebbc700 1 -- 172.21.15.8:0/1498549914 wait complete. 2023-10-18T21:58:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:50.572954+0000 mon.smithi008 (mon.0) 3938 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:51.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.615+0000 7f92bbfff700 1 -- 172.21.15.8:0/3482639342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92bc0f77d0 msgr2=0x7f92bc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:51.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.615+0000 7f92bbfff700 1 --2- 172.21.15.8:0/3482639342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92bc0f77d0 0x7f92bc0f7c30 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f92b0004660 tx=0x7f92b0009b30).stop 2023-10-18T21:58:51.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.615+0000 7f92bbfff700 1 -- 172.21.15.8:0/3482639342 shutdown_connections 2023-10-18T21:58:51.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.615+0000 7f92bbfff700 1 --2- 172.21.15.8:0/3482639342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92bc0f77d0 0x7f92bc0f7c30 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.615+0000 7f92bbfff700 1 --2- 172.21.15.8:0/3482639342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92bc0f6530 0x7f92bc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.615+0000 7f92bbfff700 1 -- 172.21.15.8:0/3482639342 >> 172.21.15.8:0/3482639342 conn(0x7f92bc0f1c90 msgr2=0x7f92bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.615+0000 7f92bbfff700 1 -- 172.21.15.8:0/3482639342 shutdown_connections 2023-10-18T21:58:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.615+0000 7f92bbfff700 1 -- 172.21.15.8:0/3482639342 wait complete. 2023-10-18T21:58:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.616+0000 7f92bbfff700 1 Processor -- start 2023-10-18T21:58:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.616+0000 7f92bbfff700 1 -- start start 2023-10-18T21:58:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.616+0000 7f92bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92bc0f6530 0x7f92bc108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.616+0000 7f92bbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92bc0f77d0 0x7f92bc1093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.616+0000 7f92bbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc1099a0 con 0x7f92bc0f6530 2023-10-18T21:58:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.616+0000 7f92bbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc109ae0 con 0x7f92bc0f77d0 2023-10-18T21:58:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.616+0000 7f92baffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92bc0f6530 0x7f92bc108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92baffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92bc0f6530 0x7f92bc108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48352/0 (socket says 172.21.15.8:48352) 2023-10-18T21:58:51.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92baffd700 1 -- 172.21.15.8:0/24316738 learned_addr learned my addr 172.21.15.8:0/24316738 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:51.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92ba7fc700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92bc0f77d0 0x7f92bc1093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:51.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92baffd700 1 -- 172.21.15.8:0/24316738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92bc0f77d0 msgr2=0x7f92bc1093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:51.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92baffd700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92bc0f77d0 0x7f92bc1093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92baffd700 1 -- 172.21.15.8:0/24316738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b0005040 con 0x7f92bc0f6530 2023-10-18T21:58:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92ba7fc700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92bc0f77d0 0x7f92bc1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:58:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92baffd700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92bc0f6530 0x7f92bc108f00 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f92ac00e7c0 tx=0x7f92ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92a37fe700 1 -- 172.21.15.8:0/24316738 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92ac0092e0 con 0x7f92bc0f6530 2023-10-18T21:58:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92a37fe700 1 -- 172.21.15.8:0/24316738 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f92ac00f040 con 0x7f92bc0f6530 2023-10-18T21:58:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92a37fe700 1 -- 172.21.15.8:0/24316738 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92ac0147e0 con 0x7f92bc0f6530 2023-10-18T21:58:51.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.617+0000 7f92bbfff700 1 -- 172.21.15.8:0/24316738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc10a480 con 0x7f92bc0f6530 2023-10-18T21:58:51.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.618+0000 7f92bbfff700 1 -- 172.21.15.8:0/24316738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc10a9c0 con 0x7f92bc0f6530 2023-10-18T21:58:51.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.619+0000 7f92bbfff700 1 -- 172.21.15.8:0/24316738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc045ad0 con 0x7f92bc0f6530 2023-10-18T21:58:51.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.620+0000 7f92a37fe700 1 -- 172.21.15.8:0/24316738 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f92ac01b030 con 0x7f92bc0f6530 2023-10-18T21:58:51.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.621+0000 7f92a37fe700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92a4060f70 0x7f92a4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:51.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.621+0000 7f92a37fe700 1 -- 172.21.15.8:0/24316738 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f92ac07c990 con 0x7f92bc0f6530 2023-10-18T21:58:51.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.621+0000 7f92ba7fc700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92a4060f70 0x7f92a4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:51.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.622+0000 7f92ba7fc700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92a4060f70 0x7f92a4063430 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f92b0009880 tx=0x7f92b000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:51.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.625+0000 7f92a37fe700 1 -- 172.21.15.8:0/24316738 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f92ac04ff10 con 0x7f92bc0f6530 2023-10-18T21:58:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.857+0000 7f92bbfff700 1 -- 172.21.15.8:0/24316738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f92bc0fee40 con 0x7f92bc0f6530 2023-10-18T21:58:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.858+0000 7f92a37fe700 1 -- 172.21.15.8:0/24316738 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f92ac019070 con 0x7f92bc0f6530 2023-10-18T21:58:51.860 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:58:51.861 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:58:51.861 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:58:51.861 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:58:51.861 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:58:51.861 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:58:51.862 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:58:51.862 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:58:51.862 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:58:51.862 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:58:51.862 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:58:51.863 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:58:51.863 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:58:51.863 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:58:51.863 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:58:51.863 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:58:51.864 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:58:51.864 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:58:51.864 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:58:51.864 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:58:51.864 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:58:51.865 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:58:51.865 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:58:51.865 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:58:51.865 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:58:51.865 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:58:51.866 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:58:51.866 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:58:51.866 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:58:51.866 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:58:51.866 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:58:51.867 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:58:51.867 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:58:51.867 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:58:51.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 -- 172.21.15.8:0/24316738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92a4060f70 msgr2=0x7f92a4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:51.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92a4060f70 0x7f92a4063430 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f92b0009880 tx=0x7f92b000b040).stop 2023-10-18T21:58:51.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 -- 172.21.15.8:0/24316738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92bc0f6530 msgr2=0x7f92bc108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:51.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92bc0f6530 0x7f92bc108f00 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f92ac00e7c0 tx=0x7f92ac00b040).stop 2023-10-18T21:58:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 -- 172.21.15.8:0/24316738 shutdown_connections 2023-10-18T21:58:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f92a4060f70 0x7f92a4063430 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92bc0f6530 0x7f92bc108f00 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 --2- 172.21.15.8:0/24316738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92bc0f77d0 0x7f92bc1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 -- 172.21.15.8:0/24316738 >> 172.21.15.8:0/24316738 conn(0x7f92bc0f1c90 msgr2=0x7f92bc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:51.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 -- 172.21.15.8:0/24316738 shutdown_connections 2023-10-18T21:58:51.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.860+0000 7f92bbfff700 1 -- 172.21.15.8:0/24316738 wait complete. 2023-10-18T21:58:51.870 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:58:52.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.998+0000 7f7007174700 1 -- 172.21.15.8:0/3920664876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70000f77d0 msgr2=0x7f70000f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.998+0000 7f7007174700 1 --2- 172.21.15.8:0/3920664876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70000f77d0 0x7f70000f7c30 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f6ff0004660 tx=0x7f6ff0009b30).stop 2023-10-18T21:58:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.998+0000 7f7007174700 1 -- 172.21.15.8:0/3920664876 shutdown_connections 2023-10-18T21:58:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.998+0000 7f7007174700 1 --2- 172.21.15.8:0/3920664876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70000f77d0 0x7f70000f7c30 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.998+0000 7f7007174700 1 --2- 172.21.15.8:0/3920664876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000f6530 0x7f70000f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.998+0000 7f7007174700 1 -- 172.21.15.8:0/3920664876 >> 172.21.15.8:0/3920664876 conn(0x7f70000f1c90 msgr2=0x7f70000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.998+0000 7f7007174700 1 -- 172.21.15.8:0/3920664876 shutdown_connections 2023-10-18T21:58:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.998+0000 7f7007174700 1 -- 172.21.15.8:0/3920664876 wait complete. 2023-10-18T21:58:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.999+0000 7f7007174700 1 Processor -- start 2023-10-18T21:58:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.999+0000 7f7007174700 1 -- start start 2023-10-18T21:58:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.999+0000 7f7007174700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70000f6530 0x7f7000108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.999+0000 7f7007174700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000f77d0 0x7f7000109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.999+0000 7f7007174700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70001099b0 con 0x7f70000f6530 2023-10-18T21:58:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:51.999+0000 7f7007174700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7000109af0 con 0x7f70000f77d0 2023-10-18T21:58:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.000+0000 7f7006172700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70000f6530 0x7f7000108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.000+0000 7f7006172700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70000f6530 0x7f7000108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48374/0 (socket says 172.21.15.8:48374) 2023-10-18T21:58:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.000+0000 7f7006172700 1 -- 172.21.15.8:0/1774484445 learned_addr learned my addr 172.21.15.8:0/1774484445 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:58:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.000+0000 7f7005971700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000f77d0 0x7f7000109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.000+0000 7f7006172700 1 -- 172.21.15.8:0/1774484445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000f77d0 msgr2=0x7f7000109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.000+0000 7f7006172700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000f77d0 0x7f7000109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.000+0000 7f7006172700 1 -- 172.21.15.8:0/1774484445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff0005040 con 0x7f70000f6530 2023-10-18T21:58:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.000+0000 7f7006172700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70000f6530 0x7f7000108f10 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f6ffc002700 tx=0x7f6ffc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.001+0000 7f6ff6ffd700 1 -- 172.21.15.8:0/1774484445 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ffc009320 con 0x7f70000f6530 2023-10-18T21:58:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.001+0000 7f6ff6ffd700 1 -- 172.21.15.8:0/1774484445 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6ffc00f040 con 0x7f70000f6530 2023-10-18T21:58:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.001+0000 7f6ff6ffd700 1 -- 172.21.15.8:0/1774484445 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ffc014970 con 0x7f70000f6530 2023-10-18T21:58:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.001+0000 7f7007174700 1 -- 172.21.15.8:0/1774484445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700010a490 con 0x7f70000f6530 2023-10-18T21:58:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.001+0000 7f7007174700 1 -- 172.21.15.8:0/1774484445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700010aa50 con 0x7f70000f6530 2023-10-18T21:58:52.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.002+0000 7f7007174700 1 -- 172.21.15.8:0/1774484445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7000045ad0 con 0x7f70000f6530 2023-10-18T21:58:52.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.003+0000 7f6ff6ffd700 1 -- 172.21.15.8:0/1774484445 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6ffc009480 con 0x7f70000f6530 2023-10-18T21:58:52.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.003+0000 7f6ff6ffd700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fec060f70 0x7f6fec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:58:52.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.004+0000 7f6ff6ffd700 1 -- 172.21.15.8:0/1774484445 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6ffc07cb80 con 0x7f70000f6530 2023-10-18T21:58:52.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.004+0000 7f7005971700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fec060f70 0x7f6fec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:58:52.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.004+0000 7f7005971700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fec060f70 0x7f6fec063430 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f6ff0004e30 tx=0x7f6ff0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:58:52.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.008+0000 7f6ff6ffd700 1 -- 172.21.15.8:0/1774484445 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6ffc050220 con 0x7f70000f6530 2023-10-18T21:58:52.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.207+0000 7f7007174700 1 -- 172.21.15.8:0/1774484445 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70000fee40 con 0x7f6fec060f70 2023-10-18T21:58:52.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.208+0000 7f6ff6ffd700 1 -- 172.21.15.8:0/1774484445 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f70000fee40 con 0x7f6fec060f70 2023-10-18T21:58:52.211 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:58:52.211 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:58:52.211 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:58:52.211 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:58:52.212 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:58:52.212 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:58:52.212 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:58:52.212 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:58:52.212 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:58:52.213 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:58:52.213 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:58:52.213 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:58:52.213 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:58:52.213 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:58:52.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.210+0000 7f7007174700 1 -- 172.21.15.8:0/1774484445 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fec060f70 msgr2=0x7f6fec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:52.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.210+0000 7f7007174700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fec060f70 0x7f6fec063430 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f6ff0004e30 tx=0x7f6ff0009b30).stop 2023-10-18T21:58:52.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.210+0000 7f7007174700 1 -- 172.21.15.8:0/1774484445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70000f6530 msgr2=0x7f7000108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:58:52.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.210+0000 7f7007174700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70000f6530 0x7f7000108f10 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f6ffc002700 tx=0x7f6ffc009d80).stop 2023-10-18T21:58:52.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.210+0000 7f7007174700 1 -- 172.21.15.8:0/1774484445 shutdown_connections 2023-10-18T21:58:52.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.210+0000 7f7007174700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6fec060f70 0x7f6fec063430 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:52.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.210+0000 7f7007174700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70000f6530 0x7f7000108f10 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:52.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.210+0000 7f7007174700 1 --2- 172.21.15.8:0/1774484445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000f77d0 0x7f7000109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:58:52.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.210+0000 7f7007174700 1 -- 172.21.15.8:0/1774484445 >> 172.21.15.8:0/1774484445 conn(0x7f70000f1c90 msgr2=0x7f700006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:58:52.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.211+0000 7f7007174700 1 -- 172.21.15.8:0/1774484445 shutdown_connections 2023-10-18T21:58:52.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:58:52.211+0000 7f7007174700 1 -- 172.21.15.8:0/1774484445 wait complete. 2023-10-18T21:58:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:50.371525+0000 mgr.smithi008.flmjzp (mgr.14640) 3593 : audit [DBG] from='client.36952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:52.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:50.544050+0000 mgr.smithi008.flmjzp (mgr.14640) 3594 : cluster [DBG] pgmap v2471: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:52.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:50.721122+0000 mgr.smithi008.flmjzp (mgr.14640) 3595 : audit [DBG] from='client.36956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:52.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.063596+0000 mgr.smithi008.flmjzp (mgr.14640) 3596 : audit [DBG] from='client.36960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:52.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.133829+0000 mon.smithi008 (mon.0) 3939 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:52.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.134737+0000 mon.smithi008 (mon.0) 3940 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:52.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:58:51.135512+0000 mgr.smithi008.flmjzp (mgr.14640) 3597 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:52.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:51.136205+0000 mgr.smithi008.flmjzp (mgr.14640) 3598 : cluster [DBG] pgmap v2472: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:52.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:51.136605+0000 mgr.smithi008.flmjzp (mgr.14640) 3599 : cluster [DBG] pgmap v2473: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:52.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.140681+0000 mon.smithi008 (mon.0) 3941 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:52.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.146316+0000 mon.smithi008 (mon.0) 3942 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:52.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.148984+0000 mon.smithi008 (mon.0) 3943 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:52.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.150485+0000 mon.smithi008 (mon.0) 3944 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:52.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.151974+0000 mon.smithi008 (mon.0) 3945 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:52.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.154114+0000 mon.smithi008 (mon.0) 3946 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:52.318 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:58:51.156036+0000 mgr.smithi008.flmjzp (mgr.14640) 3600 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:52.318 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.478421+0000 mon.smithi008 (mon.0) 3947 : audit [DBG] from='client.? 172.21.15.8:0/1498549914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:52.318 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:51.859627+0000 mon.smithi008 (mon.0) 3948 : audit [DBG] from='client.? 172.21.15.8:0/24316738' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:58:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:50.371525+0000 mgr.smithi008.flmjzp (mgr.14640) 3593 : audit [DBG] from='client.36952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:50.544050+0000 mgr.smithi008.flmjzp (mgr.14640) 3594 : cluster [DBG] pgmap v2471: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:50.721122+0000 mgr.smithi008.flmjzp (mgr.14640) 3595 : audit [DBG] from='client.36956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.063596+0000 mgr.smithi008.flmjzp (mgr.14640) 3596 : audit [DBG] from='client.36960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.133829+0000 mon.smithi008 (mon.0) 3939 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:58:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.134737+0000 mon.smithi008 (mon.0) 3940 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:58:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:58:51.135512+0000 mgr.smithi008.flmjzp (mgr.14640) 3597 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:58:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:51.136205+0000 mgr.smithi008.flmjzp (mgr.14640) 3598 : cluster [DBG] pgmap v2472: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:52.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:51.136605+0000 mgr.smithi008.flmjzp (mgr.14640) 3599 : cluster [DBG] pgmap v2473: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:52.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.140681+0000 mon.smithi008 (mon.0) 3941 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:58:52.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.146316+0000 mon.smithi008 (mon.0) 3942 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:58:52.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.148984+0000 mon.smithi008 (mon.0) 3943 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:52.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.150485+0000 mon.smithi008 (mon.0) 3944 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:52.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.151974+0000 mon.smithi008 (mon.0) 3945 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:52.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.154114+0000 mon.smithi008 (mon.0) 3946 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:52.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:58:51.156036+0000 mgr.smithi008.flmjzp (mgr.14640) 3600 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:58:52.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.478421+0000 mon.smithi008 (mon.0) 3947 : audit [DBG] from='client.? 172.21.15.8:0/1498549914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:58:52.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:51.859627+0000 mon.smithi008 (mon.0) 3948 : audit [DBG] from='client.? 172.21.15.8:0/24316738' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:58:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:58:52.209859+0000 mgr.smithi008.flmjzp (mgr.14640) 3601 : audit [DBG] from='client.36972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:58:52.209859+0000 mgr.smithi008.flmjzp (mgr.14640) 3601 : audit [DBG] from='client.36972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:58:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:53.137060+0000 mgr.smithi008.flmjzp (mgr.14640) 3602 : cluster [DBG] pgmap v2474: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:53.137060+0000 mgr.smithi008.flmjzp (mgr.14640) 3602 : cluster [DBG] pgmap v2474: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:56.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:55.137784+0000 mgr.smithi008.flmjzp (mgr.14640) 3603 : cluster [DBG] pgmap v2475: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:55.137784+0000 mgr.smithi008.flmjzp (mgr.14640) 3603 : cluster [DBG] pgmap v2475: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:58:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:57.138420+0000 mgr.smithi008.flmjzp (mgr.14640) 3604 : cluster [DBG] pgmap v2476: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:58:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:58:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:57.138420+0000 mgr.smithi008.flmjzp (mgr.14640) 3604 : cluster [DBG] pgmap v2476: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:58:59.139160+0000 mgr.smithi008.flmjzp (mgr.14640) 3605 : cluster [DBG] pgmap v2477: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:58:59.139160+0000 mgr.smithi008.flmjzp (mgr.14640) 3605 : cluster [DBG] pgmap v2477: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:01.139841+0000 mgr.smithi008.flmjzp (mgr.14640) 3606 : cluster [DBG] pgmap v2478: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:01.162361+0000 mon.smithi008 (mon.0) 3949 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:02.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:01.164532+0000 mon.smithi008 (mon.0) 3950 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:01.165578+0000 mon.smithi008 (mon.0) 3951 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:01.166444+0000 mgr.smithi008.flmjzp (mgr.14640) 3607 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:01.167059+0000 mgr.smithi008.flmjzp (mgr.14640) 3608 : cluster [DBG] pgmap v2479: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:01.167285+0000 mgr.smithi008.flmjzp (mgr.14640) 3609 : cluster [DBG] pgmap v2480: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:02.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:01.171926+0000 mon.smithi008 (mon.0) 3952 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:02.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:01.179936+0000 mon.smithi008 (mon.0) 3953 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:02.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:01.183459+0000 mon.smithi008 (mon.0) 3954 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:02.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:01.185481+0000 mon.smithi008 (mon.0) 3955 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:02.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:01.187413+0000 mon.smithi008 (mon.0) 3956 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:02.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:01.190040+0000 mon.smithi008 (mon.0) 3957 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:02.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:01.192218+0000 mgr.smithi008.flmjzp (mgr.14640) 3610 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:01.139841+0000 mgr.smithi008.flmjzp (mgr.14640) 3606 : cluster [DBG] pgmap v2478: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:01.162361+0000 mon.smithi008 (mon.0) 3949 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:01.164532+0000 mon.smithi008 (mon.0) 3950 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:01.165578+0000 mon.smithi008 (mon.0) 3951 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:01.166444+0000 mgr.smithi008.flmjzp (mgr.14640) 3607 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:01.167059+0000 mgr.smithi008.flmjzp (mgr.14640) 3608 : cluster [DBG] pgmap v2479: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:01.167285+0000 mgr.smithi008.flmjzp (mgr.14640) 3609 : cluster [DBG] pgmap v2480: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:02.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:01.171926+0000 mon.smithi008 (mon.0) 3952 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:02.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:01.179936+0000 mon.smithi008 (mon.0) 3953 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:02.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:01.183459+0000 mon.smithi008 (mon.0) 3954 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:02.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:01.185481+0000 mon.smithi008 (mon.0) 3955 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:02.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:01.187413+0000 mon.smithi008 (mon.0) 3956 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:02.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:01.190040+0000 mon.smithi008 (mon.0) 3957 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:02.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:01.192218+0000 mgr.smithi008.flmjzp (mgr.14640) 3610 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:03.167827+0000 mgr.smithi008.flmjzp (mgr.14640) 3611 : cluster [DBG] pgmap v2481: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:03.167827+0000 mgr.smithi008.flmjzp (mgr.14640) 3611 : cluster [DBG] pgmap v2481: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:05.168435+0000 mgr.smithi008.flmjzp (mgr.14640) 3612 : cluster [DBG] pgmap v2482: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:05.168435+0000 mgr.smithi008.flmjzp (mgr.14640) 3612 : cluster [DBG] pgmap v2482: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:07.169205+0000 mgr.smithi008.flmjzp (mgr.14640) 3613 : cluster [DBG] pgmap v2483: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:07.169205+0000 mgr.smithi008.flmjzp (mgr.14640) 3613 : cluster [DBG] pgmap v2483: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:09.169807+0000 mgr.smithi008.flmjzp (mgr.14640) 3614 : cluster [DBG] pgmap v2484: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:09.169807+0000 mgr.smithi008.flmjzp (mgr.14640) 3614 : cluster [DBG] pgmap v2484: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:12.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:11.170546+0000 mgr.smithi008.flmjzp (mgr.14640) 3615 : cluster [DBG] pgmap v2485: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:12.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:11.202603+0000 mon.smithi008 (mon.0) 3958 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:12.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:11.205197+0000 mon.smithi008 (mon.0) 3959 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:12.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:11.206168+0000 mon.smithi008 (mon.0) 3960 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:12.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:11.207030+0000 mgr.smithi008.flmjzp (mgr.14640) 3616 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:12.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:11.207595+0000 mgr.smithi008.flmjzp (mgr.14640) 3617 : cluster [DBG] pgmap v2486: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:12.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:11.207829+0000 mgr.smithi008.flmjzp (mgr.14640) 3618 : cluster [DBG] pgmap v2487: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:12.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:11.212478+0000 mon.smithi008 (mon.0) 3961 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:12.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:11.219284+0000 mon.smithi008 (mon.0) 3962 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:12.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:11.222388+0000 mon.smithi008 (mon.0) 3963 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:12.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:11.224042+0000 mon.smithi008 (mon.0) 3964 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:12.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:11.225658+0000 mon.smithi008 (mon.0) 3965 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:12.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:11.227612+0000 mon.smithi008 (mon.0) 3966 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:12.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:11.229471+0000 mgr.smithi008.flmjzp (mgr.14640) 3619 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:11.170546+0000 mgr.smithi008.flmjzp (mgr.14640) 3615 : cluster [DBG] pgmap v2485: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:11.202603+0000 mon.smithi008 (mon.0) 3958 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:11.205197+0000 mon.smithi008 (mon.0) 3959 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:11.206168+0000 mon.smithi008 (mon.0) 3960 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:12.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:11.207030+0000 mgr.smithi008.flmjzp (mgr.14640) 3616 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:12.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:11.207595+0000 mgr.smithi008.flmjzp (mgr.14640) 3617 : cluster [DBG] pgmap v2486: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:12.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:11.207829+0000 mgr.smithi008.flmjzp (mgr.14640) 3618 : cluster [DBG] pgmap v2487: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:12.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:11.212478+0000 mon.smithi008 (mon.0) 3961 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:12.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:11.219284+0000 mon.smithi008 (mon.0) 3962 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:12.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:11.222388+0000 mon.smithi008 (mon.0) 3963 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:12.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:11.224042+0000 mon.smithi008 (mon.0) 3964 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:12.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:11.225658+0000 mon.smithi008 (mon.0) 3965 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:12.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:11.227612+0000 mon.smithi008 (mon.0) 3966 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:12.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:11.229471+0000 mgr.smithi008.flmjzp (mgr.14640) 3619 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:13.208397+0000 mgr.smithi008.flmjzp (mgr.14640) 3620 : cluster [DBG] pgmap v2488: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:13.208397+0000 mgr.smithi008.flmjzp (mgr.14640) 3620 : cluster [DBG] pgmap v2488: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:15.208986+0000 mgr.smithi008.flmjzp (mgr.14640) 3621 : cluster [DBG] pgmap v2489: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:15.208986+0000 mgr.smithi008.flmjzp (mgr.14640) 3621 : cluster [DBG] pgmap v2489: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:17.209521+0000 mgr.smithi008.flmjzp (mgr.14640) 3622 : cluster [DBG] pgmap v2490: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:17.209521+0000 mgr.smithi008.flmjzp (mgr.14640) 3622 : cluster [DBG] pgmap v2490: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:19.210118+0000 mgr.smithi008.flmjzp (mgr.14640) 3623 : cluster [DBG] pgmap v2491: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:19.210118+0000 mgr.smithi008.flmjzp (mgr.14640) 3623 : cluster [DBG] pgmap v2491: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:21.210643+0000 mgr.smithi008.flmjzp (mgr.14640) 3624 : cluster [DBG] pgmap v2492: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:21.240277+0000 mon.smithi008 (mon.0) 3967 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:22.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:21.242937+0000 mon.smithi008 (mon.0) 3968 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:21.244389+0000 mon.smithi008 (mon.0) 3969 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:21.251226+0000 mon.smithi008 (mon.0) 3970 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:22.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:21.257539+0000 mon.smithi008 (mon.0) 3971 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:22.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:21.260626+0000 mon.smithi008 (mon.0) 3972 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:22.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:21.262310+0000 mon.smithi008 (mon.0) 3973 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:22.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:21.263907+0000 mon.smithi008 (mon.0) 3974 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:22.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:21.266090+0000 mon.smithi008 (mon.0) 3975 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:21.210643+0000 mgr.smithi008.flmjzp (mgr.14640) 3624 : cluster [DBG] pgmap v2492: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:21.240277+0000 mon.smithi008 (mon.0) 3967 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:21.242937+0000 mon.smithi008 (mon.0) 3968 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:21.244389+0000 mon.smithi008 (mon.0) 3969 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:21.251226+0000 mon.smithi008 (mon.0) 3970 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:22.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:21.257539+0000 mon.smithi008 (mon.0) 3971 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:22.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:21.260626+0000 mon.smithi008 (mon.0) 3972 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:22.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:21.262310+0000 mon.smithi008 (mon.0) 3973 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:22.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:21.263907+0000 mon.smithi008 (mon.0) 3974 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:22.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:21.266090+0000 mon.smithi008 (mon.0) 3975 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.365+0000 7f55b89bb700 1 -- 172.21.15.8:0/601539766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b40f77d0 msgr2=0x7f55b40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.365+0000 7f55b89bb700 1 --2- 172.21.15.8:0/601539766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b40f77d0 0x7f55b40f7c30 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f55a8004660 tx=0x7f55a8009b30).stop 2023-10-18T21:59:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.365+0000 7f55b89bb700 1 -- 172.21.15.8:0/601539766 shutdown_connections 2023-10-18T21:59:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.365+0000 7f55b89bb700 1 --2- 172.21.15.8:0/601539766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b40f77d0 0x7f55b40f7c30 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.365+0000 7f55b89bb700 1 --2- 172.21.15.8:0/601539766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55b40f6530 0x7f55b40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.365+0000 7f55b89bb700 1 -- 172.21.15.8:0/601539766 >> 172.21.15.8:0/601539766 conn(0x7f55b40f1c90 msgr2=0x7f55b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.365+0000 7f55b89bb700 1 -- 172.21.15.8:0/601539766 shutdown_connections 2023-10-18T21:59:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.365+0000 7f55b89bb700 1 -- 172.21.15.8:0/601539766 wait complete. 2023-10-18T21:59:22.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.366+0000 7f55b89bb700 1 Processor -- start 2023-10-18T21:59:22.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.366+0000 7f55b89bb700 1 -- start start 2023-10-18T21:59:22.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b89bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55b40f6530 0x7f55b4108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:22.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b89bb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b40f77d0 0x7f55b4109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:22.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b89bb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b4109a20 con 0x7f55b40f77d0 2023-10-18T21:59:22.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b89bb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b4109b60 con 0x7f55b40f6530 2023-10-18T21:59:22.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b40f77d0 0x7f55b4109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:22.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b40f77d0 0x7f55b4109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33898/0 (socket says 172.21.15.8:33898) 2023-10-18T21:59:22.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b259c700 1 -- 172.21.15.8:0/4034446842 learned_addr learned my addr 172.21.15.8:0/4034446842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:22.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b2d9d700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55b40f6530 0x7f55b4108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:22.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b259c700 1 -- 172.21.15.8:0/4034446842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55b40f6530 msgr2=0x7f55b4108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:22.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b259c700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55b40f6530 0x7f55b4108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:22.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.367+0000 7f55b259c700 1 -- 172.21.15.8:0/4034446842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a8005040 con 0x7f55b40f77d0 2023-10-18T21:59:22.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.368+0000 7f55b259c700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b40f77d0 0x7f55b4109470 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f55a8009990 tx=0x7f55a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:22.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.368+0000 7f559b7fe700 1 -- 172.21.15.8:0/4034446842 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55a8018070 con 0x7f55b40f77d0 2023-10-18T21:59:22.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.368+0000 7f559b7fe700 1 -- 172.21.15.8:0/4034446842 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f55a8009780 con 0x7f55b40f77d0 2023-10-18T21:59:22.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.368+0000 7f55b89bb700 1 -- 172.21.15.8:0/4034446842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b410a4a0 con 0x7f55b40f77d0 2023-10-18T21:59:22.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.368+0000 7f559b7fe700 1 -- 172.21.15.8:0/4034446842 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55a801c5e0 con 0x7f55b40f77d0 2023-10-18T21:59:22.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.368+0000 7f55b89bb700 1 -- 172.21.15.8:0/4034446842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b410aa00 con 0x7f55b40f77d0 2023-10-18T21:59:22.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.369+0000 7f55b89bb700 1 -- 172.21.15.8:0/4034446842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b4045ad0 con 0x7f55b40f77d0 2023-10-18T21:59:22.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.370+0000 7f559b7fe700 1 -- 172.21.15.8:0/4034446842 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f55a801dac0 con 0x7f55b40f77d0 2023-10-18T21:59:22.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.371+0000 7f559b7fe700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f559c060f70 0x7f559c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:22.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.371+0000 7f559b7fe700 1 -- 172.21.15.8:0/4034446842 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f55a807e680 con 0x7f55b40f77d0 2023-10-18T21:59:22.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.371+0000 7f55b2d9d700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f559c060f70 0x7f559c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:22.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.372+0000 7f55b2d9d700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f559c060f70 0x7f559c063430 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f55b40f7630 tx=0x7f55a4009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:22.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.376+0000 7f559b7fe700 1 -- 172.21.15.8:0/4034446842 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f55a8051da0 con 0x7f55b40f77d0 2023-10-18T21:59:22.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.575+0000 7f55b89bb700 1 -- 172.21.15.8:0/4034446842 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55b40feda0 con 0x7f559c060f70 2023-10-18T21:59:22.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.576+0000 7f559b7fe700 1 -- 172.21.15.8:0/4034446842 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f55b40feda0 con 0x7f559c060f70 2023-10-18T21:59:22.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.578+0000 7f55b89bb700 1 -- 172.21.15.8:0/4034446842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f559c060f70 msgr2=0x7f559c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:22.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.578+0000 7f55b89bb700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f559c060f70 0x7f559c063430 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f55b40f7630 tx=0x7f55a4009040).stop 2023-10-18T21:59:22.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.578+0000 7f55b89bb700 1 -- 172.21.15.8:0/4034446842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b40f77d0 msgr2=0x7f55b4109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:22.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.578+0000 7f55b89bb700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b40f77d0 0x7f55b4109470 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f55a8009990 tx=0x7f55a8009b30).stop 2023-10-18T21:59:22.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.578+0000 7f55b89bb700 1 -- 172.21.15.8:0/4034446842 shutdown_connections 2023-10-18T21:59:22.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.578+0000 7f55b89bb700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f559c060f70 0x7f559c063430 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:22.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.578+0000 7f55b89bb700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55b40f6530 0x7f55b4108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:22.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.578+0000 7f55b89bb700 1 --2- 172.21.15.8:0/4034446842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b40f77d0 0x7f55b4109470 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:22.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.578+0000 7f55b89bb700 1 -- 172.21.15.8:0/4034446842 >> 172.21.15.8:0/4034446842 conn(0x7f55b40f1c90 msgr2=0x7f55b406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:22.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.579+0000 7f55b89bb700 1 -- 172.21.15.8:0/4034446842 shutdown_connections 2023-10-18T21:59:22.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.579+0000 7f55b89bb700 1 -- 172.21.15.8:0/4034446842 wait complete. 2023-10-18T21:59:22.594 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:59:22.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.716+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1266148729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac0f6530 msgr2=0x7f15ac0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:22.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.716+0000 7f15b1d8a700 1 --2- 172.21.15.8:0/1266148729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac0f6530 0x7f15ac0f6950 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f15a0004660 tx=0x7f15a0009b30).stop 2023-10-18T21:59:22.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.716+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1266148729 shutdown_connections 2023-10-18T21:59:22.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.716+0000 7f15b1d8a700 1 --2- 172.21.15.8:0/1266148729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0f77d0 0x7f15ac0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:22.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.716+0000 7f15b1d8a700 1 --2- 172.21.15.8:0/1266148729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac0f6530 0x7f15ac0f6950 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:22.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.716+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1266148729 >> 172.21.15.8:0/1266148729 conn(0x7f15ac0f1c90 msgr2=0x7f15ac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:22.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.716+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1266148729 shutdown_connections 2023-10-18T21:59:22.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.716+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1266148729 wait complete. 2023-10-18T21:59:22.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.717+0000 7f15b1d8a700 1 Processor -- start 2023-10-18T21:59:22.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.717+0000 7f15b1d8a700 1 -- start start 2023-10-18T21:59:22.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.717+0000 7f15b1d8a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac0f6530 0x7f15ac06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:22.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.717+0000 7f15b1d8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0f77d0 0x7f15ac069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:22.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.717+0000 7f15b1d8a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac06a380 con 0x7f15ac0f6530 2023-10-18T21:59:22.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.717+0000 7f15b1d8a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac06a4c0 con 0x7f15ac0f77d0 2023-10-18T21:59:22.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.718+0000 7f15b0d88700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac0f6530 0x7f15ac06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:22.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.718+0000 7f15b0d88700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac0f6530 0x7f15ac06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33908/0 (socket says 172.21.15.8:33908) 2023-10-18T21:59:22.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.718+0000 7f15b0d88700 1 -- 172.21.15.8:0/1646741128 learned_addr learned my addr 172.21.15.8:0/1646741128 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.718+0000 7f15b0d88700 1 -- 172.21.15.8:0/1646741128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0f77d0 msgr2=0x7f15ac069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.718+0000 7f15b0d88700 1 --2- 172.21.15.8:0/1646741128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0f77d0 0x7f15ac069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:59:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.718+0000 7f15b0d88700 1 -- 172.21.15.8:0/1646741128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a0005040 con 0x7f15ac0f6530 2023-10-18T21:59:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.718+0000 7f15b0d88700 1 --2- 172.21.15.8:0/1646741128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac0f6530 0x7f15ac06b9a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f15a0007a60 tx=0x7f15a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.718+0000 7f15a97fa700 1 -- 172.21.15.8:0/1646741128 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a0018070 con 0x7f15ac0f6530 2023-10-18T21:59:22.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.719+0000 7f15a97fa700 1 -- 172.21.15.8:0/1646741128 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f15a0009630 con 0x7f15ac0f6530 2023-10-18T21:59:22.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.719+0000 7f15a97fa700 1 -- 172.21.15.8:0/1646741128 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a001c540 con 0x7f15ac0f6530 2023-10-18T21:59:22.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.719+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1646741128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac06a740 con 0x7f15ac0f6530 2023-10-18T21:59:22.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.719+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1646741128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac06aca0 con 0x7f15ac0f6530 2023-10-18T21:59:22.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.720+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1646741128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac045ad0 con 0x7f15ac0f6530 2023-10-18T21:59:22.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.721+0000 7f15a97fa700 1 -- 172.21.15.8:0/1646741128 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f15a001c7b0 con 0x7f15ac0f6530 2023-10-18T21:59:22.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.721+0000 7f15a97fa700 1 --2- 172.21.15.8:0/1646741128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f159c060f70 0x7f159c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:22.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.721+0000 7f15a97fa700 1 -- 172.21.15.8:0/1646741128 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f15a007e750 con 0x7f15ac0f6530 2023-10-18T21:59:22.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.722+0000 7f15abfff700 1 --2- 172.21.15.8:0/1646741128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f159c060f70 0x7f159c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:22.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.722+0000 7f15abfff700 1 --2- 172.21.15.8:0/1646741128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f159c060f70 0x7f159c063430 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f1598004bd0 tx=0x7f1598009b10).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:22.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.726+0000 7f15a97fa700 1 -- 172.21.15.8:0/1646741128 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f15a004e300 con 0x7f15ac0f6530 2023-10-18T21:59:22.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.923+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1646741128 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15ac0fee70 con 0x7f159c060f70 2023-10-18T21:59:22.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.924+0000 7f15a97fa700 1 -- 172.21.15.8:0/1646741128 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f159800f040 con 0x7f159c060f70 2023-10-18T21:59:22.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.926+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1646741128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f159c060f70 msgr2=0x7f159c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:22.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.926+0000 7f15b1d8a700 1 --2- 172.21.15.8:0/1646741128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f159c060f70 0x7f159c063430 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f1598004bd0 tx=0x7f1598009b10).stop 2023-10-18T21:59:22.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.926+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1646741128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac0f6530 msgr2=0x7f15ac06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:22.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.926+0000 7f15b1d8a700 1 --2- 172.21.15.8:0/1646741128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac0f6530 0x7f15ac06b9a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f15a0007a60 tx=0x7f15a0009b30).stop 2023-10-18T21:59:22.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.926+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1646741128 shutdown_connections 2023-10-18T21:59:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.926+0000 7f15b1d8a700 1 --2- 172.21.15.8:0/1646741128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f159c060f70 0x7f159c063430 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.926+0000 7f15b1d8a700 1 --2- 172.21.15.8:0/1646741128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15ac0f6530 0x7f15ac06b9a0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.926+0000 7f15b1d8a700 1 --2- 172.21.15.8:0/1646741128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0f77d0 0x7f15ac069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T21:59:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.926+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1646741128 >> 172.21.15.8:0/1646741128 conn(0x7f15ac0f1c90 msgr2=0x7f15ac0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.926+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1646741128 shutdown_connections 2023-10-18T21:59:22.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:22.927+0000 7f15b1d8a700 1 -- 172.21.15.8:0/1646741128 wait complete. 2023-10-18T21:59:23.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.063+0000 7f6d55d6a700 1 -- 172.21.15.8:0/3410694276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d500f6530 msgr2=0x7f6d500f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:23.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.063+0000 7f6d55d6a700 1 --2- 172.21.15.8:0/3410694276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d500f6530 0x7f6d500f6950 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f6d44004660 tx=0x7f6d44009b30).stop 2023-10-18T21:59:23.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.063+0000 7f6d55d6a700 1 -- 172.21.15.8:0/3410694276 shutdown_connections 2023-10-18T21:59:23.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.063+0000 7f6d55d6a700 1 --2- 172.21.15.8:0/3410694276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d500f77d0 0x7f6d500f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.063+0000 7f6d55d6a700 1 --2- 172.21.15.8:0/3410694276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d500f6530 0x7f6d500f6950 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.063+0000 7f6d55d6a700 1 -- 172.21.15.8:0/3410694276 >> 172.21.15.8:0/3410694276 conn(0x7f6d500f1c90 msgr2=0x7f6d500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:23.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.063+0000 7f6d55d6a700 1 -- 172.21.15.8:0/3410694276 shutdown_connections 2023-10-18T21:59:23.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.063+0000 7f6d55d6a700 1 -- 172.21.15.8:0/3410694276 wait complete. 2023-10-18T21:59:23.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.064+0000 7f6d55d6a700 1 Processor -- start 2023-10-18T21:59:23.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.064+0000 7f6d55d6a700 1 -- start start 2023-10-18T21:59:23.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.064+0000 7f6d55d6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d500f6530 0x7f6d50108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:23.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.064+0000 7f6d55d6a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d500f77d0 0x7f6d501094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:23.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.064+0000 7f6d55d6a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50109a50 con 0x7f6d500f77d0 2023-10-18T21:59:23.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.064+0000 7f6d55d6a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50109b90 con 0x7f6d500f6530 2023-10-18T21:59:23.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d500f77d0 0x7f6d501094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:23.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d500f77d0 0x7f6d501094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33926/0 (socket says 172.21.15.8:33926) 2023-10-18T21:59:23.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d4ffff700 1 -- 172.21.15.8:0/475837288 learned_addr learned my addr 172.21.15.8:0/475837288 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:23.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d54d68700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d500f6530 0x7f6d50108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:23.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d4ffff700 1 -- 172.21.15.8:0/475837288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d500f6530 msgr2=0x7f6d50108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:23.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d4ffff700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d500f6530 0x7f6d50108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d4ffff700 1 -- 172.21.15.8:0/475837288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44005040 con 0x7f6d500f77d0 2023-10-18T21:59:23.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d54d68700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d500f6530 0x7f6d50108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:59:23.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d4ffff700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d500f77d0 0x7f6d501094a0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f6d3c00c790 tx=0x7f6d3c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:23.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d4d7fa700 1 -- 172.21.15.8:0/475837288 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d3c00e680 con 0x7f6d500f77d0 2023-10-18T21:59:23.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d4d7fa700 1 -- 172.21.15.8:0/475837288 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6d3c00eca0 con 0x7f6d500f77d0 2023-10-18T21:59:23.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d4d7fa700 1 -- 172.21.15.8:0/475837288 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d3c013de0 con 0x7f6d500f77d0 2023-10-18T21:59:23.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.065+0000 7f6d55d6a700 1 -- 172.21.15.8:0/475837288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5010a530 con 0x7f6d500f77d0 2023-10-18T21:59:23.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.066+0000 7f6d55d6a700 1 -- 172.21.15.8:0/475837288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5010aaf0 con 0x7f6d500f77d0 2023-10-18T21:59:23.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.067+0000 7f6d55d6a700 1 -- 172.21.15.8:0/475837288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d50045ad0 con 0x7f6d500f77d0 2023-10-18T21:59:23.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.068+0000 7f6d4d7fa700 1 -- 172.21.15.8:0/475837288 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6d3c01a060 con 0x7f6d500f77d0 2023-10-18T21:59:23.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.068+0000 7f6d4d7fa700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d40060f70 0x7f6d40063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:23.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.068+0000 7f6d4d7fa700 1 -- 172.21.15.8:0/475837288 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6d3c07cb40 con 0x7f6d500f77d0 2023-10-18T21:59:23.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.069+0000 7f6d54d68700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d40060f70 0x7f6d40063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:23.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.069+0000 7f6d54d68700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d40060f70 0x7f6d40063430 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f6d44004e30 tx=0x7f6d44009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:23.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.073+0000 7f6d4d7fa700 1 -- 172.21.15.8:0/475837288 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6d3c0501f0 con 0x7f6d500f77d0 2023-10-18T21:59:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:21.245270+0000 mgr.smithi008.flmjzp (mgr.14640) 3625 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:23.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:21.245864+0000 mgr.smithi008.flmjzp (mgr.14640) 3626 : cluster [DBG] pgmap v2493: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:21.246160+0000 mgr.smithi008.flmjzp (mgr.14640) 3627 : cluster [DBG] pgmap v2494: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:23.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:21.268336+0000 mgr.smithi008.flmjzp (mgr.14640) 3628 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:21.245270+0000 mgr.smithi008.flmjzp (mgr.14640) 3625 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:21.245864+0000 mgr.smithi008.flmjzp (mgr.14640) 3626 : cluster [DBG] pgmap v2493: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:21.246160+0000 mgr.smithi008.flmjzp (mgr.14640) 3627 : cluster [DBG] pgmap v2494: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:23.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:21.268336+0000 mgr.smithi008.flmjzp (mgr.14640) 3628 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:23.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.264+0000 7f6d55d6a700 1 -- 172.21.15.8:0/475837288 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d500fee30 con 0x7f6d40060f70 2023-10-18T21:59:23.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.273+0000 7f6d4d7fa700 1 -- 172.21.15.8:0/475837288 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6d500fee30 con 0x7f6d40060f70 2023-10-18T21:59:23.275 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:59:23.275 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (66m) 3m ago 67m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:59:23.275 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (59m) 3m ago 67m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:59:23.275 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (59m) 83s ago 66m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:59:23.276 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (65m) 3m ago 67m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:59:23.276 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 63m - - 2023-10-18T21:59:23.276 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 63m - - 2023-10-18T21:59:23.276 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 83s ago 63m - - 2023-10-18T21:59:23.276 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 83s ago 63m - - 2023-10-18T21:59:23.277 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (61m) 3m ago 68m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:59:23.277 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (60m) 83s ago 66m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:59:23.277 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (60m) 3m ago 68m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:59:23.277 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (60m) 83s ago 66m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:59:23.277 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (67m) 3m ago 67m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:59:23.278 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (66m) 83s ago 66m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:59:23.278 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (59m) 3m ago 66m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:59:23.278 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (57m) 3m ago 65m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:59:23.278 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (57m) 3m ago 65m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:59:23.278 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (56m) 83s ago 65m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:59:23.279 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (55m) 83s ago 64m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:59:23.279 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (55m) 83s ago 64m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:59:23.279 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (61m) 3m ago 66m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:59:23.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.275+0000 7f6d55d6a700 1 -- 172.21.15.8:0/475837288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d40060f70 msgr2=0x7f6d40063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:23.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.275+0000 7f6d55d6a700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d40060f70 0x7f6d40063430 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f6d44004e30 tx=0x7f6d44009b30).stop 2023-10-18T21:59:23.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.275+0000 7f6d55d6a700 1 -- 172.21.15.8:0/475837288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d500f77d0 msgr2=0x7f6d501094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:23.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.275+0000 7f6d55d6a700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d500f77d0 0x7f6d501094a0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f6d3c00c790 tx=0x7f6d3c007d70).stop 2023-10-18T21:59:23.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.275+0000 7f6d55d6a700 1 -- 172.21.15.8:0/475837288 shutdown_connections 2023-10-18T21:59:23.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.276+0000 7f6d55d6a700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6d40060f70 0x7f6d40063430 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.276+0000 7f6d55d6a700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d500f6530 0x7f6d50108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.276+0000 7f6d55d6a700 1 --2- 172.21.15.8:0/475837288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d500f77d0 0x7f6d501094a0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.276+0000 7f6d55d6a700 1 -- 172.21.15.8:0/475837288 >> 172.21.15.8:0/475837288 conn(0x7f6d500f1c90 msgr2=0x7f6d5006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:23.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.276+0000 7f6d55d6a700 1 -- 172.21.15.8:0/475837288 shutdown_connections 2023-10-18T21:59:23.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.276+0000 7f6d55d6a700 1 -- 172.21.15.8:0/475837288 wait complete. 2023-10-18T21:59:23.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.411+0000 7fbec9375700 1 -- 172.21.15.8:0/4099429087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec40f6530 msgr2=0x7fbec40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:23.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.411+0000 7fbec9375700 1 --2- 172.21.15.8:0/4099429087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec40f6530 0x7fbec40f6950 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7fbeb4004660 tx=0x7fbeb4009b30).stop 2023-10-18T21:59:23.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.411+0000 7fbec9375700 1 -- 172.21.15.8:0/4099429087 shutdown_connections 2023-10-18T21:59:23.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.411+0000 7fbec9375700 1 --2- 172.21.15.8:0/4099429087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec40f77d0 0x7fbec40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.411+0000 7fbec9375700 1 --2- 172.21.15.8:0/4099429087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec40f6530 0x7fbec40f6950 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.411+0000 7fbec9375700 1 -- 172.21.15.8:0/4099429087 >> 172.21.15.8:0/4099429087 conn(0x7fbec40f1c90 msgr2=0x7fbec40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:23.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.411+0000 7fbec9375700 1 -- 172.21.15.8:0/4099429087 shutdown_connections 2023-10-18T21:59:23.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.411+0000 7fbec9375700 1 -- 172.21.15.8:0/4099429087 wait complete. 2023-10-18T21:59:23.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.412+0000 7fbec9375700 1 Processor -- start 2023-10-18T21:59:23.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.412+0000 7fbec9375700 1 -- start start 2023-10-18T21:59:23.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.412+0000 7fbec9375700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec40f6530 0x7fbec4108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:23.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec9375700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec40f77d0 0x7fbec41094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:23.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec9375700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4109a60 con 0x7fbec40f77d0 2023-10-18T21:59:23.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec9375700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4109ba0 con 0x7fbec40f6530 2023-10-18T21:59:23.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec40f77d0 0x7fbec41094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:23.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec40f77d0 0x7fbec41094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33944/0 (socket says 172.21.15.8:33944) 2023-10-18T21:59:23.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec37fe700 1 -- 172.21.15.8:0/1641205942 learned_addr learned my addr 172.21.15.8:0/1641205942 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:23.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec37fe700 1 -- 172.21.15.8:0/1641205942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec40f6530 msgr2=0x7fbec4108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:23.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec3fff700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec40f6530 0x7fbec4108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:23.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec37fe700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec40f6530 0x7fbec4108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec37fe700 1 -- 172.21.15.8:0/1641205942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb4005040 con 0x7fbec40f77d0 2023-10-18T21:59:23.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec3fff700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec40f6530 0x7fbec4108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:59:23.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.413+0000 7fbec37fe700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec40f77d0 0x7fbec41094b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fbeb80026d0 tx=0x7fbeb8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:23.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.414+0000 7fbec0ff9700 1 -- 172.21.15.8:0/1641205942 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbeb8009320 con 0x7fbec40f77d0 2023-10-18T21:59:23.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.414+0000 7fbec0ff9700 1 -- 172.21.15.8:0/1641205942 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbeb800f040 con 0x7fbec40f77d0 2023-10-18T21:59:23.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.414+0000 7fbec9375700 1 -- 172.21.15.8:0/1641205942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec410a540 con 0x7fbec40f77d0 2023-10-18T21:59:23.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.414+0000 7fbec0ff9700 1 -- 172.21.15.8:0/1641205942 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbeb80148a0 con 0x7fbec40f77d0 2023-10-18T21:59:23.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.414+0000 7fbec9375700 1 -- 172.21.15.8:0/1641205942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec410ab00 con 0x7fbec40f77d0 2023-10-18T21:59:23.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.415+0000 7fbec9375700 1 -- 172.21.15.8:0/1641205942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec4045ad0 con 0x7fbec40f77d0 2023-10-18T21:59:23.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.416+0000 7fbec0ff9700 1 -- 172.21.15.8:0/1641205942 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbeb8009480 con 0x7fbec40f77d0 2023-10-18T21:59:23.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.417+0000 7fbec0ff9700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeac060f70 0x7fbeac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:23.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.417+0000 7fbec0ff9700 1 -- 172.21.15.8:0/1641205942 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbeb807cea0 con 0x7fbec40f77d0 2023-10-18T21:59:23.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.417+0000 7fbec3fff700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeac060f70 0x7fbeac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:23.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.417+0000 7fbec3fff700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeac060f70 0x7fbeac063430 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fbeb4009d60 tx=0x7fbeb4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:23.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.421+0000 7fbec0ff9700 1 -- 172.21.15.8:0/1641205942 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbeb80505c0 con 0x7fbec40f77d0 2023-10-18T21:59:23.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.670+0000 7fbec9375700 1 -- 172.21.15.8:0/1641205942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbec410add0 con 0x7fbec40f77d0 2023-10-18T21:59:23.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.671+0000 7fbec0ff9700 1 -- 172.21.15.8:0/1641205942 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fbeb80501b0 con 0x7fbec40f77d0 2023-10-18T21:59:23.673 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:59:23.673 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:59:23.673 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:59:23.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:59:23.673 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:59:23.674 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:59:23.674 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:59:23.674 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:59:23.674 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:59:23.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:59:23.675 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:59:23.675 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:59:23.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:59:23.675 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:59:23.675 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:59:23.676 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:59:23.676 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:59:23.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 -- 172.21.15.8:0/1641205942 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeac060f70 msgr2=0x7fbeac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:23.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeac060f70 0x7fbeac063430 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fbeb4009d60 tx=0x7fbeb4009b30).stop 2023-10-18T21:59:23.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 -- 172.21.15.8:0/1641205942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec40f77d0 msgr2=0x7fbec41094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:23.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec40f77d0 0x7fbec41094b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fbeb80026d0 tx=0x7fbeb8009de0).stop 2023-10-18T21:59:23.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 -- 172.21.15.8:0/1641205942 shutdown_connections 2023-10-18T21:59:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbeac060f70 0x7fbeac063430 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec40f6530 0x7fbec4108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 --2- 172.21.15.8:0/1641205942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec40f77d0 0x7fbec41094b0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 -- 172.21.15.8:0/1641205942 >> 172.21.15.8:0/1641205942 conn(0x7fbec40f1c90 msgr2=0x7fbec40f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:23.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 -- 172.21.15.8:0/1641205942 shutdown_connections 2023-10-18T21:59:23.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.673+0000 7fbec9375700 1 -- 172.21.15.8:0/1641205942 wait complete. 2023-10-18T21:59:23.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.811+0000 7f0fbbfff700 1 -- 172.21.15.8:0/737974869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fbc0f6530 msgr2=0x7f0fbc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:23.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.811+0000 7f0fbbfff700 1 --2- 172.21.15.8:0/737974869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fbc0f6530 0x7f0fbc0f6950 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f0fac004660 tx=0x7f0fac009b30).stop 2023-10-18T21:59:23.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.811+0000 7f0fbbfff700 1 -- 172.21.15.8:0/737974869 shutdown_connections 2023-10-18T21:59:23.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.811+0000 7f0fbbfff700 1 --2- 172.21.15.8:0/737974869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc0f77d0 0x7f0fbc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.811+0000 7f0fbbfff700 1 --2- 172.21.15.8:0/737974869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fbc0f6530 0x7f0fbc0f6950 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.811+0000 7f0fbbfff700 1 -- 172.21.15.8:0/737974869 >> 172.21.15.8:0/737974869 conn(0x7f0fbc0f1c90 msgr2=0x7f0fbc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:23.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.811+0000 7f0fbbfff700 1 -- 172.21.15.8:0/737974869 shutdown_connections 2023-10-18T21:59:23.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.811+0000 7f0fbbfff700 1 -- 172.21.15.8:0/737974869 wait complete. 2023-10-18T21:59:23.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.812+0000 7f0fbbfff700 1 Processor -- start 2023-10-18T21:59:23.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.812+0000 7f0fbbfff700 1 -- start start 2023-10-18T21:59:23.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.812+0000 7f0fbbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fbc0f6530 0x7f0fbc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:23.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.812+0000 7f0fbbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc0f77d0 0x7f0fbc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:23.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.812+0000 7f0fbbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc10a9d0 con 0x7f0fbc0f6530 2023-10-18T21:59:23.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.812+0000 7f0fbbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc10ab10 con 0x7f0fbc0f77d0 2023-10-18T21:59:23.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.813+0000 7f0fbaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fbc0f6530 0x7f0fbc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:23.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.813+0000 7f0fba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc0f77d0 0x7f0fbc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:23.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.813+0000 7f0fba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc0f77d0 0x7f0fbc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:52118/0 (socket says 172.21.15.8:52118) 2023-10-18T21:59:23.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.813+0000 7f0fba7fc700 1 -- 172.21.15.8:0/325068454 learned_addr learned my addr 172.21.15.8:0/325068454 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:23.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.813+0000 7f0fbaffd700 1 -- 172.21.15.8:0/325068454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc0f77d0 msgr2=0x7f0fbc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:23.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.813+0000 7f0fbaffd700 1 --2- 172.21.15.8:0/325068454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc0f77d0 0x7f0fbc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:23.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.813+0000 7f0fbaffd700 1 -- 172.21.15.8:0/325068454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac005040 con 0x7f0fbc0f6530 2023-10-18T21:59:23.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.813+0000 7f0fbaffd700 1 --2- 172.21.15.8:0/325068454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fbc0f6530 0x7f0fbc06b9a0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f0fbc0f7630 tx=0x7f0fac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:23.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.813+0000 7f0fa37fe700 1 -- 172.21.15.8:0/325068454 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fac019070 con 0x7f0fbc0f6530 2023-10-18T21:59:23.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.814+0000 7f0fbbfff700 1 -- 172.21.15.8:0/325068454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc06a370 con 0x7f0fbc0f6530 2023-10-18T21:59:23.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.814+0000 7f0fa37fe700 1 -- 172.21.15.8:0/325068454 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0fac013e70 con 0x7f0fbc0f6530 2023-10-18T21:59:23.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.814+0000 7f0fa37fe700 1 -- 172.21.15.8:0/325068454 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fac014d00 con 0x7f0fbc0f6530 2023-10-18T21:59:23.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.814+0000 7f0fbbfff700 1 -- 172.21.15.8:0/325068454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc06a850 con 0x7f0fbc0f6530 2023-10-18T21:59:23.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.815+0000 7f0fbbfff700 1 -- 172.21.15.8:0/325068454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc045ad0 con 0x7f0fbc0f6530 2023-10-18T21:59:23.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.815+0000 7f0fa37fe700 1 -- 172.21.15.8:0/325068454 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0fac014420 con 0x7f0fbc0f6530 2023-10-18T21:59:23.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.816+0000 7f0fa37fe700 1 --2- 172.21.15.8:0/325068454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fa4060f70 0x7f0fa4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:23.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.816+0000 7f0fa37fe700 1 -- 172.21.15.8:0/325068454 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0fac07dea0 con 0x7f0fbc0f6530 2023-10-18T21:59:23.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.817+0000 7f0fba7fc700 1 --2- 172.21.15.8:0/325068454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fa4060f70 0x7f0fa4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:23.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.817+0000 7f0fba7fc700 1 --2- 172.21.15.8:0/325068454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fa4060f70 0x7f0fa4063430 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f0fb0004d90 tx=0x7f0fb000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:23.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:23.821+0000 7f0fa37fe700 1 -- 172.21.15.8:0/325068454 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0fac04da50 con 0x7f0fbc0f6530 2023-10-18T21:59:24.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.049+0000 7f0fbbfff700 1 -- 172.21.15.8:0/325068454 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0fbc100a00 con 0x7f0fbc0f6530 2023-10-18T21:59:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.050+0000 7f0fa37fe700 1 -- 172.21.15.8:0/325068454 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f0fac014e60 con 0x7f0fbc0f6530 2023-10-18T21:59:24.052 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:59:24.052 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:59:24.052 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:59:24.052 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:59:24.052 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:59:24.053 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:59:24.053 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:59:24.053 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:59:24.053 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:59:24.053 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:59:24.054 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:59:24.054 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:59:24.054 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:59:24.054 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:59:24.055 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:59:24.055 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:59:24.055 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:59:24.055 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:59:24.055 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:59:24.056 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:59:24.056 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:59:24.056 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:59:24.056 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:59:24.056 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:59:24.057 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:59:24.057 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:59:24.057 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:59:24.057 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:59:24.057 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:59:24.058 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:59:24.058 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:59:24.058 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:59:24.058 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:59:24.059 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:59:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 -- 172.21.15.8:0/325068454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fa4060f70 msgr2=0x7f0fa4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 --2- 172.21.15.8:0/325068454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fa4060f70 0x7f0fa4063430 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f0fb0004d90 tx=0x7f0fb000b040).stop 2023-10-18T21:59:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 -- 172.21.15.8:0/325068454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fbc0f6530 msgr2=0x7f0fbc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 --2- 172.21.15.8:0/325068454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fbc0f6530 0x7f0fbc06b9a0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f0fbc0f7630 tx=0x7f0fac00b040).stop 2023-10-18T21:59:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 -- 172.21.15.8:0/325068454 shutdown_connections 2023-10-18T21:59:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 --2- 172.21.15.8:0/325068454 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fa4060f70 0x7f0fa4063430 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 --2- 172.21.15.8:0/325068454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fbc0f6530 0x7f0fbc06b9a0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 --2- 172.21.15.8:0/325068454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc0f77d0 0x7f0fbc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 -- 172.21.15.8:0/325068454 >> 172.21.15.8:0/325068454 conn(0x7f0fbc0f1c90 msgr2=0x7f0fbc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 -- 172.21.15.8:0/325068454 shutdown_connections 2023-10-18T21:59:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.052+0000 7f0fbbfff700 1 -- 172.21.15.8:0/325068454 wait complete. 2023-10-18T21:59:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:59:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:22.576733+0000 mgr.smithi008.flmjzp (mgr.14640) 3629 : audit [DBG] from='client.36976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:22.924725+0000 mgr.smithi008.flmjzp (mgr.14640) 3630 : audit [DBG] from='client.36980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:23.671721+0000 mon.smithi008 (mon.0) 3976 : audit [DBG] from='client.? 172.21.15.8:0/1641205942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:24.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.191+0000 7f08889f7700 1 -- 172.21.15.8:0/706384147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08840f6530 msgr2=0x7f08840f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:24.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.191+0000 7f08889f7700 1 --2- 172.21.15.8:0/706384147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08840f6530 0x7f08840f6950 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f0874004660 tx=0x7f0874009b30).stop 2023-10-18T21:59:24.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.191+0000 7f08889f7700 1 -- 172.21.15.8:0/706384147 shutdown_connections 2023-10-18T21:59:24.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.191+0000 7f08889f7700 1 --2- 172.21.15.8:0/706384147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08840f77d0 0x7f08840f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:24.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.191+0000 7f08889f7700 1 --2- 172.21.15.8:0/706384147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08840f6530 0x7f08840f6950 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.191+0000 7f08889f7700 1 -- 172.21.15.8:0/706384147 >> 172.21.15.8:0/706384147 conn(0x7f08840f1c90 msgr2=0x7f08840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.191+0000 7f08889f7700 1 -- 172.21.15.8:0/706384147 shutdown_connections 2023-10-18T21:59:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.191+0000 7f08889f7700 1 -- 172.21.15.8:0/706384147 wait complete. 2023-10-18T21:59:24.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.192+0000 7f08889f7700 1 Processor -- start 2023-10-18T21:59:24.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.192+0000 7f08889f7700 1 -- start start 2023-10-18T21:59:24.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f08889f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08840f6530 0x7f0884108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:24.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f08889f7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08840f77d0 0x7f08841094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:24.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f08889f7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0884109a60 con 0x7f08840f77d0 2023-10-18T21:59:24.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f08889f7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0884109ba0 con 0x7f08840f6530 2023-10-18T21:59:24.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f088259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08840f77d0 0x7f08841094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:24.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f088259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08840f77d0 0x7f08841094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33968/0 (socket says 172.21.15.8:33968) 2023-10-18T21:59:24.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f088259c700 1 -- 172.21.15.8:0/1499290325 learned_addr learned my addr 172.21.15.8:0/1499290325 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:24.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f0882d9d700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08840f6530 0x7f0884108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:24.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f088259c700 1 -- 172.21.15.8:0/1499290325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08840f6530 msgr2=0x7f0884108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:24.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f088259c700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08840f6530 0x7f0884108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:24.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.193+0000 7f088259c700 1 -- 172.21.15.8:0/1499290325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0874005040 con 0x7f08840f77d0 2023-10-18T21:59:24.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.194+0000 7f088259c700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08840f77d0 0x7f08841094b0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f08780026d0 tx=0x7f0878009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:24.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.194+0000 7f086b7fe700 1 -- 172.21.15.8:0/1499290325 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08780079c0 con 0x7f08840f77d0 2023-10-18T21:59:24.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.194+0000 7f086b7fe700 1 -- 172.21.15.8:0/1499290325 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f087800f040 con 0x7f08840f77d0 2023-10-18T21:59:24.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.194+0000 7f08889f7700 1 -- 172.21.15.8:0/1499290325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088410a540 con 0x7f08840f77d0 2023-10-18T21:59:24.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.194+0000 7f086b7fe700 1 -- 172.21.15.8:0/1499290325 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0878014980 con 0x7f08840f77d0 2023-10-18T21:59:24.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.194+0000 7f08889f7700 1 -- 172.21.15.8:0/1499290325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088410ab00 con 0x7f08840f77d0 2023-10-18T21:59:24.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.195+0000 7f08889f7700 1 -- 172.21.15.8:0/1499290325 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0884045ad0 con 0x7f08840f77d0 2023-10-18T21:59:24.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.196+0000 7f086b7fe700 1 -- 172.21.15.8:0/1499290325 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f08780090d0 con 0x7f08840f77d0 2023-10-18T21:59:24.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.197+0000 7f086b7fe700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f086c060f70 0x7f086c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:24.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.197+0000 7f086b7fe700 1 -- 172.21.15.8:0/1499290325 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f087807c8a0 con 0x7f08840f77d0 2023-10-18T21:59:24.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.197+0000 7f0882d9d700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f086c060f70 0x7f086c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:24.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.198+0000 7f0882d9d700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f086c060f70 0x7f086c063430 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f0874004630 tx=0x7f0874009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:24.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.201+0000 7f086b7fe700 1 -- 172.21.15.8:0/1499290325 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f087804ffb0 con 0x7f08840f77d0 2023-10-18T21:59:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:22.576733+0000 mgr.smithi008.flmjzp (mgr.14640) 3629 : audit [DBG] from='client.36976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:22.924725+0000 mgr.smithi008.flmjzp (mgr.14640) 3630 : audit [DBG] from='client.36980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:24.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:23.671721+0000 mon.smithi008 (mon.0) 3976 : audit [DBG] from='client.? 172.21.15.8:0/1641205942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:24.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.398+0000 7f08889f7700 1 -- 172.21.15.8:0/1499290325 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f08840fee30 con 0x7f086c060f70 2023-10-18T21:59:24.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.400+0000 7f086b7fe700 1 -- 172.21.15.8:0/1499290325 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f08840fee30 con 0x7f086c060f70 2023-10-18T21:59:24.401 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:59:24.401 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:59:24.401 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:59:24.401 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:59:24.402 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:59:24.402 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:59:24.402 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:59:24.402 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:59:24.402 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:59:24.403 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:59:24.403 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:59:24.403 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:59:24.403 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:59:24.403 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:59:24.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 -- 172.21.15.8:0/1499290325 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f086c060f70 msgr2=0x7f086c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:24.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f086c060f70 0x7f086c063430 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f0874004630 tx=0x7f0874009b30).stop 2023-10-18T21:59:24.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 -- 172.21.15.8:0/1499290325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08840f77d0 msgr2=0x7f08841094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:24.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08840f77d0 0x7f08841094b0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f08780026d0 tx=0x7f0878009de0).stop 2023-10-18T21:59:24.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 -- 172.21.15.8:0/1499290325 shutdown_connections 2023-10-18T21:59:24.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f086c060f70 0x7f086c063430 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:24.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08840f6530 0x7f0884108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:24.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 --2- 172.21.15.8:0/1499290325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08840f77d0 0x7f08841094b0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:24.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 -- 172.21.15.8:0/1499290325 >> 172.21.15.8:0/1499290325 conn(0x7f08840f1c90 msgr2=0x7f08840f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:24.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 -- 172.21.15.8:0/1499290325 shutdown_connections 2023-10-18T21:59:24.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:24.402+0000 7f08889f7700 1 -- 172.21.15.8:0/1499290325 wait complete. 2023-10-18T21:59:25.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:23.246600+0000 mgr.smithi008.flmjzp (mgr.14640) 3631 : cluster [DBG] pgmap v2495: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:25.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:23.265334+0000 mgr.smithi008.flmjzp (mgr.14640) 3632 : audit [DBG] from='client.36984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:25.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:24.050608+0000 mon.smithi008 (mon.0) 3977 : audit [DBG] from='client.? 172.21.15.8:0/325068454' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:59:25.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:23.246600+0000 mgr.smithi008.flmjzp (mgr.14640) 3631 : cluster [DBG] pgmap v2495: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:25.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:23.265334+0000 mgr.smithi008.flmjzp (mgr.14640) 3632 : audit [DBG] from='client.36984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:25.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:24.050608+0000 mon.smithi008 (mon.0) 3977 : audit [DBG] from='client.? 172.21.15.8:0/325068454' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:59:26.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:24.400135+0000 mgr.smithi008.flmjzp (mgr.14640) 3633 : audit [DBG] from='client.36996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:24.400135+0000 mgr.smithi008.flmjzp (mgr.14640) 3633 : audit [DBG] from='client.36996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:27.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:25.247238+0000 mgr.smithi008.flmjzp (mgr.14640) 3634 : cluster [DBG] pgmap v2496: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:25.247238+0000 mgr.smithi008.flmjzp (mgr.14640) 3634 : cluster [DBG] pgmap v2496: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:29.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:27.248013+0000 mgr.smithi008.flmjzp (mgr.14640) 3635 : cluster [DBG] pgmap v2497: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:27.248013+0000 mgr.smithi008.flmjzp (mgr.14640) 3635 : cluster [DBG] pgmap v2497: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:31.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:29.248687+0000 mgr.smithi008.flmjzp (mgr.14640) 3636 : cluster [DBG] pgmap v2498: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:29.248687+0000 mgr.smithi008.flmjzp (mgr.14640) 3636 : cluster [DBG] pgmap v2498: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:31.278181+0000 mon.smithi008 (mon.0) 3978 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:31.835116+0000 mon.smithi008 (mon.0) 3979 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:31.835943+0000 mon.smithi008 (mon.0) 3980 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:32.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:31.841344+0000 mon.smithi008 (mon.0) 3981 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:31.846214+0000 mon.smithi008 (mon.0) 3982 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:31.848555+0000 mon.smithi008 (mon.0) 3983 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:31.849850+0000 mon.smithi008 (mon.0) 3984 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:32.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:31.851159+0000 mon.smithi008 (mon.0) 3985 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:32.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:31.852767+0000 mon.smithi008 (mon.0) 3986 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:32.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:31.278181+0000 mon.smithi008 (mon.0) 3978 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:32.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:31.835116+0000 mon.smithi008 (mon.0) 3979 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:32.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:31.835943+0000 mon.smithi008 (mon.0) 3980 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:32.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:31.841344+0000 mon.smithi008 (mon.0) 3981 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:32.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:31.846214+0000 mon.smithi008 (mon.0) 3982 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:32.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:31.848555+0000 mon.smithi008 (mon.0) 3983 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:32.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:31.849850+0000 mon.smithi008 (mon.0) 3984 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:32.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:31.851159+0000 mon.smithi008 (mon.0) 3985 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:32.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:31.852767+0000 mon.smithi008 (mon.0) 3986 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:31.249288+0000 mgr.smithi008.flmjzp (mgr.14640) 3637 : cluster [DBG] pgmap v2499: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:31.836597+0000 mgr.smithi008.flmjzp (mgr.14640) 3638 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:31.837099+0000 mgr.smithi008.flmjzp (mgr.14640) 3639 : cluster [DBG] pgmap v2500: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:31.837478+0000 mgr.smithi008.flmjzp (mgr.14640) 3640 : cluster [DBG] pgmap v2501: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:33.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:31.854363+0000 mgr.smithi008.flmjzp (mgr.14640) 3641 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:31.249288+0000 mgr.smithi008.flmjzp (mgr.14640) 3637 : cluster [DBG] pgmap v2499: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:31.836597+0000 mgr.smithi008.flmjzp (mgr.14640) 3638 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:31.837099+0000 mgr.smithi008.flmjzp (mgr.14640) 3639 : cluster [DBG] pgmap v2500: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:31.837478+0000 mgr.smithi008.flmjzp (mgr.14640) 3640 : cluster [DBG] pgmap v2501: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:31.854363+0000 mgr.smithi008.flmjzp (mgr.14640) 3641 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:35.212 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:33.838045+0000 mgr.smithi008.flmjzp (mgr.14640) 3642 : cluster [DBG] pgmap v2502: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:33.838045+0000 mgr.smithi008.flmjzp (mgr.14640) 3642 : cluster [DBG] pgmap v2502: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:37.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:35.838814+0000 mgr.smithi008.flmjzp (mgr.14640) 3643 : cluster [DBG] pgmap v2503: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:35.838814+0000 mgr.smithi008.flmjzp (mgr.14640) 3643 : cluster [DBG] pgmap v2503: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:39.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:37.839372+0000 mgr.smithi008.flmjzp (mgr.14640) 3644 : cluster [DBG] pgmap v2504: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:37.839372+0000 mgr.smithi008.flmjzp (mgr.14640) 3644 : cluster [DBG] pgmap v2504: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:41.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:39.839862+0000 mgr.smithi008.flmjzp (mgr.14640) 3645 : cluster [DBG] pgmap v2505: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:39.839862+0000 mgr.smithi008.flmjzp (mgr.14640) 3645 : cluster [DBG] pgmap v2505: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:41.864267+0000 mon.smithi008 (mon.0) 3987 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:41.866382+0000 mon.smithi008 (mon.0) 3988 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:41.867389+0000 mon.smithi008 (mon.0) 3989 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:41.874083+0000 mon.smithi008 (mon.0) 3990 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:41.880405+0000 mon.smithi008 (mon.0) 3991 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:41.883638+0000 mon.smithi008 (mon.0) 3992 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:42.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:41.885280+0000 mon.smithi008 (mon.0) 3993 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:42.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:41.886865+0000 mon.smithi008 (mon.0) 3994 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:42.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:41.888802+0000 mon.smithi008 (mon.0) 3995 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:41.864267+0000 mon.smithi008 (mon.0) 3987 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:41.866382+0000 mon.smithi008 (mon.0) 3988 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:41.867389+0000 mon.smithi008 (mon.0) 3989 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:42.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:41.874083+0000 mon.smithi008 (mon.0) 3990 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:42.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:41.880405+0000 mon.smithi008 (mon.0) 3991 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:42.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:41.883638+0000 mon.smithi008 (mon.0) 3992 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:42.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:41.885280+0000 mon.smithi008 (mon.0) 3993 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:42.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:41.886865+0000 mon.smithi008 (mon.0) 3994 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:42.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:41.888802+0000 mon.smithi008 (mon.0) 3995 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:41.840510+0000 mgr.smithi008.flmjzp (mgr.14640) 3646 : cluster [DBG] pgmap v2506: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:43.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:41.868260+0000 mgr.smithi008.flmjzp (mgr.14640) 3647 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:43.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:41.868853+0000 mgr.smithi008.flmjzp (mgr.14640) 3648 : cluster [DBG] pgmap v2507: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:43.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:41.869083+0000 mgr.smithi008.flmjzp (mgr.14640) 3649 : cluster [DBG] pgmap v2508: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:43.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:41.890635+0000 mgr.smithi008.flmjzp (mgr.14640) 3650 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:43.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:41.840510+0000 mgr.smithi008.flmjzp (mgr.14640) 3646 : cluster [DBG] pgmap v2506: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:41.868260+0000 mgr.smithi008.flmjzp (mgr.14640) 3647 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:41.868853+0000 mgr.smithi008.flmjzp (mgr.14640) 3648 : cluster [DBG] pgmap v2507: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:41.869083+0000 mgr.smithi008.flmjzp (mgr.14640) 3649 : cluster [DBG] pgmap v2508: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:41.890635+0000 mgr.smithi008.flmjzp (mgr.14640) 3650 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:45.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:43.869818+0000 mgr.smithi008.flmjzp (mgr.14640) 3651 : cluster [DBG] pgmap v2509: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:43.869818+0000 mgr.smithi008.flmjzp (mgr.14640) 3651 : cluster [DBG] pgmap v2509: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:47.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:45.870503+0000 mgr.smithi008.flmjzp (mgr.14640) 3652 : cluster [DBG] pgmap v2510: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:45.870503+0000 mgr.smithi008.flmjzp (mgr.14640) 3652 : cluster [DBG] pgmap v2510: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:49.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:47.871140+0000 mgr.smithi008.flmjzp (mgr.14640) 3653 : cluster [DBG] pgmap v2511: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:47.871140+0000 mgr.smithi008.flmjzp (mgr.14640) 3653 : cluster [DBG] pgmap v2511: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:51.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:49.871831+0000 mgr.smithi008.flmjzp (mgr.14640) 3654 : cluster [DBG] pgmap v2512: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:49.871831+0000 mgr.smithi008.flmjzp (mgr.14640) 3654 : cluster [DBG] pgmap v2512: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:51.901419+0000 mon.smithi008 (mon.0) 3996 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:51.901419+0000 mon.smithi008 (mon.0) 3996 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:51.872341+0000 mgr.smithi008.flmjzp (mgr.14640) 3655 : cluster [DBG] pgmap v2513: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:52.462239+0000 mon.smithi008 (mon.0) 3997 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:52.463381+0000 mon.smithi008 (mon.0) 3998 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:52.470055+0000 mon.smithi008 (mon.0) 3999 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:52.476741+0000 mon.smithi008 (mon.0) 4000 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:53.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:52.479807+0000 mon.smithi008 (mon.0) 4001 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:52.481514+0000 mon.smithi008 (mon.0) 4002 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:52.483231+0000 mon.smithi008 (mon.0) 4003 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:53.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:52.485268+0000 mon.smithi008 (mon.0) 4004 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:51.872341+0000 mgr.smithi008.flmjzp (mgr.14640) 3655 : cluster [DBG] pgmap v2513: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:52.462239+0000 mon.smithi008 (mon.0) 3997 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T21:59:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:52.463381+0000 mon.smithi008 (mon.0) 3998 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T21:59:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:52.470055+0000 mon.smithi008 (mon.0) 3999 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T21:59:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:52.476741+0000 mon.smithi008 (mon.0) 4000 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T21:59:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:52.479807+0000 mon.smithi008 (mon.0) 4001 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:52.481514+0000 mon.smithi008 (mon.0) 4002 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:52.483231+0000 mon.smithi008 (mon.0) 4003 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:53.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:52.485268+0000 mon.smithi008 (mon.0) 4004 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:54.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:52.464254+0000 mgr.smithi008.flmjzp (mgr.14640) 3656 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:52.464962+0000 mgr.smithi008.flmjzp (mgr.14640) 3657 : cluster [DBG] pgmap v2514: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:52.465217+0000 mgr.smithi008.flmjzp (mgr.14640) 3658 : cluster [DBG] pgmap v2515: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:54.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T21:59:52.487194+0000 mgr.smithi008.flmjzp (mgr.14640) 3659 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:54.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:52.464254+0000 mgr.smithi008.flmjzp (mgr.14640) 3656 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T21:59:54.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:52.464962+0000 mgr.smithi008.flmjzp (mgr.14640) 3657 : cluster [DBG] pgmap v2514: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:54.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:52.465217+0000 mgr.smithi008.flmjzp (mgr.14640) 3658 : cluster [DBG] pgmap v2515: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:54.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T21:59:52.487194+0000 mgr.smithi008.flmjzp (mgr.14640) 3659 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T21:59:54.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.554+0000 7f34e5b8d700 1 -- 172.21.15.8:0/226401381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34e00f77d0 msgr2=0x7f34e00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:54.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.554+0000 7f34e5b8d700 1 --2- 172.21.15.8:0/226401381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34e00f77d0 0x7f34e00f7c30 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f34cc004660 tx=0x7f34cc009b30).stop 2023-10-18T21:59:54.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.554+0000 7f34e5b8d700 1 -- 172.21.15.8:0/226401381 shutdown_connections 2023-10-18T21:59:54.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.554+0000 7f34e5b8d700 1 --2- 172.21.15.8:0/226401381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34e00f77d0 0x7f34e00f7c30 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:54.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.554+0000 7f34e5b8d700 1 --2- 172.21.15.8:0/226401381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e00f6530 0x7f34e00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:54.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.554+0000 7f34e5b8d700 1 -- 172.21.15.8:0/226401381 >> 172.21.15.8:0/226401381 conn(0x7f34e00f1c90 msgr2=0x7f34e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:54.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.554+0000 7f34e5b8d700 1 -- 172.21.15.8:0/226401381 shutdown_connections 2023-10-18T21:59:54.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.555+0000 7f34e5b8d700 1 -- 172.21.15.8:0/226401381 wait complete. 2023-10-18T21:59:54.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.556+0000 7f34e5b8d700 1 Processor -- start 2023-10-18T21:59:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.556+0000 7f34e5b8d700 1 -- start start 2023-10-18T21:59:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.556+0000 7f34e5b8d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34e00f6530 0x7f34e006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.556+0000 7f34e5b8d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e00f77d0 0x7f34e0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34e5b8d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e006a380 con 0x7f34e00f6530 2023-10-18T21:59:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34e5b8d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e006a4c0 con 0x7f34e00f77d0 2023-10-18T21:59:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34e4b8b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34e00f6530 0x7f34e006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34e4b8b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34e00f6530 0x7f34e006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60590/0 (socket says 172.21.15.8:60590) 2023-10-18T21:59:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34e4b8b700 1 -- 172.21.15.8:0/4085101337 learned_addr learned my addr 172.21.15.8:0/4085101337 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34dffff700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e00f77d0 0x7f34e0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34e4b8b700 1 -- 172.21.15.8:0/4085101337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e00f77d0 msgr2=0x7f34e0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34e4b8b700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e00f77d0 0x7f34e0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34e4b8b700 1 -- 172.21.15.8:0/4085101337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc005040 con 0x7f34e00f6530 2023-10-18T21:59:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34dffff700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e00f77d0 0x7f34e0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:59:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.557+0000 7f34e4b8b700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34e00f6530 0x7f34e006b9a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f34d4002700 tx=0x7f34d4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.558+0000 7f34dd7fa700 1 -- 172.21.15.8:0/4085101337 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34d4009320 con 0x7f34e00f6530 2023-10-18T21:59:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.558+0000 7f34dd7fa700 1 -- 172.21.15.8:0/4085101337 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f34d400f040 con 0x7f34e00f6530 2023-10-18T21:59:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.558+0000 7f34dd7fa700 1 -- 172.21.15.8:0/4085101337 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34d4014970 con 0x7f34e00f6530 2023-10-18T21:59:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.558+0000 7f34e5b8d700 1 -- 172.21.15.8:0/4085101337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e006a7a0 con 0x7f34e00f6530 2023-10-18T21:59:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.558+0000 7f34e5b8d700 1 -- 172.21.15.8:0/4085101337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e010ed70 con 0x7f34e00f6530 2023-10-18T21:59:54.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.559+0000 7f34e5b8d700 1 -- 172.21.15.8:0/4085101337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e0045ad0 con 0x7f34e00f6530 2023-10-18T21:59:54.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.560+0000 7f34dd7fa700 1 -- 172.21.15.8:0/4085101337 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f34d4009480 con 0x7f34e00f6530 2023-10-18T21:59:54.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.561+0000 7f34dd7fa700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34d0060f70 0x7f34d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:54.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.561+0000 7f34dd7fa700 1 -- 172.21.15.8:0/4085101337 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f34d407cad0 con 0x7f34e00f6530 2023-10-18T21:59:54.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.561+0000 7f34dffff700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34d0060f70 0x7f34d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:54.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.562+0000 7f34dffff700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34d0060f70 0x7f34d0063430 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f34cc005010 tx=0x7f34cc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:54.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.565+0000 7f34dd7fa700 1 -- 172.21.15.8:0/4085101337 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f34d404c7c0 con 0x7f34e00f6530 2023-10-18T21:59:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.765+0000 7f34e5b8d700 1 -- 172.21.15.8:0/4085101337 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34e00fee30 con 0x7f34d0060f70 2023-10-18T21:59:54.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.766+0000 7f34dd7fa700 1 -- 172.21.15.8:0/4085101337 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f34e00fee30 con 0x7f34d0060f70 2023-10-18T21:59:54.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 -- 172.21.15.8:0/4085101337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34d0060f70 msgr2=0x7f34d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:54.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34d0060f70 0x7f34d0063430 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f34cc005010 tx=0x7f34cc009b30).stop 2023-10-18T21:59:54.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 -- 172.21.15.8:0/4085101337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34e00f6530 msgr2=0x7f34e006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:54.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34e00f6530 0x7f34e006b9a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f34d4002700 tx=0x7f34d4009d80).stop 2023-10-18T21:59:54.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 -- 172.21.15.8:0/4085101337 shutdown_connections 2023-10-18T21:59:54.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f34d0060f70 0x7f34d0063430 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:54.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34e00f6530 0x7f34e006b9a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:54.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 --2- 172.21.15.8:0/4085101337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e00f77d0 0x7f34e0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:54.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 -- 172.21.15.8:0/4085101337 >> 172.21.15.8:0/4085101337 conn(0x7f34e00f1c90 msgr2=0x7f34e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:54.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 -- 172.21.15.8:0/4085101337 shutdown_connections 2023-10-18T21:59:54.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.768+0000 7f34e5b8d700 1 -- 172.21.15.8:0/4085101337 wait complete. 2023-10-18T21:59:54.784 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T21:59:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.907+0000 7f255bfff700 1 -- 172.21.15.8:0/4189052304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f255c0f77d0 msgr2=0x7f255c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.907+0000 7f255bfff700 1 --2- 172.21.15.8:0/4189052304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f255c0f77d0 0x7f255c0f7c30 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f2550004660 tx=0x7f2550009b30).stop 2023-10-18T21:59:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.907+0000 7f255bfff700 1 -- 172.21.15.8:0/4189052304 shutdown_connections 2023-10-18T21:59:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.907+0000 7f255bfff700 1 --2- 172.21.15.8:0/4189052304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f255c0f77d0 0x7f255c0f7c30 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.907+0000 7f255bfff700 1 --2- 172.21.15.8:0/4189052304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c0f6530 0x7f255c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.907+0000 7f255bfff700 1 -- 172.21.15.8:0/4189052304 >> 172.21.15.8:0/4189052304 conn(0x7f255c0f1c90 msgr2=0x7f255c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.907+0000 7f255bfff700 1 -- 172.21.15.8:0/4189052304 shutdown_connections 2023-10-18T21:59:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.907+0000 7f255bfff700 1 -- 172.21.15.8:0/4189052304 wait complete. 2023-10-18T21:59:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.908+0000 7f255bfff700 1 Processor -- start 2023-10-18T21:59:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.908+0000 7f255bfff700 1 -- start start 2023-10-18T21:59:54.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.908+0000 7f255bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c0f6530 0x7f255c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:54.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.908+0000 7f255bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f255c0f77d0 0x7f255c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:54.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.908+0000 7f255bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c06a380 con 0x7f255c0f77d0 2023-10-18T21:59:54.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.908+0000 7f255bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c06a4c0 con 0x7f255c0f6530 2023-10-18T21:59:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.908+0000 7f255a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f255c0f77d0 0x7f255c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.908+0000 7f255a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f255c0f77d0 0x7f255c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60610/0 (socket says 172.21.15.8:60610) 2023-10-18T21:59:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.908+0000 7f255a7fc700 1 -- 172.21.15.8:0/3267796759 learned_addr learned my addr 172.21.15.8:0/3267796759 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.909+0000 7f255affd700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c0f6530 0x7f255c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.909+0000 7f255a7fc700 1 -- 172.21.15.8:0/3267796759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c0f6530 msgr2=0x7f255c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.909+0000 7f255a7fc700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c0f6530 0x7f255c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.909+0000 7f255a7fc700 1 -- 172.21.15.8:0/3267796759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2550005040 con 0x7f255c0f77d0 2023-10-18T21:59:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.909+0000 7f255affd700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c0f6530 0x7f255c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:59:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.909+0000 7f255a7fc700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f255c0f77d0 0x7f255c069e20 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f2550009f50 tx=0x7f2550009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.909+0000 7f25437fe700 1 -- 172.21.15.8:0/3267796759 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2550018070 con 0x7f255c0f77d0 2023-10-18T21:59:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.909+0000 7f25437fe700 1 -- 172.21.15.8:0/3267796759 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2550009630 con 0x7f255c0f77d0 2023-10-18T21:59:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.909+0000 7f255bfff700 1 -- 172.21.15.8:0/3267796759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c06a740 con 0x7f255c0f77d0 2023-10-18T21:59:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.909+0000 7f25437fe700 1 -- 172.21.15.8:0/3267796759 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f255001c3c0 con 0x7f255c0f77d0 2023-10-18T21:59:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.910+0000 7f255bfff700 1 -- 172.21.15.8:0/3267796759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c06aca0 con 0x7f255c0f77d0 2023-10-18T21:59:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.910+0000 7f255bfff700 1 -- 172.21.15.8:0/3267796759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c045ad0 con 0x7f255c0f77d0 2023-10-18T21:59:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.911+0000 7f25437fe700 1 -- 172.21.15.8:0/3267796759 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f255001d420 con 0x7f255c0f77d0 2023-10-18T21:59:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.912+0000 7f25437fe700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2544060f70 0x7f2544063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.912+0000 7f25437fe700 1 -- 172.21.15.8:0/3267796759 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f255007e650 con 0x7f255c0f77d0 2023-10-18T21:59:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.912+0000 7f255affd700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2544060f70 0x7f2544063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.913+0000 7f255affd700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2544060f70 0x7f2544063430 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f255c06b730 tx=0x7f254c009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:54.916+0000 7f25437fe700 1 -- 172.21.15.8:0/3267796759 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f255004e2c0 con 0x7f255c0f77d0 2023-10-18T21:59:55.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.117+0000 7f255bfff700 1 -- 172.21.15.8:0/3267796759 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f255c0fedd0 con 0x7f2544060f70 2023-10-18T21:59:55.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.118+0000 7f25437fe700 1 -- 172.21.15.8:0/3267796759 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f255c0fedd0 con 0x7f2544060f70 2023-10-18T21:59:55.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 -- 172.21.15.8:0/3267796759 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2544060f70 msgr2=0x7f2544063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:55.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2544060f70 0x7f2544063430 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f255c06b730 tx=0x7f254c009c00).stop 2023-10-18T21:59:55.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 -- 172.21.15.8:0/3267796759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f255c0f77d0 msgr2=0x7f255c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:55.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f255c0f77d0 0x7f255c069e20 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f2550009f50 tx=0x7f2550009b30).stop 2023-10-18T21:59:55.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 -- 172.21.15.8:0/3267796759 shutdown_connections 2023-10-18T21:59:55.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2544060f70 0x7f2544063430 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c0f6530 0x7f255c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 --2- 172.21.15.8:0/3267796759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f255c0f77d0 0x7f255c069e20 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 -- 172.21.15.8:0/3267796759 >> 172.21.15.8:0/3267796759 conn(0x7f255c0f1c90 msgr2=0x7f255c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:55.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 -- 172.21.15.8:0/3267796759 shutdown_connections 2023-10-18T21:59:55.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.120+0000 7f255bfff700 1 -- 172.21.15.8:0/3267796759 wait complete. 2023-10-18T21:59:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.257+0000 7f2901557700 1 -- 172.21.15.8:0/2286870763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28fc0f6530 msgr2=0x7f28fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.257+0000 7f2901557700 1 --2- 172.21.15.8:0/2286870763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28fc0f6530 0x7f28fc0f6950 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f28ec004660 tx=0x7f28ec009b30).stop 2023-10-18T21:59:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.258+0000 7f2901557700 1 -- 172.21.15.8:0/2286870763 shutdown_connections 2023-10-18T21:59:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.258+0000 7f2901557700 1 --2- 172.21.15.8:0/2286870763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28fc0f77d0 0x7f28fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.258+0000 7f2901557700 1 --2- 172.21.15.8:0/2286870763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28fc0f6530 0x7f28fc0f6950 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.258+0000 7f2901557700 1 -- 172.21.15.8:0/2286870763 >> 172.21.15.8:0/2286870763 conn(0x7f28fc0f1c90 msgr2=0x7f28fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.258+0000 7f2901557700 1 -- 172.21.15.8:0/2286870763 shutdown_connections 2023-10-18T21:59:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.258+0000 7f2901557700 1 -- 172.21.15.8:0/2286870763 wait complete. 2023-10-18T21:59:55.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.258+0000 7f2901557700 1 Processor -- start 2023-10-18T21:59:55.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.259+0000 7f2901557700 1 -- start start 2023-10-18T21:59:55.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.259+0000 7f2901557700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28fc0f6530 0x7f28fc108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:55.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.259+0000 7f2901557700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28fc0f77d0 0x7f28fc109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:55.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.259+0000 7f2901557700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc1099e0 con 0x7f28fc0f77d0 2023-10-18T21:59:55.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.259+0000 7f2901557700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc109b20 con 0x7f28fc0f6530 2023-10-18T21:59:55.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.259+0000 7f28fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28fc0f77d0 0x7f28fc109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:55.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.259+0000 7f28fb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28fc0f77d0 0x7f28fc109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60620/0 (socket says 172.21.15.8:60620) 2023-10-18T21:59:55.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.259+0000 7f28fb7fe700 1 -- 172.21.15.8:0/298421315 learned_addr learned my addr 172.21.15.8:0/298421315 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:55.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.259+0000 7f28fbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28fc0f6530 0x7f28fc108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:55.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.260+0000 7f28fb7fe700 1 -- 172.21.15.8:0/298421315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28fc0f6530 msgr2=0x7f28fc108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.260+0000 7f28fb7fe700 1 --2- 172.21.15.8:0/298421315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28fc0f6530 0x7f28fc108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.260+0000 7f28fb7fe700 1 -- 172.21.15.8:0/298421315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec005040 con 0x7f28fc0f77d0 2023-10-18T21:59:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.260+0000 7f28fb7fe700 1 --2- 172.21.15.8:0/298421315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28fc0f77d0 0x7f28fc109430 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f28f000e7f0 tx=0x7f28f000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.260+0000 7f28f8ff9700 1 -- 172.21.15.8:0/298421315 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28f00092e0 con 0x7f28fc0f77d0 2023-10-18T21:59:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.260+0000 7f28f8ff9700 1 -- 172.21.15.8:0/298421315 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f28f000f040 con 0x7f28fc0f77d0 2023-10-18T21:59:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.260+0000 7f2901557700 1 -- 172.21.15.8:0/298421315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc10a4c0 con 0x7f28fc0f77d0 2023-10-18T21:59:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.260+0000 7f28f8ff9700 1 -- 172.21.15.8:0/298421315 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28f00147e0 con 0x7f28fc0f77d0 2023-10-18T21:59:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.260+0000 7f2901557700 1 -- 172.21.15.8:0/298421315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc10aa00 con 0x7f28fc0f77d0 2023-10-18T21:59:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.261+0000 7f2901557700 1 -- 172.21.15.8:0/298421315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc045ad0 con 0x7f28fc0f77d0 2023-10-18T21:59:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.262+0000 7f28f8ff9700 1 -- 172.21.15.8:0/298421315 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f28f001b030 con 0x7f28fc0f77d0 2023-10-18T21:59:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.263+0000 7f28f8ff9700 1 --2- 172.21.15.8:0/298421315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28e4060f70 0x7f28e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.263+0000 7f28f8ff9700 1 -- 172.21.15.8:0/298421315 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f28f007c6b0 con 0x7f28fc0f77d0 2023-10-18T21:59:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.263+0000 7f28fbfff700 1 --2- 172.21.15.8:0/298421315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28e4060f70 0x7f28e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.264+0000 7f28fbfff700 1 --2- 172.21.15.8:0/298421315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28e4060f70 0x7f28e4063430 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f28ec009720 tx=0x7f28ec016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.267+0000 7f28f8ff9700 1 -- 172.21.15.8:0/298421315 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f28f004fd40 con 0x7f28fc0f77d0 2023-10-18T21:59:55.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.458+0000 7f2901557700 1 -- 172.21.15.8:0/298421315 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f28fc10ac70 con 0x7f28e4060f70 2023-10-18T21:59:55.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.468+0000 7f28f8ff9700 1 -- 172.21.15.8:0/298421315 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f28fc10ac70 con 0x7f28e4060f70 2023-10-18T21:59:55.471 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T21:59:55.471 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (66m) 4m ago 68m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T21:59:55.472 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (60m) 4m ago 68m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T21:59:55.472 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (60m) 115s ago 67m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T21:59:55.472 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (66m) 4m ago 67m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T21:59:55.472 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 64m - - 2023-10-18T21:59:55.472 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 64m - - 2023-10-18T21:59:55.473 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 115s ago 64m - - 2023-10-18T21:59:55.473 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 115s ago 63m - - 2023-10-18T21:59:55.473 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (61m) 4m ago 69m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T21:59:55.473 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (61m) 115s ago 67m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T21:59:55.473 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (60m) 4m ago 69m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T21:59:55.474 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (60m) 115s ago 67m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T21:59:55.474 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (67m) 4m ago 67m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T21:59:55.474 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (66m) 115s ago 66m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T21:59:55.474 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (60m) 4m ago 66m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T21:59:55.474 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (58m) 4m ago 66m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T21:59:55.475 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (57m) 4m ago 65m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T21:59:55.475 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (57m) 115s ago 65m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T21:59:55.476 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (56m) 115s ago 65m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T21:59:55.476 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (56m) 115s ago 65m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T21:59:55.476 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (62m) 4m ago 67m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T21:59:55.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.470+0000 7f2901557700 1 -- 172.21.15.8:0/298421315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28e4060f70 msgr2=0x7f28e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:55.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.470+0000 7f2901557700 1 --2- 172.21.15.8:0/298421315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28e4060f70 0x7f28e4063430 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f28ec009720 tx=0x7f28ec016040).stop 2023-10-18T21:59:55.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.470+0000 7f2901557700 1 -- 172.21.15.8:0/298421315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28fc0f77d0 msgr2=0x7f28fc109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:55.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.470+0000 7f2901557700 1 --2- 172.21.15.8:0/298421315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28fc0f77d0 0x7f28fc109430 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f28f000e7f0 tx=0x7f28f000b040).stop 2023-10-18T21:59:55.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.470+0000 7f2901557700 1 -- 172.21.15.8:0/298421315 shutdown_connections 2023-10-18T21:59:55.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.470+0000 7f2901557700 1 --2- 172.21.15.8:0/298421315 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f28e4060f70 0x7f28e4063430 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.470+0000 7f2901557700 1 --2- 172.21.15.8:0/298421315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28fc0f6530 0x7f28fc108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.470+0000 7f2901557700 1 --2- 172.21.15.8:0/298421315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28fc0f77d0 0x7f28fc109430 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.470+0000 7f2901557700 1 -- 172.21.15.8:0/298421315 >> 172.21.15.8:0/298421315 conn(0x7f28fc0f1c90 msgr2=0x7f28fc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.471+0000 7f2901557700 1 -- 172.21.15.8:0/298421315 shutdown_connections 2023-10-18T21:59:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.471+0000 7f2901557700 1 -- 172.21.15.8:0/298421315 wait complete. 2023-10-18T21:59:55.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.606+0000 7fae713d1700 1 -- 172.21.15.8:0/3870238864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae6c0f77d0 msgr2=0x7fae6c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:55.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.606+0000 7fae713d1700 1 --2- 172.21.15.8:0/3870238864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae6c0f77d0 0x7fae6c0f7c30 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fae60004660 tx=0x7fae60009b30).stop 2023-10-18T21:59:55.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.606+0000 7fae713d1700 1 -- 172.21.15.8:0/3870238864 shutdown_connections 2023-10-18T21:59:55.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.606+0000 7fae713d1700 1 --2- 172.21.15.8:0/3870238864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae6c0f77d0 0x7fae6c0f7c30 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.606+0000 7fae713d1700 1 --2- 172.21.15.8:0/3870238864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae6c0f6530 0x7fae6c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.606+0000 7fae713d1700 1 -- 172.21.15.8:0/3870238864 >> 172.21.15.8:0/3870238864 conn(0x7fae6c0f1c90 msgr2=0x7fae6c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:55.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.606+0000 7fae713d1700 1 -- 172.21.15.8:0/3870238864 shutdown_connections 2023-10-18T21:59:55.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.606+0000 7fae713d1700 1 -- 172.21.15.8:0/3870238864 wait complete. 2023-10-18T21:59:55.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.607+0000 7fae713d1700 1 Processor -- start 2023-10-18T21:59:55.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.607+0000 7fae713d1700 1 -- start start 2023-10-18T21:59:55.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.607+0000 7fae713d1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae6c0f6530 0x7fae6c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:55.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.607+0000 7fae713d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae6c0f77d0 0x7fae6c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:55.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.607+0000 7fae713d1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c06a380 con 0x7fae6c0f6530 2023-10-18T21:59:55.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.607+0000 7fae713d1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c06a4c0 con 0x7fae6c0f77d0 2023-10-18T21:59:55.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.607+0000 7fae6bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae6c0f6530 0x7fae6c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:55.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae6bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae6c0f6530 0x7fae6c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60628/0 (socket says 172.21.15.8:60628) 2023-10-18T21:59:55.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae6bfff700 1 -- 172.21.15.8:0/4228656107 learned_addr learned my addr 172.21.15.8:0/4228656107 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:55.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae6b7fe700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae6c0f77d0 0x7fae6c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:55.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae6bfff700 1 -- 172.21.15.8:0/4228656107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae6c0f77d0 msgr2=0x7fae6c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:55.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae6bfff700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae6c0f77d0 0x7fae6c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae6bfff700 1 -- 172.21.15.8:0/4228656107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60005040 con 0x7fae6c0f6530 2023-10-18T21:59:55.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae6b7fe700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae6c0f77d0 0x7fae6c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:59:55.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae6bfff700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae6c0f6530 0x7fae6c06b9a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fae5c002700 tx=0x7fae5c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:55.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae68ff9700 1 -- 172.21.15.8:0/4228656107 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5c009320 con 0x7fae6c0f6530 2023-10-18T21:59:55.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae68ff9700 1 -- 172.21.15.8:0/4228656107 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fae5c00f040 con 0x7fae6c0f6530 2023-10-18T21:59:55.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae68ff9700 1 -- 172.21.15.8:0/4228656107 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5c014950 con 0x7fae6c0f6530 2023-10-18T21:59:55.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.608+0000 7fae713d1700 1 -- 172.21.15.8:0/4228656107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6c06a7a0 con 0x7fae6c0f6530 2023-10-18T21:59:55.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.609+0000 7fae713d1700 1 -- 172.21.15.8:0/4228656107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c10ed20 con 0x7fae6c0f6530 2023-10-18T21:59:55.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.610+0000 7fae713d1700 1 -- 172.21.15.8:0/4228656107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c045ad0 con 0x7fae6c0f6530 2023-10-18T21:59:55.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.610+0000 7fae68ff9700 1 -- 172.21.15.8:0/4228656107 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fae5c009480 con 0x7fae6c0f6530 2023-10-18T21:59:55.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.612+0000 7fae68ff9700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 0x7fae54063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:55.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.612+0000 7fae68ff9700 1 -- 172.21.15.8:0/4228656107 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fae5c07cc70 con 0x7fae6c0f6530 2023-10-18T21:59:55.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.612+0000 7fae6b7fe700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 0x7fae54063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:55.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.613+0000 7fae6b7fe700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 0x7fae54063430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fae60005010 tx=0x7fae60009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:55.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.616+0000 7fae68ff9700 1 -- 172.21.15.8:0/4228656107 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fae5c083080 con 0x7fae6c0f6530 2023-10-18T21:59:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.872+0000 7fae713d1700 1 -- 172.21.15.8:0/4228656107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fae6c0fed90 con 0x7fae6c0f6530 2023-10-18T21:59:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.873+0000 7fae68ff9700 1 -- 172.21.15.8:0/4228656107 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fae5c04c8a0 con 0x7fae6c0f6530 2023-10-18T21:59:55.876 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:59:55.876 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T21:59:55.877 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:59:55.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:59:55.877 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T21:59:55.878 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T21:59:55.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:59:55.878 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T21:59:55.879 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T21:59:55.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:59:55.879 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T21:59:55.880 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T21:59:55.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T21:59:55.881 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T21:59:55.881 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T21:59:55.881 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T21:59:55.882 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:59:55.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 -- 172.21.15.8:0/4228656107 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 msgr2=0x7fae54063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:55.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 0x7fae54063430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fae60005010 tx=0x7fae60009b30).stop 2023-10-18T21:59:55.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 -- 172.21.15.8:0/4228656107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae6c0f6530 msgr2=0x7fae6c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:55.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae6c0f6530 0x7fae6c06b9a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fae5c002700 tx=0x7fae5c009e00).stop 2023-10-18T21:59:55.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 -- 172.21.15.8:0/4228656107 shutdown_connections 2023-10-18T21:59:55.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 0x7fae54063430 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae6c0f6530 0x7fae6c06b9a0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 --2- 172.21.15.8:0/4228656107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae6c0f77d0 0x7fae6c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:55.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 -- 172.21.15.8:0/4228656107 >> 172.21.15.8:0/4228656107 conn(0x7fae6c0f1c90 msgr2=0x7fae6c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:55.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 -- 172.21.15.8:0/4228656107 shutdown_connections 2023-10-18T21:59:55.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:55.875+0000 7fae713d1700 1 -- 172.21.15.8:0/4228656107 wait complete. 2023-10-18T21:59:56.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.017+0000 7f5bc6939700 1 -- 172.21.15.8:0/3797854921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc0060310 msgr2=0x7f5bc00f9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:56.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.017+0000 7f5bc6939700 1 --2- 172.21.15.8:0/3797854921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc0060310 0x7f5bc00f9070 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f5bbc004660 tx=0x7f5bbc009b30).stop 2023-10-18T21:59:56.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.017+0000 7f5bc6939700 1 -- 172.21.15.8:0/3797854921 shutdown_connections 2023-10-18T21:59:56.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.017+0000 7f5bc6939700 1 --2- 172.21.15.8:0/3797854921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00f95f0 0x7f5bc00fba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.017+0000 7f5bc6939700 1 --2- 172.21.15.8:0/3797854921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc0060310 0x7f5bc00f9070 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.017+0000 7f5bc6939700 1 -- 172.21.15.8:0/3797854921 >> 172.21.15.8:0/3797854921 conn(0x7f5bc00f0ad0 msgr2=0x7f5bc00f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:56.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.017+0000 7f5bc6939700 1 -- 172.21.15.8:0/3797854921 shutdown_connections 2023-10-18T21:59:56.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.017+0000 7f5bc6939700 1 -- 172.21.15.8:0/3797854921 wait complete. 2023-10-18T21:59:56.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.018+0000 7f5bc6939700 1 Processor -- start 2023-10-18T21:59:56.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.018+0000 7f5bc6939700 1 -- start start 2023-10-18T21:59:56.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc6939700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc0060310 0x7f5bc0108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:56.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc6939700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00f95f0 0x7f5bc01093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:56.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc6939700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc01099a0 con 0x7f5bc0060310 2023-10-18T21:59:56.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc6939700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc0109ae0 con 0x7f5bc00f95f0 2023-10-18T21:59:56.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc5937700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc0060310 0x7f5bc0108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:56.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc5937700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc0060310 0x7f5bc0108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60654/0 (socket says 172.21.15.8:60654) 2023-10-18T21:59:56.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc5937700 1 -- 172.21.15.8:0/1058586111 learned_addr learned my addr 172.21.15.8:0/1058586111 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:56.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc5136700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00f95f0 0x7f5bc01093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:56.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc5937700 1 -- 172.21.15.8:0/1058586111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00f95f0 msgr2=0x7f5bc01093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:56.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc5937700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00f95f0 0x7f5bc01093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc5937700 1 -- 172.21.15.8:0/1058586111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc005040 con 0x7f5bc0060310 2023-10-18T21:59:56.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.019+0000 7f5bc5136700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00f95f0 0x7f5bc01093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T21:59:56.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.020+0000 7f5bc5937700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc0060310 0x7f5bc0108f00 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f5bbc009990 tx=0x7f5bbc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:56.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.020+0000 7f5bb67fc700 1 -- 172.21.15.8:0/1058586111 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bbc018070 con 0x7f5bc0060310 2023-10-18T21:59:56.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.020+0000 7f5bb67fc700 1 -- 172.21.15.8:0/1058586111 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5bbc009630 con 0x7f5bc0060310 2023-10-18T21:59:56.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.020+0000 7f5bc6939700 1 -- 172.21.15.8:0/1058586111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc010a420 con 0x7f5bc0060310 2023-10-18T21:59:56.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.020+0000 7f5bb67fc700 1 -- 172.21.15.8:0/1058586111 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bbc01c400 con 0x7f5bc0060310 2023-10-18T21:59:56.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.020+0000 7f5bc6939700 1 -- 172.21.15.8:0/1058586111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc010a980 con 0x7f5bc0060310 2023-10-18T21:59:56.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.021+0000 7f5bc6939700 1 -- 172.21.15.8:0/1058586111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc0045ad0 con 0x7f5bc0060310 2023-10-18T21:59:56.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.022+0000 7f5bb67fc700 1 -- 172.21.15.8:0/1058586111 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5bbc01d9e0 con 0x7f5bc0060310 2023-10-18T21:59:56.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.024+0000 7f5bb67fc700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bac060f70 0x7f5bac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:56.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.024+0000 7f5bb67fc700 1 -- 172.21.15.8:0/1058586111 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5bbc07e5c0 con 0x7f5bc0060310 2023-10-18T21:59:56.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.024+0000 7f5bc5136700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bac060f70 0x7f5bac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:56.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.025+0000 7f5bc5136700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bac060f70 0x7f5bac063430 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f5bc00600e0 tx=0x7f5bb0009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:56.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.028+0000 7f5bb67fc700 1 -- 172.21.15.8:0/1058586111 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5bbc051ce0 con 0x7f5bc0060310 2023-10-18T21:59:56.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.254+0000 7f5bc6939700 1 -- 172.21.15.8:0/1058586111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5bc00fed90 con 0x7f5bc0060310 2023-10-18T21:59:56.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.255+0000 7f5bb67fc700 1 -- 172.21.15.8:0/1058586111 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f5bbc0518d0 con 0x7f5bc0060310 2023-10-18T21:59:56.258 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T21:59:56.258 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T21:59:56.259 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:59:56.259 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T21:59:56.259 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:59:56.260 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T21:59:56.260 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T21:59:56.260 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T21:59:56.261 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T21:59:56.261 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T21:59:56.261 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T21:59:56.262 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T21:59:56.262 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T21:59:56.262 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T21:59:56.263 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T21:59:56.263 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T21:59:56.263 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T21:59:56.264 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T21:59:56.264 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T21:59:56.264 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T21:59:56.265 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T21:59:56.265 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T21:59:56.266 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T21:59:56.266 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T21:59:56.267 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T21:59:56.267 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T21:59:56.267 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T21:59:56.267 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T21:59:56.267 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T21:59:56.267 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T21:59:56.268 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T21:59:56.268 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T21:59:56.268 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:59:56.268 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T21:59:56.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.256+0000 7f5bc6939700 1 -- 172.21.15.8:0/1058586111 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bac060f70 msgr2=0x7f5bac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:56.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.256+0000 7f5bc6939700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bac060f70 0x7f5bac063430 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f5bc00600e0 tx=0x7f5bb0009be0).stop 2023-10-18T21:59:56.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.256+0000 7f5bc6939700 1 -- 172.21.15.8:0/1058586111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc0060310 msgr2=0x7f5bc0108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:56.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.256+0000 7f5bc6939700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc0060310 0x7f5bc0108f00 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f5bbc009990 tx=0x7f5bbc009b30).stop 2023-10-18T21:59:56.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.256+0000 7f5bc6939700 1 -- 172.21.15.8:0/1058586111 shutdown_connections 2023-10-18T21:59:56.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.256+0000 7f5bc6939700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5bac060f70 0x7f5bac063430 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.256+0000 7f5bc6939700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bc0060310 0x7f5bc0108f00 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.256+0000 7f5bc6939700 1 --2- 172.21.15.8:0/1058586111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00f95f0 0x7f5bc01093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.257+0000 7f5bc6939700 1 -- 172.21.15.8:0/1058586111 >> 172.21.15.8:0/1058586111 conn(0x7f5bc00f0ad0 msgr2=0x7f5bc00f9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.257+0000 7f5bc6939700 1 -- 172.21.15.8:0/1058586111 shutdown_connections 2023-10-18T21:59:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.257+0000 7f5bc6939700 1 -- 172.21.15.8:0/1058586111 wait complete. 2023-10-18T21:59:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T21:59:56.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.394+0000 7fabcb59e700 1 -- 172.21.15.8:0/2231279751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabcc0f77d0 msgr2=0x7fabcc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:56.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.394+0000 7fabcb59e700 1 --2- 172.21.15.8:0/2231279751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabcc0f77d0 0x7fabcc0f7c30 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fabc0004660 tx=0x7fabc0009b30).stop 2023-10-18T21:59:56.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.394+0000 7fabcb59e700 1 -- 172.21.15.8:0/2231279751 shutdown_connections 2023-10-18T21:59:56.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.394+0000 7fabcb59e700 1 --2- 172.21.15.8:0/2231279751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabcc0f77d0 0x7fabcc0f7c30 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.394+0000 7fabcb59e700 1 --2- 172.21.15.8:0/2231279751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabcc0f6530 0x7fabcc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.394+0000 7fabcb59e700 1 -- 172.21.15.8:0/2231279751 >> 172.21.15.8:0/2231279751 conn(0x7fabcc0f1c90 msgr2=0x7fabcc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:56.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.394+0000 7fabcb59e700 1 -- 172.21.15.8:0/2231279751 shutdown_connections 2023-10-18T21:59:56.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.395+0000 7fabcb59e700 1 -- 172.21.15.8:0/2231279751 wait complete. 2023-10-18T21:59:56.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.396+0000 7fabcb59e700 1 Processor -- start 2023-10-18T21:59:56.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.396+0000 7fabcb59e700 1 -- start start 2023-10-18T21:59:56.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.396+0000 7fabcb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabcc0f6530 0x7fabcc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:56.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.396+0000 7fabcb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabcc0f77d0 0x7fabcc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:56.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.396+0000 7fabcb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc107880 con 0x7fabcc0f6530 2023-10-18T21:59:56.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.396+0000 7fabcb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1080c0 con 0x7fabcc0f77d0 2023-10-18T21:59:56.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.397+0000 7fabca59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabcc0f6530 0x7fabcc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:56.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.397+0000 7fabca59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabcc0f6530 0x7fabcc106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60670/0 (socket says 172.21.15.8:60670) 2023-10-18T21:59:56.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.397+0000 7fabca59c700 1 -- 172.21.15.8:0/1921552371 learned_addr learned my addr 172.21.15.8:0/1921552371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T21:59:56.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.397+0000 7fabc9d9b700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabcc0f77d0 0x7fabcc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:56.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.397+0000 7fabca59c700 1 -- 172.21.15.8:0/1921552371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabcc0f77d0 msgr2=0x7fabcc107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:56.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.397+0000 7fabca59c700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabcc0f77d0 0x7fabcc107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.397+0000 7fabca59c700 1 -- 172.21.15.8:0/1921552371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc0005040 con 0x7fabcc0f6530 2023-10-18T21:59:56.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.397+0000 7fabc9d9b700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabcc0f77d0 0x7fabcc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T21:59:56.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.397+0000 7fabca59c700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabcc0f6530 0x7fabcc106d90 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fabbc002700 tx=0x7fabbc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:56.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.398+0000 7fabbaffd700 1 -- 172.21.15.8:0/1921552371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabbc009320 con 0x7fabcc0f6530 2023-10-18T21:59:56.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.398+0000 7fabbaffd700 1 -- 172.21.15.8:0/1921552371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fabbc00f040 con 0x7fabcc0f6530 2023-10-18T21:59:56.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.398+0000 7fabcb59e700 1 -- 172.21.15.8:0/1921552371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabcc1083a0 con 0x7fabcc0f6530 2023-10-18T21:59:56.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.398+0000 7fabbaffd700 1 -- 172.21.15.8:0/1921552371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabbc014970 con 0x7fabcc0f6530 2023-10-18T21:59:56.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.398+0000 7fabcb59e700 1 -- 172.21.15.8:0/1921552371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc1088e0 con 0x7fabcc0f6530 2023-10-18T21:59:56.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.399+0000 7fabcb59e700 1 -- 172.21.15.8:0/1921552371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabcc059100 con 0x7fabcc0f6530 2023-10-18T21:59:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.400+0000 7fabbaffd700 1 -- 172.21.15.8:0/1921552371 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fabbc009480 con 0x7fabcc0f6530 2023-10-18T21:59:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.400+0000 7fabbaffd700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fabb4060f70 0x7fabb4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T21:59:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.401+0000 7fabbaffd700 1 -- 172.21.15.8:0/1921552371 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fabbc07cad0 con 0x7fabcc0f6530 2023-10-18T21:59:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.401+0000 7fabc9d9b700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fabb4060f70 0x7fabb4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T21:59:56.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.401+0000 7fabc9d9b700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fabb4060f70 0x7fabb4063430 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fabc0009d60 tx=0x7fabc0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T21:59:56.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.405+0000 7fabbaffd700 1 -- 172.21.15.8:0/1921552371 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fabbc04c7c0 con 0x7fabcc0f6530 2023-10-18T21:59:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:54.465707+0000 mgr.smithi008.flmjzp (mgr.14640) 3660 : cluster [DBG] pgmap v2516: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:54.767211+0000 mgr.smithi008.flmjzp (mgr.14640) 3661 : audit [DBG] from='client.37000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:55.119519+0000 mgr.smithi008.flmjzp (mgr.14640) 3662 : audit [DBG] from='client.37004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:55.874352+0000 mon.smithi008 (mon.0) 4005 : audit [DBG] from='client.? 172.21.15.8:0/4228656107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:54.465707+0000 mgr.smithi008.flmjzp (mgr.14640) 3660 : cluster [DBG] pgmap v2516: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:54.767211+0000 mgr.smithi008.flmjzp (mgr.14640) 3661 : audit [DBG] from='client.37000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:55.119519+0000 mgr.smithi008.flmjzp (mgr.14640) 3662 : audit [DBG] from='client.37004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:55.874352+0000 mon.smithi008 (mon.0) 4005 : audit [DBG] from='client.? 172.21.15.8:0/4228656107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T21:59:56.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.603+0000 7fabcb59e700 1 -- 172.21.15.8:0/1921552371 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fabcc0fee70 con 0x7fabb4060f70 2023-10-18T21:59:56.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.604+0000 7fabbaffd700 1 -- 172.21.15.8:0/1921552371 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fabc0013410 con 0x7fabb4060f70 2023-10-18T21:59:56.606 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T21:59:56.607 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T21:59:56.607 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T21:59:56.607 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T21:59:56.607 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T21:59:56.607 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T21:59:56.608 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T21:59:56.608 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T21:59:56.608 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T21:59:56.608 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T21:59:56.608 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T21:59:56.609 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T21:59:56.609 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T21:59:56.609 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T21:59:56.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 -- 172.21.15.8:0/1921552371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fabb4060f70 msgr2=0x7fabb4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:56.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fabb4060f70 0x7fabb4063430 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fabc0009d60 tx=0x7fabc0009b30).stop 2023-10-18T21:59:56.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 -- 172.21.15.8:0/1921552371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabcc0f6530 msgr2=0x7fabcc106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T21:59:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabcc0f6530 0x7fabcc106d90 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fabbc002700 tx=0x7fabbc009d80).stop 2023-10-18T21:59:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 -- 172.21.15.8:0/1921552371 shutdown_connections 2023-10-18T21:59:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fabb4060f70 0x7fabb4063430 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabcc0f6530 0x7fabcc106d90 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 --2- 172.21.15.8:0/1921552371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabcc0f77d0 0x7fabcc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T21:59:56.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 -- 172.21.15.8:0/1921552371 >> 172.21.15.8:0/1921552371 conn(0x7fabcc0f1c90 msgr2=0x7fabcc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T21:59:56.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 -- 172.21.15.8:0/1921552371 shutdown_connections 2023-10-18T21:59:56.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T21:59:56.606+0000 7fabcb59e700 1 -- 172.21.15.8:0/1921552371 wait complete. 2023-10-18T21:59:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:55.461124+0000 mgr.smithi008.flmjzp (mgr.14640) 3663 : audit [DBG] from='client.37008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:56.256272+0000 mon.smithi008 (mon.0) 4006 : audit [DBG] from='client.? 172.21.15.8:0/1058586111' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:59:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:55.461124+0000 mgr.smithi008.flmjzp (mgr.14640) 3663 : audit [DBG] from='client.37008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:56.256272+0000 mon.smithi008 (mon.0) 4006 : audit [DBG] from='client.? 172.21.15.8:0/1058586111' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T21:59:58.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:56.466209+0000 mgr.smithi008.flmjzp (mgr.14640) 3664 : cluster [DBG] pgmap v2517: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 21:59:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T21:59:56.605385+0000 mgr.smithi008.flmjzp (mgr.14640) 3665 : audit [DBG] from='client.37020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T21:59:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:56.466209+0000 mgr.smithi008.flmjzp (mgr.14640) 3664 : cluster [DBG] pgmap v2517: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T21:59:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 21:59:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T21:59:56.605385+0000 mgr.smithi008.flmjzp (mgr.14640) 3665 : audit [DBG] from='client.37020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:00:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T21:59:58.466963+0000 mgr.smithi008.flmjzp (mgr.14640) 3666 : cluster [DBG] pgmap v2518: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:00.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:00.000164+0000 mon.smithi008 (mon.0) 4007 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T22:00:00.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T21:59:58.466963+0000 mgr.smithi008.flmjzp (mgr.14640) 3666 : cluster [DBG] pgmap v2518: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:00.000164+0000 mon.smithi008 (mon.0) 4007 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T22:00:02.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:00.467529+0000 mgr.smithi008.flmjzp (mgr.14640) 3667 : cluster [DBG] pgmap v2519: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:00.467529+0000 mgr.smithi008.flmjzp (mgr.14640) 3667 : cluster [DBG] pgmap v2519: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:03.038 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:02.497927+0000 mon.smithi008 (mon.0) 4008 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:03.038 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:02.500195+0000 mon.smithi008 (mon.0) 4009 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:03.038 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:02.501326+0000 mon.smithi008 (mon.0) 4010 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:03.039 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:02.507781+0000 mon.smithi008 (mon.0) 4011 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:03.039 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:02.514112+0000 mon.smithi008 (mon.0) 4012 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:03.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:02.517285+0000 mon.smithi008 (mon.0) 4013 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:03.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:02.519168+0000 mon.smithi008 (mon.0) 4014 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:03.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:02.520891+0000 mon.smithi008 (mon.0) 4015 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:03.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:02.522963+0000 mon.smithi008 (mon.0) 4016 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:03.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:02.497927+0000 mon.smithi008 (mon.0) 4008 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:03.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:02.500195+0000 mon.smithi008 (mon.0) 4009 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:03.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:02.501326+0000 mon.smithi008 (mon.0) 4010 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:03.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:02.507781+0000 mon.smithi008 (mon.0) 4011 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:03.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:02.514112+0000 mon.smithi008 (mon.0) 4012 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:03.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:02.517285+0000 mon.smithi008 (mon.0) 4013 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:03.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:02.519168+0000 mon.smithi008 (mon.0) 4014 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:03.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:02.520891+0000 mon.smithi008 (mon.0) 4015 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:03.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:02.522963+0000 mon.smithi008 (mon.0) 4016 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:02.468149+0000 mgr.smithi008.flmjzp (mgr.14640) 3668 : cluster [DBG] pgmap v2520: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:02.502283+0000 mgr.smithi008.flmjzp (mgr.14640) 3669 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:02.502863+0000 mgr.smithi008.flmjzp (mgr.14640) 3670 : cluster [DBG] pgmap v2521: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:02.503101+0000 mgr.smithi008.flmjzp (mgr.14640) 3671 : cluster [DBG] pgmap v2522: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:02.524943+0000 mgr.smithi008.flmjzp (mgr.14640) 3672 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:02.468149+0000 mgr.smithi008.flmjzp (mgr.14640) 3668 : cluster [DBG] pgmap v2520: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:02.502283+0000 mgr.smithi008.flmjzp (mgr.14640) 3669 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:02.502863+0000 mgr.smithi008.flmjzp (mgr.14640) 3670 : cluster [DBG] pgmap v2521: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:04.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:02.503101+0000 mgr.smithi008.flmjzp (mgr.14640) 3671 : cluster [DBG] pgmap v2522: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:04.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:02.524943+0000 mgr.smithi008.flmjzp (mgr.14640) 3672 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:04.503651+0000 mgr.smithi008.flmjzp (mgr.14640) 3673 : cluster [DBG] pgmap v2523: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:04.503651+0000 mgr.smithi008.flmjzp (mgr.14640) 3673 : cluster [DBG] pgmap v2523: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:08.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:06.504279+0000 mgr.smithi008.flmjzp (mgr.14640) 3674 : cluster [DBG] pgmap v2524: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:06.504279+0000 mgr.smithi008.flmjzp (mgr.14640) 3674 : cluster [DBG] pgmap v2524: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:08.504800+0000 mgr.smithi008.flmjzp (mgr.14640) 3675 : cluster [DBG] pgmap v2525: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:10.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:08.504800+0000 mgr.smithi008.flmjzp (mgr.14640) 3675 : cluster [DBG] pgmap v2525: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:10.505492+0000 mgr.smithi008.flmjzp (mgr.14640) 3676 : cluster [DBG] pgmap v2526: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:10.505492+0000 mgr.smithi008.flmjzp (mgr.14640) 3676 : cluster [DBG] pgmap v2526: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:12.535707+0000 mon.smithi008 (mon.0) 4017 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:12.537827+0000 mon.smithi008 (mon.0) 4018 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:12.538876+0000 mon.smithi008 (mon.0) 4019 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:12.545264+0000 mon.smithi008 (mon.0) 4020 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:12.551991+0000 mon.smithi008 (mon.0) 4021 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:12.555039+0000 mon.smithi008 (mon.0) 4022 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:12.556704+0000 mon.smithi008 (mon.0) 4023 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:12.558317+0000 mon.smithi008 (mon.0) 4024 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:13.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:12.560294+0000 mon.smithi008 (mon.0) 4025 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:12.535707+0000 mon.smithi008 (mon.0) 4017 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:12.537827+0000 mon.smithi008 (mon.0) 4018 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:12.538876+0000 mon.smithi008 (mon.0) 4019 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:13.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:12.545264+0000 mon.smithi008 (mon.0) 4020 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:13.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:12.551991+0000 mon.smithi008 (mon.0) 4021 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:13.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:12.555039+0000 mon.smithi008 (mon.0) 4022 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:13.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:12.556704+0000 mon.smithi008 (mon.0) 4023 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:13.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:12.558317+0000 mon.smithi008 (mon.0) 4024 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:13.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:12.560294+0000 mon.smithi008 (mon.0) 4025 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:14.337 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:12.506157+0000 mgr.smithi008.flmjzp (mgr.14640) 3677 : cluster [DBG] pgmap v2527: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:14.337 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:12.539791+0000 mgr.smithi008.flmjzp (mgr.14640) 3678 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:14.338 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:12.540359+0000 mgr.smithi008.flmjzp (mgr.14640) 3679 : cluster [DBG] pgmap v2528: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:14.338 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:12.540690+0000 mgr.smithi008.flmjzp (mgr.14640) 3680 : cluster [DBG] pgmap v2529: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:14.338 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:12.562206+0000 mgr.smithi008.flmjzp (mgr.14640) 3681 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:12.506157+0000 mgr.smithi008.flmjzp (mgr.14640) 3677 : cluster [DBG] pgmap v2527: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:12.539791+0000 mgr.smithi008.flmjzp (mgr.14640) 3678 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:12.540359+0000 mgr.smithi008.flmjzp (mgr.14640) 3679 : cluster [DBG] pgmap v2528: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:12.540690+0000 mgr.smithi008.flmjzp (mgr.14640) 3680 : cluster [DBG] pgmap v2529: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:12.562206+0000 mgr.smithi008.flmjzp (mgr.14640) 3681 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:14.541205+0000 mgr.smithi008.flmjzp (mgr.14640) 3682 : cluster [DBG] pgmap v2530: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:16.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:14.541205+0000 mgr.smithi008.flmjzp (mgr.14640) 3682 : cluster [DBG] pgmap v2530: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:18.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:16.541788+0000 mgr.smithi008.flmjzp (mgr.14640) 3683 : cluster [DBG] pgmap v2531: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:16.541788+0000 mgr.smithi008.flmjzp (mgr.14640) 3683 : cluster [DBG] pgmap v2531: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:18.542337+0000 mgr.smithi008.flmjzp (mgr.14640) 3684 : cluster [DBG] pgmap v2532: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:20.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:18.542337+0000 mgr.smithi008.flmjzp (mgr.14640) 3684 : cluster [DBG] pgmap v2532: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:22.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:20.542894+0000 mgr.smithi008.flmjzp (mgr.14640) 3685 : cluster [DBG] pgmap v2533: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:20.542894+0000 mgr.smithi008.flmjzp (mgr.14640) 3685 : cluster [DBG] pgmap v2533: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:23.088 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:22.572984+0000 mon.smithi008 (mon.0) 4026 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:23.088 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:22.575097+0000 mon.smithi008 (mon.0) 4027 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:23.088 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:22.576131+0000 mon.smithi008 (mon.0) 4028 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:23.089 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:22.582553+0000 mon.smithi008 (mon.0) 4029 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:23.089 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:22.589682+0000 mon.smithi008 (mon.0) 4030 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:23.089 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:22.592751+0000 mon.smithi008 (mon.0) 4031 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:23.089 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:22.594473+0000 mon.smithi008 (mon.0) 4032 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:22.572984+0000 mon.smithi008 (mon.0) 4026 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:22.575097+0000 mon.smithi008 (mon.0) 4027 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:22.576131+0000 mon.smithi008 (mon.0) 4028 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:22.582553+0000 mon.smithi008 (mon.0) 4029 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:22.589682+0000 mon.smithi008 (mon.0) 4030 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:22.592751+0000 mon.smithi008 (mon.0) 4031 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:22.594473+0000 mon.smithi008 (mon.0) 4032 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:22.596070+0000 mon.smithi008 (mon.0) 4033 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:23.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:22.598119+0000 mon.smithi008 (mon.0) 4034 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:22.596070+0000 mon.smithi008 (mon.0) 4033 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:22.598119+0000 mon.smithi008 (mon.0) 4034 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:24.337 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:22.543564+0000 mgr.smithi008.flmjzp (mgr.14640) 3686 : cluster [DBG] pgmap v2534: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:24.338 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:22.577047+0000 mgr.smithi008.flmjzp (mgr.14640) 3687 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:24.338 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:22.577597+0000 mgr.smithi008.flmjzp (mgr.14640) 3688 : cluster [DBG] pgmap v2535: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:24.338 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:22.577863+0000 mgr.smithi008.flmjzp (mgr.14640) 3689 : cluster [DBG] pgmap v2536: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:24.338 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:22.600069+0000 mgr.smithi008.flmjzp (mgr.14640) 3690 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:22.543564+0000 mgr.smithi008.flmjzp (mgr.14640) 3686 : cluster [DBG] pgmap v2534: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:22.577047+0000 mgr.smithi008.flmjzp (mgr.14640) 3687 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:22.577597+0000 mgr.smithi008.flmjzp (mgr.14640) 3688 : cluster [DBG] pgmap v2535: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:24.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:22.577863+0000 mgr.smithi008.flmjzp (mgr.14640) 3689 : cluster [DBG] pgmap v2536: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:24.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:22.600069+0000 mgr.smithi008.flmjzp (mgr.14640) 3690 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:24.578493+0000 mgr.smithi008.flmjzp (mgr.14640) 3691 : cluster [DBG] pgmap v2537: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:24.578493+0000 mgr.smithi008.flmjzp (mgr.14640) 3691 : cluster [DBG] pgmap v2537: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:26.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.760+0000 7f492224b700 1 -- 172.21.15.8:0/3923263382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f491c0f6530 msgr2=0x7f491c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:26.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.760+0000 7f492224b700 1 --2- 172.21.15.8:0/3923263382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f491c0f6530 0x7f491c0f6950 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f4918004660 tx=0x7f4918009b30).stop 2023-10-18T22:00:26.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.760+0000 7f492224b700 1 -- 172.21.15.8:0/3923263382 shutdown_connections 2023-10-18T22:00:26.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.760+0000 7f492224b700 1 --2- 172.21.15.8:0/3923263382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491c0f77d0 0x7f491c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:26.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.760+0000 7f492224b700 1 --2- 172.21.15.8:0/3923263382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f491c0f6530 0x7f491c0f6950 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:26.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.760+0000 7f492224b700 1 -- 172.21.15.8:0/3923263382 >> 172.21.15.8:0/3923263382 conn(0x7f491c0f1c90 msgr2=0x7f491c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:26.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.760+0000 7f492224b700 1 -- 172.21.15.8:0/3923263382 shutdown_connections 2023-10-18T22:00:26.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.761+0000 7f492224b700 1 -- 172.21.15.8:0/3923263382 wait complete. 2023-10-18T22:00:26.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.761+0000 7f492224b700 1 Processor -- start 2023-10-18T22:00:26.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.762+0000 7f492224b700 1 -- start start 2023-10-18T22:00:26.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.762+0000 7f492224b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491c0f6530 0x7f491c108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:26.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.762+0000 7f492224b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f491c0f77d0 0x7f491c1094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:26.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.762+0000 7f492224b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c109a50 con 0x7f491c0f77d0 2023-10-18T22:00:26.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.762+0000 7f492224b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c109b90 con 0x7f491c0f6530 2023-10-18T22:00:26.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.762+0000 7f4920a48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f491c0f77d0 0x7f491c1094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:26.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.762+0000 7f4920a48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f491c0f77d0 0x7f491c1094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56600/0 (socket says 172.21.15.8:56600) 2023-10-18T22:00:26.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.762+0000 7f4920a48700 1 -- 172.21.15.8:0/3795125762 learned_addr learned my addr 172.21.15.8:0/3795125762 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:00:26.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.763+0000 7f4921249700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491c0f6530 0x7f491c108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:26.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.763+0000 7f4920a48700 1 -- 172.21.15.8:0/3795125762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491c0f6530 msgr2=0x7f491c108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:26.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.763+0000 7f4920a48700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491c0f6530 0x7f491c108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:26.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.763+0000 7f4920a48700 1 -- 172.21.15.8:0/3795125762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4918005040 con 0x7f491c0f77d0 2023-10-18T22:00:26.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.763+0000 7f4920a48700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f491c0f77d0 0x7f491c1094a0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f490c00c790 tx=0x7f490c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:26.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.763+0000 7f4911ffb700 1 -- 172.21.15.8:0/3795125762 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f490c002590 con 0x7f491c0f77d0 2023-10-18T22:00:26.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.763+0000 7f4911ffb700 1 -- 172.21.15.8:0/3795125762 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f490c002bb0 con 0x7f491c0f77d0 2023-10-18T22:00:26.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.763+0000 7f492224b700 1 -- 172.21.15.8:0/3795125762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c10a530 con 0x7f491c0f77d0 2023-10-18T22:00:26.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.763+0000 7f4911ffb700 1 -- 172.21.15.8:0/3795125762 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f490c013e10 con 0x7f491c0f77d0 2023-10-18T22:00:26.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.763+0000 7f492224b700 1 -- 172.21.15.8:0/3795125762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c10aaf0 con 0x7f491c0f77d0 2023-10-18T22:00:26.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.764+0000 7f492224b700 1 -- 172.21.15.8:0/3795125762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c045ad0 con 0x7f491c0f77d0 2023-10-18T22:00:26.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.765+0000 7f4911ffb700 1 -- 172.21.15.8:0/3795125762 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f490c01a060 con 0x7f491c0f77d0 2023-10-18T22:00:26.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.766+0000 7f4911ffb700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4908060f70 0x7f4908063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:26.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.766+0000 7f4911ffb700 1 -- 172.21.15.8:0/3795125762 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f490c07cbe0 con 0x7f491c0f77d0 2023-10-18T22:00:26.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.766+0000 7f4921249700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4908060f70 0x7f4908063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:26.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.767+0000 7f4921249700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4908060f70 0x7f4908063430 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f4918004630 tx=0x7f4918009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:26.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.771+0000 7f4911ffb700 1 -- 172.21.15.8:0/3795125762 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f490c050240 con 0x7f491c0f77d0 2023-10-18T22:00:26.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.972+0000 7f492224b700 1 -- 172.21.15.8:0/3795125762 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f491c0fee30 con 0x7f4908060f70 2023-10-18T22:00:26.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.974+0000 7f4911ffb700 1 -- 172.21.15.8:0/3795125762 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f491c0fee30 con 0x7f4908060f70 2023-10-18T22:00:26.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 -- 172.21.15.8:0/3795125762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4908060f70 msgr2=0x7f4908063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:26.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4908060f70 0x7f4908063430 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f4918004630 tx=0x7f4918009b30).stop 2023-10-18T22:00:26.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 -- 172.21.15.8:0/3795125762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f491c0f77d0 msgr2=0x7f491c1094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:26.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f491c0f77d0 0x7f491c1094a0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f490c00c790 tx=0x7f490c007d70).stop 2023-10-18T22:00:26.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 -- 172.21.15.8:0/3795125762 shutdown_connections 2023-10-18T22:00:26.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4908060f70 0x7f4908063430 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:26.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491c0f6530 0x7f491c108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:26.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 --2- 172.21.15.8:0/3795125762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f491c0f77d0 0x7f491c1094a0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 -- 172.21.15.8:0/3795125762 >> 172.21.15.8:0/3795125762 conn(0x7f491c0f1c90 msgr2=0x7f491c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 -- 172.21.15.8:0/3795125762 shutdown_connections 2023-10-18T22:00:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:26.976+0000 7f492224b700 1 -- 172.21.15.8:0/3795125762 wait complete. 2023-10-18T22:00:26.992 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:00:27.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.120+0000 7f713da5e700 1 -- 172.21.15.8:0/3108018131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71380f6530 msgr2=0x7f71380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:27.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.120+0000 7f713da5e700 1 --2- 172.21.15.8:0/3108018131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71380f6530 0x7f71380f6950 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f712c004660 tx=0x7f712c009b30).stop 2023-10-18T22:00:27.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.120+0000 7f713da5e700 1 -- 172.21.15.8:0/3108018131 shutdown_connections 2023-10-18T22:00:27.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.120+0000 7f713da5e700 1 --2- 172.21.15.8:0/3108018131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71380f77d0 0x7f71380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.120+0000 7f713da5e700 1 --2- 172.21.15.8:0/3108018131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71380f6530 0x7f71380f6950 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.120+0000 7f713da5e700 1 -- 172.21.15.8:0/3108018131 >> 172.21.15.8:0/3108018131 conn(0x7f71380f1c90 msgr2=0x7f71380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:27.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.120+0000 7f713da5e700 1 -- 172.21.15.8:0/3108018131 shutdown_connections 2023-10-18T22:00:27.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.120+0000 7f713da5e700 1 -- 172.21.15.8:0/3108018131 wait complete. 2023-10-18T22:00:27.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.121+0000 7f713da5e700 1 Processor -- start 2023-10-18T22:00:27.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.121+0000 7f713da5e700 1 -- start start 2023-10-18T22:00:27.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.121+0000 7f713da5e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71380f6530 0x7f7138108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:27.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f713da5e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71380f77d0 0x7f71381094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:27.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f713da5e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7138109a70 con 0x7f71380f6530 2023-10-18T22:00:27.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f713da5e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7138109bb0 con 0x7f71380f77d0 2023-10-18T22:00:27.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f713ca5c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71380f6530 0x7f7138108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:27.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f713ca5c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71380f6530 0x7f7138108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53614/0 (socket says 172.21.15.8:53614) 2023-10-18T22:00:27.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f713ca5c700 1 -- 172.21.15.8:0/748901656 learned_addr learned my addr 172.21.15.8:0/748901656 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:00:27.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f7137fff700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71380f77d0 0x7f71381094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:27.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f713ca5c700 1 -- 172.21.15.8:0/748901656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71380f77d0 msgr2=0x7f71381094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:27.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f713ca5c700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71380f77d0 0x7f71381094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f713ca5c700 1 -- 172.21.15.8:0/748901656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c005040 con 0x7f71380f6530 2023-10-18T22:00:27.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.122+0000 7f713ca5c700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71380f6530 0x7f7138108fd0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f712c004e30 tx=0x7f712c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:27.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.123+0000 7f71357fa700 1 -- 172.21.15.8:0/748901656 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f712c018070 con 0x7f71380f6530 2023-10-18T22:00:27.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.123+0000 7f71357fa700 1 -- 172.21.15.8:0/748901656 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f712c009630 con 0x7f71380f6530 2023-10-18T22:00:27.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.123+0000 7f713da5e700 1 -- 172.21.15.8:0/748901656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713810a4f0 con 0x7f71380f6530 2023-10-18T22:00:27.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.123+0000 7f71357fa700 1 -- 172.21.15.8:0/748901656 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f712c01c3c0 con 0x7f71380f6530 2023-10-18T22:00:27.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.123+0000 7f713da5e700 1 -- 172.21.15.8:0/748901656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713810aa50 con 0x7f71380f6530 2023-10-18T22:00:27.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.124+0000 7f713da5e700 1 -- 172.21.15.8:0/748901656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7138045ad0 con 0x7f71380f6530 2023-10-18T22:00:27.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.125+0000 7f71357fa700 1 -- 172.21.15.8:0/748901656 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f712c01d420 con 0x7f71380f6530 2023-10-18T22:00:27.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.126+0000 7f71357fa700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7128060f70 0x7f7128063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:27.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.126+0000 7f71357fa700 1 -- 172.21.15.8:0/748901656 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f712c07e480 con 0x7f71380f6530 2023-10-18T22:00:27.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.126+0000 7f7137fff700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7128060f70 0x7f7128063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:27.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.127+0000 7f7137fff700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7128060f70 0x7f7128063430 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f71240096c0 tx=0x7f7124009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:27.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.131+0000 7f71357fa700 1 -- 172.21.15.8:0/748901656 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f712c051c50 con 0x7f71380f6530 2023-10-18T22:00:27.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.327+0000 7f713da5e700 1 -- 172.21.15.8:0/748901656 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71380fed30 con 0x7f7128060f70 2023-10-18T22:00:27.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.328+0000 7f71357fa700 1 -- 172.21.15.8:0/748901656 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f71380fed30 con 0x7f7128060f70 2023-10-18T22:00:27.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.330+0000 7f713da5e700 1 -- 172.21.15.8:0/748901656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7128060f70 msgr2=0x7f7128063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:27.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.330+0000 7f713da5e700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7128060f70 0x7f7128063430 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f71240096c0 tx=0x7f7124009be0).stop 2023-10-18T22:00:27.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.330+0000 7f713da5e700 1 -- 172.21.15.8:0/748901656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71380f6530 msgr2=0x7f7138108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:27.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.330+0000 7f713da5e700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71380f6530 0x7f7138108fd0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f712c004e30 tx=0x7f712c009b30).stop 2023-10-18T22:00:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.331+0000 7f713da5e700 1 -- 172.21.15.8:0/748901656 shutdown_connections 2023-10-18T22:00:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.331+0000 7f713da5e700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7128060f70 0x7f7128063430 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.331+0000 7f713da5e700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71380f6530 0x7f7138108fd0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.331+0000 7f713da5e700 1 --2- 172.21.15.8:0/748901656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71380f77d0 0x7f71381094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.331+0000 7f713da5e700 1 -- 172.21.15.8:0/748901656 >> 172.21.15.8:0/748901656 conn(0x7f71380f1c90 msgr2=0x7f713806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.331+0000 7f713da5e700 1 -- 172.21.15.8:0/748901656 shutdown_connections 2023-10-18T22:00:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.331+0000 7f713da5e700 1 -- 172.21.15.8:0/748901656 wait complete. 2023-10-18T22:00:27.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.468+0000 7fe74f0b5700 1 -- 172.21.15.8:0/2409686683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7480f6530 msgr2=0x7fe7480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:27.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.468+0000 7fe74f0b5700 1 --2- 172.21.15.8:0/2409686683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7480f6530 0x7fe7480f6950 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7fe744004660 tx=0x7fe744009b30).stop 2023-10-18T22:00:27.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.468+0000 7fe74f0b5700 1 -- 172.21.15.8:0/2409686683 shutdown_connections 2023-10-18T22:00:27.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.468+0000 7fe74f0b5700 1 --2- 172.21.15.8:0/2409686683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7480f77d0 0x7fe7480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.468+0000 7fe74f0b5700 1 --2- 172.21.15.8:0/2409686683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7480f6530 0x7fe7480f6950 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.468+0000 7fe74f0b5700 1 -- 172.21.15.8:0/2409686683 >> 172.21.15.8:0/2409686683 conn(0x7fe7480f1c90 msgr2=0x7fe7480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:27.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.468+0000 7fe74f0b5700 1 -- 172.21.15.8:0/2409686683 shutdown_connections 2023-10-18T22:00:27.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.468+0000 7fe74f0b5700 1 -- 172.21.15.8:0/2409686683 wait complete. 2023-10-18T22:00:27.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.469+0000 7fe74f0b5700 1 Processor -- start 2023-10-18T22:00:27.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.469+0000 7fe74f0b5700 1 -- start start 2023-10-18T22:00:27.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74f0b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7480f6530 0x7fe748106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:27.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74f0b5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7480f77d0 0x7fe748107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:27.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74f0b5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe748107880 con 0x7fe7480f77d0 2023-10-18T22:00:27.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74f0b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7481080c0 con 0x7fe7480f6530 2023-10-18T22:00:27.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74d8b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7480f77d0 0x7fe748107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:27.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74d8b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7480f77d0 0x7fe748107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53640/0 (socket says 172.21.15.8:53640) 2023-10-18T22:00:27.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74d8b2700 1 -- 172.21.15.8:0/4014894158 learned_addr learned my addr 172.21.15.8:0/4014894158 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:00:27.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74e0b3700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7480f6530 0x7fe748106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:27.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74d8b2700 1 -- 172.21.15.8:0/4014894158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7480f6530 msgr2=0x7fe748106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:27.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74d8b2700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7480f6530 0x7fe748106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.470+0000 7fe74d8b2700 1 -- 172.21.15.8:0/4014894158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744005040 con 0x7fe7480f77d0 2023-10-18T22:00:27.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.471+0000 7fe74d8b2700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7480f77d0 0x7fe748107280 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7fe738002700 tx=0x7fe738009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:27.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.471+0000 7fe73effd700 1 -- 172.21.15.8:0/4014894158 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe738009320 con 0x7fe7480f77d0 2023-10-18T22:00:27.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.471+0000 7fe73effd700 1 -- 172.21.15.8:0/4014894158 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe73800f040 con 0x7fe7480f77d0 2023-10-18T22:00:27.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.471+0000 7fe74f0b5700 1 -- 172.21.15.8:0/4014894158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7481083a0 con 0x7fe7480f77d0 2023-10-18T22:00:27.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.471+0000 7fe73effd700 1 -- 172.21.15.8:0/4014894158 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7380148f0 con 0x7fe7480f77d0 2023-10-18T22:00:27.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.471+0000 7fe74f0b5700 1 -- 172.21.15.8:0/4014894158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7481088e0 con 0x7fe7480f77d0 2023-10-18T22:00:27.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.472+0000 7fe74f0b5700 1 -- 172.21.15.8:0/4014894158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe748059100 con 0x7fe7480f77d0 2023-10-18T22:00:27.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.473+0000 7fe73effd700 1 -- 172.21.15.8:0/4014894158 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe738009480 con 0x7fe7480f77d0 2023-10-18T22:00:27.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.474+0000 7fe73effd700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe734060f70 0x7fe734063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:27.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.474+0000 7fe73effd700 1 -- 172.21.15.8:0/4014894158 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe73807cb80 con 0x7fe7480f77d0 2023-10-18T22:00:27.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.474+0000 7fe74e0b3700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe734060f70 0x7fe734063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:27.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.475+0000 7fe74e0b3700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe734060f70 0x7fe734063430 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fe744005010 tx=0x7fe744009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.478+0000 7fe73effd700 1 -- 172.21.15.8:0/4014894158 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe73804c7b0 con 0x7fe7480f77d0 2023-10-18T22:00:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.669+0000 7fe74f0b5700 1 -- 172.21.15.8:0/4014894158 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7480fee50 con 0x7fe734060f70 2023-10-18T22:00:27.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.679+0000 7fe73effd700 1 -- 172.21.15.8:0/4014894158 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe7480fee50 con 0x7fe734060f70 2023-10-18T22:00:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:00:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (67m) 4m ago 68m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:00:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (61m) 4m ago 68m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:00:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (60m) 2m ago 67m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:00:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (67m) 4m ago 68m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:00:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 64m - - 2023-10-18T22:00:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 64m - - 2023-10-18T22:00:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 64m - - 2023-10-18T22:00:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 64m - - 2023-10-18T22:00:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (62m) 4m ago 69m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:00:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (61m) 2m ago 67m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:00:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (61m) 4m ago 70m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:00:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (61m) 2m ago 67m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:00:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (68m) 4m ago 68m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:00:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (67m) 2m ago 67m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:00:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (60m) 4m ago 67m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:00:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (58m) 4m ago 66m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:00:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (58m) 4m ago 66m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:00:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (57m) 2m ago 66m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:00:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (57m) 2m ago 66m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:00:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (56m) 2m ago 65m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:00:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (62m) 4m ago 67m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:00:27.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 -- 172.21.15.8:0/4014894158 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe734060f70 msgr2=0x7fe734063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:27.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe734060f70 0x7fe734063430 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fe744005010 tx=0x7fe744009b30).stop 2023-10-18T22:00:27.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 -- 172.21.15.8:0/4014894158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7480f77d0 msgr2=0x7fe748107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:27.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7480f77d0 0x7fe748107280 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7fe738002700 tx=0x7fe738009e00).stop 2023-10-18T22:00:27.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 -- 172.21.15.8:0/4014894158 shutdown_connections 2023-10-18T22:00:27.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe734060f70 0x7fe734063430 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7480f6530 0x7fe748106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 --2- 172.21.15.8:0/4014894158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7480f77d0 0x7fe748107280 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 -- 172.21.15.8:0/4014894158 >> 172.21.15.8:0/4014894158 conn(0x7fe7480f1c90 msgr2=0x7fe7480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:27.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 -- 172.21.15.8:0/4014894158 shutdown_connections 2023-10-18T22:00:27.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.681+0000 7fe74f0b5700 1 -- 172.21.15.8:0/4014894158 wait complete. 2023-10-18T22:00:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.817+0000 7f107b59e700 1 -- 172.21.15.8:0/1091254864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107c0f77d0 msgr2=0x7f107c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.817+0000 7f107b59e700 1 --2- 172.21.15.8:0/1091254864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107c0f77d0 0x7f107c0f7c30 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f1070004660 tx=0x7f1070009b30).stop 2023-10-18T22:00:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.817+0000 7f107b59e700 1 -- 172.21.15.8:0/1091254864 shutdown_connections 2023-10-18T22:00:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.817+0000 7f107b59e700 1 --2- 172.21.15.8:0/1091254864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107c0f77d0 0x7f107c0f7c30 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.817+0000 7f107b59e700 1 --2- 172.21.15.8:0/1091254864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f107c0f6530 0x7f107c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.817+0000 7f107b59e700 1 -- 172.21.15.8:0/1091254864 >> 172.21.15.8:0/1091254864 conn(0x7f107c0f1c90 msgr2=0x7f107c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:27.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.817+0000 7f107b59e700 1 -- 172.21.15.8:0/1091254864 shutdown_connections 2023-10-18T22:00:27.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.817+0000 7f107b59e700 1 -- 172.21.15.8:0/1091254864 wait complete. 2023-10-18T22:00:27.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.818+0000 7f107b59e700 1 Processor -- start 2023-10-18T22:00:27.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.819+0000 7f107b59e700 1 -- start start 2023-10-18T22:00:27.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.819+0000 7f107b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f107c0f6530 0x7f107c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:27.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.819+0000 7f107b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107c0f77d0 0x7f107c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:27.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.819+0000 7f107b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c107880 con 0x7f107c0f77d0 2023-10-18T22:00:27.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.819+0000 7f107b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c1080c0 con 0x7f107c0f6530 2023-10-18T22:00:27.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f1079d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107c0f77d0 0x7f107c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:27.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f1079d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107c0f77d0 0x7f107c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53660/0 (socket says 172.21.15.8:53660) 2023-10-18T22:00:27.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f1079d9b700 1 -- 172.21.15.8:0/1188769520 learned_addr learned my addr 172.21.15.8:0/1188769520 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:00:27.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f107a59c700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f107c0f6530 0x7f107c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:27.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f1079d9b700 1 -- 172.21.15.8:0/1188769520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f107c0f6530 msgr2=0x7f107c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:27.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f1079d9b700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f107c0f6530 0x7f107c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:27.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f1079d9b700 1 -- 172.21.15.8:0/1188769520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070005040 con 0x7f107c0f77d0 2023-10-18T22:00:27.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f1079d9b700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107c0f77d0 0x7f107c107280 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f1070009990 tx=0x7f1070009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:27.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f106affd700 1 -- 172.21.15.8:0/1188769520 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1070018070 con 0x7f107c0f77d0 2023-10-18T22:00:27.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f106affd700 1 -- 172.21.15.8:0/1188769520 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1070009630 con 0x7f107c0f77d0 2023-10-18T22:00:27.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f107b59e700 1 -- 172.21.15.8:0/1188769520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107c108340 con 0x7f107c0f77d0 2023-10-18T22:00:27.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.820+0000 7f106affd700 1 -- 172.21.15.8:0/1188769520 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f107001c400 con 0x7f107c0f77d0 2023-10-18T22:00:27.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.821+0000 7f107b59e700 1 -- 172.21.15.8:0/1188769520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c108820 con 0x7f107c0f77d0 2023-10-18T22:00:27.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.822+0000 7f107b59e700 1 -- 172.21.15.8:0/1188769520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107c059100 con 0x7f107c0f77d0 2023-10-18T22:00:27.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.822+0000 7f106affd700 1 -- 172.21.15.8:0/1188769520 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f107001d9e0 con 0x7f107c0f77d0 2023-10-18T22:00:27.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.824+0000 7f106affd700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1064060f70 0x7f1064063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:27.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.824+0000 7f106affd700 1 -- 172.21.15.8:0/1188769520 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f107007e740 con 0x7f107c0f77d0 2023-10-18T22:00:27.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.824+0000 7f107a59c700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1064060f70 0x7f1064063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:27.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.824+0000 7f107a59c700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1064060f70 0x7f1064063430 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f107c107b50 tx=0x7f106c009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:27.828+0000 7f106affd700 1 -- 172.21.15.8:0/1188769520 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f107004e2f0 con 0x7f107c0f77d0 2023-10-18T22:00:28.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.088+0000 7f107b59e700 1 -- 172.21.15.8:0/1188769520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f107c027a00 con 0x7f107c0f77d0 2023-10-18T22:00:28.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.090+0000 7f106affd700 1 -- 172.21.15.8:0/1188769520 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f1070051910 con 0x7f107c0f77d0 2023-10-18T22:00:28.091 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:00:28.091 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:00:28.092 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:00:28.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:00:28.092 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:00:28.092 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:00:28.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:00:28.093 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:00:28.093 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:00:28.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:00:28.093 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:00:28.093 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:00:28.094 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:00:28.094 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:00:28.094 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:00:28.094 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:00:28.094 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:00:28.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 -- 172.21.15.8:0/1188769520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1064060f70 msgr2=0x7f1064063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:28.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1064060f70 0x7f1064063430 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f107c107b50 tx=0x7f106c009c00).stop 2023-10-18T22:00:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 -- 172.21.15.8:0/1188769520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107c0f77d0 msgr2=0x7f107c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107c0f77d0 0x7f107c107280 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f1070009990 tx=0x7f1070009b30).stop 2023-10-18T22:00:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 -- 172.21.15.8:0/1188769520 shutdown_connections 2023-10-18T22:00:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1064060f70 0x7f1064063430 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f107c0f6530 0x7f107c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 --2- 172.21.15.8:0/1188769520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107c0f77d0 0x7f107c107280 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 -- 172.21.15.8:0/1188769520 >> 172.21.15.8:0/1188769520 conn(0x7f107c0f1c90 msgr2=0x7f107c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 -- 172.21.15.8:0/1188769520 shutdown_connections 2023-10-18T22:00:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.092+0000 7f107b59e700 1 -- 172.21.15.8:0/1188769520 wait complete. 2023-10-18T22:00:28.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.229+0000 7f2510e18700 1 -- 172.21.15.8:0/1829909492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f250c0f6530 msgr2=0x7f250c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:28.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.229+0000 7f2510e18700 1 --2- 172.21.15.8:0/1829909492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f250c0f6530 0x7f250c0f6950 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f24fc004660 tx=0x7f24fc009b30).stop 2023-10-18T22:00:28.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.229+0000 7f2510e18700 1 -- 172.21.15.8:0/1829909492 shutdown_connections 2023-10-18T22:00:28.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.229+0000 7f2510e18700 1 --2- 172.21.15.8:0/1829909492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f250c0f77d0 0x7f250c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.229+0000 7f2510e18700 1 --2- 172.21.15.8:0/1829909492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f250c0f6530 0x7f250c0f6950 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.229+0000 7f2510e18700 1 -- 172.21.15.8:0/1829909492 >> 172.21.15.8:0/1829909492 conn(0x7f250c0f1c90 msgr2=0x7f250c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:28.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.229+0000 7f2510e18700 1 -- 172.21.15.8:0/1829909492 shutdown_connections 2023-10-18T22:00:28.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.229+0000 7f2510e18700 1 -- 172.21.15.8:0/1829909492 wait complete. 2023-10-18T22:00:28.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.230+0000 7f2510e18700 1 Processor -- start 2023-10-18T22:00:28.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.230+0000 7f2510e18700 1 -- start start 2023-10-18T22:00:28.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.230+0000 7f2510e18700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f250c0f6530 0x7f250c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:28.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.230+0000 7f2510e18700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f250c0f77d0 0x7f250c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:28.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.230+0000 7f2510e18700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c107880 con 0x7f250c0f77d0 2023-10-18T22:00:28.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.230+0000 7f2510e18700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c1080c0 con 0x7f250c0f6530 2023-10-18T22:00:28.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f250affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f250c0f77d0 0x7f250c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:28.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f250b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f250c0f6530 0x7f250c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:28.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f250affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f250c0f77d0 0x7f250c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53684/0 (socket says 172.21.15.8:53684) 2023-10-18T22:00:28.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f250affd700 1 -- 172.21.15.8:0/4094620735 learned_addr learned my addr 172.21.15.8:0/4094620735 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:00:28.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f250affd700 1 -- 172.21.15.8:0/4094620735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f250c0f6530 msgr2=0x7f250c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:28.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f250affd700 1 --2- 172.21.15.8:0/4094620735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f250c0f6530 0x7f250c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f250affd700 1 -- 172.21.15.8:0/4094620735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc005040 con 0x7f250c0f77d0 2023-10-18T22:00:28.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f250affd700 1 --2- 172.21.15.8:0/4094620735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f250c0f77d0 0x7f250c107280 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f250000e7f0 tx=0x7f250000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:28.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f24f3fff700 1 -- 172.21.15.8:0/4094620735 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25000092e0 con 0x7f250c0f77d0 2023-10-18T22:00:28.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f24f3fff700 1 -- 172.21.15.8:0/4094620735 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f250000f040 con 0x7f250c0f77d0 2023-10-18T22:00:28.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f24f3fff700 1 -- 172.21.15.8:0/4094620735 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25000147e0 con 0x7f250c0f77d0 2023-10-18T22:00:28.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.231+0000 7f2510e18700 1 -- 172.21.15.8:0/4094620735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c1083a0 con 0x7f250c0f77d0 2023-10-18T22:00:28.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.232+0000 7f2510e18700 1 -- 172.21.15.8:0/4094620735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c1088e0 con 0x7f250c0f77d0 2023-10-18T22:00:28.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.233+0000 7f2510e18700 1 -- 172.21.15.8:0/4094620735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c059100 con 0x7f250c0f77d0 2023-10-18T22:00:28.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.234+0000 7f24f3fff700 1 -- 172.21.15.8:0/4094620735 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f250001b030 con 0x7f250c0f77d0 2023-10-18T22:00:28.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.234+0000 7f24f3fff700 1 --2- 172.21.15.8:0/4094620735 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24f4060f70 0x7f24f4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:28.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.235+0000 7f24f3fff700 1 -- 172.21.15.8:0/4094620735 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f250007c7c0 con 0x7f250c0f77d0 2023-10-18T22:00:28.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.235+0000 7f250b7fe700 1 --2- 172.21.15.8:0/4094620735 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24f4060f70 0x7f24f4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:28.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.235+0000 7f250b7fe700 1 --2- 172.21.15.8:0/4094620735 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24f4060f70 0x7f24f4063430 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f24fc005010 tx=0x7f24fc016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:28.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.238+0000 7f24f3fff700 1 -- 172.21.15.8:0/4094620735 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f250004c420 con 0x7f250c0f77d0 2023-10-18T22:00:28.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:26.578997+0000 mgr.smithi008.flmjzp (mgr.14640) 3692 : cluster [DBG] pgmap v2538: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:28.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:26.974021+0000 mgr.smithi008.flmjzp (mgr.14640) 3693 : audit [DBG] from='client.37024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:00:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.467+0000 7f2510e18700 1 -- 172.21.15.8:0/4094620735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f250c0fed80 con 0x7f250c0f77d0 2023-10-18T22:00:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.468+0000 7f24f3fff700 1 -- 172.21.15.8:0/4094620735 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f2500019070 con 0x7f250c0f77d0 2023-10-18T22:00:28.470 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:00:28.470 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:00:28.470 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:00:28.470 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:00:28.470 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:00:28.471 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:00:28.471 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:00:28.471 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:00:28.471 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:00:28.471 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:00:28.472 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:00:28.472 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:00:28.472 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:00:28.472 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:00:28.472 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:00:28.473 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:00:28.473 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:00:28.473 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:00:28.473 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:00:28.473 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:00:28.474 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:00:28.474 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:00:28.474 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:00:28.474 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:00:28.474 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:00:28.475 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:00:28.475 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:00:28.475 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:00:28.475 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:00:28.475 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:00:28.475 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:00:28.476 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:00:28.476 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:00:28.476 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:00:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 -- 172.21.15.8:0/4094620735 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24f4060f70 msgr2=0x7f24f4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 --2- 172.21.15.8:0/4094620735 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24f4060f70 0x7f24f4063430 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f24fc005010 tx=0x7f24fc016040).stop 2023-10-18T22:00:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 -- 172.21.15.8:0/4094620735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f250c0f77d0 msgr2=0x7f250c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:28.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 --2- 172.21.15.8:0/4094620735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f250c0f77d0 0x7f250c107280 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f250000e7f0 tx=0x7f250000b040).stop 2023-10-18T22:00:28.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 -- 172.21.15.8:0/4094620735 shutdown_connections 2023-10-18T22:00:28.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 --2- 172.21.15.8:0/4094620735 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f24f4060f70 0x7f24f4063430 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 --2- 172.21.15.8:0/4094620735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f250c0f6530 0x7f250c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 --2- 172.21.15.8:0/4094620735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f250c0f77d0 0x7f250c107280 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 -- 172.21.15.8:0/4094620735 >> 172.21.15.8:0/4094620735 conn(0x7f250c0f1c90 msgr2=0x7f250c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:28.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 -- 172.21.15.8:0/4094620735 shutdown_connections 2023-10-18T22:00:28.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.470+0000 7f2510e18700 1 -- 172.21.15.8:0/4094620735 wait complete. 2023-10-18T22:00:28.479 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:00:28.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:26.578997+0000 mgr.smithi008.flmjzp (mgr.14640) 3692 : cluster [DBG] pgmap v2538: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:28.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:26.974021+0000 mgr.smithi008.flmjzp (mgr.14640) 3693 : audit [DBG] from='client.37024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:00:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.607+0000 7fae69b0d700 1 -- 172.21.15.8:0/3695523602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae640f6530 msgr2=0x7fae640f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.607+0000 7fae69b0d700 1 --2- 172.21.15.8:0/3695523602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae640f6530 0x7fae640f6950 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fae580099e0 tx=0x7fae58004d10).stop 2023-10-18T22:00:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.607+0000 7fae69b0d700 1 -- 172.21.15.8:0/3695523602 shutdown_connections 2023-10-18T22:00:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.607+0000 7fae69b0d700 1 --2- 172.21.15.8:0/3695523602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae640f77d0 0x7fae640f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.607+0000 7fae69b0d700 1 --2- 172.21.15.8:0/3695523602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae640f6530 0x7fae640f6950 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.607+0000 7fae69b0d700 1 -- 172.21.15.8:0/3695523602 >> 172.21.15.8:0/3695523602 conn(0x7fae640f1c90 msgr2=0x7fae640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:28.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.607+0000 7fae69b0d700 1 -- 172.21.15.8:0/3695523602 shutdown_connections 2023-10-18T22:00:28.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.607+0000 7fae69b0d700 1 -- 172.21.15.8:0/3695523602 wait complete. 2023-10-18T22:00:28.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.608+0000 7fae69b0d700 1 Processor -- start 2023-10-18T22:00:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.608+0000 7fae69b0d700 1 -- start start 2023-10-18T22:00:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.608+0000 7fae69b0d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae640f6530 0x7fae64109130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.608+0000 7fae69b0d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae640f77d0 0x7fae64109620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.608+0000 7fae69b0d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae64109bd0 con 0x7fae640f77d0 2023-10-18T22:00:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.608+0000 7fae69b0d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae64109d10 con 0x7fae640f6530 2023-10-18T22:00:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.609+0000 7fae63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae640f77d0 0x7fae64109620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:28.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.609+0000 7fae63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae640f77d0 0x7fae64109620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53694/0 (socket says 172.21.15.8:53694) 2023-10-18T22:00:28.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.609+0000 7fae63fff700 1 -- 172.21.15.8:0/1458833924 learned_addr learned my addr 172.21.15.8:0/1458833924 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:00:28.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.609+0000 7fae68b0b700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae640f6530 0x7fae64109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:28.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.609+0000 7fae63fff700 1 -- 172.21.15.8:0/1458833924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae640f6530 msgr2=0x7fae64109130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:28.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.609+0000 7fae63fff700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae640f6530 0x7fae64109130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.609+0000 7fae63fff700 1 -- 172.21.15.8:0/1458833924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58009640 con 0x7fae640f77d0 2023-10-18T22:00:28.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.609+0000 7fae68b0b700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae640f6530 0x7fae64109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:00:28.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.609+0000 7fae63fff700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae640f77d0 0x7fae64109620 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fae5000c790 tx=0x7fae50007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:28.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.609+0000 7fae617fa700 1 -- 172.21.15.8:0/1458833924 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5000e680 con 0x7fae640f77d0 2023-10-18T22:00:28.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.610+0000 7fae617fa700 1 -- 172.21.15.8:0/1458833924 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fae5000eca0 con 0x7fae640f77d0 2023-10-18T22:00:28.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.610+0000 7fae69b0d700 1 -- 172.21.15.8:0/1458833924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6410a6b0 con 0x7fae640f77d0 2023-10-18T22:00:28.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.610+0000 7fae617fa700 1 -- 172.21.15.8:0/1458833924 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae50013de0 con 0x7fae640f77d0 2023-10-18T22:00:28.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.610+0000 7fae69b0d700 1 -- 172.21.15.8:0/1458833924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6410abf0 con 0x7fae640f77d0 2023-10-18T22:00:28.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.611+0000 7fae69b0d700 1 -- 172.21.15.8:0/1458833924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae64045ad0 con 0x7fae640f77d0 2023-10-18T22:00:28.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.612+0000 7fae617fa700 1 -- 172.21.15.8:0/1458833924 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fae5001a060 con 0x7fae640f77d0 2023-10-18T22:00:28.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.613+0000 7fae617fa700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 0x7fae54063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:28.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.613+0000 7fae617fa700 1 -- 172.21.15.8:0/1458833924 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fae5007cab0 con 0x7fae640f77d0 2023-10-18T22:00:28.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.613+0000 7fae68b0b700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 0x7fae54063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:28.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.614+0000 7fae68b0b700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 0x7fae54063430 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fae58005010 tx=0x7fae58004d10).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:28.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.617+0000 7fae617fa700 1 -- 172.21.15.8:0/1458833924 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fae500501d0 con 0x7fae640f77d0 2023-10-18T22:00:28.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.815+0000 7fae69b0d700 1 -- 172.21.15.8:0/1458833924 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae640fee30 con 0x7fae54060f70 2023-10-18T22:00:28.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.816+0000 7fae617fa700 1 -- 172.21.15.8:0/1458833924 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fae640fee30 con 0x7fae54060f70 2023-10-18T22:00:28.818 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:00:28.818 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:00:28.819 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:00:28.819 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:00:28.819 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:00:28.820 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:00:28.820 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:00:28.821 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:00:28.821 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:00:28.821 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:00:28.821 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:00:28.822 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:00:28.822 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:00:28.823 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:00:28.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 -- 172.21.15.8:0/1458833924 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 msgr2=0x7fae54063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:28.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 0x7fae54063430 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fae58005010 tx=0x7fae58004d10).stop 2023-10-18T22:00:28.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 -- 172.21.15.8:0/1458833924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae640f77d0 msgr2=0x7fae64109620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:28.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae640f77d0 0x7fae64109620 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fae5000c790 tx=0x7fae50007d70).stop 2023-10-18T22:00:28.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 -- 172.21.15.8:0/1458833924 shutdown_connections 2023-10-18T22:00:28.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae54060f70 0x7fae54063430 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae640f6530 0x7fae64109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 --2- 172.21.15.8:0/1458833924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae640f77d0 0x7fae64109620 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:28.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 -- 172.21.15.8:0/1458833924 >> 172.21.15.8:0/1458833924 conn(0x7fae640f1c90 msgr2=0x7fae6406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:28.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 -- 172.21.15.8:0/1458833924 shutdown_connections 2023-10-18T22:00:28.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:28.818+0000 7fae69b0d700 1 -- 172.21.15.8:0/1458833924 wait complete. 2023-10-18T22:00:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:27.328674+0000 mgr.smithi008.flmjzp (mgr.14640) 3694 : audit [DBG] from='client.37028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:00:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:27.671147+0000 mgr.smithi008.flmjzp (mgr.14640) 3695 : audit [DBG] from='client.37032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:00:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:28.090551+0000 mon.smithi008 (mon.0) 4035 : audit [DBG] from='client.? 172.21.15.8:0/1188769520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:28.468391+0000 mon.smithi008 (mon.0) 4036 : audit [DBG] from='client.? 172.21.15.8:0/4094620735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:00:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:27.328674+0000 mgr.smithi008.flmjzp (mgr.14640) 3694 : audit [DBG] from='client.37028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:00:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:27.671147+0000 mgr.smithi008.flmjzp (mgr.14640) 3695 : audit [DBG] from='client.37032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:00:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:28.090551+0000 mon.smithi008 (mon.0) 4035 : audit [DBG] from='client.? 172.21.15.8:0/1188769520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:28.468391+0000 mon.smithi008 (mon.0) 4036 : audit [DBG] from='client.? 172.21.15.8:0/4094620735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:00:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:28.579472+0000 mgr.smithi008.flmjzp (mgr.14640) 3696 : cluster [DBG] pgmap v2539: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:28.816663+0000 mgr.smithi008.flmjzp (mgr.14640) 3697 : audit [DBG] from='client.37044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:00:30.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:28.579472+0000 mgr.smithi008.flmjzp (mgr.14640) 3696 : cluster [DBG] pgmap v2539: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:28.816663+0000 mgr.smithi008.flmjzp (mgr.14640) 3697 : audit [DBG] from='client.37044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:00:32.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:30.580039+0000 mgr.smithi008.flmjzp (mgr.14640) 3698 : cluster [DBG] pgmap v2540: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:30.580039+0000 mgr.smithi008.flmjzp (mgr.14640) 3698 : cluster [DBG] pgmap v2540: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:32.610861+0000 mon.smithi008 (mon.0) 4037 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:32.610861+0000 mon.smithi008 (mon.0) 4037 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:34.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:32.580709+0000 mgr.smithi008.flmjzp (mgr.14640) 3699 : cluster [DBG] pgmap v2541: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:34.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:33.183740+0000 mon.smithi008 (mon.0) 4038 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:34.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:33.184536+0000 mon.smithi008 (mon.0) 4039 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:34.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:33.185133+0000 mgr.smithi008.flmjzp (mgr.14640) 3700 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:34.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:33.185597+0000 mgr.smithi008.flmjzp (mgr.14640) 3701 : cluster [DBG] pgmap v2542: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:34.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:33.185782+0000 mgr.smithi008.flmjzp (mgr.14640) 3702 : cluster [DBG] pgmap v2543: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:34.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:33.189797+0000 mon.smithi008 (mon.0) 4040 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:34.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:33.194603+0000 mon.smithi008 (mon.0) 4041 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:34.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:33.196948+0000 mon.smithi008 (mon.0) 4042 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:34.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:33.198187+0000 mon.smithi008 (mon.0) 4043 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:34.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:33.199404+0000 mon.smithi008 (mon.0) 4044 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:34.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:33.200880+0000 mon.smithi008 (mon.0) 4045 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:34.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:33.202409+0000 mgr.smithi008.flmjzp (mgr.14640) 3703 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:32.580709+0000 mgr.smithi008.flmjzp (mgr.14640) 3699 : cluster [DBG] pgmap v2541: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:33.183740+0000 mon.smithi008 (mon.0) 4038 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:33.184536+0000 mon.smithi008 (mon.0) 4039 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:34.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:33.185133+0000 mgr.smithi008.flmjzp (mgr.14640) 3700 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:34.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:33.185597+0000 mgr.smithi008.flmjzp (mgr.14640) 3701 : cluster [DBG] pgmap v2542: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:34.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:33.185782+0000 mgr.smithi008.flmjzp (mgr.14640) 3702 : cluster [DBG] pgmap v2543: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:34.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:33.189797+0000 mon.smithi008 (mon.0) 4040 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:34.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:33.194603+0000 mon.smithi008 (mon.0) 4041 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:34.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:33.196948+0000 mon.smithi008 (mon.0) 4042 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:34.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:33.198187+0000 mon.smithi008 (mon.0) 4043 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:34.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:33.199404+0000 mon.smithi008 (mon.0) 4044 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:34.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:33.200880+0000 mon.smithi008 (mon.0) 4045 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:34.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:33.202409+0000 mgr.smithi008.flmjzp (mgr.14640) 3703 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:35.186263+0000 mgr.smithi008.flmjzp (mgr.14640) 3704 : cluster [DBG] pgmap v2544: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:36.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:35.186263+0000 mgr.smithi008.flmjzp (mgr.14640) 3704 : cluster [DBG] pgmap v2544: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:37.186877+0000 mgr.smithi008.flmjzp (mgr.14640) 3705 : cluster [DBG] pgmap v2545: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:37.186877+0000 mgr.smithi008.flmjzp (mgr.14640) 3705 : cluster [DBG] pgmap v2545: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:39.187522+0000 mgr.smithi008.flmjzp (mgr.14640) 3706 : cluster [DBG] pgmap v2546: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:39.187522+0000 mgr.smithi008.flmjzp (mgr.14640) 3706 : cluster [DBG] pgmap v2546: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:42.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:41.188270+0000 mgr.smithi008.flmjzp (mgr.14640) 3707 : cluster [DBG] pgmap v2547: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:42.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:41.188270+0000 mgr.smithi008.flmjzp (mgr.14640) 3707 : cluster [DBG] pgmap v2547: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:43.188833+0000 mgr.smithi008.flmjzp (mgr.14640) 3708 : cluster [DBG] pgmap v2548: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:43.211096+0000 mon.smithi008 (mon.0) 4046 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:43.213253+0000 mon.smithi008 (mon.0) 4047 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:43.214338+0000 mon.smithi008 (mon.0) 4048 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:43.215261+0000 mgr.smithi008.flmjzp (mgr.14640) 3709 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:43.215872+0000 mgr.smithi008.flmjzp (mgr.14640) 3710 : cluster [DBG] pgmap v2549: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:43.216180+0000 mgr.smithi008.flmjzp (mgr.14640) 3711 : cluster [DBG] pgmap v2550: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:43.220733+0000 mon.smithi008 (mon.0) 4049 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:43.227332+0000 mon.smithi008 (mon.0) 4050 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:43.230321+0000 mon.smithi008 (mon.0) 4051 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:43.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:43.231968+0000 mon.smithi008 (mon.0) 4052 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:43.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:43.233542+0000 mon.smithi008 (mon.0) 4053 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:43.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:43.235460+0000 mon.smithi008 (mon.0) 4054 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:43.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:43.237277+0000 mgr.smithi008.flmjzp (mgr.14640) 3712 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:43.188833+0000 mgr.smithi008.flmjzp (mgr.14640) 3708 : cluster [DBG] pgmap v2548: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:43.211096+0000 mon.smithi008 (mon.0) 4046 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:43.213253+0000 mon.smithi008 (mon.0) 4047 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:43.214338+0000 mon.smithi008 (mon.0) 4048 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:43.215261+0000 mgr.smithi008.flmjzp (mgr.14640) 3709 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:43.215872+0000 mgr.smithi008.flmjzp (mgr.14640) 3710 : cluster [DBG] pgmap v2549: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:43.216180+0000 mgr.smithi008.flmjzp (mgr.14640) 3711 : cluster [DBG] pgmap v2550: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:43.220733+0000 mon.smithi008 (mon.0) 4049 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:43.227332+0000 mon.smithi008 (mon.0) 4050 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:43.230321+0000 mon.smithi008 (mon.0) 4051 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:43.231968+0000 mon.smithi008 (mon.0) 4052 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:43.233542+0000 mon.smithi008 (mon.0) 4053 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:43.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:43.235460+0000 mon.smithi008 (mon.0) 4054 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:43.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:43.237277+0000 mgr.smithi008.flmjzp (mgr.14640) 3712 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:45.216862+0000 mgr.smithi008.flmjzp (mgr.14640) 3713 : cluster [DBG] pgmap v2551: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:45.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:45.216862+0000 mgr.smithi008.flmjzp (mgr.14640) 3713 : cluster [DBG] pgmap v2551: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:47.217625+0000 mgr.smithi008.flmjzp (mgr.14640) 3714 : cluster [DBG] pgmap v2552: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:47.217625+0000 mgr.smithi008.flmjzp (mgr.14640) 3714 : cluster [DBG] pgmap v2552: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:49.218302+0000 mgr.smithi008.flmjzp (mgr.14640) 3715 : cluster [DBG] pgmap v2553: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:49.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:49.218302+0000 mgr.smithi008.flmjzp (mgr.14640) 3715 : cluster [DBG] pgmap v2553: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:51.218988+0000 mgr.smithi008.flmjzp (mgr.14640) 3716 : cluster [DBG] pgmap v2554: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:51.218988+0000 mgr.smithi008.flmjzp (mgr.14640) 3716 : cluster [DBG] pgmap v2554: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:53.219524+0000 mgr.smithi008.flmjzp (mgr.14640) 3717 : cluster [DBG] pgmap v2555: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:53.247984+0000 mon.smithi008 (mon.0) 4055 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:53.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:53.219524+0000 mgr.smithi008.flmjzp (mgr.14640) 3717 : cluster [DBG] pgmap v2555: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:53.247984+0000 mon.smithi008 (mon.0) 4055 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:53.805414+0000 mon.smithi008 (mon.0) 4056 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:53.807034+0000 mon.smithi008 (mon.0) 4057 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:53.808087+0000 mgr.smithi008.flmjzp (mgr.14640) 3718 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:53.809018+0000 mgr.smithi008.flmjzp (mgr.14640) 3719 : cluster [DBG] pgmap v2556: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:53.809358+0000 mgr.smithi008.flmjzp (mgr.14640) 3720 : cluster [DBG] pgmap v2557: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:53.814281+0000 mon.smithi008 (mon.0) 4058 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:53.820918+0000 mon.smithi008 (mon.0) 4059 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:53.824032+0000 mon.smithi008 (mon.0) 4060 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:53.825740+0000 mon.smithi008 (mon.0) 4061 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:53.827376+0000 mon.smithi008 (mon.0) 4062 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:54.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:53.829414+0000 mon.smithi008 (mon.0) 4063 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:54.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:00:53.831355+0000 mgr.smithi008.flmjzp (mgr.14640) 3721 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:53.805414+0000 mon.smithi008 (mon.0) 4056 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:00:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:53.807034+0000 mon.smithi008 (mon.0) 4057 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:00:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:53.808087+0000 mgr.smithi008.flmjzp (mgr.14640) 3718 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:00:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:53.809018+0000 mgr.smithi008.flmjzp (mgr.14640) 3719 : cluster [DBG] pgmap v2556: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:54.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:53.809358+0000 mgr.smithi008.flmjzp (mgr.14640) 3720 : cluster [DBG] pgmap v2557: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:54.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:53.814281+0000 mon.smithi008 (mon.0) 4058 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:00:54.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:53.820918+0000 mon.smithi008 (mon.0) 4059 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:00:54.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:53.824032+0000 mon.smithi008 (mon.0) 4060 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:54.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:53.825740+0000 mon.smithi008 (mon.0) 4061 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:54.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:53.827376+0000 mon.smithi008 (mon.0) 4062 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:54.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:53.829414+0000 mon.smithi008 (mon.0) 4063 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:00:54.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:00:53.831355+0000 mgr.smithi008.flmjzp (mgr.14640) 3721 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:00:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:55.809913+0000 mgr.smithi008.flmjzp (mgr.14640) 3722 : cluster [DBG] pgmap v2558: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:55.809913+0000 mgr.smithi008.flmjzp (mgr.14640) 3722 : cluster [DBG] pgmap v2558: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:58.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.973+0000 7fc5ce309700 1 -- 172.21.15.8:0/1775414796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c8060310 msgr2=0x7fc5c80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.973+0000 7fc5ce309700 1 --2- 172.21.15.8:0/1775414796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c8060310 0x7fc5c80f9110 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fc5c4004660 tx=0x7fc5c4009b30).stop 2023-10-18T22:00:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.973+0000 7fc5ce309700 1 -- 172.21.15.8:0/1775414796 shutdown_connections 2023-10-18T22:00:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.973+0000 7fc5ce309700 1 --2- 172.21.15.8:0/1775414796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80f9690 0x7fc5c80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.973+0000 7fc5ce309700 1 --2- 172.21.15.8:0/1775414796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c8060310 0x7fc5c80f9110 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.973+0000 7fc5ce309700 1 -- 172.21.15.8:0/1775414796 >> 172.21.15.8:0/1775414796 conn(0x7fc5c80f0b90 msgr2=0x7fc5c80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.973+0000 7fc5ce309700 1 -- 172.21.15.8:0/1775414796 shutdown_connections 2023-10-18T22:00:58.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.973+0000 7fc5ce309700 1 -- 172.21.15.8:0/1775414796 wait complete. 2023-10-18T22:00:58.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.974+0000 7fc5ce309700 1 Processor -- start 2023-10-18T22:00:58.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.974+0000 7fc5ce309700 1 -- start start 2023-10-18T22:00:58.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.974+0000 7fc5ce309700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c8060310 0x7fc5c8108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:58.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.974+0000 7fc5ce309700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80f9690 0x7fc5c8109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:58.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.974+0000 7fc5ce309700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c8109a30 con 0x7fc5c8060310 2023-10-18T22:00:58.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.974+0000 7fc5ce309700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c8109b70 con 0x7fc5c80f9690 2023-10-18T22:00:58.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.974+0000 7fc5cd307700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c8060310 0x7fc5c8108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:58.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.975+0000 7fc5cd307700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c8060310 0x7fc5c8108f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39746/0 (socket says 172.21.15.8:39746) 2023-10-18T22:00:58.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.975+0000 7fc5cd307700 1 -- 172.21.15.8:0/1491627590 learned_addr learned my addr 172.21.15.8:0/1491627590 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:00:58.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.975+0000 7fc5ccb06700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80f9690 0x7fc5c8109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:58.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.975+0000 7fc5cd307700 1 -- 172.21.15.8:0/1491627590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80f9690 msgr2=0x7fc5c8109480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:58.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.975+0000 7fc5cd307700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80f9690 0x7fc5c8109480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:58.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.975+0000 7fc5cd307700 1 -- 172.21.15.8:0/1491627590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c4005040 con 0x7fc5c8060310 2023-10-18T22:00:58.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.975+0000 7fc5cd307700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c8060310 0x7fc5c8108f90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fc5c4009f50 tx=0x7fc5c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:58.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.975+0000 7fc5bdffb700 1 -- 172.21.15.8:0/1491627590 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c4018070 con 0x7fc5c8060310 2023-10-18T22:00:58.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.975+0000 7fc5ce309700 1 -- 172.21.15.8:0/1491627590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c810a4b0 con 0x7fc5c8060310 2023-10-18T22:00:58.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.976+0000 7fc5bdffb700 1 -- 172.21.15.8:0/1491627590 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc5c4009630 con 0x7fc5c8060310 2023-10-18T22:00:58.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.976+0000 7fc5bdffb700 1 -- 172.21.15.8:0/1491627590 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c401c3c0 con 0x7fc5c8060310 2023-10-18T22:00:58.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.976+0000 7fc5ce309700 1 -- 172.21.15.8:0/1491627590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c810aa10 con 0x7fc5c8060310 2023-10-18T22:00:58.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.977+0000 7fc5ce309700 1 -- 172.21.15.8:0/1491627590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c8045ad0 con 0x7fc5c8060310 2023-10-18T22:00:58.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.978+0000 7fc5bdffb700 1 -- 172.21.15.8:0/1491627590 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc5c401d420 con 0x7fc5c8060310 2023-10-18T22:00:58.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.978+0000 7fc5bdffb700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b4060f70 0x7fc5b4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:58.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.978+0000 7fc5bdffb700 1 -- 172.21.15.8:0/1491627590 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc5c407e5f0 con 0x7fc5c8060310 2023-10-18T22:00:58.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.979+0000 7fc5ccb06700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b4060f70 0x7fc5b4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:58.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.979+0000 7fc5ccb06700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b4060f70 0x7fc5b4063430 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fc5c80600e0 tx=0x7fc5b800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:58.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:58.983+0000 7fc5bdffb700 1 -- 172.21.15.8:0/1491627590 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc5c4051bd0 con 0x7fc5c8060310 2023-10-18T22:00:59.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.180+0000 7fc5ce309700 1 -- 172.21.15.8:0/1491627590 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5c80f5650 con 0x7fc5b4060f70 2023-10-18T22:00:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.181+0000 7fc5bdffb700 1 -- 172.21.15.8:0/1491627590 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc5c80f5650 con 0x7fc5b4060f70 2023-10-18T22:00:59.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.183+0000 7fc5ce309700 1 -- 172.21.15.8:0/1491627590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b4060f70 msgr2=0x7fc5b4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:59.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.183+0000 7fc5ce309700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b4060f70 0x7fc5b4063430 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fc5c80600e0 tx=0x7fc5b800b040).stop 2023-10-18T22:00:59.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.183+0000 7fc5ce309700 1 -- 172.21.15.8:0/1491627590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c8060310 msgr2=0x7fc5c8108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:59.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.183+0000 7fc5ce309700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c8060310 0x7fc5c8108f90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fc5c4009f50 tx=0x7fc5c4009b30).stop 2023-10-18T22:00:59.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.183+0000 7fc5ce309700 1 -- 172.21.15.8:0/1491627590 shutdown_connections 2023-10-18T22:00:59.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.183+0000 7fc5ce309700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5b4060f70 0x7fc5b4063430 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.183+0000 7fc5ce309700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5c8060310 0x7fc5c8108f90 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.183+0000 7fc5ce309700 1 --2- 172.21.15.8:0/1491627590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80f9690 0x7fc5c8109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.183+0000 7fc5ce309700 1 -- 172.21.15.8:0/1491627590 >> 172.21.15.8:0/1491627590 conn(0x7fc5c80f0b90 msgr2=0x7fc5c80f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:59.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.184+0000 7fc5ce309700 1 -- 172.21.15.8:0/1491627590 shutdown_connections 2023-10-18T22:00:59.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.184+0000 7fc5ce309700 1 -- 172.21.15.8:0/1491627590 wait complete. 2023-10-18T22:00:59.199 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:00:59.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:57.810603+0000 mgr.smithi008.flmjzp (mgr.14640) 3723 : cluster [DBG] pgmap v2559: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:59.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.322+0000 7fcaa7fff700 1 -- 172.21.15.8:0/1539751594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa80f77d0 msgr2=0x7fcaa80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:59.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.322+0000 7fcaa7fff700 1 --2- 172.21.15.8:0/1539751594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa80f77d0 0x7fcaa80f7c30 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7fca9c004660 tx=0x7fca9c009b30).stop 2023-10-18T22:00:59.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.322+0000 7fcaa7fff700 1 -- 172.21.15.8:0/1539751594 shutdown_connections 2023-10-18T22:00:59.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.322+0000 7fcaa7fff700 1 --2- 172.21.15.8:0/1539751594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa80f77d0 0x7fcaa80f7c30 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.322+0000 7fcaa7fff700 1 --2- 172.21.15.8:0/1539751594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa80f6530 0x7fcaa80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.322+0000 7fcaa7fff700 1 -- 172.21.15.8:0/1539751594 >> 172.21.15.8:0/1539751594 conn(0x7fcaa80f1c90 msgr2=0x7fcaa80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:59.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.322+0000 7fcaa7fff700 1 -- 172.21.15.8:0/1539751594 shutdown_connections 2023-10-18T22:00:59.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.322+0000 7fcaa7fff700 1 -- 172.21.15.8:0/1539751594 wait complete. 2023-10-18T22:00:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.323+0000 7fcaa7fff700 1 Processor -- start 2023-10-18T22:00:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.323+0000 7fcaa7fff700 1 -- start start 2023-10-18T22:00:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.323+0000 7fcaa7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa80f6530 0x7fcaa806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.323+0000 7fcaa7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa80f77d0 0x7fcaa8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:59.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.323+0000 7fcaa7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa806a380 con 0x7fcaa80f6530 2023-10-18T22:00:59.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.323+0000 7fcaa7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa806a4c0 con 0x7fcaa80f77d0 2023-10-18T22:00:59.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.323+0000 7fcaa6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa80f6530 0x7fcaa806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:59.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.323+0000 7fcaa6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa80f6530 0x7fcaa806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39776/0 (socket says 172.21.15.8:39776) 2023-10-18T22:00:59.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.323+0000 7fcaa6ffd700 1 -- 172.21.15.8:0/4232324163 learned_addr learned my addr 172.21.15.8:0/4232324163 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:00:59.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.324+0000 7fcaa67fc700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa80f77d0 0x7fcaa8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:59.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.324+0000 7fcaa6ffd700 1 -- 172.21.15.8:0/4232324163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa80f77d0 msgr2=0x7fcaa8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:59.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.324+0000 7fcaa6ffd700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa80f77d0 0x7fcaa8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.324+0000 7fcaa6ffd700 1 -- 172.21.15.8:0/4232324163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c005040 con 0x7fcaa80f6530 2023-10-18T22:00:59.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.324+0000 7fcaa6ffd700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa80f6530 0x7fcaa806b9a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fca98002700 tx=0x7fca98009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:59.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.324+0000 7fca8f7fe700 1 -- 172.21.15.8:0/4232324163 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca980079c0 con 0x7fcaa80f6530 2023-10-18T22:00:59.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.324+0000 7fca8f7fe700 1 -- 172.21.15.8:0/4232324163 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fca9800f040 con 0x7fcaa80f6530 2023-10-18T22:00:59.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.324+0000 7fcaa7fff700 1 -- 172.21.15.8:0/4232324163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa806a7a0 con 0x7fcaa80f6530 2023-10-18T22:00:59.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.324+0000 7fca8f7fe700 1 -- 172.21.15.8:0/4232324163 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca980148d0 con 0x7fcaa80f6530 2023-10-18T22:00:59.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.325+0000 7fcaa7fff700 1 -- 172.21.15.8:0/4232324163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa810ed20 con 0x7fcaa80f6530 2023-10-18T22:00:59.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.325+0000 7fcaa7fff700 1 -- 172.21.15.8:0/4232324163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa8045ad0 con 0x7fcaa80f6530 2023-10-18T22:00:59.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.326+0000 7fca8f7fe700 1 -- 172.21.15.8:0/4232324163 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fca9801b060 con 0x7fcaa80f6530 2023-10-18T22:00:59.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.327+0000 7fca8f7fe700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca90060f70 0x7fca90063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:59.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.327+0000 7fca8f7fe700 1 -- 172.21.15.8:0/4232324163 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fca9807c7f0 con 0x7fcaa80f6530 2023-10-18T22:00:59.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.327+0000 7fcaa67fc700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca90060f70 0x7fca90063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:59.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.328+0000 7fcaa67fc700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca90060f70 0x7fca90063430 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fca9c004630 tx=0x7fca9c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:59.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.331+0000 7fca8f7fe700 1 -- 172.21.15.8:0/4232324163 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fca9804c460 con 0x7fcaa80f6530 2023-10-18T22:00:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:57.810603+0000 mgr.smithi008.flmjzp (mgr.14640) 3723 : cluster [DBG] pgmap v2559: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:00:59.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.530+0000 7fcaa7fff700 1 -- 172.21.15.8:0/4232324163 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaa80fee70 con 0x7fca90060f70 2023-10-18T22:00:59.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.532+0000 7fca8f7fe700 1 -- 172.21.15.8:0/4232324163 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fca9c019040 con 0x7fca90060f70 2023-10-18T22:00:59.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.533+0000 7fcaa7fff700 1 -- 172.21.15.8:0/4232324163 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca90060f70 msgr2=0x7fca90063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:59.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.533+0000 7fcaa7fff700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca90060f70 0x7fca90063430 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fca9c004630 tx=0x7fca9c009b30).stop 2023-10-18T22:00:59.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.533+0000 7fcaa7fff700 1 -- 172.21.15.8:0/4232324163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa80f6530 msgr2=0x7fcaa806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:59.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.533+0000 7fcaa7fff700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa80f6530 0x7fcaa806b9a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fca98002700 tx=0x7fca98009e00).stop 2023-10-18T22:00:59.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.534+0000 7fcaa7fff700 1 -- 172.21.15.8:0/4232324163 shutdown_connections 2023-10-18T22:00:59.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.534+0000 7fcaa7fff700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca90060f70 0x7fca90063430 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.534+0000 7fcaa7fff700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaa80f6530 0x7fcaa806b9a0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.534+0000 7fcaa7fff700 1 --2- 172.21.15.8:0/4232324163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa80f77d0 0x7fcaa8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.534+0000 7fcaa7fff700 1 -- 172.21.15.8:0/4232324163 >> 172.21.15.8:0/4232324163 conn(0x7fcaa80f1c90 msgr2=0x7fcaa80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:59.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.534+0000 7fcaa7fff700 1 -- 172.21.15.8:0/4232324163 shutdown_connections 2023-10-18T22:00:59.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.534+0000 7fcaa7fff700 1 -- 172.21.15.8:0/4232324163 wait complete. 2023-10-18T22:00:59.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.671+0000 7f61188cb700 1 -- 172.21.15.8:0/3481180018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61140f77d0 msgr2=0x7f61140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:59.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.671+0000 7f61188cb700 1 --2- 172.21.15.8:0/3481180018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61140f77d0 0x7f61140f7c30 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f6108004660 tx=0x7f6108009b30).stop 2023-10-18T22:00:59.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.671+0000 7f61188cb700 1 -- 172.21.15.8:0/3481180018 shutdown_connections 2023-10-18T22:00:59.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.671+0000 7f61188cb700 1 --2- 172.21.15.8:0/3481180018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61140f77d0 0x7f61140f7c30 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.671+0000 7f61188cb700 1 --2- 172.21.15.8:0/3481180018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61140f6530 0x7f61140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.671+0000 7f61188cb700 1 -- 172.21.15.8:0/3481180018 >> 172.21.15.8:0/3481180018 conn(0x7f61140f1c70 msgr2=0x7f61140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:59.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.671+0000 7f61188cb700 1 -- 172.21.15.8:0/3481180018 shutdown_connections 2023-10-18T22:00:59.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.671+0000 7f61188cb700 1 -- 172.21.15.8:0/3481180018 wait complete. 2023-10-18T22:00:59.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.672+0000 7f61188cb700 1 Processor -- start 2023-10-18T22:00:59.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.673+0000 7f61188cb700 1 -- start start 2023-10-18T22:00:59.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.673+0000 7f61188cb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61140f6530 0x7f6114108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:59.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.673+0000 7f61188cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61140f77d0 0x7f6114109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:59.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.673+0000 7f61188cb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61141099f0 con 0x7f61140f6530 2023-10-18T22:00:59.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.673+0000 7f61188cb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114109b30 con 0x7f61140f77d0 2023-10-18T22:00:59.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.673+0000 7f6112d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61140f6530 0x7f6114108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:59.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.673+0000 7f6112d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61140f6530 0x7f6114108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39802/0 (socket says 172.21.15.8:39802) 2023-10-18T22:00:59.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.673+0000 7f6112d9d700 1 -- 172.21.15.8:0/160973210 learned_addr learned my addr 172.21.15.8:0/160973210 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:00:59.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.673+0000 7f611259c700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61140f77d0 0x7f6114109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:59.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.674+0000 7f6112d9d700 1 -- 172.21.15.8:0/160973210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61140f77d0 msgr2=0x7f6114109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:59.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.674+0000 7f6112d9d700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61140f77d0 0x7f6114109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.674+0000 7f6112d9d700 1 -- 172.21.15.8:0/160973210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6108005040 con 0x7f61140f6530 2023-10-18T22:00:59.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.674+0000 7f6112d9d700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61140f6530 0x7f6114108f50 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f6104002700 tx=0x7f6104009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:59.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.674+0000 7f60fb7fe700 1 -- 172.21.15.8:0/160973210 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61040079c0 con 0x7f61140f6530 2023-10-18T22:00:59.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.674+0000 7f60fb7fe700 1 -- 172.21.15.8:0/160973210 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f610400f040 con 0x7f61140f6530 2023-10-18T22:00:59.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.674+0000 7f61188cb700 1 -- 172.21.15.8:0/160973210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611410a4d0 con 0x7f61140f6530 2023-10-18T22:00:59.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.674+0000 7f60fb7fe700 1 -- 172.21.15.8:0/160973210 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61040148d0 con 0x7f61140f6530 2023-10-18T22:00:59.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.674+0000 7f61188cb700 1 -- 172.21.15.8:0/160973210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611410aa90 con 0x7f61140f6530 2023-10-18T22:00:59.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.675+0000 7f61188cb700 1 -- 172.21.15.8:0/160973210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6114045ad0 con 0x7f61140f6530 2023-10-18T22:00:59.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.676+0000 7f60fb7fe700 1 -- 172.21.15.8:0/160973210 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f610401b060 con 0x7f61140f6530 2023-10-18T22:00:59.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.677+0000 7f60fb7fe700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f60fc060f70 0x7f60fc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:00:59.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.677+0000 7f60fb7fe700 1 -- 172.21.15.8:0/160973210 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f610407c7d0 con 0x7f61140f6530 2023-10-18T22:00:59.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.678+0000 7f611259c700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f60fc060f70 0x7f60fc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:00:59.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.678+0000 7f611259c700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f60fc060f70 0x7f60fc063430 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f6108004630 tx=0x7f6108009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:00:59.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.681+0000 7f60fb7fe700 1 -- 172.21.15.8:0/160973210 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f610404fdb0 con 0x7f61140f6530 2023-10-18T22:00:59.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.874+0000 7f61188cb700 1 -- 172.21.15.8:0/160973210 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f61140fee40 con 0x7f60fc060f70 2023-10-18T22:00:59.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.884+0000 7f60fb7fe700 1 -- 172.21.15.8:0/160973210 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f61140fee40 con 0x7f60fc060f70 2023-10-18T22:00:59.885 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:00:59.886 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (67m) 5m ago 69m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:00:59.886 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (61m) 5m ago 69m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:00:59.886 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (61m) 3m ago 68m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:00:59.886 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (67m) 5m ago 68m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:00:59.886 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 65m - - 2023-10-18T22:00:59.887 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 65m - - 2023-10-18T22:00:59.887 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 65m - - 2023-10-18T22:00:59.887 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 65m - - 2023-10-18T22:00:59.887 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (62m) 5m ago 70m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:00:59.887 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (62m) 3m ago 68m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:00:59.888 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (62m) 5m ago 70m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:00:59.888 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (61m) 3m ago 68m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:00:59.888 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (68m) 5m ago 68m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:00:59.888 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (67m) 3m ago 67m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:00:59.888 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (61m) 5m ago 67m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:00:59.889 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (59m) 5m ago 67m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:00:59.889 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (58m) 5m ago 67m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:00:59.889 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (58m) 3m ago 66m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:00:59.889 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (57m) 3m ago 66m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:00:59.890 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (57m) 3m ago 66m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:00:59.890 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (63m) 5m ago 68m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:00:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 -- 172.21.15.8:0/160973210 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f60fc060f70 msgr2=0x7f60fc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f60fc060f70 0x7f60fc063430 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f6108004630 tx=0x7f6108009b30).stop 2023-10-18T22:00:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 -- 172.21.15.8:0/160973210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61140f6530 msgr2=0x7f6114108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:00:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61140f6530 0x7f6114108f50 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f6104002700 tx=0x7f6104009d80).stop 2023-10-18T22:00:59.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 -- 172.21.15.8:0/160973210 shutdown_connections 2023-10-18T22:00:59.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f60fc060f70 0x7f60fc063430 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61140f6530 0x7f6114108f50 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 --2- 172.21.15.8:0/160973210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61140f77d0 0x7f6114109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:00:59.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 -- 172.21.15.8:0/160973210 >> 172.21.15.8:0/160973210 conn(0x7f61140f1c70 msgr2=0x7f611406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:00:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 -- 172.21.15.8:0/160973210 shutdown_connections 2023-10-18T22:00:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:00:59.886+0000 7f61188cb700 1 -- 172.21.15.8:0/160973210 wait complete. 2023-10-18T22:01:00.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.022+0000 7fcc4b59e700 1 -- 172.21.15.8:0/1775631897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc4c0f77d0 msgr2=0x7fcc4c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:00.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.022+0000 7fcc4b59e700 1 --2- 172.21.15.8:0/1775631897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc4c0f77d0 0x7fcc4c0f7c30 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7fcc40004660 tx=0x7fcc40009b30).stop 2023-10-18T22:01:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.022+0000 7fcc4b59e700 1 -- 172.21.15.8:0/1775631897 shutdown_connections 2023-10-18T22:01:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.022+0000 7fcc4b59e700 1 --2- 172.21.15.8:0/1775631897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc4c0f77d0 0x7fcc4c0f7c30 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.022+0000 7fcc4b59e700 1 --2- 172.21.15.8:0/1775631897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc4c0f6530 0x7fcc4c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.022+0000 7fcc4b59e700 1 -- 172.21.15.8:0/1775631897 >> 172.21.15.8:0/1775631897 conn(0x7fcc4c0f1c90 msgr2=0x7fcc4c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.022+0000 7fcc4b59e700 1 -- 172.21.15.8:0/1775631897 shutdown_connections 2023-10-18T22:01:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.023+0000 7fcc4b59e700 1 -- 172.21.15.8:0/1775631897 wait complete. 2023-10-18T22:01:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.023+0000 7fcc4b59e700 1 Processor -- start 2023-10-18T22:01:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.023+0000 7fcc4b59e700 1 -- start start 2023-10-18T22:01:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc4b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc4c0f6530 0x7fcc4c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc4b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc4c0f77d0 0x7fcc4c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc4b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c06a380 con 0x7fcc4c0f6530 2023-10-18T22:01:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc4b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c06a4c0 con 0x7fcc4c0f77d0 2023-10-18T22:01:00.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc4a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc4c0f6530 0x7fcc4c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:00.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc4a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc4c0f6530 0x7fcc4c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39826/0 (socket says 172.21.15.8:39826) 2023-10-18T22:01:00.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc4a59c700 1 -- 172.21.15.8:0/2932704788 learned_addr learned my addr 172.21.15.8:0/2932704788 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:01:00.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc49d9b700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc4c0f77d0 0x7fcc4c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:00.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc4a59c700 1 -- 172.21.15.8:0/2932704788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc4c0f77d0 msgr2=0x7fcc4c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:00.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc4a59c700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc4c0f77d0 0x7fcc4c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc4a59c700 1 -- 172.21.15.8:0/2932704788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc40005040 con 0x7fcc4c0f6530 2023-10-18T22:01:00.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.024+0000 7fcc49d9b700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc4c0f77d0 0x7fcc4c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:01:00.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.025+0000 7fcc4a59c700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc4c0f6530 0x7fcc4c06b9a0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fcc3c002700 tx=0x7fcc3c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:00.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.025+0000 7fcc3affd700 1 -- 172.21.15.8:0/2932704788 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc3c009320 con 0x7fcc4c0f6530 2023-10-18T22:01:00.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.025+0000 7fcc3affd700 1 -- 172.21.15.8:0/2932704788 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcc3c00f040 con 0x7fcc4c0f6530 2023-10-18T22:01:00.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.025+0000 7fcc3affd700 1 -- 172.21.15.8:0/2932704788 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc3c014970 con 0x7fcc4c0f6530 2023-10-18T22:01:00.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.025+0000 7fcc4b59e700 1 -- 172.21.15.8:0/2932704788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c06a7a0 con 0x7fcc4c0f6530 2023-10-18T22:01:00.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.025+0000 7fcc4b59e700 1 -- 172.21.15.8:0/2932704788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c10ed70 con 0x7fcc4c0f6530 2023-10-18T22:01:00.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.026+0000 7fcc4b59e700 1 -- 172.21.15.8:0/2932704788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c045ad0 con 0x7fcc4c0f6530 2023-10-18T22:01:00.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.027+0000 7fcc3affd700 1 -- 172.21.15.8:0/2932704788 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcc3c009480 con 0x7fcc4c0f6530 2023-10-18T22:01:00.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.028+0000 7fcc3affd700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc34060f70 0x7fcc34063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:00.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.028+0000 7fcc3affd700 1 -- 172.21.15.8:0/2932704788 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcc3c07cb80 con 0x7fcc4c0f6530 2023-10-18T22:01:00.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.028+0000 7fcc49d9b700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc34060f70 0x7fcc34063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:00.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.029+0000 7fcc49d9b700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc34060f70 0x7fcc34063430 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fcc40005010 tx=0x7fcc40009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:00.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.032+0000 7fcc3affd700 1 -- 172.21.15.8:0/2932704788 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcc3c04c7f0 con 0x7fcc4c0f6530 2023-10-18T22:01:00.223 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:00:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:59.181443+0000 mgr.smithi008.flmjzp (mgr.14640) 3724 : audit [DBG] from='client.37048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:00.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:00:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:59.181443+0000 mgr.smithi008.flmjzp (mgr.14640) 3724 : audit [DBG] from='client.37048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:00.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.287+0000 7fcc4b59e700 1 -- 172.21.15.8:0/2932704788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcc4c0fedd0 con 0x7fcc4c0f6530 2023-10-18T22:01:00.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.288+0000 7fcc3affd700 1 -- 172.21.15.8:0/2932704788 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fcc3c04fe10 con 0x7fcc4c0f6530 2023-10-18T22:01:00.290 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:01:00.290 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:01:00.290 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:01:00.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:01:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:01:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:01:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:01:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:01:00.291 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:01:00.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:01:00.292 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:01:00.292 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:01:00.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:01:00.292 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:01:00.293 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:01:00.293 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:01:00.293 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:01:00.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 -- 172.21.15.8:0/2932704788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc34060f70 msgr2=0x7fcc34063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:00.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc34060f70 0x7fcc34063430 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fcc40005010 tx=0x7fcc40009b30).stop 2023-10-18T22:01:00.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 -- 172.21.15.8:0/2932704788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc4c0f6530 msgr2=0x7fcc4c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:00.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc4c0f6530 0x7fcc4c06b9a0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fcc3c002700 tx=0x7fcc3c009d80).stop 2023-10-18T22:01:00.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 -- 172.21.15.8:0/2932704788 shutdown_connections 2023-10-18T22:01:00.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc34060f70 0x7fcc34063430 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc4c0f6530 0x7fcc4c06b9a0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 --2- 172.21.15.8:0/2932704788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc4c0f77d0 0x7fcc4c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 -- 172.21.15.8:0/2932704788 >> 172.21.15.8:0/2932704788 conn(0x7fcc4c0f1c90 msgr2=0x7fcc4c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:00.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 -- 172.21.15.8:0/2932704788 shutdown_connections 2023-10-18T22:01:00.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.290+0000 7fcc4b59e700 1 -- 172.21.15.8:0/2932704788 wait complete. 2023-10-18T22:01:00.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.426+0000 7f6ba754f700 1 -- 172.21.15.8:0/3279642104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba00f6530 msgr2=0x7f6ba00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:00.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.426+0000 7f6ba754f700 1 --2- 172.21.15.8:0/3279642104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba00f6530 0x7f6ba00f6950 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f6b9c004660 tx=0x7f6b9c009b30).stop 2023-10-18T22:01:00.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.426+0000 7f6ba754f700 1 -- 172.21.15.8:0/3279642104 shutdown_connections 2023-10-18T22:01:00.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.426+0000 7f6ba754f700 1 --2- 172.21.15.8:0/3279642104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba00f77d0 0x7f6ba00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.426+0000 7f6ba754f700 1 --2- 172.21.15.8:0/3279642104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba00f6530 0x7f6ba00f6950 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.426+0000 7f6ba754f700 1 -- 172.21.15.8:0/3279642104 >> 172.21.15.8:0/3279642104 conn(0x7f6ba00f1c90 msgr2=0x7f6ba00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:00.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.426+0000 7f6ba754f700 1 -- 172.21.15.8:0/3279642104 shutdown_connections 2023-10-18T22:01:00.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.426+0000 7f6ba754f700 1 -- 172.21.15.8:0/3279642104 wait complete. 2023-10-18T22:01:00.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.427+0000 7f6ba754f700 1 Processor -- start 2023-10-18T22:01:00.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.427+0000 7f6ba754f700 1 -- start start 2023-10-18T22:01:00.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.427+0000 7f6ba754f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba00f6530 0x7f6ba0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:00.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.427+0000 7f6ba754f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba00f77d0 0x7f6ba0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:00.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.427+0000 7f6ba754f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0109a00 con 0x7f6ba00f6530 2023-10-18T22:01:00.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.427+0000 7f6ba754f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0109b40 con 0x7f6ba00f77d0 2023-10-18T22:01:00.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6ba654d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba00f6530 0x7f6ba0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6ba654d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba00f6530 0x7f6ba0108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39844/0 (socket says 172.21.15.8:39844) 2023-10-18T22:01:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6ba654d700 1 -- 172.21.15.8:0/3029027205 learned_addr learned my addr 172.21.15.8:0/3029027205 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:01:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6ba5d4c700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba00f77d0 0x7f6ba0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6ba654d700 1 -- 172.21.15.8:0/3029027205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba00f77d0 msgr2=0x7f6ba0109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6ba654d700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba00f77d0 0x7f6ba0109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6ba654d700 1 -- 172.21.15.8:0/3029027205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c005040 con 0x7f6ba00f6530 2023-10-18T22:01:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6ba654d700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba00f6530 0x7f6ba0108f60 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f6b9c014040 tx=0x7f6b9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6b96ffd700 1 -- 172.21.15.8:0/3029027205 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9c019070 con 0x7f6ba00f6530 2023-10-18T22:01:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6b96ffd700 1 -- 172.21.15.8:0/3029027205 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6b9c01e420 con 0x7f6ba00f6530 2023-10-18T22:01:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6b96ffd700 1 -- 172.21.15.8:0/3029027205 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9c014620 con 0x7f6ba00f6530 2023-10-18T22:01:00.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.428+0000 7f6ba754f700 1 -- 172.21.15.8:0/3029027205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba010a480 con 0x7f6ba00f6530 2023-10-18T22:01:00.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.429+0000 7f6ba754f700 1 -- 172.21.15.8:0/3029027205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba010a960 con 0x7f6ba00f6530 2023-10-18T22:01:00.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.430+0000 7f6ba754f700 1 -- 172.21.15.8:0/3029027205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba0045ad0 con 0x7f6ba00f6530 2023-10-18T22:01:00.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.430+0000 7f6b96ffd700 1 -- 172.21.15.8:0/3029027205 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6b9c01e9e0 con 0x7f6ba00f6530 2023-10-18T22:01:00.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.431+0000 7f6b96ffd700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b8c060f70 0x7f6b8c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:00.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.431+0000 7f6b96ffd700 1 -- 172.21.15.8:0/3029027205 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6b9c07dcf0 con 0x7f6ba00f6530 2023-10-18T22:01:00.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.432+0000 7f6ba5d4c700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b8c060f70 0x7f6b8c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:00.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.432+0000 7f6ba5d4c700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b8c060f70 0x7f6b8c063430 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f6b90009fd0 tx=0x7f6b9000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:00.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.435+0000 7f6b96ffd700 1 -- 172.21.15.8:0/3029027205 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6b9c051390 con 0x7f6ba00f6530 2023-10-18T22:01:00.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.662+0000 7f6ba754f700 1 -- 172.21.15.8:0/3029027205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6ba00fc0e0 con 0x7f6ba00f6530 2023-10-18T22:01:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.662+0000 7f6b96ffd700 1 -- 172.21.15.8:0/3029027205 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f6b9c004490 con 0x7f6ba00f6530 2023-10-18T22:01:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:01:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:01:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:01:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:01:00.665 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:01:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:01:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:01:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:01:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:01:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:01:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:01:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:01:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:01:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:01:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:01:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:01:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:01:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:01:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:01:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:01:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:01:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:01:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:01:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:01:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:01:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:01:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:01:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:01:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:01:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:01:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:01:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:01:00.671 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:01:00.671 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:01:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.665+0000 7f6ba754f700 1 -- 172.21.15.8:0/3029027205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b8c060f70 msgr2=0x7f6b8c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.665+0000 7f6ba754f700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b8c060f70 0x7f6b8c063430 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f6b90009fd0 tx=0x7f6b9000b040).stop 2023-10-18T22:01:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.665+0000 7f6ba754f700 1 -- 172.21.15.8:0/3029027205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba00f6530 msgr2=0x7f6ba0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:00.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.665+0000 7f6ba754f700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba00f6530 0x7f6ba0108f60 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f6b9c014040 tx=0x7f6b9c00b040).stop 2023-10-18T22:01:00.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.665+0000 7f6ba754f700 1 -- 172.21.15.8:0/3029027205 shutdown_connections 2023-10-18T22:01:00.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.665+0000 7f6ba754f700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6b8c060f70 0x7f6b8c063430 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.665+0000 7f6ba754f700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ba00f6530 0x7f6ba0108f60 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.665+0000 7f6ba754f700 1 --2- 172.21.15.8:0/3029027205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba00f77d0 0x7f6ba0109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.665+0000 7f6ba754f700 1 -- 172.21.15.8:0/3029027205 >> 172.21.15.8:0/3029027205 conn(0x7f6ba00f1c90 msgr2=0x7f6ba006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:00.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.665+0000 7f6ba754f700 1 -- 172.21.15.8:0/3029027205 shutdown_connections 2023-10-18T22:01:00.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.666+0000 7f6ba754f700 1 -- 172.21.15.8:0/3029027205 wait complete. 2023-10-18T22:01:00.674 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:01:00.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.803+0000 7f39cb59e700 1 -- 172.21.15.8:0/3004131728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39cc0f77d0 msgr2=0x7f39cc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:00.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.803+0000 7f39cb59e700 1 --2- 172.21.15.8:0/3004131728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39cc0f77d0 0x7f39cc0f7c30 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f39c0004660 tx=0x7f39c0009b30).stop 2023-10-18T22:01:00.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.803+0000 7f39cb59e700 1 -- 172.21.15.8:0/3004131728 shutdown_connections 2023-10-18T22:01:00.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.803+0000 7f39cb59e700 1 --2- 172.21.15.8:0/3004131728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39cc0f77d0 0x7f39cc0f7c30 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.803+0000 7f39cb59e700 1 --2- 172.21.15.8:0/3004131728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39cc0f6530 0x7f39cc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.803+0000 7f39cb59e700 1 -- 172.21.15.8:0/3004131728 >> 172.21.15.8:0/3004131728 conn(0x7f39cc0f1c70 msgr2=0x7f39cc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:00.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.803+0000 7f39cb59e700 1 -- 172.21.15.8:0/3004131728 shutdown_connections 2023-10-18T22:01:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.803+0000 7f39cb59e700 1 -- 172.21.15.8:0/3004131728 wait complete. 2023-10-18T22:01:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.805+0000 7f39cb59e700 1 Processor -- start 2023-10-18T22:01:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.805+0000 7f39cb59e700 1 -- start start 2023-10-18T22:01:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.805+0000 7f39cb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39cc0f6530 0x7f39cc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.805+0000 7f39cb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39cc0f77d0 0x7f39cc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.805+0000 7f39cb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc06a380 con 0x7f39cc0f77d0 2023-10-18T22:01:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.805+0000 7f39cb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc06a4c0 con 0x7f39cc0f6530 2023-10-18T22:01:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.806+0000 7f39c9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39cc0f77d0 0x7f39cc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:00.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.806+0000 7f39c9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39cc0f77d0 0x7f39cc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39858/0 (socket says 172.21.15.8:39858) 2023-10-18T22:01:00.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.806+0000 7f39c9d9b700 1 -- 172.21.15.8:0/4188676432 learned_addr learned my addr 172.21.15.8:0/4188676432 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:01:00.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.806+0000 7f39ca59c700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39cc0f6530 0x7f39cc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:00.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.806+0000 7f39c9d9b700 1 -- 172.21.15.8:0/4188676432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39cc0f6530 msgr2=0x7f39cc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.806+0000 7f39c9d9b700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39cc0f6530 0x7f39cc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.806+0000 7f39c9d9b700 1 -- 172.21.15.8:0/4188676432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0005040 con 0x7f39cc0f77d0 2023-10-18T22:01:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.806+0000 7f39c9d9b700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39cc0f77d0 0x7f39cc069e20 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f39c0004320 tx=0x7f39c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.807+0000 7f39baffd700 1 -- 172.21.15.8:0/4188676432 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c0019070 con 0x7f39cc0f77d0 2023-10-18T22:01:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.807+0000 7f39cb59e700 1 -- 172.21.15.8:0/4188676432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc06a740 con 0x7f39cc0f77d0 2023-10-18T22:01:00.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.807+0000 7f39baffd700 1 -- 172.21.15.8:0/4188676432 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f39c001e420 con 0x7f39cc0f77d0 2023-10-18T22:01:00.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.807+0000 7f39baffd700 1 -- 172.21.15.8:0/4188676432 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c0014680 con 0x7f39cc0f77d0 2023-10-18T22:01:00.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.807+0000 7f39cb59e700 1 -- 172.21.15.8:0/4188676432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc06ac20 con 0x7f39cc0f77d0 2023-10-18T22:01:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.808+0000 7f39cb59e700 1 -- 172.21.15.8:0/4188676432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc045ad0 con 0x7f39cc0f77d0 2023-10-18T22:01:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.809+0000 7f39baffd700 1 -- 172.21.15.8:0/4188676432 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f39c001e590 con 0x7f39cc0f77d0 2023-10-18T22:01:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.809+0000 7f39baffd700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f39b4060f70 0x7f39b4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.809+0000 7f39baffd700 1 -- 172.21.15.8:0/4188676432 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f39c007dd10 con 0x7f39cc0f77d0 2023-10-18T22:01:00.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.810+0000 7f39ca59c700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f39b4060f70 0x7f39b4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:00.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.810+0000 7f39ca59c700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f39b4060f70 0x7f39b4063430 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f39cc06b730 tx=0x7f39bc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:00.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:00.814+0000 7f39baffd700 1 -- 172.21.15.8:0/4188676432 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f39c004d8e0 con 0x7f39cc0f77d0 2023-10-18T22:01:01.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.014+0000 7f39cb59e700 1 -- 172.21.15.8:0/4188676432 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39cc0fee20 con 0x7f39b4060f70 2023-10-18T22:01:01.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.015+0000 7f39baffd700 1 -- 172.21.15.8:0/4188676432 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f39cc0fee20 con 0x7f39b4060f70 2023-10-18T22:01:01.017 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:01:01.017 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:01:01.017 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:01:01.017 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:01:01.017 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:01:01.018 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:01:01.018 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:01:01.018 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:01:01.018 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:01:01.019 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:01:01.019 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:01:01.019 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:01:01.019 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:01:01.019 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:01:01.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.017+0000 7f39cb59e700 1 -- 172.21.15.8:0/4188676432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f39b4060f70 msgr2=0x7f39b4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:01.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.017+0000 7f39cb59e700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f39b4060f70 0x7f39b4063430 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f39cc06b730 tx=0x7f39bc00b040).stop 2023-10-18T22:01:01.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.017+0000 7f39cb59e700 1 -- 172.21.15.8:0/4188676432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39cc0f77d0 msgr2=0x7f39cc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:01.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.017+0000 7f39cb59e700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39cc0f77d0 0x7f39cc069e20 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f39c0004320 tx=0x7f39c000b040).stop 2023-10-18T22:01:01.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.018+0000 7f39cb59e700 1 -- 172.21.15.8:0/4188676432 shutdown_connections 2023-10-18T22:01:01.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.018+0000 7f39cb59e700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f39b4060f70 0x7f39b4063430 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:01.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.018+0000 7f39cb59e700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39cc0f6530 0x7f39cc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:01.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.018+0000 7f39cb59e700 1 --2- 172.21.15.8:0/4188676432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39cc0f77d0 0x7f39cc069e20 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:01.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.018+0000 7f39cb59e700 1 -- 172.21.15.8:0/4188676432 >> 172.21.15.8:0/4188676432 conn(0x7f39cc0f1c70 msgr2=0x7f39cc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:01.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.018+0000 7f39cb59e700 1 -- 172.21.15.8:0/4188676432 shutdown_connections 2023-10-18T22:01:01.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:01.018+0000 7f39cb59e700 1 -- 172.21.15.8:0/4188676432 wait complete. 2023-10-18T22:01:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:59.531940+0000 mgr.smithi008.flmjzp (mgr.14640) 3725 : audit [DBG] from='client.37052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:00:59.811061+0000 mgr.smithi008.flmjzp (mgr.14640) 3726 : cluster [DBG] pgmap v2560: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:01.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:00:59.875821+0000 mgr.smithi008.flmjzp (mgr.14640) 3727 : audit [DBG] from='client.37056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:01.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:00.288392+0000 mon.smithi008 (mon.0) 4064 : audit [DBG] from='client.? 172.21.15.8:0/2932704788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:01.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:00.663056+0000 mon.smithi008 (mon.0) 4065 : audit [DBG] from='client.? 172.21.15.8:0/3029027205' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:01:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:59.531940+0000 mgr.smithi008.flmjzp (mgr.14640) 3725 : audit [DBG] from='client.37052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:00:59.811061+0000 mgr.smithi008.flmjzp (mgr.14640) 3726 : cluster [DBG] pgmap v2560: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:00:59.875821+0000 mgr.smithi008.flmjzp (mgr.14640) 3727 : audit [DBG] from='client.37056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:00.288392+0000 mon.smithi008 (mon.0) 4064 : audit [DBG] from='client.? 172.21.15.8:0/2932704788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:00.663056+0000 mon.smithi008 (mon.0) 4065 : audit [DBG] from='client.? 172.21.15.8:0/3029027205' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:01:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:01.015771+0000 mgr.smithi008.flmjzp (mgr.14640) 3728 : audit [DBG] from='client.37068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:01.015771+0000 mgr.smithi008.flmjzp (mgr.14640) 3728 : audit [DBG] from='client.37068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:03.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:01.811778+0000 mgr.smithi008.flmjzp (mgr.14640) 3729 : cluster [DBG] pgmap v2561: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:03.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:01.811778+0000 mgr.smithi008.flmjzp (mgr.14640) 3729 : cluster [DBG] pgmap v2561: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:03.841143+0000 mon.smithi008 (mon.0) 4066 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:03.843068+0000 mon.smithi008 (mon.0) 4067 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:03.844022+0000 mon.smithi008 (mon.0) 4068 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:03.850426+0000 mon.smithi008 (mon.0) 4069 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:03.856190+0000 mon.smithi008 (mon.0) 4070 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:04.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:03.859112+0000 mon.smithi008 (mon.0) 4071 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:04.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:03.860603+0000 mon.smithi008 (mon.0) 4072 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:04.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:03.862111+0000 mon.smithi008 (mon.0) 4073 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:04.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:03.863982+0000 mon.smithi008 (mon.0) 4074 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:03.841143+0000 mon.smithi008 (mon.0) 4066 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:03.843068+0000 mon.smithi008 (mon.0) 4067 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:03.844022+0000 mon.smithi008 (mon.0) 4068 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:04.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:03.850426+0000 mon.smithi008 (mon.0) 4069 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:03.856190+0000 mon.smithi008 (mon.0) 4070 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:03.859112+0000 mon.smithi008 (mon.0) 4071 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:03.860603+0000 mon.smithi008 (mon.0) 4072 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:03.862111+0000 mon.smithi008 (mon.0) 4073 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:04.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:03.863982+0000 mon.smithi008 (mon.0) 4074 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:05.215 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:03.812358+0000 mgr.smithi008.flmjzp (mgr.14640) 3730 : cluster [DBG] pgmap v2562: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:05.215 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:03.844848+0000 mgr.smithi008.flmjzp (mgr.14640) 3731 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:05.216 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:03.845412+0000 mgr.smithi008.flmjzp (mgr.14640) 3732 : cluster [DBG] pgmap v2563: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:05.216 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:03.845664+0000 mgr.smithi008.flmjzp (mgr.14640) 3733 : cluster [DBG] pgmap v2564: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:05.216 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:03.865742+0000 mgr.smithi008.flmjzp (mgr.14640) 3734 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:03.812358+0000 mgr.smithi008.flmjzp (mgr.14640) 3730 : cluster [DBG] pgmap v2562: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:03.844848+0000 mgr.smithi008.flmjzp (mgr.14640) 3731 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:03.845412+0000 mgr.smithi008.flmjzp (mgr.14640) 3732 : cluster [DBG] pgmap v2563: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:05.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:03.845664+0000 mgr.smithi008.flmjzp (mgr.14640) 3733 : cluster [DBG] pgmap v2564: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:05.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:03.865742+0000 mgr.smithi008.flmjzp (mgr.14640) 3734 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:07.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:05.846191+0000 mgr.smithi008.flmjzp (mgr.14640) 3735 : cluster [DBG] pgmap v2565: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:05.846191+0000 mgr.smithi008.flmjzp (mgr.14640) 3735 : cluster [DBG] pgmap v2565: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:07.846909+0000 mgr.smithi008.flmjzp (mgr.14640) 3736 : cluster [DBG] pgmap v2566: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:07.846909+0000 mgr.smithi008.flmjzp (mgr.14640) 3736 : cluster [DBG] pgmap v2566: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:11.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:09.847504+0000 mgr.smithi008.flmjzp (mgr.14640) 3737 : cluster [DBG] pgmap v2567: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:09.847504+0000 mgr.smithi008.flmjzp (mgr.14640) 3737 : cluster [DBG] pgmap v2567: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:13.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:11.848229+0000 mgr.smithi008.flmjzp (mgr.14640) 3738 : cluster [DBG] pgmap v2568: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:11.848229+0000 mgr.smithi008.flmjzp (mgr.14640) 3738 : cluster [DBG] pgmap v2568: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:13.876370+0000 mon.smithi008 (mon.0) 4075 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:14.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:13.878609+0000 mon.smithi008 (mon.0) 4076 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:14.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:13.879672+0000 mon.smithi008 (mon.0) 4077 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:14.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:13.886339+0000 mon.smithi008 (mon.0) 4078 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:14.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:13.892726+0000 mon.smithi008 (mon.0) 4079 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:14.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:13.896035+0000 mon.smithi008 (mon.0) 4080 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:14.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:13.897802+0000 mon.smithi008 (mon.0) 4081 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:14.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:13.899457+0000 mon.smithi008 (mon.0) 4082 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:14.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:13.901437+0000 mon.smithi008 (mon.0) 4083 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:13.876370+0000 mon.smithi008 (mon.0) 4075 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:13.878609+0000 mon.smithi008 (mon.0) 4076 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:14.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:13.879672+0000 mon.smithi008 (mon.0) 4077 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:14.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:13.886339+0000 mon.smithi008 (mon.0) 4078 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:14.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:13.892726+0000 mon.smithi008 (mon.0) 4079 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:14.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:13.896035+0000 mon.smithi008 (mon.0) 4080 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:14.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:13.897802+0000 mon.smithi008 (mon.0) 4081 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:14.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:13.899457+0000 mon.smithi008 (mon.0) 4082 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:14.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:13.901437+0000 mon.smithi008 (mon.0) 4083 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:13.848921+0000 mgr.smithi008.flmjzp (mgr.14640) 3739 : cluster [DBG] pgmap v2569: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:13.880651+0000 mgr.smithi008.flmjzp (mgr.14640) 3740 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:13.881270+0000 mgr.smithi008.flmjzp (mgr.14640) 3741 : cluster [DBG] pgmap v2570: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:15.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:13.881535+0000 mgr.smithi008.flmjzp (mgr.14640) 3742 : cluster [DBG] pgmap v2571: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:15.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:13.903424+0000 mgr.smithi008.flmjzp (mgr.14640) 3743 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:13.848921+0000 mgr.smithi008.flmjzp (mgr.14640) 3739 : cluster [DBG] pgmap v2569: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:13.880651+0000 mgr.smithi008.flmjzp (mgr.14640) 3740 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:13.881270+0000 mgr.smithi008.flmjzp (mgr.14640) 3741 : cluster [DBG] pgmap v2570: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:13.881535+0000 mgr.smithi008.flmjzp (mgr.14640) 3742 : cluster [DBG] pgmap v2571: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:13.903424+0000 mgr.smithi008.flmjzp (mgr.14640) 3743 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:15.882071+0000 mgr.smithi008.flmjzp (mgr.14640) 3744 : cluster [DBG] pgmap v2572: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:15.882071+0000 mgr.smithi008.flmjzp (mgr.14640) 3744 : cluster [DBG] pgmap v2572: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:17.882529+0000 mgr.smithi008.flmjzp (mgr.14640) 3745 : cluster [DBG] pgmap v2573: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:17.882529+0000 mgr.smithi008.flmjzp (mgr.14640) 3745 : cluster [DBG] pgmap v2573: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:19.883293+0000 mgr.smithi008.flmjzp (mgr.14640) 3746 : cluster [DBG] pgmap v2574: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:19.883293+0000 mgr.smithi008.flmjzp (mgr.14640) 3746 : cluster [DBG] pgmap v2574: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:21.883788+0000 mgr.smithi008.flmjzp (mgr.14640) 3747 : cluster [DBG] pgmap v2575: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:21.883788+0000 mgr.smithi008.flmjzp (mgr.14640) 3747 : cluster [DBG] pgmap v2575: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:23.914162+0000 mon.smithi008 (mon.0) 4084 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:24.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:23.916372+0000 mon.smithi008 (mon.0) 4085 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:24.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:23.917350+0000 mon.smithi008 (mon.0) 4086 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:24.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:23.923910+0000 mon.smithi008 (mon.0) 4087 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:24.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:23.931791+0000 mon.smithi008 (mon.0) 4088 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:24.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:23.935292+0000 mon.smithi008 (mon.0) 4089 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:24.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:23.937217+0000 mon.smithi008 (mon.0) 4090 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:24.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:23.939098+0000 mon.smithi008 (mon.0) 4091 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:24.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:23.941195+0000 mon.smithi008 (mon.0) 4092 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:23.914162+0000 mon.smithi008 (mon.0) 4084 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:23.916372+0000 mon.smithi008 (mon.0) 4085 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:23.917350+0000 mon.smithi008 (mon.0) 4086 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:24.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:23.923910+0000 mon.smithi008 (mon.0) 4087 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:24.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:23.931791+0000 mon.smithi008 (mon.0) 4088 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:24.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:23.935292+0000 mon.smithi008 (mon.0) 4089 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:24.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:23.937217+0000 mon.smithi008 (mon.0) 4090 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:24.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:23.939098+0000 mon.smithi008 (mon.0) 4091 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:24.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:23.941195+0000 mon.smithi008 (mon.0) 4092 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:23.884360+0000 mgr.smithi008.flmjzp (mgr.14640) 3748 : cluster [DBG] pgmap v2576: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:23.918184+0000 mgr.smithi008.flmjzp (mgr.14640) 3749 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:23.918793+0000 mgr.smithi008.flmjzp (mgr.14640) 3750 : cluster [DBG] pgmap v2577: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:23.919018+0000 mgr.smithi008.flmjzp (mgr.14640) 3751 : cluster [DBG] pgmap v2578: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:23.943129+0000 mgr.smithi008.flmjzp (mgr.14640) 3752 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:23.884360+0000 mgr.smithi008.flmjzp (mgr.14640) 3748 : cluster [DBG] pgmap v2576: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:23.918184+0000 mgr.smithi008.flmjzp (mgr.14640) 3749 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:23.918793+0000 mgr.smithi008.flmjzp (mgr.14640) 3750 : cluster [DBG] pgmap v2577: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:23.919018+0000 mgr.smithi008.flmjzp (mgr.14640) 3751 : cluster [DBG] pgmap v2578: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:23.943129+0000 mgr.smithi008.flmjzp (mgr.14640) 3752 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:25.919677+0000 mgr.smithi008.flmjzp (mgr.14640) 3753 : cluster [DBG] pgmap v2579: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:25.919677+0000 mgr.smithi008.flmjzp (mgr.14640) 3753 : cluster [DBG] pgmap v2579: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:27.920212+0000 mgr.smithi008.flmjzp (mgr.14640) 3754 : cluster [DBG] pgmap v2580: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:27.920212+0000 mgr.smithi008.flmjzp (mgr.14640) 3754 : cluster [DBG] pgmap v2580: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:31.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.170+0000 7f582696b700 1 -- 172.21.15.8:0/1446768406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58200f77d0 msgr2=0x7f58200f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.170+0000 7f582696b700 1 --2- 172.21.15.8:0/1446768406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58200f77d0 0x7f58200f7c30 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f5810004660 tx=0x7f5810009b30).stop 2023-10-18T22:01:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.170+0000 7f582696b700 1 -- 172.21.15.8:0/1446768406 shutdown_connections 2023-10-18T22:01:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.170+0000 7f582696b700 1 --2- 172.21.15.8:0/1446768406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58200f77d0 0x7f58200f7c30 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.170+0000 7f582696b700 1 --2- 172.21.15.8:0/1446768406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58200f6530 0x7f58200f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.170+0000 7f582696b700 1 -- 172.21.15.8:0/1446768406 >> 172.21.15.8:0/1446768406 conn(0x7f58200f1c90 msgr2=0x7f58200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.170+0000 7f582696b700 1 -- 172.21.15.8:0/1446768406 shutdown_connections 2023-10-18T22:01:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.170+0000 7f582696b700 1 -- 172.21.15.8:0/1446768406 wait complete. 2023-10-18T22:01:31.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.171+0000 7f582696b700 1 Processor -- start 2023-10-18T22:01:31.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.171+0000 7f582696b700 1 -- start start 2023-10-18T22:01:31.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f582696b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58200f6530 0x7f5820106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:31.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f582696b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58200f77d0 0x7f5820107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:31.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f582696b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5820107830 con 0x7f58200f6530 2023-10-18T22:01:31.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f582696b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5820108040 con 0x7f58200f77d0 2023-10-18T22:01:31.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f5825969700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58200f6530 0x7f5820106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:31.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f5825969700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58200f6530 0x7f5820106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57334/0 (socket says 172.21.15.8:57334) 2023-10-18T22:01:31.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f5825969700 1 -- 172.21.15.8:0/3724499993 learned_addr learned my addr 172.21.15.8:0/3724499993 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:01:31.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f5825168700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58200f77d0 0x7f5820107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f5825969700 1 -- 172.21.15.8:0/3724499993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58200f77d0 msgr2=0x7f5820107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f5825969700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58200f77d0 0x7f5820107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.172+0000 7f5825969700 1 -- 172.21.15.8:0/3724499993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5810005040 con 0x7f58200f6530 2023-10-18T22:01:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.173+0000 7f5825969700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58200f6530 0x7f5820106d40 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f581c002700 tx=0x7f581c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.173+0000 7f58167fc700 1 -- 172.21.15.8:0/3724499993 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f581c0079c0 con 0x7f58200f6530 2023-10-18T22:01:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.173+0000 7f58167fc700 1 -- 172.21.15.8:0/3724499993 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f581c00f040 con 0x7f58200f6530 2023-10-18T22:01:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.173+0000 7f582696b700 1 -- 172.21.15.8:0/3724499993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58201082c0 con 0x7f58200f6530 2023-10-18T22:01:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.173+0000 7f58167fc700 1 -- 172.21.15.8:0/3724499993 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f581c0148d0 con 0x7f58200f6530 2023-10-18T22:01:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.173+0000 7f582696b700 1 -- 172.21.15.8:0/3724499993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5820108880 con 0x7f58200f6530 2023-10-18T22:01:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.174+0000 7f582696b700 1 -- 172.21.15.8:0/3724499993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5820059100 con 0x7f58200f6530 2023-10-18T22:01:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.175+0000 7f58167fc700 1 -- 172.21.15.8:0/3724499993 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f581c01b060 con 0x7f58200f6530 2023-10-18T22:01:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.176+0000 7f58167fc700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f580c060f70 0x7f580c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.176+0000 7f58167fc700 1 -- 172.21.15.8:0/3724499993 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f581c07c770 con 0x7f58200f6530 2023-10-18T22:01:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.176+0000 7f5825168700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f580c060f70 0x7f580c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:31.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.177+0000 7f5825168700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f580c060f70 0x7f580c063430 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f5810004630 tx=0x7f5810009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:31.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.180+0000 7f58167fc700 1 -- 172.21.15.8:0/3724499993 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f581c04c3a0 con 0x7f58200f6530 2023-10-18T22:01:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.379+0000 7f582696b700 1 -- 172.21.15.8:0/3724499993 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58200fedf0 con 0x7f580c060f70 2023-10-18T22:01:31.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.380+0000 7f58167fc700 1 -- 172.21.15.8:0/3724499993 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f58200fedf0 con 0x7f580c060f70 2023-10-18T22:01:31.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.382+0000 7f582696b700 1 -- 172.21.15.8:0/3724499993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f580c060f70 msgr2=0x7f580c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:31.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.382+0000 7f582696b700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f580c060f70 0x7f580c063430 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f5810004630 tx=0x7f5810009b30).stop 2023-10-18T22:01:31.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.382+0000 7f582696b700 1 -- 172.21.15.8:0/3724499993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58200f6530 msgr2=0x7f5820106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:31.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.382+0000 7f582696b700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58200f6530 0x7f5820106d40 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f581c002700 tx=0x7f581c009d80).stop 2023-10-18T22:01:31.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.382+0000 7f582696b700 1 -- 172.21.15.8:0/3724499993 shutdown_connections 2023-10-18T22:01:31.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.382+0000 7f582696b700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f580c060f70 0x7f580c063430 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.382+0000 7f582696b700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58200f6530 0x7f5820106d40 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.382+0000 7f582696b700 1 --2- 172.21.15.8:0/3724499993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58200f77d0 0x7f5820107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.382+0000 7f582696b700 1 -- 172.21.15.8:0/3724499993 >> 172.21.15.8:0/3724499993 conn(0x7f58200f1c90 msgr2=0x7f58200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:31.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.383+0000 7f582696b700 1 -- 172.21.15.8:0/3724499993 shutdown_connections 2023-10-18T22:01:31.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.383+0000 7f582696b700 1 -- 172.21.15.8:0/3724499993 wait complete. 2023-10-18T22:01:31.399 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:01:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:29.920849+0000 mgr.smithi008.flmjzp (mgr.14640) 3755 : cluster [DBG] pgmap v2581: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:29.920849+0000 mgr.smithi008.flmjzp (mgr.14640) 3755 : cluster [DBG] pgmap v2581: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:31.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.520+0000 7f1f94d2d700 1 -- 172.21.15.8:0/3754203000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f900f6530 msgr2=0x7f1f900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:31.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.520+0000 7f1f94d2d700 1 --2- 172.21.15.8:0/3754203000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f900f6530 0x7f1f900f6950 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f1f80004660 tx=0x7f1f80009b30).stop 2023-10-18T22:01:31.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.520+0000 7f1f94d2d700 1 -- 172.21.15.8:0/3754203000 shutdown_connections 2023-10-18T22:01:31.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.520+0000 7f1f94d2d700 1 --2- 172.21.15.8:0/3754203000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f900f77d0 0x7f1f900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.520+0000 7f1f94d2d700 1 --2- 172.21.15.8:0/3754203000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f900f6530 0x7f1f900f6950 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.520+0000 7f1f94d2d700 1 -- 172.21.15.8:0/3754203000 >> 172.21.15.8:0/3754203000 conn(0x7f1f900f1c70 msgr2=0x7f1f900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:31.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.520+0000 7f1f94d2d700 1 -- 172.21.15.8:0/3754203000 shutdown_connections 2023-10-18T22:01:31.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.520+0000 7f1f94d2d700 1 -- 172.21.15.8:0/3754203000 wait complete. 2023-10-18T22:01:31.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.521+0000 7f1f94d2d700 1 Processor -- start 2023-10-18T22:01:31.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.521+0000 7f1f94d2d700 1 -- start start 2023-10-18T22:01:31.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.521+0000 7f1f94d2d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f900f6530 0x7f1f90108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:31.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.521+0000 7f1f94d2d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f900f77d0 0x7f1f901094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:31.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.522+0000 7f1f94d2d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90109a80 con 0x7f1f900f6530 2023-10-18T22:01:31.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.522+0000 7f1f94d2d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90109bc0 con 0x7f1f900f77d0 2023-10-18T22:01:31.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.522+0000 7f1f8f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f900f6530 0x7f1f90108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:31.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.522+0000 7f1f8f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f900f6530 0x7f1f90108fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57344/0 (socket says 172.21.15.8:57344) 2023-10-18T22:01:31.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.522+0000 7f1f8f7fe700 1 -- 172.21.15.8:0/2911381702 learned_addr learned my addr 172.21.15.8:0/2911381702 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:01:31.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.522+0000 7f1f8effd700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f900f77d0 0x7f1f901094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:31.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.522+0000 7f1f8f7fe700 1 -- 172.21.15.8:0/2911381702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f900f77d0 msgr2=0x7f1f901094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:31.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.522+0000 7f1f8f7fe700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f900f77d0 0x7f1f901094d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.522+0000 7f1f8f7fe700 1 -- 172.21.15.8:0/2911381702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80005040 con 0x7f1f900f6530 2023-10-18T22:01:31.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.522+0000 7f1f8f7fe700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f900f6530 0x7f1f90108fe0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f1f80007a60 tx=0x7f1f80009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:31.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.523+0000 7f1f77fff700 1 -- 172.21.15.8:0/2911381702 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f80018070 con 0x7f1f900f6530 2023-10-18T22:01:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.523+0000 7f1f77fff700 1 -- 172.21.15.8:0/2911381702 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1f80009630 con 0x7f1f900f6530 2023-10-18T22:01:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.523+0000 7f1f77fff700 1 -- 172.21.15.8:0/2911381702 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f8001c540 con 0x7f1f900f6530 2023-10-18T22:01:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.523+0000 7f1f94d2d700 1 -- 172.21.15.8:0/2911381702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9010a500 con 0x7f1f900f6530 2023-10-18T22:01:31.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.523+0000 7f1f94d2d700 1 -- 172.21.15.8:0/2911381702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9010aa60 con 0x7f1f900f6530 2023-10-18T22:01:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.524+0000 7f1f94d2d700 1 -- 172.21.15.8:0/2911381702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f90045ad0 con 0x7f1f900f6530 2023-10-18T22:01:31.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.525+0000 7f1f77fff700 1 -- 172.21.15.8:0/2911381702 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1f8001d420 con 0x7f1f900f6530 2023-10-18T22:01:31.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.525+0000 7f1f77fff700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f78060f70 0x7f1f78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:31.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.526+0000 7f1f77fff700 1 -- 172.21.15.8:0/2911381702 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1f8007e600 con 0x7f1f900f6530 2023-10-18T22:01:31.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.526+0000 7f1f8effd700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f78060f70 0x7f1f78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:31.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.526+0000 7f1f8effd700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f78060f70 0x7f1f78063430 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f1f840096c0 tx=0x7f1f84009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:31.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.530+0000 7f1f77fff700 1 -- 172.21.15.8:0/2911381702 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1f80051d20 con 0x7f1f900f6530 2023-10-18T22:01:31.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.727+0000 7f1f94d2d700 1 -- 172.21.15.8:0/2911381702 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f900fedd0 con 0x7f1f78060f70 2023-10-18T22:01:31.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.728+0000 7f1f77fff700 1 -- 172.21.15.8:0/2911381702 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1f900fedd0 con 0x7f1f78060f70 2023-10-18T22:01:31.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.730+0000 7f1f94d2d700 1 -- 172.21.15.8:0/2911381702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f78060f70 msgr2=0x7f1f78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:31.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.730+0000 7f1f94d2d700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f78060f70 0x7f1f78063430 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f1f840096c0 tx=0x7f1f84009be0).stop 2023-10-18T22:01:31.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.730+0000 7f1f94d2d700 1 -- 172.21.15.8:0/2911381702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f900f6530 msgr2=0x7f1f90108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:31.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.730+0000 7f1f94d2d700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f900f6530 0x7f1f90108fe0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f1f80007a60 tx=0x7f1f80009b30).stop 2023-10-18T22:01:31.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.730+0000 7f1f94d2d700 1 -- 172.21.15.8:0/2911381702 shutdown_connections 2023-10-18T22:01:31.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.730+0000 7f1f94d2d700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f78060f70 0x7f1f78063430 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.731+0000 7f1f94d2d700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f900f6530 0x7f1f90108fe0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.731+0000 7f1f94d2d700 1 --2- 172.21.15.8:0/2911381702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f900f77d0 0x7f1f901094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.731+0000 7f1f94d2d700 1 -- 172.21.15.8:0/2911381702 >> 172.21.15.8:0/2911381702 conn(0x7f1f900f1c70 msgr2=0x7f1f9006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:31.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.731+0000 7f1f94d2d700 1 -- 172.21.15.8:0/2911381702 shutdown_connections 2023-10-18T22:01:31.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.731+0000 7f1f94d2d700 1 -- 172.21.15.8:0/2911381702 wait complete. 2023-10-18T22:01:31.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.867+0000 7f025f59e700 1 -- 172.21.15.8:0/142301117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026006c340 msgr2=0x7f026006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:31.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.867+0000 7f025f59e700 1 --2- 172.21.15.8:0/142301117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026006c340 0x7f026006c760 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f0250004660 tx=0x7f0250009b30).stop 2023-10-18T22:01:31.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.868+0000 7f025f59e700 1 -- 172.21.15.8:0/142301117 shutdown_connections 2023-10-18T22:01:31.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.868+0000 7f025f59e700 1 --2- 172.21.15.8:0/142301117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026006d630 0x7f026006dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.868+0000 7f025f59e700 1 --2- 172.21.15.8:0/142301117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026006c340 0x7f026006c760 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.868+0000 7f025f59e700 1 -- 172.21.15.8:0/142301117 >> 172.21.15.8:0/142301117 conn(0x7f02600f40e0 msgr2=0x7f02600f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:31.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.868+0000 7f025f59e700 1 -- 172.21.15.8:0/142301117 shutdown_connections 2023-10-18T22:01:31.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.868+0000 7f025f59e700 1 -- 172.21.15.8:0/142301117 wait complete. 2023-10-18T22:01:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.868+0000 7f025f59e700 1 Processor -- start 2023-10-18T22:01:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.869+0000 7f025f59e700 1 -- start start 2023-10-18T22:01:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.869+0000 7f025f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026006c340 0x7f026010d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.869+0000 7f025f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026006d630 0x7f026010d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.869+0000 7f025f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026010ddf0 con 0x7f026006d630 2023-10-18T22:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.869+0000 7f025f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026010df30 con 0x7f026006c340 2023-10-18T22:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.869+0000 7f025dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026006d630 0x7f026010d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.869+0000 7f025dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026006d630 0x7f026010d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57362/0 (socket says 172.21.15.8:57362) 2023-10-18T22:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.869+0000 7f025dd9b700 1 -- 172.21.15.8:0/4121496563 learned_addr learned my addr 172.21.15.8:0/4121496563 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.869+0000 7f025e59c700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026006c340 0x7f026010d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.870+0000 7f025dd9b700 1 -- 172.21.15.8:0/4121496563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026006c340 msgr2=0x7f026010d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.870+0000 7f025dd9b700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026006c340 0x7f026010d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.870+0000 7f025dd9b700 1 -- 172.21.15.8:0/4121496563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250005040 con 0x7f026006d630 2023-10-18T22:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.870+0000 7f025dd9b700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026006d630 0x7f026010d840 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f025400c790 tx=0x7f0254007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.870+0000 7f024effd700 1 -- 172.21.15.8:0/4121496563 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025400e680 con 0x7f026006d630 2023-10-18T22:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.870+0000 7f024effd700 1 -- 172.21.15.8:0/4121496563 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f025400eca0 con 0x7f026006d630 2023-10-18T22:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.870+0000 7f025f59e700 1 -- 172.21.15.8:0/4121496563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026010e8d0 con 0x7f026006d630 2023-10-18T22:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.870+0000 7f024effd700 1 -- 172.21.15.8:0/4121496563 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0254013de0 con 0x7f026006d630 2023-10-18T22:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.870+0000 7f025f59e700 1 -- 172.21.15.8:0/4121496563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026010ee90 con 0x7f026006d630 2023-10-18T22:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.871+0000 7f025f59e700 1 -- 172.21.15.8:0/4121496563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0260045ad0 con 0x7f026006d630 2023-10-18T22:01:31.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.872+0000 7f024effd700 1 -- 172.21.15.8:0/4121496563 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f025401a060 con 0x7f026006d630 2023-10-18T22:01:31.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.873+0000 7f024effd700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0248060f70 0x7f0248063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:31.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.873+0000 7f024effd700 1 -- 172.21.15.8:0/4121496563 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f025407cb70 con 0x7f026006d630 2023-10-18T22:01:31.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.873+0000 7f025e59c700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0248060f70 0x7f0248063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:31.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.874+0000 7f025e59c700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0248060f70 0x7f0248063430 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f0250009490 tx=0x7f0250009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:31.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:31.877+0000 7f024effd700 1 -- 172.21.15.8:0/4121496563 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f02540501d0 con 0x7f026006d630 2023-10-18T22:01:32.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.069+0000 7f025f59e700 1 -- 172.21.15.8:0/4121496563 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0260105460 con 0x7f0248060f70 2023-10-18T22:01:32.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.078+0000 7f024effd700 1 -- 172.21.15.8:0/4121496563 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0260105460 con 0x7f0248060f70 2023-10-18T22:01:32.081 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:01:32.081 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (68m) 5m ago 69m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:01:32.081 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (62m) 5m ago 69m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:01:32.082 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (62m) 3m ago 68m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:01:32.082 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (68m) 5m ago 69m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:01:32.082 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 65m - - 2023-10-18T22:01:32.082 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 65m - - 2023-10-18T22:01:32.082 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 65m - - 2023-10-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 65m - - 2023-10-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (63m) 5m ago 71m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (62m) 3m ago 68m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (62m) 5m ago 71m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:01:32.083 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (62m) 3m ago 68m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (69m) 5m ago 69m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (68m) 3m ago 68m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (61m) 5m ago 68m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (59m) 5m ago 67m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:01:32.084 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (59m) 5m ago 67m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (58m) 3m ago 67m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (58m) 3m ago 67m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (57m) 3m ago 66m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:01:32.085 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (63m) 5m ago 68m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:01:32.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.080+0000 7f025f59e700 1 -- 172.21.15.8:0/4121496563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0248060f70 msgr2=0x7f0248063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.080+0000 7f025f59e700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0248060f70 0x7f0248063430 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f0250009490 tx=0x7f0250009b30).stop 2023-10-18T22:01:32.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.080+0000 7f025f59e700 1 -- 172.21.15.8:0/4121496563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026006d630 msgr2=0x7f026010d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.080+0000 7f025f59e700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026006d630 0x7f026010d840 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f025400c790 tx=0x7f0254007d70).stop 2023-10-18T22:01:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.081+0000 7f025f59e700 1 -- 172.21.15.8:0/4121496563 shutdown_connections 2023-10-18T22:01:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.081+0000 7f025f59e700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0248060f70 0x7f0248063430 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.081+0000 7f025f59e700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026006c340 0x7f026010d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.081+0000 7f025f59e700 1 --2- 172.21.15.8:0/4121496563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026006d630 0x7f026010d840 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.081+0000 7f025f59e700 1 -- 172.21.15.8:0/4121496563 >> 172.21.15.8:0/4121496563 conn(0x7f02600f40e0 msgr2=0x7f0260103300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:32.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.081+0000 7f025f59e700 1 -- 172.21.15.8:0/4121496563 shutdown_connections 2023-10-18T22:01:32.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.081+0000 7f025f59e700 1 -- 172.21.15.8:0/4121496563 wait complete. 2023-10-18T22:01:32.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.216+0000 7f62c7065700 1 -- 172.21.15.8:0/2449082121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62c00f6530 msgr2=0x7f62c00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.216+0000 7f62c7065700 1 --2- 172.21.15.8:0/2449082121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62c00f6530 0x7f62c00f6950 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f62bc004660 tx=0x7f62bc009b30).stop 2023-10-18T22:01:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.216+0000 7f62c7065700 1 -- 172.21.15.8:0/2449082121 shutdown_connections 2023-10-18T22:01:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.216+0000 7f62c7065700 1 --2- 172.21.15.8:0/2449082121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62c00f77d0 0x7f62c00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.216+0000 7f62c7065700 1 --2- 172.21.15.8:0/2449082121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62c00f6530 0x7f62c00f6950 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.216+0000 7f62c7065700 1 -- 172.21.15.8:0/2449082121 >> 172.21.15.8:0/2449082121 conn(0x7f62c00f1c90 msgr2=0x7f62c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:32.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.216+0000 7f62c7065700 1 -- 172.21.15.8:0/2449082121 shutdown_connections 2023-10-18T22:01:32.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.216+0000 7f62c7065700 1 -- 172.21.15.8:0/2449082121 wait complete. 2023-10-18T22:01:32.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.217+0000 7f62c7065700 1 Processor -- start 2023-10-18T22:01:32.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.217+0000 7f62c7065700 1 -- start start 2023-10-18T22:01:32.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.217+0000 7f62c7065700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62c00f6530 0x7f62c0108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:32.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.217+0000 7f62c7065700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62c00f77d0 0x7f62c01094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:32.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.217+0000 7f62c7065700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0109a60 con 0x7f62c00f77d0 2023-10-18T22:01:32.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.217+0000 7f62c7065700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0109ba0 con 0x7f62c00f6530 2023-10-18T22:01:32.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.218+0000 7f62c5862700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62c00f77d0 0x7f62c01094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:32.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.218+0000 7f62c5862700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62c00f77d0 0x7f62c01094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57382/0 (socket says 172.21.15.8:57382) 2023-10-18T22:01:32.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.218+0000 7f62c5862700 1 -- 172.21.15.8:0/3311045788 learned_addr learned my addr 172.21.15.8:0/3311045788 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:01:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.218+0000 7f62c6063700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62c00f6530 0x7f62c0108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.218+0000 7f62c5862700 1 -- 172.21.15.8:0/3311045788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62c00f6530 msgr2=0x7f62c0108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.218+0000 7f62c5862700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62c00f6530 0x7f62c0108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.218+0000 7f62c5862700 1 -- 172.21.15.8:0/3311045788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc005040 con 0x7f62c00f77d0 2023-10-18T22:01:32.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.218+0000 7f62c5862700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62c00f77d0 0x7f62c01094b0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f62b000c790 tx=0x7f62b0007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.219+0000 7f62b6ffd700 1 -- 172.21.15.8:0/3311045788 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62b0002590 con 0x7f62c00f77d0 2023-10-18T22:01:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.219+0000 7f62b6ffd700 1 -- 172.21.15.8:0/3311045788 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f62b0002bb0 con 0x7f62c00f77d0 2023-10-18T22:01:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.219+0000 7f62c7065700 1 -- 172.21.15.8:0/3311045788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c010a540 con 0x7f62c00f77d0 2023-10-18T22:01:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.219+0000 7f62b6ffd700 1 -- 172.21.15.8:0/3311045788 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62b0013e10 con 0x7f62c00f77d0 2023-10-18T22:01:32.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.219+0000 7f62c7065700 1 -- 172.21.15.8:0/3311045788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c010ab00 con 0x7f62c00f77d0 2023-10-18T22:01:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.220+0000 7f62c7065700 1 -- 172.21.15.8:0/3311045788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c0045ad0 con 0x7f62c00f77d0 2023-10-18T22:01:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.221+0000 7f62b6ffd700 1 -- 172.21.15.8:0/3311045788 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f62b001a060 con 0x7f62c00f77d0 2023-10-18T22:01:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.222+0000 7f62b6ffd700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f62ac060f70 0x7f62ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.222+0000 7f62b6ffd700 1 -- 172.21.15.8:0/3311045788 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f62b007cbe0 con 0x7f62c00f77d0 2023-10-18T22:01:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.222+0000 7f62c6063700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f62ac060f70 0x7f62ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.222+0000 7f62c6063700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f62ac060f70 0x7f62ac063430 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f62bc009f50 tx=0x7f62bc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:32.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.226+0000 7f62b6ffd700 1 -- 172.21.15.8:0/3311045788 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f62b0050240 con 0x7f62c00f77d0 2023-10-18T22:01:32.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.479+0000 7f62c7065700 1 -- 172.21.15.8:0/3311045788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f62c0027a00 con 0x7f62c00f77d0 2023-10-18T22:01:32.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.479+0000 7f62b6ffd700 1 -- 172.21.15.8:0/3311045788 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f62b004fe30 con 0x7f62c00f77d0 2023-10-18T22:01:32.482 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:01:32.482 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:01:32.483 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:01:32.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:01:32.483 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:01:32.483 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:01:32.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:01:32.484 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:01:32.484 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:01:32.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:01:32.484 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:01:32.484 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:01:32.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:01:32.485 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:01:32.485 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:01:32.485 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:01:32.485 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:01:32.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.481+0000 7f62c7065700 1 -- 172.21.15.8:0/3311045788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f62ac060f70 msgr2=0x7f62ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.481+0000 7f62c7065700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f62ac060f70 0x7f62ac063430 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f62bc009f50 tx=0x7f62bc009b30).stop 2023-10-18T22:01:32.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.481+0000 7f62c7065700 1 -- 172.21.15.8:0/3311045788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62c00f77d0 msgr2=0x7f62c01094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.481+0000 7f62c7065700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62c00f77d0 0x7f62c01094b0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f62b000c790 tx=0x7f62b0007d70).stop 2023-10-18T22:01:32.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.481+0000 7f62c7065700 1 -- 172.21.15.8:0/3311045788 shutdown_connections 2023-10-18T22:01:32.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.481+0000 7f62c7065700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f62ac060f70 0x7f62ac063430 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.481+0000 7f62c7065700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62c00f6530 0x7f62c0108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.481+0000 7f62c7065700 1 --2- 172.21.15.8:0/3311045788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62c00f77d0 0x7f62c01094b0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.481+0000 7f62c7065700 1 -- 172.21.15.8:0/3311045788 >> 172.21.15.8:0/3311045788 conn(0x7f62c00f1c90 msgr2=0x7f62c00f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:32.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.482+0000 7f62c7065700 1 -- 172.21.15.8:0/3311045788 shutdown_connections 2023-10-18T22:01:32.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.482+0000 7f62c7065700 1 -- 172.21.15.8:0/3311045788 wait complete. 2023-10-18T22:01:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.618+0000 7f7324dd0700 1 -- 172.21.15.8:0/1614385266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f732006a3b0 msgr2=0x7f732006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.618+0000 7f7324dd0700 1 --2- 172.21.15.8:0/1614385266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f732006a3b0 0x7f732006a830 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f7314004660 tx=0x7f7314009b30).stop 2023-10-18T22:01:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.618+0000 7f7324dd0700 1 -- 172.21.15.8:0/1614385266 shutdown_connections 2023-10-18T22:01:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.618+0000 7f7324dd0700 1 --2- 172.21.15.8:0/1614385266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f732006a3b0 0x7f732006a830 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.618+0000 7f7324dd0700 1 --2- 172.21.15.8:0/1614385266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732006b9c0 0x7f7320069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.618+0000 7f7324dd0700 1 -- 172.21.15.8:0/1614385266 >> 172.21.15.8:0/1614385266 conn(0x7f73200f1c90 msgr2=0x7f73200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.618+0000 7f7324dd0700 1 -- 172.21.15.8:0/1614385266 shutdown_connections 2023-10-18T22:01:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.618+0000 7f7324dd0700 1 -- 172.21.15.8:0/1614385266 wait complete. 2023-10-18T22:01:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.619+0000 7f7324dd0700 1 Processor -- start 2023-10-18T22:01:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.619+0000 7f7324dd0700 1 -- start start 2023-10-18T22:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f7324dd0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f732006a3b0 0x7f7320108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f7324dd0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732006b9c0 0x7f7320109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f7324dd0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7320109a10 con 0x7f732006a3b0 2023-10-18T22:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f7324dd0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7320109b50 con 0x7f732006b9c0 2023-10-18T22:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f731f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f732006a3b0 0x7f7320108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f731f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f732006a3b0 0x7f7320108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57404/0 (socket says 172.21.15.8:57404) 2023-10-18T22:01:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f731f7fe700 1 -- 172.21.15.8:0/1040176474 learned_addr learned my addr 172.21.15.8:0/1040176474 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:01:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f731effd700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732006b9c0 0x7f7320109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f731f7fe700 1 -- 172.21.15.8:0/1040176474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732006b9c0 msgr2=0x7f7320109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f731f7fe700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732006b9c0 0x7f7320109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.620+0000 7f731f7fe700 1 -- 172.21.15.8:0/1040176474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314005040 con 0x7f732006a3b0 2023-10-18T22:01:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.621+0000 7f731f7fe700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f732006a3b0 0x7f7320108f70 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f73100026d0 tx=0x7f7310009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.621+0000 7f7307fff700 1 -- 172.21.15.8:0/1040176474 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7310009320 con 0x7f732006a3b0 2023-10-18T22:01:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.621+0000 7f7307fff700 1 -- 172.21.15.8:0/1040176474 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f731000f040 con 0x7f732006a3b0 2023-10-18T22:01:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.621+0000 7f7307fff700 1 -- 172.21.15.8:0/1040176474 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73100148a0 con 0x7f732006a3b0 2023-10-18T22:01:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.621+0000 7f7324dd0700 1 -- 172.21.15.8:0/1040176474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732010a4f0 con 0x7f732006a3b0 2023-10-18T22:01:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.621+0000 7f7324dd0700 1 -- 172.21.15.8:0/1040176474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732010aab0 con 0x7f732006a3b0 2023-10-18T22:01:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.622+0000 7f7324dd0700 1 -- 172.21.15.8:0/1040176474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7320045ad0 con 0x7f732006a3b0 2023-10-18T22:01:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.623+0000 7f7307fff700 1 -- 172.21.15.8:0/1040176474 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7310009480 con 0x7f732006a3b0 2023-10-18T22:01:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.624+0000 7f7307fff700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7308060f70 0x7f7308063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.624+0000 7f7307fff700 1 -- 172.21.15.8:0/1040176474 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f731007cfd0 con 0x7f732006a3b0 2023-10-18T22:01:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.624+0000 7f731effd700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7308060f70 0x7f7308063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.625+0000 7f731effd700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7308060f70 0x7f7308063430 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f7314004630 tx=0x7f7314009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.628+0000 7f7307fff700 1 -- 172.21.15.8:0/1040176474 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7310050670 con 0x7f732006a3b0 2023-10-18T22:01:32.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.854+0000 7f7324dd0700 1 -- 172.21.15.8:0/1040176474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7320100fc0 con 0x7f732006a3b0 2023-10-18T22:01:32.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.855+0000 7f7307fff700 1 -- 172.21.15.8:0/1040176474 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f73100181b0 con 0x7f732006a3b0 2023-10-18T22:01:32.857 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:01:32.858 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:01:32.858 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:01:32.858 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:01:32.858 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:01:32.858 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:01:32.858 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:01:32.859 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:01:32.859 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:01:32.859 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:01:32.859 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:01:32.859 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:01:32.860 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:01:32.860 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:01:32.860 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:01:32.860 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:01:32.860 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:01:32.860 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:01:32.861 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:01:32.861 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:01:32.861 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:01:32.861 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:01:32.861 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:01:32.861 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:01:32.862 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:01:32.862 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:01:32.862 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:01:32.862 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:01:32.862 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:01:32.863 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:01:32.863 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:01:32.863 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:01:32.863 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:01:32.863 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:01:32.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 -- 172.21.15.8:0/1040176474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7308060f70 msgr2=0x7f7308063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7308060f70 0x7f7308063430 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f7314004630 tx=0x7f7314009b30).stop 2023-10-18T22:01:32.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 -- 172.21.15.8:0/1040176474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f732006a3b0 msgr2=0x7f7320108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f732006a3b0 0x7f7320108f70 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f73100026d0 tx=0x7f7310009de0).stop 2023-10-18T22:01:32.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 -- 172.21.15.8:0/1040176474 shutdown_connections 2023-10-18T22:01:32.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7308060f70 0x7f7308063430 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f732006a3b0 0x7f7320108f70 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 --2- 172.21.15.8:0/1040176474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732006b9c0 0x7f7320109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 -- 172.21.15.8:0/1040176474 >> 172.21.15.8:0/1040176474 conn(0x7f73200f1c90 msgr2=0x7f73200fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:32.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 -- 172.21.15.8:0/1040176474 shutdown_connections 2023-10-18T22:01:32.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.857+0000 7f7324dd0700 1 -- 172.21.15.8:0/1040176474 wait complete. 2023-10-18T22:01:32.866 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:01:32.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.993+0000 7f32070d0700 1 -- 172.21.15.8:0/847831756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000f77d0 msgr2=0x7f32000f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:32.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.993+0000 7f32070d0700 1 --2- 172.21.15.8:0/847831756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000f77d0 0x7f32000f7c30 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f31f0004660 tx=0x7f31f0009b30).stop 2023-10-18T22:01:32.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.993+0000 7f32070d0700 1 -- 172.21.15.8:0/847831756 shutdown_connections 2023-10-18T22:01:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.993+0000 7f32070d0700 1 --2- 172.21.15.8:0/847831756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000f77d0 0x7f32000f7c30 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.993+0000 7f32070d0700 1 --2- 172.21.15.8:0/847831756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000f6530 0x7f32000f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.993+0000 7f32070d0700 1 -- 172.21.15.8:0/847831756 >> 172.21.15.8:0/847831756 conn(0x7f32000f1c90 msgr2=0x7f32000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.993+0000 7f32070d0700 1 -- 172.21.15.8:0/847831756 shutdown_connections 2023-10-18T22:01:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.993+0000 7f32070d0700 1 -- 172.21.15.8:0/847831756 wait complete. 2023-10-18T22:01:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.994+0000 7f32070d0700 1 Processor -- start 2023-10-18T22:01:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.994+0000 7f32070d0700 1 -- start start 2023-10-18T22:01:33.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32070d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000f6530 0x7f320006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:33.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32070d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000f77d0 0x7f3200069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:33.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32070d0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320006a380 con 0x7f32000f77d0 2023-10-18T22:01:33.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32070d0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320006a4c0 con 0x7f32000f6530 2023-10-18T22:01:33.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32058cd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000f77d0 0x7f3200069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:33.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32058cd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000f77d0 0x7f3200069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57430/0 (socket says 172.21.15.8:57430) 2023-10-18T22:01:33.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32058cd700 1 -- 172.21.15.8:0/3443506303 learned_addr learned my addr 172.21.15.8:0/3443506303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:01:33.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32058cd700 1 -- 172.21.15.8:0/3443506303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000f6530 msgr2=0x7f320006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:33.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32060ce700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000f6530 0x7f320006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32058cd700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000f6530 0x7f320006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32058cd700 1 -- 172.21.15.8:0/3443506303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0005040 con 0x7f32000f77d0 2023-10-18T22:01:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.995+0000 7f32060ce700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000f6530 0x7f320006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:01:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.996+0000 7f32058cd700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000f77d0 0x7f3200069e20 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f31f0009990 tx=0x7f31f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.996+0000 7f31f6ffd700 1 -- 172.21.15.8:0/3443506303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31f0018070 con 0x7f32000f77d0 2023-10-18T22:01:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.996+0000 7f32070d0700 1 -- 172.21.15.8:0/3443506303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320006a740 con 0x7f32000f77d0 2023-10-18T22:01:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.996+0000 7f31f6ffd700 1 -- 172.21.15.8:0/3443506303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f31f0009780 con 0x7f32000f77d0 2023-10-18T22:01:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.996+0000 7f31f6ffd700 1 -- 172.21.15.8:0/3443506303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31f001c5a0 con 0x7f32000f77d0 2023-10-18T22:01:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.996+0000 7f32070d0700 1 -- 172.21.15.8:0/3443506303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320006aca0 con 0x7f32000f77d0 2023-10-18T22:01:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.997+0000 7f32070d0700 1 -- 172.21.15.8:0/3443506303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3200045ad0 con 0x7f32000f77d0 2023-10-18T22:01:33.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.998+0000 7f31f6ffd700 1 -- 172.21.15.8:0/3443506303 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f31f001db30 con 0x7f32000f77d0 2023-10-18T22:01:33.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.999+0000 7f31f6ffd700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f31ec060f70 0x7f31ec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:01:33.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.999+0000 7f31f6ffd700 1 -- 172.21.15.8:0/3443506303 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f31f007e7a0 con 0x7f32000f77d0 2023-10-18T22:01:33.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:32.999+0000 7f32060ce700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f31ec060f70 0x7f31ec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:01:33.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.000+0000 7f32060ce700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f31ec060f70 0x7f31ec063430 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f31fc007fd0 tx=0x7f31fc009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:01:33.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.003+0000 7f31f6ffd700 1 -- 172.21.15.8:0/3443506303 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f31f004e490 con 0x7f32000f77d0 2023-10-18T22:01:33.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.203+0000 7f32070d0700 1 -- 172.21.15.8:0/3443506303 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32000fedd0 con 0x7f31ec060f70 2023-10-18T22:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.204+0000 7f31f6ffd700 1 -- 172.21.15.8:0/3443506303 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f32000fedd0 con 0x7f31ec060f70 2023-10-18T22:01:33.206 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:01:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:01:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:01:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:01:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:01:33.207 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:01:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:01:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:01:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:01:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:01:33.208 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:01:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:01:33.209 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:01:33.209 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:01:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 -- 172.21.15.8:0/3443506303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f31ec060f70 msgr2=0x7f31ec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f31ec060f70 0x7f31ec063430 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f31fc007fd0 tx=0x7f31fc009040).stop 2023-10-18T22:01:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 -- 172.21.15.8:0/3443506303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000f77d0 msgr2=0x7f3200069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:01:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000f77d0 0x7f3200069e20 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f31f0009990 tx=0x7f31f0009b30).stop 2023-10-18T22:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 -- 172.21.15.8:0/3443506303 shutdown_connections 2023-10-18T22:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f31ec060f70 0x7f31ec063430 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32000f6530 0x7f320006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 --2- 172.21.15.8:0/3443506303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000f77d0 0x7f3200069e20 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 -- 172.21.15.8:0/3443506303 >> 172.21.15.8:0/3443506303 conn(0x7f32000f1c90 msgr2=0x7f32000fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:01:33.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 -- 172.21.15.8:0/3443506303 shutdown_connections 2023-10-18T22:01:33.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:01:33.206+0000 7f32070d0700 1 -- 172.21.15.8:0/3443506303 wait complete. 2023-10-18T22:01:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:31.381755+0000 mgr.smithi008.flmjzp (mgr.14640) 3756 : audit [DBG] from='client.37072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:31.729864+0000 mgr.smithi008.flmjzp (mgr.14640) 3757 : audit [DBG] from='client.37076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:31.921284+0000 mgr.smithi008.flmjzp (mgr.14640) 3758 : cluster [DBG] pgmap v2582: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:32.071335+0000 mgr.smithi008.flmjzp (mgr.14640) 3759 : audit [DBG] from='client.37080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:32.481083+0000 mon.smithi008 (mon.0) 4093 : audit [DBG] from='client.? 172.21.15.8:0/3311045788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:32.856443+0000 mon.smithi008 (mon.0) 4094 : audit [DBG] from='client.? 172.21.15.8:0/1040176474' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:01:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:31.381755+0000 mgr.smithi008.flmjzp (mgr.14640) 3756 : audit [DBG] from='client.37072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:31.729864+0000 mgr.smithi008.flmjzp (mgr.14640) 3757 : audit [DBG] from='client.37076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:31.921284+0000 mgr.smithi008.flmjzp (mgr.14640) 3758 : cluster [DBG] pgmap v2582: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:33.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:32.071335+0000 mgr.smithi008.flmjzp (mgr.14640) 3759 : audit [DBG] from='client.37080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:33.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:32.481083+0000 mon.smithi008 (mon.0) 4093 : audit [DBG] from='client.? 172.21.15.8:0/3311045788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:33.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:32.856443+0000 mon.smithi008 (mon.0) 4094 : audit [DBG] from='client.? 172.21.15.8:0/1040176474' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:01:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:33.205409+0000 mgr.smithi008.flmjzp (mgr.14640) 3760 : audit [DBG] from='client.37092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:34.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:33.953990+0000 mon.smithi008 (mon.0) 4095 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:33.205409+0000 mgr.smithi008.flmjzp (mgr.14640) 3760 : audit [DBG] from='client.37092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:01:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:33.953990+0000 mon.smithi008 (mon.0) 4095 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:33.921969+0000 mgr.smithi008.flmjzp (mgr.14640) 3761 : cluster [DBG] pgmap v2583: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:34.518961+0000 mon.smithi008 (mon.0) 4096 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:34.519782+0000 mon.smithi008 (mon.0) 4097 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:34.525337+0000 mon.smithi008 (mon.0) 4098 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:34.530210+0000 mon.smithi008 (mon.0) 4099 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:34.532614+0000 mon.smithi008 (mon.0) 4100 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:35.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:34.533908+0000 mon.smithi008 (mon.0) 4101 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:35.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:34.535171+0000 mon.smithi008 (mon.0) 4102 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:35.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:34.536725+0000 mon.smithi008 (mon.0) 4103 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:33.921969+0000 mgr.smithi008.flmjzp (mgr.14640) 3761 : cluster [DBG] pgmap v2583: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:34.518961+0000 mon.smithi008 (mon.0) 4096 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:34.519782+0000 mon.smithi008 (mon.0) 4097 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:34.525337+0000 mon.smithi008 (mon.0) 4098 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:34.530210+0000 mon.smithi008 (mon.0) 4099 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:34.532614+0000 mon.smithi008 (mon.0) 4100 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:34.533908+0000 mon.smithi008 (mon.0) 4101 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:34.535171+0000 mon.smithi008 (mon.0) 4102 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:35.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:34.536725+0000 mon.smithi008 (mon.0) 4103 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:34.520478+0000 mgr.smithi008.flmjzp (mgr.14640) 3762 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:34.520984+0000 mgr.smithi008.flmjzp (mgr.14640) 3763 : cluster [DBG] pgmap v2584: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:34.521204+0000 mgr.smithi008.flmjzp (mgr.14640) 3764 : cluster [DBG] pgmap v2585: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:34.538254+0000 mgr.smithi008.flmjzp (mgr.14640) 3765 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:34.520478+0000 mgr.smithi008.flmjzp (mgr.14640) 3762 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:34.520984+0000 mgr.smithi008.flmjzp (mgr.14640) 3763 : cluster [DBG] pgmap v2584: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:34.521204+0000 mgr.smithi008.flmjzp (mgr.14640) 3764 : cluster [DBG] pgmap v2585: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:34.538254+0000 mgr.smithi008.flmjzp (mgr.14640) 3765 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:36.521804+0000 mgr.smithi008.flmjzp (mgr.14640) 3766 : cluster [DBG] pgmap v2586: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:36.521804+0000 mgr.smithi008.flmjzp (mgr.14640) 3766 : cluster [DBG] pgmap v2586: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:38.522477+0000 mgr.smithi008.flmjzp (mgr.14640) 3767 : cluster [DBG] pgmap v2587: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:38.522477+0000 mgr.smithi008.flmjzp (mgr.14640) 3767 : cluster [DBG] pgmap v2587: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:42.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:40.523243+0000 mgr.smithi008.flmjzp (mgr.14640) 3768 : cluster [DBG] pgmap v2588: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:40.523243+0000 mgr.smithi008.flmjzp (mgr.14640) 3768 : cluster [DBG] pgmap v2588: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:44.340 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:42.523853+0000 mgr.smithi008.flmjzp (mgr.14640) 3769 : cluster [DBG] pgmap v2589: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:42.523853+0000 mgr.smithi008.flmjzp (mgr.14640) 3769 : cluster [DBG] pgmap v2589: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:44.540530+0000 mon.smithi008 (mon.0) 4104 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:44.542778+0000 mon.smithi008 (mon.0) 4105 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:44.543853+0000 mon.smithi008 (mon.0) 4106 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:44.550361+0000 mon.smithi008 (mon.0) 4107 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:44.556811+0000 mon.smithi008 (mon.0) 4108 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:44.560012+0000 mon.smithi008 (mon.0) 4109 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:45.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:44.561796+0000 mon.smithi008 (mon.0) 4110 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:45.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:44.563485+0000 mon.smithi008 (mon.0) 4111 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:45.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:44.565484+0000 mon.smithi008 (mon.0) 4112 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:44.540530+0000 mon.smithi008 (mon.0) 4104 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:44.542778+0000 mon.smithi008 (mon.0) 4105 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:44.543853+0000 mon.smithi008 (mon.0) 4106 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:45.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:44.550361+0000 mon.smithi008 (mon.0) 4107 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:45.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:44.556811+0000 mon.smithi008 (mon.0) 4108 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:45.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:44.560012+0000 mon.smithi008 (mon.0) 4109 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:45.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:44.561796+0000 mon.smithi008 (mon.0) 4110 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:45.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:44.563485+0000 mon.smithi008 (mon.0) 4111 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:45.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:44.565484+0000 mon.smithi008 (mon.0) 4112 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:44.524561+0000 mgr.smithi008.flmjzp (mgr.14640) 3770 : cluster [DBG] pgmap v2590: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:44.544788+0000 mgr.smithi008.flmjzp (mgr.14640) 3771 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:44.545348+0000 mgr.smithi008.flmjzp (mgr.14640) 3772 : cluster [DBG] pgmap v2591: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:44.545605+0000 mgr.smithi008.flmjzp (mgr.14640) 3773 : cluster [DBG] pgmap v2592: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:44.567395+0000 mgr.smithi008.flmjzp (mgr.14640) 3774 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:44.524561+0000 mgr.smithi008.flmjzp (mgr.14640) 3770 : cluster [DBG] pgmap v2590: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:44.544788+0000 mgr.smithi008.flmjzp (mgr.14640) 3771 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:44.545348+0000 mgr.smithi008.flmjzp (mgr.14640) 3772 : cluster [DBG] pgmap v2591: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:44.545605+0000 mgr.smithi008.flmjzp (mgr.14640) 3773 : cluster [DBG] pgmap v2592: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:44.567395+0000 mgr.smithi008.flmjzp (mgr.14640) 3774 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:48.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:46.546209+0000 mgr.smithi008.flmjzp (mgr.14640) 3775 : cluster [DBG] pgmap v2593: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:46.546209+0000 mgr.smithi008.flmjzp (mgr.14640) 3775 : cluster [DBG] pgmap v2593: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:48.546875+0000 mgr.smithi008.flmjzp (mgr.14640) 3776 : cluster [DBG] pgmap v2594: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:50.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:48.546875+0000 mgr.smithi008.flmjzp (mgr.14640) 3776 : cluster [DBG] pgmap v2594: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:52.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:50.547602+0000 mgr.smithi008.flmjzp (mgr.14640) 3777 : cluster [DBG] pgmap v2595: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:52.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:50.547602+0000 mgr.smithi008.flmjzp (mgr.14640) 3777 : cluster [DBG] pgmap v2595: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:54.340 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:52.548287+0000 mgr.smithi008.flmjzp (mgr.14640) 3778 : cluster [DBG] pgmap v2596: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:52.548287+0000 mgr.smithi008.flmjzp (mgr.14640) 3778 : cluster [DBG] pgmap v2596: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:54.578204+0000 mon.smithi008 (mon.0) 4113 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:54.578204+0000 mon.smithi008 (mon.0) 4113 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:54.548911+0000 mgr.smithi008.flmjzp (mgr.14640) 3779 : cluster [DBG] pgmap v2597: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:55.136169+0000 mon.smithi008 (mon.0) 4114 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:55.137269+0000 mon.smithi008 (mon.0) 4115 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:55.138126+0000 mgr.smithi008.flmjzp (mgr.14640) 3780 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:55.138755+0000 mgr.smithi008.flmjzp (mgr.14640) 3781 : cluster [DBG] pgmap v2598: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:55.138984+0000 mgr.smithi008.flmjzp (mgr.14640) 3782 : cluster [DBG] pgmap v2599: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:55.143337+0000 mon.smithi008 (mon.0) 4116 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:55.149750+0000 mon.smithi008 (mon.0) 4117 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:55.152827+0000 mon.smithi008 (mon.0) 4118 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:55.154649+0000 mon.smithi008 (mon.0) 4119 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:56.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:55.156355+0000 mon.smithi008 (mon.0) 4120 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:56.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:01:55.158268+0000 mon.smithi008 (mon.0) 4121 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:56.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:01:55.160189+0000 mgr.smithi008.flmjzp (mgr.14640) 3783 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:54.548911+0000 mgr.smithi008.flmjzp (mgr.14640) 3779 : cluster [DBG] pgmap v2597: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:55.136169+0000 mon.smithi008 (mon.0) 4114 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:01:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:55.137269+0000 mon.smithi008 (mon.0) 4115 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:01:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:55.138126+0000 mgr.smithi008.flmjzp (mgr.14640) 3780 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:01:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:55.138755+0000 mgr.smithi008.flmjzp (mgr.14640) 3781 : cluster [DBG] pgmap v2598: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:55.138984+0000 mgr.smithi008.flmjzp (mgr.14640) 3782 : cluster [DBG] pgmap v2599: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:55.143337+0000 mon.smithi008 (mon.0) 4116 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:01:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:55.149750+0000 mon.smithi008 (mon.0) 4117 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:01:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:55.152827+0000 mon.smithi008 (mon.0) 4118 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:55.154649+0000 mon.smithi008 (mon.0) 4119 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:55.156355+0000 mon.smithi008 (mon.0) 4120 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:01:55.158268+0000 mon.smithi008 (mon.0) 4121 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:01:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:01:55.160189+0000 mgr.smithi008.flmjzp (mgr.14640) 3783 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:01:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:01:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:57.139534+0000 mgr.smithi008.flmjzp (mgr.14640) 3784 : cluster [DBG] pgmap v2600: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:01:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:01:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:57.139534+0000 mgr.smithi008.flmjzp (mgr.14640) 3784 : cluster [DBG] pgmap v2600: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:01:59.140008+0000 mgr.smithi008.flmjzp (mgr.14640) 3785 : cluster [DBG] pgmap v2601: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:01:59.140008+0000 mgr.smithi008.flmjzp (mgr.14640) 3785 : cluster [DBG] pgmap v2601: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:02.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:01.140697+0000 mgr.smithi008.flmjzp (mgr.14640) 3786 : cluster [DBG] pgmap v2602: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:02.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:01.140697+0000 mgr.smithi008.flmjzp (mgr.14640) 3786 : cluster [DBG] pgmap v2602: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:03.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.361+0000 7faee4a22700 1 -- 172.21.15.8:0/1224049895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00f6530 msgr2=0x7faee00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:03.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.361+0000 7faee4a22700 1 --2- 172.21.15.8:0/1224049895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00f6530 0x7faee00f6950 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7faed0004660 tx=0x7faed0009b30).stop 2023-10-18T22:02:03.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.361+0000 7faee4a22700 1 -- 172.21.15.8:0/1224049895 shutdown_connections 2023-10-18T22:02:03.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.361+0000 7faee4a22700 1 --2- 172.21.15.8:0/1224049895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faee00f77d0 0x7faee00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.361+0000 7faee4a22700 1 --2- 172.21.15.8:0/1224049895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00f6530 0x7faee00f6950 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.361+0000 7faee4a22700 1 -- 172.21.15.8:0/1224049895 >> 172.21.15.8:0/1224049895 conn(0x7faee00f1c90 msgr2=0x7faee00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:03.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.361+0000 7faee4a22700 1 -- 172.21.15.8:0/1224049895 shutdown_connections 2023-10-18T22:02:03.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.361+0000 7faee4a22700 1 -- 172.21.15.8:0/1224049895 wait complete. 2023-10-18T22:02:03.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.362+0000 7faee4a22700 1 Processor -- start 2023-10-18T22:02:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.362+0000 7faee4a22700 1 -- start start 2023-10-18T22:02:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.362+0000 7faee4a22700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faee00f6530 0x7faee0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.362+0000 7faee4a22700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00f77d0 0x7faee0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.362+0000 7faee4a22700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee0109a00 con 0x7faee00f77d0 2023-10-18T22:02:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.362+0000 7faee4a22700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee0109b40 con 0x7faee00f6530 2023-10-18T22:02:03.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.362+0000 7faede59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00f77d0 0x7faee0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:03.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faede59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00f77d0 0x7faee0109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58388/0 (socket says 172.21.15.8:58388) 2023-10-18T22:02:03.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faede59c700 1 -- 172.21.15.8:0/3256111303 learned_addr learned my addr 172.21.15.8:0/3256111303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:03.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faeded9d700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faee00f6530 0x7faee0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:03.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faede59c700 1 -- 172.21.15.8:0/3256111303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faee00f6530 msgr2=0x7faee0108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faede59c700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faee00f6530 0x7faee0108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faede59c700 1 -- 172.21.15.8:0/3256111303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0005040 con 0x7faee00f77d0 2023-10-18T22:02:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faede59c700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00f77d0 0x7faee0109450 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7faed400e7f0 tx=0x7faed400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faec77fe700 1 -- 172.21.15.8:0/3256111303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faed40092e0 con 0x7faee00f77d0 2023-10-18T22:02:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faec77fe700 1 -- 172.21.15.8:0/3256111303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faed400f040 con 0x7faee00f77d0 2023-10-18T22:02:03.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faec77fe700 1 -- 172.21.15.8:0/3256111303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faed40147e0 con 0x7faee00f77d0 2023-10-18T22:02:03.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.363+0000 7faee4a22700 1 -- 172.21.15.8:0/3256111303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee010a4e0 con 0x7faee00f77d0 2023-10-18T22:02:03.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.364+0000 7faee4a22700 1 -- 172.21.15.8:0/3256111303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee010aa20 con 0x7faee00f77d0 2023-10-18T22:02:03.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.365+0000 7faee4a22700 1 -- 172.21.15.8:0/3256111303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee0045ad0 con 0x7faee00f77d0 2023-10-18T22:02:03.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.366+0000 7faec77fe700 1 -- 172.21.15.8:0/3256111303 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faed401b030 con 0x7faee00f77d0 2023-10-18T22:02:03.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.366+0000 7faec77fe700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec8060f70 0x7faec8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.367+0000 7faec77fe700 1 -- 172.21.15.8:0/3256111303 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faed407c6b0 con 0x7faee00f77d0 2023-10-18T22:02:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.367+0000 7faeded9d700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec8060f70 0x7faec8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.367+0000 7faeded9d700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec8060f70 0x7faec8063430 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7faed0009720 tx=0x7faed0016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.371+0000 7faec77fe700 1 -- 172.21.15.8:0/3256111303 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faed404fd40 con 0x7faee00f77d0 2023-10-18T22:02:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.571+0000 7faee4a22700 1 -- 172.21.15.8:0/3256111303 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faee010ac90 con 0x7faec8060f70 2023-10-18T22:02:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.572+0000 7faec77fe700 1 -- 172.21.15.8:0/3256111303 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faee010ac90 con 0x7faec8060f70 2023-10-18T22:02:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.574+0000 7faee4a22700 1 -- 172.21.15.8:0/3256111303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec8060f70 msgr2=0x7faec8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.574+0000 7faee4a22700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec8060f70 0x7faec8063430 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7faed0009720 tx=0x7faed0016040).stop 2023-10-18T22:02:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.574+0000 7faee4a22700 1 -- 172.21.15.8:0/3256111303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00f77d0 msgr2=0x7faee0109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.574+0000 7faee4a22700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00f77d0 0x7faee0109450 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7faed400e7f0 tx=0x7faed400b040).stop 2023-10-18T22:02:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.574+0000 7faee4a22700 1 -- 172.21.15.8:0/3256111303 shutdown_connections 2023-10-18T22:02:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.574+0000 7faee4a22700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec8060f70 0x7faec8063430 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.574+0000 7faee4a22700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faee00f6530 0x7faee0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.575+0000 7faee4a22700 1 --2- 172.21.15.8:0/3256111303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00f77d0 0x7faee0109450 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.575+0000 7faee4a22700 1 -- 172.21.15.8:0/3256111303 >> 172.21.15.8:0/3256111303 conn(0x7faee00f1c90 msgr2=0x7faee006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.575+0000 7faee4a22700 1 -- 172.21.15.8:0/3256111303 shutdown_connections 2023-10-18T22:02:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.575+0000 7faee4a22700 1 -- 172.21.15.8:0/3256111303 wait complete. 2023-10-18T22:02:03.590 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:02:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.713+0000 7f03bb36e700 1 -- 172.21.15.8:0/240381263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03b40f77d0 msgr2=0x7f03b40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.713+0000 7f03bb36e700 1 --2- 172.21.15.8:0/240381263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03b40f77d0 0x7f03b40f7c30 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f03a4004660 tx=0x7f03a4009b30).stop 2023-10-18T22:02:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.713+0000 7f03bb36e700 1 -- 172.21.15.8:0/240381263 shutdown_connections 2023-10-18T22:02:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.713+0000 7f03bb36e700 1 --2- 172.21.15.8:0/240381263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03b40f77d0 0x7f03b40f7c30 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.713+0000 7f03bb36e700 1 --2- 172.21.15.8:0/240381263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b40f6530 0x7f03b40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.713+0000 7f03bb36e700 1 -- 172.21.15.8:0/240381263 >> 172.21.15.8:0/240381263 conn(0x7f03b40f1cd0 msgr2=0x7f03b40f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.713+0000 7f03bb36e700 1 -- 172.21.15.8:0/240381263 shutdown_connections 2023-10-18T22:02:03.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.713+0000 7f03bb36e700 1 -- 172.21.15.8:0/240381263 wait complete. 2023-10-18T22:02:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.714+0000 7f03bb36e700 1 Processor -- start 2023-10-18T22:02:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.714+0000 7f03bb36e700 1 -- start start 2023-10-18T22:02:03.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.714+0000 7f03bb36e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03b40f6530 0x7f03b406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:03.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.714+0000 7f03bb36e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b40f77d0 0x7f03b4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:03.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.714+0000 7f03bb36e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b410a9c0 con 0x7f03b40f6530 2023-10-18T22:02:03.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.714+0000 7f03bb36e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b410ab00 con 0x7f03b40f77d0 2023-10-18T22:02:03.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03ba36c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03b40f6530 0x7f03b406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03ba36c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03b40f6530 0x7f03b406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58406/0 (socket says 172.21.15.8:58406) 2023-10-18T22:02:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03ba36c700 1 -- 172.21.15.8:0/3985503812 learned_addr learned my addr 172.21.15.8:0/3985503812 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03ba36c700 1 -- 172.21.15.8:0/3985503812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b40f77d0 msgr2=0x7f03b4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03b9b6b700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b40f77d0 0x7f03b4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03ba36c700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b40f77d0 0x7f03b4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03ba36c700 1 -- 172.21.15.8:0/3985503812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a4005040 con 0x7f03b40f6530 2023-10-18T22:02:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03b9b6b700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b40f77d0 0x7f03b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:02:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03ba36c700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03b40f6530 0x7f03b406b9a0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f03b0002700 tx=0x7f03b0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03aaffd700 1 -- 172.21.15.8:0/3985503812 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03b0009320 con 0x7f03b40f6530 2023-10-18T22:02:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03aaffd700 1 -- 172.21.15.8:0/3985503812 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f03b000f040 con 0x7f03b40f6530 2023-10-18T22:02:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03aaffd700 1 -- 172.21.15.8:0/3985503812 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03b0014970 con 0x7f03b40f6530 2023-10-18T22:02:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.715+0000 7f03bb36e700 1 -- 172.21.15.8:0/3985503812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b406a3d0 con 0x7f03b40f6530 2023-10-18T22:02:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.716+0000 7f03bb36e700 1 -- 172.21.15.8:0/3985503812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b406a990 con 0x7f03b40f6530 2023-10-18T22:02:03.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.717+0000 7f03bb36e700 1 -- 172.21.15.8:0/3985503812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b4045ad0 con 0x7f03b40f6530 2023-10-18T22:02:03.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.717+0000 7f03aaffd700 1 -- 172.21.15.8:0/3985503812 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f03b0009480 con 0x7f03b40f6530 2023-10-18T22:02:03.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.718+0000 7f03aaffd700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03a0060f70 0x7f03a0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:03.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.718+0000 7f03aaffd700 1 -- 172.21.15.8:0/3985503812 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f03b007cad0 con 0x7f03b40f6530 2023-10-18T22:02:03.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.719+0000 7f03b9b6b700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03a0060f70 0x7f03a0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:03.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.719+0000 7f03b9b6b700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03a0060f70 0x7f03a0063430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f03a4005010 tx=0x7f03a4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:03.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.722+0000 7f03aaffd700 1 -- 172.21.15.8:0/3985503812 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f03b004c7c0 con 0x7f03b40f6530 2023-10-18T22:02:03.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.928+0000 7f03bb36e700 1 -- 172.21.15.8:0/3985503812 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03b40fed10 con 0x7f03a0060f70 2023-10-18T22:02:03.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.929+0000 7f03aaffd700 1 -- 172.21.15.8:0/3985503812 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f03b40fed10 con 0x7f03a0060f70 2023-10-18T22:02:03.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.931+0000 7f03bb36e700 1 -- 172.21.15.8:0/3985503812 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03a0060f70 msgr2=0x7f03a0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:03.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.931+0000 7f03bb36e700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03a0060f70 0x7f03a0063430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f03a4005010 tx=0x7f03a4009b30).stop 2023-10-18T22:02:03.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.931+0000 7f03bb36e700 1 -- 172.21.15.8:0/3985503812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03b40f6530 msgr2=0x7f03b406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:03.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.931+0000 7f03bb36e700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03b40f6530 0x7f03b406b9a0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f03b0002700 tx=0x7f03b0009d80).stop 2023-10-18T22:02:03.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.932+0000 7f03bb36e700 1 -- 172.21.15.8:0/3985503812 shutdown_connections 2023-10-18T22:02:03.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.932+0000 7f03bb36e700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03a0060f70 0x7f03a0063430 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.932+0000 7f03bb36e700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03b40f6530 0x7f03b406b9a0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.932+0000 7f03bb36e700 1 --2- 172.21.15.8:0/3985503812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b40f77d0 0x7f03b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:03.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.932+0000 7f03bb36e700 1 -- 172.21.15.8:0/3985503812 >> 172.21.15.8:0/3985503812 conn(0x7f03b40f1cd0 msgr2=0x7f03b40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:03.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.932+0000 7f03bb36e700 1 -- 172.21.15.8:0/3985503812 shutdown_connections 2023-10-18T22:02:03.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:03.932+0000 7f03bb36e700 1 -- 172.21.15.8:0/3985503812 wait complete. 2023-10-18T22:02:04.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.070+0000 7f2204d6e700 1 -- 172.21.15.8:0/4014405587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22000f96a0 msgr2=0x7f22000fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.070+0000 7f2204d6e700 1 --2- 172.21.15.8:0/4014405587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22000f96a0 0x7f22000fbaf0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f21f4004660 tx=0x7f21f4009b30).stop 2023-10-18T22:02:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.070+0000 7f2204d6e700 1 -- 172.21.15.8:0/4014405587 shutdown_connections 2023-10-18T22:02:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.070+0000 7f2204d6e700 1 --2- 172.21.15.8:0/4014405587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22000f96a0 0x7f22000fbaf0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.070+0000 7f2204d6e700 1 --2- 172.21.15.8:0/4014405587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2200060270 0x7f22000f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.070+0000 7f2204d6e700 1 -- 172.21.15.8:0/4014405587 >> 172.21.15.8:0/4014405587 conn(0x7f22000f0b90 msgr2=0x7f22000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:04.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.070+0000 7f2204d6e700 1 -- 172.21.15.8:0/4014405587 shutdown_connections 2023-10-18T22:02:04.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.070+0000 7f2204d6e700 1 -- 172.21.15.8:0/4014405587 wait complete. 2023-10-18T22:02:04.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.071+0000 7f2204d6e700 1 Processor -- start 2023-10-18T22:02:04.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.071+0000 7f2204d6e700 1 -- start start 2023-10-18T22:02:04.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.071+0000 7f2204d6e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2200060270 0x7f2200108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:04.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.071+0000 7f2204d6e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000f96a0 0x7f22001093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:04.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.071+0000 7f2204d6e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2200109970 con 0x7f2200060270 2023-10-18T22:02:04.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.071+0000 7f2204d6e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2200109ab0 con 0x7f22000f96a0 2023-10-18T22:02:04.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.071+0000 7f21ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2200060270 0x7f2200108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:04.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2200060270 0x7f2200108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58434/0 (socket says 172.21.15.8:58434) 2023-10-18T22:02:04.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21ff7fe700 1 -- 172.21.15.8:0/4218205940 learned_addr learned my addr 172.21.15.8:0/4218205940 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21feffd700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000f96a0 0x7f22001093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21ff7fe700 1 -- 172.21.15.8:0/4218205940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000f96a0 msgr2=0x7f22001093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21ff7fe700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000f96a0 0x7f22001093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21ff7fe700 1 -- 172.21.15.8:0/4218205940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f4005040 con 0x7f2200060270 2023-10-18T22:02:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21feffd700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000f96a0 0x7f22001093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:02:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21ff7fe700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2200060270 0x7f2200108ed0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f21f000e7f0 tx=0x7f21f000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21e7fff700 1 -- 172.21.15.8:0/4218205940 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21f00092e0 con 0x7f2200060270 2023-10-18T22:02:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21e7fff700 1 -- 172.21.15.8:0/4218205940 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f21f000f040 con 0x7f2200060270 2023-10-18T22:02:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f21e7fff700 1 -- 172.21.15.8:0/4218205940 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21f00147e0 con 0x7f2200060270 2023-10-18T22:02:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.072+0000 7f2204d6e700 1 -- 172.21.15.8:0/4218205940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220010a450 con 0x7f2200060270 2023-10-18T22:02:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.073+0000 7f2204d6e700 1 -- 172.21.15.8:0/4218205940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220010a990 con 0x7f2200060270 2023-10-18T22:02:04.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.074+0000 7f2204d6e700 1 -- 172.21.15.8:0/4218205940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2200045ad0 con 0x7f2200060270 2023-10-18T22:02:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.075+0000 7f21e7fff700 1 -- 172.21.15.8:0/4218205940 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f21f001b030 con 0x7f2200060270 2023-10-18T22:02:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.075+0000 7f21e7fff700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f21e8060f70 0x7f21e8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.076+0000 7f21e7fff700 1 -- 172.21.15.8:0/4218205940 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f21f007c680 con 0x7f2200060270 2023-10-18T22:02:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.076+0000 7f21feffd700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f21e8060f70 0x7f21e8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.076+0000 7f21feffd700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f21e8060f70 0x7f21e8063430 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f21f4009880 tx=0x7f21f400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:04.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.080+0000 7f21e7fff700 1 -- 172.21.15.8:0/4218205940 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f21f004fd70 con 0x7f2200060270 2023-10-18T22:02:04.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.277+0000 7f2204d6e700 1 -- 172.21.15.8:0/4218205940 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f22000fa4c0 con 0x7f21e8060f70 2023-10-18T22:02:04.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.287+0000 7f21e7fff700 1 -- 172.21.15.8:0/4218205940 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f22000fa4c0 con 0x7f21e8060f70 2023-10-18T22:02:04.288 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:02:04.288 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (68m) 6m ago 70m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:02:04.288 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (62m) 6m ago 70m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:02:04.289 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (62m) 4m ago 69m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:02:04.289 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (68m) 6m ago 69m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:02:04.289 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 66m - - 2023-10-18T22:02:04.289 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 66m - - 2023-10-18T22:02:04.289 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 66m - - 2023-10-18T22:02:04.290 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 66m - - 2023-10-18T22:02:04.290 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (63m) 6m ago 71m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:02:04.290 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (63m) 4m ago 69m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:02:04.290 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (63m) 6m ago 71m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:02:04.290 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (62m) 4m ago 69m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:02:04.291 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (69m) 6m ago 69m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:02:04.291 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (69m) 4m ago 68m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:02:04.291 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (62m) 6m ago 68m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:02:04.291 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (60m) 6m ago 68m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:02:04.291 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (59m) 6m ago 68m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:02:04.292 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (59m) 4m ago 67m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:02:04.292 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (58m) 4m ago 67m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:02:04.292 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (58m) 4m ago 67m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:02:04.292 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (64m) 6m ago 69m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:02:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.288+0000 7f2204d6e700 1 -- 172.21.15.8:0/4218205940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f21e8060f70 msgr2=0x7f21e8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.288+0000 7f2204d6e700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f21e8060f70 0x7f21e8063430 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f21f4009880 tx=0x7f21f400b040).stop 2023-10-18T22:02:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.289+0000 7f2204d6e700 1 -- 172.21.15.8:0/4218205940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2200060270 msgr2=0x7f2200108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.289+0000 7f2204d6e700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2200060270 0x7f2200108ed0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f21f000e7f0 tx=0x7f21f000b040).stop 2023-10-18T22:02:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.289+0000 7f2204d6e700 1 -- 172.21.15.8:0/4218205940 shutdown_connections 2023-10-18T22:02:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.289+0000 7f2204d6e700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f21e8060f70 0x7f21e8063430 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.289+0000 7f2204d6e700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2200060270 0x7f2200108ed0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.289+0000 7f2204d6e700 1 --2- 172.21.15.8:0/4218205940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000f96a0 0x7f22001093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.289+0000 7f2204d6e700 1 -- 172.21.15.8:0/4218205940 >> 172.21.15.8:0/4218205940 conn(0x7f22000f0b90 msgr2=0x7f22000f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:04.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.289+0000 7f2204d6e700 1 -- 172.21.15.8:0/4218205940 shutdown_connections 2023-10-18T22:02:04.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.289+0000 7f2204d6e700 1 -- 172.21.15.8:0/4218205940 wait complete. 2023-10-18T22:02:04.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.425+0000 7f8b93fff700 1 -- 172.21.15.8:0/101404127 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b940f6530 msgr2=0x7f8b940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:04.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.425+0000 7f8b93fff700 1 --2- 172.21.15.8:0/101404127 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b940f6530 0x7f8b940f6950 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f8b84004660 tx=0x7f8b84009b30).stop 2023-10-18T22:02:04.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.425+0000 7f8b93fff700 1 -- 172.21.15.8:0/101404127 shutdown_connections 2023-10-18T22:02:04.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.425+0000 7f8b93fff700 1 --2- 172.21.15.8:0/101404127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b940f77d0 0x7f8b940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.425+0000 7f8b93fff700 1 --2- 172.21.15.8:0/101404127 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b940f6530 0x7f8b940f6950 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.425+0000 7f8b93fff700 1 -- 172.21.15.8:0/101404127 >> 172.21.15.8:0/101404127 conn(0x7f8b940f1c90 msgr2=0x7f8b940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:04.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.425+0000 7f8b93fff700 1 -- 172.21.15.8:0/101404127 shutdown_connections 2023-10-18T22:02:04.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.425+0000 7f8b93fff700 1 -- 172.21.15.8:0/101404127 wait complete. 2023-10-18T22:02:04.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.426+0000 7f8b93fff700 1 Processor -- start 2023-10-18T22:02:04.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.426+0000 7f8b93fff700 1 -- start start 2023-10-18T22:02:04.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b940f6530 0x7f8b94106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:04.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b940f77d0 0x7f8b94107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b93fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94107880 con 0x7f8b940f6530 2023-10-18T22:02:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b93fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941080c0 con 0x7f8b940f77d0 2023-10-18T22:02:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b940f6530 0x7f8b94106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b940f6530 0x7f8b94106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58448/0 (socket says 172.21.15.8:58448) 2023-10-18T22:02:04.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b92ffd700 1 -- 172.21.15.8:0/3216260169 learned_addr learned my addr 172.21.15.8:0/3216260169 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:04.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b927fc700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b940f77d0 0x7f8b94107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:04.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b92ffd700 1 -- 172.21.15.8:0/3216260169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b940f77d0 msgr2=0x7f8b94107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:04.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b92ffd700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b940f77d0 0x7f8b94107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.427+0000 7f8b92ffd700 1 -- 172.21.15.8:0/3216260169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84005040 con 0x7f8b940f6530 2023-10-18T22:02:04.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.428+0000 7f8b92ffd700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b940f6530 0x7f8b94106d90 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f8b84009870 tx=0x7f8b8400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:04.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.428+0000 7f8b7b7fe700 1 -- 172.21.15.8:0/3216260169 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b84019070 con 0x7f8b940f6530 2023-10-18T22:02:04.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.428+0000 7f8b7b7fe700 1 -- 172.21.15.8:0/3216260169 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8b84013380 con 0x7f8b940f6530 2023-10-18T22:02:04.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.428+0000 7f8b93fff700 1 -- 172.21.15.8:0/3216260169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b94108340 con 0x7f8b940f6530 2023-10-18T22:02:04.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.428+0000 7f8b7b7fe700 1 -- 172.21.15.8:0/3216260169 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b8401edf0 con 0x7f8b940f6530 2023-10-18T22:02:04.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.428+0000 7f8b93fff700 1 -- 172.21.15.8:0/3216260169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b94108820 con 0x7f8b940f6530 2023-10-18T22:02:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.429+0000 7f8b93fff700 1 -- 172.21.15.8:0/3216260169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b94059100 con 0x7f8b940f6530 2023-10-18T22:02:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.430+0000 7f8b7b7fe700 1 -- 172.21.15.8:0/3216260169 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8b8401e420 con 0x7f8b940f6530 2023-10-18T22:02:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.431+0000 7f8b7b7fe700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b7c060f70 0x7f8b7c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.431+0000 7f8b7b7fe700 1 -- 172.21.15.8:0/3216260169 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8b8407dd00 con 0x7f8b940f6530 2023-10-18T22:02:04.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.431+0000 7f8b927fc700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b7c060f70 0x7f8b7c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:04.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.432+0000 7f8b927fc700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b7c060f70 0x7f8b7c063430 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f8b94106b20 tx=0x7f8b8800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:04.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.435+0000 7f8b7b7fe700 1 -- 172.21.15.8:0/3216260169 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8b8404d930 con 0x7f8b940f6530 2023-10-18T22:02:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:03.141347+0000 mgr.smithi008.flmjzp (mgr.14640) 3787 : cluster [DBG] pgmap v2603: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:03.141347+0000 mgr.smithi008.flmjzp (mgr.14640) 3787 : cluster [DBG] pgmap v2603: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:04.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.687+0000 7f8b93fff700 1 -- 172.21.15.8:0/3216260169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b940fecc0 con 0x7f8b940f6530 2023-10-18T22:02:04.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.687+0000 7f8b7b7fe700 1 -- 172.21.15.8:0/3216260169 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f8b84050f50 con 0x7f8b940f6530 2023-10-18T22:02:04.689 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:02:04.689 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:02:04.689 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:02:04.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:02:04.690 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:02:04.690 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:02:04.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:02:04.691 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:02:04.691 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:02:04.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:02:04.691 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:02:04.691 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:02:04.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:02:04.692 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:02:04.692 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:02:04.692 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:02:04.692 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:02:04.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.689+0000 7f8b93fff700 1 -- 172.21.15.8:0/3216260169 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b7c060f70 msgr2=0x7f8b7c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:04.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.689+0000 7f8b93fff700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b7c060f70 0x7f8b7c063430 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f8b94106b20 tx=0x7f8b8800b040).stop 2023-10-18T22:02:04.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.689+0000 7f8b93fff700 1 -- 172.21.15.8:0/3216260169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b940f6530 msgr2=0x7f8b94106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:04.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.689+0000 7f8b93fff700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b940f6530 0x7f8b94106d90 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f8b84009870 tx=0x7f8b8400b040).stop 2023-10-18T22:02:04.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.689+0000 7f8b93fff700 1 -- 172.21.15.8:0/3216260169 shutdown_connections 2023-10-18T22:02:04.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.689+0000 7f8b93fff700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8b7c060f70 0x7f8b7c063430 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.689+0000 7f8b93fff700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b940f6530 0x7f8b94106d90 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.689+0000 7f8b93fff700 1 --2- 172.21.15.8:0/3216260169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b940f77d0 0x7f8b94107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.689+0000 7f8b93fff700 1 -- 172.21.15.8:0/3216260169 >> 172.21.15.8:0/3216260169 conn(0x7f8b940f1c90 msgr2=0x7f8b940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:04.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.690+0000 7f8b93fff700 1 -- 172.21.15.8:0/3216260169 shutdown_connections 2023-10-18T22:02:04.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.690+0000 7f8b93fff700 1 -- 172.21.15.8:0/3216260169 wait complete. 2023-10-18T22:02:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.826+0000 7ff8ef18a700 1 -- 172.21.15.8:0/3945714496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e80f77d0 msgr2=0x7ff8e80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:04.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.826+0000 7ff8ef18a700 1 --2- 172.21.15.8:0/3945714496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e80f77d0 0x7ff8e80f7c30 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7ff8d8004660 tx=0x7ff8d8009b30).stop 2023-10-18T22:02:04.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.826+0000 7ff8ef18a700 1 -- 172.21.15.8:0/3945714496 shutdown_connections 2023-10-18T22:02:04.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.826+0000 7ff8ef18a700 1 --2- 172.21.15.8:0/3945714496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e80f77d0 0x7ff8e80f7c30 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.826+0000 7ff8ef18a700 1 --2- 172.21.15.8:0/3945714496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8e80f6530 0x7ff8e80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.826+0000 7ff8ef18a700 1 -- 172.21.15.8:0/3945714496 >> 172.21.15.8:0/3945714496 conn(0x7ff8e80f1c90 msgr2=0x7ff8e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.826+0000 7ff8ef18a700 1 -- 172.21.15.8:0/3945714496 shutdown_connections 2023-10-18T22:02:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.826+0000 7ff8ef18a700 1 -- 172.21.15.8:0/3945714496 wait complete. 2023-10-18T22:02:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.827+0000 7ff8ef18a700 1 Processor -- start 2023-10-18T22:02:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.827+0000 7ff8ef18a700 1 -- start start 2023-10-18T22:02:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ef18a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8e80f6530 0x7ff8e8108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ef18a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e80f77d0 0x7ff8e8109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ef18a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e81099b0 con 0x7ff8e80f77d0 2023-10-18T22:02:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ef18a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e8109af0 con 0x7ff8e80f6530 2023-10-18T22:02:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ed987700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e80f77d0 0x7ff8e8109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ed987700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e80f77d0 0x7ff8e8109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58478/0 (socket says 172.21.15.8:58478) 2023-10-18T22:02:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ed987700 1 -- 172.21.15.8:0/1416396603 learned_addr learned my addr 172.21.15.8:0/1416396603 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ee188700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8e80f6530 0x7ff8e8108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ed987700 1 -- 172.21.15.8:0/1416396603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8e80f6530 msgr2=0x7ff8e8108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ed987700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8e80f6530 0x7ff8e8108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ed987700 1 -- 172.21.15.8:0/1416396603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d8005040 con 0x7ff8e80f77d0 2023-10-18T22:02:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.828+0000 7ff8ed987700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e80f77d0 0x7ff8e8109400 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7ff8d8009990 tx=0x7ff8d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:04.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.829+0000 7ff8deffd700 1 -- 172.21.15.8:0/1416396603 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8d8018070 con 0x7ff8e80f77d0 2023-10-18T22:02:04.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.829+0000 7ff8deffd700 1 -- 172.21.15.8:0/1416396603 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff8d8009630 con 0x7ff8e80f77d0 2023-10-18T22:02:04.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.829+0000 7ff8deffd700 1 -- 172.21.15.8:0/1416396603 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8d801c400 con 0x7ff8e80f77d0 2023-10-18T22:02:04.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.829+0000 7ff8ef18a700 1 -- 172.21.15.8:0/1416396603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e810a430 con 0x7ff8e80f77d0 2023-10-18T22:02:04.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.829+0000 7ff8ef18a700 1 -- 172.21.15.8:0/1416396603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e810a940 con 0x7ff8e80f77d0 2023-10-18T22:02:04.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.830+0000 7ff8ef18a700 1 -- 172.21.15.8:0/1416396603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e8045ad0 con 0x7ff8e80f77d0 2023-10-18T22:02:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.831+0000 7ff8deffd700 1 -- 172.21.15.8:0/1416396603 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff8d801d9e0 con 0x7ff8e80f77d0 2023-10-18T22:02:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.832+0000 7ff8deffd700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8d4060f70 0x7ff8d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.832+0000 7ff8deffd700 1 -- 172.21.15.8:0/1416396603 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff8d807e680 con 0x7ff8e80f77d0 2023-10-18T22:02:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.832+0000 7ff8ee188700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8d4060f70 0x7ff8d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:04.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.832+0000 7ff8ee188700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8d4060f70 0x7ff8d4063430 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7ff8e80f7630 tx=0x7ff8e4009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:04.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:04.836+0000 7ff8deffd700 1 -- 172.21.15.8:0/1416396603 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff8d8051ce0 con 0x7ff8e80f77d0 2023-10-18T22:02:05.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.063+0000 7ff8ef18a700 1 -- 172.21.15.8:0/1416396603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff8e80fed60 con 0x7ff8e80f77d0 2023-10-18T22:02:05.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.063+0000 7ff8deffd700 1 -- 172.21.15.8:0/1416396603 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7ff8d80518d0 con 0x7ff8e80f77d0 2023-10-18T22:02:05.065 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:02:05.065 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:02:05.066 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:02:05.066 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:02:05.066 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:02:05.066 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:02:05.066 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:02:05.067 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:02:05.067 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:02:05.067 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:02:05.067 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:02:05.067 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:02:05.068 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:02:05.068 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:02:05.068 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:02:05.068 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:02:05.068 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:02:05.069 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:02:05.069 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:02:05.069 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:02:05.069 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:02:05.069 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:02:05.070 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:02:05.070 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:02:05.070 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:02:05.070 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:02:05.070 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:02:05.071 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:02:05.071 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:02:05.071 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:02:05.071 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:02:05.071 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:02:05.071 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:02:05.072 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:02:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 -- 172.21.15.8:0/1416396603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8d4060f70 msgr2=0x7ff8d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8d4060f70 0x7ff8d4063430 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7ff8e80f7630 tx=0x7ff8e4009c00).stop 2023-10-18T22:02:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 -- 172.21.15.8:0/1416396603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e80f77d0 msgr2=0x7ff8e8109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e80f77d0 0x7ff8e8109400 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7ff8d8009990 tx=0x7ff8d8009b30).stop 2023-10-18T22:02:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 -- 172.21.15.8:0/1416396603 shutdown_connections 2023-10-18T22:02:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff8d4060f70 0x7ff8d4063430 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8e80f6530 0x7ff8e8108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 --2- 172.21.15.8:0/1416396603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e80f77d0 0x7ff8e8109400 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 -- 172.21.15.8:0/1416396603 >> 172.21.15.8:0/1416396603 conn(0x7ff8e80f1c90 msgr2=0x7ff8e806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 -- 172.21.15.8:0/1416396603 shutdown_connections 2023-10-18T22:02:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.066+0000 7ff8ef18a700 1 -- 172.21.15.8:0/1416396603 wait complete. 2023-10-18T22:02:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:02:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.206+0000 7f0729f27700 1 -- 172.21.15.8:0/1293257103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0724060310 msgr2=0x7f07240f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.206+0000 7f0729f27700 1 --2- 172.21.15.8:0/1293257103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0724060310 0x7f07240f9110 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f0718004660 tx=0x7f0718009b30).stop 2023-10-18T22:02:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.206+0000 7f0729f27700 1 -- 172.21.15.8:0/1293257103 shutdown_connections 2023-10-18T22:02:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.206+0000 7f0729f27700 1 --2- 172.21.15.8:0/1293257103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07240f9690 0x7f07240fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.206+0000 7f0729f27700 1 --2- 172.21.15.8:0/1293257103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0724060310 0x7f07240f9110 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.206+0000 7f0729f27700 1 -- 172.21.15.8:0/1293257103 >> 172.21.15.8:0/1293257103 conn(0x7f07240f0b90 msgr2=0x7f07240f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.206+0000 7f0729f27700 1 -- 172.21.15.8:0/1293257103 shutdown_connections 2023-10-18T22:02:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.206+0000 7f0729f27700 1 -- 172.21.15.8:0/1293257103 wait complete. 2023-10-18T22:02:05.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.207+0000 7f0729f27700 1 Processor -- start 2023-10-18T22:02:05.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.207+0000 7f0729f27700 1 -- start start 2023-10-18T22:02:05.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.207+0000 7f0729f27700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0724060310 0x7f0724106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:05.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.207+0000 7f0729f27700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07240f9690 0x7f0724107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:05.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.207+0000 7f0729f27700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0724107850 con 0x7f07240f9690 2023-10-18T22:02:05.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.207+0000 7f0729f27700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0724108060 con 0x7f0724060310 2023-10-18T22:02:05.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.208+0000 7f0723fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07240f9690 0x7f0724107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:05.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.208+0000 7f0723fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07240f9690 0x7f0724107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58490/0 (socket says 172.21.15.8:58490) 2023-10-18T22:02:05.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.208+0000 7f0723fff700 1 -- 172.21.15.8:0/3086528970 learned_addr learned my addr 172.21.15.8:0/3086528970 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:05.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.208+0000 7f0728f25700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0724060310 0x7f0724106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:05.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.208+0000 7f0723fff700 1 -- 172.21.15.8:0/3086528970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0724060310 msgr2=0x7f0724106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:05.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.208+0000 7f0723fff700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0724060310 0x7f0724106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:05.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.208+0000 7f0723fff700 1 -- 172.21.15.8:0/3086528970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0718005040 con 0x7f07240f9690 2023-10-18T22:02:05.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.208+0000 7f0723fff700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07240f9690 0x7f0724107250 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f071000e7c0 tx=0x7f071000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:05.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.209+0000 7f07217fa700 1 -- 172.21.15.8:0/3086528970 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07100092e0 con 0x7f07240f9690 2023-10-18T22:02:05.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.209+0000 7f07217fa700 1 -- 172.21.15.8:0/3086528970 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f071000f040 con 0x7f07240f9690 2023-10-18T22:02:05.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.209+0000 7f0729f27700 1 -- 172.21.15.8:0/3086528970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0724108280 con 0x7f07240f9690 2023-10-18T22:02:05.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.209+0000 7f07217fa700 1 -- 172.21.15.8:0/3086528970 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0710014770 con 0x7f07240f9690 2023-10-18T22:02:05.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.209+0000 7f0729f27700 1 -- 172.21.15.8:0/3086528970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07241087c0 con 0x7f07240f9690 2023-10-18T22:02:05.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.210+0000 7f0729f27700 1 -- 172.21.15.8:0/3086528970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0724059100 con 0x7f07240f9690 2023-10-18T22:02:05.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.211+0000 7f07217fa700 1 -- 172.21.15.8:0/3086528970 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0710014a30 con 0x7f07240f9690 2023-10-18T22:02:05.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.211+0000 7f07217fa700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0714060f70 0x7f0714063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:05.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.212+0000 7f07217fa700 1 -- 172.21.15.8:0/3086528970 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f071007cd90 con 0x7f07240f9690 2023-10-18T22:02:05.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.212+0000 7f0728f25700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0714060f70 0x7f0714063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:05.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.212+0000 7f0728f25700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0714060f70 0x7f0714063430 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f07180043d0 tx=0x7f071800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:05.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.216+0000 7f07217fa700 1 -- 172.21.15.8:0/3086528970 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f071004c9c0 con 0x7f07240f9690 2023-10-18T22:02:05.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.415+0000 7f0729f27700 1 -- 172.21.15.8:0/3086528970 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07240fee10 con 0x7f0714060f70 2023-10-18T22:02:05.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.416+0000 7f07217fa700 1 -- 172.21.15.8:0/3086528970 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f07240fee10 con 0x7f0714060f70 2023-10-18T22:02:05.417 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:02:05.418 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:02:05.418 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:02:05.418 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:02:05.418 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:02:05.418 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:02:05.419 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:02:05.419 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:02:05.419 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:02:05.419 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:02:05.419 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:02:05.420 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:02:05.420 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:02:05.420 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:02:05.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 -- 172.21.15.8:0/3086528970 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0714060f70 msgr2=0x7f0714063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:05.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0714060f70 0x7f0714063430 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f07180043d0 tx=0x7f071800b040).stop 2023-10-18T22:02:05.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 -- 172.21.15.8:0/3086528970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07240f9690 msgr2=0x7f0724107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:05.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07240f9690 0x7f0724107250 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f071000e7c0 tx=0x7f071000b040).stop 2023-10-18T22:02:05.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 -- 172.21.15.8:0/3086528970 shutdown_connections 2023-10-18T22:02:05.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0714060f70 0x7f0714063430 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:05.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0724060310 0x7f0724106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:05.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 --2- 172.21.15.8:0/3086528970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07240f9690 0x7f0724107250 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:05.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 -- 172.21.15.8:0/3086528970 >> 172.21.15.8:0/3086528970 conn(0x7f07240f0b90 msgr2=0x7f07240f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:05.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 -- 172.21.15.8:0/3086528970 shutdown_connections 2023-10-18T22:02:05.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:05.418+0000 7f0729f27700 1 -- 172.21.15.8:0/3086528970 wait complete. 2023-10-18T22:02:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:03.572809+0000 mgr.smithi008.flmjzp (mgr.14640) 3788 : audit [DBG] from='client.37096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:03.929862+0000 mgr.smithi008.flmjzp (mgr.14640) 3789 : audit [DBG] from='client.37100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:04.687966+0000 mon.smithi008 (mon.0) 4122 : audit [DBG] from='client.? 172.21.15.8:0/3216260169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.064157+0000 mon.smithi008 (mon.0) 4123 : audit [DBG] from='client.? 172.21.15.8:0/1416396603' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:02:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.169991+0000 mon.smithi008 (mon.0) 4124 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:05.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.171615+0000 mon.smithi008 (mon.0) 4125 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:05.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.172323+0000 mon.smithi008 (mon.0) 4126 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:05.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.177618+0000 mon.smithi008 (mon.0) 4127 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:05.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.183113+0000 mon.smithi008 (mon.0) 4128 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:05.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.185505+0000 mon.smithi008 (mon.0) 4129 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:05.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.186756+0000 mon.smithi008 (mon.0) 4130 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:05.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.187933+0000 mon.smithi008 (mon.0) 4131 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:05.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.189445+0000 mon.smithi008 (mon.0) 4132 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:03.572809+0000 mgr.smithi008.flmjzp (mgr.14640) 3788 : audit [DBG] from='client.37096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:03.929862+0000 mgr.smithi008.flmjzp (mgr.14640) 3789 : audit [DBG] from='client.37100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:04.687966+0000 mon.smithi008 (mon.0) 4122 : audit [DBG] from='client.? 172.21.15.8:0/3216260169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.064157+0000 mon.smithi008 (mon.0) 4123 : audit [DBG] from='client.? 172.21.15.8:0/1416396603' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:02:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.169991+0000 mon.smithi008 (mon.0) 4124 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.171615+0000 mon.smithi008 (mon.0) 4125 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.172323+0000 mon.smithi008 (mon.0) 4126 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.177618+0000 mon.smithi008 (mon.0) 4127 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.183113+0000 mon.smithi008 (mon.0) 4128 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.185505+0000 mon.smithi008 (mon.0) 4129 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.186756+0000 mon.smithi008 (mon.0) 4130 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.187933+0000 mon.smithi008 (mon.0) 4131 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:05.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.189445+0000 mon.smithi008 (mon.0) 4132 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:04.278350+0000 mgr.smithi008.flmjzp (mgr.14640) 3790 : audit [DBG] from='client.37104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:05.141811+0000 mgr.smithi008.flmjzp (mgr.14640) 3791 : cluster [DBG] pgmap v2604: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:05.172973+0000 mgr.smithi008.flmjzp (mgr.14640) 3792 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:05.173469+0000 mgr.smithi008.flmjzp (mgr.14640) 3793 : cluster [DBG] pgmap v2605: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:05.173701+0000 mgr.smithi008.flmjzp (mgr.14640) 3794 : cluster [DBG] pgmap v2606: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:06.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:05.191053+0000 mgr.smithi008.flmjzp (mgr.14640) 3795 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:04.278350+0000 mgr.smithi008.flmjzp (mgr.14640) 3790 : audit [DBG] from='client.37104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:05.141811+0000 mgr.smithi008.flmjzp (mgr.14640) 3791 : cluster [DBG] pgmap v2604: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:05.172973+0000 mgr.smithi008.flmjzp (mgr.14640) 3792 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:05.173469+0000 mgr.smithi008.flmjzp (mgr.14640) 3793 : cluster [DBG] pgmap v2605: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:05.173701+0000 mgr.smithi008.flmjzp (mgr.14640) 3794 : cluster [DBG] pgmap v2606: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:05.191053+0000 mgr.smithi008.flmjzp (mgr.14640) 3795 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:05.416342+0000 mgr.smithi008.flmjzp (mgr.14640) 3796 : audit [DBG] from='client.37116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:05.416342+0000 mgr.smithi008.flmjzp (mgr.14640) 3796 : audit [DBG] from='client.37116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:07.174161+0000 mgr.smithi008.flmjzp (mgr.14640) 3797 : cluster [DBG] pgmap v2607: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:07.174161+0000 mgr.smithi008.flmjzp (mgr.14640) 3797 : cluster [DBG] pgmap v2607: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:10.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:09.174816+0000 mgr.smithi008.flmjzp (mgr.14640) 3798 : cluster [DBG] pgmap v2608: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:09.174816+0000 mgr.smithi008.flmjzp (mgr.14640) 3798 : cluster [DBG] pgmap v2608: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:12.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:11.175546+0000 mgr.smithi008.flmjzp (mgr.14640) 3799 : cluster [DBG] pgmap v2609: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:11.175546+0000 mgr.smithi008.flmjzp (mgr.14640) 3799 : cluster [DBG] pgmap v2609: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:13.176243+0000 mgr.smithi008.flmjzp (mgr.14640) 3800 : cluster [DBG] pgmap v2610: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:13.176243+0000 mgr.smithi008.flmjzp (mgr.14640) 3800 : cluster [DBG] pgmap v2610: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:15.201214+0000 mon.smithi008 (mon.0) 4133 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:15.203394+0000 mon.smithi008 (mon.0) 4134 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:15.204383+0000 mon.smithi008 (mon.0) 4135 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:15.210847+0000 mon.smithi008 (mon.0) 4136 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:15.217487+0000 mon.smithi008 (mon.0) 4137 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:15.220785+0000 mon.smithi008 (mon.0) 4138 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:15.222564+0000 mon.smithi008 (mon.0) 4139 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:15.224254+0000 mon.smithi008 (mon.0) 4140 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:15.226316+0000 mon.smithi008 (mon.0) 4141 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:15.201214+0000 mon.smithi008 (mon.0) 4133 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:15.203394+0000 mon.smithi008 (mon.0) 4134 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:15.204383+0000 mon.smithi008 (mon.0) 4135 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:15.210847+0000 mon.smithi008 (mon.0) 4136 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:15.217487+0000 mon.smithi008 (mon.0) 4137 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:15.220785+0000 mon.smithi008 (mon.0) 4138 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:15.222564+0000 mon.smithi008 (mon.0) 4139 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:15.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:15.224254+0000 mon.smithi008 (mon.0) 4140 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:15.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:15.226316+0000 mon.smithi008 (mon.0) 4141 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:15.176937+0000 mgr.smithi008.flmjzp (mgr.14640) 3801 : cluster [DBG] pgmap v2611: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:15.205285+0000 mgr.smithi008.flmjzp (mgr.14640) 3802 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:15.205839+0000 mgr.smithi008.flmjzp (mgr.14640) 3803 : cluster [DBG] pgmap v2612: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:15.206083+0000 mgr.smithi008.flmjzp (mgr.14640) 3804 : cluster [DBG] pgmap v2613: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:16.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:15.228268+0000 mgr.smithi008.flmjzp (mgr.14640) 3805 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:15.176937+0000 mgr.smithi008.flmjzp (mgr.14640) 3801 : cluster [DBG] pgmap v2611: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:15.205285+0000 mgr.smithi008.flmjzp (mgr.14640) 3802 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:15.205839+0000 mgr.smithi008.flmjzp (mgr.14640) 3803 : cluster [DBG] pgmap v2612: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:15.206083+0000 mgr.smithi008.flmjzp (mgr.14640) 3804 : cluster [DBG] pgmap v2613: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:15.228268+0000 mgr.smithi008.flmjzp (mgr.14640) 3805 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:17.206766+0000 mgr.smithi008.flmjzp (mgr.14640) 3806 : cluster [DBG] pgmap v2614: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:17.206766+0000 mgr.smithi008.flmjzp (mgr.14640) 3806 : cluster [DBG] pgmap v2614: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:19.207324+0000 mgr.smithi008.flmjzp (mgr.14640) 3807 : cluster [DBG] pgmap v2615: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:19.207324+0000 mgr.smithi008.flmjzp (mgr.14640) 3807 : cluster [DBG] pgmap v2615: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:22.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:21.207841+0000 mgr.smithi008.flmjzp (mgr.14640) 3808 : cluster [DBG] pgmap v2616: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:22.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:21.207841+0000 mgr.smithi008.flmjzp (mgr.14640) 3808 : cluster [DBG] pgmap v2616: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:23.208476+0000 mgr.smithi008.flmjzp (mgr.14640) 3809 : cluster [DBG] pgmap v2617: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:23.208476+0000 mgr.smithi008.flmjzp (mgr.14640) 3809 : cluster [DBG] pgmap v2617: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:25.238909+0000 mon.smithi008 (mon.0) 4142 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:25.238909+0000 mon.smithi008 (mon.0) 4142 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:25.209006+0000 mgr.smithi008.flmjzp (mgr.14640) 3810 : cluster [DBG] pgmap v2618: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:25.592952+0000 mon.smithi008 (mon.0) 4143 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:25.593853+0000 mon.smithi008 (mon.0) 4144 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:25.594622+0000 mon.smithi008 (mon.0) 4145 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:25.599770+0000 mon.smithi008 (mon.0) 4146 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:25.604630+0000 mon.smithi008 (mon.0) 4147 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:25.606944+0000 mon.smithi008 (mon.0) 4148 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:25.608229+0000 mon.smithi008 (mon.0) 4149 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:25.609492+0000 mon.smithi008 (mon.0) 4150 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:25.611021+0000 mon.smithi008 (mon.0) 4151 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:25.209006+0000 mgr.smithi008.flmjzp (mgr.14640) 3810 : cluster [DBG] pgmap v2618: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:25.592952+0000 mon.smithi008 (mon.0) 4143 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:25.593853+0000 mon.smithi008 (mon.0) 4144 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:25.594622+0000 mon.smithi008 (mon.0) 4145 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:25.599770+0000 mon.smithi008 (mon.0) 4146 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:25.604630+0000 mon.smithi008 (mon.0) 4147 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:25.606944+0000 mon.smithi008 (mon.0) 4148 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:25.608229+0000 mon.smithi008 (mon.0) 4149 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:25.609492+0000 mon.smithi008 (mon.0) 4150 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:26.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:25.611021+0000 mon.smithi008 (mon.0) 4151 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:25.595258+0000 mgr.smithi008.flmjzp (mgr.14640) 3811 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:25.595768+0000 mgr.smithi008.flmjzp (mgr.14640) 3812 : cluster [DBG] pgmap v2619: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:25.595953+0000 mgr.smithi008.flmjzp (mgr.14640) 3813 : cluster [DBG] pgmap v2620: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:25.612552+0000 mgr.smithi008.flmjzp (mgr.14640) 3814 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:25.595258+0000 mgr.smithi008.flmjzp (mgr.14640) 3811 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:25.595768+0000 mgr.smithi008.flmjzp (mgr.14640) 3812 : cluster [DBG] pgmap v2619: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:25.595953+0000 mgr.smithi008.flmjzp (mgr.14640) 3813 : cluster [DBG] pgmap v2620: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:25.612552+0000 mgr.smithi008.flmjzp (mgr.14640) 3814 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:27.596495+0000 mgr.smithi008.flmjzp (mgr.14640) 3815 : cluster [DBG] pgmap v2621: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:27.596495+0000 mgr.smithi008.flmjzp (mgr.14640) 3815 : cluster [DBG] pgmap v2621: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:29.597008+0000 mgr.smithi008.flmjzp (mgr.14640) 3816 : cluster [DBG] pgmap v2622: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:29.597008+0000 mgr.smithi008.flmjzp (mgr.14640) 3816 : cluster [DBG] pgmap v2622: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:33.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:31.597585+0000 mgr.smithi008.flmjzp (mgr.14640) 3817 : cluster [DBG] pgmap v2623: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:31.597585+0000 mgr.smithi008.flmjzp (mgr.14640) 3817 : cluster [DBG] pgmap v2623: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:35.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:33.598199+0000 mgr.smithi008.flmjzp (mgr.14640) 3818 : cluster [DBG] pgmap v2624: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:33.598199+0000 mgr.smithi008.flmjzp (mgr.14640) 3818 : cluster [DBG] pgmap v2624: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:35.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.570+0000 7f1fe2f29700 1 -- 172.21.15.8:0/337885316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fdc0f77d0 msgr2=0x7f1fdc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.570+0000 7f1fe2f29700 1 --2- 172.21.15.8:0/337885316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fdc0f77d0 0x7f1fdc0f7c30 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f1fcc004660 tx=0x7f1fcc009b30).stop 2023-10-18T22:02:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.571+0000 7f1fe2f29700 1 -- 172.21.15.8:0/337885316 shutdown_connections 2023-10-18T22:02:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.571+0000 7f1fe2f29700 1 --2- 172.21.15.8:0/337885316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fdc0f77d0 0x7f1fdc0f7c30 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.571+0000 7f1fe2f29700 1 --2- 172.21.15.8:0/337885316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0f6530 0x7f1fdc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:35.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.571+0000 7f1fe2f29700 1 -- 172.21.15.8:0/337885316 >> 172.21.15.8:0/337885316 conn(0x7f1fdc0f1c90 msgr2=0x7f1fdc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:35.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.571+0000 7f1fe2f29700 1 -- 172.21.15.8:0/337885316 shutdown_connections 2023-10-18T22:02:35.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.571+0000 7f1fe2f29700 1 -- 172.21.15.8:0/337885316 wait complete. 2023-10-18T22:02:35.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.572+0000 7f1fe2f29700 1 Processor -- start 2023-10-18T22:02:35.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.572+0000 7f1fe2f29700 1 -- start start 2023-10-18T22:02:35.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.572+0000 7f1fe2f29700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0f6530 0x7f1fdc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:35.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.572+0000 7f1fe2f29700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fdc0f77d0 0x7f1fdc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:35.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.572+0000 7f1fe2f29700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc107880 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.572+0000 7f1fe2f29700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1080c0 con 0x7f1fdc0f6530 2023-10-18T22:02:35.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.573+0000 7f1fe1726700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fdc0f77d0 0x7f1fdc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:35.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.573+0000 7f1fe1726700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fdc0f77d0 0x7f1fdc107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46406/0 (socket says 172.21.15.8:46406) 2023-10-18T22:02:35.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.573+0000 7f1fe1726700 1 -- 172.21.15.8:0/3328470749 learned_addr learned my addr 172.21.15.8:0/3328470749 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:35.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.573+0000 7f1fe1f27700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0f6530 0x7f1fdc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:35.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.573+0000 7f1fe1726700 1 -- 172.21.15.8:0/3328470749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0f6530 msgr2=0x7f1fdc106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:35.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.573+0000 7f1fe1726700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0f6530 0x7f1fdc106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:35.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.573+0000 7f1fe1726700 1 -- 172.21.15.8:0/3328470749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc005040 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.573+0000 7f1fe1726700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fdc0f77d0 0x7f1fdc107280 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f1fcc009990 tx=0x7f1fcc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:35.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.573+0000 7f1fd27fc700 1 -- 172.21.15.8:0/3328470749 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fcc018070 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.574+0000 7f1fd27fc700 1 -- 172.21.15.8:0/3328470749 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1fcc009630 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.574+0000 7f1fe2f29700 1 -- 172.21.15.8:0/3328470749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc108340 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.574+0000 7f1fd27fc700 1 -- 172.21.15.8:0/3328470749 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fcc01c3c0 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.574+0000 7f1fe2f29700 1 -- 172.21.15.8:0/3328470749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc108820 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.575+0000 7f1fe2f29700 1 -- 172.21.15.8:0/3328470749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc059100 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.576+0000 7f1fd27fc700 1 -- 172.21.15.8:0/3328470749 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1fcc01d970 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.576+0000 7f1fd27fc700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc8060f70 0x7f1fc8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:35.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.577+0000 7f1fd27fc700 1 -- 172.21.15.8:0/3328470749 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1fcc07e580 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.577+0000 7f1fe1f27700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc8060f70 0x7f1fc8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:35.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.577+0000 7f1fe1f27700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc8060f70 0x7f1fc8063430 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f1fdc107b50 tx=0x7f1fd800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:35.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.581+0000 7f1fd27fc700 1 -- 172.21.15.8:0/3328470749 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1fcc04e1b0 con 0x7f1fdc0f77d0 2023-10-18T22:02:35.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.781+0000 7f1fe2f29700 1 -- 172.21.15.8:0/3328470749 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fdc0fed30 con 0x7f1fc8060f70 2023-10-18T22:02:35.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.782+0000 7f1fd27fc700 1 -- 172.21.15.8:0/3328470749 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1fdc0fed30 con 0x7f1fc8060f70 2023-10-18T22:02:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.784+0000 7f1fe2f29700 1 -- 172.21.15.8:0/3328470749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc8060f70 msgr2=0x7f1fc8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.784+0000 7f1fe2f29700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc8060f70 0x7f1fc8063430 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f1fdc107b50 tx=0x7f1fd800b040).stop 2023-10-18T22:02:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.784+0000 7f1fe2f29700 1 -- 172.21.15.8:0/3328470749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fdc0f77d0 msgr2=0x7f1fdc107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.784+0000 7f1fe2f29700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fdc0f77d0 0x7f1fdc107280 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f1fcc009990 tx=0x7f1fcc009b30).stop 2023-10-18T22:02:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.784+0000 7f1fe2f29700 1 -- 172.21.15.8:0/3328470749 shutdown_connections 2023-10-18T22:02:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.784+0000 7f1fe2f29700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fc8060f70 0x7f1fc8063430 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.784+0000 7f1fe2f29700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0f6530 0x7f1fdc106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.784+0000 7f1fe2f29700 1 --2- 172.21.15.8:0/3328470749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fdc0f77d0 0x7f1fdc107280 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.784+0000 7f1fe2f29700 1 -- 172.21.15.8:0/3328470749 >> 172.21.15.8:0/3328470749 conn(0x7f1fdc0f1c90 msgr2=0x7f1fdc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:35.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.785+0000 7f1fe2f29700 1 -- 172.21.15.8:0/3328470749 shutdown_connections 2023-10-18T22:02:35.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.785+0000 7f1fe2f29700 1 -- 172.21.15.8:0/3328470749 wait complete. 2023-10-18T22:02:35.802 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:02:35.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.926+0000 7f9caffff700 1 -- 172.21.15.8:0/42804102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb00f77d0 msgr2=0x7f9cb00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:35.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.926+0000 7f9caffff700 1 --2- 172.21.15.8:0/42804102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb00f77d0 0x7f9cb00f7c30 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f9ca4004660 tx=0x7f9ca4009b30).stop 2023-10-18T22:02:35.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.926+0000 7f9caffff700 1 -- 172.21.15.8:0/42804102 shutdown_connections 2023-10-18T22:02:35.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.926+0000 7f9caffff700 1 --2- 172.21.15.8:0/42804102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb00f77d0 0x7f9cb00f7c30 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:35.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.926+0000 7f9caffff700 1 --2- 172.21.15.8:0/42804102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cb00f6530 0x7f9cb00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:35.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.926+0000 7f9caffff700 1 -- 172.21.15.8:0/42804102 >> 172.21.15.8:0/42804102 conn(0x7f9cb00f1c90 msgr2=0x7f9cb00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:35.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.927+0000 7f9caffff700 1 -- 172.21.15.8:0/42804102 shutdown_connections 2023-10-18T22:02:35.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.927+0000 7f9caffff700 1 -- 172.21.15.8:0/42804102 wait complete. 2023-10-18T22:02:35.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.927+0000 7f9caffff700 1 Processor -- start 2023-10-18T22:02:35.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.928+0000 7f9caffff700 1 -- start start 2023-10-18T22:02:35.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.928+0000 7f9caffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb00f6530 0x7f9cb0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:35.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.928+0000 7f9caffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cb00f77d0 0x7f9cb0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:35.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.928+0000 7f9caffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0107880 con 0x7f9cb00f6530 2023-10-18T22:02:35.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.928+0000 7f9caffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb01080c0 con 0x7f9cb00f77d0 2023-10-18T22:02:35.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.928+0000 7f9caeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb00f6530 0x7f9cb0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:35.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.928+0000 7f9caeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb00f6530 0x7f9cb0106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46432/0 (socket says 172.21.15.8:46432) 2023-10-18T22:02:35.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.928+0000 7f9caeffd700 1 -- 172.21.15.8:0/1084377154 learned_addr learned my addr 172.21.15.8:0/1084377154 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:35.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.928+0000 7f9cae7fc700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cb00f77d0 0x7f9cb0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:35.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.929+0000 7f9caeffd700 1 -- 172.21.15.8:0/1084377154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cb00f77d0 msgr2=0x7f9cb0107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:35.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.929+0000 7f9caeffd700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cb00f77d0 0x7f9cb0107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:35.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.929+0000 7f9caeffd700 1 -- 172.21.15.8:0/1084377154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4005040 con 0x7f9cb00f6530 2023-10-18T22:02:35.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.929+0000 7f9caeffd700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb00f6530 0x7f9cb0106d90 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f9ca0002700 tx=0x7f9ca0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:35.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.929+0000 7f9c977fe700 1 -- 172.21.15.8:0/1084377154 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ca00079c0 con 0x7f9cb00f6530 2023-10-18T22:02:35.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.929+0000 7f9c977fe700 1 -- 172.21.15.8:0/1084377154 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9ca000f040 con 0x7f9cb00f6530 2023-10-18T22:02:35.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.929+0000 7f9caffff700 1 -- 172.21.15.8:0/1084377154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb01083a0 con 0x7f9cb00f6530 2023-10-18T22:02:35.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.929+0000 7f9c977fe700 1 -- 172.21.15.8:0/1084377154 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ca00148d0 con 0x7f9cb00f6530 2023-10-18T22:02:35.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.929+0000 7f9caffff700 1 -- 172.21.15.8:0/1084377154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb01088e0 con 0x7f9cb00f6530 2023-10-18T22:02:35.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.930+0000 7f9caffff700 1 -- 172.21.15.8:0/1084377154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb0059100 con 0x7f9cb00f6530 2023-10-18T22:02:35.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.931+0000 7f9c977fe700 1 -- 172.21.15.8:0/1084377154 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9ca001b060 con 0x7f9cb00f6530 2023-10-18T22:02:35.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.933+0000 7f9c977fe700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c98060f70 0x7f9c98063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:35.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.933+0000 7f9c977fe700 1 -- 172.21.15.8:0/1084377154 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9ca007c7d0 con 0x7f9cb00f6530 2023-10-18T22:02:35.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.933+0000 7f9cae7fc700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c98060f70 0x7f9c98063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:35.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.934+0000 7f9cae7fc700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c98060f70 0x7f9c98063430 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f9ca4004630 tx=0x7f9ca4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:35.937+0000 7f9c977fe700 1 -- 172.21.15.8:0/1084377154 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9ca004c380 con 0x7f9cb00f6530 2023-10-18T22:02:36.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.141+0000 7f9caffff700 1 -- 172.21.15.8:0/1084377154 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cb00fee30 con 0x7f9c98060f70 2023-10-18T22:02:36.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.143+0000 7f9c977fe700 1 -- 172.21.15.8:0/1084377154 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9cb00fee30 con 0x7f9c98060f70 2023-10-18T22:02:36.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 -- 172.21.15.8:0/1084377154 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c98060f70 msgr2=0x7f9c98063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:36.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c98060f70 0x7f9c98063430 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f9ca4004630 tx=0x7f9ca4009b30).stop 2023-10-18T22:02:36.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 -- 172.21.15.8:0/1084377154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb00f6530 msgr2=0x7f9cb0106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:36.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb00f6530 0x7f9cb0106d90 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f9ca0002700 tx=0x7f9ca0009d80).stop 2023-10-18T22:02:36.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 -- 172.21.15.8:0/1084377154 shutdown_connections 2023-10-18T22:02:36.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9c98060f70 0x7f9c98063430 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb00f6530 0x7f9cb0106d90 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 --2- 172.21.15.8:0/1084377154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cb00f77d0 0x7f9cb0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 -- 172.21.15.8:0/1084377154 >> 172.21.15.8:0/1084377154 conn(0x7f9cb00f1c90 msgr2=0x7f9cb00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:36.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 -- 172.21.15.8:0/1084377154 shutdown_connections 2023-10-18T22:02:36.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.145+0000 7f9caffff700 1 -- 172.21.15.8:0/1084377154 wait complete. 2023-10-18T22:02:36.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:35.616304+0000 mon.smithi008 (mon.0) 4152 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:36.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.292+0000 7f3811726700 1 -- 172.21.15.8:0/3219160971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f380c0f6530 msgr2=0x7f380c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:36.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.292+0000 7f3811726700 1 --2- 172.21.15.8:0/3219160971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f380c0f6530 0x7f380c0f6950 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f37fc004660 tx=0x7f37fc009b30).stop 2023-10-18T22:02:36.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.292+0000 7f3811726700 1 -- 172.21.15.8:0/3219160971 shutdown_connections 2023-10-18T22:02:36.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.292+0000 7f3811726700 1 --2- 172.21.15.8:0/3219160971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0f77d0 0x7f380c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.292+0000 7f3811726700 1 --2- 172.21.15.8:0/3219160971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f380c0f6530 0x7f380c0f6950 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.292+0000 7f3811726700 1 -- 172.21.15.8:0/3219160971 >> 172.21.15.8:0/3219160971 conn(0x7f380c0f1c90 msgr2=0x7f380c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:36.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.292+0000 7f3811726700 1 -- 172.21.15.8:0/3219160971 shutdown_connections 2023-10-18T22:02:36.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.292+0000 7f3811726700 1 -- 172.21.15.8:0/3219160971 wait complete. 2023-10-18T22:02:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.293+0000 7f3811726700 1 Processor -- start 2023-10-18T22:02:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.293+0000 7f3811726700 1 -- start start 2023-10-18T22:02:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.293+0000 7f3811726700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0f6530 0x7f380c106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.294+0000 7f3811726700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f380c0f77d0 0x7f380c107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:36.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.294+0000 7f3811726700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c107910 con 0x7f380c0f77d0 2023-10-18T22:02:36.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.294+0000 7f3811726700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c108120 con 0x7f380c0f6530 2023-10-18T22:02:36.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.294+0000 7f380b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f380c0f77d0 0x7f380c107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:36.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.294+0000 7f380b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f380c0f77d0 0x7f380c107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46456/0 (socket says 172.21.15.8:46456) 2023-10-18T22:02:36.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.294+0000 7f380b7fe700 1 -- 172.21.15.8:0/3056545794 learned_addr learned my addr 172.21.15.8:0/3056545794 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:36.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.294+0000 7f380bfff700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0f6530 0x7f380c106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:36.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.294+0000 7f380b7fe700 1 -- 172.21.15.8:0/3056545794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0f6530 msgr2=0x7f380c106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:36.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.294+0000 7f380b7fe700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0f6530 0x7f380c106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.294+0000 7f380b7fe700 1 -- 172.21.15.8:0/3056545794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc005040 con 0x7f380c0f77d0 2023-10-18T22:02:36.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.295+0000 7f380b7fe700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f380c0f77d0 0x7f380c107310 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f380000c530 tx=0x7f3800007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:36.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.295+0000 7f3808ff9700 1 -- 172.21.15.8:0/3056545794 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f380000f650 con 0x7f380c0f77d0 2023-10-18T22:02:36.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.295+0000 7f3808ff9700 1 -- 172.21.15.8:0/3056545794 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f380000fc70 con 0x7f380c0f77d0 2023-10-18T22:02:36.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.295+0000 7f3808ff9700 1 -- 172.21.15.8:0/3056545794 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3800012db0 con 0x7f380c0f77d0 2023-10-18T22:02:36.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.295+0000 7f3811726700 1 -- 172.21.15.8:0/3056545794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c1083a0 con 0x7f380c0f77d0 2023-10-18T22:02:36.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.295+0000 7f3811726700 1 -- 172.21.15.8:0/3056545794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c108960 con 0x7f380c0f77d0 2023-10-18T22:02:36.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.296+0000 7f3811726700 1 -- 172.21.15.8:0/3056545794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c059100 con 0x7f380c0f77d0 2023-10-18T22:02:36.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.297+0000 7f3808ff9700 1 -- 172.21.15.8:0/3056545794 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3800010070 con 0x7f380c0f77d0 2023-10-18T22:02:36.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.298+0000 7f3808ff9700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37f4060f70 0x7f37f4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:36.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.298+0000 7f3808ff9700 1 -- 172.21.15.8:0/3056545794 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f380007c640 con 0x7f380c0f77d0 2023-10-18T22:02:36.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.298+0000 7f380bfff700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37f4060f70 0x7f37f4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:36.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.299+0000 7f380bfff700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37f4060f70 0x7f37f4063430 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f37fc009490 tx=0x7f37fc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:36.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.302+0000 7f3808ff9700 1 -- 172.21.15.8:0/3056545794 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3800047f20 con 0x7f380c0f77d0 2023-10-18T22:02:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:35.616304+0000 mon.smithi008 (mon.0) 4152 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.492+0000 7f3811726700 1 -- 172.21.15.8:0/3056545794 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f380c0fedb0 con 0x7f37f4060f70 2023-10-18T22:02:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.502+0000 7f3808ff9700 1 -- 172.21.15.8:0/3056545794 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f380c0fedb0 con 0x7f37f4060f70 2023-10-18T22:02:36.504 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:02:36.504 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (69m) 6m ago 70m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:02:36.505 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (63m) 6m ago 70m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:02:36.505 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (63m) 4m ago 69m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:02:36.505 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (69m) 6m ago 70m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:02:36.505 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 66m - - 2023-10-18T22:02:36.505 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 66m - - 2023-10-18T22:02:36.506 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 66m - - 2023-10-18T22:02:36.506 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 66m - - 2023-10-18T22:02:36.506 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (64m) 6m ago 72m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:02:36.506 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (63m) 4m ago 69m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:02:36.506 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (63m) 6m ago 72m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:02:36.507 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (63m) 4m ago 69m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:02:36.507 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (70m) 6m ago 70m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:02:36.507 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (69m) 4m ago 69m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:02:36.507 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (62m) 6m ago 69m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:02:36.507 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (60m) 6m ago 68m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:02:36.507 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (60m) 6m ago 68m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:02:36.508 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (59m) 4m ago 68m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:02:36.508 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (59m) 4m ago 68m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:02:36.508 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (58m) 4m ago 67m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:02:36.508 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (64m) 6m ago 70m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:02:36.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 -- 172.21.15.8:0/3056545794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37f4060f70 msgr2=0x7f37f4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:36.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37f4060f70 0x7f37f4063430 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f37fc009490 tx=0x7f37fc009b30).stop 2023-10-18T22:02:36.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 -- 172.21.15.8:0/3056545794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f380c0f77d0 msgr2=0x7f380c107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:36.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f380c0f77d0 0x7f380c107310 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f380000c530 tx=0x7f3800007e20).stop 2023-10-18T22:02:36.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 -- 172.21.15.8:0/3056545794 shutdown_connections 2023-10-18T22:02:36.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f37f4060f70 0x7f37f4063430 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0f6530 0x7f380c106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 --2- 172.21.15.8:0/3056545794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f380c0f77d0 0x7f380c107310 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 -- 172.21.15.8:0/3056545794 >> 172.21.15.8:0/3056545794 conn(0x7f380c0f1c90 msgr2=0x7f380c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:36.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 -- 172.21.15.8:0/3056545794 shutdown_connections 2023-10-18T22:02:36.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.504+0000 7f3811726700 1 -- 172.21.15.8:0/3056545794 wait complete. 2023-10-18T22:02:36.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.638+0000 7fbc8dc27700 1 -- 172.21.15.8:0/3386614652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc880f8740 msgr2=0x7fbc880f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:36.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.638+0000 7fbc8dc27700 1 --2- 172.21.15.8:0/3386614652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc880f8740 0x7fbc880f8b60 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7fbc7c004660 tx=0x7fbc7c009b30).stop 2023-10-18T22:02:36.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.639+0000 7fbc8dc27700 1 -- 172.21.15.8:0/3386614652 shutdown_connections 2023-10-18T22:02:36.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.639+0000 7fbc8dc27700 1 --2- 172.21.15.8:0/3386614652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc880f99e0 0x7fbc880f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.639+0000 7fbc8dc27700 1 --2- 172.21.15.8:0/3386614652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc880f8740 0x7fbc880f8b60 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.639+0000 7fbc8dc27700 1 -- 172.21.15.8:0/3386614652 >> 172.21.15.8:0/3386614652 conn(0x7fbc880f40e0 msgr2=0x7fbc880f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:36.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.639+0000 7fbc8dc27700 1 -- 172.21.15.8:0/3386614652 shutdown_connections 2023-10-18T22:02:36.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.639+0000 7fbc8dc27700 1 -- 172.21.15.8:0/3386614652 wait complete. 2023-10-18T22:02:36.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.640+0000 7fbc8dc27700 1 Processor -- start 2023-10-18T22:02:36.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.640+0000 7fbc8dc27700 1 -- start start 2023-10-18T22:02:36.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc8dc27700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc880f8740 0x7fbc88108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:36.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc8dc27700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc880f99e0 0x7fbc881094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:36.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc8dc27700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc88109a80 con 0x7fbc880f99e0 2023-10-18T22:02:36.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc8dc27700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc88109bc0 con 0x7fbc880f8740 2023-10-18T22:02:36.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc87fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc880f99e0 0x7fbc881094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:36.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc8cc25700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc880f8740 0x7fbc88108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:36.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc87fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc880f99e0 0x7fbc881094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46460/0 (socket says 172.21.15.8:46460) 2023-10-18T22:02:36.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc87fff700 1 -- 172.21.15.8:0/2593336615 learned_addr learned my addr 172.21.15.8:0/2593336615 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:36.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc87fff700 1 -- 172.21.15.8:0/2593336615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc880f8740 msgr2=0x7fbc88108fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:36.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc87fff700 1 --2- 172.21.15.8:0/2593336615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc880f8740 0x7fbc88108fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.641+0000 7fbc87fff700 1 -- 172.21.15.8:0/2593336615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c005040 con 0x7fbc880f99e0 2023-10-18T22:02:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.642+0000 7fbc87fff700 1 --2- 172.21.15.8:0/2593336615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc880f99e0 0x7fbc881094d0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7fbc740026d0 tx=0x7fbc74009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.642+0000 7fbc857fa700 1 -- 172.21.15.8:0/2593336615 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc740079c0 con 0x7fbc880f99e0 2023-10-18T22:02:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.642+0000 7fbc857fa700 1 -- 172.21.15.8:0/2593336615 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbc7400f040 con 0x7fbc880f99e0 2023-10-18T22:02:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.642+0000 7fbc8dc27700 1 -- 172.21.15.8:0/2593336615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8810a560 con 0x7fbc880f99e0 2023-10-18T22:02:36.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.642+0000 7fbc857fa700 1 -- 172.21.15.8:0/2593336615 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc74014980 con 0x7fbc880f99e0 2023-10-18T22:02:36.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.642+0000 7fbc8dc27700 1 -- 172.21.15.8:0/2593336615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8810ab20 con 0x7fbc880f99e0 2023-10-18T22:02:36.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.643+0000 7fbc8dc27700 1 -- 172.21.15.8:0/2593336615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc88045ad0 con 0x7fbc880f99e0 2023-10-18T22:02:36.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.644+0000 7fbc857fa700 1 -- 172.21.15.8:0/2593336615 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbc740090d0 con 0x7fbc880f99e0 2023-10-18T22:02:36.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.645+0000 7fbc857fa700 1 --2- 172.21.15.8:0/2593336615 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc78060f70 0x7fbc78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:36.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.645+0000 7fbc857fa700 1 -- 172.21.15.8:0/2593336615 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbc7407c980 con 0x7fbc880f99e0 2023-10-18T22:02:36.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.645+0000 7fbc8cc25700 1 --2- 172.21.15.8:0/2593336615 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc78060f70 0x7fbc78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:36.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.645+0000 7fbc8cc25700 1 --2- 172.21.15.8:0/2593336615 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc78060f70 0x7fbc78063430 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fbc7c004630 tx=0x7fbc7c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:36.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.649+0000 7fbc857fa700 1 -- 172.21.15.8:0/2593336615 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbc74050010 con 0x7fbc880f99e0 2023-10-18T22:02:36.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.902+0000 7fbc8dc27700 1 -- 172.21.15.8:0/2593336615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbc88027a00 con 0x7fbc880f99e0 2023-10-18T22:02:36.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.903+0000 7fbc857fa700 1 -- 172.21.15.8:0/2593336615 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fbc7404fc00 con 0x7fbc880f99e0 2023-10-18T22:02:36.906 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:02:36.906 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:02:36.906 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:02:36.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:02:36.907 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:02:36.907 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:02:36.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:02:36.907 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:02:36.907 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:02:36.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:02:36.908 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:02:36.908 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:02:36.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:02:36.909 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:02:36.909 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:02:36.910 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:02:36.910 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:02:36.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 -- 172.21.15.8:0/2593336615 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc78060f70 msgr2=0x7fbc78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:36.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 --2- 172.21.15.8:0/2593336615 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc78060f70 0x7fbc78063430 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fbc7c004630 tx=0x7fbc7c009b30).stop 2023-10-18T22:02:36.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 -- 172.21.15.8:0/2593336615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc880f99e0 msgr2=0x7fbc881094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:36.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 --2- 172.21.15.8:0/2593336615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc880f99e0 0x7fbc881094d0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7fbc740026d0 tx=0x7fbc74009de0).stop 2023-10-18T22:02:36.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 -- 172.21.15.8:0/2593336615 shutdown_connections 2023-10-18T22:02:36.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 --2- 172.21.15.8:0/2593336615 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc78060f70 0x7fbc78063430 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 --2- 172.21.15.8:0/2593336615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc880f8740 0x7fbc88108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 --2- 172.21.15.8:0/2593336615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc880f99e0 0x7fbc881094d0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:36.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 -- 172.21.15.8:0/2593336615 >> 172.21.15.8:0/2593336615 conn(0x7fbc880f40e0 msgr2=0x7fbc880fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:36.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 -- 172.21.15.8:0/2593336615 shutdown_connections 2023-10-18T22:02:36.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:36.905+0000 7fbc8dc27700 1 -- 172.21.15.8:0/2593336615 wait complete. 2023-10-18T22:02:37.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.047+0000 7f1291b13700 1 -- 172.21.15.8:0/2484195771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f128c0f6530 msgr2=0x7f128c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:37.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.047+0000 7f1291b13700 1 --2- 172.21.15.8:0/2484195771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f128c0f6530 0x7f128c0f6950 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f1280004660 tx=0x7f1280009b30).stop 2023-10-18T22:02:37.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.047+0000 7f1291b13700 1 -- 172.21.15.8:0/2484195771 shutdown_connections 2023-10-18T22:02:37.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.047+0000 7f1291b13700 1 --2- 172.21.15.8:0/2484195771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f128c0f77d0 0x7f128c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:37.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.047+0000 7f1291b13700 1 --2- 172.21.15.8:0/2484195771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f128c0f6530 0x7f128c0f6950 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:37.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.047+0000 7f1291b13700 1 -- 172.21.15.8:0/2484195771 >> 172.21.15.8:0/2484195771 conn(0x7f128c0f1c90 msgr2=0x7f128c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:37.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.048+0000 7f1291b13700 1 -- 172.21.15.8:0/2484195771 shutdown_connections 2023-10-18T22:02:37.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.048+0000 7f1291b13700 1 -- 172.21.15.8:0/2484195771 wait complete. 2023-10-18T22:02:37.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.048+0000 7f1291b13700 1 Processor -- start 2023-10-18T22:02:37.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.049+0000 7f1291b13700 1 -- start start 2023-10-18T22:02:37.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.049+0000 7f1291b13700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f128c0f6530 0x7f128c106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:37.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.049+0000 7f1291b13700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f128c0f77d0 0x7f128c107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:37.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.049+0000 7f1291b13700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c107910 con 0x7f128c0f6530 2023-10-18T22:02:37.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.049+0000 7f1291b13700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c108120 con 0x7f128c0f77d0 2023-10-18T22:02:37.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.049+0000 7f1290b11700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f128c0f6530 0x7f128c106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:37.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.049+0000 7f1290b11700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f128c0f6530 0x7f128c106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59406/0 (socket says 172.21.15.8:59406) 2023-10-18T22:02:37.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.049+0000 7f1290b11700 1 -- 172.21.15.8:0/2957714423 learned_addr learned my addr 172.21.15.8:0/2957714423 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:37.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.049+0000 7f1290b11700 1 -- 172.21.15.8:0/2957714423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f128c0f77d0 msgr2=0x7f128c107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:37.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.049+0000 7f1290b11700 1 --2- 172.21.15.8:0/2957714423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f128c0f77d0 0x7f128c107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:02:37.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.050+0000 7f1290b11700 1 -- 172.21.15.8:0/2957714423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1280005040 con 0x7f128c0f6530 2023-10-18T22:02:37.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.050+0000 7f1290b11700 1 --2- 172.21.15.8:0/2957714423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f128c0f6530 0x7f128c106e20 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f1280007a60 tx=0x7f1280009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:37.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.050+0000 7f12897fa700 1 -- 172.21.15.8:0/2957714423 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1280018070 con 0x7f128c0f6530 2023-10-18T22:02:37.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.050+0000 7f12897fa700 1 -- 172.21.15.8:0/2957714423 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1280009630 con 0x7f128c0f6530 2023-10-18T22:02:37.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.050+0000 7f12897fa700 1 -- 172.21.15.8:0/2957714423 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f128001c540 con 0x7f128c0f6530 2023-10-18T22:02:37.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.050+0000 7f1291b13700 1 -- 172.21.15.8:0/2957714423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c108340 con 0x7f128c0f6530 2023-10-18T22:02:37.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.050+0000 7f1291b13700 1 -- 172.21.15.8:0/2957714423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c1088a0 con 0x7f128c0f6530 2023-10-18T22:02:37.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.051+0000 7f1291b13700 1 -- 172.21.15.8:0/2957714423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c059100 con 0x7f128c0f6530 2023-10-18T22:02:37.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.052+0000 7f12897fa700 1 -- 172.21.15.8:0/2957714423 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f128001d420 con 0x7f128c0f6530 2023-10-18T22:02:37.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.053+0000 7f12897fa700 1 --2- 172.21.15.8:0/2957714423 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f127c060f70 0x7f127c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.053+0000 7f12897fa700 1 -- 172.21.15.8:0/2957714423 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f128007e6c0 con 0x7f128c0f6530 2023-10-18T22:02:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.053+0000 7f128bfff700 1 --2- 172.21.15.8:0/2957714423 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f127c060f70 0x7f127c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.054+0000 7f128bfff700 1 --2- 172.21.15.8:0/2957714423 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f127c060f70 0x7f127c063430 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f1278004a10 tx=0x7f12780099e0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:37.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.057+0000 7f12897fa700 1 -- 172.21.15.8:0/2957714423 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f128004e2f0 con 0x7f128c0f6530 2023-10-18T22:02:37.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.285+0000 7f1291b13700 1 -- 172.21.15.8:0/2957714423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f128c0fecc0 con 0x7f128c0f6530 2023-10-18T22:02:37.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.286+0000 7f12897fa700 1 -- 172.21.15.8:0/2957714423 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1280051910 con 0x7f128c0f6530 2023-10-18T22:02:37.289 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:02:37.289 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:02:37.290 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:02:37.290 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:02:37.290 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:02:37.290 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:02:37.291 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:02:37.291 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:02:37.291 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:02:37.291 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:02:37.292 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:02:37.292 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:02:37.292 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:02:37.292 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:02:37.292 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:02:37.293 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:02:37.293 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:02:37.293 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:02:37.293 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:02:37.293 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:02:37.294 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:02:37.294 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:02:37.294 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:02:37.294 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:02:37.294 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:02:37.295 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:02:37.295 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:02:37.295 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:02:37.295 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:02:37.295 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:02:37.296 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:02:37.296 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:02:37.296 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:02:37.296 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:02:37.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 -- 172.21.15.8:0/2957714423 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f127c060f70 msgr2=0x7f127c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:37.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 --2- 172.21.15.8:0/2957714423 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f127c060f70 0x7f127c063430 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f1278004a10 tx=0x7f12780099e0).stop 2023-10-18T22:02:37.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 -- 172.21.15.8:0/2957714423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f128c0f6530 msgr2=0x7f128c106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:37.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 --2- 172.21.15.8:0/2957714423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f128c0f6530 0x7f128c106e20 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f1280007a60 tx=0x7f1280009b30).stop 2023-10-18T22:02:37.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 -- 172.21.15.8:0/2957714423 shutdown_connections 2023-10-18T22:02:37.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 --2- 172.21.15.8:0/2957714423 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f127c060f70 0x7f127c063430 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:37.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 --2- 172.21.15.8:0/2957714423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f128c0f6530 0x7f128c106e20 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:37.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 --2- 172.21.15.8:0/2957714423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f128c0f77d0 0x7f128c107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:02:37.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 -- 172.21.15.8:0/2957714423 >> 172.21.15.8:0/2957714423 conn(0x7f128c0f1c90 msgr2=0x7f128c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:37.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 -- 172.21.15.8:0/2957714423 shutdown_connections 2023-10-18T22:02:37.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.288+0000 7f1291b13700 1 -- 172.21.15.8:0/2957714423 wait complete. 2023-10-18T22:02:37.299 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:02:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:35.598666+0000 mgr.smithi008.flmjzp (mgr.14640) 3819 : cluster [DBG] pgmap v2625: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:35.783696+0000 mgr.smithi008.flmjzp (mgr.14640) 3820 : audit [DBG] from='client.37120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.144107+0000 mgr.smithi008.flmjzp (mgr.14640) 3821 : audit [DBG] from='client.37124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.182284+0000 mon.smithi008 (mon.0) 4153 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.183160+0000 mon.smithi008 (mon.0) 4154 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:36.183907+0000 mgr.smithi008.flmjzp (mgr.14640) 3822 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:36.184474+0000 mgr.smithi008.flmjzp (mgr.14640) 3823 : cluster [DBG] pgmap v2626: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:36.184712+0000 mgr.smithi008.flmjzp (mgr.14640) 3824 : cluster [DBG] pgmap v2627: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.188907+0000 mon.smithi008 (mon.0) 4155 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.197137+0000 mon.smithi008 (mon.0) 4156 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.200310+0000 mon.smithi008 (mon.0) 4157 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.202002+0000 mon.smithi008 (mon.0) 4158 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.203723+0000 mon.smithi008 (mon.0) 4159 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.206005+0000 mon.smithi008 (mon.0) 4160 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:36.208418+0000 mgr.smithi008.flmjzp (mgr.14640) 3825 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.904535+0000 mon.smithi008 (mon.0) 4161 : audit [DBG] from='client.? 172.21.15.8:0/2593336615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.426+0000 7f8026bc6700 1 -- 172.21.15.8:0/3163169757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80200f77d0 msgr2=0x7f80200f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.426+0000 7f8026bc6700 1 --2- 172.21.15.8:0/3163169757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80200f77d0 0x7f80200f7c30 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f8010004660 tx=0x7f8010009b30).stop 2023-10-18T22:02:37.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.426+0000 7f8026bc6700 1 -- 172.21.15.8:0/3163169757 shutdown_connections 2023-10-18T22:02:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.426+0000 7f8026bc6700 1 --2- 172.21.15.8:0/3163169757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80200f77d0 0x7f80200f7c30 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.426+0000 7f8026bc6700 1 --2- 172.21.15.8:0/3163169757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80200f6530 0x7f80200f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.426+0000 7f8026bc6700 1 -- 172.21.15.8:0/3163169757 >> 172.21.15.8:0/3163169757 conn(0x7f80200f1c90 msgr2=0x7f80200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.426+0000 7f8026bc6700 1 -- 172.21.15.8:0/3163169757 shutdown_connections 2023-10-18T22:02:37.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.426+0000 7f8026bc6700 1 -- 172.21.15.8:0/3163169757 wait complete. 2023-10-18T22:02:37.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.427+0000 7f8026bc6700 1 Processor -- start 2023-10-18T22:02:37.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.427+0000 7f8026bc6700 1 -- start start 2023-10-18T22:02:37.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.427+0000 7f8026bc6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80200f6530 0x7f8020106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:37.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.427+0000 7f8026bc6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80200f77d0 0x7f8020107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:37.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.427+0000 7f8026bc6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8020107830 con 0x7f80200f6530 2023-10-18T22:02:37.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.427+0000 7f8026bc6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8020108040 con 0x7f80200f77d0 2023-10-18T22:02:37.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.427+0000 7f8025bc4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80200f6530 0x7f8020106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:37.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f8025bc4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80200f6530 0x7f8020106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59428/0 (socket says 172.21.15.8:59428) 2023-10-18T22:02:37.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f8025bc4700 1 -- 172.21.15.8:0/656882621 learned_addr learned my addr 172.21.15.8:0/656882621 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:02:37.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f80253c3700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80200f77d0 0x7f8020107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:37.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f8025bc4700 1 -- 172.21.15.8:0/656882621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80200f77d0 msgr2=0x7f8020107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:37.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f8025bc4700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80200f77d0 0x7f8020107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:37.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f8025bc4700 1 -- 172.21.15.8:0/656882621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8010005040 con 0x7f80200f6530 2023-10-18T22:02:37.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f8025bc4700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80200f6530 0x7f8020106d40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f801c002700 tx=0x7f801c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:37.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f80167fc700 1 -- 172.21.15.8:0/656882621 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f801c009320 con 0x7f80200f6530 2023-10-18T22:02:37.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f80167fc700 1 -- 172.21.15.8:0/656882621 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f801c00f040 con 0x7f80200f6530 2023-10-18T22:02:37.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f8026bc6700 1 -- 172.21.15.8:0/656882621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80201082c0 con 0x7f80200f6530 2023-10-18T22:02:37.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f80167fc700 1 -- 172.21.15.8:0/656882621 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f801c014970 con 0x7f80200f6530 2023-10-18T22:02:37.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.428+0000 7f8026bc6700 1 -- 172.21.15.8:0/656882621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8020108880 con 0x7f80200f6530 2023-10-18T22:02:37.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.429+0000 7f8026bc6700 1 -- 172.21.15.8:0/656882621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8020059100 con 0x7f80200f6530 2023-10-18T22:02:37.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.430+0000 7f80167fc700 1 -- 172.21.15.8:0/656882621 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f801c009480 con 0x7f80200f6530 2023-10-18T22:02:37.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.431+0000 7f80167fc700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f800c060f70 0x7f800c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:02:37.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.431+0000 7f80167fc700 1 -- 172.21.15.8:0/656882621 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f801c07cb90 con 0x7f80200f6530 2023-10-18T22:02:37.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.431+0000 7f80253c3700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f800c060f70 0x7f800c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:02:37.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.432+0000 7f80253c3700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f800c060f70 0x7f800c063430 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f8010004630 tx=0x7f8010009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:02:37.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.435+0000 7f80167fc700 1 -- 172.21.15.8:0/656882621 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f801c04c7c0 con 0x7f80200f6530 2023-10-18T22:02:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:35.598666+0000 mgr.smithi008.flmjzp (mgr.14640) 3819 : cluster [DBG] pgmap v2625: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:35.783696+0000 mgr.smithi008.flmjzp (mgr.14640) 3820 : audit [DBG] from='client.37120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.144107+0000 mgr.smithi008.flmjzp (mgr.14640) 3821 : audit [DBG] from='client.37124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.182284+0000 mon.smithi008 (mon.0) 4153 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.183160+0000 mon.smithi008 (mon.0) 4154 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:36.183907+0000 mgr.smithi008.flmjzp (mgr.14640) 3822 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:36.184474+0000 mgr.smithi008.flmjzp (mgr.14640) 3823 : cluster [DBG] pgmap v2626: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:36.184712+0000 mgr.smithi008.flmjzp (mgr.14640) 3824 : cluster [DBG] pgmap v2627: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.188907+0000 mon.smithi008 (mon.0) 4155 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.197137+0000 mon.smithi008 (mon.0) 4156 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.200310+0000 mon.smithi008 (mon.0) 4157 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.202002+0000 mon.smithi008 (mon.0) 4158 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.203723+0000 mon.smithi008 (mon.0) 4159 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.206005+0000 mon.smithi008 (mon.0) 4160 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:37.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:36.208418+0000 mgr.smithi008.flmjzp (mgr.14640) 3825 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:37.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.904535+0000 mon.smithi008 (mon.0) 4161 : audit [DBG] from='client.? 172.21.15.8:0/2593336615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:37.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.634+0000 7f8026bc6700 1 -- 172.21.15.8:0/656882621 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80200feda0 con 0x7f800c060f70 2023-10-18T22:02:37.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.635+0000 7f80167fc700 1 -- 172.21.15.8:0/656882621 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f80200feda0 con 0x7f800c060f70 2023-10-18T22:02:37.638 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:02:37.638 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:02:37.638 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:02:37.638 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:02:37.639 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:02:37.639 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:02:37.639 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:02:37.639 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:02:37.640 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:02:37.640 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:02:37.640 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:02:37.640 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:02:37.640 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:02:37.641 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:02:37.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.637+0000 7f8026bc6700 1 -- 172.21.15.8:0/656882621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f800c060f70 msgr2=0x7f800c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.637+0000 7f8026bc6700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f800c060f70 0x7f800c063430 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f8010004630 tx=0x7f8010009b30).stop 2023-10-18T22:02:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.637+0000 7f8026bc6700 1 -- 172.21.15.8:0/656882621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80200f6530 msgr2=0x7f8020106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:02:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.637+0000 7f8026bc6700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80200f6530 0x7f8020106d40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f801c002700 tx=0x7f801c009d80).stop 2023-10-18T22:02:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.637+0000 7f8026bc6700 1 -- 172.21.15.8:0/656882621 shutdown_connections 2023-10-18T22:02:37.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.637+0000 7f8026bc6700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f800c060f70 0x7f800c063430 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:37.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.637+0000 7f8026bc6700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80200f6530 0x7f8020106d40 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:37.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.637+0000 7f8026bc6700 1 --2- 172.21.15.8:0/656882621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80200f77d0 0x7f8020107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:02:37.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.638+0000 7f8026bc6700 1 -- 172.21.15.8:0/656882621 >> 172.21.15.8:0/656882621 conn(0x7f80200f1c90 msgr2=0x7f80200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:02:37.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.638+0000 7f8026bc6700 1 -- 172.21.15.8:0/656882621 shutdown_connections 2023-10-18T22:02:37.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:02:37.638+0000 7f8026bc6700 1 -- 172.21.15.8:0/656882621 wait complete. 2023-10-18T22:02:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:36.494728+0000 mgr.smithi008.flmjzp (mgr.14640) 3826 : audit [DBG] from='client.37128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:38.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:37.287571+0000 mon.smithi008 (mon.0) 4162 : audit [DBG] from='client.? 172.21.15.8:0/2957714423' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:02:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:36.494728+0000 mgr.smithi008.flmjzp (mgr.14640) 3826 : audit [DBG] from='client.37128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:37.287571+0000 mon.smithi008 (mon.0) 4162 : audit [DBG] from='client.? 172.21.15.8:0/2957714423' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:02:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:37.636772+0000 mgr.smithi008.flmjzp (mgr.14640) 3827 : audit [DBG] from='client.37140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:38.185220+0000 mgr.smithi008.flmjzp (mgr.14640) 3828 : cluster [DBG] pgmap v2628: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:37.636772+0000 mgr.smithi008.flmjzp (mgr.14640) 3827 : audit [DBG] from='client.37140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:02:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:38.185220+0000 mgr.smithi008.flmjzp (mgr.14640) 3828 : cluster [DBG] pgmap v2628: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:40.185860+0000 mgr.smithi008.flmjzp (mgr.14640) 3829 : cluster [DBG] pgmap v2629: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:40.185860+0000 mgr.smithi008.flmjzp (mgr.14640) 3829 : cluster [DBG] pgmap v2629: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:42.186500+0000 mgr.smithi008.flmjzp (mgr.14640) 3830 : cluster [DBG] pgmap v2630: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:42.186500+0000 mgr.smithi008.flmjzp (mgr.14640) 3830 : cluster [DBG] pgmap v2630: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:44.186963+0000 mgr.smithi008.flmjzp (mgr.14640) 3831 : cluster [DBG] pgmap v2631: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:44.186963+0000 mgr.smithi008.flmjzp (mgr.14640) 3831 : cluster [DBG] pgmap v2631: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:46.187546+0000 mgr.smithi008.flmjzp (mgr.14640) 3832 : cluster [DBG] pgmap v2632: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:46.212932+0000 mon.smithi008 (mon.0) 4163 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:46.215110+0000 mon.smithi008 (mon.0) 4164 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:46.216128+0000 mon.smithi008 (mon.0) 4165 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:46.216997+0000 mgr.smithi008.flmjzp (mgr.14640) 3833 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:46.217531+0000 mgr.smithi008.flmjzp (mgr.14640) 3834 : cluster [DBG] pgmap v2633: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:46.217768+0000 mgr.smithi008.flmjzp (mgr.14640) 3835 : cluster [DBG] pgmap v2634: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:46.222826+0000 mon.smithi008 (mon.0) 4166 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:46.230905+0000 mon.smithi008 (mon.0) 4167 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:46.234551+0000 mon.smithi008 (mon.0) 4168 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:46.236560+0000 mon.smithi008 (mon.0) 4169 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:46.238600+0000 mon.smithi008 (mon.0) 4170 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:46.241239+0000 mon.smithi008 (mon.0) 4171 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:46.243393+0000 mgr.smithi008.flmjzp (mgr.14640) 3836 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:46.187546+0000 mgr.smithi008.flmjzp (mgr.14640) 3832 : cluster [DBG] pgmap v2632: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:46.212932+0000 mon.smithi008 (mon.0) 4163 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:46.215110+0000 mon.smithi008 (mon.0) 4164 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:46.216128+0000 mon.smithi008 (mon.0) 4165 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:46.216997+0000 mgr.smithi008.flmjzp (mgr.14640) 3833 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:46.217531+0000 mgr.smithi008.flmjzp (mgr.14640) 3834 : cluster [DBG] pgmap v2633: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:46.217768+0000 mgr.smithi008.flmjzp (mgr.14640) 3835 : cluster [DBG] pgmap v2634: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:46.222826+0000 mon.smithi008 (mon.0) 4166 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:46.230905+0000 mon.smithi008 (mon.0) 4167 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:46.234551+0000 mon.smithi008 (mon.0) 4168 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:47.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:46.236560+0000 mon.smithi008 (mon.0) 4169 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:47.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:46.238600+0000 mon.smithi008 (mon.0) 4170 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:47.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:46.241239+0000 mon.smithi008 (mon.0) 4171 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:47.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:46.243393+0000 mgr.smithi008.flmjzp (mgr.14640) 3836 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:48.218230+0000 mgr.smithi008.flmjzp (mgr.14640) 3837 : cluster [DBG] pgmap v2635: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:48.218230+0000 mgr.smithi008.flmjzp (mgr.14640) 3837 : cluster [DBG] pgmap v2635: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:51.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:50.218935+0000 mgr.smithi008.flmjzp (mgr.14640) 3838 : cluster [DBG] pgmap v2636: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:50.218935+0000 mgr.smithi008.flmjzp (mgr.14640) 3838 : cluster [DBG] pgmap v2636: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:52.219652+0000 mgr.smithi008.flmjzp (mgr.14640) 3839 : cluster [DBG] pgmap v2637: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:52.219652+0000 mgr.smithi008.flmjzp (mgr.14640) 3839 : cluster [DBG] pgmap v2637: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:54.220173+0000 mgr.smithi008.flmjzp (mgr.14640) 3840 : cluster [DBG] pgmap v2638: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:54.220173+0000 mgr.smithi008.flmjzp (mgr.14640) 3840 : cluster [DBG] pgmap v2638: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:56.220755+0000 mgr.smithi008.flmjzp (mgr.14640) 3841 : cluster [DBG] pgmap v2639: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:57.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:56.253728+0000 mon.smithi008 (mon.0) 4172 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:56.810481+0000 mon.smithi008 (mon.0) 4173 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:56.811668+0000 mon.smithi008 (mon.0) 4174 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:56.818657+0000 mon.smithi008 (mon.0) 4175 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:56.826022+0000 mon.smithi008 (mon.0) 4176 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:57.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:56.829563+0000 mon.smithi008 (mon.0) 4177 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:57.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:56.831290+0000 mon.smithi008 (mon.0) 4178 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:57.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:56.832883+0000 mon.smithi008 (mon.0) 4179 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:57.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:02:56.835213+0000 mon.smithi008 (mon.0) 4180 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:56.220755+0000 mgr.smithi008.flmjzp (mgr.14640) 3841 : cluster [DBG] pgmap v2639: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:56.253728+0000 mon.smithi008 (mon.0) 4172 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:56.810481+0000 mon.smithi008 (mon.0) 4173 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:02:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:56.811668+0000 mon.smithi008 (mon.0) 4174 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:02:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:56.818657+0000 mon.smithi008 (mon.0) 4175 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:02:57.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:56.826022+0000 mon.smithi008 (mon.0) 4176 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:02:57.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:56.829563+0000 mon.smithi008 (mon.0) 4177 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:57.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:56.831290+0000 mon.smithi008 (mon.0) 4178 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:57.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:56.832883+0000 mon.smithi008 (mon.0) 4179 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:57.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:02:56.835213+0000 mon.smithi008 (mon.0) 4180 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:02:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:56.812577+0000 mgr.smithi008.flmjzp (mgr.14640) 3842 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:58.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:56.813201+0000 mgr.smithi008.flmjzp (mgr.14640) 3843 : cluster [DBG] pgmap v2640: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:56.813481+0000 mgr.smithi008.flmjzp (mgr.14640) 3844 : cluster [DBG] pgmap v2641: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:58.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:02:56.837444+0000 mgr.smithi008.flmjzp (mgr.14640) 3845 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:02:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:56.812577+0000 mgr.smithi008.flmjzp (mgr.14640) 3842 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:02:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:56.813201+0000 mgr.smithi008.flmjzp (mgr.14640) 3843 : cluster [DBG] pgmap v2640: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:56.813481+0000 mgr.smithi008.flmjzp (mgr.14640) 3844 : cluster [DBG] pgmap v2641: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:02:58.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:02:56.837444+0000 mgr.smithi008.flmjzp (mgr.14640) 3845 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:02:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:02:58.814210+0000 mgr.smithi008.flmjzp (mgr.14640) 3846 : cluster [DBG] pgmap v2642: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:00.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:02:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:02:58.814210+0000 mgr.smithi008.flmjzp (mgr.14640) 3846 : cluster [DBG] pgmap v2642: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:02.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:00.814733+0000 mgr.smithi008.flmjzp (mgr.14640) 3847 : cluster [DBG] pgmap v2643: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:00.814733+0000 mgr.smithi008.flmjzp (mgr.14640) 3847 : cluster [DBG] pgmap v2643: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:02.815287+0000 mgr.smithi008.flmjzp (mgr.14640) 3848 : cluster [DBG] pgmap v2644: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:02.815287+0000 mgr.smithi008.flmjzp (mgr.14640) 3848 : cluster [DBG] pgmap v2644: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:04.815862+0000 mgr.smithi008.flmjzp (mgr.14640) 3849 : cluster [DBG] pgmap v2645: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:04.815862+0000 mgr.smithi008.flmjzp (mgr.14640) 3849 : cluster [DBG] pgmap v2645: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:06.841164+0000 mon.smithi008 (mon.0) 4181 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:06.843329+0000 mon.smithi008 (mon.0) 4182 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:06.844327+0000 mon.smithi008 (mon.0) 4183 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:06.851183+0000 mon.smithi008 (mon.0) 4184 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:07.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:06.859089+0000 mon.smithi008 (mon.0) 4185 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:07.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:06.862485+0000 mon.smithi008 (mon.0) 4186 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:07.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:06.864438+0000 mon.smithi008 (mon.0) 4187 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:07.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:06.866296+0000 mon.smithi008 (mon.0) 4188 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:07.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:06.868505+0000 mon.smithi008 (mon.0) 4189 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:06.841164+0000 mon.smithi008 (mon.0) 4181 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:06.843329+0000 mon.smithi008 (mon.0) 4182 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:06.844327+0000 mon.smithi008 (mon.0) 4183 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:06.851183+0000 mon.smithi008 (mon.0) 4184 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:06.859089+0000 mon.smithi008 (mon.0) 4185 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:06.862485+0000 mon.smithi008 (mon.0) 4186 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:06.864438+0000 mon.smithi008 (mon.0) 4187 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:07.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:06.866296+0000 mon.smithi008 (mon.0) 4188 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:07.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:06.868505+0000 mon.smithi008 (mon.0) 4189 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:07.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.790+0000 7f40ae5cd700 1 -- 172.21.15.8:0/690765512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a80f77d0 msgr2=0x7f40a80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:07.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.790+0000 7f40ae5cd700 1 --2- 172.21.15.8:0/690765512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a80f77d0 0x7f40a80f7c30 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f4098004660 tx=0x7f4098009b30).stop 2023-10-18T22:03:07.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.790+0000 7f40ae5cd700 1 -- 172.21.15.8:0/690765512 shutdown_connections 2023-10-18T22:03:07.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.790+0000 7f40ae5cd700 1 --2- 172.21.15.8:0/690765512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a80f77d0 0x7f40a80f7c30 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:07.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.790+0000 7f40ae5cd700 1 --2- 172.21.15.8:0/690765512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a80f6530 0x7f40a80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:07.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.790+0000 7f40ae5cd700 1 -- 172.21.15.8:0/690765512 >> 172.21.15.8:0/690765512 conn(0x7f40a80f1c90 msgr2=0x7f40a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:07.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.790+0000 7f40ae5cd700 1 -- 172.21.15.8:0/690765512 shutdown_connections 2023-10-18T22:03:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.790+0000 7f40ae5cd700 1 -- 172.21.15.8:0/690765512 wait complete. 2023-10-18T22:03:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.791+0000 7f40ae5cd700 1 Processor -- start 2023-10-18T22:03:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.791+0000 7f40ae5cd700 1 -- start start 2023-10-18T22:03:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ae5cd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a80f6530 0x7f40a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:07.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ae5cd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a80f77d0 0x7f40a8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ae5cd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a806a380 con 0x7f40a80f6530 2023-10-18T22:03:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ae5cd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a806a4c0 con 0x7f40a80f77d0 2023-10-18T22:03:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ad5cb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a80f6530 0x7f40a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ad5cb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a80f6530 0x7f40a806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53370/0 (socket says 172.21.15.8:53370) 2023-10-18T22:03:07.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ad5cb700 1 -- 172.21.15.8:0/1026390843 learned_addr learned my addr 172.21.15.8:0/1026390843 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40acdca700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a80f77d0 0x7f40a8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ad5cb700 1 -- 172.21.15.8:0/1026390843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a80f77d0 msgr2=0x7f40a8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ad5cb700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a80f77d0 0x7f40a8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ad5cb700 1 -- 172.21.15.8:0/1026390843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098005040 con 0x7f40a80f6530 2023-10-18T22:03:07.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40acdca700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a80f77d0 0x7f40a8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:03:07.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.792+0000 7f40ad5cb700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a80f6530 0x7f40a806b9a0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f40a4002700 tx=0x7f40a4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:07.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.793+0000 7f409dffb700 1 -- 172.21.15.8:0/1026390843 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40a4009320 con 0x7f40a80f6530 2023-10-18T22:03:07.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.793+0000 7f409dffb700 1 -- 172.21.15.8:0/1026390843 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f40a400f040 con 0x7f40a80f6530 2023-10-18T22:03:07.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.793+0000 7f409dffb700 1 -- 172.21.15.8:0/1026390843 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40a4014970 con 0x7f40a80f6530 2023-10-18T22:03:07.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.793+0000 7f40ae5cd700 1 -- 172.21.15.8:0/1026390843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a806a7a0 con 0x7f40a80f6530 2023-10-18T22:03:07.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.793+0000 7f40ae5cd700 1 -- 172.21.15.8:0/1026390843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a810ed70 con 0x7f40a80f6530 2023-10-18T22:03:07.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.794+0000 7f40ae5cd700 1 -- 172.21.15.8:0/1026390843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a8045ad0 con 0x7f40a80f6530 2023-10-18T22:03:07.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.795+0000 7f409dffb700 1 -- 172.21.15.8:0/1026390843 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f40a4009480 con 0x7f40a80f6530 2023-10-18T22:03:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.796+0000 7f409dffb700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4094060f70 0x7f4094063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.796+0000 7f409dffb700 1 -- 172.21.15.8:0/1026390843 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f40a407cad0 con 0x7f40a80f6530 2023-10-18T22:03:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.796+0000 7f40acdca700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4094060f70 0x7f4094063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.797+0000 7f40acdca700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4094060f70 0x7f4094063430 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f4098005010 tx=0x7f4098009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:07.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.801+0000 7f409dffb700 1 -- 172.21.15.8:0/1026390843 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f40a404c7c0 con 0x7f40a80f6530 2023-10-18T22:03:08.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:07.999+0000 7f40ae5cd700 1 -- 172.21.15.8:0/1026390843 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40a80fee30 con 0x7f4094060f70 2023-10-18T22:03:08.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.000+0000 7f409dffb700 1 -- 172.21.15.8:0/1026390843 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f40a80fee30 con 0x7f4094060f70 2023-10-18T22:03:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.002+0000 7f40ae5cd700 1 -- 172.21.15.8:0/1026390843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4094060f70 msgr2=0x7f4094063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.002+0000 7f40ae5cd700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4094060f70 0x7f4094063430 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f4098005010 tx=0x7f4098009b30).stop 2023-10-18T22:03:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.002+0000 7f40ae5cd700 1 -- 172.21.15.8:0/1026390843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a80f6530 msgr2=0x7f40a806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.002+0000 7f40ae5cd700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a80f6530 0x7f40a806b9a0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f40a4002700 tx=0x7f40a4009d80).stop 2023-10-18T22:03:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.002+0000 7f40ae5cd700 1 -- 172.21.15.8:0/1026390843 shutdown_connections 2023-10-18T22:03:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.002+0000 7f40ae5cd700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4094060f70 0x7f4094063430 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.002+0000 7f40ae5cd700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a80f6530 0x7f40a806b9a0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.002+0000 7f40ae5cd700 1 --2- 172.21.15.8:0/1026390843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a80f77d0 0x7f40a8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.002+0000 7f40ae5cd700 1 -- 172.21.15.8:0/1026390843 >> 172.21.15.8:0/1026390843 conn(0x7f40a80f1c90 msgr2=0x7f40a80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:08.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.003+0000 7f40ae5cd700 1 -- 172.21.15.8:0/1026390843 shutdown_connections 2023-10-18T22:03:08.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.003+0000 7f40ae5cd700 1 -- 172.21.15.8:0/1026390843 wait complete. 2023-10-18T22:03:08.020 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:03:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.141+0000 7f4ac32d8700 1 -- 172.21.15.8:0/3603704812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4abc0f77d0 msgr2=0x7f4abc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.141+0000 7f4ac32d8700 1 --2- 172.21.15.8:0/3603704812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4abc0f77d0 0x7f4abc0f7c30 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f4aac004660 tx=0x7f4aac009b30).stop 2023-10-18T22:03:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.141+0000 7f4ac32d8700 1 -- 172.21.15.8:0/3603704812 shutdown_connections 2023-10-18T22:03:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.141+0000 7f4ac32d8700 1 --2- 172.21.15.8:0/3603704812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4abc0f77d0 0x7f4abc0f7c30 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.141+0000 7f4ac32d8700 1 --2- 172.21.15.8:0/3603704812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4abc0f6530 0x7f4abc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.141+0000 7f4ac32d8700 1 -- 172.21.15.8:0/3603704812 >> 172.21.15.8:0/3603704812 conn(0x7f4abc0f1cd0 msgr2=0x7f4abc0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.141+0000 7f4ac32d8700 1 -- 172.21.15.8:0/3603704812 shutdown_connections 2023-10-18T22:03:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.141+0000 7f4ac32d8700 1 -- 172.21.15.8:0/3603704812 wait complete. 2023-10-18T22:03:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.142+0000 7f4ac32d8700 1 Processor -- start 2023-10-18T22:03:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.143+0000 7f4ac32d8700 1 -- start start 2023-10-18T22:03:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.143+0000 7f4ac32d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4abc0f6530 0x7f4abc106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.143+0000 7f4ac32d8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4abc0f77d0 0x7f4abc107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.143+0000 7f4ac32d8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc1077e0 con 0x7f4abc0f77d0 2023-10-18T22:03:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.143+0000 7f4ac32d8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc107fe0 con 0x7f4abc0f6530 2023-10-18T22:03:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.143+0000 7f4ac1ad5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4abc0f77d0 0x7f4abc107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ac1ad5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4abc0f77d0 0x7f4abc107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53400/0 (socket says 172.21.15.8:53400) 2023-10-18T22:03:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ac1ad5700 1 -- 172.21.15.8:0/167767907 learned_addr learned my addr 172.21.15.8:0/167767907 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ac22d6700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4abc0f6530 0x7f4abc106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ac1ad5700 1 -- 172.21.15.8:0/167767907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4abc0f6530 msgr2=0x7f4abc106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ac1ad5700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4abc0f6530 0x7f4abc106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ac1ad5700 1 -- 172.21.15.8:0/167767907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac005040 con 0x7f4abc0f77d0 2023-10-18T22:03:08.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ac1ad5700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4abc0f77d0 0x7f4abc107230 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f4aac004320 tx=0x7f4aac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ab2ffd700 1 -- 172.21.15.8:0/167767907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4aac019070 con 0x7f4abc0f77d0 2023-10-18T22:03:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ac32d8700 1 -- 172.21.15.8:0/167767907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc108260 con 0x7f4abc0f77d0 2023-10-18T22:03:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ab2ffd700 1 -- 172.21.15.8:0/167767907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4aac01e420 con 0x7f4abc0f77d0 2023-10-18T22:03:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.144+0000 7f4ac32d8700 1 -- 172.21.15.8:0/167767907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4abc108740 con 0x7f4abc0f77d0 2023-10-18T22:03:08.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.145+0000 7f4ab2ffd700 1 -- 172.21.15.8:0/167767907 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4aac014600 con 0x7f4abc0f77d0 2023-10-18T22:03:08.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.145+0000 7f4ac32d8700 1 -- 172.21.15.8:0/167767907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4abc059100 con 0x7f4abc0f77d0 2023-10-18T22:03:08.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.146+0000 7f4ab2ffd700 1 -- 172.21.15.8:0/167767907 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4aac01e590 con 0x7f4abc0f77d0 2023-10-18T22:03:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.147+0000 7f4ab2ffd700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4aa8060f70 0x7f4aa8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.147+0000 7f4ab2ffd700 1 -- 172.21.15.8:0/167767907 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4aac07de80 con 0x7f4abc0f77d0 2023-10-18T22:03:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.148+0000 7f4ac22d6700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4aa8060f70 0x7f4aa8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.148+0000 7f4ac22d6700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4aa8060f70 0x7f4aa8063430 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f4abc0f7630 tx=0x7f4ab800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.152+0000 7f4ab2ffd700 1 -- 172.21.15.8:0/167767907 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4aac051400 con 0x7f4abc0f77d0 2023-10-18T22:03:08.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:06.816322+0000 mgr.smithi008.flmjzp (mgr.14640) 3850 : cluster [DBG] pgmap v2646: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:08.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:06.845219+0000 mgr.smithi008.flmjzp (mgr.14640) 3851 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:03:08.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:06.845827+0000 mgr.smithi008.flmjzp (mgr.14640) 3852 : cluster [DBG] pgmap v2647: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:08.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:06.846148+0000 mgr.smithi008.flmjzp (mgr.14640) 3853 : cluster [DBG] pgmap v2648: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:08.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:06.870554+0000 mgr.smithi008.flmjzp (mgr.14640) 3854 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:08.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.353+0000 7f4ac32d8700 1 -- 172.21.15.8:0/167767907 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4abc0fed30 con 0x7f4aa8060f70 2023-10-18T22:03:08.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.355+0000 7f4ab2ffd700 1 -- 172.21.15.8:0/167767907 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4abc0fed30 con 0x7f4aa8060f70 2023-10-18T22:03:08.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.356+0000 7f4ac32d8700 1 -- 172.21.15.8:0/167767907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4aa8060f70 msgr2=0x7f4aa8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.356+0000 7f4ac32d8700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4aa8060f70 0x7f4aa8063430 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f4abc0f7630 tx=0x7f4ab800b040).stop 2023-10-18T22:03:08.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.356+0000 7f4ac32d8700 1 -- 172.21.15.8:0/167767907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4abc0f77d0 msgr2=0x7f4abc107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.356+0000 7f4ac32d8700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4abc0f77d0 0x7f4abc107230 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f4aac004320 tx=0x7f4aac00b040).stop 2023-10-18T22:03:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.357+0000 7f4ac32d8700 1 -- 172.21.15.8:0/167767907 shutdown_connections 2023-10-18T22:03:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.357+0000 7f4ac32d8700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4aa8060f70 0x7f4aa8063430 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.357+0000 7f4ac32d8700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4abc0f6530 0x7f4abc106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.357+0000 7f4ac32d8700 1 --2- 172.21.15.8:0/167767907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4abc0f77d0 0x7f4abc107230 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.357+0000 7f4ac32d8700 1 -- 172.21.15.8:0/167767907 >> 172.21.15.8:0/167767907 conn(0x7f4abc0f1cd0 msgr2=0x7f4abc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.357+0000 7f4ac32d8700 1 -- 172.21.15.8:0/167767907 shutdown_connections 2023-10-18T22:03:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.357+0000 7f4ac32d8700 1 -- 172.21.15.8:0/167767907 wait complete. 2023-10-18T22:03:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:06.816322+0000 mgr.smithi008.flmjzp (mgr.14640) 3850 : cluster [DBG] pgmap v2646: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:06.845219+0000 mgr.smithi008.flmjzp (mgr.14640) 3851 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:03:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:06.845827+0000 mgr.smithi008.flmjzp (mgr.14640) 3852 : cluster [DBG] pgmap v2647: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:06.846148+0000 mgr.smithi008.flmjzp (mgr.14640) 3853 : cluster [DBG] pgmap v2648: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:06.870554+0000 mgr.smithi008.flmjzp (mgr.14640) 3854 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.493+0000 7f34ab59e700 1 -- 172.21.15.8:0/951424133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34ac0f77d0 msgr2=0x7f34ac0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.493+0000 7f34ab59e700 1 --2- 172.21.15.8:0/951424133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34ac0f77d0 0x7f34ac0f7c30 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f34a0004660 tx=0x7f34a0009b30).stop 2023-10-18T22:03:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.493+0000 7f34ab59e700 1 -- 172.21.15.8:0/951424133 shutdown_connections 2023-10-18T22:03:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.493+0000 7f34ab59e700 1 --2- 172.21.15.8:0/951424133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34ac0f77d0 0x7f34ac0f7c30 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.493+0000 7f34ab59e700 1 --2- 172.21.15.8:0/951424133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34ac0f6530 0x7f34ac0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.493+0000 7f34ab59e700 1 -- 172.21.15.8:0/951424133 >> 172.21.15.8:0/951424133 conn(0x7f34ac0f1c90 msgr2=0x7f34ac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.493+0000 7f34ab59e700 1 -- 172.21.15.8:0/951424133 shutdown_connections 2023-10-18T22:03:08.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.494+0000 7f34ab59e700 1 -- 172.21.15.8:0/951424133 wait complete. 2023-10-18T22:03:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.494+0000 7f34ab59e700 1 Processor -- start 2023-10-18T22:03:08.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.494+0000 7f34ab59e700 1 -- start start 2023-10-18T22:03:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34ab59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34ac0f6530 0x7f34ac106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34ab59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34ac0f77d0 0x7f34ac107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34ab59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac107850 con 0x7f34ac0f6530 2023-10-18T22:03:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34ab59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac108060 con 0x7f34ac0f77d0 2023-10-18T22:03:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34aa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34ac0f6530 0x7f34ac106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34aa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34ac0f6530 0x7f34ac106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53420/0 (socket says 172.21.15.8:53420) 2023-10-18T22:03:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34aa59c700 1 -- 172.21.15.8:0/7606232 learned_addr learned my addr 172.21.15.8:0/7606232 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34a9d9b700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34ac0f77d0 0x7f34ac107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34aa59c700 1 -- 172.21.15.8:0/7606232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34ac0f77d0 msgr2=0x7f34ac107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34aa59c700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34ac0f77d0 0x7f34ac107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34aa59c700 1 -- 172.21.15.8:0/7606232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0005040 con 0x7f34ac0f6530 2023-10-18T22:03:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.495+0000 7f34a9d9b700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34ac0f77d0 0x7f34ac107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:03:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.496+0000 7f34aa59c700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34ac0f6530 0x7f34ac106d60 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f349c00e7c0 tx=0x7f349c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.496+0000 7f349affd700 1 -- 172.21.15.8:0/7606232 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349c0092e0 con 0x7f34ac0f6530 2023-10-18T22:03:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.496+0000 7f349affd700 1 -- 172.21.15.8:0/7606232 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f349c00f040 con 0x7f34ac0f6530 2023-10-18T22:03:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.496+0000 7f34ab59e700 1 -- 172.21.15.8:0/7606232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac1082e0 con 0x7f34ac0f6530 2023-10-18T22:03:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.496+0000 7f349affd700 1 -- 172.21.15.8:0/7606232 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349c0147e0 con 0x7f34ac0f6530 2023-10-18T22:03:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.496+0000 7f34ab59e700 1 -- 172.21.15.8:0/7606232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac108820 con 0x7f34ac0f6530 2023-10-18T22:03:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.497+0000 7f34ab59e700 1 -- 172.21.15.8:0/7606232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac059100 con 0x7f34ac0f6530 2023-10-18T22:03:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.498+0000 7f349affd700 1 -- 172.21.15.8:0/7606232 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f349c01b030 con 0x7f34ac0f6530 2023-10-18T22:03:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.499+0000 7f349affd700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3494060f70 0x7f3494063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.499+0000 7f349affd700 1 -- 172.21.15.8:0/7606232 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f349c07ca70 con 0x7f34ac0f6530 2023-10-18T22:03:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.499+0000 7f34a9d9b700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3494060f70 0x7f3494063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.500+0000 7f34a9d9b700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3494060f70 0x7f3494063430 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f34a00043d0 tx=0x7f34a000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:08.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.503+0000 7f349affd700 1 -- 172.21.15.8:0/7606232 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f349c04c620 con 0x7f34ac0f6530 2023-10-18T22:03:08.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.696+0000 7f34ab59e700 1 -- 172.21.15.8:0/7606232 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f34ac0fedd0 con 0x7f3494060f70 2023-10-18T22:03:08.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.706+0000 7f349affd700 1 -- 172.21.15.8:0/7606232 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f34ac0fedd0 con 0x7f3494060f70 2023-10-18T22:03:08.709 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:03:08.709 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (69m) 7m ago 71m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:03:08.709 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (63m) 7m ago 71m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:03:08.709 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (63m) 5m ago 70m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:03:08.710 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (69m) 7m ago 70m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:03:08.710 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 67m - - 2023-10-18T22:03:08.710 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 67m - - 2023-10-18T22:03:08.710 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 67m - - 2023-10-18T22:03:08.711 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 67m - - 2023-10-18T22:03:08.711 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (64m) 7m ago 72m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:03:08.711 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (64m) 5m ago 70m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:03:08.711 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (64m) 7m ago 72m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:03:08.711 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (63m) 5m ago 70m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:03:08.712 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (70m) 7m ago 70m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:03:08.712 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (70m) 5m ago 70m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:03:08.712 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (63m) 7m ago 69m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:03:08.712 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (61m) 7m ago 69m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:03:08.712 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (60m) 7m ago 69m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:03:08.713 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (60m) 5m ago 68m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:03:08.713 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (59m) 5m ago 68m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:03:08.713 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (59m) 5m ago 68m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:03:08.713 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (65m) 7m ago 70m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:03:08.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.708+0000 7f34ab59e700 1 -- 172.21.15.8:0/7606232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3494060f70 msgr2=0x7f3494063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.708+0000 7f34ab59e700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3494060f70 0x7f3494063430 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f34a00043d0 tx=0x7f34a000b040).stop 2023-10-18T22:03:08.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.708+0000 7f34ab59e700 1 -- 172.21.15.8:0/7606232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34ac0f6530 msgr2=0x7f34ac106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.708+0000 7f34ab59e700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34ac0f6530 0x7f34ac106d60 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f349c00e7c0 tx=0x7f349c00b040).stop 2023-10-18T22:03:08.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.708+0000 7f34ab59e700 1 -- 172.21.15.8:0/7606232 shutdown_connections 2023-10-18T22:03:08.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.708+0000 7f34ab59e700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3494060f70 0x7f3494063430 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.708+0000 7f34ab59e700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34ac0f6530 0x7f34ac106d60 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.708+0000 7f34ab59e700 1 --2- 172.21.15.8:0/7606232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34ac0f77d0 0x7f34ac107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.708+0000 7f34ab59e700 1 -- 172.21.15.8:0/7606232 >> 172.21.15.8:0/7606232 conn(0x7f34ac0f1c90 msgr2=0x7f34ac0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:08.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.709+0000 7f34ab59e700 1 -- 172.21.15.8:0/7606232 shutdown_connections 2023-10-18T22:03:08.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.709+0000 7f34ab59e700 1 -- 172.21.15.8:0/7606232 wait complete. 2023-10-18T22:03:08.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.844+0000 7f4f0759e700 1 -- 172.21.15.8:0/1146767220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f080f6530 msgr2=0x7f4f080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.844+0000 7f4f0759e700 1 --2- 172.21.15.8:0/1146767220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f080f6530 0x7f4f080f6950 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f4ef8004660 tx=0x7f4ef8009b30).stop 2023-10-18T22:03:08.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.844+0000 7f4f0759e700 1 -- 172.21.15.8:0/1146767220 shutdown_connections 2023-10-18T22:03:08.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.844+0000 7f4f0759e700 1 --2- 172.21.15.8:0/1146767220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f080f77d0 0x7f4f080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.844+0000 7f4f0759e700 1 --2- 172.21.15.8:0/1146767220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f080f6530 0x7f4f080f6950 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.844+0000 7f4f0759e700 1 -- 172.21.15.8:0/1146767220 >> 172.21.15.8:0/1146767220 conn(0x7f4f080f1c90 msgr2=0x7f4f080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:08.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.844+0000 7f4f0759e700 1 -- 172.21.15.8:0/1146767220 shutdown_connections 2023-10-18T22:03:08.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.844+0000 7f4f0759e700 1 -- 172.21.15.8:0/1146767220 wait complete. 2023-10-18T22:03:08.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.845+0000 7f4f0759e700 1 Processor -- start 2023-10-18T22:03:08.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.846+0000 7f4f0759e700 1 -- start start 2023-10-18T22:03:08.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.846+0000 7f4f0759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f080f6530 0x7f4f0806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:08.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.846+0000 7f4f0759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f080f77d0 0x7f4f08069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:08.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.846+0000 7f4f0759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0806a380 con 0x7f4f080f6530 2023-10-18T22:03:08.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.846+0000 7f4f0759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0806a4c0 con 0x7f4f080f77d0 2023-10-18T22:03:08.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4f0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f080f6530 0x7f4f0806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:08.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4f0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f080f6530 0x7f4f0806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53438/0 (socket says 172.21.15.8:53438) 2023-10-18T22:03:08.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4f0659c700 1 -- 172.21.15.8:0/1039353279 learned_addr learned my addr 172.21.15.8:0/1039353279 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4f05d9b700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f080f77d0 0x7f4f08069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4f0659c700 1 -- 172.21.15.8:0/1039353279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f080f77d0 msgr2=0x7f4f08069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4f0659c700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f080f77d0 0x7f4f08069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4f0659c700 1 -- 172.21.15.8:0/1039353279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8005040 con 0x7f4f080f6530 2023-10-18T22:03:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4f05d9b700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f080f77d0 0x7f4f08069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:03:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4f0659c700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f080f6530 0x7f4f0806b9a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f4ef8004e30 tx=0x7f4ef8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4ef6ffd700 1 -- 172.21.15.8:0/1039353279 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef8018070 con 0x7f4f080f6530 2023-10-18T22:03:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4ef6ffd700 1 -- 172.21.15.8:0/1039353279 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4ef8009630 con 0x7f4f080f6530 2023-10-18T22:03:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4ef6ffd700 1 -- 172.21.15.8:0/1039353279 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef801c3c0 con 0x7f4f080f6530 2023-10-18T22:03:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.847+0000 7f4f0759e700 1 -- 172.21.15.8:0/1039353279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0806a740 con 0x7f4f080f6530 2023-10-18T22:03:08.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.848+0000 7f4f0759e700 1 -- 172.21.15.8:0/1039353279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0806aca0 con 0x7f4f080f6530 2023-10-18T22:03:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.849+0000 7f4f0759e700 1 -- 172.21.15.8:0/1039353279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f08045ad0 con 0x7f4f080f6530 2023-10-18T22:03:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.850+0000 7f4ef6ffd700 1 -- 172.21.15.8:0/1039353279 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4ef801d420 con 0x7f4f080f6530 2023-10-18T22:03:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.850+0000 7f4ef6ffd700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ef0060f70 0x7f4ef0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.850+0000 7f4ef6ffd700 1 -- 172.21.15.8:0/1039353279 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4ef807e540 con 0x7f4f080f6530 2023-10-18T22:03:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.851+0000 7f4f05d9b700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ef0060f70 0x7f4ef0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.851+0000 7f4f05d9b700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ef0060f70 0x7f4ef0063430 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f4efc009780 tx=0x7f4efc009c80).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:08.855+0000 7f4ef6ffd700 1 -- 172.21.15.8:0/1039353279 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4ef804e220 con 0x7f4f080f6530 2023-10-18T22:03:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.108+0000 7f4f0759e700 1 -- 172.21.15.8:0/1039353279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4f080586e0 con 0x7f4f080f6530 2023-10-18T22:03:09.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.109+0000 7f4ef6ffd700 1 -- 172.21.15.8:0/1039353279 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f4ef8051840 con 0x7f4f080f6530 2023-10-18T22:03:09.111 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:03:09.112 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:03:09.112 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:03:09.112 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:03:09.112 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:03:09.112 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:03:09.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:03:09.113 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:03:09.113 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:03:09.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:03:09.113 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:03:09.114 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:03:09.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:03:09.114 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:03:09.114 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:03:09.114 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:03:09.115 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:03:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 -- 172.21.15.8:0/1039353279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ef0060f70 msgr2=0x7f4ef0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ef0060f70 0x7f4ef0063430 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f4efc009780 tx=0x7f4efc009c80).stop 2023-10-18T22:03:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 -- 172.21.15.8:0/1039353279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f080f6530 msgr2=0x7f4f0806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f080f6530 0x7f4f0806b9a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f4ef8004e30 tx=0x7f4ef8009b30).stop 2023-10-18T22:03:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 -- 172.21.15.8:0/1039353279 shutdown_connections 2023-10-18T22:03:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ef0060f70 0x7f4ef0063430 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f080f6530 0x7f4f0806b9a0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 --2- 172.21.15.8:0/1039353279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f080f77d0 0x7f4f08069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 -- 172.21.15.8:0/1039353279 >> 172.21.15.8:0/1039353279 conn(0x7f4f080f1c90 msgr2=0x7f4f080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 -- 172.21.15.8:0/1039353279 shutdown_connections 2023-10-18T22:03:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.111+0000 7f4f0759e700 1 -- 172.21.15.8:0/1039353279 wait complete. 2023-10-18T22:03:09.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.247+0000 7f3dd569a700 1 -- 172.21.15.8:0/3594920073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd00f6530 msgr2=0x7f3dd00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:09.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.247+0000 7f3dd569a700 1 --2- 172.21.15.8:0/3594920073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd00f6530 0x7f3dd00f6950 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f3dc0004660 tx=0x7f3dc0009b30).stop 2023-10-18T22:03:09.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.247+0000 7f3dd569a700 1 -- 172.21.15.8:0/3594920073 shutdown_connections 2023-10-18T22:03:09.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.247+0000 7f3dd569a700 1 --2- 172.21.15.8:0/3594920073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd00f77d0 0x7f3dd00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.247+0000 7f3dd569a700 1 --2- 172.21.15.8:0/3594920073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd00f6530 0x7f3dd00f6950 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.247+0000 7f3dd569a700 1 -- 172.21.15.8:0/3594920073 >> 172.21.15.8:0/3594920073 conn(0x7f3dd00f1c90 msgr2=0x7f3dd00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:09.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.247+0000 7f3dd569a700 1 -- 172.21.15.8:0/3594920073 shutdown_connections 2023-10-18T22:03:09.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.247+0000 7f3dd569a700 1 -- 172.21.15.8:0/3594920073 wait complete. 2023-10-18T22:03:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.248+0000 7f3dd569a700 1 Processor -- start 2023-10-18T22:03:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.249+0000 7f3dd569a700 1 -- start start 2023-10-18T22:03:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.249+0000 7f3dd569a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd00f6530 0x7f3dd0106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.249+0000 7f3dd569a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd00f77d0 0x7f3dd0107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:09.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.249+0000 7f3dd569a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0107870 con 0x7f3dd00f77d0 2023-10-18T22:03:09.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.249+0000 7f3dd569a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd01080b0 con 0x7f3dd00f6530 2023-10-18T22:03:09.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.249+0000 7f3dcf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd00f77d0 0x7f3dd0107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:09.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.249+0000 7f3dcf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd00f77d0 0x7f3dd0107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53456/0 (socket says 172.21.15.8:53456) 2023-10-18T22:03:09.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.249+0000 7f3dcffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd00f6530 0x7f3dd0106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:09.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.249+0000 7f3dcf7fe700 1 -- 172.21.15.8:0/3678422219 learned_addr learned my addr 172.21.15.8:0/3678422219 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.250+0000 7f3dcf7fe700 1 -- 172.21.15.8:0/3678422219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd00f6530 msgr2=0x7f3dd0106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.250+0000 7f3dcf7fe700 1 --2- 172.21.15.8:0/3678422219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd00f6530 0x7f3dd0106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.250+0000 7f3dcf7fe700 1 -- 172.21.15.8:0/3678422219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc0005040 con 0x7f3dd00f77d0 2023-10-18T22:03:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.250+0000 7f3dcf7fe700 1 --2- 172.21.15.8:0/3678422219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd00f77d0 0x7f3dd0107270 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f3dc400e7f0 tx=0x7f3dc400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:09.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.250+0000 7f3dccff9700 1 -- 172.21.15.8:0/3678422219 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dc40092e0 con 0x7f3dd00f77d0 2023-10-18T22:03:09.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.250+0000 7f3dccff9700 1 -- 172.21.15.8:0/3678422219 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3dc400f040 con 0x7f3dd00f77d0 2023-10-18T22:03:09.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.250+0000 7f3dccff9700 1 -- 172.21.15.8:0/3678422219 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dc40147e0 con 0x7f3dd00f77d0 2023-10-18T22:03:09.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.250+0000 7f3dd569a700 1 -- 172.21.15.8:0/3678422219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd0108390 con 0x7f3dd00f77d0 2023-10-18T22:03:09.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.250+0000 7f3dd569a700 1 -- 172.21.15.8:0/3678422219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd01088d0 con 0x7f3dd00f77d0 2023-10-18T22:03:09.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.252+0000 7f3dd569a700 1 -- 172.21.15.8:0/3678422219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd0059100 con 0x7f3dd00f77d0 2023-10-18T22:03:09.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.252+0000 7f3dccff9700 1 -- 172.21.15.8:0/3678422219 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3dc401b030 con 0x7f3dd00f77d0 2023-10-18T22:03:09.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.253+0000 7f3dccff9700 1 --2- 172.21.15.8:0/3678422219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db8060f70 0x7f3db8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:09.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.253+0000 7f3dccff9700 1 -- 172.21.15.8:0/3678422219 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3dc407c7c0 con 0x7f3dd00f77d0 2023-10-18T22:03:09.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.254+0000 7f3dcffff700 1 --2- 172.21.15.8:0/3678422219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db8060f70 0x7f3db8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:09.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.254+0000 7f3dcffff700 1 --2- 172.21.15.8:0/3678422219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db8060f70 0x7f3db8063430 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f3dc0005010 tx=0x7f3dc0016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.258+0000 7f3dccff9700 1 -- 172.21.15.8:0/3678422219 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3dc404c420 con 0x7f3dd00f77d0 2023-10-18T22:03:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:08.001744+0000 mgr.smithi008.flmjzp (mgr.14640) 3855 : audit [DBG] from='client.37144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:09.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.483+0000 7f3dd569a700 1 -- 172.21.15.8:0/3678422219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3dd00fed80 con 0x7f3dd00f77d0 2023-10-18T22:03:09.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.483+0000 7f3dccff9700 1 -- 172.21.15.8:0/3678422219 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f3dc4019070 con 0x7f3dd00f77d0 2023-10-18T22:03:09.486 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:03:09.486 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:03:09.486 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:03:09.487 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:03:09.487 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:03:09.487 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:03:09.487 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:03:09.487 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:03:09.488 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:03:09.488 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:03:09.488 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:03:09.488 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:03:09.488 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:03:09.488 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:03:09.489 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:03:09.489 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:03:09.489 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:03:09.489 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:03:09.489 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:03:09.489 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:03:09.490 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:03:09.490 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:03:09.490 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:03:09.490 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:03:09.490 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:03:09.491 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:03:09.491 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:03:09.491 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:03:09.491 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:03:09.491 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:03:09.491 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:03:09.492 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:03:09.492 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:03:09.492 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:03:09.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:08.001744+0000 mgr.smithi008.flmjzp (mgr.14640) 3855 : audit [DBG] from='client.37144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:09.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.485+0000 7f3dd569a700 1 -- 172.21.15.8:0/3678422219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db8060f70 msgr2=0x7f3db8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:09.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.485+0000 7f3dd569a700 1 --2- 172.21.15.8:0/3678422219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db8060f70 0x7f3db8063430 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f3dc0005010 tx=0x7f3dc0016040).stop 2023-10-18T22:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.485+0000 7f3dd569a700 1 -- 172.21.15.8:0/3678422219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd00f77d0 msgr2=0x7f3dd0107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.485+0000 7f3dd569a700 1 --2- 172.21.15.8:0/3678422219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd00f77d0 0x7f3dd0107270 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f3dc400e7f0 tx=0x7f3dc400b040).stop 2023-10-18T22:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.485+0000 7f3dd569a700 1 -- 172.21.15.8:0/3678422219 shutdown_connections 2023-10-18T22:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.485+0000 7f3dd569a700 1 --2- 172.21.15.8:0/3678422219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3db8060f70 0x7f3db8063430 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.485+0000 7f3dd569a700 1 --2- 172.21.15.8:0/3678422219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd00f6530 0x7f3dd0106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.485+0000 7f3dd569a700 1 --2- 172.21.15.8:0/3678422219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd00f77d0 0x7f3dd0107270 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.485+0000 7f3dd569a700 1 -- 172.21.15.8:0/3678422219 >> 172.21.15.8:0/3678422219 conn(0x7f3dd00f1c90 msgr2=0x7f3dd00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.486+0000 7f3dd569a700 1 -- 172.21.15.8:0/3678422219 shutdown_connections 2023-10-18T22:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.486+0000 7f3dd569a700 1 -- 172.21.15.8:0/3678422219 wait complete. 2023-10-18T22:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:03:09.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.622+0000 7f3296608700 1 -- 172.21.15.8:0/1564361594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32900f6530 msgr2=0x7f32900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:09.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.622+0000 7f3296608700 1 --2- 172.21.15.8:0/1564361594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32900f6530 0x7f32900f6950 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f328c004660 tx=0x7f328c009b30).stop 2023-10-18T22:03:09.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.622+0000 7f3296608700 1 -- 172.21.15.8:0/1564361594 shutdown_connections 2023-10-18T22:03:09.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.622+0000 7f3296608700 1 --2- 172.21.15.8:0/1564361594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32900f77d0 0x7f32900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.622+0000 7f3296608700 1 --2- 172.21.15.8:0/1564361594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32900f6530 0x7f32900f6950 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.622+0000 7f3296608700 1 -- 172.21.15.8:0/1564361594 >> 172.21.15.8:0/1564361594 conn(0x7f32900f1c90 msgr2=0x7f32900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:09.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.622+0000 7f3296608700 1 -- 172.21.15.8:0/1564361594 shutdown_connections 2023-10-18T22:03:09.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.623+0000 7f3296608700 1 -- 172.21.15.8:0/1564361594 wait complete. 2023-10-18T22:03:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.623+0000 7f3296608700 1 Processor -- start 2023-10-18T22:03:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3296608700 1 -- start start 2023-10-18T22:03:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3296608700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32900f6530 0x7f3290108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3296608700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32900f77d0 0x7f32901094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3296608700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3290109a70 con 0x7f32900f6530 2023-10-18T22:03:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3296608700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3290109bb0 con 0x7f32900f77d0 2023-10-18T22:03:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3295606700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32900f6530 0x7f3290108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3295606700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32900f6530 0x7f3290108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53474/0 (socket says 172.21.15.8:53474) 2023-10-18T22:03:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3295606700 1 -- 172.21.15.8:0/4288717680 learned_addr learned my addr 172.21.15.8:0/4288717680 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3294e05700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32900f77d0 0x7f32901094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3295606700 1 -- 172.21.15.8:0/4288717680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32900f77d0 msgr2=0x7f32901094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.624+0000 7f3295606700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32900f77d0 0x7f32901094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.625+0000 7f3295606700 1 -- 172.21.15.8:0/4288717680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c005040 con 0x7f32900f6530 2023-10-18T22:03:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.625+0000 7f3295606700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32900f6530 0x7f3290108fd0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f328c007a60 tx=0x7f328c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:09.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.625+0000 7f3285ffb700 1 -- 172.21.15.8:0/4288717680 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328c018070 con 0x7f32900f6530 2023-10-18T22:03:09.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.625+0000 7f3296608700 1 -- 172.21.15.8:0/4288717680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329010a4f0 con 0x7f32900f6530 2023-10-18T22:03:09.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.625+0000 7f3285ffb700 1 -- 172.21.15.8:0/4288717680 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f328c009630 con 0x7f32900f6530 2023-10-18T22:03:09.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.625+0000 7f3285ffb700 1 -- 172.21.15.8:0/4288717680 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328c01c540 con 0x7f32900f6530 2023-10-18T22:03:09.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.625+0000 7f3296608700 1 -- 172.21.15.8:0/4288717680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329010aa50 con 0x7f32900f6530 2023-10-18T22:03:09.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.626+0000 7f3296608700 1 -- 172.21.15.8:0/4288717680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3290045ad0 con 0x7f32900f6530 2023-10-18T22:03:09.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.627+0000 7f3285ffb700 1 -- 172.21.15.8:0/4288717680 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f328c01c7b0 con 0x7f32900f6530 2023-10-18T22:03:09.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.628+0000 7f3285ffb700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f327c060f70 0x7f327c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:09.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.628+0000 7f3285ffb700 1 -- 172.21.15.8:0/4288717680 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f328c07e760 con 0x7f32900f6530 2023-10-18T22:03:09.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.628+0000 7f3294e05700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f327c060f70 0x7f327c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:09.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.629+0000 7f3294e05700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f327c060f70 0x7f327c063430 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f32800096c0 tx=0x7f3280009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:09.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.632+0000 7f3285ffb700 1 -- 172.21.15.8:0/4288717680 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f328c051d40 con 0x7f32900f6530 2023-10-18T22:03:09.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.829+0000 7f3296608700 1 -- 172.21.15.8:0/4288717680 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32900fee00 con 0x7f327c060f70 2023-10-18T22:03:09.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.831+0000 7f3285ffb700 1 -- 172.21.15.8:0/4288717680 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f32900fee00 con 0x7f327c060f70 2023-10-18T22:03:09.834 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:03:09.834 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:03:09.834 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:03:09.834 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:03:09.835 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:03:09.835 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:03:09.835 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:03:09.835 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:03:09.835 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:03:09.836 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:03:09.836 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:03:09.836 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:03:09.836 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:03:09.836 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:03:09.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.833+0000 7f3296608700 1 -- 172.21.15.8:0/4288717680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f327c060f70 msgr2=0x7f327c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:09.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.833+0000 7f3296608700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f327c060f70 0x7f327c063430 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f32800096c0 tx=0x7f3280009be0).stop 2023-10-18T22:03:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.833+0000 7f3296608700 1 -- 172.21.15.8:0/4288717680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32900f6530 msgr2=0x7f3290108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.833+0000 7f3296608700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32900f6530 0x7f3290108fd0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f328c007a60 tx=0x7f328c009b30).stop 2023-10-18T22:03:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.833+0000 7f3296608700 1 -- 172.21.15.8:0/4288717680 shutdown_connections 2023-10-18T22:03:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.833+0000 7f3296608700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f327c060f70 0x7f327c063430 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.833+0000 7f3296608700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32900f6530 0x7f3290108fd0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.833+0000 7f3296608700 1 --2- 172.21.15.8:0/4288717680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32900f77d0 0x7f32901094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:09.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.833+0000 7f3296608700 1 -- 172.21.15.8:0/4288717680 >> 172.21.15.8:0/4288717680 conn(0x7f32900f1c90 msgr2=0x7f329006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:09.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.834+0000 7f3296608700 1 -- 172.21.15.8:0/4288717680 shutdown_connections 2023-10-18T22:03:09.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:09.834+0000 7f3296608700 1 -- 172.21.15.8:0/4288717680 wait complete. 2023-10-18T22:03:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:08.355897+0000 mgr.smithi008.flmjzp (mgr.14640) 3856 : audit [DBG] from='client.37148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:08.699140+0000 mgr.smithi008.flmjzp (mgr.14640) 3857 : audit [DBG] from='client.37152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:08.846692+0000 mgr.smithi008.flmjzp (mgr.14640) 3858 : cluster [DBG] pgmap v2649: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:09.110489+0000 mon.smithi008 (mon.0) 4190 : audit [DBG] from='client.? 172.21.15.8:0/1039353279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:09.485023+0000 mon.smithi008 (mon.0) 4191 : audit [DBG] from='client.? 172.21.15.8:0/3678422219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:03:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:08.355897+0000 mgr.smithi008.flmjzp (mgr.14640) 3856 : audit [DBG] from='client.37148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:08.699140+0000 mgr.smithi008.flmjzp (mgr.14640) 3857 : audit [DBG] from='client.37152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:08.846692+0000 mgr.smithi008.flmjzp (mgr.14640) 3858 : cluster [DBG] pgmap v2649: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:09.110489+0000 mon.smithi008 (mon.0) 4190 : audit [DBG] from='client.? 172.21.15.8:0/1039353279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:09.485023+0000 mon.smithi008 (mon.0) 4191 : audit [DBG] from='client.? 172.21.15.8:0/3678422219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:03:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:09.831816+0000 mgr.smithi008.flmjzp (mgr.14640) 3859 : audit [DBG] from='client.37164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:09.831816+0000 mgr.smithi008.flmjzp (mgr.14640) 3859 : audit [DBG] from='client.37164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:10.847343+0000 mgr.smithi008.flmjzp (mgr.14640) 3860 : cluster [DBG] pgmap v2650: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:10.847343+0000 mgr.smithi008.flmjzp (mgr.14640) 3860 : cluster [DBG] pgmap v2650: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:12.847906+0000 mgr.smithi008.flmjzp (mgr.14640) 3861 : cluster [DBG] pgmap v2651: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:12.847906+0000 mgr.smithi008.flmjzp (mgr.14640) 3861 : cluster [DBG] pgmap v2651: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:14.848439+0000 mgr.smithi008.flmjzp (mgr.14640) 3862 : cluster [DBG] pgmap v2652: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:14.848439+0000 mgr.smithi008.flmjzp (mgr.14640) 3862 : cluster [DBG] pgmap v2652: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:16.881314+0000 mon.smithi008 (mon.0) 4192 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:16.881314+0000 mon.smithi008 (mon.0) 4192 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:16.849154+0000 mgr.smithi008.flmjzp (mgr.14640) 3863 : cluster [DBG] pgmap v2653: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:17.235693+0000 mon.smithi008 (mon.0) 4193 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:17.236774+0000 mon.smithi008 (mon.0) 4194 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:17.237795+0000 mon.smithi008 (mon.0) 4195 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:17.238628+0000 mgr.smithi008.flmjzp (mgr.14640) 3864 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:03:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:17.239310+0000 mgr.smithi008.flmjzp (mgr.14640) 3865 : cluster [DBG] pgmap v2654: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:17.239590+0000 mgr.smithi008.flmjzp (mgr.14640) 3866 : cluster [DBG] pgmap v2655: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:17.243753+0000 mon.smithi008 (mon.0) 4196 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:17.249983+0000 mon.smithi008 (mon.0) 4197 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:17.253056+0000 mon.smithi008 (mon.0) 4198 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:18.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:17.254625+0000 mon.smithi008 (mon.0) 4199 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:18.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:17.256149+0000 mon.smithi008 (mon.0) 4200 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:18.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:17.258061+0000 mon.smithi008 (mon.0) 4201 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:18.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:17.260010+0000 mgr.smithi008.flmjzp (mgr.14640) 3867 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:16.849154+0000 mgr.smithi008.flmjzp (mgr.14640) 3863 : cluster [DBG] pgmap v2653: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:17.235693+0000 mon.smithi008 (mon.0) 4193 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:17.236774+0000 mon.smithi008 (mon.0) 4194 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:17.237795+0000 mon.smithi008 (mon.0) 4195 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:18.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:17.238628+0000 mgr.smithi008.flmjzp (mgr.14640) 3864 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:03:18.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:17.239310+0000 mgr.smithi008.flmjzp (mgr.14640) 3865 : cluster [DBG] pgmap v2654: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:18.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:17.239590+0000 mgr.smithi008.flmjzp (mgr.14640) 3866 : cluster [DBG] pgmap v2655: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:18.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:17.243753+0000 mon.smithi008 (mon.0) 4196 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:18.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:17.249983+0000 mon.smithi008 (mon.0) 4197 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:18.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:17.253056+0000 mon.smithi008 (mon.0) 4198 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:18.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:17.254625+0000 mon.smithi008 (mon.0) 4199 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:18.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:17.256149+0000 mon.smithi008 (mon.0) 4200 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:18.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:17.258061+0000 mon.smithi008 (mon.0) 4201 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:18.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:17.260010+0000 mgr.smithi008.flmjzp (mgr.14640) 3867 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:19.240393+0000 mgr.smithi008.flmjzp (mgr.14640) 3868 : cluster [DBG] pgmap v2656: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:19.240393+0000 mgr.smithi008.flmjzp (mgr.14640) 3868 : cluster [DBG] pgmap v2656: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:22.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:21.241099+0000 mgr.smithi008.flmjzp (mgr.14640) 3869 : cluster [DBG] pgmap v2657: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:21.241099+0000 mgr.smithi008.flmjzp (mgr.14640) 3869 : cluster [DBG] pgmap v2657: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:23.241717+0000 mgr.smithi008.flmjzp (mgr.14640) 3870 : cluster [DBG] pgmap v2658: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:23.241717+0000 mgr.smithi008.flmjzp (mgr.14640) 3870 : cluster [DBG] pgmap v2658: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:25.242379+0000 mgr.smithi008.flmjzp (mgr.14640) 3871 : cluster [DBG] pgmap v2659: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:25.242379+0000 mgr.smithi008.flmjzp (mgr.14640) 3871 : cluster [DBG] pgmap v2659: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:27.243082+0000 mgr.smithi008.flmjzp (mgr.14640) 3872 : cluster [DBG] pgmap v2660: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:27.267790+0000 mon.smithi008 (mon.0) 4202 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:27.269921+0000 mon.smithi008 (mon.0) 4203 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:27.270895+0000 mon.smithi008 (mon.0) 4204 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:27.271756+0000 mgr.smithi008.flmjzp (mgr.14640) 3873 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:03:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:27.272312+0000 mgr.smithi008.flmjzp (mgr.14640) 3874 : cluster [DBG] pgmap v2661: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:27.272566+0000 mgr.smithi008.flmjzp (mgr.14640) 3875 : cluster [DBG] pgmap v2662: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:27.277703+0000 mon.smithi008 (mon.0) 4205 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:27.283989+0000 mon.smithi008 (mon.0) 4206 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:27.287068+0000 mon.smithi008 (mon.0) 4207 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:27.288794+0000 mon.smithi008 (mon.0) 4208 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:27.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:27.290510+0000 mon.smithi008 (mon.0) 4209 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:27.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:27.292526+0000 mon.smithi008 (mon.0) 4210 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:27.243082+0000 mgr.smithi008.flmjzp (mgr.14640) 3872 : cluster [DBG] pgmap v2660: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:27.267790+0000 mon.smithi008 (mon.0) 4202 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:27.269921+0000 mon.smithi008 (mon.0) 4203 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:27.270895+0000 mon.smithi008 (mon.0) 4204 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:27.271756+0000 mgr.smithi008.flmjzp (mgr.14640) 3873 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:03:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:27.272312+0000 mgr.smithi008.flmjzp (mgr.14640) 3874 : cluster [DBG] pgmap v2661: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:27.272566+0000 mgr.smithi008.flmjzp (mgr.14640) 3875 : cluster [DBG] pgmap v2662: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:27.277703+0000 mon.smithi008 (mon.0) 4205 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:27.283989+0000 mon.smithi008 (mon.0) 4206 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:27.287068+0000 mon.smithi008 (mon.0) 4207 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:27.288794+0000 mon.smithi008 (mon.0) 4208 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:27.290510+0000 mon.smithi008 (mon.0) 4209 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:27.292526+0000 mon.smithi008 (mon.0) 4210 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:27.294548+0000 mgr.smithi008.flmjzp (mgr.14640) 3876 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:27.294548+0000 mgr.smithi008.flmjzp (mgr.14640) 3876 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:29.273201+0000 mgr.smithi008.flmjzp (mgr.14640) 3877 : cluster [DBG] pgmap v2663: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:29.273201+0000 mgr.smithi008.flmjzp (mgr.14640) 3877 : cluster [DBG] pgmap v2663: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:32.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:31.273717+0000 mgr.smithi008.flmjzp (mgr.14640) 3878 : cluster [DBG] pgmap v2664: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:31.273717+0000 mgr.smithi008.flmjzp (mgr.14640) 3878 : cluster [DBG] pgmap v2664: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:33.274424+0000 mgr.smithi008.flmjzp (mgr.14640) 3879 : cluster [DBG] pgmap v2665: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:33.274424+0000 mgr.smithi008.flmjzp (mgr.14640) 3879 : cluster [DBG] pgmap v2665: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:35.275185+0000 mgr.smithi008.flmjzp (mgr.14640) 3880 : cluster [DBG] pgmap v2666: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:35.275185+0000 mgr.smithi008.flmjzp (mgr.14640) 3880 : cluster [DBG] pgmap v2666: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:37.275698+0000 mgr.smithi008.flmjzp (mgr.14640) 3881 : cluster [DBG] pgmap v2667: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:37.305339+0000 mon.smithi008 (mon.0) 4211 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:37.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:37.275698+0000 mgr.smithi008.flmjzp (mgr.14640) 3881 : cluster [DBG] pgmap v2667: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:37.305339+0000 mon.smithi008 (mon.0) 4211 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:37.862982+0000 mon.smithi008 (mon.0) 4212 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:37.863789+0000 mon.smithi008 (mon.0) 4213 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:37.864418+0000 mgr.smithi008.flmjzp (mgr.14640) 3882 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:03:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:37.864922+0000 mgr.smithi008.flmjzp (mgr.14640) 3883 : cluster [DBG] pgmap v2668: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:37.865140+0000 mgr.smithi008.flmjzp (mgr.14640) 3884 : cluster [DBG] pgmap v2669: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:37.869181+0000 mon.smithi008 (mon.0) 4214 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:37.874183+0000 mon.smithi008 (mon.0) 4215 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:37.876497+0000 mon.smithi008 (mon.0) 4216 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:37.877760+0000 mon.smithi008 (mon.0) 4217 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:37.878960+0000 mon.smithi008 (mon.0) 4218 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:38.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:37.880565+0000 mon.smithi008 (mon.0) 4219 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:38.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:37.882122+0000 mgr.smithi008.flmjzp (mgr.14640) 3885 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:37.862982+0000 mon.smithi008 (mon.0) 4212 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:37.863789+0000 mon.smithi008 (mon.0) 4213 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:37.864418+0000 mgr.smithi008.flmjzp (mgr.14640) 3882 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:03:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:37.864922+0000 mgr.smithi008.flmjzp (mgr.14640) 3883 : cluster [DBG] pgmap v2668: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:37.865140+0000 mgr.smithi008.flmjzp (mgr.14640) 3884 : cluster [DBG] pgmap v2669: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:37.869181+0000 mon.smithi008 (mon.0) 4214 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:37.874183+0000 mon.smithi008 (mon.0) 4215 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:37.876497+0000 mon.smithi008 (mon.0) 4216 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:38.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:37.877760+0000 mon.smithi008 (mon.0) 4217 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:38.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:37.878960+0000 mon.smithi008 (mon.0) 4218 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:38.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:37.880565+0000 mon.smithi008 (mon.0) 4219 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:38.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:37.882122+0000 mgr.smithi008.flmjzp (mgr.14640) 3885 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.987+0000 7f3ced9bd700 1 -- 172.21.15.8:0/6518907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 msgr2=0x7f3ce80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.987+0000 7f3ced9bd700 1 --2- 172.21.15.8:0/6518907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 0x7f3ce80f7c30 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f3cd4004660 tx=0x7f3cd4009b30).stop 2023-10-18T22:03:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.987+0000 7f3ced9bd700 1 -- 172.21.15.8:0/6518907 shutdown_connections 2023-10-18T22:03:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.987+0000 7f3ced9bd700 1 --2- 172.21.15.8:0/6518907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 0x7f3ce80f7c30 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.987+0000 7f3ced9bd700 1 --2- 172.21.15.8:0/6518907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f6530 0x7f3ce80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.987+0000 7f3ced9bd700 1 -- 172.21.15.8:0/6518907 >> 172.21.15.8:0/6518907 conn(0x7f3ce80f1c90 msgr2=0x7f3ce80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.987+0000 7f3ced9bd700 1 -- 172.21.15.8:0/6518907 shutdown_connections 2023-10-18T22:03:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.988+0000 7f3ced9bd700 1 -- 172.21.15.8:0/6518907 wait complete. 2023-10-18T22:03:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.988+0000 7f3ced9bd700 1 Processor -- start 2023-10-18T22:03:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.988+0000 7f3ced9bd700 1 -- start start 2023-10-18T22:03:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.989+0000 7f3ced9bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f6530 0x7f3ce806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.989+0000 7f3ced9bd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 0x7f3ce8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.989+0000 7f3ced9bd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce806a380 con 0x7f3ce80f77d0 2023-10-18T22:03:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.989+0000 7f3ced9bd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce806a4c0 con 0x7f3ce80f6530 2023-10-18T22:03:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.989+0000 7f3ce7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 0x7f3ce8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.989+0000 7f3ce7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 0x7f3ce8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41472/0 (socket says 172.21.15.8:41472) 2023-10-18T22:03:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.989+0000 7f3ce7fff700 1 -- 172.21.15.8:0/98929953 learned_addr learned my addr 172.21.15.8:0/98929953 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.989+0000 7f3cec9bb700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f6530 0x7f3ce806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.990+0000 7f3ce7fff700 1 -- 172.21.15.8:0/98929953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f6530 msgr2=0x7f3ce806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.990+0000 7f3ce7fff700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f6530 0x7f3ce806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.990+0000 7f3ce7fff700 1 -- 172.21.15.8:0/98929953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4005040 con 0x7f3ce80f77d0 2023-10-18T22:03:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.990+0000 7f3ce7fff700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 0x7f3ce8069e20 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f3cd4009990 tx=0x7f3cd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.990+0000 7f3ce57fa700 1 -- 172.21.15.8:0/98929953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd4018070 con 0x7f3ce80f77d0 2023-10-18T22:03:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.990+0000 7f3ce57fa700 1 -- 172.21.15.8:0/98929953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3cd4009630 con 0x7f3ce80f77d0 2023-10-18T22:03:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.990+0000 7f3ced9bd700 1 -- 172.21.15.8:0/98929953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce806a740 con 0x7f3ce80f77d0 2023-10-18T22:03:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.990+0000 7f3ce57fa700 1 -- 172.21.15.8:0/98929953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd401c3c0 con 0x7f3ce80f77d0 2023-10-18T22:03:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.990+0000 7f3ced9bd700 1 -- 172.21.15.8:0/98929953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce806aca0 con 0x7f3ce80f77d0 2023-10-18T22:03:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.992+0000 7f3ced9bd700 1 -- 172.21.15.8:0/98929953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce8045ad0 con 0x7f3ce80f77d0 2023-10-18T22:03:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.993+0000 7f3ce57fa700 1 -- 172.21.15.8:0/98929953 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3cd401d970 con 0x7f3ce80f77d0 2023-10-18T22:03:39.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.993+0000 7f3ce57fa700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 0x7f3cd8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:39.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.994+0000 7f3ce57fa700 1 -- 172.21.15.8:0/98929953 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3cd407e5a0 con 0x7f3ce80f77d0 2023-10-18T22:03:39.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.994+0000 7f3cec9bb700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 0x7f3cd8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:39.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.994+0000 7f3cec9bb700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 0x7f3cd8063430 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f3ce806b730 tx=0x7f3cdc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:39.998+0000 7f3ce57fa700 1 -- 172.21.15.8:0/98929953 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3cd404e210 con 0x7f3ce80f77d0 2023-10-18T22:03:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.197+0000 7f3ced9bd700 1 -- 172.21.15.8:0/98929953 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ce80fee30 con 0x7f3cd8060f70 2023-10-18T22:03:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.198+0000 7f3ce57fa700 1 -- 172.21.15.8:0/98929953 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3ce80fee30 con 0x7f3cd8060f70 2023-10-18T22:03:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.200+0000 7f3ced9bd700 1 -- 172.21.15.8:0/98929953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 msgr2=0x7f3cd8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.200+0000 7f3ced9bd700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 0x7f3cd8063430 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f3ce806b730 tx=0x7f3cdc00b040).stop 2023-10-18T22:03:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.200+0000 7f3ced9bd700 1 -- 172.21.15.8:0/98929953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 msgr2=0x7f3ce8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.200+0000 7f3ced9bd700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 0x7f3ce8069e20 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f3cd4009990 tx=0x7f3cd4009b30).stop 2023-10-18T22:03:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.200+0000 7f3ced9bd700 1 -- 172.21.15.8:0/98929953 shutdown_connections 2023-10-18T22:03:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.200+0000 7f3ced9bd700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3cd8060f70 0x7f3cd8063430 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.200+0000 7f3ced9bd700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80f6530 0x7f3ce806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.200+0000 7f3ced9bd700 1 --2- 172.21.15.8:0/98929953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ce80f77d0 0x7f3ce8069e20 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.200+0000 7f3ced9bd700 1 -- 172.21.15.8:0/98929953 >> 172.21.15.8:0/98929953 conn(0x7f3ce80f1c90 msgr2=0x7f3ce80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.201+0000 7f3ced9bd700 1 -- 172.21.15.8:0/98929953 shutdown_connections 2023-10-18T22:03:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.201+0000 7f3ced9bd700 1 -- 172.21.15.8:0/98929953 wait complete. 2023-10-18T22:03:40.216 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:03:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.339+0000 7f99d3fff700 1 -- 172.21.15.8:0/2195029148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40f77d0 msgr2=0x7f99d40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.339+0000 7f99d3fff700 1 --2- 172.21.15.8:0/2195029148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40f77d0 0x7f99d40f7c30 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f99c8004660 tx=0x7f99c8009b30).stop 2023-10-18T22:03:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.339+0000 7f99d3fff700 1 -- 172.21.15.8:0/2195029148 shutdown_connections 2023-10-18T22:03:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.339+0000 7f99d3fff700 1 --2- 172.21.15.8:0/2195029148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40f77d0 0x7f99d40f7c30 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.339+0000 7f99d3fff700 1 --2- 172.21.15.8:0/2195029148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99d40f6530 0x7f99d40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.339+0000 7f99d3fff700 1 -- 172.21.15.8:0/2195029148 >> 172.21.15.8:0/2195029148 conn(0x7f99d40f1c90 msgr2=0x7f99d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.339+0000 7f99d3fff700 1 -- 172.21.15.8:0/2195029148 shutdown_connections 2023-10-18T22:03:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.339+0000 7f99d3fff700 1 -- 172.21.15.8:0/2195029148 wait complete. 2023-10-18T22:03:40.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.340+0000 7f99d3fff700 1 Processor -- start 2023-10-18T22:03:40.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.340+0000 7f99d3fff700 1 -- start start 2023-10-18T22:03:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.340+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40f6530 0x7f99d4108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.340+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99d40f77d0 0x7f99d4109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.340+0000 7f99d3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4109a20 con 0x7f99d40f6530 2023-10-18T22:03:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.340+0000 7f99d3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4109b60 con 0x7f99d40f77d0 2023-10-18T22:03:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.340+0000 7f99d2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40f6530 0x7f99d4108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.340+0000 7f99d2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40f6530 0x7f99d4108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41490/0 (socket says 172.21.15.8:41490) 2023-10-18T22:03:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.340+0000 7f99d2ffd700 1 -- 172.21.15.8:0/488850968 learned_addr learned my addr 172.21.15.8:0/488850968 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.341+0000 7f99d27fc700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99d40f77d0 0x7f99d4109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.341+0000 7f99d2ffd700 1 -- 172.21.15.8:0/488850968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99d40f77d0 msgr2=0x7f99d4109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.341+0000 7f99d2ffd700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99d40f77d0 0x7f99d4109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.341+0000 7f99d2ffd700 1 -- 172.21.15.8:0/488850968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c8005040 con 0x7f99d40f6530 2023-10-18T22:03:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.341+0000 7f99d2ffd700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40f6530 0x7f99d4108f80 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f99c400c790 tx=0x7f99c4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.341+0000 7f99bb7fe700 1 -- 172.21.15.8:0/488850968 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c4013630 con 0x7f99d40f6530 2023-10-18T22:03:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.341+0000 7f99bb7fe700 1 -- 172.21.15.8:0/488850968 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f99c4012870 con 0x7f99d40f6530 2023-10-18T22:03:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.341+0000 7f99d3fff700 1 -- 172.21.15.8:0/488850968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d410a500 con 0x7f99d40f6530 2023-10-18T22:03:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.341+0000 7f99bb7fe700 1 -- 172.21.15.8:0/488850968 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c4002830 con 0x7f99d40f6530 2023-10-18T22:03:40.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.341+0000 7f99d3fff700 1 -- 172.21.15.8:0/488850968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d410aac0 con 0x7f99d40f6530 2023-10-18T22:03:40.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.342+0000 7f99d3fff700 1 -- 172.21.15.8:0/488850968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d4045ad0 con 0x7f99d40f6530 2023-10-18T22:03:40.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.343+0000 7f99bb7fe700 1 -- 172.21.15.8:0/488850968 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f99c4010070 con 0x7f99d40f6530 2023-10-18T22:03:40.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.344+0000 7f99bb7fe700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99bc060f70 0x7f99bc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:40.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.344+0000 7f99bb7fe700 1 -- 172.21.15.8:0/488850968 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f99c407ca50 con 0x7f99d40f6530 2023-10-18T22:03:40.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.345+0000 7f99d27fc700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99bc060f70 0x7f99bc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:40.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.345+0000 7f99d27fc700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99bc060f70 0x7f99bc063430 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f99c8004630 tx=0x7f99c8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:40.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.348+0000 7f99bb7fe700 1 -- 172.21.15.8:0/488850968 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f99c404ffd0 con 0x7f99d40f6530 2023-10-18T22:03:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.545+0000 7f99d3fff700 1 -- 172.21.15.8:0/488850968 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99d40008d0 con 0x7f99bc060f70 2023-10-18T22:03:40.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.546+0000 7f99bb7fe700 1 -- 172.21.15.8:0/488850968 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f99d40008d0 con 0x7f99bc060f70 2023-10-18T22:03:40.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 -- 172.21.15.8:0/488850968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99bc060f70 msgr2=0x7f99bc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:40.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99bc060f70 0x7f99bc063430 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f99c8004630 tx=0x7f99c8009b30).stop 2023-10-18T22:03:40.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 -- 172.21.15.8:0/488850968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40f6530 msgr2=0x7f99d4108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:40.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40f6530 0x7f99d4108f80 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f99c400c790 tx=0x7f99c4007d90).stop 2023-10-18T22:03:40.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 -- 172.21.15.8:0/488850968 shutdown_connections 2023-10-18T22:03:40.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f99bc060f70 0x7f99bc063430 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40f6530 0x7f99d4108f80 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 --2- 172.21.15.8:0/488850968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99d40f77d0 0x7f99d4109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 -- 172.21.15.8:0/488850968 >> 172.21.15.8:0/488850968 conn(0x7f99d40f1c90 msgr2=0x7f99d406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:40.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 -- 172.21.15.8:0/488850968 shutdown_connections 2023-10-18T22:03:40.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.548+0000 7f99d3fff700 1 -- 172.21.15.8:0/488850968 wait complete. 2023-10-18T22:03:40.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.685+0000 7f406eadb700 1 -- 172.21.15.8:0/3219278894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680f6530 msgr2=0x7f40680f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:40.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.685+0000 7f406eadb700 1 --2- 172.21.15.8:0/3219278894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680f6530 0x7f40680f6950 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f4064004660 tx=0x7f4064009b30).stop 2023-10-18T22:03:40.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.685+0000 7f406eadb700 1 -- 172.21.15.8:0/3219278894 shutdown_connections 2023-10-18T22:03:40.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.685+0000 7f406eadb700 1 --2- 172.21.15.8:0/3219278894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40680f77d0 0x7f40680f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.685+0000 7f406eadb700 1 --2- 172.21.15.8:0/3219278894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680f6530 0x7f40680f6950 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.685+0000 7f406eadb700 1 -- 172.21.15.8:0/3219278894 >> 172.21.15.8:0/3219278894 conn(0x7f40680f1c90 msgr2=0x7f40680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:40.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.686+0000 7f406eadb700 1 -- 172.21.15.8:0/3219278894 shutdown_connections 2023-10-18T22:03:40.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.686+0000 7f406eadb700 1 -- 172.21.15.8:0/3219278894 wait complete. 2023-10-18T22:03:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.686+0000 7f406eadb700 1 Processor -- start 2023-10-18T22:03:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.686+0000 7f406eadb700 1 -- start start 2023-10-18T22:03:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.687+0000 7f406eadb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40680f6530 0x7f4068106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:40.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.687+0000 7f406eadb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680f77d0 0x7f4068107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:40.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.687+0000 7f406eadb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4068107900 con 0x7f40680f77d0 2023-10-18T22:03:40.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.687+0000 7f406eadb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4068108110 con 0x7f40680f6530 2023-10-18T22:03:40.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.687+0000 7f406d2d8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680f77d0 0x7f4068107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:40.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.687+0000 7f406d2d8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680f77d0 0x7f4068107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41516/0 (socket says 172.21.15.8:41516) 2023-10-18T22:03:40.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.687+0000 7f406d2d8700 1 -- 172.21.15.8:0/1993524366 learned_addr learned my addr 172.21.15.8:0/1993524366 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:40.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.687+0000 7f406dad9700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40680f6530 0x7f4068106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:40.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.688+0000 7f406d2d8700 1 -- 172.21.15.8:0/1993524366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40680f6530 msgr2=0x7f4068106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:40.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.688+0000 7f406d2d8700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40680f6530 0x7f4068106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.688+0000 7f406d2d8700 1 -- 172.21.15.8:0/1993524366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064005040 con 0x7f40680f77d0 2023-10-18T22:03:40.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.688+0000 7f406d2d8700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680f77d0 0x7f4068107300 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f40580026d0 tx=0x7f4058009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:40.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.688+0000 7f405e7fc700 1 -- 172.21.15.8:0/1993524366 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40580079c0 con 0x7f40680f77d0 2023-10-18T22:03:40.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.688+0000 7f405e7fc700 1 -- 172.21.15.8:0/1993524366 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f405800f040 con 0x7f40680f77d0 2023-10-18T22:03:40.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.688+0000 7f406eadb700 1 -- 172.21.15.8:0/1993524366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4068108390 con 0x7f40680f77d0 2023-10-18T22:03:40.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.688+0000 7f405e7fc700 1 -- 172.21.15.8:0/1993524366 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4058014980 con 0x7f40680f77d0 2023-10-18T22:03:40.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.688+0000 7f406eadb700 1 -- 172.21.15.8:0/1993524366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4068108950 con 0x7f40680f77d0 2023-10-18T22:03:40.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.689+0000 7f406eadb700 1 -- 172.21.15.8:0/1993524366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4068059100 con 0x7f40680f77d0 2023-10-18T22:03:40.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.690+0000 7f405e7fc700 1 -- 172.21.15.8:0/1993524366 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f40580090d0 con 0x7f40680f77d0 2023-10-18T22:03:40.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.691+0000 7f405e7fc700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4054060f70 0x7f4054063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:40.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.691+0000 7f405e7fc700 1 -- 172.21.15.8:0/1993524366 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f405807c980 con 0x7f40680f77d0 2023-10-18T22:03:40.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.691+0000 7f406dad9700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4054060f70 0x7f4054063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:40.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.692+0000 7f406dad9700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4054060f70 0x7f4054063430 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f4068106b80 tx=0x7f4064009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:40.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.695+0000 7f405e7fc700 1 -- 172.21.15.8:0/1993524366 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f405804c5e0 con 0x7f40680f77d0 2023-10-18T22:03:40.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.888+0000 7f406eadb700 1 -- 172.21.15.8:0/1993524366 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40680fee50 con 0x7f4054060f70 2023-10-18T22:03:40.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.897+0000 7f405e7fc700 1 -- 172.21.15.8:0/1993524366 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f40680fee50 con 0x7f4054060f70 2023-10-18T22:03:40.899 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:03:40.899 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (70m) 7m ago 71m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:03:40.899 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (64m) 7m ago 71m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:03:40.899 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (64m) 5m ago 70m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:03:40.900 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (70m) 7m ago 71m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:03:40.900 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 67m - - 2023-10-18T22:03:40.900 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 67m - - 2023-10-18T22:03:40.900 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 67m - - 2023-10-18T22:03:40.900 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 67m - - 2023-10-18T22:03:40.901 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (65m) 7m ago 73m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:03:40.901 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (64m) 5m ago 70m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:03:40.901 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (64m) 7m ago 73m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:03:40.901 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (64m) 5m ago 70m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:03:40.901 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (71m) 7m ago 71m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:03:40.901 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (70m) 5m ago 70m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:03:40.902 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (63m) 7m ago 70m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:03:40.902 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (61m) 7m ago 70m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:03:40.902 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (61m) 7m ago 69m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:03:40.902 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (60m) 5m ago 69m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:03:40.902 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (60m) 5m ago 69m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:03:40.902 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (59m) 5m ago 68m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:03:40.903 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (65m) 7m ago 71m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:03:40.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.899+0000 7f406eadb700 1 -- 172.21.15.8:0/1993524366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4054060f70 msgr2=0x7f4054063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.899+0000 7f406eadb700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4054060f70 0x7f4054063430 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f4068106b80 tx=0x7f4064009b30).stop 2023-10-18T22:03:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.899+0000 7f406eadb700 1 -- 172.21.15.8:0/1993524366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680f77d0 msgr2=0x7f4068107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.899+0000 7f406eadb700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680f77d0 0x7f4068107300 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f40580026d0 tx=0x7f4058009de0).stop 2023-10-18T22:03:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.899+0000 7f406eadb700 1 -- 172.21.15.8:0/1993524366 shutdown_connections 2023-10-18T22:03:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.899+0000 7f406eadb700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4054060f70 0x7f4054063430 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.899+0000 7f406eadb700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40680f6530 0x7f4068106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.899+0000 7f406eadb700 1 --2- 172.21.15.8:0/1993524366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680f77d0 0x7f4068107300 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.899+0000 7f406eadb700 1 -- 172.21.15.8:0/1993524366 >> 172.21.15.8:0/1993524366 conn(0x7f40680f1c90 msgr2=0x7f40680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.900+0000 7f406eadb700 1 -- 172.21.15.8:0/1993524366 shutdown_connections 2023-10-18T22:03:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:40.900+0000 7f406eadb700 1 -- 172.21.15.8:0/1993524366 wait complete. 2023-10-18T22:03:41.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.034+0000 7f309a54a700 1 -- 172.21.15.8:0/1482694718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30940f6530 msgr2=0x7f30940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:41.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.034+0000 7f309a54a700 1 --2- 172.21.15.8:0/1482694718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30940f6530 0x7f30940f6950 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f3090004660 tx=0x7f3090009b30).stop 2023-10-18T22:03:41.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.035+0000 7f309a54a700 1 -- 172.21.15.8:0/1482694718 shutdown_connections 2023-10-18T22:03:41.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.035+0000 7f309a54a700 1 --2- 172.21.15.8:0/1482694718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30940f77d0 0x7f30940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.035+0000 7f309a54a700 1 --2- 172.21.15.8:0/1482694718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30940f6530 0x7f30940f6950 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.035+0000 7f309a54a700 1 -- 172.21.15.8:0/1482694718 >> 172.21.15.8:0/1482694718 conn(0x7f30940f1c90 msgr2=0x7f30940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:41.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.035+0000 7f309a54a700 1 -- 172.21.15.8:0/1482694718 shutdown_connections 2023-10-18T22:03:41.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.035+0000 7f309a54a700 1 -- 172.21.15.8:0/1482694718 wait complete. 2023-10-18T22:03:41.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.035+0000 7f309a54a700 1 Processor -- start 2023-10-18T22:03:41.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.036+0000 7f309a54a700 1 -- start start 2023-10-18T22:03:41.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.036+0000 7f309a54a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30940f6530 0x7f3094108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:41.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.036+0000 7f309a54a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30940f77d0 0x7f3094109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:41.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.036+0000 7f309a54a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3094109a00 con 0x7f30940f6530 2023-10-18T22:03:41.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.036+0000 7f309a54a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3094109b40 con 0x7f30940f77d0 2023-10-18T22:03:41.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.036+0000 7f3099548700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30940f6530 0x7f3094108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:41.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.036+0000 7f3099548700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30940f6530 0x7f3094108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41548/0 (socket says 172.21.15.8:41548) 2023-10-18T22:03:41.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.036+0000 7f3099548700 1 -- 172.21.15.8:0/1192305922 learned_addr learned my addr 172.21.15.8:0/1192305922 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:41.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.036+0000 7f3098d47700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30940f77d0 0x7f3094109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:41.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.037+0000 7f3099548700 1 -- 172.21.15.8:0/1192305922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30940f77d0 msgr2=0x7f3094109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:41.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.037+0000 7f3099548700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30940f77d0 0x7f3094109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.037+0000 7f3099548700 1 -- 172.21.15.8:0/1192305922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090005040 con 0x7f30940f6530 2023-10-18T22:03:41.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.037+0000 7f3099548700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30940f6530 0x7f3094108f60 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f3090007a60 tx=0x7f3090009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:41.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.037+0000 7f3089ffb700 1 -- 172.21.15.8:0/1192305922 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3090018070 con 0x7f30940f6530 2023-10-18T22:03:41.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.037+0000 7f3089ffb700 1 -- 172.21.15.8:0/1192305922 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3090009630 con 0x7f30940f6530 2023-10-18T22:03:41.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.037+0000 7f309a54a700 1 -- 172.21.15.8:0/1192305922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309410a480 con 0x7f30940f6530 2023-10-18T22:03:41.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.037+0000 7f3089ffb700 1 -- 172.21.15.8:0/1192305922 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f309001c4d0 con 0x7f30940f6530 2023-10-18T22:03:41.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.037+0000 7f309a54a700 1 -- 172.21.15.8:0/1192305922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309410a9e0 con 0x7f30940f6530 2023-10-18T22:03:41.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.038+0000 7f309a54a700 1 -- 172.21.15.8:0/1192305922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3094045ad0 con 0x7f30940f6530 2023-10-18T22:03:41.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.039+0000 7f3089ffb700 1 -- 172.21.15.8:0/1192305922 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f309001d420 con 0x7f30940f6530 2023-10-18T22:03:41.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.041+0000 7f3089ffb700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3080060f70 0x7f3080063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:41.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.041+0000 7f3089ffb700 1 -- 172.21.15.8:0/1192305922 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f309007e560 con 0x7f30940f6530 2023-10-18T22:03:41.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.041+0000 7f3098d47700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3080060f70 0x7f3080063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:41.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.041+0000 7f3098d47700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3080060f70 0x7f3080063430 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f3084004c40 tx=0x7f308400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:41.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.045+0000 7f3089ffb700 1 -- 172.21.15.8:0/1192305922 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3090051bc0 con 0x7f30940f6530 2023-10-18T22:03:41.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:39.865713+0000 mgr.smithi008.flmjzp (mgr.14640) 3886 : cluster [DBG] pgmap v2670: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:41.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:40.198522+0000 mgr.smithi008.flmjzp (mgr.14640) 3887 : audit [DBG] from='client.37168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:41.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.297+0000 7f309a54a700 1 -- 172.21.15.8:0/1192305922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f30940fecc0 con 0x7f30940f6530 2023-10-18T22:03:41.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.298+0000 7f3089ffb700 1 -- 172.21.15.8:0/1192305922 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f30900517b0 con 0x7f30940f6530 2023-10-18T22:03:41.299 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:03:41.299 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:03:41.300 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:03:41.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:03:41.300 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:03:41.300 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:03:41.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:03:41.301 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:03:41.301 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:03:41.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:03:41.301 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:03:41.301 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:03:41.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:03:41.302 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:03:41.302 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:03:41.302 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:03:41.302 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:03:41.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 -- 172.21.15.8:0/1192305922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3080060f70 msgr2=0x7f3080063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:41.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3080060f70 0x7f3080063430 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f3084004c40 tx=0x7f308400b040).stop 2023-10-18T22:03:41.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 -- 172.21.15.8:0/1192305922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30940f6530 msgr2=0x7f3094108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:41.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30940f6530 0x7f3094108f60 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f3090007a60 tx=0x7f3090009b30).stop 2023-10-18T22:03:41.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 -- 172.21.15.8:0/1192305922 shutdown_connections 2023-10-18T22:03:41.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3080060f70 0x7f3080063430 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30940f6530 0x7f3094108f60 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 --2- 172.21.15.8:0/1192305922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30940f77d0 0x7f3094109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 -- 172.21.15.8:0/1192305922 >> 172.21.15.8:0/1192305922 conn(0x7f30940f1c90 msgr2=0x7f309406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:41.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 -- 172.21.15.8:0/1192305922 shutdown_connections 2023-10-18T22:03:41.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.300+0000 7f309a54a700 1 -- 172.21.15.8:0/1192305922 wait complete. 2023-10-18T22:03:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:39.865713+0000 mgr.smithi008.flmjzp (mgr.14640) 3886 : cluster [DBG] pgmap v2670: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:40.198522+0000 mgr.smithi008.flmjzp (mgr.14640) 3887 : audit [DBG] from='client.37168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.436+0000 7f1f73fff700 1 -- 172.21.15.8:0/677118851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740f5430 msgr2=0x7f1f740f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.436+0000 7f1f73fff700 1 --2- 172.21.15.8:0/677118851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740f5430 0x7f1f740f5850 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f1f64004660 tx=0x7f1f64009b30).stop 2023-10-18T22:03:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.436+0000 7f1f73fff700 1 -- 172.21.15.8:0/677118851 shutdown_connections 2023-10-18T22:03:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.436+0000 7f1f73fff700 1 --2- 172.21.15.8:0/677118851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f740f66d0 0x7f1f740f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.436+0000 7f1f73fff700 1 --2- 172.21.15.8:0/677118851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740f5430 0x7f1f740f5850 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.436+0000 7f1f73fff700 1 -- 172.21.15.8:0/677118851 >> 172.21.15.8:0/677118851 conn(0x7f1f740f0b90 msgr2=0x7f1f740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:41.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.436+0000 7f1f73fff700 1 -- 172.21.15.8:0/677118851 shutdown_connections 2023-10-18T22:03:41.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.436+0000 7f1f73fff700 1 -- 172.21.15.8:0/677118851 wait complete. 2023-10-18T22:03:41.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.437+0000 7f1f73fff700 1 Processor -- start 2023-10-18T22:03:41.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.437+0000 7f1f73fff700 1 -- start start 2023-10-18T22:03:41.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.438+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f740f5430 0x7f1f74108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:41.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.438+0000 7f1f73fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740f66d0 0x7f1f74109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:41.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.438+0000 7f1f73fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74109a10 con 0x7f1f740f66d0 2023-10-18T22:03:41.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.438+0000 7f1f73fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74109b50 con 0x7f1f740f5430 2023-10-18T22:03:41.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.438+0000 7f1f727fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740f66d0 0x7f1f74109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:41.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.438+0000 7f1f727fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740f66d0 0x7f1f74109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41560/0 (socket says 172.21.15.8:41560) 2023-10-18T22:03:41.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.438+0000 7f1f727fc700 1 -- 172.21.15.8:0/13835498 learned_addr learned my addr 172.21.15.8:0/13835498 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:41.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.438+0000 7f1f72ffd700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f740f5430 0x7f1f74108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:41.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.438+0000 7f1f727fc700 1 -- 172.21.15.8:0/13835498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f740f5430 msgr2=0x7f1f74108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:41.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.439+0000 7f1f727fc700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f740f5430 0x7f1f74108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.439+0000 7f1f727fc700 1 -- 172.21.15.8:0/13835498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64005040 con 0x7f1f740f66d0 2023-10-18T22:03:41.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.439+0000 7f1f727fc700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740f66d0 0x7f1f74109460 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f1f6800e7f0 tx=0x7f1f6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:41.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.439+0000 7f1f5b7fe700 1 -- 172.21.15.8:0/13835498 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f680092e0 con 0x7f1f740f66d0 2023-10-18T22:03:41.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.439+0000 7f1f5b7fe700 1 -- 172.21.15.8:0/13835498 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1f6800f040 con 0x7f1f740f66d0 2023-10-18T22:03:41.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.439+0000 7f1f5b7fe700 1 -- 172.21.15.8:0/13835498 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f680147e0 con 0x7f1f740f66d0 2023-10-18T22:03:41.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.439+0000 7f1f73fff700 1 -- 172.21.15.8:0/13835498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7410a4f0 con 0x7f1f740f66d0 2023-10-18T22:03:41.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.439+0000 7f1f73fff700 1 -- 172.21.15.8:0/13835498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7410aa30 con 0x7f1f740f66d0 2023-10-18T22:03:41.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.440+0000 7f1f73fff700 1 -- 172.21.15.8:0/13835498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f74045ad0 con 0x7f1f740f66d0 2023-10-18T22:03:41.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.441+0000 7f1f5b7fe700 1 -- 172.21.15.8:0/13835498 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1f6801b030 con 0x7f1f740f66d0 2023-10-18T22:03:41.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.442+0000 7f1f5b7fe700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f5c060f70 0x7f1f5c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:41.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.442+0000 7f1f5b7fe700 1 -- 172.21.15.8:0/13835498 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1f6807c5f0 con 0x7f1f740f66d0 2023-10-18T22:03:41.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.442+0000 7f1f72ffd700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f5c060f70 0x7f1f5c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:41.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.443+0000 7f1f72ffd700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f5c060f70 0x7f1f5c063430 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f1f64005010 tx=0x7f1f64016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:41.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.446+0000 7f1f5b7fe700 1 -- 172.21.15.8:0/13835498 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1f6804fd40 con 0x7f1f740f66d0 2023-10-18T22:03:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.668+0000 7f1f73fff700 1 -- 172.21.15.8:0/13835498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1f7410b0c0 con 0x7f1f740f66d0 2023-10-18T22:03:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.669+0000 7f1f5b7fe700 1 -- 172.21.15.8:0/13835498 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1f68019070 con 0x7f1f740f66d0 2023-10-18T22:03:41.670 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:03:41.670 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:03:41.671 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:03:41.671 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:03:41.671 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:03:41.671 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:03:41.671 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:03:41.672 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:03:41.672 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:03:41.672 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:03:41.672 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:03:41.672 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:03:41.673 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:03:41.673 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:03:41.673 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:03:41.673 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:03:41.673 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:03:41.673 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:03:41.674 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:03:41.674 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:03:41.674 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:03:41.674 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:03:41.674 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:03:41.675 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:03:41.675 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:03:41.675 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:03:41.675 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:03:41.675 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:03:41.676 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:03:41.676 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:03:41.676 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:03:41.676 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:03:41.676 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:03:41.676 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:03:41.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.670+0000 7f1f73fff700 1 -- 172.21.15.8:0/13835498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f5c060f70 msgr2=0x7f1f5c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.670+0000 7f1f73fff700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f5c060f70 0x7f1f5c063430 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f1f64005010 tx=0x7f1f64016040).stop 2023-10-18T22:03:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.670+0000 7f1f73fff700 1 -- 172.21.15.8:0/13835498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740f66d0 msgr2=0x7f1f74109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.670+0000 7f1f73fff700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740f66d0 0x7f1f74109460 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f1f6800e7f0 tx=0x7f1f6800b040).stop 2023-10-18T22:03:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.671+0000 7f1f73fff700 1 -- 172.21.15.8:0/13835498 shutdown_connections 2023-10-18T22:03:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.671+0000 7f1f73fff700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f5c060f70 0x7f1f5c063430 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.671+0000 7f1f73fff700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f740f5430 0x7f1f74108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.671+0000 7f1f73fff700 1 --2- 172.21.15.8:0/13835498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f740f66d0 0x7f1f74109460 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.671+0000 7f1f73fff700 1 -- 172.21.15.8:0/13835498 >> 172.21.15.8:0/13835498 conn(0x7f1f740f0b90 msgr2=0x7f1f7405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.671+0000 7f1f73fff700 1 -- 172.21.15.8:0/13835498 shutdown_connections 2023-10-18T22:03:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.671+0000 7f1f73fff700 1 -- 172.21.15.8:0/13835498 wait complete. 2023-10-18T22:03:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:03:41.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.807+0000 7f91bb1df700 1 -- 172.21.15.8:0/935456195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91b40f6530 msgr2=0x7f91b40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:41.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.807+0000 7f91bb1df700 1 --2- 172.21.15.8:0/935456195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91b40f6530 0x7f91b40f6950 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f91b0004660 tx=0x7f91b0009b30).stop 2023-10-18T22:03:41.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.808+0000 7f91bb1df700 1 -- 172.21.15.8:0/935456195 shutdown_connections 2023-10-18T22:03:41.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.808+0000 7f91bb1df700 1 --2- 172.21.15.8:0/935456195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b40f77d0 0x7f91b40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.808+0000 7f91bb1df700 1 --2- 172.21.15.8:0/935456195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91b40f6530 0x7f91b40f6950 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.808+0000 7f91bb1df700 1 -- 172.21.15.8:0/935456195 >> 172.21.15.8:0/935456195 conn(0x7f91b40f1c90 msgr2=0x7f91b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:41.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.808+0000 7f91bb1df700 1 -- 172.21.15.8:0/935456195 shutdown_connections 2023-10-18T22:03:41.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.808+0000 7f91bb1df700 1 -- 172.21.15.8:0/935456195 wait complete. 2023-10-18T22:03:41.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.809+0000 7f91bb1df700 1 Processor -- start 2023-10-18T22:03:41.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.809+0000 7f91bb1df700 1 -- start start 2023-10-18T22:03:41.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.809+0000 7f91bb1df700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91b40f6530 0x7f91b4108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:41.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.809+0000 7f91bb1df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b40f77d0 0x7f91b4109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:41.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.809+0000 7f91bb1df700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4109a00 con 0x7f91b40f6530 2023-10-18T22:03:41.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.809+0000 7f91bb1df700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4109b40 con 0x7f91b40f77d0 2023-10-18T22:03:41.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.809+0000 7f91ba1dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91b40f6530 0x7f91b4108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:41.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.809+0000 7f91ba1dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91b40f6530 0x7f91b4108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41576/0 (socket says 172.21.15.8:41576) 2023-10-18T22:03:41.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.809+0000 7f91ba1dd700 1 -- 172.21.15.8:0/190445073 learned_addr learned my addr 172.21.15.8:0/190445073 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:03:41.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.810+0000 7f91ba1dd700 1 -- 172.21.15.8:0/190445073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b40f77d0 msgr2=0x7f91b4109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:41.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.810+0000 7f91b99dc700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b40f77d0 0x7f91b4109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:41.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.810+0000 7f91ba1dd700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b40f77d0 0x7f91b4109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:41.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.810+0000 7f91ba1dd700 1 -- 172.21.15.8:0/190445073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0005040 con 0x7f91b40f6530 2023-10-18T22:03:41.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.810+0000 7f91b99dc700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b40f77d0 0x7f91b4109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:03:41.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.810+0000 7f91ba1dd700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91b40f6530 0x7f91b4108f60 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f91b0009870 tx=0x7f91b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:41.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.810+0000 7f91aaffd700 1 -- 172.21.15.8:0/190445073 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b0019070 con 0x7f91b40f6530 2023-10-18T22:03:41.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.810+0000 7f91aaffd700 1 -- 172.21.15.8:0/190445073 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f91b001e420 con 0x7f91b40f6530 2023-10-18T22:03:41.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.810+0000 7f91bb1df700 1 -- 172.21.15.8:0/190445073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b410a480 con 0x7f91b40f6530 2023-10-18T22:03:41.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.810+0000 7f91aaffd700 1 -- 172.21.15.8:0/190445073 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b0014660 con 0x7f91b40f6530 2023-10-18T22:03:41.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.811+0000 7f91bb1df700 1 -- 172.21.15.8:0/190445073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b410a960 con 0x7f91b40f6530 2023-10-18T22:03:41.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.812+0000 7f91bb1df700 1 -- 172.21.15.8:0/190445073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b4045ad0 con 0x7f91b40f6530 2023-10-18T22:03:41.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.813+0000 7f91aaffd700 1 -- 172.21.15.8:0/190445073 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f91b001e9c0 con 0x7f91b40f6530 2023-10-18T22:03:41.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.813+0000 7f91aaffd700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91a0060f70 0x7f91a0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:03:41.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.814+0000 7f91aaffd700 1 -- 172.21.15.8:0/190445073 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f91b007dd80 con 0x7f91b40f6530 2023-10-18T22:03:41.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.814+0000 7f91b99dc700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91a0060f70 0x7f91a0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:03:41.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.814+0000 7f91b99dc700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91a0060f70 0x7f91a0063430 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f91a4009da0 tx=0x7f91a400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:03:41.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:41.818+0000 7f91aaffd700 1 -- 172.21.15.8:0/190445073 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f91b00513e0 con 0x7f91b40f6530 2023-10-18T22:03:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.016+0000 7f91bb1df700 1 -- 172.21.15.8:0/190445073 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91b40fee00 con 0x7f91a0060f70 2023-10-18T22:03:42.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.017+0000 7f91aaffd700 1 -- 172.21.15.8:0/190445073 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f91b40fee00 con 0x7f91a0060f70 2023-10-18T22:03:42.019 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:03:42.019 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:03:42.019 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:03:42.019 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:03:42.019 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:03:42.020 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:03:42.020 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:03:42.020 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:03:42.020 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:03:42.020 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:03:42.021 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:03:42.021 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:03:42.021 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:03:42.021 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:03:42.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.019+0000 7f91bb1df700 1 -- 172.21.15.8:0/190445073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91a0060f70 msgr2=0x7f91a0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:42.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.019+0000 7f91bb1df700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91a0060f70 0x7f91a0063430 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f91a4009da0 tx=0x7f91a400b040).stop 2023-10-18T22:03:42.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.019+0000 7f91bb1df700 1 -- 172.21.15.8:0/190445073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91b40f6530 msgr2=0x7f91b4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:03:42.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.019+0000 7f91bb1df700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91b40f6530 0x7f91b4108f60 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f91b0009870 tx=0x7f91b000b040).stop 2023-10-18T22:03:42.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.019+0000 7f91bb1df700 1 -- 172.21.15.8:0/190445073 shutdown_connections 2023-10-18T22:03:42.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.019+0000 7f91bb1df700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91a0060f70 0x7f91a0063430 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:42.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.019+0000 7f91bb1df700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91b40f6530 0x7f91b4108f60 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:42.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.019+0000 7f91bb1df700 1 --2- 172.21.15.8:0/190445073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b40f77d0 0x7f91b4109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:03:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.019+0000 7f91bb1df700 1 -- 172.21.15.8:0/190445073 >> 172.21.15.8:0/190445073 conn(0x7f91b40f1c90 msgr2=0x7f91b406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:03:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.020+0000 7f91bb1df700 1 -- 172.21.15.8:0/190445073 shutdown_connections 2023-10-18T22:03:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:03:42.020+0000 7f91bb1df700 1 -- 172.21.15.8:0/190445073 wait complete. 2023-10-18T22:03:42.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:40.546308+0000 mgr.smithi008.flmjzp (mgr.14640) 3888 : audit [DBG] from='client.37172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:40.889360+0000 mgr.smithi008.flmjzp (mgr.14640) 3889 : audit [DBG] from='client.37176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:41.298409+0000 mon.smithi008 (mon.0) 4220 : audit [DBG] from='client.? 172.21.15.8:0/1192305922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:41.669247+0000 mon.smithi008 (mon.0) 4221 : audit [DBG] from='client.? 172.21.15.8:0/13835498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:03:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:40.546308+0000 mgr.smithi008.flmjzp (mgr.14640) 3888 : audit [DBG] from='client.37172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:40.889360+0000 mgr.smithi008.flmjzp (mgr.14640) 3889 : audit [DBG] from='client.37176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:41.298409+0000 mon.smithi008 (mon.0) 4220 : audit [DBG] from='client.? 172.21.15.8:0/1192305922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:42.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:41.669247+0000 mon.smithi008 (mon.0) 4221 : audit [DBG] from='client.? 172.21.15.8:0/13835498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:03:43.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:41.866208+0000 mgr.smithi008.flmjzp (mgr.14640) 3890 : cluster [DBG] pgmap v2671: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:43.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:42.017721+0000 mgr.smithi008.flmjzp (mgr.14640) 3891 : audit [DBG] from='client.37188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:41.866208+0000 mgr.smithi008.flmjzp (mgr.14640) 3890 : cluster [DBG] pgmap v2671: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:42.017721+0000 mgr.smithi008.flmjzp (mgr.14640) 3891 : audit [DBG] from='client.37188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:03:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:43.866781+0000 mgr.smithi008.flmjzp (mgr.14640) 3892 : cluster [DBG] pgmap v2672: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:43.866781+0000 mgr.smithi008.flmjzp (mgr.14640) 3892 : cluster [DBG] pgmap v2672: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:45.867288+0000 mgr.smithi008.flmjzp (mgr.14640) 3893 : cluster [DBG] pgmap v2673: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:45.867288+0000 mgr.smithi008.flmjzp (mgr.14640) 3893 : cluster [DBG] pgmap v2673: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:47.892955+0000 mon.smithi008 (mon.0) 4222 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:47.895203+0000 mon.smithi008 (mon.0) 4223 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:47.896267+0000 mon.smithi008 (mon.0) 4224 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:47.903211+0000 mon.smithi008 (mon.0) 4225 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:47.909878+0000 mon.smithi008 (mon.0) 4226 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:47.913037+0000 mon.smithi008 (mon.0) 4227 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:47.914765+0000 mon.smithi008 (mon.0) 4228 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:48.310 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:47.916406+0000 mon.smithi008 (mon.0) 4229 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:48.311 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:47.918469+0000 mon.smithi008 (mon.0) 4230 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:47.892955+0000 mon.smithi008 (mon.0) 4222 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:47.895203+0000 mon.smithi008 (mon.0) 4223 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:47.896267+0000 mon.smithi008 (mon.0) 4224 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:47.903211+0000 mon.smithi008 (mon.0) 4225 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:47.909878+0000 mon.smithi008 (mon.0) 4226 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:47.913037+0000 mon.smithi008 (mon.0) 4227 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:47.914765+0000 mon.smithi008 (mon.0) 4228 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:47.916406+0000 mon.smithi008 (mon.0) 4229 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:47.918469+0000 mon.smithi008 (mon.0) 4230 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:47.867940+0000 mgr.smithi008.flmjzp (mgr.14640) 3894 : cluster [DBG] pgmap v2674: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:47.897238+0000 mgr.smithi008.flmjzp (mgr.14640) 3895 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:03:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:47.897814+0000 mgr.smithi008.flmjzp (mgr.14640) 3896 : cluster [DBG] pgmap v2675: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:47.898089+0000 mgr.smithi008.flmjzp (mgr.14640) 3897 : cluster [DBG] pgmap v2676: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:49.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:47.920297+0000 mgr.smithi008.flmjzp (mgr.14640) 3898 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:47.867940+0000 mgr.smithi008.flmjzp (mgr.14640) 3894 : cluster [DBG] pgmap v2674: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:47.897238+0000 mgr.smithi008.flmjzp (mgr.14640) 3895 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:03:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:47.897814+0000 mgr.smithi008.flmjzp (mgr.14640) 3896 : cluster [DBG] pgmap v2675: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:49.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:47.898089+0000 mgr.smithi008.flmjzp (mgr.14640) 3897 : cluster [DBG] pgmap v2676: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:49.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:47.920297+0000 mgr.smithi008.flmjzp (mgr.14640) 3898 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:03:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:49.898793+0000 mgr.smithi008.flmjzp (mgr.14640) 3899 : cluster [DBG] pgmap v2677: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:49.898793+0000 mgr.smithi008.flmjzp (mgr.14640) 3899 : cluster [DBG] pgmap v2677: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:51.899500+0000 mgr.smithi008.flmjzp (mgr.14640) 3900 : cluster [DBG] pgmap v2678: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:51.899500+0000 mgr.smithi008.flmjzp (mgr.14640) 3900 : cluster [DBG] pgmap v2678: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:53.900030+0000 mgr.smithi008.flmjzp (mgr.14640) 3901 : cluster [DBG] pgmap v2679: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:53.900030+0000 mgr.smithi008.flmjzp (mgr.14640) 3901 : cluster [DBG] pgmap v2679: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:55.900543+0000 mgr.smithi008.flmjzp (mgr.14640) 3902 : cluster [DBG] pgmap v2680: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:55.900543+0000 mgr.smithi008.flmjzp (mgr.14640) 3902 : cluster [DBG] pgmap v2680: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:58.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:57.931063+0000 mon.smithi008 (mon.0) 4231 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:58.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:57.931063+0000 mon.smithi008 (mon.0) 4231 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:57.901148+0000 mgr.smithi008.flmjzp (mgr.14640) 3903 : cluster [DBG] pgmap v2681: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:58.489577+0000 mon.smithi008 (mon.0) 4232 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:58.490692+0000 mon.smithi008 (mon.0) 4233 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:58.497547+0000 mon.smithi008 (mon.0) 4234 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:59.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:58.504321+0000 mon.smithi008 (mon.0) 4235 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:59.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:58.507354+0000 mon.smithi008 (mon.0) 4236 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:59.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:58.509013+0000 mon.smithi008 (mon.0) 4237 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:59.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:58.510594+0000 mon.smithi008 (mon.0) 4238 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:59.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:03:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:03:58.512529+0000 mon.smithi008 (mon.0) 4239 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:57.901148+0000 mgr.smithi008.flmjzp (mgr.14640) 3903 : cluster [DBG] pgmap v2681: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:03:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:58.489577+0000 mon.smithi008 (mon.0) 4232 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:03:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:58.490692+0000 mon.smithi008 (mon.0) 4233 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:03:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:58.497547+0000 mon.smithi008 (mon.0) 4234 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:03:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:58.504321+0000 mon.smithi008 (mon.0) 4235 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:03:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:58.507354+0000 mon.smithi008 (mon.0) 4236 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:58.509013+0000 mon.smithi008 (mon.0) 4237 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:59.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:58.510594+0000 mon.smithi008 (mon.0) 4238 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:03:59.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:03:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:03:58.512529+0000 mon.smithi008 (mon.0) 4239 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:58.491622+0000 mgr.smithi008.flmjzp (mgr.14640) 3904 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:58.492305+0000 mgr.smithi008.flmjzp (mgr.14640) 3905 : cluster [DBG] pgmap v2682: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:03:58.492570+0000 mgr.smithi008.flmjzp (mgr.14640) 3906 : cluster [DBG] pgmap v2683: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:03:58.514346+0000 mgr.smithi008.flmjzp (mgr.14640) 3907 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:58.491622+0000 mgr.smithi008.flmjzp (mgr.14640) 3904 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:58.492305+0000 mgr.smithi008.flmjzp (mgr.14640) 3905 : cluster [DBG] pgmap v2682: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:03:58.492570+0000 mgr.smithi008.flmjzp (mgr.14640) 3906 : cluster [DBG] pgmap v2683: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:03:58.514346+0000 mgr.smithi008.flmjzp (mgr.14640) 3907 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:02.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:00.493127+0000 mgr.smithi008.flmjzp (mgr.14640) 3908 : cluster [DBG] pgmap v2684: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:00.493127+0000 mgr.smithi008.flmjzp (mgr.14640) 3908 : cluster [DBG] pgmap v2684: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:04.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:02.493754+0000 mgr.smithi008.flmjzp (mgr.14640) 3909 : cluster [DBG] pgmap v2685: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:02.493754+0000 mgr.smithi008.flmjzp (mgr.14640) 3909 : cluster [DBG] pgmap v2685: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:04.494507+0000 mgr.smithi008.flmjzp (mgr.14640) 3910 : cluster [DBG] pgmap v2686: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:04.494507+0000 mgr.smithi008.flmjzp (mgr.14640) 3910 : cluster [DBG] pgmap v2686: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:08.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:06.495044+0000 mgr.smithi008.flmjzp (mgr.14640) 3911 : cluster [DBG] pgmap v2687: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:06.495044+0000 mgr.smithi008.flmjzp (mgr.14640) 3911 : cluster [DBG] pgmap v2687: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:08.525017+0000 mon.smithi008 (mon.0) 4240 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:08.527316+0000 mon.smithi008 (mon.0) 4241 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:04:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:08.528371+0000 mon.smithi008 (mon.0) 4242 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:04:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:08.535661+0000 mon.smithi008 (mon.0) 4243 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:04:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:08.542224+0000 mon.smithi008 (mon.0) 4244 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:09.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:08.545577+0000 mon.smithi008 (mon.0) 4245 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:08.547378+0000 mon.smithi008 (mon.0) 4246 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:08.549034+0000 mon.smithi008 (mon.0) 4247 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:09.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:08.551041+0000 mon.smithi008 (mon.0) 4248 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:08.525017+0000 mon.smithi008 (mon.0) 4240 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:08.527316+0000 mon.smithi008 (mon.0) 4241 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:04:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:08.528371+0000 mon.smithi008 (mon.0) 4242 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:04:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:08.535661+0000 mon.smithi008 (mon.0) 4243 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:04:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:08.542224+0000 mon.smithi008 (mon.0) 4244 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:08.545577+0000 mon.smithi008 (mon.0) 4245 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:08.547378+0000 mon.smithi008 (mon.0) 4246 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:08.549034+0000 mon.smithi008 (mon.0) 4247 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:09.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:08.551041+0000 mon.smithi008 (mon.0) 4248 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:08.495805+0000 mgr.smithi008.flmjzp (mgr.14640) 3912 : cluster [DBG] pgmap v2688: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:08.529325+0000 mgr.smithi008.flmjzp (mgr.14640) 3913 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:08.529957+0000 mgr.smithi008.flmjzp (mgr.14640) 3914 : cluster [DBG] pgmap v2689: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:08.530229+0000 mgr.smithi008.flmjzp (mgr.14640) 3915 : cluster [DBG] pgmap v2690: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:08.552993+0000 mgr.smithi008.flmjzp (mgr.14640) 3916 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:08.495805+0000 mgr.smithi008.flmjzp (mgr.14640) 3912 : cluster [DBG] pgmap v2688: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:08.529325+0000 mgr.smithi008.flmjzp (mgr.14640) 3913 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:08.529957+0000 mgr.smithi008.flmjzp (mgr.14640) 3914 : cluster [DBG] pgmap v2689: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:08.530229+0000 mgr.smithi008.flmjzp (mgr.14640) 3915 : cluster [DBG] pgmap v2690: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:08.552993+0000 mgr.smithi008.flmjzp (mgr.14640) 3916 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.172+0000 7fa2e5a78700 1 -- 172.21.15.8:0/2635813230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2e00f77d0 msgr2=0x7fa2e00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:12.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.172+0000 7fa2e5a78700 1 --2- 172.21.15.8:0/2635813230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2e00f77d0 0x7fa2e00f7c30 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7fa2cc004660 tx=0x7fa2cc009b30).stop 2023-10-18T22:04:12.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.172+0000 7fa2e5a78700 1 -- 172.21.15.8:0/2635813230 shutdown_connections 2023-10-18T22:04:12.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.172+0000 7fa2e5a78700 1 --2- 172.21.15.8:0/2635813230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2e00f77d0 0x7fa2e00f7c30 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.172+0000 7fa2e5a78700 1 --2- 172.21.15.8:0/2635813230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2e00f6530 0x7fa2e00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.172+0000 7fa2e5a78700 1 -- 172.21.15.8:0/2635813230 >> 172.21.15.8:0/2635813230 conn(0x7fa2e00f1c90 msgr2=0x7fa2e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.172+0000 7fa2e5a78700 1 -- 172.21.15.8:0/2635813230 shutdown_connections 2023-10-18T22:04:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.172+0000 7fa2e5a78700 1 -- 172.21.15.8:0/2635813230 wait complete. 2023-10-18T22:04:12.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.173+0000 7fa2e5a78700 1 Processor -- start 2023-10-18T22:04:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.173+0000 7fa2e5a78700 1 -- start start 2023-10-18T22:04:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.173+0000 7fa2e5a78700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2e00f6530 0x7fa2e006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.173+0000 7fa2e5a78700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2e00f77d0 0x7fa2e0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.173+0000 7fa2e5a78700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e006a380 con 0x7fa2e00f6530 2023-10-18T22:04:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.173+0000 7fa2e5a78700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e006a4c0 con 0x7fa2e00f77d0 2023-10-18T22:04:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.174+0000 7fa2e4a76700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2e00f6530 0x7fa2e006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.174+0000 7fa2e4a76700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2e00f6530 0x7fa2e006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48198/0 (socket says 172.21.15.8:48198) 2023-10-18T22:04:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.174+0000 7fa2e4a76700 1 -- 172.21.15.8:0/1311777428 learned_addr learned my addr 172.21.15.8:0/1311777428 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.174+0000 7fa2dffff700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2e00f77d0 0x7fa2e0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.174+0000 7fa2e4a76700 1 -- 172.21.15.8:0/1311777428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2e00f77d0 msgr2=0x7fa2e0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.174+0000 7fa2e4a76700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2e00f77d0 0x7fa2e0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.174+0000 7fa2e4a76700 1 -- 172.21.15.8:0/1311777428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc005040 con 0x7fa2e00f6530 2023-10-18T22:04:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.174+0000 7fa2e4a76700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2e00f6530 0x7fa2e006b9a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fa2d400e7c0 tx=0x7fa2d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.175+0000 7fa2dd7fa700 1 -- 172.21.15.8:0/1311777428 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2d40092e0 con 0x7fa2e00f6530 2023-10-18T22:04:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.175+0000 7fa2dd7fa700 1 -- 172.21.15.8:0/1311777428 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa2d400f040 con 0x7fa2e00f6530 2023-10-18T22:04:12.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.175+0000 7fa2e5a78700 1 -- 172.21.15.8:0/1311777428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e006a7a0 con 0x7fa2e00f6530 2023-10-18T22:04:12.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.175+0000 7fa2dd7fa700 1 -- 172.21.15.8:0/1311777428 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2d40147e0 con 0x7fa2e00f6530 2023-10-18T22:04:12.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.175+0000 7fa2e5a78700 1 -- 172.21.15.8:0/1311777428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e010ed20 con 0x7fa2e00f6530 2023-10-18T22:04:12.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.176+0000 7fa2e5a78700 1 -- 172.21.15.8:0/1311777428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e0059100 con 0x7fa2e00f6530 2023-10-18T22:04:12.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.177+0000 7fa2dd7fa700 1 -- 172.21.15.8:0/1311777428 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa2d401b030 con 0x7fa2e00f6530 2023-10-18T22:04:12.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.177+0000 7fa2dd7fa700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2d0060f70 0x7fa2d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:12.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.178+0000 7fa2dd7fa700 1 -- 172.21.15.8:0/1311777428 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa2d407c9b0 con 0x7fa2e00f6530 2023-10-18T22:04:12.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.178+0000 7fa2dffff700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2d0060f70 0x7fa2d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:12.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.178+0000 7fa2dffff700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2d0060f70 0x7fa2d0063430 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fa2cc0043d0 tx=0x7fa2cc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:12.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.182+0000 7fa2dd7fa700 1 -- 172.21.15.8:0/1311777428 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa2d404c620 con 0x7fa2e00f6530 2023-10-18T22:04:12.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.385+0000 7fa2e5a78700 1 -- 172.21.15.8:0/1311777428 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2e00fee50 con 0x7fa2d0060f70 2023-10-18T22:04:12.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.387+0000 7fa2dd7fa700 1 -- 172.21.15.8:0/1311777428 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa2e00fee50 con 0x7fa2d0060f70 2023-10-18T22:04:12.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.388+0000 7fa2e5a78700 1 -- 172.21.15.8:0/1311777428 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2d0060f70 msgr2=0x7fa2d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:12.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.388+0000 7fa2e5a78700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2d0060f70 0x7fa2d0063430 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fa2cc0043d0 tx=0x7fa2cc00b040).stop 2023-10-18T22:04:12.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.388+0000 7fa2e5a78700 1 -- 172.21.15.8:0/1311777428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2e00f6530 msgr2=0x7fa2e006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:12.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.388+0000 7fa2e5a78700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2e00f6530 0x7fa2e006b9a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fa2d400e7c0 tx=0x7fa2d400b040).stop 2023-10-18T22:04:12.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.389+0000 7fa2e5a78700 1 -- 172.21.15.8:0/1311777428 shutdown_connections 2023-10-18T22:04:12.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.389+0000 7fa2e5a78700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2d0060f70 0x7fa2d0063430 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.389+0000 7fa2e5a78700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2e00f6530 0x7fa2e006b9a0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.389+0000 7fa2e5a78700 1 --2- 172.21.15.8:0/1311777428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2e00f77d0 0x7fa2e0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.389+0000 7fa2e5a78700 1 -- 172.21.15.8:0/1311777428 >> 172.21.15.8:0/1311777428 conn(0x7fa2e00f1c90 msgr2=0x7fa2e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:12.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.389+0000 7fa2e5a78700 1 -- 172.21.15.8:0/1311777428 shutdown_connections 2023-10-18T22:04:12.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.389+0000 7fa2e5a78700 1 -- 172.21.15.8:0/1311777428 wait complete. 2023-10-18T22:04:12.405 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:04:12.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:10.530965+0000 mgr.smithi008.flmjzp (mgr.14640) 3917 : cluster [DBG] pgmap v2691: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:10.530965+0000 mgr.smithi008.flmjzp (mgr.14640) 3917 : cluster [DBG] pgmap v2691: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.526+0000 7fe017fff700 1 -- 172.21.15.8:0/2130762584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0180f6530 msgr2=0x7fe0180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.526+0000 7fe017fff700 1 --2- 172.21.15.8:0/2130762584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0180f6530 0x7fe0180f6950 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fe008004660 tx=0x7fe008009b30).stop 2023-10-18T22:04:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.526+0000 7fe017fff700 1 -- 172.21.15.8:0/2130762584 shutdown_connections 2023-10-18T22:04:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.526+0000 7fe017fff700 1 --2- 172.21.15.8:0/2130762584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0180f77d0 0x7fe0180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.526+0000 7fe017fff700 1 --2- 172.21.15.8:0/2130762584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0180f6530 0x7fe0180f6950 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.526+0000 7fe017fff700 1 -- 172.21.15.8:0/2130762584 >> 172.21.15.8:0/2130762584 conn(0x7fe0180f1c90 msgr2=0x7fe0180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.526+0000 7fe017fff700 1 -- 172.21.15.8:0/2130762584 shutdown_connections 2023-10-18T22:04:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.526+0000 7fe017fff700 1 -- 172.21.15.8:0/2130762584 wait complete. 2023-10-18T22:04:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.527+0000 7fe017fff700 1 Processor -- start 2023-10-18T22:04:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.527+0000 7fe017fff700 1 -- start start 2023-10-18T22:04:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.527+0000 7fe017fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0180f6530 0x7fe018108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.527+0000 7fe017fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0180f77d0 0x7fe0181094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.527+0000 7fe017fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe018109a70 con 0x7fe0180f77d0 2023-10-18T22:04:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.527+0000 7fe017fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe018109bb0 con 0x7fe0180f6530 2023-10-18T22:04:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.528+0000 7fe0167fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0180f77d0 0x7fe0181094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.528+0000 7fe0167fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0180f77d0 0x7fe0181094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48210/0 (socket says 172.21.15.8:48210) 2023-10-18T22:04:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.528+0000 7fe0167fc700 1 -- 172.21.15.8:0/3995594009 learned_addr learned my addr 172.21.15.8:0/3995594009 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.528+0000 7fe016ffd700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0180f6530 0x7fe018108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.528+0000 7fe0167fc700 1 -- 172.21.15.8:0/3995594009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0180f6530 msgr2=0x7fe018108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.528+0000 7fe0167fc700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0180f6530 0x7fe018108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.528+0000 7fe0167fc700 1 -- 172.21.15.8:0/3995594009 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe008005040 con 0x7fe0180f77d0 2023-10-18T22:04:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.528+0000 7fe0167fc700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0180f77d0 0x7fe0181094c0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fe00c0026d0 tx=0x7fe00c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.529+0000 7fdfff7fe700 1 -- 172.21.15.8:0/3995594009 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe00c0079c0 con 0x7fe0180f77d0 2023-10-18T22:04:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.529+0000 7fdfff7fe700 1 -- 172.21.15.8:0/3995594009 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe00c00f040 con 0x7fe0180f77d0 2023-10-18T22:04:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.529+0000 7fe017fff700 1 -- 172.21.15.8:0/3995594009 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01810a550 con 0x7fe0180f77d0 2023-10-18T22:04:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.529+0000 7fdfff7fe700 1 -- 172.21.15.8:0/3995594009 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe00c014980 con 0x7fe0180f77d0 2023-10-18T22:04:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.529+0000 7fe017fff700 1 -- 172.21.15.8:0/3995594009 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01810ab10 con 0x7fe0180f77d0 2023-10-18T22:04:12.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.530+0000 7fe017fff700 1 -- 172.21.15.8:0/3995594009 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe018045ad0 con 0x7fe0180f77d0 2023-10-18T22:04:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.531+0000 7fdfff7fe700 1 -- 172.21.15.8:0/3995594009 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe00c0090d0 con 0x7fe0180f77d0 2023-10-18T22:04:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.532+0000 7fdfff7fe700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe000060f70 0x7fe000063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.532+0000 7fdfff7fe700 1 -- 172.21.15.8:0/3995594009 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe00c07c8a0 con 0x7fe0180f77d0 2023-10-18T22:04:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.532+0000 7fe016ffd700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe000060f70 0x7fe000063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.533+0000 7fe016ffd700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe000060f70 0x7fe000063430 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fe008004630 tx=0x7fe008009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:12.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.536+0000 7fdfff7fe700 1 -- 172.21.15.8:0/3995594009 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe00c04ffb0 con 0x7fe0180f77d0 2023-10-18T22:04:12.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.733+0000 7fe017fff700 1 -- 172.21.15.8:0/3995594009 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe01810ade0 con 0x7fe000060f70 2023-10-18T22:04:12.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.734+0000 7fdfff7fe700 1 -- 172.21.15.8:0/3995594009 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe01810ade0 con 0x7fe000060f70 2023-10-18T22:04:12.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 -- 172.21.15.8:0/3995594009 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe000060f70 msgr2=0x7fe000063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:12.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe000060f70 0x7fe000063430 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fe008004630 tx=0x7fe008009b30).stop 2023-10-18T22:04:12.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 -- 172.21.15.8:0/3995594009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0180f77d0 msgr2=0x7fe0181094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:12.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0180f77d0 0x7fe0181094c0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fe00c0026d0 tx=0x7fe00c009de0).stop 2023-10-18T22:04:12.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 -- 172.21.15.8:0/3995594009 shutdown_connections 2023-10-18T22:04:12.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe000060f70 0x7fe000063430 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0180f6530 0x7fe018108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 --2- 172.21.15.8:0/3995594009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0180f77d0 0x7fe0181094c0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 -- 172.21.15.8:0/3995594009 >> 172.21.15.8:0/3995594009 conn(0x7fe0180f1c90 msgr2=0x7fe01806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:12.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 -- 172.21.15.8:0/3995594009 shutdown_connections 2023-10-18T22:04:12.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.736+0000 7fe017fff700 1 -- 172.21.15.8:0/3995594009 wait complete. 2023-10-18T22:04:12.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.874+0000 7fa51f59e700 1 -- 172.21.15.8:0/588110251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5200f6530 msgr2=0x7fa5200f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:12.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.874+0000 7fa51f59e700 1 --2- 172.21.15.8:0/588110251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5200f6530 0x7fa5200f6950 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fa510004660 tx=0x7fa510009b30).stop 2023-10-18T22:04:12.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.874+0000 7fa51f59e700 1 -- 172.21.15.8:0/588110251 shutdown_connections 2023-10-18T22:04:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.874+0000 7fa51f59e700 1 --2- 172.21.15.8:0/588110251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5200f77d0 0x7fa5200f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.875+0000 7fa51f59e700 1 --2- 172.21.15.8:0/588110251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5200f6530 0x7fa5200f6950 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.875+0000 7fa51f59e700 1 -- 172.21.15.8:0/588110251 >> 172.21.15.8:0/588110251 conn(0x7fa5200f1c70 msgr2=0x7fa5200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.875+0000 7fa51f59e700 1 -- 172.21.15.8:0/588110251 shutdown_connections 2023-10-18T22:04:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.875+0000 7fa51f59e700 1 -- 172.21.15.8:0/588110251 wait complete. 2023-10-18T22:04:12.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.875+0000 7fa51f59e700 1 Processor -- start 2023-10-18T22:04:12.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.876+0000 7fa51f59e700 1 -- start start 2023-10-18T22:04:12.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.876+0000 7fa51f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5200f6530 0x7fa520108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:12.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.876+0000 7fa51f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5200f77d0 0x7fa5201094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:12.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.876+0000 7fa51f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa520109a80 con 0x7fa5200f6530 2023-10-18T22:04:12.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.876+0000 7fa51f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa520109bc0 con 0x7fa5200f77d0 2023-10-18T22:04:12.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.876+0000 7fa51e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5200f6530 0x7fa520108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:12.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.876+0000 7fa51e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5200f6530 0x7fa520108fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48228/0 (socket says 172.21.15.8:48228) 2023-10-18T22:04:12.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.876+0000 7fa51e59c700 1 -- 172.21.15.8:0/1965012515 learned_addr learned my addr 172.21.15.8:0/1965012515 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:12.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.876+0000 7fa51dd9b700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5200f77d0 0x7fa5201094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:12.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.877+0000 7fa51e59c700 1 -- 172.21.15.8:0/1965012515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5200f77d0 msgr2=0x7fa5201094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:12.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.877+0000 7fa51e59c700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5200f77d0 0x7fa5201094d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:12.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.877+0000 7fa51e59c700 1 -- 172.21.15.8:0/1965012515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa510005040 con 0x7fa5200f6530 2023-10-18T22:04:12.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.877+0000 7fa51e59c700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5200f6530 0x7fa520108fe0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fa510004e30 tx=0x7fa510009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:12.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.877+0000 7fa50effd700 1 -- 172.21.15.8:0/1965012515 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa510018070 con 0x7fa5200f6530 2023-10-18T22:04:12.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.877+0000 7fa50effd700 1 -- 172.21.15.8:0/1965012515 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa510009630 con 0x7fa5200f6530 2023-10-18T22:04:12.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.877+0000 7fa51f59e700 1 -- 172.21.15.8:0/1965012515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52010a500 con 0x7fa5200f6530 2023-10-18T22:04:12.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.877+0000 7fa50effd700 1 -- 172.21.15.8:0/1965012515 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa51001c3c0 con 0x7fa5200f6530 2023-10-18T22:04:12.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.877+0000 7fa51f59e700 1 -- 172.21.15.8:0/1965012515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52010aa60 con 0x7fa5200f6530 2023-10-18T22:04:12.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.878+0000 7fa51f59e700 1 -- 172.21.15.8:0/1965012515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa520045ad0 con 0x7fa5200f6530 2023-10-18T22:04:12.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.879+0000 7fa50effd700 1 -- 172.21.15.8:0/1965012515 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa51001d420 con 0x7fa5200f6530 2023-10-18T22:04:12.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.880+0000 7fa50effd700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa508060f70 0x7fa508063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:12.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.881+0000 7fa50effd700 1 -- 172.21.15.8:0/1965012515 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa51007e6b0 con 0x7fa5200f6530 2023-10-18T22:04:12.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.881+0000 7fa51dd9b700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa508060f70 0x7fa508063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:12.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.881+0000 7fa51dd9b700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa508060f70 0x7fa508063430 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fa5140096c0 tx=0x7fa514009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:12.885+0000 7fa50effd700 1 -- 172.21.15.8:0/1965012515 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa510051d40 con 0x7fa5200f6530 2023-10-18T22:04:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.078+0000 7fa51f59e700 1 -- 172.21.15.8:0/1965012515 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa52010ac80 con 0x7fa508060f70 2023-10-18T22:04:13.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.087+0000 7fa50effd700 1 -- 172.21.15.8:0/1965012515 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa52010ac80 con 0x7fa508060f70 2023-10-18T22:04:13.090 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:04:13.090 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (70m) 8m ago 72m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:04:13.090 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (64m) 8m ago 72m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:04:13.090 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (64m) 6m ago 71m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:04:13.090 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (70m) 8m ago 72m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:04:13.091 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 68m - - 2023-10-18T22:04:13.091 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 68m - - 2023-10-18T22:04:13.091 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 68m - - 2023-10-18T22:04:13.091 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 68m - - 2023-10-18T22:04:13.091 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (66m) 8m ago 73m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:04:13.091 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (65m) 6m ago 71m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:04:13.092 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (65m) 8m ago 73m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:04:13.092 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (65m) 6m ago 71m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:04:13.092 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (71m) 8m ago 71m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:04:13.092 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (71m) 6m ago 71m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:04:13.092 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (64m) 8m ago 70m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:04:13.093 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (62m) 8m ago 70m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:04:13.093 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (61m) 8m ago 70m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:04:13.093 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (61m) 6m ago 70m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:04:13.093 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (60m) 6m ago 69m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:04:13.093 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (60m) 6m ago 69m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:04:13.093 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (66m) 8m ago 71m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:04:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.089+0000 7fa51f59e700 1 -- 172.21.15.8:0/1965012515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa508060f70 msgr2=0x7fa508063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.089+0000 7fa51f59e700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa508060f70 0x7fa508063430 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fa5140096c0 tx=0x7fa514009be0).stop 2023-10-18T22:04:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.089+0000 7fa51f59e700 1 -- 172.21.15.8:0/1965012515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5200f6530 msgr2=0x7fa520108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.089+0000 7fa51f59e700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5200f6530 0x7fa520108fe0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fa510004e30 tx=0x7fa510009b30).stop 2023-10-18T22:04:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.089+0000 7fa51f59e700 1 -- 172.21.15.8:0/1965012515 shutdown_connections 2023-10-18T22:04:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.089+0000 7fa51f59e700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa508060f70 0x7fa508063430 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.089+0000 7fa51f59e700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5200f6530 0x7fa520108fe0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.089+0000 7fa51f59e700 1 --2- 172.21.15.8:0/1965012515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5200f77d0 0x7fa5201094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.089+0000 7fa51f59e700 1 -- 172.21.15.8:0/1965012515 >> 172.21.15.8:0/1965012515 conn(0x7fa5200f1c70 msgr2=0x7fa52006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:13.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.089+0000 7fa51f59e700 1 -- 172.21.15.8:0/1965012515 shutdown_connections 2023-10-18T22:04:13.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.090+0000 7fa51f59e700 1 -- 172.21.15.8:0/1965012515 wait complete. 2023-10-18T22:04:13.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.225+0000 7f130d318700 1 -- 172.21.15.8:0/3861055569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13080f6530 msgr2=0x7f13080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:13.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.225+0000 7f130d318700 1 --2- 172.21.15.8:0/3861055569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13080f6530 0x7f13080f6950 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f12f8004660 tx=0x7f12f8009b30).stop 2023-10-18T22:04:13.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.226+0000 7f130d318700 1 -- 172.21.15.8:0/3861055569 shutdown_connections 2023-10-18T22:04:13.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.226+0000 7f130d318700 1 --2- 172.21.15.8:0/3861055569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13080f77d0 0x7f13080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.226+0000 7f130d318700 1 --2- 172.21.15.8:0/3861055569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13080f6530 0x7f13080f6950 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.226+0000 7f130d318700 1 -- 172.21.15.8:0/3861055569 >> 172.21.15.8:0/3861055569 conn(0x7f13080f1c90 msgr2=0x7f13080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:13.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.226+0000 7f130d318700 1 -- 172.21.15.8:0/3861055569 shutdown_connections 2023-10-18T22:04:13.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.226+0000 7f130d318700 1 -- 172.21.15.8:0/3861055569 wait complete. 2023-10-18T22:04:13.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.226+0000 7f130d318700 1 Processor -- start 2023-10-18T22:04:13.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.227+0000 7f130d318700 1 -- start start 2023-10-18T22:04:13.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.227+0000 7f130d318700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13080f6530 0x7f1308108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:13.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.227+0000 7f130d318700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13080f77d0 0x7f13081094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:13.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.227+0000 7f130d318700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1308109a50 con 0x7f13080f6530 2023-10-18T22:04:13.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.227+0000 7f130d318700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1308109b90 con 0x7f13080f77d0 2023-10-18T22:04:13.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.227+0000 7f1307fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13080f6530 0x7f1308108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:13.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.227+0000 7f1307fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13080f6530 0x7f1308108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48246/0 (socket says 172.21.15.8:48246) 2023-10-18T22:04:13.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.227+0000 7f1307fff700 1 -- 172.21.15.8:0/1441217358 learned_addr learned my addr 172.21.15.8:0/1441217358 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:13.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.227+0000 7f13077fe700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13080f77d0 0x7f13081094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:13.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.228+0000 7f1307fff700 1 -- 172.21.15.8:0/1441217358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13080f77d0 msgr2=0x7f13081094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:13.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.228+0000 7f1307fff700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13080f77d0 0x7f13081094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.228+0000 7f1307fff700 1 -- 172.21.15.8:0/1441217358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8005040 con 0x7f13080f6530 2023-10-18T22:04:13.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.228+0000 7f1307fff700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13080f6530 0x7f1308108fb0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f12f8007a60 tx=0x7f12f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:13.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.228+0000 7f1304ff9700 1 -- 172.21.15.8:0/1441217358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12f8018070 con 0x7f13080f6530 2023-10-18T22:04:13.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.228+0000 7f130d318700 1 -- 172.21.15.8:0/1441217358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130810a4d0 con 0x7f13080f6530 2023-10-18T22:04:13.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.228+0000 7f1304ff9700 1 -- 172.21.15.8:0/1441217358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f12f8009630 con 0x7f13080f6530 2023-10-18T22:04:13.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.228+0000 7f1304ff9700 1 -- 172.21.15.8:0/1441217358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12f801c4d0 con 0x7f13080f6530 2023-10-18T22:04:13.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.228+0000 7f130d318700 1 -- 172.21.15.8:0/1441217358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130810aa30 con 0x7f13080f6530 2023-10-18T22:04:13.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.229+0000 7f130d318700 1 -- 172.21.15.8:0/1441217358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1308045ad0 con 0x7f13080f6530 2023-10-18T22:04:13.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.230+0000 7f1304ff9700 1 -- 172.21.15.8:0/1441217358 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f12f801d420 con 0x7f13080f6530 2023-10-18T22:04:13.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.231+0000 7f1304ff9700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12f0060f70 0x7f12f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:13.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.231+0000 7f1304ff9700 1 -- 172.21.15.8:0/1441217358 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f12f807e650 con 0x7f13080f6530 2023-10-18T22:04:13.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.232+0000 7f13077fe700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12f0060f70 0x7f12f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:13.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.232+0000 7f13077fe700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12f0060f70 0x7f12f0063430 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f12fc004c40 tx=0x7f12fc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:13.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.235+0000 7f1304ff9700 1 -- 172.21.15.8:0/1441217358 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f12f8051ca0 con 0x7f13080f6530 2023-10-18T22:04:13.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.487+0000 7f130d318700 1 -- 172.21.15.8:0/1441217358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13080fed90 con 0x7f13080f6530 2023-10-18T22:04:13.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.488+0000 7f1304ff9700 1 -- 172.21.15.8:0/1441217358 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f12f8051890 con 0x7f13080f6530 2023-10-18T22:04:13.490 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:04:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:04:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:04:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:04:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:04:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:04:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:04:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:04:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:04:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:04:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:04:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:04:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:04:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:04:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:04:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:04:13.493 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:04:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.489+0000 7f130d318700 1 -- 172.21.15.8:0/1441217358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12f0060f70 msgr2=0x7f12f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:13.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.489+0000 7f130d318700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12f0060f70 0x7f12f0063430 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f12fc004c40 tx=0x7f12fc00b040).stop 2023-10-18T22:04:13.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.489+0000 7f130d318700 1 -- 172.21.15.8:0/1441217358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13080f6530 msgr2=0x7f1308108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:13.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.489+0000 7f130d318700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13080f6530 0x7f1308108fb0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f12f8007a60 tx=0x7f12f8009b30).stop 2023-10-18T22:04:13.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.490+0000 7f130d318700 1 -- 172.21.15.8:0/1441217358 shutdown_connections 2023-10-18T22:04:13.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.490+0000 7f130d318700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f12f0060f70 0x7f12f0063430 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.490+0000 7f130d318700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13080f6530 0x7f1308108fb0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.490+0000 7f130d318700 1 --2- 172.21.15.8:0/1441217358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13080f77d0 0x7f13081094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.490+0000 7f130d318700 1 -- 172.21.15.8:0/1441217358 >> 172.21.15.8:0/1441217358 conn(0x7f13080f1c90 msgr2=0x7f130806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:13.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.490+0000 7f130d318700 1 -- 172.21.15.8:0/1441217358 shutdown_connections 2023-10-18T22:04:13.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.490+0000 7f130d318700 1 -- 172.21.15.8:0/1441217358 wait complete. 2023-10-18T22:04:13.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.626+0000 7f8ee2659700 1 -- 172.21.15.8:0/2695084992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8edc0f77d0 msgr2=0x7f8edc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:13.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.626+0000 7f8ee2659700 1 --2- 172.21.15.8:0/2695084992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8edc0f77d0 0x7f8edc0f7c30 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f8ecc004660 tx=0x7f8ecc009b30).stop 2023-10-18T22:04:13.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.626+0000 7f8ee2659700 1 -- 172.21.15.8:0/2695084992 shutdown_connections 2023-10-18T22:04:13.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.626+0000 7f8ee2659700 1 --2- 172.21.15.8:0/2695084992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8edc0f77d0 0x7f8edc0f7c30 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.626+0000 7f8ee2659700 1 --2- 172.21.15.8:0/2695084992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8edc0f6530 0x7f8edc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.626+0000 7f8ee2659700 1 -- 172.21.15.8:0/2695084992 >> 172.21.15.8:0/2695084992 conn(0x7f8edc0f1c90 msgr2=0x7f8edc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:13.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.626+0000 7f8ee2659700 1 -- 172.21.15.8:0/2695084992 shutdown_connections 2023-10-18T22:04:13.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.627+0000 7f8ee2659700 1 -- 172.21.15.8:0/2695084992 wait complete. 2023-10-18T22:04:13.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.627+0000 7f8ee2659700 1 Processor -- start 2023-10-18T22:04:13.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.627+0000 7f8ee2659700 1 -- start start 2023-10-18T22:04:13.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.628+0000 7f8ee2659700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8edc0f6530 0x7f8edc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:13.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.628+0000 7f8ee2659700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8edc0f77d0 0x7f8edc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:13.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.628+0000 7f8ee2659700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc10a920 con 0x7f8edc0f6530 2023-10-18T22:04:13.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.628+0000 7f8ee2659700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc10aa60 con 0x7f8edc0f77d0 2023-10-18T22:04:13.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.628+0000 7f8ee1657700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8edc0f6530 0x7f8edc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:13.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.628+0000 7f8ee1657700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8edc0f6530 0x7f8edc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48264/0 (socket says 172.21.15.8:48264) 2023-10-18T22:04:13.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.628+0000 7f8ee1657700 1 -- 172.21.15.8:0/2983023836 learned_addr learned my addr 172.21.15.8:0/2983023836 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:13.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.628+0000 7f8ee0e56700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8edc0f77d0 0x7f8edc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:13.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.629+0000 7f8ee1657700 1 -- 172.21.15.8:0/2983023836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8edc0f77d0 msgr2=0x7f8edc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:13.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.629+0000 7f8ee1657700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8edc0f77d0 0x7f8edc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.629+0000 7f8ee1657700 1 -- 172.21.15.8:0/2983023836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc005040 con 0x7f8edc0f6530 2023-10-18T22:04:13.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.629+0000 7f8ee1657700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8edc0f6530 0x7f8edc06b9a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f8ed800e7c0 tx=0x7f8ed800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:13.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.629+0000 7f8ed1ffb700 1 -- 172.21.15.8:0/2983023836 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed80092e0 con 0x7f8edc0f6530 2023-10-18T22:04:13.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.629+0000 7f8ed1ffb700 1 -- 172.21.15.8:0/2983023836 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8ed800f040 con 0x7f8edc0f6530 2023-10-18T22:04:13.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.629+0000 7f8ed1ffb700 1 -- 172.21.15.8:0/2983023836 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed8014810 con 0x7f8edc0f6530 2023-10-18T22:04:13.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.629+0000 7f8ee2659700 1 -- 172.21.15.8:0/2983023836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc06a3d0 con 0x7f8edc0f6530 2023-10-18T22:04:13.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.629+0000 7f8ee2659700 1 -- 172.21.15.8:0/2983023836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc06a910 con 0x7f8edc0f6530 2023-10-18T22:04:13.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.630+0000 7f8ee2659700 1 -- 172.21.15.8:0/2983023836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc045ad0 con 0x7f8edc0f6530 2023-10-18T22:04:13.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.631+0000 7f8ed1ffb700 1 -- 172.21.15.8:0/2983023836 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8ed801b030 con 0x7f8edc0f6530 2023-10-18T22:04:13.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.632+0000 7f8ed1ffb700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec8060f70 0x7f8ec8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:13.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.632+0000 7f8ed1ffb700 1 -- 172.21.15.8:0/2983023836 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8ed807c880 con 0x7f8edc0f6530 2023-10-18T22:04:13.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.632+0000 7f8ee0e56700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec8060f70 0x7f8ec8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:13.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.633+0000 7f8ee0e56700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec8060f70 0x7f8ec8063430 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f8ecc005010 tx=0x7f8ecc016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:13.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.636+0000 7f8ed1ffb700 1 -- 172.21.15.8:0/2983023836 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8ed804c430 con 0x7f8edc0f6530 2023-10-18T22:04:13.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.866+0000 7f8ee2659700 1 -- 172.21.15.8:0/2983023836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8edc0fecc0 con 0x7f8edc0f6530 2023-10-18T22:04:13.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.866+0000 7f8ed1ffb700 1 -- 172.21.15.8:0/2983023836 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f8ed8019030 con 0x7f8edc0f6530 2023-10-18T22:04:13.869 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:04:13.869 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:04:13.869 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:04:13.869 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:04:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:04:13.870 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:04:13.870 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:04:13.870 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:04:13.870 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:04:13.870 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:04:13.871 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:04:13.871 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:04:13.871 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:04:13.871 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:04:13.871 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:04:13.872 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:04:13.872 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:04:13.872 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:04:13.872 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:04:13.872 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:04:13.873 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:04:13.873 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:04:13.873 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:04:13.873 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:04:13.873 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:04:13.874 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:04:13.874 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:04:13.874 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:04:13.874 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:04:13.874 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:04:13.874 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:04:13.875 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:04:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:04:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:04:13.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 -- 172.21.15.8:0/2983023836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec8060f70 msgr2=0x7f8ec8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:13.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec8060f70 0x7f8ec8063430 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f8ecc005010 tx=0x7f8ecc016040).stop 2023-10-18T22:04:13.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 -- 172.21.15.8:0/2983023836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8edc0f6530 msgr2=0x7f8edc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:13.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8edc0f6530 0x7f8edc06b9a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f8ed800e7c0 tx=0x7f8ed800b040).stop 2023-10-18T22:04:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 -- 172.21.15.8:0/2983023836 shutdown_connections 2023-10-18T22:04:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec8060f70 0x7f8ec8063430 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8edc0f6530 0x7f8edc06b9a0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 --2- 172.21.15.8:0/2983023836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8edc0f77d0 0x7f8edc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 -- 172.21.15.8:0/2983023836 >> 172.21.15.8:0/2983023836 conn(0x7f8edc0f1c90 msgr2=0x7f8edc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 -- 172.21.15.8:0/2983023836 shutdown_connections 2023-10-18T22:04:13.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:13.868+0000 7f8ee2659700 1 -- 172.21.15.8:0/2983023836 wait complete. 2023-10-18T22:04:13.878 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:04:14.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.005+0000 7f65b359e700 1 -- 172.21.15.8:0/194604390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b40f6530 msgr2=0x7f65b40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:14.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.005+0000 7f65b359e700 1 --2- 172.21.15.8:0/194604390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b40f6530 0x7f65b40f6950 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f65a4004660 tx=0x7f65a4009b30).stop 2023-10-18T22:04:14.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.005+0000 7f65b359e700 1 -- 172.21.15.8:0/194604390 shutdown_connections 2023-10-18T22:04:14.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.005+0000 7f65b359e700 1 --2- 172.21.15.8:0/194604390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40f77d0 0x7f65b40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:14.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.005+0000 7f65b359e700 1 --2- 172.21.15.8:0/194604390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b40f6530 0x7f65b40f6950 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:14.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.005+0000 7f65b359e700 1 -- 172.21.15.8:0/194604390 >> 172.21.15.8:0/194604390 conn(0x7f65b40f1c90 msgr2=0x7f65b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:14.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.005+0000 7f65b359e700 1 -- 172.21.15.8:0/194604390 shutdown_connections 2023-10-18T22:04:14.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.005+0000 7f65b359e700 1 -- 172.21.15.8:0/194604390 wait complete. 2023-10-18T22:04:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.006+0000 7f65b359e700 1 Processor -- start 2023-10-18T22:04:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.006+0000 7f65b359e700 1 -- start start 2023-10-18T22:04:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.006+0000 7f65b359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b40f6530 0x7f65b4108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.006+0000 7f65b359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40f77d0 0x7f65b4109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.006+0000 7f65b359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b41099e0 con 0x7f65b40f6530 2023-10-18T22:04:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.006+0000 7f65b359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b4109b20 con 0x7f65b40f77d0 2023-10-18T22:04:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.006+0000 7f65b259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b40f6530 0x7f65b4108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.006+0000 7f65b259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b40f6530 0x7f65b4108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48288/0 (socket says 172.21.15.8:48288) 2023-10-18T22:04:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.006+0000 7f65b259c700 1 -- 172.21.15.8:0/489719455 learned_addr learned my addr 172.21.15.8:0/489719455 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:14.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.006+0000 7f65b1d9b700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40f77d0 0x7f65b4109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:14.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.007+0000 7f65b259c700 1 -- 172.21.15.8:0/489719455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40f77d0 msgr2=0x7f65b4109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:14.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.007+0000 7f65b259c700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40f77d0 0x7f65b4109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:14.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.007+0000 7f65b259c700 1 -- 172.21.15.8:0/489719455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a4005040 con 0x7f65b40f6530 2023-10-18T22:04:14.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.007+0000 7f65b259c700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b40f6530 0x7f65b4108f40 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f65a4004e30 tx=0x7f65a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:14.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.007+0000 7f65a2ffd700 1 -- 172.21.15.8:0/489719455 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a4018070 con 0x7f65b40f6530 2023-10-18T22:04:14.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.007+0000 7f65b359e700 1 -- 172.21.15.8:0/489719455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b410a460 con 0x7f65b40f6530 2023-10-18T22:04:14.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.007+0000 7f65a2ffd700 1 -- 172.21.15.8:0/489719455 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f65a4009630 con 0x7f65b40f6530 2023-10-18T22:04:14.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.007+0000 7f65b359e700 1 -- 172.21.15.8:0/489719455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b410a9c0 con 0x7f65b40f6530 2023-10-18T22:04:14.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.008+0000 7f65a2ffd700 1 -- 172.21.15.8:0/489719455 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a401c3c0 con 0x7f65b40f6530 2023-10-18T22:04:14.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.009+0000 7f65b359e700 1 -- 172.21.15.8:0/489719455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b4045ad0 con 0x7f65b40f6530 2023-10-18T22:04:14.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.009+0000 7f65a2ffd700 1 -- 172.21.15.8:0/489719455 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f65a401d420 con 0x7f65b40f6530 2023-10-18T22:04:14.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.010+0000 7f65a2ffd700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f659c060f70 0x7f659c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:14.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.010+0000 7f65a2ffd700 1 -- 172.21.15.8:0/489719455 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f65a407e4e0 con 0x7f65b40f6530 2023-10-18T22:04:14.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.011+0000 7f65b1d9b700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f659c060f70 0x7f659c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:14.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.011+0000 7f65b1d9b700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f659c060f70 0x7f659c063430 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f65a8004ce0 tx=0x7f65a800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:14.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.016+0000 7f65a2ffd700 1 -- 172.21.15.8:0/489719455 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f65a4051b00 con 0x7f65b40f6530 2023-10-18T22:04:14.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.215+0000 7f65b359e700 1 -- 172.21.15.8:0/489719455 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65b40fee40 con 0x7f659c060f70 2023-10-18T22:04:14.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.216+0000 7f65a2ffd700 1 -- 172.21.15.8:0/489719455 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f65b40fee40 con 0x7f659c060f70 2023-10-18T22:04:14.218 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:04:14.218 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:04:14.219 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:04:14.219 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:04:14.219 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:04:14.219 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:04:14.219 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:04:14.219 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:04:14.220 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:04:14.220 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:04:14.220 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:04:14.220 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:04:14.220 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:04:14.220 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:04:14.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 -- 172.21.15.8:0/489719455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f659c060f70 msgr2=0x7f659c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:14.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f659c060f70 0x7f659c063430 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f65a8004ce0 tx=0x7f65a800b040).stop 2023-10-18T22:04:14.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 -- 172.21.15.8:0/489719455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b40f6530 msgr2=0x7f65b4108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:14.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b40f6530 0x7f65b4108f40 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f65a4004e30 tx=0x7f65a4009b30).stop 2023-10-18T22:04:14.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 -- 172.21.15.8:0/489719455 shutdown_connections 2023-10-18T22:04:14.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f659c060f70 0x7f659c063430 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:14.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b40f6530 0x7f65b4108f40 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:14.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 --2- 172.21.15.8:0/489719455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40f77d0 0x7f65b4109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:14.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 -- 172.21.15.8:0/489719455 >> 172.21.15.8:0/489719455 conn(0x7f65b40f1c90 msgr2=0x7f65b406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:14.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 -- 172.21.15.8:0/489719455 shutdown_connections 2023-10-18T22:04:14.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:14.218+0000 7f65b359e700 1 -- 172.21.15.8:0/489719455 wait complete. 2023-10-18T22:04:14.345 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:12.387942+0000 mgr.smithi008.flmjzp (mgr.14640) 3918 : audit [DBG] from='client.37192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:14.345 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:12.531383+0000 mgr.smithi008.flmjzp (mgr.14640) 3919 : cluster [DBG] pgmap v2692: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:14.345 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:12.735574+0000 mgr.smithi008.flmjzp (mgr.14640) 3920 : audit [DBG] from='client.37196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:14.345 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:13.080383+0000 mgr.smithi008.flmjzp (mgr.14640) 3921 : audit [DBG] from='client.37200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:14.345 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:13.489261+0000 mon.smithi008 (mon.0) 4249 : audit [DBG] from='client.? 172.21.15.8:0/1441217358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:14.346 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:13.867720+0000 mon.smithi008 (mon.0) 4250 : audit [DBG] from='client.? 172.21.15.8:0/2983023836' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:04:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:12.387942+0000 mgr.smithi008.flmjzp (mgr.14640) 3918 : audit [DBG] from='client.37192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:12.531383+0000 mgr.smithi008.flmjzp (mgr.14640) 3919 : cluster [DBG] pgmap v2692: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:12.735574+0000 mgr.smithi008.flmjzp (mgr.14640) 3920 : audit [DBG] from='client.37196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:13.080383+0000 mgr.smithi008.flmjzp (mgr.14640) 3921 : audit [DBG] from='client.37200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:13.489261+0000 mon.smithi008 (mon.0) 4249 : audit [DBG] from='client.? 172.21.15.8:0/1441217358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:13.867720+0000 mon.smithi008 (mon.0) 4250 : audit [DBG] from='client.? 172.21.15.8:0/2983023836' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:04:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:14.217207+0000 mgr.smithi008.flmjzp (mgr.14640) 3922 : audit [DBG] from='client.37212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:15.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:14.217207+0000 mgr.smithi008.flmjzp (mgr.14640) 3922 : audit [DBG] from='client.37212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:14.531943+0000 mgr.smithi008.flmjzp (mgr.14640) 3923 : cluster [DBG] pgmap v2693: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:16.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:14.531943+0000 mgr.smithi008.flmjzp (mgr.14640) 3923 : cluster [DBG] pgmap v2693: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:18.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:16.532559+0000 mgr.smithi008.flmjzp (mgr.14640) 3924 : cluster [DBG] pgmap v2694: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:16.532559+0000 mgr.smithi008.flmjzp (mgr.14640) 3924 : cluster [DBG] pgmap v2694: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:18.563762+0000 mon.smithi008 (mon.0) 4251 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:18.565968+0000 mon.smithi008 (mon.0) 4252 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:04:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:18.567022+0000 mon.smithi008 (mon.0) 4253 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:04:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:18.573508+0000 mon.smithi008 (mon.0) 4254 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:04:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:18.579963+0000 mon.smithi008 (mon.0) 4255 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:18.583046+0000 mon.smithi008 (mon.0) 4256 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:19.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:18.584729+0000 mon.smithi008 (mon.0) 4257 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:19.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:18.586386+0000 mon.smithi008 (mon.0) 4258 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:19.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:18.588358+0000 mon.smithi008 (mon.0) 4259 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:18.563762+0000 mon.smithi008 (mon.0) 4251 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:18.565968+0000 mon.smithi008 (mon.0) 4252 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:04:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:18.567022+0000 mon.smithi008 (mon.0) 4253 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:04:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:18.573508+0000 mon.smithi008 (mon.0) 4254 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:04:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:18.579963+0000 mon.smithi008 (mon.0) 4255 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:18.583046+0000 mon.smithi008 (mon.0) 4256 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:18.584729+0000 mon.smithi008 (mon.0) 4257 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:19.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:18.586386+0000 mon.smithi008 (mon.0) 4258 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:19.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:18.588358+0000 mon.smithi008 (mon.0) 4259 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:18.533217+0000 mgr.smithi008.flmjzp (mgr.14640) 3925 : cluster [DBG] pgmap v2695: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:18.567927+0000 mgr.smithi008.flmjzp (mgr.14640) 3926 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:18.568558+0000 mgr.smithi008.flmjzp (mgr.14640) 3927 : cluster [DBG] pgmap v2696: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:18.568882+0000 mgr.smithi008.flmjzp (mgr.14640) 3928 : cluster [DBG] pgmap v2697: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:18.590224+0000 mgr.smithi008.flmjzp (mgr.14640) 3929 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:18.533217+0000 mgr.smithi008.flmjzp (mgr.14640) 3925 : cluster [DBG] pgmap v2695: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:18.567927+0000 mgr.smithi008.flmjzp (mgr.14640) 3926 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:18.568558+0000 mgr.smithi008.flmjzp (mgr.14640) 3927 : cluster [DBG] pgmap v2696: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:18.568882+0000 mgr.smithi008.flmjzp (mgr.14640) 3928 : cluster [DBG] pgmap v2697: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:18.590224+0000 mgr.smithi008.flmjzp (mgr.14640) 3929 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:22.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:20.569603+0000 mgr.smithi008.flmjzp (mgr.14640) 3930 : cluster [DBG] pgmap v2698: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:20.569603+0000 mgr.smithi008.flmjzp (mgr.14640) 3930 : cluster [DBG] pgmap v2698: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:24.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:22.570274+0000 mgr.smithi008.flmjzp (mgr.14640) 3931 : cluster [DBG] pgmap v2699: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:22.570274+0000 mgr.smithi008.flmjzp (mgr.14640) 3931 : cluster [DBG] pgmap v2699: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:24.570879+0000 mgr.smithi008.flmjzp (mgr.14640) 3932 : cluster [DBG] pgmap v2700: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:24.570879+0000 mgr.smithi008.flmjzp (mgr.14640) 3932 : cluster [DBG] pgmap v2700: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:28.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:26.571660+0000 mgr.smithi008.flmjzp (mgr.14640) 3933 : cluster [DBG] pgmap v2701: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:28.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:26.571660+0000 mgr.smithi008.flmjzp (mgr.14640) 3933 : cluster [DBG] pgmap v2701: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:28.600877+0000 mon.smithi008 (mon.0) 4260 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:28.603059+0000 mon.smithi008 (mon.0) 4261 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:04:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:28.604137+0000 mon.smithi008 (mon.0) 4262 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:04:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:28.610817+0000 mon.smithi008 (mon.0) 4263 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:04:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:28.617148+0000 mon.smithi008 (mon.0) 4264 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:29.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:28.620291+0000 mon.smithi008 (mon.0) 4265 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:29.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:28.622317+0000 mon.smithi008 (mon.0) 4266 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:29.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:28.624329+0000 mon.smithi008 (mon.0) 4267 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:29.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:28.626745+0000 mon.smithi008 (mon.0) 4268 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:28.600877+0000 mon.smithi008 (mon.0) 4260 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:28.603059+0000 mon.smithi008 (mon.0) 4261 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:04:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:28.604137+0000 mon.smithi008 (mon.0) 4262 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:04:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:28.610817+0000 mon.smithi008 (mon.0) 4263 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:04:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:28.617148+0000 mon.smithi008 (mon.0) 4264 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:28.620291+0000 mon.smithi008 (mon.0) 4265 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:28.622317+0000 mon.smithi008 (mon.0) 4266 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:29.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:28.624329+0000 mon.smithi008 (mon.0) 4267 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:29.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:28.626745+0000 mon.smithi008 (mon.0) 4268 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:28.572295+0000 mgr.smithi008.flmjzp (mgr.14640) 3934 : cluster [DBG] pgmap v2702: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:28.605056+0000 mgr.smithi008.flmjzp (mgr.14640) 3935 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:28.605733+0000 mgr.smithi008.flmjzp (mgr.14640) 3936 : cluster [DBG] pgmap v2703: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:28.606070+0000 mgr.smithi008.flmjzp (mgr.14640) 3937 : cluster [DBG] pgmap v2704: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:28.628690+0000 mgr.smithi008.flmjzp (mgr.14640) 3938 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:28.572295+0000 mgr.smithi008.flmjzp (mgr.14640) 3934 : cluster [DBG] pgmap v2702: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:28.605056+0000 mgr.smithi008.flmjzp (mgr.14640) 3935 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:28.605733+0000 mgr.smithi008.flmjzp (mgr.14640) 3936 : cluster [DBG] pgmap v2703: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:28.606070+0000 mgr.smithi008.flmjzp (mgr.14640) 3937 : cluster [DBG] pgmap v2704: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:28.628690+0000 mgr.smithi008.flmjzp (mgr.14640) 3938 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:32.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:30.606644+0000 mgr.smithi008.flmjzp (mgr.14640) 3939 : cluster [DBG] pgmap v2705: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:30.606644+0000 mgr.smithi008.flmjzp (mgr.14640) 3939 : cluster [DBG] pgmap v2705: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:34.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:32.607243+0000 mgr.smithi008.flmjzp (mgr.14640) 3940 : cluster [DBG] pgmap v2706: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:32.607243+0000 mgr.smithi008.flmjzp (mgr.14640) 3940 : cluster [DBG] pgmap v2706: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:34.607907+0000 mgr.smithi008.flmjzp (mgr.14640) 3941 : cluster [DBG] pgmap v2707: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:34.607907+0000 mgr.smithi008.flmjzp (mgr.14640) 3941 : cluster [DBG] pgmap v2707: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:38.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:36.608488+0000 mgr.smithi008.flmjzp (mgr.14640) 3942 : cluster [DBG] pgmap v2708: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:38.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:36.608488+0000 mgr.smithi008.flmjzp (mgr.14640) 3942 : cluster [DBG] pgmap v2708: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:38.639373+0000 mon.smithi008 (mon.0) 4269 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:38.639373+0000 mon.smithi008 (mon.0) 4269 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:38.609121+0000 mgr.smithi008.flmjzp (mgr.14640) 3943 : cluster [DBG] pgmap v2709: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:39.198116+0000 mon.smithi008 (mon.0) 4270 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:04:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:39.198938+0000 mon.smithi008 (mon.0) 4271 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:04:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:39.199582+0000 mgr.smithi008.flmjzp (mgr.14640) 3944 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:39.200136+0000 mgr.smithi008.flmjzp (mgr.14640) 3945 : cluster [DBG] pgmap v2710: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:40.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:39.200401+0000 mgr.smithi008.flmjzp (mgr.14640) 3946 : cluster [DBG] pgmap v2711: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:40.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:39.204170+0000 mon.smithi008 (mon.0) 4272 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:04:40.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:39.209203+0000 mon.smithi008 (mon.0) 4273 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:40.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:39.211520+0000 mon.smithi008 (mon.0) 4274 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:40.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:39.212761+0000 mon.smithi008 (mon.0) 4275 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:40.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:39.213969+0000 mon.smithi008 (mon.0) 4276 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:40.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:39.215499+0000 mon.smithi008 (mon.0) 4277 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:40.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:39.217022+0000 mgr.smithi008.flmjzp (mgr.14640) 3947 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:38.609121+0000 mgr.smithi008.flmjzp (mgr.14640) 3943 : cluster [DBG] pgmap v2709: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:39.198116+0000 mon.smithi008 (mon.0) 4270 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:04:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:39.198938+0000 mon.smithi008 (mon.0) 4271 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:04:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:39.199582+0000 mgr.smithi008.flmjzp (mgr.14640) 3944 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:39.200136+0000 mgr.smithi008.flmjzp (mgr.14640) 3945 : cluster [DBG] pgmap v2710: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:39.200401+0000 mgr.smithi008.flmjzp (mgr.14640) 3946 : cluster [DBG] pgmap v2711: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:39.204170+0000 mon.smithi008 (mon.0) 4272 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:04:40.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:39.209203+0000 mon.smithi008 (mon.0) 4273 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:40.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:39.211520+0000 mon.smithi008 (mon.0) 4274 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:40.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:39.212761+0000 mon.smithi008 (mon.0) 4275 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:40.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:39.213969+0000 mon.smithi008 (mon.0) 4276 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:40.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:39.215499+0000 mon.smithi008 (mon.0) 4277 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:40.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:39.217022+0000 mgr.smithi008.flmjzp (mgr.14640) 3947 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:42.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:41.201141+0000 mgr.smithi008.flmjzp (mgr.14640) 3948 : cluster [DBG] pgmap v2712: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:41.201141+0000 mgr.smithi008.flmjzp (mgr.14640) 3948 : cluster [DBG] pgmap v2712: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:44.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.374+0000 7f9966cbf700 1 -- 172.21.15.8:0/811091288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99600f6530 msgr2=0x7f99600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:44.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.374+0000 7f9966cbf700 1 --2- 172.21.15.8:0/811091288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99600f6530 0x7f99600f6950 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f995c004660 tx=0x7f995c009b30).stop 2023-10-18T22:04:44.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.374+0000 7f9966cbf700 1 -- 172.21.15.8:0/811091288 shutdown_connections 2023-10-18T22:04:44.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.374+0000 7f9966cbf700 1 --2- 172.21.15.8:0/811091288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99600f77d0 0x7f99600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.374+0000 7f9966cbf700 1 --2- 172.21.15.8:0/811091288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99600f6530 0x7f99600f6950 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.374+0000 7f9966cbf700 1 -- 172.21.15.8:0/811091288 >> 172.21.15.8:0/811091288 conn(0x7f99600f1c90 msgr2=0x7f99600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:44.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.374+0000 7f9966cbf700 1 -- 172.21.15.8:0/811091288 shutdown_connections 2023-10-18T22:04:44.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.374+0000 7f9966cbf700 1 -- 172.21.15.8:0/811091288 wait complete. 2023-10-18T22:04:44.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.375+0000 7f9966cbf700 1 Processor -- start 2023-10-18T22:04:44.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.375+0000 7f9966cbf700 1 -- start start 2023-10-18T22:04:44.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.375+0000 7f9966cbf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99600f6530 0x7f996006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:44.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.375+0000 7f9966cbf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99600f77d0 0x7f9960069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:44.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.375+0000 7f9966cbf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996006a380 con 0x7f99600f77d0 2023-10-18T22:04:44.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.375+0000 7f9966cbf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996006a4c0 con 0x7f99600f6530 2023-10-18T22:04:44.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.376+0000 7f99654bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99600f77d0 0x7f9960069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:44.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.376+0000 7f99654bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99600f77d0 0x7f9960069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45090/0 (socket says 172.21.15.8:45090) 2023-10-18T22:04:44.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.376+0000 7f99654bc700 1 -- 172.21.15.8:0/377861141 learned_addr learned my addr 172.21.15.8:0/377861141 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:44.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.376+0000 7f9965cbd700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99600f6530 0x7f996006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:44.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.376+0000 7f99654bc700 1 -- 172.21.15.8:0/377861141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99600f6530 msgr2=0x7f996006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:44.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.376+0000 7f99654bc700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99600f6530 0x7f996006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.376+0000 7f99654bc700 1 -- 172.21.15.8:0/377861141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c005040 con 0x7f99600f77d0 2023-10-18T22:04:44.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.376+0000 7f99654bc700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99600f77d0 0x7f9960069e20 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f995000e7f0 tx=0x7f995000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:44.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.376+0000 7f99567fc700 1 -- 172.21.15.8:0/377861141 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99500092e0 con 0x7f99600f77d0 2023-10-18T22:04:44.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.377+0000 7f99567fc700 1 -- 172.21.15.8:0/377861141 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f995000f040 con 0x7f99600f77d0 2023-10-18T22:04:44.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.377+0000 7f99567fc700 1 -- 172.21.15.8:0/377861141 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99500147e0 con 0x7f99600f77d0 2023-10-18T22:04:44.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.377+0000 7f9966cbf700 1 -- 172.21.15.8:0/377861141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996006a7a0 con 0x7f99600f77d0 2023-10-18T22:04:44.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.377+0000 7f9966cbf700 1 -- 172.21.15.8:0/377861141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996010ed70 con 0x7f99600f77d0 2023-10-18T22:04:44.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.378+0000 7f9966cbf700 1 -- 172.21.15.8:0/377861141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9960045ad0 con 0x7f99600f77d0 2023-10-18T22:04:44.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.379+0000 7f99567fc700 1 -- 172.21.15.8:0/377861141 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f995001b030 con 0x7f99600f77d0 2023-10-18T22:04:44.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.380+0000 7f99567fc700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f994c060f70 0x7f994c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:44.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.380+0000 7f99567fc700 1 -- 172.21.15.8:0/377861141 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f995007c6b0 con 0x7f99600f77d0 2023-10-18T22:04:44.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.380+0000 7f9965cbd700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f994c060f70 0x7f994c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:44.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.380+0000 7f9965cbd700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f994c060f70 0x7f994c063430 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f995c005010 tx=0x7f995c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:44.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.384+0000 7f99567fc700 1 -- 172.21.15.8:0/377861141 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f995004c310 con 0x7f99600f77d0 2023-10-18T22:04:44.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.584+0000 7f9966cbf700 1 -- 172.21.15.8:0/377861141 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9960057f10 con 0x7f994c060f70 2023-10-18T22:04:44.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.585+0000 7f99567fc700 1 -- 172.21.15.8:0/377861141 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9960057f10 con 0x7f994c060f70 2023-10-18T22:04:44.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.587+0000 7f9966cbf700 1 -- 172.21.15.8:0/377861141 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f994c060f70 msgr2=0x7f994c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:44.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.587+0000 7f9966cbf700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f994c060f70 0x7f994c063430 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f995c005010 tx=0x7f995c016040).stop 2023-10-18T22:04:44.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.587+0000 7f9966cbf700 1 -- 172.21.15.8:0/377861141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99600f77d0 msgr2=0x7f9960069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:44.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.587+0000 7f9966cbf700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99600f77d0 0x7f9960069e20 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f995000e7f0 tx=0x7f995000b040).stop 2023-10-18T22:04:44.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.588+0000 7f9966cbf700 1 -- 172.21.15.8:0/377861141 shutdown_connections 2023-10-18T22:04:44.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.588+0000 7f9966cbf700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f994c060f70 0x7f994c063430 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.588+0000 7f9966cbf700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99600f6530 0x7f996006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.588+0000 7f9966cbf700 1 --2- 172.21.15.8:0/377861141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99600f77d0 0x7f9960069e20 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.588+0000 7f9966cbf700 1 -- 172.21.15.8:0/377861141 >> 172.21.15.8:0/377861141 conn(0x7f99600f1c90 msgr2=0x7f99600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:44.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.588+0000 7f9966cbf700 1 -- 172.21.15.8:0/377861141 shutdown_connections 2023-10-18T22:04:44.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.588+0000 7f9966cbf700 1 -- 172.21.15.8:0/377861141 wait complete. 2023-10-18T22:04:44.605 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:04:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:43.201883+0000 mgr.smithi008.flmjzp (mgr.14640) 3949 : cluster [DBG] pgmap v2713: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:44.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.725+0000 7f32fd637700 1 -- 172.21.15.8:0/2897676886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f80f77d0 msgr2=0x7f32f80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:44.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.725+0000 7f32fd637700 1 --2- 172.21.15.8:0/2897676886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f80f77d0 0x7f32f80f7c30 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f32ec004660 tx=0x7f32ec009b30).stop 2023-10-18T22:04:44.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.726+0000 7f32fd637700 1 -- 172.21.15.8:0/2897676886 shutdown_connections 2023-10-18T22:04:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.726+0000 7f32fd637700 1 --2- 172.21.15.8:0/2897676886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f80f77d0 0x7f32f80f7c30 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.726+0000 7f32fd637700 1 --2- 172.21.15.8:0/2897676886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32f80f6530 0x7f32f80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.726+0000 7f32fd637700 1 -- 172.21.15.8:0/2897676886 >> 172.21.15.8:0/2897676886 conn(0x7f32f80f1c90 msgr2=0x7f32f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.726+0000 7f32fd637700 1 -- 172.21.15.8:0/2897676886 shutdown_connections 2023-10-18T22:04:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.726+0000 7f32fd637700 1 -- 172.21.15.8:0/2897676886 wait complete. 2023-10-18T22:04:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.726+0000 7f32fd637700 1 Processor -- start 2023-10-18T22:04:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.727+0000 7f32fd637700 1 -- start start 2023-10-18T22:04:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.727+0000 7f32fd637700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f80f6530 0x7f32f806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.727+0000 7f32fd637700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32f80f77d0 0x7f32f8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.727+0000 7f32fd637700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f806a380 con 0x7f32f80f6530 2023-10-18T22:04:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.727+0000 7f32fd637700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f806a4c0 con 0x7f32f80f77d0 2023-10-18T22:04:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.727+0000 7f32f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f80f6530 0x7f32f806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.727+0000 7f32f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f80f6530 0x7f32f806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45104/0 (socket says 172.21.15.8:45104) 2023-10-18T22:04:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.727+0000 7f32f7fff700 1 -- 172.21.15.8:0/2869571286 learned_addr learned my addr 172.21.15.8:0/2869571286 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.727+0000 7f32f77fe700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32f80f77d0 0x7f32f8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.728+0000 7f32f7fff700 1 -- 172.21.15.8:0/2869571286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32f80f77d0 msgr2=0x7f32f8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.728+0000 7f32f7fff700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32f80f77d0 0x7f32f8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.728+0000 7f32f7fff700 1 -- 172.21.15.8:0/2869571286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec005040 con 0x7f32f80f6530 2023-10-18T22:04:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.728+0000 7f32f7fff700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f80f6530 0x7f32f806b9a0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f32e800e7c0 tx=0x7f32e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.728+0000 7f32f4ff9700 1 -- 172.21.15.8:0/2869571286 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32e80092e0 con 0x7f32f80f6530 2023-10-18T22:04:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.728+0000 7f32f4ff9700 1 -- 172.21.15.8:0/2869571286 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f32e800f040 con 0x7f32f80f6530 2023-10-18T22:04:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.728+0000 7f32fd637700 1 -- 172.21.15.8:0/2869571286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f806a7a0 con 0x7f32f80f6530 2023-10-18T22:04:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.728+0000 7f32f4ff9700 1 -- 172.21.15.8:0/2869571286 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32e80147e0 con 0x7f32f80f6530 2023-10-18T22:04:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.728+0000 7f32fd637700 1 -- 172.21.15.8:0/2869571286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f810ed20 con 0x7f32f80f6530 2023-10-18T22:04:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.729+0000 7f32fd637700 1 -- 172.21.15.8:0/2869571286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f8045ad0 con 0x7f32f80f6530 2023-10-18T22:04:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.730+0000 7f32f4ff9700 1 -- 172.21.15.8:0/2869571286 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f32e801b030 con 0x7f32f80f6530 2023-10-18T22:04:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.731+0000 7f32f4ff9700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e0060f70 0x7f32e0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.731+0000 7f32f4ff9700 1 -- 172.21.15.8:0/2869571286 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f32e807c990 con 0x7f32f80f6530 2023-10-18T22:04:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.731+0000 7f32f77fe700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e0060f70 0x7f32e0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.732+0000 7f32f77fe700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e0060f70 0x7f32e0063430 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f32ec009720 tx=0x7f32ec00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:43.201883+0000 mgr.smithi008.flmjzp (mgr.14640) 3949 : cluster [DBG] pgmap v2713: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.735+0000 7f32f4ff9700 1 -- 172.21.15.8:0/2869571286 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f32e804c4e0 con 0x7f32f80f6530 2023-10-18T22:04:44.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.934+0000 7f32fd637700 1 -- 172.21.15.8:0/2869571286 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32f80fee30 con 0x7f32e0060f70 2023-10-18T22:04:44.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.936+0000 7f32f4ff9700 1 -- 172.21.15.8:0/2869571286 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f32f80fee30 con 0x7f32e0060f70 2023-10-18T22:04:44.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 -- 172.21.15.8:0/2869571286 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e0060f70 msgr2=0x7f32e0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:44.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e0060f70 0x7f32e0063430 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f32ec009720 tx=0x7f32ec00b040).stop 2023-10-18T22:04:44.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 -- 172.21.15.8:0/2869571286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f80f6530 msgr2=0x7f32f806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:44.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f80f6530 0x7f32f806b9a0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f32e800e7c0 tx=0x7f32e800b040).stop 2023-10-18T22:04:44.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 -- 172.21.15.8:0/2869571286 shutdown_connections 2023-10-18T22:04:44.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32e0060f70 0x7f32e0063430 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f80f6530 0x7f32f806b9a0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 --2- 172.21.15.8:0/2869571286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32f80f77d0 0x7f32f8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:44.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 -- 172.21.15.8:0/2869571286 >> 172.21.15.8:0/2869571286 conn(0x7f32f80f1c90 msgr2=0x7f32f80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:44.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 -- 172.21.15.8:0/2869571286 shutdown_connections 2023-10-18T22:04:44.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:44.938+0000 7f32fd637700 1 -- 172.21.15.8:0/2869571286 wait complete. 2023-10-18T22:04:45.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.075+0000 7f243d4c9700 1 -- 172.21.15.8:0/3419094740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24380f64b0 msgr2=0x7f24380f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:45.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.075+0000 7f243d4c9700 1 --2- 172.21.15.8:0/3419094740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24380f64b0 0x7f24380f68d0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f2428004660 tx=0x7f2428009b30).stop 2023-10-18T22:04:45.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.076+0000 7f243d4c9700 1 -- 172.21.15.8:0/3419094740 shutdown_connections 2023-10-18T22:04:45.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.076+0000 7f243d4c9700 1 --2- 172.21.15.8:0/3419094740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24380f7750 0x7f24380f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.076+0000 7f243d4c9700 1 --2- 172.21.15.8:0/3419094740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24380f64b0 0x7f24380f68d0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.076+0000 7f243d4c9700 1 -- 172.21.15.8:0/3419094740 >> 172.21.15.8:0/3419094740 conn(0x7f24380f1c30 msgr2=0x7f24380f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:45.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.076+0000 7f243d4c9700 1 -- 172.21.15.8:0/3419094740 shutdown_connections 2023-10-18T22:04:45.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.076+0000 7f243d4c9700 1 -- 172.21.15.8:0/3419094740 wait complete. 2023-10-18T22:04:45.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f243d4c9700 1 Processor -- start 2023-10-18T22:04:45.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f243d4c9700 1 -- start start 2023-10-18T22:04:45.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f243d4c9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24380f64b0 0x7f2438108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:45.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f243d4c9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24380f7750 0x7f24381093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:45.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f243d4c9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438109980 con 0x7f24380f7750 2023-10-18T22:04:45.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f243d4c9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438109ac0 con 0x7f24380f64b0 2023-10-18T22:04:45.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f24377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24380f7750 0x7f24381093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:45.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f24377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24380f7750 0x7f24381093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45124/0 (socket says 172.21.15.8:45124) 2023-10-18T22:04:45.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f24377fe700 1 -- 172.21.15.8:0/2837652293 learned_addr learned my addr 172.21.15.8:0/2837652293 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:45.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f2437fff700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24380f64b0 0x7f2438108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:45.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f24377fe700 1 -- 172.21.15.8:0/2837652293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24380f64b0 msgr2=0x7f2438108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:45.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f24377fe700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24380f64b0 0x7f2438108ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f24377fe700 1 -- 172.21.15.8:0/2837652293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2428005040 con 0x7f24380f7750 2023-10-18T22:04:45.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f24377fe700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24380f7750 0x7f24381093d0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f242c00e7f0 tx=0x7f242c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:45.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f2434ff9700 1 -- 172.21.15.8:0/2837652293 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f242c0092e0 con 0x7f24380f7750 2023-10-18T22:04:45.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f2434ff9700 1 -- 172.21.15.8:0/2837652293 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f242c00f040 con 0x7f24380f7750 2023-10-18T22:04:45.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f2434ff9700 1 -- 172.21.15.8:0/2837652293 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f242c014880 con 0x7f24380f7750 2023-10-18T22:04:45.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.078+0000 7f243d4c9700 1 -- 172.21.15.8:0/2837652293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243810a460 con 0x7f24380f7750 2023-10-18T22:04:45.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.079+0000 7f243d4c9700 1 -- 172.21.15.8:0/2837652293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243810a9a0 con 0x7f24380f7750 2023-10-18T22:04:45.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.080+0000 7f243d4c9700 1 -- 172.21.15.8:0/2837652293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2438045ad0 con 0x7f24380f7750 2023-10-18T22:04:45.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.080+0000 7f2434ff9700 1 -- 172.21.15.8:0/2837652293 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f242c01b030 con 0x7f24380f7750 2023-10-18T22:04:45.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.081+0000 7f2434ff9700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2420060f70 0x7f2420063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:45.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.081+0000 7f2434ff9700 1 -- 172.21.15.8:0/2837652293 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f242c07c9d0 con 0x7f24380f7750 2023-10-18T22:04:45.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.082+0000 7f2437fff700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2420060f70 0x7f2420063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:45.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.082+0000 7f2437fff700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2420060f70 0x7f2420063430 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f2428009720 tx=0x7f242800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:45.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.086+0000 7f2434ff9700 1 -- 172.21.15.8:0/2837652293 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f242c04ffb0 con 0x7f24380f7750 2023-10-18T22:04:45.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.282+0000 7f243d4c9700 1 -- 172.21.15.8:0/2837652293 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f243810abc0 con 0x7f2420060f70 2023-10-18T22:04:45.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.292+0000 7f2434ff9700 1 -- 172.21.15.8:0/2837652293 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f243810abc0 con 0x7f2420060f70 2023-10-18T22:04:45.295 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:04:45.295 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (71m) 8m ago 72m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:04:45.295 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (65m) 8m ago 72m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:04:45.295 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (65m) 6m ago 72m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:04:45.295 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (71m) 8m ago 72m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:04:45.296 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 68m - - 2023-10-18T22:04:45.296 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 68m - - 2023-10-18T22:04:45.296 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 68m - - 2023-10-18T22:04:45.296 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 68m - - 2023-10-18T22:04:45.296 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (66m) 8m ago 74m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:04:45.297 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (65m) 6m ago 71m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:04:45.297 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (65m) 8m ago 74m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:04:45.297 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (65m) 6m ago 71m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:04:45.297 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (72m) 8m ago 72m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:04:45.297 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (71m) 6m ago 71m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:04:45.298 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (64m) 8m ago 71m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:04:45.298 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (62m) 8m ago 71m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:04:45.298 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (62m) 8m ago 70m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:04:45.298 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (62m) 6m ago 70m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:04:45.298 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (61m) 6m ago 70m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:04:45.299 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (60m) 6m ago 70m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:04:45.299 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (66m) 8m ago 72m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:04:45.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 -- 172.21.15.8:0/2837652293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2420060f70 msgr2=0x7f2420063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2420060f70 0x7f2420063430 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f2428009720 tx=0x7f242800b040).stop 2023-10-18T22:04:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 -- 172.21.15.8:0/2837652293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24380f7750 msgr2=0x7f24381093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24380f7750 0x7f24381093d0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f242c00e7f0 tx=0x7f242c00b040).stop 2023-10-18T22:04:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 -- 172.21.15.8:0/2837652293 shutdown_connections 2023-10-18T22:04:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2420060f70 0x7f2420063430 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24380f64b0 0x7f2438108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 --2- 172.21.15.8:0/2837652293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24380f7750 0x7f24381093d0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 -- 172.21.15.8:0/2837652293 >> 172.21.15.8:0/2837652293 conn(0x7f24380f1c30 msgr2=0x7f243806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:45.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 -- 172.21.15.8:0/2837652293 shutdown_connections 2023-10-18T22:04:45.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.294+0000 7f243d4c9700 1 -- 172.21.15.8:0/2837652293 wait complete. 2023-10-18T22:04:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.430+0000 7f334e41b700 1 -- 172.21.15.8:0/4012258866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33480f77d0 msgr2=0x7f33480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.430+0000 7f334e41b700 1 --2- 172.21.15.8:0/4012258866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33480f77d0 0x7f33480f7c30 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f3338004660 tx=0x7f3338009b30).stop 2023-10-18T22:04:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.430+0000 7f334e41b700 1 -- 172.21.15.8:0/4012258866 shutdown_connections 2023-10-18T22:04:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.430+0000 7f334e41b700 1 --2- 172.21.15.8:0/4012258866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33480f77d0 0x7f33480f7c30 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.430+0000 7f334e41b700 1 --2- 172.21.15.8:0/4012258866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33480f6530 0x7f33480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.430+0000 7f334e41b700 1 -- 172.21.15.8:0/4012258866 >> 172.21.15.8:0/4012258866 conn(0x7f33480f1c90 msgr2=0x7f33480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.430+0000 7f334e41b700 1 -- 172.21.15.8:0/4012258866 shutdown_connections 2023-10-18T22:04:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.430+0000 7f334e41b700 1 -- 172.21.15.8:0/4012258866 wait complete. 2023-10-18T22:04:45.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.431+0000 7f334e41b700 1 Processor -- start 2023-10-18T22:04:45.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.431+0000 7f334e41b700 1 -- start start 2023-10-18T22:04:45.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.431+0000 7f334e41b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33480f6530 0x7f3348106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:45.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.431+0000 7f334e41b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33480f77d0 0x7f3348107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:45.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.431+0000 7f334e41b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33481077d0 con 0x7f33480f6530 2023-10-18T22:04:45.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.431+0000 7f334e41b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3348107fd0 con 0x7f33480f77d0 2023-10-18T22:04:45.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.432+0000 7f334d419700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33480f6530 0x7f3348106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:45.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.432+0000 7f334d419700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33480f6530 0x7f3348106d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45144/0 (socket says 172.21.15.8:45144) 2023-10-18T22:04:45.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.432+0000 7f334d419700 1 -- 172.21.15.8:0/180653825 learned_addr learned my addr 172.21.15.8:0/180653825 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.432+0000 7f334cc18700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33480f77d0 0x7f3348107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.432+0000 7f334d419700 1 -- 172.21.15.8:0/180653825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33480f77d0 msgr2=0x7f3348107220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.432+0000 7f334d419700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33480f77d0 0x7f3348107220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.432+0000 7f334d419700 1 -- 172.21.15.8:0/180653825 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338005040 con 0x7f33480f6530 2023-10-18T22:04:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.432+0000 7f334cc18700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33480f77d0 0x7f3348107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:04:45.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.432+0000 7f334d419700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33480f6530 0x7f3348106d30 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f334400e7c0 tx=0x7f334400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:45.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.433+0000 7f333dffb700 1 -- 172.21.15.8:0/180653825 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33440092e0 con 0x7f33480f6530 2023-10-18T22:04:45.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.433+0000 7f333dffb700 1 -- 172.21.15.8:0/180653825 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f334400f040 con 0x7f33480f6530 2023-10-18T22:04:45.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.433+0000 7f334e41b700 1 -- 172.21.15.8:0/180653825 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33481082b0 con 0x7f33480f6530 2023-10-18T22:04:45.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.433+0000 7f333dffb700 1 -- 172.21.15.8:0/180653825 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33440147e0 con 0x7f33480f6530 2023-10-18T22:04:45.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.433+0000 7f334e41b700 1 -- 172.21.15.8:0/180653825 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33481087f0 con 0x7f33480f6530 2023-10-18T22:04:45.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.434+0000 7f334e41b700 1 -- 172.21.15.8:0/180653825 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3348059100 con 0x7f33480f6530 2023-10-18T22:04:45.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.435+0000 7f333dffb700 1 -- 172.21.15.8:0/180653825 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f334401b030 con 0x7f33480f6530 2023-10-18T22:04:45.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.435+0000 7f333dffb700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3334060f70 0x7f3334063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:45.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.437+0000 7f333dffb700 1 -- 172.21.15.8:0/180653825 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f334407ca60 con 0x7f33480f6530 2023-10-18T22:04:45.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.437+0000 7f334cc18700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3334060f70 0x7f3334063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:45.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.437+0000 7f334cc18700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3334060f70 0x7f3334063430 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f33380043d0 tx=0x7f333800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:45.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.440+0000 7f333dffb700 1 -- 172.21.15.8:0/180653825 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3344050040 con 0x7f33480f6530 2023-10-18T22:04:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.698+0000 7f334e41b700 1 -- 172.21.15.8:0/180653825 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f33480fecf0 con 0x7f33480f6530 2023-10-18T22:04:45.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.698+0000 7f333dffb700 1 -- 172.21.15.8:0/180653825 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f3344019020 con 0x7f33480f6530 2023-10-18T22:04:45.701 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:04:45.701 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:04:45.702 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:04:45.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:04:45.702 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:04:45.702 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:04:45.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:04:45.703 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:04:45.703 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:04:45.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:04:45.703 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:04:45.703 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:04:45.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:04:45.704 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:04:45.704 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:04:45.704 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:04:45.704 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:04:45.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.700+0000 7f334e41b700 1 -- 172.21.15.8:0/180653825 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3334060f70 msgr2=0x7f3334063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:45.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.700+0000 7f334e41b700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3334060f70 0x7f3334063430 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f33380043d0 tx=0x7f333800b040).stop 2023-10-18T22:04:45.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.700+0000 7f334e41b700 1 -- 172.21.15.8:0/180653825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33480f6530 msgr2=0x7f3348106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:45.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.700+0000 7f334e41b700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33480f6530 0x7f3348106d30 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f334400e7c0 tx=0x7f334400b040).stop 2023-10-18T22:04:45.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.700+0000 7f334e41b700 1 -- 172.21.15.8:0/180653825 shutdown_connections 2023-10-18T22:04:45.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.700+0000 7f334e41b700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3334060f70 0x7f3334063430 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.700+0000 7f334e41b700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33480f6530 0x7f3348106d30 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.700+0000 7f334e41b700 1 --2- 172.21.15.8:0/180653825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33480f77d0 0x7f3348107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.700+0000 7f334e41b700 1 -- 172.21.15.8:0/180653825 >> 172.21.15.8:0/180653825 conn(0x7f33480f1c90 msgr2=0x7f33480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.702+0000 7f334e41b700 1 -- 172.21.15.8:0/180653825 shutdown_connections 2023-10-18T22:04:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.702+0000 7f334e41b700 1 -- 172.21.15.8:0/180653825 wait complete. 2023-10-18T22:04:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.838+0000 7f8d88829700 1 -- 172.21.15.8:0/1776981361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d840f6530 msgr2=0x7f8d840f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.838+0000 7f8d88829700 1 --2- 172.21.15.8:0/1776981361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d840f6530 0x7f8d840f6950 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f8d74004660 tx=0x7f8d74009b30).stop 2023-10-18T22:04:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.838+0000 7f8d88829700 1 -- 172.21.15.8:0/1776981361 shutdown_connections 2023-10-18T22:04:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.838+0000 7f8d88829700 1 --2- 172.21.15.8:0/1776981361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d840f77d0 0x7f8d840f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.838+0000 7f8d88829700 1 --2- 172.21.15.8:0/1776981361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d840f6530 0x7f8d840f6950 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.838+0000 7f8d88829700 1 -- 172.21.15.8:0/1776981361 >> 172.21.15.8:0/1776981361 conn(0x7f8d840f1c90 msgr2=0x7f8d840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:45.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.838+0000 7f8d88829700 1 -- 172.21.15.8:0/1776981361 shutdown_connections 2023-10-18T22:04:45.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.838+0000 7f8d88829700 1 -- 172.21.15.8:0/1776981361 wait complete. 2023-10-18T22:04:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.839+0000 7f8d88829700 1 Processor -- start 2023-10-18T22:04:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.839+0000 7f8d88829700 1 -- start start 2023-10-18T22:04:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.839+0000 7f8d88829700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d840f6530 0x7f8d84108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.839+0000 7f8d88829700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d840f77d0 0x7f8d84109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.839+0000 7f8d88829700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84109a00 con 0x7f8d840f77d0 2023-10-18T22:04:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.839+0000 7f8d88829700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84109b40 con 0x7f8d840f6530 2023-10-18T22:04:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d8259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d840f77d0 0x7f8d84109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d82d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d840f6530 0x7f8d84108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d8259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d840f77d0 0x7f8d84109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45168/0 (socket says 172.21.15.8:45168) 2023-10-18T22:04:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d8259c700 1 -- 172.21.15.8:0/3224049653 learned_addr learned my addr 172.21.15.8:0/3224049653 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d8259c700 1 -- 172.21.15.8:0/3224049653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d840f6530 msgr2=0x7f8d84108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:45.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d8259c700 1 --2- 172.21.15.8:0/3224049653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d840f6530 0x7f8d84108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:45.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d8259c700 1 -- 172.21.15.8:0/3224049653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74005040 con 0x7f8d840f77d0 2023-10-18T22:04:45.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d8259c700 1 --2- 172.21.15.8:0/3224049653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d840f77d0 0x7f8d84109450 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f8d7800e7f0 tx=0x7f8d7800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:45.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d6b7fe700 1 -- 172.21.15.8:0/3224049653 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d780092e0 con 0x7f8d840f77d0 2023-10-18T22:04:45.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d88829700 1 -- 172.21.15.8:0/3224049653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8410a4e0 con 0x7f8d840f77d0 2023-10-18T22:04:45.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d6b7fe700 1 -- 172.21.15.8:0/3224049653 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8d7800f040 con 0x7f8d840f77d0 2023-10-18T22:04:45.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.840+0000 7f8d6b7fe700 1 -- 172.21.15.8:0/3224049653 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d780147e0 con 0x7f8d840f77d0 2023-10-18T22:04:45.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.841+0000 7f8d88829700 1 -- 172.21.15.8:0/3224049653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8410aa20 con 0x7f8d840f77d0 2023-10-18T22:04:45.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.842+0000 7f8d88829700 1 -- 172.21.15.8:0/3224049653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d84045ad0 con 0x7f8d840f77d0 2023-10-18T22:04:45.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.843+0000 7f8d6b7fe700 1 -- 172.21.15.8:0/3224049653 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8d7801b030 con 0x7f8d840f77d0 2023-10-18T22:04:45.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.843+0000 7f8d6b7fe700 1 --2- 172.21.15.8:0/3224049653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d6c060f70 0x7f8d6c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:45.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.843+0000 7f8d6b7fe700 1 -- 172.21.15.8:0/3224049653 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8d7807c700 con 0x7f8d840f77d0 2023-10-18T22:04:45.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.844+0000 7f8d82d9d700 1 --2- 172.21.15.8:0/3224049653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d6c060f70 0x7f8d6c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:45.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.844+0000 7f8d82d9d700 1 --2- 172.21.15.8:0/3224049653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d6c060f70 0x7f8d6c063430 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f8d74005010 tx=0x7f8d74016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:45.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:45.847+0000 7f8d6b7fe700 1 -- 172.21.15.8:0/3224049653 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8d7804fe50 con 0x7f8d840f77d0 2023-10-18T22:04:46.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.074+0000 7f8d88829700 1 -- 172.21.15.8:0/3224049653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8d84027a00 con 0x7f8d840f77d0 2023-10-18T22:04:46.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.075+0000 7f8d6b7fe700 1 -- 172.21.15.8:0/3224049653 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f8d78019070 con 0x7f8d840f77d0 2023-10-18T22:04:46.076 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:04:46.077 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:04:46.077 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:04:46.077 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:04:46.077 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:04:46.078 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:04:46.078 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:04:46.078 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:04:46.078 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:04:46.078 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:04:46.079 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:04:46.079 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:04:46.079 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:04:46.079 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:04:46.079 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:04:46.080 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:04:46.080 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:04:46.080 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:04:46.080 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:04:46.080 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:04:46.081 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:04:46.081 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:04:46.081 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:04:46.081 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:04:46.081 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:04:46.082 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:04:46.082 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:04:46.082 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:04:46.082 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:04:46.082 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:04:46.083 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:04:46.083 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:04:46.083 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:04:46.083 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:04:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 -- 172.21.15.8:0/3224049653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d6c060f70 msgr2=0x7f8d6c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 --2- 172.21.15.8:0/3224049653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d6c060f70 0x7f8d6c063430 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f8d74005010 tx=0x7f8d74016040).stop 2023-10-18T22:04:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 -- 172.21.15.8:0/3224049653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d840f77d0 msgr2=0x7f8d84109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 --2- 172.21.15.8:0/3224049653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d840f77d0 0x7f8d84109450 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f8d7800e7f0 tx=0x7f8d7800b040).stop 2023-10-18T22:04:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 -- 172.21.15.8:0/3224049653 shutdown_connections 2023-10-18T22:04:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 --2- 172.21.15.8:0/3224049653 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8d6c060f70 0x7f8d6c063430 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 --2- 172.21.15.8:0/3224049653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d840f6530 0x7f8d84108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 --2- 172.21.15.8:0/3224049653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d840f77d0 0x7f8d84109450 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 -- 172.21.15.8:0/3224049653 >> 172.21.15.8:0/3224049653 conn(0x7f8d840f1c90 msgr2=0x7f8d8406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 -- 172.21.15.8:0/3224049653 shutdown_connections 2023-10-18T22:04:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.077+0000 7f8d88829700 1 -- 172.21.15.8:0/3224049653 wait complete. 2023-10-18T22:04:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:04:46.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.215+0000 7f96b3481700 1 -- 172.21.15.8:0/1587869906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96ac0f6530 msgr2=0x7f96ac0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:46.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.215+0000 7f96b3481700 1 --2- 172.21.15.8:0/1587869906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96ac0f6530 0x7f96ac0f6950 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f96a8004660 tx=0x7f96a8009b30).stop 2023-10-18T22:04:46.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.215+0000 7f96b3481700 1 -- 172.21.15.8:0/1587869906 shutdown_connections 2023-10-18T22:04:46.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.215+0000 7f96b3481700 1 --2- 172.21.15.8:0/1587869906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96ac0f77d0 0x7f96ac0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:46.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.215+0000 7f96b3481700 1 --2- 172.21.15.8:0/1587869906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96ac0f6530 0x7f96ac0f6950 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:46.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.215+0000 7f96b3481700 1 -- 172.21.15.8:0/1587869906 >> 172.21.15.8:0/1587869906 conn(0x7f96ac0f1c90 msgr2=0x7f96ac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:46.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.215+0000 7f96b3481700 1 -- 172.21.15.8:0/1587869906 shutdown_connections 2023-10-18T22:04:46.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.215+0000 7f96b3481700 1 -- 172.21.15.8:0/1587869906 wait complete. 2023-10-18T22:04:46.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.216+0000 7f96b3481700 1 Processor -- start 2023-10-18T22:04:46.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.216+0000 7f96b3481700 1 -- start start 2023-10-18T22:04:46.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.216+0000 7f96b3481700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96ac0f6530 0x7f96ac06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:46.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.216+0000 7f96b3481700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96ac0f77d0 0x7f96ac069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:46.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.216+0000 7f96b3481700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac06a380 con 0x7f96ac0f6530 2023-10-18T22:04:46.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.216+0000 7f96b3481700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac06a4c0 con 0x7f96ac0f77d0 2023-10-18T22:04:46.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.217+0000 7f96b247f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96ac0f6530 0x7f96ac06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:46.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.217+0000 7f96b247f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96ac0f6530 0x7f96ac06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45178/0 (socket says 172.21.15.8:45178) 2023-10-18T22:04:46.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.217+0000 7f96b247f700 1 -- 172.21.15.8:0/796445649 learned_addr learned my addr 172.21.15.8:0/796445649 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:04:46.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.217+0000 7f96b1c7e700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96ac0f77d0 0x7f96ac069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:46.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.217+0000 7f96b247f700 1 -- 172.21.15.8:0/796445649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96ac0f77d0 msgr2=0x7f96ac069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:46.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.217+0000 7f96b247f700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96ac0f77d0 0x7f96ac069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:46.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.217+0000 7f96b247f700 1 -- 172.21.15.8:0/796445649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a8005040 con 0x7f96ac0f6530 2023-10-18T22:04:46.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.217+0000 7f96b247f700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96ac0f6530 0x7f96ac06b9a0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f96a8004e30 tx=0x7f96a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:46.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.218+0000 7f96a2ffd700 1 -- 172.21.15.8:0/796445649 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a8018070 con 0x7f96ac0f6530 2023-10-18T22:04:46.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.218+0000 7f96b3481700 1 -- 172.21.15.8:0/796445649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ac06a740 con 0x7f96ac0f6530 2023-10-18T22:04:46.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.218+0000 7f96a2ffd700 1 -- 172.21.15.8:0/796445649 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f96a8009630 con 0x7f96ac0f6530 2023-10-18T22:04:46.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.218+0000 7f96b3481700 1 -- 172.21.15.8:0/796445649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ac06aca0 con 0x7f96ac0f6530 2023-10-18T22:04:46.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.218+0000 7f96a2ffd700 1 -- 172.21.15.8:0/796445649 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a801c3c0 con 0x7f96ac0f6530 2023-10-18T22:04:46.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.219+0000 7f96b3481700 1 -- 172.21.15.8:0/796445649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ac045ad0 con 0x7f96ac0f6530 2023-10-18T22:04:46.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.220+0000 7f96a2ffd700 1 -- 172.21.15.8:0/796445649 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f96a801d420 con 0x7f96ac0f6530 2023-10-18T22:04:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.220+0000 7f96a2ffd700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9698060f70 0x7f9698063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:04:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.221+0000 7f96a2ffd700 1 -- 172.21.15.8:0/796445649 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f96a807e520 con 0x7f96ac0f6530 2023-10-18T22:04:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.221+0000 7f96b1c7e700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9698060f70 0x7f9698063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:04:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.221+0000 7f96b1c7e700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9698060f70 0x7f9698063430 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f969c004e20 tx=0x7f969c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:04:46.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.225+0000 7f96a2ffd700 1 -- 172.21.15.8:0/796445649 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f96a804e0d0 con 0x7f96ac0f6530 2023-10-18T22:04:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.422+0000 7f96b3481700 1 -- 172.21.15.8:0/796445649 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f96ac057f10 con 0x7f9698060f70 2023-10-18T22:04:46.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.424+0000 7f96a2ffd700 1 -- 172.21.15.8:0/796445649 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f96ac057f10 con 0x7f9698060f70 2023-10-18T22:04:46.425 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:04:46.425 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:04:46.426 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:04:46.426 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:04:46.426 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:04:46.426 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:04:46.426 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:04:46.427 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:04:46.427 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:04:46.427 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:04:46.427 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:04:46.427 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:04:46.428 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:04:46.428 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:04:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 -- 172.21.15.8:0/796445649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9698060f70 msgr2=0x7f9698063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9698060f70 0x7f9698063430 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f969c004e20 tx=0x7f969c00b040).stop 2023-10-18T22:04:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 -- 172.21.15.8:0/796445649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96ac0f6530 msgr2=0x7f96ac06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:04:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96ac0f6530 0x7f96ac06b9a0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f96a8004e30 tx=0x7f96a8009b30).stop 2023-10-18T22:04:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 -- 172.21.15.8:0/796445649 shutdown_connections 2023-10-18T22:04:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9698060f70 0x7f9698063430 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96ac0f6530 0x7f96ac06b9a0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 --2- 172.21.15.8:0/796445649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96ac0f77d0 0x7f96ac069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:04:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 -- 172.21.15.8:0/796445649 >> 172.21.15.8:0/796445649 conn(0x7f96ac0f1c90 msgr2=0x7f96ac0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:04:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 -- 172.21.15.8:0/796445649 shutdown_connections 2023-10-18T22:04:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:04:46.426+0000 7f96b3481700 1 -- 172.21.15.8:0/796445649 wait complete. 2023-10-18T22:04:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:44.586679+0000 mgr.smithi008.flmjzp (mgr.14640) 3950 : audit [DBG] from='client.37216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:44.937030+0000 mgr.smithi008.flmjzp (mgr.14640) 3951 : audit [DBG] from='client.37220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:45.202355+0000 mgr.smithi008.flmjzp (mgr.14640) 3952 : cluster [DBG] pgmap v2714: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:45.285169+0000 mgr.smithi008.flmjzp (mgr.14640) 3953 : audit [DBG] from='client.37224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:45.699985+0000 mon.smithi008 (mon.0) 4278 : audit [DBG] from='client.? 172.21.15.8:0/180653825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:46.075323+0000 mon.smithi008 (mon.0) 4279 : audit [DBG] from='client.? 172.21.15.8:0/3224049653' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:04:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:44.586679+0000 mgr.smithi008.flmjzp (mgr.14640) 3950 : audit [DBG] from='client.37216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:44.937030+0000 mgr.smithi008.flmjzp (mgr.14640) 3951 : audit [DBG] from='client.37220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:45.202355+0000 mgr.smithi008.flmjzp (mgr.14640) 3952 : cluster [DBG] pgmap v2714: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:45.285169+0000 mgr.smithi008.flmjzp (mgr.14640) 3953 : audit [DBG] from='client.37224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:46.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:45.699985+0000 mon.smithi008 (mon.0) 4278 : audit [DBG] from='client.? 172.21.15.8:0/180653825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:46.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:46.075323+0000 mon.smithi008 (mon.0) 4279 : audit [DBG] from='client.? 172.21.15.8:0/3224049653' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:04:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:46.424169+0000 mgr.smithi008.flmjzp (mgr.14640) 3954 : audit [DBG] from='client.37236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:47.203055+0000 mgr.smithi008.flmjzp (mgr.14640) 3955 : cluster [DBG] pgmap v2715: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:46.424169+0000 mgr.smithi008.flmjzp (mgr.14640) 3954 : audit [DBG] from='client.37236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:04:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:47.203055+0000 mgr.smithi008.flmjzp (mgr.14640) 3955 : cluster [DBG] pgmap v2715: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:49.218080+0000 mon.smithi008 (mon.0) 4280 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:49.220216+0000 mon.smithi008 (mon.0) 4281 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:04:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:49.221231+0000 mon.smithi008 (mon.0) 4282 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:04:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:49.227923+0000 mon.smithi008 (mon.0) 4283 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:04:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:49.234274+0000 mon.smithi008 (mon.0) 4284 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:49.237261+0000 mon.smithi008 (mon.0) 4285 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:49.238971+0000 mon.smithi008 (mon.0) 4286 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:49.240541+0000 mon.smithi008 (mon.0) 4287 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:49.243167+0000 mon.smithi008 (mon.0) 4288 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:49.218080+0000 mon.smithi008 (mon.0) 4280 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:49.220216+0000 mon.smithi008 (mon.0) 4281 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:04:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:49.221231+0000 mon.smithi008 (mon.0) 4282 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:04:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:49.227923+0000 mon.smithi008 (mon.0) 4283 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:04:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:49.234274+0000 mon.smithi008 (mon.0) 4284 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:49.237261+0000 mon.smithi008 (mon.0) 4285 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:49.238971+0000 mon.smithi008 (mon.0) 4286 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:49.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:49.240541+0000 mon.smithi008 (mon.0) 4287 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:49.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:49.243167+0000 mon.smithi008 (mon.0) 4288 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:04:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:49.203680+0000 mgr.smithi008.flmjzp (mgr.14640) 3956 : cluster [DBG] pgmap v2716: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:49.222161+0000 mgr.smithi008.flmjzp (mgr.14640) 3957 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:49.222779+0000 mgr.smithi008.flmjzp (mgr.14640) 3958 : cluster [DBG] pgmap v2717: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:49.223111+0000 mgr.smithi008.flmjzp (mgr.14640) 3959 : cluster [DBG] pgmap v2718: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:49.245274+0000 mgr.smithi008.flmjzp (mgr.14640) 3960 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:49.203680+0000 mgr.smithi008.flmjzp (mgr.14640) 3956 : cluster [DBG] pgmap v2716: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:49.222161+0000 mgr.smithi008.flmjzp (mgr.14640) 3957 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:04:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:49.222779+0000 mgr.smithi008.flmjzp (mgr.14640) 3958 : cluster [DBG] pgmap v2717: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:49.223111+0000 mgr.smithi008.flmjzp (mgr.14640) 3959 : cluster [DBG] pgmap v2718: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:49.245274+0000 mgr.smithi008.flmjzp (mgr.14640) 3960 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:04:52.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:51.223871+0000 mgr.smithi008.flmjzp (mgr.14640) 3961 : cluster [DBG] pgmap v2719: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:51.223871+0000 mgr.smithi008.flmjzp (mgr.14640) 3961 : cluster [DBG] pgmap v2719: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:53.224525+0000 mgr.smithi008.flmjzp (mgr.14640) 3962 : cluster [DBG] pgmap v2720: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:53.224525+0000 mgr.smithi008.flmjzp (mgr.14640) 3962 : cluster [DBG] pgmap v2720: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:55.225052+0000 mgr.smithi008.flmjzp (mgr.14640) 3963 : cluster [DBG] pgmap v2721: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:55.225052+0000 mgr.smithi008.flmjzp (mgr.14640) 3963 : cluster [DBG] pgmap v2721: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:57.225632+0000 mgr.smithi008.flmjzp (mgr.14640) 3964 : cluster [DBG] pgmap v2722: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:57.225632+0000 mgr.smithi008.flmjzp (mgr.14640) 3964 : cluster [DBG] pgmap v2722: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:04:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:04:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:59.252147+0000 mon.smithi008 (mon.0) 4289 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:04:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:04:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:59.252147+0000 mon.smithi008 (mon.0) 4289 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:59.226241+0000 mgr.smithi008.flmjzp (mgr.14640) 3965 : cluster [DBG] pgmap v2723: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:59.807004+0000 mon.smithi008 (mon.0) 4290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:59.808098+0000 mon.smithi008 (mon.0) 4291 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:59.814651+0000 mon.smithi008 (mon.0) 4292 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:59.822620+0000 mon.smithi008 (mon.0) 4293 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:59.826042+0000 mon.smithi008 (mon.0) 4294 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:59.827967+0000 mon.smithi008 (mon.0) 4295 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:59.829787+0000 mon.smithi008 (mon.0) 4296 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:04:59.832358+0000 mon.smithi008 (mon.0) 4297 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:59.226241+0000 mgr.smithi008.flmjzp (mgr.14640) 3965 : cluster [DBG] pgmap v2723: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:59.807004+0000 mon.smithi008 (mon.0) 4290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:59.808098+0000 mon.smithi008 (mon.0) 4291 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:59.814651+0000 mon.smithi008 (mon.0) 4292 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:59.822620+0000 mon.smithi008 (mon.0) 4293 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:59.826042+0000 mon.smithi008 (mon.0) 4294 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:59.827967+0000 mon.smithi008 (mon.0) 4295 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:59.829787+0000 mon.smithi008 (mon.0) 4296 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:00.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:04:59.832358+0000 mon.smithi008 (mon.0) 4297 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:59.808954+0000 mgr.smithi008.flmjzp (mgr.14640) 3966 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:59.809713+0000 mgr.smithi008.flmjzp (mgr.14640) 3967 : cluster [DBG] pgmap v2724: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:04:59.810087+0000 mgr.smithi008.flmjzp (mgr.14640) 3968 : cluster [DBG] pgmap v2725: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:04:59.834490+0000 mgr.smithi008.flmjzp (mgr.14640) 3969 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:59.808954+0000 mgr.smithi008.flmjzp (mgr.14640) 3966 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:59.809713+0000 mgr.smithi008.flmjzp (mgr.14640) 3967 : cluster [DBG] pgmap v2724: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:04:59.810087+0000 mgr.smithi008.flmjzp (mgr.14640) 3968 : cluster [DBG] pgmap v2725: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:04:59.834490+0000 mgr.smithi008.flmjzp (mgr.14640) 3969 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:01.810739+0000 mgr.smithi008.flmjzp (mgr.14640) 3970 : cluster [DBG] pgmap v2726: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:01.810739+0000 mgr.smithi008.flmjzp (mgr.14640) 3970 : cluster [DBG] pgmap v2726: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:03.811402+0000 mgr.smithi008.flmjzp (mgr.14640) 3971 : cluster [DBG] pgmap v2727: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:03.811402+0000 mgr.smithi008.flmjzp (mgr.14640) 3971 : cluster [DBG] pgmap v2727: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:05.812076+0000 mgr.smithi008.flmjzp (mgr.14640) 3972 : cluster [DBG] pgmap v2728: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:05.812076+0000 mgr.smithi008.flmjzp (mgr.14640) 3972 : cluster [DBG] pgmap v2728: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:07.812746+0000 mgr.smithi008.flmjzp (mgr.14640) 3973 : cluster [DBG] pgmap v2729: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:07.812746+0000 mgr.smithi008.flmjzp (mgr.14640) 3973 : cluster [DBG] pgmap v2729: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:09.838538+0000 mon.smithi008 (mon.0) 4298 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:09.840926+0000 mon.smithi008 (mon.0) 4299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:09.842061+0000 mon.smithi008 (mon.0) 4300 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:09.848886+0000 mon.smithi008 (mon.0) 4301 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:09.855548+0000 mon.smithi008 (mon.0) 4302 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:09.858986+0000 mon.smithi008 (mon.0) 4303 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:10.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:09.860672+0000 mon.smithi008 (mon.0) 4304 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:10.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:09.862317+0000 mon.smithi008 (mon.0) 4305 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:10.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:09.864468+0000 mon.smithi008 (mon.0) 4306 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:09.838538+0000 mon.smithi008 (mon.0) 4298 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:09.840926+0000 mon.smithi008 (mon.0) 4299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:09.842061+0000 mon.smithi008 (mon.0) 4300 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:09.848886+0000 mon.smithi008 (mon.0) 4301 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:09.855548+0000 mon.smithi008 (mon.0) 4302 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:09.858986+0000 mon.smithi008 (mon.0) 4303 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:09.860672+0000 mon.smithi008 (mon.0) 4304 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:09.862317+0000 mon.smithi008 (mon.0) 4305 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:10.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:09.864468+0000 mon.smithi008 (mon.0) 4306 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:09.813388+0000 mgr.smithi008.flmjzp (mgr.14640) 3974 : cluster [DBG] pgmap v2730: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:05:09.843062+0000 mgr.smithi008.flmjzp (mgr.14640) 3975 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:09.843733+0000 mgr.smithi008.flmjzp (mgr.14640) 3976 : cluster [DBG] pgmap v2731: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:09.844022+0000 mgr.smithi008.flmjzp (mgr.14640) 3977 : cluster [DBG] pgmap v2732: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:05:09.866331+0000 mgr.smithi008.flmjzp (mgr.14640) 3978 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:09.813388+0000 mgr.smithi008.flmjzp (mgr.14640) 3974 : cluster [DBG] pgmap v2730: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:05:09.843062+0000 mgr.smithi008.flmjzp (mgr.14640) 3975 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:09.843733+0000 mgr.smithi008.flmjzp (mgr.14640) 3976 : cluster [DBG] pgmap v2731: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:09.844022+0000 mgr.smithi008.flmjzp (mgr.14640) 3977 : cluster [DBG] pgmap v2732: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:05:09.866331+0000 mgr.smithi008.flmjzp (mgr.14640) 3978 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:11.844552+0000 mgr.smithi008.flmjzp (mgr.14640) 3979 : cluster [DBG] pgmap v2733: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:11.844552+0000 mgr.smithi008.flmjzp (mgr.14640) 3979 : cluster [DBG] pgmap v2733: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:13.845132+0000 mgr.smithi008.flmjzp (mgr.14640) 3980 : cluster [DBG] pgmap v2734: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:13.845132+0000 mgr.smithi008.flmjzp (mgr.14640) 3980 : cluster [DBG] pgmap v2734: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:16.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.578+0000 7f9856b4c700 1 -- 172.21.15.8:0/737507960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98500f77d0 msgr2=0x7f98500f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:16.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.578+0000 7f9856b4c700 1 --2- 172.21.15.8:0/737507960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98500f77d0 0x7f98500f7c30 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f9840004660 tx=0x7f9840009b30).stop 2023-10-18T22:05:16.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.578+0000 7f9856b4c700 1 -- 172.21.15.8:0/737507960 shutdown_connections 2023-10-18T22:05:16.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.578+0000 7f9856b4c700 1 --2- 172.21.15.8:0/737507960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98500f77d0 0x7f98500f7c30 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:16.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.578+0000 7f9856b4c700 1 --2- 172.21.15.8:0/737507960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98500f6530 0x7f98500f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:16.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.578+0000 7f9856b4c700 1 -- 172.21.15.8:0/737507960 >> 172.21.15.8:0/737507960 conn(0x7f98500f1c90 msgr2=0x7f98500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:16.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.578+0000 7f9856b4c700 1 -- 172.21.15.8:0/737507960 shutdown_connections 2023-10-18T22:05:16.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.578+0000 7f9856b4c700 1 -- 172.21.15.8:0/737507960 wait complete. 2023-10-18T22:05:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.579+0000 7f9856b4c700 1 Processor -- start 2023-10-18T22:05:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.579+0000 7f9856b4c700 1 -- start start 2023-10-18T22:05:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.579+0000 7f9856b4c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98500f6530 0x7f9850108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.579+0000 7f9856b4c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98500f77d0 0x7f9850109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.579+0000 7f9856b4c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9850109a20 con 0x7f98500f6530 2023-10-18T22:05:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.579+0000 7f9856b4c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9850109b60 con 0x7f98500f77d0 2023-10-18T22:05:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.579+0000 7f9855b4a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98500f6530 0x7f9850108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:16.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.579+0000 7f9855b4a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98500f6530 0x7f9850108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33654/0 (socket says 172.21.15.8:33654) 2023-10-18T22:05:16.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.579+0000 7f9855b4a700 1 -- 172.21.15.8:0/2061462501 learned_addr learned my addr 172.21.15.8:0/2061462501 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:16.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.580+0000 7f9855349700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98500f77d0 0x7f9850109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:16.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.580+0000 7f9855b4a700 1 -- 172.21.15.8:0/2061462501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98500f77d0 msgr2=0x7f9850109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:16.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.580+0000 7f9855b4a700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98500f77d0 0x7f9850109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:16.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.580+0000 7f9855b4a700 1 -- 172.21.15.8:0/2061462501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840005040 con 0x7f98500f6530 2023-10-18T22:05:16.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.580+0000 7f9855349700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98500f77d0 0x7f9850109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:05:16.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.580+0000 7f9855b4a700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98500f6530 0x7f9850108f80 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f984c00c790 tx=0x7f984c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:16.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.580+0000 7f98467fc700 1 -- 172.21.15.8:0/2061462501 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984c00e680 con 0x7f98500f6530 2023-10-18T22:05:16.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.580+0000 7f98467fc700 1 -- 172.21.15.8:0/2061462501 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f984c00eca0 con 0x7f98500f6530 2023-10-18T22:05:16.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.580+0000 7f9856b4c700 1 -- 172.21.15.8:0/2061462501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985010a500 con 0x7f98500f6530 2023-10-18T22:05:16.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.580+0000 7f98467fc700 1 -- 172.21.15.8:0/2061462501 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984c012d80 con 0x7f98500f6530 2023-10-18T22:05:16.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.581+0000 7f9856b4c700 1 -- 172.21.15.8:0/2061462501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985010aac0 con 0x7f98500f6530 2023-10-18T22:05:16.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.582+0000 7f9856b4c700 1 -- 172.21.15.8:0/2061462501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9850045ad0 con 0x7f98500f6530 2023-10-18T22:05:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.583+0000 7f98467fc700 1 -- 172.21.15.8:0/2061462501 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f984c010070 con 0x7f98500f6530 2023-10-18T22:05:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.584+0000 7f98467fc700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f983c060f70 0x7f983c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.584+0000 7f98467fc700 1 -- 172.21.15.8:0/2061462501 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f984c07c9d0 con 0x7f98500f6530 2023-10-18T22:05:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.584+0000 7f9855349700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f983c060f70 0x7f983c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.585+0000 7f9855349700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f983c060f70 0x7f983c063430 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f9840004630 tx=0x7f9840009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.588+0000 7f98467fc700 1 -- 172.21.15.8:0/2061462501 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f984c050030 con 0x7f98500f6530 2023-10-18T22:05:16.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.786+0000 7f9856b4c700 1 -- 172.21.15.8:0/2061462501 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98500fedd0 con 0x7f983c060f70 2023-10-18T22:05:16.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.787+0000 7f98467fc700 1 -- 172.21.15.8:0/2061462501 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f98500fedd0 con 0x7f983c060f70 2023-10-18T22:05:16.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 -- 172.21.15.8:0/2061462501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f983c060f70 msgr2=0x7f983c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:16.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f983c060f70 0x7f983c063430 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f9840004630 tx=0x7f9840009b30).stop 2023-10-18T22:05:16.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 -- 172.21.15.8:0/2061462501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98500f6530 msgr2=0x7f9850108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:16.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98500f6530 0x7f9850108f80 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f984c00c790 tx=0x7f984c007d90).stop 2023-10-18T22:05:16.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 -- 172.21.15.8:0/2061462501 shutdown_connections 2023-10-18T22:05:16.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f983c060f70 0x7f983c063430 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:16.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98500f6530 0x7f9850108f80 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:16.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 --2- 172.21.15.8:0/2061462501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98500f77d0 0x7f9850109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:16.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 -- 172.21.15.8:0/2061462501 >> 172.21.15.8:0/2061462501 conn(0x7f98500f1c90 msgr2=0x7f985006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:16.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 -- 172.21.15.8:0/2061462501 shutdown_connections 2023-10-18T22:05:16.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.789+0000 7f9856b4c700 1 -- 172.21.15.8:0/2061462501 wait complete. 2023-10-18T22:05:16.805 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:05:16.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.927+0000 7f753ec2b700 1 -- 172.21.15.8:0/2401602307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75380f77d0 msgr2=0x7f75380f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:16.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.927+0000 7f753ec2b700 1 --2- 172.21.15.8:0/2401602307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75380f77d0 0x7f75380f7c30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f7528004660 tx=0x7f7528009b30).stop 2023-10-18T22:05:16.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.927+0000 7f753ec2b700 1 -- 172.21.15.8:0/2401602307 shutdown_connections 2023-10-18T22:05:16.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.927+0000 7f753ec2b700 1 --2- 172.21.15.8:0/2401602307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75380f77d0 0x7f75380f7c30 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:16.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.927+0000 7f753ec2b700 1 --2- 172.21.15.8:0/2401602307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380f6530 0x7f75380f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:16.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.927+0000 7f753ec2b700 1 -- 172.21.15.8:0/2401602307 >> 172.21.15.8:0/2401602307 conn(0x7f75380f1c90 msgr2=0x7f75380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:16.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.927+0000 7f753ec2b700 1 -- 172.21.15.8:0/2401602307 shutdown_connections 2023-10-18T22:05:16.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.927+0000 7f753ec2b700 1 -- 172.21.15.8:0/2401602307 wait complete. 2023-10-18T22:05:16.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.928+0000 7f753ec2b700 1 Processor -- start 2023-10-18T22:05:16.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.928+0000 7f753ec2b700 1 -- start start 2023-10-18T22:05:16.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753ec2b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75380f6530 0x7f753806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:16.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753ec2b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380f77d0 0x7f7538069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:16.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753ec2b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753806a380 con 0x7f75380f6530 2023-10-18T22:05:16.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753ec2b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753806a4c0 con 0x7f75380f77d0 2023-10-18T22:05:16.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753dc29700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75380f6530 0x7f753806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:16.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753dc29700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75380f6530 0x7f753806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52854/0 (socket says 172.21.15.8:52854) 2023-10-18T22:05:16.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753dc29700 1 -- 172.21.15.8:0/926506419 learned_addr learned my addr 172.21.15.8:0/926506419 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:16.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753d428700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380f77d0 0x7f7538069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:16.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753dc29700 1 -- 172.21.15.8:0/926506419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380f77d0 msgr2=0x7f7538069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:16.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753dc29700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380f77d0 0x7f7538069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:16.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.929+0000 7f753dc29700 1 -- 172.21.15.8:0/926506419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528005040 con 0x7f75380f6530 2023-10-18T22:05:16.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.930+0000 7f753dc29700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75380f6530 0x7f753806b9a0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f7534002700 tx=0x7f7534009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:16.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.930+0000 7f752e7fc700 1 -- 172.21.15.8:0/926506419 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7534009320 con 0x7f75380f6530 2023-10-18T22:05:16.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.930+0000 7f753ec2b700 1 -- 172.21.15.8:0/926506419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753806a7a0 con 0x7f75380f6530 2023-10-18T22:05:16.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.930+0000 7f752e7fc700 1 -- 172.21.15.8:0/926506419 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f753400f040 con 0x7f75380f6530 2023-10-18T22:05:16.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.930+0000 7f752e7fc700 1 -- 172.21.15.8:0/926506419 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7534014970 con 0x7f75380f6530 2023-10-18T22:05:16.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.930+0000 7f753ec2b700 1 -- 172.21.15.8:0/926506419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753810ed70 con 0x7f75380f6530 2023-10-18T22:05:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.931+0000 7f753ec2b700 1 -- 172.21.15.8:0/926506419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7538045ad0 con 0x7f75380f6530 2023-10-18T22:05:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.932+0000 7f752e7fc700 1 -- 172.21.15.8:0/926506419 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7534009480 con 0x7f75380f6530 2023-10-18T22:05:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.933+0000 7f752e7fc700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7524060f70 0x7f7524063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:16.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.933+0000 7f752e7fc700 1 -- 172.21.15.8:0/926506419 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f753407cb80 con 0x7f75380f6530 2023-10-18T22:05:16.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.933+0000 7f753d428700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7524060f70 0x7f7524063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:16.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.934+0000 7f753d428700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7524060f70 0x7f7524063430 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f7528004630 tx=0x7f7528009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:16.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:16.937+0000 7f752e7fc700 1 -- 172.21.15.8:0/926506419 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f753404c7f0 con 0x7f75380f6530 2023-10-18T22:05:17.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.147+0000 7f753ec2b700 1 -- 172.21.15.8:0/926506419 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75380fee70 con 0x7f7524060f70 2023-10-18T22:05:17.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.148+0000 7f752e7fc700 1 -- 172.21.15.8:0/926506419 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7528019040 con 0x7f7524060f70 2023-10-18T22:05:17.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.150+0000 7f753ec2b700 1 -- 172.21.15.8:0/926506419 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7524060f70 msgr2=0x7f7524063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:17.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.150+0000 7f753ec2b700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7524060f70 0x7f7524063430 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f7528004630 tx=0x7f7528009b30).stop 2023-10-18T22:05:17.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.150+0000 7f753ec2b700 1 -- 172.21.15.8:0/926506419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75380f6530 msgr2=0x7f753806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:17.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.150+0000 7f753ec2b700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75380f6530 0x7f753806b9a0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f7534002700 tx=0x7f7534009d80).stop 2023-10-18T22:05:17.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.150+0000 7f753ec2b700 1 -- 172.21.15.8:0/926506419 shutdown_connections 2023-10-18T22:05:17.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.151+0000 7f753ec2b700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7524060f70 0x7f7524063430 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.151+0000 7f753ec2b700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75380f6530 0x7f753806b9a0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.151+0000 7f753ec2b700 1 --2- 172.21.15.8:0/926506419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380f77d0 0x7f7538069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.151+0000 7f753ec2b700 1 -- 172.21.15.8:0/926506419 >> 172.21.15.8:0/926506419 conn(0x7f75380f1c90 msgr2=0x7f75380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:17.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.151+0000 7f753ec2b700 1 -- 172.21.15.8:0/926506419 shutdown_connections 2023-10-18T22:05:17.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.151+0000 7f753ec2b700 1 -- 172.21.15.8:0/926506419 wait complete. 2023-10-18T22:05:17.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.288+0000 7f30d9f5f700 1 -- 172.21.15.8:0/1133089819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30d40f6530 msgr2=0x7f30d40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:17.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.288+0000 7f30d9f5f700 1 --2- 172.21.15.8:0/1133089819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30d40f6530 0x7f30d40f6950 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f30c8004660 tx=0x7f30c8009b30).stop 2023-10-18T22:05:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.288+0000 7f30d9f5f700 1 -- 172.21.15.8:0/1133089819 shutdown_connections 2023-10-18T22:05:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.288+0000 7f30d9f5f700 1 --2- 172.21.15.8:0/1133089819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30d40f77d0 0x7f30d40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.288+0000 7f30d9f5f700 1 --2- 172.21.15.8:0/1133089819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30d40f6530 0x7f30d40f6950 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.288+0000 7f30d9f5f700 1 -- 172.21.15.8:0/1133089819 >> 172.21.15.8:0/1133089819 conn(0x7f30d40f1c90 msgr2=0x7f30d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.288+0000 7f30d9f5f700 1 -- 172.21.15.8:0/1133089819 shutdown_connections 2023-10-18T22:05:17.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.288+0000 7f30d9f5f700 1 -- 172.21.15.8:0/1133089819 wait complete. 2023-10-18T22:05:17.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.289+0000 7f30d9f5f700 1 Processor -- start 2023-10-18T22:05:17.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.289+0000 7f30d9f5f700 1 -- start start 2023-10-18T22:05:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.289+0000 7f30d9f5f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30d40f6530 0x7f30d4108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.289+0000 7f30d9f5f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30d40f77d0 0x7f30d4109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.289+0000 7f30d9f5f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d4109a00 con 0x7f30d40f77d0 2023-10-18T22:05:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.289+0000 7f30d9f5f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d4109b40 con 0x7f30d40f6530 2023-10-18T22:05:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.290+0000 7f30d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30d40f77d0 0x7f30d4109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.290+0000 7f30d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30d40f77d0 0x7f30d4109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52862/0 (socket says 172.21.15.8:52862) 2023-10-18T22:05:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.290+0000 7f30d3fff700 1 -- 172.21.15.8:0/440993629 learned_addr learned my addr 172.21.15.8:0/440993629 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.290+0000 7f30d8f5d700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30d40f6530 0x7f30d4108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.290+0000 7f30d3fff700 1 -- 172.21.15.8:0/440993629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30d40f6530 msgr2=0x7f30d4108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.290+0000 7f30d3fff700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30d40f6530 0x7f30d4108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.290+0000 7f30d3fff700 1 -- 172.21.15.8:0/440993629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c8005040 con 0x7f30d40f77d0 2023-10-18T22:05:17.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.290+0000 7f30d3fff700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30d40f77d0 0x7f30d4109450 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f30c000e7f0 tx=0x7f30c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:17.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.290+0000 7f30d17fa700 1 -- 172.21.15.8:0/440993629 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30c00092e0 con 0x7f30d40f77d0 2023-10-18T22:05:17.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.291+0000 7f30d17fa700 1 -- 172.21.15.8:0/440993629 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f30c000f040 con 0x7f30d40f77d0 2023-10-18T22:05:17.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.291+0000 7f30d17fa700 1 -- 172.21.15.8:0/440993629 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30c00147e0 con 0x7f30d40f77d0 2023-10-18T22:05:17.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.291+0000 7f30d9f5f700 1 -- 172.21.15.8:0/440993629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d410a4e0 con 0x7f30d40f77d0 2023-10-18T22:05:17.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.291+0000 7f30d9f5f700 1 -- 172.21.15.8:0/440993629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d410aa20 con 0x7f30d40f77d0 2023-10-18T22:05:17.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.292+0000 7f30d9f5f700 1 -- 172.21.15.8:0/440993629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d4045ad0 con 0x7f30d40f77d0 2023-10-18T22:05:17.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.292+0000 7f30d17fa700 1 -- 172.21.15.8:0/440993629 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f30c001b030 con 0x7f30d40f77d0 2023-10-18T22:05:17.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.293+0000 7f30d17fa700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f30c4060f70 0x7f30c4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:17.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.293+0000 7f30d17fa700 1 -- 172.21.15.8:0/440993629 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f30c007c7c0 con 0x7f30d40f77d0 2023-10-18T22:05:17.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.294+0000 7f30d8f5d700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f30c4060f70 0x7f30c4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:17.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.294+0000 7f30d8f5d700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f30c4060f70 0x7f30c4063430 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f30c8005010 tx=0x7f30c8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:17.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.297+0000 7f30d17fa700 1 -- 172.21.15.8:0/440993629 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f30c004fe50 con 0x7f30d40f77d0 2023-10-18T22:05:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:15.845739+0000 mgr.smithi008.flmjzp (mgr.14640) 3981 : cluster [DBG] pgmap v2735: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:15.845739+0000 mgr.smithi008.flmjzp (mgr.14640) 3981 : cluster [DBG] pgmap v2735: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.488+0000 7f30d9f5f700 1 -- 172.21.15.8:0/440993629 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30d410ac40 con 0x7f30c4060f70 2023-10-18T22:05:17.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.497+0000 7f30d17fa700 1 -- 172.21.15.8:0/440993629 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f30d410ac40 con 0x7f30c4060f70 2023-10-18T22:05:17.499 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:05:17.499 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (71m) 9m ago 73m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:05:17.499 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (65m) 9m ago 73m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:05:17.499 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (65m) 7m ago 72m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:05:17.500 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (71m) 9m ago 73m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:05:17.500 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 69m - - 2023-10-18T22:05:17.500 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 69m - - 2023-10-18T22:05:17.500 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 69m - - 2023-10-18T22:05:17.500 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 69m - - 2023-10-18T22:05:17.500 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (67m) 9m ago 74m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:05:17.501 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (66m) 7m ago 72m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:05:17.501 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (66m) 9m ago 74m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:05:17.501 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (66m) 7m ago 72m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:05:17.501 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (72m) 9m ago 72m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:05:17.501 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (72m) 7m ago 72m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:05:17.502 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (65m) 9m ago 72m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:05:17.502 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (63m) 9m ago 71m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:05:17.502 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (63m) 9m ago 71m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:05:17.502 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (62m) 7m ago 71m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:05:17.502 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (61m) 7m ago 70m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:05:17.503 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (61m) 7m ago 70m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:05:17.503 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (67m) 9m ago 72m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:05:17.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.499+0000 7f30d9f5f700 1 -- 172.21.15.8:0/440993629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f30c4060f70 msgr2=0x7f30c4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:17.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.499+0000 7f30d9f5f700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f30c4060f70 0x7f30c4063430 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f30c8005010 tx=0x7f30c8016040).stop 2023-10-18T22:05:17.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.499+0000 7f30d9f5f700 1 -- 172.21.15.8:0/440993629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30d40f77d0 msgr2=0x7f30d4109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:17.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.499+0000 7f30d9f5f700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30d40f77d0 0x7f30d4109450 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f30c000e7f0 tx=0x7f30c000b040).stop 2023-10-18T22:05:17.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.500+0000 7f30d9f5f700 1 -- 172.21.15.8:0/440993629 shutdown_connections 2023-10-18T22:05:17.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.500+0000 7f30d9f5f700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f30c4060f70 0x7f30c4063430 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.500+0000 7f30d9f5f700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30d40f6530 0x7f30d4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.500+0000 7f30d9f5f700 1 --2- 172.21.15.8:0/440993629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30d40f77d0 0x7f30d4109450 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.500+0000 7f30d9f5f700 1 -- 172.21.15.8:0/440993629 >> 172.21.15.8:0/440993629 conn(0x7f30d40f1c90 msgr2=0x7f30d406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:17.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.500+0000 7f30d9f5f700 1 -- 172.21.15.8:0/440993629 shutdown_connections 2023-10-18T22:05:17.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.500+0000 7f30d9f5f700 1 -- 172.21.15.8:0/440993629 wait complete. 2023-10-18T22:05:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.635+0000 7f5934814700 1 -- 172.21.15.8:0/1905854230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59300f77d0 msgr2=0x7f59300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.635+0000 7f5934814700 1 --2- 172.21.15.8:0/1905854230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59300f77d0 0x7f59300f7c30 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f5924004660 tx=0x7f5924009b30).stop 2023-10-18T22:05:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.635+0000 7f5934814700 1 -- 172.21.15.8:0/1905854230 shutdown_connections 2023-10-18T22:05:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.635+0000 7f5934814700 1 --2- 172.21.15.8:0/1905854230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59300f77d0 0x7f59300f7c30 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.635+0000 7f5934814700 1 --2- 172.21.15.8:0/1905854230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300f6530 0x7f59300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.635+0000 7f5934814700 1 -- 172.21.15.8:0/1905854230 >> 172.21.15.8:0/1905854230 conn(0x7f59300f1c90 msgr2=0x7f59300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.635+0000 7f5934814700 1 -- 172.21.15.8:0/1905854230 shutdown_connections 2023-10-18T22:05:17.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.635+0000 7f5934814700 1 -- 172.21.15.8:0/1905854230 wait complete. 2023-10-18T22:05:17.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.636+0000 7f5934814700 1 Processor -- start 2023-10-18T22:05:17.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.636+0000 7f5934814700 1 -- start start 2023-10-18T22:05:17.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.636+0000 7f5934814700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300f6530 0x7f5930106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:17.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f5934814700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59300f77d0 0x7f5930107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:17.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f5934814700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5930107880 con 0x7f59300f77d0 2023-10-18T22:05:17.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f5934814700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301080c0 con 0x7f59300f6530 2023-10-18T22:05:17.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f592e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59300f77d0 0x7f5930107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:17.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f592e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59300f77d0 0x7f5930107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52876/0 (socket says 172.21.15.8:52876) 2023-10-18T22:05:17.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f592e59c700 1 -- 172.21.15.8:0/4208775337 learned_addr learned my addr 172.21.15.8:0/4208775337 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:17.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f592ed9d700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300f6530 0x7f5930106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:17.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f592e59c700 1 -- 172.21.15.8:0/4208775337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300f6530 msgr2=0x7f5930106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:17.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f592e59c700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300f6530 0x7f5930106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f592e59c700 1 -- 172.21.15.8:0/4208775337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5924005040 con 0x7f59300f77d0 2023-10-18T22:05:17.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.637+0000 7f592ed9d700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300f6530 0x7f5930106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:05:17.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.638+0000 7f592e59c700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59300f77d0 0x7f5930107280 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f5924009990 tx=0x7f5924009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:17.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.638+0000 7f59177fe700 1 -- 172.21.15.8:0/4208775337 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5924018070 con 0x7f59300f77d0 2023-10-18T22:05:17.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.638+0000 7f59177fe700 1 -- 172.21.15.8:0/4208775337 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5924009630 con 0x7f59300f77d0 2023-10-18T22:05:17.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.638+0000 7f5934814700 1 -- 172.21.15.8:0/4208775337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5930108340 con 0x7f59300f77d0 2023-10-18T22:05:17.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.638+0000 7f59177fe700 1 -- 172.21.15.8:0/4208775337 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f592401c400 con 0x7f59300f77d0 2023-10-18T22:05:17.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.638+0000 7f5934814700 1 -- 172.21.15.8:0/4208775337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5930108820 con 0x7f59300f77d0 2023-10-18T22:05:17.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.639+0000 7f5934814700 1 -- 172.21.15.8:0/4208775337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5930059100 con 0x7f59300f77d0 2023-10-18T22:05:17.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.640+0000 7f59177fe700 1 -- 172.21.15.8:0/4208775337 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f592401d9e0 con 0x7f59300f77d0 2023-10-18T22:05:17.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.641+0000 7f59177fe700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5918060f70 0x7f5918063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:17.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.641+0000 7f59177fe700 1 -- 172.21.15.8:0/4208775337 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f592407e700 con 0x7f59300f77d0 2023-10-18T22:05:17.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.641+0000 7f592ed9d700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5918060f70 0x7f5918063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:17.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.642+0000 7f592ed9d700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5918060f70 0x7f5918063430 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f5930107b50 tx=0x7f5920009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:17.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.645+0000 7f59177fe700 1 -- 172.21.15.8:0/4208775337 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f592404e2b0 con 0x7f59300f77d0 2023-10-18T22:05:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.900+0000 7f5934814700 1 -- 172.21.15.8:0/4208775337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5930045ad0 con 0x7f59300f77d0 2023-10-18T22:05:17.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.900+0000 7f59177fe700 1 -- 172.21.15.8:0/4208775337 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f59240518d0 con 0x7f59300f77d0 2023-10-18T22:05:17.902 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:05:17.902 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:05:17.902 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:05:17.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:05:17.903 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:05:17.903 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:05:17.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:05:17.903 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:05:17.904 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:05:17.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:05:17.904 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:05:17.904 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:05:17.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:05:17.905 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:05:17.905 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:05:17.905 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:05:17.905 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:05:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.902+0000 7f5934814700 1 -- 172.21.15.8:0/4208775337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5918060f70 msgr2=0x7f5918063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.902+0000 7f5934814700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5918060f70 0x7f5918063430 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f5930107b50 tx=0x7f5920009c00).stop 2023-10-18T22:05:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.902+0000 7f5934814700 1 -- 172.21.15.8:0/4208775337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59300f77d0 msgr2=0x7f5930107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.902+0000 7f5934814700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59300f77d0 0x7f5930107280 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f5924009990 tx=0x7f5924009b30).stop 2023-10-18T22:05:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.902+0000 7f5934814700 1 -- 172.21.15.8:0/4208775337 shutdown_connections 2023-10-18T22:05:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.902+0000 7f5934814700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5918060f70 0x7f5918063430 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.902+0000 7f5934814700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300f6530 0x7f5930106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.902+0000 7f5934814700 1 --2- 172.21.15.8:0/4208775337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59300f77d0 0x7f5930107280 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:17.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.902+0000 7f5934814700 1 -- 172.21.15.8:0/4208775337 >> 172.21.15.8:0/4208775337 conn(0x7f59300f1c90 msgr2=0x7f59300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:17.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.903+0000 7f5934814700 1 -- 172.21.15.8:0/4208775337 shutdown_connections 2023-10-18T22:05:17.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:17.903+0000 7f5934814700 1 -- 172.21.15.8:0/4208775337 wait complete. 2023-10-18T22:05:18.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.042+0000 7f1f521ff700 1 -- 172.21.15.8:0/1776141880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4c0f99e0 msgr2=0x7f1f4c0f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:18.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.042+0000 7f1f521ff700 1 --2- 172.21.15.8:0/1776141880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4c0f99e0 0x7f1f4c0f9e40 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f1f3c004660 tx=0x7f1f3c009b30).stop 2023-10-18T22:05:18.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.042+0000 7f1f521ff700 1 -- 172.21.15.8:0/1776141880 shutdown_connections 2023-10-18T22:05:18.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.042+0000 7f1f521ff700 1 --2- 172.21.15.8:0/1776141880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4c0f99e0 0x7f1f4c0f9e40 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.042+0000 7f1f521ff700 1 --2- 172.21.15.8:0/1776141880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f4c0f8740 0x7f1f4c0f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.042+0000 7f1f521ff700 1 -- 172.21.15.8:0/1776141880 >> 172.21.15.8:0/1776141880 conn(0x7f1f4c0f40e0 msgr2=0x7f1f4c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:18.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.042+0000 7f1f521ff700 1 -- 172.21.15.8:0/1776141880 shutdown_connections 2023-10-18T22:05:18.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.042+0000 7f1f521ff700 1 -- 172.21.15.8:0/1776141880 wait complete. 2023-10-18T22:05:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.043+0000 7f1f521ff700 1 Processor -- start 2023-10-18T22:05:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.043+0000 7f1f521ff700 1 -- start start 2023-10-18T22:05:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.043+0000 7f1f521ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4c0f8740 0x7f1f4c108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.043+0000 7f1f521ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f4c0f99e0 0x7f1f4c1093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.043+0000 7f1f521ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c109990 con 0x7f1f4c0f8740 2023-10-18T22:05:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.043+0000 7f1f521ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c109ad0 con 0x7f1f4c0f99e0 2023-10-18T22:05:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.044+0000 7f1f511fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4c0f8740 0x7f1f4c108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.044+0000 7f1f511fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4c0f8740 0x7f1f4c108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52896/0 (socket says 172.21.15.8:52896) 2023-10-18T22:05:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.044+0000 7f1f511fd700 1 -- 172.21.15.8:0/503963047 learned_addr learned my addr 172.21.15.8:0/503963047 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.044+0000 7f1f509fc700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f4c0f99e0 0x7f1f4c1093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.044+0000 7f1f511fd700 1 -- 172.21.15.8:0/503963047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f4c0f99e0 msgr2=0x7f1f4c1093e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.044+0000 7f1f511fd700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f4c0f99e0 0x7f1f4c1093e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.044+0000 7f1f511fd700 1 -- 172.21.15.8:0/503963047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c005040 con 0x7f1f4c0f8740 2023-10-18T22:05:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.044+0000 7f1f509fc700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f4c0f99e0 0x7f1f4c1093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:05:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.044+0000 7f1f511fd700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4c0f8740 0x7f1f4c108ef0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f1f4800e7c0 tx=0x7f1f4800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:18.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.045+0000 7f1f41ffb700 1 -- 172.21.15.8:0/503963047 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f480092e0 con 0x7f1f4c0f8740 2023-10-18T22:05:18.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.045+0000 7f1f41ffb700 1 -- 172.21.15.8:0/503963047 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1f4800f040 con 0x7f1f4c0f8740 2023-10-18T22:05:18.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.045+0000 7f1f41ffb700 1 -- 172.21.15.8:0/503963047 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f480147e0 con 0x7f1f4c0f8740 2023-10-18T22:05:18.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.045+0000 7f1f521ff700 1 -- 172.21.15.8:0/503963047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c10a470 con 0x7f1f4c0f8740 2023-10-18T22:05:18.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.045+0000 7f1f521ff700 1 -- 172.21.15.8:0/503963047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c10a960 con 0x7f1f4c0f8740 2023-10-18T22:05:18.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.046+0000 7f1f521ff700 1 -- 172.21.15.8:0/503963047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c045ad0 con 0x7f1f4c0f8740 2023-10-18T22:05:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.047+0000 7f1f41ffb700 1 -- 172.21.15.8:0/503963047 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1f4801b030 con 0x7f1f4c0f8740 2023-10-18T22:05:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.048+0000 7f1f41ffb700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 0x7f1f38063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.048+0000 7f1f41ffb700 1 -- 172.21.15.8:0/503963047 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1f4807ca70 con 0x7f1f4c0f8740 2023-10-18T22:05:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.048+0000 7f1f509fc700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 0x7f1f38063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.049+0000 7f1f509fc700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 0x7f1f38063430 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f1f3c0043d0 tx=0x7f1f3c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.052+0000 7f1f41ffb700 1 -- 172.21.15.8:0/503963047 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1f48050050 con 0x7f1f4c0f8740 2023-10-18T22:05:18.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.280+0000 7f1f521ff700 1 -- 172.21.15.8:0/503963047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1f4c027a00 con 0x7f1f4c0f8740 2023-10-18T22:05:18.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.281+0000 7f1f41ffb700 1 -- 172.21.15.8:0/503963047 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1f48019070 con 0x7f1f4c0f8740 2023-10-18T22:05:18.283 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:05:18.283 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:05:18.283 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:05:18.284 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:05:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:05:18.284 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:05:18.284 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:05:18.284 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:05:18.285 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:05:18.285 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:05:18.285 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:05:18.285 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:05:18.286 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:05:18.286 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:05:18.286 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:05:18.286 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:05:18.286 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:05:18.287 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:05:18.287 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:05:18.287 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:05:18.287 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:05:18.287 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:05:18.288 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:05:18.288 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:05:18.288 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:05:18.288 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:05:18.288 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:05:18.288 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:05:18.289 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:05:18.289 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:05:18.289 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:05:18.289 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:05:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:05:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:05:18.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 -- 172.21.15.8:0/503963047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 msgr2=0x7f1f38063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:18.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 0x7f1f38063430 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f1f3c0043d0 tx=0x7f1f3c00b040).stop 2023-10-18T22:05:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 -- 172.21.15.8:0/503963047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4c0f8740 msgr2=0x7f1f4c108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4c0f8740 0x7f1f4c108ef0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f1f4800e7c0 tx=0x7f1f4800b040).stop 2023-10-18T22:05:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 -- 172.21.15.8:0/503963047 shutdown_connections 2023-10-18T22:05:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 0x7f1f38063430 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f4c0f8740 0x7f1f4c108ef0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 --2- 172.21.15.8:0/503963047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f4c0f99e0 0x7f1f4c1093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 -- 172.21.15.8:0/503963047 >> 172.21.15.8:0/503963047 conn(0x7f1f4c0f40e0 msgr2=0x7f1f4c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 -- 172.21.15.8:0/503963047 shutdown_connections 2023-10-18T22:05:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.283+0000 7f1f521ff700 1 -- 172.21.15.8:0/503963047 wait complete. 2023-10-18T22:05:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:05:18.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:16.787504+0000 mgr.smithi008.flmjzp (mgr.14640) 3982 : audit [DBG] from='client.37240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:18.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:17.148821+0000 mgr.smithi008.flmjzp (mgr.14640) 3983 : audit [DBG] from='client.37244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:18.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:17.900916+0000 mon.smithi008 (mon.0) 4307 : audit [DBG] from='client.? 172.21.15.8:0/4208775337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:18.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.421+0000 7fd73ce82700 1 -- 172.21.15.8:0/108492085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7380f6530 msgr2=0x7fd7380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:18.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.421+0000 7fd73ce82700 1 --2- 172.21.15.8:0/108492085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7380f6530 0x7fd7380f6950 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fd728004660 tx=0x7fd728009b30).stop 2023-10-18T22:05:18.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.421+0000 7fd73ce82700 1 -- 172.21.15.8:0/108492085 shutdown_connections 2023-10-18T22:05:18.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.421+0000 7fd73ce82700 1 --2- 172.21.15.8:0/108492085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7380f77d0 0x7fd7380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.421+0000 7fd73ce82700 1 --2- 172.21.15.8:0/108492085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7380f6530 0x7fd7380f6950 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.421+0000 7fd73ce82700 1 -- 172.21.15.8:0/108492085 >> 172.21.15.8:0/108492085 conn(0x7fd7380f1c90 msgr2=0x7fd7380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:18.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.421+0000 7fd73ce82700 1 -- 172.21.15.8:0/108492085 shutdown_connections 2023-10-18T22:05:18.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.421+0000 7fd73ce82700 1 -- 172.21.15.8:0/108492085 wait complete. 2023-10-18T22:05:18.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.422+0000 7fd73ce82700 1 Processor -- start 2023-10-18T22:05:18.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.422+0000 7fd73ce82700 1 -- start start 2023-10-18T22:05:18.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.422+0000 7fd73ce82700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7380f6530 0x7fd738106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:18.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.422+0000 7fd73ce82700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7380f77d0 0x7fd738107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:18.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.422+0000 7fd73ce82700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd738107880 con 0x7fd7380f77d0 2023-10-18T22:05:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.422+0000 7fd73ce82700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7381080c0 con 0x7fd7380f6530 2023-10-18T22:05:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.423+0000 7fd736ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7380f77d0 0x7fd738107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.423+0000 7fd736ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7380f77d0 0x7fd738107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52916/0 (socket says 172.21.15.8:52916) 2023-10-18T22:05:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.423+0000 7fd736ffd700 1 -- 172.21.15.8:0/662292544 learned_addr learned my addr 172.21.15.8:0/662292544 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.423+0000 7fd7377fe700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7380f6530 0x7fd738106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.423+0000 7fd736ffd700 1 -- 172.21.15.8:0/662292544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7380f6530 msgr2=0x7fd738106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.423+0000 7fd736ffd700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7380f6530 0x7fd738106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.423+0000 7fd736ffd700 1 -- 172.21.15.8:0/662292544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd728005040 con 0x7fd7380f77d0 2023-10-18T22:05:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.423+0000 7fd736ffd700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7380f77d0 0x7fd738107280 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fd72c00e7f0 tx=0x7fd72c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.423+0000 7fd71ffff700 1 -- 172.21.15.8:0/662292544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72c0092e0 con 0x7fd7380f77d0 2023-10-18T22:05:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.424+0000 7fd71ffff700 1 -- 172.21.15.8:0/662292544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd72c00f040 con 0x7fd7380f77d0 2023-10-18T22:05:18.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.424+0000 7fd71ffff700 1 -- 172.21.15.8:0/662292544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72c0147e0 con 0x7fd7380f77d0 2023-10-18T22:05:18.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.424+0000 7fd73ce82700 1 -- 172.21.15.8:0/662292544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7381083a0 con 0x7fd7380f77d0 2023-10-18T22:05:18.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.424+0000 7fd73ce82700 1 -- 172.21.15.8:0/662292544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7381088e0 con 0x7fd7380f77d0 2023-10-18T22:05:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.425+0000 7fd73ce82700 1 -- 172.21.15.8:0/662292544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd738059100 con 0x7fd7380f77d0 2023-10-18T22:05:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.426+0000 7fd71ffff700 1 -- 172.21.15.8:0/662292544 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd72c01b030 con 0x7fd7380f77d0 2023-10-18T22:05:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.426+0000 7fd71ffff700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd720060f70 0x7fd720063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.426+0000 7fd71ffff700 1 -- 172.21.15.8:0/662292544 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd72c07c5f0 con 0x7fd7380f77d0 2023-10-18T22:05:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.427+0000 7fd7377fe700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd720060f70 0x7fd720063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.427+0000 7fd7377fe700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd720060f70 0x7fd720063430 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fd728005010 tx=0x7fd728016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.431+0000 7fd71ffff700 1 -- 172.21.15.8:0/662292544 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd72c04c310 con 0x7fd7380f77d0 2023-10-18T22:05:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:16.787504+0000 mgr.smithi008.flmjzp (mgr.14640) 3982 : audit [DBG] from='client.37240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:17.148821+0000 mgr.smithi008.flmjzp (mgr.14640) 3983 : audit [DBG] from='client.37244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:17.900916+0000 mon.smithi008 (mon.0) 4307 : audit [DBG] from='client.? 172.21.15.8:0/4208775337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:18.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.626+0000 7fd73ce82700 1 -- 172.21.15.8:0/662292544 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7380fed80 con 0x7fd720060f70 2023-10-18T22:05:18.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.627+0000 7fd71ffff700 1 -- 172.21.15.8:0/662292544 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd7380fed80 con 0x7fd720060f70 2023-10-18T22:05:18.629 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:05:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:05:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:05:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:05:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:05:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:05:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:05:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:05:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:05:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:05:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:05:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:05:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:05:18.632 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:05:18.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 -- 172.21.15.8:0/662292544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd720060f70 msgr2=0x7fd720063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:18.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd720060f70 0x7fd720063430 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fd728005010 tx=0x7fd728016040).stop 2023-10-18T22:05:18.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 -- 172.21.15.8:0/662292544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7380f77d0 msgr2=0x7fd738107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:18.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7380f77d0 0x7fd738107280 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fd72c00e7f0 tx=0x7fd72c00b040).stop 2023-10-18T22:05:18.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 -- 172.21.15.8:0/662292544 shutdown_connections 2023-10-18T22:05:18.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd720060f70 0x7fd720063430 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7380f6530 0x7fd738106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 --2- 172.21.15.8:0/662292544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7380f77d0 0x7fd738107280 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:18.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 -- 172.21.15.8:0/662292544 >> 172.21.15.8:0/662292544 conn(0x7fd7380f1c90 msgr2=0x7fd7380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:18.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 -- 172.21.15.8:0/662292544 shutdown_connections 2023-10-18T22:05:18.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:18.629+0000 7fd73ce82700 1 -- 172.21.15.8:0/662292544 wait complete. 2023-10-18T22:05:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:17.489272+0000 mgr.smithi008.flmjzp (mgr.14640) 3984 : audit [DBG] from='client.37248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:17.846169+0000 mgr.smithi008.flmjzp (mgr.14640) 3985 : cluster [DBG] pgmap v2736: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:19.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:18.281663+0000 mon.smithi008 (mon.0) 4308 : audit [DBG] from='client.? 172.21.15.8:0/503963047' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:05:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:17.489272+0000 mgr.smithi008.flmjzp (mgr.14640) 3984 : audit [DBG] from='client.37248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:17.846169+0000 mgr.smithi008.flmjzp (mgr.14640) 3985 : cluster [DBG] pgmap v2736: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:18.281663+0000 mon.smithi008 (mon.0) 4308 : audit [DBG] from='client.? 172.21.15.8:0/503963047' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:05:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:18.627493+0000 mgr.smithi008.flmjzp (mgr.14640) 3986 : audit [DBG] from='client.37260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:19.869868+0000 mon.smithi008 (mon.0) 4309 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:19.871981+0000 mon.smithi008 (mon.0) 4310 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:19.872951+0000 mon.smithi008 (mon.0) 4311 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:20.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:19.879578+0000 mon.smithi008 (mon.0) 4312 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:19.886132+0000 mon.smithi008 (mon.0) 4313 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:19.889108+0000 mon.smithi008 (mon.0) 4314 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:19.890742+0000 mon.smithi008 (mon.0) 4315 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:19.892365+0000 mon.smithi008 (mon.0) 4316 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:20.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:19.894262+0000 mon.smithi008 (mon.0) 4317 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:18.627493+0000 mgr.smithi008.flmjzp (mgr.14640) 3986 : audit [DBG] from='client.37260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:19.869868+0000 mon.smithi008 (mon.0) 4309 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:19.871981+0000 mon.smithi008 (mon.0) 4310 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:19.872951+0000 mon.smithi008 (mon.0) 4311 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:19.879578+0000 mon.smithi008 (mon.0) 4312 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:19.886132+0000 mon.smithi008 (mon.0) 4313 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:19.889108+0000 mon.smithi008 (mon.0) 4314 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:19.890742+0000 mon.smithi008 (mon.0) 4315 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:19.892365+0000 mon.smithi008 (mon.0) 4316 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:20.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:19.894262+0000 mon.smithi008 (mon.0) 4317 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:19.846694+0000 mgr.smithi008.flmjzp (mgr.14640) 3987 : cluster [DBG] pgmap v2737: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:05:19.873779+0000 mgr.smithi008.flmjzp (mgr.14640) 3988 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:19.874338+0000 mgr.smithi008.flmjzp (mgr.14640) 3989 : cluster [DBG] pgmap v2738: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:19.874630+0000 mgr.smithi008.flmjzp (mgr.14640) 3990 : cluster [DBG] pgmap v2739: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:05:19.896067+0000 mgr.smithi008.flmjzp (mgr.14640) 3991 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:19.846694+0000 mgr.smithi008.flmjzp (mgr.14640) 3987 : cluster [DBG] pgmap v2737: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:05:19.873779+0000 mgr.smithi008.flmjzp (mgr.14640) 3988 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:19.874338+0000 mgr.smithi008.flmjzp (mgr.14640) 3989 : cluster [DBG] pgmap v2738: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:19.874630+0000 mgr.smithi008.flmjzp (mgr.14640) 3990 : cluster [DBG] pgmap v2739: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:05:19.896067+0000 mgr.smithi008.flmjzp (mgr.14640) 3991 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:21.875278+0000 mgr.smithi008.flmjzp (mgr.14640) 3992 : cluster [DBG] pgmap v2740: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:21.875278+0000 mgr.smithi008.flmjzp (mgr.14640) 3992 : cluster [DBG] pgmap v2740: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:23.876052+0000 mgr.smithi008.flmjzp (mgr.14640) 3993 : cluster [DBG] pgmap v2741: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:23.876052+0000 mgr.smithi008.flmjzp (mgr.14640) 3993 : cluster [DBG] pgmap v2741: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:25.876782+0000 mgr.smithi008.flmjzp (mgr.14640) 3994 : cluster [DBG] pgmap v2742: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:25.876782+0000 mgr.smithi008.flmjzp (mgr.14640) 3994 : cluster [DBG] pgmap v2742: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:27.877519+0000 mgr.smithi008.flmjzp (mgr.14640) 3995 : cluster [DBG] pgmap v2743: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:27.877519+0000 mgr.smithi008.flmjzp (mgr.14640) 3995 : cluster [DBG] pgmap v2743: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:29.906098+0000 mon.smithi008 (mon.0) 4318 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:29.908352+0000 mon.smithi008 (mon.0) 4319 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:29.909442+0000 mon.smithi008 (mon.0) 4320 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:29.915939+0000 mon.smithi008 (mon.0) 4321 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:30.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:29.923742+0000 mon.smithi008 (mon.0) 4322 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:30.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:29.927297+0000 mon.smithi008 (mon.0) 4323 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:30.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:29.929344+0000 mon.smithi008 (mon.0) 4324 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:30.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:29.931253+0000 mon.smithi008 (mon.0) 4325 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:30.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:29.933970+0000 mon.smithi008 (mon.0) 4326 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:29.906098+0000 mon.smithi008 (mon.0) 4318 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:29.908352+0000 mon.smithi008 (mon.0) 4319 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:29.909442+0000 mon.smithi008 (mon.0) 4320 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:29.915939+0000 mon.smithi008 (mon.0) 4321 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:29.923742+0000 mon.smithi008 (mon.0) 4322 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:29.927297+0000 mon.smithi008 (mon.0) 4323 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:29.929344+0000 mon.smithi008 (mon.0) 4324 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:29.931253+0000 mon.smithi008 (mon.0) 4325 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:30.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:29.933970+0000 mon.smithi008 (mon.0) 4326 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:29.878236+0000 mgr.smithi008.flmjzp (mgr.14640) 3996 : cluster [DBG] pgmap v2744: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:05:29.910461+0000 mgr.smithi008.flmjzp (mgr.14640) 3997 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:29.911058+0000 mgr.smithi008.flmjzp (mgr.14640) 3998 : cluster [DBG] pgmap v2745: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:29.911392+0000 mgr.smithi008.flmjzp (mgr.14640) 3999 : cluster [DBG] pgmap v2746: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:31.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:05:29.936144+0000 mgr.smithi008.flmjzp (mgr.14640) 4000 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:29.878236+0000 mgr.smithi008.flmjzp (mgr.14640) 3996 : cluster [DBG] pgmap v2744: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:05:29.910461+0000 mgr.smithi008.flmjzp (mgr.14640) 3997 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:29.911058+0000 mgr.smithi008.flmjzp (mgr.14640) 3998 : cluster [DBG] pgmap v2745: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:29.911392+0000 mgr.smithi008.flmjzp (mgr.14640) 3999 : cluster [DBG] pgmap v2746: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:05:29.936144+0000 mgr.smithi008.flmjzp (mgr.14640) 4000 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:31.911885+0000 mgr.smithi008.flmjzp (mgr.14640) 4001 : cluster [DBG] pgmap v2747: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:31.911885+0000 mgr.smithi008.flmjzp (mgr.14640) 4001 : cluster [DBG] pgmap v2747: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:33.912379+0000 mgr.smithi008.flmjzp (mgr.14640) 4002 : cluster [DBG] pgmap v2748: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:33.912379+0000 mgr.smithi008.flmjzp (mgr.14640) 4002 : cluster [DBG] pgmap v2748: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:35.913164+0000 mgr.smithi008.flmjzp (mgr.14640) 4003 : cluster [DBG] pgmap v2749: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:35.913164+0000 mgr.smithi008.flmjzp (mgr.14640) 4003 : cluster [DBG] pgmap v2749: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:37.913810+0000 mgr.smithi008.flmjzp (mgr.14640) 4004 : cluster [DBG] pgmap v2750: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:37.913810+0000 mgr.smithi008.flmjzp (mgr.14640) 4004 : cluster [DBG] pgmap v2750: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:39.941108+0000 mon.smithi008 (mon.0) 4327 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:39.941108+0000 mon.smithi008 (mon.0) 4327 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:39.914566+0000 mgr.smithi008.flmjzp (mgr.14640) 4005 : cluster [DBG] pgmap v2751: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:40.505409+0000 mon.smithi008 (mon.0) 4328 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:41.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:40.506318+0000 mon.smithi008 (mon.0) 4329 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:40.512359+0000 mon.smithi008 (mon.0) 4330 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:40.517314+0000 mon.smithi008 (mon.0) 4331 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:41.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:40.519565+0000 mon.smithi008 (mon.0) 4332 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:41.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:40.520816+0000 mon.smithi008 (mon.0) 4333 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:41.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:40.521981+0000 mon.smithi008 (mon.0) 4334 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:41.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:40.523474+0000 mon.smithi008 (mon.0) 4335 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:39.914566+0000 mgr.smithi008.flmjzp (mgr.14640) 4005 : cluster [DBG] pgmap v2751: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:40.505409+0000 mon.smithi008 (mon.0) 4328 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:40.506318+0000 mon.smithi008 (mon.0) 4329 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:40.512359+0000 mon.smithi008 (mon.0) 4330 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:40.517314+0000 mon.smithi008 (mon.0) 4331 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:40.519565+0000 mon.smithi008 (mon.0) 4332 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:40.520816+0000 mon.smithi008 (mon.0) 4333 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:40.521981+0000 mon.smithi008 (mon.0) 4334 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:41.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:40.523474+0000 mon.smithi008 (mon.0) 4335 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:42.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:05:40.506979+0000 mgr.smithi008.flmjzp (mgr.14640) 4006 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:40.507509+0000 mgr.smithi008.flmjzp (mgr.14640) 4007 : cluster [DBG] pgmap v2752: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:40.507727+0000 mgr.smithi008.flmjzp (mgr.14640) 4008 : cluster [DBG] pgmap v2753: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:42.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:05:40.524963+0000 mgr.smithi008.flmjzp (mgr.14640) 4009 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:05:40.506979+0000 mgr.smithi008.flmjzp (mgr.14640) 4006 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:40.507509+0000 mgr.smithi008.flmjzp (mgr.14640) 4007 : cluster [DBG] pgmap v2752: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:40.507727+0000 mgr.smithi008.flmjzp (mgr.14640) 4008 : cluster [DBG] pgmap v2753: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:42.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:05:40.524963+0000 mgr.smithi008.flmjzp (mgr.14640) 4009 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:44.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:42.508318+0000 mgr.smithi008.flmjzp (mgr.14640) 4010 : cluster [DBG] pgmap v2754: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:42.508318+0000 mgr.smithi008.flmjzp (mgr.14640) 4010 : cluster [DBG] pgmap v2754: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:44.508833+0000 mgr.smithi008.flmjzp (mgr.14640) 4011 : cluster [DBG] pgmap v2755: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:44.508833+0000 mgr.smithi008.flmjzp (mgr.14640) 4011 : cluster [DBG] pgmap v2755: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:48.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:46.509351+0000 mgr.smithi008.flmjzp (mgr.14640) 4012 : cluster [DBG] pgmap v2756: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:46.509351+0000 mgr.smithi008.flmjzp (mgr.14640) 4012 : cluster [DBG] pgmap v2756: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:48.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.781+0000 7f3d89b08700 1 -- 172.21.15.8:0/188746323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d8406a3b0 msgr2=0x7f3d8406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:48.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.781+0000 7f3d89b08700 1 --2- 172.21.15.8:0/188746323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d8406a3b0 0x7f3d8406a830 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f3d70004660 tx=0x7f3d70009b30).stop 2023-10-18T22:05:48.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.781+0000 7f3d89b08700 1 -- 172.21.15.8:0/188746323 shutdown_connections 2023-10-18T22:05:48.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.781+0000 7f3d89b08700 1 --2- 172.21.15.8:0/188746323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d8406a3b0 0x7f3d8406a830 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:48.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.781+0000 7f3d89b08700 1 --2- 172.21.15.8:0/188746323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8406b9c0 0x7f3d84069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:48.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.781+0000 7f3d89b08700 1 -- 172.21.15.8:0/188746323 >> 172.21.15.8:0/188746323 conn(0x7f3d840f1c90 msgr2=0x7f3d840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:48.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.781+0000 7f3d89b08700 1 -- 172.21.15.8:0/188746323 shutdown_connections 2023-10-18T22:05:48.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.781+0000 7f3d89b08700 1 -- 172.21.15.8:0/188746323 wait complete. 2023-10-18T22:05:48.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.782+0000 7f3d89b08700 1 Processor -- start 2023-10-18T22:05:48.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.782+0000 7f3d89b08700 1 -- start start 2023-10-18T22:05:48.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.782+0000 7f3d89b08700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d8406a3b0 0x7f3d84108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:48.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.782+0000 7f3d89b08700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8406b9c0 0x7f3d841093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:48.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.782+0000 7f3d89b08700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d84109970 con 0x7f3d8406a3b0 2023-10-18T22:05:48.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.782+0000 7f3d89b08700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d84109ab0 con 0x7f3d8406b9c0 2023-10-18T22:05:48.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.783+0000 7f3d88b06700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d8406a3b0 0x7f3d84108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:48.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.783+0000 7f3d88b06700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d8406a3b0 0x7f3d84108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42778/0 (socket says 172.21.15.8:42778) 2023-10-18T22:05:48.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.783+0000 7f3d88b06700 1 -- 172.21.15.8:0/1390473309 learned_addr learned my addr 172.21.15.8:0/1390473309 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:48.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.783+0000 7f3d83fff700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8406b9c0 0x7f3d841093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:48.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.783+0000 7f3d88b06700 1 -- 172.21.15.8:0/1390473309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8406b9c0 msgr2=0x7f3d841093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.783+0000 7f3d88b06700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8406b9c0 0x7f3d841093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.783+0000 7f3d88b06700 1 -- 172.21.15.8:0/1390473309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70005040 con 0x7f3d8406a3b0 2023-10-18T22:05:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.783+0000 7f3d88b06700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d8406a3b0 0x7f3d84108ed0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f3d78002700 tx=0x7f3d78009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.784+0000 7f3d817fa700 1 -- 172.21.15.8:0/1390473309 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d78009320 con 0x7f3d8406a3b0 2023-10-18T22:05:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.784+0000 7f3d817fa700 1 -- 172.21.15.8:0/1390473309 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3d7800f040 con 0x7f3d8406a3b0 2023-10-18T22:05:48.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.784+0000 7f3d89b08700 1 -- 172.21.15.8:0/1390473309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8410a450 con 0x7f3d8406a3b0 2023-10-18T22:05:48.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.784+0000 7f3d817fa700 1 -- 172.21.15.8:0/1390473309 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d780148a0 con 0x7f3d8406a3b0 2023-10-18T22:05:48.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.784+0000 7f3d89b08700 1 -- 172.21.15.8:0/1390473309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8410aa10 con 0x7f3d8406a3b0 2023-10-18T22:05:48.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.785+0000 7f3d89b08700 1 -- 172.21.15.8:0/1390473309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d84045ad0 con 0x7f3d8406a3b0 2023-10-18T22:05:48.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.786+0000 7f3d817fa700 1 -- 172.21.15.8:0/1390473309 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3d78009480 con 0x7f3d8406a3b0 2023-10-18T22:05:48.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.786+0000 7f3d817fa700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d74060f70 0x7f3d74063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:48.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.787+0000 7f3d817fa700 1 -- 172.21.15.8:0/1390473309 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3d7807ccc0 con 0x7f3d8406a3b0 2023-10-18T22:05:48.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.787+0000 7f3d83fff700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d74060f70 0x7f3d74063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:48.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.787+0000 7f3d83fff700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d74060f70 0x7f3d74063430 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f3d70004630 tx=0x7f3d70009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:48.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.791+0000 7f3d817fa700 1 -- 172.21.15.8:0/1390473309 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3d780503d0 con 0x7f3d8406a3b0 2023-10-18T22:05:48.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.992+0000 7f3d89b08700 1 -- 172.21.15.8:0/1390473309 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d84101030 con 0x7f3d74060f70 2023-10-18T22:05:48.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.993+0000 7f3d817fa700 1 -- 172.21.15.8:0/1390473309 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3d84101030 con 0x7f3d74060f70 2023-10-18T22:05:48.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 -- 172.21.15.8:0/1390473309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d74060f70 msgr2=0x7f3d74063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d74060f70 0x7f3d74063430 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f3d70004630 tx=0x7f3d70009b30).stop 2023-10-18T22:05:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 -- 172.21.15.8:0/1390473309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d8406a3b0 msgr2=0x7f3d84108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d8406a3b0 0x7f3d84108ed0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f3d78002700 tx=0x7f3d78009e00).stop 2023-10-18T22:05:48.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 -- 172.21.15.8:0/1390473309 shutdown_connections 2023-10-18T22:05:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d74060f70 0x7f3d74063430 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d8406a3b0 0x7f3d84108ed0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 --2- 172.21.15.8:0/1390473309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8406b9c0 0x7f3d841093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 -- 172.21.15.8:0/1390473309 >> 172.21.15.8:0/1390473309 conn(0x7f3d840f1c90 msgr2=0x7f3d840fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:48.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 -- 172.21.15.8:0/1390473309 shutdown_connections 2023-10-18T22:05:49.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:48.995+0000 7f3d89b08700 1 -- 172.21.15.8:0/1390473309 wait complete. 2023-10-18T22:05:49.012 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:05:49.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.133+0000 7efd8759e700 1 -- 172.21.15.8:0/667905982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd880f77d0 msgr2=0x7efd880f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:49.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.133+0000 7efd8759e700 1 --2- 172.21.15.8:0/667905982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd880f77d0 0x7efd880f7c30 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7efd7c004660 tx=0x7efd7c009b30).stop 2023-10-18T22:05:49.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.133+0000 7efd8759e700 1 -- 172.21.15.8:0/667905982 shutdown_connections 2023-10-18T22:05:49.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.133+0000 7efd8759e700 1 --2- 172.21.15.8:0/667905982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd880f77d0 0x7efd880f7c30 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.133+0000 7efd8759e700 1 --2- 172.21.15.8:0/667905982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd880f6530 0x7efd880f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.133+0000 7efd8759e700 1 -- 172.21.15.8:0/667905982 >> 172.21.15.8:0/667905982 conn(0x7efd880f1c90 msgr2=0x7efd880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:49.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.133+0000 7efd8759e700 1 -- 172.21.15.8:0/667905982 shutdown_connections 2023-10-18T22:05:49.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.133+0000 7efd8759e700 1 -- 172.21.15.8:0/667905982 wait complete. 2023-10-18T22:05:49.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.134+0000 7efd8759e700 1 Processor -- start 2023-10-18T22:05:49.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.134+0000 7efd8759e700 1 -- start start 2023-10-18T22:05:49.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.134+0000 7efd8759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd880f6530 0x7efd88108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:49.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.134+0000 7efd8759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd880f77d0 0x7efd88109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:49.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.134+0000 7efd8759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd881099e0 con 0x7efd880f6530 2023-10-18T22:05:49.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.134+0000 7efd8759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd88109b20 con 0x7efd880f77d0 2023-10-18T22:05:49.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.135+0000 7efd8659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd880f6530 0x7efd88108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:49.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.135+0000 7efd8659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd880f6530 0x7efd88108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42804/0 (socket says 172.21.15.8:42804) 2023-10-18T22:05:49.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.135+0000 7efd8659c700 1 -- 172.21.15.8:0/1937526063 learned_addr learned my addr 172.21.15.8:0/1937526063 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:49.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.135+0000 7efd85d9b700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd880f77d0 0x7efd88109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:49.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.135+0000 7efd8659c700 1 -- 172.21.15.8:0/1937526063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd880f77d0 msgr2=0x7efd88109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:49.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.135+0000 7efd8659c700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd880f77d0 0x7efd88109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.135+0000 7efd8659c700 1 -- 172.21.15.8:0/1937526063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c005040 con 0x7efd880f6530 2023-10-18T22:05:49.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.135+0000 7efd8659c700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd880f6530 0x7efd88108f40 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7efd78002700 tx=0x7efd78009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:49.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.136+0000 7efd76ffd700 1 -- 172.21.15.8:0/1937526063 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd780079c0 con 0x7efd880f6530 2023-10-18T22:05:49.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.136+0000 7efd8759e700 1 -- 172.21.15.8:0/1937526063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8810a4c0 con 0x7efd880f6530 2023-10-18T22:05:49.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.136+0000 7efd76ffd700 1 -- 172.21.15.8:0/1937526063 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efd7800f040 con 0x7efd880f6530 2023-10-18T22:05:49.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.136+0000 7efd76ffd700 1 -- 172.21.15.8:0/1937526063 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd780148d0 con 0x7efd880f6530 2023-10-18T22:05:49.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.136+0000 7efd8759e700 1 -- 172.21.15.8:0/1937526063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8810aa80 con 0x7efd880f6530 2023-10-18T22:05:49.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.137+0000 7efd8759e700 1 -- 172.21.15.8:0/1937526063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd88045ad0 con 0x7efd880f6530 2023-10-18T22:05:49.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.138+0000 7efd76ffd700 1 -- 172.21.15.8:0/1937526063 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7efd7801b060 con 0x7efd880f6530 2023-10-18T22:05:49.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.139+0000 7efd76ffd700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd70060f70 0x7efd70063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:49.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.139+0000 7efd76ffd700 1 -- 172.21.15.8:0/1937526063 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7efd7807c7d0 con 0x7efd880f6530 2023-10-18T22:05:49.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.139+0000 7efd85d9b700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd70060f70 0x7efd70063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:49.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.140+0000 7efd85d9b700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd70060f70 0x7efd70063430 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7efd7c004630 tx=0x7efd7c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:49.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.143+0000 7efd76ffd700 1 -- 172.21.15.8:0/1937526063 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efd7804fdb0 con 0x7efd880f6530 2023-10-18T22:05:49.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.341+0000 7efd8759e700 1 -- 172.21.15.8:0/1937526063 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd8810ad00 con 0x7efd70060f70 2023-10-18T22:05:49.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.342+0000 7efd76ffd700 1 -- 172.21.15.8:0/1937526063 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efd8810ad00 con 0x7efd70060f70 2023-10-18T22:05:49.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 -- 172.21.15.8:0/1937526063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd70060f70 msgr2=0x7efd70063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:49.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd70060f70 0x7efd70063430 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7efd7c004630 tx=0x7efd7c009b30).stop 2023-10-18T22:05:49.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 -- 172.21.15.8:0/1937526063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd880f6530 msgr2=0x7efd88108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:49.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd880f6530 0x7efd88108f40 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7efd78002700 tx=0x7efd78009d80).stop 2023-10-18T22:05:49.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 -- 172.21.15.8:0/1937526063 shutdown_connections 2023-10-18T22:05:49.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd70060f70 0x7efd70063430 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd880f6530 0x7efd88108f40 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 --2- 172.21.15.8:0/1937526063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd880f77d0 0x7efd88109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 -- 172.21.15.8:0/1937526063 >> 172.21.15.8:0/1937526063 conn(0x7efd880f1c90 msgr2=0x7efd880f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:49.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 -- 172.21.15.8:0/1937526063 shutdown_connections 2023-10-18T22:05:49.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.344+0000 7efd8759e700 1 -- 172.21.15.8:0/1937526063 wait complete. 2023-10-18T22:05:49.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.480+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2099784661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcb0060310 msgr2=0x7fdcb00f9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:49.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.480+0000 7fdcb4c3a700 1 --2- 172.21.15.8:0/2099784661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcb0060310 0x7fdcb00f9100 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7fdca0004660 tx=0x7fdca0009b30).stop 2023-10-18T22:05:49.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.481+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2099784661 shutdown_connections 2023-10-18T22:05:49.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.481+0000 7fdcb4c3a700 1 --2- 172.21.15.8:0/2099784661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcb00f9680 0x7fdcb00fbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.481+0000 7fdcb4c3a700 1 --2- 172.21.15.8:0/2099784661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcb0060310 0x7fdcb00f9100 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.481+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2099784661 >> 172.21.15.8:0/2099784661 conn(0x7fdcb00f0b60 msgr2=0x7fdcb00f2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:49.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.481+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2099784661 shutdown_connections 2023-10-18T22:05:49.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.481+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2099784661 wait complete. 2023-10-18T22:05:49.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.481+0000 7fdcb4c3a700 1 Processor -- start 2023-10-18T22:05:49.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.482+0000 7fdcb4c3a700 1 -- start start 2023-10-18T22:05:49.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.482+0000 7fdcb4c3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcb0060310 0x7fdcb0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:49.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.482+0000 7fdcb4c3a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcb00f9680 0x7fdcb0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:49.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.482+0000 7fdcb4c3a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0109a00 con 0x7fdcb0060310 2023-10-18T22:05:49.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.482+0000 7fdcb4c3a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0109b40 con 0x7fdcb00f9680 2023-10-18T22:05:49.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.482+0000 7fdcaf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcb0060310 0x7fdcb0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:49.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.482+0000 7fdcaf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcb0060310 0x7fdcb0108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42814/0 (socket says 172.21.15.8:42814) 2023-10-18T22:05:49.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.482+0000 7fdcaf7fe700 1 -- 172.21.15.8:0/2106711073 learned_addr learned my addr 172.21.15.8:0/2106711073 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:49.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.482+0000 7fdcaeffd700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcb00f9680 0x7fdcb0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:49.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.483+0000 7fdcaf7fe700 1 -- 172.21.15.8:0/2106711073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcb00f9680 msgr2=0x7fdcb0109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:49.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.483+0000 7fdcaf7fe700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcb00f9680 0x7fdcb0109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.483+0000 7fdcaf7fe700 1 -- 172.21.15.8:0/2106711073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0005040 con 0x7fdcb0060310 2023-10-18T22:05:49.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.483+0000 7fdcaeffd700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcb00f9680 0x7fdcb0109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:05:49.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.483+0000 7fdcaf7fe700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcb0060310 0x7fdcb0108f60 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fdca0009990 tx=0x7fdca0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:49.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.483+0000 7fdc97fff700 1 -- 172.21.15.8:0/2106711073 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca0018070 con 0x7fdcb0060310 2023-10-18T22:05:49.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.483+0000 7fdc97fff700 1 -- 172.21.15.8:0/2106711073 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdca0009780 con 0x7fdcb0060310 2023-10-18T22:05:49.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.483+0000 7fdc97fff700 1 -- 172.21.15.8:0/2106711073 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca001c5a0 con 0x7fdcb0060310 2023-10-18T22:05:49.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.483+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2106711073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb010a480 con 0x7fdcb0060310 2023-10-18T22:05:49.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.483+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2106711073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb010a9e0 con 0x7fdcb0060310 2023-10-18T22:05:49.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.484+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2106711073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb0045ad0 con 0x7fdcb0060310 2023-10-18T22:05:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.485+0000 7fdc97fff700 1 -- 172.21.15.8:0/2106711073 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdca001db30 con 0x7fdcb0060310 2023-10-18T22:05:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.486+0000 7fdc97fff700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc98060f70 0x7fdc98063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:49.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.486+0000 7fdc97fff700 1 -- 172.21.15.8:0/2106711073 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdca007e860 con 0x7fdcb0060310 2023-10-18T22:05:49.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.487+0000 7fdcaeffd700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc98060f70 0x7fdc98063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:49.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.487+0000 7fdcaeffd700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc98060f70 0x7fdc98063430 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fdcb00600e0 tx=0x7fdca4009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:49.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.490+0000 7fdc97fff700 1 -- 172.21.15.8:0/2106711073 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdca0051ec0 con 0x7fdcb0060310 2023-10-18T22:05:49.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.682+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2106711073 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcb00f5620 con 0x7fdc98060f70 2023-10-18T22:05:49.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.691+0000 7fdc97fff700 1 -- 172.21.15.8:0/2106711073 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fdcb00f5620 con 0x7fdc98060f70 2023-10-18T22:05:49.694 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:05:49.694 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (72m) 9m ago 73m 17.2M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:05:49.694 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (66m) 9m ago 73m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:05:49.695 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (66m) 7m ago 73m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:05:49.695 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (72m) 9m ago 73m 27.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:05:49.695 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 70m - - 2023-10-18T22:05:49.695 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 69m - - 2023-10-18T22:05:49.697 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 69m - - 2023-10-18T22:05:49.697 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 69m - - 2023-10-18T22:05:49.697 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (67m) 9m ago 75m 527M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:05:49.697 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (66m) 7m ago 73m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:05:49.697 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (66m) 9m ago 75m 477M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:05:49.698 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (66m) 7m ago 72m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:05:49.698 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (73m) 9m ago 73m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:05:49.698 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (72m) 7m ago 72m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:05:49.698 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (66m) 9m ago 72m 550M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:05:49.699 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (64m) 9m ago 72m 441M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:05:49.699 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (63m) 9m ago 71m 345M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:05:49.699 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (63m) 7m ago 71m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:05:49.699 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (62m) 7m ago 71m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:05:49.699 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (61m) 7m ago 71m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:05:49.699 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (68m) 9m ago 73m 78.2M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:05:49.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2106711073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc98060f70 msgr2=0x7fdc98063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc98060f70 0x7fdc98063430 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fdcb00600e0 tx=0x7fdca4009040).stop 2023-10-18T22:05:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2106711073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcb0060310 msgr2=0x7fdcb0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcb0060310 0x7fdcb0108f60 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fdca0009990 tx=0x7fdca0009b30).stop 2023-10-18T22:05:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2106711073 shutdown_connections 2023-10-18T22:05:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc98060f70 0x7fdc98063430 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdcb0060310 0x7fdcb0108f60 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 --2- 172.21.15.8:0/2106711073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcb00f9680 0x7fdcb0109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2106711073 >> 172.21.15.8:0/2106711073 conn(0x7fdcb00f0b60 msgr2=0x7fdcb00f4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2106711073 shutdown_connections 2023-10-18T22:05:49.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.694+0000 7fdcb4c3a700 1 -- 172.21.15.8:0/2106711073 wait complete. 2023-10-18T22:05:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.829+0000 7fab77fff700 1 -- 172.21.15.8:0/964478429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab780f6530 msgr2=0x7fab780f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.829+0000 7fab77fff700 1 --2- 172.21.15.8:0/964478429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab780f6530 0x7fab780f6950 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7fab68004660 tx=0x7fab68009b30).stop 2023-10-18T22:05:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.829+0000 7fab77fff700 1 -- 172.21.15.8:0/964478429 shutdown_connections 2023-10-18T22:05:49.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.829+0000 7fab77fff700 1 --2- 172.21.15.8:0/964478429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab780f77d0 0x7fab780f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:05:49.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.829+0000 7fab77fff700 1 --2- 172.21.15.8:0/964478429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab780f6530 0x7fab780f6950 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.829+0000 7fab77fff700 1 -- 172.21.15.8:0/964478429 >> 172.21.15.8:0/964478429 conn(0x7fab780f1c90 msgr2=0x7fab780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.830+0000 7fab77fff700 1 -- 172.21.15.8:0/964478429 shutdown_connections 2023-10-18T22:05:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.830+0000 7fab77fff700 1 -- 172.21.15.8:0/964478429 wait complete. 2023-10-18T22:05:49.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.830+0000 7fab77fff700 1 Processor -- start 2023-10-18T22:05:49.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.831+0000 7fab77fff700 1 -- start start 2023-10-18T22:05:49.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.831+0000 7fab77fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab780f6530 0x7fab78106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:49.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.831+0000 7fab77fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab780f77d0 0x7fab78107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:49.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.831+0000 7fab77fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab781079b0 con 0x7fab780f6530 2023-10-18T22:05:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.831+0000 7fab77fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab78108130 con 0x7fab780f77d0 2023-10-18T22:05:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.831+0000 7fab76ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab780f6530 0x7fab78106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.831+0000 7fab76ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab780f6530 0x7fab78106e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42830/0 (socket says 172.21.15.8:42830) 2023-10-18T22:05:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.831+0000 7fab76ffd700 1 -- 172.21.15.8:0/3304228416 learned_addr learned my addr 172.21.15.8:0/3304228416 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:49.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.831+0000 7fab767fc700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab780f77d0 0x7fab78107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:49.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.832+0000 7fab76ffd700 1 -- 172.21.15.8:0/3304228416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab780f77d0 msgr2=0x7fab78107320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:49.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.832+0000 7fab76ffd700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab780f77d0 0x7fab78107320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:49.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.832+0000 7fab76ffd700 1 -- 172.21.15.8:0/3304228416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab68005040 con 0x7fab780f6530 2023-10-18T22:05:49.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.832+0000 7fab76ffd700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab780f6530 0x7fab78106e30 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7fab68007a70 tx=0x7fab68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:49.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.832+0000 7fab5f7fe700 1 -- 172.21.15.8:0/3304228416 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab68018070 con 0x7fab780f6530 2023-10-18T22:05:49.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.832+0000 7fab77fff700 1 -- 172.21.15.8:0/3304228416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab78108350 con 0x7fab780f6530 2023-10-18T22:05:49.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.832+0000 7fab5f7fe700 1 -- 172.21.15.8:0/3304228416 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fab6801d8e0 con 0x7fab780f6530 2023-10-18T22:05:49.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.832+0000 7fab77fff700 1 -- 172.21.15.8:0/3304228416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab781088b0 con 0x7fab780f6530 2023-10-18T22:05:49.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.832+0000 7fab5f7fe700 1 -- 172.21.15.8:0/3304228416 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6801c670 con 0x7fab780f6530 2023-10-18T22:05:49.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.833+0000 7fab77fff700 1 -- 172.21.15.8:0/3304228416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab78059100 con 0x7fab780f6530 2023-10-18T22:05:49.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.834+0000 7fab5f7fe700 1 -- 172.21.15.8:0/3304228416 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fab6801da50 con 0x7fab780f6530 2023-10-18T22:05:49.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.835+0000 7fab5f7fe700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab60060f70 0x7fab60063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:49.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.835+0000 7fab5f7fe700 1 -- 172.21.15.8:0/3304228416 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fab6807e8a0 con 0x7fab780f6530 2023-10-18T22:05:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.836+0000 7fab767fc700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab60060f70 0x7fab60063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.836+0000 7fab767fc700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab60060f70 0x7fab60063430 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fab6c00b790 tx=0x7fab6c008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:49.840+0000 7fab5f7fe700 1 -- 172.21.15.8:0/3304228416 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fab6804e510 con 0x7fab780f6530 2023-10-18T22:05:50.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.094+0000 7fab77fff700 1 -- 172.21.15.8:0/3304228416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fab78045ad0 con 0x7fab780f6530 2023-10-18T22:05:50.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.095+0000 7fab5f7fe700 1 -- 172.21.15.8:0/3304228416 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fab6801dce0 con 0x7fab780f6530 2023-10-18T22:05:50.098 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:05:50.099 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:05:50.099 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:05:50.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:05:50.100 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:05:50.100 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:05:50.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:05:50.101 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:05:50.101 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:05:50.101 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:05:50.102 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:05:50.102 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:05:50.102 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:05:50.103 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:05:50.103 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:05:50.103 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:05:50.104 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:05:50.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 -- 172.21.15.8:0/3304228416 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab60060f70 msgr2=0x7fab60063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:50.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab60060f70 0x7fab60063430 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fab6c00b790 tx=0x7fab6c008040).stop 2023-10-18T22:05:50.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 -- 172.21.15.8:0/3304228416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab780f6530 msgr2=0x7fab78106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:50.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab780f6530 0x7fab78106e30 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7fab68007a70 tx=0x7fab68009b30).stop 2023-10-18T22:05:50.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 -- 172.21.15.8:0/3304228416 shutdown_connections 2023-10-18T22:05:50.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab60060f70 0x7fab60063430 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab780f6530 0x7fab78106e30 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 --2- 172.21.15.8:0/3304228416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab780f77d0 0x7fab78107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 -- 172.21.15.8:0/3304228416 >> 172.21.15.8:0/3304228416 conn(0x7fab780f1c90 msgr2=0x7fab780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:50.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 -- 172.21.15.8:0/3304228416 shutdown_connections 2023-10-18T22:05:50.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.097+0000 7fab77fff700 1 -- 172.21.15.8:0/3304228416 wait complete. 2023-10-18T22:05:50.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.235+0000 7fdfc2735700 1 -- 172.21.15.8:0/422229274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfbc0f6530 msgr2=0x7fdfbc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:50.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.235+0000 7fdfc2735700 1 --2- 172.21.15.8:0/422229274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfbc0f6530 0x7fdfbc0f6950 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7fdfb8004660 tx=0x7fdfb8009b30).stop 2023-10-18T22:05:50.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.235+0000 7fdfc2735700 1 -- 172.21.15.8:0/422229274 shutdown_connections 2023-10-18T22:05:50.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.235+0000 7fdfc2735700 1 --2- 172.21.15.8:0/422229274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc0f77d0 0x7fdfbc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.235+0000 7fdfc2735700 1 --2- 172.21.15.8:0/422229274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfbc0f6530 0x7fdfbc0f6950 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.235+0000 7fdfc2735700 1 -- 172.21.15.8:0/422229274 >> 172.21.15.8:0/422229274 conn(0x7fdfbc0f1c90 msgr2=0x7fdfbc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:50.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.235+0000 7fdfc2735700 1 -- 172.21.15.8:0/422229274 shutdown_connections 2023-10-18T22:05:50.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.235+0000 7fdfc2735700 1 -- 172.21.15.8:0/422229274 wait complete. 2023-10-18T22:05:50.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.236+0000 7fdfc2735700 1 Processor -- start 2023-10-18T22:05:50.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.236+0000 7fdfc2735700 1 -- start start 2023-10-18T22:05:50.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.236+0000 7fdfc2735700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc0f6530 0x7fdfbc108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:50.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.236+0000 7fdfc2735700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfbc0f77d0 0x7fdfbc1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:50.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.236+0000 7fdfc2735700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc109a70 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.236+0000 7fdfc2735700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc109bb0 con 0x7fdfbc0f6530 2023-10-18T22:05:50.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.237+0000 7fdfc0f32700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfbc0f77d0 0x7fdfbc1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:50.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.237+0000 7fdfc0f32700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfbc0f77d0 0x7fdfbc1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42840/0 (socket says 172.21.15.8:42840) 2023-10-18T22:05:50.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.237+0000 7fdfc0f32700 1 -- 172.21.15.8:0/4005786393 learned_addr learned my addr 172.21.15.8:0/4005786393 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:50.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.237+0000 7fdfc1733700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc0f6530 0x7fdfbc108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:50.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.237+0000 7fdfc0f32700 1 -- 172.21.15.8:0/4005786393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc0f6530 msgr2=0x7fdfbc108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:50.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.237+0000 7fdfc0f32700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc0f6530 0x7fdfbc108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.237+0000 7fdfc0f32700 1 -- 172.21.15.8:0/4005786393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8005040 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.237+0000 7fdfc0f32700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfbc0f77d0 0x7fdfbc1094c0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fdfac0026d0 tx=0x7fdfac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:50.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.238+0000 7fdfb1ffb700 1 -- 172.21.15.8:0/4005786393 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfac009320 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.238+0000 7fdfb1ffb700 1 -- 172.21.15.8:0/4005786393 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdfac00f040 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.238+0000 7fdfc2735700 1 -- 172.21.15.8:0/4005786393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc10a550 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.238+0000 7fdfb1ffb700 1 -- 172.21.15.8:0/4005786393 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfac0148a0 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.238+0000 7fdfc2735700 1 -- 172.21.15.8:0/4005786393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc10ab10 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.239+0000 7fdfc2735700 1 -- 172.21.15.8:0/4005786393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc045ad0 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.240+0000 7fdfb1ffb700 1 -- 172.21.15.8:0/4005786393 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdfac009480 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.241+0000 7fdfb1ffb700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfa8060f70 0x7fdfa8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:50.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.241+0000 7fdfb1ffb700 1 -- 172.21.15.8:0/4005786393 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdfac07cfd0 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.241+0000 7fdfc1733700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfa8060f70 0x7fdfa8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:50.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.242+0000 7fdfc1733700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfa8060f70 0x7fdfa8063430 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7fdfb8004e30 tx=0x7fdfb8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:50.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.245+0000 7fdfb1ffb700 1 -- 172.21.15.8:0/4005786393 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdfac050670 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:48.509817+0000 mgr.smithi008.flmjzp (mgr.14640) 4013 : cluster [DBG] pgmap v2757: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:50.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:48.994485+0000 mgr.smithi008.flmjzp (mgr.14640) 4014 : audit [DBG] from='client.37264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:50.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.096548+0000 mon.smithi008 (mon.0) 4336 : audit [DBG] from='client.? 172.21.15.8:0/3304228416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:50.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.472+0000 7fdfc2735700 1 -- 172.21.15.8:0/4005786393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdfbc10ad90 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.473+0000 7fdfb1ffb700 1 -- 172.21.15.8:0/4005786393 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fdfac0181b0 con 0x7fdfbc0f77d0 2023-10-18T22:05:50.476 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:05:50.476 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:05:50.476 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:05:50.476 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:05:50.477 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:05:50.477 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:05:50.477 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:05:50.477 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:05:50.477 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:05:50.478 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:05:50.478 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:05:50.478 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:05:50.478 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:05:50.478 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:05:50.479 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:05:50.479 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:05:50.479 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:05:50.479 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:05:50.479 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:05:50.480 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:05:50.480 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:05:50.480 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:05:50.480 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:05:50.480 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:05:50.481 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:05:50.481 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:05:50.481 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:05:50.481 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:05:50.481 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:05:50.482 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:05:50.482 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:05:50.482 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:05:50.482 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:05:50.482 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:05:50.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 -- 172.21.15.8:0/4005786393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfa8060f70 msgr2=0x7fdfa8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:50.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfa8060f70 0x7fdfa8063430 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7fdfb8004e30 tx=0x7fdfb8009b30).stop 2023-10-18T22:05:50.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 -- 172.21.15.8:0/4005786393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfbc0f77d0 msgr2=0x7fdfbc1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:50.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfbc0f77d0 0x7fdfbc1094c0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fdfac0026d0 tx=0x7fdfac009de0).stop 2023-10-18T22:05:50.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 -- 172.21.15.8:0/4005786393 shutdown_connections 2023-10-18T22:05:50.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfa8060f70 0x7fdfa8063430 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc0f6530 0x7fdfbc108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 --2- 172.21.15.8:0/4005786393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfbc0f77d0 0x7fdfbc1094c0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 -- 172.21.15.8:0/4005786393 >> 172.21.15.8:0/4005786393 conn(0x7fdfbc0f1c90 msgr2=0x7fdfbc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:50.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 -- 172.21.15.8:0/4005786393 shutdown_connections 2023-10-18T22:05:50.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.475+0000 7fdfc2735700 1 -- 172.21.15.8:0/4005786393 wait complete. 2023-10-18T22:05:50.486 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:05:50.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:48.509817+0000 mgr.smithi008.flmjzp (mgr.14640) 4013 : cluster [DBG] pgmap v2757: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:50.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:48.994485+0000 mgr.smithi008.flmjzp (mgr.14640) 4014 : audit [DBG] from='client.37264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:50.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.096548+0000 mon.smithi008 (mon.0) 4336 : audit [DBG] from='client.? 172.21.15.8:0/3304228416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:50.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.615+0000 7fec9759e700 1 -- 172.21.15.8:0/1639604045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 msgr2=0x7fec980f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.615+0000 7fec9759e700 1 --2- 172.21.15.8:0/1639604045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 0x7fec980f7c30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fec8c004660 tx=0x7fec8c009b30).stop 2023-10-18T22:05:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.615+0000 7fec9759e700 1 -- 172.21.15.8:0/1639604045 shutdown_connections 2023-10-18T22:05:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.615+0000 7fec9759e700 1 --2- 172.21.15.8:0/1639604045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f77d0 0x7fec980f7c30 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.615+0000 7fec9759e700 1 --2- 172.21.15.8:0/1639604045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f6530 0x7fec980f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.615+0000 7fec9759e700 1 -- 172.21.15.8:0/1639604045 >> 172.21.15.8:0/1639604045 conn(0x7fec980f1c90 msgr2=0x7fec980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.615+0000 7fec9759e700 1 -- 172.21.15.8:0/1639604045 shutdown_connections 2023-10-18T22:05:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.615+0000 7fec9759e700 1 -- 172.21.15.8:0/1639604045 wait complete. 2023-10-18T22:05:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.616+0000 7fec9759e700 1 Processor -- start 2023-10-18T22:05:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.616+0000 7fec9759e700 1 -- start start 2023-10-18T22:05:50.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.616+0000 7fec9759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f6530 0x7fec98108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:50.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.616+0000 7fec9759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f77d0 0x7fec98109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:50.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.616+0000 7fec9759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec98109a20 con 0x7fec980f6530 2023-10-18T22:05:50.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.616+0000 7fec9759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec98109b60 con 0x7fec980f77d0 2023-10-18T22:05:50.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.616+0000 7fec9659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f6530 0x7fec98108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:50.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.616+0000 7fec9659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f6530 0x7fec98108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42854/0 (socket says 172.21.15.8:42854) 2023-10-18T22:05:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.616+0000 7fec9659c700 1 -- 172.21.15.8:0/393621117 learned_addr learned my addr 172.21.15.8:0/393621117 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:05:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.617+0000 7fec95d9b700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f77d0 0x7fec98109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.617+0000 7fec9659c700 1 -- 172.21.15.8:0/393621117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f77d0 msgr2=0x7fec98109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.617+0000 7fec9659c700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f77d0 0x7fec98109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.617+0000 7fec9659c700 1 -- 172.21.15.8:0/393621117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c005040 con 0x7fec980f6530 2023-10-18T22:05:50.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.617+0000 7fec9659c700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f6530 0x7fec98108f80 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7fec88002700 tx=0x7fec88009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:50.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.617+0000 7fec86ffd700 1 -- 172.21.15.8:0/393621117 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec880079c0 con 0x7fec980f6530 2023-10-18T22:05:50.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.617+0000 7fec86ffd700 1 -- 172.21.15.8:0/393621117 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fec8800f040 con 0x7fec980f6530 2023-10-18T22:05:50.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.617+0000 7fec9759e700 1 -- 172.21.15.8:0/393621117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9810a500 con 0x7fec980f6530 2023-10-18T22:05:50.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.617+0000 7fec86ffd700 1 -- 172.21.15.8:0/393621117 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec880148d0 con 0x7fec980f6530 2023-10-18T22:05:50.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.618+0000 7fec9759e700 1 -- 172.21.15.8:0/393621117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9810aac0 con 0x7fec980f6530 2023-10-18T22:05:50.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.619+0000 7fec9759e700 1 -- 172.21.15.8:0/393621117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec98045ad0 con 0x7fec980f6530 2023-10-18T22:05:50.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.619+0000 7fec86ffd700 1 -- 172.21.15.8:0/393621117 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fec8801b060 con 0x7fec980f6530 2023-10-18T22:05:50.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.620+0000 7fec86ffd700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 0x7fec80063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:05:50.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.620+0000 7fec86ffd700 1 -- 172.21.15.8:0/393621117 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fec8807c710 con 0x7fec980f6530 2023-10-18T22:05:50.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.620+0000 7fec95d9b700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 0x7fec80063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:05:50.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.621+0000 7fec95d9b700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 0x7fec80063430 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fec8c004630 tx=0x7fec8c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:05:50.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.625+0000 7fec86ffd700 1 -- 172.21.15.8:0/393621117 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fec8804fdb0 con 0x7fec980f6530 2023-10-18T22:05:50.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.822+0000 7fec9759e700 1 -- 172.21.15.8:0/393621117 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec9810ad40 con 0x7fec80060f70 2023-10-18T22:05:50.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.824+0000 7fec86ffd700 1 -- 172.21.15.8:0/393621117 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fec9810ad40 con 0x7fec80060f70 2023-10-18T22:05:50.827 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:05:50.827 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:05:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:05:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:05:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:05:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:05:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:05:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:05:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:05:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:05:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:05:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:05:50.830 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:05:50.830 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:05:50.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.826+0000 7fec9759e700 1 -- 172.21.15.8:0/393621117 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 msgr2=0x7fec80063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:50.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.826+0000 7fec9759e700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 0x7fec80063430 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fec8c004630 tx=0x7fec8c009b30).stop 2023-10-18T22:05:50.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.826+0000 7fec9759e700 1 -- 172.21.15.8:0/393621117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f6530 msgr2=0x7fec98108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:05:50.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.826+0000 7fec9759e700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f6530 0x7fec98108f80 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7fec88002700 tx=0x7fec88009d80).stop 2023-10-18T22:05:50.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.826+0000 7fec9759e700 1 -- 172.21.15.8:0/393621117 shutdown_connections 2023-10-18T22:05:50.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.826+0000 7fec9759e700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec80060f70 0x7fec80063430 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.826+0000 7fec9759e700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec980f6530 0x7fec98108f80 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.826+0000 7fec9759e700 1 --2- 172.21.15.8:0/393621117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec980f77d0 0x7fec98109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:05:50.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.826+0000 7fec9759e700 1 -- 172.21.15.8:0/393621117 >> 172.21.15.8:0/393621117 conn(0x7fec980f1c90 msgr2=0x7fec9806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:05:50.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.827+0000 7fec9759e700 1 -- 172.21.15.8:0/393621117 shutdown_connections 2023-10-18T22:05:50.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:05:50.827+0000 7fec9759e700 1 -- 172.21.15.8:0/393621117 wait complete. 2023-10-18T22:05:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:49.343510+0000 mgr.smithi008.flmjzp (mgr.14640) 4015 : audit [DBG] from='client.37268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:49.684372+0000 mgr.smithi008.flmjzp (mgr.14640) 4016 : audit [DBG] from='client.37272 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.474673+0000 mon.smithi008 (mon.0) 4337 : audit [DBG] from='client.? 172.21.15.8:0/4005786393' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:05:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.534983+0000 mon.smithi008 (mon.0) 4338 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.536771+0000 mon.smithi008 (mon.0) 4339 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:51.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.537507+0000 mon.smithi008 (mon.0) 4340 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.544061+0000 mon.smithi008 (mon.0) 4341 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.549101+0000 mon.smithi008 (mon.0) 4342 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.551510+0000 mon.smithi008 (mon.0) 4343 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:51.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.552812+0000 mon.smithi008 (mon.0) 4344 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:51.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.554091+0000 mon.smithi008 (mon.0) 4345 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:51.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.555614+0000 mon.smithi008 (mon.0) 4346 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:49.343510+0000 mgr.smithi008.flmjzp (mgr.14640) 4015 : audit [DBG] from='client.37268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:49.684372+0000 mgr.smithi008.flmjzp (mgr.14640) 4016 : audit [DBG] from='client.37272 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.474673+0000 mon.smithi008 (mon.0) 4337 : audit [DBG] from='client.? 172.21.15.8:0/4005786393' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:05:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.534983+0000 mon.smithi008 (mon.0) 4338 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.536771+0000 mon.smithi008 (mon.0) 4339 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:05:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.537507+0000 mon.smithi008 (mon.0) 4340 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:05:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.544061+0000 mon.smithi008 (mon.0) 4341 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:05:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.549101+0000 mon.smithi008 (mon.0) 4342 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:05:51.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.551510+0000 mon.smithi008 (mon.0) 4343 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:51.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.552812+0000 mon.smithi008 (mon.0) 4344 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:51.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.554091+0000 mon.smithi008 (mon.0) 4345 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:51.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.555614+0000 mon.smithi008 (mon.0) 4346 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:05:52.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:50.510276+0000 mgr.smithi008.flmjzp (mgr.14640) 4017 : cluster [DBG] pgmap v2758: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:52.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:05:50.538187+0000 mgr.smithi008.flmjzp (mgr.14640) 4018 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:52.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:50.538691+0000 mgr.smithi008.flmjzp (mgr.14640) 4019 : cluster [DBG] pgmap v2759: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:52.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:50.539008+0000 mgr.smithi008.flmjzp (mgr.14640) 4020 : cluster [DBG] pgmap v2760: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:52.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:05:50.557159+0000 mgr.smithi008.flmjzp (mgr.14640) 4021 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:52.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:05:50.825341+0000 mgr.smithi008.flmjzp (mgr.14640) 4022 : audit [DBG] from='client.37284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:50.510276+0000 mgr.smithi008.flmjzp (mgr.14640) 4017 : cluster [DBG] pgmap v2758: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:05:50.538187+0000 mgr.smithi008.flmjzp (mgr.14640) 4018 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:05:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:50.538691+0000 mgr.smithi008.flmjzp (mgr.14640) 4019 : cluster [DBG] pgmap v2759: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:50.539008+0000 mgr.smithi008.flmjzp (mgr.14640) 4020 : cluster [DBG] pgmap v2760: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:05:50.557159+0000 mgr.smithi008.flmjzp (mgr.14640) 4021 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:05:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:05:50.825341+0000 mgr.smithi008.flmjzp (mgr.14640) 4022 : audit [DBG] from='client.37284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:05:54.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:52.539576+0000 mgr.smithi008.flmjzp (mgr.14640) 4023 : cluster [DBG] pgmap v2761: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:52.539576+0000 mgr.smithi008.flmjzp (mgr.14640) 4023 : cluster [DBG] pgmap v2761: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:54.540327+0000 mgr.smithi008.flmjzp (mgr.14640) 4024 : cluster [DBG] pgmap v2762: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:54.540327+0000 mgr.smithi008.flmjzp (mgr.14640) 4024 : cluster [DBG] pgmap v2762: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:58.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:05:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:56.540893+0000 mgr.smithi008.flmjzp (mgr.14640) 4025 : cluster [DBG] pgmap v2763: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:05:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:05:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:56.540893+0000 mgr.smithi008.flmjzp (mgr.14640) 4025 : cluster [DBG] pgmap v2763: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:05:58.541630+0000 mgr.smithi008.flmjzp (mgr.14640) 4026 : cluster [DBG] pgmap v2764: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:05:58.541630+0000 mgr.smithi008.flmjzp (mgr.14640) 4026 : cluster [DBG] pgmap v2764: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:01.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:00.564063+0000 mon.smithi008 (mon.0) 4347 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:01.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:00.564063+0000 mon.smithi008 (mon.0) 4347 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:02.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:00.542134+0000 mgr.smithi008.flmjzp (mgr.14640) 4027 : cluster [DBG] pgmap v2765: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:00.542134+0000 mgr.smithi008.flmjzp (mgr.14640) 4027 : cluster [DBG] pgmap v2765: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:04.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:02.542689+0000 mgr.smithi008.flmjzp (mgr.14640) 4028 : cluster [DBG] pgmap v2766: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:02.542689+0000 mgr.smithi008.flmjzp (mgr.14640) 4028 : cluster [DBG] pgmap v2766: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:04.543121+0000 mgr.smithi008.flmjzp (mgr.14640) 4029 : cluster [DBG] pgmap v2767: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:04.887240+0000 mon.smithi008 (mon.0) 4348 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:06.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:04.888145+0000 mon.smithi008 (mon.0) 4349 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:06.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:04.888911+0000 mon.smithi008 (mon.0) 4350 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:06.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:04.889539+0000 mgr.smithi008.flmjzp (mgr.14640) 4030 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:06.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:04.890000+0000 mgr.smithi008.flmjzp (mgr.14640) 4031 : cluster [DBG] pgmap v2768: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:06.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:04.890231+0000 mgr.smithi008.flmjzp (mgr.14640) 4032 : cluster [DBG] pgmap v2769: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:06.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:04.893420+0000 mon.smithi008 (mon.0) 4351 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:06.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:04.898469+0000 mon.smithi008 (mon.0) 4352 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:06.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:04.900905+0000 mon.smithi008 (mon.0) 4353 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:06.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:04.902145+0000 mon.smithi008 (mon.0) 4354 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:06.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:04.903304+0000 mon.smithi008 (mon.0) 4355 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:06.173 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:04.904822+0000 mon.smithi008 (mon.0) 4356 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:06.174 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:04.906311+0000 mgr.smithi008.flmjzp (mgr.14640) 4033 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:04.543121+0000 mgr.smithi008.flmjzp (mgr.14640) 4029 : cluster [DBG] pgmap v2767: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:06.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:04.887240+0000 mon.smithi008 (mon.0) 4348 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:04.888145+0000 mon.smithi008 (mon.0) 4349 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:04.888911+0000 mon.smithi008 (mon.0) 4350 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:04.889539+0000 mgr.smithi008.flmjzp (mgr.14640) 4030 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:06.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:04.890000+0000 mgr.smithi008.flmjzp (mgr.14640) 4031 : cluster [DBG] pgmap v2768: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:06.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:04.890231+0000 mgr.smithi008.flmjzp (mgr.14640) 4032 : cluster [DBG] pgmap v2769: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:06.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:04.893420+0000 mon.smithi008 (mon.0) 4351 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:06.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:04.898469+0000 mon.smithi008 (mon.0) 4352 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:06.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:04.900905+0000 mon.smithi008 (mon.0) 4353 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:06.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:04.902145+0000 mon.smithi008 (mon.0) 4354 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:06.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:04.903304+0000 mon.smithi008 (mon.0) 4355 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:06.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:04.904822+0000 mon.smithi008 (mon.0) 4356 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:06.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:04.906311+0000 mgr.smithi008.flmjzp (mgr.14640) 4033 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:08.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:06.890789+0000 mgr.smithi008.flmjzp (mgr.14640) 4034 : cluster [DBG] pgmap v2770: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:06.890789+0000 mgr.smithi008.flmjzp (mgr.14640) 4034 : cluster [DBG] pgmap v2770: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:08.891569+0000 mgr.smithi008.flmjzp (mgr.14640) 4035 : cluster [DBG] pgmap v2771: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:08.891569+0000 mgr.smithi008.flmjzp (mgr.14640) 4035 : cluster [DBG] pgmap v2771: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:12.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:10.892062+0000 mgr.smithi008.flmjzp (mgr.14640) 4036 : cluster [DBG] pgmap v2772: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:10.892062+0000 mgr.smithi008.flmjzp (mgr.14640) 4036 : cluster [DBG] pgmap v2772: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:14.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:12.892766+0000 mgr.smithi008.flmjzp (mgr.14640) 4037 : cluster [DBG] pgmap v2773: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:12.892766+0000 mgr.smithi008.flmjzp (mgr.14640) 4037 : cluster [DBG] pgmap v2773: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:14.917119+0000 mon.smithi008 (mon.0) 4357 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:14.919370+0000 mon.smithi008 (mon.0) 4358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:14.920347+0000 mon.smithi008 (mon.0) 4359 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:14.926730+0000 mon.smithi008 (mon.0) 4360 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:14.933179+0000 mon.smithi008 (mon.0) 4361 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:14.936200+0000 mon.smithi008 (mon.0) 4362 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:15.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:14.937904+0000 mon.smithi008 (mon.0) 4363 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:15.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:14.939554+0000 mon.smithi008 (mon.0) 4364 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:15.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:14.941545+0000 mon.smithi008 (mon.0) 4365 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:14.917119+0000 mon.smithi008 (mon.0) 4357 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:14.919370+0000 mon.smithi008 (mon.0) 4358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:14.920347+0000 mon.smithi008 (mon.0) 4359 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:14.926730+0000 mon.smithi008 (mon.0) 4360 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:14.933179+0000 mon.smithi008 (mon.0) 4361 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:14.936200+0000 mon.smithi008 (mon.0) 4362 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:14.937904+0000 mon.smithi008 (mon.0) 4363 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:15.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:14.939554+0000 mon.smithi008 (mon.0) 4364 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:15.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:14.941545+0000 mon.smithi008 (mon.0) 4365 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:14.893557+0000 mgr.smithi008.flmjzp (mgr.14640) 4038 : cluster [DBG] pgmap v2774: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:14.921238+0000 mgr.smithi008.flmjzp (mgr.14640) 4039 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:14.921816+0000 mgr.smithi008.flmjzp (mgr.14640) 4040 : cluster [DBG] pgmap v2775: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:14.922133+0000 mgr.smithi008.flmjzp (mgr.14640) 4041 : cluster [DBG] pgmap v2776: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:14.943418+0000 mgr.smithi008.flmjzp (mgr.14640) 4042 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:14.893557+0000 mgr.smithi008.flmjzp (mgr.14640) 4038 : cluster [DBG] pgmap v2774: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:14.921238+0000 mgr.smithi008.flmjzp (mgr.14640) 4039 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:14.921816+0000 mgr.smithi008.flmjzp (mgr.14640) 4040 : cluster [DBG] pgmap v2775: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:14.922133+0000 mgr.smithi008.flmjzp (mgr.14640) 4041 : cluster [DBG] pgmap v2776: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:14.943418+0000 mgr.smithi008.flmjzp (mgr.14640) 4042 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:18.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:16.922806+0000 mgr.smithi008.flmjzp (mgr.14640) 4043 : cluster [DBG] pgmap v2777: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:16.922806+0000 mgr.smithi008.flmjzp (mgr.14640) 4043 : cluster [DBG] pgmap v2777: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:20.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:18.923524+0000 mgr.smithi008.flmjzp (mgr.14640) 4044 : cluster [DBG] pgmap v2778: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:18.923524+0000 mgr.smithi008.flmjzp (mgr.14640) 4044 : cluster [DBG] pgmap v2778: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:20.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.981+0000 7f8731d9b700 1 -- 172.21.15.8:0/1869456425 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8728013a50 con 0x7f87340f9680 2023-10-18T22:06:20.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.981+0000 7f8738991700 1 -- 172.21.15.8:0/1869456425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87340f9680 msgr2=0x7f87340fbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:20.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.981+0000 7f8738991700 1 --2- 172.21.15.8:0/1869456425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87340f9680 0x7f87340fbad0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f8728004660 tx=0x7f8728009b30).stop 2023-10-18T22:06:20.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.981+0000 7f8738991700 1 -- 172.21.15.8:0/1869456425 shutdown_connections 2023-10-18T22:06:20.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.981+0000 7f8738991700 1 --2- 172.21.15.8:0/1869456425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87340f9680 0x7f87340fbad0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:20.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.981+0000 7f8738991700 1 --2- 172.21.15.8:0/1869456425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8734060310 0x7f87340f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:20.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.981+0000 7f8738991700 1 -- 172.21.15.8:0/1869456425 >> 172.21.15.8:0/1869456425 conn(0x7f87340f0b60 msgr2=0x7f87340f2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:20.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.981+0000 7f8738991700 1 -- 172.21.15.8:0/1869456425 shutdown_connections 2023-10-18T22:06:20.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.981+0000 7f8738991700 1 -- 172.21.15.8:0/1869456425 wait complete. 2023-10-18T22:06:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.982+0000 7f8738991700 1 Processor -- start 2023-10-18T22:06:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.982+0000 7f8738991700 1 -- start start 2023-10-18T22:06:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f8738991700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8734060310 0x7f8734106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f8738991700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87340f9680 0x7f8734107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f8738991700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87341077f0 con 0x7f87340f9680 2023-10-18T22:06:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f8738991700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8734107ff0 con 0x7f8734060310 2023-10-18T22:06:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f873259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87340f9680 0x7f8734107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f873259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87340f9680 0x7f8734107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58270/0 (socket says 172.21.15.8:58270) 2023-10-18T22:06:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f873259c700 1 -- 172.21.15.8:0/112662823 learned_addr learned my addr 172.21.15.8:0/112662823 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f8732d9d700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8734060310 0x7f8734106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f873259c700 1 -- 172.21.15.8:0/112662823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8734060310 msgr2=0x7f8734106d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f873259c700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8734060310 0x7f8734106d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.983+0000 7f873259c700 1 -- 172.21.15.8:0/112662823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8728005040 con 0x7f87340f9680 2023-10-18T22:06:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.984+0000 7f873259c700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87340f9680 0x7f8734107240 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f8728014040 tx=0x7f872800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.984+0000 7f871b7fe700 1 -- 172.21.15.8:0/112662823 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8728019070 con 0x7f87340f9680 2023-10-18T22:06:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.984+0000 7f871b7fe700 1 -- 172.21.15.8:0/112662823 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f872801e420 con 0x7f87340f9680 2023-10-18T22:06:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.984+0000 7f8738991700 1 -- 172.21.15.8:0/112662823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8734108270 con 0x7f87340f9680 2023-10-18T22:06:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.984+0000 7f871b7fe700 1 -- 172.21.15.8:0/112662823 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8728014660 con 0x7f87340f9680 2023-10-18T22:06:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.984+0000 7f8738991700 1 -- 172.21.15.8:0/112662823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8734108750 con 0x7f87340f9680 2023-10-18T22:06:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.985+0000 7f8738991700 1 -- 172.21.15.8:0/112662823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8734059100 con 0x7f87340f9680 2023-10-18T22:06:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.986+0000 7f871b7fe700 1 -- 172.21.15.8:0/112662823 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f872801e9e0 con 0x7f87340f9680 2023-10-18T22:06:20.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.987+0000 7f871b7fe700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f871c060f70 0x7f871c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:20.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.987+0000 7f871b7fe700 1 -- 172.21.15.8:0/112662823 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f872807dde0 con 0x7f87340f9680 2023-10-18T22:06:20.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.987+0000 7f8732d9d700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f871c060f70 0x7f871c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:20.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.988+0000 7f8732d9d700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f871c060f70 0x7f871c063430 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f8724007f80 tx=0x7f872400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:20.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:20.992+0000 7f871b7fe700 1 -- 172.21.15.8:0/112662823 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8728051440 con 0x7f87340f9680 2023-10-18T22:06:21.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.191+0000 7f8738991700 1 -- 172.21.15.8:0/112662823 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87340008d0 con 0x7f871c060f70 2023-10-18T22:06:21.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.192+0000 7f871b7fe700 1 -- 172.21.15.8:0/112662823 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f87340008d0 con 0x7f871c060f70 2023-10-18T22:06:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.194+0000 7f8738991700 1 -- 172.21.15.8:0/112662823 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f871c060f70 msgr2=0x7f871c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.194+0000 7f8738991700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f871c060f70 0x7f871c063430 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f8724007f80 tx=0x7f872400b040).stop 2023-10-18T22:06:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.194+0000 7f8738991700 1 -- 172.21.15.8:0/112662823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87340f9680 msgr2=0x7f8734107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.194+0000 7f8738991700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87340f9680 0x7f8734107240 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f8728014040 tx=0x7f872800b040).stop 2023-10-18T22:06:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.194+0000 7f8738991700 1 -- 172.21.15.8:0/112662823 shutdown_connections 2023-10-18T22:06:21.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.194+0000 7f8738991700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f871c060f70 0x7f871c063430 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.194+0000 7f8738991700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8734060310 0x7f8734106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.194+0000 7f8738991700 1 --2- 172.21.15.8:0/112662823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87340f9680 0x7f8734107240 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.194+0000 7f8738991700 1 -- 172.21.15.8:0/112662823 >> 172.21.15.8:0/112662823 conn(0x7f87340f0b60 msgr2=0x7f87340f2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:21.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.195+0000 7f8738991700 1 -- 172.21.15.8:0/112662823 shutdown_connections 2023-10-18T22:06:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.195+0000 7f8738991700 1 -- 172.21.15.8:0/112662823 wait complete. 2023-10-18T22:06:21.211 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:06:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.332+0000 7fadd13d0700 1 -- 172.21.15.8:0/4231244665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadcc0602b0 msgr2=0x7fadcc0f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.332+0000 7fadd13d0700 1 --2- 172.21.15.8:0/4231244665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadcc0602b0 0x7fadcc0f9170 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7fadbc004660 tx=0x7fadbc009b30).stop 2023-10-18T22:06:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.333+0000 7fadd13d0700 1 -- 172.21.15.8:0/4231244665 shutdown_connections 2023-10-18T22:06:21.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.333+0000 7fadd13d0700 1 --2- 172.21.15.8:0/4231244665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadcc0f96f0 0x7fadcc0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.333+0000 7fadd13d0700 1 --2- 172.21.15.8:0/4231244665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadcc0602b0 0x7fadcc0f9170 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.333+0000 7fadd13d0700 1 -- 172.21.15.8:0/4231244665 >> 172.21.15.8:0/4231244665 conn(0x7fadcc0f0b90 msgr2=0x7fadcc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:21.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.333+0000 7fadd13d0700 1 -- 172.21.15.8:0/4231244665 shutdown_connections 2023-10-18T22:06:21.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.333+0000 7fadd13d0700 1 -- 172.21.15.8:0/4231244665 wait complete. 2023-10-18T22:06:21.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.333+0000 7fadd13d0700 1 Processor -- start 2023-10-18T22:06:21.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.334+0000 7fadd13d0700 1 -- start start 2023-10-18T22:06:21.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.334+0000 7fadd13d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadcc0602b0 0x7fadcc106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:21.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.334+0000 7fadd13d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadcc0f96f0 0x7fadcc107260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:21.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.334+0000 7fadd13d0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc107860 con 0x7fadcc0f96f0 2023-10-18T22:06:21.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.334+0000 7fadd13d0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc108070 con 0x7fadcc0602b0 2023-10-18T22:06:21.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.334+0000 7fadcb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadcc0f96f0 0x7fadcc107260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:21.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.334+0000 7fadcb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadcc0f96f0 0x7fadcc107260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58292/0 (socket says 172.21.15.8:58292) 2023-10-18T22:06:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.334+0000 7fadcb7fe700 1 -- 172.21.15.8:0/2349568690 learned_addr learned my addr 172.21.15.8:0/2349568690 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.334+0000 7fadcbfff700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadcc0602b0 0x7fadcc106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.335+0000 7fadcb7fe700 1 -- 172.21.15.8:0/2349568690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadcc0602b0 msgr2=0x7fadcc106d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.335+0000 7fadcb7fe700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadcc0602b0 0x7fadcc106d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.335+0000 7fadcb7fe700 1 -- 172.21.15.8:0/2349568690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc005040 con 0x7fadcc0f96f0 2023-10-18T22:06:21.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.335+0000 7fadcb7fe700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadcc0f96f0 0x7fadcc107260 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fadc00026d0 tx=0x7fadc0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:21.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.335+0000 7fadc8ff9700 1 -- 172.21.15.8:0/2349568690 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadc0009320 con 0x7fadcc0f96f0 2023-10-18T22:06:21.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.335+0000 7fadc8ff9700 1 -- 172.21.15.8:0/2349568690 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fadc000f040 con 0x7fadcc0f96f0 2023-10-18T22:06:21.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.335+0000 7fadc8ff9700 1 -- 172.21.15.8:0/2349568690 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadc00148f0 con 0x7fadcc0f96f0 2023-10-18T22:06:21.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.335+0000 7fadd13d0700 1 -- 172.21.15.8:0/2349568690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc1082f0 con 0x7fadcc0f96f0 2023-10-18T22:06:21.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.335+0000 7fadd13d0700 1 -- 172.21.15.8:0/2349568690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc1088b0 con 0x7fadcc0f96f0 2023-10-18T22:06:21.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.336+0000 7fadd13d0700 1 -- 172.21.15.8:0/2349568690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadcc059100 con 0x7fadcc0f96f0 2023-10-18T22:06:21.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.337+0000 7fadc8ff9700 1 -- 172.21.15.8:0/2349568690 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fadc0009480 con 0x7fadcc0f96f0 2023-10-18T22:06:21.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.339+0000 7fadc8ff9700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadb4060f70 0x7fadb4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:21.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.339+0000 7fadc8ff9700 1 -- 172.21.15.8:0/2349568690 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fadc007cc50 con 0x7fadcc0f96f0 2023-10-18T22:06:21.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.339+0000 7fadcbfff700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadb4060f70 0x7fadb4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:21.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.339+0000 7fadcbfff700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadb4060f70 0x7fadb4063430 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fadbc004630 tx=0x7fadbc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:21.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.343+0000 7fadc8ff9700 1 -- 172.21.15.8:0/2349568690 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fadc004c880 con 0x7fadcc0f96f0 2023-10-18T22:06:21.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.541+0000 7fadd13d0700 1 -- 172.21.15.8:0/2349568690 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadcc0fedd0 con 0x7fadb4060f70 2023-10-18T22:06:21.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.542+0000 7fadc8ff9700 1 -- 172.21.15.8:0/2349568690 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fadcc0fedd0 con 0x7fadb4060f70 2023-10-18T22:06:21.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.544+0000 7fadd13d0700 1 -- 172.21.15.8:0/2349568690 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadb4060f70 msgr2=0x7fadb4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:21.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.544+0000 7fadd13d0700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadb4060f70 0x7fadb4063430 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fadbc004630 tx=0x7fadbc009b30).stop 2023-10-18T22:06:21.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.544+0000 7fadd13d0700 1 -- 172.21.15.8:0/2349568690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadcc0f96f0 msgr2=0x7fadcc107260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:21.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.544+0000 7fadd13d0700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadcc0f96f0 0x7fadcc107260 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fadc00026d0 tx=0x7fadc0009e00).stop 2023-10-18T22:06:21.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.544+0000 7fadd13d0700 1 -- 172.21.15.8:0/2349568690 shutdown_connections 2023-10-18T22:06:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.544+0000 7fadd13d0700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadb4060f70 0x7fadb4063430 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.544+0000 7fadd13d0700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadcc0602b0 0x7fadcc106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.544+0000 7fadd13d0700 1 --2- 172.21.15.8:0/2349568690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadcc0f96f0 0x7fadcc107260 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.544+0000 7fadd13d0700 1 -- 172.21.15.8:0/2349568690 >> 172.21.15.8:0/2349568690 conn(0x7fadcc0f0b90 msgr2=0x7fadcc0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.544+0000 7fadd13d0700 1 -- 172.21.15.8:0/2349568690 shutdown_connections 2023-10-18T22:06:21.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.545+0000 7fadd13d0700 1 -- 172.21.15.8:0/2349568690 wait complete. 2023-10-18T22:06:21.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.681+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/2392351382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f77d0 msgr2=0x7fe8ec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:21.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.681+0000 7fe8f2f7c700 1 --2- 172.21.15.8:0/2392351382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec0f7c30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fe8dc004660 tx=0x7fe8dc009b30).stop 2023-10-18T22:06:21.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.682+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/2392351382 shutdown_connections 2023-10-18T22:06:21.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.682+0000 7fe8f2f7c700 1 --2- 172.21.15.8:0/2392351382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec0f7c30 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.682+0000 7fe8f2f7c700 1 --2- 172.21.15.8:0/2392351382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.682+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/2392351382 >> 172.21.15.8:0/2392351382 conn(0x7fe8ec0f1c90 msgr2=0x7fe8ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:21.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.682+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/2392351382 shutdown_connections 2023-10-18T22:06:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.682+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/2392351382 wait complete. 2023-10-18T22:06:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.683+0000 7fe8f2f7c700 1 Processor -- start 2023-10-18T22:06:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.683+0000 7fe8f2f7c700 1 -- start start 2023-10-18T22:06:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.683+0000 7fe8f2f7c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.683+0000 7fe8f2f7c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.683+0000 7fe8f2f7c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec1099e0 con 0x7fe8ec0f6530 2023-10-18T22:06:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.683+0000 7fe8f2f7c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec109b20 con 0x7fe8ec0f77d0 2023-10-18T22:06:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.683+0000 7fe8f1f7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8f1f7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58312/0 (socket says 172.21.15.8:58312) 2023-10-18T22:06:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8f1f7a700 1 -- 172.21.15.8:0/523534603 learned_addr learned my addr 172.21.15.8:0/523534603 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8f1779700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8f1f7a700 1 -- 172.21.15.8:0/523534603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f77d0 msgr2=0x7fe8ec109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8f1f7a700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8f1f7a700 1 -- 172.21.15.8:0/523534603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc005040 con 0x7fe8ec0f6530 2023-10-18T22:06:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8f1f7a700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec108f40 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fe8e800c790 tx=0x7fe8e8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8e27fc700 1 -- 172.21.15.8:0/523534603 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e8013630 con 0x7fe8ec0f6530 2023-10-18T22:06:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8e27fc700 1 -- 172.21.15.8:0/523534603 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe8e8012870 con 0x7fe8ec0f6530 2023-10-18T22:06:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/523534603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec10a4c0 con 0x7fe8ec0f6530 2023-10-18T22:06:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.684+0000 7fe8e27fc700 1 -- 172.21.15.8:0/523534603 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e8002830 con 0x7fe8ec0f6530 2023-10-18T22:06:21.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.685+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/523534603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec10aa80 con 0x7fe8ec0f6530 2023-10-18T22:06:21.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.686+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/523534603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec045ad0 con 0x7fe8ec0f6530 2023-10-18T22:06:21.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.687+0000 7fe8e27fc700 1 -- 172.21.15.8:0/523534603 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe8e8010070 con 0x7fe8ec0f6530 2023-10-18T22:06:21.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.687+0000 7fe8e27fc700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d8060f70 0x7fe8d8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:21.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.687+0000 7fe8e27fc700 1 -- 172.21.15.8:0/523534603 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe8e807c900 con 0x7fe8ec0f6530 2023-10-18T22:06:21.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.688+0000 7fe8f1779700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d8060f70 0x7fe8d8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:21.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.688+0000 7fe8f1779700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d8060f70 0x7fe8d8063430 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fe8dc004630 tx=0x7fe8dc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:21.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.692+0000 7fe8e27fc700 1 -- 172.21.15.8:0/523534603 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe8e804ffc0 con 0x7fe8ec0f6530 2023-10-18T22:06:21.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.885+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/523534603 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8ec0fee00 con 0x7fe8d8060f70 2023-10-18T22:06:21.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.894+0000 7fe8e27fc700 1 -- 172.21.15.8:0/523534603 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe8ec0fee00 con 0x7fe8d8060f70 2023-10-18T22:06:21.896 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:06:21.896 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (73m) 17s ago 74m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:06:21.896 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (66m) 17s ago 74m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:06:21.897 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (66m) 8m ago 73m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:06:21.897 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (72m) 17s ago 74m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:06:21.897 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 17s ago 70m - - 2023-10-18T22:06:21.897 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 17s ago 70m - - 2023-10-18T22:06:21.897 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 70m - - 2023-10-18T22:06:21.898 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 70m - - 2023-10-18T22:06:21.898 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (68m) 17s ago 75m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:06:21.898 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (67m) 8m ago 73m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:06:21.898 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (67m) 17s ago 75m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:06:21.899 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (67m) 8m ago 73m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:06:21.899 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (74m) 17s ago 74m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:06:21.899 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (73m) 8m ago 73m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:06:21.899 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (66m) 17s ago 73m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:06:21.899 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (64m) 17s ago 72m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:06:21.899 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (64m) 17s ago 72m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:06:21.900 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (63m) 8m ago 72m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:06:21.900 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (62m) 8m ago 71m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:06:21.900 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (62m) 8m ago 71m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:06:21.900 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (68m) 17s ago 73m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:06:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.896+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/523534603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d8060f70 msgr2=0x7fe8d8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:21.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.896+0000 7fe8f2f7c700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d8060f70 0x7fe8d8063430 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fe8dc004630 tx=0x7fe8dc009b30).stop 2023-10-18T22:06:21.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.896+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/523534603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f6530 msgr2=0x7fe8ec108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:21.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.896+0000 7fe8f2f7c700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec108f40 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fe8e800c790 tx=0x7fe8e8007d90).stop 2023-10-18T22:06:21.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.897+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/523534603 shutdown_connections 2023-10-18T22:06:21.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.897+0000 7fe8f2f7c700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d8060f70 0x7fe8d8063430 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.897+0000 7fe8f2f7c700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec108f40 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.897+0000 7fe8f2f7c700 1 --2- 172.21.15.8:0/523534603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:21.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.897+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/523534603 >> 172.21.15.8:0/523534603 conn(0x7fe8ec0f1c90 msgr2=0x7fe8ec0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:21.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.897+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/523534603 shutdown_connections 2023-10-18T22:06:21.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:21.897+0000 7fe8f2f7c700 1 -- 172.21.15.8:0/523534603 wait complete. 2023-10-18T22:06:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.032+0000 7ff31aa54700 1 -- 172.21.15.8:0/1278191523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3140f6530 msgr2=0x7ff3140f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.032+0000 7ff31aa54700 1 --2- 172.21.15.8:0/1278191523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3140f6530 0x7ff3140f6950 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7ff310004660 tx=0x7ff310009b30).stop 2023-10-18T22:06:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.032+0000 7ff31aa54700 1 -- 172.21.15.8:0/1278191523 shutdown_connections 2023-10-18T22:06:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.032+0000 7ff31aa54700 1 --2- 172.21.15.8:0/1278191523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3140f77d0 0x7ff3140f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.032+0000 7ff31aa54700 1 --2- 172.21.15.8:0/1278191523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3140f6530 0x7ff3140f6950 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.032+0000 7ff31aa54700 1 -- 172.21.15.8:0/1278191523 >> 172.21.15.8:0/1278191523 conn(0x7ff3140f1c90 msgr2=0x7ff3140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.032+0000 7ff31aa54700 1 -- 172.21.15.8:0/1278191523 shutdown_connections 2023-10-18T22:06:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.032+0000 7ff31aa54700 1 -- 172.21.15.8:0/1278191523 wait complete. 2023-10-18T22:06:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.033+0000 7ff31aa54700 1 Processor -- start 2023-10-18T22:06:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.033+0000 7ff31aa54700 1 -- start start 2023-10-18T22:06:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.034+0000 7ff31aa54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3140f6530 0x7ff314106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.034+0000 7ff31aa54700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3140f77d0 0x7ff314107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.034+0000 7ff31aa54700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314107880 con 0x7ff3140f77d0 2023-10-18T22:06:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.034+0000 7ff31aa54700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3141080c0 con 0x7ff3140f6530 2023-10-18T22:06:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.034+0000 7ff319251700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3140f77d0 0x7ff314107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.034+0000 7ff319251700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3140f77d0 0x7ff314107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58316/0 (socket says 172.21.15.8:58316) 2023-10-18T22:06:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.034+0000 7ff319251700 1 -- 172.21.15.8:0/1686523313 learned_addr learned my addr 172.21.15.8:0/1686523313 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.034+0000 7ff319a52700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3140f6530 0x7ff314106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.034+0000 7ff319251700 1 -- 172.21.15.8:0/1686523313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3140f6530 msgr2=0x7ff314106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.034+0000 7ff319251700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3140f6530 0x7ff314106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.035+0000 7ff319251700 1 -- 172.21.15.8:0/1686523313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff310005040 con 0x7ff3140f77d0 2023-10-18T22:06:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.035+0000 7ff319251700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3140f77d0 0x7ff314107280 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7ff30400e7f0 tx=0x7ff30400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.035+0000 7ff30a7fc700 1 -- 172.21.15.8:0/1686523313 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3040092e0 con 0x7ff3140f77d0 2023-10-18T22:06:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.035+0000 7ff31aa54700 1 -- 172.21.15.8:0/1686523313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3141083a0 con 0x7ff3140f77d0 2023-10-18T22:06:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.035+0000 7ff30a7fc700 1 -- 172.21.15.8:0/1686523313 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff30400f040 con 0x7ff3140f77d0 2023-10-18T22:06:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.035+0000 7ff30a7fc700 1 -- 172.21.15.8:0/1686523313 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff304014760 con 0x7ff3140f77d0 2023-10-18T22:06:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.035+0000 7ff31aa54700 1 -- 172.21.15.8:0/1686523313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3141088e0 con 0x7ff3140f77d0 2023-10-18T22:06:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.036+0000 7ff31aa54700 1 -- 172.21.15.8:0/1686523313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff314059100 con 0x7ff3140f77d0 2023-10-18T22:06:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.037+0000 7ff30a7fc700 1 -- 172.21.15.8:0/1686523313 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff30401b030 con 0x7ff3140f77d0 2023-10-18T22:06:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.038+0000 7ff30a7fc700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff300060f70 0x7ff300063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.038+0000 7ff30a7fc700 1 -- 172.21.15.8:0/1686523313 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff30407c780 con 0x7ff3140f77d0 2023-10-18T22:06:22.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.038+0000 7ff319a52700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff300060f70 0x7ff300063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.039+0000 7ff319a52700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff300060f70 0x7ff300063430 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7ff310004d80 tx=0x7ff31000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.042+0000 7ff30a7fc700 1 -- 172.21.15.8:0/1686523313 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff30404c380 con 0x7ff3140f77d0 2023-10-18T22:06:22.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.296+0000 7ff31aa54700 1 -- 172.21.15.8:0/1686523313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff314045ad0 con 0x7ff3140f77d0 2023-10-18T22:06:22.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.297+0000 7ff30a7fc700 1 -- 172.21.15.8:0/1686523313 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7ff304019070 con 0x7ff3140f77d0 2023-10-18T22:06:22.299 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:06:22.299 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:06:22.299 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:06:22.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:06:22.299 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:06:22.300 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:06:22.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:06:22.300 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:06:22.300 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:06:22.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:06:22.301 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:06:22.301 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:06:22.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:06:22.301 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:06:22.301 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:06:22.302 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:06:22.302 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:06:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 -- 172.21.15.8:0/1686523313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff300060f70 msgr2=0x7ff300063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff300060f70 0x7ff300063430 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7ff310004d80 tx=0x7ff31000b040).stop 2023-10-18T22:06:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 -- 172.21.15.8:0/1686523313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3140f77d0 msgr2=0x7ff314107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3140f77d0 0x7ff314107280 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7ff30400e7f0 tx=0x7ff30400b040).stop 2023-10-18T22:06:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 -- 172.21.15.8:0/1686523313 shutdown_connections 2023-10-18T22:06:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff300060f70 0x7ff300063430 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3140f6530 0x7ff314106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 --2- 172.21.15.8:0/1686523313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3140f77d0 0x7ff314107280 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 -- 172.21.15.8:0/1686523313 >> 172.21.15.8:0/1686523313 conn(0x7ff3140f1c90 msgr2=0x7ff3140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 -- 172.21.15.8:0/1686523313 shutdown_connections 2023-10-18T22:06:22.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.299+0000 7ff31aa54700 1 -- 172.21.15.8:0/1686523313 wait complete. 2023-10-18T22:06:22.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:20.924019+0000 mgr.smithi008.flmjzp (mgr.14640) 4045 : cluster [DBG] pgmap v2779: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:22.314 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:21.192497+0000 mgr.smithi008.flmjzp (mgr.14640) 4046 : audit [DBG] from='client.37288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:22.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.435+0000 7f510523c700 1 -- 172.21.15.8:0/1506630695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51000f77d0 msgr2=0x7f51000f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:22.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.435+0000 7f510523c700 1 --2- 172.21.15.8:0/1506630695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51000f77d0 0x7f51000f7c30 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f50f4004660 tx=0x7f50f4009b30).stop 2023-10-18T22:06:22.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.436+0000 7f510523c700 1 -- 172.21.15.8:0/1506630695 shutdown_connections 2023-10-18T22:06:22.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.436+0000 7f510523c700 1 --2- 172.21.15.8:0/1506630695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51000f77d0 0x7f51000f7c30 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.436+0000 7f510523c700 1 --2- 172.21.15.8:0/1506630695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51000f6530 0x7f51000f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.436+0000 7f510523c700 1 -- 172.21.15.8:0/1506630695 >> 172.21.15.8:0/1506630695 conn(0x7f51000f1c90 msgr2=0x7f51000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:22.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.436+0000 7f510523c700 1 -- 172.21.15.8:0/1506630695 shutdown_connections 2023-10-18T22:06:22.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.436+0000 7f510523c700 1 -- 172.21.15.8:0/1506630695 wait complete. 2023-10-18T22:06:22.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.437+0000 7f510523c700 1 Processor -- start 2023-10-18T22:06:22.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.437+0000 7f510523c700 1 -- start start 2023-10-18T22:06:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.437+0000 7f510523c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51000f6530 0x7f510006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.437+0000 7f510523c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51000f77d0 0x7f5100069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.437+0000 7f510523c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510006a380 con 0x7f51000f6530 2023-10-18T22:06:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.437+0000 7f510523c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510006a4c0 con 0x7f51000f77d0 2023-10-18T22:06:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.437+0000 7f50fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51000f6530 0x7f510006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:22.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.437+0000 7f50fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51000f6530 0x7f510006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58326/0 (socket says 172.21.15.8:58326) 2023-10-18T22:06:22.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.437+0000 7f50fffff700 1 -- 172.21.15.8:0/1565838293 learned_addr learned my addr 172.21.15.8:0/1565838293 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:22.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.438+0000 7f50ff7fe700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51000f77d0 0x7f5100069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:22.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.438+0000 7f50fffff700 1 -- 172.21.15.8:0/1565838293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51000f77d0 msgr2=0x7f5100069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:22.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.438+0000 7f50fffff700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51000f77d0 0x7f5100069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.438+0000 7f50fffff700 1 -- 172.21.15.8:0/1565838293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4005040 con 0x7f51000f6530 2023-10-18T22:06:22.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.438+0000 7f50fffff700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51000f6530 0x7f510006b9a0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f50f000c790 tx=0x7f50f0007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:22.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.438+0000 7f50fcff9700 1 -- 172.21.15.8:0/1565838293 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50f0013630 con 0x7f51000f6530 2023-10-18T22:06:22.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.438+0000 7f50fcff9700 1 -- 172.21.15.8:0/1565838293 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f50f0012870 con 0x7f51000f6530 2023-10-18T22:06:22.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.438+0000 7f510523c700 1 -- 172.21.15.8:0/1565838293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510006a7a0 con 0x7f51000f6530 2023-10-18T22:06:22.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.438+0000 7f50fcff9700 1 -- 172.21.15.8:0/1565838293 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50f0002830 con 0x7f51000f6530 2023-10-18T22:06:22.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.439+0000 7f510523c700 1 -- 172.21.15.8:0/1565838293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510010ed70 con 0x7f51000f6530 2023-10-18T22:06:22.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.440+0000 7f510523c700 1 -- 172.21.15.8:0/1565838293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5100045ad0 con 0x7f51000f6530 2023-10-18T22:06:22.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.440+0000 7f50fcff9700 1 -- 172.21.15.8:0/1565838293 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f50f0010070 con 0x7f51000f6530 2023-10-18T22:06:22.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.441+0000 7f50fcff9700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e8060f70 0x7f50e8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:22.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.441+0000 7f50fcff9700 1 -- 172.21.15.8:0/1565838293 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f50f007c900 con 0x7f51000f6530 2023-10-18T22:06:22.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.442+0000 7f50ff7fe700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e8060f70 0x7f50e8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:22.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.442+0000 7f50ff7fe700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e8060f70 0x7f50e8063430 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f50f4004630 tx=0x7f50f4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:22.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.445+0000 7f50fcff9700 1 -- 172.21.15.8:0/1565838293 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f50f004c590 con 0x7f51000f6530 2023-10-18T22:06:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:20.924019+0000 mgr.smithi008.flmjzp (mgr.14640) 4045 : cluster [DBG] pgmap v2779: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:21.192497+0000 mgr.smithi008.flmjzp (mgr.14640) 4046 : audit [DBG] from='client.37288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.672+0000 7f510523c700 1 -- 172.21.15.8:0/1565838293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5100027a00 con 0x7f51000f6530 2023-10-18T22:06:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.672+0000 7f50fcff9700 1 -- 172.21.15.8:0/1565838293 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f50f004fbb0 con 0x7f51000f6530 2023-10-18T22:06:22.674 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:06:22.674 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:06:22.674 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:06:22.675 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:06:22.675 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:06:22.675 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:06:22.675 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:06:22.676 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:06:22.676 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:06:22.676 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:06:22.676 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:06:22.676 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:06:22.676 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:06:22.677 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:06:22.677 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:06:22.677 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:06:22.677 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:06:22.677 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:06:22.677 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:06:22.678 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:06:22.678 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:06:22.678 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:06:22.678 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:06:22.678 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:06:22.679 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:06:22.679 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:06:22.679 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:06:22.679 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:06:22.679 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:06:22.680 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:06:22.680 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:06:22.680 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:06:22.680 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:06:22.680 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:06:22.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 -- 172.21.15.8:0/1565838293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e8060f70 msgr2=0x7f50e8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:22.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e8060f70 0x7f50e8063430 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f50f4004630 tx=0x7f50f4009b30).stop 2023-10-18T22:06:22.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 -- 172.21.15.8:0/1565838293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51000f6530 msgr2=0x7f510006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51000f6530 0x7f510006b9a0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f50f000c790 tx=0x7f50f0007d90).stop 2023-10-18T22:06:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 -- 172.21.15.8:0/1565838293 shutdown_connections 2023-10-18T22:06:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50e8060f70 0x7f50e8063430 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51000f6530 0x7f510006b9a0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 --2- 172.21.15.8:0/1565838293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51000f77d0 0x7f5100069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 -- 172.21.15.8:0/1565838293 >> 172.21.15.8:0/1565838293 conn(0x7f51000f1c90 msgr2=0x7f51000fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:22.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 -- 172.21.15.8:0/1565838293 shutdown_connections 2023-10-18T22:06:22.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.674+0000 7f510523c700 1 -- 172.21.15.8:0/1565838293 wait complete. 2023-10-18T22:06:22.683 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:06:22.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.811+0000 7f06e25cc700 1 -- 172.21.15.8:0/2995161514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06dc0f9690 msgr2=0x7f06dc0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.811+0000 7f06e25cc700 1 --2- 172.21.15.8:0/2995161514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06dc0f9690 0x7f06dc0fbae0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f06cc004660 tx=0x7f06cc009b30).stop 2023-10-18T22:06:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.811+0000 7f06e25cc700 1 -- 172.21.15.8:0/2995161514 shutdown_connections 2023-10-18T22:06:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.811+0000 7f06e25cc700 1 --2- 172.21.15.8:0/2995161514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06dc0f9690 0x7f06dc0fbae0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.811+0000 7f06e25cc700 1 --2- 172.21.15.8:0/2995161514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc060310 0x7f06dc0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.811+0000 7f06e25cc700 1 -- 172.21.15.8:0/2995161514 >> 172.21.15.8:0/2995161514 conn(0x7f06dc0f0b90 msgr2=0x7f06dc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.811+0000 7f06e25cc700 1 -- 172.21.15.8:0/2995161514 shutdown_connections 2023-10-18T22:06:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.811+0000 7f06e25cc700 1 -- 172.21.15.8:0/2995161514 wait complete. 2023-10-18T22:06:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.812+0000 7f06e25cc700 1 Processor -- start 2023-10-18T22:06:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.812+0000 7f06e25cc700 1 -- start start 2023-10-18T22:06:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e25cc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06dc060310 0x7f06dc108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e25cc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc0f9690 0x7f06dc109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e25cc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1099b0 con 0x7f06dc060310 2023-10-18T22:06:22.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e25cc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc109af0 con 0x7f06dc0f9690 2023-10-18T22:06:22.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e15ca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06dc060310 0x7f06dc108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:22.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e15ca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06dc060310 0x7f06dc108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58342/0 (socket says 172.21.15.8:58342) 2023-10-18T22:06:22.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e15ca700 1 -- 172.21.15.8:0/2649262568 learned_addr learned my addr 172.21.15.8:0/2649262568 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:22.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e0dc9700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc0f9690 0x7f06dc109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:22.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e15ca700 1 -- 172.21.15.8:0/2649262568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc0f9690 msgr2=0x7f06dc109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:22.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e15ca700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc0f9690 0x7f06dc109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:22.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.813+0000 7f06e15ca700 1 -- 172.21.15.8:0/2649262568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc005040 con 0x7f06dc060310 2023-10-18T22:06:22.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.814+0000 7f06e15ca700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06dc060310 0x7f06dc108f10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f06d800e7f0 tx=0x7f06d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:22.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.814+0000 7f06d1ffb700 1 -- 172.21.15.8:0/2649262568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06d80092e0 con 0x7f06dc060310 2023-10-18T22:06:22.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.814+0000 7f06d1ffb700 1 -- 172.21.15.8:0/2649262568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f06d800f040 con 0x7f06dc060310 2023-10-18T22:06:22.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.814+0000 7f06e25cc700 1 -- 172.21.15.8:0/2649262568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc10a490 con 0x7f06dc060310 2023-10-18T22:06:22.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.814+0000 7f06d1ffb700 1 -- 172.21.15.8:0/2649262568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06d80147e0 con 0x7f06dc060310 2023-10-18T22:06:22.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.814+0000 7f06e25cc700 1 -- 172.21.15.8:0/2649262568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc10a9d0 con 0x7f06dc060310 2023-10-18T22:06:22.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.815+0000 7f06e25cc700 1 -- 172.21.15.8:0/2649262568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc045ad0 con 0x7f06dc060310 2023-10-18T22:06:22.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.816+0000 7f06d1ffb700 1 -- 172.21.15.8:0/2649262568 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f06d801b030 con 0x7f06dc060310 2023-10-18T22:06:22.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.817+0000 7f06d1ffb700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06c8060f70 0x7f06c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:22.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.817+0000 7f06d1ffb700 1 -- 172.21.15.8:0/2649262568 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f06d807c7c0 con 0x7f06dc060310 2023-10-18T22:06:22.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.817+0000 7f06e0dc9700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06c8060f70 0x7f06c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:22.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.818+0000 7f06e0dc9700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06c8060f70 0x7f06c8063430 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f06cc009720 tx=0x7f06cc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:22.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:22.821+0000 7f06d1ffb700 1 -- 172.21.15.8:0/2649262568 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f06d804fdf0 con 0x7f06dc060310 2023-10-18T22:06:23.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.020+0000 7f06e25cc700 1 -- 172.21.15.8:0/2649262568 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06dc0f5630 con 0x7f06c8060f70 2023-10-18T22:06:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.021+0000 7f06d1ffb700 1 -- 172.21.15.8:0/2649262568 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f06dc0f5630 con 0x7f06c8060f70 2023-10-18T22:06:23.022 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:06:23.023 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:06:23.023 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:06:23.023 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:06:23.023 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:06:23.023 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:06:23.024 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:06:23.024 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:06:23.024 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:06:23.024 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:06:23.025 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:06:23.025 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:06:23.025 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:06:23.025 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:06:23.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 -- 172.21.15.8:0/2649262568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06c8060f70 msgr2=0x7f06c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:23.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06c8060f70 0x7f06c8063430 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f06cc009720 tx=0x7f06cc00b040).stop 2023-10-18T22:06:23.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 -- 172.21.15.8:0/2649262568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06dc060310 msgr2=0x7f06dc108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:23.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06dc060310 0x7f06dc108f10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f06d800e7f0 tx=0x7f06d800b040).stop 2023-10-18T22:06:23.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 -- 172.21.15.8:0/2649262568 shutdown_connections 2023-10-18T22:06:23.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06c8060f70 0x7f06c8063430 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:23.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06dc060310 0x7f06dc108f10 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:23.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 --2- 172.21.15.8:0/2649262568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc0f9690 0x7f06dc109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:23.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 -- 172.21.15.8:0/2649262568 >> 172.21.15.8:0/2649262568 conn(0x7f06dc0f0b90 msgr2=0x7f06dc0f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:23.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 -- 172.21.15.8:0/2649262568 shutdown_connections 2023-10-18T22:06:23.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:23.023+0000 7f06e25cc700 1 -- 172.21.15.8:0/2649262568 wait complete. 2023-10-18T22:06:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:21.542612+0000 mgr.smithi008.flmjzp (mgr.14640) 4047 : audit [DBG] from='client.37292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:21.886280+0000 mgr.smithi008.flmjzp (mgr.14640) 4048 : audit [DBG] from='client.37296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:22.297481+0000 mon.smithi008 (mon.0) 4366 : audit [DBG] from='client.? 172.21.15.8:0/1686523313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:22.672953+0000 mon.smithi008 (mon.0) 4367 : audit [DBG] from='client.? 172.21.15.8:0/1565838293' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:06:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:21.542612+0000 mgr.smithi008.flmjzp (mgr.14640) 4047 : audit [DBG] from='client.37292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:21.886280+0000 mgr.smithi008.flmjzp (mgr.14640) 4048 : audit [DBG] from='client.37296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:22.297481+0000 mon.smithi008 (mon.0) 4366 : audit [DBG] from='client.? 172.21.15.8:0/1686523313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:22.672953+0000 mon.smithi008 (mon.0) 4367 : audit [DBG] from='client.? 172.21.15.8:0/1565838293' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:06:24.348 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:22.924468+0000 mgr.smithi008.flmjzp (mgr.14640) 4049 : cluster [DBG] pgmap v2780: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:24.349 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:23.021323+0000 mgr.smithi008.flmjzp (mgr.14640) 4050 : audit [DBG] from='client.37308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:22.924468+0000 mgr.smithi008.flmjzp (mgr.14640) 4049 : cluster [DBG] pgmap v2780: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:23.021323+0000 mgr.smithi008.flmjzp (mgr.14640) 4050 : audit [DBG] from='client.37308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:24.954157+0000 mon.smithi008 (mon.0) 4368 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:24.956309+0000 mon.smithi008 (mon.0) 4369 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:24.957330+0000 mon.smithi008 (mon.0) 4370 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:24.964284+0000 mon.smithi008 (mon.0) 4371 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:24.970492+0000 mon.smithi008 (mon.0) 4372 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:24.973416+0000 mon.smithi008 (mon.0) 4373 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:24.975100+0000 mon.smithi008 (mon.0) 4374 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:24.976709+0000 mon.smithi008 (mon.0) 4375 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:24.978754+0000 mon.smithi008 (mon.0) 4376 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:24.954157+0000 mon.smithi008 (mon.0) 4368 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:24.956309+0000 mon.smithi008 (mon.0) 4369 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:24.957330+0000 mon.smithi008 (mon.0) 4370 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:24.964284+0000 mon.smithi008 (mon.0) 4371 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:24.970492+0000 mon.smithi008 (mon.0) 4372 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:24.973416+0000 mon.smithi008 (mon.0) 4373 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:24.975100+0000 mon.smithi008 (mon.0) 4374 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:24.976709+0000 mon.smithi008 (mon.0) 4375 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:25.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:24.978754+0000 mon.smithi008 (mon.0) 4376 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:24.925065+0000 mgr.smithi008.flmjzp (mgr.14640) 4051 : cluster [DBG] pgmap v2781: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:24.958222+0000 mgr.smithi008.flmjzp (mgr.14640) 4052 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:24.958921+0000 mgr.smithi008.flmjzp (mgr.14640) 4053 : cluster [DBG] pgmap v2782: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:26.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:24.959175+0000 mgr.smithi008.flmjzp (mgr.14640) 4054 : cluster [DBG] pgmap v2783: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:26.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:24.980757+0000 mgr.smithi008.flmjzp (mgr.14640) 4055 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:24.925065+0000 mgr.smithi008.flmjzp (mgr.14640) 4051 : cluster [DBG] pgmap v2781: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:24.958222+0000 mgr.smithi008.flmjzp (mgr.14640) 4052 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:24.958921+0000 mgr.smithi008.flmjzp (mgr.14640) 4053 : cluster [DBG] pgmap v2782: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:24.959175+0000 mgr.smithi008.flmjzp (mgr.14640) 4054 : cluster [DBG] pgmap v2783: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:26.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:24.980757+0000 mgr.smithi008.flmjzp (mgr.14640) 4055 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:28.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:26.959761+0000 mgr.smithi008.flmjzp (mgr.14640) 4056 : cluster [DBG] pgmap v2784: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:28.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:26.959761+0000 mgr.smithi008.flmjzp (mgr.14640) 4056 : cluster [DBG] pgmap v2784: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:28.960517+0000 mgr.smithi008.flmjzp (mgr.14640) 4057 : cluster [DBG] pgmap v2785: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:28.960517+0000 mgr.smithi008.flmjzp (mgr.14640) 4057 : cluster [DBG] pgmap v2785: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:32.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:30.961090+0000 mgr.smithi008.flmjzp (mgr.14640) 4058 : cluster [DBG] pgmap v2786: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:30.961090+0000 mgr.smithi008.flmjzp (mgr.14640) 4058 : cluster [DBG] pgmap v2786: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:34.349 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:32.961635+0000 mgr.smithi008.flmjzp (mgr.14640) 4059 : cluster [DBG] pgmap v2787: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:32.961635+0000 mgr.smithi008.flmjzp (mgr.14640) 4059 : cluster [DBG] pgmap v2787: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:34.989752+0000 mon.smithi008 (mon.0) 4377 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:34.991971+0000 mon.smithi008 (mon.0) 4378 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:35.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:34.993015+0000 mon.smithi008 (mon.0) 4379 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:35.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:34.999439+0000 mon.smithi008 (mon.0) 4380 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:35.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:35.005769+0000 mon.smithi008 (mon.0) 4381 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:35.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:35.008878+0000 mon.smithi008 (mon.0) 4382 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:35.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:35.010564+0000 mon.smithi008 (mon.0) 4383 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:35.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:35.012243+0000 mon.smithi008 (mon.0) 4384 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:35.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:35.014253+0000 mon.smithi008 (mon.0) 4385 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:34.989752+0000 mon.smithi008 (mon.0) 4377 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:34.991971+0000 mon.smithi008 (mon.0) 4378 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:34.993015+0000 mon.smithi008 (mon.0) 4379 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:34.999439+0000 mon.smithi008 (mon.0) 4380 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:35.005769+0000 mon.smithi008 (mon.0) 4381 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:35.008878+0000 mon.smithi008 (mon.0) 4382 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:35.010564+0000 mon.smithi008 (mon.0) 4383 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:35.012243+0000 mon.smithi008 (mon.0) 4384 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:35.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:35.014253+0000 mon.smithi008 (mon.0) 4385 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:34.962156+0000 mgr.smithi008.flmjzp (mgr.14640) 4060 : cluster [DBG] pgmap v2788: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:34.993875+0000 mgr.smithi008.flmjzp (mgr.14640) 4061 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:34.994435+0000 mgr.smithi008.flmjzp (mgr.14640) 4062 : cluster [DBG] pgmap v2789: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:34.994760+0000 mgr.smithi008.flmjzp (mgr.14640) 4063 : cluster [DBG] pgmap v2790: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:35.016150+0000 mgr.smithi008.flmjzp (mgr.14640) 4064 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:34.962156+0000 mgr.smithi008.flmjzp (mgr.14640) 4060 : cluster [DBG] pgmap v2788: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:34.993875+0000 mgr.smithi008.flmjzp (mgr.14640) 4061 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:34.994435+0000 mgr.smithi008.flmjzp (mgr.14640) 4062 : cluster [DBG] pgmap v2789: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:34.994760+0000 mgr.smithi008.flmjzp (mgr.14640) 4063 : cluster [DBG] pgmap v2790: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:35.016150+0000 mgr.smithi008.flmjzp (mgr.14640) 4064 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:38.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:36.995390+0000 mgr.smithi008.flmjzp (mgr.14640) 4065 : cluster [DBG] pgmap v2791: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:36.995390+0000 mgr.smithi008.flmjzp (mgr.14640) 4065 : cluster [DBG] pgmap v2791: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:40.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:38.996062+0000 mgr.smithi008.flmjzp (mgr.14640) 4066 : cluster [DBG] pgmap v2792: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:40.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:38.996062+0000 mgr.smithi008.flmjzp (mgr.14640) 4066 : cluster [DBG] pgmap v2792: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:42.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:40.996797+0000 mgr.smithi008.flmjzp (mgr.14640) 4067 : cluster [DBG] pgmap v2793: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:40.996797+0000 mgr.smithi008.flmjzp (mgr.14640) 4067 : cluster [DBG] pgmap v2793: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:44.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:42.997379+0000 mgr.smithi008.flmjzp (mgr.14640) 4068 : cluster [DBG] pgmap v2794: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:44.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:42.997379+0000 mgr.smithi008.flmjzp (mgr.14640) 4068 : cluster [DBG] pgmap v2794: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:45.026813+0000 mon.smithi008 (mon.0) 4386 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:45.026813+0000 mon.smithi008 (mon.0) 4386 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:46.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:44.998193+0000 mgr.smithi008.flmjzp (mgr.14640) 4069 : cluster [DBG] pgmap v2795: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:45.593052+0000 mon.smithi008 (mon.0) 4387 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:45.593856+0000 mon.smithi008 (mon.0) 4388 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:45.599259+0000 mon.smithi008 (mon.0) 4389 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:46.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:45.604368+0000 mon.smithi008 (mon.0) 4390 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:46.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:45.606785+0000 mon.smithi008 (mon.0) 4391 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:46.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:45.608104+0000 mon.smithi008 (mon.0) 4392 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:46.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:45.609326+0000 mon.smithi008 (mon.0) 4393 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:46.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:45.610871+0000 mon.smithi008 (mon.0) 4394 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:44.998193+0000 mgr.smithi008.flmjzp (mgr.14640) 4069 : cluster [DBG] pgmap v2795: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:45.593052+0000 mon.smithi008 (mon.0) 4387 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:45.593856+0000 mon.smithi008 (mon.0) 4388 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:45.599259+0000 mon.smithi008 (mon.0) 4389 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:45.604368+0000 mon.smithi008 (mon.0) 4390 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:45.606785+0000 mon.smithi008 (mon.0) 4391 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:45.608104+0000 mon.smithi008 (mon.0) 4392 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:45.609326+0000 mon.smithi008 (mon.0) 4393 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:46.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:45.610871+0000 mon.smithi008 (mon.0) 4394 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:45.594485+0000 mgr.smithi008.flmjzp (mgr.14640) 4070 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:45.595027+0000 mgr.smithi008.flmjzp (mgr.14640) 4071 : cluster [DBG] pgmap v2796: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:45.595307+0000 mgr.smithi008.flmjzp (mgr.14640) 4072 : cluster [DBG] pgmap v2797: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:47.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:45.612360+0000 mgr.smithi008.flmjzp (mgr.14640) 4073 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:45.594485+0000 mgr.smithi008.flmjzp (mgr.14640) 4070 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:45.595027+0000 mgr.smithi008.flmjzp (mgr.14640) 4071 : cluster [DBG] pgmap v2796: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:45.595307+0000 mgr.smithi008.flmjzp (mgr.14640) 4072 : cluster [DBG] pgmap v2797: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:45.612360+0000 mgr.smithi008.flmjzp (mgr.14640) 4073 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:49.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:47.595905+0000 mgr.smithi008.flmjzp (mgr.14640) 4074 : cluster [DBG] pgmap v2798: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:47.595905+0000 mgr.smithi008.flmjzp (mgr.14640) 4074 : cluster [DBG] pgmap v2798: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:51.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:49.596512+0000 mgr.smithi008.flmjzp (mgr.14640) 4075 : cluster [DBG] pgmap v2799: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:49.596512+0000 mgr.smithi008.flmjzp (mgr.14640) 4075 : cluster [DBG] pgmap v2799: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:53.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.175+0000 7fca79ffb700 1 -- 172.21.15.8:0/1715396168 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca70013b20 con 0x7fca7c0f77d0 2023-10-18T22:06:53.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.176+0000 7fca7bfff700 1 -- 172.21.15.8:0/1715396168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca7c0f77d0 msgr2=0x7fca7c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:53.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.176+0000 7fca7bfff700 1 --2- 172.21.15.8:0/1715396168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca7c0f77d0 0x7fca7c0f7c30 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7fca70004660 tx=0x7fca70009b30).stop 2023-10-18T22:06:53.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.176+0000 7fca7bfff700 1 -- 172.21.15.8:0/1715396168 shutdown_connections 2023-10-18T22:06:53.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.176+0000 7fca7bfff700 1 --2- 172.21.15.8:0/1715396168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca7c0f77d0 0x7fca7c0f7c30 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.176+0000 7fca7bfff700 1 --2- 172.21.15.8:0/1715396168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c0f6530 0x7fca7c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.176+0000 7fca7bfff700 1 -- 172.21.15.8:0/1715396168 >> 172.21.15.8:0/1715396168 conn(0x7fca7c0f1cd0 msgr2=0x7fca7c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.176+0000 7fca7bfff700 1 -- 172.21.15.8:0/1715396168 shutdown_connections 2023-10-18T22:06:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.176+0000 7fca7bfff700 1 -- 172.21.15.8:0/1715396168 wait complete. 2023-10-18T22:06:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.177+0000 7fca7bfff700 1 Processor -- start 2023-10-18T22:06:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.177+0000 7fca7bfff700 1 -- start start 2023-10-18T22:06:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.177+0000 7fca7bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca7c0f6530 0x7fca7c108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.177+0000 7fca7bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c0f77d0 0x7fca7c109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.177+0000 7fca7bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c109a10 con 0x7fca7c0f6530 2023-10-18T22:06:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.177+0000 7fca7bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c109b50 con 0x7fca7c0f77d0 2023-10-18T22:06:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.178+0000 7fca7affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca7c0f6530 0x7fca7c108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.178+0000 7fca7affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca7c0f6530 0x7fca7c108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59922/0 (socket says 172.21.15.8:59922) 2023-10-18T22:06:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.178+0000 7fca7affd700 1 -- 172.21.15.8:0/3608059037 learned_addr learned my addr 172.21.15.8:0/3608059037 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.178+0000 7fca7a7fc700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c0f77d0 0x7fca7c109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.178+0000 7fca7affd700 1 -- 172.21.15.8:0/3608059037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c0f77d0 msgr2=0x7fca7c109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.178+0000 7fca7affd700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c0f77d0 0x7fca7c109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.178+0000 7fca7affd700 1 -- 172.21.15.8:0/3608059037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70005040 con 0x7fca7c0f6530 2023-10-18T22:06:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.178+0000 7fca7affd700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca7c0f6530 0x7fca7c108f70 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7fca6c00c790 tx=0x7fca6c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.179+0000 7fca637fe700 1 -- 172.21.15.8:0/3608059037 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca6c013630 con 0x7fca7c0f6530 2023-10-18T22:06:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.179+0000 7fca637fe700 1 -- 172.21.15.8:0/3608059037 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fca6c012870 con 0x7fca7c0f6530 2023-10-18T22:06:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.179+0000 7fca7bfff700 1 -- 172.21.15.8:0/3608059037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c10a4f0 con 0x7fca7c0f6530 2023-10-18T22:06:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.179+0000 7fca637fe700 1 -- 172.21.15.8:0/3608059037 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca6c002830 con 0x7fca7c0f6530 2023-10-18T22:06:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.179+0000 7fca7bfff700 1 -- 172.21.15.8:0/3608059037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c10aab0 con 0x7fca7c0f6530 2023-10-18T22:06:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.180+0000 7fca7bfff700 1 -- 172.21.15.8:0/3608059037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c045ad0 con 0x7fca7c0f6530 2023-10-18T22:06:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.181+0000 7fca637fe700 1 -- 172.21.15.8:0/3608059037 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fca6c010070 con 0x7fca7c0f6530 2023-10-18T22:06:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.182+0000 7fca637fe700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca64060f70 0x7fca64063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.182+0000 7fca637fe700 1 -- 172.21.15.8:0/3608059037 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fca6c07c9c0 con 0x7fca7c0f6530 2023-10-18T22:06:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.182+0000 7fca7a7fc700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca64060f70 0x7fca64063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.182+0000 7fca7a7fc700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca64060f70 0x7fca64063430 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fca70009f50 tx=0x7fca70009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.186+0000 7fca637fe700 1 -- 172.21.15.8:0/3608059037 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fca6c04ffc0 con 0x7fca7c0f6530 2023-10-18T22:06:53.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.384+0000 7fca7bfff700 1 -- 172.21.15.8:0/3608059037 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca7c0fc120 con 0x7fca64060f70 2023-10-18T22:06:53.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.385+0000 7fca637fe700 1 -- 172.21.15.8:0/3608059037 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fca7c0fc120 con 0x7fca64060f70 2023-10-18T22:06:53.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.387+0000 7fca7bfff700 1 -- 172.21.15.8:0/3608059037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca64060f70 msgr2=0x7fca64063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:53.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.387+0000 7fca7bfff700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca64060f70 0x7fca64063430 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fca70009f50 tx=0x7fca70009b30).stop 2023-10-18T22:06:53.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.387+0000 7fca7bfff700 1 -- 172.21.15.8:0/3608059037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca7c0f6530 msgr2=0x7fca7c108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:53.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.387+0000 7fca7bfff700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca7c0f6530 0x7fca7c108f70 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7fca6c00c790 tx=0x7fca6c007d90).stop 2023-10-18T22:06:53.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.387+0000 7fca7bfff700 1 -- 172.21.15.8:0/3608059037 shutdown_connections 2023-10-18T22:06:53.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.387+0000 7fca7bfff700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca64060f70 0x7fca64063430 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.387+0000 7fca7bfff700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca7c0f6530 0x7fca7c108f70 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.387+0000 7fca7bfff700 1 --2- 172.21.15.8:0/3608059037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c0f77d0 0x7fca7c109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.387+0000 7fca7bfff700 1 -- 172.21.15.8:0/3608059037 >> 172.21.15.8:0/3608059037 conn(0x7fca7c0f1cd0 msgr2=0x7fca7c0faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:53.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.388+0000 7fca7bfff700 1 -- 172.21.15.8:0/3608059037 shutdown_connections 2023-10-18T22:06:53.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.388+0000 7fca7bfff700 1 -- 172.21.15.8:0/3608059037 wait complete. 2023-10-18T22:06:53.404 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:06:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:51.597122+0000 mgr.smithi008.flmjzp (mgr.14640) 4076 : cluster [DBG] pgmap v2800: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:51.597122+0000 mgr.smithi008.flmjzp (mgr.14640) 4076 : cluster [DBG] pgmap v2800: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.526+0000 7faf632ac700 1 -- 172.21.15.8:0/4104703165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c06a3b0 msgr2=0x7faf5c06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.526+0000 7faf632ac700 1 --2- 172.21.15.8:0/4104703165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c06a3b0 0x7faf5c06a830 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7faf4c004660 tx=0x7faf4c009b30).stop 2023-10-18T22:06:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.526+0000 7faf632ac700 1 -- 172.21.15.8:0/4104703165 shutdown_connections 2023-10-18T22:06:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.526+0000 7faf632ac700 1 --2- 172.21.15.8:0/4104703165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c06a3b0 0x7faf5c06a830 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.526+0000 7faf632ac700 1 --2- 172.21.15.8:0/4104703165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf5c06b9c0 0x7faf5c069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.526+0000 7faf632ac700 1 -- 172.21.15.8:0/4104703165 >> 172.21.15.8:0/4104703165 conn(0x7faf5c0f1c90 msgr2=0x7faf5c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.527+0000 7faf632ac700 1 -- 172.21.15.8:0/4104703165 shutdown_connections 2023-10-18T22:06:53.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.527+0000 7faf632ac700 1 -- 172.21.15.8:0/4104703165 wait complete. 2023-10-18T22:06:53.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.527+0000 7faf632ac700 1 Processor -- start 2023-10-18T22:06:53.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.528+0000 7faf632ac700 1 -- start start 2023-10-18T22:06:53.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.528+0000 7faf632ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c06a3b0 0x7faf5c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:53.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.528+0000 7faf632ac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf5c06b9c0 0x7faf5c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:53.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.528+0000 7faf632ac700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c109970 con 0x7faf5c06a3b0 2023-10-18T22:06:53.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.528+0000 7faf632ac700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c109ab0 con 0x7faf5c06b9c0 2023-10-18T22:06:53.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.528+0000 7faf622aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c06a3b0 0x7faf5c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:53.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.528+0000 7faf622aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c06a3b0 0x7faf5c108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59944/0 (socket says 172.21.15.8:59944) 2023-10-18T22:06:53.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.528+0000 7faf622aa700 1 -- 172.21.15.8:0/2562246698 learned_addr learned my addr 172.21.15.8:0/2562246698 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:53.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.528+0000 7faf61aa9700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf5c06b9c0 0x7faf5c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:53.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.529+0000 7faf622aa700 1 -- 172.21.15.8:0/2562246698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf5c06b9c0 msgr2=0x7faf5c1093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:53.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.529+0000 7faf622aa700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf5c06b9c0 0x7faf5c1093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.529+0000 7faf622aa700 1 -- 172.21.15.8:0/2562246698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c005040 con 0x7faf5c06a3b0 2023-10-18T22:06:53.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.529+0000 7faf622aa700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c06a3b0 0x7faf5c108ed0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7faf5800e7f0 tx=0x7faf5800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:53.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.529+0000 7faf52ffd700 1 -- 172.21.15.8:0/2562246698 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf580092e0 con 0x7faf5c06a3b0 2023-10-18T22:06:53.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.529+0000 7faf52ffd700 1 -- 172.21.15.8:0/2562246698 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faf5800f040 con 0x7faf5c06a3b0 2023-10-18T22:06:53.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.529+0000 7faf632ac700 1 -- 172.21.15.8:0/2562246698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c10a450 con 0x7faf5c06a3b0 2023-10-18T22:06:53.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.529+0000 7faf52ffd700 1 -- 172.21.15.8:0/2562246698 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf580147e0 con 0x7faf5c06a3b0 2023-10-18T22:06:53.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.529+0000 7faf632ac700 1 -- 172.21.15.8:0/2562246698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c10a990 con 0x7faf5c06a3b0 2023-10-18T22:06:53.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.530+0000 7faf632ac700 1 -- 172.21.15.8:0/2562246698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c045ad0 con 0x7faf5c06a3b0 2023-10-18T22:06:53.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.531+0000 7faf52ffd700 1 -- 172.21.15.8:0/2562246698 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faf5801b030 con 0x7faf5c06a3b0 2023-10-18T22:06:53.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.532+0000 7faf52ffd700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf48060f70 0x7faf48063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:53.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.532+0000 7faf52ffd700 1 -- 172.21.15.8:0/2562246698 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faf5807c680 con 0x7faf5c06a3b0 2023-10-18T22:06:53.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.532+0000 7faf61aa9700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf48060f70 0x7faf48063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:53.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.533+0000 7faf61aa9700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf48060f70 0x7faf48063430 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7faf4c0043d0 tx=0x7faf4c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:53.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.536+0000 7faf52ffd700 1 -- 172.21.15.8:0/2562246698 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faf5804fd70 con 0x7faf5c06a3b0 2023-10-18T22:06:53.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.734+0000 7faf632ac700 1 -- 172.21.15.8:0/2562246698 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf5c101030 con 0x7faf48060f70 2023-10-18T22:06:53.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.735+0000 7faf52ffd700 1 -- 172.21.15.8:0/2562246698 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faf5c101030 con 0x7faf48060f70 2023-10-18T22:06:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.737+0000 7faf632ac700 1 -- 172.21.15.8:0/2562246698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf48060f70 msgr2=0x7faf48063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.737+0000 7faf632ac700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf48060f70 0x7faf48063430 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7faf4c0043d0 tx=0x7faf4c00b040).stop 2023-10-18T22:06:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.737+0000 7faf632ac700 1 -- 172.21.15.8:0/2562246698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c06a3b0 msgr2=0x7faf5c108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.737+0000 7faf632ac700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c06a3b0 0x7faf5c108ed0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7faf5800e7f0 tx=0x7faf5800b040).stop 2023-10-18T22:06:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.737+0000 7faf632ac700 1 -- 172.21.15.8:0/2562246698 shutdown_connections 2023-10-18T22:06:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.737+0000 7faf632ac700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faf48060f70 0x7faf48063430 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.737+0000 7faf632ac700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c06a3b0 0x7faf5c108ed0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.737+0000 7faf632ac700 1 --2- 172.21.15.8:0/2562246698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf5c06b9c0 0x7faf5c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.737+0000 7faf632ac700 1 -- 172.21.15.8:0/2562246698 >> 172.21.15.8:0/2562246698 conn(0x7faf5c0f1c90 msgr2=0x7faf5c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.738+0000 7faf632ac700 1 -- 172.21.15.8:0/2562246698 shutdown_connections 2023-10-18T22:06:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.738+0000 7faf632ac700 1 -- 172.21.15.8:0/2562246698 wait complete. 2023-10-18T22:06:53.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.874+0000 7f04b5a53700 1 -- 172.21.15.8:0/3603097510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04b00f77d0 msgr2=0x7f04b00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:53.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.874+0000 7f04b5a53700 1 --2- 172.21.15.8:0/3603097510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04b00f77d0 0x7f04b00f7c30 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7f049c004660 tx=0x7f049c009b30).stop 2023-10-18T22:06:53.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.874+0000 7f04b5a53700 1 -- 172.21.15.8:0/3603097510 shutdown_connections 2023-10-18T22:06:53.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.874+0000 7f04b5a53700 1 --2- 172.21.15.8:0/3603097510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04b00f77d0 0x7f04b00f7c30 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.874+0000 7f04b5a53700 1 --2- 172.21.15.8:0/3603097510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04b00f6530 0x7f04b00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.874+0000 7f04b5a53700 1 -- 172.21.15.8:0/3603097510 >> 172.21.15.8:0/3603097510 conn(0x7f04b00f1c90 msgr2=0x7f04b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:53.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.875+0000 7f04b5a53700 1 -- 172.21.15.8:0/3603097510 shutdown_connections 2023-10-18T22:06:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.875+0000 7f04b5a53700 1 -- 172.21.15.8:0/3603097510 wait complete. 2023-10-18T22:06:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.875+0000 7f04b5a53700 1 Processor -- start 2023-10-18T22:06:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.876+0000 7f04b5a53700 1 -- start start 2023-10-18T22:06:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.876+0000 7f04b5a53700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04b00f6530 0x7f04b00ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.876+0000 7f04b5a53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04b00f77d0 0x7f04b00ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.876+0000 7f04b5a53700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0100440 con 0x7f04b00f77d0 2023-10-18T22:06:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.876+0000 7f04b5a53700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0100580 con 0x7f04b00f6530 2023-10-18T22:06:53.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.876+0000 7f04affff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04b00f77d0 0x7f04b00ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:53.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.876+0000 7f04affff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04b00f77d0 0x7f04b00ffe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59960/0 (socket says 172.21.15.8:59960) 2023-10-18T22:06:53.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.876+0000 7f04affff700 1 -- 172.21.15.8:0/1405387817 learned_addr learned my addr 172.21.15.8:0/1405387817 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:53.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04b4a51700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04b00f6530 0x7f04b00ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:53.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04affff700 1 -- 172.21.15.8:0/1405387817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04b00f6530 msgr2=0x7f04b00ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:53.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04affff700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04b00f6530 0x7f04b00ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:53.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04affff700 1 -- 172.21.15.8:0/1405387817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c005040 con 0x7f04b00f77d0 2023-10-18T22:06:53.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04b4a51700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04b00f6530 0x7f04b00ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:06:53.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04affff700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04b00f77d0 0x7f04b00ffe40 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f049c009830 tx=0x7f049c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:53.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04ad7fa700 1 -- 172.21.15.8:0/1405387817 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f049c018070 con 0x7f04b00f77d0 2023-10-18T22:06:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04ad7fa700 1 -- 172.21.15.8:0/1405387817 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f049c01d8e0 con 0x7f04b00f77d0 2023-10-18T22:06:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04b5a53700 1 -- 172.21.15.8:0/1405387817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b0100e90 con 0x7f04b00f77d0 2023-10-18T22:06:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04ad7fa700 1 -- 172.21.15.8:0/1405387817 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f049c01c540 con 0x7f04b00f77d0 2023-10-18T22:06:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.877+0000 7f04b5a53700 1 -- 172.21.15.8:0/1405387817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b01013f0 con 0x7f04b00f77d0 2023-10-18T22:06:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.878+0000 7f04b5a53700 1 -- 172.21.15.8:0/1405387817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b0045ad0 con 0x7f04b00f77d0 2023-10-18T22:06:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.879+0000 7f04ad7fa700 1 -- 172.21.15.8:0/1405387817 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f049c01da50 con 0x7f04b00f77d0 2023-10-18T22:06:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.880+0000 7f04ad7fa700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f04a0060f70 0x7f04a0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.880+0000 7f04ad7fa700 1 -- 172.21.15.8:0/1405387817 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f049c07e7c0 con 0x7f04b00f77d0 2023-10-18T22:06:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.881+0000 7f04b4a51700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f04a0060f70 0x7f04a0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.881+0000 7f04b4a51700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f04a0060f70 0x7f04a0063430 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f04b00ff6e0 tx=0x7f04a4009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:53.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:53.885+0000 7f04ad7fa700 1 -- 172.21.15.8:0/1405387817 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f049c04e3f0 con 0x7f04b00f77d0 2023-10-18T22:06:54.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.077+0000 7f04b5a53700 1 -- 172.21.15.8:0/1405387817 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f04b00fee00 con 0x7f04a0060f70 2023-10-18T22:06:54.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.087+0000 7f04ad7fa700 1 -- 172.21.15.8:0/1405387817 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f04b00fee00 con 0x7f04a0060f70 2023-10-18T22:06:54.089 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:06:54.090 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (73m) 49s ago 75m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:06:54.090 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (67m) 49s ago 75m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:06:54.090 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (67m) 8m ago 74m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:06:54.090 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (73m) 49s ago 74m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:06:54.091 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 49s ago 71m - - 2023-10-18T22:06:54.091 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 49s ago 70m - - 2023-10-18T22:06:54.091 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 71m - - 2023-10-18T22:06:54.091 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 70m - - 2023-10-18T22:06:54.091 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (68m) 49s ago 76m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:06:54.091 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (68m) 8m ago 74m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:06:54.092 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (67m) 49s ago 76m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:06:54.092 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (67m) 8m ago 74m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:06:54.092 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (74m) 49s ago 74m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:06:54.092 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (73m) 8m ago 73m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:06:54.092 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (67m) 49s ago 73m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:06:54.093 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (65m) 49s ago 73m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:06:54.093 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (64m) 49s ago 72m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:06:54.093 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (64m) 8m ago 72m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:06:54.093 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (63m) 8m ago 72m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:06:54.093 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (63m) 8m ago 72m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:06:54.094 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (69m) 49s ago 74m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:06:54.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 -- 172.21.15.8:0/1405387817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f04a0060f70 msgr2=0x7f04a0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:54.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f04a0060f70 0x7f04a0063430 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f04b00ff6e0 tx=0x7f04a4009040).stop 2023-10-18T22:06:54.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 -- 172.21.15.8:0/1405387817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04b00f77d0 msgr2=0x7f04b00ffe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:54.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04b00f77d0 0x7f04b00ffe40 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f049c009830 tx=0x7f049c009b30).stop 2023-10-18T22:06:54.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 -- 172.21.15.8:0/1405387817 shutdown_connections 2023-10-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f04a0060f70 0x7f04a0063430 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04b00f6530 0x7f04b00ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 --2- 172.21.15.8:0/1405387817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04b00f77d0 0x7f04b00ffe40 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 -- 172.21.15.8:0/1405387817 >> 172.21.15.8:0/1405387817 conn(0x7f04b00f1c90 msgr2=0x7f04b006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:54.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 -- 172.21.15.8:0/1405387817 shutdown_connections 2023-10-18T22:06:54.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.089+0000 7f04b5a53700 1 -- 172.21.15.8:0/1405387817 wait complete. 2023-10-18T22:06:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.225+0000 7f17ca06b700 1 -- 172.21.15.8:0/617229720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17c4060310 msgr2=0x7f17c40f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:54.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.225+0000 7f17ca06b700 1 --2- 172.21.15.8:0/617229720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17c4060310 0x7f17c40f9120 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f17c0004660 tx=0x7f17c0009b30).stop 2023-10-18T22:06:54.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.225+0000 7f17ca06b700 1 -- 172.21.15.8:0/617229720 shutdown_connections 2023-10-18T22:06:54.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.225+0000 7f17ca06b700 1 --2- 172.21.15.8:0/617229720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c40f96a0 0x7f17c40fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.225+0000 7f17ca06b700 1 --2- 172.21.15.8:0/617229720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17c4060310 0x7f17c40f9120 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.225+0000 7f17ca06b700 1 -- 172.21.15.8:0/617229720 >> 172.21.15.8:0/617229720 conn(0x7f17c40f0ba0 msgr2=0x7f17c40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:54.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.225+0000 7f17ca06b700 1 -- 172.21.15.8:0/617229720 shutdown_connections 2023-10-18T22:06:54.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.225+0000 7f17ca06b700 1 -- 172.21.15.8:0/617229720 wait complete. 2023-10-18T22:06:54.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.226+0000 7f17ca06b700 1 Processor -- start 2023-10-18T22:06:54.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.226+0000 7f17ca06b700 1 -- start start 2023-10-18T22:06:54.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.226+0000 7f17ca06b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c4060310 0x7f17c4106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:54.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.226+0000 7f17ca06b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17c40f96a0 0x7f17c4107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:54.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.227+0000 7f17ca06b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4107850 con 0x7f17c40f96a0 2023-10-18T22:06:54.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.227+0000 7f17ca06b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4108060 con 0x7f17c4060310 2023-10-18T22:06:54.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.227+0000 7f17c8868700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17c40f96a0 0x7f17c4107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:54.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.227+0000 7f17c8868700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17c40f96a0 0x7f17c4107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59984/0 (socket says 172.21.15.8:59984) 2023-10-18T22:06:54.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.227+0000 7f17c8868700 1 -- 172.21.15.8:0/4161263900 learned_addr learned my addr 172.21.15.8:0/4161263900 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:54.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.227+0000 7f17c9069700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c4060310 0x7f17c4106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:54.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.227+0000 7f17c8868700 1 -- 172.21.15.8:0/4161263900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c4060310 msgr2=0x7f17c4106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:54.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.227+0000 7f17c8868700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c4060310 0x7f17c4106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.227+0000 7f17c8868700 1 -- 172.21.15.8:0/4161263900 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0005040 con 0x7f17c40f96a0 2023-10-18T22:06:54.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.227+0000 7f17c8868700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17c40f96a0 0x7f17c4107250 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f17b400e7c0 tx=0x7f17b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:54.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.228+0000 7f17b9ffb700 1 -- 172.21.15.8:0/4161263900 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17b40092e0 con 0x7f17c40f96a0 2023-10-18T22:06:54.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.228+0000 7f17b9ffb700 1 -- 172.21.15.8:0/4161263900 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f17b400f040 con 0x7f17c40f96a0 2023-10-18T22:06:54.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.228+0000 7f17ca06b700 1 -- 172.21.15.8:0/4161263900 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c4108280 con 0x7f17c40f96a0 2023-10-18T22:06:54.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.228+0000 7f17b9ffb700 1 -- 172.21.15.8:0/4161263900 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17b4014770 con 0x7f17c40f96a0 2023-10-18T22:06:54.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.228+0000 7f17ca06b700 1 -- 172.21.15.8:0/4161263900 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c41087c0 con 0x7f17c40f96a0 2023-10-18T22:06:54.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.229+0000 7f17ca06b700 1 -- 172.21.15.8:0/4161263900 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c4059100 con 0x7f17c40f96a0 2023-10-18T22:06:54.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.230+0000 7f17b9ffb700 1 -- 172.21.15.8:0/4161263900 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f17b4014a30 con 0x7f17c40f96a0 2023-10-18T22:06:54.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.230+0000 7f17b9ffb700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17b0060f70 0x7f17b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:54.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.231+0000 7f17b9ffb700 1 -- 172.21.15.8:0/4161263900 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f17b407cd90 con 0x7f17c40f96a0 2023-10-18T22:06:54.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.231+0000 7f17c9069700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17b0060f70 0x7f17b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:54.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.231+0000 7f17c9069700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17b0060f70 0x7f17b0063430 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f17c00043d0 tx=0x7f17c000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:54.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.235+0000 7f17b9ffb700 1 -- 172.21.15.8:0/4161263900 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f17b404c9c0 con 0x7f17c40f96a0 2023-10-18T22:06:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.491+0000 7f17ca06b700 1 -- 172.21.15.8:0/4161263900 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f17c40fedf0 con 0x7f17c40f96a0 2023-10-18T22:06:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.492+0000 7f17b9ffb700 1 -- 172.21.15.8:0/4161263900 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f17b404ffe0 con 0x7f17c40f96a0 2023-10-18T22:06:54.495 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:06:54.495 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:06:54.495 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:06:54.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:06:54.495 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:06:54.496 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:06:54.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:06:54.496 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:06:54.496 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:06:54.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:06:54.497 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:06:54.497 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:06:54.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:06:54.497 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:06:54.497 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:06:54.498 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:06:54.498 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:06:54.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.493+0000 7f17ca06b700 1 -- 172.21.15.8:0/4161263900 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17b0060f70 msgr2=0x7f17b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:54.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.493+0000 7f17ca06b700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17b0060f70 0x7f17b0063430 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f17c00043d0 tx=0x7f17c000b040).stop 2023-10-18T22:06:54.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.493+0000 7f17ca06b700 1 -- 172.21.15.8:0/4161263900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17c40f96a0 msgr2=0x7f17c4107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:54.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.493+0000 7f17ca06b700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17c40f96a0 0x7f17c4107250 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f17b400e7c0 tx=0x7f17b400b040).stop 2023-10-18T22:06:54.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.494+0000 7f17ca06b700 1 -- 172.21.15.8:0/4161263900 shutdown_connections 2023-10-18T22:06:54.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.494+0000 7f17ca06b700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f17b0060f70 0x7f17b0063430 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.494+0000 7f17ca06b700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c4060310 0x7f17c4106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.494+0000 7f17ca06b700 1 --2- 172.21.15.8:0/4161263900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17c40f96a0 0x7f17c4107250 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.494+0000 7f17ca06b700 1 -- 172.21.15.8:0/4161263900 >> 172.21.15.8:0/4161263900 conn(0x7f17c40f0ba0 msgr2=0x7f17c40f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:54.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.494+0000 7f17ca06b700 1 -- 172.21.15.8:0/4161263900 shutdown_connections 2023-10-18T22:06:54.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.494+0000 7f17ca06b700 1 -- 172.21.15.8:0/4161263900 wait complete. 2023-10-18T22:06:54.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.629+0000 7f0a21ce2700 1 -- 172.21.15.8:0/4066523617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a1c06b9c0 msgr2=0x7f0a1c069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:54.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.629+0000 7f0a21ce2700 1 --2- 172.21.15.8:0/4066523617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a1c06b9c0 0x7f0a1c069ec0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f0a10004660 tx=0x7f0a10009b30).stop 2023-10-18T22:06:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.630+0000 7f0a21ce2700 1 -- 172.21.15.8:0/4066523617 shutdown_connections 2023-10-18T22:06:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.630+0000 7f0a21ce2700 1 --2- 172.21.15.8:0/4066523617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a1c06a3b0 0x7f0a1c06a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.630+0000 7f0a21ce2700 1 --2- 172.21.15.8:0/4066523617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a1c06b9c0 0x7f0a1c069ec0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.630+0000 7f0a21ce2700 1 -- 172.21.15.8:0/4066523617 >> 172.21.15.8:0/4066523617 conn(0x7f0a1c0f1c90 msgr2=0x7f0a1c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.630+0000 7f0a21ce2700 1 -- 172.21.15.8:0/4066523617 shutdown_connections 2023-10-18T22:06:54.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.630+0000 7f0a21ce2700 1 -- 172.21.15.8:0/4066523617 wait complete. 2023-10-18T22:06:54.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.630+0000 7f0a21ce2700 1 Processor -- start 2023-10-18T22:06:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.631+0000 7f0a21ce2700 1 -- start start 2023-10-18T22:06:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.631+0000 7f0a21ce2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a1c06a3b0 0x7f0a1c108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.631+0000 7f0a21ce2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a1c06b9c0 0x7f0a1c109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.631+0000 7f0a21ce2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c1099e0 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.631+0000 7f0a21ce2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c109b20 con 0x7f0a1c06a3b0 2023-10-18T22:06:54.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.631+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a1c06b9c0 0x7f0a1c109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:54.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.631+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a1c06b9c0 0x7f0a1c109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59990/0 (socket says 172.21.15.8:59990) 2023-10-18T22:06:54.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.631+0000 7f0a1bfff700 1 -- 172.21.15.8:0/3800472762 learned_addr learned my addr 172.21.15.8:0/3800472762 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:54.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.632+0000 7f0a20ce0700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a1c06a3b0 0x7f0a1c108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.632+0000 7f0a1bfff700 1 -- 172.21.15.8:0/3800472762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a1c06a3b0 msgr2=0x7f0a1c108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.632+0000 7f0a1bfff700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a1c06a3b0 0x7f0a1c108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.632+0000 7f0a1bfff700 1 -- 172.21.15.8:0/3800472762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10005040 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.632+0000 7f0a1bfff700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a1c06b9c0 0x7f0a1c109430 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f0a08002700 tx=0x7f0a08009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.632+0000 7f0a197fa700 1 -- 172.21.15.8:0/3800472762 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a08009320 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.632+0000 7f0a197fa700 1 -- 172.21.15.8:0/3800472762 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0a0800f040 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.632+0000 7f0a21ce2700 1 -- 172.21.15.8:0/3800472762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c10a4c0 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.632+0000 7f0a197fa700 1 -- 172.21.15.8:0/3800472762 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a080148a0 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.632+0000 7f0a21ce2700 1 -- 172.21.15.8:0/3800472762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c10aa80 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.633+0000 7f0a21ce2700 1 -- 172.21.15.8:0/3800472762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c045ad0 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.634+0000 7f0a197fa700 1 -- 172.21.15.8:0/3800472762 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0a08009480 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.635+0000 7f0a197fa700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a0c060f70 0x7f0a0c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:54.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.635+0000 7f0a197fa700 1 -- 172.21.15.8:0/3800472762 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0a0807cd80 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.635+0000 7f0a20ce0700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a0c060f70 0x7f0a0c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:54.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.636+0000 7f0a20ce0700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a0c060f70 0x7f0a0c063430 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f0a10004e30 tx=0x7f0a10009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:54.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.639+0000 7f0a197fa700 1 -- 172.21.15.8:0/3800472762 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0a080503d0 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.866+0000 7f0a21ce2700 1 -- 172.21.15.8:0/3800472762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0a1c10ad00 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.867+0000 7f0a197fa700 1 -- 172.21.15.8:0/3800472762 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f0a0804ffc0 con 0x7f0a1c06b9c0 2023-10-18T22:06:54.869 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:06:54.870 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:06:54.870 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:06:54.870 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:06:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:06:54.871 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:06:54.871 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:06:54.871 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:06:54.871 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:06:54.872 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:06:54.872 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:06:54.872 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:06:54.872 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:06:54.872 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:06:54.873 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:06:54.873 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:06:54.873 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:06:54.873 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:06:54.873 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:06:54.874 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:06:54.874 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:06:54.874 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:06:54.874 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:06:54.874 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:06:54.875 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:06:54.875 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:06:54.875 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:06:54.875 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:06:54.875 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:06:54.877 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:06:54.877 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:06:54.877 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:06:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:06:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:06:54.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 -- 172.21.15.8:0/3800472762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a0c060f70 msgr2=0x7f0a0c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:54.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a0c060f70 0x7f0a0c063430 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f0a10004e30 tx=0x7f0a10009b30).stop 2023-10-18T22:06:54.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 -- 172.21.15.8:0/3800472762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a1c06b9c0 msgr2=0x7f0a1c109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:54.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a1c06b9c0 0x7f0a1c109430 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f0a08002700 tx=0x7f0a08009e00).stop 2023-10-18T22:06:54.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 -- 172.21.15.8:0/3800472762 shutdown_connections 2023-10-18T22:06:54.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0a0c060f70 0x7f0a0c063430 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a1c06a3b0 0x7f0a1c108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 --2- 172.21.15.8:0/3800472762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a1c06b9c0 0x7f0a1c109430 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:54.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 -- 172.21.15.8:0/3800472762 >> 172.21.15.8:0/3800472762 conn(0x7f0a1c0f1c90 msgr2=0x7f0a1c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:54.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 -- 172.21.15.8:0/3800472762 shutdown_connections 2023-10-18T22:06:54.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:54.869+0000 7f0a21ce2700 1 -- 172.21.15.8:0/3800472762 wait complete. 2023-10-18T22:06:54.881 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:06:55.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.008+0000 7f9378d98700 1 -- 172.21.15.8:0/2634161277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93740f6530 msgr2=0x7f93740f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.008+0000 7f9378d98700 1 --2- 172.21.15.8:0/2634161277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93740f6530 0x7f93740f6950 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f9364004660 tx=0x7f9364009b30).stop 2023-10-18T22:06:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.008+0000 7f9378d98700 1 -- 172.21.15.8:0/2634161277 shutdown_connections 2023-10-18T22:06:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.008+0000 7f9378d98700 1 --2- 172.21.15.8:0/2634161277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740f77d0 0x7f93740f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.008+0000 7f9378d98700 1 --2- 172.21.15.8:0/2634161277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93740f6530 0x7f93740f6950 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.008+0000 7f9378d98700 1 -- 172.21.15.8:0/2634161277 >> 172.21.15.8:0/2634161277 conn(0x7f93740f1c90 msgr2=0x7f93740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.008+0000 7f9378d98700 1 -- 172.21.15.8:0/2634161277 shutdown_connections 2023-10-18T22:06:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.008+0000 7f9378d98700 1 -- 172.21.15.8:0/2634161277 wait complete. 2023-10-18T22:06:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.009+0000 7f9378d98700 1 Processor -- start 2023-10-18T22:06:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.009+0000 7f9378d98700 1 -- start start 2023-10-18T22:06:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.009+0000 7f9378d98700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740f6530 0x7f9374106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.009+0000 7f9378d98700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93740f77d0 0x7f9374107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.009+0000 7f9378d98700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9374107880 con 0x7f93740f77d0 2023-10-18T22:06:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.009+0000 7f9378d98700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93741080c0 con 0x7f93740f6530 2023-10-18T22:06:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.009+0000 7f9372ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93740f77d0 0x7f9374107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f9372ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93740f77d0 0x7f9374107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60012/0 (socket says 172.21.15.8:60012) 2023-10-18T22:06:55.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f9372ffd700 1 -- 172.21.15.8:0/1906177873 learned_addr learned my addr 172.21.15.8:0/1906177873 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:06:55.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f93737fe700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740f6530 0x7f9374106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:55.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f9372ffd700 1 -- 172.21.15.8:0/1906177873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740f6530 msgr2=0x7f9374106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:55.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f9372ffd700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740f6530 0x7f9374106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:55.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f9372ffd700 1 -- 172.21.15.8:0/1906177873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9364005040 con 0x7f93740f77d0 2023-10-18T22:06:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f9372ffd700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93740f77d0 0x7f9374107280 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f936800e7f0 tx=0x7f936800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f935bfff700 1 -- 172.21.15.8:0/1906177873 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93680092e0 con 0x7f93740f77d0 2023-10-18T22:06:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f9378d98700 1 -- 172.21.15.8:0/1906177873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93741083a0 con 0x7f93740f77d0 2023-10-18T22:06:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f935bfff700 1 -- 172.21.15.8:0/1906177873 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f936800f040 con 0x7f93740f77d0 2023-10-18T22:06:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.010+0000 7f935bfff700 1 -- 172.21.15.8:0/1906177873 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93680147e0 con 0x7f93740f77d0 2023-10-18T22:06:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.011+0000 7f9378d98700 1 -- 172.21.15.8:0/1906177873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93741088e0 con 0x7f93740f77d0 2023-10-18T22:06:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.012+0000 7f9378d98700 1 -- 172.21.15.8:0/1906177873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9374059100 con 0x7f93740f77d0 2023-10-18T22:06:55.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.012+0000 7f935bfff700 1 -- 172.21.15.8:0/1906177873 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f936801b030 con 0x7f93740f77d0 2023-10-18T22:06:55.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.014+0000 7f935bfff700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f935c060f70 0x7f935c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:06:55.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.014+0000 7f935bfff700 1 -- 172.21.15.8:0/1906177873 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f936807c740 con 0x7f93740f77d0 2023-10-18T22:06:55.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.014+0000 7f93737fe700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f935c060f70 0x7f935c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:06:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.015+0000 7f93737fe700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f935c060f70 0x7f935c063430 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f9364009880 tx=0x7f936400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:06:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.018+0000 7f935bfff700 1 -- 172.21.15.8:0/1906177873 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f936804c340 con 0x7f93740f77d0 2023-10-18T22:06:55.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.217+0000 7f9378d98700 1 -- 172.21.15.8:0/1906177873 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93740fee20 con 0x7f935c060f70 2023-10-18T22:06:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.219+0000 7f935bfff700 1 -- 172.21.15.8:0/1906177873 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f93740fee20 con 0x7f935c060f70 2023-10-18T22:06:55.221 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:06:55.222 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:06:55.222 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:06:55.222 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:06:55.222 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:06:55.223 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:06:55.223 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:06:55.223 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:06:55.223 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:06:55.224 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:06:55.224 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:06:55.224 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:06:55.225 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:06:55.225 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:06:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.220+0000 7f9378d98700 1 -- 172.21.15.8:0/1906177873 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f935c060f70 msgr2=0x7f935c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:55.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.220+0000 7f9378d98700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f935c060f70 0x7f935c063430 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f9364009880 tx=0x7f936400b040).stop 2023-10-18T22:06:55.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.220+0000 7f9378d98700 1 -- 172.21.15.8:0/1906177873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93740f77d0 msgr2=0x7f9374107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:06:55.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.220+0000 7f9378d98700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93740f77d0 0x7f9374107280 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f936800e7f0 tx=0x7f936800b040).stop 2023-10-18T22:06:55.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.221+0000 7f9378d98700 1 -- 172.21.15.8:0/1906177873 shutdown_connections 2023-10-18T22:06:55.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.221+0000 7f9378d98700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f935c060f70 0x7f935c063430 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:55.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.221+0000 7f9378d98700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93740f6530 0x7f9374106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:55.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.221+0000 7f9378d98700 1 --2- 172.21.15.8:0/1906177873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93740f77d0 0x7f9374107280 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:06:55.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.221+0000 7f9378d98700 1 -- 172.21.15.8:0/1906177873 >> 172.21.15.8:0/1906177873 conn(0x7f93740f1c90 msgr2=0x7f93740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:06:55.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.221+0000 7f9378d98700 1 -- 172.21.15.8:0/1906177873 shutdown_connections 2023-10-18T22:06:55.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:06:55.221+0000 7f9378d98700 1 -- 172.21.15.8:0/1906177873 wait complete. 2023-10-18T22:06:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:53.386676+0000 mgr.smithi008.flmjzp (mgr.14640) 4077 : audit [DBG] from='client.37312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:53.597600+0000 mgr.smithi008.flmjzp (mgr.14640) 4078 : cluster [DBG] pgmap v2801: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:53.736828+0000 mgr.smithi008.flmjzp (mgr.14640) 4079 : audit [DBG] from='client.37316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:54.079753+0000 mgr.smithi008.flmjzp (mgr.14640) 4080 : audit [DBG] from='client.37320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:54.493203+0000 mon.smithi008 (mon.0) 4395 : audit [DBG] from='client.? 172.21.15.8:0/4161263900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:54.868191+0000 mon.smithi008 (mon.0) 4396 : audit [DBG] from='client.? 172.21.15.8:0/3800472762' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:06:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:53.386676+0000 mgr.smithi008.flmjzp (mgr.14640) 4077 : audit [DBG] from='client.37312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:53.597600+0000 mgr.smithi008.flmjzp (mgr.14640) 4078 : cluster [DBG] pgmap v2801: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:53.736828+0000 mgr.smithi008.flmjzp (mgr.14640) 4079 : audit [DBG] from='client.37316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:54.079753+0000 mgr.smithi008.flmjzp (mgr.14640) 4080 : audit [DBG] from='client.37320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:54.493203+0000 mon.smithi008 (mon.0) 4395 : audit [DBG] from='client.? 172.21.15.8:0/4161263900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:55.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:54.868191+0000 mon.smithi008 (mon.0) 4396 : audit [DBG] from='client.? 172.21.15.8:0/3800472762' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:06:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:55.220001+0000 mgr.smithi008.flmjzp (mgr.14640) 4081 : audit [DBG] from='client.37332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:55.623135+0000 mon.smithi008 (mon.0) 4397 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:55.624852+0000 mon.smithi008 (mon.0) 4398 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:56.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:55.625539+0000 mon.smithi008 (mon.0) 4399 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:55.630875+0000 mon.smithi008 (mon.0) 4400 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:55.636166+0000 mon.smithi008 (mon.0) 4401 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:55.638932+0000 mon.smithi008 (mon.0) 4402 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:55.640505+0000 mon.smithi008 (mon.0) 4403 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:56.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:55.642003+0000 mon.smithi008 (mon.0) 4404 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:56.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:06:55.644061+0000 mon.smithi008 (mon.0) 4405 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:55.220001+0000 mgr.smithi008.flmjzp (mgr.14640) 4081 : audit [DBG] from='client.37332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:06:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:55.623135+0000 mon.smithi008 (mon.0) 4397 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:55.624852+0000 mon.smithi008 (mon.0) 4398 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:06:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:55.625539+0000 mon.smithi008 (mon.0) 4399 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:06:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:55.630875+0000 mon.smithi008 (mon.0) 4400 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:06:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:55.636166+0000 mon.smithi008 (mon.0) 4401 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:06:56.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:55.638932+0000 mon.smithi008 (mon.0) 4402 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:55.640505+0000 mon.smithi008 (mon.0) 4403 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:55.642003+0000 mon.smithi008 (mon.0) 4404 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:56.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:06:55.644061+0000 mon.smithi008 (mon.0) 4405 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:06:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:55.598091+0000 mgr.smithi008.flmjzp (mgr.14640) 4082 : cluster [DBG] pgmap v2802: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:55.626165+0000 mgr.smithi008.flmjzp (mgr.14640) 4083 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:55.626620+0000 mgr.smithi008.flmjzp (mgr.14640) 4084 : cluster [DBG] pgmap v2803: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:55.626842+0000 mgr.smithi008.flmjzp (mgr.14640) 4085 : cluster [DBG] pgmap v2804: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:06:55.645791+0000 mgr.smithi008.flmjzp (mgr.14640) 4086 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:55.598091+0000 mgr.smithi008.flmjzp (mgr.14640) 4082 : cluster [DBG] pgmap v2802: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:55.626165+0000 mgr.smithi008.flmjzp (mgr.14640) 4083 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:06:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:55.626620+0000 mgr.smithi008.flmjzp (mgr.14640) 4084 : cluster [DBG] pgmap v2803: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:55.626842+0000 mgr.smithi008.flmjzp (mgr.14640) 4085 : cluster [DBG] pgmap v2804: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:06:55.645791+0000 mgr.smithi008.flmjzp (mgr.14640) 4086 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:06:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:06:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:57.627432+0000 mgr.smithi008.flmjzp (mgr.14640) 4087 : cluster [DBG] pgmap v2805: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:06:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:06:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:57.627432+0000 mgr.smithi008.flmjzp (mgr.14640) 4087 : cluster [DBG] pgmap v2805: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:06:59.627914+0000 mgr.smithi008.flmjzp (mgr.14640) 4088 : cluster [DBG] pgmap v2806: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:06:59.627914+0000 mgr.smithi008.flmjzp (mgr.14640) 4088 : cluster [DBG] pgmap v2806: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:03.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:01.628409+0000 mgr.smithi008.flmjzp (mgr.14640) 4089 : cluster [DBG] pgmap v2807: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:01.628409+0000 mgr.smithi008.flmjzp (mgr.14640) 4089 : cluster [DBG] pgmap v2807: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:03.629018+0000 mgr.smithi008.flmjzp (mgr.14640) 4090 : cluster [DBG] pgmap v2808: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:03.629018+0000 mgr.smithi008.flmjzp (mgr.14640) 4090 : cluster [DBG] pgmap v2808: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:05.656501+0000 mon.smithi008 (mon.0) 4406 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:05.656501+0000 mon.smithi008 (mon.0) 4406 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:05.629610+0000 mgr.smithi008.flmjzp (mgr.14640) 4091 : cluster [DBG] pgmap v2809: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:06.217314+0000 mon.smithi008 (mon.0) 4407 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:06.218490+0000 mon.smithi008 (mon.0) 4408 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:06.219408+0000 mgr.smithi008.flmjzp (mgr.14640) 4092 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:06.220148+0000 mgr.smithi008.flmjzp (mgr.14640) 4093 : cluster [DBG] pgmap v2810: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:06.220431+0000 mgr.smithi008.flmjzp (mgr.14640) 4094 : cluster [DBG] pgmap v2811: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:07.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:06.224754+0000 mon.smithi008 (mon.0) 4409 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:07.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:06.232868+0000 mon.smithi008 (mon.0) 4410 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:07.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:06.236392+0000 mon.smithi008 (mon.0) 4411 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:07.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:06.238351+0000 mon.smithi008 (mon.0) 4412 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:07.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:06.240281+0000 mon.smithi008 (mon.0) 4413 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:07.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:06.242941+0000 mon.smithi008 (mon.0) 4414 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:07.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:06.245033+0000 mgr.smithi008.flmjzp (mgr.14640) 4095 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:05.629610+0000 mgr.smithi008.flmjzp (mgr.14640) 4091 : cluster [DBG] pgmap v2809: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:06.217314+0000 mon.smithi008 (mon.0) 4407 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:06.218490+0000 mon.smithi008 (mon.0) 4408 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:06.219408+0000 mgr.smithi008.flmjzp (mgr.14640) 4092 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:06.220148+0000 mgr.smithi008.flmjzp (mgr.14640) 4093 : cluster [DBG] pgmap v2810: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:06.220431+0000 mgr.smithi008.flmjzp (mgr.14640) 4094 : cluster [DBG] pgmap v2811: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:06.224754+0000 mon.smithi008 (mon.0) 4409 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:06.232868+0000 mon.smithi008 (mon.0) 4410 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:06.236392+0000 mon.smithi008 (mon.0) 4411 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:06.238351+0000 mon.smithi008 (mon.0) 4412 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:06.240281+0000 mon.smithi008 (mon.0) 4413 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:06.242941+0000 mon.smithi008 (mon.0) 4414 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:06.245033+0000 mgr.smithi008.flmjzp (mgr.14640) 4095 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:08.220872+0000 mgr.smithi008.flmjzp (mgr.14640) 4096 : cluster [DBG] pgmap v2812: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:08.220872+0000 mgr.smithi008.flmjzp (mgr.14640) 4096 : cluster [DBG] pgmap v2812: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:10.221626+0000 mgr.smithi008.flmjzp (mgr.14640) 4097 : cluster [DBG] pgmap v2813: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:10.221626+0000 mgr.smithi008.flmjzp (mgr.14640) 4097 : cluster [DBG] pgmap v2813: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:12.222376+0000 mgr.smithi008.flmjzp (mgr.14640) 4098 : cluster [DBG] pgmap v2814: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:12.222376+0000 mgr.smithi008.flmjzp (mgr.14640) 4098 : cluster [DBG] pgmap v2814: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:14.222992+0000 mgr.smithi008.flmjzp (mgr.14640) 4099 : cluster [DBG] pgmap v2815: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:14.222992+0000 mgr.smithi008.flmjzp (mgr.14640) 4099 : cluster [DBG] pgmap v2815: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:16.223587+0000 mgr.smithi008.flmjzp (mgr.14640) 4100 : cluster [DBG] pgmap v2816: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:16.253332+0000 mon.smithi008 (mon.0) 4415 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:16.255534+0000 mon.smithi008 (mon.0) 4416 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:16.256527+0000 mon.smithi008 (mon.0) 4417 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:17.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:16.257411+0000 mgr.smithi008.flmjzp (mgr.14640) 4101 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:17.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:16.258001+0000 mgr.smithi008.flmjzp (mgr.14640) 4102 : cluster [DBG] pgmap v2817: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:17.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:16.258278+0000 mgr.smithi008.flmjzp (mgr.14640) 4103 : cluster [DBG] pgmap v2818: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:17.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:16.263365+0000 mon.smithi008 (mon.0) 4418 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:17.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:16.270566+0000 mon.smithi008 (mon.0) 4419 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:17.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:16.273711+0000 mon.smithi008 (mon.0) 4420 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:17.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:16.275346+0000 mon.smithi008 (mon.0) 4421 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:17.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:16.276988+0000 mon.smithi008 (mon.0) 4422 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:17.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:16.278977+0000 mon.smithi008 (mon.0) 4423 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:17.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:16.281045+0000 mgr.smithi008.flmjzp (mgr.14640) 4104 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:16.223587+0000 mgr.smithi008.flmjzp (mgr.14640) 4100 : cluster [DBG] pgmap v2816: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:16.253332+0000 mon.smithi008 (mon.0) 4415 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:16.255534+0000 mon.smithi008 (mon.0) 4416 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:16.256527+0000 mon.smithi008 (mon.0) 4417 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:16.257411+0000 mgr.smithi008.flmjzp (mgr.14640) 4101 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:16.258001+0000 mgr.smithi008.flmjzp (mgr.14640) 4102 : cluster [DBG] pgmap v2817: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:16.258278+0000 mgr.smithi008.flmjzp (mgr.14640) 4103 : cluster [DBG] pgmap v2818: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:17.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:16.263365+0000 mon.smithi008 (mon.0) 4418 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:17.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:16.270566+0000 mon.smithi008 (mon.0) 4419 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:17.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:16.273711+0000 mon.smithi008 (mon.0) 4420 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:17.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:16.275346+0000 mon.smithi008 (mon.0) 4421 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:17.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:16.276988+0000 mon.smithi008 (mon.0) 4422 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:17.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:16.278977+0000 mon.smithi008 (mon.0) 4423 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:17.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:16.281045+0000 mgr.smithi008.flmjzp (mgr.14640) 4104 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:18.258931+0000 mgr.smithi008.flmjzp (mgr.14640) 4105 : cluster [DBG] pgmap v2819: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:18.258931+0000 mgr.smithi008.flmjzp (mgr.14640) 4105 : cluster [DBG] pgmap v2819: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:20.259550+0000 mgr.smithi008.flmjzp (mgr.14640) 4106 : cluster [DBG] pgmap v2820: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:20.259550+0000 mgr.smithi008.flmjzp (mgr.14640) 4106 : cluster [DBG] pgmap v2820: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:22.260027+0000 mgr.smithi008.flmjzp (mgr.14640) 4107 : cluster [DBG] pgmap v2821: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:22.260027+0000 mgr.smithi008.flmjzp (mgr.14640) 4107 : cluster [DBG] pgmap v2821: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:25.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.375+0000 7f1a9230f700 1 -- 172.21.15.8:0/3776297323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a8c0f9690 msgr2=0x7f1a8c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:25.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.375+0000 7f1a9230f700 1 --2- 172.21.15.8:0/3776297323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a8c0f9690 0x7f1a8c0fbae0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7f1a7c004660 tx=0x7f1a7c009b30).stop 2023-10-18T22:07:25.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.375+0000 7f1a9230f700 1 -- 172.21.15.8:0/3776297323 shutdown_connections 2023-10-18T22:07:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.375+0000 7f1a9230f700 1 --2- 172.21.15.8:0/3776297323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a8c0f9690 0x7f1a8c0fbae0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.375+0000 7f1a9230f700 1 --2- 172.21.15.8:0/3776297323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c060310 0x7f1a8c0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.375+0000 7f1a9230f700 1 -- 172.21.15.8:0/3776297323 >> 172.21.15.8:0/3776297323 conn(0x7f1a8c0f0b90 msgr2=0x7f1a8c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.375+0000 7f1a9230f700 1 -- 172.21.15.8:0/3776297323 shutdown_connections 2023-10-18T22:07:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.376+0000 7f1a9230f700 1 -- 172.21.15.8:0/3776297323 wait complete. 2023-10-18T22:07:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.376+0000 7f1a9230f700 1 Processor -- start 2023-10-18T22:07:25.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.376+0000 7f1a9230f700 1 -- start start 2023-10-18T22:07:25.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.377+0000 7f1a9230f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c060310 0x7f1a8c106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:25.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.377+0000 7f1a9230f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a8c0f9690 0x7f1a8c107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:25.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.377+0000 7f1a9230f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c107840 con 0x7f1a8c0f9690 2023-10-18T22:07:25.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.377+0000 7f1a9230f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c108050 con 0x7f1a8c060310 2023-10-18T22:07:25.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.377+0000 7f1a90b0c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a8c0f9690 0x7f1a8c107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:25.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.377+0000 7f1a90b0c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a8c0f9690 0x7f1a8c107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56508/0 (socket says 172.21.15.8:56508) 2023-10-18T22:07:25.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.377+0000 7f1a90b0c700 1 -- 172.21.15.8:0/3064964196 learned_addr learned my addr 172.21.15.8:0/3064964196 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:25.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.377+0000 7f1a9130d700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c060310 0x7f1a8c106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.378+0000 7f1a90b0c700 1 -- 172.21.15.8:0/3064964196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c060310 msgr2=0x7f1a8c106d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.378+0000 7f1a90b0c700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c060310 0x7f1a8c106d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.378+0000 7f1a90b0c700 1 -- 172.21.15.8:0/3064964196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c005040 con 0x7f1a8c0f9690 2023-10-18T22:07:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.378+0000 7f1a90b0c700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a8c0f9690 0x7f1a8c107240 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f1a7c009870 tx=0x7f1a7c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:25.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.378+0000 7f1a81ffb700 1 -- 172.21.15.8:0/3064964196 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7c019070 con 0x7f1a8c0f9690 2023-10-18T22:07:25.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.378+0000 7f1a81ffb700 1 -- 172.21.15.8:0/3064964196 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1a7c013380 con 0x7f1a8c0f9690 2023-10-18T22:07:25.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.378+0000 7f1a81ffb700 1 -- 172.21.15.8:0/3064964196 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7c01edf0 con 0x7f1a8c0f9690 2023-10-18T22:07:25.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.378+0000 7f1a9230f700 1 -- 172.21.15.8:0/3064964196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c108270 con 0x7f1a8c0f9690 2023-10-18T22:07:25.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.378+0000 7f1a9230f700 1 -- 172.21.15.8:0/3064964196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c108750 con 0x7f1a8c0f9690 2023-10-18T22:07:25.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.379+0000 7f1a9230f700 1 -- 172.21.15.8:0/3064964196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8c059100 con 0x7f1a8c0f9690 2023-10-18T22:07:25.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.380+0000 7f1a81ffb700 1 -- 172.21.15.8:0/3064964196 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1a7c01e420 con 0x7f1a8c0f9690 2023-10-18T22:07:25.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.381+0000 7f1a81ffb700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a78060f70 0x7f1a78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:25.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.381+0000 7f1a81ffb700 1 -- 172.21.15.8:0/3064964196 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1a7c07dce0 con 0x7f1a8c0f9690 2023-10-18T22:07:25.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.381+0000 7f1a9130d700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a78060f70 0x7f1a78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:25.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.382+0000 7f1a9130d700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a78060f70 0x7f1a78063430 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f1a8c106ac0 tx=0x7f1a8800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:25.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.386+0000 7f1a81ffb700 1 -- 172.21.15.8:0/3064964196 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1a7c04d910 con 0x7f1a8c0f9690 2023-10-18T22:07:25.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.587+0000 7f1a9230f700 1 -- 172.21.15.8:0/3064964196 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a8c0feda0 con 0x7f1a78060f70 2023-10-18T22:07:25.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.589+0000 7f1a81ffb700 1 -- 172.21.15.8:0/3064964196 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1a8c0feda0 con 0x7f1a78060f70 2023-10-18T22:07:25.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 -- 172.21.15.8:0/3064964196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a78060f70 msgr2=0x7f1a78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:25.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a78060f70 0x7f1a78063430 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f1a8c106ac0 tx=0x7f1a8800b040).stop 2023-10-18T22:07:25.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 -- 172.21.15.8:0/3064964196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a8c0f9690 msgr2=0x7f1a8c107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:25.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a8c0f9690 0x7f1a8c107240 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f1a7c009870 tx=0x7f1a7c00b040).stop 2023-10-18T22:07:25.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 -- 172.21.15.8:0/3064964196 shutdown_connections 2023-10-18T22:07:25.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1a78060f70 0x7f1a78063430 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c060310 0x7f1a8c106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 --2- 172.21.15.8:0/3064964196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a8c0f9690 0x7f1a8c107240 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 -- 172.21.15.8:0/3064964196 >> 172.21.15.8:0/3064964196 conn(0x7f1a8c0f0b90 msgr2=0x7f1a8c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 -- 172.21.15.8:0/3064964196 shutdown_connections 2023-10-18T22:07:25.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.591+0000 7f1a9230f700 1 -- 172.21.15.8:0/3064964196 wait complete. 2023-10-18T22:07:25.608 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:07:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:24.260749+0000 mgr.smithi008.flmjzp (mgr.14640) 4108 : cluster [DBG] pgmap v2822: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:25.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.728+0000 7efe66c07700 1 -- 172.21.15.8:0/2969398120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe600f77d0 msgr2=0x7efe600f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:25.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.728+0000 7efe66c07700 1 --2- 172.21.15.8:0/2969398120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe600f77d0 0x7efe600f7c30 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7efe50004660 tx=0x7efe50009b30).stop 2023-10-18T22:07:25.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.728+0000 7efe66c07700 1 -- 172.21.15.8:0/2969398120 shutdown_connections 2023-10-18T22:07:25.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.728+0000 7efe66c07700 1 --2- 172.21.15.8:0/2969398120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe600f77d0 0x7efe600f7c30 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.729+0000 7efe66c07700 1 --2- 172.21.15.8:0/2969398120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe600f6530 0x7efe600f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.729+0000 7efe66c07700 1 -- 172.21.15.8:0/2969398120 >> 172.21.15.8:0/2969398120 conn(0x7efe600f1c90 msgr2=0x7efe600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:25.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.729+0000 7efe66c07700 1 -- 172.21.15.8:0/2969398120 shutdown_connections 2023-10-18T22:07:25.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.729+0000 7efe66c07700 1 -- 172.21.15.8:0/2969398120 wait complete. 2023-10-18T22:07:25.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.729+0000 7efe66c07700 1 Processor -- start 2023-10-18T22:07:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.730+0000 7efe66c07700 1 -- start start 2023-10-18T22:07:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.730+0000 7efe66c07700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe600f6530 0x7efe60106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.730+0000 7efe66c07700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe600f77d0 0x7efe60107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.730+0000 7efe66c07700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe60107880 con 0x7efe600f77d0 2023-10-18T22:07:25.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.730+0000 7efe66c07700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe601080c0 con 0x7efe600f6530 2023-10-18T22:07:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.730+0000 7efe65404700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe600f77d0 0x7efe60107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.730+0000 7efe65404700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe600f77d0 0x7efe60107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56520/0 (socket says 172.21.15.8:56520) 2023-10-18T22:07:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.730+0000 7efe65404700 1 -- 172.21.15.8:0/2454752830 learned_addr learned my addr 172.21.15.8:0/2454752830 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.730+0000 7efe65c05700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe600f6530 0x7efe60106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:25.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.731+0000 7efe65404700 1 -- 172.21.15.8:0/2454752830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe600f6530 msgr2=0x7efe60106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:25.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.731+0000 7efe65404700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe600f6530 0x7efe60106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.731+0000 7efe65404700 1 -- 172.21.15.8:0/2454752830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50005040 con 0x7efe600f77d0 2023-10-18T22:07:25.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.731+0000 7efe65404700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe600f77d0 0x7efe60107280 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7efe50009f50 tx=0x7efe50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:25.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.731+0000 7efe567fc700 1 -- 172.21.15.8:0/2454752830 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe50018070 con 0x7efe600f77d0 2023-10-18T22:07:25.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.731+0000 7efe567fc700 1 -- 172.21.15.8:0/2454752830 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efe50009630 con 0x7efe600f77d0 2023-10-18T22:07:25.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.731+0000 7efe66c07700 1 -- 172.21.15.8:0/2454752830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe60108340 con 0x7efe600f77d0 2023-10-18T22:07:25.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.731+0000 7efe567fc700 1 -- 172.21.15.8:0/2454752830 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe5001c3c0 con 0x7efe600f77d0 2023-10-18T22:07:25.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.731+0000 7efe66c07700 1 -- 172.21.15.8:0/2454752830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe60108820 con 0x7efe600f77d0 2023-10-18T22:07:25.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.732+0000 7efe66c07700 1 -- 172.21.15.8:0/2454752830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe60059100 con 0x7efe600f77d0 2023-10-18T22:07:25.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:24.260749+0000 mgr.smithi008.flmjzp (mgr.14640) 4108 : cluster [DBG] pgmap v2822: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.733+0000 7efe567fc700 1 -- 172.21.15.8:0/2454752830 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7efe5001d420 con 0x7efe600f77d0 2023-10-18T22:07:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.735+0000 7efe567fc700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efe4c060f70 0x7efe4c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.735+0000 7efe567fc700 1 -- 172.21.15.8:0/2454752830 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7efe5007e5f0 con 0x7efe600f77d0 2023-10-18T22:07:25.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.735+0000 7efe65c05700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efe4c060f70 0x7efe4c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:25.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.735+0000 7efe65c05700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efe4c060f70 0x7efe4c063430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7efe60107b50 tx=0x7efe5c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:25.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.739+0000 7efe567fc700 1 -- 172.21.15.8:0/2454752830 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efe5004e1a0 con 0x7efe600f77d0 2023-10-18T22:07:25.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.939+0000 7efe66c07700 1 -- 172.21.15.8:0/2454752830 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe600fedf0 con 0x7efe4c060f70 2023-10-18T22:07:25.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.940+0000 7efe567fc700 1 -- 172.21.15.8:0/2454752830 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efe600fedf0 con 0x7efe4c060f70 2023-10-18T22:07:25.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 -- 172.21.15.8:0/2454752830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efe4c060f70 msgr2=0x7efe4c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efe4c060f70 0x7efe4c063430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7efe60107b50 tx=0x7efe5c00b040).stop 2023-10-18T22:07:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 -- 172.21.15.8:0/2454752830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe600f77d0 msgr2=0x7efe60107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe600f77d0 0x7efe60107280 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7efe50009f50 tx=0x7efe50009b30).stop 2023-10-18T22:07:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 -- 172.21.15.8:0/2454752830 shutdown_connections 2023-10-18T22:07:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efe4c060f70 0x7efe4c063430 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe600f6530 0x7efe60106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 --2- 172.21.15.8:0/2454752830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe600f77d0 0x7efe60107280 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:25.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 -- 172.21.15.8:0/2454752830 >> 172.21.15.8:0/2454752830 conn(0x7efe600f1c90 msgr2=0x7efe600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:25.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 -- 172.21.15.8:0/2454752830 shutdown_connections 2023-10-18T22:07:25.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:25.942+0000 7efe66c07700 1 -- 172.21.15.8:0/2454752830 wait complete. 2023-10-18T22:07:26.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.080+0000 7f97228c2700 1 -- 172.21.15.8:0/1178122285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971c0f96f0 msgr2=0x7f971c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:26.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.080+0000 7f97228c2700 1 --2- 172.21.15.8:0/1178122285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971c0f96f0 0x7f971c0fbae0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f970c004660 tx=0x7f970c009b30).stop 2023-10-18T22:07:26.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.080+0000 7f97228c2700 1 -- 172.21.15.8:0/1178122285 shutdown_connections 2023-10-18T22:07:26.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.080+0000 7f97228c2700 1 --2- 172.21.15.8:0/1178122285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971c0f96f0 0x7f971c0fbae0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.080+0000 7f97228c2700 1 --2- 172.21.15.8:0/1178122285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f971c0602b0 0x7f971c0f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.080+0000 7f97228c2700 1 -- 172.21.15.8:0/1178122285 >> 172.21.15.8:0/1178122285 conn(0x7f971c0f0b90 msgr2=0x7f971c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:26.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.080+0000 7f97228c2700 1 -- 172.21.15.8:0/1178122285 shutdown_connections 2023-10-18T22:07:26.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.080+0000 7f97228c2700 1 -- 172.21.15.8:0/1178122285 wait complete. 2023-10-18T22:07:26.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.081+0000 7f97228c2700 1 Processor -- start 2023-10-18T22:07:26.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.081+0000 7f97228c2700 1 -- start start 2023-10-18T22:07:26.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97228c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971c0602b0 0x7f971c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:26.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97228c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f971c0f96f0 0x7f971c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:26.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97228c2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c109a20 con 0x7f971c0602b0 2023-10-18T22:07:26.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97228c2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c109b60 con 0x7f971c0f96f0 2023-10-18T22:07:26.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97218c0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971c0602b0 0x7f971c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:26.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97218c0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971c0602b0 0x7f971c108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56540/0 (socket says 172.21.15.8:56540) 2023-10-18T22:07:26.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97218c0700 1 -- 172.21.15.8:0/2499884115 learned_addr learned my addr 172.21.15.8:0/2499884115 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97210bf700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f971c0f96f0 0x7f971c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97218c0700 1 -- 172.21.15.8:0/2499884115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f971c0f96f0 msgr2=0x7f971c109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97218c0700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f971c0f96f0 0x7f971c109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97218c0700 1 -- 172.21.15.8:0/2499884115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c005040 con 0x7f971c0602b0 2023-10-18T22:07:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.082+0000 7f97218c0700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971c0602b0 0x7f971c108f80 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f97180026d0 tx=0x7f9718009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.083+0000 7f97127fc700 1 -- 172.21.15.8:0/2499884115 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97180079c0 con 0x7f971c0602b0 2023-10-18T22:07:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.083+0000 7f97127fc700 1 -- 172.21.15.8:0/2499884115 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f971800f040 con 0x7f971c0602b0 2023-10-18T22:07:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.083+0000 7f97228c2700 1 -- 172.21.15.8:0/2499884115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c10a500 con 0x7f971c0602b0 2023-10-18T22:07:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.083+0000 7f97127fc700 1 -- 172.21.15.8:0/2499884115 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9718014980 con 0x7f971c0602b0 2023-10-18T22:07:26.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.083+0000 7f97228c2700 1 -- 172.21.15.8:0/2499884115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c10aac0 con 0x7f971c0602b0 2023-10-18T22:07:26.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.084+0000 7f97228c2700 1 -- 172.21.15.8:0/2499884115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c045ad0 con 0x7f971c0602b0 2023-10-18T22:07:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.085+0000 7f97127fc700 1 -- 172.21.15.8:0/2499884115 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f97180090d0 con 0x7f971c0602b0 2023-10-18T22:07:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.086+0000 7f97127fc700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9708060f70 0x7f9708063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.086+0000 7f97127fc700 1 -- 172.21.15.8:0/2499884115 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f971807c8a0 con 0x7f971c0602b0 2023-10-18T22:07:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.086+0000 7f97210bf700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9708060f70 0x7f9708063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.087+0000 7f97210bf700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9708060f70 0x7f9708063430 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f970c004630 tx=0x7f970c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.090+0000 7f97127fc700 1 -- 172.21.15.8:0/2499884115 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f971804ffb0 con 0x7f971c0602b0 2023-10-18T22:07:26.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.284+0000 7f97228c2700 1 -- 172.21.15.8:0/2499884115 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f971c0f5690 con 0x7f9708060f70 2023-10-18T22:07:26.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.293+0000 7f97127fc700 1 -- 172.21.15.8:0/2499884115 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f971c0f5690 con 0x7f9708060f70 2023-10-18T22:07:26.296 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:07:26.296 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (74m) 81s ago 75m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:07:26.296 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (67m) 81s ago 75m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:07:26.296 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (67m) 9m ago 74m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:07:26.297 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (74m) 81s ago 75m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:07:26.297 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 81s ago 71m - - 2023-10-18T22:07:26.297 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 81s ago 71m - - 2023-10-18T22:07:26.297 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 71m - - 2023-10-18T22:07:26.298 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 71m - - 2023-10-18T22:07:26.298 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (69m) 81s ago 76m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:07:26.298 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (68m) 9m ago 74m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:07:26.298 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (68m) 81s ago 77m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:07:26.299 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (68m) 9m ago 74m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:07:26.299 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (75m) 81s ago 75m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:07:26.299 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (74m) 9m ago 74m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:07:26.299 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (67m) 81s ago 74m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:07:26.299 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (65m) 81s ago 73m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:07:26.300 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (65m) 81s ago 73m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:07:26.300 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (64m) 9m ago 73m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:07:26.300 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (64m) 9m ago 72m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:07:26.300 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (63m) 9m ago 72m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:07:26.300 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (69m) 81s ago 74m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:07:26.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.295+0000 7f97228c2700 1 -- 172.21.15.8:0/2499884115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9708060f70 msgr2=0x7f9708063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.295+0000 7f97228c2700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9708060f70 0x7f9708063430 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f970c004630 tx=0x7f970c009b30).stop 2023-10-18T22:07:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.295+0000 7f97228c2700 1 -- 172.21.15.8:0/2499884115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971c0602b0 msgr2=0x7f971c108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.295+0000 7f97228c2700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971c0602b0 0x7f971c108f80 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f97180026d0 tx=0x7f9718009de0).stop 2023-10-18T22:07:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.296+0000 7f97228c2700 1 -- 172.21.15.8:0/2499884115 shutdown_connections 2023-10-18T22:07:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.296+0000 7f97228c2700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9708060f70 0x7f9708063430 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.296+0000 7f97228c2700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971c0602b0 0x7f971c108f80 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.296+0000 7f97228c2700 1 --2- 172.21.15.8:0/2499884115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f971c0f96f0 0x7f971c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.296+0000 7f97228c2700 1 -- 172.21.15.8:0/2499884115 >> 172.21.15.8:0/2499884115 conn(0x7f971c0f0b90 msgr2=0x7f971c0f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.296+0000 7f97228c2700 1 -- 172.21.15.8:0/2499884115 shutdown_connections 2023-10-18T22:07:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.296+0000 7f97228c2700 1 -- 172.21.15.8:0/2499884115 wait complete. 2023-10-18T22:07:26.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.433+0000 7fe2870e2700 1 -- 172.21.15.8:0/1830034227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2800f64b0 msgr2=0x7fe2800f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:26.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.433+0000 7fe2870e2700 1 --2- 172.21.15.8:0/1830034227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2800f64b0 0x7fe2800f68d0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7fe27c0047e0 tx=0x7fe27c009ad0).stop 2023-10-18T22:07:26.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.433+0000 7fe2870e2700 1 -- 172.21.15.8:0/1830034227 shutdown_connections 2023-10-18T22:07:26.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.433+0000 7fe2870e2700 1 --2- 172.21.15.8:0/1830034227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2800f7750 0x7fe2800f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.433+0000 7fe2870e2700 1 --2- 172.21.15.8:0/1830034227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2800f64b0 0x7fe2800f68d0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.433+0000 7fe2870e2700 1 -- 172.21.15.8:0/1830034227 >> 172.21.15.8:0/1830034227 conn(0x7fe2800f1c30 msgr2=0x7fe2800f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:26.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.433+0000 7fe2870e2700 1 -- 172.21.15.8:0/1830034227 shutdown_connections 2023-10-18T22:07:26.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.433+0000 7fe2870e2700 1 -- 172.21.15.8:0/1830034227 wait complete. 2023-10-18T22:07:26.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.434+0000 7fe2870e2700 1 Processor -- start 2023-10-18T22:07:26.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.434+0000 7fe2870e2700 1 -- start start 2023-10-18T22:07:26.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2870e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2800f64b0 0x7fe280106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:26.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2870e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2800f7750 0x7fe280107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:26.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2870e2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe280107890 con 0x7fe2800f64b0 2023-10-18T22:07:26.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2870e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2801080d0 con 0x7fe2800f7750 2023-10-18T22:07:26.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2860e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2800f64b0 0x7fe280106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:26.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2860e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2800f64b0 0x7fe280106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56548/0 (socket says 172.21.15.8:56548) 2023-10-18T22:07:26.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2860e0700 1 -- 172.21.15.8:0/304511182 learned_addr learned my addr 172.21.15.8:0/304511182 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:26.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2858df700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2800f7750 0x7fe280107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:26.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2860e0700 1 -- 172.21.15.8:0/304511182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2800f7750 msgr2=0x7fe280107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:26.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2860e0700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2800f7750 0x7fe280107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.435+0000 7fe2860e0700 1 -- 172.21.15.8:0/304511182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c009d70 con 0x7fe2800f64b0 2023-10-18T22:07:26.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.436+0000 7fe2860e0700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2800f64b0 0x7fe280106da0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7fe27c004170 tx=0x7fe27c009ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:26.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.436+0000 7fe276ffd700 1 -- 172.21.15.8:0/304511182 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe27c01a070 con 0x7fe2800f64b0 2023-10-18T22:07:26.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.436+0000 7fe276ffd700 1 -- 172.21.15.8:0/304511182 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe27c014420 con 0x7fe2800f64b0 2023-10-18T22:07:26.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.436+0000 7fe2870e2700 1 -- 172.21.15.8:0/304511182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe280108350 con 0x7fe2800f64b0 2023-10-18T22:07:26.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.436+0000 7fe276ffd700 1 -- 172.21.15.8:0/304511182 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe27c00e040 con 0x7fe2800f64b0 2023-10-18T22:07:26.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.436+0000 7fe2870e2700 1 -- 172.21.15.8:0/304511182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe280108830 con 0x7fe2800f64b0 2023-10-18T22:07:26.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.437+0000 7fe2870e2700 1 -- 172.21.15.8:0/304511182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe280059100 con 0x7fe2800f64b0 2023-10-18T22:07:26.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.438+0000 7fe276ffd700 1 -- 172.21.15.8:0/304511182 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe27c0149e0 con 0x7fe2800f64b0 2023-10-18T22:07:26.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.439+0000 7fe276ffd700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe26c060f70 0x7fe26c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:26.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.439+0000 7fe276ffd700 1 -- 172.21.15.8:0/304511182 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe27c07de10 con 0x7fe2800f64b0 2023-10-18T22:07:26.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.439+0000 7fe2858df700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe26c060f70 0x7fe26c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:26.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.440+0000 7fe2858df700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe26c060f70 0x7fe26c063430 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fe280106b30 tx=0x7fe270009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:26.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.443+0000 7fe276ffd700 1 -- 172.21.15.8:0/304511182 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe27c04d9c0 con 0x7fe2800f64b0 2023-10-18T22:07:26.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.697+0000 7fe2870e2700 1 -- 172.21.15.8:0/304511182 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe2800fece0 con 0x7fe2800f64b0 2023-10-18T22:07:26.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.697+0000 7fe276ffd700 1 -- 172.21.15.8:0/304511182 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fe27c004430 con 0x7fe2800f64b0 2023-10-18T22:07:26.701 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:07:26.701 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:07:26.702 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:07:26.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:07:26.703 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:07:26.703 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:07:26.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:07:26.704 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:07:26.705 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:07:26.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:07:26.706 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:07:26.706 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:07:26.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:07:26.707 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:07:26.707 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:07:26.707 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:07:26.707 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:07:26.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.699+0000 7fe2870e2700 1 -- 172.21.15.8:0/304511182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe26c060f70 msgr2=0x7fe26c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:26.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.699+0000 7fe2870e2700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe26c060f70 0x7fe26c063430 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fe280106b30 tx=0x7fe270009be0).stop 2023-10-18T22:07:26.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.699+0000 7fe2870e2700 1 -- 172.21.15.8:0/304511182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2800f64b0 msgr2=0x7fe280106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:26.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.699+0000 7fe2870e2700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2800f64b0 0x7fe280106da0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7fe27c004170 tx=0x7fe27c009ad0).stop 2023-10-18T22:07:26.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.699+0000 7fe2870e2700 1 -- 172.21.15.8:0/304511182 shutdown_connections 2023-10-18T22:07:26.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.699+0000 7fe2870e2700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe26c060f70 0x7fe26c063430 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.699+0000 7fe2870e2700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2800f64b0 0x7fe280106da0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.699+0000 7fe2870e2700 1 --2- 172.21.15.8:0/304511182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2800f7750 0x7fe280107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.700+0000 7fe2870e2700 1 -- 172.21.15.8:0/304511182 >> 172.21.15.8:0/304511182 conn(0x7fe2800f1c30 msgr2=0x7fe2800fb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:26.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.700+0000 7fe2870e2700 1 -- 172.21.15.8:0/304511182 shutdown_connections 2023-10-18T22:07:26.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.700+0000 7fe2870e2700 1 -- 172.21.15.8:0/304511182 wait complete. 2023-10-18T22:07:26.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.836+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/3935970935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d580602b0 msgr2=0x7f3d580f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:26.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.836+0000 7f3d5c9a0700 1 --2- 172.21.15.8:0/3935970935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d580602b0 0x7f3d580f9180 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f3d48004660 tx=0x7f3d48009b30).stop 2023-10-18T22:07:26.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.836+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/3935970935 shutdown_connections 2023-10-18T22:07:26.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.836+0000 7f3d5c9a0700 1 --2- 172.21.15.8:0/3935970935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d580f9700 0x7f3d580fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.836+0000 7f3d5c9a0700 1 --2- 172.21.15.8:0/3935970935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d580602b0 0x7f3d580f9180 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.836+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/3935970935 >> 172.21.15.8:0/3935970935 conn(0x7f3d580f0ba0 msgr2=0x7f3d580f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:26.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.837+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/3935970935 shutdown_connections 2023-10-18T22:07:26.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.837+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/3935970935 wait complete. 2023-10-18T22:07:26.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.837+0000 7f3d5c9a0700 1 Processor -- start 2023-10-18T22:07:26.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.837+0000 7f3d5c9a0700 1 -- start start 2023-10-18T22:07:26.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d5c9a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d580602b0 0x7f3d580f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:26.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d5c9a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d580f9700 0x7f3d580f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:26.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d5c9a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580f55e0 con 0x7f3d580602b0 2023-10-18T22:07:26.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d5c9a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580f5720 con 0x7f3d580f9700 2023-10-18T22:07:26.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d56d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d580602b0 0x7f3d580f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:26.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d56d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d580602b0 0x7f3d580f6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56568/0 (socket says 172.21.15.8:56568) 2023-10-18T22:07:26.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d56d9d700 1 -- 172.21.15.8:0/1991390082 learned_addr learned my addr 172.21.15.8:0/1991390082 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:26.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d5659c700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d580f9700 0x7f3d580f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:26.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d56d9d700 1 -- 172.21.15.8:0/1991390082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d580f9700 msgr2=0x7f3d580f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:26.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d56d9d700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d580f9700 0x7f3d580f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:26.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.838+0000 7f3d56d9d700 1 -- 172.21.15.8:0/1991390082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d48005040 con 0x7f3d580602b0 2023-10-18T22:07:26.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.839+0000 7f3d56d9d700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d580602b0 0x7f3d580f6c00 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f3d48009f50 tx=0x7f3d48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:26.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.839+0000 7f3d3f7fe700 1 -- 172.21.15.8:0/1991390082 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d48018070 con 0x7f3d580602b0 2023-10-18T22:07:26.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.839+0000 7f3d3f7fe700 1 -- 172.21.15.8:0/1991390082 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3d48009630 con 0x7f3d580602b0 2023-10-18T22:07:26.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.839+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/1991390082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d580f59a0 con 0x7f3d580602b0 2023-10-18T22:07:26.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.839+0000 7f3d3f7fe700 1 -- 172.21.15.8:0/1991390082 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d4801c3c0 con 0x7f3d580602b0 2023-10-18T22:07:26.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.839+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/1991390082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d580f5f00 con 0x7f3d580602b0 2023-10-18T22:07:26.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.840+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/1991390082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d58045ad0 con 0x7f3d580602b0 2023-10-18T22:07:26.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.841+0000 7f3d3f7fe700 1 -- 172.21.15.8:0/1991390082 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3d4801d420 con 0x7f3d580602b0 2023-10-18T22:07:26.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.842+0000 7f3d3f7fe700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d40060f70 0x7f3d40063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:26.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.842+0000 7f3d3f7fe700 1 -- 172.21.15.8:0/1991390082 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3d4807e650 con 0x7f3d580602b0 2023-10-18T22:07:26.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.842+0000 7f3d5659c700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d40060f70 0x7f3d40063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:26.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.843+0000 7f3d5659c700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d40060f70 0x7f3d40063430 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f3d58060080 tx=0x7f3d4c009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:26.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:26.846+0000 7f3d3f7fe700 1 -- 172.21.15.8:0/1991390082 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3d4804e2c0 con 0x7f3d580602b0 2023-10-18T22:07:27.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.075+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/1991390082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3d580fedc0 con 0x7f3d580602b0 2023-10-18T22:07:27.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.075+0000 7f3d3f7fe700 1 -- 172.21.15.8:0/1991390082 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f3d480518e0 con 0x7f3d580602b0 2023-10-18T22:07:27.078 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:07:27.078 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:07:27.079 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:07:27.079 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:07:27.079 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:07:27.079 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:07:27.079 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:07:27.080 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:07:27.080 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:07:27.080 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:07:27.080 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:07:27.080 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:07:27.081 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:07:27.081 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:07:27.081 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:07:27.081 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:07:27.081 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:07:27.082 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:07:27.082 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:07:27.082 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:07:27.082 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:07:27.083 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:07:27.083 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:07:27.083 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:07:27.083 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:07:27.083 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:07:27.083 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:07:27.084 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:07:27.084 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:07:27.084 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:07:27.084 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:07:27.084 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:07:27.085 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:07:27.085 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:07:27.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.077+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/1991390082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d40060f70 msgr2=0x7f3d40063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:27.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.077+0000 7f3d5c9a0700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d40060f70 0x7f3d40063430 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f3d58060080 tx=0x7f3d4c009c60).stop 2023-10-18T22:07:27.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.077+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/1991390082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d580602b0 msgr2=0x7f3d580f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:27.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.077+0000 7f3d5c9a0700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d580602b0 0x7f3d580f6c00 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f3d48009f50 tx=0x7f3d48009b30).stop 2023-10-18T22:07:27.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.077+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/1991390082 shutdown_connections 2023-10-18T22:07:27.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.077+0000 7f3d5c9a0700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3d40060f70 0x7f3d40063430 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:27.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.077+0000 7f3d5c9a0700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d580602b0 0x7f3d580f6c00 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:27.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.077+0000 7f3d5c9a0700 1 --2- 172.21.15.8:0/1991390082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d580f9700 0x7f3d580f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:27.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.077+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/1991390082 >> 172.21.15.8:0/1991390082 conn(0x7f3d580f0ba0 msgr2=0x7f3d580f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:27.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.078+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/1991390082 shutdown_connections 2023-10-18T22:07:27.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.078+0000 7f3d5c9a0700 1 -- 172.21.15.8:0/1991390082 wait complete. 2023-10-18T22:07:27.088 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:07:27.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.214+0000 7f2f09ac0700 1 -- 172.21.15.8:0/1089255260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f040f77d0 msgr2=0x7f2f040f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:27.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.214+0000 7f2f09ac0700 1 --2- 172.21.15.8:0/1089255260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f040f77d0 0x7f2f040f7c30 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f2ef0004660 tx=0x7f2ef0009b30).stop 2023-10-18T22:07:27.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.214+0000 7f2f09ac0700 1 -- 172.21.15.8:0/1089255260 shutdown_connections 2023-10-18T22:07:27.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.214+0000 7f2f09ac0700 1 --2- 172.21.15.8:0/1089255260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f040f77d0 0x7f2f040f7c30 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:27.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.214+0000 7f2f09ac0700 1 --2- 172.21.15.8:0/1089255260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f040f6530 0x7f2f040f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:27.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.214+0000 7f2f09ac0700 1 -- 172.21.15.8:0/1089255260 >> 172.21.15.8:0/1089255260 conn(0x7f2f040f1c90 msgr2=0x7f2f040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:27.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.215+0000 7f2f09ac0700 1 -- 172.21.15.8:0/1089255260 shutdown_connections 2023-10-18T22:07:27.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.215+0000 7f2f09ac0700 1 -- 172.21.15.8:0/1089255260 wait complete. 2023-10-18T22:07:27.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.215+0000 7f2f09ac0700 1 Processor -- start 2023-10-18T22:07:27.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.216+0000 7f2f09ac0700 1 -- start start 2023-10-18T22:07:27.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.216+0000 7f2f09ac0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f040f6530 0x7f2f0406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:27.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.216+0000 7f2f09ac0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f040f77d0 0x7f2f04069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:27.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.216+0000 7f2f09ac0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0406a380 con 0x7f2f040f6530 2023-10-18T22:07:27.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.216+0000 7f2f09ac0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0406a4c0 con 0x7f2f040f77d0 2023-10-18T22:07:27.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.216+0000 7f2f08abe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f040f6530 0x7f2f0406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:27.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.216+0000 7f2f08abe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f040f6530 0x7f2f0406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39592/0 (socket says 172.21.15.8:39592) 2023-10-18T22:07:27.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.216+0000 7f2f08abe700 1 -- 172.21.15.8:0/2900938726 learned_addr learned my addr 172.21.15.8:0/2900938726 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:27.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.216+0000 7f2f03fff700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f040f77d0 0x7f2f04069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:27.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.217+0000 7f2f08abe700 1 -- 172.21.15.8:0/2900938726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f040f77d0 msgr2=0x7f2f04069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:27.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.217+0000 7f2f08abe700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f040f77d0 0x7f2f04069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:27.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.217+0000 7f2f08abe700 1 -- 172.21.15.8:0/2900938726 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0005040 con 0x7f2f040f6530 2023-10-18T22:07:27.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.217+0000 7f2f08abe700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f040f6530 0x7f2f0406b9a0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f2ef800e7c0 tx=0x7f2ef800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:27.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.217+0000 7f2f017fa700 1 -- 172.21.15.8:0/2900938726 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ef80092e0 con 0x7f2f040f6530 2023-10-18T22:07:27.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.217+0000 7f2f017fa700 1 -- 172.21.15.8:0/2900938726 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2ef800f040 con 0x7f2f040f6530 2023-10-18T22:07:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.217+0000 7f2f09ac0700 1 -- 172.21.15.8:0/2900938726 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0406a7a0 con 0x7f2f040f6530 2023-10-18T22:07:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.217+0000 7f2f017fa700 1 -- 172.21.15.8:0/2900938726 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ef8014810 con 0x7f2f040f6530 2023-10-18T22:07:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.217+0000 7f2f09ac0700 1 -- 172.21.15.8:0/2900938726 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0410ed20 con 0x7f2f040f6530 2023-10-18T22:07:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.218+0000 7f2f09ac0700 1 -- 172.21.15.8:0/2900938726 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f04045ad0 con 0x7f2f040f6530 2023-10-18T22:07:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.219+0000 7f2f017fa700 1 -- 172.21.15.8:0/2900938726 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2ef801b030 con 0x7f2f040f6530 2023-10-18T22:07:27.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.221+0000 7f2f017fa700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ef4060f70 0x7f2ef4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.221+0000 7f2f017fa700 1 -- 172.21.15.8:0/2900938726 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2ef807c950 con 0x7f2f040f6530 2023-10-18T22:07:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.221+0000 7f2f03fff700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ef4060f70 0x7f2ef4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.221+0000 7f2f03fff700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ef4060f70 0x7f2ef4063430 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f2ef0005010 tx=0x7f2ef0016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.225+0000 7f2f017fa700 1 -- 172.21.15.8:0/2900938726 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2ef804c500 con 0x7f2f040f6530 2023-10-18T22:07:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:25.590101+0000 mgr.smithi008.flmjzp (mgr.14640) 4109 : audit [DBG] from='client.37336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:25.941313+0000 mgr.smithi008.flmjzp (mgr.14640) 4110 : audit [DBG] from='client.37340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:26.261202+0000 mgr.smithi008.flmjzp (mgr.14640) 4111 : cluster [DBG] pgmap v2823: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:27.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.286267+0000 mgr.smithi008.flmjzp (mgr.14640) 4112 : audit [DBG] from='client.37344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:27.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.295419+0000 mon.smithi008 (mon.0) 4424 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:27.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.297112+0000 mon.smithi008 (mon.0) 4425 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:27.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.298101+0000 mon.smithi008 (mon.0) 4426 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:27.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:26.298869+0000 mgr.smithi008.flmjzp (mgr.14640) 4113 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:27.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:26.299360+0000 mgr.smithi008.flmjzp (mgr.14640) 4114 : cluster [DBG] pgmap v2824: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:27.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:26.299655+0000 mgr.smithi008.flmjzp (mgr.14640) 4115 : cluster [DBG] pgmap v2825: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:27.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.303759+0000 mon.smithi008 (mon.0) 4427 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:27.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.308978+0000 mon.smithi008 (mon.0) 4428 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:27.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.311414+0000 mon.smithi008 (mon.0) 4429 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:27.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.312787+0000 mon.smithi008 (mon.0) 4430 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:27.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.314035+0000 mon.smithi008 (mon.0) 4431 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:27.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.315724+0000 mon.smithi008 (mon.0) 4432 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:27.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:26.317381+0000 mgr.smithi008.flmjzp (mgr.14640) 4116 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:27.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:26.698990+0000 mon.smithi008 (mon.0) 4433 : audit [DBG] from='client.? 172.21.15.8:0/304511182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:27.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.422+0000 7f2f09ac0700 1 -- 172.21.15.8:0/2900938726 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f04057f10 con 0x7f2ef4060f70 2023-10-18T22:07:27.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.424+0000 7f2f017fa700 1 -- 172.21.15.8:0/2900938726 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2f04057f10 con 0x7f2ef4060f70 2023-10-18T22:07:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:07:27.426 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:07:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:07:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:07:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:07:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:07:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:07:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:07:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:07:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:07:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:07:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:07:27.429 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:07:27.429 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:07:27.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 -- 172.21.15.8:0/2900938726 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ef4060f70 msgr2=0x7f2ef4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:27.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ef4060f70 0x7f2ef4063430 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f2ef0005010 tx=0x7f2ef0016040).stop 2023-10-18T22:07:27.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 -- 172.21.15.8:0/2900938726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f040f6530 msgr2=0x7f2f0406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:27.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f040f6530 0x7f2f0406b9a0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f2ef800e7c0 tx=0x7f2ef800b040).stop 2023-10-18T22:07:27.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 -- 172.21.15.8:0/2900938726 shutdown_connections 2023-10-18T22:07:27.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ef4060f70 0x7f2ef4063430 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:27.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f040f6530 0x7f2f0406b9a0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:27.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 --2- 172.21.15.8:0/2900938726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f040f77d0 0x7f2f04069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:27.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 -- 172.21.15.8:0/2900938726 >> 172.21.15.8:0/2900938726 conn(0x7f2f040f1c90 msgr2=0x7f2f040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:27.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 -- 172.21.15.8:0/2900938726 shutdown_connections 2023-10-18T22:07:27.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:27.426+0000 7f2f09ac0700 1 -- 172.21.15.8:0/2900938726 wait complete. 2023-10-18T22:07:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:25.590101+0000 mgr.smithi008.flmjzp (mgr.14640) 4109 : audit [DBG] from='client.37336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:25.941313+0000 mgr.smithi008.flmjzp (mgr.14640) 4110 : audit [DBG] from='client.37340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:27.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:26.261202+0000 mgr.smithi008.flmjzp (mgr.14640) 4111 : cluster [DBG] pgmap v2823: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:27.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.286267+0000 mgr.smithi008.flmjzp (mgr.14640) 4112 : audit [DBG] from='client.37344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:27.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.295419+0000 mon.smithi008 (mon.0) 4424 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:27.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.297112+0000 mon.smithi008 (mon.0) 4425 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:27.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.298101+0000 mon.smithi008 (mon.0) 4426 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:27.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:26.298869+0000 mgr.smithi008.flmjzp (mgr.14640) 4113 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:27.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:26.299360+0000 mgr.smithi008.flmjzp (mgr.14640) 4114 : cluster [DBG] pgmap v2824: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:27.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:26.299655+0000 mgr.smithi008.flmjzp (mgr.14640) 4115 : cluster [DBG] pgmap v2825: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:27.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.303759+0000 mon.smithi008 (mon.0) 4427 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:27.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.308978+0000 mon.smithi008 (mon.0) 4428 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:27.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.311414+0000 mon.smithi008 (mon.0) 4429 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:27.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.312787+0000 mon.smithi008 (mon.0) 4430 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:27.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.314035+0000 mon.smithi008 (mon.0) 4431 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:27.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.315724+0000 mon.smithi008 (mon.0) 4432 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:27.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:26.317381+0000 mgr.smithi008.flmjzp (mgr.14640) 4116 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:27.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:26.698990+0000 mon.smithi008 (mon.0) 4433 : audit [DBG] from='client.? 172.21.15.8:0/304511182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:28.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:27.077041+0000 mon.smithi008 (mon.0) 4434 : audit [DBG] from='client.? 172.21.15.8:0/1991390082' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:07:28.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:27.077041+0000 mon.smithi008 (mon.0) 4434 : audit [DBG] from='client.? 172.21.15.8:0/1991390082' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:07:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:27.425182+0000 mgr.smithi008.flmjzp (mgr.14640) 4117 : audit [DBG] from='client.37356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:29.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:28.300104+0000 mgr.smithi008.flmjzp (mgr.14640) 4118 : cluster [DBG] pgmap v2826: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:27.425182+0000 mgr.smithi008.flmjzp (mgr.14640) 4117 : audit [DBG] from='client.37356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:28.300104+0000 mgr.smithi008.flmjzp (mgr.14640) 4118 : cluster [DBG] pgmap v2826: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:30.300613+0000 mgr.smithi008.flmjzp (mgr.14640) 4119 : cluster [DBG] pgmap v2827: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:30.300613+0000 mgr.smithi008.flmjzp (mgr.14640) 4119 : cluster [DBG] pgmap v2827: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:32.301215+0000 mgr.smithi008.flmjzp (mgr.14640) 4120 : cluster [DBG] pgmap v2828: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:32.301215+0000 mgr.smithi008.flmjzp (mgr.14640) 4120 : cluster [DBG] pgmap v2828: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:34.301950+0000 mgr.smithi008.flmjzp (mgr.14640) 4121 : cluster [DBG] pgmap v2829: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:34.301950+0000 mgr.smithi008.flmjzp (mgr.14640) 4121 : cluster [DBG] pgmap v2829: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:36.302578+0000 mgr.smithi008.flmjzp (mgr.14640) 4122 : cluster [DBG] pgmap v2830: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:36.327081+0000 mon.smithi008 (mon.0) 4435 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:36.329187+0000 mon.smithi008 (mon.0) 4436 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:36.330306+0000 mon.smithi008 (mon.0) 4437 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:36.331206+0000 mgr.smithi008.flmjzp (mgr.14640) 4123 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:36.331894+0000 mgr.smithi008.flmjzp (mgr.14640) 4124 : cluster [DBG] pgmap v2831: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:36.332210+0000 mgr.smithi008.flmjzp (mgr.14640) 4125 : cluster [DBG] pgmap v2832: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:37.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:36.337236+0000 mon.smithi008 (mon.0) 4438 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:36.345302+0000 mon.smithi008 (mon.0) 4439 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:36.348934+0000 mon.smithi008 (mon.0) 4440 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:36.350845+0000 mon.smithi008 (mon.0) 4441 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:36.352580+0000 mon.smithi008 (mon.0) 4442 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:37.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:36.354554+0000 mon.smithi008 (mon.0) 4443 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:36.302578+0000 mgr.smithi008.flmjzp (mgr.14640) 4122 : cluster [DBG] pgmap v2830: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:36.327081+0000 mon.smithi008 (mon.0) 4435 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:36.329187+0000 mon.smithi008 (mon.0) 4436 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:36.330306+0000 mon.smithi008 (mon.0) 4437 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:36.331206+0000 mgr.smithi008.flmjzp (mgr.14640) 4123 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:36.331894+0000 mgr.smithi008.flmjzp (mgr.14640) 4124 : cluster [DBG] pgmap v2831: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:36.332210+0000 mgr.smithi008.flmjzp (mgr.14640) 4125 : cluster [DBG] pgmap v2832: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:36.337236+0000 mon.smithi008 (mon.0) 4438 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:36.345302+0000 mon.smithi008 (mon.0) 4439 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:36.348934+0000 mon.smithi008 (mon.0) 4440 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:36.350845+0000 mon.smithi008 (mon.0) 4441 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:37.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:36.352580+0000 mon.smithi008 (mon.0) 4442 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:37.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:36.354554+0000 mon.smithi008 (mon.0) 4443 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:38.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:36.356390+0000 mgr.smithi008.flmjzp (mgr.14640) 4126 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:38.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:36.356390+0000 mgr.smithi008.flmjzp (mgr.14640) 4126 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:38.332887+0000 mgr.smithi008.flmjzp (mgr.14640) 4127 : cluster [DBG] pgmap v2833: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:38.332887+0000 mgr.smithi008.flmjzp (mgr.14640) 4127 : cluster [DBG] pgmap v2833: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:40.333431+0000 mgr.smithi008.flmjzp (mgr.14640) 4128 : cluster [DBG] pgmap v2834: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:40.333431+0000 mgr.smithi008.flmjzp (mgr.14640) 4128 : cluster [DBG] pgmap v2834: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:42.334007+0000 mgr.smithi008.flmjzp (mgr.14640) 4129 : cluster [DBG] pgmap v2835: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:42.334007+0000 mgr.smithi008.flmjzp (mgr.14640) 4129 : cluster [DBG] pgmap v2835: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:44.334586+0000 mgr.smithi008.flmjzp (mgr.14640) 4130 : cluster [DBG] pgmap v2836: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:44.334586+0000 mgr.smithi008.flmjzp (mgr.14640) 4130 : cluster [DBG] pgmap v2836: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:46.335168+0000 mgr.smithi008.flmjzp (mgr.14640) 4131 : cluster [DBG] pgmap v2837: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:46.363008+0000 mon.smithi008 (mon.0) 4444 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:47.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:46.923415+0000 mon.smithi008 (mon.0) 4445 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:46.924244+0000 mon.smithi008 (mon.0) 4446 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:46.929588+0000 mon.smithi008 (mon.0) 4447 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:46.934429+0000 mon.smithi008 (mon.0) 4448 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:46.936812+0000 mon.smithi008 (mon.0) 4449 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:47.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:46.938042+0000 mon.smithi008 (mon.0) 4450 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:47.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:46.939242+0000 mon.smithi008 (mon.0) 4451 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:47.424 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:46.940759+0000 mon.smithi008 (mon.0) 4452 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:46.335168+0000 mgr.smithi008.flmjzp (mgr.14640) 4131 : cluster [DBG] pgmap v2837: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:46.363008+0000 mon.smithi008 (mon.0) 4444 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:46.923415+0000 mon.smithi008 (mon.0) 4445 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:46.924244+0000 mon.smithi008 (mon.0) 4446 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:46.929588+0000 mon.smithi008 (mon.0) 4447 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:46.934429+0000 mon.smithi008 (mon.0) 4448 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:46.936812+0000 mon.smithi008 (mon.0) 4449 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:46.938042+0000 mon.smithi008 (mon.0) 4450 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:46.939242+0000 mon.smithi008 (mon.0) 4451 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:47.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:46.940759+0000 mon.smithi008 (mon.0) 4452 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:48.308 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:46.924861+0000 mgr.smithi008.flmjzp (mgr.14640) 4132 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:46.925344+0000 mgr.smithi008.flmjzp (mgr.14640) 4133 : cluster [DBG] pgmap v2838: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:46.925582+0000 mgr.smithi008.flmjzp (mgr.14640) 4134 : cluster [DBG] pgmap v2839: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:48.309 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:46.942283+0000 mgr.smithi008.flmjzp (mgr.14640) 4135 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:46.924861+0000 mgr.smithi008.flmjzp (mgr.14640) 4132 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:46.925344+0000 mgr.smithi008.flmjzp (mgr.14640) 4133 : cluster [DBG] pgmap v2838: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:46.925582+0000 mgr.smithi008.flmjzp (mgr.14640) 4134 : cluster [DBG] pgmap v2839: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:48.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:46.942283+0000 mgr.smithi008.flmjzp (mgr.14640) 4135 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:48.926131+0000 mgr.smithi008.flmjzp (mgr.14640) 4136 : cluster [DBG] pgmap v2840: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:50.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:48.926131+0000 mgr.smithi008.flmjzp (mgr.14640) 4136 : cluster [DBG] pgmap v2840: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:52.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:50.926855+0000 mgr.smithi008.flmjzp (mgr.14640) 4137 : cluster [DBG] pgmap v2841: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:50.926855+0000 mgr.smithi008.flmjzp (mgr.14640) 4137 : cluster [DBG] pgmap v2841: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:54.351 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:52.927422+0000 mgr.smithi008.flmjzp (mgr.14640) 4138 : cluster [DBG] pgmap v2842: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:52.927422+0000 mgr.smithi008.flmjzp (mgr.14640) 4138 : cluster [DBG] pgmap v2842: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:54.928113+0000 mgr.smithi008.flmjzp (mgr.14640) 4139 : cluster [DBG] pgmap v2843: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:54.928113+0000 mgr.smithi008.flmjzp (mgr.14640) 4139 : cluster [DBG] pgmap v2843: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:56.944559+0000 mon.smithi008 (mon.0) 4453 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:56.946787+0000 mon.smithi008 (mon.0) 4454 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:56.947752+0000 mon.smithi008 (mon.0) 4455 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:56.954584+0000 mon.smithi008 (mon.0) 4456 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:56.961310+0000 mon.smithi008 (mon.0) 4457 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:57.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:56.964600+0000 mon.smithi008 (mon.0) 4458 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:57.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:56.966300+0000 mon.smithi008 (mon.0) 4459 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:57.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:56.967951+0000 mon.smithi008 (mon.0) 4460 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:57.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:56.970037+0000 mon.smithi008 (mon.0) 4461 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:56.944559+0000 mon.smithi008 (mon.0) 4453 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:56.946787+0000 mon.smithi008 (mon.0) 4454 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:07:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:56.947752+0000 mon.smithi008 (mon.0) 4455 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:07:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:56.954584+0000 mon.smithi008 (mon.0) 4456 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:07:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:56.961310+0000 mon.smithi008 (mon.0) 4457 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:07:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:56.964600+0000 mon.smithi008 (mon.0) 4458 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:57.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:56.966300+0000 mon.smithi008 (mon.0) 4459 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:57.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:56.967951+0000 mon.smithi008 (mon.0) 4460 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:57.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:56.970037+0000 mon.smithi008 (mon.0) 4461 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:57.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.581+0000 7f824cdb4700 1 -- 172.21.15.8:0/1181534928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82480f77d0 msgr2=0x7f82480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:57.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.581+0000 7f824cdb4700 1 --2- 172.21.15.8:0/1181534928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82480f77d0 0x7f82480f7c30 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f823c004660 tx=0x7f823c009b30).stop 2023-10-18T22:07:57.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.581+0000 7f824cdb4700 1 -- 172.21.15.8:0/1181534928 shutdown_connections 2023-10-18T22:07:57.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.581+0000 7f824cdb4700 1 --2- 172.21.15.8:0/1181534928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82480f77d0 0x7f82480f7c30 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:57.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.581+0000 7f824cdb4700 1 --2- 172.21.15.8:0/1181534928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82480f6530 0x7f82480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:57.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.581+0000 7f824cdb4700 1 -- 172.21.15.8:0/1181534928 >> 172.21.15.8:0/1181534928 conn(0x7f82480f1c90 msgr2=0x7f82480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:57.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.581+0000 7f824cdb4700 1 -- 172.21.15.8:0/1181534928 shutdown_connections 2023-10-18T22:07:57.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.581+0000 7f824cdb4700 1 -- 172.21.15.8:0/1181534928 wait complete. 2023-10-18T22:07:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.582+0000 7f824cdb4700 1 Processor -- start 2023-10-18T22:07:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.582+0000 7f824cdb4700 1 -- start start 2023-10-18T22:07:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.583+0000 7f824cdb4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82480f6530 0x7f8248108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.583+0000 7f824cdb4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82480f77d0 0x7f8248109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:57.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.583+0000 7f824cdb4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82481099b0 con 0x7f82480f6530 2023-10-18T22:07:57.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.583+0000 7f824cdb4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8248109af0 con 0x7f82480f77d0 2023-10-18T22:07:57.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.583+0000 7f82477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82480f6530 0x7f8248108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:57.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.583+0000 7f82477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82480f6530 0x7f8248108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40398/0 (socket says 172.21.15.8:40398) 2023-10-18T22:07:57.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.583+0000 7f82477fe700 1 -- 172.21.15.8:0/2529947870 learned_addr learned my addr 172.21.15.8:0/2529947870 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.584+0000 7f8246ffd700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82480f77d0 0x7f8248109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.584+0000 7f82477fe700 1 -- 172.21.15.8:0/2529947870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82480f77d0 msgr2=0x7f8248109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.584+0000 7f82477fe700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82480f77d0 0x7f8248109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.584+0000 7f82477fe700 1 -- 172.21.15.8:0/2529947870 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c005040 con 0x7f82480f6530 2023-10-18T22:07:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.584+0000 7f82477fe700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82480f6530 0x7f8248108f10 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f8238002700 tx=0x7f8238009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.584+0000 7f822ffff700 1 -- 172.21.15.8:0/2529947870 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8238009320 con 0x7f82480f6530 2023-10-18T22:07:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.584+0000 7f822ffff700 1 -- 172.21.15.8:0/2529947870 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f823800f040 con 0x7f82480f6530 2023-10-18T22:07:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.584+0000 7f822ffff700 1 -- 172.21.15.8:0/2529947870 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8238014970 con 0x7f82480f6530 2023-10-18T22:07:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.584+0000 7f824cdb4700 1 -- 172.21.15.8:0/2529947870 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824810a490 con 0x7f82480f6530 2023-10-18T22:07:57.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.584+0000 7f824cdb4700 1 -- 172.21.15.8:0/2529947870 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824810aa50 con 0x7f82480f6530 2023-10-18T22:07:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.585+0000 7f824cdb4700 1 -- 172.21.15.8:0/2529947870 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8248045ad0 con 0x7f82480f6530 2023-10-18T22:07:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.586+0000 7f822ffff700 1 -- 172.21.15.8:0/2529947870 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8238009480 con 0x7f82480f6530 2023-10-18T22:07:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.587+0000 7f822ffff700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8230060f70 0x7f8230063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.587+0000 7f822ffff700 1 -- 172.21.15.8:0/2529947870 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f823807cb90 con 0x7f82480f6530 2023-10-18T22:07:57.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.587+0000 7f8246ffd700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8230060f70 0x7f8230063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:57.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.588+0000 7f8246ffd700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8230060f70 0x7f8230063430 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f823c004630 tx=0x7f823c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:57.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.592+0000 7f822ffff700 1 -- 172.21.15.8:0/2529947870 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f82380501f0 con 0x7f82480f6530 2023-10-18T22:07:57.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.790+0000 7f824cdb4700 1 -- 172.21.15.8:0/2529947870 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82480fee40 con 0x7f8230060f70 2023-10-18T22:07:57.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.791+0000 7f822ffff700 1 -- 172.21.15.8:0/2529947870 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f82480fee40 con 0x7f8230060f70 2023-10-18T22:07:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.793+0000 7f824cdb4700 1 -- 172.21.15.8:0/2529947870 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8230060f70 msgr2=0x7f8230063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.793+0000 7f824cdb4700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8230060f70 0x7f8230063430 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f823c004630 tx=0x7f823c009b30).stop 2023-10-18T22:07:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.793+0000 7f824cdb4700 1 -- 172.21.15.8:0/2529947870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82480f6530 msgr2=0x7f8248108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:57.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.793+0000 7f824cdb4700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82480f6530 0x7f8248108f10 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f8238002700 tx=0x7f8238009d80).stop 2023-10-18T22:07:57.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.794+0000 7f824cdb4700 1 -- 172.21.15.8:0/2529947870 shutdown_connections 2023-10-18T22:07:57.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.794+0000 7f824cdb4700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8230060f70 0x7f8230063430 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:57.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.794+0000 7f824cdb4700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82480f6530 0x7f8248108f10 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:57.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.794+0000 7f824cdb4700 1 --2- 172.21.15.8:0/2529947870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82480f77d0 0x7f8248109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:57.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.794+0000 7f824cdb4700 1 -- 172.21.15.8:0/2529947870 >> 172.21.15.8:0/2529947870 conn(0x7f82480f1c90 msgr2=0x7f824806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.794+0000 7f824cdb4700 1 -- 172.21.15.8:0/2529947870 shutdown_connections 2023-10-18T22:07:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.794+0000 7f824cdb4700 1 -- 172.21.15.8:0/2529947870 wait complete. 2023-10-18T22:07:57.809 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:07:57.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.932+0000 7fcc6ffff700 1 -- 172.21.15.8:0/3619266683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc700f6530 msgr2=0x7fcc700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.932+0000 7fcc6ffff700 1 --2- 172.21.15.8:0/3619266683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc700f6530 0x7fcc700f6950 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7fcc60004660 tx=0x7fcc60009b30).stop 2023-10-18T22:07:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.932+0000 7fcc6ffff700 1 -- 172.21.15.8:0/3619266683 shutdown_connections 2023-10-18T22:07:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.932+0000 7fcc6ffff700 1 --2- 172.21.15.8:0/3619266683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc700f77d0 0x7fcc700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.932+0000 7fcc6ffff700 1 --2- 172.21.15.8:0/3619266683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc700f6530 0x7fcc700f6950 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.932+0000 7fcc6ffff700 1 -- 172.21.15.8:0/3619266683 >> 172.21.15.8:0/3619266683 conn(0x7fcc700f1c90 msgr2=0x7fcc700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.932+0000 7fcc6ffff700 1 -- 172.21.15.8:0/3619266683 shutdown_connections 2023-10-18T22:07:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.932+0000 7fcc6ffff700 1 -- 172.21.15.8:0/3619266683 wait complete. 2023-10-18T22:07:57.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.933+0000 7fcc6ffff700 1 Processor -- start 2023-10-18T22:07:57.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.933+0000 7fcc6ffff700 1 -- start start 2023-10-18T22:07:57.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc700f6530 0x7fcc70108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:57.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc700f77d0 0x7fcc701094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc70109a50 con 0x7fcc700f77d0 2023-10-18T22:07:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc70109b90 con 0x7fcc700f6530 2023-10-18T22:07:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc700f77d0 0x7fcc701094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc700f77d0 0x7fcc701094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40414/0 (socket says 172.21.15.8:40414) 2023-10-18T22:07:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6e7fc700 1 -- 172.21.15.8:0/1827826891 learned_addr learned my addr 172.21.15.8:0/1827826891 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6effd700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc700f6530 0x7fcc70108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6e7fc700 1 -- 172.21.15.8:0/1827826891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc700f6530 msgr2=0x7fcc70108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6e7fc700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc700f6530 0x7fcc70108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6e7fc700 1 -- 172.21.15.8:0/1827826891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc60005040 con 0x7fcc700f77d0 2023-10-18T22:07:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.934+0000 7fcc6effd700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc700f6530 0x7fcc70108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:07:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.935+0000 7fcc6e7fc700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc700f77d0 0x7fcc701094a0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fcc640026d0 tx=0x7fcc64009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.935+0000 7fcc577fe700 1 -- 172.21.15.8:0/1827826891 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc64009320 con 0x7fcc700f77d0 2023-10-18T22:07:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.935+0000 7fcc577fe700 1 -- 172.21.15.8:0/1827826891 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcc6400f040 con 0x7fcc700f77d0 2023-10-18T22:07:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.935+0000 7fcc577fe700 1 -- 172.21.15.8:0/1827826891 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc640148a0 con 0x7fcc700f77d0 2023-10-18T22:07:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.935+0000 7fcc6ffff700 1 -- 172.21.15.8:0/1827826891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7010a530 con 0x7fcc700f77d0 2023-10-18T22:07:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.935+0000 7fcc6ffff700 1 -- 172.21.15.8:0/1827826891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7010aaf0 con 0x7fcc700f77d0 2023-10-18T22:07:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.936+0000 7fcc6ffff700 1 -- 172.21.15.8:0/1827826891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc70045ad0 con 0x7fcc700f77d0 2023-10-18T22:07:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.937+0000 7fcc577fe700 1 -- 172.21.15.8:0/1827826891 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcc64009480 con 0x7fcc700f77d0 2023-10-18T22:07:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.938+0000 7fcc577fe700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc58060f70 0x7fcc58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.938+0000 7fcc577fe700 1 -- 172.21.15.8:0/1827826891 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcc6407cf60 con 0x7fcc700f77d0 2023-10-18T22:07:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.938+0000 7fcc6effd700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc58060f70 0x7fcc58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.939+0000 7fcc6effd700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc58060f70 0x7fcc58063430 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fcc60005010 tx=0x7fcc60009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:57.942+0000 7fcc577fe700 1 -- 172.21.15.8:0/1827826891 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcc640505c0 con 0x7fcc700f77d0 2023-10-18T22:07:58.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.140+0000 7fcc6ffff700 1 -- 172.21.15.8:0/1827826891 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc7010adc0 con 0x7fcc58060f70 2023-10-18T22:07:58.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.142+0000 7fcc577fe700 1 -- 172.21.15.8:0/1827826891 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcc7010adc0 con 0x7fcc58060f70 2023-10-18T22:07:58.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 -- 172.21.15.8:0/1827826891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc58060f70 msgr2=0x7fcc58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:58.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc58060f70 0x7fcc58063430 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fcc60005010 tx=0x7fcc60009b30).stop 2023-10-18T22:07:58.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 -- 172.21.15.8:0/1827826891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc700f77d0 msgr2=0x7fcc701094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:58.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc700f77d0 0x7fcc701094a0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fcc640026d0 tx=0x7fcc64009de0).stop 2023-10-18T22:07:58.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 -- 172.21.15.8:0/1827826891 shutdown_connections 2023-10-18T22:07:58.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcc58060f70 0x7fcc58063430 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc700f6530 0x7fcc70108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 --2- 172.21.15.8:0/1827826891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc700f77d0 0x7fcc701094a0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 -- 172.21.15.8:0/1827826891 >> 172.21.15.8:0/1827826891 conn(0x7fcc700f1c90 msgr2=0x7fcc7006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:58.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 -- 172.21.15.8:0/1827826891 shutdown_connections 2023-10-18T22:07:58.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.144+0000 7fcc6ffff700 1 -- 172.21.15.8:0/1827826891 wait complete. 2023-10-18T22:07:58.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.280+0000 7f332759e700 1 -- 172.21.15.8:0/2862181204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33280f77d0 msgr2=0x7f33280f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:58.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.280+0000 7f332759e700 1 --2- 172.21.15.8:0/2862181204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33280f77d0 0x7f33280f7c30 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f331c004660 tx=0x7f331c009b30).stop 2023-10-18T22:07:58.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.280+0000 7f332759e700 1 -- 172.21.15.8:0/2862181204 shutdown_connections 2023-10-18T22:07:58.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.280+0000 7f332759e700 1 --2- 172.21.15.8:0/2862181204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33280f77d0 0x7f33280f7c30 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.280+0000 7f332759e700 1 --2- 172.21.15.8:0/2862181204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33280f6530 0x7f33280f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.280+0000 7f332759e700 1 -- 172.21.15.8:0/2862181204 >> 172.21.15.8:0/2862181204 conn(0x7f33280f1c90 msgr2=0x7f33280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:58.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.280+0000 7f332759e700 1 -- 172.21.15.8:0/2862181204 shutdown_connections 2023-10-18T22:07:58.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.281+0000 7f332759e700 1 -- 172.21.15.8:0/2862181204 wait complete. 2023-10-18T22:07:58.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.281+0000 7f332759e700 1 Processor -- start 2023-10-18T22:07:58.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.281+0000 7f332759e700 1 -- start start 2023-10-18T22:07:58.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f332759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33280f6530 0x7f3328108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:58.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f332759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33280f77d0 0x7f3328109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:58.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f332759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33281099d0 con 0x7f33280f77d0 2023-10-18T22:07:58.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f332759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3328109b10 con 0x7f33280f6530 2023-10-18T22:07:58.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f3325d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33280f77d0 0x7f3328109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:58.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f3325d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33280f77d0 0x7f3328109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40442/0 (socket says 172.21.15.8:40442) 2023-10-18T22:07:58.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f3325d9b700 1 -- 172.21.15.8:0/1159106177 learned_addr learned my addr 172.21.15.8:0/1159106177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:58.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f332659c700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33280f6530 0x7f3328108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:58.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f3325d9b700 1 -- 172.21.15.8:0/1159106177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33280f6530 msgr2=0x7f3328108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:58.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f3325d9b700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33280f6530 0x7f3328108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f3325d9b700 1 -- 172.21.15.8:0/1159106177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c005040 con 0x7f33280f77d0 2023-10-18T22:07:58.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.282+0000 7f332659c700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33280f6530 0x7f3328108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:07:58.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.283+0000 7f3325d9b700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33280f77d0 0x7f3328109420 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f331c009990 tx=0x7f331c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:58.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.283+0000 7f3316ffd700 1 -- 172.21.15.8:0/1159106177 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f331c018070 con 0x7f33280f77d0 2023-10-18T22:07:58.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.283+0000 7f332759e700 1 -- 172.21.15.8:0/1159106177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332810a450 con 0x7f33280f77d0 2023-10-18T22:07:58.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.283+0000 7f3316ffd700 1 -- 172.21.15.8:0/1159106177 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f331c009630 con 0x7f33280f77d0 2023-10-18T22:07:58.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.283+0000 7f3316ffd700 1 -- 172.21.15.8:0/1159106177 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f331c01c400 con 0x7f33280f77d0 2023-10-18T22:07:58.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.283+0000 7f332759e700 1 -- 172.21.15.8:0/1159106177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332810a9b0 con 0x7f33280f77d0 2023-10-18T22:07:58.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.284+0000 7f332759e700 1 -- 172.21.15.8:0/1159106177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3328045ad0 con 0x7f33280f77d0 2023-10-18T22:07:58.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.285+0000 7f3316ffd700 1 -- 172.21.15.8:0/1159106177 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f331c01d9e0 con 0x7f33280f77d0 2023-10-18T22:07:58.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.286+0000 7f3316ffd700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3310060f70 0x7f3310063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:58.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.286+0000 7f3316ffd700 1 -- 172.21.15.8:0/1159106177 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f331c07e710 con 0x7f33280f77d0 2023-10-18T22:07:58.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.286+0000 7f332659c700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3310060f70 0x7f3310063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:58.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.287+0000 7f332659c700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3310060f70 0x7f3310063430 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f33280f7630 tx=0x7f3318009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:58.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.290+0000 7f3316ffd700 1 -- 172.21.15.8:0/1159106177 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f331c051cf0 con 0x7f33280f77d0 2023-10-18T22:07:58.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:56.928749+0000 mgr.smithi008.flmjzp (mgr.14640) 4140 : cluster [DBG] pgmap v2844: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:58.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:56.948641+0000 mgr.smithi008.flmjzp (mgr.14640) 4141 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:58.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:56.949243+0000 mgr.smithi008.flmjzp (mgr.14640) 4142 : cluster [DBG] pgmap v2845: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:58.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:56.949593+0000 mgr.smithi008.flmjzp (mgr.14640) 4143 : cluster [DBG] pgmap v2846: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:58.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:07:56.971945+0000 mgr.smithi008.flmjzp (mgr.14640) 4144 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:58.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.483+0000 7f332759e700 1 -- 172.21.15.8:0/1159106177 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f332810abd0 con 0x7f3310060f70 2023-10-18T22:07:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:56.928749+0000 mgr.smithi008.flmjzp (mgr.14640) 4140 : cluster [DBG] pgmap v2844: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:56.948641+0000 mgr.smithi008.flmjzp (mgr.14640) 4141 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:07:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:56.949243+0000 mgr.smithi008.flmjzp (mgr.14640) 4142 : cluster [DBG] pgmap v2845: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:56.949593+0000 mgr.smithi008.flmjzp (mgr.14640) 4143 : cluster [DBG] pgmap v2846: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:07:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:07:56.971945+0000 mgr.smithi008.flmjzp (mgr.14640) 4144 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:07:58.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.493+0000 7f3316ffd700 1 -- 172.21.15.8:0/1159106177 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f332810abd0 con 0x7f3310060f70 2023-10-18T22:07:58.495 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:07:58.496 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (74m) 113s ago 76m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:07:58.496 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (68m) 113s ago 76m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:07:58.496 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (68m) 9m ago 75m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:07:58.496 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (74m) 113s ago 75m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:07:58.497 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 113s ago 72m - - 2023-10-18T22:07:58.497 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 113s ago 72m - - 2023-10-18T22:07:58.497 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 72m - - 2023-10-18T22:07:58.497 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 72m - - 2023-10-18T22:07:58.497 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (69m) 113s ago 77m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:07:58.498 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (69m) 9m ago 75m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:07:58.498 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (68m) 113s ago 77m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:07:58.498 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (68m) 9m ago 75m 253M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:07:58.498 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (75m) 113s ago 75m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:07:58.498 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (74m) 9m ago 74m 10.7M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:07:58.499 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (68m) 113s ago 74m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:07:58.499 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (66m) 113s ago 74m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:07:58.499 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (65m) 113s ago 74m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:07:58.499 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (65m) 9m ago 73m 488M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:07:58.499 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (64m) 9m ago 73m 424M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:07:58.499 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (64m) 9m ago 73m 350M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:07:58.500 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (70m) 113s ago 75m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:07:58.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 -- 172.21.15.8:0/1159106177 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3310060f70 msgr2=0x7f3310063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3310060f70 0x7f3310063430 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f33280f7630 tx=0x7f3318009c00).stop 2023-10-18T22:07:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 -- 172.21.15.8:0/1159106177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33280f77d0 msgr2=0x7f3328109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33280f77d0 0x7f3328109420 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f331c009990 tx=0x7f331c009b30).stop 2023-10-18T22:07:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 -- 172.21.15.8:0/1159106177 shutdown_connections 2023-10-18T22:07:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3310060f70 0x7f3310063430 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33280f6530 0x7f3328108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 --2- 172.21.15.8:0/1159106177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33280f77d0 0x7f3328109420 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 -- 172.21.15.8:0/1159106177 >> 172.21.15.8:0/1159106177 conn(0x7f33280f1c90 msgr2=0x7f332806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 -- 172.21.15.8:0/1159106177 shutdown_connections 2023-10-18T22:07:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.495+0000 7f332759e700 1 -- 172.21.15.8:0/1159106177 wait complete. 2023-10-18T22:07:58.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.631+0000 7f3eca462700 1 -- 172.21.15.8:0/151888208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec40f6530 msgr2=0x7f3ec40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:58.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.631+0000 7f3eca462700 1 --2- 172.21.15.8:0/151888208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec40f6530 0x7f3ec40f6950 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f3ec0004660 tx=0x7f3ec0009b30).stop 2023-10-18T22:07:58.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.631+0000 7f3eca462700 1 -- 172.21.15.8:0/151888208 shutdown_connections 2023-10-18T22:07:58.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.631+0000 7f3eca462700 1 --2- 172.21.15.8:0/151888208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ec40f77d0 0x7f3ec40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.631+0000 7f3eca462700 1 --2- 172.21.15.8:0/151888208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec40f6530 0x7f3ec40f6950 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.631+0000 7f3eca462700 1 -- 172.21.15.8:0/151888208 >> 172.21.15.8:0/151888208 conn(0x7f3ec40f1c90 msgr2=0x7f3ec40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:58.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.631+0000 7f3eca462700 1 -- 172.21.15.8:0/151888208 shutdown_connections 2023-10-18T22:07:58.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.631+0000 7f3eca462700 1 -- 172.21.15.8:0/151888208 wait complete. 2023-10-18T22:07:58.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.632+0000 7f3eca462700 1 Processor -- start 2023-10-18T22:07:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.632+0000 7f3eca462700 1 -- start start 2023-10-18T22:07:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.632+0000 7f3eca462700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ec40f6530 0x7f3ec4106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.632+0000 7f3eca462700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec40f77d0 0x7f3ec4107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.632+0000 7f3eca462700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4107910 con 0x7f3ec40f77d0 2023-10-18T22:07:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.632+0000 7f3eca462700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4108120 con 0x7f3ec40f6530 2023-10-18T22:07:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.632+0000 7f3ec8c5f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec40f77d0 0x7f3ec4107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.632+0000 7f3ec8c5f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec40f77d0 0x7f3ec4107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40456/0 (socket says 172.21.15.8:40456) 2023-10-18T22:07:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.632+0000 7f3ec8c5f700 1 -- 172.21.15.8:0/1642807203 learned_addr learned my addr 172.21.15.8:0/1642807203 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.633+0000 7f3ec9460700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ec40f6530 0x7f3ec4106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.633+0000 7f3ec8c5f700 1 -- 172.21.15.8:0/1642807203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ec40f6530 msgr2=0x7f3ec4106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.633+0000 7f3ec8c5f700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ec40f6530 0x7f3ec4106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.633+0000 7f3ec8c5f700 1 -- 172.21.15.8:0/1642807203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0005040 con 0x7f3ec40f77d0 2023-10-18T22:07:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.633+0000 7f3ec8c5f700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec40f77d0 0x7f3ec4107310 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f3eb40026d0 tx=0x7f3eb4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.633+0000 7f3eb9ffb700 1 -- 172.21.15.8:0/1642807203 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eb40079c0 con 0x7f3ec40f77d0 2023-10-18T22:07:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.633+0000 7f3eb9ffb700 1 -- 172.21.15.8:0/1642807203 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3eb400f040 con 0x7f3ec40f77d0 2023-10-18T22:07:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.633+0000 7f3eca462700 1 -- 172.21.15.8:0/1642807203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec41083a0 con 0x7f3ec40f77d0 2023-10-18T22:07:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.633+0000 7f3eb9ffb700 1 -- 172.21.15.8:0/1642807203 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eb4014980 con 0x7f3ec40f77d0 2023-10-18T22:07:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.634+0000 7f3eca462700 1 -- 172.21.15.8:0/1642807203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec4108960 con 0x7f3ec40f77d0 2023-10-18T22:07:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.635+0000 7f3eca462700 1 -- 172.21.15.8:0/1642807203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec4059100 con 0x7f3ec40f77d0 2023-10-18T22:07:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.636+0000 7f3eb9ffb700 1 -- 172.21.15.8:0/1642807203 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3eb40090d0 con 0x7f3ec40f77d0 2023-10-18T22:07:58.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.636+0000 7f3eb9ffb700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3eb0060f70 0x7f3eb0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:58.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.636+0000 7f3eb9ffb700 1 -- 172.21.15.8:0/1642807203 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3eb407c8c0 con 0x7f3ec40f77d0 2023-10-18T22:07:58.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.637+0000 7f3ec9460700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3eb0060f70 0x7f3eb0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:58.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.637+0000 7f3ec9460700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3eb0060f70 0x7f3eb0063430 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f3ec0005010 tx=0x7f3ec0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:58.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.640+0000 7f3eb9ffb700 1 -- 172.21.15.8:0/1642807203 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3eb404c5e0 con 0x7f3ec40f77d0 2023-10-18T22:07:58.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.893+0000 7f3eca462700 1 -- 172.21.15.8:0/1642807203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3ec40fee50 con 0x7f3ec40f77d0 2023-10-18T22:07:58.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.894+0000 7f3eb9ffb700 1 -- 172.21.15.8:0/1642807203 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f3ec40fee50 con 0x7f3ec40f77d0 2023-10-18T22:07:58.895 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:07:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:07:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:07:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:07:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:07:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:07:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:07:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:07:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:07:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:07:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:07:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:07:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:07:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:07:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:07:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:07:58.899 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:07:58.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 -- 172.21.15.8:0/1642807203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3eb0060f70 msgr2=0x7f3eb0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:58.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3eb0060f70 0x7f3eb0063430 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f3ec0005010 tx=0x7f3ec0009b30).stop 2023-10-18T22:07:58.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 -- 172.21.15.8:0/1642807203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec40f77d0 msgr2=0x7f3ec4107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:58.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec40f77d0 0x7f3ec4107310 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f3eb40026d0 tx=0x7f3eb4009de0).stop 2023-10-18T22:07:58.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 -- 172.21.15.8:0/1642807203 shutdown_connections 2023-10-18T22:07:58.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3eb0060f70 0x7f3eb0063430 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ec40f6530 0x7f3ec4106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 --2- 172.21.15.8:0/1642807203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec40f77d0 0x7f3ec4107310 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:58.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 -- 172.21.15.8:0/1642807203 >> 172.21.15.8:0/1642807203 conn(0x7f3ec40f1c90 msgr2=0x7f3ec40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:58.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 -- 172.21.15.8:0/1642807203 shutdown_connections 2023-10-18T22:07:58.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:58.896+0000 7f3eca462700 1 -- 172.21.15.8:0/1642807203 wait complete. 2023-10-18T22:07:59.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.032+0000 7f948359e700 1 -- 172.21.15.8:0/4293274196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94840f6530 msgr2=0x7f94840f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:59.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.032+0000 7f948359e700 1 --2- 172.21.15.8:0/4293274196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94840f6530 0x7f94840f6950 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f9474004660 tx=0x7f9474009b30).stop 2023-10-18T22:07:59.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.032+0000 7f948359e700 1 -- 172.21.15.8:0/4293274196 shutdown_connections 2023-10-18T22:07:59.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.032+0000 7f948359e700 1 --2- 172.21.15.8:0/4293274196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94840f77d0 0x7f94840f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.032+0000 7f948359e700 1 --2- 172.21.15.8:0/4293274196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94840f6530 0x7f94840f6950 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.032+0000 7f948359e700 1 -- 172.21.15.8:0/4293274196 >> 172.21.15.8:0/4293274196 conn(0x7f94840f1c90 msgr2=0x7f94840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:59.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.032+0000 7f948359e700 1 -- 172.21.15.8:0/4293274196 shutdown_connections 2023-10-18T22:07:59.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.032+0000 7f948359e700 1 -- 172.21.15.8:0/4293274196 wait complete. 2023-10-18T22:07:59.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.033+0000 7f948359e700 1 Processor -- start 2023-10-18T22:07:59.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.033+0000 7f948359e700 1 -- start start 2023-10-18T22:07:59.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f948359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94840f6530 0x7f9484106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:59.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f948359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94840f77d0 0x7f9484107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:59.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f948359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9484107910 con 0x7f94840f77d0 2023-10-18T22:07:59.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f948359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9484108120 con 0x7f94840f6530 2023-10-18T22:07:59.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f9481d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94840f77d0 0x7f9484107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:59.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f9481d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94840f77d0 0x7f9484107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40466/0 (socket says 172.21.15.8:40466) 2023-10-18T22:07:59.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f9481d9b700 1 -- 172.21.15.8:0/553127834 learned_addr learned my addr 172.21.15.8:0/553127834 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:59.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f948259c700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94840f6530 0x7f9484106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:59.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f9481d9b700 1 -- 172.21.15.8:0/553127834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94840f6530 msgr2=0x7f9484106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:59.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f9481d9b700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94840f6530 0x7f9484106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.034+0000 7f9481d9b700 1 -- 172.21.15.8:0/553127834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474005040 con 0x7f94840f77d0 2023-10-18T22:07:59.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.035+0000 7f9481d9b700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94840f77d0 0x7f9484107310 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f94780026d0 tx=0x7f9478009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:59.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.035+0000 7f9472ffd700 1 -- 172.21.15.8:0/553127834 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94780079c0 con 0x7f94840f77d0 2023-10-18T22:07:59.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.035+0000 7f9472ffd700 1 -- 172.21.15.8:0/553127834 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f947800f040 con 0x7f94840f77d0 2023-10-18T22:07:59.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.035+0000 7f9472ffd700 1 -- 172.21.15.8:0/553127834 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9478014980 con 0x7f94840f77d0 2023-10-18T22:07:59.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.035+0000 7f948359e700 1 -- 172.21.15.8:0/553127834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94841083a0 con 0x7f94840f77d0 2023-10-18T22:07:59.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.035+0000 7f948359e700 1 -- 172.21.15.8:0/553127834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9484108960 con 0x7f94840f77d0 2023-10-18T22:07:59.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.036+0000 7f948359e700 1 -- 172.21.15.8:0/553127834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9484059100 con 0x7f94840f77d0 2023-10-18T22:07:59.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.037+0000 7f9472ffd700 1 -- 172.21.15.8:0/553127834 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f94780090d0 con 0x7f94840f77d0 2023-10-18T22:07:59.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.038+0000 7f9472ffd700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f946c060f70 0x7f946c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:59.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.038+0000 7f9472ffd700 1 -- 172.21.15.8:0/553127834 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f947807c8a0 con 0x7f94840f77d0 2023-10-18T22:07:59.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.038+0000 7f948259c700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f946c060f70 0x7f946c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:59.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.039+0000 7f948259c700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f946c060f70 0x7f946c063430 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f9484106b90 tx=0x7f9474009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:59.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.042+0000 7f9472ffd700 1 -- 172.21.15.8:0/553127834 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f947804c580 con 0x7f94840f77d0 2023-10-18T22:07:59.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.273+0000 7f948359e700 1 -- 172.21.15.8:0/553127834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f94840008d0 con 0x7f94840f77d0 2023-10-18T22:07:59.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.273+0000 7f9472ffd700 1 -- 172.21.15.8:0/553127834 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f947804fba0 con 0x7f94840f77d0 2023-10-18T22:07:59.275 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:07:59.275 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:07:59.275 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:07:59.276 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:07:59.276 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:07:59.276 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:07:59.276 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:07:59.276 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:07:59.277 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:07:59.277 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:07:59.277 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:07:59.277 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:07:59.277 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:07:59.278 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:07:59.278 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:07:59.278 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:07:59.278 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:07:59.278 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:07:59.279 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:07:59.279 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:07:59.279 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:07:59.279 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:07:59.279 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:07:59.280 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:07:59.280 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:07:59.280 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:07:59.280 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:07:59.280 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:07:59.280 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:07:59.281 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:07:59.281 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:07:59.281 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:07:59.281 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:07:59.281 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:07:59.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 -- 172.21.15.8:0/553127834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f946c060f70 msgr2=0x7f946c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:59.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f946c060f70 0x7f946c063430 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f9484106b90 tx=0x7f9474009b30).stop 2023-10-18T22:07:59.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 -- 172.21.15.8:0/553127834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94840f77d0 msgr2=0x7f9484107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:59.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94840f77d0 0x7f9484107310 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f94780026d0 tx=0x7f9478009de0).stop 2023-10-18T22:07:59.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 -- 172.21.15.8:0/553127834 shutdown_connections 2023-10-18T22:07:59.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f946c060f70 0x7f946c063430 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94840f6530 0x7f9484106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 --2- 172.21.15.8:0/553127834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94840f77d0 0x7f9484107310 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 -- 172.21.15.8:0/553127834 >> 172.21.15.8:0/553127834 conn(0x7f94840f1c90 msgr2=0x7f94840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:59.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 -- 172.21.15.8:0/553127834 shutdown_connections 2023-10-18T22:07:59.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.275+0000 7f948359e700 1 -- 172.21.15.8:0/553127834 wait complete. 2023-10-18T22:07:59.284 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:07:59.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.413+0000 7f1112c8a700 1 -- 172.21.15.8:0/3471471762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f110c0f77d0 msgr2=0x7f110c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:59.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.413+0000 7f1112c8a700 1 --2- 172.21.15.8:0/3471471762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f110c0f77d0 0x7f110c0f7c30 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7f10fc004660 tx=0x7f10fc009b30).stop 2023-10-18T22:07:59.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.413+0000 7f1112c8a700 1 -- 172.21.15.8:0/3471471762 shutdown_connections 2023-10-18T22:07:59.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.413+0000 7f1112c8a700 1 --2- 172.21.15.8:0/3471471762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f110c0f77d0 0x7f110c0f7c30 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.413+0000 7f1112c8a700 1 --2- 172.21.15.8:0/3471471762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110c0f6530 0x7f110c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.413+0000 7f1112c8a700 1 -- 172.21.15.8:0/3471471762 >> 172.21.15.8:0/3471471762 conn(0x7f110c0f1c90 msgr2=0x7f110c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:59.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.413+0000 7f1112c8a700 1 -- 172.21.15.8:0/3471471762 shutdown_connections 2023-10-18T22:07:59.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.413+0000 7f1112c8a700 1 -- 172.21.15.8:0/3471471762 wait complete. 2023-10-18T22:07:59.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.414+0000 7f1112c8a700 1 Processor -- start 2023-10-18T22:07:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.414+0000 7f1112c8a700 1 -- start start 2023-10-18T22:07:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.414+0000 7f1112c8a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f110c0f6530 0x7f110c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.414+0000 7f1112c8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110c0f77d0 0x7f110c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.414+0000 7f1112c8a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c109a20 con 0x7f110c0f6530 2023-10-18T22:07:59.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.414+0000 7f1112c8a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c109b60 con 0x7f110c0f77d0 2023-10-18T22:07:59.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f1111c88700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f110c0f6530 0x7f110c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:59.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f1111c88700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f110c0f6530 0x7f110c108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40494/0 (socket says 172.21.15.8:40494) 2023-10-18T22:07:59.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f1111c88700 1 -- 172.21.15.8:0/3858585082 learned_addr learned my addr 172.21.15.8:0/3858585082 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:07:59.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f1111487700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110c0f77d0 0x7f110c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:59.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f1111c88700 1 -- 172.21.15.8:0/3858585082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110c0f77d0 msgr2=0x7f110c109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:59.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f1111c88700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110c0f77d0 0x7f110c109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f1111c88700 1 -- 172.21.15.8:0/3858585082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc005040 con 0x7f110c0f6530 2023-10-18T22:07:59.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f1111c88700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f110c0f6530 0x7f110c108f80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f110800c790 tx=0x7f1108007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:59.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f11027fc700 1 -- 172.21.15.8:0/3858585082 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f110800e680 con 0x7f110c0f6530 2023-10-18T22:07:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f11027fc700 1 -- 172.21.15.8:0/3858585082 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f110800eca0 con 0x7f110c0f6530 2023-10-18T22:07:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f11027fc700 1 -- 172.21.15.8:0/3858585082 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1108012d80 con 0x7f110c0f6530 2023-10-18T22:07:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.415+0000 7f1112c8a700 1 -- 172.21.15.8:0/3858585082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c10a500 con 0x7f110c0f6530 2023-10-18T22:07:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.416+0000 7f1112c8a700 1 -- 172.21.15.8:0/3858585082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c10aac0 con 0x7f110c0f6530 2023-10-18T22:07:59.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.417+0000 7f1112c8a700 1 -- 172.21.15.8:0/3858585082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c045ad0 con 0x7f110c0f6530 2023-10-18T22:07:59.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.418+0000 7f11027fc700 1 -- 172.21.15.8:0/3858585082 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1108010070 con 0x7f110c0f6530 2023-10-18T22:07:59.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.418+0000 7f11027fc700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10f8060f70 0x7f10f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:07:59.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.419+0000 7f11027fc700 1 -- 172.21.15.8:0/3858585082 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f110807c9d0 con 0x7f110c0f6530 2023-10-18T22:07:59.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:57.791671+0000 mgr.smithi008.flmjzp (mgr.14640) 4145 : audit [DBG] from='client.37360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:59.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:58.142108+0000 mgr.smithi008.flmjzp (mgr.14640) 4146 : audit [DBG] from='client.37364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:59.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:07:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:58.894431+0000 mon.smithi008 (mon.0) 4462 : audit [DBG] from='client.? 172.21.15.8:0/1642807203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:59.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.419+0000 7f1111487700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10f8060f70 0x7f10f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:07:59.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.419+0000 7f1111487700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10f8060f70 0x7f10f8063430 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f10fc004e30 tx=0x7f10fc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:07:59.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.422+0000 7f11027fc700 1 -- 172.21.15.8:0/3858585082 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1108050030 con 0x7f110c0f6530 2023-10-18T22:07:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:57.791671+0000 mgr.smithi008.flmjzp (mgr.14640) 4145 : audit [DBG] from='client.37360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:58.142108+0000 mgr.smithi008.flmjzp (mgr.14640) 4146 : audit [DBG] from='client.37364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:07:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:07:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:58.894431+0000 mon.smithi008 (mon.0) 4462 : audit [DBG] from='client.? 172.21.15.8:0/1642807203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:07:59.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.624+0000 7f1112c8a700 1 -- 172.21.15.8:0/3858585082 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f110c0fee00 con 0x7f10f8060f70 2023-10-18T22:07:59.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.626+0000 7f11027fc700 1 -- 172.21.15.8:0/3858585082 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f110c0fee00 con 0x7f10f8060f70 2023-10-18T22:07:59.627 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:07:59.627 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:07:59.627 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:07:59.628 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:07:59.628 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:07:59.628 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:07:59.628 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:07:59.628 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:07:59.629 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:07:59.629 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:07:59.629 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:07:59.629 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:07:59.629 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:07:59.629 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:07:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 -- 172.21.15.8:0/3858585082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10f8060f70 msgr2=0x7f10f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:59.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10f8060f70 0x7f10f8063430 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f10fc004e30 tx=0x7f10fc009b30).stop 2023-10-18T22:07:59.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 -- 172.21.15.8:0/3858585082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f110c0f6530 msgr2=0x7f110c108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:07:59.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f110c0f6530 0x7f110c108f80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f110800c790 tx=0x7f1108007d90).stop 2023-10-18T22:07:59.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 -- 172.21.15.8:0/3858585082 shutdown_connections 2023-10-18T22:07:59.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10f8060f70 0x7f10f8063430 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f110c0f6530 0x7f110c108f80 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 --2- 172.21.15.8:0/3858585082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110c0f77d0 0x7f110c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:07:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 -- 172.21.15.8:0/3858585082 >> 172.21.15.8:0/3858585082 conn(0x7f110c0f1c90 msgr2=0x7f110c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:07:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 -- 172.21.15.8:0/3858585082 shutdown_connections 2023-10-18T22:07:59.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:07:59.628+0000 7f1112c8a700 1 -- 172.21.15.8:0/3858585082 wait complete. 2023-10-18T22:08:00.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:58.485073+0000 mgr.smithi008.flmjzp (mgr.14640) 4147 : audit [DBG] from='client.37368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:07:58.950129+0000 mgr.smithi008.flmjzp (mgr.14640) 4148 : cluster [DBG] pgmap v2847: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:00.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:59.273738+0000 mon.smithi008 (mon.0) 4463 : audit [DBG] from='client.? 172.21.15.8:0/553127834' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:08:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:58.485073+0000 mgr.smithi008.flmjzp (mgr.14640) 4147 : audit [DBG] from='client.37368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:07:58.950129+0000 mgr.smithi008.flmjzp (mgr.14640) 4148 : cluster [DBG] pgmap v2847: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:59.273738+0000 mon.smithi008 (mon.0) 4463 : audit [DBG] from='client.? 172.21.15.8:0/553127834' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:08:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:07:59.626141+0000 mgr.smithi008.flmjzp (mgr.14640) 4149 : audit [DBG] from='client.37380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:07:59.626141+0000 mgr.smithi008.flmjzp (mgr.14640) 4149 : audit [DBG] from='client.37380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:02.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:00.950734+0000 mgr.smithi008.flmjzp (mgr.14640) 4150 : cluster [DBG] pgmap v2848: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:00.950734+0000 mgr.smithi008.flmjzp (mgr.14640) 4150 : cluster [DBG] pgmap v2848: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:04.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:02.951272+0000 mgr.smithi008.flmjzp (mgr.14640) 4151 : cluster [DBG] pgmap v2849: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:02.951272+0000 mgr.smithi008.flmjzp (mgr.14640) 4151 : cluster [DBG] pgmap v2849: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:06.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:04.951811+0000 mgr.smithi008.flmjzp (mgr.14640) 4152 : cluster [DBG] pgmap v2850: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:06.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:04.951811+0000 mgr.smithi008.flmjzp (mgr.14640) 4152 : cluster [DBG] pgmap v2850: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:06.982735+0000 mon.smithi008 (mon.0) 4464 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:06.982735+0000 mon.smithi008 (mon.0) 4464 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:08.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:06.952400+0000 mgr.smithi008.flmjzp (mgr.14640) 4153 : cluster [DBG] pgmap v2851: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:06.952400+0000 mgr.smithi008.flmjzp (mgr.14640) 4153 : cluster [DBG] pgmap v2851: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:08.952915+0000 mgr.smithi008.flmjzp (mgr.14640) 4154 : cluster [DBG] pgmap v2852: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:09.611313+0000 mon.smithi008 (mon.0) 4465 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:08.952915+0000 mgr.smithi008.flmjzp (mgr.14640) 4154 : cluster [DBG] pgmap v2852: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:09.611313+0000 mon.smithi008 (mon.0) 4465 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:10.156177+0000 mon.smithi008 (mon.0) 4466 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:08:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:10.157246+0000 mon.smithi008 (mon.0) 4467 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:08:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:08:10.158099+0000 mgr.smithi008.flmjzp (mgr.14640) 4155 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:08:11.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:10.158772+0000 mgr.smithi008.flmjzp (mgr.14640) 4156 : cluster [DBG] pgmap v2853: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:11.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:10.159018+0000 mgr.smithi008.flmjzp (mgr.14640) 4157 : cluster [DBG] pgmap v2854: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:11.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:10.163467+0000 mon.smithi008 (mon.0) 4468 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:11.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:10.169820+0000 mon.smithi008 (mon.0) 4469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:11.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:10.172733+0000 mon.smithi008 (mon.0) 4470 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:11.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:10.174351+0000 mon.smithi008 (mon.0) 4471 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:11.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:10.175946+0000 mon.smithi008 (mon.0) 4472 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:11.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:10.177946+0000 mon.smithi008 (mon.0) 4473 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:11.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:08:10.179808+0000 mgr.smithi008.flmjzp (mgr.14640) 4158 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:08:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:10.156177+0000 mon.smithi008 (mon.0) 4466 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:08:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:10.157246+0000 mon.smithi008 (mon.0) 4467 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:08:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:08:10.158099+0000 mgr.smithi008.flmjzp (mgr.14640) 4155 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:08:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:10.158772+0000 mgr.smithi008.flmjzp (mgr.14640) 4156 : cluster [DBG] pgmap v2853: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:10.159018+0000 mgr.smithi008.flmjzp (mgr.14640) 4157 : cluster [DBG] pgmap v2854: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:10.163467+0000 mon.smithi008 (mon.0) 4468 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:10.169820+0000 mon.smithi008 (mon.0) 4469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:10.172733+0000 mon.smithi008 (mon.0) 4470 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:10.174351+0000 mon.smithi008 (mon.0) 4471 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:10.175946+0000 mon.smithi008 (mon.0) 4472 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:10.177946+0000 mon.smithi008 (mon.0) 4473 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:11.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:08:10.179808+0000 mgr.smithi008.flmjzp (mgr.14640) 4158 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:08:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:12.159761+0000 mgr.smithi008.flmjzp (mgr.14640) 4159 : cluster [DBG] pgmap v2855: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:12.159761+0000 mgr.smithi008.flmjzp (mgr.14640) 4159 : cluster [DBG] pgmap v2855: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:14.160481+0000 mgr.smithi008.flmjzp (mgr.14640) 4160 : cluster [DBG] pgmap v2856: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:14.160481+0000 mgr.smithi008.flmjzp (mgr.14640) 4160 : cluster [DBG] pgmap v2856: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:16.160975+0000 mgr.smithi008.flmjzp (mgr.14640) 4161 : cluster [DBG] pgmap v2857: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:16.160975+0000 mgr.smithi008.flmjzp (mgr.14640) 4161 : cluster [DBG] pgmap v2857: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:18.161669+0000 mgr.smithi008.flmjzp (mgr.14640) 4162 : cluster [DBG] pgmap v2858: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:18.161669+0000 mgr.smithi008.flmjzp (mgr.14640) 4162 : cluster [DBG] pgmap v2858: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:20.182971+0000 mon.smithi008 (mon.0) 4474 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:20.185231+0000 mon.smithi008 (mon.0) 4475 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:08:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:20.186302+0000 mon.smithi008 (mon.0) 4476 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:08:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:20.192759+0000 mon.smithi008 (mon.0) 4477 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:20.199059+0000 mon.smithi008 (mon.0) 4478 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:20.202144+0000 mon.smithi008 (mon.0) 4479 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:20.203842+0000 mon.smithi008 (mon.0) 4480 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:20.205558+0000 mon.smithi008 (mon.0) 4481 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:20.207600+0000 mon.smithi008 (mon.0) 4482 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:20.182971+0000 mon.smithi008 (mon.0) 4474 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:20.185231+0000 mon.smithi008 (mon.0) 4475 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:08:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:20.186302+0000 mon.smithi008 (mon.0) 4476 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:08:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:20.192759+0000 mon.smithi008 (mon.0) 4477 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:20.199059+0000 mon.smithi008 (mon.0) 4478 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:20.202144+0000 mon.smithi008 (mon.0) 4479 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:20.203842+0000 mon.smithi008 (mon.0) 4480 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:20.205558+0000 mon.smithi008 (mon.0) 4481 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:20.207600+0000 mon.smithi008 (mon.0) 4482 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:20.162321+0000 mgr.smithi008.flmjzp (mgr.14640) 4163 : cluster [DBG] pgmap v2859: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:08:20.187199+0000 mgr.smithi008.flmjzp (mgr.14640) 4164 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:08:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:20.187828+0000 mgr.smithi008.flmjzp (mgr.14640) 4165 : cluster [DBG] pgmap v2860: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:20.188139+0000 mgr.smithi008.flmjzp (mgr.14640) 4166 : cluster [DBG] pgmap v2861: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:08:20.209445+0000 mgr.smithi008.flmjzp (mgr.14640) 4167 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:08:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:20.162321+0000 mgr.smithi008.flmjzp (mgr.14640) 4163 : cluster [DBG] pgmap v2859: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:08:20.187199+0000 mgr.smithi008.flmjzp (mgr.14640) 4164 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:08:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:20.187828+0000 mgr.smithi008.flmjzp (mgr.14640) 4165 : cluster [DBG] pgmap v2860: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:20.188139+0000 mgr.smithi008.flmjzp (mgr.14640) 4166 : cluster [DBG] pgmap v2861: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:08:20.209445+0000 mgr.smithi008.flmjzp (mgr.14640) 4167 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:08:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:22.188766+0000 mgr.smithi008.flmjzp (mgr.14640) 4168 : cluster [DBG] pgmap v2862: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:22.188766+0000 mgr.smithi008.flmjzp (mgr.14640) 4168 : cluster [DBG] pgmap v2862: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:24.189609+0000 mgr.smithi008.flmjzp (mgr.14640) 4169 : cluster [DBG] pgmap v2863: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:24.189609+0000 mgr.smithi008.flmjzp (mgr.14640) 4169 : cluster [DBG] pgmap v2863: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:26.190362+0000 mgr.smithi008.flmjzp (mgr.14640) 4170 : cluster [DBG] pgmap v2864: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:26.190362+0000 mgr.smithi008.flmjzp (mgr.14640) 4170 : cluster [DBG] pgmap v2864: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:28.190954+0000 mgr.smithi008.flmjzp (mgr.14640) 4171 : cluster [DBG] pgmap v2865: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:28.190954+0000 mgr.smithi008.flmjzp (mgr.14640) 4171 : cluster [DBG] pgmap v2865: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.779+0000 7fbef1317700 1 -- 172.21.15.8:0/3834631798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeec0f77d0 msgr2=0x7fbeec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.779+0000 7fbef1317700 1 --2- 172.21.15.8:0/3834631798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeec0f77d0 0x7fbeec0f7c30 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7fbee0004660 tx=0x7fbee0009b30).stop 2023-10-18T22:08:29.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.780+0000 7fbef1317700 1 -- 172.21.15.8:0/3834631798 shutdown_connections 2023-10-18T22:08:29.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.780+0000 7fbef1317700 1 --2- 172.21.15.8:0/3834631798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeec0f77d0 0x7fbeec0f7c30 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:29.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.780+0000 7fbef1317700 1 --2- 172.21.15.8:0/3834631798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeec0f6530 0x7fbeec0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.780+0000 7fbef1317700 1 -- 172.21.15.8:0/3834631798 >> 172.21.15.8:0/3834631798 conn(0x7fbeec0f1c90 msgr2=0x7fbeec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.780+0000 7fbef1317700 1 -- 172.21.15.8:0/3834631798 shutdown_connections 2023-10-18T22:08:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.780+0000 7fbef1317700 1 -- 172.21.15.8:0/3834631798 wait complete. 2023-10-18T22:08:29.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.781+0000 7fbef1317700 1 Processor -- start 2023-10-18T22:08:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.781+0000 7fbef1317700 1 -- start start 2023-10-18T22:08:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.781+0000 7fbef1317700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeec0f6530 0x7fbeec108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.781+0000 7fbef1317700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeec0f77d0 0x7fbeec1093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.781+0000 7fbef1317700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec1099a0 con 0x7fbeec0f77d0 2023-10-18T22:08:29.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.781+0000 7fbef1317700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec109ae0 con 0x7fbeec0f6530 2023-10-18T22:08:29.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.781+0000 7fbeeb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeec0f77d0 0x7fbeec1093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:29.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.781+0000 7fbeeb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeec0f77d0 0x7fbeec1093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59340/0 (socket says 172.21.15.8:59340) 2023-10-18T22:08:29.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.781+0000 7fbeeb7fe700 1 -- 172.21.15.8:0/2014065470 learned_addr learned my addr 172.21.15.8:0/2014065470 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:08:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.782+0000 7fbeebfff700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeec0f6530 0x7fbeec108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.782+0000 7fbeeb7fe700 1 -- 172.21.15.8:0/2014065470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeec0f6530 msgr2=0x7fbeec108f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.782+0000 7fbeeb7fe700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeec0f6530 0x7fbeec108f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.782+0000 7fbeeb7fe700 1 -- 172.21.15.8:0/2014065470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee0005040 con 0x7fbeec0f77d0 2023-10-18T22:08:29.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.782+0000 7fbeeb7fe700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeec0f77d0 0x7fbeec1093f0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fbee0004320 tx=0x7fbee000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:29.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.782+0000 7fbee8ff9700 1 -- 172.21.15.8:0/2014065470 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbee0019070 con 0x7fbeec0f77d0 2023-10-18T22:08:29.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.782+0000 7fbee8ff9700 1 -- 172.21.15.8:0/2014065470 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbee001e420 con 0x7fbeec0f77d0 2023-10-18T22:08:29.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.782+0000 7fbee8ff9700 1 -- 172.21.15.8:0/2014065470 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbee0014680 con 0x7fbeec0f77d0 2023-10-18T22:08:29.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.782+0000 7fbef1317700 1 -- 172.21.15.8:0/2014065470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeec10a420 con 0x7fbeec0f77d0 2023-10-18T22:08:29.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.783+0000 7fbef1317700 1 -- 172.21.15.8:0/2014065470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeec10a900 con 0x7fbeec0f77d0 2023-10-18T22:08:29.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.784+0000 7fbef1317700 1 -- 172.21.15.8:0/2014065470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeec045ad0 con 0x7fbeec0f77d0 2023-10-18T22:08:29.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.785+0000 7fbee8ff9700 1 -- 172.21.15.8:0/2014065470 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbee001e590 con 0x7fbeec0f77d0 2023-10-18T22:08:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.786+0000 7fbee8ff9700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbed4060f70 0x7fbed4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.786+0000 7fbee8ff9700 1 -- 172.21.15.8:0/2014065470 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbee007dc50 con 0x7fbeec0f77d0 2023-10-18T22:08:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.786+0000 7fbeebfff700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbed4060f70 0x7fbed4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:29.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.787+0000 7fbeebfff700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbed4060f70 0x7fbed4063430 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fbedc009fd0 tx=0x7fbedc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:29.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.791+0000 7fbee8ff9700 1 -- 172.21.15.8:0/2014065470 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbee0051310 con 0x7fbeec0f77d0 2023-10-18T22:08:29.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.990+0000 7fbef1317700 1 -- 172.21.15.8:0/2014065470 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbeec0fee30 con 0x7fbed4060f70 2023-10-18T22:08:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.992+0000 7fbee8ff9700 1 -- 172.21.15.8:0/2014065470 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbeec0fee30 con 0x7fbed4060f70 2023-10-18T22:08:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 -- 172.21.15.8:0/2014065470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbed4060f70 msgr2=0x7fbed4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbed4060f70 0x7fbed4063430 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fbedc009fd0 tx=0x7fbedc00b040).stop 2023-10-18T22:08:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 -- 172.21.15.8:0/2014065470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeec0f77d0 msgr2=0x7fbeec1093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeec0f77d0 0x7fbeec1093f0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fbee0004320 tx=0x7fbee000b040).stop 2023-10-18T22:08:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 -- 172.21.15.8:0/2014065470 shutdown_connections 2023-10-18T22:08:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbed4060f70 0x7fbed4063430 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeec0f6530 0x7fbeec108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:29.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 --2- 172.21.15.8:0/2014065470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeec0f77d0 0x7fbeec1093f0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:29.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 -- 172.21.15.8:0/2014065470 >> 172.21.15.8:0/2014065470 conn(0x7fbeec0f1c90 msgr2=0x7fbeec06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:29.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 -- 172.21.15.8:0/2014065470 shutdown_connections 2023-10-18T22:08:29.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:29.994+0000 7fbef1317700 1 -- 172.21.15.8:0/2014065470 wait complete. 2023-10-18T22:08:30.011 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:08:30.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.132+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3987746918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6d806b960 msgr2=0x7fa6d8069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:30.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.132+0000 7fa6dddfb700 1 --2- 172.21.15.8:0/3987746918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6d806b960 0x7fa6d8069e60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7fa6cc004660 tx=0x7fa6cc009b30).stop 2023-10-18T22:08:30.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.132+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3987746918 shutdown_connections 2023-10-18T22:08:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.132+0000 7fa6dddfb700 1 --2- 172.21.15.8:0/3987746918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6d806a350 0x7fa6d806a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:08:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.132+0000 7fa6dddfb700 1 --2- 172.21.15.8:0/3987746918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6d806b960 0x7fa6d8069e60 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.132+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3987746918 >> 172.21.15.8:0/3987746918 conn(0x7fa6d80f1c90 msgr2=0x7fa6d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.132+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3987746918 shutdown_connections 2023-10-18T22:08:30.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.133+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3987746918 wait complete. 2023-10-18T22:08:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.133+0000 7fa6dddfb700 1 Processor -- start 2023-10-18T22:08:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.133+0000 7fa6dddfb700 1 -- start start 2023-10-18T22:08:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.134+0000 7fa6dddfb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6d806a350 0x7fa6d8108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.134+0000 7fa6dddfb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6d806b960 0x7fa6d8109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.134+0000 7fa6dddfb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8109ad0 con 0x7fa6d806b960 2023-10-18T22:08:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.134+0000 7fa6dddfb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d810a380 con 0x7fa6d806a350 2023-10-18T22:08:30.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.134+0000 7fa6d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6d806b960 0x7fa6d8109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:30.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.134+0000 7fa6d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6d806b960 0x7fa6d8109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59360/0 (socket says 172.21.15.8:59360) 2023-10-18T22:08:30.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.134+0000 7fa6d7fff700 1 -- 172.21.15.8:0/3260746670 learned_addr learned my addr 172.21.15.8:0/3260746670 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:08:30.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.134+0000 7fa6dcdf9700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6d806a350 0x7fa6d8108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:30.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.135+0000 7fa6d7fff700 1 -- 172.21.15.8:0/3260746670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6d806a350 msgr2=0x7fa6d8108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.135+0000 7fa6d7fff700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6d806a350 0x7fa6d8108fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.135+0000 7fa6d7fff700 1 -- 172.21.15.8:0/3260746670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc005040 con 0x7fa6d806b960 2023-10-18T22:08:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.135+0000 7fa6d7fff700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6d806b960 0x7fa6d8109490 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fa6c400b410 tx=0x7fa6c4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.135+0000 7fa6d57fa700 1 -- 172.21.15.8:0/3260746670 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6c40125f0 con 0x7fa6d806b960 2023-10-18T22:08:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.135+0000 7fa6d57fa700 1 -- 172.21.15.8:0/3260746670 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa6c400be30 con 0x7fa6d806b960 2023-10-18T22:08:30.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.135+0000 7fa6d57fa700 1 -- 172.21.15.8:0/3260746670 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6c4002a60 con 0x7fa6d806b960 2023-10-18T22:08:30.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.135+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3260746670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d810a660 con 0x7fa6d806b960 2023-10-18T22:08:30.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.135+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3260746670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d810ac20 con 0x7fa6d806b960 2023-10-18T22:08:30.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.136+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3260746670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d8059100 con 0x7fa6d806b960 2023-10-18T22:08:30.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.137+0000 7fa6d57fa700 1 -- 172.21.15.8:0/3260746670 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa6c400f030 con 0x7fa6d806b960 2023-10-18T22:08:30.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.138+0000 7fa6d57fa700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa6c8060f70 0x7fa6c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:30.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.138+0000 7fa6d57fa700 1 -- 172.21.15.8:0/3260746670 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa6c407cd20 con 0x7fa6d806b960 2023-10-18T22:08:30.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.139+0000 7fa6dcdf9700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa6c8060f70 0x7fa6c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:30.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.139+0000 7fa6dcdf9700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa6c8060f70 0x7fa6c8063430 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fa6cc004630 tx=0x7fa6cc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:30.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.143+0000 7fa6d57fa700 1 -- 172.21.15.8:0/3260746670 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa6c4050320 con 0x7fa6d806b960 2023-10-18T22:08:30.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.349+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3260746670 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6d8100fa0 con 0x7fa6c8060f70 2023-10-18T22:08:30.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.350+0000 7fa6d57fa700 1 -- 172.21.15.8:0/3260746670 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa6d8100fa0 con 0x7fa6c8060f70 2023-10-18T22:08:30.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3260746670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa6c8060f70 msgr2=0x7fa6c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:30.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa6c8060f70 0x7fa6c8063430 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fa6cc004630 tx=0x7fa6cc009b30).stop 2023-10-18T22:08:30.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3260746670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6d806b960 msgr2=0x7fa6d8109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:30.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6d806b960 0x7fa6d8109490 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fa6c400b410 tx=0x7fa6c4006ef0).stop 2023-10-18T22:08:30.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3260746670 shutdown_connections 2023-10-18T22:08:30.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa6c8060f70 0x7fa6c8063430 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6d806a350 0x7fa6d8108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 --2- 172.21.15.8:0/3260746670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6d806b960 0x7fa6d8109490 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3260746670 >> 172.21.15.8:0/3260746670 conn(0x7fa6d80f1c90 msgr2=0x7fa6d80fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:30.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3260746670 shutdown_connections 2023-10-18T22:08:30.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.352+0000 7fa6dddfb700 1 -- 172.21.15.8:0/3260746670 wait complete. 2023-10-18T22:08:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.488+0000 7fc5e759e700 1 -- 172.21.15.8:0/2826800844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f96e0 msgr2=0x7fc5e80fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.488+0000 7fc5e759e700 1 --2- 172.21.15.8:0/2826800844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f96e0 0x7fc5e80fbaf0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fc5dc004660 tx=0x7fc5dc009b30).stop 2023-10-18T22:08:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.488+0000 7fc5e759e700 1 -- 172.21.15.8:0/2826800844 shutdown_connections 2023-10-18T22:08:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.488+0000 7fc5e759e700 1 --2- 172.21.15.8:0/2826800844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80f96e0 0x7fc5e80fbaf0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.488+0000 7fc5e759e700 1 --2- 172.21.15.8:0/2826800844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80602d0 0x7fc5e80f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.488+0000 7fc5e759e700 1 -- 172.21.15.8:0/2826800844 >> 172.21.15.8:0/2826800844 conn(0x7fc5e80f0ba0 msgr2=0x7fc5e80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.489+0000 7fc5e759e700 1 -- 172.21.15.8:0/2826800844 shutdown_connections 2023-10-18T22:08:30.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.489+0000 7fc5e759e700 1 -- 172.21.15.8:0/2826800844 wait complete. 2023-10-18T22:08:30.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.489+0000 7fc5e759e700 1 Processor -- start 2023-10-18T22:08:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.490+0000 7fc5e759e700 1 -- start start 2023-10-18T22:08:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.490+0000 7fc5e759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80602d0 0x7fc5e8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.490+0000 7fc5e759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f96e0 0x7fc5e8109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.490+0000 7fc5e759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8109a20 con 0x7fc5e80602d0 2023-10-18T22:08:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.490+0000 7fc5e759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8109b60 con 0x7fc5e80f96e0 2023-10-18T22:08:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.490+0000 7fc5e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80602d0 0x7fc5e8108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.490+0000 7fc5e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80602d0 0x7fc5e8108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59380/0 (socket says 172.21.15.8:59380) 2023-10-18T22:08:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.490+0000 7fc5e659c700 1 -- 172.21.15.8:0/477975337 learned_addr learned my addr 172.21.15.8:0/477975337 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:08:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.490+0000 7fc5e5d9b700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f96e0 0x7fc5e8109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.491+0000 7fc5e659c700 1 -- 172.21.15.8:0/477975337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f96e0 msgr2=0x7fc5e8109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.491+0000 7fc5e659c700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f96e0 0x7fc5e8109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.491+0000 7fc5e659c700 1 -- 172.21.15.8:0/477975337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc005040 con 0x7fc5e80602d0 2023-10-18T22:08:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.491+0000 7fc5e659c700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80602d0 0x7fc5e8108f80 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7fc5d80026d0 tx=0x7fc5d8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.491+0000 7fc5d6ffd700 1 -- 172.21.15.8:0/477975337 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d80079c0 con 0x7fc5e80602d0 2023-10-18T22:08:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.491+0000 7fc5e759e700 1 -- 172.21.15.8:0/477975337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e810a500 con 0x7fc5e80602d0 2023-10-18T22:08:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.491+0000 7fc5d6ffd700 1 -- 172.21.15.8:0/477975337 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc5d800f040 con 0x7fc5e80602d0 2023-10-18T22:08:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.491+0000 7fc5d6ffd700 1 -- 172.21.15.8:0/477975337 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d8014980 con 0x7fc5e80602d0 2023-10-18T22:08:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.491+0000 7fc5e759e700 1 -- 172.21.15.8:0/477975337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e810aac0 con 0x7fc5e80602d0 2023-10-18T22:08:30.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.492+0000 7fc5e759e700 1 -- 172.21.15.8:0/477975337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e8045ad0 con 0x7fc5e80602d0 2023-10-18T22:08:30.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.493+0000 7fc5d6ffd700 1 -- 172.21.15.8:0/477975337 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc5d80090d0 con 0x7fc5e80602d0 2023-10-18T22:08:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.494+0000 7fc5d6ffd700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 0x7fc5d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.494+0000 7fc5d6ffd700 1 -- 172.21.15.8:0/477975337 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc5d807c8c0 con 0x7fc5e80602d0 2023-10-18T22:08:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.494+0000 7fc5e5d9b700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 0x7fc5d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.495+0000 7fc5e5d9b700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 0x7fc5d0063430 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fc5dc004630 tx=0x7fc5dc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.498+0000 7fc5d6ffd700 1 -- 172.21.15.8:0/477975337 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc5d8050010 con 0x7fc5e80602d0 2023-10-18T22:08:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.220010+0000 mon.smithi008 (mon.0) 4483 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.221624+0000 mon.smithi008 (mon.0) 4484 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:08:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.222334+0000 mon.smithi008 (mon.0) 4485 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:08:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.227586+0000 mon.smithi008 (mon.0) 4486 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.232532+0000 mon.smithi008 (mon.0) 4487 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.234962+0000 mon.smithi008 (mon.0) 4488 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.236291+0000 mon.smithi008 (mon.0) 4489 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:30.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.237919+0000 mon.smithi008 (mon.0) 4490 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:30.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.239901+0000 mon.smithi008 (mon.0) 4491 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.690+0000 7fc5e759e700 1 -- 172.21.15.8:0/477975337 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5e80f56a0 con 0x7fc5d0060f70 2023-10-18T22:08:30.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.699+0000 7fc5d6ffd700 1 -- 172.21.15.8:0/477975337 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc5e80f56a0 con 0x7fc5d0060f70 2023-10-18T22:08:30.702 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:08:30.702 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (75m) 2m ago 76m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:08:30.702 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (69m) 2m ago 76m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:08:30.703 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (68m) 21s ago 75m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:08:30.703 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (75m) 2m ago 76m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:08:30.703 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 72m - - 2023-10-18T22:08:30.703 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 72m - - 2023-10-18T22:08:30.703 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 21s ago 72m - - 2023-10-18T22:08:30.703 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 21s ago 72m - - 2023-10-18T22:08:30.704 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (70m) 2m ago 78m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:08:30.704 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (69m) 21s ago 75m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:08:30.704 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (69m) 2m ago 78m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:08:30.704 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (69m) 21s ago 75m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:08:30.704 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (76m) 2m ago 76m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:08:30.705 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (75m) 21s ago 75m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:08:30.705 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (68m) 2m ago 75m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:08:30.705 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (66m) 2m ago 74m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:08:30.705 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (66m) 2m ago 74m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:08:30.705 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (65m) 21s ago 74m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:08:30.706 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (65m) 21s ago 74m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:08:30.706 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (64m) 21s ago 73m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:08:30.706 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (70m) 2m ago 75m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:08:30.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.701+0000 7fc5e759e700 1 -- 172.21.15.8:0/477975337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 msgr2=0x7fc5d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:30.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.701+0000 7fc5e759e700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 0x7fc5d0063430 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fc5dc004630 tx=0x7fc5dc009b30).stop 2023-10-18T22:08:30.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.701+0000 7fc5e759e700 1 -- 172.21.15.8:0/477975337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80602d0 msgr2=0x7fc5e8108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:30.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.701+0000 7fc5e759e700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80602d0 0x7fc5e8108f80 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7fc5d80026d0 tx=0x7fc5d8009de0).stop 2023-10-18T22:08:30.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.702+0000 7fc5e759e700 1 -- 172.21.15.8:0/477975337 shutdown_connections 2023-10-18T22:08:30.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.702+0000 7fc5e759e700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc5d0060f70 0x7fc5d0063430 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.702+0000 7fc5e759e700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5e80602d0 0x7fc5e8108f80 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.702+0000 7fc5e759e700 1 --2- 172.21.15.8:0/477975337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e80f96e0 0x7fc5e8109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.702+0000 7fc5e759e700 1 -- 172.21.15.8:0/477975337 >> 172.21.15.8:0/477975337 conn(0x7fc5e80f0ba0 msgr2=0x7fc5e80f4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:30.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.703+0000 7fc5e759e700 1 -- 172.21.15.8:0/477975337 shutdown_connections 2023-10-18T22:08:30.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.703+0000 7fc5e759e700 1 -- 172.21.15.8:0/477975337 wait complete. 2023-10-18T22:08:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.220010+0000 mon.smithi008 (mon.0) 4483 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.221624+0000 mon.smithi008 (mon.0) 4484 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:08:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.222334+0000 mon.smithi008 (mon.0) 4485 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:08:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.227586+0000 mon.smithi008 (mon.0) 4486 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.232532+0000 mon.smithi008 (mon.0) 4487 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.234962+0000 mon.smithi008 (mon.0) 4488 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.236291+0000 mon.smithi008 (mon.0) 4489 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.237919+0000 mon.smithi008 (mon.0) 4490 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.239901+0000 mon.smithi008 (mon.0) 4491 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:30.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.840+0000 7f4445e24700 1 -- 172.21.15.8:0/967859658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44400f6530 msgr2=0x7f44400f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:30.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.840+0000 7f4445e24700 1 --2- 172.21.15.8:0/967859658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44400f6530 0x7f44400f6950 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f4434004660 tx=0x7f4434009b30).stop 2023-10-18T22:08:30.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.840+0000 7f4445e24700 1 -- 172.21.15.8:0/967859658 shutdown_connections 2023-10-18T22:08:30.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.840+0000 7f4445e24700 1 --2- 172.21.15.8:0/967859658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44400f77d0 0x7f44400f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.840+0000 7f4445e24700 1 --2- 172.21.15.8:0/967859658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44400f6530 0x7f44400f6950 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.840+0000 7f4445e24700 1 -- 172.21.15.8:0/967859658 >> 172.21.15.8:0/967859658 conn(0x7f44400f1c90 msgr2=0x7f44400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.840+0000 7f4445e24700 1 -- 172.21.15.8:0/967859658 shutdown_connections 2023-10-18T22:08:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.840+0000 7f4445e24700 1 -- 172.21.15.8:0/967859658 wait complete. 2023-10-18T22:08:30.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.841+0000 7f4445e24700 1 Processor -- start 2023-10-18T22:08:30.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.841+0000 7f4445e24700 1 -- start start 2023-10-18T22:08:30.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4445e24700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44400f6530 0x7f4440108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:30.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4445e24700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44400f77d0 0x7f44401094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:30.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4445e24700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440109a70 con 0x7f44400f6530 2023-10-18T22:08:30.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4445e24700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440109bb0 con 0x7f44400f77d0 2023-10-18T22:08:30.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4444e22700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44400f6530 0x7f4440108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:30.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4444e22700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44400f6530 0x7f4440108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59400/0 (socket says 172.21.15.8:59400) 2023-10-18T22:08:30.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4444e22700 1 -- 172.21.15.8:0/2028594795 learned_addr learned my addr 172.21.15.8:0/2028594795 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:08:30.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f443ffff700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44400f77d0 0x7f44401094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:30.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4444e22700 1 -- 172.21.15.8:0/2028594795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44400f77d0 msgr2=0x7f44401094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:30.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4444e22700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44400f77d0 0x7f44401094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:30.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4444e22700 1 -- 172.21.15.8:0/2028594795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4434005040 con 0x7f44400f6530 2023-10-18T22:08:30.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f443ffff700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44400f77d0 0x7f44401094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:08:30.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.842+0000 7f4444e22700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44400f6530 0x7f4440108fd0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7f4434007a60 tx=0x7f4434009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:30.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.843+0000 7f443d7fa700 1 -- 172.21.15.8:0/2028594795 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4434018070 con 0x7f44400f6530 2023-10-18T22:08:30.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.843+0000 7f443d7fa700 1 -- 172.21.15.8:0/2028594795 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4434009630 con 0x7f44400f6530 2023-10-18T22:08:30.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.843+0000 7f4445e24700 1 -- 172.21.15.8:0/2028594795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444010a4f0 con 0x7f44400f6530 2023-10-18T22:08:30.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.843+0000 7f443d7fa700 1 -- 172.21.15.8:0/2028594795 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f443401c540 con 0x7f44400f6530 2023-10-18T22:08:30.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.843+0000 7f4445e24700 1 -- 172.21.15.8:0/2028594795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444010aa50 con 0x7f44400f6530 2023-10-18T22:08:30.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.844+0000 7f4445e24700 1 -- 172.21.15.8:0/2028594795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4440045ad0 con 0x7f44400f6530 2023-10-18T22:08:30.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.845+0000 7f443d7fa700 1 -- 172.21.15.8:0/2028594795 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f443401c7b0 con 0x7f44400f6530 2023-10-18T22:08:30.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.846+0000 7f443d7fa700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4430060f70 0x7f4430063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:30.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.846+0000 7f443d7fa700 1 -- 172.21.15.8:0/2028594795 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f443407e760 con 0x7f44400f6530 2023-10-18T22:08:30.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.846+0000 7f443ffff700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4430060f70 0x7f4430063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:30.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.847+0000 7f443ffff700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4430060f70 0x7f4430063430 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f442c009fd0 tx=0x7f442c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:30.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:30.850+0000 7f443d7fa700 1 -- 172.21.15.8:0/2028594795 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4434051d40 con 0x7f44400f6530 2023-10-18T22:08:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.102+0000 7f4445e24700 1 -- 172.21.15.8:0/2028594795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4440027a00 con 0x7f44400f6530 2023-10-18T22:08:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.103+0000 7f443d7fa700 1 -- 172.21.15.8:0/2028594795 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f4434051930 con 0x7f44400f6530 2023-10-18T22:08:31.106 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:08:31.106 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:08:31.106 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:08:31.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:08:31.107 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:08:31.107 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:08:31.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:08:31.107 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:08:31.107 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:08:31.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:08:31.108 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:08:31.108 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:08:31.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:08:31.108 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:08:31.109 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:08:31.109 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:08:31.109 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:08:31.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.105+0000 7f4445e24700 1 -- 172.21.15.8:0/2028594795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4430060f70 msgr2=0x7f4430063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:31.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.105+0000 7f4445e24700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4430060f70 0x7f4430063430 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f442c009fd0 tx=0x7f442c00b040).stop 2023-10-18T22:08:31.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.105+0000 7f4445e24700 1 -- 172.21.15.8:0/2028594795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44400f6530 msgr2=0x7f4440108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:31.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.105+0000 7f4445e24700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44400f6530 0x7f4440108fd0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7f4434007a60 tx=0x7f4434009b30).stop 2023-10-18T22:08:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.105+0000 7f4445e24700 1 -- 172.21.15.8:0/2028594795 shutdown_connections 2023-10-18T22:08:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.105+0000 7f4445e24700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4430060f70 0x7f4430063430 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.105+0000 7f4445e24700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44400f6530 0x7f4440108fd0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.105+0000 7f4445e24700 1 --2- 172.21.15.8:0/2028594795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44400f77d0 0x7f44401094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.105+0000 7f4445e24700 1 -- 172.21.15.8:0/2028594795 >> 172.21.15.8:0/2028594795 conn(0x7f44400f1c90 msgr2=0x7f444006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.106+0000 7f4445e24700 1 -- 172.21.15.8:0/2028594795 shutdown_connections 2023-10-18T22:08:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.106+0000 7f4445e24700 1 -- 172.21.15.8:0/2028594795 wait complete. 2023-10-18T22:08:31.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.243+0000 7f7a58ce0700 1 -- 172.21.15.8:0/1660062539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a540f77d0 msgr2=0x7f7a540f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:31.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.243+0000 7f7a58ce0700 1 --2- 172.21.15.8:0/1660062539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a540f77d0 0x7f7a540f7c30 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f7a48004660 tx=0x7f7a48009b30).stop 2023-10-18T22:08:31.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.243+0000 7f7a58ce0700 1 -- 172.21.15.8:0/1660062539 shutdown_connections 2023-10-18T22:08:31.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.243+0000 7f7a58ce0700 1 --2- 172.21.15.8:0/1660062539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a540f77d0 0x7f7a540f7c30 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.243+0000 7f7a58ce0700 1 --2- 172.21.15.8:0/1660062539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a540f6530 0x7f7a540f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.243+0000 7f7a58ce0700 1 -- 172.21.15.8:0/1660062539 >> 172.21.15.8:0/1660062539 conn(0x7f7a540f1c90 msgr2=0x7f7a540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:31.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.243+0000 7f7a58ce0700 1 -- 172.21.15.8:0/1660062539 shutdown_connections 2023-10-18T22:08:31.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.243+0000 7f7a58ce0700 1 -- 172.21.15.8:0/1660062539 wait complete. 2023-10-18T22:08:31.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.244+0000 7f7a58ce0700 1 Processor -- start 2023-10-18T22:08:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.244+0000 7f7a58ce0700 1 -- start start 2023-10-18T22:08:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a58ce0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a540f6530 0x7f7a5406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a58ce0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a540f77d0 0x7f7a54069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:31.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a58ce0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5406a380 con 0x7f7a540f77d0 2023-10-18T22:08:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a58ce0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5406a4c0 con 0x7f7a540f6530 2023-10-18T22:08:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a52ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a540f77d0 0x7f7a54069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a52ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a540f77d0 0x7f7a54069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59430/0 (socket says 172.21.15.8:59430) 2023-10-18T22:08:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a52ffd700 1 -- 172.21.15.8:0/715845151 learned_addr learned my addr 172.21.15.8:0/715845151 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:08:31.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a537fe700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a540f6530 0x7f7a5406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:31.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a52ffd700 1 -- 172.21.15.8:0/715845151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a540f6530 msgr2=0x7f7a5406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:31.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a52ffd700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a540f6530 0x7f7a5406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.245+0000 7f7a52ffd700 1 -- 172.21.15.8:0/715845151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a48005040 con 0x7f7a540f77d0 2023-10-18T22:08:31.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.246+0000 7f7a52ffd700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a540f77d0 0x7f7a54069e20 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f7a48009f50 tx=0x7f7a48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:31.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.246+0000 7f7a3bfff700 1 -- 172.21.15.8:0/715845151 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a48018070 con 0x7f7a540f77d0 2023-10-18T22:08:31.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.246+0000 7f7a3bfff700 1 -- 172.21.15.8:0/715845151 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7a48009630 con 0x7f7a540f77d0 2023-10-18T22:08:31.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.246+0000 7f7a3bfff700 1 -- 172.21.15.8:0/715845151 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4801c3c0 con 0x7f7a540f77d0 2023-10-18T22:08:31.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.246+0000 7f7a58ce0700 1 -- 172.21.15.8:0/715845151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5406a740 con 0x7f7a540f77d0 2023-10-18T22:08:31.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.246+0000 7f7a58ce0700 1 -- 172.21.15.8:0/715845151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5406aca0 con 0x7f7a540f77d0 2023-10-18T22:08:31.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.247+0000 7f7a58ce0700 1 -- 172.21.15.8:0/715845151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a54045ad0 con 0x7f7a540f77d0 2023-10-18T22:08:31.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.248+0000 7f7a3bfff700 1 -- 172.21.15.8:0/715845151 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7a4801d420 con 0x7f7a540f77d0 2023-10-18T22:08:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.249+0000 7f7a3bfff700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a3c060f70 0x7f7a3c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.249+0000 7f7a3bfff700 1 -- 172.21.15.8:0/715845151 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7a4807e500 con 0x7f7a540f77d0 2023-10-18T22:08:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.249+0000 7f7a537fe700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a3c060f70 0x7f7a3c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:31.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.250+0000 7f7a537fe700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a3c060f70 0x7f7a3c063430 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f7a5406b730 tx=0x7f7a4400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:31.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.253+0000 7f7a3bfff700 1 -- 172.21.15.8:0/715845151 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7a4804e170 con 0x7f7a540f77d0 2023-10-18T22:08:31.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.477+0000 7f7a58ce0700 1 -- 172.21.15.8:0/715845151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7a54027a00 con 0x7f7a540f77d0 2023-10-18T22:08:31.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.477+0000 7f7a3bfff700 1 -- 172.21.15.8:0/715845151 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f7a48051790 con 0x7f7a540f77d0 2023-10-18T22:08:31.480 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:08:31.480 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:08:31.480 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:08:31.480 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:08:31.481 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:08:31.481 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:08:31.481 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:08:31.482 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:08:31.482 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:08:31.482 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:08:31.482 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:08:31.483 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:08:31.483 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:08:31.483 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:08:31.483 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:08:31.483 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:08:31.484 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:08:31.484 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:08:31.484 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:08:31.484 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:08:31.484 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:08:31.485 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:08:31.485 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:08:31.485 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:08:31.485 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:08:31.485 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:08:31.486 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:08:31.486 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:08:31.486 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:08:31.486 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:08:31.486 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:08:31.487 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:08:31.487 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:08:31.487 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:08:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:29.993162+0000 mgr.smithi008.flmjzp (mgr.14640) 4172 : audit [DBG] from='client.37384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:30.191415+0000 mgr.smithi008.flmjzp (mgr.14640) 4173 : cluster [DBG] pgmap v2866: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:08:30.222982+0000 mgr.smithi008.flmjzp (mgr.14640) 4174 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:08:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:30.223440+0000 mgr.smithi008.flmjzp (mgr.14640) 4175 : cluster [DBG] pgmap v2867: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:30.223641+0000 mgr.smithi008.flmjzp (mgr.14640) 4176 : cluster [DBG] pgmap v2868: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:08:30.241576+0000 mgr.smithi008.flmjzp (mgr.14640) 4177 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:08:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:31.104564+0000 mon.smithi008 (mon.0) 4492 : audit [DBG] from='client.? 172.21.15.8:0/2028594795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:31.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.479+0000 7f7a58ce0700 1 -- 172.21.15.8:0/715845151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a3c060f70 msgr2=0x7f7a3c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:31.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.479+0000 7f7a58ce0700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a3c060f70 0x7f7a3c063430 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f7a5406b730 tx=0x7f7a4400b040).stop 2023-10-18T22:08:31.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.479+0000 7f7a58ce0700 1 -- 172.21.15.8:0/715845151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a540f77d0 msgr2=0x7f7a54069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:31.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.479+0000 7f7a58ce0700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a540f77d0 0x7f7a54069e20 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f7a48009f50 tx=0x7f7a48009b30).stop 2023-10-18T22:08:31.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.479+0000 7f7a58ce0700 1 -- 172.21.15.8:0/715845151 shutdown_connections 2023-10-18T22:08:31.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.479+0000 7f7a58ce0700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a3c060f70 0x7f7a3c063430 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.479+0000 7f7a58ce0700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a540f6530 0x7f7a5406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.479+0000 7f7a58ce0700 1 --2- 172.21.15.8:0/715845151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a540f77d0 0x7f7a54069e20 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.479+0000 7f7a58ce0700 1 -- 172.21.15.8:0/715845151 >> 172.21.15.8:0/715845151 conn(0x7f7a540f1c90 msgr2=0x7f7a540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:31.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.479+0000 7f7a58ce0700 1 -- 172.21.15.8:0/715845151 shutdown_connections 2023-10-18T22:08:31.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.480+0000 7f7a58ce0700 1 -- 172.21.15.8:0/715845151 wait complete. 2023-10-18T22:08:31.493 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:08:31.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.618+0000 7f2cce90b700 1 -- 172.21.15.8:0/1602908896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc80f6530 msgr2=0x7f2cc80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:31.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.618+0000 7f2cce90b700 1 --2- 172.21.15.8:0/1602908896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc80f6530 0x7f2cc80f6950 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f2cc4004660 tx=0x7f2cc4009b30).stop 2023-10-18T22:08:31.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.618+0000 7f2cce90b700 1 -- 172.21.15.8:0/1602908896 shutdown_connections 2023-10-18T22:08:31.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.618+0000 7f2cce90b700 1 --2- 172.21.15.8:0/1602908896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc80f77d0 0x7f2cc80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.618+0000 7f2cce90b700 1 --2- 172.21.15.8:0/1602908896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc80f6530 0x7f2cc80f6950 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.618+0000 7f2cce90b700 1 -- 172.21.15.8:0/1602908896 >> 172.21.15.8:0/1602908896 conn(0x7f2cc80f1cd0 msgr2=0x7f2cc80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:31.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.618+0000 7f2cce90b700 1 -- 172.21.15.8:0/1602908896 shutdown_connections 2023-10-18T22:08:31.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.618+0000 7f2cce90b700 1 -- 172.21.15.8:0/1602908896 wait complete. 2023-10-18T22:08:31.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.619+0000 7f2cce90b700 1 Processor -- start 2023-10-18T22:08:31.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.619+0000 7f2cce90b700 1 -- start start 2023-10-18T22:08:31.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.620+0000 7f2cce90b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc80f6530 0x7f2cc8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:31.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.620+0000 7f2cce90b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc80f77d0 0x7f2cc8109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:31.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.620+0000 7f2cce90b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8109a20 con 0x7f2cc80f77d0 2023-10-18T22:08:31.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.620+0000 7f2cce90b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8109b60 con 0x7f2cc80f6530 2023-10-18T22:08:31.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.620+0000 7f2ccd108700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc80f77d0 0x7f2cc8109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:31.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.620+0000 7f2ccd108700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc80f77d0 0x7f2cc8109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59446/0 (socket says 172.21.15.8:59446) 2023-10-18T22:08:31.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.620+0000 7f2ccd108700 1 -- 172.21.15.8:0/3188735027 learned_addr learned my addr 172.21.15.8:0/3188735027 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:08:31.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.620+0000 7f2ccd909700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc80f6530 0x7f2cc8108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:31.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.620+0000 7f2ccd108700 1 -- 172.21.15.8:0/3188735027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc80f6530 msgr2=0x7f2cc8108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:31.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.621+0000 7f2ccd108700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc80f6530 0x7f2cc8108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.621+0000 7f2ccd108700 1 -- 172.21.15.8:0/3188735027 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4005040 con 0x7f2cc80f77d0 2023-10-18T22:08:31.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.621+0000 7f2ccd108700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc80f77d0 0x7f2cc8109470 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f2cb80026d0 tx=0x7f2cb8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:31.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.621+0000 7f2cbe7fc700 1 -- 172.21.15.8:0/3188735027 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cb80079c0 con 0x7f2cc80f77d0 2023-10-18T22:08:31.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.621+0000 7f2cbe7fc700 1 -- 172.21.15.8:0/3188735027 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2cb800f040 con 0x7f2cc80f77d0 2023-10-18T22:08:31.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.621+0000 7f2cbe7fc700 1 -- 172.21.15.8:0/3188735027 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cb8014980 con 0x7f2cc80f77d0 2023-10-18T22:08:31.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.621+0000 7f2cce90b700 1 -- 172.21.15.8:0/3188735027 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc810a500 con 0x7f2cc80f77d0 2023-10-18T22:08:31.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.621+0000 7f2cce90b700 1 -- 172.21.15.8:0/3188735027 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc810aac0 con 0x7f2cc80f77d0 2023-10-18T22:08:31.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.622+0000 7f2cce90b700 1 -- 172.21.15.8:0/3188735027 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc8045ad0 con 0x7f2cc80f77d0 2023-10-18T22:08:31.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.623+0000 7f2cbe7fc700 1 -- 172.21.15.8:0/3188735027 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2cb80090d0 con 0x7f2cc80f77d0 2023-10-18T22:08:31.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.624+0000 7f2cbe7fc700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb4060f70 0x7f2cb4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:08:31.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.624+0000 7f2cbe7fc700 1 -- 172.21.15.8:0/3188735027 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2cb807c8a0 con 0x7f2cc80f77d0 2023-10-18T22:08:31.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.624+0000 7f2ccd909700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb4060f70 0x7f2cb4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:08:31.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.625+0000 7f2ccd909700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb4060f70 0x7f2cb4063430 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f2cc4004630 tx=0x7f2cc4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:08:31.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.628+0000 7f2cbe7fc700 1 -- 172.21.15.8:0/3188735027 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2cb804ffb0 con 0x7f2cc80f77d0 2023-10-18T22:08:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:29.993162+0000 mgr.smithi008.flmjzp (mgr.14640) 4172 : audit [DBG] from='client.37384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:30.191415+0000 mgr.smithi008.flmjzp (mgr.14640) 4173 : cluster [DBG] pgmap v2866: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:08:30.222982+0000 mgr.smithi008.flmjzp (mgr.14640) 4174 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:08:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:30.223440+0000 mgr.smithi008.flmjzp (mgr.14640) 4175 : cluster [DBG] pgmap v2867: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:30.223641+0000 mgr.smithi008.flmjzp (mgr.14640) 4176 : cluster [DBG] pgmap v2868: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:08:30.241576+0000 mgr.smithi008.flmjzp (mgr.14640) 4177 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:08:31.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:31.104564+0000 mon.smithi008 (mon.0) 4492 : audit [DBG] from='client.? 172.21.15.8:0/2028594795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:31.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.830+0000 7f2cce90b700 1 -- 172.21.15.8:0/3188735027 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cc80fee70 con 0x7f2cb4060f70 2023-10-18T22:08:31.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.831+0000 7f2cbe7fc700 1 -- 172.21.15.8:0/3188735027 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2cc4019040 con 0x7f2cb4060f70 2023-10-18T22:08:31.833 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:08:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:08:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:08:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:08:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:08:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:08:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:08:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:08:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:08:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:08:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:08:31.836 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:08:31.836 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:08:31.836 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:08:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 -- 172.21.15.8:0/3188735027 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb4060f70 msgr2=0x7f2cb4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb4060f70 0x7f2cb4063430 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f2cc4004630 tx=0x7f2cc4009b30).stop 2023-10-18T22:08:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 -- 172.21.15.8:0/3188735027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc80f77d0 msgr2=0x7f2cc8109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:08:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc80f77d0 0x7f2cc8109470 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f2cb80026d0 tx=0x7f2cb8009de0).stop 2023-10-18T22:08:31.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 -- 172.21.15.8:0/3188735027 shutdown_connections 2023-10-18T22:08:31.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb4060f70 0x7f2cb4063430 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc80f6530 0x7f2cc8108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 --2- 172.21.15.8:0/3188735027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc80f77d0 0x7f2cc8109470 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:08:31.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 -- 172.21.15.8:0/3188735027 >> 172.21.15.8:0/3188735027 conn(0x7f2cc80f1cd0 msgr2=0x7f2cc806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:08:31.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 -- 172.21.15.8:0/3188735027 shutdown_connections 2023-10-18T22:08:31.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:08:31.833+0000 7f2cce90b700 1 -- 172.21.15.8:0/3188735027 wait complete. 2023-10-18T22:08:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.351341+0000 mgr.smithi008.flmjzp (mgr.14640) 4178 : audit [DBG] from='client.37388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:30.692532+0000 mgr.smithi008.flmjzp (mgr.14640) 4179 : audit [DBG] from='client.37392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:31.478728+0000 mon.smithi008 (mon.0) 4493 : audit [DBG] from='client.? 172.21.15.8:0/715845151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:08:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.351341+0000 mgr.smithi008.flmjzp (mgr.14640) 4178 : audit [DBG] from='client.37388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:30.692532+0000 mgr.smithi008.flmjzp (mgr.14640) 4179 : audit [DBG] from='client.37392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:31.478728+0000 mon.smithi008 (mon.0) 4493 : audit [DBG] from='client.? 172.21.15.8:0/715845151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:08:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:31.832234+0000 mgr.smithi008.flmjzp (mgr.14640) 4180 : audit [DBG] from='client.37404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:32.224308+0000 mgr.smithi008.flmjzp (mgr.14640) 4181 : cluster [DBG] pgmap v2869: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:31.832234+0000 mgr.smithi008.flmjzp (mgr.14640) 4180 : audit [DBG] from='client.37404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:08:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:32.224308+0000 mgr.smithi008.flmjzp (mgr.14640) 4181 : cluster [DBG] pgmap v2869: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:34.224990+0000 mgr.smithi008.flmjzp (mgr.14640) 4182 : cluster [DBG] pgmap v2870: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:34.224990+0000 mgr.smithi008.flmjzp (mgr.14640) 4182 : cluster [DBG] pgmap v2870: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:36.225557+0000 mgr.smithi008.flmjzp (mgr.14640) 4183 : cluster [DBG] pgmap v2871: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:36.225557+0000 mgr.smithi008.flmjzp (mgr.14640) 4183 : cluster [DBG] pgmap v2871: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:38.226260+0000 mgr.smithi008.flmjzp (mgr.14640) 4184 : cluster [DBG] pgmap v2872: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:38.226260+0000 mgr.smithi008.flmjzp (mgr.14640) 4184 : cluster [DBG] pgmap v2872: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:40.252276+0000 mon.smithi008 (mon.0) 4494 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:40.254423+0000 mon.smithi008 (mon.0) 4495 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:08:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:40.255403+0000 mon.smithi008 (mon.0) 4496 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:08:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:40.262344+0000 mon.smithi008 (mon.0) 4497 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:40.268787+0000 mon.smithi008 (mon.0) 4498 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:40.271846+0000 mon.smithi008 (mon.0) 4499 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:40.273640+0000 mon.smithi008 (mon.0) 4500 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:40.275238+0000 mon.smithi008 (mon.0) 4501 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:40.277329+0000 mon.smithi008 (mon.0) 4502 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:40.252276+0000 mon.smithi008 (mon.0) 4494 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:40.254423+0000 mon.smithi008 (mon.0) 4495 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:08:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:40.255403+0000 mon.smithi008 (mon.0) 4496 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:08:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:40.262344+0000 mon.smithi008 (mon.0) 4497 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:40.268787+0000 mon.smithi008 (mon.0) 4498 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:40.271846+0000 mon.smithi008 (mon.0) 4499 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:40.273640+0000 mon.smithi008 (mon.0) 4500 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:40.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:40.275238+0000 mon.smithi008 (mon.0) 4501 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:40.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:40.277329+0000 mon.smithi008 (mon.0) 4502 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:40.226825+0000 mgr.smithi008.flmjzp (mgr.14640) 4185 : cluster [DBG] pgmap v2873: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:08:40.256266+0000 mgr.smithi008.flmjzp (mgr.14640) 4186 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:08:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:40.256892+0000 mgr.smithi008.flmjzp (mgr.14640) 4187 : cluster [DBG] pgmap v2874: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:40.257222+0000 mgr.smithi008.flmjzp (mgr.14640) 4188 : cluster [DBG] pgmap v2875: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:08:40.279248+0000 mgr.smithi008.flmjzp (mgr.14640) 4189 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:08:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:40.226825+0000 mgr.smithi008.flmjzp (mgr.14640) 4185 : cluster [DBG] pgmap v2873: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:08:40.256266+0000 mgr.smithi008.flmjzp (mgr.14640) 4186 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:08:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:40.256892+0000 mgr.smithi008.flmjzp (mgr.14640) 4187 : cluster [DBG] pgmap v2874: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:40.257222+0000 mgr.smithi008.flmjzp (mgr.14640) 4188 : cluster [DBG] pgmap v2875: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:08:40.279248+0000 mgr.smithi008.flmjzp (mgr.14640) 4189 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:08:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:42.257924+0000 mgr.smithi008.flmjzp (mgr.14640) 4190 : cluster [DBG] pgmap v2876: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:42.257924+0000 mgr.smithi008.flmjzp (mgr.14640) 4190 : cluster [DBG] pgmap v2876: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:44.258445+0000 mgr.smithi008.flmjzp (mgr.14640) 4191 : cluster [DBG] pgmap v2877: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:44.258445+0000 mgr.smithi008.flmjzp (mgr.14640) 4191 : cluster [DBG] pgmap v2877: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:47.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:46.259133+0000 mgr.smithi008.flmjzp (mgr.14640) 4192 : cluster [DBG] pgmap v2878: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:46.259133+0000 mgr.smithi008.flmjzp (mgr.14640) 4192 : cluster [DBG] pgmap v2878: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:48.259724+0000 mgr.smithi008.flmjzp (mgr.14640) 4193 : cluster [DBG] pgmap v2879: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:48.259724+0000 mgr.smithi008.flmjzp (mgr.14640) 4193 : cluster [DBG] pgmap v2879: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:50.289907+0000 mon.smithi008 (mon.0) 4503 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:50.289907+0000 mon.smithi008 (mon.0) 4503 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:50.260241+0000 mgr.smithi008.flmjzp (mgr.14640) 4194 : cluster [DBG] pgmap v2880: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:50.850773+0000 mon.smithi008 (mon.0) 4504 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:08:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:50.851564+0000 mon.smithi008 (mon.0) 4505 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:08:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:50.856948+0000 mon.smithi008 (mon.0) 4506 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:50.862752+0000 mon.smithi008 (mon.0) 4507 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:50.865150+0000 mon.smithi008 (mon.0) 4508 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:50.866344+0000 mon.smithi008 (mon.0) 4509 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:51.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:50.867581+0000 mon.smithi008 (mon.0) 4510 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:51.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:08:50.869069+0000 mon.smithi008 (mon.0) 4511 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:50.260241+0000 mgr.smithi008.flmjzp (mgr.14640) 4194 : cluster [DBG] pgmap v2880: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:50.850773+0000 mon.smithi008 (mon.0) 4504 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:08:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:50.851564+0000 mon.smithi008 (mon.0) 4505 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:08:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:50.856948+0000 mon.smithi008 (mon.0) 4506 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:08:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:50.862752+0000 mon.smithi008 (mon.0) 4507 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:08:51.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:50.865150+0000 mon.smithi008 (mon.0) 4508 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:51.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:50.866344+0000 mon.smithi008 (mon.0) 4509 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:51.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:50.867581+0000 mon.smithi008 (mon.0) 4510 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:51.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:08:50.869069+0000 mon.smithi008 (mon.0) 4511 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:08:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:08:50.852187+0000 mgr.smithi008.flmjzp (mgr.14640) 4195 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:08:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:50.852725+0000 mgr.smithi008.flmjzp (mgr.14640) 4196 : cluster [DBG] pgmap v2881: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:50.852992+0000 mgr.smithi008.flmjzp (mgr.14640) 4197 : cluster [DBG] pgmap v2882: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:08:50.870692+0000 mgr.smithi008.flmjzp (mgr.14640) 4198 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:08:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:08:50.852187+0000 mgr.smithi008.flmjzp (mgr.14640) 4195 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:08:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:50.852725+0000 mgr.smithi008.flmjzp (mgr.14640) 4196 : cluster [DBG] pgmap v2881: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:50.852992+0000 mgr.smithi008.flmjzp (mgr.14640) 4197 : cluster [DBG] pgmap v2882: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:08:50.870692+0000 mgr.smithi008.flmjzp (mgr.14640) 4198 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:08:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:52.853543+0000 mgr.smithi008.flmjzp (mgr.14640) 4199 : cluster [DBG] pgmap v2883: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:52.853543+0000 mgr.smithi008.flmjzp (mgr.14640) 4199 : cluster [DBG] pgmap v2883: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:54.854059+0000 mgr.smithi008.flmjzp (mgr.14640) 4200 : cluster [DBG] pgmap v2884: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:54.854059+0000 mgr.smithi008.flmjzp (mgr.14640) 4200 : cluster [DBG] pgmap v2884: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:08:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:56.854759+0000 mgr.smithi008.flmjzp (mgr.14640) 4201 : cluster [DBG] pgmap v2885: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:08:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:08:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:56.854759+0000 mgr.smithi008.flmjzp (mgr.14640) 4201 : cluster [DBG] pgmap v2885: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:08:58.855387+0000 mgr.smithi008.flmjzp (mgr.14640) 4202 : cluster [DBG] pgmap v2886: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:08:58.855387+0000 mgr.smithi008.flmjzp (mgr.14640) 4202 : cluster [DBG] pgmap v2886: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:00.878090+0000 mon.smithi008 (mon.0) 4512 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:00.879984+0000 mon.smithi008 (mon.0) 4513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:00.880879+0000 mon.smithi008 (mon.0) 4514 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:00.886895+0000 mon.smithi008 (mon.0) 4515 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:00.892814+0000 mon.smithi008 (mon.0) 4516 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:00.895667+0000 mon.smithi008 (mon.0) 4517 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:00.897192+0000 mon.smithi008 (mon.0) 4518 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:00.898642+0000 mon.smithi008 (mon.0) 4519 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:00.900499+0000 mon.smithi008 (mon.0) 4520 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:00.878090+0000 mon.smithi008 (mon.0) 4512 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:00.879984+0000 mon.smithi008 (mon.0) 4513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:00.880879+0000 mon.smithi008 (mon.0) 4514 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:00.886895+0000 mon.smithi008 (mon.0) 4515 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:00.892814+0000 mon.smithi008 (mon.0) 4516 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:00.895667+0000 mon.smithi008 (mon.0) 4517 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:00.897192+0000 mon.smithi008 (mon.0) 4518 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:00.898642+0000 mon.smithi008 (mon.0) 4519 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:00.900499+0000 mon.smithi008 (mon.0) 4520 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.987+0000 7f7a8b380700 1 -- 172.21.15.8:0/1734799366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a840f8740 msgr2=0x7f7a840f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.987+0000 7f7a8b380700 1 --2- 172.21.15.8:0/1734799366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a840f8740 0x7f7a840f8b60 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f7a80004660 tx=0x7f7a80009b30).stop 2023-10-18T22:09:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.987+0000 7f7a8b380700 1 -- 172.21.15.8:0/1734799366 shutdown_connections 2023-10-18T22:09:01.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.987+0000 7f7a8b380700 1 --2- 172.21.15.8:0/1734799366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a840f99e0 0x7f7a840f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:01.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.987+0000 7f7a8b380700 1 --2- 172.21.15.8:0/1734799366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a840f8740 0x7f7a840f8b60 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:01.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.987+0000 7f7a8b380700 1 -- 172.21.15.8:0/1734799366 >> 172.21.15.8:0/1734799366 conn(0x7f7a840f40e0 msgr2=0x7f7a840f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:01.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.988+0000 7f7a8b380700 1 -- 172.21.15.8:0/1734799366 shutdown_connections 2023-10-18T22:09:01.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.988+0000 7f7a8b380700 1 -- 172.21.15.8:0/1734799366 wait complete. 2023-10-18T22:09:01.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.988+0000 7f7a8b380700 1 Processor -- start 2023-10-18T22:09:01.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.989+0000 7f7a8b380700 1 -- start start 2023-10-18T22:09:01.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.989+0000 7f7a8b380700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a840f8740 0x7f7a84108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:01.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.989+0000 7f7a8b380700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a840f99e0 0x7f7a841093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:01.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.989+0000 7f7a8b380700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a84109970 con 0x7f7a840f99e0 2023-10-18T22:09:01.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.989+0000 7f7a8b380700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a84109ab0 con 0x7f7a840f8740 2023-10-18T22:09:01.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.989+0000 7f7a89b7d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a840f99e0 0x7f7a841093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:01.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.989+0000 7f7a89b7d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a840f99e0 0x7f7a841093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60924/0 (socket says 172.21.15.8:60924) 2023-10-18T22:09:01.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.989+0000 7f7a89b7d700 1 -- 172.21.15.8:0/2961291322 learned_addr learned my addr 172.21.15.8:0/2961291322 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:01.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.990+0000 7f7a8a37e700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a840f8740 0x7f7a84108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:01.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.990+0000 7f7a89b7d700 1 -- 172.21.15.8:0/2961291322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a840f8740 msgr2=0x7f7a84108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:01.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.990+0000 7f7a89b7d700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a840f8740 0x7f7a84108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:01.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.990+0000 7f7a89b7d700 1 -- 172.21.15.8:0/2961291322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80005040 con 0x7f7a840f99e0 2023-10-18T22:09:01.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.990+0000 7f7a89b7d700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a840f99e0 0x7f7a841093c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f7a7400e7f0 tx=0x7f7a7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:01.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.990+0000 7f7a7affd700 1 -- 172.21.15.8:0/2961291322 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a740092e0 con 0x7f7a840f99e0 2023-10-18T22:09:01.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.990+0000 7f7a8b380700 1 -- 172.21.15.8:0/2961291322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8410a450 con 0x7f7a840f99e0 2023-10-18T22:09:01.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.990+0000 7f7a7affd700 1 -- 172.21.15.8:0/2961291322 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7a7400f040 con 0x7f7a840f99e0 2023-10-18T22:09:01.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.991+0000 7f7a7affd700 1 -- 172.21.15.8:0/2961291322 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a740147e0 con 0x7f7a840f99e0 2023-10-18T22:09:01.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.991+0000 7f7a8b380700 1 -- 172.21.15.8:0/2961291322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8410a990 con 0x7f7a840f99e0 2023-10-18T22:09:01.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.992+0000 7f7a8b380700 1 -- 172.21.15.8:0/2961291322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a84045ad0 con 0x7f7a840f99e0 2023-10-18T22:09:01.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.992+0000 7f7a7affd700 1 -- 172.21.15.8:0/2961291322 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7a7401b030 con 0x7f7a840f99e0 2023-10-18T22:09:01.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.993+0000 7f7a7affd700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a70060f70 0x7f7a70063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:01.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.993+0000 7f7a7affd700 1 -- 172.21.15.8:0/2961291322 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7a7407c700 con 0x7f7a840f99e0 2023-10-18T22:09:01.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.994+0000 7f7a8a37e700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a70060f70 0x7f7a70063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:01.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.994+0000 7f7a8a37e700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a70060f70 0x7f7a70063430 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f7a80009720 tx=0x7f7a80016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:02.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:01.998+0000 7f7a7affd700 1 -- 172.21.15.8:0/2961291322 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7a7404fe50 con 0x7f7a840f99e0 2023-10-18T22:09:02.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.198+0000 7f7a8b380700 1 -- 172.21.15.8:0/2961291322 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a8410abb0 con 0x7f7a70060f70 2023-10-18T22:09:02.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.200+0000 7f7a7affd700 1 -- 172.21.15.8:0/2961291322 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7a8410abb0 con 0x7f7a70060f70 2023-10-18T22:09:02.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 -- 172.21.15.8:0/2961291322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a70060f70 msgr2=0x7f7a70063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:02.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a70060f70 0x7f7a70063430 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f7a80009720 tx=0x7f7a80016040).stop 2023-10-18T22:09:02.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 -- 172.21.15.8:0/2961291322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a840f99e0 msgr2=0x7f7a841093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a840f99e0 0x7f7a841093c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f7a7400e7f0 tx=0x7f7a7400b040).stop 2023-10-18T22:09:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 -- 172.21.15.8:0/2961291322 shutdown_connections 2023-10-18T22:09:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7a70060f70 0x7f7a70063430 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a840f8740 0x7f7a84108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 --2- 172.21.15.8:0/2961291322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a840f99e0 0x7f7a841093c0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 -- 172.21.15.8:0/2961291322 >> 172.21.15.8:0/2961291322 conn(0x7f7a840f40e0 msgr2=0x7f7a840fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 -- 172.21.15.8:0/2961291322 shutdown_connections 2023-10-18T22:09:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.202+0000 7f7a8b380700 1 -- 172.21.15.8:0/2961291322 wait complete. 2023-10-18T22:09:02.219 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:09:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.340+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/2319891788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00f77d0 msgr2=0x7f6cc00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.340+0000 7f6cc5c5d700 1 --2- 172.21.15.8:0/2319891788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00f77d0 0x7f6cc00f7c30 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f6cac004660 tx=0x7f6cac009b30).stop 2023-10-18T22:09:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.340+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/2319891788 shutdown_connections 2023-10-18T22:09:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.340+0000 7f6cc5c5d700 1 --2- 172.21.15.8:0/2319891788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00f77d0 0x7f6cc00f7c30 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.340+0000 7f6cc5c5d700 1 --2- 172.21.15.8:0/2319891788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cc00f6530 0x7f6cc00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.340+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/2319891788 >> 172.21.15.8:0/2319891788 conn(0x7f6cc00f1c90 msgr2=0x7f6cc00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.340+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/2319891788 shutdown_connections 2023-10-18T22:09:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.340+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/2319891788 wait complete. 2023-10-18T22:09:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.341+0000 7f6cc5c5d700 1 Processor -- start 2023-10-18T22:09:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.341+0000 7f6cc5c5d700 1 -- start start 2023-10-18T22:09:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.342+0000 7f6cc5c5d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00f6530 0x7f6cc0108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.342+0000 7f6cc5c5d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cc00f77d0 0x7f6cc01093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.342+0000 7f6cc5c5d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc0109970 con 0x7f6cc00f6530 2023-10-18T22:09:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.342+0000 7f6cc5c5d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc0109ab0 con 0x7f6cc00f77d0 2023-10-18T22:09:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.342+0000 7f6cc4c5b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00f6530 0x7f6cc0108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.342+0000 7f6cc4c5b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00f6530 0x7f6cc0108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60954/0 (socket says 172.21.15.8:60954) 2023-10-18T22:09:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.342+0000 7f6cc4c5b700 1 -- 172.21.15.8:0/3425820302 learned_addr learned my addr 172.21.15.8:0/3425820302 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.342+0000 7f6cbffff700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cc00f77d0 0x7f6cc01093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.343+0000 7f6cc4c5b700 1 -- 172.21.15.8:0/3425820302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cc00f77d0 msgr2=0x7f6cc01093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.343+0000 7f6cc4c5b700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cc00f77d0 0x7f6cc01093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.343+0000 7f6cc4c5b700 1 -- 172.21.15.8:0/3425820302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac005040 con 0x7f6cc00f6530 2023-10-18T22:09:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.343+0000 7f6cc4c5b700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00f6530 0x7f6cc0108ed0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f6cb400e7c0 tx=0x7f6cb400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.343+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/3425820302 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb40092e0 con 0x7f6cc00f6530 2023-10-18T22:09:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.343+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/3425820302 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6cb400f040 con 0x7f6cc00f6530 2023-10-18T22:09:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.343+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/3425820302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc010a450 con 0x7f6cc00f6530 2023-10-18T22:09:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.343+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/3425820302 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb40147e0 con 0x7f6cc00f6530 2023-10-18T22:09:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.343+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/3425820302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc010a990 con 0x7f6cc00f6530 2023-10-18T22:09:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.345+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/3425820302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc0045ad0 con 0x7f6cc00f6530 2023-10-18T22:09:02.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.345+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/3425820302 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6cb401b030 con 0x7f6cc00f6530 2023-10-18T22:09:02.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.346+0000 7f6cbd7fa700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6cb0060f70 0x7f6cb0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:02.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.346+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/3425820302 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6cb407c9b0 con 0x7f6cc00f6530 2023-10-18T22:09:02.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.346+0000 7f6cbffff700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6cb0060f70 0x7f6cb0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:02.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.347+0000 7f6cbffff700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6cb0060f70 0x7f6cb0063430 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f6cac009720 tx=0x7f6cac00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:02.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.350+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/3425820302 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6cb4050050 con 0x7f6cc00f6530 2023-10-18T22:09:02.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.549+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/3425820302 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cc010abb0 con 0x7f6cb0060f70 2023-10-18T22:09:02.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.550+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/3425820302 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6cc010abb0 con 0x7f6cb0060f70 2023-10-18T22:09:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.552+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/3425820302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6cb0060f70 msgr2=0x7f6cb0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.552+0000 7f6cc5c5d700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6cb0060f70 0x7f6cb0063430 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f6cac009720 tx=0x7f6cac00b040).stop 2023-10-18T22:09:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.552+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/3425820302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00f6530 msgr2=0x7f6cc0108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:02.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.552+0000 7f6cc5c5d700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00f6530 0x7f6cc0108ed0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f6cb400e7c0 tx=0x7f6cb400b040).stop 2023-10-18T22:09:02.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.552+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/3425820302 shutdown_connections 2023-10-18T22:09:02.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.552+0000 7f6cc5c5d700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6cb0060f70 0x7f6cb0063430 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.552+0000 7f6cc5c5d700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00f6530 0x7f6cc0108ed0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.552+0000 7f6cc5c5d700 1 --2- 172.21.15.8:0/3425820302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cc00f77d0 0x7f6cc01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.552+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/3425820302 >> 172.21.15.8:0/3425820302 conn(0x7f6cc00f1c90 msgr2=0x7f6cc00f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:02.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.553+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/3425820302 shutdown_connections 2023-10-18T22:09:02.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.553+0000 7f6cc5c5d700 1 -- 172.21.15.8:0/3425820302 wait complete. 2023-10-18T22:09:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:00.855969+0000 mgr.smithi008.flmjzp (mgr.14640) 4203 : cluster [DBG] pgmap v2887: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:00.881686+0000 mgr.smithi008.flmjzp (mgr.14640) 4204 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:00.882205+0000 mgr.smithi008.flmjzp (mgr.14640) 4205 : cluster [DBG] pgmap v2888: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:00.882511+0000 mgr.smithi008.flmjzp (mgr.14640) 4206 : cluster [DBG] pgmap v2889: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:00.902301+0000 mgr.smithi008.flmjzp (mgr.14640) 4207 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:02.201125+0000 mgr.smithi008.flmjzp (mgr.14640) 4208 : audit [DBG] from='client.37408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.689+0000 7ff591430700 1 -- 172.21.15.8:0/2855657808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff58c0f6530 msgr2=0x7ff58c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:02.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.689+0000 7ff591430700 1 --2- 172.21.15.8:0/2855657808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff58c0f6530 0x7ff58c0f6950 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7ff57c004660 tx=0x7ff57c009b30).stop 2023-10-18T22:09:02.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.689+0000 7ff591430700 1 -- 172.21.15.8:0/2855657808 shutdown_connections 2023-10-18T22:09:02.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.689+0000 7ff591430700 1 --2- 172.21.15.8:0/2855657808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff58c0f77d0 0x7ff58c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.689+0000 7ff591430700 1 --2- 172.21.15.8:0/2855657808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff58c0f6530 0x7ff58c0f6950 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.689+0000 7ff591430700 1 -- 172.21.15.8:0/2855657808 >> 172.21.15.8:0/2855657808 conn(0x7ff58c0f1c90 msgr2=0x7ff58c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:02.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.689+0000 7ff591430700 1 -- 172.21.15.8:0/2855657808 shutdown_connections 2023-10-18T22:09:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.689+0000 7ff591430700 1 -- 172.21.15.8:0/2855657808 wait complete. 2023-10-18T22:09:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.690+0000 7ff591430700 1 Processor -- start 2023-10-18T22:09:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.690+0000 7ff591430700 1 -- start start 2023-10-18T22:09:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.690+0000 7ff591430700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff58c0f6530 0x7ff58c108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.690+0000 7ff591430700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff58c0f77d0 0x7ff58c109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.690+0000 7ff591430700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c109a00 con 0x7ff58c0f6530 2023-10-18T22:09:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.690+0000 7ff591430700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c109b40 con 0x7ff58c0f77d0 2023-10-18T22:09:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.691+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff58c0f6530 0x7ff58c108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.691+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff58c0f6530 0x7ff58c108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60968/0 (socket says 172.21.15.8:60968) 2023-10-18T22:09:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.691+0000 7ff58bfff700 1 -- 172.21.15.8:0/1248529156 learned_addr learned my addr 172.21.15.8:0/1248529156 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.691+0000 7ff58bfff700 1 -- 172.21.15.8:0/1248529156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff58c0f77d0 msgr2=0x7ff58c109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.691+0000 7ff58bfff700 1 --2- 172.21.15.8:0/1248529156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff58c0f77d0 0x7ff58c109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:09:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.691+0000 7ff58bfff700 1 -- 172.21.15.8:0/1248529156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c005040 con 0x7ff58c0f6530 2023-10-18T22:09:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.691+0000 7ff58bfff700 1 --2- 172.21.15.8:0/1248529156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff58c0f6530 0x7ff58c108f60 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7ff57c014040 tx=0x7ff57c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.691+0000 7ff588ff9700 1 -- 172.21.15.8:0/1248529156 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff57c019070 con 0x7ff58c0f6530 2023-10-18T22:09:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.692+0000 7ff588ff9700 1 -- 172.21.15.8:0/1248529156 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff57c01e420 con 0x7ff58c0f6530 2023-10-18T22:09:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.692+0000 7ff591430700 1 -- 172.21.15.8:0/1248529156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c10a480 con 0x7ff58c0f6530 2023-10-18T22:09:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.692+0000 7ff588ff9700 1 -- 172.21.15.8:0/1248529156 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff57c014660 con 0x7ff58c0f6530 2023-10-18T22:09:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.692+0000 7ff591430700 1 -- 172.21.15.8:0/1248529156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c10a960 con 0x7ff58c0f6530 2023-10-18T22:09:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.693+0000 7ff591430700 1 -- 172.21.15.8:0/1248529156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58c045ad0 con 0x7ff58c0f6530 2023-10-18T22:09:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.694+0000 7ff588ff9700 1 -- 172.21.15.8:0/1248529156 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff57c01e9e0 con 0x7ff58c0f6530 2023-10-18T22:09:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.694+0000 7ff588ff9700 1 --2- 172.21.15.8:0/1248529156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff574060f70 0x7ff574063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.695+0000 7ff588ff9700 1 -- 172.21.15.8:0/1248529156 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff57c07ddc0 con 0x7ff58c0f6530 2023-10-18T22:09:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.695+0000 7ff58b7fe700 1 --2- 172.21.15.8:0/1248529156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff574060f70 0x7ff574063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.695+0000 7ff58b7fe700 1 --2- 172.21.15.8:0/1248529156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff574060f70 0x7ff574063430 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7ff580004b70 tx=0x7ff58000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:02.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.699+0000 7ff588ff9700 1 -- 172.21.15.8:0/1248529156 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff57c081030 con 0x7ff58c0f6530 2023-10-18T22:09:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:00.855969+0000 mgr.smithi008.flmjzp (mgr.14640) 4203 : cluster [DBG] pgmap v2887: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:00.881686+0000 mgr.smithi008.flmjzp (mgr.14640) 4204 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:00.882205+0000 mgr.smithi008.flmjzp (mgr.14640) 4205 : cluster [DBG] pgmap v2888: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:00.882511+0000 mgr.smithi008.flmjzp (mgr.14640) 4206 : cluster [DBG] pgmap v2889: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:00.902301+0000 mgr.smithi008.flmjzp (mgr.14640) 4207 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:02.201125+0000 mgr.smithi008.flmjzp (mgr.14640) 4208 : audit [DBG] from='client.37408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:02.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.892+0000 7ff591430700 1 -- 172.21.15.8:0/1248529156 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff58c10ac40 con 0x7ff574060f70 2023-10-18T22:09:02.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.902+0000 7ff588ff9700 1 -- 172.21.15.8:0/1248529156 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff58c10ac40 con 0x7ff574060f70 2023-10-18T22:09:02.904 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:09:02.904 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (75m) 2m ago 77m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:09:02.905 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (69m) 2m ago 77m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:09:02.905 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (69m) 53s ago 76m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:09:02.905 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (75m) 2m ago 76m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:09:02.905 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 73m - - 2023-10-18T22:09:02.905 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 73m - - 2023-10-18T22:09:02.905 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 53s ago 73m - - 2023-10-18T22:09:02.906 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 53s ago 73m - - 2023-10-18T22:09:02.906 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (70m) 2m ago 78m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:09:02.906 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (70m) 53s ago 76m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:09:02.906 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (70m) 2m ago 78m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:09:02.906 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (69m) 53s ago 76m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:09:02.907 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (76m) 2m ago 76m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:09:02.907 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (75m) 53s ago 75m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:09:02.907 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (69m) 2m ago 75m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:09:02.907 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (67m) 2m ago 75m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:09:02.907 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (66m) 2m ago 75m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:09:02.907 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (66m) 53s ago 74m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:09:02.908 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (65m) 53s ago 74m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:09:02.908 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (65m) 53s ago 74m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:09:02.908 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (71m) 2m ago 76m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:09:02.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 -- 172.21.15.8:0/1248529156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff574060f70 msgr2=0x7ff574063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:02.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 --2- 172.21.15.8:0/1248529156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff574060f70 0x7ff574063430 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7ff580004b70 tx=0x7ff58000b040).stop 2023-10-18T22:09:02.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 -- 172.21.15.8:0/1248529156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff58c0f6530 msgr2=0x7ff58c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:02.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 --2- 172.21.15.8:0/1248529156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff58c0f6530 0x7ff58c108f60 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7ff57c014040 tx=0x7ff57c00b040).stop 2023-10-18T22:09:02.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 -- 172.21.15.8:0/1248529156 shutdown_connections 2023-10-18T22:09:02.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 --2- 172.21.15.8:0/1248529156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff574060f70 0x7ff574063430 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 --2- 172.21.15.8:0/1248529156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff58c0f6530 0x7ff58c108f60 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:02.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 --2- 172.21.15.8:0/1248529156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff58c0f77d0 0x7ff58c109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:09:02.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 -- 172.21.15.8:0/1248529156 >> 172.21.15.8:0/1248529156 conn(0x7ff58c0f1c90 msgr2=0x7ff58c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:02.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 -- 172.21.15.8:0/1248529156 shutdown_connections 2023-10-18T22:09:02.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:02.904+0000 7ff591430700 1 -- 172.21.15.8:0/1248529156 wait complete. 2023-10-18T22:09:03.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.039+0000 7f926a36c700 1 -- 172.21.15.8:0/4261543422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92640f77d0 msgr2=0x7f92640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:03.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.039+0000 7f926a36c700 1 --2- 172.21.15.8:0/4261543422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92640f77d0 0x7f92640f7c30 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f9254004660 tx=0x7f9254009b30).stop 2023-10-18T22:09:03.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.039+0000 7f926a36c700 1 -- 172.21.15.8:0/4261543422 shutdown_connections 2023-10-18T22:09:03.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.039+0000 7f926a36c700 1 --2- 172.21.15.8:0/4261543422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92640f77d0 0x7f92640f7c30 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.039+0000 7f926a36c700 1 --2- 172.21.15.8:0/4261543422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92640f6530 0x7f92640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.039+0000 7f926a36c700 1 -- 172.21.15.8:0/4261543422 >> 172.21.15.8:0/4261543422 conn(0x7f92640f1c90 msgr2=0x7f92640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:03.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.039+0000 7f926a36c700 1 -- 172.21.15.8:0/4261543422 shutdown_connections 2023-10-18T22:09:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.039+0000 7f926a36c700 1 -- 172.21.15.8:0/4261543422 wait complete. 2023-10-18T22:09:03.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.040+0000 7f926a36c700 1 Processor -- start 2023-10-18T22:09:03.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.040+0000 7f926a36c700 1 -- start start 2023-10-18T22:09:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.040+0000 7f926a36c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92640f6530 0x7f9264108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.040+0000 7f926a36c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92640f77d0 0x7f92641093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.040+0000 7f926a36c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9264109970 con 0x7f92640f77d0 2023-10-18T22:09:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.040+0000 7f926a36c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9264109ab0 con 0x7f92640f6530 2023-10-18T22:09:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.040+0000 7f9268b69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92640f77d0 0x7f92641093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f9268b69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92640f77d0 0x7f92641093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60988/0 (socket says 172.21.15.8:60988) 2023-10-18T22:09:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f9268b69700 1 -- 172.21.15.8:0/2446407349 learned_addr learned my addr 172.21.15.8:0/2446407349 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f926936a700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92640f6530 0x7f9264108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f9268b69700 1 -- 172.21.15.8:0/2446407349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92640f6530 msgr2=0x7f9264108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f9268b69700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92640f6530 0x7f9264108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f9268b69700 1 -- 172.21.15.8:0/2446407349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254005040 con 0x7f92640f77d0 2023-10-18T22:09:03.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f9268b69700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92640f77d0 0x7f92641093c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f9254009990 tx=0x7f9254009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:03.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f9259ffb700 1 -- 172.21.15.8:0/2446407349 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9254018070 con 0x7f92640f77d0 2023-10-18T22:09:03.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f9259ffb700 1 -- 172.21.15.8:0/2446407349 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9254009630 con 0x7f92640f77d0 2023-10-18T22:09:03.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f9259ffb700 1 -- 172.21.15.8:0/2446407349 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f925401c3c0 con 0x7f92640f77d0 2023-10-18T22:09:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.041+0000 7f926a36c700 1 -- 172.21.15.8:0/2446407349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926410a3f0 con 0x7f92640f77d0 2023-10-18T22:09:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.042+0000 7f926a36c700 1 -- 172.21.15.8:0/2446407349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926410a950 con 0x7f92640f77d0 2023-10-18T22:09:03.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.043+0000 7f926a36c700 1 -- 172.21.15.8:0/2446407349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9264045ad0 con 0x7f92640f77d0 2023-10-18T22:09:03.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.043+0000 7f9259ffb700 1 -- 172.21.15.8:0/2446407349 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f925401d970 con 0x7f92640f77d0 2023-10-18T22:09:03.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.045+0000 7f9259ffb700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9250060f70 0x7f9250063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:03.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.045+0000 7f9259ffb700 1 -- 172.21.15.8:0/2446407349 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f925407e580 con 0x7f92640f77d0 2023-10-18T22:09:03.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.045+0000 7f926936a700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9250060f70 0x7f9250063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:03.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.045+0000 7f926936a700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9250060f70 0x7f9250063430 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f92640f7630 tx=0x7f926000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:03.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.048+0000 7f9259ffb700 1 -- 172.21.15.8:0/2446407349 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9254051be0 con 0x7f92640f77d0 2023-10-18T22:09:03.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.298+0000 7f926a36c700 1 -- 172.21.15.8:0/2446407349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f92640fedc0 con 0x7f92640f77d0 2023-10-18T22:09:03.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.299+0000 7f9259ffb700 1 -- 172.21.15.8:0/2446407349 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f92540097a0 con 0x7f92640f77d0 2023-10-18T22:09:03.302 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:09:03.302 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:09:03.303 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:09:03.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:09:03.303 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:09:03.303 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:09:03.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:09:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:09:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:09:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:09:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:09:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:09:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:09:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:09:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:09:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:09:03.305 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:09:03.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.300+0000 7f926a36c700 1 -- 172.21.15.8:0/2446407349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9250060f70 msgr2=0x7f9250063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:03.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.300+0000 7f926a36c700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9250060f70 0x7f9250063430 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f92640f7630 tx=0x7f926000b040).stop 2023-10-18T22:09:03.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.300+0000 7f926a36c700 1 -- 172.21.15.8:0/2446407349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92640f77d0 msgr2=0x7f92641093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:03.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.300+0000 7f926a36c700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92640f77d0 0x7f92641093c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f9254009990 tx=0x7f9254009b30).stop 2023-10-18T22:09:03.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.301+0000 7f926a36c700 1 -- 172.21.15.8:0/2446407349 shutdown_connections 2023-10-18T22:09:03.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.301+0000 7f926a36c700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9250060f70 0x7f9250063430 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.301+0000 7f926a36c700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92640f6530 0x7f9264108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.301+0000 7f926a36c700 1 --2- 172.21.15.8:0/2446407349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92640f77d0 0x7f92641093c0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.301+0000 7f926a36c700 1 -- 172.21.15.8:0/2446407349 >> 172.21.15.8:0/2446407349 conn(0x7f92640f1c90 msgr2=0x7f926406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:03.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.301+0000 7f926a36c700 1 -- 172.21.15.8:0/2446407349 shutdown_connections 2023-10-18T22:09:03.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.301+0000 7f926a36c700 1 -- 172.21.15.8:0/2446407349 wait complete. 2023-10-18T22:09:03.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.438+0000 7fdcad318700 1 -- 172.21.15.8:0/4214951585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdca80f6530 msgr2=0x7fdca80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:03.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.438+0000 7fdcad318700 1 --2- 172.21.15.8:0/4214951585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdca80f6530 0x7fdca80f6950 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7fdc98004660 tx=0x7fdc98009b30).stop 2023-10-18T22:09:03.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.438+0000 7fdcad318700 1 -- 172.21.15.8:0/4214951585 shutdown_connections 2023-10-18T22:09:03.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.438+0000 7fdcad318700 1 --2- 172.21.15.8:0/4214951585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca80f77d0 0x7fdca80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.438+0000 7fdcad318700 1 --2- 172.21.15.8:0/4214951585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdca80f6530 0x7fdca80f6950 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.438+0000 7fdcad318700 1 -- 172.21.15.8:0/4214951585 >> 172.21.15.8:0/4214951585 conn(0x7fdca80f1c90 msgr2=0x7fdca80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:03.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.438+0000 7fdcad318700 1 -- 172.21.15.8:0/4214951585 shutdown_connections 2023-10-18T22:09:03.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.438+0000 7fdcad318700 1 -- 172.21.15.8:0/4214951585 wait complete. 2023-10-18T22:09:03.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.439+0000 7fdcad318700 1 Processor -- start 2023-10-18T22:09:03.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.439+0000 7fdcad318700 1 -- start start 2023-10-18T22:09:03.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdcad318700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca80f77d0 0x7fdca8106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:03.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdcad318700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdca81073d0 0x7fdca81082c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:03.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdcad318700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81078a0 con 0x7fdca81073d0 2023-10-18T22:09:03.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdcad318700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81079e0 con 0x7fdca80f77d0 2023-10-18T22:09:03.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdca77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdca81073d0 0x7fdca81082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:03.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdca77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdca81073d0 0x7fdca81082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32772/0 (socket says 172.21.15.8:32772) 2023-10-18T22:09:03.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdca77fe700 1 -- 172.21.15.8:0/2332835438 learned_addr learned my addr 172.21.15.8:0/2332835438 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:03.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdca7fff700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca80f77d0 0x7fdca8106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:03.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdca77fe700 1 -- 172.21.15.8:0/2332835438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca80f77d0 msgr2=0x7fdca8106ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:03.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdca77fe700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca80f77d0 0x7fdca8106ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.440+0000 7fdca77fe700 1 -- 172.21.15.8:0/2332835438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98005040 con 0x7fdca81073d0 2023-10-18T22:09:03.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.441+0000 7fdca77fe700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdca81073d0 0x7fdca81082c0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7fdc9c00e7f0 tx=0x7fdc9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:03.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.441+0000 7fdca4ff9700 1 -- 172.21.15.8:0/2332835438 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9c0092e0 con 0x7fdca81073d0 2023-10-18T22:09:03.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.441+0000 7fdca4ff9700 1 -- 172.21.15.8:0/2332835438 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdc9c00f040 con 0x7fdca81073d0 2023-10-18T22:09:03.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.441+0000 7fdca4ff9700 1 -- 172.21.15.8:0/2332835438 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9c0147e0 con 0x7fdca81073d0 2023-10-18T22:09:03.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.441+0000 7fdcad318700 1 -- 172.21.15.8:0/2332835438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca8108870 con 0x7fdca81073d0 2023-10-18T22:09:03.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.441+0000 7fdcad318700 1 -- 172.21.15.8:0/2332835438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca8108db0 con 0x7fdca81073d0 2023-10-18T22:09:03.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.442+0000 7fdcad318700 1 -- 172.21.15.8:0/2332835438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca8045ad0 con 0x7fdca81073d0 2023-10-18T22:09:03.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.443+0000 7fdca4ff9700 1 -- 172.21.15.8:0/2332835438 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdc9c01b030 con 0x7fdca81073d0 2023-10-18T22:09:03.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.444+0000 7fdca4ff9700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc90060f70 0x7fdc90063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:03.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.444+0000 7fdca4ff9700 1 -- 172.21.15.8:0/2332835438 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdc9c07c680 con 0x7fdca81073d0 2023-10-18T22:09:03.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.445+0000 7fdca7fff700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc90060f70 0x7fdc90063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:03.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.445+0000 7fdca7fff700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc90060f70 0x7fdc90063430 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fdc98004630 tx=0x7fdc98009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:03.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.449+0000 7fdca4ff9700 1 -- 172.21.15.8:0/2332835438 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdc9c04fd70 con 0x7fdca81073d0 2023-10-18T22:09:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:02.551611+0000 mgr.smithi008.flmjzp (mgr.14640) 4209 : audit [DBG] from='client.37412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:02.882929+0000 mgr.smithi008.flmjzp (mgr.14640) 4210 : cluster [DBG] pgmap v2890: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:02.894496+0000 mgr.smithi008.flmjzp (mgr.14640) 4211 : audit [DBG] from='client.37416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:03.300126+0000 mon.smithi008 (mon.0) 4521 : audit [DBG] from='client.? 172.21.15.8:0/2446407349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:03.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.679+0000 7fdcad318700 1 -- 172.21.15.8:0/2332835438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdca8027b00 con 0x7fdca81073d0 2023-10-18T22:09:03.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.680+0000 7fdca4ff9700 1 -- 172.21.15.8:0/2332835438 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fdc9c019070 con 0x7fdca81073d0 2023-10-18T22:09:03.682 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:09:03.683 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:09:03.683 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:09:03.683 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:09:03.683 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:09:03.683 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:09:03.684 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:09:03.684 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:09:03.684 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:09:03.684 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:09:03.684 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:09:03.685 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:09:03.685 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:09:03.685 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:09:03.685 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:09:03.685 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:09:03.686 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:09:03.686 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:09:03.686 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:09:03.686 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:09:03.686 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:09:03.687 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:09:03.687 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:09:03.687 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:09:03.687 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:09:03.687 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:09:03.688 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:09:03.688 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:09:03.688 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:09:03.688 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:09:03.688 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:09:03.689 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:09:03.689 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:09:03.689 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:09:03.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 -- 172.21.15.8:0/2332835438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc90060f70 msgr2=0x7fdc90063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:03.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc90060f70 0x7fdc90063430 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fdc98004630 tx=0x7fdc98009b30).stop 2023-10-18T22:09:03.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 -- 172.21.15.8:0/2332835438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdca81073d0 msgr2=0x7fdca81082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:03.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdca81073d0 0x7fdca81082c0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7fdc9c00e7f0 tx=0x7fdc9c00b040).stop 2023-10-18T22:09:03.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 -- 172.21.15.8:0/2332835438 shutdown_connections 2023-10-18T22:09:03.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc90060f70 0x7fdc90063430 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca80f77d0 0x7fdca8106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 --2- 172.21.15.8:0/2332835438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdca81073d0 0x7fdca81082c0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 -- 172.21.15.8:0/2332835438 >> 172.21.15.8:0/2332835438 conn(0x7fdca80f1c90 msgr2=0x7fdca80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:03.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 -- 172.21.15.8:0/2332835438 shutdown_connections 2023-10-18T22:09:03.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.682+0000 7fdcad318700 1 -- 172.21.15.8:0/2332835438 wait complete. 2023-10-18T22:09:03.692 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:09:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:02.551611+0000 mgr.smithi008.flmjzp (mgr.14640) 4209 : audit [DBG] from='client.37412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:02.882929+0000 mgr.smithi008.flmjzp (mgr.14640) 4210 : cluster [DBG] pgmap v2890: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:02.894496+0000 mgr.smithi008.flmjzp (mgr.14640) 4211 : audit [DBG] from='client.37416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:03.300126+0000 mon.smithi008 (mon.0) 4521 : audit [DBG] from='client.? 172.21.15.8:0/2446407349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:03.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.819+0000 7f51a3fff700 1 -- 172.21.15.8:0/285118204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51a40f6530 msgr2=0x7f51a40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:03.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.819+0000 7f51a3fff700 1 --2- 172.21.15.8:0/285118204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51a40f6530 0x7f51a40f6950 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f5194004660 tx=0x7f5194009b30).stop 2023-10-18T22:09:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.819+0000 7f51a3fff700 1 -- 172.21.15.8:0/285118204 shutdown_connections 2023-10-18T22:09:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.819+0000 7f51a3fff700 1 --2- 172.21.15.8:0/285118204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51a40f77d0 0x7f51a40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.819+0000 7f51a3fff700 1 --2- 172.21.15.8:0/285118204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51a40f6530 0x7f51a40f6950 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.819+0000 7f51a3fff700 1 -- 172.21.15.8:0/285118204 >> 172.21.15.8:0/285118204 conn(0x7f51a40f1c90 msgr2=0x7f51a40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.819+0000 7f51a3fff700 1 -- 172.21.15.8:0/285118204 shutdown_connections 2023-10-18T22:09:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.819+0000 7f51a3fff700 1 -- 172.21.15.8:0/285118204 wait complete. 2023-10-18T22:09:03.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.820+0000 7f51a3fff700 1 Processor -- start 2023-10-18T22:09:03.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.820+0000 7f51a3fff700 1 -- start start 2023-10-18T22:09:03.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.820+0000 7f51a3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51a40f6530 0x7f51a4108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:03.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.820+0000 7f51a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51a40f77d0 0x7f51a4109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:03.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.820+0000 7f51a3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4109a00 con 0x7f51a40f77d0 2023-10-18T22:09:03.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.820+0000 7f51a3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4109b40 con 0x7f51a40f6530 2023-10-18T22:09:03.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.821+0000 7f51a27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51a40f77d0 0x7f51a4109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.821+0000 7f51a27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51a40f77d0 0x7f51a4109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32790/0 (socket says 172.21.15.8:32790) 2023-10-18T22:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.821+0000 7f51a27fc700 1 -- 172.21.15.8:0/2613837888 learned_addr learned my addr 172.21.15.8:0/2613837888 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.821+0000 7f51a2ffd700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51a40f6530 0x7f51a4108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.821+0000 7f51a27fc700 1 -- 172.21.15.8:0/2613837888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51a40f6530 msgr2=0x7f51a4108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.821+0000 7f51a27fc700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51a40f6530 0x7f51a4108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:03.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.821+0000 7f51a27fc700 1 -- 172.21.15.8:0/2613837888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194005040 con 0x7f51a40f77d0 2023-10-18T22:09:03.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.821+0000 7f51a27fc700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51a40f77d0 0x7f51a4109450 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f519800e7f0 tx=0x7f519800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:03.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.822+0000 7f518b7fe700 1 -- 172.21.15.8:0/2613837888 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51980092e0 con 0x7f51a40f77d0 2023-10-18T22:09:03.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.822+0000 7f518b7fe700 1 -- 172.21.15.8:0/2613837888 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f519800f040 con 0x7f51a40f77d0 2023-10-18T22:09:03.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.822+0000 7f518b7fe700 1 -- 172.21.15.8:0/2613837888 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51980147e0 con 0x7f51a40f77d0 2023-10-18T22:09:03.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.822+0000 7f51a3fff700 1 -- 172.21.15.8:0/2613837888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a410a4e0 con 0x7f51a40f77d0 2023-10-18T22:09:03.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.822+0000 7f51a3fff700 1 -- 172.21.15.8:0/2613837888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a410aa20 con 0x7f51a40f77d0 2023-10-18T22:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.823+0000 7f51a3fff700 1 -- 172.21.15.8:0/2613837888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a4045ad0 con 0x7f51a40f77d0 2023-10-18T22:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.824+0000 7f518b7fe700 1 -- 172.21.15.8:0/2613837888 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f519801b030 con 0x7f51a40f77d0 2023-10-18T22:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.825+0000 7f518b7fe700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f518c060f70 0x7f518c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.825+0000 7f518b7fe700 1 -- 172.21.15.8:0/2613837888 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f519807c6b0 con 0x7f51a40f77d0 2023-10-18T22:09:03.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.826+0000 7f51a2ffd700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f518c060f70 0x7f518c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:03.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.826+0000 7f51a2ffd700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f518c060f70 0x7f518c063430 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f5194005010 tx=0x7f5194016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:03.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:03.829+0000 7f518b7fe700 1 -- 172.21.15.8:0/2613837888 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f519804fd40 con 0x7f51a40f77d0 2023-10-18T22:09:04.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.031+0000 7f51a3fff700 1 -- 172.21.15.8:0/2613837888 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51a410ac90 con 0x7f518c060f70 2023-10-18T22:09:04.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.032+0000 7f518b7fe700 1 -- 172.21.15.8:0/2613837888 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f51a410ac90 con 0x7f518c060f70 2023-10-18T22:09:04.035 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:09:04.035 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:09:04.035 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:09:04.035 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:09:04.036 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:09:04.036 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:09:04.036 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:09:04.036 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:09:04.036 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:09:04.037 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:09:04.037 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:09:04.037 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:09:04.037 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:09:04.037 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:09:04.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 -- 172.21.15.8:0/2613837888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f518c060f70 msgr2=0x7f518c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:04.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f518c060f70 0x7f518c063430 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f5194005010 tx=0x7f5194016040).stop 2023-10-18T22:09:04.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 -- 172.21.15.8:0/2613837888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51a40f77d0 msgr2=0x7f51a4109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:04.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51a40f77d0 0x7f51a4109450 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f519800e7f0 tx=0x7f519800b040).stop 2023-10-18T22:09:04.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 -- 172.21.15.8:0/2613837888 shutdown_connections 2023-10-18T22:09:04.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f518c060f70 0x7f518c063430 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:04.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51a40f6530 0x7f51a4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:04.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 --2- 172.21.15.8:0/2613837888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51a40f77d0 0x7f51a4109450 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:04.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 -- 172.21.15.8:0/2613837888 >> 172.21.15.8:0/2613837888 conn(0x7f51a40f1c90 msgr2=0x7f51a406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:04.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 -- 172.21.15.8:0/2613837888 shutdown_connections 2023-10-18T22:09:04.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:04.035+0000 7f51a3fff700 1 -- 172.21.15.8:0/2613837888 wait complete. 2023-10-18T22:09:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:03.681520+0000 mon.smithi008 (mon.0) 4522 : audit [DBG] from='client.? 172.21.15.8:0/2332835438' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:09:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:04.033748+0000 mgr.smithi008.flmjzp (mgr.14640) 4212 : audit [DBG] from='client.37428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:03.681520+0000 mon.smithi008 (mon.0) 4522 : audit [DBG] from='client.? 172.21.15.8:0/2332835438' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:09:04.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:04.033748+0000 mgr.smithi008.flmjzp (mgr.14640) 4212 : audit [DBG] from='client.37428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:04.883502+0000 mgr.smithi008.flmjzp (mgr.14640) 4213 : cluster [DBG] pgmap v2891: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:04.883502+0000 mgr.smithi008.flmjzp (mgr.14640) 4213 : cluster [DBG] pgmap v2891: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:08.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:06.883985+0000 mgr.smithi008.flmjzp (mgr.14640) 4214 : cluster [DBG] pgmap v2892: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:06.883985+0000 mgr.smithi008.flmjzp (mgr.14640) 4214 : cluster [DBG] pgmap v2892: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:10.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:08.884587+0000 mgr.smithi008.flmjzp (mgr.14640) 4215 : cluster [DBG] pgmap v2893: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:08.884587+0000 mgr.smithi008.flmjzp (mgr.14640) 4215 : cluster [DBG] pgmap v2893: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:10.905179+0000 mon.smithi008 (mon.0) 4523 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:10.905179+0000 mon.smithi008 (mon.0) 4523 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:12.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:10.885284+0000 mgr.smithi008.flmjzp (mgr.14640) 4216 : cluster [DBG] pgmap v2894: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:11.467978+0000 mon.smithi008 (mon.0) 4524 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:11.469061+0000 mon.smithi008 (mon.0) 4525 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:11.475874+0000 mon.smithi008 (mon.0) 4526 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:12.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:11.482538+0000 mon.smithi008 (mon.0) 4527 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:12.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:11.485745+0000 mon.smithi008 (mon.0) 4528 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:12.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:11.487423+0000 mon.smithi008 (mon.0) 4529 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:12.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:11.489120+0000 mon.smithi008 (mon.0) 4530 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:12.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:11.491160+0000 mon.smithi008 (mon.0) 4531 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:10.885284+0000 mgr.smithi008.flmjzp (mgr.14640) 4216 : cluster [DBG] pgmap v2894: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:11.467978+0000 mon.smithi008 (mon.0) 4524 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:12.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:11.469061+0000 mon.smithi008 (mon.0) 4525 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:11.475874+0000 mon.smithi008 (mon.0) 4526 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:11.482538+0000 mon.smithi008 (mon.0) 4527 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:11.485745+0000 mon.smithi008 (mon.0) 4528 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:12.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:11.487423+0000 mon.smithi008 (mon.0) 4529 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:11.489120+0000 mon.smithi008 (mon.0) 4530 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:12.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:11.491160+0000 mon.smithi008 (mon.0) 4531 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:13.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:11.469949+0000 mgr.smithi008.flmjzp (mgr.14640) 4217 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:11.470673+0000 mgr.smithi008.flmjzp (mgr.14640) 4218 : cluster [DBG] pgmap v2895: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:11.470992+0000 mgr.smithi008.flmjzp (mgr.14640) 4219 : cluster [DBG] pgmap v2896: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:13.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:11.493179+0000 mgr.smithi008.flmjzp (mgr.14640) 4220 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:11.469949+0000 mgr.smithi008.flmjzp (mgr.14640) 4217 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:11.470673+0000 mgr.smithi008.flmjzp (mgr.14640) 4218 : cluster [DBG] pgmap v2895: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:11.470992+0000 mgr.smithi008.flmjzp (mgr.14640) 4219 : cluster [DBG] pgmap v2896: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:13.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:11.493179+0000 mgr.smithi008.flmjzp (mgr.14640) 4220 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:15.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:13.471535+0000 mgr.smithi008.flmjzp (mgr.14640) 4221 : cluster [DBG] pgmap v2897: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:13.471535+0000 mgr.smithi008.flmjzp (mgr.14640) 4221 : cluster [DBG] pgmap v2897: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:17.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:15.472111+0000 mgr.smithi008.flmjzp (mgr.14640) 4222 : cluster [DBG] pgmap v2898: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:15.472111+0000 mgr.smithi008.flmjzp (mgr.14640) 4222 : cluster [DBG] pgmap v2898: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:17.472798+0000 mgr.smithi008.flmjzp (mgr.14640) 4223 : cluster [DBG] pgmap v2899: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:17.472798+0000 mgr.smithi008.flmjzp (mgr.14640) 4223 : cluster [DBG] pgmap v2899: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:21.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:19.473371+0000 mgr.smithi008.flmjzp (mgr.14640) 4224 : cluster [DBG] pgmap v2900: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:19.473371+0000 mgr.smithi008.flmjzp (mgr.14640) 4224 : cluster [DBG] pgmap v2900: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:22.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:21.504005+0000 mon.smithi008 (mon.0) 4532 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:22.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:21.506936+0000 mon.smithi008 (mon.0) 4533 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:22.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:21.507903+0000 mon.smithi008 (mon.0) 4534 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:22.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:21.514389+0000 mon.smithi008 (mon.0) 4535 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:22.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:21.520760+0000 mon.smithi008 (mon.0) 4536 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:22.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:21.524008+0000 mon.smithi008 (mon.0) 4537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:22.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:21.525702+0000 mon.smithi008 (mon.0) 4538 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:22.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:21.527403+0000 mon.smithi008 (mon.0) 4539 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:22.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:21.529434+0000 mon.smithi008 (mon.0) 4540 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:21.504005+0000 mon.smithi008 (mon.0) 4532 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:21.506936+0000 mon.smithi008 (mon.0) 4533 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:22.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:21.507903+0000 mon.smithi008 (mon.0) 4534 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:22.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:21.514389+0000 mon.smithi008 (mon.0) 4535 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:22.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:21.520760+0000 mon.smithi008 (mon.0) 4536 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:22.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:21.524008+0000 mon.smithi008 (mon.0) 4537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:22.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:21.525702+0000 mon.smithi008 (mon.0) 4538 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:22.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:21.527403+0000 mon.smithi008 (mon.0) 4539 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:22.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:21.529434+0000 mon.smithi008 (mon.0) 4540 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:21.473882+0000 mgr.smithi008.flmjzp (mgr.14640) 4225 : cluster [DBG] pgmap v2901: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:21.508744+0000 mgr.smithi008.flmjzp (mgr.14640) 4226 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:21.509336+0000 mgr.smithi008.flmjzp (mgr.14640) 4227 : cluster [DBG] pgmap v2902: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:21.509632+0000 mgr.smithi008.flmjzp (mgr.14640) 4228 : cluster [DBG] pgmap v2903: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:23.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:21.531370+0000 mgr.smithi008.flmjzp (mgr.14640) 4229 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:21.473882+0000 mgr.smithi008.flmjzp (mgr.14640) 4225 : cluster [DBG] pgmap v2901: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:21.508744+0000 mgr.smithi008.flmjzp (mgr.14640) 4226 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:21.509336+0000 mgr.smithi008.flmjzp (mgr.14640) 4227 : cluster [DBG] pgmap v2902: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:21.509632+0000 mgr.smithi008.flmjzp (mgr.14640) 4228 : cluster [DBG] pgmap v2903: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:23.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:21.531370+0000 mgr.smithi008.flmjzp (mgr.14640) 4229 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:23.510230+0000 mgr.smithi008.flmjzp (mgr.14640) 4230 : cluster [DBG] pgmap v2904: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:23.510230+0000 mgr.smithi008.flmjzp (mgr.14640) 4230 : cluster [DBG] pgmap v2904: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:25.510754+0000 mgr.smithi008.flmjzp (mgr.14640) 4231 : cluster [DBG] pgmap v2905: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:25.510754+0000 mgr.smithi008.flmjzp (mgr.14640) 4231 : cluster [DBG] pgmap v2905: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:29.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:27.511230+0000 mgr.smithi008.flmjzp (mgr.14640) 4232 : cluster [DBG] pgmap v2906: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:27.511230+0000 mgr.smithi008.flmjzp (mgr.14640) 4232 : cluster [DBG] pgmap v2906: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:31.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:29.511792+0000 mgr.smithi008.flmjzp (mgr.14640) 4233 : cluster [DBG] pgmap v2907: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:29.511792+0000 mgr.smithi008.flmjzp (mgr.14640) 4233 : cluster [DBG] pgmap v2907: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:32.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:31.535796+0000 mon.smithi008 (mon.0) 4541 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:32.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:31.538024+0000 mon.smithi008 (mon.0) 4542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:32.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:31.539077+0000 mon.smithi008 (mon.0) 4543 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:32.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:31.546075+0000 mon.smithi008 (mon.0) 4544 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:32.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:31.554656+0000 mon.smithi008 (mon.0) 4545 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:32.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:31.558386+0000 mon.smithi008 (mon.0) 4546 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:32.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:31.560131+0000 mon.smithi008 (mon.0) 4547 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:32.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:31.561790+0000 mon.smithi008 (mon.0) 4548 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:32.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:31.563839+0000 mon.smithi008 (mon.0) 4549 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:32.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:31.535796+0000 mon.smithi008 (mon.0) 4541 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:32.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:31.538024+0000 mon.smithi008 (mon.0) 4542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:32.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:31.539077+0000 mon.smithi008 (mon.0) 4543 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:32.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:31.546075+0000 mon.smithi008 (mon.0) 4544 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:32.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:31.554656+0000 mon.smithi008 (mon.0) 4545 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:32.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:31.558386+0000 mon.smithi008 (mon.0) 4546 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:32.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:31.560131+0000 mon.smithi008 (mon.0) 4547 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:32.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:31.561790+0000 mon.smithi008 (mon.0) 4548 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:32.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:31.563839+0000 mon.smithi008 (mon.0) 4549 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:31.512416+0000 mgr.smithi008.flmjzp (mgr.14640) 4234 : cluster [DBG] pgmap v2908: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:31.539987+0000 mgr.smithi008.flmjzp (mgr.14640) 4235 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:31.540525+0000 mgr.smithi008.flmjzp (mgr.14640) 4236 : cluster [DBG] pgmap v2909: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:31.540799+0000 mgr.smithi008.flmjzp (mgr.14640) 4237 : cluster [DBG] pgmap v2910: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:33.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:31.565788+0000 mgr.smithi008.flmjzp (mgr.14640) 4238 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:31.512416+0000 mgr.smithi008.flmjzp (mgr.14640) 4234 : cluster [DBG] pgmap v2908: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:31.539987+0000 mgr.smithi008.flmjzp (mgr.14640) 4235 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:31.540525+0000 mgr.smithi008.flmjzp (mgr.14640) 4236 : cluster [DBG] pgmap v2909: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:31.540799+0000 mgr.smithi008.flmjzp (mgr.14640) 4237 : cluster [DBG] pgmap v2910: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:33.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:31.565788+0000 mgr.smithi008.flmjzp (mgr.14640) 4238 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:34.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.190+0000 7f05424ef700 1 -- 172.21.15.8:0/593027411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f053c0f77d0 msgr2=0x7f053c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:34.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.190+0000 7f05424ef700 1 --2- 172.21.15.8:0/593027411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f053c0f77d0 0x7f053c0f7c30 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f052c004660 tx=0x7f052c009b30).stop 2023-10-18T22:09:34.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.190+0000 7f05424ef700 1 -- 172.21.15.8:0/593027411 shutdown_connections 2023-10-18T22:09:34.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.190+0000 7f05424ef700 1 --2- 172.21.15.8:0/593027411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f053c0f77d0 0x7f053c0f7c30 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.190+0000 7f05424ef700 1 --2- 172.21.15.8:0/593027411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c0f6530 0x7f053c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.190+0000 7f05424ef700 1 -- 172.21.15.8:0/593027411 >> 172.21.15.8:0/593027411 conn(0x7f053c0f1c90 msgr2=0x7f053c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:34.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.190+0000 7f05424ef700 1 -- 172.21.15.8:0/593027411 shutdown_connections 2023-10-18T22:09:34.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.190+0000 7f05424ef700 1 -- 172.21.15.8:0/593027411 wait complete. 2023-10-18T22:09:34.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.191+0000 7f05424ef700 1 Processor -- start 2023-10-18T22:09:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.191+0000 7f05424ef700 1 -- start start 2023-10-18T22:09:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.191+0000 7f05424ef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f053c0f6530 0x7f053c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.191+0000 7f05424ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c0f77d0 0x7f053c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.191+0000 7f05424ef700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c109a20 con 0x7f053c0f6530 2023-10-18T22:09:34.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.191+0000 7f05424ef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c109b60 con 0x7f053c0f77d0 2023-10-18T22:09:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f05414ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f053c0f6530 0x7f053c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f05414ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f053c0f6530 0x7f053c108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53924/0 (socket says 172.21.15.8:53924) 2023-10-18T22:09:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f05414ed700 1 -- 172.21.15.8:0/437090384 learned_addr learned my addr 172.21.15.8:0/437090384 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f0540cec700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c0f77d0 0x7f053c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:34.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f05414ed700 1 -- 172.21.15.8:0/437090384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c0f77d0 msgr2=0x7f053c109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:34.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f05414ed700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c0f77d0 0x7f053c109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f05414ed700 1 -- 172.21.15.8:0/437090384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c005040 con 0x7f053c0f6530 2023-10-18T22:09:34.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f05414ed700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f053c0f6530 0x7f053c108f80 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f0538002700 tx=0x7f0538009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:34.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f0531ffb700 1 -- 172.21.15.8:0/437090384 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05380079c0 con 0x7f053c0f6530 2023-10-18T22:09:34.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f05424ef700 1 -- 172.21.15.8:0/437090384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c10a500 con 0x7f053c0f6530 2023-10-18T22:09:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f0531ffb700 1 -- 172.21.15.8:0/437090384 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f053800f040 con 0x7f053c0f6530 2023-10-18T22:09:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.192+0000 7f0531ffb700 1 -- 172.21.15.8:0/437090384 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05380148d0 con 0x7f053c0f6530 2023-10-18T22:09:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.193+0000 7f05424ef700 1 -- 172.21.15.8:0/437090384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c10aac0 con 0x7f053c0f6530 2023-10-18T22:09:34.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.194+0000 7f05424ef700 1 -- 172.21.15.8:0/437090384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c045ad0 con 0x7f053c0f6530 2023-10-18T22:09:34.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.195+0000 7f0531ffb700 1 -- 172.21.15.8:0/437090384 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f053801b060 con 0x7f053c0f6530 2023-10-18T22:09:34.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.195+0000 7f0531ffb700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0528060f70 0x7f0528063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.195+0000 7f0531ffb700 1 -- 172.21.15.8:0/437090384 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f053807c7d0 con 0x7f053c0f6530 2023-10-18T22:09:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.196+0000 7f0540cec700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0528060f70 0x7f0528063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.196+0000 7f0540cec700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0528060f70 0x7f0528063430 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f052c004630 tx=0x7f052c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.200+0000 7f0531ffb700 1 -- 172.21.15.8:0/437090384 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f053804fdb0 con 0x7f053c0f6530 2023-10-18T22:09:34.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.401+0000 7f05424ef700 1 -- 172.21.15.8:0/437090384 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f053c0fee30 con 0x7f0528060f70 2023-10-18T22:09:34.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.402+0000 7f0531ffb700 1 -- 172.21.15.8:0/437090384 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f053c0fee30 con 0x7f0528060f70 2023-10-18T22:09:34.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 -- 172.21.15.8:0/437090384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0528060f70 msgr2=0x7f0528063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:34.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0528060f70 0x7f0528063430 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f052c004630 tx=0x7f052c009b30).stop 2023-10-18T22:09:34.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 -- 172.21.15.8:0/437090384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f053c0f6530 msgr2=0x7f053c108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:34.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f053c0f6530 0x7f053c108f80 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f0538002700 tx=0x7f0538009d80).stop 2023-10-18T22:09:34.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 -- 172.21.15.8:0/437090384 shutdown_connections 2023-10-18T22:09:34.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0528060f70 0x7f0528063430 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f053c0f6530 0x7f053c108f80 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 --2- 172.21.15.8:0/437090384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f053c0f77d0 0x7f053c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 -- 172.21.15.8:0/437090384 >> 172.21.15.8:0/437090384 conn(0x7f053c0f1c90 msgr2=0x7f053c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:34.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 -- 172.21.15.8:0/437090384 shutdown_connections 2023-10-18T22:09:34.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.404+0000 7f05424ef700 1 -- 172.21.15.8:0/437090384 wait complete. 2023-10-18T22:09:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:09:34.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.541+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/301854712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 msgr2=0x7f0c380f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:34.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.541+0000 7f0c3cdaf700 1 --2- 172.21.15.8:0/301854712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c380f7c30 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f0c2c004660 tx=0x7f0c2c009b30).stop 2023-10-18T22:09:34.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.541+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/301854712 shutdown_connections 2023-10-18T22:09:34.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.541+0000 7f0c3cdaf700 1 --2- 172.21.15.8:0/301854712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c380f7c30 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.541+0000 7f0c3cdaf700 1 --2- 172.21.15.8:0/301854712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 0x7f0c380f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.541+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/301854712 >> 172.21.15.8:0/301854712 conn(0x7f0c380f1c90 msgr2=0x7f0c380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:34.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.542+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/301854712 shutdown_connections 2023-10-18T22:09:34.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.542+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/301854712 wait complete. 2023-10-18T22:09:34.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.542+0000 7f0c3cdaf700 1 Processor -- start 2023-10-18T22:09:34.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.543+0000 7f0c3cdaf700 1 -- start start 2023-10-18T22:09:34.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.543+0000 7f0c3cdaf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 0x7f0c38106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:34.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.543+0000 7f0c3cdaf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:34.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.543+0000 7f0c3cdaf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c38107880 con 0x7f0c380f77d0 2023-10-18T22:09:34.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.543+0000 7f0c3cdaf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c381080c0 con 0x7f0c380f6530 2023-10-18T22:09:34.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.543+0000 7f0c36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:34.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.543+0000 7f0c36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53942/0 (socket says 172.21.15.8:53942) 2023-10-18T22:09:34.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.543+0000 7f0c36ffd700 1 -- 172.21.15.8:0/2874137259 learned_addr learned my addr 172.21.15.8:0/2874137259 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:34.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.543+0000 7f0c377fe700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 0x7f0c38106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:34.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.544+0000 7f0c36ffd700 1 -- 172.21.15.8:0/2874137259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 msgr2=0x7f0c38106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:34.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.544+0000 7f0c36ffd700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 0x7f0c38106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.544+0000 7f0c36ffd700 1 -- 172.21.15.8:0/2874137259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c005040 con 0x7f0c380f77d0 2023-10-18T22:09:34.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.544+0000 7f0c36ffd700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f0c2c009990 tx=0x7f0c2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:34.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.544+0000 7f0c1ffff700 1 -- 172.21.15.8:0/2874137259 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c2c018070 con 0x7f0c380f77d0 2023-10-18T22:09:34.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.544+0000 7f0c1ffff700 1 -- 172.21.15.8:0/2874137259 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0c2c009630 con 0x7f0c380f77d0 2023-10-18T22:09:34.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.544+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/2874137259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c38108340 con 0x7f0c380f77d0 2023-10-18T22:09:34.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.544+0000 7f0c1ffff700 1 -- 172.21.15.8:0/2874137259 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c2c01c3c0 con 0x7f0c380f77d0 2023-10-18T22:09:34.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.544+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/2874137259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c38108820 con 0x7f0c380f77d0 2023-10-18T22:09:34.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.545+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/2874137259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c38059100 con 0x7f0c380f77d0 2023-10-18T22:09:34.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.546+0000 7f0c1ffff700 1 -- 172.21.15.8:0/2874137259 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0c2c01d970 con 0x7f0c380f77d0 2023-10-18T22:09:34.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.547+0000 7f0c1ffff700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c20060f70 0x7f0c20063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:34.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.547+0000 7f0c1ffff700 1 -- 172.21.15.8:0/2874137259 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0c2c07e5a0 con 0x7f0c380f77d0 2023-10-18T22:09:34.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.547+0000 7f0c377fe700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c20060f70 0x7f0c20063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:34.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.548+0000 7f0c377fe700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c20060f70 0x7f0c20063430 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f0c38107b50 tx=0x7f0c2800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:34.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.551+0000 7f0c1ffff700 1 -- 172.21.15.8:0/2874137259 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0c2c04e1d0 con 0x7f0c380f77d0 2023-10-18T22:09:34.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.749+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/2874137259 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c380fedf0 con 0x7f0c20060f70 2023-10-18T22:09:34.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.750+0000 7f0c1ffff700 1 -- 172.21.15.8:0/2874137259 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0c380fedf0 con 0x7f0c20060f70 2023-10-18T22:09:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/2874137259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c20060f70 msgr2=0x7f0c20063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c20060f70 0x7f0c20063430 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f0c38107b50 tx=0x7f0c2800b040).stop 2023-10-18T22:09:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/2874137259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 msgr2=0x7f0c38107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f0c2c009990 tx=0x7f0c2c009b30).stop 2023-10-18T22:09:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/2874137259 shutdown_connections 2023-10-18T22:09:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c20060f70 0x7f0c20063430 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c380f6530 0x7f0c38106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 --2- 172.21.15.8:0/2874137259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c380f77d0 0x7f0c38107280 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/2874137259 >> 172.21.15.8:0/2874137259 conn(0x7f0c380f1c90 msgr2=0x7f0c380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/2874137259 shutdown_connections 2023-10-18T22:09:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.752+0000 7f0c3cdaf700 1 -- 172.21.15.8:0/2874137259 wait complete. 2023-10-18T22:09:34.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.890+0000 7f60323af700 1 -- 172.21.15.8:0/3223494697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602c0f77d0 msgr2=0x7f602c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.890+0000 7f60323af700 1 --2- 172.21.15.8:0/3223494697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602c0f77d0 0x7f602c0f7c30 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f601c004660 tx=0x7f601c009b30).stop 2023-10-18T22:09:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.890+0000 7f60323af700 1 -- 172.21.15.8:0/3223494697 shutdown_connections 2023-10-18T22:09:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.890+0000 7f60323af700 1 --2- 172.21.15.8:0/3223494697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602c0f77d0 0x7f602c0f7c30 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.890+0000 7f60323af700 1 --2- 172.21.15.8:0/3223494697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f602c0f6530 0x7f602c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.890+0000 7f60323af700 1 -- 172.21.15.8:0/3223494697 >> 172.21.15.8:0/3223494697 conn(0x7f602c0f1c90 msgr2=0x7f602c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:34.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.890+0000 7f60323af700 1 -- 172.21.15.8:0/3223494697 shutdown_connections 2023-10-18T22:09:34.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.890+0000 7f60323af700 1 -- 172.21.15.8:0/3223494697 wait complete. 2023-10-18T22:09:34.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.891+0000 7f60323af700 1 Processor -- start 2023-10-18T22:09:34.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.891+0000 7f60323af700 1 -- start start 2023-10-18T22:09:34.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.891+0000 7f60323af700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602c0f6530 0x7f602c108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:34.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.891+0000 7f60323af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f602c0f77d0 0x7f602c109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:34.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.891+0000 7f60323af700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c1099f0 con 0x7f602c0f6530 2023-10-18T22:09:34.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.891+0000 7f60323af700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c109b30 con 0x7f602c0f77d0 2023-10-18T22:09:34.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.892+0000 7f60313ad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602c0f6530 0x7f602c108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:34.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.892+0000 7f60313ad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602c0f6530 0x7f602c108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53962/0 (socket says 172.21.15.8:53962) 2023-10-18T22:09:34.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.892+0000 7f60313ad700 1 -- 172.21.15.8:0/1785479652 learned_addr learned my addr 172.21.15.8:0/1785479652 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:34.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.892+0000 7f6030bac700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f602c0f77d0 0x7f602c109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:34.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.892+0000 7f60313ad700 1 -- 172.21.15.8:0/1785479652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f602c0f77d0 msgr2=0x7f602c109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:34.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.892+0000 7f60313ad700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f602c0f77d0 0x7f602c109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:34.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.892+0000 7f60313ad700 1 -- 172.21.15.8:0/1785479652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c005040 con 0x7f602c0f6530 2023-10-18T22:09:34.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.892+0000 7f6030bac700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f602c0f77d0 0x7f602c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:09:34.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.892+0000 7f60313ad700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602c0f6530 0x7f602c108f50 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7f602800c790 tx=0x7f6028007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:34.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.892+0000 7f6021ffb700 1 -- 172.21.15.8:0/1785479652 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f602800e680 con 0x7f602c0f6530 2023-10-18T22:09:34.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.893+0000 7f6021ffb700 1 -- 172.21.15.8:0/1785479652 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f602800eca0 con 0x7f602c0f6530 2023-10-18T22:09:34.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.893+0000 7f6021ffb700 1 -- 172.21.15.8:0/1785479652 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6028012d80 con 0x7f602c0f6530 2023-10-18T22:09:34.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.893+0000 7f60323af700 1 -- 172.21.15.8:0/1785479652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c10a4d0 con 0x7f602c0f6530 2023-10-18T22:09:34.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.893+0000 7f60323af700 1 -- 172.21.15.8:0/1785479652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c10aa90 con 0x7f602c0f6530 2023-10-18T22:09:34.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.894+0000 7f60323af700 1 -- 172.21.15.8:0/1785479652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c045ad0 con 0x7f602c0f6530 2023-10-18T22:09:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.895+0000 7f6021ffb700 1 -- 172.21.15.8:0/1785479652 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6028010070 con 0x7f602c0f6530 2023-10-18T22:09:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.895+0000 7f6021ffb700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6018060f70 0x7f6018063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:34.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.896+0000 7f6021ffb700 1 -- 172.21.15.8:0/1785479652 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f602807c9d0 con 0x7f602c0f6530 2023-10-18T22:09:34.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.896+0000 7f6030bac700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6018060f70 0x7f6018063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:34.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.896+0000 7f6030bac700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6018060f70 0x7f6018063430 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f601c004e30 tx=0x7f601c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:34.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:34.900+0000 7f6021ffb700 1 -- 172.21.15.8:0/1785479652 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6028050030 con 0x7f602c0f6530 2023-10-18T22:09:35.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.095+0000 7f60323af700 1 -- 172.21.15.8:0/1785479652 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f602c0fee00 con 0x7f6018060f70 2023-10-18T22:09:35.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.105+0000 7f6021ffb700 1 -- 172.21.15.8:0/1785479652 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f602c0fee00 con 0x7f6018060f70 2023-10-18T22:09:35.106 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:09:35.106 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (76m) 3m ago 77m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:09:35.107 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (70m) 3m ago 77m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:09:35.107 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (70m) 85s ago 76m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:09:35.107 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (76m) 3m ago 77m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:09:35.107 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 73m - - 2023-10-18T22:09:35.107 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 73m - - 2023-10-18T22:09:35.107 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 85s ago 73m - - 2023-10-18T22:09:35.108 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 85s ago 73m - - 2023-10-18T22:09:35.108 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (71m) 3m ago 79m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:09:35.108 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (70m) 85s ago 76m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:09:35.108 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (70m) 3m ago 79m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:09:35.108 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (70m) 85s ago 76m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:09:35.109 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (77m) 3m ago 77m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:09:35.109 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (76m) 85s ago 76m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:09:35.109 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (69m) 3m ago 76m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:09:35.109 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (67m) 3m ago 75m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:09:35.109 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (67m) 3m ago 75m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:09:35.109 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (66m) 85s ago 75m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:09:35.110 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (66m) 85s ago 75m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:09:35.110 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (65m) 85s ago 74m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:09:35.110 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (71m) 3m ago 76m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:09:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 -- 172.21.15.8:0/1785479652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6018060f70 msgr2=0x7f6018063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6018060f70 0x7f6018063430 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f601c004e30 tx=0x7f601c009b30).stop 2023-10-18T22:09:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 -- 172.21.15.8:0/1785479652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602c0f6530 msgr2=0x7f602c108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602c0f6530 0x7f602c108f50 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7f602800c790 tx=0x7f6028007d90).stop 2023-10-18T22:09:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 -- 172.21.15.8:0/1785479652 shutdown_connections 2023-10-18T22:09:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6018060f70 0x7f6018063430 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f602c0f6530 0x7f602c108f50 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 --2- 172.21.15.8:0/1785479652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f602c0f77d0 0x7f602c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 -- 172.21.15.8:0/1785479652 >> 172.21.15.8:0/1785479652 conn(0x7f602c0f1c90 msgr2=0x7f602c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 -- 172.21.15.8:0/1785479652 shutdown_connections 2023-10-18T22:09:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.107+0000 7f60323af700 1 -- 172.21.15.8:0/1785479652 wait complete. 2023-10-18T22:09:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.244+0000 7fd259bae700 1 -- 172.21.15.8:0/1667940474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2540f6530 msgr2=0x7fd2540f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.244+0000 7fd259bae700 1 --2- 172.21.15.8:0/1667940474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2540f6530 0x7fd2540f6950 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7fd248004660 tx=0x7fd248009b30).stop 2023-10-18T22:09:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.244+0000 7fd259bae700 1 -- 172.21.15.8:0/1667940474 shutdown_connections 2023-10-18T22:09:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.244+0000 7fd259bae700 1 --2- 172.21.15.8:0/1667940474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2540f77d0 0x7fd2540f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.244+0000 7fd259bae700 1 --2- 172.21.15.8:0/1667940474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2540f6530 0x7fd2540f6950 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.244+0000 7fd259bae700 1 -- 172.21.15.8:0/1667940474 >> 172.21.15.8:0/1667940474 conn(0x7fd2540f1c90 msgr2=0x7fd2540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.244+0000 7fd259bae700 1 -- 172.21.15.8:0/1667940474 shutdown_connections 2023-10-18T22:09:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.244+0000 7fd259bae700 1 -- 172.21.15.8:0/1667940474 wait complete. 2023-10-18T22:09:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.245+0000 7fd259bae700 1 Processor -- start 2023-10-18T22:09:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.245+0000 7fd259bae700 1 -- start start 2023-10-18T22:09:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd259bae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2540f6530 0x7fd254108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd259bae700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2540f77d0 0x7fd2541094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd259bae700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd254109a70 con 0x7fd2540f77d0 2023-10-18T22:09:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd259bae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd254109bb0 con 0x7fd2540f6530 2023-10-18T22:09:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd253fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2540f77d0 0x7fd2541094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd253fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2540f77d0 0x7fd2541094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53980/0 (socket says 172.21.15.8:53980) 2023-10-18T22:09:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd253fff700 1 -- 172.21.15.8:0/2034199371 learned_addr learned my addr 172.21.15.8:0/2034199371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd258bac700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2540f6530 0x7fd254108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd253fff700 1 -- 172.21.15.8:0/2034199371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2540f6530 msgr2=0x7fd254108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd253fff700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2540f6530 0x7fd254108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd253fff700 1 -- 172.21.15.8:0/2034199371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248005040 con 0x7fd2540f77d0 2023-10-18T22:09:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd258bac700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2540f6530 0x7fd254108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:09:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.246+0000 7fd253fff700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2540f77d0 0x7fd2541094c0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7fd2400026d0 tx=0x7fd240009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.247+0000 7fd2517fa700 1 -- 172.21.15.8:0/2034199371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd240009320 con 0x7fd2540f77d0 2023-10-18T22:09:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.247+0000 7fd2517fa700 1 -- 172.21.15.8:0/2034199371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd24000f040 con 0x7fd2540f77d0 2023-10-18T22:09:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.247+0000 7fd259bae700 1 -- 172.21.15.8:0/2034199371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25410a550 con 0x7fd2540f77d0 2023-10-18T22:09:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.247+0000 7fd2517fa700 1 -- 172.21.15.8:0/2034199371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2400148a0 con 0x7fd2540f77d0 2023-10-18T22:09:35.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.247+0000 7fd259bae700 1 -- 172.21.15.8:0/2034199371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25410ab10 con 0x7fd2540f77d0 2023-10-18T22:09:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.248+0000 7fd259bae700 1 -- 172.21.15.8:0/2034199371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd254045ad0 con 0x7fd2540f77d0 2023-10-18T22:09:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.249+0000 7fd2517fa700 1 -- 172.21.15.8:0/2034199371 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd240009480 con 0x7fd2540f77d0 2023-10-18T22:09:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.250+0000 7fd2517fa700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd244060f70 0x7fd244063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.250+0000 7fd2517fa700 1 -- 172.21.15.8:0/2034199371 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd24007cf60 con 0x7fd2540f77d0 2023-10-18T22:09:35.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.250+0000 7fd258bac700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd244060f70 0x7fd244063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:35.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.251+0000 7fd258bac700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd244060f70 0x7fd244063430 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fd248005010 tx=0x7fd248009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:35.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.254+0000 7fd2517fa700 1 -- 172.21.15.8:0/2034199371 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd2400505c0 con 0x7fd2540f77d0 2023-10-18T22:09:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:33.541523+0000 mgr.smithi008.flmjzp (mgr.14640) 4239 : cluster [DBG] pgmap v2911: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:33.541523+0000 mgr.smithi008.flmjzp (mgr.14640) 4239 : cluster [DBG] pgmap v2911: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:35.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.508+0000 7fd259bae700 1 -- 172.21.15.8:0/2034199371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd2540fee00 con 0x7fd2540f77d0 2023-10-18T22:09:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.509+0000 7fd2517fa700 1 -- 172.21.15.8:0/2034199371 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fd2400501b0 con 0x7fd2540f77d0 2023-10-18T22:09:35.510 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:09:35.511 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:09:35.511 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:09:35.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:09:35.511 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:09:35.511 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:09:35.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:09:35.512 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:09:35.512 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:09:35.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:09:35.512 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:09:35.513 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:09:35.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:09:35.513 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:09:35.513 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:09:35.513 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:09:35.513 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:09:35.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 -- 172.21.15.8:0/2034199371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd244060f70 msgr2=0x7fd244063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:35.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd244060f70 0x7fd244063430 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fd248005010 tx=0x7fd248009b30).stop 2023-10-18T22:09:35.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 -- 172.21.15.8:0/2034199371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2540f77d0 msgr2=0x7fd2541094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:35.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2540f77d0 0x7fd2541094c0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7fd2400026d0 tx=0x7fd240009de0).stop 2023-10-18T22:09:35.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 -- 172.21.15.8:0/2034199371 shutdown_connections 2023-10-18T22:09:35.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd244060f70 0x7fd244063430 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2540f6530 0x7fd254108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 --2- 172.21.15.8:0/2034199371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2540f77d0 0x7fd2541094c0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 -- 172.21.15.8:0/2034199371 >> 172.21.15.8:0/2034199371 conn(0x7fd2540f1c90 msgr2=0x7fd25406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:35.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 -- 172.21.15.8:0/2034199371 shutdown_connections 2023-10-18T22:09:35.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.511+0000 7fd259bae700 1 -- 172.21.15.8:0/2034199371 wait complete. 2023-10-18T22:09:35.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.649+0000 7fab33fff700 1 -- 172.21.15.8:0/992789957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab340f6530 msgr2=0x7fab340f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:35.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.649+0000 7fab33fff700 1 --2- 172.21.15.8:0/992789957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab340f6530 0x7fab340f6950 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7fab24004660 tx=0x7fab24009b30).stop 2023-10-18T22:09:35.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.649+0000 7fab33fff700 1 -- 172.21.15.8:0/992789957 shutdown_connections 2023-10-18T22:09:35.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.649+0000 7fab33fff700 1 --2- 172.21.15.8:0/992789957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab340f77d0 0x7fab340f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.649+0000 7fab33fff700 1 --2- 172.21.15.8:0/992789957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab340f6530 0x7fab340f6950 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.649+0000 7fab33fff700 1 -- 172.21.15.8:0/992789957 >> 172.21.15.8:0/992789957 conn(0x7fab340f1c90 msgr2=0x7fab340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:35.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.649+0000 7fab33fff700 1 -- 172.21.15.8:0/992789957 shutdown_connections 2023-10-18T22:09:35.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.649+0000 7fab33fff700 1 -- 172.21.15.8:0/992789957 wait complete. 2023-10-18T22:09:35.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.650+0000 7fab33fff700 1 Processor -- start 2023-10-18T22:09:35.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.650+0000 7fab33fff700 1 -- start start 2023-10-18T22:09:35.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab33fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab340f6530 0x7fab34108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:35.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab33fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab340f77d0 0x7fab341094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:35.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab33fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab34109a50 con 0x7fab340f77d0 2023-10-18T22:09:35.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab33fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab34109b90 con 0x7fab340f6530 2023-10-18T22:09:35.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab327fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab340f77d0 0x7fab341094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:35.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab327fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab340f77d0 0x7fab341094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53998/0 (socket says 172.21.15.8:53998) 2023-10-18T22:09:35.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab327fc700 1 -- 172.21.15.8:0/3763472989 learned_addr learned my addr 172.21.15.8:0/3763472989 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:35.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab32ffd700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab340f6530 0x7fab34108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:35.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab327fc700 1 -- 172.21.15.8:0/3763472989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab340f6530 msgr2=0x7fab34108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:35.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab327fc700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab340f6530 0x7fab34108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab327fc700 1 -- 172.21.15.8:0/3763472989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24005040 con 0x7fab340f77d0 2023-10-18T22:09:35.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.651+0000 7fab327fc700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab340f77d0 0x7fab341094a0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7fab280026d0 tx=0x7fab28009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:35.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.652+0000 7fab1b7fe700 1 -- 172.21.15.8:0/3763472989 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab28009320 con 0x7fab340f77d0 2023-10-18T22:09:35.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.652+0000 7fab1b7fe700 1 -- 172.21.15.8:0/3763472989 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fab2800f040 con 0x7fab340f77d0 2023-10-18T22:09:35.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.652+0000 7fab33fff700 1 -- 172.21.15.8:0/3763472989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3410a530 con 0x7fab340f77d0 2023-10-18T22:09:35.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.652+0000 7fab1b7fe700 1 -- 172.21.15.8:0/3763472989 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab280148a0 con 0x7fab340f77d0 2023-10-18T22:09:35.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.652+0000 7fab33fff700 1 -- 172.21.15.8:0/3763472989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3410aaf0 con 0x7fab340f77d0 2023-10-18T22:09:35.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.653+0000 7fab33fff700 1 -- 172.21.15.8:0/3763472989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab34045ad0 con 0x7fab340f77d0 2023-10-18T22:09:35.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.654+0000 7fab1b7fe700 1 -- 172.21.15.8:0/3763472989 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fab28009480 con 0x7fab340f77d0 2023-10-18T22:09:35.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.655+0000 7fab1b7fe700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab1c060f70 0x7fab1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:35.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.655+0000 7fab1b7fe700 1 -- 172.21.15.8:0/3763472989 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fab2807d090 con 0x7fab340f77d0 2023-10-18T22:09:35.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.655+0000 7fab32ffd700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab1c060f70 0x7fab1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:35.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.656+0000 7fab32ffd700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab1c060f70 0x7fab1c063430 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fab24004630 tx=0x7fab24009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:35.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.659+0000 7fab1b7fe700 1 -- 172.21.15.8:0/3763472989 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fab28050670 con 0x7fab340f77d0 2023-10-18T22:09:35.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.883+0000 7fab33fff700 1 -- 172.21.15.8:0/3763472989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab34027a00 con 0x7fab340f77d0 2023-10-18T22:09:35.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.884+0000 7fab1b7fe700 1 -- 172.21.15.8:0/3763472989 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fab280181b0 con 0x7fab340f77d0 2023-10-18T22:09:35.886 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:09:35.886 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:09:35.886 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:09:35.886 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:09:35.887 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:09:35.887 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:09:35.887 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:09:35.887 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:09:35.887 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:09:35.888 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:09:35.888 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:09:35.888 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:09:35.888 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:09:35.888 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:09:35.889 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:09:35.889 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:09:35.889 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:09:35.889 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:09:35.889 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:09:35.890 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:09:35.890 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:09:35.890 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:09:35.890 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:09:35.891 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:09:35.891 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:09:35.891 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:09:35.891 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:09:35.891 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:09:35.892 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:09:35.892 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:09:35.892 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:09:35.892 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:09:35.892 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:09:35.892 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:09:35.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 -- 172.21.15.8:0/3763472989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab1c060f70 msgr2=0x7fab1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:35.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab1c060f70 0x7fab1c063430 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fab24004630 tx=0x7fab24009b30).stop 2023-10-18T22:09:35.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 -- 172.21.15.8:0/3763472989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab340f77d0 msgr2=0x7fab341094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:35.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab340f77d0 0x7fab341094a0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7fab280026d0 tx=0x7fab28009de0).stop 2023-10-18T22:09:35.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 -- 172.21.15.8:0/3763472989 shutdown_connections 2023-10-18T22:09:35.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab1c060f70 0x7fab1c063430 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab340f6530 0x7fab34108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 --2- 172.21.15.8:0/3763472989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab340f77d0 0x7fab341094a0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:35.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 -- 172.21.15.8:0/3763472989 >> 172.21.15.8:0/3763472989 conn(0x7fab340f1c90 msgr2=0x7fab3406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:35.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 -- 172.21.15.8:0/3763472989 shutdown_connections 2023-10-18T22:09:35.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:35.886+0000 7fab33fff700 1 -- 172.21.15.8:0/3763472989 wait complete. 2023-10-18T22:09:35.895 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:09:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.023+0000 7f9cd72c7700 1 -- 172.21.15.8:0/3504106648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cd006a3b0 msgr2=0x7f9cd006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.023+0000 7f9cd72c7700 1 --2- 172.21.15.8:0/3504106648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cd006a3b0 0x7f9cd006a830 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f9cc0004660 tx=0x7f9cc0009b30).stop 2023-10-18T22:09:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.023+0000 7f9cd72c7700 1 -- 172.21.15.8:0/3504106648 shutdown_connections 2023-10-18T22:09:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.023+0000 7f9cd72c7700 1 --2- 172.21.15.8:0/3504106648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cd006a3b0 0x7f9cd006a830 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.023+0000 7f9cd72c7700 1 --2- 172.21.15.8:0/3504106648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cd006b9c0 0x7f9cd0069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.023+0000 7f9cd72c7700 1 -- 172.21.15.8:0/3504106648 >> 172.21.15.8:0/3504106648 conn(0x7f9cd00f1c90 msgr2=0x7f9cd00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.023+0000 7f9cd72c7700 1 -- 172.21.15.8:0/3504106648 shutdown_connections 2023-10-18T22:09:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.023+0000 7f9cd72c7700 1 -- 172.21.15.8:0/3504106648 wait complete. 2023-10-18T22:09:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.024+0000 7f9cd72c7700 1 Processor -- start 2023-10-18T22:09:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.024+0000 7f9cd72c7700 1 -- start start 2023-10-18T22:09:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.024+0000 7f9cd72c7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cd006a3b0 0x7f9cd0108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.024+0000 7f9cd72c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cd006b9c0 0x7f9cd0109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.024+0000 7f9cd72c7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd0109a10 con 0x7f9cd006a3b0 2023-10-18T22:09:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.024+0000 7f9cd72c7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd0109b50 con 0x7f9cd006b9c0 2023-10-18T22:09:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.025+0000 7f9cd62c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cd006a3b0 0x7f9cd0108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.025+0000 7f9cd62c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cd006a3b0 0x7f9cd0108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54002/0 (socket says 172.21.15.8:54002) 2023-10-18T22:09:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.025+0000 7f9cd62c5700 1 -- 172.21.15.8:0/2650351204 learned_addr learned my addr 172.21.15.8:0/2650351204 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:09:36.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.025+0000 7f9cd5ac4700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cd006b9c0 0x7f9cd0109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:36.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.025+0000 7f9cd62c5700 1 -- 172.21.15.8:0/2650351204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cd006b9c0 msgr2=0x7f9cd0109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:36.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.025+0000 7f9cd62c5700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cd006b9c0 0x7f9cd0109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:36.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.025+0000 7f9cd62c5700 1 -- 172.21.15.8:0/2650351204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc0005040 con 0x7f9cd006a3b0 2023-10-18T22:09:36.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.025+0000 7f9cd62c5700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cd006a3b0 0x7f9cd0108f70 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f9ccc0026d0 tx=0x7f9ccc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:36.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.026+0000 7f9cc6ffd700 1 -- 172.21.15.8:0/2650351204 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ccc0079c0 con 0x7f9cd006a3b0 2023-10-18T22:09:36.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.026+0000 7f9cc6ffd700 1 -- 172.21.15.8:0/2650351204 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9ccc00f040 con 0x7f9cd006a3b0 2023-10-18T22:09:36.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.026+0000 7f9cc6ffd700 1 -- 172.21.15.8:0/2650351204 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ccc014980 con 0x7f9cd006a3b0 2023-10-18T22:09:36.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.026+0000 7f9cd72c7700 1 -- 172.21.15.8:0/2650351204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd010a4f0 con 0x7f9cd006a3b0 2023-10-18T22:09:36.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.026+0000 7f9cd72c7700 1 -- 172.21.15.8:0/2650351204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd010aab0 con 0x7f9cd006a3b0 2023-10-18T22:09:36.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.027+0000 7f9cd72c7700 1 -- 172.21.15.8:0/2650351204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd0045ad0 con 0x7f9cd006a3b0 2023-10-18T22:09:36.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.028+0000 7f9cc6ffd700 1 -- 172.21.15.8:0/2650351204 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9ccc0090d0 con 0x7f9cd006a3b0 2023-10-18T22:09:36.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.029+0000 7f9cc6ffd700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9cbc060f70 0x7f9cbc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:09:36.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.029+0000 7f9cc6ffd700 1 -- 172.21.15.8:0/2650351204 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9ccc07c8a0 con 0x7f9cd006a3b0 2023-10-18T22:09:36.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.029+0000 7f9cd5ac4700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9cbc060f70 0x7f9cbc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:09:36.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.029+0000 7f9cd5ac4700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9cbc060f70 0x7f9cbc063430 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f9cc0004630 tx=0x7f9cc0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:09:36.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.033+0000 7f9cc6ffd700 1 -- 172.21.15.8:0/2650351204 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9ccc04ffb0 con 0x7f9cd006a3b0 2023-10-18T22:09:36.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.230+0000 7f9cd72c7700 1 -- 172.21.15.8:0/2650351204 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cd0100ff0 con 0x7f9cbc060f70 2023-10-18T22:09:36.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.231+0000 7f9cc6ffd700 1 -- 172.21.15.8:0/2650351204 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9cd0100ff0 con 0x7f9cbc060f70 2023-10-18T22:09:36.232 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:09:36.232 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:09:36.233 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:09:36.233 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:09:36.233 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:09:36.233 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:09:36.233 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:09:36.234 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:09:36.234 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:09:36.234 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:09:36.234 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:09:36.235 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:09:36.235 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:09:36.235 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:09:36.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 -- 172.21.15.8:0/2650351204 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9cbc060f70 msgr2=0x7f9cbc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:36.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9cbc060f70 0x7f9cbc063430 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f9cc0004630 tx=0x7f9cc0009b30).stop 2023-10-18T22:09:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 -- 172.21.15.8:0/2650351204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cd006a3b0 msgr2=0x7f9cd0108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:09:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cd006a3b0 0x7f9cd0108f70 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f9ccc0026d0 tx=0x7f9ccc009de0).stop 2023-10-18T22:09:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 -- 172.21.15.8:0/2650351204 shutdown_connections 2023-10-18T22:09:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9cbc060f70 0x7f9cbc063430 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cd006a3b0 0x7f9cd0108f70 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 --2- 172.21.15.8:0/2650351204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cd006b9c0 0x7f9cd0109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:09:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 -- 172.21.15.8:0/2650351204 >> 172.21.15.8:0/2650351204 conn(0x7f9cd00f1c90 msgr2=0x7f9cd00fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:09:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 -- 172.21.15.8:0/2650351204 shutdown_connections 2023-10-18T22:09:36.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:09:36.233+0000 7f9cd72c7700 1 -- 172.21.15.8:0/2650351204 wait complete. 2023-10-18T22:09:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:34.402232+0000 mgr.smithi008.flmjzp (mgr.14640) 4240 : audit [DBG] from='client.37432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:34.750377+0000 mgr.smithi008.flmjzp (mgr.14640) 4241 : audit [DBG] from='client.37436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:35.096389+0000 mgr.smithi008.flmjzp (mgr.14640) 4242 : audit [DBG] from='client.37440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:35.509524+0000 mon.smithi008 (mon.0) 4550 : audit [DBG] from='client.? 172.21.15.8:0/2034199371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:35.884411+0000 mon.smithi008 (mon.0) 4551 : audit [DBG] from='client.? 172.21.15.8:0/3763472989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:09:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:34.402232+0000 mgr.smithi008.flmjzp (mgr.14640) 4240 : audit [DBG] from='client.37432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:34.750377+0000 mgr.smithi008.flmjzp (mgr.14640) 4241 : audit [DBG] from='client.37436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:35.096389+0000 mgr.smithi008.flmjzp (mgr.14640) 4242 : audit [DBG] from='client.37440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:35.509524+0000 mon.smithi008 (mon.0) 4550 : audit [DBG] from='client.? 172.21.15.8:0/2034199371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:35.884411+0000 mon.smithi008 (mon.0) 4551 : audit [DBG] from='client.? 172.21.15.8:0/3763472989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:09:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:35.542075+0000 mgr.smithi008.flmjzp (mgr.14640) 4243 : cluster [DBG] pgmap v2912: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:36.231287+0000 mgr.smithi008.flmjzp (mgr.14640) 4244 : audit [DBG] from='client.37452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:35.542075+0000 mgr.smithi008.flmjzp (mgr.14640) 4243 : cluster [DBG] pgmap v2912: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:36.231287+0000 mgr.smithi008.flmjzp (mgr.14640) 4244 : audit [DBG] from='client.37452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:09:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:37.542677+0000 mgr.smithi008.flmjzp (mgr.14640) 4245 : cluster [DBG] pgmap v2913: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:37.542677+0000 mgr.smithi008.flmjzp (mgr.14640) 4245 : cluster [DBG] pgmap v2913: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:39.543468+0000 mgr.smithi008.flmjzp (mgr.14640) 4246 : cluster [DBG] pgmap v2914: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:39.543468+0000 mgr.smithi008.flmjzp (mgr.14640) 4246 : cluster [DBG] pgmap v2914: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:41.569984+0000 mon.smithi008 (mon.0) 4552 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:42.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:41.572052+0000 mon.smithi008 (mon.0) 4553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:42.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:41.573096+0000 mon.smithi008 (mon.0) 4554 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:42.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:41.579684+0000 mon.smithi008 (mon.0) 4555 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:42.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:41.586215+0000 mon.smithi008 (mon.0) 4556 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:42.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:41.589358+0000 mon.smithi008 (mon.0) 4557 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:42.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:41.591076+0000 mon.smithi008 (mon.0) 4558 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:42.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:41.592706+0000 mon.smithi008 (mon.0) 4559 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:42.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:41.594745+0000 mon.smithi008 (mon.0) 4560 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:41.569984+0000 mon.smithi008 (mon.0) 4552 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:41.572052+0000 mon.smithi008 (mon.0) 4553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:41.573096+0000 mon.smithi008 (mon.0) 4554 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:41.579684+0000 mon.smithi008 (mon.0) 4555 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:41.586215+0000 mon.smithi008 (mon.0) 4556 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:41.589358+0000 mon.smithi008 (mon.0) 4557 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:41.591076+0000 mon.smithi008 (mon.0) 4558 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:41.592706+0000 mon.smithi008 (mon.0) 4559 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:41.594745+0000 mon.smithi008 (mon.0) 4560 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:41.543953+0000 mgr.smithi008.flmjzp (mgr.14640) 4247 : cluster [DBG] pgmap v2915: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:41.573969+0000 mgr.smithi008.flmjzp (mgr.14640) 4248 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:41.574522+0000 mgr.smithi008.flmjzp (mgr.14640) 4249 : cluster [DBG] pgmap v2916: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:41.574755+0000 mgr.smithi008.flmjzp (mgr.14640) 4250 : cluster [DBG] pgmap v2917: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:43.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:41.596622+0000 mgr.smithi008.flmjzp (mgr.14640) 4251 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:41.543953+0000 mgr.smithi008.flmjzp (mgr.14640) 4247 : cluster [DBG] pgmap v2915: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:41.573969+0000 mgr.smithi008.flmjzp (mgr.14640) 4248 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:41.574522+0000 mgr.smithi008.flmjzp (mgr.14640) 4249 : cluster [DBG] pgmap v2916: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:41.574755+0000 mgr.smithi008.flmjzp (mgr.14640) 4250 : cluster [DBG] pgmap v2917: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:41.596622+0000 mgr.smithi008.flmjzp (mgr.14640) 4251 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:45.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:43.575556+0000 mgr.smithi008.flmjzp (mgr.14640) 4252 : cluster [DBG] pgmap v2918: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:43.575556+0000 mgr.smithi008.flmjzp (mgr.14640) 4252 : cluster [DBG] pgmap v2918: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:45.576260+0000 mgr.smithi008.flmjzp (mgr.14640) 4253 : cluster [DBG] pgmap v2919: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:45.576260+0000 mgr.smithi008.flmjzp (mgr.14640) 4253 : cluster [DBG] pgmap v2919: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:47.576736+0000 mgr.smithi008.flmjzp (mgr.14640) 4254 : cluster [DBG] pgmap v2920: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:47.576736+0000 mgr.smithi008.flmjzp (mgr.14640) 4254 : cluster [DBG] pgmap v2920: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:49.577442+0000 mgr.smithi008.flmjzp (mgr.14640) 4255 : cluster [DBG] pgmap v2921: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:51.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:49.577442+0000 mgr.smithi008.flmjzp (mgr.14640) 4255 : cluster [DBG] pgmap v2921: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:51.599177+0000 mon.smithi008 (mon.0) 4561 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:52.160413+0000 mon.smithi008 (mon.0) 4562 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:52.161215+0000 mon.smithi008 (mon.0) 4563 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:52.166391+0000 mon.smithi008 (mon.0) 4564 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:52.172041+0000 mon.smithi008 (mon.0) 4565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:52.174391+0000 mon.smithi008 (mon.0) 4566 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:52.175637+0000 mon.smithi008 (mon.0) 4567 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:52.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:52.176811+0000 mon.smithi008 (mon.0) 4568 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:52.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:09:52.178324+0000 mon.smithi008 (mon.0) 4569 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:51.599177+0000 mon.smithi008 (mon.0) 4561 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:52.160413+0000 mon.smithi008 (mon.0) 4562 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:09:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:52.161215+0000 mon.smithi008 (mon.0) 4563 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:09:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:52.166391+0000 mon.smithi008 (mon.0) 4564 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:09:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:52.172041+0000 mon.smithi008 (mon.0) 4565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:09:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:52.174391+0000 mon.smithi008 (mon.0) 4566 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:52.175637+0000 mon.smithi008 (mon.0) 4567 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:52.176811+0000 mon.smithi008 (mon.0) 4568 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:09:52.178324+0000 mon.smithi008 (mon.0) 4569 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:09:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:51.577945+0000 mgr.smithi008.flmjzp (mgr.14640) 4256 : cluster [DBG] pgmap v2922: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:52.161836+0000 mgr.smithi008.flmjzp (mgr.14640) 4257 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:52.162329+0000 mgr.smithi008.flmjzp (mgr.14640) 4258 : cluster [DBG] pgmap v2923: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:52.162601+0000 mgr.smithi008.flmjzp (mgr.14640) 4259 : cluster [DBG] pgmap v2924: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:53.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:09:52.179900+0000 mgr.smithi008.flmjzp (mgr.14640) 4260 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:51.577945+0000 mgr.smithi008.flmjzp (mgr.14640) 4256 : cluster [DBG] pgmap v2922: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:52.161836+0000 mgr.smithi008.flmjzp (mgr.14640) 4257 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:09:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:52.162329+0000 mgr.smithi008.flmjzp (mgr.14640) 4258 : cluster [DBG] pgmap v2923: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:52.162601+0000 mgr.smithi008.flmjzp (mgr.14640) 4259 : cluster [DBG] pgmap v2924: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:09:52.179900+0000 mgr.smithi008.flmjzp (mgr.14640) 4260 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:09:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:54.163150+0000 mgr.smithi008.flmjzp (mgr.14640) 4261 : cluster [DBG] pgmap v2925: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:54.163150+0000 mgr.smithi008.flmjzp (mgr.14640) 4261 : cluster [DBG] pgmap v2925: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:56.163825+0000 mgr.smithi008.flmjzp (mgr.14640) 4262 : cluster [DBG] pgmap v2926: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:56.163825+0000 mgr.smithi008.flmjzp (mgr.14640) 4262 : cluster [DBG] pgmap v2926: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:09:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:09:58.164511+0000 mgr.smithi008.flmjzp (mgr.14640) 4263 : cluster [DBG] pgmap v2927: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:09:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:09:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:09:58.164511+0000 mgr.smithi008.flmjzp (mgr.14640) 4263 : cluster [DBG] pgmap v2927: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:00.000214+0000 mon.smithi008 (mon.0) 4570 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T22:10:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:00.000214+0000 mon.smithi008 (mon.0) 4570 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T22:10:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:00.165056+0000 mgr.smithi008.flmjzp (mgr.14640) 4264 : cluster [DBG] pgmap v2928: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:00.165056+0000 mgr.smithi008.flmjzp (mgr.14640) 4264 : cluster [DBG] pgmap v2928: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:02.190601+0000 mon.smithi008 (mon.0) 4571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:02.192748+0000 mon.smithi008 (mon.0) 4572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:02.193768+0000 mon.smithi008 (mon.0) 4573 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:02.200083+0000 mon.smithi008 (mon.0) 4574 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:02.206710+0000 mon.smithi008 (mon.0) 4575 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:02.209807+0000 mon.smithi008 (mon.0) 4576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:02.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:02.211469+0000 mon.smithi008 (mon.0) 4577 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:02.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:02.213018+0000 mon.smithi008 (mon.0) 4578 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:02.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:02.215005+0000 mon.smithi008 (mon.0) 4579 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:02.190601+0000 mon.smithi008 (mon.0) 4571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:02.192748+0000 mon.smithi008 (mon.0) 4572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:02.193768+0000 mon.smithi008 (mon.0) 4573 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:02.200083+0000 mon.smithi008 (mon.0) 4574 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:02.206710+0000 mon.smithi008 (mon.0) 4575 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:02.209807+0000 mon.smithi008 (mon.0) 4576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:02.211469+0000 mon.smithi008 (mon.0) 4577 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:02.213018+0000 mon.smithi008 (mon.0) 4578 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:02.215005+0000 mon.smithi008 (mon.0) 4579 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:02.165659+0000 mgr.smithi008.flmjzp (mgr.14640) 4265 : cluster [DBG] pgmap v2929: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:02.194656+0000 mgr.smithi008.flmjzp (mgr.14640) 4266 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:02.195238+0000 mgr.smithi008.flmjzp (mgr.14640) 4267 : cluster [DBG] pgmap v2930: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:02.195582+0000 mgr.smithi008.flmjzp (mgr.14640) 4268 : cluster [DBG] pgmap v2931: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:02.216824+0000 mgr.smithi008.flmjzp (mgr.14640) 4269 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:02.165659+0000 mgr.smithi008.flmjzp (mgr.14640) 4265 : cluster [DBG] pgmap v2929: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:02.194656+0000 mgr.smithi008.flmjzp (mgr.14640) 4266 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:02.195238+0000 mgr.smithi008.flmjzp (mgr.14640) 4267 : cluster [DBG] pgmap v2930: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:02.195582+0000 mgr.smithi008.flmjzp (mgr.14640) 4268 : cluster [DBG] pgmap v2931: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:02.216824+0000 mgr.smithi008.flmjzp (mgr.14640) 4269 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:04.196282+0000 mgr.smithi008.flmjzp (mgr.14640) 4270 : cluster [DBG] pgmap v2932: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:04.196282+0000 mgr.smithi008.flmjzp (mgr.14640) 4270 : cluster [DBG] pgmap v2932: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.385+0000 7f9826793700 1 -- 172.21.15.8:0/2129960651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982006a3b0 msgr2=0x7f982006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.385+0000 7f9826793700 1 --2- 172.21.15.8:0/2129960651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982006a3b0 0x7f982006a830 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f9810004660 tx=0x7f9810009b30).stop 2023-10-18T22:10:06.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.386+0000 7f9826793700 1 -- 172.21.15.8:0/2129960651 shutdown_connections 2023-10-18T22:10:06.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.386+0000 7f9826793700 1 --2- 172.21.15.8:0/2129960651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982006a3b0 0x7f982006a830 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:06.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.386+0000 7f9826793700 1 --2- 172.21.15.8:0/2129960651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f982006b9c0 0x7f9820069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:06.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.386+0000 7f9826793700 1 -- 172.21.15.8:0/2129960651 >> 172.21.15.8:0/2129960651 conn(0x7f98200f1c90 msgr2=0x7f98200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:06.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.386+0000 7f9826793700 1 -- 172.21.15.8:0/2129960651 shutdown_connections 2023-10-18T22:10:06.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.386+0000 7f9826793700 1 -- 172.21.15.8:0/2129960651 wait complete. 2023-10-18T22:10:06.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.386+0000 7f9826793700 1 Processor -- start 2023-10-18T22:10:06.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.387+0000 7f9826793700 1 -- start start 2023-10-18T22:10:06.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.387+0000 7f9826793700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f982006a3b0 0x7f9820108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:06.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.387+0000 7f9826793700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982006b9c0 0x7f9820109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:06.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.387+0000 7f9826793700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820109a10 con 0x7f982006b9c0 2023-10-18T22:10:06.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.387+0000 7f9826793700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820109b50 con 0x7f982006a3b0 2023-10-18T22:10:06.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.387+0000 7f9824f90700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982006b9c0 0x7f9820109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:06.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.387+0000 7f9825791700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f982006a3b0 0x7f9820108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:06.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.387+0000 7f9824f90700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982006b9c0 0x7f9820109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53520/0 (socket says 172.21.15.8:53520) 2023-10-18T22:10:06.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.387+0000 7f9824f90700 1 -- 172.21.15.8:0/2970234492 learned_addr learned my addr 172.21.15.8:0/2970234492 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:06.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.388+0000 7f9824f90700 1 -- 172.21.15.8:0/2970234492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f982006a3b0 msgr2=0x7f9820108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:06.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.388+0000 7f9824f90700 1 --2- 172.21.15.8:0/2970234492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f982006a3b0 0x7f9820108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:06.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.388+0000 7f9824f90700 1 -- 172.21.15.8:0/2970234492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810005040 con 0x7f982006b9c0 2023-10-18T22:10:06.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.388+0000 7f9824f90700 1 --2- 172.21.15.8:0/2970234492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982006b9c0 0x7f9820109460 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f9810009990 tx=0x7f9810009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:06.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.388+0000 7f9815ffb700 1 -- 172.21.15.8:0/2970234492 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9810018070 con 0x7f982006b9c0 2023-10-18T22:10:06.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.388+0000 7f9815ffb700 1 -- 172.21.15.8:0/2970234492 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9810009630 con 0x7f982006b9c0 2023-10-18T22:10:06.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.388+0000 7f9815ffb700 1 -- 172.21.15.8:0/2970234492 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f981001c3c0 con 0x7f982006b9c0 2023-10-18T22:10:06.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.388+0000 7f9826793700 1 -- 172.21.15.8:0/2970234492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982010a490 con 0x7f982006b9c0 2023-10-18T22:10:06.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.388+0000 7f9826793700 1 -- 172.21.15.8:0/2970234492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982010a9f0 con 0x7f982006b9c0 2023-10-18T22:10:06.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.389+0000 7f9826793700 1 -- 172.21.15.8:0/2970234492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9820045ad0 con 0x7f982006b9c0 2023-10-18T22:10:06.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.390+0000 7f9815ffb700 1 -- 172.21.15.8:0/2970234492 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f981001d970 con 0x7f982006b9c0 2023-10-18T22:10:06.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.391+0000 7f9815ffb700 1 --2- 172.21.15.8:0/2970234492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f980c060f70 0x7f980c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:06.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.391+0000 7f9815ffb700 1 -- 172.21.15.8:0/2970234492 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f981007e580 con 0x7f982006b9c0 2023-10-18T22:10:06.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.392+0000 7f9825791700 1 --2- 172.21.15.8:0/2970234492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f980c060f70 0x7f980c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:06.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.392+0000 7f9825791700 1 --2- 172.21.15.8:0/2970234492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f980c060f70 0x7f980c063430 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f981c004c40 tx=0x7f981c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.396+0000 7f9815ffb700 1 -- 172.21.15.8:0/2970234492 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9810051be0 con 0x7f982006b9c0 2023-10-18T22:10:06.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.592+0000 7f9826793700 1 -- 172.21.15.8:0/2970234492 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9820100f20 con 0x7f980c060f70 2023-10-18T22:10:06.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.594+0000 7f9815ffb700 1 -- 172.21.15.8:0/2970234492 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9820100f20 con 0x7f980c060f70 2023-10-18T22:10:06.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 -- 172.21.15.8:0/2970234492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f980c060f70 msgr2=0x7f980c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:06.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 --2- 172.21.15.8:0/2970234492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f980c060f70 0x7f980c063430 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f981c004c40 tx=0x7f981c00b040).stop 2023-10-18T22:10:06.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 -- 172.21.15.8:0/2970234492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982006b9c0 msgr2=0x7f9820109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:06.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 --2- 172.21.15.8:0/2970234492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982006b9c0 0x7f9820109460 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f9810009990 tx=0x7f9810009b30).stop 2023-10-18T22:10:06.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 -- 172.21.15.8:0/2970234492 shutdown_connections 2023-10-18T22:10:06.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 --2- 172.21.15.8:0/2970234492 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f980c060f70 0x7f980c063430 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:06.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 --2- 172.21.15.8:0/2970234492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f982006a3b0 0x7f9820108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:06.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 --2- 172.21.15.8:0/2970234492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f982006b9c0 0x7f9820109460 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:06.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 -- 172.21.15.8:0/2970234492 >> 172.21.15.8:0/2970234492 conn(0x7f98200f1c90 msgr2=0x7f98200fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:06.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 -- 172.21.15.8:0/2970234492 shutdown_connections 2023-10-18T22:10:06.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.596+0000 7f9826793700 1 -- 172.21.15.8:0/2970234492 wait complete. 2023-10-18T22:10:06.612 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:10:06.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.733+0000 7fa8dafef700 1 -- 172.21.15.8:0/1316965106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40f77d0 msgr2=0x7fa8d40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:06.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.733+0000 7fa8dafef700 1 --2- 172.21.15.8:0/1316965106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40f77d0 0x7fa8d40f7c30 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7fa8c4004660 tx=0x7fa8c4009b30).stop 2023-10-18T22:10:06.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.733+0000 7fa8dafef700 1 -- 172.21.15.8:0/1316965106 shutdown_connections 2023-10-18T22:10:06.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.733+0000 7fa8dafef700 1 --2- 172.21.15.8:0/1316965106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40f77d0 0x7fa8d40f7c30 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:06.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.733+0000 7fa8dafef700 1 --2- 172.21.15.8:0/1316965106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d40f6530 0x7fa8d40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:06.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.733+0000 7fa8dafef700 1 -- 172.21.15.8:0/1316965106 >> 172.21.15.8:0/1316965106 conn(0x7fa8d40f1c90 msgr2=0x7fa8d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:06.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.733+0000 7fa8dafef700 1 -- 172.21.15.8:0/1316965106 shutdown_connections 2023-10-18T22:10:06.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.733+0000 7fa8dafef700 1 -- 172.21.15.8:0/1316965106 wait complete. 2023-10-18T22:10:06.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.734+0000 7fa8dafef700 1 Processor -- start 2023-10-18T22:10:06.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.734+0000 7fa8dafef700 1 -- start start 2023-10-18T22:10:06.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.734+0000 7fa8dafef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d40f6530 0x7fa8d4108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:06.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.734+0000 7fa8dafef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40f77d0 0x7fa8d4109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:06.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.734+0000 7fa8dafef700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d41099c0 con 0x7fa8d40f77d0 2023-10-18T22:10:06.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.734+0000 7fa8dafef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4109b00 con 0x7fa8d40f6530 2023-10-18T22:10:06.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.735+0000 7fa8d97ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40f77d0 0x7fa8d4109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:06.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.735+0000 7fa8d97ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40f77d0 0x7fa8d4109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53536/0 (socket says 172.21.15.8:53536) 2023-10-18T22:10:06.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.735+0000 7fa8d97ec700 1 -- 172.21.15.8:0/3613555422 learned_addr learned my addr 172.21.15.8:0/3613555422 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.735+0000 7fa8d97ec700 1 -- 172.21.15.8:0/3613555422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d40f6530 msgr2=0x7fa8d4108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.735+0000 7fa8d97ec700 1 --2- 172.21.15.8:0/3613555422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d40f6530 0x7fa8d4108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:10:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.735+0000 7fa8d97ec700 1 -- 172.21.15.8:0/3613555422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4005040 con 0x7fa8d40f77d0 2023-10-18T22:10:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.735+0000 7fa8d97ec700 1 --2- 172.21.15.8:0/3613555422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40f77d0 0x7fa8d4109410 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7fa8c4004d80 tx=0x7fa8c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.735+0000 7fa8ca7fc700 1 -- 172.21.15.8:0/3613555422 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8c4019070 con 0x7fa8d40f77d0 2023-10-18T22:10:06.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.736+0000 7fa8ca7fc700 1 -- 172.21.15.8:0/3613555422 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa8c401e420 con 0x7fa8d40f77d0 2023-10-18T22:10:06.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.736+0000 7fa8ca7fc700 1 -- 172.21.15.8:0/3613555422 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8c4014680 con 0x7fa8d40f77d0 2023-10-18T22:10:06.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.736+0000 7fa8dafef700 1 -- 172.21.15.8:0/3613555422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d410a440 con 0x7fa8d40f77d0 2023-10-18T22:10:06.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.736+0000 7fa8dafef700 1 -- 172.21.15.8:0/3613555422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d410a8d0 con 0x7fa8d40f77d0 2023-10-18T22:10:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.737+0000 7fa8dafef700 1 -- 172.21.15.8:0/3613555422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d4045ad0 con 0x7fa8d40f77d0 2023-10-18T22:10:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.738+0000 7fa8ca7fc700 1 -- 172.21.15.8:0/3613555422 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa8c401e9c0 con 0x7fa8d40f77d0 2023-10-18T22:10:06.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.738+0000 7fa8ca7fc700 1 --2- 172.21.15.8:0/3613555422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c0060f70 0x7fa8c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:06.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.739+0000 7fa8ca7fc700 1 -- 172.21.15.8:0/3613555422 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa8c407deb0 con 0x7fa8d40f77d0 2023-10-18T22:10:06.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.739+0000 7fa8d9fed700 1 --2- 172.21.15.8:0/3613555422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c0060f70 0x7fa8c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:06.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.739+0000 7fa8d9fed700 1 --2- 172.21.15.8:0/3613555422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c0060f70 0x7fa8c0063430 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fa8d40f7630 tx=0x7fa8d000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:06.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.743+0000 7fa8ca7fc700 1 -- 172.21.15.8:0/3613555422 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa8c4051490 con 0x7fa8d40f77d0 2023-10-18T22:10:06.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.942+0000 7fa8dafef700 1 -- 172.21.15.8:0/3613555422 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8d410aaf0 con 0x7fa8c0060f70 2023-10-18T22:10:06.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.944+0000 7fa8ca7fc700 1 -- 172.21.15.8:0/3613555422 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa8d410aaf0 con 0x7fa8c0060f70 2023-10-18T22:10:06.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 -- 172.21.15.8:0/3613555422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c0060f70 msgr2=0x7fa8c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:06.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 --2- 172.21.15.8:0/3613555422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c0060f70 0x7fa8c0063430 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fa8d40f7630 tx=0x7fa8d000b040).stop 2023-10-18T22:10:06.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 -- 172.21.15.8:0/3613555422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40f77d0 msgr2=0x7fa8d4109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:06.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 --2- 172.21.15.8:0/3613555422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40f77d0 0x7fa8d4109410 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7fa8c4004d80 tx=0x7fa8c400b040).stop 2023-10-18T22:10:06.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 -- 172.21.15.8:0/3613555422 shutdown_connections 2023-10-18T22:10:06.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 --2- 172.21.15.8:0/3613555422 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8c0060f70 0x7fa8c0063430 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:06.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 --2- 172.21.15.8:0/3613555422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d40f6530 0x7fa8d4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:10:06.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 --2- 172.21.15.8:0/3613555422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40f77d0 0x7fa8d4109410 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:06.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 -- 172.21.15.8:0/3613555422 >> 172.21.15.8:0/3613555422 conn(0x7fa8d40f1c90 msgr2=0x7fa8d406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:06.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 -- 172.21.15.8:0/3613555422 shutdown_connections 2023-10-18T22:10:06.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:06.946+0000 7fa8dafef700 1 -- 172.21.15.8:0/3613555422 wait complete. 2023-10-18T22:10:07.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.086+0000 7fcb9a42f700 1 -- 172.21.15.8:0/3177322376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb940f6530 msgr2=0x7fcb940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:07.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.086+0000 7fcb9a42f700 1 --2- 172.21.15.8:0/3177322376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb940f6530 0x7fcb940f6950 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7fcb90004660 tx=0x7fcb90009b30).stop 2023-10-18T22:10:07.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.086+0000 7fcb9a42f700 1 -- 172.21.15.8:0/3177322376 shutdown_connections 2023-10-18T22:10:07.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.086+0000 7fcb9a42f700 1 --2- 172.21.15.8:0/3177322376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb940f77d0 0x7fcb940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.086+0000 7fcb9a42f700 1 --2- 172.21.15.8:0/3177322376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb940f6530 0x7fcb940f6950 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.086+0000 7fcb9a42f700 1 -- 172.21.15.8:0/3177322376 >> 172.21.15.8:0/3177322376 conn(0x7fcb940f1c90 msgr2=0x7fcb940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:07.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.086+0000 7fcb9a42f700 1 -- 172.21.15.8:0/3177322376 shutdown_connections 2023-10-18T22:10:07.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.086+0000 7fcb9a42f700 1 -- 172.21.15.8:0/3177322376 wait complete. 2023-10-18T22:10:07.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.087+0000 7fcb9a42f700 1 Processor -- start 2023-10-18T22:10:07.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.087+0000 7fcb9a42f700 1 -- start start 2023-10-18T22:10:07.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb9a42f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb940f6530 0x7fcb94108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:07.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb9a42f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb940f77d0 0x7fcb94109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:07.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb9a42f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb941099f0 con 0x7fcb940f77d0 2023-10-18T22:10:07.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb9a42f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94109b30 con 0x7fcb940f6530 2023-10-18T22:10:07.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb98c2c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb940f77d0 0x7fcb94109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:07.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb98c2c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb940f77d0 0x7fcb94109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35088/0 (socket says 172.21.15.8:35088) 2023-10-18T22:10:07.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb98c2c700 1 -- 172.21.15.8:0/742452219 learned_addr learned my addr 172.21.15.8:0/742452219 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:07.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb9942d700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb940f6530 0x7fcb94108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:07.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb98c2c700 1 -- 172.21.15.8:0/742452219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb940f6530 msgr2=0x7fcb94108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:07.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb98c2c700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb940f6530 0x7fcb94108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb98c2c700 1 -- 172.21.15.8:0/742452219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90005040 con 0x7fcb940f77d0 2023-10-18T22:10:07.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb9942d700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb940f6530 0x7fcb94108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:10:07.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.088+0000 7fcb98c2c700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb940f77d0 0x7fcb94109440 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fcb84002700 tx=0x7fcb84009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:07.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.089+0000 7fcb89ffb700 1 -- 172.21.15.8:0/742452219 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb84009320 con 0x7fcb940f77d0 2023-10-18T22:10:07.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.089+0000 7fcb89ffb700 1 -- 172.21.15.8:0/742452219 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcb8400f040 con 0x7fcb940f77d0 2023-10-18T22:10:07.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.089+0000 7fcb9a42f700 1 -- 172.21.15.8:0/742452219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9410a4d0 con 0x7fcb940f77d0 2023-10-18T22:10:07.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.089+0000 7fcb89ffb700 1 -- 172.21.15.8:0/742452219 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb840148a0 con 0x7fcb940f77d0 2023-10-18T22:10:07.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.089+0000 7fcb9a42f700 1 -- 172.21.15.8:0/742452219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9410aa90 con 0x7fcb940f77d0 2023-10-18T22:10:07.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.090+0000 7fcb9a42f700 1 -- 172.21.15.8:0/742452219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb94045ad0 con 0x7fcb940f77d0 2023-10-18T22:10:07.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.091+0000 7fcb89ffb700 1 -- 172.21.15.8:0/742452219 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcb84009480 con 0x7fcb940f77d0 2023-10-18T22:10:07.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.092+0000 7fcb89ffb700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb80060f70 0x7fcb80063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:07.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.092+0000 7fcb89ffb700 1 -- 172.21.15.8:0/742452219 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcb8407cc00 con 0x7fcb940f77d0 2023-10-18T22:10:07.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.092+0000 7fcb9942d700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb80060f70 0x7fcb80063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:07.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.093+0000 7fcb9942d700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb80060f70 0x7fcb80063430 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7fcb90009d60 tx=0x7fcb90009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.096+0000 7fcb89ffb700 1 -- 172.21.15.8:0/742452219 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcb840501e0 con 0x7fcb940f77d0 2023-10-18T22:10:07.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.286+0000 7fcb9a42f700 1 -- 172.21.15.8:0/742452219 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb940fee70 con 0x7fcb80060f70 2023-10-18T22:10:07.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.296+0000 7fcb89ffb700 1 -- 172.21.15.8:0/742452219 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcb90013410 con 0x7fcb80060f70 2023-10-18T22:10:07.299 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:10:07.299 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (76m) 4m ago 78m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:10:07.299 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (70m) 4m ago 78m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:10:07.299 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (70m) 117s ago 77m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:10:07.300 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (76m) 4m ago 77m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:10:07.300 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 74m - - 2023-10-18T22:10:07.300 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 74m - - 2023-10-18T22:10:07.300 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 117s ago 74m - - 2023-10-18T22:10:07.300 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 117s ago 74m - - 2023-10-18T22:10:07.301 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (71m) 4m ago 79m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:10:07.301 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (71m) 117s ago 77m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:10:07.301 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (71m) 4m ago 79m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:10:07.301 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (70m) 117s ago 77m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:10:07.301 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (77m) 4m ago 77m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:10:07.302 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (77m) 117s ago 77m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:10:07.302 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (70m) 4m ago 76m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:10:07.302 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (68m) 4m ago 76m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:10:07.302 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (67m) 4m ago 76m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:10:07.302 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (67m) 117s ago 75m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:10:07.303 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (66m) 117s ago 75m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:10:07.303 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (66m) 117s ago 75m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:10:07.303 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (72m) 4m ago 77m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:10:07.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 -- 172.21.15.8:0/742452219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb80060f70 msgr2=0x7fcb80063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:07.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb80060f70 0x7fcb80063430 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7fcb90009d60 tx=0x7fcb90009b30).stop 2023-10-18T22:10:07.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 -- 172.21.15.8:0/742452219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb940f77d0 msgr2=0x7fcb94109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:07.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb940f77d0 0x7fcb94109440 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fcb84002700 tx=0x7fcb84009e00).stop 2023-10-18T22:10:07.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 -- 172.21.15.8:0/742452219 shutdown_connections 2023-10-18T22:10:07.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb80060f70 0x7fcb80063430 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb940f6530 0x7fcb94108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 --2- 172.21.15.8:0/742452219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb940f77d0 0x7fcb94109440 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 -- 172.21.15.8:0/742452219 >> 172.21.15.8:0/742452219 conn(0x7fcb940f1c90 msgr2=0x7fcb940f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:07.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 -- 172.21.15.8:0/742452219 shutdown_connections 2023-10-18T22:10:07.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.298+0000 7fcb9a42f700 1 -- 172.21.15.8:0/742452219 wait complete. 2023-10-18T22:10:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:06.197018+0000 mgr.smithi008.flmjzp (mgr.14640) 4271 : cluster [DBG] pgmap v2933: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:07.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.434+0000 7fd9b4940700 1 -- 172.21.15.8:0/295341029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9b00f6530 msgr2=0x7fd9b00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:07.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.434+0000 7fd9b4940700 1 --2- 172.21.15.8:0/295341029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9b00f6530 0x7fd9b00f6950 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7fd9a0004660 tx=0x7fd9a0009b30).stop 2023-10-18T22:10:07.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.434+0000 7fd9b4940700 1 -- 172.21.15.8:0/295341029 shutdown_connections 2023-10-18T22:10:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.434+0000 7fd9b4940700 1 --2- 172.21.15.8:0/295341029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b00f77d0 0x7fd9b00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.434+0000 7fd9b4940700 1 --2- 172.21.15.8:0/295341029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9b00f6530 0x7fd9b00f6950 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.434+0000 7fd9b4940700 1 -- 172.21.15.8:0/295341029 >> 172.21.15.8:0/295341029 conn(0x7fd9b00f1c90 msgr2=0x7fd9b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.435+0000 7fd9b4940700 1 -- 172.21.15.8:0/295341029 shutdown_connections 2023-10-18T22:10:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.435+0000 7fd9b4940700 1 -- 172.21.15.8:0/295341029 wait complete. 2023-10-18T22:10:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.436+0000 7fd9b4940700 1 Processor -- start 2023-10-18T22:10:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.436+0000 7fd9b4940700 1 -- start start 2023-10-18T22:10:07.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9b4940700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b00f6530 0x7fd9b0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:07.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9b4940700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9b00f77d0 0x7fd9b0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:07.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9b4940700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0107910 con 0x7fd9b00f77d0 2023-10-18T22:10:07.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9b4940700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0108120 con 0x7fd9b00f6530 2023-10-18T22:10:07.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9aeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9b00f77d0 0x7fd9b0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9aeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9b00f77d0 0x7fd9b0107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35102/0 (socket says 172.21.15.8:35102) 2023-10-18T22:10:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9aeffd700 1 -- 172.21.15.8:0/3333084596 learned_addr learned my addr 172.21.15.8:0/3333084596 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9af7fe700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b00f6530 0x7fd9b0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9aeffd700 1 -- 172.21.15.8:0/3333084596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b00f6530 msgr2=0x7fd9b0106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9aeffd700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b00f6530 0x7fd9b0106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9aeffd700 1 -- 172.21.15.8:0/3333084596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0005040 con 0x7fd9b00f77d0 2023-10-18T22:10:07.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.437+0000 7fd9aeffd700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9b00f77d0 0x7fd9b0107310 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7fd9a400c790 tx=0x7fd9a4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:07.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.438+0000 7fd997fff700 1 -- 172.21.15.8:0/3333084596 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a400e680 con 0x7fd9b00f77d0 2023-10-18T22:10:07.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.438+0000 7fd997fff700 1 -- 172.21.15.8:0/3333084596 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd9a400eca0 con 0x7fd9b00f77d0 2023-10-18T22:10:07.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.438+0000 7fd9b4940700 1 -- 172.21.15.8:0/3333084596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b01083a0 con 0x7fd9b00f77d0 2023-10-18T22:10:07.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.438+0000 7fd997fff700 1 -- 172.21.15.8:0/3333084596 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a4013de0 con 0x7fd9b00f77d0 2023-10-18T22:10:07.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.438+0000 7fd9b4940700 1 -- 172.21.15.8:0/3333084596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b0108960 con 0x7fd9b00f77d0 2023-10-18T22:10:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.439+0000 7fd9b4940700 1 -- 172.21.15.8:0/3333084596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b0059100 con 0x7fd9b00f77d0 2023-10-18T22:10:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.440+0000 7fd997fff700 1 -- 172.21.15.8:0/3333084596 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd9a401a060 con 0x7fd9b00f77d0 2023-10-18T22:10:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.441+0000 7fd997fff700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd998060f70 0x7fd998063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.441+0000 7fd997fff700 1 -- 172.21.15.8:0/3333084596 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd9a407cb70 con 0x7fd9b00f77d0 2023-10-18T22:10:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.441+0000 7fd9af7fe700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd998060f70 0x7fd998063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.442+0000 7fd9af7fe700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd998060f70 0x7fd998063430 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fd9a0009490 tx=0x7fd9a0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.445+0000 7fd997fff700 1 -- 172.21.15.8:0/3333084596 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd9a404c7a0 con 0x7fd9b00f77d0 2023-10-18T22:10:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:06.197018+0000 mgr.smithi008.flmjzp (mgr.14640) 4271 : cluster [DBG] pgmap v2933: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:07.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.700+0000 7fd9b4940700 1 -- 172.21.15.8:0/3333084596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd9b00fecc0 con 0x7fd9b00f77d0 2023-10-18T22:10:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.700+0000 7fd997fff700 1 -- 172.21.15.8:0/3333084596 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fd9a404fdc0 con 0x7fd9b00f77d0 2023-10-18T22:10:07.703 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:10:07.703 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:10:07.703 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:10:07.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:10:07.704 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:10:07.704 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:10:07.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:10:07.704 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:10:07.705 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:10:07.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:10:07.705 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:10:07.705 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:10:07.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:10:07.706 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:10:07.706 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:10:07.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:10:07.706 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:10:07.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.702+0000 7fd9b4940700 1 -- 172.21.15.8:0/3333084596 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd998060f70 msgr2=0x7fd998063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:07.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.702+0000 7fd9b4940700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd998060f70 0x7fd998063430 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fd9a0009490 tx=0x7fd9a0009b30).stop 2023-10-18T22:10:07.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.702+0000 7fd9b4940700 1 -- 172.21.15.8:0/3333084596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9b00f77d0 msgr2=0x7fd9b0107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:07.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.702+0000 7fd9b4940700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9b00f77d0 0x7fd9b0107310 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7fd9a400c790 tx=0x7fd9a4007d70).stop 2023-10-18T22:10:07.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.702+0000 7fd9b4940700 1 -- 172.21.15.8:0/3333084596 shutdown_connections 2023-10-18T22:10:07.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.702+0000 7fd9b4940700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd998060f70 0x7fd998063430 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.702+0000 7fd9b4940700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b00f6530 0x7fd9b0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.702+0000 7fd9b4940700 1 --2- 172.21.15.8:0/3333084596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9b00f77d0 0x7fd9b0107310 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.702+0000 7fd9b4940700 1 -- 172.21.15.8:0/3333084596 >> 172.21.15.8:0/3333084596 conn(0x7fd9b00f1c90 msgr2=0x7fd9b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.702+0000 7fd9b4940700 1 -- 172.21.15.8:0/3333084596 shutdown_connections 2023-10-18T22:10:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.703+0000 7fd9b4940700 1 -- 172.21.15.8:0/3333084596 wait complete. 2023-10-18T22:10:07.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.839+0000 7f397ef87700 1 -- 172.21.15.8:0/2768399707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3978060310 msgr2=0x7f39780f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:07.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.839+0000 7f397ef87700 1 --2- 172.21.15.8:0/2768399707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3978060310 0x7f39780f9120 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f3974004660 tx=0x7f3974009b30).stop 2023-10-18T22:10:07.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.839+0000 7f397ef87700 1 -- 172.21.15.8:0/2768399707 shutdown_connections 2023-10-18T22:10:07.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.839+0000 7f397ef87700 1 --2- 172.21.15.8:0/2768399707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39780f96a0 0x7f39780fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.839+0000 7f397ef87700 1 --2- 172.21.15.8:0/2768399707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3978060310 0x7f39780f9120 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.839+0000 7f397ef87700 1 -- 172.21.15.8:0/2768399707 >> 172.21.15.8:0/2768399707 conn(0x7f39780f0ba0 msgr2=0x7f39780f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.839+0000 7f397ef87700 1 -- 172.21.15.8:0/2768399707 shutdown_connections 2023-10-18T22:10:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.839+0000 7f397ef87700 1 -- 172.21.15.8:0/2768399707 wait complete. 2023-10-18T22:10:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.840+0000 7f397ef87700 1 Processor -- start 2023-10-18T22:10:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.840+0000 7f397ef87700 1 -- start start 2023-10-18T22:10:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.840+0000 7f397ef87700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3978060310 0x7f3978108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.840+0000 7f397ef87700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39780f96a0 0x7f39781093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.840+0000 7f397ef87700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39781099a0 con 0x7f3978060310 2023-10-18T22:10:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.840+0000 7f397ef87700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3978109ae0 con 0x7f39780f96a0 2023-10-18T22:10:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.840+0000 7f397df85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3978060310 0x7f3978108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.840+0000 7f397df85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3978060310 0x7f3978108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35120/0 (socket says 172.21.15.8:35120) 2023-10-18T22:10:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.840+0000 7f397df85700 1 -- 172.21.15.8:0/916487855 learned_addr learned my addr 172.21.15.8:0/916487855 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.841+0000 7f397d784700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39780f96a0 0x7f39781093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.841+0000 7f397df85700 1 -- 172.21.15.8:0/916487855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39780f96a0 msgr2=0x7f39781093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.841+0000 7f397df85700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39780f96a0 0x7f39781093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.841+0000 7f397df85700 1 -- 172.21.15.8:0/916487855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3974005040 con 0x7f3978060310 2023-10-18T22:10:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.841+0000 7f397df85700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3978060310 0x7f3978108f00 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f3974004d80 tx=0x7f397400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.841+0000 7f396e7fc700 1 -- 172.21.15.8:0/916487855 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3974019070 con 0x7f3978060310 2023-10-18T22:10:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.841+0000 7f397ef87700 1 -- 172.21.15.8:0/916487855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397810a420 con 0x7f3978060310 2023-10-18T22:10:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.841+0000 7f396e7fc700 1 -- 172.21.15.8:0/916487855 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f397401e420 con 0x7f3978060310 2023-10-18T22:10:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.841+0000 7f396e7fc700 1 -- 172.21.15.8:0/916487855 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3974014660 con 0x7f3978060310 2023-10-18T22:10:07.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.841+0000 7f397ef87700 1 -- 172.21.15.8:0/916487855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397810a900 con 0x7f3978060310 2023-10-18T22:10:07.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.842+0000 7f397ef87700 1 -- 172.21.15.8:0/916487855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3978045ad0 con 0x7f3978060310 2023-10-18T22:10:07.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.843+0000 7f396e7fc700 1 -- 172.21.15.8:0/916487855 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f397401e590 con 0x7f3978060310 2023-10-18T22:10:07.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.844+0000 7f396e7fc700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3964060f70 0x7f3964063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:07.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.844+0000 7f396e7fc700 1 -- 172.21.15.8:0/916487855 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f397407de00 con 0x7f3978060310 2023-10-18T22:10:07.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.844+0000 7f397d784700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3964060f70 0x7f3964063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.845+0000 7f397d784700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3964060f70 0x7f3964063430 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f3968009fd0 tx=0x7f396800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:07.848+0000 7f396e7fc700 1 -- 172.21.15.8:0/916487855 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f39740513e0 con 0x7f3978060310 2023-10-18T22:10:08.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.073+0000 7f397ef87700 1 -- 172.21.15.8:0/916487855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f39780fedc0 con 0x7f3978060310 2023-10-18T22:10:08.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.074+0000 7f396e7fc700 1 -- 172.21.15.8:0/916487855 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f3974050fd0 con 0x7f3978060310 2023-10-18T22:10:08.077 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:10:08.077 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:10:08.077 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:10:08.077 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:10:08.077 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:10:08.078 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:10:08.078 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:10:08.078 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:10:08.078 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:10:08.079 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:10:08.079 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:10:08.079 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:10:08.079 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:10:08.079 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:10:08.080 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:10:08.080 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:10:08.080 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:10:08.080 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:10:08.081 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:10:08.081 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:10:08.081 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:10:08.081 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:10:08.081 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:10:08.082 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:10:08.082 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:10:08.082 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:10:08.082 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:10:08.082 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:10:08.083 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:10:08.083 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:10:08.083 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:10:08.083 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:10:08.083 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:10:08.084 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:10:08.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 -- 172.21.15.8:0/916487855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3964060f70 msgr2=0x7f3964063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:08.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3964060f70 0x7f3964063430 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f3968009fd0 tx=0x7f396800b040).stop 2023-10-18T22:10:08.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 -- 172.21.15.8:0/916487855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3978060310 msgr2=0x7f3978108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:08.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3978060310 0x7f3978108f00 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f3974004d80 tx=0x7f397400b040).stop 2023-10-18T22:10:08.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 -- 172.21.15.8:0/916487855 shutdown_connections 2023-10-18T22:10:08.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3964060f70 0x7f3964063430 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:08.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3978060310 0x7f3978108f00 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:08.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 --2- 172.21.15.8:0/916487855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39780f96a0 0x7f39781093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:08.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 -- 172.21.15.8:0/916487855 >> 172.21.15.8:0/916487855 conn(0x7f39780f0ba0 msgr2=0x7f39780f4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:08.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 -- 172.21.15.8:0/916487855 shutdown_connections 2023-10-18T22:10:08.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.076+0000 7f397ef87700 1 -- 172.21.15.8:0/916487855 wait complete. 2023-10-18T22:10:08.087 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:10:08.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.214+0000 7f62aabb5700 1 -- 172.21.15.8:0/3098855465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62a40f6530 msgr2=0x7f62a40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:08.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.214+0000 7f62aabb5700 1 --2- 172.21.15.8:0/3098855465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62a40f6530 0x7f62a40f6950 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f62a0004660 tx=0x7f62a0009b30).stop 2023-10-18T22:10:08.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.215+0000 7f62aabb5700 1 -- 172.21.15.8:0/3098855465 shutdown_connections 2023-10-18T22:10:08.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.215+0000 7f62aabb5700 1 --2- 172.21.15.8:0/3098855465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62a40f77d0 0x7f62a40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:08.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.215+0000 7f62aabb5700 1 --2- 172.21.15.8:0/3098855465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62a40f6530 0x7f62a40f6950 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:08.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.215+0000 7f62aabb5700 1 -- 172.21.15.8:0/3098855465 >> 172.21.15.8:0/3098855465 conn(0x7f62a40f1c90 msgr2=0x7f62a40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:08.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.215+0000 7f62aabb5700 1 -- 172.21.15.8:0/3098855465 shutdown_connections 2023-10-18T22:10:08.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.215+0000 7f62aabb5700 1 -- 172.21.15.8:0/3098855465 wait complete. 2023-10-18T22:10:08.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.216+0000 7f62aabb5700 1 Processor -- start 2023-10-18T22:10:08.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.216+0000 7f62aabb5700 1 -- start start 2023-10-18T22:10:08.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.216+0000 7f62aabb5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62a40f6530 0x7f62a4106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:08.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.217+0000 7f62aabb5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62a40f77d0 0x7f62a4107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:08.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.217+0000 7f62aabb5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4107910 con 0x7f62a40f77d0 2023-10-18T22:10:08.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.217+0000 7f62aabb5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4108120 con 0x7f62a40f6530 2023-10-18T22:10:08.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.217+0000 7f62a93b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62a40f77d0 0x7f62a4107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:08.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.217+0000 7f62a93b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62a40f77d0 0x7f62a4107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35130/0 (socket says 172.21.15.8:35130) 2023-10-18T22:10:08.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.217+0000 7f62a93b2700 1 -- 172.21.15.8:0/2195419642 learned_addr learned my addr 172.21.15.8:0/2195419642 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:08.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.217+0000 7f62a9bb3700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62a40f6530 0x7f62a4106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:08.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.217+0000 7f62a93b2700 1 -- 172.21.15.8:0/2195419642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62a40f6530 msgr2=0x7f62a4106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:08.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.217+0000 7f62a93b2700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62a40f6530 0x7f62a4106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:08.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.217+0000 7f62a93b2700 1 -- 172.21.15.8:0/2195419642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0005040 con 0x7f62a40f77d0 2023-10-18T22:10:08.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.218+0000 7f62a93b2700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62a40f77d0 0x7f62a4107310 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f62940026d0 tx=0x7f6294009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:08.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.218+0000 7f629a7fc700 1 -- 172.21.15.8:0/2195419642 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62940079c0 con 0x7f62a40f77d0 2023-10-18T22:10:08.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.218+0000 7f629a7fc700 1 -- 172.21.15.8:0/2195419642 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f629400f040 con 0x7f62a40f77d0 2023-10-18T22:10:08.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.218+0000 7f62aabb5700 1 -- 172.21.15.8:0/2195419642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a41083a0 con 0x7f62a40f77d0 2023-10-18T22:10:08.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.218+0000 7f629a7fc700 1 -- 172.21.15.8:0/2195419642 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6294014980 con 0x7f62a40f77d0 2023-10-18T22:10:08.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.218+0000 7f62aabb5700 1 -- 172.21.15.8:0/2195419642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a4108960 con 0x7f62a40f77d0 2023-10-18T22:10:08.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.219+0000 7f62aabb5700 1 -- 172.21.15.8:0/2195419642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a4059100 con 0x7f62a40f77d0 2023-10-18T22:10:08.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.220+0000 7f629a7fc700 1 -- 172.21.15.8:0/2195419642 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f62940090d0 con 0x7f62a40f77d0 2023-10-18T22:10:08.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.221+0000 7f629a7fc700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6290060f70 0x7f6290063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:08.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.221+0000 7f629a7fc700 1 -- 172.21.15.8:0/2195419642 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f629407c8a0 con 0x7f62a40f77d0 2023-10-18T22:10:08.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.221+0000 7f62a9bb3700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6290060f70 0x7f6290063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:08.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.222+0000 7f62a9bb3700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6290060f70 0x7f6290063430 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f62a4106b90 tx=0x7f62a0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:08.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.225+0000 7f629a7fc700 1 -- 172.21.15.8:0/2195419642 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f629404c580 con 0x7f62a40f77d0 2023-10-18T22:10:08.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:06.595232+0000 mgr.smithi008.flmjzp (mgr.14640) 4272 : audit [DBG] from='client.37456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:08.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:06.945146+0000 mgr.smithi008.flmjzp (mgr.14640) 4273 : audit [DBG] from='client.37460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:08.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:07.288867+0000 mgr.smithi008.flmjzp (mgr.14640) 4274 : audit [DBG] from='client.37464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:08.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:07.701925+0000 mon.smithi008 (mon.0) 4580 : audit [DBG] from='client.? 172.21.15.8:0/3333084596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:08.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:08.075619+0000 mon.smithi008 (mon.0) 4581 : audit [DBG] from='client.? 172.21.15.8:0/916487855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:10:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.423+0000 7f62aabb5700 1 -- 172.21.15.8:0/2195419642 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62a40fee50 con 0x7f6290060f70 2023-10-18T22:10:08.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.425+0000 7f629a7fc700 1 -- 172.21.15.8:0/2195419642 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f62a40fee50 con 0x7f6290060f70 2023-10-18T22:10:08.428 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:10:08.428 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:10:08.428 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:10:08.429 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:10:08.429 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:10:08.429 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:10:08.430 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:10:08.430 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:10:08.430 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:10:08.431 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:10:08.431 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:10:08.432 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:10:08.432 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:10:08.432 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:10:08.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 -- 172.21.15.8:0/2195419642 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6290060f70 msgr2=0x7f6290063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:08.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6290060f70 0x7f6290063430 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f62a4106b90 tx=0x7f62a0009b30).stop 2023-10-18T22:10:08.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 -- 172.21.15.8:0/2195419642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62a40f77d0 msgr2=0x7f62a4107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:08.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62a40f77d0 0x7f62a4107310 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f62940026d0 tx=0x7f6294009de0).stop 2023-10-18T22:10:08.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 -- 172.21.15.8:0/2195419642 shutdown_connections 2023-10-18T22:10:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6290060f70 0x7f6290063430 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62a40f6530 0x7f62a4106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 --2- 172.21.15.8:0/2195419642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62a40f77d0 0x7f62a4107310 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:08.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 -- 172.21.15.8:0/2195419642 >> 172.21.15.8:0/2195419642 conn(0x7f62a40f1c90 msgr2=0x7f62a40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:08.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 -- 172.21.15.8:0/2195419642 shutdown_connections 2023-10-18T22:10:08.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:08.427+0000 7f62aabb5700 1 -- 172.21.15.8:0/2195419642 wait complete. 2023-10-18T22:10:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:06.595232+0000 mgr.smithi008.flmjzp (mgr.14640) 4272 : audit [DBG] from='client.37456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:08.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:06.945146+0000 mgr.smithi008.flmjzp (mgr.14640) 4273 : audit [DBG] from='client.37460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:07.288867+0000 mgr.smithi008.flmjzp (mgr.14640) 4274 : audit [DBG] from='client.37464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:07.701925+0000 mon.smithi008 (mon.0) 4580 : audit [DBG] from='client.? 172.21.15.8:0/3333084596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:08.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:08.075619+0000 mon.smithi008 (mon.0) 4581 : audit [DBG] from='client.? 172.21.15.8:0/916487855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:10:09.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:08.197526+0000 mgr.smithi008.flmjzp (mgr.14640) 4275 : cluster [DBG] pgmap v2934: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:08.197526+0000 mgr.smithi008.flmjzp (mgr.14640) 4275 : cluster [DBG] pgmap v2934: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:10.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:08.426113+0000 mgr.smithi008.flmjzp (mgr.14640) 4276 : audit [DBG] from='client.37476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:10.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:08.426113+0000 mgr.smithi008.flmjzp (mgr.14640) 4276 : audit [DBG] from='client.37476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:11.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:10.198314+0000 mgr.smithi008.flmjzp (mgr.14640) 4277 : cluster [DBG] pgmap v2935: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:10.198314+0000 mgr.smithi008.flmjzp (mgr.14640) 4277 : cluster [DBG] pgmap v2935: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:12.226222+0000 mon.smithi008 (mon.0) 4582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:12.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:12.226222+0000 mon.smithi008 (mon.0) 4582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:12.198902+0000 mgr.smithi008.flmjzp (mgr.14640) 4278 : cluster [DBG] pgmap v2936: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:12.787203+0000 mon.smithi008 (mon.0) 4583 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:12.788359+0000 mon.smithi008 (mon.0) 4584 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:12.795357+0000 mon.smithi008 (mon.0) 4585 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:12.802203+0000 mon.smithi008 (mon.0) 4586 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:13.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:12.805342+0000 mon.smithi008 (mon.0) 4587 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:13.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:12.807062+0000 mon.smithi008 (mon.0) 4588 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:13.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:12.808712+0000 mon.smithi008 (mon.0) 4589 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:13.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:12.810670+0000 mon.smithi008 (mon.0) 4590 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:12.198902+0000 mgr.smithi008.flmjzp (mgr.14640) 4278 : cluster [DBG] pgmap v2936: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:12.787203+0000 mon.smithi008 (mon.0) 4583 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:12.788359+0000 mon.smithi008 (mon.0) 4584 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:12.795357+0000 mon.smithi008 (mon.0) 4585 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:12.802203+0000 mon.smithi008 (mon.0) 4586 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:12.805342+0000 mon.smithi008 (mon.0) 4587 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:12.807062+0000 mon.smithi008 (mon.0) 4588 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:13.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:12.808712+0000 mon.smithi008 (mon.0) 4589 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:13.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:12.810670+0000 mon.smithi008 (mon.0) 4590 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:12.789265+0000 mgr.smithi008.flmjzp (mgr.14640) 4279 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:12.789937+0000 mgr.smithi008.flmjzp (mgr.14640) 4280 : cluster [DBG] pgmap v2937: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:12.790256+0000 mgr.smithi008.flmjzp (mgr.14640) 4281 : cluster [DBG] pgmap v2938: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:12.812586+0000 mgr.smithi008.flmjzp (mgr.14640) 4282 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:12.789265+0000 mgr.smithi008.flmjzp (mgr.14640) 4279 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:12.789937+0000 mgr.smithi008.flmjzp (mgr.14640) 4280 : cluster [DBG] pgmap v2937: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:12.790256+0000 mgr.smithi008.flmjzp (mgr.14640) 4281 : cluster [DBG] pgmap v2938: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:12.812586+0000 mgr.smithi008.flmjzp (mgr.14640) 4282 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:14.790849+0000 mgr.smithi008.flmjzp (mgr.14640) 4283 : cluster [DBG] pgmap v2939: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:14.790849+0000 mgr.smithi008.flmjzp (mgr.14640) 4283 : cluster [DBG] pgmap v2939: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:16.791405+0000 mgr.smithi008.flmjzp (mgr.14640) 4284 : cluster [DBG] pgmap v2940: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:16.791405+0000 mgr.smithi008.flmjzp (mgr.14640) 4284 : cluster [DBG] pgmap v2940: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:18.792047+0000 mgr.smithi008.flmjzp (mgr.14640) 4285 : cluster [DBG] pgmap v2941: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:18.792047+0000 mgr.smithi008.flmjzp (mgr.14640) 4285 : cluster [DBG] pgmap v2941: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:20.792552+0000 mgr.smithi008.flmjzp (mgr.14640) 4286 : cluster [DBG] pgmap v2942: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:20.792552+0000 mgr.smithi008.flmjzp (mgr.14640) 4286 : cluster [DBG] pgmap v2942: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:22.821330+0000 mon.smithi008 (mon.0) 4591 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:22.823373+0000 mon.smithi008 (mon.0) 4592 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:22.824405+0000 mon.smithi008 (mon.0) 4593 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:22.830695+0000 mon.smithi008 (mon.0) 4594 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:22.837217+0000 mon.smithi008 (mon.0) 4595 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:23.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:22.840305+0000 mon.smithi008 (mon.0) 4596 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:23.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:22.842031+0000 mon.smithi008 (mon.0) 4597 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:23.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:22.843698+0000 mon.smithi008 (mon.0) 4598 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:23.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:22.845798+0000 mon.smithi008 (mon.0) 4599 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:22.821330+0000 mon.smithi008 (mon.0) 4591 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:22.823373+0000 mon.smithi008 (mon.0) 4592 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:22.824405+0000 mon.smithi008 (mon.0) 4593 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:22.830695+0000 mon.smithi008 (mon.0) 4594 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:22.837217+0000 mon.smithi008 (mon.0) 4595 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:22.840305+0000 mon.smithi008 (mon.0) 4596 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:22.842031+0000 mon.smithi008 (mon.0) 4597 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:22.843698+0000 mon.smithi008 (mon.0) 4598 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:23.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:22.845798+0000 mon.smithi008 (mon.0) 4599 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:22.793078+0000 mgr.smithi008.flmjzp (mgr.14640) 4287 : cluster [DBG] pgmap v2943: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:24.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:22.825287+0000 mgr.smithi008.flmjzp (mgr.14640) 4288 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:24.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:22.825860+0000 mgr.smithi008.flmjzp (mgr.14640) 4289 : cluster [DBG] pgmap v2944: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:24.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:22.826115+0000 mgr.smithi008.flmjzp (mgr.14640) 4290 : cluster [DBG] pgmap v2945: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:24.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:22.847701+0000 mgr.smithi008.flmjzp (mgr.14640) 4291 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:22.793078+0000 mgr.smithi008.flmjzp (mgr.14640) 4287 : cluster [DBG] pgmap v2943: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:22.825287+0000 mgr.smithi008.flmjzp (mgr.14640) 4288 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:22.825860+0000 mgr.smithi008.flmjzp (mgr.14640) 4289 : cluster [DBG] pgmap v2944: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:22.826115+0000 mgr.smithi008.flmjzp (mgr.14640) 4290 : cluster [DBG] pgmap v2945: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:22.847701+0000 mgr.smithi008.flmjzp (mgr.14640) 4291 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:24.826931+0000 mgr.smithi008.flmjzp (mgr.14640) 4292 : cluster [DBG] pgmap v2946: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:24.826931+0000 mgr.smithi008.flmjzp (mgr.14640) 4292 : cluster [DBG] pgmap v2946: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:26.827536+0000 mgr.smithi008.flmjzp (mgr.14640) 4293 : cluster [DBG] pgmap v2947: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:26.827536+0000 mgr.smithi008.flmjzp (mgr.14640) 4293 : cluster [DBG] pgmap v2947: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:28.828111+0000 mgr.smithi008.flmjzp (mgr.14640) 4294 : cluster [DBG] pgmap v2948: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:28.828111+0000 mgr.smithi008.flmjzp (mgr.14640) 4294 : cluster [DBG] pgmap v2948: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:30.828668+0000 mgr.smithi008.flmjzp (mgr.14640) 4295 : cluster [DBG] pgmap v2949: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:30.828668+0000 mgr.smithi008.flmjzp (mgr.14640) 4295 : cluster [DBG] pgmap v2949: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:32.853410+0000 mon.smithi008 (mon.0) 4600 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:32.855566+0000 mon.smithi008 (mon.0) 4601 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:32.856606+0000 mon.smithi008 (mon.0) 4602 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:32.863318+0000 mon.smithi008 (mon.0) 4603 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:32.871469+0000 mon.smithi008 (mon.0) 4604 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:32.875014+0000 mon.smithi008 (mon.0) 4605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:33.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:32.877052+0000 mon.smithi008 (mon.0) 4606 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:33.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:32.878970+0000 mon.smithi008 (mon.0) 4607 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:33.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:32.881994+0000 mon.smithi008 (mon.0) 4608 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:32.853410+0000 mon.smithi008 (mon.0) 4600 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:32.855566+0000 mon.smithi008 (mon.0) 4601 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:32.856606+0000 mon.smithi008 (mon.0) 4602 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:32.863318+0000 mon.smithi008 (mon.0) 4603 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:32.871469+0000 mon.smithi008 (mon.0) 4604 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:32.875014+0000 mon.smithi008 (mon.0) 4605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:33.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:32.877052+0000 mon.smithi008 (mon.0) 4606 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:33.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:32.878970+0000 mon.smithi008 (mon.0) 4607 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:33.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:32.881994+0000 mon.smithi008 (mon.0) 4608 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:32.829246+0000 mgr.smithi008.flmjzp (mgr.14640) 4296 : cluster [DBG] pgmap v2950: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:32.857423+0000 mgr.smithi008.flmjzp (mgr.14640) 4297 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:32.857999+0000 mgr.smithi008.flmjzp (mgr.14640) 4298 : cluster [DBG] pgmap v2951: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:32.858227+0000 mgr.smithi008.flmjzp (mgr.14640) 4299 : cluster [DBG] pgmap v2952: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:32.884063+0000 mgr.smithi008.flmjzp (mgr.14640) 4300 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:32.829246+0000 mgr.smithi008.flmjzp (mgr.14640) 4296 : cluster [DBG] pgmap v2950: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:32.857423+0000 mgr.smithi008.flmjzp (mgr.14640) 4297 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:32.857999+0000 mgr.smithi008.flmjzp (mgr.14640) 4298 : cluster [DBG] pgmap v2951: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:32.858227+0000 mgr.smithi008.flmjzp (mgr.14640) 4299 : cluster [DBG] pgmap v2952: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:34.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:32.884063+0000 mgr.smithi008.flmjzp (mgr.14640) 4300 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:34.858960+0000 mgr.smithi008.flmjzp (mgr.14640) 4301 : cluster [DBG] pgmap v2953: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:34.858960+0000 mgr.smithi008.flmjzp (mgr.14640) 4301 : cluster [DBG] pgmap v2953: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.582+0000 7f2237189700 1 -- 172.21.15.8:0/4014936616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22300f77d0 msgr2=0x7f22300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.582+0000 7f2237189700 1 --2- 172.21.15.8:0/4014936616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22300f77d0 0x7f22300f7c30 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f2220004660 tx=0x7f2220009b30).stop 2023-10-18T22:10:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.582+0000 7f2237189700 1 -- 172.21.15.8:0/4014936616 shutdown_connections 2023-10-18T22:10:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.582+0000 7f2237189700 1 --2- 172.21.15.8:0/4014936616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22300f77d0 0x7f22300f7c30 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:38.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.582+0000 7f2237189700 1 --2- 172.21.15.8:0/4014936616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22300f6530 0x7f22300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:38.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.582+0000 7f2237189700 1 -- 172.21.15.8:0/4014936616 >> 172.21.15.8:0/4014936616 conn(0x7f22300f1c90 msgr2=0x7f22300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:38.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.582+0000 7f2237189700 1 -- 172.21.15.8:0/4014936616 shutdown_connections 2023-10-18T22:10:38.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.582+0000 7f2237189700 1 -- 172.21.15.8:0/4014936616 wait complete. 2023-10-18T22:10:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.583+0000 7f2237189700 1 Processor -- start 2023-10-18T22:10:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.584+0000 7f2237189700 1 -- start start 2023-10-18T22:10:38.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.584+0000 7f2237189700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22300f6530 0x7f2230108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:38.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.584+0000 7f2237189700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22300f77d0 0x7f2230109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:38.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.584+0000 7f2237189700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22301099d0 con 0x7f22300f77d0 2023-10-18T22:10:38.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.584+0000 7f2237189700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2230109b10 con 0x7f22300f6530 2023-10-18T22:10:38.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.584+0000 7f2235986700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22300f77d0 0x7f2230109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:38.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.584+0000 7f2235986700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22300f77d0 0x7f2230109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59896/0 (socket says 172.21.15.8:59896) 2023-10-18T22:10:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.584+0000 7f2235986700 1 -- 172.21.15.8:0/2224963029 learned_addr learned my addr 172.21.15.8:0/2224963029 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.584+0000 7f2236187700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22300f6530 0x7f2230108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.585+0000 7f2235986700 1 -- 172.21.15.8:0/2224963029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22300f6530 msgr2=0x7f2230108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.585+0000 7f2235986700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22300f6530 0x7f2230108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.585+0000 7f2235986700 1 -- 172.21.15.8:0/2224963029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220005040 con 0x7f22300f77d0 2023-10-18T22:10:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.585+0000 7f2235986700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22300f77d0 0x7f2230109420 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f2220009990 tx=0x7f2220009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.585+0000 7f2226ffd700 1 -- 172.21.15.8:0/2224963029 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2220018070 con 0x7f22300f77d0 2023-10-18T22:10:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.585+0000 7f2226ffd700 1 -- 172.21.15.8:0/2224963029 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2220009630 con 0x7f22300f77d0 2023-10-18T22:10:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.585+0000 7f2226ffd700 1 -- 172.21.15.8:0/2224963029 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f222001c3c0 con 0x7f22300f77d0 2023-10-18T22:10:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.585+0000 7f2237189700 1 -- 172.21.15.8:0/2224963029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223010a450 con 0x7f22300f77d0 2023-10-18T22:10:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.585+0000 7f2237189700 1 -- 172.21.15.8:0/2224963029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223010a9b0 con 0x7f22300f77d0 2023-10-18T22:10:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.586+0000 7f2237189700 1 -- 172.21.15.8:0/2224963029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2230045ad0 con 0x7f22300f77d0 2023-10-18T22:10:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.587+0000 7f2226ffd700 1 -- 172.21.15.8:0/2224963029 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f222001d970 con 0x7f22300f77d0 2023-10-18T22:10:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.588+0000 7f2226ffd700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f221c060f70 0x7f221c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.588+0000 7f2226ffd700 1 -- 172.21.15.8:0/2224963029 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f222007e580 con 0x7f22300f77d0 2023-10-18T22:10:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.589+0000 7f2236187700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f221c060f70 0x7f221c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.589+0000 7f2236187700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f221c060f70 0x7f221c063430 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f22300f7630 tx=0x7f222c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.593+0000 7f2226ffd700 1 -- 172.21.15.8:0/2224963029 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2220051be0 con 0x7f22300f77d0 2023-10-18T22:10:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:36.859701+0000 mgr.smithi008.flmjzp (mgr.14640) 4302 : cluster [DBG] pgmap v2954: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:36.859701+0000 mgr.smithi008.flmjzp (mgr.14640) 4302 : cluster [DBG] pgmap v2954: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.790+0000 7f2237189700 1 -- 172.21.15.8:0/2224963029 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22300fee30 con 0x7f221c060f70 2023-10-18T22:10:38.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.791+0000 7f2226ffd700 1 -- 172.21.15.8:0/2224963029 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f22300fee30 con 0x7f221c060f70 2023-10-18T22:10:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.793+0000 7f2237189700 1 -- 172.21.15.8:0/2224963029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f221c060f70 msgr2=0x7f221c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.793+0000 7f2237189700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f221c060f70 0x7f221c063430 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f22300f7630 tx=0x7f222c00b040).stop 2023-10-18T22:10:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.793+0000 7f2237189700 1 -- 172.21.15.8:0/2224963029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22300f77d0 msgr2=0x7f2230109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.793+0000 7f2237189700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22300f77d0 0x7f2230109420 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f2220009990 tx=0x7f2220009b30).stop 2023-10-18T22:10:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.793+0000 7f2237189700 1 -- 172.21.15.8:0/2224963029 shutdown_connections 2023-10-18T22:10:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.793+0000 7f2237189700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f221c060f70 0x7f221c063430 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.793+0000 7f2237189700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22300f6530 0x7f2230108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.793+0000 7f2237189700 1 --2- 172.21.15.8:0/2224963029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22300f77d0 0x7f2230109420 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.793+0000 7f2237189700 1 -- 172.21.15.8:0/2224963029 >> 172.21.15.8:0/2224963029 conn(0x7f22300f1c90 msgr2=0x7f223006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.794+0000 7f2237189700 1 -- 172.21.15.8:0/2224963029 shutdown_connections 2023-10-18T22:10:38.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.794+0000 7f2237189700 1 -- 172.21.15.8:0/2224963029 wait complete. 2023-10-18T22:10:38.809 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:10:38.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.931+0000 7f153ffff700 1 -- 172.21.15.8:0/4166592007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15400f77d0 msgr2=0x7f15400f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:38.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.931+0000 7f153ffff700 1 --2- 172.21.15.8:0/4166592007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15400f77d0 0x7f15400f7c30 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f1534004660 tx=0x7f1534009b30).stop 2023-10-18T22:10:38.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.931+0000 7f153ffff700 1 -- 172.21.15.8:0/4166592007 shutdown_connections 2023-10-18T22:10:38.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.931+0000 7f153ffff700 1 --2- 172.21.15.8:0/4166592007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15400f77d0 0x7f15400f7c30 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:38.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.931+0000 7f153ffff700 1 --2- 172.21.15.8:0/4166592007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15400f6530 0x7f15400f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:38.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.931+0000 7f153ffff700 1 -- 172.21.15.8:0/4166592007 >> 172.21.15.8:0/4166592007 conn(0x7f15400f1c90 msgr2=0x7f15400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:38.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.931+0000 7f153ffff700 1 -- 172.21.15.8:0/4166592007 shutdown_connections 2023-10-18T22:10:38.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.931+0000 7f153ffff700 1 -- 172.21.15.8:0/4166592007 wait complete. 2023-10-18T22:10:38.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.933+0000 7f153ffff700 1 Processor -- start 2023-10-18T22:10:38.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.933+0000 7f153ffff700 1 -- start start 2023-10-18T22:10:38.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.933+0000 7f153ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15400f6530 0x7f154006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:38.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.933+0000 7f153ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15400f77d0 0x7f1540069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:38.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.933+0000 7f153ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154006a380 con 0x7f15400f6530 2023-10-18T22:10:38.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.933+0000 7f153ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154006a4c0 con 0x7f15400f77d0 2023-10-18T22:10:38.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f153effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15400f6530 0x7f154006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:38.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f153effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15400f6530 0x7f154006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59908/0 (socket says 172.21.15.8:59908) 2023-10-18T22:10:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f153effd700 1 -- 172.21.15.8:0/3372419719 learned_addr learned my addr 172.21.15.8:0/3372419719 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f153e7fc700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15400f77d0 0x7f1540069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f153effd700 1 -- 172.21.15.8:0/3372419719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15400f77d0 msgr2=0x7f1540069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f153effd700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15400f77d0 0x7f1540069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:38.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f153effd700 1 -- 172.21.15.8:0/3372419719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1534005040 con 0x7f15400f6530 2023-10-18T22:10:38.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f153effd700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15400f6530 0x7f154006b9a0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f1530002700 tx=0x7f1530009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:38.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f15277fe700 1 -- 172.21.15.8:0/3372419719 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15300079c0 con 0x7f15400f6530 2023-10-18T22:10:38.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f15277fe700 1 -- 172.21.15.8:0/3372419719 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f153000f040 con 0x7f15400f6530 2023-10-18T22:10:38.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f15277fe700 1 -- 172.21.15.8:0/3372419719 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15300148d0 con 0x7f15400f6530 2023-10-18T22:10:38.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.934+0000 7f153ffff700 1 -- 172.21.15.8:0/3372419719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154006a7a0 con 0x7f15400f6530 2023-10-18T22:10:38.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.935+0000 7f153ffff700 1 -- 172.21.15.8:0/3372419719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154010ed00 con 0x7f15400f6530 2023-10-18T22:10:38.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.936+0000 7f153ffff700 1 -- 172.21.15.8:0/3372419719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1540045ad0 con 0x7f15400f6530 2023-10-18T22:10:38.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.936+0000 7f15277fe700 1 -- 172.21.15.8:0/3372419719 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f153001b060 con 0x7f15400f6530 2023-10-18T22:10:38.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.938+0000 7f15277fe700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1528060f70 0x7f1528063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:38.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.938+0000 7f15277fe700 1 -- 172.21.15.8:0/3372419719 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f153007c770 con 0x7f15400f6530 2023-10-18T22:10:38.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.938+0000 7f153e7fc700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1528060f70 0x7f1528063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:38.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.939+0000 7f153e7fc700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1528060f70 0x7f1528063430 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f1534004630 tx=0x7f1534009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:38.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:38.942+0000 7f15277fe700 1 -- 172.21.15.8:0/3372419719 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f153004c3a0 con 0x7f15400f6530 2023-10-18T22:10:39.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.143+0000 7f153ffff700 1 -- 172.21.15.8:0/3372419719 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15400fee00 con 0x7f1528060f70 2023-10-18T22:10:39.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.144+0000 7f15277fe700 1 -- 172.21.15.8:0/3372419719 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f15400fee00 con 0x7f1528060f70 2023-10-18T22:10:39.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.146+0000 7f153ffff700 1 -- 172.21.15.8:0/3372419719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1528060f70 msgr2=0x7f1528063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:39.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.146+0000 7f153ffff700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1528060f70 0x7f1528063430 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f1534004630 tx=0x7f1534009b30).stop 2023-10-18T22:10:39.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.146+0000 7f153ffff700 1 -- 172.21.15.8:0/3372419719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15400f6530 msgr2=0x7f154006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:39.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.146+0000 7f153ffff700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15400f6530 0x7f154006b9a0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f1530002700 tx=0x7f1530009d80).stop 2023-10-18T22:10:39.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.146+0000 7f153ffff700 1 -- 172.21.15.8:0/3372419719 shutdown_connections 2023-10-18T22:10:39.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.146+0000 7f153ffff700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1528060f70 0x7f1528063430 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.146+0000 7f153ffff700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15400f6530 0x7f154006b9a0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.146+0000 7f153ffff700 1 --2- 172.21.15.8:0/3372419719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15400f77d0 0x7f1540069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.146+0000 7f153ffff700 1 -- 172.21.15.8:0/3372419719 >> 172.21.15.8:0/3372419719 conn(0x7f15400f1c90 msgr2=0x7f15400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:39.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.147+0000 7f153ffff700 1 -- 172.21.15.8:0/3372419719 shutdown_connections 2023-10-18T22:10:39.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.147+0000 7f153ffff700 1 -- 172.21.15.8:0/3372419719 wait complete. 2023-10-18T22:10:39.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.283+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/1546908051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0e00f99e0 msgr2=0x7fb0e00f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:39.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.283+0000 7fb0e4ed0700 1 --2- 172.21.15.8:0/1546908051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0e00f99e0 0x7fb0e00f9e40 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fb0d4004660 tx=0x7fb0d4009b30).stop 2023-10-18T22:10:39.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.283+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/1546908051 shutdown_connections 2023-10-18T22:10:39.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.283+0000 7fb0e4ed0700 1 --2- 172.21.15.8:0/1546908051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0e00f99e0 0x7fb0e00f9e40 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.283+0000 7fb0e4ed0700 1 --2- 172.21.15.8:0/1546908051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0e00f8740 0x7fb0e00f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.283+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/1546908051 >> 172.21.15.8:0/1546908051 conn(0x7fb0e00f40e0 msgr2=0x7fb0e00f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:39.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.283+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/1546908051 shutdown_connections 2023-10-18T22:10:39.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.283+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/1546908051 wait complete. 2023-10-18T22:10:39.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.284+0000 7fb0e4ed0700 1 Processor -- start 2023-10-18T22:10:39.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.284+0000 7fb0e4ed0700 1 -- start start 2023-10-18T22:10:39.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.284+0000 7fb0e4ed0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0e00f8740 0x7fb0e0108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:39.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.284+0000 7fb0e4ed0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0e00f99e0 0x7fb0e0109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:39.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.284+0000 7fb0e4ed0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e01099e0 con 0x7fb0e00f8740 2023-10-18T22:10:39.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.284+0000 7fb0e4ed0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e0109b20 con 0x7fb0e00f99e0 2023-10-18T22:10:39.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.284+0000 7fb0df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0e00f8740 0x7fb0e0108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:39.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0e00f8740 0x7fb0e0108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59928/0 (socket says 172.21.15.8:59928) 2023-10-18T22:10:39.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0df7fe700 1 -- 172.21.15.8:0/3181492718 learned_addr learned my addr 172.21.15.8:0/3181492718 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:39.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0deffd700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0e00f99e0 0x7fb0e0109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:39.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0df7fe700 1 -- 172.21.15.8:0/3181492718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0e00f99e0 msgr2=0x7fb0e0109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:39.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0df7fe700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0e00f99e0 0x7fb0e0109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0df7fe700 1 -- 172.21.15.8:0/3181492718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4005040 con 0x7fb0e00f8740 2023-10-18T22:10:39.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0deffd700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0e00f99e0 0x7fb0e0109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:10:39.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0df7fe700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0e00f8740 0x7fb0e0108f40 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7fb0d0002700 tx=0x7fb0d0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:39.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0c7fff700 1 -- 172.21.15.8:0/3181492718 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0d0009320 con 0x7fb0e00f8740 2023-10-18T22:10:39.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0c7fff700 1 -- 172.21.15.8:0/3181492718 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb0d000f040 con 0x7fb0e00f8740 2023-10-18T22:10:39.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0c7fff700 1 -- 172.21.15.8:0/3181492718 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0d0014970 con 0x7fb0e00f8740 2023-10-18T22:10:39.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.285+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/3181492718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e010a4c0 con 0x7fb0e00f8740 2023-10-18T22:10:39.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.286+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/3181492718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e010aa30 con 0x7fb0e00f8740 2023-10-18T22:10:39.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.287+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/3181492718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e0045ad0 con 0x7fb0e00f8740 2023-10-18T22:10:39.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.287+0000 7fb0c7fff700 1 -- 172.21.15.8:0/3181492718 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb0d0009480 con 0x7fb0e00f8740 2023-10-18T22:10:39.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.288+0000 7fb0c7fff700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0c8060f70 0x7fb0c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:39.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.289+0000 7fb0c7fff700 1 -- 172.21.15.8:0/3181492718 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb0d007cb80 con 0x7fb0e00f8740 2023-10-18T22:10:39.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.289+0000 7fb0deffd700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0c8060f70 0x7fb0c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:39.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.289+0000 7fb0deffd700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0c8060f70 0x7fb0c8063430 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fb0d4005010 tx=0x7fb0d4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:39.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.293+0000 7fb0c7fff700 1 -- 172.21.15.8:0/3181492718 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb0d0050220 con 0x7fb0e00f8740 2023-10-18T22:10:39.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.488+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/3181492718 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0e010ad00 con 0x7fb0c8060f70 2023-10-18T22:10:39.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.498+0000 7fb0c7fff700 1 -- 172.21.15.8:0/3181492718 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb0e010ad00 con 0x7fb0c8060f70 2023-10-18T22:10:39.499 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:10:39.500 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (77m) 4m ago 78m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:10:39.500 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (71m) 4m ago 78m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:10:39.500 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (71m) 2m ago 77m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:10:39.500 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (77m) 4m ago 78m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:10:39.501 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 74m - - 2023-10-18T22:10:39.501 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 74m - - 2023-10-18T22:10:39.501 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 74m - - 2023-10-18T22:10:39.501 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 74m - - 2023-10-18T22:10:39.501 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (72m) 4m ago 80m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:10:39.502 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (71m) 2m ago 77m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:10:39.502 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (71m) 4m ago 80m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:10:39.502 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (71m) 2m ago 77m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:10:39.502 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (78m) 4m ago 78m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:10:39.502 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (77m) 2m ago 77m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:10:39.503 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (70m) 4m ago 77m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:10:39.503 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (68m) 4m ago 77m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:10:39.503 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (68m) 4m ago 76m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:10:39.503 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (67m) 2m ago 76m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:10:39.503 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (67m) 2m ago 76m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:10:39.504 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (66m) 2m ago 75m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:10:39.504 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (72m) 4m ago 78m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:10:39.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/3181492718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0c8060f70 msgr2=0x7fb0c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:39.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0c8060f70 0x7fb0c8063430 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fb0d4005010 tx=0x7fb0d4009b30).stop 2023-10-18T22:10:39.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/3181492718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0e00f8740 msgr2=0x7fb0e0108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:39.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0e00f8740 0x7fb0e0108f40 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7fb0d0002700 tx=0x7fb0d0009d80).stop 2023-10-18T22:10:39.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/3181492718 shutdown_connections 2023-10-18T22:10:39.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb0c8060f70 0x7fb0c8063430 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0e00f8740 0x7fb0e0108f40 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 --2- 172.21.15.8:0/3181492718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0e00f99e0 0x7fb0e0109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/3181492718 >> 172.21.15.8:0/3181492718 conn(0x7fb0e00f40e0 msgr2=0x7fb0e00fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:39.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/3181492718 shutdown_connections 2023-10-18T22:10:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.500+0000 7fb0e4ed0700 1 -- 172.21.15.8:0/3181492718 wait complete. 2023-10-18T22:10:39.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.638+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1448768861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c780f77d0 msgr2=0x7f0c780f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:39.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.638+0000 7f0c7ca26700 1 --2- 172.21.15.8:0/1448768861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c780f77d0 0x7f0c780f7c30 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f0c6c004660 tx=0x7f0c6c009b30).stop 2023-10-18T22:10:39.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.638+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1448768861 shutdown_connections 2023-10-18T22:10:39.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.638+0000 7f0c7ca26700 1 --2- 172.21.15.8:0/1448768861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c780f77d0 0x7f0c780f7c30 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.638+0000 7f0c7ca26700 1 --2- 172.21.15.8:0/1448768861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c780f6530 0x7f0c780f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.638+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1448768861 >> 172.21.15.8:0/1448768861 conn(0x7f0c780f1c90 msgr2=0x7f0c780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:39.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.638+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1448768861 shutdown_connections 2023-10-18T22:10:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.638+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1448768861 wait complete. 2023-10-18T22:10:39.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.639+0000 7f0c7ca26700 1 Processor -- start 2023-10-18T22:10:39.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.639+0000 7f0c7ca26700 1 -- start start 2023-10-18T22:10:39.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c7ca26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c780f6530 0x7f0c78106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:39.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c7ca26700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c780f77d0 0x7f0c78107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:39.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c7ca26700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c78107880 con 0x7f0c780f6530 2023-10-18T22:10:39.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c7ca26700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c781080c0 con 0x7f0c780f77d0 2023-10-18T22:10:39.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c777fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c780f6530 0x7f0c78106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:39.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c777fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c780f6530 0x7f0c78106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59936/0 (socket says 172.21.15.8:59936) 2023-10-18T22:10:39.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c777fe700 1 -- 172.21.15.8:0/1578873675 learned_addr learned my addr 172.21.15.8:0/1578873675 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:39.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c76ffd700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c780f77d0 0x7f0c78107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:39.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c777fe700 1 -- 172.21.15.8:0/1578873675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c780f77d0 msgr2=0x7f0c78107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c777fe700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c780f77d0 0x7f0c78107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.640+0000 7f0c777fe700 1 -- 172.21.15.8:0/1578873675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c005040 con 0x7f0c780f6530 2023-10-18T22:10:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.641+0000 7f0c777fe700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c780f6530 0x7f0c78106d90 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f0c68002700 tx=0x7f0c68009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.641+0000 7f0c5ffff700 1 -- 172.21.15.8:0/1578873675 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c68009320 con 0x7f0c780f6530 2023-10-18T22:10:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.641+0000 7f0c5ffff700 1 -- 172.21.15.8:0/1578873675 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0c6800f040 con 0x7f0c780f6530 2023-10-18T22:10:39.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.641+0000 7f0c5ffff700 1 -- 172.21.15.8:0/1578873675 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c68014970 con 0x7f0c780f6530 2023-10-18T22:10:39.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.641+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1578873675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c781083a0 con 0x7f0c780f6530 2023-10-18T22:10:39.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.641+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1578873675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c781088e0 con 0x7f0c780f6530 2023-10-18T22:10:39.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.642+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1578873675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c78059100 con 0x7f0c780f6530 2023-10-18T22:10:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.643+0000 7f0c5ffff700 1 -- 172.21.15.8:0/1578873675 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0c68009480 con 0x7f0c780f6530 2023-10-18T22:10:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.644+0000 7f0c5ffff700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c60060f70 0x7f0c60063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.644+0000 7f0c5ffff700 1 -- 172.21.15.8:0/1578873675 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0c6807cc40 con 0x7f0c780f6530 2023-10-18T22:10:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.644+0000 7f0c76ffd700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c60060f70 0x7f0c60063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.645+0000 7f0c76ffd700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c60060f70 0x7f0c60063430 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f0c6c004630 tx=0x7f0c6c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.648+0000 7f0c5ffff700 1 -- 172.21.15.8:0/1578873675 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0c6804c7f0 con 0x7f0c780f6530 2023-10-18T22:10:39.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.907+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1578873675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0c780fed90 con 0x7f0c780f6530 2023-10-18T22:10:39.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.907+0000 7f0c5ffff700 1 -- 172.21.15.8:0/1578873675 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f0c6804fe10 con 0x7f0c780f6530 2023-10-18T22:10:39.909 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:10:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:10:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:10:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:10:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:10:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:10:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:10:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:10:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:10:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:10:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:10:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:10:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:10:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:10:39.913 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:10:39.913 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:10:39.913 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:10:39.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.909+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1578873675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c60060f70 msgr2=0x7f0c60063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:39.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.909+0000 7f0c7ca26700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c60060f70 0x7f0c60063430 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f0c6c004630 tx=0x7f0c6c009b30).stop 2023-10-18T22:10:39.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.909+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1578873675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c780f6530 msgr2=0x7f0c78106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:39.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.909+0000 7f0c7ca26700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c780f6530 0x7f0c78106d90 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f0c68002700 tx=0x7f0c68009d80).stop 2023-10-18T22:10:39.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.910+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1578873675 shutdown_connections 2023-10-18T22:10:39.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.910+0000 7f0c7ca26700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c60060f70 0x7f0c60063430 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.910+0000 7f0c7ca26700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c780f6530 0x7f0c78106d90 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.910+0000 7f0c7ca26700 1 --2- 172.21.15.8:0/1578873675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c780f77d0 0x7f0c78107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:39.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.910+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1578873675 >> 172.21.15.8:0/1578873675 conn(0x7f0c780f1c90 msgr2=0x7f0c780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:39.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.910+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1578873675 shutdown_connections 2023-10-18T22:10:39.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:39.910+0000 7f0c7ca26700 1 -- 172.21.15.8:0/1578873675 wait complete. 2023-10-18T22:10:40.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.046+0000 7f6320a74700 1 -- 172.21.15.8:0/553074349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f631c0f77d0 msgr2=0x7f631c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:40.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.046+0000 7f6320a74700 1 --2- 172.21.15.8:0/553074349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f631c0f77d0 0x7f631c0f7c30 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f6310004660 tx=0x7f6310009b30).stop 2023-10-18T22:10:40.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.046+0000 7f6320a74700 1 -- 172.21.15.8:0/553074349 shutdown_connections 2023-10-18T22:10:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.046+0000 7f6320a74700 1 --2- 172.21.15.8:0/553074349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f631c0f77d0 0x7f631c0f7c30 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.046+0000 7f6320a74700 1 --2- 172.21.15.8:0/553074349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f631c0f6530 0x7f631c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.046+0000 7f6320a74700 1 -- 172.21.15.8:0/553074349 >> 172.21.15.8:0/553074349 conn(0x7f631c0f1c90 msgr2=0x7f631c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.046+0000 7f6320a74700 1 -- 172.21.15.8:0/553074349 shutdown_connections 2023-10-18T22:10:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.046+0000 7f6320a74700 1 -- 172.21.15.8:0/553074349 wait complete. 2023-10-18T22:10:40.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.047+0000 7f6320a74700 1 Processor -- start 2023-10-18T22:10:40.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.048+0000 7f6320a74700 1 -- start start 2023-10-18T22:10:40.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.048+0000 7f6320a74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f631c0f6530 0x7f631c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:40.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.048+0000 7f6320a74700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f631c0f77d0 0x7f631c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:40.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.048+0000 7f6320a74700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c107880 con 0x7f631c0f6530 2023-10-18T22:10:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.048+0000 7f6320a74700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c1080c0 con 0x7f631c0f77d0 2023-10-18T22:10:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.048+0000 7f631b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f631c0f6530 0x7f631c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f631b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f631c0f6530 0x7f631c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59954/0 (socket says 172.21.15.8:59954) 2023-10-18T22:10:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f631b7fe700 1 -- 172.21.15.8:0/253188398 learned_addr learned my addr 172.21.15.8:0/253188398 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f631affd700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f631c0f77d0 0x7f631c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f631b7fe700 1 -- 172.21.15.8:0/253188398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f631c0f77d0 msgr2=0x7f631c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f631b7fe700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f631c0f77d0 0x7f631c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f631b7fe700 1 -- 172.21.15.8:0/253188398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6310005040 con 0x7f631c0f6530 2023-10-18T22:10:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f631b7fe700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f631c0f6530 0x7f631c106d90 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f630c002700 tx=0x7f630c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f6303fff700 1 -- 172.21.15.8:0/253188398 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f630c009320 con 0x7f631c0f6530 2023-10-18T22:10:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f6303fff700 1 -- 172.21.15.8:0/253188398 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f630c00f040 con 0x7f631c0f6530 2023-10-18T22:10:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f6320a74700 1 -- 172.21.15.8:0/253188398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c1083a0 con 0x7f631c0f6530 2023-10-18T22:10:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.049+0000 7f6303fff700 1 -- 172.21.15.8:0/253188398 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f630c014970 con 0x7f631c0f6530 2023-10-18T22:10:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.050+0000 7f6320a74700 1 -- 172.21.15.8:0/253188398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c1088e0 con 0x7f631c0f6530 2023-10-18T22:10:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.051+0000 7f6320a74700 1 -- 172.21.15.8:0/253188398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c059100 con 0x7f631c0f6530 2023-10-18T22:10:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.051+0000 7f6303fff700 1 -- 172.21.15.8:0/253188398 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f630c009480 con 0x7f631c0f6530 2023-10-18T22:10:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.053+0000 7f6303fff700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6304060f70 0x7f6304063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.053+0000 7f6303fff700 1 -- 172.21.15.8:0/253188398 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f630c07cb80 con 0x7f631c0f6530 2023-10-18T22:10:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.053+0000 7f631affd700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6304060f70 0x7f6304063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.053+0000 7f631affd700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6304060f70 0x7f6304063430 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f6310004630 tx=0x7f6310009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:40.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.057+0000 7f6303fff700 1 -- 172.21.15.8:0/253188398 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f630c04c7f0 con 0x7f631c0f6530 2023-10-18T22:10:40.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.284+0000 7f6320a74700 1 -- 172.21.15.8:0/253188398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f631c0fedc0 con 0x7f631c0f6530 2023-10-18T22:10:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.284+0000 7f6303fff700 1 -- 172.21.15.8:0/253188398 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f630c04fe10 con 0x7f631c0f6530 2023-10-18T22:10:40.286 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:10:40.286 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:10:40.286 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:10:40.287 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:10:40.287 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:10:40.287 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:10:40.287 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:10:40.287 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:10:40.288 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:10:40.288 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:10:40.288 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:10:40.288 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:10:40.288 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:10:40.288 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:10:40.289 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:10:40.289 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:10:40.289 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:10:40.289 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:10:40.289 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:10:40.290 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:10:40.290 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:10:40.290 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:10:40.290 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:10:40.291 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:10:40.291 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:10:40.291 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:10:40.291 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:10:40.291 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:10:40.292 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:10:40.292 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:10:40.292 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:10:40.293 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:10:40.293 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:10:40.293 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:10:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 -- 172.21.15.8:0/253188398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6304060f70 msgr2=0x7f6304063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6304060f70 0x7f6304063430 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f6310004630 tx=0x7f6310009b30).stop 2023-10-18T22:10:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 -- 172.21.15.8:0/253188398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f631c0f6530 msgr2=0x7f631c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f631c0f6530 0x7f631c106d90 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f630c002700 tx=0x7f630c009d80).stop 2023-10-18T22:10:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 -- 172.21.15.8:0/253188398 shutdown_connections 2023-10-18T22:10:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6304060f70 0x7f6304063430 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f631c0f6530 0x7f631c106d90 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 --2- 172.21.15.8:0/253188398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f631c0f77d0 0x7f631c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 -- 172.21.15.8:0/253188398 >> 172.21.15.8:0/253188398 conn(0x7f631c0f1c90 msgr2=0x7f631c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 -- 172.21.15.8:0/253188398 shutdown_connections 2023-10-18T22:10:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.286+0000 7f6320a74700 1 -- 172.21.15.8:0/253188398 wait complete. 2023-10-18T22:10:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:10:40.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.427+0000 7ff2d759e700 1 -- 172.21.15.8:0/1870028269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2d80f77d0 msgr2=0x7ff2d80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:40.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.427+0000 7ff2d759e700 1 --2- 172.21.15.8:0/1870028269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2d80f77d0 0x7ff2d80f7c30 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7ff2cc004660 tx=0x7ff2cc009b30).stop 2023-10-18T22:10:40.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.427+0000 7ff2d759e700 1 -- 172.21.15.8:0/1870028269 shutdown_connections 2023-10-18T22:10:40.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.427+0000 7ff2d759e700 1 --2- 172.21.15.8:0/1870028269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2d80f77d0 0x7ff2d80f7c30 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.427+0000 7ff2d759e700 1 --2- 172.21.15.8:0/1870028269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d80f6530 0x7ff2d80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.427+0000 7ff2d759e700 1 -- 172.21.15.8:0/1870028269 >> 172.21.15.8:0/1870028269 conn(0x7ff2d80f1c90 msgr2=0x7ff2d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:40.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.427+0000 7ff2d759e700 1 -- 172.21.15.8:0/1870028269 shutdown_connections 2023-10-18T22:10:40.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.427+0000 7ff2d759e700 1 -- 172.21.15.8:0/1870028269 wait complete. 2023-10-18T22:10:40.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.428+0000 7ff2d759e700 1 Processor -- start 2023-10-18T22:10:40.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.428+0000 7ff2d759e700 1 -- start start 2023-10-18T22:10:40.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.428+0000 7ff2d759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2d80f6530 0x7ff2d8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:40.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.428+0000 7ff2d759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d80f77d0 0x7ff2d8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:40.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.428+0000 7ff2d759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8107880 con 0x7ff2d80f6530 2023-10-18T22:10:40.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.428+0000 7ff2d759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d81080c0 con 0x7ff2d80f77d0 2023-10-18T22:10:40.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.428+0000 7ff2d659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2d80f6530 0x7ff2d8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:40.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.428+0000 7ff2d659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2d80f6530 0x7ff2d8106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59966/0 (socket says 172.21.15.8:59966) 2023-10-18T22:10:40.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.428+0000 7ff2d659c700 1 -- 172.21.15.8:0/955091854 learned_addr learned my addr 172.21.15.8:0/955091854 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:10:40.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.429+0000 7ff2d659c700 1 -- 172.21.15.8:0/955091854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d80f77d0 msgr2=0x7ff2d8107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:40.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.429+0000 7ff2d5d9b700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d80f77d0 0x7ff2d8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:40.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.429+0000 7ff2d659c700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d80f77d0 0x7ff2d8107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.429+0000 7ff2d659c700 1 -- 172.21.15.8:0/955091854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc005040 con 0x7ff2d80f6530 2023-10-18T22:10:40.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.429+0000 7ff2d5d9b700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d80f77d0 0x7ff2d8107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:10:40.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.429+0000 7ff2d659c700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2d80f6530 0x7ff2d8106d90 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7ff2c8002700 tx=0x7ff2c8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:40.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.429+0000 7ff2c6ffd700 1 -- 172.21.15.8:0/955091854 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c8009320 con 0x7ff2d80f6530 2023-10-18T22:10:40.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.429+0000 7ff2c6ffd700 1 -- 172.21.15.8:0/955091854 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff2c800f040 con 0x7ff2d80f6530 2023-10-18T22:10:40.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.429+0000 7ff2c6ffd700 1 -- 172.21.15.8:0/955091854 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c8014970 con 0x7ff2d80f6530 2023-10-18T22:10:40.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.429+0000 7ff2d759e700 1 -- 172.21.15.8:0/955091854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d81083a0 con 0x7ff2d80f6530 2023-10-18T22:10:40.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.430+0000 7ff2d759e700 1 -- 172.21.15.8:0/955091854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d81088e0 con 0x7ff2d80f6530 2023-10-18T22:10:40.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.430+0000 7ff2d759e700 1 -- 172.21.15.8:0/955091854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d8059100 con 0x7ff2d80f6530 2023-10-18T22:10:40.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.431+0000 7ff2c6ffd700 1 -- 172.21.15.8:0/955091854 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff2c8009480 con 0x7ff2d80f6530 2023-10-18T22:10:40.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.433+0000 7ff2c6ffd700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2c0060f70 0x7ff2c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:10:40.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.433+0000 7ff2c6ffd700 1 -- 172.21.15.8:0/955091854 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff2c807cb90 con 0x7ff2d80f6530 2023-10-18T22:10:40.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.433+0000 7ff2d5d9b700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2c0060f70 0x7ff2c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:10:40.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.434+0000 7ff2d5d9b700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2c0060f70 0x7ff2c0063430 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7ff2cc009d60 tx=0x7ff2cc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:10:40.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.437+0000 7ff2c6ffd700 1 -- 172.21.15.8:0/955091854 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff2c804c7c0 con 0x7ff2d80f6530 2023-10-18T22:10:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.636+0000 7ff2d759e700 1 -- 172.21.15.8:0/955091854 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2d80fee00 con 0x7ff2c0060f70 2023-10-18T22:10:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.638+0000 7ff2c6ffd700 1 -- 172.21.15.8:0/955091854 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff2d80fee00 con 0x7ff2c0060f70 2023-10-18T22:10:40.639 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:10:40.639 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:10:40.640 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:10:40.640 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:10:40.640 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:10:40.640 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:10:40.640 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:10:40.641 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:10:40.641 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:10:40.641 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:10:40.641 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:10:40.641 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:10:40.642 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:10:40.642 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:10:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 -- 172.21.15.8:0/955091854 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2c0060f70 msgr2=0x7ff2c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2c0060f70 0x7ff2c0063430 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7ff2cc009d60 tx=0x7ff2cc009b30).stop 2023-10-18T22:10:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 -- 172.21.15.8:0/955091854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2d80f6530 msgr2=0x7ff2d8106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:10:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2d80f6530 0x7ff2d8106d90 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7ff2c8002700 tx=0x7ff2c8009d80).stop 2023-10-18T22:10:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 -- 172.21.15.8:0/955091854 shutdown_connections 2023-10-18T22:10:40.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff2c0060f70 0x7ff2c0063430 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2d80f6530 0x7ff2d8106d90 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 --2- 172.21.15.8:0/955091854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d80f77d0 0x7ff2d8107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:10:40.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 -- 172.21.15.8:0/955091854 >> 172.21.15.8:0/955091854 conn(0x7ff2d80f1c90 msgr2=0x7ff2d80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:10:40.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 -- 172.21.15.8:0/955091854 shutdown_connections 2023-10-18T22:10:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:10:40.640+0000 7ff2d759e700 1 -- 172.21.15.8:0/955091854 wait complete. 2023-10-18T22:10:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:38.791527+0000 mgr.smithi008.flmjzp (mgr.14640) 4303 : audit [DBG] from='client.37480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:38.860183+0000 mgr.smithi008.flmjzp (mgr.14640) 4304 : cluster [DBG] pgmap v2955: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:39.144767+0000 mgr.smithi008.flmjzp (mgr.14640) 4305 : audit [DBG] from='client.37484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:39.908030+0000 mon.smithi008 (mon.0) 4609 : audit [DBG] from='client.? 172.21.15.8:0/1578873675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:40.284902+0000 mon.smithi008 (mon.0) 4610 : audit [DBG] from='client.? 172.21.15.8:0/253188398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:10:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:38.791527+0000 mgr.smithi008.flmjzp (mgr.14640) 4303 : audit [DBG] from='client.37480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:38.860183+0000 mgr.smithi008.flmjzp (mgr.14640) 4304 : cluster [DBG] pgmap v2955: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:39.144767+0000 mgr.smithi008.flmjzp (mgr.14640) 4305 : audit [DBG] from='client.37484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:39.908030+0000 mon.smithi008 (mon.0) 4609 : audit [DBG] from='client.? 172.21.15.8:0/1578873675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:40.284902+0000 mon.smithi008 (mon.0) 4610 : audit [DBG] from='client.? 172.21.15.8:0/253188398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:10:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:39.489901+0000 mgr.smithi008.flmjzp (mgr.14640) 4306 : audit [DBG] from='client.37488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:39.489901+0000 mgr.smithi008.flmjzp (mgr.14640) 4306 : audit [DBG] from='client.37488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:40.638188+0000 mgr.smithi008.flmjzp (mgr.14640) 4307 : audit [DBG] from='client.37500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:40.860685+0000 mgr.smithi008.flmjzp (mgr.14640) 4308 : cluster [DBG] pgmap v2956: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:40.638188+0000 mgr.smithi008.flmjzp (mgr.14640) 4307 : audit [DBG] from='client.37500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:10:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:40.860685+0000 mgr.smithi008.flmjzp (mgr.14640) 4308 : cluster [DBG] pgmap v2956: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:42.886956+0000 mon.smithi008 (mon.0) 4611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:42.889084+0000 mon.smithi008 (mon.0) 4612 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:42.890084+0000 mon.smithi008 (mon.0) 4613 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:42.896664+0000 mon.smithi008 (mon.0) 4614 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:42.903078+0000 mon.smithi008 (mon.0) 4615 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:42.906160+0000 mon.smithi008 (mon.0) 4616 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:42.907934+0000 mon.smithi008 (mon.0) 4617 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:42.909519+0000 mon.smithi008 (mon.0) 4618 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:43.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:42.911478+0000 mon.smithi008 (mon.0) 4619 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:42.886956+0000 mon.smithi008 (mon.0) 4611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:42.889084+0000 mon.smithi008 (mon.0) 4612 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:42.890084+0000 mon.smithi008 (mon.0) 4613 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:42.896664+0000 mon.smithi008 (mon.0) 4614 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:42.903078+0000 mon.smithi008 (mon.0) 4615 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:42.906160+0000 mon.smithi008 (mon.0) 4616 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:42.907934+0000 mon.smithi008 (mon.0) 4617 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:42.909519+0000 mon.smithi008 (mon.0) 4618 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:42.911478+0000 mon.smithi008 (mon.0) 4619 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:42.861227+0000 mgr.smithi008.flmjzp (mgr.14640) 4309 : cluster [DBG] pgmap v2957: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:42.890950+0000 mgr.smithi008.flmjzp (mgr.14640) 4310 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:42.891526+0000 mgr.smithi008.flmjzp (mgr.14640) 4311 : cluster [DBG] pgmap v2958: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:42.891889+0000 mgr.smithi008.flmjzp (mgr.14640) 4312 : cluster [DBG] pgmap v2959: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:42.913314+0000 mgr.smithi008.flmjzp (mgr.14640) 4313 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:42.861227+0000 mgr.smithi008.flmjzp (mgr.14640) 4309 : cluster [DBG] pgmap v2957: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:42.890950+0000 mgr.smithi008.flmjzp (mgr.14640) 4310 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:42.891526+0000 mgr.smithi008.flmjzp (mgr.14640) 4311 : cluster [DBG] pgmap v2958: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:42.891889+0000 mgr.smithi008.flmjzp (mgr.14640) 4312 : cluster [DBG] pgmap v2959: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:42.913314+0000 mgr.smithi008.flmjzp (mgr.14640) 4313 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:44.892429+0000 mgr.smithi008.flmjzp (mgr.14640) 4314 : cluster [DBG] pgmap v2960: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:44.892429+0000 mgr.smithi008.flmjzp (mgr.14640) 4314 : cluster [DBG] pgmap v2960: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:48.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:46.893127+0000 mgr.smithi008.flmjzp (mgr.14640) 4315 : cluster [DBG] pgmap v2961: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:48.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:46.893127+0000 mgr.smithi008.flmjzp (mgr.14640) 4315 : cluster [DBG] pgmap v2961: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:50.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:48.893700+0000 mgr.smithi008.flmjzp (mgr.14640) 4316 : cluster [DBG] pgmap v2962: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:50.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:48.893700+0000 mgr.smithi008.flmjzp (mgr.14640) 4316 : cluster [DBG] pgmap v2962: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:52.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:50.894218+0000 mgr.smithi008.flmjzp (mgr.14640) 4317 : cluster [DBG] pgmap v2963: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:52.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:50.894218+0000 mgr.smithi008.flmjzp (mgr.14640) 4317 : cluster [DBG] pgmap v2963: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:53.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:52.916435+0000 mon.smithi008 (mon.0) 4620 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:52.916435+0000 mon.smithi008 (mon.0) 4620 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:54.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:52.894851+0000 mgr.smithi008.flmjzp (mgr.14640) 4318 : cluster [DBG] pgmap v2964: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:54.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:53.487202+0000 mon.smithi008 (mon.0) 4621 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:54.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:53.488024+0000 mon.smithi008 (mon.0) 4622 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:54.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:53.493522+0000 mon.smithi008 (mon.0) 4623 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:54.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:53.499416+0000 mon.smithi008 (mon.0) 4624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:54.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:53.502103+0000 mon.smithi008 (mon.0) 4625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:54.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:53.503792+0000 mon.smithi008 (mon.0) 4626 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:54.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:53.505461+0000 mon.smithi008 (mon.0) 4627 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:54.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:10:53.507443+0000 mon.smithi008 (mon.0) 4628 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:52.894851+0000 mgr.smithi008.flmjzp (mgr.14640) 4318 : cluster [DBG] pgmap v2964: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:53.487202+0000 mon.smithi008 (mon.0) 4621 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:10:54.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:53.488024+0000 mon.smithi008 (mon.0) 4622 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:10:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:53.493522+0000 mon.smithi008 (mon.0) 4623 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:10:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:53.499416+0000 mon.smithi008 (mon.0) 4624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:10:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:53.502103+0000 mon.smithi008 (mon.0) 4625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:53.503792+0000 mon.smithi008 (mon.0) 4626 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:54.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:53.505461+0000 mon.smithi008 (mon.0) 4627 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:54.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:10:53.507443+0000 mon.smithi008 (mon.0) 4628 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:10:55.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:53.488647+0000 mgr.smithi008.flmjzp (mgr.14640) 4319 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:53.489179+0000 mgr.smithi008.flmjzp (mgr.14640) 4320 : cluster [DBG] pgmap v2965: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:53.489479+0000 mgr.smithi008.flmjzp (mgr.14640) 4321 : cluster [DBG] pgmap v2966: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:55.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:10:53.508986+0000 mgr.smithi008.flmjzp (mgr.14640) 4322 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:53.488647+0000 mgr.smithi008.flmjzp (mgr.14640) 4319 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:10:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:53.489179+0000 mgr.smithi008.flmjzp (mgr.14640) 4320 : cluster [DBG] pgmap v2965: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:53.489479+0000 mgr.smithi008.flmjzp (mgr.14640) 4321 : cluster [DBG] pgmap v2966: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:10:53.508986+0000 mgr.smithi008.flmjzp (mgr.14640) 4322 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:10:57.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:55.489920+0000 mgr.smithi008.flmjzp (mgr.14640) 4323 : cluster [DBG] pgmap v2967: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:57.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:55.489920+0000 mgr.smithi008.flmjzp (mgr.14640) 4323 : cluster [DBG] pgmap v2967: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:59.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:10:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:57.490560+0000 mgr.smithi008.flmjzp (mgr.14640) 4324 : cluster [DBG] pgmap v2968: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:10:59.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:10:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:57.490560+0000 mgr.smithi008.flmjzp (mgr.14640) 4324 : cluster [DBG] pgmap v2968: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:01.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:10:59.491074+0000 mgr.smithi008.flmjzp (mgr.14640) 4325 : cluster [DBG] pgmap v2969: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:10:59.491074+0000 mgr.smithi008.flmjzp (mgr.14640) 4325 : cluster [DBG] pgmap v2969: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:03.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:01.491994+0000 mgr.smithi008.flmjzp (mgr.14640) 4326 : cluster [DBG] pgmap v2970: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:03.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:01.491994+0000 mgr.smithi008.flmjzp (mgr.14640) 4326 : cluster [DBG] pgmap v2970: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:04.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:03.519800+0000 mon.smithi008 (mon.0) 4629 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:04.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:03.521980+0000 mon.smithi008 (mon.0) 4630 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:04.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:03.523123+0000 mon.smithi008 (mon.0) 4631 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:04.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:03.529777+0000 mon.smithi008 (mon.0) 4632 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:04.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:03.536204+0000 mon.smithi008 (mon.0) 4633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:04.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:03.539548+0000 mon.smithi008 (mon.0) 4634 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:04.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:03.541285+0000 mon.smithi008 (mon.0) 4635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:04.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:03.542954+0000 mon.smithi008 (mon.0) 4636 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:04.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:03.545014+0000 mon.smithi008 (mon.0) 4637 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:03.519800+0000 mon.smithi008 (mon.0) 4629 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:04.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:03.521980+0000 mon.smithi008 (mon.0) 4630 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:04.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:03.523123+0000 mon.smithi008 (mon.0) 4631 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:04.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:03.529777+0000 mon.smithi008 (mon.0) 4632 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:04.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:03.536204+0000 mon.smithi008 (mon.0) 4633 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:04.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:03.539548+0000 mon.smithi008 (mon.0) 4634 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:04.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:03.541285+0000 mon.smithi008 (mon.0) 4635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:04.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:03.542954+0000 mon.smithi008 (mon.0) 4636 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:04.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:03.545014+0000 mon.smithi008 (mon.0) 4637 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:05.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:03.492663+0000 mgr.smithi008.flmjzp (mgr.14640) 4327 : cluster [DBG] pgmap v2971: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:03.524065+0000 mgr.smithi008.flmjzp (mgr.14640) 4328 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:03.524699+0000 mgr.smithi008.flmjzp (mgr.14640) 4329 : cluster [DBG] pgmap v2972: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:03.525044+0000 mgr.smithi008.flmjzp (mgr.14640) 4330 : cluster [DBG] pgmap v2973: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:05.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:03.547244+0000 mgr.smithi008.flmjzp (mgr.14640) 4331 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:03.492663+0000 mgr.smithi008.flmjzp (mgr.14640) 4327 : cluster [DBG] pgmap v2971: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:03.524065+0000 mgr.smithi008.flmjzp (mgr.14640) 4328 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:05.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:03.524699+0000 mgr.smithi008.flmjzp (mgr.14640) 4329 : cluster [DBG] pgmap v2972: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:03.525044+0000 mgr.smithi008.flmjzp (mgr.14640) 4330 : cluster [DBG] pgmap v2973: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:05.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:03.547244+0000 mgr.smithi008.flmjzp (mgr.14640) 4331 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:05.525617+0000 mgr.smithi008.flmjzp (mgr.14640) 4332 : cluster [DBG] pgmap v2974: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:05.525617+0000 mgr.smithi008.flmjzp (mgr.14640) 4332 : cluster [DBG] pgmap v2974: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:07.526146+0000 mgr.smithi008.flmjzp (mgr.14640) 4333 : cluster [DBG] pgmap v2975: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:07.526146+0000 mgr.smithi008.flmjzp (mgr.14640) 4333 : cluster [DBG] pgmap v2975: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:10.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.793+0000 7f76f759e700 1 -- 172.21.15.8:0/3633459313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80f77d0 msgr2=0x7f76f80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:10.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.793+0000 7f76f759e700 1 --2- 172.21.15.8:0/3633459313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80f77d0 0x7f76f80f7c30 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7f76ec004660 tx=0x7f76ec009b30).stop 2023-10-18T22:11:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.793+0000 7f76f759e700 1 -- 172.21.15.8:0/3633459313 shutdown_connections 2023-10-18T22:11:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.793+0000 7f76f759e700 1 --2- 172.21.15.8:0/3633459313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80f77d0 0x7f76f80f7c30 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.793+0000 7f76f759e700 1 --2- 172.21.15.8:0/3633459313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f80f6530 0x7f76f80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.793+0000 7f76f759e700 1 -- 172.21.15.8:0/3633459313 >> 172.21.15.8:0/3633459313 conn(0x7f76f80f1c90 msgr2=0x7f76f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:10.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.793+0000 7f76f759e700 1 -- 172.21.15.8:0/3633459313 shutdown_connections 2023-10-18T22:11:10.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.793+0000 7f76f759e700 1 -- 172.21.15.8:0/3633459313 wait complete. 2023-10-18T22:11:10.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.794+0000 7f76f759e700 1 Processor -- start 2023-10-18T22:11:10.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.795+0000 7f76f759e700 1 -- start start 2023-10-18T22:11:10.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.795+0000 7f76f759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f80f6530 0x7f76f806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:10.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.795+0000 7f76f759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80f77d0 0x7f76f8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:10.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.795+0000 7f76f759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f806a380 con 0x7f76f80f77d0 2023-10-18T22:11:10.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.795+0000 7f76f759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f806a4c0 con 0x7f76f80f6530 2023-10-18T22:11:10.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.795+0000 7f76f5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80f77d0 0x7f76f8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:10.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.795+0000 7f76f5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80f77d0 0x7f76f8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40580/0 (socket says 172.21.15.8:40580) 2023-10-18T22:11:10.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.796+0000 7f76f5d9b700 1 -- 172.21.15.8:0/3372087363 learned_addr learned my addr 172.21.15.8:0/3372087363 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:10.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.796+0000 7f76f659c700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f80f6530 0x7f76f806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:10.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.796+0000 7f76f5d9b700 1 -- 172.21.15.8:0/3372087363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f80f6530 msgr2=0x7f76f806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:10.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.796+0000 7f76f5d9b700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f80f6530 0x7f76f806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:10.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.796+0000 7f76f5d9b700 1 -- 172.21.15.8:0/3372087363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec005040 con 0x7f76f80f77d0 2023-10-18T22:11:10.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.796+0000 7f76f5d9b700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80f77d0 0x7f76f8069e20 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f76ec009f50 tx=0x7f76ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:10.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.796+0000 7f76e6ffd700 1 -- 172.21.15.8:0/3372087363 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76ec018070 con 0x7f76f80f77d0 2023-10-18T22:11:10.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.796+0000 7f76e6ffd700 1 -- 172.21.15.8:0/3372087363 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f76ec009630 con 0x7f76f80f77d0 2023-10-18T22:11:10.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.796+0000 7f76e6ffd700 1 -- 172.21.15.8:0/3372087363 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76ec01c3c0 con 0x7f76f80f77d0 2023-10-18T22:11:10.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.796+0000 7f76f759e700 1 -- 172.21.15.8:0/3372087363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f806a740 con 0x7f76f80f77d0 2023-10-18T22:11:10.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.797+0000 7f76f759e700 1 -- 172.21.15.8:0/3372087363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f806aca0 con 0x7f76f80f77d0 2023-10-18T22:11:10.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.798+0000 7f76f759e700 1 -- 172.21.15.8:0/3372087363 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f8045ad0 con 0x7f76f80f77d0 2023-10-18T22:11:10.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.799+0000 7f76e6ffd700 1 -- 172.21.15.8:0/3372087363 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f76ec01d420 con 0x7f76f80f77d0 2023-10-18T22:11:10.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.800+0000 7f76e6ffd700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76e0060f70 0x7f76e0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:10.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.800+0000 7f76e6ffd700 1 -- 172.21.15.8:0/3372087363 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f76ec07e600 con 0x7f76f80f77d0 2023-10-18T22:11:10.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.800+0000 7f76f659c700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76e0060f70 0x7f76e0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:10.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.801+0000 7f76f659c700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76e0060f70 0x7f76e0063430 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f76f806b730 tx=0x7f76e8009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:10.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:10.805+0000 7f76e6ffd700 1 -- 172.21.15.8:0/3372087363 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f76ec04e310 con 0x7f76f80f77d0 2023-10-18T22:11:11.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.004+0000 7f76f759e700 1 -- 172.21.15.8:0/3372087363 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76f8057f10 con 0x7f76e0060f70 2023-10-18T22:11:11.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.005+0000 7f76e6ffd700 1 -- 172.21.15.8:0/3372087363 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f76f8057f10 con 0x7f76e0060f70 2023-10-18T22:11:11.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.007+0000 7f76f759e700 1 -- 172.21.15.8:0/3372087363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76e0060f70 msgr2=0x7f76e0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.007+0000 7f76f759e700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76e0060f70 0x7f76e0063430 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f76f806b730 tx=0x7f76e8009c00).stop 2023-10-18T22:11:11.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.007+0000 7f76f759e700 1 -- 172.21.15.8:0/3372087363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80f77d0 msgr2=0x7f76f8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.007+0000 7f76f759e700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80f77d0 0x7f76f8069e20 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f76ec009f50 tx=0x7f76ec009b30).stop 2023-10-18T22:11:11.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.007+0000 7f76f759e700 1 -- 172.21.15.8:0/3372087363 shutdown_connections 2023-10-18T22:11:11.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.007+0000 7f76f759e700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f76e0060f70 0x7f76e0063430 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.007+0000 7f76f759e700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f80f6530 0x7f76f806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.007+0000 7f76f759e700 1 --2- 172.21.15.8:0/3372087363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f80f77d0 0x7f76f8069e20 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.007+0000 7f76f759e700 1 -- 172.21.15.8:0/3372087363 >> 172.21.15.8:0/3372087363 conn(0x7f76f80f1c90 msgr2=0x7f76f80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:11.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.008+0000 7f76f759e700 1 -- 172.21.15.8:0/3372087363 shutdown_connections 2023-10-18T22:11:11.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.008+0000 7f76f759e700 1 -- 172.21.15.8:0/3372087363 wait complete. 2023-10-18T22:11:11.026 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:11:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.145+0000 7faa43fff700 1 -- 172.21.15.8:0/2553094949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa440f77d0 msgr2=0x7faa440f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.145+0000 7faa43fff700 1 --2- 172.21.15.8:0/2553094949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa440f77d0 0x7faa440f7c30 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7faa38004660 tx=0x7faa38009b30).stop 2023-10-18T22:11:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.145+0000 7faa43fff700 1 -- 172.21.15.8:0/2553094949 shutdown_connections 2023-10-18T22:11:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.145+0000 7faa43fff700 1 --2- 172.21.15.8:0/2553094949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa440f77d0 0x7faa440f7c30 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.145+0000 7faa43fff700 1 --2- 172.21.15.8:0/2553094949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440f6530 0x7faa440f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.145+0000 7faa43fff700 1 -- 172.21.15.8:0/2553094949 >> 172.21.15.8:0/2553094949 conn(0x7faa440f1c90 msgr2=0x7faa440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:11.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.145+0000 7faa43fff700 1 -- 172.21.15.8:0/2553094949 shutdown_connections 2023-10-18T22:11:11.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.145+0000 7faa43fff700 1 -- 172.21.15.8:0/2553094949 wait complete. 2023-10-18T22:11:11.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.146+0000 7faa43fff700 1 Processor -- start 2023-10-18T22:11:11.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.146+0000 7faa43fff700 1 -- start start 2023-10-18T22:11:11.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.147+0000 7faa43fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa440f6530 0x7faa44108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:11.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.147+0000 7faa43fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440f77d0 0x7faa441093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:11.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.147+0000 7faa43fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa441099a0 con 0x7faa440f6530 2023-10-18T22:11:11.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.147+0000 7faa43fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa44109ae0 con 0x7faa440f77d0 2023-10-18T22:11:11.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.147+0000 7faa42ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa440f6530 0x7faa44108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:11.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.147+0000 7faa42ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa440f6530 0x7faa44108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40596/0 (socket says 172.21.15.8:40596) 2023-10-18T22:11:11.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.147+0000 7faa42ffd700 1 -- 172.21.15.8:0/953422130 learned_addr learned my addr 172.21.15.8:0/953422130 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:11.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.147+0000 7faa427fc700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440f77d0 0x7faa441093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:11.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.148+0000 7faa42ffd700 1 -- 172.21.15.8:0/953422130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440f77d0 msgr2=0x7faa441093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.148+0000 7faa42ffd700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440f77d0 0x7faa441093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.148+0000 7faa42ffd700 1 -- 172.21.15.8:0/953422130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38005040 con 0x7faa440f6530 2023-10-18T22:11:11.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.148+0000 7faa42ffd700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa440f6530 0x7faa44108f00 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7faa3400e7c0 tx=0x7faa3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:11.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.148+0000 7faa2b7fe700 1 -- 172.21.15.8:0/953422130 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa340092e0 con 0x7faa440f6530 2023-10-18T22:11:11.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.148+0000 7faa2b7fe700 1 -- 172.21.15.8:0/953422130 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faa3400f040 con 0x7faa440f6530 2023-10-18T22:11:11.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.148+0000 7faa2b7fe700 1 -- 172.21.15.8:0/953422130 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa340147e0 con 0x7faa440f6530 2023-10-18T22:11:11.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.148+0000 7faa43fff700 1 -- 172.21.15.8:0/953422130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4410a480 con 0x7faa440f6530 2023-10-18T22:11:11.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.148+0000 7faa43fff700 1 -- 172.21.15.8:0/953422130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4410a9c0 con 0x7faa440f6530 2023-10-18T22:11:11.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.149+0000 7faa43fff700 1 -- 172.21.15.8:0/953422130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa44045ad0 con 0x7faa440f6530 2023-10-18T22:11:11.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.150+0000 7faa2b7fe700 1 -- 172.21.15.8:0/953422130 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faa3401b030 con 0x7faa440f6530 2023-10-18T22:11:11.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.151+0000 7faa2b7fe700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa2c060f70 0x7faa2c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:11.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.151+0000 7faa2b7fe700 1 -- 172.21.15.8:0/953422130 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faa3407c990 con 0x7faa440f6530 2023-10-18T22:11:11.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.151+0000 7faa427fc700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa2c060f70 0x7faa2c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:11.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.152+0000 7faa427fc700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa2c060f70 0x7faa2c063430 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7faa38009720 tx=0x7faa3800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:11.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.156+0000 7faa2b7fe700 1 -- 172.21.15.8:0/953422130 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faa3404ff10 con 0x7faa440f6530 2023-10-18T22:11:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.353+0000 7faa43fff700 1 -- 172.21.15.8:0/953422130 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa4410ac30 con 0x7faa2c060f70 2023-10-18T22:11:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.354+0000 7faa2b7fe700 1 -- 172.21.15.8:0/953422130 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faa4410ac30 con 0x7faa2c060f70 2023-10-18T22:11:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 -- 172.21.15.8:0/953422130 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa2c060f70 msgr2=0x7faa2c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa2c060f70 0x7faa2c063430 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7faa38009720 tx=0x7faa3800b040).stop 2023-10-18T22:11:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 -- 172.21.15.8:0/953422130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa440f6530 msgr2=0x7faa44108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa440f6530 0x7faa44108f00 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7faa3400e7c0 tx=0x7faa3400b040).stop 2023-10-18T22:11:11.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 -- 172.21.15.8:0/953422130 shutdown_connections 2023-10-18T22:11:11.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa2c060f70 0x7faa2c063430 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa440f6530 0x7faa44108f00 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 --2- 172.21.15.8:0/953422130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440f77d0 0x7faa441093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 -- 172.21.15.8:0/953422130 >> 172.21.15.8:0/953422130 conn(0x7faa440f1c90 msgr2=0x7faa4406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:11.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 -- 172.21.15.8:0/953422130 shutdown_connections 2023-10-18T22:11:11.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.356+0000 7faa43fff700 1 -- 172.21.15.8:0/953422130 wait complete. 2023-10-18T22:11:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:09.526770+0000 mgr.smithi008.flmjzp (mgr.14640) 4334 : cluster [DBG] pgmap v2976: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:11.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.492+0000 7f7cdbfff700 1 -- 172.21.15.8:0/2044773002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cdc0f77d0 msgr2=0x7f7cdc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.492+0000 7f7cdbfff700 1 --2- 172.21.15.8:0/2044773002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cdc0f77d0 0x7f7cdc0f7c30 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f7cd0004660 tx=0x7f7cd0009b30).stop 2023-10-18T22:11:11.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.493+0000 7f7cdbfff700 1 -- 172.21.15.8:0/2044773002 shutdown_connections 2023-10-18T22:11:11.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.493+0000 7f7cdbfff700 1 --2- 172.21.15.8:0/2044773002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cdc0f77d0 0x7f7cdc0f7c30 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.493+0000 7f7cdbfff700 1 --2- 172.21.15.8:0/2044773002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cdc0f6530 0x7f7cdc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.493+0000 7f7cdbfff700 1 -- 172.21.15.8:0/2044773002 >> 172.21.15.8:0/2044773002 conn(0x7f7cdc0f1c90 msgr2=0x7f7cdc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:11.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.493+0000 7f7cdbfff700 1 -- 172.21.15.8:0/2044773002 shutdown_connections 2023-10-18T22:11:11.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.493+0000 7f7cdbfff700 1 -- 172.21.15.8:0/2044773002 wait complete. 2023-10-18T22:11:11.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.494+0000 7f7cdbfff700 1 Processor -- start 2023-10-18T22:11:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.494+0000 7f7cdbfff700 1 -- start start 2023-10-18T22:11:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.494+0000 7f7cdbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cdc0f6530 0x7f7cdc108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.494+0000 7f7cdbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cdc0f77d0 0x7f7cdc1093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.494+0000 7f7cdbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc109950 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.494+0000 7f7cdbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc109a90 con 0x7f7cdc0f6530 2023-10-18T22:11:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.494+0000 7f7cda7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cdc0f77d0 0x7f7cdc1093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.494+0000 7f7cda7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cdc0f77d0 0x7f7cdc1093a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40612/0 (socket says 172.21.15.8:40612) 2023-10-18T22:11:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cda7fc700 1 -- 172.21.15.8:0/3656473318 learned_addr learned my addr 172.21.15.8:0/3656473318 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cdaffd700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cdc0f6530 0x7f7cdc108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:11.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cda7fc700 1 -- 172.21.15.8:0/3656473318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cdc0f6530 msgr2=0x7f7cdc108eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cda7fc700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cdc0f6530 0x7f7cdc108eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cda7fc700 1 -- 172.21.15.8:0/3656473318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd0005040 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cda7fc700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cdc0f77d0 0x7f7cdc1093a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f7cd0004320 tx=0x7f7cd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cc37fe700 1 -- 172.21.15.8:0/3656473318 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd0019070 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cc37fe700 1 -- 172.21.15.8:0/3656473318 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7cd001e420 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cdbfff700 1 -- 172.21.15.8:0/3656473318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc10a3d0 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cc37fe700 1 -- 172.21.15.8:0/3656473318 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd0014660 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.495+0000 7f7cdbfff700 1 -- 172.21.15.8:0/3656473318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc10a8b0 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.496+0000 7f7cdbfff700 1 -- 172.21.15.8:0/3656473318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cdc045ad0 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.497+0000 7f7cc37fe700 1 -- 172.21.15.8:0/3656473318 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7cd001e590 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.498+0000 7f7cc37fe700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cc4060f70 0x7f7cc4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:11.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.498+0000 7f7cc37fe700 1 -- 172.21.15.8:0/3656473318 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7cd007dd90 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.499+0000 7f7cdaffd700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cc4060f70 0x7f7cc4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:11.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.499+0000 7f7cdaffd700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cc4060f70 0x7f7cc4063430 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f7cdc0f7630 tx=0x7f7ccc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:11.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.503+0000 7f7cc37fe700 1 -- 172.21.15.8:0/3656473318 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7cd0051390 con 0x7f7cdc0f77d0 2023-10-18T22:11:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:09.526770+0000 mgr.smithi008.flmjzp (mgr.14640) 4334 : cluster [DBG] pgmap v2976: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:11.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.695+0000 7f7cdbfff700 1 -- 172.21.15.8:0/3656473318 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cdc0fee30 con 0x7f7cc4060f70 2023-10-18T22:11:11.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.705+0000 7f7cc37fe700 1 -- 172.21.15.8:0/3656473318 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7cdc0fee30 con 0x7f7cc4060f70 2023-10-18T22:11:11.708 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:11:11.708 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (77m) 5m ago 79m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:11:11.708 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (71m) 5m ago 79m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:11:11.708 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (71m) 3m ago 78m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:11:11.709 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (77m) 5m ago 78m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:11:11.709 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 75m - - 2023-10-18T22:11:11.709 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 75m - - 2023-10-18T22:11:11.710 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 75m - - 2023-10-18T22:11:11.710 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 75m - - 2023-10-18T22:11:11.710 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (73m) 5m ago 80m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:11:11.711 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (72m) 3m ago 78m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:11:11.711 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (72m) 5m ago 80m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:11:11.711 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (71m) 3m ago 78m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:11:11.711 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (78m) 5m ago 78m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:11:11.711 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (78m) 3m ago 78m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:11:11.712 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (71m) 5m ago 77m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:11:11.712 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (69m) 5m ago 77m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:11:11.712 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (68m) 5m ago 77m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:11:11.712 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (68m) 3m ago 77m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:11:11.712 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (67m) 3m ago 76m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:11:11.713 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (67m) 3m ago 76m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:11:11.713 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (73m) 5m ago 78m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:11:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 -- 172.21.15.8:0/3656473318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cc4060f70 msgr2=0x7f7cc4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cc4060f70 0x7f7cc4063430 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f7cdc0f7630 tx=0x7f7ccc00b040).stop 2023-10-18T22:11:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 -- 172.21.15.8:0/3656473318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cdc0f77d0 msgr2=0x7f7cdc1093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cdc0f77d0 0x7f7cdc1093a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f7cd0004320 tx=0x7f7cd000b040).stop 2023-10-18T22:11:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 -- 172.21.15.8:0/3656473318 shutdown_connections 2023-10-18T22:11:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7cc4060f70 0x7f7cc4063430 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cdc0f6530 0x7f7cdc108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 --2- 172.21.15.8:0/3656473318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cdc0f77d0 0x7f7cdc1093a0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 -- 172.21.15.8:0/3656473318 >> 172.21.15.8:0/3656473318 conn(0x7f7cdc0f1c90 msgr2=0x7f7cdc0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 -- 172.21.15.8:0/3656473318 shutdown_connections 2023-10-18T22:11:11.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.707+0000 7f7cdbfff700 1 -- 172.21.15.8:0/3656473318 wait complete. 2023-10-18T22:11:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.843+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1884077883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0f77d0 msgr2=0x7fd0ec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.843+0000 7fd0f0bc0700 1 --2- 172.21.15.8:0/1884077883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0f77d0 0x7fd0ec0f7c30 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7fd0e0004660 tx=0x7fd0e0009b30).stop 2023-10-18T22:11:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.843+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1884077883 shutdown_connections 2023-10-18T22:11:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.843+0000 7fd0f0bc0700 1 --2- 172.21.15.8:0/1884077883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0f77d0 0x7fd0ec0f7c30 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.843+0000 7fd0f0bc0700 1 --2- 172.21.15.8:0/1884077883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ec0f6530 0x7fd0ec0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.843+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1884077883 >> 172.21.15.8:0/1884077883 conn(0x7fd0ec0f1c90 msgr2=0x7fd0ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.843+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1884077883 shutdown_connections 2023-10-18T22:11:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.843+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1884077883 wait complete. 2023-10-18T22:11:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.844+0000 7fd0f0bc0700 1 Processor -- start 2023-10-18T22:11:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.844+0000 7fd0f0bc0700 1 -- start start 2023-10-18T22:11:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.844+0000 7fd0f0bc0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0f6530 0x7fd0ec108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:11.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.844+0000 7fd0f0bc0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ec0f77d0 0x7fd0ec109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:11.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.844+0000 7fd0f0bc0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec1099d0 con 0x7fd0ec0f6530 2023-10-18T22:11:11.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.844+0000 7fd0f0bc0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec109b10 con 0x7fd0ec0f77d0 2023-10-18T22:11:11.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.845+0000 7fd0eb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0f6530 0x7fd0ec108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:11.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.845+0000 7fd0eb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0f6530 0x7fd0ec108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40634/0 (socket says 172.21.15.8:40634) 2023-10-18T22:11:11.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.845+0000 7fd0eb7fe700 1 -- 172.21.15.8:0/1198156623 learned_addr learned my addr 172.21.15.8:0/1198156623 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:11.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.845+0000 7fd0eb7fe700 1 -- 172.21.15.8:0/1198156623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ec0f77d0 msgr2=0x7fd0ec109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:11.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.845+0000 7fd0eaffd700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ec0f77d0 0x7fd0ec109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:11.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.845+0000 7fd0eb7fe700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ec0f77d0 0x7fd0ec109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:11.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.845+0000 7fd0eb7fe700 1 -- 172.21.15.8:0/1198156623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e0005040 con 0x7fd0ec0f6530 2023-10-18T22:11:11.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.845+0000 7fd0eb7fe700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0f6530 0x7fd0ec108f30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7fd0dc00e7c0 tx=0x7fd0dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:11.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.845+0000 7fd0d3fff700 1 -- 172.21.15.8:0/1198156623 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0dc0092e0 con 0x7fd0ec0f6530 2023-10-18T22:11:11.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.845+0000 7fd0d3fff700 1 -- 172.21.15.8:0/1198156623 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd0dc00f040 con 0x7fd0ec0f6530 2023-10-18T22:11:11.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.846+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1198156623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec10a460 con 0x7fd0ec0f6530 2023-10-18T22:11:11.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.846+0000 7fd0d3fff700 1 -- 172.21.15.8:0/1198156623 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0dc0147e0 con 0x7fd0ec0f6530 2023-10-18T22:11:11.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.846+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1198156623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec10a9a0 con 0x7fd0ec0f6530 2023-10-18T22:11:11.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.847+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1198156623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ec045ad0 con 0x7fd0ec0f6530 2023-10-18T22:11:11.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.848+0000 7fd0d3fff700 1 -- 172.21.15.8:0/1198156623 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd0dc01b030 con 0x7fd0ec0f6530 2023-10-18T22:11:11.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.848+0000 7fd0d3fff700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0d4060f70 0x7fd0d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:11.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.849+0000 7fd0d3fff700 1 -- 172.21.15.8:0/1198156623 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd0dc07c990 con 0x7fd0ec0f6530 2023-10-18T22:11:11.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.849+0000 7fd0eaffd700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0d4060f70 0x7fd0d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:11.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.849+0000 7fd0eaffd700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0d4060f70 0x7fd0d4063430 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fd0e0005010 tx=0x7fd0e000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:11.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:11.853+0000 7fd0d3fff700 1 -- 172.21.15.8:0/1198156623 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd0dc04ff10 con 0x7fd0ec0f6530 2023-10-18T22:11:12.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.106+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1198156623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0ec10b030 con 0x7fd0ec0f6530 2023-10-18T22:11:12.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.106+0000 7fd0d3fff700 1 -- 172.21.15.8:0/1198156623 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fd0dc019020 con 0x7fd0ec0f6530 2023-10-18T22:11:12.109 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:11:12.109 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:11:12.109 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:11:12.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:11:12.110 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:11:12.110 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:11:12.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:11:12.110 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:11:12.111 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:11:12.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:11:12.111 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:11:12.111 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:11:12.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:11:12.112 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:11:12.112 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:11:12.112 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:11:12.112 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:11:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.108+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1198156623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0d4060f70 msgr2=0x7fd0d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.108+0000 7fd0f0bc0700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0d4060f70 0x7fd0d4063430 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fd0e0005010 tx=0x7fd0e000b040).stop 2023-10-18T22:11:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.108+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1198156623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0f6530 msgr2=0x7fd0ec108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.108+0000 7fd0f0bc0700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0f6530 0x7fd0ec108f30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7fd0dc00e7c0 tx=0x7fd0dc00b040).stop 2023-10-18T22:11:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.108+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1198156623 shutdown_connections 2023-10-18T22:11:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.108+0000 7fd0f0bc0700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd0d4060f70 0x7fd0d4063430 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.108+0000 7fd0f0bc0700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0f6530 0x7fd0ec108f30 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.108+0000 7fd0f0bc0700 1 --2- 172.21.15.8:0/1198156623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ec0f77d0 0x7fd0ec109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.108+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1198156623 >> 172.21.15.8:0/1198156623 conn(0x7fd0ec0f1c90 msgr2=0x7fd0ec0f3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:12.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.109+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1198156623 shutdown_connections 2023-10-18T22:11:12.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.109+0000 7fd0f0bc0700 1 -- 172.21.15.8:0/1198156623 wait complete. 2023-10-18T22:11:12.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.246+0000 7f2db759e700 1 -- 172.21.15.8:0/2320427197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80f6530 msgr2=0x7f2db80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:12.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.246+0000 7f2db759e700 1 --2- 172.21.15.8:0/2320427197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80f6530 0x7f2db80f6950 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f2da8004660 tx=0x7f2da8009b30).stop 2023-10-18T22:11:12.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.247+0000 7f2db759e700 1 -- 172.21.15.8:0/2320427197 shutdown_connections 2023-10-18T22:11:12.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.247+0000 7f2db759e700 1 --2- 172.21.15.8:0/2320427197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80f77d0 0x7f2db80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.247+0000 7f2db759e700 1 --2- 172.21.15.8:0/2320427197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80f6530 0x7f2db80f6950 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.247+0000 7f2db759e700 1 -- 172.21.15.8:0/2320427197 >> 172.21.15.8:0/2320427197 conn(0x7f2db80f1c90 msgr2=0x7f2db80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.247+0000 7f2db759e700 1 -- 172.21.15.8:0/2320427197 shutdown_connections 2023-10-18T22:11:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.247+0000 7f2db759e700 1 -- 172.21.15.8:0/2320427197 wait complete. 2023-10-18T22:11:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.248+0000 7f2db759e700 1 Processor -- start 2023-10-18T22:11:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.248+0000 7f2db759e700 1 -- start start 2023-10-18T22:11:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80f6530 0x7f2db8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80f77d0 0x7f2db81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8109a70 con 0x7f2db80f77d0 2023-10-18T22:11:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8109bb0 con 0x7f2db80f6530 2023-10-18T22:11:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80f77d0 0x7f2db81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80f77d0 0x7f2db81094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40652/0 (socket says 172.21.15.8:40652) 2023-10-18T22:11:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db5d9b700 1 -- 172.21.15.8:0/3333940181 learned_addr learned my addr 172.21.15.8:0/3333940181 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db659c700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80f6530 0x7f2db8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db5d9b700 1 -- 172.21.15.8:0/3333940181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80f6530 msgr2=0x7f2db8108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db5d9b700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80f6530 0x7f2db8108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db5d9b700 1 -- 172.21.15.8:0/3333940181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da8005040 con 0x7f2db80f77d0 2023-10-18T22:11:12.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.249+0000 7f2db5d9b700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80f77d0 0x7f2db81094c0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f2dac0026d0 tx=0x7f2dac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:12.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.250+0000 7f2da6ffd700 1 -- 172.21.15.8:0/3333940181 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dac009320 con 0x7f2db80f77d0 2023-10-18T22:11:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.250+0000 7f2da6ffd700 1 -- 172.21.15.8:0/3333940181 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2dac00f040 con 0x7f2db80f77d0 2023-10-18T22:11:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.250+0000 7f2db759e700 1 -- 172.21.15.8:0/3333940181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db810a550 con 0x7f2db80f77d0 2023-10-18T22:11:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.250+0000 7f2da6ffd700 1 -- 172.21.15.8:0/3333940181 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dac0148a0 con 0x7f2db80f77d0 2023-10-18T22:11:12.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.250+0000 7f2db759e700 1 -- 172.21.15.8:0/3333940181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db810ab10 con 0x7f2db80f77d0 2023-10-18T22:11:12.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.251+0000 7f2db759e700 1 -- 172.21.15.8:0/3333940181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db8045ad0 con 0x7f2db80f77d0 2023-10-18T22:11:12.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.252+0000 7f2da6ffd700 1 -- 172.21.15.8:0/3333940181 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2dac009480 con 0x7f2db80f77d0 2023-10-18T22:11:12.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.253+0000 7f2da6ffd700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2da0060f70 0x7f2da0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:12.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.253+0000 7f2da6ffd700 1 -- 172.21.15.8:0/3333940181 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2dac07cf60 con 0x7f2db80f77d0 2023-10-18T22:11:12.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.253+0000 7f2db659c700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2da0060f70 0x7f2da0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:12.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.254+0000 7f2db659c700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2da0060f70 0x7f2da0063430 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f2da8004630 tx=0x7f2da8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:12.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.257+0000 7f2da6ffd700 1 -- 172.21.15.8:0/3333940181 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2dac0505c0 con 0x7f2db80f77d0 2023-10-18T22:11:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.484+0000 7f2db759e700 1 -- 172.21.15.8:0/3333940181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2db8027a00 con 0x7f2db80f77d0 2023-10-18T22:11:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.484+0000 7f2da6ffd700 1 -- 172.21.15.8:0/3333940181 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f2dac0501b0 con 0x7f2db80f77d0 2023-10-18T22:11:12.488 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:11:12.488 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:11:12.489 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:11:12.489 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:11:12.490 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:11:12.490 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:11:12.490 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:11:12.491 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:11:12.491 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:11:12.492 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:11:12.492 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:11:12.492 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:11:12.492 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:11:12.493 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:11:12.493 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:11:12.494 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:11:12.494 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:11:12.494 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:11:12.495 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:11:12.495 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:11:12.496 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:11:12.496 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:11:12.496 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:11:12.497 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:11:12.497 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:11:12.497 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:11:12.497 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:11:12.498 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:11:12.498 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:11:12.498 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:11:12.498 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:11:12.499 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:11:12.499 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:11:12.499 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:11:12.500 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:11.005477+0000 mgr.smithi008.flmjzp (mgr.14640) 4335 : audit [DBG] from='client.37504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:12.500 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:11.355610+0000 mgr.smithi008.flmjzp (mgr.14640) 4336 : audit [DBG] from='client.37508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:12.501 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:12.107967+0000 mon.smithi008 (mon.0) 4638 : audit [DBG] from='client.? 172.21.15.8:0/1198156623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:12.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.486+0000 7f2db759e700 1 -- 172.21.15.8:0/3333940181 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2da0060f70 msgr2=0x7f2da0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:12.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.486+0000 7f2db759e700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2da0060f70 0x7f2da0063430 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f2da8004630 tx=0x7f2da8009b30).stop 2023-10-18T22:11:12.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.486+0000 7f2db759e700 1 -- 172.21.15.8:0/3333940181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80f77d0 msgr2=0x7f2db81094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:12.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.486+0000 7f2db759e700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80f77d0 0x7f2db81094c0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f2dac0026d0 tx=0x7f2dac009de0).stop 2023-10-18T22:11:12.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.486+0000 7f2db759e700 1 -- 172.21.15.8:0/3333940181 shutdown_connections 2023-10-18T22:11:12.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.486+0000 7f2db759e700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2da0060f70 0x7f2da0063430 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.486+0000 7f2db759e700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80f6530 0x7f2db8108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.486+0000 7f2db759e700 1 --2- 172.21.15.8:0/3333940181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80f77d0 0x7f2db81094c0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.486+0000 7f2db759e700 1 -- 172.21.15.8:0/3333940181 >> 172.21.15.8:0/3333940181 conn(0x7f2db80f1c90 msgr2=0x7f2db806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:12.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.487+0000 7f2db759e700 1 -- 172.21.15.8:0/3333940181 shutdown_connections 2023-10-18T22:11:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.487+0000 7f2db759e700 1 -- 172.21.15.8:0/3333940181 wait complete. 2023-10-18T22:11:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:11:12.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.624+0000 7efd4f59e700 1 -- 172.21.15.8:0/334392133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd500602b0 msgr2=0x7efd500f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:12.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.624+0000 7efd4f59e700 1 --2- 172.21.15.8:0/334392133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd500602b0 0x7efd500f9170 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7efd40004660 tx=0x7efd40009b30).stop 2023-10-18T22:11:12.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.624+0000 7efd4f59e700 1 -- 172.21.15.8:0/334392133 shutdown_connections 2023-10-18T22:11:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.624+0000 7efd4f59e700 1 --2- 172.21.15.8:0/334392133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd500f96f0 0x7efd500fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.624+0000 7efd4f59e700 1 --2- 172.21.15.8:0/334392133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd500602b0 0x7efd500f9170 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.624+0000 7efd4f59e700 1 -- 172.21.15.8:0/334392133 >> 172.21.15.8:0/334392133 conn(0x7efd500f0b90 msgr2=0x7efd500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.624+0000 7efd4f59e700 1 -- 172.21.15.8:0/334392133 shutdown_connections 2023-10-18T22:11:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.624+0000 7efd4f59e700 1 -- 172.21.15.8:0/334392133 wait complete. 2023-10-18T22:11:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.626+0000 7efd4f59e700 1 Processor -- start 2023-10-18T22:11:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.626+0000 7efd4f59e700 1 -- start start 2023-10-18T22:11:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.626+0000 7efd4f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd500602b0 0x7efd50106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.626+0000 7efd4f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd500f96f0 0x7efd50107260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.626+0000 7efd4f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50107860 con 0x7efd500602b0 2023-10-18T22:11:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.626+0000 7efd4f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50108070 con 0x7efd500f96f0 2023-10-18T22:11:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.627+0000 7efd4e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd500602b0 0x7efd50106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.627+0000 7efd4e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd500602b0 0x7efd50106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40670/0 (socket says 172.21.15.8:40670) 2023-10-18T22:11:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.627+0000 7efd4e59c700 1 -- 172.21.15.8:0/3424165914 learned_addr learned my addr 172.21.15.8:0/3424165914 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.627+0000 7efd4dd9b700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd500f96f0 0x7efd50107260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:12.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.627+0000 7efd4e59c700 1 -- 172.21.15.8:0/3424165914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd500f96f0 msgr2=0x7efd50107260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:12.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.627+0000 7efd4e59c700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd500f96f0 0x7efd50107260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.627+0000 7efd4e59c700 1 -- 172.21.15.8:0/3424165914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40005040 con 0x7efd500602b0 2023-10-18T22:11:12.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.627+0000 7efd4e59c700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd500602b0 0x7efd50106d70 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7efd40004320 tx=0x7efd4000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:12.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.627+0000 7efd3effd700 1 -- 172.21.15.8:0/3424165914 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd40019070 con 0x7efd500602b0 2023-10-18T22:11:12.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.628+0000 7efd3effd700 1 -- 172.21.15.8:0/3424165914 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efd4001e420 con 0x7efd500602b0 2023-10-18T22:11:12.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.628+0000 7efd3effd700 1 -- 172.21.15.8:0/3424165914 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd40014660 con 0x7efd500602b0 2023-10-18T22:11:12.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.628+0000 7efd4f59e700 1 -- 172.21.15.8:0/3424165914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd50108290 con 0x7efd500602b0 2023-10-18T22:11:12.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.628+0000 7efd4f59e700 1 -- 172.21.15.8:0/3424165914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd50108720 con 0x7efd500602b0 2023-10-18T22:11:12.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.629+0000 7efd4f59e700 1 -- 172.21.15.8:0/3424165914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd50059100 con 0x7efd500602b0 2023-10-18T22:11:12.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.630+0000 7efd3effd700 1 -- 172.21.15.8:0/3424165914 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7efd4001e590 con 0x7efd500602b0 2023-10-18T22:11:12.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.631+0000 7efd3effd700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd38060f70 0x7efd38063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:12.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.631+0000 7efd3effd700 1 -- 172.21.15.8:0/3424165914 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7efd4007deb0 con 0x7efd500602b0 2023-10-18T22:11:12.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.631+0000 7efd4dd9b700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd38060f70 0x7efd38063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:12.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.632+0000 7efd4dd9b700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd38060f70 0x7efd38063430 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7efd50060080 tx=0x7efd4400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:12.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.635+0000 7efd3effd700 1 -- 172.21.15.8:0/3424165914 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efd4004da00 con 0x7efd500602b0 2023-10-18T22:11:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:11.005477+0000 mgr.smithi008.flmjzp (mgr.14640) 4335 : audit [DBG] from='client.37504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:11.355610+0000 mgr.smithi008.flmjzp (mgr.14640) 4336 : audit [DBG] from='client.37508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:12.107967+0000 mon.smithi008 (mon.0) 4638 : audit [DBG] from='client.? 172.21.15.8:0/1198156623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:12.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.836+0000 7efd4f59e700 1 -- 172.21.15.8:0/3424165914 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd500008d0 con 0x7efd38060f70 2023-10-18T22:11:12.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.838+0000 7efd3effd700 1 -- 172.21.15.8:0/3424165914 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efd500008d0 con 0x7efd38060f70 2023-10-18T22:11:12.840 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:11:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:11:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:11:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:11:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:11:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:11:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:11:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:11:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:11:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:11:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:11:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:11:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:11:12.843 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:11:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 -- 172.21.15.8:0/3424165914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd38060f70 msgr2=0x7efd38063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd38060f70 0x7efd38063430 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7efd50060080 tx=0x7efd4400b040).stop 2023-10-18T22:11:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 -- 172.21.15.8:0/3424165914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd500602b0 msgr2=0x7efd50106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd500602b0 0x7efd50106d70 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7efd40004320 tx=0x7efd4000b040).stop 2023-10-18T22:11:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 -- 172.21.15.8:0/3424165914 shutdown_connections 2023-10-18T22:11:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efd38060f70 0x7efd38063430 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd500602b0 0x7efd50106d70 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 --2- 172.21.15.8:0/3424165914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd500f96f0 0x7efd50107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 -- 172.21.15.8:0/3424165914 >> 172.21.15.8:0/3424165914 conn(0x7efd500f0b90 msgr2=0x7efd500f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 -- 172.21.15.8:0/3424165914 shutdown_connections 2023-10-18T22:11:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:12.840+0000 7efd4f59e700 1 -- 172.21.15.8:0/3424165914 wait complete. 2023-10-18T22:11:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:11.527202+0000 mgr.smithi008.flmjzp (mgr.14640) 4337 : cluster [DBG] pgmap v2977: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:11.697869+0000 mgr.smithi008.flmjzp (mgr.14640) 4338 : audit [DBG] from='client.37512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:13.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:12.486122+0000 mon.smithi008 (mon.0) 4639 : audit [DBG] from='client.? 172.21.15.8:0/3333940181' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:11:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:11.527202+0000 mgr.smithi008.flmjzp (mgr.14640) 4337 : cluster [DBG] pgmap v2977: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:11.697869+0000 mgr.smithi008.flmjzp (mgr.14640) 4338 : audit [DBG] from='client.37512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:12.486122+0000 mon.smithi008 (mon.0) 4639 : audit [DBG] from='client.? 172.21.15.8:0/3333940181' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:11:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:12.838958+0000 mgr.smithi008.flmjzp (mgr.14640) 4339 : audit [DBG] from='client.37524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:14.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:13.558004+0000 mon.smithi008 (mon.0) 4640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:14.114801+0000 mon.smithi008 (mon.0) 4641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:14.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:14.115921+0000 mon.smithi008 (mon.0) 4642 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:14.122596+0000 mon.smithi008 (mon.0) 4643 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:14.128952+0000 mon.smithi008 (mon.0) 4644 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:14.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:14.132300+0000 mon.smithi008 (mon.0) 4645 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:14.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:14.134056+0000 mon.smithi008 (mon.0) 4646 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:14.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:14.135823+0000 mon.smithi008 (mon.0) 4647 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:14.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:14.137917+0000 mon.smithi008 (mon.0) 4648 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:12.838958+0000 mgr.smithi008.flmjzp (mgr.14640) 4339 : audit [DBG] from='client.37524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:13.558004+0000 mon.smithi008 (mon.0) 4640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:14.114801+0000 mon.smithi008 (mon.0) 4641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:14.115921+0000 mon.smithi008 (mon.0) 4642 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:14.122596+0000 mon.smithi008 (mon.0) 4643 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:14.128952+0000 mon.smithi008 (mon.0) 4644 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:14.132300+0000 mon.smithi008 (mon.0) 4645 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:14.134056+0000 mon.smithi008 (mon.0) 4646 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:14.135823+0000 mon.smithi008 (mon.0) 4647 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:14.137917+0000 mon.smithi008 (mon.0) 4648 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:13.527923+0000 mgr.smithi008.flmjzp (mgr.14640) 4340 : cluster [DBG] pgmap v2978: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:15.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:14.116800+0000 mgr.smithi008.flmjzp (mgr.14640) 4341 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:14.117531+0000 mgr.smithi008.flmjzp (mgr.14640) 4342 : cluster [DBG] pgmap v2979: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:14.117868+0000 mgr.smithi008.flmjzp (mgr.14640) 4343 : cluster [DBG] pgmap v2980: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:15.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:14.139893+0000 mgr.smithi008.flmjzp (mgr.14640) 4344 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:13.527923+0000 mgr.smithi008.flmjzp (mgr.14640) 4340 : cluster [DBG] pgmap v2978: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:14.116800+0000 mgr.smithi008.flmjzp (mgr.14640) 4341 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:14.117531+0000 mgr.smithi008.flmjzp (mgr.14640) 4342 : cluster [DBG] pgmap v2979: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:14.117868+0000 mgr.smithi008.flmjzp (mgr.14640) 4343 : cluster [DBG] pgmap v2980: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:14.139893+0000 mgr.smithi008.flmjzp (mgr.14640) 4344 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:16.118375+0000 mgr.smithi008.flmjzp (mgr.14640) 4345 : cluster [DBG] pgmap v2981: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:16.118375+0000 mgr.smithi008.flmjzp (mgr.14640) 4345 : cluster [DBG] pgmap v2981: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:19.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:18.118886+0000 mgr.smithi008.flmjzp (mgr.14640) 4346 : cluster [DBG] pgmap v2982: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:18.118886+0000 mgr.smithi008.flmjzp (mgr.14640) 4346 : cluster [DBG] pgmap v2982: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:21.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:20.119498+0000 mgr.smithi008.flmjzp (mgr.14640) 4347 : cluster [DBG] pgmap v2983: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:20.119498+0000 mgr.smithi008.flmjzp (mgr.14640) 4347 : cluster [DBG] pgmap v2983: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:23.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:22.120013+0000 mgr.smithi008.flmjzp (mgr.14640) 4348 : cluster [DBG] pgmap v2984: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:23.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:22.120013+0000 mgr.smithi008.flmjzp (mgr.14640) 4348 : cluster [DBG] pgmap v2984: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:25.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:24.120597+0000 mgr.smithi008.flmjzp (mgr.14640) 4349 : cluster [DBG] pgmap v2985: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:24.152981+0000 mon.smithi008 (mon.0) 4649 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:24.154987+0000 mon.smithi008 (mon.0) 4650 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:24.155959+0000 mon.smithi008 (mon.0) 4651 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:24.156856+0000 mgr.smithi008.flmjzp (mgr.14640) 4350 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:25.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:24.157394+0000 mgr.smithi008.flmjzp (mgr.14640) 4351 : cluster [DBG] pgmap v2986: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:24.157670+0000 mgr.smithi008.flmjzp (mgr.14640) 4352 : cluster [DBG] pgmap v2987: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:24.165063+0000 mon.smithi008 (mon.0) 4652 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:24.171374+0000 mon.smithi008 (mon.0) 4653 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:25.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:24.174441+0000 mon.smithi008 (mon.0) 4654 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:25.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:24.176153+0000 mon.smithi008 (mon.0) 4655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:25.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:24.177752+0000 mon.smithi008 (mon.0) 4656 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:25.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:24.179700+0000 mon.smithi008 (mon.0) 4657 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:25.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:24.181747+0000 mgr.smithi008.flmjzp (mgr.14640) 4353 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:24.120597+0000 mgr.smithi008.flmjzp (mgr.14640) 4349 : cluster [DBG] pgmap v2985: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:24.152981+0000 mon.smithi008 (mon.0) 4649 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:24.154987+0000 mon.smithi008 (mon.0) 4650 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:24.155959+0000 mon.smithi008 (mon.0) 4651 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:24.156856+0000 mgr.smithi008.flmjzp (mgr.14640) 4350 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:24.157394+0000 mgr.smithi008.flmjzp (mgr.14640) 4351 : cluster [DBG] pgmap v2986: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:24.157670+0000 mgr.smithi008.flmjzp (mgr.14640) 4352 : cluster [DBG] pgmap v2987: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:25.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:24.165063+0000 mon.smithi008 (mon.0) 4652 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:25.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:24.171374+0000 mon.smithi008 (mon.0) 4653 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:25.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:24.174441+0000 mon.smithi008 (mon.0) 4654 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:25.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:24.176153+0000 mon.smithi008 (mon.0) 4655 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:25.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:24.177752+0000 mon.smithi008 (mon.0) 4656 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:25.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:24.179700+0000 mon.smithi008 (mon.0) 4657 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:25.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:24.181747+0000 mgr.smithi008.flmjzp (mgr.14640) 4353 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:27.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:26.158214+0000 mgr.smithi008.flmjzp (mgr.14640) 4354 : cluster [DBG] pgmap v2988: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:26.158214+0000 mgr.smithi008.flmjzp (mgr.14640) 4354 : cluster [DBG] pgmap v2988: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:29.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:28.158782+0000 mgr.smithi008.flmjzp (mgr.14640) 4355 : cluster [DBG] pgmap v2989: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:28.158782+0000 mgr.smithi008.flmjzp (mgr.14640) 4355 : cluster [DBG] pgmap v2989: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:30.159325+0000 mgr.smithi008.flmjzp (mgr.14640) 4356 : cluster [DBG] pgmap v2990: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:30.159325+0000 mgr.smithi008.flmjzp (mgr.14640) 4356 : cluster [DBG] pgmap v2990: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:32.159921+0000 mgr.smithi008.flmjzp (mgr.14640) 4357 : cluster [DBG] pgmap v2991: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:32.159921+0000 mgr.smithi008.flmjzp (mgr.14640) 4357 : cluster [DBG] pgmap v2991: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:34.192586+0000 mon.smithi008 (mon.0) 4658 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:34.194815+0000 mon.smithi008 (mon.0) 4659 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:34.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:34.195970+0000 mon.smithi008 (mon.0) 4660 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:34.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:34.202868+0000 mon.smithi008 (mon.0) 4661 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:34.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:34.209466+0000 mon.smithi008 (mon.0) 4662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:34.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:34.212703+0000 mon.smithi008 (mon.0) 4663 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:34.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:34.214532+0000 mon.smithi008 (mon.0) 4664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:34.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:34.216173+0000 mon.smithi008 (mon.0) 4665 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:34.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:34.218220+0000 mon.smithi008 (mon.0) 4666 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:34.192586+0000 mon.smithi008 (mon.0) 4658 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:34.194815+0000 mon.smithi008 (mon.0) 4659 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:34.195970+0000 mon.smithi008 (mon.0) 4660 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:34.202868+0000 mon.smithi008 (mon.0) 4661 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:34.209466+0000 mon.smithi008 (mon.0) 4662 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:34.212703+0000 mon.smithi008 (mon.0) 4663 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:34.214532+0000 mon.smithi008 (mon.0) 4664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:34.216173+0000 mon.smithi008 (mon.0) 4665 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:34.218220+0000 mon.smithi008 (mon.0) 4666 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:34.160639+0000 mgr.smithi008.flmjzp (mgr.14640) 4358 : cluster [DBG] pgmap v2992: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:35.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:34.196978+0000 mgr.smithi008.flmjzp (mgr.14640) 4359 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:35.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:34.197892+0000 mgr.smithi008.flmjzp (mgr.14640) 4360 : cluster [DBG] pgmap v2993: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:35.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:34.198270+0000 mgr.smithi008.flmjzp (mgr.14640) 4361 : cluster [DBG] pgmap v2994: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:35.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:34.220250+0000 mgr.smithi008.flmjzp (mgr.14640) 4362 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:34.160639+0000 mgr.smithi008.flmjzp (mgr.14640) 4358 : cluster [DBG] pgmap v2992: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:34.196978+0000 mgr.smithi008.flmjzp (mgr.14640) 4359 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:34.197892+0000 mgr.smithi008.flmjzp (mgr.14640) 4360 : cluster [DBG] pgmap v2993: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:35.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:34.198270+0000 mgr.smithi008.flmjzp (mgr.14640) 4361 : cluster [DBG] pgmap v2994: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:35.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:34.220250+0000 mgr.smithi008.flmjzp (mgr.14640) 4362 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:36.198785+0000 mgr.smithi008.flmjzp (mgr.14640) 4363 : cluster [DBG] pgmap v2995: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:36.198785+0000 mgr.smithi008.flmjzp (mgr.14640) 4363 : cluster [DBG] pgmap v2995: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:38.199237+0000 mgr.smithi008.flmjzp (mgr.14640) 4364 : cluster [DBG] pgmap v2996: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:38.199237+0000 mgr.smithi008.flmjzp (mgr.14640) 4364 : cluster [DBG] pgmap v2996: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:40.199820+0000 mgr.smithi008.flmjzp (mgr.14640) 4365 : cluster [DBG] pgmap v2997: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:40.199820+0000 mgr.smithi008.flmjzp (mgr.14640) 4365 : cluster [DBG] pgmap v2997: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:42.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.991+0000 7f37b7218700 1 -- 172.21.15.8:0/1167993264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00f6530 msgr2=0x7f37b00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:42.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.991+0000 7f37b7218700 1 --2- 172.21.15.8:0/1167993264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00f6530 0x7f37b00f6950 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f37ac004660 tx=0x7f37ac009b30).stop 2023-10-18T22:11:42.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.991+0000 7f37b7218700 1 -- 172.21.15.8:0/1167993264 shutdown_connections 2023-10-18T22:11:42.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.991+0000 7f37b7218700 1 --2- 172.21.15.8:0/1167993264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b00f77d0 0x7f37b00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:42.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.991+0000 7f37b7218700 1 --2- 172.21.15.8:0/1167993264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00f6530 0x7f37b00f6950 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:42.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.991+0000 7f37b7218700 1 -- 172.21.15.8:0/1167993264 >> 172.21.15.8:0/1167993264 conn(0x7f37b00f1c90 msgr2=0x7f37b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.991+0000 7f37b7218700 1 -- 172.21.15.8:0/1167993264 shutdown_connections 2023-10-18T22:11:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.991+0000 7f37b7218700 1 -- 172.21.15.8:0/1167993264 wait complete. 2023-10-18T22:11:42.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.992+0000 7f37b7218700 1 Processor -- start 2023-10-18T22:11:42.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.992+0000 7f37b7218700 1 -- start start 2023-10-18T22:11:42.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.992+0000 7f37b7218700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b00f6530 0x7f37b0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:42.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.992+0000 7f37b7218700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00f77d0 0x7f37b0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.992+0000 7f37b7218700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b0109a00 con 0x7f37b00f77d0 2023-10-18T22:11:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.992+0000 7f37b7218700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b0109b40 con 0x7f37b00f6530 2023-10-18T22:11:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.993+0000 7f37b5a15700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00f77d0 0x7f37b0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.993+0000 7f37b5a15700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00f77d0 0x7f37b0109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60578/0 (socket says 172.21.15.8:60578) 2023-10-18T22:11:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.993+0000 7f37b5a15700 1 -- 172.21.15.8:0/2169592610 learned_addr learned my addr 172.21.15.8:0/2169592610 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.993+0000 7f37b6216700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b00f6530 0x7f37b0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.993+0000 7f37b5a15700 1 -- 172.21.15.8:0/2169592610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b00f6530 msgr2=0x7f37b0108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.993+0000 7f37b5a15700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b00f6530 0x7f37b0108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.993+0000 7f37b5a15700 1 -- 172.21.15.8:0/2169592610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac005040 con 0x7f37b00f77d0 2023-10-18T22:11:43.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.993+0000 7f37b5a15700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00f77d0 0x7f37b0109450 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f37a000e7f0 tx=0x7f37a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:43.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.993+0000 7f37a6ffd700 1 -- 172.21.15.8:0/2169592610 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37a00092e0 con 0x7f37b00f77d0 2023-10-18T22:11:43.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.993+0000 7f37a6ffd700 1 -- 172.21.15.8:0/2169592610 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f37a000f040 con 0x7f37b00f77d0 2023-10-18T22:11:43.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.994+0000 7f37b7218700 1 -- 172.21.15.8:0/2169592610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b010a4e0 con 0x7f37b00f77d0 2023-10-18T22:11:43.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.994+0000 7f37a6ffd700 1 -- 172.21.15.8:0/2169592610 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37a00147e0 con 0x7f37b00f77d0 2023-10-18T22:11:43.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.994+0000 7f37b7218700 1 -- 172.21.15.8:0/2169592610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b010aa20 con 0x7f37b00f77d0 2023-10-18T22:11:43.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.995+0000 7f37b7218700 1 -- 172.21.15.8:0/2169592610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b0045ad0 con 0x7f37b00f77d0 2023-10-18T22:11:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.995+0000 7f37a6ffd700 1 -- 172.21.15.8:0/2169592610 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f37a001b030 con 0x7f37b00f77d0 2023-10-18T22:11:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.996+0000 7f37a6ffd700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f379c060f70 0x7f379c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.996+0000 7f37a6ffd700 1 -- 172.21.15.8:0/2169592610 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f37a007c7c0 con 0x7f37b00f77d0 2023-10-18T22:11:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.997+0000 7f37b6216700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f379c060f70 0x7f379c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:42.997+0000 7f37b6216700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f379c060f70 0x7f379c063430 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f37ac005010 tx=0x7f37ac016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.001+0000 7f37a6ffd700 1 -- 172.21.15.8:0/2169592610 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f37a004fe50 con 0x7f37b00f77d0 2023-10-18T22:11:43.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.198+0000 7f37b7218700 1 -- 172.21.15.8:0/2169592610 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37b010ac40 con 0x7f379c060f70 2023-10-18T22:11:43.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.199+0000 7f37a6ffd700 1 -- 172.21.15.8:0/2169592610 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f37b010ac40 con 0x7f379c060f70 2023-10-18T22:11:43.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 -- 172.21.15.8:0/2169592610 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f379c060f70 msgr2=0x7f379c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:43.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f379c060f70 0x7f379c063430 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f37ac005010 tx=0x7f37ac016040).stop 2023-10-18T22:11:43.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 -- 172.21.15.8:0/2169592610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00f77d0 msgr2=0x7f37b0109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:43.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00f77d0 0x7f37b0109450 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f37a000e7f0 tx=0x7f37a000b040).stop 2023-10-18T22:11:43.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 -- 172.21.15.8:0/2169592610 shutdown_connections 2023-10-18T22:11:43.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f379c060f70 0x7f379c063430 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b00f6530 0x7f37b0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 --2- 172.21.15.8:0/2169592610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00f77d0 0x7f37b0109450 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 -- 172.21.15.8:0/2169592610 >> 172.21.15.8:0/2169592610 conn(0x7f37b00f1c90 msgr2=0x7f37b006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:43.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 -- 172.21.15.8:0/2169592610 shutdown_connections 2023-10-18T22:11:43.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.201+0000 7f37b7218700 1 -- 172.21.15.8:0/2169592610 wait complete. 2023-10-18T22:11:43.218 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:11:43.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.340+0000 7fc3eca65700 1 -- 172.21.15.8:0/3583699856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3e80f77d0 msgr2=0x7fc3e80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:43.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.340+0000 7fc3eca65700 1 --2- 172.21.15.8:0/3583699856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3e80f77d0 0x7fc3e80f7c30 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7fc3dc004660 tx=0x7fc3dc009b30).stop 2023-10-18T22:11:43.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.340+0000 7fc3eca65700 1 -- 172.21.15.8:0/3583699856 shutdown_connections 2023-10-18T22:11:43.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.340+0000 7fc3eca65700 1 --2- 172.21.15.8:0/3583699856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3e80f77d0 0x7fc3e80f7c30 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.340+0000 7fc3eca65700 1 --2- 172.21.15.8:0/3583699856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e80f6530 0x7fc3e80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.340+0000 7fc3eca65700 1 -- 172.21.15.8:0/3583699856 >> 172.21.15.8:0/3583699856 conn(0x7fc3e80f1c90 msgr2=0x7fc3e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:43.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.340+0000 7fc3eca65700 1 -- 172.21.15.8:0/3583699856 shutdown_connections 2023-10-18T22:11:43.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.340+0000 7fc3eca65700 1 -- 172.21.15.8:0/3583699856 wait complete. 2023-10-18T22:11:43.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.341+0000 7fc3eca65700 1 Processor -- start 2023-10-18T22:11:43.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.341+0000 7fc3eca65700 1 -- start start 2023-10-18T22:11:43.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3eca65700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3e80f6530 0x7fc3e8108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:43.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3eca65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e80f77d0 0x7fc3e8109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:43.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3eca65700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e81099c0 con 0x7fc3e80f6530 2023-10-18T22:11:43.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3eca65700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8109b00 con 0x7fc3e80f77d0 2023-10-18T22:11:43.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3e77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3e80f6530 0x7fc3e8108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:43.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3e77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3e80f6530 0x7fc3e8108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60590/0 (socket says 172.21.15.8:60590) 2023-10-18T22:11:43.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3e77fe700 1 -- 172.21.15.8:0/1011964841 learned_addr learned my addr 172.21.15.8:0/1011964841 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:43.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3e6ffd700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e80f77d0 0x7fc3e8109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:43.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3e77fe700 1 -- 172.21.15.8:0/1011964841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e80f77d0 msgr2=0x7fc3e8109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:43.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3e77fe700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e80f77d0 0x7fc3e8109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.342+0000 7fc3e77fe700 1 -- 172.21.15.8:0/1011964841 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc005040 con 0x7fc3e80f6530 2023-10-18T22:11:43.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.343+0000 7fc3e77fe700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3e80f6530 0x7fc3e8108f20 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fc3d800e7c0 tx=0x7fc3d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:43.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.343+0000 7fc3cffff700 1 -- 172.21.15.8:0/1011964841 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3d80092e0 con 0x7fc3e80f6530 2023-10-18T22:11:43.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.343+0000 7fc3cffff700 1 -- 172.21.15.8:0/1011964841 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc3d800f040 con 0x7fc3e80f6530 2023-10-18T22:11:43.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.343+0000 7fc3cffff700 1 -- 172.21.15.8:0/1011964841 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3d80147e0 con 0x7fc3e80f6530 2023-10-18T22:11:43.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.343+0000 7fc3eca65700 1 -- 172.21.15.8:0/1011964841 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e810a4a0 con 0x7fc3e80f6530 2023-10-18T22:11:43.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.343+0000 7fc3eca65700 1 -- 172.21.15.8:0/1011964841 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e810a9e0 con 0x7fc3e80f6530 2023-10-18T22:11:43.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.344+0000 7fc3eca65700 1 -- 172.21.15.8:0/1011964841 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e8045ad0 con 0x7fc3e80f6530 2023-10-18T22:11:43.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.345+0000 7fc3cffff700 1 -- 172.21.15.8:0/1011964841 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc3d801b030 con 0x7fc3e80f6530 2023-10-18T22:11:43.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.346+0000 7fc3cffff700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc3d0060f70 0x7fc3d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:43.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.346+0000 7fc3cffff700 1 -- 172.21.15.8:0/1011964841 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc3d807ca70 con 0x7fc3e80f6530 2023-10-18T22:11:43.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.346+0000 7fc3e6ffd700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc3d0060f70 0x7fc3d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:43.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.347+0000 7fc3e6ffd700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc3d0060f70 0x7fc3d0063430 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fc3dc0043d0 tx=0x7fc3dc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:43.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.350+0000 7fc3cffff700 1 -- 172.21.15.8:0/1011964841 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc3d8050050 con 0x7fc3e80f6530 2023-10-18T22:11:43.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.552+0000 7fc3eca65700 1 -- 172.21.15.8:0/1011964841 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3e80fee30 con 0x7fc3d0060f70 2023-10-18T22:11:43.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.553+0000 7fc3cffff700 1 -- 172.21.15.8:0/1011964841 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc3e80fee30 con 0x7fc3d0060f70 2023-10-18T22:11:43.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.555+0000 7fc3eca65700 1 -- 172.21.15.8:0/1011964841 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc3d0060f70 msgr2=0x7fc3d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:43.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.555+0000 7fc3eca65700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc3d0060f70 0x7fc3d0063430 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fc3dc0043d0 tx=0x7fc3dc00b040).stop 2023-10-18T22:11:43.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.555+0000 7fc3eca65700 1 -- 172.21.15.8:0/1011964841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3e80f6530 msgr2=0x7fc3e8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:43.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.555+0000 7fc3eca65700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3e80f6530 0x7fc3e8108f20 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fc3d800e7c0 tx=0x7fc3d800b040).stop 2023-10-18T22:11:43.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.555+0000 7fc3eca65700 1 -- 172.21.15.8:0/1011964841 shutdown_connections 2023-10-18T22:11:43.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.555+0000 7fc3eca65700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc3d0060f70 0x7fc3d0063430 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.555+0000 7fc3eca65700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3e80f6530 0x7fc3e8108f20 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.555+0000 7fc3eca65700 1 --2- 172.21.15.8:0/1011964841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3e80f77d0 0x7fc3e8109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.555+0000 7fc3eca65700 1 -- 172.21.15.8:0/1011964841 >> 172.21.15.8:0/1011964841 conn(0x7fc3e80f1c90 msgr2=0x7fc3e806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:43.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.556+0000 7fc3eca65700 1 -- 172.21.15.8:0/1011964841 shutdown_connections 2023-10-18T22:11:43.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.556+0000 7fc3eca65700 1 -- 172.21.15.8:0/1011964841 wait complete. 2023-10-18T22:11:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:42.200281+0000 mgr.smithi008.flmjzp (mgr.14640) 4366 : cluster [DBG] pgmap v2998: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:43.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.693+0000 7fcfc3fff700 1 -- 172.21.15.8:0/2450127154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc4060310 msgr2=0x7fcfc40f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.693+0000 7fcfc3fff700 1 --2- 172.21.15.8:0/2450127154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc4060310 0x7fcfc40f9110 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fcfb4004660 tx=0x7fcfb4009b30).stop 2023-10-18T22:11:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.693+0000 7fcfc3fff700 1 -- 172.21.15.8:0/2450127154 shutdown_connections 2023-10-18T22:11:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.693+0000 7fcfc3fff700 1 --2- 172.21.15.8:0/2450127154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc40f9690 0x7fcfc40fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.693+0000 7fcfc3fff700 1 --2- 172.21.15.8:0/2450127154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc4060310 0x7fcfc40f9110 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.693+0000 7fcfc3fff700 1 -- 172.21.15.8:0/2450127154 >> 172.21.15.8:0/2450127154 conn(0x7fcfc40f0b90 msgr2=0x7fcfc40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:43.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.693+0000 7fcfc3fff700 1 -- 172.21.15.8:0/2450127154 shutdown_connections 2023-10-18T22:11:43.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.693+0000 7fcfc3fff700 1 -- 172.21.15.8:0/2450127154 wait complete. 2023-10-18T22:11:43.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.694+0000 7fcfc3fff700 1 Processor -- start 2023-10-18T22:11:43.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.694+0000 7fcfc3fff700 1 -- start start 2023-10-18T22:11:43.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.695+0000 7fcfc3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc4060310 0x7fcfc4106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:43.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.695+0000 7fcfc3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc40f9690 0x7fcfc41072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:43.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.695+0000 7fcfc3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc41078a0 con 0x7fcfc4060310 2023-10-18T22:11:43.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.695+0000 7fcfc3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc41080e0 con 0x7fcfc40f9690 2023-10-18T22:11:43.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.695+0000 7fcfc2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc4060310 0x7fcfc4106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:43.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.695+0000 7fcfc2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc4060310 0x7fcfc4106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60608/0 (socket says 172.21.15.8:60608) 2023-10-18T22:11:43.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.695+0000 7fcfc2ffd700 1 -- 172.21.15.8:0/130817343 learned_addr learned my addr 172.21.15.8:0/130817343 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:43.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.695+0000 7fcfc27fc700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc40f9690 0x7fcfc41072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:43.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.696+0000 7fcfc2ffd700 1 -- 172.21.15.8:0/130817343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc40f9690 msgr2=0x7fcfc41072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:43.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.696+0000 7fcfc2ffd700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc40f9690 0x7fcfc41072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.696+0000 7fcfc2ffd700 1 -- 172.21.15.8:0/130817343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4005040 con 0x7fcfc4060310 2023-10-18T22:11:43.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.696+0000 7fcfc2ffd700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc4060310 0x7fcfc4106db0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fcfb4009990 tx=0x7fcfb4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:43.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.696+0000 7fcfab7fe700 1 -- 172.21.15.8:0/130817343 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb4018070 con 0x7fcfc4060310 2023-10-18T22:11:43.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.696+0000 7fcfab7fe700 1 -- 172.21.15.8:0/130817343 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcfb4009630 con 0x7fcfc4060310 2023-10-18T22:11:43.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.696+0000 7fcfc3fff700 1 -- 172.21.15.8:0/130817343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc4108360 con 0x7fcfc4060310 2023-10-18T22:11:43.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.696+0000 7fcfab7fe700 1 -- 172.21.15.8:0/130817343 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb401c3c0 con 0x7fcfc4060310 2023-10-18T22:11:43.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.696+0000 7fcfc3fff700 1 -- 172.21.15.8:0/130817343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc4108840 con 0x7fcfc4060310 2023-10-18T22:11:43.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.697+0000 7fcfc3fff700 1 -- 172.21.15.8:0/130817343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc4059100 con 0x7fcfc4060310 2023-10-18T22:11:43.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.698+0000 7fcfab7fe700 1 -- 172.21.15.8:0/130817343 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcfb401d970 con 0x7fcfc4060310 2023-10-18T22:11:43.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.699+0000 7fcfab7fe700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcfac060f70 0x7fcfac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:43.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.700+0000 7fcfab7fe700 1 -- 172.21.15.8:0/130817343 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcfb407e640 con 0x7fcfc4060310 2023-10-18T22:11:43.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.700+0000 7fcfc27fc700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcfac060f70 0x7fcfac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:43.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.700+0000 7fcfc27fc700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcfac060f70 0x7fcfac063430 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fcfc4106b40 tx=0x7fcfb800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:43.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.704+0000 7fcfab7fe700 1 -- 172.21.15.8:0/130817343 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcfb404e1f0 con 0x7fcfc4060310 2023-10-18T22:11:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:42.200281+0000 mgr.smithi008.flmjzp (mgr.14640) 4366 : cluster [DBG] pgmap v2998: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:43.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.894+0000 7fcfc3fff700 1 -- 172.21.15.8:0/130817343 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfc40fedf0 con 0x7fcfac060f70 2023-10-18T22:11:43.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.904+0000 7fcfab7fe700 1 -- 172.21.15.8:0/130817343 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcfc40fedf0 con 0x7fcfac060f70 2023-10-18T22:11:43.907 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:11:43.907 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (78m) 5m ago 79m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:11:43.907 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (72m) 5m ago 79m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:11:43.907 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (72m) 3m ago 79m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:11:43.907 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (78m) 5m ago 79m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:11:43.908 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 75m - - 2023-10-18T22:11:43.908 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 75m - - 2023-10-18T22:11:43.908 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 75m - - 2023-10-18T22:11:43.908 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 75m - - 2023-10-18T22:11:43.908 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (73m) 5m ago 81m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:11:43.909 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (72m) 3m ago 78m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:11:43.909 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (72m) 5m ago 81m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:11:43.909 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (72m) 3m ago 78m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:11:43.909 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (79m) 5m ago 79m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:11:43.909 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (78m) 3m ago 78m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:11:43.910 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (71m) 5m ago 78m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:11:43.910 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (69m) 5m ago 78m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:11:43.910 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (69m) 5m ago 77m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:11:43.910 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (69m) 3m ago 77m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:11:43.910 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (68m) 3m ago 77m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:11:43.911 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (67m) 3m ago 77m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:11:43.911 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (73m) 5m ago 79m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:11:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 -- 172.21.15.8:0/130817343 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcfac060f70 msgr2=0x7fcfac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcfac060f70 0x7fcfac063430 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fcfc4106b40 tx=0x7fcfb800b040).stop 2023-10-18T22:11:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 -- 172.21.15.8:0/130817343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc4060310 msgr2=0x7fcfc4106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc4060310 0x7fcfc4106db0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fcfb4009990 tx=0x7fcfb4009b30).stop 2023-10-18T22:11:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 -- 172.21.15.8:0/130817343 shutdown_connections 2023-10-18T22:11:43.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcfac060f70 0x7fcfac063430 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc4060310 0x7fcfc4106db0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 --2- 172.21.15.8:0/130817343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc40f9690 0x7fcfc41072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:43.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 -- 172.21.15.8:0/130817343 >> 172.21.15.8:0/130817343 conn(0x7fcfc40f0b90 msgr2=0x7fcfc40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:43.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 -- 172.21.15.8:0/130817343 shutdown_connections 2023-10-18T22:11:43.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:43.906+0000 7fcfc3fff700 1 -- 172.21.15.8:0/130817343 wait complete. 2023-10-18T22:11:44.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.042+0000 7f614317d700 1 -- 172.21.15.8:0/3298569468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0f6530 msgr2=0x7f613c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.042+0000 7f614317d700 1 --2- 172.21.15.8:0/3298569468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0f6530 0x7f613c0f6950 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f6138004660 tx=0x7f6138009b30).stop 2023-10-18T22:11:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.042+0000 7f614317d700 1 -- 172.21.15.8:0/3298569468 shutdown_connections 2023-10-18T22:11:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.042+0000 7f614317d700 1 --2- 172.21.15.8:0/3298569468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f613c0f77d0 0x7f613c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.042+0000 7f614317d700 1 --2- 172.21.15.8:0/3298569468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0f6530 0x7f613c0f6950 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.042+0000 7f614317d700 1 -- 172.21.15.8:0/3298569468 >> 172.21.15.8:0/3298569468 conn(0x7f613c0f1c90 msgr2=0x7f613c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.042+0000 7f614317d700 1 -- 172.21.15.8:0/3298569468 shutdown_connections 2023-10-18T22:11:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.042+0000 7f614317d700 1 -- 172.21.15.8:0/3298569468 wait complete. 2023-10-18T22:11:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.043+0000 7f614317d700 1 Processor -- start 2023-10-18T22:11:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.043+0000 7f614317d700 1 -- start start 2023-10-18T22:11:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.043+0000 7f614317d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f613c0f6530 0x7f613c108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.043+0000 7f614317d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0f77d0 0x7f613c109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.044+0000 7f614317d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c109a00 con 0x7f613c0f77d0 2023-10-18T22:11:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.044+0000 7f614317d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c109b40 con 0x7f613c0f6530 2023-10-18T22:11:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.044+0000 7f614197a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0f77d0 0x7f613c109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.044+0000 7f614197a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0f77d0 0x7f613c109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60624/0 (socket says 172.21.15.8:60624) 2023-10-18T22:11:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.044+0000 7f614197a700 1 -- 172.21.15.8:0/3497001155 learned_addr learned my addr 172.21.15.8:0/3497001155 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:44.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.044+0000 7f614217b700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f613c0f6530 0x7f613c108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.044+0000 7f614197a700 1 -- 172.21.15.8:0/3497001155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f613c0f6530 msgr2=0x7f613c108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.044+0000 7f614197a700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f613c0f6530 0x7f613c108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.044+0000 7f614197a700 1 -- 172.21.15.8:0/3497001155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138005040 con 0x7f613c0f77d0 2023-10-18T22:11:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.044+0000 7f614197a700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0f77d0 0x7f613c109450 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7f612c002700 tx=0x7f612c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:44.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.045+0000 7f6132ffd700 1 -- 172.21.15.8:0/3497001155 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f612c009320 con 0x7f613c0f77d0 2023-10-18T22:11:44.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.045+0000 7f614317d700 1 -- 172.21.15.8:0/3497001155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c10a4e0 con 0x7f613c0f77d0 2023-10-18T22:11:44.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.045+0000 7f6132ffd700 1 -- 172.21.15.8:0/3497001155 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f612c00f040 con 0x7f613c0f77d0 2023-10-18T22:11:44.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.045+0000 7f6132ffd700 1 -- 172.21.15.8:0/3497001155 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f612c014690 con 0x7f613c0f77d0 2023-10-18T22:11:44.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.045+0000 7f614317d700 1 -- 172.21.15.8:0/3497001155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c10aaa0 con 0x7f613c0f77d0 2023-10-18T22:11:44.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.046+0000 7f614317d700 1 -- 172.21.15.8:0/3497001155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c045ad0 con 0x7f613c0f77d0 2023-10-18T22:11:44.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.047+0000 7f6132ffd700 1 -- 172.21.15.8:0/3497001155 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f612c009480 con 0x7f613c0f77d0 2023-10-18T22:11:44.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.047+0000 7f6132ffd700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6128060f70 0x7f6128063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:44.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.048+0000 7f6132ffd700 1 -- 172.21.15.8:0/3497001155 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f612c07ca60 con 0x7f613c0f77d0 2023-10-18T22:11:44.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.048+0000 7f614217b700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6128060f70 0x7f6128063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:44.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.048+0000 7f614217b700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6128060f70 0x7f6128063430 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f6138004630 tx=0x7f6138009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:44.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.052+0000 7f6132ffd700 1 -- 172.21.15.8:0/3497001155 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f612c050040 con 0x7f613c0f77d0 2023-10-18T22:11:44.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.308+0000 7f614317d700 1 -- 172.21.15.8:0/3497001155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f613c027a00 con 0x7f613c0f77d0 2023-10-18T22:11:44.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.308+0000 7f6132ffd700 1 -- 172.21.15.8:0/3497001155 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f612c04fc30 con 0x7f613c0f77d0 2023-10-18T22:11:44.311 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:11:44.311 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:11:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:11:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:11:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:11:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:11:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:11:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:11:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:11:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:11:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:11:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:11:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:11:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:11:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:11:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:11:44.314 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:11:44.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.310+0000 7f614317d700 1 -- 172.21.15.8:0/3497001155 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6128060f70 msgr2=0x7f6128063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:44.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.310+0000 7f614317d700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6128060f70 0x7f6128063430 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f6138004630 tx=0x7f6138009b30).stop 2023-10-18T22:11:44.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.310+0000 7f614317d700 1 -- 172.21.15.8:0/3497001155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0f77d0 msgr2=0x7f613c109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:44.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.310+0000 7f614317d700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0f77d0 0x7f613c109450 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7f612c002700 tx=0x7f612c009e00).stop 2023-10-18T22:11:44.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.311+0000 7f614317d700 1 -- 172.21.15.8:0/3497001155 shutdown_connections 2023-10-18T22:11:44.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.311+0000 7f614317d700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6128060f70 0x7f6128063430 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.311+0000 7f614317d700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f613c0f6530 0x7f613c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.311+0000 7f614317d700 1 --2- 172.21.15.8:0/3497001155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f613c0f77d0 0x7f613c109450 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.311+0000 7f614317d700 1 -- 172.21.15.8:0/3497001155 >> 172.21.15.8:0/3497001155 conn(0x7f613c0f1c90 msgr2=0x7f613c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:44.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.311+0000 7f614317d700 1 -- 172.21.15.8:0/3497001155 shutdown_connections 2023-10-18T22:11:44.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.311+0000 7f614317d700 1 -- 172.21.15.8:0/3497001155 wait complete. 2023-10-18T22:11:44.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.447+0000 7f38f9571700 1 -- 172.21.15.8:0/2672314443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40f77d0 msgr2=0x7f38f40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:44.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.447+0000 7f38f9571700 1 --2- 172.21.15.8:0/2672314443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40f77d0 0x7f38f40f7c30 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7f38e8004660 tx=0x7f38e8009b30).stop 2023-10-18T22:11:44.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.447+0000 7f38f9571700 1 -- 172.21.15.8:0/2672314443 shutdown_connections 2023-10-18T22:11:44.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.447+0000 7f38f9571700 1 --2- 172.21.15.8:0/2672314443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40f77d0 0x7f38f40f7c30 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.447+0000 7f38f9571700 1 --2- 172.21.15.8:0/2672314443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f40f6530 0x7f38f40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.447+0000 7f38f9571700 1 -- 172.21.15.8:0/2672314443 >> 172.21.15.8:0/2672314443 conn(0x7f38f40f1c90 msgr2=0x7f38f40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:44.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.448+0000 7f38f9571700 1 -- 172.21.15.8:0/2672314443 shutdown_connections 2023-10-18T22:11:44.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.448+0000 7f38f9571700 1 -- 172.21.15.8:0/2672314443 wait complete. 2023-10-18T22:11:44.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.448+0000 7f38f9571700 1 Processor -- start 2023-10-18T22:11:44.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.449+0000 7f38f9571700 1 -- start start 2023-10-18T22:11:44.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.449+0000 7f38f9571700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f40f6530 0x7f38f4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:44.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.449+0000 7f38f9571700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40f77d0 0x7f38f4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:44.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.449+0000 7f38f9571700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f4107880 con 0x7f38f40f77d0 2023-10-18T22:11:44.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.449+0000 7f38f9571700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f41080c0 con 0x7f38f40f6530 2023-10-18T22:11:44.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.449+0000 7f38f37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40f77d0 0x7f38f4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:44.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.449+0000 7f38f37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40f77d0 0x7f38f4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60650/0 (socket says 172.21.15.8:60650) 2023-10-18T22:11:44.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.449+0000 7f38f37fe700 1 -- 172.21.15.8:0/806113667 learned_addr learned my addr 172.21.15.8:0/806113667 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:44.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.449+0000 7f38f3fff700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f40f6530 0x7f38f4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:44.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.450+0000 7f38f37fe700 1 -- 172.21.15.8:0/806113667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f40f6530 msgr2=0x7f38f4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:44.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.450+0000 7f38f37fe700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f40f6530 0x7f38f4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.450+0000 7f38f37fe700 1 -- 172.21.15.8:0/806113667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e8005040 con 0x7f38f40f77d0 2023-10-18T22:11:44.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.450+0000 7f38f37fe700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40f77d0 0x7f38f4107280 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f38e8009f50 tx=0x7f38e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:44.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.450+0000 7f38f0ff9700 1 -- 172.21.15.8:0/806113667 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38e8018070 con 0x7f38f40f77d0 2023-10-18T22:11:44.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.450+0000 7f38f0ff9700 1 -- 172.21.15.8:0/806113667 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f38e8009630 con 0x7f38f40f77d0 2023-10-18T22:11:44.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.450+0000 7f38f9571700 1 -- 172.21.15.8:0/806113667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f4108340 con 0x7f38f40f77d0 2023-10-18T22:11:44.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.450+0000 7f38f0ff9700 1 -- 172.21.15.8:0/806113667 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38e801c3c0 con 0x7f38f40f77d0 2023-10-18T22:11:44.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.450+0000 7f38f9571700 1 -- 172.21.15.8:0/806113667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f4108820 con 0x7f38f40f77d0 2023-10-18T22:11:44.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.451+0000 7f38f9571700 1 -- 172.21.15.8:0/806113667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f4059100 con 0x7f38f40f77d0 2023-10-18T22:11:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.452+0000 7f38f0ff9700 1 -- 172.21.15.8:0/806113667 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f38e801d420 con 0x7f38f40f77d0 2023-10-18T22:11:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.453+0000 7f38f0ff9700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38dc060f70 0x7f38dc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.453+0000 7f38f0ff9700 1 -- 172.21.15.8:0/806113667 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f38e807e600 con 0x7f38f40f77d0 2023-10-18T22:11:44.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.453+0000 7f38f3fff700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38dc060f70 0x7f38dc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:44.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.454+0000 7f38f3fff700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38dc060f70 0x7f38dc063430 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f38f4107b50 tx=0x7f38e4009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:44.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.457+0000 7f38f0ff9700 1 -- 172.21.15.8:0/806113667 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f38e804e310 con 0x7f38f40f77d0 2023-10-18T22:11:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:43.200428+0000 mgr.smithi008.flmjzp (mgr.14640) 4367 : audit [DBG] from='client.37528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.229888+0000 mon.smithi008 (mon.0) 4667 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.231428+0000 mon.smithi008 (mon.0) 4668 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.232162+0000 mon.smithi008 (mon.0) 4669 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.237602+0000 mon.smithi008 (mon.0) 4670 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.242631+0000 mon.smithi008 (mon.0) 4671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.245051+0000 mon.smithi008 (mon.0) 4672 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.246356+0000 mon.smithi008 (mon.0) 4673 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.247608+0000 mon.smithi008 (mon.0) 4674 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.249152+0000 mon.smithi008 (mon.0) 4675 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:44.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.685+0000 7f38f9571700 1 -- 172.21.15.8:0/806113667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f38f4027a00 con 0x7f38f40f77d0 2023-10-18T22:11:44.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.685+0000 7f38f0ff9700 1 -- 172.21.15.8:0/806113667 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f38e8051930 con 0x7f38f40f77d0 2023-10-18T22:11:44.688 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:11:44.688 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:11:44.688 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:11:44.688 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:11:44.689 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:11:44.689 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:11:44.689 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:11:44.689 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:11:44.690 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:11:44.690 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:11:44.690 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:11:44.690 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:11:44.691 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:11:44.691 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:11:44.691 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:11:44.691 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:11:44.691 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:11:44.692 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:11:44.692 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:11:44.692 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:11:44.692 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:11:44.692 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:11:44.692 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:11:44.693 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:11:44.693 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:11:44.693 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:11:44.693 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:11:44.693 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:11:44.694 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:11:44.694 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:11:44.694 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:11:44.694 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:11:44.694 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:11:44.695 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:11:44.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.687+0000 7f38f9571700 1 -- 172.21.15.8:0/806113667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38dc060f70 msgr2=0x7f38dc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:44.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.687+0000 7f38f9571700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38dc060f70 0x7f38dc063430 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f38f4107b50 tx=0x7f38e4009c00).stop 2023-10-18T22:11:44.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.687+0000 7f38f9571700 1 -- 172.21.15.8:0/806113667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40f77d0 msgr2=0x7f38f4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:44.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.687+0000 7f38f9571700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40f77d0 0x7f38f4107280 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f38e8009f50 tx=0x7f38e8009b30).stop 2023-10-18T22:11:44.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.688+0000 7f38f9571700 1 -- 172.21.15.8:0/806113667 shutdown_connections 2023-10-18T22:11:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.688+0000 7f38f9571700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38dc060f70 0x7f38dc063430 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.688+0000 7f38f9571700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38f40f6530 0x7f38f4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.688+0000 7f38f9571700 1 --2- 172.21.15.8:0/806113667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40f77d0 0x7f38f4107280 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.688+0000 7f38f9571700 1 -- 172.21.15.8:0/806113667 >> 172.21.15.8:0/806113667 conn(0x7f38f40f1c90 msgr2=0x7f38f40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.688+0000 7f38f9571700 1 -- 172.21.15.8:0/806113667 shutdown_connections 2023-10-18T22:11:44.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.688+0000 7f38f9571700 1 -- 172.21.15.8:0/806113667 wait complete. 2023-10-18T22:11:44.698 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:11:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:43.200428+0000 mgr.smithi008.flmjzp (mgr.14640) 4367 : audit [DBG] from='client.37528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.229888+0000 mon.smithi008 (mon.0) 4667 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.231428+0000 mon.smithi008 (mon.0) 4668 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.232162+0000 mon.smithi008 (mon.0) 4669 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.237602+0000 mon.smithi008 (mon.0) 4670 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.242631+0000 mon.smithi008 (mon.0) 4671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.245051+0000 mon.smithi008 (mon.0) 4672 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.246356+0000 mon.smithi008 (mon.0) 4673 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.247608+0000 mon.smithi008 (mon.0) 4674 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:44.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.249152+0000 mon.smithi008 (mon.0) 4675 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:44.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.827+0000 7f3c6f59e700 1 -- 172.21.15.8:0/107259818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c700f77d0 msgr2=0x7f3c700f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:44.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.827+0000 7f3c6f59e700 1 --2- 172.21.15.8:0/107259818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c700f77d0 0x7f3c700f7c30 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f3c64004660 tx=0x7f3c64009b30).stop 2023-10-18T22:11:44.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.828+0000 7f3c6f59e700 1 -- 172.21.15.8:0/107259818 shutdown_connections 2023-10-18T22:11:44.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.828+0000 7f3c6f59e700 1 --2- 172.21.15.8:0/107259818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c700f77d0 0x7f3c700f7c30 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.828+0000 7f3c6f59e700 1 --2- 172.21.15.8:0/107259818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c700f6530 0x7f3c700f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.828+0000 7f3c6f59e700 1 -- 172.21.15.8:0/107259818 >> 172.21.15.8:0/107259818 conn(0x7f3c700f1c90 msgr2=0x7f3c700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:44.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.828+0000 7f3c6f59e700 1 -- 172.21.15.8:0/107259818 shutdown_connections 2023-10-18T22:11:44.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.828+0000 7f3c6f59e700 1 -- 172.21.15.8:0/107259818 wait complete. 2023-10-18T22:11:44.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.828+0000 7f3c6f59e700 1 Processor -- start 2023-10-18T22:11:44.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.829+0000 7f3c6f59e700 1 -- start start 2023-10-18T22:11:44.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.829+0000 7f3c6f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c700f6530 0x7f3c70108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:44.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.829+0000 7f3c6f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c700f77d0 0x7f3c70109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:44.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.829+0000 7f3c6f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c701099c0 con 0x7f3c700f6530 2023-10-18T22:11:44.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.829+0000 7f3c6f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c70109b00 con 0x7f3c700f77d0 2023-10-18T22:11:44.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.829+0000 7f3c6e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c700f6530 0x7f3c70108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:44.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.829+0000 7f3c6e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c700f6530 0x7f3c70108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60670/0 (socket says 172.21.15.8:60670) 2023-10-18T22:11:44.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.829+0000 7f3c6e59c700 1 -- 172.21.15.8:0/1107245654 learned_addr learned my addr 172.21.15.8:0/1107245654 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:11:44.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.829+0000 7f3c6dd9b700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c700f77d0 0x7f3c70109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:44.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.830+0000 7f3c6e59c700 1 -- 172.21.15.8:0/1107245654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c700f77d0 msgr2=0x7f3c70109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:44.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.830+0000 7f3c6e59c700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c700f77d0 0x7f3c70109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:44.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.830+0000 7f3c6e59c700 1 -- 172.21.15.8:0/1107245654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c64005040 con 0x7f3c700f6530 2023-10-18T22:11:44.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.830+0000 7f3c6e59c700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c700f6530 0x7f3c70108f20 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f3c6000e7c0 tx=0x7f3c6000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:44.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.830+0000 7f3c5effd700 1 -- 172.21.15.8:0/1107245654 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c600092e0 con 0x7f3c700f6530 2023-10-18T22:11:44.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.830+0000 7f3c5effd700 1 -- 172.21.15.8:0/1107245654 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3c6000f040 con 0x7f3c700f6530 2023-10-18T22:11:44.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.830+0000 7f3c5effd700 1 -- 172.21.15.8:0/1107245654 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c60014810 con 0x7f3c700f6530 2023-10-18T22:11:44.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.830+0000 7f3c6f59e700 1 -- 172.21.15.8:0/1107245654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7010a4a0 con 0x7f3c700f6530 2023-10-18T22:11:44.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.830+0000 7f3c6f59e700 1 -- 172.21.15.8:0/1107245654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7010a9e0 con 0x7f3c700f6530 2023-10-18T22:11:44.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.831+0000 7f3c6f59e700 1 -- 172.21.15.8:0/1107245654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c70045ad0 con 0x7f3c700f6530 2023-10-18T22:11:44.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.832+0000 7f3c5effd700 1 -- 172.21.15.8:0/1107245654 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3c6001b030 con 0x7f3c700f6530 2023-10-18T22:11:44.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.833+0000 7f3c5effd700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c58060f70 0x7f3c58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:11:44.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.833+0000 7f3c5effd700 1 -- 172.21.15.8:0/1107245654 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3c6007c880 con 0x7f3c700f6530 2023-10-18T22:11:44.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.833+0000 7f3c6dd9b700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c58060f70 0x7f3c58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:11:44.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.834+0000 7f3c6dd9b700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c58060f70 0x7f3c58063430 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f3c64005010 tx=0x7f3c64016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:11:44.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:44.837+0000 7f3c5effd700 1 -- 172.21.15.8:0/1107245654 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3c6004fe60 con 0x7f3c700f6530 2023-10-18T22:11:45.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.037+0000 7f3c6f59e700 1 -- 172.21.15.8:0/1107245654 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c7010acb0 con 0x7f3c58060f70 2023-10-18T22:11:45.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.038+0000 7f3c5effd700 1 -- 172.21.15.8:0/1107245654 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3c7010acb0 con 0x7f3c58060f70 2023-10-18T22:11:45.040 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:11:45.040 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:11:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:11:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:11:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:11:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:11:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:11:45.042 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:11:45.042 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:11:45.042 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:11:45.042 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:11:45.042 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:11:45.043 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:11:45.043 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:11:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 -- 172.21.15.8:0/1107245654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c58060f70 msgr2=0x7f3c58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c58060f70 0x7f3c58063430 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f3c64005010 tx=0x7f3c64016040).stop 2023-10-18T22:11:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 -- 172.21.15.8:0/1107245654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c700f6530 msgr2=0x7f3c70108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:11:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c700f6530 0x7f3c70108f20 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f3c6000e7c0 tx=0x7f3c6000b040).stop 2023-10-18T22:11:45.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 -- 172.21.15.8:0/1107245654 shutdown_connections 2023-10-18T22:11:45.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3c58060f70 0x7f3c58063430 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:45.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c700f6530 0x7f3c70108f20 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:45.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 --2- 172.21.15.8:0/1107245654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c700f77d0 0x7f3c70109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:11:45.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 -- 172.21.15.8:0/1107245654 >> 172.21.15.8:0/1107245654 conn(0x7f3c700f1c90 msgr2=0x7f3c7006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:11:45.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 -- 172.21.15.8:0/1107245654 shutdown_connections 2023-10-18T22:11:45.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:11:45.040+0000 7f3c6f59e700 1 -- 172.21.15.8:0/1107245654 wait complete. 2023-10-18T22:11:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:43.554754+0000 mgr.smithi008.flmjzp (mgr.14640) 4368 : audit [DBG] from='client.37532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:43.897122+0000 mgr.smithi008.flmjzp (mgr.14640) 4369 : audit [DBG] from='client.37536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:44.200774+0000 mgr.smithi008.flmjzp (mgr.14640) 4370 : cluster [DBG] pgmap v2999: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:44.232881+0000 mgr.smithi008.flmjzp (mgr.14640) 4371 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:44.233332+0000 mgr.smithi008.flmjzp (mgr.14640) 4372 : cluster [DBG] pgmap v3000: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:45.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:44.233529+0000 mgr.smithi008.flmjzp (mgr.14640) 4373 : cluster [DBG] pgmap v3001: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:45.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:44.250714+0000 mgr.smithi008.flmjzp (mgr.14640) 4374 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:45.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.310069+0000 mon.smithi008 (mon.0) 4676 : audit [DBG] from='client.? 172.21.15.8:0/3497001155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:45.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:44.687029+0000 mon.smithi008 (mon.0) 4677 : audit [DBG] from='client.? 172.21.15.8:0/806113667' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:11:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:43.554754+0000 mgr.smithi008.flmjzp (mgr.14640) 4368 : audit [DBG] from='client.37532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:43.897122+0000 mgr.smithi008.flmjzp (mgr.14640) 4369 : audit [DBG] from='client.37536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:44.200774+0000 mgr.smithi008.flmjzp (mgr.14640) 4370 : cluster [DBG] pgmap v2999: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:44.232881+0000 mgr.smithi008.flmjzp (mgr.14640) 4371 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:44.233332+0000 mgr.smithi008.flmjzp (mgr.14640) 4372 : cluster [DBG] pgmap v3000: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:44.233529+0000 mgr.smithi008.flmjzp (mgr.14640) 4373 : cluster [DBG] pgmap v3001: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:44.250714+0000 mgr.smithi008.flmjzp (mgr.14640) 4374 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:45.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.310069+0000 mon.smithi008 (mon.0) 4676 : audit [DBG] from='client.? 172.21.15.8:0/3497001155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:45.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:44.687029+0000 mon.smithi008 (mon.0) 4677 : audit [DBG] from='client.? 172.21.15.8:0/806113667' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:11:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:45.039240+0000 mgr.smithi008.flmjzp (mgr.14640) 4375 : audit [DBG] from='client.37548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:45.039240+0000 mgr.smithi008.flmjzp (mgr.14640) 4375 : audit [DBG] from='client.37548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:11:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:46.234052+0000 mgr.smithi008.flmjzp (mgr.14640) 4376 : cluster [DBG] pgmap v3002: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:47.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:46.234052+0000 mgr.smithi008.flmjzp (mgr.14640) 4376 : cluster [DBG] pgmap v3002: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:48.234522+0000 mgr.smithi008.flmjzp (mgr.14640) 4377 : cluster [DBG] pgmap v3003: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:48.234522+0000 mgr.smithi008.flmjzp (mgr.14640) 4377 : cluster [DBG] pgmap v3003: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:50.235134+0000 mgr.smithi008.flmjzp (mgr.14640) 4378 : cluster [DBG] pgmap v3004: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:50.235134+0000 mgr.smithi008.flmjzp (mgr.14640) 4378 : cluster [DBG] pgmap v3004: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:53.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:52.235748+0000 mgr.smithi008.flmjzp (mgr.14640) 4379 : cluster [DBG] pgmap v3005: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:52.235748+0000 mgr.smithi008.flmjzp (mgr.14640) 4379 : cluster [DBG] pgmap v3005: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:54.259396+0000 mon.smithi008 (mon.0) 4678 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:54.259396+0000 mon.smithi008 (mon.0) 4678 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:54.236497+0000 mgr.smithi008.flmjzp (mgr.14640) 4380 : cluster [DBG] pgmap v3006: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:54.819931+0000 mon.smithi008 (mon.0) 4679 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:54.820741+0000 mon.smithi008 (mon.0) 4680 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:54.826181+0000 mon.smithi008 (mon.0) 4681 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:54.831202+0000 mon.smithi008 (mon.0) 4682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:54.834754+0000 mon.smithi008 (mon.0) 4683 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:54.836142+0000 mon.smithi008 (mon.0) 4684 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:54.837352+0000 mon.smithi008 (mon.0) 4685 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:11:54.838967+0000 mon.smithi008 (mon.0) 4686 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:54.236497+0000 mgr.smithi008.flmjzp (mgr.14640) 4380 : cluster [DBG] pgmap v3006: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:54.819931+0000 mon.smithi008 (mon.0) 4679 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:11:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:54.820741+0000 mon.smithi008 (mon.0) 4680 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:11:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:54.826181+0000 mon.smithi008 (mon.0) 4681 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:11:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:54.831202+0000 mon.smithi008 (mon.0) 4682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:11:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:54.834754+0000 mon.smithi008 (mon.0) 4683 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:54.836142+0000 mon.smithi008 (mon.0) 4684 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:55.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:54.837352+0000 mon.smithi008 (mon.0) 4685 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:55.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:11:54.838967+0000 mon.smithi008 (mon.0) 4686 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:11:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:54.821361+0000 mgr.smithi008.flmjzp (mgr.14640) 4381 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:54.821931+0000 mgr.smithi008.flmjzp (mgr.14640) 4382 : cluster [DBG] pgmap v3007: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:54.822199+0000 mgr.smithi008.flmjzp (mgr.14640) 4383 : cluster [DBG] pgmap v3008: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:11:54.840633+0000 mgr.smithi008.flmjzp (mgr.14640) 4384 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:54.821361+0000 mgr.smithi008.flmjzp (mgr.14640) 4381 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:11:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:54.821931+0000 mgr.smithi008.flmjzp (mgr.14640) 4382 : cluster [DBG] pgmap v3007: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:54.822199+0000 mgr.smithi008.flmjzp (mgr.14640) 4383 : cluster [DBG] pgmap v3008: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:11:54.840633+0000 mgr.smithi008.flmjzp (mgr.14640) 4384 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:11:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:11:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:56.822881+0000 mgr.smithi008.flmjzp (mgr.14640) 4385 : cluster [DBG] pgmap v3009: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:11:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:11:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:56.822881+0000 mgr.smithi008.flmjzp (mgr.14640) 4385 : cluster [DBG] pgmap v3009: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:11:58.823575+0000 mgr.smithi008.flmjzp (mgr.14640) 4386 : cluster [DBG] pgmap v3010: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:11:58.823575+0000 mgr.smithi008.flmjzp (mgr.14640) 4386 : cluster [DBG] pgmap v3010: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:00.824132+0000 mgr.smithi008.flmjzp (mgr.14640) 4387 : cluster [DBG] pgmap v3011: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:00.824132+0000 mgr.smithi008.flmjzp (mgr.14640) 4387 : cluster [DBG] pgmap v3011: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:02.824669+0000 mgr.smithi008.flmjzp (mgr.14640) 4388 : cluster [DBG] pgmap v3012: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:02.824669+0000 mgr.smithi008.flmjzp (mgr.14640) 4388 : cluster [DBG] pgmap v3012: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:04.842205+0000 mon.smithi008 (mon.0) 4687 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:04.844395+0000 mon.smithi008 (mon.0) 4688 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:04.845442+0000 mon.smithi008 (mon.0) 4689 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:04.852109+0000 mon.smithi008 (mon.0) 4690 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:04.858533+0000 mon.smithi008 (mon.0) 4691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:04.861793+0000 mon.smithi008 (mon.0) 4692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:05.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:04.863442+0000 mon.smithi008 (mon.0) 4693 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:05.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:04.865131+0000 mon.smithi008 (mon.0) 4694 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:05.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:04.867109+0000 mon.smithi008 (mon.0) 4695 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:04.842205+0000 mon.smithi008 (mon.0) 4687 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:04.844395+0000 mon.smithi008 (mon.0) 4688 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:04.845442+0000 mon.smithi008 (mon.0) 4689 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:04.852109+0000 mon.smithi008 (mon.0) 4690 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:04.858533+0000 mon.smithi008 (mon.0) 4691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:04.861793+0000 mon.smithi008 (mon.0) 4692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:05.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:04.863442+0000 mon.smithi008 (mon.0) 4693 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:05.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:04.865131+0000 mon.smithi008 (mon.0) 4694 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:05.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:04.867109+0000 mon.smithi008 (mon.0) 4695 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:04.825238+0000 mgr.smithi008.flmjzp (mgr.14640) 4389 : cluster [DBG] pgmap v3013: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:04.846334+0000 mgr.smithi008.flmjzp (mgr.14640) 4390 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:04.846878+0000 mgr.smithi008.flmjzp (mgr.14640) 4391 : cluster [DBG] pgmap v3014: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:04.847150+0000 mgr.smithi008.flmjzp (mgr.14640) 4392 : cluster [DBG] pgmap v3015: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:04.869181+0000 mgr.smithi008.flmjzp (mgr.14640) 4393 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:04.825238+0000 mgr.smithi008.flmjzp (mgr.14640) 4389 : cluster [DBG] pgmap v3013: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:04.846334+0000 mgr.smithi008.flmjzp (mgr.14640) 4390 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:04.846878+0000 mgr.smithi008.flmjzp (mgr.14640) 4391 : cluster [DBG] pgmap v3014: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:04.847150+0000 mgr.smithi008.flmjzp (mgr.14640) 4392 : cluster [DBG] pgmap v3015: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:06.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:04.869181+0000 mgr.smithi008.flmjzp (mgr.14640) 4393 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:06.847811+0000 mgr.smithi008.flmjzp (mgr.14640) 4394 : cluster [DBG] pgmap v3016: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:06.847811+0000 mgr.smithi008.flmjzp (mgr.14640) 4394 : cluster [DBG] pgmap v3016: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:08.848316+0000 mgr.smithi008.flmjzp (mgr.14640) 4395 : cluster [DBG] pgmap v3017: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:08.848316+0000 mgr.smithi008.flmjzp (mgr.14640) 4395 : cluster [DBG] pgmap v3017: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:10.848994+0000 mgr.smithi008.flmjzp (mgr.14640) 4396 : cluster [DBG] pgmap v3018: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:10.848994+0000 mgr.smithi008.flmjzp (mgr.14640) 4396 : cluster [DBG] pgmap v3018: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:12.849640+0000 mgr.smithi008.flmjzp (mgr.14640) 4397 : cluster [DBG] pgmap v3019: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:12.849640+0000 mgr.smithi008.flmjzp (mgr.14640) 4397 : cluster [DBG] pgmap v3019: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:15.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.196+0000 7f3fd48a3700 1 -- 172.21.15.8:0/1375205289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fd00f6530 msgr2=0x7f3fd00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:15.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.196+0000 7f3fd48a3700 1 --2- 172.21.15.8:0/1375205289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fd00f6530 0x7f3fd00f6950 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f3fc0004660 tx=0x7f3fc0009b30).stop 2023-10-18T22:12:15.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.196+0000 7f3fd48a3700 1 -- 172.21.15.8:0/1375205289 shutdown_connections 2023-10-18T22:12:15.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.196+0000 7f3fd48a3700 1 --2- 172.21.15.8:0/1375205289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fd00f77d0 0x7f3fd00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.196+0000 7f3fd48a3700 1 --2- 172.21.15.8:0/1375205289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fd00f6530 0x7f3fd00f6950 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.196+0000 7f3fd48a3700 1 -- 172.21.15.8:0/1375205289 >> 172.21.15.8:0/1375205289 conn(0x7f3fd00f1c90 msgr2=0x7f3fd00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:15.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.196+0000 7f3fd48a3700 1 -- 172.21.15.8:0/1375205289 shutdown_connections 2023-10-18T22:12:15.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.196+0000 7f3fd48a3700 1 -- 172.21.15.8:0/1375205289 wait complete. 2023-10-18T22:12:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.197+0000 7f3fd48a3700 1 Processor -- start 2023-10-18T22:12:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.197+0000 7f3fd48a3700 1 -- start start 2023-10-18T22:12:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.197+0000 7f3fd48a3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fd00f6530 0x7f3fd0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.197+0000 7f3fd48a3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fd00f77d0 0x7f3fd0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.197+0000 7f3fd48a3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0109a00 con 0x7f3fd00f6530 2023-10-18T22:12:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.197+0000 7f3fd48a3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0109b40 con 0x7f3fd00f77d0 2023-10-18T22:12:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.198+0000 7f3fced9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fd00f6530 0x7f3fd0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.198+0000 7f3fced9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fd00f6530 0x7f3fd0108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55110/0 (socket says 172.21.15.8:55110) 2023-10-18T22:12:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.198+0000 7f3fced9d700 1 -- 172.21.15.8:0/3605004178 learned_addr learned my addr 172.21.15.8:0/3605004178 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.198+0000 7f3fce59c700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fd00f77d0 0x7f3fd0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.198+0000 7f3fced9d700 1 -- 172.21.15.8:0/3605004178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fd00f77d0 msgr2=0x7f3fd0109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.198+0000 7f3fced9d700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fd00f77d0 0x7f3fd0109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.198+0000 7f3fced9d700 1 -- 172.21.15.8:0/3605004178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc0005040 con 0x7f3fd00f6530 2023-10-18T22:12:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.198+0000 7f3fced9d700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fd00f6530 0x7f3fd0108f60 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f3fc0014040 tx=0x7f3fc000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.198+0000 7f3fb77fe700 1 -- 172.21.15.8:0/3605004178 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fc0019070 con 0x7f3fd00f6530 2023-10-18T22:12:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.199+0000 7f3fb77fe700 1 -- 172.21.15.8:0/3605004178 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3fc001e420 con 0x7f3fd00f6530 2023-10-18T22:12:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.199+0000 7f3fd48a3700 1 -- 172.21.15.8:0/3605004178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd010a480 con 0x7f3fd00f6530 2023-10-18T22:12:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.199+0000 7f3fb77fe700 1 -- 172.21.15.8:0/3605004178 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fc0014620 con 0x7f3fd00f6530 2023-10-18T22:12:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.199+0000 7f3fd48a3700 1 -- 172.21.15.8:0/3605004178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd010a960 con 0x7f3fd00f6530 2023-10-18T22:12:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.200+0000 7f3fd48a3700 1 -- 172.21.15.8:0/3605004178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd0045ad0 con 0x7f3fd00f6530 2023-10-18T22:12:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.201+0000 7f3fb77fe700 1 -- 172.21.15.8:0/3605004178 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3fc001e9e0 con 0x7f3fd00f6530 2023-10-18T22:12:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.202+0000 7f3fb77fe700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fb8060f70 0x7f3fb8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.202+0000 7f3fb77fe700 1 -- 172.21.15.8:0/3605004178 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3fc007dcc0 con 0x7f3fd00f6530 2023-10-18T22:12:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.202+0000 7f3fce59c700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fb8060f70 0x7f3fb8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.203+0000 7f3fce59c700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fb8060f70 0x7f3fb8063430 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f3fc4009fd0 tx=0x7f3fc400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.207+0000 7f3fb77fe700 1 -- 172.21.15.8:0/3605004178 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3fc0083020 con 0x7f3fd00f6530 2023-10-18T22:12:15.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.408+0000 7f3fd48a3700 1 -- 172.21.15.8:0/3605004178 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fd00fee70 con 0x7f3fb8060f70 2023-10-18T22:12:15.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.409+0000 7f3fb77fe700 1 -- 172.21.15.8:0/3605004178 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3fc400f040 con 0x7f3fb8060f70 2023-10-18T22:12:15.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 -- 172.21.15.8:0/3605004178 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fb8060f70 msgr2=0x7f3fb8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:15.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fb8060f70 0x7f3fb8063430 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f3fc4009fd0 tx=0x7f3fc400b040).stop 2023-10-18T22:12:15.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 -- 172.21.15.8:0/3605004178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fd00f6530 msgr2=0x7f3fd0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:15.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fd00f6530 0x7f3fd0108f60 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f3fc0014040 tx=0x7f3fc000b040).stop 2023-10-18T22:12:15.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 -- 172.21.15.8:0/3605004178 shutdown_connections 2023-10-18T22:12:15.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3fb8060f70 0x7f3fb8063430 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fd00f6530 0x7f3fd0108f60 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 --2- 172.21.15.8:0/3605004178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fd00f77d0 0x7f3fd0109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 -- 172.21.15.8:0/3605004178 >> 172.21.15.8:0/3605004178 conn(0x7f3fd00f1c90 msgr2=0x7f3fd006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:15.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 -- 172.21.15.8:0/3605004178 shutdown_connections 2023-10-18T22:12:15.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.411+0000 7f3fd48a3700 1 -- 172.21.15.8:0/3605004178 wait complete. 2023-10-18T22:12:15.427 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:12:15.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.553+0000 7f44ecaea700 1 -- 172.21.15.8:0/441867722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44e8060310 msgr2=0x7f44e80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:15.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.553+0000 7f44ecaea700 1 --2- 172.21.15.8:0/441867722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44e8060310 0x7f44e80f9110 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f44d8004660 tx=0x7f44d8009b30).stop 2023-10-18T22:12:15.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.553+0000 7f44ecaea700 1 -- 172.21.15.8:0/441867722 shutdown_connections 2023-10-18T22:12:15.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.553+0000 7f44ecaea700 1 --2- 172.21.15.8:0/441867722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e80f9690 0x7f44e80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.553+0000 7f44ecaea700 1 --2- 172.21.15.8:0/441867722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44e8060310 0x7f44e80f9110 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.553+0000 7f44ecaea700 1 -- 172.21.15.8:0/441867722 >> 172.21.15.8:0/441867722 conn(0x7f44e80f0b90 msgr2=0x7f44e80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:15.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.553+0000 7f44ecaea700 1 -- 172.21.15.8:0/441867722 shutdown_connections 2023-10-18T22:12:15.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.553+0000 7f44ecaea700 1 -- 172.21.15.8:0/441867722 wait complete. 2023-10-18T22:12:15.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.554+0000 7f44ecaea700 1 Processor -- start 2023-10-18T22:12:15.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.554+0000 7f44ecaea700 1 -- start start 2023-10-18T22:12:15.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.554+0000 7f44ecaea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44e8060310 0x7f44e8106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:15.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.554+0000 7f44ecaea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e80f9690 0x7f44e8107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:15.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.554+0000 7f44ecaea700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e8107850 con 0x7f44e8060310 2023-10-18T22:12:15.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.554+0000 7f44ecaea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e8108060 con 0x7f44e80f9690 2023-10-18T22:12:15.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.555+0000 7f44e77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44e8060310 0x7f44e8106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:15.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.555+0000 7f44e77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44e8060310 0x7f44e8106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55128/0 (socket says 172.21.15.8:55128) 2023-10-18T22:12:15.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.555+0000 7f44e6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e80f9690 0x7f44e8107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:15.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.555+0000 7f44e77fe700 1 -- 172.21.15.8:0/1393604095 learned_addr learned my addr 172.21.15.8:0/1393604095 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:15.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.555+0000 7f44e77fe700 1 -- 172.21.15.8:0/1393604095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e80f9690 msgr2=0x7f44e8107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:15.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.555+0000 7f44e77fe700 1 --2- 172.21.15.8:0/1393604095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e80f9690 0x7f44e8107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.555+0000 7f44e77fe700 1 -- 172.21.15.8:0/1393604095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d8005040 con 0x7f44e8060310 2023-10-18T22:12:15.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.555+0000 7f44e77fe700 1 --2- 172.21.15.8:0/1393604095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44e8060310 0x7f44e8106d60 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f44d8004320 tx=0x7f44d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:15.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.555+0000 7f44cffff700 1 -- 172.21.15.8:0/1393604095 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44d8019070 con 0x7f44e8060310 2023-10-18T22:12:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.556+0000 7f44ecaea700 1 -- 172.21.15.8:0/1393604095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e8108280 con 0x7f44e8060310 2023-10-18T22:12:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.556+0000 7f44cffff700 1 -- 172.21.15.8:0/1393604095 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f44d801e420 con 0x7f44e8060310 2023-10-18T22:12:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.556+0000 7f44ecaea700 1 -- 172.21.15.8:0/1393604095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e8108760 con 0x7f44e8060310 2023-10-18T22:12:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.556+0000 7f44cffff700 1 -- 172.21.15.8:0/1393604095 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44d8014600 con 0x7f44e8060310 2023-10-18T22:12:15.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.557+0000 7f44ecaea700 1 -- 172.21.15.8:0/1393604095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e8059100 con 0x7f44e8060310 2023-10-18T22:12:15.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.558+0000 7f44cffff700 1 -- 172.21.15.8:0/1393604095 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f44d801e590 con 0x7f44e8060310 2023-10-18T22:12:15.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.558+0000 7f44cffff700 1 --2- 172.21.15.8:0/1393604095 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44d0060f70 0x7f44d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:15.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.558+0000 7f44cffff700 1 -- 172.21.15.8:0/1393604095 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f44d807ddc0 con 0x7f44e8060310 2023-10-18T22:12:15.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.559+0000 7f44e6ffd700 1 --2- 172.21.15.8:0/1393604095 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44d0060f70 0x7f44d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:15.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.559+0000 7f44e6ffd700 1 --2- 172.21.15.8:0/1393604095 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44d0060f70 0x7f44d0063430 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f44dc009fd0 tx=0x7f44dc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.563+0000 7f44cffff700 1 -- 172.21.15.8:0/1393604095 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f44d8081030 con 0x7f44e8060310 2023-10-18T22:12:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:14.876279+0000 mon.smithi008 (mon.0) 4696 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:14.876279+0000 mon.smithi008 (mon.0) 4696 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.759+0000 7f44ecaea700 1 -- 172.21.15.8:0/1393604095 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f44e80fedd0 con 0x7f44d0060f70 2023-10-18T22:12:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.761+0000 7f44cffff700 1 -- 172.21.15.8:0/1393604095 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f44e80fedd0 con 0x7f44d0060f70 2023-10-18T22:12:15.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 -- 172.21.15.8:0/1393604095 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44d0060f70 msgr2=0x7f44d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:15.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 --2- 172.21.15.8:0/1393604095 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44d0060f70 0x7f44d0063430 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f44dc009fd0 tx=0x7f44dc00b040).stop 2023-10-18T22:12:15.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 -- 172.21.15.8:0/1393604095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44e8060310 msgr2=0x7f44e8106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:15.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 --2- 172.21.15.8:0/1393604095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44e8060310 0x7f44e8106d60 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f44d8004320 tx=0x7f44d800b040).stop 2023-10-18T22:12:15.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 -- 172.21.15.8:0/1393604095 shutdown_connections 2023-10-18T22:12:15.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 --2- 172.21.15.8:0/1393604095 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44d0060f70 0x7f44d0063430 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 --2- 172.21.15.8:0/1393604095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44e8060310 0x7f44e8106d60 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 --2- 172.21.15.8:0/1393604095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e80f9690 0x7f44e8107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 -- 172.21.15.8:0/1393604095 >> 172.21.15.8:0/1393604095 conn(0x7f44e80f0b90 msgr2=0x7f44e80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:15.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 -- 172.21.15.8:0/1393604095 shutdown_connections 2023-10-18T22:12:15.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.763+0000 7f44ecaea700 1 -- 172.21.15.8:0/1393604095 wait complete. 2023-10-18T22:12:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.900+0000 7f5c41012700 1 -- 172.21.15.8:0/4248810335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0f77d0 msgr2=0x7f5c3c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.900+0000 7f5c41012700 1 --2- 172.21.15.8:0/4248810335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0f77d0 0x7f5c3c0f7c30 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f5c30004660 tx=0x7f5c30009b30).stop 2023-10-18T22:12:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.900+0000 7f5c41012700 1 -- 172.21.15.8:0/4248810335 shutdown_connections 2023-10-18T22:12:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.900+0000 7f5c41012700 1 --2- 172.21.15.8:0/4248810335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0f77d0 0x7f5c3c0f7c30 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.900+0000 7f5c41012700 1 --2- 172.21.15.8:0/4248810335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c3c0f6530 0x7f5c3c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.900+0000 7f5c41012700 1 -- 172.21.15.8:0/4248810335 >> 172.21.15.8:0/4248810335 conn(0x7f5c3c0f1c90 msgr2=0x7f5c3c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.900+0000 7f5c41012700 1 -- 172.21.15.8:0/4248810335 shutdown_connections 2023-10-18T22:12:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.900+0000 7f5c41012700 1 -- 172.21.15.8:0/4248810335 wait complete. 2023-10-18T22:12:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.901+0000 7f5c41012700 1 Processor -- start 2023-10-18T22:12:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.901+0000 7f5c41012700 1 -- start start 2023-10-18T22:12:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c41012700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c3c0f6530 0x7f5c3c106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c41012700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0f77d0 0x7f5c3c107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c41012700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c107850 con 0x7f5c3c0f77d0 2023-10-18T22:12:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c41012700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c108060 con 0x7f5c3c0f6530 2023-10-18T22:12:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c3b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0f77d0 0x7f5c3c107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c3b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0f77d0 0x7f5c3c107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55144/0 (socket says 172.21.15.8:55144) 2023-10-18T22:12:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c3b7fe700 1 -- 172.21.15.8:0/3166925670 learned_addr learned my addr 172.21.15.8:0/3166925670 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c3bfff700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c3c0f6530 0x7f5c3c106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c3b7fe700 1 -- 172.21.15.8:0/3166925670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c3c0f6530 msgr2=0x7f5c3c106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c3b7fe700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c3c0f6530 0x7f5c3c106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.902+0000 7f5c3b7fe700 1 -- 172.21.15.8:0/3166925670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c30005040 con 0x7f5c3c0f77d0 2023-10-18T22:12:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.903+0000 7f5c3b7fe700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0f77d0 0x7f5c3c107250 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f5c30004d80 tx=0x7f5c3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.903+0000 7f5c38ff9700 1 -- 172.21.15.8:0/3166925670 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c30019070 con 0x7f5c3c0f77d0 2023-10-18T22:12:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.903+0000 7f5c38ff9700 1 -- 172.21.15.8:0/3166925670 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5c3001e420 con 0x7f5c3c0f77d0 2023-10-18T22:12:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.903+0000 7f5c41012700 1 -- 172.21.15.8:0/3166925670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3c108280 con 0x7f5c3c0f77d0 2023-10-18T22:12:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.903+0000 7f5c38ff9700 1 -- 172.21.15.8:0/3166925670 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c30014660 con 0x7f5c3c0f77d0 2023-10-18T22:12:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.903+0000 7f5c41012700 1 -- 172.21.15.8:0/3166925670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c108760 con 0x7f5c3c0f77d0 2023-10-18T22:12:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.904+0000 7f5c41012700 1 -- 172.21.15.8:0/3166925670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c059100 con 0x7f5c3c0f77d0 2023-10-18T22:12:15.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.905+0000 7f5c38ff9700 1 -- 172.21.15.8:0/3166925670 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5c3001e590 con 0x7f5c3c0f77d0 2023-10-18T22:12:15.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.906+0000 7f5c38ff9700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c24060f70 0x7f5c24063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:15.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.906+0000 7f5c38ff9700 1 -- 172.21.15.8:0/3166925670 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5c3007dd70 con 0x7f5c3c0f77d0 2023-10-18T22:12:15.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.906+0000 7f5c3bfff700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c24060f70 0x7f5c24063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:15.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.907+0000 7f5c3bfff700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c24060f70 0x7f5c24063430 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f5c3c106ad0 tx=0x7f5c2c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:15.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:15.910+0000 7f5c38ff9700 1 -- 172.21.15.8:0/3166925670 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5c3004d9a0 con 0x7f5c3c0f77d0 2023-10-18T22:12:16.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.099+0000 7f5c41012700 1 -- 172.21.15.8:0/3166925670 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c3c0fee50 con 0x7f5c24060f70 2023-10-18T22:12:16.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.109+0000 7f5c38ff9700 1 -- 172.21.15.8:0/3166925670 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5c3c0fee50 con 0x7f5c24060f70 2023-10-18T22:12:16.110 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:12:16.111 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (78m) 6m ago 80m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:12:16.111 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (72m) 6m ago 80m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:12:16.111 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (72m) 4m ago 79m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:12:16.111 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (78m) 6m ago 80m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:12:16.111 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 76m - - 2023-10-18T22:12:16.112 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 76m - - 2023-10-18T22:12:16.112 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 76m - - 2023-10-18T22:12:16.112 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 76m - - 2023-10-18T22:12:16.112 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (74m) 6m ago 81m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:12:16.113 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (73m) 4m ago 79m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:12:16.113 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (73m) 6m ago 81m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:12:16.113 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (73m) 4m ago 79m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:12:16.113 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (79m) 6m ago 79m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:12:16.113 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (79m) 4m ago 79m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:12:16.113 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (72m) 6m ago 78m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:12:16.114 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (70m) 6m ago 78m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:12:16.114 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (70m) 6m ago 78m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:12:16.114 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (69m) 4m ago 78m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:12:16.114 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (68m) 4m ago 77m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:12:16.115 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (68m) 4m ago 77m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:12:16.115 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (74m) 6m ago 79m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:12:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 -- 172.21.15.8:0/3166925670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c24060f70 msgr2=0x7f5c24063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c24060f70 0x7f5c24063430 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f5c3c106ad0 tx=0x7f5c2c00b040).stop 2023-10-18T22:12:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 -- 172.21.15.8:0/3166925670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0f77d0 msgr2=0x7f5c3c107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:16.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0f77d0 0x7f5c3c107250 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f5c30004d80 tx=0x7f5c3000b040).stop 2023-10-18T22:12:16.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 -- 172.21.15.8:0/3166925670 shutdown_connections 2023-10-18T22:12:16.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5c24060f70 0x7f5c24063430 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c3c0f6530 0x7f5c3c106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 --2- 172.21.15.8:0/3166925670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0f77d0 0x7f5c3c107250 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 -- 172.21.15.8:0/3166925670 >> 172.21.15.8:0/3166925670 conn(0x7f5c3c0f1c90 msgr2=0x7f5c3c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 -- 172.21.15.8:0/3166925670 shutdown_connections 2023-10-18T22:12:16.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.111+0000 7f5c41012700 1 -- 172.21.15.8:0/3166925670 wait complete. 2023-10-18T22:12:16.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.247+0000 7fa838a69700 1 -- 172.21.15.8:0/3890781894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8340f77d0 msgr2=0x7fa8340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:16.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.247+0000 7fa838a69700 1 --2- 172.21.15.8:0/3890781894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8340f77d0 0x7fa8340f7c30 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fa828004660 tx=0x7fa828009b30).stop 2023-10-18T22:12:16.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.247+0000 7fa838a69700 1 -- 172.21.15.8:0/3890781894 shutdown_connections 2023-10-18T22:12:16.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.247+0000 7fa838a69700 1 --2- 172.21.15.8:0/3890781894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8340f77d0 0x7fa8340f7c30 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.247+0000 7fa838a69700 1 --2- 172.21.15.8:0/3890781894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8340f6530 0x7fa8340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.247+0000 7fa838a69700 1 -- 172.21.15.8:0/3890781894 >> 172.21.15.8:0/3890781894 conn(0x7fa8340f1c90 msgr2=0x7fa8340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:16.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.247+0000 7fa838a69700 1 -- 172.21.15.8:0/3890781894 shutdown_connections 2023-10-18T22:12:16.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.247+0000 7fa838a69700 1 -- 172.21.15.8:0/3890781894 wait complete. 2023-10-18T22:12:16.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.248+0000 7fa838a69700 1 Processor -- start 2023-10-18T22:12:16.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.248+0000 7fa838a69700 1 -- start start 2023-10-18T22:12:16.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa838a69700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8340f6530 0x7fa834108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:16.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa838a69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8340f77d0 0x7fa834109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:16.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa838a69700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8341099d0 con 0x7fa8340f77d0 2023-10-18T22:12:16.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa838a69700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa834109b10 con 0x7fa8340f6530 2023-10-18T22:12:16.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8340f77d0 0x7fa834109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:16.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8340f77d0 0x7fa834109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55172/0 (socket says 172.21.15.8:55172) 2023-10-18T22:12:16.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa832ffd700 1 -- 172.21.15.8:0/2732440565 learned_addr learned my addr 172.21.15.8:0/2732440565 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:16.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa8337fe700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8340f6530 0x7fa834108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:16.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa832ffd700 1 -- 172.21.15.8:0/2732440565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8340f6530 msgr2=0x7fa834108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:16.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa832ffd700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8340f6530 0x7fa834108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.249+0000 7fa832ffd700 1 -- 172.21.15.8:0/2732440565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828005040 con 0x7fa8340f77d0 2023-10-18T22:12:16.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.250+0000 7fa832ffd700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8340f77d0 0x7fa834109420 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fa828009f50 tx=0x7fa828009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:16.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.250+0000 7fa81bfff700 1 -- 172.21.15.8:0/2732440565 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa828018070 con 0x7fa8340f77d0 2023-10-18T22:12:16.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.250+0000 7fa81bfff700 1 -- 172.21.15.8:0/2732440565 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa828009630 con 0x7fa8340f77d0 2023-10-18T22:12:16.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.250+0000 7fa81bfff700 1 -- 172.21.15.8:0/2732440565 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa82801c3c0 con 0x7fa8340f77d0 2023-10-18T22:12:16.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.250+0000 7fa838a69700 1 -- 172.21.15.8:0/2732440565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83410a450 con 0x7fa8340f77d0 2023-10-18T22:12:16.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.250+0000 7fa838a69700 1 -- 172.21.15.8:0/2732440565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83410a9b0 con 0x7fa8340f77d0 2023-10-18T22:12:16.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.251+0000 7fa838a69700 1 -- 172.21.15.8:0/2732440565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa834045ad0 con 0x7fa8340f77d0 2023-10-18T22:12:16.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.252+0000 7fa81bfff700 1 -- 172.21.15.8:0/2732440565 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa82801d420 con 0x7fa8340f77d0 2023-10-18T22:12:16.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.253+0000 7fa81bfff700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa81c060f70 0x7fa81c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:16.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.253+0000 7fa81bfff700 1 -- 172.21.15.8:0/2732440565 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa82807e580 con 0x7fa8340f77d0 2023-10-18T22:12:16.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.253+0000 7fa8337fe700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa81c060f70 0x7fa81c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:16.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.254+0000 7fa8337fe700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa81c060f70 0x7fa81c063430 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fa8340f7630 tx=0x7fa82400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:16.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.258+0000 7fa81bfff700 1 -- 172.21.15.8:0/2732440565 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa828051be0 con 0x7fa8340f77d0 2023-10-18T22:12:16.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.523+0000 7fa838a69700 1 -- 172.21.15.8:0/2732440565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa834027a00 con 0x7fa8340f77d0 2023-10-18T22:12:16.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.524+0000 7fa81bfff700 1 -- 172.21.15.8:0/2732440565 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fa8280517d0 con 0x7fa8340f77d0 2023-10-18T22:12:16.526 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:12:16.526 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:12:16.526 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:12:16.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:12:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:12:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:12:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:12:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:12:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:12:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:12:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:12:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:12:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:12:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:12:16.529 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:12:16.529 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:12:16.529 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:12:16.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 -- 172.21.15.8:0/2732440565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa81c060f70 msgr2=0x7fa81c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:16.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa81c060f70 0x7fa81c063430 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fa8340f7630 tx=0x7fa82400b040).stop 2023-10-18T22:12:16.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 -- 172.21.15.8:0/2732440565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8340f77d0 msgr2=0x7fa834109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:16.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8340f77d0 0x7fa834109420 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fa828009f50 tx=0x7fa828009b30).stop 2023-10-18T22:12:16.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 -- 172.21.15.8:0/2732440565 shutdown_connections 2023-10-18T22:12:16.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa81c060f70 0x7fa81c063430 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8340f6530 0x7fa834108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 --2- 172.21.15.8:0/2732440565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8340f77d0 0x7fa834109420 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 -- 172.21.15.8:0/2732440565 >> 172.21.15.8:0/2732440565 conn(0x7fa8340f1c90 msgr2=0x7fa83406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:16.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 -- 172.21.15.8:0/2732440565 shutdown_connections 2023-10-18T22:12:16.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.526+0000 7fa838a69700 1 -- 172.21.15.8:0/2732440565 wait complete. 2023-10-18T22:12:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.662+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/4206180472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7a80f6530 msgr2=0x7ff7a80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.662+0000 7ff7ad5cf700 1 --2- 172.21.15.8:0/4206180472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7a80f6530 0x7ff7a80f6950 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7ff798004660 tx=0x7ff798009b30).stop 2023-10-18T22:12:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.662+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/4206180472 shutdown_connections 2023-10-18T22:12:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.662+0000 7ff7ad5cf700 1 --2- 172.21.15.8:0/4206180472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7a80f77d0 0x7ff7a80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.662+0000 7ff7ad5cf700 1 --2- 172.21.15.8:0/4206180472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7a80f6530 0x7ff7a80f6950 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.662+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/4206180472 >> 172.21.15.8:0/4206180472 conn(0x7ff7a80f1c90 msgr2=0x7ff7a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.662+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/4206180472 shutdown_connections 2023-10-18T22:12:16.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.663+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/4206180472 wait complete. 2023-10-18T22:12:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.663+0000 7ff7ad5cf700 1 Processor -- start 2023-10-18T22:12:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.663+0000 7ff7ad5cf700 1 -- start start 2023-10-18T22:12:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.664+0000 7ff7ad5cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7a80f6530 0x7ff7a8108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.664+0000 7ff7ad5cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7a80f77d0 0x7ff7a81094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.664+0000 7ff7ad5cf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8109a70 con 0x7ff7a80f77d0 2023-10-18T22:12:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.664+0000 7ff7ad5cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8109bb0 con 0x7ff7a80f6530 2023-10-18T22:12:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.664+0000 7ff7a77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7a80f77d0 0x7ff7a81094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.664+0000 7ff7a77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7a80f77d0 0x7ff7a81094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55196/0 (socket says 172.21.15.8:55196) 2023-10-18T22:12:16.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.664+0000 7ff7a77fe700 1 -- 172.21.15.8:0/954252389 learned_addr learned my addr 172.21.15.8:0/954252389 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:16.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.664+0000 7ff7a7fff700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7a80f6530 0x7ff7a8108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:16.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.665+0000 7ff7a77fe700 1 -- 172.21.15.8:0/954252389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7a80f6530 msgr2=0x7ff7a8108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:16.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.665+0000 7ff7a77fe700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7a80f6530 0x7ff7a8108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.665+0000 7ff7a77fe700 1 -- 172.21.15.8:0/954252389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798005040 con 0x7ff7a80f77d0 2023-10-18T22:12:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.665+0000 7ff7a77fe700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7a80f77d0 0x7ff7a81094c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7ff79c0026d0 tx=0x7ff79c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.665+0000 7ff7a4ff9700 1 -- 172.21.15.8:0/954252389 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff79c0079c0 con 0x7ff7a80f77d0 2023-10-18T22:12:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.665+0000 7ff7a4ff9700 1 -- 172.21.15.8:0/954252389 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff79c00f040 con 0x7ff7a80f77d0 2023-10-18T22:12:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.665+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/954252389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a810a550 con 0x7ff7a80f77d0 2023-10-18T22:12:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.665+0000 7ff7a4ff9700 1 -- 172.21.15.8:0/954252389 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff79c014980 con 0x7ff7a80f77d0 2023-10-18T22:12:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.665+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/954252389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a810ab10 con 0x7ff7a80f77d0 2023-10-18T22:12:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.666+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/954252389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a8045ad0 con 0x7ff7a80f77d0 2023-10-18T22:12:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.667+0000 7ff7a4ff9700 1 -- 172.21.15.8:0/954252389 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff79c0090d0 con 0x7ff7a80f77d0 2023-10-18T22:12:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.668+0000 7ff7a4ff9700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff790060f70 0x7ff790063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:16.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.668+0000 7ff7a4ff9700 1 -- 172.21.15.8:0/954252389 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff79c07c980 con 0x7ff7a80f77d0 2023-10-18T22:12:16.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.668+0000 7ff7a7fff700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff790060f70 0x7ff790063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:16.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.669+0000 7ff7a7fff700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff790060f70 0x7ff790063430 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7ff798004630 tx=0x7ff798009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:16.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:14.850245+0000 mgr.smithi008.flmjzp (mgr.14640) 4398 : cluster [DBG] pgmap v3020: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:16.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:15.432668+0000 mon.smithi008 (mon.0) 4697 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:16.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:15.433571+0000 mon.smithi008 (mon.0) 4698 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:16.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:15.439301+0000 mon.smithi008 (mon.0) 4699 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:16.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:15.445479+0000 mon.smithi008 (mon.0) 4700 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:16.676 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:15.448633+0000 mon.smithi008 (mon.0) 4701 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:16.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:15.450308+0000 mon.smithi008 (mon.0) 4702 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:16.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:15.451894+0000 mon.smithi008 (mon.0) 4703 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:16.677 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:15.453911+0000 mon.smithi008 (mon.0) 4704 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:16.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.672+0000 7ff7a4ff9700 1 -- 172.21.15.8:0/954252389 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff79c050010 con 0x7ff7a80f77d0 2023-10-18T22:12:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:14.850245+0000 mgr.smithi008.flmjzp (mgr.14640) 4398 : cluster [DBG] pgmap v3020: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:15.432668+0000 mon.smithi008 (mon.0) 4697 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:15.433571+0000 mon.smithi008 (mon.0) 4698 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:15.439301+0000 mon.smithi008 (mon.0) 4699 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:15.445479+0000 mon.smithi008 (mon.0) 4700 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:15.448633+0000 mon.smithi008 (mon.0) 4701 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:15.450308+0000 mon.smithi008 (mon.0) 4702 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:15.451894+0000 mon.smithi008 (mon.0) 4703 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:15.453911+0000 mon.smithi008 (mon.0) 4704 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:16.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.903+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/954252389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff7a8027a00 con 0x7ff7a80f77d0 2023-10-18T22:12:16.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.904+0000 7ff7a4ff9700 1 -- 172.21.15.8:0/954252389 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7ff79c04fc00 con 0x7ff7a80f77d0 2023-10-18T22:12:16.906 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:12:16.906 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:12:16.906 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:12:16.906 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:12:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:12:16.907 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:12:16.907 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:12:16.907 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:12:16.907 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:12:16.908 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:12:16.908 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:12:16.908 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:12:16.908 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:12:16.908 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:12:16.908 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:12:16.909 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:12:16.909 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:12:16.909 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:12:16.909 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:12:16.909 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:12:16.910 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:12:16.910 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:12:16.910 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:12:16.910 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:12:16.910 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:12:16.911 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:12:16.911 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:12:16.911 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:12:16.911 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:12:16.911 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:12:16.912 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:12:16.912 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:12:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:12:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:12:16.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/954252389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff790060f70 msgr2=0x7ff790063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:16.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff790060f70 0x7ff790063430 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7ff798004630 tx=0x7ff798009b30).stop 2023-10-18T22:12:16.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/954252389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7a80f77d0 msgr2=0x7ff7a81094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:16.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7a80f77d0 0x7ff7a81094c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7ff79c0026d0 tx=0x7ff79c009de0).stop 2023-10-18T22:12:16.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/954252389 shutdown_connections 2023-10-18T22:12:16.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff790060f70 0x7ff790063430 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7a80f6530 0x7ff7a8108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 --2- 172.21.15.8:0/954252389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7a80f77d0 0x7ff7a81094c0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:16.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/954252389 >> 172.21.15.8:0/954252389 conn(0x7ff7a80f1c90 msgr2=0x7ff7a806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:16.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/954252389 shutdown_connections 2023-10-18T22:12:16.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:16.906+0000 7ff7ad5cf700 1 -- 172.21.15.8:0/954252389 wait complete. 2023-10-18T22:12:16.915 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:12:17.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.048+0000 7fd37d25f700 1 -- 172.21.15.8:0/4114237877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3780f6530 msgr2=0x7fd3780f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:17.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.048+0000 7fd37d25f700 1 --2- 172.21.15.8:0/4114237877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3780f6530 0x7fd3780f6950 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7fd368004660 tx=0x7fd368009b30).stop 2023-10-18T22:12:17.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.048+0000 7fd37d25f700 1 -- 172.21.15.8:0/4114237877 shutdown_connections 2023-10-18T22:12:17.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.048+0000 7fd37d25f700 1 --2- 172.21.15.8:0/4114237877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3780f77d0 0x7fd3780f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:17.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.048+0000 7fd37d25f700 1 --2- 172.21.15.8:0/4114237877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3780f6530 0x7fd3780f6950 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:17.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.048+0000 7fd37d25f700 1 -- 172.21.15.8:0/4114237877 >> 172.21.15.8:0/4114237877 conn(0x7fd3780f1c90 msgr2=0x7fd3780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:17.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.048+0000 7fd37d25f700 1 -- 172.21.15.8:0/4114237877 shutdown_connections 2023-10-18T22:12:17.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.048+0000 7fd37d25f700 1 -- 172.21.15.8:0/4114237877 wait complete. 2023-10-18T22:12:17.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.049+0000 7fd37d25f700 1 Processor -- start 2023-10-18T22:12:17.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.049+0000 7fd37d25f700 1 -- start start 2023-10-18T22:12:17.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd37d25f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3780f6530 0x7fd37806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:17.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd37d25f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3780f77d0 0x7fd378069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:17.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd37d25f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37806a380 con 0x7fd3780f77d0 2023-10-18T22:12:17.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd37d25f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37806a4c0 con 0x7fd3780f6530 2023-10-18T22:12:17.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd3777fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3780f77d0 0x7fd378069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:17.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd3777fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3780f77d0 0x7fd378069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44132/0 (socket says 172.21.15.8:44132) 2023-10-18T22:12:17.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd3777fe700 1 -- 172.21.15.8:0/4134675808 learned_addr learned my addr 172.21.15.8:0/4134675808 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:17.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd377fff700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3780f6530 0x7fd37806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:17.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd3777fe700 1 -- 172.21.15.8:0/4134675808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3780f6530 msgr2=0x7fd37806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:17.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd3777fe700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3780f6530 0x7fd37806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:17.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.050+0000 7fd3777fe700 1 -- 172.21.15.8:0/4134675808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368005040 con 0x7fd3780f77d0 2023-10-18T22:12:17.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.051+0000 7fd3777fe700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3780f77d0 0x7fd378069e20 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fd36c002700 tx=0x7fd36c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:17.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.051+0000 7fd374ff9700 1 -- 172.21.15.8:0/4134675808 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36c009320 con 0x7fd3780f77d0 2023-10-18T22:12:17.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.051+0000 7fd374ff9700 1 -- 172.21.15.8:0/4134675808 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd36c00f040 con 0x7fd3780f77d0 2023-10-18T22:12:17.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.051+0000 7fd374ff9700 1 -- 172.21.15.8:0/4134675808 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36c0148a0 con 0x7fd3780f77d0 2023-10-18T22:12:17.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.051+0000 7fd37d25f700 1 -- 172.21.15.8:0/4134675808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37806a7a0 con 0x7fd3780f77d0 2023-10-18T22:12:17.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.051+0000 7fd37d25f700 1 -- 172.21.15.8:0/4134675808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37810ed70 con 0x7fd3780f77d0 2023-10-18T22:12:17.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.052+0000 7fd37d25f700 1 -- 172.21.15.8:0/4134675808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd378045ad0 con 0x7fd3780f77d0 2023-10-18T22:12:17.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.053+0000 7fd374ff9700 1 -- 172.21.15.8:0/4134675808 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd36c009480 con 0x7fd3780f77d0 2023-10-18T22:12:17.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.054+0000 7fd374ff9700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd360060f70 0x7fd360063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:17.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.054+0000 7fd374ff9700 1 -- 172.21.15.8:0/4134675808 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd36c07cb40 con 0x7fd3780f77d0 2023-10-18T22:12:17.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.054+0000 7fd377fff700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd360060f70 0x7fd360063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:17.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.055+0000 7fd377fff700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd360060f70 0x7fd360063430 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fd37806b730 tx=0x7fd368009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:17.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.058+0000 7fd374ff9700 1 -- 172.21.15.8:0/4134675808 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd36c04c7b0 con 0x7fd3780f77d0 2023-10-18T22:12:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.257+0000 7fd37d25f700 1 -- 172.21.15.8:0/4134675808 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3780fedd0 con 0x7fd360060f70 2023-10-18T22:12:17.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.258+0000 7fd374ff9700 1 -- 172.21.15.8:0/4134675808 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd3780fedd0 con 0x7fd360060f70 2023-10-18T22:12:17.259 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:12:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:12:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:12:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:12:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:12:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:12:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:12:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:12:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:12:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:12:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:12:17.262 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:12:17.262 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:12:17.262 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:12:17.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 -- 172.21.15.8:0/4134675808 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd360060f70 msgr2=0x7fd360063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:17.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd360060f70 0x7fd360063430 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fd37806b730 tx=0x7fd368009b30).stop 2023-10-18T22:12:17.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 -- 172.21.15.8:0/4134675808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3780f77d0 msgr2=0x7fd378069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3780f77d0 0x7fd378069e20 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fd36c002700 tx=0x7fd36c009e00).stop 2023-10-18T22:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 -- 172.21.15.8:0/4134675808 shutdown_connections 2023-10-18T22:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd360060f70 0x7fd360063430 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3780f6530 0x7fd37806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 --2- 172.21.15.8:0/4134675808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3780f77d0 0x7fd378069e20 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 -- 172.21.15.8:0/4134675808 >> 172.21.15.8:0/4134675808 conn(0x7fd3780f1c90 msgr2=0x7fd3780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 -- 172.21.15.8:0/4134675808 shutdown_connections 2023-10-18T22:12:17.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:17.260+0000 7fd37d25f700 1 -- 172.21.15.8:0/4134675808 wait complete. 2023-10-18T22:12:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:15.409528+0000 mgr.smithi008.flmjzp (mgr.14640) 4399 : audit [DBG] from='client.37552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:15.434310+0000 mgr.smithi008.flmjzp (mgr.14640) 4400 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:15.434846+0000 mgr.smithi008.flmjzp (mgr.14640) 4401 : cluster [DBG] pgmap v3021: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:15.435035+0000 mgr.smithi008.flmjzp (mgr.14640) 4402 : cluster [DBG] pgmap v3022: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:15.455707+0000 mgr.smithi008.flmjzp (mgr.14640) 4403 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:15.761108+0000 mgr.smithi008.flmjzp (mgr.14640) 4404 : audit [DBG] from='client.37556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:16.101041+0000 mgr.smithi008.flmjzp (mgr.14640) 4405 : audit [DBG] from='client.37560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:16.524645+0000 mon.smithi008 (mon.0) 4705 : audit [DBG] from='client.? 172.21.15.8:0/2732440565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:16.904558+0000 mon.smithi008 (mon.0) 4706 : audit [DBG] from='client.? 172.21.15.8:0/954252389' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:12:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:15.409528+0000 mgr.smithi008.flmjzp (mgr.14640) 4399 : audit [DBG] from='client.37552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:15.434310+0000 mgr.smithi008.flmjzp (mgr.14640) 4400 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:15.434846+0000 mgr.smithi008.flmjzp (mgr.14640) 4401 : cluster [DBG] pgmap v3021: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:15.435035+0000 mgr.smithi008.flmjzp (mgr.14640) 4402 : cluster [DBG] pgmap v3022: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:15.455707+0000 mgr.smithi008.flmjzp (mgr.14640) 4403 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:15.761108+0000 mgr.smithi008.flmjzp (mgr.14640) 4404 : audit [DBG] from='client.37556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:16.101041+0000 mgr.smithi008.flmjzp (mgr.14640) 4405 : audit [DBG] from='client.37560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:17.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:16.524645+0000 mon.smithi008 (mon.0) 4705 : audit [DBG] from='client.? 172.21.15.8:0/2732440565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:17.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:16.904558+0000 mon.smithi008 (mon.0) 4706 : audit [DBG] from='client.? 172.21.15.8:0/954252389' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:12:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:17.258412+0000 mgr.smithi008.flmjzp (mgr.14640) 4406 : audit [DBG] from='client.37572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:17.258412+0000 mgr.smithi008.flmjzp (mgr.14640) 4406 : audit [DBG] from='client.37572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:17.435590+0000 mgr.smithi008.flmjzp (mgr.14640) 4407 : cluster [DBG] pgmap v3023: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:17.435590+0000 mgr.smithi008.flmjzp (mgr.14640) 4407 : cluster [DBG] pgmap v3023: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:19.436318+0000 mgr.smithi008.flmjzp (mgr.14640) 4408 : cluster [DBG] pgmap v3024: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:19.436318+0000 mgr.smithi008.flmjzp (mgr.14640) 4408 : cluster [DBG] pgmap v3024: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:21.436886+0000 mgr.smithi008.flmjzp (mgr.14640) 4409 : cluster [DBG] pgmap v3025: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:21.436886+0000 mgr.smithi008.flmjzp (mgr.14640) 4409 : cluster [DBG] pgmap v3025: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:23.437605+0000 mgr.smithi008.flmjzp (mgr.14640) 4410 : cluster [DBG] pgmap v3026: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:23.437605+0000 mgr.smithi008.flmjzp (mgr.14640) 4410 : cluster [DBG] pgmap v3026: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:25.461332+0000 mon.smithi008 (mon.0) 4707 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:25.463421+0000 mon.smithi008 (mon.0) 4708 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:25.464555+0000 mon.smithi008 (mon.0) 4709 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:25.470884+0000 mon.smithi008 (mon.0) 4710 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:25.477212+0000 mon.smithi008 (mon.0) 4711 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:25.480443+0000 mon.smithi008 (mon.0) 4712 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:25.482200+0000 mon.smithi008 (mon.0) 4713 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:25.483906+0000 mon.smithi008 (mon.0) 4714 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:25.485928+0000 mon.smithi008 (mon.0) 4715 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:25.461332+0000 mon.smithi008 (mon.0) 4707 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:25.463421+0000 mon.smithi008 (mon.0) 4708 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:25.464555+0000 mon.smithi008 (mon.0) 4709 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:25.470884+0000 mon.smithi008 (mon.0) 4710 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:25.477212+0000 mon.smithi008 (mon.0) 4711 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:25.480443+0000 mon.smithi008 (mon.0) 4712 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:25.482200+0000 mon.smithi008 (mon.0) 4713 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:26.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:25.483906+0000 mon.smithi008 (mon.0) 4714 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:26.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:25.485928+0000 mon.smithi008 (mon.0) 4715 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:25.438141+0000 mgr.smithi008.flmjzp (mgr.14640) 4411 : cluster [DBG] pgmap v3027: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:25.465394+0000 mgr.smithi008.flmjzp (mgr.14640) 4412 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:25.465992+0000 mgr.smithi008.flmjzp (mgr.14640) 4413 : cluster [DBG] pgmap v3028: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:25.466220+0000 mgr.smithi008.flmjzp (mgr.14640) 4414 : cluster [DBG] pgmap v3029: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:25.487846+0000 mgr.smithi008.flmjzp (mgr.14640) 4415 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:25.438141+0000 mgr.smithi008.flmjzp (mgr.14640) 4411 : cluster [DBG] pgmap v3027: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:25.465394+0000 mgr.smithi008.flmjzp (mgr.14640) 4412 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:25.465992+0000 mgr.smithi008.flmjzp (mgr.14640) 4413 : cluster [DBG] pgmap v3028: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:25.466220+0000 mgr.smithi008.flmjzp (mgr.14640) 4414 : cluster [DBG] pgmap v3029: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:25.487846+0000 mgr.smithi008.flmjzp (mgr.14640) 4415 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:27.466752+0000 mgr.smithi008.flmjzp (mgr.14640) 4416 : cluster [DBG] pgmap v3030: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:27.466752+0000 mgr.smithi008.flmjzp (mgr.14640) 4416 : cluster [DBG] pgmap v3030: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:29.467334+0000 mgr.smithi008.flmjzp (mgr.14640) 4417 : cluster [DBG] pgmap v3031: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:29.467334+0000 mgr.smithi008.flmjzp (mgr.14640) 4417 : cluster [DBG] pgmap v3031: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:33.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:31.467876+0000 mgr.smithi008.flmjzp (mgr.14640) 4418 : cluster [DBG] pgmap v3032: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:33.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:31.467876+0000 mgr.smithi008.flmjzp (mgr.14640) 4418 : cluster [DBG] pgmap v3032: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:35.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:33.468581+0000 mgr.smithi008.flmjzp (mgr.14640) 4419 : cluster [DBG] pgmap v3033: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:35.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:33.468581+0000 mgr.smithi008.flmjzp (mgr.14640) 4419 : cluster [DBG] pgmap v3033: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:36.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:35.497082+0000 mon.smithi008 (mon.0) 4716 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:35.849678+0000 mon.smithi008 (mon.0) 4717 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:35.850730+0000 mon.smithi008 (mon.0) 4718 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:35.851465+0000 mon.smithi008 (mon.0) 4719 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:35.856516+0000 mon.smithi008 (mon.0) 4720 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:36.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:35.861365+0000 mon.smithi008 (mon.0) 4721 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:36.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:35.863788+0000 mon.smithi008 (mon.0) 4722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:36.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:35.865065+0000 mon.smithi008 (mon.0) 4723 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:36.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:35.866263+0000 mon.smithi008 (mon.0) 4724 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:36.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:35.867767+0000 mon.smithi008 (mon.0) 4725 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:35.497082+0000 mon.smithi008 (mon.0) 4716 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:35.849678+0000 mon.smithi008 (mon.0) 4717 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:36.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:35.850730+0000 mon.smithi008 (mon.0) 4718 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:35.851465+0000 mon.smithi008 (mon.0) 4719 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:35.856516+0000 mon.smithi008 (mon.0) 4720 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:35.861365+0000 mon.smithi008 (mon.0) 4721 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:35.863788+0000 mon.smithi008 (mon.0) 4722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:36.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:35.865065+0000 mon.smithi008 (mon.0) 4723 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:36.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:35.866263+0000 mon.smithi008 (mon.0) 4724 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:36.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:35.867767+0000 mon.smithi008 (mon.0) 4725 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:35.469164+0000 mgr.smithi008.flmjzp (mgr.14640) 4420 : cluster [DBG] pgmap v3034: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:37.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:35.852098+0000 mgr.smithi008.flmjzp (mgr.14640) 4421 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:35.852652+0000 mgr.smithi008.flmjzp (mgr.14640) 4422 : cluster [DBG] pgmap v3035: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:35.852916+0000 mgr.smithi008.flmjzp (mgr.14640) 4423 : cluster [DBG] pgmap v3036: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:37.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:35.869339+0000 mgr.smithi008.flmjzp (mgr.14640) 4424 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:35.469164+0000 mgr.smithi008.flmjzp (mgr.14640) 4420 : cluster [DBG] pgmap v3034: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:35.852098+0000 mgr.smithi008.flmjzp (mgr.14640) 4421 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:35.852652+0000 mgr.smithi008.flmjzp (mgr.14640) 4422 : cluster [DBG] pgmap v3035: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:37.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:35.852916+0000 mgr.smithi008.flmjzp (mgr.14640) 4423 : cluster [DBG] pgmap v3036: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:37.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:35.869339+0000 mgr.smithi008.flmjzp (mgr.14640) 4424 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:39.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:37.853605+0000 mgr.smithi008.flmjzp (mgr.14640) 4425 : cluster [DBG] pgmap v3037: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:39.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:37.853605+0000 mgr.smithi008.flmjzp (mgr.14640) 4425 : cluster [DBG] pgmap v3037: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:41.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:39.854102+0000 mgr.smithi008.flmjzp (mgr.14640) 4426 : cluster [DBG] pgmap v3038: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:39.854102+0000 mgr.smithi008.flmjzp (mgr.14640) 4426 : cluster [DBG] pgmap v3038: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:43.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:41.854664+0000 mgr.smithi008.flmjzp (mgr.14640) 4427 : cluster [DBG] pgmap v3039: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:43.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:41.854664+0000 mgr.smithi008.flmjzp (mgr.14640) 4427 : cluster [DBG] pgmap v3039: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:45.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:43.855433+0000 mgr.smithi008.flmjzp (mgr.14640) 4428 : cluster [DBG] pgmap v3040: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:45.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:43.855433+0000 mgr.smithi008.flmjzp (mgr.14640) 4428 : cluster [DBG] pgmap v3040: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:45.875652+0000 mon.smithi008 (mon.0) 4726 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:46.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:45.877612+0000 mon.smithi008 (mon.0) 4727 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:45.878604+0000 mon.smithi008 (mon.0) 4728 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:45.885083+0000 mon.smithi008 (mon.0) 4729 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:45.891065+0000 mon.smithi008 (mon.0) 4730 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:45.893960+0000 mon.smithi008 (mon.0) 4731 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:46.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:45.895504+0000 mon.smithi008 (mon.0) 4732 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:46.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:45.896966+0000 mon.smithi008 (mon.0) 4733 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:46.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:45.898788+0000 mon.smithi008 (mon.0) 4734 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:45.875652+0000 mon.smithi008 (mon.0) 4726 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:45.877612+0000 mon.smithi008 (mon.0) 4727 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:45.878604+0000 mon.smithi008 (mon.0) 4728 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:45.885083+0000 mon.smithi008 (mon.0) 4729 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:45.891065+0000 mon.smithi008 (mon.0) 4730 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:45.893960+0000 mon.smithi008 (mon.0) 4731 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:45.895504+0000 mon.smithi008 (mon.0) 4732 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:45.896966+0000 mon.smithi008 (mon.0) 4733 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:45.898788+0000 mon.smithi008 (mon.0) 4734 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:47.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.411+0000 7fc338b44700 1 -- 172.21.15.8:0/3317828148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3340602b0 msgr2=0x7fc3340f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:47.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.411+0000 7fc338b44700 1 --2- 172.21.15.8:0/3317828148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3340602b0 0x7fc3340f9170 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fc324004660 tx=0x7fc324009b30).stop 2023-10-18T22:12:47.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.411+0000 7fc338b44700 1 -- 172.21.15.8:0/3317828148 shutdown_connections 2023-10-18T22:12:47.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.411+0000 7fc338b44700 1 --2- 172.21.15.8:0/3317828148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3340f96f0 0x7fc3340fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.411+0000 7fc338b44700 1 --2- 172.21.15.8:0/3317828148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3340602b0 0x7fc3340f9170 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.411+0000 7fc338b44700 1 -- 172.21.15.8:0/3317828148 >> 172.21.15.8:0/3317828148 conn(0x7fc3340f0b90 msgr2=0x7fc3340f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:47.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.412+0000 7fc338b44700 1 -- 172.21.15.8:0/3317828148 shutdown_connections 2023-10-18T22:12:47.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.412+0000 7fc338b44700 1 -- 172.21.15.8:0/3317828148 wait complete. 2023-10-18T22:12:47.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.412+0000 7fc338b44700 1 Processor -- start 2023-10-18T22:12:47.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.413+0000 7fc338b44700 1 -- start start 2023-10-18T22:12:47.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.413+0000 7fc338b44700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3340602b0 0x7fc334108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:47.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.413+0000 7fc338b44700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3340f96f0 0x7fc334109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:47.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.413+0000 7fc338b44700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3341099b0 con 0x7fc3340f96f0 2023-10-18T22:12:47.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.413+0000 7fc338b44700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc334109af0 con 0x7fc3340602b0 2023-10-18T22:12:47.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.413+0000 7fc332ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3340f96f0 0x7fc334109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:47.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.413+0000 7fc332ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3340f96f0 0x7fc334109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48794/0 (socket says 172.21.15.8:48794) 2023-10-18T22:12:47.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.413+0000 7fc332ffd700 1 -- 172.21.15.8:0/2190416167 learned_addr learned my addr 172.21.15.8:0/2190416167 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:47.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.413+0000 7fc3337fe700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3340602b0 0x7fc334108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:47.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.414+0000 7fc332ffd700 1 -- 172.21.15.8:0/2190416167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3340602b0 msgr2=0x7fc334108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:47.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.414+0000 7fc332ffd700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3340602b0 0x7fc334108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.414+0000 7fc332ffd700 1 -- 172.21.15.8:0/2190416167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc324005040 con 0x7fc3340f96f0 2023-10-18T22:12:47.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.414+0000 7fc332ffd700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3340f96f0 0x7fc334109400 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7fc3280026d0 tx=0x7fc328009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:47.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.414+0000 7fc31bfff700 1 -- 172.21.15.8:0/2190416167 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3280079c0 con 0x7fc3340f96f0 2023-10-18T22:12:47.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.414+0000 7fc31bfff700 1 -- 172.21.15.8:0/2190416167 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc32800f040 con 0x7fc3340f96f0 2023-10-18T22:12:47.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.414+0000 7fc338b44700 1 -- 172.21.15.8:0/2190416167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33410a490 con 0x7fc3340f96f0 2023-10-18T22:12:47.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.414+0000 7fc31bfff700 1 -- 172.21.15.8:0/2190416167 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3280148d0 con 0x7fc3340f96f0 2023-10-18T22:12:47.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.414+0000 7fc338b44700 1 -- 172.21.15.8:0/2190416167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33410aa50 con 0x7fc3340f96f0 2023-10-18T22:12:47.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.415+0000 7fc338b44700 1 -- 172.21.15.8:0/2190416167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc334045ad0 con 0x7fc3340f96f0 2023-10-18T22:12:47.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.416+0000 7fc31bfff700 1 -- 172.21.15.8:0/2190416167 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc3280090d0 con 0x7fc3340f96f0 2023-10-18T22:12:47.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.417+0000 7fc31bfff700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc31c060f70 0x7fc31c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:47.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.417+0000 7fc31bfff700 1 -- 172.21.15.8:0/2190416167 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc32807c900 con 0x7fc3340f96f0 2023-10-18T22:12:47.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.417+0000 7fc3337fe700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc31c060f70 0x7fc31c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:47.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.418+0000 7fc3337fe700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc31c060f70 0x7fc31c063430 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fc324004630 tx=0x7fc324009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:47.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.422+0000 7fc31bfff700 1 -- 172.21.15.8:0/2190416167 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc32804ff60 con 0x7fc3340f96f0 2023-10-18T22:12:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:45.855959+0000 mgr.smithi008.flmjzp (mgr.14640) 4429 : cluster [DBG] pgmap v3041: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:45.879523+0000 mgr.smithi008.flmjzp (mgr.14640) 4430 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:47.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:45.880054+0000 mgr.smithi008.flmjzp (mgr.14640) 4431 : cluster [DBG] pgmap v3042: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:45.880353+0000 mgr.smithi008.flmjzp (mgr.14640) 4432 : cluster [DBG] pgmap v3043: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:47.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:45.900560+0000 mgr.smithi008.flmjzp (mgr.14640) 4433 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:47.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.619+0000 7fc338b44700 1 -- 172.21.15.8:0/2190416167 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3340f5690 con 0x7fc31c060f70 2023-10-18T22:12:47.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.620+0000 7fc31bfff700 1 -- 172.21.15.8:0/2190416167 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc3340f5690 con 0x7fc31c060f70 2023-10-18T22:12:47.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.623+0000 7fc338b44700 1 -- 172.21.15.8:0/2190416167 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc31c060f70 msgr2=0x7fc31c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:47.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.623+0000 7fc338b44700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc31c060f70 0x7fc31c063430 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fc324004630 tx=0x7fc324009b30).stop 2023-10-18T22:12:47.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.623+0000 7fc338b44700 1 -- 172.21.15.8:0/2190416167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3340f96f0 msgr2=0x7fc334109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:47.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.623+0000 7fc338b44700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3340f96f0 0x7fc334109400 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7fc3280026d0 tx=0x7fc328009e00).stop 2023-10-18T22:12:47.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.623+0000 7fc338b44700 1 -- 172.21.15.8:0/2190416167 shutdown_connections 2023-10-18T22:12:47.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.623+0000 7fc338b44700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc31c060f70 0x7fc31c063430 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.623+0000 7fc338b44700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3340602b0 0x7fc334108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.623+0000 7fc338b44700 1 --2- 172.21.15.8:0/2190416167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3340f96f0 0x7fc334109400 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.623+0000 7fc338b44700 1 -- 172.21.15.8:0/2190416167 >> 172.21.15.8:0/2190416167 conn(0x7fc3340f0b90 msgr2=0x7fc3340f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:47.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.623+0000 7fc338b44700 1 -- 172.21.15.8:0/2190416167 shutdown_connections 2023-10-18T22:12:47.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.624+0000 7fc338b44700 1 -- 172.21.15.8:0/2190416167 wait complete. 2023-10-18T22:12:47.640 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:12:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:45.855959+0000 mgr.smithi008.flmjzp (mgr.14640) 4429 : cluster [DBG] pgmap v3041: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:45.879523+0000 mgr.smithi008.flmjzp (mgr.14640) 4430 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:45.880054+0000 mgr.smithi008.flmjzp (mgr.14640) 4431 : cluster [DBG] pgmap v3042: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:45.880353+0000 mgr.smithi008.flmjzp (mgr.14640) 4432 : cluster [DBG] pgmap v3043: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:45.900560+0000 mgr.smithi008.flmjzp (mgr.14640) 4433 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.762+0000 7f637bfff700 1 -- 172.21.15.8:0/1556897087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637c0f77d0 msgr2=0x7f637c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.762+0000 7f637bfff700 1 --2- 172.21.15.8:0/1556897087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637c0f77d0 0x7f637c0f7c30 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f6370004660 tx=0x7f6370009b30).stop 2023-10-18T22:12:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.762+0000 7f637bfff700 1 -- 172.21.15.8:0/1556897087 shutdown_connections 2023-10-18T22:12:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.762+0000 7f637bfff700 1 --2- 172.21.15.8:0/1556897087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637c0f77d0 0x7f637c0f7c30 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.762+0000 7f637bfff700 1 --2- 172.21.15.8:0/1556897087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637c0f6530 0x7f637c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.762+0000 7f637bfff700 1 -- 172.21.15.8:0/1556897087 >> 172.21.15.8:0/1556897087 conn(0x7f637c0f1c90 msgr2=0x7f637c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.762+0000 7f637bfff700 1 -- 172.21.15.8:0/1556897087 shutdown_connections 2023-10-18T22:12:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.762+0000 7f637bfff700 1 -- 172.21.15.8:0/1556897087 wait complete. 2023-10-18T22:12:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.763+0000 7f637bfff700 1 Processor -- start 2023-10-18T22:12:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.763+0000 7f637bfff700 1 -- start start 2023-10-18T22:12:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.763+0000 7f637bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637c0f6530 0x7f637c106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.763+0000 7f637bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637c0f77d0 0x7f637c107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.763+0000 7f637bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c107850 con 0x7f637c0f77d0 2023-10-18T22:12:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.763+0000 7f637bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c108060 con 0x7f637c0f6530 2023-10-18T22:12:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.764+0000 7f637a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637c0f77d0 0x7f637c107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.764+0000 7f637a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637c0f77d0 0x7f637c107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48800/0 (socket says 172.21.15.8:48800) 2023-10-18T22:12:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.764+0000 7f637a7fc700 1 -- 172.21.15.8:0/1102758083 learned_addr learned my addr 172.21.15.8:0/1102758083 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.764+0000 7f637affd700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637c0f6530 0x7f637c106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:47.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.764+0000 7f637a7fc700 1 -- 172.21.15.8:0/1102758083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637c0f6530 msgr2=0x7f637c106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:47.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.764+0000 7f637a7fc700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637c0f6530 0x7f637c106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.764+0000 7f637a7fc700 1 -- 172.21.15.8:0/1102758083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6370005040 con 0x7f637c0f77d0 2023-10-18T22:12:47.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.764+0000 7f637affd700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637c0f6530 0x7f637c106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:12:47.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.764+0000 7f637a7fc700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637c0f77d0 0x7f637c107250 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f6370004320 tx=0x7f637000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:47.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.765+0000 7f63637fe700 1 -- 172.21.15.8:0/1102758083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6370019070 con 0x7f637c0f77d0 2023-10-18T22:12:47.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.765+0000 7f63637fe700 1 -- 172.21.15.8:0/1102758083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f637001e420 con 0x7f637c0f77d0 2023-10-18T22:12:47.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.765+0000 7f637bfff700 1 -- 172.21.15.8:0/1102758083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c108280 con 0x7f637c0f77d0 2023-10-18T22:12:47.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.765+0000 7f63637fe700 1 -- 172.21.15.8:0/1102758083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6370014660 con 0x7f637c0f77d0 2023-10-18T22:12:47.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.765+0000 7f637bfff700 1 -- 172.21.15.8:0/1102758083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c108760 con 0x7f637c0f77d0 2023-10-18T22:12:47.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.766+0000 7f637bfff700 1 -- 172.21.15.8:0/1102758083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c059100 con 0x7f637c0f77d0 2023-10-18T22:12:47.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.767+0000 7f63637fe700 1 -- 172.21.15.8:0/1102758083 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f637001e590 con 0x7f637c0f77d0 2023-10-18T22:12:47.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.768+0000 7f63637fe700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6364060f70 0x7f6364063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:47.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.768+0000 7f63637fe700 1 -- 172.21.15.8:0/1102758083 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f637007deb0 con 0x7f637c0f77d0 2023-10-18T22:12:47.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.768+0000 7f637affd700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6364060f70 0x7f6364063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:47.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.768+0000 7f637affd700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6364060f70 0x7f6364063430 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f636c009da0 tx=0x7f636c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:47.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.772+0000 7f63637fe700 1 -- 172.21.15.8:0/1102758083 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f637004da00 con 0x7f637c0f77d0 2023-10-18T22:12:47.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.970+0000 7f637bfff700 1 -- 172.21.15.8:0/1102758083 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f637c0008d0 con 0x7f6364060f70 2023-10-18T22:12:47.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.971+0000 7f63637fe700 1 -- 172.21.15.8:0/1102758083 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f637c0008d0 con 0x7f6364060f70 2023-10-18T22:12:47.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 -- 172.21.15.8:0/1102758083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6364060f70 msgr2=0x7f6364063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:47.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6364060f70 0x7f6364063430 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f636c009da0 tx=0x7f636c00b040).stop 2023-10-18T22:12:47.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 -- 172.21.15.8:0/1102758083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637c0f77d0 msgr2=0x7f637c107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:47.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637c0f77d0 0x7f637c107250 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f6370004320 tx=0x7f637000b040).stop 2023-10-18T22:12:47.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 -- 172.21.15.8:0/1102758083 shutdown_connections 2023-10-18T22:12:47.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6364060f70 0x7f6364063430 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637c0f6530 0x7f637c106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 --2- 172.21.15.8:0/1102758083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637c0f77d0 0x7f637c107250 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:47.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 -- 172.21.15.8:0/1102758083 >> 172.21.15.8:0/1102758083 conn(0x7f637c0f1c90 msgr2=0x7f637c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:47.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 -- 172.21.15.8:0/1102758083 shutdown_connections 2023-10-18T22:12:47.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:47.973+0000 7f637bfff700 1 -- 172.21.15.8:0/1102758083 wait complete. 2023-10-18T22:12:48.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.112+0000 7fcbe355e700 1 -- 172.21.15.8:0/3411829310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbdc0f6530 msgr2=0x7fcbdc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:48.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.112+0000 7fcbe355e700 1 --2- 172.21.15.8:0/3411829310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbdc0f6530 0x7fcbdc0f6950 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7fcbd8004660 tx=0x7fcbd8009b30).stop 2023-10-18T22:12:48.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.112+0000 7fcbe355e700 1 -- 172.21.15.8:0/3411829310 shutdown_connections 2023-10-18T22:12:48.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.112+0000 7fcbe355e700 1 --2- 172.21.15.8:0/3411829310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbdc0f77d0 0x7fcbdc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.112+0000 7fcbe355e700 1 --2- 172.21.15.8:0/3411829310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbdc0f6530 0x7fcbdc0f6950 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.112+0000 7fcbe355e700 1 -- 172.21.15.8:0/3411829310 >> 172.21.15.8:0/3411829310 conn(0x7fcbdc0f1c90 msgr2=0x7fcbdc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:48.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.112+0000 7fcbe355e700 1 -- 172.21.15.8:0/3411829310 shutdown_connections 2023-10-18T22:12:48.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.112+0000 7fcbe355e700 1 -- 172.21.15.8:0/3411829310 wait complete. 2023-10-18T22:12:48.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.113+0000 7fcbe355e700 1 Processor -- start 2023-10-18T22:12:48.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.113+0000 7fcbe355e700 1 -- start start 2023-10-18T22:12:48.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.113+0000 7fcbe355e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbdc0f6530 0x7fcbdc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:48.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.113+0000 7fcbe355e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbdc0f77d0 0x7fcbdc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:48.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.113+0000 7fcbe355e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc107880 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.113+0000 7fcbe355e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc1080c0 con 0x7fcbdc0f6530 2023-10-18T22:12:48.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.113+0000 7fcbe1d5b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbdc0f77d0 0x7fcbdc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:48.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.113+0000 7fcbe1d5b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbdc0f77d0 0x7fcbdc107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48828/0 (socket says 172.21.15.8:48828) 2023-10-18T22:12:48.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.113+0000 7fcbe1d5b700 1 -- 172.21.15.8:0/3844407920 learned_addr learned my addr 172.21.15.8:0/3844407920 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:48.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.113+0000 7fcbe255c700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbdc0f6530 0x7fcbdc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:48.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.114+0000 7fcbe1d5b700 1 -- 172.21.15.8:0/3844407920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbdc0f6530 msgr2=0x7fcbdc106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:48.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.114+0000 7fcbe1d5b700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbdc0f6530 0x7fcbdc106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.114+0000 7fcbe1d5b700 1 -- 172.21.15.8:0/3844407920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8005040 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.114+0000 7fcbe1d5b700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbdc0f77d0 0x7fcbdc107280 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fcbcc00e7f0 tx=0x7fcbcc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:48.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.114+0000 7fcbd2ffd700 1 -- 172.21.15.8:0/3844407920 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbcc0092e0 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.114+0000 7fcbe355e700 1 -- 172.21.15.8:0/3844407920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbdc1083a0 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.114+0000 7fcbd2ffd700 1 -- 172.21.15.8:0/3844407920 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcbcc00f040 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.114+0000 7fcbd2ffd700 1 -- 172.21.15.8:0/3844407920 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbcc0147e0 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.114+0000 7fcbe355e700 1 -- 172.21.15.8:0/3844407920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc1088e0 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.116+0000 7fcbe355e700 1 -- 172.21.15.8:0/3844407920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc059100 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.117+0000 7fcbd2ffd700 1 -- 172.21.15.8:0/3844407920 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcbcc01b030 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.117+0000 7fcbd2ffd700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcbc8060f70 0x7fcbc8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:48.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.117+0000 7fcbd2ffd700 1 -- 172.21.15.8:0/3844407920 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcbcc07c700 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.118+0000 7fcbe255c700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcbc8060f70 0x7fcbc8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:48.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.118+0000 7fcbe255c700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcbc8060f70 0x7fcbc8063430 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fcbd8004d80 tx=0x7fcbd8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:48.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.122+0000 7fcbd2ffd700 1 -- 172.21.15.8:0/3844407920 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcbcc04c420 con 0x7fcbdc0f77d0 2023-10-18T22:12:48.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.315+0000 7fcbe355e700 1 -- 172.21.15.8:0/3844407920 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbdc0fed80 con 0x7fcbc8060f70 2023-10-18T22:12:48.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.324+0000 7fcbd2ffd700 1 -- 172.21.15.8:0/3844407920 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcbdc0fed80 con 0x7fcbc8060f70 2023-10-18T22:12:48.327 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:12:48.327 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (79m) 6m ago 80m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:12:48.327 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (73m) 6m ago 80m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:12:48.327 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (73m) 4m ago 80m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:12:48.328 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (79m) 6m ago 80m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:12:48.328 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 76m - - 2023-10-18T22:12:48.328 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 76m - - 2023-10-18T22:12:48.328 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 76m - - 2023-10-18T22:12:48.329 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 76m - - 2023-10-18T22:12:48.329 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (74m) 6m ago 82m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:12:48.329 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (73m) 4m ago 80m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:12:48.329 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (73m) 6m ago 82m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:12:48.329 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (73m) 4m ago 79m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:12:48.329 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (80m) 6m ago 80m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:12:48.330 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (79m) 4m ago 79m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:12:48.330 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (73m) 6m ago 79m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:12:48.330 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (71m) 6m ago 79m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:12:48.330 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (70m) 6m ago 78m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:12:48.330 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (70m) 4m ago 78m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:12:48.331 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (69m) 4m ago 78m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:12:48.331 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (68m) 4m ago 78m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:12:48.331 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (74m) 6m ago 80m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:12:48.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.326+0000 7fcbe355e700 1 -- 172.21.15.8:0/3844407920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcbc8060f70 msgr2=0x7fcbc8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:48.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.326+0000 7fcbe355e700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcbc8060f70 0x7fcbc8063430 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fcbd8004d80 tx=0x7fcbd8016040).stop 2023-10-18T22:12:48.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.326+0000 7fcbe355e700 1 -- 172.21.15.8:0/3844407920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbdc0f77d0 msgr2=0x7fcbdc107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:48.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.326+0000 7fcbe355e700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbdc0f77d0 0x7fcbdc107280 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fcbcc00e7f0 tx=0x7fcbcc00b040).stop 2023-10-18T22:12:48.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.327+0000 7fcbe355e700 1 -- 172.21.15.8:0/3844407920 shutdown_connections 2023-10-18T22:12:48.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.327+0000 7fcbe355e700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcbc8060f70 0x7fcbc8063430 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.327+0000 7fcbe355e700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbdc0f6530 0x7fcbdc106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.327+0000 7fcbe355e700 1 --2- 172.21.15.8:0/3844407920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbdc0f77d0 0x7fcbdc107280 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.327+0000 7fcbe355e700 1 -- 172.21.15.8:0/3844407920 >> 172.21.15.8:0/3844407920 conn(0x7fcbdc0f1c90 msgr2=0x7fcbdc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:48.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.327+0000 7fcbe355e700 1 -- 172.21.15.8:0/3844407920 shutdown_connections 2023-10-18T22:12:48.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.327+0000 7fcbe355e700 1 -- 172.21.15.8:0/3844407920 wait complete. 2023-10-18T22:12:48.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.462+0000 7f0da25a4700 1 -- 172.21.15.8:0/73619084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d9c0f9690 msgr2=0x7f0d9c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:48.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.462+0000 7f0da25a4700 1 --2- 172.21.15.8:0/73619084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d9c0f9690 0x7f0d9c0fbae0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f0d8c004660 tx=0x7f0d8c009b30).stop 2023-10-18T22:12:48.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.462+0000 7f0da25a4700 1 -- 172.21.15.8:0/73619084 shutdown_connections 2023-10-18T22:12:48.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.462+0000 7f0da25a4700 1 --2- 172.21.15.8:0/73619084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d9c0f9690 0x7f0d9c0fbae0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.462+0000 7f0da25a4700 1 --2- 172.21.15.8:0/73619084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d9c060310 0x7f0d9c0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.462+0000 7f0da25a4700 1 -- 172.21.15.8:0/73619084 >> 172.21.15.8:0/73619084 conn(0x7f0d9c0f0b90 msgr2=0x7f0d9c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:48.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.462+0000 7f0da25a4700 1 -- 172.21.15.8:0/73619084 shutdown_connections 2023-10-18T22:12:48.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.462+0000 7f0da25a4700 1 -- 172.21.15.8:0/73619084 wait complete. 2023-10-18T22:12:48.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.463+0000 7f0da25a4700 1 Processor -- start 2023-10-18T22:12:48.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.463+0000 7f0da25a4700 1 -- start start 2023-10-18T22:12:48.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.463+0000 7f0da25a4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d9c060310 0x7f0d9c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:48.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.463+0000 7f0da25a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d9c0f9690 0x7f0d9c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:48.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.463+0000 7f0da25a4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c109a20 con 0x7f0d9c060310 2023-10-18T22:12:48.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.463+0000 7f0da25a4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c109b60 con 0x7f0d9c0f9690 2023-10-18T22:12:48.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.464+0000 7f0da15a2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d9c060310 0x7f0d9c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.464+0000 7f0da15a2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d9c060310 0x7f0d9c108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48848/0 (socket says 172.21.15.8:48848) 2023-10-18T22:12:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.464+0000 7f0da15a2700 1 -- 172.21.15.8:0/374333410 learned_addr learned my addr 172.21.15.8:0/374333410 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.464+0000 7f0da0da1700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d9c0f9690 0x7f0d9c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.464+0000 7f0da15a2700 1 -- 172.21.15.8:0/374333410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d9c0f9690 msgr2=0x7f0d9c109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.464+0000 7f0da15a2700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d9c0f9690 0x7f0d9c109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.464+0000 7f0da15a2700 1 -- 172.21.15.8:0/374333410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c005040 con 0x7f0d9c060310 2023-10-18T22:12:48.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.464+0000 7f0da15a2700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d9c060310 0x7f0d9c108f80 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f0d980026d0 tx=0x7f0d98009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:48.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.464+0000 7f0d91ffb700 1 -- 172.21.15.8:0/374333410 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d980079c0 con 0x7f0d9c060310 2023-10-18T22:12:48.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.465+0000 7f0d91ffb700 1 -- 172.21.15.8:0/374333410 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0d9800f040 con 0x7f0d9c060310 2023-10-18T22:12:48.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.465+0000 7f0d91ffb700 1 -- 172.21.15.8:0/374333410 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d98014980 con 0x7f0d9c060310 2023-10-18T22:12:48.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.465+0000 7f0da25a4700 1 -- 172.21.15.8:0/374333410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9c10a500 con 0x7f0d9c060310 2023-10-18T22:12:48.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.465+0000 7f0da25a4700 1 -- 172.21.15.8:0/374333410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9c10aac0 con 0x7f0d9c060310 2023-10-18T22:12:48.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.466+0000 7f0da25a4700 1 -- 172.21.15.8:0/374333410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9c045ad0 con 0x7f0d9c060310 2023-10-18T22:12:48.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.467+0000 7f0d91ffb700 1 -- 172.21.15.8:0/374333410 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0d980090d0 con 0x7f0d9c060310 2023-10-18T22:12:48.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.467+0000 7f0d91ffb700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 0x7f0d88063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:48.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.468+0000 7f0d91ffb700 1 -- 172.21.15.8:0/374333410 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0d9807c980 con 0x7f0d9c060310 2023-10-18T22:12:48.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.468+0000 7f0da0da1700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 0x7f0d88063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:48.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.468+0000 7f0da0da1700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 0x7f0d88063430 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f0d8c004630 tx=0x7f0d8c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:48.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.471+0000 7f0d91ffb700 1 -- 172.21.15.8:0/374333410 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0d98050010 con 0x7f0d9c060310 2023-10-18T22:12:48.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.723+0000 7f0da25a4700 1 -- 172.21.15.8:0/374333410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0d9c10b160 con 0x7f0d9c060310 2023-10-18T22:12:48.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.724+0000 7f0d91ffb700 1 -- 172.21.15.8:0/374333410 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f0d9804fc00 con 0x7f0d9c060310 2023-10-18T22:12:48.727 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:12:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:12:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:12:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:12:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:12:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:12:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:12:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:12:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:12:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:12:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:12:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:12:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:12:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:12:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:12:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:12:48.731 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:12:48.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 -- 172.21.15.8:0/374333410 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 msgr2=0x7f0d88063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:48.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 0x7f0d88063430 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f0d8c004630 tx=0x7f0d8c009b30).stop 2023-10-18T22:12:48.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 -- 172.21.15.8:0/374333410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d9c060310 msgr2=0x7f0d9c108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:48.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d9c060310 0x7f0d9c108f80 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f0d980026d0 tx=0x7f0d98009de0).stop 2023-10-18T22:12:48.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 -- 172.21.15.8:0/374333410 shutdown_connections 2023-10-18T22:12:48.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0d88060f70 0x7f0d88063430 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d9c060310 0x7f0d9c108f80 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 --2- 172.21.15.8:0/374333410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d9c0f9690 0x7f0d9c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 -- 172.21.15.8:0/374333410 >> 172.21.15.8:0/374333410 conn(0x7f0d9c0f0b90 msgr2=0x7f0d9c0f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:48.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 -- 172.21.15.8:0/374333410 shutdown_connections 2023-10-18T22:12:48.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.726+0000 7f0da25a4700 1 -- 172.21.15.8:0/374333410 wait complete. 2023-10-18T22:12:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.865+0000 7fbcff59e700 1 -- 172.21.15.8:0/2950677432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f9690 msgr2=0x7fbd000fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.865+0000 7fbcff59e700 1 --2- 172.21.15.8:0/2950677432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f9690 0x7fbd000fbae0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7fbcf4004660 tx=0x7fbcf4009b30).stop 2023-10-18T22:12:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.865+0000 7fbcff59e700 1 -- 172.21.15.8:0/2950677432 shutdown_connections 2023-10-18T22:12:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.865+0000 7fbcff59e700 1 --2- 172.21.15.8:0/2950677432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd000f9690 0x7fbd000fbae0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.865+0000 7fbcff59e700 1 --2- 172.21.15.8:0/2950677432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd00060310 0x7fbd000f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.865+0000 7fbcff59e700 1 -- 172.21.15.8:0/2950677432 >> 172.21.15.8:0/2950677432 conn(0x7fbd000f0b90 msgr2=0x7fbd000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:48.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.865+0000 7fbcff59e700 1 -- 172.21.15.8:0/2950677432 shutdown_connections 2023-10-18T22:12:48.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.865+0000 7fbcff59e700 1 -- 172.21.15.8:0/2950677432 wait complete. 2023-10-18T22:12:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.866+0000 7fbcff59e700 1 Processor -- start 2023-10-18T22:12:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.866+0000 7fbcff59e700 1 -- start start 2023-10-18T22:12:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcff59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd00060310 0x7fbd00106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcff59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f9690 0x7fbd00107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcff59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd00107840 con 0x7fbd00060310 2023-10-18T22:12:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcff59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd00108050 con 0x7fbd000f9690 2023-10-18T22:12:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcfe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd00060310 0x7fbd00106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcfe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd00060310 0x7fbd00106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48858/0 (socket says 172.21.15.8:48858) 2023-10-18T22:12:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcfe59c700 1 -- 172.21.15.8:0/454629036 learned_addr learned my addr 172.21.15.8:0/454629036 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:48.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcfdd9b700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f9690 0x7fbd00107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:48.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcfe59c700 1 -- 172.21.15.8:0/454629036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f9690 msgr2=0x7fbd00107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:48.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcfe59c700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f9690 0x7fbd00107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:48.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcfe59c700 1 -- 172.21.15.8:0/454629036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf4005040 con 0x7fbd00060310 2023-10-18T22:12:48.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.867+0000 7fbcfdd9b700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f9690 0x7fbd00107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:12:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.868+0000 7fbcfe59c700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd00060310 0x7fbd00106d50 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fbcf000e7f0 tx=0x7fbcf000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.868+0000 7fbceeffd700 1 -- 172.21.15.8:0/454629036 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcf00092e0 con 0x7fbd00060310 2023-10-18T22:12:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.868+0000 7fbceeffd700 1 -- 172.21.15.8:0/454629036 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbcf000f040 con 0x7fbd00060310 2023-10-18T22:12:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.868+0000 7fbceeffd700 1 -- 172.21.15.8:0/454629036 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcf00147e0 con 0x7fbd00060310 2023-10-18T22:12:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.868+0000 7fbcff59e700 1 -- 172.21.15.8:0/454629036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd001082d0 con 0x7fbd00060310 2023-10-18T22:12:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.868+0000 7fbcff59e700 1 -- 172.21.15.8:0/454629036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd00108810 con 0x7fbd00060310 2023-10-18T22:12:48.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.869+0000 7fbcff59e700 1 -- 172.21.15.8:0/454629036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd00059100 con 0x7fbd00060310 2023-10-18T22:12:48.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.870+0000 7fbceeffd700 1 -- 172.21.15.8:0/454629036 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbcf001b030 con 0x7fbd00060310 2023-10-18T22:12:48.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.871+0000 7fbceeffd700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbce8060f70 0x7fbce8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.871+0000 7fbceeffd700 1 -- 172.21.15.8:0/454629036 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbcf007c7f0 con 0x7fbd00060310 2023-10-18T22:12:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.872+0000 7fbcfdd9b700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbce8060f70 0x7fbce8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.872+0000 7fbcfdd9b700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbce8060f70 0x7fbce8063430 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fbcf40043d0 tx=0x7fbcf400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:48.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:48.876+0000 7fbceeffd700 1 -- 172.21.15.8:0/454629036 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbcf004c450 con 0x7fbd00060310 2023-10-18T22:12:49.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.104+0000 7fbcff59e700 1 -- 172.21.15.8:0/454629036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbd000fecf0 con 0x7fbd00060310 2023-10-18T22:12:49.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.105+0000 7fbceeffd700 1 -- 172.21.15.8:0/454629036 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fbcf0019070 con 0x7fbd00060310 2023-10-18T22:12:49.107 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:12:49.108 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:12:49.108 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:12:49.108 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:12:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:12:49.108 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:12:49.109 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:12:49.109 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:12:49.109 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:12:49.109 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:12:49.109 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:12:49.110 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:12:49.110 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:12:49.110 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:12:49.110 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:12:49.110 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:12:49.111 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:12:49.111 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:12:49.111 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:12:49.111 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:12:49.111 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:12:49.112 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:12:49.112 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:12:49.112 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:12:49.112 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:12:49.112 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:12:49.112 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:12:49.113 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:12:49.113 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:12:49.113 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:12:49.113 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:12:49.113 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:12:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:12:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:12:49.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 -- 172.21.15.8:0/454629036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbce8060f70 msgr2=0x7fbce8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:49.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbce8060f70 0x7fbce8063430 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fbcf40043d0 tx=0x7fbcf400b040).stop 2023-10-18T22:12:49.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 -- 172.21.15.8:0/454629036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd00060310 msgr2=0x7fbd00106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:49.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd00060310 0x7fbd00106d50 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fbcf000e7f0 tx=0x7fbcf000b040).stop 2023-10-18T22:12:49.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 -- 172.21.15.8:0/454629036 shutdown_connections 2023-10-18T22:12:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbce8060f70 0x7fbce8063430 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd00060310 0x7fbd00106d50 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 --2- 172.21.15.8:0/454629036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd000f9690 0x7fbd00107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 -- 172.21.15.8:0/454629036 >> 172.21.15.8:0/454629036 conn(0x7fbd000f0b90 msgr2=0x7fbd000f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 -- 172.21.15.8:0/454629036 shutdown_connections 2023-10-18T22:12:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.107+0000 7fbcff59e700 1 -- 172.21.15.8:0/454629036 wait complete. 2023-10-18T22:12:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:12:49.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.245+0000 7f49f2adb700 1 -- 172.21.15.8:0/3317709189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0f77d0 msgr2=0x7f49ec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:49.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.245+0000 7f49f2adb700 1 --2- 172.21.15.8:0/3317709189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0f77d0 0x7f49ec0f7c30 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f49dc004660 tx=0x7f49dc009b30).stop 2023-10-18T22:12:49.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.245+0000 7f49f2adb700 1 -- 172.21.15.8:0/3317709189 shutdown_connections 2023-10-18T22:12:49.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.245+0000 7f49f2adb700 1 --2- 172.21.15.8:0/3317709189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0f77d0 0x7f49ec0f7c30 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:49.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.245+0000 7f49f2adb700 1 --2- 172.21.15.8:0/3317709189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49ec0f6530 0x7f49ec0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:12:49.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.245+0000 7f49f2adb700 1 -- 172.21.15.8:0/3317709189 >> 172.21.15.8:0/3317709189 conn(0x7f49ec0f1c90 msgr2=0x7f49ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:49.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.245+0000 7f49f2adb700 1 -- 172.21.15.8:0/3317709189 shutdown_connections 2023-10-18T22:12:49.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.245+0000 7f49f2adb700 1 -- 172.21.15.8:0/3317709189 wait complete. 2023-10-18T22:12:49.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.246+0000 7f49f2adb700 1 Processor -- start 2023-10-18T22:12:49.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.246+0000 7f49f2adb700 1 -- start start 2023-10-18T22:12:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f2adb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49ec0f6530 0x7f49ec106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f2adb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0f77d0 0x7f49ec107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f2adb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec1079a0 con 0x7f49ec0f77d0 2023-10-18T22:12:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f2adb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec108120 con 0x7f49ec0f6530 2023-10-18T22:12:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f12d8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0f77d0 0x7f49ec107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f12d8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0f77d0 0x7f49ec107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48890/0 (socket says 172.21.15.8:48890) 2023-10-18T22:12:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f12d8700 1 -- 172.21.15.8:0/890196684 learned_addr learned my addr 172.21.15.8:0/890196684 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:12:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f12d8700 1 -- 172.21.15.8:0/890196684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49ec0f6530 msgr2=0x7f49ec106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f1ad9700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49ec0f6530 0x7f49ec106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f12d8700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49ec0f6530 0x7f49ec106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f12d8700 1 -- 172.21.15.8:0/890196684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc005040 con 0x7f49ec0f77d0 2023-10-18T22:12:49.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.247+0000 7f49f1ad9700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49ec0f6530 0x7f49ec106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:12:49.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.248+0000 7f49f12d8700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0f77d0 0x7f49ec107310 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f49dc009830 tx=0x7f49dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:49.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.248+0000 7f49e27fc700 1 -- 172.21.15.8:0/890196684 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49dc018070 con 0x7f49ec0f77d0 2023-10-18T22:12:49.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.248+0000 7f49e27fc700 1 -- 172.21.15.8:0/890196684 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f49dc01d8e0 con 0x7f49ec0f77d0 2023-10-18T22:12:49.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.248+0000 7f49e27fc700 1 -- 172.21.15.8:0/890196684 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49dc01c540 con 0x7f49ec0f77d0 2023-10-18T22:12:49.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.248+0000 7f49f2adb700 1 -- 172.21.15.8:0/890196684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec108340 con 0x7f49ec0f77d0 2023-10-18T22:12:49.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.248+0000 7f49f2adb700 1 -- 172.21.15.8:0/890196684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec1088a0 con 0x7f49ec0f77d0 2023-10-18T22:12:49.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.249+0000 7f49f2adb700 1 -- 172.21.15.8:0/890196684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec045ad0 con 0x7f49ec0f77d0 2023-10-18T22:12:49.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.250+0000 7f49e27fc700 1 -- 172.21.15.8:0/890196684 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f49dc01da50 con 0x7f49ec0f77d0 2023-10-18T22:12:49.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.251+0000 7f49e27fc700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49d8060f70 0x7f49d8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:12:49.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.251+0000 7f49e27fc700 1 -- 172.21.15.8:0/890196684 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f49dc07e700 con 0x7f49ec0f77d0 2023-10-18T22:12:49.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.251+0000 7f49f1ad9700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49d8060f70 0x7f49d8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:12:49.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.252+0000 7f49f1ad9700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49d8060f70 0x7f49d8063430 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f49ec106b90 tx=0x7f49e8008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:12:49.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.255+0000 7f49e27fc700 1 -- 172.21.15.8:0/890196684 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f49dc04e3f0 con 0x7f49ec0f77d0 2023-10-18T22:12:49.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.452+0000 7f49f2adb700 1 -- 172.21.15.8:0/890196684 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49ec108bd0 con 0x7f49d8060f70 2023-10-18T22:12:49.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.453+0000 7f49e27fc700 1 -- 172.21.15.8:0/890196684 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f49ec108bd0 con 0x7f49d8060f70 2023-10-18T22:12:49.455 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:12:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:12:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:12:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:12:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:12:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:12:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:12:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:12:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:12:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:12:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:12:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:12:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:12:49.458 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:12:49.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 -- 172.21.15.8:0/890196684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49d8060f70 msgr2=0x7f49d8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:49.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49d8060f70 0x7f49d8063430 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f49ec106b90 tx=0x7f49e8008040).stop 2023-10-18T22:12:49.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 -- 172.21.15.8:0/890196684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0f77d0 msgr2=0x7f49ec107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:12:49.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0f77d0 0x7f49ec107310 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f49dc009830 tx=0x7f49dc009b30).stop 2023-10-18T22:12:49.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 -- 172.21.15.8:0/890196684 shutdown_connections 2023-10-18T22:12:49.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f49d8060f70 0x7f49d8063430 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:49.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49ec0f6530 0x7f49ec106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:49.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 --2- 172.21.15.8:0/890196684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0f77d0 0x7f49ec107310 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:12:49.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 -- 172.21.15.8:0/890196684 >> 172.21.15.8:0/890196684 conn(0x7f49ec0f1c90 msgr2=0x7f49ec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:12:49.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 -- 172.21.15.8:0/890196684 shutdown_connections 2023-10-18T22:12:49.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:12:49.455+0000 7f49f2adb700 1 -- 172.21.15.8:0/890196684 wait complete. 2023-10-18T22:12:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:47.621811+0000 mgr.smithi008.flmjzp (mgr.14640) 4434 : audit [DBG] from='client.37576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:47.880759+0000 mgr.smithi008.flmjzp (mgr.14640) 4435 : cluster [DBG] pgmap v3044: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:47.972299+0000 mgr.smithi008.flmjzp (mgr.14640) 4436 : audit [DBG] from='client.37580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:48.317185+0000 mgr.smithi008.flmjzp (mgr.14640) 4437 : audit [DBG] from='client.37584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:49.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:48.725687+0000 mon.smithi008 (mon.0) 4735 : audit [DBG] from='client.? 172.21.15.8:0/374333410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:49.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:49.106435+0000 mon.smithi008 (mon.0) 4736 : audit [DBG] from='client.? 172.21.15.8:0/454629036' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:12:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:47.621811+0000 mgr.smithi008.flmjzp (mgr.14640) 4434 : audit [DBG] from='client.37576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:47.880759+0000 mgr.smithi008.flmjzp (mgr.14640) 4435 : cluster [DBG] pgmap v3044: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:47.972299+0000 mgr.smithi008.flmjzp (mgr.14640) 4436 : audit [DBG] from='client.37580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:48.317185+0000 mgr.smithi008.flmjzp (mgr.14640) 4437 : audit [DBG] from='client.37584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:48.725687+0000 mon.smithi008 (mon.0) 4735 : audit [DBG] from='client.? 172.21.15.8:0/374333410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:49.106435+0000 mon.smithi008 (mon.0) 4736 : audit [DBG] from='client.? 172.21.15.8:0/454629036' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:12:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:49.454539+0000 mgr.smithi008.flmjzp (mgr.14640) 4438 : audit [DBG] from='client.37596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:49.881315+0000 mgr.smithi008.flmjzp (mgr.14640) 4439 : cluster [DBG] pgmap v3045: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:49.454539+0000 mgr.smithi008.flmjzp (mgr.14640) 4438 : audit [DBG] from='client.37596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:12:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:49.881315+0000 mgr.smithi008.flmjzp (mgr.14640) 4439 : cluster [DBG] pgmap v3045: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:53.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:51.881830+0000 mgr.smithi008.flmjzp (mgr.14640) 4440 : cluster [DBG] pgmap v3046: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:51.881830+0000 mgr.smithi008.flmjzp (mgr.14640) 4440 : cluster [DBG] pgmap v3046: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:55.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:53.882608+0000 mgr.smithi008.flmjzp (mgr.14640) 4441 : cluster [DBG] pgmap v3047: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:53.882608+0000 mgr.smithi008.flmjzp (mgr.14640) 4441 : cluster [DBG] pgmap v3047: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:56.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:55.905730+0000 mon.smithi008 (mon.0) 4737 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:55.905730+0000 mon.smithi008 (mon.0) 4737 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:55.883256+0000 mgr.smithi008.flmjzp (mgr.14640) 4442 : cluster [DBG] pgmap v3048: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:56.480229+0000 mon.smithi008 (mon.0) 4738 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:57.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:56.481059+0000 mon.smithi008 (mon.0) 4739 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:56.486381+0000 mon.smithi008 (mon.0) 4740 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:56.492387+0000 mon.smithi008 (mon.0) 4741 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:56.495034+0000 mon.smithi008 (mon.0) 4742 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:56.496552+0000 mon.smithi008 (mon.0) 4743 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:57.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:56.497965+0000 mon.smithi008 (mon.0) 4744 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:57.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:12:56.499924+0000 mon.smithi008 (mon.0) 4745 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:55.883256+0000 mgr.smithi008.flmjzp (mgr.14640) 4442 : cluster [DBG] pgmap v3048: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:56.480229+0000 mon.smithi008 (mon.0) 4738 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:12:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:56.481059+0000 mon.smithi008 (mon.0) 4739 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:12:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:56.486381+0000 mon.smithi008 (mon.0) 4740 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:12:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:56.492387+0000 mon.smithi008 (mon.0) 4741 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:12:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:56.495034+0000 mon.smithi008 (mon.0) 4742 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:56.496552+0000 mon.smithi008 (mon.0) 4743 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:56.497965+0000 mon.smithi008 (mon.0) 4744 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:12:56.499924+0000 mon.smithi008 (mon.0) 4745 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:12:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:56.481680+0000 mgr.smithi008.flmjzp (mgr.14640) 4443 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:56.482176+0000 mgr.smithi008.flmjzp (mgr.14640) 4444 : cluster [DBG] pgmap v3049: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:56.482387+0000 mgr.smithi008.flmjzp (mgr.14640) 4445 : cluster [DBG] pgmap v3050: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:58.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:12:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:12:56.501598+0000 mgr.smithi008.flmjzp (mgr.14640) 4446 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:12:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:56.481680+0000 mgr.smithi008.flmjzp (mgr.14640) 4443 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:12:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:56.482176+0000 mgr.smithi008.flmjzp (mgr.14640) 4444 : cluster [DBG] pgmap v3049: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:56.482387+0000 mgr.smithi008.flmjzp (mgr.14640) 4445 : cluster [DBG] pgmap v3050: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:12:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:12:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:12:56.501598+0000 mgr.smithi008.flmjzp (mgr.14640) 4446 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:00.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:12:58.482863+0000 mgr.smithi008.flmjzp (mgr.14640) 4447 : cluster [DBG] pgmap v3051: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:12:58.482863+0000 mgr.smithi008.flmjzp (mgr.14640) 4447 : cluster [DBG] pgmap v3051: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:02.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:00.483410+0000 mgr.smithi008.flmjzp (mgr.14640) 4448 : cluster [DBG] pgmap v3052: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:00.483410+0000 mgr.smithi008.flmjzp (mgr.14640) 4448 : cluster [DBG] pgmap v3052: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:04.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:02.483965+0000 mgr.smithi008.flmjzp (mgr.14640) 4449 : cluster [DBG] pgmap v3053: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:02.483965+0000 mgr.smithi008.flmjzp (mgr.14640) 4449 : cluster [DBG] pgmap v3053: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:06.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:04.484612+0000 mgr.smithi008.flmjzp (mgr.14640) 4450 : cluster [DBG] pgmap v3054: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:04.484612+0000 mgr.smithi008.flmjzp (mgr.14640) 4450 : cluster [DBG] pgmap v3054: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:06.512273+0000 mon.smithi008 (mon.0) 4746 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:06.514415+0000 mon.smithi008 (mon.0) 4747 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:06.515524+0000 mon.smithi008 (mon.0) 4748 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:06.522012+0000 mon.smithi008 (mon.0) 4749 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:06.530072+0000 mon.smithi008 (mon.0) 4750 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:06.533688+0000 mon.smithi008 (mon.0) 4751 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:06.535584+0000 mon.smithi008 (mon.0) 4752 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:07.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:06.537479+0000 mon.smithi008 (mon.0) 4753 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:07.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:06.540162+0000 mon.smithi008 (mon.0) 4754 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:06.512273+0000 mon.smithi008 (mon.0) 4746 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:06.514415+0000 mon.smithi008 (mon.0) 4747 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:06.515524+0000 mon.smithi008 (mon.0) 4748 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:06.522012+0000 mon.smithi008 (mon.0) 4749 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:06.530072+0000 mon.smithi008 (mon.0) 4750 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:06.533688+0000 mon.smithi008 (mon.0) 4751 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:06.535584+0000 mon.smithi008 (mon.0) 4752 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:06.537479+0000 mon.smithi008 (mon.0) 4753 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:06.540162+0000 mon.smithi008 (mon.0) 4754 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:06.485069+0000 mgr.smithi008.flmjzp (mgr.14640) 4451 : cluster [DBG] pgmap v3055: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:06.516422+0000 mgr.smithi008.flmjzp (mgr.14640) 4452 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:06.517026+0000 mgr.smithi008.flmjzp (mgr.14640) 4453 : cluster [DBG] pgmap v3056: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:06.517330+0000 mgr.smithi008.flmjzp (mgr.14640) 4454 : cluster [DBG] pgmap v3057: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:06.542290+0000 mgr.smithi008.flmjzp (mgr.14640) 4455 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:06.485069+0000 mgr.smithi008.flmjzp (mgr.14640) 4451 : cluster [DBG] pgmap v3055: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:06.516422+0000 mgr.smithi008.flmjzp (mgr.14640) 4452 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:06.517026+0000 mgr.smithi008.flmjzp (mgr.14640) 4453 : cluster [DBG] pgmap v3056: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:06.517330+0000 mgr.smithi008.flmjzp (mgr.14640) 4454 : cluster [DBG] pgmap v3057: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:06.542290+0000 mgr.smithi008.flmjzp (mgr.14640) 4455 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:08.517840+0000 mgr.smithi008.flmjzp (mgr.14640) 4456 : cluster [DBG] pgmap v3058: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:08.517840+0000 mgr.smithi008.flmjzp (mgr.14640) 4456 : cluster [DBG] pgmap v3058: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:10.518438+0000 mgr.smithi008.flmjzp (mgr.14640) 4457 : cluster [DBG] pgmap v3059: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:10.518438+0000 mgr.smithi008.flmjzp (mgr.14640) 4457 : cluster [DBG] pgmap v3059: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:12.519017+0000 mgr.smithi008.flmjzp (mgr.14640) 4458 : cluster [DBG] pgmap v3060: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:12.519017+0000 mgr.smithi008.flmjzp (mgr.14640) 4458 : cluster [DBG] pgmap v3060: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:14.519534+0000 mgr.smithi008.flmjzp (mgr.14640) 4459 : cluster [DBG] pgmap v3061: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:14.519534+0000 mgr.smithi008.flmjzp (mgr.14640) 4459 : cluster [DBG] pgmap v3061: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:16.546549+0000 mon.smithi008 (mon.0) 4755 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:17.103046+0000 mon.smithi008 (mon.0) 4756 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:17.104178+0000 mon.smithi008 (mon.0) 4757 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:17.111108+0000 mon.smithi008 (mon.0) 4758 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:17.117402+0000 mon.smithi008 (mon.0) 4759 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:17.122036+0000 mon.smithi008 (mon.0) 4760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:17.123785+0000 mon.smithi008 (mon.0) 4761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:17.125407+0000 mon.smithi008 (mon.0) 4762 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:17.127484+0000 mon.smithi008 (mon.0) 4763 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:16.546549+0000 mon.smithi008 (mon.0) 4755 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:17.103046+0000 mon.smithi008 (mon.0) 4756 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:17.104178+0000 mon.smithi008 (mon.0) 4757 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:17.111108+0000 mon.smithi008 (mon.0) 4758 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:17.117402+0000 mon.smithi008 (mon.0) 4759 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:17.122036+0000 mon.smithi008 (mon.0) 4760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:17.123785+0000 mon.smithi008 (mon.0) 4761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:17.125407+0000 mon.smithi008 (mon.0) 4762 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:17.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:17.127484+0000 mon.smithi008 (mon.0) 4763 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:16.520003+0000 mgr.smithi008.flmjzp (mgr.14640) 4460 : cluster [DBG] pgmap v3062: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:17.105064+0000 mgr.smithi008.flmjzp (mgr.14640) 4461 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:17.105702+0000 mgr.smithi008.flmjzp (mgr.14640) 4462 : cluster [DBG] pgmap v3063: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:17.106019+0000 mgr.smithi008.flmjzp (mgr.14640) 4463 : cluster [DBG] pgmap v3064: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:17.129500+0000 mgr.smithi008.flmjzp (mgr.14640) 4464 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:16.520003+0000 mgr.smithi008.flmjzp (mgr.14640) 4460 : cluster [DBG] pgmap v3062: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:17.105064+0000 mgr.smithi008.flmjzp (mgr.14640) 4461 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:17.105702+0000 mgr.smithi008.flmjzp (mgr.14640) 4462 : cluster [DBG] pgmap v3063: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:17.106019+0000 mgr.smithi008.flmjzp (mgr.14640) 4463 : cluster [DBG] pgmap v3064: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:18.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:17.129500+0000 mgr.smithi008.flmjzp (mgr.14640) 4464 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:19.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.609+0000 7ff85b59e700 1 -- 172.21.15.8:0/2412141692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff85c0f6530 msgr2=0x7ff85c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:19.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.609+0000 7ff85b59e700 1 --2- 172.21.15.8:0/2412141692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff85c0f6530 0x7ff85c0f6950 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7ff84c004660 tx=0x7ff84c009b30).stop 2023-10-18T22:13:19.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.609+0000 7ff85b59e700 1 -- 172.21.15.8:0/2412141692 shutdown_connections 2023-10-18T22:13:19.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.609+0000 7ff85b59e700 1 --2- 172.21.15.8:0/2412141692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85c0f77d0 0x7ff85c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.609+0000 7ff85b59e700 1 --2- 172.21.15.8:0/2412141692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff85c0f6530 0x7ff85c0f6950 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.609+0000 7ff85b59e700 1 -- 172.21.15.8:0/2412141692 >> 172.21.15.8:0/2412141692 conn(0x7ff85c0f1c90 msgr2=0x7ff85c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.609+0000 7ff85b59e700 1 -- 172.21.15.8:0/2412141692 shutdown_connections 2023-10-18T22:13:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.609+0000 7ff85b59e700 1 -- 172.21.15.8:0/2412141692 wait complete. 2023-10-18T22:13:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.610+0000 7ff85b59e700 1 Processor -- start 2023-10-18T22:13:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.610+0000 7ff85b59e700 1 -- start start 2023-10-18T22:13:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff85c0f6530 0x7ff85c108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85c0f77d0 0x7ff85c1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c109a60 con 0x7ff85c0f6530 2023-10-18T22:13:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c109ba0 con 0x7ff85c0f77d0 2023-10-18T22:13:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff85c0f6530 0x7ff85c108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff85c0f6530 0x7ff85c108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54062/0 (socket says 172.21.15.8:54062) 2023-10-18T22:13:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85a59c700 1 -- 172.21.15.8:0/2880444123 learned_addr learned my addr 172.21.15.8:0/2880444123 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff859d9b700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85c0f77d0 0x7ff85c1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85a59c700 1 -- 172.21.15.8:0/2880444123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85c0f77d0 msgr2=0x7ff85c1094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85a59c700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85c0f77d0 0x7ff85c1094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85a59c700 1 -- 172.21.15.8:0/2880444123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c005040 con 0x7ff85c0f6530 2023-10-18T22:13:19.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.611+0000 7ff85a59c700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff85c0f6530 0x7ff85c108fc0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7ff84c007a60 tx=0x7ff84c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:19.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.612+0000 7ff84affd700 1 -- 172.21.15.8:0/2880444123 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff84c018070 con 0x7ff85c0f6530 2023-10-18T22:13:19.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.612+0000 7ff84affd700 1 -- 172.21.15.8:0/2880444123 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff84c009630 con 0x7ff85c0f6530 2023-10-18T22:13:19.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.612+0000 7ff85b59e700 1 -- 172.21.15.8:0/2880444123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85c10a4e0 con 0x7ff85c0f6530 2023-10-18T22:13:19.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.612+0000 7ff84affd700 1 -- 172.21.15.8:0/2880444123 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff84c01c540 con 0x7ff85c0f6530 2023-10-18T22:13:19.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.612+0000 7ff85b59e700 1 -- 172.21.15.8:0/2880444123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85c10aa40 con 0x7ff85c0f6530 2023-10-18T22:13:19.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.613+0000 7ff85b59e700 1 -- 172.21.15.8:0/2880444123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85c045ad0 con 0x7ff85c0f6530 2023-10-18T22:13:19.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.614+0000 7ff84affd700 1 -- 172.21.15.8:0/2880444123 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff84c01c7b0 con 0x7ff85c0f6530 2023-10-18T22:13:19.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.615+0000 7ff84affd700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 0x7ff844063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:19.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.615+0000 7ff84affd700 1 -- 172.21.15.8:0/2880444123 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff84c07e750 con 0x7ff85c0f6530 2023-10-18T22:13:19.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.615+0000 7ff859d9b700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 0x7ff844063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.615+0000 7ff859d9b700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 0x7ff844063430 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7ff8500096c0 tx=0x7ff850009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.619+0000 7ff84affd700 1 -- 172.21.15.8:0/2880444123 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff84c051d30 con 0x7ff85c0f6530 2023-10-18T22:13:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.817+0000 7ff85b59e700 1 -- 172.21.15.8:0/2880444123 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff85c10ac60 con 0x7ff844060f70 2023-10-18T22:13:19.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.819+0000 7ff84affd700 1 -- 172.21.15.8:0/2880444123 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff85c10ac60 con 0x7ff844060f70 2023-10-18T22:13:19.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 -- 172.21.15.8:0/2880444123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 msgr2=0x7ff844063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:19.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 0x7ff844063430 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7ff8500096c0 tx=0x7ff850009be0).stop 2023-10-18T22:13:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 -- 172.21.15.8:0/2880444123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff85c0f6530 msgr2=0x7ff85c108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff85c0f6530 0x7ff85c108fc0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7ff84c007a60 tx=0x7ff84c009b30).stop 2023-10-18T22:13:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 -- 172.21.15.8:0/2880444123 shutdown_connections 2023-10-18T22:13:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff844060f70 0x7ff844063430 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff85c0f6530 0x7ff85c108fc0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 --2- 172.21.15.8:0/2880444123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85c0f77d0 0x7ff85c1094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 -- 172.21.15.8:0/2880444123 >> 172.21.15.8:0/2880444123 conn(0x7ff85c0f1c90 msgr2=0x7ff85c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 -- 172.21.15.8:0/2880444123 shutdown_connections 2023-10-18T22:13:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.821+0000 7ff85b59e700 1 -- 172.21.15.8:0/2880444123 wait complete. 2023-10-18T22:13:19.838 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:13:19.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.958+0000 7f39459cf700 1 -- 172.21.15.8:0/335592259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39400f6530 msgr2=0x7f39400f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:19.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.958+0000 7f39459cf700 1 --2- 172.21.15.8:0/335592259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39400f6530 0x7f39400f6950 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f3934004660 tx=0x7f3934009b30).stop 2023-10-18T22:13:19.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.958+0000 7f39459cf700 1 -- 172.21.15.8:0/335592259 shutdown_connections 2023-10-18T22:13:19.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.958+0000 7f39459cf700 1 --2- 172.21.15.8:0/335592259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400f77d0 0x7f39400f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:19.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.958+0000 7f39459cf700 1 --2- 172.21.15.8:0/335592259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39400f6530 0x7f39400f6950 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:19.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.958+0000 7f39459cf700 1 -- 172.21.15.8:0/335592259 >> 172.21.15.8:0/335592259 conn(0x7f39400f1c90 msgr2=0x7f39400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:19.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.959+0000 7f39459cf700 1 -- 172.21.15.8:0/335592259 shutdown_connections 2023-10-18T22:13:19.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.959+0000 7f39459cf700 1 -- 172.21.15.8:0/335592259 wait complete. 2023-10-18T22:13:19.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.959+0000 7f39459cf700 1 Processor -- start 2023-10-18T22:13:19.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.960+0000 7f39459cf700 1 -- start start 2023-10-18T22:13:19.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.960+0000 7f39459cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39400f6530 0x7f3940106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:19.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.960+0000 7f39459cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400f77d0 0x7f3940107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:19.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.960+0000 7f39459cf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940107910 con 0x7f39400f6530 2023-10-18T22:13:19.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.960+0000 7f39459cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940108120 con 0x7f39400f77d0 2023-10-18T22:13:19.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.960+0000 7f39449cd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39400f6530 0x7f3940106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:19.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.960+0000 7f39449cd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39400f6530 0x7f3940106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54080/0 (socket says 172.21.15.8:54080) 2023-10-18T22:13:19.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.960+0000 7f39449cd700 1 -- 172.21.15.8:0/2558881273 learned_addr learned my addr 172.21.15.8:0/2558881273 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:19.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.960+0000 7f393ffff700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400f77d0 0x7f3940107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:19.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.961+0000 7f39449cd700 1 -- 172.21.15.8:0/2558881273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400f77d0 msgr2=0x7f3940107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:19.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.961+0000 7f39449cd700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400f77d0 0x7f3940107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:19.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.961+0000 7f39449cd700 1 -- 172.21.15.8:0/2558881273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934005040 con 0x7f39400f6530 2023-10-18T22:13:19.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.961+0000 7f39449cd700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39400f6530 0x7f3940106e20 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f3934007a60 tx=0x7f3934009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:19.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.961+0000 7f393d7fa700 1 -- 172.21.15.8:0/2558881273 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3934018070 con 0x7f39400f6530 2023-10-18T22:13:19.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.961+0000 7f393d7fa700 1 -- 172.21.15.8:0/2558881273 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3934009630 con 0x7f39400f6530 2023-10-18T22:13:19.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.961+0000 7f393d7fa700 1 -- 172.21.15.8:0/2558881273 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f393401c540 con 0x7f39400f6530 2023-10-18T22:13:19.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.961+0000 7f39459cf700 1 -- 172.21.15.8:0/2558881273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3940108340 con 0x7f39400f6530 2023-10-18T22:13:19.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.961+0000 7f39459cf700 1 -- 172.21.15.8:0/2558881273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39401088a0 con 0x7f39400f6530 2023-10-18T22:13:19.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.962+0000 7f39459cf700 1 -- 172.21.15.8:0/2558881273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3940059100 con 0x7f39400f6530 2023-10-18T22:13:19.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.963+0000 7f393d7fa700 1 -- 172.21.15.8:0/2558881273 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f393401d420 con 0x7f39400f6530 2023-10-18T22:13:19.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.964+0000 7f393d7fa700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3930060f70 0x7f3930063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:19.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.964+0000 7f393d7fa700 1 -- 172.21.15.8:0/2558881273 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f393407e5c0 con 0x7f39400f6530 2023-10-18T22:13:19.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.964+0000 7f393ffff700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3930060f70 0x7f3930063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:19.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.965+0000 7f393ffff700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3930060f70 0x7f3930063430 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f392c0096c0 tx=0x7f392c009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:19.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:19.968+0000 7f393d7fa700 1 -- 172.21.15.8:0/2558881273 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f393404e2b0 con 0x7f39400f6530 2023-10-18T22:13:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.165+0000 7f39459cf700 1 -- 172.21.15.8:0/2558881273 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39400008d0 con 0x7f3930060f70 2023-10-18T22:13:20.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.167+0000 7f393d7fa700 1 -- 172.21.15.8:0/2558881273 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f39400008d0 con 0x7f3930060f70 2023-10-18T22:13:20.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.168+0000 7f39459cf700 1 -- 172.21.15.8:0/2558881273 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3930060f70 msgr2=0x7f3930063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:20.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.169+0000 7f39459cf700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3930060f70 0x7f3930063430 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f392c0096c0 tx=0x7f392c009be0).stop 2023-10-18T22:13:20.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.169+0000 7f39459cf700 1 -- 172.21.15.8:0/2558881273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39400f6530 msgr2=0x7f3940106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:20.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.169+0000 7f39459cf700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39400f6530 0x7f3940106e20 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f3934007a60 tx=0x7f3934009b30).stop 2023-10-18T22:13:20.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.169+0000 7f39459cf700 1 -- 172.21.15.8:0/2558881273 shutdown_connections 2023-10-18T22:13:20.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.169+0000 7f39459cf700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3930060f70 0x7f3930063430 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.169+0000 7f39459cf700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39400f6530 0x7f3940106e20 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.169+0000 7f39459cf700 1 --2- 172.21.15.8:0/2558881273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400f77d0 0x7f3940107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.169+0000 7f39459cf700 1 -- 172.21.15.8:0/2558881273 >> 172.21.15.8:0/2558881273 conn(0x7f39400f1c90 msgr2=0x7f39400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.169+0000 7f39459cf700 1 -- 172.21.15.8:0/2558881273 shutdown_connections 2023-10-18T22:13:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.169+0000 7f39459cf700 1 -- 172.21.15.8:0/2558881273 wait complete. 2023-10-18T22:13:20.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.307+0000 7fcb1b327700 1 -- 172.21.15.8:0/1465019884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 msgr2=0x7fcb140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:20.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.307+0000 7fcb1b327700 1 --2- 172.21.15.8:0/1465019884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb140f7c30 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7fcb04004660 tx=0x7fcb04009b30).stop 2023-10-18T22:13:20.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.307+0000 7fcb1b327700 1 -- 172.21.15.8:0/1465019884 shutdown_connections 2023-10-18T22:13:20.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.307+0000 7fcb1b327700 1 --2- 172.21.15.8:0/1465019884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb140f7c30 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.307+0000 7fcb1b327700 1 --2- 172.21.15.8:0/1465019884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 0x7fcb140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.307+0000 7fcb1b327700 1 -- 172.21.15.8:0/1465019884 >> 172.21.15.8:0/1465019884 conn(0x7fcb140f1c90 msgr2=0x7fcb140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:20.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.307+0000 7fcb1b327700 1 -- 172.21.15.8:0/1465019884 shutdown_connections 2023-10-18T22:13:20.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.307+0000 7fcb1b327700 1 -- 172.21.15.8:0/1465019884 wait complete. 2023-10-18T22:13:20.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.308+0000 7fcb1b327700 1 Processor -- start 2023-10-18T22:13:20.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.308+0000 7fcb1b327700 1 -- start start 2023-10-18T22:13:20.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.308+0000 7fcb1b327700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 0x7fcb14108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:20.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.308+0000 7fcb1b327700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:20.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.308+0000 7fcb1b327700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14109a20 con 0x7fcb140f77d0 2023-10-18T22:13:20.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.308+0000 7fcb1b327700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14109b60 con 0x7fcb140f6530 2023-10-18T22:13:20.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.309+0000 7fcb19b24700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:20.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.309+0000 7fcb19b24700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54106/0 (socket says 172.21.15.8:54106) 2023-10-18T22:13:20.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.309+0000 7fcb19b24700 1 -- 172.21.15.8:0/1918724450 learned_addr learned my addr 172.21.15.8:0/1918724450 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:20.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.309+0000 7fcb1a325700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 0x7fcb14108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:20.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.309+0000 7fcb19b24700 1 -- 172.21.15.8:0/1918724450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 msgr2=0x7fcb14108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:20.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.309+0000 7fcb19b24700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 0x7fcb14108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.309+0000 7fcb19b24700 1 -- 172.21.15.8:0/1918724450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04005040 con 0x7fcb140f77d0 2023-10-18T22:13:20.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.309+0000 7fcb19b24700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14109470 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7fcb04009f50 tx=0x7fcb04009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:20.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.309+0000 7fcb0affd700 1 -- 172.21.15.8:0/1918724450 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb04018070 con 0x7fcb140f77d0 2023-10-18T22:13:20.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.310+0000 7fcb0affd700 1 -- 172.21.15.8:0/1918724450 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcb04009630 con 0x7fcb140f77d0 2023-10-18T22:13:20.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.310+0000 7fcb1b327700 1 -- 172.21.15.8:0/1918724450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1410a4a0 con 0x7fcb140f77d0 2023-10-18T22:13:20.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.310+0000 7fcb0affd700 1 -- 172.21.15.8:0/1918724450 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb0401c3c0 con 0x7fcb140f77d0 2023-10-18T22:13:20.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.310+0000 7fcb1b327700 1 -- 172.21.15.8:0/1918724450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1410aa00 con 0x7fcb140f77d0 2023-10-18T22:13:20.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.311+0000 7fcb1b327700 1 -- 172.21.15.8:0/1918724450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb14045ad0 con 0x7fcb140f77d0 2023-10-18T22:13:20.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.312+0000 7fcb0affd700 1 -- 172.21.15.8:0/1918724450 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcb0401d420 con 0x7fcb140f77d0 2023-10-18T22:13:20.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.312+0000 7fcb0affd700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 0x7fcb00063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:20.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.313+0000 7fcb0affd700 1 -- 172.21.15.8:0/1918724450 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcb0407e530 con 0x7fcb140f77d0 2023-10-18T22:13:20.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.313+0000 7fcb1a325700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 0x7fcb00063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:20.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.313+0000 7fcb1a325700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 0x7fcb00063430 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7fcb140f7630 tx=0x7fcb1000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:20.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.317+0000 7fcb0affd700 1 -- 172.21.15.8:0/1918724450 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcb04051bd0 con 0x7fcb140f77d0 2023-10-18T22:13:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.509+0000 7fcb1b327700 1 -- 172.21.15.8:0/1918724450 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb140fed30 con 0x7fcb00060f70 2023-10-18T22:13:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.519+0000 7fcb0affd700 1 -- 172.21.15.8:0/1918724450 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcb140fed30 con 0x7fcb00060f70 2023-10-18T22:13:20.521 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:13:20.522 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (80m) 7m ago 81m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:13:20.522 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (73m) 7m ago 81m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:13:20.522 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (73m) 5m ago 80m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:13:20.522 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (79m) 7m ago 81m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:13:20.523 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 77m - - 2023-10-18T22:13:20.523 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 77m - - 2023-10-18T22:13:20.523 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 77m - - 2023-10-18T22:13:20.523 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 77m - - 2023-10-18T22:13:20.524 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (75m) 7m ago 82m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:13:20.524 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (74m) 5m ago 80m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:13:20.524 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (74m) 7m ago 82m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:13:20.524 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (74m) 5m ago 80m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:13:20.524 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (80m) 7m ago 80m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:13:20.525 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (80m) 5m ago 80m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:13:20.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (73m) 7m ago 80m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:13:20.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (71m) 7m ago 79m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:13:20.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (71m) 7m ago 79m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:13:20.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (70m) 5m ago 79m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:13:20.526 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (69m) 5m ago 78m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:13:20.526 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (69m) 5m ago 78m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:13:20.526 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (75m) 7m ago 80m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:13:20.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 -- 172.21.15.8:0/1918724450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 msgr2=0x7fcb00063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:20.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 0x7fcb00063430 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7fcb140f7630 tx=0x7fcb1000b040).stop 2023-10-18T22:13:20.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 -- 172.21.15.8:0/1918724450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 msgr2=0x7fcb14109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:20.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14109470 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7fcb04009f50 tx=0x7fcb04009b30).stop 2023-10-18T22:13:20.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 -- 172.21.15.8:0/1918724450 shutdown_connections 2023-10-18T22:13:20.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 0x7fcb00063430 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 0x7fcb14108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 --2- 172.21.15.8:0/1918724450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14109470 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 -- 172.21.15.8:0/1918724450 >> 172.21.15.8:0/1918724450 conn(0x7fcb140f1c90 msgr2=0x7fcb1406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:20.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 -- 172.21.15.8:0/1918724450 shutdown_connections 2023-10-18T22:13:20.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.521+0000 7fcb1b327700 1 -- 172.21.15.8:0/1918724450 wait complete. 2023-10-18T22:13:20.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.658+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/104735573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5e80f77d0 msgr2=0x7fb5e80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:20.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.658+0000 7fb5ef1ad700 1 --2- 172.21.15.8:0/104735573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5e80f77d0 0x7fb5e80f7c30 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7fb5d8004660 tx=0x7fb5d8009b30).stop 2023-10-18T22:13:20.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.658+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/104735573 shutdown_connections 2023-10-18T22:13:20.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.658+0000 7fb5ef1ad700 1 --2- 172.21.15.8:0/104735573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5e80f77d0 0x7fb5e80f7c30 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.658+0000 7fb5ef1ad700 1 --2- 172.21.15.8:0/104735573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e80f6530 0x7fb5e80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.658+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/104735573 >> 172.21.15.8:0/104735573 conn(0x7fb5e80f1c90 msgr2=0x7fb5e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:20.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.658+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/104735573 shutdown_connections 2023-10-18T22:13:20.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.658+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/104735573 wait complete. 2023-10-18T22:13:20.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.659+0000 7fb5ef1ad700 1 Processor -- start 2023-10-18T22:13:20.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.659+0000 7fb5ef1ad700 1 -- start start 2023-10-18T22:13:20.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.659+0000 7fb5ef1ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e80f6530 0x7fb5e806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:20.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.659+0000 7fb5ef1ad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5e80f77d0 0x7fb5e8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:20.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.659+0000 7fb5ef1ad700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e806a380 con 0x7fb5e80f77d0 2023-10-18T22:13:20.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.659+0000 7fb5ef1ad700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e806a4c0 con 0x7fb5e80f6530 2023-10-18T22:13:20.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5ed9aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5e80f77d0 0x7fb5e8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:20.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5ed9aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5e80f77d0 0x7fb5e8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54128/0 (socket says 172.21.15.8:54128) 2023-10-18T22:13:20.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5ed9aa700 1 -- 172.21.15.8:0/477072933 learned_addr learned my addr 172.21.15.8:0/477072933 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:20.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5ed9aa700 1 -- 172.21.15.8:0/477072933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e80f6530 msgr2=0x7fb5e806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:20.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5ed9aa700 1 --2- 172.21.15.8:0/477072933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e80f6530 0x7fb5e806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:13:20.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5ed9aa700 1 -- 172.21.15.8:0/477072933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d8005040 con 0x7fb5e80f77d0 2023-10-18T22:13:20.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5ed9aa700 1 --2- 172.21.15.8:0/477072933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5e80f77d0 0x7fb5e8069e20 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7fb5d8009830 tx=0x7fb5d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:20.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5deffd700 1 -- 172.21.15.8:0/477072933 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5d8018070 con 0x7fb5e80f77d0 2023-10-18T22:13:20.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5deffd700 1 -- 172.21.15.8:0/477072933 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb5d801d8e0 con 0x7fb5e80f77d0 2023-10-18T22:13:20.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/477072933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e806a740 con 0x7fb5e80f77d0 2023-10-18T22:13:20.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.660+0000 7fb5deffd700 1 -- 172.21.15.8:0/477072933 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5d801c540 con 0x7fb5e80f77d0 2023-10-18T22:13:20.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.661+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/477072933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e806aca0 con 0x7fb5e80f77d0 2023-10-18T22:13:20.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.662+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/477072933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e8045ad0 con 0x7fb5e80f77d0 2023-10-18T22:13:20.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.663+0000 7fb5deffd700 1 -- 172.21.15.8:0/477072933 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb5d801da50 con 0x7fb5e80f77d0 2023-10-18T22:13:20.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.664+0000 7fb5deffd700 1 --2- 172.21.15.8:0/477072933 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb5d4060f70 0x7fb5d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:20.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.664+0000 7fb5deffd700 1 -- 172.21.15.8:0/477072933 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb5d807e930 con 0x7fb5e80f77d0 2023-10-18T22:13:20.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.664+0000 7fb5ee1ab700 1 --2- 172.21.15.8:0/477072933 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb5d4060f70 0x7fb5d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:20.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.664+0000 7fb5ee1ab700 1 --2- 172.21.15.8:0/477072933 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb5d4060f70 0x7fb5d4063430 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7fb5e806b730 tx=0x7fb5e4007a60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:20.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:19.106648+0000 mgr.smithi008.flmjzp (mgr.14640) 4465 : cluster [DBG] pgmap v3065: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:20.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.668+0000 7fb5deffd700 1 -- 172.21.15.8:0/477072933 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb5d804e4e0 con 0x7fb5e80f77d0 2023-10-18T22:13:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:19.106648+0000 mgr.smithi008.flmjzp (mgr.14640) 4465 : cluster [DBG] pgmap v3065: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:20.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.924+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/477072933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb5e8027a00 con 0x7fb5e80f77d0 2023-10-18T22:13:20.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.925+0000 7fb5deffd700 1 -- 172.21.15.8:0/477072933 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fb5d8051b00 con 0x7fb5e80f77d0 2023-10-18T22:13:20.927 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:13:20.928 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:13:20.928 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:13:20.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:13:20.928 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:13:20.929 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:13:20.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:13:20.929 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:13:20.929 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:13:20.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:13:20.930 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:13:20.930 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:13:20.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:13:20.930 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:13:20.930 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:13:20.931 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:13:20.931 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:13:20.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/477072933 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb5d4060f70 msgr2=0x7fb5d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:20.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 --2- 172.21.15.8:0/477072933 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb5d4060f70 0x7fb5d4063430 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7fb5e806b730 tx=0x7fb5e4007a60).stop 2023-10-18T22:13:20.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/477072933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5e80f77d0 msgr2=0x7fb5e8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 --2- 172.21.15.8:0/477072933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5e80f77d0 0x7fb5e8069e20 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7fb5d8009830 tx=0x7fb5d8009b30).stop 2023-10-18T22:13:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/477072933 shutdown_connections 2023-10-18T22:13:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 --2- 172.21.15.8:0/477072933 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb5d4060f70 0x7fb5d4063430 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 --2- 172.21.15.8:0/477072933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e80f6530 0x7fb5e806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:13:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 --2- 172.21.15.8:0/477072933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5e80f77d0 0x7fb5e8069e20 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:20.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/477072933 >> 172.21.15.8:0/477072933 conn(0x7fb5e80f1c90 msgr2=0x7fb5e80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:20.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/477072933 shutdown_connections 2023-10-18T22:13:20.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:20.927+0000 7fb5ef1ad700 1 -- 172.21.15.8:0/477072933 wait complete. 2023-10-18T22:13:21.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.063+0000 7f1175db9700 1 -- 172.21.15.8:0/466472309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700f6530 msgr2=0x7f11700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:21.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.063+0000 7f1175db9700 1 --2- 172.21.15.8:0/466472309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700f6530 0x7f11700f6950 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f1164004660 tx=0x7f1164009b30).stop 2023-10-18T22:13:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.063+0000 7f1175db9700 1 -- 172.21.15.8:0/466472309 shutdown_connections 2023-10-18T22:13:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.063+0000 7f1175db9700 1 --2- 172.21.15.8:0/466472309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11700f77d0 0x7f11700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.063+0000 7f1175db9700 1 --2- 172.21.15.8:0/466472309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700f6530 0x7f11700f6950 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.063+0000 7f1175db9700 1 -- 172.21.15.8:0/466472309 >> 172.21.15.8:0/466472309 conn(0x7f11700f1c90 msgr2=0x7f11700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.063+0000 7f1175db9700 1 -- 172.21.15.8:0/466472309 shutdown_connections 2023-10-18T22:13:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.063+0000 7f1175db9700 1 -- 172.21.15.8:0/466472309 wait complete. 2023-10-18T22:13:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.064+0000 7f1175db9700 1 Processor -- start 2023-10-18T22:13:21.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.064+0000 7f1175db9700 1 -- start start 2023-10-18T22:13:21.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f1175db9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700f6530 0x7f1170108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:21.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f1175db9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11700f77d0 0x7f11701094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:21.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f1175db9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170109a50 con 0x7f11700f6530 2023-10-18T22:13:21.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f1175db9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170109b90 con 0x7f11700f77d0 2023-10-18T22:13:21.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f1174db7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700f6530 0x7f1170108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:21.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f1174db7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700f6530 0x7f1170108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54150/0 (socket says 172.21.15.8:54150) 2023-10-18T22:13:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f1174db7700 1 -- 172.21.15.8:0/707963703 learned_addr learned my addr 172.21.15.8:0/707963703 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f116ffff700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11700f77d0 0x7f11701094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f1174db7700 1 -- 172.21.15.8:0/707963703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11700f77d0 msgr2=0x7f11701094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f1174db7700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11700f77d0 0x7f11701094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.065+0000 7f1174db7700 1 -- 172.21.15.8:0/707963703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1164005040 con 0x7f11700f6530 2023-10-18T22:13:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.066+0000 7f1174db7700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700f6530 0x7f1170108fb0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f1164007a60 tx=0x7f1164009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.066+0000 7f116d7fa700 1 -- 172.21.15.8:0/707963703 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1164018070 con 0x7f11700f6530 2023-10-18T22:13:21.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.066+0000 7f1175db9700 1 -- 172.21.15.8:0/707963703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117010a4d0 con 0x7f11700f6530 2023-10-18T22:13:21.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.066+0000 7f116d7fa700 1 -- 172.21.15.8:0/707963703 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1164009630 con 0x7f11700f6530 2023-10-18T22:13:21.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.066+0000 7f116d7fa700 1 -- 172.21.15.8:0/707963703 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f116401c540 con 0x7f11700f6530 2023-10-18T22:13:21.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.066+0000 7f1175db9700 1 -- 172.21.15.8:0/707963703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117010aa30 con 0x7f11700f6530 2023-10-18T22:13:21.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.067+0000 7f1175db9700 1 -- 172.21.15.8:0/707963703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1170045ad0 con 0x7f11700f6530 2023-10-18T22:13:21.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.068+0000 7f116d7fa700 1 -- 172.21.15.8:0/707963703 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f116401c7b0 con 0x7f11700f6530 2023-10-18T22:13:21.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.069+0000 7f116d7fa700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1160060f70 0x7f1160063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:21.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.069+0000 7f116d7fa700 1 -- 172.21.15.8:0/707963703 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f116407e6a0 con 0x7f11700f6530 2023-10-18T22:13:21.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.069+0000 7f116ffff700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1160060f70 0x7f1160063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.070+0000 7f116ffff700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1160060f70 0x7f1160063430 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f115c0096c0 tx=0x7f115c009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.073+0000 7f116d7fa700 1 -- 172.21.15.8:0/707963703 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1164051d40 con 0x7f11700f6530 2023-10-18T22:13:21.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.303+0000 7f1175db9700 1 -- 172.21.15.8:0/707963703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f11700008d0 con 0x7f11700f6530 2023-10-18T22:13:21.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.304+0000 7f116d7fa700 1 -- 172.21.15.8:0/707963703 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1164051930 con 0x7f11700f6530 2023-10-18T22:13:21.307 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:13:21.307 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:13:21.307 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:13:21.307 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:13:21.308 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:13:21.308 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:13:21.308 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:13:21.308 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:13:21.308 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:13:21.309 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:13:21.309 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:13:21.309 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:13:21.309 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:13:21.309 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:13:21.310 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:13:21.310 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:13:21.310 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:13:21.310 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:13:21.311 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:13:21.311 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:13:21.311 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:13:21.312 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:13:21.312 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:13:21.312 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:13:21.313 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:13:21.313 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:13:21.313 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:13:21.314 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:13:21.314 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:13:21.315 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:13:21.315 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:13:21.315 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:13:21.315 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:13:21.316 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:13:21.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 -- 172.21.15.8:0/707963703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1160060f70 msgr2=0x7f1160063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:21.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1160060f70 0x7f1160063430 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f115c0096c0 tx=0x7f115c009be0).stop 2023-10-18T22:13:21.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 -- 172.21.15.8:0/707963703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700f6530 msgr2=0x7f1170108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:21.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700f6530 0x7f1170108fb0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f1164007a60 tx=0x7f1164009b30).stop 2023-10-18T22:13:21.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 -- 172.21.15.8:0/707963703 shutdown_connections 2023-10-18T22:13:21.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1160060f70 0x7f1160063430 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11700f6530 0x7f1170108fb0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 --2- 172.21.15.8:0/707963703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11700f77d0 0x7f11701094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 -- 172.21.15.8:0/707963703 >> 172.21.15.8:0/707963703 conn(0x7f11700f1c90 msgr2=0x7f117006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:21.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 -- 172.21.15.8:0/707963703 shutdown_connections 2023-10-18T22:13:21.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.306+0000 7f1175db9700 1 -- 172.21.15.8:0/707963703 wait complete. 2023-10-18T22:13:21.319 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:13:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.443+0000 7fe5ef59e700 1 -- 172.21.15.8:0/65738012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f00f77d0 msgr2=0x7fe5f00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.443+0000 7fe5ef59e700 1 --2- 172.21.15.8:0/65738012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f00f77d0 0x7fe5f00f7c30 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7fe5e4004660 tx=0x7fe5e4009b30).stop 2023-10-18T22:13:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.443+0000 7fe5ef59e700 1 -- 172.21.15.8:0/65738012 shutdown_connections 2023-10-18T22:13:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.443+0000 7fe5ef59e700 1 --2- 172.21.15.8:0/65738012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f00f77d0 0x7fe5f00f7c30 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.443+0000 7fe5ef59e700 1 --2- 172.21.15.8:0/65738012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f00f6530 0x7fe5f00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.443+0000 7fe5ef59e700 1 -- 172.21.15.8:0/65738012 >> 172.21.15.8:0/65738012 conn(0x7fe5f00f1c90 msgr2=0x7fe5f00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.443+0000 7fe5ef59e700 1 -- 172.21.15.8:0/65738012 shutdown_connections 2023-10-18T22:13:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.443+0000 7fe5ef59e700 1 -- 172.21.15.8:0/65738012 wait complete. 2023-10-18T22:13:21.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.444+0000 7fe5ef59e700 1 Processor -- start 2023-10-18T22:13:21.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.445+0000 7fe5ef59e700 1 -- start start 2023-10-18T22:13:21.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.445+0000 7fe5ef59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f00f6530 0x7fe5f0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:21.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.445+0000 7fe5ef59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f00f77d0 0x7fe5f0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:21.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.445+0000 7fe5ef59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0107880 con 0x7fe5f00f6530 2023-10-18T22:13:21.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.445+0000 7fe5ef59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f01080c0 con 0x7fe5f00f77d0 2023-10-18T22:13:21.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5ee59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f00f6530 0x7fe5f0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:21.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5ee59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f00f6530 0x7fe5f0106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54156/0 (socket says 172.21.15.8:54156) 2023-10-18T22:13:21.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5ee59c700 1 -- 172.21.15.8:0/2012778586 learned_addr learned my addr 172.21.15.8:0/2012778586 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:21.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5edd9b700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f00f77d0 0x7fe5f0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:21.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5ee59c700 1 -- 172.21.15.8:0/2012778586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f00f77d0 msgr2=0x7fe5f0107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:21.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5ee59c700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f00f77d0 0x7fe5f0107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5ee59c700 1 -- 172.21.15.8:0/2012778586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4005040 con 0x7fe5f00f6530 2023-10-18T22:13:21.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5ee59c700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f00f6530 0x7fe5f0106d90 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7fe5e0002700 tx=0x7fe5e0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:21.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5deffd700 1 -- 172.21.15.8:0/2012778586 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5e00079c0 con 0x7fe5f00f6530 2023-10-18T22:13:21.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5deffd700 1 -- 172.21.15.8:0/2012778586 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe5e000f040 con 0x7fe5f00f6530 2023-10-18T22:13:21.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5deffd700 1 -- 172.21.15.8:0/2012778586 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5e00148d0 con 0x7fe5f00f6530 2023-10-18T22:13:21.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.446+0000 7fe5ef59e700 1 -- 172.21.15.8:0/2012778586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f01083a0 con 0x7fe5f00f6530 2023-10-18T22:13:21.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.447+0000 7fe5ef59e700 1 -- 172.21.15.8:0/2012778586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f01088e0 con 0x7fe5f00f6530 2023-10-18T22:13:21.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.448+0000 7fe5ef59e700 1 -- 172.21.15.8:0/2012778586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f0059100 con 0x7fe5f00f6530 2023-10-18T22:13:21.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.449+0000 7fe5deffd700 1 -- 172.21.15.8:0/2012778586 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe5e001b060 con 0x7fe5f00f6530 2023-10-18T22:13:21.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.450+0000 7fe5deffd700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5d8060f70 0x7fe5d8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:21.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.450+0000 7fe5deffd700 1 -- 172.21.15.8:0/2012778586 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe5e007c6b0 con 0x7fe5f00f6530 2023-10-18T22:13:21.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.450+0000 7fe5edd9b700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5d8060f70 0x7fe5d8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:21.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.450+0000 7fe5edd9b700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5d8060f70 0x7fe5d8063430 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fe5e4004630 tx=0x7fe5e4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:21.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.454+0000 7fe5deffd700 1 -- 172.21.15.8:0/2012778586 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe5e004c3a0 con 0x7fe5f00f6530 2023-10-18T22:13:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:19.820141+0000 mgr.smithi008.flmjzp (mgr.14640) 4466 : audit [DBG] from='client.37600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:20.168045+0000 mgr.smithi008.flmjzp (mgr.14640) 4467 : audit [DBG] from='client.37604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:20.926307+0000 mon.smithi008 (mon.0) 4764 : audit [DBG] from='client.? 172.21.15.8:0/477072933' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:21.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.651+0000 7fe5ef59e700 1 -- 172.21.15.8:0/2012778586 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5f00fee30 con 0x7fe5d8060f70 2023-10-18T22:13:21.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.652+0000 7fe5deffd700 1 -- 172.21.15.8:0/2012778586 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe5f00fee30 con 0x7fe5d8060f70 2023-10-18T22:13:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:13:21.655 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:13:21.655 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:13:21.655 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:13:21.655 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:13:21.656 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:13:21.656 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:13:21.656 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:13:21.656 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:13:21.656 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:13:21.657 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:13:21.657 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:13:21.657 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:13:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:13:21.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.654+0000 7fe5ef59e700 1 -- 172.21.15.8:0/2012778586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5d8060f70 msgr2=0x7fe5d8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:21.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.654+0000 7fe5ef59e700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5d8060f70 0x7fe5d8063430 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fe5e4004630 tx=0x7fe5e4009b30).stop 2023-10-18T22:13:21.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.654+0000 7fe5ef59e700 1 -- 172.21.15.8:0/2012778586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f00f6530 msgr2=0x7fe5f0106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:21.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.654+0000 7fe5ef59e700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f00f6530 0x7fe5f0106d90 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7fe5e0002700 tx=0x7fe5e0009d80).stop 2023-10-18T22:13:21.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.655+0000 7fe5ef59e700 1 -- 172.21.15.8:0/2012778586 shutdown_connections 2023-10-18T22:13:21.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.655+0000 7fe5ef59e700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe5d8060f70 0x7fe5d8063430 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.655+0000 7fe5ef59e700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f00f6530 0x7fe5f0106d90 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.655+0000 7fe5ef59e700 1 --2- 172.21.15.8:0/2012778586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f00f77d0 0x7fe5f0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:21.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.655+0000 7fe5ef59e700 1 -- 172.21.15.8:0/2012778586 >> 172.21.15.8:0/2012778586 conn(0x7fe5f00f1c90 msgr2=0x7fe5f00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:21.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.655+0000 7fe5ef59e700 1 -- 172.21.15.8:0/2012778586 shutdown_connections 2023-10-18T22:13:21.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:21.655+0000 7fe5ef59e700 1 -- 172.21.15.8:0/2012778586 wait complete. 2023-10-18T22:13:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:19.820141+0000 mgr.smithi008.flmjzp (mgr.14640) 4466 : audit [DBG] from='client.37600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:20.168045+0000 mgr.smithi008.flmjzp (mgr.14640) 4467 : audit [DBG] from='client.37604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:20.926307+0000 mon.smithi008 (mon.0) 4764 : audit [DBG] from='client.? 172.21.15.8:0/477072933' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:20.512149+0000 mgr.smithi008.flmjzp (mgr.14640) 4468 : audit [DBG] from='client.37608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:21.107292+0000 mgr.smithi008.flmjzp (mgr.14640) 4469 : cluster [DBG] pgmap v3066: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:21.305608+0000 mon.smithi008 (mon.0) 4765 : audit [DBG] from='client.? 172.21.15.8:0/707963703' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:13:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:20.512149+0000 mgr.smithi008.flmjzp (mgr.14640) 4468 : audit [DBG] from='client.37608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:21.107292+0000 mgr.smithi008.flmjzp (mgr.14640) 4469 : cluster [DBG] pgmap v3066: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:21.305608+0000 mon.smithi008 (mon.0) 4765 : audit [DBG] from='client.? 172.21.15.8:0/707963703' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:13:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:21.653780+0000 mgr.smithi008.flmjzp (mgr.14640) 4470 : audit [DBG] from='client.37620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:21.653780+0000 mgr.smithi008.flmjzp (mgr.14640) 4470 : audit [DBG] from='client.37620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:23.108009+0000 mgr.smithi008.flmjzp (mgr.14640) 4471 : cluster [DBG] pgmap v3067: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:23.108009+0000 mgr.smithi008.flmjzp (mgr.14640) 4471 : cluster [DBG] pgmap v3067: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:25.108698+0000 mgr.smithi008.flmjzp (mgr.14640) 4472 : cluster [DBG] pgmap v3068: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:25.108698+0000 mgr.smithi008.flmjzp (mgr.14640) 4472 : cluster [DBG] pgmap v3068: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:27.135849+0000 mon.smithi008 (mon.0) 4766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:27.135849+0000 mon.smithi008 (mon.0) 4766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:27.109312+0000 mgr.smithi008.flmjzp (mgr.14640) 4473 : cluster [DBG] pgmap v3069: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:27.489009+0000 mon.smithi008 (mon.0) 4767 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:27.490213+0000 mon.smithi008 (mon.0) 4768 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:27.491340+0000 mon.smithi008 (mon.0) 4769 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:27.497442+0000 mon.smithi008 (mon.0) 4770 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:27.503721+0000 mon.smithi008 (mon.0) 4771 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:27.506789+0000 mon.smithi008 (mon.0) 4772 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:27.508435+0000 mon.smithi008 (mon.0) 4773 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:27.510012+0000 mon.smithi008 (mon.0) 4774 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:27.511995+0000 mon.smithi008 (mon.0) 4775 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:27.109312+0000 mgr.smithi008.flmjzp (mgr.14640) 4473 : cluster [DBG] pgmap v3069: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:27.489009+0000 mon.smithi008 (mon.0) 4767 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:27.490213+0000 mon.smithi008 (mon.0) 4768 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:27.491340+0000 mon.smithi008 (mon.0) 4769 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:27.497442+0000 mon.smithi008 (mon.0) 4770 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:27.503721+0000 mon.smithi008 (mon.0) 4771 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:27.506789+0000 mon.smithi008 (mon.0) 4772 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:27.508435+0000 mon.smithi008 (mon.0) 4773 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:28.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:27.510012+0000 mon.smithi008 (mon.0) 4774 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:28.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:27.511995+0000 mon.smithi008 (mon.0) 4775 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:27.492426+0000 mgr.smithi008.flmjzp (mgr.14640) 4474 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:27.493105+0000 mgr.smithi008.flmjzp (mgr.14640) 4475 : cluster [DBG] pgmap v3070: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:27.493383+0000 mgr.smithi008.flmjzp (mgr.14640) 4476 : cluster [DBG] pgmap v3071: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:27.513849+0000 mgr.smithi008.flmjzp (mgr.14640) 4477 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:27.492426+0000 mgr.smithi008.flmjzp (mgr.14640) 4474 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:27.493105+0000 mgr.smithi008.flmjzp (mgr.14640) 4475 : cluster [DBG] pgmap v3070: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:27.493383+0000 mgr.smithi008.flmjzp (mgr.14640) 4476 : cluster [DBG] pgmap v3071: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:27.513849+0000 mgr.smithi008.flmjzp (mgr.14640) 4477 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:29.493996+0000 mgr.smithi008.flmjzp (mgr.14640) 4478 : cluster [DBG] pgmap v3072: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:29.493996+0000 mgr.smithi008.flmjzp (mgr.14640) 4478 : cluster [DBG] pgmap v3072: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:31.494753+0000 mgr.smithi008.flmjzp (mgr.14640) 4479 : cluster [DBG] pgmap v3073: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:31.494753+0000 mgr.smithi008.flmjzp (mgr.14640) 4479 : cluster [DBG] pgmap v3073: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:33.495416+0000 mgr.smithi008.flmjzp (mgr.14640) 4480 : cluster [DBG] pgmap v3074: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:35.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:33.495416+0000 mgr.smithi008.flmjzp (mgr.14640) 4480 : cluster [DBG] pgmap v3074: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:35.496138+0000 mgr.smithi008.flmjzp (mgr.14640) 4481 : cluster [DBG] pgmap v3075: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:35.496138+0000 mgr.smithi008.flmjzp (mgr.14640) 4481 : cluster [DBG] pgmap v3075: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:37.524578+0000 mon.smithi008 (mon.0) 4776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:37.526588+0000 mon.smithi008 (mon.0) 4777 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:37.527553+0000 mon.smithi008 (mon.0) 4778 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:37.533956+0000 mon.smithi008 (mon.0) 4779 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:37.540357+0000 mon.smithi008 (mon.0) 4780 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:37.543492+0000 mon.smithi008 (mon.0) 4781 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:37.545110+0000 mon.smithi008 (mon.0) 4782 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:37.546688+0000 mon.smithi008 (mon.0) 4783 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:37.548631+0000 mon.smithi008 (mon.0) 4784 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:37.524578+0000 mon.smithi008 (mon.0) 4776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:37.526588+0000 mon.smithi008 (mon.0) 4777 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:37.527553+0000 mon.smithi008 (mon.0) 4778 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:37.533956+0000 mon.smithi008 (mon.0) 4779 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:37.540357+0000 mon.smithi008 (mon.0) 4780 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:37.543492+0000 mon.smithi008 (mon.0) 4781 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:37.545110+0000 mon.smithi008 (mon.0) 4782 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:37.546688+0000 mon.smithi008 (mon.0) 4783 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:38.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:37.548631+0000 mon.smithi008 (mon.0) 4784 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:37.496661+0000 mgr.smithi008.flmjzp (mgr.14640) 4482 : cluster [DBG] pgmap v3076: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:37.528407+0000 mgr.smithi008.flmjzp (mgr.14640) 4483 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:37.528978+0000 mgr.smithi008.flmjzp (mgr.14640) 4484 : cluster [DBG] pgmap v3077: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:37.529223+0000 mgr.smithi008.flmjzp (mgr.14640) 4485 : cluster [DBG] pgmap v3078: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:37.550535+0000 mgr.smithi008.flmjzp (mgr.14640) 4486 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:37.496661+0000 mgr.smithi008.flmjzp (mgr.14640) 4482 : cluster [DBG] pgmap v3076: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:37.528407+0000 mgr.smithi008.flmjzp (mgr.14640) 4483 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:37.528978+0000 mgr.smithi008.flmjzp (mgr.14640) 4484 : cluster [DBG] pgmap v3077: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:37.529223+0000 mgr.smithi008.flmjzp (mgr.14640) 4485 : cluster [DBG] pgmap v3078: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:37.550535+0000 mgr.smithi008.flmjzp (mgr.14640) 4486 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:39.529965+0000 mgr.smithi008.flmjzp (mgr.14640) 4487 : cluster [DBG] pgmap v3079: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:39.529965+0000 mgr.smithi008.flmjzp (mgr.14640) 4487 : cluster [DBG] pgmap v3079: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:41.530663+0000 mgr.smithi008.flmjzp (mgr.14640) 4488 : cluster [DBG] pgmap v3080: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:41.530663+0000 mgr.smithi008.flmjzp (mgr.14640) 4488 : cluster [DBG] pgmap v3080: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:43.531219+0000 mgr.smithi008.flmjzp (mgr.14640) 4489 : cluster [DBG] pgmap v3081: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:43.531219+0000 mgr.smithi008.flmjzp (mgr.14640) 4489 : cluster [DBG] pgmap v3081: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:45.531789+0000 mgr.smithi008.flmjzp (mgr.14640) 4490 : cluster [DBG] pgmap v3082: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:45.531789+0000 mgr.smithi008.flmjzp (mgr.14640) 4490 : cluster [DBG] pgmap v3082: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:47.558229+0000 mon.smithi008 (mon.0) 4785 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:47.560399+0000 mon.smithi008 (mon.0) 4786 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:47.561557+0000 mon.smithi008 (mon.0) 4787 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:47.567785+0000 mon.smithi008 (mon.0) 4788 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:47.574311+0000 mon.smithi008 (mon.0) 4789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:47.577330+0000 mon.smithi008 (mon.0) 4790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:47.578983+0000 mon.smithi008 (mon.0) 4791 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:47.580585+0000 mon.smithi008 (mon.0) 4792 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:47.582544+0000 mon.smithi008 (mon.0) 4793 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:47.558229+0000 mon.smithi008 (mon.0) 4785 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:47.560399+0000 mon.smithi008 (mon.0) 4786 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:47.561557+0000 mon.smithi008 (mon.0) 4787 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:47.567785+0000 mon.smithi008 (mon.0) 4788 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:47.574311+0000 mon.smithi008 (mon.0) 4789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:47.577330+0000 mon.smithi008 (mon.0) 4790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:47.578983+0000 mon.smithi008 (mon.0) 4791 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:47.580585+0000 mon.smithi008 (mon.0) 4792 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:48.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:47.582544+0000 mon.smithi008 (mon.0) 4793 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:47.532444+0000 mgr.smithi008.flmjzp (mgr.14640) 4491 : cluster [DBG] pgmap v3083: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:47.562464+0000 mgr.smithi008.flmjzp (mgr.14640) 4492 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:47.563008+0000 mgr.smithi008.flmjzp (mgr.14640) 4493 : cluster [DBG] pgmap v3084: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:47.563280+0000 mgr.smithi008.flmjzp (mgr.14640) 4494 : cluster [DBG] pgmap v3085: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:47.584407+0000 mgr.smithi008.flmjzp (mgr.14640) 4495 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:47.532444+0000 mgr.smithi008.flmjzp (mgr.14640) 4491 : cluster [DBG] pgmap v3083: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:47.562464+0000 mgr.smithi008.flmjzp (mgr.14640) 4492 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:47.563008+0000 mgr.smithi008.flmjzp (mgr.14640) 4493 : cluster [DBG] pgmap v3084: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:47.563280+0000 mgr.smithi008.flmjzp (mgr.14640) 4494 : cluster [DBG] pgmap v3085: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:49.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:47.584407+0000 mgr.smithi008.flmjzp (mgr.14640) 4495 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:49.563977+0000 mgr.smithi008.flmjzp (mgr.14640) 4496 : cluster [DBG] pgmap v3086: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:49.563977+0000 mgr.smithi008.flmjzp (mgr.14640) 4496 : cluster [DBG] pgmap v3086: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:51.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.809+0000 7fe521020700 1 -- 172.21.15.8:0/3836202045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51c0f9690 msgr2=0x7fe51c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:51.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.809+0000 7fe521020700 1 --2- 172.21.15.8:0/3836202045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51c0f9690 0x7fe51c0fbae0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7fe510004660 tx=0x7fe510009b30).stop 2023-10-18T22:13:51.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.809+0000 7fe521020700 1 -- 172.21.15.8:0/3836202045 shutdown_connections 2023-10-18T22:13:51.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.809+0000 7fe521020700 1 --2- 172.21.15.8:0/3836202045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51c0f9690 0x7fe51c0fbae0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:51.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.809+0000 7fe521020700 1 --2- 172.21.15.8:0/3836202045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51c060310 0x7fe51c0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:51.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.809+0000 7fe521020700 1 -- 172.21.15.8:0/3836202045 >> 172.21.15.8:0/3836202045 conn(0x7fe51c0f0b90 msgr2=0x7fe51c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:51.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.809+0000 7fe521020700 1 -- 172.21.15.8:0/3836202045 shutdown_connections 2023-10-18T22:13:51.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.809+0000 7fe521020700 1 -- 172.21.15.8:0/3836202045 wait complete. 2023-10-18T22:13:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.810+0000 7fe521020700 1 Processor -- start 2023-10-18T22:13:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.810+0000 7fe521020700 1 -- start start 2023-10-18T22:13:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.810+0000 7fe521020700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51c060310 0x7fe51c108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:51.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.810+0000 7fe521020700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51c0f9690 0x7fe51c109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:51.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe521020700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c1099f0 con 0x7fe51c0f9690 2023-10-18T22:13:51.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe521020700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c109b30 con 0x7fe51c060310 2023-10-18T22:13:51.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe51b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51c0f9690 0x7fe51c109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:51.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe51b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51c0f9690 0x7fe51c109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46398/0 (socket says 172.21.15.8:46398) 2023-10-18T22:13:51.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe51b7fe700 1 -- 172.21.15.8:0/1468531834 learned_addr learned my addr 172.21.15.8:0/1468531834 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:51.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe51bfff700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51c060310 0x7fe51c108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:51.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe51b7fe700 1 -- 172.21.15.8:0/1468531834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51c060310 msgr2=0x7fe51c108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:51.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe51b7fe700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51c060310 0x7fe51c108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:51.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe51b7fe700 1 -- 172.21.15.8:0/1468531834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe510005040 con 0x7fe51c0f9690 2023-10-18T22:13:51.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe51bfff700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51c060310 0x7fe51c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:13:51.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.811+0000 7fe51b7fe700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51c0f9690 0x7fe51c109440 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7fe510007a70 tx=0x7fe510009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:51.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.812+0000 7fe518ff9700 1 -- 172.21.15.8:0/1468531834 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe510018070 con 0x7fe51c0f9690 2023-10-18T22:13:51.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.812+0000 7fe518ff9700 1 -- 172.21.15.8:0/1468531834 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe51001d8e0 con 0x7fe51c0f9690 2023-10-18T22:13:51.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.812+0000 7fe521020700 1 -- 172.21.15.8:0/1468531834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51c10a470 con 0x7fe51c0f9690 2023-10-18T22:13:51.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.812+0000 7fe518ff9700 1 -- 172.21.15.8:0/1468531834 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe51001c660 con 0x7fe51c0f9690 2023-10-18T22:13:51.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.812+0000 7fe521020700 1 -- 172.21.15.8:0/1468531834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51c10a9d0 con 0x7fe51c0f9690 2023-10-18T22:13:51.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.813+0000 7fe521020700 1 -- 172.21.15.8:0/1468531834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe51c045ad0 con 0x7fe51c0f9690 2023-10-18T22:13:51.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.814+0000 7fe518ff9700 1 -- 172.21.15.8:0/1468531834 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe51001da50 con 0x7fe51c0f9690 2023-10-18T22:13:51.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.815+0000 7fe518ff9700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe504060f70 0x7fe504063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:51.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.815+0000 7fe518ff9700 1 -- 172.21.15.8:0/1468531834 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe51007e990 con 0x7fe51c0f9690 2023-10-18T22:13:51.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.815+0000 7fe51bfff700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe504060f70 0x7fe504063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:51.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.816+0000 7fe51bfff700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe504060f70 0x7fe504063430 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fe50c0041d0 tx=0x7fe50c009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:51.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:51.819+0000 7fe518ff9700 1 -- 172.21.15.8:0/1468531834 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe510051f70 con 0x7fe51c0f9690 2023-10-18T22:13:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.019+0000 7fe521020700 1 -- 172.21.15.8:0/1468531834 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe51c0fa550 con 0x7fe504060f70 2023-10-18T22:13:52.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.020+0000 7fe518ff9700 1 -- 172.21.15.8:0/1468531834 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe51c0fa550 con 0x7fe504060f70 2023-10-18T22:13:52.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 -- 172.21.15.8:0/1468531834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe504060f70 msgr2=0x7fe504063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe504060f70 0x7fe504063430 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fe50c0041d0 tx=0x7fe50c009040).stop 2023-10-18T22:13:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 -- 172.21.15.8:0/1468531834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51c0f9690 msgr2=0x7fe51c109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51c0f9690 0x7fe51c109440 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7fe510007a70 tx=0x7fe510009b30).stop 2023-10-18T22:13:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 -- 172.21.15.8:0/1468531834 shutdown_connections 2023-10-18T22:13:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe504060f70 0x7fe504063430 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51c060310 0x7fe51c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 --2- 172.21.15.8:0/1468531834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51c0f9690 0x7fe51c109440 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 -- 172.21.15.8:0/1468531834 >> 172.21.15.8:0/1468531834 conn(0x7fe51c0f0b90 msgr2=0x7fe51c0f9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 -- 172.21.15.8:0/1468531834 shutdown_connections 2023-10-18T22:13:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.022+0000 7fe521020700 1 -- 172.21.15.8:0/1468531834 wait complete. 2023-10-18T22:13:52.038 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:13:52.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.160+0000 7fd290b81700 1 -- 172.21.15.8:0/2317120925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28c0f77d0 msgr2=0x7fd28c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.160+0000 7fd290b81700 1 --2- 172.21.15.8:0/2317120925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28c0f77d0 0x7fd28c0f7c30 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7fd280004660 tx=0x7fd280009b30).stop 2023-10-18T22:13:52.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.160+0000 7fd290b81700 1 -- 172.21.15.8:0/2317120925 shutdown_connections 2023-10-18T22:13:52.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.160+0000 7fd290b81700 1 --2- 172.21.15.8:0/2317120925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28c0f77d0 0x7fd28c0f7c30 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.160+0000 7fd290b81700 1 --2- 172.21.15.8:0/2317120925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd28c0f6530 0x7fd28c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.160+0000 7fd290b81700 1 -- 172.21.15.8:0/2317120925 >> 172.21.15.8:0/2317120925 conn(0x7fd28c0f1c90 msgr2=0x7fd28c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:52.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.160+0000 7fd290b81700 1 -- 172.21.15.8:0/2317120925 shutdown_connections 2023-10-18T22:13:52.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.160+0000 7fd290b81700 1 -- 172.21.15.8:0/2317120925 wait complete. 2023-10-18T22:13:52.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.161+0000 7fd290b81700 1 Processor -- start 2023-10-18T22:13:52.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.161+0000 7fd290b81700 1 -- start start 2023-10-18T22:13:52.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.161+0000 7fd290b81700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28c0f6530 0x7fd28c108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:52.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.161+0000 7fd290b81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd28c0f77d0 0x7fd28c109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:52.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.161+0000 7fd290b81700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c1099c0 con 0x7fd28c0f6530 2023-10-18T22:13:52.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.161+0000 7fd290b81700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c109b00 con 0x7fd28c0f77d0 2023-10-18T22:13:52.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.161+0000 7fd28b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28c0f6530 0x7fd28c108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:52.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd28b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28c0f6530 0x7fd28c108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46406/0 (socket says 172.21.15.8:46406) 2023-10-18T22:13:52.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd28b7fe700 1 -- 172.21.15.8:0/3362629740 learned_addr learned my addr 172.21.15.8:0/3362629740 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:52.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd28affd700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd28c0f77d0 0x7fd28c109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:52.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd28b7fe700 1 -- 172.21.15.8:0/3362629740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd28c0f77d0 msgr2=0x7fd28c109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd28b7fe700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd28c0f77d0 0x7fd28c109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd28b7fe700 1 -- 172.21.15.8:0/3362629740 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd280005040 con 0x7fd28c0f6530 2023-10-18T22:13:52.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd28b7fe700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28c0f6530 0x7fd28c108f20 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7fd27c002700 tx=0x7fd27c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:52.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd273fff700 1 -- 172.21.15.8:0/3362629740 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27c0079c0 con 0x7fd28c0f6530 2023-10-18T22:13:52.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd273fff700 1 -- 172.21.15.8:0/3362629740 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd27c00f040 con 0x7fd28c0f6530 2023-10-18T22:13:52.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd273fff700 1 -- 172.21.15.8:0/3362629740 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27c0148d0 con 0x7fd28c0f6530 2023-10-18T22:13:52.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.162+0000 7fd290b81700 1 -- 172.21.15.8:0/3362629740 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c10a4a0 con 0x7fd28c0f6530 2023-10-18T22:13:52.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.163+0000 7fd290b81700 1 -- 172.21.15.8:0/3362629740 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c10aa60 con 0x7fd28c0f6530 2023-10-18T22:13:52.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.164+0000 7fd290b81700 1 -- 172.21.15.8:0/3362629740 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c045ad0 con 0x7fd28c0f6530 2023-10-18T22:13:52.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.165+0000 7fd273fff700 1 -- 172.21.15.8:0/3362629740 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd27c01b060 con 0x7fd28c0f6530 2023-10-18T22:13:52.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.165+0000 7fd273fff700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd274060f70 0x7fd274063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:52.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.165+0000 7fd273fff700 1 -- 172.21.15.8:0/3362629740 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd27c07c6e0 con 0x7fd28c0f6530 2023-10-18T22:13:52.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.166+0000 7fd28affd700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd274060f70 0x7fd274063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:52.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.166+0000 7fd28affd700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd274060f70 0x7fd274063430 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7fd280004630 tx=0x7fd280009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:52.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.170+0000 7fd273fff700 1 -- 172.21.15.8:0/3362629740 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd27c04fe00 con 0x7fd28c0f6530 2023-10-18T22:13:52.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.368+0000 7fd290b81700 1 -- 172.21.15.8:0/3362629740 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd28c10ad30 con 0x7fd274060f70 2023-10-18T22:13:52.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.370+0000 7fd273fff700 1 -- 172.21.15.8:0/3362629740 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd28c10ad30 con 0x7fd274060f70 2023-10-18T22:13:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.371+0000 7fd290b81700 1 -- 172.21.15.8:0/3362629740 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd274060f70 msgr2=0x7fd274063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.371+0000 7fd290b81700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd274060f70 0x7fd274063430 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7fd280004630 tx=0x7fd280009b30).stop 2023-10-18T22:13:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.371+0000 7fd290b81700 1 -- 172.21.15.8:0/3362629740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28c0f6530 msgr2=0x7fd28c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.371+0000 7fd290b81700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28c0f6530 0x7fd28c108f20 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7fd27c002700 tx=0x7fd27c009e00).stop 2023-10-18T22:13:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.371+0000 7fd290b81700 1 -- 172.21.15.8:0/3362629740 shutdown_connections 2023-10-18T22:13:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.371+0000 7fd290b81700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd274060f70 0x7fd274063430 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.371+0000 7fd290b81700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd28c0f6530 0x7fd28c108f20 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.371+0000 7fd290b81700 1 --2- 172.21.15.8:0/3362629740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd28c0f77d0 0x7fd28c109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.372+0000 7fd290b81700 1 -- 172.21.15.8:0/3362629740 >> 172.21.15.8:0/3362629740 conn(0x7fd28c0f1c90 msgr2=0x7fd28c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.372+0000 7fd290b81700 1 -- 172.21.15.8:0/3362629740 shutdown_connections 2023-10-18T22:13:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.372+0000 7fd290b81700 1 -- 172.21.15.8:0/3362629740 wait complete. 2023-10-18T22:13:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.508+0000 7f0497208700 1 -- 172.21.15.8:0/3193963769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f049006b9c0 msgr2=0x7f0490069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.508+0000 7f0497208700 1 --2- 172.21.15.8:0/3193963769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f049006b9c0 0x7f0490069ec0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f048c004660 tx=0x7f048c009b30).stop 2023-10-18T22:13:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.508+0000 7f0497208700 1 -- 172.21.15.8:0/3193963769 shutdown_connections 2023-10-18T22:13:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.508+0000 7f0497208700 1 --2- 172.21.15.8:0/3193963769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f049006a3b0 0x7f049006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.508+0000 7f0497208700 1 --2- 172.21.15.8:0/3193963769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f049006b9c0 0x7f0490069ec0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.508+0000 7f0497208700 1 -- 172.21.15.8:0/3193963769 >> 172.21.15.8:0/3193963769 conn(0x7f04900f1cd0 msgr2=0x7f04900f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:52.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.508+0000 7f0497208700 1 -- 172.21.15.8:0/3193963769 shutdown_connections 2023-10-18T22:13:52.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.508+0000 7f0497208700 1 -- 172.21.15.8:0/3193963769 wait complete. 2023-10-18T22:13:52.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.510+0000 7f0497208700 1 Processor -- start 2023-10-18T22:13:52.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.510+0000 7f0497208700 1 -- start start 2023-10-18T22:13:52.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.510+0000 7f0497208700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f049006a3b0 0x7f049010d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:52.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.510+0000 7f0497208700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f049006b9c0 0x7f049010d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.510+0000 7f0497208700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049010dde0 con 0x7f049006b9c0 2023-10-18T22:13:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.510+0000 7f0497208700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049010df20 con 0x7f049006a3b0 2023-10-18T22:13:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.511+0000 7f0495a05700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f049006b9c0 0x7f049010d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.511+0000 7f0495a05700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f049006b9c0 0x7f049010d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46428/0 (socket says 172.21.15.8:46428) 2023-10-18T22:13:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.511+0000 7f0495a05700 1 -- 172.21.15.8:0/172687777 learned_addr learned my addr 172.21.15.8:0/172687777 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.511+0000 7f0496206700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f049006a3b0 0x7f049010d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.511+0000 7f0495a05700 1 -- 172.21.15.8:0/172687777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f049006a3b0 msgr2=0x7f049010d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.511+0000 7f0495a05700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f049006a3b0 0x7f049010d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.511+0000 7f0495a05700 1 -- 172.21.15.8:0/172687777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c005040 con 0x7f049006b9c0 2023-10-18T22:13:52.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.511+0000 7f0496206700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f049006a3b0 0x7f049010d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:13:52.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.511+0000 7f0495a05700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f049006b9c0 0x7f049010d830 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f04800026d0 tx=0x7f0480009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:52.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.512+0000 7f0486ffd700 1 -- 172.21.15.8:0/172687777 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0480009320 con 0x7f049006b9c0 2023-10-18T22:13:52.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.512+0000 7f0486ffd700 1 -- 172.21.15.8:0/172687777 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f048000f040 con 0x7f049006b9c0 2023-10-18T22:13:52.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.512+0000 7f0486ffd700 1 -- 172.21.15.8:0/172687777 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04800148a0 con 0x7f049006b9c0 2023-10-18T22:13:52.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.512+0000 7f0497208700 1 -- 172.21.15.8:0/172687777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049010e8c0 con 0x7f049006b9c0 2023-10-18T22:13:52.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.512+0000 7f0497208700 1 -- 172.21.15.8:0/172687777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049010ee80 con 0x7f049006b9c0 2023-10-18T22:13:52.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.513+0000 7f0497208700 1 -- 172.21.15.8:0/172687777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0490045ad0 con 0x7f049006b9c0 2023-10-18T22:13:52.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.514+0000 7f0486ffd700 1 -- 172.21.15.8:0/172687777 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0480009480 con 0x7f049006b9c0 2023-10-18T22:13:52.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.515+0000 7f0486ffd700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f047c060f70 0x7f047c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:52.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.515+0000 7f0486ffd700 1 -- 172.21.15.8:0/172687777 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f048007cf60 con 0x7f049006b9c0 2023-10-18T22:13:52.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.515+0000 7f0496206700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f047c060f70 0x7f047c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:52.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.516+0000 7f0496206700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f047c060f70 0x7f047c063430 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f048c005010 tx=0x7f048c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:52.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.519+0000 7f0486ffd700 1 -- 172.21.15.8:0/172687777 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f04800505c0 con 0x7f049006b9c0 2023-10-18T22:13:52.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.708+0000 7f0497208700 1 -- 172.21.15.8:0/172687777 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0490105430 con 0x7f047c060f70 2023-10-18T22:13:52.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.718+0000 7f0486ffd700 1 -- 172.21.15.8:0/172687777 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0490105430 con 0x7f047c060f70 2023-10-18T22:13:52.719 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:13:52.719 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (80m) 7m ago 82m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:13:52.720 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (74m) 7m ago 81m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:13:52.720 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (74m) 5m ago 81m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:13:52.720 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (80m) 7m ago 81m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:13:52.720 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 78m - - 2023-10-18T22:13:52.720 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 77m - - 2023-10-18T22:13:52.721 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 78m - - 2023-10-18T22:13:52.721 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 77m - - 2023-10-18T22:13:52.721 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (75m) 7m ago 83m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:13:52.721 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (75m) 5m ago 81m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:13:52.721 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (74m) 7m ago 83m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:13:52.722 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (74m) 5m ago 81m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:13:52.722 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (81m) 7m ago 81m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:13:52.722 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (80m) 5m ago 80m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:13:52.722 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (74m) 7m ago 80m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:13:52.722 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (72m) 7m ago 80m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:13:52.723 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (71m) 7m ago 79m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:13:52.723 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (71m) 5m ago 79m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:13:52.723 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (70m) 5m ago 79m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:13:52.723 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (70m) 5m ago 79m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:13:52.723 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (76m) 7m ago 81m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:13:52.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 -- 172.21.15.8:0/172687777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f047c060f70 msgr2=0x7f047c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f047c060f70 0x7f047c063430 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f048c005010 tx=0x7f048c009b30).stop 2023-10-18T22:13:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 -- 172.21.15.8:0/172687777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f049006b9c0 msgr2=0x7f049010d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f049006b9c0 0x7f049010d830 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f04800026d0 tx=0x7f0480009de0).stop 2023-10-18T22:13:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 -- 172.21.15.8:0/172687777 shutdown_connections 2023-10-18T22:13:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f047c060f70 0x7f047c063430 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f049006a3b0 0x7f049010d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 --2- 172.21.15.8:0/172687777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f049006b9c0 0x7f049010d830 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 -- 172.21.15.8:0/172687777 >> 172.21.15.8:0/172687777 conn(0x7f04900f1cd0 msgr2=0x7f04900f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:52.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 -- 172.21.15.8:0/172687777 shutdown_connections 2023-10-18T22:13:52.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.720+0000 7f0497208700 1 -- 172.21.15.8:0/172687777 wait complete. 2023-10-18T22:13:52.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.858+0000 7f136a472700 1 -- 172.21.15.8:0/1045345853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13640f9690 msgr2=0x7f13640fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.858+0000 7f136a472700 1 --2- 172.21.15.8:0/1045345853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13640f9690 0x7f13640fbae0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f1354004660 tx=0x7f1354009b30).stop 2023-10-18T22:13:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.858+0000 7f136a472700 1 -- 172.21.15.8:0/1045345853 shutdown_connections 2023-10-18T22:13:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.858+0000 7f136a472700 1 --2- 172.21.15.8:0/1045345853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13640f9690 0x7f13640fbae0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.858+0000 7f136a472700 1 --2- 172.21.15.8:0/1045345853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1364060310 0x7f13640f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.858+0000 7f136a472700 1 -- 172.21.15.8:0/1045345853 >> 172.21.15.8:0/1045345853 conn(0x7f13640f0b90 msgr2=0x7f13640f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:52.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.858+0000 7f136a472700 1 -- 172.21.15.8:0/1045345853 shutdown_connections 2023-10-18T22:13:52.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.858+0000 7f136a472700 1 -- 172.21.15.8:0/1045345853 wait complete. 2023-10-18T22:13:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.859+0000 7f136a472700 1 Processor -- start 2023-10-18T22:13:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.859+0000 7f136a472700 1 -- start start 2023-10-18T22:13:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.859+0000 7f136a472700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1364060310 0x7f1364108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.859+0000 7f136a472700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13640f9690 0x7f1364109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.859+0000 7f136a472700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13641099b0 con 0x7f13640f9690 2023-10-18T22:13:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.859+0000 7f136a472700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1364109af0 con 0x7f1364060310 2023-10-18T22:13:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.860+0000 7f1368c6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13640f9690 0x7f1364109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.860+0000 7f1368c6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13640f9690 0x7f1364109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46432/0 (socket says 172.21.15.8:46432) 2023-10-18T22:13:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.860+0000 7f1368c6f700 1 -- 172.21.15.8:0/1133173239 learned_addr learned my addr 172.21.15.8:0/1133173239 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.860+0000 7f1369470700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1364060310 0x7f1364108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.860+0000 7f1368c6f700 1 -- 172.21.15.8:0/1133173239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1364060310 msgr2=0x7f1364108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.860+0000 7f1368c6f700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1364060310 0x7f1364108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.860+0000 7f1368c6f700 1 -- 172.21.15.8:0/1133173239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1354005040 con 0x7f13640f9690 2023-10-18T22:13:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.860+0000 7f1368c6f700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13640f9690 0x7f1364109400 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f1354009870 tx=0x7f135400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:52.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.861+0000 7f1359ffb700 1 -- 172.21.15.8:0/1133173239 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1354019070 con 0x7f13640f9690 2023-10-18T22:13:52.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.861+0000 7f1359ffb700 1 -- 172.21.15.8:0/1133173239 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1354013380 con 0x7f13640f9690 2023-10-18T22:13:52.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.861+0000 7f136a472700 1 -- 172.21.15.8:0/1133173239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136410a430 con 0x7f13640f9690 2023-10-18T22:13:52.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.861+0000 7f1359ffb700 1 -- 172.21.15.8:0/1133173239 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f135401edf0 con 0x7f13640f9690 2023-10-18T22:13:52.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.861+0000 7f136a472700 1 -- 172.21.15.8:0/1133173239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136410a910 con 0x7f13640f9690 2023-10-18T22:13:52.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.862+0000 7f136a472700 1 -- 172.21.15.8:0/1133173239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1364045ad0 con 0x7f13640f9690 2023-10-18T22:13:52.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.863+0000 7f1359ffb700 1 -- 172.21.15.8:0/1133173239 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f135401e420 con 0x7f13640f9690 2023-10-18T22:13:52.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.864+0000 7f1359ffb700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1350060f70 0x7f1350063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:52.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.864+0000 7f1359ffb700 1 -- 172.21.15.8:0/1133173239 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f135407dd00 con 0x7f13640f9690 2023-10-18T22:13:52.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.864+0000 7f1369470700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1350060f70 0x7f1350063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:52.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.864+0000 7f1369470700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1350060f70 0x7f1350063430 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f1360009fd0 tx=0x7f136000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:52.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:52.868+0000 7f1359ffb700 1 -- 172.21.15.8:0/1133173239 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1354051360 con 0x7f13640f9690 2023-10-18T22:13:53.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.125+0000 7f136a472700 1 -- 172.21.15.8:0/1133173239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13640fecc0 con 0x7f13640f9690 2023-10-18T22:13:53.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.126+0000 7f1359ffb700 1 -- 172.21.15.8:0/1133173239 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f1354050f50 con 0x7f13640f9690 2023-10-18T22:13:53.127 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:13:53.128 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:13:53.128 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:13:53.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:13:53.128 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:13:53.129 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:13:53.129 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:13:53.129 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:13:53.129 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:13:53.129 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:13:53.130 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:13:53.130 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:13:53.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:13:53.130 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:13:53.130 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:13:53.131 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:13:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:13:53.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 -- 172.21.15.8:0/1133173239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1350060f70 msgr2=0x7f1350063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:53.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1350060f70 0x7f1350063430 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f1360009fd0 tx=0x7f136000b040).stop 2023-10-18T22:13:53.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 -- 172.21.15.8:0/1133173239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13640f9690 msgr2=0x7f1364109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:53.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13640f9690 0x7f1364109400 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f1354009870 tx=0x7f135400b040).stop 2023-10-18T22:13:53.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 -- 172.21.15.8:0/1133173239 shutdown_connections 2023-10-18T22:13:53.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1350060f70 0x7f1350063430 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1364060310 0x7f1364108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 --2- 172.21.15.8:0/1133173239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13640f9690 0x7f1364109400 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 -- 172.21.15.8:0/1133173239 >> 172.21.15.8:0/1133173239 conn(0x7f13640f0b90 msgr2=0x7f13640f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:53.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 -- 172.21.15.8:0/1133173239 shutdown_connections 2023-10-18T22:13:53.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.128+0000 7f136a472700 1 -- 172.21.15.8:0/1133173239 wait complete. 2023-10-18T22:13:53.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.263+0000 7fab6a53e700 1 -- 172.21.15.8:0/388777961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab640f77d0 msgr2=0x7fab640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:53.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.263+0000 7fab6a53e700 1 --2- 172.21.15.8:0/388777961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab640f77d0 0x7fab640f7c30 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7fab54004660 tx=0x7fab54009b30).stop 2023-10-18T22:13:53.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.263+0000 7fab6a53e700 1 -- 172.21.15.8:0/388777961 shutdown_connections 2023-10-18T22:13:53.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.263+0000 7fab6a53e700 1 --2- 172.21.15.8:0/388777961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab640f77d0 0x7fab640f7c30 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.263+0000 7fab6a53e700 1 --2- 172.21.15.8:0/388777961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640f6530 0x7fab640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.263+0000 7fab6a53e700 1 -- 172.21.15.8:0/388777961 >> 172.21.15.8:0/388777961 conn(0x7fab640f1c90 msgr2=0x7fab640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:53.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.264+0000 7fab6a53e700 1 -- 172.21.15.8:0/388777961 shutdown_connections 2023-10-18T22:13:53.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.264+0000 7fab6a53e700 1 -- 172.21.15.8:0/388777961 wait complete. 2023-10-18T22:13:53.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.264+0000 7fab6a53e700 1 Processor -- start 2023-10-18T22:13:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.265+0000 7fab6a53e700 1 -- start start 2023-10-18T22:13:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.265+0000 7fab6a53e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640f6530 0x7fab64106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.265+0000 7fab6a53e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab640f77d0 0x7fab64107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.265+0000 7fab6a53e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64107850 con 0x7fab640f77d0 2023-10-18T22:13:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.265+0000 7fab6a53e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64108060 con 0x7fab640f6530 2023-10-18T22:13:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.265+0000 7fab68d3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab640f77d0 0x7fab64107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.265+0000 7fab68d3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab640f77d0 0x7fab64107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46450/0 (socket says 172.21.15.8:46450) 2023-10-18T22:13:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.265+0000 7fab68d3b700 1 -- 172.21.15.8:0/1563642426 learned_addr learned my addr 172.21.15.8:0/1563642426 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.265+0000 7fab6953c700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640f6530 0x7fab64106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.266+0000 7fab68d3b700 1 -- 172.21.15.8:0/1563642426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640f6530 msgr2=0x7fab64106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.266+0000 7fab68d3b700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640f6530 0x7fab64106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.266+0000 7fab68d3b700 1 -- 172.21.15.8:0/1563642426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54005040 con 0x7fab640f77d0 2023-10-18T22:13:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.266+0000 7fab6953c700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640f6530 0x7fab64106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:13:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.266+0000 7fab68d3b700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab640f77d0 0x7fab64107250 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7fab54004320 tx=0x7fab5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.266+0000 7fab59ffb700 1 -- 172.21.15.8:0/1563642426 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab54019070 con 0x7fab640f77d0 2023-10-18T22:13:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.266+0000 7fab6a53e700 1 -- 172.21.15.8:0/1563642426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab64108280 con 0x7fab640f77d0 2023-10-18T22:13:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.266+0000 7fab59ffb700 1 -- 172.21.15.8:0/1563642426 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fab5401e420 con 0x7fab640f77d0 2023-10-18T22:13:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.266+0000 7fab59ffb700 1 -- 172.21.15.8:0/1563642426 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab54014660 con 0x7fab640f77d0 2023-10-18T22:13:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.266+0000 7fab6a53e700 1 -- 172.21.15.8:0/1563642426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab64108760 con 0x7fab640f77d0 2023-10-18T22:13:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.267+0000 7fab6a53e700 1 -- 172.21.15.8:0/1563642426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab64059100 con 0x7fab640f77d0 2023-10-18T22:13:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.268+0000 7fab59ffb700 1 -- 172.21.15.8:0/1563642426 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fab5401e590 con 0x7fab640f77d0 2023-10-18T22:13:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.269+0000 7fab59ffb700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab50060f70 0x7fab50063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.269+0000 7fab59ffb700 1 -- 172.21.15.8:0/1563642426 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fab5407deb0 con 0x7fab640f77d0 2023-10-18T22:13:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.269+0000 7fab6953c700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab50060f70 0x7fab50063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.270+0000 7fab6953c700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab50060f70 0x7fab50063430 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fab64106ad0 tx=0x7fab6000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.273+0000 7fab59ffb700 1 -- 172.21.15.8:0/1563642426 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fab5404da00 con 0x7fab640f77d0 2023-10-18T22:13:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.497+0000 7fab6a53e700 1 -- 172.21.15.8:0/1563642426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab640fedc0 con 0x7fab640f77d0 2023-10-18T22:13:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.498+0000 7fab59ffb700 1 -- 172.21.15.8:0/1563642426 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fab54051020 con 0x7fab640f77d0 2023-10-18T22:13:53.500 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:13:53.500 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:13:53.500 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:13:53.500 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:13:53.501 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:13:53.501 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:13:53.501 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:13:53.501 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:13:53.501 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:13:53.502 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:13:53.502 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:13:53.502 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:13:53.502 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:13:53.502 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:13:53.503 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:13:53.503 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:13:53.503 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:13:53.503 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:13:53.503 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:13:53.504 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:13:53.504 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:13:53.504 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:13:53.504 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:13:53.504 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:13:53.505 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:13:53.505 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:13:53.505 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:13:53.505 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:13:53.505 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:13:53.506 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:13:53.506 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:13:53.506 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:13:53.506 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:13:53.506 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:13:53.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 -- 172.21.15.8:0/1563642426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab50060f70 msgr2=0x7fab50063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:53.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab50060f70 0x7fab50063430 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fab64106ad0 tx=0x7fab6000b040).stop 2023-10-18T22:13:53.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 -- 172.21.15.8:0/1563642426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab640f77d0 msgr2=0x7fab64107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:53.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab640f77d0 0x7fab64107250 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7fab54004320 tx=0x7fab5400b040).stop 2023-10-18T22:13:53.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 -- 172.21.15.8:0/1563642426 shutdown_connections 2023-10-18T22:13:53.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fab50060f70 0x7fab50063430 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640f6530 0x7fab64106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 --2- 172.21.15.8:0/1563642426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab640f77d0 0x7fab64107250 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 -- 172.21.15.8:0/1563642426 >> 172.21.15.8:0/1563642426 conn(0x7fab640f1c90 msgr2=0x7fab640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:53.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 -- 172.21.15.8:0/1563642426 shutdown_connections 2023-10-18T22:13:53.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.500+0000 7fab6a53e700 1 -- 172.21.15.8:0/1563642426 wait complete. 2023-10-18T22:13:53.509 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:13:53.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.637+0000 7ff655c1f700 1 -- 172.21.15.8:0/1644032105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff65006b9c0 msgr2=0x7ff650069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:53.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.637+0000 7ff655c1f700 1 --2- 172.21.15.8:0/1644032105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff65006b9c0 0x7ff650069ec0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7ff644004660 tx=0x7ff644009b30).stop 2023-10-18T22:13:53.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.638+0000 7ff655c1f700 1 -- 172.21.15.8:0/1644032105 shutdown_connections 2023-10-18T22:13:53.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.638+0000 7ff655c1f700 1 --2- 172.21.15.8:0/1644032105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65006a3b0 0x7ff65006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.638+0000 7ff655c1f700 1 --2- 172.21.15.8:0/1644032105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff65006b9c0 0x7ff650069ec0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.638+0000 7ff655c1f700 1 -- 172.21.15.8:0/1644032105 >> 172.21.15.8:0/1644032105 conn(0x7ff6500f1c90 msgr2=0x7ff6500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:53.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.638+0000 7ff655c1f700 1 -- 172.21.15.8:0/1644032105 shutdown_connections 2023-10-18T22:13:53.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.638+0000 7ff655c1f700 1 -- 172.21.15.8:0/1644032105 wait complete. 2023-10-18T22:13:53.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.638+0000 7ff655c1f700 1 Processor -- start 2023-10-18T22:13:53.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.639+0000 7ff655c1f700 1 -- start start 2023-10-18T22:13:53.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.639+0000 7ff655c1f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff65006a3b0 0x7ff650108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:53.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.639+0000 7ff655c1f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65006b9c0 0x7ff6501094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:53.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.639+0000 7ff655c1f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff650109a50 con 0x7ff65006a3b0 2023-10-18T22:13:53.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.639+0000 7ff655c1f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff650109b90 con 0x7ff65006b9c0 2023-10-18T22:13:53.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.639+0000 7ff654c1d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff65006a3b0 0x7ff650108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:53.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.639+0000 7ff654c1d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff65006a3b0 0x7ff650108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46456/0 (socket says 172.21.15.8:46456) 2023-10-18T22:13:53.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.639+0000 7ff64ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65006b9c0 0x7ff6501094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:53.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.639+0000 7ff654c1d700 1 -- 172.21.15.8:0/1855150487 learned_addr learned my addr 172.21.15.8:0/1855150487 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:13:53.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.640+0000 7ff654c1d700 1 -- 172.21.15.8:0/1855150487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65006b9c0 msgr2=0x7ff6501094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:53.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.640+0000 7ff654c1d700 1 --2- 172.21.15.8:0/1855150487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65006b9c0 0x7ff6501094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.640+0000 7ff654c1d700 1 -- 172.21.15.8:0/1855150487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff644005040 con 0x7ff65006a3b0 2023-10-18T22:13:53.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.640+0000 7ff654c1d700 1 --2- 172.21.15.8:0/1855150487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff65006a3b0 0x7ff650108fb0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7ff644009990 tx=0x7ff644009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:53.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.640+0000 7ff64d7fa700 1 -- 172.21.15.8:0/1855150487 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff644018070 con 0x7ff65006a3b0 2023-10-18T22:13:53.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.640+0000 7ff64d7fa700 1 -- 172.21.15.8:0/1855150487 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff644009630 con 0x7ff65006a3b0 2023-10-18T22:13:53.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.640+0000 7ff64d7fa700 1 -- 172.21.15.8:0/1855150487 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff64401c3c0 con 0x7ff65006a3b0 2023-10-18T22:13:53.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.640+0000 7ff655c1f700 1 -- 172.21.15.8:0/1855150487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65010a4d0 con 0x7ff65006a3b0 2023-10-18T22:13:53.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.640+0000 7ff655c1f700 1 -- 172.21.15.8:0/1855150487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65010aa30 con 0x7ff65006a3b0 2023-10-18T22:13:53.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.641+0000 7ff655c1f700 1 -- 172.21.15.8:0/1855150487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff650045ad0 con 0x7ff65006a3b0 2023-10-18T22:13:53.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.642+0000 7ff64d7fa700 1 -- 172.21.15.8:0/1855150487 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff64401d970 con 0x7ff65006a3b0 2023-10-18T22:13:53.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.644+0000 7ff64d7fa700 1 --2- 172.21.15.8:0/1855150487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff640060f70 0x7ff640063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:13:53.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.644+0000 7ff64d7fa700 1 -- 172.21.15.8:0/1855150487 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff64407e580 con 0x7ff65006a3b0 2023-10-18T22:13:53.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.644+0000 7ff64ffff700 1 --2- 172.21.15.8:0/1855150487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff640060f70 0x7ff640063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:13:53.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.644+0000 7ff64ffff700 1 --2- 172.21.15.8:0/1855150487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff640060f70 0x7ff640063430 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7ff63c004c40 tx=0x7ff63c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:13:53.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.648+0000 7ff64d7fa700 1 -- 172.21.15.8:0/1855150487 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff644051be0 con 0x7ff65006a3b0 2023-10-18T22:13:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:51.564591+0000 mgr.smithi008.flmjzp (mgr.14640) 4497 : cluster [DBG] pgmap v3087: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:52.020441+0000 mgr.smithi008.flmjzp (mgr.14640) 4498 : audit [DBG] from='client.37624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:52.369955+0000 mgr.smithi008.flmjzp (mgr.14640) 4499 : audit [DBG] from='client.37628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:53.126390+0000 mon.smithi008 (mon.0) 4794 : audit [DBG] from='client.? 172.21.15.8:0/1133173239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:51.564591+0000 mgr.smithi008.flmjzp (mgr.14640) 4497 : cluster [DBG] pgmap v3087: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:52.020441+0000 mgr.smithi008.flmjzp (mgr.14640) 4498 : audit [DBG] from='client.37624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:52.369955+0000 mgr.smithi008.flmjzp (mgr.14640) 4499 : audit [DBG] from='client.37628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:53.126390+0000 mon.smithi008 (mon.0) 4794 : audit [DBG] from='client.? 172.21.15.8:0/1133173239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:53.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.848+0000 7ff655c1f700 1 -- 172.21.15.8:0/1855150487 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6500008d0 con 0x7ff640060f70 2023-10-18T22:13:53.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.850+0000 7ff64d7fa700 1 -- 172.21.15.8:0/1855150487 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff6500008d0 con 0x7ff640060f70 2023-10-18T22:13:53.851 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:13:53.852 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:13:53.852 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:13:53.852 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:13:53.852 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:13:53.852 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:13:53.853 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:13:53.853 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:13:53.853 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:13:53.853 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:13:53.853 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:13:53.854 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:13:53.854 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:13:53.854 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:13:53.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 -- 172.21.15.8:0/1855150487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff640060f70 msgr2=0x7ff640063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:53.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 --2- 172.21.15.8:0/1855150487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff640060f70 0x7ff640063430 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7ff63c004c40 tx=0x7ff63c00b040).stop 2023-10-18T22:13:53.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 -- 172.21.15.8:0/1855150487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff65006a3b0 msgr2=0x7ff650108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:13:53.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 --2- 172.21.15.8:0/1855150487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff65006a3b0 0x7ff650108fb0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7ff644009990 tx=0x7ff644009b30).stop 2023-10-18T22:13:53.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 -- 172.21.15.8:0/1855150487 shutdown_connections 2023-10-18T22:13:53.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 --2- 172.21.15.8:0/1855150487 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff640060f70 0x7ff640063430 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 --2- 172.21.15.8:0/1855150487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff65006a3b0 0x7ff650108fb0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 --2- 172.21.15.8:0/1855150487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65006b9c0 0x7ff6501094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:13:53.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 -- 172.21.15.8:0/1855150487 >> 172.21.15.8:0/1855150487 conn(0x7ff6500f1c90 msgr2=0x7ff6500fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:13:53.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 -- 172.21.15.8:0/1855150487 shutdown_connections 2023-10-18T22:13:53.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:13:53.852+0000 7ff655c1f700 1 -- 172.21.15.8:0/1855150487 wait complete. 2023-10-18T22:13:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:52.709643+0000 mgr.smithi008.flmjzp (mgr.14640) 4500 : audit [DBG] from='client.37632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:53.498620+0000 mon.smithi008 (mon.0) 4795 : audit [DBG] from='client.? 172.21.15.8:0/1563642426' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:13:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:52.709643+0000 mgr.smithi008.flmjzp (mgr.14640) 4500 : audit [DBG] from='client.37632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:53.498620+0000 mon.smithi008 (mon.0) 4795 : audit [DBG] from='client.? 172.21.15.8:0/1563642426' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:13:55.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:53.565052+0000 mgr.smithi008.flmjzp (mgr.14640) 4501 : cluster [DBG] pgmap v3088: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:55.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:53.850223+0000 mgr.smithi008.flmjzp (mgr.14640) 4502 : audit [DBG] from='client.37644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:53.565052+0000 mgr.smithi008.flmjzp (mgr.14640) 4501 : cluster [DBG] pgmap v3088: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:53.850223+0000 mgr.smithi008.flmjzp (mgr.14640) 4502 : audit [DBG] from='client.37644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:13:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:55.565712+0000 mgr.smithi008.flmjzp (mgr.14640) 4503 : cluster [DBG] pgmap v3089: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:55.565712+0000 mgr.smithi008.flmjzp (mgr.14640) 4503 : cluster [DBG] pgmap v3089: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:57.595117+0000 mon.smithi008 (mon.0) 4796 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:58.153627+0000 mon.smithi008 (mon.0) 4797 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:58.154507+0000 mon.smithi008 (mon.0) 4798 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:58.159680+0000 mon.smithi008 (mon.0) 4799 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:58.165625+0000 mon.smithi008 (mon.0) 4800 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:58.168161+0000 mon.smithi008 (mon.0) 4801 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:58.169621+0000 mon.smithi008 (mon.0) 4802 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:58.171024+0000 mon.smithi008 (mon.0) 4803 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:13:58.172985+0000 mon.smithi008 (mon.0) 4804 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:57.595117+0000 mon.smithi008 (mon.0) 4796 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:58.153627+0000 mon.smithi008 (mon.0) 4797 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:13:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:58.154507+0000 mon.smithi008 (mon.0) 4798 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:13:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:58.159680+0000 mon.smithi008 (mon.0) 4799 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:13:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:58.165625+0000 mon.smithi008 (mon.0) 4800 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:13:58.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:58.168161+0000 mon.smithi008 (mon.0) 4801 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:58.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:58.169621+0000 mon.smithi008 (mon.0) 4802 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:58.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:58.171024+0000 mon.smithi008 (mon.0) 4803 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:58.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:13:58.172985+0000 mon.smithi008 (mon.0) 4804 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:13:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:57.566208+0000 mgr.smithi008.flmjzp (mgr.14640) 4504 : cluster [DBG] pgmap v3090: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:58.155167+0000 mgr.smithi008.flmjzp (mgr.14640) 4505 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:58.155647+0000 mgr.smithi008.flmjzp (mgr.14640) 4506 : cluster [DBG] pgmap v3091: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:13:58.155835+0000 mgr.smithi008.flmjzp (mgr.14640) 4507 : cluster [DBG] pgmap v3092: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:13:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:13:58.174703+0000 mgr.smithi008.flmjzp (mgr.14640) 4508 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:13:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:57.566208+0000 mgr.smithi008.flmjzp (mgr.14640) 4504 : cluster [DBG] pgmap v3090: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:58.155167+0000 mgr.smithi008.flmjzp (mgr.14640) 4505 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:13:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:58.155647+0000 mgr.smithi008.flmjzp (mgr.14640) 4506 : cluster [DBG] pgmap v3091: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:13:58.155835+0000 mgr.smithi008.flmjzp (mgr.14640) 4507 : cluster [DBG] pgmap v3092: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:13:59.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:13:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:13:58.174703+0000 mgr.smithi008.flmjzp (mgr.14640) 4508 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:00.156537+0000 mgr.smithi008.flmjzp (mgr.14640) 4509 : cluster [DBG] pgmap v3093: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:00.156537+0000 mgr.smithi008.flmjzp (mgr.14640) 4509 : cluster [DBG] pgmap v3093: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:02.157110+0000 mgr.smithi008.flmjzp (mgr.14640) 4510 : cluster [DBG] pgmap v3094: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:02.157110+0000 mgr.smithi008.flmjzp (mgr.14640) 4510 : cluster [DBG] pgmap v3094: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:04.157830+0000 mgr.smithi008.flmjzp (mgr.14640) 4511 : cluster [DBG] pgmap v3095: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:04.157830+0000 mgr.smithi008.flmjzp (mgr.14640) 4511 : cluster [DBG] pgmap v3095: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:07.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:06.158362+0000 mgr.smithi008.flmjzp (mgr.14640) 4512 : cluster [DBG] pgmap v3096: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:07.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:06.158362+0000 mgr.smithi008.flmjzp (mgr.14640) 4512 : cluster [DBG] pgmap v3096: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:08.159009+0000 mgr.smithi008.flmjzp (mgr.14640) 4513 : cluster [DBG] pgmap v3097: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:08.185479+0000 mon.smithi008 (mon.0) 4805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:08.187692+0000 mon.smithi008 (mon.0) 4806 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:14:09.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:08.188718+0000 mon.smithi008 (mon.0) 4807 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:14:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:08.189581+0000 mgr.smithi008.flmjzp (mgr.14640) 4514 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:14:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:08.190234+0000 mgr.smithi008.flmjzp (mgr.14640) 4515 : cluster [DBG] pgmap v3098: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:08.190592+0000 mgr.smithi008.flmjzp (mgr.14640) 4516 : cluster [DBG] pgmap v3099: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:09.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:08.194627+0000 mon.smithi008 (mon.0) 4808 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:14:09.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:08.201082+0000 mon.smithi008 (mon.0) 4809 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:09.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:08.204181+0000 mon.smithi008 (mon.0) 4810 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:09.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:08.205841+0000 mon.smithi008 (mon.0) 4811 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:09.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:08.207391+0000 mon.smithi008 (mon.0) 4812 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:09.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:08.209446+0000 mon.smithi008 (mon.0) 4813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:09.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:08.211586+0000 mgr.smithi008.flmjzp (mgr.14640) 4517 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:08.159009+0000 mgr.smithi008.flmjzp (mgr.14640) 4513 : cluster [DBG] pgmap v3097: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:08.185479+0000 mon.smithi008 (mon.0) 4805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:08.187692+0000 mon.smithi008 (mon.0) 4806 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:14:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:08.188718+0000 mon.smithi008 (mon.0) 4807 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:14:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:08.189581+0000 mgr.smithi008.flmjzp (mgr.14640) 4514 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:14:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:08.190234+0000 mgr.smithi008.flmjzp (mgr.14640) 4515 : cluster [DBG] pgmap v3098: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:08.190592+0000 mgr.smithi008.flmjzp (mgr.14640) 4516 : cluster [DBG] pgmap v3099: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:08.194627+0000 mon.smithi008 (mon.0) 4808 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:14:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:08.201082+0000 mon.smithi008 (mon.0) 4809 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:08.204181+0000 mon.smithi008 (mon.0) 4810 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:09.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:08.205841+0000 mon.smithi008 (mon.0) 4811 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:09.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:08.207391+0000 mon.smithi008 (mon.0) 4812 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:09.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:08.209446+0000 mon.smithi008 (mon.0) 4813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:09.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:08.211586+0000 mgr.smithi008.flmjzp (mgr.14640) 4517 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:10.191385+0000 mgr.smithi008.flmjzp (mgr.14640) 4518 : cluster [DBG] pgmap v3100: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:10.191385+0000 mgr.smithi008.flmjzp (mgr.14640) 4518 : cluster [DBG] pgmap v3100: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:12.191868+0000 mgr.smithi008.flmjzp (mgr.14640) 4519 : cluster [DBG] pgmap v3101: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:12.191868+0000 mgr.smithi008.flmjzp (mgr.14640) 4519 : cluster [DBG] pgmap v3101: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:14.192567+0000 mgr.smithi008.flmjzp (mgr.14640) 4520 : cluster [DBG] pgmap v3102: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:14.192567+0000 mgr.smithi008.flmjzp (mgr.14640) 4520 : cluster [DBG] pgmap v3102: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:17.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:16.193178+0000 mgr.smithi008.flmjzp (mgr.14640) 4521 : cluster [DBG] pgmap v3103: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:16.193178+0000 mgr.smithi008.flmjzp (mgr.14640) 4521 : cluster [DBG] pgmap v3103: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:18.222425+0000 mon.smithi008 (mon.0) 4814 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:18.222425+0000 mon.smithi008 (mon.0) 4814 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:18.193769+0000 mgr.smithi008.flmjzp (mgr.14640) 4522 : cluster [DBG] pgmap v3104: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:19.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:18.778437+0000 mon.smithi008 (mon.0) 4815 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:14:19.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:18.779573+0000 mon.smithi008 (mon.0) 4816 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:14:19.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:18.786239+0000 mon.smithi008 (mon.0) 4817 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:14:19.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:18.792577+0000 mon.smithi008 (mon.0) 4818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:19.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:18.795673+0000 mon.smithi008 (mon.0) 4819 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:19.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:18.797511+0000 mon.smithi008 (mon.0) 4820 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:19.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:18.799102+0000 mon.smithi008 (mon.0) 4821 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:19.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:18.801124+0000 mon.smithi008 (mon.0) 4822 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:18.193769+0000 mgr.smithi008.flmjzp (mgr.14640) 4522 : cluster [DBG] pgmap v3104: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:18.778437+0000 mon.smithi008 (mon.0) 4815 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:14:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:18.779573+0000 mon.smithi008 (mon.0) 4816 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:14:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:18.786239+0000 mon.smithi008 (mon.0) 4817 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:14:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:18.792577+0000 mon.smithi008 (mon.0) 4818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:18.795673+0000 mon.smithi008 (mon.0) 4819 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:18.797511+0000 mon.smithi008 (mon.0) 4820 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:19.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:18.799102+0000 mon.smithi008 (mon.0) 4821 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:19.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:18.801124+0000 mon.smithi008 (mon.0) 4822 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:18.780535+0000 mgr.smithi008.flmjzp (mgr.14640) 4523 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:14:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:18.781274+0000 mgr.smithi008.flmjzp (mgr.14640) 4524 : cluster [DBG] pgmap v3105: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:18.781620+0000 mgr.smithi008.flmjzp (mgr.14640) 4525 : cluster [DBG] pgmap v3106: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:18.803001+0000 mgr.smithi008.flmjzp (mgr.14640) 4526 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:18.780535+0000 mgr.smithi008.flmjzp (mgr.14640) 4523 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:14:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:18.781274+0000 mgr.smithi008.flmjzp (mgr.14640) 4524 : cluster [DBG] pgmap v3105: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:18.781620+0000 mgr.smithi008.flmjzp (mgr.14640) 4525 : cluster [DBG] pgmap v3106: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:18.803001+0000 mgr.smithi008.flmjzp (mgr.14640) 4526 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:20.782130+0000 mgr.smithi008.flmjzp (mgr.14640) 4527 : cluster [DBG] pgmap v3107: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:20.782130+0000 mgr.smithi008.flmjzp (mgr.14640) 4527 : cluster [DBG] pgmap v3107: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.004+0000 7f407f138700 1 -- 172.21.15.8:0/1068370265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40780f6530 msgr2=0x7f40780f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.004+0000 7f407f138700 1 --2- 172.21.15.8:0/1068370265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40780f6530 0x7f40780f6950 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7f4074004660 tx=0x7f4074009b30).stop 2023-10-18T22:14:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.004+0000 7f407f138700 1 -- 172.21.15.8:0/1068370265 shutdown_connections 2023-10-18T22:14:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.004+0000 7f407f138700 1 --2- 172.21.15.8:0/1068370265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40780f77d0 0x7f40780f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.004+0000 7f407f138700 1 --2- 172.21.15.8:0/1068370265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40780f6530 0x7f40780f6950 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.004+0000 7f407f138700 1 -- 172.21.15.8:0/1068370265 >> 172.21.15.8:0/1068370265 conn(0x7f40780f1c90 msgr2=0x7f40780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.004+0000 7f407f138700 1 -- 172.21.15.8:0/1068370265 shutdown_connections 2023-10-18T22:14:24.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.004+0000 7f407f138700 1 -- 172.21.15.8:0/1068370265 wait complete. 2023-10-18T22:14:24.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.005+0000 7f407f138700 1 Processor -- start 2023-10-18T22:14:24.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.005+0000 7f407f138700 1 -- start start 2023-10-18T22:14:24.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.005+0000 7f407f138700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40780f6530 0x7f4078108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:24.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.005+0000 7f407f138700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40780f77d0 0x7f40781094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:24.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.005+0000 7f407f138700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078109a70 con 0x7f40780f77d0 2023-10-18T22:14:24.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.005+0000 7f407f138700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078109bb0 con 0x7f40780f6530 2023-10-18T22:14:24.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.005+0000 7f407d935700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40780f77d0 0x7f40781094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:24.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f407d935700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40780f77d0 0x7f40781094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38540/0 (socket says 172.21.15.8:38540) 2023-10-18T22:14:24.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f407d935700 1 -- 172.21.15.8:0/3239414949 learned_addr learned my addr 172.21.15.8:0/3239414949 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:24.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f407e136700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40780f6530 0x7f4078108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:24.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f407d935700 1 -- 172.21.15.8:0/3239414949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40780f6530 msgr2=0x7f4078108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f407d935700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40780f6530 0x7f4078108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f407d935700 1 -- 172.21.15.8:0/3239414949 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4074005040 con 0x7f40780f77d0 2023-10-18T22:14:24.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f407d935700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40780f77d0 0x7f40781094c0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7f40680026d0 tx=0x7f4068009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:24.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f406effd700 1 -- 172.21.15.8:0/3239414949 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40680079c0 con 0x7f40780f77d0 2023-10-18T22:14:24.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f406effd700 1 -- 172.21.15.8:0/3239414949 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f406800f040 con 0x7f40780f77d0 2023-10-18T22:14:24.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f406effd700 1 -- 172.21.15.8:0/3239414949 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4068014980 con 0x7f40780f77d0 2023-10-18T22:14:24.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.006+0000 7f407f138700 1 -- 172.21.15.8:0/3239414949 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407810a550 con 0x7f40780f77d0 2023-10-18T22:14:24.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.007+0000 7f407f138700 1 -- 172.21.15.8:0/3239414949 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407810ab10 con 0x7f40780f77d0 2023-10-18T22:14:24.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.008+0000 7f407f138700 1 -- 172.21.15.8:0/3239414949 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4078045ad0 con 0x7f40780f77d0 2023-10-18T22:14:24.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.009+0000 7f406effd700 1 -- 172.21.15.8:0/3239414949 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f40680090d0 con 0x7f40780f77d0 2023-10-18T22:14:24.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.010+0000 7f406effd700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4064060f70 0x7f4064063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:24.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.010+0000 7f406effd700 1 -- 172.21.15.8:0/3239414949 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f406807c980 con 0x7f40780f77d0 2023-10-18T22:14:24.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.010+0000 7f407e136700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4064060f70 0x7f4064063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:24.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.011+0000 7f407e136700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4064060f70 0x7f4064063430 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f4074004630 tx=0x7f4074009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.014+0000 7f406effd700 1 -- 172.21.15.8:0/3239414949 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4068050010 con 0x7f40780f77d0 2023-10-18T22:14:24.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.211+0000 7f407f138700 1 -- 172.21.15.8:0/3239414949 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40780fee40 con 0x7f4064060f70 2023-10-18T22:14:24.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.212+0000 7f406effd700 1 -- 172.21.15.8:0/3239414949 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f40780fee40 con 0x7f4064060f70 2023-10-18T22:14:24.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 -- 172.21.15.8:0/3239414949 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4064060f70 msgr2=0x7f4064063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4064060f70 0x7f4064063430 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f4074004630 tx=0x7f4074009b30).stop 2023-10-18T22:14:24.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 -- 172.21.15.8:0/3239414949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40780f77d0 msgr2=0x7f40781094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40780f77d0 0x7f40781094c0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7f40680026d0 tx=0x7f4068009de0).stop 2023-10-18T22:14:24.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 -- 172.21.15.8:0/3239414949 shutdown_connections 2023-10-18T22:14:24.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4064060f70 0x7f4064063430 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40780f6530 0x7f4078108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 --2- 172.21.15.8:0/3239414949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40780f77d0 0x7f40781094c0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 -- 172.21.15.8:0/3239414949 >> 172.21.15.8:0/3239414949 conn(0x7f40780f1c90 msgr2=0x7f407806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:24.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 -- 172.21.15.8:0/3239414949 shutdown_connections 2023-10-18T22:14:24.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.214+0000 7f407f138700 1 -- 172.21.15.8:0/3239414949 wait complete. 2023-10-18T22:14:24.231 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:14:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.353+0000 7f301e79d700 1 -- 172.21.15.8:0/2514371907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180f77d0 msgr2=0x7f30180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.353+0000 7f301e79d700 1 --2- 172.21.15.8:0/2514371907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180f77d0 0x7f30180f7c30 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f3008004660 tx=0x7f3008009b30).stop 2023-10-18T22:14:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.353+0000 7f301e79d700 1 -- 172.21.15.8:0/2514371907 shutdown_connections 2023-10-18T22:14:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.353+0000 7f301e79d700 1 --2- 172.21.15.8:0/2514371907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180f77d0 0x7f30180f7c30 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.353+0000 7f301e79d700 1 --2- 172.21.15.8:0/2514371907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30180f6530 0x7f30180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.353+0000 7f301e79d700 1 -- 172.21.15.8:0/2514371907 >> 172.21.15.8:0/2514371907 conn(0x7f30180f1c90 msgr2=0x7f30180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:24.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.353+0000 7f301e79d700 1 -- 172.21.15.8:0/2514371907 shutdown_connections 2023-10-18T22:14:24.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.353+0000 7f301e79d700 1 -- 172.21.15.8:0/2514371907 wait complete. 2023-10-18T22:14:24.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.354+0000 7f301e79d700 1 Processor -- start 2023-10-18T22:14:24.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.354+0000 7f301e79d700 1 -- start start 2023-10-18T22:14:24.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.355+0000 7f301e79d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30180f6530 0x7f3018108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:24.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.355+0000 7f301e79d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180f77d0 0x7f3018109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:24.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.355+0000 7f301e79d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30181099c0 con 0x7f30180f77d0 2023-10-18T22:14:24.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.355+0000 7f301e79d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018109b00 con 0x7f30180f6530 2023-10-18T22:14:24.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.355+0000 7f301cf9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180f77d0 0x7f3018109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:24.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.355+0000 7f301cf9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180f77d0 0x7f3018109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38564/0 (socket says 172.21.15.8:38564) 2023-10-18T22:14:24.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.355+0000 7f301cf9a700 1 -- 172.21.15.8:0/2997166643 learned_addr learned my addr 172.21.15.8:0/2997166643 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:24.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.355+0000 7f301d79b700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30180f6530 0x7f3018108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.355+0000 7f301cf9a700 1 -- 172.21.15.8:0/2997166643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30180f6530 msgr2=0x7f3018108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.355+0000 7f301cf9a700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30180f6530 0x7f3018108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.356+0000 7f301cf9a700 1 -- 172.21.15.8:0/2997166643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008005040 con 0x7f30180f77d0 2023-10-18T22:14:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.356+0000 7f301cf9a700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180f77d0 0x7f3018109410 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f3008004d80 tx=0x7f300800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.356+0000 7f300dffb700 1 -- 172.21.15.8:0/2997166643 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3008019070 con 0x7f30180f77d0 2023-10-18T22:14:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.356+0000 7f300dffb700 1 -- 172.21.15.8:0/2997166643 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f300801e420 con 0x7f30180f77d0 2023-10-18T22:14:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.356+0000 7f300dffb700 1 -- 172.21.15.8:0/2997166643 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3008014660 con 0x7f30180f77d0 2023-10-18T22:14:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.356+0000 7f301e79d700 1 -- 172.21.15.8:0/2997166643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301810a440 con 0x7f30180f77d0 2023-10-18T22:14:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.356+0000 7f301e79d700 1 -- 172.21.15.8:0/2997166643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301810a880 con 0x7f30180f77d0 2023-10-18T22:14:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.357+0000 7f301e79d700 1 -- 172.21.15.8:0/2997166643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3018045ad0 con 0x7f30180f77d0 2023-10-18T22:14:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.358+0000 7f300dffb700 1 -- 172.21.15.8:0/2997166643 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f300801e590 con 0x7f30180f77d0 2023-10-18T22:14:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.359+0000 7f300dffb700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3004060f70 0x7f3004063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.359+0000 7f300dffb700 1 -- 172.21.15.8:0/2997166643 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f300807de00 con 0x7f30180f77d0 2023-10-18T22:14:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.359+0000 7f301d79b700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3004060f70 0x7f3004063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.360+0000 7f301d79b700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3004060f70 0x7f3004063430 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f3014009fd0 tx=0x7f301400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.363+0000 7f300dffb700 1 -- 172.21.15.8:0/2997166643 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f30080513e0 con 0x7f30180f77d0 2023-10-18T22:14:24.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.562+0000 7f301e79d700 1 -- 172.21.15.8:0/2997166643 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30180fee30 con 0x7f3004060f70 2023-10-18T22:14:24.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.564+0000 7f300dffb700 1 -- 172.21.15.8:0/2997166643 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f30180fee30 con 0x7f3004060f70 2023-10-18T22:14:24.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 -- 172.21.15.8:0/2997166643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3004060f70 msgr2=0x7f3004063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3004060f70 0x7f3004063430 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f3014009fd0 tx=0x7f301400b040).stop 2023-10-18T22:14:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 -- 172.21.15.8:0/2997166643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180f77d0 msgr2=0x7f3018109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180f77d0 0x7f3018109410 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f3008004d80 tx=0x7f300800b040).stop 2023-10-18T22:14:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 -- 172.21.15.8:0/2997166643 shutdown_connections 2023-10-18T22:14:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3004060f70 0x7f3004063430 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30180f6530 0x7f3018108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 --2- 172.21.15.8:0/2997166643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180f77d0 0x7f3018109410 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 -- 172.21.15.8:0/2997166643 >> 172.21.15.8:0/2997166643 conn(0x7f30180f1c90 msgr2=0x7f301806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:24.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 -- 172.21.15.8:0/2997166643 shutdown_connections 2023-10-18T22:14:24.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.566+0000 7f301e79d700 1 -- 172.21.15.8:0/2997166643 wait complete. 2023-10-18T22:14:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:22.782848+0000 mgr.smithi008.flmjzp (mgr.14640) 4528 : cluster [DBG] pgmap v3108: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:24.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.702+0000 7fae9f469700 1 -- 172.21.15.8:0/3792657468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae980f6530 msgr2=0x7fae980f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.702+0000 7fae9f469700 1 --2- 172.21.15.8:0/3792657468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae980f6530 0x7fae980f6950 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7fae94004660 tx=0x7fae94009b30).stop 2023-10-18T22:14:24.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.702+0000 7fae9f469700 1 -- 172.21.15.8:0/3792657468 shutdown_connections 2023-10-18T22:14:24.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.702+0000 7fae9f469700 1 --2- 172.21.15.8:0/3792657468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae980f77d0 0x7fae980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.702+0000 7fae9f469700 1 --2- 172.21.15.8:0/3792657468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae980f6530 0x7fae980f6950 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.702+0000 7fae9f469700 1 -- 172.21.15.8:0/3792657468 >> 172.21.15.8:0/3792657468 conn(0x7fae980f1c90 msgr2=0x7fae980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:24.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.703+0000 7fae9f469700 1 -- 172.21.15.8:0/3792657468 shutdown_connections 2023-10-18T22:14:24.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.703+0000 7fae9f469700 1 -- 172.21.15.8:0/3792657468 wait complete. 2023-10-18T22:14:24.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.704+0000 7fae9f469700 1 Processor -- start 2023-10-18T22:14:24.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.704+0000 7fae9f469700 1 -- start start 2023-10-18T22:14:24.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.704+0000 7fae9f469700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae980f6530 0x7fae9806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:24.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.704+0000 7fae9f469700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae980f77d0 0x7fae98069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:24.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.704+0000 7fae9f469700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9806a380 con 0x7fae980f77d0 2023-10-18T22:14:24.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.705+0000 7fae9f469700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9806a4c0 con 0x7fae980f6530 2023-10-18T22:14:24.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.705+0000 7fae9dc66700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae980f77d0 0x7fae98069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.705+0000 7fae9dc66700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae980f77d0 0x7fae98069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38578/0 (socket says 172.21.15.8:38578) 2023-10-18T22:14:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.705+0000 7fae9dc66700 1 -- 172.21.15.8:0/1657600490 learned_addr learned my addr 172.21.15.8:0/1657600490 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.705+0000 7fae9dc66700 1 -- 172.21.15.8:0/1657600490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae980f6530 msgr2=0x7fae9806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.705+0000 7fae9dc66700 1 --2- 172.21.15.8:0/1657600490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae980f6530 0x7fae9806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:14:24.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.705+0000 7fae9dc66700 1 -- 172.21.15.8:0/1657600490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94005040 con 0x7fae980f77d0 2023-10-18T22:14:24.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.705+0000 7fae9dc66700 1 --2- 172.21.15.8:0/1657600490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae980f77d0 0x7fae98069e20 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7fae8800e7f0 tx=0x7fae8800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:24.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.706+0000 7fae8effd700 1 -- 172.21.15.8:0/1657600490 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae880092e0 con 0x7fae980f77d0 2023-10-18T22:14:24.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.706+0000 7fae8effd700 1 -- 172.21.15.8:0/1657600490 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fae8800f040 con 0x7fae980f77d0 2023-10-18T22:14:24.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.706+0000 7fae8effd700 1 -- 172.21.15.8:0/1657600490 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae880147e0 con 0x7fae980f77d0 2023-10-18T22:14:24.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.706+0000 7fae9f469700 1 -- 172.21.15.8:0/1657600490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9806a7a0 con 0x7fae980f77d0 2023-10-18T22:14:24.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.706+0000 7fae9f469700 1 -- 172.21.15.8:0/1657600490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9810ed60 con 0x7fae980f77d0 2023-10-18T22:14:24.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.707+0000 7fae9f469700 1 -- 172.21.15.8:0/1657600490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae98045ad0 con 0x7fae980f77d0 2023-10-18T22:14:24.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.707+0000 7fae8effd700 1 -- 172.21.15.8:0/1657600490 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fae8801b030 con 0x7fae980f77d0 2023-10-18T22:14:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.708+0000 7fae8effd700 1 --2- 172.21.15.8:0/1657600490 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae84060f70 0x7fae84063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.708+0000 7fae8effd700 1 -- 172.21.15.8:0/1657600490 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fae8807c680 con 0x7fae980f77d0 2023-10-18T22:14:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.709+0000 7fae9e467700 1 --2- 172.21.15.8:0/1657600490 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae84060f70 0x7fae84063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:24.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.709+0000 7fae9e467700 1 --2- 172.21.15.8:0/1657600490 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae84060f70 0x7fae84063430 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fae94005010 tx=0x7fae9400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:24.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.712+0000 7fae8effd700 1 -- 172.21.15.8:0/1657600490 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fae8804c340 con 0x7fae980f77d0 2023-10-18T22:14:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:22.782848+0000 mgr.smithi008.flmjzp (mgr.14640) 4528 : cluster [DBG] pgmap v3108: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.914+0000 7fae9f469700 1 -- 172.21.15.8:0/1657600490 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fae980fee30 con 0x7fae84060f70 2023-10-18T22:14:24.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.924+0000 7fae8effd700 1 -- 172.21.15.8:0/1657600490 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fae980fee30 con 0x7fae84060f70 2023-10-18T22:14:24.927 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:14:24.927 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (81m) 8m ago 82m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:14:24.927 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (74m) 8m ago 82m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:14:24.927 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (74m) 6m ago 81m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:14:24.927 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (81m) 8m ago 82m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:14:24.928 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 78m - - 2023-10-18T22:14:24.928 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 78m - - 2023-10-18T22:14:24.928 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 78m - - 2023-10-18T22:14:24.928 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 78m - - 2023-10-18T22:14:24.928 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (76m) 8m ago 83m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:14:24.929 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (75m) 6m ago 81m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:14:24.929 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (75m) 8m ago 84m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:14:24.929 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (75m) 6m ago 81m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:14:24.929 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (82m) 8m ago 82m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:14:24.929 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (81m) 6m ago 81m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:14:24.929 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (74m) 8m ago 81m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:14:24.930 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (72m) 8m ago 80m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:14:24.930 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (72m) 8m ago 80m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:14:24.930 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (71m) 6m ago 80m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:14:24.930 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (71m) 6m ago 79m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:14:24.930 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (70m) 6m ago 79m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:14:24.931 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (76m) 8m ago 81m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:14:24.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 -- 172.21.15.8:0/1657600490 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae84060f70 msgr2=0x7fae84063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 --2- 172.21.15.8:0/1657600490 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae84060f70 0x7fae84063430 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fae94005010 tx=0x7fae9400b040).stop 2023-10-18T22:14:24.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 -- 172.21.15.8:0/1657600490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae980f77d0 msgr2=0x7fae98069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:24.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 --2- 172.21.15.8:0/1657600490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae980f77d0 0x7fae98069e20 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7fae8800e7f0 tx=0x7fae8800b040).stop 2023-10-18T22:14:24.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 -- 172.21.15.8:0/1657600490 shutdown_connections 2023-10-18T22:14:24.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 --2- 172.21.15.8:0/1657600490 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fae84060f70 0x7fae84063430 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 --2- 172.21.15.8:0/1657600490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae980f6530 0x7fae9806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:14:24.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 --2- 172.21.15.8:0/1657600490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae980f77d0 0x7fae98069e20 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:24.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 -- 172.21.15.8:0/1657600490 >> 172.21.15.8:0/1657600490 conn(0x7fae980f1c90 msgr2=0x7fae980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:24.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 -- 172.21.15.8:0/1657600490 shutdown_connections 2023-10-18T22:14:24.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:24.926+0000 7fae9f469700 1 -- 172.21.15.8:0/1657600490 wait complete. 2023-10-18T22:14:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.062+0000 7f2680867700 1 -- 172.21.15.8:0/914562442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f267c0f7ba0 msgr2=0x7f267c0f7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.062+0000 7f2680867700 1 --2- 172.21.15.8:0/914562442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f267c0f7ba0 0x7f267c0f7fc0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f266c004660 tx=0x7f266c009b30).stop 2023-10-18T22:14:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.062+0000 7f2680867700 1 -- 172.21.15.8:0/914562442 shutdown_connections 2023-10-18T22:14:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.062+0000 7f2680867700 1 --2- 172.21.15.8:0/914562442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f267c0f8540 0x7f267c0f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.062+0000 7f2680867700 1 --2- 172.21.15.8:0/914562442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f267c0f7ba0 0x7f267c0f7fc0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.062+0000 7f2680867700 1 -- 172.21.15.8:0/914562442 >> 172.21.15.8:0/914562442 conn(0x7f267c0f0320 msgr2=0x7f267c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.062+0000 7f2680867700 1 -- 172.21.15.8:0/914562442 shutdown_connections 2023-10-18T22:14:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.062+0000 7f2680867700 1 -- 172.21.15.8:0/914562442 wait complete. 2023-10-18T22:14:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.063+0000 7f2680867700 1 Processor -- start 2023-10-18T22:14:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.063+0000 7f2680867700 1 -- start start 2023-10-18T22:14:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.063+0000 7f2680867700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f267c0f7ba0 0x7f267c108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.063+0000 7f2680867700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f267c0f8540 0x7f267c1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.063+0000 7f2680867700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c109a60 con 0x7f267c0f8540 2023-10-18T22:14:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.063+0000 7f2680867700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c109ba0 con 0x7f267c0f7ba0 2023-10-18T22:14:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f267affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f267c0f8540 0x7f267c1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f267affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f267c0f8540 0x7f267c1094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38592/0 (socket says 172.21.15.8:38592) 2023-10-18T22:14:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f267affd700 1 -- 172.21.15.8:0/2311576919 learned_addr learned my addr 172.21.15.8:0/2311576919 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f267b7fe700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f267c0f7ba0 0x7f267c108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f267affd700 1 -- 172.21.15.8:0/2311576919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f267c0f7ba0 msgr2=0x7f267c108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:25.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f267affd700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f267c0f7ba0 0x7f267c108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f267affd700 1 -- 172.21.15.8:0/2311576919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c005040 con 0x7f267c0f8540 2023-10-18T22:14:25.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f267affd700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f267c0f8540 0x7f267c1094b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f267000c790 tx=0x7f2670007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:25.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f2663fff700 1 -- 172.21.15.8:0/2311576919 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f267000e680 con 0x7f267c0f8540 2023-10-18T22:14:25.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f2663fff700 1 -- 172.21.15.8:0/2311576919 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f267000eca0 con 0x7f267c0f8540 2023-10-18T22:14:25.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f2680867700 1 -- 172.21.15.8:0/2311576919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c10a540 con 0x7f267c0f8540 2023-10-18T22:14:25.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.064+0000 7f2663fff700 1 -- 172.21.15.8:0/2311576919 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2670013de0 con 0x7f267c0f8540 2023-10-18T22:14:25.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.065+0000 7f2680867700 1 -- 172.21.15.8:0/2311576919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c10ab00 con 0x7f267c0f8540 2023-10-18T22:14:25.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.066+0000 7f2680867700 1 -- 172.21.15.8:0/2311576919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c045ad0 con 0x7f267c0f8540 2023-10-18T22:14:25.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.067+0000 7f2663fff700 1 -- 172.21.15.8:0/2311576919 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f267001a060 con 0x7f267c0f8540 2023-10-18T22:14:25.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.068+0000 7f2663fff700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2664060f70 0x7f2664063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:25.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.068+0000 7f2663fff700 1 -- 172.21.15.8:0/2311576919 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f267007cb70 con 0x7f267c0f8540 2023-10-18T22:14:25.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.068+0000 7f267b7fe700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2664060f70 0x7f2664063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:25.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.069+0000 7f267b7fe700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2664060f70 0x7f2664063430 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f266c009490 tx=0x7f266c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.072+0000 7f2663fff700 1 -- 172.21.15.8:0/2311576919 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f26700501d0 con 0x7f267c0f8540 2023-10-18T22:14:25.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.328+0000 7f2680867700 1 -- 172.21.15.8:0/2311576919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f267c0fed80 con 0x7f267c0f8540 2023-10-18T22:14:25.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.328+0000 7f2663fff700 1 -- 172.21.15.8:0/2311576919 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f267004fdc0 con 0x7f267c0f8540 2023-10-18T22:14:25.331 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:14:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:14:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:14:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:14:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:14:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:14:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:14:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:14:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:14:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:14:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:14:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:14:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:14:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:14:25.334 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:14:25.334 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:14:25.334 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:14:25.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 -- 172.21.15.8:0/2311576919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2664060f70 msgr2=0x7f2664063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:25.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2664060f70 0x7f2664063430 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f266c009490 tx=0x7f266c009b30).stop 2023-10-18T22:14:25.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 -- 172.21.15.8:0/2311576919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f267c0f8540 msgr2=0x7f267c1094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:25.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f267c0f8540 0x7f267c1094b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f267000c790 tx=0x7f2670007d70).stop 2023-10-18T22:14:25.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 -- 172.21.15.8:0/2311576919 shutdown_connections 2023-10-18T22:14:25.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2664060f70 0x7f2664063430 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f267c0f7ba0 0x7f267c108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 --2- 172.21.15.8:0/2311576919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f267c0f8540 0x7f267c1094b0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 -- 172.21.15.8:0/2311576919 >> 172.21.15.8:0/2311576919 conn(0x7f267c0f0320 msgr2=0x7f267c0f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:25.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 -- 172.21.15.8:0/2311576919 shutdown_connections 2023-10-18T22:14:25.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.330+0000 7f2680867700 1 -- 172.21.15.8:0/2311576919 wait complete. 2023-10-18T22:14:25.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.466+0000 7fe939d47700 1 -- 172.21.15.8:0/307348600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9340f6530 msgr2=0x7fe9340f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:25.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.466+0000 7fe939d47700 1 --2- 172.21.15.8:0/307348600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9340f6530 0x7fe9340f6950 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7fe928004660 tx=0x7fe928009b30).stop 2023-10-18T22:14:25.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.466+0000 7fe939d47700 1 -- 172.21.15.8:0/307348600 shutdown_connections 2023-10-18T22:14:25.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.466+0000 7fe939d47700 1 --2- 172.21.15.8:0/307348600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340f77d0 0x7fe9340f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.466+0000 7fe939d47700 1 --2- 172.21.15.8:0/307348600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9340f6530 0x7fe9340f6950 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.466+0000 7fe939d47700 1 -- 172.21.15.8:0/307348600 >> 172.21.15.8:0/307348600 conn(0x7fe9340f1c90 msgr2=0x7fe9340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:25.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.466+0000 7fe939d47700 1 -- 172.21.15.8:0/307348600 shutdown_connections 2023-10-18T22:14:25.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.466+0000 7fe939d47700 1 -- 172.21.15.8:0/307348600 wait complete. 2023-10-18T22:14:25.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.468+0000 7fe939d47700 1 Processor -- start 2023-10-18T22:14:25.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.468+0000 7fe939d47700 1 -- start start 2023-10-18T22:14:25.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.468+0000 7fe939d47700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9340f6530 0x7fe93406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:25.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.468+0000 7fe939d47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340f77d0 0x7fe934069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:25.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.468+0000 7fe939d47700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93406a380 con 0x7fe9340f6530 2023-10-18T22:14:25.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.468+0000 7fe939d47700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93406a4c0 con 0x7fe9340f77d0 2023-10-18T22:14:25.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.469+0000 7fe938d45700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9340f6530 0x7fe93406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:25.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.469+0000 7fe938d45700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9340f6530 0x7fe93406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38608/0 (socket says 172.21.15.8:38608) 2023-10-18T22:14:25.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.469+0000 7fe938d45700 1 -- 172.21.15.8:0/2520259041 learned_addr learned my addr 172.21.15.8:0/2520259041 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:25.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.469+0000 7fe933fff700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340f77d0 0x7fe934069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:25.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.469+0000 7fe938d45700 1 -- 172.21.15.8:0/2520259041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340f77d0 msgr2=0x7fe934069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:25.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.469+0000 7fe938d45700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340f77d0 0x7fe934069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.469+0000 7fe938d45700 1 -- 172.21.15.8:0/2520259041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe928005040 con 0x7fe9340f6530 2023-10-18T22:14:25.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.469+0000 7fe938d45700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9340f6530 0x7fe93406b9a0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7fe928007a60 tx=0x7fe928009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:25.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.469+0000 7fe9317fa700 1 -- 172.21.15.8:0/2520259041 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe928018070 con 0x7fe9340f6530 2023-10-18T22:14:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.470+0000 7fe939d47700 1 -- 172.21.15.8:0/2520259041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93406a740 con 0x7fe9340f6530 2023-10-18T22:14:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.470+0000 7fe9317fa700 1 -- 172.21.15.8:0/2520259041 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe928009630 con 0x7fe9340f6530 2023-10-18T22:14:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.470+0000 7fe9317fa700 1 -- 172.21.15.8:0/2520259041 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe92801c540 con 0x7fe9340f6530 2023-10-18T22:14:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.470+0000 7fe939d47700 1 -- 172.21.15.8:0/2520259041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93406aca0 con 0x7fe9340f6530 2023-10-18T22:14:25.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.471+0000 7fe939d47700 1 -- 172.21.15.8:0/2520259041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe934045ad0 con 0x7fe9340f6530 2023-10-18T22:14:25.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.472+0000 7fe9317fa700 1 -- 172.21.15.8:0/2520259041 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe92801c7b0 con 0x7fe9340f6530 2023-10-18T22:14:25.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.472+0000 7fe9317fa700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe924060f70 0x7fe924063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:25.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.473+0000 7fe9317fa700 1 -- 172.21.15.8:0/2520259041 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe92807e6a0 con 0x7fe9340f6530 2023-10-18T22:14:25.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.473+0000 7fe933fff700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe924060f70 0x7fe924063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:25.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.473+0000 7fe933fff700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe924060f70 0x7fe924063430 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fe920009760 tx=0x7fe920009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:25.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.477+0000 7fe9317fa700 1 -- 172.21.15.8:0/2520259041 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe92804e310 con 0x7fe9340f6530 2023-10-18T22:14:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:24.213547+0000 mgr.smithi008.flmjzp (mgr.14640) 4529 : audit [DBG] from='client.37648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:25.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.703+0000 7fe939d47700 1 -- 172.21.15.8:0/2520259041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe9340fed60 con 0x7fe9340f6530 2023-10-18T22:14:25.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.703+0000 7fe9317fa700 1 -- 172.21.15.8:0/2520259041 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fe928051930 con 0x7fe9340f6530 2023-10-18T22:14:25.706 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:14:25.706 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:14:25.706 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:14:25.707 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:14:25.707 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:14:25.707 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:14:25.707 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:14:25.707 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:14:25.708 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:14:25.708 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:14:25.708 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:14:25.708 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:14:25.708 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:14:25.709 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:14:25.709 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:14:25.709 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:14:25.709 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:14:25.709 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:14:25.709 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:14:25.710 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:14:25.710 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:14:25.710 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:14:25.710 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:14:25.710 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:14:25.711 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:14:25.711 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:14:25.711 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:14:25.711 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:14:25.711 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:14:25.712 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:14:25.712 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:14:25.712 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:14:25.712 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:14:25.712 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:14:25.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.705+0000 7fe939d47700 1 -- 172.21.15.8:0/2520259041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe924060f70 msgr2=0x7fe924063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.705+0000 7fe939d47700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe924060f70 0x7fe924063430 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fe920009760 tx=0x7fe920009c60).stop 2023-10-18T22:14:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.705+0000 7fe939d47700 1 -- 172.21.15.8:0/2520259041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9340f6530 msgr2=0x7fe93406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.705+0000 7fe939d47700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9340f6530 0x7fe93406b9a0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7fe928007a60 tx=0x7fe928009b30).stop 2023-10-18T22:14:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.706+0000 7fe939d47700 1 -- 172.21.15.8:0/2520259041 shutdown_connections 2023-10-18T22:14:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.706+0000 7fe939d47700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe924060f70 0x7fe924063430 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.706+0000 7fe939d47700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9340f6530 0x7fe93406b9a0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.706+0000 7fe939d47700 1 --2- 172.21.15.8:0/2520259041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340f77d0 0x7fe934069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.706+0000 7fe939d47700 1 -- 172.21.15.8:0/2520259041 >> 172.21.15.8:0/2520259041 conn(0x7fe9340f1c90 msgr2=0x7fe9340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.706+0000 7fe939d47700 1 -- 172.21.15.8:0/2520259041 shutdown_connections 2023-10-18T22:14:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.706+0000 7fe939d47700 1 -- 172.21.15.8:0/2520259041 wait complete. 2023-10-18T22:14:25.716 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:14:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:24.213547+0000 mgr.smithi008.flmjzp (mgr.14640) 4529 : audit [DBG] from='client.37648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:25.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.843+0000 7f04108a8700 1 -- 172.21.15.8:0/1088466000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c0f99e0 msgr2=0x7f040c0f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:25.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.843+0000 7f04108a8700 1 --2- 172.21.15.8:0/1088466000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c0f99e0 0x7f040c0f9e40 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f0400004660 tx=0x7f0400009b30).stop 2023-10-18T22:14:25.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.843+0000 7f04108a8700 1 -- 172.21.15.8:0/1088466000 shutdown_connections 2023-10-18T22:14:25.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.843+0000 7f04108a8700 1 --2- 172.21.15.8:0/1088466000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c0f99e0 0x7f040c0f9e40 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.843+0000 7f04108a8700 1 --2- 172.21.15.8:0/1088466000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f8740 0x7f040c0f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.843+0000 7f04108a8700 1 -- 172.21.15.8:0/1088466000 >> 172.21.15.8:0/1088466000 conn(0x7f040c0f40e0 msgr2=0x7f040c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.843+0000 7f04108a8700 1 -- 172.21.15.8:0/1088466000 shutdown_connections 2023-10-18T22:14:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.843+0000 7f04108a8700 1 -- 172.21.15.8:0/1088466000 wait complete. 2023-10-18T22:14:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.844+0000 7f04108a8700 1 Processor -- start 2023-10-18T22:14:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.844+0000 7f04108a8700 1 -- start start 2023-10-18T22:14:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f04108a8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c0f8740 0x7f040c108e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f04108a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f99e0 0x7f040c109380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f04108a8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c109930 con 0x7f040c0f8740 2023-10-18T22:14:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f04108a8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c109a70 con 0x7f040c0f99e0 2023-10-18T22:14:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f040b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c0f8740 0x7f040c108e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f040b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c0f8740 0x7f040c108e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38630/0 (socket says 172.21.15.8:38630) 2023-10-18T22:14:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f040b7fe700 1 -- 172.21.15.8:0/680066192 learned_addr learned my addr 172.21.15.8:0/680066192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f040affd700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f99e0 0x7f040c109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f040b7fe700 1 -- 172.21.15.8:0/680066192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f99e0 msgr2=0x7f040c109380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f040b7fe700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f99e0 0x7f040c109380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.845+0000 7f040b7fe700 1 -- 172.21.15.8:0/680066192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400005040 con 0x7f040c0f8740 2023-10-18T22:14:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.846+0000 7f040b7fe700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c0f8740 0x7f040c108e90 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f03fc00e7c0 tx=0x7f03fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.846+0000 7f03f3fff700 1 -- 172.21.15.8:0/680066192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03fc0092e0 con 0x7f040c0f8740 2023-10-18T22:14:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.846+0000 7f03f3fff700 1 -- 172.21.15.8:0/680066192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f03fc00f040 con 0x7f040c0f8740 2023-10-18T22:14:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.846+0000 7f04108a8700 1 -- 172.21.15.8:0/680066192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c10a410 con 0x7f040c0f8740 2023-10-18T22:14:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.846+0000 7f03f3fff700 1 -- 172.21.15.8:0/680066192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03fc0147e0 con 0x7f040c0f8740 2023-10-18T22:14:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.846+0000 7f04108a8700 1 -- 172.21.15.8:0/680066192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c10a950 con 0x7f040c0f8740 2023-10-18T22:14:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.847+0000 7f04108a8700 1 -- 172.21.15.8:0/680066192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040c045ad0 con 0x7f040c0f8740 2023-10-18T22:14:25.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.848+0000 7f03f3fff700 1 -- 172.21.15.8:0/680066192 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f03fc01b030 con 0x7f040c0f8740 2023-10-18T22:14:25.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.849+0000 7f03f3fff700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f4060f70 0x7f03f4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:25.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.849+0000 7f03f3fff700 1 -- 172.21.15.8:0/680066192 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f03fc07c9a0 con 0x7f040c0f8740 2023-10-18T22:14:25.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.849+0000 7f040affd700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f4060f70 0x7f03f4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:25.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.850+0000 7f040affd700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f4060f70 0x7f03f4063430 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f0400009720 tx=0x7f040000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:25.853+0000 7f03f3fff700 1 -- 172.21.15.8:0/680066192 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f03fc050040 con 0x7f040c0f8740 2023-10-18T22:14:26.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.053+0000 7f04108a8700 1 -- 172.21.15.8:0/680066192 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f040c10ab70 con 0x7f03f4060f70 2023-10-18T22:14:26.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.054+0000 7f03f3fff700 1 -- 172.21.15.8:0/680066192 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f040c10ab70 con 0x7f03f4060f70 2023-10-18T22:14:26.057 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:14:26.057 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:14:26.057 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:14:26.057 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:14:26.058 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:14:26.058 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:14:26.058 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:14:26.058 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:14:26.058 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:14:26.059 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:14:26.059 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:14:26.059 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:14:26.059 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:14:26.060 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:14:26.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.056+0000 7f04108a8700 1 -- 172.21.15.8:0/680066192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f4060f70 msgr2=0x7f03f4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:26.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.056+0000 7f04108a8700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f4060f70 0x7f03f4063430 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f0400009720 tx=0x7f040000b040).stop 2023-10-18T22:14:26.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.056+0000 7f04108a8700 1 -- 172.21.15.8:0/680066192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c0f8740 msgr2=0x7f040c108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:26.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.056+0000 7f04108a8700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c0f8740 0x7f040c108e90 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f03fc00e7c0 tx=0x7f03fc00b040).stop 2023-10-18T22:14:26.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.056+0000 7f04108a8700 1 -- 172.21.15.8:0/680066192 shutdown_connections 2023-10-18T22:14:26.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.056+0000 7f04108a8700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f03f4060f70 0x7f03f4063430 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:26.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.056+0000 7f04108a8700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f040c0f8740 0x7f040c108e90 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:26.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.056+0000 7f04108a8700 1 --2- 172.21.15.8:0/680066192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f040c0f99e0 0x7f040c109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:26.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.056+0000 7f04108a8700 1 -- 172.21.15.8:0/680066192 >> 172.21.15.8:0/680066192 conn(0x7f040c0f40e0 msgr2=0x7f040c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:26.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.057+0000 7f04108a8700 1 -- 172.21.15.8:0/680066192 shutdown_connections 2023-10-18T22:14:26.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:26.057+0000 7f04108a8700 1 -- 172.21.15.8:0/680066192 wait complete. 2023-10-18T22:14:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:24.565054+0000 mgr.smithi008.flmjzp (mgr.14640) 4530 : audit [DBG] from='client.37652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:24.783340+0000 mgr.smithi008.flmjzp (mgr.14640) 4531 : cluster [DBG] pgmap v3109: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:24.917081+0000 mgr.smithi008.flmjzp (mgr.14640) 4532 : audit [DBG] from='client.37656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:25.329747+0000 mon.smithi008 (mon.0) 4823 : audit [DBG] from='client.? 172.21.15.8:0/2311576919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:25.704956+0000 mon.smithi008 (mon.0) 4824 : audit [DBG] from='client.? 172.21.15.8:0/2520259041' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:14:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:24.565054+0000 mgr.smithi008.flmjzp (mgr.14640) 4530 : audit [DBG] from='client.37652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:24.783340+0000 mgr.smithi008.flmjzp (mgr.14640) 4531 : cluster [DBG] pgmap v3109: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:24.917081+0000 mgr.smithi008.flmjzp (mgr.14640) 4532 : audit [DBG] from='client.37656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:25.329747+0000 mon.smithi008 (mon.0) 4823 : audit [DBG] from='client.? 172.21.15.8:0/2311576919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:25.704956+0000 mon.smithi008 (mon.0) 4824 : audit [DBG] from='client.? 172.21.15.8:0/2520259041' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:14:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:26.055649+0000 mgr.smithi008.flmjzp (mgr.14640) 4533 : audit [DBG] from='client.37668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:26.055649+0000 mgr.smithi008.flmjzp (mgr.14640) 4533 : audit [DBG] from='client.37668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:26.784044+0000 mgr.smithi008.flmjzp (mgr.14640) 4534 : cluster [DBG] pgmap v3110: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:26.784044+0000 mgr.smithi008.flmjzp (mgr.14640) 4534 : cluster [DBG] pgmap v3110: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:28.813655+0000 mon.smithi008 (mon.0) 4825 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:28.815707+0000 mon.smithi008 (mon.0) 4826 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:14:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:28.816668+0000 mon.smithi008 (mon.0) 4827 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:14:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:28.823767+0000 mon.smithi008 (mon.0) 4828 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:14:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:28.830483+0000 mon.smithi008 (mon.0) 4829 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:29.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:28.833874+0000 mon.smithi008 (mon.0) 4830 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:29.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:28.835625+0000 mon.smithi008 (mon.0) 4831 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:29.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:28.837287+0000 mon.smithi008 (mon.0) 4832 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:29.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:28.839328+0000 mon.smithi008 (mon.0) 4833 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:28.813655+0000 mon.smithi008 (mon.0) 4825 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:28.815707+0000 mon.smithi008 (mon.0) 4826 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:14:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:28.816668+0000 mon.smithi008 (mon.0) 4827 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:14:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:28.823767+0000 mon.smithi008 (mon.0) 4828 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:14:29.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:28.830483+0000 mon.smithi008 (mon.0) 4829 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:29.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:28.833874+0000 mon.smithi008 (mon.0) 4830 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:29.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:28.835625+0000 mon.smithi008 (mon.0) 4831 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:29.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:28.837287+0000 mon.smithi008 (mon.0) 4832 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:29.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:28.839328+0000 mon.smithi008 (mon.0) 4833 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:28.784805+0000 mgr.smithi008.flmjzp (mgr.14640) 4535 : cluster [DBG] pgmap v3111: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:28.817614+0000 mgr.smithi008.flmjzp (mgr.14640) 4536 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:14:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:28.818282+0000 mgr.smithi008.flmjzp (mgr.14640) 4537 : cluster [DBG] pgmap v3112: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:28.818590+0000 mgr.smithi008.flmjzp (mgr.14640) 4538 : cluster [DBG] pgmap v3113: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:28.841367+0000 mgr.smithi008.flmjzp (mgr.14640) 4539 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:28.784805+0000 mgr.smithi008.flmjzp (mgr.14640) 4535 : cluster [DBG] pgmap v3111: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:28.817614+0000 mgr.smithi008.flmjzp (mgr.14640) 4536 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:14:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:28.818282+0000 mgr.smithi008.flmjzp (mgr.14640) 4537 : cluster [DBG] pgmap v3112: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:28.818590+0000 mgr.smithi008.flmjzp (mgr.14640) 4538 : cluster [DBG] pgmap v3113: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:28.841367+0000 mgr.smithi008.flmjzp (mgr.14640) 4539 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:30.819302+0000 mgr.smithi008.flmjzp (mgr.14640) 4540 : cluster [DBG] pgmap v3114: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:30.819302+0000 mgr.smithi008.flmjzp (mgr.14640) 4540 : cluster [DBG] pgmap v3114: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:32.819868+0000 mgr.smithi008.flmjzp (mgr.14640) 4541 : cluster [DBG] pgmap v3115: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:32.819868+0000 mgr.smithi008.flmjzp (mgr.14640) 4541 : cluster [DBG] pgmap v3115: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:34.820766+0000 mgr.smithi008.flmjzp (mgr.14640) 4542 : cluster [DBG] pgmap v3116: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:34.820766+0000 mgr.smithi008.flmjzp (mgr.14640) 4542 : cluster [DBG] pgmap v3116: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:36.821402+0000 mgr.smithi008.flmjzp (mgr.14640) 4543 : cluster [DBG] pgmap v3117: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:36.821402+0000 mgr.smithi008.flmjzp (mgr.14640) 4543 : cluster [DBG] pgmap v3117: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:38.845314+0000 mon.smithi008 (mon.0) 4834 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:38.847428+0000 mon.smithi008 (mon.0) 4835 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:14:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:38.848458+0000 mon.smithi008 (mon.0) 4836 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:14:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:38.854907+0000 mon.smithi008 (mon.0) 4837 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:14:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:38.861170+0000 mon.smithi008 (mon.0) 4838 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:38.864173+0000 mon.smithi008 (mon.0) 4839 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:38.865858+0000 mon.smithi008 (mon.0) 4840 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:38.867495+0000 mon.smithi008 (mon.0) 4841 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:39.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:38.869538+0000 mon.smithi008 (mon.0) 4842 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:38.845314+0000 mon.smithi008 (mon.0) 4834 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:38.847428+0000 mon.smithi008 (mon.0) 4835 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:14:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:38.848458+0000 mon.smithi008 (mon.0) 4836 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:14:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:38.854907+0000 mon.smithi008 (mon.0) 4837 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:14:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:38.861170+0000 mon.smithi008 (mon.0) 4838 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:39.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:38.864173+0000 mon.smithi008 (mon.0) 4839 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:39.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:38.865858+0000 mon.smithi008 (mon.0) 4840 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:39.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:38.867495+0000 mon.smithi008 (mon.0) 4841 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:39.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:38.869538+0000 mon.smithi008 (mon.0) 4842 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:38.822139+0000 mgr.smithi008.flmjzp (mgr.14640) 4544 : cluster [DBG] pgmap v3118: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:38.849325+0000 mgr.smithi008.flmjzp (mgr.14640) 4545 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:14:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:38.849904+0000 mgr.smithi008.flmjzp (mgr.14640) 4546 : cluster [DBG] pgmap v3119: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:38.850276+0000 mgr.smithi008.flmjzp (mgr.14640) 4547 : cluster [DBG] pgmap v3120: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:38.871419+0000 mgr.smithi008.flmjzp (mgr.14640) 4548 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:38.822139+0000 mgr.smithi008.flmjzp (mgr.14640) 4544 : cluster [DBG] pgmap v3118: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:38.849325+0000 mgr.smithi008.flmjzp (mgr.14640) 4545 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:14:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:38.849904+0000 mgr.smithi008.flmjzp (mgr.14640) 4546 : cluster [DBG] pgmap v3119: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:38.850276+0000 mgr.smithi008.flmjzp (mgr.14640) 4547 : cluster [DBG] pgmap v3120: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:38.871419+0000 mgr.smithi008.flmjzp (mgr.14640) 4548 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:40.850891+0000 mgr.smithi008.flmjzp (mgr.14640) 4549 : cluster [DBG] pgmap v3121: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:40.850891+0000 mgr.smithi008.flmjzp (mgr.14640) 4549 : cluster [DBG] pgmap v3121: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:42.851700+0000 mgr.smithi008.flmjzp (mgr.14640) 4550 : cluster [DBG] pgmap v3122: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:42.851700+0000 mgr.smithi008.flmjzp (mgr.14640) 4550 : cluster [DBG] pgmap v3122: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:44.852274+0000 mgr.smithi008.flmjzp (mgr.14640) 4551 : cluster [DBG] pgmap v3123: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:44.852274+0000 mgr.smithi008.flmjzp (mgr.14640) 4551 : cluster [DBG] pgmap v3123: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:46.852839+0000 mgr.smithi008.flmjzp (mgr.14640) 4552 : cluster [DBG] pgmap v3124: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:48.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:46.852839+0000 mgr.smithi008.flmjzp (mgr.14640) 4552 : cluster [DBG] pgmap v3124: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:48.879686+0000 mon.smithi008 (mon.0) 4843 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:48.881612+0000 mon.smithi008 (mon.0) 4844 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:14:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:48.882488+0000 mon.smithi008 (mon.0) 4845 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:14:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:48.888615+0000 mon.smithi008 (mon.0) 4846 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:14:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:48.895358+0000 mon.smithi008 (mon.0) 4847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:48.898417+0000 mon.smithi008 (mon.0) 4848 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:48.900002+0000 mon.smithi008 (mon.0) 4849 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:48.901526+0000 mon.smithi008 (mon.0) 4850 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:49.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:48.903393+0000 mon.smithi008 (mon.0) 4851 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:48.879686+0000 mon.smithi008 (mon.0) 4843 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:48.881612+0000 mon.smithi008 (mon.0) 4844 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:14:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:48.882488+0000 mon.smithi008 (mon.0) 4845 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:14:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:48.888615+0000 mon.smithi008 (mon.0) 4846 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:14:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:48.895358+0000 mon.smithi008 (mon.0) 4847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:48.898417+0000 mon.smithi008 (mon.0) 4848 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:48.900002+0000 mon.smithi008 (mon.0) 4849 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:49.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:48.901526+0000 mon.smithi008 (mon.0) 4850 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:49.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:48.903393+0000 mon.smithi008 (mon.0) 4851 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:48.853482+0000 mgr.smithi008.flmjzp (mgr.14640) 4553 : cluster [DBG] pgmap v3125: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:48.883268+0000 mgr.smithi008.flmjzp (mgr.14640) 4554 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:14:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:48.883856+0000 mgr.smithi008.flmjzp (mgr.14640) 4555 : cluster [DBG] pgmap v3126: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:48.884209+0000 mgr.smithi008.flmjzp (mgr.14640) 4556 : cluster [DBG] pgmap v3127: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:48.905216+0000 mgr.smithi008.flmjzp (mgr.14640) 4557 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:48.853482+0000 mgr.smithi008.flmjzp (mgr.14640) 4553 : cluster [DBG] pgmap v3125: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:48.883268+0000 mgr.smithi008.flmjzp (mgr.14640) 4554 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:14:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:48.883856+0000 mgr.smithi008.flmjzp (mgr.14640) 4555 : cluster [DBG] pgmap v3126: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:48.884209+0000 mgr.smithi008.flmjzp (mgr.14640) 4556 : cluster [DBG] pgmap v3127: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:48.905216+0000 mgr.smithi008.flmjzp (mgr.14640) 4557 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:14:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:50.884759+0000 mgr.smithi008.flmjzp (mgr.14640) 4558 : cluster [DBG] pgmap v3128: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:50.884759+0000 mgr.smithi008.flmjzp (mgr.14640) 4558 : cluster [DBG] pgmap v3128: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:52.885300+0000 mgr.smithi008.flmjzp (mgr.14640) 4559 : cluster [DBG] pgmap v3129: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:52.885300+0000 mgr.smithi008.flmjzp (mgr.14640) 4559 : cluster [DBG] pgmap v3129: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:56.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.211+0000 7f2810c38700 1 -- 172.21.15.8:0/957917124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f280c0f77d0 msgr2=0x7f280c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:56.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.211+0000 7f2810c38700 1 --2- 172.21.15.8:0/957917124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f280c0f77d0 0x7f280c0f7c30 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f2800004660 tx=0x7f2800009b30).stop 2023-10-18T22:14:56.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.211+0000 7f2810c38700 1 -- 172.21.15.8:0/957917124 shutdown_connections 2023-10-18T22:14:56.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.211+0000 7f2810c38700 1 --2- 172.21.15.8:0/957917124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f280c0f77d0 0x7f280c0f7c30 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.211+0000 7f2810c38700 1 --2- 172.21.15.8:0/957917124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c0f6530 0x7f280c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:14:56.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.211+0000 7f2810c38700 1 -- 172.21.15.8:0/957917124 >> 172.21.15.8:0/957917124 conn(0x7f280c0f1c90 msgr2=0x7f280c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:56.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.211+0000 7f2810c38700 1 -- 172.21.15.8:0/957917124 shutdown_connections 2023-10-18T22:14:56.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.211+0000 7f2810c38700 1 -- 172.21.15.8:0/957917124 wait complete. 2023-10-18T22:14:56.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.212+0000 7f2810c38700 1 Processor -- start 2023-10-18T22:14:56.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.212+0000 7f2810c38700 1 -- start start 2023-10-18T22:14:56.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.212+0000 7f2810c38700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c0f6530 0x7f280c106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:56.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.212+0000 7f2810c38700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f280c0f77d0 0x7f280c107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:56.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.212+0000 7f2810c38700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c1079a0 con 0x7f280c0f77d0 2023-10-18T22:14:56.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.212+0000 7f2810c38700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c108120 con 0x7f280c0f6530 2023-10-18T22:14:56.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.213+0000 7f280affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f280c0f77d0 0x7f280c107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:56.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.213+0000 7f280affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f280c0f77d0 0x7f280c107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50752/0 (socket says 172.21.15.8:50752) 2023-10-18T22:14:56.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.213+0000 7f280affd700 1 -- 172.21.15.8:0/1786237788 learned_addr learned my addr 172.21.15.8:0/1786237788 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:56.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.213+0000 7f280b7fe700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c0f6530 0x7f280c106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:56.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.213+0000 7f280affd700 1 -- 172.21.15.8:0/1786237788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c0f6530 msgr2=0x7f280c106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:56.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.213+0000 7f280affd700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c0f6530 0x7f280c106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.213+0000 7f280affd700 1 -- 172.21.15.8:0/1786237788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2800005040 con 0x7f280c0f77d0 2023-10-18T22:14:56.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.213+0000 7f280affd700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f280c0f77d0 0x7f280c107310 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f2800009990 tx=0x7f2800009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:56.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.214+0000 7f27f3fff700 1 -- 172.21.15.8:0/1786237788 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2800018070 con 0x7f280c0f77d0 2023-10-18T22:14:56.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.214+0000 7f2810c38700 1 -- 172.21.15.8:0/1786237788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c108340 con 0x7f280c0f77d0 2023-10-18T22:14:56.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.214+0000 7f27f3fff700 1 -- 172.21.15.8:0/1786237788 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2800009780 con 0x7f280c0f77d0 2023-10-18T22:14:56.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.214+0000 7f27f3fff700 1 -- 172.21.15.8:0/1786237788 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f280001c5a0 con 0x7f280c0f77d0 2023-10-18T22:14:56.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.214+0000 7f2810c38700 1 -- 172.21.15.8:0/1786237788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c1088a0 con 0x7f280c0f77d0 2023-10-18T22:14:56.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.215+0000 7f2810c38700 1 -- 172.21.15.8:0/1786237788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c045ad0 con 0x7f280c0f77d0 2023-10-18T22:14:56.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.216+0000 7f27f3fff700 1 -- 172.21.15.8:0/1786237788 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f280001db30 con 0x7f280c0f77d0 2023-10-18T22:14:56.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.217+0000 7f27f3fff700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f27f4060f70 0x7f27f4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:56.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.217+0000 7f27f3fff700 1 -- 172.21.15.8:0/1786237788 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f280007e940 con 0x7f280c0f77d0 2023-10-18T22:14:56.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.217+0000 7f280b7fe700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f27f4060f70 0x7f27f4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:56.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.217+0000 7f280b7fe700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f27f4060f70 0x7f27f4063430 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f280c106b90 tx=0x7f27fc008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:56.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.221+0000 7f27f3fff700 1 -- 172.21.15.8:0/1786237788 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f280004e4f0 con 0x7f280c0f77d0 2023-10-18T22:14:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.419+0000 7f2810c38700 1 -- 172.21.15.8:0/1786237788 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f280c0feed0 con 0x7f27f4060f70 2023-10-18T22:14:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.420+0000 7f27f3fff700 1 -- 172.21.15.8:0/1786237788 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f280c0feed0 con 0x7f27f4060f70 2023-10-18T22:14:56.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 -- 172.21.15.8:0/1786237788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f27f4060f70 msgr2=0x7f27f4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:56.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f27f4060f70 0x7f27f4063430 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f280c106b90 tx=0x7f27fc008040).stop 2023-10-18T22:14:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 -- 172.21.15.8:0/1786237788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f280c0f77d0 msgr2=0x7f280c107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f280c0f77d0 0x7f280c107310 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f2800009990 tx=0x7f2800009b30).stop 2023-10-18T22:14:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 -- 172.21.15.8:0/1786237788 shutdown_connections 2023-10-18T22:14:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f27f4060f70 0x7f27f4063430 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c0f6530 0x7f280c106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 --2- 172.21.15.8:0/1786237788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f280c0f77d0 0x7f280c107310 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 -- 172.21.15.8:0/1786237788 >> 172.21.15.8:0/1786237788 conn(0x7f280c0f1c90 msgr2=0x7f280c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 -- 172.21.15.8:0/1786237788 shutdown_connections 2023-10-18T22:14:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.422+0000 7f2810c38700 1 -- 172.21.15.8:0/1786237788 wait complete. 2023-10-18T22:14:56.438 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:14:56.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.562+0000 7f54a089e700 1 -- 172.21.15.8:0/2264186258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f549c060310 msgr2=0x7f549c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:56.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.562+0000 7f54a089e700 1 --2- 172.21.15.8:0/2264186258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f549c060310 0x7f549c0f9110 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f548c004660 tx=0x7f548c009b30).stop 2023-10-18T22:14:56.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.562+0000 7f54a089e700 1 -- 172.21.15.8:0/2264186258 shutdown_connections 2023-10-18T22:14:56.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.562+0000 7f54a089e700 1 --2- 172.21.15.8:0/2264186258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c0f9690 0x7f549c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.562+0000 7f54a089e700 1 --2- 172.21.15.8:0/2264186258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f549c060310 0x7f549c0f9110 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.562+0000 7f54a089e700 1 -- 172.21.15.8:0/2264186258 >> 172.21.15.8:0/2264186258 conn(0x7f549c0f0b90 msgr2=0x7f549c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:56.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.562+0000 7f54a089e700 1 -- 172.21.15.8:0/2264186258 shutdown_connections 2023-10-18T22:14:56.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.562+0000 7f54a089e700 1 -- 172.21.15.8:0/2264186258 wait complete. 2023-10-18T22:14:56.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.563+0000 7f54a089e700 1 Processor -- start 2023-10-18T22:14:56.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.563+0000 7f54a089e700 1 -- start start 2023-10-18T22:14:56.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.563+0000 7f54a089e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c060310 0x7f549c106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:56.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.563+0000 7f54a089e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f549c0f9690 0x7f549c1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:56.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.563+0000 7f54a089e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c1078a0 con 0x7f549c0f9690 2023-10-18T22:14:56.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.563+0000 7f54a089e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c1080e0 con 0x7f549c060310 2023-10-18T22:14:56.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f549a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f549c0f9690 0x7f549c1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:56.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f549a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f549c0f9690 0x7f549c1072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50776/0 (socket says 172.21.15.8:50776) 2023-10-18T22:14:56.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f549a59c700 1 -- 172.21.15.8:0/1018864999 learned_addr learned my addr 172.21.15.8:0/1018864999 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:56.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f549a59c700 1 -- 172.21.15.8:0/1018864999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c060310 msgr2=0x7f549c106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:56.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f549a59c700 1 --2- 172.21.15.8:0/1018864999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c060310 0x7f549c106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:14:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f549a59c700 1 -- 172.21.15.8:0/1018864999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c005040 con 0x7f549c0f9690 2023-10-18T22:14:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f549a59c700 1 --2- 172.21.15.8:0/1018864999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f549c0f9690 0x7f549c1072a0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f5490002700 tx=0x7f5490009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f54837fe700 1 -- 172.21.15.8:0/1018864999 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5490009320 con 0x7f549c0f9690 2023-10-18T22:14:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f54837fe700 1 -- 172.21.15.8:0/1018864999 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f549000f040 con 0x7f549c0f9690 2023-10-18T22:14:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f54a089e700 1 -- 172.21.15.8:0/1018864999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549c1083c0 con 0x7f549c0f9690 2023-10-18T22:14:56.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.564+0000 7f54837fe700 1 -- 172.21.15.8:0/1018864999 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5490014860 con 0x7f549c0f9690 2023-10-18T22:14:56.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.565+0000 7f54a089e700 1 -- 172.21.15.8:0/1018864999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c108900 con 0x7f549c0f9690 2023-10-18T22:14:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.566+0000 7f54a089e700 1 -- 172.21.15.8:0/1018864999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549c059100 con 0x7f549c0f9690 2023-10-18T22:14:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.567+0000 7f54837fe700 1 -- 172.21.15.8:0/1018864999 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f54900077b0 con 0x7f549c0f9690 2023-10-18T22:14:56.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.567+0000 7f54837fe700 1 --2- 172.21.15.8:0/1018864999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5484060f70 0x7f5484063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:56.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.568+0000 7f54837fe700 1 -- 172.21.15.8:0/1018864999 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f549007cee0 con 0x7f549c0f9690 2023-10-18T22:14:56.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.568+0000 7f549ad9d700 1 --2- 172.21.15.8:0/1018864999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5484060f70 0x7f5484063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:56.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.568+0000 7f549ad9d700 1 --2- 172.21.15.8:0/1018864999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5484060f70 0x7f5484063430 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f548c009f50 tx=0x7f548c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.572+0000 7f54837fe700 1 -- 172.21.15.8:0/1018864999 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f549004cb50 con 0x7f549c0f9690 2023-10-18T22:14:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:54.886005+0000 mgr.smithi008.flmjzp (mgr.14640) 4560 : cluster [DBG] pgmap v3130: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:54.886005+0000 mgr.smithi008.flmjzp (mgr.14640) 4560 : cluster [DBG] pgmap v3130: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.775+0000 7f54a089e700 1 -- 172.21.15.8:0/1018864999 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f549c0fee90 con 0x7f5484060f70 2023-10-18T22:14:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.777+0000 7f54837fe700 1 -- 172.21.15.8:0/1018864999 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f548c0092e0 con 0x7f5484060f70 2023-10-18T22:14:56.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 -- 172.21.15.8:0/1018864999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5484060f70 msgr2=0x7f5484063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:56.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 --2- 172.21.15.8:0/1018864999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5484060f70 0x7f5484063430 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f548c009f50 tx=0x7f548c009b30).stop 2023-10-18T22:14:56.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 -- 172.21.15.8:0/1018864999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f549c0f9690 msgr2=0x7f549c1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 --2- 172.21.15.8:0/1018864999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f549c0f9690 0x7f549c1072a0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f5490002700 tx=0x7f5490009d60).stop 2023-10-18T22:14:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 -- 172.21.15.8:0/1018864999 shutdown_connections 2023-10-18T22:14:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 --2- 172.21.15.8:0/1018864999 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5484060f70 0x7f5484063430 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 --2- 172.21.15.8:0/1018864999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f549c060310 0x7f549c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:14:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 --2- 172.21.15.8:0/1018864999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f549c0f9690 0x7f549c1072a0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 -- 172.21.15.8:0/1018864999 >> 172.21.15.8:0/1018864999 conn(0x7f549c0f0b90 msgr2=0x7f549c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 -- 172.21.15.8:0/1018864999 shutdown_connections 2023-10-18T22:14:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.779+0000 7f54a089e700 1 -- 172.21.15.8:0/1018864999 wait complete. 2023-10-18T22:14:56.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.919+0000 7effa5f3a700 1 -- 172.21.15.8:0/4232302162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effa00f77d0 msgr2=0x7effa00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:56.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.919+0000 7effa5f3a700 1 --2- 172.21.15.8:0/4232302162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effa00f77d0 0x7effa00f7c30 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7eff8c004660 tx=0x7eff8c009b30).stop 2023-10-18T22:14:56.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.919+0000 7effa5f3a700 1 -- 172.21.15.8:0/4232302162 shutdown_connections 2023-10-18T22:14:56.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.919+0000 7effa5f3a700 1 --2- 172.21.15.8:0/4232302162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effa00f77d0 0x7effa00f7c30 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.919+0000 7effa5f3a700 1 --2- 172.21.15.8:0/4232302162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa00f6530 0x7effa00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.919+0000 7effa5f3a700 1 -- 172.21.15.8:0/4232302162 >> 172.21.15.8:0/4232302162 conn(0x7effa00f1c90 msgr2=0x7effa00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:56.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.919+0000 7effa5f3a700 1 -- 172.21.15.8:0/4232302162 shutdown_connections 2023-10-18T22:14:56.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.919+0000 7effa5f3a700 1 -- 172.21.15.8:0/4232302162 wait complete. 2023-10-18T22:14:56.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.920+0000 7effa5f3a700 1 Processor -- start 2023-10-18T22:14:56.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.921+0000 7effa5f3a700 1 -- start start 2023-10-18T22:14:56.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.921+0000 7effa5f3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effa00f6530 0x7effa0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:56.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.921+0000 7effa5f3a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa00f77d0 0x7effa0107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:56.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.921+0000 7effa5f3a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0107850 con 0x7effa00f6530 2023-10-18T22:14:56.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.921+0000 7effa5f3a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0108060 con 0x7effa00f77d0 2023-10-18T22:14:56.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.921+0000 7effa4f38700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effa00f6530 0x7effa0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:56.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.921+0000 7effa4f38700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effa00f6530 0x7effa0106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59466/0 (socket says 172.21.15.8:59466) 2023-10-18T22:14:56.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.922+0000 7effa4f38700 1 -- 172.21.15.8:0/1026346328 learned_addr learned my addr 172.21.15.8:0/1026346328 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:56.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.922+0000 7eff9ffff700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa00f77d0 0x7effa0107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.922+0000 7effa4f38700 1 -- 172.21.15.8:0/1026346328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa00f77d0 msgr2=0x7effa0107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.922+0000 7effa4f38700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa00f77d0 0x7effa0107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.922+0000 7effa4f38700 1 -- 172.21.15.8:0/1026346328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c005040 con 0x7effa00f6530 2023-10-18T22:14:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.922+0000 7eff9ffff700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa00f77d0 0x7effa0107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:14:56.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.922+0000 7effa4f38700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effa00f6530 0x7effa0106d60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7eff9400e7c0 tx=0x7eff9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:56.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.922+0000 7eff9d7fa700 1 -- 172.21.15.8:0/1026346328 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff940092e0 con 0x7effa00f6530 2023-10-18T22:14:56.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.922+0000 7effa5f3a700 1 -- 172.21.15.8:0/1026346328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa01082e0 con 0x7effa00f6530 2023-10-18T22:14:56.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.922+0000 7eff9d7fa700 1 -- 172.21.15.8:0/1026346328 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7eff9400f040 con 0x7effa00f6530 2023-10-18T22:14:56.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.923+0000 7effa5f3a700 1 -- 172.21.15.8:0/1026346328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa0108820 con 0x7effa00f6530 2023-10-18T22:14:56.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.923+0000 7eff9d7fa700 1 -- 172.21.15.8:0/1026346328 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff94014780 con 0x7effa00f6530 2023-10-18T22:14:56.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.924+0000 7effa5f3a700 1 -- 172.21.15.8:0/1026346328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa0059100 con 0x7effa00f6530 2023-10-18T22:14:56.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.924+0000 7eff9d7fa700 1 -- 172.21.15.8:0/1026346328 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7eff9401b030 con 0x7effa00f6530 2023-10-18T22:14:56.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.925+0000 7eff9d7fa700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff90060f70 0x7eff90063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:56.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.925+0000 7eff9d7fa700 1 -- 172.21.15.8:0/1026346328 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7eff9407c990 con 0x7effa00f6530 2023-10-18T22:14:56.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.925+0000 7eff9ffff700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff90060f70 0x7eff90063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:56.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.926+0000 7eff9ffff700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff90060f70 0x7eff90063430 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7eff8c0043d0 tx=0x7eff8c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:56.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:56.930+0000 7eff9d7fa700 1 -- 172.21.15.8:0/1026346328 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7eff9404c600 con 0x7effa00f6530 2023-10-18T22:14:57.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.131+0000 7effa5f3a700 1 -- 172.21.15.8:0/1026346328 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7effa00008d0 con 0x7eff90060f70 2023-10-18T22:14:57.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.140+0000 7eff9d7fa700 1 -- 172.21.15.8:0/1026346328 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7effa00008d0 con 0x7eff90060f70 2023-10-18T22:14:57.142 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:14:57.142 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (81m) 8m ago 83m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:14:57.142 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (75m) 8m ago 83m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:14:57.142 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (75m) 6m ago 82m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:14:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (81m) 8m ago 82m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:14:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 79m - - 2023-10-18T22:14:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 79m - - 2023-10-18T22:14:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 79m - - 2023-10-18T22:14:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 79m - - 2023-10-18T22:14:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (76m) 8m ago 84m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:14:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (76m) 6m ago 82m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:14:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (75m) 8m ago 84m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:14:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (75m) 6m ago 82m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:14:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (82m) 8m ago 82m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:14:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (81m) 6m ago 81m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:14:57.145 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (75m) 8m ago 81m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:14:57.145 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (73m) 8m ago 81m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:14:57.145 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (72m) 8m ago 81m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:14:57.145 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (72m) 6m ago 80m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:14:57.145 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (71m) 6m ago 80m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:14:57.146 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (71m) 6m ago 80m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:14:57.146 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (77m) 8m ago 82m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:14:57.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 -- 172.21.15.8:0/1026346328 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff90060f70 msgr2=0x7eff90063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:57.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff90060f70 0x7eff90063430 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7eff8c0043d0 tx=0x7eff8c00b040).stop 2023-10-18T22:14:57.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 -- 172.21.15.8:0/1026346328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effa00f6530 msgr2=0x7effa0106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:57.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effa00f6530 0x7effa0106d60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7eff9400e7c0 tx=0x7eff9400b040).stop 2023-10-18T22:14:57.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 -- 172.21.15.8:0/1026346328 shutdown_connections 2023-10-18T22:14:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff90060f70 0x7eff90063430 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effa00f6530 0x7effa0106d60 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 --2- 172.21.15.8:0/1026346328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa00f77d0 0x7effa0107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 -- 172.21.15.8:0/1026346328 >> 172.21.15.8:0/1026346328 conn(0x7effa00f1c90 msgr2=0x7effa00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 -- 172.21.15.8:0/1026346328 shutdown_connections 2023-10-18T22:14:57.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.142+0000 7effa5f3a700 1 -- 172.21.15.8:0/1026346328 wait complete. 2023-10-18T22:14:57.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.278+0000 7fe99b197700 1 -- 172.21.15.8:0/3501012274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9940f77d0 msgr2=0x7fe9940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:57.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.278+0000 7fe99b197700 1 --2- 172.21.15.8:0/3501012274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9940f77d0 0x7fe9940f7c30 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7fe984004660 tx=0x7fe984009b30).stop 2023-10-18T22:14:57.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.279+0000 7fe99b197700 1 -- 172.21.15.8:0/3501012274 shutdown_connections 2023-10-18T22:14:57.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.279+0000 7fe99b197700 1 --2- 172.21.15.8:0/3501012274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9940f77d0 0x7fe9940f7c30 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.279+0000 7fe99b197700 1 --2- 172.21.15.8:0/3501012274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9940f6530 0x7fe9940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.279+0000 7fe99b197700 1 -- 172.21.15.8:0/3501012274 >> 172.21.15.8:0/3501012274 conn(0x7fe9940f1c90 msgr2=0x7fe9940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:57.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.279+0000 7fe99b197700 1 -- 172.21.15.8:0/3501012274 shutdown_connections 2023-10-18T22:14:57.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.279+0000 7fe99b197700 1 -- 172.21.15.8:0/3501012274 wait complete. 2023-10-18T22:14:57.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.279+0000 7fe99b197700 1 Processor -- start 2023-10-18T22:14:57.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.280+0000 7fe99b197700 1 -- start start 2023-10-18T22:14:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.280+0000 7fe99b197700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9940f6530 0x7fe994108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.280+0000 7fe99b197700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9940f77d0 0x7fe994109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.280+0000 7fe99b197700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe994109a10 con 0x7fe9940f77d0 2023-10-18T22:14:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.280+0000 7fe99b197700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe994109b50 con 0x7fe9940f6530 2023-10-18T22:14:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.280+0000 7fe999994700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9940f77d0 0x7fe994109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.280+0000 7fe999994700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9940f77d0 0x7fe994109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59490/0 (socket says 172.21.15.8:59490) 2023-10-18T22:14:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.280+0000 7fe999994700 1 -- 172.21.15.8:0/2228486698 learned_addr learned my addr 172.21.15.8:0/2228486698 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.280+0000 7fe99a195700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9940f6530 0x7fe994108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.281+0000 7fe999994700 1 -- 172.21.15.8:0/2228486698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9940f6530 msgr2=0x7fe994108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:57.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.281+0000 7fe999994700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9940f6530 0x7fe994108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.281+0000 7fe999994700 1 -- 172.21.15.8:0/2228486698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984005040 con 0x7fe9940f77d0 2023-10-18T22:14:57.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.281+0000 7fe999994700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9940f77d0 0x7fe994109460 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fe984009f50 tx=0x7fe984009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:57.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.281+0000 7fe98affd700 1 -- 172.21.15.8:0/2228486698 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe984018070 con 0x7fe9940f77d0 2023-10-18T22:14:57.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.281+0000 7fe98affd700 1 -- 172.21.15.8:0/2228486698 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe984009630 con 0x7fe9940f77d0 2023-10-18T22:14:57.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.281+0000 7fe98affd700 1 -- 172.21.15.8:0/2228486698 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe98401c3c0 con 0x7fe9940f77d0 2023-10-18T22:14:57.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.281+0000 7fe99b197700 1 -- 172.21.15.8:0/2228486698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99410a490 con 0x7fe9940f77d0 2023-10-18T22:14:57.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.282+0000 7fe99b197700 1 -- 172.21.15.8:0/2228486698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99410a9f0 con 0x7fe9940f77d0 2023-10-18T22:14:57.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.283+0000 7fe99b197700 1 -- 172.21.15.8:0/2228486698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe994045ad0 con 0x7fe9940f77d0 2023-10-18T22:14:57.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.284+0000 7fe98affd700 1 -- 172.21.15.8:0/2228486698 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe98401d420 con 0x7fe9940f77d0 2023-10-18T22:14:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.284+0000 7fe98affd700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe980060f70 0x7fe980063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.284+0000 7fe98affd700 1 -- 172.21.15.8:0/2228486698 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe98407e480 con 0x7fe9940f77d0 2023-10-18T22:14:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.285+0000 7fe99a195700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe980060f70 0x7fe980063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.285+0000 7fe99a195700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe980060f70 0x7fe980063430 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fe9940f7630 tx=0x7fe99000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:57.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.289+0000 7fe98affd700 1 -- 172.21.15.8:0/2228486698 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe984051ba0 con 0x7fe9940f77d0 2023-10-18T22:14:57.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.541+0000 7fe99b197700 1 -- 172.21.15.8:0/2228486698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe994027a00 con 0x7fe9940f77d0 2023-10-18T22:14:57.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.541+0000 7fe98affd700 1 -- 172.21.15.8:0/2228486698 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fe984051790 con 0x7fe9940f77d0 2023-10-18T22:14:57.543 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:14:57.543 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:14:57.543 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:14:57.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:14:57.544 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:14:57.544 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:14:57.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:14:57.545 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:14:57.545 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:14:57.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:14:57.545 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:14:57.545 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:14:57.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:14:57.546 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:14:57.546 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:14:57.546 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:14:57.546 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:14:57.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.543+0000 7fe99b197700 1 -- 172.21.15.8:0/2228486698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe980060f70 msgr2=0x7fe980063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:57.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.543+0000 7fe99b197700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe980060f70 0x7fe980063430 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fe9940f7630 tx=0x7fe99000b040).stop 2023-10-18T22:14:57.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.543+0000 7fe99b197700 1 -- 172.21.15.8:0/2228486698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9940f77d0 msgr2=0x7fe994109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:57.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.543+0000 7fe99b197700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9940f77d0 0x7fe994109460 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fe984009f50 tx=0x7fe984009b30).stop 2023-10-18T22:14:57.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.543+0000 7fe99b197700 1 -- 172.21.15.8:0/2228486698 shutdown_connections 2023-10-18T22:14:57.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.543+0000 7fe99b197700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe980060f70 0x7fe980063430 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.543+0000 7fe99b197700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9940f6530 0x7fe994108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.543+0000 7fe99b197700 1 --2- 172.21.15.8:0/2228486698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9940f77d0 0x7fe994109460 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.544+0000 7fe99b197700 1 -- 172.21.15.8:0/2228486698 >> 172.21.15.8:0/2228486698 conn(0x7fe9940f1c90 msgr2=0x7fe99406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:57.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.544+0000 7fe99b197700 1 -- 172.21.15.8:0/2228486698 shutdown_connections 2023-10-18T22:14:57.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.544+0000 7fe99b197700 1 -- 172.21.15.8:0/2228486698 wait complete. 2023-10-18T22:14:57.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.680+0000 7f1f4df0b700 1 -- 172.21.15.8:0/1246305109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f480f6530 msgr2=0x7f1f480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:57.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.680+0000 7f1f4df0b700 1 --2- 172.21.15.8:0/1246305109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f480f6530 0x7f1f480f6950 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f1f3c004660 tx=0x7f1f3c009b30).stop 2023-10-18T22:14:57.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.680+0000 7f1f4df0b700 1 -- 172.21.15.8:0/1246305109 shutdown_connections 2023-10-18T22:14:57.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.680+0000 7f1f4df0b700 1 --2- 172.21.15.8:0/1246305109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f480f77d0 0x7f1f480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.680+0000 7f1f4df0b700 1 --2- 172.21.15.8:0/1246305109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f480f6530 0x7f1f480f6950 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.680+0000 7f1f4df0b700 1 -- 172.21.15.8:0/1246305109 >> 172.21.15.8:0/1246305109 conn(0x7f1f480f1c90 msgr2=0x7f1f480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:57.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.680+0000 7f1f4df0b700 1 -- 172.21.15.8:0/1246305109 shutdown_connections 2023-10-18T22:14:57.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.680+0000 7f1f4df0b700 1 -- 172.21.15.8:0/1246305109 wait complete. 2023-10-18T22:14:57.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.681+0000 7f1f4df0b700 1 Processor -- start 2023-10-18T22:14:57.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.681+0000 7f1f4df0b700 1 -- start start 2023-10-18T22:14:57.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f4df0b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f480f6530 0x7f1f4806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:57.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f4df0b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f480f77d0 0x7f1f48069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:57.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f4df0b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4806a380 con 0x7f1f480f77d0 2023-10-18T22:14:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f4df0b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4806a4c0 con 0x7f1f480f6530 2023-10-18T22:14:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f47fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f480f77d0 0x7f1f48069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f47fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f480f77d0 0x7f1f48069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59500/0 (socket says 172.21.15.8:59500) 2023-10-18T22:14:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f47fff700 1 -- 172.21.15.8:0/370322906 learned_addr learned my addr 172.21.15.8:0/370322906 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f4cf09700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f480f6530 0x7f1f4806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:57.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f47fff700 1 -- 172.21.15.8:0/370322906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f480f6530 msgr2=0x7f1f4806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:57.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f47fff700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f480f6530 0x7f1f4806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f47fff700 1 -- 172.21.15.8:0/370322906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c005040 con 0x7f1f480f77d0 2023-10-18T22:14:57.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.682+0000 7f1f47fff700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f480f77d0 0x7f1f48069e20 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f1f3400e7f0 tx=0x7f1f3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:57.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.683+0000 7f1f457fa700 1 -- 172.21.15.8:0/370322906 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f340092e0 con 0x7f1f480f77d0 2023-10-18T22:14:57.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.683+0000 7f1f457fa700 1 -- 172.21.15.8:0/370322906 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1f3400f040 con 0x7f1f480f77d0 2023-10-18T22:14:57.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.683+0000 7f1f457fa700 1 -- 172.21.15.8:0/370322906 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f340147e0 con 0x7f1f480f77d0 2023-10-18T22:14:57.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.683+0000 7f1f4df0b700 1 -- 172.21.15.8:0/370322906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4806a7a0 con 0x7f1f480f77d0 2023-10-18T22:14:57.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.683+0000 7f1f4df0b700 1 -- 172.21.15.8:0/370322906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4810ed00 con 0x7f1f480f77d0 2023-10-18T22:14:57.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.684+0000 7f1f4df0b700 1 -- 172.21.15.8:0/370322906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f48045ad0 con 0x7f1f480f77d0 2023-10-18T22:14:57.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.685+0000 7f1f457fa700 1 -- 172.21.15.8:0/370322906 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1f3401b030 con 0x7f1f480f77d0 2023-10-18T22:14:57.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.685+0000 7f1f457fa700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 0x7f1f38063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:57.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.686+0000 7f1f457fa700 1 -- 172.21.15.8:0/370322906 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1f3407c680 con 0x7f1f480f77d0 2023-10-18T22:14:57.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.686+0000 7f1f4cf09700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 0x7f1f38063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:57.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.686+0000 7f1f4cf09700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 0x7f1f38063430 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f1f3c004d80 tx=0x7f1f3c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:57.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.690+0000 7f1f457fa700 1 -- 172.21.15.8:0/370322906 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1f3404c340 con 0x7f1f480f77d0 2023-10-18T22:14:57.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.914+0000 7f1f4df0b700 1 -- 172.21.15.8:0/370322906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1f48027a00 con 0x7f1f480f77d0 2023-10-18T22:14:57.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.915+0000 7f1f457fa700 1 -- 172.21.15.8:0/370322906 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1f34019070 con 0x7f1f480f77d0 2023-10-18T22:14:57.918 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:14:57.919 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:14:57.919 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:14:57.919 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:14:57.920 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:14:57.920 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:14:57.920 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:14:57.920 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:14:57.921 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:14:57.921 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:14:57.921 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:14:57.921 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:14:57.921 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:14:57.922 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:14:57.922 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:14:57.923 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:14:57.923 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:14:57.923 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:14:57.923 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:14:57.924 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:14:57.924 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:14:57.924 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:14:57.924 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:14:57.924 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:14:57.925 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:14:57.925 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:14:57.925 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:14:57.925 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:14:57.926 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:14:57.927 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:14:57.927 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:14:57.927 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:14:57.927 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:14:57.927 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:14:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 -- 172.21.15.8:0/370322906 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 msgr2=0x7f1f38063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 0x7f1f38063430 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f1f3c004d80 tx=0x7f1f3c00b040).stop 2023-10-18T22:14:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 -- 172.21.15.8:0/370322906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f480f77d0 msgr2=0x7f1f48069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f480f77d0 0x7f1f48069e20 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f1f3400e7f0 tx=0x7f1f3400b040).stop 2023-10-18T22:14:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 -- 172.21.15.8:0/370322906 shutdown_connections 2023-10-18T22:14:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1f38060f70 0x7f1f38063430 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f480f6530 0x7f1f4806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 --2- 172.21.15.8:0/370322906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f480f77d0 0x7f1f48069e20 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 -- 172.21.15.8:0/370322906 >> 172.21.15.8:0/370322906 conn(0x7f1f480f1c90 msgr2=0x7f1f480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 -- 172.21.15.8:0/370322906 shutdown_connections 2023-10-18T22:14:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:57.917+0000 7f1f4df0b700 1 -- 172.21.15.8:0/370322906 wait complete. 2023-10-18T22:14:57.931 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:14:58.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.054+0000 7f3dc49e5700 1 -- 172.21.15.8:0/2976620544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc00f77d0 msgr2=0x7f3dc00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:58.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.054+0000 7f3dc49e5700 1 --2- 172.21.15.8:0/2976620544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc00f77d0 0x7f3dc00f7c30 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f3db4004660 tx=0x7f3db4009b30).stop 2023-10-18T22:14:58.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.054+0000 7f3dc49e5700 1 -- 172.21.15.8:0/2976620544 shutdown_connections 2023-10-18T22:14:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.054+0000 7f3dc49e5700 1 --2- 172.21.15.8:0/2976620544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc00f77d0 0x7f3dc00f7c30 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.054+0000 7f3dc49e5700 1 --2- 172.21.15.8:0/2976620544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc00f6530 0x7f3dc00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:14:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.054+0000 7f3dc49e5700 1 -- 172.21.15.8:0/2976620544 >> 172.21.15.8:0/2976620544 conn(0x7f3dc00f1c90 msgr2=0x7f3dc00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.054+0000 7f3dc49e5700 1 -- 172.21.15.8:0/2976620544 shutdown_connections 2023-10-18T22:14:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.055+0000 7f3dc49e5700 1 -- 172.21.15.8:0/2976620544 wait complete. 2023-10-18T22:14:58.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.055+0000 7f3dc49e5700 1 Processor -- start 2023-10-18T22:14:58.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.056+0000 7f3dc49e5700 1 -- start start 2023-10-18T22:14:58.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.056+0000 7f3dc49e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc00f6530 0x7f3dc0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:58.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.056+0000 7f3dc49e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc00f77d0 0x7f3dc0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:58.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.056+0000 7f3dc49e5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc01079a0 con 0x7f3dc00f77d0 2023-10-18T22:14:58.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.056+0000 7f3dc49e5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc0108120 con 0x7f3dc00f6530 2023-10-18T22:14:58.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.056+0000 7f3dbe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc00f77d0 0x7f3dc0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:58.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.056+0000 7f3dbe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc00f77d0 0x7f3dc0107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59512/0 (socket says 172.21.15.8:59512) 2023-10-18T22:14:58.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.056+0000 7f3dbe59c700 1 -- 172.21.15.8:0/4106499466 learned_addr learned my addr 172.21.15.8:0/4106499466 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:14:58.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.056+0000 7f3dbed9d700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc00f6530 0x7f3dc0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:58.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.057+0000 7f3dbe59c700 1 -- 172.21.15.8:0/4106499466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc00f6530 msgr2=0x7f3dc0106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:58.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.057+0000 7f3dbe59c700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc00f6530 0x7f3dc0106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:58.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.057+0000 7f3dbe59c700 1 -- 172.21.15.8:0/4106499466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db4005040 con 0x7f3dc00f77d0 2023-10-18T22:14:58.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.057+0000 7f3dbed9d700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc00f6530 0x7f3dc0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:14:58.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.057+0000 7f3dbe59c700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc00f77d0 0x7f3dc0107310 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f3db4009830 tx=0x7f3db4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:58.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.057+0000 7f3da77fe700 1 -- 172.21.15.8:0/4106499466 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3db4018070 con 0x7f3dc00f77d0 2023-10-18T22:14:58.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.057+0000 7f3da77fe700 1 -- 172.21.15.8:0/4106499466 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3db401d8e0 con 0x7f3dc00f77d0 2023-10-18T22:14:58.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.057+0000 7f3da77fe700 1 -- 172.21.15.8:0/4106499466 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3db401c540 con 0x7f3dc00f77d0 2023-10-18T22:14:58.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.057+0000 7f3dc49e5700 1 -- 172.21.15.8:0/4106499466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc0108340 con 0x7f3dc00f77d0 2023-10-18T22:14:58.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.057+0000 7f3dc49e5700 1 -- 172.21.15.8:0/4106499466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc01088a0 con 0x7f3dc00f77d0 2023-10-18T22:14:58.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.058+0000 7f3dc49e5700 1 -- 172.21.15.8:0/4106499466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc0045ad0 con 0x7f3dc00f77d0 2023-10-18T22:14:58.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.059+0000 7f3da77fe700 1 -- 172.21.15.8:0/4106499466 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3db401da50 con 0x7f3dc00f77d0 2023-10-18T22:14:58.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.060+0000 7f3da77fe700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3da8060f70 0x7f3da8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:14:58.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.060+0000 7f3da77fe700 1 -- 172.21.15.8:0/4106499466 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3db407e7c0 con 0x7f3dc00f77d0 2023-10-18T22:14:58.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.060+0000 7f3dbed9d700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3da8060f70 0x7f3da8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:14:58.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.061+0000 7f3dbed9d700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3da8060f70 0x7f3da8063430 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f3dc0106b90 tx=0x7f3db0008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:14:58.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.064+0000 7f3da77fe700 1 -- 172.21.15.8:0/4106499466 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3db404e3f0 con 0x7f3dc00f77d0 2023-10-18T22:14:58.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.263+0000 7f3dc49e5700 1 -- 172.21.15.8:0/4106499466 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dc00feee0 con 0x7f3da8060f70 2023-10-18T22:14:58.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.264+0000 7f3da77fe700 1 -- 172.21.15.8:0/4106499466 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3dc00feee0 con 0x7f3da8060f70 2023-10-18T22:14:58.265 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:14:58.266 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:14:58.266 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:14:58.266 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:14:58.266 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:14:58.266 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:14:58.267 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:14:58.267 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:14:58.267 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:14:58.267 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:14:58.267 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:14:58.268 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:14:58.268 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:14:58.268 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:14:58.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 -- 172.21.15.8:0/4106499466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3da8060f70 msgr2=0x7f3da8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:58.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3da8060f70 0x7f3da8063430 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f3dc0106b90 tx=0x7f3db0008040).stop 2023-10-18T22:14:58.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 -- 172.21.15.8:0/4106499466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc00f77d0 msgr2=0x7f3dc0107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:14:58.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc00f77d0 0x7f3dc0107310 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f3db4009830 tx=0x7f3db4009b30).stop 2023-10-18T22:14:58.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 -- 172.21.15.8:0/4106499466 shutdown_connections 2023-10-18T22:14:58.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3da8060f70 0x7f3da8063430 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:58.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc00f6530 0x7f3dc0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:58.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 --2- 172.21.15.8:0/4106499466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc00f77d0 0x7f3dc0107310 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:14:58.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 -- 172.21.15.8:0/4106499466 >> 172.21.15.8:0/4106499466 conn(0x7f3dc00f1c90 msgr2=0x7f3dc00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:14:58.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 -- 172.21.15.8:0/4106499466 shutdown_connections 2023-10-18T22:14:58.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:14:58.266+0000 7f3dc49e5700 1 -- 172.21.15.8:0/4106499466 wait complete. 2023-10-18T22:14:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:56.420251+0000 mgr.smithi008.flmjzp (mgr.14640) 4561 : audit [DBG] from='client.37672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:56.776894+0000 mgr.smithi008.flmjzp (mgr.14640) 4562 : audit [DBG] from='client.37676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:56.886502+0000 mgr.smithi008.flmjzp (mgr.14640) 4563 : cluster [DBG] pgmap v3131: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:57.132282+0000 mgr.smithi008.flmjzp (mgr.14640) 4564 : audit [DBG] from='client.37680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:57.542088+0000 mon.smithi008 (mon.0) 4852 : audit [DBG] from='client.? 172.21.15.8:0/2228486698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:57.915634+0000 mon.smithi008 (mon.0) 4853 : audit [DBG] from='client.? 172.21.15.8:0/370322906' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:14:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:56.420251+0000 mgr.smithi008.flmjzp (mgr.14640) 4561 : audit [DBG] from='client.37672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:56.776894+0000 mgr.smithi008.flmjzp (mgr.14640) 4562 : audit [DBG] from='client.37676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:56.886502+0000 mgr.smithi008.flmjzp (mgr.14640) 4563 : cluster [DBG] pgmap v3131: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:14:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:57.132282+0000 mgr.smithi008.flmjzp (mgr.14640) 4564 : audit [DBG] from='client.37680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:57.542088+0000 mon.smithi008 (mon.0) 4852 : audit [DBG] from='client.? 172.21.15.8:0/2228486698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:14:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:57.915634+0000 mon.smithi008 (mon.0) 4853 : audit [DBG] from='client.? 172.21.15.8:0/370322906' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:14:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:58.264473+0000 mgr.smithi008.flmjzp (mgr.14640) 4565 : audit [DBG] from='client.37692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:59.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:14:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:58.915383+0000 mon.smithi008 (mon.0) 4854 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:14:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:58.264473+0000 mgr.smithi008.flmjzp (mgr.14640) 4565 : audit [DBG] from='client.37692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:14:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:14:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:58.915383+0000 mon.smithi008 (mon.0) 4854 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:58.886959+0000 mgr.smithi008.flmjzp (mgr.14640) 4566 : cluster [DBG] pgmap v3132: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:59.466700+0000 mon.smithi008 (mon.0) 4855 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:00.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:59.467519+0000 mon.smithi008 (mon.0) 4856 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:59.472706+0000 mon.smithi008 (mon.0) 4857 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:59.477694+0000 mon.smithi008 (mon.0) 4858 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:59.480053+0000 mon.smithi008 (mon.0) 4859 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:00.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:59.481353+0000 mon.smithi008 (mon.0) 4860 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:00.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:59.482618+0000 mon.smithi008 (mon.0) 4861 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:00.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:14:59.484171+0000 mon.smithi008 (mon.0) 4862 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:58.886959+0000 mgr.smithi008.flmjzp (mgr.14640) 4566 : cluster [DBG] pgmap v3132: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:59.466700+0000 mon.smithi008 (mon.0) 4855 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:59.467519+0000 mon.smithi008 (mon.0) 4856 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:59.472706+0000 mon.smithi008 (mon.0) 4857 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:00.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:59.477694+0000 mon.smithi008 (mon.0) 4858 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:00.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:59.480053+0000 mon.smithi008 (mon.0) 4859 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:00.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:59.481353+0000 mon.smithi008 (mon.0) 4860 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:00.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:59.482618+0000 mon.smithi008 (mon.0) 4861 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:00.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:14:59.484171+0000 mon.smithi008 (mon.0) 4862 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:59.468175+0000 mgr.smithi008.flmjzp (mgr.14640) 4567 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:59.468655+0000 mgr.smithi008.flmjzp (mgr.14640) 4568 : cluster [DBG] pgmap v3133: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:14:59.468876+0000 mgr.smithi008.flmjzp (mgr.14640) 4569 : cluster [DBG] pgmap v3134: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:14:59.485724+0000 mgr.smithi008.flmjzp (mgr.14640) 4570 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:59.468175+0000 mgr.smithi008.flmjzp (mgr.14640) 4567 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:59.468655+0000 mgr.smithi008.flmjzp (mgr.14640) 4568 : cluster [DBG] pgmap v3133: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:14:59.468876+0000 mgr.smithi008.flmjzp (mgr.14640) 4569 : cluster [DBG] pgmap v3134: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:14:59.485724+0000 mgr.smithi008.flmjzp (mgr.14640) 4570 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:01.469330+0000 mgr.smithi008.flmjzp (mgr.14640) 4571 : cluster [DBG] pgmap v3135: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:01.469330+0000 mgr.smithi008.flmjzp (mgr.14640) 4571 : cluster [DBG] pgmap v3135: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:03.469830+0000 mgr.smithi008.flmjzp (mgr.14640) 4572 : cluster [DBG] pgmap v3136: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:03.469830+0000 mgr.smithi008.flmjzp (mgr.14640) 4572 : cluster [DBG] pgmap v3136: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:05.470544+0000 mgr.smithi008.flmjzp (mgr.14640) 4573 : cluster [DBG] pgmap v3137: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:05.470544+0000 mgr.smithi008.flmjzp (mgr.14640) 4573 : cluster [DBG] pgmap v3137: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:07.471067+0000 mgr.smithi008.flmjzp (mgr.14640) 4574 : cluster [DBG] pgmap v3138: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:07.471067+0000 mgr.smithi008.flmjzp (mgr.14640) 4574 : cluster [DBG] pgmap v3138: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:09.496562+0000 mon.smithi008 (mon.0) 4863 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:09.498650+0000 mon.smithi008 (mon.0) 4864 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:09.499718+0000 mon.smithi008 (mon.0) 4865 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:09.506248+0000 mon.smithi008 (mon.0) 4866 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:09.512667+0000 mon.smithi008 (mon.0) 4867 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:09.515804+0000 mon.smithi008 (mon.0) 4868 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:09.517500+0000 mon.smithi008 (mon.0) 4869 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:09.519103+0000 mon.smithi008 (mon.0) 4870 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:09.521223+0000 mon.smithi008 (mon.0) 4871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:09.496562+0000 mon.smithi008 (mon.0) 4863 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:09.498650+0000 mon.smithi008 (mon.0) 4864 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:10.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:09.499718+0000 mon.smithi008 (mon.0) 4865 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:10.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:09.506248+0000 mon.smithi008 (mon.0) 4866 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:10.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:09.512667+0000 mon.smithi008 (mon.0) 4867 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:10.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:09.515804+0000 mon.smithi008 (mon.0) 4868 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:10.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:09.517500+0000 mon.smithi008 (mon.0) 4869 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:10.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:09.519103+0000 mon.smithi008 (mon.0) 4870 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:10.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:09.521223+0000 mon.smithi008 (mon.0) 4871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:09.471763+0000 mgr.smithi008.flmjzp (mgr.14640) 4575 : cluster [DBG] pgmap v3139: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:15:09.500674+0000 mgr.smithi008.flmjzp (mgr.14640) 4576 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:09.501244+0000 mgr.smithi008.flmjzp (mgr.14640) 4577 : cluster [DBG] pgmap v3140: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:09.501597+0000 mgr.smithi008.flmjzp (mgr.14640) 4578 : cluster [DBG] pgmap v3141: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:15:09.523156+0000 mgr.smithi008.flmjzp (mgr.14640) 4579 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:09.471763+0000 mgr.smithi008.flmjzp (mgr.14640) 4575 : cluster [DBG] pgmap v3139: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:15:09.500674+0000 mgr.smithi008.flmjzp (mgr.14640) 4576 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:09.501244+0000 mgr.smithi008.flmjzp (mgr.14640) 4577 : cluster [DBG] pgmap v3140: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:09.501597+0000 mgr.smithi008.flmjzp (mgr.14640) 4578 : cluster [DBG] pgmap v3141: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:15:09.523156+0000 mgr.smithi008.flmjzp (mgr.14640) 4579 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:11.502310+0000 mgr.smithi008.flmjzp (mgr.14640) 4580 : cluster [DBG] pgmap v3142: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:11.502310+0000 mgr.smithi008.flmjzp (mgr.14640) 4580 : cluster [DBG] pgmap v3142: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:13.502874+0000 mgr.smithi008.flmjzp (mgr.14640) 4581 : cluster [DBG] pgmap v3143: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:13.502874+0000 mgr.smithi008.flmjzp (mgr.14640) 4581 : cluster [DBG] pgmap v3143: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:15.503602+0000 mgr.smithi008.flmjzp (mgr.14640) 4582 : cluster [DBG] pgmap v3144: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:15.503602+0000 mgr.smithi008.flmjzp (mgr.14640) 4582 : cluster [DBG] pgmap v3144: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:19.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:17.504119+0000 mgr.smithi008.flmjzp (mgr.14640) 4583 : cluster [DBG] pgmap v3145: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:17.504119+0000 mgr.smithi008.flmjzp (mgr.14640) 4583 : cluster [DBG] pgmap v3145: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:19.529477+0000 mon.smithi008 (mon.0) 4872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:20.085193+0000 mon.smithi008 (mon.0) 4873 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:20.086381+0000 mon.smithi008 (mon.0) 4874 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:20.093084+0000 mon.smithi008 (mon.0) 4875 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:20.101346+0000 mon.smithi008 (mon.0) 4876 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:20.104373+0000 mon.smithi008 (mon.0) 4877 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:20.106065+0000 mon.smithi008 (mon.0) 4878 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:20.107631+0000 mon.smithi008 (mon.0) 4879 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:20.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:20.109861+0000 mon.smithi008 (mon.0) 4880 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:19.529477+0000 mon.smithi008 (mon.0) 4872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:20.085193+0000 mon.smithi008 (mon.0) 4873 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:20.086381+0000 mon.smithi008 (mon.0) 4874 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:20.093084+0000 mon.smithi008 (mon.0) 4875 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:20.101346+0000 mon.smithi008 (mon.0) 4876 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:20.104373+0000 mon.smithi008 (mon.0) 4877 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:20.106065+0000 mon.smithi008 (mon.0) 4878 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:20.107631+0000 mon.smithi008 (mon.0) 4879 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:20.109861+0000 mon.smithi008 (mon.0) 4880 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:19.504744+0000 mgr.smithi008.flmjzp (mgr.14640) 4584 : cluster [DBG] pgmap v3146: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:15:20.087415+0000 mgr.smithi008.flmjzp (mgr.14640) 4585 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:20.088109+0000 mgr.smithi008.flmjzp (mgr.14640) 4586 : cluster [DBG] pgmap v3147: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:20.088396+0000 mgr.smithi008.flmjzp (mgr.14640) 4587 : cluster [DBG] pgmap v3148: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:15:20.111940+0000 mgr.smithi008.flmjzp (mgr.14640) 4588 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:19.504744+0000 mgr.smithi008.flmjzp (mgr.14640) 4584 : cluster [DBG] pgmap v3146: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:15:20.087415+0000 mgr.smithi008.flmjzp (mgr.14640) 4585 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:20.088109+0000 mgr.smithi008.flmjzp (mgr.14640) 4586 : cluster [DBG] pgmap v3147: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:20.088396+0000 mgr.smithi008.flmjzp (mgr.14640) 4587 : cluster [DBG] pgmap v3148: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:15:20.111940+0000 mgr.smithi008.flmjzp (mgr.14640) 4588 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:23.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:22.088874+0000 mgr.smithi008.flmjzp (mgr.14640) 4589 : cluster [DBG] pgmap v3149: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:22.088874+0000 mgr.smithi008.flmjzp (mgr.14640) 4589 : cluster [DBG] pgmap v3149: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:25.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:24.089551+0000 mgr.smithi008.flmjzp (mgr.14640) 4590 : cluster [DBG] pgmap v3150: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:24.089551+0000 mgr.smithi008.flmjzp (mgr.14640) 4590 : cluster [DBG] pgmap v3150: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:27.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:26.090127+0000 mgr.smithi008.flmjzp (mgr.14640) 4591 : cluster [DBG] pgmap v3151: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:26.090127+0000 mgr.smithi008.flmjzp (mgr.14640) 4591 : cluster [DBG] pgmap v3151: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:28.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.419+0000 7f8307fff700 1 -- 172.21.15.8:0/636700617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83080f6530 msgr2=0x7f83080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:28.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.419+0000 7f8307fff700 1 --2- 172.21.15.8:0/636700617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83080f6530 0x7f83080f6950 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f82f8004660 tx=0x7f82f8009b30).stop 2023-10-18T22:15:28.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.419+0000 7f8307fff700 1 -- 172.21.15.8:0/636700617 shutdown_connections 2023-10-18T22:15:28.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.419+0000 7f8307fff700 1 --2- 172.21.15.8:0/636700617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83080f77d0 0x7f83080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.419+0000 7f8307fff700 1 --2- 172.21.15.8:0/636700617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83080f6530 0x7f83080f6950 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.419+0000 7f8307fff700 1 -- 172.21.15.8:0/636700617 >> 172.21.15.8:0/636700617 conn(0x7f83080f1c90 msgr2=0x7f83080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:28.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.420+0000 7f8307fff700 1 -- 172.21.15.8:0/636700617 shutdown_connections 2023-10-18T22:15:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.420+0000 7f8307fff700 1 -- 172.21.15.8:0/636700617 wait complete. 2023-10-18T22:15:28.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.420+0000 7f8307fff700 1 Processor -- start 2023-10-18T22:15:28.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.421+0000 7f8307fff700 1 -- start start 2023-10-18T22:15:28.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.421+0000 7f8307fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83080f6530 0x7f8308108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:28.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.421+0000 7f8307fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83080f77d0 0x7f83081094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:28.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.421+0000 7f8307fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8308109a70 con 0x7f83080f77d0 2023-10-18T22:15:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.421+0000 7f8307fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8308109bb0 con 0x7f83080f6530 2023-10-18T22:15:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.421+0000 7f83067fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83080f77d0 0x7f83081094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.421+0000 7f83067fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83080f77d0 0x7f83081094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60634/0 (socket says 172.21.15.8:60634) 2023-10-18T22:15:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.421+0000 7f83067fc700 1 -- 172.21.15.8:0/1156211446 learned_addr learned my addr 172.21.15.8:0/1156211446 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:15:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.421+0000 7f8306ffd700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83080f6530 0x7f8308108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.422+0000 7f83067fc700 1 -- 172.21.15.8:0/1156211446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83080f6530 msgr2=0x7f8308108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:28.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.422+0000 7f83067fc700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83080f6530 0x7f8308108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.422+0000 7f83067fc700 1 -- 172.21.15.8:0/1156211446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8005040 con 0x7f83080f77d0 2023-10-18T22:15:28.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.422+0000 7f83067fc700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83080f77d0 0x7f83081094c0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f82fc0026d0 tx=0x7f82fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:28.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.422+0000 7f82ef7fe700 1 -- 172.21.15.8:0/1156211446 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82fc0079c0 con 0x7f83080f77d0 2023-10-18T22:15:28.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.422+0000 7f82ef7fe700 1 -- 172.21.15.8:0/1156211446 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f82fc00f040 con 0x7f83080f77d0 2023-10-18T22:15:28.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.422+0000 7f82ef7fe700 1 -- 172.21.15.8:0/1156211446 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82fc014980 con 0x7f83080f77d0 2023-10-18T22:15:28.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.422+0000 7f8307fff700 1 -- 172.21.15.8:0/1156211446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830810a550 con 0x7f83080f77d0 2023-10-18T22:15:28.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.422+0000 7f8307fff700 1 -- 172.21.15.8:0/1156211446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830810ab10 con 0x7f83080f77d0 2023-10-18T22:15:28.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.424+0000 7f8307fff700 1 -- 172.21.15.8:0/1156211446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8308045ad0 con 0x7f83080f77d0 2023-10-18T22:15:28.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.424+0000 7f82ef7fe700 1 -- 172.21.15.8:0/1156211446 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f82fc0090d0 con 0x7f83080f77d0 2023-10-18T22:15:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.425+0000 7f82ef7fe700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f0060f70 0x7f82f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.425+0000 7f82ef7fe700 1 -- 172.21.15.8:0/1156211446 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f82fc07c8a0 con 0x7f83080f77d0 2023-10-18T22:15:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.426+0000 7f8306ffd700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f0060f70 0x7f82f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.426+0000 7f8306ffd700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f0060f70 0x7f82f0063430 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f82f8004630 tx=0x7f82f8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.430+0000 7f82ef7fe700 1 -- 172.21.15.8:0/1156211446 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f82fc04ffb0 con 0x7f83080f77d0 2023-10-18T22:15:28.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.627+0000 7f8307fff700 1 -- 172.21.15.8:0/1156211446 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f830810ade0 con 0x7f82f0060f70 2023-10-18T22:15:28.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.628+0000 7f82ef7fe700 1 -- 172.21.15.8:0/1156211446 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f830810ade0 con 0x7f82f0060f70 2023-10-18T22:15:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.630+0000 7f8307fff700 1 -- 172.21.15.8:0/1156211446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f0060f70 msgr2=0x7f82f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.630+0000 7f8307fff700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f0060f70 0x7f82f0063430 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f82f8004630 tx=0x7f82f8009b30).stop 2023-10-18T22:15:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.630+0000 7f8307fff700 1 -- 172.21.15.8:0/1156211446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83080f77d0 msgr2=0x7f83081094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.630+0000 7f8307fff700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83080f77d0 0x7f83081094c0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f82fc0026d0 tx=0x7f82fc009de0).stop 2023-10-18T22:15:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.630+0000 7f8307fff700 1 -- 172.21.15.8:0/1156211446 shutdown_connections 2023-10-18T22:15:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.630+0000 7f8307fff700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f0060f70 0x7f82f0063430 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.630+0000 7f8307fff700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83080f6530 0x7f8308108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.630+0000 7f8307fff700 1 --2- 172.21.15.8:0/1156211446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f83080f77d0 0x7f83081094c0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.630+0000 7f8307fff700 1 -- 172.21.15.8:0/1156211446 >> 172.21.15.8:0/1156211446 conn(0x7f83080f1c90 msgr2=0x7f830806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.631+0000 7f8307fff700 1 -- 172.21.15.8:0/1156211446 shutdown_connections 2023-10-18T22:15:28.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.631+0000 7f8307fff700 1 -- 172.21.15.8:0/1156211446 wait complete. 2023-10-18T22:15:28.646 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:15:28.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.770+0000 7f03a759e700 1 -- 172.21.15.8:0/116954426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a80f9690 msgr2=0x7f03a80fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:28.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.770+0000 7f03a759e700 1 --2- 172.21.15.8:0/116954426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a80f9690 0x7f03a80fbae0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f039c004660 tx=0x7f039c009b30).stop 2023-10-18T22:15:28.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.770+0000 7f03a759e700 1 -- 172.21.15.8:0/116954426 shutdown_connections 2023-10-18T22:15:28.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.770+0000 7f03a759e700 1 --2- 172.21.15.8:0/116954426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a80f9690 0x7f03a80fbae0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.770+0000 7f03a759e700 1 --2- 172.21.15.8:0/116954426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03a8060310 0x7f03a80f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.770+0000 7f03a759e700 1 -- 172.21.15.8:0/116954426 >> 172.21.15.8:0/116954426 conn(0x7f03a80f0b90 msgr2=0x7f03a80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:28.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.770+0000 7f03a759e700 1 -- 172.21.15.8:0/116954426 shutdown_connections 2023-10-18T22:15:28.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.770+0000 7f03a759e700 1 -- 172.21.15.8:0/116954426 wait complete. 2023-10-18T22:15:28.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.771+0000 7f03a759e700 1 Processor -- start 2023-10-18T22:15:28.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.771+0000 7f03a759e700 1 -- start start 2023-10-18T22:15:28.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.771+0000 7f03a759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03a8060310 0x7f03a8106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:28.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.771+0000 7f03a759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a80f9690 0x7f03a81072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:28.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.771+0000 7f03a759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a81078b0 con 0x7f03a80f9690 2023-10-18T22:15:28.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.771+0000 7f03a759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a81080f0 con 0x7f03a8060310 2023-10-18T22:15:28.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f03a5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a80f9690 0x7f03a81072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:28.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f03a5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a80f9690 0x7f03a81072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60652/0 (socket says 172.21.15.8:60652) 2023-10-18T22:15:28.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f03a5d9b700 1 -- 172.21.15.8:0/247977678 learned_addr learned my addr 172.21.15.8:0/247977678 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:15:28.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f03a659c700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03a8060310 0x7f03a8106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:28.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f03a5d9b700 1 -- 172.21.15.8:0/247977678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03a8060310 msgr2=0x7f03a8106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:28.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f03a5d9b700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03a8060310 0x7f03a8106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f03a5d9b700 1 -- 172.21.15.8:0/247977678 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c005040 con 0x7f03a80f9690 2023-10-18T22:15:28.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f03a5d9b700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a80f9690 0x7f03a81072b0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f039c004e30 tx=0x7f039c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:28.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f0396ffd700 1 -- 172.21.15.8:0/247977678 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f039c018070 con 0x7f03a80f9690 2023-10-18T22:15:28.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f0396ffd700 1 -- 172.21.15.8:0/247977678 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f039c009630 con 0x7f03a80f9690 2023-10-18T22:15:28.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f03a759e700 1 -- 172.21.15.8:0/247977678 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a8108370 con 0x7f03a80f9690 2023-10-18T22:15:28.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.772+0000 7f0396ffd700 1 -- 172.21.15.8:0/247977678 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f039c01c3c0 con 0x7f03a80f9690 2023-10-18T22:15:28.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.773+0000 7f03a759e700 1 -- 172.21.15.8:0/247977678 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a8108850 con 0x7f03a80f9690 2023-10-18T22:15:28.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.774+0000 7f03a759e700 1 -- 172.21.15.8:0/247977678 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a8059100 con 0x7f03a80f9690 2023-10-18T22:15:28.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.775+0000 7f0396ffd700 1 -- 172.21.15.8:0/247977678 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f039c01d420 con 0x7f03a80f9690 2023-10-18T22:15:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.775+0000 7f0396ffd700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0390060f70 0x7f0390063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.776+0000 7f0396ffd700 1 -- 172.21.15.8:0/247977678 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f039c07e6b0 con 0x7f03a80f9690 2023-10-18T22:15:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.776+0000 7f03a659c700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0390060f70 0x7f0390063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.776+0000 7f03a659c700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0390060f70 0x7f0390063430 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f03a8107b80 tx=0x7f0398009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.780+0000 7f0396ffd700 1 -- 172.21.15.8:0/247977678 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f039c04e310 con 0x7f03a80f9690 2023-10-18T22:15:28.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.980+0000 7f03a759e700 1 -- 172.21.15.8:0/247977678 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03a80fedb0 con 0x7f0390060f70 2023-10-18T22:15:28.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.981+0000 7f0396ffd700 1 -- 172.21.15.8:0/247977678 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f03a80fedb0 con 0x7f0390060f70 2023-10-18T22:15:28.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 -- 172.21.15.8:0/247977678 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0390060f70 msgr2=0x7f0390063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:28.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0390060f70 0x7f0390063430 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f03a8107b80 tx=0x7f0398009be0).stop 2023-10-18T22:15:28.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 -- 172.21.15.8:0/247977678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a80f9690 msgr2=0x7f03a81072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:28.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a80f9690 0x7f03a81072b0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f039c004e30 tx=0x7f039c009b30).stop 2023-10-18T22:15:28.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 -- 172.21.15.8:0/247977678 shutdown_connections 2023-10-18T22:15:28.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0390060f70 0x7f0390063430 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03a8060310 0x7f03a8106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 --2- 172.21.15.8:0/247977678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a80f9690 0x7f03a81072b0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:28.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 -- 172.21.15.8:0/247977678 >> 172.21.15.8:0/247977678 conn(0x7f03a80f0b90 msgr2=0x7f03a80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:28.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 -- 172.21.15.8:0/247977678 shutdown_connections 2023-10-18T22:15:28.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:28.983+0000 7f03a759e700 1 -- 172.21.15.8:0/247977678 wait complete. 2023-10-18T22:15:29.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.119+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/427659565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 msgr2=0x7f7b840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:29.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.119+0000 7f7b8a4ae700 1 --2- 172.21.15.8:0/427659565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b840f7c30 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f7b74004660 tx=0x7f7b74009b30).stop 2023-10-18T22:15:29.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.119+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/427659565 shutdown_connections 2023-10-18T22:15:29.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.119+0000 7f7b8a4ae700 1 --2- 172.21.15.8:0/427659565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b840f7c30 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.119+0000 7f7b8a4ae700 1 --2- 172.21.15.8:0/427659565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.119+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/427659565 >> 172.21.15.8:0/427659565 conn(0x7f7b840f1c90 msgr2=0x7f7b840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:29.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.119+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/427659565 shutdown_connections 2023-10-18T22:15:29.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.119+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/427659565 wait complete. 2023-10-18T22:15:29.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.120+0000 7f7b8a4ae700 1 Processor -- start 2023-10-18T22:15:29.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.120+0000 7f7b8a4ae700 1 -- start start 2023-10-18T22:15:29.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.120+0000 7f7b8a4ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b84106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:29.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.120+0000 7f7b8a4ae700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:29.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.120+0000 7f7b8a4ae700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b84107850 con 0x7f7b840f77d0 2023-10-18T22:15:29.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.120+0000 7f7b8a4ae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b84108060 con 0x7f7b840f6530 2023-10-18T22:15:29.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.121+0000 7f7b88cab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:29.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.121+0000 7f7b894ac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b84106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:29.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.121+0000 7f7b894ac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b84106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:57340/0 (socket says 172.21.15.8:57340) 2023-10-18T22:15:29.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.121+0000 7f7b894ac700 1 -- 172.21.15.8:0/1387290399 learned_addr learned my addr 172.21.15.8:0/1387290399 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:15:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.121+0000 7f7b88cab700 1 -- 172.21.15.8:0/1387290399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 msgr2=0x7f7b84106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.121+0000 7f7b88cab700 1 --2- 172.21.15.8:0/1387290399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b84106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.121+0000 7f7b88cab700 1 -- 172.21.15.8:0/1387290399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74005040 con 0x7f7b840f77d0 2023-10-18T22:15:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.121+0000 7f7b88cab700 1 --2- 172.21.15.8:0/1387290399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84107250 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f7b74011000 tx=0x7f7b7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:29.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.121+0000 7f7b79ffb700 1 -- 172.21.15.8:0/1387290399 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b74019070 con 0x7f7b840f77d0 2023-10-18T22:15:29.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.122+0000 7f7b79ffb700 1 -- 172.21.15.8:0/1387290399 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7b74013e70 con 0x7f7b840f77d0 2023-10-18T22:15:29.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.122+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/1387290399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b84108280 con 0x7f7b840f77d0 2023-10-18T22:15:29.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.122+0000 7f7b79ffb700 1 -- 172.21.15.8:0/1387290399 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b74014d30 con 0x7f7b840f77d0 2023-10-18T22:15:29.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.122+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/1387290399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b84108760 con 0x7f7b840f77d0 2023-10-18T22:15:29.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.123+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/1387290399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b84059100 con 0x7f7b840f77d0 2023-10-18T22:15:29.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.124+0000 7f7b79ffb700 1 -- 172.21.15.8:0/1387290399 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7b74014420 con 0x7f7b840f77d0 2023-10-18T22:15:29.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.125+0000 7f7b79ffb700 1 --2- 172.21.15.8:0/1387290399 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 0x7f7b70063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:29.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.125+0000 7f7b79ffb700 1 -- 172.21.15.8:0/1387290399 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7b7407dee0 con 0x7f7b840f77d0 2023-10-18T22:15:29.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.125+0000 7f7b894ac700 1 --2- 172.21.15.8:0/1387290399 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 0x7f7b70063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:29.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.126+0000 7f7b894ac700 1 --2- 172.21.15.8:0/1387290399 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 0x7f7b70063430 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f7b84106ad0 tx=0x7f7b8000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.129+0000 7f7b79ffb700 1 -- 172.21.15.8:0/1387290399 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7b7404da90 con 0x7f7b840f77d0 2023-10-18T22:15:29.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.321+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/1387290399 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b840fee50 con 0x7f7b70060f70 2023-10-18T22:15:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.331+0000 7f7b79ffb700 1 -- 172.21.15.8:0/1387290399 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7b840fee50 con 0x7f7b70060f70 2023-10-18T22:15:29.334 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:15:29.334 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (82m) 9m ago 83m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:15:29.334 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (76m) 9m ago 83m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:15:29.334 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (75m) 7m ago 82m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:15:29.334 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (82m) 9m ago 83m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:15:29.335 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 79m - - 2023-10-18T22:15:29.335 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 79m - - 2023-10-18T22:15:29.335 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 79m - - 2023-10-18T22:15:29.335 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 79m - - 2023-10-18T22:15:29.335 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (77m) 9m ago 84m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:15:29.336 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (76m) 7m ago 82m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:15:29.336 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (76m) 9m ago 85m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:15:29.336 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (76m) 7m ago 82m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:15:29.336 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (83m) 9m ago 83m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:15:29.336 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (82m) 7m ago 82m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:15:29.337 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (75m) 9m ago 82m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:15:29.337 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (73m) 9m ago 81m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:15:29.337 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (73m) 9m ago 81m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:15:29.337 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (72m) 7m ago 81m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:15:29.337 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (72m) 7m ago 81m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:15:29.338 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (71m) 7m ago 80m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:15:29.338 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (77m) 9m ago 82m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:15:29.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/1387290399 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 msgr2=0x7f7b70063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:29.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 --2- 172.21.15.8:0/1387290399 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 0x7f7b70063430 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f7b84106ad0 tx=0x7f7b8000b040).stop 2023-10-18T22:15:29.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/1387290399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 msgr2=0x7f7b84107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:29.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 --2- 172.21.15.8:0/1387290399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84107250 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f7b74011000 tx=0x7f7b7400b040).stop 2023-10-18T22:15:29.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/1387290399 shutdown_connections 2023-10-18T22:15:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 --2- 172.21.15.8:0/1387290399 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7b70060f70 0x7f7b70063430 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 --2- 172.21.15.8:0/1387290399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b840f6530 0x7f7b84106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 --2- 172.21.15.8:0/1387290399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b840f77d0 0x7f7b84107250 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/1387290399 >> 172.21.15.8:0/1387290399 conn(0x7f7b840f1c90 msgr2=0x7f7b840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/1387290399 shutdown_connections 2023-10-18T22:15:29.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.333+0000 7f7b8a4ae700 1 -- 172.21.15.8:0/1387290399 wait complete. 2023-10-18T22:15:29.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.468+0000 7f0e09932700 1 -- 172.21.15.8:0/3974489272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040f77d0 msgr2=0x7f0e040f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:29.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.468+0000 7f0e09932700 1 --2- 172.21.15.8:0/3974489272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040f77d0 0x7f0e040f7c30 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f0df0004660 tx=0x7f0df0009b30).stop 2023-10-18T22:15:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.468+0000 7f0e09932700 1 -- 172.21.15.8:0/3974489272 shutdown_connections 2023-10-18T22:15:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.468+0000 7f0e09932700 1 --2- 172.21.15.8:0/3974489272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040f77d0 0x7f0e040f7c30 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.468+0000 7f0e09932700 1 --2- 172.21.15.8:0/3974489272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040f6530 0x7f0e040f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.468+0000 7f0e09932700 1 -- 172.21.15.8:0/3974489272 >> 172.21.15.8:0/3974489272 conn(0x7f0e040f1c90 msgr2=0x7f0e040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:29.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.468+0000 7f0e09932700 1 -- 172.21.15.8:0/3974489272 shutdown_connections 2023-10-18T22:15:29.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.468+0000 7f0e09932700 1 -- 172.21.15.8:0/3974489272 wait complete. 2023-10-18T22:15:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.469+0000 7f0e09932700 1 Processor -- start 2023-10-18T22:15:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.469+0000 7f0e09932700 1 -- start start 2023-10-18T22:15:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.469+0000 7f0e09932700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040f6530 0x7f0e04108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.469+0000 7f0e09932700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040f77d0 0x7f0e041093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.469+0000 7f0e09932700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04109980 con 0x7f0e040f6530 2023-10-18T22:15:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.469+0000 7f0e09932700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04109ac0 con 0x7f0e040f77d0 2023-10-18T22:15:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.469+0000 7f0e08930700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040f6530 0x7f0e04108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:29.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e08930700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040f6530 0x7f0e04108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60688/0 (socket says 172.21.15.8:60688) 2023-10-18T22:15:29.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e08930700 1 -- 172.21.15.8:0/3666407431 learned_addr learned my addr 172.21.15.8:0/3666407431 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:15:29.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e03fff700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040f77d0 0x7f0e041093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:29.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e08930700 1 -- 172.21.15.8:0/3666407431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040f77d0 msgr2=0x7f0e041093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:29.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e08930700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040f77d0 0x7f0e041093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e08930700 1 -- 172.21.15.8:0/3666407431 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0005040 con 0x7f0e040f6530 2023-10-18T22:15:29.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e03fff700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040f77d0 0x7f0e041093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:15:29.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e08930700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040f6530 0x7f0e04108ee0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f0df8002700 tx=0x7f0df8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:29.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e017fa700 1 -- 172.21.15.8:0/3666407431 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0df8009320 con 0x7f0e040f6530 2023-10-18T22:15:29.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e017fa700 1 -- 172.21.15.8:0/3666407431 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0df800f040 con 0x7f0e040f6530 2023-10-18T22:15:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e09932700 1 -- 172.21.15.8:0/3666407431 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0410a460 con 0x7f0e040f6530 2023-10-18T22:15:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.470+0000 7f0e017fa700 1 -- 172.21.15.8:0/3666407431 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0df8014970 con 0x7f0e040f6530 2023-10-18T22:15:29.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.471+0000 7f0e09932700 1 -- 172.21.15.8:0/3666407431 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0410aa20 con 0x7f0e040f6530 2023-10-18T22:15:29.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.472+0000 7f0e09932700 1 -- 172.21.15.8:0/3666407431 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e04045ad0 con 0x7f0e040f6530 2023-10-18T22:15:29.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.472+0000 7f0e017fa700 1 -- 172.21.15.8:0/3666407431 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0df8009480 con 0x7f0e040f6530 2023-10-18T22:15:29.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.473+0000 7f0e017fa700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 0x7f0df4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:29.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.473+0000 7f0e017fa700 1 -- 172.21.15.8:0/3666407431 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0df807cc40 con 0x7f0e040f6530 2023-10-18T22:15:29.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.474+0000 7f0e03fff700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 0x7f0df4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:29.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.474+0000 7f0e03fff700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 0x7f0df4063430 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f0df0005010 tx=0x7f0df0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:29.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.477+0000 7f0e017fa700 1 -- 172.21.15.8:0/3666407431 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0df8050220 con 0x7f0e040f6530 2023-10-18T22:15:29.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:28.090831+0000 mgr.smithi008.flmjzp (mgr.14640) 4592 : cluster [DBG] pgmap v3152: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:28.090831+0000 mgr.smithi008.flmjzp (mgr.14640) 4592 : cluster [DBG] pgmap v3152: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:29.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.731+0000 7f0e09932700 1 -- 172.21.15.8:0/3666407431 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0e040fee40 con 0x7f0e040f6530 2023-10-18T22:15:29.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.732+0000 7f0e017fa700 1 -- 172.21.15.8:0/3666407431 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f0df804fe10 con 0x7f0e040f6530 2023-10-18T22:15:29.735 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:15:29.735 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:15:29.735 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:15:29.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:15:29.735 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:15:29.736 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:15:29.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:15:29.736 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:15:29.736 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:15:29.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:15:29.737 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:15:29.737 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:15:29.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:15:29.737 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:15:29.737 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:15:29.737 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:15:29.738 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:15:29.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 -- 172.21.15.8:0/3666407431 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 msgr2=0x7f0df4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:29.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 0x7f0df4063430 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f0df0005010 tx=0x7f0df0009b30).stop 2023-10-18T22:15:29.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 -- 172.21.15.8:0/3666407431 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040f6530 msgr2=0x7f0e04108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:29.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040f6530 0x7f0e04108ee0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f0df8002700 tx=0x7f0df8009d80).stop 2023-10-18T22:15:29.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 -- 172.21.15.8:0/3666407431 shutdown_connections 2023-10-18T22:15:29.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0df4060f70 0x7f0df4063430 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040f6530 0x7f0e04108ee0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 --2- 172.21.15.8:0/3666407431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040f77d0 0x7f0e041093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 -- 172.21.15.8:0/3666407431 >> 172.21.15.8:0/3666407431 conn(0x7f0e040f1c90 msgr2=0x7f0e040f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:29.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 -- 172.21.15.8:0/3666407431 shutdown_connections 2023-10-18T22:15:29.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.734+0000 7f0e09932700 1 -- 172.21.15.8:0/3666407431 wait complete. 2023-10-18T22:15:29.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.869+0000 7fe506d73700 1 -- 172.21.15.8:0/4056276952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5000f96d0 msgr2=0x7fe5000fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:29.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.869+0000 7fe506d73700 1 --2- 172.21.15.8:0/4056276952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5000f96d0 0x7fe5000fbae0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7fe4f0004660 tx=0x7fe4f0009b30).stop 2023-10-18T22:15:29.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.870+0000 7fe506d73700 1 -- 172.21.15.8:0/4056276952 shutdown_connections 2023-10-18T22:15:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.870+0000 7fe506d73700 1 --2- 172.21.15.8:0/4056276952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5000f96d0 0x7fe5000fbae0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.870+0000 7fe506d73700 1 --2- 172.21.15.8:0/4056276952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5000602d0 0x7fe5000f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.870+0000 7fe506d73700 1 -- 172.21.15.8:0/4056276952 >> 172.21.15.8:0/4056276952 conn(0x7fe5000f0b90 msgr2=0x7fe5000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.870+0000 7fe506d73700 1 -- 172.21.15.8:0/4056276952 shutdown_connections 2023-10-18T22:15:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.870+0000 7fe506d73700 1 -- 172.21.15.8:0/4056276952 wait complete. 2023-10-18T22:15:29.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.870+0000 7fe506d73700 1 Processor -- start 2023-10-18T22:15:29.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.871+0000 7fe506d73700 1 -- start start 2023-10-18T22:15:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.871+0000 7fe506d73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5000602d0 0x7fe500108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.871+0000 7fe506d73700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5000f96d0 0x7fe500109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.871+0000 7fe506d73700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe500109a20 con 0x7fe5000602d0 2023-10-18T22:15:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.871+0000 7fe506d73700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe500109b60 con 0x7fe5000f96d0 2023-10-18T22:15:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.871+0000 7fe505d71700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5000602d0 0x7fe500108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.871+0000 7fe505d71700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5000602d0 0x7fe500108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60700/0 (socket says 172.21.15.8:60700) 2023-10-18T22:15:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.871+0000 7fe505d71700 1 -- 172.21.15.8:0/1360551656 learned_addr learned my addr 172.21.15.8:0/1360551656 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:15:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.871+0000 7fe505570700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5000f96d0 0x7fe500109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.872+0000 7fe505d71700 1 -- 172.21.15.8:0/1360551656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5000f96d0 msgr2=0x7fe500109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.872+0000 7fe505d71700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5000f96d0 0x7fe500109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.872+0000 7fe505d71700 1 -- 172.21.15.8:0/1360551656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f0005040 con 0x7fe5000602d0 2023-10-18T22:15:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.872+0000 7fe505d71700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5000602d0 0x7fe500108f80 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7fe4fc0026d0 tx=0x7fe4fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:29.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.872+0000 7fe4f67fc700 1 -- 172.21.15.8:0/1360551656 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4fc0079c0 con 0x7fe5000602d0 2023-10-18T22:15:29.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.872+0000 7fe4f67fc700 1 -- 172.21.15.8:0/1360551656 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe4fc00f040 con 0x7fe5000602d0 2023-10-18T22:15:29.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.872+0000 7fe506d73700 1 -- 172.21.15.8:0/1360551656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50010a500 con 0x7fe5000602d0 2023-10-18T22:15:29.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.872+0000 7fe4f67fc700 1 -- 172.21.15.8:0/1360551656 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4fc014980 con 0x7fe5000602d0 2023-10-18T22:15:29.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.872+0000 7fe506d73700 1 -- 172.21.15.8:0/1360551656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50010aac0 con 0x7fe5000602d0 2023-10-18T22:15:29.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.873+0000 7fe506d73700 1 -- 172.21.15.8:0/1360551656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe500045ad0 con 0x7fe5000602d0 2023-10-18T22:15:29.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.874+0000 7fe4f67fc700 1 -- 172.21.15.8:0/1360551656 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe4fc0090d0 con 0x7fe5000602d0 2023-10-18T22:15:29.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.875+0000 7fe4f67fc700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4ec060f70 0x7fe4ec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:29.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.875+0000 7fe4f67fc700 1 -- 172.21.15.8:0/1360551656 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe4fc07c8a0 con 0x7fe5000602d0 2023-10-18T22:15:29.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.875+0000 7fe505570700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4ec060f70 0x7fe4ec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:29.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.876+0000 7fe505570700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4ec060f70 0x7fe4ec063430 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fe4f0004630 tx=0x7fe4f0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:29.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:29.879+0000 7fe4f67fc700 1 -- 172.21.15.8:0/1360551656 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe4fc04ffb0 con 0x7fe5000602d0 2023-10-18T22:15:30.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.104+0000 7fe506d73700 1 -- 172.21.15.8:0/1360551656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe50010f660 con 0x7fe5000602d0 2023-10-18T22:15:30.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.104+0000 7fe4f67fc700 1 -- 172.21.15.8:0/1360551656 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fe4fc04fba0 con 0x7fe5000602d0 2023-10-18T22:15:30.107 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:15:30.107 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:15:30.108 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:15:30.108 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:15:30.108 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:15:30.108 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:15:30.108 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:15:30.109 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:15:30.109 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:15:30.109 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:15:30.109 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:15:30.109 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:15:30.110 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:15:30.110 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:15:30.110 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:15:30.110 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:15:30.110 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:15:30.111 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:15:30.111 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:15:30.111 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:15:30.111 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:15:30.112 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:15:30.113 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:15:30.113 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:15:30.113 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:15:30.113 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:15:30.114 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:15:30.114 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:15:30.114 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:15:30.114 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:15:30.114 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:15:30.115 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:15:30.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:15:30.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:15:30.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.106+0000 7fe506d73700 1 -- 172.21.15.8:0/1360551656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4ec060f70 msgr2=0x7fe4ec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:30.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.106+0000 7fe506d73700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4ec060f70 0x7fe4ec063430 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fe4f0004630 tx=0x7fe4f0009b30).stop 2023-10-18T22:15:30.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.106+0000 7fe506d73700 1 -- 172.21.15.8:0/1360551656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5000602d0 msgr2=0x7fe500108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.106+0000 7fe506d73700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5000602d0 0x7fe500108f80 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7fe4fc0026d0 tx=0x7fe4fc009de0).stop 2023-10-18T22:15:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.106+0000 7fe506d73700 1 -- 172.21.15.8:0/1360551656 shutdown_connections 2023-10-18T22:15:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.106+0000 7fe506d73700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe4ec060f70 0x7fe4ec063430 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.106+0000 7fe506d73700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5000602d0 0x7fe500108f80 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:30.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.106+0000 7fe506d73700 1 --2- 172.21.15.8:0/1360551656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5000f96d0 0x7fe500109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:30.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.106+0000 7fe506d73700 1 -- 172.21.15.8:0/1360551656 >> 172.21.15.8:0/1360551656 conn(0x7fe5000f0b90 msgr2=0x7fe5000f4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:30.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.107+0000 7fe506d73700 1 -- 172.21.15.8:0/1360551656 shutdown_connections 2023-10-18T22:15:30.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.107+0000 7fe506d73700 1 -- 172.21.15.8:0/1360551656 wait complete. 2023-10-18T22:15:30.118 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:15:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.250+0000 7f484724e700 1 -- 172.21.15.8:0/2412602525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48400f64b0 msgr2=0x7f48400f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.250+0000 7f484724e700 1 --2- 172.21.15.8:0/2412602525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48400f64b0 0x7f48400f68d0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f483c0047e0 tx=0x7f483c009ad0).stop 2023-10-18T22:15:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.250+0000 7f484724e700 1 -- 172.21.15.8:0/2412602525 shutdown_connections 2023-10-18T22:15:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.250+0000 7f484724e700 1 --2- 172.21.15.8:0/2412602525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48400f7750 0x7f48400f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.250+0000 7f484724e700 1 --2- 172.21.15.8:0/2412602525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48400f64b0 0x7f48400f68d0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:30.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.250+0000 7f484724e700 1 -- 172.21.15.8:0/2412602525 >> 172.21.15.8:0/2412602525 conn(0x7f48400f1c30 msgr2=0x7f48400f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:30.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.250+0000 7f484724e700 1 -- 172.21.15.8:0/2412602525 shutdown_connections 2023-10-18T22:15:30.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.250+0000 7f484724e700 1 -- 172.21.15.8:0/2412602525 wait complete. 2023-10-18T22:15:30.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.251+0000 7f484724e700 1 Processor -- start 2023-10-18T22:15:30.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.251+0000 7f484724e700 1 -- start start 2023-10-18T22:15:30.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f484724e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48400f64b0 0x7f4840108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:30.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f484724e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48400f7750 0x7f4840109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:30.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f484724e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48401099c0 con 0x7f48400f7750 2023-10-18T22:15:30.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f484724e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4840109b00 con 0x7f48400f64b0 2023-10-18T22:15:30.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f4845a4b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48400f7750 0x7f4840109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:30.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f4845a4b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48400f7750 0x7f4840109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60710/0 (socket says 172.21.15.8:60710) 2023-10-18T22:15:30.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f4845a4b700 1 -- 172.21.15.8:0/1449814505 learned_addr learned my addr 172.21.15.8:0/1449814505 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:15:30.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f484624c700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48400f64b0 0x7f4840108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:30.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f4845a4b700 1 -- 172.21.15.8:0/1449814505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48400f64b0 msgr2=0x7f4840108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:30.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f4845a4b700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48400f64b0 0x7f4840108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:30.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.252+0000 7f4845a4b700 1 -- 172.21.15.8:0/1449814505 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c009d70 con 0x7f48400f7750 2023-10-18T22:15:30.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.253+0000 7f4845a4b700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48400f7750 0x7f4840109410 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f483000e7f0 tx=0x7f483000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:30.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.253+0000 7f4836ffd700 1 -- 172.21.15.8:0/1449814505 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48300092e0 con 0x7f48400f7750 2023-10-18T22:15:30.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.253+0000 7f4836ffd700 1 -- 172.21.15.8:0/1449814505 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f483000f040 con 0x7f48400f7750 2023-10-18T22:15:30.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.253+0000 7f4836ffd700 1 -- 172.21.15.8:0/1449814505 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48300147e0 con 0x7f48400f7750 2023-10-18T22:15:30.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.253+0000 7f484724e700 1 -- 172.21.15.8:0/1449814505 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484010a4a0 con 0x7f48400f7750 2023-10-18T22:15:30.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.253+0000 7f484724e700 1 -- 172.21.15.8:0/1449814505 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484010aa60 con 0x7f48400f7750 2023-10-18T22:15:30.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.254+0000 7f484724e700 1 -- 172.21.15.8:0/1449814505 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4840045ad0 con 0x7f48400f7750 2023-10-18T22:15:30.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.255+0000 7f4836ffd700 1 -- 172.21.15.8:0/1449814505 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f483001b030 con 0x7f48400f7750 2023-10-18T22:15:30.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.256+0000 7f4836ffd700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f482c060f70 0x7f482c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:15:30.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.256+0000 7f4836ffd700 1 -- 172.21.15.8:0/1449814505 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f483007c740 con 0x7f48400f7750 2023-10-18T22:15:30.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.256+0000 7f484624c700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f482c060f70 0x7f482c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:15:30.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.257+0000 7f484624c700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f482c060f70 0x7f482c063430 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f483c005010 tx=0x7f483c009ad0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:15:30.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.261+0000 7f4836ffd700 1 -- 172.21.15.8:0/1449814505 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f483004fd70 con 0x7f48400f7750 2023-10-18T22:15:30.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.456+0000 7f484724e700 1 -- 172.21.15.8:0/1449814505 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f484010acd0 con 0x7f482c060f70 2023-10-18T22:15:30.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.457+0000 7f4836ffd700 1 -- 172.21.15.8:0/1449814505 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f484010acd0 con 0x7f482c060f70 2023-10-18T22:15:30.459 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:15:30.460 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:15:30.460 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:15:30.460 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:15:30.460 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:15:30.460 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:15:30.461 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:15:30.461 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:15:30.461 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:15:30.461 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:15:30.461 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:15:30.462 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:15:30.462 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:15:30.462 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:15:30.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 -- 172.21.15.8:0/1449814505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f482c060f70 msgr2=0x7f482c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:30.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f482c060f70 0x7f482c063430 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f483c005010 tx=0x7f483c009ad0).stop 2023-10-18T22:15:30.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 -- 172.21.15.8:0/1449814505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48400f7750 msgr2=0x7f4840109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:15:30.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48400f7750 0x7f4840109410 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f483000e7f0 tx=0x7f483000b040).stop 2023-10-18T22:15:30.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 -- 172.21.15.8:0/1449814505 shutdown_connections 2023-10-18T22:15:30.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f482c060f70 0x7f482c063430 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:30.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48400f64b0 0x7f4840108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:30.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 --2- 172.21.15.8:0/1449814505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48400f7750 0x7f4840109410 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:15:30.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 -- 172.21.15.8:0/1449814505 >> 172.21.15.8:0/1449814505 conn(0x7f48400f1c30 msgr2=0x7f48400f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:15:30.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 -- 172.21.15.8:0/1449814505 shutdown_connections 2023-10-18T22:15:30.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:15:30.459+0000 7f484724e700 1 -- 172.21.15.8:0/1449814505 wait complete. 2023-10-18T22:15:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:28.628443+0000 mgr.smithi008.flmjzp (mgr.14640) 4593 : audit [DBG] from='client.37696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:15:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:28.982431+0000 mgr.smithi008.flmjzp (mgr.14640) 4594 : audit [DBG] from='client.37700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:15:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:29.324154+0000 mgr.smithi008.flmjzp (mgr.14640) 4595 : audit [DBG] from='client.37704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:15:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:29.733538+0000 mon.smithi008 (mon.0) 4881 : audit [DBG] from='client.? 172.21.15.8:0/3666407431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.106092+0000 mon.smithi008 (mon.0) 4882 : audit [DBG] from='client.? 172.21.15.8:0/1360551656' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:15:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.122018+0000 mon.smithi008 (mon.0) 4883 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:30.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.124072+0000 mon.smithi008 (mon.0) 4884 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:30.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.124935+0000 mon.smithi008 (mon.0) 4885 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:30.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.130586+0000 mon.smithi008 (mon.0) 4886 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:30.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.138973+0000 mon.smithi008 (mon.0) 4887 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:30.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.141553+0000 mon.smithi008 (mon.0) 4888 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:30.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.142794+0000 mon.smithi008 (mon.0) 4889 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:30.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.143977+0000 mon.smithi008 (mon.0) 4890 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:30.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.145486+0000 mon.smithi008 (mon.0) 4891 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:28.628443+0000 mgr.smithi008.flmjzp (mgr.14640) 4593 : audit [DBG] from='client.37696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:15:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:28.982431+0000 mgr.smithi008.flmjzp (mgr.14640) 4594 : audit [DBG] from='client.37700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:15:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:29.324154+0000 mgr.smithi008.flmjzp (mgr.14640) 4595 : audit [DBG] from='client.37704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:15:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:29.733538+0000 mon.smithi008 (mon.0) 4881 : audit [DBG] from='client.? 172.21.15.8:0/3666407431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.106092+0000 mon.smithi008 (mon.0) 4882 : audit [DBG] from='client.? 172.21.15.8:0/1360551656' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:15:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.122018+0000 mon.smithi008 (mon.0) 4883 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:30.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.124072+0000 mon.smithi008 (mon.0) 4884 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:30.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.124935+0000 mon.smithi008 (mon.0) 4885 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:30.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.130586+0000 mon.smithi008 (mon.0) 4886 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:30.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.138973+0000 mon.smithi008 (mon.0) 4887 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:30.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.141553+0000 mon.smithi008 (mon.0) 4888 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:30.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.142794+0000 mon.smithi008 (mon.0) 4889 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:30.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.143977+0000 mon.smithi008 (mon.0) 4890 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:30.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.145486+0000 mon.smithi008 (mon.0) 4891 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:30.091314+0000 mgr.smithi008.flmjzp (mgr.14640) 4596 : cluster [DBG] pgmap v3153: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:15:30.125729+0000 mgr.smithi008.flmjzp (mgr.14640) 4597 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:30.126218+0000 mgr.smithi008.flmjzp (mgr.14640) 4598 : cluster [DBG] pgmap v3154: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:30.126438+0000 mgr.smithi008.flmjzp (mgr.14640) 4599 : cluster [DBG] pgmap v3155: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:15:30.147078+0000 mgr.smithi008.flmjzp (mgr.14640) 4600 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:30.091314+0000 mgr.smithi008.flmjzp (mgr.14640) 4596 : cluster [DBG] pgmap v3153: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:15:30.125729+0000 mgr.smithi008.flmjzp (mgr.14640) 4597 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:30.126218+0000 mgr.smithi008.flmjzp (mgr.14640) 4598 : cluster [DBG] pgmap v3154: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:30.126438+0000 mgr.smithi008.flmjzp (mgr.14640) 4599 : cluster [DBG] pgmap v3155: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:15:30.147078+0000 mgr.smithi008.flmjzp (mgr.14640) 4600 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:30.458555+0000 mgr.smithi008.flmjzp (mgr.14640) 4601 : audit [DBG] from='client.37716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:15:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:30.458555+0000 mgr.smithi008.flmjzp (mgr.14640) 4601 : audit [DBG] from='client.37716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:15:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:32.127106+0000 mgr.smithi008.flmjzp (mgr.14640) 4602 : cluster [DBG] pgmap v3156: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:32.127106+0000 mgr.smithi008.flmjzp (mgr.14640) 4602 : cluster [DBG] pgmap v3156: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:34.127893+0000 mgr.smithi008.flmjzp (mgr.14640) 4603 : cluster [DBG] pgmap v3157: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:34.127893+0000 mgr.smithi008.flmjzp (mgr.14640) 4603 : cluster [DBG] pgmap v3157: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:36.128599+0000 mgr.smithi008.flmjzp (mgr.14640) 4604 : cluster [DBG] pgmap v3158: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:36.128599+0000 mgr.smithi008.flmjzp (mgr.14640) 4604 : cluster [DBG] pgmap v3158: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:38.129277+0000 mgr.smithi008.flmjzp (mgr.14640) 4605 : cluster [DBG] pgmap v3159: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:38.129277+0000 mgr.smithi008.flmjzp (mgr.14640) 4605 : cluster [DBG] pgmap v3159: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:40.151176+0000 mon.smithi008 (mon.0) 4892 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:40.153437+0000 mon.smithi008 (mon.0) 4893 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:40.154567+0000 mon.smithi008 (mon.0) 4894 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:40.160937+0000 mon.smithi008 (mon.0) 4895 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:40.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:40.167324+0000 mon.smithi008 (mon.0) 4896 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:40.170344+0000 mon.smithi008 (mon.0) 4897 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:40.172036+0000 mon.smithi008 (mon.0) 4898 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:40.173629+0000 mon.smithi008 (mon.0) 4899 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:40.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:40.175547+0000 mon.smithi008 (mon.0) 4900 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:40.151176+0000 mon.smithi008 (mon.0) 4892 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:40.153437+0000 mon.smithi008 (mon.0) 4893 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:40.154567+0000 mon.smithi008 (mon.0) 4894 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:40.160937+0000 mon.smithi008 (mon.0) 4895 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:40.167324+0000 mon.smithi008 (mon.0) 4896 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:40.170344+0000 mon.smithi008 (mon.0) 4897 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:40.172036+0000 mon.smithi008 (mon.0) 4898 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:40.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:40.173629+0000 mon.smithi008 (mon.0) 4899 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:40.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:40.175547+0000 mon.smithi008 (mon.0) 4900 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:40.129949+0000 mgr.smithi008.flmjzp (mgr.14640) 4606 : cluster [DBG] pgmap v3160: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:15:40.155508+0000 mgr.smithi008.flmjzp (mgr.14640) 4607 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:40.156060+0000 mgr.smithi008.flmjzp (mgr.14640) 4608 : cluster [DBG] pgmap v3161: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:40.156310+0000 mgr.smithi008.flmjzp (mgr.14640) 4609 : cluster [DBG] pgmap v3162: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:15:40.177408+0000 mgr.smithi008.flmjzp (mgr.14640) 4610 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:40.129949+0000 mgr.smithi008.flmjzp (mgr.14640) 4606 : cluster [DBG] pgmap v3160: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:15:40.155508+0000 mgr.smithi008.flmjzp (mgr.14640) 4607 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:40.156060+0000 mgr.smithi008.flmjzp (mgr.14640) 4608 : cluster [DBG] pgmap v3161: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:40.156310+0000 mgr.smithi008.flmjzp (mgr.14640) 4609 : cluster [DBG] pgmap v3162: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:15:40.177408+0000 mgr.smithi008.flmjzp (mgr.14640) 4610 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:42.156830+0000 mgr.smithi008.flmjzp (mgr.14640) 4611 : cluster [DBG] pgmap v3163: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:42.156830+0000 mgr.smithi008.flmjzp (mgr.14640) 4611 : cluster [DBG] pgmap v3163: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:44.157431+0000 mgr.smithi008.flmjzp (mgr.14640) 4612 : cluster [DBG] pgmap v3164: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:44.157431+0000 mgr.smithi008.flmjzp (mgr.14640) 4612 : cluster [DBG] pgmap v3164: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:46.158108+0000 mgr.smithi008.flmjzp (mgr.14640) 4613 : cluster [DBG] pgmap v3165: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:46.158108+0000 mgr.smithi008.flmjzp (mgr.14640) 4613 : cluster [DBG] pgmap v3165: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:48.158724+0000 mgr.smithi008.flmjzp (mgr.14640) 4614 : cluster [DBG] pgmap v3166: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:48.158724+0000 mgr.smithi008.flmjzp (mgr.14640) 4614 : cluster [DBG] pgmap v3166: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:50.184561+0000 mon.smithi008 (mon.0) 4901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:50.186719+0000 mon.smithi008 (mon.0) 4902 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:50.187698+0000 mon.smithi008 (mon.0) 4903 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:50.194137+0000 mon.smithi008 (mon.0) 4904 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:50.200707+0000 mon.smithi008 (mon.0) 4905 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:50.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:50.203845+0000 mon.smithi008 (mon.0) 4906 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:50.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:50.205615+0000 mon.smithi008 (mon.0) 4907 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:50.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:50.207250+0000 mon.smithi008 (mon.0) 4908 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:50.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:15:50.209190+0000 mon.smithi008 (mon.0) 4909 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:50.184561+0000 mon.smithi008 (mon.0) 4901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:50.186719+0000 mon.smithi008 (mon.0) 4902 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:15:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:50.187698+0000 mon.smithi008 (mon.0) 4903 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:15:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:50.194137+0000 mon.smithi008 (mon.0) 4904 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:15:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:50.200707+0000 mon.smithi008 (mon.0) 4905 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:15:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:50.203845+0000 mon.smithi008 (mon.0) 4906 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:50.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:50.205615+0000 mon.smithi008 (mon.0) 4907 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:50.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:50.207250+0000 mon.smithi008 (mon.0) 4908 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:50.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:15:50.209190+0000 mon.smithi008 (mon.0) 4909 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:15:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:50.159195+0000 mgr.smithi008.flmjzp (mgr.14640) 4615 : cluster [DBG] pgmap v3167: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:15:50.188569+0000 mgr.smithi008.flmjzp (mgr.14640) 4616 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:50.189109+0000 mgr.smithi008.flmjzp (mgr.14640) 4617 : cluster [DBG] pgmap v3168: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:50.189424+0000 mgr.smithi008.flmjzp (mgr.14640) 4618 : cluster [DBG] pgmap v3169: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:51.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:15:50.211068+0000 mgr.smithi008.flmjzp (mgr.14640) 4619 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:50.159195+0000 mgr.smithi008.flmjzp (mgr.14640) 4615 : cluster [DBG] pgmap v3167: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:15:50.188569+0000 mgr.smithi008.flmjzp (mgr.14640) 4616 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:15:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:50.189109+0000 mgr.smithi008.flmjzp (mgr.14640) 4617 : cluster [DBG] pgmap v3168: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:50.189424+0000 mgr.smithi008.flmjzp (mgr.14640) 4618 : cluster [DBG] pgmap v3169: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:51.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:15:50.211068+0000 mgr.smithi008.flmjzp (mgr.14640) 4619 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:15:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:52.189949+0000 mgr.smithi008.flmjzp (mgr.14640) 4620 : cluster [DBG] pgmap v3170: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:52.189949+0000 mgr.smithi008.flmjzp (mgr.14640) 4620 : cluster [DBG] pgmap v3170: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:54.190731+0000 mgr.smithi008.flmjzp (mgr.14640) 4621 : cluster [DBG] pgmap v3171: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:54.190731+0000 mgr.smithi008.flmjzp (mgr.14640) 4621 : cluster [DBG] pgmap v3171: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:56.191382+0000 mgr.smithi008.flmjzp (mgr.14640) 4622 : cluster [DBG] pgmap v3172: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:56.191382+0000 mgr.smithi008.flmjzp (mgr.14640) 4622 : cluster [DBG] pgmap v3172: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:15:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:15:58.191942+0000 mgr.smithi008.flmjzp (mgr.14640) 4623 : cluster [DBG] pgmap v3173: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:15:59.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:15:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:15:58.191942+0000 mgr.smithi008.flmjzp (mgr.14640) 4623 : cluster [DBG] pgmap v3173: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.603+0000 7eff8589f700 1 -- 172.21.15.8:0/3158530369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff800f6530 msgr2=0x7eff800f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.603+0000 7eff8589f700 1 --2- 172.21.15.8:0/3158530369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff800f6530 0x7eff800f6950 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7eff74004660 tx=0x7eff74009b30).stop 2023-10-18T22:16:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.603+0000 7eff8589f700 1 -- 172.21.15.8:0/3158530369 shutdown_connections 2023-10-18T22:16:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.603+0000 7eff8589f700 1 --2- 172.21.15.8:0/3158530369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff800f77d0 0x7eff800f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.603+0000 7eff8589f700 1 --2- 172.21.15.8:0/3158530369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff800f6530 0x7eff800f6950 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.603+0000 7eff8589f700 1 -- 172.21.15.8:0/3158530369 >> 172.21.15.8:0/3158530369 conn(0x7eff800f1c70 msgr2=0x7eff800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:00.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.603+0000 7eff8589f700 1 -- 172.21.15.8:0/3158530369 shutdown_connections 2023-10-18T22:16:00.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.603+0000 7eff8589f700 1 -- 172.21.15.8:0/3158530369 wait complete. 2023-10-18T22:16:00.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.604+0000 7eff8589f700 1 Processor -- start 2023-10-18T22:16:00.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.604+0000 7eff8589f700 1 -- start start 2023-10-18T22:16:00.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff8589f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff800f6530 0x7eff80108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:00.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff8589f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff800f77d0 0x7eff801094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:00.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff8589f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff80109a60 con 0x7eff800f77d0 2023-10-18T22:16:00.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff8589f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff80109ba0 con 0x7eff800f6530 2023-10-18T22:16:00.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff7ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff800f77d0 0x7eff801094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:00.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff7ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff800f77d0 0x7eff801094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59970/0 (socket says 172.21.15.8:59970) 2023-10-18T22:16:00.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff7ffff700 1 -- 172.21.15.8:0/3858947288 learned_addr learned my addr 172.21.15.8:0/3858947288 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:00.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff8489d700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff800f6530 0x7eff80108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:00.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff7ffff700 1 -- 172.21.15.8:0/3858947288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff800f6530 msgr2=0x7eff80108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:00.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff7ffff700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff800f6530 0x7eff80108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:00.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff7ffff700 1 -- 172.21.15.8:0/3858947288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff74005040 con 0x7eff800f77d0 2023-10-18T22:16:00.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.605+0000 7eff8489d700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff800f6530 0x7eff80108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:16:00.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.606+0000 7eff7ffff700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff800f77d0 0x7eff801094b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7eff6c0026d0 tx=0x7eff6c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:00.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.606+0000 7eff7d7fa700 1 -- 172.21.15.8:0/3858947288 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff6c009320 con 0x7eff800f77d0 2023-10-18T22:16:00.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.606+0000 7eff7d7fa700 1 -- 172.21.15.8:0/3858947288 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7eff6c00f040 con 0x7eff800f77d0 2023-10-18T22:16:00.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.606+0000 7eff7d7fa700 1 -- 172.21.15.8:0/3858947288 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff6c0148a0 con 0x7eff800f77d0 2023-10-18T22:16:00.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.606+0000 7eff8589f700 1 -- 172.21.15.8:0/3858947288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8010a540 con 0x7eff800f77d0 2023-10-18T22:16:00.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.606+0000 7eff8589f700 1 -- 172.21.15.8:0/3858947288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8010ab00 con 0x7eff800f77d0 2023-10-18T22:16:00.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.607+0000 7eff8589f700 1 -- 172.21.15.8:0/3858947288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff80045ad0 con 0x7eff800f77d0 2023-10-18T22:16:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.608+0000 7eff7d7fa700 1 -- 172.21.15.8:0/3858947288 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7eff6c009480 con 0x7eff800f77d0 2023-10-18T22:16:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.609+0000 7eff7d7fa700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff70060f70 0x7eff70063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.609+0000 7eff7d7fa700 1 -- 172.21.15.8:0/3858947288 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7eff6c07cf60 con 0x7eff800f77d0 2023-10-18T22:16:00.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.609+0000 7eff8489d700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff70060f70 0x7eff70063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:00.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.610+0000 7eff8489d700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff70060f70 0x7eff70063430 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7eff74009d60 tx=0x7eff74009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:00.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.614+0000 7eff7d7fa700 1 -- 172.21.15.8:0/3858947288 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7eff6c0505c0 con 0x7eff800f77d0 2023-10-18T22:16:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:00.221955+0000 mon.smithi008 (mon.0) 4910 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:00.221955+0000 mon.smithi008 (mon.0) 4910 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:00.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.819+0000 7eff8589f700 1 -- 172.21.15.8:0/3858947288 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff8010add0 con 0x7eff70060f70 2023-10-18T22:16:00.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.821+0000 7eff7d7fa700 1 -- 172.21.15.8:0/3858947288 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7eff8010add0 con 0x7eff70060f70 2023-10-18T22:16:00.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 -- 172.21.15.8:0/3858947288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff70060f70 msgr2=0x7eff70063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:00.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff70060f70 0x7eff70063430 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7eff74009d60 tx=0x7eff74009b30).stop 2023-10-18T22:16:00.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 -- 172.21.15.8:0/3858947288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff800f77d0 msgr2=0x7eff801094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:00.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff800f77d0 0x7eff801094b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7eff6c0026d0 tx=0x7eff6c009de0).stop 2023-10-18T22:16:00.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 -- 172.21.15.8:0/3858947288 shutdown_connections 2023-10-18T22:16:00.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7eff70060f70 0x7eff70063430 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:00.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff800f6530 0x7eff80108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:00.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 --2- 172.21.15.8:0/3858947288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff800f77d0 0x7eff801094b0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:00.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 -- 172.21.15.8:0/3858947288 >> 172.21.15.8:0/3858947288 conn(0x7eff800f1c70 msgr2=0x7eff800f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:00.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 -- 172.21.15.8:0/3858947288 shutdown_connections 2023-10-18T22:16:00.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.823+0000 7eff8589f700 1 -- 172.21.15.8:0/3858947288 wait complete. 2023-10-18T22:16:00.841 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:16:00.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.963+0000 7f45c1c9a700 1 -- 172.21.15.8:0/1762617562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45bc0f64b0 msgr2=0x7f45bc0f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:00.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.963+0000 7f45c1c9a700 1 --2- 172.21.15.8:0/1762617562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45bc0f64b0 0x7f45bc0f68d0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f45b00047e0 tx=0x7f45b0009ad0).stop 2023-10-18T22:16:00.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.964+0000 7f45c1c9a700 1 -- 172.21.15.8:0/1762617562 shutdown_connections 2023-10-18T22:16:00.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.964+0000 7f45c1c9a700 1 --2- 172.21.15.8:0/1762617562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45bc0f7750 0x7f45bc0f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:00.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.964+0000 7f45c1c9a700 1 --2- 172.21.15.8:0/1762617562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45bc0f64b0 0x7f45bc0f68d0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:00.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.964+0000 7f45c1c9a700 1 -- 172.21.15.8:0/1762617562 >> 172.21.15.8:0/1762617562 conn(0x7f45bc0f1c30 msgr2=0x7f45bc0f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:00.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.964+0000 7f45c1c9a700 1 -- 172.21.15.8:0/1762617562 shutdown_connections 2023-10-18T22:16:00.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.964+0000 7f45c1c9a700 1 -- 172.21.15.8:0/1762617562 wait complete. 2023-10-18T22:16:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.965+0000 7f45c1c9a700 1 Processor -- start 2023-10-18T22:16:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.965+0000 7f45c1c9a700 1 -- start start 2023-10-18T22:16:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45c1c9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45bc0f64b0 0x7f45bc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45c1c9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45bc0f7750 0x7f45bc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45c1c9a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc06a380 con 0x7f45bc0f7750 2023-10-18T22:16:00.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45c1c9a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc06a4c0 con 0x7f45bc0f64b0 2023-10-18T22:16:00.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45bc0f7750 0x7f45bc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:00.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45bc0f7750 0x7f45bc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59988/0 (socket says 172.21.15.8:59988) 2023-10-18T22:16:00.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45bbfff700 1 -- 172.21.15.8:0/4132423136 learned_addr learned my addr 172.21.15.8:0/4132423136 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:00.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45c0c98700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45bc0f64b0 0x7f45bc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45bbfff700 1 -- 172.21.15.8:0/4132423136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45bc0f64b0 msgr2=0x7f45bc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45bbfff700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45bc0f64b0 0x7f45bc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.966+0000 7f45bbfff700 1 -- 172.21.15.8:0/4132423136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b0009d70 con 0x7f45bc0f7750 2023-10-18T22:16:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.967+0000 7f45bbfff700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45bc0f7750 0x7f45bc069e20 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f45a800e7f0 tx=0x7f45a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.967+0000 7f45b97fa700 1 -- 172.21.15.8:0/4132423136 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45a80092e0 con 0x7f45bc0f7750 2023-10-18T22:16:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.967+0000 7f45b97fa700 1 -- 172.21.15.8:0/4132423136 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f45a800f040 con 0x7f45bc0f7750 2023-10-18T22:16:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.967+0000 7f45c1c9a700 1 -- 172.21.15.8:0/4132423136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc06a7a0 con 0x7f45bc0f7750 2023-10-18T22:16:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.967+0000 7f45b97fa700 1 -- 172.21.15.8:0/4132423136 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45a80147e0 con 0x7f45bc0f7750 2023-10-18T22:16:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.967+0000 7f45c1c9a700 1 -- 172.21.15.8:0/4132423136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc10ed70 con 0x7f45bc0f7750 2023-10-18T22:16:00.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.968+0000 7f45c1c9a700 1 -- 172.21.15.8:0/4132423136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc045ad0 con 0x7f45bc0f7750 2023-10-18T22:16:00.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.969+0000 7f45b97fa700 1 -- 172.21.15.8:0/4132423136 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f45a801b030 con 0x7f45bc0f7750 2023-10-18T22:16:00.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.970+0000 7f45b97fa700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45ac060f70 0x7f45ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:00.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.970+0000 7f45b97fa700 1 -- 172.21.15.8:0/4132423136 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f45a807c700 con 0x7f45bc0f7750 2023-10-18T22:16:00.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.970+0000 7f45c0c98700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45ac060f70 0x7f45ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:00.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.970+0000 7f45c0c98700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45ac060f70 0x7f45ac063430 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f45b0000c00 tx=0x7f45b0009ad0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:00.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:00.974+0000 7f45b97fa700 1 -- 172.21.15.8:0/4132423136 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f45a804c420 con 0x7f45bc0f7750 2023-10-18T22:16:01.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.174+0000 7f45c1c9a700 1 -- 172.21.15.8:0/4132423136 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45bc0fedd0 con 0x7f45ac060f70 2023-10-18T22:16:01.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.175+0000 7f45b97fa700 1 -- 172.21.15.8:0/4132423136 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f45bc0fedd0 con 0x7f45ac060f70 2023-10-18T22:16:01.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 -- 172.21.15.8:0/4132423136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45ac060f70 msgr2=0x7f45ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:01.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45ac060f70 0x7f45ac063430 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f45b0000c00 tx=0x7f45b0009ad0).stop 2023-10-18T22:16:01.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 -- 172.21.15.8:0/4132423136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45bc0f7750 msgr2=0x7f45bc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:01.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45bc0f7750 0x7f45bc069e20 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f45a800e7f0 tx=0x7f45a800b040).stop 2023-10-18T22:16:01.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 -- 172.21.15.8:0/4132423136 shutdown_connections 2023-10-18T22:16:01.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45ac060f70 0x7f45ac063430 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45bc0f64b0 0x7f45bc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 --2- 172.21.15.8:0/4132423136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45bc0f7750 0x7f45bc069e20 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 -- 172.21.15.8:0/4132423136 >> 172.21.15.8:0/4132423136 conn(0x7f45bc0f1c30 msgr2=0x7f45bc0fb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:01.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 -- 172.21.15.8:0/4132423136 shutdown_connections 2023-10-18T22:16:01.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.177+0000 7f45c1c9a700 1 -- 172.21.15.8:0/4132423136 wait complete. 2023-10-18T22:16:01.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.320+0000 7f302cf7d700 1 -- 172.21.15.8:0/3661448849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30280f77d0 msgr2=0x7f30280f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:01.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.320+0000 7f302cf7d700 1 --2- 172.21.15.8:0/3661448849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30280f77d0 0x7f30280f7c30 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7f301c004660 tx=0x7f301c009b30).stop 2023-10-18T22:16:01.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.320+0000 7f302cf7d700 1 -- 172.21.15.8:0/3661448849 shutdown_connections 2023-10-18T22:16:01.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.320+0000 7f302cf7d700 1 --2- 172.21.15.8:0/3661448849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30280f77d0 0x7f30280f7c30 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.320+0000 7f302cf7d700 1 --2- 172.21.15.8:0/3661448849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30280f6530 0x7f30280f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.320+0000 7f302cf7d700 1 -- 172.21.15.8:0/3661448849 >> 172.21.15.8:0/3661448849 conn(0x7f30280f1c90 msgr2=0x7f30280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.320+0000 7f302cf7d700 1 -- 172.21.15.8:0/3661448849 shutdown_connections 2023-10-18T22:16:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.320+0000 7f302cf7d700 1 -- 172.21.15.8:0/3661448849 wait complete. 2023-10-18T22:16:01.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.321+0000 7f302cf7d700 1 Processor -- start 2023-10-18T22:16:01.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.321+0000 7f302cf7d700 1 -- start start 2023-10-18T22:16:01.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.321+0000 7f302cf7d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30280f6530 0x7f302806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:01.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.321+0000 7f302cf7d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30280f77d0 0x7f3028069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:01.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.321+0000 7f302cf7d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302806a380 con 0x7f30280f6530 2023-10-18T22:16:01.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.321+0000 7f302cf7d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302806a4c0 con 0x7f30280f77d0 2023-10-18T22:16:01.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.322+0000 7f30277fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30280f6530 0x7f302806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:01.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.322+0000 7f30277fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30280f6530 0x7f302806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60002/0 (socket says 172.21.15.8:60002) 2023-10-18T22:16:01.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.322+0000 7f30277fe700 1 -- 172.21.15.8:0/1965374321 learned_addr learned my addr 172.21.15.8:0/1965374321 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.322+0000 7f3026ffd700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30280f77d0 0x7f3028069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.322+0000 7f30277fe700 1 -- 172.21.15.8:0/1965374321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30280f77d0 msgr2=0x7f3028069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.322+0000 7f30277fe700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30280f77d0 0x7f3028069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.322+0000 7f30277fe700 1 -- 172.21.15.8:0/1965374321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c005040 con 0x7f30280f6530 2023-10-18T22:16:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.322+0000 7f30277fe700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30280f6530 0x7f302806b9a0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f301800e7c0 tx=0x7f301800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.323+0000 7f300ffff700 1 -- 172.21.15.8:0/1965374321 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30180092e0 con 0x7f30280f6530 2023-10-18T22:16:01.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.323+0000 7f300ffff700 1 -- 172.21.15.8:0/1965374321 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f301800f040 con 0x7f30280f6530 2023-10-18T22:16:01.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.323+0000 7f300ffff700 1 -- 172.21.15.8:0/1965374321 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3018014810 con 0x7f30280f6530 2023-10-18T22:16:01.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.323+0000 7f302cf7d700 1 -- 172.21.15.8:0/1965374321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302806a7a0 con 0x7f30280f6530 2023-10-18T22:16:01.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.323+0000 7f302cf7d700 1 -- 172.21.15.8:0/1965374321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302810ed20 con 0x7f30280f6530 2023-10-18T22:16:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.324+0000 7f302cf7d700 1 -- 172.21.15.8:0/1965374321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3028045ad0 con 0x7f30280f6530 2023-10-18T22:16:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.325+0000 7f300ffff700 1 -- 172.21.15.8:0/1965374321 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f301801b030 con 0x7f30280f6530 2023-10-18T22:16:01.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.325+0000 7f300ffff700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3010060f70 0x7f3010063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:01.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.325+0000 7f300ffff700 1 -- 172.21.15.8:0/1965374321 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f301807c880 con 0x7f30280f6530 2023-10-18T22:16:01.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.326+0000 7f3026ffd700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3010060f70 0x7f3010063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:01.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.326+0000 7f3026ffd700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3010060f70 0x7f3010063430 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f301c009720 tx=0x7f301c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:01.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.330+0000 7f300ffff700 1 -- 172.21.15.8:0/1965374321 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f301804c430 con 0x7f30280f6530 2023-10-18T22:16:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:00.192664+0000 mgr.smithi008.flmjzp (mgr.14640) 4624 : cluster [DBG] pgmap v3174: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:00.800694+0000 mon.smithi008 (mon.0) 4911 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:00.801532+0000 mon.smithi008 (mon.0) 4912 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:00.807178+0000 mon.smithi008 (mon.0) 4913 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:00.812271+0000 mon.smithi008 (mon.0) 4914 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:00.816205+0000 mon.smithi008 (mon.0) 4915 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:00.817587+0000 mon.smithi008 (mon.0) 4916 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:00.818802+0000 mon.smithi008 (mon.0) 4917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:01.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:00.820310+0000 mon.smithi008 (mon.0) 4918 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:01.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.524+0000 7f302cf7d700 1 -- 172.21.15.8:0/1965374321 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30280fee30 con 0x7f3010060f70 2023-10-18T22:16:01.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.533+0000 7f300ffff700 1 -- 172.21.15.8:0/1965374321 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f30280fee30 con 0x7f3010060f70 2023-10-18T22:16:01.536 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:16:01.536 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (82m) 9m ago 84m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:16:01.536 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (76m) 9m ago 84m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:16:01.536 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (76m) 7m ago 83m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:16:01.537 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (82m) 9m ago 83m 27.9M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:16:01.537 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 80m - - 2023-10-18T22:16:01.537 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 80m - - 2023-10-18T22:16:01.537 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 80m - - 2023-10-18T22:16:01.537 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 80m - - 2023-10-18T22:16:01.538 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (77m) 9m ago 85m 538M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:16:01.538 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (77m) 7m ago 83m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:16:01.538 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (77m) 9m ago 85m 543M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:16:01.538 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (76m) 7m ago 83m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:16:01.538 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (83m) 9m ago 83m 10.5M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:16:01.539 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (82m) 7m ago 82m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:16:01.539 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (76m) 9m ago 82m 571M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:16:01.539 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (74m) 9m ago 82m 462M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:16:01.539 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (73m) 9m ago 82m 363M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:16:01.539 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (73m) 7m ago 81m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:16:01.540 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (72m) 7m ago 81m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:16:01.540 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (72m) 7m ago 81m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:16:01.540 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (78m) 9m ago 83m 80.5M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:16:01.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.535+0000 7f302cf7d700 1 -- 172.21.15.8:0/1965374321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3010060f70 msgr2=0x7f3010063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:01.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.535+0000 7f302cf7d700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3010060f70 0x7f3010063430 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f301c009720 tx=0x7f301c016040).stop 2023-10-18T22:16:01.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.535+0000 7f302cf7d700 1 -- 172.21.15.8:0/1965374321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30280f6530 msgr2=0x7f302806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:01.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.535+0000 7f302cf7d700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30280f6530 0x7f302806b9a0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f301800e7c0 tx=0x7f301800b040).stop 2023-10-18T22:16:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.535+0000 7f302cf7d700 1 -- 172.21.15.8:0/1965374321 shutdown_connections 2023-10-18T22:16:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.535+0000 7f302cf7d700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3010060f70 0x7f3010063430 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.535+0000 7f302cf7d700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30280f6530 0x7f302806b9a0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.535+0000 7f302cf7d700 1 --2- 172.21.15.8:0/1965374321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30280f77d0 0x7f3028069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.535+0000 7f302cf7d700 1 -- 172.21.15.8:0/1965374321 >> 172.21.15.8:0/1965374321 conn(0x7f30280f1c90 msgr2=0x7f30280fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.536+0000 7f302cf7d700 1 -- 172.21.15.8:0/1965374321 shutdown_connections 2023-10-18T22:16:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.536+0000 7f302cf7d700 1 -- 172.21.15.8:0/1965374321 wait complete. 2023-10-18T22:16:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:00.192664+0000 mgr.smithi008.flmjzp (mgr.14640) 4624 : cluster [DBG] pgmap v3174: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:00.800694+0000 mon.smithi008 (mon.0) 4911 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:00.801532+0000 mon.smithi008 (mon.0) 4912 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:00.807178+0000 mon.smithi008 (mon.0) 4913 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:00.812271+0000 mon.smithi008 (mon.0) 4914 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:00.816205+0000 mon.smithi008 (mon.0) 4915 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:00.817587+0000 mon.smithi008 (mon.0) 4916 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:00.818802+0000 mon.smithi008 (mon.0) 4917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:00.820310+0000 mon.smithi008 (mon.0) 4918 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:01.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.671+0000 7f48add27700 1 -- 172.21.15.8:0/1496429849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48a80f77d0 msgr2=0x7f48a80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:01.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.671+0000 7f48add27700 1 --2- 172.21.15.8:0/1496429849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48a80f77d0 0x7f48a80f7c30 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f4894004660 tx=0x7f4894009b30).stop 2023-10-18T22:16:01.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.671+0000 7f48add27700 1 -- 172.21.15.8:0/1496429849 shutdown_connections 2023-10-18T22:16:01.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.671+0000 7f48add27700 1 --2- 172.21.15.8:0/1496429849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48a80f77d0 0x7f48a80f7c30 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.671+0000 7f48add27700 1 --2- 172.21.15.8:0/1496429849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48a80f6530 0x7f48a80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.671+0000 7f48add27700 1 -- 172.21.15.8:0/1496429849 >> 172.21.15.8:0/1496429849 conn(0x7f48a80f1c90 msgr2=0x7f48a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:01.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.671+0000 7f48add27700 1 -- 172.21.15.8:0/1496429849 shutdown_connections 2023-10-18T22:16:01.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.671+0000 7f48add27700 1 -- 172.21.15.8:0/1496429849 wait complete. 2023-10-18T22:16:01.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.672+0000 7f48add27700 1 Processor -- start 2023-10-18T22:16:01.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.672+0000 7f48add27700 1 -- start start 2023-10-18T22:16:01.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48add27700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48a80f6530 0x7f48a8108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:01.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48add27700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48a80f77d0 0x7f48a81093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:01.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48add27700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a81099a0 con 0x7f48a80f6530 2023-10-18T22:16:01.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48add27700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a810a1b0 con 0x7f48a80f77d0 2023-10-18T22:16:01.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48acd25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48a80f6530 0x7f48a8108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:01.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48acd25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48a80f6530 0x7f48a8108eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60012/0 (socket says 172.21.15.8:60012) 2023-10-18T22:16:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48acd25700 1 -- 172.21.15.8:0/1898915382 learned_addr learned my addr 172.21.15.8:0/1898915382 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48a7fff700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48a80f77d0 0x7f48a81093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48acd25700 1 -- 172.21.15.8:0/1898915382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48a80f77d0 msgr2=0x7f48a81093a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48acd25700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48a80f77d0 0x7f48a81093a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48acd25700 1 -- 172.21.15.8:0/1898915382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4894005040 con 0x7f48a80f6530 2023-10-18T22:16:01.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.673+0000 7f48a7fff700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48a80f77d0 0x7f48a81093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:16:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.674+0000 7f48acd25700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48a80f6530 0x7f48a8108eb0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f489c00e7c0 tx=0x7f489c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.674+0000 7f48a57fa700 1 -- 172.21.15.8:0/1898915382 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f489c0092e0 con 0x7f48a80f6530 2023-10-18T22:16:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.674+0000 7f48a57fa700 1 -- 172.21.15.8:0/1898915382 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f489c00f040 con 0x7f48a80f6530 2023-10-18T22:16:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.674+0000 7f48add27700 1 -- 172.21.15.8:0/1898915382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a810a430 con 0x7f48a80f6530 2023-10-18T22:16:01.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.674+0000 7f48a57fa700 1 -- 172.21.15.8:0/1898915382 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f489c0147e0 con 0x7f48a80f6530 2023-10-18T22:16:01.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.674+0000 7f48add27700 1 -- 172.21.15.8:0/1898915382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a810a970 con 0x7f48a80f6530 2023-10-18T22:16:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.675+0000 7f48add27700 1 -- 172.21.15.8:0/1898915382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a8059100 con 0x7f48a80f6530 2023-10-18T22:16:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.676+0000 7f48a57fa700 1 -- 172.21.15.8:0/1898915382 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f489c01b030 con 0x7f48a80f6530 2023-10-18T22:16:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.677+0000 7f48a57fa700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4898060f70 0x7f4898063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.677+0000 7f48a57fa700 1 -- 172.21.15.8:0/1898915382 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f489c07ca60 con 0x7f48a80f6530 2023-10-18T22:16:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.677+0000 7f48a7fff700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4898060f70 0x7f4898063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.678+0000 7f48a7fff700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4898060f70 0x7f4898063430 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f4894009720 tx=0x7f489400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.681+0000 7f48a57fa700 1 -- 172.21.15.8:0/1898915382 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f489c04c610 con 0x7f48a80f6530 2023-10-18T22:16:01.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.932+0000 7f48add27700 1 -- 172.21.15.8:0/1898915382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f48a80fed60 con 0x7f48a80f6530 2023-10-18T22:16:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.933+0000 7f48a57fa700 1 -- 172.21.15.8:0/1898915382 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f489c019020 con 0x7f48a80f6530 2023-10-18T22:16:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:16:01.935 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:16:01.936 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:16:01.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:16:01.936 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:16:01.936 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:16:01.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:16:01.937 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:16:01.937 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:16:01.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:16:01.937 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:16:01.937 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:16:01.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:16:01.938 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:16:01.938 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:16:01.938 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:16:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:16:01.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 -- 172.21.15.8:0/1898915382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4898060f70 msgr2=0x7f4898063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:01.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4898060f70 0x7f4898063430 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f4894009720 tx=0x7f489400b040).stop 2023-10-18T22:16:01.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 -- 172.21.15.8:0/1898915382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48a80f6530 msgr2=0x7f48a8108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:01.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48a80f6530 0x7f48a8108eb0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f489c00e7c0 tx=0x7f489c00b040).stop 2023-10-18T22:16:01.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 -- 172.21.15.8:0/1898915382 shutdown_connections 2023-10-18T22:16:01.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4898060f70 0x7f4898063430 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48a80f6530 0x7f48a8108eb0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 --2- 172.21.15.8:0/1898915382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48a80f77d0 0x7f48a81093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 -- 172.21.15.8:0/1898915382 >> 172.21.15.8:0/1898915382 conn(0x7f48a80f1c90 msgr2=0x7f48a80f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 -- 172.21.15.8:0/1898915382 shutdown_connections 2023-10-18T22:16:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:01.935+0000 7f48add27700 1 -- 172.21.15.8:0/1898915382 wait complete. 2023-10-18T22:16:02.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.071+0000 7fc7b3fff700 1 -- 172.21.15.8:0/3346480223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b4060310 msgr2=0x7fc7b40f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:02.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.071+0000 7fc7b3fff700 1 --2- 172.21.15.8:0/3346480223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b4060310 0x7fc7b40f9120 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7fc7a4004660 tx=0x7fc7a4009b30).stop 2023-10-18T22:16:02.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.071+0000 7fc7b3fff700 1 -- 172.21.15.8:0/3346480223 shutdown_connections 2023-10-18T22:16:02.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.071+0000 7fc7b3fff700 1 --2- 172.21.15.8:0/3346480223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b40f96a0 0x7fc7b40fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.071+0000 7fc7b3fff700 1 --2- 172.21.15.8:0/3346480223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b4060310 0x7fc7b40f9120 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.071+0000 7fc7b3fff700 1 -- 172.21.15.8:0/3346480223 >> 172.21.15.8:0/3346480223 conn(0x7fc7b40f0ba0 msgr2=0x7fc7b40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:02.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.071+0000 7fc7b3fff700 1 -- 172.21.15.8:0/3346480223 shutdown_connections 2023-10-18T22:16:02.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.072+0000 7fc7b3fff700 1 -- 172.21.15.8:0/3346480223 wait complete. 2023-10-18T22:16:02.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.072+0000 7fc7b3fff700 1 Processor -- start 2023-10-18T22:16:02.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.073+0000 7fc7b3fff700 1 -- start start 2023-10-18T22:16:02.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.073+0000 7fc7b3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b4060310 0x7fc7b4106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:02.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.073+0000 7fc7b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b40f96a0 0x7fc7b4107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:02.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.073+0000 7fc7b3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4107850 con 0x7fc7b40f96a0 2023-10-18T22:16:02.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.073+0000 7fc7b3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4108060 con 0x7fc7b4060310 2023-10-18T22:16:02.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.073+0000 7fc7b27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b40f96a0 0x7fc7b4107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:02.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.073+0000 7fc7b27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b40f96a0 0x7fc7b4107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60036/0 (socket says 172.21.15.8:60036) 2023-10-18T22:16:02.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.073+0000 7fc7b27fc700 1 -- 172.21.15.8:0/2210912779 learned_addr learned my addr 172.21.15.8:0/2210912779 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:02.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.073+0000 7fc7b2ffd700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b4060310 0x7fc7b4106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:02.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.074+0000 7fc7b27fc700 1 -- 172.21.15.8:0/2210912779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b4060310 msgr2=0x7fc7b4106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:02.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.074+0000 7fc7b27fc700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b4060310 0x7fc7b4106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.074+0000 7fc7b27fc700 1 -- 172.21.15.8:0/2210912779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4005040 con 0x7fc7b40f96a0 2023-10-18T22:16:02.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.074+0000 7fc7b27fc700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b40f96a0 0x7fc7b4107250 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7fc7a800e7c0 tx=0x7fc7a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:02.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.074+0000 7fc79b7fe700 1 -- 172.21.15.8:0/2210912779 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7a80092e0 con 0x7fc7b40f96a0 2023-10-18T22:16:02.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.074+0000 7fc79b7fe700 1 -- 172.21.15.8:0/2210912779 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc7a800f040 con 0x7fc7b40f96a0 2023-10-18T22:16:02.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.074+0000 7fc79b7fe700 1 -- 172.21.15.8:0/2210912779 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7a80147e0 con 0x7fc7b40f96a0 2023-10-18T22:16:02.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.074+0000 7fc7b3fff700 1 -- 172.21.15.8:0/2210912779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b41082e0 con 0x7fc7b40f96a0 2023-10-18T22:16:02.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.074+0000 7fc7b3fff700 1 -- 172.21.15.8:0/2210912779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b4108820 con 0x7fc7b40f96a0 2023-10-18T22:16:02.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.075+0000 7fc7b3fff700 1 -- 172.21.15.8:0/2210912779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b4059100 con 0x7fc7b40f96a0 2023-10-18T22:16:02.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.076+0000 7fc79b7fe700 1 -- 172.21.15.8:0/2210912779 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc7a8014a10 con 0x7fc7b40f96a0 2023-10-18T22:16:02.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.077+0000 7fc79b7fe700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc79c060f70 0x7fc79c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:02.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.077+0000 7fc79b7fe700 1 -- 172.21.15.8:0/2210912779 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc7a807cbc0 con 0x7fc7b40f96a0 2023-10-18T22:16:02.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.077+0000 7fc7b2ffd700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc79c060f70 0x7fc79c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:02.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.078+0000 7fc7b2ffd700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc79c060f70 0x7fc79c063430 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7fc7a4005010 tx=0x7fc7a4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:02.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.081+0000 7fc79b7fe700 1 -- 172.21.15.8:0/2210912779 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc7a804c770 con 0x7fc7b40f96a0 2023-10-18T22:16:02.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.309+0000 7fc7b3fff700 1 -- 172.21.15.8:0/2210912779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc7b40fedf0 con 0x7fc7b40f96a0 2023-10-18T22:16:02.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.309+0000 7fc79b7fe700 1 -- 172.21.15.8:0/2210912779 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fc7a804fd90 con 0x7fc7b40f96a0 2023-10-18T22:16:02.312 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:16:02.312 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:16:02.313 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:16:02.313 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:16:02.313 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:16:02.313 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:16:02.313 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:16:02.313 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:16:02.314 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:16:02.314 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:16:02.314 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:16:02.314 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:16:02.314 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:16:02.315 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:16:02.315 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:16:02.315 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:16:02.315 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:16:02.315 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:16:02.316 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:16:02.316 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:16:02.316 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:16:02.316 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:16:02.316 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:16:02.316 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:16:02.317 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:16:02.317 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:16:02.317 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:16:02.317 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:16:02.317 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:16:02.318 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:16:02.318 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:16:02.318 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:16:02.318 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:16:02.318 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:16:02.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.311+0000 7fc7b3fff700 1 -- 172.21.15.8:0/2210912779 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc79c060f70 msgr2=0x7fc79c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:02.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.311+0000 7fc7b3fff700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc79c060f70 0x7fc79c063430 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7fc7a4005010 tx=0x7fc7a4016040).stop 2023-10-18T22:16:02.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.311+0000 7fc7b3fff700 1 -- 172.21.15.8:0/2210912779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b40f96a0 msgr2=0x7fc7b4107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:02.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.311+0000 7fc7b3fff700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b40f96a0 0x7fc7b4107250 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7fc7a800e7c0 tx=0x7fc7a800b040).stop 2023-10-18T22:16:02.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.311+0000 7fc7b3fff700 1 -- 172.21.15.8:0/2210912779 shutdown_connections 2023-10-18T22:16:02.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.311+0000 7fc7b3fff700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc79c060f70 0x7fc79c063430 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.311+0000 7fc7b3fff700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b4060310 0x7fc7b4106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.311+0000 7fc7b3fff700 1 --2- 172.21.15.8:0/2210912779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b40f96a0 0x7fc7b4107250 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.311+0000 7fc7b3fff700 1 -- 172.21.15.8:0/2210912779 >> 172.21.15.8:0/2210912779 conn(0x7fc7b40f0ba0 msgr2=0x7fc7b40f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:02.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.312+0000 7fc7b3fff700 1 -- 172.21.15.8:0/2210912779 shutdown_connections 2023-10-18T22:16:02.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.312+0000 7fc7b3fff700 1 -- 172.21.15.8:0/2210912779 wait complete. 2023-10-18T22:16:02.321 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:16:02.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.451+0000 7f992ffff700 1 -- 172.21.15.8:0/2550943192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99300f6530 msgr2=0x7f99300f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:02.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.451+0000 7f992ffff700 1 --2- 172.21.15.8:0/2550943192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99300f6530 0x7f99300f6950 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f9920004660 tx=0x7f9920009b30).stop 2023-10-18T22:16:02.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.451+0000 7f992ffff700 1 -- 172.21.15.8:0/2550943192 shutdown_connections 2023-10-18T22:16:02.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.451+0000 7f992ffff700 1 --2- 172.21.15.8:0/2550943192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99300f77d0 0x7f99300f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.451+0000 7f992ffff700 1 --2- 172.21.15.8:0/2550943192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99300f6530 0x7f99300f6950 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.451+0000 7f992ffff700 1 -- 172.21.15.8:0/2550943192 >> 172.21.15.8:0/2550943192 conn(0x7f99300f1c90 msgr2=0x7f99300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:02.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.451+0000 7f992ffff700 1 -- 172.21.15.8:0/2550943192 shutdown_connections 2023-10-18T22:16:02.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.451+0000 7f992ffff700 1 -- 172.21.15.8:0/2550943192 wait complete. 2023-10-18T22:16:02.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.452+0000 7f992ffff700 1 Processor -- start 2023-10-18T22:16:02.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.452+0000 7f992ffff700 1 -- start start 2023-10-18T22:16:02.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.452+0000 7f992ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99300f6530 0x7f9930106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:02.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.452+0000 7f992ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99300f77d0 0x7f9930107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:02.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.452+0000 7f992ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9930107880 con 0x7f99300f77d0 2023-10-18T22:16:02.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.452+0000 7f992ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99301080c0 con 0x7f99300f6530 2023-10-18T22:16:02.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.452+0000 7f992e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99300f77d0 0x7f9930107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:02.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.452+0000 7f992e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99300f77d0 0x7f9930107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60048/0 (socket says 172.21.15.8:60048) 2023-10-18T22:16:02.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.452+0000 7f992e7fc700 1 -- 172.21.15.8:0/388110350 learned_addr learned my addr 172.21.15.8:0/388110350 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.453+0000 7f992effd700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99300f6530 0x7f9930106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.453+0000 7f992e7fc700 1 -- 172.21.15.8:0/388110350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99300f6530 msgr2=0x7f9930106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.453+0000 7f992e7fc700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99300f6530 0x7f9930106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.453+0000 7f992e7fc700 1 -- 172.21.15.8:0/388110350 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920005040 con 0x7f99300f77d0 2023-10-18T22:16:02.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.453+0000 7f992e7fc700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99300f77d0 0x7f9930107280 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f992400e7f0 tx=0x7f992400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:02.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.453+0000 7f99177fe700 1 -- 172.21.15.8:0/388110350 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99240092e0 con 0x7f99300f77d0 2023-10-18T22:16:02.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.453+0000 7f99177fe700 1 -- 172.21.15.8:0/388110350 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f992400f040 con 0x7f99300f77d0 2023-10-18T22:16:02.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.453+0000 7f99177fe700 1 -- 172.21.15.8:0/388110350 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99240147e0 con 0x7f99300f77d0 2023-10-18T22:16:02.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.453+0000 7f992ffff700 1 -- 172.21.15.8:0/388110350 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99301083a0 con 0x7f99300f77d0 2023-10-18T22:16:02.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.454+0000 7f992ffff700 1 -- 172.21.15.8:0/388110350 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9930108890 con 0x7f99300f77d0 2023-10-18T22:16:02.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.455+0000 7f992ffff700 1 -- 172.21.15.8:0/388110350 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9930059100 con 0x7f99300f77d0 2023-10-18T22:16:02.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.455+0000 7f99177fe700 1 -- 172.21.15.8:0/388110350 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f992401b030 con 0x7f99300f77d0 2023-10-18T22:16:02.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.456+0000 7f99177fe700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9918060f70 0x7f9918063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:02.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.456+0000 7f99177fe700 1 -- 172.21.15.8:0/388110350 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f992407c7f0 con 0x7f99300f77d0 2023-10-18T22:16:02.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.457+0000 7f992effd700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9918060f70 0x7f9918063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:02.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.457+0000 7f992effd700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9918060f70 0x7f9918063430 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f9920004d80 tx=0x7f992000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:02.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.461+0000 7f99177fe700 1 -- 172.21.15.8:0/388110350 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f992404c450 con 0x7f99300f77d0 2023-10-18T22:16:02.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.657+0000 7f992ffff700 1 -- 172.21.15.8:0/388110350 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99300fed80 con 0x7f9918060f70 2023-10-18T22:16:02.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.658+0000 7f99177fe700 1 -- 172.21.15.8:0/388110350 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f99300fed80 con 0x7f9918060f70 2023-10-18T22:16:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:16:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:16:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:16:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:16:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:16:02.662 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:16:02.662 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:16:02.662 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:16:02.662 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:16:02.662 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:16:02.663 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:16:02.663 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:16:02.663 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:16:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:16:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.660+0000 7f992ffff700 1 -- 172.21.15.8:0/388110350 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9918060f70 msgr2=0x7f9918063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.660+0000 7f992ffff700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9918060f70 0x7f9918063430 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f9920004d80 tx=0x7f992000b040).stop 2023-10-18T22:16:02.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.660+0000 7f992ffff700 1 -- 172.21.15.8:0/388110350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99300f77d0 msgr2=0x7f9930107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:02.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.660+0000 7f992ffff700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99300f77d0 0x7f9930107280 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f992400e7f0 tx=0x7f992400b040).stop 2023-10-18T22:16:02.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.660+0000 7f992ffff700 1 -- 172.21.15.8:0/388110350 shutdown_connections 2023-10-18T22:16:02.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.660+0000 7f992ffff700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9918060f70 0x7f9918063430 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.660+0000 7f992ffff700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99300f6530 0x7f9930106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.660+0000 7f992ffff700 1 --2- 172.21.15.8:0/388110350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99300f77d0 0x7f9930107280 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:02.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.660+0000 7f992ffff700 1 -- 172.21.15.8:0/388110350 >> 172.21.15.8:0/388110350 conn(0x7f99300f1c90 msgr2=0x7f99300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:02.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.660+0000 7f992ffff700 1 -- 172.21.15.8:0/388110350 shutdown_connections 2023-10-18T22:16:02.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:02.661+0000 7f992ffff700 1 -- 172.21.15.8:0/388110350 wait complete. 2023-10-18T22:16:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:00.802166+0000 mgr.smithi008.flmjzp (mgr.14640) 4625 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:00.802731+0000 mgr.smithi008.flmjzp (mgr.14640) 4626 : cluster [DBG] pgmap v3175: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:00.802942+0000 mgr.smithi008.flmjzp (mgr.14640) 4627 : cluster [DBG] pgmap v3176: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:00.822045+0000 mgr.smithi008.flmjzp (mgr.14640) 4628 : audit [DBG] from='client.37720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:00.822106+0000 mgr.smithi008.flmjzp (mgr.14640) 4629 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:01.176555+0000 mgr.smithi008.flmjzp (mgr.14640) 4630 : audit [DBG] from='client.37724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:01.934244+0000 mon.smithi008 (mon.0) 4919 : audit [DBG] from='client.? 172.21.15.8:0/1898915382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:02.311057+0000 mon.smithi008 (mon.0) 4920 : audit [DBG] from='client.? 172.21.15.8:0/2210912779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:16:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:00.802166+0000 mgr.smithi008.flmjzp (mgr.14640) 4625 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:00.802731+0000 mgr.smithi008.flmjzp (mgr.14640) 4626 : cluster [DBG] pgmap v3175: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:00.802942+0000 mgr.smithi008.flmjzp (mgr.14640) 4627 : cluster [DBG] pgmap v3176: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:00.822045+0000 mgr.smithi008.flmjzp (mgr.14640) 4628 : audit [DBG] from='client.37720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:00.822106+0000 mgr.smithi008.flmjzp (mgr.14640) 4629 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:01.176555+0000 mgr.smithi008.flmjzp (mgr.14640) 4630 : audit [DBG] from='client.37724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:01.934244+0000 mon.smithi008 (mon.0) 4919 : audit [DBG] from='client.? 172.21.15.8:0/1898915382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:02.311057+0000 mon.smithi008 (mon.0) 4920 : audit [DBG] from='client.? 172.21.15.8:0/2210912779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:16:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:01.526397+0000 mgr.smithi008.flmjzp (mgr.14640) 4631 : audit [DBG] from='client.37728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:01.526397+0000 mgr.smithi008.flmjzp (mgr.14640) 4631 : audit [DBG] from='client.37728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:02.659631+0000 mgr.smithi008.flmjzp (mgr.14640) 4632 : audit [DBG] from='client.37740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:02.803559+0000 mgr.smithi008.flmjzp (mgr.14640) 4633 : cluster [DBG] pgmap v3177: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:02.659631+0000 mgr.smithi008.flmjzp (mgr.14640) 4632 : audit [DBG] from='client.37740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:02.803559+0000 mgr.smithi008.flmjzp (mgr.14640) 4633 : cluster [DBG] pgmap v3177: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:04.804101+0000 mgr.smithi008.flmjzp (mgr.14640) 4634 : cluster [DBG] pgmap v3178: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:04.804101+0000 mgr.smithi008.flmjzp (mgr.14640) 4634 : cluster [DBG] pgmap v3178: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:06.804675+0000 mgr.smithi008.flmjzp (mgr.14640) 4635 : cluster [DBG] pgmap v3179: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:06.804675+0000 mgr.smithi008.flmjzp (mgr.14640) 4635 : cluster [DBG] pgmap v3179: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:08.805277+0000 mgr.smithi008.flmjzp (mgr.14640) 4636 : cluster [DBG] pgmap v3180: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:08.805277+0000 mgr.smithi008.flmjzp (mgr.14640) 4636 : cluster [DBG] pgmap v3180: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:10.832803+0000 mon.smithi008 (mon.0) 4921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:11.620 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:10.832803+0000 mon.smithi008 (mon.0) 4921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:10.805816+0000 mgr.smithi008.flmjzp (mgr.14640) 4637 : cluster [DBG] pgmap v3181: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:10.805816+0000 mgr.smithi008.flmjzp (mgr.14640) 4637 : cluster [DBG] pgmap v3181: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:12.806438+0000 mgr.smithi008.flmjzp (mgr.14640) 4638 : cluster [DBG] pgmap v3182: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:12.806438+0000 mgr.smithi008.flmjzp (mgr.14640) 4638 : cluster [DBG] pgmap v3182: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:16.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:14.806918+0000 mgr.smithi008.flmjzp (mgr.14640) 4639 : cluster [DBG] pgmap v3183: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:15.117725+0000 mon.smithi008 (mon.0) 4922 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:15.118588+0000 mon.smithi008 (mon.0) 4923 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:15.119347+0000 mon.smithi008 (mon.0) 4924 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:16.421 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:15.119981+0000 mgr.smithi008.flmjzp (mgr.14640) 4640 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:15.120439+0000 mgr.smithi008.flmjzp (mgr.14640) 4641 : cluster [DBG] pgmap v3184: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:15.120676+0000 mgr.smithi008.flmjzp (mgr.14640) 4642 : cluster [DBG] pgmap v3185: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:15.124123+0000 mon.smithi008 (mon.0) 4925 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:15.128970+0000 mon.smithi008 (mon.0) 4926 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:16.422 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:15.131475+0000 mon.smithi008 (mon.0) 4927 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:16.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:15.132722+0000 mon.smithi008 (mon.0) 4928 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:16.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:15.133946+0000 mon.smithi008 (mon.0) 4929 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:16.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:15.135509+0000 mon.smithi008 (mon.0) 4930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:16.423 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:15.137041+0000 mgr.smithi008.flmjzp (mgr.14640) 4643 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:14.806918+0000 mgr.smithi008.flmjzp (mgr.14640) 4639 : cluster [DBG] pgmap v3183: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:16.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:15.117725+0000 mon.smithi008 (mon.0) 4922 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:15.118588+0000 mon.smithi008 (mon.0) 4923 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:15.119347+0000 mon.smithi008 (mon.0) 4924 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:15.119981+0000 mgr.smithi008.flmjzp (mgr.14640) 4640 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:15.120439+0000 mgr.smithi008.flmjzp (mgr.14640) 4641 : cluster [DBG] pgmap v3184: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:16.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:15.120676+0000 mgr.smithi008.flmjzp (mgr.14640) 4642 : cluster [DBG] pgmap v3185: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:16.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:15.124123+0000 mon.smithi008 (mon.0) 4925 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:16.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:15.128970+0000 mon.smithi008 (mon.0) 4926 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:16.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:15.131475+0000 mon.smithi008 (mon.0) 4927 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:16.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:15.132722+0000 mon.smithi008 (mon.0) 4928 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:16.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:15.133946+0000 mon.smithi008 (mon.0) 4929 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:16.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:15.135509+0000 mon.smithi008 (mon.0) 4930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:16.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:15.137041+0000 mgr.smithi008.flmjzp (mgr.14640) 4643 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:18.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:17.121223+0000 mgr.smithi008.flmjzp (mgr.14640) 4644 : cluster [DBG] pgmap v3186: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:17.121223+0000 mgr.smithi008.flmjzp (mgr.14640) 4644 : cluster [DBG] pgmap v3186: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:20.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:19.122003+0000 mgr.smithi008.flmjzp (mgr.14640) 4645 : cluster [DBG] pgmap v3187: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:19.122003+0000 mgr.smithi008.flmjzp (mgr.14640) 4645 : cluster [DBG] pgmap v3187: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:21.122762+0000 mgr.smithi008.flmjzp (mgr.14640) 4646 : cluster [DBG] pgmap v3188: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:21.122762+0000 mgr.smithi008.flmjzp (mgr.14640) 4646 : cluster [DBG] pgmap v3188: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:24.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:23.123239+0000 mgr.smithi008.flmjzp (mgr.14640) 4647 : cluster [DBG] pgmap v3189: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:23.123239+0000 mgr.smithi008.flmjzp (mgr.14640) 4647 : cluster [DBG] pgmap v3189: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:25.140243+0000 mon.smithi008 (mon.0) 4931 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:25.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:25.140243+0000 mon.smithi008 (mon.0) 4931 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:25.123929+0000 mgr.smithi008.flmjzp (mgr.14640) 4648 : cluster [DBG] pgmap v3190: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:25.700983+0000 mon.smithi008 (mon.0) 4932 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:25.702207+0000 mon.smithi008 (mon.0) 4933 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:26.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:25.709003+0000 mon.smithi008 (mon.0) 4934 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:25.715489+0000 mon.smithi008 (mon.0) 4935 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:25.718569+0000 mon.smithi008 (mon.0) 4936 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:25.720282+0000 mon.smithi008 (mon.0) 4937 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:25.721924+0000 mon.smithi008 (mon.0) 4938 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:26.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:25.724247+0000 mon.smithi008 (mon.0) 4939 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:25.123929+0000 mgr.smithi008.flmjzp (mgr.14640) 4648 : cluster [DBG] pgmap v3190: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:25.700983+0000 mon.smithi008 (mon.0) 4932 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:25.702207+0000 mon.smithi008 (mon.0) 4933 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:25.709003+0000 mon.smithi008 (mon.0) 4934 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:25.715489+0000 mon.smithi008 (mon.0) 4935 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:25.718569+0000 mon.smithi008 (mon.0) 4936 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:25.720282+0000 mon.smithi008 (mon.0) 4937 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:25.721924+0000 mon.smithi008 (mon.0) 4938 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:25.724247+0000 mon.smithi008 (mon.0) 4939 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:25.703139+0000 mgr.smithi008.flmjzp (mgr.14640) 4649 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:25.703918+0000 mgr.smithi008.flmjzp (mgr.14640) 4650 : cluster [DBG] pgmap v3191: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:25.704208+0000 mgr.smithi008.flmjzp (mgr.14640) 4651 : cluster [DBG] pgmap v3192: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:25.726368+0000 mgr.smithi008.flmjzp (mgr.14640) 4652 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:25.703139+0000 mgr.smithi008.flmjzp (mgr.14640) 4649 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:25.703918+0000 mgr.smithi008.flmjzp (mgr.14640) 4650 : cluster [DBG] pgmap v3191: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:25.704208+0000 mgr.smithi008.flmjzp (mgr.14640) 4651 : cluster [DBG] pgmap v3192: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:25.726368+0000 mgr.smithi008.flmjzp (mgr.14640) 4652 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:27.704768+0000 mgr.smithi008.flmjzp (mgr.14640) 4653 : cluster [DBG] pgmap v3193: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:29.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:27.704768+0000 mgr.smithi008.flmjzp (mgr.14640) 4653 : cluster [DBG] pgmap v3193: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:29.705520+0000 mgr.smithi008.flmjzp (mgr.14640) 4654 : cluster [DBG] pgmap v3194: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:29.705520+0000 mgr.smithi008.flmjzp (mgr.14640) 4654 : cluster [DBG] pgmap v3194: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:32.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.816+0000 7fc6ecfac700 1 -- 172.21.15.8:0/4190393606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e80f77d0 msgr2=0x7fc6e80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:32.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.816+0000 7fc6ecfac700 1 --2- 172.21.15.8:0/4190393606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e80f77d0 0x7fc6e80f7c30 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7fc6dc004660 tx=0x7fc6dc009b30).stop 2023-10-18T22:16:32.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.817+0000 7fc6ecfac700 1 -- 172.21.15.8:0/4190393606 shutdown_connections 2023-10-18T22:16:32.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.817+0000 7fc6ecfac700 1 --2- 172.21.15.8:0/4190393606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e80f77d0 0x7fc6e80f7c30 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:32.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.817+0000 7fc6ecfac700 1 --2- 172.21.15.8:0/4190393606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e80f6530 0x7fc6e80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:32.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.817+0000 7fc6ecfac700 1 -- 172.21.15.8:0/4190393606 >> 172.21.15.8:0/4190393606 conn(0x7fc6e80f1c90 msgr2=0x7fc6e80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:32.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.817+0000 7fc6ecfac700 1 -- 172.21.15.8:0/4190393606 shutdown_connections 2023-10-18T22:16:32.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.817+0000 7fc6ecfac700 1 -- 172.21.15.8:0/4190393606 wait complete. 2023-10-18T22:16:32.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.818+0000 7fc6ecfac700 1 Processor -- start 2023-10-18T22:16:32.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.818+0000 7fc6ecfac700 1 -- start start 2023-10-18T22:16:32.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.818+0000 7fc6ecfac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e80f6530 0x7fc6e8108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:32.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.818+0000 7fc6ecfac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e80f77d0 0x7fc6e8109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:32.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.818+0000 7fc6ecfac700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e81099b0 con 0x7fc6e80f77d0 2023-10-18T22:16:32.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.818+0000 7fc6ecfac700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8109af0 con 0x7fc6e80f6530 2023-10-18T22:16:32.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.819+0000 7fc6e6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e80f77d0 0x7fc6e8109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:32.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.819+0000 7fc6e6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e80f77d0 0x7fc6e8109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59412/0 (socket says 172.21.15.8:59412) 2023-10-18T22:16:32.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.819+0000 7fc6e6ffd700 1 -- 172.21.15.8:0/3117195540 learned_addr learned my addr 172.21.15.8:0/3117195540 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:32.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.819+0000 7fc6e77fe700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e80f6530 0x7fc6e8108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:32.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.819+0000 7fc6e6ffd700 1 -- 172.21.15.8:0/3117195540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e80f6530 msgr2=0x7fc6e8108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:32.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.819+0000 7fc6e6ffd700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e80f6530 0x7fc6e8108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:32.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.819+0000 7fc6e6ffd700 1 -- 172.21.15.8:0/3117195540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc005040 con 0x7fc6e80f77d0 2023-10-18T22:16:32.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.819+0000 7fc6e6ffd700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e80f77d0 0x7fc6e8109400 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7fc6dc009990 tx=0x7fc6dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:32.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.819+0000 7fc6cffff700 1 -- 172.21.15.8:0/3117195540 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6dc018070 con 0x7fc6e80f77d0 2023-10-18T22:16:32.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.820+0000 7fc6cffff700 1 -- 172.21.15.8:0/3117195540 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc6dc009630 con 0x7fc6e80f77d0 2023-10-18T22:16:32.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.820+0000 7fc6ecfac700 1 -- 172.21.15.8:0/3117195540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e810a430 con 0x7fc6e80f77d0 2023-10-18T22:16:32.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.820+0000 7fc6cffff700 1 -- 172.21.15.8:0/3117195540 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6dc01c3c0 con 0x7fc6e80f77d0 2023-10-18T22:16:32.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.820+0000 7fc6ecfac700 1 -- 172.21.15.8:0/3117195540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e810a990 con 0x7fc6e80f77d0 2023-10-18T22:16:32.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.821+0000 7fc6ecfac700 1 -- 172.21.15.8:0/3117195540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8045ad0 con 0x7fc6e80f77d0 2023-10-18T22:16:32.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.822+0000 7fc6cffff700 1 -- 172.21.15.8:0/3117195540 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc6dc01d970 con 0x7fc6e80f77d0 2023-10-18T22:16:32.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.822+0000 7fc6cffff700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc6d0060f70 0x7fc6d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:32.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.823+0000 7fc6cffff700 1 -- 172.21.15.8:0/3117195540 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc6dc07e660 con 0x7fc6e80f77d0 2023-10-18T22:16:32.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.823+0000 7fc6e77fe700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc6d0060f70 0x7fc6d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:32.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.823+0000 7fc6e77fe700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc6d0060f70 0x7fc6d0063430 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7fc6e80f7630 tx=0x7fc6d800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:32.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:32.827+0000 7fc6cffff700 1 -- 172.21.15.8:0/3117195540 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc6dc051c40 con 0x7fc6e80f77d0 2023-10-18T22:16:33.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.026+0000 7fc6ecfac700 1 -- 172.21.15.8:0/3117195540 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6e810abb0 con 0x7fc6d0060f70 2023-10-18T22:16:33.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.027+0000 7fc6cffff700 1 -- 172.21.15.8:0/3117195540 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc6e810abb0 con 0x7fc6d0060f70 2023-10-18T22:16:33.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 -- 172.21.15.8:0/3117195540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc6d0060f70 msgr2=0x7fc6d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc6d0060f70 0x7fc6d0063430 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7fc6e80f7630 tx=0x7fc6d800b040).stop 2023-10-18T22:16:33.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 -- 172.21.15.8:0/3117195540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e80f77d0 msgr2=0x7fc6e8109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e80f77d0 0x7fc6e8109400 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7fc6dc009990 tx=0x7fc6dc009b30).stop 2023-10-18T22:16:33.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 -- 172.21.15.8:0/3117195540 shutdown_connections 2023-10-18T22:16:33.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc6d0060f70 0x7fc6d0063430 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e80f6530 0x7fc6e8108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 --2- 172.21.15.8:0/3117195540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e80f77d0 0x7fc6e8109400 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 -- 172.21.15.8:0/3117195540 >> 172.21.15.8:0/3117195540 conn(0x7fc6e80f1c90 msgr2=0x7fc6e806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:33.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 -- 172.21.15.8:0/3117195540 shutdown_connections 2023-10-18T22:16:33.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.029+0000 7fc6ecfac700 1 -- 172.21.15.8:0/3117195540 wait complete. 2023-10-18T22:16:33.045 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:16:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.167+0000 7fca77127700 1 -- 172.21.15.8:0/258054169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca70060310 msgr2=0x7fca700f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.167+0000 7fca77127700 1 --2- 172.21.15.8:0/258054169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca70060310 0x7fca700f9110 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7fca6c004660 tx=0x7fca6c009b30).stop 2023-10-18T22:16:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.167+0000 7fca77127700 1 -- 172.21.15.8:0/258054169 shutdown_connections 2023-10-18T22:16:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.167+0000 7fca77127700 1 --2- 172.21.15.8:0/258054169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca700f9690 0x7fca700fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:16:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.167+0000 7fca77127700 1 --2- 172.21.15.8:0/258054169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca70060310 0x7fca700f9110 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.167+0000 7fca77127700 1 -- 172.21.15.8:0/258054169 >> 172.21.15.8:0/258054169 conn(0x7fca700f0b90 msgr2=0x7fca700f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.167+0000 7fca77127700 1 -- 172.21.15.8:0/258054169 shutdown_connections 2023-10-18T22:16:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.167+0000 7fca77127700 1 -- 172.21.15.8:0/258054169 wait complete. 2023-10-18T22:16:33.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.168+0000 7fca77127700 1 Processor -- start 2023-10-18T22:16:33.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.168+0000 7fca77127700 1 -- start start 2023-10-18T22:16:33.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.168+0000 7fca77127700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca70060310 0x7fca70108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:33.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca77127700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca700f9690 0x7fca70109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:33.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca77127700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca70109aa0 con 0x7fca700f9690 2023-10-18T22:16:33.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca77127700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7010a350 con 0x7fca70060310 2023-10-18T22:16:33.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca75924700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca700f9690 0x7fca70109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:33.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca75924700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca700f9690 0x7fca70109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59420/0 (socket says 172.21.15.8:59420) 2023-10-18T22:16:33.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca75924700 1 -- 172.21.15.8:0/3854408778 learned_addr learned my addr 172.21.15.8:0/3854408778 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:33.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca76125700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca70060310 0x7fca70108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca75924700 1 -- 172.21.15.8:0/3854408778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca70060310 msgr2=0x7fca70108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca75924700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca70060310 0x7fca70108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca75924700 1 -- 172.21.15.8:0/3854408778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c005040 con 0x7fca700f9690 2023-10-18T22:16:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.169+0000 7fca75924700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca700f9690 0x7fca70109460 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7fca600093f0 tx=0x7fca60006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.170+0000 7fca66ffd700 1 -- 172.21.15.8:0/3854408778 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca60013640 con 0x7fca700f9690 2023-10-18T22:16:33.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.170+0000 7fca66ffd700 1 -- 172.21.15.8:0/3854408778 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fca60013c60 con 0x7fca700f9690 2023-10-18T22:16:33.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.170+0000 7fca77127700 1 -- 172.21.15.8:0/3854408778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7010a630 con 0x7fca700f9690 2023-10-18T22:16:33.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.170+0000 7fca66ffd700 1 -- 172.21.15.8:0/3854408778 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca60012ce0 con 0x7fca700f9690 2023-10-18T22:16:33.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.170+0000 7fca77127700 1 -- 172.21.15.8:0/3854408778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7010abf0 con 0x7fca700f9690 2023-10-18T22:16:33.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.171+0000 7fca77127700 1 -- 172.21.15.8:0/3854408778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca70059100 con 0x7fca700f9690 2023-10-18T22:16:33.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.172+0000 7fca66ffd700 1 -- 172.21.15.8:0/3854408778 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fca6001a060 con 0x7fca700f9690 2023-10-18T22:16:33.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.173+0000 7fca66ffd700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca5c060f70 0x7fca5c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:33.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.173+0000 7fca66ffd700 1 -- 172.21.15.8:0/3854408778 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fca6007c970 con 0x7fca700f9690 2023-10-18T22:16:33.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.173+0000 7fca76125700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca5c060f70 0x7fca5c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:33.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.173+0000 7fca76125700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca5c060f70 0x7fca5c063430 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fca6c004630 tx=0x7fca6c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.177+0000 7fca66ffd700 1 -- 172.21.15.8:0/3854408778 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fca6004fef0 con 0x7fca700f9690 2023-10-18T22:16:33.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.376+0000 7fca77127700 1 -- 172.21.15.8:0/3854408778 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca700f5650 con 0x7fca5c060f70 2023-10-18T22:16:33.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.377+0000 7fca66ffd700 1 -- 172.21.15.8:0/3854408778 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fca700f5650 con 0x7fca5c060f70 2023-10-18T22:16:33.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 -- 172.21.15.8:0/3854408778 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca5c060f70 msgr2=0x7fca5c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca5c060f70 0x7fca5c063430 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fca6c004630 tx=0x7fca6c009b30).stop 2023-10-18T22:16:33.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 -- 172.21.15.8:0/3854408778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca700f9690 msgr2=0x7fca70109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca700f9690 0x7fca70109460 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7fca600093f0 tx=0x7fca60006ec0).stop 2023-10-18T22:16:33.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 -- 172.21.15.8:0/3854408778 shutdown_connections 2023-10-18T22:16:33.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca5c060f70 0x7fca5c063430 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca70060310 0x7fca70108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 --2- 172.21.15.8:0/3854408778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca700f9690 0x7fca70109460 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 -- 172.21.15.8:0/3854408778 >> 172.21.15.8:0/3854408778 conn(0x7fca700f0b90 msgr2=0x7fca700f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:33.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 -- 172.21.15.8:0/3854408778 shutdown_connections 2023-10-18T22:16:33.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.379+0000 7fca77127700 1 -- 172.21.15.8:0/3854408778 wait complete. 2023-10-18T22:16:33.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.516+0000 7fcd0f59e700 1 -- 172.21.15.8:0/152614638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd100f6530 msgr2=0x7fcd100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.516+0000 7fcd0f59e700 1 --2- 172.21.15.8:0/152614638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd100f6530 0x7fcd100f6950 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7fcd00004660 tx=0x7fcd00009b30).stop 2023-10-18T22:16:33.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.516+0000 7fcd0f59e700 1 -- 172.21.15.8:0/152614638 shutdown_connections 2023-10-18T22:16:33.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.516+0000 7fcd0f59e700 1 --2- 172.21.15.8:0/152614638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd100f77d0 0x7fcd100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.516+0000 7fcd0f59e700 1 --2- 172.21.15.8:0/152614638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd100f6530 0x7fcd100f6950 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.516+0000 7fcd0f59e700 1 -- 172.21.15.8:0/152614638 >> 172.21.15.8:0/152614638 conn(0x7fcd100f1c90 msgr2=0x7fcd100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:33.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.517+0000 7fcd0f59e700 1 -- 172.21.15.8:0/152614638 shutdown_connections 2023-10-18T22:16:33.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.517+0000 7fcd0f59e700 1 -- 172.21.15.8:0/152614638 wait complete. 2023-10-18T22:16:33.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.517+0000 7fcd0f59e700 1 Processor -- start 2023-10-18T22:16:33.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.518+0000 7fcd0f59e700 1 -- start start 2023-10-18T22:16:33.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.518+0000 7fcd0f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd100f6530 0x7fcd10108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:33.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.518+0000 7fcd0f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd100f77d0 0x7fcd101094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:33.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.518+0000 7fcd0f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd10109a50 con 0x7fcd100f6530 2023-10-18T22:16:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.518+0000 7fcd0f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd10109b90 con 0x7fcd100f77d0 2023-10-18T22:16:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.518+0000 7fcd0e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd100f6530 0x7fcd10108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.518+0000 7fcd0e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd100f6530 0x7fcd10108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59440/0 (socket says 172.21.15.8:59440) 2023-10-18T22:16:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.518+0000 7fcd0e59c700 1 -- 172.21.15.8:0/2066014658 learned_addr learned my addr 172.21.15.8:0/2066014658 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:33.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.518+0000 7fcd0dd9b700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd100f77d0 0x7fcd101094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:33.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.519+0000 7fcd0e59c700 1 -- 172.21.15.8:0/2066014658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd100f77d0 msgr2=0x7fcd101094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.519+0000 7fcd0e59c700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd100f77d0 0x7fcd101094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.519+0000 7fcd0e59c700 1 -- 172.21.15.8:0/2066014658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00005040 con 0x7fcd100f6530 2023-10-18T22:16:33.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.519+0000 7fcd0e59c700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd100f6530 0x7fcd10108fb0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7fcd00007a60 tx=0x7fcd00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:33.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.519+0000 7fccfeffd700 1 -- 172.21.15.8:0/2066014658 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd00018070 con 0x7fcd100f6530 2023-10-18T22:16:33.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.519+0000 7fccfeffd700 1 -- 172.21.15.8:0/2066014658 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcd00009630 con 0x7fcd100f6530 2023-10-18T22:16:33.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.519+0000 7fcd0f59e700 1 -- 172.21.15.8:0/2066014658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1010a4d0 con 0x7fcd100f6530 2023-10-18T22:16:33.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.519+0000 7fccfeffd700 1 -- 172.21.15.8:0/2066014658 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd0001c540 con 0x7fcd100f6530 2023-10-18T22:16:33.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.519+0000 7fcd0f59e700 1 -- 172.21.15.8:0/2066014658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1010aa30 con 0x7fcd100f6530 2023-10-18T22:16:33.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.520+0000 7fcd0f59e700 1 -- 172.21.15.8:0/2066014658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd10045ad0 con 0x7fcd100f6530 2023-10-18T22:16:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.521+0000 7fccfeffd700 1 -- 172.21.15.8:0/2066014658 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcd0001c7b0 con 0x7fcd100f6530 2023-10-18T22:16:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.522+0000 7fccfeffd700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccf8060f70 0x7fccf8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.522+0000 7fccfeffd700 1 -- 172.21.15.8:0/2066014658 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcd0007e750 con 0x7fcd100f6530 2023-10-18T22:16:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.522+0000 7fcd0dd9b700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccf8060f70 0x7fccf8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.523+0000 7fcd0dd9b700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccf8060f70 0x7fccf8063430 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fcd040096c0 tx=0x7fcd04009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:33.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.526+0000 7fccfeffd700 1 -- 172.21.15.8:0/2066014658 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcd00051d30 con 0x7fcd100f6530 2023-10-18T22:16:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:31.706166+0000 mgr.smithi008.flmjzp (mgr.14640) 4655 : cluster [DBG] pgmap v3195: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:33.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.721+0000 7fcd0f59e700 1 -- 172.21.15.8:0/2066014658 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd100fee00 con 0x7fccf8060f70 2023-10-18T22:16:33.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.731+0000 7fccfeffd700 1 -- 172.21.15.8:0/2066014658 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcd100fee00 con 0x7fccf8060f70 2023-10-18T22:16:33.732 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:16:33.732 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (83m) 18s ago 84m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:16:33.732 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (77m) 18s ago 84m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:16:33.733 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (77m) 8m ago 83m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:16:33.733 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (83m) 18s ago 84m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:16:33.733 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 18s ago 80m - - 2023-10-18T22:16:33.733 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 18s ago 80m - - 2023-10-18T22:16:33.733 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 80m - - 2023-10-18T22:16:33.734 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 80m - - 2023-10-18T22:16:33.734 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (78m) 18s ago 86m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:16:33.734 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (77m) 8m ago 83m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:16:33.734 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (77m) 18s ago 86m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:16:33.734 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (77m) 8m ago 83m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:16:33.735 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (84m) 18s ago 84m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:16:33.735 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (83m) 8m ago 83m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:16:33.735 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (76m) 18s ago 83m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:16:33.735 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (74m) 18s ago 82m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:16:33.735 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (74m) 18s ago 82m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:16:33.735 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (73m) 8m ago 82m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:16:33.736 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (73m) 8m ago 82m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:16:33.736 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (72m) 8m ago 81m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:16:33.736 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (78m) 18s ago 83m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:16:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:31.706166+0000 mgr.smithi008.flmjzp (mgr.14640) 4655 : cluster [DBG] pgmap v3195: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:33.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 -- 172.21.15.8:0/2066014658 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccf8060f70 msgr2=0x7fccf8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccf8060f70 0x7fccf8063430 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fcd040096c0 tx=0x7fcd04009be0).stop 2023-10-18T22:16:33.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 -- 172.21.15.8:0/2066014658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd100f6530 msgr2=0x7fcd10108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd100f6530 0x7fcd10108fb0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7fcd00007a60 tx=0x7fcd00009b30).stop 2023-10-18T22:16:33.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 -- 172.21.15.8:0/2066014658 shutdown_connections 2023-10-18T22:16:33.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fccf8060f70 0x7fccf8063430 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd100f6530 0x7fcd10108fb0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 --2- 172.21.15.8:0/2066014658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd100f77d0 0x7fcd101094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 -- 172.21.15.8:0/2066014658 >> 172.21.15.8:0/2066014658 conn(0x7fcd100f1c90 msgr2=0x7fcd1006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 -- 172.21.15.8:0/2066014658 shutdown_connections 2023-10-18T22:16:33.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.733+0000 7fcd0f59e700 1 -- 172.21.15.8:0/2066014658 wait complete. 2023-10-18T22:16:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.870+0000 7efde71c7700 1 -- 172.21.15.8:0/2894706247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efde00f77d0 msgr2=0x7efde00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.870+0000 7efde71c7700 1 --2- 172.21.15.8:0/2894706247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efde00f77d0 0x7efde00f7c30 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7efdd0004660 tx=0x7efdd0009b30).stop 2023-10-18T22:16:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.870+0000 7efde71c7700 1 -- 172.21.15.8:0/2894706247 shutdown_connections 2023-10-18T22:16:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.870+0000 7efde71c7700 1 --2- 172.21.15.8:0/2894706247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efde00f77d0 0x7efde00f7c30 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.870+0000 7efde71c7700 1 --2- 172.21.15.8:0/2894706247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde00f6530 0x7efde00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.870+0000 7efde71c7700 1 -- 172.21.15.8:0/2894706247 >> 172.21.15.8:0/2894706247 conn(0x7efde00f1c90 msgr2=0x7efde00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.870+0000 7efde71c7700 1 -- 172.21.15.8:0/2894706247 shutdown_connections 2023-10-18T22:16:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.870+0000 7efde71c7700 1 -- 172.21.15.8:0/2894706247 wait complete. 2023-10-18T22:16:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.871+0000 7efde71c7700 1 Processor -- start 2023-10-18T22:16:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.871+0000 7efde71c7700 1 -- start start 2023-10-18T22:16:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.871+0000 7efde71c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde00f6530 0x7efde0108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.871+0000 7efde71c7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efde00f77d0 0x7efde01093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.871+0000 7efde71c7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0109990 con 0x7efde00f77d0 2023-10-18T22:16:33.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.871+0000 7efde71c7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0109ad0 con 0x7efde00f6530 2023-10-18T22:16:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.872+0000 7efde59c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efde00f77d0 0x7efde01093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.872+0000 7efde59c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efde00f77d0 0x7efde01093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59462/0 (socket says 172.21.15.8:59462) 2023-10-18T22:16:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.872+0000 7efde59c4700 1 -- 172.21.15.8:0/1016830826 learned_addr learned my addr 172.21.15.8:0/1016830826 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.872+0000 7efde61c5700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde00f6530 0x7efde0108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.872+0000 7efde59c4700 1 -- 172.21.15.8:0/1016830826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde00f6530 msgr2=0x7efde0108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.872+0000 7efde59c4700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde00f6530 0x7efde0108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.872+0000 7efde59c4700 1 -- 172.21.15.8:0/1016830826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0005040 con 0x7efde00f77d0 2023-10-18T22:16:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.872+0000 7efde59c4700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efde00f77d0 0x7efde01093e0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7efdd0004d80 tx=0x7efdd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.873+0000 7efdd6ffd700 1 -- 172.21.15.8:0/1016830826 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdd0019070 con 0x7efde00f77d0 2023-10-18T22:16:33.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.873+0000 7efdd6ffd700 1 -- 172.21.15.8:0/1016830826 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efdd001e420 con 0x7efde00f77d0 2023-10-18T22:16:33.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.873+0000 7efde71c7700 1 -- 172.21.15.8:0/1016830826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde010a410 con 0x7efde00f77d0 2023-10-18T22:16:33.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.873+0000 7efdd6ffd700 1 -- 172.21.15.8:0/1016830826 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdd0014680 con 0x7efde00f77d0 2023-10-18T22:16:33.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.873+0000 7efde71c7700 1 -- 172.21.15.8:0/1016830826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde010a8f0 con 0x7efde00f77d0 2023-10-18T22:16:33.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.874+0000 7efde71c7700 1 -- 172.21.15.8:0/1016830826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde0045ad0 con 0x7efde00f77d0 2023-10-18T22:16:33.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.875+0000 7efdd6ffd700 1 -- 172.21.15.8:0/1016830826 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7efdd001e9c0 con 0x7efde00f77d0 2023-10-18T22:16:33.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.875+0000 7efdd6ffd700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdcc060f70 0x7efdcc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:33.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.876+0000 7efdd6ffd700 1 -- 172.21.15.8:0/1016830826 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7efdd007dde0 con 0x7efde00f77d0 2023-10-18T22:16:33.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.876+0000 7efde61c5700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdcc060f70 0x7efdcc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:33.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.876+0000 7efde61c5700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdcc060f70 0x7efdcc063430 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7efde00f7630 tx=0x7efddc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:33.880+0000 7efdd6ffd700 1 -- 172.21.15.8:0/1016830826 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efdd0051440 con 0x7efde00f77d0 2023-10-18T22:16:34.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.131+0000 7efde71c7700 1 -- 172.21.15.8:0/1016830826 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efde0100fb0 con 0x7efde00f77d0 2023-10-18T22:16:34.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.132+0000 7efdd6ffd700 1 -- 172.21.15.8:0/1016830826 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7efdd0051030 con 0x7efde00f77d0 2023-10-18T22:16:34.133 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:16:34.133 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:16:34.134 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:16:34.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:16:34.134 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:16:34.134 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:16:34.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:16:34.135 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:16:34.135 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:16:34.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:16:34.137 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:16:34.137 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:16:34.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:16:34.137 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:16:34.138 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:16:34.138 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:16:34.138 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:16:34.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 -- 172.21.15.8:0/1016830826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdcc060f70 msgr2=0x7efdcc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:34.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdcc060f70 0x7efdcc063430 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7efde00f7630 tx=0x7efddc00b040).stop 2023-10-18T22:16:34.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 -- 172.21.15.8:0/1016830826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efde00f77d0 msgr2=0x7efde01093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:34.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efde00f77d0 0x7efde01093e0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7efdd0004d80 tx=0x7efdd000b040).stop 2023-10-18T22:16:34.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 -- 172.21.15.8:0/1016830826 shutdown_connections 2023-10-18T22:16:34.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efdcc060f70 0x7efdcc063430 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde00f6530 0x7efde0108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 --2- 172.21.15.8:0/1016830826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efde00f77d0 0x7efde01093e0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 -- 172.21.15.8:0/1016830826 >> 172.21.15.8:0/1016830826 conn(0x7efde00f1c90 msgr2=0x7efde00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:34.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 -- 172.21.15.8:0/1016830826 shutdown_connections 2023-10-18T22:16:34.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.134+0000 7efde71c7700 1 -- 172.21.15.8:0/1016830826 wait complete. 2023-10-18T22:16:34.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.271+0000 7ff0df230700 1 -- 172.21.15.8:0/1489237847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 msgr2=0x7ff0d80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:34.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.271+0000 7ff0df230700 1 --2- 172.21.15.8:0/1489237847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d80f6950 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7ff0d4004660 tx=0x7ff0d4009b30).stop 2023-10-18T22:16:34.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.271+0000 7ff0df230700 1 -- 172.21.15.8:0/1489237847 shutdown_connections 2023-10-18T22:16:34.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.271+0000 7ff0df230700 1 --2- 172.21.15.8:0/1489237847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 0x7ff0d80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.271+0000 7ff0df230700 1 --2- 172.21.15.8:0/1489237847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d80f6950 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.271+0000 7ff0df230700 1 -- 172.21.15.8:0/1489237847 >> 172.21.15.8:0/1489237847 conn(0x7ff0d80f1c90 msgr2=0x7ff0d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:34.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.271+0000 7ff0df230700 1 -- 172.21.15.8:0/1489237847 shutdown_connections 2023-10-18T22:16:34.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.271+0000 7ff0df230700 1 -- 172.21.15.8:0/1489237847 wait complete. 2023-10-18T22:16:34.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.272+0000 7ff0df230700 1 Processor -- start 2023-10-18T22:16:34.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.272+0000 7ff0df230700 1 -- start start 2023-10-18T22:16:34.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.273+0000 7ff0df230700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:34.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.273+0000 7ff0df230700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 0x7ff0d8107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.273+0000 7ff0df230700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8107910 con 0x7ff0d80f6530 2023-10-18T22:16:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.273+0000 7ff0df230700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8108120 con 0x7ff0d80f77d0 2023-10-18T22:16:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.273+0000 7ff0de22e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.273+0000 7ff0de22e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59490/0 (socket says 172.21.15.8:59490) 2023-10-18T22:16:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.273+0000 7ff0de22e700 1 -- 172.21.15.8:0/1447061818 learned_addr learned my addr 172.21.15.8:0/1447061818 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:34.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.273+0000 7ff0dda2d700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 0x7ff0d8107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.274+0000 7ff0de22e700 1 -- 172.21.15.8:0/1447061818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 msgr2=0x7ff0d8107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.274+0000 7ff0de22e700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 0x7ff0d8107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.274+0000 7ff0de22e700 1 -- 172.21.15.8:0/1447061818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4005040 con 0x7ff0d80f6530 2023-10-18T22:16:34.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.274+0000 7ff0de22e700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8106e20 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7ff0d4004e30 tx=0x7ff0d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:34.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.274+0000 7ff0ceffd700 1 -- 172.21.15.8:0/1447061818 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0d4018070 con 0x7ff0d80f6530 2023-10-18T22:16:34.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.274+0000 7ff0ceffd700 1 -- 172.21.15.8:0/1447061818 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff0d4009630 con 0x7ff0d80f6530 2023-10-18T22:16:34.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.274+0000 7ff0df230700 1 -- 172.21.15.8:0/1447061818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d8108340 con 0x7ff0d80f6530 2023-10-18T22:16:34.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.274+0000 7ff0ceffd700 1 -- 172.21.15.8:0/1447061818 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0d401c3c0 con 0x7ff0d80f6530 2023-10-18T22:16:34.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.274+0000 7ff0df230700 1 -- 172.21.15.8:0/1447061818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d81088a0 con 0x7ff0d80f6530 2023-10-18T22:16:34.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.275+0000 7ff0df230700 1 -- 172.21.15.8:0/1447061818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8059100 con 0x7ff0d80f6530 2023-10-18T22:16:34.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.276+0000 7ff0ceffd700 1 -- 172.21.15.8:0/1447061818 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff0d401d420 con 0x7ff0d80f6530 2023-10-18T22:16:34.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.277+0000 7ff0ceffd700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c4060f70 0x7ff0c4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:34.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.277+0000 7ff0ceffd700 1 -- 172.21.15.8:0/1447061818 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff0d407e6b0 con 0x7ff0d80f6530 2023-10-18T22:16:34.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.277+0000 7ff0dda2d700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c4060f70 0x7ff0c4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:34.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.278+0000 7ff0dda2d700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c4060f70 0x7ff0c4063430 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7ff0c80096c0 tx=0x7ff0c8009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.281+0000 7ff0ceffd700 1 -- 172.21.15.8:0/1447061818 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff0d404e310 con 0x7ff0d80f6530 2023-10-18T22:16:34.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.507+0000 7ff0df230700 1 -- 172.21.15.8:0/1447061818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff0d80fed60 con 0x7ff0d80f6530 2023-10-18T22:16:34.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.508+0000 7ff0ceffd700 1 -- 172.21.15.8:0/1447061818 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7ff0d4051930 con 0x7ff0d80f6530 2023-10-18T22:16:34.509 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:16:34.510 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:16:34.510 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:16:34.510 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:16:34.510 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:16:34.511 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:16:34.511 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:16:34.511 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:16:34.511 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:16:34.511 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:16:34.512 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:16:34.512 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:16:34.512 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:16:34.512 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:16:34.512 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:16:34.513 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:16:34.513 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:16:34.513 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:16:34.513 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:16:34.513 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:16:34.514 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:16:34.514 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:16:34.514 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:16:34.514 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:16:34.514 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:16:34.515 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:16:34.515 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:16:34.515 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:16:34.515 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:16:34.515 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:16:34.516 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:16:34.516 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:16:34.516 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:16:34.516 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:16:34.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 -- 172.21.15.8:0/1447061818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c4060f70 msgr2=0x7ff0c4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:34.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c4060f70 0x7ff0c4063430 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7ff0c80096c0 tx=0x7ff0c8009be0).stop 2023-10-18T22:16:34.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 -- 172.21.15.8:0/1447061818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 msgr2=0x7ff0d8106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:34.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8106e20 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7ff0d4004e30 tx=0x7ff0d4009b30).stop 2023-10-18T22:16:34.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 -- 172.21.15.8:0/1447061818 shutdown_connections 2023-10-18T22:16:34.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0c4060f70 0x7ff0c4063430 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80f6530 0x7ff0d8106e20 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 --2- 172.21.15.8:0/1447061818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d80f77d0 0x7ff0d8107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 -- 172.21.15.8:0/1447061818 >> 172.21.15.8:0/1447061818 conn(0x7ff0d80f1c90 msgr2=0x7ff0d80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:34.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 -- 172.21.15.8:0/1447061818 shutdown_connections 2023-10-18T22:16:34.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.510+0000 7ff0df230700 1 -- 172.21.15.8:0/1447061818 wait complete. 2023-10-18T22:16:34.519 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:16:34.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.648+0000 7f53d2e41700 1 -- 172.21.15.8:0/3109058697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53cc0f6530 msgr2=0x7f53cc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:34.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.648+0000 7f53d2e41700 1 --2- 172.21.15.8:0/3109058697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53cc0f6530 0x7f53cc0f6950 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f53c8004660 tx=0x7f53c8009b30).stop 2023-10-18T22:16:34.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.648+0000 7f53d2e41700 1 -- 172.21.15.8:0/3109058697 shutdown_connections 2023-10-18T22:16:34.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.648+0000 7f53d2e41700 1 --2- 172.21.15.8:0/3109058697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc0f77d0 0x7f53cc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.648+0000 7f53d2e41700 1 --2- 172.21.15.8:0/3109058697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53cc0f6530 0x7f53cc0f6950 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.648+0000 7f53d2e41700 1 -- 172.21.15.8:0/3109058697 >> 172.21.15.8:0/3109058697 conn(0x7f53cc0f1c90 msgr2=0x7f53cc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:34.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.648+0000 7f53d2e41700 1 -- 172.21.15.8:0/3109058697 shutdown_connections 2023-10-18T22:16:34.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.648+0000 7f53d2e41700 1 -- 172.21.15.8:0/3109058697 wait complete. 2023-10-18T22:16:34.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.649+0000 7f53d2e41700 1 Processor -- start 2023-10-18T22:16:34.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.649+0000 7f53d2e41700 1 -- start start 2023-10-18T22:16:34.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.649+0000 7f53d2e41700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc0f6530 0x7f53cc108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:34.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.649+0000 7f53d2e41700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53cc0f77d0 0x7f53cc1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:34.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.649+0000 7f53d2e41700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc109a70 con 0x7f53cc0f77d0 2023-10-18T22:16:34.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.649+0000 7f53d2e41700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc109bb0 con 0x7f53cc0f6530 2023-10-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.650+0000 7f53d163e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53cc0f77d0 0x7f53cc1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.650+0000 7f53d163e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53cc0f77d0 0x7f53cc1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59496/0 (socket says 172.21.15.8:59496) 2023-10-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.650+0000 7f53d163e700 1 -- 172.21.15.8:0/4053233687 learned_addr learned my addr 172.21.15.8:0/4053233687 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.650+0000 7f53d1e3f700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc0f6530 0x7f53cc108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.650+0000 7f53d163e700 1 -- 172.21.15.8:0/4053233687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc0f6530 msgr2=0x7f53cc108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.650+0000 7f53d163e700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc0f6530 0x7f53cc108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.650+0000 7f53d163e700 1 -- 172.21.15.8:0/4053233687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8005040 con 0x7f53cc0f77d0 2023-10-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.650+0000 7f53d163e700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53cc0f77d0 0x7f53cc1094c0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f53bc0026d0 tx=0x7f53bc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.651+0000 7f53c27fc700 1 -- 172.21.15.8:0/4053233687 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53bc0079c0 con 0x7f53cc0f77d0 2023-10-18T22:16:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.651+0000 7f53c27fc700 1 -- 172.21.15.8:0/4053233687 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f53bc00f040 con 0x7f53cc0f77d0 2023-10-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.651+0000 7f53d2e41700 1 -- 172.21.15.8:0/4053233687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc10a550 con 0x7f53cc0f77d0 2023-10-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.651+0000 7f53c27fc700 1 -- 172.21.15.8:0/4053233687 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53bc014980 con 0x7f53cc0f77d0 2023-10-18T22:16:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.651+0000 7f53d2e41700 1 -- 172.21.15.8:0/4053233687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc10ab10 con 0x7f53cc0f77d0 2023-10-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.652+0000 7f53d2e41700 1 -- 172.21.15.8:0/4053233687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc045ad0 con 0x7f53cc0f77d0 2023-10-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.653+0000 7f53c27fc700 1 -- 172.21.15.8:0/4053233687 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f53bc0090d0 con 0x7f53cc0f77d0 2023-10-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.654+0000 7f53c27fc700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53b8060f70 0x7f53b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:16:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.654+0000 7f53c27fc700 1 -- 172.21.15.8:0/4053233687 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f53bc07cb90 con 0x7f53cc0f77d0 2023-10-18T22:16:34.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.654+0000 7f53d1e3f700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53b8060f70 0x7f53b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:16:34.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.654+0000 7f53d1e3f700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53b8060f70 0x7f53b8063430 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f53c8004630 tx=0x7f53c8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:16:34.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.658+0000 7f53c27fc700 1 -- 172.21.15.8:0/4053233687 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f53bc0502b0 con 0x7f53cc0f77d0 2023-10-18T22:16:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:33.027327+0000 mgr.smithi008.flmjzp (mgr.14640) 4656 : audit [DBG] from='client.37744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:33.377356+0000 mgr.smithi008.flmjzp (mgr.14640) 4657 : audit [DBG] from='client.37748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:34.132223+0000 mon.smithi008 (mon.0) 4940 : audit [DBG] from='client.? 172.21.15.8:0/1016830826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:33.027327+0000 mgr.smithi008.flmjzp (mgr.14640) 4656 : audit [DBG] from='client.37744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:33.377356+0000 mgr.smithi008.flmjzp (mgr.14640) 4657 : audit [DBG] from='client.37748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:34.132223+0000 mon.smithi008 (mon.0) 4940 : audit [DBG] from='client.? 172.21.15.8:0/1016830826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:34.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.858+0000 7f53d2e41700 1 -- 172.21.15.8:0/4053233687 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53cc10ade0 con 0x7f53b8060f70 2023-10-18T22:16:34.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.860+0000 7f53c27fc700 1 -- 172.21.15.8:0/4053233687 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f53cc10ade0 con 0x7f53b8060f70 2023-10-18T22:16:34.861 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:16:34.861 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:16:34.861 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:16:34.862 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:16:34.862 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:16:34.862 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:16:34.862 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:16:34.862 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:16:34.863 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:16:34.863 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:16:34.863 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:16:34.863 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:16:34.863 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:16:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:16:34.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 -- 172.21.15.8:0/4053233687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53b8060f70 msgr2=0x7f53b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53b8060f70 0x7f53b8063430 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f53c8004630 tx=0x7f53c8009b30).stop 2023-10-18T22:16:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 -- 172.21.15.8:0/4053233687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53cc0f77d0 msgr2=0x7f53cc1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:16:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53cc0f77d0 0x7f53cc1094c0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f53bc0026d0 tx=0x7f53bc009de0).stop 2023-10-18T22:16:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 -- 172.21.15.8:0/4053233687 shutdown_connections 2023-10-18T22:16:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53b8060f70 0x7f53b8063430 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc0f6530 0x7f53cc108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 --2- 172.21.15.8:0/4053233687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53cc0f77d0 0x7f53cc1094c0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:16:34.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 -- 172.21.15.8:0/4053233687 >> 172.21.15.8:0/4053233687 conn(0x7f53cc0f1c90 msgr2=0x7f53cc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:16:34.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 -- 172.21.15.8:0/4053233687 shutdown_connections 2023-10-18T22:16:34.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:16:34.862+0000 7f53d2e41700 1 -- 172.21.15.8:0/4053233687 wait complete. 2023-10-18T22:16:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:33.706762+0000 mgr.smithi008.flmjzp (mgr.14640) 4658 : cluster [DBG] pgmap v3196: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:33.722785+0000 mgr.smithi008.flmjzp (mgr.14640) 4659 : audit [DBG] from='client.37752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:34.508433+0000 mon.smithi008 (mon.0) 4941 : audit [DBG] from='client.? 172.21.15.8:0/1447061818' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:16:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:33.706762+0000 mgr.smithi008.flmjzp (mgr.14640) 4658 : cluster [DBG] pgmap v3196: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:33.722785+0000 mgr.smithi008.flmjzp (mgr.14640) 4659 : audit [DBG] from='client.37752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:34.508433+0000 mon.smithi008 (mon.0) 4941 : audit [DBG] from='client.? 172.21.15.8:0/1447061818' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:16:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:34.860131+0000 mgr.smithi008.flmjzp (mgr.14640) 4660 : audit [DBG] from='client.37764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:35.736317+0000 mon.smithi008 (mon.0) 4942 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:35.738465+0000 mon.smithi008 (mon.0) 4943 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:36.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:35.739553+0000 mon.smithi008 (mon.0) 4944 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:35.746206+0000 mon.smithi008 (mon.0) 4945 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:35.752708+0000 mon.smithi008 (mon.0) 4946 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:35.755829+0000 mon.smithi008 (mon.0) 4947 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:35.757698+0000 mon.smithi008 (mon.0) 4948 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:36.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:35.759294+0000 mon.smithi008 (mon.0) 4949 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:36.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:35.761319+0000 mon.smithi008 (mon.0) 4950 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:34.860131+0000 mgr.smithi008.flmjzp (mgr.14640) 4660 : audit [DBG] from='client.37764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:16:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:35.736317+0000 mon.smithi008 (mon.0) 4942 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:35.738465+0000 mon.smithi008 (mon.0) 4943 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:35.739553+0000 mon.smithi008 (mon.0) 4944 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:35.746206+0000 mon.smithi008 (mon.0) 4945 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:35.752708+0000 mon.smithi008 (mon.0) 4946 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:35.755829+0000 mon.smithi008 (mon.0) 4947 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:35.757698+0000 mon.smithi008 (mon.0) 4948 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:36.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:35.759294+0000 mon.smithi008 (mon.0) 4949 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:36.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:35.761319+0000 mon.smithi008 (mon.0) 4950 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:35.707364+0000 mgr.smithi008.flmjzp (mgr.14640) 4661 : cluster [DBG] pgmap v3197: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:35.740567+0000 mgr.smithi008.flmjzp (mgr.14640) 4662 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:35.741136+0000 mgr.smithi008.flmjzp (mgr.14640) 4663 : cluster [DBG] pgmap v3198: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:35.741467+0000 mgr.smithi008.flmjzp (mgr.14640) 4664 : cluster [DBG] pgmap v3199: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:35.763250+0000 mgr.smithi008.flmjzp (mgr.14640) 4665 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:35.707364+0000 mgr.smithi008.flmjzp (mgr.14640) 4661 : cluster [DBG] pgmap v3197: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:35.740567+0000 mgr.smithi008.flmjzp (mgr.14640) 4662 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:35.741136+0000 mgr.smithi008.flmjzp (mgr.14640) 4663 : cluster [DBG] pgmap v3198: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:35.741467+0000 mgr.smithi008.flmjzp (mgr.14640) 4664 : cluster [DBG] pgmap v3199: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:35.763250+0000 mgr.smithi008.flmjzp (mgr.14640) 4665 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:37.742051+0000 mgr.smithi008.flmjzp (mgr.14640) 4666 : cluster [DBG] pgmap v3200: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:39.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:37.742051+0000 mgr.smithi008.flmjzp (mgr.14640) 4666 : cluster [DBG] pgmap v3200: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:39.742642+0000 mgr.smithi008.flmjzp (mgr.14640) 4667 : cluster [DBG] pgmap v3201: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:39.742642+0000 mgr.smithi008.flmjzp (mgr.14640) 4667 : cluster [DBG] pgmap v3201: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:41.743250+0000 mgr.smithi008.flmjzp (mgr.14640) 4668 : cluster [DBG] pgmap v3202: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:41.743250+0000 mgr.smithi008.flmjzp (mgr.14640) 4668 : cluster [DBG] pgmap v3202: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:43.743866+0000 mgr.smithi008.flmjzp (mgr.14640) 4669 : cluster [DBG] pgmap v3203: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:43.743866+0000 mgr.smithi008.flmjzp (mgr.14640) 4669 : cluster [DBG] pgmap v3203: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:45.766934+0000 mon.smithi008 (mon.0) 4951 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:45.769069+0000 mon.smithi008 (mon.0) 4952 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:45.770106+0000 mon.smithi008 (mon.0) 4953 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:45.776848+0000 mon.smithi008 (mon.0) 4954 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:46.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:45.783466+0000 mon.smithi008 (mon.0) 4955 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:45.786585+0000 mon.smithi008 (mon.0) 4956 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:45.788350+0000 mon.smithi008 (mon.0) 4957 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:45.790109+0000 mon.smithi008 (mon.0) 4958 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:46.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:45.792155+0000 mon.smithi008 (mon.0) 4959 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:45.766934+0000 mon.smithi008 (mon.0) 4951 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:45.769069+0000 mon.smithi008 (mon.0) 4952 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:45.770106+0000 mon.smithi008 (mon.0) 4953 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:45.776848+0000 mon.smithi008 (mon.0) 4954 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:45.783466+0000 mon.smithi008 (mon.0) 4955 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:45.786585+0000 mon.smithi008 (mon.0) 4956 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:45.788350+0000 mon.smithi008 (mon.0) 4957 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:45.790109+0000 mon.smithi008 (mon.0) 4958 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:46.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:45.792155+0000 mon.smithi008 (mon.0) 4959 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:45.744579+0000 mgr.smithi008.flmjzp (mgr.14640) 4670 : cluster [DBG] pgmap v3204: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:45.771005+0000 mgr.smithi008.flmjzp (mgr.14640) 4671 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:45.771558+0000 mgr.smithi008.flmjzp (mgr.14640) 4672 : cluster [DBG] pgmap v3205: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:45.771874+0000 mgr.smithi008.flmjzp (mgr.14640) 4673 : cluster [DBG] pgmap v3206: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:45.794129+0000 mgr.smithi008.flmjzp (mgr.14640) 4674 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:47.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:45.744579+0000 mgr.smithi008.flmjzp (mgr.14640) 4670 : cluster [DBG] pgmap v3204: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:45.771005+0000 mgr.smithi008.flmjzp (mgr.14640) 4671 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:45.771558+0000 mgr.smithi008.flmjzp (mgr.14640) 4672 : cluster [DBG] pgmap v3205: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:45.771874+0000 mgr.smithi008.flmjzp (mgr.14640) 4673 : cluster [DBG] pgmap v3206: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:45.794129+0000 mgr.smithi008.flmjzp (mgr.14640) 4674 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:47.772425+0000 mgr.smithi008.flmjzp (mgr.14640) 4675 : cluster [DBG] pgmap v3207: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:47.772425+0000 mgr.smithi008.flmjzp (mgr.14640) 4675 : cluster [DBG] pgmap v3207: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:49.772960+0000 mgr.smithi008.flmjzp (mgr.14640) 4676 : cluster [DBG] pgmap v3208: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:49.772960+0000 mgr.smithi008.flmjzp (mgr.14640) 4676 : cluster [DBG] pgmap v3208: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:51.773631+0000 mgr.smithi008.flmjzp (mgr.14640) 4677 : cluster [DBG] pgmap v3209: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:51.773631+0000 mgr.smithi008.flmjzp (mgr.14640) 4677 : cluster [DBG] pgmap v3209: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:53.774311+0000 mgr.smithi008.flmjzp (mgr.14640) 4678 : cluster [DBG] pgmap v3210: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:53.774311+0000 mgr.smithi008.flmjzp (mgr.14640) 4678 : cluster [DBG] pgmap v3210: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:55.804196+0000 mon.smithi008 (mon.0) 4960 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:55.806315+0000 mon.smithi008 (mon.0) 4961 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:55.807328+0000 mon.smithi008 (mon.0) 4962 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:55.814112+0000 mon.smithi008 (mon.0) 4963 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:55.820807+0000 mon.smithi008 (mon.0) 4964 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:55.824157+0000 mon.smithi008 (mon.0) 4965 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:55.825900+0000 mon.smithi008 (mon.0) 4966 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:56.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:55.827577+0000 mon.smithi008 (mon.0) 4967 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:56.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:16:55.829617+0000 mon.smithi008 (mon.0) 4968 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:55.804196+0000 mon.smithi008 (mon.0) 4960 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:55.806315+0000 mon.smithi008 (mon.0) 4961 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:16:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:55.807328+0000 mon.smithi008 (mon.0) 4962 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:16:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:55.814112+0000 mon.smithi008 (mon.0) 4963 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:16:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:55.820807+0000 mon.smithi008 (mon.0) 4964 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:16:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:55.824157+0000 mon.smithi008 (mon.0) 4965 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:55.825900+0000 mon.smithi008 (mon.0) 4966 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:56.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:55.827577+0000 mon.smithi008 (mon.0) 4967 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:56.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:16:55.829617+0000 mon.smithi008 (mon.0) 4968 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:16:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:55.774851+0000 mgr.smithi008.flmjzp (mgr.14640) 4679 : cluster [DBG] pgmap v3211: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:55.808230+0000 mgr.smithi008.flmjzp (mgr.14640) 4680 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:55.808828+0000 mgr.smithi008.flmjzp (mgr.14640) 4681 : cluster [DBG] pgmap v3212: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:55.809240+0000 mgr.smithi008.flmjzp (mgr.14640) 4682 : cluster [DBG] pgmap v3213: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:16:55.831539+0000 mgr.smithi008.flmjzp (mgr.14640) 4683 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:55.774851+0000 mgr.smithi008.flmjzp (mgr.14640) 4679 : cluster [DBG] pgmap v3211: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:55.808230+0000 mgr.smithi008.flmjzp (mgr.14640) 4680 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:16:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:55.808828+0000 mgr.smithi008.flmjzp (mgr.14640) 4681 : cluster [DBG] pgmap v3212: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:55.809240+0000 mgr.smithi008.flmjzp (mgr.14640) 4682 : cluster [DBG] pgmap v3213: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:16:55.831539+0000 mgr.smithi008.flmjzp (mgr.14640) 4683 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:16:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:16:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:57.809833+0000 mgr.smithi008.flmjzp (mgr.14640) 4684 : cluster [DBG] pgmap v3214: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:16:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:16:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:57.809833+0000 mgr.smithi008.flmjzp (mgr.14640) 4684 : cluster [DBG] pgmap v3214: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:16:59.810616+0000 mgr.smithi008.flmjzp (mgr.14640) 4685 : cluster [DBG] pgmap v3215: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:16:59.810616+0000 mgr.smithi008.flmjzp (mgr.14640) 4685 : cluster [DBG] pgmap v3215: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:01.811347+0000 mgr.smithi008.flmjzp (mgr.14640) 4686 : cluster [DBG] pgmap v3216: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:01.811347+0000 mgr.smithi008.flmjzp (mgr.14640) 4686 : cluster [DBG] pgmap v3216: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:05.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.013+0000 7f5f721fe700 1 -- 172.21.15.8:0/548387199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f6c0f77d0 msgr2=0x7f5f6c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.013+0000 7f5f721fe700 1 --2- 172.21.15.8:0/548387199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f6c0f77d0 0x7f5f6c0f7c30 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f5f5c004660 tx=0x7f5f5c009b30).stop 2023-10-18T22:17:05.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.013+0000 7f5f721fe700 1 -- 172.21.15.8:0/548387199 shutdown_connections 2023-10-18T22:17:05.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.013+0000 7f5f721fe700 1 --2- 172.21.15.8:0/548387199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f6c0f77d0 0x7f5f6c0f7c30 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.013+0000 7f5f721fe700 1 --2- 172.21.15.8:0/548387199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f6c0f6530 0x7f5f6c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.013+0000 7f5f721fe700 1 -- 172.21.15.8:0/548387199 >> 172.21.15.8:0/548387199 conn(0x7f5f6c0f1c90 msgr2=0x7f5f6c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:05.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.013+0000 7f5f721fe700 1 -- 172.21.15.8:0/548387199 shutdown_connections 2023-10-18T22:17:05.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.013+0000 7f5f721fe700 1 -- 172.21.15.8:0/548387199 wait complete. 2023-10-18T22:17:05.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.014+0000 7f5f721fe700 1 Processor -- start 2023-10-18T22:17:05.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.014+0000 7f5f721fe700 1 -- start start 2023-10-18T22:17:05.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.015+0000 7f5f721fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f6c0f6530 0x7f5f6c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:05.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.015+0000 7f5f721fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f6c0f77d0 0x7f5f6c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:05.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.015+0000 7f5f721fe700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c109970 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.015+0000 7f5f721fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c109ab0 con 0x7f5f6c0f6530 2023-10-18T22:17:05.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.015+0000 7f5f709fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f6c0f77d0 0x7f5f6c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:05.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.015+0000 7f5f709fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f6c0f77d0 0x7f5f6c1093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35062/0 (socket says 172.21.15.8:35062) 2023-10-18T22:17:05.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.015+0000 7f5f709fb700 1 -- 172.21.15.8:0/3552785932 learned_addr learned my addr 172.21.15.8:0/3552785932 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:05.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.015+0000 7f5f711fc700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f6c0f6530 0x7f5f6c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:05.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.015+0000 7f5f709fb700 1 -- 172.21.15.8:0/3552785932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f6c0f6530 msgr2=0x7f5f6c108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.015+0000 7f5f709fb700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f6c0f6530 0x7f5f6c108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.016+0000 7f5f709fb700 1 -- 172.21.15.8:0/3552785932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c005040 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.016+0000 7f5f709fb700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f6c0f77d0 0x7f5f6c1093c0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7f5f5c004320 tx=0x7f5f5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:05.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.016+0000 7f5f61ffb700 1 -- 172.21.15.8:0/3552785932 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f5c019070 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.016+0000 7f5f61ffb700 1 -- 172.21.15.8:0/3552785932 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5f5c01e420 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.016+0000 7f5f61ffb700 1 -- 172.21.15.8:0/3552785932 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f5c014680 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.016+0000 7f5f721fe700 1 -- 172.21.15.8:0/3552785932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c10a3f0 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.016+0000 7f5f721fe700 1 -- 172.21.15.8:0/3552785932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c10a8d0 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.017+0000 7f5f721fe700 1 -- 172.21.15.8:0/3552785932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c045ad0 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.018+0000 7f5f61ffb700 1 -- 172.21.15.8:0/3552785932 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5f5c01e590 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.019+0000 7f5f61ffb700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f58060f70 0x7f5f58063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:05.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.019+0000 7f5f61ffb700 1 -- 172.21.15.8:0/3552785932 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5f5c07dd10 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.020+0000 7f5f711fc700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f58060f70 0x7f5f58063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:05.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.020+0000 7f5f711fc700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f58060f70 0x7f5f58063430 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f5f68009fd0 tx=0x7f5f6800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:05.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.023+0000 7f5f61ffb700 1 -- 172.21.15.8:0/3552785932 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5f5c051310 con 0x7f5f6c0f77d0 2023-10-18T22:17:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.221+0000 7f5f721fe700 1 -- 172.21.15.8:0/3552785932 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f6c10ab40 con 0x7f5f58060f70 2023-10-18T22:17:05.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.222+0000 7f5f61ffb700 1 -- 172.21.15.8:0/3552785932 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5f6c10ab40 con 0x7f5f58060f70 2023-10-18T22:17:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.224+0000 7f5f721fe700 1 -- 172.21.15.8:0/3552785932 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f58060f70 msgr2=0x7f5f58063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.224+0000 7f5f721fe700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f58060f70 0x7f5f58063430 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f5f68009fd0 tx=0x7f5f6800b040).stop 2023-10-18T22:17:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.224+0000 7f5f721fe700 1 -- 172.21.15.8:0/3552785932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f6c0f77d0 msgr2=0x7f5f6c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.224+0000 7f5f721fe700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f6c0f77d0 0x7f5f6c1093c0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7f5f5c004320 tx=0x7f5f5c00b040).stop 2023-10-18T22:17:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.224+0000 7f5f721fe700 1 -- 172.21.15.8:0/3552785932 shutdown_connections 2023-10-18T22:17:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.224+0000 7f5f721fe700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5f58060f70 0x7f5f58063430 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.225+0000 7f5f721fe700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f6c0f6530 0x7f5f6c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.225+0000 7f5f721fe700 1 --2- 172.21.15.8:0/3552785932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f6c0f77d0 0x7f5f6c1093c0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.225+0000 7f5f721fe700 1 -- 172.21.15.8:0/3552785932 >> 172.21.15.8:0/3552785932 conn(0x7f5f6c0f1c90 msgr2=0x7f5f6c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.225+0000 7f5f721fe700 1 -- 172.21.15.8:0/3552785932 shutdown_connections 2023-10-18T22:17:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.225+0000 7f5f721fe700 1 -- 172.21.15.8:0/3552785932 wait complete. 2023-10-18T22:17:05.241 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:17:05.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.366+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3134914881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b640f77d0 msgr2=0x7f0b640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.366+0000 7f0b6b03c700 1 --2- 172.21.15.8:0/3134914881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b640f77d0 0x7f0b640f7c30 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7f0b54004660 tx=0x7f0b54009b30).stop 2023-10-18T22:17:05.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.366+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3134914881 shutdown_connections 2023-10-18T22:17:05.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.366+0000 7f0b6b03c700 1 --2- 172.21.15.8:0/3134914881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b640f77d0 0x7f0b640f7c30 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.366+0000 7f0b6b03c700 1 --2- 172.21.15.8:0/3134914881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b640f6530 0x7f0b640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.366+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3134914881 >> 172.21.15.8:0/3134914881 conn(0x7f0b640f1c90 msgr2=0x7f0b640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:05.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.366+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3134914881 shutdown_connections 2023-10-18T22:17:05.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.366+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3134914881 wait complete. 2023-10-18T22:17:05.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.367+0000 7f0b6b03c700 1 Processor -- start 2023-10-18T22:17:05.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.368+0000 7f0b6b03c700 1 -- start start 2023-10-18T22:17:05.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.368+0000 7f0b6b03c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b640f6530 0x7f0b6406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:05.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.368+0000 7f0b6b03c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b640f77d0 0x7f0b64069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:05.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.368+0000 7f0b6b03c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6406a380 con 0x7f0b640f77d0 2023-10-18T22:17:05.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.368+0000 7f0b6b03c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6406a4c0 con 0x7f0b640f6530 2023-10-18T22:17:05.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.368+0000 7f0b69839700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b640f77d0 0x7f0b64069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:05.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.368+0000 7f0b69839700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b640f77d0 0x7f0b64069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35082/0 (socket says 172.21.15.8:35082) 2023-10-18T22:17:05.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.368+0000 7f0b69839700 1 -- 172.21.15.8:0/3532063818 learned_addr learned my addr 172.21.15.8:0/3532063818 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:05.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.369+0000 7f0b6a03a700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b640f6530 0x7f0b6406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:05.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.369+0000 7f0b69839700 1 -- 172.21.15.8:0/3532063818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b640f6530 msgr2=0x7f0b6406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.369+0000 7f0b69839700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b640f6530 0x7f0b6406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.369+0000 7f0b69839700 1 -- 172.21.15.8:0/3532063818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54005040 con 0x7f0b640f77d0 2023-10-18T22:17:05.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.369+0000 7f0b69839700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b640f77d0 0x7f0b64069e20 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f0b54004320 tx=0x7f0b5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:05.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.369+0000 7f0b5affd700 1 -- 172.21.15.8:0/3532063818 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b54019070 con 0x7f0b640f77d0 2023-10-18T22:17:05.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.369+0000 7f0b5affd700 1 -- 172.21.15.8:0/3532063818 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0b5401e420 con 0x7f0b640f77d0 2023-10-18T22:17:05.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.369+0000 7f0b5affd700 1 -- 172.21.15.8:0/3532063818 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b54014680 con 0x7f0b640f77d0 2023-10-18T22:17:05.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.369+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3532063818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6406a740 con 0x7f0b640f77d0 2023-10-18T22:17:05.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.370+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3532063818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6406ac20 con 0x7f0b640f77d0 2023-10-18T22:17:05.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.371+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3532063818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b64045ad0 con 0x7f0b640f77d0 2023-10-18T22:17:05.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.372+0000 7f0b5affd700 1 -- 172.21.15.8:0/3532063818 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0b5401e590 con 0x7f0b640f77d0 2023-10-18T22:17:05.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.372+0000 7f0b5affd700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b50060f70 0x7f0b50063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:05.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.373+0000 7f0b5affd700 1 -- 172.21.15.8:0/3532063818 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0b5407dc50 con 0x7f0b640f77d0 2023-10-18T22:17:05.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.373+0000 7f0b6a03a700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b50060f70 0x7f0b50063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:05.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.373+0000 7f0b6a03a700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b50060f70 0x7f0b50063430 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f0b6406b730 tx=0x7f0b6000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:05.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.378+0000 7f0b5affd700 1 -- 172.21.15.8:0/3532063818 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0b5404d8e0 con 0x7f0b640f77d0 2023-10-18T22:17:05.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.577+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3532063818 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b640fee30 con 0x7f0b50060f70 2023-10-18T22:17:05.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.578+0000 7f0b5affd700 1 -- 172.21.15.8:0/3532063818 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0b640fee30 con 0x7f0b50060f70 2023-10-18T22:17:05.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.580+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3532063818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b50060f70 msgr2=0x7f0b50063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.580+0000 7f0b6b03c700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b50060f70 0x7f0b50063430 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f0b6406b730 tx=0x7f0b6000b040).stop 2023-10-18T22:17:05.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.580+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3532063818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b640f77d0 msgr2=0x7f0b64069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.580+0000 7f0b6b03c700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b640f77d0 0x7f0b64069e20 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f0b54004320 tx=0x7f0b5400b040).stop 2023-10-18T22:17:05.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.581+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3532063818 shutdown_connections 2023-10-18T22:17:05.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.581+0000 7f0b6b03c700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b50060f70 0x7f0b50063430 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.581+0000 7f0b6b03c700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b640f6530 0x7f0b6406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.581+0000 7f0b6b03c700 1 --2- 172.21.15.8:0/3532063818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b640f77d0 0x7f0b64069e20 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.581+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3532063818 >> 172.21.15.8:0/3532063818 conn(0x7f0b640f1c90 msgr2=0x7f0b640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:05.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.581+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3532063818 shutdown_connections 2023-10-18T22:17:05.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.581+0000 7f0b6b03c700 1 -- 172.21.15.8:0/3532063818 wait complete. 2023-10-18T22:17:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:03.812116+0000 mgr.smithi008.flmjzp (mgr.14640) 4687 : cluster [DBG] pgmap v3217: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.717+0000 7f551b492700 1 -- 172.21.15.8:0/3875399192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f551406a3b0 msgr2=0x7f551406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.717+0000 7f551b492700 1 --2- 172.21.15.8:0/3875399192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f551406a3b0 0x7f551406a830 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f5504004660 tx=0x7f5504009b30).stop 2023-10-18T22:17:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.717+0000 7f551b492700 1 -- 172.21.15.8:0/3875399192 shutdown_connections 2023-10-18T22:17:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.717+0000 7f551b492700 1 --2- 172.21.15.8:0/3875399192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f551406a3b0 0x7f551406a830 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.717+0000 7f551b492700 1 --2- 172.21.15.8:0/3875399192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f551406b9c0 0x7f5514069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.717+0000 7f551b492700 1 -- 172.21.15.8:0/3875399192 >> 172.21.15.8:0/3875399192 conn(0x7f55140f1c90 msgr2=0x7f55140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.718+0000 7f551b492700 1 -- 172.21.15.8:0/3875399192 shutdown_connections 2023-10-18T22:17:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.718+0000 7f551b492700 1 -- 172.21.15.8:0/3875399192 wait complete. 2023-10-18T22:17:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.718+0000 7f551b492700 1 Processor -- start 2023-10-18T22:17:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.718+0000 7f551b492700 1 -- start start 2023-10-18T22:17:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.719+0000 7f551b492700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f551406a3b0 0x7f5514108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.719+0000 7f551b492700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f551406b9c0 0x7f5514109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.719+0000 7f551b492700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5514109a10 con 0x7f551406a3b0 2023-10-18T22:17:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.719+0000 7f551b492700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5514109b50 con 0x7f551406b9c0 2023-10-18T22:17:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.719+0000 7f551a490700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f551406a3b0 0x7f5514108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.719+0000 7f551a490700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f551406a3b0 0x7f5514108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35100/0 (socket says 172.21.15.8:35100) 2023-10-18T22:17:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.719+0000 7f551a490700 1 -- 172.21.15.8:0/2143158449 learned_addr learned my addr 172.21.15.8:0/2143158449 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.719+0000 7f5519c8f700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f551406b9c0 0x7f5514109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:05.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.719+0000 7f551a490700 1 -- 172.21.15.8:0/2143158449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f551406b9c0 msgr2=0x7f5514109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.720+0000 7f551a490700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f551406b9c0 0x7f5514109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.720+0000 7f551a490700 1 -- 172.21.15.8:0/2143158449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504005040 con 0x7f551406a3b0 2023-10-18T22:17:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.720+0000 7f551a490700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f551406a3b0 0x7f5514108f70 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f551000c530 tx=0x7f5510007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.720+0000 7f550affd700 1 -- 172.21.15.8:0/2143158449 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f551000f650 con 0x7f551406a3b0 2023-10-18T22:17:05.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.720+0000 7f551b492700 1 -- 172.21.15.8:0/2143158449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551410a4f0 con 0x7f551406a3b0 2023-10-18T22:17:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.720+0000 7f550affd700 1 -- 172.21.15.8:0/2143158449 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f551000fc70 con 0x7f551406a3b0 2023-10-18T22:17:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.720+0000 7f550affd700 1 -- 172.21.15.8:0/2143158449 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5510012d00 con 0x7f551406a3b0 2023-10-18T22:17:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.720+0000 7f551b492700 1 -- 172.21.15.8:0/2143158449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551410aab0 con 0x7f551406a3b0 2023-10-18T22:17:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.721+0000 7f551b492700 1 -- 172.21.15.8:0/2143158449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5514045ad0 con 0x7f551406a3b0 2023-10-18T22:17:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.722+0000 7f550affd700 1 -- 172.21.15.8:0/2143158449 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5510010070 con 0x7f551406a3b0 2023-10-18T22:17:05.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.723+0000 7f550affd700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5500060f70 0x7f5500063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.723+0000 7f550affd700 1 -- 172.21.15.8:0/2143158449 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f551007c5b0 con 0x7f551406a3b0 2023-10-18T22:17:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.723+0000 7f5519c8f700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5500060f70 0x7f5500063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.724+0000 7f5519c8f700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5500060f70 0x7f5500063430 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f5504004630 tx=0x7f5504009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:05.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.727+0000 7f550affd700 1 -- 172.21.15.8:0/2143158449 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5510047f20 con 0x7f551406a3b0 2023-10-18T22:17:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:03.812116+0000 mgr.smithi008.flmjzp (mgr.14640) 4687 : cluster [DBG] pgmap v3217: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:05.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.921+0000 7f551b492700 1 -- 172.21.15.8:0/2143158449 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5514101030 con 0x7f5500060f70 2023-10-18T22:17:05.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.931+0000 7f550affd700 1 -- 172.21.15.8:0/2143158449 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5514101030 con 0x7f5500060f70 2023-10-18T22:17:05.985 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:17:05.985 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (83m) 50s ago 85m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:17:05.986 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (77m) 50s ago 85m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:17:05.986 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (77m) 8m ago 84m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:17:05.986 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (83m) 50s ago 84m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:17:05.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 50s ago 81m - - 2023-10-18T22:17:05.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 50s ago 81m - - 2023-10-18T22:17:05.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 81m - - 2023-10-18T22:17:05.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 81m - - 2023-10-18T22:17:05.987 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (78m) 50s ago 86m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:17:05.988 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (78m) 8m ago 84m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:17:05.988 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (78m) 50s ago 86m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:17:05.988 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (77m) 8m ago 84m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:17:05.988 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (84m) 50s ago 84m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:17:05.989 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (84m) 8m ago 84m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:17:05.989 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (77m) 50s ago 83m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:17:05.989 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (75m) 50s ago 83m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:17:05.989 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (74m) 50s ago 83m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:17:05.989 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (74m) 8m ago 82m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:17:05.990 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (73m) 8m ago 82m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:17:05.990 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (73m) 8m ago 82m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:17:05.990 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (79m) 50s ago 84m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:17:05.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 -- 172.21.15.8:0/2143158449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5500060f70 msgr2=0x7f5500063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5500060f70 0x7f5500063430 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f5504004630 tx=0x7f5504009b30).stop 2023-10-18T22:17:05.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 -- 172.21.15.8:0/2143158449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f551406a3b0 msgr2=0x7f5514108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:05.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f551406a3b0 0x7f5514108f70 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f551000c530 tx=0x7f5510007e20).stop 2023-10-18T22:17:05.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 -- 172.21.15.8:0/2143158449 shutdown_connections 2023-10-18T22:17:05.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5500060f70 0x7f5500063430 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f551406a3b0 0x7f5514108f70 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 --2- 172.21.15.8:0/2143158449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f551406b9c0 0x7f5514109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:05.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 -- 172.21.15.8:0/2143158449 >> 172.21.15.8:0/2143158449 conn(0x7f55140f1c90 msgr2=0x7f55140fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:05.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 -- 172.21.15.8:0/2143158449 shutdown_connections 2023-10-18T22:17:05.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:05.933+0000 7f551b492700 1 -- 172.21.15.8:0/2143158449 wait complete. 2023-10-18T22:17:06.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.072+0000 7f6002508700 1 -- 172.21.15.8:0/2755519625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ffc0f77d0 msgr2=0x7f5ffc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:06.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.072+0000 7f6002508700 1 --2- 172.21.15.8:0/2755519625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ffc0f77d0 0x7f5ffc0f7c30 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f5fec004660 tx=0x7f5fec009b30).stop 2023-10-18T22:17:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.072+0000 7f6002508700 1 -- 172.21.15.8:0/2755519625 shutdown_connections 2023-10-18T22:17:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.072+0000 7f6002508700 1 --2- 172.21.15.8:0/2755519625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ffc0f77d0 0x7f5ffc0f7c30 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.072+0000 7f6002508700 1 --2- 172.21.15.8:0/2755519625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ffc0f6530 0x7f5ffc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.072+0000 7f6002508700 1 -- 172.21.15.8:0/2755519625 >> 172.21.15.8:0/2755519625 conn(0x7f5ffc0f1c90 msgr2=0x7f5ffc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:06.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.073+0000 7f6002508700 1 -- 172.21.15.8:0/2755519625 shutdown_connections 2023-10-18T22:17:06.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.073+0000 7f6002508700 1 -- 172.21.15.8:0/2755519625 wait complete. 2023-10-18T22:17:06.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.074+0000 7f6002508700 1 Processor -- start 2023-10-18T22:17:06.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.074+0000 7f6002508700 1 -- start start 2023-10-18T22:17:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.074+0000 7f6002508700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ffc0f6530 0x7f5ffc106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.075+0000 7f6002508700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ffc0f77d0 0x7f5ffc107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.075+0000 7f6002508700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc107850 con 0x7f5ffc0f6530 2023-10-18T22:17:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.075+0000 7f6002508700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc108060 con 0x7f5ffc0f77d0 2023-10-18T22:17:06.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.075+0000 7f6001506700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ffc0f6530 0x7f5ffc106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.075+0000 7f6001506700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ffc0f6530 0x7f5ffc106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35120/0 (socket says 172.21.15.8:35120) 2023-10-18T22:17:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.075+0000 7f6001506700 1 -- 172.21.15.8:0/3283996858 learned_addr learned my addr 172.21.15.8:0/3283996858 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.075+0000 7f6001506700 1 -- 172.21.15.8:0/3283996858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ffc0f77d0 msgr2=0x7f5ffc107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.075+0000 7f6001506700 1 --2- 172.21.15.8:0/3283996858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ffc0f77d0 0x7f5ffc107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:17:06.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.075+0000 7f6001506700 1 -- 172.21.15.8:0/3283996858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec005040 con 0x7f5ffc0f6530 2023-10-18T22:17:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.075+0000 7f6001506700 1 --2- 172.21.15.8:0/3283996858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ffc0f6530 0x7f5ffc106d60 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f5ff800e7c0 tx=0x7f5ff800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.076+0000 7f5ff1ffb700 1 -- 172.21.15.8:0/3283996858 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ff80092e0 con 0x7f5ffc0f6530 2023-10-18T22:17:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.076+0000 7f5ff1ffb700 1 -- 172.21.15.8:0/3283996858 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5ff800f040 con 0x7f5ffc0f6530 2023-10-18T22:17:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.076+0000 7f5ff1ffb700 1 -- 172.21.15.8:0/3283996858 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ff80147e0 con 0x7f5ffc0f6530 2023-10-18T22:17:06.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.076+0000 7f6002508700 1 -- 172.21.15.8:0/3283996858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc1082e0 con 0x7f5ffc0f6530 2023-10-18T22:17:06.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.076+0000 7f6002508700 1 -- 172.21.15.8:0/3283996858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc108820 con 0x7f5ffc0f6530 2023-10-18T22:17:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.077+0000 7f6002508700 1 -- 172.21.15.8:0/3283996858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc059100 con 0x7f5ffc0f6530 2023-10-18T22:17:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.078+0000 7f5ff1ffb700 1 -- 172.21.15.8:0/3283996858 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5ff801b030 con 0x7f5ffc0f6530 2023-10-18T22:17:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.079+0000 7f5ff1ffb700 1 --2- 172.21.15.8:0/3283996858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fe8060f70 0x7f5fe8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.079+0000 7f5ff1ffb700 1 -- 172.21.15.8:0/3283996858 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5ff807c990 con 0x7f5ffc0f6530 2023-10-18T22:17:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.080+0000 7f6000d05700 1 --2- 172.21.15.8:0/3283996858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fe8060f70 0x7f5fe8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.080+0000 7f6000d05700 1 --2- 172.21.15.8:0/3283996858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fe8060f70 0x7f5fe8063430 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f5fec005010 tx=0x7f5fec00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.083+0000 7f5ff1ffb700 1 -- 172.21.15.8:0/3283996858 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5ff804c4e0 con 0x7f5ffc0f6530 2023-10-18T22:17:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.341+0000 7f6002508700 1 -- 172.21.15.8:0/3283996858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5ffc0fecc0 con 0x7f5ffc0f6530 2023-10-18T22:17:06.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.344+0000 7f5ff1ffb700 1 -- 172.21.15.8:0/3283996858 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5ff8019020 con 0x7f5ffc0f6530 2023-10-18T22:17:06.346 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:17:06.347 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:17:06.348 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:17:06.349 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:17:06.350 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:17:06.350 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:17:06.350 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:17:06.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.346+0000 7f6002508700 1 -- 172.21.15.8:0/3283996858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fe8060f70 msgr2=0x7f5fe8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:06.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.346+0000 7f6002508700 1 --2- 172.21.15.8:0/3283996858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fe8060f70 0x7f5fe8063430 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f5fec005010 tx=0x7f5fec00b040).stop 2023-10-18T22:17:06.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.346+0000 7f6002508700 1 -- 172.21.15.8:0/3283996858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ffc0f6530 msgr2=0x7f5ffc106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.346+0000 7f6002508700 1 --2- 172.21.15.8:0/3283996858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ffc0f6530 0x7f5ffc106d60 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f5ff800e7c0 tx=0x7f5ff800b040).stop 2023-10-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.346+0000 7f6002508700 1 -- 172.21.15.8:0/3283996858 shutdown_connections 2023-10-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.346+0000 7f6002508700 1 --2- 172.21.15.8:0/3283996858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5fe8060f70 0x7f5fe8063430 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.346+0000 7f6002508700 1 --2- 172.21.15.8:0/3283996858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ffc0f6530 0x7f5ffc106d60 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.346+0000 7f6002508700 1 --2- 172.21.15.8:0/3283996858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ffc0f77d0 0x7f5ffc107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.346+0000 7f6002508700 1 -- 172.21.15.8:0/3283996858 >> 172.21.15.8:0/3283996858 conn(0x7f5ffc0f1c90 msgr2=0x7f5ffc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.347+0000 7f6002508700 1 -- 172.21.15.8:0/3283996858 shutdown_connections 2023-10-18T22:17:06.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.347+0000 7f6002508700 1 -- 172.21.15.8:0/3283996858 wait complete. 2023-10-18T22:17:06.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.487+0000 7f9096c1e700 1 -- 172.21.15.8:0/1847415688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900f6530 msgr2=0x7f90900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:06.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.487+0000 7f9096c1e700 1 --2- 172.21.15.8:0/1847415688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900f6530 0x7f90900f6950 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f908c004660 tx=0x7f908c009b30).stop 2023-10-18T22:17:06.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.487+0000 7f9096c1e700 1 -- 172.21.15.8:0/1847415688 shutdown_connections 2023-10-18T22:17:06.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.487+0000 7f9096c1e700 1 --2- 172.21.15.8:0/1847415688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90900f77d0 0x7f90900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.487+0000 7f9096c1e700 1 --2- 172.21.15.8:0/1847415688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900f6530 0x7f90900f6950 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.487+0000 7f9096c1e700 1 -- 172.21.15.8:0/1847415688 >> 172.21.15.8:0/1847415688 conn(0x7f90900f1c90 msgr2=0x7f90900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:06.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.487+0000 7f9096c1e700 1 -- 172.21.15.8:0/1847415688 shutdown_connections 2023-10-18T22:17:06.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.487+0000 7f9096c1e700 1 -- 172.21.15.8:0/1847415688 wait complete. 2023-10-18T22:17:06.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.489+0000 7f9096c1e700 1 Processor -- start 2023-10-18T22:17:06.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.489+0000 7f9096c1e700 1 -- start start 2023-10-18T22:17:06.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.489+0000 7f9096c1e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900f6530 0x7f909006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:06.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.489+0000 7f9096c1e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90900f77d0 0x7f9090069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:06.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.489+0000 7f9096c1e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909006a380 con 0x7f90900f6530 2023-10-18T22:17:06.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.489+0000 7f9096c1e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909006a4c0 con 0x7f90900f77d0 2023-10-18T22:17:06.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.490+0000 7f9095c1c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900f6530 0x7f909006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:06.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.490+0000 7f9095c1c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900f6530 0x7f909006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35142/0 (socket says 172.21.15.8:35142) 2023-10-18T22:17:06.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.490+0000 7f9095c1c700 1 -- 172.21.15.8:0/3443158797 learned_addr learned my addr 172.21.15.8:0/3443158797 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:06.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.490+0000 7f909541b700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90900f77d0 0x7f9090069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:06.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.490+0000 7f9095c1c700 1 -- 172.21.15.8:0/3443158797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90900f77d0 msgr2=0x7f9090069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:06.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.490+0000 7f9095c1c700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90900f77d0 0x7f9090069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.490+0000 7f9095c1c700 1 -- 172.21.15.8:0/3443158797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c005040 con 0x7f90900f6530 2023-10-18T22:17:06.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.490+0000 7f909541b700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90900f77d0 0x7f9090069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:17:06.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.490+0000 7f9095c1c700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900f6530 0x7f909006b9a0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f908c007a60 tx=0x7f908c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:06.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.490+0000 7f90867fc700 1 -- 172.21.15.8:0/3443158797 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f908c018070 con 0x7f90900f6530 2023-10-18T22:17:06.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.491+0000 7f9096c1e700 1 -- 172.21.15.8:0/3443158797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909006a740 con 0x7f90900f6530 2023-10-18T22:17:06.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.491+0000 7f90867fc700 1 -- 172.21.15.8:0/3443158797 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f908c009630 con 0x7f90900f6530 2023-10-18T22:17:06.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.491+0000 7f90867fc700 1 -- 172.21.15.8:0/3443158797 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f908c01c540 con 0x7f90900f6530 2023-10-18T22:17:06.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.491+0000 7f9096c1e700 1 -- 172.21.15.8:0/3443158797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909006aca0 con 0x7f90900f6530 2023-10-18T22:17:06.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.492+0000 7f9096c1e700 1 -- 172.21.15.8:0/3443158797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9090045ad0 con 0x7f90900f6530 2023-10-18T22:17:06.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.493+0000 7f90867fc700 1 -- 172.21.15.8:0/3443158797 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f908c01c7b0 con 0x7f90900f6530 2023-10-18T22:17:06.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.493+0000 7f90867fc700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f907c060f70 0x7f907c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:06.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.494+0000 7f90867fc700 1 -- 172.21.15.8:0/3443158797 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f908c07e6a0 con 0x7f90900f6530 2023-10-18T22:17:06.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.494+0000 7f909541b700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f907c060f70 0x7f907c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:06.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.494+0000 7f909541b700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f907c060f70 0x7f907c063430 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f9080004b90 tx=0x7f908000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:06.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.498+0000 7f90867fc700 1 -- 172.21.15.8:0/3443158797 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f908c04e310 con 0x7f90900f6530 2023-10-18T22:17:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:05.223741+0000 mgr.smithi008.flmjzp (mgr.14640) 4688 : audit [DBG] from='client.37768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:05.842033+0000 mon.smithi008 (mon.0) 4969 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:06.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.724+0000 7f9096c1e700 1 -- 172.21.15.8:0/3443158797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9090027a00 con 0x7f90900f6530 2023-10-18T22:17:06.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.725+0000 7f90867fc700 1 -- 172.21.15.8:0/3443158797 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f908c051930 con 0x7f90900f6530 2023-10-18T22:17:06.727 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:17:06.728 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:17:06.728 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:17:06.728 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:17:06.728 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:17:06.728 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:17:06.729 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:17:06.729 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:17:06.729 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:17:06.729 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:17:06.729 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:17:06.730 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:17:06.730 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:17:06.730 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:17:06.730 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:17:06.730 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:17:06.731 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:17:06.731 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:17:06.731 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:17:06.731 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:17:06.731 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:17:06.732 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:17:06.732 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:17:06.732 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:17:06.732 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:17:06.732 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:17:06.733 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:17:06.733 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:17:06.733 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:17:06.733 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:17:06.733 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:17:06.734 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:17:06.734 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:17:06.734 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:17:06.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.726+0000 7f9096c1e700 1 -- 172.21.15.8:0/3443158797 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f907c060f70 msgr2=0x7f907c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:06.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.726+0000 7f9096c1e700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f907c060f70 0x7f907c063430 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f9080004b90 tx=0x7f908000b040).stop 2023-10-18T22:17:06.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.726+0000 7f9096c1e700 1 -- 172.21.15.8:0/3443158797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900f6530 msgr2=0x7f909006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:06.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.726+0000 7f9096c1e700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900f6530 0x7f909006b9a0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f908c007a60 tx=0x7f908c009b30).stop 2023-10-18T22:17:06.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.727+0000 7f9096c1e700 1 -- 172.21.15.8:0/3443158797 shutdown_connections 2023-10-18T22:17:06.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.727+0000 7f9096c1e700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f907c060f70 0x7f907c063430 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.727+0000 7f9096c1e700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90900f6530 0x7f909006b9a0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.727+0000 7f9096c1e700 1 --2- 172.21.15.8:0/3443158797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90900f77d0 0x7f9090069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.727+0000 7f9096c1e700 1 -- 172.21.15.8:0/3443158797 >> 172.21.15.8:0/3443158797 conn(0x7f90900f1c90 msgr2=0x7f90900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:06.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.727+0000 7f9096c1e700 1 -- 172.21.15.8:0/3443158797 shutdown_connections 2023-10-18T22:17:06.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.727+0000 7f9096c1e700 1 -- 172.21.15.8:0/3443158797 wait complete. 2023-10-18T22:17:06.737 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:17:06.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:05.223741+0000 mgr.smithi008.flmjzp (mgr.14640) 4688 : audit [DBG] from='client.37768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:06.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:05.842033+0000 mon.smithi008 (mon.0) 4969 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:06.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.865+0000 7f923eaf3700 1 -- 172.21.15.8:0/1207003351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92380f6530 msgr2=0x7f92380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:06.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.865+0000 7f923eaf3700 1 --2- 172.21.15.8:0/1207003351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92380f6530 0x7f92380f6950 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f9234004660 tx=0x7f9234009b30).stop 2023-10-18T22:17:06.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.865+0000 7f923eaf3700 1 -- 172.21.15.8:0/1207003351 shutdown_connections 2023-10-18T22:17:06.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.865+0000 7f923eaf3700 1 --2- 172.21.15.8:0/1207003351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92380f77d0 0x7f92380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.865+0000 7f923eaf3700 1 --2- 172.21.15.8:0/1207003351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92380f6530 0x7f92380f6950 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.865+0000 7f923eaf3700 1 -- 172.21.15.8:0/1207003351 >> 172.21.15.8:0/1207003351 conn(0x7f92380f1c90 msgr2=0x7f92380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:06.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.865+0000 7f923eaf3700 1 -- 172.21.15.8:0/1207003351 shutdown_connections 2023-10-18T22:17:06.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.865+0000 7f923eaf3700 1 -- 172.21.15.8:0/1207003351 wait complete. 2023-10-18T22:17:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.866+0000 7f923eaf3700 1 Processor -- start 2023-10-18T22:17:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.866+0000 7f923eaf3700 1 -- start start 2023-10-18T22:17:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.866+0000 7f923eaf3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92380f6530 0x7f9238108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.866+0000 7f923eaf3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92380f77d0 0x7f92381094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.866+0000 7f923eaf3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9238109a70 con 0x7f92380f77d0 2023-10-18T22:17:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.866+0000 7f923eaf3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9238109bb0 con 0x7f92380f6530 2023-10-18T22:17:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.867+0000 7f923d2f0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92380f77d0 0x7f92381094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.867+0000 7f923d2f0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92380f77d0 0x7f92381094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35166/0 (socket says 172.21.15.8:35166) 2023-10-18T22:17:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.867+0000 7f923d2f0700 1 -- 172.21.15.8:0/2887002444 learned_addr learned my addr 172.21.15.8:0/2887002444 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.867+0000 7f923daf1700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92380f6530 0x7f9238108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.867+0000 7f923d2f0700 1 -- 172.21.15.8:0/2887002444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92380f6530 msgr2=0x7f9238108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.867+0000 7f923d2f0700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92380f6530 0x7f9238108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.867+0000 7f923d2f0700 1 -- 172.21.15.8:0/2887002444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234005040 con 0x7f92380f77d0 2023-10-18T22:17:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.867+0000 7f923d2f0700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92380f77d0 0x7f92381094c0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f92280026d0 tx=0x7f9228009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:06.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.867+0000 7f922e7fc700 1 -- 172.21.15.8:0/2887002444 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92280079c0 con 0x7f92380f77d0 2023-10-18T22:17:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.868+0000 7f922e7fc700 1 -- 172.21.15.8:0/2887002444 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f922800f040 con 0x7f92380f77d0 2023-10-18T22:17:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.868+0000 7f922e7fc700 1 -- 172.21.15.8:0/2887002444 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9228014980 con 0x7f92380f77d0 2023-10-18T22:17:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.868+0000 7f923eaf3700 1 -- 172.21.15.8:0/2887002444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923810a550 con 0x7f92380f77d0 2023-10-18T22:17:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.868+0000 7f923eaf3700 1 -- 172.21.15.8:0/2887002444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923810ab10 con 0x7f92380f77d0 2023-10-18T22:17:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.869+0000 7f923eaf3700 1 -- 172.21.15.8:0/2887002444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9238045ad0 con 0x7f92380f77d0 2023-10-18T22:17:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.870+0000 7f922e7fc700 1 -- 172.21.15.8:0/2887002444 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f92280090d0 con 0x7f92380f77d0 2023-10-18T22:17:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.870+0000 7f922e7fc700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9224060f70 0x7f9224063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.871+0000 7f922e7fc700 1 -- 172.21.15.8:0/2887002444 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f922807c8a0 con 0x7f92380f77d0 2023-10-18T22:17:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.871+0000 7f923daf1700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9224060f70 0x7f9224063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.871+0000 7f923daf1700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9224060f70 0x7f9224063430 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f9234004630 tx=0x7f9234009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:06.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:06.874+0000 7f922e7fc700 1 -- 172.21.15.8:0/2887002444 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f922804ffb0 con 0x7f92380f77d0 2023-10-18T22:17:07.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.077+0000 7f923eaf3700 1 -- 172.21.15.8:0/2887002444 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f923810ade0 con 0x7f9224060f70 2023-10-18T22:17:07.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.078+0000 7f922e7fc700 1 -- 172.21.15.8:0/2887002444 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f923810ade0 con 0x7f9224060f70 2023-10-18T22:17:07.080 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:17:07.081 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:17:07.081 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:17:07.081 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:17:07.081 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:17:07.081 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:17:07.082 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:17:07.082 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:17:07.082 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:17:07.082 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:17:07.082 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:17:07.083 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:17:07.083 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:17:07.083 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:17:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 -- 172.21.15.8:0/2887002444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9224060f70 msgr2=0x7f9224063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9224060f70 0x7f9224063430 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f9234004630 tx=0x7f9234009b30).stop 2023-10-18T22:17:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 -- 172.21.15.8:0/2887002444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92380f77d0 msgr2=0x7f92381094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92380f77d0 0x7f92381094c0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f92280026d0 tx=0x7f9228009de0).stop 2023-10-18T22:17:07.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 -- 172.21.15.8:0/2887002444 shutdown_connections 2023-10-18T22:17:07.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9224060f70 0x7f9224063430 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:07.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92380f6530 0x7f9238108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:07.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 --2- 172.21.15.8:0/2887002444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92380f77d0 0x7f92381094c0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:07.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 -- 172.21.15.8:0/2887002444 >> 172.21.15.8:0/2887002444 conn(0x7f92380f1c90 msgr2=0x7f923806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:07.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 -- 172.21.15.8:0/2887002444 shutdown_connections 2023-10-18T22:17:07.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:07.080+0000 7f923eaf3700 1 -- 172.21.15.8:0/2887002444 wait complete. 2023-10-18T22:17:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:05.579918+0000 mgr.smithi008.flmjzp (mgr.14640) 4689 : audit [DBG] from='client.37772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:05.812708+0000 mgr.smithi008.flmjzp (mgr.14640) 4690 : cluster [DBG] pgmap v3218: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:05.923831+0000 mgr.smithi008.flmjzp (mgr.14640) 4691 : audit [DBG] from='client.37776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:06.345572+0000 mon.smithi008 (mon.0) 4970 : audit [DBG] from='client.? 172.21.15.8:0/3283996858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:06.411718+0000 mon.smithi008 (mon.0) 4971 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:06.412516+0000 mon.smithi008 (mon.0) 4972 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:06.413153+0000 mgr.smithi008.flmjzp (mgr.14640) 4692 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:06.413663+0000 mgr.smithi008.flmjzp (mgr.14640) 4693 : cluster [DBG] pgmap v3219: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:06.413883+0000 mgr.smithi008.flmjzp (mgr.14640) 4694 : cluster [DBG] pgmap v3220: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:06.417804+0000 mon.smithi008 (mon.0) 4973 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:06.422729+0000 mon.smithi008 (mon.0) 4974 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:06.425132+0000 mon.smithi008 (mon.0) 4975 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:06.426402+0000 mon.smithi008 (mon.0) 4976 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:06.427643+0000 mon.smithi008 (mon.0) 4977 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:07.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:06.429200+0000 mon.smithi008 (mon.0) 4978 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:07.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:06.430799+0000 mgr.smithi008.flmjzp (mgr.14640) 4695 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:07.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:06.726335+0000 mon.smithi008 (mon.0) 4979 : audit [DBG] from='client.? 172.21.15.8:0/3443158797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:17:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:05.579918+0000 mgr.smithi008.flmjzp (mgr.14640) 4689 : audit [DBG] from='client.37772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:05.812708+0000 mgr.smithi008.flmjzp (mgr.14640) 4690 : cluster [DBG] pgmap v3218: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:05.923831+0000 mgr.smithi008.flmjzp (mgr.14640) 4691 : audit [DBG] from='client.37776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:06.345572+0000 mon.smithi008 (mon.0) 4970 : audit [DBG] from='client.? 172.21.15.8:0/3283996858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:06.411718+0000 mon.smithi008 (mon.0) 4971 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:06.412516+0000 mon.smithi008 (mon.0) 4972 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:06.413153+0000 mgr.smithi008.flmjzp (mgr.14640) 4692 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:06.413663+0000 mgr.smithi008.flmjzp (mgr.14640) 4693 : cluster [DBG] pgmap v3219: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:06.413883+0000 mgr.smithi008.flmjzp (mgr.14640) 4694 : cluster [DBG] pgmap v3220: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:07.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:06.417804+0000 mon.smithi008 (mon.0) 4973 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:07.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:06.422729+0000 mon.smithi008 (mon.0) 4974 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:07.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:06.425132+0000 mon.smithi008 (mon.0) 4975 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:07.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:06.426402+0000 mon.smithi008 (mon.0) 4976 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:07.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:06.427643+0000 mon.smithi008 (mon.0) 4977 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:07.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:06.429200+0000 mon.smithi008 (mon.0) 4978 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:07.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:06.430799+0000 mgr.smithi008.flmjzp (mgr.14640) 4695 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:07.742 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:06.726335+0000 mon.smithi008 (mon.0) 4979 : audit [DBG] from='client.? 172.21.15.8:0/3443158797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:17:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:07.079610+0000 mgr.smithi008.flmjzp (mgr.14640) 4696 : audit [DBG] from='client.37788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:08.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:07.079610+0000 mgr.smithi008.flmjzp (mgr.14640) 4696 : audit [DBG] from='client.37788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:08.414674+0000 mgr.smithi008.flmjzp (mgr.14640) 4697 : cluster [DBG] pgmap v3221: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:08.414674+0000 mgr.smithi008.flmjzp (mgr.14640) 4697 : cluster [DBG] pgmap v3221: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:10.415262+0000 mgr.smithi008.flmjzp (mgr.14640) 4698 : cluster [DBG] pgmap v3222: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:10.415262+0000 mgr.smithi008.flmjzp (mgr.14640) 4698 : cluster [DBG] pgmap v3222: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:12.415964+0000 mgr.smithi008.flmjzp (mgr.14640) 4699 : cluster [DBG] pgmap v3223: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:12.415964+0000 mgr.smithi008.flmjzp (mgr.14640) 4699 : cluster [DBG] pgmap v3223: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:14.416636+0000 mgr.smithi008.flmjzp (mgr.14640) 4700 : cluster [DBG] pgmap v3224: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:14.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:14.416636+0000 mgr.smithi008.flmjzp (mgr.14640) 4700 : cluster [DBG] pgmap v3224: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:16.417253+0000 mgr.smithi008.flmjzp (mgr.14640) 4701 : cluster [DBG] pgmap v3225: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:16.440016+0000 mon.smithi008 (mon.0) 4980 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:17.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:16.442166+0000 mon.smithi008 (mon.0) 4981 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:16.443262+0000 mon.smithi008 (mon.0) 4982 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:16.450193+0000 mon.smithi008 (mon.0) 4983 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:16.456671+0000 mon.smithi008 (mon.0) 4984 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:17.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:16.459901+0000 mon.smithi008 (mon.0) 4985 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:17.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:16.461636+0000 mon.smithi008 (mon.0) 4986 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:17.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:16.463384+0000 mon.smithi008 (mon.0) 4987 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:17.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:16.465555+0000 mon.smithi008 (mon.0) 4988 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:16.417253+0000 mgr.smithi008.flmjzp (mgr.14640) 4701 : cluster [DBG] pgmap v3225: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:16.440016+0000 mon.smithi008 (mon.0) 4980 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:16.442166+0000 mon.smithi008 (mon.0) 4981 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:16.443262+0000 mon.smithi008 (mon.0) 4982 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:16.450193+0000 mon.smithi008 (mon.0) 4983 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:16.456671+0000 mon.smithi008 (mon.0) 4984 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:16.459901+0000 mon.smithi008 (mon.0) 4985 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:16.461636+0000 mon.smithi008 (mon.0) 4986 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:16.463384+0000 mon.smithi008 (mon.0) 4987 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:16.465555+0000 mon.smithi008 (mon.0) 4988 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:16.444198+0000 mgr.smithi008.flmjzp (mgr.14640) 4702 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:16.444723+0000 mgr.smithi008.flmjzp (mgr.14640) 4703 : cluster [DBG] pgmap v3226: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:16.445064+0000 mgr.smithi008.flmjzp (mgr.14640) 4704 : cluster [DBG] pgmap v3227: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:16.467512+0000 mgr.smithi008.flmjzp (mgr.14640) 4705 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:16.444198+0000 mgr.smithi008.flmjzp (mgr.14640) 4702 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:16.444723+0000 mgr.smithi008.flmjzp (mgr.14640) 4703 : cluster [DBG] pgmap v3226: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:16.445064+0000 mgr.smithi008.flmjzp (mgr.14640) 4704 : cluster [DBG] pgmap v3227: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:18.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:16.467512+0000 mgr.smithi008.flmjzp (mgr.14640) 4705 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:18.445675+0000 mgr.smithi008.flmjzp (mgr.14640) 4706 : cluster [DBG] pgmap v3228: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:18.445675+0000 mgr.smithi008.flmjzp (mgr.14640) 4706 : cluster [DBG] pgmap v3228: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:20.446536+0000 mgr.smithi008.flmjzp (mgr.14640) 4707 : cluster [DBG] pgmap v3229: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:22.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:20.446536+0000 mgr.smithi008.flmjzp (mgr.14640) 4707 : cluster [DBG] pgmap v3229: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:22.447145+0000 mgr.smithi008.flmjzp (mgr.14640) 4708 : cluster [DBG] pgmap v3230: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:24.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:22.447145+0000 mgr.smithi008.flmjzp (mgr.14640) 4708 : cluster [DBG] pgmap v3230: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:24.447752+0000 mgr.smithi008.flmjzp (mgr.14640) 4709 : cluster [DBG] pgmap v3231: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:24.447752+0000 mgr.smithi008.flmjzp (mgr.14640) 4709 : cluster [DBG] pgmap v3231: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:26.478086+0000 mon.smithi008 (mon.0) 4989 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:27.032346+0000 mon.smithi008 (mon.0) 4990 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:27.033574+0000 mon.smithi008 (mon.0) 4991 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:27.040343+0000 mon.smithi008 (mon.0) 4992 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:27.046901+0000 mon.smithi008 (mon.0) 4993 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:27.049833+0000 mon.smithi008 (mon.0) 4994 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:27.051420+0000 mon.smithi008 (mon.0) 4995 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:27.052981+0000 mon.smithi008 (mon.0) 4996 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:27.054967+0000 mon.smithi008 (mon.0) 4997 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:26.478086+0000 mon.smithi008 (mon.0) 4989 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:27.032346+0000 mon.smithi008 (mon.0) 4990 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:27.033574+0000 mon.smithi008 (mon.0) 4991 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:27.040343+0000 mon.smithi008 (mon.0) 4992 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:27.046901+0000 mon.smithi008 (mon.0) 4993 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:27.049833+0000 mon.smithi008 (mon.0) 4994 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:27.051420+0000 mon.smithi008 (mon.0) 4995 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:27.052981+0000 mon.smithi008 (mon.0) 4996 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:27.054967+0000 mon.smithi008 (mon.0) 4997 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:26.448247+0000 mgr.smithi008.flmjzp (mgr.14640) 4710 : cluster [DBG] pgmap v3232: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:27.034500+0000 mgr.smithi008.flmjzp (mgr.14640) 4711 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:27.035169+0000 mgr.smithi008.flmjzp (mgr.14640) 4712 : cluster [DBG] pgmap v3233: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:27.035430+0000 mgr.smithi008.flmjzp (mgr.14640) 4713 : cluster [DBG] pgmap v3234: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:27.056794+0000 mgr.smithi008.flmjzp (mgr.14640) 4714 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:26.448247+0000 mgr.smithi008.flmjzp (mgr.14640) 4710 : cluster [DBG] pgmap v3232: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:27.034500+0000 mgr.smithi008.flmjzp (mgr.14640) 4711 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:27.035169+0000 mgr.smithi008.flmjzp (mgr.14640) 4712 : cluster [DBG] pgmap v3233: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:27.035430+0000 mgr.smithi008.flmjzp (mgr.14640) 4713 : cluster [DBG] pgmap v3234: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:27.056794+0000 mgr.smithi008.flmjzp (mgr.14640) 4714 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:29.036356+0000 mgr.smithi008.flmjzp (mgr.14640) 4715 : cluster [DBG] pgmap v3235: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:29.036356+0000 mgr.smithi008.flmjzp (mgr.14640) 4715 : cluster [DBG] pgmap v3235: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:31.037047+0000 mgr.smithi008.flmjzp (mgr.14640) 4716 : cluster [DBG] pgmap v3236: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:31.037047+0000 mgr.smithi008.flmjzp (mgr.14640) 4716 : cluster [DBG] pgmap v3236: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:33.037615+0000 mgr.smithi008.flmjzp (mgr.14640) 4717 : cluster [DBG] pgmap v3237: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:33.037615+0000 mgr.smithi008.flmjzp (mgr.14640) 4717 : cluster [DBG] pgmap v3237: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:35.038131+0000 mgr.smithi008.flmjzp (mgr.14640) 4718 : cluster [DBG] pgmap v3238: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:35.038131+0000 mgr.smithi008.flmjzp (mgr.14640) 4718 : cluster [DBG] pgmap v3238: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.231+0000 7f8ae4866700 1 -- 172.21.15.8:0/3805447972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ae00f6530 msgr2=0x7f8ae00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.231+0000 7f8ae4866700 1 --2- 172.21.15.8:0/3805447972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ae00f6530 0x7f8ae00f6950 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f8ad0004660 tx=0x7f8ad0009b30).stop 2023-10-18T22:17:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.231+0000 7f8ae4866700 1 -- 172.21.15.8:0/3805447972 shutdown_connections 2023-10-18T22:17:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.231+0000 7f8ae4866700 1 --2- 172.21.15.8:0/3805447972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ae00f77d0 0x7f8ae00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.231+0000 7f8ae4866700 1 --2- 172.21.15.8:0/3805447972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ae00f6530 0x7f8ae00f6950 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.231+0000 7f8ae4866700 1 -- 172.21.15.8:0/3805447972 >> 172.21.15.8:0/3805447972 conn(0x7f8ae00f1c90 msgr2=0x7f8ae00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.232+0000 7f8ae4866700 1 -- 172.21.15.8:0/3805447972 shutdown_connections 2023-10-18T22:17:37.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.232+0000 7f8ae4866700 1 -- 172.21.15.8:0/3805447972 wait complete. 2023-10-18T22:17:37.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.232+0000 7f8ae4866700 1 Processor -- start 2023-10-18T22:17:37.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.233+0000 7f8ae4866700 1 -- start start 2023-10-18T22:17:37.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.233+0000 7f8ae4866700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ae00f6530 0x7f8ae0108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:37.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.233+0000 7f8ae4866700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ae00f77d0 0x7f8ae01094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:37.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.233+0000 7f8ae4866700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0109a70 con 0x7f8ae00f77d0 2023-10-18T22:17:37.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.233+0000 7f8ae4866700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0109bb0 con 0x7f8ae00f6530 2023-10-18T22:17:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.233+0000 7f8adeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ae00f77d0 0x7f8ae01094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.233+0000 7f8adeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ae00f77d0 0x7f8ae01094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50824/0 (socket says 172.21.15.8:50824) 2023-10-18T22:17:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.233+0000 7f8adeffd700 1 -- 172.21.15.8:0/3056819634 learned_addr learned my addr 172.21.15.8:0/3056819634 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.234+0000 7f8adf7fe700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ae00f6530 0x7f8ae0108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.234+0000 7f8adeffd700 1 -- 172.21.15.8:0/3056819634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ae00f6530 msgr2=0x7f8ae0108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.234+0000 7f8adeffd700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ae00f6530 0x7f8ae0108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.234+0000 7f8adeffd700 1 -- 172.21.15.8:0/3056819634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0005040 con 0x7f8ae00f77d0 2023-10-18T22:17:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.234+0000 7f8adeffd700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ae00f77d0 0x7f8ae01094c0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f8ad40026d0 tx=0x7f8ad4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.234+0000 7f8ac7fff700 1 -- 172.21.15.8:0/3056819634 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad4009320 con 0x7f8ae00f77d0 2023-10-18T22:17:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.234+0000 7f8ac7fff700 1 -- 172.21.15.8:0/3056819634 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8ad400f040 con 0x7f8ae00f77d0 2023-10-18T22:17:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.234+0000 7f8ac7fff700 1 -- 172.21.15.8:0/3056819634 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad40148a0 con 0x7f8ae00f77d0 2023-10-18T22:17:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.234+0000 7f8ae4866700 1 -- 172.21.15.8:0/3056819634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae010a550 con 0x7f8ae00f77d0 2023-10-18T22:17:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.234+0000 7f8ae4866700 1 -- 172.21.15.8:0/3056819634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae010ab10 con 0x7f8ae00f77d0 2023-10-18T22:17:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.236+0000 7f8ae4866700 1 -- 172.21.15.8:0/3056819634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae0045ad0 con 0x7f8ae00f77d0 2023-10-18T22:17:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.236+0000 7f8ac7fff700 1 -- 172.21.15.8:0/3056819634 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8ad4009480 con 0x7f8ae00f77d0 2023-10-18T22:17:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.237+0000 7f8ac7fff700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ac8060f70 0x7f8ac8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:37.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.237+0000 7f8ac7fff700 1 -- 172.21.15.8:0/3056819634 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8ad407cf60 con 0x7f8ae00f77d0 2023-10-18T22:17:37.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.238+0000 7f8adf7fe700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ac8060f70 0x7f8ac8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:37.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.238+0000 7f8adf7fe700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ac8060f70 0x7f8ac8063430 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f8ad0004630 tx=0x7f8ad0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:37.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.242+0000 7f8ac7fff700 1 -- 172.21.15.8:0/3056819634 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8ad40505c0 con 0x7f8ae00f77d0 2023-10-18T22:17:37.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.441+0000 7f8ae4866700 1 -- 172.21.15.8:0/3056819634 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ae00fee40 con 0x7f8ac8060f70 2023-10-18T22:17:37.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.442+0000 7f8ac7fff700 1 -- 172.21.15.8:0/3056819634 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8ae00fee40 con 0x7f8ac8060f70 2023-10-18T22:17:37.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.444+0000 7f8ae4866700 1 -- 172.21.15.8:0/3056819634 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ac8060f70 msgr2=0x7f8ac8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:37.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.444+0000 7f8ae4866700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ac8060f70 0x7f8ac8063430 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f8ad0004630 tx=0x7f8ad0009b30).stop 2023-10-18T22:17:37.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.444+0000 7f8ae4866700 1 -- 172.21.15.8:0/3056819634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ae00f77d0 msgr2=0x7f8ae01094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:37.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.444+0000 7f8ae4866700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ae00f77d0 0x7f8ae01094c0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f8ad40026d0 tx=0x7f8ad4009de0).stop 2023-10-18T22:17:37.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.444+0000 7f8ae4866700 1 -- 172.21.15.8:0/3056819634 shutdown_connections 2023-10-18T22:17:37.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.444+0000 7f8ae4866700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ac8060f70 0x7f8ac8063430 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.444+0000 7f8ae4866700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ae00f6530 0x7f8ae0108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.444+0000 7f8ae4866700 1 --2- 172.21.15.8:0/3056819634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ae00f77d0 0x7f8ae01094c0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.444+0000 7f8ae4866700 1 -- 172.21.15.8:0/3056819634 >> 172.21.15.8:0/3056819634 conn(0x7f8ae00f1c90 msgr2=0x7f8ae006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:37.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.445+0000 7f8ae4866700 1 -- 172.21.15.8:0/3056819634 shutdown_connections 2023-10-18T22:17:37.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.445+0000 7f8ae4866700 1 -- 172.21.15.8:0/3056819634 wait complete. 2023-10-18T22:17:37.462 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:17:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.582+0000 7f2e75d58700 1 -- 172.21.15.8:0/747452481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e700f6530 msgr2=0x7f2e700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.582+0000 7f2e75d58700 1 --2- 172.21.15.8:0/747452481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e700f6530 0x7f2e700f6950 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f2e64004660 tx=0x7f2e64009b30).stop 2023-10-18T22:17:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.582+0000 7f2e75d58700 1 -- 172.21.15.8:0/747452481 shutdown_connections 2023-10-18T22:17:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.582+0000 7f2e75d58700 1 --2- 172.21.15.8:0/747452481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e700f77d0 0x7f2e700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.582+0000 7f2e75d58700 1 --2- 172.21.15.8:0/747452481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e700f6530 0x7f2e700f6950 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.582+0000 7f2e75d58700 1 -- 172.21.15.8:0/747452481 >> 172.21.15.8:0/747452481 conn(0x7f2e700f1c90 msgr2=0x7f2e700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.582+0000 7f2e75d58700 1 -- 172.21.15.8:0/747452481 shutdown_connections 2023-10-18T22:17:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.582+0000 7f2e75d58700 1 -- 172.21.15.8:0/747452481 wait complete. 2023-10-18T22:17:37.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.583+0000 7f2e75d58700 1 Processor -- start 2023-10-18T22:17:37.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.583+0000 7f2e75d58700 1 -- start start 2023-10-18T22:17:37.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.584+0000 7f2e75d58700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e700f6530 0x7f2e70106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:37.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.584+0000 7f2e75d58700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e700f77d0 0x7f2e70107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:37.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.584+0000 7f2e75d58700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70107910 con 0x7f2e700f77d0 2023-10-18T22:17:37.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.584+0000 7f2e75d58700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70108120 con 0x7f2e700f6530 2023-10-18T22:17:37.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.584+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e700f77d0 0x7f2e70107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:37.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.584+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e700f77d0 0x7f2e70107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50834/0 (socket says 172.21.15.8:50834) 2023-10-18T22:17:37.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.584+0000 7f2e6ffff700 1 -- 172.21.15.8:0/328580991 learned_addr learned my addr 172.21.15.8:0/328580991 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:37.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.584+0000 7f2e74d56700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e700f6530 0x7f2e70106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:37.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.584+0000 7f2e6ffff700 1 -- 172.21.15.8:0/328580991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e700f6530 msgr2=0x7f2e70106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:37.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.585+0000 7f2e6ffff700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e700f6530 0x7f2e70106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.585+0000 7f2e6ffff700 1 -- 172.21.15.8:0/328580991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64005040 con 0x7f2e700f77d0 2023-10-18T22:17:37.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.585+0000 7f2e6ffff700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e700f77d0 0x7f2e70107310 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f2e5c0026d0 tx=0x7f2e5c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:37.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.585+0000 7f2e6d7fa700 1 -- 172.21.15.8:0/328580991 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5c0079c0 con 0x7f2e700f77d0 2023-10-18T22:17:37.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.585+0000 7f2e6d7fa700 1 -- 172.21.15.8:0/328580991 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2e5c00f040 con 0x7f2e700f77d0 2023-10-18T22:17:37.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.585+0000 7f2e75d58700 1 -- 172.21.15.8:0/328580991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e701083a0 con 0x7f2e700f77d0 2023-10-18T22:17:37.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.585+0000 7f2e6d7fa700 1 -- 172.21.15.8:0/328580991 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5c014980 con 0x7f2e700f77d0 2023-10-18T22:17:37.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.585+0000 7f2e75d58700 1 -- 172.21.15.8:0/328580991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e70108960 con 0x7f2e700f77d0 2023-10-18T22:17:37.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.586+0000 7f2e75d58700 1 -- 172.21.15.8:0/328580991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e70059100 con 0x7f2e700f77d0 2023-10-18T22:17:37.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.587+0000 7f2e6d7fa700 1 -- 172.21.15.8:0/328580991 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2e5c0090d0 con 0x7f2e700f77d0 2023-10-18T22:17:37.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.588+0000 7f2e6d7fa700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e60060f70 0x7f2e60063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:37.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.588+0000 7f2e6d7fa700 1 -- 172.21.15.8:0/328580991 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2e5c07c8a0 con 0x7f2e700f77d0 2023-10-18T22:17:37.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.588+0000 7f2e74d56700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e60060f70 0x7f2e60063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:37.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.589+0000 7f2e74d56700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e60060f70 0x7f2e60063430 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f2e64005010 tx=0x7f2e64009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:37.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.592+0000 7f2e6d7fa700 1 -- 172.21.15.8:0/328580991 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2e5c04c580 con 0x7f2e700f77d0 2023-10-18T22:17:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.064438+0000 mon.smithi008 (mon.0) 4998 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.066693+0000 mon.smithi008 (mon.0) 4999 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.067674+0000 mon.smithi008 (mon.0) 5000 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.074206+0000 mon.smithi008 (mon.0) 5001 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.082045+0000 mon.smithi008 (mon.0) 5002 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:37.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.085443+0000 mon.smithi008 (mon.0) 5003 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:37.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.087436+0000 mon.smithi008 (mon.0) 5004 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:37.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.089329+0000 mon.smithi008 (mon.0) 5005 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:37.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.091895+0000 mon.smithi008 (mon.0) 5006 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.064438+0000 mon.smithi008 (mon.0) 4998 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.066693+0000 mon.smithi008 (mon.0) 4999 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.067674+0000 mon.smithi008 (mon.0) 5000 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.074206+0000 mon.smithi008 (mon.0) 5001 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.082045+0000 mon.smithi008 (mon.0) 5002 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.085443+0000 mon.smithi008 (mon.0) 5003 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.087436+0000 mon.smithi008 (mon.0) 5004 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.089329+0000 mon.smithi008 (mon.0) 5005 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.091895+0000 mon.smithi008 (mon.0) 5006 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:37.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.789+0000 7f2e75d58700 1 -- 172.21.15.8:0/328580991 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e700fee50 con 0x7f2e60060f70 2023-10-18T22:17:37.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.790+0000 7f2e6d7fa700 1 -- 172.21.15.8:0/328580991 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2e700fee50 con 0x7f2e60060f70 2023-10-18T22:17:37.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 -- 172.21.15.8:0/328580991 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e60060f70 msgr2=0x7f2e60063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:37.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e60060f70 0x7f2e60063430 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f2e64005010 tx=0x7f2e64009b30).stop 2023-10-18T22:17:37.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 -- 172.21.15.8:0/328580991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e700f77d0 msgr2=0x7f2e70107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:37.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e700f77d0 0x7f2e70107310 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f2e5c0026d0 tx=0x7f2e5c009de0).stop 2023-10-18T22:17:37.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 -- 172.21.15.8:0/328580991 shutdown_connections 2023-10-18T22:17:37.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2e60060f70 0x7f2e60063430 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e700f6530 0x7f2e70106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 --2- 172.21.15.8:0/328580991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e700f77d0 0x7f2e70107310 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 -- 172.21.15.8:0/328580991 >> 172.21.15.8:0/328580991 conn(0x7f2e700f1c90 msgr2=0x7f2e700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:37.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 -- 172.21.15.8:0/328580991 shutdown_connections 2023-10-18T22:17:37.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.792+0000 7f2e75d58700 1 -- 172.21.15.8:0/328580991 wait complete. 2023-10-18T22:17:37.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.928+0000 7f827ffff700 1 -- 172.21.15.8:0/3921761150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8280060310 msgr2=0x7f82800f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.928+0000 7f827ffff700 1 --2- 172.21.15.8:0/3921761150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8280060310 0x7f82800f9110 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7f8270004660 tx=0x7f8270009b30).stop 2023-10-18T22:17:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.929+0000 7f827ffff700 1 -- 172.21.15.8:0/3921761150 shutdown_connections 2023-10-18T22:17:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.929+0000 7f827ffff700 1 --2- 172.21.15.8:0/3921761150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82800f9690 0x7f82800fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.929+0000 7f827ffff700 1 --2- 172.21.15.8:0/3921761150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8280060310 0x7f82800f9110 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.929+0000 7f827ffff700 1 -- 172.21.15.8:0/3921761150 >> 172.21.15.8:0/3921761150 conn(0x7f82800f0b90 msgr2=0x7f82800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.929+0000 7f827ffff700 1 -- 172.21.15.8:0/3921761150 shutdown_connections 2023-10-18T22:17:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.929+0000 7f827ffff700 1 -- 172.21.15.8:0/3921761150 wait complete. 2023-10-18T22:17:37.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.930+0000 7f827ffff700 1 Processor -- start 2023-10-18T22:17:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.930+0000 7f827ffff700 1 -- start start 2023-10-18T22:17:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.930+0000 7f827ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8280060310 0x7f8280108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.930+0000 7f827ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82800f9690 0x7f8280109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.930+0000 7f827ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280109a00 con 0x7f8280060310 2023-10-18T22:17:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.930+0000 7f827ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280109b40 con 0x7f82800f9690 2023-10-18T22:17:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.930+0000 7f827effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8280060310 0x7f8280108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.930+0000 7f827effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8280060310 0x7f8280108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50844/0 (socket says 172.21.15.8:50844) 2023-10-18T22:17:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.930+0000 7f827effd700 1 -- 172.21.15.8:0/109302772 learned_addr learned my addr 172.21.15.8:0/109302772 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.931+0000 7f827e7fc700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82800f9690 0x7f8280109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.931+0000 7f827effd700 1 -- 172.21.15.8:0/109302772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82800f9690 msgr2=0x7f8280109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.931+0000 7f827effd700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82800f9690 0x7f8280109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.931+0000 7f827effd700 1 -- 172.21.15.8:0/109302772 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8270005040 con 0x7f8280060310 2023-10-18T22:17:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.931+0000 7f827effd700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8280060310 0x7f8280108f60 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f8270009990 tx=0x7f8270009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.931+0000 7f82677fe700 1 -- 172.21.15.8:0/109302772 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8270018070 con 0x7f8280060310 2023-10-18T22:17:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.931+0000 7f82677fe700 1 -- 172.21.15.8:0/109302772 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8270009630 con 0x7f8280060310 2023-10-18T22:17:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.931+0000 7f827ffff700 1 -- 172.21.15.8:0/109302772 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828010a480 con 0x7f8280060310 2023-10-18T22:17:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.931+0000 7f82677fe700 1 -- 172.21.15.8:0/109302772 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f827001c400 con 0x7f8280060310 2023-10-18T22:17:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.931+0000 7f827ffff700 1 -- 172.21.15.8:0/109302772 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828010a9e0 con 0x7f8280060310 2023-10-18T22:17:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.932+0000 7f827ffff700 1 -- 172.21.15.8:0/109302772 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8280045ad0 con 0x7f8280060310 2023-10-18T22:17:37.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.933+0000 7f82677fe700 1 -- 172.21.15.8:0/109302772 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f827001d9e0 con 0x7f8280060310 2023-10-18T22:17:37.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.934+0000 7f82677fe700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8268060f70 0x7f8268063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:37.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.934+0000 7f82677fe700 1 -- 172.21.15.8:0/109302772 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f827007e680 con 0x7f8280060310 2023-10-18T22:17:37.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.934+0000 7f827e7fc700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8268060f70 0x7f8268063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:37.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.935+0000 7f827e7fc700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8268060f70 0x7f8268063430 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f82800600e0 tx=0x7f8274009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:37.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:37.938+0000 7f82677fe700 1 -- 172.21.15.8:0/109302772 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8270051ce0 con 0x7f8280060310 2023-10-18T22:17:38.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.127+0000 7f827ffff700 1 -- 172.21.15.8:0/109302772 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f82800fa530 con 0x7f8268060f70 2023-10-18T22:17:38.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.136+0000 7f82677fe700 1 -- 172.21.15.8:0/109302772 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f82800fa530 con 0x7f8268060f70 2023-10-18T22:17:38.139 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:17:38.139 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (84m) 83s ago 85m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:17:38.139 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (78m) 83s ago 85m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:17:38.139 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (78m) 9m ago 84m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:17:38.140 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (84m) 83s ago 85m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:17:38.140 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 83s ago 81m - - 2023-10-18T22:17:38.140 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 83s ago 81m - - 2023-10-18T22:17:38.140 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 81m - - 2023-10-18T22:17:38.141 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 81m - - 2023-10-18T22:17:38.141 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (79m) 83s ago 87m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:17:38.141 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (78m) 9m ago 84m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:17:38.141 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (78m) 83s ago 87m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:17:38.141 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (78m) 9m ago 84m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:17:38.142 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (85m) 83s ago 85m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:17:38.142 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (84m) 9m ago 84m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:17:38.142 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (77m) 83s ago 84m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:17:38.142 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (75m) 83s ago 84m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:17:38.142 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (75m) 83s ago 83m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:17:38.143 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (74m) 9m ago 83m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:17:38.143 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (74m) 9m ago 83m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:17:38.143 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (73m) 9m ago 82m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:17:38.143 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (79m) 83s ago 85m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:17:38.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.138+0000 7f827ffff700 1 -- 172.21.15.8:0/109302772 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8268060f70 msgr2=0x7f8268063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:38.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.138+0000 7f827ffff700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8268060f70 0x7f8268063430 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f82800600e0 tx=0x7f8274009be0).stop 2023-10-18T22:17:38.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.138+0000 7f827ffff700 1 -- 172.21.15.8:0/109302772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8280060310 msgr2=0x7f8280108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:38.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.138+0000 7f827ffff700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8280060310 0x7f8280108f60 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f8270009990 tx=0x7f8270009b30).stop 2023-10-18T22:17:38.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.138+0000 7f827ffff700 1 -- 172.21.15.8:0/109302772 shutdown_connections 2023-10-18T22:17:38.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.138+0000 7f827ffff700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8268060f70 0x7f8268063430 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.138+0000 7f827ffff700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8280060310 0x7f8280108f60 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.138+0000 7f827ffff700 1 --2- 172.21.15.8:0/109302772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82800f9690 0x7f8280109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.138+0000 7f827ffff700 1 -- 172.21.15.8:0/109302772 >> 172.21.15.8:0/109302772 conn(0x7f82800f0b90 msgr2=0x7f82800f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:38.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.139+0000 7f827ffff700 1 -- 172.21.15.8:0/109302772 shutdown_connections 2023-10-18T22:17:38.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.139+0000 7f827ffff700 1 -- 172.21.15.8:0/109302772 wait complete. 2023-10-18T22:17:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.273+0000 7f15726e7700 1 -- 172.21.15.8:0/1085476960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c0f8740 msgr2=0x7f156c0f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.273+0000 7f15726e7700 1 --2- 172.21.15.8:0/1085476960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c0f8740 0x7f156c0f8b60 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f1568004660 tx=0x7f1568009b30).stop 2023-10-18T22:17:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.273+0000 7f15726e7700 1 -- 172.21.15.8:0/1085476960 shutdown_connections 2023-10-18T22:17:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.273+0000 7f15726e7700 1 --2- 172.21.15.8:0/1085476960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f156c0f99e0 0x7f156c0f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.273+0000 7f15726e7700 1 --2- 172.21.15.8:0/1085476960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c0f8740 0x7f156c0f8b60 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.273+0000 7f15726e7700 1 -- 172.21.15.8:0/1085476960 >> 172.21.15.8:0/1085476960 conn(0x7f156c0f40e0 msgr2=0x7f156c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:38.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.273+0000 7f15726e7700 1 -- 172.21.15.8:0/1085476960 shutdown_connections 2023-10-18T22:17:38.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.273+0000 7f15726e7700 1 -- 172.21.15.8:0/1085476960 wait complete. 2023-10-18T22:17:38.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.274+0000 7f15726e7700 1 Processor -- start 2023-10-18T22:17:38.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.274+0000 7f15726e7700 1 -- start start 2023-10-18T22:17:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.274+0000 7f15726e7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f156c0f8740 0x7f156c108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.274+0000 7f15726e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c0f99e0 0x7f156c1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.274+0000 7f15726e7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c109a60 con 0x7f156c0f99e0 2023-10-18T22:17:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.274+0000 7f15726e7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c109ba0 con 0x7f156c0f8740 2023-10-18T22:17:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.275+0000 7f1570ee4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c0f99e0 0x7f156c1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.275+0000 7f1570ee4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c0f99e0 0x7f156c1094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50866/0 (socket says 172.21.15.8:50866) 2023-10-18T22:17:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.275+0000 7f1570ee4700 1 -- 172.21.15.8:0/3355342834 learned_addr learned my addr 172.21.15.8:0/3355342834 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.275+0000 7f15716e5700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f156c0f8740 0x7f156c108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:38.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.275+0000 7f1570ee4700 1 -- 172.21.15.8:0/3355342834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f156c0f8740 msgr2=0x7f156c108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.275+0000 7f1570ee4700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f156c0f8740 0x7f156c108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.275+0000 7f1570ee4700 1 -- 172.21.15.8:0/3355342834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1568005040 con 0x7f156c0f99e0 2023-10-18T22:17:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.275+0000 7f1570ee4700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c0f99e0 0x7f156c1094b0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f155c0026d0 tx=0x7f155c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.276+0000 7f1561ffb700 1 -- 172.21.15.8:0/3355342834 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f155c009320 con 0x7f156c0f99e0 2023-10-18T22:17:38.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.276+0000 7f1561ffb700 1 -- 172.21.15.8:0/3355342834 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f155c00f040 con 0x7f156c0f99e0 2023-10-18T22:17:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.276+0000 7f1561ffb700 1 -- 172.21.15.8:0/3355342834 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f155c0148a0 con 0x7f156c0f99e0 2023-10-18T22:17:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.276+0000 7f15726e7700 1 -- 172.21.15.8:0/3355342834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c10a540 con 0x7f156c0f99e0 2023-10-18T22:17:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.276+0000 7f15726e7700 1 -- 172.21.15.8:0/3355342834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c10ab00 con 0x7f156c0f99e0 2023-10-18T22:17:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.277+0000 7f15726e7700 1 -- 172.21.15.8:0/3355342834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c045ad0 con 0x7f156c0f99e0 2023-10-18T22:17:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.278+0000 7f1561ffb700 1 -- 172.21.15.8:0/3355342834 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f155c009480 con 0x7f156c0f99e0 2023-10-18T22:17:38.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.279+0000 7f1561ffb700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1558060f70 0x7f1558063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:38.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.279+0000 7f1561ffb700 1 -- 172.21.15.8:0/3355342834 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f155c07cf60 con 0x7f156c0f99e0 2023-10-18T22:17:38.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.279+0000 7f15716e5700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1558060f70 0x7f1558063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:38.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.280+0000 7f15716e5700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1558060f70 0x7f1558063430 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f1568004630 tx=0x7f1568009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:38.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.283+0000 7f1561ffb700 1 -- 172.21.15.8:0/3355342834 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f155c0505c0 con 0x7f156c0f99e0 2023-10-18T22:17:38.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.535+0000 7f15726e7700 1 -- 172.21.15.8:0/3355342834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f156c027a00 con 0x7f156c0f99e0 2023-10-18T22:17:38.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.536+0000 7f1561ffb700 1 -- 172.21.15.8:0/3355342834 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f155c0501b0 con 0x7f156c0f99e0 2023-10-18T22:17:38.539 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:17:38.539 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:17:38.539 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:17:38.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:17:38.540 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:17:38.540 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:17:38.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:17:38.540 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:17:38.540 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:17:38.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:17:38.541 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:17:38.541 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:17:38.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:17:38.541 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:17:38.542 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:17:38.542 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:17:38.542 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:17:38.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 -- 172.21.15.8:0/3355342834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1558060f70 msgr2=0x7f1558063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:38.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1558060f70 0x7f1558063430 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f1568004630 tx=0x7f1568009b30).stop 2023-10-18T22:17:38.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 -- 172.21.15.8:0/3355342834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c0f99e0 msgr2=0x7f156c1094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:38.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c0f99e0 0x7f156c1094b0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f155c0026d0 tx=0x7f155c009de0).stop 2023-10-18T22:17:38.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 -- 172.21.15.8:0/3355342834 shutdown_connections 2023-10-18T22:17:38.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1558060f70 0x7f1558063430 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f156c0f8740 0x7f156c108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 --2- 172.21.15.8:0/3355342834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c0f99e0 0x7f156c1094b0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 -- 172.21.15.8:0/3355342834 >> 172.21.15.8:0/3355342834 conn(0x7f156c0f40e0 msgr2=0x7f156c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:38.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 -- 172.21.15.8:0/3355342834 shutdown_connections 2023-10-18T22:17:38.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.538+0000 7f15726e7700 1 -- 172.21.15.8:0/3355342834 wait complete. 2023-10-18T22:17:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:37.038803+0000 mgr.smithi008.flmjzp (mgr.14640) 4719 : cluster [DBG] pgmap v3239: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:37.068519+0000 mgr.smithi008.flmjzp (mgr.14640) 4720 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:37.069085+0000 mgr.smithi008.flmjzp (mgr.14640) 4721 : cluster [DBG] pgmap v3240: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:37.069401+0000 mgr.smithi008.flmjzp (mgr.14640) 4722 : cluster [DBG] pgmap v3241: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:37.093763+0000 mgr.smithi008.flmjzp (mgr.14640) 4723 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:38.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.676+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2237037159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf58060310 msgr2=0x7fdf580f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:38.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.676+0000 7fdf5e3fc700 1 --2- 172.21.15.8:0/2237037159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf58060310 0x7fdf580f9120 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7fdf54004660 tx=0x7fdf54009b30).stop 2023-10-18T22:17:38.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.676+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2237037159 shutdown_connections 2023-10-18T22:17:38.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.676+0000 7fdf5e3fc700 1 --2- 172.21.15.8:0/2237037159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf580f96a0 0x7fdf580fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.676+0000 7fdf5e3fc700 1 --2- 172.21.15.8:0/2237037159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf58060310 0x7fdf580f9120 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.676+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2237037159 >> 172.21.15.8:0/2237037159 conn(0x7fdf580f0ba0 msgr2=0x7fdf580f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:38.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.676+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2237037159 shutdown_connections 2023-10-18T22:17:38.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.676+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2237037159 wait complete. 2023-10-18T22:17:38.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.677+0000 7fdf5e3fc700 1 Processor -- start 2023-10-18T22:17:38.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.677+0000 7fdf5e3fc700 1 -- start start 2023-10-18T22:17:38.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.677+0000 7fdf5e3fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf58060310 0x7fdf58108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:38.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.677+0000 7fdf5e3fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf580f96a0 0x7fdf58109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:38.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.677+0000 7fdf5e3fc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58109a10 con 0x7fdf58060310 2023-10-18T22:17:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.677+0000 7fdf5e3fc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58109b50 con 0x7fdf580f96a0 2023-10-18T22:17:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.677+0000 7fdf5d3fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf58060310 0x7fdf58108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf5d3fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf58060310 0x7fdf58108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50886/0 (socket says 172.21.15.8:50886) 2023-10-18T22:17:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf5d3fa700 1 -- 172.21.15.8:0/2049508877 learned_addr learned my addr 172.21.15.8:0/2049508877 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf5cbf9700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf580f96a0 0x7fdf58109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:38.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf5d3fa700 1 -- 172.21.15.8:0/2049508877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf580f96a0 msgr2=0x7fdf58109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:38.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf5d3fa700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf580f96a0 0x7fdf58109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf5d3fa700 1 -- 172.21.15.8:0/2049508877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf54005040 con 0x7fdf58060310 2023-10-18T22:17:38.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf5d3fa700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf58060310 0x7fdf58108f70 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7fdf54009f50 tx=0x7fdf54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:38.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf4dffb700 1 -- 172.21.15.8:0/2049508877 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf54018070 con 0x7fdf58060310 2023-10-18T22:17:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf4dffb700 1 -- 172.21.15.8:0/2049508877 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdf54009630 con 0x7fdf58060310 2023-10-18T22:17:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2049508877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5810a490 con 0x7fdf58060310 2023-10-18T22:17:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.678+0000 7fdf4dffb700 1 -- 172.21.15.8:0/2049508877 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf5401c3c0 con 0x7fdf58060310 2023-10-18T22:17:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.679+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2049508877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5810a9f0 con 0x7fdf58060310 2023-10-18T22:17:38.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.679+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2049508877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf58045ad0 con 0x7fdf58060310 2023-10-18T22:17:38.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.680+0000 7fdf4dffb700 1 -- 172.21.15.8:0/2049508877 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdf5401d420 con 0x7fdf58060310 2023-10-18T22:17:38.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.681+0000 7fdf4dffb700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdf44060f70 0x7fdf44063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:38.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.681+0000 7fdf4dffb700 1 -- 172.21.15.8:0/2049508877 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdf5407e480 con 0x7fdf58060310 2023-10-18T22:17:38.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.681+0000 7fdf5cbf9700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdf44060f70 0x7fdf44063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:38.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.682+0000 7fdf5cbf9700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdf44060f70 0x7fdf44063430 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fdf580600e0 tx=0x7fdf4800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:38.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.685+0000 7fdf4dffb700 1 -- 172.21.15.8:0/2049508877 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdf54051ba0 con 0x7fdf58060310 2023-10-18T22:17:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:37.038803+0000 mgr.smithi008.flmjzp (mgr.14640) 4719 : cluster [DBG] pgmap v3239: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:37.068519+0000 mgr.smithi008.flmjzp (mgr.14640) 4720 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:37.069085+0000 mgr.smithi008.flmjzp (mgr.14640) 4721 : cluster [DBG] pgmap v3240: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:37.069401+0000 mgr.smithi008.flmjzp (mgr.14640) 4722 : cluster [DBG] pgmap v3241: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:37.093763+0000 mgr.smithi008.flmjzp (mgr.14640) 4723 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:38.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.909+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2049508877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdf5810f590 con 0x7fdf58060310 2023-10-18T22:17:38.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.910+0000 7fdf4dffb700 1 -- 172.21.15.8:0/2049508877 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fdf54051790 con 0x7fdf58060310 2023-10-18T22:17:38.912 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:17:38.912 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:17:38.913 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:17:38.913 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:17:38.913 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:17:38.913 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:17:38.913 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:17:38.914 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:17:38.914 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:17:38.914 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:17:38.914 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:17:38.914 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:17:38.915 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:17:38.915 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:17:38.915 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:17:38.915 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:17:38.915 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:17:38.916 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:17:38.916 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:17:38.916 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:17:38.916 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:17:38.916 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:17:38.917 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:17:38.917 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:17:38.917 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:17:38.917 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:17:38.917 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:17:38.918 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:17:38.918 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:17:38.918 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:17:38.918 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:17:38.918 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:17:38.919 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:17:38.919 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:17:38.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.911+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2049508877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdf44060f70 msgr2=0x7fdf44063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:38.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.911+0000 7fdf5e3fc700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdf44060f70 0x7fdf44063430 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fdf580600e0 tx=0x7fdf4800b040).stop 2023-10-18T22:17:38.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.911+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2049508877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf58060310 msgr2=0x7fdf58108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:38.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.911+0000 7fdf5e3fc700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf58060310 0x7fdf58108f70 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7fdf54009f50 tx=0x7fdf54009b30).stop 2023-10-18T22:17:38.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.912+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2049508877 shutdown_connections 2023-10-18T22:17:38.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.912+0000 7fdf5e3fc700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdf44060f70 0x7fdf44063430 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.912+0000 7fdf5e3fc700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf58060310 0x7fdf58108f70 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.912+0000 7fdf5e3fc700 1 --2- 172.21.15.8:0/2049508877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf580f96a0 0x7fdf58109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:38.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.912+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2049508877 >> 172.21.15.8:0/2049508877 conn(0x7fdf580f0ba0 msgr2=0x7fdf580f4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:38.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.912+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2049508877 shutdown_connections 2023-10-18T22:17:38.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:38.912+0000 7fdf5e3fc700 1 -- 172.21.15.8:0/2049508877 wait complete. 2023-10-18T22:17:38.922 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:17:39.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.049+0000 7f824dda0700 1 -- 172.21.15.8:0/2056078919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f824806c340 msgr2=0x7f824806c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:39.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.049+0000 7f824dda0700 1 --2- 172.21.15.8:0/2056078919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f824806c340 0x7f824806c760 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f823c004660 tx=0x7f823c009b30).stop 2023-10-18T22:17:39.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.049+0000 7f824dda0700 1 -- 172.21.15.8:0/2056078919 shutdown_connections 2023-10-18T22:17:39.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.049+0000 7f824dda0700 1 --2- 172.21.15.8:0/2056078919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f824806d630 0x7f824806dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:39.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.049+0000 7f824dda0700 1 --2- 172.21.15.8:0/2056078919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f824806c340 0x7f824806c760 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:39.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.049+0000 7f824dda0700 1 -- 172.21.15.8:0/2056078919 >> 172.21.15.8:0/2056078919 conn(0x7f82480f40e0 msgr2=0x7f82480f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:39.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.049+0000 7f824dda0700 1 -- 172.21.15.8:0/2056078919 shutdown_connections 2023-10-18T22:17:39.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.049+0000 7f824dda0700 1 -- 172.21.15.8:0/2056078919 wait complete. 2023-10-18T22:17:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.050+0000 7f824dda0700 1 Processor -- start 2023-10-18T22:17:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.050+0000 7f824dda0700 1 -- start start 2023-10-18T22:17:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f824dda0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f824806c340 0x7f824810d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f824dda0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f824806d630 0x7f824810d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f824dda0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824810dd40 con 0x7f824806c340 2023-10-18T22:17:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f824dda0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824810de80 con 0x7f824806d630 2023-10-18T22:17:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f824cd9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f824806c340 0x7f824810d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f824cd9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f824806c340 0x7f824810d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50902/0 (socket says 172.21.15.8:50902) 2023-10-18T22:17:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f824cd9e700 1 -- 172.21.15.8:0/3158811259 learned_addr learned my addr 172.21.15.8:0/3158811259 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:17:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f8247fff700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f824806d630 0x7f824810d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f824cd9e700 1 -- 172.21.15.8:0/3158811259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f824806d630 msgr2=0x7f824810d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f824cd9e700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f824806d630 0x7f824810d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.051+0000 7f824cd9e700 1 -- 172.21.15.8:0/3158811259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c005040 con 0x7f824806c340 2023-10-18T22:17:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.052+0000 7f824cd9e700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f824806c340 0x7f824810d2a0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f823c004d80 tx=0x7f823c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.052+0000 7f82457fa700 1 -- 172.21.15.8:0/3158811259 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f823c019070 con 0x7f824806c340 2023-10-18T22:17:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.052+0000 7f824dda0700 1 -- 172.21.15.8:0/3158811259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824810e7c0 con 0x7f824806c340 2023-10-18T22:17:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.052+0000 7f82457fa700 1 -- 172.21.15.8:0/3158811259 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f823c01e420 con 0x7f824806c340 2023-10-18T22:17:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.052+0000 7f82457fa700 1 -- 172.21.15.8:0/3158811259 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f823c014680 con 0x7f824806c340 2023-10-18T22:17:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.052+0000 7f824dda0700 1 -- 172.21.15.8:0/3158811259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824810eca0 con 0x7f824806c340 2023-10-18T22:17:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.053+0000 7f824dda0700 1 -- 172.21.15.8:0/3158811259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8248045ad0 con 0x7f824806c340 2023-10-18T22:17:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.054+0000 7f82457fa700 1 -- 172.21.15.8:0/3158811259 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f823c01e9c0 con 0x7f824806c340 2023-10-18T22:17:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.055+0000 7f82457fa700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8238060f70 0x7f8238063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:17:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.055+0000 7f82457fa700 1 -- 172.21.15.8:0/3158811259 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f823c07ddf0 con 0x7f824806c340 2023-10-18T22:17:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.055+0000 7f8247fff700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8238060f70 0x7f8238063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:17:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.056+0000 7f8247fff700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8238060f70 0x7f8238063430 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f8234007f80 tx=0x7f823400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:17:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.059+0000 7f82457fa700 1 -- 172.21.15.8:0/3158811259 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f823c051490 con 0x7f824806c340 2023-10-18T22:17:39.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.258+0000 7f824dda0700 1 -- 172.21.15.8:0/3158811259 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8248105360 con 0x7f8238060f70 2023-10-18T22:17:39.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.259+0000 7f82457fa700 1 -- 172.21.15.8:0/3158811259 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8248105360 con 0x7f8238060f70 2023-10-18T22:17:39.262 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:17:39.262 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:17:39.262 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:17:39.262 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:17:39.263 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:17:39.263 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:17:39.263 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:17:39.263 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:17:39.263 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:17:39.264 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:17:39.264 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:17:39.264 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:17:39.264 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:17:39.264 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:17:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 -- 172.21.15.8:0/3158811259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8238060f70 msgr2=0x7f8238063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8238060f70 0x7f8238063430 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f8234007f80 tx=0x7f823400b040).stop 2023-10-18T22:17:39.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 -- 172.21.15.8:0/3158811259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f824806c340 msgr2=0x7f824810d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:17:39.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f824806c340 0x7f824810d2a0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f823c004d80 tx=0x7f823c00b040).stop 2023-10-18T22:17:39.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 -- 172.21.15.8:0/3158811259 shutdown_connections 2023-10-18T22:17:39.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8238060f70 0x7f8238063430 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:39.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f824806c340 0x7f824810d2a0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:39.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 --2- 172.21.15.8:0/3158811259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f824806d630 0x7f824810d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:17:39.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 -- 172.21.15.8:0/3158811259 >> 172.21.15.8:0/3158811259 conn(0x7f82480f40e0 msgr2=0x7f8248103300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:17:39.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 -- 172.21.15.8:0/3158811259 shutdown_connections 2023-10-18T22:17:39.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:17:39.262+0000 7f824dda0700 1 -- 172.21.15.8:0/3158811259 wait complete. 2023-10-18T22:17:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.443722+0000 mgr.smithi008.flmjzp (mgr.14640) 4724 : audit [DBG] from='client.37792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:37.791407+0000 mgr.smithi008.flmjzp (mgr.14640) 4725 : audit [DBG] from='client.37796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:38.129428+0000 mgr.smithi008.flmjzp (mgr.14640) 4726 : audit [DBG] from='client.37800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:38.537513+0000 mon.smithi008 (mon.0) 5007 : audit [DBG] from='client.? 172.21.15.8:0/3355342834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:39.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:38.911219+0000 mon.smithi008 (mon.0) 5008 : audit [DBG] from='client.? 172.21.15.8:0/2049508877' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:17:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.443722+0000 mgr.smithi008.flmjzp (mgr.14640) 4724 : audit [DBG] from='client.37792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:37.791407+0000 mgr.smithi008.flmjzp (mgr.14640) 4725 : audit [DBG] from='client.37796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:38.129428+0000 mgr.smithi008.flmjzp (mgr.14640) 4726 : audit [DBG] from='client.37800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:38.537513+0000 mon.smithi008 (mon.0) 5007 : audit [DBG] from='client.? 172.21.15.8:0/3355342834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:39.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:38.911219+0000 mon.smithi008 (mon.0) 5008 : audit [DBG] from='client.? 172.21.15.8:0/2049508877' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:17:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:39.069864+0000 mgr.smithi008.flmjzp (mgr.14640) 4727 : cluster [DBG] pgmap v3242: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:39.260833+0000 mgr.smithi008.flmjzp (mgr.14640) 4728 : audit [DBG] from='client.37812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:39.069864+0000 mgr.smithi008.flmjzp (mgr.14640) 4727 : cluster [DBG] pgmap v3242: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:39.260833+0000 mgr.smithi008.flmjzp (mgr.14640) 4728 : audit [DBG] from='client.37812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:17:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:41.070430+0000 mgr.smithi008.flmjzp (mgr.14640) 4729 : cluster [DBG] pgmap v3243: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:41.070430+0000 mgr.smithi008.flmjzp (mgr.14640) 4729 : cluster [DBG] pgmap v3243: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:43.071053+0000 mgr.smithi008.flmjzp (mgr.14640) 4730 : cluster [DBG] pgmap v3244: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:43.071053+0000 mgr.smithi008.flmjzp (mgr.14640) 4730 : cluster [DBG] pgmap v3244: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:46.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:45.071707+0000 mgr.smithi008.flmjzp (mgr.14640) 4731 : cluster [DBG] pgmap v3245: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:45.071707+0000 mgr.smithi008.flmjzp (mgr.14640) 4731 : cluster [DBG] pgmap v3245: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:47.104188+0000 mon.smithi008 (mon.0) 5009 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:47.106270+0000 mon.smithi008 (mon.0) 5010 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:47.107187+0000 mon.smithi008 (mon.0) 5011 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:47.113632+0000 mon.smithi008 (mon.0) 5012 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:47.120157+0000 mon.smithi008 (mon.0) 5013 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:47.122995+0000 mon.smithi008 (mon.0) 5014 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:47.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:47.124610+0000 mon.smithi008 (mon.0) 5015 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:47.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:47.126203+0000 mon.smithi008 (mon.0) 5016 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:47.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:47.128224+0000 mon.smithi008 (mon.0) 5017 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:47.104188+0000 mon.smithi008 (mon.0) 5009 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:47.106270+0000 mon.smithi008 (mon.0) 5010 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:47.107187+0000 mon.smithi008 (mon.0) 5011 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:47.113632+0000 mon.smithi008 (mon.0) 5012 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:47.120157+0000 mon.smithi008 (mon.0) 5013 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:47.122995+0000 mon.smithi008 (mon.0) 5014 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:47.124610+0000 mon.smithi008 (mon.0) 5015 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:47.126203+0000 mon.smithi008 (mon.0) 5016 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:47.128224+0000 mon.smithi008 (mon.0) 5017 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:47.072266+0000 mgr.smithi008.flmjzp (mgr.14640) 4732 : cluster [DBG] pgmap v3246: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:47.107973+0000 mgr.smithi008.flmjzp (mgr.14640) 4733 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:47.108553+0000 mgr.smithi008.flmjzp (mgr.14640) 4734 : cluster [DBG] pgmap v3247: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:47.108872+0000 mgr.smithi008.flmjzp (mgr.14640) 4735 : cluster [DBG] pgmap v3248: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:47.130098+0000 mgr.smithi008.flmjzp (mgr.14640) 4736 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:47.072266+0000 mgr.smithi008.flmjzp (mgr.14640) 4732 : cluster [DBG] pgmap v3246: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:47.107973+0000 mgr.smithi008.flmjzp (mgr.14640) 4733 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:47.108553+0000 mgr.smithi008.flmjzp (mgr.14640) 4734 : cluster [DBG] pgmap v3247: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:47.108872+0000 mgr.smithi008.flmjzp (mgr.14640) 4735 : cluster [DBG] pgmap v3248: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:47.130098+0000 mgr.smithi008.flmjzp (mgr.14640) 4736 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:49.109509+0000 mgr.smithi008.flmjzp (mgr.14640) 4737 : cluster [DBG] pgmap v3249: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:49.109509+0000 mgr.smithi008.flmjzp (mgr.14640) 4737 : cluster [DBG] pgmap v3249: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:51.110120+0000 mgr.smithi008.flmjzp (mgr.14640) 4738 : cluster [DBG] pgmap v3250: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:52.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:51.110120+0000 mgr.smithi008.flmjzp (mgr.14640) 4738 : cluster [DBG] pgmap v3250: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:53.110652+0000 mgr.smithi008.flmjzp (mgr.14640) 4739 : cluster [DBG] pgmap v3251: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:53.110652+0000 mgr.smithi008.flmjzp (mgr.14640) 4739 : cluster [DBG] pgmap v3251: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:55.111350+0000 mgr.smithi008.flmjzp (mgr.14640) 4740 : cluster [DBG] pgmap v3252: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:55.111350+0000 mgr.smithi008.flmjzp (mgr.14640) 4740 : cluster [DBG] pgmap v3252: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:57.137364+0000 mon.smithi008 (mon.0) 5018 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:57.139566+0000 mon.smithi008 (mon.0) 5019 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:57.140582+0000 mon.smithi008 (mon.0) 5020 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:57.147333+0000 mon.smithi008 (mon.0) 5021 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:57.155252+0000 mon.smithi008 (mon.0) 5022 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:57.158843+0000 mon.smithi008 (mon.0) 5023 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:57.160828+0000 mon.smithi008 (mon.0) 5024 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:57.162702+0000 mon.smithi008 (mon.0) 5025 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:17:57.165324+0000 mon.smithi008 (mon.0) 5026 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:57.137364+0000 mon.smithi008 (mon.0) 5018 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:57.139566+0000 mon.smithi008 (mon.0) 5019 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:17:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:57.140582+0000 mon.smithi008 (mon.0) 5020 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:17:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:57.147333+0000 mon.smithi008 (mon.0) 5021 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:17:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:57.155252+0000 mon.smithi008 (mon.0) 5022 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:17:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:57.158843+0000 mon.smithi008 (mon.0) 5023 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:57.160828+0000 mon.smithi008 (mon.0) 5024 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:57.162702+0000 mon.smithi008 (mon.0) 5025 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:17:57.165324+0000 mon.smithi008 (mon.0) 5026 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:17:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:57.111944+0000 mgr.smithi008.flmjzp (mgr.14640) 4741 : cluster [DBG] pgmap v3253: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:57.141493+0000 mgr.smithi008.flmjzp (mgr.14640) 4742 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:57.142037+0000 mgr.smithi008.flmjzp (mgr.14640) 4743 : cluster [DBG] pgmap v3254: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:57.142300+0000 mgr.smithi008.flmjzp (mgr.14640) 4744 : cluster [DBG] pgmap v3255: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:17:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:17:57.167478+0000 mgr.smithi008.flmjzp (mgr.14640) 4745 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:17:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:57.111944+0000 mgr.smithi008.flmjzp (mgr.14640) 4741 : cluster [DBG] pgmap v3253: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:57.141493+0000 mgr.smithi008.flmjzp (mgr.14640) 4742 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:17:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:57.142037+0000 mgr.smithi008.flmjzp (mgr.14640) 4743 : cluster [DBG] pgmap v3254: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:57.142300+0000 mgr.smithi008.flmjzp (mgr.14640) 4744 : cluster [DBG] pgmap v3255: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:17:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:17:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:17:57.167478+0000 mgr.smithi008.flmjzp (mgr.14640) 4745 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:17:59.142986+0000 mgr.smithi008.flmjzp (mgr.14640) 4746 : cluster [DBG] pgmap v3256: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:17:59.142986+0000 mgr.smithi008.flmjzp (mgr.14640) 4746 : cluster [DBG] pgmap v3256: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:01.143544+0000 mgr.smithi008.flmjzp (mgr.14640) 4747 : cluster [DBG] pgmap v3257: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:01.143544+0000 mgr.smithi008.flmjzp (mgr.14640) 4747 : cluster [DBG] pgmap v3257: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:03.144062+0000 mgr.smithi008.flmjzp (mgr.14640) 4748 : cluster [DBG] pgmap v3258: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:03.144062+0000 mgr.smithi008.flmjzp (mgr.14640) 4748 : cluster [DBG] pgmap v3258: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:05.144792+0000 mgr.smithi008.flmjzp (mgr.14640) 4749 : cluster [DBG] pgmap v3259: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:05.144792+0000 mgr.smithi008.flmjzp (mgr.14640) 4749 : cluster [DBG] pgmap v3259: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:07.170554+0000 mon.smithi008 (mon.0) 5027 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:07.170554+0000 mon.smithi008 (mon.0) 5027 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:07.145368+0000 mgr.smithi008.flmjzp (mgr.14640) 4750 : cluster [DBG] pgmap v3260: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:07.733082+0000 mon.smithi008 (mon.0) 5028 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:18:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:07.733934+0000 mon.smithi008 (mon.0) 5029 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:18:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:07.739056+0000 mon.smithi008 (mon.0) 5030 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:07.743994+0000 mon.smithi008 (mon.0) 5031 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:07.746406+0000 mon.smithi008 (mon.0) 5032 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:07.747708+0000 mon.smithi008 (mon.0) 5033 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:07.749035+0000 mon.smithi008 (mon.0) 5034 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:07.750611+0000 mon.smithi008 (mon.0) 5035 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:07.145368+0000 mgr.smithi008.flmjzp (mgr.14640) 4750 : cluster [DBG] pgmap v3260: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:07.733082+0000 mon.smithi008 (mon.0) 5028 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:18:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:07.733934+0000 mon.smithi008 (mon.0) 5029 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:18:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:07.739056+0000 mon.smithi008 (mon.0) 5030 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:07.743994+0000 mon.smithi008 (mon.0) 5031 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:07.746406+0000 mon.smithi008 (mon.0) 5032 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:07.747708+0000 mon.smithi008 (mon.0) 5033 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:07.749035+0000 mon.smithi008 (mon.0) 5034 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:07.750611+0000 mon.smithi008 (mon.0) 5035 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:09.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.417+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/1752285191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e580f77d0 msgr2=0x7f0e580f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:09.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.417+0000 7f0e5e1ad700 1 --2- 172.21.15.8:0/1752285191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e580f77d0 0x7f0e580f7c30 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f0e48004660 tx=0x7f0e48009b30).stop 2023-10-18T22:18:09.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.417+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/1752285191 shutdown_connections 2023-10-18T22:18:09.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.417+0000 7f0e5e1ad700 1 --2- 172.21.15.8:0/1752285191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e580f77d0 0x7f0e580f7c30 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.417+0000 7f0e5e1ad700 1 --2- 172.21.15.8:0/1752285191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e580f6530 0x7f0e580f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.417+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/1752285191 >> 172.21.15.8:0/1752285191 conn(0x7f0e580f1c90 msgr2=0x7f0e580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:09.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.417+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/1752285191 shutdown_connections 2023-10-18T22:18:09.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.417+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/1752285191 wait complete. 2023-10-18T22:18:09.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.418+0000 7f0e5e1ad700 1 Processor -- start 2023-10-18T22:18:09.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.418+0000 7f0e5e1ad700 1 -- start start 2023-10-18T22:18:09.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.418+0000 7f0e5e1ad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e580f6530 0x7f0e58108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:09.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.418+0000 7f0e5e1ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e580f77d0 0x7f0e581093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:09.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.418+0000 7f0e5e1ad700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581099a0 con 0x7f0e580f6530 2023-10-18T22:18:09.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.418+0000 7f0e5e1ad700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58109ae0 con 0x7f0e580f77d0 2023-10-18T22:18:09.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.418+0000 7f0e5d1ab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e580f6530 0x7f0e58108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:09.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e5d1ab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e580f6530 0x7f0e58108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45824/0 (socket says 172.21.15.8:45824) 2023-10-18T22:18:09.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e5d1ab700 1 -- 172.21.15.8:0/2220289965 learned_addr learned my addr 172.21.15.8:0/2220289965 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:09.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e5c9aa700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e580f77d0 0x7f0e581093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:09.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e5d1ab700 1 -- 172.21.15.8:0/2220289965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e580f77d0 msgr2=0x7f0e581093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:09.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e5d1ab700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e580f77d0 0x7f0e581093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e5d1ab700 1 -- 172.21.15.8:0/2220289965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48005040 con 0x7f0e580f6530 2023-10-18T22:18:09.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e5d1ab700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e580f6530 0x7f0e58108f00 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f0e5400e7c0 tx=0x7f0e5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:09.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e4dffb700 1 -- 172.21.15.8:0/2220289965 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e540092e0 con 0x7f0e580f6530 2023-10-18T22:18:09.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e4dffb700 1 -- 172.21.15.8:0/2220289965 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0e5400f040 con 0x7f0e580f6530 2023-10-18T22:18:09.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/2220289965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5810a480 con 0x7f0e580f6530 2023-10-18T22:18:09.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.419+0000 7f0e4dffb700 1 -- 172.21.15.8:0/2220289965 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e540147e0 con 0x7f0e580f6530 2023-10-18T22:18:09.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.420+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/2220289965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5810a9c0 con 0x7f0e580f6530 2023-10-18T22:18:09.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.421+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/2220289965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e58045ad0 con 0x7f0e580f6530 2023-10-18T22:18:09.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.422+0000 7f0e4dffb700 1 -- 172.21.15.8:0/2220289965 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0e5401b030 con 0x7f0e580f6530 2023-10-18T22:18:09.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.422+0000 7f0e4dffb700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e44060f70 0x7f0e44063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:09.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.423+0000 7f0e4dffb700 1 -- 172.21.15.8:0/2220289965 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0e5407c990 con 0x7f0e580f6530 2023-10-18T22:18:09.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.423+0000 7f0e5c9aa700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e44060f70 0x7f0e44063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:09.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.423+0000 7f0e5c9aa700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e44060f70 0x7f0e44063430 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f0e480043d0 tx=0x7f0e4800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:09.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.427+0000 7f0e4dffb700 1 -- 172.21.15.8:0/2220289965 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0e5404ff10 con 0x7f0e580f6530 2023-10-18T22:18:09.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.623+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/2220289965 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e5810ac30 con 0x7f0e44060f70 2023-10-18T22:18:09.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.624+0000 7f0e4dffb700 1 -- 172.21.15.8:0/2220289965 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0e5810ac30 con 0x7f0e44060f70 2023-10-18T22:18:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.626+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/2220289965 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e44060f70 msgr2=0x7f0e44063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.626+0000 7f0e5e1ad700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e44060f70 0x7f0e44063430 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f0e480043d0 tx=0x7f0e4800b040).stop 2023-10-18T22:18:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.626+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/2220289965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e580f6530 msgr2=0x7f0e58108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:09.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.626+0000 7f0e5e1ad700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e580f6530 0x7f0e58108f00 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f0e5400e7c0 tx=0x7f0e5400b040).stop 2023-10-18T22:18:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.626+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/2220289965 shutdown_connections 2023-10-18T22:18:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.626+0000 7f0e5e1ad700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0e44060f70 0x7f0e44063430 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.626+0000 7f0e5e1ad700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e580f6530 0x7f0e58108f00 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.626+0000 7f0e5e1ad700 1 --2- 172.21.15.8:0/2220289965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e580f77d0 0x7f0e581093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.626+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/2220289965 >> 172.21.15.8:0/2220289965 conn(0x7f0e580f1c90 msgr2=0x7f0e5806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:09.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.627+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/2220289965 shutdown_connections 2023-10-18T22:18:09.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.627+0000 7f0e5e1ad700 1 -- 172.21.15.8:0/2220289965 wait complete. 2023-10-18T22:18:09.642 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:18:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:18:07.734630+0000 mgr.smithi008.flmjzp (mgr.14640) 4751 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:18:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:07.735080+0000 mgr.smithi008.flmjzp (mgr.14640) 4752 : cluster [DBG] pgmap v3261: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:07.735303+0000 mgr.smithi008.flmjzp (mgr.14640) 4753 : cluster [DBG] pgmap v3262: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:18:07.752208+0000 mgr.smithi008.flmjzp (mgr.14640) 4754 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:09.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:18:07.734630+0000 mgr.smithi008.flmjzp (mgr.14640) 4751 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:18:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:07.735080+0000 mgr.smithi008.flmjzp (mgr.14640) 4752 : cluster [DBG] pgmap v3261: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:07.735303+0000 mgr.smithi008.flmjzp (mgr.14640) 4753 : cluster [DBG] pgmap v3262: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:18:07.752208+0000 mgr.smithi008.flmjzp (mgr.14640) 4754 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:09.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.764+0000 7fe2b094d700 1 -- 172.21.15.8:0/2054910105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2ac0f6530 msgr2=0x7fe2ac0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:09.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.764+0000 7fe2b094d700 1 --2- 172.21.15.8:0/2054910105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2ac0f6530 0x7fe2ac0f6950 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fe29c004660 tx=0x7fe29c009b30).stop 2023-10-18T22:18:09.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.764+0000 7fe2b094d700 1 -- 172.21.15.8:0/2054910105 shutdown_connections 2023-10-18T22:18:09.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.764+0000 7fe2b094d700 1 --2- 172.21.15.8:0/2054910105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0f77d0 0x7fe2ac0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.764+0000 7fe2b094d700 1 --2- 172.21.15.8:0/2054910105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2ac0f6530 0x7fe2ac0f6950 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.764+0000 7fe2b094d700 1 -- 172.21.15.8:0/2054910105 >> 172.21.15.8:0/2054910105 conn(0x7fe2ac0f1c90 msgr2=0x7fe2ac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:09.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.764+0000 7fe2b094d700 1 -- 172.21.15.8:0/2054910105 shutdown_connections 2023-10-18T22:18:09.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.764+0000 7fe2b094d700 1 -- 172.21.15.8:0/2054910105 wait complete. 2023-10-18T22:18:09.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.765+0000 7fe2b094d700 1 Processor -- start 2023-10-18T22:18:09.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.765+0000 7fe2b094d700 1 -- start start 2023-10-18T22:18:09.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.765+0000 7fe2b094d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0f6530 0x7fe2ac106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:09.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2b094d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2ac0f77d0 0x7fe2ac107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:09.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2b094d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac107900 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2b094d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac108110 con 0x7fe2ac0f6530 2023-10-18T22:18:09.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2aa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2ac0f77d0 0x7fe2ac107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:09.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2aa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2ac0f77d0 0x7fe2ac107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45842/0 (socket says 172.21.15.8:45842) 2023-10-18T22:18:09.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2aa59c700 1 -- 172.21.15.8:0/3610171929 learned_addr learned my addr 172.21.15.8:0/3610171929 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:09.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2aad9d700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0f6530 0x7fe2ac106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:09.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2aa59c700 1 -- 172.21.15.8:0/3610171929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0f6530 msgr2=0x7fe2ac106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:09.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2aa59c700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0f6530 0x7fe2ac106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2aa59c700 1 -- 172.21.15.8:0/3610171929 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c005040 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.766+0000 7fe2aa59c700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2ac0f77d0 0x7fe2ac107300 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7fe2a00026d0 tx=0x7fe2a0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:09.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.767+0000 7fe2937fe700 1 -- 172.21.15.8:0/3610171929 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2a0009320 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.767+0000 7fe2937fe700 1 -- 172.21.15.8:0/3610171929 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe2a000f040 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.767+0000 7fe2b094d700 1 -- 172.21.15.8:0/3610171929 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ac108390 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.767+0000 7fe2937fe700 1 -- 172.21.15.8:0/3610171929 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2a00148a0 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.767+0000 7fe2b094d700 1 -- 172.21.15.8:0/3610171929 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac108950 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.768+0000 7fe2b094d700 1 -- 172.21.15.8:0/3610171929 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac059100 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.769+0000 7fe2937fe700 1 -- 172.21.15.8:0/3610171929 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe2a0009480 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.770+0000 7fe2937fe700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe294060f70 0x7fe294063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:09.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.770+0000 7fe2937fe700 1 -- 172.21.15.8:0/3610171929 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe2a007d090 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.770+0000 7fe2aad9d700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe294060f70 0x7fe294063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:09.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.771+0000 7fe2aad9d700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe294060f70 0x7fe294063430 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7fe2ac106b80 tx=0x7fe29c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:09.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.774+0000 7fe2937fe700 1 -- 172.21.15.8:0/3610171929 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe2a004cc40 con 0x7fe2ac0f77d0 2023-10-18T22:18:09.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.973+0000 7fe2b094d700 1 -- 172.21.15.8:0/3610171929 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2ac0fee30 con 0x7fe294060f70 2023-10-18T22:18:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.975+0000 7fe2937fe700 1 -- 172.21.15.8:0/3610171929 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe2ac0fee30 con 0x7fe294060f70 2023-10-18T22:18:09.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 -- 172.21.15.8:0/3610171929 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe294060f70 msgr2=0x7fe294063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:09.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe294060f70 0x7fe294063430 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7fe2ac106b80 tx=0x7fe29c009b30).stop 2023-10-18T22:18:09.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 -- 172.21.15.8:0/3610171929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2ac0f77d0 msgr2=0x7fe2ac107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:09.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2ac0f77d0 0x7fe2ac107300 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7fe2a00026d0 tx=0x7fe2a0009de0).stop 2023-10-18T22:18:09.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 -- 172.21.15.8:0/3610171929 shutdown_connections 2023-10-18T22:18:09.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe294060f70 0x7fe294063430 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0f6530 0x7fe2ac106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 --2- 172.21.15.8:0/3610171929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2ac0f77d0 0x7fe2ac107300 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:09.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 -- 172.21.15.8:0/3610171929 >> 172.21.15.8:0/3610171929 conn(0x7fe2ac0f1c90 msgr2=0x7fe2ac0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:09.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 -- 172.21.15.8:0/3610171929 shutdown_connections 2023-10-18T22:18:09.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:09.977+0000 7fe2b094d700 1 -- 172.21.15.8:0/3610171929 wait complete. 2023-10-18T22:18:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.113+0000 7fb24d37a700 1 -- 172.21.15.8:0/221151967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480f77d0 msgr2=0x7fb2480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.113+0000 7fb24d37a700 1 --2- 172.21.15.8:0/221151967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480f77d0 0x7fb2480f7c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb23c004660 tx=0x7fb23c009b30).stop 2023-10-18T22:18:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.113+0000 7fb24d37a700 1 -- 172.21.15.8:0/221151967 shutdown_connections 2023-10-18T22:18:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.113+0000 7fb24d37a700 1 --2- 172.21.15.8:0/221151967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480f77d0 0x7fb2480f7c30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.113+0000 7fb24d37a700 1 --2- 172.21.15.8:0/221151967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2480f6530 0x7fb2480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.113+0000 7fb24d37a700 1 -- 172.21.15.8:0/221151967 >> 172.21.15.8:0/221151967 conn(0x7fb2480f1c90 msgr2=0x7fb2480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.113+0000 7fb24d37a700 1 -- 172.21.15.8:0/221151967 shutdown_connections 2023-10-18T22:18:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.113+0000 7fb24d37a700 1 -- 172.21.15.8:0/221151967 wait complete. 2023-10-18T22:18:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.114+0000 7fb24d37a700 1 Processor -- start 2023-10-18T22:18:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.114+0000 7fb24d37a700 1 -- start start 2023-10-18T22:18:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb24d37a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480f6530 0x7fb248108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb24d37a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2480f77d0 0x7fb2481093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:10.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb24d37a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb248109950 con 0x7fb2480f77d0 2023-10-18T22:18:10.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb24d37a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb248109a90 con 0x7fb2480f6530 2023-10-18T22:18:10.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb2477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2480f77d0 0x7fb2481093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:10.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb2477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2480f77d0 0x7fb2481093a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45870/0 (socket says 172.21.15.8:45870) 2023-10-18T22:18:10.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb2477fe700 1 -- 172.21.15.8:0/1649030608 learned_addr learned my addr 172.21.15.8:0/1649030608 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:10.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb247fff700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480f6530 0x7fb248108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:10.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb2477fe700 1 -- 172.21.15.8:0/1649030608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480f6530 msgr2=0x7fb248108eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:10.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb2477fe700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480f6530 0x7fb248108eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.115+0000 7fb2477fe700 1 -- 172.21.15.8:0/1649030608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c005040 con 0x7fb2480f77d0 2023-10-18T22:18:10.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.116+0000 7fb2477fe700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2480f77d0 0x7fb2481093a0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7fb23c004d80 tx=0x7fb23c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.116+0000 7fb244ff9700 1 -- 172.21.15.8:0/1649030608 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb23c019070 con 0x7fb2480f77d0 2023-10-18T22:18:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.116+0000 7fb24d37a700 1 -- 172.21.15.8:0/1649030608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24810a3d0 con 0x7fb2480f77d0 2023-10-18T22:18:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.116+0000 7fb244ff9700 1 -- 172.21.15.8:0/1649030608 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb23c01e420 con 0x7fb2480f77d0 2023-10-18T22:18:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.116+0000 7fb244ff9700 1 -- 172.21.15.8:0/1649030608 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb23c014680 con 0x7fb2480f77d0 2023-10-18T22:18:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.116+0000 7fb24d37a700 1 -- 172.21.15.8:0/1649030608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24810a8b0 con 0x7fb2480f77d0 2023-10-18T22:18:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.117+0000 7fb24d37a700 1 -- 172.21.15.8:0/1649030608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb248045ad0 con 0x7fb2480f77d0 2023-10-18T22:18:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.118+0000 7fb244ff9700 1 -- 172.21.15.8:0/1649030608 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb23c01e9c0 con 0x7fb2480f77d0 2023-10-18T22:18:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.119+0000 7fb244ff9700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb230060f70 0x7fb230063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.119+0000 7fb244ff9700 1 -- 172.21.15.8:0/1649030608 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb23c07dd20 con 0x7fb2480f77d0 2023-10-18T22:18:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.119+0000 7fb247fff700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb230060f70 0x7fb230063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.120+0000 7fb247fff700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb230060f70 0x7fb230063430 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fb2480f7630 tx=0x7fb23800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.123+0000 7fb244ff9700 1 -- 172.21.15.8:0/1649030608 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb23c051440 con 0x7fb2480f77d0 2023-10-18T22:18:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.318+0000 7fb24d37a700 1 -- 172.21.15.8:0/1649030608 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2480fedd0 con 0x7fb230060f70 2023-10-18T22:18:10.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.328+0000 7fb244ff9700 1 -- 172.21.15.8:0/1649030608 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb2480fedd0 con 0x7fb230060f70 2023-10-18T22:18:10.329 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:18:10.329 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (84m) 115s ago 86m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:18:10.329 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (78m) 115s ago 86m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:18:10.330 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (78m) 10m ago 85m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:18:10.330 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (84m) 115s ago 85m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:18:10.330 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 115s ago 82m - - 2023-10-18T22:18:10.330 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 115s ago 82m - - 2023-10-18T22:18:10.330 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 10m ago 82m - - 2023-10-18T22:18:10.331 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 10m ago 82m - - 2023-10-18T22:18:10.331 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (79m) 115s ago 87m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:18:10.331 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (79m) 10m ago 85m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:18:10.331 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (79m) 115s ago 87m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:18:10.331 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (78m) 10m ago 85m 299M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:18:10.331 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (85m) 115s ago 85m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:18:10.332 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (85m) 10m ago 85m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:18:10.332 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (78m) 115s ago 84m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:18:10.332 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (76m) 115s ago 84m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:18:10.332 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (75m) 115s ago 84m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:18:10.332 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (75m) 10m ago 83m 512M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:18:10.333 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (74m) 10m ago 83m 442M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:18:10.333 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (74m) 10m ago 83m 369M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:18:10.333 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (80m) 115s ago 85m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:18:10.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 -- 172.21.15.8:0/1649030608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb230060f70 msgr2=0x7fb230063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:10.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb230060f70 0x7fb230063430 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fb2480f7630 tx=0x7fb23800b040).stop 2023-10-18T22:18:10.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 -- 172.21.15.8:0/1649030608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2480f77d0 msgr2=0x7fb2481093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:10.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2480f77d0 0x7fb2481093a0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7fb23c004d80 tx=0x7fb23c00b040).stop 2023-10-18T22:18:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 -- 172.21.15.8:0/1649030608 shutdown_connections 2023-10-18T22:18:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb230060f70 0x7fb230063430 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480f6530 0x7fb248108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 --2- 172.21.15.8:0/1649030608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2480f77d0 0x7fb2481093a0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 -- 172.21.15.8:0/1649030608 >> 172.21.15.8:0/1649030608 conn(0x7fb2480f1c90 msgr2=0x7fb24806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 -- 172.21.15.8:0/1649030608 shutdown_connections 2023-10-18T22:18:10.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.330+0000 7fb24d37a700 1 -- 172.21.15.8:0/1649030608 wait complete. 2023-10-18T22:18:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.465+0000 7fe5b3fff700 1 -- 172.21.15.8:0/2388834757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b40f77d0 msgr2=0x7fe5b40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.465+0000 7fe5b3fff700 1 --2- 172.21.15.8:0/2388834757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b40f77d0 0x7fe5b40f7c30 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7fe5a8004660 tx=0x7fe5a8009b30).stop 2023-10-18T22:18:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.465+0000 7fe5b3fff700 1 -- 172.21.15.8:0/2388834757 shutdown_connections 2023-10-18T22:18:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.465+0000 7fe5b3fff700 1 --2- 172.21.15.8:0/2388834757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b40f77d0 0x7fe5b40f7c30 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.465+0000 7fe5b3fff700 1 --2- 172.21.15.8:0/2388834757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b40f6530 0x7fe5b40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.465+0000 7fe5b3fff700 1 -- 172.21.15.8:0/2388834757 >> 172.21.15.8:0/2388834757 conn(0x7fe5b40f1c90 msgr2=0x7fe5b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.466+0000 7fe5b3fff700 1 -- 172.21.15.8:0/2388834757 shutdown_connections 2023-10-18T22:18:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.466+0000 7fe5b3fff700 1 -- 172.21.15.8:0/2388834757 wait complete. 2023-10-18T22:18:10.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.466+0000 7fe5b3fff700 1 Processor -- start 2023-10-18T22:18:10.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.467+0000 7fe5b3fff700 1 -- start start 2023-10-18T22:18:10.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.467+0000 7fe5b3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b40f6530 0x7fe5b4108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:10.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.467+0000 7fe5b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b40f77d0 0x7fe5b4109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.467+0000 7fe5b3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b41099b0 con 0x7fe5b40f77d0 2023-10-18T22:18:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.467+0000 7fe5b3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4109af0 con 0x7fe5b40f6530 2023-10-18T22:18:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.467+0000 7fe5b27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b40f77d0 0x7fe5b4109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.467+0000 7fe5b27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b40f77d0 0x7fe5b4109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45886/0 (socket says 172.21.15.8:45886) 2023-10-18T22:18:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.467+0000 7fe5b27fc700 1 -- 172.21.15.8:0/1503339441 learned_addr learned my addr 172.21.15.8:0/1503339441 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:10.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.467+0000 7fe5b2ffd700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b40f6530 0x7fe5b4108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:10.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.468+0000 7fe5b27fc700 1 -- 172.21.15.8:0/1503339441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b40f6530 msgr2=0x7fe5b4108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:10.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.468+0000 7fe5b27fc700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b40f6530 0x7fe5b4108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.468+0000 7fe5b27fc700 1 -- 172.21.15.8:0/1503339441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8005040 con 0x7fe5b40f77d0 2023-10-18T22:18:10.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.468+0000 7fe5b27fc700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b40f77d0 0x7fe5b4109400 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7fe5a8009990 tx=0x7fe5a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:10.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.468+0000 7fe59b7fe700 1 -- 172.21.15.8:0/1503339441 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5a8018070 con 0x7fe5b40f77d0 2023-10-18T22:18:10.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.468+0000 7fe59b7fe700 1 -- 172.21.15.8:0/1503339441 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe5a8009780 con 0x7fe5b40f77d0 2023-10-18T22:18:10.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.468+0000 7fe5b3fff700 1 -- 172.21.15.8:0/1503339441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b410a430 con 0x7fe5b40f77d0 2023-10-18T22:18:10.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.468+0000 7fe59b7fe700 1 -- 172.21.15.8:0/1503339441 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5a801c5a0 con 0x7fe5b40f77d0 2023-10-18T22:18:10.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.468+0000 7fe5b3fff700 1 -- 172.21.15.8:0/1503339441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b410a990 con 0x7fe5b40f77d0 2023-10-18T22:18:10.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.469+0000 7fe5b3fff700 1 -- 172.21.15.8:0/1503339441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b4045ad0 con 0x7fe5b40f77d0 2023-10-18T22:18:10.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.470+0000 7fe59b7fe700 1 -- 172.21.15.8:0/1503339441 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe5a801db30 con 0x7fe5b40f77d0 2023-10-18T22:18:10.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.471+0000 7fe59b7fe700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe59c060f70 0x7fe59c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:10.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.471+0000 7fe59b7fe700 1 -- 172.21.15.8:0/1503339441 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe5a807e940 con 0x7fe5b40f77d0 2023-10-18T22:18:10.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.471+0000 7fe5b2ffd700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe59c060f70 0x7fe59c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:10.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.472+0000 7fe5b2ffd700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe59c060f70 0x7fe59c063430 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7fe5a4007fd0 tx=0x7fe5a4009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:10.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.475+0000 7fe59b7fe700 1 -- 172.21.15.8:0/1503339441 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe5a8051f20 con 0x7fe5b40f77d0 2023-10-18T22:18:10.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.727+0000 7fe5b3fff700 1 -- 172.21.15.8:0/1503339441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe5b4027a00 con 0x7fe5b40f77d0 2023-10-18T22:18:10.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.727+0000 7fe59b7fe700 1 -- 172.21.15.8:0/1503339441 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fe5a8051b10 con 0x7fe5b40f77d0 2023-10-18T22:18:10.729 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:18:10.729 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:18:10.729 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:18:10.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:18:10.730 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:18:10.730 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:18:10.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:18:10.730 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:18:10.730 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:18:10.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:18:10.731 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:18:10.731 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:18:10.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:18:10.731 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:18:10.731 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:18:10.732 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:18:10.732 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:18:10.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 -- 172.21.15.8:0/1503339441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe59c060f70 msgr2=0x7fe59c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:10.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe59c060f70 0x7fe59c063430 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7fe5a4007fd0 tx=0x7fe5a4009040).stop 2023-10-18T22:18:10.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 -- 172.21.15.8:0/1503339441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b40f77d0 msgr2=0x7fe5b4109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:10.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b40f77d0 0x7fe5b4109400 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7fe5a8009990 tx=0x7fe5a8009b30).stop 2023-10-18T22:18:10.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 -- 172.21.15.8:0/1503339441 shutdown_connections 2023-10-18T22:18:10.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe59c060f70 0x7fe59c063430 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b40f6530 0x7fe5b4108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 --2- 172.21.15.8:0/1503339441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5b40f77d0 0x7fe5b4109400 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 -- 172.21.15.8:0/1503339441 >> 172.21.15.8:0/1503339441 conn(0x7fe5b40f1c90 msgr2=0x7fe5b406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:10.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 -- 172.21.15.8:0/1503339441 shutdown_connections 2023-10-18T22:18:10.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.729+0000 7fe5b3fff700 1 -- 172.21.15.8:0/1503339441 wait complete. 2023-10-18T22:18:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.866+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3365193106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad00f6530 msgr2=0x7f1ad00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.866+0000 7f1ad5c63700 1 --2- 172.21.15.8:0/3365193106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad00f6530 0x7f1ad00f6950 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f1ac4004660 tx=0x7f1ac4009b30).stop 2023-10-18T22:18:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.866+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3365193106 shutdown_connections 2023-10-18T22:18:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.866+0000 7f1ad5c63700 1 --2- 172.21.15.8:0/3365193106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad00f77d0 0x7f1ad00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.866+0000 7f1ad5c63700 1 --2- 172.21.15.8:0/3365193106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad00f6530 0x7f1ad00f6950 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.866+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3365193106 >> 172.21.15.8:0/3365193106 conn(0x7f1ad00f1c90 msgr2=0x7f1ad00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.866+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3365193106 shutdown_connections 2023-10-18T22:18:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.866+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3365193106 wait complete. 2023-10-18T22:18:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.867+0000 7f1ad5c63700 1 Processor -- start 2023-10-18T22:18:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.867+0000 7f1ad5c63700 1 -- start start 2023-10-18T22:18:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.867+0000 7f1ad5c63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad00f6530 0x7f1ad0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1ad5c63700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad00f77d0 0x7f1ad0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1ad5c63700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0109a00 con 0x7f1ad00f6530 2023-10-18T22:18:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1ad5c63700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0109b40 con 0x7f1ad00f77d0 2023-10-18T22:18:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1ad4c61700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad00f6530 0x7f1ad0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1ad4c61700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad00f6530 0x7f1ad0108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45896/0 (socket says 172.21.15.8:45896) 2023-10-18T22:18:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1ad4c61700 1 -- 172.21.15.8:0/3904978584 learned_addr learned my addr 172.21.15.8:0/3904978584 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1acffff700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad00f77d0 0x7f1ad0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1ad4c61700 1 -- 172.21.15.8:0/3904978584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad00f77d0 msgr2=0x7f1ad0109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1ad4c61700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad00f77d0 0x7f1ad0109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1ad4c61700 1 -- 172.21.15.8:0/3904978584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4005040 con 0x7f1ad00f6530 2023-10-18T22:18:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.868+0000 7f1ad4c61700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad00f6530 0x7f1ad0108f60 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f1ac4014040 tx=0x7f1ac400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:10.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.869+0000 7f1acd7fa700 1 -- 172.21.15.8:0/3904978584 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ac4019070 con 0x7f1ad00f6530 2023-10-18T22:18:10.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.869+0000 7f1acd7fa700 1 -- 172.21.15.8:0/3904978584 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1ac401e420 con 0x7f1ad00f6530 2023-10-18T22:18:10.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.869+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3904978584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad010a480 con 0x7f1ad00f6530 2023-10-18T22:18:10.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.869+0000 7f1acd7fa700 1 -- 172.21.15.8:0/3904978584 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ac4014620 con 0x7f1ad00f6530 2023-10-18T22:18:10.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.869+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3904978584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad010a960 con 0x7f1ad00f6530 2023-10-18T22:18:10.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.870+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3904978584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad0045ad0 con 0x7f1ad00f6530 2023-10-18T22:18:10.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.871+0000 7f1acd7fa700 1 -- 172.21.15.8:0/3904978584 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1ac401e9e0 con 0x7f1ad00f6530 2023-10-18T22:18:10.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.872+0000 7f1acd7fa700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ac0060f70 0x7f1ac0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:10.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.872+0000 7f1acd7fa700 1 -- 172.21.15.8:0/3904978584 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1ac407dcf0 con 0x7f1ad00f6530 2023-10-18T22:18:10.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.872+0000 7f1acffff700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ac0060f70 0x7f1ac0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:10.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.873+0000 7f1acffff700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ac0060f70 0x7f1ac0063430 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f1abc009fd0 tx=0x7f1abc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:10.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:10.876+0000 7f1acd7fa700 1 -- 172.21.15.8:0/3904978584 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1ac4051390 con 0x7f1ad00f6530 2023-10-18T22:18:11.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.105+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3904978584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1ad00fecc0 con 0x7f1ad00f6530 2023-10-18T22:18:11.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.105+0000 7f1acd7fa700 1 -- 172.21.15.8:0/3904978584 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f1ac4004490 con 0x7f1ad00f6530 2023-10-18T22:18:11.107 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:18:11.107 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:18:11.108 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:18:11.108 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:18:11.108 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:18:11.108 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:18:11.108 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:18:11.109 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:18:11.109 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:18:11.109 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:18:11.109 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:18:11.109 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:18:11.110 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:18:11.110 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:18:11.110 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:18:11.110 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:18:11.110 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:18:11.111 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:18:11.111 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:18:11.111 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:18:11.111 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:18:11.111 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:18:11.112 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:18:11.112 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:18:11.112 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:18:11.112 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:18:11.112 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:18:11.112 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:18:11.113 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:18:11.113 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:18:11.113 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:18:11.113 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:18:11.113 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:18:11.113 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:18:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.107+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3904978584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ac0060f70 msgr2=0x7f1ac0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.107+0000 7f1ad5c63700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ac0060f70 0x7f1ac0063430 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f1abc009fd0 tx=0x7f1abc00b040).stop 2023-10-18T22:18:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.107+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3904978584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad00f6530 msgr2=0x7f1ad0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.107+0000 7f1ad5c63700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad00f6530 0x7f1ad0108f60 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f1ac4014040 tx=0x7f1ac400b040).stop 2023-10-18T22:18:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.107+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3904978584 shutdown_connections 2023-10-18T22:18:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.108+0000 7f1ad5c63700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1ac0060f70 0x7f1ac0063430 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:11.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.108+0000 7f1ad5c63700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ad00f6530 0x7f1ad0108f60 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:11.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.108+0000 7f1ad5c63700 1 --2- 172.21.15.8:0/3904978584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad00f77d0 0x7f1ad0109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:11.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.108+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3904978584 >> 172.21.15.8:0/3904978584 conn(0x7f1ad00f1c90 msgr2=0x7f1ad006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:11.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.108+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3904978584 shutdown_connections 2023-10-18T22:18:11.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.108+0000 7f1ad5c63700 1 -- 172.21.15.8:0/3904978584 wait complete. 2023-10-18T22:18:11.117 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:18:11.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.244+0000 7f2af7fff700 1 -- 172.21.15.8:0/97976948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2af80f6530 msgr2=0x7f2af80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:11.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.244+0000 7f2af7fff700 1 --2- 172.21.15.8:0/97976948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2af80f6530 0x7f2af80f6950 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f2ae8004660 tx=0x7f2ae8009b30).stop 2023-10-18T22:18:11.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.244+0000 7f2af7fff700 1 -- 172.21.15.8:0/97976948 shutdown_connections 2023-10-18T22:18:11.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.244+0000 7f2af7fff700 1 --2- 172.21.15.8:0/97976948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2af80f77d0 0x7f2af80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:11.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.244+0000 7f2af7fff700 1 --2- 172.21.15.8:0/97976948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2af80f6530 0x7f2af80f6950 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:11.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.244+0000 7f2af7fff700 1 -- 172.21.15.8:0/97976948 >> 172.21.15.8:0/97976948 conn(0x7f2af80f1c90 msgr2=0x7f2af80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:11.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.244+0000 7f2af7fff700 1 -- 172.21.15.8:0/97976948 shutdown_connections 2023-10-18T22:18:11.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.244+0000 7f2af7fff700 1 -- 172.21.15.8:0/97976948 wait complete. 2023-10-18T22:18:11.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.245+0000 7f2af7fff700 1 Processor -- start 2023-10-18T22:18:11.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.245+0000 7f2af7fff700 1 -- start start 2023-10-18T22:18:11.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2af80f6530 0x7f2af8108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:11.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2af80f77d0 0x7f2af8109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:11.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af81099e0 con 0x7f2af80f6530 2023-10-18T22:18:11.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8109b20 con 0x7f2af80f77d0 2023-10-18T22:18:11.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2af80f6530 0x7f2af8108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:11.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2af80f6530 0x7f2af8108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45914/0 (socket says 172.21.15.8:45914) 2023-10-18T22:18:11.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af6ffd700 1 -- 172.21.15.8:0/1680946072 learned_addr learned my addr 172.21.15.8:0/1680946072 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:11.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af67fc700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2af80f77d0 0x7f2af8109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:11.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af6ffd700 1 -- 172.21.15.8:0/1680946072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2af80f77d0 msgr2=0x7f2af8109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:11.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af6ffd700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2af80f77d0 0x7f2af8109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:11.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.246+0000 7f2af6ffd700 1 -- 172.21.15.8:0/1680946072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae8005040 con 0x7f2af80f6530 2023-10-18T22:18:11.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.247+0000 7f2af6ffd700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2af80f6530 0x7f2af8108f40 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f2ae8009870 tx=0x7f2ae800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:11.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.247+0000 7f2adf7fe700 1 -- 172.21.15.8:0/1680946072 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ae8019070 con 0x7f2af80f6530 2023-10-18T22:18:11.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.247+0000 7f2adf7fe700 1 -- 172.21.15.8:0/1680946072 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2ae8013380 con 0x7f2af80f6530 2023-10-18T22:18:11.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.247+0000 7f2adf7fe700 1 -- 172.21.15.8:0/1680946072 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ae801edf0 con 0x7f2af80f6530 2023-10-18T22:18:11.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.247+0000 7f2af7fff700 1 -- 172.21.15.8:0/1680946072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af810a460 con 0x7f2af80f6530 2023-10-18T22:18:11.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.247+0000 7f2af7fff700 1 -- 172.21.15.8:0/1680946072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af810a940 con 0x7f2af80f6530 2023-10-18T22:18:11.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.248+0000 7f2af7fff700 1 -- 172.21.15.8:0/1680946072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af8045ad0 con 0x7f2af80f6530 2023-10-18T22:18:11.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.249+0000 7f2adf7fe700 1 -- 172.21.15.8:0/1680946072 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2ae801e420 con 0x7f2af80f6530 2023-10-18T22:18:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.250+0000 7f2adf7fe700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ae0060f70 0x7f2ae0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.250+0000 7f2adf7fe700 1 -- 172.21.15.8:0/1680946072 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2ae807dce0 con 0x7f2af80f6530 2023-10-18T22:18:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.250+0000 7f2af67fc700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ae0060f70 0x7f2ae0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.250+0000 7f2af67fc700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ae0060f70 0x7f2ae0063430 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f2aec009fd0 tx=0x7f2aec00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:11.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.254+0000 7f2adf7fe700 1 -- 172.21.15.8:0/1680946072 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2ae8051340 con 0x7f2af80f6530 2023-10-18T22:18:11.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.454+0000 7f2af7fff700 1 -- 172.21.15.8:0/1680946072 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2af80fee40 con 0x7f2ae0060f70 2023-10-18T22:18:11.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.455+0000 7f2adf7fe700 1 -- 172.21.15.8:0/1680946072 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2af80fee40 con 0x7f2ae0060f70 2023-10-18T22:18:11.457 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:18:11.457 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:18:11.457 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:18:11.457 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:18:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:18:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:18:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:18:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:18:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:18:11.458 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:18:11.459 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:18:11.459 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:18:11.459 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:18:11.459 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:18:11.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 -- 172.21.15.8:0/1680946072 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ae0060f70 msgr2=0x7f2ae0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:11.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ae0060f70 0x7f2ae0063430 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f2aec009fd0 tx=0x7f2aec00b040).stop 2023-10-18T22:18:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 -- 172.21.15.8:0/1680946072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2af80f6530 msgr2=0x7f2af8108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2af80f6530 0x7f2af8108f40 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f2ae8009870 tx=0x7f2ae800b040).stop 2023-10-18T22:18:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 -- 172.21.15.8:0/1680946072 shutdown_connections 2023-10-18T22:18:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2ae0060f70 0x7f2ae0063430 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:11.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2af80f6530 0x7f2af8108f40 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:11.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 --2- 172.21.15.8:0/1680946072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2af80f77d0 0x7f2af8109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:11.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 -- 172.21.15.8:0/1680946072 >> 172.21.15.8:0/1680946072 conn(0x7f2af80f1c90 msgr2=0x7f2af806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:11.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 -- 172.21.15.8:0/1680946072 shutdown_connections 2023-10-18T22:18:11.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:11.457+0000 7f2af7fff700 1 -- 172.21.15.8:0/1680946072 wait complete. 2023-10-18T22:18:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:09.624786+0000 mgr.smithi008.flmjzp (mgr.14640) 4755 : audit [DBG] from='client.37816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:09.735796+0000 mgr.smithi008.flmjzp (mgr.14640) 4756 : cluster [DBG] pgmap v3263: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:09.975126+0000 mgr.smithi008.flmjzp (mgr.14640) 4757 : audit [DBG] from='client.37820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:10.319204+0000 mgr.smithi008.flmjzp (mgr.14640) 4758 : audit [DBG] from='client.37824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:10.727756+0000 mon.smithi008 (mon.0) 5036 : audit [DBG] from='client.? 172.21.15.8:0/1503339441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:11.106151+0000 mon.smithi008 (mon.0) 5037 : audit [DBG] from='client.? 172.21.15.8:0/3904978584' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:18:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:09.624786+0000 mgr.smithi008.flmjzp (mgr.14640) 4755 : audit [DBG] from='client.37816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:09.735796+0000 mgr.smithi008.flmjzp (mgr.14640) 4756 : cluster [DBG] pgmap v3263: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:09.975126+0000 mgr.smithi008.flmjzp (mgr.14640) 4757 : audit [DBG] from='client.37820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:10.319204+0000 mgr.smithi008.flmjzp (mgr.14640) 4758 : audit [DBG] from='client.37824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:10.727756+0000 mon.smithi008 (mon.0) 5036 : audit [DBG] from='client.? 172.21.15.8:0/1503339441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:11.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:11.106151+0000 mon.smithi008 (mon.0) 5037 : audit [DBG] from='client.? 172.21.15.8:0/3904978584' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:18:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:11.455613+0000 mgr.smithi008.flmjzp (mgr.14640) 4759 : audit [DBG] from='client.37836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:11.736309+0000 mgr.smithi008.flmjzp (mgr.14640) 4760 : cluster [DBG] pgmap v3264: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:11.455613+0000 mgr.smithi008.flmjzp (mgr.14640) 4759 : audit [DBG] from='client.37836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:11.736309+0000 mgr.smithi008.flmjzp (mgr.14640) 4760 : cluster [DBG] pgmap v3264: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:13.736985+0000 mgr.smithi008.flmjzp (mgr.14640) 4761 : cluster [DBG] pgmap v3265: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:13.736985+0000 mgr.smithi008.flmjzp (mgr.14640) 4761 : cluster [DBG] pgmap v3265: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:15.737505+0000 mgr.smithi008.flmjzp (mgr.14640) 4762 : cluster [DBG] pgmap v3266: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:15.737505+0000 mgr.smithi008.flmjzp (mgr.14640) 4762 : cluster [DBG] pgmap v3266: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:17.761069+0000 mon.smithi008 (mon.0) 5038 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:18.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:17.761069+0000 mon.smithi008 (mon.0) 5038 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:17.738009+0000 mgr.smithi008.flmjzp (mgr.14640) 4763 : cluster [DBG] pgmap v3267: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:19.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:17.738009+0000 mgr.smithi008.flmjzp (mgr.14640) 4763 : cluster [DBG] pgmap v3267: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:19.738710+0000 mgr.smithi008.flmjzp (mgr.14640) 4764 : cluster [DBG] pgmap v3268: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:20.315516+0000 mon.smithi008 (mon.0) 5039 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:20.316616+0000 mon.smithi008 (mon.0) 5040 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:18:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:20.317783+0000 mon.smithi008 (mon.0) 5041 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:18:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:18:20.318738+0000 mgr.smithi008.flmjzp (mgr.14640) 4765 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:18:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:20.319417+0000 mgr.smithi008.flmjzp (mgr.14640) 4766 : cluster [DBG] pgmap v3269: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:20.319658+0000 mgr.smithi008.flmjzp (mgr.14640) 4767 : cluster [DBG] pgmap v3270: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:21.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:20.323801+0000 mon.smithi008 (mon.0) 5042 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:20.331747+0000 mon.smithi008 (mon.0) 5043 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:20.335272+0000 mon.smithi008 (mon.0) 5044 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:20.337151+0000 mon.smithi008 (mon.0) 5045 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:20.339003+0000 mon.smithi008 (mon.0) 5046 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:21.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:20.341465+0000 mon.smithi008 (mon.0) 5047 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:21.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:18:20.343504+0000 mgr.smithi008.flmjzp (mgr.14640) 4768 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:19.738710+0000 mgr.smithi008.flmjzp (mgr.14640) 4764 : cluster [DBG] pgmap v3268: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:20.315516+0000 mon.smithi008 (mon.0) 5039 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:20.316616+0000 mon.smithi008 (mon.0) 5040 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:18:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:20.317783+0000 mon.smithi008 (mon.0) 5041 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:18:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:18:20.318738+0000 mgr.smithi008.flmjzp (mgr.14640) 4765 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:18:21.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:20.319417+0000 mgr.smithi008.flmjzp (mgr.14640) 4766 : cluster [DBG] pgmap v3269: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:20.319658+0000 mgr.smithi008.flmjzp (mgr.14640) 4767 : cluster [DBG] pgmap v3270: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:20.323801+0000 mon.smithi008 (mon.0) 5042 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:20.331747+0000 mon.smithi008 (mon.0) 5043 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:20.335272+0000 mon.smithi008 (mon.0) 5044 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:21.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:20.337151+0000 mon.smithi008 (mon.0) 5045 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:21.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:20.339003+0000 mon.smithi008 (mon.0) 5046 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:21.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:20.341465+0000 mon.smithi008 (mon.0) 5047 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:21.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:18:20.343504+0000 mgr.smithi008.flmjzp (mgr.14640) 4768 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:22.320211+0000 mgr.smithi008.flmjzp (mgr.14640) 4769 : cluster [DBG] pgmap v3271: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:22.320211+0000 mgr.smithi008.flmjzp (mgr.14640) 4769 : cluster [DBG] pgmap v3271: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:24.320823+0000 mgr.smithi008.flmjzp (mgr.14640) 4770 : cluster [DBG] pgmap v3272: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:24.320823+0000 mgr.smithi008.flmjzp (mgr.14640) 4770 : cluster [DBG] pgmap v3272: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:26.321479+0000 mgr.smithi008.flmjzp (mgr.14640) 4771 : cluster [DBG] pgmap v3273: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:26.321479+0000 mgr.smithi008.flmjzp (mgr.14640) 4771 : cluster [DBG] pgmap v3273: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:28.321965+0000 mgr.smithi008.flmjzp (mgr.14640) 4772 : cluster [DBG] pgmap v3274: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:28.321965+0000 mgr.smithi008.flmjzp (mgr.14640) 4772 : cluster [DBG] pgmap v3274: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:30.346509+0000 mon.smithi008 (mon.0) 5048 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:30.346509+0000 mon.smithi008 (mon.0) 5048 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:30.322616+0000 mgr.smithi008.flmjzp (mgr.14640) 4773 : cluster [DBG] pgmap v3275: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:30.906191+0000 mon.smithi008 (mon.0) 5049 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:18:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:30.907343+0000 mon.smithi008 (mon.0) 5050 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:18:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:30.914186+0000 mon.smithi008 (mon.0) 5051 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:30.920957+0000 mon.smithi008 (mon.0) 5052 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:30.924007+0000 mon.smithi008 (mon.0) 5053 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:30.925664+0000 mon.smithi008 (mon.0) 5054 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:31.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:30.927326+0000 mon.smithi008 (mon.0) 5055 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:31.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:30.929263+0000 mon.smithi008 (mon.0) 5056 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:30.322616+0000 mgr.smithi008.flmjzp (mgr.14640) 4773 : cluster [DBG] pgmap v3275: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:30.906191+0000 mon.smithi008 (mon.0) 5049 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:18:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:30.907343+0000 mon.smithi008 (mon.0) 5050 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:18:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:30.914186+0000 mon.smithi008 (mon.0) 5051 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:30.920957+0000 mon.smithi008 (mon.0) 5052 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:31.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:30.924007+0000 mon.smithi008 (mon.0) 5053 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:31.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:30.925664+0000 mon.smithi008 (mon.0) 5054 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:31.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:30.927326+0000 mon.smithi008 (mon.0) 5055 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:31.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:30.929263+0000 mon.smithi008 (mon.0) 5056 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:18:30.908272+0000 mgr.smithi008.flmjzp (mgr.14640) 4774 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:18:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:30.909001+0000 mgr.smithi008.flmjzp (mgr.14640) 4775 : cluster [DBG] pgmap v3276: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:30.909266+0000 mgr.smithi008.flmjzp (mgr.14640) 4776 : cluster [DBG] pgmap v3277: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:18:30.931118+0000 mgr.smithi008.flmjzp (mgr.14640) 4777 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:18:30.908272+0000 mgr.smithi008.flmjzp (mgr.14640) 4774 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:18:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:30.909001+0000 mgr.smithi008.flmjzp (mgr.14640) 4775 : cluster [DBG] pgmap v3276: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:30.909266+0000 mgr.smithi008.flmjzp (mgr.14640) 4776 : cluster [DBG] pgmap v3277: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:18:30.931118+0000 mgr.smithi008.flmjzp (mgr.14640) 4777 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:32.909749+0000 mgr.smithi008.flmjzp (mgr.14640) 4778 : cluster [DBG] pgmap v3278: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:32.909749+0000 mgr.smithi008.flmjzp (mgr.14640) 4778 : cluster [DBG] pgmap v3278: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:36.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:34.910414+0000 mgr.smithi008.flmjzp (mgr.14640) 4779 : cluster [DBG] pgmap v3279: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:36.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:34.910414+0000 mgr.smithi008.flmjzp (mgr.14640) 4779 : cluster [DBG] pgmap v3279: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:36.910972+0000 mgr.smithi008.flmjzp (mgr.14640) 4780 : cluster [DBG] pgmap v3280: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:36.910972+0000 mgr.smithi008.flmjzp (mgr.14640) 4780 : cluster [DBG] pgmap v3280: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:38.911585+0000 mgr.smithi008.flmjzp (mgr.14640) 4781 : cluster [DBG] pgmap v3281: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:38.911585+0000 mgr.smithi008.flmjzp (mgr.14640) 4781 : cluster [DBG] pgmap v3281: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:40.940226+0000 mon.smithi008 (mon.0) 5057 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:40.942393+0000 mon.smithi008 (mon.0) 5058 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:18:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:40.943430+0000 mon.smithi008 (mon.0) 5059 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:18:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:40.950369+0000 mon.smithi008 (mon.0) 5060 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:40.957687+0000 mon.smithi008 (mon.0) 5061 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:40.961168+0000 mon.smithi008 (mon.0) 5062 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:40.963163+0000 mon.smithi008 (mon.0) 5063 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:40.965053+0000 mon.smithi008 (mon.0) 5064 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:41.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:40.967715+0000 mon.smithi008 (mon.0) 5065 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:41.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.609+0000 7f156e807700 1 -- 172.21.15.8:0/85816609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15680f77d0 msgr2=0x7f15680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:41.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.609+0000 7f156e807700 1 --2- 172.21.15.8:0/85816609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15680f77d0 0x7f15680f7c30 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f1558004660 tx=0x7f1558009b30).stop 2023-10-18T22:18:41.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.610+0000 7f156e807700 1 -- 172.21.15.8:0/85816609 shutdown_connections 2023-10-18T22:18:41.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.610+0000 7f156e807700 1 --2- 172.21.15.8:0/85816609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15680f77d0 0x7f15680f7c30 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:41.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.610+0000 7f156e807700 1 --2- 172.21.15.8:0/85816609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15680f6530 0x7f15680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:41.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.610+0000 7f156e807700 1 -- 172.21.15.8:0/85816609 >> 172.21.15.8:0/85816609 conn(0x7f15680f1c90 msgr2=0x7f15680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:41.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.610+0000 7f156e807700 1 -- 172.21.15.8:0/85816609 shutdown_connections 2023-10-18T22:18:41.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.610+0000 7f156e807700 1 -- 172.21.15.8:0/85816609 wait complete. 2023-10-18T22:18:41.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.611+0000 7f156e807700 1 Processor -- start 2023-10-18T22:18:41.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.611+0000 7f156e807700 1 -- start start 2023-10-18T22:18:41.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.611+0000 7f156e807700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15680f6530 0x7f1568108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:41.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.611+0000 7f156e807700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15680f77d0 0x7f1568109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:41.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.611+0000 7f156e807700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15681099d0 con 0x7f15680f77d0 2023-10-18T22:18:41.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.611+0000 7f156e807700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1568109b10 con 0x7f15680f6530 2023-10-18T22:18:41.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.611+0000 7f156d004700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15680f77d0 0x7f1568109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:41.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.611+0000 7f156d004700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15680f77d0 0x7f1568109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58086/0 (socket says 172.21.15.8:58086) 2023-10-18T22:18:41.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.611+0000 7f156d004700 1 -- 172.21.15.8:0/2949220748 learned_addr learned my addr 172.21.15.8:0/2949220748 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:41.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.612+0000 7f156d805700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15680f6530 0x7f1568108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:41.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.612+0000 7f156d004700 1 -- 172.21.15.8:0/2949220748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15680f6530 msgr2=0x7f1568108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:41.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.612+0000 7f156d004700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15680f6530 0x7f1568108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:41.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.612+0000 7f156d004700 1 -- 172.21.15.8:0/2949220748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558005040 con 0x7f15680f77d0 2023-10-18T22:18:41.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.612+0000 7f156d004700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15680f77d0 0x7f1568109420 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f1558009830 tx=0x7f1558009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:41.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.612+0000 7f155e7fc700 1 -- 172.21.15.8:0/2949220748 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1558018070 con 0x7f15680f77d0 2023-10-18T22:18:41.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.612+0000 7f155e7fc700 1 -- 172.21.15.8:0/2949220748 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f155801d8e0 con 0x7f15680f77d0 2023-10-18T22:18:41.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.612+0000 7f156e807700 1 -- 172.21.15.8:0/2949220748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156810a450 con 0x7f15680f77d0 2023-10-18T22:18:41.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.612+0000 7f155e7fc700 1 -- 172.21.15.8:0/2949220748 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f155801c480 con 0x7f15680f77d0 2023-10-18T22:18:41.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.613+0000 7f156e807700 1 -- 172.21.15.8:0/2949220748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156810a9b0 con 0x7f15680f77d0 2023-10-18T22:18:41.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.614+0000 7f156e807700 1 -- 172.21.15.8:0/2949220748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1568045ad0 con 0x7f15680f77d0 2023-10-18T22:18:41.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.615+0000 7f155e7fc700 1 -- 172.21.15.8:0/2949220748 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f155801da50 con 0x7f15680f77d0 2023-10-18T22:18:41.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.616+0000 7f155e7fc700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1554060f70 0x7f1554063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:41.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.616+0000 7f155e7fc700 1 -- 172.21.15.8:0/2949220748 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f155807e8c0 con 0x7f15680f77d0 2023-10-18T22:18:41.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.616+0000 7f156d805700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1554060f70 0x7f1554063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:41.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.617+0000 7f156d805700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1554060f70 0x7f1554063430 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f15680f7630 tx=0x7f1564009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:41.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.621+0000 7f155e7fc700 1 -- 172.21.15.8:0/2949220748 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1558051ea0 con 0x7f15680f77d0 2023-10-18T22:18:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:40.940226+0000 mon.smithi008 (mon.0) 5057 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:40.942393+0000 mon.smithi008 (mon.0) 5058 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:18:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:40.943430+0000 mon.smithi008 (mon.0) 5059 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:18:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:40.950369+0000 mon.smithi008 (mon.0) 5060 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:41.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:40.957687+0000 mon.smithi008 (mon.0) 5061 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:40.961168+0000 mon.smithi008 (mon.0) 5062 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:40.963163+0000 mon.smithi008 (mon.0) 5063 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:40.965053+0000 mon.smithi008 (mon.0) 5064 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:41.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:40.967715+0000 mon.smithi008 (mon.0) 5065 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:41.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.820+0000 7f156e807700 1 -- 172.21.15.8:0/2949220748 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15680feda0 con 0x7f1554060f70 2023-10-18T22:18:41.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.822+0000 7f155e7fc700 1 -- 172.21.15.8:0/2949220748 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f15680feda0 con 0x7f1554060f70 2023-10-18T22:18:41.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.823+0000 7f156e807700 1 -- 172.21.15.8:0/2949220748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1554060f70 msgr2=0x7f1554063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:41.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.823+0000 7f156e807700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1554060f70 0x7f1554063430 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f15680f7630 tx=0x7f1564009040).stop 2023-10-18T22:18:41.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.823+0000 7f156e807700 1 -- 172.21.15.8:0/2949220748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15680f77d0 msgr2=0x7f1568109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:41.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.823+0000 7f156e807700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15680f77d0 0x7f1568109420 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f1558009830 tx=0x7f1558009b30).stop 2023-10-18T22:18:41.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.824+0000 7f156e807700 1 -- 172.21.15.8:0/2949220748 shutdown_connections 2023-10-18T22:18:41.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.824+0000 7f156e807700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1554060f70 0x7f1554063430 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:41.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.824+0000 7f156e807700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15680f6530 0x7f1568108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:41.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.824+0000 7f156e807700 1 --2- 172.21.15.8:0/2949220748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15680f77d0 0x7f1568109420 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:41.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.824+0000 7f156e807700 1 -- 172.21.15.8:0/2949220748 >> 172.21.15.8:0/2949220748 conn(0x7f15680f1c90 msgr2=0x7f156806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:41.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.824+0000 7f156e807700 1 -- 172.21.15.8:0/2949220748 shutdown_connections 2023-10-18T22:18:41.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.824+0000 7f156e807700 1 -- 172.21.15.8:0/2949220748 wait complete. 2023-10-18T22:18:41.841 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:18:41.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.962+0000 7f752a0e8700 1 -- 172.21.15.8:0/504689280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75240f77d0 msgr2=0x7f75240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:41.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.962+0000 7f752a0e8700 1 --2- 172.21.15.8:0/504689280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75240f77d0 0x7f75240f7c30 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f7514004660 tx=0x7f7514009b30).stop 2023-10-18T22:18:41.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.962+0000 7f752a0e8700 1 -- 172.21.15.8:0/504689280 shutdown_connections 2023-10-18T22:18:41.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.962+0000 7f752a0e8700 1 --2- 172.21.15.8:0/504689280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75240f77d0 0x7f75240f7c30 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.962+0000 7f752a0e8700 1 --2- 172.21.15.8:0/504689280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75240f6530 0x7f75240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.962+0000 7f752a0e8700 1 -- 172.21.15.8:0/504689280 >> 172.21.15.8:0/504689280 conn(0x7f75240f1c90 msgr2=0x7f75240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.962+0000 7f752a0e8700 1 -- 172.21.15.8:0/504689280 shutdown_connections 2023-10-18T22:18:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.962+0000 7f752a0e8700 1 -- 172.21.15.8:0/504689280 wait complete. 2023-10-18T22:18:41.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.963+0000 7f752a0e8700 1 Processor -- start 2023-10-18T22:18:41.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.963+0000 7f752a0e8700 1 -- start start 2023-10-18T22:18:41.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f752a0e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75240f6530 0x7f7524108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:41.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f752a0e8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75240f77d0 0x7f7524109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:41.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f752a0e8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75241099e0 con 0x7f75240f77d0 2023-10-18T22:18:41.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f752a0e8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7524109b20 con 0x7f75240f6530 2023-10-18T22:18:41.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f75288e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75240f77d0 0x7f7524109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:41.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f75288e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75240f77d0 0x7f7524109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58106/0 (socket says 172.21.15.8:58106) 2023-10-18T22:18:41.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f75288e5700 1 -- 172.21.15.8:0/3288146782 learned_addr learned my addr 172.21.15.8:0/3288146782 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:41.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f75290e6700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75240f6530 0x7f7524108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:41.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f75288e5700 1 -- 172.21.15.8:0/3288146782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75240f6530 msgr2=0x7f7524108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:41.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f75288e5700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75240f6530 0x7f7524108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:41.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f75288e5700 1 -- 172.21.15.8:0/3288146782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514005040 con 0x7f75240f77d0 2023-10-18T22:18:41.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.964+0000 7f75290e6700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75240f6530 0x7f7524108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:18:41.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.965+0000 7f75288e5700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75240f77d0 0x7f7524109430 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f7514009990 tx=0x7f7514009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:41.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.965+0000 7f7519ffb700 1 -- 172.21.15.8:0/3288146782 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7514018070 con 0x7f75240f77d0 2023-10-18T22:18:41.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.965+0000 7f7519ffb700 1 -- 172.21.15.8:0/3288146782 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7514009780 con 0x7f75240f77d0 2023-10-18T22:18:41.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.965+0000 7f752a0e8700 1 -- 172.21.15.8:0/3288146782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752410a460 con 0x7f75240f77d0 2023-10-18T22:18:41.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.965+0000 7f7519ffb700 1 -- 172.21.15.8:0/3288146782 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f751401c5a0 con 0x7f75240f77d0 2023-10-18T22:18:41.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.965+0000 7f752a0e8700 1 -- 172.21.15.8:0/3288146782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752410a9c0 con 0x7f75240f77d0 2023-10-18T22:18:41.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.966+0000 7f752a0e8700 1 -- 172.21.15.8:0/3288146782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7524045ad0 con 0x7f75240f77d0 2023-10-18T22:18:41.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.967+0000 7f7519ffb700 1 -- 172.21.15.8:0/3288146782 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f751401db30 con 0x7f75240f77d0 2023-10-18T22:18:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.968+0000 7f7519ffb700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7510060f70 0x7f7510063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.968+0000 7f7519ffb700 1 -- 172.21.15.8:0/3288146782 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f751407e940 con 0x7f75240f77d0 2023-10-18T22:18:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.969+0000 7f75290e6700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7510060f70 0x7f7510063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:41.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.969+0000 7f75290e6700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7510060f70 0x7f7510063430 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f75240f7630 tx=0x7f7520009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:41.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:41.972+0000 7f7519ffb700 1 -- 172.21.15.8:0/3288146782 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7514051f20 con 0x7f75240f77d0 2023-10-18T22:18:42.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.170+0000 7f752a0e8700 1 -- 172.21.15.8:0/3288146782 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75240feda0 con 0x7f7510060f70 2023-10-18T22:18:42.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.171+0000 7f7519ffb700 1 -- 172.21.15.8:0/3288146782 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f75240feda0 con 0x7f7510060f70 2023-10-18T22:18:42.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 -- 172.21.15.8:0/3288146782 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7510060f70 msgr2=0x7f7510063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:42.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7510060f70 0x7f7510063430 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f75240f7630 tx=0x7f7520009040).stop 2023-10-18T22:18:42.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 -- 172.21.15.8:0/3288146782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75240f77d0 msgr2=0x7f7524109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:42.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75240f77d0 0x7f7524109430 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f7514009990 tx=0x7f7514009b30).stop 2023-10-18T22:18:42.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 -- 172.21.15.8:0/3288146782 shutdown_connections 2023-10-18T22:18:42.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7510060f70 0x7f7510063430 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75240f6530 0x7f7524108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 --2- 172.21.15.8:0/3288146782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75240f77d0 0x7f7524109430 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 -- 172.21.15.8:0/3288146782 >> 172.21.15.8:0/3288146782 conn(0x7f75240f1c90 msgr2=0x7f75240f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:42.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 -- 172.21.15.8:0/3288146782 shutdown_connections 2023-10-18T22:18:42.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.173+0000 7f752a0e8700 1 -- 172.21.15.8:0/3288146782 wait complete. 2023-10-18T22:18:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.309+0000 7f5b3b59e700 1 -- 172.21.15.8:0/2207078754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b3c0f77d0 msgr2=0x7f5b3c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.309+0000 7f5b3b59e700 1 --2- 172.21.15.8:0/2207078754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b3c0f77d0 0x7f5b3c0f7c30 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f5b30004660 tx=0x7f5b30009b30).stop 2023-10-18T22:18:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.309+0000 7f5b3b59e700 1 -- 172.21.15.8:0/2207078754 shutdown_connections 2023-10-18T22:18:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.309+0000 7f5b3b59e700 1 --2- 172.21.15.8:0/2207078754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b3c0f77d0 0x7f5b3c0f7c30 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.309+0000 7f5b3b59e700 1 --2- 172.21.15.8:0/2207078754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b3c0f6530 0x7f5b3c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.309+0000 7f5b3b59e700 1 -- 172.21.15.8:0/2207078754 >> 172.21.15.8:0/2207078754 conn(0x7f5b3c0f1c90 msgr2=0x7f5b3c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.309+0000 7f5b3b59e700 1 -- 172.21.15.8:0/2207078754 shutdown_connections 2023-10-18T22:18:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.309+0000 7f5b3b59e700 1 -- 172.21.15.8:0/2207078754 wait complete. 2023-10-18T22:18:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.310+0000 7f5b3b59e700 1 Processor -- start 2023-10-18T22:18:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.310+0000 7f5b3b59e700 1 -- start start 2023-10-18T22:18:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.311+0000 7f5b3b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b3c0f6530 0x7f5b3c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.311+0000 7f5b3b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b3c0f77d0 0x7f5b3c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.311+0000 7f5b3b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c107880 con 0x7f5b3c0f6530 2023-10-18T22:18:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.311+0000 7f5b3b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c1080c0 con 0x7f5b3c0f77d0 2023-10-18T22:18:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.311+0000 7f5b3a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b3c0f6530 0x7f5b3c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.311+0000 7f5b3a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b3c0f6530 0x7f5b3c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58130/0 (socket says 172.21.15.8:58130) 2023-10-18T22:18:42.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.311+0000 7f5b3a59c700 1 -- 172.21.15.8:0/3252947749 learned_addr learned my addr 172.21.15.8:0/3252947749 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:42.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.311+0000 7f5b39d9b700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b3c0f77d0 0x7f5b3c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:42.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.312+0000 7f5b3a59c700 1 -- 172.21.15.8:0/3252947749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b3c0f77d0 msgr2=0x7f5b3c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:42.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.312+0000 7f5b3a59c700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b3c0f77d0 0x7f5b3c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.312+0000 7f5b3a59c700 1 -- 172.21.15.8:0/3252947749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b30005040 con 0x7f5b3c0f6530 2023-10-18T22:18:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.312+0000 7f5b3a59c700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b3c0f6530 0x7f5b3c106d90 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f5b2c002700 tx=0x7f5b2c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.312+0000 7f5b2affd700 1 -- 172.21.15.8:0/3252947749 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b2c0079c0 con 0x7f5b3c0f6530 2023-10-18T22:18:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.312+0000 7f5b2affd700 1 -- 172.21.15.8:0/3252947749 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5b2c00f040 con 0x7f5b3c0f6530 2023-10-18T22:18:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.312+0000 7f5b2affd700 1 -- 172.21.15.8:0/3252947749 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b2c0148d0 con 0x7f5b3c0f6530 2023-10-18T22:18:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.312+0000 7f5b3b59e700 1 -- 172.21.15.8:0/3252947749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c1083a0 con 0x7f5b3c0f6530 2023-10-18T22:18:42.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.312+0000 7f5b3b59e700 1 -- 172.21.15.8:0/3252947749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c1088e0 con 0x7f5b3c0f6530 2023-10-18T22:18:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.314+0000 7f5b3b59e700 1 -- 172.21.15.8:0/3252947749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c059100 con 0x7f5b3c0f6530 2023-10-18T22:18:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.314+0000 7f5b2affd700 1 -- 172.21.15.8:0/3252947749 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5b2c01b060 con 0x7f5b3c0f6530 2023-10-18T22:18:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.315+0000 7f5b2affd700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b24060f70 0x7f5b24063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.315+0000 7f5b2affd700 1 -- 172.21.15.8:0/3252947749 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5b2c07c6b0 con 0x7f5b3c0f6530 2023-10-18T22:18:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.316+0000 7f5b39d9b700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b24060f70 0x7f5b24063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:42.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.316+0000 7f5b39d9b700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b24060f70 0x7f5b24063430 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f5b30004630 tx=0x7f5b30009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:42.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.320+0000 7f5b2affd700 1 -- 172.21.15.8:0/3252947749 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5b2c04c3a0 con 0x7f5b3c0f6530 2023-10-18T22:18:42.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.514+0000 7f5b3b59e700 1 -- 172.21.15.8:0/3252947749 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b3c0fee00 con 0x7f5b24060f70 2023-10-18T22:18:42.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.523+0000 7f5b2affd700 1 -- 172.21.15.8:0/3252947749 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5b3c0fee00 con 0x7f5b24060f70 2023-10-18T22:18:42.525 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:18:42.526 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (85m) 2m ago 86m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:18:42.526 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (79m) 2m ago 86m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:18:42.526 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (79m) 22s ago 85m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:18:42.526 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (85m) 2m ago 86m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:18:42.527 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 82m - - 2023-10-18T22:18:42.527 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 82m - - 2023-10-18T22:18:42.527 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 22s ago 82m - - 2023-10-18T22:18:42.527 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 22s ago 82m - - 2023-10-18T22:18:42.527 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (80m) 2m ago 88m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:18:42.528 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (79m) 22s ago 85m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:18:42.528 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (79m) 2m ago 88m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:18:42.528 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (79m) 22s ago 85m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:18:42.528 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (86m) 2m ago 86m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:18:42.528 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (85m) 22s ago 85m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:18:42.528 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (78m) 2m ago 85m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:18:42.529 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (76m) 2m ago 85m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:18:42.529 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (76m) 2m ago 84m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:18:42.529 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (75m) 22s ago 84m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:18:42.529 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (75m) 22s ago 84m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:18:42.530 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (74m) 22s ago 83m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:18:42.530 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (80m) 2m ago 86m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:18:42.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.525+0000 7f5b3b59e700 1 -- 172.21.15.8:0/3252947749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b24060f70 msgr2=0x7f5b24063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:42.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.525+0000 7f5b3b59e700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b24060f70 0x7f5b24063430 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f5b30004630 tx=0x7f5b30009b30).stop 2023-10-18T22:18:42.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.525+0000 7f5b3b59e700 1 -- 172.21.15.8:0/3252947749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b3c0f6530 msgr2=0x7f5b3c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:42.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.525+0000 7f5b3b59e700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b3c0f6530 0x7f5b3c106d90 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f5b2c002700 tx=0x7f5b2c009d80).stop 2023-10-18T22:18:42.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.525+0000 7f5b3b59e700 1 -- 172.21.15.8:0/3252947749 shutdown_connections 2023-10-18T22:18:42.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.525+0000 7f5b3b59e700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5b24060f70 0x7f5b24063430 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.525+0000 7f5b3b59e700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b3c0f6530 0x7f5b3c106d90 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.525+0000 7f5b3b59e700 1 --2- 172.21.15.8:0/3252947749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b3c0f77d0 0x7f5b3c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.525+0000 7f5b3b59e700 1 -- 172.21.15.8:0/3252947749 >> 172.21.15.8:0/3252947749 conn(0x7f5b3c0f1c90 msgr2=0x7f5b3c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:42.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.525+0000 7f5b3b59e700 1 -- 172.21.15.8:0/3252947749 shutdown_connections 2023-10-18T22:18:42.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.526+0000 7f5b3b59e700 1 -- 172.21.15.8:0/3252947749 wait complete. 2023-10-18T22:18:42.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.661+0000 7f182d105700 1 -- 172.21.15.8:0/2978090278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18280f77d0 msgr2=0x7f18280f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:42.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.661+0000 7f182d105700 1 --2- 172.21.15.8:0/2978090278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18280f77d0 0x7f18280f7c30 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f181c004660 tx=0x7f181c009b30).stop 2023-10-18T22:18:42.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.661+0000 7f182d105700 1 -- 172.21.15.8:0/2978090278 shutdown_connections 2023-10-18T22:18:42.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.661+0000 7f182d105700 1 --2- 172.21.15.8:0/2978090278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18280f77d0 0x7f18280f7c30 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.661+0000 7f182d105700 1 --2- 172.21.15.8:0/2978090278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18280f6530 0x7f18280f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.661+0000 7f182d105700 1 -- 172.21.15.8:0/2978090278 >> 172.21.15.8:0/2978090278 conn(0x7f18280f1c90 msgr2=0x7f18280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:42.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.661+0000 7f182d105700 1 -- 172.21.15.8:0/2978090278 shutdown_connections 2023-10-18T22:18:42.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.661+0000 7f182d105700 1 -- 172.21.15.8:0/2978090278 wait complete. 2023-10-18T22:18:42.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.662+0000 7f182d105700 1 Processor -- start 2023-10-18T22:18:42.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.662+0000 7f182d105700 1 -- start start 2023-10-18T22:18:42.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.662+0000 7f182d105700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18280f6530 0x7f1828108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:42.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.662+0000 7f182d105700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18280f77d0 0x7f18281093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:42.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.662+0000 7f182d105700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18281099a0 con 0x7f18280f77d0 2023-10-18T22:18:42.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.662+0000 7f182d105700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1828109ae0 con 0x7f18280f6530 2023-10-18T22:18:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.663+0000 7f18277fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18280f77d0 0x7f18281093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.663+0000 7f18277fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18280f77d0 0x7f18281093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58148/0 (socket says 172.21.15.8:58148) 2023-10-18T22:18:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.663+0000 7f18277fe700 1 -- 172.21.15.8:0/3270350093 learned_addr learned my addr 172.21.15.8:0/3270350093 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.663+0000 7f1827fff700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18280f6530 0x7f1828108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.663+0000 7f18277fe700 1 -- 172.21.15.8:0/3270350093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18280f6530 msgr2=0x7f1828108f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.663+0000 7f18277fe700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18280f6530 0x7f1828108f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.663+0000 7f18277fe700 1 -- 172.21.15.8:0/3270350093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c005040 con 0x7f18280f77d0 2023-10-18T22:18:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.663+0000 7f18277fe700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18280f77d0 0x7f18281093f0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7f181c004320 tx=0x7f181c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.663+0000 7f1824ff9700 1 -- 172.21.15.8:0/3270350093 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f181c019070 con 0x7f18280f77d0 2023-10-18T22:18:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.664+0000 7f1824ff9700 1 -- 172.21.15.8:0/3270350093 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f181c01e420 con 0x7f18280f77d0 2023-10-18T22:18:42.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.664+0000 7f182d105700 1 -- 172.21.15.8:0/3270350093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182810a420 con 0x7f18280f77d0 2023-10-18T22:18:42.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.664+0000 7f1824ff9700 1 -- 172.21.15.8:0/3270350093 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f181c014680 con 0x7f18280f77d0 2023-10-18T22:18:42.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.664+0000 7f182d105700 1 -- 172.21.15.8:0/3270350093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182810a900 con 0x7f18280f77d0 2023-10-18T22:18:42.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.665+0000 7f182d105700 1 -- 172.21.15.8:0/3270350093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1828045ad0 con 0x7f18280f77d0 2023-10-18T22:18:42.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.666+0000 7f1824ff9700 1 -- 172.21.15.8:0/3270350093 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f181c01e590 con 0x7f18280f77d0 2023-10-18T22:18:42.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.666+0000 7f1824ff9700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1810060f70 0x7f1810063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:42.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.666+0000 7f1824ff9700 1 -- 172.21.15.8:0/3270350093 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f181c07dc50 con 0x7f18280f77d0 2023-10-18T22:18:42.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.667+0000 7f1827fff700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1810060f70 0x7f1810063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:42.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.667+0000 7f1827fff700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1810060f70 0x7f1810063430 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f1818009fd0 tx=0x7f181800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:40.912167+0000 mgr.smithi008.flmjzp (mgr.14640) 4782 : cluster [DBG] pgmap v3282: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:42.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:18:40.944330+0000 mgr.smithi008.flmjzp (mgr.14640) 4783 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:18:42.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:40.944981+0000 mgr.smithi008.flmjzp (mgr.14640) 4784 : cluster [DBG] pgmap v3283: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:42.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:40.945229+0000 mgr.smithi008.flmjzp (mgr.14640) 4785 : cluster [DBG] pgmap v3284: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:42.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:18:40.969852+0000 mgr.smithi008.flmjzp (mgr.14640) 4786 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:42.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.671+0000 7f1824ff9700 1 -- 172.21.15.8:0/3270350093 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f181c051310 con 0x7f18280f77d0 2023-10-18T22:18:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:40.912167+0000 mgr.smithi008.flmjzp (mgr.14640) 4782 : cluster [DBG] pgmap v3282: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:18:40.944330+0000 mgr.smithi008.flmjzp (mgr.14640) 4783 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:18:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:40.944981+0000 mgr.smithi008.flmjzp (mgr.14640) 4784 : cluster [DBG] pgmap v3283: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:40.945229+0000 mgr.smithi008.flmjzp (mgr.14640) 4785 : cluster [DBG] pgmap v3284: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:18:40.969852+0000 mgr.smithi008.flmjzp (mgr.14640) 4786 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:42.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.926+0000 7f182d105700 1 -- 172.21.15.8:0/3270350093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1828027a00 con 0x7f18280f77d0 2023-10-18T22:18:42.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.926+0000 7f1824ff9700 1 -- 172.21.15.8:0/3270350093 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f181c050f00 con 0x7f18280f77d0 2023-10-18T22:18:42.929 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:18:42.929 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:18:42.929 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:18:42.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:18:42.930 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:18:42.930 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:18:42.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:18:42.930 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:18:42.931 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:18:42.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:18:42.931 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:18:42.931 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:18:42.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:18:42.932 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:18:42.932 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:18:42.932 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:18:42.932 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:18:42.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 -- 172.21.15.8:0/3270350093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1810060f70 msgr2=0x7f1810063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:42.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1810060f70 0x7f1810063430 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f1818009fd0 tx=0x7f181800b040).stop 2023-10-18T22:18:42.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 -- 172.21.15.8:0/3270350093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18280f77d0 msgr2=0x7f18281093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:42.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18280f77d0 0x7f18281093f0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7f181c004320 tx=0x7f181c00b040).stop 2023-10-18T22:18:42.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 -- 172.21.15.8:0/3270350093 shutdown_connections 2023-10-18T22:18:42.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1810060f70 0x7f1810063430 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18280f6530 0x7f1828108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 --2- 172.21.15.8:0/3270350093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18280f77d0 0x7f18281093f0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:42.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 -- 172.21.15.8:0/3270350093 >> 172.21.15.8:0/3270350093 conn(0x7f18280f1c90 msgr2=0x7f182806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:42.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 -- 172.21.15.8:0/3270350093 shutdown_connections 2023-10-18T22:18:42.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:42.928+0000 7f182d105700 1 -- 172.21.15.8:0/3270350093 wait complete. 2023-10-18T22:18:43.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.065+0000 7f70b50d7700 1 -- 172.21.15.8:0/2408133910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70b00f77d0 msgr2=0x7f70b00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:43.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.065+0000 7f70b50d7700 1 --2- 172.21.15.8:0/2408133910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70b00f77d0 0x7f70b00f7c30 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7f70a4004660 tx=0x7f70a4009b30).stop 2023-10-18T22:18:43.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.065+0000 7f70b50d7700 1 -- 172.21.15.8:0/2408133910 shutdown_connections 2023-10-18T22:18:43.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.065+0000 7f70b50d7700 1 --2- 172.21.15.8:0/2408133910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70b00f77d0 0x7f70b00f7c30 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.065+0000 7f70b50d7700 1 --2- 172.21.15.8:0/2408133910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70b00f6530 0x7f70b00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.065+0000 7f70b50d7700 1 -- 172.21.15.8:0/2408133910 >> 172.21.15.8:0/2408133910 conn(0x7f70b00f1c90 msgr2=0x7f70b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:43.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.065+0000 7f70b50d7700 1 -- 172.21.15.8:0/2408133910 shutdown_connections 2023-10-18T22:18:43.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.065+0000 7f70b50d7700 1 -- 172.21.15.8:0/2408133910 wait complete. 2023-10-18T22:18:43.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.066+0000 7f70b50d7700 1 Processor -- start 2023-10-18T22:18:43.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.066+0000 7f70b50d7700 1 -- start start 2023-10-18T22:18:43.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.066+0000 7f70b50d7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70b00f6530 0x7f70b006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:43.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.066+0000 7f70b50d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70b00f77d0 0x7f70b0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:43.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.066+0000 7f70b50d7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b010a920 con 0x7f70b00f6530 2023-10-18T22:18:43.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.066+0000 7f70b50d7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b010aa60 con 0x7f70b00f77d0 2023-10-18T22:18:43.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.067+0000 7f70affff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70b00f6530 0x7f70b006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:43.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.067+0000 7f70affff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70b00f6530 0x7f70b006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58172/0 (socket says 172.21.15.8:58172) 2023-10-18T22:18:43.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.067+0000 7f70affff700 1 -- 172.21.15.8:0/3002787574 learned_addr learned my addr 172.21.15.8:0/3002787574 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:43.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.067+0000 7f70af7fe700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70b00f77d0 0x7f70b0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:43.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.067+0000 7f70affff700 1 -- 172.21.15.8:0/3002787574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70b00f77d0 msgr2=0x7f70b0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:43.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.067+0000 7f70affff700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70b00f77d0 0x7f70b0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.067+0000 7f70affff700 1 -- 172.21.15.8:0/3002787574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a4005040 con 0x7f70b00f6530 2023-10-18T22:18:43.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.067+0000 7f70affff700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70b00f6530 0x7f70b006b9a0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7f70a000e7c0 tx=0x7f70a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:43.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.068+0000 7f70acff9700 1 -- 172.21.15.8:0/3002787574 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a00092e0 con 0x7f70b00f6530 2023-10-18T22:18:43.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.068+0000 7f70acff9700 1 -- 172.21.15.8:0/3002787574 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f70a000f040 con 0x7f70b00f6530 2023-10-18T22:18:43.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.068+0000 7f70acff9700 1 -- 172.21.15.8:0/3002787574 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a00147e0 con 0x7f70b00f6530 2023-10-18T22:18:43.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.068+0000 7f70b50d7700 1 -- 172.21.15.8:0/3002787574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b006a3d0 con 0x7f70b00f6530 2023-10-18T22:18:43.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.068+0000 7f70b50d7700 1 -- 172.21.15.8:0/3002787574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b006a8c0 con 0x7f70b00f6530 2023-10-18T22:18:43.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.069+0000 7f70b50d7700 1 -- 172.21.15.8:0/3002787574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b0045ad0 con 0x7f70b00f6530 2023-10-18T22:18:43.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.070+0000 7f70acff9700 1 -- 172.21.15.8:0/3002787574 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f70a001b030 con 0x7f70b00f6530 2023-10-18T22:18:43.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.070+0000 7f70acff9700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7098060f70 0x7f7098063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:43.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.071+0000 7f70acff9700 1 -- 172.21.15.8:0/3002787574 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f70a007ca70 con 0x7f70b00f6530 2023-10-18T22:18:43.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.071+0000 7f70af7fe700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7098060f70 0x7f7098063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:43.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.071+0000 7f70af7fe700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7098060f70 0x7f7098063430 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f70a40043d0 tx=0x7f70a400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:43.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.075+0000 7f70acff9700 1 -- 172.21.15.8:0/3002787574 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f70a004c620 con 0x7f70b00f6530 2023-10-18T22:18:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.301+0000 7f70b50d7700 1 -- 172.21.15.8:0/3002787574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f70b00fed90 con 0x7f70b00f6530 2023-10-18T22:18:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.302+0000 7f70acff9700 1 -- 172.21.15.8:0/3002787574 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f70a0019070 con 0x7f70b00f6530 2023-10-18T22:18:43.305 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:18:43.305 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:18:43.305 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:18:43.305 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:18:43.305 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:18:43.306 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:18:43.306 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:18:43.306 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:18:43.306 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:18:43.306 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:18:43.307 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:18:43.307 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:18:43.307 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:18:43.307 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:18:43.307 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:18:43.307 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:18:43.308 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:18:43.308 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:18:43.308 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:18:43.308 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:18:43.308 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:18:43.309 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:18:43.309 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:18:43.309 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:18:43.309 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:18:43.309 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:18:43.310 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:18:43.310 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:18:43.310 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:18:43.310 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:18:43.310 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:18:43.311 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:18:43.311 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:18:43.311 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:18:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 -- 172.21.15.8:0/3002787574 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7098060f70 msgr2=0x7f7098063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7098060f70 0x7f7098063430 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f70a40043d0 tx=0x7f70a400b040).stop 2023-10-18T22:18:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 -- 172.21.15.8:0/3002787574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70b00f6530 msgr2=0x7f70b006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70b00f6530 0x7f70b006b9a0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7f70a000e7c0 tx=0x7f70a000b040).stop 2023-10-18T22:18:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 -- 172.21.15.8:0/3002787574 shutdown_connections 2023-10-18T22:18:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7098060f70 0x7f7098063430 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70b00f6530 0x7f70b006b9a0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 --2- 172.21.15.8:0/3002787574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70b00f77d0 0x7f70b0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 -- 172.21.15.8:0/3002787574 >> 172.21.15.8:0/3002787574 conn(0x7f70b00f1c90 msgr2=0x7f70b00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 -- 172.21.15.8:0/3002787574 shutdown_connections 2023-10-18T22:18:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.304+0000 7f70b50d7700 1 -- 172.21.15.8:0/3002787574 wait complete. 2023-10-18T22:18:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:18:43.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.442+0000 7f1051d35700 1 -- 172.21.15.8:0/3398533050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f104c0f6530 msgr2=0x7f104c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:43.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.442+0000 7f1051d35700 1 --2- 172.21.15.8:0/3398533050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f104c0f6530 0x7f104c0f6950 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f1040004660 tx=0x7f1040009b30).stop 2023-10-18T22:18:43.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.442+0000 7f1051d35700 1 -- 172.21.15.8:0/3398533050 shutdown_connections 2023-10-18T22:18:43.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.442+0000 7f1051d35700 1 --2- 172.21.15.8:0/3398533050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f104c0f77d0 0x7f104c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.442+0000 7f1051d35700 1 --2- 172.21.15.8:0/3398533050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f104c0f6530 0x7f104c0f6950 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.442+0000 7f1051d35700 1 -- 172.21.15.8:0/3398533050 >> 172.21.15.8:0/3398533050 conn(0x7f104c0f1c90 msgr2=0x7f104c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:43.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.442+0000 7f1051d35700 1 -- 172.21.15.8:0/3398533050 shutdown_connections 2023-10-18T22:18:43.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.442+0000 7f1051d35700 1 -- 172.21.15.8:0/3398533050 wait complete. 2023-10-18T22:18:43.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.443+0000 7f1051d35700 1 Processor -- start 2023-10-18T22:18:43.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.443+0000 7f1051d35700 1 -- start start 2023-10-18T22:18:43.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.443+0000 7f1051d35700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f104c0f6530 0x7f104c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:43.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.443+0000 7f1051d35700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f104c0f77d0 0x7f104c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:43.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.443+0000 7f1051d35700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c06a380 con 0x7f104c0f77d0 2023-10-18T22:18:43.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.443+0000 7f1051d35700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c06a4c0 con 0x7f104c0f6530 2023-10-18T22:18:43.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.444+0000 7f104bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f104c0f77d0 0x7f104c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:43.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.444+0000 7f104bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f104c0f77d0 0x7f104c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58186/0 (socket says 172.21.15.8:58186) 2023-10-18T22:18:43.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.444+0000 7f104bfff700 1 -- 172.21.15.8:0/3096701398 learned_addr learned my addr 172.21.15.8:0/3096701398 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:18:43.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.444+0000 7f1050d33700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f104c0f6530 0x7f104c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:43.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.444+0000 7f104bfff700 1 -- 172.21.15.8:0/3096701398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f104c0f6530 msgr2=0x7f104c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:43.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.444+0000 7f104bfff700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f104c0f6530 0x7f104c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.444+0000 7f104bfff700 1 -- 172.21.15.8:0/3096701398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1040005040 con 0x7f104c0f77d0 2023-10-18T22:18:43.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.444+0000 7f1050d33700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f104c0f6530 0x7f104c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:18:43.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.444+0000 7f104bfff700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f104c0f77d0 0x7f104c069e20 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f103800c790 tx=0x7f1038007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:43.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.445+0000 7f10497fa700 1 -- 172.21.15.8:0/3096701398 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103800e680 con 0x7f104c0f77d0 2023-10-18T22:18:43.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.445+0000 7f10497fa700 1 -- 172.21.15.8:0/3096701398 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f103800eca0 con 0x7f104c0f77d0 2023-10-18T22:18:43.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.445+0000 7f10497fa700 1 -- 172.21.15.8:0/3096701398 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1038013de0 con 0x7f104c0f77d0 2023-10-18T22:18:43.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.445+0000 7f1051d35700 1 -- 172.21.15.8:0/3096701398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104c06a7a0 con 0x7f104c0f77d0 2023-10-18T22:18:43.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.445+0000 7f1051d35700 1 -- 172.21.15.8:0/3096701398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104c10ede0 con 0x7f104c0f77d0 2023-10-18T22:18:43.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.446+0000 7f1051d35700 1 -- 172.21.15.8:0/3096701398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104c045ad0 con 0x7f104c0f77d0 2023-10-18T22:18:43.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.447+0000 7f10497fa700 1 -- 172.21.15.8:0/3096701398 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f103801a060 con 0x7f104c0f77d0 2023-10-18T22:18:43.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.447+0000 7f10497fa700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f103c060f70 0x7f103c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:18:43.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.447+0000 7f10497fa700 1 -- 172.21.15.8:0/3096701398 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f103807cab0 con 0x7f104c0f77d0 2023-10-18T22:18:43.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.448+0000 7f1050d33700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f103c060f70 0x7f103c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:18:43.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.448+0000 7f1050d33700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f103c060f70 0x7f103c063430 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f104c06b730 tx=0x7f1040009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:18:43.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.452+0000 7f10497fa700 1 -- 172.21.15.8:0/3096701398 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f103804c7a0 con 0x7f104c0f77d0 2023-10-18T22:18:43.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.650+0000 7f1051d35700 1 -- 172.21.15.8:0/3096701398 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f104c0fedd0 con 0x7f103c060f70 2023-10-18T22:18:43.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.652+0000 7f10497fa700 1 -- 172.21.15.8:0/3096701398 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f104c0fedd0 con 0x7f103c060f70 2023-10-18T22:18:43.654 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:18:43.654 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:18:43.655 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:18:43.655 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:18:43.655 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:18:43.655 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:18:43.656 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:18:43.656 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:18:43.656 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:18:43.656 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:18:43.656 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:18:43.657 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:18:43.657 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:18:43.657 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:18:43.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 -- 172.21.15.8:0/3096701398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f103c060f70 msgr2=0x7f103c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:43.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f103c060f70 0x7f103c063430 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f104c06b730 tx=0x7f1040009b30).stop 2023-10-18T22:18:43.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 -- 172.21.15.8:0/3096701398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f104c0f77d0 msgr2=0x7f104c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:18:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f104c0f77d0 0x7f104c069e20 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f103800c790 tx=0x7f1038007d70).stop 2023-10-18T22:18:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 -- 172.21.15.8:0/3096701398 shutdown_connections 2023-10-18T22:18:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f103c060f70 0x7f103c063430 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f104c0f6530 0x7f104c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 --2- 172.21.15.8:0/3096701398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f104c0f77d0 0x7f104c069e20 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:18:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 -- 172.21.15.8:0/3096701398 >> 172.21.15.8:0/3096701398 conn(0x7f104c0f1c90 msgr2=0x7f104c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:18:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 -- 172.21.15.8:0/3096701398 shutdown_connections 2023-10-18T22:18:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:18:43.654+0000 7f1051d35700 1 -- 172.21.15.8:0/3096701398 wait complete. 2023-10-18T22:18:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:41.822896+0000 mgr.smithi008.flmjzp (mgr.14640) 4787 : audit [DBG] from='client.37840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:42.172396+0000 mgr.smithi008.flmjzp (mgr.14640) 4788 : audit [DBG] from='client.37844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:42.927758+0000 mon.smithi008 (mon.0) 5066 : audit [DBG] from='client.? 172.21.15.8:0/3270350093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:43.303699+0000 mon.smithi008 (mon.0) 5067 : audit [DBG] from='client.? 172.21.15.8:0/3002787574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:18:43.843 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:41.822896+0000 mgr.smithi008.flmjzp (mgr.14640) 4787 : audit [DBG] from='client.37840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:43.843 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:42.172396+0000 mgr.smithi008.flmjzp (mgr.14640) 4788 : audit [DBG] from='client.37844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:43.843 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:42.927758+0000 mon.smithi008 (mon.0) 5066 : audit [DBG] from='client.? 172.21.15.8:0/3270350093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:43.843 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:43.303699+0000 mon.smithi008 (mon.0) 5067 : audit [DBG] from='client.? 172.21.15.8:0/3002787574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:18:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:42.516173+0000 mgr.smithi008.flmjzp (mgr.14640) 4789 : audit [DBG] from='client.37848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:42.945684+0000 mgr.smithi008.flmjzp (mgr.14640) 4790 : cluster [DBG] pgmap v3285: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:42.516173+0000 mgr.smithi008.flmjzp (mgr.14640) 4789 : audit [DBG] from='client.37848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:42.945684+0000 mgr.smithi008.flmjzp (mgr.14640) 4790 : cluster [DBG] pgmap v3285: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:43.653071+0000 mgr.smithi008.flmjzp (mgr.14640) 4791 : audit [DBG] from='client.37860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:45.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:43.653071+0000 mgr.smithi008.flmjzp (mgr.14640) 4791 : audit [DBG] from='client.37860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:18:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:44.946392+0000 mgr.smithi008.flmjzp (mgr.14640) 4792 : cluster [DBG] pgmap v3286: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:44.946392+0000 mgr.smithi008.flmjzp (mgr.14640) 4792 : cluster [DBG] pgmap v3286: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:48.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:46.947042+0000 mgr.smithi008.flmjzp (mgr.14640) 4793 : cluster [DBG] pgmap v3287: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:46.947042+0000 mgr.smithi008.flmjzp (mgr.14640) 4793 : cluster [DBG] pgmap v3287: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:48.947755+0000 mgr.smithi008.flmjzp (mgr.14640) 4794 : cluster [DBG] pgmap v3288: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:48.947755+0000 mgr.smithi008.flmjzp (mgr.14640) 4794 : cluster [DBG] pgmap v3288: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:51.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:50.980637+0000 mon.smithi008 (mon.0) 5068 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:51.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:50.982902+0000 mon.smithi008 (mon.0) 5069 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:18:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:50.983864+0000 mon.smithi008 (mon.0) 5070 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:18:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:50.990512+0000 mon.smithi008 (mon.0) 5071 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:50.996897+0000 mon.smithi008 (mon.0) 5072 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:50.999896+0000 mon.smithi008 (mon.0) 5073 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:51.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:51.001556+0000 mon.smithi008 (mon.0) 5074 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:51.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:51.003187+0000 mon.smithi008 (mon.0) 5075 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:51.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:18:51.005154+0000 mon.smithi008 (mon.0) 5076 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:50.980637+0000 mon.smithi008 (mon.0) 5068 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:50.982902+0000 mon.smithi008 (mon.0) 5069 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:18:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:50.983864+0000 mon.smithi008 (mon.0) 5070 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:18:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:50.990512+0000 mon.smithi008 (mon.0) 5071 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:18:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:50.996897+0000 mon.smithi008 (mon.0) 5072 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:18:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:50.999896+0000 mon.smithi008 (mon.0) 5073 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:51.001556+0000 mon.smithi008 (mon.0) 5074 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:51.003187+0000 mon.smithi008 (mon.0) 5075 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:18:51.005154+0000 mon.smithi008 (mon.0) 5076 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:18:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:50.948274+0000 mgr.smithi008.flmjzp (mgr.14640) 4795 : cluster [DBG] pgmap v3289: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:18:50.984723+0000 mgr.smithi008.flmjzp (mgr.14640) 4796 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:18:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:50.985281+0000 mgr.smithi008.flmjzp (mgr.14640) 4797 : cluster [DBG] pgmap v3290: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:50.985528+0000 mgr.smithi008.flmjzp (mgr.14640) 4798 : cluster [DBG] pgmap v3291: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:18:51.007066+0000 mgr.smithi008.flmjzp (mgr.14640) 4799 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:50.948274+0000 mgr.smithi008.flmjzp (mgr.14640) 4795 : cluster [DBG] pgmap v3289: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:18:50.984723+0000 mgr.smithi008.flmjzp (mgr.14640) 4796 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:18:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:50.985281+0000 mgr.smithi008.flmjzp (mgr.14640) 4797 : cluster [DBG] pgmap v3290: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:50.985528+0000 mgr.smithi008.flmjzp (mgr.14640) 4798 : cluster [DBG] pgmap v3291: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:18:51.007066+0000 mgr.smithi008.flmjzp (mgr.14640) 4799 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:18:53.843 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:52.986229+0000 mgr.smithi008.flmjzp (mgr.14640) 4800 : cluster [DBG] pgmap v3292: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:52.986229+0000 mgr.smithi008.flmjzp (mgr.14640) 4800 : cluster [DBG] pgmap v3292: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:56.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:54.986993+0000 mgr.smithi008.flmjzp (mgr.14640) 4801 : cluster [DBG] pgmap v3293: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:56.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:54.986993+0000 mgr.smithi008.flmjzp (mgr.14640) 4801 : cluster [DBG] pgmap v3293: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:18:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:56.987704+0000 mgr.smithi008.flmjzp (mgr.14640) 4802 : cluster [DBG] pgmap v3294: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:18:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:18:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:56.987704+0000 mgr.smithi008.flmjzp (mgr.14640) 4802 : cluster [DBG] pgmap v3294: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:18:58.988470+0000 mgr.smithi008.flmjzp (mgr.14640) 4803 : cluster [DBG] pgmap v3295: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:18:58.988470+0000 mgr.smithi008.flmjzp (mgr.14640) 4803 : cluster [DBG] pgmap v3295: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:01.017765+0000 mon.smithi008 (mon.0) 5077 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:01.019790+0000 mon.smithi008 (mon.0) 5078 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:01.020781+0000 mon.smithi008 (mon.0) 5079 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:01.027180+0000 mon.smithi008 (mon.0) 5080 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:01.033602+0000 mon.smithi008 (mon.0) 5081 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:01.036761+0000 mon.smithi008 (mon.0) 5082 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:01.038442+0000 mon.smithi008 (mon.0) 5083 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:01.040075+0000 mon.smithi008 (mon.0) 5084 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:01.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:01.042073+0000 mon.smithi008 (mon.0) 5085 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:01.017765+0000 mon.smithi008 (mon.0) 5077 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:01.019790+0000 mon.smithi008 (mon.0) 5078 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:01.020781+0000 mon.smithi008 (mon.0) 5079 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:01.027180+0000 mon.smithi008 (mon.0) 5080 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:01.033602+0000 mon.smithi008 (mon.0) 5081 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:01.036761+0000 mon.smithi008 (mon.0) 5082 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:01.038442+0000 mon.smithi008 (mon.0) 5083 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:01.040075+0000 mon.smithi008 (mon.0) 5084 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:01.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:01.042073+0000 mon.smithi008 (mon.0) 5085 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:00.988966+0000 mgr.smithi008.flmjzp (mgr.14640) 4804 : cluster [DBG] pgmap v3296: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:01.021660+0000 mgr.smithi008.flmjzp (mgr.14640) 4805 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:01.022222+0000 mgr.smithi008.flmjzp (mgr.14640) 4806 : cluster [DBG] pgmap v3297: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:01.022563+0000 mgr.smithi008.flmjzp (mgr.14640) 4807 : cluster [DBG] pgmap v3298: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:01.043978+0000 mgr.smithi008.flmjzp (mgr.14640) 4808 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:00.988966+0000 mgr.smithi008.flmjzp (mgr.14640) 4804 : cluster [DBG] pgmap v3296: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:01.021660+0000 mgr.smithi008.flmjzp (mgr.14640) 4805 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:01.022222+0000 mgr.smithi008.flmjzp (mgr.14640) 4806 : cluster [DBG] pgmap v3297: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:01.022563+0000 mgr.smithi008.flmjzp (mgr.14640) 4807 : cluster [DBG] pgmap v3298: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:01.043978+0000 mgr.smithi008.flmjzp (mgr.14640) 4808 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:03.023021+0000 mgr.smithi008.flmjzp (mgr.14640) 4809 : cluster [DBG] pgmap v3299: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:03.023021+0000 mgr.smithi008.flmjzp (mgr.14640) 4809 : cluster [DBG] pgmap v3299: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:05.023733+0000 mgr.smithi008.flmjzp (mgr.14640) 4810 : cluster [DBG] pgmap v3300: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:05.023733+0000 mgr.smithi008.flmjzp (mgr.14640) 4810 : cluster [DBG] pgmap v3300: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:07.024231+0000 mgr.smithi008.flmjzp (mgr.14640) 4811 : cluster [DBG] pgmap v3301: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:07.024231+0000 mgr.smithi008.flmjzp (mgr.14640) 4811 : cluster [DBG] pgmap v3301: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:09.024850+0000 mgr.smithi008.flmjzp (mgr.14640) 4812 : cluster [DBG] pgmap v3302: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:09.024850+0000 mgr.smithi008.flmjzp (mgr.14640) 4812 : cluster [DBG] pgmap v3302: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:11.054020+0000 mon.smithi008 (mon.0) 5086 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:11.054020+0000 mon.smithi008 (mon.0) 5086 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:11.025536+0000 mgr.smithi008.flmjzp (mgr.14640) 4813 : cluster [DBG] pgmap v3303: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:11.617990+0000 mon.smithi008 (mon.0) 5087 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:11.618842+0000 mon.smithi008 (mon.0) 5088 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:11.624512+0000 mon.smithi008 (mon.0) 5089 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:11.630444+0000 mon.smithi008 (mon.0) 5090 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:12.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:11.632907+0000 mon.smithi008 (mon.0) 5091 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:12.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:11.634179+0000 mon.smithi008 (mon.0) 5092 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:12.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:11.635413+0000 mon.smithi008 (mon.0) 5093 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:12.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:11.636967+0000 mon.smithi008 (mon.0) 5094 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:11.025536+0000 mgr.smithi008.flmjzp (mgr.14640) 4813 : cluster [DBG] pgmap v3303: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:11.617990+0000 mon.smithi008 (mon.0) 5087 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:11.618842+0000 mon.smithi008 (mon.0) 5088 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:11.624512+0000 mon.smithi008 (mon.0) 5089 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:11.630444+0000 mon.smithi008 (mon.0) 5090 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:12.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:11.632907+0000 mon.smithi008 (mon.0) 5091 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:12.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:11.634179+0000 mon.smithi008 (mon.0) 5092 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:12.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:11.635413+0000 mon.smithi008 (mon.0) 5093 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:12.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:11.636967+0000 mon.smithi008 (mon.0) 5094 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:11.619547+0000 mgr.smithi008.flmjzp (mgr.14640) 4814 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:11.620003+0000 mgr.smithi008.flmjzp (mgr.14640) 4815 : cluster [DBG] pgmap v3304: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:11.620250+0000 mgr.smithi008.flmjzp (mgr.14640) 4816 : cluster [DBG] pgmap v3305: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:13.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:11.638534+0000 mgr.smithi008.flmjzp (mgr.14640) 4817 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:11.619547+0000 mgr.smithi008.flmjzp (mgr.14640) 4814 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:11.620003+0000 mgr.smithi008.flmjzp (mgr.14640) 4815 : cluster [DBG] pgmap v3304: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:11.620250+0000 mgr.smithi008.flmjzp (mgr.14640) 4816 : cluster [DBG] pgmap v3305: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:11.638534+0000 mgr.smithi008.flmjzp (mgr.14640) 4817 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:13.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.808+0000 7f39317fc700 1 -- 172.21.15.8:0/2307394757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f392c0f77d0 msgr2=0x7f392c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:13.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.808+0000 7f39317fc700 1 --2- 172.21.15.8:0/2307394757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f392c0f77d0 0x7f392c0f7c30 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f3920004660 tx=0x7f3920009b30).stop 2023-10-18T22:19:13.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.808+0000 7f39317fc700 1 -- 172.21.15.8:0/2307394757 shutdown_connections 2023-10-18T22:19:13.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.808+0000 7f39317fc700 1 --2- 172.21.15.8:0/2307394757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f392c0f77d0 0x7f392c0f7c30 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:13.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.808+0000 7f39317fc700 1 --2- 172.21.15.8:0/2307394757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f392c0f6530 0x7f392c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:13.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.808+0000 7f39317fc700 1 -- 172.21.15.8:0/2307394757 >> 172.21.15.8:0/2307394757 conn(0x7f392c0f1c90 msgr2=0x7f392c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:13.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.808+0000 7f39317fc700 1 -- 172.21.15.8:0/2307394757 shutdown_connections 2023-10-18T22:19:13.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.808+0000 7f39317fc700 1 -- 172.21.15.8:0/2307394757 wait complete. 2023-10-18T22:19:13.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.809+0000 7f39317fc700 1 Processor -- start 2023-10-18T22:19:13.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.809+0000 7f39317fc700 1 -- start start 2023-10-18T22:19:13.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.810+0000 7f39317fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f392c0f6530 0x7f392c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:13.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.810+0000 7f39317fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f392c0f77d0 0x7f392c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:13.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.810+0000 7f39317fc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c06a380 con 0x7f392c0f6530 2023-10-18T22:19:13.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.810+0000 7f39317fc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c06a4c0 con 0x7f392c0f77d0 2023-10-18T22:19:13.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.810+0000 7f392bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f392c0f6530 0x7f392c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:13.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.810+0000 7f392bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f392c0f6530 0x7f392c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54762/0 (socket says 172.21.15.8:54762) 2023-10-18T22:19:13.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.810+0000 7f392bfff700 1 -- 172.21.15.8:0/3708385444 learned_addr learned my addr 172.21.15.8:0/3708385444 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:13.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.810+0000 7f392b7fe700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f392c0f77d0 0x7f392c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:13.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.811+0000 7f392bfff700 1 -- 172.21.15.8:0/3708385444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f392c0f77d0 msgr2=0x7f392c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:13.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.811+0000 7f392bfff700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f392c0f77d0 0x7f392c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:13.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.811+0000 7f392bfff700 1 -- 172.21.15.8:0/3708385444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3920005040 con 0x7f392c0f6530 2023-10-18T22:19:13.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.811+0000 7f392bfff700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f392c0f6530 0x7f392c06b9a0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f391c002700 tx=0x7f391c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:13.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.811+0000 7f3928ff9700 1 -- 172.21.15.8:0/3708385444 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f391c0079c0 con 0x7f392c0f6530 2023-10-18T22:19:13.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.811+0000 7f3928ff9700 1 -- 172.21.15.8:0/3708385444 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f391c00f040 con 0x7f392c0f6530 2023-10-18T22:19:13.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.811+0000 7f3928ff9700 1 -- 172.21.15.8:0/3708385444 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f391c0148d0 con 0x7f392c0f6530 2023-10-18T22:19:13.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.811+0000 7f39317fc700 1 -- 172.21.15.8:0/3708385444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c06a7a0 con 0x7f392c0f6530 2023-10-18T22:19:13.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.811+0000 7f39317fc700 1 -- 172.21.15.8:0/3708385444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c10ed70 con 0x7f392c0f6530 2023-10-18T22:19:13.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.812+0000 7f39317fc700 1 -- 172.21.15.8:0/3708385444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c045ad0 con 0x7f392c0f6530 2023-10-18T22:19:13.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.813+0000 7f3928ff9700 1 -- 172.21.15.8:0/3708385444 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f391c01b060 con 0x7f392c0f6530 2023-10-18T22:19:13.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.814+0000 7f3928ff9700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3914060f70 0x7f3914063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:13.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.814+0000 7f3928ff9700 1 -- 172.21.15.8:0/3708385444 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f391c07c730 con 0x7f392c0f6530 2023-10-18T22:19:13.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.814+0000 7f392b7fe700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3914060f70 0x7f3914063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:13.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.815+0000 7f392b7fe700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3914060f70 0x7f3914063430 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f3920004630 tx=0x7f3920009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:13.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:13.818+0000 7f3928ff9700 1 -- 172.21.15.8:0/3708385444 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f391c04c3a0 con 0x7f392c0f6530 2023-10-18T22:19:14.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.022+0000 7f39317fc700 1 -- 172.21.15.8:0/3708385444 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f392c0fee00 con 0x7f3914060f70 2023-10-18T22:19:14.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.023+0000 7f3928ff9700 1 -- 172.21.15.8:0/3708385444 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f392c0fee00 con 0x7f3914060f70 2023-10-18T22:19:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 -- 172.21.15.8:0/3708385444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3914060f70 msgr2=0x7f3914063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3914060f70 0x7f3914063430 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f3920004630 tx=0x7f3920009b30).stop 2023-10-18T22:19:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 -- 172.21.15.8:0/3708385444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f392c0f6530 msgr2=0x7f392c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f392c0f6530 0x7f392c06b9a0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f391c002700 tx=0x7f391c009d80).stop 2023-10-18T22:19:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 -- 172.21.15.8:0/3708385444 shutdown_connections 2023-10-18T22:19:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3914060f70 0x7f3914063430 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f392c0f6530 0x7f392c06b9a0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 --2- 172.21.15.8:0/3708385444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f392c0f77d0 0x7f392c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 -- 172.21.15.8:0/3708385444 >> 172.21.15.8:0/3708385444 conn(0x7f392c0f1c90 msgr2=0x7f392c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 -- 172.21.15.8:0/3708385444 shutdown_connections 2023-10-18T22:19:14.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.025+0000 7f39317fc700 1 -- 172.21.15.8:0/3708385444 wait complete. 2023-10-18T22:19:14.041 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:19:14.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.162+0000 7f3e20851700 1 -- 172.21.15.8:0/2240855313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e1c0f77d0 msgr2=0x7f3e1c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.162+0000 7f3e20851700 1 --2- 172.21.15.8:0/2240855313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e1c0f77d0 0x7f3e1c0f7c30 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f3e10004660 tx=0x7f3e10009b30).stop 2023-10-18T22:19:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.162+0000 7f3e20851700 1 -- 172.21.15.8:0/2240855313 shutdown_connections 2023-10-18T22:19:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.162+0000 7f3e20851700 1 --2- 172.21.15.8:0/2240855313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e1c0f77d0 0x7f3e1c0f7c30 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.162+0000 7f3e20851700 1 --2- 172.21.15.8:0/2240855313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0f6530 0x7f3e1c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.162+0000 7f3e20851700 1 -- 172.21.15.8:0/2240855313 >> 172.21.15.8:0/2240855313 conn(0x7f3e1c0f1c90 msgr2=0x7f3e1c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.162+0000 7f3e20851700 1 -- 172.21.15.8:0/2240855313 shutdown_connections 2023-10-18T22:19:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.162+0000 7f3e20851700 1 -- 172.21.15.8:0/2240855313 wait complete. 2023-10-18T22:19:14.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.163+0000 7f3e20851700 1 Processor -- start 2023-10-18T22:19:14.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.163+0000 7f3e20851700 1 -- start start 2023-10-18T22:19:14.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.163+0000 7f3e20851700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e1c0f6530 0x7f3e1c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:14.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.163+0000 7f3e20851700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0f77d0 0x7f3e1c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:14.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.163+0000 7f3e20851700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c109a20 con 0x7f3e1c0f6530 2023-10-18T22:19:14.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.163+0000 7f3e20851700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c109b60 con 0x7f3e1c0f77d0 2023-10-18T22:19:14.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e1ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e1c0f6530 0x7f3e1c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:14.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e1ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e1c0f6530 0x7f3e1c108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54778/0 (socket says 172.21.15.8:54778) 2023-10-18T22:19:14.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e1ad9d700 1 -- 172.21.15.8:0/1034780661 learned_addr learned my addr 172.21.15.8:0/1034780661 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:14.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e1a59c700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0f77d0 0x7f3e1c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:14.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e1ad9d700 1 -- 172.21.15.8:0/1034780661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0f77d0 msgr2=0x7f3e1c109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e1ad9d700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0f77d0 0x7f3e1c109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e1ad9d700 1 -- 172.21.15.8:0/1034780661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e10005040 con 0x7f3e1c0f6530 2023-10-18T22:19:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e1ad9d700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e1c0f6530 0x7f3e1c108f80 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f3e0c002700 tx=0x7f3e0c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e037fe700 1 -- 172.21.15.8:0/1034780661 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e0c0079c0 con 0x7f3e1c0f6530 2023-10-18T22:19:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e037fe700 1 -- 172.21.15.8:0/1034780661 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3e0c00f040 con 0x7f3e1c0f6530 2023-10-18T22:19:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.164+0000 7f3e037fe700 1 -- 172.21.15.8:0/1034780661 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e0c0148d0 con 0x7f3e1c0f6530 2023-10-18T22:19:14.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.165+0000 7f3e20851700 1 -- 172.21.15.8:0/1034780661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1c10a500 con 0x7f3e1c0f6530 2023-10-18T22:19:14.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.165+0000 7f3e20851700 1 -- 172.21.15.8:0/1034780661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c10aac0 con 0x7f3e1c0f6530 2023-10-18T22:19:14.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.166+0000 7f3e20851700 1 -- 172.21.15.8:0/1034780661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1c045ad0 con 0x7f3e1c0f6530 2023-10-18T22:19:14.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.167+0000 7f3e037fe700 1 -- 172.21.15.8:0/1034780661 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3e0c01b060 con 0x7f3e1c0f6530 2023-10-18T22:19:14.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.167+0000 7f3e037fe700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3e04060f70 0x7f3e04063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:14.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.167+0000 7f3e037fe700 1 -- 172.21.15.8:0/1034780661 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3e0c07c770 con 0x7f3e1c0f6530 2023-10-18T22:19:14.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.168+0000 7f3e1a59c700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3e04060f70 0x7f3e04063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:14.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.168+0000 7f3e1a59c700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3e04060f70 0x7f3e04063430 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f3e10004630 tx=0x7f3e10009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:14.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.172+0000 7f3e037fe700 1 -- 172.21.15.8:0/1034780661 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3e0c04fdd0 con 0x7f3e1c0f6530 2023-10-18T22:19:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.371+0000 7f3e20851700 1 -- 172.21.15.8:0/1034780661 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e1c10ad90 con 0x7f3e04060f70 2023-10-18T22:19:14.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.372+0000 7f3e037fe700 1 -- 172.21.15.8:0/1034780661 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3e1c10ad90 con 0x7f3e04060f70 2023-10-18T22:19:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 -- 172.21.15.8:0/1034780661 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3e04060f70 msgr2=0x7f3e04063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3e04060f70 0x7f3e04063430 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f3e10004630 tx=0x7f3e10009b30).stop 2023-10-18T22:19:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 -- 172.21.15.8:0/1034780661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e1c0f6530 msgr2=0x7f3e1c108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e1c0f6530 0x7f3e1c108f80 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f3e0c002700 tx=0x7f3e0c009d80).stop 2023-10-18T22:19:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 -- 172.21.15.8:0/1034780661 shutdown_connections 2023-10-18T22:19:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3e04060f70 0x7f3e04063430 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e1c0f6530 0x7f3e1c108f80 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 --2- 172.21.15.8:0/1034780661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c0f77d0 0x7f3e1c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 -- 172.21.15.8:0/1034780661 >> 172.21.15.8:0/1034780661 conn(0x7f3e1c0f1c90 msgr2=0x7f3e1c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 -- 172.21.15.8:0/1034780661 shutdown_connections 2023-10-18T22:19:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.375+0000 7f3e20851700 1 -- 172.21.15.8:0/1034780661 wait complete. 2023-10-18T22:19:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.512+0000 7fbdeda94700 1 -- 172.21.15.8:0/1963588052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde80602d0 msgr2=0x7fbde80f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.512+0000 7fbdeda94700 1 --2- 172.21.15.8:0/1963588052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde80602d0 0x7fbde80f9150 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fbddc004660 tx=0x7fbddc009b30).stop 2023-10-18T22:19:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.512+0000 7fbdeda94700 1 -- 172.21.15.8:0/1963588052 shutdown_connections 2023-10-18T22:19:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.512+0000 7fbdeda94700 1 --2- 172.21.15.8:0/1963588052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80f96d0 0x7fbde80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.512+0000 7fbdeda94700 1 --2- 172.21.15.8:0/1963588052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde80602d0 0x7fbde80f9150 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.512+0000 7fbdeda94700 1 -- 172.21.15.8:0/1963588052 >> 172.21.15.8:0/1963588052 conn(0x7fbde80f0b90 msgr2=0x7fbde80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.512+0000 7fbdeda94700 1 -- 172.21.15.8:0/1963588052 shutdown_connections 2023-10-18T22:19:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.512+0000 7fbdeda94700 1 -- 172.21.15.8:0/1963588052 wait complete. 2023-10-18T22:19:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.513+0000 7fbdeda94700 1 Processor -- start 2023-10-18T22:19:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.513+0000 7fbdeda94700 1 -- start start 2023-10-18T22:19:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.513+0000 7fbdeda94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80602d0 0x7fbde80f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.513+0000 7fbdeda94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde80f96d0 0x7fbde80f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.513+0000 7fbdeda94700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80f55b0 con 0x7fbde80f96d0 2023-10-18T22:19:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.513+0000 7fbdeda94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80f56f0 con 0x7fbde80602d0 2023-10-18T22:19:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.514+0000 7fbde7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde80f96d0 0x7fbde80f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.514+0000 7fbde7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde80f96d0 0x7fbde80f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54792/0 (socket says 172.21.15.8:54792) 2023-10-18T22:19:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.514+0000 7fbde7fff700 1 -- 172.21.15.8:0/335320407 learned_addr learned my addr 172.21.15.8:0/335320407 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.514+0000 7fbdeca92700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80602d0 0x7fbde80f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.514+0000 7fbde7fff700 1 -- 172.21.15.8:0/335320407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80602d0 msgr2=0x7fbde80f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.514+0000 7fbde7fff700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80602d0 0x7fbde80f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.514+0000 7fbde7fff700 1 -- 172.21.15.8:0/335320407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc005040 con 0x7fbde80f96d0 2023-10-18T22:19:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.514+0000 7fbde7fff700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde80f96d0 0x7fbde80f5050 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fbdd400e7c0 tx=0x7fbdd400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.515+0000 7fbde57fa700 1 -- 172.21.15.8:0/335320407 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdd40092e0 con 0x7fbde80f96d0 2023-10-18T22:19:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.515+0000 7fbde57fa700 1 -- 172.21.15.8:0/335320407 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbdd400f040 con 0x7fbde80f96d0 2023-10-18T22:19:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.515+0000 7fbde57fa700 1 -- 172.21.15.8:0/335320407 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdd40147e0 con 0x7fbde80f96d0 2023-10-18T22:19:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.515+0000 7fbdeda94700 1 -- 172.21.15.8:0/335320407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde80f59d0 con 0x7fbde80f96d0 2023-10-18T22:19:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.515+0000 7fbdeda94700 1 -- 172.21.15.8:0/335320407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde80f5ec0 con 0x7fbde80f96d0 2023-10-18T22:19:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.516+0000 7fbdeda94700 1 -- 172.21.15.8:0/335320407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde8045ad0 con 0x7fbde80f96d0 2023-10-18T22:19:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.517+0000 7fbde57fa700 1 -- 172.21.15.8:0/335320407 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbdd4014a60 con 0x7fbde80f96d0 2023-10-18T22:19:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.518+0000 7fbde57fa700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdd8060f70 0x7fbdd8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.518+0000 7fbde57fa700 1 -- 172.21.15.8:0/335320407 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbdd407ca40 con 0x7fbde80f96d0 2023-10-18T22:19:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.518+0000 7fbdeca92700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdd8060f70 0x7fbdd8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.519+0000 7fbdeca92700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdd8060f70 0x7fbdd8063430 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fbddc009720 tx=0x7fbddc016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.522+0000 7fbde57fa700 1 -- 172.21.15.8:0/335320407 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbdd404c6b0 con 0x7fbde80f96d0 2023-10-18T22:19:14.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.715+0000 7fbdeda94700 1 -- 172.21.15.8:0/335320407 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbde80f5ec0 con 0x7fbdd8060f70 2023-10-18T22:19:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.725+0000 7fbde57fa700 1 -- 172.21.15.8:0/335320407 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fbde80f5ec0 con 0x7fbdd8060f70 2023-10-18T22:19:14.726 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:19:14.726 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (85m) 2m ago 87m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:19:14.727 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (79m) 2m ago 87m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:19:14.727 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (79m) 54s ago 86m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:19:14.727 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (85m) 2m ago 87m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:19:14.727 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 83m - - 2023-10-18T22:19:14.727 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 83m - - 2023-10-18T22:19:14.728 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 54s ago 83m - - 2023-10-18T22:19:14.728 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 54s ago 83m - - 2023-10-18T22:19:14.728 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (81m) 2m ago 88m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:19:14.728 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (80m) 54s ago 86m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:19:14.728 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (80m) 2m ago 88m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:19:14.729 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (80m) 54s ago 86m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:19:14.729 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (86m) 2m ago 86m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:19:14.729 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (86m) 54s ago 86m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:19:14.729 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (79m) 2m ago 85m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:19:14.729 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (77m) 2m ago 85m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:19:14.729 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (77m) 2m ago 85m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:19:14.730 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (76m) 54s ago 85m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:19:14.730 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (75m) 54s ago 84m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:19:14.730 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (75m) 54s ago 84m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:19:14.730 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (81m) 2m ago 86m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:19:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 -- 172.21.15.8:0/335320407 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdd8060f70 msgr2=0x7fbdd8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdd8060f70 0x7fbdd8063430 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fbddc009720 tx=0x7fbddc016040).stop 2023-10-18T22:19:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 -- 172.21.15.8:0/335320407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde80f96d0 msgr2=0x7fbde80f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde80f96d0 0x7fbde80f5050 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fbdd400e7c0 tx=0x7fbdd400b040).stop 2023-10-18T22:19:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 -- 172.21.15.8:0/335320407 shutdown_connections 2023-10-18T22:19:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdd8060f70 0x7fbdd8063430 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80602d0 0x7fbde80f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 --2- 172.21.15.8:0/335320407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbde80f96d0 0x7fbde80f5050 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 -- 172.21.15.8:0/335320407 >> 172.21.15.8:0/335320407 conn(0x7fbde80f0b90 msgr2=0x7fbde80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:14.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 -- 172.21.15.8:0/335320407 shutdown_connections 2023-10-18T22:19:14.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.727+0000 7fbdeda94700 1 -- 172.21.15.8:0/335320407 wait complete. 2023-10-18T22:19:14.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.864+0000 7fe69a4e5700 1 -- 172.21.15.8:0/2869920716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6940f6530 msgr2=0x7fe6940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.864+0000 7fe69a4e5700 1 --2- 172.21.15.8:0/2869920716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6940f6530 0x7fe6940f6950 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7fe690004660 tx=0x7fe690009b30).stop 2023-10-18T22:19:14.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.864+0000 7fe69a4e5700 1 -- 172.21.15.8:0/2869920716 shutdown_connections 2023-10-18T22:19:14.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.864+0000 7fe69a4e5700 1 --2- 172.21.15.8:0/2869920716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6940f77d0 0x7fe6940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.864+0000 7fe69a4e5700 1 --2- 172.21.15.8:0/2869920716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6940f6530 0x7fe6940f6950 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:14.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.864+0000 7fe69a4e5700 1 -- 172.21.15.8:0/2869920716 >> 172.21.15.8:0/2869920716 conn(0x7fe6940f1c90 msgr2=0x7fe6940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.864+0000 7fe69a4e5700 1 -- 172.21.15.8:0/2869920716 shutdown_connections 2023-10-18T22:19:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.864+0000 7fe69a4e5700 1 -- 172.21.15.8:0/2869920716 wait complete. 2023-10-18T22:19:14.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.865+0000 7fe69a4e5700 1 Processor -- start 2023-10-18T22:19:14.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.865+0000 7fe69a4e5700 1 -- start start 2023-10-18T22:19:14.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.865+0000 7fe69a4e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6940f6530 0x7fe694108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:14.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.865+0000 7fe69a4e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6940f77d0 0x7fe6941094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:14.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.865+0000 7fe69a4e5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe694109a70 con 0x7fe6940f77d0 2023-10-18T22:19:14.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.865+0000 7fe69a4e5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe694109bb0 con 0x7fe6940f6530 2023-10-18T22:19:14.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.866+0000 7fe698ce2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6940f77d0 0x7fe6941094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.866+0000 7fe698ce2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6940f77d0 0x7fe6941094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54816/0 (socket says 172.21.15.8:54816) 2023-10-18T22:19:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.866+0000 7fe698ce2700 1 -- 172.21.15.8:0/44161904 learned_addr learned my addr 172.21.15.8:0/44161904 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.866+0000 7fe698ce2700 1 -- 172.21.15.8:0/44161904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6940f6530 msgr2=0x7fe694108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.866+0000 7fe698ce2700 1 --2- 172.21.15.8:0/44161904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6940f6530 0x7fe694108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:19:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.866+0000 7fe698ce2700 1 -- 172.21.15.8:0/44161904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe690005040 con 0x7fe6940f77d0 2023-10-18T22:19:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.866+0000 7fe698ce2700 1 --2- 172.21.15.8:0/44161904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6940f77d0 0x7fe6941094c0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7fe6840026d0 tx=0x7fe684009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.866+0000 7fe689ffb700 1 -- 172.21.15.8:0/44161904 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe684009320 con 0x7fe6940f77d0 2023-10-18T22:19:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.867+0000 7fe689ffb700 1 -- 172.21.15.8:0/44161904 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe68400f040 con 0x7fe6940f77d0 2023-10-18T22:19:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.867+0000 7fe69a4e5700 1 -- 172.21.15.8:0/44161904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69410a550 con 0x7fe6940f77d0 2023-10-18T22:19:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.867+0000 7fe689ffb700 1 -- 172.21.15.8:0/44161904 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6840148a0 con 0x7fe6940f77d0 2023-10-18T22:19:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.867+0000 7fe69a4e5700 1 -- 172.21.15.8:0/44161904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69410ab10 con 0x7fe6940f77d0 2023-10-18T22:19:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.868+0000 7fe69a4e5700 1 -- 172.21.15.8:0/44161904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe694045ad0 con 0x7fe6940f77d0 2023-10-18T22:19:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.869+0000 7fe689ffb700 1 -- 172.21.15.8:0/44161904 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe684009480 con 0x7fe6940f77d0 2023-10-18T22:19:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.869+0000 7fe689ffb700 1 --2- 172.21.15.8:0/44161904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe680060f70 0x7fe680063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.870+0000 7fe689ffb700 1 -- 172.21.15.8:0/44161904 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe68407cfd0 con 0x7fe6940f77d0 2023-10-18T22:19:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.870+0000 7fe6994e3700 1 --2- 172.21.15.8:0/44161904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe680060f70 0x7fe680063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:14.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.870+0000 7fe6994e3700 1 --2- 172.21.15.8:0/44161904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe680060f70 0x7fe680063430 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fe690009f50 tx=0x7fe690009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:14.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:14.873+0000 7fe689ffb700 1 -- 172.21.15.8:0/44161904 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe684050670 con 0x7fe6940f77d0 2023-10-18T22:19:15.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.127+0000 7fe69a4e5700 1 -- 172.21.15.8:0/44161904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe694027a00 con 0x7fe6940f77d0 2023-10-18T22:19:15.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.128+0000 7fe689ffb700 1 -- 172.21.15.8:0/44161904 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fe6840181b0 con 0x7fe6940f77d0 2023-10-18T22:19:15.130 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:19:15.130 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:19:15.130 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:19:15.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:19:15.131 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:19:15.131 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:19:15.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:19:15.131 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:19:15.131 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:19:15.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:19:15.132 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:19:15.132 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:19:15.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:19:15.132 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:19:15.133 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:19:15.133 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:19:15.133 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:19:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.130+0000 7fe69a4e5700 1 -- 172.21.15.8:0/44161904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe680060f70 msgr2=0x7fe680063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.130+0000 7fe69a4e5700 1 --2- 172.21.15.8:0/44161904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe680060f70 0x7fe680063430 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fe690009f50 tx=0x7fe690009b30).stop 2023-10-18T22:19:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.130+0000 7fe69a4e5700 1 -- 172.21.15.8:0/44161904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6940f77d0 msgr2=0x7fe6941094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.130+0000 7fe69a4e5700 1 --2- 172.21.15.8:0/44161904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6940f77d0 0x7fe6941094c0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7fe6840026d0 tx=0x7fe684009de0).stop 2023-10-18T22:19:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.130+0000 7fe69a4e5700 1 -- 172.21.15.8:0/44161904 shutdown_connections 2023-10-18T22:19:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.130+0000 7fe69a4e5700 1 --2- 172.21.15.8:0/44161904 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe680060f70 0x7fe680063430 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.130+0000 7fe69a4e5700 1 --2- 172.21.15.8:0/44161904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6940f6530 0x7fe694108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:19:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.130+0000 7fe69a4e5700 1 --2- 172.21.15.8:0/44161904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6940f77d0 0x7fe6941094c0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.130+0000 7fe69a4e5700 1 -- 172.21.15.8:0/44161904 >> 172.21.15.8:0/44161904 conn(0x7fe6940f1c90 msgr2=0x7fe69406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.131+0000 7fe69a4e5700 1 -- 172.21.15.8:0/44161904 shutdown_connections 2023-10-18T22:19:15.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.131+0000 7fe69a4e5700 1 -- 172.21.15.8:0/44161904 wait complete. 2023-10-18T22:19:15.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.267+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/1072986931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e40f77d0 msgr2=0x7fb6e40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:15.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.267+0000 7fb6e9cd0700 1 --2- 172.21.15.8:0/1072986931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e40f77d0 0x7fb6e40f7c30 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7fb6d0004660 tx=0x7fb6d0009b30).stop 2023-10-18T22:19:15.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.268+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/1072986931 shutdown_connections 2023-10-18T22:19:15.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.268+0000 7fb6e9cd0700 1 --2- 172.21.15.8:0/1072986931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e40f77d0 0x7fb6e40f7c30 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.268+0000 7fb6e9cd0700 1 --2- 172.21.15.8:0/1072986931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e40f6530 0x7fb6e40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.268+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/1072986931 >> 172.21.15.8:0/1072986931 conn(0x7fb6e40f1c90 msgr2=0x7fb6e40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.268+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/1072986931 shutdown_connections 2023-10-18T22:19:15.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.268+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/1072986931 wait complete. 2023-10-18T22:19:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.268+0000 7fb6e9cd0700 1 Processor -- start 2023-10-18T22:19:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.269+0000 7fb6e9cd0700 1 -- start start 2023-10-18T22:19:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.269+0000 7fb6e9cd0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e40f6530 0x7fb6e4108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.269+0000 7fb6e9cd0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e40f77d0 0x7fb6e4109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:15.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.269+0000 7fb6e9cd0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e41099b0 con 0x7fb6e40f77d0 2023-10-18T22:19:15.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.269+0000 7fb6e9cd0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e4109af0 con 0x7fb6e40f6530 2023-10-18T22:19:15.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.269+0000 7fb6e3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e40f77d0 0x7fb6e4109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:15.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.269+0000 7fb6e3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e40f77d0 0x7fb6e4109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54834/0 (socket says 172.21.15.8:54834) 2023-10-18T22:19:15.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.269+0000 7fb6e3fff700 1 -- 172.21.15.8:0/425425621 learned_addr learned my addr 172.21.15.8:0/425425621 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:15.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.269+0000 7fb6e8cce700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e40f6530 0x7fb6e4108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:15.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.270+0000 7fb6e3fff700 1 -- 172.21.15.8:0/425425621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e40f6530 msgr2=0x7fb6e4108f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.270+0000 7fb6e3fff700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e40f6530 0x7fb6e4108f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.270+0000 7fb6e3fff700 1 -- 172.21.15.8:0/425425621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0005040 con 0x7fb6e40f77d0 2023-10-18T22:19:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.270+0000 7fb6e3fff700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e40f77d0 0x7fb6e4109400 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7fb6d0009f50 tx=0x7fb6d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.270+0000 7fb6e17fa700 1 -- 172.21.15.8:0/425425621 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d0018070 con 0x7fb6e40f77d0 2023-10-18T22:19:15.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.270+0000 7fb6e17fa700 1 -- 172.21.15.8:0/425425621 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb6d0009630 con 0x7fb6e40f77d0 2023-10-18T22:19:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.270+0000 7fb6e17fa700 1 -- 172.21.15.8:0/425425621 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d001c3c0 con 0x7fb6e40f77d0 2023-10-18T22:19:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.270+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/425425621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e410a430 con 0x7fb6e40f77d0 2023-10-18T22:19:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.270+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/425425621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e410a990 con 0x7fb6e40f77d0 2023-10-18T22:19:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.272+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/425425621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e4045ad0 con 0x7fb6e40f77d0 2023-10-18T22:19:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.272+0000 7fb6e17fa700 1 -- 172.21.15.8:0/425425621 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb6d001d420 con 0x7fb6e40f77d0 2023-10-18T22:19:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.273+0000 7fb6e17fa700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6d4060f70 0x7fb6d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.273+0000 7fb6e17fa700 1 -- 172.21.15.8:0/425425621 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb6d007e540 con 0x7fb6e40f77d0 2023-10-18T22:19:15.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.274+0000 7fb6e8cce700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6d4060f70 0x7fb6d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.274+0000 7fb6e8cce700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6d4060f70 0x7fb6d4063430 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7fb6e40f7630 tx=0x7fb6d800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:15.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.279+0000 7fb6e17fa700 1 -- 172.21.15.8:0/425425621 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb6d0051ba0 con 0x7fb6e40f77d0 2023-10-18T22:19:15.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.505+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/425425621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb6e4027a00 con 0x7fb6e40f77d0 2023-10-18T22:19:15.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.506+0000 7fb6e17fa700 1 -- 172.21.15.8:0/425425621 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fb6d0051790 con 0x7fb6e40f77d0 2023-10-18T22:19:15.507 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:19:15.508 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:19:15.508 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:19:15.508 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:19:15.508 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:19:15.509 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:19:15.509 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:19:15.509 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:19:15.509 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:19:15.509 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:19:15.509 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:19:15.510 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:19:15.510 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:19:15.510 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:19:15.510 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:19:15.511 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:19:15.511 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:19:15.511 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:19:15.511 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:19:15.511 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:19:15.511 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:19:15.512 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:19:15.512 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:19:15.512 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:19:15.512 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:19:15.512 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:19:15.513 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:19:15.513 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:19:15.513 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:19:15.513 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:19:15.513 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:19:15.514 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:19:15.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:19:15.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:19:15.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/425425621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6d4060f70 msgr2=0x7fb6d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:15.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6d4060f70 0x7fb6d4063430 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7fb6e40f7630 tx=0x7fb6d800b040).stop 2023-10-18T22:19:15.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/425425621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e40f77d0 msgr2=0x7fb6e4109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:15.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e40f77d0 0x7fb6e4109400 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7fb6d0009f50 tx=0x7fb6d0009b30).stop 2023-10-18T22:19:15.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/425425621 shutdown_connections 2023-10-18T22:19:15.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb6d4060f70 0x7fb6d4063430 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e40f6530 0x7fb6e4108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 --2- 172.21.15.8:0/425425621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e40f77d0 0x7fb6e4109400 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/425425621 >> 172.21.15.8:0/425425621 conn(0x7fb6e40f1c90 msgr2=0x7fb6e406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:15.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/425425621 shutdown_connections 2023-10-18T22:19:15.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.508+0000 7fb6e9cd0700 1 -- 172.21.15.8:0/425425621 wait complete. 2023-10-18T22:19:15.517 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:19:15.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.647+0000 7f5abd3d1700 1 -- 172.21.15.8:0/1481374295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab80f9690 msgr2=0x7f5ab80fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:15.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.647+0000 7f5abd3d1700 1 --2- 172.21.15.8:0/1481374295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab80f9690 0x7f5ab80fbae0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f5aac004660 tx=0x7f5aac009b30).stop 2023-10-18T22:19:15.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.647+0000 7f5abd3d1700 1 -- 172.21.15.8:0/1481374295 shutdown_connections 2023-10-18T22:19:15.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.647+0000 7f5abd3d1700 1 --2- 172.21.15.8:0/1481374295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab80f9690 0x7f5ab80fbae0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.647+0000 7f5abd3d1700 1 --2- 172.21.15.8:0/1481374295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ab8060310 0x7f5ab80f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.647+0000 7f5abd3d1700 1 -- 172.21.15.8:0/1481374295 >> 172.21.15.8:0/1481374295 conn(0x7f5ab80f0b90 msgr2=0x7f5ab80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:15.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.647+0000 7f5abd3d1700 1 -- 172.21.15.8:0/1481374295 shutdown_connections 2023-10-18T22:19:15.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.647+0000 7f5abd3d1700 1 -- 172.21.15.8:0/1481374295 wait complete. 2023-10-18T22:19:15.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.648+0000 7f5abd3d1700 1 Processor -- start 2023-10-18T22:19:15.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.648+0000 7f5abd3d1700 1 -- start start 2023-10-18T22:19:15.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.648+0000 7f5abd3d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ab8060310 0x7f5ab80f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:15.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.648+0000 7f5abd3d1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab80f9690 0x7f5ab80f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:15.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.648+0000 7f5abd3d1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80f5570 con 0x7f5ab80f9690 2023-10-18T22:19:15.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.648+0000 7f5abd3d1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80f56b0 con 0x7f5ab8060310 2023-10-18T22:19:15.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.649+0000 7f5ab77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab80f9690 0x7f5ab80f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:15.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.649+0000 7f5ab7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ab8060310 0x7f5ab80f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:15.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.649+0000 7f5ab77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab80f9690 0x7f5ab80f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54860/0 (socket says 172.21.15.8:54860) 2023-10-18T22:19:15.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.649+0000 7f5ab77fe700 1 -- 172.21.15.8:0/4051100546 learned_addr learned my addr 172.21.15.8:0/4051100546 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:15.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.649+0000 7f5ab77fe700 1 -- 172.21.15.8:0/4051100546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ab8060310 msgr2=0x7f5ab80f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:15.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.649+0000 7f5ab77fe700 1 --2- 172.21.15.8:0/4051100546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ab8060310 0x7f5ab80f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.649+0000 7f5ab77fe700 1 -- 172.21.15.8:0/4051100546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac005040 con 0x7f5ab80f9690 2023-10-18T22:19:15.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.649+0000 7f5ab77fe700 1 --2- 172.21.15.8:0/4051100546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab80f9690 0x7f5ab80f5010 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f5aac004e30 tx=0x7f5aac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:15.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.650+0000 7f5ab4ff9700 1 -- 172.21.15.8:0/4051100546 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aac018070 con 0x7f5ab80f9690 2023-10-18T22:19:15.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.650+0000 7f5ab4ff9700 1 -- 172.21.15.8:0/4051100546 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5aac009630 con 0x7f5ab80f9690 2023-10-18T22:19:15.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.650+0000 7f5ab4ff9700 1 -- 172.21.15.8:0/4051100546 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aac01c3c0 con 0x7f5ab80f9690 2023-10-18T22:19:15.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.650+0000 7f5abd3d1700 1 -- 172.21.15.8:0/4051100546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab80f5930 con 0x7f5ab80f9690 2023-10-18T22:19:15.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.650+0000 7f5abd3d1700 1 -- 172.21.15.8:0/4051100546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab80f5e90 con 0x7f5ab80f9690 2023-10-18T22:19:15.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.651+0000 7f5abd3d1700 1 -- 172.21.15.8:0/4051100546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab8045ad0 con 0x7f5ab80f9690 2023-10-18T22:19:15.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.652+0000 7f5ab4ff9700 1 -- 172.21.15.8:0/4051100546 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5aac01d420 con 0x7f5ab80f9690 2023-10-18T22:19:15.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.653+0000 7f5ab4ff9700 1 --2- 172.21.15.8:0/4051100546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5aa0060f70 0x7f5aa0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:15.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.653+0000 7f5ab4ff9700 1 -- 172.21.15.8:0/4051100546 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5aac07e490 con 0x7f5ab80f9690 2023-10-18T22:19:15.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.653+0000 7f5ab7fff700 1 --2- 172.21.15.8:0/4051100546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5aa0060f70 0x7f5aa0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:15.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.653+0000 7f5ab7fff700 1 --2- 172.21.15.8:0/4051100546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5aa0060f70 0x7f5aa0063430 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f5ab80f6920 tx=0x7f5aa800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:15.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.657+0000 7f5ab4ff9700 1 -- 172.21.15.8:0/4051100546 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5aac04e0c0 con 0x7f5ab80f9690 2023-10-18T22:19:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:13.620772+0000 mgr.smithi008.flmjzp (mgr.14640) 4818 : cluster [DBG] pgmap v3306: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:14.023341+0000 mgr.smithi008.flmjzp (mgr.14640) 4819 : audit [DBG] from='client.37864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:14.372589+0000 mgr.smithi008.flmjzp (mgr.14640) 4820 : audit [DBG] from='client.37868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:15.128748+0000 mon.smithi008 (mon.0) 5095 : audit [DBG] from='client.? 172.21.15.8:0/44161904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:13.620772+0000 mgr.smithi008.flmjzp (mgr.14640) 4818 : cluster [DBG] pgmap v3306: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:14.023341+0000 mgr.smithi008.flmjzp (mgr.14640) 4819 : audit [DBG] from='client.37864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:14.372589+0000 mgr.smithi008.flmjzp (mgr.14640) 4820 : audit [DBG] from='client.37868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:15.128748+0000 mon.smithi008 (mon.0) 5095 : audit [DBG] from='client.? 172.21.15.8:0/44161904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:15.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.855+0000 7f5abd3d1700 1 -- 172.21.15.8:0/4051100546 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ab80fee00 con 0x7f5aa0060f70 2023-10-18T22:19:15.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.857+0000 7f5ab4ff9700 1 -- 172.21.15.8:0/4051100546 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5ab80fee00 con 0x7f5aa0060f70 2023-10-18T22:19:15.858 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:19:15.858 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:19:15.858 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:19:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:19:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:19:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:19:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:19:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:19:15.859 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:19:15.860 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:19:15.860 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:19:15.860 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:19:15.860 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:19:15.860 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:19:15.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 -- 172.21.15.8:0/4051100546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5aa0060f70 msgr2=0x7f5aa0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:15.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 --2- 172.21.15.8:0/4051100546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5aa0060f70 0x7f5aa0063430 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f5ab80f6920 tx=0x7f5aa800b040).stop 2023-10-18T22:19:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 -- 172.21.15.8:0/4051100546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab80f9690 msgr2=0x7f5ab80f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 --2- 172.21.15.8:0/4051100546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab80f9690 0x7f5ab80f5010 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f5aac004e30 tx=0x7f5aac009b30).stop 2023-10-18T22:19:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 -- 172.21.15.8:0/4051100546 shutdown_connections 2023-10-18T22:19:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 --2- 172.21.15.8:0/4051100546 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5aa0060f70 0x7f5aa0063430 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 --2- 172.21.15.8:0/4051100546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ab8060310 0x7f5ab80f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 --2- 172.21.15.8:0/4051100546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab80f9690 0x7f5ab80f5010 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 -- 172.21.15.8:0/4051100546 >> 172.21.15.8:0/4051100546 conn(0x7f5ab80f0b90 msgr2=0x7f5ab80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 -- 172.21.15.8:0/4051100546 shutdown_connections 2023-10-18T22:19:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:15.859+0000 7f5abd3d1700 1 -- 172.21.15.8:0/4051100546 wait complete. 2023-10-18T22:19:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:14.716819+0000 mgr.smithi008.flmjzp (mgr.14640) 4821 : audit [DBG] from='client.37872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:15.506404+0000 mon.smithi008 (mon.0) 5096 : audit [DBG] from='client.? 172.21.15.8:0/425425621' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:19:16.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:14.716819+0000 mgr.smithi008.flmjzp (mgr.14640) 4821 : audit [DBG] from='client.37872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:15.506404+0000 mon.smithi008 (mon.0) 5096 : audit [DBG] from='client.? 172.21.15.8:0/425425621' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:19:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:15.621250+0000 mgr.smithi008.flmjzp (mgr.14640) 4822 : cluster [DBG] pgmap v3307: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:15.857058+0000 mgr.smithi008.flmjzp (mgr.14640) 4823 : audit [DBG] from='client.37884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:15.621250+0000 mgr.smithi008.flmjzp (mgr.14640) 4822 : cluster [DBG] pgmap v3307: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:15.857058+0000 mgr.smithi008.flmjzp (mgr.14640) 4823 : audit [DBG] from='client.37884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:17.621755+0000 mgr.smithi008.flmjzp (mgr.14640) 4824 : cluster [DBG] pgmap v3308: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:17.621755+0000 mgr.smithi008.flmjzp (mgr.14640) 4824 : cluster [DBG] pgmap v3308: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:19.622402+0000 mgr.smithi008.flmjzp (mgr.14640) 4825 : cluster [DBG] pgmap v3309: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:19.622402+0000 mgr.smithi008.flmjzp (mgr.14640) 4825 : cluster [DBG] pgmap v3309: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:21.641226+0000 mon.smithi008 (mon.0) 5097 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:21.644265+0000 mon.smithi008 (mon.0) 5098 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:21.645281+0000 mon.smithi008 (mon.0) 5099 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:21.651400+0000 mon.smithi008 (mon.0) 5100 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:21.657923+0000 mon.smithi008 (mon.0) 5101 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:21.661038+0000 mon.smithi008 (mon.0) 5102 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:21.662660+0000 mon.smithi008 (mon.0) 5103 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:21.664262+0000 mon.smithi008 (mon.0) 5104 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:21.666171+0000 mon.smithi008 (mon.0) 5105 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:21.641226+0000 mon.smithi008 (mon.0) 5097 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:21.644265+0000 mon.smithi008 (mon.0) 5098 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:21.645281+0000 mon.smithi008 (mon.0) 5099 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:21.651400+0000 mon.smithi008 (mon.0) 5100 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:21.657923+0000 mon.smithi008 (mon.0) 5101 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:21.661038+0000 mon.smithi008 (mon.0) 5102 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:21.662660+0000 mon.smithi008 (mon.0) 5103 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:21.664262+0000 mon.smithi008 (mon.0) 5104 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:21.666171+0000 mon.smithi008 (mon.0) 5105 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:21.622878+0000 mgr.smithi008.flmjzp (mgr.14640) 4826 : cluster [DBG] pgmap v3310: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:21.646149+0000 mgr.smithi008.flmjzp (mgr.14640) 4827 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:21.646720+0000 mgr.smithi008.flmjzp (mgr.14640) 4828 : cluster [DBG] pgmap v3311: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:21.646962+0000 mgr.smithi008.flmjzp (mgr.14640) 4829 : cluster [DBG] pgmap v3312: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:21.668186+0000 mgr.smithi008.flmjzp (mgr.14640) 4830 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:21.622878+0000 mgr.smithi008.flmjzp (mgr.14640) 4826 : cluster [DBG] pgmap v3310: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:21.646149+0000 mgr.smithi008.flmjzp (mgr.14640) 4827 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:21.646720+0000 mgr.smithi008.flmjzp (mgr.14640) 4828 : cluster [DBG] pgmap v3311: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:21.646962+0000 mgr.smithi008.flmjzp (mgr.14640) 4829 : cluster [DBG] pgmap v3312: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:21.668186+0000 mgr.smithi008.flmjzp (mgr.14640) 4830 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:23.647740+0000 mgr.smithi008.flmjzp (mgr.14640) 4831 : cluster [DBG] pgmap v3313: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:25.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:23.647740+0000 mgr.smithi008.flmjzp (mgr.14640) 4831 : cluster [DBG] pgmap v3313: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:25.648378+0000 mgr.smithi008.flmjzp (mgr.14640) 4832 : cluster [DBG] pgmap v3314: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:25.648378+0000 mgr.smithi008.flmjzp (mgr.14640) 4832 : cluster [DBG] pgmap v3314: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:27.649163+0000 mgr.smithi008.flmjzp (mgr.14640) 4833 : cluster [DBG] pgmap v3315: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:27.649163+0000 mgr.smithi008.flmjzp (mgr.14640) 4833 : cluster [DBG] pgmap v3315: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:29.649826+0000 mgr.smithi008.flmjzp (mgr.14640) 4834 : cluster [DBG] pgmap v3316: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:29.649826+0000 mgr.smithi008.flmjzp (mgr.14640) 4834 : cluster [DBG] pgmap v3316: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:31.679009+0000 mon.smithi008 (mon.0) 5106 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:32.235839+0000 mon.smithi008 (mon.0) 5107 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:32.236927+0000 mon.smithi008 (mon.0) 5108 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:32.243439+0000 mon.smithi008 (mon.0) 5109 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:32.250152+0000 mon.smithi008 (mon.0) 5110 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:32.254533+0000 mon.smithi008 (mon.0) 5111 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:32.256236+0000 mon.smithi008 (mon.0) 5112 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:32.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:32.257810+0000 mon.smithi008 (mon.0) 5113 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:32.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:32.259821+0000 mon.smithi008 (mon.0) 5114 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:31.679009+0000 mon.smithi008 (mon.0) 5106 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:32.235839+0000 mon.smithi008 (mon.0) 5107 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:32.236927+0000 mon.smithi008 (mon.0) 5108 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:32.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:32.243439+0000 mon.smithi008 (mon.0) 5109 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:32.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:32.250152+0000 mon.smithi008 (mon.0) 5110 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:32.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:32.254533+0000 mon.smithi008 (mon.0) 5111 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:32.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:32.256236+0000 mon.smithi008 (mon.0) 5112 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:32.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:32.257810+0000 mon.smithi008 (mon.0) 5113 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:32.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:32.259821+0000 mon.smithi008 (mon.0) 5114 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:31.650312+0000 mgr.smithi008.flmjzp (mgr.14640) 4835 : cluster [DBG] pgmap v3317: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:32.237826+0000 mgr.smithi008.flmjzp (mgr.14640) 4836 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:32.238539+0000 mgr.smithi008.flmjzp (mgr.14640) 4837 : cluster [DBG] pgmap v3318: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:32.238780+0000 mgr.smithi008.flmjzp (mgr.14640) 4838 : cluster [DBG] pgmap v3319: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:32.261690+0000 mgr.smithi008.flmjzp (mgr.14640) 4839 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:31.650312+0000 mgr.smithi008.flmjzp (mgr.14640) 4835 : cluster [DBG] pgmap v3317: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:32.237826+0000 mgr.smithi008.flmjzp (mgr.14640) 4836 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:32.238539+0000 mgr.smithi008.flmjzp (mgr.14640) 4837 : cluster [DBG] pgmap v3318: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:32.238780+0000 mgr.smithi008.flmjzp (mgr.14640) 4838 : cluster [DBG] pgmap v3319: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:32.261690+0000 mgr.smithi008.flmjzp (mgr.14640) 4839 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:34.239358+0000 mgr.smithi008.flmjzp (mgr.14640) 4840 : cluster [DBG] pgmap v3320: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:34.239358+0000 mgr.smithi008.flmjzp (mgr.14640) 4840 : cluster [DBG] pgmap v3320: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:36.240132+0000 mgr.smithi008.flmjzp (mgr.14640) 4841 : cluster [DBG] pgmap v3321: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:36.240132+0000 mgr.smithi008.flmjzp (mgr.14640) 4841 : cluster [DBG] pgmap v3321: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:38.240669+0000 mgr.smithi008.flmjzp (mgr.14640) 4842 : cluster [DBG] pgmap v3322: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:38.240669+0000 mgr.smithi008.flmjzp (mgr.14640) 4842 : cluster [DBG] pgmap v3322: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:40.241561+0000 mgr.smithi008.flmjzp (mgr.14640) 4843 : cluster [DBG] pgmap v3323: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:40.241561+0000 mgr.smithi008.flmjzp (mgr.14640) 4843 : cluster [DBG] pgmap v3323: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:42.272507+0000 mon.smithi008 (mon.0) 5115 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:42.274662+0000 mon.smithi008 (mon.0) 5116 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:42.275744+0000 mon.smithi008 (mon.0) 5117 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:42.282335+0000 mon.smithi008 (mon.0) 5118 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:42.290319+0000 mon.smithi008 (mon.0) 5119 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:42.293898+0000 mon.smithi008 (mon.0) 5120 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:42.295830+0000 mon.smithi008 (mon.0) 5121 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:42.297677+0000 mon.smithi008 (mon.0) 5122 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:42.300300+0000 mon.smithi008 (mon.0) 5123 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:42.272507+0000 mon.smithi008 (mon.0) 5115 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:42.274662+0000 mon.smithi008 (mon.0) 5116 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:42.275744+0000 mon.smithi008 (mon.0) 5117 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:42.282335+0000 mon.smithi008 (mon.0) 5118 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:42.290319+0000 mon.smithi008 (mon.0) 5119 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:42.293898+0000 mon.smithi008 (mon.0) 5120 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:42.295830+0000 mon.smithi008 (mon.0) 5121 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:42.297677+0000 mon.smithi008 (mon.0) 5122 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:42.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:42.300300+0000 mon.smithi008 (mon.0) 5123 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:42.242285+0000 mgr.smithi008.flmjzp (mgr.14640) 4844 : cluster [DBG] pgmap v3324: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:42.276645+0000 mgr.smithi008.flmjzp (mgr.14640) 4845 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:42.277182+0000 mgr.smithi008.flmjzp (mgr.14640) 4846 : cluster [DBG] pgmap v3325: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:42.277570+0000 mgr.smithi008.flmjzp (mgr.14640) 4847 : cluster [DBG] pgmap v3326: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:43.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:42.302432+0000 mgr.smithi008.flmjzp (mgr.14640) 4848 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:42.242285+0000 mgr.smithi008.flmjzp (mgr.14640) 4844 : cluster [DBG] pgmap v3324: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:42.276645+0000 mgr.smithi008.flmjzp (mgr.14640) 4845 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:42.277182+0000 mgr.smithi008.flmjzp (mgr.14640) 4846 : cluster [DBG] pgmap v3325: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:42.277570+0000 mgr.smithi008.flmjzp (mgr.14640) 4847 : cluster [DBG] pgmap v3326: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:42.302432+0000 mgr.smithi008.flmjzp (mgr.14640) 4848 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:44.278192+0000 mgr.smithi008.flmjzp (mgr.14640) 4849 : cluster [DBG] pgmap v3327: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:44.278192+0000 mgr.smithi008.flmjzp (mgr.14640) 4849 : cluster [DBG] pgmap v3327: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:46.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.010+0000 7f284cab1700 1 -- 172.21.15.8:0/3636989032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28480f77d0 msgr2=0x7f28480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.010+0000 7f284cab1700 1 --2- 172.21.15.8:0/3636989032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28480f77d0 0x7f28480f7c30 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f283c004660 tx=0x7f283c009b30).stop 2023-10-18T22:19:46.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.010+0000 7f284cab1700 1 -- 172.21.15.8:0/3636989032 shutdown_connections 2023-10-18T22:19:46.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.010+0000 7f284cab1700 1 --2- 172.21.15.8:0/3636989032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28480f77d0 0x7f28480f7c30 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.010+0000 7f284cab1700 1 --2- 172.21.15.8:0/3636989032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28480f6530 0x7f28480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.010+0000 7f284cab1700 1 -- 172.21.15.8:0/3636989032 >> 172.21.15.8:0/3636989032 conn(0x7f28480f1c90 msgr2=0x7f28480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:46.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.010+0000 7f284cab1700 1 -- 172.21.15.8:0/3636989032 shutdown_connections 2023-10-18T22:19:46.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.010+0000 7f284cab1700 1 -- 172.21.15.8:0/3636989032 wait complete. 2023-10-18T22:19:46.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.011+0000 7f284cab1700 1 Processor -- start 2023-10-18T22:19:46.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.011+0000 7f284cab1700 1 -- start start 2023-10-18T22:19:46.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f284cab1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28480f6530 0x7f284806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:46.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f284cab1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28480f77d0 0x7f2848069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:46.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f284cab1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284806a380 con 0x7f28480f6530 2023-10-18T22:19:46.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f284cab1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284806a4c0 con 0x7f28480f77d0 2023-10-18T22:19:46.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f28477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28480f6530 0x7f284806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:46.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f28477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28480f6530 0x7f284806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48874/0 (socket says 172.21.15.8:48874) 2023-10-18T22:19:46.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f28477fe700 1 -- 172.21.15.8:0/2031370438 learned_addr learned my addr 172.21.15.8:0/2031370438 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:46.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f28477fe700 1 -- 172.21.15.8:0/2031370438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28480f77d0 msgr2=0x7f2848069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f2846ffd700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28480f77d0 0x7f2848069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:46.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f28477fe700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28480f77d0 0x7f2848069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f28477fe700 1 -- 172.21.15.8:0/2031370438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c005040 con 0x7f28480f6530 2023-10-18T22:19:46.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.012+0000 7f2846ffd700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28480f77d0 0x7f2848069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:19:46.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.013+0000 7f28477fe700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28480f6530 0x7f284806b9a0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7f2838002700 tx=0x7f2838009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:46.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.013+0000 7f282ffff700 1 -- 172.21.15.8:0/2031370438 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2838009320 con 0x7f28480f6530 2023-10-18T22:19:46.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.013+0000 7f282ffff700 1 -- 172.21.15.8:0/2031370438 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f283800f040 con 0x7f28480f6530 2023-10-18T22:19:46.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.013+0000 7f284cab1700 1 -- 172.21.15.8:0/2031370438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284806a7a0 con 0x7f28480f6530 2023-10-18T22:19:46.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.013+0000 7f282ffff700 1 -- 172.21.15.8:0/2031370438 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2838014970 con 0x7f28480f6530 2023-10-18T22:19:46.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.013+0000 7f284cab1700 1 -- 172.21.15.8:0/2031370438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284810ed00 con 0x7f28480f6530 2023-10-18T22:19:46.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.014+0000 7f284cab1700 1 -- 172.21.15.8:0/2031370438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2848045ad0 con 0x7f28480f6530 2023-10-18T22:19:46.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.015+0000 7f282ffff700 1 -- 172.21.15.8:0/2031370438 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2838009480 con 0x7f28480f6530 2023-10-18T22:19:46.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.016+0000 7f282ffff700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2830060f70 0x7f2830063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:46.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.016+0000 7f282ffff700 1 -- 172.21.15.8:0/2031370438 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f283807cc40 con 0x7f28480f6530 2023-10-18T22:19:46.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.016+0000 7f2846ffd700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2830060f70 0x7f2830063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:46.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.017+0000 7f2846ffd700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2830060f70 0x7f2830063430 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f283c009d60 tx=0x7f283c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:46.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.020+0000 7f282ffff700 1 -- 172.21.15.8:0/2031370438 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f283804c7f0 con 0x7f28480f6530 2023-10-18T22:19:46.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.220+0000 7f284cab1700 1 -- 172.21.15.8:0/2031370438 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f28480fee40 con 0x7f2830060f70 2023-10-18T22:19:46.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.221+0000 7f282ffff700 1 -- 172.21.15.8:0/2031370438 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f28480fee40 con 0x7f2830060f70 2023-10-18T22:19:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.223+0000 7f284cab1700 1 -- 172.21.15.8:0/2031370438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2830060f70 msgr2=0x7f2830063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.223+0000 7f284cab1700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2830060f70 0x7f2830063430 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f283c009d60 tx=0x7f283c009b30).stop 2023-10-18T22:19:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.223+0000 7f284cab1700 1 -- 172.21.15.8:0/2031370438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28480f6530 msgr2=0x7f284806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.223+0000 7f284cab1700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28480f6530 0x7f284806b9a0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7f2838002700 tx=0x7f2838009d80).stop 2023-10-18T22:19:46.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.223+0000 7f284cab1700 1 -- 172.21.15.8:0/2031370438 shutdown_connections 2023-10-18T22:19:46.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.223+0000 7f284cab1700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2830060f70 0x7f2830063430 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.223+0000 7f284cab1700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28480f6530 0x7f284806b9a0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.223+0000 7f284cab1700 1 --2- 172.21.15.8:0/2031370438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28480f77d0 0x7f2848069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.223+0000 7f284cab1700 1 -- 172.21.15.8:0/2031370438 >> 172.21.15.8:0/2031370438 conn(0x7f28480f1c90 msgr2=0x7f28480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:46.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.224+0000 7f284cab1700 1 -- 172.21.15.8:0/2031370438 shutdown_connections 2023-10-18T22:19:46.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.224+0000 7f284cab1700 1 -- 172.21.15.8:0/2031370438 wait complete. 2023-10-18T22:19:46.241 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:19:46.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.363+0000 7f882eda9700 1 -- 172.21.15.8:0/170069341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88280f77d0 msgr2=0x7f88280f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.363+0000 7f882eda9700 1 --2- 172.21.15.8:0/170069341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88280f77d0 0x7f88280f7c30 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f8818004660 tx=0x7f8818009b30).stop 2023-10-18T22:19:46.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.363+0000 7f882eda9700 1 -- 172.21.15.8:0/170069341 shutdown_connections 2023-10-18T22:19:46.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.363+0000 7f882eda9700 1 --2- 172.21.15.8:0/170069341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88280f77d0 0x7f88280f7c30 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.363+0000 7f882eda9700 1 --2- 172.21.15.8:0/170069341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88280f6530 0x7f88280f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.363+0000 7f882eda9700 1 -- 172.21.15.8:0/170069341 >> 172.21.15.8:0/170069341 conn(0x7f88280f1c90 msgr2=0x7f88280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:46.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.363+0000 7f882eda9700 1 -- 172.21.15.8:0/170069341 shutdown_connections 2023-10-18T22:19:46.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.363+0000 7f882eda9700 1 -- 172.21.15.8:0/170069341 wait complete. 2023-10-18T22:19:46.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.364+0000 7f882eda9700 1 Processor -- start 2023-10-18T22:19:46.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.364+0000 7f882eda9700 1 -- start start 2023-10-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.364+0000 7f882eda9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88280f6530 0x7f8828108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.364+0000 7f882eda9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88280f77d0 0x7f8828109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.364+0000 7f882eda9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8828109a20 con 0x7f88280f77d0 2023-10-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.364+0000 7f882eda9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8828109b60 con 0x7f88280f6530 2023-10-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.365+0000 7f882d5a6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88280f77d0 0x7f8828109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:46.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.365+0000 7f882d5a6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88280f77d0 0x7f8828109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48892/0 (socket says 172.21.15.8:48892) 2023-10-18T22:19:46.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.365+0000 7f882d5a6700 1 -- 172.21.15.8:0/1483033591 learned_addr learned my addr 172.21.15.8:0/1483033591 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:46.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.365+0000 7f882dda7700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88280f6530 0x7f8828108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:46.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.365+0000 7f882d5a6700 1 -- 172.21.15.8:0/1483033591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88280f6530 msgr2=0x7f8828108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.365+0000 7f882d5a6700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88280f6530 0x7f8828108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.365+0000 7f882d5a6700 1 -- 172.21.15.8:0/1483033591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8818005040 con 0x7f88280f77d0 2023-10-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.365+0000 7f882d5a6700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88280f77d0 0x7f8828109470 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7f8818009f50 tx=0x7f8818009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.366+0000 7f881e7fc700 1 -- 172.21.15.8:0/1483033591 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8818018070 con 0x7f88280f77d0 2023-10-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.366+0000 7f881e7fc700 1 -- 172.21.15.8:0/1483033591 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8818009630 con 0x7f88280f77d0 2023-10-18T22:19:46.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.366+0000 7f881e7fc700 1 -- 172.21.15.8:0/1483033591 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f881801c3c0 con 0x7f88280f77d0 2023-10-18T22:19:46.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.366+0000 7f882eda9700 1 -- 172.21.15.8:0/1483033591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882810a4a0 con 0x7f88280f77d0 2023-10-18T22:19:46.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.366+0000 7f882eda9700 1 -- 172.21.15.8:0/1483033591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882810aa00 con 0x7f88280f77d0 2023-10-18T22:19:46.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.367+0000 7f882eda9700 1 -- 172.21.15.8:0/1483033591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8828045ad0 con 0x7f88280f77d0 2023-10-18T22:19:46.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.368+0000 7f881e7fc700 1 -- 172.21.15.8:0/1483033591 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f881801d420 con 0x7f88280f77d0 2023-10-18T22:19:46.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.368+0000 7f881e7fc700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8814060f70 0x7f8814063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.369+0000 7f881e7fc700 1 -- 172.21.15.8:0/1483033591 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f881807e580 con 0x7f88280f77d0 2023-10-18T22:19:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.369+0000 7f882dda7700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8814060f70 0x7f8814063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:46.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.369+0000 7f882dda7700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8814060f70 0x7f8814063430 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f88280f7630 tx=0x7f882400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:46.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.373+0000 7f881e7fc700 1 -- 172.21.15.8:0/1483033591 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8818051be0 con 0x7f88280f77d0 2023-10-18T22:19:46.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.575+0000 7f882eda9700 1 -- 172.21.15.8:0/1483033591 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88280fee30 con 0x7f8814060f70 2023-10-18T22:19:46.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.576+0000 7f881e7fc700 1 -- 172.21.15.8:0/1483033591 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f88280fee30 con 0x7f8814060f70 2023-10-18T22:19:46.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 -- 172.21.15.8:0/1483033591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8814060f70 msgr2=0x7f8814063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8814060f70 0x7f8814063430 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f88280f7630 tx=0x7f882400b040).stop 2023-10-18T22:19:46.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 -- 172.21.15.8:0/1483033591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88280f77d0 msgr2=0x7f8828109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88280f77d0 0x7f8828109470 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7f8818009f50 tx=0x7f8818009b30).stop 2023-10-18T22:19:46.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 -- 172.21.15.8:0/1483033591 shutdown_connections 2023-10-18T22:19:46.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8814060f70 0x7f8814063430 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88280f6530 0x7f8828108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 --2- 172.21.15.8:0/1483033591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88280f77d0 0x7f8828109470 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 -- 172.21.15.8:0/1483033591 >> 172.21.15.8:0/1483033591 conn(0x7f88280f1c90 msgr2=0x7f882806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:46.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 -- 172.21.15.8:0/1483033591 shutdown_connections 2023-10-18T22:19:46.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.578+0000 7f882eda9700 1 -- 172.21.15.8:0/1483033591 wait complete. 2023-10-18T22:19:46.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.716+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1533594597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bac0f6530 msgr2=0x7f0bac0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.716+0000 7f0bb24c5700 1 --2- 172.21.15.8:0/1533594597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bac0f6530 0x7f0bac0f6950 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7f0ba8004660 tx=0x7f0ba8009b30).stop 2023-10-18T22:19:46.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.716+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1533594597 shutdown_connections 2023-10-18T22:19:46.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.716+0000 7f0bb24c5700 1 --2- 172.21.15.8:0/1533594597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bac0f77d0 0x7f0bac0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.716+0000 7f0bb24c5700 1 --2- 172.21.15.8:0/1533594597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bac0f6530 0x7f0bac0f6950 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.716+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1533594597 >> 172.21.15.8:0/1533594597 conn(0x7f0bac0f1c90 msgr2=0x7f0bac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:46.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.716+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1533594597 shutdown_connections 2023-10-18T22:19:46.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.716+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1533594597 wait complete. 2023-10-18T22:19:46.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.717+0000 7f0bb24c5700 1 Processor -- start 2023-10-18T22:19:46.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.717+0000 7f0bb24c5700 1 -- start start 2023-10-18T22:19:46.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.717+0000 7f0bb24c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bac0f6530 0x7f0bac108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:46.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.717+0000 7f0bb24c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bac0f77d0 0x7f0bac109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:46.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.717+0000 7f0bb24c5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac109a00 con 0x7f0bac0f77d0 2023-10-18T22:19:46.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.717+0000 7f0bb24c5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac109b40 con 0x7f0bac0f6530 2023-10-18T22:19:46.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.717+0000 7f0bb0cc2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bac0f77d0 0x7f0bac109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:46.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0bb0cc2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bac0f77d0 0x7f0bac109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48916/0 (socket says 172.21.15.8:48916) 2023-10-18T22:19:46.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0bb0cc2700 1 -- 172.21.15.8:0/1776273533 learned_addr learned my addr 172.21.15.8:0/1776273533 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:46.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0bb14c3700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bac0f6530 0x7f0bac108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:46.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0bb0cc2700 1 -- 172.21.15.8:0/1776273533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bac0f6530 msgr2=0x7f0bac108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0bb0cc2700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bac0f6530 0x7f0bac108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0bb0cc2700 1 -- 172.21.15.8:0/1776273533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba8005040 con 0x7f0bac0f77d0 2023-10-18T22:19:46.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0bb14c3700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bac0f6530 0x7f0bac108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:19:46.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0bb0cc2700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bac0f77d0 0x7f0bac109450 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7f0b9c002700 tx=0x7f0b9c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0ba1ffb700 1 -- 172.21.15.8:0/1776273533 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b9c009320 con 0x7f0bac0f77d0 2023-10-18T22:19:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0ba1ffb700 1 -- 172.21.15.8:0/1776273533 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0b9c00f040 con 0x7f0bac0f77d0 2023-10-18T22:19:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0ba1ffb700 1 -- 172.21.15.8:0/1776273533 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b9c0148a0 con 0x7f0bac0f77d0 2023-10-18T22:19:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.718+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1776273533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bac10a4e0 con 0x7f0bac0f77d0 2023-10-18T22:19:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.719+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1776273533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac10aaa0 con 0x7f0bac0f77d0 2023-10-18T22:19:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.720+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1776273533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac045ad0 con 0x7f0bac0f77d0 2023-10-18T22:19:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.720+0000 7f0ba1ffb700 1 -- 172.21.15.8:0/1776273533 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0b9c009480 con 0x7f0bac0f77d0 2023-10-18T22:19:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.721+0000 7f0ba1ffb700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b98060f70 0x7f0b98063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.721+0000 7f0ba1ffb700 1 -- 172.21.15.8:0/1776273533 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0b9c07cc00 con 0x7f0bac0f77d0 2023-10-18T22:19:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.721+0000 7f0bb14c3700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b98060f70 0x7f0b98063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.722+0000 7f0bb14c3700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b98060f70 0x7f0b98063430 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f0ba8005010 tx=0x7f0ba8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.725+0000 7f0ba1ffb700 1 -- 172.21.15.8:0/1776273533 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0b9c0501e0 con 0x7f0bac0f77d0 2023-10-18T22:19:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.919+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1776273533 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bac10ad70 con 0x7f0b98060f70 2023-10-18T22:19:46.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.929+0000 7f0ba1ffb700 1 -- 172.21.15.8:0/1776273533 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0bac10ad70 con 0x7f0b98060f70 2023-10-18T22:19:46.931 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:19:46.932 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (86m) 3m ago 87m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:19:46.932 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (80m) 3m ago 87m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:19:46.932 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (80m) 86s ago 87m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:19:46.932 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (86m) 3m ago 87m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:19:46.932 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 83m - - 2023-10-18T22:19:46.933 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 83m - - 2023-10-18T22:19:46.933 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 86s ago 83m - - 2023-10-18T22:19:46.933 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 86s ago 83m - - 2023-10-18T22:19:46.933 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (81m) 3m ago 89m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:19:46.933 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (80m) 86s ago 87m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:19:46.934 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (80m) 3m ago 89m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:19:46.934 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (80m) 86s ago 86m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:19:46.934 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (87m) 3m ago 87m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:19:46.934 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (86m) 86s ago 86m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:19:46.934 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (80m) 3m ago 86m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:19:46.935 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (78m) 3m ago 86m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:19:46.935 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (77m) 3m ago 85m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:19:46.935 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (77m) 86s ago 85m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:19:46.935 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (76m) 86s ago 85m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:19:46.935 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (75m) 86s ago 85m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:19:46.936 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (81m) 3m ago 87m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:19:46.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1776273533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b98060f70 msgr2=0x7f0b98063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b98060f70 0x7f0b98063430 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f0ba8005010 tx=0x7f0ba8009b30).stop 2023-10-18T22:19:46.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1776273533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bac0f77d0 msgr2=0x7f0bac109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:46.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bac0f77d0 0x7f0bac109450 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7f0b9c002700 tx=0x7f0b9c009e00).stop 2023-10-18T22:19:46.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1776273533 shutdown_connections 2023-10-18T22:19:46.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0b98060f70 0x7f0b98063430 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bac0f6530 0x7f0bac108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 --2- 172.21.15.8:0/1776273533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bac0f77d0 0x7f0bac109450 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:46.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1776273533 >> 172.21.15.8:0/1776273533 conn(0x7f0bac0f1c90 msgr2=0x7f0bac06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:46.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1776273533 shutdown_connections 2023-10-18T22:19:46.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:46.931+0000 7f0bb24c5700 1 -- 172.21.15.8:0/1776273533 wait complete. 2023-10-18T22:19:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.070+0000 7f8459ca6700 1 -- 172.21.15.8:0/3503729949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f845406a3b0 msgr2=0x7f845406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.070+0000 7f8459ca6700 1 --2- 172.21.15.8:0/3503729949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f845406a3b0 0x7f845406a830 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f8440004660 tx=0x7f8440009b30).stop 2023-10-18T22:19:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.070+0000 7f8459ca6700 1 -- 172.21.15.8:0/3503729949 shutdown_connections 2023-10-18T22:19:47.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.070+0000 7f8459ca6700 1 --2- 172.21.15.8:0/3503729949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f845406a3b0 0x7f845406a830 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.070+0000 7f8459ca6700 1 --2- 172.21.15.8:0/3503729949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f845406b9c0 0x7f8454069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.070+0000 7f8459ca6700 1 -- 172.21.15.8:0/3503729949 >> 172.21.15.8:0/3503729949 conn(0x7f84540f1c90 msgr2=0x7f84540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:47.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.070+0000 7f8459ca6700 1 -- 172.21.15.8:0/3503729949 shutdown_connections 2023-10-18T22:19:47.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.071+0000 7f8459ca6700 1 -- 172.21.15.8:0/3503729949 wait complete. 2023-10-18T22:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.071+0000 7f8459ca6700 1 Processor -- start 2023-10-18T22:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.071+0000 7f8459ca6700 1 -- start start 2023-10-18T22:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.072+0000 7f8459ca6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f845406a3b0 0x7f8454108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.072+0000 7f8459ca6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f845406b9c0 0x7f8454109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.072+0000 7f8459ca6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8454109a10 con 0x7f845406b9c0 2023-10-18T22:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.072+0000 7f8459ca6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8454109b50 con 0x7f845406a3b0 2023-10-18T22:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.072+0000 7f8453fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f845406b9c0 0x7f8454109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.072+0000 7f8453fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f845406b9c0 0x7f8454109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48226/0 (socket says 172.21.15.8:48226) 2023-10-18T22:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.072+0000 7f8453fff700 1 -- 172.21.15.8:0/4243666172 learned_addr learned my addr 172.21.15.8:0/4243666172 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.072+0000 7f8458ca4700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f845406a3b0 0x7f8454108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.072+0000 7f8453fff700 1 -- 172.21.15.8:0/4243666172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f845406a3b0 msgr2=0x7f8454108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.073+0000 7f8453fff700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f845406a3b0 0x7f8454108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.073+0000 7f8453fff700 1 -- 172.21.15.8:0/4243666172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8440005040 con 0x7f845406b9c0 2023-10-18T22:19:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.073+0000 7f8458ca4700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f845406a3b0 0x7f8454108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:19:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.073+0000 7f8453fff700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f845406b9c0 0x7f8454109460 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f8440009f50 tx=0x7f8440009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.073+0000 7f84517fa700 1 -- 172.21.15.8:0/4243666172 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8440018070 con 0x7f845406b9c0 2023-10-18T22:19:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.073+0000 7f84517fa700 1 -- 172.21.15.8:0/4243666172 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8440009630 con 0x7f845406b9c0 2023-10-18T22:19:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.073+0000 7f8459ca6700 1 -- 172.21.15.8:0/4243666172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845410a490 con 0x7f845406b9c0 2023-10-18T22:19:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.073+0000 7f84517fa700 1 -- 172.21.15.8:0/4243666172 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844001c3c0 con 0x7f845406b9c0 2023-10-18T22:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.073+0000 7f8459ca6700 1 -- 172.21.15.8:0/4243666172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845410a9f0 con 0x7f845406b9c0 2023-10-18T22:19:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.074+0000 7f8459ca6700 1 -- 172.21.15.8:0/4243666172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8454045ad0 con 0x7f845406b9c0 2023-10-18T22:19:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.075+0000 7f84517fa700 1 -- 172.21.15.8:0/4243666172 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f844001d420 con 0x7f845406b9c0 2023-10-18T22:19:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.076+0000 7f84517fa700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8444060f70 0x7f8444063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.076+0000 7f84517fa700 1 -- 172.21.15.8:0/4243666172 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f844007e600 con 0x7f845406b9c0 2023-10-18T22:19:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.076+0000 7f8458ca4700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8444060f70 0x7f8444063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:47.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.077+0000 7f8458ca4700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8444060f70 0x7f8444063430 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f8448009740 tx=0x7f8448009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:47.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.080+0000 7f84517fa700 1 -- 172.21.15.8:0/4243666172 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8440051d40 con 0x7f845406b9c0 2023-10-18T22:19:47.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.337+0000 7f8459ca6700 1 -- 172.21.15.8:0/4243666172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8454100f50 con 0x7f845406b9c0 2023-10-18T22:19:47.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.338+0000 7f84517fa700 1 -- 172.21.15.8:0/4243666172 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f8440051930 con 0x7f845406b9c0 2023-10-18T22:19:47.340 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:19:47.341 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:19:47.341 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:19:47.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:19:47.341 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:19:47.342 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:19:47.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:19:47.342 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:19:47.342 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:19:47.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:19:47.342 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:19:47.343 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:19:47.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:19:47.343 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:19:47.343 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:19:47.343 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:19:47.344 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:19:47.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 -- 172.21.15.8:0/4243666172 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8444060f70 msgr2=0x7f8444063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:47.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8444060f70 0x7f8444063430 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f8448009740 tx=0x7f8448009be0).stop 2023-10-18T22:19:47.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 -- 172.21.15.8:0/4243666172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f845406b9c0 msgr2=0x7f8454109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:47.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f845406b9c0 0x7f8454109460 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f8440009f50 tx=0x7f8440009b30).stop 2023-10-18T22:19:47.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 -- 172.21.15.8:0/4243666172 shutdown_connections 2023-10-18T22:19:47.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8444060f70 0x7f8444063430 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f845406a3b0 0x7f8454108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 --2- 172.21.15.8:0/4243666172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f845406b9c0 0x7f8454109460 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 -- 172.21.15.8:0/4243666172 >> 172.21.15.8:0/4243666172 conn(0x7f84540f1c90 msgr2=0x7f84540fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:47.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 -- 172.21.15.8:0/4243666172 shutdown_connections 2023-10-18T22:19:47.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.340+0000 7f8459ca6700 1 -- 172.21.15.8:0/4243666172 wait complete. 2023-10-18T22:19:47.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.476+0000 7fd048d0c700 1 -- 172.21.15.8:0/3696870719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0440f77d0 msgr2=0x7fd0440f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.476+0000 7fd048d0c700 1 --2- 172.21.15.8:0/3696870719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0440f77d0 0x7fd0440f7c30 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7fd038004660 tx=0x7fd038009b30).stop 2023-10-18T22:19:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.476+0000 7fd048d0c700 1 -- 172.21.15.8:0/3696870719 shutdown_connections 2023-10-18T22:19:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.476+0000 7fd048d0c700 1 --2- 172.21.15.8:0/3696870719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0440f77d0 0x7fd0440f7c30 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.476+0000 7fd048d0c700 1 --2- 172.21.15.8:0/3696870719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0440f6530 0x7fd0440f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:19:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.476+0000 7fd048d0c700 1 -- 172.21.15.8:0/3696870719 >> 172.21.15.8:0/3696870719 conn(0x7fd0440f1c90 msgr2=0x7fd0440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.476+0000 7fd048d0c700 1 -- 172.21.15.8:0/3696870719 shutdown_connections 2023-10-18T22:19:47.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.476+0000 7fd048d0c700 1 -- 172.21.15.8:0/3696870719 wait complete. 2023-10-18T22:19:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.477+0000 7fd048d0c700 1 Processor -- start 2023-10-18T22:19:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.477+0000 7fd048d0c700 1 -- start start 2023-10-18T22:19:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd048d0c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0440f6530 0x7fd044106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:47.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd048d0c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0440f77d0 0x7fd044107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd048d0c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0441079a0 con 0x7fd0440f6530 2023-10-18T22:19:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd048d0c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd044108120 con 0x7fd0440f77d0 2023-10-18T22:19:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd0437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0440f6530 0x7fd044106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd0437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0440f6530 0x7fd044106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48258/0 (socket says 172.21.15.8:48258) 2023-10-18T22:19:47.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd0437fe700 1 -- 172.21.15.8:0/927112936 learned_addr learned my addr 172.21.15.8:0/927112936 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:47.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd042ffd700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0440f77d0 0x7fd044107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:47.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd0437fe700 1 -- 172.21.15.8:0/927112936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0440f77d0 msgr2=0x7fd044107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:47.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd0437fe700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0440f77d0 0x7fd044107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.478+0000 7fd0437fe700 1 -- 172.21.15.8:0/927112936 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038005040 con 0x7fd0440f6530 2023-10-18T22:19:47.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.479+0000 7fd0437fe700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0440f6530 0x7fd044106e20 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fd0340093f0 tx=0x7fd034006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:47.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.479+0000 7fd02bfff700 1 -- 172.21.15.8:0/927112936 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd034013640 con 0x7fd0440f6530 2023-10-18T22:19:47.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.479+0000 7fd02bfff700 1 -- 172.21.15.8:0/927112936 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd034013c60 con 0x7fd0440f6530 2023-10-18T22:19:47.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.479+0000 7fd048d0c700 1 -- 172.21.15.8:0/927112936 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0441083a0 con 0x7fd0440f6530 2023-10-18T22:19:47.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.479+0000 7fd02bfff700 1 -- 172.21.15.8:0/927112936 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd034012ce0 con 0x7fd0440f6530 2023-10-18T22:19:47.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.479+0000 7fd048d0c700 1 -- 172.21.15.8:0/927112936 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd044108960 con 0x7fd0440f6530 2023-10-18T22:19:47.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.480+0000 7fd048d0c700 1 -- 172.21.15.8:0/927112936 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd044045ad0 con 0x7fd0440f6530 2023-10-18T22:19:47.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.481+0000 7fd02bfff700 1 -- 172.21.15.8:0/927112936 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd03401a060 con 0x7fd0440f6530 2023-10-18T22:19:47.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.482+0000 7fd02bfff700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd02c060f70 0x7fd02c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:47.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.482+0000 7fd02bfff700 1 -- 172.21.15.8:0/927112936 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd03407c830 con 0x7fd0440f6530 2023-10-18T22:19:47.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.482+0000 7fd042ffd700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd02c060f70 0x7fd02c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:47.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.483+0000 7fd042ffd700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd02c060f70 0x7fd02c063430 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fd038009f50 tx=0x7fd038009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:47.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.486+0000 7fd02bfff700 1 -- 172.21.15.8:0/927112936 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd03404c670 con 0x7fd0440f6530 2023-10-18T22:19:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:46.222781+0000 mgr.smithi008.flmjzp (mgr.14640) 4850 : audit [DBG] from='client.37888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:47.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:46.278644+0000 mgr.smithi008.flmjzp (mgr.14640) 4851 : cluster [DBG] pgmap v3328: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.711+0000 7fd048d0c700 1 -- 172.21.15.8:0/927112936 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd044027a00 con 0x7fd0440f6530 2023-10-18T22:19:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.712+0000 7fd02bfff700 1 -- 172.21.15.8:0/927112936 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fd03404fc90 con 0x7fd0440f6530 2023-10-18T22:19:47.715 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:19:47.715 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:19:47.715 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:19:47.715 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:19:47.716 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:19:47.716 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:19:47.716 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:19:47.716 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:19:47.717 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:19:47.717 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:19:47.717 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:19:47.717 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:19:47.717 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:19:47.718 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:19:47.718 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:19:47.718 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:19:47.718 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:19:47.718 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:19:47.719 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:19:47.719 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:19:47.719 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:19:47.719 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:19:47.719 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:19:47.720 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:19:47.720 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:19:47.720 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:19:47.720 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:19:47.721 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:19:47.721 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:19:47.721 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:19:47.721 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:19:47.721 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:19:47.722 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:19:47.722 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:19:47.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 -- 172.21.15.8:0/927112936 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd02c060f70 msgr2=0x7fd02c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:47.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd02c060f70 0x7fd02c063430 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fd038009f50 tx=0x7fd038009b30).stop 2023-10-18T22:19:47.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 -- 172.21.15.8:0/927112936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0440f6530 msgr2=0x7fd044106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:47.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0440f6530 0x7fd044106e20 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fd0340093f0 tx=0x7fd034006ec0).stop 2023-10-18T22:19:47.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 -- 172.21.15.8:0/927112936 shutdown_connections 2023-10-18T22:19:47.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd02c060f70 0x7fd02c063430 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0440f6530 0x7fd044106e20 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 --2- 172.21.15.8:0/927112936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0440f77d0 0x7fd044107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 -- 172.21.15.8:0/927112936 >> 172.21.15.8:0/927112936 conn(0x7fd0440f1c90 msgr2=0x7fd0440fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:47.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 -- 172.21.15.8:0/927112936 shutdown_connections 2023-10-18T22:19:47.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.714+0000 7fd048d0c700 1 -- 172.21.15.8:0/927112936 wait complete. 2023-10-18T22:19:47.725 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:19:47.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:46.222781+0000 mgr.smithi008.flmjzp (mgr.14640) 4850 : audit [DBG] from='client.37888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:46.278644+0000 mgr.smithi008.flmjzp (mgr.14640) 4851 : cluster [DBG] pgmap v3328: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:47.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.851+0000 7f1c3f59e700 1 -- 172.21.15.8:0/747041463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c40060310 msgr2=0x7f1c400f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:47.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.851+0000 7f1c3f59e700 1 --2- 172.21.15.8:0/747041463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c40060310 0x7f1c400f9110 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7f1c30004660 tx=0x7f1c30009b30).stop 2023-10-18T22:19:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.851+0000 7f1c3f59e700 1 -- 172.21.15.8:0/747041463 shutdown_connections 2023-10-18T22:19:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.851+0000 7f1c3f59e700 1 --2- 172.21.15.8:0/747041463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400f9690 0x7f1c400fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.851+0000 7f1c3f59e700 1 --2- 172.21.15.8:0/747041463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c40060310 0x7f1c400f9110 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.851+0000 7f1c3f59e700 1 -- 172.21.15.8:0/747041463 >> 172.21.15.8:0/747041463 conn(0x7f1c400f0b90 msgr2=0x7f1c400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:47.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.851+0000 7f1c3f59e700 1 -- 172.21.15.8:0/747041463 shutdown_connections 2023-10-18T22:19:47.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.851+0000 7f1c3f59e700 1 -- 172.21.15.8:0/747041463 wait complete. 2023-10-18T22:19:47.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.852+0000 7f1c3f59e700 1 Processor -- start 2023-10-18T22:19:47.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.852+0000 7f1c3f59e700 1 -- start start 2023-10-18T22:19:47.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.852+0000 7f1c3f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c40060310 0x7f1c40108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:47.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.852+0000 7f1c3f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400f9690 0x7f1c401093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:47.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.852+0000 7f1c3f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40109980 con 0x7f1c40060310 2023-10-18T22:19:47.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.852+0000 7f1c3f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40109ac0 con 0x7f1c400f9690 2023-10-18T22:19:47.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.852+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c40060310 0x7f1c40108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:47.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.852+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c40060310 0x7f1c40108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48272/0 (socket says 172.21.15.8:48272) 2023-10-18T22:19:47.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.852+0000 7f1c3e59c700 1 -- 172.21.15.8:0/1117324594 learned_addr learned my addr 172.21.15.8:0/1117324594 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:19:47.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.852+0000 7f1c3dd9b700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400f9690 0x7f1c401093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.853+0000 7f1c3e59c700 1 -- 172.21.15.8:0/1117324594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400f9690 msgr2=0x7f1c401093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.853+0000 7f1c3e59c700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400f9690 0x7f1c401093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.853+0000 7f1c3e59c700 1 -- 172.21.15.8:0/1117324594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c30005040 con 0x7f1c40060310 2023-10-18T22:19:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.853+0000 7f1c3e59c700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c40060310 0x7f1c40108ee0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f1c30004d80 tx=0x7f1c3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:47.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.853+0000 7f1c2effd700 1 -- 172.21.15.8:0/1117324594 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c30019070 con 0x7f1c40060310 2023-10-18T22:19:47.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.853+0000 7f1c2effd700 1 -- 172.21.15.8:0/1117324594 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1c3001e420 con 0x7f1c40060310 2023-10-18T22:19:47.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.853+0000 7f1c3f59e700 1 -- 172.21.15.8:0/1117324594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4010a400 con 0x7f1c40060310 2023-10-18T22:19:47.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.853+0000 7f1c2effd700 1 -- 172.21.15.8:0/1117324594 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c30014660 con 0x7f1c40060310 2023-10-18T22:19:47.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.853+0000 7f1c3f59e700 1 -- 172.21.15.8:0/1117324594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4010a8e0 con 0x7f1c40060310 2023-10-18T22:19:47.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.855+0000 7f1c3f59e700 1 -- 172.21.15.8:0/1117324594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c40045ad0 con 0x7f1c40060310 2023-10-18T22:19:47.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.855+0000 7f1c2effd700 1 -- 172.21.15.8:0/1117324594 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1c3001e590 con 0x7f1c40060310 2023-10-18T22:19:47.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.856+0000 7f1c2effd700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 0x7f1c28063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:19:47.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.856+0000 7f1c2effd700 1 -- 172.21.15.8:0/1117324594 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1c3007dcb0 con 0x7f1c40060310 2023-10-18T22:19:47.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.857+0000 7f1c3dd9b700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 0x7f1c28063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:19:47.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.857+0000 7f1c3dd9b700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 0x7f1c28063430 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f1c34009fd0 tx=0x7f1c3400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:19:47.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:47.861+0000 7f1c2effd700 1 -- 172.21.15.8:0/1117324594 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1c300513d0 con 0x7f1c40060310 2023-10-18T22:19:48.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.057+0000 7f1c3f59e700 1 -- 172.21.15.8:0/1117324594 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c400fee20 con 0x7f1c28060f70 2023-10-18T22:19:48.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.059+0000 7f1c2effd700 1 -- 172.21.15.8:0/1117324594 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1c400fee20 con 0x7f1c28060f70 2023-10-18T22:19:48.061 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:19:48.061 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:19:48.061 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:19:48.062 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:19:48.062 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:19:48.062 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:19:48.062 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:19:48.062 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:19:48.063 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:19:48.063 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:19:48.063 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:19:48.063 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:19:48.063 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:19:48.064 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:19:48.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 -- 172.21.15.8:0/1117324594 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 msgr2=0x7f1c28063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 0x7f1c28063430 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f1c34009fd0 tx=0x7f1c3400b040).stop 2023-10-18T22:19:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 -- 172.21.15.8:0/1117324594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c40060310 msgr2=0x7f1c40108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:19:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c40060310 0x7f1c40108ee0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f1c30004d80 tx=0x7f1c3000b040).stop 2023-10-18T22:19:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 -- 172.21.15.8:0/1117324594 shutdown_connections 2023-10-18T22:19:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1c28060f70 0x7f1c28063430 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c40060310 0x7f1c40108ee0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 --2- 172.21.15.8:0/1117324594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400f9690 0x7f1c401093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:19:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 -- 172.21.15.8:0/1117324594 >> 172.21.15.8:0/1117324594 conn(0x7f1c400f0b90 msgr2=0x7f1c400f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:19:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 -- 172.21.15.8:0/1117324594 shutdown_connections 2023-10-18T22:19:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:19:48.061+0000 7f1c3f59e700 1 -- 172.21.15.8:0/1117324594 wait complete. 2023-10-18T22:19:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:46.577230+0000 mgr.smithi008.flmjzp (mgr.14640) 4852 : audit [DBG] from='client.37892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:46.921969+0000 mgr.smithi008.flmjzp (mgr.14640) 4853 : audit [DBG] from='client.37896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:47.339371+0000 mon.smithi008 (mon.0) 5124 : audit [DBG] from='client.? 172.21.15.8:0/4243666172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:47.713611+0000 mon.smithi008 (mon.0) 5125 : audit [DBG] from='client.? 172.21.15.8:0/927112936' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:19:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:46.577230+0000 mgr.smithi008.flmjzp (mgr.14640) 4852 : audit [DBG] from='client.37892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:46.921969+0000 mgr.smithi008.flmjzp (mgr.14640) 4853 : audit [DBG] from='client.37896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:47.339371+0000 mon.smithi008 (mon.0) 5124 : audit [DBG] from='client.? 172.21.15.8:0/4243666172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:47.713611+0000 mon.smithi008 (mon.0) 5125 : audit [DBG] from='client.? 172.21.15.8:0/927112936' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:19:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:48.060036+0000 mgr.smithi008.flmjzp (mgr.14640) 4854 : audit [DBG] from='client.37908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:49.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:48.279002+0000 mgr.smithi008.flmjzp (mgr.14640) 4855 : cluster [DBG] pgmap v3329: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:48.060036+0000 mgr.smithi008.flmjzp (mgr.14640) 4854 : audit [DBG] from='client.37908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:19:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:48.279002+0000 mgr.smithi008.flmjzp (mgr.14640) 4855 : cluster [DBG] pgmap v3329: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:50.279704+0000 mgr.smithi008.flmjzp (mgr.14640) 4856 : cluster [DBG] pgmap v3330: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:50.279704+0000 mgr.smithi008.flmjzp (mgr.14640) 4856 : cluster [DBG] pgmap v3330: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:52.280228+0000 mgr.smithi008.flmjzp (mgr.14640) 4857 : cluster [DBG] pgmap v3331: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:52.313192+0000 mon.smithi008 (mon.0) 5126 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:52.315737+0000 mon.smithi008 (mon.0) 5127 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:52.316694+0000 mon.smithi008 (mon.0) 5128 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:53.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:52.317581+0000 mgr.smithi008.flmjzp (mgr.14640) 4858 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:53.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:52.318174+0000 mgr.smithi008.flmjzp (mgr.14640) 4859 : cluster [DBG] pgmap v3332: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:53.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:52.318472+0000 mgr.smithi008.flmjzp (mgr.14640) 4860 : cluster [DBG] pgmap v3333: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:53.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:52.323079+0000 mon.smithi008 (mon.0) 5129 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:53.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:52.329665+0000 mon.smithi008 (mon.0) 5130 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:53.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:52.332816+0000 mon.smithi008 (mon.0) 5131 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:53.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:52.334471+0000 mon.smithi008 (mon.0) 5132 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:53.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:52.336141+0000 mon.smithi008 (mon.0) 5133 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:53.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:19:52.338167+0000 mon.smithi008 (mon.0) 5134 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:53.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:19:52.340080+0000 mgr.smithi008.flmjzp (mgr.14640) 4861 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:52.280228+0000 mgr.smithi008.flmjzp (mgr.14640) 4857 : cluster [DBG] pgmap v3331: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:52.313192+0000 mon.smithi008 (mon.0) 5126 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:52.315737+0000 mon.smithi008 (mon.0) 5127 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:19:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:52.316694+0000 mon.smithi008 (mon.0) 5128 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:19:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:52.317581+0000 mgr.smithi008.flmjzp (mgr.14640) 4858 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:19:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:52.318174+0000 mgr.smithi008.flmjzp (mgr.14640) 4859 : cluster [DBG] pgmap v3332: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:52.318472+0000 mgr.smithi008.flmjzp (mgr.14640) 4860 : cluster [DBG] pgmap v3333: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:53.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:52.323079+0000 mon.smithi008 (mon.0) 5129 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:19:53.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:52.329665+0000 mon.smithi008 (mon.0) 5130 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:19:53.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:52.332816+0000 mon.smithi008 (mon.0) 5131 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:53.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:52.334471+0000 mon.smithi008 (mon.0) 5132 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:53.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:52.336141+0000 mon.smithi008 (mon.0) 5133 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:53.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:19:52.338167+0000 mon.smithi008 (mon.0) 5134 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:19:53.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:19:52.340080+0000 mgr.smithi008.flmjzp (mgr.14640) 4861 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:19:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:54.319030+0000 mgr.smithi008.flmjzp (mgr.14640) 4862 : cluster [DBG] pgmap v3334: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:54.319030+0000 mgr.smithi008.flmjzp (mgr.14640) 4862 : cluster [DBG] pgmap v3334: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:56.319559+0000 mgr.smithi008.flmjzp (mgr.14640) 4863 : cluster [DBG] pgmap v3335: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:56.319559+0000 mgr.smithi008.flmjzp (mgr.14640) 4863 : cluster [DBG] pgmap v3335: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:19:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:19:58.320042+0000 mgr.smithi008.flmjzp (mgr.14640) 4864 : cluster [DBG] pgmap v3336: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:19:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:19:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:19:58.320042+0000 mgr.smithi008.flmjzp (mgr.14640) 4864 : cluster [DBG] pgmap v3336: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:00.000179+0000 mon.smithi008 (mon.0) 5135 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T22:20:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:00.000179+0000 mon.smithi008 (mon.0) 5135 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T22:20:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:00.320694+0000 mgr.smithi008.flmjzp (mgr.14640) 4865 : cluster [DBG] pgmap v3337: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:00.320694+0000 mgr.smithi008.flmjzp (mgr.14640) 4865 : cluster [DBG] pgmap v3337: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:02.350761+0000 mon.smithi008 (mon.0) 5136 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:02.352890+0000 mon.smithi008 (mon.0) 5137 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:02.353818+0000 mon.smithi008 (mon.0) 5138 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:02.360012+0000 mon.smithi008 (mon.0) 5139 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:02.366494+0000 mon.smithi008 (mon.0) 5140 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:02.369668+0000 mon.smithi008 (mon.0) 5141 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:02.371462+0000 mon.smithi008 (mon.0) 5142 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:02.373078+0000 mon.smithi008 (mon.0) 5143 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:02.375056+0000 mon.smithi008 (mon.0) 5144 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:02.350761+0000 mon.smithi008 (mon.0) 5136 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:02.352890+0000 mon.smithi008 (mon.0) 5137 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:02.353818+0000 mon.smithi008 (mon.0) 5138 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:02.360012+0000 mon.smithi008 (mon.0) 5139 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:02.366494+0000 mon.smithi008 (mon.0) 5140 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:02.369668+0000 mon.smithi008 (mon.0) 5141 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:02.371462+0000 mon.smithi008 (mon.0) 5142 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:02.373078+0000 mon.smithi008 (mon.0) 5143 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:02.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:02.375056+0000 mon.smithi008 (mon.0) 5144 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:02.321294+0000 mgr.smithi008.flmjzp (mgr.14640) 4866 : cluster [DBG] pgmap v3338: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:02.354673+0000 mgr.smithi008.flmjzp (mgr.14640) 4867 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:02.355202+0000 mgr.smithi008.flmjzp (mgr.14640) 4868 : cluster [DBG] pgmap v3339: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:02.355428+0000 mgr.smithi008.flmjzp (mgr.14640) 4869 : cluster [DBG] pgmap v3340: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:03.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:02.376951+0000 mgr.smithi008.flmjzp (mgr.14640) 4870 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:02.321294+0000 mgr.smithi008.flmjzp (mgr.14640) 4866 : cluster [DBG] pgmap v3338: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:02.354673+0000 mgr.smithi008.flmjzp (mgr.14640) 4867 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:02.355202+0000 mgr.smithi008.flmjzp (mgr.14640) 4868 : cluster [DBG] pgmap v3339: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:02.355428+0000 mgr.smithi008.flmjzp (mgr.14640) 4869 : cluster [DBG] pgmap v3340: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:03.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:02.376951+0000 mgr.smithi008.flmjzp (mgr.14640) 4870 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:04.356189+0000 mgr.smithi008.flmjzp (mgr.14640) 4871 : cluster [DBG] pgmap v3341: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:04.356189+0000 mgr.smithi008.flmjzp (mgr.14640) 4871 : cluster [DBG] pgmap v3341: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:06.356911+0000 mgr.smithi008.flmjzp (mgr.14640) 4872 : cluster [DBG] pgmap v3342: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:06.356911+0000 mgr.smithi008.flmjzp (mgr.14640) 4872 : cluster [DBG] pgmap v3342: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:08.357550+0000 mgr.smithi008.flmjzp (mgr.14640) 4873 : cluster [DBG] pgmap v3343: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:08.357550+0000 mgr.smithi008.flmjzp (mgr.14640) 4873 : cluster [DBG] pgmap v3343: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:10.358098+0000 mgr.smithi008.flmjzp (mgr.14640) 4874 : cluster [DBG] pgmap v3344: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:10.358098+0000 mgr.smithi008.flmjzp (mgr.14640) 4874 : cluster [DBG] pgmap v3344: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:12.380630+0000 mon.smithi008 (mon.0) 5145 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:12.380630+0000 mon.smithi008 (mon.0) 5145 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:12.358610+0000 mgr.smithi008.flmjzp (mgr.14640) 4875 : cluster [DBG] pgmap v3345: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:12.943638+0000 mon.smithi008 (mon.0) 5146 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:12.944549+0000 mon.smithi008 (mon.0) 5147 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:12.950096+0000 mon.smithi008 (mon.0) 5148 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:12.955016+0000 mon.smithi008 (mon.0) 5149 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:12.957406+0000 mon.smithi008 (mon.0) 5150 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:12.958663+0000 mon.smithi008 (mon.0) 5151 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:13.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:12.959849+0000 mon.smithi008 (mon.0) 5152 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:13.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:12.961467+0000 mon.smithi008 (mon.0) 5153 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:13.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:12.358610+0000 mgr.smithi008.flmjzp (mgr.14640) 4875 : cluster [DBG] pgmap v3345: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:13.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:12.943638+0000 mon.smithi008 (mon.0) 5146 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:13.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:12.944549+0000 mon.smithi008 (mon.0) 5147 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:13.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:12.950096+0000 mon.smithi008 (mon.0) 5148 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:13.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:12.955016+0000 mon.smithi008 (mon.0) 5149 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:13.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:12.957406+0000 mon.smithi008 (mon.0) 5150 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:13.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:12.958663+0000 mon.smithi008 (mon.0) 5151 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:13.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:12.959849+0000 mon.smithi008 (mon.0) 5152 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:13.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:12.961467+0000 mon.smithi008 (mon.0) 5153 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:12.945255+0000 mgr.smithi008.flmjzp (mgr.14640) 4876 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:12.945742+0000 mgr.smithi008.flmjzp (mgr.14640) 4877 : cluster [DBG] pgmap v3346: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:12.945947+0000 mgr.smithi008.flmjzp (mgr.14640) 4878 : cluster [DBG] pgmap v3347: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:12.963020+0000 mgr.smithi008.flmjzp (mgr.14640) 4879 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:12.945255+0000 mgr.smithi008.flmjzp (mgr.14640) 4876 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:12.945742+0000 mgr.smithi008.flmjzp (mgr.14640) 4877 : cluster [DBG] pgmap v3346: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:12.945947+0000 mgr.smithi008.flmjzp (mgr.14640) 4878 : cluster [DBG] pgmap v3347: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:12.963020+0000 mgr.smithi008.flmjzp (mgr.14640) 4879 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:14.946419+0000 mgr.smithi008.flmjzp (mgr.14640) 4880 : cluster [DBG] pgmap v3348: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:14.946419+0000 mgr.smithi008.flmjzp (mgr.14640) 4880 : cluster [DBG] pgmap v3348: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.215+0000 7f1d0359e700 1 -- 172.21.15.8:0/2215861507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d040f77d0 msgr2=0x7f1d040f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:18.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.215+0000 7f1d0359e700 1 --2- 172.21.15.8:0/2215861507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d040f77d0 0x7f1d040f7c30 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f1cf8004660 tx=0x7f1cf8009b30).stop 2023-10-18T22:20:18.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.215+0000 7f1d0359e700 1 -- 172.21.15.8:0/2215861507 shutdown_connections 2023-10-18T22:20:18.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.215+0000 7f1d0359e700 1 --2- 172.21.15.8:0/2215861507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d040f77d0 0x7f1d040f7c30 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.215+0000 7f1d0359e700 1 --2- 172.21.15.8:0/2215861507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d040f6530 0x7f1d040f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.215+0000 7f1d0359e700 1 -- 172.21.15.8:0/2215861507 >> 172.21.15.8:0/2215861507 conn(0x7f1d040f1c90 msgr2=0x7f1d040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.215+0000 7f1d0359e700 1 -- 172.21.15.8:0/2215861507 shutdown_connections 2023-10-18T22:20:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.215+0000 7f1d0359e700 1 -- 172.21.15.8:0/2215861507 wait complete. 2023-10-18T22:20:18.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.216+0000 7f1d0359e700 1 Processor -- start 2023-10-18T22:20:18.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.216+0000 7f1d0359e700 1 -- start start 2023-10-18T22:20:18.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.216+0000 7f1d0359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d040f6530 0x7f1d04108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:18.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.216+0000 7f1d0359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d040f77d0 0x7f1d041093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:18.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.216+0000 7f1d0359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d041099a0 con 0x7f1d040f6530 2023-10-18T22:20:18.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.216+0000 7f1d0359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04109ae0 con 0x7f1d040f77d0 2023-10-18T22:20:18.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.216+0000 7f1d0259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d040f6530 0x7f1d04108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:18.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.217+0000 7f1d0259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d040f6530 0x7f1d04108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51004/0 (socket says 172.21.15.8:51004) 2023-10-18T22:20:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.217+0000 7f1d0259c700 1 -- 172.21.15.8:0/1389571441 learned_addr learned my addr 172.21.15.8:0/1389571441 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.217+0000 7f1d01d9b700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d040f77d0 0x7f1d041093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.217+0000 7f1d0259c700 1 -- 172.21.15.8:0/1389571441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d040f77d0 msgr2=0x7f1d041093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.217+0000 7f1d0259c700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d040f77d0 0x7f1d041093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.217+0000 7f1d0259c700 1 -- 172.21.15.8:0/1389571441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8005040 con 0x7f1d040f6530 2023-10-18T22:20:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.217+0000 7f1d0259c700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d040f6530 0x7f1d04108f00 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f1cf400e7c0 tx=0x7f1cf400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.217+0000 7f1cf2ffd700 1 -- 172.21.15.8:0/1389571441 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cf40092e0 con 0x7f1d040f6530 2023-10-18T22:20:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.218+0000 7f1cf2ffd700 1 -- 172.21.15.8:0/1389571441 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1cf400f040 con 0x7f1d040f6530 2023-10-18T22:20:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.218+0000 7f1cf2ffd700 1 -- 172.21.15.8:0/1389571441 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cf4014810 con 0x7f1d040f6530 2023-10-18T22:20:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.218+0000 7f1d0359e700 1 -- 172.21.15.8:0/1389571441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0410a480 con 0x7f1d040f6530 2023-10-18T22:20:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.218+0000 7f1d0359e700 1 -- 172.21.15.8:0/1389571441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0410a9c0 con 0x7f1d040f6530 2023-10-18T22:20:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.219+0000 7f1d0359e700 1 -- 172.21.15.8:0/1389571441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d04045ad0 con 0x7f1d040f6530 2023-10-18T22:20:18.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.220+0000 7f1cf2ffd700 1 -- 172.21.15.8:0/1389571441 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1cf401b030 con 0x7f1d040f6530 2023-10-18T22:20:18.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.220+0000 7f1cf2ffd700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1cec060f70 0x7f1cec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:18.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.221+0000 7f1cf2ffd700 1 -- 172.21.15.8:0/1389571441 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1cf407c7c0 con 0x7f1d040f6530 2023-10-18T22:20:18.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.221+0000 7f1d01d9b700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1cec060f70 0x7f1cec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:18.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.221+0000 7f1d01d9b700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1cec060f70 0x7f1cec063430 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f1cf8005010 tx=0x7f1cf8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:18.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.225+0000 7f1cf2ffd700 1 -- 172.21.15.8:0/1389571441 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1cf404fe60 con 0x7f1d040f6530 2023-10-18T22:20:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.425+0000 7f1d0359e700 1 -- 172.21.15.8:0/1389571441 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d040fee00 con 0x7f1cec060f70 2023-10-18T22:20:18.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.427+0000 7f1cf2ffd700 1 -- 172.21.15.8:0/1389571441 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1d040fee00 con 0x7f1cec060f70 2023-10-18T22:20:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 -- 172.21.15.8:0/1389571441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1cec060f70 msgr2=0x7f1cec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1cec060f70 0x7f1cec063430 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f1cf8005010 tx=0x7f1cf8016040).stop 2023-10-18T22:20:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 -- 172.21.15.8:0/1389571441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d040f6530 msgr2=0x7f1d04108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d040f6530 0x7f1d04108f00 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f1cf400e7c0 tx=0x7f1cf400b040).stop 2023-10-18T22:20:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 -- 172.21.15.8:0/1389571441 shutdown_connections 2023-10-18T22:20:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1cec060f70 0x7f1cec063430 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d040f6530 0x7f1d04108f00 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 --2- 172.21.15.8:0/1389571441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d040f77d0 0x7f1d041093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 -- 172.21.15.8:0/1389571441 >> 172.21.15.8:0/1389571441 conn(0x7f1d040f1c90 msgr2=0x7f1d0406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:18.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 -- 172.21.15.8:0/1389571441 shutdown_connections 2023-10-18T22:20:18.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.429+0000 7f1d0359e700 1 -- 172.21.15.8:0/1389571441 wait complete. 2023-10-18T22:20:18.446 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:20:18.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.568+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1654282963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc406b960 msgr2=0x7f2cc4069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:18.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.568+0000 7f2ccb6aa700 1 --2- 172.21.15.8:0/1654282963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc406b960 0x7f2cc4069e60 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f2cc0004660 tx=0x7f2cc0009b30).stop 2023-10-18T22:20:18.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.568+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1654282963 shutdown_connections 2023-10-18T22:20:18.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.568+0000 7f2ccb6aa700 1 --2- 172.21.15.8:0/1654282963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc406a350 0x7f2cc406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.568+0000 7f2ccb6aa700 1 --2- 172.21.15.8:0/1654282963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc406b960 0x7f2cc4069e60 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.568+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1654282963 >> 172.21.15.8:0/1654282963 conn(0x7f2cc40f1e40 msgr2=0x7f2cc40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:18.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.568+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1654282963 shutdown_connections 2023-10-18T22:20:18.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.568+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1654282963 wait complete. 2023-10-18T22:20:18.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.569+0000 7f2ccb6aa700 1 Processor -- start 2023-10-18T22:20:18.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.569+0000 7f2ccb6aa700 1 -- start start 2023-10-18T22:20:18.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2ccb6aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc406a350 0x7f2cc4109120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:18.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2ccb6aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc406b960 0x7f2cc4109610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:18.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2ccb6aa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4109bc0 con 0x7f2cc406b960 2023-10-18T22:20:18.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2ccb6aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4109d00 con 0x7f2cc406a350 2023-10-18T22:20:18.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2cc8c45700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc406b960 0x7f2cc4109610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:18.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2cc8c45700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc406b960 0x7f2cc4109610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51024/0 (socket says 172.21.15.8:51024) 2023-10-18T22:20:18.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2cc8c45700 1 -- 172.21.15.8:0/1510359638 learned_addr learned my addr 172.21.15.8:0/1510359638 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2cc9446700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc406a350 0x7f2cc4109120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2cc8c45700 1 -- 172.21.15.8:0/1510359638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc406a350 msgr2=0x7f2cc4109120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2cc8c45700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc406a350 0x7f2cc4109120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.570+0000 7f2cc8c45700 1 -- 172.21.15.8:0/1510359638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0005040 con 0x7f2cc406b960 2023-10-18T22:20:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.571+0000 7f2cc8c45700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc406b960 0x7f2cc4109610 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f2cb400e7f0 tx=0x7f2cb400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.571+0000 7f2cb9ffb700 1 -- 172.21.15.8:0/1510359638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cb40092e0 con 0x7f2cc406b960 2023-10-18T22:20:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.571+0000 7f2cb9ffb700 1 -- 172.21.15.8:0/1510359638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2cb400f040 con 0x7f2cc406b960 2023-10-18T22:20:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.571+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1510359638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc410a6a0 con 0x7f2cc406b960 2023-10-18T22:20:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.571+0000 7f2cb9ffb700 1 -- 172.21.15.8:0/1510359638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cb40147e0 con 0x7f2cc406b960 2023-10-18T22:20:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.571+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1510359638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc410abe0 con 0x7f2cc406b960 2023-10-18T22:20:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.572+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1510359638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc4045ad0 con 0x7f2cc406b960 2023-10-18T22:20:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.573+0000 7f2cb9ffb700 1 -- 172.21.15.8:0/1510359638 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2cb401b030 con 0x7f2cc406b960 2023-10-18T22:20:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.574+0000 7f2cb9ffb700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb0060f20 0x7f2cb00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.574+0000 7f2cb9ffb700 1 -- 172.21.15.8:0/1510359638 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2cb407c680 con 0x7f2cc406b960 2023-10-18T22:20:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.574+0000 7f2cc9446700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb0060f20 0x7f2cb00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:18.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.574+0000 7f2cc9446700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb0060f20 0x7f2cb00633e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f2cc0005010 tx=0x7f2cc000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:18.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.578+0000 7f2cb9ffb700 1 -- 172.21.15.8:0/1510359638 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2cb404fd70 con 0x7f2cc406b960 2023-10-18T22:20:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:16.946954+0000 mgr.smithi008.flmjzp (mgr.14640) 4881 : cluster [DBG] pgmap v3349: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:16.946954+0000 mgr.smithi008.flmjzp (mgr.14640) 4881 : cluster [DBG] pgmap v3349: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:18.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.777+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1510359638 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cc410ae50 con 0x7f2cb0060f20 2023-10-18T22:20:18.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.778+0000 7f2cb9ffb700 1 -- 172.21.15.8:0/1510359638 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2cc410ae50 con 0x7f2cb0060f20 2023-10-18T22:20:18.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.780+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1510359638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb0060f20 msgr2=0x7f2cb00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:18.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.780+0000 7f2ccb6aa700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb0060f20 0x7f2cb00633e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f2cc0005010 tx=0x7f2cc000b040).stop 2023-10-18T22:20:18.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.780+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1510359638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc406b960 msgr2=0x7f2cc4109610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:18.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.780+0000 7f2ccb6aa700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc406b960 0x7f2cc4109610 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f2cb400e7f0 tx=0x7f2cb400b040).stop 2023-10-18T22:20:18.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.781+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1510359638 shutdown_connections 2023-10-18T22:20:18.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.781+0000 7f2ccb6aa700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2cb0060f20 0x7f2cb00633e0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.781+0000 7f2ccb6aa700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cc406a350 0x7f2cc4109120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.781+0000 7f2ccb6aa700 1 --2- 172.21.15.8:0/1510359638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cc406b960 0x7f2cc4109610 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.781+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1510359638 >> 172.21.15.8:0/1510359638 conn(0x7f2cc40f1e40 msgr2=0x7f2cc40fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:18.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.781+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1510359638 shutdown_connections 2023-10-18T22:20:18.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.781+0000 7f2ccb6aa700 1 -- 172.21.15.8:0/1510359638 wait complete. 2023-10-18T22:20:18.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.919+0000 7fe77bfff700 1 -- 172.21.15.8:0/1273041017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77c0f6530 msgr2=0x7fe77c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:18.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.919+0000 7fe77bfff700 1 --2- 172.21.15.8:0/1273041017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77c0f6530 0x7fe77c0f6950 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7fe76c004660 tx=0x7fe76c009b30).stop 2023-10-18T22:20:18.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.919+0000 7fe77bfff700 1 -- 172.21.15.8:0/1273041017 shutdown_connections 2023-10-18T22:20:18.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.919+0000 7fe77bfff700 1 --2- 172.21.15.8:0/1273041017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c0f77d0 0x7fe77c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.919+0000 7fe77bfff700 1 --2- 172.21.15.8:0/1273041017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77c0f6530 0x7fe77c0f6950 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.919+0000 7fe77bfff700 1 -- 172.21.15.8:0/1273041017 >> 172.21.15.8:0/1273041017 conn(0x7fe77c0f1c90 msgr2=0x7fe77c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:18.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.919+0000 7fe77bfff700 1 -- 172.21.15.8:0/1273041017 shutdown_connections 2023-10-18T22:20:18.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.920+0000 7fe77bfff700 1 -- 172.21.15.8:0/1273041017 wait complete. 2023-10-18T22:20:18.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.920+0000 7fe77bfff700 1 Processor -- start 2023-10-18T22:20:18.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.920+0000 7fe77bfff700 1 -- start start 2023-10-18T22:20:18.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77c0f6530 0x7fe77c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:18.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c0f77d0 0x7fe77c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:18.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c06a380 con 0x7fe77c0f6530 2023-10-18T22:20:18.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c06a4c0 con 0x7fe77c0f77d0 2023-10-18T22:20:18.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77c0f6530 0x7fe77c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:18.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77c0f6530 0x7fe77c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51046/0 (socket says 172.21.15.8:51046) 2023-10-18T22:20:18.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77affd700 1 -- 172.21.15.8:0/2450636713 learned_addr learned my addr 172.21.15.8:0/2450636713 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:18.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77a7fc700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c0f77d0 0x7fe77c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:18.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77affd700 1 -- 172.21.15.8:0/2450636713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c0f77d0 msgr2=0x7fe77c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:18.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77affd700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c0f77d0 0x7fe77c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:18.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.921+0000 7fe77affd700 1 -- 172.21.15.8:0/2450636713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c005040 con 0x7fe77c0f6530 2023-10-18T22:20:18.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.922+0000 7fe77affd700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77c0f6530 0x7fe77c06b9a0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7fe76c004e30 tx=0x7fe76c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:18.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.922+0000 7fe7637fe700 1 -- 172.21.15.8:0/2450636713 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76c018070 con 0x7fe77c0f6530 2023-10-18T22:20:18.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.922+0000 7fe7637fe700 1 -- 172.21.15.8:0/2450636713 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe76c009630 con 0x7fe77c0f6530 2023-10-18T22:20:18.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.922+0000 7fe77bfff700 1 -- 172.21.15.8:0/2450636713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c06a740 con 0x7fe77c0f6530 2023-10-18T22:20:18.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.922+0000 7fe7637fe700 1 -- 172.21.15.8:0/2450636713 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76c01c3c0 con 0x7fe77c0f6530 2023-10-18T22:20:18.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.922+0000 7fe77bfff700 1 -- 172.21.15.8:0/2450636713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c06aca0 con 0x7fe77c0f6530 2023-10-18T22:20:18.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.923+0000 7fe77bfff700 1 -- 172.21.15.8:0/2450636713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c045ad0 con 0x7fe77c0f6530 2023-10-18T22:20:18.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.924+0000 7fe7637fe700 1 -- 172.21.15.8:0/2450636713 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe76c01d420 con 0x7fe77c0f6530 2023-10-18T22:20:18.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.925+0000 7fe7637fe700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe764060f70 0x7fe764063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:18.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.925+0000 7fe7637fe700 1 -- 172.21.15.8:0/2450636713 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe76c07e530 con 0x7fe77c0f6530 2023-10-18T22:20:18.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.925+0000 7fe77a7fc700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe764060f70 0x7fe764063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:18.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.926+0000 7fe77a7fc700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe764060f70 0x7fe764063430 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7fe770004e20 tx=0x7fe77000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:18.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:18.929+0000 7fe7637fe700 1 -- 172.21.15.8:0/2450636713 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe76c04e0e0 con 0x7fe77c0f6530 2023-10-18T22:20:19.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.123+0000 7fe77bfff700 1 -- 172.21.15.8:0/2450636713 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe77c0fee40 con 0x7fe764060f70 2023-10-18T22:20:19.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.133+0000 7fe7637fe700 1 -- 172.21.15.8:0/2450636713 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe77c0fee40 con 0x7fe764060f70 2023-10-18T22:20:19.135 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:20:19.135 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (86m) 4m ago 88m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:20:19.135 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (80m) 4m ago 88m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:20:19.136 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (80m) 118s ago 87m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:20:19.136 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (86m) 4m ago 88m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:20:19.136 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 84m - - 2023-10-18T22:20:19.136 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 84m - - 2023-10-18T22:20:19.136 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 118s ago 84m - - 2023-10-18T22:20:19.137 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 118s ago 84m - - 2023-10-18T22:20:19.137 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (82m) 4m ago 89m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:20:19.137 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (81m) 118s ago 87m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:20:19.137 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (81m) 4m ago 89m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:20:19.137 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (81m) 118s ago 87m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:20:19.138 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (87m) 4m ago 87m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:20:19.138 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (87m) 118s ago 87m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:20:19.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (80m) 4m ago 87m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:20:19.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (78m) 4m ago 86m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:20:19.138 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (78m) 4m ago 86m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:20:19.139 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (77m) 118s ago 86m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:20:19.139 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (76m) 118s ago 85m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:20:19.139 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (76m) 118s ago 85m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:20:19.139 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (82m) 4m ago 87m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:20:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 -- 172.21.15.8:0/2450636713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe764060f70 msgr2=0x7fe764063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe764060f70 0x7fe764063430 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7fe770004e20 tx=0x7fe77000b040).stop 2023-10-18T22:20:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 -- 172.21.15.8:0/2450636713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77c0f6530 msgr2=0x7fe77c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77c0f6530 0x7fe77c06b9a0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7fe76c004e30 tx=0x7fe76c009b30).stop 2023-10-18T22:20:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 -- 172.21.15.8:0/2450636713 shutdown_connections 2023-10-18T22:20:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe764060f70 0x7fe764063430 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77c0f6530 0x7fe77c06b9a0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 --2- 172.21.15.8:0/2450636713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c0f77d0 0x7fe77c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 -- 172.21.15.8:0/2450636713 >> 172.21.15.8:0/2450636713 conn(0x7fe77c0f1c90 msgr2=0x7fe77c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:19.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 -- 172.21.15.8:0/2450636713 shutdown_connections 2023-10-18T22:20:19.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.135+0000 7fe77bfff700 1 -- 172.21.15.8:0/2450636713 wait complete. 2023-10-18T22:20:19.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.270+0000 7f8dee5f8700 1 -- 172.21.15.8:0/653415501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de806d630 msgr2=0x7f8de806dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:19.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.270+0000 7f8dee5f8700 1 --2- 172.21.15.8:0/653415501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de806d630 0x7f8de806dab0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f8dd8004660 tx=0x7f8dd8009b30).stop 2023-10-18T22:20:19.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.270+0000 7f8dee5f8700 1 -- 172.21.15.8:0/653415501 shutdown_connections 2023-10-18T22:20:19.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.270+0000 7f8dee5f8700 1 --2- 172.21.15.8:0/653415501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de806d630 0x7f8de806dab0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.270+0000 7f8dee5f8700 1 --2- 172.21.15.8:0/653415501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de806c340 0x7f8de806c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.270+0000 7f8dee5f8700 1 -- 172.21.15.8:0/653415501 >> 172.21.15.8:0/653415501 conn(0x7f8de80f40e0 msgr2=0x7f8de80f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:19.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.270+0000 7f8dee5f8700 1 -- 172.21.15.8:0/653415501 shutdown_connections 2023-10-18T22:20:19.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.270+0000 7f8dee5f8700 1 -- 172.21.15.8:0/653415501 wait complete. 2023-10-18T22:20:19.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.271+0000 7f8dee5f8700 1 Processor -- start 2023-10-18T22:20:19.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.271+0000 7f8dee5f8700 1 -- start start 2023-10-18T22:20:19.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.271+0000 7f8dee5f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de806c340 0x7f8de810d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:19.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.271+0000 7f8dee5f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de810d9d0 0x7f8de810e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:19.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.271+0000 7f8dee5f8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de810dea0 con 0x7f8de810d9d0 2023-10-18T22:20:19.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.271+0000 7f8dee5f8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de810dfe0 con 0x7f8de806c340 2023-10-18T22:20:19.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.272+0000 7f8decdf5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de810d9d0 0x7f8de810e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:19.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.272+0000 7f8decdf5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de810d9d0 0x7f8de810e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51062/0 (socket says 172.21.15.8:51062) 2023-10-18T22:20:19.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.272+0000 7f8decdf5700 1 -- 172.21.15.8:0/724700297 learned_addr learned my addr 172.21.15.8:0/724700297 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:19.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.272+0000 7f8ded5f6700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de806c340 0x7f8de810d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:19.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.272+0000 7f8decdf5700 1 -- 172.21.15.8:0/724700297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de806c340 msgr2=0x7f8de810d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:19.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.272+0000 7f8decdf5700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de806c340 0x7f8de810d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.272+0000 7f8decdf5700 1 -- 172.21.15.8:0/724700297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8005040 con 0x7f8de810d9d0 2023-10-18T22:20:19.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.272+0000 7f8ded5f6700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de806c340 0x7f8de810d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:20:19.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.272+0000 7f8decdf5700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de810d9d0 0x7f8de810e8c0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f8dd8009f50 tx=0x7f8dd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:19.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.272+0000 7f8dddffb700 1 -- 172.21.15.8:0/724700297 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dd8019070 con 0x7f8de810d9d0 2023-10-18T22:20:19.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.273+0000 7f8dddffb700 1 -- 172.21.15.8:0/724700297 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8dd8009630 con 0x7f8de810d9d0 2023-10-18T22:20:19.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.273+0000 7f8dddffb700 1 -- 172.21.15.8:0/724700297 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dd8014650 con 0x7f8de810d9d0 2023-10-18T22:20:19.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.273+0000 7f8dee5f8700 1 -- 172.21.15.8:0/724700297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de810ee10 con 0x7f8de810d9d0 2023-10-18T22:20:19.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.273+0000 7f8dee5f8700 1 -- 172.21.15.8:0/724700297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de810f2e0 con 0x7f8de810d9d0 2023-10-18T22:20:19.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.274+0000 7f8dee5f8700 1 -- 172.21.15.8:0/724700297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de8059100 con 0x7f8de810d9d0 2023-10-18T22:20:19.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.275+0000 7f8dddffb700 1 -- 172.21.15.8:0/724700297 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8dd8014000 con 0x7f8de810d9d0 2023-10-18T22:20:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.275+0000 7f8dddffb700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8dd4060f70 0x7f8dd4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.275+0000 7f8dddffb700 1 -- 172.21.15.8:0/724700297 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8dd807dd80 con 0x7f8de810d9d0 2023-10-18T22:20:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.276+0000 7f8ded5f6700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8dd4060f70 0x7f8dd4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.276+0000 7f8ded5f6700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8dd4060f70 0x7f8dd4063430 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f8de4009740 tx=0x7f8de4009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:19.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.280+0000 7f8dddffb700 1 -- 172.21.15.8:0/724700297 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8dd80514d0 con 0x7f8de810d9d0 2023-10-18T22:20:19.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.532+0000 7f8dee5f8700 1 -- 172.21.15.8:0/724700297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8de8027a30 con 0x7f8de810d9d0 2023-10-18T22:20:19.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.533+0000 7f8dddffb700 1 -- 172.21.15.8:0/724700297 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f8dd80510c0 con 0x7f8de810d9d0 2023-10-18T22:20:19.535 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:20:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:20:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:20:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:20:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:20:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:20:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:20:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:20:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:20:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:20:19.537 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:20:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:20:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:20:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:20:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:20:19.538 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:20:19.539 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:20:19.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 -- 172.21.15.8:0/724700297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8dd4060f70 msgr2=0x7f8dd4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:19.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8dd4060f70 0x7f8dd4063430 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f8de4009740 tx=0x7f8de4009be0).stop 2023-10-18T22:20:19.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 -- 172.21.15.8:0/724700297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de810d9d0 msgr2=0x7f8de810e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:19.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de810d9d0 0x7f8de810e8c0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f8dd8009f50 tx=0x7f8dd8009b30).stop 2023-10-18T22:20:19.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 -- 172.21.15.8:0/724700297 shutdown_connections 2023-10-18T22:20:19.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8dd4060f70 0x7f8dd4063430 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de806c340 0x7f8de810d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 --2- 172.21.15.8:0/724700297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8de810d9d0 0x7f8de810e8c0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 -- 172.21.15.8:0/724700297 >> 172.21.15.8:0/724700297 conn(0x7f8de80f40e0 msgr2=0x7f8de8103300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:19.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 -- 172.21.15.8:0/724700297 shutdown_connections 2023-10-18T22:20:19.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.535+0000 7f8dee5f8700 1 -- 172.21.15.8:0/724700297 wait complete. 2023-10-18T22:20:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.674+0000 7fbc4f59e700 1 -- 172.21.15.8:0/574453420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc500f6530 msgr2=0x7fbc500f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.674+0000 7fbc4f59e700 1 --2- 172.21.15.8:0/574453420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc500f6530 0x7fbc500f6950 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7fbc40004660 tx=0x7fbc40009b30).stop 2023-10-18T22:20:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.674+0000 7fbc4f59e700 1 -- 172.21.15.8:0/574453420 shutdown_connections 2023-10-18T22:20:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.674+0000 7fbc4f59e700 1 --2- 172.21.15.8:0/574453420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500f77d0 0x7fbc500f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.674+0000 7fbc4f59e700 1 --2- 172.21.15.8:0/574453420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc500f6530 0x7fbc500f6950 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.674+0000 7fbc4f59e700 1 -- 172.21.15.8:0/574453420 >> 172.21.15.8:0/574453420 conn(0x7fbc500f1c90 msgr2=0x7fbc500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:19.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.674+0000 7fbc4f59e700 1 -- 172.21.15.8:0/574453420 shutdown_connections 2023-10-18T22:20:19.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.674+0000 7fbc4f59e700 1 -- 172.21.15.8:0/574453420 wait complete. 2023-10-18T22:20:19.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.675+0000 7fbc4f59e700 1 Processor -- start 2023-10-18T22:20:19.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.675+0000 7fbc4f59e700 1 -- start start 2023-10-18T22:20:19.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.675+0000 7fbc4f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500f6530 0x7fbc50106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:19.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.675+0000 7fbc4f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc500f77d0 0x7fbc50107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:19.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.675+0000 7fbc4f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50107910 con 0x7fbc500f77d0 2023-10-18T22:20:19.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.676+0000 7fbc4f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50108120 con 0x7fbc500f6530 2023-10-18T22:20:19.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.676+0000 7fbc4dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc500f77d0 0x7fbc50107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:19.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.676+0000 7fbc4dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc500f77d0 0x7fbc50107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51086/0 (socket says 172.21.15.8:51086) 2023-10-18T22:20:19.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.676+0000 7fbc4dd9b700 1 -- 172.21.15.8:0/511794269 learned_addr learned my addr 172.21.15.8:0/511794269 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:19.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.676+0000 7fbc4e59c700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500f6530 0x7fbc50106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:19.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.676+0000 7fbc4dd9b700 1 -- 172.21.15.8:0/511794269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500f6530 msgr2=0x7fbc50106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:19.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.676+0000 7fbc4dd9b700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500f6530 0x7fbc50106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.676+0000 7fbc4dd9b700 1 -- 172.21.15.8:0/511794269 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40005040 con 0x7fbc500f77d0 2023-10-18T22:20:19.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.676+0000 7fbc4dd9b700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc500f77d0 0x7fbc50107310 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7fbc440026d0 tx=0x7fbc44009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:19.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.677+0000 7fbc3effd700 1 -- 172.21.15.8:0/511794269 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc44009320 con 0x7fbc500f77d0 2023-10-18T22:20:19.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.677+0000 7fbc3effd700 1 -- 172.21.15.8:0/511794269 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbc4400f040 con 0x7fbc500f77d0 2023-10-18T22:20:19.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.677+0000 7fbc4f59e700 1 -- 172.21.15.8:0/511794269 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc501083a0 con 0x7fbc500f77d0 2023-10-18T22:20:19.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.677+0000 7fbc3effd700 1 -- 172.21.15.8:0/511794269 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc440148a0 con 0x7fbc500f77d0 2023-10-18T22:20:19.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.677+0000 7fbc4f59e700 1 -- 172.21.15.8:0/511794269 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc50108960 con 0x7fbc500f77d0 2023-10-18T22:20:19.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.678+0000 7fbc4f59e700 1 -- 172.21.15.8:0/511794269 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc50059100 con 0x7fbc500f77d0 2023-10-18T22:20:19.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.679+0000 7fbc3effd700 1 -- 172.21.15.8:0/511794269 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbc44009480 con 0x7fbc500f77d0 2023-10-18T22:20:19.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.680+0000 7fbc3effd700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc38060f70 0x7fbc38063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:19.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.680+0000 7fbc3effd700 1 -- 172.21.15.8:0/511794269 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbc4407d090 con 0x7fbc500f77d0 2023-10-18T22:20:19.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.680+0000 7fbc4e59c700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc38060f70 0x7fbc38063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:19.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.681+0000 7fbc4e59c700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc38060f70 0x7fbc38063430 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fbc40005010 tx=0x7fbc40009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:19.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.684+0000 7fbc3effd700 1 -- 172.21.15.8:0/511794269 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbc4404cc40 con 0x7fbc500f77d0 2023-10-18T22:20:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:18.428184+0000 mgr.smithi008.flmjzp (mgr.14640) 4882 : audit [DBG] from='client.37912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:19.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.910+0000 7fbc4f59e700 1 -- 172.21.15.8:0/511794269 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbc500fee50 con 0x7fbc500f77d0 2023-10-18T22:20:19.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.911+0000 7fbc3effd700 1 -- 172.21.15.8:0/511794269 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fbc500fee50 con 0x7fbc500f77d0 2023-10-18T22:20:19.914 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:20:19.914 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:20:19.914 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:20:19.914 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:20:19.915 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:20:19.915 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:20:19.915 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:20:19.915 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:20:19.915 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:20:19.916 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:20:19.916 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:20:19.916 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:20:19.916 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:20:19.916 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:20:19.917 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:20:19.917 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:20:19.917 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:20:19.917 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:20:19.917 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:20:19.917 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:20:19.918 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:20:19.918 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:20:19.918 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:20:19.918 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:20:19.918 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:20:19.919 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:20:19.919 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:20:19.919 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:20:19.919 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:20:19.919 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:20:19.920 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:20:19.920 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:20:19.920 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:20:19.920 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:20:19.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 -- 172.21.15.8:0/511794269 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc38060f70 msgr2=0x7fbc38063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:19.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc38060f70 0x7fbc38063430 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fbc40005010 tx=0x7fbc40009b30).stop 2023-10-18T22:20:19.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 -- 172.21.15.8:0/511794269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc500f77d0 msgr2=0x7fbc50107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:19.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc500f77d0 0x7fbc50107310 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7fbc440026d0 tx=0x7fbc44009de0).stop 2023-10-18T22:20:19.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 -- 172.21.15.8:0/511794269 shutdown_connections 2023-10-18T22:20:19.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbc38060f70 0x7fbc38063430 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500f6530 0x7fbc50106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 --2- 172.21.15.8:0/511794269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc500f77d0 0x7fbc50107310 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:19.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 -- 172.21.15.8:0/511794269 >> 172.21.15.8:0/511794269 conn(0x7fbc500f1c90 msgr2=0x7fbc500fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:19.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 -- 172.21.15.8:0/511794269 shutdown_connections 2023-10-18T22:20:19.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:19.913+0000 7fbc4f59e700 1 -- 172.21.15.8:0/511794269 wait complete. 2023-10-18T22:20:19.923 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:20:19.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:18.428184+0000 mgr.smithi008.flmjzp (mgr.14640) 4882 : audit [DBG] from='client.37912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:20.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.051+0000 7fb263fff700 1 -- 172.21.15.8:0/1612943878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2640f6530 msgr2=0x7fb2640f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:20.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.051+0000 7fb263fff700 1 --2- 172.21.15.8:0/1612943878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2640f6530 0x7fb2640f6950 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7fb254004660 tx=0x7fb254009b30).stop 2023-10-18T22:20:20.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.051+0000 7fb263fff700 1 -- 172.21.15.8:0/1612943878 shutdown_connections 2023-10-18T22:20:20.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.051+0000 7fb263fff700 1 --2- 172.21.15.8:0/1612943878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640f77d0 0x7fb2640f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:20.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.051+0000 7fb263fff700 1 --2- 172.21.15.8:0/1612943878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2640f6530 0x7fb2640f6950 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:20.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.051+0000 7fb263fff700 1 -- 172.21.15.8:0/1612943878 >> 172.21.15.8:0/1612943878 conn(0x7fb2640f1c90 msgr2=0x7fb2640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:20.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.051+0000 7fb263fff700 1 -- 172.21.15.8:0/1612943878 shutdown_connections 2023-10-18T22:20:20.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.051+0000 7fb263fff700 1 -- 172.21.15.8:0/1612943878 wait complete. 2023-10-18T22:20:20.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.052+0000 7fb263fff700 1 Processor -- start 2023-10-18T22:20:20.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.052+0000 7fb263fff700 1 -- start start 2023-10-18T22:20:20.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.052+0000 7fb263fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2640f6530 0x7fb264108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:20.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.052+0000 7fb263fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640f77d0 0x7fb2641094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:20.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.052+0000 7fb263fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264109a50 con 0x7fb2640f6530 2023-10-18T22:20:20.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.052+0000 7fb263fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264109b90 con 0x7fb2640f77d0 2023-10-18T22:20:20.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.052+0000 7fb262ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2640f6530 0x7fb264108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:20.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.052+0000 7fb262ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2640f6530 0x7fb264108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51098/0 (socket says 172.21.15.8:51098) 2023-10-18T22:20:20.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.052+0000 7fb262ffd700 1 -- 172.21.15.8:0/1853473909 learned_addr learned my addr 172.21.15.8:0/1853473909 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:20.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb2627fc700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640f77d0 0x7fb2641094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:20.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb262ffd700 1 -- 172.21.15.8:0/1853473909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640f77d0 msgr2=0x7fb2641094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:20.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb262ffd700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640f77d0 0x7fb2641094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:20.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb262ffd700 1 -- 172.21.15.8:0/1853473909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb254005040 con 0x7fb2640f6530 2023-10-18T22:20:20.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb2627fc700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640f77d0 0x7fb2641094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:20:20.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb262ffd700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2640f6530 0x7fb264108fb0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7fb254007a60 tx=0x7fb254009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:20.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb24b7fe700 1 -- 172.21.15.8:0/1853473909 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb254018070 con 0x7fb2640f6530 2023-10-18T22:20:20.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb24b7fe700 1 -- 172.21.15.8:0/1853473909 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb254009630 con 0x7fb2640f6530 2023-10-18T22:20:20.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb24b7fe700 1 -- 172.21.15.8:0/1853473909 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb25401c540 con 0x7fb2640f6530 2023-10-18T22:20:20.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb263fff700 1 -- 172.21.15.8:0/1853473909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26410a4d0 con 0x7fb2640f6530 2023-10-18T22:20:20.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.053+0000 7fb263fff700 1 -- 172.21.15.8:0/1853473909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26410aa30 con 0x7fb2640f6530 2023-10-18T22:20:20.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.055+0000 7fb263fff700 1 -- 172.21.15.8:0/1853473909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb264045ad0 con 0x7fb2640f6530 2023-10-18T22:20:20.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.055+0000 7fb24b7fe700 1 -- 172.21.15.8:0/1853473909 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb25401d420 con 0x7fb2640f6530 2023-10-18T22:20:20.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.057+0000 7fb24b7fe700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb24c060f70 0x7fb24c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:20.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.057+0000 7fb24b7fe700 1 -- 172.21.15.8:0/1853473909 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb25407e680 con 0x7fb2640f6530 2023-10-18T22:20:20.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.057+0000 7fb2627fc700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb24c060f70 0x7fb24c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:20.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.057+0000 7fb2627fc700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb24c060f70 0x7fb24c063430 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fb258009fd0 tx=0x7fb25800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:20.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.061+0000 7fb24b7fe700 1 -- 172.21.15.8:0/1853473909 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb254051ce0 con 0x7fb2640f6530 2023-10-18T22:20:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.259+0000 7fb263fff700 1 -- 172.21.15.8:0/1853473909 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2640fee70 con 0x7fb24c060f70 2023-10-18T22:20:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.260+0000 7fb24b7fe700 1 -- 172.21.15.8:0/1853473909 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb25800f040 con 0x7fb24c060f70 2023-10-18T22:20:20.263 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:20:20.263 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:20:20.263 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:20:20.263 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:20:20.264 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:20:20.264 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:20:20.264 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:20:20.264 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:20:20.264 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:20:20.265 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:20:20.265 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:20:20.265 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:20:20.265 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:20:20.265 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:20:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.262+0000 7fb263fff700 1 -- 172.21.15.8:0/1853473909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb24c060f70 msgr2=0x7fb24c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.262+0000 7fb263fff700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb24c060f70 0x7fb24c063430 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fb258009fd0 tx=0x7fb25800b040).stop 2023-10-18T22:20:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.262+0000 7fb263fff700 1 -- 172.21.15.8:0/1853473909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2640f6530 msgr2=0x7fb264108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.262+0000 7fb263fff700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2640f6530 0x7fb264108fb0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7fb254007a60 tx=0x7fb254009b30).stop 2023-10-18T22:20:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.263+0000 7fb263fff700 1 -- 172.21.15.8:0/1853473909 shutdown_connections 2023-10-18T22:20:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.263+0000 7fb263fff700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb24c060f70 0x7fb24c063430 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.263+0000 7fb263fff700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2640f6530 0x7fb264108fb0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.263+0000 7fb263fff700 1 --2- 172.21.15.8:0/1853473909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640f77d0 0x7fb2641094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.263+0000 7fb263fff700 1 -- 172.21.15.8:0/1853473909 >> 172.21.15.8:0/1853473909 conn(0x7fb2640f1c90 msgr2=0x7fb26406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.263+0000 7fb263fff700 1 -- 172.21.15.8:0/1853473909 shutdown_connections 2023-10-18T22:20:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:20.263+0000 7fb263fff700 1 -- 172.21.15.8:0/1853473909 wait complete. 2023-10-18T22:20:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:18.779828+0000 mgr.smithi008.flmjzp (mgr.14640) 4883 : audit [DBG] from='client.37916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:18.947612+0000 mgr.smithi008.flmjzp (mgr.14640) 4884 : cluster [DBG] pgmap v3350: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:19.125570+0000 mgr.smithi008.flmjzp (mgr.14640) 4885 : audit [DBG] from='client.37920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:19.534460+0000 mon.smithi008 (mon.0) 5154 : audit [DBG] from='client.? 172.21.15.8:0/724700297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:19.912666+0000 mon.smithi008 (mon.0) 5155 : audit [DBG] from='client.? 172.21.15.8:0/511794269' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:20:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:18.779828+0000 mgr.smithi008.flmjzp (mgr.14640) 4883 : audit [DBG] from='client.37916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:18.947612+0000 mgr.smithi008.flmjzp (mgr.14640) 4884 : cluster [DBG] pgmap v3350: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:19.125570+0000 mgr.smithi008.flmjzp (mgr.14640) 4885 : audit [DBG] from='client.37920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:19.534460+0000 mon.smithi008 (mon.0) 5154 : audit [DBG] from='client.? 172.21.15.8:0/724700297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:20.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:19.912666+0000 mon.smithi008 (mon.0) 5155 : audit [DBG] from='client.? 172.21.15.8:0/511794269' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:20:21.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:20.261736+0000 mgr.smithi008.flmjzp (mgr.14640) 4886 : audit [DBG] from='client.37932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:20.261736+0000 mgr.smithi008.flmjzp (mgr.14640) 4886 : audit [DBG] from='client.37932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:20.948079+0000 mgr.smithi008.flmjzp (mgr.14640) 4887 : cluster [DBG] pgmap v3351: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:20.948079+0000 mgr.smithi008.flmjzp (mgr.14640) 4887 : cluster [DBG] pgmap v3351: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:22.973698+0000 mon.smithi008 (mon.0) 5156 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:22.975888+0000 mon.smithi008 (mon.0) 5157 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:22.976891+0000 mon.smithi008 (mon.0) 5158 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:22.983566+0000 mon.smithi008 (mon.0) 5159 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:22.990151+0000 mon.smithi008 (mon.0) 5160 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:22.993324+0000 mon.smithi008 (mon.0) 5161 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:22.995049+0000 mon.smithi008 (mon.0) 5162 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:23.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:22.996687+0000 mon.smithi008 (mon.0) 5163 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:23.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:22.998691+0000 mon.smithi008 (mon.0) 5164 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:23.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:22.973698+0000 mon.smithi008 (mon.0) 5156 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:23.846 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:22.975888+0000 mon.smithi008 (mon.0) 5157 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:23.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:22.976891+0000 mon.smithi008 (mon.0) 5158 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:23.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:22.983566+0000 mon.smithi008 (mon.0) 5159 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:23.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:22.990151+0000 mon.smithi008 (mon.0) 5160 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:23.847 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:22.993324+0000 mon.smithi008 (mon.0) 5161 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:23.848 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:22.995049+0000 mon.smithi008 (mon.0) 5162 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:23.848 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:22.996687+0000 mon.smithi008 (mon.0) 5163 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:23.848 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:22.998691+0000 mon.smithi008 (mon.0) 5164 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:22.948584+0000 mgr.smithi008.flmjzp (mgr.14640) 4888 : cluster [DBG] pgmap v3352: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:22.977723+0000 mgr.smithi008.flmjzp (mgr.14640) 4889 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:22.978235+0000 mgr.smithi008.flmjzp (mgr.14640) 4890 : cluster [DBG] pgmap v3353: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:22.978497+0000 mgr.smithi008.flmjzp (mgr.14640) 4891 : cluster [DBG] pgmap v3354: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:23.000595+0000 mgr.smithi008.flmjzp (mgr.14640) 4892 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:22.948584+0000 mgr.smithi008.flmjzp (mgr.14640) 4888 : cluster [DBG] pgmap v3352: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:22.977723+0000 mgr.smithi008.flmjzp (mgr.14640) 4889 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:22.978235+0000 mgr.smithi008.flmjzp (mgr.14640) 4890 : cluster [DBG] pgmap v3353: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:22.978497+0000 mgr.smithi008.flmjzp (mgr.14640) 4891 : cluster [DBG] pgmap v3354: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:23.000595+0000 mgr.smithi008.flmjzp (mgr.14640) 4892 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:24.979040+0000 mgr.smithi008.flmjzp (mgr.14640) 4893 : cluster [DBG] pgmap v3355: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:24.979040+0000 mgr.smithi008.flmjzp (mgr.14640) 4893 : cluster [DBG] pgmap v3355: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:26.979774+0000 mgr.smithi008.flmjzp (mgr.14640) 4894 : cluster [DBG] pgmap v3356: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:27.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:26.979774+0000 mgr.smithi008.flmjzp (mgr.14640) 4894 : cluster [DBG] pgmap v3356: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:30.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:28.980333+0000 mgr.smithi008.flmjzp (mgr.14640) 4895 : cluster [DBG] pgmap v3357: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:30.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:28.980333+0000 mgr.smithi008.flmjzp (mgr.14640) 4895 : cluster [DBG] pgmap v3357: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:30.981032+0000 mgr.smithi008.flmjzp (mgr.14640) 4896 : cluster [DBG] pgmap v3358: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:30.981032+0000 mgr.smithi008.flmjzp (mgr.14640) 4896 : cluster [DBG] pgmap v3358: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:33.010545+0000 mon.smithi008 (mon.0) 5165 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:33.010545+0000 mon.smithi008 (mon.0) 5165 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:32.981716+0000 mgr.smithi008.flmjzp (mgr.14640) 4897 : cluster [DBG] pgmap v3359: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:33.572044+0000 mon.smithi008 (mon.0) 5166 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:33.573233+0000 mon.smithi008 (mon.0) 5167 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:33.579957+0000 mon.smithi008 (mon.0) 5168 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:33.586677+0000 mon.smithi008 (mon.0) 5169 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:33.589707+0000 mon.smithi008 (mon.0) 5170 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:33.591343+0000 mon.smithi008 (mon.0) 5171 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:33.592970+0000 mon.smithi008 (mon.0) 5172 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:33.594931+0000 mon.smithi008 (mon.0) 5173 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:32.981716+0000 mgr.smithi008.flmjzp (mgr.14640) 4897 : cluster [DBG] pgmap v3359: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:33.572044+0000 mon.smithi008 (mon.0) 5166 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:33.573233+0000 mon.smithi008 (mon.0) 5167 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:33.579957+0000 mon.smithi008 (mon.0) 5168 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:34.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:33.586677+0000 mon.smithi008 (mon.0) 5169 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:34.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:33.589707+0000 mon.smithi008 (mon.0) 5170 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:34.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:33.591343+0000 mon.smithi008 (mon.0) 5171 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:34.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:33.592970+0000 mon.smithi008 (mon.0) 5172 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:34.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:33.594931+0000 mon.smithi008 (mon.0) 5173 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:33.574163+0000 mgr.smithi008.flmjzp (mgr.14640) 4898 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:33.574917+0000 mgr.smithi008.flmjzp (mgr.14640) 4899 : cluster [DBG] pgmap v3360: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:33.575229+0000 mgr.smithi008.flmjzp (mgr.14640) 4900 : cluster [DBG] pgmap v3361: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:33.596792+0000 mgr.smithi008.flmjzp (mgr.14640) 4901 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:33.574163+0000 mgr.smithi008.flmjzp (mgr.14640) 4898 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:33.574917+0000 mgr.smithi008.flmjzp (mgr.14640) 4899 : cluster [DBG] pgmap v3360: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:33.575229+0000 mgr.smithi008.flmjzp (mgr.14640) 4900 : cluster [DBG] pgmap v3361: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:33.596792+0000 mgr.smithi008.flmjzp (mgr.14640) 4901 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:37.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:35.575903+0000 mgr.smithi008.flmjzp (mgr.14640) 4902 : cluster [DBG] pgmap v3362: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:35.575903+0000 mgr.smithi008.flmjzp (mgr.14640) 4902 : cluster [DBG] pgmap v3362: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:39.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:37.576512+0000 mgr.smithi008.flmjzp (mgr.14640) 4903 : cluster [DBG] pgmap v3363: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:37.576512+0000 mgr.smithi008.flmjzp (mgr.14640) 4903 : cluster [DBG] pgmap v3363: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:41.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:39.577068+0000 mgr.smithi008.flmjzp (mgr.14640) 4904 : cluster [DBG] pgmap v3364: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:41.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:39.577068+0000 mgr.smithi008.flmjzp (mgr.14640) 4904 : cluster [DBG] pgmap v3364: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:43.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:41.577767+0000 mgr.smithi008.flmjzp (mgr.14640) 4905 : cluster [DBG] pgmap v3365: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:41.577767+0000 mgr.smithi008.flmjzp (mgr.14640) 4905 : cluster [DBG] pgmap v3365: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:43.598284+0000 mon.smithi008 (mon.0) 5174 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:43.600534+0000 mon.smithi008 (mon.0) 5175 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:43.601635+0000 mon.smithi008 (mon.0) 5176 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:43.608517+0000 mon.smithi008 (mon.0) 5177 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:43.615343+0000 mon.smithi008 (mon.0) 5178 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:43.618512+0000 mon.smithi008 (mon.0) 5179 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:43.620215+0000 mon.smithi008 (mon.0) 5180 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:43.621882+0000 mon.smithi008 (mon.0) 5181 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:43.623890+0000 mon.smithi008 (mon.0) 5182 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:43.598284+0000 mon.smithi008 (mon.0) 5174 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:43.600534+0000 mon.smithi008 (mon.0) 5175 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:43.601635+0000 mon.smithi008 (mon.0) 5176 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:43.608517+0000 mon.smithi008 (mon.0) 5177 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:43.615343+0000 mon.smithi008 (mon.0) 5178 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:43.618512+0000 mon.smithi008 (mon.0) 5179 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:43.620215+0000 mon.smithi008 (mon.0) 5180 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:43.621882+0000 mon.smithi008 (mon.0) 5181 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:44.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:43.623890+0000 mon.smithi008 (mon.0) 5182 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:43.578313+0000 mgr.smithi008.flmjzp (mgr.14640) 4906 : cluster [DBG] pgmap v3366: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:43.602573+0000 mgr.smithi008.flmjzp (mgr.14640) 4907 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:43.603143+0000 mgr.smithi008.flmjzp (mgr.14640) 4908 : cluster [DBG] pgmap v3367: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:43.603417+0000 mgr.smithi008.flmjzp (mgr.14640) 4909 : cluster [DBG] pgmap v3368: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:43.625844+0000 mgr.smithi008.flmjzp (mgr.14640) 4910 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:43.578313+0000 mgr.smithi008.flmjzp (mgr.14640) 4906 : cluster [DBG] pgmap v3366: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:43.602573+0000 mgr.smithi008.flmjzp (mgr.14640) 4907 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:43.603143+0000 mgr.smithi008.flmjzp (mgr.14640) 4908 : cluster [DBG] pgmap v3367: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:43.603417+0000 mgr.smithi008.flmjzp (mgr.14640) 4909 : cluster [DBG] pgmap v3368: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:43.625844+0000 mgr.smithi008.flmjzp (mgr.14640) 4910 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:47.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:45.603881+0000 mgr.smithi008.flmjzp (mgr.14640) 4911 : cluster [DBG] pgmap v3369: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:45.603881+0000 mgr.smithi008.flmjzp (mgr.14640) 4911 : cluster [DBG] pgmap v3369: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:49.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:47.604347+0000 mgr.smithi008.flmjzp (mgr.14640) 4912 : cluster [DBG] pgmap v3370: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:47.604347+0000 mgr.smithi008.flmjzp (mgr.14640) 4912 : cluster [DBG] pgmap v3370: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:50.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.416+0000 7ff28b3fd700 1 -- 172.21.15.8:0/4083441730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff28406b9c0 msgr2=0x7ff284069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:50.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.416+0000 7ff28b3fd700 1 --2- 172.21.15.8:0/4083441730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff28406b9c0 0x7ff284069ec0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7ff280004660 tx=0x7ff280009b30).stop 2023-10-18T22:20:50.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.416+0000 7ff28b3fd700 1 -- 172.21.15.8:0/4083441730 shutdown_connections 2023-10-18T22:20:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.416+0000 7ff28b3fd700 1 --2- 172.21.15.8:0/4083441730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff28406a3b0 0x7ff28406a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.416+0000 7ff28b3fd700 1 --2- 172.21.15.8:0/4083441730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff28406b9c0 0x7ff284069ec0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.416+0000 7ff28b3fd700 1 -- 172.21.15.8:0/4083441730 >> 172.21.15.8:0/4083441730 conn(0x7ff2840f1c90 msgr2=0x7ff2840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.417+0000 7ff28b3fd700 1 -- 172.21.15.8:0/4083441730 shutdown_connections 2023-10-18T22:20:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.417+0000 7ff28b3fd700 1 -- 172.21.15.8:0/4083441730 wait complete. 2023-10-18T22:20:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.417+0000 7ff28b3fd700 1 Processor -- start 2023-10-18T22:20:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.418+0000 7ff28b3fd700 1 -- start start 2023-10-18T22:20:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.418+0000 7ff28b3fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff28406a3b0 0x7ff284108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.418+0000 7ff28b3fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff28406b9c0 0x7ff284109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.418+0000 7ff28b3fd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2841099e0 con 0x7ff28406b9c0 2023-10-18T22:20:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.418+0000 7ff28b3fd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284109b20 con 0x7ff28406a3b0 2023-10-18T22:20:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.418+0000 7ff289bfa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff28406b9c0 0x7ff284109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.418+0000 7ff289bfa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff28406b9c0 0x7ff284109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41482/0 (socket says 172.21.15.8:41482) 2023-10-18T22:20:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.418+0000 7ff289bfa700 1 -- 172.21.15.8:0/2086513855 learned_addr learned my addr 172.21.15.8:0/2086513855 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.418+0000 7ff28a3fb700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff28406a3b0 0x7ff284108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.419+0000 7ff289bfa700 1 -- 172.21.15.8:0/2086513855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff28406a3b0 msgr2=0x7ff284108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.419+0000 7ff289bfa700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff28406a3b0 0x7ff284108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.419+0000 7ff289bfa700 1 -- 172.21.15.8:0/2086513855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280005040 con 0x7ff28406b9c0 2023-10-18T22:20:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.419+0000 7ff289bfa700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff28406b9c0 0x7ff284109430 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7ff27400e7f0 tx=0x7ff27400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.419+0000 7ff27affd700 1 -- 172.21.15.8:0/2086513855 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2740092e0 con 0x7ff28406b9c0 2023-10-18T22:20:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.419+0000 7ff27affd700 1 -- 172.21.15.8:0/2086513855 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff27400f040 con 0x7ff28406b9c0 2023-10-18T22:20:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.419+0000 7ff28b3fd700 1 -- 172.21.15.8:0/2086513855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28410a4c0 con 0x7ff28406b9c0 2023-10-18T22:20:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.419+0000 7ff27affd700 1 -- 172.21.15.8:0/2086513855 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2740147e0 con 0x7ff28406b9c0 2023-10-18T22:20:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.419+0000 7ff28b3fd700 1 -- 172.21.15.8:0/2086513855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28410aa00 con 0x7ff28406b9c0 2023-10-18T22:20:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.420+0000 7ff28b3fd700 1 -- 172.21.15.8:0/2086513855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff284045ad0 con 0x7ff28406b9c0 2023-10-18T22:20:50.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.421+0000 7ff27affd700 1 -- 172.21.15.8:0/2086513855 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff27401b030 con 0x7ff28406b9c0 2023-10-18T22:20:50.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.422+0000 7ff27affd700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff270060f70 0x7ff270063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:50.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.422+0000 7ff27affd700 1 -- 172.21.15.8:0/2086513855 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff27407c7c0 con 0x7ff28406b9c0 2023-10-18T22:20:50.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.422+0000 7ff28a3fb700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff270060f70 0x7ff270063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:50.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.423+0000 7ff28a3fb700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff270060f70 0x7ff270063430 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7ff280005010 tx=0x7ff280016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.427+0000 7ff27affd700 1 -- 172.21.15.8:0/2086513855 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff27404fe50 con 0x7ff28406b9c0 2023-10-18T22:20:50.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.622+0000 7ff28b3fd700 1 -- 172.21.15.8:0/2086513855 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff28410ac20 con 0x7ff270060f70 2023-10-18T22:20:50.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.623+0000 7ff27affd700 1 -- 172.21.15.8:0/2086513855 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff28410ac20 con 0x7ff270060f70 2023-10-18T22:20:50.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 -- 172.21.15.8:0/2086513855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff270060f70 msgr2=0x7ff270063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff270060f70 0x7ff270063430 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7ff280005010 tx=0x7ff280016040).stop 2023-10-18T22:20:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 -- 172.21.15.8:0/2086513855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff28406b9c0 msgr2=0x7ff284109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff28406b9c0 0x7ff284109430 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7ff27400e7f0 tx=0x7ff27400b040).stop 2023-10-18T22:20:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 -- 172.21.15.8:0/2086513855 shutdown_connections 2023-10-18T22:20:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff270060f70 0x7ff270063430 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff28406a3b0 0x7ff284108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 --2- 172.21.15.8:0/2086513855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff28406b9c0 0x7ff284109430 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 -- 172.21.15.8:0/2086513855 >> 172.21.15.8:0/2086513855 conn(0x7ff2840f1c90 msgr2=0x7ff2840fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 -- 172.21.15.8:0/2086513855 shutdown_connections 2023-10-18T22:20:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.625+0000 7ff28b3fd700 1 -- 172.21.15.8:0/2086513855 wait complete. 2023-10-18T22:20:50.641 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:20:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.763+0000 7ff22e47d700 1 -- 172.21.15.8:0/1203463983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2280f6530 msgr2=0x7ff2280f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.763+0000 7ff22e47d700 1 --2- 172.21.15.8:0/1203463983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2280f6530 0x7ff2280f6950 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7ff224004660 tx=0x7ff224009b30).stop 2023-10-18T22:20:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.763+0000 7ff22e47d700 1 -- 172.21.15.8:0/1203463983 shutdown_connections 2023-10-18T22:20:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.763+0000 7ff22e47d700 1 --2- 172.21.15.8:0/1203463983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2280f77d0 0x7ff2280f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.763+0000 7ff22e47d700 1 --2- 172.21.15.8:0/1203463983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2280f6530 0x7ff2280f6950 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.763+0000 7ff22e47d700 1 -- 172.21.15.8:0/1203463983 >> 172.21.15.8:0/1203463983 conn(0x7ff2280f1c90 msgr2=0x7ff2280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:50.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.763+0000 7ff22e47d700 1 -- 172.21.15.8:0/1203463983 shutdown_connections 2023-10-18T22:20:50.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.763+0000 7ff22e47d700 1 -- 172.21.15.8:0/1203463983 wait complete. 2023-10-18T22:20:50.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.764+0000 7ff22e47d700 1 Processor -- start 2023-10-18T22:20:50.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.764+0000 7ff22e47d700 1 -- start start 2023-10-18T22:20:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22e47d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2280f6530 0x7ff228108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22e47d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2280f77d0 0x7ff228109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22e47d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff228109a00 con 0x7ff2280f77d0 2023-10-18T22:20:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22e47d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff228109b40 con 0x7ff2280f6530 2023-10-18T22:20:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22cc7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2280f77d0 0x7ff228109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22cc7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2280f77d0 0x7ff228109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41506/0 (socket says 172.21.15.8:41506) 2023-10-18T22:20:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22cc7a700 1 -- 172.21.15.8:0/99554090 learned_addr learned my addr 172.21.15.8:0/99554090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22d47b700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2280f6530 0x7ff228108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22cc7a700 1 -- 172.21.15.8:0/99554090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2280f6530 msgr2=0x7ff228108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22cc7a700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2280f6530 0x7ff228108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22cc7a700 1 -- 172.21.15.8:0/99554090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224005040 con 0x7ff2280f77d0 2023-10-18T22:20:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.765+0000 7ff22cc7a700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2280f77d0 0x7ff228109450 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7ff21800e7f0 tx=0x7ff21800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.766+0000 7ff21dffb700 1 -- 172.21.15.8:0/99554090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2180092e0 con 0x7ff2280f77d0 2023-10-18T22:20:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.766+0000 7ff21dffb700 1 -- 172.21.15.8:0/99554090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff21800f040 con 0x7ff2280f77d0 2023-10-18T22:20:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.766+0000 7ff21dffb700 1 -- 172.21.15.8:0/99554090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2180147e0 con 0x7ff2280f77d0 2023-10-18T22:20:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.766+0000 7ff22e47d700 1 -- 172.21.15.8:0/99554090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22810a4e0 con 0x7ff2280f77d0 2023-10-18T22:20:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.766+0000 7ff22e47d700 1 -- 172.21.15.8:0/99554090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22810aa20 con 0x7ff2280f77d0 2023-10-18T22:20:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.767+0000 7ff22e47d700 1 -- 172.21.15.8:0/99554090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff228045ad0 con 0x7ff2280f77d0 2023-10-18T22:20:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.768+0000 7ff21dffb700 1 -- 172.21.15.8:0/99554090 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff21801b030 con 0x7ff2280f77d0 2023-10-18T22:20:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.769+0000 7ff21dffb700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff214060f70 0x7ff214063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.769+0000 7ff21dffb700 1 -- 172.21.15.8:0/99554090 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff21807c5f0 con 0x7ff2280f77d0 2023-10-18T22:20:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.769+0000 7ff22d47b700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff214060f70 0x7ff214063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.769+0000 7ff22d47b700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff214060f70 0x7ff214063430 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7ff224005010 tx=0x7ff224016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:50.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.773+0000 7ff21dffb700 1 -- 172.21.15.8:0/99554090 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff21804fd40 con 0x7ff2280f77d0 2023-10-18T22:20:50.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.974+0000 7ff22e47d700 1 -- 172.21.15.8:0/99554090 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff22810ac90 con 0x7ff214060f70 2023-10-18T22:20:50.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.975+0000 7ff21dffb700 1 -- 172.21.15.8:0/99554090 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff22810ac90 con 0x7ff214060f70 2023-10-18T22:20:50.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.977+0000 7ff22e47d700 1 -- 172.21.15.8:0/99554090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff214060f70 msgr2=0x7ff214063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:50.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.977+0000 7ff22e47d700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff214060f70 0x7ff214063430 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7ff224005010 tx=0x7ff224016040).stop 2023-10-18T22:20:50.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.977+0000 7ff22e47d700 1 -- 172.21.15.8:0/99554090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2280f77d0 msgr2=0x7ff228109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:50.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.977+0000 7ff22e47d700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2280f77d0 0x7ff228109450 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7ff21800e7f0 tx=0x7ff21800b040).stop 2023-10-18T22:20:50.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.977+0000 7ff22e47d700 1 -- 172.21.15.8:0/99554090 shutdown_connections 2023-10-18T22:20:50.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.977+0000 7ff22e47d700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff214060f70 0x7ff214063430 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.977+0000 7ff22e47d700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2280f6530 0x7ff228108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.977+0000 7ff22e47d700 1 --2- 172.21.15.8:0/99554090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2280f77d0 0x7ff228109450 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:50.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.977+0000 7ff22e47d700 1 -- 172.21.15.8:0/99554090 >> 172.21.15.8:0/99554090 conn(0x7ff2280f1c90 msgr2=0x7ff22806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:50.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.978+0000 7ff22e47d700 1 -- 172.21.15.8:0/99554090 shutdown_connections 2023-10-18T22:20:50.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:50.978+0000 7ff22e47d700 1 -- 172.21.15.8:0/99554090 wait complete. 2023-10-18T22:20:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.113+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1644785102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80f77d0 msgr2=0x7f5ee80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.113+0000 7f5ee7fff700 1 --2- 172.21.15.8:0/1644785102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80f77d0 0x7f5ee80f7c30 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f5edc004660 tx=0x7f5edc009b30).stop 2023-10-18T22:20:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.114+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1644785102 shutdown_connections 2023-10-18T22:20:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.114+0000 7f5ee7fff700 1 --2- 172.21.15.8:0/1644785102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80f77d0 0x7f5ee80f7c30 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.114+0000 7f5ee7fff700 1 --2- 172.21.15.8:0/1644785102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee80f6530 0x7f5ee80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.114+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1644785102 >> 172.21.15.8:0/1644785102 conn(0x7f5ee80f1c90 msgr2=0x7f5ee80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.114+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1644785102 shutdown_connections 2023-10-18T22:20:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.114+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1644785102 wait complete. 2023-10-18T22:20:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.114+0000 7f5ee7fff700 1 Processor -- start 2023-10-18T22:20:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.115+0000 7f5ee7fff700 1 -- start start 2023-10-18T22:20:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.115+0000 7f5ee7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80f6530 0x7f5ee806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.115+0000 7f5ee7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee80f77d0 0x7f5ee8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.115+0000 7f5ee7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee806a380 con 0x7f5ee80f6530 2023-10-18T22:20:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.115+0000 7f5ee7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee806a4c0 con 0x7f5ee80f77d0 2023-10-18T22:20:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.115+0000 7f5ee6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80f6530 0x7f5ee806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.115+0000 7f5ee6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80f6530 0x7f5ee806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41524/0 (socket says 172.21.15.8:41524) 2023-10-18T22:20:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.115+0000 7f5ee6ffd700 1 -- 172.21.15.8:0/1010373121 learned_addr learned my addr 172.21.15.8:0/1010373121 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ee67fc700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee80f77d0 0x7f5ee8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ee6ffd700 1 -- 172.21.15.8:0/1010373121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee80f77d0 msgr2=0x7f5ee8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ee6ffd700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee80f77d0 0x7f5ee8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ee6ffd700 1 -- 172.21.15.8:0/1010373121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc005040 con 0x7f5ee80f6530 2023-10-18T22:20:51.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ee67fc700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee80f77d0 0x7f5ee8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:20:51.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ee6ffd700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80f6530 0x7f5ee806b9a0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f5ed800c790 tx=0x7f5ed8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:51.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ecf7fe700 1 -- 172.21.15.8:0/1010373121 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ed800e680 con 0x7f5ee80f6530 2023-10-18T22:20:51.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ecf7fe700 1 -- 172.21.15.8:0/1010373121 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5ed800eca0 con 0x7f5ee80f6530 2023-10-18T22:20:51.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ecf7fe700 1 -- 172.21.15.8:0/1010373121 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ed8012d80 con 0x7f5ee80f6530 2023-10-18T22:20:51.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1010373121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee806a7a0 con 0x7f5ee80f6530 2023-10-18T22:20:51.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.116+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1010373121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee810ed70 con 0x7f5ee80f6530 2023-10-18T22:20:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.117+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1010373121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee8045ad0 con 0x7f5ee80f6530 2023-10-18T22:20:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.118+0000 7f5ecf7fe700 1 -- 172.21.15.8:0/1010373121 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5ed8010070 con 0x7f5ee80f6530 2023-10-18T22:20:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.119+0000 7f5ecf7fe700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ed0060f70 0x7f5ed0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.119+0000 7f5ecf7fe700 1 -- 172.21.15.8:0/1010373121 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5ed807ca70 con 0x7f5ee80f6530 2023-10-18T22:20:51.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.120+0000 7f5ee67fc700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ed0060f70 0x7f5ed0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:51.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.120+0000 7f5ee67fc700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ed0060f70 0x7f5ed0063430 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f5edc009d60 tx=0x7f5edc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:51.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.123+0000 7f5ecf7fe700 1 -- 172.21.15.8:0/1010373121 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5ed804c5c0 con 0x7f5ee80f6530 2023-10-18T22:20:51.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.314+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1010373121 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ee80fee40 con 0x7f5ed0060f70 2023-10-18T22:20:51.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.323+0000 7f5ecf7fe700 1 -- 172.21.15.8:0/1010373121 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5ee80fee40 con 0x7f5ed0060f70 2023-10-18T22:20:51.325 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:20:51.325 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (87m) 4m ago 89m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:20:51.325 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (81m) 4m ago 88m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:20:51.325 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (81m) 2m ago 88m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:20:51.325 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (87m) 4m ago 88m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:20:51.326 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 85m - - 2023-10-18T22:20:51.326 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 84m - - 2023-10-18T22:20:51.326 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 84m - - 2023-10-18T22:20:51.326 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 84m - - 2023-10-18T22:20:51.326 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (82m) 4m ago 90m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:20:51.327 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (82m) 2m ago 88m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:20:51.327 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (81m) 4m ago 90m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:20:51.327 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (81m) 2m ago 88m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:20:51.327 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (88m) 4m ago 88m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:20:51.327 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (87m) 2m ago 87m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:20:51.328 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (81m) 4m ago 87m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:20:51.328 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (79m) 4m ago 87m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:20:51.328 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (78m) 4m ago 86m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:20:51.328 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (78m) 2m ago 86m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:20:51.328 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (77m) 2m ago 86m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:20:51.329 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (76m) 2m ago 86m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:20:51.329 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (83m) 4m ago 88m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:20:51.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.325+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1010373121 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ed0060f70 msgr2=0x7f5ed0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:51.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.325+0000 7f5ee7fff700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ed0060f70 0x7f5ed0063430 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f5edc009d60 tx=0x7f5edc009b30).stop 2023-10-18T22:20:51.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.325+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1010373121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80f6530 msgr2=0x7f5ee806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:51.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.325+0000 7f5ee7fff700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80f6530 0x7f5ee806b9a0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f5ed800c790 tx=0x7f5ed8007d90).stop 2023-10-18T22:20:51.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.325+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1010373121 shutdown_connections 2023-10-18T22:20:51.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.325+0000 7f5ee7fff700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5ed0060f70 0x7f5ed0063430 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.325+0000 7f5ee7fff700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ee80f6530 0x7f5ee806b9a0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.325+0000 7f5ee7fff700 1 --2- 172.21.15.8:0/1010373121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee80f77d0 0x7f5ee8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.325+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1010373121 >> 172.21.15.8:0/1010373121 conn(0x7f5ee80f1c90 msgr2=0x7f5ee80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:51.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.325+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1010373121 shutdown_connections 2023-10-18T22:20:51.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.326+0000 7f5ee7fff700 1 -- 172.21.15.8:0/1010373121 wait complete. 2023-10-18T22:20:51.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.462+0000 7feadde8b700 1 -- 172.21.15.8:0/4231246444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f77d0 msgr2=0x7fead80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.462+0000 7feadde8b700 1 --2- 172.21.15.8:0/4231246444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f77d0 0x7fead80f7c30 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7feac4004660 tx=0x7feac4009b30).stop 2023-10-18T22:20:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.462+0000 7feadde8b700 1 -- 172.21.15.8:0/4231246444 shutdown_connections 2023-10-18T22:20:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.462+0000 7feadde8b700 1 --2- 172.21.15.8:0/4231246444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f77d0 0x7fead80f7c30 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.462+0000 7feadde8b700 1 --2- 172.21.15.8:0/4231246444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f6530 0x7fead80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.462+0000 7feadde8b700 1 -- 172.21.15.8:0/4231246444 >> 172.21.15.8:0/4231246444 conn(0x7fead80f1c90 msgr2=0x7fead80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.462+0000 7feadde8b700 1 -- 172.21.15.8:0/4231246444 shutdown_connections 2023-10-18T22:20:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.462+0000 7feadde8b700 1 -- 172.21.15.8:0/4231246444 wait complete. 2023-10-18T22:20:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.463+0000 7feadde8b700 1 Processor -- start 2023-10-18T22:20:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.463+0000 7feadde8b700 1 -- start start 2023-10-18T22:20:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.463+0000 7feadde8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f6530 0x7fead806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.463+0000 7feadde8b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f77d0 0x7fead8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.463+0000 7feadde8b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead806a380 con 0x7fead80f77d0 2023-10-18T22:20:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.463+0000 7feadde8b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead806a4c0 con 0x7fead80f6530 2023-10-18T22:20:51.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7fead7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f77d0 0x7fead8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:51.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7fead7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f77d0 0x7fead8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41548/0 (socket says 172.21.15.8:41548) 2023-10-18T22:20:51.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7fead7fff700 1 -- 172.21.15.8:0/3540933877 learned_addr learned my addr 172.21.15.8:0/3540933877 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:51.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7feadce89700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f6530 0x7fead806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:51.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7fead7fff700 1 -- 172.21.15.8:0/3540933877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f6530 msgr2=0x7fead806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:51.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7fead7fff700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f6530 0x7fead806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7fead7fff700 1 -- 172.21.15.8:0/3540933877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4005040 con 0x7fead80f77d0 2023-10-18T22:20:51.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7fead7fff700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f77d0 0x7fead8069e20 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7feac4004320 tx=0x7feac400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:51.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7fead57fa700 1 -- 172.21.15.8:0/3540933877 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac4019070 con 0x7fead80f77d0 2023-10-18T22:20:51.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7fead57fa700 1 -- 172.21.15.8:0/3540933877 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7feac401e420 con 0x7fead80f77d0 2023-10-18T22:20:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7feadde8b700 1 -- 172.21.15.8:0/3540933877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead806a740 con 0x7fead80f77d0 2023-10-18T22:20:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.464+0000 7fead57fa700 1 -- 172.21.15.8:0/3540933877 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac4014680 con 0x7fead80f77d0 2023-10-18T22:20:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.465+0000 7feadde8b700 1 -- 172.21.15.8:0/3540933877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead806ac20 con 0x7fead80f77d0 2023-10-18T22:20:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.466+0000 7feadde8b700 1 -- 172.21.15.8:0/3540933877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead8045ad0 con 0x7fead80f77d0 2023-10-18T22:20:51.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.467+0000 7fead57fa700 1 -- 172.21.15.8:0/3540933877 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7feac401e590 con 0x7fead80f77d0 2023-10-18T22:20:51.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.467+0000 7fead57fa700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feac8060f70 0x7feac8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:51.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.468+0000 7fead57fa700 1 -- 172.21.15.8:0/3540933877 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7feac407dd10 con 0x7fead80f77d0 2023-10-18T22:20:51.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.468+0000 7feadce89700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feac8060f70 0x7feac8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:51.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.468+0000 7feadce89700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feac8060f70 0x7feac8063430 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fead806b730 tx=0x7feacc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:51.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.472+0000 7fead57fa700 1 -- 172.21.15.8:0/3540933877 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7feac404d8e0 con 0x7fead80f77d0 2023-10-18T22:20:51.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:49.605001+0000 mgr.smithi008.flmjzp (mgr.14640) 4913 : cluster [DBG] pgmap v3371: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:51.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:49.605001+0000 mgr.smithi008.flmjzp (mgr.14640) 4913 : cluster [DBG] pgmap v3371: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:51.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.725+0000 7feadde8b700 1 -- 172.21.15.8:0/3540933877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fead8027a00 con 0x7fead80f77d0 2023-10-18T22:20:51.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.725+0000 7fead57fa700 1 -- 172.21.15.8:0/3540933877 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7feac4050f00 con 0x7fead80f77d0 2023-10-18T22:20:51.728 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:20:51.728 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:20:51.729 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:20:51.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:20:51.730 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:20:51.730 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:20:51.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:20:51.731 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:20:51.731 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:20:51.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:20:51.732 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:20:51.733 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:20:51.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:20:51.734 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:20:51.734 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:20:51.735 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:20:51.735 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:20:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.727+0000 7feadde8b700 1 -- 172.21.15.8:0/3540933877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feac8060f70 msgr2=0x7feac8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.727+0000 7feadde8b700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feac8060f70 0x7feac8063430 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fead806b730 tx=0x7feacc00b040).stop 2023-10-18T22:20:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.727+0000 7feadde8b700 1 -- 172.21.15.8:0/3540933877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f77d0 msgr2=0x7fead8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.727+0000 7feadde8b700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f77d0 0x7fead8069e20 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7feac4004320 tx=0x7feac400b040).stop 2023-10-18T22:20:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.727+0000 7feadde8b700 1 -- 172.21.15.8:0/3540933877 shutdown_connections 2023-10-18T22:20:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.728+0000 7feadde8b700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feac8060f70 0x7feac8063430 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.728+0000 7feadde8b700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80f6530 0x7fead806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.728+0000 7feadde8b700 1 --2- 172.21.15.8:0/3540933877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead80f77d0 0x7fead8069e20 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.728+0000 7feadde8b700 1 -- 172.21.15.8:0/3540933877 >> 172.21.15.8:0/3540933877 conn(0x7fead80f1c90 msgr2=0x7fead80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.728+0000 7feadde8b700 1 -- 172.21.15.8:0/3540933877 shutdown_connections 2023-10-18T22:20:51.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.728+0000 7feadde8b700 1 -- 172.21.15.8:0/3540933877 wait complete. 2023-10-18T22:20:51.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.865+0000 7ffb22046700 1 -- 172.21.15.8:0/2535634827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb1c0f6530 msgr2=0x7ffb1c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:51.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.865+0000 7ffb22046700 1 --2- 172.21.15.8:0/2535634827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb1c0f6530 0x7ffb1c0f6950 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7ffb18004660 tx=0x7ffb18009b30).stop 2023-10-18T22:20:51.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.865+0000 7ffb22046700 1 -- 172.21.15.8:0/2535634827 shutdown_connections 2023-10-18T22:20:51.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.865+0000 7ffb22046700 1 --2- 172.21.15.8:0/2535634827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1c0f77d0 0x7ffb1c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.865+0000 7ffb22046700 1 --2- 172.21.15.8:0/2535634827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb1c0f6530 0x7ffb1c0f6950 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.865+0000 7ffb22046700 1 -- 172.21.15.8:0/2535634827 >> 172.21.15.8:0/2535634827 conn(0x7ffb1c0f1c90 msgr2=0x7ffb1c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.865+0000 7ffb22046700 1 -- 172.21.15.8:0/2535634827 shutdown_connections 2023-10-18T22:20:51.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.865+0000 7ffb22046700 1 -- 172.21.15.8:0/2535634827 wait complete. 2023-10-18T22:20:51.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.866+0000 7ffb22046700 1 Processor -- start 2023-10-18T22:20:51.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.866+0000 7ffb22046700 1 -- start start 2023-10-18T22:20:51.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.866+0000 7ffb22046700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb1c0f6530 0x7ffb1c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:51.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.866+0000 7ffb22046700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1c0f77d0 0x7ffb1c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:51.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.866+0000 7ffb22046700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c06a380 con 0x7ffb1c0f6530 2023-10-18T22:20:51.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.866+0000 7ffb22046700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c06a4c0 con 0x7ffb1c0f77d0 2023-10-18T22:20:51.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.867+0000 7ffb21044700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb1c0f6530 0x7ffb1c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:51.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.867+0000 7ffb21044700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb1c0f6530 0x7ffb1c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41566/0 (socket says 172.21.15.8:41566) 2023-10-18T22:20:51.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.867+0000 7ffb21044700 1 -- 172.21.15.8:0/4027315832 learned_addr learned my addr 172.21.15.8:0/4027315832 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:51.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.867+0000 7ffb20843700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1c0f77d0 0x7ffb1c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:51.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.867+0000 7ffb21044700 1 -- 172.21.15.8:0/4027315832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1c0f77d0 msgr2=0x7ffb1c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:51.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.867+0000 7ffb21044700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1c0f77d0 0x7ffb1c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:51.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.867+0000 7ffb21044700 1 -- 172.21.15.8:0/4027315832 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb18005040 con 0x7ffb1c0f6530 2023-10-18T22:20:51.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.867+0000 7ffb20843700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1c0f77d0 0x7ffb1c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:20:51.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.867+0000 7ffb21044700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb1c0f6530 0x7ffb1c06b9a0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7ffb18004e30 tx=0x7ffb18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:51.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.867+0000 7ffb11ffb700 1 -- 172.21.15.8:0/4027315832 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb18018070 con 0x7ffb1c0f6530 2023-10-18T22:20:51.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.868+0000 7ffb11ffb700 1 -- 172.21.15.8:0/4027315832 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ffb18009630 con 0x7ffb1c0f6530 2023-10-18T22:20:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.868+0000 7ffb22046700 1 -- 172.21.15.8:0/4027315832 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c06a740 con 0x7ffb1c0f6530 2023-10-18T22:20:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.868+0000 7ffb11ffb700 1 -- 172.21.15.8:0/4027315832 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb1801c3c0 con 0x7ffb1c0f6530 2023-10-18T22:20:51.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.868+0000 7ffb22046700 1 -- 172.21.15.8:0/4027315832 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c06aca0 con 0x7ffb1c0f6530 2023-10-18T22:20:51.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.869+0000 7ffb22046700 1 -- 172.21.15.8:0/4027315832 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c045ad0 con 0x7ffb1c0f6530 2023-10-18T22:20:51.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.870+0000 7ffb11ffb700 1 -- 172.21.15.8:0/4027315832 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ffb1801d420 con 0x7ffb1c0f6530 2023-10-18T22:20:51.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.870+0000 7ffb11ffb700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb08060f70 0x7ffb08063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:51.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.871+0000 7ffb11ffb700 1 -- 172.21.15.8:0/4027315832 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ffb1807e670 con 0x7ffb1c0f6530 2023-10-18T22:20:51.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.871+0000 7ffb20843700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb08060f70 0x7ffb08063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:51.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.871+0000 7ffb20843700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb08060f70 0x7ffb08063430 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7ffb0c009780 tx=0x7ffb0c009c80).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:51.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:51.875+0000 7ffb11ffb700 1 -- 172.21.15.8:0/4027315832 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ffb1804e310 con 0x7ffb1c0f6530 2023-10-18T22:20:52.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.100+0000 7ffb22046700 1 -- 172.21.15.8:0/4027315832 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb1c0fed60 con 0x7ffb1c0f6530 2023-10-18T22:20:52.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.100+0000 7ffb11ffb700 1 -- 172.21.15.8:0/4027315832 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7ffb18051930 con 0x7ffb1c0f6530 2023-10-18T22:20:52.102 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:20:52.102 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:20:52.103 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:20:52.103 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:20:52.103 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:20:52.103 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:20:52.103 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:20:52.104 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:20:52.104 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:20:52.104 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:20:52.104 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:20:52.104 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:20:52.105 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:20:52.105 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:20:52.105 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:20:52.105 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:20:52.105 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:20:52.106 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:20:52.106 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:20:52.106 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:20:52.106 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:20:52.106 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:20:52.107 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:20:52.107 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:20:52.107 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:20:52.107 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:20:52.107 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:20:52.108 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:20:52.108 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:20:52.108 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:20:52.108 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:20:52.108 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:20:52.109 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:20:52.109 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:20:52.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.102+0000 7ffb22046700 1 -- 172.21.15.8:0/4027315832 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb08060f70 msgr2=0x7ffb08063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:52.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.102+0000 7ffb22046700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb08060f70 0x7ffb08063430 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7ffb0c009780 tx=0x7ffb0c009c80).stop 2023-10-18T22:20:52.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.102+0000 7ffb22046700 1 -- 172.21.15.8:0/4027315832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb1c0f6530 msgr2=0x7ffb1c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:52.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.102+0000 7ffb22046700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb1c0f6530 0x7ffb1c06b9a0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7ffb18004e30 tx=0x7ffb18009b30).stop 2023-10-18T22:20:52.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.102+0000 7ffb22046700 1 -- 172.21.15.8:0/4027315832 shutdown_connections 2023-10-18T22:20:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.102+0000 7ffb22046700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb08060f70 0x7ffb08063430 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.102+0000 7ffb22046700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb1c0f6530 0x7ffb1c06b9a0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.102+0000 7ffb22046700 1 --2- 172.21.15.8:0/4027315832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb1c0f77d0 0x7ffb1c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.102+0000 7ffb22046700 1 -- 172.21.15.8:0/4027315832 >> 172.21.15.8:0/4027315832 conn(0x7ffb1c0f1c90 msgr2=0x7ffb1c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.103+0000 7ffb22046700 1 -- 172.21.15.8:0/4027315832 shutdown_connections 2023-10-18T22:20:52.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.103+0000 7ffb22046700 1 -- 172.21.15.8:0/4027315832 wait complete. 2023-10-18T22:20:52.112 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:20:52.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.239+0000 7f660aefd700 1 -- 172.21.15.8:0/1292930330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040f6530 msgr2=0x7f66040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:52.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.239+0000 7f660aefd700 1 --2- 172.21.15.8:0/1292930330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040f6530 0x7f66040f6950 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7f6600004660 tx=0x7f6600009b30).stop 2023-10-18T22:20:52.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.239+0000 7f660aefd700 1 -- 172.21.15.8:0/1292930330 shutdown_connections 2023-10-18T22:20:52.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.239+0000 7f660aefd700 1 --2- 172.21.15.8:0/1292930330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66040f77d0 0x7f66040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:52.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.239+0000 7f660aefd700 1 --2- 172.21.15.8:0/1292930330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040f6530 0x7f66040f6950 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:52.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.239+0000 7f660aefd700 1 -- 172.21.15.8:0/1292930330 >> 172.21.15.8:0/1292930330 conn(0x7f66040f1c90 msgr2=0x7f66040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:52.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.239+0000 7f660aefd700 1 -- 172.21.15.8:0/1292930330 shutdown_connections 2023-10-18T22:20:52.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.239+0000 7f660aefd700 1 -- 172.21.15.8:0/1292930330 wait complete. 2023-10-18T22:20:52.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.240+0000 7f660aefd700 1 Processor -- start 2023-10-18T22:20:52.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.240+0000 7f660aefd700 1 -- start start 2023-10-18T22:20:52.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f660aefd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66040f6530 0x7f6604108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:52.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f660aefd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040f77d0 0x7f66041094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:52.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f660aefd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604109a70 con 0x7f66040f77d0 2023-10-18T22:20:52.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f660aefd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604109bb0 con 0x7f66040f6530 2023-10-18T22:20:52.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f66096fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040f77d0 0x7f66041094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:52.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f66096fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040f77d0 0x7f66041094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41584/0 (socket says 172.21.15.8:41584) 2023-10-18T22:20:52.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f66096fa700 1 -- 172.21.15.8:0/472585322 learned_addr learned my addr 172.21.15.8:0/472585322 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:20:52.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f6609efb700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66040f6530 0x7f6604108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:52.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f66096fa700 1 -- 172.21.15.8:0/472585322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66040f6530 msgr2=0x7f6604108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:52.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f66096fa700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66040f6530 0x7f6604108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:52.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f66096fa700 1 -- 172.21.15.8:0/472585322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6600005040 con 0x7f66040f77d0 2023-10-18T22:20:52.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.241+0000 7f6609efb700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66040f6530 0x7f6604108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:20:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.242+0000 7f66096fa700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040f77d0 0x7f66041094c0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f65f40026d0 tx=0x7f65f4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.242+0000 7f65fa7fc700 1 -- 172.21.15.8:0/472585322 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65f4009320 con 0x7f66040f77d0 2023-10-18T22:20:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.242+0000 7f660aefd700 1 -- 172.21.15.8:0/472585322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660410a550 con 0x7f66040f77d0 2023-10-18T22:20:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.242+0000 7f65fa7fc700 1 -- 172.21.15.8:0/472585322 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f65f400f040 con 0x7f66040f77d0 2023-10-18T22:20:52.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.242+0000 7f65fa7fc700 1 -- 172.21.15.8:0/472585322 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65f40148a0 con 0x7f66040f77d0 2023-10-18T22:20:52.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.242+0000 7f660aefd700 1 -- 172.21.15.8:0/472585322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660410ab10 con 0x7f66040f77d0 2023-10-18T22:20:52.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.243+0000 7f660aefd700 1 -- 172.21.15.8:0/472585322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6604045ad0 con 0x7f66040f77d0 2023-10-18T22:20:52.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.244+0000 7f65fa7fc700 1 -- 172.21.15.8:0/472585322 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f65f4009480 con 0x7f66040f77d0 2023-10-18T22:20:52.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.245+0000 7f65fa7fc700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65f0060f70 0x7f65f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:20:52.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.245+0000 7f65fa7fc700 1 -- 172.21.15.8:0/472585322 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f65f407cf60 con 0x7f66040f77d0 2023-10-18T22:20:52.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.246+0000 7f6609efb700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65f0060f70 0x7f65f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:20:52.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.246+0000 7f6609efb700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65f0060f70 0x7f65f0063430 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f6600005010 tx=0x7f6600009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:20:52.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.249+0000 7f65fa7fc700 1 -- 172.21.15.8:0/472585322 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f65f40505c0 con 0x7f66040f77d0 2023-10-18T22:20:52.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.448+0000 7f660aefd700 1 -- 172.21.15.8:0/472585322 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66040fee40 con 0x7f65f0060f70 2023-10-18T22:20:52.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.449+0000 7f65fa7fc700 1 -- 172.21.15.8:0/472585322 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f66040fee40 con 0x7f65f0060f70 2023-10-18T22:20:52.451 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:20:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:20:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:20:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:20:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:20:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:20:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:20:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:20:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:20:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:20:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:20:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:20:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:20:52.453 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:20:52.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.451+0000 7f660aefd700 1 -- 172.21.15.8:0/472585322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65f0060f70 msgr2=0x7f65f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:52.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.451+0000 7f660aefd700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65f0060f70 0x7f65f0063430 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f6600005010 tx=0x7f6600009b30).stop 2023-10-18T22:20:52.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.451+0000 7f660aefd700 1 -- 172.21.15.8:0/472585322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040f77d0 msgr2=0x7f66041094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:20:52.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.451+0000 7f660aefd700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040f77d0 0x7f66041094c0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f65f40026d0 tx=0x7f65f4009de0).stop 2023-10-18T22:20:52.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.451+0000 7f660aefd700 1 -- 172.21.15.8:0/472585322 shutdown_connections 2023-10-18T22:20:52.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.451+0000 7f660aefd700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f65f0060f70 0x7f65f0063430 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:52.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.451+0000 7f660aefd700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66040f6530 0x7f6604108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:52.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.451+0000 7f660aefd700 1 --2- 172.21.15.8:0/472585322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040f77d0 0x7f66041094c0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:20:52.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.451+0000 7f660aefd700 1 -- 172.21.15.8:0/472585322 >> 172.21.15.8:0/472585322 conn(0x7f66040f1c90 msgr2=0x7f660406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:20:52.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.452+0000 7f660aefd700 1 -- 172.21.15.8:0/472585322 shutdown_connections 2023-10-18T22:20:52.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:20:52.452+0000 7f660aefd700 1 -- 172.21.15.8:0/472585322 wait complete. 2023-10-18T22:20:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:50.623565+0000 mgr.smithi008.flmjzp (mgr.14640) 4914 : audit [DBG] from='client.37936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:50.975521+0000 mgr.smithi008.flmjzp (mgr.14640) 4915 : audit [DBG] from='client.37940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:51.315297+0000 mgr.smithi008.flmjzp (mgr.14640) 4916 : audit [DBG] from='client.37944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:51.725943+0000 mon.smithi008 (mon.0) 5183 : audit [DBG] from='client.? 172.21.15.8:0/3540933877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:52.101115+0000 mon.smithi008 (mon.0) 5184 : audit [DBG] from='client.? 172.21.15.8:0/4027315832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:20:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:50.623565+0000 mgr.smithi008.flmjzp (mgr.14640) 4914 : audit [DBG] from='client.37936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:50.975521+0000 mgr.smithi008.flmjzp (mgr.14640) 4915 : audit [DBG] from='client.37940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:51.315297+0000 mgr.smithi008.flmjzp (mgr.14640) 4916 : audit [DBG] from='client.37944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:51.725943+0000 mon.smithi008 (mon.0) 5183 : audit [DBG] from='client.? 172.21.15.8:0/3540933877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:52.101115+0000 mon.smithi008 (mon.0) 5184 : audit [DBG] from='client.? 172.21.15.8:0/4027315832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:20:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:51.605469+0000 mgr.smithi008.flmjzp (mgr.14640) 4917 : cluster [DBG] pgmap v3372: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:53.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:52.449741+0000 mgr.smithi008.flmjzp (mgr.14640) 4918 : audit [DBG] from='client.37956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:53.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:51.605469+0000 mgr.smithi008.flmjzp (mgr.14640) 4917 : cluster [DBG] pgmap v3372: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:52.449741+0000 mgr.smithi008.flmjzp (mgr.14640) 4918 : audit [DBG] from='client.37956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:20:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:53.629388+0000 mon.smithi008 (mon.0) 5185 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:53.631658+0000 mon.smithi008 (mon.0) 5186 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:53.632650+0000 mon.smithi008 (mon.0) 5187 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:53.639436+0000 mon.smithi008 (mon.0) 5188 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:53.645795+0000 mon.smithi008 (mon.0) 5189 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:53.648737+0000 mon.smithi008 (mon.0) 5190 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:53.650371+0000 mon.smithi008 (mon.0) 5191 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:54.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:53.652017+0000 mon.smithi008 (mon.0) 5192 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:54.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:20:53.653993+0000 mon.smithi008 (mon.0) 5193 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:53.629388+0000 mon.smithi008 (mon.0) 5185 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:53.631658+0000 mon.smithi008 (mon.0) 5186 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:20:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:53.632650+0000 mon.smithi008 (mon.0) 5187 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:20:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:53.639436+0000 mon.smithi008 (mon.0) 5188 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:20:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:53.645795+0000 mon.smithi008 (mon.0) 5189 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:20:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:53.648737+0000 mon.smithi008 (mon.0) 5190 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:54.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:53.650371+0000 mon.smithi008 (mon.0) 5191 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:54.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:53.652017+0000 mon.smithi008 (mon.0) 5192 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:54.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:20:53.653993+0000 mon.smithi008 (mon.0) 5193 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:20:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:53.606072+0000 mgr.smithi008.flmjzp (mgr.14640) 4919 : cluster [DBG] pgmap v3373: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:53.633521+0000 mgr.smithi008.flmjzp (mgr.14640) 4920 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:53.634191+0000 mgr.smithi008.flmjzp (mgr.14640) 4921 : cluster [DBG] pgmap v3374: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:53.634517+0000 mgr.smithi008.flmjzp (mgr.14640) 4922 : cluster [DBG] pgmap v3375: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:20:53.655862+0000 mgr.smithi008.flmjzp (mgr.14640) 4923 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:53.606072+0000 mgr.smithi008.flmjzp (mgr.14640) 4919 : cluster [DBG] pgmap v3373: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:53.633521+0000 mgr.smithi008.flmjzp (mgr.14640) 4920 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:20:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:53.634191+0000 mgr.smithi008.flmjzp (mgr.14640) 4921 : cluster [DBG] pgmap v3374: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:53.634517+0000 mgr.smithi008.flmjzp (mgr.14640) 4922 : cluster [DBG] pgmap v3375: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:20:53.655862+0000 mgr.smithi008.flmjzp (mgr.14640) 4923 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:20:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:55.634992+0000 mgr.smithi008.flmjzp (mgr.14640) 4924 : cluster [DBG] pgmap v3376: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:55.634992+0000 mgr.smithi008.flmjzp (mgr.14640) 4924 : cluster [DBG] pgmap v3376: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:20:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:57.635685+0000 mgr.smithi008.flmjzp (mgr.14640) 4925 : cluster [DBG] pgmap v3377: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:20:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:20:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:57.635685+0000 mgr.smithi008.flmjzp (mgr.14640) 4925 : cluster [DBG] pgmap v3377: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:20:59.636329+0000 mgr.smithi008.flmjzp (mgr.14640) 4926 : cluster [DBG] pgmap v3378: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:20:59.636329+0000 mgr.smithi008.flmjzp (mgr.14640) 4926 : cluster [DBG] pgmap v3378: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:01.636937+0000 mgr.smithi008.flmjzp (mgr.14640) 4927 : cluster [DBG] pgmap v3379: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:01.636937+0000 mgr.smithi008.flmjzp (mgr.14640) 4927 : cluster [DBG] pgmap v3379: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:03.666538+0000 mon.smithi008 (mon.0) 5194 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:03.668659+0000 mon.smithi008 (mon.0) 5195 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:03.669697+0000 mon.smithi008 (mon.0) 5196 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:03.676002+0000 mon.smithi008 (mon.0) 5197 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:03.682396+0000 mon.smithi008 (mon.0) 5198 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:03.685470+0000 mon.smithi008 (mon.0) 5199 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:04.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:03.687259+0000 mon.smithi008 (mon.0) 5200 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:04.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:03.688902+0000 mon.smithi008 (mon.0) 5201 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:04.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:03.690831+0000 mon.smithi008 (mon.0) 5202 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:03.666538+0000 mon.smithi008 (mon.0) 5194 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:03.668659+0000 mon.smithi008 (mon.0) 5195 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:03.669697+0000 mon.smithi008 (mon.0) 5196 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:04.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:03.676002+0000 mon.smithi008 (mon.0) 5197 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:04.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:03.682396+0000 mon.smithi008 (mon.0) 5198 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:04.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:03.685470+0000 mon.smithi008 (mon.0) 5199 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:04.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:03.687259+0000 mon.smithi008 (mon.0) 5200 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:04.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:03.688902+0000 mon.smithi008 (mon.0) 5201 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:04.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:03.690831+0000 mon.smithi008 (mon.0) 5202 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:03.637569+0000 mgr.smithi008.flmjzp (mgr.14640) 4928 : cluster [DBG] pgmap v3380: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:03.670670+0000 mgr.smithi008.flmjzp (mgr.14640) 4929 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:03.671274+0000 mgr.smithi008.flmjzp (mgr.14640) 4930 : cluster [DBG] pgmap v3381: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:03.671617+0000 mgr.smithi008.flmjzp (mgr.14640) 4931 : cluster [DBG] pgmap v3382: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:03.692700+0000 mgr.smithi008.flmjzp (mgr.14640) 4932 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:03.637569+0000 mgr.smithi008.flmjzp (mgr.14640) 4928 : cluster [DBG] pgmap v3380: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:03.670670+0000 mgr.smithi008.flmjzp (mgr.14640) 4929 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:03.671274+0000 mgr.smithi008.flmjzp (mgr.14640) 4930 : cluster [DBG] pgmap v3381: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:03.671617+0000 mgr.smithi008.flmjzp (mgr.14640) 4931 : cluster [DBG] pgmap v3382: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:03.692700+0000 mgr.smithi008.flmjzp (mgr.14640) 4932 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:05.672205+0000 mgr.smithi008.flmjzp (mgr.14640) 4933 : cluster [DBG] pgmap v3383: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:05.672205+0000 mgr.smithi008.flmjzp (mgr.14640) 4933 : cluster [DBG] pgmap v3383: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:07.672969+0000 mgr.smithi008.flmjzp (mgr.14640) 4934 : cluster [DBG] pgmap v3384: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:07.672969+0000 mgr.smithi008.flmjzp (mgr.14640) 4934 : cluster [DBG] pgmap v3384: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:09.673561+0000 mgr.smithi008.flmjzp (mgr.14640) 4935 : cluster [DBG] pgmap v3385: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:09.673561+0000 mgr.smithi008.flmjzp (mgr.14640) 4935 : cluster [DBG] pgmap v3385: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:11.674128+0000 mgr.smithi008.flmjzp (mgr.14640) 4936 : cluster [DBG] pgmap v3386: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:11.674128+0000 mgr.smithi008.flmjzp (mgr.14640) 4936 : cluster [DBG] pgmap v3386: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:13.703513+0000 mon.smithi008 (mon.0) 5203 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:14.260616+0000 mon.smithi008 (mon.0) 5204 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:14.261411+0000 mon.smithi008 (mon.0) 5205 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:14.267072+0000 mon.smithi008 (mon.0) 5206 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:14.271909+0000 mon.smithi008 (mon.0) 5207 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:14.274191+0000 mon.smithi008 (mon.0) 5208 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:14.275665+0000 mon.smithi008 (mon.0) 5209 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:14.276921+0000 mon.smithi008 (mon.0) 5210 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:14.278766+0000 mon.smithi008 (mon.0) 5211 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:13.703513+0000 mon.smithi008 (mon.0) 5203 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:14.260616+0000 mon.smithi008 (mon.0) 5204 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:14.261411+0000 mon.smithi008 (mon.0) 5205 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:14.267072+0000 mon.smithi008 (mon.0) 5206 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:14.271909+0000 mon.smithi008 (mon.0) 5207 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:14.274191+0000 mon.smithi008 (mon.0) 5208 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:14.275665+0000 mon.smithi008 (mon.0) 5209 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:14.276921+0000 mon.smithi008 (mon.0) 5210 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:14.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:14.278766+0000 mon.smithi008 (mon.0) 5211 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:13.674777+0000 mgr.smithi008.flmjzp (mgr.14640) 4937 : cluster [DBG] pgmap v3387: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:14.262045+0000 mgr.smithi008.flmjzp (mgr.14640) 4938 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:14.262543+0000 mgr.smithi008.flmjzp (mgr.14640) 4939 : cluster [DBG] pgmap v3388: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:14.262768+0000 mgr.smithi008.flmjzp (mgr.14640) 4940 : cluster [DBG] pgmap v3389: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:14.280263+0000 mgr.smithi008.flmjzp (mgr.14640) 4941 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:13.674777+0000 mgr.smithi008.flmjzp (mgr.14640) 4937 : cluster [DBG] pgmap v3387: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:14.262045+0000 mgr.smithi008.flmjzp (mgr.14640) 4938 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:14.262543+0000 mgr.smithi008.flmjzp (mgr.14640) 4939 : cluster [DBG] pgmap v3388: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:14.262768+0000 mgr.smithi008.flmjzp (mgr.14640) 4940 : cluster [DBG] pgmap v3389: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:14.280263+0000 mgr.smithi008.flmjzp (mgr.14640) 4941 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:16.263276+0000 mgr.smithi008.flmjzp (mgr.14640) 4942 : cluster [DBG] pgmap v3390: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:16.263276+0000 mgr.smithi008.flmjzp (mgr.14640) 4942 : cluster [DBG] pgmap v3390: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:18.263865+0000 mgr.smithi008.flmjzp (mgr.14640) 4943 : cluster [DBG] pgmap v3391: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:18.263865+0000 mgr.smithi008.flmjzp (mgr.14640) 4943 : cluster [DBG] pgmap v3391: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:20.264462+0000 mgr.smithi008.flmjzp (mgr.14640) 4944 : cluster [DBG] pgmap v3392: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:20.264462+0000 mgr.smithi008.flmjzp (mgr.14640) 4944 : cluster [DBG] pgmap v3392: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:22.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.603+0000 7f79c906e700 1 -- 172.21.15.8:0/1410589520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c40f9690 msgr2=0x7f79c40fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:22.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.603+0000 7f79c906e700 1 --2- 172.21.15.8:0/1410589520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c40f9690 0x7f79c40fbae0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f79b8004660 tx=0x7f79b8009b30).stop 2023-10-18T22:21:22.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.603+0000 7f79c906e700 1 -- 172.21.15.8:0/1410589520 shutdown_connections 2023-10-18T22:21:22.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.603+0000 7f79c906e700 1 --2- 172.21.15.8:0/1410589520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c40f9690 0x7f79c40fbae0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:22.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.603+0000 7f79c906e700 1 --2- 172.21.15.8:0/1410589520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79c4060310 0x7f79c40f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:22.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.603+0000 7f79c906e700 1 -- 172.21.15.8:0/1410589520 >> 172.21.15.8:0/1410589520 conn(0x7f79c40f0b90 msgr2=0x7f79c40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:22.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.603+0000 7f79c906e700 1 -- 172.21.15.8:0/1410589520 shutdown_connections 2023-10-18T22:21:22.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.603+0000 7f79c906e700 1 -- 172.21.15.8:0/1410589520 wait complete. 2023-10-18T22:21:22.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.604+0000 7f79c906e700 1 Processor -- start 2023-10-18T22:21:22.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.604+0000 7f79c906e700 1 -- start start 2023-10-18T22:21:22.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.604+0000 7f79c906e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79c4060310 0x7f79c4108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:22.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.604+0000 7f79c906e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c40f9690 0x7f79c4109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:22.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.604+0000 7f79c906e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4109a20 con 0x7f79c40f9690 2023-10-18T22:21:22.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.604+0000 7f79c906e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4109b60 con 0x7f79c4060310 2023-10-18T22:21:22.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.605+0000 7f79c37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c40f9690 0x7f79c4109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:22.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.605+0000 7f79c37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c40f9690 0x7f79c4109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50740/0 (socket says 172.21.15.8:50740) 2023-10-18T22:21:22.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.605+0000 7f79c37fe700 1 -- 172.21.15.8:0/2075565829 learned_addr learned my addr 172.21.15.8:0/2075565829 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:22.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.605+0000 7f79c3fff700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79c4060310 0x7f79c4108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:22.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.605+0000 7f79c37fe700 1 -- 172.21.15.8:0/2075565829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79c4060310 msgr2=0x7f79c4108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:22.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.605+0000 7f79c37fe700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79c4060310 0x7f79c4108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:22.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.605+0000 7f79c37fe700 1 -- 172.21.15.8:0/2075565829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8005040 con 0x7f79c40f9690 2023-10-18T22:21:22.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.605+0000 7f79c37fe700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c40f9690 0x7f79c4109470 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f79b8007a60 tx=0x7f79b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:22.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.606+0000 7f79c0ff9700 1 -- 172.21.15.8:0/2075565829 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79b8018070 con 0x7f79c40f9690 2023-10-18T22:21:22.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.606+0000 7f79c0ff9700 1 -- 172.21.15.8:0/2075565829 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f79b8009630 con 0x7f79c40f9690 2023-10-18T22:21:22.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.606+0000 7f79c0ff9700 1 -- 172.21.15.8:0/2075565829 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79b801c4d0 con 0x7f79c40f9690 2023-10-18T22:21:22.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.606+0000 7f79c906e700 1 -- 172.21.15.8:0/2075565829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c410a4a0 con 0x7f79c40f9690 2023-10-18T22:21:22.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.606+0000 7f79c906e700 1 -- 172.21.15.8:0/2075565829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c410aa00 con 0x7f79c40f9690 2023-10-18T22:21:22.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.607+0000 7f79c906e700 1 -- 172.21.15.8:0/2075565829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c4045ad0 con 0x7f79c40f9690 2023-10-18T22:21:22.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.608+0000 7f79c0ff9700 1 -- 172.21.15.8:0/2075565829 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f79b801d420 con 0x7f79c40f9690 2023-10-18T22:21:22.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.609+0000 7f79c0ff9700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f79ac060f70 0x7f79ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:22.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.609+0000 7f79c0ff9700 1 -- 172.21.15.8:0/2075565829 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f79b807e4a0 con 0x7f79c40f9690 2023-10-18T22:21:22.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.609+0000 7f79c3fff700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f79ac060f70 0x7f79ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:22.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.610+0000 7f79c3fff700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f79ac060f70 0x7f79ac063430 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f79b4004c40 tx=0x7f79b400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.613+0000 7f79c0ff9700 1 -- 172.21.15.8:0/2075565829 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f79b8051bc0 con 0x7f79c40f9690 2023-10-18T22:21:22.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.809+0000 7f79c906e700 1 -- 172.21.15.8:0/2075565829 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79c40f5670 con 0x7f79ac060f70 2023-10-18T22:21:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.811+0000 7f79c0ff9700 1 -- 172.21.15.8:0/2075565829 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f79c40f5670 con 0x7f79ac060f70 2023-10-18T22:21:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 -- 172.21.15.8:0/2075565829 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f79ac060f70 msgr2=0x7f79ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f79ac060f70 0x7f79ac063430 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f79b4004c40 tx=0x7f79b400b040).stop 2023-10-18T22:21:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 -- 172.21.15.8:0/2075565829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c40f9690 msgr2=0x7f79c4109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c40f9690 0x7f79c4109470 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f79b8007a60 tx=0x7f79b8009b30).stop 2023-10-18T22:21:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 -- 172.21.15.8:0/2075565829 shutdown_connections 2023-10-18T22:21:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f79ac060f70 0x7f79ac063430 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79c4060310 0x7f79c4108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 --2- 172.21.15.8:0/2075565829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c40f9690 0x7f79c4109470 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 -- 172.21.15.8:0/2075565829 >> 172.21.15.8:0/2075565829 conn(0x7f79c40f0b90 msgr2=0x7f79c40f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:22.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 -- 172.21.15.8:0/2075565829 shutdown_connections 2023-10-18T22:21:22.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.813+0000 7f79c906e700 1 -- 172.21.15.8:0/2075565829 wait complete. 2023-10-18T22:21:22.830 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:21:22.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.951+0000 7f08fa86f700 1 -- 172.21.15.8:0/423767216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08f40f9690 msgr2=0x7f08f40fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:22.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.951+0000 7f08fa86f700 1 --2- 172.21.15.8:0/423767216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08f40f9690 0x7f08f40fbae0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7f08e4004660 tx=0x7f08e4009b30).stop 2023-10-18T22:21:22.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.951+0000 7f08fa86f700 1 -- 172.21.15.8:0/423767216 shutdown_connections 2023-10-18T22:21:22.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.951+0000 7f08fa86f700 1 --2- 172.21.15.8:0/423767216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08f40f9690 0x7f08f40fbae0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:22.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.951+0000 7f08fa86f700 1 --2- 172.21.15.8:0/423767216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4060310 0x7f08f40f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:22.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.951+0000 7f08fa86f700 1 -- 172.21.15.8:0/423767216 >> 172.21.15.8:0/423767216 conn(0x7f08f40f0b90 msgr2=0x7f08f40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:22.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.951+0000 7f08fa86f700 1 -- 172.21.15.8:0/423767216 shutdown_connections 2023-10-18T22:21:22.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.951+0000 7f08fa86f700 1 -- 172.21.15.8:0/423767216 wait complete. 2023-10-18T22:21:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.952+0000 7f08fa86f700 1 Processor -- start 2023-10-18T22:21:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.952+0000 7f08fa86f700 1 -- start start 2023-10-18T22:21:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08fa86f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08f4060310 0x7f08f4106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:22.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08fa86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f40f9690 0x7f08f4107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08fa86f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f4107840 con 0x7f08f4060310 2023-10-18T22:21:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08fa86f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f4108050 con 0x7f08f40f9690 2023-10-18T22:21:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08f986d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08f4060310 0x7f08f4106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08f986d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08f4060310 0x7f08f4106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50756/0 (socket says 172.21.15.8:50756) 2023-10-18T22:21:22.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08f986d700 1 -- 172.21.15.8:0/666428189 learned_addr learned my addr 172.21.15.8:0/666428189 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:22.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08f906c700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f40f9690 0x7f08f4107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:22.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08f986d700 1 -- 172.21.15.8:0/666428189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f40f9690 msgr2=0x7f08f4107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:22.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08f986d700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f40f9690 0x7f08f4107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:22.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.953+0000 7f08f986d700 1 -- 172.21.15.8:0/666428189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e4005040 con 0x7f08f4060310 2023-10-18T22:21:22.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.954+0000 7f08f986d700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08f4060310 0x7f08f4106d50 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f08f000e7f0 tx=0x7f08f000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:22.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.954+0000 7f08ea7fc700 1 -- 172.21.15.8:0/666428189 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f00092e0 con 0x7f08f4060310 2023-10-18T22:21:22.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.954+0000 7f08ea7fc700 1 -- 172.21.15.8:0/666428189 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f08f000f040 con 0x7f08f4060310 2023-10-18T22:21:22.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.954+0000 7f08ea7fc700 1 -- 172.21.15.8:0/666428189 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f00147e0 con 0x7f08f4060310 2023-10-18T22:21:22.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.954+0000 7f08fa86f700 1 -- 172.21.15.8:0/666428189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f41082d0 con 0x7f08f4060310 2023-10-18T22:21:22.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.954+0000 7f08fa86f700 1 -- 172.21.15.8:0/666428189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f4108810 con 0x7f08f4060310 2023-10-18T22:21:22.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.955+0000 7f08fa86f700 1 -- 172.21.15.8:0/666428189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f4059100 con 0x7f08f4060310 2023-10-18T22:21:22.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.956+0000 7f08ea7fc700 1 -- 172.21.15.8:0/666428189 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f08f001b030 con 0x7f08f4060310 2023-10-18T22:21:22.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.957+0000 7f08ea7fc700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f08e0060f70 0x7f08e0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:22.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.957+0000 7f08ea7fc700 1 -- 172.21.15.8:0/666428189 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f08f007c6b0 con 0x7f08f4060310 2023-10-18T22:21:22.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.957+0000 7f08f906c700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f08e0060f70 0x7f08e0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:22.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.958+0000 7f08f906c700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f08e0060f70 0x7f08e0063430 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f08e4009720 tx=0x7f08e4016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:22.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:22.961+0000 7f08ea7fc700 1 -- 172.21.15.8:0/666428189 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f08f004c310 con 0x7f08f4060310 2023-10-18T22:21:23.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.159+0000 7f08fa86f700 1 -- 172.21.15.8:0/666428189 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f08f40fedc0 con 0x7f08e0060f70 2023-10-18T22:21:23.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.160+0000 7f08ea7fc700 1 -- 172.21.15.8:0/666428189 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f08f40fedc0 con 0x7f08e0060f70 2023-10-18T22:21:23.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.162+0000 7f08fa86f700 1 -- 172.21.15.8:0/666428189 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f08e0060f70 msgr2=0x7f08e0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:23.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.162+0000 7f08fa86f700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f08e0060f70 0x7f08e0063430 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f08e4009720 tx=0x7f08e4016040).stop 2023-10-18T22:21:23.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.162+0000 7f08fa86f700 1 -- 172.21.15.8:0/666428189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08f4060310 msgr2=0x7f08f4106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:23.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.162+0000 7f08fa86f700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08f4060310 0x7f08f4106d50 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f08f000e7f0 tx=0x7f08f000b040).stop 2023-10-18T22:21:23.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.162+0000 7f08fa86f700 1 -- 172.21.15.8:0/666428189 shutdown_connections 2023-10-18T22:21:23.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.162+0000 7f08fa86f700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f08e0060f70 0x7f08e0063430 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.162+0000 7f08fa86f700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08f4060310 0x7f08f4106d50 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.162+0000 7f08fa86f700 1 --2- 172.21.15.8:0/666428189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f40f9690 0x7f08f4107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.162+0000 7f08fa86f700 1 -- 172.21.15.8:0/666428189 >> 172.21.15.8:0/666428189 conn(0x7f08f40f0b90 msgr2=0x7f08f40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:23.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.162+0000 7f08fa86f700 1 -- 172.21.15.8:0/666428189 shutdown_connections 2023-10-18T22:21:23.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.163+0000 7f08fa86f700 1 -- 172.21.15.8:0/666428189 wait complete. 2023-10-18T22:21:23.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.299+0000 7f9b08b2a700 1 -- 172.21.15.8:0/1663325653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f77d0 msgr2=0x7f9b040f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:23.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.299+0000 7f9b08b2a700 1 --2- 172.21.15.8:0/1663325653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f77d0 0x7f9b040f7c30 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f9af8004660 tx=0x7f9af8009b30).stop 2023-10-18T22:21:23.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.299+0000 7f9b08b2a700 1 -- 172.21.15.8:0/1663325653 shutdown_connections 2023-10-18T22:21:23.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.299+0000 7f9b08b2a700 1 --2- 172.21.15.8:0/1663325653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f77d0 0x7f9b040f7c30 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.299+0000 7f9b08b2a700 1 --2- 172.21.15.8:0/1663325653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f6530 0x7f9b040f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.299+0000 7f9b08b2a700 1 -- 172.21.15.8:0/1663325653 >> 172.21.15.8:0/1663325653 conn(0x7f9b040f1c90 msgr2=0x7f9b040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:23.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.299+0000 7f9b08b2a700 1 -- 172.21.15.8:0/1663325653 shutdown_connections 2023-10-18T22:21:23.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.299+0000 7f9b08b2a700 1 -- 172.21.15.8:0/1663325653 wait complete. 2023-10-18T22:21:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.300+0000 7f9b08b2a700 1 Processor -- start 2023-10-18T22:21:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.300+0000 7f9b08b2a700 1 -- start start 2023-10-18T22:21:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.300+0000 7f9b08b2a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.301+0000 7f9b08b2a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 0x7f9b04069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.301+0000 7f9b08b2a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0406a380 con 0x7f9b040f6530 2023-10-18T22:21:23.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.301+0000 7f9b08b2a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0406a4c0 con 0x7f9b040f77d0 2023-10-18T22:21:23.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.301+0000 7f9b037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:23.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.301+0000 7f9b037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50776/0 (socket says 172.21.15.8:50776) 2023-10-18T22:21:23.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.301+0000 7f9b037fe700 1 -- 172.21.15.8:0/894850224 learned_addr learned my addr 172.21.15.8:0/894850224 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:23.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.301+0000 7f9b02ffd700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 0x7f9b04069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.301+0000 7f9b037fe700 1 -- 172.21.15.8:0/894850224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 msgr2=0x7f9b04069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.301+0000 7f9b037fe700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 0x7f9b04069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.301+0000 7f9b037fe700 1 -- 172.21.15.8:0/894850224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8005040 con 0x7f9b040f6530 2023-10-18T22:21:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.302+0000 7f9b037fe700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7f9af400e7c0 tx=0x7f9af400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.302+0000 7f9aebfff700 1 -- 172.21.15.8:0/894850224 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af40092e0 con 0x7f9b040f6530 2023-10-18T22:21:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.302+0000 7f9aebfff700 1 -- 172.21.15.8:0/894850224 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9af400f040 con 0x7f9b040f6530 2023-10-18T22:21:23.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.302+0000 7f9b08b2a700 1 -- 172.21.15.8:0/894850224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0406a7a0 con 0x7f9b040f6530 2023-10-18T22:21:23.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.302+0000 7f9aebfff700 1 -- 172.21.15.8:0/894850224 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af4014810 con 0x7f9b040f6530 2023-10-18T22:21:23.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.302+0000 7f9b08b2a700 1 -- 172.21.15.8:0/894850224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0410ecc0 con 0x7f9b040f6530 2023-10-18T22:21:23.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.303+0000 7f9b08b2a700 1 -- 172.21.15.8:0/894850224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b04045ad0 con 0x7f9b040f6530 2023-10-18T22:21:23.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.304+0000 7f9aebfff700 1 -- 172.21.15.8:0/894850224 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9af401b030 con 0x7f9b040f6530 2023-10-18T22:21:23.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.305+0000 7f9aebfff700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 0x7f9aec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:23.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.305+0000 7f9aebfff700 1 -- 172.21.15.8:0/894850224 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9af407c7c0 con 0x7f9b040f6530 2023-10-18T22:21:23.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.305+0000 7f9b02ffd700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 0x7f9aec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:23.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.306+0000 7f9b02ffd700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 0x7f9aec063430 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f9af8009720 tx=0x7f9af8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.309+0000 7f9aebfff700 1 -- 172.21.15.8:0/894850224 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9af404c430 con 0x7f9b040f6530 2023-10-18T22:21:23.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.504+0000 7f9b08b2a700 1 -- 172.21.15.8:0/894850224 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b040fee30 con 0x7f9aec060f70 2023-10-18T22:21:23.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.514+0000 7f9aebfff700 1 -- 172.21.15.8:0/894850224 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9b040fee30 con 0x7f9aec060f70 2023-10-18T22:21:23.517 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:21:23.517 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (88m) 5m ago 89m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:21:23.517 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (81m) 5m ago 89m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:21:23.517 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (81m) 3m ago 88m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:21:23.518 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (87m) 5m ago 89m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:21:23.518 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 85m - - 2023-10-18T22:21:23.518 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 85m - - 2023-10-18T22:21:23.519 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 85m - - 2023-10-18T22:21:23.519 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 85m - - 2023-10-18T22:21:23.519 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (83m) 5m ago 90m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:21:23.520 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (82m) 3m ago 88m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:21:23.520 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (82m) 5m ago 90m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:21:23.520 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (82m) 3m ago 88m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:21:23.520 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (89m) 5m ago 89m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:21:23.521 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (88m) 3m ago 88m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:21:23.521 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (81m) 5m ago 88m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:21:23.521 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (79m) 5m ago 87m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:21:23.521 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (79m) 5m ago 87m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:21:23.521 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (78m) 3m ago 87m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:21:23.522 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (77m) 3m ago 86m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:21:23.522 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (77m) 3m ago 86m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:21:23.522 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (83m) 5m ago 88m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:21:23.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 -- 172.21.15.8:0/894850224 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 msgr2=0x7f9aec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:23.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 0x7f9aec063430 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f9af8009720 tx=0x7f9af8016040).stop 2023-10-18T22:21:23.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 -- 172.21.15.8:0/894850224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 msgr2=0x7f9b0406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:23.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7f9af400e7c0 tx=0x7f9af400b040).stop 2023-10-18T22:21:23.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 -- 172.21.15.8:0/894850224 shutdown_connections 2023-10-18T22:21:23.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9aec060f70 0x7f9aec063430 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b040f6530 0x7f9b0406b9a0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 --2- 172.21.15.8:0/894850224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b040f77d0 0x7f9b04069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 -- 172.21.15.8:0/894850224 >> 172.21.15.8:0/894850224 conn(0x7f9b040f1c90 msgr2=0x7f9b040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:23.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 -- 172.21.15.8:0/894850224 shutdown_connections 2023-10-18T22:21:23.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.516+0000 7f9b08b2a700 1 -- 172.21.15.8:0/894850224 wait complete. 2023-10-18T22:21:23.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.651+0000 7f2ab95e9700 1 -- 172.21.15.8:0/1345866818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ab40f77d0 msgr2=0x7f2ab40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:23.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.651+0000 7f2ab95e9700 1 --2- 172.21.15.8:0/1345866818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ab40f77d0 0x7f2ab40f7c30 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f2aa8004660 tx=0x7f2aa8009b30).stop 2023-10-18T22:21:23.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.651+0000 7f2ab95e9700 1 -- 172.21.15.8:0/1345866818 shutdown_connections 2023-10-18T22:21:23.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.651+0000 7f2ab95e9700 1 --2- 172.21.15.8:0/1345866818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ab40f77d0 0x7f2ab40f7c30 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.651+0000 7f2ab95e9700 1 --2- 172.21.15.8:0/1345866818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ab40f6530 0x7f2ab40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.651+0000 7f2ab95e9700 1 -- 172.21.15.8:0/1345866818 >> 172.21.15.8:0/1345866818 conn(0x7f2ab40f1c90 msgr2=0x7f2ab40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:23.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.651+0000 7f2ab95e9700 1 -- 172.21.15.8:0/1345866818 shutdown_connections 2023-10-18T22:21:23.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.651+0000 7f2ab95e9700 1 -- 172.21.15.8:0/1345866818 wait complete. 2023-10-18T22:21:23.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.652+0000 7f2ab95e9700 1 Processor -- start 2023-10-18T22:21:23.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.652+0000 7f2ab95e9700 1 -- start start 2023-10-18T22:21:23.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab95e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ab40f6530 0x7f2ab4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:23.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab95e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ab40f77d0 0x7f2ab4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:23.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab95e9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab4107880 con 0x7f2ab40f77d0 2023-10-18T22:21:23.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab95e9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab41080c0 con 0x7f2ab40f6530 2023-10-18T22:21:23.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ab40f77d0 0x7f2ab4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:23.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ab40f77d0 0x7f2ab4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50800/0 (socket says 172.21.15.8:50800) 2023-10-18T22:21:23.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab37fe700 1 -- 172.21.15.8:0/146071061 learned_addr learned my addr 172.21.15.8:0/146071061 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:23.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab3fff700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ab40f6530 0x7f2ab4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:23.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab37fe700 1 -- 172.21.15.8:0/146071061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ab40f6530 msgr2=0x7f2ab4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:23.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab37fe700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ab40f6530 0x7f2ab4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab37fe700 1 -- 172.21.15.8:0/146071061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa8005040 con 0x7f2ab40f77d0 2023-10-18T22:21:23.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab3fff700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ab40f6530 0x7f2ab4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:21:23.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.653+0000 7f2ab37fe700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ab40f77d0 0x7f2ab4107280 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f2aa8009f50 tx=0x7f2aa8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:23.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.654+0000 7f2ab0ff9700 1 -- 172.21.15.8:0/146071061 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa8018070 con 0x7f2ab40f77d0 2023-10-18T22:21:23.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.654+0000 7f2ab95e9700 1 -- 172.21.15.8:0/146071061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab4108340 con 0x7f2ab40f77d0 2023-10-18T22:21:23.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.654+0000 7f2ab0ff9700 1 -- 172.21.15.8:0/146071061 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2aa8009630 con 0x7f2ab40f77d0 2023-10-18T22:21:23.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.654+0000 7f2ab0ff9700 1 -- 172.21.15.8:0/146071061 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa801c3c0 con 0x7f2ab40f77d0 2023-10-18T22:21:23.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.654+0000 7f2ab95e9700 1 -- 172.21.15.8:0/146071061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab4108820 con 0x7f2ab40f77d0 2023-10-18T22:21:23.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.655+0000 7f2ab95e9700 1 -- 172.21.15.8:0/146071061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab4059100 con 0x7f2ab40f77d0 2023-10-18T22:21:23.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.656+0000 7f2ab0ff9700 1 -- 172.21.15.8:0/146071061 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2aa801d420 con 0x7f2ab40f77d0 2023-10-18T22:21:23.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.657+0000 7f2ab0ff9700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a9c060f70 0x7f2a9c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:23.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.657+0000 7f2ab0ff9700 1 -- 172.21.15.8:0/146071061 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2aa807e650 con 0x7f2ab40f77d0 2023-10-18T22:21:23.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.657+0000 7f2ab3fff700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a9c060f70 0x7f2a9c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:23.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.658+0000 7f2ab3fff700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a9c060f70 0x7f2a9c063430 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f2aa4009fd0 tx=0x7f2aa400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:23.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.661+0000 7f2ab0ff9700 1 -- 172.21.15.8:0/146071061 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2aa804e2c0 con 0x7f2ab40f77d0 2023-10-18T22:21:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:22.265233+0000 mgr.smithi008.flmjzp (mgr.14640) 4945 : cluster [DBG] pgmap v3393: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:22.265233+0000 mgr.smithi008.flmjzp (mgr.14640) 4945 : cluster [DBG] pgmap v3393: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:23.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.919+0000 7f2ab95e9700 1 -- 172.21.15.8:0/146071061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ab4045ad0 con 0x7f2ab40f77d0 2023-10-18T22:21:23.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.919+0000 7f2ab0ff9700 1 -- 172.21.15.8:0/146071061 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f2aa80518e0 con 0x7f2ab40f77d0 2023-10-18T22:21:23.922 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:21:23.922 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:21:23.922 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:21:23.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:21:23.923 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:21:23.923 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:21:23.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:21:23.924 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:21:23.924 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:21:23.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:21:23.924 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:21:23.925 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:21:23.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:21:23.925 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:21:23.925 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:21:23.926 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:21:23.926 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:21:23.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.921+0000 7f2ab95e9700 1 -- 172.21.15.8:0/146071061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a9c060f70 msgr2=0x7f2a9c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:23.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.921+0000 7f2ab95e9700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a9c060f70 0x7f2a9c063430 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f2aa4009fd0 tx=0x7f2aa400b040).stop 2023-10-18T22:21:23.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.921+0000 7f2ab95e9700 1 -- 172.21.15.8:0/146071061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ab40f77d0 msgr2=0x7f2ab4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:23.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.921+0000 7f2ab95e9700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ab40f77d0 0x7f2ab4107280 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f2aa8009f50 tx=0x7f2aa8009b30).stop 2023-10-18T22:21:23.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.921+0000 7f2ab95e9700 1 -- 172.21.15.8:0/146071061 shutdown_connections 2023-10-18T22:21:23.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.921+0000 7f2ab95e9700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a9c060f70 0x7f2a9c063430 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.921+0000 7f2ab95e9700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ab40f6530 0x7f2ab4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.921+0000 7f2ab95e9700 1 --2- 172.21.15.8:0/146071061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ab40f77d0 0x7f2ab4107280 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:23.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.921+0000 7f2ab95e9700 1 -- 172.21.15.8:0/146071061 >> 172.21.15.8:0/146071061 conn(0x7f2ab40f1c90 msgr2=0x7f2ab40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:23.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.921+0000 7f2ab95e9700 1 -- 172.21.15.8:0/146071061 shutdown_connections 2023-10-18T22:21:23.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:23.922+0000 7f2ab95e9700 1 -- 172.21.15.8:0/146071061 wait complete. 2023-10-18T22:21:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.058+0000 7f4d7b15b700 1 -- 172.21.15.8:0/1486229322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d740f6530 msgr2=0x7f4d740f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.058+0000 7f4d7b15b700 1 --2- 172.21.15.8:0/1486229322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d740f6530 0x7f4d740f6950 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f4d70004660 tx=0x7f4d70009b30).stop 2023-10-18T22:21:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.058+0000 7f4d7b15b700 1 -- 172.21.15.8:0/1486229322 shutdown_connections 2023-10-18T22:21:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.058+0000 7f4d7b15b700 1 --2- 172.21.15.8:0/1486229322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d740f77d0 0x7f4d740f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.058+0000 7f4d7b15b700 1 --2- 172.21.15.8:0/1486229322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d740f6530 0x7f4d740f6950 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.058+0000 7f4d7b15b700 1 -- 172.21.15.8:0/1486229322 >> 172.21.15.8:0/1486229322 conn(0x7f4d740f1c90 msgr2=0x7f4d740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.058+0000 7f4d7b15b700 1 -- 172.21.15.8:0/1486229322 shutdown_connections 2023-10-18T22:21:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.058+0000 7f4d7b15b700 1 -- 172.21.15.8:0/1486229322 wait complete. 2023-10-18T22:21:24.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.059+0000 7f4d7b15b700 1 Processor -- start 2023-10-18T22:21:24.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.059+0000 7f4d7b15b700 1 -- start start 2023-10-18T22:21:24.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d7b15b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d740f6530 0x7f4d7406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d7b15b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d740f77d0 0x7f4d74069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d7b15b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7406a380 con 0x7f4d740f77d0 2023-10-18T22:21:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d7b15b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7406a4c0 con 0x7f4d740f6530 2023-10-18T22:21:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d79958700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d740f77d0 0x7f4d74069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d79958700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d740f77d0 0x7f4d74069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50818/0 (socket says 172.21.15.8:50818) 2023-10-18T22:21:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d79958700 1 -- 172.21.15.8:0/4187400839 learned_addr learned my addr 172.21.15.8:0/4187400839 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d7a159700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d740f6530 0x7f4d7406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d79958700 1 -- 172.21.15.8:0/4187400839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d740f6530 msgr2=0x7f4d7406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d79958700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d740f6530 0x7f4d7406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d79958700 1 -- 172.21.15.8:0/4187400839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70005040 con 0x7f4d740f77d0 2023-10-18T22:21:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.060+0000 7f4d79958700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d740f77d0 0x7f4d74069e20 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f4d6400e7f0 tx=0x7f4d6400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.061+0000 7f4d6affd700 1 -- 172.21.15.8:0/4187400839 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d640092e0 con 0x7f4d740f77d0 2023-10-18T22:21:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.061+0000 7f4d7b15b700 1 -- 172.21.15.8:0/4187400839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7406a7a0 con 0x7f4d740f77d0 2023-10-18T22:21:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.061+0000 7f4d6affd700 1 -- 172.21.15.8:0/4187400839 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4d6400f040 con 0x7f4d740f77d0 2023-10-18T22:21:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.061+0000 7f4d6affd700 1 -- 172.21.15.8:0/4187400839 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d640147e0 con 0x7f4d740f77d0 2023-10-18T22:21:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.061+0000 7f4d7b15b700 1 -- 172.21.15.8:0/4187400839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7410ed60 con 0x7f4d740f77d0 2023-10-18T22:21:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.062+0000 7f4d7b15b700 1 -- 172.21.15.8:0/4187400839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d74059100 con 0x7f4d740f77d0 2023-10-18T22:21:24.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.063+0000 7f4d6affd700 1 -- 172.21.15.8:0/4187400839 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4d6401b030 con 0x7f4d740f77d0 2023-10-18T22:21:24.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.064+0000 7f4d6affd700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d60060f70 0x7f4d60063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:24.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.064+0000 7f4d6affd700 1 -- 172.21.15.8:0/4187400839 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4d6407c730 con 0x7f4d740f77d0 2023-10-18T22:21:24.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.064+0000 7f4d7a159700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d60060f70 0x7f4d60063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:24.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.064+0000 7f4d7a159700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d60060f70 0x7f4d60063430 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f4d700043d0 tx=0x7f4d7000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:24.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.068+0000 7f4d6affd700 1 -- 172.21.15.8:0/4187400839 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4d6404c450 con 0x7f4d740f77d0 2023-10-18T22:21:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.297+0000 7f4d7b15b700 1 -- 172.21.15.8:0/4187400839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4d740fed80 con 0x7f4d740f77d0 2023-10-18T22:21:24.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.298+0000 7f4d6affd700 1 -- 172.21.15.8:0/4187400839 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f4d64019070 con 0x7f4d740f77d0 2023-10-18T22:21:24.300 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:21:24.301 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:21:24.301 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:21:24.301 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:21:24.301 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:21:24.302 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:21:24.302 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:21:24.302 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:21:24.302 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:21:24.303 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:21:24.303 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:21:24.303 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:21:24.303 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:21:24.303 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:21:24.304 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:21:24.304 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:21:24.304 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:21:24.304 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:21:24.304 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:21:24.305 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:21:24.305 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:21:24.305 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:21:24.306 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:21:24.306 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:21:24.306 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:21:24.306 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:21:24.307 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:21:24.307 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:21:24.307 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:21:24.307 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:21:24.307 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:21:24.308 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:21:24.308 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:21:24.308 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:21:24.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 -- 172.21.15.8:0/4187400839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d60060f70 msgr2=0x7f4d60063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:24.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d60060f70 0x7f4d60063430 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f4d700043d0 tx=0x7f4d7000b040).stop 2023-10-18T22:21:24.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 -- 172.21.15.8:0/4187400839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d740f77d0 msgr2=0x7f4d74069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:24.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d740f77d0 0x7f4d74069e20 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f4d6400e7f0 tx=0x7f4d6400b040).stop 2023-10-18T22:21:24.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 -- 172.21.15.8:0/4187400839 shutdown_connections 2023-10-18T22:21:24.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d60060f70 0x7f4d60063430 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d740f6530 0x7f4d7406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 --2- 172.21.15.8:0/4187400839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d740f77d0 0x7f4d74069e20 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 -- 172.21.15.8:0/4187400839 >> 172.21.15.8:0/4187400839 conn(0x7f4d740f1c90 msgr2=0x7f4d740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:24.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 -- 172.21.15.8:0/4187400839 shutdown_connections 2023-10-18T22:21:24.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.300+0000 7f4d7b15b700 1 -- 172.21.15.8:0/4187400839 wait complete. 2023-10-18T22:21:24.312 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:21:24.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.440+0000 7fdac0aa7700 1 -- 172.21.15.8:0/566158521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdabc0f77d0 msgr2=0x7fdabc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:24.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.440+0000 7fdac0aa7700 1 --2- 172.21.15.8:0/566158521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdabc0f77d0 0x7fdabc0f7c30 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fdab0004660 tx=0x7fdab0009b30).stop 2023-10-18T22:21:24.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.440+0000 7fdac0aa7700 1 -- 172.21.15.8:0/566158521 shutdown_connections 2023-10-18T22:21:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.440+0000 7fdac0aa7700 1 --2- 172.21.15.8:0/566158521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdabc0f77d0 0x7fdabc0f7c30 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.440+0000 7fdac0aa7700 1 --2- 172.21.15.8:0/566158521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdabc0f6530 0x7fdabc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:21:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.440+0000 7fdac0aa7700 1 -- 172.21.15.8:0/566158521 >> 172.21.15.8:0/566158521 conn(0x7fdabc0f1c90 msgr2=0x7fdabc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.440+0000 7fdac0aa7700 1 -- 172.21.15.8:0/566158521 shutdown_connections 2023-10-18T22:21:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.440+0000 7fdac0aa7700 1 -- 172.21.15.8:0/566158521 wait complete. 2023-10-18T22:21:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.442+0000 7fdac0aa7700 1 Processor -- start 2023-10-18T22:21:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.442+0000 7fdac0aa7700 1 -- start start 2023-10-18T22:21:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.442+0000 7fdac0aa7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdabc0f6530 0x7fdabc108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.442+0000 7fdac0aa7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdabc0f77d0 0x7fdabc109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.442+0000 7fdac0aa7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc109ad0 con 0x7fdabc0f6530 2023-10-18T22:21:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.442+0000 7fdac0aa7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc10a380 con 0x7fdabc0f77d0 2023-10-18T22:21:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.443+0000 7fdabb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdabc0f6530 0x7fdabc108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.443+0000 7fdabb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdabc0f6530 0x7fdabc108fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50834/0 (socket says 172.21.15.8:50834) 2023-10-18T22:21:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.443+0000 7fdabb7fe700 1 -- 172.21.15.8:0/2973043434 learned_addr learned my addr 172.21.15.8:0/2973043434 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.443+0000 7fdabaffd700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdabc0f77d0 0x7fdabc109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.443+0000 7fdabb7fe700 1 -- 172.21.15.8:0/2973043434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdabc0f77d0 msgr2=0x7fdabc109490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.443+0000 7fdabb7fe700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdabc0f77d0 0x7fdabc109490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.443+0000 7fdabb7fe700 1 -- 172.21.15.8:0/2973043434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab0005040 con 0x7fdabc0f6530 2023-10-18T22:21:24.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.443+0000 7fdabb7fe700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdabc0f6530 0x7fdabc108fa0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7fdaac0093f0 tx=0x7fdaac006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.444+0000 7fdaa3fff700 1 -- 172.21.15.8:0/2973043434 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaac009ea0 con 0x7fdabc0f6530 2023-10-18T22:21:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.444+0000 7fdaa3fff700 1 -- 172.21.15.8:0/2973043434 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdaac013b00 con 0x7fdabc0f6530 2023-10-18T22:21:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.444+0000 7fdaa3fff700 1 -- 172.21.15.8:0/2973043434 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaac00dbf0 con 0x7fdabc0f6530 2023-10-18T22:21:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.444+0000 7fdac0aa7700 1 -- 172.21.15.8:0/2973043434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc10a660 con 0x7fdabc0f6530 2023-10-18T22:21:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.444+0000 7fdac0aa7700 1 -- 172.21.15.8:0/2973043434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc10ac20 con 0x7fdabc0f6530 2023-10-18T22:21:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.445+0000 7fdac0aa7700 1 -- 172.21.15.8:0/2973043434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc059100 con 0x7fdabc0f6530 2023-10-18T22:21:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.446+0000 7fdaa3fff700 1 -- 172.21.15.8:0/2973043434 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdaac01a060 con 0x7fdabc0f6530 2023-10-18T22:21:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.447+0000 7fdaa3fff700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdaa4060f70 0x7fdaa4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.447+0000 7fdaa3fff700 1 -- 172.21.15.8:0/2973043434 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdaac07c910 con 0x7fdabc0f6530 2023-10-18T22:21:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.447+0000 7fdabaffd700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdaa4060f70 0x7fdaa4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.448+0000 7fdabaffd700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdaa4060f70 0x7fdaa4063430 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fdab0009490 tx=0x7fdab0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:24.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.451+0000 7fdaa3fff700 1 -- 172.21.15.8:0/2973043434 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdaac04ffc0 con 0x7fdabc0f6530 2023-10-18T22:21:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.651+0000 7fdac0aa7700 1 -- 172.21.15.8:0/2973043434 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdabc0fedd0 con 0x7fdaa4060f70 2023-10-18T22:21:24.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.653+0000 7fdaa3fff700 1 -- 172.21.15.8:0/2973043434 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdabc0fedd0 con 0x7fdaa4060f70 2023-10-18T22:21:24.655 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:21:24.655 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:21:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:21:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:21:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:21:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:21:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:21:24.657 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:21:24.657 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:21:24.657 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:21:24.657 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:21:24.657 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:21:24.658 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:21:24.658 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:21:24.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 -- 172.21.15.8:0/2973043434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdaa4060f70 msgr2=0x7fdaa4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:24.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdaa4060f70 0x7fdaa4063430 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fdab0009490 tx=0x7fdab0009b30).stop 2023-10-18T22:21:24.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 -- 172.21.15.8:0/2973043434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdabc0f6530 msgr2=0x7fdabc108fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:24.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdabc0f6530 0x7fdabc108fa0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7fdaac0093f0 tx=0x7fdaac006ec0).stop 2023-10-18T22:21:24.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 -- 172.21.15.8:0/2973043434 shutdown_connections 2023-10-18T22:21:24.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdaa4060f70 0x7fdaa4063430 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdabc0f6530 0x7fdabc108fa0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 --2- 172.21.15.8:0/2973043434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdabc0f77d0 0x7fdabc109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:24.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 -- 172.21.15.8:0/2973043434 >> 172.21.15.8:0/2973043434 conn(0x7fdabc0f1c90 msgr2=0x7fdabc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:24.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 -- 172.21.15.8:0/2973043434 shutdown_connections 2023-10-18T22:21:24.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:24.655+0000 7fdac0aa7700 1 -- 172.21.15.8:0/2973043434 wait complete. 2023-10-18T22:21:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:22.812055+0000 mgr.smithi008.flmjzp (mgr.14640) 4946 : audit [DBG] from='client.37960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:23.161730+0000 mgr.smithi008.flmjzp (mgr.14640) 4947 : audit [DBG] from='client.37964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:23.920840+0000 mon.smithi008 (mon.0) 5212 : audit [DBG] from='client.? 172.21.15.8:0/146071061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.287898+0000 mon.smithi008 (mon.0) 5213 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.289503+0000 mon.smithi008 (mon.0) 5214 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.290165+0000 mon.smithi008 (mon.0) 5215 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:24.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.295433+0000 mon.smithi008 (mon.0) 5216 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:24.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.299373+0000 mon.smithi008 (mon.0) 5217 : audit [DBG] from='client.? 172.21.15.8:0/4187400839' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:21:24.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.300699+0000 mon.smithi008 (mon.0) 5218 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:24.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.303535+0000 mon.smithi008 (mon.0) 5219 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:24.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.304895+0000 mon.smithi008 (mon.0) 5220 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:24.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.306188+0000 mon.smithi008 (mon.0) 5221 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:24.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.307768+0000 mon.smithi008 (mon.0) 5222 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:22.812055+0000 mgr.smithi008.flmjzp (mgr.14640) 4946 : audit [DBG] from='client.37960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:23.161730+0000 mgr.smithi008.flmjzp (mgr.14640) 4947 : audit [DBG] from='client.37964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:23.920840+0000 mon.smithi008 (mon.0) 5212 : audit [DBG] from='client.? 172.21.15.8:0/146071061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.287898+0000 mon.smithi008 (mon.0) 5213 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.289503+0000 mon.smithi008 (mon.0) 5214 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.290165+0000 mon.smithi008 (mon.0) 5215 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.295433+0000 mon.smithi008 (mon.0) 5216 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:24.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.299373+0000 mon.smithi008 (mon.0) 5217 : audit [DBG] from='client.? 172.21.15.8:0/4187400839' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:21:24.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.300699+0000 mon.smithi008 (mon.0) 5218 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:24.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.303535+0000 mon.smithi008 (mon.0) 5219 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:24.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.304895+0000 mon.smithi008 (mon.0) 5220 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:24.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.306188+0000 mon.smithi008 (mon.0) 5221 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:24.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.307768+0000 mon.smithi008 (mon.0) 5222 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:23.506744+0000 mgr.smithi008.flmjzp (mgr.14640) 4948 : audit [DBG] from='client.37968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:24.265647+0000 mgr.smithi008.flmjzp (mgr.14640) 4949 : cluster [DBG] pgmap v3394: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:24.290781+0000 mgr.smithi008.flmjzp (mgr.14640) 4950 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:24.291240+0000 mgr.smithi008.flmjzp (mgr.14640) 4951 : cluster [DBG] pgmap v3395: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:25.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:24.291533+0000 mgr.smithi008.flmjzp (mgr.14640) 4952 : cluster [DBG] pgmap v3396: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:25.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:24.309544+0000 mgr.smithi008.flmjzp (mgr.14640) 4953 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:23.506744+0000 mgr.smithi008.flmjzp (mgr.14640) 4948 : audit [DBG] from='client.37968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:24.265647+0000 mgr.smithi008.flmjzp (mgr.14640) 4949 : cluster [DBG] pgmap v3394: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:24.290781+0000 mgr.smithi008.flmjzp (mgr.14640) 4950 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:24.291240+0000 mgr.smithi008.flmjzp (mgr.14640) 4951 : cluster [DBG] pgmap v3395: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:24.291533+0000 mgr.smithi008.flmjzp (mgr.14640) 4952 : cluster [DBG] pgmap v3396: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:25.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:24.309544+0000 mgr.smithi008.flmjzp (mgr.14640) 4953 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:24.654176+0000 mgr.smithi008.flmjzp (mgr.14640) 4954 : audit [DBG] from='client.37980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:24.654176+0000 mgr.smithi008.flmjzp (mgr.14640) 4954 : audit [DBG] from='client.37980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:26.292164+0000 mgr.smithi008.flmjzp (mgr.14640) 4955 : cluster [DBG] pgmap v3397: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:26.292164+0000 mgr.smithi008.flmjzp (mgr.14640) 4955 : cluster [DBG] pgmap v3397: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:29.743 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:28.292802+0000 mgr.smithi008.flmjzp (mgr.14640) 4956 : cluster [DBG] pgmap v3398: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:28.292802+0000 mgr.smithi008.flmjzp (mgr.14640) 4956 : cluster [DBG] pgmap v3398: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:30.293527+0000 mgr.smithi008.flmjzp (mgr.14640) 4957 : cluster [DBG] pgmap v3399: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:30.293527+0000 mgr.smithi008.flmjzp (mgr.14640) 4957 : cluster [DBG] pgmap v3399: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:32.293976+0000 mgr.smithi008.flmjzp (mgr.14640) 4958 : cluster [DBG] pgmap v3400: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:33.848 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:32.293976+0000 mgr.smithi008.flmjzp (mgr.14640) 4958 : cluster [DBG] pgmap v3400: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:34.319545+0000 mon.smithi008 (mon.0) 5223 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:34.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:34.319545+0000 mon.smithi008 (mon.0) 5223 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:34.294640+0000 mgr.smithi008.flmjzp (mgr.14640) 4959 : cluster [DBG] pgmap v3401: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:34.880092+0000 mon.smithi008 (mon.0) 5224 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:34.881253+0000 mon.smithi008 (mon.0) 5225 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:34.888300+0000 mon.smithi008 (mon.0) 5226 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:35.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:34.895029+0000 mon.smithi008 (mon.0) 5227 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:35.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:34.898629+0000 mon.smithi008 (mon.0) 5228 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:35.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:34.900810+0000 mon.smithi008 (mon.0) 5229 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:35.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:34.902767+0000 mon.smithi008 (mon.0) 5230 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:35.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:34.905439+0000 mon.smithi008 (mon.0) 5231 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:34.294640+0000 mgr.smithi008.flmjzp (mgr.14640) 4959 : cluster [DBG] pgmap v3401: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:34.880092+0000 mon.smithi008 (mon.0) 5224 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:34.881253+0000 mon.smithi008 (mon.0) 5225 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:34.888300+0000 mon.smithi008 (mon.0) 5226 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:34.895029+0000 mon.smithi008 (mon.0) 5227 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:34.898629+0000 mon.smithi008 (mon.0) 5228 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:34.900810+0000 mon.smithi008 (mon.0) 5229 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:35.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:34.902767+0000 mon.smithi008 (mon.0) 5230 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:35.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:34.905439+0000 mon.smithi008 (mon.0) 5231 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:34.882139+0000 mgr.smithi008.flmjzp (mgr.14640) 4960 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:34.882825+0000 mgr.smithi008.flmjzp (mgr.14640) 4961 : cluster [DBG] pgmap v3402: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:34.883173+0000 mgr.smithi008.flmjzp (mgr.14640) 4962 : cluster [DBG] pgmap v3403: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:34.907659+0000 mgr.smithi008.flmjzp (mgr.14640) 4963 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:34.882139+0000 mgr.smithi008.flmjzp (mgr.14640) 4960 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:34.882825+0000 mgr.smithi008.flmjzp (mgr.14640) 4961 : cluster [DBG] pgmap v3402: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:34.883173+0000 mgr.smithi008.flmjzp (mgr.14640) 4962 : cluster [DBG] pgmap v3403: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:34.907659+0000 mgr.smithi008.flmjzp (mgr.14640) 4963 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:36.883876+0000 mgr.smithi008.flmjzp (mgr.14640) 4964 : cluster [DBG] pgmap v3404: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:36.883876+0000 mgr.smithi008.flmjzp (mgr.14640) 4964 : cluster [DBG] pgmap v3404: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:38.884613+0000 mgr.smithi008.flmjzp (mgr.14640) 4965 : cluster [DBG] pgmap v3405: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:40.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:38.884613+0000 mgr.smithi008.flmjzp (mgr.14640) 4965 : cluster [DBG] pgmap v3405: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:40.885246+0000 mgr.smithi008.flmjzp (mgr.14640) 4966 : cluster [DBG] pgmap v3406: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:40.885246+0000 mgr.smithi008.flmjzp (mgr.14640) 4966 : cluster [DBG] pgmap v3406: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:42.885842+0000 mgr.smithi008.flmjzp (mgr.14640) 4967 : cluster [DBG] pgmap v3407: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:42.885842+0000 mgr.smithi008.flmjzp (mgr.14640) 4967 : cluster [DBG] pgmap v3407: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:44.913996+0000 mon.smithi008 (mon.0) 5232 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:44.916333+0000 mon.smithi008 (mon.0) 5233 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:44.917358+0000 mon.smithi008 (mon.0) 5234 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:44.924166+0000 mon.smithi008 (mon.0) 5235 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:45.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:44.931049+0000 mon.smithi008 (mon.0) 5236 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:45.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:44.934069+0000 mon.smithi008 (mon.0) 5237 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:45.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:44.935846+0000 mon.smithi008 (mon.0) 5238 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:45.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:44.937547+0000 mon.smithi008 (mon.0) 5239 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:45.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:44.939521+0000 mon.smithi008 (mon.0) 5240 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:44.913996+0000 mon.smithi008 (mon.0) 5232 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:44.916333+0000 mon.smithi008 (mon.0) 5233 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:44.917358+0000 mon.smithi008 (mon.0) 5234 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:44.924166+0000 mon.smithi008 (mon.0) 5235 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:44.931049+0000 mon.smithi008 (mon.0) 5236 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:44.934069+0000 mon.smithi008 (mon.0) 5237 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:44.935846+0000 mon.smithi008 (mon.0) 5238 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:45.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:44.937547+0000 mon.smithi008 (mon.0) 5239 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:45.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:44.939521+0000 mon.smithi008 (mon.0) 5240 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:44.886355+0000 mgr.smithi008.flmjzp (mgr.14640) 4968 : cluster [DBG] pgmap v3408: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:44.918269+0000 mgr.smithi008.flmjzp (mgr.14640) 4969 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:44.918844+0000 mgr.smithi008.flmjzp (mgr.14640) 4970 : cluster [DBG] pgmap v3409: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:44.919094+0000 mgr.smithi008.flmjzp (mgr.14640) 4971 : cluster [DBG] pgmap v3410: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:44.941415+0000 mgr.smithi008.flmjzp (mgr.14640) 4972 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:44.886355+0000 mgr.smithi008.flmjzp (mgr.14640) 4968 : cluster [DBG] pgmap v3408: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:44.918269+0000 mgr.smithi008.flmjzp (mgr.14640) 4969 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:44.918844+0000 mgr.smithi008.flmjzp (mgr.14640) 4970 : cluster [DBG] pgmap v3409: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:44.919094+0000 mgr.smithi008.flmjzp (mgr.14640) 4971 : cluster [DBG] pgmap v3410: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:44.941415+0000 mgr.smithi008.flmjzp (mgr.14640) 4972 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:46.919696+0000 mgr.smithi008.flmjzp (mgr.14640) 4973 : cluster [DBG] pgmap v3411: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:46.919696+0000 mgr.smithi008.flmjzp (mgr.14640) 4973 : cluster [DBG] pgmap v3411: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:48.920385+0000 mgr.smithi008.flmjzp (mgr.14640) 4974 : cluster [DBG] pgmap v3412: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:48.920385+0000 mgr.smithi008.flmjzp (mgr.14640) 4974 : cluster [DBG] pgmap v3412: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:50.921050+0000 mgr.smithi008.flmjzp (mgr.14640) 4975 : cluster [DBG] pgmap v3413: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:52.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:50.921050+0000 mgr.smithi008.flmjzp (mgr.14640) 4975 : cluster [DBG] pgmap v3413: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:52.921679+0000 mgr.smithi008.flmjzp (mgr.14640) 4976 : cluster [DBG] pgmap v3414: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:52.921679+0000 mgr.smithi008.flmjzp (mgr.14640) 4976 : cluster [DBG] pgmap v3414: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.808+0000 7f69c73e2700 1 -- 172.21.15.8:0/1342330645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69c0060310 msgr2=0x7f69c00f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.808+0000 7f69c73e2700 1 --2- 172.21.15.8:0/1342330645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69c0060310 0x7f69c00f9110 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f69bc004660 tx=0x7f69bc009b30).stop 2023-10-18T22:21:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.808+0000 7f69c73e2700 1 -- 172.21.15.8:0/1342330645 shutdown_connections 2023-10-18T22:21:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.808+0000 7f69c73e2700 1 --2- 172.21.15.8:0/1342330645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c00f9690 0x7f69c00fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.808+0000 7f69c73e2700 1 --2- 172.21.15.8:0/1342330645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69c0060310 0x7f69c00f9110 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.808+0000 7f69c73e2700 1 -- 172.21.15.8:0/1342330645 >> 172.21.15.8:0/1342330645 conn(0x7f69c00f0b90 msgr2=0x7f69c00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.808+0000 7f69c73e2700 1 -- 172.21.15.8:0/1342330645 shutdown_connections 2023-10-18T22:21:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.808+0000 7f69c73e2700 1 -- 172.21.15.8:0/1342330645 wait complete. 2023-10-18T22:21:54.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.809+0000 7f69c73e2700 1 Processor -- start 2023-10-18T22:21:54.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.809+0000 7f69c73e2700 1 -- start start 2023-10-18T22:21:54.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.810+0000 7f69c73e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69c0060310 0x7f69c0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:54.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.810+0000 7f69c73e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c00f9690 0x7f69c0107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:54.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.810+0000 7f69c73e2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c0107850 con 0x7f69c0060310 2023-10-18T22:21:54.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.810+0000 7f69c73e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c0108060 con 0x7f69c00f9690 2023-10-18T22:21:54.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.810+0000 7f69c63e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69c0060310 0x7f69c0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:54.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.810+0000 7f69c63e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69c0060310 0x7f69c0106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59526/0 (socket says 172.21.15.8:59526) 2023-10-18T22:21:54.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.810+0000 7f69c63e0700 1 -- 172.21.15.8:0/4142533030 learned_addr learned my addr 172.21.15.8:0/4142533030 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:54.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.811+0000 7f69c5bdf700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c00f9690 0x7f69c0107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:54.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.811+0000 7f69c63e0700 1 -- 172.21.15.8:0/4142533030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c00f9690 msgr2=0x7f69c0107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:54.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.811+0000 7f69c63e0700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c00f9690 0x7f69c0107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:54.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.811+0000 7f69c63e0700 1 -- 172.21.15.8:0/4142533030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc005040 con 0x7f69c0060310 2023-10-18T22:21:54.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.811+0000 7f69c5bdf700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c00f9690 0x7f69c0107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:21:54.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.811+0000 7f69c63e0700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69c0060310 0x7f69c0106d60 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7f69bc004d80 tx=0x7f69bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:54.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.811+0000 7f69b6ffd700 1 -- 172.21.15.8:0/4142533030 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69bc019070 con 0x7f69c0060310 2023-10-18T22:21:54.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.811+0000 7f69b6ffd700 1 -- 172.21.15.8:0/4142533030 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f69bc01e420 con 0x7f69c0060310 2023-10-18T22:21:54.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.811+0000 7f69b6ffd700 1 -- 172.21.15.8:0/4142533030 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69bc014680 con 0x7f69c0060310 2023-10-18T22:21:54.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.811+0000 7f69c73e2700 1 -- 172.21.15.8:0/4142533030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c0108280 con 0x7f69c0060310 2023-10-18T22:21:54.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.812+0000 7f69c73e2700 1 -- 172.21.15.8:0/4142533030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c0108760 con 0x7f69c0060310 2023-10-18T22:21:54.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.812+0000 7f69c73e2700 1 -- 172.21.15.8:0/4142533030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c0059100 con 0x7f69c0060310 2023-10-18T22:21:54.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.813+0000 7f69b6ffd700 1 -- 172.21.15.8:0/4142533030 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f69bc01e9c0 con 0x7f69c0060310 2023-10-18T22:21:54.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.814+0000 7f69b6ffd700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69ac060f70 0x7f69ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:54.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.814+0000 7f69b6ffd700 1 -- 172.21.15.8:0/4142533030 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f69bc07dde0 con 0x7f69c0060310 2023-10-18T22:21:54.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.814+0000 7f69c5bdf700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69ac060f70 0x7f69ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:54.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.815+0000 7f69c5bdf700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69ac060f70 0x7f69ac063430 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f69c00600e0 tx=0x7f69b000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:54.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:54.819+0000 7f69b6ffd700 1 -- 172.21.15.8:0/4142533030 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f69bc04da10 con 0x7f69c0060310 2023-10-18T22:21:55.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.024+0000 7f69c73e2700 1 -- 172.21.15.8:0/4142533030 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69c00008d0 con 0x7f69ac060f70 2023-10-18T22:21:55.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.025+0000 7f69b6ffd700 1 -- 172.21.15.8:0/4142533030 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f69c00008d0 con 0x7f69ac060f70 2023-10-18T22:21:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.027+0000 7f69c73e2700 1 -- 172.21.15.8:0/4142533030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69ac060f70 msgr2=0x7f69ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.027+0000 7f69c73e2700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69ac060f70 0x7f69ac063430 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f69c00600e0 tx=0x7f69b000b040).stop 2023-10-18T22:21:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.027+0000 7f69c73e2700 1 -- 172.21.15.8:0/4142533030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69c0060310 msgr2=0x7f69c0106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.027+0000 7f69c73e2700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69c0060310 0x7f69c0106d60 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7f69bc004d80 tx=0x7f69bc00b040).stop 2023-10-18T22:21:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.027+0000 7f69c73e2700 1 -- 172.21.15.8:0/4142533030 shutdown_connections 2023-10-18T22:21:55.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.027+0000 7f69c73e2700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f69ac060f70 0x7f69ac063430 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.027+0000 7f69c73e2700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69c0060310 0x7f69c0106d60 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.027+0000 7f69c73e2700 1 --2- 172.21.15.8:0/4142533030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c00f9690 0x7f69c0107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.027+0000 7f69c73e2700 1 -- 172.21.15.8:0/4142533030 >> 172.21.15.8:0/4142533030 conn(0x7f69c00f0b90 msgr2=0x7f69c00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:55.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.027+0000 7f69c73e2700 1 -- 172.21.15.8:0/4142533030 shutdown_connections 2023-10-18T22:21:55.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.028+0000 7f69c73e2700 1 -- 172.21.15.8:0/4142533030 wait complete. 2023-10-18T22:21:55.044 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:21:55.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.165+0000 7fa18e871700 1 -- 172.21.15.8:0/2644181622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1880f6530 msgr2=0x7fa1880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.165+0000 7fa18e871700 1 --2- 172.21.15.8:0/2644181622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1880f6530 0x7fa1880f6950 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fa184004660 tx=0x7fa184009b30).stop 2023-10-18T22:21:55.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.165+0000 7fa18e871700 1 -- 172.21.15.8:0/2644181622 shutdown_connections 2023-10-18T22:21:55.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.165+0000 7fa18e871700 1 --2- 172.21.15.8:0/2644181622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1880f77d0 0x7fa1880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.165+0000 7fa18e871700 1 --2- 172.21.15.8:0/2644181622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1880f6530 0x7fa1880f6950 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.165+0000 7fa18e871700 1 -- 172.21.15.8:0/2644181622 >> 172.21.15.8:0/2644181622 conn(0x7fa1880f1c90 msgr2=0x7fa1880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:55.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.166+0000 7fa18e871700 1 -- 172.21.15.8:0/2644181622 shutdown_connections 2023-10-18T22:21:55.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.166+0000 7fa18e871700 1 -- 172.21.15.8:0/2644181622 wait complete. 2023-10-18T22:21:55.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.166+0000 7fa18e871700 1 Processor -- start 2023-10-18T22:21:55.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.167+0000 7fa18e871700 1 -- start start 2023-10-18T22:21:55.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.167+0000 7fa18e871700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1880f6530 0x7fa188108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:55.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.167+0000 7fa18e871700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1880f77d0 0x7fa188109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:55.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.167+0000 7fa18e871700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa188109a00 con 0x7fa1880f6530 2023-10-18T22:21:55.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.167+0000 7fa18e871700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa188109b40 con 0x7fa1880f77d0 2023-10-18T22:21:55.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.167+0000 7fa18d86f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1880f6530 0x7fa188108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:55.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.167+0000 7fa18d86f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1880f6530 0x7fa188108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59542/0 (socket says 172.21.15.8:59542) 2023-10-18T22:21:55.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.167+0000 7fa18d86f700 1 -- 172.21.15.8:0/213493647 learned_addr learned my addr 172.21.15.8:0/213493647 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:55.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.167+0000 7fa18d06e700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1880f77d0 0x7fa188109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:55.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.168+0000 7fa18d86f700 1 -- 172.21.15.8:0/213493647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1880f77d0 msgr2=0x7fa188109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.168+0000 7fa18d86f700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1880f77d0 0x7fa188109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.168+0000 7fa18d86f700 1 -- 172.21.15.8:0/213493647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184005040 con 0x7fa1880f6530 2023-10-18T22:21:55.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.168+0000 7fa18d86f700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1880f6530 0x7fa188108f60 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fa184014040 tx=0x7fa18400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:55.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.168+0000 7fa17e7fc700 1 -- 172.21.15.8:0/213493647 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa184019070 con 0x7fa1880f6530 2023-10-18T22:21:55.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.168+0000 7fa17e7fc700 1 -- 172.21.15.8:0/213493647 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa18401e420 con 0x7fa1880f6530 2023-10-18T22:21:55.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.168+0000 7fa17e7fc700 1 -- 172.21.15.8:0/213493647 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa184014620 con 0x7fa1880f6530 2023-10-18T22:21:55.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.168+0000 7fa18e871700 1 -- 172.21.15.8:0/213493647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18810a480 con 0x7fa1880f6530 2023-10-18T22:21:55.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.168+0000 7fa18e871700 1 -- 172.21.15.8:0/213493647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18810a960 con 0x7fa1880f6530 2023-10-18T22:21:55.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.169+0000 7fa18e871700 1 -- 172.21.15.8:0/213493647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa188045ad0 con 0x7fa1880f6530 2023-10-18T22:21:55.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.170+0000 7fa17e7fc700 1 -- 172.21.15.8:0/213493647 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa18401e9e0 con 0x7fa1880f6530 2023-10-18T22:21:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.171+0000 7fa17e7fc700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa174060f70 0x7fa174063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.171+0000 7fa17e7fc700 1 -- 172.21.15.8:0/213493647 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa18407dcb0 con 0x7fa1880f6530 2023-10-18T22:21:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.171+0000 7fa18d06e700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa174060f70 0x7fa174063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.172+0000 7fa18d06e700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa174060f70 0x7fa174063430 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fa178009fd0 tx=0x7fa17800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:55.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.175+0000 7fa17e7fc700 1 -- 172.21.15.8:0/213493647 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa184051310 con 0x7fa1880f6530 2023-10-18T22:21:55.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.376+0000 7fa18e871700 1 -- 172.21.15.8:0/213493647 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1880fedd0 con 0x7fa174060f70 2023-10-18T22:21:55.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.378+0000 7fa17e7fc700 1 -- 172.21.15.8:0/213493647 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa1880fedd0 con 0x7fa174060f70 2023-10-18T22:21:55.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 -- 172.21.15.8:0/213493647 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa174060f70 msgr2=0x7fa174063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa174060f70 0x7fa174063430 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fa178009fd0 tx=0x7fa17800b040).stop 2023-10-18T22:21:55.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 -- 172.21.15.8:0/213493647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1880f6530 msgr2=0x7fa188108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1880f6530 0x7fa188108f60 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fa184014040 tx=0x7fa18400b040).stop 2023-10-18T22:21:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 -- 172.21.15.8:0/213493647 shutdown_connections 2023-10-18T22:21:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa174060f70 0x7fa174063430 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1880f6530 0x7fa188108f60 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 --2- 172.21.15.8:0/213493647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1880f77d0 0x7fa188109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 -- 172.21.15.8:0/213493647 >> 172.21.15.8:0/213493647 conn(0x7fa1880f1c90 msgr2=0x7fa18806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 -- 172.21.15.8:0/213493647 shutdown_connections 2023-10-18T22:21:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.380+0000 7fa18e871700 1 -- 172.21.15.8:0/213493647 wait complete. 2023-10-18T22:21:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.517+0000 7f41999ed700 1 -- 172.21.15.8:0/2265993875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41940f9690 msgr2=0x7f41940fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.517+0000 7f41999ed700 1 --2- 172.21.15.8:0/2265993875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41940f9690 0x7f41940fbae0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7f4180004660 tx=0x7f4180009b30).stop 2023-10-18T22:21:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.517+0000 7f41999ed700 1 -- 172.21.15.8:0/2265993875 shutdown_connections 2023-10-18T22:21:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.517+0000 7f41999ed700 1 --2- 172.21.15.8:0/2265993875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41940f9690 0x7f41940fbae0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.517+0000 7f41999ed700 1 --2- 172.21.15.8:0/2265993875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4194060310 0x7f41940f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.517+0000 7f41999ed700 1 -- 172.21.15.8:0/2265993875 >> 172.21.15.8:0/2265993875 conn(0x7f41940f0b90 msgr2=0x7f41940f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:55.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.517+0000 7f41999ed700 1 -- 172.21.15.8:0/2265993875 shutdown_connections 2023-10-18T22:21:55.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.517+0000 7f41999ed700 1 -- 172.21.15.8:0/2265993875 wait complete. 2023-10-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.518+0000 7f41999ed700 1 Processor -- start 2023-10-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.518+0000 7f41999ed700 1 -- start start 2023-10-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.518+0000 7f41999ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4194060310 0x7f41940f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f41999ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41940f9690 0x7f41940f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f41999ed700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419410a970 con 0x7f41940f9690 2023-10-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f41999ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419410aab0 con 0x7f4194060310 2023-10-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f4193fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41940f9690 0x7f41940f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f4193fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41940f9690 0x7f41940f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59546/0 (socket says 172.21.15.8:59546) 2023-10-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f4193fff700 1 -- 172.21.15.8:0/1025884983 learned_addr learned my addr 172.21.15.8:0/1025884983 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f41989eb700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4194060310 0x7f41940f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:55.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f4193fff700 1 -- 172.21.15.8:0/1025884983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4194060310 msgr2=0x7f41940f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f4193fff700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4194060310 0x7f41940f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f4193fff700 1 -- 172.21.15.8:0/1025884983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180005040 con 0x7f41940f9690 2023-10-18T22:21:55.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.519+0000 7f4193fff700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41940f9690 0x7f41940f5010 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f4180007a60 tx=0x7f4180009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:55.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.520+0000 7f41917fa700 1 -- 172.21.15.8:0/1025884983 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4180018070 con 0x7f41940f9690 2023-10-18T22:21:55.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.520+0000 7f41917fa700 1 -- 172.21.15.8:0/1025884983 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4180009630 con 0x7f41940f9690 2023-10-18T22:21:55.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.520+0000 7f41999ed700 1 -- 172.21.15.8:0/1025884983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41940f5560 con 0x7f41940f9690 2023-10-18T22:21:55.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.520+0000 7f41917fa700 1 -- 172.21.15.8:0/1025884983 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f418001c4d0 con 0x7f41940f9690 2023-10-18T22:21:55.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.520+0000 7f41999ed700 1 -- 172.21.15.8:0/1025884983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41940f5ac0 con 0x7f41940f9690 2023-10-18T22:21:55.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.521+0000 7f41999ed700 1 -- 172.21.15.8:0/1025884983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4194045ad0 con 0x7f41940f9690 2023-10-18T22:21:55.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.522+0000 7f41917fa700 1 -- 172.21.15.8:0/1025884983 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f418001d420 con 0x7f41940f9690 2023-10-18T22:21:55.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.523+0000 7f41917fa700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4184060f70 0x7f4184063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:55.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.523+0000 7f41917fa700 1 -- 172.21.15.8:0/1025884983 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f418007e650 con 0x7f41940f9690 2023-10-18T22:21:55.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.523+0000 7f41989eb700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4184060f70 0x7f4184063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:55.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.524+0000 7f41989eb700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4184060f70 0x7f4184063430 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f41940f6920 tx=0x7f418800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.527+0000 7f41917fa700 1 -- 172.21.15.8:0/1025884983 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f418004e270 con 0x7f41940f9690 2023-10-18T22:21:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:54.951962+0000 mon.smithi008 (mon.0) 5241 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:54.953763+0000 mon.smithi008 (mon.0) 5242 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:54.954513+0000 mon.smithi008 (mon.0) 5243 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:54.959677+0000 mon.smithi008 (mon.0) 5244 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:54.964758+0000 mon.smithi008 (mon.0) 5245 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:54.967110+0000 mon.smithi008 (mon.0) 5246 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:54.968366+0000 mon.smithi008 (mon.0) 5247 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:54.969599+0000 mon.smithi008 (mon.0) 5248 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:54.971098+0000 mon.smithi008 (mon.0) 5249 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:55.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.724+0000 7f41999ed700 1 -- 172.21.15.8:0/1025884983 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4194027aa0 con 0x7f4184060f70 2023-10-18T22:21:55.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.734+0000 7f41917fa700 1 -- 172.21.15.8:0/1025884983 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4194027aa0 con 0x7f4184060f70 2023-10-18T22:21:55.736 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:21:55.737 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (88m) 5m ago 90m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:21:55.737 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (82m) 5m ago 90m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:21:55.737 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (82m) 3m ago 89m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:21:55.737 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (88m) 5m ago 89m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:21:55.737 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 86m - - 2023-10-18T22:21:55.738 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 86m - - 2023-10-18T22:21:55.738 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 86m - - 2023-10-18T22:21:55.738 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 85m - - 2023-10-18T22:21:55.738 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (83m) 5m ago 91m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:21:55.738 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (83m) 3m ago 89m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:21:55.739 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (82m) 5m ago 91m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:21:55.739 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (82m) 3m ago 89m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:21:55.739 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (89m) 5m ago 89m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:21:55.739 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (88m) 3m ago 88m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:21:55.739 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (82m) 5m ago 88m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:21:55.740 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (80m) 5m ago 88m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:21:55.740 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (79m) 5m ago 87m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:21:55.740 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (79m) 3m ago 87m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:21:55.740 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (78m) 3m ago 87m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:21:55.740 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (78m) 3m ago 87m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:21:55.740 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (84m) 5m ago 89m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:21:55.743 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:54.951962+0000 mon.smithi008 (mon.0) 5241 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:55.743 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:54.953763+0000 mon.smithi008 (mon.0) 5242 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:21:55.743 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:54.954513+0000 mon.smithi008 (mon.0) 5243 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:21:55.744 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:54.959677+0000 mon.smithi008 (mon.0) 5244 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:21:55.744 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:54.964758+0000 mon.smithi008 (mon.0) 5245 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:21:55.744 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:54.967110+0000 mon.smithi008 (mon.0) 5246 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:55.744 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:54.968366+0000 mon.smithi008 (mon.0) 5247 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:55.744 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:54.969599+0000 mon.smithi008 (mon.0) 5248 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:55.745 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:54.971098+0000 mon.smithi008 (mon.0) 5249 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 -- 172.21.15.8:0/1025884983 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4184060f70 msgr2=0x7f4184063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4184060f70 0x7f4184063430 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f41940f6920 tx=0x7f418800b040).stop 2023-10-18T22:21:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 -- 172.21.15.8:0/1025884983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41940f9690 msgr2=0x7f41940f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41940f9690 0x7f41940f5010 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f4180007a60 tx=0x7f4180009b30).stop 2023-10-18T22:21:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 -- 172.21.15.8:0/1025884983 shutdown_connections 2023-10-18T22:21:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4184060f70 0x7f4184063430 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4194060310 0x7f41940f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 --2- 172.21.15.8:0/1025884983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41940f9690 0x7f41940f5010 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 -- 172.21.15.8:0/1025884983 >> 172.21.15.8:0/1025884983 conn(0x7f41940f0b90 msgr2=0x7f41940f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 -- 172.21.15.8:0/1025884983 shutdown_connections 2023-10-18T22:21:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.736+0000 7f41999ed700 1 -- 172.21.15.8:0/1025884983 wait complete. 2023-10-18T22:21:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.872+0000 7f231d085700 1 -- 172.21.15.8:0/3931617680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23180f77d0 msgr2=0x7f23180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.872+0000 7f231d085700 1 --2- 172.21.15.8:0/3931617680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23180f77d0 0x7f23180f7c30 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f230c004660 tx=0x7f230c009b30).stop 2023-10-18T22:21:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.872+0000 7f231d085700 1 -- 172.21.15.8:0/3931617680 shutdown_connections 2023-10-18T22:21:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.872+0000 7f231d085700 1 --2- 172.21.15.8:0/3931617680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23180f77d0 0x7f23180f7c30 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.872+0000 7f231d085700 1 --2- 172.21.15.8:0/3931617680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180f6530 0x7f23180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.872+0000 7f231d085700 1 -- 172.21.15.8:0/3931617680 >> 172.21.15.8:0/3931617680 conn(0x7f23180f1c90 msgr2=0x7f23180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.872+0000 7f231d085700 1 -- 172.21.15.8:0/3931617680 shutdown_connections 2023-10-18T22:21:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.872+0000 7f231d085700 1 -- 172.21.15.8:0/3931617680 wait complete. 2023-10-18T22:21:55.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.873+0000 7f231d085700 1 Processor -- start 2023-10-18T22:21:55.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.873+0000 7f231d085700 1 -- start start 2023-10-18T22:21:55.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f231d085700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180f6530 0x7f231806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:55.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f231d085700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23180f77d0 0x7f2318069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:55.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f231d085700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231806a380 con 0x7f23180f77d0 2023-10-18T22:21:55.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f231d085700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231806a4c0 con 0x7f23180f6530 2023-10-18T22:21:55.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f23177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23180f77d0 0x7f2318069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:55.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f23177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23180f77d0 0x7f2318069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59560/0 (socket says 172.21.15.8:59560) 2023-10-18T22:21:55.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f23177fe700 1 -- 172.21.15.8:0/3242720099 learned_addr learned my addr 172.21.15.8:0/3242720099 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:55.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f2317fff700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180f6530 0x7f231806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:55.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f23177fe700 1 -- 172.21.15.8:0/3242720099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180f6530 msgr2=0x7f231806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:55.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f23177fe700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180f6530 0x7f231806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:55.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.874+0000 7f23177fe700 1 -- 172.21.15.8:0/3242720099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c005040 con 0x7f23180f77d0 2023-10-18T22:21:55.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.875+0000 7f23177fe700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23180f77d0 0x7f2318069e20 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7f230c004320 tx=0x7f230c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.875+0000 7f2314ff9700 1 -- 172.21.15.8:0/3242720099 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f230c019070 con 0x7f23180f77d0 2023-10-18T22:21:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.875+0000 7f2314ff9700 1 -- 172.21.15.8:0/3242720099 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f230c01e420 con 0x7f23180f77d0 2023-10-18T22:21:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.875+0000 7f2314ff9700 1 -- 172.21.15.8:0/3242720099 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f230c014680 con 0x7f23180f77d0 2023-10-18T22:21:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.875+0000 7f231d085700 1 -- 172.21.15.8:0/3242720099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231806a740 con 0x7f23180f77d0 2023-10-18T22:21:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.875+0000 7f231d085700 1 -- 172.21.15.8:0/3242720099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231806ac20 con 0x7f23180f77d0 2023-10-18T22:21:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.876+0000 7f231d085700 1 -- 172.21.15.8:0/3242720099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318045ad0 con 0x7f23180f77d0 2023-10-18T22:21:55.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.877+0000 7f2314ff9700 1 -- 172.21.15.8:0/3242720099 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f230c01e590 con 0x7f23180f77d0 2023-10-18T22:21:55.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.877+0000 7f2314ff9700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2300060f70 0x7f2300063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:55.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.878+0000 7f2314ff9700 1 -- 172.21.15.8:0/3242720099 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f230c07dc50 con 0x7f23180f77d0 2023-10-18T22:21:55.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.878+0000 7f2317fff700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2300060f70 0x7f2300063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:55.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.878+0000 7f2317fff700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2300060f70 0x7f2300063430 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f231806b730 tx=0x7f230800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:55.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:55.882+0000 7f2314ff9700 1 -- 172.21.15.8:0/3242720099 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f230c04d8e0 con 0x7f23180f77d0 2023-10-18T22:21:56.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.139+0000 7f231d085700 1 -- 172.21.15.8:0/3242720099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2318027a00 con 0x7f23180f77d0 2023-10-18T22:21:56.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.140+0000 7f2314ff9700 1 -- 172.21.15.8:0/3242720099 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f230c050f00 con 0x7f23180f77d0 2023-10-18T22:21:56.142 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:21:56.142 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:21:56.143 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:21:56.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:21:56.143 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:21:56.143 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:21:56.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:21:56.144 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:21:56.144 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:21:56.144 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:21:56.144 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:21:56.144 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:21:56.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:21:56.145 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:21:56.145 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:21:56.145 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:21:56.145 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:21:56.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.141+0000 7f231d085700 1 -- 172.21.15.8:0/3242720099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2300060f70 msgr2=0x7f2300063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:56.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.142+0000 7f231d085700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2300060f70 0x7f2300063430 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f231806b730 tx=0x7f230800b040).stop 2023-10-18T22:21:56.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.142+0000 7f231d085700 1 -- 172.21.15.8:0/3242720099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23180f77d0 msgr2=0x7f2318069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:56.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.142+0000 7f231d085700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23180f77d0 0x7f2318069e20 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7f230c004320 tx=0x7f230c00b040).stop 2023-10-18T22:21:56.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.142+0000 7f231d085700 1 -- 172.21.15.8:0/3242720099 shutdown_connections 2023-10-18T22:21:56.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.142+0000 7f231d085700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2300060f70 0x7f2300063430 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.142+0000 7f231d085700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180f6530 0x7f231806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.142+0000 7f231d085700 1 --2- 172.21.15.8:0/3242720099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23180f77d0 0x7f2318069e20 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.142+0000 7f231d085700 1 -- 172.21.15.8:0/3242720099 >> 172.21.15.8:0/3242720099 conn(0x7f23180f1c90 msgr2=0x7f23180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.142+0000 7f231d085700 1 -- 172.21.15.8:0/3242720099 shutdown_connections 2023-10-18T22:21:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.142+0000 7f231d085700 1 -- 172.21.15.8:0/3242720099 wait complete. 2023-10-18T22:21:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.281+0000 7fd3e754b700 1 -- 172.21.15.8:0/587793528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3e00f6530 msgr2=0x7fd3e00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.281+0000 7fd3e754b700 1 --2- 172.21.15.8:0/587793528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3e00f6530 0x7fd3e00f6950 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7fd3dc004660 tx=0x7fd3dc009b30).stop 2023-10-18T22:21:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.281+0000 7fd3e754b700 1 -- 172.21.15.8:0/587793528 shutdown_connections 2023-10-18T22:21:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.281+0000 7fd3e754b700 1 --2- 172.21.15.8:0/587793528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3e00f77d0 0x7fd3e00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.281+0000 7fd3e754b700 1 --2- 172.21.15.8:0/587793528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3e00f6530 0x7fd3e00f6950 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.281+0000 7fd3e754b700 1 -- 172.21.15.8:0/587793528 >> 172.21.15.8:0/587793528 conn(0x7fd3e00f1c90 msgr2=0x7fd3e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.281+0000 7fd3e754b700 1 -- 172.21.15.8:0/587793528 shutdown_connections 2023-10-18T22:21:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.281+0000 7fd3e754b700 1 -- 172.21.15.8:0/587793528 wait complete. 2023-10-18T22:21:56.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.282+0000 7fd3e754b700 1 Processor -- start 2023-10-18T22:21:56.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.282+0000 7fd3e754b700 1 -- start start 2023-10-18T22:21:56.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.283+0000 7fd3e754b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3e00f6530 0x7fd3e0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:56.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.283+0000 7fd3e754b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3e00f77d0 0x7fd3e0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:56.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.283+0000 7fd3e754b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e0107910 con 0x7fd3e00f6530 2023-10-18T22:21:56.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.283+0000 7fd3e754b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e0108120 con 0x7fd3e00f77d0 2023-10-18T22:21:56.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.283+0000 7fd3e6549700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3e00f6530 0x7fd3e0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:56.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.283+0000 7fd3e6549700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3e00f6530 0x7fd3e0106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59580/0 (socket says 172.21.15.8:59580) 2023-10-18T22:21:56.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.283+0000 7fd3e6549700 1 -- 172.21.15.8:0/2857374475 learned_addr learned my addr 172.21.15.8:0/2857374475 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:56.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.283+0000 7fd3e5d48700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3e00f77d0 0x7fd3e0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:56.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.284+0000 7fd3e6549700 1 -- 172.21.15.8:0/2857374475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3e00f77d0 msgr2=0x7fd3e0107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:56.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.284+0000 7fd3e6549700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3e00f77d0 0x7fd3e0107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.284+0000 7fd3e6549700 1 -- 172.21.15.8:0/2857374475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc005040 con 0x7fd3e00f6530 2023-10-18T22:21:56.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.284+0000 7fd3e6549700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3e00f6530 0x7fd3e0106e20 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7fd3dc007a60 tx=0x7fd3dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:56.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.284+0000 7fd3d6ffd700 1 -- 172.21.15.8:0/2857374475 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3dc018070 con 0x7fd3e00f6530 2023-10-18T22:21:56.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.284+0000 7fd3d6ffd700 1 -- 172.21.15.8:0/2857374475 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd3dc009630 con 0x7fd3e00f6530 2023-10-18T22:21:56.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.284+0000 7fd3d6ffd700 1 -- 172.21.15.8:0/2857374475 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3dc01c4d0 con 0x7fd3e00f6530 2023-10-18T22:21:56.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.284+0000 7fd3e754b700 1 -- 172.21.15.8:0/2857374475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e0108340 con 0x7fd3e00f6530 2023-10-18T22:21:56.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.284+0000 7fd3e754b700 1 -- 172.21.15.8:0/2857374475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e01088a0 con 0x7fd3e00f6530 2023-10-18T22:21:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.285+0000 7fd3e754b700 1 -- 172.21.15.8:0/2857374475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e0059100 con 0x7fd3e00f6530 2023-10-18T22:21:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.286+0000 7fd3d6ffd700 1 -- 172.21.15.8:0/2857374475 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd3dc01d420 con 0x7fd3e00f6530 2023-10-18T22:21:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.287+0000 7fd3d6ffd700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3cc060f70 0x7fd3cc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.287+0000 7fd3d6ffd700 1 -- 172.21.15.8:0/2857374475 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd3dc07e560 con 0x7fd3e00f6530 2023-10-18T22:21:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.287+0000 7fd3e5d48700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3cc060f70 0x7fd3cc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.288+0000 7fd3e5d48700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3cc060f70 0x7fd3cc063430 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fd3d0004c40 tx=0x7fd3d000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.291+0000 7fd3d6ffd700 1 -- 172.21.15.8:0/2857374475 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd3dc04e190 con 0x7fd3e00f6530 2023-10-18T22:21:56.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.517+0000 7fd3e754b700 1 -- 172.21.15.8:0/2857374475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3e00fecc0 con 0x7fd3e00f6530 2023-10-18T22:21:56.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.517+0000 7fd3d6ffd700 1 -- 172.21.15.8:0/2857374475 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fd3dc0517b0 con 0x7fd3e00f6530 2023-10-18T22:21:56.520 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:21:56.520 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:21:56.520 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:21:56.520 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:21:56.521 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:21:56.521 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:21:56.521 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:21:56.521 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:21:56.521 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:21:56.522 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:21:56.522 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:21:56.522 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:21:56.522 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:21:56.522 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:21:56.523 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:21:56.523 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:21:56.523 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:21:56.523 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:21:56.523 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:21:56.524 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:21:56.524 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:21:56.524 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:21:56.524 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:21:56.524 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:21:56.524 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:21:56.525 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:21:56.525 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:21:56.525 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:21:56.525 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:21:56.525 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:21:56.526 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:21:56.526 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:21:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:21:56.526 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:21:56.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 -- 172.21.15.8:0/2857374475 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3cc060f70 msgr2=0x7fd3cc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:56.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3cc060f70 0x7fd3cc063430 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fd3d0004c40 tx=0x7fd3d000b040).stop 2023-10-18T22:21:56.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 -- 172.21.15.8:0/2857374475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3e00f6530 msgr2=0x7fd3e0106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:56.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3e00f6530 0x7fd3e0106e20 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7fd3dc007a60 tx=0x7fd3dc009b30).stop 2023-10-18T22:21:56.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 -- 172.21.15.8:0/2857374475 shutdown_connections 2023-10-18T22:21:56.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd3cc060f70 0x7fd3cc063430 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3e00f6530 0x7fd3e0106e20 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 --2- 172.21.15.8:0/2857374475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3e00f77d0 0x7fd3e0107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 -- 172.21.15.8:0/2857374475 >> 172.21.15.8:0/2857374475 conn(0x7fd3e00f1c90 msgr2=0x7fd3e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:56.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 -- 172.21.15.8:0/2857374475 shutdown_connections 2023-10-18T22:21:56.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.519+0000 7fd3e754b700 1 -- 172.21.15.8:0/2857374475 wait complete. 2023-10-18T22:21:56.529 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:21:56.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.658+0000 7f657bfff700 1 -- 172.21.15.8:0/2343765483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f657c0f77d0 msgr2=0x7f657c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:56.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.658+0000 7f657bfff700 1 --2- 172.21.15.8:0/2343765483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f657c0f77d0 0x7f657c0f7c30 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7f6570004660 tx=0x7f6570009b30).stop 2023-10-18T22:21:56.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.658+0000 7f657bfff700 1 -- 172.21.15.8:0/2343765483 shutdown_connections 2023-10-18T22:21:56.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.658+0000 7f657bfff700 1 --2- 172.21.15.8:0/2343765483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f657c0f77d0 0x7f657c0f7c30 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.658+0000 7f657bfff700 1 --2- 172.21.15.8:0/2343765483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0f6530 0x7f657c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.658+0000 7f657bfff700 1 -- 172.21.15.8:0/2343765483 >> 172.21.15.8:0/2343765483 conn(0x7f657c0f1c90 msgr2=0x7f657c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:56.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.658+0000 7f657bfff700 1 -- 172.21.15.8:0/2343765483 shutdown_connections 2023-10-18T22:21:56.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.658+0000 7f657bfff700 1 -- 172.21.15.8:0/2343765483 wait complete. 2023-10-18T22:21:56.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.659+0000 7f657bfff700 1 Processor -- start 2023-10-18T22:21:56.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.659+0000 7f657bfff700 1 -- start start 2023-10-18T22:21:56.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.659+0000 7f657bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0f6530 0x7f657c108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:56.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.659+0000 7f657bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f657c0f77d0 0x7f657c1093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:56.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.659+0000 7f657bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c1099a0 con 0x7f657c0f77d0 2023-10-18T22:21:56.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.659+0000 7f657bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c109ae0 con 0x7f657c0f6530 2023-10-18T22:21:56.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.660+0000 7f657a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f657c0f77d0 0x7f657c1093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:56.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.660+0000 7f657a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f657c0f77d0 0x7f657c1093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59596/0 (socket says 172.21.15.8:59596) 2023-10-18T22:21:56.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.660+0000 7f657a7fc700 1 -- 172.21.15.8:0/3575553200 learned_addr learned my addr 172.21.15.8:0/3575553200 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:21:56.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.660+0000 7f657affd700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0f6530 0x7f657c108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:56.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.660+0000 7f657a7fc700 1 -- 172.21.15.8:0/3575553200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0f6530 msgr2=0x7f657c108f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:56.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.660+0000 7f657a7fc700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0f6530 0x7f657c108f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.660+0000 7f657a7fc700 1 -- 172.21.15.8:0/3575553200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6570005040 con 0x7f657c0f77d0 2023-10-18T22:21:56.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.660+0000 7f657a7fc700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f657c0f77d0 0x7f657c1093f0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f6570004320 tx=0x7f657000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:56.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.660+0000 7f65637fe700 1 -- 172.21.15.8:0/3575553200 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6570019070 con 0x7f657c0f77d0 2023-10-18T22:21:56.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.661+0000 7f65637fe700 1 -- 172.21.15.8:0/3575553200 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f657001e420 con 0x7f657c0f77d0 2023-10-18T22:21:56.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.661+0000 7f65637fe700 1 -- 172.21.15.8:0/3575553200 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6570014680 con 0x7f657c0f77d0 2023-10-18T22:21:56.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.661+0000 7f657bfff700 1 -- 172.21.15.8:0/3575553200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c10a420 con 0x7f657c0f77d0 2023-10-18T22:21:56.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.661+0000 7f657bfff700 1 -- 172.21.15.8:0/3575553200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657c10a900 con 0x7f657c0f77d0 2023-10-18T22:21:56.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.662+0000 7f657bfff700 1 -- 172.21.15.8:0/3575553200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657c045ad0 con 0x7f657c0f77d0 2023-10-18T22:21:56.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.663+0000 7f65637fe700 1 -- 172.21.15.8:0/3575553200 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f657001e590 con 0x7f657c0f77d0 2023-10-18T22:21:56.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.664+0000 7f65637fe700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6564060f70 0x7f6564063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:21:56.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.664+0000 7f65637fe700 1 -- 172.21.15.8:0/3575553200 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f657007dc50 con 0x7f657c0f77d0 2023-10-18T22:21:56.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.664+0000 7f657affd700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6564060f70 0x7f6564063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:21:56.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.664+0000 7f657affd700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6564060f70 0x7f6564063430 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f656c009fd0 tx=0x7f656c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:21:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:54.922180+0000 mgr.smithi008.flmjzp (mgr.14640) 4977 : cluster [DBG] pgmap v3415: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:54.955226+0000 mgr.smithi008.flmjzp (mgr.14640) 4978 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:54.955711+0000 mgr.smithi008.flmjzp (mgr.14640) 4979 : cluster [DBG] pgmap v3416: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:54.955904+0000 mgr.smithi008.flmjzp (mgr.14640) 4980 : cluster [DBG] pgmap v3417: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:21:54.972670+0000 mgr.smithi008.flmjzp (mgr.14640) 4981 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:55.026734+0000 mgr.smithi008.flmjzp (mgr.14640) 4982 : audit [DBG] from='client.37984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:55.378983+0000 mgr.smithi008.flmjzp (mgr.14640) 4983 : audit [DBG] from='client.37988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:56.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:56.141162+0000 mon.smithi008 (mon.0) 5250 : audit [DBG] from='client.? 172.21.15.8:0/3242720099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:56.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.669+0000 7f65637fe700 1 -- 172.21.15.8:0/3575553200 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6570051310 con 0x7f657c0f77d0 2023-10-18T22:21:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:54.922180+0000 mgr.smithi008.flmjzp (mgr.14640) 4977 : cluster [DBG] pgmap v3415: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:54.955226+0000 mgr.smithi008.flmjzp (mgr.14640) 4978 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:21:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:54.955711+0000 mgr.smithi008.flmjzp (mgr.14640) 4979 : cluster [DBG] pgmap v3416: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:54.955904+0000 mgr.smithi008.flmjzp (mgr.14640) 4980 : cluster [DBG] pgmap v3417: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:21:54.972670+0000 mgr.smithi008.flmjzp (mgr.14640) 4981 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:21:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:55.026734+0000 mgr.smithi008.flmjzp (mgr.14640) 4982 : audit [DBG] from='client.37984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:55.378983+0000 mgr.smithi008.flmjzp (mgr.14640) 4983 : audit [DBG] from='client.37988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:56.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:56.141162+0000 mon.smithi008 (mon.0) 5250 : audit [DBG] from='client.? 172.21.15.8:0/3242720099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:21:56.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.866+0000 7f657bfff700 1 -- 172.21.15.8:0/3575553200 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f657c10ab70 con 0x7f6564060f70 2023-10-18T22:21:56.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.868+0000 7f65637fe700 1 -- 172.21.15.8:0/3575553200 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f657c10ab70 con 0x7f6564060f70 2023-10-18T22:21:56.870 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:21:56.870 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:21:56.870 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:21:56.871 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:21:56.871 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:21:56.871 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:21:56.871 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:21:56.871 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:21:56.872 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:21:56.872 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:21:56.872 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:21:56.872 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:21:56.872 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:21:56.873 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:21:56.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 -- 172.21.15.8:0/3575553200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6564060f70 msgr2=0x7f6564063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:56.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6564060f70 0x7f6564063430 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f656c009fd0 tx=0x7f656c00b040).stop 2023-10-18T22:21:56.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 -- 172.21.15.8:0/3575553200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f657c0f77d0 msgr2=0x7f657c1093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:21:56.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f657c0f77d0 0x7f657c1093f0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f6570004320 tx=0x7f657000b040).stop 2023-10-18T22:21:56.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 -- 172.21.15.8:0/3575553200 shutdown_connections 2023-10-18T22:21:56.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6564060f70 0x7f6564063430 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0f6530 0x7f657c108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 --2- 172.21.15.8:0/3575553200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f657c0f77d0 0x7f657c1093f0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:21:56.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 -- 172.21.15.8:0/3575553200 >> 172.21.15.8:0/3575553200 conn(0x7f657c0f1c90 msgr2=0x7f657c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:21:56.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 -- 172.21.15.8:0/3575553200 shutdown_connections 2023-10-18T22:21:56.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:21:56.870+0000 7f657bfff700 1 -- 172.21.15.8:0/3575553200 wait complete. 2023-10-18T22:21:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:55.726911+0000 mgr.smithi008.flmjzp (mgr.14640) 4984 : audit [DBG] from='client.37992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:56.518848+0000 mon.smithi008 (mon.0) 5251 : audit [DBG] from='client.? 172.21.15.8:0/2857374475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:21:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:55.726911+0000 mgr.smithi008.flmjzp (mgr.14640) 4984 : audit [DBG] from='client.37992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:56.518848+0000 mon.smithi008 (mon.0) 5251 : audit [DBG] from='client.? 172.21.15.8:0/2857374475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:21:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:21:56.869100+0000 mgr.smithi008.flmjzp (mgr.14640) 4985 : audit [DBG] from='client.38004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:21:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:56.956515+0000 mgr.smithi008.flmjzp (mgr.14640) 4986 : cluster [DBG] pgmap v3418: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:21:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:21:56.869100+0000 mgr.smithi008.flmjzp (mgr.14640) 4985 : audit [DBG] from='client.38004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:21:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:21:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:56.956515+0000 mgr.smithi008.flmjzp (mgr.14640) 4986 : cluster [DBG] pgmap v3418: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:21:58.957081+0000 mgr.smithi008.flmjzp (mgr.14640) 4987 : cluster [DBG] pgmap v3419: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:21:58.957081+0000 mgr.smithi008.flmjzp (mgr.14640) 4987 : cluster [DBG] pgmap v3419: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:00.957671+0000 mgr.smithi008.flmjzp (mgr.14640) 4988 : cluster [DBG] pgmap v3420: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:02.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:00.957671+0000 mgr.smithi008.flmjzp (mgr.14640) 4988 : cluster [DBG] pgmap v3420: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:02.958189+0000 mgr.smithi008.flmjzp (mgr.14640) 4989 : cluster [DBG] pgmap v3421: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:02.958189+0000 mgr.smithi008.flmjzp (mgr.14640) 4989 : cluster [DBG] pgmap v3421: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:04.980812+0000 mon.smithi008 (mon.0) 5252 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:04.982916+0000 mon.smithi008 (mon.0) 5253 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:04.983926+0000 mon.smithi008 (mon.0) 5254 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:04.990764+0000 mon.smithi008 (mon.0) 5255 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:04.997389+0000 mon.smithi008 (mon.0) 5256 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:05.000492+0000 mon.smithi008 (mon.0) 5257 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:05.002149+0000 mon.smithi008 (mon.0) 5258 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:05.003797+0000 mon.smithi008 (mon.0) 5259 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:05.005819+0000 mon.smithi008 (mon.0) 5260 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:04.980812+0000 mon.smithi008 (mon.0) 5252 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:04.982916+0000 mon.smithi008 (mon.0) 5253 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:04.983926+0000 mon.smithi008 (mon.0) 5254 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:04.990764+0000 mon.smithi008 (mon.0) 5255 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:04.997389+0000 mon.smithi008 (mon.0) 5256 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:05.000492+0000 mon.smithi008 (mon.0) 5257 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:05.002149+0000 mon.smithi008 (mon.0) 5258 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:05.003797+0000 mon.smithi008 (mon.0) 5259 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:05.005819+0000 mon.smithi008 (mon.0) 5260 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:04.958946+0000 mgr.smithi008.flmjzp (mgr.14640) 4990 : cluster [DBG] pgmap v3422: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:04.984805+0000 mgr.smithi008.flmjzp (mgr.14640) 4991 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:04.985338+0000 mgr.smithi008.flmjzp (mgr.14640) 4992 : cluster [DBG] pgmap v3423: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:04.985719+0000 mgr.smithi008.flmjzp (mgr.14640) 4993 : cluster [DBG] pgmap v3424: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:05.007705+0000 mgr.smithi008.flmjzp (mgr.14640) 4994 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:04.958946+0000 mgr.smithi008.flmjzp (mgr.14640) 4990 : cluster [DBG] pgmap v3422: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:04.984805+0000 mgr.smithi008.flmjzp (mgr.14640) 4991 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:04.985338+0000 mgr.smithi008.flmjzp (mgr.14640) 4992 : cluster [DBG] pgmap v3423: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:04.985719+0000 mgr.smithi008.flmjzp (mgr.14640) 4993 : cluster [DBG] pgmap v3424: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:06.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:05.007705+0000 mgr.smithi008.flmjzp (mgr.14640) 4994 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:06.986437+0000 mgr.smithi008.flmjzp (mgr.14640) 4995 : cluster [DBG] pgmap v3425: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:06.986437+0000 mgr.smithi008.flmjzp (mgr.14640) 4995 : cluster [DBG] pgmap v3425: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:08.987053+0000 mgr.smithi008.flmjzp (mgr.14640) 4996 : cluster [DBG] pgmap v3426: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:08.987053+0000 mgr.smithi008.flmjzp (mgr.14640) 4996 : cluster [DBG] pgmap v3426: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:10.987731+0000 mgr.smithi008.flmjzp (mgr.14640) 4997 : cluster [DBG] pgmap v3427: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:10.987731+0000 mgr.smithi008.flmjzp (mgr.14640) 4997 : cluster [DBG] pgmap v3427: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:12.988306+0000 mgr.smithi008.flmjzp (mgr.14640) 4998 : cluster [DBG] pgmap v3428: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:14.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:12.988306+0000 mgr.smithi008.flmjzp (mgr.14640) 4998 : cluster [DBG] pgmap v3428: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:15.018161+0000 mon.smithi008 (mon.0) 5261 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:15.018161+0000 mon.smithi008 (mon.0) 5261 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:14.989015+0000 mgr.smithi008.flmjzp (mgr.14640) 4999 : cluster [DBG] pgmap v3429: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:15.592603+0000 mon.smithi008 (mon.0) 5262 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:15.593350+0000 mon.smithi008 (mon.0) 5263 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:15.598800+0000 mon.smithi008 (mon.0) 5264 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:15.604464+0000 mon.smithi008 (mon.0) 5265 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:16.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:15.606976+0000 mon.smithi008 (mon.0) 5266 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:16.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:15.608191+0000 mon.smithi008 (mon.0) 5267 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:16.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:15.609341+0000 mon.smithi008 (mon.0) 5268 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:16.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:15.610896+0000 mon.smithi008 (mon.0) 5269 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:14.989015+0000 mgr.smithi008.flmjzp (mgr.14640) 4999 : cluster [DBG] pgmap v3429: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:15.592603+0000 mon.smithi008 (mon.0) 5262 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:15.593350+0000 mon.smithi008 (mon.0) 5263 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:15.598800+0000 mon.smithi008 (mon.0) 5264 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:15.604464+0000 mon.smithi008 (mon.0) 5265 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:15.606976+0000 mon.smithi008 (mon.0) 5266 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:16.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:15.608191+0000 mon.smithi008 (mon.0) 5267 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:16.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:15.609341+0000 mon.smithi008 (mon.0) 5268 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:16.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:15.610896+0000 mon.smithi008 (mon.0) 5269 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:15.593952+0000 mgr.smithi008.flmjzp (mgr.14640) 5000 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:15.594475+0000 mgr.smithi008.flmjzp (mgr.14640) 5001 : cluster [DBG] pgmap v3430: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:15.594666+0000 mgr.smithi008.flmjzp (mgr.14640) 5002 : cluster [DBG] pgmap v3431: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:15.612553+0000 mgr.smithi008.flmjzp (mgr.14640) 5003 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:15.593952+0000 mgr.smithi008.flmjzp (mgr.14640) 5000 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:15.594475+0000 mgr.smithi008.flmjzp (mgr.14640) 5001 : cluster [DBG] pgmap v3430: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:15.594666+0000 mgr.smithi008.flmjzp (mgr.14640) 5002 : cluster [DBG] pgmap v3431: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:15.612553+0000 mgr.smithi008.flmjzp (mgr.14640) 5003 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:19.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:17.595314+0000 mgr.smithi008.flmjzp (mgr.14640) 5004 : cluster [DBG] pgmap v3432: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:17.595314+0000 mgr.smithi008.flmjzp (mgr.14640) 5004 : cluster [DBG] pgmap v3432: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:19.596017+0000 mgr.smithi008.flmjzp (mgr.14640) 5005 : cluster [DBG] pgmap v3433: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:19.596017+0000 mgr.smithi008.flmjzp (mgr.14640) 5005 : cluster [DBG] pgmap v3433: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:21.596829+0000 mgr.smithi008.flmjzp (mgr.14640) 5006 : cluster [DBG] pgmap v3434: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:21.596829+0000 mgr.smithi008.flmjzp (mgr.14640) 5006 : cluster [DBG] pgmap v3434: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:23.597541+0000 mgr.smithi008.flmjzp (mgr.14640) 5007 : cluster [DBG] pgmap v3435: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:25.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:23.597541+0000 mgr.smithi008.flmjzp (mgr.14640) 5007 : cluster [DBG] pgmap v3435: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:26.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:25.620595+0000 mon.smithi008 (mon.0) 5270 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:26.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:25.622723+0000 mon.smithi008 (mon.0) 5271 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:26.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:25.623704+0000 mon.smithi008 (mon.0) 5272 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:26.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:25.630323+0000 mon.smithi008 (mon.0) 5273 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:26.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:25.636759+0000 mon.smithi008 (mon.0) 5274 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:26.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:25.639837+0000 mon.smithi008 (mon.0) 5275 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:26.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:25.641484+0000 mon.smithi008 (mon.0) 5276 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:26.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:25.643083+0000 mon.smithi008 (mon.0) 5277 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:26.675 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:25.645079+0000 mon.smithi008 (mon.0) 5278 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:25.620595+0000 mon.smithi008 (mon.0) 5270 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:25.622723+0000 mon.smithi008 (mon.0) 5271 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:25.623704+0000 mon.smithi008 (mon.0) 5272 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:25.630323+0000 mon.smithi008 (mon.0) 5273 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:25.636759+0000 mon.smithi008 (mon.0) 5274 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:25.639837+0000 mon.smithi008 (mon.0) 5275 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:25.641484+0000 mon.smithi008 (mon.0) 5276 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:25.643083+0000 mon.smithi008 (mon.0) 5277 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:25.645079+0000 mon.smithi008 (mon.0) 5278 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:27.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.026+0000 7f2428f56700 1 -- 172.21.15.8:0/3002343428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24240f99e0 msgr2=0x7f24240f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.026+0000 7f2428f56700 1 --2- 172.21.15.8:0/3002343428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24240f99e0 0x7f24240f9e40 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7f2418004660 tx=0x7f2418009b30).stop 2023-10-18T22:22:27.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.026+0000 7f2428f56700 1 -- 172.21.15.8:0/3002343428 shutdown_connections 2023-10-18T22:22:27.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.026+0000 7f2428f56700 1 --2- 172.21.15.8:0/3002343428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24240f99e0 0x7f24240f9e40 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.026+0000 7f2428f56700 1 --2- 172.21.15.8:0/3002343428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24240f8740 0x7f24240f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.026+0000 7f2428f56700 1 -- 172.21.15.8:0/3002343428 >> 172.21.15.8:0/3002343428 conn(0x7f24240f40e0 msgr2=0x7f24240f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:27.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.026+0000 7f2428f56700 1 -- 172.21.15.8:0/3002343428 shutdown_connections 2023-10-18T22:22:27.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.026+0000 7f2428f56700 1 -- 172.21.15.8:0/3002343428 wait complete. 2023-10-18T22:22:27.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.027+0000 7f2428f56700 1 Processor -- start 2023-10-18T22:22:27.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.027+0000 7f2428f56700 1 -- start start 2023-10-18T22:22:27.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f2428f56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24240f8740 0x7f2424108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:27.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f2428f56700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24240f99e0 0x7f2424109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:27.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f2428f56700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24241099e0 con 0x7f24240f99e0 2023-10-18T22:22:27.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f2428f56700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2424109b20 con 0x7f24240f8740 2023-10-18T22:22:27.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f2422ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24240f99e0 0x7f2424109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:27.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f2422ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24240f99e0 0x7f2424109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55194/0 (socket says 172.21.15.8:55194) 2023-10-18T22:22:27.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f2422ffd700 1 -- 172.21.15.8:0/4267618186 learned_addr learned my addr 172.21.15.8:0/4267618186 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:22:27.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f24237fe700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24240f8740 0x7f2424108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:27.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f2422ffd700 1 -- 172.21.15.8:0/4267618186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24240f8740 msgr2=0x7f2424108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f2422ffd700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24240f8740 0x7f2424108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.028+0000 7f2422ffd700 1 -- 172.21.15.8:0/4267618186 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2418005040 con 0x7f24240f99e0 2023-10-18T22:22:27.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.029+0000 7f2422ffd700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24240f99e0 0x7f2424109430 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7f2418004d80 tx=0x7f241800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:27.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.029+0000 7f240bfff700 1 -- 172.21.15.8:0/4267618186 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2418019070 con 0x7f24240f99e0 2023-10-18T22:22:27.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.029+0000 7f240bfff700 1 -- 172.21.15.8:0/4267618186 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f241801e420 con 0x7f24240f99e0 2023-10-18T22:22:27.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.029+0000 7f2428f56700 1 -- 172.21.15.8:0/4267618186 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242410a410 con 0x7f24240f99e0 2023-10-18T22:22:27.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.029+0000 7f240bfff700 1 -- 172.21.15.8:0/4267618186 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2418014680 con 0x7f24240f99e0 2023-10-18T22:22:27.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.029+0000 7f2428f56700 1 -- 172.21.15.8:0/4267618186 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242410a8a0 con 0x7f24240f99e0 2023-10-18T22:22:27.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.031+0000 7f2428f56700 1 -- 172.21.15.8:0/4267618186 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2424045ad0 con 0x7f24240f99e0 2023-10-18T22:22:27.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.031+0000 7f240bfff700 1 -- 172.21.15.8:0/4267618186 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f241801e9c0 con 0x7f24240f99e0 2023-10-18T22:22:27.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.032+0000 7f240bfff700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f240c060f70 0x7f240c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:27.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.032+0000 7f240bfff700 1 -- 172.21.15.8:0/4267618186 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f241807dea0 con 0x7f24240f99e0 2023-10-18T22:22:27.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.033+0000 7f24237fe700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f240c060f70 0x7f240c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:27.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.033+0000 7f24237fe700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f240c060f70 0x7f240c063430 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f24240f9840 tx=0x7f241400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:27.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.037+0000 7f240bfff700 1 -- 172.21.15.8:0/4267618186 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2418051480 con 0x7f24240f99e0 2023-10-18T22:22:27.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.235+0000 7f2428f56700 1 -- 172.21.15.8:0/4267618186 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2424102f00 con 0x7f240c060f70 2023-10-18T22:22:27.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.236+0000 7f240bfff700 1 -- 172.21.15.8:0/4267618186 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2424102f00 con 0x7f240c060f70 2023-10-18T22:22:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.238+0000 7f2428f56700 1 -- 172.21.15.8:0/4267618186 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f240c060f70 msgr2=0x7f240c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.238+0000 7f2428f56700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f240c060f70 0x7f240c063430 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f24240f9840 tx=0x7f241400b040).stop 2023-10-18T22:22:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.238+0000 7f2428f56700 1 -- 172.21.15.8:0/4267618186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24240f99e0 msgr2=0x7f2424109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.238+0000 7f2428f56700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24240f99e0 0x7f2424109430 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7f2418004d80 tx=0x7f241800b040).stop 2023-10-18T22:22:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.238+0000 7f2428f56700 1 -- 172.21.15.8:0/4267618186 shutdown_connections 2023-10-18T22:22:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.238+0000 7f2428f56700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f240c060f70 0x7f240c063430 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.238+0000 7f2428f56700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24240f8740 0x7f2424108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.238+0000 7f2428f56700 1 --2- 172.21.15.8:0/4267618186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24240f99e0 0x7f2424109430 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.238+0000 7f2428f56700 1 -- 172.21.15.8:0/4267618186 >> 172.21.15.8:0/4267618186 conn(0x7f24240f40e0 msgr2=0x7f24240fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:27.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.239+0000 7f2428f56700 1 -- 172.21.15.8:0/4267618186 shutdown_connections 2023-10-18T22:22:27.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.239+0000 7f2428f56700 1 -- 172.21.15.8:0/4267618186 wait complete. 2023-10-18T22:22:27.254 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:22:27.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.376+0000 7f41e1b5d700 1 -- 172.21.15.8:0/973040229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41dc0f6530 msgr2=0x7f41dc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.376+0000 7f41e1b5d700 1 --2- 172.21.15.8:0/973040229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41dc0f6530 0x7f41dc0f6950 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f41d0004660 tx=0x7f41d0009b30).stop 2023-10-18T22:22:27.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.376+0000 7f41e1b5d700 1 -- 172.21.15.8:0/973040229 shutdown_connections 2023-10-18T22:22:27.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.376+0000 7f41e1b5d700 1 --2- 172.21.15.8:0/973040229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41dc0f77d0 0x7f41dc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.376+0000 7f41e1b5d700 1 --2- 172.21.15.8:0/973040229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41dc0f6530 0x7f41dc0f6950 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.376+0000 7f41e1b5d700 1 -- 172.21.15.8:0/973040229 >> 172.21.15.8:0/973040229 conn(0x7f41dc0f1c90 msgr2=0x7f41dc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:27.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.376+0000 7f41e1b5d700 1 -- 172.21.15.8:0/973040229 shutdown_connections 2023-10-18T22:22:27.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.376+0000 7f41e1b5d700 1 -- 172.21.15.8:0/973040229 wait complete. 2023-10-18T22:22:27.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.377+0000 7f41e1b5d700 1 Processor -- start 2023-10-18T22:22:27.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.377+0000 7f41e1b5d700 1 -- start start 2023-10-18T22:22:27.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41e1b5d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41dc0f6530 0x7f41dc106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:27.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41e1b5d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41dc0f77d0 0x7f41dc107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:27.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41e1b5d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc107910 con 0x7f41dc0f6530 2023-10-18T22:22:27.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41e1b5d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc108120 con 0x7f41dc0f77d0 2023-10-18T22:22:27.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41e0b5b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41dc0f6530 0x7f41dc106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:27.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41e0b5b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41dc0f6530 0x7f41dc106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55198/0 (socket says 172.21.15.8:55198) 2023-10-18T22:22:27.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41e0b5b700 1 -- 172.21.15.8:0/496204599 learned_addr learned my addr 172.21.15.8:0/496204599 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:22:27.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41dbfff700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41dc0f77d0 0x7f41dc107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:27.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41e0b5b700 1 -- 172.21.15.8:0/496204599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41dc0f77d0 msgr2=0x7f41dc107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41e0b5b700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41dc0f77d0 0x7f41dc107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.378+0000 7f41e0b5b700 1 -- 172.21.15.8:0/496204599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d0005040 con 0x7f41dc0f6530 2023-10-18T22:22:27.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.379+0000 7f41e0b5b700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41dc0f6530 0x7f41dc106e20 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f41d0009f50 tx=0x7f41d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:27.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.379+0000 7f41d97fa700 1 -- 172.21.15.8:0/496204599 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41d0018070 con 0x7f41dc0f6530 2023-10-18T22:22:27.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.379+0000 7f41e1b5d700 1 -- 172.21.15.8:0/496204599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc108340 con 0x7f41dc0f6530 2023-10-18T22:22:27.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.379+0000 7f41d97fa700 1 -- 172.21.15.8:0/496204599 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f41d001d8e0 con 0x7f41dc0f6530 2023-10-18T22:22:27.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.379+0000 7f41d97fa700 1 -- 172.21.15.8:0/496204599 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41d001c4c0 con 0x7f41dc0f6530 2023-10-18T22:22:27.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.379+0000 7f41e1b5d700 1 -- 172.21.15.8:0/496204599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc1088a0 con 0x7f41dc0f6530 2023-10-18T22:22:27.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.380+0000 7f41e1b5d700 1 -- 172.21.15.8:0/496204599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41dc059100 con 0x7f41dc0f6530 2023-10-18T22:22:27.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.381+0000 7f41d97fa700 1 -- 172.21.15.8:0/496204599 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f41d001d420 con 0x7f41dc0f6530 2023-10-18T22:22:27.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.382+0000 7f41d97fa700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41cc060f70 0x7f41cc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:27.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.382+0000 7f41d97fa700 1 -- 172.21.15.8:0/496204599 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f41d007e8a0 con 0x7f41dc0f6530 2023-10-18T22:22:27.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.382+0000 7f41dbfff700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41cc060f70 0x7f41cc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:27.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.383+0000 7f41dbfff700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41cc060f70 0x7f41cc063430 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f41c8007fd0 tx=0x7f41c8009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.386+0000 7f41d97fa700 1 -- 172.21.15.8:0/496204599 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f41d004e450 con 0x7f41dc0f6530 2023-10-18T22:22:27.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.585+0000 7f41e1b5d700 1 -- 172.21.15.8:0/496204599 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f41dc0fed30 con 0x7f41cc060f70 2023-10-18T22:22:27.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.586+0000 7f41d97fa700 1 -- 172.21.15.8:0/496204599 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f41dc0fed30 con 0x7f41cc060f70 2023-10-18T22:22:27.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 -- 172.21.15.8:0/496204599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41cc060f70 msgr2=0x7f41cc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41cc060f70 0x7f41cc063430 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f41c8007fd0 tx=0x7f41c8009040).stop 2023-10-18T22:22:27.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 -- 172.21.15.8:0/496204599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41dc0f6530 msgr2=0x7f41dc106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41dc0f6530 0x7f41dc106e20 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f41d0009f50 tx=0x7f41d0009b30).stop 2023-10-18T22:22:27.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 -- 172.21.15.8:0/496204599 shutdown_connections 2023-10-18T22:22:27.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41cc060f70 0x7f41cc063430 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41dc0f6530 0x7f41dc106e20 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 --2- 172.21.15.8:0/496204599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41dc0f77d0 0x7f41dc107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 -- 172.21.15.8:0/496204599 >> 172.21.15.8:0/496204599 conn(0x7f41dc0f1c90 msgr2=0x7f41dc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:27.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 -- 172.21.15.8:0/496204599 shutdown_connections 2023-10-18T22:22:27.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.588+0000 7f41e1b5d700 1 -- 172.21.15.8:0/496204599 wait complete. 2023-10-18T22:22:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:25.598167+0000 mgr.smithi008.flmjzp (mgr.14640) 5008 : cluster [DBG] pgmap v3436: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:25.624573+0000 mgr.smithi008.flmjzp (mgr.14640) 5009 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:25.625194+0000 mgr.smithi008.flmjzp (mgr.14640) 5010 : cluster [DBG] pgmap v3437: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:25.625538+0000 mgr.smithi008.flmjzp (mgr.14640) 5011 : cluster [DBG] pgmap v3438: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:25.646932+0000 mgr.smithi008.flmjzp (mgr.14640) 5012 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.724+0000 7f7133fff700 1 -- 172.21.15.8:0/237975806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340f77d0 msgr2=0x7f71340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.724+0000 7f7133fff700 1 --2- 172.21.15.8:0/237975806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340f77d0 0x7f71340f7c30 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f7128004660 tx=0x7f7128009b30).stop 2023-10-18T22:22:27.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.725+0000 7f7133fff700 1 -- 172.21.15.8:0/237975806 shutdown_connections 2023-10-18T22:22:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.725+0000 7f7133fff700 1 --2- 172.21.15.8:0/237975806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340f77d0 0x7f71340f7c30 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.725+0000 7f7133fff700 1 --2- 172.21.15.8:0/237975806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340f6530 0x7f71340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.725+0000 7f7133fff700 1 -- 172.21.15.8:0/237975806 >> 172.21.15.8:0/237975806 conn(0x7f71340f1c90 msgr2=0x7f71340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.725+0000 7f7133fff700 1 -- 172.21.15.8:0/237975806 shutdown_connections 2023-10-18T22:22:27.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.725+0000 7f7133fff700 1 -- 172.21.15.8:0/237975806 wait complete. 2023-10-18T22:22:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.726+0000 7f7133fff700 1 Processor -- start 2023-10-18T22:22:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.726+0000 7f7133fff700 1 -- start start 2023-10-18T22:22:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.726+0000 7f7133fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340f6530 0x7f7134106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:27.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.726+0000 7f7133fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340f77d0 0x7f7134107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.726+0000 7f7133fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7134107850 con 0x7f71340f77d0 2023-10-18T22:22:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.726+0000 7f7133fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7134108060 con 0x7f71340f6530 2023-10-18T22:22:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.726+0000 7f71327fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340f77d0 0x7f7134107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.726+0000 7f71327fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340f77d0 0x7f7134107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55208/0 (socket says 172.21.15.8:55208) 2023-10-18T22:22:27.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.726+0000 7f71327fc700 1 -- 172.21.15.8:0/120349449 learned_addr learned my addr 172.21.15.8:0/120349449 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:22:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.727+0000 7f7132ffd700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340f6530 0x7f7134106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.727+0000 7f71327fc700 1 -- 172.21.15.8:0/120349449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340f6530 msgr2=0x7f7134106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.727+0000 7f71327fc700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340f6530 0x7f7134106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.727+0000 7f71327fc700 1 -- 172.21.15.8:0/120349449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7128005040 con 0x7f71340f77d0 2023-10-18T22:22:27.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.727+0000 7f71327fc700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340f77d0 0x7f7134107250 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f7128004320 tx=0x7f712800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:27.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.727+0000 7f711b7fe700 1 -- 172.21.15.8:0/120349449 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7128019070 con 0x7f71340f77d0 2023-10-18T22:22:27.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.727+0000 7f711b7fe700 1 -- 172.21.15.8:0/120349449 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f712801e420 con 0x7f71340f77d0 2023-10-18T22:22:27.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.727+0000 7f7133fff700 1 -- 172.21.15.8:0/120349449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7134108280 con 0x7f71340f77d0 2023-10-18T22:22:27.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.727+0000 7f711b7fe700 1 -- 172.21.15.8:0/120349449 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7128014660 con 0x7f71340f77d0 2023-10-18T22:22:27.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.727+0000 7f7133fff700 1 -- 172.21.15.8:0/120349449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7134108760 con 0x7f71340f77d0 2023-10-18T22:22:27.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.728+0000 7f7133fff700 1 -- 172.21.15.8:0/120349449 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7134059100 con 0x7f71340f77d0 2023-10-18T22:22:27.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.729+0000 7f711b7fe700 1 -- 172.21.15.8:0/120349449 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f712801e590 con 0x7f71340f77d0 2023-10-18T22:22:27.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.730+0000 7f711b7fe700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f711c060f70 0x7f711c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:27.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.730+0000 7f711b7fe700 1 -- 172.21.15.8:0/120349449 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f712807dec0 con 0x7f71340f77d0 2023-10-18T22:22:27.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.730+0000 7f7132ffd700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f711c060f70 0x7f711c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:27.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.731+0000 7f7132ffd700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f711c060f70 0x7f711c063430 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f7134106ad0 tx=0x7f712400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:27.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.735+0000 7f711b7fe700 1 -- 172.21.15.8:0/120349449 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f712804da10 con 0x7f71340f77d0 2023-10-18T22:22:27.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:25.598167+0000 mgr.smithi008.flmjzp (mgr.14640) 5008 : cluster [DBG] pgmap v3436: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:25.624573+0000 mgr.smithi008.flmjzp (mgr.14640) 5009 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:25.625194+0000 mgr.smithi008.flmjzp (mgr.14640) 5010 : cluster [DBG] pgmap v3437: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:25.625538+0000 mgr.smithi008.flmjzp (mgr.14640) 5011 : cluster [DBG] pgmap v3438: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:25.646932+0000 mgr.smithi008.flmjzp (mgr.14640) 5012 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:27.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.929+0000 7f7133fff700 1 -- 172.21.15.8:0/120349449 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f71340fee30 con 0x7f711c060f70 2023-10-18T22:22:27.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.939+0000 7f711b7fe700 1 -- 172.21.15.8:0/120349449 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f71340fee30 con 0x7f711c060f70 2023-10-18T22:22:27.941 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:22:27.941 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (89m) 6m ago 90m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:22:27.941 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (83m) 6m ago 90m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:22:27.941 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (82m) 4m ago 89m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:22:27.941 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (89m) 6m ago 90m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:22:27.942 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 86m - - 2023-10-18T22:22:27.942 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 86m - - 2023-10-18T22:22:27.942 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 86m - - 2023-10-18T22:22:27.942 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 86m - - 2023-10-18T22:22:27.942 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (84m) 6m ago 91m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:22:27.943 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (83m) 4m ago 89m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:22:27.943 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (83m) 6m ago 92m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:22:27.943 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (83m) 4m ago 89m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:22:27.943 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (90m) 6m ago 90m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:22:27.943 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (89m) 4m ago 89m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:22:27.944 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (82m) 6m ago 89m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:22:27.944 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (80m) 6m ago 88m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:22:27.944 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (80m) 6m ago 88m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:22:27.944 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (79m) 4m ago 88m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:22:27.944 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (79m) 4m ago 88m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:22:27.944 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (78m) 4m ago 87m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:22:27.945 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (84m) 6m ago 89m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:22:27.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 -- 172.21.15.8:0/120349449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f711c060f70 msgr2=0x7f711c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f711c060f70 0x7f711c063430 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f7134106ad0 tx=0x7f712400b040).stop 2023-10-18T22:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 -- 172.21.15.8:0/120349449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340f77d0 msgr2=0x7f7134107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340f77d0 0x7f7134107250 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f7128004320 tx=0x7f712800b040).stop 2023-10-18T22:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 -- 172.21.15.8:0/120349449 shutdown_connections 2023-10-18T22:22:27.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f711c060f70 0x7f711c063430 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340f6530 0x7f7134106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 --2- 172.21.15.8:0/120349449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340f77d0 0x7f7134107250 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 -- 172.21.15.8:0/120349449 >> 172.21.15.8:0/120349449 conn(0x7f71340f1c90 msgr2=0x7f71340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 -- 172.21.15.8:0/120349449 shutdown_connections 2023-10-18T22:22:27.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:27.941+0000 7f7133fff700 1 -- 172.21.15.8:0/120349449 wait complete. 2023-10-18T22:22:28.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.076+0000 7fd4d2f44700 1 -- 172.21.15.8:0/2048831405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4cc0f77d0 msgr2=0x7fd4cc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:28.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.076+0000 7fd4d2f44700 1 --2- 172.21.15.8:0/2048831405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4cc0f77d0 0x7fd4cc0f7c30 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7fd4bc004660 tx=0x7fd4bc009b30).stop 2023-10-18T22:22:28.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.076+0000 7fd4d2f44700 1 -- 172.21.15.8:0/2048831405 shutdown_connections 2023-10-18T22:22:28.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.076+0000 7fd4d2f44700 1 --2- 172.21.15.8:0/2048831405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4cc0f77d0 0x7fd4cc0f7c30 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.076+0000 7fd4d2f44700 1 --2- 172.21.15.8:0/2048831405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4cc0f6530 0x7fd4cc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.076+0000 7fd4d2f44700 1 -- 172.21.15.8:0/2048831405 >> 172.21.15.8:0/2048831405 conn(0x7fd4cc0f1c90 msgr2=0x7fd4cc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.076+0000 7fd4d2f44700 1 -- 172.21.15.8:0/2048831405 shutdown_connections 2023-10-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.076+0000 7fd4d2f44700 1 -- 172.21.15.8:0/2048831405 wait complete. 2023-10-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.077+0000 7fd4d2f44700 1 Processor -- start 2023-10-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.077+0000 7fd4d2f44700 1 -- start start 2023-10-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d2f44700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4cc0f6530 0x7fd4cc108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d2f44700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4cc0f77d0 0x7fd4cc1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:28.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d2f44700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc109970 con 0x7fd4cc0f6530 2023-10-18T22:22:28.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d2f44700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc109ab0 con 0x7fd4cc0f77d0 2023-10-18T22:22:28.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d1f42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4cc0f6530 0x7fd4cc108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:28.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d1f42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4cc0f6530 0x7fd4cc108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55218/0 (socket says 172.21.15.8:55218) 2023-10-18T22:22:28.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d1f42700 1 -- 172.21.15.8:0/3407345886 learned_addr learned my addr 172.21.15.8:0/3407345886 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:22:28.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d1741700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4cc0f77d0 0x7fd4cc1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:28.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d1f42700 1 -- 172.21.15.8:0/3407345886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4cc0f77d0 msgr2=0x7fd4cc1093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:28.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d1f42700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4cc0f77d0 0x7fd4cc1093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d1f42700 1 -- 172.21.15.8:0/3407345886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc005040 con 0x7fd4cc0f6530 2023-10-18T22:22:28.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.078+0000 7fd4d1f42700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4cc0f6530 0x7fd4cc108ed0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7fd4c800e7c0 tx=0x7fd4c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:28.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.079+0000 7fd4c27fc700 1 -- 172.21.15.8:0/3407345886 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4c80092e0 con 0x7fd4cc0f6530 2023-10-18T22:22:28.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.079+0000 7fd4c27fc700 1 -- 172.21.15.8:0/3407345886 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd4c800f040 con 0x7fd4cc0f6530 2023-10-18T22:22:28.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.079+0000 7fd4c27fc700 1 -- 172.21.15.8:0/3407345886 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4c80147e0 con 0x7fd4cc0f6530 2023-10-18T22:22:28.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.079+0000 7fd4d2f44700 1 -- 172.21.15.8:0/3407345886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc10a450 con 0x7fd4cc0f6530 2023-10-18T22:22:28.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.079+0000 7fd4d2f44700 1 -- 172.21.15.8:0/3407345886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4cc10a990 con 0x7fd4cc0f6530 2023-10-18T22:22:28.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.080+0000 7fd4d2f44700 1 -- 172.21.15.8:0/3407345886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4cc045ad0 con 0x7fd4cc0f6530 2023-10-18T22:22:28.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.081+0000 7fd4c27fc700 1 -- 172.21.15.8:0/3407345886 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd4c801b030 con 0x7fd4cc0f6530 2023-10-18T22:22:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.082+0000 7fd4c27fc700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd4b8060f70 0x7fd4b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.082+0000 7fd4c27fc700 1 -- 172.21.15.8:0/3407345886 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd4c807c8d0 con 0x7fd4cc0f6530 2023-10-18T22:22:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.082+0000 7fd4d1741700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd4b8060f70 0x7fd4b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:28.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.082+0000 7fd4d1741700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd4b8060f70 0x7fd4b8063430 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fd4bc009720 tx=0x7fd4bc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:28.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.086+0000 7fd4c27fc700 1 -- 172.21.15.8:0/3407345886 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd4c804ff10 con 0x7fd4cc0f6530 2023-10-18T22:22:28.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.339+0000 7fd4d2f44700 1 -- 172.21.15.8:0/3407345886 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd4cc0fee40 con 0x7fd4cc0f6530 2023-10-18T22:22:28.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.339+0000 7fd4c27fc700 1 -- 172.21.15.8:0/3407345886 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fd4c8019020 con 0x7fd4cc0f6530 2023-10-18T22:22:28.341 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:22:28.341 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:22:28.341 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:22:28.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:22:28.341 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:22:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:22:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:22:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:22:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:22:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:22:28.343 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:22:28.343 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:22:28.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:22:28.343 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:22:28.343 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:22:28.344 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:22:28.344 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:22:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 -- 172.21.15.8:0/3407345886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd4b8060f70 msgr2=0x7fd4b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd4b8060f70 0x7fd4b8063430 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fd4bc009720 tx=0x7fd4bc00b040).stop 2023-10-18T22:22:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 -- 172.21.15.8:0/3407345886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4cc0f6530 msgr2=0x7fd4cc108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4cc0f6530 0x7fd4cc108ed0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7fd4c800e7c0 tx=0x7fd4c800b040).stop 2023-10-18T22:22:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 -- 172.21.15.8:0/3407345886 shutdown_connections 2023-10-18T22:22:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd4b8060f70 0x7fd4b8063430 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4cc0f6530 0x7fd4cc108ed0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 --2- 172.21.15.8:0/3407345886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4cc0f77d0 0x7fd4cc1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 -- 172.21.15.8:0/3407345886 >> 172.21.15.8:0/3407345886 conn(0x7fd4cc0f1c90 msgr2=0x7fd4cc0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 -- 172.21.15.8:0/3407345886 shutdown_connections 2023-10-18T22:22:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.341+0000 7fd4d2f44700 1 -- 172.21.15.8:0/3407345886 wait complete. 2023-10-18T22:22:28.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.480+0000 7f420900c700 1 -- 172.21.15.8:0/2930425905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42040f6530 msgr2=0x7f42040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:28.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.480+0000 7f420900c700 1 --2- 172.21.15.8:0/2930425905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42040f6530 0x7f42040f6950 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7f41f4004660 tx=0x7f41f4009b30).stop 2023-10-18T22:22:28.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.480+0000 7f420900c700 1 -- 172.21.15.8:0/2930425905 shutdown_connections 2023-10-18T22:22:28.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.480+0000 7f420900c700 1 --2- 172.21.15.8:0/2930425905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42040f77d0 0x7f42040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.480+0000 7f420900c700 1 --2- 172.21.15.8:0/2930425905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42040f6530 0x7f42040f6950 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.480+0000 7f420900c700 1 -- 172.21.15.8:0/2930425905 >> 172.21.15.8:0/2930425905 conn(0x7f42040f1c90 msgr2=0x7f42040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:28.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.480+0000 7f420900c700 1 -- 172.21.15.8:0/2930425905 shutdown_connections 2023-10-18T22:22:28.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.480+0000 7f420900c700 1 -- 172.21.15.8:0/2930425905 wait complete. 2023-10-18T22:22:28.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.481+0000 7f420900c700 1 Processor -- start 2023-10-18T22:22:28.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.481+0000 7f420900c700 1 -- start start 2023-10-18T22:22:28.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.481+0000 7f420900c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42040f6530 0x7f4204108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:28.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f420900c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42040f77d0 0x7f42041093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:28.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f420900c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4204109990 con 0x7f42040f6530 2023-10-18T22:22:28.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f420900c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4204109ad0 con 0x7f42040f77d0 2023-10-18T22:22:28.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f4203fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42040f6530 0x7f4204108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:28.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f4203fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42040f6530 0x7f4204108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55240/0 (socket says 172.21.15.8:55240) 2023-10-18T22:22:28.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f4203fff700 1 -- 172.21.15.8:0/1202899251 learned_addr learned my addr 172.21.15.8:0/1202899251 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:22:28.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f42037fe700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42040f77d0 0x7f42041093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:28.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f4203fff700 1 -- 172.21.15.8:0/1202899251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42040f77d0 msgr2=0x7f42041093e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:28.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f4203fff700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42040f77d0 0x7f42041093e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f4203fff700 1 -- 172.21.15.8:0/1202899251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4005040 con 0x7f42040f6530 2023-10-18T22:22:28.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f42037fe700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42040f77d0 0x7f42041093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:22:28.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.482+0000 7f4203fff700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42040f6530 0x7f4204108ef0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f41f4007a60 tx=0x7f41f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:28.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.483+0000 7f4200ff9700 1 -- 172.21.15.8:0/1202899251 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41f4018070 con 0x7f42040f6530 2023-10-18T22:22:28.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.483+0000 7f4200ff9700 1 -- 172.21.15.8:0/1202899251 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f41f4009630 con 0x7f42040f6530 2023-10-18T22:22:28.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.483+0000 7f4200ff9700 1 -- 172.21.15.8:0/1202899251 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41f401c540 con 0x7f42040f6530 2023-10-18T22:22:28.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.483+0000 7f420900c700 1 -- 172.21.15.8:0/1202899251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420410a410 con 0x7f42040f6530 2023-10-18T22:22:28.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.483+0000 7f420900c700 1 -- 172.21.15.8:0/1202899251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420410a970 con 0x7f42040f6530 2023-10-18T22:22:28.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.484+0000 7f420900c700 1 -- 172.21.15.8:0/1202899251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4204045ad0 con 0x7f42040f6530 2023-10-18T22:22:28.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.485+0000 7f4200ff9700 1 -- 172.21.15.8:0/1202899251 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f41f401c7b0 con 0x7f42040f6530 2023-10-18T22:22:28.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.486+0000 7f4200ff9700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41ec060f70 0x7f41ec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:28.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.486+0000 7f4200ff9700 1 -- 172.21.15.8:0/1202899251 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f41f407e690 con 0x7f42040f6530 2023-10-18T22:22:28.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.486+0000 7f42037fe700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41ec060f70 0x7f41ec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:28.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.486+0000 7f42037fe700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41ec060f70 0x7f41ec063430 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f41f8009760 tx=0x7f41f8009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:28.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.490+0000 7f4200ff9700 1 -- 172.21.15.8:0/1202899251 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f41f4051d30 con 0x7f42040f6530 2023-10-18T22:22:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:27.236874+0000 mgr.smithi008.flmjzp (mgr.14640) 5013 : audit [DBG] from='client.38008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:22:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:28.339764+0000 mon.smithi008 (mon.0) 5279 : audit [DBG] from='client.? 172.21.15.8:0/3407345886' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:28.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.718+0000 7f420900c700 1 -- 172.21.15.8:0/1202899251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f42040fedd0 con 0x7f42040f6530 2023-10-18T22:22:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.718+0000 7f4200ff9700 1 -- 172.21.15.8:0/1202899251 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f41f4051920 con 0x7f42040f6530 2023-10-18T22:22:28.720 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:22:28.720 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:22:28.720 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:22:28.721 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:22:28.721 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:22:28.721 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:22:28.721 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:22:28.721 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:22:28.722 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:22:28.722 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:22:28.722 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:22:28.722 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:22:28.722 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:22:28.723 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:22:28.723 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:22:28.723 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:22:28.723 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:22:28.723 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:22:28.724 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:22:28.724 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:22:28.724 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:22:28.724 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:22:28.724 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:22:28.724 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:22:28.725 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:22:28.725 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:22:28.725 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:22:28.725 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:22:28.725 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:22:28.726 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:22:28.726 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:22:28.726 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:22:28.726 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:22:28.726 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:22:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 -- 172.21.15.8:0/1202899251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41ec060f70 msgr2=0x7f41ec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41ec060f70 0x7f41ec063430 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f41f8009760 tx=0x7f41f8009c60).stop 2023-10-18T22:22:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 -- 172.21.15.8:0/1202899251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42040f6530 msgr2=0x7f4204108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42040f6530 0x7f4204108ef0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f41f4007a60 tx=0x7f41f4009b30).stop 2023-10-18T22:22:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 -- 172.21.15.8:0/1202899251 shutdown_connections 2023-10-18T22:22:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f41ec060f70 0x7f41ec063430 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42040f6530 0x7f4204108ef0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 --2- 172.21.15.8:0/1202899251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42040f77d0 0x7f42041093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 -- 172.21.15.8:0/1202899251 >> 172.21.15.8:0/1202899251 conn(0x7f42040f1c90 msgr2=0x7f420406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 -- 172.21.15.8:0/1202899251 shutdown_connections 2023-10-18T22:22:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.720+0000 7f420900c700 1 -- 172.21.15.8:0/1202899251 wait complete. 2023-10-18T22:22:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:22:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:27.236874+0000 mgr.smithi008.flmjzp (mgr.14640) 5013 : audit [DBG] from='client.38008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:22:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:28.339764+0000 mon.smithi008 (mon.0) 5279 : audit [DBG] from='client.? 172.21.15.8:0/3407345886' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:28.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.856+0000 7fca4e721700 1 -- 172.21.15.8:0/1422798032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca480f77d0 msgr2=0x7fca480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:28.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.856+0000 7fca4e721700 1 --2- 172.21.15.8:0/1422798032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca480f77d0 0x7fca480f7c30 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7fca38004660 tx=0x7fca38009b30).stop 2023-10-18T22:22:28.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.857+0000 7fca4e721700 1 -- 172.21.15.8:0/1422798032 shutdown_connections 2023-10-18T22:22:28.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.857+0000 7fca4e721700 1 --2- 172.21.15.8:0/1422798032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca480f77d0 0x7fca480f7c30 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.857+0000 7fca4e721700 1 --2- 172.21.15.8:0/1422798032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca480f6530 0x7fca480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.857+0000 7fca4e721700 1 -- 172.21.15.8:0/1422798032 >> 172.21.15.8:0/1422798032 conn(0x7fca480f1cd0 msgr2=0x7fca480f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:28.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.857+0000 7fca4e721700 1 -- 172.21.15.8:0/1422798032 shutdown_connections 2023-10-18T22:22:28.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.857+0000 7fca4e721700 1 -- 172.21.15.8:0/1422798032 wait complete. 2023-10-18T22:22:28.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.858+0000 7fca4e721700 1 Processor -- start 2023-10-18T22:22:28.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.858+0000 7fca4e721700 1 -- start start 2023-10-18T22:22:28.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4e721700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca480f6530 0x7fca4806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:28.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4e721700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca480f77d0 0x7fca48069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:28.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4e721700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4806a380 con 0x7fca480f6530 2023-10-18T22:22:28.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4e721700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4806a4c0 con 0x7fca480f77d0 2023-10-18T22:22:28.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4d71f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca480f6530 0x7fca4806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:28.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4d71f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca480f6530 0x7fca4806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55252/0 (socket says 172.21.15.8:55252) 2023-10-18T22:22:28.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4d71f700 1 -- 172.21.15.8:0/259852458 learned_addr learned my addr 172.21.15.8:0/259852458 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:22:28.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4cf1e700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca480f77d0 0x7fca48069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:28.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4d71f700 1 -- 172.21.15.8:0/259852458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca480f77d0 msgr2=0x7fca48069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:28.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4d71f700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca480f77d0 0x7fca48069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:28.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4d71f700 1 -- 172.21.15.8:0/259852458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38005040 con 0x7fca480f6530 2023-10-18T22:22:28.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4cf1e700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca480f77d0 0x7fca48069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:22:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.859+0000 7fca4d71f700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca480f6530 0x7fca4806b9a0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7fca44002700 tx=0x7fca44009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.860+0000 7fca3dffb700 1 -- 172.21.15.8:0/259852458 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca44009320 con 0x7fca480f6530 2023-10-18T22:22:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.860+0000 7fca3dffb700 1 -- 172.21.15.8:0/259852458 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fca4400f040 con 0x7fca480f6530 2023-10-18T22:22:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.860+0000 7fca4e721700 1 -- 172.21.15.8:0/259852458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4806a7a0 con 0x7fca480f6530 2023-10-18T22:22:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.860+0000 7fca3dffb700 1 -- 172.21.15.8:0/259852458 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca44014970 con 0x7fca480f6530 2023-10-18T22:22:28.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.860+0000 7fca4e721700 1 -- 172.21.15.8:0/259852458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4810ed60 con 0x7fca480f6530 2023-10-18T22:22:28.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.861+0000 7fca4e721700 1 -- 172.21.15.8:0/259852458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca48045ad0 con 0x7fca480f6530 2023-10-18T22:22:28.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.862+0000 7fca3dffb700 1 -- 172.21.15.8:0/259852458 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fca44009480 con 0x7fca480f6530 2023-10-18T22:22:28.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.863+0000 7fca3dffb700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca34060f70 0x7fca34063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:28.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.863+0000 7fca3dffb700 1 -- 172.21.15.8:0/259852458 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fca4407cad0 con 0x7fca480f6530 2023-10-18T22:22:28.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.863+0000 7fca4cf1e700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca34060f70 0x7fca34063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.864+0000 7fca4cf1e700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca34060f70 0x7fca34063430 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fca38005010 tx=0x7fca38009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:28.867+0000 7fca3dffb700 1 -- 172.21.15.8:0/259852458 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fca4404c7c0 con 0x7fca480f6530 2023-10-18T22:22:29.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.066+0000 7fca4e721700 1 -- 172.21.15.8:0/259852458 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca480fee40 con 0x7fca34060f70 2023-10-18T22:22:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.067+0000 7fca3dffb700 1 -- 172.21.15.8:0/259852458 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fca480fee40 con 0x7fca34060f70 2023-10-18T22:22:29.069 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:22:29.069 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:22:29.069 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:22:29.070 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:22:29.070 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:22:29.070 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:22:29.070 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:22:29.070 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:22:29.071 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:22:29.071 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:22:29.071 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:22:29.071 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:22:29.071 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:22:29.072 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:22:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.069+0000 7fca4e721700 1 -- 172.21.15.8:0/259852458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca34060f70 msgr2=0x7fca34063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.069+0000 7fca4e721700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca34060f70 0x7fca34063430 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fca38005010 tx=0x7fca38009b30).stop 2023-10-18T22:22:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.069+0000 7fca4e721700 1 -- 172.21.15.8:0/259852458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca480f6530 msgr2=0x7fca4806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.069+0000 7fca4e721700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca480f6530 0x7fca4806b9a0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7fca44002700 tx=0x7fca44009d80).stop 2023-10-18T22:22:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.070+0000 7fca4e721700 1 -- 172.21.15.8:0/259852458 shutdown_connections 2023-10-18T22:22:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.070+0000 7fca4e721700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fca34060f70 0x7fca34063430 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.070+0000 7fca4e721700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca480f6530 0x7fca4806b9a0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.070+0000 7fca4e721700 1 --2- 172.21.15.8:0/259852458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca480f77d0 0x7fca48069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.070+0000 7fca4e721700 1 -- 172.21.15.8:0/259852458 >> 172.21.15.8:0/259852458 conn(0x7fca480f1cd0 msgr2=0x7fca480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.070+0000 7fca4e721700 1 -- 172.21.15.8:0/259852458 shutdown_connections 2023-10-18T22:22:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:29.070+0000 7fca4e721700 1 -- 172.21.15.8:0/259852458 wait complete. 2023-10-18T22:22:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:27.586371+0000 mgr.smithi008.flmjzp (mgr.14640) 5014 : audit [DBG] from='client.38012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:22:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:27.626093+0000 mgr.smithi008.flmjzp (mgr.14640) 5015 : cluster [DBG] pgmap v3439: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:27.931204+0000 mgr.smithi008.flmjzp (mgr.14640) 5016 : audit [DBG] from='client.38016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:22:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:28.718769+0000 mon.smithi008 (mon.0) 5280 : audit [DBG] from='client.? 172.21.15.8:0/1202899251' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:22:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:27.586371+0000 mgr.smithi008.flmjzp (mgr.14640) 5014 : audit [DBG] from='client.38012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:22:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:27.626093+0000 mgr.smithi008.flmjzp (mgr.14640) 5015 : cluster [DBG] pgmap v3439: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:27.931204+0000 mgr.smithi008.flmjzp (mgr.14640) 5016 : audit [DBG] from='client.38016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:22:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:28.718769+0000 mon.smithi008 (mon.0) 5280 : audit [DBG] from='client.? 172.21.15.8:0/1202899251' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:22:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:29.067825+0000 mgr.smithi008.flmjzp (mgr.14640) 5017 : audit [DBG] from='client.38028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:22:30.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:29.067825+0000 mgr.smithi008.flmjzp (mgr.14640) 5017 : audit [DBG] from='client.38028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:22:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:29.626801+0000 mgr.smithi008.flmjzp (mgr.14640) 5018 : cluster [DBG] pgmap v3440: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:29.626801+0000 mgr.smithi008.flmjzp (mgr.14640) 5018 : cluster [DBG] pgmap v3440: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:33.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:31.627345+0000 mgr.smithi008.flmjzp (mgr.14640) 5019 : cluster [DBG] pgmap v3441: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:33.850 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:31.627345+0000 mgr.smithi008.flmjzp (mgr.14640) 5019 : cluster [DBG] pgmap v3441: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:33.628072+0000 mgr.smithi008.flmjzp (mgr.14640) 5020 : cluster [DBG] pgmap v3442: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:35.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:33.628072+0000 mgr.smithi008.flmjzp (mgr.14640) 5020 : cluster [DBG] pgmap v3442: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:35.657688+0000 mon.smithi008 (mon.0) 5281 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:36.217560+0000 mon.smithi008 (mon.0) 5282 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:36.218652+0000 mon.smithi008 (mon.0) 5283 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:36.225305+0000 mon.smithi008 (mon.0) 5284 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:36.233380+0000 mon.smithi008 (mon.0) 5285 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:36.236786+0000 mon.smithi008 (mon.0) 5286 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:36.238757+0000 mon.smithi008 (mon.0) 5287 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:36.240638+0000 mon.smithi008 (mon.0) 5288 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:36.243259+0000 mon.smithi008 (mon.0) 5289 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:35.657688+0000 mon.smithi008 (mon.0) 5281 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:36.217560+0000 mon.smithi008 (mon.0) 5282 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:36.218652+0000 mon.smithi008 (mon.0) 5283 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:36.225305+0000 mon.smithi008 (mon.0) 5284 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:36.233380+0000 mon.smithi008 (mon.0) 5285 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:36.236786+0000 mon.smithi008 (mon.0) 5286 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:36.238757+0000 mon.smithi008 (mon.0) 5287 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:36.240638+0000 mon.smithi008 (mon.0) 5288 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:36.243259+0000 mon.smithi008 (mon.0) 5289 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:35.628854+0000 mgr.smithi008.flmjzp (mgr.14640) 5021 : cluster [DBG] pgmap v3443: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:36.219491+0000 mgr.smithi008.flmjzp (mgr.14640) 5022 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:36.220185+0000 mgr.smithi008.flmjzp (mgr.14640) 5023 : cluster [DBG] pgmap v3444: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:36.220463+0000 mgr.smithi008.flmjzp (mgr.14640) 5024 : cluster [DBG] pgmap v3445: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:36.245393+0000 mgr.smithi008.flmjzp (mgr.14640) 5025 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:35.628854+0000 mgr.smithi008.flmjzp (mgr.14640) 5021 : cluster [DBG] pgmap v3443: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:36.219491+0000 mgr.smithi008.flmjzp (mgr.14640) 5022 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:36.220185+0000 mgr.smithi008.flmjzp (mgr.14640) 5023 : cluster [DBG] pgmap v3444: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:36.220463+0000 mgr.smithi008.flmjzp (mgr.14640) 5024 : cluster [DBG] pgmap v3445: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:36.245393+0000 mgr.smithi008.flmjzp (mgr.14640) 5025 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:38.220953+0000 mgr.smithi008.flmjzp (mgr.14640) 5026 : cluster [DBG] pgmap v3446: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:38.220953+0000 mgr.smithi008.flmjzp (mgr.14640) 5026 : cluster [DBG] pgmap v3446: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:41.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:40.221736+0000 mgr.smithi008.flmjzp (mgr.14640) 5027 : cluster [DBG] pgmap v3447: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:40.221736+0000 mgr.smithi008.flmjzp (mgr.14640) 5027 : cluster [DBG] pgmap v3447: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:42.222306+0000 mgr.smithi008.flmjzp (mgr.14640) 5028 : cluster [DBG] pgmap v3448: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:43.851 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:42.222306+0000 mgr.smithi008.flmjzp (mgr.14640) 5028 : cluster [DBG] pgmap v3448: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:44.223004+0000 mgr.smithi008.flmjzp (mgr.14640) 5029 : cluster [DBG] pgmap v3449: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:44.223004+0000 mgr.smithi008.flmjzp (mgr.14640) 5029 : cluster [DBG] pgmap v3449: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:46.254868+0000 mon.smithi008 (mon.0) 5290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:46.254868+0000 mon.smithi008 (mon.0) 5290 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:46.223688+0000 mgr.smithi008.flmjzp (mgr.14640) 5030 : cluster [DBG] pgmap v3450: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:46.608095+0000 mon.smithi008 (mon.0) 5291 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:46.609074+0000 mon.smithi008 (mon.0) 5292 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:46.609825+0000 mon.smithi008 (mon.0) 5293 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:46.615031+0000 mon.smithi008 (mon.0) 5294 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:46.620615+0000 mon.smithi008 (mon.0) 5295 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:46.623345+0000 mon.smithi008 (mon.0) 5296 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:46.624715+0000 mon.smithi008 (mon.0) 5297 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:47.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:46.625896+0000 mon.smithi008 (mon.0) 5298 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:47.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:46.627394+0000 mon.smithi008 (mon.0) 5299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:46.223688+0000 mgr.smithi008.flmjzp (mgr.14640) 5030 : cluster [DBG] pgmap v3450: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:46.608095+0000 mon.smithi008 (mon.0) 5291 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:46.609074+0000 mon.smithi008 (mon.0) 5292 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:46.609825+0000 mon.smithi008 (mon.0) 5293 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:46.615031+0000 mon.smithi008 (mon.0) 5294 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:46.620615+0000 mon.smithi008 (mon.0) 5295 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:46.623345+0000 mon.smithi008 (mon.0) 5296 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:46.624715+0000 mon.smithi008 (mon.0) 5297 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:46.625896+0000 mon.smithi008 (mon.0) 5298 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:46.627394+0000 mon.smithi008 (mon.0) 5299 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:46.610440+0000 mgr.smithi008.flmjzp (mgr.14640) 5031 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:46.610931+0000 mgr.smithi008.flmjzp (mgr.14640) 5032 : cluster [DBG] pgmap v3451: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:46.611187+0000 mgr.smithi008.flmjzp (mgr.14640) 5033 : cluster [DBG] pgmap v3452: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:46.628954+0000 mgr.smithi008.flmjzp (mgr.14640) 5034 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:46.610440+0000 mgr.smithi008.flmjzp (mgr.14640) 5031 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:46.610931+0000 mgr.smithi008.flmjzp (mgr.14640) 5032 : cluster [DBG] pgmap v3451: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:46.611187+0000 mgr.smithi008.flmjzp (mgr.14640) 5033 : cluster [DBG] pgmap v3452: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:46.628954+0000 mgr.smithi008.flmjzp (mgr.14640) 5034 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:48.611881+0000 mgr.smithi008.flmjzp (mgr.14640) 5035 : cluster [DBG] pgmap v3453: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:50.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:48.611881+0000 mgr.smithi008.flmjzp (mgr.14640) 5035 : cluster [DBG] pgmap v3453: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:50.612602+0000 mgr.smithi008.flmjzp (mgr.14640) 5036 : cluster [DBG] pgmap v3454: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:50.612602+0000 mgr.smithi008.flmjzp (mgr.14640) 5036 : cluster [DBG] pgmap v3454: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:52.613111+0000 mgr.smithi008.flmjzp (mgr.14640) 5037 : cluster [DBG] pgmap v3455: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:52.613111+0000 mgr.smithi008.flmjzp (mgr.14640) 5037 : cluster [DBG] pgmap v3455: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:54.613737+0000 mgr.smithi008.flmjzp (mgr.14640) 5038 : cluster [DBG] pgmap v3456: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:55.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:54.613737+0000 mgr.smithi008.flmjzp (mgr.14640) 5038 : cluster [DBG] pgmap v3456: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:56.636216+0000 mon.smithi008 (mon.0) 5300 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:56.638247+0000 mon.smithi008 (mon.0) 5301 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:56.639373+0000 mon.smithi008 (mon.0) 5302 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:56.646018+0000 mon.smithi008 (mon.0) 5303 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:56.653682+0000 mon.smithi008 (mon.0) 5304 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:56.656670+0000 mon.smithi008 (mon.0) 5305 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:56.658257+0000 mon.smithi008 (mon.0) 5306 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:56.659772+0000 mon.smithi008 (mon.0) 5307 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:56.661729+0000 mon.smithi008 (mon.0) 5308 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:56.636216+0000 mon.smithi008 (mon.0) 5300 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:56.638247+0000 mon.smithi008 (mon.0) 5301 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:22:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:56.639373+0000 mon.smithi008 (mon.0) 5302 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:22:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:56.646018+0000 mon.smithi008 (mon.0) 5303 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:22:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:56.653682+0000 mon.smithi008 (mon.0) 5304 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:22:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:56.656670+0000 mon.smithi008 (mon.0) 5305 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:56.658257+0000 mon.smithi008 (mon.0) 5306 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:56.659772+0000 mon.smithi008 (mon.0) 5307 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:57.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:56.661729+0000 mon.smithi008 (mon.0) 5308 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:22:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:56.614284+0000 mgr.smithi008.flmjzp (mgr.14640) 5039 : cluster [DBG] pgmap v3457: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:56.640307+0000 mgr.smithi008.flmjzp (mgr.14640) 5040 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:56.641061+0000 mgr.smithi008.flmjzp (mgr.14640) 5041 : cluster [DBG] pgmap v3458: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:56.641388+0000 mgr.smithi008.flmjzp (mgr.14640) 5042 : cluster [DBG] pgmap v3459: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:22:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:22:56.663611+0000 mgr.smithi008.flmjzp (mgr.14640) 5043 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:56.614284+0000 mgr.smithi008.flmjzp (mgr.14640) 5039 : cluster [DBG] pgmap v3457: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:56.640307+0000 mgr.smithi008.flmjzp (mgr.14640) 5040 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:22:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:56.641061+0000 mgr.smithi008.flmjzp (mgr.14640) 5041 : cluster [DBG] pgmap v3458: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:56.641388+0000 mgr.smithi008.flmjzp (mgr.14640) 5042 : cluster [DBG] pgmap v3459: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:22:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:22:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:22:56.663611+0000 mgr.smithi008.flmjzp (mgr.14640) 5043 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:22:59.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.222+0000 7f91ecad5700 1 -- 172.21.15.8:0/1541690036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91e80f9850 msgr2=0x7f91e80fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:59.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.222+0000 7f91ecad5700 1 --2- 172.21.15.8:0/1541690036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91e80f9850 0x7f91e80fbc80 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7f91dc004660 tx=0x7f91dc009b30).stop 2023-10-18T22:22:59.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.222+0000 7f91ecad5700 1 -- 172.21.15.8:0/1541690036 shutdown_connections 2023-10-18T22:22:59.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.222+0000 7f91ecad5700 1 --2- 172.21.15.8:0/1541690036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91e80f9850 0x7f91e80fbc80 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.222+0000 7f91ecad5700 1 --2- 172.21.15.8:0/1541690036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91e8060250 0x7f91e80f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.222+0000 7f91ecad5700 1 -- 172.21.15.8:0/1541690036 >> 172.21.15.8:0/1541690036 conn(0x7f91e80f0d40 msgr2=0x7f91e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:59.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.222+0000 7f91ecad5700 1 -- 172.21.15.8:0/1541690036 shutdown_connections 2023-10-18T22:22:59.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.222+0000 7f91ecad5700 1 -- 172.21.15.8:0/1541690036 wait complete. 2023-10-18T22:22:59.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.223+0000 7f91ecad5700 1 Processor -- start 2023-10-18T22:22:59.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.223+0000 7f91ecad5700 1 -- start start 2023-10-18T22:22:59.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.223+0000 7f91ecad5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91e8060250 0x7f91e80f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:59.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.223+0000 7f91ecad5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91e80f9850 0x7f91e80f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:59.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.223+0000 7f91ecad5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80f57c0 con 0x7f91e8060250 2023-10-18T22:22:59.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.223+0000 7f91ecad5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80f5900 con 0x7f91e80f9850 2023-10-18T22:22:59.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.223+0000 7f91e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91e8060250 0x7f91e80f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:59.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.224+0000 7f91e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91e8060250 0x7f91e80f6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39110/0 (socket says 172.21.15.8:39110) 2023-10-18T22:22:59.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.224+0000 7f91e659c700 1 -- 172.21.15.8:0/773208450 learned_addr learned my addr 172.21.15.8:0/773208450 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:22:59.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.224+0000 7f91e5d9b700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91e80f9850 0x7f91e80f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:59.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.224+0000 7f91e659c700 1 -- 172.21.15.8:0/773208450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91e80f9850 msgr2=0x7f91e80f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:59.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.224+0000 7f91e659c700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91e80f9850 0x7f91e80f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.224+0000 7f91e659c700 1 -- 172.21.15.8:0/773208450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc005040 con 0x7f91e8060250 2023-10-18T22:22:59.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.224+0000 7f91e659c700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91e8060250 0x7f91e80f6de0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f91d80026d0 tx=0x7f91d8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:59.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.224+0000 7f91d6ffd700 1 -- 172.21.15.8:0/773208450 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91d80079c0 con 0x7f91e8060250 2023-10-18T22:22:59.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.225+0000 7f91d6ffd700 1 -- 172.21.15.8:0/773208450 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f91d800f040 con 0x7f91e8060250 2023-10-18T22:22:59.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.225+0000 7f91ecad5700 1 -- 172.21.15.8:0/773208450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e80f5be0 con 0x7f91e8060250 2023-10-18T22:22:59.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.225+0000 7f91d6ffd700 1 -- 172.21.15.8:0/773208450 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91d8014980 con 0x7f91e8060250 2023-10-18T22:22:59.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.225+0000 7f91ecad5700 1 -- 172.21.15.8:0/773208450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e810efc0 con 0x7f91e8060250 2023-10-18T22:22:59.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.226+0000 7f91ecad5700 1 -- 172.21.15.8:0/773208450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e8045ad0 con 0x7f91e8060250 2023-10-18T22:22:59.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.227+0000 7f91d6ffd700 1 -- 172.21.15.8:0/773208450 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f91d80090d0 con 0x7f91e8060250 2023-10-18T22:22:59.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.227+0000 7f91d6ffd700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91d0060f20 0x7f91d00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:59.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.228+0000 7f91d6ffd700 1 -- 172.21.15.8:0/773208450 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f91d807c7d0 con 0x7f91e8060250 2023-10-18T22:22:59.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.228+0000 7f91e5d9b700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91d0060f20 0x7f91d00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:59.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.228+0000 7f91e5d9b700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91d0060f20 0x7f91d00633e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f91dc009f50 tx=0x7f91dc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:59.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.232+0000 7f91d6ffd700 1 -- 172.21.15.8:0/773208450 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f91d804c570 con 0x7f91e8060250 2023-10-18T22:22:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.429+0000 7f91ecad5700 1 -- 172.21.15.8:0/773208450 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91e80fef70 con 0x7f91d0060f20 2023-10-18T22:22:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.430+0000 7f91d6ffd700 1 -- 172.21.15.8:0/773208450 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f91e80fef70 con 0x7f91d0060f20 2023-10-18T22:22:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.432+0000 7f91ecad5700 1 -- 172.21.15.8:0/773208450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91d0060f20 msgr2=0x7f91d00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.432+0000 7f91ecad5700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91d0060f20 0x7f91d00633e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f91dc009f50 tx=0x7f91dc009b30).stop 2023-10-18T22:22:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.432+0000 7f91ecad5700 1 -- 172.21.15.8:0/773208450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91e8060250 msgr2=0x7f91e80f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.432+0000 7f91ecad5700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91e8060250 0x7f91e80f6de0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f91d80026d0 tx=0x7f91d8009de0).stop 2023-10-18T22:22:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.432+0000 7f91ecad5700 1 -- 172.21.15.8:0/773208450 shutdown_connections 2023-10-18T22:22:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.432+0000 7f91ecad5700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f91d0060f20 0x7f91d00633e0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.432+0000 7f91ecad5700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91e8060250 0x7f91e80f6de0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.432+0000 7f91ecad5700 1 --2- 172.21.15.8:0/773208450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91e80f9850 0x7f91e80f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.432+0000 7f91ecad5700 1 -- 172.21.15.8:0/773208450 >> 172.21.15.8:0/773208450 conn(0x7f91e80f0d40 msgr2=0x7f91e80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.433+0000 7f91ecad5700 1 -- 172.21.15.8:0/773208450 shutdown_connections 2023-10-18T22:22:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.433+0000 7f91ecad5700 1 -- 172.21.15.8:0/773208450 wait complete. 2023-10-18T22:22:59.449 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:22:59.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.571+0000 7fd9d5439700 1 -- 172.21.15.8:0/1047405454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9d0060310 msgr2=0x7fd9d00f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:59.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.571+0000 7fd9d5439700 1 --2- 172.21.15.8:0/1047405454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9d0060310 0x7fd9d00f9120 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7fd9c0004660 tx=0x7fd9c0009b30).stop 2023-10-18T22:22:59.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.571+0000 7fd9d5439700 1 -- 172.21.15.8:0/1047405454 shutdown_connections 2023-10-18T22:22:59.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.571+0000 7fd9d5439700 1 --2- 172.21.15.8:0/1047405454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9d00f96a0 0x7fd9d00fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.571+0000 7fd9d5439700 1 --2- 172.21.15.8:0/1047405454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9d0060310 0x7fd9d00f9120 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.571+0000 7fd9d5439700 1 -- 172.21.15.8:0/1047405454 >> 172.21.15.8:0/1047405454 conn(0x7fd9d00f0ba0 msgr2=0x7fd9d00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:59.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.571+0000 7fd9d5439700 1 -- 172.21.15.8:0/1047405454 shutdown_connections 2023-10-18T22:22:59.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.571+0000 7fd9d5439700 1 -- 172.21.15.8:0/1047405454 wait complete. 2023-10-18T22:22:59.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.572+0000 7fd9d5439700 1 Processor -- start 2023-10-18T22:22:59.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.572+0000 7fd9d5439700 1 -- start start 2023-10-18T22:22:59.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.572+0000 7fd9d5439700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9d0060310 0x7fd9d00f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:59.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.572+0000 7fd9d5439700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9d00f96a0 0x7fd9d00f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:59.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.572+0000 7fd9d5439700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00f5580 con 0x7fd9d00f96a0 2023-10-18T22:22:59.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.572+0000 7fd9d5439700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00f56c0 con 0x7fd9d0060310 2023-10-18T22:22:59.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.573+0000 7fd9cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9d0060310 0x7fd9d00f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:59.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.573+0000 7fd9cf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9d00f96a0 0x7fd9d00f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:59.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.573+0000 7fd9cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9d0060310 0x7fd9d00f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:53442/0 (socket says 172.21.15.8:53442) 2023-10-18T22:22:59.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.573+0000 7fd9cffff700 1 -- 172.21.15.8:0/1633115030 learned_addr learned my addr 172.21.15.8:0/1633115030 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:22:59.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.573+0000 7fd9cffff700 1 -- 172.21.15.8:0/1633115030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9d00f96a0 msgr2=0x7fd9d00f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:59.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.573+0000 7fd9cffff700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9d00f96a0 0x7fd9d00f5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.573+0000 7fd9cffff700 1 -- 172.21.15.8:0/1633115030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c0005040 con 0x7fd9d0060310 2023-10-18T22:22:59.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.573+0000 7fd9cf7fe700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9d00f96a0 0x7fd9d00f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T22:22:59.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.573+0000 7fd9cffff700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9d0060310 0x7fd9d00f6ba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd9c0004d80 tx=0x7fd9c000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:59.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.574+0000 7fd9ccff9700 1 -- 172.21.15.8:0/1633115030 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9c0019070 con 0x7fd9d0060310 2023-10-18T22:22:59.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.574+0000 7fd9d5439700 1 -- 172.21.15.8:0/1633115030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d00f5940 con 0x7fd9d0060310 2023-10-18T22:22:59.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.574+0000 7fd9ccff9700 1 -- 172.21.15.8:0/1633115030 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd9c001e420 con 0x7fd9d0060310 2023-10-18T22:22:59.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.574+0000 7fd9ccff9700 1 -- 172.21.15.8:0/1633115030 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9c0014660 con 0x7fd9d0060310 2023-10-18T22:22:59.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.574+0000 7fd9d5439700 1 -- 172.21.15.8:0/1633115030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d00f5e20 con 0x7fd9d0060310 2023-10-18T22:22:59.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.575+0000 7fd9d5439700 1 -- 172.21.15.8:0/1633115030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d0045ad0 con 0x7fd9d0060310 2023-10-18T22:22:59.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.576+0000 7fd9ccff9700 1 -- 172.21.15.8:0/1633115030 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd9c001e590 con 0x7fd9d0060310 2023-10-18T22:22:59.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.577+0000 7fd9ccff9700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd9b8060f70 0x7fd9b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:59.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.577+0000 7fd9ccff9700 1 -- 172.21.15.8:0/1633115030 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd9c007de00 con 0x7fd9d0060310 2023-10-18T22:22:59.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.577+0000 7fd9cf7fe700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd9b8060f70 0x7fd9b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:59.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.577+0000 7fd9cf7fe700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd9b8060f70 0x7fd9b8063430 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fd9c4009fd0 tx=0x7fd9c400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:59.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.581+0000 7fd9ccff9700 1 -- 172.21.15.8:0/1633115030 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd9c004d9b0 con 0x7fd9d0060310 2023-10-18T22:22:59.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.779+0000 7fd9d5439700 1 -- 172.21.15.8:0/1633115030 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9d00fee00 con 0x7fd9b8060f70 2023-10-18T22:22:59.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.780+0000 7fd9ccff9700 1 -- 172.21.15.8:0/1633115030 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd9d00fee00 con 0x7fd9b8060f70 2023-10-18T22:22:59.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 -- 172.21.15.8:0/1633115030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd9b8060f70 msgr2=0x7fd9b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:59.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd9b8060f70 0x7fd9b8063430 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fd9c4009fd0 tx=0x7fd9c400b040).stop 2023-10-18T22:22:59.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 -- 172.21.15.8:0/1633115030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9d0060310 msgr2=0x7fd9d00f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:59.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9d0060310 0x7fd9d00f6ba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd9c0004d80 tx=0x7fd9c000b040).stop 2023-10-18T22:22:59.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 -- 172.21.15.8:0/1633115030 shutdown_connections 2023-10-18T22:22:59.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd9b8060f70 0x7fd9b8063430 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9d0060310 0x7fd9d00f6ba0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 --2- 172.21.15.8:0/1633115030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9d00f96a0 0x7fd9d00f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 -- 172.21.15.8:0/1633115030 >> 172.21.15.8:0/1633115030 conn(0x7fd9d00f0ba0 msgr2=0x7fd9d00f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:59.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 -- 172.21.15.8:0/1633115030 shutdown_connections 2023-10-18T22:22:59.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.782+0000 7fd9d5439700 1 -- 172.21.15.8:0/1633115030 wait complete. 2023-10-18T22:22:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.918+0000 7fae03461700 1 -- 172.21.15.8:0/2752909316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadfc06a3b0 msgr2=0x7fadfc06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.918+0000 7fae03461700 1 --2- 172.21.15.8:0/2752909316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadfc06a3b0 0x7fadfc06a830 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7fadec004660 tx=0x7fadec009b30).stop 2023-10-18T22:22:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.918+0000 7fae03461700 1 -- 172.21.15.8:0/2752909316 shutdown_connections 2023-10-18T22:22:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.918+0000 7fae03461700 1 --2- 172.21.15.8:0/2752909316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadfc06a3b0 0x7fadfc06a830 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.918+0000 7fae03461700 1 --2- 172.21.15.8:0/2752909316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadfc06b9c0 0x7fadfc069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.918+0000 7fae03461700 1 -- 172.21.15.8:0/2752909316 >> 172.21.15.8:0/2752909316 conn(0x7fadfc0f1c90 msgr2=0x7fadfc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:22:59.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.918+0000 7fae03461700 1 -- 172.21.15.8:0/2752909316 shutdown_connections 2023-10-18T22:22:59.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.918+0000 7fae03461700 1 -- 172.21.15.8:0/2752909316 wait complete. 2023-10-18T22:22:59.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.919+0000 7fae03461700 1 Processor -- start 2023-10-18T22:22:59.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.919+0000 7fae03461700 1 -- start start 2023-10-18T22:22:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae03461700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadfc06a3b0 0x7fadfc108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae03461700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadfc06b9c0 0x7fadfc109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae03461700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc109a10 con 0x7fadfc06a3b0 2023-10-18T22:22:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae03461700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc109b50 con 0x7fadfc06b9c0 2023-10-18T22:22:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae0245f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadfc06a3b0 0x7fadfc108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae0245f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadfc06a3b0 0x7fadfc108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39142/0 (socket says 172.21.15.8:39142) 2023-10-18T22:22:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae0245f700 1 -- 172.21.15.8:0/764093387 learned_addr learned my addr 172.21.15.8:0/764093387 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:22:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae01c5e700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadfc06b9c0 0x7fadfc109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae0245f700 1 -- 172.21.15.8:0/764093387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadfc06b9c0 msgr2=0x7fadfc109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:22:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae0245f700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadfc06b9c0 0x7fadfc109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:22:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.920+0000 7fae0245f700 1 -- 172.21.15.8:0/764093387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec005040 con 0x7fadfc06a3b0 2023-10-18T22:22:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.921+0000 7fae0245f700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadfc06a3b0 0x7fadfc108f70 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7fadf80026d0 tx=0x7fadf8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.921+0000 7fadf2ffd700 1 -- 172.21.15.8:0/764093387 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadf8009320 con 0x7fadfc06a3b0 2023-10-18T22:22:59.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.921+0000 7fae03461700 1 -- 172.21.15.8:0/764093387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc10a4f0 con 0x7fadfc06a3b0 2023-10-18T22:22:59.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.921+0000 7fadf2ffd700 1 -- 172.21.15.8:0/764093387 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fadf800f040 con 0x7fadfc06a3b0 2023-10-18T22:22:59.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.921+0000 7fadf2ffd700 1 -- 172.21.15.8:0/764093387 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadf80148a0 con 0x7fadfc06a3b0 2023-10-18T22:22:59.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.921+0000 7fae03461700 1 -- 172.21.15.8:0/764093387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc10aab0 con 0x7fadfc06a3b0 2023-10-18T22:22:59.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.922+0000 7fae03461700 1 -- 172.21.15.8:0/764093387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc045ad0 con 0x7fadfc06a3b0 2023-10-18T22:22:59.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.923+0000 7fadf2ffd700 1 -- 172.21.15.8:0/764093387 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fadf8009480 con 0x7fadfc06a3b0 2023-10-18T22:22:59.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.924+0000 7fadf2ffd700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fade8060f70 0x7fade8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:22:59.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.924+0000 7fadf2ffd700 1 -- 172.21.15.8:0/764093387 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fadf807cea0 con 0x7fadfc06a3b0 2023-10-18T22:22:59.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.924+0000 7fae01c5e700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fade8060f70 0x7fade8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:22:59.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.925+0000 7fae01c5e700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fade8060f70 0x7fade8063430 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fadec004630 tx=0x7fadec009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:22:59.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:22:59.928+0000 7fadf2ffd700 1 -- 172.21.15.8:0/764093387 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fadf80505c0 con 0x7fadfc06a3b0 2023-10-18T22:23:00.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.117+0000 7fae03461700 1 -- 172.21.15.8:0/764093387 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fadfc101030 con 0x7fade8060f70 2023-10-18T22:23:00.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.126+0000 7fadf2ffd700 1 -- 172.21.15.8:0/764093387 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fadfc101030 con 0x7fade8060f70 2023-10-18T22:23:00.129 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:23:00.129 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (89m) 6m ago 91m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:23:00.129 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (83m) 6m ago 91m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:23:00.130 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (83m) 4m ago 90m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:23:00.130 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (89m) 6m ago 90m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:23:00.130 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 87m - - 2023-10-18T22:23:00.130 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 87m - - 2023-10-18T22:23:00.130 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 87m - - 2023-10-18T22:23:00.131 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 87m - - 2023-10-18T22:23:00.131 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (84m) 6m ago 92m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:23:00.131 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (84m) 4m ago 90m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:23:00.131 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (84m) 6m ago 92m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:23:00.131 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (83m) 4m ago 90m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:23:00.132 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (90m) 6m ago 90m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:23:00.132 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (89m) 4m ago 89m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:23:00.132 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (83m) 6m ago 89m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:23:00.132 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (81m) 6m ago 89m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:23:00.132 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (80m) 6m ago 89m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:23:00.132 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (80m) 4m ago 88m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:23:00.133 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (79m) 4m ago 88m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:23:00.133 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (79m) 4m ago 88m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:23:00.133 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (85m) 6m ago 90m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:23:00.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.128+0000 7fae03461700 1 -- 172.21.15.8:0/764093387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fade8060f70 msgr2=0x7fade8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:00.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.128+0000 7fae03461700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fade8060f70 0x7fade8063430 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fadec004630 tx=0x7fadec009b30).stop 2023-10-18T22:23:00.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.128+0000 7fae03461700 1 -- 172.21.15.8:0/764093387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadfc06a3b0 msgr2=0x7fadfc108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:00.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.128+0000 7fae03461700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadfc06a3b0 0x7fadfc108f70 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7fadf80026d0 tx=0x7fadf8009de0).stop 2023-10-18T22:23:00.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.128+0000 7fae03461700 1 -- 172.21.15.8:0/764093387 shutdown_connections 2023-10-18T22:23:00.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.128+0000 7fae03461700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fade8060f70 0x7fade8063430 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.129+0000 7fae03461700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadfc06a3b0 0x7fadfc108f70 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.129+0000 7fae03461700 1 --2- 172.21.15.8:0/764093387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadfc06b9c0 0x7fadfc109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.129+0000 7fae03461700 1 -- 172.21.15.8:0/764093387 >> 172.21.15.8:0/764093387 conn(0x7fadfc0f1c90 msgr2=0x7fadfc0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.129+0000 7fae03461700 1 -- 172.21.15.8:0/764093387 shutdown_connections 2023-10-18T22:23:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.129+0000 7fae03461700 1 -- 172.21.15.8:0/764093387 wait complete. 2023-10-18T22:23:00.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.263+0000 7f8ed759e700 1 -- 172.21.15.8:0/2621712629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed80f77d0 msgr2=0x7f8ed80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:00.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.263+0000 7f8ed759e700 1 --2- 172.21.15.8:0/2621712629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed80f77d0 0x7f8ed80f7c30 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7f8ecc004660 tx=0x7f8ecc009b30).stop 2023-10-18T22:23:00.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.263+0000 7f8ed759e700 1 -- 172.21.15.8:0/2621712629 shutdown_connections 2023-10-18T22:23:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.263+0000 7f8ed759e700 1 --2- 172.21.15.8:0/2621712629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed80f77d0 0x7f8ed80f7c30 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.263+0000 7f8ed759e700 1 --2- 172.21.15.8:0/2621712629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed80f6530 0x7f8ed80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.263+0000 7f8ed759e700 1 -- 172.21.15.8:0/2621712629 >> 172.21.15.8:0/2621712629 conn(0x7f8ed80f1c90 msgr2=0x7f8ed80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.263+0000 7f8ed759e700 1 -- 172.21.15.8:0/2621712629 shutdown_connections 2023-10-18T22:23:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.263+0000 7f8ed759e700 1 -- 172.21.15.8:0/2621712629 wait complete. 2023-10-18T22:23:00.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.264+0000 7f8ed759e700 1 Processor -- start 2023-10-18T22:23:00.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.264+0000 7f8ed759e700 1 -- start start 2023-10-18T22:23:00.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.265+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed80f6530 0x7f8ed806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.265+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed80f77d0 0x7f8ed8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.265+0000 7f8ed759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed806a380 con 0x7f8ed80f6530 2023-10-18T22:23:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.265+0000 7f8ed759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed806a4c0 con 0x7f8ed80f77d0 2023-10-18T22:23:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.265+0000 7f8ed659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed80f6530 0x7f8ed806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.265+0000 7f8ed659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed80f6530 0x7f8ed806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39168/0 (socket says 172.21.15.8:39168) 2023-10-18T22:23:00.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.265+0000 7f8ed659c700 1 -- 172.21.15.8:0/3015609896 learned_addr learned my addr 172.21.15.8:0/3015609896 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:23:00.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.265+0000 7f8ed5d9b700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed80f77d0 0x7f8ed8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:00.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.266+0000 7f8ed659c700 1 -- 172.21.15.8:0/3015609896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed80f77d0 msgr2=0x7f8ed8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:00.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.266+0000 7f8ed659c700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed80f77d0 0x7f8ed8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.266+0000 7f8ed659c700 1 -- 172.21.15.8:0/3015609896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc005040 con 0x7f8ed80f6530 2023-10-18T22:23:00.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.266+0000 7f8ed5d9b700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed80f77d0 0x7f8ed8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T22:23:00.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.266+0000 7f8ed659c700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed80f6530 0x7f8ed806b9a0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f8ec8002700 tx=0x7f8ec8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:00.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.266+0000 7f8ec6ffd700 1 -- 172.21.15.8:0/3015609896 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec80079c0 con 0x7f8ed80f6530 2023-10-18T22:23:00.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.266+0000 7f8ec6ffd700 1 -- 172.21.15.8:0/3015609896 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8ec800f040 con 0x7f8ed80f6530 2023-10-18T22:23:00.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.266+0000 7f8ed759e700 1 -- 172.21.15.8:0/3015609896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed806a7a0 con 0x7f8ed80f6530 2023-10-18T22:23:00.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.266+0000 7f8ec6ffd700 1 -- 172.21.15.8:0/3015609896 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec80148d0 con 0x7f8ed80f6530 2023-10-18T22:23:00.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.266+0000 7f8ed759e700 1 -- 172.21.15.8:0/3015609896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed810ed70 con 0x7f8ed80f6530 2023-10-18T22:23:00.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.267+0000 7f8ed759e700 1 -- 172.21.15.8:0/3015609896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed8045ad0 con 0x7f8ed80f6530 2023-10-18T22:23:00.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.268+0000 7f8ec6ffd700 1 -- 172.21.15.8:0/3015609896 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f8ec801b060 con 0x7f8ed80f6530 2023-10-18T22:23:00.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.269+0000 7f8ec6ffd700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec0060f70 0x7f8ec0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:00.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.269+0000 7f8ec6ffd700 1 -- 172.21.15.8:0/3015609896 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f8ec807c710 con 0x7f8ed80f6530 2023-10-18T22:23:00.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.269+0000 7f8ed5d9b700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec0060f70 0x7f8ec0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:00.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.270+0000 7f8ed5d9b700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec0060f70 0x7f8ec0063430 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f8ecc009f50 tx=0x7f8ecc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:00.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.273+0000 7f8ec6ffd700 1 -- 172.21.15.8:0/3015609896 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f8ec804c380 con 0x7f8ed80f6530 2023-10-18T22:23:00.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.526+0000 7f8ed759e700 1 -- 172.21.15.8:0/3015609896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8ed80fee00 con 0x7f8ed80f6530 2023-10-18T22:23:00.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.527+0000 7f8ec6ffd700 1 -- 172.21.15.8:0/3015609896 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f8ec804f9a0 con 0x7f8ed80f6530 2023-10-18T22:23:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:23:00.559 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:23:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:23:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:23:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:23:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:23:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:23:00.560 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:23:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:23:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:23:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:23:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:23:00.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:23:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:23:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:23:00.562 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:23:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:23:00.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 -- 172.21.15.8:0/3015609896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec0060f70 msgr2=0x7f8ec0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:00.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec0060f70 0x7f8ec0063430 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f8ecc009f50 tx=0x7f8ecc009b30).stop 2023-10-18T22:23:00.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 -- 172.21.15.8:0/3015609896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed80f6530 msgr2=0x7f8ed806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:00.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed80f6530 0x7f8ed806b9a0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f8ec8002700 tx=0x7f8ec8009d80).stop 2023-10-18T22:23:00.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 -- 172.21.15.8:0/3015609896 shutdown_connections 2023-10-18T22:23:00.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8ec0060f70 0x7f8ec0063430 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ed80f6530 0x7f8ed806b9a0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 --2- 172.21.15.8:0/3015609896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ed80f77d0 0x7f8ed8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 -- 172.21.15.8:0/3015609896 >> 172.21.15.8:0/3015609896 conn(0x7f8ed80f1c90 msgr2=0x7f8ed80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:00.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 -- 172.21.15.8:0/3015609896 shutdown_connections 2023-10-18T22:23:00.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.529+0000 7f8ed759e700 1 -- 172.21.15.8:0/3015609896 wait complete. 2023-10-18T22:23:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:22:58.641889+0000 mgr.smithi008.flmjzp (mgr.14640) 5044 : cluster [DBG] pgmap v3460: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:59.431809+0000 mgr.smithi008.flmjzp (mgr.14640) 5045 : audit [DBG] from='client.38032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:00.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.670+0000 7f51b7381700 1 -- 172.21.15.8:0/3318447358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51b006a330 msgr2=0x7f51b006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:00.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.670+0000 7f51b7381700 1 --2- 172.21.15.8:0/3318447358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51b006a330 0x7f51b006a7b0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7f51a0004660 tx=0x7f51a0009b30).stop 2023-10-18T22:23:00.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.670+0000 7f51b7381700 1 -- 172.21.15.8:0/3318447358 shutdown_connections 2023-10-18T22:23:00.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.670+0000 7f51b7381700 1 --2- 172.21.15.8:0/3318447358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51b006a330 0x7f51b006a7b0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.670+0000 7f51b7381700 1 --2- 172.21.15.8:0/3318447358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51b006b940 0x7f51b0069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.670+0000 7f51b7381700 1 -- 172.21.15.8:0/3318447358 >> 172.21.15.8:0/3318447358 conn(0x7f51b00f1c70 msgr2=0x7f51b00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:00.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.670+0000 7f51b7381700 1 -- 172.21.15.8:0/3318447358 shutdown_connections 2023-10-18T22:23:00.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.670+0000 7f51b7381700 1 -- 172.21.15.8:0/3318447358 wait complete. 2023-10-18T22:23:00.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.671+0000 7f51b7381700 1 Processor -- start 2023-10-18T22:23:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.672+0000 7f51b7381700 1 -- start start 2023-10-18T22:23:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.672+0000 7f51b7381700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51b006a330 0x7f51b0108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.672+0000 7f51b7381700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51b006b940 0x7f51b0109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.672+0000 7f51b7381700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0109a10 con 0x7f51b006a330 2023-10-18T22:23:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.672+0000 7f51b7381700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0109b50 con 0x7f51b006b940 2023-10-18T22:23:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51b637f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51b006a330 0x7f51b0108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51b637f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51b006a330 0x7f51b0108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39184/0 (socket says 172.21.15.8:39184) 2023-10-18T22:23:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51b637f700 1 -- 172.21.15.8:0/3347781198 learned_addr learned my addr 172.21.15.8:0/3347781198 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:23:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51b5b7e700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51b006b940 0x7f51b0109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51b637f700 1 -- 172.21.15.8:0/3347781198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51b006b940 msgr2=0x7f51b0109460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51b637f700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51b006b940 0x7f51b0109460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51b637f700 1 -- 172.21.15.8:0/3347781198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a0005040 con 0x7f51b006a330 2023-10-18T22:23:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51b637f700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51b006a330 0x7f51b0108f70 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f51ac0026d0 tx=0x7f51ac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:00.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51a6ffd700 1 -- 172.21.15.8:0/3347781198 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ac0079c0 con 0x7f51b006a330 2023-10-18T22:23:00.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51a6ffd700 1 -- 172.21.15.8:0/3347781198 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f51ac00f040 con 0x7f51b006a330 2023-10-18T22:23:00.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51b7381700 1 -- 172.21.15.8:0/3347781198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b010a4f0 con 0x7f51b006a330 2023-10-18T22:23:00.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.673+0000 7f51a6ffd700 1 -- 172.21.15.8:0/3347781198 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ac014980 con 0x7f51b006a330 2023-10-18T22:23:00.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.674+0000 7f51b7381700 1 -- 172.21.15.8:0/3347781198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b010aab0 con 0x7f51b006a330 2023-10-18T22:23:00.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.675+0000 7f51b7381700 1 -- 172.21.15.8:0/3347781198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b0045ad0 con 0x7f51b006a330 2023-10-18T22:23:00.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.675+0000 7f51a6ffd700 1 -- 172.21.15.8:0/3347781198 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f51ac0090d0 con 0x7f51b006a330 2023-10-18T22:23:00.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.676+0000 7f51a6ffd700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f519c060f70 0x7f519c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:00.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.676+0000 7f51a6ffd700 1 -- 172.21.15.8:0/3347781198 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f51ac07c970 con 0x7f51b006a330 2023-10-18T22:23:00.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.676+0000 7f51b5b7e700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f519c060f70 0x7f519c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:00.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.677+0000 7f51b5b7e700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f519c060f70 0x7f519c063430 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f51a0004630 tx=0x7f51a0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:00.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.680+0000 7f51a6ffd700 1 -- 172.21.15.8:0/3347781198 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f51ac050000 con 0x7f51b006a330 2023-10-18T22:23:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:22:58.641889+0000 mgr.smithi008.flmjzp (mgr.14640) 5044 : cluster [DBG] pgmap v3460: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:59.431809+0000 mgr.smithi008.flmjzp (mgr.14640) 5045 : audit [DBG] from='client.38032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:00.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.909+0000 7f51b7381700 1 -- 172.21.15.8:0/3347781198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f51b0100fc0 con 0x7f51b006a330 2023-10-18T22:23:00.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.909+0000 7f51a6ffd700 1 -- 172.21.15.8:0/3347781198 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f51ac04fbf0 con 0x7f51b006a330 2023-10-18T22:23:00.912 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:23:00.912 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:23:00.913 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:23:00.913 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:23:00.913 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:23:00.913 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:23:00.913 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:23:00.914 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:23:00.914 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:23:00.914 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:23:00.914 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:23:00.914 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:23:00.915 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:23:00.915 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:23:00.915 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:23:00.915 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:23:00.915 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:23:00.915 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:23:00.916 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:23:00.916 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:23:00.916 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:23:00.916 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:23:00.916 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:23:00.917 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:23:00.917 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:23:00.917 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:23:00.917 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:23:00.917 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:23:00.917 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:23:00.918 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:23:00.918 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:23:00.918 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:23:00.918 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:23:00.918 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:23:00.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.911+0000 7f51b7381700 1 -- 172.21.15.8:0/3347781198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f519c060f70 msgr2=0x7f519c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:00.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.911+0000 7f51b7381700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f519c060f70 0x7f519c063430 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f51a0004630 tx=0x7f51a0009b30).stop 2023-10-18T22:23:00.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.911+0000 7f51b7381700 1 -- 172.21.15.8:0/3347781198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51b006a330 msgr2=0x7f51b0108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:00.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.911+0000 7f51b7381700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51b006a330 0x7f51b0108f70 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f51ac0026d0 tx=0x7f51ac009de0).stop 2023-10-18T22:23:00.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.911+0000 7f51b7381700 1 -- 172.21.15.8:0/3347781198 shutdown_connections 2023-10-18T22:23:00.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.911+0000 7f51b7381700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f519c060f70 0x7f519c063430 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.911+0000 7f51b7381700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51b006a330 0x7f51b0108f70 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.911+0000 7f51b7381700 1 --2- 172.21.15.8:0/3347781198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51b006b940 0x7f51b0109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:00.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.911+0000 7f51b7381700 1 -- 172.21.15.8:0/3347781198 >> 172.21.15.8:0/3347781198 conn(0x7f51b00f1c70 msgr2=0x7f51b00fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:00.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.912+0000 7f51b7381700 1 -- 172.21.15.8:0/3347781198 shutdown_connections 2023-10-18T22:23:00.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:00.912+0000 7f51b7381700 1 -- 172.21.15.8:0/3347781198 wait complete. 2023-10-18T22:23:00.922 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:23:01.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.049+0000 7f83121db700 1 -- 172.21.15.8:0/2862801872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f830c0f6530 msgr2=0x7f830c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:01.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.049+0000 7f83121db700 1 --2- 172.21.15.8:0/2862801872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f830c0f6530 0x7f830c0f6950 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7f8308004660 tx=0x7f8308009b30).stop 2023-10-18T22:23:01.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.049+0000 7f83121db700 1 -- 172.21.15.8:0/2862801872 shutdown_connections 2023-10-18T22:23:01.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.049+0000 7f83121db700 1 --2- 172.21.15.8:0/2862801872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f830c0f77d0 0x7f830c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:01.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.049+0000 7f83121db700 1 --2- 172.21.15.8:0/2862801872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f830c0f6530 0x7f830c0f6950 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:01.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.049+0000 7f83121db700 1 -- 172.21.15.8:0/2862801872 >> 172.21.15.8:0/2862801872 conn(0x7f830c0f1c70 msgr2=0x7f830c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:01.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.049+0000 7f83121db700 1 -- 172.21.15.8:0/2862801872 shutdown_connections 2023-10-18T22:23:01.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.049+0000 7f83121db700 1 -- 172.21.15.8:0/2862801872 wait complete. 2023-10-18T22:23:01.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.050+0000 7f83121db700 1 Processor -- start 2023-10-18T22:23:01.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.050+0000 7f83121db700 1 -- start start 2023-10-18T22:23:01.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83121db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f830c0f6530 0x7f830c106e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:01.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83121db700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f830c0f77d0 0x7f830c107330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:01.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83121db700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c107930 con 0x7f830c0f6530 2023-10-18T22:23:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83121db700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c108140 con 0x7f830c0f77d0 2023-10-18T22:23:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83111d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f830c0f6530 0x7f830c106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83111d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f830c0f6530 0x7f830c106e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39206/0 (socket says 172.21.15.8:39206) 2023-10-18T22:23:01.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83111d9700 1 -- 172.21.15.8:0/680861950 learned_addr learned my addr 172.21.15.8:0/680861950 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:23:01.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83109d8700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f830c0f77d0 0x7f830c107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:01.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83111d9700 1 -- 172.21.15.8:0/680861950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f830c0f77d0 msgr2=0x7f830c107330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:01.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83111d9700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f830c0f77d0 0x7f830c107330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:01.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83111d9700 1 -- 172.21.15.8:0/680861950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8308005040 con 0x7f830c0f6530 2023-10-18T22:23:01.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.051+0000 7f83109d8700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f830c0f77d0 0x7f830c107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:23:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.052+0000 7f83111d9700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f830c0f6530 0x7f830c106e40 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 rx=0x7f8308004e30 tx=0x7f8308009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.052+0000 7f8301ffb700 1 -- 172.21.15.8:0/680861950 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8308018070 con 0x7f830c0f6530 2023-10-18T22:23:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.052+0000 7f8301ffb700 1 -- 172.21.15.8:0/680861950 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8308009630 con 0x7f830c0f6530 2023-10-18T22:23:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.052+0000 7f83121db700 1 -- 172.21.15.8:0/680861950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c108360 con 0x7f830c0f6530 2023-10-18T22:23:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.052+0000 7f8301ffb700 1 -- 172.21.15.8:0/680861950 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f830801c3c0 con 0x7f830c0f6530 2023-10-18T22:23:01.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.052+0000 7f83121db700 1 -- 172.21.15.8:0/680861950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c1088c0 con 0x7f830c0f6530 2023-10-18T22:23:01.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.053+0000 7f83121db700 1 -- 172.21.15.8:0/680861950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c059100 con 0x7f830c0f6530 2023-10-18T22:23:01.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.054+0000 7f8301ffb700 1 -- 172.21.15.8:0/680861950 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f830801d420 con 0x7f830c0f6530 2023-10-18T22:23:01.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.055+0000 7f8301ffb700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f8060f70 0x7f82f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:01.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.055+0000 7f8301ffb700 1 -- 172.21.15.8:0/680861950 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f830807e5f0 con 0x7f830c0f6530 2023-10-18T22:23:01.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.055+0000 7f83109d8700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f8060f70 0x7f82f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:01.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.055+0000 7f83109d8700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f8060f70 0x7f82f8063430 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f82fc009fd0 tx=0x7f82fc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:01.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.059+0000 7f8301ffb700 1 -- 172.21.15.8:0/680861950 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f830804e310 con 0x7f830c0f6530 2023-10-18T22:23:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.257+0000 7f83121db700 1 -- 172.21.15.8:0/680861950 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f830c0fed30 con 0x7f82f8060f70 2023-10-18T22:23:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.258+0000 7f8301ffb700 1 -- 172.21.15.8:0/680861950 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f830c0fed30 con 0x7f82f8060f70 2023-10-18T22:23:01.261 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:23:01.261 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:23:01.261 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:23:01.261 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:23:01.261 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:23:01.262 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:23:01.262 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:23:01.262 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:23:01.262 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:23:01.263 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:23:01.263 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:23:01.263 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:23:01.263 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:23:01.263 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:23:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 -- 172.21.15.8:0/680861950 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f8060f70 msgr2=0x7f82f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f8060f70 0x7f82f8063430 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f82fc009fd0 tx=0x7f82fc00b040).stop 2023-10-18T22:23:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 -- 172.21.15.8:0/680861950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f830c0f6530 msgr2=0x7f830c106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f830c0f6530 0x7f830c106e40 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 rx=0x7f8308004e30 tx=0x7f8308009b30).stop 2023-10-18T22:23:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 -- 172.21.15.8:0/680861950 shutdown_connections 2023-10-18T22:23:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f82f8060f70 0x7f82f8063430 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f830c0f6530 0x7f830c106e40 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 --2- 172.21.15.8:0/680861950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f830c0f77d0 0x7f830c107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 -- 172.21.15.8:0/680861950 >> 172.21.15.8:0/680861950 conn(0x7f830c0f1c70 msgr2=0x7f830c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 -- 172.21.15.8:0/680861950 shutdown_connections 2023-10-18T22:23:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:01.260+0000 7f83121db700 1 -- 172.21.15.8:0/680861950 wait complete. 2023-10-18T22:23:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:22:59.781296+0000 mgr.smithi008.flmjzp (mgr.14640) 5046 : audit [DBG] from='client.47533 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:00.119401+0000 mgr.smithi008.flmjzp (mgr.14640) 5047 : audit [DBG] from='client.38040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:00.528514+0000 mon.smithi008 (mon.0) 5309 : audit [DBG] from='client.? 172.21.15.8:0/3015609896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:00.911025+0000 mon.smithi008 (mon.0) 5310 : audit [DBG] from='client.? 172.21.15.8:0/3347781198' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:23:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:22:59.781296+0000 mgr.smithi008.flmjzp (mgr.14640) 5046 : audit [DBG] from='client.47533 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:00.119401+0000 mgr.smithi008.flmjzp (mgr.14640) 5047 : audit [DBG] from='client.38040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:00.528514+0000 mon.smithi008 (mon.0) 5309 : audit [DBG] from='client.? 172.21.15.8:0/3015609896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:01.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:00.911025+0000 mon.smithi008 (mon.0) 5310 : audit [DBG] from='client.? 172.21.15.8:0/3347781198' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:23:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:00.642433+0000 mgr.smithi008.flmjzp (mgr.14640) 5048 : cluster [DBG] pgmap v3461: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:01.259538+0000 mgr.smithi008.flmjzp (mgr.14640) 5049 : audit [DBG] from='client.38052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:00.642433+0000 mgr.smithi008.flmjzp (mgr.14640) 5048 : cluster [DBG] pgmap v3461: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:01.259538+0000 mgr.smithi008.flmjzp (mgr.14640) 5049 : audit [DBG] from='client.38052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:02.643053+0000 mgr.smithi008.flmjzp (mgr.14640) 5050 : cluster [DBG] pgmap v3462: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:02.643053+0000 mgr.smithi008.flmjzp (mgr.14640) 5050 : cluster [DBG] pgmap v3462: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:04.643582+0000 mgr.smithi008.flmjzp (mgr.14640) 5051 : cluster [DBG] pgmap v3463: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:04.643582+0000 mgr.smithi008.flmjzp (mgr.14640) 5051 : cluster [DBG] pgmap v3463: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:06.674067+0000 mon.smithi008 (mon.0) 5311 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:06.676205+0000 mon.smithi008 (mon.0) 5312 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:06.677243+0000 mon.smithi008 (mon.0) 5313 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:06.683718+0000 mon.smithi008 (mon.0) 5314 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:06.690514+0000 mon.smithi008 (mon.0) 5315 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:06.693764+0000 mon.smithi008 (mon.0) 5316 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:06.695547+0000 mon.smithi008 (mon.0) 5317 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:06.697297+0000 mon.smithi008 (mon.0) 5318 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:07.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:06.699315+0000 mon.smithi008 (mon.0) 5319 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:06.674067+0000 mon.smithi008 (mon.0) 5311 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:06.676205+0000 mon.smithi008 (mon.0) 5312 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:06.677243+0000 mon.smithi008 (mon.0) 5313 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:06.683718+0000 mon.smithi008 (mon.0) 5314 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:06.690514+0000 mon.smithi008 (mon.0) 5315 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:06.693764+0000 mon.smithi008 (mon.0) 5316 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:06.695547+0000 mon.smithi008 (mon.0) 5317 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:06.697297+0000 mon.smithi008 (mon.0) 5318 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:06.699315+0000 mon.smithi008 (mon.0) 5319 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:06.644076+0000 mgr.smithi008.flmjzp (mgr.14640) 5052 : cluster [DBG] pgmap v3464: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:06.678179+0000 mgr.smithi008.flmjzp (mgr.14640) 5053 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:06.678791+0000 mgr.smithi008.flmjzp (mgr.14640) 5054 : cluster [DBG] pgmap v3465: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:06.679171+0000 mgr.smithi008.flmjzp (mgr.14640) 5055 : cluster [DBG] pgmap v3466: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:06.701314+0000 mgr.smithi008.flmjzp (mgr.14640) 5056 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:06.644076+0000 mgr.smithi008.flmjzp (mgr.14640) 5052 : cluster [DBG] pgmap v3464: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:06.678179+0000 mgr.smithi008.flmjzp (mgr.14640) 5053 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:06.678791+0000 mgr.smithi008.flmjzp (mgr.14640) 5054 : cluster [DBG] pgmap v3465: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:06.679171+0000 mgr.smithi008.flmjzp (mgr.14640) 5055 : cluster [DBG] pgmap v3466: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:06.701314+0000 mgr.smithi008.flmjzp (mgr.14640) 5056 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:08.679664+0000 mgr.smithi008.flmjzp (mgr.14640) 5057 : cluster [DBG] pgmap v3467: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:08.679664+0000 mgr.smithi008.flmjzp (mgr.14640) 5057 : cluster [DBG] pgmap v3467: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:10.680282+0000 mgr.smithi008.flmjzp (mgr.14640) 5058 : cluster [DBG] pgmap v3468: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:10.680282+0000 mgr.smithi008.flmjzp (mgr.14640) 5058 : cluster [DBG] pgmap v3468: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:12.680862+0000 mgr.smithi008.flmjzp (mgr.14640) 5059 : cluster [DBG] pgmap v3469: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:12.680862+0000 mgr.smithi008.flmjzp (mgr.14640) 5059 : cluster [DBG] pgmap v3469: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:16.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:14.681430+0000 mgr.smithi008.flmjzp (mgr.14640) 5060 : cluster [DBG] pgmap v3470: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:14.681430+0000 mgr.smithi008.flmjzp (mgr.14640) 5060 : cluster [DBG] pgmap v3470: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:16.708947+0000 mon.smithi008 (mon.0) 5320 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:17.272332+0000 mon.smithi008 (mon.0) 5321 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:17.273129+0000 mon.smithi008 (mon.0) 5322 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:17.278733+0000 mon.smithi008 (mon.0) 5323 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:17.283515+0000 mon.smithi008 (mon.0) 5324 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:17.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:17.286008+0000 mon.smithi008 (mon.0) 5325 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:17.287362+0000 mon.smithi008 (mon.0) 5326 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:17.288691+0000 mon.smithi008 (mon.0) 5327 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:17.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:17.290344+0000 mon.smithi008 (mon.0) 5328 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:16.708947+0000 mon.smithi008 (mon.0) 5320 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:17.272332+0000 mon.smithi008 (mon.0) 5321 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:17.273129+0000 mon.smithi008 (mon.0) 5322 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:17.278733+0000 mon.smithi008 (mon.0) 5323 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:17.283515+0000 mon.smithi008 (mon.0) 5324 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:17.286008+0000 mon.smithi008 (mon.0) 5325 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:17.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:17.287362+0000 mon.smithi008 (mon.0) 5326 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:17.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:17.288691+0000 mon.smithi008 (mon.0) 5327 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:17.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:17.290344+0000 mon.smithi008 (mon.0) 5328 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:16.681949+0000 mgr.smithi008.flmjzp (mgr.14640) 5061 : cluster [DBG] pgmap v3471: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:17.273740+0000 mgr.smithi008.flmjzp (mgr.14640) 5062 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:17.274209+0000 mgr.smithi008.flmjzp (mgr.14640) 5063 : cluster [DBG] pgmap v3472: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:17.274476+0000 mgr.smithi008.flmjzp (mgr.14640) 5064 : cluster [DBG] pgmap v3473: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:17.291990+0000 mgr.smithi008.flmjzp (mgr.14640) 5065 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:16.681949+0000 mgr.smithi008.flmjzp (mgr.14640) 5061 : cluster [DBG] pgmap v3471: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:17.273740+0000 mgr.smithi008.flmjzp (mgr.14640) 5062 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:17.274209+0000 mgr.smithi008.flmjzp (mgr.14640) 5063 : cluster [DBG] pgmap v3472: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:17.274476+0000 mgr.smithi008.flmjzp (mgr.14640) 5064 : cluster [DBG] pgmap v3473: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:18.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:17.291990+0000 mgr.smithi008.flmjzp (mgr.14640) 5065 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:19.275029+0000 mgr.smithi008.flmjzp (mgr.14640) 5066 : cluster [DBG] pgmap v3474: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:19.275029+0000 mgr.smithi008.flmjzp (mgr.14640) 5066 : cluster [DBG] pgmap v3474: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:21.275731+0000 mgr.smithi008.flmjzp (mgr.14640) 5067 : cluster [DBG] pgmap v3475: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:21.275731+0000 mgr.smithi008.flmjzp (mgr.14640) 5067 : cluster [DBG] pgmap v3475: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:23.276190+0000 mgr.smithi008.flmjzp (mgr.14640) 5068 : cluster [DBG] pgmap v3476: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:23.276190+0000 mgr.smithi008.flmjzp (mgr.14640) 5068 : cluster [DBG] pgmap v3476: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:26.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:25.276890+0000 mgr.smithi008.flmjzp (mgr.14640) 5069 : cluster [DBG] pgmap v3477: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:25.276890+0000 mgr.smithi008.flmjzp (mgr.14640) 5069 : cluster [DBG] pgmap v3477: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:27.299551+0000 mon.smithi008 (mon.0) 5329 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:27.301671+0000 mon.smithi008 (mon.0) 5330 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:27.302693+0000 mon.smithi008 (mon.0) 5331 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:27.309460+0000 mon.smithi008 (mon.0) 5332 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:27.315911+0000 mon.smithi008 (mon.0) 5333 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:27.319165+0000 mon.smithi008 (mon.0) 5334 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:27.320876+0000 mon.smithi008 (mon.0) 5335 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:27.322525+0000 mon.smithi008 (mon.0) 5336 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:27.324558+0000 mon.smithi008 (mon.0) 5337 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:27.299551+0000 mon.smithi008 (mon.0) 5329 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:27.301671+0000 mon.smithi008 (mon.0) 5330 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:27.302693+0000 mon.smithi008 (mon.0) 5331 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:27.309460+0000 mon.smithi008 (mon.0) 5332 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:27.315911+0000 mon.smithi008 (mon.0) 5333 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:27.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:27.319165+0000 mon.smithi008 (mon.0) 5334 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:27.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:27.320876+0000 mon.smithi008 (mon.0) 5335 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:27.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:27.322525+0000 mon.smithi008 (mon.0) 5336 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:27.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:27.324558+0000 mon.smithi008 (mon.0) 5337 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:27.277406+0000 mgr.smithi008.flmjzp (mgr.14640) 5070 : cluster [DBG] pgmap v3478: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:27.303602+0000 mgr.smithi008.flmjzp (mgr.14640) 5071 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:27.304201+0000 mgr.smithi008.flmjzp (mgr.14640) 5072 : cluster [DBG] pgmap v3479: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:27.304562+0000 mgr.smithi008.flmjzp (mgr.14640) 5073 : cluster [DBG] pgmap v3480: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:27.326445+0000 mgr.smithi008.flmjzp (mgr.14640) 5074 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:27.277406+0000 mgr.smithi008.flmjzp (mgr.14640) 5070 : cluster [DBG] pgmap v3478: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:27.303602+0000 mgr.smithi008.flmjzp (mgr.14640) 5071 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:27.304201+0000 mgr.smithi008.flmjzp (mgr.14640) 5072 : cluster [DBG] pgmap v3479: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:27.304562+0000 mgr.smithi008.flmjzp (mgr.14640) 5073 : cluster [DBG] pgmap v3480: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:27.326445+0000 mgr.smithi008.flmjzp (mgr.14640) 5074 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:29.305212+0000 mgr.smithi008.flmjzp (mgr.14640) 5075 : cluster [DBG] pgmap v3481: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:29.305212+0000 mgr.smithi008.flmjzp (mgr.14640) 5075 : cluster [DBG] pgmap v3481: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:31.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.414+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1725773304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb840f77d0 msgr2=0x7ffb840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:31.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.414+0000 7ffb8b1f4700 1 --2- 172.21.15.8:0/1725773304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb840f77d0 0x7ffb840f7c30 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7ffb74004660 tx=0x7ffb74009b30).stop 2023-10-18T22:23:31.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.414+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1725773304 shutdown_connections 2023-10-18T22:23:31.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.414+0000 7ffb8b1f4700 1 --2- 172.21.15.8:0/1725773304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb840f77d0 0x7ffb840f7c30 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.414+0000 7ffb8b1f4700 1 --2- 172.21.15.8:0/1725773304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb840f6530 0x7ffb840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.414+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1725773304 >> 172.21.15.8:0/1725773304 conn(0x7ffb840f1c90 msgr2=0x7ffb840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:31.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.414+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1725773304 shutdown_connections 2023-10-18T22:23:31.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.414+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1725773304 wait complete. 2023-10-18T22:23:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.415+0000 7ffb8b1f4700 1 Processor -- start 2023-10-18T22:23:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.415+0000 7ffb8b1f4700 1 -- start start 2023-10-18T22:23:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb8b1f4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb840f6530 0x7ffb84108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:31.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb8b1f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb840f77d0 0x7ffb84109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb8b1f4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb841099b0 con 0x7ffb840f6530 2023-10-18T22:23:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb8b1f4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84109af0 con 0x7ffb840f77d0 2023-10-18T22:23:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb8a1f2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb840f6530 0x7ffb84108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb8a1f2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb840f6530 0x7ffb84108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51934/0 (socket says 172.21.15.8:51934) 2023-10-18T22:23:31.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb8a1f2700 1 -- 172.21.15.8:0/1393505804 learned_addr learned my addr 172.21.15.8:0/1393505804 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:23:31.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb899f1700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb840f77d0 0x7ffb84109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:31.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb8a1f2700 1 -- 172.21.15.8:0/1393505804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb840f77d0 msgr2=0x7ffb84109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:31.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb8a1f2700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb840f77d0 0x7ffb84109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.416+0000 7ffb8a1f2700 1 -- 172.21.15.8:0/1393505804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74005040 con 0x7ffb840f6530 2023-10-18T22:23:31.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.417+0000 7ffb8a1f2700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb840f6530 0x7ffb84108f10 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7ffb80002700 tx=0x7ffb80009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:31.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.417+0000 7ffb7affd700 1 -- 172.21.15.8:0/1393505804 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb800079c0 con 0x7ffb840f6530 2023-10-18T22:23:31.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.417+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1393505804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8410a490 con 0x7ffb840f6530 2023-10-18T22:23:31.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.417+0000 7ffb7affd700 1 -- 172.21.15.8:0/1393505804 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ffb8000f040 con 0x7ffb840f6530 2023-10-18T22:23:31.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.417+0000 7ffb7affd700 1 -- 172.21.15.8:0/1393505804 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb80014850 con 0x7ffb840f6530 2023-10-18T22:23:31.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.417+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1393505804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8410aa50 con 0x7ffb840f6530 2023-10-18T22:23:31.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.418+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1393505804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb84045ad0 con 0x7ffb840f6530 2023-10-18T22:23:31.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.419+0000 7ffb7affd700 1 -- 172.21.15.8:0/1393505804 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ffb8001b060 con 0x7ffb840f6530 2023-10-18T22:23:31.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.420+0000 7ffb7affd700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb70060f70 0x7ffb70063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:31.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.420+0000 7ffb7affd700 1 -- 172.21.15.8:0/1393505804 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ffb8007c7f0 con 0x7ffb840f6530 2023-10-18T22:23:31.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.421+0000 7ffb899f1700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb70060f70 0x7ffb70063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:31.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.421+0000 7ffb899f1700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb70060f70 0x7ffb70063430 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7ffb74004630 tx=0x7ffb74009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:31.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.425+0000 7ffb7affd700 1 -- 172.21.15.8:0/1393505804 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ffb8004fdd0 con 0x7ffb840f6530 2023-10-18T22:23:31.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.624+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1393505804 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb8410ad20 con 0x7ffb70060f70 2023-10-18T22:23:31.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.625+0000 7ffb7affd700 1 -- 172.21.15.8:0/1393505804 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffb8410ad20 con 0x7ffb70060f70 2023-10-18T22:23:31.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.627+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1393505804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb70060f70 msgr2=0x7ffb70063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:31.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.627+0000 7ffb8b1f4700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb70060f70 0x7ffb70063430 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7ffb74004630 tx=0x7ffb74009b30).stop 2023-10-18T22:23:31.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.627+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1393505804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb840f6530 msgr2=0x7ffb84108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:31.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.627+0000 7ffb8b1f4700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb840f6530 0x7ffb84108f10 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7ffb80002700 tx=0x7ffb80009d80).stop 2023-10-18T22:23:31.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.628+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1393505804 shutdown_connections 2023-10-18T22:23:31.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.628+0000 7ffb8b1f4700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ffb70060f70 0x7ffb70063430 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.628+0000 7ffb8b1f4700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb840f6530 0x7ffb84108f10 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.628+0000 7ffb8b1f4700 1 --2- 172.21.15.8:0/1393505804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb840f77d0 0x7ffb84109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.628+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1393505804 >> 172.21.15.8:0/1393505804 conn(0x7ffb840f1c90 msgr2=0x7ffb8406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:31.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.628+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1393505804 shutdown_connections 2023-10-18T22:23:31.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.628+0000 7ffb8b1f4700 1 -- 172.21.15.8:0/1393505804 wait complete. 2023-10-18T22:23:31.644 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:23:31.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.766+0000 7f32cef1b700 1 -- 172.21.15.8:0/2333644438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c8060310 msgr2=0x7f32c80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:31.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.766+0000 7f32cef1b700 1 --2- 172.21.15.8:0/2333644438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c8060310 0x7f32c80f9110 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 rx=0x7f32c4004660 tx=0x7f32c4009b30).stop 2023-10-18T22:23:31.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.766+0000 7f32cef1b700 1 -- 172.21.15.8:0/2333644438 shutdown_connections 2023-10-18T22:23:31.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.766+0000 7f32cef1b700 1 --2- 172.21.15.8:0/2333644438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32c80f9690 0x7f32c80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.766+0000 7f32cef1b700 1 --2- 172.21.15.8:0/2333644438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c8060310 0x7f32c80f9110 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.766+0000 7f32cef1b700 1 -- 172.21.15.8:0/2333644438 >> 172.21.15.8:0/2333644438 conn(0x7f32c80f0b90 msgr2=0x7f32c80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:31.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.767+0000 7f32cef1b700 1 -- 172.21.15.8:0/2333644438 shutdown_connections 2023-10-18T22:23:31.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.767+0000 7f32cef1b700 1 -- 172.21.15.8:0/2333644438 wait complete. 2023-10-18T22:23:31.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.767+0000 7f32cef1b700 1 Processor -- start 2023-10-18T22:23:31.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.768+0000 7f32cef1b700 1 -- start start 2023-10-18T22:23:31.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.768+0000 7f32cef1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c8060310 0x7f32c8106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:31.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.768+0000 7f32cef1b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32c80f9690 0x7f32c81072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:31.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.768+0000 7f32cef1b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c81078a0 con 0x7f32c8060310 2023-10-18T22:23:31.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.768+0000 7f32cef1b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c81080e0 con 0x7f32c80f9690 2023-10-18T22:23:31.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.768+0000 7f32cdf19700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c8060310 0x7f32c8106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:31.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.768+0000 7f32cdf19700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c8060310 0x7f32c8106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51956/0 (socket says 172.21.15.8:51956) 2023-10-18T22:23:31.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.768+0000 7f32cdf19700 1 -- 172.21.15.8:0/2473855425 learned_addr learned my addr 172.21.15.8:0/2473855425 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:23:31.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.768+0000 7f32cd718700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32c80f9690 0x7f32c81072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:31.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.768+0000 7f32cdf19700 1 -- 172.21.15.8:0/2473855425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32c80f9690 msgr2=0x7f32c81072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:31.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.769+0000 7f32cdf19700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32c80f9690 0x7f32c81072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.769+0000 7f32cdf19700 1 -- 172.21.15.8:0/2473855425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c4005040 con 0x7f32c8060310 2023-10-18T22:23:31.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.769+0000 7f32cdf19700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c8060310 0x7f32c8106db0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f32c4009990 tx=0x7f32c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:31.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.769+0000 7f32be7fc700 1 -- 172.21.15.8:0/2473855425 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32c4018070 con 0x7f32c8060310 2023-10-18T22:23:31.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.769+0000 7f32be7fc700 1 -- 172.21.15.8:0/2473855425 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f32c4009630 con 0x7f32c8060310 2023-10-18T22:23:31.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.769+0000 7f32be7fc700 1 -- 172.21.15.8:0/2473855425 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32c401c3c0 con 0x7f32c8060310 2023-10-18T22:23:31.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.769+0000 7f32cef1b700 1 -- 172.21.15.8:0/2473855425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c8108360 con 0x7f32c8060310 2023-10-18T22:23:31.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.769+0000 7f32cef1b700 1 -- 172.21.15.8:0/2473855425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c8108840 con 0x7f32c8060310 2023-10-18T22:23:31.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.770+0000 7f32cef1b700 1 -- 172.21.15.8:0/2473855425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c8059100 con 0x7f32c8060310 2023-10-18T22:23:31.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.771+0000 7f32be7fc700 1 -- 172.21.15.8:0/2473855425 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f32c401d970 con 0x7f32c8060310 2023-10-18T22:23:31.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.772+0000 7f32be7fc700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32b4060f70 0x7f32b4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:31.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.773+0000 7f32be7fc700 1 -- 172.21.15.8:0/2473855425 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f32c407e580 con 0x7f32c8060310 2023-10-18T22:23:31.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.773+0000 7f32cd718700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32b4060f70 0x7f32b4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:31.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.773+0000 7f32cd718700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32b4060f70 0x7f32b4063430 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f32c8106b40 tx=0x7f32b800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.777+0000 7f32be7fc700 1 -- 172.21.15.8:0/2473855425 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f32c404e1b0 con 0x7f32c8060310 2023-10-18T22:23:31.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.973+0000 7f32cef1b700 1 -- 172.21.15.8:0/2473855425 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32c80fed50 con 0x7f32b4060f70 2023-10-18T22:23:31.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.975+0000 7f32be7fc700 1 -- 172.21.15.8:0/2473855425 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f32c80fed50 con 0x7f32b4060f70 2023-10-18T22:23:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 -- 172.21.15.8:0/2473855425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32b4060f70 msgr2=0x7f32b4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32b4060f70 0x7f32b4063430 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f32c8106b40 tx=0x7f32b800b040).stop 2023-10-18T22:23:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 -- 172.21.15.8:0/2473855425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c8060310 msgr2=0x7f32c8106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:31.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c8060310 0x7f32c8106db0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f32c4009990 tx=0x7f32c4009b30).stop 2023-10-18T22:23:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 -- 172.21.15.8:0/2473855425 shutdown_connections 2023-10-18T22:23:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f32b4060f70 0x7f32b4063430 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c8060310 0x7f32c8106db0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 --2- 172.21.15.8:0/2473855425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32c80f9690 0x7f32c81072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:31.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 -- 172.21.15.8:0/2473855425 >> 172.21.15.8:0/2473855425 conn(0x7f32c80f0b90 msgr2=0x7f32c80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:31.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 -- 172.21.15.8:0/2473855425 shutdown_connections 2023-10-18T22:23:31.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:31.977+0000 7f32cef1b700 1 -- 172.21.15.8:0/2473855425 wait complete. 2023-10-18T22:23:32.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.114+0000 7fda7593a700 1 -- 172.21.15.8:0/1163726519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda700f77d0 msgr2=0x7fda700f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.114+0000 7fda7593a700 1 --2- 172.21.15.8:0/1163726519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda700f77d0 0x7fda700f7c30 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7fda5c004660 tx=0x7fda5c009b30).stop 2023-10-18T22:23:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.114+0000 7fda7593a700 1 -- 172.21.15.8:0/1163726519 shutdown_connections 2023-10-18T22:23:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.114+0000 7fda7593a700 1 --2- 172.21.15.8:0/1163726519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda700f77d0 0x7fda700f7c30 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.114+0000 7fda7593a700 1 --2- 172.21.15.8:0/1163726519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda700f6530 0x7fda700f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.114+0000 7fda7593a700 1 -- 172.21.15.8:0/1163726519 >> 172.21.15.8:0/1163726519 conn(0x7fda700f1c90 msgr2=0x7fda700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.114+0000 7fda7593a700 1 -- 172.21.15.8:0/1163726519 shutdown_connections 2023-10-18T22:23:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.114+0000 7fda7593a700 1 -- 172.21.15.8:0/1163726519 wait complete. 2023-10-18T22:23:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.115+0000 7fda7593a700 1 Processor -- start 2023-10-18T22:23:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.115+0000 7fda7593a700 1 -- start start 2023-10-18T22:23:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda7593a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda700f6530 0x7fda70108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda7593a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda700f77d0 0x7fda70109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda7593a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda701099f0 con 0x7fda700f6530 2023-10-18T22:23:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda7593a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70109b30 con 0x7fda700f77d0 2023-10-18T22:23:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda74938700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda700f6530 0x7fda70108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda74938700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda700f6530 0x7fda70108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51974/0 (socket says 172.21.15.8:51974) 2023-10-18T22:23:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda74938700 1 -- 172.21.15.8:0/1246172166 learned_addr learned my addr 172.21.15.8:0/1246172166 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:23:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda6ffff700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda700f77d0 0x7fda70109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda74938700 1 -- 172.21.15.8:0/1246172166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda700f77d0 msgr2=0x7fda70109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:32.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda74938700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda700f77d0 0x7fda70109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda74938700 1 -- 172.21.15.8:0/1246172166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c005040 con 0x7fda700f6530 2023-10-18T22:23:32.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda6ffff700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda700f77d0 0x7fda70109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:23:32.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.116+0000 7fda74938700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda700f6530 0x7fda70108f50 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 rx=0x7fda64002700 tx=0x7fda64009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:32.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.117+0000 7fda6d7fa700 1 -- 172.21.15.8:0/1246172166 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda64009320 con 0x7fda700f6530 2023-10-18T22:23:32.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.117+0000 7fda7593a700 1 -- 172.21.15.8:0/1246172166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7010a4d0 con 0x7fda700f6530 2023-10-18T22:23:32.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.117+0000 7fda6d7fa700 1 -- 172.21.15.8:0/1246172166 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fda6400f040 con 0x7fda700f6530 2023-10-18T22:23:32.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.117+0000 7fda6d7fa700 1 -- 172.21.15.8:0/1246172166 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda64014710 con 0x7fda700f6530 2023-10-18T22:23:32.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.117+0000 7fda7593a700 1 -- 172.21.15.8:0/1246172166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7010aa90 con 0x7fda700f6530 2023-10-18T22:23:32.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.118+0000 7fda7593a700 1 -- 172.21.15.8:0/1246172166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda70045ad0 con 0x7fda700f6530 2023-10-18T22:23:32.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.119+0000 7fda6d7fa700 1 -- 172.21.15.8:0/1246172166 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fda64009480 con 0x7fda700f6530 2023-10-18T22:23:32.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.120+0000 7fda6d7fa700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda60060f70 0x7fda60063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:32.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.120+0000 7fda6d7fa700 1 -- 172.21.15.8:0/1246172166 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fda6407c930 con 0x7fda700f6530 2023-10-18T22:23:32.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.120+0000 7fda6ffff700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda60060f70 0x7fda60063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:32.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.120+0000 7fda6ffff700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda60060f70 0x7fda60063430 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7fda5c009d60 tx=0x7fda5c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:32.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.124+0000 7fda6d7fa700 1 -- 172.21.15.8:0/1246172166 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fda6404ffd0 con 0x7fda700f6530 2023-10-18T22:23:32.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.315+0000 7fda7593a700 1 -- 172.21.15.8:0/1246172166 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda7010ad60 con 0x7fda60060f70 2023-10-18T22:23:32.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.324+0000 7fda6d7fa700 1 -- 172.21.15.8:0/1246172166 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fda7010ad60 con 0x7fda60060f70 2023-10-18T22:23:32.326 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:23:32.326 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (90m) 7m ago 91m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:23:32.326 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (84m) 7m ago 91m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:23:32.326 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (84m) 5m ago 90m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:23:32.326 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (90m) 7m ago 91m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:23:32.327 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 87m - - 2023-10-18T22:23:32.327 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 87m - - 2023-10-18T22:23:32.327 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 87m - - 2023-10-18T22:23:32.327 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 87m - - 2023-10-18T22:23:32.327 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (85m) 7m ago 93m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:23:32.328 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (84m) 5m ago 90m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:23:32.328 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (84m) 7m ago 93m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:23:32.328 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (84m) 5m ago 90m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:23:32.328 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (91m) 7m ago 91m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:23:32.328 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (90m) 5m ago 90m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:23:32.328 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (83m) 7m ago 90m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:23:32.329 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (81m) 7m ago 89m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:23:32.329 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (81m) 7m ago 89m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:23:32.329 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (80m) 5m ago 89m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:23:32.329 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (80m) 5m ago 89m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:23:32.329 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (79m) 5m ago 88m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:23:32.330 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (85m) 7m ago 90m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:23:32.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.326+0000 7fda7593a700 1 -- 172.21.15.8:0/1246172166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda60060f70 msgr2=0x7fda60063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:32.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.326+0000 7fda7593a700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda60060f70 0x7fda60063430 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7fda5c009d60 tx=0x7fda5c009b30).stop 2023-10-18T22:23:32.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.326+0000 7fda7593a700 1 -- 172.21.15.8:0/1246172166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda700f6530 msgr2=0x7fda70108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:32.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.326+0000 7fda7593a700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda700f6530 0x7fda70108f50 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 rx=0x7fda64002700 tx=0x7fda64009d80).stop 2023-10-18T22:23:32.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.326+0000 7fda7593a700 1 -- 172.21.15.8:0/1246172166 shutdown_connections 2023-10-18T22:23:32.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.326+0000 7fda7593a700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda60060f70 0x7fda60063430 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.326+0000 7fda7593a700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda700f6530 0x7fda70108f50 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.326+0000 7fda7593a700 1 --2- 172.21.15.8:0/1246172166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda700f77d0 0x7fda70109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.326+0000 7fda7593a700 1 -- 172.21.15.8:0/1246172166 >> 172.21.15.8:0/1246172166 conn(0x7fda700f1c90 msgr2=0x7fda700f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:32.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.327+0000 7fda7593a700 1 -- 172.21.15.8:0/1246172166 shutdown_connections 2023-10-18T22:23:32.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.327+0000 7fda7593a700 1 -- 172.21.15.8:0/1246172166 wait complete. 2023-10-18T22:23:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.463+0000 7f638b59e700 1 -- 172.21.15.8:0/1536018589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c0f77d0 msgr2=0x7f638c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.463+0000 7f638b59e700 1 --2- 172.21.15.8:0/1536018589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c0f77d0 0x7f638c0f7c30 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f6380004660 tx=0x7f6380009b30).stop 2023-10-18T22:23:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.463+0000 7f638b59e700 1 -- 172.21.15.8:0/1536018589 shutdown_connections 2023-10-18T22:23:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.463+0000 7f638b59e700 1 --2- 172.21.15.8:0/1536018589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c0f77d0 0x7f638c0f7c30 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.463+0000 7f638b59e700 1 --2- 172.21.15.8:0/1536018589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f638c0f6530 0x7f638c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.463+0000 7f638b59e700 1 -- 172.21.15.8:0/1536018589 >> 172.21.15.8:0/1536018589 conn(0x7f638c0f1c90 msgr2=0x7f638c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.464+0000 7f638b59e700 1 -- 172.21.15.8:0/1536018589 shutdown_connections 2023-10-18T22:23:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.464+0000 7f638b59e700 1 -- 172.21.15.8:0/1536018589 wait complete. 2023-10-18T22:23:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.464+0000 7f638b59e700 1 Processor -- start 2023-10-18T22:23:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.465+0000 7f638b59e700 1 -- start start 2023-10-18T22:23:32.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.465+0000 7f638b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f638c0f6530 0x7f638c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:32.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.465+0000 7f638b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c0f77d0 0x7f638c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:32.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.465+0000 7f638b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c06a380 con 0x7f638c0f77d0 2023-10-18T22:23:32.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.465+0000 7f638b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c06a4c0 con 0x7f638c0f6530 2023-10-18T22:23:32.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.465+0000 7f6389d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c0f77d0 0x7f638c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.465+0000 7f6389d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c0f77d0 0x7f638c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51988/0 (socket says 172.21.15.8:51988) 2023-10-18T22:23:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.465+0000 7f6389d9b700 1 -- 172.21.15.8:0/2803053256 learned_addr learned my addr 172.21.15.8:0/2803053256 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:23:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.465+0000 7f638a59c700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f638c0f6530 0x7f638c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.466+0000 7f6389d9b700 1 -- 172.21.15.8:0/2803053256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f638c0f6530 msgr2=0x7f638c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.466+0000 7f6389d9b700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f638c0f6530 0x7f638c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.466+0000 7f6389d9b700 1 -- 172.21.15.8:0/2803053256 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380005040 con 0x7f638c0f77d0 2023-10-18T22:23:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.466+0000 7f6389d9b700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c0f77d0 0x7f638c069e20 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f6380009f50 tx=0x7f6380009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.466+0000 7f637affd700 1 -- 172.21.15.8:0/2803053256 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6380018070 con 0x7f638c0f77d0 2023-10-18T22:23:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.466+0000 7f637affd700 1 -- 172.21.15.8:0/2803053256 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6380009630 con 0x7f638c0f77d0 2023-10-18T22:23:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.466+0000 7f637affd700 1 -- 172.21.15.8:0/2803053256 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f638001c3c0 con 0x7f638c0f77d0 2023-10-18T22:23:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.466+0000 7f638b59e700 1 -- 172.21.15.8:0/2803053256 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c06a740 con 0x7f638c0f77d0 2023-10-18T22:23:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.466+0000 7f638b59e700 1 -- 172.21.15.8:0/2803053256 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c06aca0 con 0x7f638c0f77d0 2023-10-18T22:23:32.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.467+0000 7f638b59e700 1 -- 172.21.15.8:0/2803053256 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c045ad0 con 0x7f638c0f77d0 2023-10-18T22:23:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.468+0000 7f637affd700 1 -- 172.21.15.8:0/2803053256 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f638001d420 con 0x7f638c0f77d0 2023-10-18T22:23:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.469+0000 7f637affd700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6374060f70 0x7f6374063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:32.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.469+0000 7f637affd700 1 -- 172.21.15.8:0/2803053256 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f638007e580 con 0x7f638c0f77d0 2023-10-18T22:23:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.469+0000 7f638a59c700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6374060f70 0x7f6374063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.470+0000 7f638a59c700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6374060f70 0x7f6374063430 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f638c06b730 tx=0x7f637c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.473+0000 7f637affd700 1 -- 172.21.15.8:0/2803053256 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f638004e1b0 con 0x7f638c0f77d0 2023-10-18T22:23:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:31.305722+0000 mgr.smithi008.flmjzp (mgr.14640) 5076 : cluster [DBG] pgmap v3482: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:32.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.725+0000 7f638b59e700 1 -- 172.21.15.8:0/2803053256 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f638c027a00 con 0x7f638c0f77d0 2023-10-18T22:23:32.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.725+0000 7f637affd700 1 -- 172.21.15.8:0/2803053256 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f63800517d0 con 0x7f638c0f77d0 2023-10-18T22:23:32.727 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:23:32.727 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:23:32.727 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:23:32.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:23:32.728 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:23:32.728 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:23:32.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:23:32.728 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:23:32.729 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:23:32.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:23:32.729 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:23:32.729 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:23:32.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:23:32.729 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:23:32.730 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:23:32.730 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:23:32.730 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:23:32.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.727+0000 7f638b59e700 1 -- 172.21.15.8:0/2803053256 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6374060f70 msgr2=0x7f6374063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:32.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.727+0000 7f638b59e700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6374060f70 0x7f6374063430 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f638c06b730 tx=0x7f637c00b040).stop 2023-10-18T22:23:32.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.727+0000 7f638b59e700 1 -- 172.21.15.8:0/2803053256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c0f77d0 msgr2=0x7f638c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:32.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.727+0000 7f638b59e700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c0f77d0 0x7f638c069e20 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f6380009f50 tx=0x7f6380009b30).stop 2023-10-18T22:23:32.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.727+0000 7f638b59e700 1 -- 172.21.15.8:0/2803053256 shutdown_connections 2023-10-18T22:23:32.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.727+0000 7f638b59e700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6374060f70 0x7f6374063430 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.727+0000 7f638b59e700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f638c0f6530 0x7f638c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.727+0000 7f638b59e700 1 --2- 172.21.15.8:0/2803053256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f638c0f77d0 0x7f638c069e20 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.727+0000 7f638b59e700 1 -- 172.21.15.8:0/2803053256 >> 172.21.15.8:0/2803053256 conn(0x7f638c0f1c90 msgr2=0x7f638c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:32.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.728+0000 7f638b59e700 1 -- 172.21.15.8:0/2803053256 shutdown_connections 2023-10-18T22:23:32.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.728+0000 7f638b59e700 1 -- 172.21.15.8:0/2803053256 wait complete. 2023-10-18T22:23:32.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:31.305722+0000 mgr.smithi008.flmjzp (mgr.14640) 5076 : cluster [DBG] pgmap v3482: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:32.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.864+0000 7f6a1b168700 1 -- 172.21.15.8:0/3397622716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a14060270 msgr2=0x7f6a140f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:32.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.864+0000 7f6a1b168700 1 --2- 172.21.15.8:0/3397622716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a14060270 0x7f6a140f91b0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 rx=0x7f6a10004660 tx=0x7f6a10009b30).stop 2023-10-18T22:23:32.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.864+0000 7f6a1b168700 1 -- 172.21.15.8:0/3397622716 shutdown_connections 2023-10-18T22:23:32.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.864+0000 7f6a1b168700 1 --2- 172.21.15.8:0/3397622716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a140f96a0 0x7f6a140fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.864+0000 7f6a1b168700 1 --2- 172.21.15.8:0/3397622716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a14060270 0x7f6a140f91b0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.864+0000 7f6a1b168700 1 -- 172.21.15.8:0/3397622716 >> 172.21.15.8:0/3397622716 conn(0x7f6a140f0b90 msgr2=0x7f6a140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:32.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.864+0000 7f6a1b168700 1 -- 172.21.15.8:0/3397622716 shutdown_connections 2023-10-18T22:23:32.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.864+0000 7f6a1b168700 1 -- 172.21.15.8:0/3397622716 wait complete. 2023-10-18T22:23:32.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.865+0000 7f6a1b168700 1 Processor -- start 2023-10-18T22:23:32.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.865+0000 7f6a1b168700 1 -- start start 2023-10-18T22:23:32.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a1b168700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a14060270 0x7f6a14108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:32.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a1b168700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a140f96a0 0x7f6a141094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:32.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a1b168700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14109a50 con 0x7f6a140f96a0 2023-10-18T22:23:32.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a1b168700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14109b90 con 0x7f6a14060270 2023-10-18T22:23:32.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a19965700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a140f96a0 0x7f6a141094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:32.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a19965700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a140f96a0 0x7f6a141094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52010/0 (socket says 172.21.15.8:52010) 2023-10-18T22:23:32.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a19965700 1 -- 172.21.15.8:0/1618188867 learned_addr learned my addr 172.21.15.8:0/1618188867 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:23:32.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a1a166700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a14060270 0x7f6a14108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:32.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a19965700 1 -- 172.21.15.8:0/1618188867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a14060270 msgr2=0x7f6a14108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:32.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a19965700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a14060270 0x7f6a14108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:32.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a19965700 1 -- 172.21.15.8:0/1618188867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10005040 con 0x7f6a140f96a0 2023-10-18T22:23:32.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.866+0000 7f6a1a166700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a14060270 0x7f6a14108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:23:32.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.867+0000 7f6a19965700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a140f96a0 0x7f6a141094a0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f6a04002700 tx=0x7f6a04009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:32.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.867+0000 7f6a0affd700 1 -- 172.21.15.8:0/1618188867 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a04009320 con 0x7f6a140f96a0 2023-10-18T22:23:32.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.867+0000 7f6a0affd700 1 -- 172.21.15.8:0/1618188867 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6a0400f040 con 0x7f6a140f96a0 2023-10-18T22:23:32.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.867+0000 7f6a1b168700 1 -- 172.21.15.8:0/1618188867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1410a530 con 0x7f6a140f96a0 2023-10-18T22:23:32.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.867+0000 7f6a0affd700 1 -- 172.21.15.8:0/1618188867 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a04014860 con 0x7f6a140f96a0 2023-10-18T22:23:32.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.867+0000 7f6a1b168700 1 -- 172.21.15.8:0/1618188867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1410aaf0 con 0x7f6a140f96a0 2023-10-18T22:23:32.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.868+0000 7f6a1b168700 1 -- 172.21.15.8:0/1618188867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a14045ad0 con 0x7f6a140f96a0 2023-10-18T22:23:32.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.869+0000 7f6a0affd700 1 -- 172.21.15.8:0/1618188867 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6a040077b0 con 0x7f6a140f96a0 2023-10-18T22:23:32.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.870+0000 7f6a0affd700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a00060f70 0x7f6a00063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:32.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.870+0000 7f6a0affd700 1 -- 172.21.15.8:0/1618188867 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6a0407cfa0 con 0x7f6a140f96a0 2023-10-18T22:23:32.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.870+0000 7f6a1a166700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a00060f70 0x7f6a00063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:32.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.870+0000 7f6a1a166700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a00060f70 0x7f6a00063430 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f6a10005010 tx=0x7f6a10009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:32.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:32.874+0000 7f6a0affd700 1 -- 172.21.15.8:0/1618188867 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6a04050580 con 0x7f6a140f96a0 2023-10-18T22:23:33.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.099+0000 7f6a1b168700 1 -- 172.21.15.8:0/1618188867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6a1410f690 con 0x7f6a140f96a0 2023-10-18T22:23:33.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.100+0000 7f6a0affd700 1 -- 172.21.15.8:0/1618188867 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f6a040181b0 con 0x7f6a140f96a0 2023-10-18T22:23:33.102 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:23:33.102 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:23:33.102 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:23:33.102 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:23:33.103 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:23:33.103 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:23:33.103 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:23:33.103 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:23:33.103 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:23:33.104 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:23:33.104 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:23:33.104 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:23:33.104 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:23:33.104 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:23:33.104 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:23:33.105 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:23:33.105 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:23:33.105 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:23:33.105 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:23:33.105 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:23:33.106 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:23:33.106 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:23:33.106 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:23:33.106 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:23:33.107 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:23:33.107 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:23:33.107 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:23:33.107 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:23:33.107 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:23:33.108 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:23:33.108 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:23:33.108 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:23:33.108 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:23:33.108 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:23:33.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 -- 172.21.15.8:0/1618188867 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a00060f70 msgr2=0x7f6a00063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:33.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a00060f70 0x7f6a00063430 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f6a10005010 tx=0x7f6a10009b30).stop 2023-10-18T22:23:33.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 -- 172.21.15.8:0/1618188867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a140f96a0 msgr2=0x7f6a141094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:33.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a140f96a0 0x7f6a141094a0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f6a04002700 tx=0x7f6a04009d60).stop 2023-10-18T22:23:33.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 -- 172.21.15.8:0/1618188867 shutdown_connections 2023-10-18T22:23:33.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a00060f70 0x7f6a00063430 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:33.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a14060270 0x7f6a14108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:33.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 --2- 172.21.15.8:0/1618188867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a140f96a0 0x7f6a141094a0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:33.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 -- 172.21.15.8:0/1618188867 >> 172.21.15.8:0/1618188867 conn(0x7f6a140f0b90 msgr2=0x7f6a140f4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:33.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 -- 172.21.15.8:0/1618188867 shutdown_connections 2023-10-18T22:23:33.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.102+0000 7f6a1b168700 1 -- 172.21.15.8:0/1618188867 wait complete. 2023-10-18T22:23:33.111 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:23:33.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.239+0000 7f5114d31700 1 -- 172.21.15.8:0/3938208096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51100f6530 msgr2=0x7f51100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:33.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.239+0000 7f5114d31700 1 --2- 172.21.15.8:0/3938208096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51100f6530 0x7f51100f6950 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f5100004660 tx=0x7f5100009b30).stop 2023-10-18T22:23:33.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.239+0000 7f5114d31700 1 -- 172.21.15.8:0/3938208096 shutdown_connections 2023-10-18T22:23:33.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.239+0000 7f5114d31700 1 --2- 172.21.15.8:0/3938208096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100f77d0 0x7f51100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:33.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.239+0000 7f5114d31700 1 --2- 172.21.15.8:0/3938208096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51100f6530 0x7f51100f6950 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:33.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.239+0000 7f5114d31700 1 -- 172.21.15.8:0/3938208096 >> 172.21.15.8:0/3938208096 conn(0x7f51100f1c90 msgr2=0x7f51100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:33.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.239+0000 7f5114d31700 1 -- 172.21.15.8:0/3938208096 shutdown_connections 2023-10-18T22:23:33.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.239+0000 7f5114d31700 1 -- 172.21.15.8:0/3938208096 wait complete. 2023-10-18T22:23:33.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.240+0000 7f5114d31700 1 Processor -- start 2023-10-18T22:23:33.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.240+0000 7f5114d31700 1 -- start start 2023-10-18T22:23:33.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.240+0000 7f5114d31700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100f6530 0x7f511006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:33.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.240+0000 7f5114d31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51100f77d0 0x7f5110069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:33.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.240+0000 7f5114d31700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511006a380 con 0x7f51100f77d0 2023-10-18T22:23:33.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.240+0000 7f5114d31700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511006a4c0 con 0x7f51100f6530 2023-10-18T22:23:33.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.240+0000 7f510effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51100f77d0 0x7f5110069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:33.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f510effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51100f77d0 0x7f5110069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52028/0 (socket says 172.21.15.8:52028) 2023-10-18T22:23:33.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f510effd700 1 -- 172.21.15.8:0/2861493068 learned_addr learned my addr 172.21.15.8:0/2861493068 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:23:33.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f510f7fe700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100f6530 0x7f511006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:33.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f510effd700 1 -- 172.21.15.8:0/2861493068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100f6530 msgr2=0x7f511006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:33.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f510effd700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100f6530 0x7f511006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:33.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f510effd700 1 -- 172.21.15.8:0/2861493068 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5100005040 con 0x7f51100f77d0 2023-10-18T22:23:33.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f510effd700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51100f77d0 0x7f5110069e20 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f51040026d0 tx=0x7f5104009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:33.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f50f7fff700 1 -- 172.21.15.8:0/2861493068 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5104009320 con 0x7f51100f77d0 2023-10-18T22:23:33.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f50f7fff700 1 -- 172.21.15.8:0/2861493068 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f510400f040 con 0x7f51100f77d0 2023-10-18T22:23:33.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f50f7fff700 1 -- 172.21.15.8:0/2861493068 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51040148a0 con 0x7f51100f77d0 2023-10-18T22:23:33.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.241+0000 7f5114d31700 1 -- 172.21.15.8:0/2861493068 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511006a7a0 con 0x7f51100f77d0 2023-10-18T22:23:33.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.242+0000 7f5114d31700 1 -- 172.21.15.8:0/2861493068 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511010ede0 con 0x7f51100f77d0 2023-10-18T22:23:33.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.243+0000 7f5114d31700 1 -- 172.21.15.8:0/2861493068 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5110045ad0 con 0x7f51100f77d0 2023-10-18T22:23:33.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.243+0000 7f50f7fff700 1 -- 172.21.15.8:0/2861493068 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5104009480 con 0x7f51100f77d0 2023-10-18T22:23:33.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.244+0000 7f50f7fff700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50f8060f70 0x7f50f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:23:33.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.244+0000 7f50f7fff700 1 -- 172.21.15.8:0/2861493068 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f510407d090 con 0x7f51100f77d0 2023-10-18T22:23:33.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.245+0000 7f510f7fe700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50f8060f70 0x7f50f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:23:33.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.245+0000 7f510f7fe700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50f8060f70 0x7f50f8063430 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f5100005010 tx=0x7f5100009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:23:33.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.248+0000 7f50f7fff700 1 -- 172.21.15.8:0/2861493068 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f510404cc40 con 0x7f51100f77d0 2023-10-18T22:23:33.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.451+0000 7f5114d31700 1 -- 172.21.15.8:0/2861493068 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51100fedd0 con 0x7f50f8060f70 2023-10-18T22:23:33.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.453+0000 7f50f7fff700 1 -- 172.21.15.8:0/2861493068 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f51100fedd0 con 0x7f50f8060f70 2023-10-18T22:23:33.454 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:23:33.454 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:23:33.455 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:23:33.455 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:23:33.455 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:23:33.455 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:23:33.455 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:23:33.456 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:23:33.456 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:23:33.456 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:23:33.456 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:23:33.456 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:23:33.457 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:23:33.457 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:23:33.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 -- 172.21.15.8:0/2861493068 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50f8060f70 msgr2=0x7f50f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:33.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50f8060f70 0x7f50f8063430 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f5100005010 tx=0x7f5100009b30).stop 2023-10-18T22:23:33.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 -- 172.21.15.8:0/2861493068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51100f77d0 msgr2=0x7f5110069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:23:33.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51100f77d0 0x7f5110069e20 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f51040026d0 tx=0x7f5104009de0).stop 2023-10-18T22:23:33.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 -- 172.21.15.8:0/2861493068 shutdown_connections 2023-10-18T22:23:33.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f50f8060f70 0x7f50f8063430 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:33.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100f6530 0x7f511006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:33.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 --2- 172.21.15.8:0/2861493068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51100f77d0 0x7f5110069e20 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:23:33.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 -- 172.21.15.8:0/2861493068 >> 172.21.15.8:0/2861493068 conn(0x7f51100f1c90 msgr2=0x7f51100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:23:33.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 -- 172.21.15.8:0/2861493068 shutdown_connections 2023-10-18T22:23:33.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:23:33.455+0000 7f5114d31700 1 -- 172.21.15.8:0/2861493068 wait complete. 2023-10-18T22:23:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:31.625718+0000 mgr.smithi008.flmjzp (mgr.14640) 5077 : audit [DBG] from='client.38056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:31.975117+0000 mgr.smithi008.flmjzp (mgr.14640) 5078 : audit [DBG] from='client.38060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:32.316264+0000 mgr.smithi008.flmjzp (mgr.14640) 5079 : audit [DBG] from='client.38064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:32.725973+0000 mon.smithi008 (mon.0) 5338 : audit [DBG] from='client.? 172.21.15.8:0/2803053256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:33.100569+0000 mon.smithi008 (mon.0) 5339 : audit [DBG] from='client.? 172.21.15.8:0/1618188867' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:23:33.852 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:31.625718+0000 mgr.smithi008.flmjzp (mgr.14640) 5077 : audit [DBG] from='client.38056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:33.853 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:31.975117+0000 mgr.smithi008.flmjzp (mgr.14640) 5078 : audit [DBG] from='client.38060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:33.853 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:32.316264+0000 mgr.smithi008.flmjzp (mgr.14640) 5079 : audit [DBG] from='client.38064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:33.853 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:32.725973+0000 mon.smithi008 (mon.0) 5338 : audit [DBG] from='client.? 172.21.15.8:0/2803053256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:33.853 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:33.100569+0000 mon.smithi008 (mon.0) 5339 : audit [DBG] from='client.? 172.21.15.8:0/1618188867' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:23:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:33.306239+0000 mgr.smithi008.flmjzp (mgr.14640) 5080 : cluster [DBG] pgmap v3483: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:33.453119+0000 mgr.smithi008.flmjzp (mgr.14640) 5081 : audit [DBG] from='client.38076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:33.306239+0000 mgr.smithi008.flmjzp (mgr.14640) 5080 : cluster [DBG] pgmap v3483: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:33.453119+0000 mgr.smithi008.flmjzp (mgr.14640) 5081 : audit [DBG] from='client.38076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:23:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:35.306951+0000 mgr.smithi008.flmjzp (mgr.14640) 5082 : cluster [DBG] pgmap v3484: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:35.306951+0000 mgr.smithi008.flmjzp (mgr.14640) 5082 : cluster [DBG] pgmap v3484: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:37.328150+0000 mon.smithi008 (mon.0) 5340 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:37.328150+0000 mon.smithi008 (mon.0) 5340 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:37.307591+0000 mgr.smithi008.flmjzp (mgr.14640) 5083 : cluster [DBG] pgmap v3485: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:37.684523+0000 mon.smithi008 (mon.0) 5341 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:38.228927+0000 mon.smithi008 (mon.0) 5342 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:38.230080+0000 mon.smithi008 (mon.0) 5343 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:38.236849+0000 mon.smithi008 (mon.0) 5344 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:38.243325+0000 mon.smithi008 (mon.0) 5345 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:38.246426+0000 mon.smithi008 (mon.0) 5346 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:38.248086+0000 mon.smithi008 (mon.0) 5347 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:38.249760+0000 mon.smithi008 (mon.0) 5348 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:38.251810+0000 mon.smithi008 (mon.0) 5349 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:37.307591+0000 mgr.smithi008.flmjzp (mgr.14640) 5083 : cluster [DBG] pgmap v3485: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:37.684523+0000 mon.smithi008 (mon.0) 5341 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:38.228927+0000 mon.smithi008 (mon.0) 5342 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:38.230080+0000 mon.smithi008 (mon.0) 5343 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:38.236849+0000 mon.smithi008 (mon.0) 5344 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:38.243325+0000 mon.smithi008 (mon.0) 5345 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:38.246426+0000 mon.smithi008 (mon.0) 5346 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:38.248086+0000 mon.smithi008 (mon.0) 5347 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:38.249760+0000 mon.smithi008 (mon.0) 5348 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:38.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:38.251810+0000 mon.smithi008 (mon.0) 5349 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:38.231014+0000 mgr.smithi008.flmjzp (mgr.14640) 5084 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:38.231695+0000 mgr.smithi008.flmjzp (mgr.14640) 5085 : cluster [DBG] pgmap v3486: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:38.232038+0000 mgr.smithi008.flmjzp (mgr.14640) 5086 : cluster [DBG] pgmap v3487: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:38.253753+0000 mgr.smithi008.flmjzp (mgr.14640) 5087 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:38.231014+0000 mgr.smithi008.flmjzp (mgr.14640) 5084 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:38.231695+0000 mgr.smithi008.flmjzp (mgr.14640) 5085 : cluster [DBG] pgmap v3486: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:38.232038+0000 mgr.smithi008.flmjzp (mgr.14640) 5086 : cluster [DBG] pgmap v3487: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:38.253753+0000 mgr.smithi008.flmjzp (mgr.14640) 5087 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:41.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:40.232623+0000 mgr.smithi008.flmjzp (mgr.14640) 5088 : cluster [DBG] pgmap v3488: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:40.232623+0000 mgr.smithi008.flmjzp (mgr.14640) 5088 : cluster [DBG] pgmap v3488: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:42.233317+0000 mgr.smithi008.flmjzp (mgr.14640) 5089 : cluster [DBG] pgmap v3489: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:43.852 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:42.233317+0000 mgr.smithi008.flmjzp (mgr.14640) 5089 : cluster [DBG] pgmap v3489: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:44.234021+0000 mgr.smithi008.flmjzp (mgr.14640) 5090 : cluster [DBG] pgmap v3490: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:45.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:44.234021+0000 mgr.smithi008.flmjzp (mgr.14640) 5090 : cluster [DBG] pgmap v3490: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:46.234601+0000 mgr.smithi008.flmjzp (mgr.14640) 5091 : cluster [DBG] pgmap v3491: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:46.234601+0000 mgr.smithi008.flmjzp (mgr.14640) 5091 : cluster [DBG] pgmap v3491: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:48.264537+0000 mon.smithi008 (mon.0) 5350 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:48.266633+0000 mon.smithi008 (mon.0) 5351 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:48.267585+0000 mon.smithi008 (mon.0) 5352 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:48.274026+0000 mon.smithi008 (mon.0) 5353 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:48.280548+0000 mon.smithi008 (mon.0) 5354 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:48.283616+0000 mon.smithi008 (mon.0) 5355 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:48.285270+0000 mon.smithi008 (mon.0) 5356 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:48.286842+0000 mon.smithi008 (mon.0) 5357 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:48.288825+0000 mon.smithi008 (mon.0) 5358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:48.264537+0000 mon.smithi008 (mon.0) 5350 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:48.266633+0000 mon.smithi008 (mon.0) 5351 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:48.267585+0000 mon.smithi008 (mon.0) 5352 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:48.274026+0000 mon.smithi008 (mon.0) 5353 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:48.280548+0000 mon.smithi008 (mon.0) 5354 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:48.283616+0000 mon.smithi008 (mon.0) 5355 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:48.285270+0000 mon.smithi008 (mon.0) 5356 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:48.286842+0000 mon.smithi008 (mon.0) 5357 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:48.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:48.288825+0000 mon.smithi008 (mon.0) 5358 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:48.235232+0000 mgr.smithi008.flmjzp (mgr.14640) 5092 : cluster [DBG] pgmap v3492: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:48.268421+0000 mgr.smithi008.flmjzp (mgr.14640) 5093 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:48.269049+0000 mgr.smithi008.flmjzp (mgr.14640) 5094 : cluster [DBG] pgmap v3493: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:48.269389+0000 mgr.smithi008.flmjzp (mgr.14640) 5095 : cluster [DBG] pgmap v3494: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:49.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:48.290687+0000 mgr.smithi008.flmjzp (mgr.14640) 5096 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:48.235232+0000 mgr.smithi008.flmjzp (mgr.14640) 5092 : cluster [DBG] pgmap v3492: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:48.268421+0000 mgr.smithi008.flmjzp (mgr.14640) 5093 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:48.269049+0000 mgr.smithi008.flmjzp (mgr.14640) 5094 : cluster [DBG] pgmap v3493: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:48.269389+0000 mgr.smithi008.flmjzp (mgr.14640) 5095 : cluster [DBG] pgmap v3494: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:48.290687+0000 mgr.smithi008.flmjzp (mgr.14640) 5096 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:50.269956+0000 mgr.smithi008.flmjzp (mgr.14640) 5097 : cluster [DBG] pgmap v3495: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:51.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:50.269956+0000 mgr.smithi008.flmjzp (mgr.14640) 5097 : cluster [DBG] pgmap v3495: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:53.853 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:52.270494+0000 mgr.smithi008.flmjzp (mgr.14640) 5098 : cluster [DBG] pgmap v3496: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:52.270494+0000 mgr.smithi008.flmjzp (mgr.14640) 5098 : cluster [DBG] pgmap v3496: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:54.271110+0000 mgr.smithi008.flmjzp (mgr.14640) 5099 : cluster [DBG] pgmap v3497: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:55.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:54.271110+0000 mgr.smithi008.flmjzp (mgr.14640) 5099 : cluster [DBG] pgmap v3497: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:56.271650+0000 mgr.smithi008.flmjzp (mgr.14640) 5100 : cluster [DBG] pgmap v3498: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:56.271650+0000 mgr.smithi008.flmjzp (mgr.14640) 5100 : cluster [DBG] pgmap v3498: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:58.299240+0000 mon.smithi008 (mon.0) 5359 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:58.301290+0000 mon.smithi008 (mon.0) 5360 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:58.302312+0000 mon.smithi008 (mon.0) 5361 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:58.309018+0000 mon.smithi008 (mon.0) 5362 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:58.315543+0000 mon.smithi008 (mon.0) 5363 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:58.318575+0000 mon.smithi008 (mon.0) 5364 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:58.320267+0000 mon.smithi008 (mon.0) 5365 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:58.321878+0000 mon.smithi008 (mon.0) 5366 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:23:58.324115+0000 mon.smithi008 (mon.0) 5367 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:58.299240+0000 mon.smithi008 (mon.0) 5359 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:58.301290+0000 mon.smithi008 (mon.0) 5360 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:23:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:58.302312+0000 mon.smithi008 (mon.0) 5361 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:23:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:58.309018+0000 mon.smithi008 (mon.0) 5362 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:23:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:58.315543+0000 mon.smithi008 (mon.0) 5363 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:23:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:58.318575+0000 mon.smithi008 (mon.0) 5364 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:58.320267+0000 mon.smithi008 (mon.0) 5365 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:58.321878+0000 mon.smithi008 (mon.0) 5366 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:58.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:23:58.324115+0000 mon.smithi008 (mon.0) 5367 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:23:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:58.272123+0000 mgr.smithi008.flmjzp (mgr.14640) 5101 : cluster [DBG] pgmap v3499: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:58.303180+0000 mgr.smithi008.flmjzp (mgr.14640) 5102 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:58.303705+0000 mgr.smithi008.flmjzp (mgr.14640) 5103 : cluster [DBG] pgmap v3500: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:23:58.303987+0000 mgr.smithi008.flmjzp (mgr.14640) 5104 : cluster [DBG] pgmap v3501: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:23:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:23:58.326052+0000 mgr.smithi008.flmjzp (mgr.14640) 5105 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:23:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:58.272123+0000 mgr.smithi008.flmjzp (mgr.14640) 5101 : cluster [DBG] pgmap v3499: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:58.303180+0000 mgr.smithi008.flmjzp (mgr.14640) 5102 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:23:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:58.303705+0000 mgr.smithi008.flmjzp (mgr.14640) 5103 : cluster [DBG] pgmap v3500: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:23:58.303987+0000 mgr.smithi008.flmjzp (mgr.14640) 5104 : cluster [DBG] pgmap v3501: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:23:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:23:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:23:58.326052+0000 mgr.smithi008.flmjzp (mgr.14640) 5105 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:00.304553+0000 mgr.smithi008.flmjzp (mgr.14640) 5106 : cluster [DBG] pgmap v3502: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:00.304553+0000 mgr.smithi008.flmjzp (mgr.14640) 5106 : cluster [DBG] pgmap v3502: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:03.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.609+0000 7f19fbfff700 1 -- 172.21.15.8:0/2457891020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19fc06a330 msgr2=0x7f19fc06a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:03.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.609+0000 7f19fbfff700 1 --2- 172.21.15.8:0/2457891020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19fc06a330 0x7f19fc06a7b0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f19f0004660 tx=0x7f19f0009b30).stop 2023-10-18T22:24:03.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.609+0000 7f19fbfff700 1 -- 172.21.15.8:0/2457891020 shutdown_connections 2023-10-18T22:24:03.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.609+0000 7f19fbfff700 1 --2- 172.21.15.8:0/2457891020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19fc06a330 0x7f19fc06a7b0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:03.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.609+0000 7f19fbfff700 1 --2- 172.21.15.8:0/2457891020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc06b940 0x7f19fc069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:03.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.609+0000 7f19fbfff700 1 -- 172.21.15.8:0/2457891020 >> 172.21.15.8:0/2457891020 conn(0x7f19fc0f1c90 msgr2=0x7f19fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:03.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.609+0000 7f19fbfff700 1 -- 172.21.15.8:0/2457891020 shutdown_connections 2023-10-18T22:24:03.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.609+0000 7f19fbfff700 1 -- 172.21.15.8:0/2457891020 wait complete. 2023-10-18T22:24:03.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.610+0000 7f19fbfff700 1 Processor -- start 2023-10-18T22:24:03.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.610+0000 7f19fbfff700 1 -- start start 2023-10-18T22:24:03.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.610+0000 7f19fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19fc06a330 0x7f19fc108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:03.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.610+0000 7f19fbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc06b940 0x7f19fc1093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:03.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.610+0000 7f19fbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc109950 con 0x7f19fc06a330 2023-10-18T22:24:03.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.610+0000 7f19fbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc109a90 con 0x7f19fc06b940 2023-10-18T22:24:03.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.611+0000 7f19faffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19fc06a330 0x7f19fc108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:03.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.611+0000 7f19faffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19fc06a330 0x7f19fc108eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34044/0 (socket says 172.21.15.8:34044) 2023-10-18T22:24:03.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.611+0000 7f19faffd700 1 -- 172.21.15.8:0/139495327 learned_addr learned my addr 172.21.15.8:0/139495327 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:03.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.611+0000 7f19fa7fc700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc06b940 0x7f19fc1093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:03.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.611+0000 7f19faffd700 1 -- 172.21.15.8:0/139495327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc06b940 msgr2=0x7f19fc1093a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:03.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.611+0000 7f19faffd700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc06b940 0x7f19fc1093a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:03.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.611+0000 7f19faffd700 1 -- 172.21.15.8:0/139495327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f0005040 con 0x7f19fc06a330 2023-10-18T22:24:03.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.611+0000 7f19faffd700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19fc06a330 0x7f19fc108eb0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7f19ec00e7f0 tx=0x7f19ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:03.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.611+0000 7f19e37fe700 1 -- 172.21.15.8:0/139495327 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec0092e0 con 0x7f19fc06a330 2023-10-18T22:24:03.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.612+0000 7f19e37fe700 1 -- 172.21.15.8:0/139495327 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f19ec00f040 con 0x7f19fc06a330 2023-10-18T22:24:03.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.612+0000 7f19fbfff700 1 -- 172.21.15.8:0/139495327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19fc10a430 con 0x7f19fc06a330 2023-10-18T22:24:03.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.612+0000 7f19e37fe700 1 -- 172.21.15.8:0/139495327 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec0147e0 con 0x7f19fc06a330 2023-10-18T22:24:03.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.612+0000 7f19fbfff700 1 -- 172.21.15.8:0/139495327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19fc10a970 con 0x7f19fc06a330 2023-10-18T22:24:03.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.613+0000 7f19fbfff700 1 -- 172.21.15.8:0/139495327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19fc045ad0 con 0x7f19fc06a330 2023-10-18T22:24:03.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.614+0000 7f19e37fe700 1 -- 172.21.15.8:0/139495327 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f19ec01b030 con 0x7f19fc06a330 2023-10-18T22:24:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.615+0000 7f19e37fe700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19e4060f70 0x7f19e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:03.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.615+0000 7f19e37fe700 1 -- 172.21.15.8:0/139495327 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f19ec07c6b0 con 0x7f19fc06a330 2023-10-18T22:24:03.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.615+0000 7f19fa7fc700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19e4060f70 0x7f19e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:03.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.615+0000 7f19fa7fc700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19e4060f70 0x7f19e4063430 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f19f0005010 tx=0x7f19f0016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:03.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.619+0000 7f19e37fe700 1 -- 172.21.15.8:0/139495327 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f19ec04fd40 con 0x7f19fc06a330 2023-10-18T22:24:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:02.305032+0000 mgr.smithi008.flmjzp (mgr.14640) 5107 : cluster [DBG] pgmap v3503: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:03.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:02.305032+0000 mgr.smithi008.flmjzp (mgr.14640) 5107 : cluster [DBG] pgmap v3503: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.816+0000 7f19fbfff700 1 -- 172.21.15.8:0/139495327 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19fc101050 con 0x7f19e4060f70 2023-10-18T22:24:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.817+0000 7f19e37fe700 1 -- 172.21.15.8:0/139495327 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f19fc101050 con 0x7f19e4060f70 2023-10-18T22:24:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.819+0000 7f19fbfff700 1 -- 172.21.15.8:0/139495327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19e4060f70 msgr2=0x7f19e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.819+0000 7f19fbfff700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19e4060f70 0x7f19e4063430 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f19f0005010 tx=0x7f19f0016040).stop 2023-10-18T22:24:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.819+0000 7f19fbfff700 1 -- 172.21.15.8:0/139495327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19fc06a330 msgr2=0x7f19fc108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.819+0000 7f19fbfff700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19fc06a330 0x7f19fc108eb0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7f19ec00e7f0 tx=0x7f19ec00b040).stop 2023-10-18T22:24:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.819+0000 7f19fbfff700 1 -- 172.21.15.8:0/139495327 shutdown_connections 2023-10-18T22:24:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.819+0000 7f19fbfff700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19e4060f70 0x7f19e4063430 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.819+0000 7f19fbfff700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19fc06a330 0x7f19fc108eb0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.819+0000 7f19fbfff700 1 --2- 172.21.15.8:0/139495327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19fc06b940 0x7f19fc1093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.819+0000 7f19fbfff700 1 -- 172.21.15.8:0/139495327 >> 172.21.15.8:0/139495327 conn(0x7f19fc0f1c90 msgr2=0x7f19fc0fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:03.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.820+0000 7f19fbfff700 1 -- 172.21.15.8:0/139495327 shutdown_connections 2023-10-18T22:24:03.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.820+0000 7f19fbfff700 1 -- 172.21.15.8:0/139495327 wait complete. 2023-10-18T22:24:03.836 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:24:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.959+0000 7ff58d5c2700 1 -- 172.21.15.8:0/2378213950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5880f6530 msgr2=0x7ff5880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.959+0000 7ff58d5c2700 1 --2- 172.21.15.8:0/2378213950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5880f6530 0x7ff5880f6950 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7ff578004660 tx=0x7ff578009b30).stop 2023-10-18T22:24:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.959+0000 7ff58d5c2700 1 -- 172.21.15.8:0/2378213950 shutdown_connections 2023-10-18T22:24:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.959+0000 7ff58d5c2700 1 --2- 172.21.15.8:0/2378213950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5880f77d0 0x7ff5880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.959+0000 7ff58d5c2700 1 --2- 172.21.15.8:0/2378213950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5880f6530 0x7ff5880f6950 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:03.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.959+0000 7ff58d5c2700 1 -- 172.21.15.8:0/2378213950 >> 172.21.15.8:0/2378213950 conn(0x7ff5880f1c90 msgr2=0x7ff5880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:03.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.959+0000 7ff58d5c2700 1 -- 172.21.15.8:0/2378213950 shutdown_connections 2023-10-18T22:24:03.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.959+0000 7ff58d5c2700 1 -- 172.21.15.8:0/2378213950 wait complete. 2023-10-18T22:24:03.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.960+0000 7ff58d5c2700 1 Processor -- start 2023-10-18T22:24:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.960+0000 7ff58d5c2700 1 -- start start 2023-10-18T22:24:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.960+0000 7ff58d5c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5880f6530 0x7ff58806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.960+0000 7ff58d5c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5880f77d0 0x7ff588069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.961+0000 7ff58d5c2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58806a380 con 0x7ff5880f6530 2023-10-18T22:24:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.961+0000 7ff58d5c2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58806a4c0 con 0x7ff5880f77d0 2023-10-18T22:24:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.961+0000 7ff587fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5880f6530 0x7ff58806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.961+0000 7ff587fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5880f6530 0x7ff58806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34056/0 (socket says 172.21.15.8:34056) 2023-10-18T22:24:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.961+0000 7ff587fff700 1 -- 172.21.15.8:0/3065021803 learned_addr learned my addr 172.21.15.8:0/3065021803 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.961+0000 7ff5877fe700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5880f77d0 0x7ff588069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.961+0000 7ff587fff700 1 -- 172.21.15.8:0/3065021803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5880f77d0 msgr2=0x7ff588069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.961+0000 7ff587fff700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5880f77d0 0x7ff588069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.961+0000 7ff587fff700 1 -- 172.21.15.8:0/3065021803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578005040 con 0x7ff5880f6530 2023-10-18T22:24:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.961+0000 7ff587fff700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5880f6530 0x7ff58806b9a0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7ff578007a60 tx=0x7ff578009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.962+0000 7ff584ff9700 1 -- 172.21.15.8:0/3065021803 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff578018070 con 0x7ff5880f6530 2023-10-18T22:24:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.962+0000 7ff584ff9700 1 -- 172.21.15.8:0/3065021803 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff578009630 con 0x7ff5880f6530 2023-10-18T22:24:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.962+0000 7ff58d5c2700 1 -- 172.21.15.8:0/3065021803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58806a740 con 0x7ff5880f6530 2023-10-18T22:24:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.962+0000 7ff584ff9700 1 -- 172.21.15.8:0/3065021803 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff57801c540 con 0x7ff5880f6530 2023-10-18T22:24:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.962+0000 7ff58d5c2700 1 -- 172.21.15.8:0/3065021803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58806aca0 con 0x7ff5880f6530 2023-10-18T22:24:03.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.963+0000 7ff58d5c2700 1 -- 172.21.15.8:0/3065021803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff588045ad0 con 0x7ff5880f6530 2023-10-18T22:24:03.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.964+0000 7ff584ff9700 1 -- 172.21.15.8:0/3065021803 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff57801d420 con 0x7ff5880f6530 2023-10-18T22:24:03.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.965+0000 7ff584ff9700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff570060f70 0x7ff570063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:03.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.965+0000 7ff584ff9700 1 -- 172.21.15.8:0/3065021803 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff57807e6c0 con 0x7ff5880f6530 2023-10-18T22:24:03.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.965+0000 7ff5877fe700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff570060f70 0x7ff570063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:03.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.966+0000 7ff5877fe700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff570060f70 0x7ff570063430 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7ff57c009760 tx=0x7ff57c009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:03.970+0000 7ff584ff9700 1 -- 172.21.15.8:0/3065021803 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff57804e2f0 con 0x7ff5880f6530 2023-10-18T22:24:04.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.166+0000 7ff58d5c2700 1 -- 172.21.15.8:0/3065021803 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5880fee00 con 0x7ff570060f70 2023-10-18T22:24:04.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.168+0000 7ff584ff9700 1 -- 172.21.15.8:0/3065021803 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff5880fee00 con 0x7ff570060f70 2023-10-18T22:24:04.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 -- 172.21.15.8:0/3065021803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff570060f70 msgr2=0x7ff570063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:04.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff570060f70 0x7ff570063430 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7ff57c009760 tx=0x7ff57c009c60).stop 2023-10-18T22:24:04.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 -- 172.21.15.8:0/3065021803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5880f6530 msgr2=0x7ff58806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:04.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5880f6530 0x7ff58806b9a0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7ff578007a60 tx=0x7ff578009b30).stop 2023-10-18T22:24:04.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 -- 172.21.15.8:0/3065021803 shutdown_connections 2023-10-18T22:24:04.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff570060f70 0x7ff570063430 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5880f6530 0x7ff58806b9a0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 --2- 172.21.15.8:0/3065021803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5880f77d0 0x7ff588069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 -- 172.21.15.8:0/3065021803 >> 172.21.15.8:0/3065021803 conn(0x7ff5880f1c90 msgr2=0x7ff5880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:04.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 -- 172.21.15.8:0/3065021803 shutdown_connections 2023-10-18T22:24:04.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.170+0000 7ff58d5c2700 1 -- 172.21.15.8:0/3065021803 wait complete. 2023-10-18T22:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.307+0000 7f5845215700 1 -- 172.21.15.8:0/2782576064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58400f77d0 msgr2=0x7f58400f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.307+0000 7f5845215700 1 --2- 172.21.15.8:0/2782576064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58400f77d0 0x7f58400f7c30 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7f5834004660 tx=0x7f5834009b30).stop 2023-10-18T22:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.307+0000 7f5845215700 1 -- 172.21.15.8:0/2782576064 shutdown_connections 2023-10-18T22:24:04.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.307+0000 7f5845215700 1 --2- 172.21.15.8:0/2782576064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58400f77d0 0x7f58400f7c30 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.307+0000 7f5845215700 1 --2- 172.21.15.8:0/2782576064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58400f6530 0x7f58400f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.307+0000 7f5845215700 1 -- 172.21.15.8:0/2782576064 >> 172.21.15.8:0/2782576064 conn(0x7f58400f1c90 msgr2=0x7f58400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:04.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.307+0000 7f5845215700 1 -- 172.21.15.8:0/2782576064 shutdown_connections 2023-10-18T22:24:04.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.308+0000 7f5845215700 1 -- 172.21.15.8:0/2782576064 wait complete. 2023-10-18T22:24:04.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.308+0000 7f5845215700 1 Processor -- start 2023-10-18T22:24:04.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.308+0000 7f5845215700 1 -- start start 2023-10-18T22:24:04.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f5845215700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58400f6530 0x7f584006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:04.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f5845215700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58400f77d0 0x7f5840069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:04.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f5845215700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584006a380 con 0x7f58400f6530 2023-10-18T22:24:04.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f5845215700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584006a4c0 con 0x7f58400f77d0 2023-10-18T22:24:04.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f583ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58400f6530 0x7f584006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:04.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f583ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58400f6530 0x7f584006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34068/0 (socket says 172.21.15.8:34068) 2023-10-18T22:24:04.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f583ffff700 1 -- 172.21.15.8:0/3897369667 learned_addr learned my addr 172.21.15.8:0/3897369667 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:04.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f583f7fe700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58400f77d0 0x7f5840069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:04.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f583ffff700 1 -- 172.21.15.8:0/3897369667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58400f77d0 msgr2=0x7f5840069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:04.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f583ffff700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58400f77d0 0x7f5840069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f583ffff700 1 -- 172.21.15.8:0/3897369667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834005040 con 0x7f58400f6530 2023-10-18T22:24:04.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.309+0000 7f583f7fe700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58400f77d0 0x7f5840069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:24:04.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.310+0000 7f583ffff700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58400f6530 0x7f584006b9a0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f5830002700 tx=0x7f5830009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:04.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.310+0000 7f583cff9700 1 -- 172.21.15.8:0/3897369667 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5830009320 con 0x7f58400f6530 2023-10-18T22:24:04.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.310+0000 7f583cff9700 1 -- 172.21.15.8:0/3897369667 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f583000f040 con 0x7f58400f6530 2023-10-18T22:24:04.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.310+0000 7f5845215700 1 -- 172.21.15.8:0/3897369667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584006a7a0 con 0x7f58400f6530 2023-10-18T22:24:04.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.310+0000 7f583cff9700 1 -- 172.21.15.8:0/3897369667 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5830014970 con 0x7f58400f6530 2023-10-18T22:24:04.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.310+0000 7f5845215700 1 -- 172.21.15.8:0/3897369667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584010ed00 con 0x7f58400f6530 2023-10-18T22:24:04.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.311+0000 7f5845215700 1 -- 172.21.15.8:0/3897369667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5840045ad0 con 0x7f58400f6530 2023-10-18T22:24:04.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.312+0000 7f583cff9700 1 -- 172.21.15.8:0/3897369667 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5830009480 con 0x7f58400f6530 2023-10-18T22:24:04.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.313+0000 7f583cff9700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5828060f70 0x7f5828063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:04.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.313+0000 7f583cff9700 1 -- 172.21.15.8:0/3897369667 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f583007cc40 con 0x7f58400f6530 2023-10-18T22:24:04.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.314+0000 7f583f7fe700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5828060f70 0x7f5828063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:04.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.314+0000 7f583f7fe700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5828060f70 0x7f5828063430 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f5834005010 tx=0x7f5834009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:04.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.317+0000 7f583cff9700 1 -- 172.21.15.8:0/3897369667 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f583004c7f0 con 0x7f58400f6530 2023-10-18T22:24:04.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.510+0000 7f5845215700 1 -- 172.21.15.8:0/3897369667 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f58400fee00 con 0x7f5828060f70 2023-10-18T22:24:04.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.519+0000 7f583cff9700 1 -- 172.21.15.8:0/3897369667 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f58400fee00 con 0x7f5828060f70 2023-10-18T22:24:04.522 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:24:04.522 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (90m) 7m ago 92m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:24:04.522 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (84m) 7m ago 92m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:24:04.522 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (84m) 5m ago 91m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:24:04.523 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (90m) 7m ago 91m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:24:04.523 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 88m - - 2023-10-18T22:24:04.523 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 88m - - 2023-10-18T22:24:04.523 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 88m - - 2023-10-18T22:24:04.523 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 88m - - 2023-10-18T22:24:04.524 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (85m) 7m ago 93m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:24:04.524 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (85m) 5m ago 91m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:24:04.524 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (85m) 7m ago 93m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:24:04.524 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (84m) 5m ago 91m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:24:04.524 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (91m) 7m ago 91m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:24:04.525 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (91m) 5m ago 91m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:24:04.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (84m) 7m ago 90m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:24:04.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (82m) 7m ago 90m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:24:04.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (81m) 7m ago 90m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:24:04.525 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (81m) 5m ago 89m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:24:04.526 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (80m) 5m ago 89m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:24:04.526 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (80m) 5m ago 89m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:24:04.526 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (86m) 7m ago 91m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:24:04.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.521+0000 7f5845215700 1 -- 172.21.15.8:0/3897369667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5828060f70 msgr2=0x7f5828063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:04.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.521+0000 7f5845215700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5828060f70 0x7f5828063430 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f5834005010 tx=0x7f5834009b30).stop 2023-10-18T22:24:04.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.521+0000 7f5845215700 1 -- 172.21.15.8:0/3897369667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58400f6530 msgr2=0x7f584006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:04.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.521+0000 7f5845215700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58400f6530 0x7f584006b9a0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f5830002700 tx=0x7f5830009d80).stop 2023-10-18T22:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.521+0000 7f5845215700 1 -- 172.21.15.8:0/3897369667 shutdown_connections 2023-10-18T22:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.521+0000 7f5845215700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5828060f70 0x7f5828063430 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.521+0000 7f5845215700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58400f6530 0x7f584006b9a0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.521+0000 7f5845215700 1 --2- 172.21.15.8:0/3897369667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58400f77d0 0x7f5840069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.521+0000 7f5845215700 1 -- 172.21.15.8:0/3897369667 >> 172.21.15.8:0/3897369667 conn(0x7f58400f1c90 msgr2=0x7f58400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:04.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.522+0000 7f5845215700 1 -- 172.21.15.8:0/3897369667 shutdown_connections 2023-10-18T22:24:04.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.522+0000 7f5845215700 1 -- 172.21.15.8:0/3897369667 wait complete. 2023-10-18T22:24:04.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.659+0000 7fde47fff700 1 -- 172.21.15.8:0/690180194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 msgr2=0x7fde480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:04.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.659+0000 7fde47fff700 1 --2- 172.21.15.8:0/690180194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde480f7c30 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7fde3c004660 tx=0x7fde3c009b30).stop 2023-10-18T22:24:04.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.659+0000 7fde47fff700 1 -- 172.21.15.8:0/690180194 shutdown_connections 2023-10-18T22:24:04.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.659+0000 7fde47fff700 1 --2- 172.21.15.8:0/690180194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde480f7c30 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.659+0000 7fde47fff700 1 --2- 172.21.15.8:0/690180194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 0x7fde480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.659+0000 7fde47fff700 1 -- 172.21.15.8:0/690180194 >> 172.21.15.8:0/690180194 conn(0x7fde480f1c90 msgr2=0x7fde480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:04.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.659+0000 7fde47fff700 1 -- 172.21.15.8:0/690180194 shutdown_connections 2023-10-18T22:24:04.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.659+0000 7fde47fff700 1 -- 172.21.15.8:0/690180194 wait complete. 2023-10-18T22:24:04.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.660+0000 7fde47fff700 1 Processor -- start 2023-10-18T22:24:04.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.660+0000 7fde47fff700 1 -- start start 2023-10-18T22:24:04.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.660+0000 7fde47fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 0x7fde48108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:04.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.660+0000 7fde47fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:04.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.660+0000 7fde47fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde481099c0 con 0x7fde480f77d0 2023-10-18T22:24:04.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.660+0000 7fde47fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde48109b00 con 0x7fde480f6530 2023-10-18T22:24:04.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.660+0000 7fde467fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:04.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.660+0000 7fde467fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34088/0 (socket says 172.21.15.8:34088) 2023-10-18T22:24:04.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.661+0000 7fde467fc700 1 -- 172.21.15.8:0/1273854183 learned_addr learned my addr 172.21.15.8:0/1273854183 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:04.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.661+0000 7fde46ffd700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 0x7fde48108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:04.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.661+0000 7fde467fc700 1 -- 172.21.15.8:0/1273854183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 msgr2=0x7fde48108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:04.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.661+0000 7fde467fc700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 0x7fde48108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.661+0000 7fde467fc700 1 -- 172.21.15.8:0/1273854183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c005040 con 0x7fde480f77d0 2023-10-18T22:24:04.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.661+0000 7fde467fc700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48109410 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7fde3c004320 tx=0x7fde3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:04.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.661+0000 7fde2f7fe700 1 -- 172.21.15.8:0/1273854183 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde3c019070 con 0x7fde480f77d0 2023-10-18T22:24:04.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.661+0000 7fde47fff700 1 -- 172.21.15.8:0/1273854183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4810a440 con 0x7fde480f77d0 2023-10-18T22:24:04.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.661+0000 7fde2f7fe700 1 -- 172.21.15.8:0/1273854183 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fde3c01e420 con 0x7fde480f77d0 2023-10-18T22:24:04.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.661+0000 7fde47fff700 1 -- 172.21.15.8:0/1273854183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4810a920 con 0x7fde480f77d0 2023-10-18T22:24:04.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.662+0000 7fde2f7fe700 1 -- 172.21.15.8:0/1273854183 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde3c014600 con 0x7fde480f77d0 2023-10-18T22:24:04.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.663+0000 7fde47fff700 1 -- 172.21.15.8:0/1273854183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde48045ad0 con 0x7fde480f77d0 2023-10-18T22:24:04.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.663+0000 7fde2f7fe700 1 -- 172.21.15.8:0/1273854183 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fde3c01e590 con 0x7fde480f77d0 2023-10-18T22:24:04.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.664+0000 7fde2f7fe700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 0x7fde30063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:04.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.664+0000 7fde2f7fe700 1 -- 172.21.15.8:0/1273854183 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fde3c07ddc0 con 0x7fde480f77d0 2023-10-18T22:24:04.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.665+0000 7fde46ffd700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 0x7fde30063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:04.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.665+0000 7fde46ffd700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 0x7fde30063430 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fde38009fd0 tx=0x7fde3800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:04.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.669+0000 7fde2f7fe700 1 -- 172.21.15.8:0/1273854183 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fde3c081030 con 0x7fde480f77d0 2023-10-18T22:24:04.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.927+0000 7fde47fff700 1 -- 172.21.15.8:0/1273854183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fde48027a00 con 0x7fde480f77d0 2023-10-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.928+0000 7fde2f7fe700 1 -- 172.21.15.8:0/1273854183 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fde3c051340 con 0x7fde480f77d0 2023-10-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:24:04.931 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:24:04.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:24:04.931 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:24:04.931 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:24:04.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:24:04.932 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:24:04.932 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:24:04.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:24:04.932 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:24:04.933 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:24:04.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:24:04.933 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:24:04.933 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:24:04.933 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:24:04.933 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:24:04.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 -- 172.21.15.8:0/1273854183 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 msgr2=0x7fde30063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 0x7fde30063430 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fde38009fd0 tx=0x7fde3800b040).stop 2023-10-18T22:24:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 -- 172.21.15.8:0/1273854183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 msgr2=0x7fde48109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48109410 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7fde3c004320 tx=0x7fde3c00b040).stop 2023-10-18T22:24:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 -- 172.21.15.8:0/1273854183 shutdown_connections 2023-10-18T22:24:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fde30060f70 0x7fde30063430 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde480f6530 0x7fde48108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 --2- 172.21.15.8:0/1273854183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde480f77d0 0x7fde48109410 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:04.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 -- 172.21.15.8:0/1273854183 >> 172.21.15.8:0/1273854183 conn(0x7fde480f1c90 msgr2=0x7fde4806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:04.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 -- 172.21.15.8:0/1273854183 shutdown_connections 2023-10-18T22:24:04.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:04.930+0000 7fde47fff700 1 -- 172.21.15.8:0/1273854183 wait complete. 2023-10-18T22:24:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.065+0000 7f2972be7700 1 -- 172.21.15.8:0/3876341512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296c0f99e0 msgr2=0x7f296c0f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.065+0000 7f2972be7700 1 --2- 172.21.15.8:0/3876341512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296c0f99e0 0x7f296c0f9e40 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f295c004660 tx=0x7f295c009b30).stop 2023-10-18T22:24:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.065+0000 7f2972be7700 1 -- 172.21.15.8:0/3876341512 shutdown_connections 2023-10-18T22:24:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.065+0000 7f2972be7700 1 --2- 172.21.15.8:0/3876341512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296c0f99e0 0x7f296c0f9e40 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.065+0000 7f2972be7700 1 --2- 172.21.15.8:0/3876341512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f296c0f8740 0x7f296c0f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.065+0000 7f2972be7700 1 -- 172.21.15.8:0/3876341512 >> 172.21.15.8:0/3876341512 conn(0x7f296c0f40e0 msgr2=0x7f296c0f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.066+0000 7f2972be7700 1 -- 172.21.15.8:0/3876341512 shutdown_connections 2023-10-18T22:24:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.066+0000 7f2972be7700 1 -- 172.21.15.8:0/3876341512 wait complete. 2023-10-18T22:24:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.066+0000 7f2972be7700 1 Processor -- start 2023-10-18T22:24:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.067+0000 7f2972be7700 1 -- start start 2023-10-18T22:24:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.067+0000 7f2972be7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f296c0f8740 0x7f296c108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.067+0000 7f2972be7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296c0f99e0 0x7f296c109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.067+0000 7f2972be7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c1099f0 con 0x7f296c0f99e0 2023-10-18T22:24:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.067+0000 7f2972be7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c109b30 con 0x7f296c0f8740 2023-10-18T22:24:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.067+0000 7f29713e4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296c0f99e0 0x7f296c109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.067+0000 7f29713e4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296c0f99e0 0x7f296c109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34098/0 (socket says 172.21.15.8:34098) 2023-10-18T22:24:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.067+0000 7f29713e4700 1 -- 172.21.15.8:0/145813469 learned_addr learned my addr 172.21.15.8:0/145813469 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.067+0000 7f2971be5700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f296c0f8740 0x7f296c108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.068+0000 7f29713e4700 1 -- 172.21.15.8:0/145813469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f296c0f8740 msgr2=0x7f296c108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.068+0000 7f29713e4700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f296c0f8740 0x7f296c108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.068+0000 7f29713e4700 1 -- 172.21.15.8:0/145813469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c005040 con 0x7f296c0f99e0 2023-10-18T22:24:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.068+0000 7f29713e4700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296c0f99e0 0x7f296c109440 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f295c009f50 tx=0x7f295c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.068+0000 7f29627fc700 1 -- 172.21.15.8:0/145813469 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295c018070 con 0x7f296c0f99e0 2023-10-18T22:24:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.068+0000 7f29627fc700 1 -- 172.21.15.8:0/145813469 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f295c009630 con 0x7f296c0f99e0 2023-10-18T22:24:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.068+0000 7f2972be7700 1 -- 172.21.15.8:0/145813469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296c10a470 con 0x7f296c0f99e0 2023-10-18T22:24:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.068+0000 7f29627fc700 1 -- 172.21.15.8:0/145813469 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295c01c3c0 con 0x7f296c0f99e0 2023-10-18T22:24:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.068+0000 7f2972be7700 1 -- 172.21.15.8:0/145813469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296c10a9d0 con 0x7f296c0f99e0 2023-10-18T22:24:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.069+0000 7f2972be7700 1 -- 172.21.15.8:0/145813469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296c045ad0 con 0x7f296c0f99e0 2023-10-18T22:24:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.070+0000 7f29627fc700 1 -- 172.21.15.8:0/145813469 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f295c01d420 con 0x7f296c0f99e0 2023-10-18T22:24:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.071+0000 7f29627fc700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2958060f70 0x7f2958063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.071+0000 7f29627fc700 1 -- 172.21.15.8:0/145813469 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f295c07e600 con 0x7f296c0f99e0 2023-10-18T22:24:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.071+0000 7f2971be5700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2958060f70 0x7f2958063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.072+0000 7f2971be5700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2958060f70 0x7f2958063430 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f296c0f9840 tx=0x7f2968009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.075+0000 7f29627fc700 1 -- 172.21.15.8:0/145813469 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f295c051d40 con 0x7f296c0f99e0 2023-10-18T22:24:05.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.306+0000 7f2972be7700 1 -- 172.21.15.8:0/145813469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f296c027a00 con 0x7f296c0f99e0 2023-10-18T22:24:05.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.306+0000 7f29627fc700 1 -- 172.21.15.8:0/145813469 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f295c051930 con 0x7f296c0f99e0 2023-10-18T22:24:05.309 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:24:05.309 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:24:05.310 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:24:05.310 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:24:05.310 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:24:05.310 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:24:05.311 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:24:05.311 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:24:05.311 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:24:05.311 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:24:05.311 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:24:05.312 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:24:05.312 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:24:05.312 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:24:05.312 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:24:05.312 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:24:05.312 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:24:05.313 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:24:05.313 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:24:05.313 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:24:05.313 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:24:05.313 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:24:05.314 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:24:05.314 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:24:05.314 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:24:05.314 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:24:05.315 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:24:05.315 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:24:05.315 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:24:05.315 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:24:05.317 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:24:05.317 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:24:05.317 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:24:05.317 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:24:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 -- 172.21.15.8:0/145813469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2958060f70 msgr2=0x7f2958063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2958060f70 0x7f2958063430 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f296c0f9840 tx=0x7f2968009c00).stop 2023-10-18T22:24:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 -- 172.21.15.8:0/145813469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296c0f99e0 msgr2=0x7f296c109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296c0f99e0 0x7f296c109440 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f295c009f50 tx=0x7f295c009b30).stop 2023-10-18T22:24:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 -- 172.21.15.8:0/145813469 shutdown_connections 2023-10-18T22:24:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2958060f70 0x7f2958063430 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f296c0f8740 0x7f296c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 --2- 172.21.15.8:0/145813469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296c0f99e0 0x7f296c109440 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 -- 172.21.15.8:0/145813469 >> 172.21.15.8:0/145813469 conn(0x7f296c0f40e0 msgr2=0x7f296c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 -- 172.21.15.8:0/145813469 shutdown_connections 2023-10-18T22:24:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.309+0000 7f2972be7700 1 -- 172.21.15.8:0/145813469 wait complete. 2023-10-18T22:24:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:24:05.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.448+0000 7fe09e329700 1 -- 172.21.15.8:0/3249026456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0980f77d0 msgr2=0x7fe0980f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:05.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.448+0000 7fe09e329700 1 --2- 172.21.15.8:0/3249026456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0980f77d0 0x7fe0980f7c30 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7fe088004660 tx=0x7fe088009b30).stop 2023-10-18T22:24:05.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.448+0000 7fe09e329700 1 -- 172.21.15.8:0/3249026456 shutdown_connections 2023-10-18T22:24:05.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.448+0000 7fe09e329700 1 --2- 172.21.15.8:0/3249026456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0980f77d0 0x7fe0980f7c30 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.448+0000 7fe09e329700 1 --2- 172.21.15.8:0/3249026456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0980f6530 0x7fe0980f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.448+0000 7fe09e329700 1 -- 172.21.15.8:0/3249026456 >> 172.21.15.8:0/3249026456 conn(0x7fe0980f1c90 msgr2=0x7fe0980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:05.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.448+0000 7fe09e329700 1 -- 172.21.15.8:0/3249026456 shutdown_connections 2023-10-18T22:24:05.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.448+0000 7fe09e329700 1 -- 172.21.15.8:0/3249026456 wait complete. 2023-10-18T22:24:05.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.449+0000 7fe09e329700 1 Processor -- start 2023-10-18T22:24:05.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.449+0000 7fe09e329700 1 -- start start 2023-10-18T22:24:05.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.449+0000 7fe09e329700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0980f6530 0x7fe098108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:05.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.449+0000 7fe09e329700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0980f77d0 0x7fe0981093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:05.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.449+0000 7fe09e329700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098109970 con 0x7fe0980f77d0 2023-10-18T22:24:05.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.449+0000 7fe09e329700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098109ab0 con 0x7fe0980f6530 2023-10-18T22:24:05.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.449+0000 7fe09cb26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0980f77d0 0x7fe0981093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:05.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe09cb26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0980f77d0 0x7fe0981093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34118/0 (socket says 172.21.15.8:34118) 2023-10-18T22:24:05.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe09cb26700 1 -- 172.21.15.8:0/179627684 learned_addr learned my addr 172.21.15.8:0/179627684 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:05.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe09d327700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0980f6530 0x7fe098108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:05.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe09cb26700 1 -- 172.21.15.8:0/179627684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0980f6530 msgr2=0x7fe098108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:05.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe09cb26700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0980f6530 0x7fe098108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe09cb26700 1 -- 172.21.15.8:0/179627684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe088005040 con 0x7fe0980f77d0 2023-10-18T22:24:05.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe09cb26700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0980f77d0 0x7fe0981093c0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7fe088004320 tx=0x7fe08800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:05.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe08dffb700 1 -- 172.21.15.8:0/179627684 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe088019070 con 0x7fe0980f77d0 2023-10-18T22:24:05.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe08dffb700 1 -- 172.21.15.8:0/179627684 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe08801e420 con 0x7fe0980f77d0 2023-10-18T22:24:05.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe09e329700 1 -- 172.21.15.8:0/179627684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09810a3f0 con 0x7fe0980f77d0 2023-10-18T22:24:05.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.450+0000 7fe08dffb700 1 -- 172.21.15.8:0/179627684 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe088014680 con 0x7fe0980f77d0 2023-10-18T22:24:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.451+0000 7fe09e329700 1 -- 172.21.15.8:0/179627684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09810a8d0 con 0x7fe0980f77d0 2023-10-18T22:24:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.452+0000 7fe09e329700 1 -- 172.21.15.8:0/179627684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe098045ad0 con 0x7fe0980f77d0 2023-10-18T22:24:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.452+0000 7fe08dffb700 1 -- 172.21.15.8:0/179627684 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe08801e590 con 0x7fe0980f77d0 2023-10-18T22:24:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.453+0000 7fe08dffb700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe084060f70 0x7fe084063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.453+0000 7fe08dffb700 1 -- 172.21.15.8:0/179627684 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe08807ddc0 con 0x7fe0980f77d0 2023-10-18T22:24:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.453+0000 7fe09d327700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe084060f70 0x7fe084063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.454+0000 7fe09d327700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe084060f70 0x7fe084063430 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fe094009fd0 tx=0x7fe09400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.457+0000 7fe08dffb700 1 -- 172.21.15.8:0/179627684 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe088081030 con 0x7fe0980f77d0 2023-10-18T22:24:05.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.655+0000 7fe09e329700 1 -- 172.21.15.8:0/179627684 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe09810aaf0 con 0x7fe084060f70 2023-10-18T22:24:05.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.657+0000 7fe08dffb700 1 -- 172.21.15.8:0/179627684 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe09810aaf0 con 0x7fe084060f70 2023-10-18T22:24:05.659 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:24:05.659 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:24:05.659 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:24:05.660 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:24:05.660 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:24:05.660 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:24:05.660 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:24:05.660 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:24:05.660 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:24:05.661 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:24:05.661 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:24:05.661 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:24:05.661 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:24:05.661 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:24:05.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.658+0000 7fe09e329700 1 -- 172.21.15.8:0/179627684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe084060f70 msgr2=0x7fe084063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:05.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.658+0000 7fe09e329700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe084060f70 0x7fe084063430 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fe094009fd0 tx=0x7fe09400b040).stop 2023-10-18T22:24:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.658+0000 7fe09e329700 1 -- 172.21.15.8:0/179627684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0980f77d0 msgr2=0x7fe0981093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.658+0000 7fe09e329700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0980f77d0 0x7fe0981093c0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7fe088004320 tx=0x7fe08800b040).stop 2023-10-18T22:24:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.659+0000 7fe09e329700 1 -- 172.21.15.8:0/179627684 shutdown_connections 2023-10-18T22:24:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.659+0000 7fe09e329700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe084060f70 0x7fe084063430 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.659+0000 7fe09e329700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0980f6530 0x7fe098108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.659+0000 7fe09e329700 1 --2- 172.21.15.8:0/179627684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0980f77d0 0x7fe0981093c0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.659+0000 7fe09e329700 1 -- 172.21.15.8:0/179627684 >> 172.21.15.8:0/179627684 conn(0x7fe0980f1c90 msgr2=0x7fe09806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.659+0000 7fe09e329700 1 -- 172.21.15.8:0/179627684 shutdown_connections 2023-10-18T22:24:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:05.659+0000 7fe09e329700 1 -- 172.21.15.8:0/179627684 wait complete. 2023-10-18T22:24:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:03.818390+0000 mgr.smithi008.flmjzp (mgr.14640) 5108 : audit [DBG] from='client.38080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:04.169063+0000 mgr.smithi008.flmjzp (mgr.14640) 5109 : audit [DBG] from='client.38084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:04.305483+0000 mgr.smithi008.flmjzp (mgr.14640) 5110 : cluster [DBG] pgmap v3504: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:04.929377+0000 mon.smithi008 (mon.0) 5368 : audit [DBG] from='client.? 172.21.15.8:0/1273854183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:05.308122+0000 mon.smithi008 (mon.0) 5369 : audit [DBG] from='client.? 172.21.15.8:0/145813469' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:24:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:03.818390+0000 mgr.smithi008.flmjzp (mgr.14640) 5108 : audit [DBG] from='client.38080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:04.169063+0000 mgr.smithi008.flmjzp (mgr.14640) 5109 : audit [DBG] from='client.38084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:04.305483+0000 mgr.smithi008.flmjzp (mgr.14640) 5110 : cluster [DBG] pgmap v3504: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:04.929377+0000 mon.smithi008 (mon.0) 5368 : audit [DBG] from='client.? 172.21.15.8:0/1273854183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:05.308122+0000 mon.smithi008 (mon.0) 5369 : audit [DBG] from='client.? 172.21.15.8:0/145813469' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:24:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:04.512318+0000 mgr.smithi008.flmjzp (mgr.14640) 5111 : audit [DBG] from='client.38088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:04.512318+0000 mgr.smithi008.flmjzp (mgr.14640) 5111 : audit [DBG] from='client.38088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:07.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:05.657989+0000 mgr.smithi008.flmjzp (mgr.14640) 5112 : audit [DBG] from='client.38100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:07.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:06.306028+0000 mgr.smithi008.flmjzp (mgr.14640) 5113 : cluster [DBG] pgmap v3505: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:05.657989+0000 mgr.smithi008.flmjzp (mgr.14640) 5112 : audit [DBG] from='client.38100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:06.306028+0000 mgr.smithi008.flmjzp (mgr.14640) 5113 : cluster [DBG] pgmap v3505: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:08.336800+0000 mon.smithi008 (mon.0) 5370 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:08.338873+0000 mon.smithi008 (mon.0) 5371 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:24:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:08.339812+0000 mon.smithi008 (mon.0) 5372 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:24:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:08.346496+0000 mon.smithi008 (mon.0) 5373 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:08.352864+0000 mon.smithi008 (mon.0) 5374 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:08.355908+0000 mon.smithi008 (mon.0) 5375 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:08.357902+0000 mon.smithi008 (mon.0) 5376 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:08.359492+0000 mon.smithi008 (mon.0) 5377 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:08.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:08.361504+0000 mon.smithi008 (mon.0) 5378 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:08.336800+0000 mon.smithi008 (mon.0) 5370 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:08.338873+0000 mon.smithi008 (mon.0) 5371 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:24:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:08.339812+0000 mon.smithi008 (mon.0) 5372 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:24:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:08.346496+0000 mon.smithi008 (mon.0) 5373 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:08.352864+0000 mon.smithi008 (mon.0) 5374 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:08.355908+0000 mon.smithi008 (mon.0) 5375 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:08.357902+0000 mon.smithi008 (mon.0) 5376 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:08.359492+0000 mon.smithi008 (mon.0) 5377 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:08.361504+0000 mon.smithi008 (mon.0) 5378 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:08.306734+0000 mgr.smithi008.flmjzp (mgr.14640) 5114 : cluster [DBG] pgmap v3506: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:24:08.340637+0000 mgr.smithi008.flmjzp (mgr.14640) 5115 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:24:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:08.341185+0000 mgr.smithi008.flmjzp (mgr.14640) 5116 : cluster [DBG] pgmap v3507: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:08.341434+0000 mgr.smithi008.flmjzp (mgr.14640) 5117 : cluster [DBG] pgmap v3508: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:09.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:24:08.363398+0000 mgr.smithi008.flmjzp (mgr.14640) 5118 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:09.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:08.306734+0000 mgr.smithi008.flmjzp (mgr.14640) 5114 : cluster [DBG] pgmap v3506: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:24:08.340637+0000 mgr.smithi008.flmjzp (mgr.14640) 5115 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:24:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:08.341185+0000 mgr.smithi008.flmjzp (mgr.14640) 5116 : cluster [DBG] pgmap v3507: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:08.341434+0000 mgr.smithi008.flmjzp (mgr.14640) 5117 : cluster [DBG] pgmap v3508: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:24:08.363398+0000 mgr.smithi008.flmjzp (mgr.14640) 5118 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:11.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:10.341973+0000 mgr.smithi008.flmjzp (mgr.14640) 5119 : cluster [DBG] pgmap v3509: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:10.341973+0000 mgr.smithi008.flmjzp (mgr.14640) 5119 : cluster [DBG] pgmap v3509: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:13.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:12.342523+0000 mgr.smithi008.flmjzp (mgr.14640) 5120 : cluster [DBG] pgmap v3510: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:13.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:12.342523+0000 mgr.smithi008.flmjzp (mgr.14640) 5120 : cluster [DBG] pgmap v3510: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:14.343297+0000 mgr.smithi008.flmjzp (mgr.14640) 5121 : cluster [DBG] pgmap v3511: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:14.343297+0000 mgr.smithi008.flmjzp (mgr.14640) 5121 : cluster [DBG] pgmap v3511: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:17.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:16.344089+0000 mgr.smithi008.flmjzp (mgr.14640) 5122 : cluster [DBG] pgmap v3512: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:16.344089+0000 mgr.smithi008.flmjzp (mgr.14640) 5122 : cluster [DBG] pgmap v3512: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:18.373169+0000 mon.smithi008 (mon.0) 5379 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:18.373169+0000 mon.smithi008 (mon.0) 5379 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:19.537 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:18.344739+0000 mgr.smithi008.flmjzp (mgr.14640) 5123 : cluster [DBG] pgmap v3513: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:18.344739+0000 mgr.smithi008.flmjzp (mgr.14640) 5123 : cluster [DBG] pgmap v3513: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:20.345177+0000 mgr.smithi008.flmjzp (mgr.14640) 5124 : cluster [DBG] pgmap v3514: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:21.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:21.168778+0000 mon.smithi008 (mon.0) 5380 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:20.345177+0000 mgr.smithi008.flmjzp (mgr.14640) 5124 : cluster [DBG] pgmap v3514: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:21.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:21.168778+0000 mon.smithi008 (mon.0) 5380 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:21.721018+0000 mon.smithi008 (mon.0) 5381 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:24:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:21.721894+0000 mon.smithi008 (mon.0) 5382 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:24:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:21.727397+0000 mon.smithi008 (mon.0) 5383 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:21.733292+0000 mon.smithi008 (mon.0) 5384 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:21.735666+0000 mon.smithi008 (mon.0) 5385 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:21.736922+0000 mon.smithi008 (mon.0) 5386 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:21.738154+0000 mon.smithi008 (mon.0) 5387 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:21.739676+0000 mon.smithi008 (mon.0) 5388 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:21.721018+0000 mon.smithi008 (mon.0) 5381 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:24:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:21.721894+0000 mon.smithi008 (mon.0) 5382 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:24:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:21.727397+0000 mon.smithi008 (mon.0) 5383 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:21.733292+0000 mon.smithi008 (mon.0) 5384 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:21.735666+0000 mon.smithi008 (mon.0) 5385 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:21.736922+0000 mon.smithi008 (mon.0) 5386 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:21.738154+0000 mon.smithi008 (mon.0) 5387 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:21.739676+0000 mon.smithi008 (mon.0) 5388 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:24:21.722606+0000 mgr.smithi008.flmjzp (mgr.14640) 5125 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:24:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:21.723123+0000 mgr.smithi008.flmjzp (mgr.14640) 5126 : cluster [DBG] pgmap v3515: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:21.723357+0000 mgr.smithi008.flmjzp (mgr.14640) 5127 : cluster [DBG] pgmap v3516: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:24:21.741252+0000 mgr.smithi008.flmjzp (mgr.14640) 5128 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:24:21.722606+0000 mgr.smithi008.flmjzp (mgr.14640) 5125 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:24:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:21.723123+0000 mgr.smithi008.flmjzp (mgr.14640) 5126 : cluster [DBG] pgmap v3515: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:21.723357+0000 mgr.smithi008.flmjzp (mgr.14640) 5127 : cluster [DBG] pgmap v3516: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:24:21.741252+0000 mgr.smithi008.flmjzp (mgr.14640) 5128 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:23.723876+0000 mgr.smithi008.flmjzp (mgr.14640) 5129 : cluster [DBG] pgmap v3517: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:23.723876+0000 mgr.smithi008.flmjzp (mgr.14640) 5129 : cluster [DBG] pgmap v3517: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:25.724471+0000 mgr.smithi008.flmjzp (mgr.14640) 5130 : cluster [DBG] pgmap v3518: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:25.724471+0000 mgr.smithi008.flmjzp (mgr.14640) 5130 : cluster [DBG] pgmap v3518: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:27.724982+0000 mgr.smithi008.flmjzp (mgr.14640) 5131 : cluster [DBG] pgmap v3519: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:27.724982+0000 mgr.smithi008.flmjzp (mgr.14640) 5131 : cluster [DBG] pgmap v3519: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:29.725641+0000 mgr.smithi008.flmjzp (mgr.14640) 5132 : cluster [DBG] pgmap v3520: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:29.725641+0000 mgr.smithi008.flmjzp (mgr.14640) 5132 : cluster [DBG] pgmap v3520: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:31.745222+0000 mon.smithi008 (mon.0) 5389 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:31.747514+0000 mon.smithi008 (mon.0) 5390 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:24:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:31.748548+0000 mon.smithi008 (mon.0) 5391 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:24:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:31.755241+0000 mon.smithi008 (mon.0) 5392 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:31.761682+0000 mon.smithi008 (mon.0) 5393 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:31.764847+0000 mon.smithi008 (mon.0) 5394 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:31.766586+0000 mon.smithi008 (mon.0) 5395 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:31.768322+0000 mon.smithi008 (mon.0) 5396 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:31.770309+0000 mon.smithi008 (mon.0) 5397 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:31.745222+0000 mon.smithi008 (mon.0) 5389 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:31.747514+0000 mon.smithi008 (mon.0) 5390 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:24:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:31.748548+0000 mon.smithi008 (mon.0) 5391 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:24:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:31.755241+0000 mon.smithi008 (mon.0) 5392 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:31.761682+0000 mon.smithi008 (mon.0) 5393 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:31.764847+0000 mon.smithi008 (mon.0) 5394 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:31.766586+0000 mon.smithi008 (mon.0) 5395 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:31.768322+0000 mon.smithi008 (mon.0) 5396 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:31.770309+0000 mon.smithi008 (mon.0) 5397 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:31.726208+0000 mgr.smithi008.flmjzp (mgr.14640) 5133 : cluster [DBG] pgmap v3521: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:24:31.749414+0000 mgr.smithi008.flmjzp (mgr.14640) 5134 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:24:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:31.749982+0000 mgr.smithi008.flmjzp (mgr.14640) 5135 : cluster [DBG] pgmap v3522: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:31.750318+0000 mgr.smithi008.flmjzp (mgr.14640) 5136 : cluster [DBG] pgmap v3523: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:24:31.772235+0000 mgr.smithi008.flmjzp (mgr.14640) 5137 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:33.855 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:31.726208+0000 mgr.smithi008.flmjzp (mgr.14640) 5133 : cluster [DBG] pgmap v3521: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:33.855 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:24:31.749414+0000 mgr.smithi008.flmjzp (mgr.14640) 5134 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:24:33.855 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:31.749982+0000 mgr.smithi008.flmjzp (mgr.14640) 5135 : cluster [DBG] pgmap v3522: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:33.855 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:31.750318+0000 mgr.smithi008.flmjzp (mgr.14640) 5136 : cluster [DBG] pgmap v3523: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:33.856 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:24:31.772235+0000 mgr.smithi008.flmjzp (mgr.14640) 5137 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:33.751034+0000 mgr.smithi008.flmjzp (mgr.14640) 5138 : cluster [DBG] pgmap v3524: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:33.751034+0000 mgr.smithi008.flmjzp (mgr.14640) 5138 : cluster [DBG] pgmap v3524: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:35.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.812+0000 7f89148f9700 1 -- 172.21.15.8:0/1290148935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89100f77d0 msgr2=0x7f89100f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:35.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.812+0000 7f89148f9700 1 --2- 172.21.15.8:0/1290148935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89100f77d0 0x7f89100f7c30 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f8904004660 tx=0x7f8904009b30).stop 2023-10-18T22:24:35.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.812+0000 7f89148f9700 1 -- 172.21.15.8:0/1290148935 shutdown_connections 2023-10-18T22:24:35.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.812+0000 7f89148f9700 1 --2- 172.21.15.8:0/1290148935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89100f77d0 0x7f89100f7c30 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:35.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.812+0000 7f89148f9700 1 --2- 172.21.15.8:0/1290148935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89100f6530 0x7f89100f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:35.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.812+0000 7f89148f9700 1 -- 172.21.15.8:0/1290148935 >> 172.21.15.8:0/1290148935 conn(0x7f89100f1c70 msgr2=0x7f89100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:35.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.812+0000 7f89148f9700 1 -- 172.21.15.8:0/1290148935 shutdown_connections 2023-10-18T22:24:35.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.813+0000 7f89148f9700 1 -- 172.21.15.8:0/1290148935 wait complete. 2023-10-18T22:24:35.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.813+0000 7f89148f9700 1 Processor -- start 2023-10-18T22:24:35.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.814+0000 7f89148f9700 1 -- start start 2023-10-18T22:24:35.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.814+0000 7f89148f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89100f6530 0x7f891006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:35.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.814+0000 7f89148f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89100f77d0 0x7f8910069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:35.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.814+0000 7f89148f9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891006a380 con 0x7f89100f6530 2023-10-18T22:24:35.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.814+0000 7f89148f9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891006a4c0 con 0x7f89100f77d0 2023-10-18T22:24:35.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.814+0000 7f890f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89100f6530 0x7f891006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:35.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.814+0000 7f890f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89100f6530 0x7f891006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44696/0 (socket says 172.21.15.8:44696) 2023-10-18T22:24:35.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.814+0000 7f890f7fe700 1 -- 172.21.15.8:0/4197576045 learned_addr learned my addr 172.21.15.8:0/4197576045 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:35.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.814+0000 7f890effd700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89100f77d0 0x7f8910069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:35.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.815+0000 7f890f7fe700 1 -- 172.21.15.8:0/4197576045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89100f77d0 msgr2=0x7f8910069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:35.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.815+0000 7f890f7fe700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89100f77d0 0x7f8910069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:35.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.815+0000 7f890f7fe700 1 -- 172.21.15.8:0/4197576045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8904005040 con 0x7f89100f6530 2023-10-18T22:24:35.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.815+0000 7f890f7fe700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89100f6530 0x7f891006b9a0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7f8900002700 tx=0x7f8900009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:35.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.815+0000 7f88f7fff700 1 -- 172.21.15.8:0/4197576045 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89000079c0 con 0x7f89100f6530 2023-10-18T22:24:35.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.815+0000 7f88f7fff700 1 -- 172.21.15.8:0/4197576045 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f890000f040 con 0x7f89100f6530 2023-10-18T22:24:35.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.815+0000 7f88f7fff700 1 -- 172.21.15.8:0/4197576045 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89000148d0 con 0x7f89100f6530 2023-10-18T22:24:35.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.815+0000 7f89148f9700 1 -- 172.21.15.8:0/4197576045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891006a7a0 con 0x7f89100f6530 2023-10-18T22:24:35.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.815+0000 7f89148f9700 1 -- 172.21.15.8:0/4197576045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891010ed90 con 0x7f89100f6530 2023-10-18T22:24:35.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.816+0000 7f89148f9700 1 -- 172.21.15.8:0/4197576045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8910045ad0 con 0x7f89100f6530 2023-10-18T22:24:35.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.817+0000 7f88f7fff700 1 -- 172.21.15.8:0/4197576045 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f890001b060 con 0x7f89100f6530 2023-10-18T22:24:35.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.818+0000 7f88f7fff700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88f8060f70 0x7f88f8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:35.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.818+0000 7f88f7fff700 1 -- 172.21.15.8:0/4197576045 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f890007c770 con 0x7f89100f6530 2023-10-18T22:24:35.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.818+0000 7f890effd700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88f8060f70 0x7f88f8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:35.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.819+0000 7f890effd700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88f8060f70 0x7f88f8063430 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f8904004630 tx=0x7f8904009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:35.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:35.823+0000 7f88f7fff700 1 -- 172.21.15.8:0/4197576045 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f890004c3a0 con 0x7f89100f6530 2023-10-18T22:24:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.024+0000 7f89148f9700 1 -- 172.21.15.8:0/4197576045 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89100fee30 con 0x7f88f8060f70 2023-10-18T22:24:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.025+0000 7f88f7fff700 1 -- 172.21.15.8:0/4197576045 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f89100fee30 con 0x7f88f8060f70 2023-10-18T22:24:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 -- 172.21.15.8:0/4197576045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88f8060f70 msgr2=0x7f88f8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88f8060f70 0x7f88f8063430 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f8904004630 tx=0x7f8904009b30).stop 2023-10-18T22:24:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 -- 172.21.15.8:0/4197576045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89100f6530 msgr2=0x7f891006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89100f6530 0x7f891006b9a0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7f8900002700 tx=0x7f8900009d80).stop 2023-10-18T22:24:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 -- 172.21.15.8:0/4197576045 shutdown_connections 2023-10-18T22:24:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f88f8060f70 0x7f88f8063430 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89100f6530 0x7f891006b9a0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 --2- 172.21.15.8:0/4197576045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89100f77d0 0x7f8910069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 -- 172.21.15.8:0/4197576045 >> 172.21.15.8:0/4197576045 conn(0x7f89100f1c70 msgr2=0x7f89100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:36.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 -- 172.21.15.8:0/4197576045 shutdown_connections 2023-10-18T22:24:36.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.027+0000 7f89148f9700 1 -- 172.21.15.8:0/4197576045 wait complete. 2023-10-18T22:24:36.044 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:24:36.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.165+0000 7f0210843700 1 -- 172.21.15.8:0/497049266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c0f6530 msgr2=0x7f020c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.165+0000 7f0210843700 1 --2- 172.21.15.8:0/497049266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c0f6530 0x7f020c0f6950 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f01fc004660 tx=0x7f01fc009b30).stop 2023-10-18T22:24:36.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.165+0000 7f0210843700 1 -- 172.21.15.8:0/497049266 shutdown_connections 2023-10-18T22:24:36.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.165+0000 7f0210843700 1 --2- 172.21.15.8:0/497049266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c0f77d0 0x7f020c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.165+0000 7f0210843700 1 --2- 172.21.15.8:0/497049266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c0f6530 0x7f020c0f6950 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.165+0000 7f0210843700 1 -- 172.21.15.8:0/497049266 >> 172.21.15.8:0/497049266 conn(0x7f020c0f1c90 msgr2=0x7f020c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:36.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.165+0000 7f0210843700 1 -- 172.21.15.8:0/497049266 shutdown_connections 2023-10-18T22:24:36.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.165+0000 7f0210843700 1 -- 172.21.15.8:0/497049266 wait complete. 2023-10-18T22:24:36.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.166+0000 7f0210843700 1 Processor -- start 2023-10-18T22:24:36.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.166+0000 7f0210843700 1 -- start start 2023-10-18T22:24:36.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.166+0000 7f0210843700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c0f6530 0x7f020c108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:36.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.166+0000 7f0210843700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c0f77d0 0x7f020c109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:36.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.166+0000 7f0210843700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c1099f0 con 0x7f020c0f77d0 2023-10-18T22:24:36.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.166+0000 7f0210843700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c109b30 con 0x7f020c0f6530 2023-10-18T22:24:36.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.167+0000 7f020affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c0f77d0 0x7f020c109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:36.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.167+0000 7f020affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c0f77d0 0x7f020c109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44708/0 (socket says 172.21.15.8:44708) 2023-10-18T22:24:36.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.167+0000 7f020affd700 1 -- 172.21.15.8:0/3207261506 learned_addr learned my addr 172.21.15.8:0/3207261506 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:36.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.167+0000 7f020b7fe700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c0f6530 0x7f020c108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:36.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.167+0000 7f020affd700 1 -- 172.21.15.8:0/3207261506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c0f6530 msgr2=0x7f020c108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.167+0000 7f020affd700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c0f6530 0x7f020c108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.167+0000 7f020affd700 1 -- 172.21.15.8:0/3207261506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc005040 con 0x7f020c0f77d0 2023-10-18T22:24:36.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.167+0000 7f020b7fe700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c0f6530 0x7f020c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:24:36.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.167+0000 7f020affd700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c0f77d0 0x7f020c109440 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7f0200002700 tx=0x7f0200009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:36.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.167+0000 7f01f3fff700 1 -- 172.21.15.8:0/3207261506 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0200009320 con 0x7f020c0f77d0 2023-10-18T22:24:36.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.168+0000 7f01f3fff700 1 -- 172.21.15.8:0/3207261506 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f020000f040 con 0x7f020c0f77d0 2023-10-18T22:24:36.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.168+0000 7f0210843700 1 -- 172.21.15.8:0/3207261506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c10a4d0 con 0x7f020c0f77d0 2023-10-18T22:24:36.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.168+0000 7f01f3fff700 1 -- 172.21.15.8:0/3207261506 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02000148a0 con 0x7f020c0f77d0 2023-10-18T22:24:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.168+0000 7f0210843700 1 -- 172.21.15.8:0/3207261506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c10aa90 con 0x7f020c0f77d0 2023-10-18T22:24:36.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.169+0000 7f0210843700 1 -- 172.21.15.8:0/3207261506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c045ad0 con 0x7f020c0f77d0 2023-10-18T22:24:36.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.170+0000 7f01f3fff700 1 -- 172.21.15.8:0/3207261506 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0200009480 con 0x7f020c0f77d0 2023-10-18T22:24:36.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.170+0000 7f01f3fff700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f01f4060f70 0x7f01f4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:36.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.171+0000 7f01f3fff700 1 -- 172.21.15.8:0/3207261506 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f020007cd80 con 0x7f020c0f77d0 2023-10-18T22:24:36.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.171+0000 7f020b7fe700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f01f4060f70 0x7f01f4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:36.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.171+0000 7f020b7fe700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f01f4060f70 0x7f01f4063430 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f01fc005010 tx=0x7f01fc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:36.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.175+0000 7f01f3fff700 1 -- 172.21.15.8:0/3207261506 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f02000503d0 con 0x7f020c0f77d0 2023-10-18T22:24:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.373+0000 7f0210843700 1 -- 172.21.15.8:0/3207261506 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f020c10ad10 con 0x7f01f4060f70 2023-10-18T22:24:36.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.374+0000 7f01f3fff700 1 -- 172.21.15.8:0/3207261506 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f020c10ad10 con 0x7f01f4060f70 2023-10-18T22:24:36.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 -- 172.21.15.8:0/3207261506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f01f4060f70 msgr2=0x7f01f4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f01f4060f70 0x7f01f4063430 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f01fc005010 tx=0x7f01fc009b30).stop 2023-10-18T22:24:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 -- 172.21.15.8:0/3207261506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c0f77d0 msgr2=0x7f020c109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c0f77d0 0x7f020c109440 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7f0200002700 tx=0x7f0200009e00).stop 2023-10-18T22:24:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 -- 172.21.15.8:0/3207261506 shutdown_connections 2023-10-18T22:24:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f01f4060f70 0x7f01f4063430 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c0f6530 0x7f020c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 --2- 172.21.15.8:0/3207261506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f020c0f77d0 0x7f020c109440 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 -- 172.21.15.8:0/3207261506 >> 172.21.15.8:0/3207261506 conn(0x7f020c0f1c90 msgr2=0x7f020c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 -- 172.21.15.8:0/3207261506 shutdown_connections 2023-10-18T22:24:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.376+0000 7f0210843700 1 -- 172.21.15.8:0/3207261506 wait complete. 2023-10-18T22:24:36.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.513+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3768593393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d00f77d0 msgr2=0x7fa8d00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.513+0000 7fa8d57b4700 1 --2- 172.21.15.8:0/3768593393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d00f77d0 0x7fa8d00f7c30 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7fa8c4004660 tx=0x7fa8c4009b30).stop 2023-10-18T22:24:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.514+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3768593393 shutdown_connections 2023-10-18T22:24:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.514+0000 7fa8d57b4700 1 --2- 172.21.15.8:0/3768593393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d00f77d0 0x7fa8d00f7c30 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.514+0000 7fa8d57b4700 1 --2- 172.21.15.8:0/3768593393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d00f6530 0x7fa8d00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.514+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3768593393 >> 172.21.15.8:0/3768593393 conn(0x7fa8d00f1c90 msgr2=0x7fa8d00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:36.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.514+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3768593393 shutdown_connections 2023-10-18T22:24:36.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.514+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3768593393 wait complete. 2023-10-18T22:24:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.514+0000 7fa8d57b4700 1 Processor -- start 2023-10-18T22:24:36.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.515+0000 7fa8d57b4700 1 -- start start 2023-10-18T22:24:36.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.515+0000 7fa8d57b4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d00f6530 0x7fa8d006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:36.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.515+0000 7fa8d57b4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d00f77d0 0x7fa8d0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:36.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.515+0000 7fa8d57b4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d006a380 con 0x7fa8d00f77d0 2023-10-18T22:24:36.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.515+0000 7fa8d57b4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d006a4c0 con 0x7fa8d00f6530 2023-10-18T22:24:36.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.515+0000 7fa8cf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d00f77d0 0x7fa8d0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:36.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.515+0000 7fa8cf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d00f77d0 0x7fa8d0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44732/0 (socket says 172.21.15.8:44732) 2023-10-18T22:24:36.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.515+0000 7fa8cf7fe700 1 -- 172.21.15.8:0/3973174015 learned_addr learned my addr 172.21.15.8:0/3973174015 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:36.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8cffff700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d00f6530 0x7fa8d006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:36.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8cf7fe700 1 -- 172.21.15.8:0/3973174015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d00f6530 msgr2=0x7fa8d006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8cf7fe700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d00f6530 0x7fa8d006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8cf7fe700 1 -- 172.21.15.8:0/3973174015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4005040 con 0x7fa8d00f77d0 2023-10-18T22:24:36.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8cffff700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d00f6530 0x7fa8d006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:24:36.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8cf7fe700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d00f77d0 0x7fa8d0069e20 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7fa8c4009990 tx=0x7fa8c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:36.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8ccff9700 1 -- 172.21.15.8:0/3973174015 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8c4018070 con 0x7fa8d00f77d0 2023-10-18T22:24:36.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8ccff9700 1 -- 172.21.15.8:0/3973174015 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa8c4009630 con 0x7fa8d00f77d0 2023-10-18T22:24:36.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8ccff9700 1 -- 172.21.15.8:0/3973174015 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8c401c400 con 0x7fa8d00f77d0 2023-10-18T22:24:36.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3973174015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d006a740 con 0x7fa8d00f77d0 2023-10-18T22:24:36.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.516+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3973174015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d006aca0 con 0x7fa8d00f77d0 2023-10-18T22:24:36.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.517+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3973174015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d0045ad0 con 0x7fa8d00f77d0 2023-10-18T22:24:36.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.518+0000 7fa8ccff9700 1 -- 172.21.15.8:0/3973174015 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa8c401d9e0 con 0x7fa8d00f77d0 2023-10-18T22:24:36.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.519+0000 7fa8ccff9700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8b8060f70 0x7fa8b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:36.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.519+0000 7fa8ccff9700 1 -- 172.21.15.8:0/3973174015 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa8c407e630 con 0x7fa8d00f77d0 2023-10-18T22:24:36.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.519+0000 7fa8cffff700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8b8060f70 0x7fa8b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:36.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.520+0000 7fa8cffff700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8b8060f70 0x7fa8b8063430 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7fa8c0009fd0 tx=0x7fa8c000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:36.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.523+0000 7fa8ccff9700 1 -- 172.21.15.8:0/3973174015 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa8c404e2a0 con 0x7fa8d00f77d0 2023-10-18T22:24:36.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.716+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3973174015 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8d00fee40 con 0x7fa8b8060f70 2023-10-18T22:24:36.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.726+0000 7fa8ccff9700 1 -- 172.21.15.8:0/3973174015 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa8d00fee40 con 0x7fa8b8060f70 2023-10-18T22:24:36.728 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:24:36.729 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (91m) 8m ago 92m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:24:36.729 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (85m) 8m ago 92m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:24:36.729 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (85m) 6m ago 91m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:24:36.729 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (91m) 8m ago 92m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:24:36.729 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 88m - - 2023-10-18T22:24:36.730 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 88m - - 2023-10-18T22:24:36.730 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 88m - - 2023-10-18T22:24:36.730 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 88m - - 2023-10-18T22:24:36.730 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (86m) 8m ago 94m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:24:36.730 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (85m) 6m ago 91m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:24:36.731 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (85m) 8m ago 94m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:24:36.731 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (85m) 6m ago 91m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:24:36.731 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (92m) 8m ago 92m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:24:36.731 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (91m) 6m ago 91m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:24:36.731 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (84m) 8m ago 91m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:24:36.731 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (82m) 8m ago 90m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:24:36.732 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (82m) 8m ago 90m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:24:36.732 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (81m) 6m ago 90m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:24:36.732 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (81m) 6m ago 90m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:24:36.732 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (80m) 6m ago 89m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:24:36.732 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (86m) 8m ago 92m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:24:36.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3973174015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8b8060f70 msgr2=0x7fa8b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8b8060f70 0x7fa8b8063430 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7fa8c0009fd0 tx=0x7fa8c000b040).stop 2023-10-18T22:24:36.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3973174015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d00f77d0 msgr2=0x7fa8d0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d00f77d0 0x7fa8d0069e20 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7fa8c4009990 tx=0x7fa8c4009b30).stop 2023-10-18T22:24:36.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3973174015 shutdown_connections 2023-10-18T22:24:36.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa8b8060f70 0x7fa8b8063430 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d00f6530 0x7fa8d006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 --2- 172.21.15.8:0/3973174015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d00f77d0 0x7fa8d0069e20 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3973174015 >> 172.21.15.8:0/3973174015 conn(0x7fa8d00f1c90 msgr2=0x7fa8d00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:36.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3973174015 shutdown_connections 2023-10-18T22:24:36.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.728+0000 7fa8d57b4700 1 -- 172.21.15.8:0/3973174015 wait complete. 2023-10-18T22:24:36.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.865+0000 7f71d9546700 1 -- 172.21.15.8:0/1040171140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71d40f6530 msgr2=0x7f71d40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.865+0000 7f71d9546700 1 --2- 172.21.15.8:0/1040171140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71d40f6530 0x7f71d40f6950 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f71c4004660 tx=0x7f71c4009b30).stop 2023-10-18T22:24:36.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.865+0000 7f71d9546700 1 -- 172.21.15.8:0/1040171140 shutdown_connections 2023-10-18T22:24:36.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.865+0000 7f71d9546700 1 --2- 172.21.15.8:0/1040171140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d40f77d0 0x7f71d40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.865+0000 7f71d9546700 1 --2- 172.21.15.8:0/1040171140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71d40f6530 0x7f71d40f6950 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.865+0000 7f71d9546700 1 -- 172.21.15.8:0/1040171140 >> 172.21.15.8:0/1040171140 conn(0x7f71d40f1c90 msgr2=0x7f71d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:36.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.865+0000 7f71d9546700 1 -- 172.21.15.8:0/1040171140 shutdown_connections 2023-10-18T22:24:36.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.865+0000 7f71d9546700 1 -- 172.21.15.8:0/1040171140 wait complete. 2023-10-18T22:24:36.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.866+0000 7f71d9546700 1 Processor -- start 2023-10-18T22:24:36.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.866+0000 7f71d9546700 1 -- start start 2023-10-18T22:24:36.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d9546700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d40f6530 0x7f71d4108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:36.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d9546700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71d40f77d0 0x7f71d4109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:36.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d9546700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d41099e0 con 0x7f71d40f77d0 2023-10-18T22:24:36.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d9546700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d4109b20 con 0x7f71d40f6530 2023-10-18T22:24:36.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71d40f77d0 0x7f71d4109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:36.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71d40f77d0 0x7f71d4109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44752/0 (socket says 172.21.15.8:44752) 2023-10-18T22:24:36.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d37fe700 1 -- 172.21.15.8:0/2651982083 learned_addr learned my addr 172.21.15.8:0/2651982083 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:36.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d3fff700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d40f6530 0x7f71d4108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:36.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d37fe700 1 -- 172.21.15.8:0/2651982083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d40f6530 msgr2=0x7f71d4108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:36.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d37fe700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d40f6530 0x7f71d4108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:36.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d37fe700 1 -- 172.21.15.8:0/2651982083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4005040 con 0x7f71d40f77d0 2023-10-18T22:24:36.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d3fff700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d40f6530 0x7f71d4108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:24:36.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.867+0000 7f71d37fe700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71d40f77d0 0x7f71d4109430 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7f71c800e7f0 tx=0x7f71c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:36.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.868+0000 7f71d0ff9700 1 -- 172.21.15.8:0/2651982083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c80092e0 con 0x7f71d40f77d0 2023-10-18T22:24:36.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.868+0000 7f71d0ff9700 1 -- 172.21.15.8:0/2651982083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f71c800f040 con 0x7f71d40f77d0 2023-10-18T22:24:36.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.868+0000 7f71d9546700 1 -- 172.21.15.8:0/2651982083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d410a4c0 con 0x7f71d40f77d0 2023-10-18T22:24:36.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.868+0000 7f71d0ff9700 1 -- 172.21.15.8:0/2651982083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c80147e0 con 0x7f71d40f77d0 2023-10-18T22:24:36.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.868+0000 7f71d9546700 1 -- 172.21.15.8:0/2651982083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d410aa00 con 0x7f71d40f77d0 2023-10-18T22:24:36.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.869+0000 7f71d9546700 1 -- 172.21.15.8:0/2651982083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d4045ad0 con 0x7f71d40f77d0 2023-10-18T22:24:36.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.870+0000 7f71d0ff9700 1 -- 172.21.15.8:0/2651982083 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f71c801b030 con 0x7f71d40f77d0 2023-10-18T22:24:36.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.871+0000 7f71d0ff9700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71bc060f70 0x7f71bc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:36.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.871+0000 7f71d0ff9700 1 -- 172.21.15.8:0/2651982083 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f71c807c7c0 con 0x7f71d40f77d0 2023-10-18T22:24:36.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.871+0000 7f71d3fff700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71bc060f70 0x7f71bc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:36.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.871+0000 7f71d3fff700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71bc060f70 0x7f71bc063430 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f71c4009720 tx=0x7f71c400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:36.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:36.875+0000 7f71d0ff9700 1 -- 172.21.15.8:0/2651982083 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f71c804fdf0 con 0x7f71d40f77d0 2023-10-18T22:24:37.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.134+0000 7f71d9546700 1 -- 172.21.15.8:0/2651982083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f71d40fedc0 con 0x7f71d40f77d0 2023-10-18T22:24:37.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.135+0000 7f71d0ff9700 1 -- 172.21.15.8:0/2651982083 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f71c8019020 con 0x7f71d40f77d0 2023-10-18T22:24:37.138 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:24:37.138 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:24:37.138 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:24:37.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:24:37.138 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:24:37.139 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:24:37.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:24:37.139 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:24:37.139 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:24:37.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:24:37.140 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:24:37.140 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:24:37.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:24:37.140 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:24:37.140 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:24:37.141 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:24:37.141 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:24:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 -- 172.21.15.8:0/2651982083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71bc060f70 msgr2=0x7f71bc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71bc060f70 0x7f71bc063430 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f71c4009720 tx=0x7f71c400b040).stop 2023-10-18T22:24:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 -- 172.21.15.8:0/2651982083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71d40f77d0 msgr2=0x7f71d4109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71d40f77d0 0x7f71d4109430 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7f71c800e7f0 tx=0x7f71c800b040).stop 2023-10-18T22:24:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 -- 172.21.15.8:0/2651982083 shutdown_connections 2023-10-18T22:24:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f71bc060f70 0x7f71bc063430 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d40f6530 0x7f71d4108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 --2- 172.21.15.8:0/2651982083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71d40f77d0 0x7f71d4109430 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 -- 172.21.15.8:0/2651982083 >> 172.21.15.8:0/2651982083 conn(0x7f71d40f1c90 msgr2=0x7f71d406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 -- 172.21.15.8:0/2651982083 shutdown_connections 2023-10-18T22:24:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.137+0000 7f71d9546700 1 -- 172.21.15.8:0/2651982083 wait complete. 2023-10-18T22:24:37.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.273+0000 7f4c1f360700 1 -- 172.21.15.8:0/2859372811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c180f99e0 msgr2=0x7f4c180f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:37.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.273+0000 7f4c1f360700 1 --2- 172.21.15.8:0/2859372811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c180f99e0 0x7f4c180f9e40 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f4c08004660 tx=0x7f4c08009b30).stop 2023-10-18T22:24:37.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.274+0000 7f4c1f360700 1 -- 172.21.15.8:0/2859372811 shutdown_connections 2023-10-18T22:24:37.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.274+0000 7f4c1f360700 1 --2- 172.21.15.8:0/2859372811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c180f99e0 0x7f4c180f9e40 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.274+0000 7f4c1f360700 1 --2- 172.21.15.8:0/2859372811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180f8740 0x7f4c180f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.274+0000 7f4c1f360700 1 -- 172.21.15.8:0/2859372811 >> 172.21.15.8:0/2859372811 conn(0x7f4c180f40e0 msgr2=0x7f4c180f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:37.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.274+0000 7f4c1f360700 1 -- 172.21.15.8:0/2859372811 shutdown_connections 2023-10-18T22:24:37.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.274+0000 7f4c1f360700 1 -- 172.21.15.8:0/2859372811 wait complete. 2023-10-18T22:24:37.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.275+0000 7f4c1f360700 1 Processor -- start 2023-10-18T22:24:37.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.275+0000 7f4c1f360700 1 -- start start 2023-10-18T22:24:37.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.275+0000 7f4c1f360700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c180f8740 0x7f4c18108e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:37.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.276+0000 7f4c1f360700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180f99e0 0x7f4c18109380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:37.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.276+0000 7f4c1f360700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18109930 con 0x7f4c180f8740 2023-10-18T22:24:37.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.276+0000 7f4c1f360700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18109a70 con 0x7f4c180f99e0 2023-10-18T22:24:37.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.276+0000 7f4c1e35e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c180f8740 0x7f4c18108e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:37.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.276+0000 7f4c1e35e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c180f8740 0x7f4c18108e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48466/0 (socket says 172.21.15.8:48466) 2023-10-18T22:24:37.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.276+0000 7f4c1e35e700 1 -- 172.21.15.8:0/3859657364 learned_addr learned my addr 172.21.15.8:0/3859657364 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:37.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.276+0000 7f4c1db5d700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180f99e0 0x7f4c18109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:37.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.276+0000 7f4c1e35e700 1 -- 172.21.15.8:0/3859657364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180f99e0 msgr2=0x7f4c18109380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:37.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.276+0000 7f4c1e35e700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180f99e0 0x7f4c18109380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.276+0000 7f4c1e35e700 1 -- 172.21.15.8:0/3859657364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08005040 con 0x7f4c180f8740 2023-10-18T22:24:37.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.277+0000 7f4c1e35e700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c180f8740 0x7f4c18108e90 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7f4c1400e7c0 tx=0x7f4c1400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:37.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.277+0000 7f4c0effd700 1 -- 172.21.15.8:0/3859657364 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c140092e0 con 0x7f4c180f8740 2023-10-18T22:24:37.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.277+0000 7f4c0effd700 1 -- 172.21.15.8:0/3859657364 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4c1400f040 con 0x7f4c180f8740 2023-10-18T22:24:37.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.277+0000 7f4c1f360700 1 -- 172.21.15.8:0/3859657364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1810a410 con 0x7f4c180f8740 2023-10-18T22:24:37.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.277+0000 7f4c0effd700 1 -- 172.21.15.8:0/3859657364 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c14014810 con 0x7f4c180f8740 2023-10-18T22:24:37.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.277+0000 7f4c1f360700 1 -- 172.21.15.8:0/3859657364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1810a950 con 0x7f4c180f8740 2023-10-18T22:24:37.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.278+0000 7f4c1f360700 1 -- 172.21.15.8:0/3859657364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c18045ad0 con 0x7f4c180f8740 2023-10-18T22:24:37.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.279+0000 7f4c0effd700 1 -- 172.21.15.8:0/3859657364 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4c1401b030 con 0x7f4c180f8740 2023-10-18T22:24:37.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.280+0000 7f4c0effd700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c04060f70 0x7f4c04063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:37.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.280+0000 7f4c0effd700 1 -- 172.21.15.8:0/3859657364 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4c1407c880 con 0x7f4c180f8740 2023-10-18T22:24:37.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.280+0000 7f4c1db5d700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c04060f70 0x7f4c04063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:37.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.280+0000 7f4c1db5d700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c04060f70 0x7f4c04063430 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f4c08005010 tx=0x7f4c08016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:37.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.284+0000 7f4c0effd700 1 -- 172.21.15.8:0/3859657364 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4c1404fe60 con 0x7f4c180f8740 2023-10-18T22:24:37.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.513+0000 7f4c1f360700 1 -- 172.21.15.8:0/3859657364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4c1810ac20 con 0x7f4c180f8740 2023-10-18T22:24:37.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.514+0000 7f4c0effd700 1 -- 172.21.15.8:0/3859657364 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f4c14019030 con 0x7f4c180f8740 2023-10-18T22:24:37.517 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:24:37.517 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:24:37.517 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:24:37.517 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:24:37.518 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:24:37.518 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:24:37.518 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:24:37.518 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:24:37.518 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:24:37.519 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:24:37.519 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:24:37.519 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:24:37.519 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:24:37.519 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:24:37.519 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:24:37.520 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:24:37.520 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:24:37.520 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:24:37.520 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:24:37.520 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:24:37.521 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:24:37.521 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:24:37.521 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:24:37.521 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:24:37.521 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:24:37.522 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:24:37.522 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:24:37.522 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:24:37.522 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:24:37.522 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:24:37.523 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:24:37.523 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:24:37.523 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:24:37.523 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:24:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 -- 172.21.15.8:0/3859657364 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c04060f70 msgr2=0x7f4c04063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c04060f70 0x7f4c04063430 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f4c08005010 tx=0x7f4c08016040).stop 2023-10-18T22:24:37.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 -- 172.21.15.8:0/3859657364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c180f8740 msgr2=0x7f4c18108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:37.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c180f8740 0x7f4c18108e90 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7f4c1400e7c0 tx=0x7f4c1400b040).stop 2023-10-18T22:24:37.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 -- 172.21.15.8:0/3859657364 shutdown_connections 2023-10-18T22:24:37.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4c04060f70 0x7f4c04063430 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c180f8740 0x7f4c18108e90 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 --2- 172.21.15.8:0/3859657364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180f99e0 0x7f4c18109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 -- 172.21.15.8:0/3859657364 >> 172.21.15.8:0/3859657364 conn(0x7f4c180f40e0 msgr2=0x7f4c180fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:37.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 -- 172.21.15.8:0/3859657364 shutdown_connections 2023-10-18T22:24:37.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.516+0000 7f4c1f360700 1 -- 172.21.15.8:0/3859657364 wait complete. 2023-10-18T22:24:37.526 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:24:37.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.653+0000 7faeda147700 1 -- 172.21.15.8:0/1060878847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed40f77d0 msgr2=0x7faed40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:37.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.653+0000 7faeda147700 1 --2- 172.21.15.8:0/1060878847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed40f77d0 0x7faed40f7c30 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7faec4004660 tx=0x7faec4009b30).stop 2023-10-18T22:24:37.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.653+0000 7faeda147700 1 -- 172.21.15.8:0/1060878847 shutdown_connections 2023-10-18T22:24:37.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.653+0000 7faeda147700 1 --2- 172.21.15.8:0/1060878847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed40f77d0 0x7faed40f7c30 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.653+0000 7faeda147700 1 --2- 172.21.15.8:0/1060878847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed40f6530 0x7faed40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.653+0000 7faeda147700 1 -- 172.21.15.8:0/1060878847 >> 172.21.15.8:0/1060878847 conn(0x7faed40f1c90 msgr2=0x7faed40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.653+0000 7faeda147700 1 -- 172.21.15.8:0/1060878847 shutdown_connections 2023-10-18T22:24:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.653+0000 7faeda147700 1 -- 172.21.15.8:0/1060878847 wait complete. 2023-10-18T22:24:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.655+0000 7faeda147700 1 Processor -- start 2023-10-18T22:24:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.655+0000 7faeda147700 1 -- start start 2023-10-18T22:24:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.655+0000 7faeda147700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed40f6530 0x7faed4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.655+0000 7faeda147700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed40f77d0 0x7faed4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.655+0000 7faeda147700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed4107880 con 0x7faed40f77d0 2023-10-18T22:24:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.655+0000 7faeda147700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed41080c0 con 0x7faed40f6530 2023-10-18T22:24:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.656+0000 7faed8944700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed40f77d0 0x7faed4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.656+0000 7faed8944700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed40f77d0 0x7faed4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48492/0 (socket says 172.21.15.8:48492) 2023-10-18T22:24:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.656+0000 7faed8944700 1 -- 172.21.15.8:0/3571803313 learned_addr learned my addr 172.21.15.8:0/3571803313 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:24:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.656+0000 7faed9145700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed40f6530 0x7faed4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.656+0000 7faed8944700 1 -- 172.21.15.8:0/3571803313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed40f6530 msgr2=0x7faed4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.656+0000 7faed8944700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed40f6530 0x7faed4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.656+0000 7faed8944700 1 -- 172.21.15.8:0/3571803313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4005040 con 0x7faed40f77d0 2023-10-18T22:24:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.656+0000 7faed8944700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed40f77d0 0x7faed4107280 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7faec4009f50 tx=0x7faec4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:37.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.657+0000 7faec9ffb700 1 -- 172.21.15.8:0/3571803313 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec4018070 con 0x7faed40f77d0 2023-10-18T22:24:37.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.657+0000 7faec9ffb700 1 -- 172.21.15.8:0/3571803313 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faec4009630 con 0x7faed40f77d0 2023-10-18T22:24:37.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.657+0000 7faec9ffb700 1 -- 172.21.15.8:0/3571803313 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec401c3c0 con 0x7faed40f77d0 2023-10-18T22:24:37.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.657+0000 7faeda147700 1 -- 172.21.15.8:0/3571803313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed4108340 con 0x7faed40f77d0 2023-10-18T22:24:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.657+0000 7faeda147700 1 -- 172.21.15.8:0/3571803313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed4108820 con 0x7faed40f77d0 2023-10-18T22:24:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.658+0000 7faeda147700 1 -- 172.21.15.8:0/3571803313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed4059100 con 0x7faed40f77d0 2023-10-18T22:24:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.659+0000 7faec9ffb700 1 -- 172.21.15.8:0/3571803313 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faec401d420 con 0x7faed40f77d0 2023-10-18T22:24:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.660+0000 7faec9ffb700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec0060f70 0x7faec0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:24:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.661+0000 7faec9ffb700 1 -- 172.21.15.8:0/3571803313 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faec407e5f0 con 0x7faed40f77d0 2023-10-18T22:24:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.661+0000 7faed9145700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec0060f70 0x7faec0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:24:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.661+0000 7faed9145700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec0060f70 0x7faec0063430 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7faed4107b50 tx=0x7faed000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:24:37.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.665+0000 7faec9ffb700 1 -- 172.21.15.8:0/3571803313 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faec404e1a0 con 0x7faed40f77d0 2023-10-18T22:24:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:35.751527+0000 mgr.smithi008.flmjzp (mgr.14640) 5139 : cluster [DBG] pgmap v3525: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:36.026327+0000 mgr.smithi008.flmjzp (mgr.14640) 5140 : audit [DBG] from='client.38104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:36.375260+0000 mgr.smithi008.flmjzp (mgr.14640) 5141 : audit [DBG] from='client.38108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:37.136286+0000 mon.smithi008 (mon.0) 5398 : audit [DBG] from='client.? 172.21.15.8:0/2651982083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.864+0000 7faeda147700 1 -- 172.21.15.8:0/3571803313 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faed40fedb0 con 0x7faec0060f70 2023-10-18T22:24:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.866+0000 7faec9ffb700 1 -- 172.21.15.8:0/3571803313 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faed40fedb0 con 0x7faec0060f70 2023-10-18T22:24:37.868 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:24:37.868 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:24:37.868 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:24:37.869 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:24:37.869 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:24:37.869 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:24:37.869 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:24:37.869 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:24:37.869 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:24:37.870 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:24:37.870 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:24:37.870 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:24:37.870 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:24:37.870 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:24:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 -- 172.21.15.8:0/3571803313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec0060f70 msgr2=0x7faec0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec0060f70 0x7faec0063430 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7faed4107b50 tx=0x7faed000b040).stop 2023-10-18T22:24:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 -- 172.21.15.8:0/3571803313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed40f77d0 msgr2=0x7faed4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:24:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed40f77d0 0x7faed4107280 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7faec4009f50 tx=0x7faec4009b30).stop 2023-10-18T22:24:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 -- 172.21.15.8:0/3571803313 shutdown_connections 2023-10-18T22:24:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faec0060f70 0x7faec0063430 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed40f6530 0x7faed4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 --2- 172.21.15.8:0/3571803313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed40f77d0 0x7faed4107280 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:24:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 -- 172.21.15.8:0/3571803313 >> 172.21.15.8:0/3571803313 conn(0x7faed40f1c90 msgr2=0x7faed40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:24:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 -- 172.21.15.8:0/3571803313 shutdown_connections 2023-10-18T22:24:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:24:37.868+0000 7faeda147700 1 -- 172.21.15.8:0/3571803313 wait complete. 2023-10-18T22:24:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:35.751527+0000 mgr.smithi008.flmjzp (mgr.14640) 5139 : cluster [DBG] pgmap v3525: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:36.026327+0000 mgr.smithi008.flmjzp (mgr.14640) 5140 : audit [DBG] from='client.38104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:36.375260+0000 mgr.smithi008.flmjzp (mgr.14640) 5141 : audit [DBG] from='client.38108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:37.136286+0000 mon.smithi008 (mon.0) 5398 : audit [DBG] from='client.? 172.21.15.8:0/2651982083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:36.718992+0000 mgr.smithi008.flmjzp (mgr.14640) 5142 : audit [DBG] from='client.38112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:37.515603+0000 mon.smithi008 (mon.0) 5399 : audit [DBG] from='client.? 172.21.15.8:0/3859657364' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:24:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:36.718992+0000 mgr.smithi008.flmjzp (mgr.14640) 5142 : audit [DBG] from='client.38112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:37.515603+0000 mon.smithi008 (mon.0) 5399 : audit [DBG] from='client.? 172.21.15.8:0/3859657364' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:24:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:37.751990+0000 mgr.smithi008.flmjzp (mgr.14640) 5143 : cluster [DBG] pgmap v3526: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:37.866960+0000 mgr.smithi008.flmjzp (mgr.14640) 5144 : audit [DBG] from='client.38124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:37.751990+0000 mgr.smithi008.flmjzp (mgr.14640) 5143 : cluster [DBG] pgmap v3526: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:37.866960+0000 mgr.smithi008.flmjzp (mgr.14640) 5144 : audit [DBG] from='client.38124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:24:41.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:39.752516+0000 mgr.smithi008.flmjzp (mgr.14640) 5145 : cluster [DBG] pgmap v3527: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:39.752516+0000 mgr.smithi008.flmjzp (mgr.14640) 5145 : cluster [DBG] pgmap v3527: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:41.772957+0000 mon.smithi008 (mon.0) 5400 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:42.328487+0000 mon.smithi008 (mon.0) 5401 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:24:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:42.329588+0000 mon.smithi008 (mon.0) 5402 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:24:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:42.336393+0000 mon.smithi008 (mon.0) 5403 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:42.342718+0000 mon.smithi008 (mon.0) 5404 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:42.345726+0000 mon.smithi008 (mon.0) 5405 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:42.347355+0000 mon.smithi008 (mon.0) 5406 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:42.348941+0000 mon.smithi008 (mon.0) 5407 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:42.350938+0000 mon.smithi008 (mon.0) 5408 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:41.772957+0000 mon.smithi008 (mon.0) 5400 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:42.328487+0000 mon.smithi008 (mon.0) 5401 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:24:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:42.329588+0000 mon.smithi008 (mon.0) 5402 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:24:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:42.336393+0000 mon.smithi008 (mon.0) 5403 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:42.342718+0000 mon.smithi008 (mon.0) 5404 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:42.345726+0000 mon.smithi008 (mon.0) 5405 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:42.347355+0000 mon.smithi008 (mon.0) 5406 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:42.348941+0000 mon.smithi008 (mon.0) 5407 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:42.350938+0000 mon.smithi008 (mon.0) 5408 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:41.753009+0000 mgr.smithi008.flmjzp (mgr.14640) 5146 : cluster [DBG] pgmap v3528: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:24:42.330509+0000 mgr.smithi008.flmjzp (mgr.14640) 5147 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:24:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:42.331183+0000 mgr.smithi008.flmjzp (mgr.14640) 5148 : cluster [DBG] pgmap v3529: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:42.331418+0000 mgr.smithi008.flmjzp (mgr.14640) 5149 : cluster [DBG] pgmap v3530: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:24:42.352846+0000 mgr.smithi008.flmjzp (mgr.14640) 5150 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:43.855 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:41.753009+0000 mgr.smithi008.flmjzp (mgr.14640) 5146 : cluster [DBG] pgmap v3528: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:43.855 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:24:42.330509+0000 mgr.smithi008.flmjzp (mgr.14640) 5147 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:24:43.856 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:42.331183+0000 mgr.smithi008.flmjzp (mgr.14640) 5148 : cluster [DBG] pgmap v3529: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:43.856 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:42.331418+0000 mgr.smithi008.flmjzp (mgr.14640) 5149 : cluster [DBG] pgmap v3530: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:43.856 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:24:42.352846+0000 mgr.smithi008.flmjzp (mgr.14640) 5150 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:44.332125+0000 mgr.smithi008.flmjzp (mgr.14640) 5151 : cluster [DBG] pgmap v3531: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:44.332125+0000 mgr.smithi008.flmjzp (mgr.14640) 5151 : cluster [DBG] pgmap v3531: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:46.332817+0000 mgr.smithi008.flmjzp (mgr.14640) 5152 : cluster [DBG] pgmap v3532: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:46.332817+0000 mgr.smithi008.flmjzp (mgr.14640) 5152 : cluster [DBG] pgmap v3532: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:48.333289+0000 mgr.smithi008.flmjzp (mgr.14640) 5153 : cluster [DBG] pgmap v3533: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:48.333289+0000 mgr.smithi008.flmjzp (mgr.14640) 5153 : cluster [DBG] pgmap v3533: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:50.333879+0000 mgr.smithi008.flmjzp (mgr.14640) 5154 : cluster [DBG] pgmap v3534: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:50.333879+0000 mgr.smithi008.flmjzp (mgr.14640) 5154 : cluster [DBG] pgmap v3534: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:52.363732+0000 mon.smithi008 (mon.0) 5409 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:52.365941+0000 mon.smithi008 (mon.0) 5410 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:24:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:52.367944+0000 mon.smithi008 (mon.0) 5411 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:24:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:52.374480+0000 mon.smithi008 (mon.0) 5412 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:52.381074+0000 mon.smithi008 (mon.0) 5413 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:52.384131+0000 mon.smithi008 (mon.0) 5414 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:52.385823+0000 mon.smithi008 (mon.0) 5415 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:52.387392+0000 mon.smithi008 (mon.0) 5416 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:24:52.389417+0000 mon.smithi008 (mon.0) 5417 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:52.363732+0000 mon.smithi008 (mon.0) 5409 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:52.365941+0000 mon.smithi008 (mon.0) 5410 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:24:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:52.367944+0000 mon.smithi008 (mon.0) 5411 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:24:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:52.374480+0000 mon.smithi008 (mon.0) 5412 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:24:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:52.381074+0000 mon.smithi008 (mon.0) 5413 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:24:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:52.384131+0000 mon.smithi008 (mon.0) 5414 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:52.385823+0000 mon.smithi008 (mon.0) 5415 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:52.387392+0000 mon.smithi008 (mon.0) 5416 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:24:52.389417+0000 mon.smithi008 (mon.0) 5417 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:24:53.856 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:52.334419+0000 mgr.smithi008.flmjzp (mgr.14640) 5155 : cluster [DBG] pgmap v3535: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:53.856 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:24:52.368841+0000 mgr.smithi008.flmjzp (mgr.14640) 5156 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:24:53.856 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:52.369370+0000 mgr.smithi008.flmjzp (mgr.14640) 5157 : cluster [DBG] pgmap v3536: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:53.857 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:52.369642+0000 mgr.smithi008.flmjzp (mgr.14640) 5158 : cluster [DBG] pgmap v3537: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:53.857 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:24:52.391337+0000 mgr.smithi008.flmjzp (mgr.14640) 5159 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:53.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:52.334419+0000 mgr.smithi008.flmjzp (mgr.14640) 5155 : cluster [DBG] pgmap v3535: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:24:52.368841+0000 mgr.smithi008.flmjzp (mgr.14640) 5156 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:24:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:52.369370+0000 mgr.smithi008.flmjzp (mgr.14640) 5157 : cluster [DBG] pgmap v3536: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:52.369642+0000 mgr.smithi008.flmjzp (mgr.14640) 5158 : cluster [DBG] pgmap v3537: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:24:52.391337+0000 mgr.smithi008.flmjzp (mgr.14640) 5159 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:24:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:54.370230+0000 mgr.smithi008.flmjzp (mgr.14640) 5160 : cluster [DBG] pgmap v3538: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:54.370230+0000 mgr.smithi008.flmjzp (mgr.14640) 5160 : cluster [DBG] pgmap v3538: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:56.370806+0000 mgr.smithi008.flmjzp (mgr.14640) 5161 : cluster [DBG] pgmap v3539: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:56.370806+0000 mgr.smithi008.flmjzp (mgr.14640) 5161 : cluster [DBG] pgmap v3539: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:59.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:24:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:24:58.371393+0000 mgr.smithi008.flmjzp (mgr.14640) 5162 : cluster [DBG] pgmap v3540: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:24:59.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:24:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:24:58.371393+0000 mgr.smithi008.flmjzp (mgr.14640) 5162 : cluster [DBG] pgmap v3540: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:01.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:00.372194+0000 mgr.smithi008.flmjzp (mgr.14640) 5163 : cluster [DBG] pgmap v3541: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:01.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:00.372194+0000 mgr.smithi008.flmjzp (mgr.14640) 5163 : cluster [DBG] pgmap v3541: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:03.630 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:02.372748+0000 mgr.smithi008.flmjzp (mgr.14640) 5164 : cluster [DBG] pgmap v3542: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:03.630 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:02.402120+0000 mon.smithi008 (mon.0) 5418 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:02.372748+0000 mgr.smithi008.flmjzp (mgr.14640) 5164 : cluster [DBG] pgmap v3542: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:03.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:02.402120+0000 mon.smithi008 (mon.0) 5418 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:04.373261+0000 mgr.smithi008.flmjzp (mgr.14640) 5165 : cluster [DBG] pgmap v3543: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:05.315037+0000 mon.smithi008 (mon.0) 5419 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:05.316066+0000 mon.smithi008 (mon.0) 5420 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:05.317135+0000 mon.smithi008 (mon.0) 5421 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:05.323519+0000 mon.smithi008 (mon.0) 5422 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:05.329842+0000 mon.smithi008 (mon.0) 5423 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:05.332972+0000 mon.smithi008 (mon.0) 5424 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:05.334636+0000 mon.smithi008 (mon.0) 5425 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:05.336229+0000 mon.smithi008 (mon.0) 5426 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:05.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:05.338245+0000 mon.smithi008 (mon.0) 5427 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:04.373261+0000 mgr.smithi008.flmjzp (mgr.14640) 5165 : cluster [DBG] pgmap v3543: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:05.315037+0000 mon.smithi008 (mon.0) 5419 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:05.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:05.316066+0000 mon.smithi008 (mon.0) 5420 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:05.317135+0000 mon.smithi008 (mon.0) 5421 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:05.323519+0000 mon.smithi008 (mon.0) 5422 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:05.329842+0000 mon.smithi008 (mon.0) 5423 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:05.332972+0000 mon.smithi008 (mon.0) 5424 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:05.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:05.334636+0000 mon.smithi008 (mon.0) 5425 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:05.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:05.336229+0000 mon.smithi008 (mon.0) 5426 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:05.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:05.338245+0000 mon.smithi008 (mon.0) 5427 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:05.318047+0000 mgr.smithi008.flmjzp (mgr.14640) 5166 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:05.318749+0000 mgr.smithi008.flmjzp (mgr.14640) 5167 : cluster [DBG] pgmap v3544: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:05.319035+0000 mgr.smithi008.flmjzp (mgr.14640) 5168 : cluster [DBG] pgmap v3545: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:06.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:05.340169+0000 mgr.smithi008.flmjzp (mgr.14640) 5169 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:06.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:05.318047+0000 mgr.smithi008.flmjzp (mgr.14640) 5166 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:05.318749+0000 mgr.smithi008.flmjzp (mgr.14640) 5167 : cluster [DBG] pgmap v3544: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:05.319035+0000 mgr.smithi008.flmjzp (mgr.14640) 5168 : cluster [DBG] pgmap v3545: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:05.340169+0000 mgr.smithi008.flmjzp (mgr.14640) 5169 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:08.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.023+0000 7ff0f54bf700 1 -- 172.21.15.8:0/1124696806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0f0060310 msgr2=0x7ff0f00f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.023+0000 7ff0f54bf700 1 --2- 172.21.15.8:0/1124696806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0f0060310 0x7ff0f00f9110 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7ff0e0004660 tx=0x7ff0e0009b30).stop 2023-10-18T22:25:08.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.023+0000 7ff0f54bf700 1 -- 172.21.15.8:0/1124696806 shutdown_connections 2023-10-18T22:25:08.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.023+0000 7ff0f54bf700 1 --2- 172.21.15.8:0/1124696806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0f00f9690 0x7ff0f00fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.023+0000 7ff0f54bf700 1 --2- 172.21.15.8:0/1124696806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0f0060310 0x7ff0f00f9110 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.023+0000 7ff0f54bf700 1 -- 172.21.15.8:0/1124696806 >> 172.21.15.8:0/1124696806 conn(0x7ff0f00f0b90 msgr2=0x7ff0f00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:08.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.024+0000 7ff0f54bf700 1 -- 172.21.15.8:0/1124696806 shutdown_connections 2023-10-18T22:25:08.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.024+0000 7ff0f54bf700 1 -- 172.21.15.8:0/1124696806 wait complete. 2023-10-18T22:25:08.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.024+0000 7ff0f54bf700 1 Processor -- start 2023-10-18T22:25:08.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.025+0000 7ff0f54bf700 1 -- start start 2023-10-18T22:25:08.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.025+0000 7ff0f54bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0f0060310 0x7ff0f0108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:08.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.025+0000 7ff0f54bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0f00f9690 0x7ff0f01093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:08.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.025+0000 7ff0f54bf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0109980 con 0x7ff0f0060310 2023-10-18T22:25:08.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.025+0000 7ff0f54bf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0109ac0 con 0x7ff0f00f9690 2023-10-18T22:25:08.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.025+0000 7ff0effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0f0060310 0x7ff0f0108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:08.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.025+0000 7ff0effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0f0060310 0x7ff0f0108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40124/0 (socket says 172.21.15.8:40124) 2023-10-18T22:25:08.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.025+0000 7ff0effff700 1 -- 172.21.15.8:0/2281286921 learned_addr learned my addr 172.21.15.8:0/2281286921 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:08.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.025+0000 7ff0ef7fe700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0f00f9690 0x7ff0f01093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:08.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.026+0000 7ff0effff700 1 -- 172.21.15.8:0/2281286921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0f00f9690 msgr2=0x7ff0f01093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.026+0000 7ff0effff700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0f00f9690 0x7ff0f01093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.026+0000 7ff0effff700 1 -- 172.21.15.8:0/2281286921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0005040 con 0x7ff0f0060310 2023-10-18T22:25:08.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.026+0000 7ff0effff700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0f0060310 0x7ff0f0108ee0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7ff0e0004d80 tx=0x7ff0e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:08.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.026+0000 7ff0ecff9700 1 -- 172.21.15.8:0/2281286921 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0e0019070 con 0x7ff0f0060310 2023-10-18T22:25:08.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.026+0000 7ff0ecff9700 1 -- 172.21.15.8:0/2281286921 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff0e001e420 con 0x7ff0f0060310 2023-10-18T22:25:08.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.026+0000 7ff0f54bf700 1 -- 172.21.15.8:0/2281286921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f010a400 con 0x7ff0f0060310 2023-10-18T22:25:08.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.026+0000 7ff0ecff9700 1 -- 172.21.15.8:0/2281286921 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0e0014660 con 0x7ff0f0060310 2023-10-18T22:25:08.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.026+0000 7ff0f54bf700 1 -- 172.21.15.8:0/2281286921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f010a8e0 con 0x7ff0f0060310 2023-10-18T22:25:08.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.027+0000 7ff0f54bf700 1 -- 172.21.15.8:0/2281286921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f0045ad0 con 0x7ff0f0060310 2023-10-18T22:25:08.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.028+0000 7ff0ecff9700 1 -- 172.21.15.8:0/2281286921 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff0e001e590 con 0x7ff0f0060310 2023-10-18T22:25:08.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.029+0000 7ff0ecff9700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0d8060f70 0x7ff0d8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:08.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.029+0000 7ff0ecff9700 1 -- 172.21.15.8:0/2281286921 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff0e007de00 con 0x7ff0f0060310 2023-10-18T22:25:08.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.029+0000 7ff0ef7fe700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0d8060f70 0x7ff0d8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:08.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.030+0000 7ff0ef7fe700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0d8060f70 0x7ff0d8063430 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7ff0e4009fd0 tx=0x7ff0e400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:08.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.034+0000 7ff0ecff9700 1 -- 172.21.15.8:0/2281286921 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff0e00513e0 con 0x7ff0f0060310 2023-10-18T22:25:08.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.231+0000 7ff0f54bf700 1 -- 172.21.15.8:0/2281286921 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0f00f5630 con 0x7ff0d8060f70 2023-10-18T22:25:08.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.232+0000 7ff0ecff9700 1 -- 172.21.15.8:0/2281286921 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff0f00f5630 con 0x7ff0d8060f70 2023-10-18T22:25:08.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.234+0000 7ff0f54bf700 1 -- 172.21.15.8:0/2281286921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0d8060f70 msgr2=0x7ff0d8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.234+0000 7ff0f54bf700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0d8060f70 0x7ff0d8063430 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7ff0e4009fd0 tx=0x7ff0e400b040).stop 2023-10-18T22:25:08.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.234+0000 7ff0f54bf700 1 -- 172.21.15.8:0/2281286921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0f0060310 msgr2=0x7ff0f0108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.235+0000 7ff0f54bf700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0f0060310 0x7ff0f0108ee0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7ff0e0004d80 tx=0x7ff0e000b040).stop 2023-10-18T22:25:08.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.235+0000 7ff0f54bf700 1 -- 172.21.15.8:0/2281286921 shutdown_connections 2023-10-18T22:25:08.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.235+0000 7ff0f54bf700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff0d8060f70 0x7ff0d8063430 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.235+0000 7ff0f54bf700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0f0060310 0x7ff0f0108ee0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.235+0000 7ff0f54bf700 1 --2- 172.21.15.8:0/2281286921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0f00f9690 0x7ff0f01093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.235+0000 7ff0f54bf700 1 -- 172.21.15.8:0/2281286921 >> 172.21.15.8:0/2281286921 conn(0x7ff0f00f0b90 msgr2=0x7ff0f00f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:08.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.235+0000 7ff0f54bf700 1 -- 172.21.15.8:0/2281286921 shutdown_connections 2023-10-18T22:25:08.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.235+0000 7ff0f54bf700 1 -- 172.21.15.8:0/2281286921 wait complete. 2023-10-18T22:25:08.251 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:25:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.373+0000 7fbb99767700 1 -- 172.21.15.8:0/126439252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb940f77d0 msgr2=0x7fbb940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.373+0000 7fbb99767700 1 --2- 172.21.15.8:0/126439252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb940f77d0 0x7fbb940f7c30 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7fbb88004660 tx=0x7fbb88009b30).stop 2023-10-18T22:25:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.373+0000 7fbb99767700 1 -- 172.21.15.8:0/126439252 shutdown_connections 2023-10-18T22:25:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.373+0000 7fbb99767700 1 --2- 172.21.15.8:0/126439252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb940f77d0 0x7fbb940f7c30 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.373+0000 7fbb99767700 1 --2- 172.21.15.8:0/126439252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb940f6530 0x7fbb940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.373+0000 7fbb99767700 1 -- 172.21.15.8:0/126439252 >> 172.21.15.8:0/126439252 conn(0x7fbb940f1c90 msgr2=0x7fbb940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.373+0000 7fbb99767700 1 -- 172.21.15.8:0/126439252 shutdown_connections 2023-10-18T22:25:08.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.373+0000 7fbb99767700 1 -- 172.21.15.8:0/126439252 wait complete. 2023-10-18T22:25:08.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.374+0000 7fbb99767700 1 Processor -- start 2023-10-18T22:25:08.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.374+0000 7fbb99767700 1 -- start start 2023-10-18T22:25:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.374+0000 7fbb99767700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb940f6530 0x7fbb94106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.374+0000 7fbb99767700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb940f77d0 0x7fbb94107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.374+0000 7fbb99767700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94107880 con 0x7fbb940f77d0 2023-10-18T22:25:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.374+0000 7fbb99767700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941080c0 con 0x7fbb940f6530 2023-10-18T22:25:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb940f77d0 0x7fbb94107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb940f77d0 0x7fbb94107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40138/0 (socket says 172.21.15.8:40138) 2023-10-18T22:25:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb937fe700 1 -- 172.21.15.8:0/4128944930 learned_addr learned my addr 172.21.15.8:0/4128944930 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb93fff700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb940f6530 0x7fbb94106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb937fe700 1 -- 172.21.15.8:0/4128944930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb940f6530 msgr2=0x7fbb94106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb937fe700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb940f6530 0x7fbb94106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb937fe700 1 -- 172.21.15.8:0/4128944930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb88005040 con 0x7fbb940f77d0 2023-10-18T22:25:08.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb937fe700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb940f77d0 0x7fbb94107280 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7fbb88009f50 tx=0x7fbb88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:08.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb90ff9700 1 -- 172.21.15.8:0/4128944930 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb88018070 con 0x7fbb940f77d0 2023-10-18T22:25:08.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb90ff9700 1 -- 172.21.15.8:0/4128944930 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbb88009630 con 0x7fbb940f77d0 2023-10-18T22:25:08.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb90ff9700 1 -- 172.21.15.8:0/4128944930 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb8801c3c0 con 0x7fbb940f77d0 2023-10-18T22:25:08.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.375+0000 7fbb99767700 1 -- 172.21.15.8:0/4128944930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb94108340 con 0x7fbb940f77d0 2023-10-18T22:25:08.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.376+0000 7fbb99767700 1 -- 172.21.15.8:0/4128944930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb94108820 con 0x7fbb940f77d0 2023-10-18T22:25:08.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.377+0000 7fbb99767700 1 -- 172.21.15.8:0/4128944930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb94059100 con 0x7fbb940f77d0 2023-10-18T22:25:08.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.377+0000 7fbb90ff9700 1 -- 172.21.15.8:0/4128944930 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbb8801d420 con 0x7fbb940f77d0 2023-10-18T22:25:08.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.379+0000 7fbb90ff9700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb7c060f70 0x7fbb7c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:08.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.379+0000 7fbb90ff9700 1 -- 172.21.15.8:0/4128944930 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbb8807e4c0 con 0x7fbb940f77d0 2023-10-18T22:25:08.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.379+0000 7fbb93fff700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb7c060f70 0x7fbb7c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:08.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.379+0000 7fbb93fff700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb7c060f70 0x7fbb7c063430 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fbb94107b50 tx=0x7fbb8400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:08.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.383+0000 7fbb90ff9700 1 -- 172.21.15.8:0/4128944930 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbb8804e1b0 con 0x7fbb940f77d0 2023-10-18T22:25:08.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.585+0000 7fbb99767700 1 -- 172.21.15.8:0/4128944930 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb940fee50 con 0x7fbb7c060f70 2023-10-18T22:25:08.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.586+0000 7fbb90ff9700 1 -- 172.21.15.8:0/4128944930 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbb940fee50 con 0x7fbb7c060f70 2023-10-18T22:25:08.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 -- 172.21.15.8:0/4128944930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb7c060f70 msgr2=0x7fbb7c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb7c060f70 0x7fbb7c063430 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fbb94107b50 tx=0x7fbb8400b040).stop 2023-10-18T22:25:08.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 -- 172.21.15.8:0/4128944930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb940f77d0 msgr2=0x7fbb94107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb940f77d0 0x7fbb94107280 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7fbb88009f50 tx=0x7fbb88009b30).stop 2023-10-18T22:25:08.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 -- 172.21.15.8:0/4128944930 shutdown_connections 2023-10-18T22:25:08.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbb7c060f70 0x7fbb7c063430 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb940f6530 0x7fbb94106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 --2- 172.21.15.8:0/4128944930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb940f77d0 0x7fbb94107280 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 -- 172.21.15.8:0/4128944930 >> 172.21.15.8:0/4128944930 conn(0x7fbb940f1c90 msgr2=0x7fbb940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:08.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 -- 172.21.15.8:0/4128944930 shutdown_connections 2023-10-18T22:25:08.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.588+0000 7fbb99767700 1 -- 172.21.15.8:0/4128944930 wait complete. 2023-10-18T22:25:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:07.319595+0000 mgr.smithi008.flmjzp (mgr.14640) 5170 : cluster [DBG] pgmap v3546: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.725+0000 7ff6c3fff700 1 -- 172.21.15.8:0/1146250807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c40f6530 msgr2=0x7ff6c40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.725+0000 7ff6c3fff700 1 --2- 172.21.15.8:0/1146250807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c40f6530 0x7ff6c40f6950 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7ff6b4004660 tx=0x7ff6b4009b30).stop 2023-10-18T22:25:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.725+0000 7ff6c3fff700 1 -- 172.21.15.8:0/1146250807 shutdown_connections 2023-10-18T22:25:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.725+0000 7ff6c3fff700 1 --2- 172.21.15.8:0/1146250807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c40f77d0 0x7ff6c40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.725+0000 7ff6c3fff700 1 --2- 172.21.15.8:0/1146250807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c40f6530 0x7ff6c40f6950 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.725+0000 7ff6c3fff700 1 -- 172.21.15.8:0/1146250807 >> 172.21.15.8:0/1146250807 conn(0x7ff6c40f1c90 msgr2=0x7ff6c40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.725+0000 7ff6c3fff700 1 -- 172.21.15.8:0/1146250807 shutdown_connections 2023-10-18T22:25:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.725+0000 7ff6c3fff700 1 -- 172.21.15.8:0/1146250807 wait complete. 2023-10-18T22:25:08.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.726+0000 7ff6c3fff700 1 Processor -- start 2023-10-18T22:25:08.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.726+0000 7ff6c3fff700 1 -- start start 2023-10-18T22:25:08.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c40f6530 0x7ff6c4108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:08.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c40f77d0 0x7ff6c41094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4109a70 con 0x7ff6c40f77d0 2023-10-18T22:25:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4109bb0 con 0x7ff6c40f6530 2023-10-18T22:25:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c40f77d0 0x7ff6c41094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c40f77d0 0x7ff6c41094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40160/0 (socket says 172.21.15.8:40160) 2023-10-18T22:25:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c27fc700 1 -- 172.21.15.8:0/11751076 learned_addr learned my addr 172.21.15.8:0/11751076 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c2ffd700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c40f6530 0x7ff6c4108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c27fc700 1 -- 172.21.15.8:0/11751076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c40f6530 msgr2=0x7ff6c4108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c27fc700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c40f6530 0x7ff6c4108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c27fc700 1 -- 172.21.15.8:0/11751076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4005040 con 0x7ff6c40f77d0 2023-10-18T22:25:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c2ffd700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c40f6530 0x7ff6c4108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:25:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.727+0000 7ff6c27fc700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c40f77d0 0x7ff6c41094c0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7ff6b80026d0 tx=0x7ff6b8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.728+0000 7ff6ab7fe700 1 -- 172.21.15.8:0/11751076 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6b8009320 con 0x7ff6c40f77d0 2023-10-18T22:25:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.728+0000 7ff6ab7fe700 1 -- 172.21.15.8:0/11751076 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff6b800f040 con 0x7ff6c40f77d0 2023-10-18T22:25:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.728+0000 7ff6ab7fe700 1 -- 172.21.15.8:0/11751076 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6b80148a0 con 0x7ff6c40f77d0 2023-10-18T22:25:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.728+0000 7ff6c3fff700 1 -- 172.21.15.8:0/11751076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c410a550 con 0x7ff6c40f77d0 2023-10-18T22:25:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.728+0000 7ff6c3fff700 1 -- 172.21.15.8:0/11751076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c410ab10 con 0x7ff6c40f77d0 2023-10-18T22:25:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.729+0000 7ff6c3fff700 1 -- 172.21.15.8:0/11751076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c4045ad0 con 0x7ff6c40f77d0 2023-10-18T22:25:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.730+0000 7ff6ab7fe700 1 -- 172.21.15.8:0/11751076 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff6b8009480 con 0x7ff6c40f77d0 2023-10-18T22:25:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.731+0000 7ff6ab7fe700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6ac060f70 0x7ff6ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.731+0000 7ff6ab7fe700 1 -- 172.21.15.8:0/11751076 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff6b807cf60 con 0x7ff6c40f77d0 2023-10-18T22:25:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.731+0000 7ff6c2ffd700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6ac060f70 0x7ff6ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.732+0000 7ff6c2ffd700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6ac060f70 0x7ff6ac063430 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7ff6b4005010 tx=0x7ff6b4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.735+0000 7ff6ab7fe700 1 -- 172.21.15.8:0/11751076 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff6b80505c0 con 0x7ff6c40f77d0 2023-10-18T22:25:08.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:07.319595+0000 mgr.smithi008.flmjzp (mgr.14640) 5170 : cluster [DBG] pgmap v3546: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:08.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.928+0000 7ff6c3fff700 1 -- 172.21.15.8:0/11751076 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6c40fee70 con 0x7ff6ac060f70 2023-10-18T22:25:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.937+0000 7ff6ab7fe700 1 -- 172.21.15.8:0/11751076 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff6b4013410 con 0x7ff6ac060f70 2023-10-18T22:25:08.939 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:25:08.939 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (91m) 8m ago 93m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:25:08.939 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (85m) 8m ago 93m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:25:08.940 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (85m) 6m ago 92m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:25:08.940 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (91m) 8m ago 92m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:25:08.940 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 8m ago 89m - - 2023-10-18T22:25:08.940 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 8m ago 89m - - 2023-10-18T22:25:08.940 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 6m ago 89m - - 2023-10-18T22:25:08.940 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 6m ago 89m - - 2023-10-18T22:25:08.941 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (86m) 8m ago 94m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:25:08.941 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (86m) 6m ago 92m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:25:08.941 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (86m) 8m ago 94m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:25:08.941 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (85m) 6m ago 92m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:25:08.941 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (92m) 8m ago 92m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:25:08.942 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (92m) 6m ago 92m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:25:08.942 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (85m) 8m ago 91m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:25:08.942 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (83m) 8m ago 91m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:25:08.942 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (82m) 8m ago 91m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:25:08.942 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (82m) 6m ago 90m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:25:08.943 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (81m) 6m ago 90m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:25:08.943 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (81m) 6m ago 90m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:25:08.943 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (87m) 8m ago 92m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:25:08.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.939+0000 7ff6c3fff700 1 -- 172.21.15.8:0/11751076 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6ac060f70 msgr2=0x7ff6ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.939+0000 7ff6c3fff700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6ac060f70 0x7ff6ac063430 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7ff6b4005010 tx=0x7ff6b4009b30).stop 2023-10-18T22:25:08.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.939+0000 7ff6c3fff700 1 -- 172.21.15.8:0/11751076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c40f77d0 msgr2=0x7ff6c41094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:08.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.939+0000 7ff6c3fff700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c40f77d0 0x7ff6c41094c0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7ff6b80026d0 tx=0x7ff6b8009de0).stop 2023-10-18T22:25:08.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.939+0000 7ff6c3fff700 1 -- 172.21.15.8:0/11751076 shutdown_connections 2023-10-18T22:25:08.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.939+0000 7ff6c3fff700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff6ac060f70 0x7ff6ac063430 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.939+0000 7ff6c3fff700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c40f6530 0x7ff6c4108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.939+0000 7ff6c3fff700 1 --2- 172.21.15.8:0/11751076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c40f77d0 0x7ff6c41094c0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:08.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.939+0000 7ff6c3fff700 1 -- 172.21.15.8:0/11751076 >> 172.21.15.8:0/11751076 conn(0x7ff6c40f1c90 msgr2=0x7ff6c406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:08.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.940+0000 7ff6c3fff700 1 -- 172.21.15.8:0/11751076 shutdown_connections 2023-10-18T22:25:08.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:08.940+0000 7ff6c3fff700 1 -- 172.21.15.8:0/11751076 wait complete. 2023-10-18T22:25:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.075+0000 7f47d5479700 1 -- 172.21.15.8:0/1400969449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d00f6530 msgr2=0x7f47d00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.075+0000 7f47d5479700 1 --2- 172.21.15.8:0/1400969449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d00f6530 0x7f47d00f6950 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f47c0004660 tx=0x7f47c0009b30).stop 2023-10-18T22:25:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.075+0000 7f47d5479700 1 -- 172.21.15.8:0/1400969449 shutdown_connections 2023-10-18T22:25:09.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.075+0000 7f47d5479700 1 --2- 172.21.15.8:0/1400969449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d00f77d0 0x7f47d00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.075+0000 7f47d5479700 1 --2- 172.21.15.8:0/1400969449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d00f6530 0x7f47d00f6950 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.075+0000 7f47d5479700 1 -- 172.21.15.8:0/1400969449 >> 172.21.15.8:0/1400969449 conn(0x7f47d00f1c90 msgr2=0x7f47d00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:09.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.075+0000 7f47d5479700 1 -- 172.21.15.8:0/1400969449 shutdown_connections 2023-10-18T22:25:09.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.076+0000 7f47d5479700 1 -- 172.21.15.8:0/1400969449 wait complete. 2023-10-18T22:25:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.076+0000 7f47d5479700 1 Processor -- start 2023-10-18T22:25:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.076+0000 7f47d5479700 1 -- start start 2023-10-18T22:25:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.077+0000 7f47d5479700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d00f6530 0x7f47d006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:09.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.077+0000 7f47d5479700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d00f77d0 0x7f47d0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:09.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.077+0000 7f47d5479700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d006a380 con 0x7f47d00f6530 2023-10-18T22:25:09.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.077+0000 7f47d5479700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d006a4c0 con 0x7f47d00f77d0 2023-10-18T22:25:09.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.077+0000 7f47cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d00f6530 0x7f47d006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:09.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.077+0000 7f47cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d00f6530 0x7f47d006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40188/0 (socket says 172.21.15.8:40188) 2023-10-18T22:25:09.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.077+0000 7f47cffff700 1 -- 172.21.15.8:0/684121001 learned_addr learned my addr 172.21.15.8:0/684121001 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:09.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.077+0000 7f47cf7fe700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d00f77d0 0x7f47d0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:09.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.078+0000 7f47cffff700 1 -- 172.21.15.8:0/684121001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d00f77d0 msgr2=0x7f47d0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:09.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.078+0000 7f47cffff700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d00f77d0 0x7f47d0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.078+0000 7f47cffff700 1 -- 172.21.15.8:0/684121001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c0005040 con 0x7f47d00f6530 2023-10-18T22:25:09.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.078+0000 7f47cffff700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d00f6530 0x7f47d006b9a0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f47c0007a70 tx=0x7f47c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:09.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.078+0000 7f47ccff9700 1 -- 172.21.15.8:0/684121001 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c0018070 con 0x7f47d00f6530 2023-10-18T22:25:09.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.078+0000 7f47ccff9700 1 -- 172.21.15.8:0/684121001 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f47c001d8e0 con 0x7f47d00f6530 2023-10-18T22:25:09.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.078+0000 7f47ccff9700 1 -- 172.21.15.8:0/684121001 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c001c5c0 con 0x7f47d00f6530 2023-10-18T22:25:09.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.078+0000 7f47d5479700 1 -- 172.21.15.8:0/684121001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d006a740 con 0x7f47d00f6530 2023-10-18T22:25:09.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.078+0000 7f47d5479700 1 -- 172.21.15.8:0/684121001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d006aca0 con 0x7f47d00f6530 2023-10-18T22:25:09.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.079+0000 7f47d5479700 1 -- 172.21.15.8:0/684121001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d0045ad0 con 0x7f47d00f6530 2023-10-18T22:25:09.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.080+0000 7f47ccff9700 1 -- 172.21.15.8:0/684121001 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f47c001da50 con 0x7f47d00f6530 2023-10-18T22:25:09.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.081+0000 7f47ccff9700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47b8060f70 0x7f47b8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:09.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.081+0000 7f47ccff9700 1 -- 172.21.15.8:0/684121001 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f47c007e780 con 0x7f47d00f6530 2023-10-18T22:25:09.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.081+0000 7f47cf7fe700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47b8060f70 0x7f47b8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:09.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.082+0000 7f47cf7fe700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47b8060f70 0x7f47b8063430 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f47c4007fd0 tx=0x7f47c4009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:09.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.085+0000 7f47ccff9700 1 -- 172.21.15.8:0/684121001 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f47c004e470 con 0x7f47d00f6530 2023-10-18T22:25:09.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.338+0000 7f47d5479700 1 -- 172.21.15.8:0/684121001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f47d00fed60 con 0x7f47d00f6530 2023-10-18T22:25:09.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.339+0000 7f47ccff9700 1 -- 172.21.15.8:0/684121001 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f47c001dce0 con 0x7f47d00f6530 2023-10-18T22:25:09.341 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:25:09.341 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:25:09.341 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:25:09.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:25:09.342 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:25:09.342 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:25:09.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:25:09.342 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:25:09.342 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:25:09.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:25:09.343 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:25:09.343 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:25:09.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:25:09.343 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:25:09.344 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:25:09.344 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:25:09.344 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:25:09.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 -- 172.21.15.8:0/684121001 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47b8060f70 msgr2=0x7f47b8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:09.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47b8060f70 0x7f47b8063430 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f47c4007fd0 tx=0x7f47c4009040).stop 2023-10-18T22:25:09.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 -- 172.21.15.8:0/684121001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d00f6530 msgr2=0x7f47d006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:09.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d00f6530 0x7f47d006b9a0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f47c0007a70 tx=0x7f47c0009b30).stop 2023-10-18T22:25:09.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 -- 172.21.15.8:0/684121001 shutdown_connections 2023-10-18T22:25:09.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f47b8060f70 0x7f47b8063430 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d00f6530 0x7f47d006b9a0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 --2- 172.21.15.8:0/684121001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d00f77d0 0x7f47d0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 -- 172.21.15.8:0/684121001 >> 172.21.15.8:0/684121001 conn(0x7f47d00f1c90 msgr2=0x7f47d00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 -- 172.21.15.8:0/684121001 shutdown_connections 2023-10-18T22:25:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.341+0000 7f47d5479700 1 -- 172.21.15.8:0/684121001 wait complete. 2023-10-18T22:25:09.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.478+0000 7f2b5ef60700 1 -- 172.21.15.8:0/2759938757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b580f6530 msgr2=0x7f2b580f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:09.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.478+0000 7f2b5ef60700 1 --2- 172.21.15.8:0/2759938757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b580f6530 0x7f2b580f6950 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f2b54004660 tx=0x7f2b54009b30).stop 2023-10-18T22:25:09.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.479+0000 7f2b5ef60700 1 -- 172.21.15.8:0/2759938757 shutdown_connections 2023-10-18T22:25:09.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.479+0000 7f2b5ef60700 1 --2- 172.21.15.8:0/2759938757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b580f77d0 0x7f2b580f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.479+0000 7f2b5ef60700 1 --2- 172.21.15.8:0/2759938757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b580f6530 0x7f2b580f6950 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.479+0000 7f2b5ef60700 1 -- 172.21.15.8:0/2759938757 >> 172.21.15.8:0/2759938757 conn(0x7f2b580f1c90 msgr2=0x7f2b580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:09.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.479+0000 7f2b5ef60700 1 -- 172.21.15.8:0/2759938757 shutdown_connections 2023-10-18T22:25:09.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.479+0000 7f2b5ef60700 1 -- 172.21.15.8:0/2759938757 wait complete. 2023-10-18T22:25:09.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.479+0000 7f2b5ef60700 1 Processor -- start 2023-10-18T22:25:09.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.480+0000 7f2b5ef60700 1 -- start start 2023-10-18T22:25:09.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.480+0000 7f2b5ef60700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b580f6530 0x7f2b58108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:09.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.480+0000 7f2b5ef60700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b580f77d0 0x7f2b58109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:09.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.480+0000 7f2b5ef60700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58109a00 con 0x7f2b580f77d0 2023-10-18T22:25:09.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.480+0000 7f2b5ef60700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58109b40 con 0x7f2b580f6530 2023-10-18T22:25:09.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.480+0000 7f2b5d75d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b580f77d0 0x7f2b58109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:09.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.480+0000 7f2b5d75d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b580f77d0 0x7f2b58109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40208/0 (socket says 172.21.15.8:40208) 2023-10-18T22:25:09.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.480+0000 7f2b5d75d700 1 -- 172.21.15.8:0/880223432 learned_addr learned my addr 172.21.15.8:0/880223432 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:09.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.480+0000 7f2b5df5e700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b580f6530 0x7f2b58108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:09.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.481+0000 7f2b5d75d700 1 -- 172.21.15.8:0/880223432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b580f6530 msgr2=0x7f2b58108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:09.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.481+0000 7f2b5d75d700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b580f6530 0x7f2b58108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.481+0000 7f2b5d75d700 1 -- 172.21.15.8:0/880223432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b54005040 con 0x7f2b580f77d0 2023-10-18T22:25:09.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.481+0000 7f2b5d75d700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b580f77d0 0x7f2b58109450 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7f2b4800e7f0 tx=0x7f2b4800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:09.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.481+0000 7f2b4e7fc700 1 -- 172.21.15.8:0/880223432 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b480092e0 con 0x7f2b580f77d0 2023-10-18T22:25:09.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.481+0000 7f2b4e7fc700 1 -- 172.21.15.8:0/880223432 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2b4800f040 con 0x7f2b580f77d0 2023-10-18T22:25:09.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.481+0000 7f2b4e7fc700 1 -- 172.21.15.8:0/880223432 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b480147e0 con 0x7f2b580f77d0 2023-10-18T22:25:09.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.481+0000 7f2b5ef60700 1 -- 172.21.15.8:0/880223432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5810a4e0 con 0x7f2b580f77d0 2023-10-18T22:25:09.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.481+0000 7f2b5ef60700 1 -- 172.21.15.8:0/880223432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5810aa20 con 0x7f2b580f77d0 2023-10-18T22:25:09.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.482+0000 7f2b5ef60700 1 -- 172.21.15.8:0/880223432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b58045ad0 con 0x7f2b580f77d0 2023-10-18T22:25:09.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.483+0000 7f2b4e7fc700 1 -- 172.21.15.8:0/880223432 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2b4801b030 con 0x7f2b580f77d0 2023-10-18T22:25:09.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.484+0000 7f2b4e7fc700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b44060f70 0x7f2b44063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:09.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.484+0000 7f2b4e7fc700 1 -- 172.21.15.8:0/880223432 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2b4807c6b0 con 0x7f2b580f77d0 2023-10-18T22:25:09.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.484+0000 7f2b5df5e700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b44060f70 0x7f2b44063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:09.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.485+0000 7f2b5df5e700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b44060f70 0x7f2b44063430 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f2b54009720 tx=0x7f2b54016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:09.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.488+0000 7f2b4e7fc700 1 -- 172.21.15.8:0/880223432 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2b4804fd40 con 0x7f2b580f77d0 2023-10-18T22:25:09.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:08.232748+0000 mgr.smithi008.flmjzp (mgr.14640) 5171 : audit [DBG] from='client.38128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:09.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:09.339545+0000 mon.smithi008 (mon.0) 5428 : audit [DBG] from='client.? 172.21.15.8:0/684121001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:09.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.714+0000 7f2b5ef60700 1 -- 172.21.15.8:0/880223432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2b58027a00 con 0x7f2b580f77d0 2023-10-18T22:25:09.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.715+0000 7f2b4e7fc700 1 -- 172.21.15.8:0/880223432 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f2b48019070 con 0x7f2b580f77d0 2023-10-18T22:25:09.717 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:25:09.717 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:25:09.717 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:25:09.717 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:25:09.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:25:09.718 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:25:09.718 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:25:09.718 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:25:09.718 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:25:09.718 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:25:09.719 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:25:09.719 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:25:09.719 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:25:09.719 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:25:09.719 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:25:09.720 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:25:09.720 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:25:09.720 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:25:09.720 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:25:09.720 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:25:09.720 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:25:09.721 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:25:09.721 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:25:09.721 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:25:09.721 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:25:09.721 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:25:09.721 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:25:09.722 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:25:09.722 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:25:09.722 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:25:09.722 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:25:09.723 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:25:09.723 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:25:09.723 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:25:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.716+0000 7f2b5ef60700 1 -- 172.21.15.8:0/880223432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b44060f70 msgr2=0x7f2b44063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.716+0000 7f2b5ef60700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b44060f70 0x7f2b44063430 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f2b54009720 tx=0x7f2b54016040).stop 2023-10-18T22:25:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.717+0000 7f2b5ef60700 1 -- 172.21.15.8:0/880223432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b580f77d0 msgr2=0x7f2b58109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.717+0000 7f2b5ef60700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b580f77d0 0x7f2b58109450 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7f2b4800e7f0 tx=0x7f2b4800b040).stop 2023-10-18T22:25:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.717+0000 7f2b5ef60700 1 -- 172.21.15.8:0/880223432 shutdown_connections 2023-10-18T22:25:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.717+0000 7f2b5ef60700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2b44060f70 0x7f2b44063430 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.717+0000 7f2b5ef60700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b580f6530 0x7f2b58108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.717+0000 7f2b5ef60700 1 --2- 172.21.15.8:0/880223432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b580f77d0 0x7f2b58109450 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.717+0000 7f2b5ef60700 1 -- 172.21.15.8:0/880223432 >> 172.21.15.8:0/880223432 conn(0x7f2b580f1c90 msgr2=0x7f2b5806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.717+0000 7f2b5ef60700 1 -- 172.21.15.8:0/880223432 shutdown_connections 2023-10-18T22:25:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.717+0000 7f2b5ef60700 1 -- 172.21.15.8:0/880223432 wait complete. 2023-10-18T22:25:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:25:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:08.232748+0000 mgr.smithi008.flmjzp (mgr.14640) 5171 : audit [DBG] from='client.38128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:09.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:09.339545+0000 mon.smithi008 (mon.0) 5428 : audit [DBG] from='client.? 172.21.15.8:0/684121001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:09.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.853+0000 7fe009624700 1 -- 172.21.15.8:0/1636723005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0040f77d0 msgr2=0x7fe0040f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:09.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.853+0000 7fe009624700 1 --2- 172.21.15.8:0/1636723005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0040f77d0 0x7fe0040f7c30 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7fdff8004660 tx=0x7fdff8009b30).stop 2023-10-18T22:25:09.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.854+0000 7fe009624700 1 -- 172.21.15.8:0/1636723005 shutdown_connections 2023-10-18T22:25:09.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.854+0000 7fe009624700 1 --2- 172.21.15.8:0/1636723005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0040f77d0 0x7fe0040f7c30 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.854+0000 7fe009624700 1 --2- 172.21.15.8:0/1636723005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0040f6530 0x7fe0040f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.854+0000 7fe009624700 1 -- 172.21.15.8:0/1636723005 >> 172.21.15.8:0/1636723005 conn(0x7fe0040f1c90 msgr2=0x7fe0040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:09.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.854+0000 7fe009624700 1 -- 172.21.15.8:0/1636723005 shutdown_connections 2023-10-18T22:25:09.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.854+0000 7fe009624700 1 -- 172.21.15.8:0/1636723005 wait complete. 2023-10-18T22:25:09.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.854+0000 7fe009624700 1 Processor -- start 2023-10-18T22:25:09.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.855+0000 7fe009624700 1 -- start start 2023-10-18T22:25:09.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.855+0000 7fe009624700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0040f6530 0x7fe00406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:09.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.855+0000 7fe009624700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0040f77d0 0x7fe004069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:09.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.855+0000 7fe009624700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00406a380 con 0x7fe0040f6530 2023-10-18T22:25:09.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.855+0000 7fe009624700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00406a4c0 con 0x7fe0040f77d0 2023-10-18T22:25:09.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.855+0000 7fe003fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0040f6530 0x7fe00406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:09.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.855+0000 7fe003fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0040f6530 0x7fe00406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40228/0 (socket says 172.21.15.8:40228) 2023-10-18T22:25:09.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.855+0000 7fe003fff700 1 -- 172.21.15.8:0/2106670203 learned_addr learned my addr 172.21.15.8:0/2106670203 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:09.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.855+0000 7fe0037fe700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0040f77d0 0x7fe004069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:09.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.856+0000 7fe003fff700 1 -- 172.21.15.8:0/2106670203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0040f77d0 msgr2=0x7fe004069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:09.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.856+0000 7fe003fff700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0040f77d0 0x7fe004069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:09.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.856+0000 7fe003fff700 1 -- 172.21.15.8:0/2106670203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8005040 con 0x7fe0040f6530 2023-10-18T22:25:09.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.856+0000 7fe003fff700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0040f6530 0x7fe00406b9a0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7fdff400e7c0 tx=0x7fdff400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:09.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.856+0000 7fe000ff9700 1 -- 172.21.15.8:0/2106670203 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff40092e0 con 0x7fe0040f6530 2023-10-18T22:25:09.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.856+0000 7fe000ff9700 1 -- 172.21.15.8:0/2106670203 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdff400f040 con 0x7fe0040f6530 2023-10-18T22:25:09.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.856+0000 7fe009624700 1 -- 172.21.15.8:0/2106670203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00406a7a0 con 0x7fe0040f6530 2023-10-18T22:25:09.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.856+0000 7fe000ff9700 1 -- 172.21.15.8:0/2106670203 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff4014810 con 0x7fe0040f6530 2023-10-18T22:25:09.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.856+0000 7fe009624700 1 -- 172.21.15.8:0/2106670203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00410ed20 con 0x7fe0040f6530 2023-10-18T22:25:09.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.857+0000 7fe009624700 1 -- 172.21.15.8:0/2106670203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe004045ad0 con 0x7fe0040f6530 2023-10-18T22:25:09.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.858+0000 7fe000ff9700 1 -- 172.21.15.8:0/2106670203 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdff401b030 con 0x7fe0040f6530 2023-10-18T22:25:09.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.859+0000 7fe000ff9700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfec060f70 0x7fdfec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:09.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.859+0000 7fe000ff9700 1 -- 172.21.15.8:0/2106670203 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdff407c860 con 0x7fe0040f6530 2023-10-18T22:25:09.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.859+0000 7fe0037fe700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfec060f70 0x7fdfec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:09.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.860+0000 7fe0037fe700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfec060f70 0x7fdfec063430 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7fdff8009720 tx=0x7fdff8016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:09.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:09.863+0000 7fe000ff9700 1 -- 172.21.15.8:0/2106670203 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdff404c4d0 con 0x7fe0040f6530 2023-10-18T22:25:10.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.062+0000 7fe009624700 1 -- 172.21.15.8:0/2106670203 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe004057f10 con 0x7fdfec060f70 2023-10-18T22:25:10.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.063+0000 7fe000ff9700 1 -- 172.21.15.8:0/2106670203 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe004057f10 con 0x7fdfec060f70 2023-10-18T22:25:10.064 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:25:10.065 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:25:10.065 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:25:10.065 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:25:10.065 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:25:10.065 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:25:10.066 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:25:10.066 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:25:10.066 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:25:10.066 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:25:10.066 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:25:10.067 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:25:10.067 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:25:10.067 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:25:10.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 -- 172.21.15.8:0/2106670203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfec060f70 msgr2=0x7fdfec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:10.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfec060f70 0x7fdfec063430 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7fdff8009720 tx=0x7fdff8016040).stop 2023-10-18T22:25:10.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 -- 172.21.15.8:0/2106670203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0040f6530 msgr2=0x7fe00406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:10.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0040f6530 0x7fe00406b9a0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7fdff400e7c0 tx=0x7fdff400b040).stop 2023-10-18T22:25:10.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 -- 172.21.15.8:0/2106670203 shutdown_connections 2023-10-18T22:25:10.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdfec060f70 0x7fdfec063430 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:10.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0040f6530 0x7fe00406b9a0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:10.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 --2- 172.21.15.8:0/2106670203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0040f77d0 0x7fe004069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:10.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 -- 172.21.15.8:0/2106670203 >> 172.21.15.8:0/2106670203 conn(0x7fe0040f1c90 msgr2=0x7fe0040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:10.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 -- 172.21.15.8:0/2106670203 shutdown_connections 2023-10-18T22:25:10.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:10.065+0000 7fe009624700 1 -- 172.21.15.8:0/2106670203 wait complete. 2023-10-18T22:25:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:08.586262+0000 mgr.smithi008.flmjzp (mgr.14640) 5172 : audit [DBG] from='client.38132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:08.929491+0000 mgr.smithi008.flmjzp (mgr.14640) 5173 : audit [DBG] from='client.38136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:09.320034+0000 mgr.smithi008.flmjzp (mgr.14640) 5174 : cluster [DBG] pgmap v3547: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:09.715310+0000 mon.smithi008 (mon.0) 5429 : audit [DBG] from='client.? 172.21.15.8:0/880223432' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:25:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:08.586262+0000 mgr.smithi008.flmjzp (mgr.14640) 5172 : audit [DBG] from='client.38132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:08.929491+0000 mgr.smithi008.flmjzp (mgr.14640) 5173 : audit [DBG] from='client.38136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:09.320034+0000 mgr.smithi008.flmjzp (mgr.14640) 5174 : cluster [DBG] pgmap v3547: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:09.715310+0000 mon.smithi008 (mon.0) 5429 : audit [DBG] from='client.? 172.21.15.8:0/880223432' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:25:11.486 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:10.063297+0000 mgr.smithi008.flmjzp (mgr.14640) 5175 : audit [DBG] from='client.38148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:11.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:10.063297+0000 mgr.smithi008.flmjzp (mgr.14640) 5175 : audit [DBG] from='client.38148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:11.320701+0000 mgr.smithi008.flmjzp (mgr.14640) 5176 : cluster [DBG] pgmap v3548: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:12.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:11.320701+0000 mgr.smithi008.flmjzp (mgr.14640) 5176 : cluster [DBG] pgmap v3548: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:13.321183+0000 mgr.smithi008.flmjzp (mgr.14640) 5177 : cluster [DBG] pgmap v3549: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:13.321183+0000 mgr.smithi008.flmjzp (mgr.14640) 5177 : cluster [DBG] pgmap v3549: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:15.350854+0000 mon.smithi008 (mon.0) 5430 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:15.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:15.353079+0000 mon.smithi008 (mon.0) 5431 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:15.354163+0000 mon.smithi008 (mon.0) 5432 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:15.361055+0000 mon.smithi008 (mon.0) 5433 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:15.367665+0000 mon.smithi008 (mon.0) 5434 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:15.370830+0000 mon.smithi008 (mon.0) 5435 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:15.372565+0000 mon.smithi008 (mon.0) 5436 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:15.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:15.374268+0000 mon.smithi008 (mon.0) 5437 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:15.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:15.376403+0000 mon.smithi008 (mon.0) 5438 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:15.350854+0000 mon.smithi008 (mon.0) 5430 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:15.353079+0000 mon.smithi008 (mon.0) 5431 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:15.354163+0000 mon.smithi008 (mon.0) 5432 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:15.361055+0000 mon.smithi008 (mon.0) 5433 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:15.367665+0000 mon.smithi008 (mon.0) 5434 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:15.370830+0000 mon.smithi008 (mon.0) 5435 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:15.372565+0000 mon.smithi008 (mon.0) 5436 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:15.374268+0000 mon.smithi008 (mon.0) 5437 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:15.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:15.376403+0000 mon.smithi008 (mon.0) 5438 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:15.321830+0000 mgr.smithi008.flmjzp (mgr.14640) 5178 : cluster [DBG] pgmap v3550: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:15.355167+0000 mgr.smithi008.flmjzp (mgr.14640) 5179 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:15.355728+0000 mgr.smithi008.flmjzp (mgr.14640) 5180 : cluster [DBG] pgmap v3551: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:15.355993+0000 mgr.smithi008.flmjzp (mgr.14640) 5181 : cluster [DBG] pgmap v3552: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:16.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:15.378269+0000 mgr.smithi008.flmjzp (mgr.14640) 5182 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:15.321830+0000 mgr.smithi008.flmjzp (mgr.14640) 5178 : cluster [DBG] pgmap v3550: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:16.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:15.355167+0000 mgr.smithi008.flmjzp (mgr.14640) 5179 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:16.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:15.355728+0000 mgr.smithi008.flmjzp (mgr.14640) 5180 : cluster [DBG] pgmap v3551: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:16.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:15.355993+0000 mgr.smithi008.flmjzp (mgr.14640) 5181 : cluster [DBG] pgmap v3552: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:16.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:15.378269+0000 mgr.smithi008.flmjzp (mgr.14640) 5182 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:17.356545+0000 mgr.smithi008.flmjzp (mgr.14640) 5183 : cluster [DBG] pgmap v3553: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:18.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:17.356545+0000 mgr.smithi008.flmjzp (mgr.14640) 5183 : cluster [DBG] pgmap v3553: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:20.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:19.357072+0000 mgr.smithi008.flmjzp (mgr.14640) 5184 : cluster [DBG] pgmap v3554: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:20.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:19.357072+0000 mgr.smithi008.flmjzp (mgr.14640) 5184 : cluster [DBG] pgmap v3554: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:21.357636+0000 mgr.smithi008.flmjzp (mgr.14640) 5185 : cluster [DBG] pgmap v3555: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:21.357636+0000 mgr.smithi008.flmjzp (mgr.14640) 5185 : cluster [DBG] pgmap v3555: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:23.358256+0000 mgr.smithi008.flmjzp (mgr.14640) 5186 : cluster [DBG] pgmap v3556: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:24.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:23.358256+0000 mgr.smithi008.flmjzp (mgr.14640) 5186 : cluster [DBG] pgmap v3556: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:25.387316+0000 mon.smithi008 (mon.0) 5439 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:25.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:25.387316+0000 mon.smithi008 (mon.0) 5439 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:25.358851+0000 mgr.smithi008.flmjzp (mgr.14640) 5187 : cluster [DBG] pgmap v3557: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:25.951388+0000 mon.smithi008 (mon.0) 5440 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:26.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:25.952277+0000 mon.smithi008 (mon.0) 5441 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:25.957464+0000 mon.smithi008 (mon.0) 5442 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:25.962298+0000 mon.smithi008 (mon.0) 5443 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:25.964578+0000 mon.smithi008 (mon.0) 5444 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:25.965802+0000 mon.smithi008 (mon.0) 5445 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:26.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:25.967047+0000 mon.smithi008 (mon.0) 5446 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:26.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:25.968574+0000 mon.smithi008 (mon.0) 5447 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:25.358851+0000 mgr.smithi008.flmjzp (mgr.14640) 5187 : cluster [DBG] pgmap v3557: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:25.951388+0000 mon.smithi008 (mon.0) 5440 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:25.952277+0000 mon.smithi008 (mon.0) 5441 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:25.957464+0000 mon.smithi008 (mon.0) 5442 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:26.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:25.962298+0000 mon.smithi008 (mon.0) 5443 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:26.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:25.964578+0000 mon.smithi008 (mon.0) 5444 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:26.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:25.965802+0000 mon.smithi008 (mon.0) 5445 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:26.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:25.967047+0000 mon.smithi008 (mon.0) 5446 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:26.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:25.968574+0000 mon.smithi008 (mon.0) 5447 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:25.952908+0000 mgr.smithi008.flmjzp (mgr.14640) 5188 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:25.953376+0000 mgr.smithi008.flmjzp (mgr.14640) 5189 : cluster [DBG] pgmap v3558: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:25.953623+0000 mgr.smithi008.flmjzp (mgr.14640) 5190 : cluster [DBG] pgmap v3559: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:25.970071+0000 mgr.smithi008.flmjzp (mgr.14640) 5191 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:25.952908+0000 mgr.smithi008.flmjzp (mgr.14640) 5188 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:25.953376+0000 mgr.smithi008.flmjzp (mgr.14640) 5189 : cluster [DBG] pgmap v3558: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:25.953623+0000 mgr.smithi008.flmjzp (mgr.14640) 5190 : cluster [DBG] pgmap v3559: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:25.970071+0000 mgr.smithi008.flmjzp (mgr.14640) 5191 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:27.954155+0000 mgr.smithi008.flmjzp (mgr.14640) 5192 : cluster [DBG] pgmap v3560: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:27.954155+0000 mgr.smithi008.flmjzp (mgr.14640) 5192 : cluster [DBG] pgmap v3560: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:29.954727+0000 mgr.smithi008.flmjzp (mgr.14640) 5193 : cluster [DBG] pgmap v3561: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:29.954727+0000 mgr.smithi008.flmjzp (mgr.14640) 5193 : cluster [DBG] pgmap v3561: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:31.955233+0000 mgr.smithi008.flmjzp (mgr.14640) 5194 : cluster [DBG] pgmap v3562: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:33.856 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:31.955233+0000 mgr.smithi008.flmjzp (mgr.14640) 5194 : cluster [DBG] pgmap v3562: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:33.955968+0000 mgr.smithi008.flmjzp (mgr.14640) 5195 : cluster [DBG] pgmap v3563: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:33.955968+0000 mgr.smithi008.flmjzp (mgr.14640) 5195 : cluster [DBG] pgmap v3563: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:35.980921+0000 mon.smithi008 (mon.0) 5448 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:35.983059+0000 mon.smithi008 (mon.0) 5449 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:35.984030+0000 mon.smithi008 (mon.0) 5450 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:35.991317+0000 mon.smithi008 (mon.0) 5451 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:35.997781+0000 mon.smithi008 (mon.0) 5452 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:36.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:36.000921+0000 mon.smithi008 (mon.0) 5453 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:36.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:36.002696+0000 mon.smithi008 (mon.0) 5454 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:36.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:36.004306+0000 mon.smithi008 (mon.0) 5455 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:36.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:36.006252+0000 mon.smithi008 (mon.0) 5456 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:35.980921+0000 mon.smithi008 (mon.0) 5448 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:35.983059+0000 mon.smithi008 (mon.0) 5449 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:35.984030+0000 mon.smithi008 (mon.0) 5450 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:35.991317+0000 mon.smithi008 (mon.0) 5451 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:35.997781+0000 mon.smithi008 (mon.0) 5452 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:36.000921+0000 mon.smithi008 (mon.0) 5453 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:36.002696+0000 mon.smithi008 (mon.0) 5454 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:36.004306+0000 mon.smithi008 (mon.0) 5455 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:36.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:36.006252+0000 mon.smithi008 (mon.0) 5456 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:35.956649+0000 mgr.smithi008.flmjzp (mgr.14640) 5196 : cluster [DBG] pgmap v3564: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:35.984857+0000 mgr.smithi008.flmjzp (mgr.14640) 5197 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:35.985475+0000 mgr.smithi008.flmjzp (mgr.14640) 5198 : cluster [DBG] pgmap v3565: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:35.985748+0000 mgr.smithi008.flmjzp (mgr.14640) 5199 : cluster [DBG] pgmap v3566: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:37.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:36.008126+0000 mgr.smithi008.flmjzp (mgr.14640) 5200 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:37.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:35.956649+0000 mgr.smithi008.flmjzp (mgr.14640) 5196 : cluster [DBG] pgmap v3564: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:37.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:35.984857+0000 mgr.smithi008.flmjzp (mgr.14640) 5197 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:37.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:35.985475+0000 mgr.smithi008.flmjzp (mgr.14640) 5198 : cluster [DBG] pgmap v3565: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:37.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:35.985748+0000 mgr.smithi008.flmjzp (mgr.14640) 5199 : cluster [DBG] pgmap v3566: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:37.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:36.008126+0000 mgr.smithi008.flmjzp (mgr.14640) 5200 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:37.986371+0000 mgr.smithi008.flmjzp (mgr.14640) 5201 : cluster [DBG] pgmap v3567: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:37.986371+0000 mgr.smithi008.flmjzp (mgr.14640) 5201 : cluster [DBG] pgmap v3567: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.217+0000 7f7c254b8700 1 -- 172.21.15.8:0/208171312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c200f6530 msgr2=0x7f7c200f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.217+0000 7f7c254b8700 1 --2- 172.21.15.8:0/208171312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c200f6530 0x7f7c200f6950 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7f7c10004660 tx=0x7f7c10009b30).stop 2023-10-18T22:25:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.217+0000 7f7c254b8700 1 -- 172.21.15.8:0/208171312 shutdown_connections 2023-10-18T22:25:40.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.217+0000 7f7c254b8700 1 --2- 172.21.15.8:0/208171312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c200f77d0 0x7f7c200f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.217+0000 7f7c254b8700 1 --2- 172.21.15.8:0/208171312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c200f6530 0x7f7c200f6950 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.217+0000 7f7c254b8700 1 -- 172.21.15.8:0/208171312 >> 172.21.15.8:0/208171312 conn(0x7f7c200f1c70 msgr2=0x7f7c200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:40.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.217+0000 7f7c254b8700 1 -- 172.21.15.8:0/208171312 shutdown_connections 2023-10-18T22:25:40.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.217+0000 7f7c254b8700 1 -- 172.21.15.8:0/208171312 wait complete. 2023-10-18T22:25:40.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.218+0000 7f7c254b8700 1 Processor -- start 2023-10-18T22:25:40.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.218+0000 7f7c254b8700 1 -- start start 2023-10-18T22:25:40.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c254b8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c200f6530 0x7f7c20106e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:40.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c254b8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c200f77d0 0x7f7c20107330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:40.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c254b8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20107930 con 0x7f7c200f6530 2023-10-18T22:25:40.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c254b8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20108140 con 0x7f7c200f77d0 2023-10-18T22:25:40.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c1ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c200f6530 0x7f7c20106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:40.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c1ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c200f6530 0x7f7c20106e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39242/0 (socket says 172.21.15.8:39242) 2023-10-18T22:25:40.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c1ffff700 1 -- 172.21.15.8:0/3263997914 learned_addr learned my addr 172.21.15.8:0/3263997914 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:40.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c1f7fe700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c200f77d0 0x7f7c20107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:40.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c1ffff700 1 -- 172.21.15.8:0/3263997914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c200f77d0 msgr2=0x7f7c20107330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:40.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c1ffff700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c200f77d0 0x7f7c20107330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.219+0000 7f7c1ffff700 1 -- 172.21.15.8:0/3263997914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10005040 con 0x7f7c200f6530 2023-10-18T22:25:40.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.220+0000 7f7c1ffff700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c200f6530 0x7f7c20106e40 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7f7c10007a60 tx=0x7f7c10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:40.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.220+0000 7f7c1cff9700 1 -- 172.21.15.8:0/3263997914 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c10018070 con 0x7f7c200f6530 2023-10-18T22:25:40.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.220+0000 7f7c1cff9700 1 -- 172.21.15.8:0/3263997914 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7c10009630 con 0x7f7c200f6530 2023-10-18T22:25:40.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.220+0000 7f7c1cff9700 1 -- 172.21.15.8:0/3263997914 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c1001c4d0 con 0x7f7c200f6530 2023-10-18T22:25:40.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.220+0000 7f7c254b8700 1 -- 172.21.15.8:0/3263997914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c20108360 con 0x7f7c200f6530 2023-10-18T22:25:40.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.220+0000 7f7c254b8700 1 -- 172.21.15.8:0/3263997914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c201088c0 con 0x7f7c200f6530 2023-10-18T22:25:40.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.221+0000 7f7c254b8700 1 -- 172.21.15.8:0/3263997914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c20059100 con 0x7f7c200f6530 2023-10-18T22:25:40.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.222+0000 7f7c1cff9700 1 -- 172.21.15.8:0/3263997914 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7c1001d420 con 0x7f7c200f6530 2023-10-18T22:25:40.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.223+0000 7f7c1cff9700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c08060f70 0x7f7c08063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:40.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.224+0000 7f7c1cff9700 1 -- 172.21.15.8:0/3263997914 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7c1007e550 con 0x7f7c200f6530 2023-10-18T22:25:40.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.224+0000 7f7c1f7fe700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c08060f70 0x7f7c08063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:40.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.224+0000 7f7c1f7fe700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c08060f70 0x7f7c08063430 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f7c14004c40 tx=0x7f7c1400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:40.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.228+0000 7f7c1cff9700 1 -- 172.21.15.8:0/3263997914 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7c1004e180 con 0x7f7c200f6530 2023-10-18T22:25:40.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.429+0000 7f7c254b8700 1 -- 172.21.15.8:0/3263997914 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c200008d0 con 0x7f7c08060f70 2023-10-18T22:25:40.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.430+0000 7f7c1cff9700 1 -- 172.21.15.8:0/3263997914 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7c200008d0 con 0x7f7c08060f70 2023-10-18T22:25:40.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.432+0000 7f7c254b8700 1 -- 172.21.15.8:0/3263997914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c08060f70 msgr2=0x7f7c08063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:40.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.432+0000 7f7c254b8700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c08060f70 0x7f7c08063430 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f7c14004c40 tx=0x7f7c1400b040).stop 2023-10-18T22:25:40.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.432+0000 7f7c254b8700 1 -- 172.21.15.8:0/3263997914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c200f6530 msgr2=0x7f7c20106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:40.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.432+0000 7f7c254b8700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c200f6530 0x7f7c20106e40 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7f7c10007a60 tx=0x7f7c10009b30).stop 2023-10-18T22:25:40.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.432+0000 7f7c254b8700 1 -- 172.21.15.8:0/3263997914 shutdown_connections 2023-10-18T22:25:40.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.432+0000 7f7c254b8700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c08060f70 0x7f7c08063430 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.432+0000 7f7c254b8700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c200f6530 0x7f7c20106e40 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.432+0000 7f7c254b8700 1 --2- 172.21.15.8:0/3263997914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c200f77d0 0x7f7c20107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.432+0000 7f7c254b8700 1 -- 172.21.15.8:0/3263997914 >> 172.21.15.8:0/3263997914 conn(0x7f7c200f1c70 msgr2=0x7f7c200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:40.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.433+0000 7f7c254b8700 1 -- 172.21.15.8:0/3263997914 shutdown_connections 2023-10-18T22:25:40.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.433+0000 7f7c254b8700 1 -- 172.21.15.8:0/3263997914 wait complete. 2023-10-18T22:25:40.449 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:25:40.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.571+0000 7f53fb59e700 1 -- 172.21.15.8:0/1038191002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 msgr2=0x7f53fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:40.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.571+0000 7f53fb59e700 1 --2- 172.21.15.8:0/1038191002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 0x7f53fc0f6950 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7f53ec004660 tx=0x7f53ec009b30).stop 2023-10-18T22:25:40.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.571+0000 7f53fb59e700 1 -- 172.21.15.8:0/1038191002 shutdown_connections 2023-10-18T22:25:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.571+0000 7f53fb59e700 1 --2- 172.21.15.8:0/1038191002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f77d0 0x7f53fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.571+0000 7f53fb59e700 1 --2- 172.21.15.8:0/1038191002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 0x7f53fc0f6950 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.571+0000 7f53fb59e700 1 -- 172.21.15.8:0/1038191002 >> 172.21.15.8:0/1038191002 conn(0x7f53fc0f1c90 msgr2=0x7f53fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.571+0000 7f53fb59e700 1 -- 172.21.15.8:0/1038191002 shutdown_connections 2023-10-18T22:25:40.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.571+0000 7f53fb59e700 1 -- 172.21.15.8:0/1038191002 wait complete. 2023-10-18T22:25:40.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.572+0000 7f53fb59e700 1 Processor -- start 2023-10-18T22:25:40.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.572+0000 7f53fb59e700 1 -- start start 2023-10-18T22:25:40.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.573+0000 7f53fb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 0x7f53fc108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:40.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.573+0000 7f53fb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f77d0 0x7f53fc1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:40.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.573+0000 7f53fb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc109a70 con 0x7f53fc0f6530 2023-10-18T22:25:40.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.573+0000 7f53fb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc109bb0 con 0x7f53fc0f77d0 2023-10-18T22:25:40.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.573+0000 7f53fa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 0x7f53fc108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:40.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.573+0000 7f53fa59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 0x7f53fc108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39266/0 (socket says 172.21.15.8:39266) 2023-10-18T22:25:40.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.573+0000 7f53fa59c700 1 -- 172.21.15.8:0/546611567 learned_addr learned my addr 172.21.15.8:0/546611567 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:40.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.573+0000 7f53f9d9b700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f77d0 0x7f53fc1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:40.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.574+0000 7f53fa59c700 1 -- 172.21.15.8:0/546611567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f77d0 msgr2=0x7f53fc1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:40.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.574+0000 7f53fa59c700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f77d0 0x7f53fc1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.574+0000 7f53fa59c700 1 -- 172.21.15.8:0/546611567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec005040 con 0x7f53fc0f6530 2023-10-18T22:25:40.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.574+0000 7f53fa59c700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 0x7f53fc108fd0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f53ec007a60 tx=0x7f53ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:40.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.574+0000 7f53eaffd700 1 -- 172.21.15.8:0/546611567 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53ec018070 con 0x7f53fc0f6530 2023-10-18T22:25:40.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.574+0000 7f53eaffd700 1 -- 172.21.15.8:0/546611567 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f53ec009630 con 0x7f53fc0f6530 2023-10-18T22:25:40.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.574+0000 7f53fb59e700 1 -- 172.21.15.8:0/546611567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc10a4f0 con 0x7f53fc0f6530 2023-10-18T22:25:40.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.574+0000 7f53eaffd700 1 -- 172.21.15.8:0/546611567 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53ec01c4d0 con 0x7f53fc0f6530 2023-10-18T22:25:40.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.574+0000 7f53fb59e700 1 -- 172.21.15.8:0/546611567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc10aa50 con 0x7f53fc0f6530 2023-10-18T22:25:40.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.575+0000 7f53fb59e700 1 -- 172.21.15.8:0/546611567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc045ad0 con 0x7f53fc0f6530 2023-10-18T22:25:40.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.576+0000 7f53eaffd700 1 -- 172.21.15.8:0/546611567 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f53ec01d420 con 0x7f53fc0f6530 2023-10-18T22:25:40.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.577+0000 7f53eaffd700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 0x7f53e4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:40.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.577+0000 7f53eaffd700 1 -- 172.21.15.8:0/546611567 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f53ec07e650 con 0x7f53fc0f6530 2023-10-18T22:25:40.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.577+0000 7f53f9d9b700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 0x7f53e4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:40.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.578+0000 7f53f9d9b700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 0x7f53e4063430 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f53f0004c40 tx=0x7f53f000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:40.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.581+0000 7f53eaffd700 1 -- 172.21.15.8:0/546611567 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f53ec051ca0 con 0x7f53fc0f6530 2023-10-18T22:25:40.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.777+0000 7f53fb59e700 1 -- 172.21.15.8:0/546611567 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53fc0fedd0 con 0x7f53e4060f70 2023-10-18T22:25:40.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.779+0000 7f53eaffd700 1 -- 172.21.15.8:0/546611567 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f53fc0fedd0 con 0x7f53e4060f70 2023-10-18T22:25:40.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.780+0000 7f53fb59e700 1 -- 172.21.15.8:0/546611567 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 msgr2=0x7f53e4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:40.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.781+0000 7f53fb59e700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 0x7f53e4063430 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f53f0004c40 tx=0x7f53f000b040).stop 2023-10-18T22:25:40.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.781+0000 7f53fb59e700 1 -- 172.21.15.8:0/546611567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 msgr2=0x7f53fc108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:40.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.781+0000 7f53fb59e700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 0x7f53fc108fd0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f53ec007a60 tx=0x7f53ec009b30).stop 2023-10-18T22:25:40.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.781+0000 7f53fb59e700 1 -- 172.21.15.8:0/546611567 shutdown_connections 2023-10-18T22:25:40.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.781+0000 7f53fb59e700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f53e4060f70 0x7f53e4063430 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.781+0000 7f53fb59e700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53fc0f6530 0x7f53fc108fd0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.781+0000 7f53fb59e700 1 --2- 172.21.15.8:0/546611567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53fc0f77d0 0x7f53fc1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.781+0000 7f53fb59e700 1 -- 172.21.15.8:0/546611567 >> 172.21.15.8:0/546611567 conn(0x7f53fc0f1c90 msgr2=0x7f53fc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:40.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.781+0000 7f53fb59e700 1 -- 172.21.15.8:0/546611567 shutdown_connections 2023-10-18T22:25:40.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.781+0000 7f53fb59e700 1 -- 172.21.15.8:0/546611567 wait complete. 2023-10-18T22:25:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.917+0000 7f2a455df700 1 -- 172.21.15.8:0/2658237771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a400f77d0 msgr2=0x7f2a400f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.917+0000 7f2a455df700 1 --2- 172.21.15.8:0/2658237771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a400f77d0 0x7f2a400f7c30 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f2a34004660 tx=0x7f2a34009b30).stop 2023-10-18T22:25:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.918+0000 7f2a455df700 1 -- 172.21.15.8:0/2658237771 shutdown_connections 2023-10-18T22:25:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.918+0000 7f2a455df700 1 --2- 172.21.15.8:0/2658237771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a400f77d0 0x7f2a400f7c30 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.918+0000 7f2a455df700 1 --2- 172.21.15.8:0/2658237771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a400f6530 0x7f2a400f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.918+0000 7f2a455df700 1 -- 172.21.15.8:0/2658237771 >> 172.21.15.8:0/2658237771 conn(0x7f2a400f1c70 msgr2=0x7f2a400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.918+0000 7f2a455df700 1 -- 172.21.15.8:0/2658237771 shutdown_connections 2023-10-18T22:25:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.918+0000 7f2a455df700 1 -- 172.21.15.8:0/2658237771 wait complete. 2023-10-18T22:25:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.919+0000 7f2a455df700 1 Processor -- start 2023-10-18T22:25:40.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.919+0000 7f2a455df700 1 -- start start 2023-10-18T22:25:40.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.919+0000 7f2a455df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a400f6530 0x7f2a40106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:40.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.919+0000 7f2a455df700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a400f77d0 0x7f2a40107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:40.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.919+0000 7f2a455df700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a40107820 con 0x7f2a400f77d0 2023-10-18T22:25:40.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.919+0000 7f2a455df700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a40108030 con 0x7f2a400f6530 2023-10-18T22:25:40.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.919+0000 7f2a3f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a400f77d0 0x7f2a40107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:40.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.919+0000 7f2a3f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a400f77d0 0x7f2a40107220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39286/0 (socket says 172.21.15.8:39286) 2023-10-18T22:25:40.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.920+0000 7f2a3f7fe700 1 -- 172.21.15.8:0/2348020230 learned_addr learned my addr 172.21.15.8:0/2348020230 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:40.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.920+0000 7f2a3ffff700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a400f6530 0x7f2a40106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:40.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.920+0000 7f2a3f7fe700 1 -- 172.21.15.8:0/2348020230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a400f6530 msgr2=0x7f2a40106d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:40.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.920+0000 7f2a3f7fe700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a400f6530 0x7f2a40106d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:40.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.920+0000 7f2a3f7fe700 1 -- 172.21.15.8:0/2348020230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34005040 con 0x7f2a400f77d0 2023-10-18T22:25:40.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.920+0000 7f2a3f7fe700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a400f77d0 0x7f2a40107220 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7f2a34009f50 tx=0x7f2a34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:40.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.920+0000 7f2a3cff9700 1 -- 172.21.15.8:0/2348020230 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a34018070 con 0x7f2a400f77d0 2023-10-18T22:25:40.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.920+0000 7f2a3cff9700 1 -- 172.21.15.8:0/2348020230 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2a34009630 con 0x7f2a400f77d0 2023-10-18T22:25:40.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.920+0000 7f2a455df700 1 -- 172.21.15.8:0/2348020230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a40108250 con 0x7f2a400f77d0 2023-10-18T22:25:40.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.920+0000 7f2a3cff9700 1 -- 172.21.15.8:0/2348020230 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a3401c3c0 con 0x7f2a400f77d0 2023-10-18T22:25:40.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.921+0000 7f2a455df700 1 -- 172.21.15.8:0/2348020230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a401087b0 con 0x7f2a400f77d0 2023-10-18T22:25:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.922+0000 7f2a455df700 1 -- 172.21.15.8:0/2348020230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a40059100 con 0x7f2a400f77d0 2023-10-18T22:25:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.922+0000 7f2a3cff9700 1 -- 172.21.15.8:0/2348020230 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2a3401d420 con 0x7f2a400f77d0 2023-10-18T22:25:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.924+0000 7f2a3cff9700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a28060f70 0x7f2a28063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:40.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.924+0000 7f2a3cff9700 1 -- 172.21.15.8:0/2348020230 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2a3407e5c0 con 0x7f2a400f77d0 2023-10-18T22:25:40.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.924+0000 7f2a3ffff700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a28060f70 0x7f2a28063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:40.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.924+0000 7f2a3ffff700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a28060f70 0x7f2a28063430 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f2a40106aa0 tx=0x7f2a30009c80).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:40.928+0000 7f2a3cff9700 1 -- 172.21.15.8:0/2348020230 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2a3404e310 con 0x7f2a400f77d0 2023-10-18T22:25:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.121+0000 7f2a455df700 1 -- 172.21.15.8:0/2348020230 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a400fee50 con 0x7f2a28060f70 2023-10-18T22:25:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.131+0000 7f2a3cff9700 1 -- 172.21.15.8:0/2348020230 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2a400fee50 con 0x7f2a28060f70 2023-10-18T22:25:41.133 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:25:41.134 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (92m) 9m ago 93m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:25:41.134 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (86m) 9m ago 93m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:25:41.134 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (86m) 7m ago 92m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:25:41.134 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (92m) 9m ago 93m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:25:41.134 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 89m - - 2023-10-18T22:25:41.135 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 89m - - 2023-10-18T22:25:41.135 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 89m - - 2023-10-18T22:25:41.135 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 89m - - 2023-10-18T22:25:41.135 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (87m) 9m ago 95m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:25:41.135 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (86m) 7m ago 92m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:25:41.136 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (86m) 9m ago 95m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:25:41.136 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (86m) 7m ago 92m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:25:41.136 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (93m) 9m ago 93m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:25:41.136 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (92m) 7m ago 92m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:25:41.136 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (85m) 9m ago 92m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:25:41.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (83m) 9m ago 92m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:25:41.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (83m) 9m ago 91m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:25:41.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (82m) 7m ago 91m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:25:41.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (82m) 7m ago 91m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:25:41.137 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (81m) 7m ago 90m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:25:41.138 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (87m) 9m ago 93m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:25:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.133+0000 7f2a455df700 1 -- 172.21.15.8:0/2348020230 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a28060f70 msgr2=0x7f2a28063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.133+0000 7f2a455df700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a28060f70 0x7f2a28063430 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f2a40106aa0 tx=0x7f2a30009c80).stop 2023-10-18T22:25:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.133+0000 7f2a455df700 1 -- 172.21.15.8:0/2348020230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a400f77d0 msgr2=0x7f2a40107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.133+0000 7f2a455df700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a400f77d0 0x7f2a40107220 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7f2a34009f50 tx=0x7f2a34009b30).stop 2023-10-18T22:25:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.133+0000 7f2a455df700 1 -- 172.21.15.8:0/2348020230 shutdown_connections 2023-10-18T22:25:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.133+0000 7f2a455df700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2a28060f70 0x7f2a28063430 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.133+0000 7f2a455df700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a400f6530 0x7f2a40106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.133+0000 7f2a455df700 1 --2- 172.21.15.8:0/2348020230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a400f77d0 0x7f2a40107220 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.133+0000 7f2a455df700 1 -- 172.21.15.8:0/2348020230 >> 172.21.15.8:0/2348020230 conn(0x7f2a400f1c70 msgr2=0x7f2a400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.134+0000 7f2a455df700 1 -- 172.21.15.8:0/2348020230 shutdown_connections 2023-10-18T22:25:41.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.134+0000 7f2a455df700 1 -- 172.21.15.8:0/2348020230 wait complete. 2023-10-18T22:25:41.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.270+0000 7f7be2eac700 1 -- 172.21.15.8:0/778970677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bdc0f6530 msgr2=0x7f7bdc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:41.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.270+0000 7f7be2eac700 1 --2- 172.21.15.8:0/778970677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bdc0f6530 0x7f7bdc0f6950 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f7bd8004660 tx=0x7f7bd8009b30).stop 2023-10-18T22:25:41.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.270+0000 7f7be2eac700 1 -- 172.21.15.8:0/778970677 shutdown_connections 2023-10-18T22:25:41.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.270+0000 7f7be2eac700 1 --2- 172.21.15.8:0/778970677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bdc0f77d0 0x7f7bdc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.270+0000 7f7be2eac700 1 --2- 172.21.15.8:0/778970677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bdc0f6530 0x7f7bdc0f6950 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.270+0000 7f7be2eac700 1 -- 172.21.15.8:0/778970677 >> 172.21.15.8:0/778970677 conn(0x7f7bdc0f1c90 msgr2=0x7f7bdc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:41.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.270+0000 7f7be2eac700 1 -- 172.21.15.8:0/778970677 shutdown_connections 2023-10-18T22:25:41.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.270+0000 7f7be2eac700 1 -- 172.21.15.8:0/778970677 wait complete. 2023-10-18T22:25:41.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.271+0000 7f7be2eac700 1 Processor -- start 2023-10-18T22:25:41.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.271+0000 7f7be2eac700 1 -- start start 2023-10-18T22:25:41.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.271+0000 7f7be2eac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bdc0f6530 0x7f7bdc106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:41.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.271+0000 7f7be2eac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bdc0f77d0 0x7f7bdc107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:41.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.271+0000 7f7be2eac700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc107900 con 0x7f7bdc0f6530 2023-10-18T22:25:41.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.272+0000 7f7be2eac700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc108110 con 0x7f7bdc0f77d0 2023-10-18T22:25:41.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.272+0000 7f7be1eaa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bdc0f6530 0x7f7bdc106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:41.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.272+0000 7f7be1eaa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bdc0f6530 0x7f7bdc106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39300/0 (socket says 172.21.15.8:39300) 2023-10-18T22:25:41.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.272+0000 7f7be1eaa700 1 -- 172.21.15.8:0/4002603544 learned_addr learned my addr 172.21.15.8:0/4002603544 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:41.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.272+0000 7f7be16a9700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bdc0f77d0 0x7f7bdc107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:41.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.272+0000 7f7be1eaa700 1 -- 172.21.15.8:0/4002603544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bdc0f77d0 msgr2=0x7f7bdc107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:41.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.272+0000 7f7be1eaa700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bdc0f77d0 0x7f7bdc107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.272+0000 7f7be1eaa700 1 -- 172.21.15.8:0/4002603544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd8005040 con 0x7f7bdc0f6530 2023-10-18T22:25:41.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.272+0000 7f7be16a9700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bdc0f77d0 0x7f7bdc107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:25:41.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.272+0000 7f7be1eaa700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bdc0f6530 0x7f7bdc106e10 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f7bd8007a60 tx=0x7f7bd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:41.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.273+0000 7f7bd27fc700 1 -- 172.21.15.8:0/4002603544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd8018070 con 0x7f7bdc0f6530 2023-10-18T22:25:41.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.273+0000 7f7bd27fc700 1 -- 172.21.15.8:0/4002603544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7bd8009630 con 0x7f7bdc0f6530 2023-10-18T22:25:41.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.273+0000 7f7be2eac700 1 -- 172.21.15.8:0/4002603544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc108330 con 0x7f7bdc0f6530 2023-10-18T22:25:41.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.273+0000 7f7bd27fc700 1 -- 172.21.15.8:0/4002603544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd801c540 con 0x7f7bdc0f6530 2023-10-18T22:25:41.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.273+0000 7f7be2eac700 1 -- 172.21.15.8:0/4002603544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc108890 con 0x7f7bdc0f6530 2023-10-18T22:25:41.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.274+0000 7f7be2eac700 1 -- 172.21.15.8:0/4002603544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc059100 con 0x7f7bdc0f6530 2023-10-18T22:25:41.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.275+0000 7f7bd27fc700 1 -- 172.21.15.8:0/4002603544 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7bd801c7b0 con 0x7f7bdc0f6530 2023-10-18T22:25:41.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.276+0000 7f7bd27fc700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7bc8060f70 0x7f7bc8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:41.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.276+0000 7f7bd27fc700 1 -- 172.21.15.8:0/4002603544 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7bd807e760 con 0x7f7bdc0f6530 2023-10-18T22:25:41.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.276+0000 7f7be16a9700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7bc8060f70 0x7f7bc8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:41.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.276+0000 7f7be16a9700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7bc8060f70 0x7f7bc8063430 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f7bcc009740 tx=0x7f7bcc009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:41.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.280+0000 7f7bd27fc700 1 -- 172.21.15.8:0/4002603544 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7bd804e310 con 0x7f7bdc0f6530 2023-10-18T22:25:41.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.538+0000 7f7be2eac700 1 -- 172.21.15.8:0/4002603544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7bdc0fecc0 con 0x7f7bdc0f6530 2023-10-18T22:25:41.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.539+0000 7f7bd27fc700 1 -- 172.21.15.8:0/4002603544 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f7bd8051930 con 0x7f7bdc0f6530 2023-10-18T22:25:41.542 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:25:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:25:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:25:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:25:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:25:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:25:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:25:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:25:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:25:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:25:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:25:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:25:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:25:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:25:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:25:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:25:41.545 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:25:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 -- 172.21.15.8:0/4002603544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7bc8060f70 msgr2=0x7f7bc8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:41.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7bc8060f70 0x7f7bc8063430 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f7bcc009740 tx=0x7f7bcc009be0).stop 2023-10-18T22:25:41.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 -- 172.21.15.8:0/4002603544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bdc0f6530 msgr2=0x7f7bdc106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:41.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bdc0f6530 0x7f7bdc106e10 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f7bd8007a60 tx=0x7f7bd8009b30).stop 2023-10-18T22:25:41.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 -- 172.21.15.8:0/4002603544 shutdown_connections 2023-10-18T22:25:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7bc8060f70 0x7f7bc8063430 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bdc0f6530 0x7f7bdc106e10 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 --2- 172.21.15.8:0/4002603544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bdc0f77d0 0x7f7bdc107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 -- 172.21.15.8:0/4002603544 >> 172.21.15.8:0/4002603544 conn(0x7f7bdc0f1c90 msgr2=0x7f7bdc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 -- 172.21.15.8:0/4002603544 shutdown_connections 2023-10-18T22:25:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.541+0000 7f7be2eac700 1 -- 172.21.15.8:0/4002603544 wait complete. 2023-10-18T22:25:41.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.678+0000 7fce4912d700 1 -- 172.21.15.8:0/1432143717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce440f6530 msgr2=0x7fce440f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:41.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.678+0000 7fce4912d700 1 --2- 172.21.15.8:0/1432143717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce440f6530 0x7fce440f6950 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7fce34004660 tx=0x7fce34009b30).stop 2023-10-18T22:25:41.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.678+0000 7fce4912d700 1 -- 172.21.15.8:0/1432143717 shutdown_connections 2023-10-18T22:25:41.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.678+0000 7fce4912d700 1 --2- 172.21.15.8:0/1432143717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce440f77d0 0x7fce440f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.678+0000 7fce4912d700 1 --2- 172.21.15.8:0/1432143717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce440f6530 0x7fce440f6950 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.678+0000 7fce4912d700 1 -- 172.21.15.8:0/1432143717 >> 172.21.15.8:0/1432143717 conn(0x7fce440f1c90 msgr2=0x7fce440f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:41.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.678+0000 7fce4912d700 1 -- 172.21.15.8:0/1432143717 shutdown_connections 2023-10-18T22:25:41.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.678+0000 7fce4912d700 1 -- 172.21.15.8:0/1432143717 wait complete. 2023-10-18T22:25:41.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.679+0000 7fce4912d700 1 Processor -- start 2023-10-18T22:25:41.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.679+0000 7fce4912d700 1 -- start start 2023-10-18T22:25:41.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.680+0000 7fce4912d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce440f6530 0x7fce44106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:41.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.680+0000 7fce4912d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce440f77d0 0x7fce44107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.680+0000 7fce4912d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44107910 con 0x7fce440f77d0 2023-10-18T22:25:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.680+0000 7fce4912d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44108120 con 0x7fce440f6530 2023-10-18T22:25:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.680+0000 7fce437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce440f77d0 0x7fce44107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.680+0000 7fce437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce440f77d0 0x7fce44107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39308/0 (socket says 172.21.15.8:39308) 2023-10-18T22:25:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.680+0000 7fce437fe700 1 -- 172.21.15.8:0/2962019162 learned_addr learned my addr 172.21.15.8:0/2962019162 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce43fff700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce440f6530 0x7fce44106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce437fe700 1 -- 172.21.15.8:0/2962019162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce440f6530 msgr2=0x7fce44106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce437fe700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce440f6530 0x7fce44106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce437fe700 1 -- 172.21.15.8:0/2962019162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34005040 con 0x7fce440f77d0 2023-10-18T22:25:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce43fff700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce440f6530 0x7fce44106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:25:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce437fe700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce440f77d0 0x7fce44107310 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7fce380026d0 tx=0x7fce38009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce40ff9700 1 -- 172.21.15.8:0/2962019162 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce38009320 con 0x7fce440f77d0 2023-10-18T22:25:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce40ff9700 1 -- 172.21.15.8:0/2962019162 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fce3800f040 con 0x7fce440f77d0 2023-10-18T22:25:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce4912d700 1 -- 172.21.15.8:0/2962019162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce441083a0 con 0x7fce440f77d0 2023-10-18T22:25:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce40ff9700 1 -- 172.21.15.8:0/2962019162 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce380148a0 con 0x7fce440f77d0 2023-10-18T22:25:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.681+0000 7fce4912d700 1 -- 172.21.15.8:0/2962019162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce44108960 con 0x7fce440f77d0 2023-10-18T22:25:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.682+0000 7fce4912d700 1 -- 172.21.15.8:0/2962019162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce44059100 con 0x7fce440f77d0 2023-10-18T22:25:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.683+0000 7fce40ff9700 1 -- 172.21.15.8:0/2962019162 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fce38009480 con 0x7fce440f77d0 2023-10-18T22:25:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.684+0000 7fce40ff9700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce2c060f70 0x7fce2c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.684+0000 7fce40ff9700 1 -- 172.21.15.8:0/2962019162 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fce3807cf60 con 0x7fce440f77d0 2023-10-18T22:25:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.685+0000 7fce43fff700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce2c060f70 0x7fce2c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.685+0000 7fce43fff700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce2c060f70 0x7fce2c063430 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fce34009d60 tx=0x7fce34009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:41.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.688+0000 7fce40ff9700 1 -- 172.21.15.8:0/2962019162 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fce3804cb90 con 0x7fce440f77d0 2023-10-18T22:25:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.913+0000 7fce4912d700 1 -- 172.21.15.8:0/2962019162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fce440fedf0 con 0x7fce440f77d0 2023-10-18T22:25:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.914+0000 7fce40ff9700 1 -- 172.21.15.8:0/2962019162 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fce380501b0 con 0x7fce440f77d0 2023-10-18T22:25:41.917 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:25:41.917 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:25:41.917 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:25:41.917 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:25:41.918 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:25:41.918 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:25:41.918 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:25:41.918 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:25:41.919 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:25:41.919 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:25:41.919 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:25:41.919 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:25:41.919 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:25:41.920 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:25:41.920 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:25:41.920 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:25:41.920 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:25:41.920 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:25:41.921 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:25:41.921 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:25:41.921 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:25:41.921 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:25:41.921 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:25:41.922 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:25:41.922 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:25:41.922 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:25:41.922 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:25:41.922 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:25:41.923 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:25:41.923 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:25:41.923 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:25:41.923 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:25:41.923 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:25:41.924 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:25:41.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 -- 172.21.15.8:0/2962019162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce2c060f70 msgr2=0x7fce2c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:41.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce2c060f70 0x7fce2c063430 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fce34009d60 tx=0x7fce34009b30).stop 2023-10-18T22:25:41.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 -- 172.21.15.8:0/2962019162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce440f77d0 msgr2=0x7fce44107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:41.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce440f77d0 0x7fce44107310 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7fce380026d0 tx=0x7fce38009de0).stop 2023-10-18T22:25:41.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 -- 172.21.15.8:0/2962019162 shutdown_connections 2023-10-18T22:25:41.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fce2c060f70 0x7fce2c063430 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce440f6530 0x7fce44106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 --2- 172.21.15.8:0/2962019162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce440f77d0 0x7fce44107310 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:41.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 -- 172.21.15.8:0/2962019162 >> 172.21.15.8:0/2962019162 conn(0x7fce440f1c90 msgr2=0x7fce440fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:41.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 -- 172.21.15.8:0/2962019162 shutdown_connections 2023-10-18T22:25:41.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:41.916+0000 7fce4912d700 1 -- 172.21.15.8:0/2962019162 wait complete. 2023-10-18T22:25:41.927 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:25:41.927 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:39.986954+0000 mgr.smithi008.flmjzp (mgr.14640) 5202 : cluster [DBG] pgmap v3568: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:41.927 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:40.431765+0000 mgr.smithi008.flmjzp (mgr.14640) 5203 : audit [DBG] from='client.38152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:39.986954+0000 mgr.smithi008.flmjzp (mgr.14640) 5202 : cluster [DBG] pgmap v3568: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:40.431765+0000 mgr.smithi008.flmjzp (mgr.14640) 5203 : audit [DBG] from='client.38152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.053+0000 7fead4b86700 1 -- 172.21.15.8:0/1976852704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead00f77d0 msgr2=0x7fead00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.053+0000 7fead4b86700 1 --2- 172.21.15.8:0/1976852704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead00f77d0 0x7fead00f7c30 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7feac4004660 tx=0x7feac4009b30).stop 2023-10-18T22:25:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.053+0000 7fead4b86700 1 -- 172.21.15.8:0/1976852704 shutdown_connections 2023-10-18T22:25:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.053+0000 7fead4b86700 1 --2- 172.21.15.8:0/1976852704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead00f77d0 0x7fead00f7c30 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.053+0000 7fead4b86700 1 --2- 172.21.15.8:0/1976852704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00f6530 0x7fead00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.053+0000 7fead4b86700 1 -- 172.21.15.8:0/1976852704 >> 172.21.15.8:0/1976852704 conn(0x7fead00f1c90 msgr2=0x7fead00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.053+0000 7fead4b86700 1 -- 172.21.15.8:0/1976852704 shutdown_connections 2023-10-18T22:25:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.053+0000 7fead4b86700 1 -- 172.21.15.8:0/1976852704 wait complete. 2023-10-18T22:25:42.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.054+0000 7fead4b86700 1 Processor -- start 2023-10-18T22:25:42.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.054+0000 7fead4b86700 1 -- start start 2023-10-18T22:25:42.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.054+0000 7fead4b86700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead00f6530 0x7fead0108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.054+0000 7fead4b86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00f77d0 0x7fead0109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.054+0000 7fead4b86700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead01099b0 con 0x7fead00f6530 2023-10-18T22:25:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.054+0000 7fead4b86700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead0109af0 con 0x7fead00f77d0 2023-10-18T22:25:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feacf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead00f6530 0x7fead0108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:42.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feacf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead00f6530 0x7fead0108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39326/0 (socket says 172.21.15.8:39326) 2023-10-18T22:25:42.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feacf7fe700 1 -- 172.21.15.8:0/104808794 learned_addr learned my addr 172.21.15.8:0/104808794 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:25:42.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feaceffd700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00f77d0 0x7fead0109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:42.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feacf7fe700 1 -- 172.21.15.8:0/104808794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00f77d0 msgr2=0x7fead0109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:42.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feacf7fe700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00f77d0 0x7fead0109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:42.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feacf7fe700 1 -- 172.21.15.8:0/104808794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4005040 con 0x7fead00f6530 2023-10-18T22:25:42.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feacf7fe700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead00f6530 0x7fead0108f10 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7feac0002700 tx=0x7feac0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:42.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feab7fff700 1 -- 172.21.15.8:0/104808794 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac00079c0 con 0x7fead00f6530 2023-10-18T22:25:42.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feab7fff700 1 -- 172.21.15.8:0/104808794 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7feac000f040 con 0x7fead00f6530 2023-10-18T22:25:42.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7fead4b86700 1 -- 172.21.15.8:0/104808794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead010a490 con 0x7fead00f6530 2023-10-18T22:25:42.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.055+0000 7feab7fff700 1 -- 172.21.15.8:0/104808794 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac00148d0 con 0x7fead00f6530 2023-10-18T22:25:42.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.056+0000 7fead4b86700 1 -- 172.21.15.8:0/104808794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead010aa50 con 0x7fead00f6530 2023-10-18T22:25:42.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.057+0000 7fead4b86700 1 -- 172.21.15.8:0/104808794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead0045ad0 con 0x7fead00f6530 2023-10-18T22:25:42.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.057+0000 7feab7fff700 1 -- 172.21.15.8:0/104808794 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7feac001b060 con 0x7fead00f6530 2023-10-18T22:25:42.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.058+0000 7feab7fff700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feab8060f70 0x7feab8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:25:42.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.058+0000 7feab7fff700 1 -- 172.21.15.8:0/104808794 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7feac007c710 con 0x7fead00f6530 2023-10-18T22:25:42.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.059+0000 7feaceffd700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feab8060f70 0x7feab8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:25:42.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.059+0000 7feaceffd700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feab8060f70 0x7feab8063430 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7feac4004630 tx=0x7feac4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:25:42.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.062+0000 7feab7fff700 1 -- 172.21.15.8:0/104808794 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7feac004fdb0 con 0x7fead00f6530 2023-10-18T22:25:42.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.260+0000 7fead4b86700 1 -- 172.21.15.8:0/104808794 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fead00fee40 con 0x7feab8060f70 2023-10-18T22:25:42.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.262+0000 7feab7fff700 1 -- 172.21.15.8:0/104808794 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fead00fee40 con 0x7feab8060f70 2023-10-18T22:25:42.264 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:25:42.264 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:25:42.265 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:25:42.265 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:25:42.265 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:25:42.265 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:25:42.265 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:25:42.266 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:25:42.266 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:25:42.266 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:25:42.266 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:25:42.266 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:25:42.267 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:25:42.267 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:25:42.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 -- 172.21.15.8:0/104808794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feab8060f70 msgr2=0x7feab8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:42.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feab8060f70 0x7feab8063430 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7feac4004630 tx=0x7feac4009b30).stop 2023-10-18T22:25:42.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 -- 172.21.15.8:0/104808794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead00f6530 msgr2=0x7fead0108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:25:42.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead00f6530 0x7fead0108f10 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7feac0002700 tx=0x7feac0009d80).stop 2023-10-18T22:25:42.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 -- 172.21.15.8:0/104808794 shutdown_connections 2023-10-18T22:25:42.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7feab8060f70 0x7feab8063430 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:42.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead00f6530 0x7fead0108f10 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:42.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 --2- 172.21.15.8:0/104808794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00f77d0 0x7fead0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:25:42.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 -- 172.21.15.8:0/104808794 >> 172.21.15.8:0/104808794 conn(0x7fead00f1c90 msgr2=0x7fead006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:25:42.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 -- 172.21.15.8:0/104808794 shutdown_connections 2023-10-18T22:25:42.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:25:42.264+0000 7fead4b86700 1 -- 172.21.15.8:0/104808794 wait complete. 2023-10-18T22:25:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:40.780046+0000 mgr.smithi008.flmjzp (mgr.14640) 5204 : audit [DBG] from='client.38156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:41.124150+0000 mgr.smithi008.flmjzp (mgr.14640) 5205 : audit [DBG] from='client.38160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:41.540385+0000 mon.smithi008 (mon.0) 5457 : audit [DBG] from='client.? 172.21.15.8:0/4002603544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:41.915629+0000 mon.smithi008 (mon.0) 5458 : audit [DBG] from='client.? 172.21.15.8:0/2962019162' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:25:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:40.780046+0000 mgr.smithi008.flmjzp (mgr.14640) 5204 : audit [DBG] from='client.38156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:41.124150+0000 mgr.smithi008.flmjzp (mgr.14640) 5205 : audit [DBG] from='client.38160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:41.540385+0000 mon.smithi008 (mon.0) 5457 : audit [DBG] from='client.? 172.21.15.8:0/4002603544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:41.915629+0000 mon.smithi008 (mon.0) 5458 : audit [DBG] from='client.? 172.21.15.8:0/2962019162' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:25:43.857 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:41.987408+0000 mgr.smithi008.flmjzp (mgr.14640) 5206 : cluster [DBG] pgmap v3569: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:43.857 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:42.263117+0000 mgr.smithi008.flmjzp (mgr.14640) 5207 : audit [DBG] from='client.38172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:41.987408+0000 mgr.smithi008.flmjzp (mgr.14640) 5206 : cluster [DBG] pgmap v3569: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:42.263117+0000 mgr.smithi008.flmjzp (mgr.14640) 5207 : audit [DBG] from='client.38172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:25:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:43.987965+0000 mgr.smithi008.flmjzp (mgr.14640) 5208 : cluster [DBG] pgmap v3570: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:43.987965+0000 mgr.smithi008.flmjzp (mgr.14640) 5208 : cluster [DBG] pgmap v3570: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:46.017302+0000 mon.smithi008 (mon.0) 5459 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:46.017302+0000 mon.smithi008 (mon.0) 5459 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:45.988575+0000 mgr.smithi008.flmjzp (mgr.14640) 5209 : cluster [DBG] pgmap v3571: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:46.583027+0000 mon.smithi008 (mon.0) 5460 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:46.584141+0000 mon.smithi008 (mon.0) 5461 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:46.590820+0000 mon.smithi008 (mon.0) 5462 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:46.597308+0000 mon.smithi008 (mon.0) 5463 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:46.600212+0000 mon.smithi008 (mon.0) 5464 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:46.601803+0000 mon.smithi008 (mon.0) 5465 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:46.603329+0000 mon.smithi008 (mon.0) 5466 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:46.605248+0000 mon.smithi008 (mon.0) 5467 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:45.988575+0000 mgr.smithi008.flmjzp (mgr.14640) 5209 : cluster [DBG] pgmap v3571: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:46.583027+0000 mon.smithi008 (mon.0) 5460 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:46.584141+0000 mon.smithi008 (mon.0) 5461 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:46.590820+0000 mon.smithi008 (mon.0) 5462 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:46.597308+0000 mon.smithi008 (mon.0) 5463 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:46.600212+0000 mon.smithi008 (mon.0) 5464 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:46.601803+0000 mon.smithi008 (mon.0) 5465 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:46.603329+0000 mon.smithi008 (mon.0) 5466 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:46.605248+0000 mon.smithi008 (mon.0) 5467 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:46.584973+0000 mgr.smithi008.flmjzp (mgr.14640) 5210 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:46.585656+0000 mgr.smithi008.flmjzp (mgr.14640) 5211 : cluster [DBG] pgmap v3572: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:46.585996+0000 mgr.smithi008.flmjzp (mgr.14640) 5212 : cluster [DBG] pgmap v3573: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:46.607126+0000 mgr.smithi008.flmjzp (mgr.14640) 5213 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:46.584973+0000 mgr.smithi008.flmjzp (mgr.14640) 5210 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:46.585656+0000 mgr.smithi008.flmjzp (mgr.14640) 5211 : cluster [DBG] pgmap v3572: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:46.585996+0000 mgr.smithi008.flmjzp (mgr.14640) 5212 : cluster [DBG] pgmap v3573: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:48.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:46.607126+0000 mgr.smithi008.flmjzp (mgr.14640) 5213 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:50.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:48.586675+0000 mgr.smithi008.flmjzp (mgr.14640) 5214 : cluster [DBG] pgmap v3574: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:48.586675+0000 mgr.smithi008.flmjzp (mgr.14640) 5214 : cluster [DBG] pgmap v3574: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:50.587152+0000 mgr.smithi008.flmjzp (mgr.14640) 5215 : cluster [DBG] pgmap v3575: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:50.587152+0000 mgr.smithi008.flmjzp (mgr.14640) 5215 : cluster [DBG] pgmap v3575: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:52.587695+0000 mgr.smithi008.flmjzp (mgr.14640) 5216 : cluster [DBG] pgmap v3576: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:54.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:52.587695+0000 mgr.smithi008.flmjzp (mgr.14640) 5216 : cluster [DBG] pgmap v3576: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:56.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:54.588262+0000 mgr.smithi008.flmjzp (mgr.14640) 5217 : cluster [DBG] pgmap v3577: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:56.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:54.588262+0000 mgr.smithi008.flmjzp (mgr.14640) 5217 : cluster [DBG] pgmap v3577: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:57.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:56.617768+0000 mon.smithi008 (mon.0) 5468 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:56.619835+0000 mon.smithi008 (mon.0) 5469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:56.620949+0000 mon.smithi008 (mon.0) 5470 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:56.627597+0000 mon.smithi008 (mon.0) 5471 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:56.634054+0000 mon.smithi008 (mon.0) 5472 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:57.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:56.637201+0000 mon.smithi008 (mon.0) 5473 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:56.639007+0000 mon.smithi008 (mon.0) 5474 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:56.640718+0000 mon.smithi008 (mon.0) 5475 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:57.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:25:56.642796+0000 mon.smithi008 (mon.0) 5476 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:56.617768+0000 mon.smithi008 (mon.0) 5468 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:56.619835+0000 mon.smithi008 (mon.0) 5469 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:25:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:56.620949+0000 mon.smithi008 (mon.0) 5470 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:25:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:56.627597+0000 mon.smithi008 (mon.0) 5471 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:25:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:56.634054+0000 mon.smithi008 (mon.0) 5472 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:25:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:56.637201+0000 mon.smithi008 (mon.0) 5473 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:56.639007+0000 mon.smithi008 (mon.0) 5474 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:56.640718+0000 mon.smithi008 (mon.0) 5475 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:57.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:25:56.642796+0000 mon.smithi008 (mon.0) 5476 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:25:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:56.588784+0000 mgr.smithi008.flmjzp (mgr.14640) 5218 : cluster [DBG] pgmap v3578: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:56.621943+0000 mgr.smithi008.flmjzp (mgr.14640) 5219 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:56.622542+0000 mgr.smithi008.flmjzp (mgr.14640) 5220 : cluster [DBG] pgmap v3579: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:56.622784+0000 mgr.smithi008.flmjzp (mgr.14640) 5221 : cluster [DBG] pgmap v3580: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:25:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:25:56.644789+0000 mgr.smithi008.flmjzp (mgr.14640) 5222 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:25:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:56.588784+0000 mgr.smithi008.flmjzp (mgr.14640) 5218 : cluster [DBG] pgmap v3578: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:56.621943+0000 mgr.smithi008.flmjzp (mgr.14640) 5219 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:25:58.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:56.622542+0000 mgr.smithi008.flmjzp (mgr.14640) 5220 : cluster [DBG] pgmap v3579: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:56.622784+0000 mgr.smithi008.flmjzp (mgr.14640) 5221 : cluster [DBG] pgmap v3580: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:25:58.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:25:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:25:56.644789+0000 mgr.smithi008.flmjzp (mgr.14640) 5222 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:25:58.623475+0000 mgr.smithi008.flmjzp (mgr.14640) 5223 : cluster [DBG] pgmap v3581: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:00.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:25:58.623475+0000 mgr.smithi008.flmjzp (mgr.14640) 5223 : cluster [DBG] pgmap v3581: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:00.624059+0000 mgr.smithi008.flmjzp (mgr.14640) 5224 : cluster [DBG] pgmap v3582: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:00.624059+0000 mgr.smithi008.flmjzp (mgr.14640) 5224 : cluster [DBG] pgmap v3582: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:02.624679+0000 mgr.smithi008.flmjzp (mgr.14640) 5225 : cluster [DBG] pgmap v3583: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:04.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:02.624679+0000 mgr.smithi008.flmjzp (mgr.14640) 5225 : cluster [DBG] pgmap v3583: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:06.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:04.625398+0000 mgr.smithi008.flmjzp (mgr.14640) 5226 : cluster [DBG] pgmap v3584: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:06.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:04.625398+0000 mgr.smithi008.flmjzp (mgr.14640) 5226 : cluster [DBG] pgmap v3584: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:06.655520+0000 mon.smithi008 (mon.0) 5477 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:07.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:06.657672+0000 mon.smithi008 (mon.0) 5478 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:26:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:06.658753+0000 mon.smithi008 (mon.0) 5479 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:26:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:06.665255+0000 mon.smithi008 (mon.0) 5480 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:06.671840+0000 mon.smithi008 (mon.0) 5481 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:06.674857+0000 mon.smithi008 (mon.0) 5482 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:07.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:06.676507+0000 mon.smithi008 (mon.0) 5483 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:06.678118+0000 mon.smithi008 (mon.0) 5484 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:07.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:06.680050+0000 mon.smithi008 (mon.0) 5485 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:06.655520+0000 mon.smithi008 (mon.0) 5477 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:06.657672+0000 mon.smithi008 (mon.0) 5478 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:26:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:06.658753+0000 mon.smithi008 (mon.0) 5479 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:26:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:06.665255+0000 mon.smithi008 (mon.0) 5480 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:06.671840+0000 mon.smithi008 (mon.0) 5481 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:06.674857+0000 mon.smithi008 (mon.0) 5482 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:06.676507+0000 mon.smithi008 (mon.0) 5483 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:06.678118+0000 mon.smithi008 (mon.0) 5484 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:06.680050+0000 mon.smithi008 (mon.0) 5485 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:06.625925+0000 mgr.smithi008.flmjzp (mgr.14640) 5227 : cluster [DBG] pgmap v3585: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:26:06.659716+0000 mgr.smithi008.flmjzp (mgr.14640) 5228 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:26:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:06.660293+0000 mgr.smithi008.flmjzp (mgr.14640) 5229 : cluster [DBG] pgmap v3586: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:06.660574+0000 mgr.smithi008.flmjzp (mgr.14640) 5230 : cluster [DBG] pgmap v3587: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:08.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:26:06.681938+0000 mgr.smithi008.flmjzp (mgr.14640) 5231 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:06.625925+0000 mgr.smithi008.flmjzp (mgr.14640) 5227 : cluster [DBG] pgmap v3585: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:26:06.659716+0000 mgr.smithi008.flmjzp (mgr.14640) 5228 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:26:08.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:06.660293+0000 mgr.smithi008.flmjzp (mgr.14640) 5229 : cluster [DBG] pgmap v3586: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:06.660574+0000 mgr.smithi008.flmjzp (mgr.14640) 5230 : cluster [DBG] pgmap v3587: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:08.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:26:06.681938+0000 mgr.smithi008.flmjzp (mgr.14640) 5231 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:08.661100+0000 mgr.smithi008.flmjzp (mgr.14640) 5232 : cluster [DBG] pgmap v3588: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:10.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:08.661100+0000 mgr.smithi008.flmjzp (mgr.14640) 5232 : cluster [DBG] pgmap v3588: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:12.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.417+0000 7fb4231e9700 1 -- 172.21.15.8:0/540973928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb41c0f6530 msgr2=0x7fb41c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:12.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.417+0000 7fb4231e9700 1 --2- 172.21.15.8:0/540973928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb41c0f6530 0x7fb41c0f6950 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7fb418004660 tx=0x7fb418009b30).stop 2023-10-18T22:26:12.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.417+0000 7fb4231e9700 1 -- 172.21.15.8:0/540973928 shutdown_connections 2023-10-18T22:26:12.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.417+0000 7fb4231e9700 1 --2- 172.21.15.8:0/540973928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0f77d0 0x7fb41c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:26:12.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.417+0000 7fb4231e9700 1 --2- 172.21.15.8:0/540973928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb41c0f6530 0x7fb41c0f6950 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.417+0000 7fb4231e9700 1 -- 172.21.15.8:0/540973928 >> 172.21.15.8:0/540973928 conn(0x7fb41c0f1c90 msgr2=0x7fb41c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.417+0000 7fb4231e9700 1 -- 172.21.15.8:0/540973928 shutdown_connections 2023-10-18T22:26:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.417+0000 7fb4231e9700 1 -- 172.21.15.8:0/540973928 wait complete. 2023-10-18T22:26:12.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.418+0000 7fb4231e9700 1 Processor -- start 2023-10-18T22:26:12.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.418+0000 7fb4231e9700 1 -- start start 2023-10-18T22:26:12.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4231e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb41c0f6530 0x7fb41c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:12.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4231e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0f77d0 0x7fb41c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:12.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4231e9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c06a410 con 0x7fb41c0f6530 2023-10-18T22:26:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4231e9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c06a550 con 0x7fb41c0f77d0 2023-10-18T22:26:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4221e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb41c0f6530 0x7fb41c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4221e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb41c0f6530 0x7fb41c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55590/0 (socket says 172.21.15.8:55590) 2023-10-18T22:26:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4221e7700 1 -- 172.21.15.8:0/2979689616 learned_addr learned my addr 172.21.15.8:0/2979689616 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4219e6700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0f77d0 0x7fb41c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:12.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4221e7700 1 -- 172.21.15.8:0/2979689616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0f77d0 msgr2=0x7fb41c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:12.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4221e7700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0f77d0 0x7fb41c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.419+0000 7fb4221e7700 1 -- 172.21.15.8:0/2979689616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb418005040 con 0x7fb41c0f6530 2023-10-18T22:26:12.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.420+0000 7fb4221e7700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb41c0f6530 0x7fb41c06b9a0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7fb418007a70 tx=0x7fb418009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:12.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.420+0000 7fb412ffd700 1 -- 172.21.15.8:0/2979689616 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb418018070 con 0x7fb41c0f6530 2023-10-18T22:26:12.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.420+0000 7fb412ffd700 1 -- 172.21.15.8:0/2979689616 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb41801d8e0 con 0x7fb41c0f6530 2023-10-18T22:26:12.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.420+0000 7fb4231e9700 1 -- 172.21.15.8:0/2979689616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41c06a7d0 con 0x7fb41c0f6530 2023-10-18T22:26:12.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.420+0000 7fb412ffd700 1 -- 172.21.15.8:0/2979689616 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb41801c660 con 0x7fb41c0f6530 2023-10-18T22:26:12.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.420+0000 7fb4231e9700 1 -- 172.21.15.8:0/2979689616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c10edf0 con 0x7fb41c0f6530 2023-10-18T22:26:12.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.421+0000 7fb4231e9700 1 -- 172.21.15.8:0/2979689616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41c045ad0 con 0x7fb41c0f6530 2023-10-18T22:26:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.422+0000 7fb412ffd700 1 -- 172.21.15.8:0/2979689616 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb41801da50 con 0x7fb41c0f6530 2023-10-18T22:26:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.423+0000 7fb412ffd700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb408060f70 0x7fb408063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.423+0000 7fb412ffd700 1 -- 172.21.15.8:0/2979689616 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb41807e800 con 0x7fb41c0f6530 2023-10-18T22:26:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.423+0000 7fb4219e6700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb408060f70 0x7fb408063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.424+0000 7fb4219e6700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb408060f70 0x7fb408063430 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7fb40c00b830 tx=0x7fb40c008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:12.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.428+0000 7fb412ffd700 1 -- 172.21.15.8:0/2979689616 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb41804e4f0 con 0x7fb41c0f6530 2023-10-18T22:26:12.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.628+0000 7fb4231e9700 1 -- 172.21.15.8:0/2979689616 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb41c0fedb0 con 0x7fb408060f70 2023-10-18T22:26:12.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.629+0000 7fb412ffd700 1 -- 172.21.15.8:0/2979689616 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb41c0fedb0 con 0x7fb408060f70 2023-10-18T22:26:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.631+0000 7fb4231e9700 1 -- 172.21.15.8:0/2979689616 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb408060f70 msgr2=0x7fb408063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.631+0000 7fb4231e9700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb408060f70 0x7fb408063430 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7fb40c00b830 tx=0x7fb40c008040).stop 2023-10-18T22:26:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.631+0000 7fb4231e9700 1 -- 172.21.15.8:0/2979689616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb41c0f6530 msgr2=0x7fb41c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.631+0000 7fb4231e9700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb41c0f6530 0x7fb41c06b9a0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7fb418007a70 tx=0x7fb418009b30).stop 2023-10-18T22:26:12.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.631+0000 7fb4231e9700 1 -- 172.21.15.8:0/2979689616 shutdown_connections 2023-10-18T22:26:12.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.631+0000 7fb4231e9700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb408060f70 0x7fb408063430 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.631+0000 7fb4231e9700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb41c0f6530 0x7fb41c06b9a0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.631+0000 7fb4231e9700 1 --2- 172.21.15.8:0/2979689616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0f77d0 0x7fb41c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.631+0000 7fb4231e9700 1 -- 172.21.15.8:0/2979689616 >> 172.21.15.8:0/2979689616 conn(0x7fb41c0f1c90 msgr2=0x7fb41c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:12.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.632+0000 7fb4231e9700 1 -- 172.21.15.8:0/2979689616 shutdown_connections 2023-10-18T22:26:12.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.632+0000 7fb4231e9700 1 -- 172.21.15.8:0/2979689616 wait complete. 2023-10-18T22:26:12.648 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:26:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:10.661781+0000 mgr.smithi008.flmjzp (mgr.14640) 5233 : cluster [DBG] pgmap v3589: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:12.736 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:10.661781+0000 mgr.smithi008.flmjzp (mgr.14640) 5233 : cluster [DBG] pgmap v3589: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:12.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.768+0000 7fa335096700 1 -- 172.21.15.8:0/1868824966 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa32c013a50 con 0x7fa3300f6530 2023-10-18T22:26:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.769+0000 7fa33709a700 1 -- 172.21.15.8:0/1868824966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3300f6530 msgr2=0x7fa3300f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.769+0000 7fa33709a700 1 --2- 172.21.15.8:0/1868824966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3300f6530 0x7fa3300f6950 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7fa32c004660 tx=0x7fa32c009b30).stop 2023-10-18T22:26:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.769+0000 7fa33709a700 1 -- 172.21.15.8:0/1868824966 shutdown_connections 2023-10-18T22:26:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.769+0000 7fa33709a700 1 --2- 172.21.15.8:0/1868824966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3300f77d0 0x7fa3300f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.769+0000 7fa33709a700 1 --2- 172.21.15.8:0/1868824966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3300f6530 0x7fa3300f6950 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.769+0000 7fa33709a700 1 -- 172.21.15.8:0/1868824966 >> 172.21.15.8:0/1868824966 conn(0x7fa3300f1c90 msgr2=0x7fa3300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.769+0000 7fa33709a700 1 -- 172.21.15.8:0/1868824966 shutdown_connections 2023-10-18T22:26:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.769+0000 7fa33709a700 1 -- 172.21.15.8:0/1868824966 wait complete. 2023-10-18T22:26:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.770+0000 7fa33709a700 1 Processor -- start 2023-10-18T22:26:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.770+0000 7fa33709a700 1 -- start start 2023-10-18T22:26:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa33709a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3300f6530 0x7fa33010d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa33709a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3300f77d0 0x7fa33010d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa33709a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33010dde0 con 0x7fa3300f77d0 2023-10-18T22:26:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa33709a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33010df20 con 0x7fa3300f6530 2023-10-18T22:26:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa335897700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3300f77d0 0x7fa33010d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa335897700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3300f77d0 0x7fa33010d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55618/0 (socket says 172.21.15.8:55618) 2023-10-18T22:26:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa335897700 1 -- 172.21.15.8:0/486345317 learned_addr learned my addr 172.21.15.8:0/486345317 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa336098700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3300f6530 0x7fa33010d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa335897700 1 -- 172.21.15.8:0/486345317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3300f6530 msgr2=0x7fa33010d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa335897700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3300f6530 0x7fa33010d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.771+0000 7fa335897700 1 -- 172.21.15.8:0/486345317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c005040 con 0x7fa3300f77d0 2023-10-18T22:26:12.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.772+0000 7fa335897700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3300f77d0 0x7fa33010d830 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7fa32000e7f0 tx=0x7fa32000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:12.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.772+0000 7fa326ffd700 1 -- 172.21.15.8:0/486345317 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3200092e0 con 0x7fa3300f77d0 2023-10-18T22:26:12.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.772+0000 7fa326ffd700 1 -- 172.21.15.8:0/486345317 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa32000f040 con 0x7fa3300f77d0 2023-10-18T22:26:12.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.772+0000 7fa326ffd700 1 -- 172.21.15.8:0/486345317 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3200147e0 con 0x7fa3300f77d0 2023-10-18T22:26:12.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.772+0000 7fa33709a700 1 -- 172.21.15.8:0/486345317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33010e8c0 con 0x7fa3300f77d0 2023-10-18T22:26:12.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.772+0000 7fa33709a700 1 -- 172.21.15.8:0/486345317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33010ee00 con 0x7fa3300f77d0 2023-10-18T22:26:12.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.773+0000 7fa33709a700 1 -- 172.21.15.8:0/486345317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa330045ad0 con 0x7fa3300f77d0 2023-10-18T22:26:12.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.774+0000 7fa326ffd700 1 -- 172.21.15.8:0/486345317 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa32001b030 con 0x7fa3300f77d0 2023-10-18T22:26:12.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.775+0000 7fa326ffd700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa31c060f70 0x7fa31c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:12.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.775+0000 7fa326ffd700 1 -- 172.21.15.8:0/486345317 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa32007c5f0 con 0x7fa3300f77d0 2023-10-18T22:26:12.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.775+0000 7fa336098700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa31c060f70 0x7fa31c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:12.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.776+0000 7fa336098700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa31c060f70 0x7fa31c063430 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7fa32c009720 tx=0x7fa32c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:12.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.779+0000 7fa326ffd700 1 -- 172.21.15.8:0/486345317 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa32004fd40 con 0x7fa3300f77d0 2023-10-18T22:26:12.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.977+0000 7fa33709a700 1 -- 172.21.15.8:0/486345317 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3300fc230 con 0x7fa31c060f70 2023-10-18T22:26:12.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.979+0000 7fa326ffd700 1 -- 172.21.15.8:0/486345317 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa3300fc230 con 0x7fa31c060f70 2023-10-18T22:26:12.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.980+0000 7fa33709a700 1 -- 172.21.15.8:0/486345317 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa31c060f70 msgr2=0x7fa31c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:12.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.980+0000 7fa33709a700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa31c060f70 0x7fa31c063430 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7fa32c009720 tx=0x7fa32c016040).stop 2023-10-18T22:26:12.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.981+0000 7fa33709a700 1 -- 172.21.15.8:0/486345317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3300f77d0 msgr2=0x7fa33010d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:12.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.981+0000 7fa33709a700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3300f77d0 0x7fa33010d830 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7fa32000e7f0 tx=0x7fa32000b040).stop 2023-10-18T22:26:12.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.981+0000 7fa33709a700 1 -- 172.21.15.8:0/486345317 shutdown_connections 2023-10-18T22:26:12.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.981+0000 7fa33709a700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa31c060f70 0x7fa31c063430 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.981+0000 7fa33709a700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3300f6530 0x7fa33010d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.981+0000 7fa33709a700 1 --2- 172.21.15.8:0/486345317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3300f77d0 0x7fa33010d830 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:12.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.981+0000 7fa33709a700 1 -- 172.21.15.8:0/486345317 >> 172.21.15.8:0/486345317 conn(0x7fa3300f1c90 msgr2=0x7fa3300f3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:12.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.981+0000 7fa33709a700 1 -- 172.21.15.8:0/486345317 shutdown_connections 2023-10-18T22:26:12.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:12.981+0000 7fa33709a700 1 -- 172.21.15.8:0/486345317 wait complete. 2023-10-18T22:26:13.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.116+0000 7f2ad6765700 1 -- 172.21.15.8:0/3870039811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad00f77d0 msgr2=0x7f2ad00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:13.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.116+0000 7f2ad6765700 1 --2- 172.21.15.8:0/3870039811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad00f77d0 0x7f2ad00f7c30 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7f2ac0004660 tx=0x7f2ac0009b30).stop 2023-10-18T22:26:13.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.116+0000 7f2ad6765700 1 -- 172.21.15.8:0/3870039811 shutdown_connections 2023-10-18T22:26:13.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.116+0000 7f2ad6765700 1 --2- 172.21.15.8:0/3870039811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad00f77d0 0x7f2ad00f7c30 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.116+0000 7f2ad6765700 1 --2- 172.21.15.8:0/3870039811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad00f6530 0x7f2ad00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.116+0000 7f2ad6765700 1 -- 172.21.15.8:0/3870039811 >> 172.21.15.8:0/3870039811 conn(0x7f2ad00f1c90 msgr2=0x7f2ad00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:13.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.117+0000 7f2ad6765700 1 -- 172.21.15.8:0/3870039811 shutdown_connections 2023-10-18T22:26:13.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.117+0000 7f2ad6765700 1 -- 172.21.15.8:0/3870039811 wait complete. 2023-10-18T22:26:13.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad6765700 1 Processor -- start 2023-10-18T22:26:13.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad6765700 1 -- start start 2023-10-18T22:26:13.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad6765700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad00f6530 0x7f2ad0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:13.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad6765700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad00f77d0 0x7f2ad0107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:13.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad6765700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0107850 con 0x7f2ad00f77d0 2023-10-18T22:26:13.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad6765700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0108060 con 0x7f2ad00f6530 2023-10-18T22:26:13.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad4f62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad00f77d0 0x7f2ad0107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:13.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad4f62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad00f77d0 0x7f2ad0107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55638/0 (socket says 172.21.15.8:55638) 2023-10-18T22:26:13.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad4f62700 1 -- 172.21.15.8:0/447912146 learned_addr learned my addr 172.21.15.8:0/447912146 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:13.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad5763700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad00f6530 0x7f2ad0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:13.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad4f62700 1 -- 172.21.15.8:0/447912146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad00f6530 msgr2=0x7f2ad0106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:13.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad4f62700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad00f6530 0x7f2ad0106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad4f62700 1 -- 172.21.15.8:0/447912146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0005040 con 0x7f2ad00f77d0 2023-10-18T22:26:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.119+0000 7f2ad4f62700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad00f77d0 0x7f2ad0107250 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 rx=0x7f2ac0004320 tx=0x7f2ac000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.120+0000 7f2ac5ffb700 1 -- 172.21.15.8:0/447912146 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac0019070 con 0x7f2ad00f77d0 2023-10-18T22:26:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.120+0000 7f2ac5ffb700 1 -- 172.21.15.8:0/447912146 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2ac001e420 con 0x7f2ad00f77d0 2023-10-18T22:26:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.120+0000 7f2ad6765700 1 -- 172.21.15.8:0/447912146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad0108280 con 0x7f2ad00f77d0 2023-10-18T22:26:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.120+0000 7f2ac5ffb700 1 -- 172.21.15.8:0/447912146 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac0014680 con 0x7f2ad00f77d0 2023-10-18T22:26:13.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.120+0000 7f2ad6765700 1 -- 172.21.15.8:0/447912146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad0108760 con 0x7f2ad00f77d0 2023-10-18T22:26:13.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.121+0000 7f2ad6765700 1 -- 172.21.15.8:0/447912146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad0059100 con 0x7f2ad00f77d0 2023-10-18T22:26:13.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.122+0000 7f2ac5ffb700 1 -- 172.21.15.8:0/447912146 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f2ac001e590 con 0x7f2ad00f77d0 2023-10-18T22:26:13.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.124+0000 7f2ac5ffb700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 0x7f2abc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:13.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.124+0000 7f2ac5ffb700 1 -- 172.21.15.8:0/447912146 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f2ac007dd10 con 0x7f2ad00f77d0 2023-10-18T22:26:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.124+0000 7f2ad5763700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 0x7f2abc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.124+0000 7f2ad5763700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 0x7f2abc063430 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f2ad0106ad0 tx=0x7f2acc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.128+0000 7f2ac5ffb700 1 -- 172.21.15.8:0/447912146 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f2ac004d8e0 con 0x7f2ad00f77d0 2023-10-18T22:26:13.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.321+0000 7f2ad6765700 1 -- 172.21.15.8:0/447912146 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ad00fedb0 con 0x7f2abc060f70 2023-10-18T22:26:13.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.331+0000 7f2ac5ffb700 1 -- 172.21.15.8:0/447912146 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2ad00fedb0 con 0x7f2abc060f70 2023-10-18T22:26:13.333 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:26:13.334 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (92m) 9m ago 94m 17.3M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:26:13.334 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (86m) 9m ago 94m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:26:13.334 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (86m) 7m ago 93m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:26:13.334 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (92m) 9m ago 94m 28.7M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:26:13.335 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 9m ago 90m - - 2023-10-18T22:26:13.335 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 9m ago 90m - - 2023-10-18T22:26:13.335 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 7m ago 90m - - 2023-10-18T22:26:13.335 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 7m ago 90m - - 2023-10-18T22:26:13.335 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (88m) 9m ago 95m 550M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:26:13.336 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (87m) 7m ago 93m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:26:13.336 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (87m) 9m ago 95m 618M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:26:13.336 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (87m) 7m ago 93m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:26:13.336 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (93m) 9m ago 93m 10.6M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:26:13.336 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (93m) 7m ago 93m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:26:13.337 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (86m) 9m ago 92m 591M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:26:13.337 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (84m) 9m ago 92m 483M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:26:13.337 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (83m) 9m ago 92m 379M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:26:13.337 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (83m) 7m ago 92m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:26:13.337 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (82m) 7m ago 91m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:26:13.338 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (82m) 7m ago 91m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:26:13.338 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (88m) 9m ago 93m 82.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:26:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 -- 172.21.15.8:0/447912146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 msgr2=0x7f2abc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 0x7f2abc063430 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f2ad0106ad0 tx=0x7f2acc00b040).stop 2023-10-18T22:26:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 -- 172.21.15.8:0/447912146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad00f77d0 msgr2=0x7f2ad0107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad00f77d0 0x7f2ad0107250 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 rx=0x7f2ac0004320 tx=0x7f2ac000b040).stop 2023-10-18T22:26:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 -- 172.21.15.8:0/447912146 shutdown_connections 2023-10-18T22:26:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f2abc060f70 0x7f2abc063430 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ad00f6530 0x7f2ad0106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 --2- 172.21.15.8:0/447912146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ad00f77d0 0x7f2ad0107250 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 -- 172.21.15.8:0/447912146 >> 172.21.15.8:0/447912146 conn(0x7f2ad00f1c90 msgr2=0x7f2ad00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 -- 172.21.15.8:0/447912146 shutdown_connections 2023-10-18T22:26:13.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.334+0000 7f2ad6765700 1 -- 172.21.15.8:0/447912146 wait complete. 2023-10-18T22:26:13.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.470+0000 7fbdcffff700 1 -- 172.21.15.8:0/213622761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdd00f77d0 msgr2=0x7fbdd00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:13.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.470+0000 7fbdcffff700 1 --2- 172.21.15.8:0/213622761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdd00f77d0 0x7fbdd00f7c30 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fbdc4004660 tx=0x7fbdc4009b30).stop 2023-10-18T22:26:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.471+0000 7fbdcffff700 1 -- 172.21.15.8:0/213622761 shutdown_connections 2023-10-18T22:26:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.471+0000 7fbdcffff700 1 --2- 172.21.15.8:0/213622761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdd00f77d0 0x7fbdd00f7c30 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.471+0000 7fbdcffff700 1 --2- 172.21.15.8:0/213622761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdd00f6530 0x7fbdd00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.471+0000 7fbdcffff700 1 -- 172.21.15.8:0/213622761 >> 172.21.15.8:0/213622761 conn(0x7fbdd00f1c90 msgr2=0x7fbdd00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:13.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.471+0000 7fbdcffff700 1 -- 172.21.15.8:0/213622761 shutdown_connections 2023-10-18T22:26:13.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.471+0000 7fbdcffff700 1 -- 172.21.15.8:0/213622761 wait complete. 2023-10-18T22:26:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.471+0000 7fbdcffff700 1 Processor -- start 2023-10-18T22:26:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.472+0000 7fbdcffff700 1 -- start start 2023-10-18T22:26:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.472+0000 7fbdcffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdd00f6530 0x7fbdd0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.472+0000 7fbdcffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdd00f77d0 0x7fbdd0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:13.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.472+0000 7fbdcffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0107880 con 0x7fbdd00f6530 2023-10-18T22:26:13.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.472+0000 7fbdcffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd01080c0 con 0x7fbdd00f77d0 2023-10-18T22:26:13.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.472+0000 7fbdceffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdd00f6530 0x7fbdd0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:13.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.472+0000 7fbdceffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdd00f6530 0x7fbdd0106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55656/0 (socket says 172.21.15.8:55656) 2023-10-18T22:26:13.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.472+0000 7fbdceffd700 1 -- 172.21.15.8:0/1283216748 learned_addr learned my addr 172.21.15.8:0/1283216748 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:13.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.472+0000 7fbdce7fc700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdd00f77d0 0x7fbdd0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:13.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.473+0000 7fbdceffd700 1 -- 172.21.15.8:0/1283216748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdd00f77d0 msgr2=0x7fbdd0107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:13.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.473+0000 7fbdceffd700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdd00f77d0 0x7fbdd0107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.473+0000 7fbdceffd700 1 -- 172.21.15.8:0/1283216748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4005040 con 0x7fbdd00f6530 2023-10-18T22:26:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.473+0000 7fbdceffd700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdd00f6530 0x7fbdd0106d90 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7fbdc000c790 tx=0x7fbdc0007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.473+0000 7fbdb77fe700 1 -- 172.21.15.8:0/1283216748 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdc0013630 con 0x7fbdd00f6530 2023-10-18T22:26:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.473+0000 7fbdcffff700 1 -- 172.21.15.8:0/1283216748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd01083a0 con 0x7fbdd00f6530 2023-10-18T22:26:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.473+0000 7fbdb77fe700 1 -- 172.21.15.8:0/1283216748 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbdc0012870 con 0x7fbdd00f6530 2023-10-18T22:26:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.473+0000 7fbdb77fe700 1 -- 172.21.15.8:0/1283216748 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdc0002830 con 0x7fbdd00f6530 2023-10-18T22:26:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.473+0000 7fbdcffff700 1 -- 172.21.15.8:0/1283216748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd01088e0 con 0x7fbdd00f6530 2023-10-18T22:26:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.474+0000 7fbdcffff700 1 -- 172.21.15.8:0/1283216748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd0059100 con 0x7fbdd00f6530 2023-10-18T22:26:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.475+0000 7fbdb77fe700 1 -- 172.21.15.8:0/1283216748 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fbdc0010070 con 0x7fbdd00f6530 2023-10-18T22:26:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.476+0000 7fbdb77fe700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdb8060f70 0x7fbdb8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.476+0000 7fbdb77fe700 1 -- 172.21.15.8:0/1283216748 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fbdc007c9c0 con 0x7fbdd00f6530 2023-10-18T22:26:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.476+0000 7fbdce7fc700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdb8060f70 0x7fbdb8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.477+0000 7fbdce7fc700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdb8060f70 0x7fbdb8063430 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fbdc4004630 tx=0x7fbdc4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.480+0000 7fbdb77fe700 1 -- 172.21.15.8:0/1283216748 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fbdc004c590 con 0x7fbdd00f6530 2023-10-18T22:26:13.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.731+0000 7fbdcffff700 1 -- 172.21.15.8:0/1283216748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbdd00fed60 con 0x7fbdd00f6530 2023-10-18T22:26:13.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.732+0000 7fbdb77fe700 1 -- 172.21.15.8:0/1283216748 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fbdc004fbb0 con 0x7fbdd00f6530 2023-10-18T22:26:13.734 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:26:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:26:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:26:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:26:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:26:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:26:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:26:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:26:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:26:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:26:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:26:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:26:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:26:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:26:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:26:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:26:13.737 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:26:13.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.734+0000 7fbdcffff700 1 -- 172.21.15.8:0/1283216748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdb8060f70 msgr2=0x7fbdb8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:13.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.734+0000 7fbdcffff700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdb8060f70 0x7fbdb8063430 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fbdc4004630 tx=0x7fbdc4009b30).stop 2023-10-18T22:26:13.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.734+0000 7fbdcffff700 1 -- 172.21.15.8:0/1283216748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdd00f6530 msgr2=0x7fbdd0106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:13.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.734+0000 7fbdcffff700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdd00f6530 0x7fbdd0106d90 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7fbdc000c790 tx=0x7fbdc0007d90).stop 2023-10-18T22:26:13.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.734+0000 7fbdcffff700 1 -- 172.21.15.8:0/1283216748 shutdown_connections 2023-10-18T22:26:13.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.734+0000 7fbdcffff700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fbdb8060f70 0x7fbdb8063430 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.734+0000 7fbdcffff700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdd00f6530 0x7fbdd0106d90 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.734+0000 7fbdcffff700 1 --2- 172.21.15.8:0/1283216748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdd00f77d0 0x7fbdd0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.734+0000 7fbdcffff700 1 -- 172.21.15.8:0/1283216748 >> 172.21.15.8:0/1283216748 conn(0x7fbdd00f1c90 msgr2=0x7fbdd00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:13.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.734+0000 7fbdcffff700 1 -- 172.21.15.8:0/1283216748 shutdown_connections 2023-10-18T22:26:13.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.735+0000 7fbdcffff700 1 -- 172.21.15.8:0/1283216748 wait complete. 2023-10-18T22:26:13.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.871+0000 7faab15f3700 1 -- 172.21.15.8:0/956342754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaac0f6530 msgr2=0x7faaac0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:13.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.871+0000 7faab15f3700 1 --2- 172.21.15.8:0/956342754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaac0f6530 0x7faaac0f6950 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7faa9c004660 tx=0x7faa9c009b30).stop 2023-10-18T22:26:13.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.871+0000 7faab15f3700 1 -- 172.21.15.8:0/956342754 shutdown_connections 2023-10-18T22:26:13.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.871+0000 7faab15f3700 1 --2- 172.21.15.8:0/956342754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaac0f77d0 0x7faaac0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.871+0000 7faab15f3700 1 --2- 172.21.15.8:0/956342754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaac0f6530 0x7faaac0f6950 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.871+0000 7faab15f3700 1 -- 172.21.15.8:0/956342754 >> 172.21.15.8:0/956342754 conn(0x7faaac0f1c90 msgr2=0x7faaac0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:13.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.871+0000 7faab15f3700 1 -- 172.21.15.8:0/956342754 shutdown_connections 2023-10-18T22:26:13.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.871+0000 7faab15f3700 1 -- 172.21.15.8:0/956342754 wait complete. 2023-10-18T22:26:13.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.872+0000 7faab15f3700 1 Processor -- start 2023-10-18T22:26:13.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.872+0000 7faab15f3700 1 -- start start 2023-10-18T22:26:13.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faab15f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaac0f6530 0x7faaac06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:13.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faab15f3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaac0f77d0 0x7faaac069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faab15f3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac06a380 con 0x7faaac0f6530 2023-10-18T22:26:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faab15f3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac06a4c0 con 0x7faaac0f77d0 2023-10-18T22:26:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faaabfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaac0f6530 0x7faaac06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faaabfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaac0f6530 0x7faaac06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55684/0 (socket says 172.21.15.8:55684) 2023-10-18T22:26:13.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faaabfff700 1 -- 172.21.15.8:0/1008080446 learned_addr learned my addr 172.21.15.8:0/1008080446 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:13.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faaab7fe700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaac0f77d0 0x7faaac069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:13.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faaabfff700 1 -- 172.21.15.8:0/1008080446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaac0f77d0 msgr2=0x7faaac069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:13.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faaabfff700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaac0f77d0 0x7faaac069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:13.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.873+0000 7faaabfff700 1 -- 172.21.15.8:0/1008080446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c005040 con 0x7faaac0f6530 2023-10-18T22:26:13.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.874+0000 7faaabfff700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaac0f6530 0x7faaac06b9a0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7faa9c007a60 tx=0x7faa9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:13.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.874+0000 7faaa8ff9700 1 -- 172.21.15.8:0/1008080446 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9c018070 con 0x7faaac0f6530 2023-10-18T22:26:13.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.874+0000 7faaa8ff9700 1 -- 172.21.15.8:0/1008080446 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faa9c009630 con 0x7faaac0f6530 2023-10-18T22:26:13.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.874+0000 7faab15f3700 1 -- 172.21.15.8:0/1008080446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac06a740 con 0x7faaac0f6530 2023-10-18T22:26:13.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.874+0000 7faaa8ff9700 1 -- 172.21.15.8:0/1008080446 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9c01c4d0 con 0x7faaac0f6530 2023-10-18T22:26:13.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.874+0000 7faab15f3700 1 -- 172.21.15.8:0/1008080446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac06aca0 con 0x7faaac0f6530 2023-10-18T22:26:13.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.875+0000 7faab15f3700 1 -- 172.21.15.8:0/1008080446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac045ad0 con 0x7faaac0f6530 2023-10-18T22:26:13.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.876+0000 7faaa8ff9700 1 -- 172.21.15.8:0/1008080446 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faa9c01d420 con 0x7faaac0f6530 2023-10-18T22:26:13.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.877+0000 7faaa8ff9700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa94060f70 0x7faa94063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:13.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.877+0000 7faaa8ff9700 1 -- 172.21.15.8:0/1008080446 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faa9c07e650 con 0x7faaac0f6530 2023-10-18T22:26:13.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.877+0000 7faaab7fe700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa94060f70 0x7faa94063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:13.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.878+0000 7faaab7fe700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa94060f70 0x7faa94063430 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7faaa0004e20 tx=0x7faaa000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:13.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:13.881+0000 7faaa8ff9700 1 -- 172.21.15.8:0/1008080446 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faa9c04e270 con 0x7faaac0f6530 2023-10-18T22:26:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.107+0000 7faab15f3700 1 -- 172.21.15.8:0/1008080446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faaac0586e0 con 0x7faaac0f6530 2023-10-18T22:26:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.107+0000 7faaa8ff9700 1 -- 172.21.15.8:0/1008080446 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7faa9c051890 con 0x7faaac0f6530 2023-10-18T22:26:14.109 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:26:14.109 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:26:14.109 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:26:14.110 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:26:14.110 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:26:14.110 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:26:14.110 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:26:14.110 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:26:14.111 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:26:14.111 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:26:14.111 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:26:14.111 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:26:14.111 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:26:14.111 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:26:14.112 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:26:14.112 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:26:14.112 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:26:14.112 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:26:14.112 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:26:14.113 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:26:14.113 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:26:14.113 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:26:14.113 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:26:14.113 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:26:14.114 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:26:14.114 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:26:14.114 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:26:14.114 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:26:14.114 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:26:14.115 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:26:14.115 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:26:14.115 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:26:14.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:26:14.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:26:14.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 -- 172.21.15.8:0/1008080446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa94060f70 msgr2=0x7faa94063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:14.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa94060f70 0x7faa94063430 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7faaa0004e20 tx=0x7faaa000b040).stop 2023-10-18T22:26:14.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 -- 172.21.15.8:0/1008080446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaac0f6530 msgr2=0x7faaac06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:14.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaac0f6530 0x7faaac06b9a0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7faa9c007a60 tx=0x7faa9c009b30).stop 2023-10-18T22:26:14.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 -- 172.21.15.8:0/1008080446 shutdown_connections 2023-10-18T22:26:14.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa94060f70 0x7faa94063430 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:14.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaac0f6530 0x7faaac06b9a0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:14.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 --2- 172.21.15.8:0/1008080446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaac0f77d0 0x7faaac069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:14.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 -- 172.21.15.8:0/1008080446 >> 172.21.15.8:0/1008080446 conn(0x7faaac0f1c90 msgr2=0x7faaac0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:14.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 -- 172.21.15.8:0/1008080446 shutdown_connections 2023-10-18T22:26:14.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.109+0000 7faab15f3700 1 -- 172.21.15.8:0/1008080446 wait complete. 2023-10-18T22:26:14.119 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:26:14.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.247+0000 7fe3d7fff700 1 -- 172.21.15.8:0/2931724112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3d80f5440 msgr2=0x7fe3d80f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:14.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.247+0000 7fe3d7fff700 1 --2- 172.21.15.8:0/2931724112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3d80f5440 0x7fe3d80f5860 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7fe3c8004660 tx=0x7fe3c8009b30).stop 2023-10-18T22:26:14.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.247+0000 7fe3d7fff700 1 -- 172.21.15.8:0/2931724112 shutdown_connections 2023-10-18T22:26:14.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.247+0000 7fe3d7fff700 1 --2- 172.21.15.8:0/2931724112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d80f66e0 0x7fe3d80f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:14.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.247+0000 7fe3d7fff700 1 --2- 172.21.15.8:0/2931724112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3d80f5440 0x7fe3d80f5860 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:14.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.247+0000 7fe3d7fff700 1 -- 172.21.15.8:0/2931724112 >> 172.21.15.8:0/2931724112 conn(0x7fe3d80f0ba0 msgr2=0x7fe3d80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:14.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.247+0000 7fe3d7fff700 1 -- 172.21.15.8:0/2931724112 shutdown_connections 2023-10-18T22:26:14.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.247+0000 7fe3d7fff700 1 -- 172.21.15.8:0/2931724112 wait complete. 2023-10-18T22:26:14.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.248+0000 7fe3d7fff700 1 Processor -- start 2023-10-18T22:26:14.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.248+0000 7fe3d7fff700 1 -- start start 2023-10-18T22:26:14.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.248+0000 7fe3d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3d80f5440 0x7fe3d8106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:14.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.248+0000 7fe3d7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d80f66e0 0x7fe3d81072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.248+0000 7fe3d7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d81078b0 con 0x7fe3d80f5440 2023-10-18T22:26:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.248+0000 7fe3d7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d81080f0 con 0x7fe3d80f66e0 2023-10-18T22:26:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.249+0000 7fe3d6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3d80f5440 0x7fe3d8106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.249+0000 7fe3d6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3d80f5440 0x7fe3d8106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55704/0 (socket says 172.21.15.8:55704) 2023-10-18T22:26:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.249+0000 7fe3d6ffd700 1 -- 172.21.15.8:0/1553698051 learned_addr learned my addr 172.21.15.8:0/1553698051 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:14.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.249+0000 7fe3d67fc700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d80f66e0 0x7fe3d81072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:14.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.249+0000 7fe3d6ffd700 1 -- 172.21.15.8:0/1553698051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d80f66e0 msgr2=0x7fe3d81072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:14.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.249+0000 7fe3d6ffd700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d80f66e0 0x7fe3d81072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:14.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.249+0000 7fe3d6ffd700 1 -- 172.21.15.8:0/1553698051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8005040 con 0x7fe3d80f5440 2023-10-18T22:26:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.249+0000 7fe3d6ffd700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3d80f5440 0x7fe3d8106dc0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7fe3c8014040 tx=0x7fe3c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.249+0000 7fe3bf7fe700 1 -- 172.21.15.8:0/1553698051 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c8019070 con 0x7fe3d80f5440 2023-10-18T22:26:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.250+0000 7fe3bf7fe700 1 -- 172.21.15.8:0/1553698051 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe3c801e420 con 0x7fe3d80f5440 2023-10-18T22:26:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.250+0000 7fe3bf7fe700 1 -- 172.21.15.8:0/1553698051 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c8014620 con 0x7fe3d80f5440 2023-10-18T22:26:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.250+0000 7fe3d7fff700 1 -- 172.21.15.8:0/1553698051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d8108370 con 0x7fe3d80f5440 2023-10-18T22:26:14.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.250+0000 7fe3d7fff700 1 -- 172.21.15.8:0/1553698051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d8108850 con 0x7fe3d80f5440 2023-10-18T22:26:14.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.251+0000 7fe3d7fff700 1 -- 172.21.15.8:0/1553698051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d8059100 con 0x7fe3d80f5440 2023-10-18T22:26:14.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.252+0000 7fe3bf7fe700 1 -- 172.21.15.8:0/1553698051 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe3c801e9e0 con 0x7fe3d80f5440 2023-10-18T22:26:14.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.253+0000 7fe3bf7fe700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe3c0060f70 0x7fe3c0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:14.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.253+0000 7fe3bf7fe700 1 -- 172.21.15.8:0/1553698051 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe3c807dcc0 con 0x7fe3d80f5440 2023-10-18T22:26:14.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.254+0000 7fe3d67fc700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe3c0060f70 0x7fe3c0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:14.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.255+0000 7fe3d67fc700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe3c0060f70 0x7fe3c0063430 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fe3d8106b50 tx=0x7fe3cc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:14.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.258+0000 7fe3bf7fe700 1 -- 172.21.15.8:0/1553698051 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe3c8083020 con 0x7fe3d80f5440 2023-10-18T22:26:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.460+0000 7fe3d7fff700 1 -- 172.21.15.8:0/1553698051 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3d80fab20 con 0x7fe3c0060f70 2023-10-18T22:26:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.461+0000 7fe3bf7fe700 1 -- 172.21.15.8:0/1553698051 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe3d80fab20 con 0x7fe3c0060f70 2023-10-18T22:26:14.463 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:26:14.463 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:26:14.463 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:26:14.463 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:26:14.463 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:26:14.463 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:26:14.464 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:26:14.464 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:26:14.464 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:26:14.464 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:26:14.464 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:26:14.465 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:26:14.465 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:26:14.465 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:26:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.463+0000 7fe3d7fff700 1 -- 172.21.15.8:0/1553698051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe3c0060f70 msgr2=0x7fe3c0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.463+0000 7fe3d7fff700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe3c0060f70 0x7fe3c0063430 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fe3d8106b50 tx=0x7fe3cc00b040).stop 2023-10-18T22:26:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.463+0000 7fe3d7fff700 1 -- 172.21.15.8:0/1553698051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3d80f5440 msgr2=0x7fe3d8106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.463+0000 7fe3d7fff700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3d80f5440 0x7fe3d8106dc0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7fe3c8014040 tx=0x7fe3c800b040).stop 2023-10-18T22:26:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.463+0000 7fe3d7fff700 1 -- 172.21.15.8:0/1553698051 shutdown_connections 2023-10-18T22:26:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.463+0000 7fe3d7fff700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe3c0060f70 0x7fe3c0063430 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.463+0000 7fe3d7fff700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3d80f5440 0x7fe3d8106dc0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.463+0000 7fe3d7fff700 1 --2- 172.21.15.8:0/1553698051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d80f66e0 0x7fe3d81072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:14.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.463+0000 7fe3d7fff700 1 -- 172.21.15.8:0/1553698051 >> 172.21.15.8:0/1553698051 conn(0x7fe3d80f0ba0 msgr2=0x7fe3d805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:14.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.464+0000 7fe3d7fff700 1 -- 172.21.15.8:0/1553698051 shutdown_connections 2023-10-18T22:26:14.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:14.464+0000 7fe3d7fff700 1 -- 172.21.15.8:0/1553698051 wait complete. 2023-10-18T22:26:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:12.630723+0000 mgr.smithi008.flmjzp (mgr.14640) 5234 : audit [DBG] from='client.38176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:12.662217+0000 mgr.smithi008.flmjzp (mgr.14640) 5235 : cluster [DBG] pgmap v3590: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:12.980109+0000 mgr.smithi008.flmjzp (mgr.14640) 5236 : audit [DBG] from='client.38180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:13.324012+0000 mgr.smithi008.flmjzp (mgr.14640) 5237 : audit [DBG] from='client.38184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:13.732707+0000 mon.smithi008 (mon.0) 5486 : audit [DBG] from='client.? 172.21.15.8:0/1283216748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:14.107822+0000 mon.smithi008 (mon.0) 5487 : audit [DBG] from='client.? 172.21.15.8:0/1008080446' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:26:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:12.630723+0000 mgr.smithi008.flmjzp (mgr.14640) 5234 : audit [DBG] from='client.38176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:12.662217+0000 mgr.smithi008.flmjzp (mgr.14640) 5235 : cluster [DBG] pgmap v3590: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:12.980109+0000 mgr.smithi008.flmjzp (mgr.14640) 5236 : audit [DBG] from='client.38180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:13.324012+0000 mgr.smithi008.flmjzp (mgr.14640) 5237 : audit [DBG] from='client.38184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:13.732707+0000 mon.smithi008 (mon.0) 5486 : audit [DBG] from='client.? 172.21.15.8:0/1283216748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:14.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:14.107822+0000 mon.smithi008 (mon.0) 5487 : audit [DBG] from='client.? 172.21.15.8:0/1008080446' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:26:15.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:14.461488+0000 mgr.smithi008.flmjzp (mgr.14640) 5238 : audit [DBG] from='client.38196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:15.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:14.461488+0000 mgr.smithi008.flmjzp (mgr.14640) 5238 : audit [DBG] from='client.38196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:14.662834+0000 mgr.smithi008.flmjzp (mgr.14640) 5239 : cluster [DBG] pgmap v3591: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:14.662834+0000 mgr.smithi008.flmjzp (mgr.14640) 5239 : cluster [DBG] pgmap v3591: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:16.692653+0000 mon.smithi008 (mon.0) 5488 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:16.692653+0000 mon.smithi008 (mon.0) 5488 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:18.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:16.663435+0000 mgr.smithi008.flmjzp (mgr.14640) 5240 : cluster [DBG] pgmap v3592: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:18.830 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:16.663435+0000 mgr.smithi008.flmjzp (mgr.14640) 5240 : cluster [DBG] pgmap v3592: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:20.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:18.663879+0000 mgr.smithi008.flmjzp (mgr.14640) 5241 : cluster [DBG] pgmap v3593: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:18.663879+0000 mgr.smithi008.flmjzp (mgr.14640) 5241 : cluster [DBG] pgmap v3593: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:22.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:20.664344+0000 mgr.smithi008.flmjzp (mgr.14640) 5242 : cluster [DBG] pgmap v3594: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:22.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:21.046992+0000 mon.smithi008 (mon.0) 5489 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:22.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:21.047855+0000 mon.smithi008 (mon.0) 5490 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:26:22.315 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:21.048609+0000 mon.smithi008 (mon.0) 5491 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:26:22.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:26:21.049233+0000 mgr.smithi008.flmjzp (mgr.14640) 5243 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:26:22.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:21.049785+0000 mgr.smithi008.flmjzp (mgr.14640) 5244 : cluster [DBG] pgmap v3595: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:22.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:21.050068+0000 mgr.smithi008.flmjzp (mgr.14640) 5245 : cluster [DBG] pgmap v3596: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:22.316 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:21.053329+0000 mon.smithi008 (mon.0) 5492 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:22.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:21.058375+0000 mon.smithi008 (mon.0) 5493 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:22.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:21.060725+0000 mon.smithi008 (mon.0) 5494 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:22.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:21.061938+0000 mon.smithi008 (mon.0) 5495 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:22.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:21.063180+0000 mon.smithi008 (mon.0) 5496 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:22.317 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:21.064733+0000 mon.smithi008 (mon.0) 5497 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:22.318 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:26:21.066286+0000 mgr.smithi008.flmjzp (mgr.14640) 5246 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:22.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:20.664344+0000 mgr.smithi008.flmjzp (mgr.14640) 5242 : cluster [DBG] pgmap v3594: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:22.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:21.046992+0000 mon.smithi008 (mon.0) 5489 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:22.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:21.047855+0000 mon.smithi008 (mon.0) 5490 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:26:22.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:21.048609+0000 mon.smithi008 (mon.0) 5491 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:26:22.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:26:21.049233+0000 mgr.smithi008.flmjzp (mgr.14640) 5243 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:26:22.489 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:21.049785+0000 mgr.smithi008.flmjzp (mgr.14640) 5244 : cluster [DBG] pgmap v3595: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:22.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:21.050068+0000 mgr.smithi008.flmjzp (mgr.14640) 5245 : cluster [DBG] pgmap v3596: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:22.490 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:21.053329+0000 mon.smithi008 (mon.0) 5492 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:22.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:21.058375+0000 mon.smithi008 (mon.0) 5493 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:22.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:21.060725+0000 mon.smithi008 (mon.0) 5494 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:22.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:21.061938+0000 mon.smithi008 (mon.0) 5495 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:22.491 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:21.063180+0000 mon.smithi008 (mon.0) 5496 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:22.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:21.064733+0000 mon.smithi008 (mon.0) 5497 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:22.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:26:21.066286+0000 mgr.smithi008.flmjzp (mgr.14640) 5246 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:24.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:23.050717+0000 mgr.smithi008.flmjzp (mgr.14640) 5247 : cluster [DBG] pgmap v3597: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:24.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:23.050717+0000 mgr.smithi008.flmjzp (mgr.14640) 5247 : cluster [DBG] pgmap v3597: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:26.420 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:25.051438+0000 mgr.smithi008.flmjzp (mgr.14640) 5248 : cluster [DBG] pgmap v3598: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:26.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:25.051438+0000 mgr.smithi008.flmjzp (mgr.14640) 5248 : cluster [DBG] pgmap v3598: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:27.051955+0000 mgr.smithi008.flmjzp (mgr.14640) 5249 : cluster [DBG] pgmap v3599: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:27.051955+0000 mgr.smithi008.flmjzp (mgr.14640) 5249 : cluster [DBG] pgmap v3599: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:29.052529+0000 mgr.smithi008.flmjzp (mgr.14640) 5250 : cluster [DBG] pgmap v3600: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:30.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:29.052529+0000 mgr.smithi008.flmjzp (mgr.14640) 5250 : cluster [DBG] pgmap v3600: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:31.076949+0000 mon.smithi008 (mon.0) 5498 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:31.076949+0000 mon.smithi008 (mon.0) 5498 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:31.053108+0000 mgr.smithi008.flmjzp (mgr.14640) 5251 : cluster [DBG] pgmap v3601: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:31.641780+0000 mon.smithi008 (mon.0) 5499 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:26:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:31.642610+0000 mon.smithi008 (mon.0) 5500 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:26:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:31.647835+0000 mon.smithi008 (mon.0) 5501 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:31.652691+0000 mon.smithi008 (mon.0) 5502 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:31.654982+0000 mon.smithi008 (mon.0) 5503 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:31.656208+0000 mon.smithi008 (mon.0) 5504 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:31.657402+0000 mon.smithi008 (mon.0) 5505 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:31.658916+0000 mon.smithi008 (mon.0) 5506 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:31.053108+0000 mgr.smithi008.flmjzp (mgr.14640) 5251 : cluster [DBG] pgmap v3601: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:31.641780+0000 mon.smithi008 (mon.0) 5499 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:26:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:31.642610+0000 mon.smithi008 (mon.0) 5500 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:26:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:31.647835+0000 mon.smithi008 (mon.0) 5501 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:31.652691+0000 mon.smithi008 (mon.0) 5502 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:32.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:31.654982+0000 mon.smithi008 (mon.0) 5503 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:32.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:31.656208+0000 mon.smithi008 (mon.0) 5504 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:32.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:31.657402+0000 mon.smithi008 (mon.0) 5505 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:32.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:31.658916+0000 mon.smithi008 (mon.0) 5506 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:33.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:26:31.643270+0000 mgr.smithi008.flmjzp (mgr.14640) 5252 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:26:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:31.643825+0000 mgr.smithi008.flmjzp (mgr.14640) 5253 : cluster [DBG] pgmap v3602: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:31.644139+0000 mgr.smithi008.flmjzp (mgr.14640) 5254 : cluster [DBG] pgmap v3603: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:33.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:26:31.660935+0000 mgr.smithi008.flmjzp (mgr.14640) 5255 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:26:31.643270+0000 mgr.smithi008.flmjzp (mgr.14640) 5252 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:26:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:31.643825+0000 mgr.smithi008.flmjzp (mgr.14640) 5253 : cluster [DBG] pgmap v3602: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:31.644139+0000 mgr.smithi008.flmjzp (mgr.14640) 5254 : cluster [DBG] pgmap v3603: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:26:31.660935+0000 mgr.smithi008.flmjzp (mgr.14640) 5255 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:33.644744+0000 mgr.smithi008.flmjzp (mgr.14640) 5256 : cluster [DBG] pgmap v3604: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:33.644744+0000 mgr.smithi008.flmjzp (mgr.14640) 5256 : cluster [DBG] pgmap v3604: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:35.645469+0000 mgr.smithi008.flmjzp (mgr.14640) 5257 : cluster [DBG] pgmap v3605: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:35.645469+0000 mgr.smithi008.flmjzp (mgr.14640) 5257 : cluster [DBG] pgmap v3605: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:39.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:37.645915+0000 mgr.smithi008.flmjzp (mgr.14640) 5258 : cluster [DBG] pgmap v3606: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:37.645915+0000 mgr.smithi008.flmjzp (mgr.14640) 5258 : cluster [DBG] pgmap v3606: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:41.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:39.646494+0000 mgr.smithi008.flmjzp (mgr.14640) 5259 : cluster [DBG] pgmap v3607: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:39.646494+0000 mgr.smithi008.flmjzp (mgr.14640) 5259 : cluster [DBG] pgmap v3607: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:41.671309+0000 mon.smithi008 (mon.0) 5507 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:41.673394+0000 mon.smithi008 (mon.0) 5508 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:26:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:41.674435+0000 mon.smithi008 (mon.0) 5509 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:26:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:41.681033+0000 mon.smithi008 (mon.0) 5510 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:41.687777+0000 mon.smithi008 (mon.0) 5511 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:41.690984+0000 mon.smithi008 (mon.0) 5512 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:41.692665+0000 mon.smithi008 (mon.0) 5513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:41.694342+0000 mon.smithi008 (mon.0) 5514 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:41.696388+0000 mon.smithi008 (mon.0) 5515 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:41.671309+0000 mon.smithi008 (mon.0) 5507 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:41.673394+0000 mon.smithi008 (mon.0) 5508 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:26:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:41.674435+0000 mon.smithi008 (mon.0) 5509 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:26:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:41.681033+0000 mon.smithi008 (mon.0) 5510 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:41.687777+0000 mon.smithi008 (mon.0) 5511 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:41.690984+0000 mon.smithi008 (mon.0) 5512 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:41.692665+0000 mon.smithi008 (mon.0) 5513 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:42.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:41.694342+0000 mon.smithi008 (mon.0) 5514 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:42.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:41.696388+0000 mon.smithi008 (mon.0) 5515 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:41.647082+0000 mgr.smithi008.flmjzp (mgr.14640) 5260 : cluster [DBG] pgmap v3608: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:26:41.675339+0000 mgr.smithi008.flmjzp (mgr.14640) 5261 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:26:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:41.675952+0000 mgr.smithi008.flmjzp (mgr.14640) 5262 : cluster [DBG] pgmap v3609: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:41.676222+0000 mgr.smithi008.flmjzp (mgr.14640) 5263 : cluster [DBG] pgmap v3610: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:26:41.698295+0000 mgr.smithi008.flmjzp (mgr.14640) 5264 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:43.859 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:41.647082+0000 mgr.smithi008.flmjzp (mgr.14640) 5260 : cluster [DBG] pgmap v3608: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:43.859 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:26:41.675339+0000 mgr.smithi008.flmjzp (mgr.14640) 5261 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:26:43.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:41.675952+0000 mgr.smithi008.flmjzp (mgr.14640) 5262 : cluster [DBG] pgmap v3609: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:43.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:41.676222+0000 mgr.smithi008.flmjzp (mgr.14640) 5263 : cluster [DBG] pgmap v3610: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:43.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:26:41.698295+0000 mgr.smithi008.flmjzp (mgr.14640) 5264 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:44.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.617+0000 7f082952d700 1 -- 172.21.15.8:0/1206339418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08240f77d0 msgr2=0x7f08240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.617+0000 7f082952d700 1 --2- 172.21.15.8:0/1206339418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08240f77d0 0x7f08240f7c30 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7f0818004660 tx=0x7f0818009b30).stop 2023-10-18T22:26:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.617+0000 7f082952d700 1 -- 172.21.15.8:0/1206339418 shutdown_connections 2023-10-18T22:26:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.617+0000 7f082952d700 1 --2- 172.21.15.8:0/1206339418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08240f77d0 0x7f08240f7c30 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.617+0000 7f082952d700 1 --2- 172.21.15.8:0/1206339418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08240f6530 0x7f08240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.617+0000 7f082952d700 1 -- 172.21.15.8:0/1206339418 >> 172.21.15.8:0/1206339418 conn(0x7f08240f1c90 msgr2=0x7f08240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:44.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.617+0000 7f082952d700 1 -- 172.21.15.8:0/1206339418 shutdown_connections 2023-10-18T22:26:44.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.617+0000 7f082952d700 1 -- 172.21.15.8:0/1206339418 wait complete. 2023-10-18T22:26:44.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.618+0000 7f082952d700 1 Processor -- start 2023-10-18T22:26:44.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.618+0000 7f082952d700 1 -- start start 2023-10-18T22:26:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.618+0000 7f082952d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08240f6530 0x7f082406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.618+0000 7f082952d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08240f77d0 0x7f0824069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.618+0000 7f082952d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082406a380 con 0x7f08240f77d0 2023-10-18T22:26:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.618+0000 7f082952d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082406a4c0 con 0x7f08240f6530 2023-10-18T22:26:44.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.619+0000 7f08237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08240f77d0 0x7f0824069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:44.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.619+0000 7f08237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08240f77d0 0x7f0824069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46764/0 (socket says 172.21.15.8:46764) 2023-10-18T22:26:44.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.619+0000 7f08237fe700 1 -- 172.21.15.8:0/2272908818 learned_addr learned my addr 172.21.15.8:0/2272908818 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:44.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.619+0000 7f0823fff700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08240f6530 0x7f082406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:44.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.619+0000 7f08237fe700 1 -- 172.21.15.8:0/2272908818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08240f6530 msgr2=0x7f082406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:44.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.619+0000 7f08237fe700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08240f6530 0x7f082406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:44.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.619+0000 7f08237fe700 1 -- 172.21.15.8:0/2272908818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818005040 con 0x7f08240f77d0 2023-10-18T22:26:44.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.619+0000 7f08237fe700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08240f77d0 0x7f0824069e20 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f0818009990 tx=0x7f0818009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:44.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.620+0000 7f0820ff9700 1 -- 172.21.15.8:0/2272908818 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0818018070 con 0x7f08240f77d0 2023-10-18T22:26:44.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.620+0000 7f0820ff9700 1 -- 172.21.15.8:0/2272908818 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0818009630 con 0x7f08240f77d0 2023-10-18T22:26:44.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.620+0000 7f082952d700 1 -- 172.21.15.8:0/2272908818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082406a740 con 0x7f08240f77d0 2023-10-18T22:26:44.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.620+0000 7f0820ff9700 1 -- 172.21.15.8:0/2272908818 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f081801c3c0 con 0x7f08240f77d0 2023-10-18T22:26:44.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.620+0000 7f082952d700 1 -- 172.21.15.8:0/2272908818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082406aca0 con 0x7f08240f77d0 2023-10-18T22:26:44.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.621+0000 7f082952d700 1 -- 172.21.15.8:0/2272908818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0824045ad0 con 0x7f08240f77d0 2023-10-18T22:26:44.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.622+0000 7f0820ff9700 1 -- 172.21.15.8:0/2272908818 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f081801d970 con 0x7f08240f77d0 2023-10-18T22:26:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.622+0000 7f0820ff9700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f080c060f70 0x7f080c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.623+0000 7f0820ff9700 1 -- 172.21.15.8:0/2272908818 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f081807e4e0 con 0x7f08240f77d0 2023-10-18T22:26:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.623+0000 7f0823fff700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f080c060f70 0x7f080c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.623+0000 7f0823fff700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f080c060f70 0x7f080c063430 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f082406b730 tx=0x7f081400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.627+0000 7f0820ff9700 1 -- 172.21.15.8:0/2272908818 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f081804e1d0 con 0x7f08240f77d0 2023-10-18T22:26:44.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.825+0000 7f082952d700 1 -- 172.21.15.8:0/2272908818 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f08240fedd0 con 0x7f080c060f70 2023-10-18T22:26:44.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.827+0000 7f0820ff9700 1 -- 172.21.15.8:0/2272908818 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f08240fedd0 con 0x7f080c060f70 2023-10-18T22:26:44.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 -- 172.21.15.8:0/2272908818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f080c060f70 msgr2=0x7f080c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:44.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f080c060f70 0x7f080c063430 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f082406b730 tx=0x7f081400b040).stop 2023-10-18T22:26:44.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 -- 172.21.15.8:0/2272908818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08240f77d0 msgr2=0x7f0824069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:44.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08240f77d0 0x7f0824069e20 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f0818009990 tx=0x7f0818009b30).stop 2023-10-18T22:26:44.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 -- 172.21.15.8:0/2272908818 shutdown_connections 2023-10-18T22:26:44.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f080c060f70 0x7f080c063430 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:44.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08240f6530 0x7f082406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:44.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 --2- 172.21.15.8:0/2272908818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08240f77d0 0x7f0824069e20 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:44.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 -- 172.21.15.8:0/2272908818 >> 172.21.15.8:0/2272908818 conn(0x7f08240f1c90 msgr2=0x7f08240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:44.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 -- 172.21.15.8:0/2272908818 shutdown_connections 2023-10-18T22:26:44.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.829+0000 7f082952d700 1 -- 172.21.15.8:0/2272908818 wait complete. 2023-10-18T22:26:44.845 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:26:44.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.967+0000 7fa96d8f2700 1 -- 172.21.15.8:0/1579453790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9680f6530 msgr2=0x7fa9680f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:44.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.967+0000 7fa96d8f2700 1 --2- 172.21.15.8:0/1579453790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9680f6530 0x7fa9680f6950 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7fa95c004660 tx=0x7fa95c009b30).stop 2023-10-18T22:26:44.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.967+0000 7fa96d8f2700 1 -- 172.21.15.8:0/1579453790 shutdown_connections 2023-10-18T22:26:44.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.967+0000 7fa96d8f2700 1 --2- 172.21.15.8:0/1579453790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9680f77d0 0x7fa9680f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:44.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.967+0000 7fa96d8f2700 1 --2- 172.21.15.8:0/1579453790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9680f6530 0x7fa9680f6950 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:44.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.967+0000 7fa96d8f2700 1 -- 172.21.15.8:0/1579453790 >> 172.21.15.8:0/1579453790 conn(0x7fa9680f1c90 msgr2=0x7fa9680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:44.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.967+0000 7fa96d8f2700 1 -- 172.21.15.8:0/1579453790 shutdown_connections 2023-10-18T22:26:44.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.968+0000 7fa96d8f2700 1 -- 172.21.15.8:0/1579453790 wait complete. 2023-10-18T22:26:44.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.968+0000 7fa96d8f2700 1 Processor -- start 2023-10-18T22:26:44.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.968+0000 7fa96d8f2700 1 -- start start 2023-10-18T22:26:44.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.969+0000 7fa96d8f2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9680f6530 0x7fa968108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:44.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.969+0000 7fa96d8f2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9680f77d0 0x7fa968109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:44.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.969+0000 7fa96d8f2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968109a00 con 0x7fa9680f6530 2023-10-18T22:26:44.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.969+0000 7fa96d8f2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968109b40 con 0x7fa9680f77d0 2023-10-18T22:26:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.969+0000 7fa96c8f0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9680f6530 0x7fa968108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.969+0000 7fa96c8f0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9680f6530 0x7fa968108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46784/0 (socket says 172.21.15.8:46784) 2023-10-18T22:26:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.969+0000 7fa96c8f0700 1 -- 172.21.15.8:0/706657691 learned_addr learned my addr 172.21.15.8:0/706657691 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.969+0000 7fa967fff700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9680f77d0 0x7fa968109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:44.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.970+0000 7fa96c8f0700 1 -- 172.21.15.8:0/706657691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9680f77d0 msgr2=0x7fa968109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:44.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.970+0000 7fa96c8f0700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9680f77d0 0x7fa968109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:44.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.970+0000 7fa96c8f0700 1 -- 172.21.15.8:0/706657691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c005040 con 0x7fa9680f6530 2023-10-18T22:26:44.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.970+0000 7fa96c8f0700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9680f6530 0x7fa968108f60 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7fa95c009870 tx=0x7fa95c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:44.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.970+0000 7fa9657fa700 1 -- 172.21.15.8:0/706657691 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa95c019070 con 0x7fa9680f6530 2023-10-18T22:26:44.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.970+0000 7fa9657fa700 1 -- 172.21.15.8:0/706657691 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa95c013380 con 0x7fa9680f6530 2023-10-18T22:26:44.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.970+0000 7fa96d8f2700 1 -- 172.21.15.8:0/706657691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96810a480 con 0x7fa9680f6530 2023-10-18T22:26:44.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.970+0000 7fa9657fa700 1 -- 172.21.15.8:0/706657691 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa95c01edf0 con 0x7fa9680f6530 2023-10-18T22:26:44.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.970+0000 7fa96d8f2700 1 -- 172.21.15.8:0/706657691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96810a960 con 0x7fa9680f6530 2023-10-18T22:26:44.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.971+0000 7fa96d8f2700 1 -- 172.21.15.8:0/706657691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa968045ad0 con 0x7fa9680f6530 2023-10-18T22:26:44.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.972+0000 7fa9657fa700 1 -- 172.21.15.8:0/706657691 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa95c01e420 con 0x7fa9680f6530 2023-10-18T22:26:44.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.973+0000 7fa9657fa700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa958060f70 0x7fa958063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.973+0000 7fa9657fa700 1 -- 172.21.15.8:0/706657691 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa95c07ddb0 con 0x7fa9680f6530 2023-10-18T22:26:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.973+0000 7fa967fff700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa958060f70 0x7fa958063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:44.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.974+0000 7fa967fff700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa958060f70 0x7fa958063430 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fa954009fd0 tx=0x7fa95400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:44.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:44.977+0000 7fa9657fa700 1 -- 172.21.15.8:0/706657691 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa95c051390 con 0x7fa9680f6530 2023-10-18T22:26:45.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.179+0000 7fa96d8f2700 1 -- 172.21.15.8:0/706657691 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9680fed30 con 0x7fa958060f70 2023-10-18T22:26:45.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.180+0000 7fa9657fa700 1 -- 172.21.15.8:0/706657691 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa9680fed30 con 0x7fa958060f70 2023-10-18T22:26:45.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 -- 172.21.15.8:0/706657691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa958060f70 msgr2=0x7fa958063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:45.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa958060f70 0x7fa958063430 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fa954009fd0 tx=0x7fa95400b040).stop 2023-10-18T22:26:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 -- 172.21.15.8:0/706657691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9680f6530 msgr2=0x7fa968108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9680f6530 0x7fa968108f60 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7fa95c009870 tx=0x7fa95c00b040).stop 2023-10-18T22:26:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 -- 172.21.15.8:0/706657691 shutdown_connections 2023-10-18T22:26:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa958060f70 0x7fa958063430 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9680f6530 0x7fa968108f60 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 --2- 172.21.15.8:0/706657691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9680f77d0 0x7fa968109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 -- 172.21.15.8:0/706657691 >> 172.21.15.8:0/706657691 conn(0x7fa9680f1c90 msgr2=0x7fa96806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:45.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 -- 172.21.15.8:0/706657691 shutdown_connections 2023-10-18T22:26:45.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.182+0000 7fa96d8f2700 1 -- 172.21.15.8:0/706657691 wait complete. 2023-10-18T22:26:45.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.319+0000 7f75adb9d700 1 -- 172.21.15.8:0/1990978394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75a806b9c0 msgr2=0x7f75a8069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:45.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.319+0000 7f75adb9d700 1 --2- 172.21.15.8:0/1990978394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75a806b9c0 0x7f75a8069ec0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f759c004660 tx=0x7f759c009b30).stop 2023-10-18T22:26:45.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.319+0000 7f75adb9d700 1 -- 172.21.15.8:0/1990978394 shutdown_connections 2023-10-18T22:26:45.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.319+0000 7f75adb9d700 1 --2- 172.21.15.8:0/1990978394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a806a3b0 0x7f75a806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.319+0000 7f75adb9d700 1 --2- 172.21.15.8:0/1990978394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75a806b9c0 0x7f75a8069ec0 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.319+0000 7f75adb9d700 1 -- 172.21.15.8:0/1990978394 >> 172.21.15.8:0/1990978394 conn(0x7f75a80f1c90 msgr2=0x7f75a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:45.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.319+0000 7f75adb9d700 1 -- 172.21.15.8:0/1990978394 shutdown_connections 2023-10-18T22:26:45.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.319+0000 7f75adb9d700 1 -- 172.21.15.8:0/1990978394 wait complete. 2023-10-18T22:26:45.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.320+0000 7f75adb9d700 1 Processor -- start 2023-10-18T22:26:45.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.320+0000 7f75adb9d700 1 -- start start 2023-10-18T22:26:45.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75adb9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a806a3b0 0x7f75a8108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:45.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75adb9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75a806b9c0 0x7f75a8109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:45.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75adb9d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a81099e0 con 0x7f75a806b9c0 2023-10-18T22:26:45.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75adb9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8109b20 con 0x7f75a806a3b0 2023-10-18T22:26:45.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75a806b9c0 0x7f75a8109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:45.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75a806b9c0 0x7f75a8109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46796/0 (socket says 172.21.15.8:46796) 2023-10-18T22:26:45.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75a7fff700 1 -- 172.21.15.8:0/795662379 learned_addr learned my addr 172.21.15.8:0/795662379 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:45.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75acb9b700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a806a3b0 0x7f75a8108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:45.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75a7fff700 1 -- 172.21.15.8:0/795662379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a806a3b0 msgr2=0x7f75a8108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:45.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75a7fff700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a806a3b0 0x7f75a8108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.321+0000 7f75a7fff700 1 -- 172.21.15.8:0/795662379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c005040 con 0x7f75a806b9c0 2023-10-18T22:26:45.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.322+0000 7f75a7fff700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75a806b9c0 0x7f75a8109430 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f7594002700 tx=0x7f7594009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:45.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.322+0000 7f75a57fa700 1 -- 172.21.15.8:0/795662379 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7594009320 con 0x7f75a806b9c0 2023-10-18T22:26:45.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.322+0000 7f75a57fa700 1 -- 172.21.15.8:0/795662379 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f759400f040 con 0x7f75a806b9c0 2023-10-18T22:26:45.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.322+0000 7f75a57fa700 1 -- 172.21.15.8:0/795662379 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75940148f0 con 0x7f75a806b9c0 2023-10-18T22:26:45.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.322+0000 7f75adb9d700 1 -- 172.21.15.8:0/795662379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a810a4c0 con 0x7f75a806b9c0 2023-10-18T22:26:45.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.322+0000 7f75adb9d700 1 -- 172.21.15.8:0/795662379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a810aa80 con 0x7f75a806b9c0 2023-10-18T22:26:45.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.323+0000 7f75adb9d700 1 -- 172.21.15.8:0/795662379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a8045ad0 con 0x7f75a806b9c0 2023-10-18T22:26:45.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.324+0000 7f75a57fa700 1 -- 172.21.15.8:0/795662379 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7594009480 con 0x7f75a806b9c0 2023-10-18T22:26:45.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.325+0000 7f75a57fa700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7598060f70 0x7f7598063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:45.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.325+0000 7f75a57fa700 1 -- 172.21.15.8:0/795662379 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f759407cb80 con 0x7f75a806b9c0 2023-10-18T22:26:45.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.325+0000 7f75acb9b700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7598060f70 0x7f7598063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:45.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.326+0000 7f75acb9b700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7598060f70 0x7f7598063430 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f759c004630 tx=0x7f759c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:45.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.329+0000 7f75a57fa700 1 -- 172.21.15.8:0/795662379 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f75940501e0 con 0x7f75a806b9c0 2023-10-18T22:26:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.523+0000 7f75adb9d700 1 -- 172.21.15.8:0/795662379 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75a8101030 con 0x7f7598060f70 2023-10-18T22:26:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.532+0000 7f75a57fa700 1 -- 172.21.15.8:0/795662379 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f75a8101030 con 0x7f7598060f70 2023-10-18T22:26:45.534 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:26:45.534 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (93m) 24s ago 94m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:26:45.534 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (87m) 24s ago 94m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:26:45.534 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (87m) 8m ago 94m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:26:45.535 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (93m) 24s ago 94m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:26:45.535 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 24s ago 90m - - 2023-10-18T22:26:45.535 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 24s ago 90m - - 2023-10-18T22:26:45.535 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 90m - - 2023-10-18T22:26:45.535 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 90m - - 2023-10-18T22:26:45.536 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (88m) 24s ago 96m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:26:45.536 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (87m) 8m ago 93m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:26:45.536 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (87m) 24s ago 96m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:26:45.536 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (87m) 8m ago 93m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:26:45.536 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (94m) 24s ago 94m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:26:45.537 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (93m) 8m ago 93m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:26:45.537 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (86m) 24s ago 93m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:26:45.537 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (84m) 24s ago 93m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:26:45.537 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (84m) 24s ago 92m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:26:45.537 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (84m) 8m ago 92m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:26:45.537 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (83m) 8m ago 92m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:26:45.538 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (82m) 8m ago 92m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:26:45.538 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (88m) 24s ago 94m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:26:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 -- 172.21.15.8:0/795662379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7598060f70 msgr2=0x7f7598063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7598060f70 0x7f7598063430 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f759c004630 tx=0x7f759c009b30).stop 2023-10-18T22:26:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 -- 172.21.15.8:0/795662379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75a806b9c0 msgr2=0x7f75a8109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75a806b9c0 0x7f75a8109430 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f7594002700 tx=0x7f7594009e00).stop 2023-10-18T22:26:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 -- 172.21.15.8:0/795662379 shutdown_connections 2023-10-18T22:26:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7598060f70 0x7f7598063430 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a806a3b0 0x7f75a8108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 --2- 172.21.15.8:0/795662379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75a806b9c0 0x7f75a8109430 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 -- 172.21.15.8:0/795662379 >> 172.21.15.8:0/795662379 conn(0x7f75a80f1c90 msgr2=0x7f75a80fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 -- 172.21.15.8:0/795662379 shutdown_connections 2023-10-18T22:26:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.534+0000 7f75adb9d700 1 -- 172.21.15.8:0/795662379 wait complete. 2023-10-18T22:26:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:43.677047+0000 mgr.smithi008.flmjzp (mgr.14640) 5265 : cluster [DBG] pgmap v3611: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:45.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.670+0000 7f61c7fff700 1 -- 172.21.15.8:0/1780309953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61c80f8740 msgr2=0x7f61c80f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:45.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.670+0000 7f61c7fff700 1 --2- 172.21.15.8:0/1780309953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61c80f8740 0x7f61c80f8b60 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f61b8004660 tx=0x7f61b8009b30).stop 2023-10-18T22:26:45.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.670+0000 7f61c7fff700 1 -- 172.21.15.8:0/1780309953 shutdown_connections 2023-10-18T22:26:45.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.670+0000 7f61c7fff700 1 --2- 172.21.15.8:0/1780309953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c80f99e0 0x7f61c80f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.670+0000 7f61c7fff700 1 --2- 172.21.15.8:0/1780309953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61c80f8740 0x7f61c80f8b60 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.670+0000 7f61c7fff700 1 -- 172.21.15.8:0/1780309953 >> 172.21.15.8:0/1780309953 conn(0x7f61c80f40e0 msgr2=0x7f61c80f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:45.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.670+0000 7f61c7fff700 1 -- 172.21.15.8:0/1780309953 shutdown_connections 2023-10-18T22:26:45.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.670+0000 7f61c7fff700 1 -- 172.21.15.8:0/1780309953 wait complete. 2023-10-18T22:26:45.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.671+0000 7f61c7fff700 1 Processor -- start 2023-10-18T22:26:45.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.671+0000 7f61c7fff700 1 -- start start 2023-10-18T22:26:45.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61c80f8740 0x7f61c8108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:45.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c80f99e0 0x7f61c81094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:45.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8109a80 con 0x7f61c80f8740 2023-10-18T22:26:45.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8109bc0 con 0x7f61c80f99e0 2023-10-18T22:26:45.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61c80f8740 0x7f61c8108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:45.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61c80f8740 0x7f61c8108fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46800/0 (socket says 172.21.15.8:46800) 2023-10-18T22:26:45.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c6ffd700 1 -- 172.21.15.8:0/1762483371 learned_addr learned my addr 172.21.15.8:0/1762483371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:45.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c67fc700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c80f99e0 0x7f61c81094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:45.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c6ffd700 1 -- 172.21.15.8:0/1762483371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c80f99e0 msgr2=0x7f61c81094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:45.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c6ffd700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c80f99e0 0x7f61c81094d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c6ffd700 1 -- 172.21.15.8:0/1762483371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b8005040 con 0x7f61c80f8740 2023-10-18T22:26:45.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.672+0000 7f61c6ffd700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61c80f8740 0x7f61c8108fe0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f61b8007a60 tx=0x7f61b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:45.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.673+0000 7f61af7fe700 1 -- 172.21.15.8:0/1762483371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61b8018070 con 0x7f61c80f8740 2023-10-18T22:26:45.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.673+0000 7f61af7fe700 1 -- 172.21.15.8:0/1762483371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f61b8009630 con 0x7f61c80f8740 2023-10-18T22:26:45.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.673+0000 7f61af7fe700 1 -- 172.21.15.8:0/1762483371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61b801c540 con 0x7f61c80f8740 2023-10-18T22:26:45.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.673+0000 7f61c7fff700 1 -- 172.21.15.8:0/1762483371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c810a500 con 0x7f61c80f8740 2023-10-18T22:26:45.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.673+0000 7f61c7fff700 1 -- 172.21.15.8:0/1762483371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c810aa60 con 0x7f61c80f8740 2023-10-18T22:26:45.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.674+0000 7f61c7fff700 1 -- 172.21.15.8:0/1762483371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c8045ad0 con 0x7f61c80f8740 2023-10-18T22:26:45.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.675+0000 7f61af7fe700 1 -- 172.21.15.8:0/1762483371 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f61b801d420 con 0x7f61c80f8740 2023-10-18T22:26:45.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.676+0000 7f61af7fe700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61b0060f70 0x7f61b0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:45.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.676+0000 7f61af7fe700 1 -- 172.21.15.8:0/1762483371 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f61b807e6c0 con 0x7f61c80f8740 2023-10-18T22:26:45.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.676+0000 7f61c67fc700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61b0060f70 0x7f61b0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:45.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.677+0000 7f61c67fc700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61b0060f70 0x7f61b0063430 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f61bc0096c0 tx=0x7f61bc009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:45.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.680+0000 7f61af7fe700 1 -- 172.21.15.8:0/1762483371 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f61b8051d20 con 0x7f61c80f8740 2023-10-18T22:26:45.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:43.677047+0000 mgr.smithi008.flmjzp (mgr.14640) 5265 : cluster [DBG] pgmap v3611: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:45.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.935+0000 7f61c7fff700 1 -- 172.21.15.8:0/1762483371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f61c8100f70 con 0x7f61c80f8740 2023-10-18T22:26:45.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.936+0000 7f61af7fe700 1 -- 172.21.15.8:0/1762483371 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f61b8051910 con 0x7f61c80f8740 2023-10-18T22:26:45.938 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:26:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:26:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:26:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:26:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:26:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:26:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:26:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:26:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:26:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:26:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:26:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:26:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:26:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:26:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:26:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:26:45.941 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:26:45.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.938+0000 7f61c7fff700 1 -- 172.21.15.8:0/1762483371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61b0060f70 msgr2=0x7f61b0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:45.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.938+0000 7f61c7fff700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61b0060f70 0x7f61b0063430 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f61bc0096c0 tx=0x7f61bc009be0).stop 2023-10-18T22:26:45.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.938+0000 7f61c7fff700 1 -- 172.21.15.8:0/1762483371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61c80f8740 msgr2=0x7f61c8108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:45.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.938+0000 7f61c7fff700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61c80f8740 0x7f61c8108fe0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f61b8007a60 tx=0x7f61b8009b30).stop 2023-10-18T22:26:45.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.938+0000 7f61c7fff700 1 -- 172.21.15.8:0/1762483371 shutdown_connections 2023-10-18T22:26:45.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.938+0000 7f61c7fff700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f61b0060f70 0x7f61b0063430 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.938+0000 7f61c7fff700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61c80f8740 0x7f61c8108fe0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.938+0000 7f61c7fff700 1 --2- 172.21.15.8:0/1762483371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c80f99e0 0x7f61c81094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:45.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.938+0000 7f61c7fff700 1 -- 172.21.15.8:0/1762483371 >> 172.21.15.8:0/1762483371 conn(0x7f61c80f40e0 msgr2=0x7f61c80fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:45.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.939+0000 7f61c7fff700 1 -- 172.21.15.8:0/1762483371 shutdown_connections 2023-10-18T22:26:45.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:45.939+0000 7f61c7fff700 1 -- 172.21.15.8:0/1762483371 wait complete. 2023-10-18T22:26:46.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.074+0000 7f81bb1ce700 1 -- 172.21.15.8:0/1856726998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40f77d0 msgr2=0x7f81b40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:46.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.075+0000 7f81bb1ce700 1 --2- 172.21.15.8:0/1856726998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40f77d0 0x7f81b40f7c30 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f81a4004660 tx=0x7f81a4009b30).stop 2023-10-18T22:26:46.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.075+0000 7f81bb1ce700 1 -- 172.21.15.8:0/1856726998 shutdown_connections 2023-10-18T22:26:46.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.075+0000 7f81bb1ce700 1 --2- 172.21.15.8:0/1856726998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40f77d0 0x7f81b40f7c30 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.075+0000 7f81bb1ce700 1 --2- 172.21.15.8:0/1856726998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81b40f6530 0x7f81b40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.075+0000 7f81bb1ce700 1 -- 172.21.15.8:0/1856726998 >> 172.21.15.8:0/1856726998 conn(0x7f81b40f1c90 msgr2=0x7f81b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:46.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.075+0000 7f81bb1ce700 1 -- 172.21.15.8:0/1856726998 shutdown_connections 2023-10-18T22:26:46.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.075+0000 7f81bb1ce700 1 -- 172.21.15.8:0/1856726998 wait complete. 2023-10-18T22:26:46.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.076+0000 7f81bb1ce700 1 Processor -- start 2023-10-18T22:26:46.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.076+0000 7f81bb1ce700 1 -- start start 2023-10-18T22:26:46.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.076+0000 7f81bb1ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81b40f6530 0x7f81b4108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:46.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.076+0000 7f81bb1ce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40f77d0 0x7f81b4109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:46.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.076+0000 7f81bb1ce700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b4109a20 con 0x7f81b40f77d0 2023-10-18T22:26:46.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.076+0000 7f81bb1ce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b4109b60 con 0x7f81b40f6530 2023-10-18T22:26:46.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.076+0000 7f81b99cb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40f77d0 0x7f81b4109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:46.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81b99cb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40f77d0 0x7f81b4109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46816/0 (socket says 172.21.15.8:46816) 2023-10-18T22:26:46.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81b99cb700 1 -- 172.21.15.8:0/2711776989 learned_addr learned my addr 172.21.15.8:0/2711776989 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81ba1cc700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81b40f6530 0x7f81b4108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81b99cb700 1 -- 172.21.15.8:0/2711776989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81b40f6530 msgr2=0x7f81b4108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81b99cb700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81b40f6530 0x7f81b4108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81b99cb700 1 -- 172.21.15.8:0/2711776989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4005040 con 0x7f81b40f77d0 2023-10-18T22:26:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81b99cb700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40f77d0 0x7f81b4109470 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f81a4009830 tx=0x7f81a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:46.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81aaffd700 1 -- 172.21.15.8:0/2711776989 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a4018070 con 0x7f81b40f77d0 2023-10-18T22:26:46.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81aaffd700 1 -- 172.21.15.8:0/2711776989 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f81a401d8e0 con 0x7f81b40f77d0 2023-10-18T22:26:46.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81aaffd700 1 -- 172.21.15.8:0/2711776989 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a401c480 con 0x7f81b40f77d0 2023-10-18T22:26:46.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.077+0000 7f81bb1ce700 1 -- 172.21.15.8:0/2711776989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b410a4a0 con 0x7f81b40f77d0 2023-10-18T22:26:46.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.078+0000 7f81bb1ce700 1 -- 172.21.15.8:0/2711776989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b410aa00 con 0x7f81b40f77d0 2023-10-18T22:26:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.079+0000 7f81bb1ce700 1 -- 172.21.15.8:0/2711776989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b4045ad0 con 0x7f81b40f77d0 2023-10-18T22:26:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.079+0000 7f81aaffd700 1 -- 172.21.15.8:0/2711776989 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f81a401da50 con 0x7f81b40f77d0 2023-10-18T22:26:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.080+0000 7f81aaffd700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81a0060f70 0x7f81a0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.080+0000 7f81aaffd700 1 -- 172.21.15.8:0/2711776989 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f81a407e850 con 0x7f81b40f77d0 2023-10-18T22:26:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.081+0000 7f81ba1cc700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81a0060f70 0x7f81a0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.081+0000 7f81ba1cc700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81a0060f70 0x7f81a0063430 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f81b40f7630 tx=0x7f81b0009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.084+0000 7f81aaffd700 1 -- 172.21.15.8:0/2711776989 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f81a4051e70 con 0x7f81b40f77d0 2023-10-18T22:26:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.312+0000 7f81bb1ce700 1 -- 172.21.15.8:0/2711776989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f81b4027a00 con 0x7f81b40f77d0 2023-10-18T22:26:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.313+0000 7f81aaffd700 1 -- 172.21.15.8:0/2711776989 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f81a4019270 con 0x7f81b40f77d0 2023-10-18T22:26:46.315 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:26:46.315 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:26:46.315 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:26:46.315 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:26:46.316 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:26:46.316 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:26:46.316 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:26:46.316 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:26:46.316 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:26:46.317 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:26:46.317 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:26:46.317 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:26:46.317 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:26:46.318 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:26:46.318 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:26:46.318 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:26:46.318 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:26:46.319 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:26:46.319 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:26:46.319 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:26:46.319 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:26:46.319 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:26:46.320 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:26:46.320 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:26:46.320 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:26:46.320 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:26:46.320 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:26:46.321 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:26:46.321 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:26:46.321 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:26:46.321 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:26:46.321 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:26:46.322 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:26:46.322 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:26:46.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.315+0000 7f81bb1ce700 1 -- 172.21.15.8:0/2711776989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81a0060f70 msgr2=0x7f81a0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:46.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.315+0000 7f81bb1ce700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81a0060f70 0x7f81a0063430 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f81b40f7630 tx=0x7f81b0009040).stop 2023-10-18T22:26:46.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.315+0000 7f81bb1ce700 1 -- 172.21.15.8:0/2711776989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40f77d0 msgr2=0x7f81b4109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:46.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.315+0000 7f81bb1ce700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40f77d0 0x7f81b4109470 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f81a4009830 tx=0x7f81a4009b30).stop 2023-10-18T22:26:46.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.315+0000 7f81bb1ce700 1 -- 172.21.15.8:0/2711776989 shutdown_connections 2023-10-18T22:26:46.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.315+0000 7f81bb1ce700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f81a0060f70 0x7f81a0063430 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.315+0000 7f81bb1ce700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81b40f6530 0x7f81b4108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.315+0000 7f81bb1ce700 1 --2- 172.21.15.8:0/2711776989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40f77d0 0x7f81b4109470 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.315+0000 7f81bb1ce700 1 -- 172.21.15.8:0/2711776989 >> 172.21.15.8:0/2711776989 conn(0x7f81b40f1c90 msgr2=0x7f81b406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:46.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.315+0000 7f81bb1ce700 1 -- 172.21.15.8:0/2711776989 shutdown_connections 2023-10-18T22:26:46.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.316+0000 7f81bb1ce700 1 -- 172.21.15.8:0/2711776989 wait complete. 2023-10-18T22:26:46.325 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:26:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.454+0000 7f633d6fb700 1 -- 172.21.15.8:0/2720557663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63380f77d0 msgr2=0x7f63380f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.454+0000 7f633d6fb700 1 --2- 172.21.15.8:0/2720557663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63380f77d0 0x7f63380f7c30 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7f6320004660 tx=0x7f6320009b30).stop 2023-10-18T22:26:46.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.455+0000 7f633d6fb700 1 -- 172.21.15.8:0/2720557663 shutdown_connections 2023-10-18T22:26:46.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.455+0000 7f633d6fb700 1 --2- 172.21.15.8:0/2720557663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63380f77d0 0x7f63380f7c30 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.455+0000 7f633d6fb700 1 --2- 172.21.15.8:0/2720557663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63380f6530 0x7f63380f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.455+0000 7f633d6fb700 1 -- 172.21.15.8:0/2720557663 >> 172.21.15.8:0/2720557663 conn(0x7f63380f1c90 msgr2=0x7f63380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:46.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.455+0000 7f633d6fb700 1 -- 172.21.15.8:0/2720557663 shutdown_connections 2023-10-18T22:26:46.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.455+0000 7f633d6fb700 1 -- 172.21.15.8:0/2720557663 wait complete. 2023-10-18T22:26:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.455+0000 7f633d6fb700 1 Processor -- start 2023-10-18T22:26:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.456+0000 7f633d6fb700 1 -- start start 2023-10-18T22:26:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.456+0000 7f633d6fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63380f6530 0x7f6338108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:46.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.456+0000 7f633d6fb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63380f77d0 0x7f6338109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:46.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.456+0000 7f633d6fb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63381099c0 con 0x7f63380f6530 2023-10-18T22:26:46.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.456+0000 7f633d6fb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6338109b00 con 0x7f63380f77d0 2023-10-18T22:26:46.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.456+0000 7f6337fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63380f6530 0x7f6338108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:46.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.456+0000 7f6337fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63380f6530 0x7f6338108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46836/0 (socket says 172.21.15.8:46836) 2023-10-18T22:26:46.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.456+0000 7f6337fff700 1 -- 172.21.15.8:0/4177346205 learned_addr learned my addr 172.21.15.8:0/4177346205 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:26:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.456+0000 7f632ffff700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63380f77d0 0x7f6338109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.457+0000 7f6337fff700 1 -- 172.21.15.8:0/4177346205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63380f77d0 msgr2=0x7f6338109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.457+0000 7f6337fff700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63380f77d0 0x7f6338109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.457+0000 7f6337fff700 1 -- 172.21.15.8:0/4177346205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320005040 con 0x7f63380f6530 2023-10-18T22:26:46.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.457+0000 7f6337fff700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63380f6530 0x7f6338108f20 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7f632800e7c0 tx=0x7f632800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:46.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.457+0000 7f63357fa700 1 -- 172.21.15.8:0/4177346205 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63280092e0 con 0x7f63380f6530 2023-10-18T22:26:46.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.457+0000 7f63357fa700 1 -- 172.21.15.8:0/4177346205 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f632800f040 con 0x7f63380f6530 2023-10-18T22:26:46.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.457+0000 7f63357fa700 1 -- 172.21.15.8:0/4177346205 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6328014810 con 0x7f63380f6530 2023-10-18T22:26:46.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.457+0000 7f633d6fb700 1 -- 172.21.15.8:0/4177346205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633810a4a0 con 0x7f63380f6530 2023-10-18T22:26:46.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.457+0000 7f633d6fb700 1 -- 172.21.15.8:0/4177346205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633810a9e0 con 0x7f63380f6530 2023-10-18T22:26:46.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.458+0000 7f633d6fb700 1 -- 172.21.15.8:0/4177346205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6338045ad0 con 0x7f63380f6530 2023-10-18T22:26:46.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.459+0000 7f63357fa700 1 -- 172.21.15.8:0/4177346205 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f632801b030 con 0x7f63380f6530 2023-10-18T22:26:46.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.460+0000 7f63357fa700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6324060f70 0x7f6324063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:26:46.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.460+0000 7f63357fa700 1 -- 172.21.15.8:0/4177346205 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f632807c7c0 con 0x7f63380f6530 2023-10-18T22:26:46.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.460+0000 7f632ffff700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6324060f70 0x7f6324063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:26:46.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.461+0000 7f632ffff700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6324060f70 0x7f6324063430 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f6320005010 tx=0x7f6320016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:26:46.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.465+0000 7f63357fa700 1 -- 172.21.15.8:0/4177346205 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f632804fe60 con 0x7f63380f6530 2023-10-18T22:26:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.660+0000 7f633d6fb700 1 -- 172.21.15.8:0/4177346205 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f63380fee00 con 0x7f6324060f70 2023-10-18T22:26:46.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.661+0000 7f63357fa700 1 -- 172.21.15.8:0/4177346205 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f63380fee00 con 0x7f6324060f70 2023-10-18T22:26:46.663 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:26:46.663 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:26:46.663 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:26:46.664 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:26:46.664 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:26:46.664 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:26:46.664 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:26:46.664 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:26:46.665 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:26:46.665 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:26:46.665 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:26:46.665 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:26:46.665 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:26:46.666 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:26:46.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.663+0000 7f633d6fb700 1 -- 172.21.15.8:0/4177346205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6324060f70 msgr2=0x7f6324063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.663+0000 7f633d6fb700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6324060f70 0x7f6324063430 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f6320005010 tx=0x7f6320016040).stop 2023-10-18T22:26:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.663+0000 7f633d6fb700 1 -- 172.21.15.8:0/4177346205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63380f6530 msgr2=0x7f6338108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:26:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.663+0000 7f633d6fb700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63380f6530 0x7f6338108f20 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7f632800e7c0 tx=0x7f632800b040).stop 2023-10-18T22:26:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.664+0000 7f633d6fb700 1 -- 172.21.15.8:0/4177346205 shutdown_connections 2023-10-18T22:26:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.664+0000 7f633d6fb700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6324060f70 0x7f6324063430 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.664+0000 7f633d6fb700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63380f6530 0x7f6338108f20 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.664+0000 7f633d6fb700 1 --2- 172.21.15.8:0/4177346205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63380f77d0 0x7f6338109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:26:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.664+0000 7f633d6fb700 1 -- 172.21.15.8:0/4177346205 >> 172.21.15.8:0/4177346205 conn(0x7f63380f1c90 msgr2=0x7f633806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:26:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.664+0000 7f633d6fb700 1 -- 172.21.15.8:0/4177346205 shutdown_connections 2023-10-18T22:26:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:26:46.664+0000 7f633d6fb700 1 -- 172.21.15.8:0/4177346205 wait complete. 2023-10-18T22:26:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:44.827191+0000 mgr.smithi008.flmjzp (mgr.14640) 5266 : audit [DBG] from='client.38200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:45.180210+0000 mgr.smithi008.flmjzp (mgr.14640) 5267 : audit [DBG] from='client.38204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:45.524165+0000 mgr.smithi008.flmjzp (mgr.14640) 5268 : audit [DBG] from='client.38208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:45.936702+0000 mon.smithi008 (mon.0) 5516 : audit [DBG] from='client.? 172.21.15.8:0/1762483371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:46.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:46.313706+0000 mon.smithi008 (mon.0) 5517 : audit [DBG] from='client.? 172.21.15.8:0/2711776989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:26:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:44.827191+0000 mgr.smithi008.flmjzp (mgr.14640) 5266 : audit [DBG] from='client.38200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:45.180210+0000 mgr.smithi008.flmjzp (mgr.14640) 5267 : audit [DBG] from='client.38204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:45.524165+0000 mgr.smithi008.flmjzp (mgr.14640) 5268 : audit [DBG] from='client.38208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:45.936702+0000 mon.smithi008 (mon.0) 5516 : audit [DBG] from='client.? 172.21.15.8:0/1762483371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:46.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:46.313706+0000 mon.smithi008 (mon.0) 5517 : audit [DBG] from='client.? 172.21.15.8:0/2711776989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:26:47.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:45.677458+0000 mgr.smithi008.flmjzp (mgr.14640) 5269 : cluster [DBG] pgmap v3612: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:45.677458+0000 mgr.smithi008.flmjzp (mgr.14640) 5269 : cluster [DBG] pgmap v3612: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:46.661810+0000 mgr.smithi008.flmjzp (mgr.14640) 5270 : audit [DBG] from='client.38220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:46.661810+0000 mgr.smithi008.flmjzp (mgr.14640) 5270 : audit [DBG] from='client.38220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:26:49.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:47.677968+0000 mgr.smithi008.flmjzp (mgr.14640) 5271 : cluster [DBG] pgmap v3613: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:47.677968+0000 mgr.smithi008.flmjzp (mgr.14640) 5271 : cluster [DBG] pgmap v3613: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:51.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:49.678590+0000 mgr.smithi008.flmjzp (mgr.14640) 5272 : cluster [DBG] pgmap v3614: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:49.678590+0000 mgr.smithi008.flmjzp (mgr.14640) 5272 : cluster [DBG] pgmap v3614: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:51.709099+0000 mon.smithi008 (mon.0) 5518 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:52.265937+0000 mon.smithi008 (mon.0) 5519 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:26:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:52.267017+0000 mon.smithi008 (mon.0) 5520 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:26:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:52.273705+0000 mon.smithi008 (mon.0) 5521 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:52.280202+0000 mon.smithi008 (mon.0) 5522 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:52.283188+0000 mon.smithi008 (mon.0) 5523 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:52.284993+0000 mon.smithi008 (mon.0) 5524 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:52.286631+0000 mon.smithi008 (mon.0) 5525 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:26:52.288573+0000 mon.smithi008 (mon.0) 5526 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:51.709099+0000 mon.smithi008 (mon.0) 5518 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:52.265937+0000 mon.smithi008 (mon.0) 5519 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:26:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:52.267017+0000 mon.smithi008 (mon.0) 5520 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:26:52.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:52.273705+0000 mon.smithi008 (mon.0) 5521 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:26:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:52.280202+0000 mon.smithi008 (mon.0) 5522 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:26:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:52.283188+0000 mon.smithi008 (mon.0) 5523 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:52.284993+0000 mon.smithi008 (mon.0) 5524 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:52.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:52.286631+0000 mon.smithi008 (mon.0) 5525 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:52.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:26:52.288573+0000 mon.smithi008 (mon.0) 5526 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:26:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:51.679046+0000 mgr.smithi008.flmjzp (mgr.14640) 5273 : cluster [DBG] pgmap v3615: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:26:52.267845+0000 mgr.smithi008.flmjzp (mgr.14640) 5274 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:26:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:52.268523+0000 mgr.smithi008.flmjzp (mgr.14640) 5275 : cluster [DBG] pgmap v3616: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:53.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:52.268792+0000 mgr.smithi008.flmjzp (mgr.14640) 5276 : cluster [DBG] pgmap v3617: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:53.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:26:52.290407+0000 mgr.smithi008.flmjzp (mgr.14640) 5277 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:53.859 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:51.679046+0000 mgr.smithi008.flmjzp (mgr.14640) 5273 : cluster [DBG] pgmap v3615: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:53.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:26:52.267845+0000 mgr.smithi008.flmjzp (mgr.14640) 5274 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:26:53.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:52.268523+0000 mgr.smithi008.flmjzp (mgr.14640) 5275 : cluster [DBG] pgmap v3616: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:53.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:52.268792+0000 mgr.smithi008.flmjzp (mgr.14640) 5276 : cluster [DBG] pgmap v3617: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:53.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:26:52.290407+0000 mgr.smithi008.flmjzp (mgr.14640) 5277 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:26:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:54.269329+0000 mgr.smithi008.flmjzp (mgr.14640) 5278 : cluster [DBG] pgmap v3618: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:55.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:54.269329+0000 mgr.smithi008.flmjzp (mgr.14640) 5278 : cluster [DBG] pgmap v3618: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:57.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:56.270075+0000 mgr.smithi008.flmjzp (mgr.14640) 5279 : cluster [DBG] pgmap v3619: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:56.270075+0000 mgr.smithi008.flmjzp (mgr.14640) 5279 : cluster [DBG] pgmap v3619: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:26:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:26:58.270615+0000 mgr.smithi008.flmjzp (mgr.14640) 5280 : cluster [DBG] pgmap v3620: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:26:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:26:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:26:58.270615+0000 mgr.smithi008.flmjzp (mgr.14640) 5280 : cluster [DBG] pgmap v3620: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:00.271238+0000 mgr.smithi008.flmjzp (mgr.14640) 5281 : cluster [DBG] pgmap v3621: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:00.271238+0000 mgr.smithi008.flmjzp (mgr.14640) 5281 : cluster [DBG] pgmap v3621: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:02.301101+0000 mon.smithi008 (mon.0) 5527 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:02.303221+0000 mon.smithi008 (mon.0) 5528 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:02.304329+0000 mon.smithi008 (mon.0) 5529 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:02.311113+0000 mon.smithi008 (mon.0) 5530 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:02.318188+0000 mon.smithi008 (mon.0) 5531 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:02.321222+0000 mon.smithi008 (mon.0) 5532 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:02.322853+0000 mon.smithi008 (mon.0) 5533 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:02.324325+0000 mon.smithi008 (mon.0) 5534 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:02.326260+0000 mon.smithi008 (mon.0) 5535 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:02.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:02.301101+0000 mon.smithi008 (mon.0) 5527 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:02.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:02.303221+0000 mon.smithi008 (mon.0) 5528 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:02.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:02.304329+0000 mon.smithi008 (mon.0) 5529 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:02.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:02.311113+0000 mon.smithi008 (mon.0) 5530 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:02.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:02.318188+0000 mon.smithi008 (mon.0) 5531 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:02.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:02.321222+0000 mon.smithi008 (mon.0) 5532 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:02.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:02.322853+0000 mon.smithi008 (mon.0) 5533 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:02.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:02.324325+0000 mon.smithi008 (mon.0) 5534 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:02.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:02.326260+0000 mon.smithi008 (mon.0) 5535 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:03.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:02.271794+0000 mgr.smithi008.flmjzp (mgr.14640) 5282 : cluster [DBG] pgmap v3622: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:03.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:02.305292+0000 mgr.smithi008.flmjzp (mgr.14640) 5283 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:03.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:02.305879+0000 mgr.smithi008.flmjzp (mgr.14640) 5284 : cluster [DBG] pgmap v3623: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:03.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:02.306178+0000 mgr.smithi008.flmjzp (mgr.14640) 5285 : cluster [DBG] pgmap v3624: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:03.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:02.328260+0000 mgr.smithi008.flmjzp (mgr.14640) 5286 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:02.271794+0000 mgr.smithi008.flmjzp (mgr.14640) 5282 : cluster [DBG] pgmap v3622: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:02.305292+0000 mgr.smithi008.flmjzp (mgr.14640) 5283 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:02.305879+0000 mgr.smithi008.flmjzp (mgr.14640) 5284 : cluster [DBG] pgmap v3623: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:02.306178+0000 mgr.smithi008.flmjzp (mgr.14640) 5285 : cluster [DBG] pgmap v3624: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:02.328260+0000 mgr.smithi008.flmjzp (mgr.14640) 5286 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:04.306729+0000 mgr.smithi008.flmjzp (mgr.14640) 5287 : cluster [DBG] pgmap v3625: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:04.306729+0000 mgr.smithi008.flmjzp (mgr.14640) 5287 : cluster [DBG] pgmap v3625: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:06.307438+0000 mgr.smithi008.flmjzp (mgr.14640) 5288 : cluster [DBG] pgmap v3626: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:07.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:06.307438+0000 mgr.smithi008.flmjzp (mgr.14640) 5288 : cluster [DBG] pgmap v3626: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:08.307894+0000 mgr.smithi008.flmjzp (mgr.14640) 5289 : cluster [DBG] pgmap v3627: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:08.307894+0000 mgr.smithi008.flmjzp (mgr.14640) 5289 : cluster [DBG] pgmap v3627: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:10.308510+0000 mgr.smithi008.flmjzp (mgr.14640) 5290 : cluster [DBG] pgmap v3628: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:10.308510+0000 mgr.smithi008.flmjzp (mgr.14640) 5290 : cluster [DBG] pgmap v3628: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:12.332949+0000 mon.smithi008 (mon.0) 5536 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:12.335177+0000 mon.smithi008 (mon.0) 5537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:12.336160+0000 mon.smithi008 (mon.0) 5538 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:12.342510+0000 mon.smithi008 (mon.0) 5539 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:12.349487+0000 mon.smithi008 (mon.0) 5540 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:12.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:12.352964+0000 mon.smithi008 (mon.0) 5541 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:12.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:12.354674+0000 mon.smithi008 (mon.0) 5542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:12.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:12.356301+0000 mon.smithi008 (mon.0) 5543 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:12.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:12.358305+0000 mon.smithi008 (mon.0) 5544 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:12.332949+0000 mon.smithi008 (mon.0) 5536 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:12.335177+0000 mon.smithi008 (mon.0) 5537 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:12.336160+0000 mon.smithi008 (mon.0) 5538 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:12.342510+0000 mon.smithi008 (mon.0) 5539 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:12.349487+0000 mon.smithi008 (mon.0) 5540 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:12.352964+0000 mon.smithi008 (mon.0) 5541 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:12.354674+0000 mon.smithi008 (mon.0) 5542 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:12.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:12.356301+0000 mon.smithi008 (mon.0) 5543 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:12.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:12.358305+0000 mon.smithi008 (mon.0) 5544 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:13.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:12.308961+0000 mgr.smithi008.flmjzp (mgr.14640) 5291 : cluster [DBG] pgmap v3629: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:13.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:12.337037+0000 mgr.smithi008.flmjzp (mgr.14640) 5292 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:13.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:12.337626+0000 mgr.smithi008.flmjzp (mgr.14640) 5293 : cluster [DBG] pgmap v3630: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:13.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:12.337925+0000 mgr.smithi008.flmjzp (mgr.14640) 5294 : cluster [DBG] pgmap v3631: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:13.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:12.360232+0000 mgr.smithi008.flmjzp (mgr.14640) 5295 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:12.308961+0000 mgr.smithi008.flmjzp (mgr.14640) 5291 : cluster [DBG] pgmap v3629: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:12.337037+0000 mgr.smithi008.flmjzp (mgr.14640) 5292 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:12.337626+0000 mgr.smithi008.flmjzp (mgr.14640) 5293 : cluster [DBG] pgmap v3630: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:12.337925+0000 mgr.smithi008.flmjzp (mgr.14640) 5294 : cluster [DBG] pgmap v3631: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:12.360232+0000 mgr.smithi008.flmjzp (mgr.14640) 5295 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:14.338494+0000 mgr.smithi008.flmjzp (mgr.14640) 5296 : cluster [DBG] pgmap v3632: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:14.338494+0000 mgr.smithi008.flmjzp (mgr.14640) 5296 : cluster [DBG] pgmap v3632: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.817+0000 7f937f59e700 1 -- 172.21.15.8:0/256557777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93800f77d0 msgr2=0x7f93800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.817+0000 7f937f59e700 1 --2- 172.21.15.8:0/256557777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93800f77d0 0x7f93800f7c30 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f9374004660 tx=0x7f9374009b30).stop 2023-10-18T22:27:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.817+0000 7f937f59e700 1 -- 172.21.15.8:0/256557777 shutdown_connections 2023-10-18T22:27:16.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.817+0000 7f937f59e700 1 --2- 172.21.15.8:0/256557777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93800f77d0 0x7f93800f7c30 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:16.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.817+0000 7f937f59e700 1 --2- 172.21.15.8:0/256557777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93800f6530 0x7f93800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:16.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.817+0000 7f937f59e700 1 -- 172.21.15.8:0/256557777 >> 172.21.15.8:0/256557777 conn(0x7f93800f1c70 msgr2=0x7f93800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:16.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.817+0000 7f937f59e700 1 -- 172.21.15.8:0/256557777 shutdown_connections 2023-10-18T22:27:16.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.817+0000 7f937f59e700 1 -- 172.21.15.8:0/256557777 wait complete. 2023-10-18T22:27:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.818+0000 7f937f59e700 1 Processor -- start 2023-10-18T22:27:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.818+0000 7f937f59e700 1 -- start start 2023-10-18T22:27:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93800f6530 0x7f9380106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93800f77d0 0x7f93801072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93801078a0 con 0x7f93800f77d0 2023-10-18T22:27:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93801080e0 con 0x7f93800f6530 2023-10-18T22:27:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93800f77d0 0x7f93801072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93800f6530 0x7f9380106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93800f6530 0x7f9380106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:51026/0 (socket says 172.21.15.8:51026) 2023-10-18T22:27:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937e59c700 1 -- 172.21.15.8:0/2567688795 learned_addr learned my addr 172.21.15.8:0/2567688795 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937dd9b700 1 -- 172.21.15.8:0/2567688795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93800f6530 msgr2=0x7f9380106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937dd9b700 1 --2- 172.21.15.8:0/2567688795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93800f6530 0x7f9380106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.819+0000 7f937dd9b700 1 -- 172.21.15.8:0/2567688795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9374005040 con 0x7f93800f77d0 2023-10-18T22:27:16.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.820+0000 7f937dd9b700 1 --2- 172.21.15.8:0/2567688795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93800f77d0 0x7f93801072a0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f9374000c00 tx=0x7f9374009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:16.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.820+0000 7f936effd700 1 -- 172.21.15.8:0/2567688795 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9374018070 con 0x7f93800f77d0 2023-10-18T22:27:16.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.820+0000 7f936effd700 1 -- 172.21.15.8:0/2567688795 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9374009630 con 0x7f93800f77d0 2023-10-18T22:27:16.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.820+0000 7f937f59e700 1 -- 172.21.15.8:0/2567688795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9380108360 con 0x7f93800f77d0 2023-10-18T22:27:16.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.820+0000 7f936effd700 1 -- 172.21.15.8:0/2567688795 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937401c3c0 con 0x7f93800f77d0 2023-10-18T22:27:16.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.820+0000 7f937f59e700 1 -- 172.21.15.8:0/2567688795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9380108840 con 0x7f93800f77d0 2023-10-18T22:27:16.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.821+0000 7f937f59e700 1 -- 172.21.15.8:0/2567688795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9380059100 con 0x7f93800f77d0 2023-10-18T22:27:16.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.822+0000 7f936effd700 1 -- 172.21.15.8:0/2567688795 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f937401d420 con 0x7f93800f77d0 2023-10-18T22:27:16.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.823+0000 7f936effd700 1 --2- 172.21.15.8:0/2567688795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9368060f70 0x7f9368063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:16.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.824+0000 7f936effd700 1 -- 172.21.15.8:0/2567688795 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f937407e550 con 0x7f93800f77d0 2023-10-18T22:27:16.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.824+0000 7f937e59c700 1 --2- 172.21.15.8:0/2567688795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9368060f70 0x7f9368063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:16.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.824+0000 7f937e59c700 1 --2- 172.21.15.8:0/2567688795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9368060f70 0x7f9368063430 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f9380107b70 tx=0x7f937000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:16.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:16.828+0000 7f936effd700 1 -- 172.21.15.8:0/2567688795 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f937404e180 con 0x7f93800f77d0 2023-10-18T22:27:17.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.029+0000 7f937f59e700 1 -- 172.21.15.8:0/2567688795 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93800fed30 con 0x7f9368060f70 2023-10-18T22:27:17.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.031+0000 7f936effd700 1 -- 172.21.15.8:0/2567688795 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f93800fed30 con 0x7f9368060f70 2023-10-18T22:27:17.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 -- 172.21.15.8:0/2567688795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9368060f70 msgr2=0x7f9368063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 --2- 172.21.15.8:0/2567688795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9368060f70 0x7f9368063430 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f9380107b70 tx=0x7f937000b040).stop 2023-10-18T22:27:17.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 -- 172.21.15.8:0/2567688795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93800f77d0 msgr2=0x7f93801072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 --2- 172.21.15.8:0/2567688795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93800f77d0 0x7f93801072a0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f9374000c00 tx=0x7f9374009b30).stop 2023-10-18T22:27:17.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 -- 172.21.15.8:0/2567688795 shutdown_connections 2023-10-18T22:27:17.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 --2- 172.21.15.8:0/2567688795 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9368060f70 0x7f9368063430 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 --2- 172.21.15.8:0/2567688795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93800f6530 0x7f9380106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 --2- 172.21.15.8:0/2567688795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93800f77d0 0x7f93801072a0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 -- 172.21.15.8:0/2567688795 >> 172.21.15.8:0/2567688795 conn(0x7f93800f1c70 msgr2=0x7f93800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:17.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 -- 172.21.15.8:0/2567688795 shutdown_connections 2023-10-18T22:27:17.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.033+0000 7f937f59e700 1 -- 172.21.15.8:0/2567688795 wait complete. 2023-10-18T22:27:17.050 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:27:17.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.172+0000 7f39a759e700 1 -- 172.21.15.8:0/2299602140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39a80f6530 msgr2=0x7f39a80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.172+0000 7f39a759e700 1 --2- 172.21.15.8:0/2299602140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39a80f6530 0x7f39a80f6950 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f3998004660 tx=0x7f3998009b30).stop 2023-10-18T22:27:17.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.172+0000 7f39a759e700 1 -- 172.21.15.8:0/2299602140 shutdown_connections 2023-10-18T22:27:17.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.172+0000 7f39a759e700 1 --2- 172.21.15.8:0/2299602140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a80f77d0 0x7f39a80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.172+0000 7f39a759e700 1 --2- 172.21.15.8:0/2299602140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39a80f6530 0x7f39a80f6950 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.172+0000 7f39a759e700 1 -- 172.21.15.8:0/2299602140 >> 172.21.15.8:0/2299602140 conn(0x7f39a80f1c90 msgr2=0x7f39a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:17.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.172+0000 7f39a759e700 1 -- 172.21.15.8:0/2299602140 shutdown_connections 2023-10-18T22:27:17.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.172+0000 7f39a759e700 1 -- 172.21.15.8:0/2299602140 wait complete. 2023-10-18T22:27:17.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.173+0000 7f39a759e700 1 Processor -- start 2023-10-18T22:27:17.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.173+0000 7f39a759e700 1 -- start start 2023-10-18T22:27:17.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.173+0000 7f39a759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a80f6530 0x7f39a8108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:17.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.173+0000 7f39a759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39a80f77d0 0x7f39a8109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:17.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.173+0000 7f39a759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8109a00 con 0x7f39a80f77d0 2023-10-18T22:27:17.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.173+0000 7f39a759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8109b40 con 0x7f39a80f6530 2023-10-18T22:27:17.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.173+0000 7f39a5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39a80f77d0 0x7f39a8109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:17.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f39a5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39a80f77d0 0x7f39a8109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38688/0 (socket says 172.21.15.8:38688) 2023-10-18T22:27:17.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f39a5d9b700 1 -- 172.21.15.8:0/722871777 learned_addr learned my addr 172.21.15.8:0/722871777 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:17.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f39a659c700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a80f6530 0x7f39a8108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:17.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f39a5d9b700 1 -- 172.21.15.8:0/722871777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a80f6530 msgr2=0x7f39a8108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f39a5d9b700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a80f6530 0x7f39a8108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f39a5d9b700 1 -- 172.21.15.8:0/722871777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3998005040 con 0x7f39a80f77d0 2023-10-18T22:27:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f39a5d9b700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39a80f77d0 0x7f39a8109450 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f399c00e7f0 tx=0x7f399c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f3996ffd700 1 -- 172.21.15.8:0/722871777 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f399c0092e0 con 0x7f39a80f77d0 2023-10-18T22:27:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f3996ffd700 1 -- 172.21.15.8:0/722871777 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f399c00f040 con 0x7f39a80f77d0 2023-10-18T22:27:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f3996ffd700 1 -- 172.21.15.8:0/722871777 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f399c0147e0 con 0x7f39a80f77d0 2023-10-18T22:27:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.174+0000 7f39a759e700 1 -- 172.21.15.8:0/722871777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a810a4e0 con 0x7f39a80f77d0 2023-10-18T22:27:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.175+0000 7f39a759e700 1 -- 172.21.15.8:0/722871777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a810aa20 con 0x7f39a80f77d0 2023-10-18T22:27:17.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.176+0000 7f39a759e700 1 -- 172.21.15.8:0/722871777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a8045ad0 con 0x7f39a80f77d0 2023-10-18T22:27:17.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.176+0000 7f3996ffd700 1 -- 172.21.15.8:0/722871777 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f399c01b030 con 0x7f39a80f77d0 2023-10-18T22:27:17.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.178+0000 7f3996ffd700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3990060f70 0x7f3990063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:17.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.178+0000 7f3996ffd700 1 -- 172.21.15.8:0/722871777 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f399c07c6b0 con 0x7f39a80f77d0 2023-10-18T22:27:17.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.178+0000 7f39a659c700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3990060f70 0x7f3990063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:17.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.179+0000 7f39a659c700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3990060f70 0x7f3990063430 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f3998005010 tx=0x7f3998016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:17.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.182+0000 7f3996ffd700 1 -- 172.21.15.8:0/722871777 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f399c04fd40 con 0x7f39a80f77d0 2023-10-18T22:27:17.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.378+0000 7f39a759e700 1 -- 172.21.15.8:0/722871777 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39a810ac90 con 0x7f3990060f70 2023-10-18T22:27:17.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.379+0000 7f3996ffd700 1 -- 172.21.15.8:0/722871777 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f39a810ac90 con 0x7f3990060f70 2023-10-18T22:27:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 -- 172.21.15.8:0/722871777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3990060f70 msgr2=0x7f3990063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3990060f70 0x7f3990063430 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f3998005010 tx=0x7f3998016040).stop 2023-10-18T22:27:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 -- 172.21.15.8:0/722871777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39a80f77d0 msgr2=0x7f39a8109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39a80f77d0 0x7f39a8109450 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f399c00e7f0 tx=0x7f399c00b040).stop 2023-10-18T22:27:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 -- 172.21.15.8:0/722871777 shutdown_connections 2023-10-18T22:27:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3990060f70 0x7f3990063430 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a80f6530 0x7f39a8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 --2- 172.21.15.8:0/722871777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39a80f77d0 0x7f39a8109450 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 -- 172.21.15.8:0/722871777 >> 172.21.15.8:0/722871777 conn(0x7f39a80f1c90 msgr2=0x7f39a806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 -- 172.21.15.8:0/722871777 shutdown_connections 2023-10-18T22:27:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.381+0000 7f39a759e700 1 -- 172.21.15.8:0/722871777 wait complete. 2023-10-18T22:27:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.522+0000 7faaef59e700 1 -- 172.21.15.8:0/1837523909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaf00f6530 msgr2=0x7faaf00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.522+0000 7faaef59e700 1 --2- 172.21.15.8:0/1837523909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaf00f6530 0x7faaf00f6950 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 rx=0x7faae0004660 tx=0x7faae0009b30).stop 2023-10-18T22:27:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.522+0000 7faaef59e700 1 -- 172.21.15.8:0/1837523909 shutdown_connections 2023-10-18T22:27:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.522+0000 7faaef59e700 1 --2- 172.21.15.8:0/1837523909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf00f77d0 0x7faaf00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.522+0000 7faaef59e700 1 --2- 172.21.15.8:0/1837523909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaf00f6530 0x7faaf00f6950 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.522+0000 7faaef59e700 1 -- 172.21.15.8:0/1837523909 >> 172.21.15.8:0/1837523909 conn(0x7faaf00f1c90 msgr2=0x7faaf00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:17.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.522+0000 7faaef59e700 1 -- 172.21.15.8:0/1837523909 shutdown_connections 2023-10-18T22:27:17.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.522+0000 7faaef59e700 1 -- 172.21.15.8:0/1837523909 wait complete. 2023-10-18T22:27:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.523+0000 7faaef59e700 1 Processor -- start 2023-10-18T22:27:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.524+0000 7faaef59e700 1 -- start start 2023-10-18T22:27:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.524+0000 7faaef59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaf00f6530 0x7faaf006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.524+0000 7faaef59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf00f77d0 0x7faaf0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.524+0000 7faaef59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf006a380 con 0x7faaf00f6530 2023-10-18T22:27:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.524+0000 7faaef59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf006a4c0 con 0x7faaf00f77d0 2023-10-18T22:27:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.524+0000 7faaee59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaf00f6530 0x7faaf006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.524+0000 7faaee59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaf00f6530 0x7faaf006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38706/0 (socket says 172.21.15.8:38706) 2023-10-18T22:27:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.524+0000 7faaee59c700 1 -- 172.21.15.8:0/1599808090 learned_addr learned my addr 172.21.15.8:0/1599808090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.524+0000 7faaedd9b700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf00f77d0 0x7faaf0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.525+0000 7faaee59c700 1 -- 172.21.15.8:0/1599808090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf00f77d0 msgr2=0x7faaf0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.525+0000 7faaee59c700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf00f77d0 0x7faaf0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.525+0000 7faaee59c700 1 -- 172.21.15.8:0/1599808090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae0005040 con 0x7faaf00f6530 2023-10-18T22:27:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.525+0000 7faaee59c700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaf00f6530 0x7faaf006b9a0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7faae0007a60 tx=0x7faae0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.525+0000 7faadeffd700 1 -- 172.21.15.8:0/1599808090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae0018070 con 0x7faaf00f6530 2023-10-18T22:27:17.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.525+0000 7faadeffd700 1 -- 172.21.15.8:0/1599808090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faae0009630 con 0x7faaf00f6530 2023-10-18T22:27:17.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.525+0000 7faaef59e700 1 -- 172.21.15.8:0/1599808090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf006a740 con 0x7faaf00f6530 2023-10-18T22:27:17.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.525+0000 7faadeffd700 1 -- 172.21.15.8:0/1599808090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae001c4d0 con 0x7faaf00f6530 2023-10-18T22:27:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.525+0000 7faaef59e700 1 -- 172.21.15.8:0/1599808090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf006aca0 con 0x7faaf00f6530 2023-10-18T22:27:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.527+0000 7faaef59e700 1 -- 172.21.15.8:0/1599808090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf0045ad0 con 0x7faaf00f6530 2023-10-18T22:27:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.527+0000 7faadeffd700 1 -- 172.21.15.8:0/1599808090 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faae001d420 con 0x7faaf00f6530 2023-10-18T22:27:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.528+0000 7faadeffd700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faad8060f70 0x7faad8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.529+0000 7faadeffd700 1 -- 172.21.15.8:0/1599808090 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faae007e650 con 0x7faaf00f6530 2023-10-18T22:27:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.529+0000 7faaedd9b700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faad8060f70 0x7faad8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.529+0000 7faaedd9b700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faad8060f70 0x7faad8063430 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7faae4004e20 tx=0x7faae400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:17.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.533+0000 7faadeffd700 1 -- 172.21.15.8:0/1599808090 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faae004e270 con 0x7faaf00f6530 2023-10-18T22:27:17.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.726+0000 7faaef59e700 1 -- 172.21.15.8:0/1599808090 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faaf0057f10 con 0x7faad8060f70 2023-10-18T22:27:17.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.736+0000 7faadeffd700 1 -- 172.21.15.8:0/1599808090 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7faaf0057f10 con 0x7faad8060f70 2023-10-18T22:27:17.738 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:27:17.739 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (93m) 56s ago 95m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:27:17.739 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (87m) 56s ago 95m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:27:17.739 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (87m) 8m ago 94m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:27:17.739 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (93m) 56s ago 95m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:27:17.739 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 56s ago 91m - - 2023-10-18T22:27:17.740 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 56s ago 91m - - 2023-10-18T22:27:17.740 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 8m ago 91m - - 2023-10-18T22:27:17.740 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 8m ago 91m - - 2023-10-18T22:27:17.740 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (89m) 56s ago 96m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:27:17.740 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (88m) 8m ago 94m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:27:17.740 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (88m) 56s ago 96m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:27:17.741 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (88m) 8m ago 94m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:27:17.741 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (94m) 56s ago 94m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:27:17.741 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (94m) 8m ago 94m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:27:17.741 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (87m) 56s ago 94m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:27:17.741 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (85m) 56s ago 93m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:27:17.742 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (85m) 56s ago 93m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:27:17.742 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (84m) 8m ago 93m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:27:17.742 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (83m) 8m ago 92m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:27:17.742 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (83m) 8m ago 92m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:27:17.742 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (89m) 56s ago 94m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:27:17.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 -- 172.21.15.8:0/1599808090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faad8060f70 msgr2=0x7faad8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faad8060f70 0x7faad8063430 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7faae4004e20 tx=0x7faae400b040).stop 2023-10-18T22:27:17.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 -- 172.21.15.8:0/1599808090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaf00f6530 msgr2=0x7faaf006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaf00f6530 0x7faaf006b9a0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7faae0007a60 tx=0x7faae0009b30).stop 2023-10-18T22:27:17.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 -- 172.21.15.8:0/1599808090 shutdown_connections 2023-10-18T22:27:17.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faad8060f70 0x7faad8063430 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faaf00f6530 0x7faaf006b9a0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 --2- 172.21.15.8:0/1599808090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf00f77d0 0x7faaf0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 -- 172.21.15.8:0/1599808090 >> 172.21.15.8:0/1599808090 conn(0x7faaf00f1c90 msgr2=0x7faaf00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:17.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 -- 172.21.15.8:0/1599808090 shutdown_connections 2023-10-18T22:27:17.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.738+0000 7faaef59e700 1 -- 172.21.15.8:0/1599808090 wait complete. 2023-10-18T22:27:17.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.873+0000 7ff76d9cb700 1 -- 172.21.15.8:0/1127713029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7680f6530 msgr2=0x7ff7680f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.873+0000 7ff76d9cb700 1 --2- 172.21.15.8:0/1127713029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7680f6530 0x7ff7680f6950 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7ff75c004660 tx=0x7ff75c009b30).stop 2023-10-18T22:27:17.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.873+0000 7ff76d9cb700 1 -- 172.21.15.8:0/1127713029 shutdown_connections 2023-10-18T22:27:17.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.873+0000 7ff76d9cb700 1 --2- 172.21.15.8:0/1127713029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7680f77d0 0x7ff7680f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.873+0000 7ff76d9cb700 1 --2- 172.21.15.8:0/1127713029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7680f6530 0x7ff7680f6950 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.873+0000 7ff76d9cb700 1 -- 172.21.15.8:0/1127713029 >> 172.21.15.8:0/1127713029 conn(0x7ff7680f1c90 msgr2=0x7ff7680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:17.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.873+0000 7ff76d9cb700 1 -- 172.21.15.8:0/1127713029 shutdown_connections 2023-10-18T22:27:17.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.873+0000 7ff76d9cb700 1 -- 172.21.15.8:0/1127713029 wait complete. 2023-10-18T22:27:17.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.874+0000 7ff76d9cb700 1 Processor -- start 2023-10-18T22:27:17.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.874+0000 7ff76d9cb700 1 -- start start 2023-10-18T22:27:17.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff76d9cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7680f6530 0x7ff768108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:17.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff76d9cb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7680f77d0 0x7ff768109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:17.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff76d9cb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff768109a00 con 0x7ff7680f77d0 2023-10-18T22:27:17.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff76d9cb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff768109b40 con 0x7ff7680f6530 2023-10-18T22:27:17.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff767fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7680f77d0 0x7ff768109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:17.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff767fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7680f77d0 0x7ff768109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38728/0 (socket says 172.21.15.8:38728) 2023-10-18T22:27:17.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff767fff700 1 -- 172.21.15.8:0/2763815790 learned_addr learned my addr 172.21.15.8:0/2763815790 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:17.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff76c9c9700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7680f6530 0x7ff768108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:17.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff767fff700 1 -- 172.21.15.8:0/2763815790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7680f6530 msgr2=0x7ff768108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:17.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff767fff700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7680f6530 0x7ff768108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:17.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.875+0000 7ff767fff700 1 -- 172.21.15.8:0/2763815790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c005040 con 0x7ff7680f77d0 2023-10-18T22:27:17.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.876+0000 7ff767fff700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7680f77d0 0x7ff768109450 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7ff75400e7f0 tx=0x7ff75400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:17.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.876+0000 7ff7657fa700 1 -- 172.21.15.8:0/2763815790 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7540092e0 con 0x7ff7680f77d0 2023-10-18T22:27:17.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.876+0000 7ff7657fa700 1 -- 172.21.15.8:0/2763815790 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff75400f040 con 0x7ff7680f77d0 2023-10-18T22:27:17.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.876+0000 7ff76d9cb700 1 -- 172.21.15.8:0/2763815790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76810a4e0 con 0x7ff7680f77d0 2023-10-18T22:27:17.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.876+0000 7ff7657fa700 1 -- 172.21.15.8:0/2763815790 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7540147e0 con 0x7ff7680f77d0 2023-10-18T22:27:17.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.876+0000 7ff76d9cb700 1 -- 172.21.15.8:0/2763815790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76810aa20 con 0x7ff7680f77d0 2023-10-18T22:27:17.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.877+0000 7ff76d9cb700 1 -- 172.21.15.8:0/2763815790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff768045ad0 con 0x7ff7680f77d0 2023-10-18T22:27:17.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.878+0000 7ff7657fa700 1 -- 172.21.15.8:0/2763815790 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff75401b030 con 0x7ff7680f77d0 2023-10-18T22:27:17.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.879+0000 7ff7657fa700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff758060f70 0x7ff758063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:17.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.879+0000 7ff7657fa700 1 -- 172.21.15.8:0/2763815790 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff75407c700 con 0x7ff7680f77d0 2023-10-18T22:27:17.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.879+0000 7ff76c9c9700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff758060f70 0x7ff758063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:17.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.880+0000 7ff76c9c9700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff758060f70 0x7ff758063430 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7ff75c005010 tx=0x7ff75c016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:17.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:17.883+0000 7ff7657fa700 1 -- 172.21.15.8:0/2763815790 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff75404fe50 con 0x7ff7680f77d0 2023-10-18T22:27:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:16.339017+0000 mgr.smithi008.flmjzp (mgr.14640) 5297 : cluster [DBG] pgmap v3633: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:16.339017+0000 mgr.smithi008.flmjzp (mgr.14640) 5297 : cluster [DBG] pgmap v3633: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.135+0000 7ff76d9cb700 1 -- 172.21.15.8:0/2763815790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff768027a00 con 0x7ff7680f77d0 2023-10-18T22:27:18.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.135+0000 7ff7657fa700 1 -- 172.21.15.8:0/2763815790 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7ff754019020 con 0x7ff7680f77d0 2023-10-18T22:27:18.138 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:27:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:27:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:27:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:27:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:27:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:27:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:27:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:27:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:27:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:27:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:27:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:27:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:27:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:27:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:27:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:27:18.142 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:27:18.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.137+0000 7ff76d9cb700 1 -- 172.21.15.8:0/2763815790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff758060f70 msgr2=0x7ff758063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.137+0000 7ff76d9cb700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff758060f70 0x7ff758063430 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7ff75c005010 tx=0x7ff75c016040).stop 2023-10-18T22:27:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.137+0000 7ff76d9cb700 1 -- 172.21.15.8:0/2763815790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7680f77d0 msgr2=0x7ff768109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.137+0000 7ff76d9cb700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7680f77d0 0x7ff768109450 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7ff75400e7f0 tx=0x7ff75400b040).stop 2023-10-18T22:27:18.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.137+0000 7ff76d9cb700 1 -- 172.21.15.8:0/2763815790 shutdown_connections 2023-10-18T22:27:18.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.137+0000 7ff76d9cb700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff758060f70 0x7ff758063430 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.137+0000 7ff76d9cb700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7680f6530 0x7ff768108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.137+0000 7ff76d9cb700 1 --2- 172.21.15.8:0/2763815790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7680f77d0 0x7ff768109450 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.137+0000 7ff76d9cb700 1 -- 172.21.15.8:0/2763815790 >> 172.21.15.8:0/2763815790 conn(0x7ff7680f1c90 msgr2=0x7ff76806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:18.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.137+0000 7ff76d9cb700 1 -- 172.21.15.8:0/2763815790 shutdown_connections 2023-10-18T22:27:18.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.138+0000 7ff76d9cb700 1 -- 172.21.15.8:0/2763815790 wait complete. 2023-10-18T22:27:18.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.275+0000 7ff36abb4700 1 -- 172.21.15.8:0/705395937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3640f77d0 msgr2=0x7ff3640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:18.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.275+0000 7ff36abb4700 1 --2- 172.21.15.8:0/705395937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3640f77d0 0x7ff3640f7c30 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7ff354004660 tx=0x7ff354009b30).stop 2023-10-18T22:27:18.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.276+0000 7ff36abb4700 1 -- 172.21.15.8:0/705395937 shutdown_connections 2023-10-18T22:27:18.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.276+0000 7ff36abb4700 1 --2- 172.21.15.8:0/705395937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3640f77d0 0x7ff3640f7c30 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.276+0000 7ff36abb4700 1 --2- 172.21.15.8:0/705395937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3640f6530 0x7ff3640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.276+0000 7ff36abb4700 1 -- 172.21.15.8:0/705395937 >> 172.21.15.8:0/705395937 conn(0x7ff3640f1c90 msgr2=0x7ff3640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:18.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.276+0000 7ff36abb4700 1 -- 172.21.15.8:0/705395937 shutdown_connections 2023-10-18T22:27:18.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.276+0000 7ff36abb4700 1 -- 172.21.15.8:0/705395937 wait complete. 2023-10-18T22:27:18.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.276+0000 7ff36abb4700 1 Processor -- start 2023-10-18T22:27:18.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.277+0000 7ff36abb4700 1 -- start start 2023-10-18T22:27:18.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.277+0000 7ff36abb4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3640f6530 0x7ff364108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:18.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.277+0000 7ff36abb4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3640f77d0 0x7ff364109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:18.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.277+0000 7ff36abb4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3641099b0 con 0x7ff3640f6530 2023-10-18T22:27:18.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.277+0000 7ff36abb4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff364109af0 con 0x7ff3640f77d0 2023-10-18T22:27:18.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.277+0000 7ff369bb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3640f6530 0x7ff364108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:18.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.277+0000 7ff369bb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3640f6530 0x7ff364108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38744/0 (socket says 172.21.15.8:38744) 2023-10-18T22:27:18.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.277+0000 7ff369bb2700 1 -- 172.21.15.8:0/1590730723 learned_addr learned my addr 172.21.15.8:0/1590730723 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:18.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.277+0000 7ff3693b1700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3640f77d0 0x7ff364109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:18.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.278+0000 7ff369bb2700 1 -- 172.21.15.8:0/1590730723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3640f77d0 msgr2=0x7ff364109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:18.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.278+0000 7ff369bb2700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3640f77d0 0x7ff364109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.278+0000 7ff369bb2700 1 -- 172.21.15.8:0/1590730723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff354005040 con 0x7ff3640f6530 2023-10-18T22:27:18.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.278+0000 7ff369bb2700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3640f6530 0x7ff364108f10 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7ff36000c790 tx=0x7ff360007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:18.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.278+0000 7ff35a7fc700 1 -- 172.21.15.8:0/1590730723 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff360013630 con 0x7ff3640f6530 2023-10-18T22:27:18.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.278+0000 7ff35a7fc700 1 -- 172.21.15.8:0/1590730723 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff360012870 con 0x7ff3640f6530 2023-10-18T22:27:18.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.278+0000 7ff35a7fc700 1 -- 172.21.15.8:0/1590730723 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff360002830 con 0x7ff3640f6530 2023-10-18T22:27:18.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.278+0000 7ff36abb4700 1 -- 172.21.15.8:0/1590730723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36410a490 con 0x7ff3640f6530 2023-10-18T22:27:18.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.278+0000 7ff36abb4700 1 -- 172.21.15.8:0/1590730723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36410aa50 con 0x7ff3640f6530 2023-10-18T22:27:18.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.279+0000 7ff36abb4700 1 -- 172.21.15.8:0/1590730723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff364045ad0 con 0x7ff3640f6530 2023-10-18T22:27:18.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.280+0000 7ff35a7fc700 1 -- 172.21.15.8:0/1590730723 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff360010070 con 0x7ff3640f6530 2023-10-18T22:27:18.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.281+0000 7ff35a7fc700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff350060f70 0x7ff350063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:18.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.281+0000 7ff35a7fc700 1 -- 172.21.15.8:0/1590730723 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff36007c9c0 con 0x7ff3640f6530 2023-10-18T22:27:18.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.281+0000 7ff3693b1700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff350060f70 0x7ff350063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:18.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.282+0000 7ff3693b1700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff350060f70 0x7ff350063430 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7ff354009f50 tx=0x7ff354009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:18.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.285+0000 7ff35a7fc700 1 -- 172.21.15.8:0/1590730723 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff36004ffc0 con 0x7ff3640f6530 2023-10-18T22:27:18.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.511+0000 7ff36abb4700 1 -- 172.21.15.8:0/1590730723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff3640fed60 con 0x7ff3640f6530 2023-10-18T22:27:18.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.512+0000 7ff35a7fc700 1 -- 172.21.15.8:0/1590730723 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7ff36004fbb0 con 0x7ff3640f6530 2023-10-18T22:27:18.515 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:27:18.515 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:27:18.515 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:27:18.515 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:27:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:27:18.516 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:27:18.516 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:27:18.516 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:27:18.516 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:27:18.517 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:27:18.517 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:27:18.517 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:27:18.517 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:27:18.517 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:27:18.518 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:27:18.518 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:27:18.518 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:27:18.518 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:27:18.518 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:27:18.519 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:27:18.519 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:27:18.519 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:27:18.519 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:27:18.519 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:27:18.520 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:27:18.520 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:27:18.520 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:27:18.520 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:27:18.520 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:27:18.520 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:27:18.521 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:27:18.521 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:27:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:27:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:27:18.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 -- 172.21.15.8:0/1590730723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff350060f70 msgr2=0x7ff350063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:18.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff350060f70 0x7ff350063430 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7ff354009f50 tx=0x7ff354009b30).stop 2023-10-18T22:27:18.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 -- 172.21.15.8:0/1590730723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3640f6530 msgr2=0x7ff364108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:18.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3640f6530 0x7ff364108f10 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7ff36000c790 tx=0x7ff360007d90).stop 2023-10-18T22:27:18.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 -- 172.21.15.8:0/1590730723 shutdown_connections 2023-10-18T22:27:18.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff350060f70 0x7ff350063430 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3640f6530 0x7ff364108f10 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 --2- 172.21.15.8:0/1590730723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3640f77d0 0x7ff364109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 -- 172.21.15.8:0/1590730723 >> 172.21.15.8:0/1590730723 conn(0x7ff3640f1c90 msgr2=0x7ff36406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 -- 172.21.15.8:0/1590730723 shutdown_connections 2023-10-18T22:27:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.514+0000 7ff36abb4700 1 -- 172.21.15.8:0/1590730723 wait complete. 2023-10-18T22:27:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:27:18.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.652+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3686435300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b840f6530 msgr2=0x7f9b840f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:18.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.652+0000 7f9b8af6f700 1 --2- 172.21.15.8:0/3686435300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b840f6530 0x7f9b840f6950 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7f9b80004660 tx=0x7f9b80009b30).stop 2023-10-18T22:27:18.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.652+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3686435300 shutdown_connections 2023-10-18T22:27:18.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.652+0000 7f9b8af6f700 1 --2- 172.21.15.8:0/3686435300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b840f77d0 0x7f9b840f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.652+0000 7f9b8af6f700 1 --2- 172.21.15.8:0/3686435300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b840f6530 0x7f9b840f6950 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.652+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3686435300 >> 172.21.15.8:0/3686435300 conn(0x7f9b840f1c90 msgr2=0x7f9b840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:18.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.652+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3686435300 shutdown_connections 2023-10-18T22:27:18.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.652+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3686435300 wait complete. 2023-10-18T22:27:18.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.653+0000 7f9b8af6f700 1 Processor -- start 2023-10-18T22:27:18.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.653+0000 7f9b8af6f700 1 -- start start 2023-10-18T22:27:18.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.653+0000 7f9b8af6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b840f6530 0x7f9b84108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:18.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.653+0000 7f9b8af6f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b840f77d0 0x7f9b84109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:18.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.653+0000 7f9b8af6f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84109a00 con 0x7f9b840f6530 2023-10-18T22:27:18.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.653+0000 7f9b8af6f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84109b40 con 0x7f9b840f77d0 2023-10-18T22:27:18.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b89f6d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b840f6530 0x7f9b84108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:18.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b89f6d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b840f6530 0x7f9b84108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38758/0 (socket says 172.21.15.8:38758) 2023-10-18T22:27:18.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b89f6d700 1 -- 172.21.15.8:0/3650412030 learned_addr learned my addr 172.21.15.8:0/3650412030 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:18.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b8976c700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b840f77d0 0x7f9b84109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:18.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b89f6d700 1 -- 172.21.15.8:0/3650412030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b840f77d0 msgr2=0x7f9b84109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:18.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b89f6d700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b840f77d0 0x7f9b84109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b89f6d700 1 -- 172.21.15.8:0/3650412030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80005040 con 0x7f9b840f6530 2023-10-18T22:27:18.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b89f6d700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b840f6530 0x7f9b84108f60 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x7f9b80009870 tx=0x7f9b8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:18.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b7a7fc700 1 -- 172.21.15.8:0/3650412030 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b80019070 con 0x7f9b840f6530 2023-10-18T22:27:18.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b7a7fc700 1 -- 172.21.15.8:0/3650412030 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9b8001e420 con 0x7f9b840f6530 2023-10-18T22:27:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.654+0000 7f9b7a7fc700 1 -- 172.21.15.8:0/3650412030 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b80014660 con 0x7f9b840f6530 2023-10-18T22:27:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.655+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3650412030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8410a480 con 0x7f9b840f6530 2023-10-18T22:27:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.655+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3650412030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8410a960 con 0x7f9b840f6530 2023-10-18T22:27:18.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.656+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3650412030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b84045ad0 con 0x7f9b840f6530 2023-10-18T22:27:18.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.657+0000 7f9b7a7fc700 1 -- 172.21.15.8:0/3650412030 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9b8001e9c0 con 0x7f9b840f6530 2023-10-18T22:27:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.658+0000 7f9b7a7fc700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9b70060f70 0x7f9b70063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.658+0000 7f9b7a7fc700 1 -- 172.21.15.8:0/3650412030 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9b8007e460 con 0x7f9b840f6530 2023-10-18T22:27:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.659+0000 7f9b8976c700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9b70060f70 0x7f9b70063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.659+0000 7f9b8976c700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9b70060f70 0x7f9b70063430 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f9b74007f80 tx=0x7f9b7400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:18.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.661+0000 7f9b7a7fc700 1 -- 172.21.15.8:0/3650412030 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9b80051ac0 con 0x7f9b840f6530 2023-10-18T22:27:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:17.032197+0000 mgr.smithi008.flmjzp (mgr.14640) 5298 : audit [DBG] from='client.38224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:17.380406+0000 mgr.smithi008.flmjzp (mgr.14640) 5299 : audit [DBG] from='client.38228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:18.136821+0000 mon.smithi008 (mon.0) 5545 : audit [DBG] from='client.? 172.21.15.8:0/2763815790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:18.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:18.513675+0000 mon.smithi008 (mon.0) 5546 : audit [DBG] from='client.? 172.21.15.8:0/1590730723' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:27:18.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.864+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3650412030 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b8410abd0 con 0x7f9b70060f70 2023-10-18T22:27:18.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.866+0000 7f9b7a7fc700 1 -- 172.21.15.8:0/3650412030 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9b8410abd0 con 0x7f9b70060f70 2023-10-18T22:27:18.868 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:27:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:27:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:27:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:27:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:27:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:27:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:27:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:27:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:27:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:27:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:27:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:27:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:27:18.871 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:27:18.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3650412030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9b70060f70 msgr2=0x7f9b70063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:18.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9b70060f70 0x7f9b70063430 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f9b74007f80 tx=0x7f9b7400b040).stop 2023-10-18T22:27:18.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3650412030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b840f6530 msgr2=0x7f9b84108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:18.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b840f6530 0x7f9b84108f60 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x7f9b80009870 tx=0x7f9b8000b040).stop 2023-10-18T22:27:18.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3650412030 shutdown_connections 2023-10-18T22:27:18.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9b70060f70 0x7f9b70063430 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b840f6530 0x7f9b84108f60 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 --2- 172.21.15.8:0/3650412030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b840f77d0 0x7f9b84109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:18.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3650412030 >> 172.21.15.8:0/3650412030 conn(0x7f9b840f1c90 msgr2=0x7f9b8406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:18.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3650412030 shutdown_connections 2023-10-18T22:27:18.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:18.868+0000 7f9b8af6f700 1 -- 172.21.15.8:0/3650412030 wait complete. 2023-10-18T22:27:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:17.032197+0000 mgr.smithi008.flmjzp (mgr.14640) 5298 : audit [DBG] from='client.38224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:17.380406+0000 mgr.smithi008.flmjzp (mgr.14640) 5299 : audit [DBG] from='client.38228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:18.136821+0000 mon.smithi008 (mon.0) 5545 : audit [DBG] from='client.? 172.21.15.8:0/2763815790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:18.513675+0000 mon.smithi008 (mon.0) 5546 : audit [DBG] from='client.? 172.21.15.8:0/1590730723' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:27:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:17.728714+0000 mgr.smithi008.flmjzp (mgr.14640) 5300 : audit [DBG] from='client.38232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:18.339411+0000 mgr.smithi008.flmjzp (mgr.14640) 5301 : cluster [DBG] pgmap v3634: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:17.728714+0000 mgr.smithi008.flmjzp (mgr.14640) 5300 : audit [DBG] from='client.38232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:18.339411+0000 mgr.smithi008.flmjzp (mgr.14640) 5301 : cluster [DBG] pgmap v3634: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:18.867299+0000 mgr.smithi008.flmjzp (mgr.14640) 5302 : audit [DBG] from='client.38244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:20.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:20.340202+0000 mgr.smithi008.flmjzp (mgr.14640) 5303 : cluster [DBG] pgmap v3635: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:18.867299+0000 mgr.smithi008.flmjzp (mgr.14640) 5302 : audit [DBG] from='client.38244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:20.340202+0000 mgr.smithi008.flmjzp (mgr.14640) 5303 : cluster [DBG] pgmap v3635: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:22.368363+0000 mon.smithi008 (mon.0) 5547 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:22.370547+0000 mon.smithi008 (mon.0) 5548 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:22.371537+0000 mon.smithi008 (mon.0) 5549 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:22.378098+0000 mon.smithi008 (mon.0) 5550 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:22.384720+0000 mon.smithi008 (mon.0) 5551 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:22.387848+0000 mon.smithi008 (mon.0) 5552 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:22.389521+0000 mon.smithi008 (mon.0) 5553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:22.391184+0000 mon.smithi008 (mon.0) 5554 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:22.393273+0000 mon.smithi008 (mon.0) 5555 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:22.368363+0000 mon.smithi008 (mon.0) 5547 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:22.370547+0000 mon.smithi008 (mon.0) 5548 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:22.371537+0000 mon.smithi008 (mon.0) 5549 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:22.378098+0000 mon.smithi008 (mon.0) 5550 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:22.384720+0000 mon.smithi008 (mon.0) 5551 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:22.387848+0000 mon.smithi008 (mon.0) 5552 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:22.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:22.389521+0000 mon.smithi008 (mon.0) 5553 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:22.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:22.391184+0000 mon.smithi008 (mon.0) 5554 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:22.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:22.393273+0000 mon.smithi008 (mon.0) 5555 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:23.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:22.340735+0000 mgr.smithi008.flmjzp (mgr.14640) 5304 : cluster [DBG] pgmap v3636: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:22.372374+0000 mgr.smithi008.flmjzp (mgr.14640) 5305 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:22.372952+0000 mgr.smithi008.flmjzp (mgr.14640) 5306 : cluster [DBG] pgmap v3637: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:22.373201+0000 mgr.smithi008.flmjzp (mgr.14640) 5307 : cluster [DBG] pgmap v3638: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:23.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:22.395128+0000 mgr.smithi008.flmjzp (mgr.14640) 5308 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:22.340735+0000 mgr.smithi008.flmjzp (mgr.14640) 5304 : cluster [DBG] pgmap v3636: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:22.372374+0000 mgr.smithi008.flmjzp (mgr.14640) 5305 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:22.372952+0000 mgr.smithi008.flmjzp (mgr.14640) 5306 : cluster [DBG] pgmap v3637: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:22.373201+0000 mgr.smithi008.flmjzp (mgr.14640) 5307 : cluster [DBG] pgmap v3638: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:22.395128+0000 mgr.smithi008.flmjzp (mgr.14640) 5308 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:24.373887+0000 mgr.smithi008.flmjzp (mgr.14640) 5309 : cluster [DBG] pgmap v3639: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:24.373887+0000 mgr.smithi008.flmjzp (mgr.14640) 5309 : cluster [DBG] pgmap v3639: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:26.374603+0000 mgr.smithi008.flmjzp (mgr.14640) 5310 : cluster [DBG] pgmap v3640: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:26.374603+0000 mgr.smithi008.flmjzp (mgr.14640) 5310 : cluster [DBG] pgmap v3640: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:28.375137+0000 mgr.smithi008.flmjzp (mgr.14640) 5311 : cluster [DBG] pgmap v3641: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:28.375137+0000 mgr.smithi008.flmjzp (mgr.14640) 5311 : cluster [DBG] pgmap v3641: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:30.375735+0000 mgr.smithi008.flmjzp (mgr.14640) 5312 : cluster [DBG] pgmap v3642: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:30.375735+0000 mgr.smithi008.flmjzp (mgr.14640) 5312 : cluster [DBG] pgmap v3642: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:32.403119+0000 mon.smithi008 (mon.0) 5556 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:32.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:32.403119+0000 mon.smithi008 (mon.0) 5556 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:32.376282+0000 mgr.smithi008.flmjzp (mgr.14640) 5313 : cluster [DBG] pgmap v3643: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:32.965064+0000 mon.smithi008 (mon.0) 5557 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:32.965881+0000 mon.smithi008 (mon.0) 5558 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:32.971275+0000 mon.smithi008 (mon.0) 5559 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:32.976203+0000 mon.smithi008 (mon.0) 5560 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:33.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:32.978498+0000 mon.smithi008 (mon.0) 5561 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:33.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:32.979704+0000 mon.smithi008 (mon.0) 5562 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:33.741 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:32.980895+0000 mon.smithi008 (mon.0) 5563 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:33.742 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:32.982419+0000 mon.smithi008 (mon.0) 5564 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:33.860 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:32.376282+0000 mgr.smithi008.flmjzp (mgr.14640) 5313 : cluster [DBG] pgmap v3643: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:33.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:32.965064+0000 mon.smithi008 (mon.0) 5557 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:33.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:32.965881+0000 mon.smithi008 (mon.0) 5558 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:33.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:32.971275+0000 mon.smithi008 (mon.0) 5559 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:33.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:32.976203+0000 mon.smithi008 (mon.0) 5560 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:33.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:32.978498+0000 mon.smithi008 (mon.0) 5561 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:33.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:32.979704+0000 mon.smithi008 (mon.0) 5562 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:33.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:32.980895+0000 mon.smithi008 (mon.0) 5563 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:33.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:32.982419+0000 mon.smithi008 (mon.0) 5564 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:32.966568+0000 mgr.smithi008.flmjzp (mgr.14640) 5314 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:32.967048+0000 mgr.smithi008.flmjzp (mgr.14640) 5315 : cluster [DBG] pgmap v3644: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:32.967241+0000 mgr.smithi008.flmjzp (mgr.14640) 5316 : cluster [DBG] pgmap v3645: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:32.983927+0000 mgr.smithi008.flmjzp (mgr.14640) 5317 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:32.966568+0000 mgr.smithi008.flmjzp (mgr.14640) 5314 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:32.967048+0000 mgr.smithi008.flmjzp (mgr.14640) 5315 : cluster [DBG] pgmap v3644: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:32.967241+0000 mgr.smithi008.flmjzp (mgr.14640) 5316 : cluster [DBG] pgmap v3645: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:34.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:32.983927+0000 mgr.smithi008.flmjzp (mgr.14640) 5317 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:34.967824+0000 mgr.smithi008.flmjzp (mgr.14640) 5318 : cluster [DBG] pgmap v3646: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:34.967824+0000 mgr.smithi008.flmjzp (mgr.14640) 5318 : cluster [DBG] pgmap v3646: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:36.968528+0000 mgr.smithi008.flmjzp (mgr.14640) 5319 : cluster [DBG] pgmap v3647: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:36.968528+0000 mgr.smithi008.flmjzp (mgr.14640) 5319 : cluster [DBG] pgmap v3647: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:38.969218+0000 mgr.smithi008.flmjzp (mgr.14640) 5320 : cluster [DBG] pgmap v3648: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:38.969218+0000 mgr.smithi008.flmjzp (mgr.14640) 5320 : cluster [DBG] pgmap v3648: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:40.969870+0000 mgr.smithi008.flmjzp (mgr.14640) 5321 : cluster [DBG] pgmap v3649: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:40.969870+0000 mgr.smithi008.flmjzp (mgr.14640) 5321 : cluster [DBG] pgmap v3649: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:42.994716+0000 mon.smithi008 (mon.0) 5565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:43.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:42.996887+0000 mon.smithi008 (mon.0) 5566 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:42.997907+0000 mon.smithi008 (mon.0) 5567 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:43.004492+0000 mon.smithi008 (mon.0) 5568 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:43.011379+0000 mon.smithi008 (mon.0) 5569 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:43.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:43.014516+0000 mon.smithi008 (mon.0) 5570 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:43.016210+0000 mon.smithi008 (mon.0) 5571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:43.017929+0000 mon.smithi008 (mon.0) 5572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:43.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:43.019917+0000 mon.smithi008 (mon.0) 5573 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:43.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:42.994716+0000 mon.smithi008 (mon.0) 5565 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:43.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:42.996887+0000 mon.smithi008 (mon.0) 5566 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:43.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:42.997907+0000 mon.smithi008 (mon.0) 5567 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:43.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:43.004492+0000 mon.smithi008 (mon.0) 5568 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:43.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:43.011379+0000 mon.smithi008 (mon.0) 5569 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:43.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:43.014516+0000 mon.smithi008 (mon.0) 5570 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:43.863 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:43.016210+0000 mon.smithi008 (mon.0) 5571 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:43.863 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:43.017929+0000 mon.smithi008 (mon.0) 5572 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:43.863 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:43.019917+0000 mon.smithi008 (mon.0) 5573 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:42.970519+0000 mgr.smithi008.flmjzp (mgr.14640) 5322 : cluster [DBG] pgmap v3650: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:42.998780+0000 mgr.smithi008.flmjzp (mgr.14640) 5323 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:42.999366+0000 mgr.smithi008.flmjzp (mgr.14640) 5324 : cluster [DBG] pgmap v3651: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:42.999680+0000 mgr.smithi008.flmjzp (mgr.14640) 5325 : cluster [DBG] pgmap v3652: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:43.021854+0000 mgr.smithi008.flmjzp (mgr.14640) 5326 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:42.970519+0000 mgr.smithi008.flmjzp (mgr.14640) 5322 : cluster [DBG] pgmap v3650: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:42.998780+0000 mgr.smithi008.flmjzp (mgr.14640) 5323 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:42.999366+0000 mgr.smithi008.flmjzp (mgr.14640) 5324 : cluster [DBG] pgmap v3651: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:42.999680+0000 mgr.smithi008.flmjzp (mgr.14640) 5325 : cluster [DBG] pgmap v3652: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:44.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:43.021854+0000 mgr.smithi008.flmjzp (mgr.14640) 5326 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:45.000255+0000 mgr.smithi008.flmjzp (mgr.14640) 5327 : cluster [DBG] pgmap v3653: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:45.000255+0000 mgr.smithi008.flmjzp (mgr.14640) 5327 : cluster [DBG] pgmap v3653: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:47.000825+0000 mgr.smithi008.flmjzp (mgr.14640) 5328 : cluster [DBG] pgmap v3654: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:48.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:47.000825+0000 mgr.smithi008.flmjzp (mgr.14640) 5328 : cluster [DBG] pgmap v3654: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:49.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.023+0000 7fc435332700 1 -- 172.21.15.8:0/811177499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430060310 msgr2=0x7fc4300f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.023+0000 7fc435332700 1 --2- 172.21.15.8:0/811177499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430060310 0x7fc4300f9110 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7fc420004660 tx=0x7fc420009b30).stop 2023-10-18T22:27:49.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.023+0000 7fc435332700 1 -- 172.21.15.8:0/811177499 shutdown_connections 2023-10-18T22:27:49.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.023+0000 7fc435332700 1 --2- 172.21.15.8:0/811177499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4300f9690 0x7fc4300fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.023+0000 7fc435332700 1 --2- 172.21.15.8:0/811177499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430060310 0x7fc4300f9110 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.023+0000 7fc435332700 1 -- 172.21.15.8:0/811177499 >> 172.21.15.8:0/811177499 conn(0x7fc4300f0b90 msgr2=0x7fc4300f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:49.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.023+0000 7fc435332700 1 -- 172.21.15.8:0/811177499 shutdown_connections 2023-10-18T22:27:49.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.023+0000 7fc435332700 1 -- 172.21.15.8:0/811177499 wait complete. 2023-10-18T22:27:49.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.024+0000 7fc435332700 1 Processor -- start 2023-10-18T22:27:49.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.024+0000 7fc435332700 1 -- start start 2023-10-18T22:27:49.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc435332700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430060310 0x7fc430106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:49.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc435332700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4300f9690 0x7fc430107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:49.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc435332700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc430107850 con 0x7fc430060310 2023-10-18T22:27:49.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc435332700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc430108060 con 0x7fc4300f9690 2023-10-18T22:27:49.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc42ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430060310 0x7fc430106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:49.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc42ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430060310 0x7fc430106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40930/0 (socket says 172.21.15.8:40930) 2023-10-18T22:27:49.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc42ffff700 1 -- 172.21.15.8:0/3722987015 learned_addr learned my addr 172.21.15.8:0/3722987015 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:49.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc42f7fe700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4300f9690 0x7fc430107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:49.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc42ffff700 1 -- 172.21.15.8:0/3722987015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4300f9690 msgr2=0x7fc430107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc42ffff700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4300f9690 0x7fc430107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.025+0000 7fc42ffff700 1 -- 172.21.15.8:0/3722987015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc420005040 con 0x7fc430060310 2023-10-18T22:27:49.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.026+0000 7fc42ffff700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430060310 0x7fc430106d60 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7fc420004320 tx=0x7fc42000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:49.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.026+0000 7fc42cff9700 1 -- 172.21.15.8:0/3722987015 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc420019070 con 0x7fc430060310 2023-10-18T22:27:49.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.026+0000 7fc42cff9700 1 -- 172.21.15.8:0/3722987015 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc42001e420 con 0x7fc430060310 2023-10-18T22:27:49.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.026+0000 7fc42cff9700 1 -- 172.21.15.8:0/3722987015 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc420014680 con 0x7fc430060310 2023-10-18T22:27:49.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.026+0000 7fc435332700 1 -- 172.21.15.8:0/3722987015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc430108280 con 0x7fc430060310 2023-10-18T22:27:49.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.026+0000 7fc435332700 1 -- 172.21.15.8:0/3722987015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc430108760 con 0x7fc430060310 2023-10-18T22:27:49.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.027+0000 7fc435332700 1 -- 172.21.15.8:0/3722987015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc430059100 con 0x7fc430060310 2023-10-18T22:27:49.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.028+0000 7fc42cff9700 1 -- 172.21.15.8:0/3722987015 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc42001e590 con 0x7fc430060310 2023-10-18T22:27:49.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.029+0000 7fc42cff9700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc418060f70 0x7fc418063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:49.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.029+0000 7fc42cff9700 1 -- 172.21.15.8:0/3722987015 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc42007dc50 con 0x7fc430060310 2023-10-18T22:27:49.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.029+0000 7fc42f7fe700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc418060f70 0x7fc418063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:49.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.030+0000 7fc42f7fe700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc418060f70 0x7fc418063430 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fc424009fd0 tx=0x7fc42400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:49.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.033+0000 7fc42cff9700 1 -- 172.21.15.8:0/3722987015 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc42004d8e0 con 0x7fc430060310 2023-10-18T22:27:49.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.232+0000 7fc435332700 1 -- 172.21.15.8:0/3722987015 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4300008d0 con 0x7fc418060f70 2023-10-18T22:27:49.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.233+0000 7fc42cff9700 1 -- 172.21.15.8:0/3722987015 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc4300008d0 con 0x7fc418060f70 2023-10-18T22:27:49.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 -- 172.21.15.8:0/3722987015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc418060f70 msgr2=0x7fc418063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc418060f70 0x7fc418063430 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fc424009fd0 tx=0x7fc42400b040).stop 2023-10-18T22:27:49.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 -- 172.21.15.8:0/3722987015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430060310 msgr2=0x7fc430106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430060310 0x7fc430106d60 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7fc420004320 tx=0x7fc42000b040).stop 2023-10-18T22:27:49.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 -- 172.21.15.8:0/3722987015 shutdown_connections 2023-10-18T22:27:49.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc418060f70 0x7fc418063430 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430060310 0x7fc430106d60 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 --2- 172.21.15.8:0/3722987015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4300f9690 0x7fc430107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 -- 172.21.15.8:0/3722987015 >> 172.21.15.8:0/3722987015 conn(0x7fc4300f0b90 msgr2=0x7fc4300f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:49.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 -- 172.21.15.8:0/3722987015 shutdown_connections 2023-10-18T22:27:49.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.235+0000 7fc435332700 1 -- 172.21.15.8:0/3722987015 wait complete. 2023-10-18T22:27:49.251 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:27:49.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.373+0000 7f190a20e700 1 -- 172.21.15.8:0/2573673648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19040f6530 msgr2=0x7f19040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.373+0000 7f190a20e700 1 --2- 172.21.15.8:0/2573673648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19040f6530 0x7f19040f6950 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f1900004660 tx=0x7f1900009b30).stop 2023-10-18T22:27:49.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.373+0000 7f190a20e700 1 -- 172.21.15.8:0/2573673648 shutdown_connections 2023-10-18T22:27:49.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.373+0000 7f190a20e700 1 --2- 172.21.15.8:0/2573673648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19040f77d0 0x7f19040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.373+0000 7f190a20e700 1 --2- 172.21.15.8:0/2573673648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19040f6530 0x7f19040f6950 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.373+0000 7f190a20e700 1 -- 172.21.15.8:0/2573673648 >> 172.21.15.8:0/2573673648 conn(0x7f19040f1c90 msgr2=0x7f19040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:49.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.373+0000 7f190a20e700 1 -- 172.21.15.8:0/2573673648 shutdown_connections 2023-10-18T22:27:49.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.373+0000 7f190a20e700 1 -- 172.21.15.8:0/2573673648 wait complete. 2023-10-18T22:27:49.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.374+0000 7f190a20e700 1 Processor -- start 2023-10-18T22:27:49.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.374+0000 7f190a20e700 1 -- start start 2023-10-18T22:27:49.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.374+0000 7f190a20e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19040f6530 0x7f1904108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:49.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.374+0000 7f190a20e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19040f77d0 0x7f1904109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:49.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.374+0000 7f190a20e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904109a00 con 0x7f19040f77d0 2023-10-18T22:27:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.374+0000 7f190a20e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904109b40 con 0x7f19040f6530 2023-10-18T22:27:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.374+0000 7f1908a0b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19040f77d0 0x7f1904109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.374+0000 7f1908a0b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19040f77d0 0x7f1904109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40942/0 (socket says 172.21.15.8:40942) 2023-10-18T22:27:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.374+0000 7f1908a0b700 1 -- 172.21.15.8:0/2146378232 learned_addr learned my addr 172.21.15.8:0/2146378232 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.375+0000 7f190920c700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19040f6530 0x7f1904108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.375+0000 7f1908a0b700 1 -- 172.21.15.8:0/2146378232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19040f6530 msgr2=0x7f1904108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.375+0000 7f1908a0b700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19040f6530 0x7f1904108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.375+0000 7f1908a0b700 1 -- 172.21.15.8:0/2146378232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4005040 con 0x7f19040f77d0 2023-10-18T22:27:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.375+0000 7f1908a0b700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19040f77d0 0x7f1904109450 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7f18f4004870 tx=0x7f18f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.375+0000 7f18f9ffb700 1 -- 172.21.15.8:0/2146378232 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18f400e030 con 0x7f19040f77d0 2023-10-18T22:27:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.375+0000 7f18f9ffb700 1 -- 172.21.15.8:0/2146378232 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f18f400f040 con 0x7f19040f77d0 2023-10-18T22:27:49.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.375+0000 7f190a20e700 1 -- 172.21.15.8:0/2146378232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1900005040 con 0x7f19040f77d0 2023-10-18T22:27:49.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.375+0000 7f18f9ffb700 1 -- 172.21.15.8:0/2146378232 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18f4014940 con 0x7f19040f77d0 2023-10-18T22:27:49.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.376+0000 7f190a20e700 1 -- 172.21.15.8:0/2146378232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190410a890 con 0x7f19040f77d0 2023-10-18T22:27:49.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.377+0000 7f190a20e700 1 -- 172.21.15.8:0/2146378232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1904045ad0 con 0x7f19040f77d0 2023-10-18T22:27:49.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.377+0000 7f18f9ffb700 1 -- 172.21.15.8:0/2146378232 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f18f4010530 con 0x7f19040f77d0 2023-10-18T22:27:49.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.378+0000 7f18f9ffb700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18f0060f70 0x7f18f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.378+0000 7f18f9ffb700 1 -- 172.21.15.8:0/2146378232 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f18f407cff0 con 0x7f19040f77d0 2023-10-18T22:27:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.379+0000 7f190920c700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18f0060f70 0x7f18f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.379+0000 7f190920c700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18f0060f70 0x7f18f0063430 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f19000043d0 tx=0x7f190000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.382+0000 7f18f9ffb700 1 -- 172.21.15.8:0/2146378232 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f18f40505f0 con 0x7f19040f77d0 2023-10-18T22:27:49.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.580+0000 7f190a20e700 1 -- 172.21.15.8:0/2146378232 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f190410ab10 con 0x7f18f0060f70 2023-10-18T22:27:49.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.581+0000 7f18f9ffb700 1 -- 172.21.15.8:0/2146378232 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f190410ab10 con 0x7f18f0060f70 2023-10-18T22:27:49.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.583+0000 7f190a20e700 1 -- 172.21.15.8:0/2146378232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18f0060f70 msgr2=0x7f18f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.583+0000 7f190a20e700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18f0060f70 0x7f18f0063430 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f19000043d0 tx=0x7f190000b040).stop 2023-10-18T22:27:49.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.583+0000 7f190a20e700 1 -- 172.21.15.8:0/2146378232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19040f77d0 msgr2=0x7f1904109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.583+0000 7f190a20e700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19040f77d0 0x7f1904109450 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7f18f4004870 tx=0x7f18f4009b30).stop 2023-10-18T22:27:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.584+0000 7f190a20e700 1 -- 172.21.15.8:0/2146378232 shutdown_connections 2023-10-18T22:27:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.584+0000 7f190a20e700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18f0060f70 0x7f18f0063430 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.584+0000 7f190a20e700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19040f6530 0x7f1904108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.584+0000 7f190a20e700 1 --2- 172.21.15.8:0/2146378232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19040f77d0 0x7f1904109450 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.584+0000 7f190a20e700 1 -- 172.21.15.8:0/2146378232 >> 172.21.15.8:0/2146378232 conn(0x7f19040f1c90 msgr2=0x7f190406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:49.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.584+0000 7f190a20e700 1 -- 172.21.15.8:0/2146378232 shutdown_connections 2023-10-18T22:27:49.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.584+0000 7f190a20e700 1 -- 172.21.15.8:0/2146378232 wait complete. 2023-10-18T22:27:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.720+0000 7f1ec9040700 1 -- 172.21.15.8:0/899028325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ec40f6530 msgr2=0x7f1ec40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.720+0000 7f1ec9040700 1 --2- 172.21.15.8:0/899028325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ec40f6530 0x7f1ec40f6950 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7f1eb4004660 tx=0x7f1eb4009b30).stop 2023-10-18T22:27:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.720+0000 7f1ec9040700 1 -- 172.21.15.8:0/899028325 shutdown_connections 2023-10-18T22:27:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.720+0000 7f1ec9040700 1 --2- 172.21.15.8:0/899028325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec40f77d0 0x7f1ec40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.720+0000 7f1ec9040700 1 --2- 172.21.15.8:0/899028325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ec40f6530 0x7f1ec40f6950 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.720+0000 7f1ec9040700 1 -- 172.21.15.8:0/899028325 >> 172.21.15.8:0/899028325 conn(0x7f1ec40f1c90 msgr2=0x7f1ec40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:49.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.720+0000 7f1ec9040700 1 -- 172.21.15.8:0/899028325 shutdown_connections 2023-10-18T22:27:49.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.720+0000 7f1ec9040700 1 -- 172.21.15.8:0/899028325 wait complete. 2023-10-18T22:27:49.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.721+0000 7f1ec9040700 1 Processor -- start 2023-10-18T22:27:49.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.721+0000 7f1ec9040700 1 -- start start 2023-10-18T22:27:49.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.721+0000 7f1ec9040700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ec40f6530 0x7f1ec4108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:49.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.721+0000 7f1ec9040700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec40f77d0 0x7f1ec4109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:49.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.721+0000 7f1ec9040700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec41099f0 con 0x7f1ec40f6530 2023-10-18T22:27:49.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.721+0000 7f1ec9040700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec4109b30 con 0x7f1ec40f77d0 2023-10-18T22:27:49.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.721+0000 7f1ec3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ec40f6530 0x7f1ec4108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:49.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.721+0000 7f1ec3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ec40f6530 0x7f1ec4108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40958/0 (socket says 172.21.15.8:40958) 2023-10-18T22:27:49.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.722+0000 7f1ec3fff700 1 -- 172.21.15.8:0/1327215393 learned_addr learned my addr 172.21.15.8:0/1327215393 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:49.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.722+0000 7f1ec3fff700 1 -- 172.21.15.8:0/1327215393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec40f77d0 msgr2=0x7f1ec4109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.722+0000 7f1ec3fff700 1 --2- 172.21.15.8:0/1327215393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec40f77d0 0x7f1ec4109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:27:49.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.722+0000 7f1ec3fff700 1 -- 172.21.15.8:0/1327215393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb4005040 con 0x7f1ec40f6530 2023-10-18T22:27:49.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.722+0000 7f1ec3fff700 1 --2- 172.21.15.8:0/1327215393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ec40f6530 0x7f1ec4108f50 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7f1eb4009870 tx=0x7f1eb400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:49.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.722+0000 7f1ec0ff9700 1 -- 172.21.15.8:0/1327215393 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eb4019070 con 0x7f1ec40f6530 2023-10-18T22:27:49.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.722+0000 7f1ec9040700 1 -- 172.21.15.8:0/1327215393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec410a470 con 0x7f1ec40f6530 2023-10-18T22:27:49.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.722+0000 7f1ec0ff9700 1 -- 172.21.15.8:0/1327215393 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1eb401e420 con 0x7f1ec40f6530 2023-10-18T22:27:49.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.722+0000 7f1ec0ff9700 1 -- 172.21.15.8:0/1327215393 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eb4014660 con 0x7f1ec40f6530 2023-10-18T22:27:49.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.723+0000 7f1ec9040700 1 -- 172.21.15.8:0/1327215393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec410a950 con 0x7f1ec40f6530 2023-10-18T22:27:49.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.723+0000 7f1ec9040700 1 -- 172.21.15.8:0/1327215393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec4045ad0 con 0x7f1ec40f6530 2023-10-18T22:27:49.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.724+0000 7f1ec0ff9700 1 -- 172.21.15.8:0/1327215393 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1eb401e9c0 con 0x7f1ec40f6530 2023-10-18T22:27:49.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.725+0000 7f1ec0ff9700 1 --2- 172.21.15.8:0/1327215393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1eac060f70 0x7f1eac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:49.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.725+0000 7f1ec0ff9700 1 -- 172.21.15.8:0/1327215393 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1eb407de90 con 0x7f1ec40f6530 2023-10-18T22:27:49.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.725+0000 7f1ec37fe700 1 --2- 172.21.15.8:0/1327215393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1eac060f70 0x7f1eac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:49.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.726+0000 7f1ec37fe700 1 --2- 172.21.15.8:0/1327215393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1eac060f70 0x7f1eac063430 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f1eb8004b70 tx=0x7f1eb800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:49.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.729+0000 7f1ec0ff9700 1 -- 172.21.15.8:0/1327215393 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1eb4051470 con 0x7f1ec40f6530 2023-10-18T22:27:49.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.921+0000 7f1ec9040700 1 -- 172.21.15.8:0/1327215393 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ec410ab70 con 0x7f1eac060f70 2023-10-18T22:27:49.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.930+0000 7f1ec0ff9700 1 -- 172.21.15.8:0/1327215393 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1ec410ab70 con 0x7f1eac060f70 2023-10-18T22:27:49.932 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:27:49.932 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (94m) 88s ago 95m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:27:49.932 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (88m) 88s ago 95m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:27:49.933 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (88m) 9m ago 95m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:27:49.933 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (94m) 88s ago 95m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:27:49.933 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 88s ago 92m - - 2023-10-18T22:27:49.933 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 88s ago 91m - - 2023-10-18T22:27:49.934 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 9m ago 91m - - 2023-10-18T22:27:49.934 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 9m ago 91m - - 2023-10-18T22:27:49.934 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (89m) 88s ago 97m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:27:49.934 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (89m) 9m ago 95m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:27:49.935 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (88m) 88s ago 97m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:27:49.935 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (88m) 9m ago 95m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:27:49.935 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (95m) 88s ago 95m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:27:49.935 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (94m) 9m ago 94m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:27:49.935 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (88m) 88s ago 94m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:27:49.936 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (86m) 88s ago 94m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:27:49.936 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (85m) 88s ago 93m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:27:49.937 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (85m) 9m ago 93m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:27:49.937 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (84m) 9m ago 93m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:27:49.937 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (83m) 9m ago 93m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:27:49.937 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (90m) 88s ago 95m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:27:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.932+0000 7f1ec9040700 1 -- 172.21.15.8:0/1327215393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1eac060f70 msgr2=0x7f1eac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.932+0000 7f1ec9040700 1 --2- 172.21.15.8:0/1327215393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1eac060f70 0x7f1eac063430 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f1eb8004b70 tx=0x7f1eb800b040).stop 2023-10-18T22:27:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.932+0000 7f1ec9040700 1 -- 172.21.15.8:0/1327215393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ec40f6530 msgr2=0x7f1ec4108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.932+0000 7f1ec9040700 1 --2- 172.21.15.8:0/1327215393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ec40f6530 0x7f1ec4108f50 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7f1eb4009870 tx=0x7f1eb400b040).stop 2023-10-18T22:27:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.932+0000 7f1ec9040700 1 -- 172.21.15.8:0/1327215393 shutdown_connections 2023-10-18T22:27:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.932+0000 7f1ec9040700 1 --2- 172.21.15.8:0/1327215393 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1eac060f70 0x7f1eac063430 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.932+0000 7f1ec9040700 1 --2- 172.21.15.8:0/1327215393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ec40f6530 0x7f1ec4108f50 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.932+0000 7f1ec9040700 1 --2- 172.21.15.8:0/1327215393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ec40f77d0 0x7f1ec4109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:27:49.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.933+0000 7f1ec9040700 1 -- 172.21.15.8:0/1327215393 >> 172.21.15.8:0/1327215393 conn(0x7f1ec40f1c90 msgr2=0x7f1ec40f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:49.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.933+0000 7f1ec9040700 1 -- 172.21.15.8:0/1327215393 shutdown_connections 2023-10-18T22:27:49.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:49.933+0000 7f1ec9040700 1 -- 172.21.15.8:0/1327215393 wait complete. 2023-10-18T22:27:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.068+0000 7fe8eb59e700 1 -- 172.21.15.8:0/606427142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f6530 msgr2=0x7fe8ec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:50.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.068+0000 7fe8eb59e700 1 --2- 172.21.15.8:0/606427142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec0f6950 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7fe8dc004660 tx=0x7fe8dc009b30).stop 2023-10-18T22:27:50.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.068+0000 7fe8eb59e700 1 -- 172.21.15.8:0/606427142 shutdown_connections 2023-10-18T22:27:50.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.068+0000 7fe8eb59e700 1 --2- 172.21.15.8:0/606427142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.068+0000 7fe8eb59e700 1 --2- 172.21.15.8:0/606427142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec0f6950 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.068+0000 7fe8eb59e700 1 -- 172.21.15.8:0/606427142 >> 172.21.15.8:0/606427142 conn(0x7fe8ec0f1c90 msgr2=0x7fe8ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:50.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.068+0000 7fe8eb59e700 1 -- 172.21.15.8:0/606427142 shutdown_connections 2023-10-18T22:27:50.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.068+0000 7fe8eb59e700 1 -- 172.21.15.8:0/606427142 wait complete. 2023-10-18T22:27:50.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.069+0000 7fe8eb59e700 1 Processor -- start 2023-10-18T22:27:50.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.069+0000 7fe8eb59e700 1 -- start start 2023-10-18T22:27:50.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8eb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:50.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8eb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:50.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8eb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec06a380 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8eb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec06a4c0 con 0x7fe8ec0f6530 2023-10-18T22:27:50.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8e9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:50.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8e9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40970/0 (socket says 172.21.15.8:40970) 2023-10-18T22:27:50.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8e9d9b700 1 -- 172.21.15.8:0/3092910446 learned_addr learned my addr 172.21.15.8:0/3092910446 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:50.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8ea59c700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:50.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8e9d9b700 1 -- 172.21.15.8:0/3092910446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f6530 msgr2=0x7fe8ec06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:50.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8e9d9b700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.070+0000 7fe8e9d9b700 1 -- 172.21.15.8:0/3092910446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc005040 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.071+0000 7fe8e9d9b700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec069e20 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7fe8e000e7f0 tx=0x7fe8e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:50.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.071+0000 7fe8daffd700 1 -- 172.21.15.8:0/3092910446 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e00092e0 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.071+0000 7fe8daffd700 1 -- 172.21.15.8:0/3092910446 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe8e000f040 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.071+0000 7fe8daffd700 1 -- 172.21.15.8:0/3092910446 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e00147e0 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.071+0000 7fe8eb59e700 1 -- 172.21.15.8:0/3092910446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec06a7a0 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.071+0000 7fe8eb59e700 1 -- 172.21.15.8:0/3092910446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec10ed60 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.072+0000 7fe8eb59e700 1 -- 172.21.15.8:0/3092910446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec045ad0 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.073+0000 7fe8daffd700 1 -- 172.21.15.8:0/3092910446 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe8e001b030 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.074+0000 7fe8daffd700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d4060f70 0x7fe8d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:50.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.074+0000 7fe8daffd700 1 -- 172.21.15.8:0/3092910446 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe8e007c740 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.074+0000 7fe8ea59c700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d4060f70 0x7fe8d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:50.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.074+0000 7fe8ea59c700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d4060f70 0x7fe8d4063430 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7fe8dc004d80 tx=0x7fe8dc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:50.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.078+0000 7fe8daffd700 1 -- 172.21.15.8:0/3092910446 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe8e004c340 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.331+0000 7fe8eb59e700 1 -- 172.21.15.8:0/3092910446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe8ec027a00 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.332+0000 7fe8daffd700 1 -- 172.21.15.8:0/3092910446 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fe8e0019020 con 0x7fe8ec0f77d0 2023-10-18T22:27:50.333 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:27:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:27:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:27:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:27:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:27:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:27:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:27:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:27:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:27:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:27:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:27:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:27:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:27:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:27:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:27:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:27:50.336 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:27:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 -- 172.21.15.8:0/3092910446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d4060f70 msgr2=0x7fe8d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d4060f70 0x7fe8d4063430 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7fe8dc004d80 tx=0x7fe8dc00b040).stop 2023-10-18T22:27:50.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 -- 172.21.15.8:0/3092910446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f77d0 msgr2=0x7fe8ec069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:50.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec069e20 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7fe8e000e7f0 tx=0x7fe8e000b040).stop 2023-10-18T22:27:50.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 -- 172.21.15.8:0/3092910446 shutdown_connections 2023-10-18T22:27:50.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe8d4060f70 0x7fe8d4063430 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ec0f6530 0x7fe8ec06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 --2- 172.21.15.8:0/3092910446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8ec0f77d0 0x7fe8ec069e20 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 -- 172.21.15.8:0/3092910446 >> 172.21.15.8:0/3092910446 conn(0x7fe8ec0f1c90 msgr2=0x7fe8ec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:50.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 -- 172.21.15.8:0/3092910446 shutdown_connections 2023-10-18T22:27:50.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.334+0000 7fe8eb59e700 1 -- 172.21.15.8:0/3092910446 wait complete. 2023-10-18T22:27:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.470+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/3858148448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ebc0f96a0 msgr2=0x7f4ebc0fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.470+0000 7f4ec0ad1700 1 --2- 172.21.15.8:0/3858148448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ebc0f96a0 0x7f4ebc0fbaf0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f4eb0004660 tx=0x7f4eb0009b30).stop 2023-10-18T22:27:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.470+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/3858148448 shutdown_connections 2023-10-18T22:27:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.470+0000 7f4ec0ad1700 1 --2- 172.21.15.8:0/3858148448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ebc0f96a0 0x7f4ebc0fbaf0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.470+0000 7f4ec0ad1700 1 --2- 172.21.15.8:0/3858148448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ebc060270 0x7f4ebc0f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.470+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/3858148448 >> 172.21.15.8:0/3858148448 conn(0x7f4ebc0f0b90 msgr2=0x7f4ebc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:50.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.470+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/3858148448 shutdown_connections 2023-10-18T22:27:50.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.470+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/3858148448 wait complete. 2023-10-18T22:27:50.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.471+0000 7f4ec0ad1700 1 Processor -- start 2023-10-18T22:27:50.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.471+0000 7f4ec0ad1700 1 -- start start 2023-10-18T22:27:50.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.471+0000 7f4ec0ad1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ebc060270 0x7f4ebc108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:50.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.471+0000 7f4ec0ad1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ebc0f96a0 0x7f4ebc1093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:50.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.471+0000 7f4ec0ad1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc109990 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.471+0000 7f4ec0ad1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc109ad0 con 0x7f4ebc060270 2023-10-18T22:27:50.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.472+0000 7f4ebaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ebc0f96a0 0x7f4ebc1093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:50.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.472+0000 7f4ebaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ebc0f96a0 0x7f4ebc1093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40996/0 (socket says 172.21.15.8:40996) 2023-10-18T22:27:50.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.472+0000 7f4ebaffd700 1 -- 172.21.15.8:0/1751592591 learned_addr learned my addr 172.21.15.8:0/1751592591 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:50.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.472+0000 7f4ebb7fe700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ebc060270 0x7f4ebc108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:50.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.472+0000 7f4ebaffd700 1 -- 172.21.15.8:0/1751592591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ebc060270 msgr2=0x7f4ebc108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:50.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.472+0000 7f4ebaffd700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ebc060270 0x7f4ebc108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.472+0000 7f4ebaffd700 1 -- 172.21.15.8:0/1751592591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb0005040 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.472+0000 7f4ebaffd700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ebc0f96a0 0x7f4ebc1093e0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7f4eb0014040 tx=0x7f4eb000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:50.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.473+0000 7f4ea3fff700 1 -- 172.21.15.8:0/1751592591 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eb0019070 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.473+0000 7f4ea3fff700 1 -- 172.21.15.8:0/1751592591 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4eb001e420 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.473+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/1751592591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ebc10a410 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.473+0000 7f4ea3fff700 1 -- 172.21.15.8:0/1751592591 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eb0014660 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.473+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/1751592591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ebc10a8f0 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.474+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/1751592591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ebc045ad0 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.475+0000 7f4ea3fff700 1 -- 172.21.15.8:0/1751592591 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4eb001e9e0 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.475+0000 7f4ea3fff700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ea4060f70 0x7f4ea4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:50.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.476+0000 7f4ea3fff700 1 -- 172.21.15.8:0/1751592591 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4eb007de30 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.476+0000 7f4ebb7fe700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ea4060f70 0x7f4ea4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:50.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.476+0000 7f4ebb7fe700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ea4060f70 0x7f4ea4063430 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f4eac007f80 tx=0x7f4eac00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:50.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.480+0000 7f4ea3fff700 1 -- 172.21.15.8:0/1751592591 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4eb0051490 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:49.001298+0000 mgr.smithi008.flmjzp (mgr.14640) 5329 : cluster [DBG] pgmap v3655: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:49.233289+0000 mgr.smithi008.flmjzp (mgr.14640) 5330 : audit [DBG] from='client.38248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:50.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:50.332321+0000 mon.smithi008 (mon.0) 5574 : audit [DBG] from='client.? 172.21.15.8:0/3092910446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.713+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/1751592591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4ebc10aff0 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.714+0000 7f4ea3fff700 1 -- 172.21.15.8:0/1751592591 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f4eb0051080 con 0x7f4ebc0f96a0 2023-10-18T22:27:50.715 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:27:50.716 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:27:50.716 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:27:50.716 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:27:50.716 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:27:50.717 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:27:50.717 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:27:50.717 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:27:50.717 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:27:50.717 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:27:50.718 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:27:50.718 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:27:50.718 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:27:50.718 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:27:50.718 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:27:50.719 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:27:50.719 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:27:50.719 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:27:50.719 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:27:50.719 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:27:50.720 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:27:50.720 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:27:50.720 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:27:50.720 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:27:50.720 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:27:50.720 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:27:50.721 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:27:50.721 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:27:50.721 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:27:50.721 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:27:50.721 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:27:50.721 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:27:50.722 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:27:50.722 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:27:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.715+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/1751592591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ea4060f70 msgr2=0x7f4ea4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.715+0000 7f4ec0ad1700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ea4060f70 0x7f4ea4063430 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f4eac007f80 tx=0x7f4eac00b040).stop 2023-10-18T22:27:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.716+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/1751592591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ebc0f96a0 msgr2=0x7f4ebc1093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.716+0000 7f4ec0ad1700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ebc0f96a0 0x7f4ebc1093e0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7f4eb0014040 tx=0x7f4eb000b040).stop 2023-10-18T22:27:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.716+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/1751592591 shutdown_connections 2023-10-18T22:27:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.716+0000 7f4ec0ad1700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4ea4060f70 0x7f4ea4063430 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.716+0000 7f4ec0ad1700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ebc060270 0x7f4ebc108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.716+0000 7f4ec0ad1700 1 --2- 172.21.15.8:0/1751592591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ebc0f96a0 0x7f4ebc1093e0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.716+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/1751592591 >> 172.21.15.8:0/1751592591 conn(0x7f4ebc0f0b90 msgr2=0x7f4ebc0f5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.716+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/1751592591 shutdown_connections 2023-10-18T22:27:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.716+0000 7f4ec0ad1700 1 -- 172.21.15.8:0/1751592591 wait complete. 2023-10-18T22:27:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:27:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:49.001298+0000 mgr.smithi008.flmjzp (mgr.14640) 5329 : cluster [DBG] pgmap v3655: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:49.233289+0000 mgr.smithi008.flmjzp (mgr.14640) 5330 : audit [DBG] from='client.38248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:50.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:50.332321+0000 mon.smithi008 (mon.0) 5574 : audit [DBG] from='client.? 172.21.15.8:0/3092910446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.853+0000 7fd437fff700 1 -- 172.21.15.8:0/3238418090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4380f6530 msgr2=0x7fd4380f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.853+0000 7fd437fff700 1 --2- 172.21.15.8:0/3238418090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4380f6530 0x7fd4380f6950 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7fd428004660 tx=0x7fd428009b30).stop 2023-10-18T22:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.853+0000 7fd437fff700 1 -- 172.21.15.8:0/3238418090 shutdown_connections 2023-10-18T22:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.853+0000 7fd437fff700 1 --2- 172.21.15.8:0/3238418090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4380f77d0 0x7fd4380f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.853+0000 7fd437fff700 1 --2- 172.21.15.8:0/3238418090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4380f6530 0x7fd4380f6950 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.853+0000 7fd437fff700 1 -- 172.21.15.8:0/3238418090 >> 172.21.15.8:0/3238418090 conn(0x7fd4380f1c70 msgr2=0x7fd4380f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.853+0000 7fd437fff700 1 -- 172.21.15.8:0/3238418090 shutdown_connections 2023-10-18T22:27:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.853+0000 7fd437fff700 1 -- 172.21.15.8:0/3238418090 wait complete. 2023-10-18T22:27:50.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.854+0000 7fd437fff700 1 Processor -- start 2023-10-18T22:27:50.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.855+0000 7fd437fff700 1 -- start start 2023-10-18T22:27:50.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.855+0000 7fd437fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4380f6530 0x7fd43806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:50.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.855+0000 7fd437fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4380f77d0 0x7fd438069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:50.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.855+0000 7fd437fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43806a380 con 0x7fd4380f6530 2023-10-18T22:27:50.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.855+0000 7fd437fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43806a4c0 con 0x7fd4380f77d0 2023-10-18T22:27:50.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.855+0000 7fd436ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4380f6530 0x7fd43806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:50.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.855+0000 7fd436ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4380f6530 0x7fd43806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41014/0 (socket says 172.21.15.8:41014) 2023-10-18T22:27:50.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.855+0000 7fd436ffd700 1 -- 172.21.15.8:0/2640138406 learned_addr learned my addr 172.21.15.8:0/2640138406 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:27:50.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.856+0000 7fd4367fc700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4380f77d0 0x7fd438069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:50.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.856+0000 7fd436ffd700 1 -- 172.21.15.8:0/2640138406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4380f77d0 msgr2=0x7fd438069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:50.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.856+0000 7fd436ffd700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4380f77d0 0x7fd438069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:50.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.856+0000 7fd436ffd700 1 -- 172.21.15.8:0/2640138406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd428005040 con 0x7fd4380f6530 2023-10-18T22:27:50.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.856+0000 7fd436ffd700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4380f6530 0x7fd43806b9a0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7fd428007a60 tx=0x7fd428009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:50.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.856+0000 7fd41f7fe700 1 -- 172.21.15.8:0/2640138406 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd428018070 con 0x7fd4380f6530 2023-10-18T22:27:50.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.856+0000 7fd41f7fe700 1 -- 172.21.15.8:0/2640138406 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd428009630 con 0x7fd4380f6530 2023-10-18T22:27:50.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.856+0000 7fd41f7fe700 1 -- 172.21.15.8:0/2640138406 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd42801c540 con 0x7fd4380f6530 2023-10-18T22:27:50.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.856+0000 7fd437fff700 1 -- 172.21.15.8:0/2640138406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43806a740 con 0x7fd4380f6530 2023-10-18T22:27:50.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.857+0000 7fd437fff700 1 -- 172.21.15.8:0/2640138406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43806aca0 con 0x7fd4380f6530 2023-10-18T22:27:50.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.858+0000 7fd437fff700 1 -- 172.21.15.8:0/2640138406 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd438045ad0 con 0x7fd4380f6530 2023-10-18T22:27:50.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.858+0000 7fd41f7fe700 1 -- 172.21.15.8:0/2640138406 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd42801d420 con 0x7fd4380f6530 2023-10-18T22:27:50.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.859+0000 7fd41f7fe700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd420060f70 0x7fd420063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:27:50.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.859+0000 7fd41f7fe700 1 -- 172.21.15.8:0/2640138406 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd42807e6c0 con 0x7fd4380f6530 2023-10-18T22:27:50.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.859+0000 7fd4367fc700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd420060f70 0x7fd420063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:27:50.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.860+0000 7fd4367fc700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd420060f70 0x7fd420063430 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fd42c009760 tx=0x7fd42c009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:27:50.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:50.863+0000 7fd41f7fe700 1 -- 172.21.15.8:0/2640138406 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd42804e2f0 con 0x7fd4380f6530 2023-10-18T22:27:51.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.061+0000 7fd437fff700 1 -- 172.21.15.8:0/2640138406 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4380fee00 con 0x7fd420060f70 2023-10-18T22:27:51.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.063+0000 7fd41f7fe700 1 -- 172.21.15.8:0/2640138406 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd4380fee00 con 0x7fd420060f70 2023-10-18T22:27:51.064 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:27:51.064 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:27:51.065 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:27:51.065 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:27:51.065 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:27:51.065 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:27:51.065 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:27:51.066 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:27:51.066 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:27:51.066 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:27:51.066 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:27:51.066 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:27:51.067 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:27:51.067 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:27:51.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.064+0000 7fd437fff700 1 -- 172.21.15.8:0/2640138406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd420060f70 msgr2=0x7fd420063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:51.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.064+0000 7fd437fff700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd420060f70 0x7fd420063430 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fd42c009760 tx=0x7fd42c009c60).stop 2023-10-18T22:27:51.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.065+0000 7fd437fff700 1 -- 172.21.15.8:0/2640138406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4380f6530 msgr2=0x7fd43806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:27:51.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.065+0000 7fd437fff700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4380f6530 0x7fd43806b9a0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7fd428007a60 tx=0x7fd428009b30).stop 2023-10-18T22:27:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.065+0000 7fd437fff700 1 -- 172.21.15.8:0/2640138406 shutdown_connections 2023-10-18T22:27:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.065+0000 7fd437fff700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd420060f70 0x7fd420063430 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.065+0000 7fd437fff700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4380f6530 0x7fd43806b9a0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.065+0000 7fd437fff700 1 --2- 172.21.15.8:0/2640138406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4380f77d0 0x7fd438069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:27:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.065+0000 7fd437fff700 1 -- 172.21.15.8:0/2640138406 >> 172.21.15.8:0/2640138406 conn(0x7fd4380f1c70 msgr2=0x7fd4380fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:27:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.065+0000 7fd437fff700 1 -- 172.21.15.8:0/2640138406 shutdown_connections 2023-10-18T22:27:51.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:27:51.065+0000 7fd437fff700 1 -- 172.21.15.8:0/2640138406 wait complete. 2023-10-18T22:27:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:49.581905+0000 mgr.smithi008.flmjzp (mgr.14640) 5331 : audit [DBG] from='client.38252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:49.922601+0000 mgr.smithi008.flmjzp (mgr.14640) 5332 : audit [DBG] from='client.38256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:50.714216+0000 mon.smithi008 (mon.0) 5575 : audit [DBG] from='client.? 172.21.15.8:0/1751592591' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:27:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:49.581905+0000 mgr.smithi008.flmjzp (mgr.14640) 5331 : audit [DBG] from='client.38252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:49.922601+0000 mgr.smithi008.flmjzp (mgr.14640) 5332 : audit [DBG] from='client.38256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:50.714216+0000 mon.smithi008 (mon.0) 5575 : audit [DBG] from='client.? 172.21.15.8:0/1751592591' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:27:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:51.001783+0000 mgr.smithi008.flmjzp (mgr.14640) 5333 : cluster [DBG] pgmap v3656: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:51.063047+0000 mgr.smithi008.flmjzp (mgr.14640) 5334 : audit [DBG] from='client.38268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:51.001783+0000 mgr.smithi008.flmjzp (mgr.14640) 5333 : cluster [DBG] pgmap v3656: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:51.063047+0000 mgr.smithi008.flmjzp (mgr.14640) 5334 : audit [DBG] from='client.38268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:27:53.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:53.032606+0000 mon.smithi008 (mon.0) 5576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:53.032606+0000 mon.smithi008 (mon.0) 5576 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:53.002331+0000 mgr.smithi008.flmjzp (mgr.14640) 5335 : cluster [DBG] pgmap v3657: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:53.586884+0000 mon.smithi008 (mon.0) 5577 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:53.587982+0000 mon.smithi008 (mon.0) 5578 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:53.594678+0000 mon.smithi008 (mon.0) 5579 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:53.601129+0000 mon.smithi008 (mon.0) 5580 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:53.604255+0000 mon.smithi008 (mon.0) 5581 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:53.605974+0000 mon.smithi008 (mon.0) 5582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:53.607615+0000 mon.smithi008 (mon.0) 5583 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:27:53.609629+0000 mon.smithi008 (mon.0) 5584 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:53.002331+0000 mgr.smithi008.flmjzp (mgr.14640) 5335 : cluster [DBG] pgmap v3657: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:53.586884+0000 mon.smithi008 (mon.0) 5577 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:27:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:53.587982+0000 mon.smithi008 (mon.0) 5578 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:27:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:53.594678+0000 mon.smithi008 (mon.0) 5579 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:27:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:53.601129+0000 mon.smithi008 (mon.0) 5580 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:27:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:53.604255+0000 mon.smithi008 (mon.0) 5581 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:53.605974+0000 mon.smithi008 (mon.0) 5582 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:53.607615+0000 mon.smithi008 (mon.0) 5583 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:54.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:27:53.609629+0000 mon.smithi008 (mon.0) 5584 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:27:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:53.588891+0000 mgr.smithi008.flmjzp (mgr.14640) 5336 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:53.589610+0000 mgr.smithi008.flmjzp (mgr.14640) 5337 : cluster [DBG] pgmap v3658: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:53.589843+0000 mgr.smithi008.flmjzp (mgr.14640) 5338 : cluster [DBG] pgmap v3659: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:27:53.611527+0000 mgr.smithi008.flmjzp (mgr.14640) 5339 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:53.588891+0000 mgr.smithi008.flmjzp (mgr.14640) 5336 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:27:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:53.589610+0000 mgr.smithi008.flmjzp (mgr.14640) 5337 : cluster [DBG] pgmap v3658: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:53.589843+0000 mgr.smithi008.flmjzp (mgr.14640) 5338 : cluster [DBG] pgmap v3659: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:27:53.611527+0000 mgr.smithi008.flmjzp (mgr.14640) 5339 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:27:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:55.590362+0000 mgr.smithi008.flmjzp (mgr.14640) 5340 : cluster [DBG] pgmap v3660: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:55.590362+0000 mgr.smithi008.flmjzp (mgr.14640) 5340 : cluster [DBG] pgmap v3660: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:27:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:57.590990+0000 mgr.smithi008.flmjzp (mgr.14640) 5341 : cluster [DBG] pgmap v3661: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:27:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:27:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:57.590990+0000 mgr.smithi008.flmjzp (mgr.14640) 5341 : cluster [DBG] pgmap v3661: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:27:59.591540+0000 mgr.smithi008.flmjzp (mgr.14640) 5342 : cluster [DBG] pgmap v3662: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:27:59.591540+0000 mgr.smithi008.flmjzp (mgr.14640) 5342 : cluster [DBG] pgmap v3662: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:03.861 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:01.592123+0000 mgr.smithi008.flmjzp (mgr.14640) 5343 : cluster [DBG] pgmap v3663: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:01.592123+0000 mgr.smithi008.flmjzp (mgr.14640) 5343 : cluster [DBG] pgmap v3663: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:03.622212+0000 mon.smithi008 (mon.0) 5585 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:03.624306+0000 mon.smithi008 (mon.0) 5586 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:03.625358+0000 mon.smithi008 (mon.0) 5587 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:03.631913+0000 mon.smithi008 (mon.0) 5588 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:03.638532+0000 mon.smithi008 (mon.0) 5589 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:03.641516+0000 mon.smithi008 (mon.0) 5590 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:03.643228+0000 mon.smithi008 (mon.0) 5591 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:03.644786+0000 mon.smithi008 (mon.0) 5592 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:04.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:03.646678+0000 mon.smithi008 (mon.0) 5593 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:03.622212+0000 mon.smithi008 (mon.0) 5585 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:03.624306+0000 mon.smithi008 (mon.0) 5586 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:03.625358+0000 mon.smithi008 (mon.0) 5587 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:03.631913+0000 mon.smithi008 (mon.0) 5588 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:03.638532+0000 mon.smithi008 (mon.0) 5589 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:03.641516+0000 mon.smithi008 (mon.0) 5590 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:03.643228+0000 mon.smithi008 (mon.0) 5591 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:03.644786+0000 mon.smithi008 (mon.0) 5592 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:04.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:03.646678+0000 mon.smithi008 (mon.0) 5593 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:03.592685+0000 mgr.smithi008.flmjzp (mgr.14640) 5344 : cluster [DBG] pgmap v3664: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:03.626241+0000 mgr.smithi008.flmjzp (mgr.14640) 5345 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:03.626841+0000 mgr.smithi008.flmjzp (mgr.14640) 5346 : cluster [DBG] pgmap v3665: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:03.627088+0000 mgr.smithi008.flmjzp (mgr.14640) 5347 : cluster [DBG] pgmap v3666: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:05.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:03.648533+0000 mgr.smithi008.flmjzp (mgr.14640) 5348 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:03.592685+0000 mgr.smithi008.flmjzp (mgr.14640) 5344 : cluster [DBG] pgmap v3664: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:03.626241+0000 mgr.smithi008.flmjzp (mgr.14640) 5345 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:03.626841+0000 mgr.smithi008.flmjzp (mgr.14640) 5346 : cluster [DBG] pgmap v3665: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:05.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:03.627088+0000 mgr.smithi008.flmjzp (mgr.14640) 5347 : cluster [DBG] pgmap v3666: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:05.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:03.648533+0000 mgr.smithi008.flmjzp (mgr.14640) 5348 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:05.627727+0000 mgr.smithi008.flmjzp (mgr.14640) 5349 : cluster [DBG] pgmap v3667: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:05.627727+0000 mgr.smithi008.flmjzp (mgr.14640) 5349 : cluster [DBG] pgmap v3667: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:07.628366+0000 mgr.smithi008.flmjzp (mgr.14640) 5350 : cluster [DBG] pgmap v3668: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:07.628366+0000 mgr.smithi008.flmjzp (mgr.14640) 5350 : cluster [DBG] pgmap v3668: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:09.628924+0000 mgr.smithi008.flmjzp (mgr.14640) 5351 : cluster [DBG] pgmap v3669: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:09.628924+0000 mgr.smithi008.flmjzp (mgr.14640) 5351 : cluster [DBG] pgmap v3669: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:13.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:11.629441+0000 mgr.smithi008.flmjzp (mgr.14640) 5352 : cluster [DBG] pgmap v3670: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:11.629441+0000 mgr.smithi008.flmjzp (mgr.14640) 5352 : cluster [DBG] pgmap v3670: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:13.659042+0000 mon.smithi008 (mon.0) 5594 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:13.661048+0000 mon.smithi008 (mon.0) 5595 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:13.662028+0000 mon.smithi008 (mon.0) 5596 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:13.668284+0000 mon.smithi008 (mon.0) 5597 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:13.674685+0000 mon.smithi008 (mon.0) 5598 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:13.678063+0000 mon.smithi008 (mon.0) 5599 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:13.679867+0000 mon.smithi008 (mon.0) 5600 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:13.681487+0000 mon.smithi008 (mon.0) 5601 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:14.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:13.683517+0000 mon.smithi008 (mon.0) 5602 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:13.659042+0000 mon.smithi008 (mon.0) 5594 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:13.661048+0000 mon.smithi008 (mon.0) 5595 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:13.662028+0000 mon.smithi008 (mon.0) 5596 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:13.668284+0000 mon.smithi008 (mon.0) 5597 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:13.674685+0000 mon.smithi008 (mon.0) 5598 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:13.678063+0000 mon.smithi008 (mon.0) 5599 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:13.679867+0000 mon.smithi008 (mon.0) 5600 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:13.681487+0000 mon.smithi008 (mon.0) 5601 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:13.683517+0000 mon.smithi008 (mon.0) 5602 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:13.629991+0000 mgr.smithi008.flmjzp (mgr.14640) 5353 : cluster [DBG] pgmap v3671: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:13.662820+0000 mgr.smithi008.flmjzp (mgr.14640) 5354 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:13.663388+0000 mgr.smithi008.flmjzp (mgr.14640) 5355 : cluster [DBG] pgmap v3672: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:13.663648+0000 mgr.smithi008.flmjzp (mgr.14640) 5356 : cluster [DBG] pgmap v3673: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:15.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:13.685514+0000 mgr.smithi008.flmjzp (mgr.14640) 5357 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:13.629991+0000 mgr.smithi008.flmjzp (mgr.14640) 5353 : cluster [DBG] pgmap v3671: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:13.662820+0000 mgr.smithi008.flmjzp (mgr.14640) 5354 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:15.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:13.663388+0000 mgr.smithi008.flmjzp (mgr.14640) 5355 : cluster [DBG] pgmap v3672: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:15.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:13.663648+0000 mgr.smithi008.flmjzp (mgr.14640) 5356 : cluster [DBG] pgmap v3673: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:15.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:13.685514+0000 mgr.smithi008.flmjzp (mgr.14640) 5357 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:17.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:15.664480+0000 mgr.smithi008.flmjzp (mgr.14640) 5358 : cluster [DBG] pgmap v3674: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:15.664480+0000 mgr.smithi008.flmjzp (mgr.14640) 5358 : cluster [DBG] pgmap v3674: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:19.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:17.665240+0000 mgr.smithi008.flmjzp (mgr.14640) 5359 : cluster [DBG] pgmap v3675: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:17.665240+0000 mgr.smithi008.flmjzp (mgr.14640) 5359 : cluster [DBG] pgmap v3675: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:21.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.217+0000 7f85b923d700 1 -- 172.21.15.8:0/3598828883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b40f77d0 msgr2=0x7f85b40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:21.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.217+0000 7f85b923d700 1 --2- 172.21.15.8:0/3598828883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b40f77d0 0x7f85b40f7c30 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7f85a8004660 tx=0x7f85a8009b30).stop 2023-10-18T22:28:21.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.217+0000 7f85b923d700 1 -- 172.21.15.8:0/3598828883 shutdown_connections 2023-10-18T22:28:21.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.217+0000 7f85b923d700 1 --2- 172.21.15.8:0/3598828883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b40f77d0 0x7f85b40f7c30 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.217+0000 7f85b923d700 1 --2- 172.21.15.8:0/3598828883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85b40f6530 0x7f85b40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.217+0000 7f85b923d700 1 -- 172.21.15.8:0/3598828883 >> 172.21.15.8:0/3598828883 conn(0x7f85b40f1c90 msgr2=0x7f85b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:21.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.217+0000 7f85b923d700 1 -- 172.21.15.8:0/3598828883 shutdown_connections 2023-10-18T22:28:21.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.217+0000 7f85b923d700 1 -- 172.21.15.8:0/3598828883 wait complete. 2023-10-18T22:28:21.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.218+0000 7f85b923d700 1 Processor -- start 2023-10-18T22:28:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.218+0000 7f85b923d700 1 -- start start 2023-10-18T22:28:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b923d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b40f6530 0x7f85b406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b923d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85b40f77d0 0x7f85b4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b923d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b406a380 con 0x7f85b40f6530 2023-10-18T22:28:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b923d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b406a4c0 con 0x7f85b40f77d0 2023-10-18T22:28:21.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b40f6530 0x7f85b406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:21.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b40f6530 0x7f85b406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52378/0 (socket says 172.21.15.8:52378) 2023-10-18T22:28:21.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b3fff700 1 -- 172.21.15.8:0/3477128128 learned_addr learned my addr 172.21.15.8:0/3477128128 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:21.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b37fe700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85b40f77d0 0x7f85b4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:21.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b3fff700 1 -- 172.21.15.8:0/3477128128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85b40f77d0 msgr2=0x7f85b4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:21.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b3fff700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85b40f77d0 0x7f85b4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.219+0000 7f85b3fff700 1 -- 172.21.15.8:0/3477128128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8005040 con 0x7f85b40f6530 2023-10-18T22:28:21.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.220+0000 7f85b3fff700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b40f6530 0x7f85b406b9a0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7f85a4002700 tx=0x7f85a4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:21.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.220+0000 7f85b0ff9700 1 -- 172.21.15.8:0/3477128128 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a4009320 con 0x7f85b40f6530 2023-10-18T22:28:21.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.220+0000 7f85b923d700 1 -- 172.21.15.8:0/3477128128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b406a7a0 con 0x7f85b40f6530 2023-10-18T22:28:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.220+0000 7f85b0ff9700 1 -- 172.21.15.8:0/3477128128 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f85a400f040 con 0x7f85b40f6530 2023-10-18T22:28:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.220+0000 7f85b0ff9700 1 -- 172.21.15.8:0/3477128128 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a4014970 con 0x7f85b40f6530 2023-10-18T22:28:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.220+0000 7f85b923d700 1 -- 172.21.15.8:0/3477128128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b410ed70 con 0x7f85b40f6530 2023-10-18T22:28:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.221+0000 7f85b923d700 1 -- 172.21.15.8:0/3477128128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b4045ad0 con 0x7f85b40f6530 2023-10-18T22:28:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.222+0000 7f85b0ff9700 1 -- 172.21.15.8:0/3477128128 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f85a4009480 con 0x7f85b40f6530 2023-10-18T22:28:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.223+0000 7f85b0ff9700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f859c060f70 0x7f859c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.223+0000 7f85b0ff9700 1 -- 172.21.15.8:0/3477128128 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f85a407cb80 con 0x7f85b40f6530 2023-10-18T22:28:21.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.223+0000 7f85b37fe700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f859c060f70 0x7f859c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:21.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.224+0000 7f85b37fe700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f859c060f70 0x7f859c063430 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f85a8004630 tx=0x7f85a8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:21.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.227+0000 7f85b0ff9700 1 -- 172.21.15.8:0/3477128128 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f85a404c7f0 con 0x7f85b40f6530 2023-10-18T22:28:21.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.425+0000 7f85b923d700 1 -- 172.21.15.8:0/3477128128 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85b40fee70 con 0x7f859c060f70 2023-10-18T22:28:21.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.427+0000 7f85b0ff9700 1 -- 172.21.15.8:0/3477128128 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f85a8019040 con 0x7f859c060f70 2023-10-18T22:28:21.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 -- 172.21.15.8:0/3477128128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f859c060f70 msgr2=0x7f859c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:21.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f859c060f70 0x7f859c063430 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f85a8004630 tx=0x7f85a8009b30).stop 2023-10-18T22:28:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 -- 172.21.15.8:0/3477128128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b40f6530 msgr2=0x7f85b406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b40f6530 0x7f85b406b9a0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7f85a4002700 tx=0x7f85a4009d80).stop 2023-10-18T22:28:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 -- 172.21.15.8:0/3477128128 shutdown_connections 2023-10-18T22:28:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f859c060f70 0x7f859c063430 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b40f6530 0x7f85b406b9a0 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 --2- 172.21.15.8:0/3477128128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85b40f77d0 0x7f85b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 -- 172.21.15.8:0/3477128128 >> 172.21.15.8:0/3477128128 conn(0x7f85b40f1c90 msgr2=0x7f85b40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:21.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 -- 172.21.15.8:0/3477128128 shutdown_connections 2023-10-18T22:28:21.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.429+0000 7f85b923d700 1 -- 172.21.15.8:0/3477128128 wait complete. 2023-10-18T22:28:21.447 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:28:21.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.568+0000 7f1ffce85700 1 -- 172.21.15.8:0/1180584696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff80f77d0 msgr2=0x7f1ff80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:21.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.568+0000 7f1ffce85700 1 --2- 172.21.15.8:0/1180584696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff80f77d0 0x7f1ff80f7c30 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7f1fec004660 tx=0x7f1fec009b30).stop 2023-10-18T22:28:21.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.568+0000 7f1ffce85700 1 -- 172.21.15.8:0/1180584696 shutdown_connections 2023-10-18T22:28:21.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.568+0000 7f1ffce85700 1 --2- 172.21.15.8:0/1180584696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff80f77d0 0x7f1ff80f7c30 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.568+0000 7f1ffce85700 1 --2- 172.21.15.8:0/1180584696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff80f6530 0x7f1ff80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.568+0000 7f1ffce85700 1 -- 172.21.15.8:0/1180584696 >> 172.21.15.8:0/1180584696 conn(0x7f1ff80f1c90 msgr2=0x7f1ff80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:21.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.568+0000 7f1ffce85700 1 -- 172.21.15.8:0/1180584696 shutdown_connections 2023-10-18T22:28:21.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.568+0000 7f1ffce85700 1 -- 172.21.15.8:0/1180584696 wait complete. 2023-10-18T22:28:21.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.569+0000 7f1ffce85700 1 Processor -- start 2023-10-18T22:28:21.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.569+0000 7f1ffce85700 1 -- start start 2023-10-18T22:28:21.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.569+0000 7f1ffce85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff80f6530 0x7f1ff8108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:21.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.569+0000 7f1ffce85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff80f77d0 0x7f1ff8109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:21.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.569+0000 7f1ffce85700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8109a20 con 0x7f1ff80f77d0 2023-10-18T22:28:21.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.569+0000 7f1ffce85700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8109b60 con 0x7f1ff80f6530 2023-10-18T22:28:21.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.570+0000 7f1ff6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff80f77d0 0x7f1ff8109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:21.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.570+0000 7f1ff77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff80f6530 0x7f1ff8108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:21.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.570+0000 7f1ff77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff80f6530 0x7f1ff8108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:56910/0 (socket says 172.21.15.8:56910) 2023-10-18T22:28:21.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.570+0000 7f1ff77fe700 1 -- 172.21.15.8:0/2765844718 learned_addr learned my addr 172.21.15.8:0/2765844718 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:21.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.570+0000 7f1ff6ffd700 1 -- 172.21.15.8:0/2765844718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff80f6530 msgr2=0x7f1ff8108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:21.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.570+0000 7f1ff6ffd700 1 --2- 172.21.15.8:0/2765844718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff80f6530 0x7f1ff8108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.570+0000 7f1ff6ffd700 1 -- 172.21.15.8:0/2765844718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec005040 con 0x7f1ff80f77d0 2023-10-18T22:28:21.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.570+0000 7f1ff6ffd700 1 --2- 172.21.15.8:0/2765844718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff80f77d0 0x7f1ff8109470 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f1fec000c00 tx=0x7f1fec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:21.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.571+0000 7f1fdffff700 1 -- 172.21.15.8:0/2765844718 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fec018070 con 0x7f1ff80f77d0 2023-10-18T22:28:21.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.571+0000 7f1fdffff700 1 -- 172.21.15.8:0/2765844718 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1fec009630 con 0x7f1ff80f77d0 2023-10-18T22:28:21.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.571+0000 7f1ffce85700 1 -- 172.21.15.8:0/2765844718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff810a4a0 con 0x7f1ff80f77d0 2023-10-18T22:28:21.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.571+0000 7f1fdffff700 1 -- 172.21.15.8:0/2765844718 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fec01c3c0 con 0x7f1ff80f77d0 2023-10-18T22:28:21.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.571+0000 7f1ffce85700 1 -- 172.21.15.8:0/2765844718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff810aa00 con 0x7f1ff80f77d0 2023-10-18T22:28:21.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.572+0000 7f1ffce85700 1 -- 172.21.15.8:0/2765844718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff8045ad0 con 0x7f1ff80f77d0 2023-10-18T22:28:21.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.573+0000 7f1fdffff700 1 -- 172.21.15.8:0/2765844718 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f1fec01d420 con 0x7f1ff80f77d0 2023-10-18T22:28:21.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.574+0000 7f1fdffff700 1 --2- 172.21.15.8:0/2765844718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fe0060f70 0x7f1fe0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:21.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.574+0000 7f1fdffff700 1 -- 172.21.15.8:0/2765844718 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f1fec07e660 con 0x7f1ff80f77d0 2023-10-18T22:28:21.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.574+0000 7f1ff77fe700 1 --2- 172.21.15.8:0/2765844718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fe0060f70 0x7f1fe0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:21.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.574+0000 7f1ff77fe700 1 --2- 172.21.15.8:0/2765844718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fe0060f70 0x7f1fe0063430 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f1fe8004d00 tx=0x7f1fe800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:21.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.578+0000 7f1fdffff700 1 -- 172.21.15.8:0/2765844718 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1fec051c40 con 0x7f1ff80f77d0 2023-10-18T22:28:21.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:19.666075+0000 mgr.smithi008.flmjzp (mgr.14640) 5360 : cluster [DBG] pgmap v3676: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.776+0000 7f1ffce85700 1 -- 172.21.15.8:0/2765844718 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ff80fee00 con 0x7f1fe0060f70 2023-10-18T22:28:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.778+0000 7f1fdffff700 1 -- 172.21.15.8:0/2765844718 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1ff80fee00 con 0x7f1fe0060f70 2023-10-18T22:28:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 -- 172.21.15.8:0/2765844718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fe0060f70 msgr2=0x7f1fe0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 --2- 172.21.15.8:0/2765844718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fe0060f70 0x7f1fe0063430 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f1fe8004d00 tx=0x7f1fe800b040).stop 2023-10-18T22:28:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 -- 172.21.15.8:0/2765844718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff80f77d0 msgr2=0x7f1ff8109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 --2- 172.21.15.8:0/2765844718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff80f77d0 0x7f1ff8109470 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f1fec000c00 tx=0x7f1fec009b30).stop 2023-10-18T22:28:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 -- 172.21.15.8:0/2765844718 shutdown_connections 2023-10-18T22:28:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 --2- 172.21.15.8:0/2765844718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1fe0060f70 0x7f1fe0063430 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 --2- 172.21.15.8:0/2765844718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff80f6530 0x7f1ff8108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 --2- 172.21.15.8:0/2765844718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff80f77d0 0x7f1ff8109470 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 -- 172.21.15.8:0/2765844718 >> 172.21.15.8:0/2765844718 conn(0x7f1ff80f1c90 msgr2=0x7f1ff806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 -- 172.21.15.8:0/2765844718 shutdown_connections 2023-10-18T22:28:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.780+0000 7f1ffce85700 1 -- 172.21.15.8:0/2765844718 wait complete. 2023-10-18T22:28:21.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.917+0000 7fd1a6351700 1 -- 172.21.15.8:0/3340700686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a00f6530 msgr2=0x7fd1a00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:21.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.917+0000 7fd1a6351700 1 --2- 172.21.15.8:0/3340700686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a00f6530 0x7fd1a00f6950 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7fd19c004660 tx=0x7fd19c009b30).stop 2023-10-18T22:28:21.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.917+0000 7fd1a6351700 1 -- 172.21.15.8:0/3340700686 shutdown_connections 2023-10-18T22:28:21.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.917+0000 7fd1a6351700 1 --2- 172.21.15.8:0/3340700686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a00f77d0 0x7fd1a00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.917+0000 7fd1a6351700 1 --2- 172.21.15.8:0/3340700686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a00f6530 0x7fd1a00f6950 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.917+0000 7fd1a6351700 1 -- 172.21.15.8:0/3340700686 >> 172.21.15.8:0/3340700686 conn(0x7fd1a00f1c90 msgr2=0x7fd1a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:21.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.917+0000 7fd1a6351700 1 -- 172.21.15.8:0/3340700686 shutdown_connections 2023-10-18T22:28:21.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.917+0000 7fd1a6351700 1 -- 172.21.15.8:0/3340700686 wait complete. 2023-10-18T22:28:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:19.666075+0000 mgr.smithi008.flmjzp (mgr.14640) 5360 : cluster [DBG] pgmap v3676: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:21.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.918+0000 7fd1a6351700 1 Processor -- start 2023-10-18T22:28:21.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.918+0000 7fd1a6351700 1 -- start start 2023-10-18T22:28:21.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a6351700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a00f6530 0x7fd1a0108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:21.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a6351700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a00f77d0 0x7fd1a01094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:21.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a6351700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0109a70 con 0x7fd1a00f77d0 2023-10-18T22:28:21.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a6351700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0109bb0 con 0x7fd1a00f6530 2023-10-18T22:28:21.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a4b4e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a00f77d0 0x7fd1a01094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:21.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a4b4e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a00f77d0 0x7fd1a01094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52400/0 (socket says 172.21.15.8:52400) 2023-10-18T22:28:21.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a4b4e700 1 -- 172.21.15.8:0/1912420063 learned_addr learned my addr 172.21.15.8:0/1912420063 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:21.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a534f700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a00f6530 0x7fd1a0108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:21.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a4b4e700 1 -- 172.21.15.8:0/1912420063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a00f6530 msgr2=0x7fd1a0108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:21.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a4b4e700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a00f6530 0x7fd1a0108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:21.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a4b4e700 1 -- 172.21.15.8:0/1912420063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c005040 con 0x7fd1a00f77d0 2023-10-18T22:28:21.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.919+0000 7fd1a4b4e700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a00f77d0 0x7fd1a01094c0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7fd1900026d0 tx=0x7fd190009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:21.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.920+0000 7fd195ffb700 1 -- 172.21.15.8:0/1912420063 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1900079c0 con 0x7fd1a00f77d0 2023-10-18T22:28:21.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.920+0000 7fd195ffb700 1 -- 172.21.15.8:0/1912420063 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd19000f040 con 0x7fd1a00f77d0 2023-10-18T22:28:21.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.920+0000 7fd1a6351700 1 -- 172.21.15.8:0/1912420063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a010a550 con 0x7fd1a00f77d0 2023-10-18T22:28:21.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.920+0000 7fd195ffb700 1 -- 172.21.15.8:0/1912420063 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd190014980 con 0x7fd1a00f77d0 2023-10-18T22:28:21.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.920+0000 7fd1a6351700 1 -- 172.21.15.8:0/1912420063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a010ab10 con 0x7fd1a00f77d0 2023-10-18T22:28:21.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.921+0000 7fd1a6351700 1 -- 172.21.15.8:0/1912420063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a0045ad0 con 0x7fd1a00f77d0 2023-10-18T22:28:21.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.922+0000 7fd195ffb700 1 -- 172.21.15.8:0/1912420063 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd1900090d0 con 0x7fd1a00f77d0 2023-10-18T22:28:21.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.922+0000 7fd195ffb700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd18c060f70 0x7fd18c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:21.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.923+0000 7fd195ffb700 1 -- 172.21.15.8:0/1912420063 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd19007c980 con 0x7fd1a00f77d0 2023-10-18T22:28:21.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.923+0000 7fd1a534f700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd18c060f70 0x7fd18c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:21.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.923+0000 7fd1a534f700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd18c060f70 0x7fd18c063430 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fd19c004630 tx=0x7fd19c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:21.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:21.926+0000 7fd195ffb700 1 -- 172.21.15.8:0/1912420063 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd190050010 con 0x7fd1a00f77d0 2023-10-18T22:28:22.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.119+0000 7fd1a6351700 1 -- 172.21.15.8:0/1912420063 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1a010ad90 con 0x7fd18c060f70 2023-10-18T22:28:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.128+0000 7fd195ffb700 1 -- 172.21.15.8:0/1912420063 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd1a010ad90 con 0x7fd18c060f70 2023-10-18T22:28:22.131 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:28:22.132 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (95m) 2m ago 96m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:28:22.132 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (88m) 2m ago 96m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:28:22.132 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (88m) 10m ago 95m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:28:22.132 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (94m) 2m ago 96m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:28:22.132 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 92m - - 2023-10-18T22:28:22.133 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 92m - - 2023-10-18T22:28:22.133 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 10m ago 92m - - 2023-10-18T22:28:22.133 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 10m ago 92m - - 2023-10-18T22:28:22.133 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (90m) 2m ago 97m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:28:22.133 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (89m) 10m ago 95m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:28:22.134 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (89m) 2m ago 97m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:28:22.134 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (89m) 10m ago 95m 319M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:28:22.134 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (96m) 2m ago 96m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:28:22.134 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (95m) 10m ago 95m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:28:22.134 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (88m) 2m ago 95m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:28:22.135 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (86m) 2m ago 94m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:28:22.135 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (86m) 2m ago 94m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:28:22.135 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (85m) 10m ago 94m 536M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:28:22.135 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (84m) 10m ago 93m 461M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:28:22.135 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (84m) 10m ago 93m 389M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:28:22.136 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (90m) 2m ago 95m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:28:22.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.130+0000 7fd1a6351700 1 -- 172.21.15.8:0/1912420063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd18c060f70 msgr2=0x7fd18c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:22.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.130+0000 7fd1a6351700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd18c060f70 0x7fd18c063430 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fd19c004630 tx=0x7fd19c009b30).stop 2023-10-18T22:28:22.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.130+0000 7fd1a6351700 1 -- 172.21.15.8:0/1912420063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a00f77d0 msgr2=0x7fd1a01094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:22.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.130+0000 7fd1a6351700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a00f77d0 0x7fd1a01094c0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7fd1900026d0 tx=0x7fd190009de0).stop 2023-10-18T22:28:22.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.131+0000 7fd1a6351700 1 -- 172.21.15.8:0/1912420063 shutdown_connections 2023-10-18T22:28:22.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.131+0000 7fd1a6351700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd18c060f70 0x7fd18c063430 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.131+0000 7fd1a6351700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a00f6530 0x7fd1a0108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.131+0000 7fd1a6351700 1 --2- 172.21.15.8:0/1912420063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a00f77d0 0x7fd1a01094c0 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.131+0000 7fd1a6351700 1 -- 172.21.15.8:0/1912420063 >> 172.21.15.8:0/1912420063 conn(0x7fd1a00f1c90 msgr2=0x7fd1a006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:22.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.131+0000 7fd1a6351700 1 -- 172.21.15.8:0/1912420063 shutdown_connections 2023-10-18T22:28:22.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.131+0000 7fd1a6351700 1 -- 172.21.15.8:0/1912420063 wait complete. 2023-10-18T22:28:22.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.267+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1906732749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbb80f6530 msgr2=0x7fdbb80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:22.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.267+0000 7fdbbcb21700 1 --2- 172.21.15.8:0/1906732749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbb80f6530 0x7fdbb80f6950 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7fdba8004660 tx=0x7fdba8009b30).stop 2023-10-18T22:28:22.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.267+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1906732749 shutdown_connections 2023-10-18T22:28:22.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.267+0000 7fdbbcb21700 1 --2- 172.21.15.8:0/1906732749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80f77d0 0x7fdbb80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.267+0000 7fdbbcb21700 1 --2- 172.21.15.8:0/1906732749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbb80f6530 0x7fdbb80f6950 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.267+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1906732749 >> 172.21.15.8:0/1906732749 conn(0x7fdbb80f1c90 msgr2=0x7fdbb80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:22.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.267+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1906732749 shutdown_connections 2023-10-18T22:28:22.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.267+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1906732749 wait complete. 2023-10-18T22:28:22.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.268+0000 7fdbbcb21700 1 Processor -- start 2023-10-18T22:28:22.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.268+0000 7fdbbcb21700 1 -- start start 2023-10-18T22:28:22.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.268+0000 7fdbbcb21700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80f6530 0x7fdbb8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:22.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbbcb21700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbb80f77d0 0x7fdbb8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:22.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbbcb21700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb8107880 con 0x7fdbb80f77d0 2023-10-18T22:28:22.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbbcb21700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb81080c0 con 0x7fdbb80f6530 2023-10-18T22:28:22.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbb6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbb80f77d0 0x7fdbb8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:22.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbb6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbb80f77d0 0x7fdbb8107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52420/0 (socket says 172.21.15.8:52420) 2023-10-18T22:28:22.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbb6ffd700 1 -- 172.21.15.8:0/1892256191 learned_addr learned my addr 172.21.15.8:0/1892256191 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:22.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbb77fe700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80f6530 0x7fdbb8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:22.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbb6ffd700 1 -- 172.21.15.8:0/1892256191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80f6530 msgr2=0x7fdbb8106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:22.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbb6ffd700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80f6530 0x7fdbb8106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbb6ffd700 1 -- 172.21.15.8:0/1892256191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba8005040 con 0x7fdbb80f77d0 2023-10-18T22:28:22.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbb77fe700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80f6530 0x7fdbb8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:28:22.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.269+0000 7fdbb6ffd700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbb80f77d0 0x7fdbb8107280 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7fdbac00e7f0 tx=0x7fdbac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:22.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.270+0000 7fdb9ffff700 1 -- 172.21.15.8:0/1892256191 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbac0092e0 con 0x7fdbb80f77d0 2023-10-18T22:28:22.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.270+0000 7fdb9ffff700 1 -- 172.21.15.8:0/1892256191 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdbac00f040 con 0x7fdbb80f77d0 2023-10-18T22:28:22.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.270+0000 7fdb9ffff700 1 -- 172.21.15.8:0/1892256191 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbac0147e0 con 0x7fdbb80f77d0 2023-10-18T22:28:22.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.270+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1892256191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb81083a0 con 0x7fdbb80f77d0 2023-10-18T22:28:22.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.270+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1892256191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb81088e0 con 0x7fdbb80f77d0 2023-10-18T22:28:22.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.271+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1892256191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb8059100 con 0x7fdbb80f77d0 2023-10-18T22:28:22.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.272+0000 7fdb9ffff700 1 -- 172.21.15.8:0/1892256191 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdbac01b030 con 0x7fdbb80f77d0 2023-10-18T22:28:22.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.273+0000 7fdb9ffff700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdba0060f70 0x7fdba0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:22.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.273+0000 7fdb9ffff700 1 -- 172.21.15.8:0/1892256191 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdbac07c740 con 0x7fdbb80f77d0 2023-10-18T22:28:22.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.273+0000 7fdbb77fe700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdba0060f70 0x7fdba0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:22.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.274+0000 7fdbb77fe700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdba0060f70 0x7fdba0063430 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7fdba8009880 tx=0x7fdba800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:22.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.277+0000 7fdb9ffff700 1 -- 172.21.15.8:0/1892256191 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdbac04c340 con 0x7fdbb80f77d0 2023-10-18T22:28:22.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.537+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1892256191 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdbb80fee20 con 0x7fdbb80f77d0 2023-10-18T22:28:22.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.537+0000 7fdb9ffff700 1 -- 172.21.15.8:0/1892256191 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fdbac019020 con 0x7fdbb80f77d0 2023-10-18T22:28:22.540 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:28:22.541 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:28:22.541 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:28:22.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:28:22.541 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:28:22.541 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:28:22.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:28:22.542 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:28:22.542 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:28:22.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:28:22.543 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:28:22.543 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:28:22.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:28:22.543 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:28:22.543 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:28:22.544 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:28:22.544 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1892256191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdba0060f70 msgr2=0x7fdba0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdba0060f70 0x7fdba0063430 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7fdba8009880 tx=0x7fdba800b040).stop 2023-10-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1892256191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbb80f77d0 msgr2=0x7fdbb8107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbb80f77d0 0x7fdbb8107280 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7fdbac00e7f0 tx=0x7fdbac00b040).stop 2023-10-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1892256191 shutdown_connections 2023-10-18T22:28:22.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdba0060f70 0x7fdba0063430 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb80f6530 0x7fdbb8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 --2- 172.21.15.8:0/1892256191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbb80f77d0 0x7fdbb8107280 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1892256191 >> 172.21.15.8:0/1892256191 conn(0x7fdbb80f1c90 msgr2=0x7fdbb80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1892256191 shutdown_connections 2023-10-18T22:28:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.540+0000 7fdbbcb21700 1 -- 172.21.15.8:0/1892256191 wait complete. 2023-10-18T22:28:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:21.428024+0000 mgr.smithi008.flmjzp (mgr.14640) 5361 : audit [DBG] from='client.38272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:22.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.676+0000 7f18d359e700 1 -- 172.21.15.8:0/2098508732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18d40602b0 msgr2=0x7f18d40f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:22.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.676+0000 7f18d359e700 1 --2- 172.21.15.8:0/2098508732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18d40602b0 0x7f18d40f9170 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7f18c4004660 tx=0x7f18c4009b30).stop 2023-10-18T22:28:22.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.676+0000 7f18d359e700 1 -- 172.21.15.8:0/2098508732 shutdown_connections 2023-10-18T22:28:22.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.676+0000 7f18d359e700 1 --2- 172.21.15.8:0/2098508732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d40f96f0 0x7f18d40fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.676+0000 7f18d359e700 1 --2- 172.21.15.8:0/2098508732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18d40602b0 0x7f18d40f9170 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.676+0000 7f18d359e700 1 -- 172.21.15.8:0/2098508732 >> 172.21.15.8:0/2098508732 conn(0x7f18d40f0b90 msgr2=0x7f18d40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:22.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.676+0000 7f18d359e700 1 -- 172.21.15.8:0/2098508732 shutdown_connections 2023-10-18T22:28:22.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.676+0000 7f18d359e700 1 -- 172.21.15.8:0/2098508732 wait complete. 2023-10-18T22:28:22.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.677+0000 7f18d359e700 1 Processor -- start 2023-10-18T22:28:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.677+0000 7f18d359e700 1 -- start start 2023-10-18T22:28:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d40602b0 0x7f18d4108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18d40f96f0 0x7f18d4109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:22.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4109a20 con 0x7f18d40f96f0 2023-10-18T22:28:22.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4109b60 con 0x7f18d40602b0 2023-10-18T22:28:22.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18d40f96f0 0x7f18d4109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:22.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18d40f96f0 0x7f18d4109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52426/0 (socket says 172.21.15.8:52426) 2023-10-18T22:28:22.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d1d9b700 1 -- 172.21.15.8:0/2754606012 learned_addr learned my addr 172.21.15.8:0/2754606012 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:22.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d259c700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d40602b0 0x7f18d4108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:22.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d1d9b700 1 -- 172.21.15.8:0/2754606012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d40602b0 msgr2=0x7f18d4108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:22.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d1d9b700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d40602b0 0x7f18d4108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d1d9b700 1 -- 172.21.15.8:0/2754606012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4005040 con 0x7f18d40f96f0 2023-10-18T22:28:22.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.678+0000 7f18d259c700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d40602b0 0x7f18d4108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:28:22.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.679+0000 7f18d1d9b700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18d40f96f0 0x7f18d4109470 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f18c8002700 tx=0x7f18c8009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:22.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.679+0000 7f18c2ffd700 1 -- 172.21.15.8:0/2754606012 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18c8009320 con 0x7f18d40f96f0 2023-10-18T22:28:22.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.679+0000 7f18d359e700 1 -- 172.21.15.8:0/2754606012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d410a500 con 0x7f18d40f96f0 2023-10-18T22:28:22.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.679+0000 7f18c2ffd700 1 -- 172.21.15.8:0/2754606012 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f18c800f040 con 0x7f18d40f96f0 2023-10-18T22:28:22.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.679+0000 7f18c2ffd700 1 -- 172.21.15.8:0/2754606012 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18c8014650 con 0x7f18d40f96f0 2023-10-18T22:28:22.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.679+0000 7f18d359e700 1 -- 172.21.15.8:0/2754606012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d410aac0 con 0x7f18d40f96f0 2023-10-18T22:28:22.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.680+0000 7f18d359e700 1 -- 172.21.15.8:0/2754606012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d4045ad0 con 0x7f18d40f96f0 2023-10-18T22:28:22.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.681+0000 7f18c2ffd700 1 -- 172.21.15.8:0/2754606012 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f18c80077b0 con 0x7f18d40f96f0 2023-10-18T22:28:22.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.682+0000 7f18c2ffd700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18bc060f70 0x7f18bc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:22.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.682+0000 7f18c2ffd700 1 -- 172.21.15.8:0/2754606012 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f18c807cd90 con 0x7f18d40f96f0 2023-10-18T22:28:22.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.682+0000 7f18d259c700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18bc060f70 0x7f18bc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:22.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.683+0000 7f18d259c700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18bc060f70 0x7f18bc063430 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f18c4005010 tx=0x7f18c4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:22.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.686+0000 7f18c2ffd700 1 -- 172.21.15.8:0/2754606012 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f18c8050370 con 0x7f18d40f96f0 2023-10-18T22:28:22.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:21.428024+0000 mgr.smithi008.flmjzp (mgr.14640) 5361 : audit [DBG] from='client.38272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:22.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.910+0000 7f18d359e700 1 -- 172.21.15.8:0/2754606012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f18d410b160 con 0x7f18d40f96f0 2023-10-18T22:28:22.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.911+0000 7f18c2ffd700 1 -- 172.21.15.8:0/2754606012 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f18c80181b0 con 0x7f18d40f96f0 2023-10-18T22:28:22.914 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:28:22.914 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:28:22.914 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:28:22.914 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:28:22.915 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:28:22.915 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:28:22.915 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:28:22.915 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:28:22.915 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:28:22.916 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:28:22.916 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:28:22.916 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:28:22.916 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:28:22.916 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:28:22.917 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:28:22.917 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:28:22.917 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:28:22.917 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:28:22.917 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:28:22.918 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:28:22.918 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:28:22.918 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:28:22.918 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:28:22.918 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:28:22.919 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:28:22.919 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:28:22.919 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:28:22.919 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:28:22.919 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:28:22.920 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:28:22.920 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:28:22.920 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:28:22.920 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:28:22.920 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:28:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 -- 172.21.15.8:0/2754606012 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18bc060f70 msgr2=0x7f18bc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18bc060f70 0x7f18bc063430 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f18c4005010 tx=0x7f18c4009b30).stop 2023-10-18T22:28:22.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 -- 172.21.15.8:0/2754606012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18d40f96f0 msgr2=0x7f18d4109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:22.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18d40f96f0 0x7f18d4109470 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f18c8002700 tx=0x7f18c8009d60).stop 2023-10-18T22:28:22.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 -- 172.21.15.8:0/2754606012 shutdown_connections 2023-10-18T22:28:22.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f18bc060f70 0x7f18bc063430 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d40602b0 0x7f18d4108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 --2- 172.21.15.8:0/2754606012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18d40f96f0 0x7f18d4109470 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:22.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 -- 172.21.15.8:0/2754606012 >> 172.21.15.8:0/2754606012 conn(0x7f18d40f0b90 msgr2=0x7f18d40f4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:22.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 -- 172.21.15.8:0/2754606012 shutdown_connections 2023-10-18T22:28:22.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:22.913+0000 7f18d359e700 1 -- 172.21.15.8:0/2754606012 wait complete. 2023-10-18T22:28:22.924 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:28:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.050+0000 7f44bf59e700 1 -- 172.21.15.8:0/3156326907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f6530 msgr2=0x7f44c00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.050+0000 7f44bf59e700 1 --2- 172.21.15.8:0/3156326907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f6530 0x7f44c00f6950 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f44b0004660 tx=0x7f44b0009b30).stop 2023-10-18T22:28:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.050+0000 7f44bf59e700 1 -- 172.21.15.8:0/3156326907 shutdown_connections 2023-10-18T22:28:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.050+0000 7f44bf59e700 1 --2- 172.21.15.8:0/3156326907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f77d0 0x7f44c00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:23.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.050+0000 7f44bf59e700 1 --2- 172.21.15.8:0/3156326907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f6530 0x7f44c00f6950 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:23.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.050+0000 7f44bf59e700 1 -- 172.21.15.8:0/3156326907 >> 172.21.15.8:0/3156326907 conn(0x7f44c00f1c90 msgr2=0x7f44c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:23.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.050+0000 7f44bf59e700 1 -- 172.21.15.8:0/3156326907 shutdown_connections 2023-10-18T22:28:23.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.050+0000 7f44bf59e700 1 -- 172.21.15.8:0/3156326907 wait complete. 2023-10-18T22:28:23.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.051+0000 7f44bf59e700 1 Processor -- start 2023-10-18T22:28:23.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.051+0000 7f44bf59e700 1 -- start start 2023-10-18T22:28:23.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.051+0000 7f44bf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 0x7f44c0108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:23.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.051+0000 7f44bf59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:23.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.052+0000 7f44bf59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0109a40 con 0x7f44c00f77d0 2023-10-18T22:28:23.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.052+0000 7f44bf59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0109b80 con 0x7f44c00f6530 2023-10-18T22:28:23.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.052+0000 7f44bdd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:23.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.052+0000 7f44bdd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52444/0 (socket says 172.21.15.8:52444) 2023-10-18T22:28:23.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.052+0000 7f44bdd9b700 1 -- 172.21.15.8:0/11547094 learned_addr learned my addr 172.21.15.8:0/11547094 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:23.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.052+0000 7f44be59c700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 0x7f44c0108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:23.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.052+0000 7f44bdd9b700 1 -- 172.21.15.8:0/11547094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 msgr2=0x7f44c0108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:23.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.052+0000 7f44bdd9b700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 0x7f44c0108fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:23.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.052+0000 7f44bdd9b700 1 -- 172.21.15.8:0/11547094 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0005040 con 0x7f44c00f77d0 2023-10-18T22:28:23.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.052+0000 7f44bdd9b700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0109490 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f44b40026d0 tx=0x7f44b4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:23.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.053+0000 7f44aeffd700 1 -- 172.21.15.8:0/11547094 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b40079c0 con 0x7f44c00f77d0 2023-10-18T22:28:23.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.053+0000 7f44aeffd700 1 -- 172.21.15.8:0/11547094 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f44b400f040 con 0x7f44c00f77d0 2023-10-18T22:28:23.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.053+0000 7f44aeffd700 1 -- 172.21.15.8:0/11547094 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b4014980 con 0x7f44c00f77d0 2023-10-18T22:28:23.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.053+0000 7f44bf59e700 1 -- 172.21.15.8:0/11547094 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c010a520 con 0x7f44c00f77d0 2023-10-18T22:28:23.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.053+0000 7f44bf59e700 1 -- 172.21.15.8:0/11547094 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c010aae0 con 0x7f44c00f77d0 2023-10-18T22:28:23.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.054+0000 7f44bf59e700 1 -- 172.21.15.8:0/11547094 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c0045ad0 con 0x7f44c00f77d0 2023-10-18T22:28:23.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.055+0000 7f44aeffd700 1 -- 172.21.15.8:0/11547094 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f44b40090d0 con 0x7f44c00f77d0 2023-10-18T22:28:23.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.056+0000 7f44aeffd700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 0x7f44a8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:23.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.056+0000 7f44aeffd700 1 -- 172.21.15.8:0/11547094 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f44b407c980 con 0x7f44c00f77d0 2023-10-18T22:28:23.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.056+0000 7f44be59c700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 0x7f44a8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:23.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.057+0000 7f44be59c700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 0x7f44a8063430 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f44b0004630 tx=0x7f44b0009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:23.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.060+0000 7f44aeffd700 1 -- 172.21.15.8:0/11547094 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f44b4050010 con 0x7f44c00f77d0 2023-10-18T22:28:23.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.258+0000 7f44bf59e700 1 -- 172.21.15.8:0/11547094 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f44c00fbdc0 con 0x7f44a8060f70 2023-10-18T22:28:23.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.259+0000 7f44aeffd700 1 -- 172.21.15.8:0/11547094 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f44c00fbdc0 con 0x7f44a8060f70 2023-10-18T22:28:23.262 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:28:23.262 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:28:23.262 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:28:23.263 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:28:23.263 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:28:23.263 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:28:23.263 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:28:23.263 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:28:23.264 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:28:23.264 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:28:23.264 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:28:23.264 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:28:23.265 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:28:23.265 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:28:23.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 -- 172.21.15.8:0/11547094 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 msgr2=0x7f44a8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:23.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 0x7f44a8063430 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f44b0004630 tx=0x7f44b0009b30).stop 2023-10-18T22:28:23.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 -- 172.21.15.8:0/11547094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 msgr2=0x7f44c0109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:23.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0109490 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f44b40026d0 tx=0x7f44b4009de0).stop 2023-10-18T22:28:23.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 -- 172.21.15.8:0/11547094 shutdown_connections 2023-10-18T22:28:23.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f44a8060f70 0x7f44a8063430 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:23.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c00f6530 0x7f44c0108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:23.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 --2- 172.21.15.8:0/11547094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44c00f77d0 0x7f44c0109490 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:23.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 -- 172.21.15.8:0/11547094 >> 172.21.15.8:0/11547094 conn(0x7f44c00f1c90 msgr2=0x7f44c00f3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:23.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 -- 172.21.15.8:0/11547094 shutdown_connections 2023-10-18T22:28:23.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:23.261+0000 7f44bf59e700 1 -- 172.21.15.8:0/11547094 wait complete. 2023-10-18T22:28:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:21.666538+0000 mgr.smithi008.flmjzp (mgr.14640) 5362 : cluster [DBG] pgmap v3677: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:21.779029+0000 mgr.smithi008.flmjzp (mgr.14640) 5363 : audit [DBG] from='client.38276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:22.121718+0000 mgr.smithi008.flmjzp (mgr.14640) 5364 : audit [DBG] from='client.38280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:22.539126+0000 mon.smithi008 (mon.0) 5603 : audit [DBG] from='client.? 172.21.15.8:0/1892256191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:23.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:22.912611+0000 mon.smithi008 (mon.0) 5604 : audit [DBG] from='client.? 172.21.15.8:0/2754606012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:28:23.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:21.666538+0000 mgr.smithi008.flmjzp (mgr.14640) 5362 : cluster [DBG] pgmap v3677: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:23.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:21.779029+0000 mgr.smithi008.flmjzp (mgr.14640) 5363 : audit [DBG] from='client.38276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:23.863 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:22.121718+0000 mgr.smithi008.flmjzp (mgr.14640) 5364 : audit [DBG] from='client.38280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:23.863 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:22.539126+0000 mon.smithi008 (mon.0) 5603 : audit [DBG] from='client.? 172.21.15.8:0/1892256191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:23.863 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:22.912611+0000 mon.smithi008 (mon.0) 5604 : audit [DBG] from='client.? 172.21.15.8:0/2754606012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:28:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:23.260688+0000 mgr.smithi008.flmjzp (mgr.14640) 5365 : audit [DBG] from='client.38292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:23.689945+0000 mon.smithi008 (mon.0) 5605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:23.260688+0000 mgr.smithi008.flmjzp (mgr.14640) 5365 : audit [DBG] from='client.38292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:24.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:23.689945+0000 mon.smithi008 (mon.0) 5605 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:23.666976+0000 mgr.smithi008.flmjzp (mgr.14640) 5366 : cluster [DBG] pgmap v3678: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:23.666976+0000 mgr.smithi008.flmjzp (mgr.14640) 5366 : cluster [DBG] pgmap v3678: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:27.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:25.667572+0000 mgr.smithi008.flmjzp (mgr.14640) 5367 : cluster [DBG] pgmap v3679: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:26.297673+0000 mon.smithi008 (mon.0) 5606 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:26.298646+0000 mon.smithi008 (mon.0) 5607 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:27.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:26.299735+0000 mon.smithi008 (mon.0) 5608 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:26.300627+0000 mgr.smithi008.flmjzp (mgr.14640) 5368 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:26.301354+0000 mgr.smithi008.flmjzp (mgr.14640) 5369 : cluster [DBG] pgmap v3680: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:26.301672+0000 mgr.smithi008.flmjzp (mgr.14640) 5370 : cluster [DBG] pgmap v3681: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:27.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:26.306360+0000 mon.smithi008 (mon.0) 5609 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:27.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:26.312773+0000 mon.smithi008 (mon.0) 5610 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:27.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:26.315608+0000 mon.smithi008 (mon.0) 5611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:27.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:26.317547+0000 mon.smithi008 (mon.0) 5612 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:27.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:26.319226+0000 mon.smithi008 (mon.0) 5613 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:27.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:26.321154+0000 mon.smithi008 (mon.0) 5614 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:27.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:26.323354+0000 mgr.smithi008.flmjzp (mgr.14640) 5371 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:25.667572+0000 mgr.smithi008.flmjzp (mgr.14640) 5367 : cluster [DBG] pgmap v3679: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:26.297673+0000 mon.smithi008 (mon.0) 5606 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:26.298646+0000 mon.smithi008 (mon.0) 5607 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:26.299735+0000 mon.smithi008 (mon.0) 5608 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:26.300627+0000 mgr.smithi008.flmjzp (mgr.14640) 5368 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:26.301354+0000 mgr.smithi008.flmjzp (mgr.14640) 5369 : cluster [DBG] pgmap v3680: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:26.301672+0000 mgr.smithi008.flmjzp (mgr.14640) 5370 : cluster [DBG] pgmap v3681: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:26.306360+0000 mon.smithi008 (mon.0) 5609 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:26.312773+0000 mon.smithi008 (mon.0) 5610 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:26.315608+0000 mon.smithi008 (mon.0) 5611 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:27.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:26.317547+0000 mon.smithi008 (mon.0) 5612 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:27.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:26.319226+0000 mon.smithi008 (mon.0) 5613 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:27.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:26.321154+0000 mon.smithi008 (mon.0) 5614 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:27.740 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:26.323354+0000 mgr.smithi008.flmjzp (mgr.14640) 5371 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:29.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:28.302142+0000 mgr.smithi008.flmjzp (mgr.14640) 5372 : cluster [DBG] pgmap v3682: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:28.302142+0000 mgr.smithi008.flmjzp (mgr.14640) 5372 : cluster [DBG] pgmap v3682: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:31.487 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:30.302725+0000 mgr.smithi008.flmjzp (mgr.14640) 5373 : cluster [DBG] pgmap v3683: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:31.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:30.302725+0000 mgr.smithi008.flmjzp (mgr.14640) 5373 : cluster [DBG] pgmap v3683: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:33.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:32.303407+0000 mgr.smithi008.flmjzp (mgr.14640) 5374 : cluster [DBG] pgmap v3684: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:33.862 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:32.303407+0000 mgr.smithi008.flmjzp (mgr.14640) 5374 : cluster [DBG] pgmap v3684: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:34.303985+0000 mgr.smithi008.flmjzp (mgr.14640) 5375 : cluster [DBG] pgmap v3685: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:35.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:34.303985+0000 mgr.smithi008.flmjzp (mgr.14640) 5375 : cluster [DBG] pgmap v3685: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:36.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:36.329011+0000 mon.smithi008 (mon.0) 5615 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:36.329011+0000 mon.smithi008 (mon.0) 5615 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:36.304637+0000 mgr.smithi008.flmjzp (mgr.14640) 5376 : cluster [DBG] pgmap v3686: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:36.890633+0000 mon.smithi008 (mon.0) 5616 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:37.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:36.891468+0000 mon.smithi008 (mon.0) 5617 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:36.896900+0000 mon.smithi008 (mon.0) 5618 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:36.901927+0000 mon.smithi008 (mon.0) 5619 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:36.904343+0000 mon.smithi008 (mon.0) 5620 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:37.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:36.905566+0000 mon.smithi008 (mon.0) 5621 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:37.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:36.906747+0000 mon.smithi008 (mon.0) 5622 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:37.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:36.908288+0000 mon.smithi008 (mon.0) 5623 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:36.304637+0000 mgr.smithi008.flmjzp (mgr.14640) 5376 : cluster [DBG] pgmap v3686: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:36.890633+0000 mon.smithi008 (mon.0) 5616 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:36.891468+0000 mon.smithi008 (mon.0) 5617 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:36.896900+0000 mon.smithi008 (mon.0) 5618 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:36.901927+0000 mon.smithi008 (mon.0) 5619 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:36.904343+0000 mon.smithi008 (mon.0) 5620 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:36.905566+0000 mon.smithi008 (mon.0) 5621 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:36.906747+0000 mon.smithi008 (mon.0) 5622 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:37.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:36.908288+0000 mon.smithi008 (mon.0) 5623 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:36.892111+0000 mgr.smithi008.flmjzp (mgr.14640) 5377 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:36.892567+0000 mgr.smithi008.flmjzp (mgr.14640) 5378 : cluster [DBG] pgmap v3687: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:36.892757+0000 mgr.smithi008.flmjzp (mgr.14640) 5379 : cluster [DBG] pgmap v3688: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:36.909821+0000 mgr.smithi008.flmjzp (mgr.14640) 5380 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:36.892111+0000 mgr.smithi008.flmjzp (mgr.14640) 5377 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:38.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:36.892567+0000 mgr.smithi008.flmjzp (mgr.14640) 5378 : cluster [DBG] pgmap v3687: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:36.892757+0000 mgr.smithi008.flmjzp (mgr.14640) 5379 : cluster [DBG] pgmap v3688: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:38.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:36.909821+0000 mgr.smithi008.flmjzp (mgr.14640) 5380 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:40.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:38.893410+0000 mgr.smithi008.flmjzp (mgr.14640) 5381 : cluster [DBG] pgmap v3689: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:40.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:38.893410+0000 mgr.smithi008.flmjzp (mgr.14640) 5381 : cluster [DBG] pgmap v3689: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:40.893908+0000 mgr.smithi008.flmjzp (mgr.14640) 5382 : cluster [DBG] pgmap v3690: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:42.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:40.893908+0000 mgr.smithi008.flmjzp (mgr.14640) 5382 : cluster [DBG] pgmap v3690: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:42.894602+0000 mgr.smithi008.flmjzp (mgr.14640) 5383 : cluster [DBG] pgmap v3691: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:44.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:42.894602+0000 mgr.smithi008.flmjzp (mgr.14640) 5383 : cluster [DBG] pgmap v3691: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:46.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:44.895300+0000 mgr.smithi008.flmjzp (mgr.14640) 5384 : cluster [DBG] pgmap v3692: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:44.895300+0000 mgr.smithi008.flmjzp (mgr.14640) 5384 : cluster [DBG] pgmap v3692: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:46.916234+0000 mon.smithi008 (mon.0) 5624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:46.918366+0000 mon.smithi008 (mon.0) 5625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:46.919362+0000 mon.smithi008 (mon.0) 5626 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:47.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:46.926107+0000 mon.smithi008 (mon.0) 5627 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:46.932566+0000 mon.smithi008 (mon.0) 5628 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:46.935886+0000 mon.smithi008 (mon.0) 5629 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:46.937629+0000 mon.smithi008 (mon.0) 5630 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:46.939379+0000 mon.smithi008 (mon.0) 5631 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:47.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:46.941415+0000 mon.smithi008 (mon.0) 5632 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:46.916234+0000 mon.smithi008 (mon.0) 5624 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:46.918366+0000 mon.smithi008 (mon.0) 5625 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:46.919362+0000 mon.smithi008 (mon.0) 5626 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:46.926107+0000 mon.smithi008 (mon.0) 5627 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:46.932566+0000 mon.smithi008 (mon.0) 5628 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:46.935886+0000 mon.smithi008 (mon.0) 5629 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:46.937629+0000 mon.smithi008 (mon.0) 5630 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:47.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:46.939379+0000 mon.smithi008 (mon.0) 5631 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:47.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:46.941415+0000 mon.smithi008 (mon.0) 5632 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:46.895843+0000 mgr.smithi008.flmjzp (mgr.14640) 5385 : cluster [DBG] pgmap v3693: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:46.920328+0000 mgr.smithi008.flmjzp (mgr.14640) 5386 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:46.920923+0000 mgr.smithi008.flmjzp (mgr.14640) 5387 : cluster [DBG] pgmap v3694: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:46.921184+0000 mgr.smithi008.flmjzp (mgr.14640) 5388 : cluster [DBG] pgmap v3695: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:46.943333+0000 mgr.smithi008.flmjzp (mgr.14640) 5389 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:46.895843+0000 mgr.smithi008.flmjzp (mgr.14640) 5385 : cluster [DBG] pgmap v3693: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:46.920328+0000 mgr.smithi008.flmjzp (mgr.14640) 5386 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:46.920923+0000 mgr.smithi008.flmjzp (mgr.14640) 5387 : cluster [DBG] pgmap v3694: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:48.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:46.921184+0000 mgr.smithi008.flmjzp (mgr.14640) 5388 : cluster [DBG] pgmap v3695: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:48.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:46.943333+0000 mgr.smithi008.flmjzp (mgr.14640) 5389 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:48.921802+0000 mgr.smithi008.flmjzp (mgr.14640) 5390 : cluster [DBG] pgmap v3696: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:48.921802+0000 mgr.smithi008.flmjzp (mgr.14640) 5390 : cluster [DBG] pgmap v3696: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:50.922351+0000 mgr.smithi008.flmjzp (mgr.14640) 5391 : cluster [DBG] pgmap v3697: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:50.922351+0000 mgr.smithi008.flmjzp (mgr.14640) 5391 : cluster [DBG] pgmap v3697: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:53.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.413+0000 7fa380f86700 1 -- 172.21.15.8:0/193341599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa37c0f6530 msgr2=0x7fa37c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.413+0000 7fa380f86700 1 --2- 172.21.15.8:0/193341599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa37c0f6530 0x7fa37c0f6950 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7fa36c004660 tx=0x7fa36c009b30).stop 2023-10-18T22:28:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.414+0000 7fa380f86700 1 -- 172.21.15.8:0/193341599 shutdown_connections 2023-10-18T22:28:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.414+0000 7fa380f86700 1 --2- 172.21.15.8:0/193341599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa37c0f77d0 0x7fa37c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.414+0000 7fa380f86700 1 --2- 172.21.15.8:0/193341599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa37c0f6530 0x7fa37c0f6950 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.414+0000 7fa380f86700 1 -- 172.21.15.8:0/193341599 >> 172.21.15.8:0/193341599 conn(0x7fa37c0f1c90 msgr2=0x7fa37c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:53.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.414+0000 7fa380f86700 1 -- 172.21.15.8:0/193341599 shutdown_connections 2023-10-18T22:28:53.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.414+0000 7fa380f86700 1 -- 172.21.15.8:0/193341599 wait complete. 2023-10-18T22:28:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.415+0000 7fa380f86700 1 Processor -- start 2023-10-18T22:28:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.415+0000 7fa380f86700 1 -- start start 2023-10-18T22:28:53.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.415+0000 7fa380f86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa37c0f6530 0x7fa37c108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:53.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.415+0000 7fa380f86700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa37c0f77d0 0x7fa37c1094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:53.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.415+0000 7fa380f86700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c109a50 con 0x7fa37c0f77d0 2023-10-18T22:28:53.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.415+0000 7fa380f86700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c109b90 con 0x7fa37c0f6530 2023-10-18T22:28:53.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.415+0000 7fa37affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa37c0f77d0 0x7fa37c1094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:53.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa37affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa37c0f77d0 0x7fa37c1094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54708/0 (socket says 172.21.15.8:54708) 2023-10-18T22:28:53.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa37affd700 1 -- 172.21.15.8:0/2680938015 learned_addr learned my addr 172.21.15.8:0/2680938015 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:53.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa37b7fe700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa37c0f6530 0x7fa37c108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:53.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa37affd700 1 -- 172.21.15.8:0/2680938015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa37c0f6530 msgr2=0x7fa37c108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:53.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa37affd700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa37c0f6530 0x7fa37c108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa37affd700 1 -- 172.21.15.8:0/2680938015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c005040 con 0x7fa37c0f77d0 2023-10-18T22:28:53.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa37b7fe700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa37c0f6530 0x7fa37c108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:28:53.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa37affd700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa37c0f77d0 0x7fa37c1094a0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7fa3700026d0 tx=0x7fa370009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:53.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa363fff700 1 -- 172.21.15.8:0/2680938015 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa370009320 con 0x7fa37c0f77d0 2023-10-18T22:28:53.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa363fff700 1 -- 172.21.15.8:0/2680938015 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa37000f040 con 0x7fa37c0f77d0 2023-10-18T22:28:53.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa380f86700 1 -- 172.21.15.8:0/2680938015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c10a530 con 0x7fa37c0f77d0 2023-10-18T22:28:53.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.416+0000 7fa363fff700 1 -- 172.21.15.8:0/2680938015 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3700148a0 con 0x7fa37c0f77d0 2023-10-18T22:28:53.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.417+0000 7fa380f86700 1 -- 172.21.15.8:0/2680938015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c10aaf0 con 0x7fa37c0f77d0 2023-10-18T22:28:53.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.418+0000 7fa380f86700 1 -- 172.21.15.8:0/2680938015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c045ad0 con 0x7fa37c0f77d0 2023-10-18T22:28:53.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.419+0000 7fa363fff700 1 -- 172.21.15.8:0/2680938015 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa370009480 con 0x7fa37c0f77d0 2023-10-18T22:28:53.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.419+0000 7fa363fff700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa364060f70 0x7fa364063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:53.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.420+0000 7fa363fff700 1 -- 172.21.15.8:0/2680938015 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa37007cf60 con 0x7fa37c0f77d0 2023-10-18T22:28:53.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.420+0000 7fa37b7fe700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa364060f70 0x7fa364063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:53.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.420+0000 7fa37b7fe700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa364060f70 0x7fa364063430 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7fa36c005010 tx=0x7fa36c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:53.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.424+0000 7fa363fff700 1 -- 172.21.15.8:0/2680938015 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa3700505c0 con 0x7fa37c0f77d0 2023-10-18T22:28:53.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.623+0000 7fa380f86700 1 -- 172.21.15.8:0/2680938015 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa37c0fee70 con 0x7fa364060f70 2023-10-18T22:28:53.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.624+0000 7fa363fff700 1 -- 172.21.15.8:0/2680938015 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa36c013410 con 0x7fa364060f70 2023-10-18T22:28:53.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 -- 172.21.15.8:0/2680938015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa364060f70 msgr2=0x7fa364063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:53.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa364060f70 0x7fa364063430 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7fa36c005010 tx=0x7fa36c009b30).stop 2023-10-18T22:28:53.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 -- 172.21.15.8:0/2680938015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa37c0f77d0 msgr2=0x7fa37c1094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:53.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa37c0f77d0 0x7fa37c1094a0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7fa3700026d0 tx=0x7fa370009de0).stop 2023-10-18T22:28:53.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 -- 172.21.15.8:0/2680938015 shutdown_connections 2023-10-18T22:28:53.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa364060f70 0x7fa364063430 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa37c0f6530 0x7fa37c108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 --2- 172.21.15.8:0/2680938015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa37c0f77d0 0x7fa37c1094a0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 -- 172.21.15.8:0/2680938015 >> 172.21.15.8:0/2680938015 conn(0x7fa37c0f1c90 msgr2=0x7fa37c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:53.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 -- 172.21.15.8:0/2680938015 shutdown_connections 2023-10-18T22:28:53.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.626+0000 7fa380f86700 1 -- 172.21.15.8:0/2680938015 wait complete. 2023-10-18T22:28:53.643 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:28:53.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.763+0000 7fe9f25b2700 1 -- 172.21.15.8:0/2470093689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9ec0f6530 msgr2=0x7fe9ec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:53.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.763+0000 7fe9f25b2700 1 --2- 172.21.15.8:0/2470093689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9ec0f6530 0x7fe9ec0f6950 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7fe9e8004660 tx=0x7fe9e8009b30).stop 2023-10-18T22:28:53.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.763+0000 7fe9f25b2700 1 -- 172.21.15.8:0/2470093689 shutdown_connections 2023-10-18T22:28:53.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.763+0000 7fe9f25b2700 1 --2- 172.21.15.8:0/2470093689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9ec0f77d0 0x7fe9ec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.763+0000 7fe9f25b2700 1 --2- 172.21.15.8:0/2470093689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9ec0f6530 0x7fe9ec0f6950 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.763+0000 7fe9f25b2700 1 -- 172.21.15.8:0/2470093689 >> 172.21.15.8:0/2470093689 conn(0x7fe9ec0f1c90 msgr2=0x7fe9ec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:53.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.763+0000 7fe9f25b2700 1 -- 172.21.15.8:0/2470093689 shutdown_connections 2023-10-18T22:28:53.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.764+0000 7fe9f25b2700 1 -- 172.21.15.8:0/2470093689 wait complete. 2023-10-18T22:28:53.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.765+0000 7fe9f25b2700 1 Processor -- start 2023-10-18T22:28:53.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.765+0000 7fe9f25b2700 1 -- start start 2023-10-18T22:28:53.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.765+0000 7fe9f25b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9ec0f6530 0x7fe9ec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:53.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.765+0000 7fe9f25b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9ec0f77d0 0x7fe9ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:53.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.765+0000 7fe9f25b2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec06a380 con 0x7fe9ec0f6530 2023-10-18T22:28:53.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.765+0000 7fe9f25b2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec06a4c0 con 0x7fe9ec0f77d0 2023-10-18T22:28:53.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.766+0000 7fe9f15b0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9ec0f6530 0x7fe9ec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:53.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.766+0000 7fe9f15b0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9ec0f6530 0x7fe9ec06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54722/0 (socket says 172.21.15.8:54722) 2023-10-18T22:28:53.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.766+0000 7fe9f15b0700 1 -- 172.21.15.8:0/992024139 learned_addr learned my addr 172.21.15.8:0/992024139 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:53.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.766+0000 7fe9f0daf700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9ec0f77d0 0x7fe9ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:53.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.766+0000 7fe9f15b0700 1 -- 172.21.15.8:0/992024139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9ec0f77d0 msgr2=0x7fe9ec069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:53.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.766+0000 7fe9f15b0700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9ec0f77d0 0x7fe9ec069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.766+0000 7fe9f15b0700 1 -- 172.21.15.8:0/992024139 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8005040 con 0x7fe9ec0f6530 2023-10-18T22:28:53.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.766+0000 7fe9f15b0700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9ec0f6530 0x7fe9ec06b9a0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7fe9e8007a70 tx=0x7fe9e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:53.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.766+0000 7fe9e1ffb700 1 -- 172.21.15.8:0/992024139 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9e8018070 con 0x7fe9ec0f6530 2023-10-18T22:28:53.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.767+0000 7fe9e1ffb700 1 -- 172.21.15.8:0/992024139 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe9e801d8e0 con 0x7fe9ec0f6530 2023-10-18T22:28:53.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.767+0000 7fe9f25b2700 1 -- 172.21.15.8:0/992024139 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec06a740 con 0x7fe9ec0f6530 2023-10-18T22:28:53.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.767+0000 7fe9e1ffb700 1 -- 172.21.15.8:0/992024139 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9e801c660 con 0x7fe9ec0f6530 2023-10-18T22:28:53.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.767+0000 7fe9f25b2700 1 -- 172.21.15.8:0/992024139 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec06aca0 con 0x7fe9ec0f6530 2023-10-18T22:28:53.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.768+0000 7fe9f25b2700 1 -- 172.21.15.8:0/992024139 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec045ad0 con 0x7fe9ec0f6530 2023-10-18T22:28:53.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.769+0000 7fe9e1ffb700 1 -- 172.21.15.8:0/992024139 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe9e801da50 con 0x7fe9ec0f6530 2023-10-18T22:28:53.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.769+0000 7fe9e1ffb700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9d8060f70 0x7fe9d8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:53.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.769+0000 7fe9e1ffb700 1 -- 172.21.15.8:0/992024139 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe9e807e9b0 con 0x7fe9ec0f6530 2023-10-18T22:28:53.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.770+0000 7fe9f0daf700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9d8060f70 0x7fe9d8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:53.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.770+0000 7fe9f0daf700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9d8060f70 0x7fe9d8063430 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fe9dc0041d0 tx=0x7fe9dc009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:53.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.774+0000 7fe9e1ffb700 1 -- 172.21.15.8:0/992024139 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe9e804e560 con 0x7fe9ec0f6530 2023-10-18T22:28:53.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.971+0000 7fe9f25b2700 1 -- 172.21.15.8:0/992024139 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9ec0fee70 con 0x7fe9d8060f70 2023-10-18T22:28:53.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.972+0000 7fe9e1ffb700 1 -- 172.21.15.8:0/992024139 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe9dc004600 con 0x7fe9d8060f70 2023-10-18T22:28:53.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 -- 172.21.15.8:0/992024139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9d8060f70 msgr2=0x7fe9d8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:53.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9d8060f70 0x7fe9d8063430 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fe9dc0041d0 tx=0x7fe9dc009040).stop 2023-10-18T22:28:53.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 -- 172.21.15.8:0/992024139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9ec0f6530 msgr2=0x7fe9ec06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:53.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9ec0f6530 0x7fe9ec06b9a0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7fe9e8007a70 tx=0x7fe9e8009b30).stop 2023-10-18T22:28:53.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 -- 172.21.15.8:0/992024139 shutdown_connections 2023-10-18T22:28:53.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe9d8060f70 0x7fe9d8063430 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9ec0f6530 0x7fe9ec06b9a0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 --2- 172.21.15.8:0/992024139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9ec0f77d0 0x7fe9ec069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:53.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 -- 172.21.15.8:0/992024139 >> 172.21.15.8:0/992024139 conn(0x7fe9ec0f1c90 msgr2=0x7fe9ec0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:53.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 -- 172.21.15.8:0/992024139 shutdown_connections 2023-10-18T22:28:53.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:53.974+0000 7fe9f25b2700 1 -- 172.21.15.8:0/992024139 wait complete. 2023-10-18T22:28:54.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.110+0000 7f9b1359e700 1 -- 172.21.15.8:0/433620048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b140f77d0 msgr2=0x7f9b140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:54.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.110+0000 7f9b1359e700 1 --2- 172.21.15.8:0/433620048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b140f77d0 0x7f9b140f7c30 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7f9b08004660 tx=0x7f9b08009b30).stop 2023-10-18T22:28:54.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.110+0000 7f9b1359e700 1 -- 172.21.15.8:0/433620048 shutdown_connections 2023-10-18T22:28:54.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.110+0000 7f9b1359e700 1 --2- 172.21.15.8:0/433620048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b140f77d0 0x7f9b140f7c30 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.110+0000 7f9b1359e700 1 --2- 172.21.15.8:0/433620048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b140f6530 0x7f9b140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.110+0000 7f9b1359e700 1 -- 172.21.15.8:0/433620048 >> 172.21.15.8:0/433620048 conn(0x7f9b140f1c90 msgr2=0x7f9b140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:54.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.110+0000 7f9b1359e700 1 -- 172.21.15.8:0/433620048 shutdown_connections 2023-10-18T22:28:54.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.110+0000 7f9b1359e700 1 -- 172.21.15.8:0/433620048 wait complete. 2023-10-18T22:28:54.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.111+0000 7f9b1359e700 1 Processor -- start 2023-10-18T22:28:54.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.112+0000 7f9b1359e700 1 -- start start 2023-10-18T22:28:54.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.112+0000 7f9b1359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b140f6530 0x7f9b14108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.112+0000 7f9b1359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b140f77d0 0x7f9b14109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.112+0000 7f9b1359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14109a20 con 0x7f9b140f6530 2023-10-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.112+0000 7f9b1359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14109b60 con 0x7f9b140f77d0 2023-10-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.112+0000 7f9b1259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b140f6530 0x7f9b14108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:54.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.112+0000 7f9b1259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b140f6530 0x7f9b14108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54736/0 (socket says 172.21.15.8:54736) 2023-10-18T22:28:54.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.112+0000 7f9b1259c700 1 -- 172.21.15.8:0/1648423985 learned_addr learned my addr 172.21.15.8:0/1648423985 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:54.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.113+0000 7f9b11d9b700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b140f77d0 0x7f9b14109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:54.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.113+0000 7f9b1259c700 1 -- 172.21.15.8:0/1648423985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b140f77d0 msgr2=0x7f9b14109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.113+0000 7f9b1259c700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b140f77d0 0x7f9b14109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.113+0000 7f9b1259c700 1 -- 172.21.15.8:0/1648423985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08005040 con 0x7f9b140f6530 2023-10-18T22:28:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.113+0000 7f9b1259c700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b140f6530 0x7f9b14108f80 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7f9b04002700 tx=0x7f9b04009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.113+0000 7f9b02ffd700 1 -- 172.21.15.8:0/1648423985 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b040079c0 con 0x7f9b140f6530 2023-10-18T22:28:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.113+0000 7f9b02ffd700 1 -- 172.21.15.8:0/1648423985 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9b0400f040 con 0x7f9b140f6530 2023-10-18T22:28:54.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.113+0000 7f9b1359e700 1 -- 172.21.15.8:0/1648423985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1410a500 con 0x7f9b140f6530 2023-10-18T22:28:54.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.113+0000 7f9b02ffd700 1 -- 172.21.15.8:0/1648423985 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b040148d0 con 0x7f9b140f6530 2023-10-18T22:28:54.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.113+0000 7f9b1359e700 1 -- 172.21.15.8:0/1648423985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1410aac0 con 0x7f9b140f6530 2023-10-18T22:28:54.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.115+0000 7f9b1359e700 1 -- 172.21.15.8:0/1648423985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b14045ad0 con 0x7f9b140f6530 2023-10-18T22:28:54.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.115+0000 7f9b02ffd700 1 -- 172.21.15.8:0/1648423985 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9b0401b060 con 0x7f9b140f6530 2023-10-18T22:28:54.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.116+0000 7f9b02ffd700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9afc060f70 0x7f9afc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:54.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.116+0000 7f9b02ffd700 1 -- 172.21.15.8:0/1648423985 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9b0407c710 con 0x7f9b140f6530 2023-10-18T22:28:54.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.116+0000 7f9b11d9b700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9afc060f70 0x7f9afc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:54.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.117+0000 7f9b11d9b700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9afc060f70 0x7f9afc063430 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f9b08004630 tx=0x7f9b08009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:54.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.120+0000 7f9b02ffd700 1 -- 172.21.15.8:0/1648423985 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9b0404fdb0 con 0x7f9b140f6530 2023-10-18T22:28:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.313+0000 7f9b1359e700 1 -- 172.21.15.8:0/1648423985 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b140fee40 con 0x7f9afc060f70 2023-10-18T22:28:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.323+0000 7f9b02ffd700 1 -- 172.21.15.8:0/1648423985 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9b140fee40 con 0x7f9afc060f70 2023-10-18T22:28:54.325 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (95m) 2m ago 97m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (89m) 2m ago 97m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (89m) 28s ago 96m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (95m) 2m ago 96m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 2m ago 93m - - 2023-10-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 2m ago 92m - - 2023-10-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 28s ago 93m - - 2023-10-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 28s ago 92m - - 2023-10-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (90m) 2m ago 98m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (90m) 28s ago 96m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (89m) 2m ago 98m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (89m) 28s ago 96m 342M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (96m) 2m ago 96m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (95m) 28s ago 95m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (89m) 2m ago 95m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (87m) 2m ago 95m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (86m) 2m ago 94m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (86m) 28s ago 94m 559M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (85m) 28s ago 94m 479M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (85m) 28s ago 94m 407M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (91m) 2m ago 96m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.324+0000 7f9b1359e700 1 -- 172.21.15.8:0/1648423985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9afc060f70 msgr2=0x7f9afc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.324+0000 7f9b1359e700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9afc060f70 0x7f9afc063430 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f9b08004630 tx=0x7f9b08009b30).stop 2023-10-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.324+0000 7f9b1359e700 1 -- 172.21.15.8:0/1648423985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b140f6530 msgr2=0x7f9b14108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.324+0000 7f9b1359e700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b140f6530 0x7f9b14108f80 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7f9b04002700 tx=0x7f9b04009d80).stop 2023-10-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.325+0000 7f9b1359e700 1 -- 172.21.15.8:0/1648423985 shutdown_connections 2023-10-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.325+0000 7f9b1359e700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9afc060f70 0x7f9afc063430 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.325+0000 7f9b1359e700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b140f6530 0x7f9b14108f80 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.325+0000 7f9b1359e700 1 --2- 172.21.15.8:0/1648423985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b140f77d0 0x7f9b14109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.325+0000 7f9b1359e700 1 -- 172.21.15.8:0/1648423985 >> 172.21.15.8:0/1648423985 conn(0x7f9b140f1c90 msgr2=0x7f9b1406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:54.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.325+0000 7f9b1359e700 1 -- 172.21.15.8:0/1648423985 shutdown_connections 2023-10-18T22:28:54.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.325+0000 7f9b1359e700 1 -- 172.21.15.8:0/1648423985 wait complete. 2023-10-18T22:28:54.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.460+0000 7f93e9a77700 1 -- 172.21.15.8:0/1016344367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4060310 msgr2=0x7f93e40f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:54.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.460+0000 7f93e9a77700 1 --2- 172.21.15.8:0/1016344367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4060310 0x7f93e40f9110 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7f93d8004660 tx=0x7f93d8009b30).stop 2023-10-18T22:28:54.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.460+0000 7f93e9a77700 1 -- 172.21.15.8:0/1016344367 shutdown_connections 2023-10-18T22:28:54.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.460+0000 7f93e9a77700 1 --2- 172.21.15.8:0/1016344367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93e40f9690 0x7f93e40fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.460+0000 7f93e9a77700 1 --2- 172.21.15.8:0/1016344367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4060310 0x7f93e40f9110 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.460+0000 7f93e9a77700 1 -- 172.21.15.8:0/1016344367 >> 172.21.15.8:0/1016344367 conn(0x7f93e40f0b90 msgr2=0x7f93e40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:54.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.460+0000 7f93e9a77700 1 -- 172.21.15.8:0/1016344367 shutdown_connections 2023-10-18T22:28:54.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.460+0000 7f93e9a77700 1 -- 172.21.15.8:0/1016344367 wait complete. 2023-10-18T22:28:54.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.461+0000 7f93e9a77700 1 Processor -- start 2023-10-18T22:28:54.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.461+0000 7f93e9a77700 1 -- start start 2023-10-18T22:28:54.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.461+0000 7f93e9a77700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4060310 0x7f93e40f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:54.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.461+0000 7f93e9a77700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93e40f9690 0x7f93e40f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:54.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.461+0000 7f93e9a77700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40f5570 con 0x7f93e4060310 2023-10-18T22:28:54.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.461+0000 7f93e9a77700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40f56b0 con 0x7f93e40f9690 2023-10-18T22:28:54.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.462+0000 7f93e8a75700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4060310 0x7f93e40f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:54.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.462+0000 7f93e8a75700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4060310 0x7f93e40f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54750/0 (socket says 172.21.15.8:54750) 2023-10-18T22:28:54.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.462+0000 7f93e8a75700 1 -- 172.21.15.8:0/188321853 learned_addr learned my addr 172.21.15.8:0/188321853 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:54.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.462+0000 7f93e3fff700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93e40f9690 0x7f93e40f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:54.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.462+0000 7f93e8a75700 1 -- 172.21.15.8:0/188321853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93e40f9690 msgr2=0x7f93e40f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:54.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.462+0000 7f93e8a75700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93e40f9690 0x7f93e40f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.462+0000 7f93e8a75700 1 -- 172.21.15.8:0/188321853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8005040 con 0x7f93e4060310 2023-10-18T22:28:54.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.462+0000 7f93e3fff700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93e40f9690 0x7f93e40f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:28:54.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.462+0000 7f93e8a75700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4060310 0x7f93e40f6b90 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7f93d8009f50 tx=0x7f93d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:54.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.463+0000 7f93e17fa700 1 -- 172.21.15.8:0/188321853 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93d8018070 con 0x7f93e4060310 2023-10-18T22:28:54.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.463+0000 7f93e17fa700 1 -- 172.21.15.8:0/188321853 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f93d8009630 con 0x7f93e4060310 2023-10-18T22:28:54.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.463+0000 7f93e9a77700 1 -- 172.21.15.8:0/188321853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e40f5930 con 0x7f93e4060310 2023-10-18T22:28:54.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.463+0000 7f93e17fa700 1 -- 172.21.15.8:0/188321853 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93d801c3c0 con 0x7f93e4060310 2023-10-18T22:28:54.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.463+0000 7f93e9a77700 1 -- 172.21.15.8:0/188321853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e40f5e90 con 0x7f93e4060310 2023-10-18T22:28:54.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.464+0000 7f93e9a77700 1 -- 172.21.15.8:0/188321853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e4045ad0 con 0x7f93e4060310 2023-10-18T22:28:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.465+0000 7f93e17fa700 1 -- 172.21.15.8:0/188321853 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f93d801d420 con 0x7f93e4060310 2023-10-18T22:28:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.466+0000 7f93e17fa700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f93d4060f70 0x7f93d4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.466+0000 7f93e17fa700 1 -- 172.21.15.8:0/188321853 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f93d807e600 con 0x7f93e4060310 2023-10-18T22:28:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.466+0000 7f93e3fff700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f93d4060f70 0x7f93d4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.467+0000 7f93e3fff700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f93d4060f70 0x7f93d4063430 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f93e40600e0 tx=0x7f93d000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.470+0000 7f93e17fa700 1 -- 172.21.15.8:0/188321853 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f93d804e310 con 0x7f93e4060310 2023-10-18T22:28:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:52.923026+0000 mgr.smithi008.flmjzp (mgr.14640) 5392 : cluster [DBG] pgmap v3698: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:54.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.722+0000 7f93e9a77700 1 -- 172.21.15.8:0/188321853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f93e4027a00 con 0x7f93e4060310 2023-10-18T22:28:54.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.723+0000 7f93e17fa700 1 -- 172.21.15.8:0/188321853 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f93d8051930 con 0x7f93e4060310 2023-10-18T22:28:54.726 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:28:54.726 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:28:54.726 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:28:54.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:28:54.727 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:28:54.727 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:28:54.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:28:54.727 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:28:54.728 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:28:54.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:28:54.728 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:28:54.728 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:28:54.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:28:54.729 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:28:54.729 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:28:54.729 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:28:54.729 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:28:54.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.725+0000 7f93e9a77700 1 -- 172.21.15.8:0/188321853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f93d4060f70 msgr2=0x7f93d4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:54.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.725+0000 7f93e9a77700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f93d4060f70 0x7f93d4063430 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f93e40600e0 tx=0x7f93d000b040).stop 2023-10-18T22:28:54.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.725+0000 7f93e9a77700 1 -- 172.21.15.8:0/188321853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4060310 msgr2=0x7f93e40f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:54.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.725+0000 7f93e9a77700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4060310 0x7f93e40f6b90 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7f93d8009f50 tx=0x7f93d8009b30).stop 2023-10-18T22:28:54.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.725+0000 7f93e9a77700 1 -- 172.21.15.8:0/188321853 shutdown_connections 2023-10-18T22:28:54.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.725+0000 7f93e9a77700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f93d4060f70 0x7f93d4063430 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.725+0000 7f93e9a77700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4060310 0x7f93e40f6b90 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.725+0000 7f93e9a77700 1 --2- 172.21.15.8:0/188321853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93e40f9690 0x7f93e40f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.725+0000 7f93e9a77700 1 -- 172.21.15.8:0/188321853 >> 172.21.15.8:0/188321853 conn(0x7f93e40f0b90 msgr2=0x7f93e40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:54.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.726+0000 7f93e9a77700 1 -- 172.21.15.8:0/188321853 shutdown_connections 2023-10-18T22:28:54.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.726+0000 7f93e9a77700 1 -- 172.21.15.8:0/188321853 wait complete. 2023-10-18T22:28:54.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.863+0000 7fcb1ae01700 1 -- 172.21.15.8:0/3054197031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f6530 msgr2=0x7fcb140f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.863+0000 7fcb1ae01700 1 --2- 172.21.15.8:0/3054197031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f6530 0x7fcb140f6950 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7fcb10004660 tx=0x7fcb10009b30).stop 2023-10-18T22:28:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.863+0000 7fcb1ae01700 1 -- 172.21.15.8:0/3054197031 shutdown_connections 2023-10-18T22:28:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.863+0000 7fcb1ae01700 1 --2- 172.21.15.8:0/3054197031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f77d0 0x7fcb140f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.863+0000 7fcb1ae01700 1 --2- 172.21.15.8:0/3054197031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f6530 0x7fcb140f6950 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.863+0000 7fcb1ae01700 1 -- 172.21.15.8:0/3054197031 >> 172.21.15.8:0/3054197031 conn(0x7fcb140f1c90 msgr2=0x7fcb140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:54.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.863+0000 7fcb1ae01700 1 -- 172.21.15.8:0/3054197031 shutdown_connections 2023-10-18T22:28:54.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.863+0000 7fcb1ae01700 1 -- 172.21.15.8:0/3054197031 wait complete. 2023-10-18T22:28:54.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.864+0000 7fcb1ae01700 1 Processor -- start 2023-10-18T22:28:54.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.864+0000 7fcb1ae01700 1 -- start start 2023-10-18T22:28:54.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.864+0000 7fcb1ae01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 0x7fcb14106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.864+0000 7fcb1ae01700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.864+0000 7fcb1ae01700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14107910 con 0x7fcb140f77d0 2023-10-18T22:28:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.864+0000 7fcb1ae01700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14108120 con 0x7fcb140f6530 2023-10-18T22:28:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb195fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb195fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54776/0 (socket says 172.21.15.8:54776) 2023-10-18T22:28:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb195fe700 1 -- 172.21.15.8:0/739186081 learned_addr learned my addr 172.21.15.8:0/739186081 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb19dff700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 0x7fcb14106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb195fe700 1 -- 172.21.15.8:0/739186081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 msgr2=0x7fcb14106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb195fe700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 0x7fcb14106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb195fe700 1 -- 172.21.15.8:0/739186081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10005040 con 0x7fcb140f77d0 2023-10-18T22:28:54.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb19dff700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 0x7fcb14106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:28:54.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb195fe700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14107310 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7fcb040026d0 tx=0x7fcb04009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:54.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb0a7fc700 1 -- 172.21.15.8:0/739186081 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb04009320 con 0x7fcb140f77d0 2023-10-18T22:28:54.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb0a7fc700 1 -- 172.21.15.8:0/739186081 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcb0400f040 con 0x7fcb140f77d0 2023-10-18T22:28:54.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.865+0000 7fcb0a7fc700 1 -- 172.21.15.8:0/739186081 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb040148a0 con 0x7fcb140f77d0 2023-10-18T22:28:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.866+0000 7fcb1ae01700 1 -- 172.21.15.8:0/739186081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb141083a0 con 0x7fcb140f77d0 2023-10-18T22:28:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.866+0000 7fcb1ae01700 1 -- 172.21.15.8:0/739186081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb14108960 con 0x7fcb140f77d0 2023-10-18T22:28:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.867+0000 7fcb1ae01700 1 -- 172.21.15.8:0/739186081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb14059100 con 0x7fcb140f77d0 2023-10-18T22:28:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.868+0000 7fcb0a7fc700 1 -- 172.21.15.8:0/739186081 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fcb04009480 con 0x7fcb140f77d0 2023-10-18T22:28:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.869+0000 7fcb0a7fc700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 0x7fcb00063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.869+0000 7fcb0a7fc700 1 -- 172.21.15.8:0/739186081 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fcb0407cf60 con 0x7fcb140f77d0 2023-10-18T22:28:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.869+0000 7fcb19dff700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 0x7fcb00063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:54.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.870+0000 7fcb19dff700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 0x7fcb00063430 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fcb10004630 tx=0x7fcb10009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:54.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:54.873+0000 7fcb0a7fc700 1 -- 172.21.15.8:0/739186081 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fcb0404cb90 con 0x7fcb140f77d0 2023-10-18T22:28:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:52.923026+0000 mgr.smithi008.flmjzp (mgr.14640) 5392 : cluster [DBG] pgmap v3698: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:55.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.098+0000 7fcb1ae01700 1 -- 172.21.15.8:0/739186081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcb14027a00 con 0x7fcb140f77d0 2023-10-18T22:28:55.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.099+0000 7fcb0a7fc700 1 -- 172.21.15.8:0/739186081 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fcb040501b0 con 0x7fcb140f77d0 2023-10-18T22:28:55.102 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:28:55.102 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:28:55.102 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:28:55.103 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:28:55.103 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:28:55.103 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:28:55.104 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:28:55.104 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:28:55.104 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:28:55.104 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:28:55.105 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:28:55.105 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:28:55.105 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:28:55.105 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:28:55.105 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:28:55.105 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:28:55.106 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:28:55.106 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:28:55.106 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:28:55.106 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:28:55.106 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:28:55.107 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:28:55.107 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:28:55.107 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:28:55.107 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:28:55.107 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:28:55.108 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:28:55.108 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:28:55.108 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:28:55.108 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:28:55.108 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:28:55.109 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:28:55.109 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:28:55.109 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:28:55.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 -- 172.21.15.8:0/739186081 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 msgr2=0x7fcb00063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:55.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 0x7fcb00063430 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fcb10004630 tx=0x7fcb10009b30).stop 2023-10-18T22:28:55.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 -- 172.21.15.8:0/739186081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 msgr2=0x7fcb14107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:55.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14107310 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 rx=0x7fcb040026d0 tx=0x7fcb04009de0).stop 2023-10-18T22:28:55.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 -- 172.21.15.8:0/739186081 shutdown_connections 2023-10-18T22:28:55.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fcb00060f70 0x7fcb00063430 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:55.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb140f6530 0x7fcb14106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:55.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 --2- 172.21.15.8:0/739186081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb140f77d0 0x7fcb14107310 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:55.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 -- 172.21.15.8:0/739186081 >> 172.21.15.8:0/739186081 conn(0x7fcb140f1c90 msgr2=0x7fcb140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:55.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 -- 172.21.15.8:0/739186081 shutdown_connections 2023-10-18T22:28:55.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.101+0000 7fcb1ae01700 1 -- 172.21.15.8:0/739186081 wait complete. 2023-10-18T22:28:55.112 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:28:55.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.239+0000 7f9a95af6700 1 -- 172.21.15.8:0/3002514366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a900f6530 msgr2=0x7f9a900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:55.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.239+0000 7f9a95af6700 1 --2- 172.21.15.8:0/3002514366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a900f6530 0x7f9a900f6950 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7f9a84004660 tx=0x7f9a84009b30).stop 2023-10-18T22:28:55.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.239+0000 7f9a95af6700 1 -- 172.21.15.8:0/3002514366 shutdown_connections 2023-10-18T22:28:55.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.239+0000 7f9a95af6700 1 --2- 172.21.15.8:0/3002514366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a900f77d0 0x7f9a900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.239+0000 7f9a95af6700 1 --2- 172.21.15.8:0/3002514366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a900f6530 0x7f9a900f6950 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.239+0000 7f9a95af6700 1 -- 172.21.15.8:0/3002514366 >> 172.21.15.8:0/3002514366 conn(0x7f9a900f1c90 msgr2=0x7f9a900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.239+0000 7f9a95af6700 1 -- 172.21.15.8:0/3002514366 shutdown_connections 2023-10-18T22:28:55.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.239+0000 7f9a95af6700 1 -- 172.21.15.8:0/3002514366 wait complete. 2023-10-18T22:28:55.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.240+0000 7f9a95af6700 1 Processor -- start 2023-10-18T22:28:55.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.240+0000 7f9a95af6700 1 -- start start 2023-10-18T22:28:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.240+0000 7f9a95af6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a900f6530 0x7f9a90108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.240+0000 7f9a95af6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a900f77d0 0x7f9a90109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.240+0000 7f9a95af6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a901099e0 con 0x7f9a900f6530 2023-10-18T22:28:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.240+0000 7f9a95af6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90109b20 con 0x7f9a900f77d0 2023-10-18T22:28:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.240+0000 7f9a94af4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a900f6530 0x7f9a90108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.240+0000 7f9a94af4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a900f6530 0x7f9a90108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54794/0 (socket says 172.21.15.8:54794) 2023-10-18T22:28:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.240+0000 7f9a94af4700 1 -- 172.21.15.8:0/3542982858 learned_addr learned my addr 172.21.15.8:0/3542982858 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:28:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.240+0000 7f9a8ffff700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a900f77d0 0x7f9a90109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.241+0000 7f9a94af4700 1 -- 172.21.15.8:0/3542982858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a900f77d0 msgr2=0x7f9a90109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.241+0000 7f9a94af4700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a900f77d0 0x7f9a90109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.241+0000 7f9a94af4700 1 -- 172.21.15.8:0/3542982858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a84005040 con 0x7f9a900f6530 2023-10-18T22:28:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.241+0000 7f9a94af4700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a900f6530 0x7f9a90108f40 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f9a84009870 tx=0x7f9a8400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.241+0000 7f9a8d7fa700 1 -- 172.21.15.8:0/3542982858 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a84019070 con 0x7f9a900f6530 2023-10-18T22:28:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.241+0000 7f9a8d7fa700 1 -- 172.21.15.8:0/3542982858 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9a84013380 con 0x7f9a900f6530 2023-10-18T22:28:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.241+0000 7f9a95af6700 1 -- 172.21.15.8:0/3542982858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9010a460 con 0x7f9a900f6530 2023-10-18T22:28:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.241+0000 7f9a8d7fa700 1 -- 172.21.15.8:0/3542982858 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8401edf0 con 0x7f9a900f6530 2023-10-18T22:28:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.242+0000 7f9a95af6700 1 -- 172.21.15.8:0/3542982858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9010a940 con 0x7f9a900f6530 2023-10-18T22:28:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.243+0000 7f9a95af6700 1 -- 172.21.15.8:0/3542982858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a90045ad0 con 0x7f9a900f6530 2023-10-18T22:28:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.243+0000 7f9a8d7fa700 1 -- 172.21.15.8:0/3542982858 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f9a8401e420 con 0x7f9a900f6530 2023-10-18T22:28:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.244+0000 7f9a8d7fa700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a80060f70 0x7f9a80063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:28:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.244+0000 7f9a8d7fa700 1 -- 172.21.15.8:0/3542982858 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f9a8407dd00 con 0x7f9a900f6530 2023-10-18T22:28:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.245+0000 7f9a8ffff700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a80060f70 0x7f9a80063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:28:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.245+0000 7f9a8ffff700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a80060f70 0x7f9a80063430 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f9a7c009fd0 tx=0x7f9a7c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:28:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.249+0000 7f9a8d7fa700 1 -- 172.21.15.8:0/3542982858 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f9a84051360 con 0x7f9a900f6530 2023-10-18T22:28:55.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.451+0000 7f9a95af6700 1 -- 172.21.15.8:0/3542982858 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a900fee00 con 0x7f9a80060f70 2023-10-18T22:28:55.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.452+0000 7f9a8d7fa700 1 -- 172.21.15.8:0/3542982858 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9a900fee00 con 0x7f9a80060f70 2023-10-18T22:28:55.455 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:28:55.455 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:28:55.455 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:28:55.456 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:28:55.456 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:28:55.456 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:28:55.456 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:28:55.456 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:28:55.457 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:28:55.457 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:28:55.457 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:28:55.457 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:28:55.457 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:28:55.458 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:28:55.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 -- 172.21.15.8:0/3542982858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a80060f70 msgr2=0x7f9a80063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:55.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a80060f70 0x7f9a80063430 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f9a7c009fd0 tx=0x7f9a7c00b040).stop 2023-10-18T22:28:55.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 -- 172.21.15.8:0/3542982858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a900f6530 msgr2=0x7f9a90108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:28:55.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a900f6530 0x7f9a90108f40 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f9a84009870 tx=0x7f9a8400b040).stop 2023-10-18T22:28:55.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 -- 172.21.15.8:0/3542982858 shutdown_connections 2023-10-18T22:28:55.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9a80060f70 0x7f9a80063430 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:55.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a900f6530 0x7f9a90108f40 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:55.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 --2- 172.21.15.8:0/3542982858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a900f77d0 0x7f9a90109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:28:55.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 -- 172.21.15.8:0/3542982858 >> 172.21.15.8:0/3542982858 conn(0x7f9a900f1c90 msgr2=0x7f9a9006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:28:55.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 -- 172.21.15.8:0/3542982858 shutdown_connections 2023-10-18T22:28:55.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:28:55.455+0000 7f9a95af6700 1 -- 172.21.15.8:0/3542982858 wait complete. 2023-10-18T22:28:55.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:53.625313+0000 mgr.smithi008.flmjzp (mgr.14640) 5393 : audit [DBG] from='client.38296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:53.973530+0000 mgr.smithi008.flmjzp (mgr.14640) 5394 : audit [DBG] from='client.38300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:55.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:54.315559+0000 mgr.smithi008.flmjzp (mgr.14640) 5395 : audit [DBG] from='client.38304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:54.724600+0000 mon.smithi008 (mon.0) 5633 : audit [DBG] from='client.? 172.21.15.8:0/188321853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:55.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:55.100561+0000 mon.smithi008 (mon.0) 5634 : audit [DBG] from='client.? 172.21.15.8:0/739186081' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:28:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:53.625313+0000 mgr.smithi008.flmjzp (mgr.14640) 5393 : audit [DBG] from='client.38296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:53.973530+0000 mgr.smithi008.flmjzp (mgr.14640) 5394 : audit [DBG] from='client.38300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:54.315559+0000 mgr.smithi008.flmjzp (mgr.14640) 5395 : audit [DBG] from='client.38304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:54.724600+0000 mon.smithi008 (mon.0) 5633 : audit [DBG] from='client.? 172.21.15.8:0/188321853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:55.100561+0000 mon.smithi008 (mon.0) 5634 : audit [DBG] from='client.? 172.21.15.8:0/739186081' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:28:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:54.923518+0000 mgr.smithi008.flmjzp (mgr.14640) 5396 : cluster [DBG] pgmap v3699: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:56.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:55.453822+0000 mgr.smithi008.flmjzp (mgr.14640) 5397 : audit [DBG] from='client.38316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:54.923518+0000 mgr.smithi008.flmjzp (mgr.14640) 5396 : cluster [DBG] pgmap v3699: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:55.453822+0000 mgr.smithi008.flmjzp (mgr.14640) 5397 : audit [DBG] from='client.38316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:28:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:56.952093+0000 mon.smithi008 (mon.0) 5635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:57.512393+0000 mon.smithi008 (mon.0) 5636 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:57.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:57.513591+0000 mon.smithi008 (mon.0) 5637 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:56.952093+0000 mon.smithi008 (mon.0) 5635 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:57.512393+0000 mon.smithi008 (mon.0) 5636 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:28:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:57.513591+0000 mon.smithi008 (mon.0) 5637 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:28:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:56.924165+0000 mgr.smithi008.flmjzp (mgr.14640) 5398 : cluster [DBG] pgmap v3700: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:58.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:57.514523+0000 mgr.smithi008.flmjzp (mgr.14640) 5399 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:57.515216+0000 mgr.smithi008.flmjzp (mgr.14640) 5400 : cluster [DBG] pgmap v3701: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:57.515571+0000 mgr.smithi008.flmjzp (mgr.14640) 5401 : cluster [DBG] pgmap v3702: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:58.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:57.524129+0000 mon.smithi008 (mon.0) 5638 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:58.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:57.530383+0000 mon.smithi008 (mon.0) 5639 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:58.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:57.533613+0000 mon.smithi008 (mon.0) 5640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:58.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:57.535259+0000 mon.smithi008 (mon.0) 5641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:58.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:57.536849+0000 mon.smithi008 (mon.0) 5642 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:58.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:28:57.538900+0000 mon.smithi008 (mon.0) 5643 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:58.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:28:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:28:57.540933+0000 mgr.smithi008.flmjzp (mgr.14640) 5402 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:28:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:56.924165+0000 mgr.smithi008.flmjzp (mgr.14640) 5398 : cluster [DBG] pgmap v3700: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:57.514523+0000 mgr.smithi008.flmjzp (mgr.14640) 5399 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:28:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:57.515216+0000 mgr.smithi008.flmjzp (mgr.14640) 5400 : cluster [DBG] pgmap v3701: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:57.515571+0000 mgr.smithi008.flmjzp (mgr.14640) 5401 : cluster [DBG] pgmap v3702: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:28:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:57.524129+0000 mon.smithi008 (mon.0) 5638 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:28:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:57.530383+0000 mon.smithi008 (mon.0) 5639 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:28:58.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:57.533613+0000 mon.smithi008 (mon.0) 5640 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:58.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:57.535259+0000 mon.smithi008 (mon.0) 5641 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:58.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:57.536849+0000 mon.smithi008 (mon.0) 5642 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:58.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:28:57.538900+0000 mon.smithi008 (mon.0) 5643 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:28:58.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:28:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:28:57.540933+0000 mgr.smithi008.flmjzp (mgr.14640) 5402 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:28:59.516391+0000 mgr.smithi008.flmjzp (mgr.14640) 5403 : cluster [DBG] pgmap v3703: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:28:59.516391+0000 mgr.smithi008.flmjzp (mgr.14640) 5403 : cluster [DBG] pgmap v3703: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:02.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:01.517085+0000 mgr.smithi008.flmjzp (mgr.14640) 5404 : cluster [DBG] pgmap v3704: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:02.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:01.517085+0000 mgr.smithi008.flmjzp (mgr.14640) 5404 : cluster [DBG] pgmap v3704: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:03.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:03.517809+0000 mgr.smithi008.flmjzp (mgr.14640) 5405 : cluster [DBG] pgmap v3705: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:03.517809+0000 mgr.smithi008.flmjzp (mgr.14640) 5405 : cluster [DBG] pgmap v3705: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:05.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:05.518433+0000 mgr.smithi008.flmjzp (mgr.14640) 5406 : cluster [DBG] pgmap v3706: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:05.518433+0000 mgr.smithi008.flmjzp (mgr.14640) 5406 : cluster [DBG] pgmap v3706: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:07.519171+0000 mgr.smithi008.flmjzp (mgr.14640) 5407 : cluster [DBG] pgmap v3707: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:07.551595+0000 mon.smithi008 (mon.0) 5644 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:07.553712+0000 mon.smithi008 (mon.0) 5645 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:07.554705+0000 mon.smithi008 (mon.0) 5646 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:07.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:07.555597+0000 mgr.smithi008.flmjzp (mgr.14640) 5408 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:29:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:07.556153+0000 mgr.smithi008.flmjzp (mgr.14640) 5409 : cluster [DBG] pgmap v3708: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:07.556394+0000 mgr.smithi008.flmjzp (mgr.14640) 5410 : cluster [DBG] pgmap v3709: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:07.561288+0000 mon.smithi008 (mon.0) 5647 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:07.567671+0000 mon.smithi008 (mon.0) 5648 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:07.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:07.570940+0000 mon.smithi008 (mon.0) 5649 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:07.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:07.573871+0000 mon.smithi008 (mon.0) 5650 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:07.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:07.575445+0000 mon.smithi008 (mon.0) 5651 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:07.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:07.577436+0000 mon.smithi008 (mon.0) 5652 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:07.519171+0000 mgr.smithi008.flmjzp (mgr.14640) 5407 : cluster [DBG] pgmap v3707: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:07.551595+0000 mon.smithi008 (mon.0) 5644 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:07.553712+0000 mon.smithi008 (mon.0) 5645 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:07.554705+0000 mon.smithi008 (mon.0) 5646 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:07.555597+0000 mgr.smithi008.flmjzp (mgr.14640) 5408 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:29:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:07.556153+0000 mgr.smithi008.flmjzp (mgr.14640) 5409 : cluster [DBG] pgmap v3708: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:07.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:07.556394+0000 mgr.smithi008.flmjzp (mgr.14640) 5410 : cluster [DBG] pgmap v3709: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:07.561288+0000 mon.smithi008 (mon.0) 5647 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:07.567671+0000 mon.smithi008 (mon.0) 5648 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:07.570940+0000 mon.smithi008 (mon.0) 5649 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:07.573871+0000 mon.smithi008 (mon.0) 5650 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:07.575445+0000 mon.smithi008 (mon.0) 5651 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:07.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:07.577436+0000 mon.smithi008 (mon.0) 5652 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:08.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:07.579323+0000 mgr.smithi008.flmjzp (mgr.14640) 5411 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:07.579323+0000 mgr.smithi008.flmjzp (mgr.14640) 5411 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:09.557059+0000 mgr.smithi008.flmjzp (mgr.14640) 5412 : cluster [DBG] pgmap v3710: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:09.557059+0000 mgr.smithi008.flmjzp (mgr.14640) 5412 : cluster [DBG] pgmap v3710: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:11.557720+0000 mgr.smithi008.flmjzp (mgr.14640) 5413 : cluster [DBG] pgmap v3711: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:11.557720+0000 mgr.smithi008.flmjzp (mgr.14640) 5413 : cluster [DBG] pgmap v3711: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:13.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:13.558392+0000 mgr.smithi008.flmjzp (mgr.14640) 5414 : cluster [DBG] pgmap v3712: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:13.558392+0000 mgr.smithi008.flmjzp (mgr.14640) 5414 : cluster [DBG] pgmap v3712: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:15.558944+0000 mgr.smithi008.flmjzp (mgr.14640) 5415 : cluster [DBG] pgmap v3713: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:15.558944+0000 mgr.smithi008.flmjzp (mgr.14640) 5415 : cluster [DBG] pgmap v3713: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:17.559583+0000 mgr.smithi008.flmjzp (mgr.14640) 5416 : cluster [DBG] pgmap v3714: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:17.583709+0000 mon.smithi008 (mon.0) 5653 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:17.585837+0000 mon.smithi008 (mon.0) 5654 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:17.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:17.586789+0000 mon.smithi008 (mon.0) 5655 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:17.593251+0000 mon.smithi008 (mon.0) 5656 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:17.600041+0000 mon.smithi008 (mon.0) 5657 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:17.603133+0000 mon.smithi008 (mon.0) 5658 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:17.604817+0000 mon.smithi008 (mon.0) 5659 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:17.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:17.606464+0000 mon.smithi008 (mon.0) 5660 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:17.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:17.608485+0000 mon.smithi008 (mon.0) 5661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:17.559583+0000 mgr.smithi008.flmjzp (mgr.14640) 5416 : cluster [DBG] pgmap v3714: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:17.583709+0000 mon.smithi008 (mon.0) 5653 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:17.585837+0000 mon.smithi008 (mon.0) 5654 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:17.586789+0000 mon.smithi008 (mon.0) 5655 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:17.593251+0000 mon.smithi008 (mon.0) 5656 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:17.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:17.600041+0000 mon.smithi008 (mon.0) 5657 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:17.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:17.603133+0000 mon.smithi008 (mon.0) 5658 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:17.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:17.604817+0000 mon.smithi008 (mon.0) 5659 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:17.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:17.606464+0000 mon.smithi008 (mon.0) 5660 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:17.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:17.608485+0000 mon.smithi008 (mon.0) 5661 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:18.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:17.587636+0000 mgr.smithi008.flmjzp (mgr.14640) 5417 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:29:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:17.588186+0000 mgr.smithi008.flmjzp (mgr.14640) 5418 : cluster [DBG] pgmap v3715: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:17.588517+0000 mgr.smithi008.flmjzp (mgr.14640) 5419 : cluster [DBG] pgmap v3716: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:18.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:17.610365+0000 mgr.smithi008.flmjzp (mgr.14640) 5420 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:17.587636+0000 mgr.smithi008.flmjzp (mgr.14640) 5417 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:29:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:17.588186+0000 mgr.smithi008.flmjzp (mgr.14640) 5418 : cluster [DBG] pgmap v3715: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:17.588517+0000 mgr.smithi008.flmjzp (mgr.14640) 5419 : cluster [DBG] pgmap v3716: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:18.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:17.610365+0000 mgr.smithi008.flmjzp (mgr.14640) 5420 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:19.589012+0000 mgr.smithi008.flmjzp (mgr.14640) 5421 : cluster [DBG] pgmap v3717: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:19.589012+0000 mgr.smithi008.flmjzp (mgr.14640) 5421 : cluster [DBG] pgmap v3717: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:23.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:21.589514+0000 mgr.smithi008.flmjzp (mgr.14640) 5422 : cluster [DBG] pgmap v3718: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:23.864 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:21.589514+0000 mgr.smithi008.flmjzp (mgr.14640) 5422 : cluster [DBG] pgmap v3718: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:25.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.608+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3709165287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c680f6530 msgr2=0x7f7c680f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:25.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.608+0000 7f7c6e58d700 1 --2- 172.21.15.8:0/3709165287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c680f6530 0x7f7c680f6950 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7f7c64004660 tx=0x7f7c64009b30).stop 2023-10-18T22:29:25.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.608+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3709165287 shutdown_connections 2023-10-18T22:29:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.608+0000 7f7c6e58d700 1 --2- 172.21.15.8:0/3709165287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c680f77d0 0x7f7c680f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.608+0000 7f7c6e58d700 1 --2- 172.21.15.8:0/3709165287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c680f6530 0x7f7c680f6950 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.608+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3709165287 >> 172.21.15.8:0/3709165287 conn(0x7f7c680f1c90 msgr2=0x7f7c680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.608+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3709165287 shutdown_connections 2023-10-18T22:29:25.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.608+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3709165287 wait complete. 2023-10-18T22:29:25.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.609+0000 7f7c6e58d700 1 Processor -- start 2023-10-18T22:29:25.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.609+0000 7f7c6e58d700 1 -- start start 2023-10-18T22:29:25.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.610+0000 7f7c6e58d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c680f6530 0x7f7c68108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:25.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.610+0000 7f7c6e58d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c680f77d0 0x7f7c68109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.610+0000 7f7c6e58d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68109a00 con 0x7f7c680f6530 2023-10-18T22:29:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.610+0000 7f7c6e58d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68109b40 con 0x7f7c680f77d0 2023-10-18T22:29:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.610+0000 7f7c6d58b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c680f6530 0x7f7c68108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.610+0000 7f7c6d58b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c680f6530 0x7f7c68108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40010/0 (socket says 172.21.15.8:40010) 2023-10-18T22:29:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.610+0000 7f7c6d58b700 1 -- 172.21.15.8:0/3720372430 learned_addr learned my addr 172.21.15.8:0/3720372430 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.610+0000 7f7c6cd8a700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c680f77d0 0x7f7c68109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.610+0000 7f7c6d58b700 1 -- 172.21.15.8:0/3720372430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c680f77d0 msgr2=0x7f7c68109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.610+0000 7f7c6d58b700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c680f77d0 0x7f7c68109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.611+0000 7f7c6d58b700 1 -- 172.21.15.8:0/3720372430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c64005040 con 0x7f7c680f6530 2023-10-18T22:29:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.611+0000 7f7c6d58b700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c680f6530 0x7f7c68108f60 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7f7c64014040 tx=0x7f7c6400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:25.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.611+0000 7f7c5dffb700 1 -- 172.21.15.8:0/3720372430 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c64019070 con 0x7f7c680f6530 2023-10-18T22:29:25.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.611+0000 7f7c5dffb700 1 -- 172.21.15.8:0/3720372430 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7c6401e420 con 0x7f7c680f6530 2023-10-18T22:29:25.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.611+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3720372430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6810a480 con 0x7f7c680f6530 2023-10-18T22:29:25.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.611+0000 7f7c5dffb700 1 -- 172.21.15.8:0/3720372430 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c64014660 con 0x7f7c680f6530 2023-10-18T22:29:25.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.611+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3720372430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6810a960 con 0x7f7c680f6530 2023-10-18T22:29:25.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.612+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3720372430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c68045ad0 con 0x7f7c680f6530 2023-10-18T22:29:25.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.613+0000 7f7c5dffb700 1 -- 172.21.15.8:0/3720372430 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f7c6401e9e0 con 0x7f7c680f6530 2023-10-18T22:29:25.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.614+0000 7f7c5dffb700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c54060f70 0x7f7c54063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:25.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.614+0000 7f7c5dffb700 1 -- 172.21.15.8:0/3720372430 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f7c6407de90 con 0x7f7c680f6530 2023-10-18T22:29:25.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.614+0000 7f7c6cd8a700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c54060f70 0x7f7c54063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:25.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.615+0000 7f7c6cd8a700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c54060f70 0x7f7c54063430 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f7c58007f80 tx=0x7f7c5800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:25.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.619+0000 7f7c5dffb700 1 -- 172.21.15.8:0/3720372430 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f7c64051470 con 0x7f7c680f6530 2023-10-18T22:29:25.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:23.590138+0000 mgr.smithi008.flmjzp (mgr.14640) 5423 : cluster [DBG] pgmap v3719: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:25.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:23.590138+0000 mgr.smithi008.flmjzp (mgr.14640) 5423 : cluster [DBG] pgmap v3719: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:25.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.818+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3720372430 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c680fc150 con 0x7f7c54060f70 2023-10-18T22:29:25.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.819+0000 7f7c5dffb700 1 -- 172.21.15.8:0/3720372430 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7c680fc150 con 0x7f7c54060f70 2023-10-18T22:29:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3720372430 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c54060f70 msgr2=0x7f7c54063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c54060f70 0x7f7c54063430 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f7c58007f80 tx=0x7f7c5800b040).stop 2023-10-18T22:29:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3720372430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c680f6530 msgr2=0x7f7c68108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c680f6530 0x7f7c68108f60 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7f7c64014040 tx=0x7f7c6400b040).stop 2023-10-18T22:29:25.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3720372430 shutdown_connections 2023-10-18T22:29:25.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7c54060f70 0x7f7c54063430 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:25.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c680f6530 0x7f7c68108f60 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:25.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 --2- 172.21.15.8:0/3720372430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c680f77d0 0x7f7c68109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:25.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3720372430 >> 172.21.15.8:0/3720372430 conn(0x7f7c680f1c90 msgr2=0x7f7c6806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:25.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3720372430 shutdown_connections 2023-10-18T22:29:25.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.821+0000 7f7c6e58d700 1 -- 172.21.15.8:0/3720372430 wait complete. 2023-10-18T22:29:25.838 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:29:25.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.959+0000 7faa5359e700 1 -- 172.21.15.8:0/2413370545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa540f6530 msgr2=0x7faa540f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:25.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.959+0000 7faa5359e700 1 --2- 172.21.15.8:0/2413370545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa540f6530 0x7faa540f6950 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7faa44004660 tx=0x7faa44009b30).stop 2023-10-18T22:29:25.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.959+0000 7faa5359e700 1 -- 172.21.15.8:0/2413370545 shutdown_connections 2023-10-18T22:29:25.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.959+0000 7faa5359e700 1 --2- 172.21.15.8:0/2413370545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa540f77d0 0x7faa540f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:25.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.959+0000 7faa5359e700 1 --2- 172.21.15.8:0/2413370545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa540f6530 0x7faa540f6950 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:25.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.959+0000 7faa5359e700 1 -- 172.21.15.8:0/2413370545 >> 172.21.15.8:0/2413370545 conn(0x7faa540f1c90 msgr2=0x7faa540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:25.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.959+0000 7faa5359e700 1 -- 172.21.15.8:0/2413370545 shutdown_connections 2023-10-18T22:29:25.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.959+0000 7faa5359e700 1 -- 172.21.15.8:0/2413370545 wait complete. 2023-10-18T22:29:25.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.960+0000 7faa5359e700 1 Processor -- start 2023-10-18T22:29:25.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.960+0000 7faa5359e700 1 -- start start 2023-10-18T22:29:25.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.960+0000 7faa5359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa540f6530 0x7faa54108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:25.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.960+0000 7faa5359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa540f77d0 0x7faa54109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:25.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.960+0000 7faa5359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa54109a00 con 0x7faa540f6530 2023-10-18T22:29:25.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.960+0000 7faa5359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa54109b40 con 0x7faa540f77d0 2023-10-18T22:29:25.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa5259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa540f6530 0x7faa54108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:25.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa5259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa540f6530 0x7faa54108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40016/0 (socket says 172.21.15.8:40016) 2023-10-18T22:29:25.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa5259c700 1 -- 172.21.15.8:0/2021835855 learned_addr learned my addr 172.21.15.8:0/2021835855 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:25.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa51d9b700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa540f77d0 0x7faa54109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:25.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa5259c700 1 -- 172.21.15.8:0/2021835855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa540f77d0 msgr2=0x7faa54109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:25.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa5259c700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa540f77d0 0x7faa54109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:25.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa5259c700 1 -- 172.21.15.8:0/2021835855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44005040 con 0x7faa540f6530 2023-10-18T22:29:25.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa51d9b700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa540f77d0 0x7faa54109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:29:25.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa5259c700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa540f6530 0x7faa54108f60 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7faa44014040 tx=0x7faa4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:25.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa42ffd700 1 -- 172.21.15.8:0/2021835855 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa44019070 con 0x7faa540f6530 2023-10-18T22:29:25.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa5359e700 1 -- 172.21.15.8:0/2021835855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5410a480 con 0x7faa540f6530 2023-10-18T22:29:25.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa42ffd700 1 -- 172.21.15.8:0/2021835855 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faa4401e420 con 0x7faa540f6530 2023-10-18T22:29:25.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.961+0000 7faa42ffd700 1 -- 172.21.15.8:0/2021835855 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa44014660 con 0x7faa540f6530 2023-10-18T22:29:25.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.962+0000 7faa5359e700 1 -- 172.21.15.8:0/2021835855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5410a960 con 0x7faa540f6530 2023-10-18T22:29:25.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.963+0000 7faa5359e700 1 -- 172.21.15.8:0/2021835855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa54045ad0 con 0x7faa540f6530 2023-10-18T22:29:25.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.963+0000 7faa42ffd700 1 -- 172.21.15.8:0/2021835855 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7faa4401e9e0 con 0x7faa540f6530 2023-10-18T22:29:25.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.964+0000 7faa42ffd700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa3c060f70 0x7faa3c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:25.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.964+0000 7faa42ffd700 1 -- 172.21.15.8:0/2021835855 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7faa4407dd00 con 0x7faa540f6530 2023-10-18T22:29:25.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.965+0000 7faa51d9b700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa3c060f70 0x7faa3c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:25.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.965+0000 7faa51d9b700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa3c060f70 0x7faa3c063430 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7faa48007fc0 tx=0x7faa4800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:25.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:25.969+0000 7faa42ffd700 1 -- 172.21.15.8:0/2021835855 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7faa44081030 con 0x7faa540f6530 2023-10-18T22:29:26.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.168+0000 7faa5359e700 1 -- 172.21.15.8:0/2021835855 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa540fedd0 con 0x7faa3c060f70 2023-10-18T22:29:26.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.169+0000 7faa42ffd700 1 -- 172.21.15.8:0/2021835855 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faa540fedd0 con 0x7faa3c060f70 2023-10-18T22:29:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.171+0000 7faa5359e700 1 -- 172.21.15.8:0/2021835855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa3c060f70 msgr2=0x7faa3c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.171+0000 7faa5359e700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa3c060f70 0x7faa3c063430 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7faa48007fc0 tx=0x7faa4800b040).stop 2023-10-18T22:29:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.171+0000 7faa5359e700 1 -- 172.21.15.8:0/2021835855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa540f6530 msgr2=0x7faa54108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.171+0000 7faa5359e700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa540f6530 0x7faa54108f60 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7faa44014040 tx=0x7faa4400b040).stop 2023-10-18T22:29:26.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.171+0000 7faa5359e700 1 -- 172.21.15.8:0/2021835855 shutdown_connections 2023-10-18T22:29:26.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.171+0000 7faa5359e700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7faa3c060f70 0x7faa3c063430 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.171+0000 7faa5359e700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa540f6530 0x7faa54108f60 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.171+0000 7faa5359e700 1 --2- 172.21.15.8:0/2021835855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa540f77d0 0x7faa54109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.171+0000 7faa5359e700 1 -- 172.21.15.8:0/2021835855 >> 172.21.15.8:0/2021835855 conn(0x7faa540f1c90 msgr2=0x7faa5406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:26.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.172+0000 7faa5359e700 1 -- 172.21.15.8:0/2021835855 shutdown_connections 2023-10-18T22:29:26.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.172+0000 7faa5359e700 1 -- 172.21.15.8:0/2021835855 wait complete. 2023-10-18T22:29:26.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.309+0000 7fd3ae301700 1 -- 172.21.15.8:0/4123620968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a80f6530 msgr2=0x7fd3a80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:26.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.309+0000 7fd3ae301700 1 --2- 172.21.15.8:0/4123620968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a80f6530 0x7fd3a80f6950 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7fd3a4004660 tx=0x7fd3a4009b30).stop 2023-10-18T22:29:26.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.309+0000 7fd3ae301700 1 -- 172.21.15.8:0/4123620968 shutdown_connections 2023-10-18T22:29:26.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.309+0000 7fd3ae301700 1 --2- 172.21.15.8:0/4123620968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80f77d0 0x7fd3a80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.309+0000 7fd3ae301700 1 --2- 172.21.15.8:0/4123620968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a80f6530 0x7fd3a80f6950 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.309+0000 7fd3ae301700 1 -- 172.21.15.8:0/4123620968 >> 172.21.15.8:0/4123620968 conn(0x7fd3a80f1c90 msgr2=0x7fd3a80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:26.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.309+0000 7fd3ae301700 1 -- 172.21.15.8:0/4123620968 shutdown_connections 2023-10-18T22:29:26.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.309+0000 7fd3ae301700 1 -- 172.21.15.8:0/4123620968 wait complete. 2023-10-18T22:29:26.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.310+0000 7fd3ae301700 1 Processor -- start 2023-10-18T22:29:26.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.310+0000 7fd3ae301700 1 -- start start 2023-10-18T22:29:26.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3ae301700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80f6530 0x7fd3a8106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:26.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3ae301700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a80f77d0 0x7fd3a8107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:26.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3ae301700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a8107910 con 0x7fd3a80f77d0 2023-10-18T22:29:26.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3ae301700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a8108120 con 0x7fd3a80f6530 2023-10-18T22:29:26.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3acafe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a80f77d0 0x7fd3a8107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:26.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3acafe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a80f77d0 0x7fd3a8107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40036/0 (socket says 172.21.15.8:40036) 2023-10-18T22:29:26.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3acafe700 1 -- 172.21.15.8:0/99105611 learned_addr learned my addr 172.21.15.8:0/99105611 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:26.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3ad2ff700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80f6530 0x7fd3a8106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:26.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3acafe700 1 -- 172.21.15.8:0/99105611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80f6530 msgr2=0x7fd3a8106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:26.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3acafe700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80f6530 0x7fd3a8106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.311+0000 7fd3acafe700 1 -- 172.21.15.8:0/99105611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4005040 con 0x7fd3a80f77d0 2023-10-18T22:29:26.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.312+0000 7fd3acafe700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a80f77d0 0x7fd3a8107310 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7fd39800c790 tx=0x7fd398007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:26.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.312+0000 7fd39dffb700 1 -- 172.21.15.8:0/99105611 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd398002590 con 0x7fd3a80f77d0 2023-10-18T22:29:26.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.312+0000 7fd39dffb700 1 -- 172.21.15.8:0/99105611 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd398002bb0 con 0x7fd3a80f77d0 2023-10-18T22:29:26.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.312+0000 7fd39dffb700 1 -- 172.21.15.8:0/99105611 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd398013e10 con 0x7fd3a80f77d0 2023-10-18T22:29:26.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.312+0000 7fd3ae301700 1 -- 172.21.15.8:0/99105611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a81083a0 con 0x7fd3a80f77d0 2023-10-18T22:29:26.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.312+0000 7fd3ae301700 1 -- 172.21.15.8:0/99105611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a8108960 con 0x7fd3a80f77d0 2023-10-18T22:29:26.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.313+0000 7fd3ae301700 1 -- 172.21.15.8:0/99105611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a8059100 con 0x7fd3a80f77d0 2023-10-18T22:29:26.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.314+0000 7fd39dffb700 1 -- 172.21.15.8:0/99105611 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd39801a060 con 0x7fd3a80f77d0 2023-10-18T22:29:26.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.315+0000 7fd39dffb700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd394060f70 0x7fd394063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:26.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.315+0000 7fd39dffb700 1 -- 172.21.15.8:0/99105611 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd39807cbe0 con 0x7fd3a80f77d0 2023-10-18T22:29:26.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.315+0000 7fd3ad2ff700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd394060f70 0x7fd394063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:26.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.316+0000 7fd3ad2ff700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd394060f70 0x7fd394063430 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fd3a8106b90 tx=0x7fd3a4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:26.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.319+0000 7fd39dffb700 1 -- 172.21.15.8:0/99105611 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd39804c810 con 0x7fd3a80f77d0 2023-10-18T22:29:26.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.517+0000 7fd3ae301700 1 -- 172.21.15.8:0/99105611 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3a80feda0 con 0x7fd394060f70 2023-10-18T22:29:26.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.527+0000 7fd39dffb700 1 -- 172.21.15.8:0/99105611 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd3a80feda0 con 0x7fd394060f70 2023-10-18T22:29:26.528 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:29:26.529 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (96m) 3m ago 97m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:29:26.529 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (89m) 3m ago 97m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:29:26.529 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (89m) 60s ago 96m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:29:26.529 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (96m) 3m ago 97m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:29:26.530 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 93m - - 2023-10-18T22:29:26.530 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 93m - - 2023-10-18T22:29:26.530 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 60s ago 93m - - 2023-10-18T22:29:26.530 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 60s ago 93m - - 2023-10-18T22:29:26.530 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (91m) 3m ago 98m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:29:26.531 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (90m) 60s ago 96m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:29:26.531 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (90m) 3m ago 99m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:29:26.531 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (90m) 60s ago 96m 342M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:29:26.531 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (97m) 3m ago 97m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:29:26.531 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (96m) 60s ago 96m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:29:26.531 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (89m) 3m ago 96m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:29:26.532 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (87m) 3m ago 95m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:29:26.532 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (87m) 3m ago 95m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:29:26.532 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (86m) 60s ago 95m 559M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:29:26.532 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (86m) 60s ago 94m 479M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:29:26.532 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (85m) 60s ago 94m 407M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:29:26.533 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (91m) 3m ago 96m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:29:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 -- 172.21.15.8:0/99105611 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd394060f70 msgr2=0x7fd394063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd394060f70 0x7fd394063430 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fd3a8106b90 tx=0x7fd3a4009b30).stop 2023-10-18T22:29:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 -- 172.21.15.8:0/99105611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a80f77d0 msgr2=0x7fd3a8107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a80f77d0 0x7fd3a8107310 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7fd39800c790 tx=0x7fd398007d70).stop 2023-10-18T22:29:26.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 -- 172.21.15.8:0/99105611 shutdown_connections 2023-10-18T22:29:26.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd394060f70 0x7fd394063430 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80f6530 0x7fd3a8106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 --2- 172.21.15.8:0/99105611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3a80f77d0 0x7fd3a8107310 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 -- 172.21.15.8:0/99105611 >> 172.21.15.8:0/99105611 conn(0x7fd3a80f1c90 msgr2=0x7fd3a80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:26.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 -- 172.21.15.8:0/99105611 shutdown_connections 2023-10-18T22:29:26.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.529+0000 7fd3ae301700 1 -- 172.21.15.8:0/99105611 wait complete. 2023-10-18T22:29:26.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.665+0000 7f855bfff700 1 -- 172.21.15.8:0/1119430657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f855c0f6530 msgr2=0x7f855c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:26.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.665+0000 7f855bfff700 1 --2- 172.21.15.8:0/1119430657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f855c0f6530 0x7f855c0f6950 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7f854c004660 tx=0x7f854c009b30).stop 2023-10-18T22:29:26.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.665+0000 7f855bfff700 1 -- 172.21.15.8:0/1119430657 shutdown_connections 2023-10-18T22:29:26.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.665+0000 7f855bfff700 1 --2- 172.21.15.8:0/1119430657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f855c0f77d0 0x7f855c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.665+0000 7f855bfff700 1 --2- 172.21.15.8:0/1119430657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f855c0f6530 0x7f855c0f6950 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.665+0000 7f855bfff700 1 -- 172.21.15.8:0/1119430657 >> 172.21.15.8:0/1119430657 conn(0x7f855c0f1c90 msgr2=0x7f855c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:26.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.665+0000 7f855bfff700 1 -- 172.21.15.8:0/1119430657 shutdown_connections 2023-10-18T22:29:26.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.665+0000 7f855bfff700 1 -- 172.21.15.8:0/1119430657 wait complete. 2023-10-18T22:29:26.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.666+0000 7f855bfff700 1 Processor -- start 2023-10-18T22:29:26.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.666+0000 7f855bfff700 1 -- start start 2023-10-18T22:29:26.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.666+0000 7f855bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f855c0f6530 0x7f855c108ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:26.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.666+0000 7f855bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f855c0f77d0 0x7f855c1094e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:26.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.666+0000 7f855bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c109a90 con 0x7f855c0f6530 2023-10-18T22:29:26.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.666+0000 7f855bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c109bd0 con 0x7f855c0f77d0 2023-10-18T22:29:26.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f855affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f855c0f6530 0x7f855c108ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:26.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f855affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f855c0f6530 0x7f855c108ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40068/0 (socket says 172.21.15.8:40068) 2023-10-18T22:29:26.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f855affd700 1 -- 172.21.15.8:0/2079291324 learned_addr learned my addr 172.21.15.8:0/2079291324 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:26.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f855a7fc700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f855c0f77d0 0x7f855c1094e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:26.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f855affd700 1 -- 172.21.15.8:0/2079291324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f855c0f77d0 msgr2=0x7f855c1094e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:26.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f855affd700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f855c0f77d0 0x7f855c1094e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f855affd700 1 -- 172.21.15.8:0/2079291324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c005040 con 0x7f855c0f6530 2023-10-18T22:29:26.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f855a7fc700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f855c0f77d0 0x7f855c1094e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:29:26.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f855affd700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f855c0f6530 0x7f855c108ff0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 rx=0x7f854c004e30 tx=0x7f854c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:26.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f85437fe700 1 -- 172.21.15.8:0/2079291324 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854c018070 con 0x7f855c0f6530 2023-10-18T22:29:26.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f855bfff700 1 -- 172.21.15.8:0/2079291324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c10a510 con 0x7f855c0f6530 2023-10-18T22:29:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f85437fe700 1 -- 172.21.15.8:0/2079291324 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f854c009630 con 0x7f855c0f6530 2023-10-18T22:29:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.667+0000 7f85437fe700 1 -- 172.21.15.8:0/2079291324 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854c01c3c0 con 0x7f855c0f6530 2023-10-18T22:29:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.668+0000 7f855bfff700 1 -- 172.21.15.8:0/2079291324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c10aa70 con 0x7f855c0f6530 2023-10-18T22:29:26.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.669+0000 7f855bfff700 1 -- 172.21.15.8:0/2079291324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c045ad0 con 0x7f855c0f6530 2023-10-18T22:29:26.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.670+0000 7f85437fe700 1 -- 172.21.15.8:0/2079291324 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f854c01d420 con 0x7f855c0f6530 2023-10-18T22:29:26.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.670+0000 7f85437fe700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8544060f70 0x7f8544063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:26.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.670+0000 7f85437fe700 1 -- 172.21.15.8:0/2079291324 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f854c07e540 con 0x7f855c0f6530 2023-10-18T22:29:26.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.671+0000 7f855a7fc700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8544060f70 0x7f8544063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:26.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.671+0000 7f855a7fc700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8544060f70 0x7f8544063430 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f8550004bb0 tx=0x7f855000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:26.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.675+0000 7f85437fe700 1 -- 172.21.15.8:0/2079291324 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f854c051c50 con 0x7f855c0f6530 2023-10-18T22:29:26.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.929+0000 7f855bfff700 1 -- 172.21.15.8:0/2079291324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f855c0fece0 con 0x7f855c0f6530 2023-10-18T22:29:26.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.930+0000 7f85437fe700 1 -- 172.21.15.8:0/2079291324 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f854c051840 con 0x7f855c0f6530 2023-10-18T22:29:26.932 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:29:26.932 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:29:26.932 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:29:26.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:29:26.932 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:29:26.932 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:29:26.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:29:26.933 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:29:26.933 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:29:26.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:29:26.933 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:29:26.934 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:29:26.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:29:26.934 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:29:26.934 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:29:26.934 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:29:26.935 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:29:26.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 -- 172.21.15.8:0/2079291324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8544060f70 msgr2=0x7f8544063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:26.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8544060f70 0x7f8544063430 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f8550004bb0 tx=0x7f855000b040).stop 2023-10-18T22:29:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 -- 172.21.15.8:0/2079291324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f855c0f6530 msgr2=0x7f855c108ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f855c0f6530 0x7f855c108ff0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 rx=0x7f854c004e30 tx=0x7f854c009b30).stop 2023-10-18T22:29:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 -- 172.21.15.8:0/2079291324 shutdown_connections 2023-10-18T22:29:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f8544060f70 0x7f8544063430 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f855c0f6530 0x7f855c108ff0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 --2- 172.21.15.8:0/2079291324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f855c0f77d0 0x7f855c1094e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 -- 172.21.15.8:0/2079291324 >> 172.21.15.8:0/2079291324 conn(0x7f855c0f1c90 msgr2=0x7f855c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 -- 172.21.15.8:0/2079291324 shutdown_connections 2023-10-18T22:29:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:26.932+0000 7f855bfff700 1 -- 172.21.15.8:0/2079291324 wait complete. 2023-10-18T22:29:27.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.072+0000 7fd519fd9700 1 -- 172.21.15.8:0/2503186747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5140f6530 msgr2=0x7fd5140f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:27.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.072+0000 7fd519fd9700 1 --2- 172.21.15.8:0/2503186747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5140f6530 0x7fd5140f6950 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 rx=0x7fd508004660 tx=0x7fd508009b30).stop 2023-10-18T22:29:27.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.072+0000 7fd519fd9700 1 -- 172.21.15.8:0/2503186747 shutdown_connections 2023-10-18T22:29:27.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.072+0000 7fd519fd9700 1 --2- 172.21.15.8:0/2503186747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5140f77d0 0x7fd5140f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.072+0000 7fd519fd9700 1 --2- 172.21.15.8:0/2503186747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5140f6530 0x7fd5140f6950 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.072+0000 7fd519fd9700 1 -- 172.21.15.8:0/2503186747 >> 172.21.15.8:0/2503186747 conn(0x7fd5140f1c90 msgr2=0x7fd5140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:27.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.072+0000 7fd519fd9700 1 -- 172.21.15.8:0/2503186747 shutdown_connections 2023-10-18T22:29:27.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.072+0000 7fd519fd9700 1 -- 172.21.15.8:0/2503186747 wait complete. 2023-10-18T22:29:27.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.073+0000 7fd519fd9700 1 Processor -- start 2023-10-18T22:29:27.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.073+0000 7fd519fd9700 1 -- start start 2023-10-18T22:29:27.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.073+0000 7fd519fd9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5140f6530 0x7fd514106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:27.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.073+0000 7fd519fd9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5140f77d0 0x7fd514107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.073+0000 7fd519fd9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514107870 con 0x7fd5140f6530 2023-10-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.073+0000 7fd519fd9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5141080b0 con 0x7fd5140f77d0 2023-10-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.073+0000 7fd518fd7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5140f6530 0x7fd514106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd518fd7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5140f6530 0x7fd514106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48024/0 (socket says 172.21.15.8:48024) 2023-10-18T22:29:27.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd518fd7700 1 -- 172.21.15.8:0/703607680 learned_addr learned my addr 172.21.15.8:0/703607680 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:27.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd513fff700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5140f77d0 0x7fd514107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:27.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd518fd7700 1 -- 172.21.15.8:0/703607680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5140f77d0 msgr2=0x7fd514107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:27.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd518fd7700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5140f77d0 0x7fd514107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd518fd7700 1 -- 172.21.15.8:0/703607680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508005040 con 0x7fd5140f6530 2023-10-18T22:29:27.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd518fd7700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5140f6530 0x7fd514106d80 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7fd508014040 tx=0x7fd50800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:27.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd5117fa700 1 -- 172.21.15.8:0/703607680 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd508019070 con 0x7fd5140f6530 2023-10-18T22:29:27.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd519fd9700 1 -- 172.21.15.8:0/703607680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd514108330 con 0x7fd5140f6530 2023-10-18T22:29:27.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd5117fa700 1 -- 172.21.15.8:0/703607680 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd50801e420 con 0x7fd5140f6530 2023-10-18T22:29:27.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.074+0000 7fd5117fa700 1 -- 172.21.15.8:0/703607680 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd508014660 con 0x7fd5140f6530 2023-10-18T22:29:27.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.075+0000 7fd519fd9700 1 -- 172.21.15.8:0/703607680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd514108810 con 0x7fd5140f6530 2023-10-18T22:29:27.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.076+0000 7fd519fd9700 1 -- 172.21.15.8:0/703607680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd514059100 con 0x7fd5140f6530 2023-10-18T22:29:27.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.077+0000 7fd5117fa700 1 -- 172.21.15.8:0/703607680 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fd50801e9e0 con 0x7fd5140f6530 2023-10-18T22:29:27.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.077+0000 7fd5117fa700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd504060f70 0x7fd504063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:27.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.078+0000 7fd5117fa700 1 -- 172.21.15.8:0/703607680 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fd50807dda0 con 0x7fd5140f6530 2023-10-18T22:29:27.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.078+0000 7fd513fff700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd504060f70 0x7fd504063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:27.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.078+0000 7fd513fff700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd504060f70 0x7fd504063430 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fd500009da0 tx=0x7fd50000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:27.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.082+0000 7fd5117fa700 1 -- 172.21.15.8:0/703607680 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fd50804da10 con 0x7fd5140f6530 2023-10-18T22:29:27.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.306+0000 7fd519fd9700 1 -- 172.21.15.8:0/703607680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd5140fecc0 con 0x7fd5140f6530 2023-10-18T22:29:27.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.306+0000 7fd5117fa700 1 -- 172.21.15.8:0/703607680 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7fd50807be60 con 0x7fd5140f6530 2023-10-18T22:29:27.308 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:29:27.308 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:29:27.309 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:29:27.309 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:29:27.309 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:29:27.309 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:29:27.309 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:29:27.310 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:29:27.310 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:29:27.310 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:29:27.310 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:29:27.310 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:29:27.311 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:29:27.311 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:29:27.311 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:29:27.311 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:29:27.311 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:29:27.312 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:29:27.312 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:29:27.312 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:29:27.312 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:29:27.312 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:29:27.313 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:29:27.313 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:29:27.313 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:29:27.313 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:29:27.313 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:29:27.313 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:29:27.314 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:29:27.314 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:29:27.314 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:29:27.314 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:29:27.315 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:29:27.315 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:29:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.308+0000 7fd519fd9700 1 -- 172.21.15.8:0/703607680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd504060f70 msgr2=0x7fd504063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.308+0000 7fd519fd9700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd504060f70 0x7fd504063430 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fd500009da0 tx=0x7fd50000b040).stop 2023-10-18T22:29:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.308+0000 7fd519fd9700 1 -- 172.21.15.8:0/703607680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5140f6530 msgr2=0x7fd514106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.308+0000 7fd519fd9700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5140f6530 0x7fd514106d80 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7fd508014040 tx=0x7fd50800b040).stop 2023-10-18T22:29:27.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.308+0000 7fd519fd9700 1 -- 172.21.15.8:0/703607680 shutdown_connections 2023-10-18T22:29:27.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.308+0000 7fd519fd9700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fd504060f70 0x7fd504063430 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.308+0000 7fd519fd9700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5140f6530 0x7fd514106d80 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.308+0000 7fd519fd9700 1 --2- 172.21.15.8:0/703607680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5140f77d0 0x7fd514107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.308+0000 7fd519fd9700 1 -- 172.21.15.8:0/703607680 >> 172.21.15.8:0/703607680 conn(0x7fd5140f1c90 msgr2=0x7fd5140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.308+0000 7fd519fd9700 1 -- 172.21.15.8:0/703607680 shutdown_connections 2023-10-18T22:29:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.309+0000 7fd519fd9700 1 -- 172.21.15.8:0/703607680 wait complete. 2023-10-18T22:29:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:29:27.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.446+0000 7f4b53fff700 1 -- 172.21.15.8:0/2918020965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540f77d0 msgr2=0x7f4b540f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:27.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.446+0000 7f4b53fff700 1 --2- 172.21.15.8:0/2918020965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540f77d0 0x7f4b540f7c30 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7f4b480045a0 tx=0x7f4b48009b30).stop 2023-10-18T22:29:27.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.446+0000 7f4b53fff700 1 -- 172.21.15.8:0/2918020965 shutdown_connections 2023-10-18T22:29:27.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.446+0000 7f4b53fff700 1 --2- 172.21.15.8:0/2918020965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540f77d0 0x7f4b540f7c30 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.446+0000 7f4b53fff700 1 --2- 172.21.15.8:0/2918020965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b540f6530 0x7f4b540f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.446+0000 7f4b53fff700 1 -- 172.21.15.8:0/2918020965 >> 172.21.15.8:0/2918020965 conn(0x7f4b540f1c90 msgr2=0x7f4b540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:27.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.446+0000 7f4b53fff700 1 -- 172.21.15.8:0/2918020965 shutdown_connections 2023-10-18T22:29:27.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.446+0000 7f4b53fff700 1 -- 172.21.15.8:0/2918020965 wait complete. 2023-10-18T22:29:27.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.447+0000 7f4b53fff700 1 Processor -- start 2023-10-18T22:29:27.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.447+0000 7f4b53fff700 1 -- start start 2023-10-18T22:29:27.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.447+0000 7f4b53fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b540f6530 0x7f4b5406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:27.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.447+0000 7f4b53fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540f77d0 0x7f4b54069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:27.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.447+0000 7f4b53fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5406a380 con 0x7f4b540f77d0 2023-10-18T22:29:27.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.447+0000 7f4b53fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5406a4c0 con 0x7f4b540f6530 2023-10-18T22:29:27.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.447+0000 7f4b527fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540f77d0 0x7f4b54069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:27.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.447+0000 7f4b527fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540f77d0 0x7f4b54069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48054/0 (socket says 172.21.15.8:48054) 2023-10-18T22:29:27.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.447+0000 7f4b527fc700 1 -- 172.21.15.8:0/2368187386 learned_addr learned my addr 172.21.15.8:0/2368187386 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:27.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.448+0000 7f4b52ffd700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b540f6530 0x7f4b5406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:27.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.448+0000 7f4b527fc700 1 -- 172.21.15.8:0/2368187386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b540f6530 msgr2=0x7f4b5406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:27.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.448+0000 7f4b527fc700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b540f6530 0x7f4b5406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.448+0000 7f4b527fc700 1 -- 172.21.15.8:0/2368187386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44005040 con 0x7f4b540f77d0 2023-10-18T22:29:27.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.448+0000 7f4b527fc700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540f77d0 0x7f4b54069e20 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7f4b48009870 tx=0x7f4b4800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:27.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.448+0000 7f4b3b7fe700 1 -- 172.21.15.8:0/2368187386 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b4800e070 con 0x7f4b540f77d0 2023-10-18T22:29:27.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.448+0000 7f4b3b7fe700 1 -- 172.21.15.8:0/2368187386 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4b48007ba0 con 0x7f4b540f77d0 2023-10-18T22:29:27.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.448+0000 7f4b3b7fe700 1 -- 172.21.15.8:0/2368187386 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b48019070 con 0x7f4b540f77d0 2023-10-18T22:29:27.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.448+0000 7f4b53fff700 1 -- 172.21.15.8:0/2368187386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b48005040 con 0x7f4b540f77d0 2023-10-18T22:29:27.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.449+0000 7f4b53fff700 1 -- 172.21.15.8:0/2368187386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5406aa40 con 0x7f4b540f77d0 2023-10-18T22:29:27.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.449+0000 7f4b53fff700 1 -- 172.21.15.8:0/2368187386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b54059100 con 0x7f4b540f77d0 2023-10-18T22:29:27.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.450+0000 7f4b3b7fe700 1 -- 172.21.15.8:0/2368187386 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4b48025070 con 0x7f4b540f77d0 2023-10-18T22:29:27.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.451+0000 7f4b3b7fe700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4b3c060f70 0x7f4b3c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.451+0000 7f4b3b7fe700 1 -- 172.21.15.8:0/2368187386 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4b4807d6e0 con 0x7f4b540f77d0 2023-10-18T22:29:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.452+0000 7f4b52ffd700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4b3c060f70 0x7f4b3c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.452+0000 7f4b52ffd700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4b3c060f70 0x7f4b3c063430 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f4b5406b730 tx=0x7f4b4400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.456+0000 7f4b3b7fe700 1 -- 172.21.15.8:0/2368187386 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4b4804d290 con 0x7f4b540f77d0 2023-10-18T22:29:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.656+0000 7f4b53fff700 1 -- 172.21.15.8:0/2368187386 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b540fed30 con 0x7f4b3c060f70 2023-10-18T22:29:27.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.657+0000 7f4b3b7fe700 1 -- 172.21.15.8:0/2368187386 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4b540fed30 con 0x7f4b3c060f70 2023-10-18T22:29:27.658 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:29:27.658 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:29:27.659 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:29:27.659 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:29:27.659 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:29:27.659 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:29:27.659 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:29:27.660 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:29:27.660 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:29:27.660 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:29:27.660 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:29:27.660 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:29:27.661 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:29:27.661 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:29:27.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 -- 172.21.15.8:0/2368187386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4b3c060f70 msgr2=0x7f4b3c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:27.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4b3c060f70 0x7f4b3c063430 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f4b5406b730 tx=0x7f4b4400b040).stop 2023-10-18T22:29:27.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 -- 172.21.15.8:0/2368187386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540f77d0 msgr2=0x7f4b54069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:27.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540f77d0 0x7f4b54069e20 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7f4b48009870 tx=0x7f4b4800b040).stop 2023-10-18T22:29:27.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 -- 172.21.15.8:0/2368187386 shutdown_connections 2023-10-18T22:29:27.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4b3c060f70 0x7f4b3c063430 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b540f6530 0x7f4b5406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 --2- 172.21.15.8:0/2368187386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540f77d0 0x7f4b54069e20 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:27.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 -- 172.21.15.8:0/2368187386 >> 172.21.15.8:0/2368187386 conn(0x7f4b540f1c90 msgr2=0x7f4b540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:27.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 -- 172.21.15.8:0/2368187386 shutdown_connections 2023-10-18T22:29:27.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:27.659+0000 7f4b53fff700 1 -- 172.21.15.8:0/2368187386 wait complete. 2023-10-18T22:29:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:25.590625+0000 mgr.smithi008.flmjzp (mgr.14640) 5424 : cluster [DBG] pgmap v3720: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:27.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:25.819588+0000 mgr.smithi008.flmjzp (mgr.14640) 5425 : audit [DBG] from='client.38320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:26.169486+0000 mgr.smithi008.flmjzp (mgr.14640) 5426 : audit [DBG] from='client.38324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:26.518732+0000 mgr.smithi008.flmjzp (mgr.14640) 5427 : audit [DBG] from='client.38328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:26.930308+0000 mon.smithi008 (mon.0) 5662 : audit [DBG] from='client.? 172.21.15.8:0/2079291324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:27.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.307059+0000 mon.smithi008 (mon.0) 5663 : audit [DBG] from='client.? 172.21.15.8:0/703607680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:29:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:25.590625+0000 mgr.smithi008.flmjzp (mgr.14640) 5424 : cluster [DBG] pgmap v3720: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:25.819588+0000 mgr.smithi008.flmjzp (mgr.14640) 5425 : audit [DBG] from='client.38320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:26.169486+0000 mgr.smithi008.flmjzp (mgr.14640) 5426 : audit [DBG] from='client.38324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:26.518732+0000 mgr.smithi008.flmjzp (mgr.14640) 5427 : audit [DBG] from='client.38328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:27.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:26.930308+0000 mon.smithi008 (mon.0) 5662 : audit [DBG] from='client.? 172.21.15.8:0/2079291324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:27.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.307059+0000 mon.smithi008 (mon.0) 5663 : audit [DBG] from='client.? 172.21.15.8:0/703607680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:29:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.619913+0000 mon.smithi008 (mon.0) 5664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.622345+0000 mon.smithi008 (mon.0) 5665 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.623043+0000 mon.smithi008 (mon.0) 5666 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.628162+0000 mon.smithi008 (mon.0) 5667 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:28.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.633159+0000 mon.smithi008 (mon.0) 5668 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.635529+0000 mon.smithi008 (mon.0) 5669 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.636819+0000 mon.smithi008 (mon.0) 5670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.638073+0000 mon.smithi008 (mon.0) 5671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:28.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.639611+0000 mon.smithi008 (mon.0) 5672 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.619913+0000 mon.smithi008 (mon.0) 5664 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.622345+0000 mon.smithi008 (mon.0) 5665 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.623043+0000 mon.smithi008 (mon.0) 5666 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.628162+0000 mon.smithi008 (mon.0) 5667 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.633159+0000 mon.smithi008 (mon.0) 5668 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.635529+0000 mon.smithi008 (mon.0) 5669 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.636819+0000 mon.smithi008 (mon.0) 5670 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:28.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.638073+0000 mon.smithi008 (mon.0) 5671 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:28.739 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.639611+0000 mon.smithi008 (mon.0) 5672 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:27.591038+0000 mgr.smithi008.flmjzp (mgr.14640) 5428 : cluster [DBG] pgmap v3721: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:29.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:27.623667+0000 mgr.smithi008.flmjzp (mgr.14640) 5429 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:29:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:27.624196+0000 mgr.smithi008.flmjzp (mgr.14640) 5430 : cluster [DBG] pgmap v3722: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:27.624567+0000 mgr.smithi008.flmjzp (mgr.14640) 5431 : cluster [DBG] pgmap v3723: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:27.641144+0000 mgr.smithi008.flmjzp (mgr.14640) 5432 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:29.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:27.657280+0000 mgr.smithi008.flmjzp (mgr.14640) 5433 : audit [DBG] from='client.38340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:27.591038+0000 mgr.smithi008.flmjzp (mgr.14640) 5428 : cluster [DBG] pgmap v3721: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:27.623667+0000 mgr.smithi008.flmjzp (mgr.14640) 5429 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:29:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:27.624196+0000 mgr.smithi008.flmjzp (mgr.14640) 5430 : cluster [DBG] pgmap v3722: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:27.624567+0000 mgr.smithi008.flmjzp (mgr.14640) 5431 : cluster [DBG] pgmap v3723: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:27.641144+0000 mgr.smithi008.flmjzp (mgr.14640) 5432 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:27.657280+0000 mgr.smithi008.flmjzp (mgr.14640) 5433 : audit [DBG] from='client.38340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:31.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:29.625043+0000 mgr.smithi008.flmjzp (mgr.14640) 5434 : cluster [DBG] pgmap v3724: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:29.625043+0000 mgr.smithi008.flmjzp (mgr.14640) 5434 : cluster [DBG] pgmap v3724: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:33.864 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:31.625674+0000 mgr.smithi008.flmjzp (mgr.14640) 5435 : cluster [DBG] pgmap v3725: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:31.625674+0000 mgr.smithi008.flmjzp (mgr.14640) 5435 : cluster [DBG] pgmap v3725: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:35.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:33.626235+0000 mgr.smithi008.flmjzp (mgr.14640) 5436 : cluster [DBG] pgmap v3726: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:33.626235+0000 mgr.smithi008.flmjzp (mgr.14640) 5436 : cluster [DBG] pgmap v3726: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:35.626793+0000 mgr.smithi008.flmjzp (mgr.14640) 5437 : cluster [DBG] pgmap v3727: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:37.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:35.626793+0000 mgr.smithi008.flmjzp (mgr.14640) 5437 : cluster [DBG] pgmap v3727: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:37.642074+0000 mon.smithi008 (mon.0) 5673 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:38.200334+0000 mon.smithi008 (mon.0) 5674 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:38.201086+0000 mon.smithi008 (mon.0) 5675 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:38.206405+0000 mon.smithi008 (mon.0) 5676 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:38.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:38.211336+0000 mon.smithi008 (mon.0) 5677 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:38.213700+0000 mon.smithi008 (mon.0) 5678 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:38.214979+0000 mon.smithi008 (mon.0) 5679 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:38.216197+0000 mon.smithi008 (mon.0) 5680 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:38.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:38.217692+0000 mon.smithi008 (mon.0) 5681 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:37.642074+0000 mon.smithi008 (mon.0) 5673 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:38.200334+0000 mon.smithi008 (mon.0) 5674 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:38.201086+0000 mon.smithi008 (mon.0) 5675 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:38.206405+0000 mon.smithi008 (mon.0) 5676 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:38.211336+0000 mon.smithi008 (mon.0) 5677 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:38.213700+0000 mon.smithi008 (mon.0) 5678 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:38.214979+0000 mon.smithi008 (mon.0) 5679 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:38.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:38.216197+0000 mon.smithi008 (mon.0) 5680 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:38.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:38.217692+0000 mon.smithi008 (mon.0) 5681 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:37.627347+0000 mgr.smithi008.flmjzp (mgr.14640) 5438 : cluster [DBG] pgmap v3728: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:38.201678+0000 mgr.smithi008.flmjzp (mgr.14640) 5439 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:29:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:38.202153+0000 mgr.smithi008.flmjzp (mgr.14640) 5440 : cluster [DBG] pgmap v3729: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:38.202439+0000 mgr.smithi008.flmjzp (mgr.14640) 5441 : cluster [DBG] pgmap v3730: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:38.219228+0000 mgr.smithi008.flmjzp (mgr.14640) 5442 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:37.627347+0000 mgr.smithi008.flmjzp (mgr.14640) 5438 : cluster [DBG] pgmap v3728: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:38.201678+0000 mgr.smithi008.flmjzp (mgr.14640) 5439 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:29:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:38.202153+0000 mgr.smithi008.flmjzp (mgr.14640) 5440 : cluster [DBG] pgmap v3729: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:38.202439+0000 mgr.smithi008.flmjzp (mgr.14640) 5441 : cluster [DBG] pgmap v3730: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:38.219228+0000 mgr.smithi008.flmjzp (mgr.14640) 5442 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:41.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:40.202985+0000 mgr.smithi008.flmjzp (mgr.14640) 5443 : cluster [DBG] pgmap v3731: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:40.202985+0000 mgr.smithi008.flmjzp (mgr.14640) 5443 : cluster [DBG] pgmap v3731: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:43.865 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:42.203558+0000 mgr.smithi008.flmjzp (mgr.14640) 5444 : cluster [DBG] pgmap v3732: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:42.203558+0000 mgr.smithi008.flmjzp (mgr.14640) 5444 : cluster [DBG] pgmap v3732: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:44.204230+0000 mgr.smithi008.flmjzp (mgr.14640) 5445 : cluster [DBG] pgmap v3733: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:44.204230+0000 mgr.smithi008.flmjzp (mgr.14640) 5445 : cluster [DBG] pgmap v3733: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:46.204716+0000 mgr.smithi008.flmjzp (mgr.14640) 5446 : cluster [DBG] pgmap v3734: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:46.204716+0000 mgr.smithi008.flmjzp (mgr.14640) 5446 : cluster [DBG] pgmap v3734: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:48.221034+0000 mon.smithi008 (mon.0) 5682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:48.223228+0000 mon.smithi008 (mon.0) 5683 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:48.224254+0000 mon.smithi008 (mon.0) 5684 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:48.230959+0000 mon.smithi008 (mon.0) 5685 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:48.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:48.237374+0000 mon.smithi008 (mon.0) 5686 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:48.240523+0000 mon.smithi008 (mon.0) 5687 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:48.242292+0000 mon.smithi008 (mon.0) 5688 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:48.244026+0000 mon.smithi008 (mon.0) 5689 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:48.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:48.246106+0000 mon.smithi008 (mon.0) 5690 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:48.221034+0000 mon.smithi008 (mon.0) 5682 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:48.223228+0000 mon.smithi008 (mon.0) 5683 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:48.224254+0000 mon.smithi008 (mon.0) 5684 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:48.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:48.230959+0000 mon.smithi008 (mon.0) 5685 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:48.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:48.237374+0000 mon.smithi008 (mon.0) 5686 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:48.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:48.240523+0000 mon.smithi008 (mon.0) 5687 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:48.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:48.242292+0000 mon.smithi008 (mon.0) 5688 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:48.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:48.244026+0000 mon.smithi008 (mon.0) 5689 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:48.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:48.246106+0000 mon.smithi008 (mon.0) 5690 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:48.205260+0000 mgr.smithi008.flmjzp (mgr.14640) 5447 : cluster [DBG] pgmap v3735: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:48.225164+0000 mgr.smithi008.flmjzp (mgr.14640) 5448 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:29:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:48.225779+0000 mgr.smithi008.flmjzp (mgr.14640) 5449 : cluster [DBG] pgmap v3736: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:48.226114+0000 mgr.smithi008.flmjzp (mgr.14640) 5450 : cluster [DBG] pgmap v3737: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:48.248046+0000 mgr.smithi008.flmjzp (mgr.14640) 5451 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:48.205260+0000 mgr.smithi008.flmjzp (mgr.14640) 5447 : cluster [DBG] pgmap v3735: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:48.225164+0000 mgr.smithi008.flmjzp (mgr.14640) 5448 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:29:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:48.225779+0000 mgr.smithi008.flmjzp (mgr.14640) 5449 : cluster [DBG] pgmap v3736: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:48.226114+0000 mgr.smithi008.flmjzp (mgr.14640) 5450 : cluster [DBG] pgmap v3737: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:48.248046+0000 mgr.smithi008.flmjzp (mgr.14640) 5451 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:29:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:50.226813+0000 mgr.smithi008.flmjzp (mgr.14640) 5452 : cluster [DBG] pgmap v3738: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:50.226813+0000 mgr.smithi008.flmjzp (mgr.14640) 5452 : cluster [DBG] pgmap v3738: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:53.865 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:52.227482+0000 mgr.smithi008.flmjzp (mgr.14640) 5453 : cluster [DBG] pgmap v3739: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:52.227482+0000 mgr.smithi008.flmjzp (mgr.14640) 5453 : cluster [DBG] pgmap v3739: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:54.228029+0000 mgr.smithi008.flmjzp (mgr.14640) 5454 : cluster [DBG] pgmap v3740: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:54.228029+0000 mgr.smithi008.flmjzp (mgr.14640) 5454 : cluster [DBG] pgmap v3740: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.812+0000 7f3597249700 1 -- 172.21.15.8:0/1780578041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35900f77d0 msgr2=0x7f35900f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.812+0000 7f3597249700 1 --2- 172.21.15.8:0/1780578041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35900f77d0 0x7f35900f7c30 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f3580004660 tx=0x7f3580009b30).stop 2023-10-18T22:29:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.812+0000 7f3597249700 1 -- 172.21.15.8:0/1780578041 shutdown_connections 2023-10-18T22:29:57.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.812+0000 7f3597249700 1 --2- 172.21.15.8:0/1780578041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35900f77d0 0x7f35900f7c30 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.812+0000 7f3597249700 1 --2- 172.21.15.8:0/1780578041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35900f6530 0x7f35900f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.812+0000 7f3597249700 1 -- 172.21.15.8:0/1780578041 >> 172.21.15.8:0/1780578041 conn(0x7f35900f1c90 msgr2=0x7f35900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.812+0000 7f3597249700 1 -- 172.21.15.8:0/1780578041 shutdown_connections 2023-10-18T22:29:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.812+0000 7f3597249700 1 -- 172.21.15.8:0/1780578041 wait complete. 2023-10-18T22:29:57.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.813+0000 7f3597249700 1 Processor -- start 2023-10-18T22:29:57.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.813+0000 7f3597249700 1 -- start start 2023-10-18T22:29:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.813+0000 7f3597249700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35900f6530 0x7f3590108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.813+0000 7f3597249700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35900f77d0 0x7f35901093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.813+0000 7f3597249700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35901099a0 con 0x7f35900f6530 2023-10-18T22:29:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.813+0000 7f3597249700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3590109ae0 con 0x7f35900f77d0 2023-10-18T22:29:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.814+0000 7f3596247700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35900f6530 0x7f3590108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.814+0000 7f3596247700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35900f6530 0x7f3590108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59460/0 (socket says 172.21.15.8:59460) 2023-10-18T22:29:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.814+0000 7f3596247700 1 -- 172.21.15.8:0/110697511 learned_addr learned my addr 172.21.15.8:0/110697511 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.814+0000 7f3595a46700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35900f77d0 0x7f35901093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.814+0000 7f3596247700 1 -- 172.21.15.8:0/110697511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35900f77d0 msgr2=0x7f35901093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.814+0000 7f3596247700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35900f77d0 0x7f35901093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.814+0000 7f3596247700 1 -- 172.21.15.8:0/110697511 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3580005040 con 0x7f35900f6530 2023-10-18T22:29:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.814+0000 7f3596247700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35900f6530 0x7f3590108f00 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 rx=0x7f358c00e7c0 tx=0x7f358c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.815+0000 7f3586ffd700 1 -- 172.21.15.8:0/110697511 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f358c0092e0 con 0x7f35900f6530 2023-10-18T22:29:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.815+0000 7f3586ffd700 1 -- 172.21.15.8:0/110697511 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f358c00f040 con 0x7f35900f6530 2023-10-18T22:29:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.815+0000 7f3597249700 1 -- 172.21.15.8:0/110697511 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359010a480 con 0x7f35900f6530 2023-10-18T22:29:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.815+0000 7f3586ffd700 1 -- 172.21.15.8:0/110697511 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f358c014810 con 0x7f35900f6530 2023-10-18T22:29:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.815+0000 7f3597249700 1 -- 172.21.15.8:0/110697511 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359010a9c0 con 0x7f35900f6530 2023-10-18T22:29:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.816+0000 7f3597249700 1 -- 172.21.15.8:0/110697511 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3590045ad0 con 0x7f35900f6530 2023-10-18T22:29:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.817+0000 7f3586ffd700 1 -- 172.21.15.8:0/110697511 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f358c01b030 con 0x7f35900f6530 2023-10-18T22:29:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.817+0000 7f3586ffd700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f357c060f70 0x7f357c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:57.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.817+0000 7f3586ffd700 1 -- 172.21.15.8:0/110697511 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f358c07c920 con 0x7f35900f6530 2023-10-18T22:29:57.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.818+0000 7f3595a46700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f357c060f70 0x7f357c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:57.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.818+0000 7f3595a46700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f357c060f70 0x7f357c063430 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f3580009720 tx=0x7f3580016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:57.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:57.822+0000 7f3586ffd700 1 -- 172.21.15.8:0/110697511 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f358c04ff00 con 0x7f35900f6530 2023-10-18T22:29:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:56.228615+0000 mgr.smithi008.flmjzp (mgr.14640) 5455 : cluster [DBG] pgmap v3741: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:56.228615+0000 mgr.smithi008.flmjzp (mgr.14640) 5455 : cluster [DBG] pgmap v3741: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:58.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.023+0000 7f3597249700 1 -- 172.21.15.8:0/110697511 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f359010ac40 con 0x7f357c060f70 2023-10-18T22:29:58.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.024+0000 7f3586ffd700 1 -- 172.21.15.8:0/110697511 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f359010ac40 con 0x7f357c060f70 2023-10-18T22:29:58.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.026+0000 7f3597249700 1 -- 172.21.15.8:0/110697511 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f357c060f70 msgr2=0x7f357c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.026+0000 7f3597249700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f357c060f70 0x7f357c063430 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f3580009720 tx=0x7f3580016040).stop 2023-10-18T22:29:58.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.026+0000 7f3597249700 1 -- 172.21.15.8:0/110697511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35900f6530 msgr2=0x7f3590108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.026+0000 7f3597249700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35900f6530 0x7f3590108f00 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 rx=0x7f358c00e7c0 tx=0x7f358c00b040).stop 2023-10-18T22:29:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.026+0000 7f3597249700 1 -- 172.21.15.8:0/110697511 shutdown_connections 2023-10-18T22:29:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.026+0000 7f3597249700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f357c060f70 0x7f357c063430 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.026+0000 7f3597249700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35900f6530 0x7f3590108f00 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.026+0000 7f3597249700 1 --2- 172.21.15.8:0/110697511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35900f77d0 0x7f35901093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.026+0000 7f3597249700 1 -- 172.21.15.8:0/110697511 >> 172.21.15.8:0/110697511 conn(0x7f35900f1c90 msgr2=0x7f359006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:58.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.027+0000 7f3597249700 1 -- 172.21.15.8:0/110697511 shutdown_connections 2023-10-18T22:29:58.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.027+0000 7f3597249700 1 -- 172.21.15.8:0/110697511 wait complete. 2023-10-18T22:29:58.043 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:29:58.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.163+0000 7f19f359e700 1 -- 172.21.15.8:0/602594431 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19f40f77d0 msgr2=0x7f19f40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.164+0000 7f19f359e700 1 --2- 172.21.15.8:0/602594431 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19f40f77d0 0x7f19f40f7c30 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7f19e8004660 tx=0x7f19e8009b30).stop 2023-10-18T22:29:58.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.164+0000 7f19f359e700 1 -- 172.21.15.8:0/602594431 shutdown_connections 2023-10-18T22:29:58.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.164+0000 7f19f359e700 1 --2- 172.21.15.8:0/602594431 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19f40f77d0 0x7f19f40f7c30 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.164+0000 7f19f359e700 1 --2- 172.21.15.8:0/602594431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19f40f6530 0x7f19f40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.164+0000 7f19f359e700 1 -- 172.21.15.8:0/602594431 >> 172.21.15.8:0/602594431 conn(0x7f19f40f1c90 msgr2=0x7f19f40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:58.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.164+0000 7f19f359e700 1 -- 172.21.15.8:0/602594431 shutdown_connections 2023-10-18T22:29:58.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.164+0000 7f19f359e700 1 -- 172.21.15.8:0/602594431 wait complete. 2023-10-18T22:29:58.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.165+0000 7f19f359e700 1 Processor -- start 2023-10-18T22:29:58.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.165+0000 7f19f359e700 1 -- start start 2023-10-18T22:29:58.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.165+0000 7f19f359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19f40f6530 0x7f19f4108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:58.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.165+0000 7f19f359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19f40f77d0 0x7f19f41093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:58.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.165+0000 7f19f359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f4109970 con 0x7f19f40f6530 2023-10-18T22:29:58.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.165+0000 7f19f359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f4109ab0 con 0x7f19f40f77d0 2023-10-18T22:29:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.165+0000 7f19f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19f40f6530 0x7f19f4108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.165+0000 7f19f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19f40f6530 0x7f19f4108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59482/0 (socket says 172.21.15.8:59482) 2023-10-18T22:29:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.165+0000 7f19f259c700 1 -- 172.21.15.8:0/4127188174 learned_addr learned my addr 172.21.15.8:0/4127188174 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19f1d9b700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19f40f77d0 0x7f19f41093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:58.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19f259c700 1 -- 172.21.15.8:0/4127188174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19f40f77d0 msgr2=0x7f19f41093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19f259c700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19f40f77d0 0x7f19f41093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19f259c700 1 -- 172.21.15.8:0/4127188174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8005040 con 0x7f19f40f6530 2023-10-18T22:29:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19f1d9b700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19f40f77d0 0x7f19f41093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:29:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19f259c700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19f40f6530 0x7f19f4108ed0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f19e400e7c0 tx=0x7f19e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:58.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19e2ffd700 1 -- 172.21.15.8:0/4127188174 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19e40092e0 con 0x7f19f40f6530 2023-10-18T22:29:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19f359e700 1 -- 172.21.15.8:0/4127188174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f410a450 con 0x7f19f40f6530 2023-10-18T22:29:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19e2ffd700 1 -- 172.21.15.8:0/4127188174 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f19e400f040 con 0x7f19f40f6530 2023-10-18T22:29:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19e2ffd700 1 -- 172.21.15.8:0/4127188174 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19e40147e0 con 0x7f19f40f6530 2023-10-18T22:29:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.166+0000 7f19f359e700 1 -- 172.21.15.8:0/4127188174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f410a990 con 0x7f19f40f6530 2023-10-18T22:29:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.168+0000 7f19f359e700 1 -- 172.21.15.8:0/4127188174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f4045ad0 con 0x7f19f40f6530 2023-10-18T22:29:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.168+0000 7f19e2ffd700 1 -- 172.21.15.8:0/4127188174 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f19e401b030 con 0x7f19f40f6530 2023-10-18T22:29:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.169+0000 7f19e2ffd700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19dc060f70 0x7f19dc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.169+0000 7f19e2ffd700 1 -- 172.21.15.8:0/4127188174 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f19e407c9b0 con 0x7f19f40f6530 2023-10-18T22:29:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.169+0000 7f19f1d9b700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19dc060f70 0x7f19dc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.170+0000 7f19f1d9b700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19dc060f70 0x7f19dc063430 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f19e80043d0 tx=0x7f19e800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.174+0000 7f19e2ffd700 1 -- 172.21.15.8:0/4127188174 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f19e4050050 con 0x7f19f40f6530 2023-10-18T22:29:58.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.371+0000 7f19f359e700 1 -- 172.21.15.8:0/4127188174 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19f410abb0 con 0x7f19dc060f70 2023-10-18T22:29:58.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.372+0000 7f19e2ffd700 1 -- 172.21.15.8:0/4127188174 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f19f410abb0 con 0x7f19dc060f70 2023-10-18T22:29:58.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.374+0000 7f19f359e700 1 -- 172.21.15.8:0/4127188174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19dc060f70 msgr2=0x7f19dc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.374+0000 7f19f359e700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19dc060f70 0x7f19dc063430 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f19e80043d0 tx=0x7f19e800b040).stop 2023-10-18T22:29:58.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.374+0000 7f19f359e700 1 -- 172.21.15.8:0/4127188174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19f40f6530 msgr2=0x7f19f4108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.374+0000 7f19f359e700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19f40f6530 0x7f19f4108ed0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f19e400e7c0 tx=0x7f19e400b040).stop 2023-10-18T22:29:58.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.374+0000 7f19f359e700 1 -- 172.21.15.8:0/4127188174 shutdown_connections 2023-10-18T22:29:58.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.374+0000 7f19f359e700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f19dc060f70 0x7f19dc063430 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.374+0000 7f19f359e700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19f40f6530 0x7f19f4108ed0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.374+0000 7f19f359e700 1 --2- 172.21.15.8:0/4127188174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19f40f77d0 0x7f19f41093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.374+0000 7f19f359e700 1 -- 172.21.15.8:0/4127188174 >> 172.21.15.8:0/4127188174 conn(0x7f19f40f1c90 msgr2=0x7f19f406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:58.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.375+0000 7f19f359e700 1 -- 172.21.15.8:0/4127188174 shutdown_connections 2023-10-18T22:29:58.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.375+0000 7f19f359e700 1 -- 172.21.15.8:0/4127188174 wait complete. 2023-10-18T22:29:58.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.512+0000 7fda4cdb9700 1 -- 172.21.15.8:0/1175955742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda480f6530 msgr2=0x7fda480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.512+0000 7fda4cdb9700 1 --2- 172.21.15.8:0/1175955742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda480f6530 0x7fda480f6950 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7fda38004660 tx=0x7fda38009b30).stop 2023-10-18T22:29:58.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.512+0000 7fda4cdb9700 1 -- 172.21.15.8:0/1175955742 shutdown_connections 2023-10-18T22:29:58.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.512+0000 7fda4cdb9700 1 --2- 172.21.15.8:0/1175955742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480f77d0 0x7fda480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.512+0000 7fda4cdb9700 1 --2- 172.21.15.8:0/1175955742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda480f6530 0x7fda480f6950 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.512+0000 7fda4cdb9700 1 -- 172.21.15.8:0/1175955742 >> 172.21.15.8:0/1175955742 conn(0x7fda480f1c90 msgr2=0x7fda480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.513+0000 7fda4cdb9700 1 -- 172.21.15.8:0/1175955742 shutdown_connections 2023-10-18T22:29:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.513+0000 7fda4cdb9700 1 -- 172.21.15.8:0/1175955742 wait complete. 2023-10-18T22:29:58.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.514+0000 7fda4cdb9700 1 Processor -- start 2023-10-18T22:29:58.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.514+0000 7fda4cdb9700 1 -- start start 2023-10-18T22:29:58.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda4cdb9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda480f6530 0x7fda4806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:58.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda4cdb9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480f77d0 0x7fda48069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:58.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda4cdb9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4806a380 con 0x7fda480f6530 2023-10-18T22:29:58.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda4cdb9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4806a4c0 con 0x7fda480f77d0 2023-10-18T22:29:58.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda480f6530 0x7fda4806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:58.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda480f6530 0x7fda4806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59498/0 (socket says 172.21.15.8:59498) 2023-10-18T22:29:58.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda477fe700 1 -- 172.21.15.8:0/116379455 learned_addr learned my addr 172.21.15.8:0/116379455 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:58.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda46ffd700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480f77d0 0x7fda48069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:58.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda477fe700 1 -- 172.21.15.8:0/116379455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480f77d0 msgr2=0x7fda48069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda477fe700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480f77d0 0x7fda48069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda477fe700 1 -- 172.21.15.8:0/116379455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda38005040 con 0x7fda480f6530 2023-10-18T22:29:58.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.515+0000 7fda477fe700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda480f6530 0x7fda4806b9a0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7fda38014040 tx=0x7fda3800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.516+0000 7fda2ffff700 1 -- 172.21.15.8:0/116379455 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda38019070 con 0x7fda480f6530 2023-10-18T22:29:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.516+0000 7fda2ffff700 1 -- 172.21.15.8:0/116379455 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fda3801e420 con 0x7fda480f6530 2023-10-18T22:29:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.516+0000 7fda2ffff700 1 -- 172.21.15.8:0/116379455 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda38014620 con 0x7fda480f6530 2023-10-18T22:29:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.516+0000 7fda4cdb9700 1 -- 172.21.15.8:0/116379455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4806a740 con 0x7fda480f6530 2023-10-18T22:29:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.516+0000 7fda4cdb9700 1 -- 172.21.15.8:0/116379455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4806ac20 con 0x7fda480f6530 2023-10-18T22:29:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.517+0000 7fda4cdb9700 1 -- 172.21.15.8:0/116379455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda48045ad0 con 0x7fda480f6530 2023-10-18T22:29:58.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.518+0000 7fda2ffff700 1 -- 172.21.15.8:0/116379455 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fda3801e9e0 con 0x7fda480f6530 2023-10-18T22:29:58.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.519+0000 7fda2ffff700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda30060f70 0x7fda30063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:58.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.519+0000 7fda2ffff700 1 -- 172.21.15.8:0/116379455 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fda3807dcf0 con 0x7fda480f6530 2023-10-18T22:29:58.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.519+0000 7fda46ffd700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda30060f70 0x7fda30063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:58.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.519+0000 7fda46ffd700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda30060f70 0x7fda30063430 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fda3c009fd0 tx=0x7fda3c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:58.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.523+0000 7fda2ffff700 1 -- 172.21.15.8:0/116379455 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fda3804d960 con 0x7fda480f6530 2023-10-18T22:29:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.257974+0000 mon.smithi008 (mon.0) 5691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.717+0000 7fda4cdb9700 1 -- 172.21.15.8:0/116379455 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda480fedd0 con 0x7fda30060f70 2023-10-18T22:29:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.726+0000 7fda2ffff700 1 -- 172.21.15.8:0/116379455 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fda480fedd0 con 0x7fda30060f70 2023-10-18T22:29:58.729 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:29:58.730 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (96m) 3m ago 98m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:29:58.730 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (90m) 3m ago 98m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:29:58.730 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (90m) 92s ago 97m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:29:58.731 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (96m) 3m ago 97m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:29:58.731 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 3m ago 94m - - 2023-10-18T22:29:58.731 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 3m ago 94m - - 2023-10-18T22:29:58.732 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 92s ago 94m - - 2023-10-18T22:29:58.732 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 92s ago 94m - - 2023-10-18T22:29:58.733 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (91m) 3m ago 99m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:29:58.733 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (91m) 92s ago 97m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:29:58.733 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (90m) 3m ago 99m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:29:58.734 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (90m) 92s ago 97m 342M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:29:58.734 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (97m) 3m ago 97m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:29:58.734 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (96m) 92s ago 96m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:29:58.735 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (90m) 3m ago 96m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:29:58.735 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (88m) 3m ago 96m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:29:58.736 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (87m) 3m ago 96m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:29:58.736 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (87m) 92s ago 95m 559M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:29:58.736 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (86m) 92s ago 95m 479M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:29:58.737 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (86m) 92s ago 95m 407M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:29:58.737 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (92m) 3m ago 97m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:29:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.728+0000 7fda4cdb9700 1 -- 172.21.15.8:0/116379455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda30060f70 msgr2=0x7fda30063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.728+0000 7fda4cdb9700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda30060f70 0x7fda30063430 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fda3c009fd0 tx=0x7fda3c00b040).stop 2023-10-18T22:29:58.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.728+0000 7fda4cdb9700 1 -- 172.21.15.8:0/116379455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda480f6530 msgr2=0x7fda4806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.728+0000 7fda4cdb9700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda480f6530 0x7fda4806b9a0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7fda38014040 tx=0x7fda3800b040).stop 2023-10-18T22:29:58.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.728+0000 7fda4cdb9700 1 -- 172.21.15.8:0/116379455 shutdown_connections 2023-10-18T22:29:58.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.728+0000 7fda4cdb9700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fda30060f70 0x7fda30063430 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.728+0000 7fda4cdb9700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda480f6530 0x7fda4806b9a0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.728+0000 7fda4cdb9700 1 --2- 172.21.15.8:0/116379455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480f77d0 0x7fda48069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.728+0000 7fda4cdb9700 1 -- 172.21.15.8:0/116379455 >> 172.21.15.8:0/116379455 conn(0x7fda480f1c90 msgr2=0x7fda480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:58.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.729+0000 7fda4cdb9700 1 -- 172.21.15.8:0/116379455 shutdown_connections 2023-10-18T22:29:58.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.729+0000 7fda4cdb9700 1 -- 172.21.15.8:0/116379455 wait complete. 2023-10-18T22:29:58.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.866+0000 7f6a1f59e700 1 -- 172.21.15.8:0/2826068641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a200f6530 msgr2=0x7f6a200f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.866+0000 7f6a1f59e700 1 --2- 172.21.15.8:0/2826068641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a200f6530 0x7f6a200f6950 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7f6a10004660 tx=0x7f6a10009b30).stop 2023-10-18T22:29:58.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.866+0000 7f6a1f59e700 1 -- 172.21.15.8:0/2826068641 shutdown_connections 2023-10-18T22:29:58.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.866+0000 7f6a1f59e700 1 --2- 172.21.15.8:0/2826068641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a200f77d0 0x7f6a200f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.866+0000 7f6a1f59e700 1 --2- 172.21.15.8:0/2826068641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a200f6530 0x7f6a200f6950 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.866+0000 7f6a1f59e700 1 -- 172.21.15.8:0/2826068641 >> 172.21.15.8:0/2826068641 conn(0x7f6a200f1c90 msgr2=0x7f6a200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:58.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.866+0000 7f6a1f59e700 1 -- 172.21.15.8:0/2826068641 shutdown_connections 2023-10-18T22:29:58.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.866+0000 7f6a1f59e700 1 -- 172.21.15.8:0/2826068641 wait complete. 2023-10-18T22:29:58.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.867+0000 7f6a1f59e700 1 Processor -- start 2023-10-18T22:29:58.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.867+0000 7f6a1f59e700 1 -- start start 2023-10-18T22:29:58.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a200f6530 0x7f6a20108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:58.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a200f77d0 0x7f6a20109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:58.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20109a00 con 0x7f6a200f77d0 2023-10-18T22:29:58.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20109b40 con 0x7f6a200f6530 2023-10-18T22:29:58.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a200f77d0 0x7f6a20109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:58.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a200f77d0 0x7f6a20109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59514/0 (socket says 172.21.15.8:59514) 2023-10-18T22:29:58.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1dd9b700 1 -- 172.21.15.8:0/3161163506 learned_addr learned my addr 172.21.15.8:0/3161163506 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:58.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1e59c700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a200f6530 0x7f6a20108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:58.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1dd9b700 1 -- 172.21.15.8:0/3161163506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a200f6530 msgr2=0x7f6a20108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:58.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1dd9b700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a200f6530 0x7f6a20108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:58.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.868+0000 7f6a1dd9b700 1 -- 172.21.15.8:0/3161163506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10005040 con 0x7f6a200f77d0 2023-10-18T22:29:58.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.869+0000 7f6a1dd9b700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a200f77d0 0x7f6a20109450 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 rx=0x7f6a14002700 tx=0x7f6a14009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:58.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.869+0000 7f6a0effd700 1 -- 172.21.15.8:0/3161163506 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a14009320 con 0x7f6a200f77d0 2023-10-18T22:29:58.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.869+0000 7f6a0effd700 1 -- 172.21.15.8:0/3161163506 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6a1400f040 con 0x7f6a200f77d0 2023-10-18T22:29:58.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.869+0000 7f6a1f59e700 1 -- 172.21.15.8:0/3161163506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2010a4e0 con 0x7f6a200f77d0 2023-10-18T22:29:58.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.869+0000 7f6a0effd700 1 -- 172.21.15.8:0/3161163506 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a140148f0 con 0x7f6a200f77d0 2023-10-18T22:29:58.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.869+0000 7f6a1f59e700 1 -- 172.21.15.8:0/3161163506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2010aaa0 con 0x7f6a200f77d0 2023-10-18T22:29:58.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.870+0000 7f6a1f59e700 1 -- 172.21.15.8:0/3161163506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a20045ad0 con 0x7f6a200f77d0 2023-10-18T22:29:58.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.871+0000 7f6a0effd700 1 -- 172.21.15.8:0/3161163506 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f6a14009480 con 0x7f6a200f77d0 2023-10-18T22:29:58.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.872+0000 7f6a0effd700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a08060f70 0x7f6a08063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:58.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.872+0000 7f6a0effd700 1 -- 172.21.15.8:0/3161163506 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f6a1407cb80 con 0x7f6a200f77d0 2023-10-18T22:29:58.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.872+0000 7f6a1e59c700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a08060f70 0x7f6a08063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:58.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.873+0000 7f6a1e59c700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a08060f70 0x7f6a08063430 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f6a10004630 tx=0x7f6a10009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:58.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:58.876+0000 7f6a0effd700 1 -- 172.21.15.8:0/3161163506 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f6a140501e0 con 0x7f6a200f77d0 2023-10-18T22:29:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.257974+0000 mon.smithi008 (mon.0) 5691 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:59.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.126+0000 7f6a1f59e700 1 -- 172.21.15.8:0/3161163506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6a20027a00 con 0x7f6a200f77d0 2023-10-18T22:29:59.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.126+0000 7f6a0effd700 1 -- 172.21.15.8:0/3161163506 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f6a1404c030 con 0x7f6a200f77d0 2023-10-18T22:29:59.129 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:29:59.129 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:29:59.130 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:29:59.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:29:59.130 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:29:59.130 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:29:59.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:29:59.131 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:29:59.131 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:29:59.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:29:59.131 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:29:59.132 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:29:59.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:29:59.132 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:29:59.132 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:29:59.133 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:29:59.133 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:29:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.128+0000 7f6a1f59e700 1 -- 172.21.15.8:0/3161163506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a08060f70 msgr2=0x7f6a08063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.128+0000 7f6a1f59e700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a08060f70 0x7f6a08063430 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f6a10004630 tx=0x7f6a10009b30).stop 2023-10-18T22:29:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.128+0000 7f6a1f59e700 1 -- 172.21.15.8:0/3161163506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a200f77d0 msgr2=0x7f6a20109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:59.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.128+0000 7f6a1f59e700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a200f77d0 0x7f6a20109450 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 rx=0x7f6a14002700 tx=0x7f6a14009e00).stop 2023-10-18T22:29:59.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.128+0000 7f6a1f59e700 1 -- 172.21.15.8:0/3161163506 shutdown_connections 2023-10-18T22:29:59.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.128+0000 7f6a1f59e700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f6a08060f70 0x7f6a08063430 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.128+0000 7f6a1f59e700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a200f6530 0x7f6a20108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.129+0000 7f6a1f59e700 1 --2- 172.21.15.8:0/3161163506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a200f77d0 0x7f6a20109450 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.129+0000 7f6a1f59e700 1 -- 172.21.15.8:0/3161163506 >> 172.21.15.8:0/3161163506 conn(0x7f6a200f1c90 msgr2=0x7f6a2006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:59.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.129+0000 7f6a1f59e700 1 -- 172.21.15.8:0/3161163506 shutdown_connections 2023-10-18T22:29:59.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.129+0000 7f6a1f59e700 1 -- 172.21.15.8:0/3161163506 wait complete. 2023-10-18T22:29:59.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.264+0000 7f3ade70b700 1 -- 172.21.15.8:0/310227481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad80f6530 msgr2=0x7f3ad80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:59.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.264+0000 7f3ade70b700 1 --2- 172.21.15.8:0/310227481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad80f6530 0x7f3ad80f6950 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7f3ad4004660 tx=0x7f3ad4009b30).stop 2023-10-18T22:29:59.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.264+0000 7f3ade70b700 1 -- 172.21.15.8:0/310227481 shutdown_connections 2023-10-18T22:29:59.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.264+0000 7f3ade70b700 1 --2- 172.21.15.8:0/310227481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad80f77d0 0x7f3ad80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.264+0000 7f3ade70b700 1 --2- 172.21.15.8:0/310227481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad80f6530 0x7f3ad80f6950 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.264+0000 7f3ade70b700 1 -- 172.21.15.8:0/310227481 >> 172.21.15.8:0/310227481 conn(0x7f3ad80f1c90 msgr2=0x7f3ad80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:59.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.264+0000 7f3ade70b700 1 -- 172.21.15.8:0/310227481 shutdown_connections 2023-10-18T22:29:59.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.265+0000 7f3ade70b700 1 -- 172.21.15.8:0/310227481 wait complete. 2023-10-18T22:29:59.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.265+0000 7f3ade70b700 1 Processor -- start 2023-10-18T22:29:59.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.265+0000 7f3ade70b700 1 -- start start 2023-10-18T22:29:59.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.266+0000 7f3ade70b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad80f6530 0x7f3ad806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:59.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.266+0000 7f3ade70b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad80f77d0 0x7f3ad8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:59.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.266+0000 7f3ade70b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad806a380 con 0x7f3ad80f6530 2023-10-18T22:29:59.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.266+0000 7f3ade70b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad806a4c0 con 0x7f3ad80f77d0 2023-10-18T22:29:59.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.266+0000 7f3add709700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad80f6530 0x7f3ad806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:59.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.266+0000 7f3add709700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad80f6530 0x7f3ad806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59522/0 (socket says 172.21.15.8:59522) 2023-10-18T22:29:59.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.266+0000 7f3add709700 1 -- 172.21.15.8:0/1208957915 learned_addr learned my addr 172.21.15.8:0/1208957915 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:59.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.266+0000 7f3add709700 1 -- 172.21.15.8:0/1208957915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad80f77d0 msgr2=0x7f3ad8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:59.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.266+0000 7f3add709700 1 --2- 172.21.15.8:0/1208957915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad80f77d0 0x7f3ad8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:29:59.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.266+0000 7f3add709700 1 -- 172.21.15.8:0/1208957915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad4005040 con 0x7f3ad80f6530 2023-10-18T22:29:59.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.267+0000 7f3add709700 1 --2- 172.21.15.8:0/1208957915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad80f6530 0x7f3ad806b9a0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f3ad4007a60 tx=0x7f3ad4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:59.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.267+0000 7f3acdffb700 1 -- 172.21.15.8:0/1208957915 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad4018070 con 0x7f3ad80f6530 2023-10-18T22:29:59.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.267+0000 7f3acdffb700 1 -- 172.21.15.8:0/1208957915 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3ad4009630 con 0x7f3ad80f6530 2023-10-18T22:29:59.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.267+0000 7f3acdffb700 1 -- 172.21.15.8:0/1208957915 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad401c540 con 0x7f3ad80f6530 2023-10-18T22:29:59.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.267+0000 7f3ade70b700 1 -- 172.21.15.8:0/1208957915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad806a740 con 0x7f3ad80f6530 2023-10-18T22:29:59.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.267+0000 7f3ade70b700 1 -- 172.21.15.8:0/1208957915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad806aca0 con 0x7f3ad80f6530 2023-10-18T22:29:59.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.268+0000 7f3ade70b700 1 -- 172.21.15.8:0/1208957915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad8045ad0 con 0x7f3ad80f6530 2023-10-18T22:29:59.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.269+0000 7f3acdffb700 1 -- 172.21.15.8:0/1208957915 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3ad401d420 con 0x7f3ad80f6530 2023-10-18T22:29:59.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.270+0000 7f3acdffb700 1 --2- 172.21.15.8:0/1208957915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ac4060f70 0x7f3ac4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:59.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.270+0000 7f3acdffb700 1 -- 172.21.15.8:0/1208957915 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3ad407e600 con 0x7f3ad80f6530 2023-10-18T22:29:59.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.270+0000 7f3adcf08700 1 --2- 172.21.15.8:0/1208957915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ac4060f70 0x7f3ac4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:59.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.271+0000 7f3adcf08700 1 --2- 172.21.15.8:0/1208957915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ac4060f70 0x7f3ac4063430 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f3ac8004bd0 tx=0x7f3ac8009b10).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:59.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.274+0000 7f3acdffb700 1 -- 172.21.15.8:0/1208957915 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3ad404e2f0 con 0x7f3ad80f6530 2023-10-18T22:29:59.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.499+0000 7f3ade70b700 1 -- 172.21.15.8:0/1208957915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ad80fed90 con 0x7f3ad80f6530 2023-10-18T22:29:59.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.499+0000 7f3acdffb700 1 -- 172.21.15.8:0/1208957915 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f3ad4051910 con 0x7f3ad80f6530 2023-10-18T22:29:59.502 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:29:59.502 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:29:59.502 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:29:59.503 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:29:59.503 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:29:59.503 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:29:59.503 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:29:59.503 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:29:59.504 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:29:59.504 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:29:59.504 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:29:59.504 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:29:59.504 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:29:59.505 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:29:59.505 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:29:59.505 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:29:59.505 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:29:59.506 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:29:59.506 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:29:59.506 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:29:59.506 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:29:59.506 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:29:59.507 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:29:59.507 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:29:59.507 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:29:59.507 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:29:59.507 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:29:59.508 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:29:59.508 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:29:59.508 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:29:59.508 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:29:59.508 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:29:59.509 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:29:59.509 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:29:59.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 -- 172.21.15.8:0/1208957915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ac4060f70 msgr2=0x7f3ac4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:59.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 --2- 172.21.15.8:0/1208957915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ac4060f70 0x7f3ac4063430 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f3ac8004bd0 tx=0x7f3ac8009b10).stop 2023-10-18T22:29:59.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 -- 172.21.15.8:0/1208957915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad80f6530 msgr2=0x7f3ad806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:59.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 --2- 172.21.15.8:0/1208957915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad80f6530 0x7f3ad806b9a0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f3ad4007a60 tx=0x7f3ad4009b30).stop 2023-10-18T22:29:59.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 -- 172.21.15.8:0/1208957915 shutdown_connections 2023-10-18T22:29:59.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 --2- 172.21.15.8:0/1208957915 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3ac4060f70 0x7f3ac4063430 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 --2- 172.21.15.8:0/1208957915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ad80f6530 0x7f3ad806b9a0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 --2- 172.21.15.8:0/1208957915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ad80f77d0 0x7f3ad8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-18T22:29:59.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 -- 172.21.15.8:0/1208957915 >> 172.21.15.8:0/1208957915 conn(0x7f3ad80f1c90 msgr2=0x7f3ad80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:59.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 -- 172.21.15.8:0/1208957915 shutdown_connections 2023-10-18T22:29:59.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.501+0000 7f3ade70b700 1 -- 172.21.15.8:0/1208957915 wait complete. 2023-10-18T22:29:59.512 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:29:59.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.641+0000 7f0fe7fff700 1 -- 172.21.15.8:0/2950416111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe80f77d0 msgr2=0x7f0fe80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.641+0000 7f0fe7fff700 1 --2- 172.21.15.8:0/2950416111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe80f77d0 0x7f0fe80f7c30 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f0fdc004660 tx=0x7f0fdc009b30).stop 2023-10-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.641+0000 7f0fe7fff700 1 -- 172.21.15.8:0/2950416111 shutdown_connections 2023-10-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.641+0000 7f0fe7fff700 1 --2- 172.21.15.8:0/2950416111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe80f77d0 0x7f0fe80f7c30 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.641+0000 7f0fe7fff700 1 --2- 172.21.15.8:0/2950416111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fe80f6530 0x7f0fe80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.641+0000 7f0fe7fff700 1 -- 172.21.15.8:0/2950416111 >> 172.21.15.8:0/2950416111 conn(0x7f0fe80f1c90 msgr2=0x7f0fe80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:59.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.641+0000 7f0fe7fff700 1 -- 172.21.15.8:0/2950416111 shutdown_connections 2023-10-18T22:29:59.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.641+0000 7f0fe7fff700 1 -- 172.21.15.8:0/2950416111 wait complete. 2023-10-18T22:29:59.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.642+0000 7f0fe7fff700 1 Processor -- start 2023-10-18T22:29:59.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.642+0000 7f0fe7fff700 1 -- start start 2023-10-18T22:29:59.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.642+0000 7f0fe7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fe80f6530 0x7f0fe8106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:59.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.642+0000 7f0fe7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe80f77d0 0x7f0fe8107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:59.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.642+0000 7f0fe7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe8107830 con 0x7f0fe80f77d0 2023-10-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.642+0000 7f0fe7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe8108040 con 0x7f0fe80f6530 2023-10-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.642+0000 7f0fe67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe80f77d0 0x7f0fe8107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.642+0000 7f0fe67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe80f77d0 0x7f0fe8107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59538/0 (socket says 172.21.15.8:59538) 2023-10-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.643+0000 7f0fe67fc700 1 -- 172.21.15.8:0/1300341508 learned_addr learned my addr 172.21.15.8:0/1300341508 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.643+0000 7f0fe6ffd700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fe80f6530 0x7f0fe8106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.643+0000 7f0fe67fc700 1 -- 172.21.15.8:0/1300341508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fe80f6530 msgr2=0x7f0fe8106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.643+0000 7f0fe67fc700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fe80f6530 0x7f0fe8106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.643+0000 7f0fe67fc700 1 -- 172.21.15.8:0/1300341508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc005040 con 0x7f0fe80f77d0 2023-10-18T22:29:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.643+0000 7f0fe67fc700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe80f77d0 0x7f0fe8107230 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7f0fdc009990 tx=0x7f0fdc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:59.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.643+0000 7f0fcf7fe700 1 -- 172.21.15.8:0/1300341508 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fdc018070 con 0x7f0fe80f77d0 2023-10-18T22:29:59.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.643+0000 7f0fe7fff700 1 -- 172.21.15.8:0/1300341508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe8108260 con 0x7f0fe80f77d0 2023-10-18T22:29:59.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.643+0000 7f0fcf7fe700 1 -- 172.21.15.8:0/1300341508 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0fdc009630 con 0x7f0fe80f77d0 2023-10-18T22:29:59.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.643+0000 7f0fcf7fe700 1 -- 172.21.15.8:0/1300341508 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fdc01c3c0 con 0x7f0fe80f77d0 2023-10-18T22:29:59.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.644+0000 7f0fe7fff700 1 -- 172.21.15.8:0/1300341508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe81087c0 con 0x7f0fe80f77d0 2023-10-18T22:29:59.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.645+0000 7f0fe7fff700 1 -- 172.21.15.8:0/1300341508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe8059100 con 0x7f0fe80f77d0 2023-10-18T22:29:59.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.646+0000 7f0fcf7fe700 1 -- 172.21.15.8:0/1300341508 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0fdc01d970 con 0x7f0fe80f77d0 2023-10-18T22:29:59.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.646+0000 7f0fcf7fe700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fd0060f70 0x7f0fd0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.646+0000 7f0fcf7fe700 1 -- 172.21.15.8:0/1300341508 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0fdc07e660 con 0x7f0fe80f77d0 2023-10-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.647+0000 7f0fe6ffd700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fd0060f70 0x7f0fd0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.647+0000 7f0fe6ffd700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fd0060f70 0x7f0fd0063430 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f0fe8106ab0 tx=0x7f0fd800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:29:59.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.651+0000 7f0fcf7fe700 1 -- 172.21.15.8:0/1300341508 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0fdc04e210 con 0x7f0fe80f77d0 2023-10-18T22:29:59.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.851+0000 7f0fe7fff700 1 -- 172.21.15.8:0/1300341508 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fe80fee50 con 0x7f0fd0060f70 2023-10-18T22:29:59.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.853+0000 7f0fcf7fe700 1 -- 172.21.15.8:0/1300341508 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0fe80fee50 con 0x7f0fd0060f70 2023-10-18T22:29:59.855 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:29:59.855 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:29:59.856 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:29:59.856 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:29:59.856 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:29:59.856 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:29:59.856 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:29:59.856 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:29:59.857 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:29:59.857 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:29:59.857 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:29:59.857 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:29:59.857 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:29:59.858 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:29:59.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 -- 172.21.15.8:0/1300341508 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fd0060f70 msgr2=0x7f0fd0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fd0060f70 0x7f0fd0063430 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f0fe8106ab0 tx=0x7f0fd800b040).stop 2023-10-18T22:29:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 -- 172.21.15.8:0/1300341508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe80f77d0 msgr2=0x7f0fe8107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:29:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe80f77d0 0x7f0fe8107230 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7f0fdc009990 tx=0x7f0fdc009b30).stop 2023-10-18T22:29:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 -- 172.21.15.8:0/1300341508 shutdown_connections 2023-10-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0fd0060f70 0x7f0fd0063430 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fe80f6530 0x7f0fe8106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 --2- 172.21.15.8:0/1300341508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe80f77d0 0x7f0fe8107230 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 -- 172.21.15.8:0/1300341508 >> 172.21.15.8:0/1300341508 conn(0x7f0fe80f1c90 msgr2=0x7f0fe80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 -- 172.21.15.8:0/1300341508 shutdown_connections 2023-10-18T22:29:59.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:29:59.855+0000 7f0fe7fff700 1 -- 172.21.15.8:0/1300341508 wait complete. 2023-10-18T22:29:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.025677+0000 mgr.smithi008.flmjzp (mgr.14640) 5456 : audit [DBG] from='client.38344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:58.229020+0000 mgr.smithi008.flmjzp (mgr.14640) 5457 : cluster [DBG] pgmap v3742: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.373818+0000 mgr.smithi008.flmjzp (mgr.14640) 5458 : audit [DBG] from='client.38348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.816347+0000 mon.smithi008 (mon.0) 5692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.817198+0000 mon.smithi008 (mon.0) 5693 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.822506+0000 mon.smithi008 (mon.0) 5694 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:59.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.828595+0000 mon.smithi008 (mon.0) 5695 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:59.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.831423+0000 mon.smithi008 (mon.0) 5696 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:59.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.832999+0000 mon.smithi008 (mon.0) 5697 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:59.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.834513+0000 mon.smithi008 (mon.0) 5698 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:59.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.836606+0000 mon.smithi008 (mon.0) 5699 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:59.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:59.127964+0000 mon.smithi008 (mon.0) 5700 : audit [DBG] from='client.? 172.21.15.8:0/3161163506' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:59.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:29:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:59.500706+0000 mon.smithi008 (mon.0) 5701 : audit [DBG] from='client.? 172.21.15.8:0/1208957915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:29:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.025677+0000 mgr.smithi008.flmjzp (mgr.14640) 5456 : audit [DBG] from='client.38344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:58.229020+0000 mgr.smithi008.flmjzp (mgr.14640) 5457 : cluster [DBG] pgmap v3742: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:29:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.373818+0000 mgr.smithi008.flmjzp (mgr.14640) 5458 : audit [DBG] from='client.38348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:29:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.816347+0000 mon.smithi008 (mon.0) 5692 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:29:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.817198+0000 mon.smithi008 (mon.0) 5693 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:29:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.822506+0000 mon.smithi008 (mon.0) 5694 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:29:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.828595+0000 mon.smithi008 (mon.0) 5695 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:29:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.831423+0000 mon.smithi008 (mon.0) 5696 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.832999+0000 mon.smithi008 (mon.0) 5697 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.834513+0000 mon.smithi008 (mon.0) 5698 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:59.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.836606+0000 mon.smithi008 (mon.0) 5699 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:59.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:59.127964+0000 mon.smithi008 (mon.0) 5700 : audit [DBG] from='client.? 172.21.15.8:0/3161163506' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:29:59.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:29:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:59.500706+0000 mon.smithi008 (mon.0) 5701 : audit [DBG] from='client.? 172.21.15.8:0/1208957915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:30:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:58.719434+0000 mgr.smithi008.flmjzp (mgr.14640) 5459 : audit [DBG] from='client.38352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:58.817874+0000 mgr.smithi008.flmjzp (mgr.14640) 5460 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:58.818435+0000 mgr.smithi008.flmjzp (mgr.14640) 5461 : cluster [DBG] pgmap v3743: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:29:58.818734+0000 mgr.smithi008.flmjzp (mgr.14640) 5462 : cluster [DBG] pgmap v3744: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:29:58.838730+0000 mgr.smithi008.flmjzp (mgr.14640) 5463 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:00.000147+0000 mon.smithi008 (mon.0) 5702 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T22:30:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:58.719434+0000 mgr.smithi008.flmjzp (mgr.14640) 5459 : audit [DBG] from='client.38352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:58.817874+0000 mgr.smithi008.flmjzp (mgr.14640) 5460 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:58.818435+0000 mgr.smithi008.flmjzp (mgr.14640) 5461 : cluster [DBG] pgmap v3743: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:29:58.818734+0000 mgr.smithi008.flmjzp (mgr.14640) 5462 : cluster [DBG] pgmap v3744: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:29:58.838730+0000 mgr.smithi008.flmjzp (mgr.14640) 5463 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:00.000147+0000 mon.smithi008 (mon.0) 5702 : cluster [WRN] overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 22 daemons have recently crashed 2023-10-18T22:30:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:29:59.854160+0000 mgr.smithi008.flmjzp (mgr.14640) 5464 : audit [DBG] from='client.38364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:29:59.854160+0000 mgr.smithi008.flmjzp (mgr.14640) 5464 : audit [DBG] from='client.38364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:02.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:00.819247+0000 mgr.smithi008.flmjzp (mgr.14640) 5465 : cluster [DBG] pgmap v3745: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:00.819247+0000 mgr.smithi008.flmjzp (mgr.14640) 5465 : cluster [DBG] pgmap v3745: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:02.819959+0000 mgr.smithi008.flmjzp (mgr.14640) 5466 : cluster [DBG] pgmap v3746: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:04.986 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:02.819959+0000 mgr.smithi008.flmjzp (mgr.14640) 5466 : cluster [DBG] pgmap v3746: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:04.820644+0000 mgr.smithi008.flmjzp (mgr.14640) 5467 : cluster [DBG] pgmap v3747: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:06.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:04.820644+0000 mgr.smithi008.flmjzp (mgr.14640) 5467 : cluster [DBG] pgmap v3747: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:06.821303+0000 mgr.smithi008.flmjzp (mgr.14640) 5468 : cluster [DBG] pgmap v3748: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:06.821303+0000 mgr.smithi008.flmjzp (mgr.14640) 5468 : cluster [DBG] pgmap v3748: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:09.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:08.847737+0000 mon.smithi008 (mon.0) 5703 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:09.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:08.850657+0000 mon.smithi008 (mon.0) 5704 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:30:09.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:08.852123+0000 mon.smithi008 (mon.0) 5705 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:30:09.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:08.858544+0000 mon.smithi008 (mon.0) 5706 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:30:09.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:08.865043+0000 mon.smithi008 (mon.0) 5707 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:09.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:08.868179+0000 mon.smithi008 (mon.0) 5708 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:09.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:08.869935+0000 mon.smithi008 (mon.0) 5709 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:09.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:08.871600+0000 mon.smithi008 (mon.0) 5710 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:09.172 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:08.873798+0000 mon.smithi008 (mon.0) 5711 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:08.847737+0000 mon.smithi008 (mon.0) 5703 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:09.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:08.850657+0000 mon.smithi008 (mon.0) 5704 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:30:09.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:08.852123+0000 mon.smithi008 (mon.0) 5705 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:30:09.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:08.858544+0000 mon.smithi008 (mon.0) 5706 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:30:09.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:08.865043+0000 mon.smithi008 (mon.0) 5707 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:09.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:08.868179+0000 mon.smithi008 (mon.0) 5708 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:09.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:08.869935+0000 mon.smithi008 (mon.0) 5709 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:09.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:08.871600+0000 mon.smithi008 (mon.0) 5710 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:09.239 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:08.873798+0000 mon.smithi008 (mon.0) 5711 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:10.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:08.821855+0000 mgr.smithi008.flmjzp (mgr.14640) 5469 : cluster [DBG] pgmap v3749: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:10.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:30:08.853007+0000 mgr.smithi008.flmjzp (mgr.14640) 5470 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:10.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:08.853652+0000 mgr.smithi008.flmjzp (mgr.14640) 5471 : cluster [DBG] pgmap v3750: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:10.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:08.853971+0000 mgr.smithi008.flmjzp (mgr.14640) 5472 : cluster [DBG] pgmap v3751: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:10.171 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:30:08.877688+0000 mgr.smithi008.flmjzp (mgr.14640) 5473 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:08.821855+0000 mgr.smithi008.flmjzp (mgr.14640) 5469 : cluster [DBG] pgmap v3749: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:10.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:30:08.853007+0000 mgr.smithi008.flmjzp (mgr.14640) 5470 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:08.853652+0000 mgr.smithi008.flmjzp (mgr.14640) 5471 : cluster [DBG] pgmap v3750: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:08.853971+0000 mgr.smithi008.flmjzp (mgr.14640) 5472 : cluster [DBG] pgmap v3751: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:10.238 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:30:08.877688+0000 mgr.smithi008.flmjzp (mgr.14640) 5473 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:10.854701+0000 mgr.smithi008.flmjzp (mgr.14640) 5474 : cluster [DBG] pgmap v3752: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:12.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:10.854701+0000 mgr.smithi008.flmjzp (mgr.14640) 5474 : cluster [DBG] pgmap v3752: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:12.855388+0000 mgr.smithi008.flmjzp (mgr.14640) 5475 : cluster [DBG] pgmap v3753: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:14.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:12.855388+0000 mgr.smithi008.flmjzp (mgr.14640) 5475 : cluster [DBG] pgmap v3753: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:16.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:14.856027+0000 mgr.smithi008.flmjzp (mgr.14640) 5476 : cluster [DBG] pgmap v3754: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:14.856027+0000 mgr.smithi008.flmjzp (mgr.14640) 5476 : cluster [DBG] pgmap v3754: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:16.856709+0000 mgr.smithi008.flmjzp (mgr.14640) 5477 : cluster [DBG] pgmap v3755: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:16.856709+0000 mgr.smithi008.flmjzp (mgr.14640) 5477 : cluster [DBG] pgmap v3755: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:18.885811+0000 mon.smithi008 (mon.0) 5712 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:18.887967+0000 mon.smithi008 (mon.0) 5713 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:30:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:18.888981+0000 mon.smithi008 (mon.0) 5714 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:30:19.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:18.895613+0000 mon.smithi008 (mon.0) 5715 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:30:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:18.901981+0000 mon.smithi008 (mon.0) 5716 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:18.905031+0000 mon.smithi008 (mon.0) 5717 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:18.906767+0000 mon.smithi008 (mon.0) 5718 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:18.908343+0000 mon.smithi008 (mon.0) 5719 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:19.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:18.910436+0000 mon.smithi008 (mon.0) 5720 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:18.885811+0000 mon.smithi008 (mon.0) 5712 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:18.887967+0000 mon.smithi008 (mon.0) 5713 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:30:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:18.888981+0000 mon.smithi008 (mon.0) 5714 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:30:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:18.895613+0000 mon.smithi008 (mon.0) 5715 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:30:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:18.901981+0000 mon.smithi008 (mon.0) 5716 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:19.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:18.905031+0000 mon.smithi008 (mon.0) 5717 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:18.906767+0000 mon.smithi008 (mon.0) 5718 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:18.908343+0000 mon.smithi008 (mon.0) 5719 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:19.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:18.910436+0000 mon.smithi008 (mon.0) 5720 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:18.857330+0000 mgr.smithi008.flmjzp (mgr.14640) 5478 : cluster [DBG] pgmap v3756: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:30:18.889843+0000 mgr.smithi008.flmjzp (mgr.14640) 5479 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:18.890392+0000 mgr.smithi008.flmjzp (mgr.14640) 5480 : cluster [DBG] pgmap v3757: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:20.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:18.890672+0000 mgr.smithi008.flmjzp (mgr.14640) 5481 : cluster [DBG] pgmap v3758: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:20.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:30:18.912346+0000 mgr.smithi008.flmjzp (mgr.14640) 5482 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:18.857330+0000 mgr.smithi008.flmjzp (mgr.14640) 5478 : cluster [DBG] pgmap v3756: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:30:18.889843+0000 mgr.smithi008.flmjzp (mgr.14640) 5479 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:18.890392+0000 mgr.smithi008.flmjzp (mgr.14640) 5480 : cluster [DBG] pgmap v3757: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:18.890672+0000 mgr.smithi008.flmjzp (mgr.14640) 5481 : cluster [DBG] pgmap v3758: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:30:18.912346+0000 mgr.smithi008.flmjzp (mgr.14640) 5482 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:20.891323+0000 mgr.smithi008.flmjzp (mgr.14640) 5483 : cluster [DBG] pgmap v3759: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:20.891323+0000 mgr.smithi008.flmjzp (mgr.14640) 5483 : cluster [DBG] pgmap v3759: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:22.892007+0000 mgr.smithi008.flmjzp (mgr.14640) 5484 : cluster [DBG] pgmap v3760: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:22.892007+0000 mgr.smithi008.flmjzp (mgr.14640) 5484 : cluster [DBG] pgmap v3760: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:24.892530+0000 mgr.smithi008.flmjzp (mgr.14640) 5485 : cluster [DBG] pgmap v3761: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:24.892530+0000 mgr.smithi008.flmjzp (mgr.14640) 5485 : cluster [DBG] pgmap v3761: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:28.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:26.893001+0000 mgr.smithi008.flmjzp (mgr.14640) 5486 : cluster [DBG] pgmap v3762: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:26.893001+0000 mgr.smithi008.flmjzp (mgr.14640) 5486 : cluster [DBG] pgmap v3762: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:28.918981+0000 mon.smithi008 (mon.0) 5721 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:28.921089+0000 mon.smithi008 (mon.0) 5722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:30:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:28.922074+0000 mon.smithi008 (mon.0) 5723 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:30:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:28.928790+0000 mon.smithi008 (mon.0) 5724 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:30:29.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:28.935218+0000 mon.smithi008 (mon.0) 5725 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:28.938348+0000 mon.smithi008 (mon.0) 5726 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:28.940042+0000 mon.smithi008 (mon.0) 5727 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:28.941719+0000 mon.smithi008 (mon.0) 5728 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:29.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:28.943721+0000 mon.smithi008 (mon.0) 5729 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:28.918981+0000 mon.smithi008 (mon.0) 5721 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:28.921089+0000 mon.smithi008 (mon.0) 5722 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:30:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:28.922074+0000 mon.smithi008 (mon.0) 5723 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:30:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:28.928790+0000 mon.smithi008 (mon.0) 5724 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:30:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:28.935218+0000 mon.smithi008 (mon.0) 5725 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:28.938348+0000 mon.smithi008 (mon.0) 5726 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:28.940042+0000 mon.smithi008 (mon.0) 5727 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:29.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:28.941719+0000 mon.smithi008 (mon.0) 5728 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:29.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:28.943721+0000 mon.smithi008 (mon.0) 5729 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.010+0000 7ff08b59e700 1 -- 172.21.15.8:0/262072145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff08c0f6530 msgr2=0x7ff08c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.010+0000 7ff08b59e700 1 --2- 172.21.15.8:0/262072145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff08c0f6530 0x7ff08c0f6950 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 rx=0x7ff07c004660 tx=0x7ff07c009b30).stop 2023-10-18T22:30:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.010+0000 7ff08b59e700 1 -- 172.21.15.8:0/262072145 shutdown_connections 2023-10-18T22:30:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.010+0000 7ff08b59e700 1 --2- 172.21.15.8:0/262072145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff08c0f77d0 0x7ff08c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.010+0000 7ff08b59e700 1 --2- 172.21.15.8:0/262072145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff08c0f6530 0x7ff08c0f6950 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.010+0000 7ff08b59e700 1 -- 172.21.15.8:0/262072145 >> 172.21.15.8:0/262072145 conn(0x7ff08c0f1c90 msgr2=0x7ff08c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.010+0000 7ff08b59e700 1 -- 172.21.15.8:0/262072145 shutdown_connections 2023-10-18T22:30:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.010+0000 7ff08b59e700 1 -- 172.21.15.8:0/262072145 wait complete. 2023-10-18T22:30:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.011+0000 7ff08b59e700 1 Processor -- start 2023-10-18T22:30:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.011+0000 7ff08b59e700 1 -- start start 2023-10-18T22:30:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.011+0000 7ff08b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff08c0f6530 0x7ff08c108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.011+0000 7ff08b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff08c0f77d0 0x7ff08c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.011+0000 7ff08b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c109a70 con 0x7ff08c0f6530 2023-10-18T22:30:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.011+0000 7ff08b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c109bb0 con 0x7ff08c0f77d0 2023-10-18T22:30:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.012+0000 7ff08a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff08c0f6530 0x7ff08c108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.012+0000 7ff08a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff08c0f6530 0x7ff08c108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42032/0 (socket says 172.21.15.8:42032) 2023-10-18T22:30:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.012+0000 7ff08a59c700 1 -- 172.21.15.8:0/10770168 learned_addr learned my addr 172.21.15.8:0/10770168 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:30:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.012+0000 7ff089d9b700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff08c0f77d0 0x7ff08c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.012+0000 7ff08a59c700 1 -- 172.21.15.8:0/10770168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff08c0f77d0 msgr2=0x7ff08c1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.012+0000 7ff08a59c700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff08c0f77d0 0x7ff08c1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.012+0000 7ff08a59c700 1 -- 172.21.15.8:0/10770168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c005040 con 0x7ff08c0f6530 2023-10-18T22:30:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.012+0000 7ff08a59c700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff08c0f6530 0x7ff08c108fd0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7ff07c007a60 tx=0x7ff07c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.012+0000 7ff07affd700 1 -- 172.21.15.8:0/10770168 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07c018070 con 0x7ff08c0f6530 2023-10-18T22:30:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.013+0000 7ff07affd700 1 -- 172.21.15.8:0/10770168 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff07c009630 con 0x7ff08c0f6530 2023-10-18T22:30:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.013+0000 7ff07affd700 1 -- 172.21.15.8:0/10770168 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07c01c540 con 0x7ff08c0f6530 2023-10-18T22:30:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.013+0000 7ff08b59e700 1 -- 172.21.15.8:0/10770168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08c10a4f0 con 0x7ff08c0f6530 2023-10-18T22:30:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.013+0000 7ff08b59e700 1 -- 172.21.15.8:0/10770168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08c10aa50 con 0x7ff08c0f6530 2023-10-18T22:30:30.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.014+0000 7ff08b59e700 1 -- 172.21.15.8:0/10770168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08c045ad0 con 0x7ff08c0f6530 2023-10-18T22:30:30.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.015+0000 7ff07affd700 1 -- 172.21.15.8:0/10770168 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7ff07c01d420 con 0x7ff08c0f6530 2023-10-18T22:30:30.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.015+0000 7ff07affd700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff074060f70 0x7ff074063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:30.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.016+0000 7ff07affd700 1 -- 172.21.15.8:0/10770168 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7ff07c07e680 con 0x7ff08c0f6530 2023-10-18T22:30:30.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.016+0000 7ff089d9b700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff074060f70 0x7ff074063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:30.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.016+0000 7ff089d9b700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff074060f70 0x7ff074063430 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7ff080004a70 tx=0x7ff08000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:30.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.020+0000 7ff07affd700 1 -- 172.21.15.8:0/10770168 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7ff07c051ce0 con 0x7ff08c0f6530 2023-10-18T22:30:30.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.219+0000 7ff08b59e700 1 -- 172.21.15.8:0/10770168 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff08c0fee30 con 0x7ff074060f70 2023-10-18T22:30:30.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.220+0000 7ff07affd700 1 -- 172.21.15.8:0/10770168 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff08c0fee30 con 0x7ff074060f70 2023-10-18T22:30:30.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.222+0000 7ff08b59e700 1 -- 172.21.15.8:0/10770168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff074060f70 msgr2=0x7ff074063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.222+0000 7ff08b59e700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff074060f70 0x7ff074063430 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7ff080004a70 tx=0x7ff08000b040).stop 2023-10-18T22:30:30.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.222+0000 7ff08b59e700 1 -- 172.21.15.8:0/10770168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff08c0f6530 msgr2=0x7ff08c108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.222+0000 7ff08b59e700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff08c0f6530 0x7ff08c108fd0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7ff07c007a60 tx=0x7ff07c009b30).stop 2023-10-18T22:30:30.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.222+0000 7ff08b59e700 1 -- 172.21.15.8:0/10770168 shutdown_connections 2023-10-18T22:30:30.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.222+0000 7ff08b59e700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7ff074060f70 0x7ff074063430 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.222+0000 7ff08b59e700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff08c0f6530 0x7ff08c108fd0 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.222+0000 7ff08b59e700 1 --2- 172.21.15.8:0/10770168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff08c0f77d0 0x7ff08c1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.222+0000 7ff08b59e700 1 -- 172.21.15.8:0/10770168 >> 172.21.15.8:0/10770168 conn(0x7ff08c0f1c90 msgr2=0x7ff08c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:30.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.222+0000 7ff08b59e700 1 -- 172.21.15.8:0/10770168 shutdown_connections 2023-10-18T22:30:30.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.223+0000 7ff08b59e700 1 -- 172.21.15.8:0/10770168 wait complete. 2023-10-18T22:30:30.238 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:30:30.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.360+0000 7fadd3fff700 1 -- 172.21.15.8:0/3521124379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadd40f77d0 msgr2=0x7fadd40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.360+0000 7fadd3fff700 1 --2- 172.21.15.8:0/3521124379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadd40f77d0 0x7fadd40f7c30 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 rx=0x7fadc8004660 tx=0x7fadc8009b30).stop 2023-10-18T22:30:30.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.360+0000 7fadd3fff700 1 -- 172.21.15.8:0/3521124379 shutdown_connections 2023-10-18T22:30:30.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.360+0000 7fadd3fff700 1 --2- 172.21.15.8:0/3521124379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadd40f77d0 0x7fadd40f7c30 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.360+0000 7fadd3fff700 1 --2- 172.21.15.8:0/3521124379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd40f6530 0x7fadd40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.360+0000 7fadd3fff700 1 -- 172.21.15.8:0/3521124379 >> 172.21.15.8:0/3521124379 conn(0x7fadd40f1c90 msgr2=0x7fadd40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:30.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.361+0000 7fadd3fff700 1 -- 172.21.15.8:0/3521124379 shutdown_connections 2023-10-18T22:30:30.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.361+0000 7fadd3fff700 1 -- 172.21.15.8:0/3521124379 wait complete. 2023-10-18T22:30:30.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.361+0000 7fadd3fff700 1 Processor -- start 2023-10-18T22:30:30.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.361+0000 7fadd3fff700 1 -- start start 2023-10-18T22:30:30.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.362+0000 7fadd3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd40f6530 0x7fadd4108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:30.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.362+0000 7fadd3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadd40f77d0 0x7fadd4109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:30.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.362+0000 7fadd3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4109a20 con 0x7fadd40f77d0 2023-10-18T22:30:30.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.362+0000 7fadd3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4109b60 con 0x7fadd40f6530 2023-10-18T22:30:30.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.362+0000 7fadd27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadd40f77d0 0x7fadd4109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:30.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.362+0000 7fadd27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadd40f77d0 0x7fadd4109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42056/0 (socket says 172.21.15.8:42056) 2023-10-18T22:30:30.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.362+0000 7fadd27fc700 1 -- 172.21.15.8:0/2801621728 learned_addr learned my addr 172.21.15.8:0/2801621728 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:30:30.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.362+0000 7fadd2ffd700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd40f6530 0x7fadd4108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:30.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.363+0000 7fadd27fc700 1 -- 172.21.15.8:0/2801621728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd40f6530 msgr2=0x7fadd4108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.363+0000 7fadd27fc700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd40f6530 0x7fadd4108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.363+0000 7fadd27fc700 1 -- 172.21.15.8:0/2801621728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8005040 con 0x7fadd40f77d0 2023-10-18T22:30:30.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.363+0000 7fadd27fc700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadd40f77d0 0x7fadd4109470 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7fadc8009830 tx=0x7fadc8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:30.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.363+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2801621728 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadc8018070 con 0x7fadd40f77d0 2023-10-18T22:30:30.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.363+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2801621728 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fadc801d8e0 con 0x7fadd40f77d0 2023-10-18T22:30:30.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.363+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2801621728 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadc801c480 con 0x7fadd40f77d0 2023-10-18T22:30:30.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.363+0000 7fadd3fff700 1 -- 172.21.15.8:0/2801621728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd410a4a0 con 0x7fadd40f77d0 2023-10-18T22:30:30.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.363+0000 7fadd3fff700 1 -- 172.21.15.8:0/2801621728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd410aa00 con 0x7fadd40f77d0 2023-10-18T22:30:30.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.364+0000 7fadd3fff700 1 -- 172.21.15.8:0/2801621728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd4045ad0 con 0x7fadd40f77d0 2023-10-18T22:30:30.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.365+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2801621728 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fadc801da50 con 0x7fadd40f77d0 2023-10-18T22:30:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.366+0000 7fadbb7fe700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadbc060f70 0x7fadbc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.366+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2801621728 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fadc807e890 con 0x7fadd40f77d0 2023-10-18T22:30:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.366+0000 7fadd2ffd700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadbc060f70 0x7fadbc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.367+0000 7fadd2ffd700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadbc060f70 0x7fadbc063430 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7fadd40f7630 tx=0x7fadc4009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:30.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.370+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2801621728 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fadc8051e70 con 0x7fadd40f77d0 2023-10-18T22:30:30.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.571+0000 7fadd3fff700 1 -- 172.21.15.8:0/2801621728 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadd40feda0 con 0x7fadbc060f70 2023-10-18T22:30:30.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.572+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2801621728 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fadd40feda0 con 0x7fadbc060f70 2023-10-18T22:30:30.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 -- 172.21.15.8:0/2801621728 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadbc060f70 msgr2=0x7fadbc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadbc060f70 0x7fadbc063430 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7fadd40f7630 tx=0x7fadc4009040).stop 2023-10-18T22:30:30.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 -- 172.21.15.8:0/2801621728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadd40f77d0 msgr2=0x7fadd4109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadd40f77d0 0x7fadd4109470 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7fadc8009830 tx=0x7fadc8009b30).stop 2023-10-18T22:30:30.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 -- 172.21.15.8:0/2801621728 shutdown_connections 2023-10-18T22:30:30.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fadbc060f70 0x7fadbc063430 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd40f6530 0x7fadd4108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 --2- 172.21.15.8:0/2801621728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadd40f77d0 0x7fadd4109470 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 -- 172.21.15.8:0/2801621728 >> 172.21.15.8:0/2801621728 conn(0x7fadd40f1c90 msgr2=0x7fadd406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:30.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 -- 172.21.15.8:0/2801621728 shutdown_connections 2023-10-18T22:30:30.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.575+0000 7fadd3fff700 1 -- 172.21.15.8:0/2801621728 wait complete. 2023-10-18T22:30:30.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:28.893775+0000 mgr.smithi008.flmjzp (mgr.14640) 5487 : cluster [DBG] pgmap v3763: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:30:28.922953+0000 mgr.smithi008.flmjzp (mgr.14640) 5488 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:28.923529+0000 mgr.smithi008.flmjzp (mgr.14640) 5489 : cluster [DBG] pgmap v3764: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:28.923926+0000 mgr.smithi008.flmjzp (mgr.14640) 5490 : cluster [DBG] pgmap v3765: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:30.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:30:28.945631+0000 mgr.smithi008.flmjzp (mgr.14640) 5491 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:30.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.712+0000 7fec8ffff700 1 -- 172.21.15.8:0/1467122432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec900f6530 msgr2=0x7fec900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.712+0000 7fec8ffff700 1 --2- 172.21.15.8:0/1467122432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec900f6530 0x7fec900f6950 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 rx=0x7fec80004660 tx=0x7fec80009b30).stop 2023-10-18T22:30:30.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.713+0000 7fec8ffff700 1 -- 172.21.15.8:0/1467122432 shutdown_connections 2023-10-18T22:30:30.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.713+0000 7fec8ffff700 1 --2- 172.21.15.8:0/1467122432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec900f77d0 0x7fec900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.713+0000 7fec8ffff700 1 --2- 172.21.15.8:0/1467122432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec900f6530 0x7fec900f6950 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.713+0000 7fec8ffff700 1 -- 172.21.15.8:0/1467122432 >> 172.21.15.8:0/1467122432 conn(0x7fec900f1c90 msgr2=0x7fec900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:30.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.713+0000 7fec8ffff700 1 -- 172.21.15.8:0/1467122432 shutdown_connections 2023-10-18T22:30:30.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.713+0000 7fec8ffff700 1 -- 172.21.15.8:0/1467122432 wait complete. 2023-10-18T22:30:30.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.713+0000 7fec8ffff700 1 Processor -- start 2023-10-18T22:30:30.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.714+0000 7fec8ffff700 1 -- start start 2023-10-18T22:30:30.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.714+0000 7fec8ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec900f6530 0x7fec90108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:30.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.714+0000 7fec8ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec900f77d0 0x7fec901094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:30.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.714+0000 7fec8ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec90109a70 con 0x7fec900f77d0 2023-10-18T22:30:30.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.714+0000 7fec8ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec90109bb0 con 0x7fec900f6530 2023-10-18T22:30:30.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.714+0000 7fec8e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec900f77d0 0x7fec901094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:30.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.714+0000 7fec8e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec900f77d0 0x7fec901094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42076/0 (socket says 172.21.15.8:42076) 2023-10-18T22:30:30.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.714+0000 7fec8effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec900f6530 0x7fec90108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:30.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.714+0000 7fec8e7fc700 1 -- 172.21.15.8:0/2350375529 learned_addr learned my addr 172.21.15.8:0/2350375529 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:30:30.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.715+0000 7fec8e7fc700 1 -- 172.21.15.8:0/2350375529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec900f6530 msgr2=0x7fec90108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.715+0000 7fec8e7fc700 1 --2- 172.21.15.8:0/2350375529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec900f6530 0x7fec90108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.715+0000 7fec8e7fc700 1 -- 172.21.15.8:0/2350375529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80005040 con 0x7fec900f77d0 2023-10-18T22:30:30.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.715+0000 7fec8e7fc700 1 --2- 172.21.15.8:0/2350375529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec900f77d0 0x7fec901094c0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7fec840026d0 tx=0x7fec84009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:30.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.715+0000 7fec777fe700 1 -- 172.21.15.8:0/2350375529 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec840079c0 con 0x7fec900f77d0 2023-10-18T22:30:30.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.715+0000 7fec777fe700 1 -- 172.21.15.8:0/2350375529 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fec8400f040 con 0x7fec900f77d0 2023-10-18T22:30:30.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.715+0000 7fec8ffff700 1 -- 172.21.15.8:0/2350375529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9010a550 con 0x7fec900f77d0 2023-10-18T22:30:30.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.715+0000 7fec777fe700 1 -- 172.21.15.8:0/2350375529 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec84014980 con 0x7fec900f77d0 2023-10-18T22:30:30.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.715+0000 7fec8ffff700 1 -- 172.21.15.8:0/2350375529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9010ab10 con 0x7fec900f77d0 2023-10-18T22:30:30.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.716+0000 7fec8ffff700 1 -- 172.21.15.8:0/2350375529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec90045ad0 con 0x7fec900f77d0 2023-10-18T22:30:30.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.717+0000 7fec777fe700 1 -- 172.21.15.8:0/2350375529 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fec840090d0 con 0x7fec900f77d0 2023-10-18T22:30:30.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.718+0000 7fec777fe700 1 --2- 172.21.15.8:0/2350375529 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec78060f70 0x7fec78063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:30.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.718+0000 7fec777fe700 1 -- 172.21.15.8:0/2350375529 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fec8407c860 con 0x7fec900f77d0 2023-10-18T22:30:30.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.718+0000 7fec8effd700 1 --2- 172.21.15.8:0/2350375529 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec78060f70 0x7fec78063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:30.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.719+0000 7fec8effd700 1 --2- 172.21.15.8:0/2350375529 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec78060f70 0x7fec78063430 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7fec80004630 tx=0x7fec80009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:30.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.722+0000 7fec777fe700 1 -- 172.21.15.8:0/2350375529 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fec8404ffb0 con 0x7fec900f77d0 2023-10-18T22:30:30.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.914+0000 7fec8ffff700 1 -- 172.21.15.8:0/2350375529 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec900fee30 con 0x7fec78060f70 2023-10-18T22:30:30.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.924+0000 7fec777fe700 1 -- 172.21.15.8:0/2350375529 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fec900fee30 con 0x7fec78060f70 2023-10-18T22:30:30.925 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:30:30.926 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (97m) 4m ago 98m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:30:30.926 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (91m) 4m ago 98m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:30:30.926 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (90m) 2m ago 97m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:30:30.926 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (97m) 4m ago 98m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:30:30.927 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 94m - - 2023-10-18T22:30:30.927 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 94m - - 2023-10-18T22:30:30.927 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 94m - - 2023-10-18T22:30:30.927 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 94m - - 2023-10-18T22:30:30.928 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (92m) 4m ago 100m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:30:30.928 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (91m) 2m ago 97m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:30:30.928 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (91m) 4m ago 100m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:30:30.928 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (91m) 2m ago 97m 342M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:30:30.929 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (98m) 4m ago 98m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:30:30.929 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (97m) 2m ago 97m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:30:30.929 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (90m) 4m ago 97m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:30:30.929 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (88m) 4m ago 96m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:30:30.929 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (88m) 4m ago 96m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:30:30.930 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (87m) 2m ago 96m 559M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:30:30.930 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (87m) 2m ago 96m 479M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:30:30.930 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (86m) 2m ago 95m 407M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:30:30.930 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (92m) 4m ago 97m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:30:30.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 -- 172.21.15.8:0/2350375529 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec78060f70 msgr2=0x7fec78063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 --2- 172.21.15.8:0/2350375529 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec78060f70 0x7fec78063430 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7fec80004630 tx=0x7fec80009b30).stop 2023-10-18T22:30:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 -- 172.21.15.8:0/2350375529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec900f77d0 msgr2=0x7fec901094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 --2- 172.21.15.8:0/2350375529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec900f77d0 0x7fec901094c0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7fec840026d0 tx=0x7fec84009de0).stop 2023-10-18T22:30:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 -- 172.21.15.8:0/2350375529 shutdown_connections 2023-10-18T22:30:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 --2- 172.21.15.8:0/2350375529 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fec78060f70 0x7fec78063430 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 --2- 172.21.15.8:0/2350375529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec900f6530 0x7fec90108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 --2- 172.21.15.8:0/2350375529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec900f77d0 0x7fec901094c0 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 -- 172.21.15.8:0/2350375529 >> 172.21.15.8:0/2350375529 conn(0x7fec900f1c90 msgr2=0x7fec9006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 -- 172.21.15.8:0/2350375529 shutdown_connections 2023-10-18T22:30:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:30.926+0000 7fec8ffff700 1 -- 172.21.15.8:0/2350375529 wait complete. 2023-10-18T22:30:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:28.893775+0000 mgr.smithi008.flmjzp (mgr.14640) 5487 : cluster [DBG] pgmap v3763: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:30:28.922953+0000 mgr.smithi008.flmjzp (mgr.14640) 5488 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:28.923529+0000 mgr.smithi008.flmjzp (mgr.14640) 5489 : cluster [DBG] pgmap v3764: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:28.923926+0000 mgr.smithi008.flmjzp (mgr.14640) 5490 : cluster [DBG] pgmap v3765: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:30:28.945631+0000 mgr.smithi008.flmjzp (mgr.14640) 5491 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:31.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.062+0000 7f4fa6153700 1 -- 172.21.15.8:0/2720120455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fa006a3b0 msgr2=0x7f4fa006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:31.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.062+0000 7f4fa6153700 1 --2- 172.21.15.8:0/2720120455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fa006a3b0 0x7f4fa006a830 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 rx=0x7f4f90004660 tx=0x7f4f90009b30).stop 2023-10-18T22:30:31.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.062+0000 7f4fa6153700 1 -- 172.21.15.8:0/2720120455 shutdown_connections 2023-10-18T22:30:31.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.062+0000 7f4fa6153700 1 --2- 172.21.15.8:0/2720120455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fa006a3b0 0x7f4fa006a830 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.062+0000 7f4fa6153700 1 --2- 172.21.15.8:0/2720120455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa006b9c0 0x7f4fa0069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.062+0000 7f4fa6153700 1 -- 172.21.15.8:0/2720120455 >> 172.21.15.8:0/2720120455 conn(0x7f4fa00f1c90 msgr2=0x7f4fa00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:31.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.063+0000 7f4fa6153700 1 -- 172.21.15.8:0/2720120455 shutdown_connections 2023-10-18T22:30:31.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.063+0000 7f4fa6153700 1 -- 172.21.15.8:0/2720120455 wait complete. 2023-10-18T22:30:31.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.063+0000 7f4fa6153700 1 Processor -- start 2023-10-18T22:30:31.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.064+0000 7f4fa6153700 1 -- start start 2023-10-18T22:30:31.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.064+0000 7f4fa6153700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa006a3b0 0x7f4fa0108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:31.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.064+0000 7f4fa6153700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fa006b9c0 0x7f4fa01093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:31.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.064+0000 7f4fa6153700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0109970 con 0x7f4fa006b9c0 2023-10-18T22:30:31.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.064+0000 7f4fa6153700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0109ab0 con 0x7f4fa006a3b0 2023-10-18T22:30:31.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.064+0000 7f4fa4950700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fa006b9c0 0x7f4fa01093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:31.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.064+0000 7f4fa4950700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fa006b9c0 0x7f4fa01093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42102/0 (socket says 172.21.15.8:42102) 2023-10-18T22:30:31.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.064+0000 7f4fa4950700 1 -- 172.21.15.8:0/544434700 learned_addr learned my addr 172.21.15.8:0/544434700 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:30:31.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.064+0000 7f4fa5151700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa006a3b0 0x7f4fa0108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:31.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.065+0000 7f4fa4950700 1 -- 172.21.15.8:0/544434700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa006a3b0 msgr2=0x7f4fa0108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:31.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.065+0000 7f4fa4950700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa006a3b0 0x7f4fa0108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.065+0000 7f4fa4950700 1 -- 172.21.15.8:0/544434700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90005040 con 0x7f4fa006b9c0 2023-10-18T22:30:31.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.065+0000 7f4fa4950700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fa006b9c0 0x7f4fa01093c0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 rx=0x7f4f90004320 tx=0x7f4f9000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:31.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.065+0000 7f4f95ffb700 1 -- 172.21.15.8:0/544434700 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f90019070 con 0x7f4fa006b9c0 2023-10-18T22:30:31.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.065+0000 7f4f95ffb700 1 -- 172.21.15.8:0/544434700 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4f9001e420 con 0x7f4fa006b9c0 2023-10-18T22:30:31.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.065+0000 7f4f95ffb700 1 -- 172.21.15.8:0/544434700 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f90014680 con 0x7f4fa006b9c0 2023-10-18T22:30:31.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.065+0000 7f4fa6153700 1 -- 172.21.15.8:0/544434700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa010a3f0 con 0x7f4fa006b9c0 2023-10-18T22:30:31.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.065+0000 7f4fa6153700 1 -- 172.21.15.8:0/544434700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa010a8d0 con 0x7f4fa006b9c0 2023-10-18T22:30:31.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.066+0000 7f4fa6153700 1 -- 172.21.15.8:0/544434700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa0045ad0 con 0x7f4fa006b9c0 2023-10-18T22:30:31.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.067+0000 7f4f95ffb700 1 -- 172.21.15.8:0/544434700 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4f9001e590 con 0x7f4fa006b9c0 2023-10-18T22:30:31.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.068+0000 7f4f95ffb700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f8c060f70 0x7f4f8c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:31.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.068+0000 7f4f95ffb700 1 -- 172.21.15.8:0/544434700 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4f9007dd10 con 0x7f4fa006b9c0 2023-10-18T22:30:31.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.068+0000 7f4fa5151700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f8c060f70 0x7f4f8c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:31.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.069+0000 7f4fa5151700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f8c060f70 0x7f4f8c063430 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f4f9c009fd0 tx=0x7f4f9c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:31.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.072+0000 7f4f95ffb700 1 -- 172.21.15.8:0/544434700 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4f90051310 con 0x7f4fa006b9c0 2023-10-18T22:30:31.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.327+0000 7f4fa6153700 1 -- 172.21.15.8:0/544434700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4fa010ab40 con 0x7f4fa006b9c0 2023-10-18T22:30:31.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.328+0000 7f4f95ffb700 1 -- 172.21.15.8:0/544434700 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f4f90050f00 con 0x7f4fa006b9c0 2023-10-18T22:30:31.330 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:30:31.330 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:30:31.331 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:30:31.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:30:31.331 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:30:31.331 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:30:31.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:30:31.332 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:30:31.332 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:30:31.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:30:31.332 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:30:31.333 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:30:31.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:30:31.333 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:30:31.333 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:30:31.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:30:31.334 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:30:31.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 -- 172.21.15.8:0/544434700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f8c060f70 msgr2=0x7f4f8c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:31.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f8c060f70 0x7f4f8c063430 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f4f9c009fd0 tx=0x7f4f9c00b040).stop 2023-10-18T22:30:31.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 -- 172.21.15.8:0/544434700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fa006b9c0 msgr2=0x7f4fa01093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:31.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fa006b9c0 0x7f4fa01093c0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 rx=0x7f4f90004320 tx=0x7f4f9000b040).stop 2023-10-18T22:30:31.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 -- 172.21.15.8:0/544434700 shutdown_connections 2023-10-18T22:30:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4f8c060f70 0x7f4f8c063430 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa006a3b0 0x7f4fa0108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 --2- 172.21.15.8:0/544434700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fa006b9c0 0x7f4fa01093c0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 -- 172.21.15.8:0/544434700 >> 172.21.15.8:0/544434700 conn(0x7f4fa00f1c90 msgr2=0x7f4fa00fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:31.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 -- 172.21.15.8:0/544434700 shutdown_connections 2023-10-18T22:30:31.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.330+0000 7f4fa6153700 1 -- 172.21.15.8:0/544434700 wait complete. 2023-10-18T22:30:31.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.466+0000 7f10a481e700 1 -- 172.21.15.8:0/2466541522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a00f6530 msgr2=0x7f10a00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:31.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.466+0000 7f10a481e700 1 --2- 172.21.15.8:0/2466541522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a00f6530 0x7f10a00f6950 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7f1090004660 tx=0x7f1090009b30).stop 2023-10-18T22:30:31.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.466+0000 7f10a481e700 1 -- 172.21.15.8:0/2466541522 shutdown_connections 2023-10-18T22:30:31.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.466+0000 7f10a481e700 1 --2- 172.21.15.8:0/2466541522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10a00f77d0 0x7f10a00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.466+0000 7f10a481e700 1 --2- 172.21.15.8:0/2466541522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a00f6530 0x7f10a00f6950 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.466+0000 7f10a481e700 1 -- 172.21.15.8:0/2466541522 >> 172.21.15.8:0/2466541522 conn(0x7f10a00f1c90 msgr2=0x7f10a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:31.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.467+0000 7f10a481e700 1 -- 172.21.15.8:0/2466541522 shutdown_connections 2023-10-18T22:30:31.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.467+0000 7f10a481e700 1 -- 172.21.15.8:0/2466541522 wait complete. 2023-10-18T22:30:31.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.467+0000 7f10a481e700 1 Processor -- start 2023-10-18T22:30:31.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.468+0000 7f10a481e700 1 -- start start 2023-10-18T22:30:31.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.468+0000 7f10a481e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10a00f6530 0x7f10a0108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:31.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.468+0000 7f10a481e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a00f77d0 0x7f10a01094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:31.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.468+0000 7f10a481e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0109a70 con 0x7f10a00f77d0 2023-10-18T22:30:31.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.468+0000 7f10a481e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0109bb0 con 0x7f10a00f6530 2023-10-18T22:30:31.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.468+0000 7f109e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a00f77d0 0x7f10a01094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:31.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.468+0000 7f109ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10a00f6530 0x7f10a0108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:31.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.468+0000 7f109ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10a00f6530 0x7f10a0108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.8:33236/0 (socket says 172.21.15.8:33236) 2023-10-18T22:30:31.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.468+0000 7f109ed9d700 1 -- 172.21.15.8:0/4138258966 learned_addr learned my addr 172.21.15.8:0/4138258966 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:30:31.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.469+0000 7f109ed9d700 1 -- 172.21.15.8:0/4138258966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a00f77d0 msgr2=0x7f10a01094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:31.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.469+0000 7f109ed9d700 1 --2- 172.21.15.8:0/4138258966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a00f77d0 0x7f10a01094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.469+0000 7f109ed9d700 1 -- 172.21.15.8:0/4138258966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090005040 con 0x7f10a00f6530 2023-10-18T22:30:31.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.469+0000 7f109ed9d700 1 --2- 172.21.15.8:0/4138258966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10a00f6530 0x7f10a0108fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1090007a60 tx=0x7f1090009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:31.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.469+0000 7f10877fe700 1 -- 172.21.15.8:0/4138258966 <== mon.1 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1090018070 con 0x7f10a00f6530 2023-10-18T22:30:31.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.469+0000 7f10a481e700 1 -- 172.21.15.8:0/4138258966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a010a4f0 con 0x7f10a00f6530 2023-10-18T22:30:31.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.469+0000 7f10877fe700 1 -- 172.21.15.8:0/4138258966 <== mon.1 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1090009630 con 0x7f10a00f6530 2023-10-18T22:30:31.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.469+0000 7f10877fe700 1 -- 172.21.15.8:0/4138258966 <== mon.1 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f109001c4d0 con 0x7f10a00f6530 2023-10-18T22:30:31.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.469+0000 7f10a481e700 1 -- 172.21.15.8:0/4138258966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a010aa50 con 0x7f10a00f6530 2023-10-18T22:30:31.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.470+0000 7f10a481e700 1 -- 172.21.15.8:0/4138258966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a0045ad0 con 0x7f10a00f6530 2023-10-18T22:30:31.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.471+0000 7f10877fe700 1 -- 172.21.15.8:0/4138258966 <== mon.1 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f109001d420 con 0x7f10a00f6530 2023-10-18T22:30:31.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.472+0000 7f10877fe700 1 --2- 172.21.15.8:0/4138258966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1088060f70 0x7f1088063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:31.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.472+0000 7f10877fe700 1 -- 172.21.15.8:0/4138258966 <== mon.1 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f109007e560 con 0x7f10a00f6530 2023-10-18T22:30:31.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.472+0000 7f109e59c700 1 --2- 172.21.15.8:0/4138258966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1088060f70 0x7f1088063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:31.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.473+0000 7f109e59c700 1 --2- 172.21.15.8:0/4138258966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1088060f70 0x7f1088063430 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f1094004c40 tx=0x7f109400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:31.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.478+0000 7f10877fe700 1 -- 172.21.15.8:0/4138258966 <== mon.1 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1090051bc0 con 0x7f10a00f6530 2023-10-18T22:30:31.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.708+0000 7f10a481e700 1 -- 172.21.15.8:0/4138258966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f10a00fed90 con 0x7f10a00f6530 2023-10-18T22:30:31.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.709+0000 7f10877fe700 1 -- 172.21.15.8:0/4138258966 <== mon.1 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f10900517b0 con 0x7f10a00f6530 2023-10-18T22:30:31.710 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:30:31.711 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:30:31.711 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:30:31.711 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:30:31.711 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:30:31.712 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:30:31.712 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:30:31.712 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:30:31.712 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:30:31.713 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:30:31.713 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:30:31.713 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:30:31.713 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:30:31.713 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:30:31.714 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:30:31.714 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:30:31.714 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:30:31.714 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:30:31.714 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:30:31.715 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:30:31.715 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:30:31.715 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:30:31.715 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:30:31.716 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:30:31.716 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:30:31.716 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:30:31.716 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:30:31.716 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:30:31.716 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:30:31.717 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:30:31.717 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:30:31.717 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:30:31.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:30:31.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:30:31.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 -- 172.21.15.8:0/4138258966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1088060f70 msgr2=0x7f1088063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:31.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 --2- 172.21.15.8:0/4138258966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1088060f70 0x7f1088063430 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f1094004c40 tx=0x7f109400b040).stop 2023-10-18T22:30:31.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 -- 172.21.15.8:0/4138258966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10a00f6530 msgr2=0x7f10a0108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:31.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 --2- 172.21.15.8:0/4138258966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10a00f6530 0x7f10a0108fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1090007a60 tx=0x7f1090009b30).stop 2023-10-18T22:30:31.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 -- 172.21.15.8:0/4138258966 shutdown_connections 2023-10-18T22:30:31.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 --2- 172.21.15.8:0/4138258966 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1088060f70 0x7f1088063430 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 --2- 172.21.15.8:0/4138258966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10a00f6530 0x7f10a0108fd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 --2- 172.21.15.8:0/4138258966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a00f77d0 0x7f10a01094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 -- 172.21.15.8:0/4138258966 >> 172.21.15.8:0/4138258966 conn(0x7f10a00f1c90 msgr2=0x7f10a006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:31.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 -- 172.21.15.8:0/4138258966 shutdown_connections 2023-10-18T22:30:31.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.711+0000 7f10a481e700 1 -- 172.21.15.8:0/4138258966 wait complete. 2023-10-18T22:30:31.721 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:30:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.849+0000 7f186dc51700 1 -- 172.21.15.8:0/3166833600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18680f77d0 msgr2=0x7f18680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.849+0000 7f186dc51700 1 --2- 172.21.15.8:0/3166833600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18680f77d0 0x7f18680f7c30 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7f1854004660 tx=0x7f1854009b30).stop 2023-10-18T22:30:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.849+0000 7f186dc51700 1 -- 172.21.15.8:0/3166833600 shutdown_connections 2023-10-18T22:30:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.849+0000 7f186dc51700 1 --2- 172.21.15.8:0/3166833600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18680f77d0 0x7f18680f7c30 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.849+0000 7f186dc51700 1 --2- 172.21.15.8:0/3166833600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18680f6530 0x7f18680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.849+0000 7f186dc51700 1 -- 172.21.15.8:0/3166833600 >> 172.21.15.8:0/3166833600 conn(0x7f18680f1c90 msgr2=0x7f18680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.849+0000 7f186dc51700 1 -- 172.21.15.8:0/3166833600 shutdown_connections 2023-10-18T22:30:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.849+0000 7f186dc51700 1 -- 172.21.15.8:0/3166833600 wait complete. 2023-10-18T22:30:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.850+0000 7f186dc51700 1 Processor -- start 2023-10-18T22:30:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.850+0000 7f186dc51700 1 -- start start 2023-10-18T22:30:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.850+0000 7f186dc51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18680f6530 0x7f186806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.850+0000 7f186dc51700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18680f77d0 0x7f1868069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.850+0000 7f186dc51700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186810a960 con 0x7f18680f77d0 2023-10-18T22:30:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.850+0000 7f186dc51700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186810aaa0 con 0x7f18680f6530 2023-10-18T22:30:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.850+0000 7f1867fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18680f77d0 0x7f1868069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f1867fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18680f77d0 0x7f1868069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42146/0 (socket says 172.21.15.8:42146) 2023-10-18T22:30:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f1867fff700 1 -- 172.21.15.8:0/236231278 learned_addr learned my addr 172.21.15.8:0/236231278 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:30:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f186cc4f700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18680f6530 0x7f186806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f1867fff700 1 -- 172.21.15.8:0/236231278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18680f6530 msgr2=0x7f186806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f1867fff700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18680f6530 0x7f186806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f1867fff700 1 -- 172.21.15.8:0/236231278 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854005040 con 0x7f18680f77d0 2023-10-18T22:30:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f1867fff700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18680f77d0 0x7f1868069e20 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7f1854009f50 tx=0x7f1854009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f18657fa700 1 -- 172.21.15.8:0/236231278 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1854018070 con 0x7f18680f77d0 2023-10-18T22:30:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f18657fa700 1 -- 172.21.15.8:0/236231278 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1854009630 con 0x7f18680f77d0 2023-10-18T22:30:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f18657fa700 1 -- 172.21.15.8:0/236231278 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185401c3c0 con 0x7f18680f77d0 2023-10-18T22:30:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.851+0000 7f186dc51700 1 -- 172.21.15.8:0/236231278 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186806a370 con 0x7f18680f77d0 2023-10-18T22:30:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.852+0000 7f186dc51700 1 -- 172.21.15.8:0/236231278 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186806a8d0 con 0x7f18680f77d0 2023-10-18T22:30:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.853+0000 7f186dc51700 1 -- 172.21.15.8:0/236231278 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1868045ad0 con 0x7f18680f77d0 2023-10-18T22:30:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.854+0000 7f18657fa700 1 -- 172.21.15.8:0/236231278 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f185401d420 con 0x7f18680f77d0 2023-10-18T22:30:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.854+0000 7f18657fa700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1858060f70 0x7f1858063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:30:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.855+0000 7f18657fa700 1 -- 172.21.15.8:0/236231278 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f185407e540 con 0x7f18680f77d0 2023-10-18T22:30:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.855+0000 7f186cc4f700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1858060f70 0x7f1858063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:30:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.855+0000 7f186cc4f700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1858060f70 0x7f1858063430 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f186806b730 tx=0x7f185c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:30:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:31.859+0000 7f18657fa700 1 -- 172.21.15.8:0/236231278 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f185404e170 con 0x7f18680f77d0 2023-10-18T22:30:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:30.220506+0000 mgr.smithi008.flmjzp (mgr.14640) 5492 : audit [DBG] from='client.38368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:31.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:30.572925+0000 mgr.smithi008.flmjzp (mgr.14640) 5493 : audit [DBG] from='client.38372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:31.328698+0000 mon.smithi008 (mon.0) 5730 : audit [DBG] from='client.? 172.21.15.8:0/544434700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:30.220506+0000 mgr.smithi008.flmjzp (mgr.14640) 5492 : audit [DBG] from='client.38368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:30.572925+0000 mgr.smithi008.flmjzp (mgr.14640) 5493 : audit [DBG] from='client.38372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:31.328698+0000 mon.smithi008 (mon.0) 5730 : audit [DBG] from='client.? 172.21.15.8:0/544434700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.055+0000 7f186dc51700 1 -- 172.21.15.8:0/236231278 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18680fecc0 con 0x7f1858060f70 2023-10-18T22:30:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.057+0000 7f18657fa700 1 -- 172.21.15.8:0/236231278 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f18680fecc0 con 0x7f1858060f70 2023-10-18T22:30:32.058 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:30:32.058 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:30:32.059 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:30:32.059 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:30:32.059 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:30:32.059 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:30:32.059 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:30:32.059 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:30:32.060 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:30:32.060 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:30:32.060 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:30:32.060 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:30:32.060 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:30:32.061 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:30:32.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.058+0000 7f186dc51700 1 -- 172.21.15.8:0/236231278 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1858060f70 msgr2=0x7f1858063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:32.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.058+0000 7f186dc51700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1858060f70 0x7f1858063430 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f186806b730 tx=0x7f185c00b040).stop 2023-10-18T22:30:32.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.058+0000 7f186dc51700 1 -- 172.21.15.8:0/236231278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18680f77d0 msgr2=0x7f1868069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:30:32.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.058+0000 7f186dc51700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18680f77d0 0x7f1868069e20 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7f1854009f50 tx=0x7f1854009b30).stop 2023-10-18T22:30:32.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.059+0000 7f186dc51700 1 -- 172.21.15.8:0/236231278 shutdown_connections 2023-10-18T22:30:32.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.059+0000 7f186dc51700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1858060f70 0x7f1858063430 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:32.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.059+0000 7f186dc51700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18680f6530 0x7f186806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:32.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.059+0000 7f186dc51700 1 --2- 172.21.15.8:0/236231278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18680f77d0 0x7f1868069e20 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:30:32.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.059+0000 7f186dc51700 1 -- 172.21.15.8:0/236231278 >> 172.21.15.8:0/236231278 conn(0x7f18680f1c90 msgr2=0x7f18680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:30:32.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.059+0000 7f186dc51700 1 -- 172.21.15.8:0/236231278 shutdown_connections 2023-10-18T22:30:32.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:30:32.059+0000 7f186dc51700 1 -- 172.21.15.8:0/236231278 wait complete. 2023-10-18T22:30:32.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:30.915614+0000 mgr.smithi008.flmjzp (mgr.14640) 5494 : audit [DBG] from='client.38376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:30.924489+0000 mgr.smithi008.flmjzp (mgr.14640) 5495 : cluster [DBG] pgmap v3766: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:31.709461+0000 mon.smithi060 (mon.1) 10 : audit [DBG] from='client.? 172.21.15.8:0/4138258966' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:30:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:30.915614+0000 mgr.smithi008.flmjzp (mgr.14640) 5494 : audit [DBG] from='client.38376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:30.924489+0000 mgr.smithi008.flmjzp (mgr.14640) 5495 : cluster [DBG] pgmap v3766: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:31.709461+0000 mon.smithi060 (mon.1) 10 : audit [DBG] from='client.? 172.21.15.8:0/4138258966' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:30:33.867 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:32.056962+0000 mgr.smithi008.flmjzp (mgr.14640) 5496 : audit [DBG] from='client.38388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:32.056962+0000 mgr.smithi008.flmjzp (mgr.14640) 5496 : audit [DBG] from='client.38388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:30:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:32.925188+0000 mgr.smithi008.flmjzp (mgr.14640) 5497 : cluster [DBG] pgmap v3767: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:32.925188+0000 mgr.smithi008.flmjzp (mgr.14640) 5497 : cluster [DBG] pgmap v3767: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:34.925879+0000 mgr.smithi008.flmjzp (mgr.14640) 5498 : cluster [DBG] pgmap v3768: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:34.925879+0000 mgr.smithi008.flmjzp (mgr.14640) 5498 : cluster [DBG] pgmap v3768: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:38.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:36.926719+0000 mgr.smithi008.flmjzp (mgr.14640) 5499 : cluster [DBG] pgmap v3769: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:36.926719+0000 mgr.smithi008.flmjzp (mgr.14640) 5499 : cluster [DBG] pgmap v3769: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:38.956265+0000 mon.smithi008 (mon.0) 5731 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:39.515615+0000 mon.smithi008 (mon.0) 5732 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:30:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:39.516420+0000 mon.smithi008 (mon.0) 5733 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:30:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:39.521890+0000 mon.smithi008 (mon.0) 5734 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:30:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:39.526776+0000 mon.smithi008 (mon.0) 5735 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:39.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:39.529055+0000 mon.smithi008 (mon.0) 5736 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:39.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:39.530271+0000 mon.smithi008 (mon.0) 5737 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:39.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:39.531493+0000 mon.smithi008 (mon.0) 5738 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:39.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:39.532996+0000 mon.smithi008 (mon.0) 5739 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:38.956265+0000 mon.smithi008 (mon.0) 5731 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:39.515615+0000 mon.smithi008 (mon.0) 5732 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:30:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:39.516420+0000 mon.smithi008 (mon.0) 5733 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:30:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:39.521890+0000 mon.smithi008 (mon.0) 5734 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:30:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:39.526776+0000 mon.smithi008 (mon.0) 5735 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:39.529055+0000 mon.smithi008 (mon.0) 5736 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:39.530271+0000 mon.smithi008 (mon.0) 5737 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:39.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:39.531493+0000 mon.smithi008 (mon.0) 5738 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:39.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:39.532996+0000 mon.smithi008 (mon.0) 5739 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:38.927320+0000 mgr.smithi008.flmjzp (mgr.14640) 5500 : cluster [DBG] pgmap v3770: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:30:39.517086+0000 mgr.smithi008.flmjzp (mgr.14640) 5501 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:39.517577+0000 mgr.smithi008.flmjzp (mgr.14640) 5502 : cluster [DBG] pgmap v3771: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:39.517863+0000 mgr.smithi008.flmjzp (mgr.14640) 5503 : cluster [DBG] pgmap v3772: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:30:39.534540+0000 mgr.smithi008.flmjzp (mgr.14640) 5504 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:38.927320+0000 mgr.smithi008.flmjzp (mgr.14640) 5500 : cluster [DBG] pgmap v3770: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:30:39.517086+0000 mgr.smithi008.flmjzp (mgr.14640) 5501 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:39.517577+0000 mgr.smithi008.flmjzp (mgr.14640) 5502 : cluster [DBG] pgmap v3771: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:39.517863+0000 mgr.smithi008.flmjzp (mgr.14640) 5503 : cluster [DBG] pgmap v3772: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:40.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:30:39.534540+0000 mgr.smithi008.flmjzp (mgr.14640) 5504 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:42.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:41.518405+0000 mgr.smithi008.flmjzp (mgr.14640) 5505 : cluster [DBG] pgmap v3773: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:41.518405+0000 mgr.smithi008.flmjzp (mgr.14640) 5505 : cluster [DBG] pgmap v3773: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:43.518955+0000 mgr.smithi008.flmjzp (mgr.14640) 5506 : cluster [DBG] pgmap v3774: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:43.518955+0000 mgr.smithi008.flmjzp (mgr.14640) 5506 : cluster [DBG] pgmap v3774: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:46.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:46 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:45.519557+0000 mgr.smithi008.flmjzp (mgr.14640) 5507 : cluster [DBG] pgmap v3775: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:46.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:46 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:45.519557+0000 mgr.smithi008.flmjzp (mgr.14640) 5507 : cluster [DBG] pgmap v3775: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:48.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:47.520164+0000 mgr.smithi008.flmjzp (mgr.14640) 5508 : cluster [DBG] pgmap v3776: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:47.520164+0000 mgr.smithi008.flmjzp (mgr.14640) 5508 : cluster [DBG] pgmap v3776: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:49.520745+0000 mgr.smithi008.flmjzp (mgr.14640) 5509 : cluster [DBG] pgmap v3777: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:49.544244+0000 mon.smithi008 (mon.0) 5740 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:49.546416+0000 mon.smithi008 (mon.0) 5741 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:30:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:49.547465+0000 mon.smithi008 (mon.0) 5742 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:30:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:30:49.548380+0000 mgr.smithi008.flmjzp (mgr.14640) 5510 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:49.549000+0000 mgr.smithi008.flmjzp (mgr.14640) 5511 : cluster [DBG] pgmap v3778: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:49.549359+0000 mgr.smithi008.flmjzp (mgr.14640) 5512 : cluster [DBG] pgmap v3779: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:49.553926+0000 mon.smithi008 (mon.0) 5743 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:30:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:49.560363+0000 mon.smithi008 (mon.0) 5744 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:49.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:49.563804+0000 mon.smithi008 (mon.0) 5745 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:49.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:49.565839+0000 mon.smithi008 (mon.0) 5746 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:49.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:49.567770+0000 mon.smithi008 (mon.0) 5747 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:49.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:49.570422+0000 mon.smithi008 (mon.0) 5748 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:49.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:30:49.572625+0000 mgr.smithi008.flmjzp (mgr.14640) 5513 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:49.520745+0000 mgr.smithi008.flmjzp (mgr.14640) 5509 : cluster [DBG] pgmap v3777: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:49.544244+0000 mon.smithi008 (mon.0) 5740 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:49.546416+0000 mon.smithi008 (mon.0) 5741 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:30:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:49.547465+0000 mon.smithi008 (mon.0) 5742 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:30:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:30:49.548380+0000 mgr.smithi008.flmjzp (mgr.14640) 5510 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:30:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:49.549000+0000 mgr.smithi008.flmjzp (mgr.14640) 5511 : cluster [DBG] pgmap v3778: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:49.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:49.549359+0000 mgr.smithi008.flmjzp (mgr.14640) 5512 : cluster [DBG] pgmap v3779: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:49.553926+0000 mon.smithi008 (mon.0) 5743 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:30:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:49.560363+0000 mon.smithi008 (mon.0) 5744 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:49.563804+0000 mon.smithi008 (mon.0) 5745 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:49.565839+0000 mon.smithi008 (mon.0) 5746 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:49.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:49.567770+0000 mon.smithi008 (mon.0) 5747 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:49.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:49.570422+0000 mon.smithi008 (mon.0) 5748 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:30:49.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:30:49.572625+0000 mgr.smithi008.flmjzp (mgr.14640) 5513 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:30:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:51.549824+0000 mgr.smithi008.flmjzp (mgr.14640) 5514 : cluster [DBG] pgmap v3780: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:51.549824+0000 mgr.smithi008.flmjzp (mgr.14640) 5514 : cluster [DBG] pgmap v3780: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:53.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:53.550383+0000 mgr.smithi008.flmjzp (mgr.14640) 5515 : cluster [DBG] pgmap v3781: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:53.550383+0000 mgr.smithi008.flmjzp (mgr.14640) 5515 : cluster [DBG] pgmap v3781: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:55.550957+0000 mgr.smithi008.flmjzp (mgr.14640) 5516 : cluster [DBG] pgmap v3782: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:55.550957+0000 mgr.smithi008.flmjzp (mgr.14640) 5516 : cluster [DBG] pgmap v3782: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:57.551653+0000 mgr.smithi008.flmjzp (mgr.14640) 5517 : cluster [DBG] pgmap v3783: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:57.551653+0000 mgr.smithi008.flmjzp (mgr.14640) 5517 : cluster [DBG] pgmap v3783: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:30:59.552258+0000 mgr.smithi008.flmjzp (mgr.14640) 5518 : cluster [DBG] pgmap v3784: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:59.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:30:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:30:59.576858+0000 mon.smithi008 (mon.0) 5749 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:30:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:30:59.552258+0000 mgr.smithi008.flmjzp (mgr.14640) 5518 : cluster [DBG] pgmap v3784: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:30:59.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:30:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:30:59.576858+0000 mon.smithi008 (mon.0) 5749 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:00.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:00.135924+0000 mon.smithi008 (mon.0) 5750 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:00.137051+0000 mon.smithi008 (mon.0) 5751 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:00.137995+0000 mgr.smithi008.flmjzp (mgr.14640) 5519 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:00.138659+0000 mgr.smithi008.flmjzp (mgr.14640) 5520 : cluster [DBG] pgmap v3785: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:00.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:00.139006+0000 mgr.smithi008.flmjzp (mgr.14640) 5521 : cluster [DBG] pgmap v3786: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:00.143378+0000 mon.smithi008 (mon.0) 5752 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:00.149874+0000 mon.smithi008 (mon.0) 5753 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:00.152899+0000 mon.smithi008 (mon.0) 5754 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:00.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:00.154578+0000 mon.smithi008 (mon.0) 5755 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:00.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:00.156144+0000 mon.smithi008 (mon.0) 5756 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:00.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:00.158595+0000 mon.smithi008 (mon.0) 5757 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:00.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:00.160483+0000 mgr.smithi008.flmjzp (mgr.14640) 5522 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:00.135924+0000 mon.smithi008 (mon.0) 5750 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:00.137051+0000 mon.smithi008 (mon.0) 5751 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:00.137995+0000 mgr.smithi008.flmjzp (mgr.14640) 5519 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:00.138659+0000 mgr.smithi008.flmjzp (mgr.14640) 5520 : cluster [DBG] pgmap v3785: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:00.139006+0000 mgr.smithi008.flmjzp (mgr.14640) 5521 : cluster [DBG] pgmap v3786: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:00.143378+0000 mon.smithi008 (mon.0) 5752 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:00.149874+0000 mon.smithi008 (mon.0) 5753 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:00.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:00.152899+0000 mon.smithi008 (mon.0) 5754 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:00.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:00.154578+0000 mon.smithi008 (mon.0) 5755 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:00.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:00.156144+0000 mon.smithi008 (mon.0) 5756 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:00.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:00.158595+0000 mon.smithi008 (mon.0) 5757 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:00.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:00.160483+0000 mgr.smithi008.flmjzp (mgr.14640) 5522 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:02.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.212+0000 7f571359e700 1 -- 172.21.15.8:0/444283781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57140f77d0 msgr2=0x7f57140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:02.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.212+0000 7f571359e700 1 --2- 172.21.15.8:0/444283781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57140f77d0 0x7f57140f7c30 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 rx=0x7f5708004660 tx=0x7f5708009b30).stop 2023-10-18T22:31:02.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.212+0000 7f571359e700 1 -- 172.21.15.8:0/444283781 shutdown_connections 2023-10-18T22:31:02.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.212+0000 7f571359e700 1 --2- 172.21.15.8:0/444283781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57140f77d0 0x7f57140f7c30 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.212+0000 7f571359e700 1 --2- 172.21.15.8:0/444283781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57140f6530 0x7f57140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:31:02.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.212+0000 7f571359e700 1 -- 172.21.15.8:0/444283781 >> 172.21.15.8:0/444283781 conn(0x7f57140f1c90 msgr2=0x7f57140f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:02.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.212+0000 7f571359e700 1 -- 172.21.15.8:0/444283781 shutdown_connections 2023-10-18T22:31:02.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.213+0000 7f571359e700 1 -- 172.21.15.8:0/444283781 wait complete. 2023-10-18T22:31:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.214+0000 7f571359e700 1 Processor -- start 2023-10-18T22:31:02.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.214+0000 7f571359e700 1 -- start start 2023-10-18T22:31:02.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.214+0000 7f571359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57140f6530 0x7f5714106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:02.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.214+0000 7f571359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57140f77d0 0x7f5714107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:02.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.214+0000 7f571359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57141079a0 con 0x7f57140f77d0 2023-10-18T22:31:02.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.214+0000 7f571359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5714108120 con 0x7f57140f6530 2023-10-18T22:31:02.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.215+0000 7f5711d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57140f77d0 0x7f5714107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:02.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.215+0000 7f5711d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57140f77d0 0x7f5714107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38502/0 (socket says 172.21.15.8:38502) 2023-10-18T22:31:02.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.215+0000 7f5711d9b700 1 -- 172.21.15.8:0/331684762 learned_addr learned my addr 172.21.15.8:0/331684762 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:02.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.215+0000 7f571259c700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57140f6530 0x7f5714106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:02.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.215+0000 7f5711d9b700 1 -- 172.21.15.8:0/331684762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57140f6530 msgr2=0x7f5714106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:02.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.215+0000 7f5711d9b700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57140f6530 0x7f5714106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.215+0000 7f5711d9b700 1 -- 172.21.15.8:0/331684762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5708005040 con 0x7f57140f77d0 2023-10-18T22:31:02.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.215+0000 7f5711d9b700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57140f77d0 0x7f5714107310 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f5708009830 tx=0x7f5708009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:02.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.216+0000 7f5702ffd700 1 -- 172.21.15.8:0/331684762 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5708018070 con 0x7f57140f77d0 2023-10-18T22:31:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.216+0000 7f5702ffd700 1 -- 172.21.15.8:0/331684762 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f570801d8e0 con 0x7f57140f77d0 2023-10-18T22:31:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.216+0000 7f571359e700 1 -- 172.21.15.8:0/331684762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5714108340 con 0x7f57140f77d0 2023-10-18T22:31:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.216+0000 7f5702ffd700 1 -- 172.21.15.8:0/331684762 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570801c540 con 0x7f57140f77d0 2023-10-18T22:31:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.216+0000 7f571359e700 1 -- 172.21.15.8:0/331684762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57141088a0 con 0x7f57140f77d0 2023-10-18T22:31:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.217+0000 7f571359e700 1 -- 172.21.15.8:0/331684762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5714045ad0 con 0x7f57140f77d0 2023-10-18T22:31:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.218+0000 7f5702ffd700 1 -- 172.21.15.8:0/331684762 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f570801da50 con 0x7f57140f77d0 2023-10-18T22:31:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.219+0000 7f5702ffd700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f56fc060f70 0x7f56fc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:02.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.219+0000 7f5702ffd700 1 -- 172.21.15.8:0/331684762 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f570807e7c0 con 0x7f57140f77d0 2023-10-18T22:31:02.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.219+0000 7f571259c700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f56fc060f70 0x7f56fc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:02.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.220+0000 7f571259c700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f56fc060f70 0x7f56fc063430 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f5714106b90 tx=0x7f5704008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:02.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.223+0000 7f5702ffd700 1 -- 172.21.15.8:0/331684762 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f570804e3f0 con 0x7f57140f77d0 2023-10-18T22:31:02.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.422+0000 7f571359e700 1 -- 172.21.15.8:0/331684762 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57140feed0 con 0x7f56fc060f70 2023-10-18T22:31:02.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.424+0000 7f5702ffd700 1 -- 172.21.15.8:0/331684762 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f57140feed0 con 0x7f56fc060f70 2023-10-18T22:31:02.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 -- 172.21.15.8:0/331684762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f56fc060f70 msgr2=0x7f56fc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:02.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f56fc060f70 0x7f56fc063430 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f5714106b90 tx=0x7f5704008040).stop 2023-10-18T22:31:02.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 -- 172.21.15.8:0/331684762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57140f77d0 msgr2=0x7f5714107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:02.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57140f77d0 0x7f5714107310 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f5708009830 tx=0x7f5708009b30).stop 2023-10-18T22:31:02.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 -- 172.21.15.8:0/331684762 shutdown_connections 2023-10-18T22:31:02.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f56fc060f70 0x7f56fc063430 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57140f6530 0x7f5714106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 --2- 172.21.15.8:0/331684762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57140f77d0 0x7f5714107310 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 -- 172.21.15.8:0/331684762 >> 172.21.15.8:0/331684762 conn(0x7f57140f1c90 msgr2=0x7f57140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:02.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 -- 172.21.15.8:0/331684762 shutdown_connections 2023-10-18T22:31:02.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.426+0000 7f571359e700 1 -- 172.21.15.8:0/331684762 wait complete. 2023-10-18T22:31:02.442 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:31:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.564+0000 7f1121428700 1 -- 172.21.15.8:0/554341521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f111c0f77d0 msgr2=0x7f111c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.564+0000 7f1121428700 1 --2- 172.21.15.8:0/554341521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f111c0f77d0 0x7f111c0f7c30 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7f1110004660 tx=0x7f1110009b30).stop 2023-10-18T22:31:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.564+0000 7f1121428700 1 -- 172.21.15.8:0/554341521 shutdown_connections 2023-10-18T22:31:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.564+0000 7f1121428700 1 --2- 172.21.15.8:0/554341521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f111c0f77d0 0x7f111c0f7c30 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.564+0000 7f1121428700 1 --2- 172.21.15.8:0/554341521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111c0f6530 0x7f111c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.564+0000 7f1121428700 1 -- 172.21.15.8:0/554341521 >> 172.21.15.8:0/554341521 conn(0x7f111c0f1c90 msgr2=0x7f111c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.564+0000 7f1121428700 1 -- 172.21.15.8:0/554341521 shutdown_connections 2023-10-18T22:31:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.564+0000 7f1121428700 1 -- 172.21.15.8:0/554341521 wait complete. 2023-10-18T22:31:02.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.565+0000 7f1121428700 1 Processor -- start 2023-10-18T22:31:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.565+0000 7f1121428700 1 -- start start 2023-10-18T22:31:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f1121428700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111c0f6530 0x7f111c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f1121428700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f111c0f77d0 0x7f111c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f1121428700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c109970 con 0x7f111c0f77d0 2023-10-18T22:31:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f1121428700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c109ab0 con 0x7f111c0f6530 2023-10-18T22:31:02.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f111b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f111c0f77d0 0x7f111c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:02.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f111b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f111c0f77d0 0x7f111c1093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38512/0 (socket says 172.21.15.8:38512) 2023-10-18T22:31:02.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f111b7fe700 1 -- 172.21.15.8:0/3514901041 learned_addr learned my addr 172.21.15.8:0/3514901041 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:02.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f111bfff700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111c0f6530 0x7f111c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:02.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f111b7fe700 1 -- 172.21.15.8:0/3514901041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111c0f6530 msgr2=0x7f111c108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:02.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f111b7fe700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111c0f6530 0x7f111c108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f111b7fe700 1 -- 172.21.15.8:0/3514901041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1110005040 con 0x7f111c0f77d0 2023-10-18T22:31:02.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.566+0000 7f111bfff700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111c0f6530 0x7f111c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:31:02.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.567+0000 7f111b7fe700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f111c0f77d0 0x7f111c1093c0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7f1110004320 tx=0x7f111000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:02.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.567+0000 7f1118ff9700 1 -- 172.21.15.8:0/3514901041 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1110019070 con 0x7f111c0f77d0 2023-10-18T22:31:02.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.567+0000 7f1121428700 1 -- 172.21.15.8:0/3514901041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c10a3f0 con 0x7f111c0f77d0 2023-10-18T22:31:02.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.567+0000 7f1118ff9700 1 -- 172.21.15.8:0/3514901041 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f111001e420 con 0x7f111c0f77d0 2023-10-18T22:31:02.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.567+0000 7f1118ff9700 1 -- 172.21.15.8:0/3514901041 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1110014660 con 0x7f111c0f77d0 2023-10-18T22:31:02.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.567+0000 7f1121428700 1 -- 172.21.15.8:0/3514901041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c10a8d0 con 0x7f111c0f77d0 2023-10-18T22:31:02.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.568+0000 7f1121428700 1 -- 172.21.15.8:0/3514901041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c045ad0 con 0x7f111c0f77d0 2023-10-18T22:31:02.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.569+0000 7f1118ff9700 1 -- 172.21.15.8:0/3514901041 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f111001e590 con 0x7f111c0f77d0 2023-10-18T22:31:02.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.570+0000 7f1118ff9700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1104060f70 0x7f1104063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:02.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.570+0000 7f1118ff9700 1 -- 172.21.15.8:0/3514901041 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f111007dec0 con 0x7f111c0f77d0 2023-10-18T22:31:02.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.570+0000 7f111bfff700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1104060f70 0x7f1104063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:02.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.571+0000 7f111bfff700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1104060f70 0x7f1104063430 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f110c009da0 tx=0x7f110c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:02.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.574+0000 7f1118ff9700 1 -- 172.21.15.8:0/3514901041 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1110051440 con 0x7f111c0f77d0 2023-10-18T22:31:02.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.771+0000 7f1121428700 1 -- 172.21.15.8:0/3514901041 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f111c0fee30 con 0x7f1104060f70 2023-10-18T22:31:02.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.773+0000 7f1118ff9700 1 -- 172.21.15.8:0/3514901041 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f111c0fee30 con 0x7f1104060f70 2023-10-18T22:31:02.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 -- 172.21.15.8:0/3514901041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1104060f70 msgr2=0x7f1104063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:02.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1104060f70 0x7f1104063430 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f110c009da0 tx=0x7f110c00b040).stop 2023-10-18T22:31:02.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 -- 172.21.15.8:0/3514901041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f111c0f77d0 msgr2=0x7f111c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:02.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f111c0f77d0 0x7f111c1093c0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7f1110004320 tx=0x7f111000b040).stop 2023-10-18T22:31:02.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 -- 172.21.15.8:0/3514901041 shutdown_connections 2023-10-18T22:31:02.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1104060f70 0x7f1104063430 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111c0f6530 0x7f111c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 --2- 172.21.15.8:0/3514901041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f111c0f77d0 0x7f111c1093c0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 -- 172.21.15.8:0/3514901041 >> 172.21.15.8:0/3514901041 conn(0x7f111c0f1c90 msgr2=0x7f111c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:02.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 -- 172.21.15.8:0/3514901041 shutdown_connections 2023-10-18T22:31:02.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.775+0000 7f1121428700 1 -- 172.21.15.8:0/3514901041 wait complete. 2023-10-18T22:31:02.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.912+0000 7f5d3f042700 1 -- 172.21.15.8:0/2644342341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d38060270 msgr2=0x7f5d380f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.912+0000 7f5d3f042700 1 --2- 172.21.15.8:0/2644342341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d38060270 0x7f5d380f91b0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7f5d34004660 tx=0x7f5d34009b30).stop 2023-10-18T22:31:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.913+0000 7f5d3f042700 1 -- 172.21.15.8:0/2644342341 shutdown_connections 2023-10-18T22:31:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.913+0000 7f5d3f042700 1 --2- 172.21.15.8:0/2644342341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380f96a0 0x7f5d380fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.913+0000 7f5d3f042700 1 --2- 172.21.15.8:0/2644342341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d38060270 0x7f5d380f91b0 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.913+0000 7f5d3f042700 1 -- 172.21.15.8:0/2644342341 >> 172.21.15.8:0/2644342341 conn(0x7f5d380f0b90 msgr2=0x7f5d380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:02.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.913+0000 7f5d3f042700 1 -- 172.21.15.8:0/2644342341 shutdown_connections 2023-10-18T22:31:02.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.913+0000 7f5d3f042700 1 -- 172.21.15.8:0/2644342341 wait complete. 2023-10-18T22:31:02.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.913+0000 7f5d3f042700 1 Processor -- start 2023-10-18T22:31:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.914+0000 7f5d3f042700 1 -- start start 2023-10-18T22:31:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.914+0000 7f5d3f042700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d38060270 0x7f5d38106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.914+0000 7f5d3f042700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380f96a0 0x7f5d38107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.914+0000 7f5d3f042700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38107900 con 0x7f5d38060270 2023-10-18T22:31:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.914+0000 7f5d3f042700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38108110 con 0x7f5d380f96a0 2023-10-18T22:31:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.914+0000 7f5d3e040700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d38060270 0x7f5d38106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.914+0000 7f5d3e040700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d38060270 0x7f5d38106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38530/0 (socket says 172.21.15.8:38530) 2023-10-18T22:31:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.914+0000 7f5d3e040700 1 -- 172.21.15.8:0/2643968114 learned_addr learned my addr 172.21.15.8:0/2643968114 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.914+0000 7f5d3d83f700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380f96a0 0x7f5d38107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.915+0000 7f5d3e040700 1 -- 172.21.15.8:0/2643968114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380f96a0 msgr2=0x7f5d38107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:02.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.915+0000 7f5d3e040700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380f96a0 0x7f5d38107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:02.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.915+0000 7f5d3e040700 1 -- 172.21.15.8:0/2643968114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34005040 con 0x7f5d38060270 2023-10-18T22:31:02.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.915+0000 7f5d3e040700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d38060270 0x7f5d38106e10 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f5d34009990 tx=0x7f5d34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:02.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.915+0000 7f5d2effd700 1 -- 172.21.15.8:0/2643968114 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d34018070 con 0x7f5d38060270 2023-10-18T22:31:02.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.915+0000 7f5d2effd700 1 -- 172.21.15.8:0/2643968114 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5d3401d8e0 con 0x7f5d38060270 2023-10-18T22:31:02.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.915+0000 7f5d3f042700 1 -- 172.21.15.8:0/2643968114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d38108330 con 0x7f5d38060270 2023-10-18T22:31:02.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.915+0000 7f5d2effd700 1 -- 172.21.15.8:0/2643968114 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d3401c5c0 con 0x7f5d38060270 2023-10-18T22:31:02.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.915+0000 7f5d3f042700 1 -- 172.21.15.8:0/2643968114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d38108890 con 0x7f5d38060270 2023-10-18T22:31:02.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.916+0000 7f5d3f042700 1 -- 172.21.15.8:0/2643968114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d38059100 con 0x7f5d38060270 2023-10-18T22:31:02.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.917+0000 7f5d2effd700 1 -- 172.21.15.8:0/2643968114 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5d3401da50 con 0x7f5d38060270 2023-10-18T22:31:02.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.918+0000 7f5d2effd700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d24060f70 0x7f5d24063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:02.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.918+0000 7f5d2effd700 1 -- 172.21.15.8:0/2643968114 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5d3407e710 con 0x7f5d38060270 2023-10-18T22:31:02.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.918+0000 7f5d3d83f700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d24060f70 0x7f5d24063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:02.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.919+0000 7f5d3d83f700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d24060f70 0x7f5d24063430 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f5d280041d0 tx=0x7f5d28009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:02.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:02.922+0000 7f5d2effd700 1 -- 172.21.15.8:0/2643968114 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5d3404e400 con 0x7f5d38060270 2023-10-18T22:31:03.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.114+0000 7f5d3f042700 1 -- 172.21.15.8:0/2643968114 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d380fed60 con 0x7f5d24060f70 2023-10-18T22:31:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.124+0000 7f5d2effd700 1 -- 172.21.15.8:0/2643968114 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5d380fed60 con 0x7f5d24060f70 2023-10-18T22:31:03.126 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:31:03.126 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (97m) 4m ago 99m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:31:03.126 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (91m) 4m ago 99m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:31:03.126 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (91m) 2m ago 98m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:31:03.126 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (97m) 4m ago 98m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:31:03.127 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 4m ago 95m - - 2023-10-18T22:31:03.127 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 4m ago 95m - - 2023-10-18T22:31:03.127 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 2m ago 95m - - 2023-10-18T22:31:03.127 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 2m ago 95m - - 2023-10-18T22:31:03.127 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (92m) 4m ago 100m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:31:03.128 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (92m) 2m ago 98m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:31:03.128 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (92m) 4m ago 100m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:31:03.128 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (91m) 2m ago 98m 342M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:31:03.128 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (98m) 4m ago 98m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:31:03.128 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (97m) 2m ago 97m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:31:03.129 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (91m) 4m ago 97m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:31:03.129 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (89m) 4m ago 97m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:31:03.129 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (88m) 4m ago 97m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:31:03.129 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (88m) 2m ago 96m 559M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:31:03.130 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (87m) 2m ago 96m 479M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:31:03.130 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (87m) 2m ago 96m 407M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:31:03.130 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (93m) 4m ago 98m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:31:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 -- 172.21.15.8:0/2643968114 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d24060f70 msgr2=0x7f5d24063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d24060f70 0x7f5d24063430 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f5d280041d0 tx=0x7f5d28009040).stop 2023-10-18T22:31:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 -- 172.21.15.8:0/2643968114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d38060270 msgr2=0x7f5d38106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d38060270 0x7f5d38106e10 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f5d34009990 tx=0x7f5d34009b30).stop 2023-10-18T22:31:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 -- 172.21.15.8:0/2643968114 shutdown_connections 2023-10-18T22:31:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5d24060f70 0x7f5d24063430 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d38060270 0x7f5d38106e10 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 --2- 172.21.15.8:0/2643968114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d380f96a0 0x7f5d38107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 -- 172.21.15.8:0/2643968114 >> 172.21.15.8:0/2643968114 conn(0x7f5d380f0b90 msgr2=0x7f5d380f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 -- 172.21.15.8:0/2643968114 shutdown_connections 2023-10-18T22:31:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.126+0000 7f5d3f042700 1 -- 172.21.15.8:0/2643968114 wait complete. 2023-10-18T22:31:03.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.263+0000 7efd12286700 1 -- 172.21.15.8:0/2737225057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0f77d0 msgr2=0x7efd0c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:03.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.263+0000 7efd12286700 1 --2- 172.21.15.8:0/2737225057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0f77d0 0x7efd0c0f7c30 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7efcfc004660 tx=0x7efcfc009b30).stop 2023-10-18T22:31:03.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.263+0000 7efd12286700 1 -- 172.21.15.8:0/2737225057 shutdown_connections 2023-10-18T22:31:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.263+0000 7efd12286700 1 --2- 172.21.15.8:0/2737225057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0f77d0 0x7efd0c0f7c30 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.263+0000 7efd12286700 1 --2- 172.21.15.8:0/2737225057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd0c0f6530 0x7efd0c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.263+0000 7efd12286700 1 -- 172.21.15.8:0/2737225057 >> 172.21.15.8:0/2737225057 conn(0x7efd0c0f1c90 msgr2=0x7efd0c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.263+0000 7efd12286700 1 -- 172.21.15.8:0/2737225057 shutdown_connections 2023-10-18T22:31:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.263+0000 7efd12286700 1 -- 172.21.15.8:0/2737225057 wait complete. 2023-10-18T22:31:03.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.264+0000 7efd12286700 1 Processor -- start 2023-10-18T22:31:03.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.264+0000 7efd12286700 1 -- start start 2023-10-18T22:31:03.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.264+0000 7efd12286700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0f6530 0x7efd0c108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:03.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.264+0000 7efd12286700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd0c0f77d0 0x7efd0c109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:03.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.264+0000 7efd12286700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c1099d0 con 0x7efd0c0f6530 2023-10-18T22:31:03.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.264+0000 7efd12286700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c109b10 con 0x7efd0c0f77d0 2023-10-18T22:31:03.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.265+0000 7efd11284700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0f6530 0x7efd0c108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:03.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.265+0000 7efd11284700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0f6530 0x7efd0c108f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38558/0 (socket says 172.21.15.8:38558) 2023-10-18T22:31:03.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.265+0000 7efd11284700 1 -- 172.21.15.8:0/3395539420 learned_addr learned my addr 172.21.15.8:0/3395539420 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:03.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.265+0000 7efd10a83700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd0c0f77d0 0x7efd0c109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:03.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.265+0000 7efd11284700 1 -- 172.21.15.8:0/3395539420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd0c0f77d0 msgr2=0x7efd0c109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:03.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.265+0000 7efd11284700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd0c0f77d0 0x7efd0c109420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.265+0000 7efd11284700 1 -- 172.21.15.8:0/3395539420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc005040 con 0x7efd0c0f6530 2023-10-18T22:31:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.265+0000 7efd10a83700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd0c0f77d0 0x7efd0c109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:31:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.265+0000 7efd11284700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0f6530 0x7efd0c108f30 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 rx=0x7efd08002700 tx=0x7efd08009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.266+0000 7efd01ffb700 1 -- 172.21.15.8:0/3395539420 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd08009320 con 0x7efd0c0f6530 2023-10-18T22:31:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.266+0000 7efd01ffb700 1 -- 172.21.15.8:0/3395539420 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efd0800f040 con 0x7efd0c0f6530 2023-10-18T22:31:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.266+0000 7efd12286700 1 -- 172.21.15.8:0/3395539420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c10a4b0 con 0x7efd0c0f6530 2023-10-18T22:31:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.266+0000 7efd01ffb700 1 -- 172.21.15.8:0/3395539420 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd08014970 con 0x7efd0c0f6530 2023-10-18T22:31:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.266+0000 7efd12286700 1 -- 172.21.15.8:0/3395539420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c10aa70 con 0x7efd0c0f6530 2023-10-18T22:31:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.267+0000 7efd12286700 1 -- 172.21.15.8:0/3395539420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c045ad0 con 0x7efd0c0f6530 2023-10-18T22:31:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.268+0000 7efd01ffb700 1 -- 172.21.15.8:0/3395539420 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7efd08009480 con 0x7efd0c0f6530 2023-10-18T22:31:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.269+0000 7efd01ffb700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efcf8060f70 0x7efcf8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.269+0000 7efd01ffb700 1 -- 172.21.15.8:0/3395539420 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7efd0807cad0 con 0x7efd0c0f6530 2023-10-18T22:31:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.269+0000 7efd10a83700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efcf8060f70 0x7efcf8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.269+0000 7efd10a83700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efcf8060f70 0x7efcf8063430 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7efcfc005010 tx=0x7efcfc009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:03.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.273+0000 7efd01ffb700 1 -- 172.21.15.8:0/3395539420 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7efd080501f0 con 0x7efd0c0f6530 2023-10-18T22:31:03.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.528+0000 7efd12286700 1 -- 172.21.15.8:0/3395539420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd0c0fee40 con 0x7efd0c0f6530 2023-10-18T22:31:03.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.528+0000 7efd01ffb700 1 -- 172.21.15.8:0/3395539420 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7efd0804fde0 con 0x7efd0c0f6530 2023-10-18T22:31:03.530 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:31:03.530 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:31:03.530 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:31:03.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:31:03.531 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:31:03.531 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:31:03.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:31:03.531 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:31:03.532 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:31:03.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:31:03.532 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:31:03.532 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:31:03.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:31:03.533 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:31:03.533 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:31:03.533 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:31:03.533 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:31:03.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.530+0000 7efd12286700 1 -- 172.21.15.8:0/3395539420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efcf8060f70 msgr2=0x7efcf8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:03.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.530+0000 7efd12286700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efcf8060f70 0x7efcf8063430 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7efcfc005010 tx=0x7efcfc009b30).stop 2023-10-18T22:31:03.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.530+0000 7efd12286700 1 -- 172.21.15.8:0/3395539420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0f6530 msgr2=0x7efd0c108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.530+0000 7efd12286700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0f6530 0x7efd0c108f30 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 rx=0x7efd08002700 tx=0x7efd08009d80).stop 2023-10-18T22:31:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.530+0000 7efd12286700 1 -- 172.21.15.8:0/3395539420 shutdown_connections 2023-10-18T22:31:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.530+0000 7efd12286700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7efcf8060f70 0x7efcf8063430 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.530+0000 7efd12286700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0f6530 0x7efd0c108f30 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.530+0000 7efd12286700 1 --2- 172.21.15.8:0/3395539420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd0c0f77d0 0x7efd0c109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.530+0000 7efd12286700 1 -- 172.21.15.8:0/3395539420 >> 172.21.15.8:0/3395539420 conn(0x7efd0c0f1c90 msgr2=0x7efd0c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.530+0000 7efd12286700 1 -- 172.21.15.8:0/3395539420 shutdown_connections 2023-10-18T22:31:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.531+0000 7efd12286700 1 -- 172.21.15.8:0/3395539420 wait complete. 2023-10-18T22:31:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.668+0000 7f40526c2700 1 -- 172.21.15.8:0/305991137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c0f6530 msgr2=0x7f404c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.668+0000 7f40526c2700 1 --2- 172.21.15.8:0/305991137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c0f6530 0x7f404c0f6950 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7f4048004660 tx=0x7f4048009b30).stop 2023-10-18T22:31:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.668+0000 7f40526c2700 1 -- 172.21.15.8:0/305991137 shutdown_connections 2023-10-18T22:31:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.668+0000 7f40526c2700 1 --2- 172.21.15.8:0/305991137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c0f77d0 0x7f404c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.668+0000 7f40526c2700 1 --2- 172.21.15.8:0/305991137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c0f6530 0x7f404c0f6950 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.668+0000 7f40526c2700 1 -- 172.21.15.8:0/305991137 >> 172.21.15.8:0/305991137 conn(0x7f404c0f1c90 msgr2=0x7f404c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.668+0000 7f40526c2700 1 -- 172.21.15.8:0/305991137 shutdown_connections 2023-10-18T22:31:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.668+0000 7f40526c2700 1 -- 172.21.15.8:0/305991137 wait complete. 2023-10-18T22:31:03.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.669+0000 7f40526c2700 1 Processor -- start 2023-10-18T22:31:03.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.669+0000 7f40526c2700 1 -- start start 2023-10-18T22:31:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40526c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c0f6530 0x7f404c108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40526c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c0f77d0 0x7f404c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40526c2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c109a70 con 0x7f404c0f6530 2023-10-18T22:31:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40526c2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c109bb0 con 0x7f404c0f77d0 2023-10-18T22:31:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40516c0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c0f6530 0x7f404c108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40516c0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c0f6530 0x7f404c108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38584/0 (socket says 172.21.15.8:38584) 2023-10-18T22:31:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40516c0700 1 -- 172.21.15.8:0/1431435568 learned_addr learned my addr 172.21.15.8:0/1431435568 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f4050ebf700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c0f77d0 0x7f404c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40516c0700 1 -- 172.21.15.8:0/1431435568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c0f77d0 msgr2=0x7f404c1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40516c0700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c0f77d0 0x7f404c1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40516c0700 1 -- 172.21.15.8:0/1431435568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4048005040 con 0x7f404c0f6530 2023-10-18T22:31:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.670+0000 7f40516c0700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c0f6530 0x7f404c108fd0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 rx=0x7f4048004e30 tx=0x7f4048009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.671+0000 7f4041ffb700 1 -- 172.21.15.8:0/1431435568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4048018070 con 0x7f404c0f6530 2023-10-18T22:31:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.671+0000 7f4041ffb700 1 -- 172.21.15.8:0/1431435568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4048009630 con 0x7f404c0f6530 2023-10-18T22:31:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.671+0000 7f40526c2700 1 -- 172.21.15.8:0/1431435568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c10a4f0 con 0x7f404c0f6530 2023-10-18T22:31:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.671+0000 7f4041ffb700 1 -- 172.21.15.8:0/1431435568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f404801c3c0 con 0x7f404c0f6530 2023-10-18T22:31:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.671+0000 7f40526c2700 1 -- 172.21.15.8:0/1431435568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c10aa50 con 0x7f404c0f6530 2023-10-18T22:31:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.672+0000 7f40526c2700 1 -- 172.21.15.8:0/1431435568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c045ad0 con 0x7f404c0f6530 2023-10-18T22:31:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.673+0000 7f4041ffb700 1 -- 172.21.15.8:0/1431435568 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f404801d420 con 0x7f404c0f6530 2023-10-18T22:31:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.674+0000 7f4041ffb700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4038060f70 0x7f4038063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.674+0000 7f4041ffb700 1 -- 172.21.15.8:0/1431435568 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f404807e540 con 0x7f404c0f6530 2023-10-18T22:31:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.675+0000 7f4050ebf700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4038060f70 0x7f4038063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.675+0000 7f4050ebf700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4038060f70 0x7f4038063430 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f403c0096c0 tx=0x7f403c009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.679+0000 7f4041ffb700 1 -- 172.21.15.8:0/1431435568 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4048051c50 con 0x7f404c0f6530 2023-10-18T22:31:03.868 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:02.139576+0000 mgr.smithi008.flmjzp (mgr.14640) 5523 : cluster [DBG] pgmap v3787: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:03.868 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:02.424049+0000 mgr.smithi008.flmjzp (mgr.14640) 5524 : audit [DBG] from='client.38392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:03.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.904+0000 7f40526c2700 1 -- 172.21.15.8:0/1431435568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f404c0008d0 con 0x7f404c0f6530 2023-10-18T22:31:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.905+0000 7f4041ffb700 1 -- 172.21.15.8:0/1431435568 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f4048051840 con 0x7f404c0f6530 2023-10-18T22:31:03.907 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:31:03.907 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:31:03.908 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:31:03.908 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:31:03.908 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:31:03.908 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:31:03.909 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:31:03.909 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:31:03.909 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:31:03.909 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:31:03.909 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:31:03.910 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:31:03.910 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:31:03.910 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:31:03.910 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:31:03.910 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:31:03.911 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:31:03.911 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:31:03.911 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:31:03.911 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:31:03.911 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:31:03.914 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:31:03.914 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:31:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 -- 172.21.15.8:0/1431435568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4038060f70 msgr2=0x7f4038063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4038060f70 0x7f4038063430 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f403c0096c0 tx=0x7f403c009be0).stop 2023-10-18T22:31:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 -- 172.21.15.8:0/1431435568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c0f6530 msgr2=0x7f404c108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c0f6530 0x7f404c108fd0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 rx=0x7f4048004e30 tx=0x7f4048009b30).stop 2023-10-18T22:31:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 -- 172.21.15.8:0/1431435568 shutdown_connections 2023-10-18T22:31:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4038060f70 0x7f4038063430 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c0f6530 0x7f404c108fd0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 --2- 172.21.15.8:0/1431435568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c0f77d0 0x7f404c1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 -- 172.21.15.8:0/1431435568 >> 172.21.15.8:0/1431435568 conn(0x7f404c0f1c90 msgr2=0x7f404c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 -- 172.21.15.8:0/1431435568 shutdown_connections 2023-10-18T22:31:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:03.907+0000 7f40526c2700 1 -- 172.21.15.8:0/1431435568 wait complete. 2023-10-18T22:31:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:31:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:02.139576+0000 mgr.smithi008.flmjzp (mgr.14640) 5523 : cluster [DBG] pgmap v3787: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:02.424049+0000 mgr.smithi008.flmjzp (mgr.14640) 5524 : audit [DBG] from='client.38392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:04.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.044+0000 7f1941070700 1 -- 172.21.15.8:0/2425379176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c0f77d0 msgr2=0x7f193c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:04.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.044+0000 7f1941070700 1 --2- 172.21.15.8:0/2425379176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c0f77d0 0x7f193c0f7c30 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 rx=0x7f1930004660 tx=0x7f1930009b30).stop 2023-10-18T22:31:04.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.044+0000 7f1941070700 1 -- 172.21.15.8:0/2425379176 shutdown_connections 2023-10-18T22:31:04.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.044+0000 7f1941070700 1 --2- 172.21.15.8:0/2425379176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c0f77d0 0x7f193c0f7c30 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:04.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.044+0000 7f1941070700 1 --2- 172.21.15.8:0/2425379176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f193c0f6530 0x7f193c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:31:04.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.044+0000 7f1941070700 1 -- 172.21.15.8:0/2425379176 >> 172.21.15.8:0/2425379176 conn(0x7f193c0f1c90 msgr2=0x7f193c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:04.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.044+0000 7f1941070700 1 -- 172.21.15.8:0/2425379176 shutdown_connections 2023-10-18T22:31:04.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.044+0000 7f1941070700 1 -- 172.21.15.8:0/2425379176 wait complete. 2023-10-18T22:31:04.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.045+0000 7f1941070700 1 Processor -- start 2023-10-18T22:31:04.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.045+0000 7f1941070700 1 -- start start 2023-10-18T22:31:04.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f1941070700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f193c0f6530 0x7f193c108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:04.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f1941070700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c0f77d0 0x7f193c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:04.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f1941070700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c109b00 con 0x7f193c0f77d0 2023-10-18T22:31:04.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f1941070700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c10a3b0 con 0x7f193c0f6530 2023-10-18T22:31:04.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f193b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c0f77d0 0x7f193c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:04.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f193b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c0f77d0 0x7f193c1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38604/0 (socket says 172.21.15.8:38604) 2023-10-18T22:31:04.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f193b7fe700 1 -- 172.21.15.8:0/308065994 learned_addr learned my addr 172.21.15.8:0/308065994 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:04.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f193bfff700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f193c0f6530 0x7f193c108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f193b7fe700 1 -- 172.21.15.8:0/308065994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f193c0f6530 msgr2=0x7f193c108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f193b7fe700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f193c0f6530 0x7f193c108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f193b7fe700 1 -- 172.21.15.8:0/308065994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1930005040 con 0x7f193c0f77d0 2023-10-18T22:31:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.046+0000 7f193b7fe700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c0f77d0 0x7f193c1094c0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 rx=0x7f1930009830 tx=0x7f1930009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:04.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.047+0000 7f1938ff9700 1 -- 172.21.15.8:0/308065994 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1930018070 con 0x7f193c0f77d0 2023-10-18T22:31:04.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.047+0000 7f1938ff9700 1 -- 172.21.15.8:0/308065994 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f193001d8e0 con 0x7f193c0f77d0 2023-10-18T22:31:04.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.047+0000 7f1938ff9700 1 -- 172.21.15.8:0/308065994 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f193001c540 con 0x7f193c0f77d0 2023-10-18T22:31:04.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.047+0000 7f1941070700 1 -- 172.21.15.8:0/308065994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c10a630 con 0x7f193c0f77d0 2023-10-18T22:31:04.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.047+0000 7f1941070700 1 -- 172.21.15.8:0/308065994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c10ab90 con 0x7f193c0f77d0 2023-10-18T22:31:04.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.048+0000 7f1941070700 1 -- 172.21.15.8:0/308065994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c059100 con 0x7f193c0f77d0 2023-10-18T22:31:04.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.049+0000 7f1938ff9700 1 -- 172.21.15.8:0/308065994 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f193001da50 con 0x7f193c0f77d0 2023-10-18T22:31:04.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.050+0000 7f1938ff9700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1924060f70 0x7f1924063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:04.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.050+0000 7f1938ff9700 1 -- 172.21.15.8:0/308065994 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f193007e7c0 con 0x7f193c0f77d0 2023-10-18T22:31:04.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.050+0000 7f193bfff700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1924060f70 0x7f1924063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:04.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.050+0000 7f193bfff700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1924060f70 0x7f1924063430 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f193c0f7630 tx=0x7f192c008040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:04.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.054+0000 7f1938ff9700 1 -- 172.21.15.8:0/308065994 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1930051e20 con 0x7f193c0f77d0 2023-10-18T22:31:04.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.252+0000 7f1941070700 1 -- 172.21.15.8:0/308065994 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f193c0fed60 con 0x7f1924060f70 2023-10-18T22:31:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.254+0000 7f1938ff9700 1 -- 172.21.15.8:0/308065994 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f193c0fed60 con 0x7f1924060f70 2023-10-18T22:31:04.256 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:31:04.256 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:31:04.256 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:31:04.256 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:31:04.257 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:31:04.257 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:31:04.257 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:31:04.258 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:31:04.258 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:31:04.259 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:31:04.259 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:31:04.259 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:31:04.260 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:31:04.260 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:31:04.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 -- 172.21.15.8:0/308065994 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1924060f70 msgr2=0x7f1924063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:04.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1924060f70 0x7f1924063430 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f193c0f7630 tx=0x7f192c008040).stop 2023-10-18T22:31:04.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 -- 172.21.15.8:0/308065994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c0f77d0 msgr2=0x7f193c1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:04.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c0f77d0 0x7f193c1094c0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 rx=0x7f1930009830 tx=0x7f1930009b30).stop 2023-10-18T22:31:04.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 -- 172.21.15.8:0/308065994 shutdown_connections 2023-10-18T22:31:04.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1924060f70 0x7f1924063430 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f193c0f6530 0x7f193c108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 --2- 172.21.15.8:0/308065994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c0f77d0 0x7f193c1094c0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 -- 172.21.15.8:0/308065994 >> 172.21.15.8:0/308065994 conn(0x7f193c0f1c90 msgr2=0x7f193c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 -- 172.21.15.8:0/308065994 shutdown_connections 2023-10-18T22:31:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:04.256+0000 7f1941070700 1 -- 172.21.15.8:0/308065994 wait complete. 2023-10-18T22:31:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:02.773105+0000 mgr.smithi008.flmjzp (mgr.14640) 5525 : audit [DBG] from='client.38396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:03.115865+0000 mgr.smithi008.flmjzp (mgr.14640) 5526 : audit [DBG] from='client.38400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:03.528838+0000 mon.smithi008 (mon.0) 5758 : audit [DBG] from='client.? 172.21.15.8:0/3395539420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:03.905678+0000 mon.smithi008 (mon.0) 5759 : audit [DBG] from='client.? 172.21.15.8:0/1431435568' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:31:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:02.773105+0000 mgr.smithi008.flmjzp (mgr.14640) 5525 : audit [DBG] from='client.38396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:03.115865+0000 mgr.smithi008.flmjzp (mgr.14640) 5526 : audit [DBG] from='client.38400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:03.528838+0000 mon.smithi008 (mon.0) 5758 : audit [DBG] from='client.? 172.21.15.8:0/3395539420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:03.905678+0000 mon.smithi008 (mon.0) 5759 : audit [DBG] from='client.? 172.21.15.8:0/1431435568' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:31:05.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:04.140040+0000 mgr.smithi008.flmjzp (mgr.14640) 5527 : cluster [DBG] pgmap v3788: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:05.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:04.254102+0000 mgr.smithi008.flmjzp (mgr.14640) 5528 : audit [DBG] from='client.38412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:04.140040+0000 mgr.smithi008.flmjzp (mgr.14640) 5527 : cluster [DBG] pgmap v3788: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:04.254102+0000 mgr.smithi008.flmjzp (mgr.14640) 5528 : audit [DBG] from='client.38412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:07.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:07 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:06.140639+0000 mgr.smithi008.flmjzp (mgr.14640) 5529 : cluster [DBG] pgmap v3789: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:07.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:07 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:06.140639+0000 mgr.smithi008.flmjzp (mgr.14640) 5529 : cluster [DBG] pgmap v3789: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:09.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:09 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:08.141203+0000 mgr.smithi008.flmjzp (mgr.14640) 5530 : cluster [DBG] pgmap v3790: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:09.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:09 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:08.141203+0000 mgr.smithi008.flmjzp (mgr.14640) 5530 : cluster [DBG] pgmap v3790: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:10.171144+0000 mon.smithi008 (mon.0) 5760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:10.173260+0000 mon.smithi008 (mon.0) 5761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:10.174336+0000 mon.smithi008 (mon.0) 5762 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:10.180795+0000 mon.smithi008 (mon.0) 5763 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:10.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:10.187219+0000 mon.smithi008 (mon.0) 5764 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:10.190167+0000 mon.smithi008 (mon.0) 5765 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:10.191868+0000 mon.smithi008 (mon.0) 5766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:10.193588+0000 mon.smithi008 (mon.0) 5767 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:10.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:10.195656+0000 mon.smithi008 (mon.0) 5768 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:10.171144+0000 mon.smithi008 (mon.0) 5760 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:10.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:10.173260+0000 mon.smithi008 (mon.0) 5761 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:10.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:10.174336+0000 mon.smithi008 (mon.0) 5762 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:10.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:10.180795+0000 mon.smithi008 (mon.0) 5763 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:10.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:10.187219+0000 mon.smithi008 (mon.0) 5764 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:10.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:10.190167+0000 mon.smithi008 (mon.0) 5765 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:10.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:10.191868+0000 mon.smithi008 (mon.0) 5766 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:10.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:10.193588+0000 mon.smithi008 (mon.0) 5767 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:10.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:10.195656+0000 mon.smithi008 (mon.0) 5768 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:11.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:10.141987+0000 mgr.smithi008.flmjzp (mgr.14640) 5531 : cluster [DBG] pgmap v3791: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:10.175229+0000 mgr.smithi008.flmjzp (mgr.14640) 5532 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:10.175784+0000 mgr.smithi008.flmjzp (mgr.14640) 5533 : cluster [DBG] pgmap v3792: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:10.176136+0000 mgr.smithi008.flmjzp (mgr.14640) 5534 : cluster [DBG] pgmap v3793: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:10.197569+0000 mgr.smithi008.flmjzp (mgr.14640) 5535 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:10.141987+0000 mgr.smithi008.flmjzp (mgr.14640) 5531 : cluster [DBG] pgmap v3791: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:10.175229+0000 mgr.smithi008.flmjzp (mgr.14640) 5532 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:10.175784+0000 mgr.smithi008.flmjzp (mgr.14640) 5533 : cluster [DBG] pgmap v3792: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:10.176136+0000 mgr.smithi008.flmjzp (mgr.14640) 5534 : cluster [DBG] pgmap v3793: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:10.197569+0000 mgr.smithi008.flmjzp (mgr.14640) 5535 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:13.868 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:12.176720+0000 mgr.smithi008.flmjzp (mgr.14640) 5536 : cluster [DBG] pgmap v3794: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:12.176720+0000 mgr.smithi008.flmjzp (mgr.14640) 5536 : cluster [DBG] pgmap v3794: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:15.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:15 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:14.177221+0000 mgr.smithi008.flmjzp (mgr.14640) 5537 : cluster [DBG] pgmap v3795: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:15.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:15 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:14.177221+0000 mgr.smithi008.flmjzp (mgr.14640) 5537 : cluster [DBG] pgmap v3795: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:17.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:17 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:16.177834+0000 mgr.smithi008.flmjzp (mgr.14640) 5538 : cluster [DBG] pgmap v3796: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:17.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:17 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:16.177834+0000 mgr.smithi008.flmjzp (mgr.14640) 5538 : cluster [DBG] pgmap v3796: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:19.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:19 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:18.178401+0000 mgr.smithi008.flmjzp (mgr.14640) 5539 : cluster [DBG] pgmap v3797: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:19.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:19 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:18.178401+0000 mgr.smithi008.flmjzp (mgr.14640) 5539 : cluster [DBG] pgmap v3797: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:20.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:20.208253+0000 mon.smithi008 (mon.0) 5769 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:20.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:20.210347+0000 mon.smithi008 (mon.0) 5770 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:20.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:20.211305+0000 mon.smithi008 (mon.0) 5771 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:20.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:20.218220+0000 mon.smithi008 (mon.0) 5772 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:20.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:20.224570+0000 mon.smithi008 (mon.0) 5773 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:20.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:20.227770+0000 mon.smithi008 (mon.0) 5774 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:20.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:20.229657+0000 mon.smithi008 (mon.0) 5775 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:20.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:20.231398+0000 mon.smithi008 (mon.0) 5776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:20.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:20.233612+0000 mon.smithi008 (mon.0) 5777 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:20.208253+0000 mon.smithi008 (mon.0) 5769 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:20.210347+0000 mon.smithi008 (mon.0) 5770 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:20.211305+0000 mon.smithi008 (mon.0) 5771 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:20.218220+0000 mon.smithi008 (mon.0) 5772 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:20.224570+0000 mon.smithi008 (mon.0) 5773 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:20.227770+0000 mon.smithi008 (mon.0) 5774 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:20.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:20.229657+0000 mon.smithi008 (mon.0) 5775 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:20.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:20.231398+0000 mon.smithi008 (mon.0) 5776 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:20.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:20.233612+0000 mon.smithi008 (mon.0) 5777 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:21.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:20.178878+0000 mgr.smithi008.flmjzp (mgr.14640) 5540 : cluster [DBG] pgmap v3798: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:20.212141+0000 mgr.smithi008.flmjzp (mgr.14640) 5541 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:20.212716+0000 mgr.smithi008.flmjzp (mgr.14640) 5542 : cluster [DBG] pgmap v3799: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:21.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:20.213051+0000 mgr.smithi008.flmjzp (mgr.14640) 5543 : cluster [DBG] pgmap v3800: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:21.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:21 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:20.235670+0000 mgr.smithi008.flmjzp (mgr.14640) 5544 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:20.178878+0000 mgr.smithi008.flmjzp (mgr.14640) 5540 : cluster [DBG] pgmap v3798: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:20.212141+0000 mgr.smithi008.flmjzp (mgr.14640) 5541 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:20.212716+0000 mgr.smithi008.flmjzp (mgr.14640) 5542 : cluster [DBG] pgmap v3799: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:21.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:20.213051+0000 mgr.smithi008.flmjzp (mgr.14640) 5543 : cluster [DBG] pgmap v3800: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:21.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:21 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:20.235670+0000 mgr.smithi008.flmjzp (mgr.14640) 5544 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:23.868 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:22.213846+0000 mgr.smithi008.flmjzp (mgr.14640) 5545 : cluster [DBG] pgmap v3801: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:22.213846+0000 mgr.smithi008.flmjzp (mgr.14640) 5545 : cluster [DBG] pgmap v3801: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:25.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:25 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:24.214369+0000 mgr.smithi008.flmjzp (mgr.14640) 5546 : cluster [DBG] pgmap v3802: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:25.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:25 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:24.214369+0000 mgr.smithi008.flmjzp (mgr.14640) 5546 : cluster [DBG] pgmap v3802: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:27.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:27 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:26.215002+0000 mgr.smithi008.flmjzp (mgr.14640) 5547 : cluster [DBG] pgmap v3803: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:27.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:27 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:26.215002+0000 mgr.smithi008.flmjzp (mgr.14640) 5547 : cluster [DBG] pgmap v3803: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:29.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:29 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:28.215638+0000 mgr.smithi008.flmjzp (mgr.14640) 5548 : cluster [DBG] pgmap v3804: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:29.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:29 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:28.215638+0000 mgr.smithi008.flmjzp (mgr.14640) 5548 : cluster [DBG] pgmap v3804: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:30.246409+0000 mon.smithi008 (mon.0) 5778 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:30.248625+0000 mon.smithi008 (mon.0) 5779 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:30.249637+0000 mon.smithi008 (mon.0) 5780 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:30.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:30.256485+0000 mon.smithi008 (mon.0) 5781 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:30.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:30.262885+0000 mon.smithi008 (mon.0) 5782 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:30.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:30.266060+0000 mon.smithi008 (mon.0) 5783 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:30.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:30.267866+0000 mon.smithi008 (mon.0) 5784 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:30.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:30.269579+0000 mon.smithi008 (mon.0) 5785 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:30.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:30.271763+0000 mon.smithi008 (mon.0) 5786 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:30.246409+0000 mon.smithi008 (mon.0) 5778 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:30.248625+0000 mon.smithi008 (mon.0) 5779 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:30.249637+0000 mon.smithi008 (mon.0) 5780 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:30.256485+0000 mon.smithi008 (mon.0) 5781 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:30.262885+0000 mon.smithi008 (mon.0) 5782 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:30.266060+0000 mon.smithi008 (mon.0) 5783 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:30.267866+0000 mon.smithi008 (mon.0) 5784 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:30.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:30.269579+0000 mon.smithi008 (mon.0) 5785 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:30.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:30.271763+0000 mon.smithi008 (mon.0) 5786 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:30.216346+0000 mgr.smithi008.flmjzp (mgr.14640) 5549 : cluster [DBG] pgmap v3805: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:30.250552+0000 mgr.smithi008.flmjzp (mgr.14640) 5550 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:30.251167+0000 mgr.smithi008.flmjzp (mgr.14640) 5551 : cluster [DBG] pgmap v3806: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:31.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:30.251400+0000 mgr.smithi008.flmjzp (mgr.14640) 5552 : cluster [DBG] pgmap v3807: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:31.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:31 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:30.273948+0000 mgr.smithi008.flmjzp (mgr.14640) 5553 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:30.216346+0000 mgr.smithi008.flmjzp (mgr.14640) 5549 : cluster [DBG] pgmap v3805: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:31.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:30.250552+0000 mgr.smithi008.flmjzp (mgr.14640) 5550 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:30.251167+0000 mgr.smithi008.flmjzp (mgr.14640) 5551 : cluster [DBG] pgmap v3806: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:30.251400+0000 mgr.smithi008.flmjzp (mgr.14640) 5552 : cluster [DBG] pgmap v3807: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:31.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:31 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:30.273948+0000 mgr.smithi008.flmjzp (mgr.14640) 5553 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:33.869 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:32.251938+0000 mgr.smithi008.flmjzp (mgr.14640) 5554 : cluster [DBG] pgmap v3808: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:32.251938+0000 mgr.smithi008.flmjzp (mgr.14640) 5554 : cluster [DBG] pgmap v3808: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:34.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.409+0000 7f2478f5e700 1 -- 172.21.15.8:0/3044467668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2474060310 msgr2=0x7f24740f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:34.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.409+0000 7f2478f5e700 1 --2- 172.21.15.8:0/3044467668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2474060310 0x7f24740f9120 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7f2464004660 tx=0x7f2464009b30).stop 2023-10-18T22:31:34.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.409+0000 7f2478f5e700 1 -- 172.21.15.8:0/3044467668 shutdown_connections 2023-10-18T22:31:34.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.409+0000 7f2478f5e700 1 --2- 172.21.15.8:0/3044467668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24740f96a0 0x7f24740fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.409+0000 7f2478f5e700 1 --2- 172.21.15.8:0/3044467668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2474060310 0x7f24740f9120 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.409+0000 7f2478f5e700 1 -- 172.21.15.8:0/3044467668 >> 172.21.15.8:0/3044467668 conn(0x7f24740f0ba0 msgr2=0x7f24740f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:34.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.409+0000 7f2478f5e700 1 -- 172.21.15.8:0/3044467668 shutdown_connections 2023-10-18T22:31:34.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.409+0000 7f2478f5e700 1 -- 172.21.15.8:0/3044467668 wait complete. 2023-10-18T22:31:34.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.410+0000 7f2478f5e700 1 Processor -- start 2023-10-18T22:31:34.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.411+0000 7f2478f5e700 1 -- start start 2023-10-18T22:31:34.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.411+0000 7f2478f5e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2474060310 0x7f2474106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:34.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.411+0000 7f2478f5e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24740f96a0 0x7f24741072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:34.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.411+0000 7f2478f5e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24741078b0 con 0x7f24740f96a0 2023-10-18T22:31:34.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.411+0000 7f2478f5e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24741080f0 con 0x7f2474060310 2023-10-18T22:31:34.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.411+0000 7f2472ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24740f96a0 0x7f24741072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:34.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.411+0000 7f2472ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24740f96a0 0x7f24741072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55644/0 (socket says 172.21.15.8:55644) 2023-10-18T22:31:34.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.411+0000 7f2472ffd700 1 -- 172.21.15.8:0/4085081261 learned_addr learned my addr 172.21.15.8:0/4085081261 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:34.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.411+0000 7f24737fe700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2474060310 0x7f2474106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:34.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.412+0000 7f2472ffd700 1 -- 172.21.15.8:0/4085081261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2474060310 msgr2=0x7f2474106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:34.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.412+0000 7f2472ffd700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2474060310 0x7f2474106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.412+0000 7f2472ffd700 1 -- 172.21.15.8:0/4085081261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2464005040 con 0x7f24740f96a0 2023-10-18T22:31:34.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.412+0000 7f24737fe700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2474060310 0x7f2474106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:31:34.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.412+0000 7f2472ffd700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24740f96a0 0x7f24741072b0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f2468002700 tx=0x7f2468009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:34.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.412+0000 7f245bfff700 1 -- 172.21.15.8:0/4085081261 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2468009320 con 0x7f24740f96a0 2023-10-18T22:31:34.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.412+0000 7f245bfff700 1 -- 172.21.15.8:0/4085081261 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f246800f040 con 0x7f24740f96a0 2023-10-18T22:31:34.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.412+0000 7f2478f5e700 1 -- 172.21.15.8:0/4085081261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24741083d0 con 0x7f24740f96a0 2023-10-18T22:31:34.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.412+0000 7f245bfff700 1 -- 172.21.15.8:0/4085081261 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2468014860 con 0x7f24740f96a0 2023-10-18T22:31:34.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.412+0000 7f2478f5e700 1 -- 172.21.15.8:0/4085081261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2474108910 con 0x7f24740f96a0 2023-10-18T22:31:34.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.413+0000 7f2478f5e700 1 -- 172.21.15.8:0/4085081261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2474059100 con 0x7f24740f96a0 2023-10-18T22:31:34.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.414+0000 7f245bfff700 1 -- 172.21.15.8:0/4085081261 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f24680077b0 con 0x7f24740f96a0 2023-10-18T22:31:34.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.415+0000 7f245bfff700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f245c060f70 0x7f245c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:34.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.415+0000 7f245bfff700 1 -- 172.21.15.8:0/4085081261 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f246807ceb0 con 0x7f24740f96a0 2023-10-18T22:31:34.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.415+0000 7f24737fe700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f245c060f70 0x7f245c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:34.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.416+0000 7f24737fe700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f245c060f70 0x7f245c063430 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f2464004e30 tx=0x7f2464009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:34.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.419+0000 7f245bfff700 1 -- 172.21.15.8:0/4085081261 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f246804ca60 con 0x7f24740f96a0 2023-10-18T22:31:34.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.620+0000 7f2478f5e700 1 -- 172.21.15.8:0/4085081261 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24740fee60 con 0x7f245c060f70 2023-10-18T22:31:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.621+0000 7f245bfff700 1 -- 172.21.15.8:0/4085081261 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f24740fee60 con 0x7f245c060f70 2023-10-18T22:31:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.623+0000 7f2478f5e700 1 -- 172.21.15.8:0/4085081261 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f245c060f70 msgr2=0x7f245c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.623+0000 7f2478f5e700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f245c060f70 0x7f245c063430 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f2464004e30 tx=0x7f2464009b30).stop 2023-10-18T22:31:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.623+0000 7f2478f5e700 1 -- 172.21.15.8:0/4085081261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24740f96a0 msgr2=0x7f24741072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.623+0000 7f2478f5e700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24740f96a0 0x7f24741072b0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f2468002700 tx=0x7f2468009d60).stop 2023-10-18T22:31:34.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.623+0000 7f2478f5e700 1 -- 172.21.15.8:0/4085081261 shutdown_connections 2023-10-18T22:31:34.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.623+0000 7f2478f5e700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f245c060f70 0x7f245c063430 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.623+0000 7f2478f5e700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2474060310 0x7f2474106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.623+0000 7f2478f5e700 1 --2- 172.21.15.8:0/4085081261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24740f96a0 0x7f24741072b0 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.623+0000 7f2478f5e700 1 -- 172.21.15.8:0/4085081261 >> 172.21.15.8:0/4085081261 conn(0x7f24740f0ba0 msgr2=0x7f24740f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:34.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.624+0000 7f2478f5e700 1 -- 172.21.15.8:0/4085081261 shutdown_connections 2023-10-18T22:31:34.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.624+0000 7f2478f5e700 1 -- 172.21.15.8:0/4085081261 wait complete. 2023-10-18T22:31:34.640 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:31:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.760+0000 7f75f359e700 1 -- 172.21.15.8:0/3845601614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75f40f6530 msgr2=0x7f75f40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.760+0000 7f75f359e700 1 --2- 172.21.15.8:0/3845601614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75f40f6530 0x7f75f40f6950 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 rx=0x7f75e4004660 tx=0x7f75e4009b30).stop 2023-10-18T22:31:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.760+0000 7f75f359e700 1 -- 172.21.15.8:0/3845601614 shutdown_connections 2023-10-18T22:31:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.760+0000 7f75f359e700 1 --2- 172.21.15.8:0/3845601614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40f77d0 0x7f75f40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.760+0000 7f75f359e700 1 --2- 172.21.15.8:0/3845601614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75f40f6530 0x7f75f40f6950 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.760+0000 7f75f359e700 1 -- 172.21.15.8:0/3845601614 >> 172.21.15.8:0/3845601614 conn(0x7f75f40f1c90 msgr2=0x7f75f40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.760+0000 7f75f359e700 1 -- 172.21.15.8:0/3845601614 shutdown_connections 2023-10-18T22:31:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.760+0000 7f75f359e700 1 -- 172.21.15.8:0/3845601614 wait complete. 2023-10-18T22:31:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.761+0000 7f75f359e700 1 Processor -- start 2023-10-18T22:31:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.762+0000 7f75f359e700 1 -- start start 2023-10-18T22:31:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.762+0000 7f75f359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40f6530 0x7f75f406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.762+0000 7f75f359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75f40f77d0 0x7f75f4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.762+0000 7f75f359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f406a380 con 0x7f75f40f77d0 2023-10-18T22:31:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.762+0000 7f75f359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f406a4c0 con 0x7f75f40f6530 2023-10-18T22:31:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.763+0000 7f75f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75f40f77d0 0x7f75f4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.763+0000 7f75f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75f40f77d0 0x7f75f4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55656/0 (socket says 172.21.15.8:55656) 2023-10-18T22:31:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.763+0000 7f75f1d9b700 1 -- 172.21.15.8:0/1197841718 learned_addr learned my addr 172.21.15.8:0/1197841718 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.763+0000 7f75f259c700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40f6530 0x7f75f406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.763+0000 7f75f1d9b700 1 -- 172.21.15.8:0/1197841718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40f6530 msgr2=0x7f75f406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.763+0000 7f75f1d9b700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40f6530 0x7f75f406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.763+0000 7f75f1d9b700 1 -- 172.21.15.8:0/1197841718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e4005040 con 0x7f75f40f77d0 2023-10-18T22:31:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.763+0000 7f75f1d9b700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75f40f77d0 0x7f75f4069e20 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7f75e800e7f0 tx=0x7f75e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.763+0000 7f75e2ffd700 1 -- 172.21.15.8:0/1197841718 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e80092e0 con 0x7f75f40f77d0 2023-10-18T22:31:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.763+0000 7f75e2ffd700 1 -- 172.21.15.8:0/1197841718 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f75e800f040 con 0x7f75f40f77d0 2023-10-18T22:31:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.764+0000 7f75f359e700 1 -- 172.21.15.8:0/1197841718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f406a7a0 con 0x7f75f40f77d0 2023-10-18T22:31:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.764+0000 7f75e2ffd700 1 -- 172.21.15.8:0/1197841718 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e80147e0 con 0x7f75f40f77d0 2023-10-18T22:31:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.764+0000 7f75f359e700 1 -- 172.21.15.8:0/1197841718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f410ed70 con 0x7f75f40f77d0 2023-10-18T22:31:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.765+0000 7f75f359e700 1 -- 172.21.15.8:0/1197841718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f4045ad0 con 0x7f75f40f77d0 2023-10-18T22:31:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.766+0000 7f75e2ffd700 1 -- 172.21.15.8:0/1197841718 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f75e801b030 con 0x7f75f40f77d0 2023-10-18T22:31:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.766+0000 7f75e2ffd700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f75dc060f70 0x7f75dc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.766+0000 7f75e2ffd700 1 -- 172.21.15.8:0/1197841718 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f75e807c740 con 0x7f75f40f77d0 2023-10-18T22:31:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.767+0000 7f75f259c700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f75dc060f70 0x7f75dc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.767+0000 7f75f259c700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f75dc060f70 0x7f75dc063430 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f75e40043d0 tx=0x7f75e400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.771+0000 7f75e2ffd700 1 -- 172.21.15.8:0/1197841718 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f75e804c340 con 0x7f75f40f77d0 2023-10-18T22:31:34.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.968+0000 7f75f359e700 1 -- 172.21.15.8:0/1197841718 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75f4057f10 con 0x7f75dc060f70 2023-10-18T22:31:34.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.969+0000 7f75e2ffd700 1 -- 172.21.15.8:0/1197841718 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f75f4057f10 con 0x7f75dc060f70 2023-10-18T22:31:34.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 -- 172.21.15.8:0/1197841718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f75dc060f70 msgr2=0x7f75dc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f75dc060f70 0x7f75dc063430 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f75e40043d0 tx=0x7f75e400b040).stop 2023-10-18T22:31:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 -- 172.21.15.8:0/1197841718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75f40f77d0 msgr2=0x7f75f4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75f40f77d0 0x7f75f4069e20 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7f75e800e7f0 tx=0x7f75e800b040).stop 2023-10-18T22:31:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 -- 172.21.15.8:0/1197841718 shutdown_connections 2023-10-18T22:31:34.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f75dc060f70 0x7f75dc063430 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40f6530 0x7f75f406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 --2- 172.21.15.8:0/1197841718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75f40f77d0 0x7f75f4069e20 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:34.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 -- 172.21.15.8:0/1197841718 >> 172.21.15.8:0/1197841718 conn(0x7f75f40f1c90 msgr2=0x7f75f40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:34.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 -- 172.21.15.8:0/1197841718 shutdown_connections 2023-10-18T22:31:34.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:34.971+0000 7f75f359e700 1 -- 172.21.15.8:0/1197841718 wait complete. 2023-10-18T22:31:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.108+0000 7fe352e15700 1 -- 172.21.15.8:0/3644982669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c0f6530 msgr2=0x7fe34c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.108+0000 7fe352e15700 1 --2- 172.21.15.8:0/3644982669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c0f6530 0x7fe34c0f6950 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7fe348004660 tx=0x7fe348009b30).stop 2023-10-18T22:31:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.108+0000 7fe352e15700 1 -- 172.21.15.8:0/3644982669 shutdown_connections 2023-10-18T22:31:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.108+0000 7fe352e15700 1 --2- 172.21.15.8:0/3644982669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c0f77d0 0x7fe34c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.108+0000 7fe352e15700 1 --2- 172.21.15.8:0/3644982669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c0f6530 0x7fe34c0f6950 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.108+0000 7fe352e15700 1 -- 172.21.15.8:0/3644982669 >> 172.21.15.8:0/3644982669 conn(0x7fe34c0f1c90 msgr2=0x7fe34c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.108+0000 7fe352e15700 1 -- 172.21.15.8:0/3644982669 shutdown_connections 2023-10-18T22:31:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.108+0000 7fe352e15700 1 -- 172.21.15.8:0/3644982669 wait complete. 2023-10-18T22:31:35.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.109+0000 7fe352e15700 1 Processor -- start 2023-10-18T22:31:35.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.109+0000 7fe352e15700 1 -- start start 2023-10-18T22:31:35.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.110+0000 7fe352e15700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c0f6530 0x7fe34c108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:35.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.110+0000 7fe352e15700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c0f77d0 0x7fe34c109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:35.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.110+0000 7fe352e15700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c109a00 con 0x7fe34c0f77d0 2023-10-18T22:31:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.110+0000 7fe352e15700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c109b40 con 0x7fe34c0f6530 2023-10-18T22:31:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.110+0000 7fe351612700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c0f77d0 0x7fe34c109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.110+0000 7fe351612700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c0f77d0 0x7fe34c109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55672/0 (socket says 172.21.15.8:55672) 2023-10-18T22:31:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.110+0000 7fe351612700 1 -- 172.21.15.8:0/3636545820 learned_addr learned my addr 172.21.15.8:0/3636545820 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.110+0000 7fe351e13700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c0f6530 0x7fe34c108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.111+0000 7fe351612700 1 -- 172.21.15.8:0/3636545820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c0f6530 msgr2=0x7fe34c108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.111+0000 7fe351612700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c0f6530 0x7fe34c108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.111+0000 7fe351612700 1 -- 172.21.15.8:0/3636545820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348005040 con 0x7fe34c0f77d0 2023-10-18T22:31:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.111+0000 7fe351612700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c0f77d0 0x7fe34c109450 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 rx=0x7fe33c00e7f0 tx=0x7fe33c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.111+0000 7fe3427fc700 1 -- 172.21.15.8:0/3636545820 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe33c0092e0 con 0x7fe34c0f77d0 2023-10-18T22:31:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.111+0000 7fe3427fc700 1 -- 172.21.15.8:0/3636545820 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe33c00f040 con 0x7fe34c0f77d0 2023-10-18T22:31:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.111+0000 7fe352e15700 1 -- 172.21.15.8:0/3636545820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c10a4e0 con 0x7fe34c0f77d0 2023-10-18T22:31:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.111+0000 7fe3427fc700 1 -- 172.21.15.8:0/3636545820 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe33c0147e0 con 0x7fe34c0f77d0 2023-10-18T22:31:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.111+0000 7fe352e15700 1 -- 172.21.15.8:0/3636545820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c10aa20 con 0x7fe34c0f77d0 2023-10-18T22:31:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.112+0000 7fe352e15700 1 -- 172.21.15.8:0/3636545820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34c045ad0 con 0x7fe34c0f77d0 2023-10-18T22:31:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.113+0000 7fe3427fc700 1 -- 172.21.15.8:0/3636545820 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe33c01b030 con 0x7fe34c0f77d0 2023-10-18T22:31:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.114+0000 7fe3427fc700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe338060f70 0x7fe338063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.114+0000 7fe3427fc700 1 -- 172.21.15.8:0/3636545820 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe33c07c7f0 con 0x7fe34c0f77d0 2023-10-18T22:31:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.114+0000 7fe351e13700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe338060f70 0x7fe338063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.115+0000 7fe351e13700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe338060f70 0x7fe338063430 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7fe3480043d0 tx=0x7fe34800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.118+0000 7fe3427fc700 1 -- 172.21.15.8:0/3636545820 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe33c04fe80 con 0x7fe34c0f77d0 2023-10-18T22:31:35.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.311+0000 7fe352e15700 1 -- 172.21.15.8:0/3636545820 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe34c10ac40 con 0x7fe338060f70 2023-10-18T22:31:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.320+0000 7fe3427fc700 1 -- 172.21.15.8:0/3636545820 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe34c10ac40 con 0x7fe338060f70 2023-10-18T22:31:35.323 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:31:35.323 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (98m) 5m ago 99m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:31:35.324 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (92m) 5m ago 99m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:31:35.324 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (92m) 3m ago 98m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:31:35.324 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (98m) 5m ago 99m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:31:35.324 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 95m - - 2023-10-18T22:31:35.325 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 95m - - 2023-10-18T22:31:35.325 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 95m - - 2023-10-18T22:31:35.325 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 95m - - 2023-10-18T22:31:35.325 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (93m) 5m ago 101m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:31:35.325 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (92m) 3m ago 98m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:31:35.326 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (92m) 5m ago 101m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:31:35.326 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (92m) 3m ago 98m 342M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:31:35.326 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (99m) 5m ago 99m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:31:35.326 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (98m) 3m ago 98m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:31:35.327 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (91m) 5m ago 98m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:31:35.327 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (89m) 5m ago 97m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:31:35.327 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (89m) 5m ago 97m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:31:35.327 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (88m) 3m ago 97m 559M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:31:35.327 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (88m) 3m ago 97m 479M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:31:35.328 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (87m) 3m ago 96m 407M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:31:35.328 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (93m) 5m ago 98m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:31:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.322+0000 7fe352e15700 1 -- 172.21.15.8:0/3636545820 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe338060f70 msgr2=0x7fe338063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.322+0000 7fe352e15700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe338060f70 0x7fe338063430 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7fe3480043d0 tx=0x7fe34800b040).stop 2023-10-18T22:31:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.322+0000 7fe352e15700 1 -- 172.21.15.8:0/3636545820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c0f77d0 msgr2=0x7fe34c109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.322+0000 7fe352e15700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c0f77d0 0x7fe34c109450 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 rx=0x7fe33c00e7f0 tx=0x7fe33c00b040).stop 2023-10-18T22:31:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.323+0000 7fe352e15700 1 -- 172.21.15.8:0/3636545820 shutdown_connections 2023-10-18T22:31:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.323+0000 7fe352e15700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe338060f70 0x7fe338063430 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.323+0000 7fe352e15700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c0f6530 0x7fe34c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.323+0000 7fe352e15700 1 --2- 172.21.15.8:0/3636545820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe34c0f77d0 0x7fe34c109450 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.323+0000 7fe352e15700 1 -- 172.21.15.8:0/3636545820 >> 172.21.15.8:0/3636545820 conn(0x7fe34c0f1c90 msgr2=0x7fe34c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.323+0000 7fe352e15700 1 -- 172.21.15.8:0/3636545820 shutdown_connections 2023-10-18T22:31:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.323+0000 7fe352e15700 1 -- 172.21.15.8:0/3636545820 wait complete. 2023-10-18T22:31:35.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.458+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3373718284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e00f99e0 msgr2=0x7fb1e00f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:35.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.458+0000 7fb1e4b7c700 1 --2- 172.21.15.8:0/3373718284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e00f99e0 0x7fb1e00f9e40 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7fb1d4004660 tx=0x7fb1d4009b30).stop 2023-10-18T22:31:35.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.458+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3373718284 shutdown_connections 2023-10-18T22:31:35.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.458+0000 7fb1e4b7c700 1 --2- 172.21.15.8:0/3373718284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e00f99e0 0x7fb1e00f9e40 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.458+0000 7fb1e4b7c700 1 --2- 172.21.15.8:0/3373718284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e00f8740 0x7fb1e00f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.458+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3373718284 >> 172.21.15.8:0/3373718284 conn(0x7fb1e00f40e0 msgr2=0x7fb1e00f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:35.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.458+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3373718284 shutdown_connections 2023-10-18T22:31:35.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.458+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3373718284 wait complete. 2023-10-18T22:31:35.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.459+0000 7fb1e4b7c700 1 Processor -- start 2023-10-18T22:31:35.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.459+0000 7fb1e4b7c700 1 -- start start 2023-10-18T22:31:35.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.459+0000 7fb1e4b7c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e00f8740 0x7fb1e0108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:35.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1e4b7c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e00f99e0 0x7fb1e0109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:35.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1e4b7c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e01099e0 con 0x7fb1e00f8740 2023-10-18T22:31:35.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1e4b7c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e0109b20 con 0x7fb1e00f99e0 2023-10-18T22:31:35.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e00f8740 0x7fb1e0108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:35.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1df7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e00f8740 0x7fb1e0108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55704/0 (socket says 172.21.15.8:55704) 2023-10-18T22:31:35.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1df7fe700 1 -- 172.21.15.8:0/3675345783 learned_addr learned my addr 172.21.15.8:0/3675345783 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:35.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1deffd700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e00f99e0 0x7fb1e0109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:35.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1df7fe700 1 -- 172.21.15.8:0/3675345783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e00f99e0 msgr2=0x7fb1e0109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:35.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1df7fe700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e00f99e0 0x7fb1e0109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1df7fe700 1 -- 172.21.15.8:0/3675345783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4005040 con 0x7fb1e00f8740 2023-10-18T22:31:35.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.460+0000 7fb1df7fe700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e00f8740 0x7fb1e0108f40 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 rx=0x7fb1d000e7c0 tx=0x7fb1d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:35.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.461+0000 7fb1c7fff700 1 -- 172.21.15.8:0/3675345783 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1d00092e0 con 0x7fb1e00f8740 2023-10-18T22:31:35.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.461+0000 7fb1c7fff700 1 -- 172.21.15.8:0/3675345783 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb1d000f040 con 0x7fb1e00f8740 2023-10-18T22:31:35.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.461+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3675345783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e010a470 con 0x7fb1e00f8740 2023-10-18T22:31:35.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.461+0000 7fb1c7fff700 1 -- 172.21.15.8:0/3675345783 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1d00147e0 con 0x7fb1e00f8740 2023-10-18T22:31:35.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.461+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3675345783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e010a9b0 con 0x7fb1e00f8740 2023-10-18T22:31:35.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.462+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3675345783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e0045ad0 con 0x7fb1e00f8740 2023-10-18T22:31:35.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.463+0000 7fb1c7fff700 1 -- 172.21.15.8:0/3675345783 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fb1d001b030 con 0x7fb1e00f8740 2023-10-18T22:31:35.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.464+0000 7fb1c7fff700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb1c8060f70 0x7fb1c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:35.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.464+0000 7fb1c7fff700 1 -- 172.21.15.8:0/3675345783 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fb1d007c9b0 con 0x7fb1e00f8740 2023-10-18T22:31:35.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.464+0000 7fb1deffd700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb1c8060f70 0x7fb1c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:35.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.464+0000 7fb1deffd700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb1c8060f70 0x7fb1c8063430 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fb1d40043d0 tx=0x7fb1d400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:35.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.468+0000 7fb1c7fff700 1 -- 172.21.15.8:0/3675345783 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fb1d0050050 con 0x7fb1e00f8740 2023-10-18T22:31:35.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.724+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3675345783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb1e0027a00 con 0x7fb1e00f8740 2023-10-18T22:31:35.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.725+0000 7fb1c7fff700 1 -- 172.21.15.8:0/3675345783 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fb1d0019020 con 0x7fb1e00f8740 2023-10-18T22:31:35.727 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:31:35.728 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:31:35.728 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:31:35.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:31:35.728 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:31:35.729 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:31:35.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:31:35.729 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:31:35.729 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:31:35.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:31:35.730 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:31:35.730 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:31:35.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:31:35.730 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:31:35.730 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:31:35.731 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:31:35.731 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:31:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.726+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3675345783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb1c8060f70 msgr2=0x7fb1c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.726+0000 7fb1e4b7c700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb1c8060f70 0x7fb1c8063430 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fb1d40043d0 tx=0x7fb1d400b040).stop 2023-10-18T22:31:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.726+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3675345783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e00f8740 msgr2=0x7fb1e0108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.726+0000 7fb1e4b7c700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e00f8740 0x7fb1e0108f40 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 rx=0x7fb1d000e7c0 tx=0x7fb1d000b040).stop 2023-10-18T22:31:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.727+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3675345783 shutdown_connections 2023-10-18T22:31:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.727+0000 7fb1e4b7c700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fb1c8060f70 0x7fb1c8063430 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.727+0000 7fb1e4b7c700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e00f8740 0x7fb1e0108f40 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.727+0000 7fb1e4b7c700 1 --2- 172.21.15.8:0/3675345783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e00f99e0 0x7fb1e0109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.727+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3675345783 >> 172.21.15.8:0/3675345783 conn(0x7fb1e00f40e0 msgr2=0x7fb1e00fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.727+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3675345783 shutdown_connections 2023-10-18T22:31:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.727+0000 7fb1e4b7c700 1 -- 172.21.15.8:0/3675345783 wait complete. 2023-10-18T22:31:35.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.864+0000 7f3a3287b700 1 -- 172.21.15.8:0/2415852480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a2c0f77d0 msgr2=0x7f3a2c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:35.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.864+0000 7f3a3287b700 1 --2- 172.21.15.8:0/2415852480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a2c0f77d0 0x7f3a2c0f7c30 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7f3a1c004660 tx=0x7f3a1c009b30).stop 2023-10-18T22:31:35.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.864+0000 7f3a3287b700 1 -- 172.21.15.8:0/2415852480 shutdown_connections 2023-10-18T22:31:35.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.864+0000 7f3a3287b700 1 --2- 172.21.15.8:0/2415852480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a2c0f77d0 0x7f3a2c0f7c30 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.864+0000 7f3a3287b700 1 --2- 172.21.15.8:0/2415852480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0f6530 0x7f3a2c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.864+0000 7f3a3287b700 1 -- 172.21.15.8:0/2415852480 >> 172.21.15.8:0/2415852480 conn(0x7f3a2c0f1c90 msgr2=0x7f3a2c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:35.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.864+0000 7f3a3287b700 1 -- 172.21.15.8:0/2415852480 shutdown_connections 2023-10-18T22:31:35.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.864+0000 7f3a3287b700 1 -- 172.21.15.8:0/2415852480 wait complete. 2023-10-18T22:31:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.865+0000 7f3a3287b700 1 Processor -- start 2023-10-18T22:31:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.865+0000 7f3a3287b700 1 -- start start 2023-10-18T22:31:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.865+0000 7f3a3287b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a2c0f6530 0x7f3a2c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.865+0000 7f3a3287b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0f77d0 0x7f3a2c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.865+0000 7f3a3287b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c10a9d0 con 0x7f3a2c0f6530 2023-10-18T22:31:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.865+0000 7f3a3287b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c10ab10 con 0x7f3a2c0f77d0 2023-10-18T22:31:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.866+0000 7f3a31879700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a2c0f6530 0x7f3a2c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.866+0000 7f3a31879700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a2c0f6530 0x7f3a2c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55726/0 (socket says 172.21.15.8:55726) 2023-10-18T22:31:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.866+0000 7f3a31879700 1 -- 172.21.15.8:0/985278819 learned_addr learned my addr 172.21.15.8:0/985278819 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:35.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.866+0000 7f3a31078700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0f77d0 0x7f3a2c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:35.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.866+0000 7f3a31879700 1 -- 172.21.15.8:0/985278819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0f77d0 msgr2=0x7f3a2c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:35.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.866+0000 7f3a31879700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0f77d0 0x7f3a2c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:35.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.866+0000 7f3a31879700 1 -- 172.21.15.8:0/985278819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c005040 con 0x7f3a2c0f6530 2023-10-18T22:31:35.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.866+0000 7f3a31879700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a2c0f6530 0x7f3a2c06b9a0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f3a28002700 tx=0x7f3a28009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:35.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.867+0000 7f3a227fc700 1 -- 172.21.15.8:0/985278819 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a280079c0 con 0x7f3a2c0f6530 2023-10-18T22:31:35.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.867+0000 7f3a3287b700 1 -- 172.21.15.8:0/985278819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c06a3d0 con 0x7f3a2c0f6530 2023-10-18T22:31:35.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.867+0000 7f3a227fc700 1 -- 172.21.15.8:0/985278819 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3a2800f040 con 0x7f3a2c0f6530 2023-10-18T22:31:35.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.867+0000 7f3a227fc700 1 -- 172.21.15.8:0/985278819 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a28014850 con 0x7f3a2c0f6530 2023-10-18T22:31:35.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.867+0000 7f3a3287b700 1 -- 172.21.15.8:0/985278819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c06a990 con 0x7f3a2c0f6530 2023-10-18T22:31:35.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.868+0000 7f3a3287b700 1 -- 172.21.15.8:0/985278819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c045ad0 con 0x7f3a2c0f6530 2023-10-18T22:31:35.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.869+0000 7f3a227fc700 1 -- 172.21.15.8:0/985278819 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f3a2801b060 con 0x7f3a2c0f6530 2023-10-18T22:31:35.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.869+0000 7f3a227fc700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a18060f70 0x7f3a18063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:35.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.870+0000 7f3a227fc700 1 -- 172.21.15.8:0/985278819 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f3a2807c730 con 0x7f3a2c0f6530 2023-10-18T22:31:35.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.870+0000 7f3a31078700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a18060f70 0x7f3a18063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:35.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.870+0000 7f3a31078700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a18060f70 0x7f3a18063430 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f3a1c004630 tx=0x7f3a1c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:35.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:35.874+0000 7f3a227fc700 1 -- 172.21.15.8:0/985278819 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f3a2804c3a0 con 0x7f3a2c0f6530 2023-10-18T22:31:35.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:34.252418+0000 mgr.smithi008.flmjzp (mgr.14640) 5555 : cluster [DBG] pgmap v3809: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:34.252418+0000 mgr.smithi008.flmjzp (mgr.14640) 5555 : cluster [DBG] pgmap v3809: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:36.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.099+0000 7f3a3287b700 1 -- 172.21.15.8:0/985278819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3a2c06ac10 con 0x7f3a2c0f6530 2023-10-18T22:31:36.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.099+0000 7f3a227fc700 1 -- 172.21.15.8:0/985278819 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f3a2804f9c0 con 0x7f3a2c0f6530 2023-10-18T22:31:36.102 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:31:36.103 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:31:36.103 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:31:36.103 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:31:36.103 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:31:36.104 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:31:36.104 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:31:36.104 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:31:36.104 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:31:36.104 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:31:36.105 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:31:36.105 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:31:36.105 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:31:36.105 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:31:36.105 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:31:36.106 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:31:36.106 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:31:36.106 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:31:36.106 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:31:36.107 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:31:36.107 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:31:36.107 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:31:36.107 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:31:36.108 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:31:36.108 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:31:36.108 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:31:36.108 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:31:36.109 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:31:36.109 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:31:36.109 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:31:36.109 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:31:36.109 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:31:36.110 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:31:36.110 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:31:36.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.101+0000 7f3a3287b700 1 -- 172.21.15.8:0/985278819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a18060f70 msgr2=0x7f3a18063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:36.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.101+0000 7f3a3287b700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a18060f70 0x7f3a18063430 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f3a1c004630 tx=0x7f3a1c009b30).stop 2023-10-18T22:31:36.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.101+0000 7f3a3287b700 1 -- 172.21.15.8:0/985278819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a2c0f6530 msgr2=0x7f3a2c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:36.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.101+0000 7f3a3287b700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a2c0f6530 0x7f3a2c06b9a0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f3a28002700 tx=0x7f3a28009d80).stop 2023-10-18T22:31:36.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.101+0000 7f3a3287b700 1 -- 172.21.15.8:0/985278819 shutdown_connections 2023-10-18T22:31:36.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.101+0000 7f3a3287b700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f3a18060f70 0x7f3a18063430 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:36.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.101+0000 7f3a3287b700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a2c0f6530 0x7f3a2c06b9a0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:36.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.101+0000 7f3a3287b700 1 --2- 172.21.15.8:0/985278819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0f77d0 0x7f3a2c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:36.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.101+0000 7f3a3287b700 1 -- 172.21.15.8:0/985278819 >> 172.21.15.8:0/985278819 conn(0x7f3a2c0f1c90 msgr2=0x7f3a2c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:36.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.102+0000 7f3a3287b700 1 -- 172.21.15.8:0/985278819 shutdown_connections 2023-10-18T22:31:36.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.102+0000 7f3a3287b700 1 -- 172.21.15.8:0/985278819 wait complete. 2023-10-18T22:31:36.113 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:31:36.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.239+0000 7f15a54fd700 1 -- 172.21.15.8:0/1286296186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a006a3b0 msgr2=0x7f15a006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.239+0000 7f15a54fd700 1 --2- 172.21.15.8:0/1286296186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a006a3b0 0x7f15a006a830 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 rx=0x7f1594004660 tx=0x7f1594009b30).stop 2023-10-18T22:31:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.239+0000 7f15a54fd700 1 -- 172.21.15.8:0/1286296186 shutdown_connections 2023-10-18T22:31:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.239+0000 7f15a54fd700 1 --2- 172.21.15.8:0/1286296186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a006a3b0 0x7f15a006a830 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:36.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.239+0000 7f15a54fd700 1 --2- 172.21.15.8:0/1286296186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15a006b9c0 0x7f15a0069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:36.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.239+0000 7f15a54fd700 1 -- 172.21.15.8:0/1286296186 >> 172.21.15.8:0/1286296186 conn(0x7f15a00f1c90 msgr2=0x7f15a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:36.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.239+0000 7f15a54fd700 1 -- 172.21.15.8:0/1286296186 shutdown_connections 2023-10-18T22:31:36.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.239+0000 7f15a54fd700 1 -- 172.21.15.8:0/1286296186 wait complete. 2023-10-18T22:31:36.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.240+0000 7f15a54fd700 1 Processor -- start 2023-10-18T22:31:36.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.240+0000 7f15a54fd700 1 -- start start 2023-10-18T22:31:36.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f15a54fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15a006a3b0 0x7f15a0108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:36.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f15a54fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a006b9c0 0x7f15a01093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:36.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f15a54fd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a0109970 con 0x7f15a006b9c0 2023-10-18T22:31:36.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f15a54fd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a0109ab0 con 0x7f15a006a3b0 2023-10-18T22:31:36.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f159f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a006b9c0 0x7f15a01093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:36.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f159f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a006b9c0 0x7f15a01093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55736/0 (socket says 172.21.15.8:55736) 2023-10-18T22:31:36.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f159f7fe700 1 -- 172.21.15.8:0/3183210462 learned_addr learned my addr 172.21.15.8:0/3183210462 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:31:36.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f159ffff700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15a006a3b0 0x7f15a0108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:36.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f159f7fe700 1 -- 172.21.15.8:0/3183210462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15a006a3b0 msgr2=0x7f15a0108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:36.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f159f7fe700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15a006a3b0 0x7f15a0108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:36.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.241+0000 7f159f7fe700 1 -- 172.21.15.8:0/3183210462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1594005040 con 0x7f15a006b9c0 2023-10-18T22:31:36.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.242+0000 7f159f7fe700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a006b9c0 0x7f15a01093c0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7f1594009990 tx=0x7f1594009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:36.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.242+0000 7f159cff9700 1 -- 172.21.15.8:0/3183210462 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1594018070 con 0x7f15a006b9c0 2023-10-18T22:31:36.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.242+0000 7f159cff9700 1 -- 172.21.15.8:0/3183210462 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1594009630 con 0x7f15a006b9c0 2023-10-18T22:31:36.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.242+0000 7f159cff9700 1 -- 172.21.15.8:0/3183210462 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f159401c400 con 0x7f15a006b9c0 2023-10-18T22:31:36.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.242+0000 7f15a54fd700 1 -- 172.21.15.8:0/3183210462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a010a3f0 con 0x7f15a006b9c0 2023-10-18T22:31:36.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.242+0000 7f15a54fd700 1 -- 172.21.15.8:0/3183210462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a010a900 con 0x7f15a006b9c0 2023-10-18T22:31:36.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.243+0000 7f15a54fd700 1 -- 172.21.15.8:0/3183210462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a0045ad0 con 0x7f15a006b9c0 2023-10-18T22:31:36.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.244+0000 7f159cff9700 1 -- 172.21.15.8:0/3183210462 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f159401d9e0 con 0x7f15a006b9c0 2023-10-18T22:31:36.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.245+0000 7f159cff9700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1588060f70 0x7f1588063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:31:36.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.245+0000 7f159cff9700 1 -- 172.21.15.8:0/3183210462 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f159407e670 con 0x7f15a006b9c0 2023-10-18T22:31:36.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.245+0000 7f159ffff700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1588060f70 0x7f1588063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:31:36.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.246+0000 7f159ffff700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1588060f70 0x7f1588063430 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f1590009740 tx=0x7f1590009c60).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:31:36.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.249+0000 7f159cff9700 1 -- 172.21.15.8:0/3183210462 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f1594051cd0 con 0x7f15a006b9c0 2023-10-18T22:31:36.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.450+0000 7f15a54fd700 1 -- 172.21.15.8:0/3183210462 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15a0100ff0 con 0x7f1588060f70 2023-10-18T22:31:36.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.451+0000 7f159cff9700 1 -- 172.21.15.8:0/3183210462 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f15a0100ff0 con 0x7f1588060f70 2023-10-18T22:31:36.454 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:31:36.454 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:31:36.454 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:31:36.455 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:31:36.455 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:31:36.455 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:31:36.455 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:31:36.455 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:31:36.456 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:31:36.456 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:31:36.456 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:31:36.456 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:31:36.456 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:31:36.457 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:31:36.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 -- 172.21.15.8:0/3183210462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1588060f70 msgr2=0x7f1588063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:36.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1588060f70 0x7f1588063430 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f1590009740 tx=0x7f1590009c60).stop 2023-10-18T22:31:36.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 -- 172.21.15.8:0/3183210462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a006b9c0 msgr2=0x7f15a01093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:31:36.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a006b9c0 0x7f15a01093c0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7f1594009990 tx=0x7f1594009b30).stop 2023-10-18T22:31:36.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 -- 172.21.15.8:0/3183210462 shutdown_connections 2023-10-18T22:31:36.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f1588060f70 0x7f1588063430 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:36.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15a006a3b0 0x7f15a0108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:36.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 --2- 172.21.15.8:0/3183210462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a006b9c0 0x7f15a01093c0 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:31:36.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 -- 172.21.15.8:0/3183210462 >> 172.21.15.8:0/3183210462 conn(0x7f15a00f1c90 msgr2=0x7f15a00fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:31:36.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 -- 172.21.15.8:0/3183210462 shutdown_connections 2023-10-18T22:31:36.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:31:36.454+0000 7f15a54fd700 1 -- 172.21.15.8:0/3183210462 wait complete. 2023-10-18T22:31:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:34.622762+0000 mgr.smithi008.flmjzp (mgr.14640) 5556 : audit [DBG] from='client.38416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:34.970282+0000 mgr.smithi008.flmjzp (mgr.14640) 5557 : audit [DBG] from='client.38420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:35.313565+0000 mgr.smithi008.flmjzp (mgr.14640) 5558 : audit [DBG] from='client.38424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:35.726231+0000 mon.smithi008 (mon.0) 5787 : audit [DBG] from='client.? 172.21.15.8:0/3675345783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:36.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:36.101111+0000 mon.smithi008 (mon.0) 5788 : audit [DBG] from='client.? 172.21.15.8:0/985278819' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:31:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:34.622762+0000 mgr.smithi008.flmjzp (mgr.14640) 5556 : audit [DBG] from='client.38416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:34.970282+0000 mgr.smithi008.flmjzp (mgr.14640) 5557 : audit [DBG] from='client.38420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:35.313565+0000 mgr.smithi008.flmjzp (mgr.14640) 5558 : audit [DBG] from='client.38424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:35.726231+0000 mon.smithi008 (mon.0) 5787 : audit [DBG] from='client.? 172.21.15.8:0/3675345783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:36.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:36.101111+0000 mon.smithi008 (mon.0) 5788 : audit [DBG] from='client.? 172.21.15.8:0/985278819' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:31:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:36.252876+0000 mgr.smithi008.flmjzp (mgr.14640) 5559 : cluster [DBG] pgmap v3810: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:37.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:36.452905+0000 mgr.smithi008.flmjzp (mgr.14640) 5560 : audit [DBG] from='client.38436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:37.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:36.252876+0000 mgr.smithi008.flmjzp (mgr.14640) 5559 : cluster [DBG] pgmap v3810: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:37.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:36.452905+0000 mgr.smithi008.flmjzp (mgr.14640) 5560 : audit [DBG] from='client.38436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:31:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:38.253417+0000 mgr.smithi008.flmjzp (mgr.14640) 5561 : cluster [DBG] pgmap v3811: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:38.253417+0000 mgr.smithi008.flmjzp (mgr.14640) 5561 : cluster [DBG] pgmap v3811: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:40.284074+0000 mon.smithi008 (mon.0) 5789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:40.284074+0000 mon.smithi008 (mon.0) 5789 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:40.253973+0000 mgr.smithi008.flmjzp (mgr.14640) 5562 : cluster [DBG] pgmap v3812: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:40.842116+0000 mon.smithi008 (mon.0) 5790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:40.842893+0000 mon.smithi008 (mon.0) 5791 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:41.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:40.843548+0000 mgr.smithi008.flmjzp (mgr.14640) 5563 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:41.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:40.844046+0000 mgr.smithi008.flmjzp (mgr.14640) 5564 : cluster [DBG] pgmap v3813: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:41.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:40.844238+0000 mgr.smithi008.flmjzp (mgr.14640) 5565 : cluster [DBG] pgmap v3814: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:41.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:40.848217+0000 mon.smithi008 (mon.0) 5792 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:41.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:40.853278+0000 mon.smithi008 (mon.0) 5793 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:41.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:40.855598+0000 mon.smithi008 (mon.0) 5794 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:41.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:40.856849+0000 mon.smithi008 (mon.0) 5795 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:41.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:40.858038+0000 mon.smithi008 (mon.0) 5796 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:41.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:40.859540+0000 mon.smithi008 (mon.0) 5797 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:41.923 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:41 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:40.861086+0000 mgr.smithi008.flmjzp (mgr.14640) 5566 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:40.253973+0000 mgr.smithi008.flmjzp (mgr.14640) 5562 : cluster [DBG] pgmap v3812: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:41.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:40.842116+0000 mon.smithi008 (mon.0) 5790 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:40.842893+0000 mon.smithi008 (mon.0) 5791 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:40.843548+0000 mgr.smithi008.flmjzp (mgr.14640) 5563 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:41.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:40.844046+0000 mgr.smithi008.flmjzp (mgr.14640) 5564 : cluster [DBG] pgmap v3813: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:40.844238+0000 mgr.smithi008.flmjzp (mgr.14640) 5565 : cluster [DBG] pgmap v3814: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:40.848217+0000 mon.smithi008 (mon.0) 5792 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:40.853278+0000 mon.smithi008 (mon.0) 5793 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:40.855598+0000 mon.smithi008 (mon.0) 5794 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:41.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:40.856849+0000 mon.smithi008 (mon.0) 5795 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:41.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:40.858038+0000 mon.smithi008 (mon.0) 5796 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:41.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:40.859540+0000 mon.smithi008 (mon.0) 5797 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:41.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:41 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:40.861086+0000 mgr.smithi008.flmjzp (mgr.14640) 5566 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:44.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:42.844893+0000 mgr.smithi008.flmjzp (mgr.14640) 5567 : cluster [DBG] pgmap v3815: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:44.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:42.844893+0000 mgr.smithi008.flmjzp (mgr.14640) 5567 : cluster [DBG] pgmap v3815: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:46.170 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:44.845387+0000 mgr.smithi008.flmjzp (mgr.14640) 5568 : cluster [DBG] pgmap v3816: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:46.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:44.845387+0000 mgr.smithi008.flmjzp (mgr.14640) 5568 : cluster [DBG] pgmap v3816: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:48.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:48 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:46.845836+0000 mgr.smithi008.flmjzp (mgr.14640) 5569 : cluster [DBG] pgmap v3817: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:48.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:48 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:46.845836+0000 mgr.smithi008.flmjzp (mgr.14640) 5569 : cluster [DBG] pgmap v3817: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:50.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:50 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:48.846374+0000 mgr.smithi008.flmjzp (mgr.14640) 5570 : cluster [DBG] pgmap v3818: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:50.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:50 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:48.846374+0000 mgr.smithi008.flmjzp (mgr.14640) 5570 : cluster [DBG] pgmap v3818: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:50.864209+0000 mon.smithi008 (mon.0) 5798 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:50.866278+0000 mon.smithi008 (mon.0) 5799 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:50.867325+0000 mon.smithi008 (mon.0) 5800 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:50.873929+0000 mon.smithi008 (mon.0) 5801 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:51.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:50.880810+0000 mon.smithi008 (mon.0) 5802 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:50.883763+0000 mon.smithi008 (mon.0) 5803 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:50.885401+0000 mon.smithi008 (mon.0) 5804 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:50.887049+0000 mon.smithi008 (mon.0) 5805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:51.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:31:50.889073+0000 mon.smithi008 (mon.0) 5806 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:50.864209+0000 mon.smithi008 (mon.0) 5798 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:50.866278+0000 mon.smithi008 (mon.0) 5799 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:31:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:50.867325+0000 mon.smithi008 (mon.0) 5800 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:31:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:50.873929+0000 mon.smithi008 (mon.0) 5801 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:31:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:50.880810+0000 mon.smithi008 (mon.0) 5802 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:31:51.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:50.883763+0000 mon.smithi008 (mon.0) 5803 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:51.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:50.885401+0000 mon.smithi008 (mon.0) 5804 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:51.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:50.887049+0000 mon.smithi008 (mon.0) 5805 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:51.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:31:50.889073+0000 mon.smithi008 (mon.0) 5806 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:31:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:50.847076+0000 mgr.smithi008.flmjzp (mgr.14640) 5571 : cluster [DBG] pgmap v3819: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:50.868180+0000 mgr.smithi008.flmjzp (mgr.14640) 5572 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:50.868748+0000 mgr.smithi008.flmjzp (mgr.14640) 5573 : cluster [DBG] pgmap v3820: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:50.868994+0000 mgr.smithi008.flmjzp (mgr.14640) 5574 : cluster [DBG] pgmap v3821: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:52.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:31:50.890953+0000 mgr.smithi008.flmjzp (mgr.14640) 5575 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:50.847076+0000 mgr.smithi008.flmjzp (mgr.14640) 5571 : cluster [DBG] pgmap v3819: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:50.868180+0000 mgr.smithi008.flmjzp (mgr.14640) 5572 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:31:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:50.868748+0000 mgr.smithi008.flmjzp (mgr.14640) 5573 : cluster [DBG] pgmap v3820: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:50.868994+0000 mgr.smithi008.flmjzp (mgr.14640) 5574 : cluster [DBG] pgmap v3821: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:31:50.890953+0000 mgr.smithi008.flmjzp (mgr.14640) 5575 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:31:54.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:52.869698+0000 mgr.smithi008.flmjzp (mgr.14640) 5576 : cluster [DBG] pgmap v3822: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:52.869698+0000 mgr.smithi008.flmjzp (mgr.14640) 5576 : cluster [DBG] pgmap v3822: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:56.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:56 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:54.870313+0000 mgr.smithi008.flmjzp (mgr.14640) 5577 : cluster [DBG] pgmap v3823: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:56.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:56 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:54.870313+0000 mgr.smithi008.flmjzp (mgr.14640) 5577 : cluster [DBG] pgmap v3823: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:58.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:31:58 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:56.871044+0000 mgr.smithi008.flmjzp (mgr.14640) 5578 : cluster [DBG] pgmap v3824: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:31:58.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:31:58 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:56.871044+0000 mgr.smithi008.flmjzp (mgr.14640) 5578 : cluster [DBG] pgmap v3824: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:00.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:00 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:31:58.871767+0000 mgr.smithi008.flmjzp (mgr.14640) 5579 : cluster [DBG] pgmap v3825: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:00.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:00 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:31:58.871767+0000 mgr.smithi008.flmjzp (mgr.14640) 5579 : cluster [DBG] pgmap v3825: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:00.901032+0000 mon.smithi008 (mon.0) 5807 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:01.456074+0000 mon.smithi008 (mon.0) 5808 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:01.457100+0000 mon.smithi008 (mon.0) 5809 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:01.463466+0000 mon.smithi008 (mon.0) 5810 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:01.470342+0000 mon.smithi008 (mon.0) 5811 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:01.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:01.473604+0000 mon.smithi008 (mon.0) 5812 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:01.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:01.475320+0000 mon.smithi008 (mon.0) 5813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:01.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:01.477025+0000 mon.smithi008 (mon.0) 5814 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:01.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:01.479120+0000 mon.smithi008 (mon.0) 5815 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:00.901032+0000 mon.smithi008 (mon.0) 5807 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:01.456074+0000 mon.smithi008 (mon.0) 5808 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:01.457100+0000 mon.smithi008 (mon.0) 5809 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:01.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:01.463466+0000 mon.smithi008 (mon.0) 5810 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:01.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:01.470342+0000 mon.smithi008 (mon.0) 5811 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:01.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:01.473604+0000 mon.smithi008 (mon.0) 5812 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:01.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:01.475320+0000 mon.smithi008 (mon.0) 5813 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:01.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:01.477025+0000 mon.smithi008 (mon.0) 5814 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:01.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:01.479120+0000 mon.smithi008 (mon.0) 5815 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:00.872546+0000 mgr.smithi008.flmjzp (mgr.14640) 5580 : cluster [DBG] pgmap v3826: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:01.457958+0000 mgr.smithi008.flmjzp (mgr.14640) 5581 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:01.458649+0000 mgr.smithi008.flmjzp (mgr.14640) 5582 : cluster [DBG] pgmap v3827: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:02.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:01.458970+0000 mgr.smithi008.flmjzp (mgr.14640) 5583 : cluster [DBG] pgmap v3828: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:02.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:01.481079+0000 mgr.smithi008.flmjzp (mgr.14640) 5584 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:00.872546+0000 mgr.smithi008.flmjzp (mgr.14640) 5580 : cluster [DBG] pgmap v3826: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:01.457958+0000 mgr.smithi008.flmjzp (mgr.14640) 5581 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:01.458649+0000 mgr.smithi008.flmjzp (mgr.14640) 5582 : cluster [DBG] pgmap v3827: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:01.458970+0000 mgr.smithi008.flmjzp (mgr.14640) 5583 : cluster [DBG] pgmap v3828: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:02.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:01.481079+0000 mgr.smithi008.flmjzp (mgr.14640) 5584 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:03.459567+0000 mgr.smithi008.flmjzp (mgr.14640) 5585 : cluster [DBG] pgmap v3829: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:03.459567+0000 mgr.smithi008.flmjzp (mgr.14640) 5585 : cluster [DBG] pgmap v3829: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:06.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.609+0000 7f595759e700 1 -- 172.21.15.8:0/2140922109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59580f77d0 msgr2=0x7f59580f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.609+0000 7f595759e700 1 --2- 172.21.15.8:0/2140922109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59580f77d0 0x7f59580f7c30 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f594c004660 tx=0x7f594c009b30).stop 2023-10-18T22:32:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.609+0000 7f595759e700 1 -- 172.21.15.8:0/2140922109 shutdown_connections 2023-10-18T22:32:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.609+0000 7f595759e700 1 --2- 172.21.15.8:0/2140922109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59580f77d0 0x7f59580f7c30 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.609+0000 7f595759e700 1 --2- 172.21.15.8:0/2140922109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59580f6530 0x7f59580f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:06.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.609+0000 7f595759e700 1 -- 172.21.15.8:0/2140922109 >> 172.21.15.8:0/2140922109 conn(0x7f59580f1c90 msgr2=0x7f59580f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:06.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.610+0000 7f595759e700 1 -- 172.21.15.8:0/2140922109 shutdown_connections 2023-10-18T22:32:06.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.610+0000 7f595759e700 1 -- 172.21.15.8:0/2140922109 wait complete. 2023-10-18T22:32:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.610+0000 7f595759e700 1 Processor -- start 2023-10-18T22:32:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.611+0000 7f595759e700 1 -- start start 2023-10-18T22:32:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.611+0000 7f595759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59580f6530 0x7f5958108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.611+0000 7f595759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59580f77d0 0x7f5958109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.611+0000 7f595759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958109a20 con 0x7f59580f77d0 2023-10-18T22:32:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.611+0000 7f595759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958109b60 con 0x7f59580f6530 2023-10-18T22:32:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.611+0000 7f5955d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59580f77d0 0x7f5958109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.611+0000 7f5955d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59580f77d0 0x7f5958109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39604/0 (socket says 172.21.15.8:39604) 2023-10-18T22:32:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.611+0000 7f5955d9b700 1 -- 172.21.15.8:0/3647713757 learned_addr learned my addr 172.21.15.8:0/3647713757 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f595659c700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59580f6530 0x7f5958108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f5955d9b700 1 -- 172.21.15.8:0/3647713757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59580f6530 msgr2=0x7f5958108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f5955d9b700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59580f6530 0x7f5958108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f5955d9b700 1 -- 172.21.15.8:0/3647713757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c005040 con 0x7f59580f77d0 2023-10-18T22:32:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f595659c700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59580f6530 0x7f5958108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:32:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f5955d9b700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59580f77d0 0x7f5958109470 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 rx=0x7f594c009990 tx=0x7f594c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f5946ffd700 1 -- 172.21.15.8:0/3647713757 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f594c018070 con 0x7f59580f77d0 2023-10-18T22:32:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f5946ffd700 1 -- 172.21.15.8:0/3647713757 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f594c009780 con 0x7f59580f77d0 2023-10-18T22:32:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f595759e700 1 -- 172.21.15.8:0/3647713757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595810a4a0 con 0x7f59580f77d0 2023-10-18T22:32:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f5946ffd700 1 -- 172.21.15.8:0/3647713757 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f594c01c5a0 con 0x7f59580f77d0 2023-10-18T22:32:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.612+0000 7f595759e700 1 -- 172.21.15.8:0/3647713757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595810aa00 con 0x7f59580f77d0 2023-10-18T22:32:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.613+0000 7f595759e700 1 -- 172.21.15.8:0/3647713757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5958045ad0 con 0x7f59580f77d0 2023-10-18T22:32:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.614+0000 7f5946ffd700 1 -- 172.21.15.8:0/3647713757 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f594c01db30 con 0x7f59580f77d0 2023-10-18T22:32:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.615+0000 7f5946ffd700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5940060f70 0x7f5940063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.615+0000 7f5946ffd700 1 -- 172.21.15.8:0/3647713757 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f594c07e860 con 0x7f59580f77d0 2023-10-18T22:32:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.615+0000 7f595659c700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5940060f70 0x7f5940063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:06.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.616+0000 7f595659c700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5940060f70 0x7f5940063430 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f59580f7630 tx=0x7f5948009040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:06.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.620+0000 7f5946ffd700 1 -- 172.21.15.8:0/3647713757 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f594c051ec0 con 0x7f59580f77d0 2023-10-18T22:32:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.819+0000 7f595759e700 1 -- 172.21.15.8:0/3647713757 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59580fedd0 con 0x7f5940060f70 2023-10-18T22:32:06.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.820+0000 7f5946ffd700 1 -- 172.21.15.8:0/3647713757 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f59580fedd0 con 0x7f5940060f70 2023-10-18T22:32:06.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.822+0000 7f595759e700 1 -- 172.21.15.8:0/3647713757 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5940060f70 msgr2=0x7f5940063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:06.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.822+0000 7f595759e700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5940060f70 0x7f5940063430 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f59580f7630 tx=0x7f5948009040).stop 2023-10-18T22:32:06.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.822+0000 7f595759e700 1 -- 172.21.15.8:0/3647713757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59580f77d0 msgr2=0x7f5958109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:06.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.822+0000 7f595759e700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59580f77d0 0x7f5958109470 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 rx=0x7f594c009990 tx=0x7f594c009b30).stop 2023-10-18T22:32:06.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.822+0000 7f595759e700 1 -- 172.21.15.8:0/3647713757 shutdown_connections 2023-10-18T22:32:06.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.822+0000 7f595759e700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5940060f70 0x7f5940063430 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:06.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.822+0000 7f595759e700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59580f6530 0x7f5958108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:06.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.822+0000 7f595759e700 1 --2- 172.21.15.8:0/3647713757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59580f77d0 0x7f5958109470 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:06.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.822+0000 7f595759e700 1 -- 172.21.15.8:0/3647713757 >> 172.21.15.8:0/3647713757 conn(0x7f59580f1c90 msgr2=0x7f595806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:06.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.823+0000 7f595759e700 1 -- 172.21.15.8:0/3647713757 shutdown_connections 2023-10-18T22:32:06.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.823+0000 7f595759e700 1 -- 172.21.15.8:0/3647713757 wait complete. 2023-10-18T22:32:06.839 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:32:06.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:06 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:05.460070+0000 mgr.smithi008.flmjzp (mgr.14640) 5586 : cluster [DBG] pgmap v3830: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:06.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.962+0000 7fc79afa1700 1 -- 172.21.15.8:0/1356621543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7940f77d0 msgr2=0x7fc7940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:06.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.962+0000 7fc79afa1700 1 --2- 172.21.15.8:0/1356621543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7940f77d0 0x7fc7940f7c30 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7fc784004660 tx=0x7fc784009b30).stop 2023-10-18T22:32:06.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.962+0000 7fc79afa1700 1 -- 172.21.15.8:0/1356621543 shutdown_connections 2023-10-18T22:32:06.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.962+0000 7fc79afa1700 1 --2- 172.21.15.8:0/1356621543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7940f77d0 0x7fc7940f7c30 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:06.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.962+0000 7fc79afa1700 1 --2- 172.21.15.8:0/1356621543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7940f6530 0x7fc7940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:06.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.962+0000 7fc79afa1700 1 -- 172.21.15.8:0/1356621543 >> 172.21.15.8:0/1356621543 conn(0x7fc7940f1c90 msgr2=0x7fc7940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:06.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.962+0000 7fc79afa1700 1 -- 172.21.15.8:0/1356621543 shutdown_connections 2023-10-18T22:32:06.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.962+0000 7fc79afa1700 1 -- 172.21.15.8:0/1356621543 wait complete. 2023-10-18T22:32:06.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.963+0000 7fc79afa1700 1 Processor -- start 2023-10-18T22:32:06.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.963+0000 7fc79afa1700 1 -- start start 2023-10-18T22:32:06.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.963+0000 7fc79afa1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7940f6530 0x7fc79406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:06.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.963+0000 7fc79afa1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7940f77d0 0x7fc794069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:06.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.963+0000 7fc79afa1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79406a380 con 0x7fc7940f77d0 2023-10-18T22:32:06.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.963+0000 7fc79afa1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79406a4c0 con 0x7fc7940f6530 2023-10-18T22:32:06.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.963+0000 7fc79979e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7940f77d0 0x7fc794069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:06.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.963+0000 7fc79979e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7940f77d0 0x7fc794069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33510/0 (socket says 172.21.15.8:33510) 2023-10-18T22:32:06.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.963+0000 7fc79979e700 1 -- 172.21.15.8:0/2459249093 learned_addr learned my addr 172.21.15.8:0/2459249093 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:06.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.964+0000 7fc799f9f700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7940f6530 0x7fc79406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:06.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.964+0000 7fc79979e700 1 -- 172.21.15.8:0/2459249093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7940f6530 msgr2=0x7fc79406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:06.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.964+0000 7fc79979e700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7940f6530 0x7fc79406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:06.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.964+0000 7fc79979e700 1 -- 172.21.15.8:0/2459249093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784005040 con 0x7fc7940f77d0 2023-10-18T22:32:06.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.964+0000 7fc79979e700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7940f77d0 0x7fc794069e20 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7fc784004d80 tx=0x7fc78400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:06.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.964+0000 7fc78a7fc700 1 -- 172.21.15.8:0/2459249093 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc784019070 con 0x7fc7940f77d0 2023-10-18T22:32:06.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.964+0000 7fc78a7fc700 1 -- 172.21.15.8:0/2459249093 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc78401e420 con 0x7fc7940f77d0 2023-10-18T22:32:06.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.964+0000 7fc79afa1700 1 -- 172.21.15.8:0/2459249093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79406a740 con 0x7fc7940f77d0 2023-10-18T22:32:06.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.964+0000 7fc78a7fc700 1 -- 172.21.15.8:0/2459249093 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc784014660 con 0x7fc7940f77d0 2023-10-18T22:32:06.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.965+0000 7fc79afa1700 1 -- 172.21.15.8:0/2459249093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79406ac20 con 0x7fc7940f77d0 2023-10-18T22:32:06.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.966+0000 7fc79afa1700 1 -- 172.21.15.8:0/2459249093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc794045ad0 con 0x7fc7940f77d0 2023-10-18T22:32:06.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.967+0000 7fc78a7fc700 1 -- 172.21.15.8:0/2459249093 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fc78401e590 con 0x7fc7940f77d0 2023-10-18T22:32:06.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.968+0000 7fc78a7fc700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc780060f70 0x7fc780063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:06.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.968+0000 7fc78a7fc700 1 -- 172.21.15.8:0/2459249093 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fc78407de00 con 0x7fc7940f77d0 2023-10-18T22:32:06.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.968+0000 7fc799f9f700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc780060f70 0x7fc780063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:06.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.968+0000 7fc799f9f700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc780060f70 0x7fc780063430 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fc79406b730 tx=0x7fc79000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:06.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:06.972+0000 7fc78a7fc700 1 -- 172.21.15.8:0/2459249093 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fc78404d9b0 con 0x7fc7940f77d0 2023-10-18T22:32:06.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:06 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:05.460070+0000 mgr.smithi008.flmjzp (mgr.14640) 5586 : cluster [DBG] pgmap v3830: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:07.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.173+0000 7fc79afa1700 1 -- 172.21.15.8:0/2459249093 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7940fedd0 con 0x7fc780060f70 2023-10-18T22:32:07.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.175+0000 7fc78a7fc700 1 -- 172.21.15.8:0/2459249093 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc7940fedd0 con 0x7fc780060f70 2023-10-18T22:32:07.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.176+0000 7fc79afa1700 1 -- 172.21.15.8:0/2459249093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc780060f70 msgr2=0x7fc780063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:07.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.176+0000 7fc79afa1700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc780060f70 0x7fc780063430 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fc79406b730 tx=0x7fc79000b040).stop 2023-10-18T22:32:07.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.176+0000 7fc79afa1700 1 -- 172.21.15.8:0/2459249093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7940f77d0 msgr2=0x7fc794069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:07.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.176+0000 7fc79afa1700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7940f77d0 0x7fc794069e20 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7fc784004d80 tx=0x7fc78400b040).stop 2023-10-18T22:32:07.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.176+0000 7fc79afa1700 1 -- 172.21.15.8:0/2459249093 shutdown_connections 2023-10-18T22:32:07.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.176+0000 7fc79afa1700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fc780060f70 0x7fc780063430 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.176+0000 7fc79afa1700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7940f6530 0x7fc79406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.177+0000 7fc79afa1700 1 --2- 172.21.15.8:0/2459249093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7940f77d0 0x7fc794069e20 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.177+0000 7fc79afa1700 1 -- 172.21.15.8:0/2459249093 >> 172.21.15.8:0/2459249093 conn(0x7fc7940f1c90 msgr2=0x7fc7940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.177+0000 7fc79afa1700 1 -- 172.21.15.8:0/2459249093 shutdown_connections 2023-10-18T22:32:07.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.177+0000 7fc79afa1700 1 -- 172.21.15.8:0/2459249093 wait complete. 2023-10-18T22:32:07.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.313+0000 7fe89bfff700 1 -- 172.21.15.8:0/3392733294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c0f77d0 msgr2=0x7fe89c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:07.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.313+0000 7fe89bfff700 1 --2- 172.21.15.8:0/3392733294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c0f77d0 0x7fe89c0f7c30 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 rx=0x7fe890004660 tx=0x7fe890009b30).stop 2023-10-18T22:32:07.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.313+0000 7fe89bfff700 1 -- 172.21.15.8:0/3392733294 shutdown_connections 2023-10-18T22:32:07.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.313+0000 7fe89bfff700 1 --2- 172.21.15.8:0/3392733294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c0f77d0 0x7fe89c0f7c30 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.313+0000 7fe89bfff700 1 --2- 172.21.15.8:0/3392733294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe89c0f6530 0x7fe89c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.313+0000 7fe89bfff700 1 -- 172.21.15.8:0/3392733294 >> 172.21.15.8:0/3392733294 conn(0x7fe89c0f1c90 msgr2=0x7fe89c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:07.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.313+0000 7fe89bfff700 1 -- 172.21.15.8:0/3392733294 shutdown_connections 2023-10-18T22:32:07.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.313+0000 7fe89bfff700 1 -- 172.21.15.8:0/3392733294 wait complete. 2023-10-18T22:32:07.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.314+0000 7fe89bfff700 1 Processor -- start 2023-10-18T22:32:07.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.314+0000 7fe89bfff700 1 -- start start 2023-10-18T22:32:07.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c0f6530 0x7fe89c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:07.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe89c0f77d0 0x7fe89c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:07.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c109a20 con 0x7fe89c0f6530 2023-10-18T22:32:07.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c109b60 con 0x7fe89c0f77d0 2023-10-18T22:32:07.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c0f6530 0x7fe89c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:07.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c0f6530 0x7fe89c108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33516/0 (socket says 172.21.15.8:33516) 2023-10-18T22:32:07.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89affd700 1 -- 172.21.15.8:0/2579244819 learned_addr learned my addr 172.21.15.8:0/2579244819 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:07.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89affd700 1 -- 172.21.15.8:0/2579244819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe89c0f77d0 msgr2=0x7fe89c109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:07.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89a7fc700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe89c0f77d0 0x7fe89c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89affd700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe89c0f77d0 0x7fe89c109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89affd700 1 -- 172.21.15.8:0/2579244819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890005040 con 0x7fe89c0f6530 2023-10-18T22:32:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.315+0000 7fe89a7fc700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe89c0f77d0 0x7fe89c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:32:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.316+0000 7fe89affd700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c0f6530 0x7fe89c108f80 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7fe88c002700 tx=0x7fe88c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.316+0000 7fe8837fe700 1 -- 172.21.15.8:0/2579244819 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe88c009320 con 0x7fe89c0f6530 2023-10-18T22:32:07.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.316+0000 7fe8837fe700 1 -- 172.21.15.8:0/2579244819 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe88c00f040 con 0x7fe89c0f6530 2023-10-18T22:32:07.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.316+0000 7fe89bfff700 1 -- 172.21.15.8:0/2579244819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c10a500 con 0x7fe89c0f6530 2023-10-18T22:32:07.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.316+0000 7fe8837fe700 1 -- 172.21.15.8:0/2579244819 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe88c014970 con 0x7fe89c0f6530 2023-10-18T22:32:07.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.316+0000 7fe89bfff700 1 -- 172.21.15.8:0/2579244819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c10aac0 con 0x7fe89c0f6530 2023-10-18T22:32:07.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.317+0000 7fe89bfff700 1 -- 172.21.15.8:0/2579244819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c045ad0 con 0x7fe89c0f6530 2023-10-18T22:32:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.318+0000 7fe8837fe700 1 -- 172.21.15.8:0/2579244819 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe88c009480 con 0x7fe89c0f6530 2023-10-18T22:32:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.319+0000 7fe8837fe700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe884060f70 0x7fe884063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.319+0000 7fe8837fe700 1 -- 172.21.15.8:0/2579244819 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe88c07cb90 con 0x7fe89c0f6530 2023-10-18T22:32:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.319+0000 7fe89a7fc700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe884060f70 0x7fe884063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.320+0000 7fe89a7fc700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe884060f70 0x7fe884063430 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fe890009d60 tx=0x7fe890009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.323+0000 7fe8837fe700 1 -- 172.21.15.8:0/2579244819 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe88c0501f0 con 0x7fe89c0f6530 2023-10-18T22:32:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.515+0000 7fe89bfff700 1 -- 172.21.15.8:0/2579244819 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe89c10ad90 con 0x7fe884060f70 2023-10-18T22:32:07.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.524+0000 7fe8837fe700 1 -- 172.21.15.8:0/2579244819 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe89c10ad90 con 0x7fe884060f70 2023-10-18T22:32:07.526 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:32:07.526 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (98m) 5m ago 100m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:32:07.526 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (92m) 5m ago 100m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:32:07.526 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (92m) 3m ago 99m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:32:07.527 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (98m) 5m ago 99m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:32:07.527 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 5m ago 96m - - 2023-10-18T22:32:07.527 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 5m ago 96m - - 2023-10-18T22:32:07.527 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 3m ago 96m - - 2023-10-18T22:32:07.527 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 3m ago 96m - - 2023-10-18T22:32:07.528 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (93m) 5m ago 101m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:32:07.528 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (93m) 3m ago 99m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:32:07.528 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (93m) 5m ago 101m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:32:07.528 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (92m) 3m ago 99m 342M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:32:07.528 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (99m) 5m ago 99m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:32:07.529 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (99m) 3m ago 99m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:32:07.529 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (92m) 5m ago 98m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:32:07.529 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (90m) 5m ago 98m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:32:07.529 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (89m) 5m ago 98m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:32:07.529 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (89m) 3m ago 97m 559M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:32:07.530 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (88m) 3m ago 97m 479M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:32:07.530 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (88m) 3m ago 97m 407M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:32:07.530 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (94m) 5m ago 99m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:32:07.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 -- 172.21.15.8:0/2579244819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe884060f70 msgr2=0x7fe884063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:07.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe884060f70 0x7fe884063430 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fe890009d60 tx=0x7fe890009b30).stop 2023-10-18T22:32:07.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 -- 172.21.15.8:0/2579244819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c0f6530 msgr2=0x7fe89c108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:07.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c0f6530 0x7fe89c108f80 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7fe88c002700 tx=0x7fe88c009d80).stop 2023-10-18T22:32:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 -- 172.21.15.8:0/2579244819 shutdown_connections 2023-10-18T22:32:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe884060f70 0x7fe884063430 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c0f6530 0x7fe89c108f80 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 --2- 172.21.15.8:0/2579244819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe89c0f77d0 0x7fe89c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 -- 172.21.15.8:0/2579244819 >> 172.21.15.8:0/2579244819 conn(0x7fe89c0f1c90 msgr2=0x7fe89c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:07.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 -- 172.21.15.8:0/2579244819 shutdown_connections 2023-10-18T22:32:07.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.526+0000 7fe89bfff700 1 -- 172.21.15.8:0/2579244819 wait complete. 2023-10-18T22:32:07.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.663+0000 7f712c9c8700 1 -- 172.21.15.8:0/3804274755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71280f77d0 msgr2=0x7f71280f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:07.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.663+0000 7f712c9c8700 1 --2- 172.21.15.8:0/3804274755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71280f77d0 0x7f71280f7c30 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7f711c004660 tx=0x7f711c009b30).stop 2023-10-18T22:32:07.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.663+0000 7f712c9c8700 1 -- 172.21.15.8:0/3804274755 shutdown_connections 2023-10-18T22:32:07.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.663+0000 7f712c9c8700 1 --2- 172.21.15.8:0/3804274755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71280f77d0 0x7f71280f7c30 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.664+0000 7f712c9c8700 1 --2- 172.21.15.8:0/3804274755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71280f6530 0x7f71280f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.664+0000 7f712c9c8700 1 -- 172.21.15.8:0/3804274755 >> 172.21.15.8:0/3804274755 conn(0x7f71280f1c90 msgr2=0x7f71280f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:07.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.664+0000 7f712c9c8700 1 -- 172.21.15.8:0/3804274755 shutdown_connections 2023-10-18T22:32:07.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.664+0000 7f712c9c8700 1 -- 172.21.15.8:0/3804274755 wait complete. 2023-10-18T22:32:07.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.665+0000 7f712c9c8700 1 Processor -- start 2023-10-18T22:32:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.665+0000 7f712c9c8700 1 -- start start 2023-10-18T22:32:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f712c9c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71280f6530 0x7f7128106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f712c9c8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71280f77d0 0x7f7128107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f712c9c8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7128107880 con 0x7f71280f77d0 2023-10-18T22:32:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f712c9c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71281080c0 con 0x7f71280f6530 2023-10-18T22:32:07.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f7126ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71280f77d0 0x7f7128107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:07.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f7126ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71280f77d0 0x7f7128107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33538/0 (socket says 172.21.15.8:33538) 2023-10-18T22:32:07.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f7126ffd700 1 -- 172.21.15.8:0/3133168872 learned_addr learned my addr 172.21.15.8:0/3133168872 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:07.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f71277fe700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71280f6530 0x7f7128106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:07.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f7126ffd700 1 -- 172.21.15.8:0/3133168872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71280f6530 msgr2=0x7f7128106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f7126ffd700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71280f6530 0x7f7128106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f7126ffd700 1 -- 172.21.15.8:0/3133168872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c005040 con 0x7f71280f77d0 2023-10-18T22:32:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.666+0000 7f7126ffd700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71280f77d0 0x7f7128107280 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7f711c009f50 tx=0x7f711c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.667+0000 7f710ffff700 1 -- 172.21.15.8:0/3133168872 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711c018070 con 0x7f71280f77d0 2023-10-18T22:32:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.667+0000 7f710ffff700 1 -- 172.21.15.8:0/3133168872 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f711c009630 con 0x7f71280f77d0 2023-10-18T22:32:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.667+0000 7f712c9c8700 1 -- 172.21.15.8:0/3133168872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7128108340 con 0x7f71280f77d0 2023-10-18T22:32:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.667+0000 7f710ffff700 1 -- 172.21.15.8:0/3133168872 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711c01c3c0 con 0x7f71280f77d0 2023-10-18T22:32:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.667+0000 7f712c9c8700 1 -- 172.21.15.8:0/3133168872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7128108820 con 0x7f71280f77d0 2023-10-18T22:32:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.668+0000 7f712c9c8700 1 -- 172.21.15.8:0/3133168872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7128059100 con 0x7f71280f77d0 2023-10-18T22:32:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.669+0000 7f710ffff700 1 -- 172.21.15.8:0/3133168872 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f711c01d420 con 0x7f71280f77d0 2023-10-18T22:32:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.670+0000 7f710ffff700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7110060f70 0x7f7110063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:07.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.670+0000 7f710ffff700 1 -- 172.21.15.8:0/3133168872 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f711c07e600 con 0x7f71280f77d0 2023-10-18T22:32:07.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.670+0000 7f71277fe700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7110060f70 0x7f7110063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:07.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.670+0000 7f71277fe700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7110060f70 0x7f7110063430 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f7128107b50 tx=0x7f7118009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:07.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.674+0000 7f710ffff700 1 -- 172.21.15.8:0/3133168872 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f711c04e310 con 0x7f71280f77d0 2023-10-18T22:32:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.923+0000 7f712c9c8700 1 -- 172.21.15.8:0/3133168872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7128045ad0 con 0x7f71280f77d0 2023-10-18T22:32:07.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.924+0000 7f710ffff700 1 -- 172.21.15.8:0/3133168872 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f711c051930 con 0x7f71280f77d0 2023-10-18T22:32:07.926 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:32:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:32:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:32:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:32:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:32:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:32:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:32:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:32:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:32:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:32:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:32:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:32:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:32:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:32:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:32:07.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:32:07.929 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:32:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.925+0000 7f712c9c8700 1 -- 172.21.15.8:0/3133168872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7110060f70 msgr2=0x7f7110063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.925+0000 7f712c9c8700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7110060f70 0x7f7110063430 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f7128107b50 tx=0x7f7118009c00).stop 2023-10-18T22:32:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.925+0000 7f712c9c8700 1 -- 172.21.15.8:0/3133168872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71280f77d0 msgr2=0x7f7128107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.925+0000 7f712c9c8700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71280f77d0 0x7f7128107280 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7f711c009f50 tx=0x7f711c009b30).stop 2023-10-18T22:32:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.926+0000 7f712c9c8700 1 -- 172.21.15.8:0/3133168872 shutdown_connections 2023-10-18T22:32:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.926+0000 7f712c9c8700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f7110060f70 0x7f7110063430 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.926+0000 7f712c9c8700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71280f6530 0x7f7128106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.926+0000 7f712c9c8700 1 --2- 172.21.15.8:0/3133168872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71280f77d0 0x7f7128107280 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.926+0000 7f712c9c8700 1 -- 172.21.15.8:0/3133168872 >> 172.21.15.8:0/3133168872 conn(0x7f71280f1c90 msgr2=0x7f71280fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.926+0000 7f712c9c8700 1 -- 172.21.15.8:0/3133168872 shutdown_connections 2023-10-18T22:32:07.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:07.926+0000 7f712c9c8700 1 -- 172.21.15.8:0/3133168872 wait complete. 2023-10-18T22:32:08.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.061+0000 7f25d8a52700 1 -- 172.21.15.8:0/3995724140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d40f6530 msgr2=0x7f25d40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:08.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.061+0000 7f25d8a52700 1 --2- 172.21.15.8:0/3995724140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d40f6530 0x7f25d40f6950 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7f25c4004660 tx=0x7f25c4009b30).stop 2023-10-18T22:32:08.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.061+0000 7f25d8a52700 1 -- 172.21.15.8:0/3995724140 shutdown_connections 2023-10-18T22:32:08.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.061+0000 7f25d8a52700 1 --2- 172.21.15.8:0/3995724140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d40f77d0 0x7f25d40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.061+0000 7f25d8a52700 1 --2- 172.21.15.8:0/3995724140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d40f6530 0x7f25d40f6950 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.061+0000 7f25d8a52700 1 -- 172.21.15.8:0/3995724140 >> 172.21.15.8:0/3995724140 conn(0x7f25d40f1c90 msgr2=0x7f25d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.061+0000 7f25d8a52700 1 -- 172.21.15.8:0/3995724140 shutdown_connections 2023-10-18T22:32:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.061+0000 7f25d8a52700 1 -- 172.21.15.8:0/3995724140 wait complete. 2023-10-18T22:32:08.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.062+0000 7f25d8a52700 1 Processor -- start 2023-10-18T22:32:08.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.062+0000 7f25d8a52700 1 -- start start 2023-10-18T22:32:08.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.062+0000 7f25d8a52700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d40f6530 0x7f25d4108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:08.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.062+0000 7f25d8a52700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d40f77d0 0x7f25d41094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:08.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.062+0000 7f25d8a52700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d4109a70 con 0x7f25d40f77d0 2023-10-18T22:32:08.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.062+0000 7f25d8a52700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d4109bb0 con 0x7f25d40f6530 2023-10-18T22:32:08.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25d259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d40f77d0 0x7f25d41094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:08.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25d259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d40f77d0 0x7f25d41094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33550/0 (socket says 172.21.15.8:33550) 2023-10-18T22:32:08.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25d259c700 1 -- 172.21.15.8:0/3301556666 learned_addr learned my addr 172.21.15.8:0/3301556666 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:08.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25d2d9d700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d40f6530 0x7f25d4108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:08.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25d259c700 1 -- 172.21.15.8:0/3301556666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d40f6530 msgr2=0x7f25d4108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:08.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25d259c700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d40f6530 0x7f25d4108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25d259c700 1 -- 172.21.15.8:0/3301556666 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4005040 con 0x7f25d40f77d0 2023-10-18T22:32:08.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25d259c700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d40f77d0 0x7f25d41094c0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 rx=0x7f25c800c790 tx=0x7f25c8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:08.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25bb7fe700 1 -- 172.21.15.8:0/3301556666 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c800e680 con 0x7f25d40f77d0 2023-10-18T22:32:08.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25bb7fe700 1 -- 172.21.15.8:0/3301556666 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f25c800eca0 con 0x7f25d40f77d0 2023-10-18T22:32:08.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.063+0000 7f25d8a52700 1 -- 172.21.15.8:0/3301556666 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d410a550 con 0x7f25d40f77d0 2023-10-18T22:32:08.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.064+0000 7f25bb7fe700 1 -- 172.21.15.8:0/3301556666 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c8013de0 con 0x7f25d40f77d0 2023-10-18T22:32:08.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.064+0000 7f25d8a52700 1 -- 172.21.15.8:0/3301556666 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d410ab10 con 0x7f25d40f77d0 2023-10-18T22:32:08.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.065+0000 7f25d8a52700 1 -- 172.21.15.8:0/3301556666 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d4045ad0 con 0x7f25d40f77d0 2023-10-18T22:32:08.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.066+0000 7f25bb7fe700 1 -- 172.21.15.8:0/3301556666 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f25c801a060 con 0x7f25d40f77d0 2023-10-18T22:32:08.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.066+0000 7f25bb7fe700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25bc060f70 0x7f25bc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:08.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.066+0000 7f25bb7fe700 1 -- 172.21.15.8:0/3301556666 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f25c807cb70 con 0x7f25d40f77d0 2023-10-18T22:32:08.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.067+0000 7f25d2d9d700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25bc060f70 0x7f25bc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:08.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.067+0000 7f25d2d9d700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25bc060f70 0x7f25bc063430 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f25c4009490 tx=0x7f25c4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:08.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.070+0000 7f25bb7fe700 1 -- 172.21.15.8:0/3301556666 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f25c80501d0 con 0x7f25d40f77d0 2023-10-18T22:32:08.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.296+0000 7f25d8a52700 1 -- 172.21.15.8:0/3301556666 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f25d4027a00 con 0x7f25d40f77d0 2023-10-18T22:32:08.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.296+0000 7f25bb7fe700 1 -- 172.21.15.8:0/3301556666 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f25c804fdc0 con 0x7f25d40f77d0 2023-10-18T22:32:08.298 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:32:08.299 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:32:08.299 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:32:08.299 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:32:08.299 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:32:08.299 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:32:08.300 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:32:08.300 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:32:08.300 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:32:08.300 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:32:08.300 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:32:08.300 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:32:08.301 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:32:08.301 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:32:08.301 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:32:08.301 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:32:08.301 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:32:08.302 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:32:08.302 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:32:08.302 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:32:08.302 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:32:08.302 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:32:08.303 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:32:08.303 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:32:08.303 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:32:08.303 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:32:08.303 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:32:08.303 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:32:08.304 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:32:08.304 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:32:08.304 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:32:08.304 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:32:08.304 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:32:08.304 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:32:08.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.298+0000 7f25d8a52700 1 -- 172.21.15.8:0/3301556666 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25bc060f70 msgr2=0x7f25bc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.298+0000 7f25d8a52700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25bc060f70 0x7f25bc063430 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f25c4009490 tx=0x7f25c4009b30).stop 2023-10-18T22:32:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.298+0000 7f25d8a52700 1 -- 172.21.15.8:0/3301556666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d40f77d0 msgr2=0x7f25d41094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.298+0000 7f25d8a52700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d40f77d0 0x7f25d41094c0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 rx=0x7f25c800c790 tx=0x7f25c8007d70).stop 2023-10-18T22:32:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.298+0000 7f25d8a52700 1 -- 172.21.15.8:0/3301556666 shutdown_connections 2023-10-18T22:32:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.298+0000 7f25d8a52700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f25bc060f70 0x7f25bc063430 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.298+0000 7f25d8a52700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d40f6530 0x7f25d4108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.298+0000 7f25d8a52700 1 --2- 172.21.15.8:0/3301556666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d40f77d0 0x7f25d41094c0 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.298+0000 7f25d8a52700 1 -- 172.21.15.8:0/3301556666 >> 172.21.15.8:0/3301556666 conn(0x7f25d40f1c90 msgr2=0x7f25d406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:08.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.299+0000 7f25d8a52700 1 -- 172.21.15.8:0/3301556666 shutdown_connections 2023-10-18T22:32:08.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.299+0000 7f25d8a52700 1 -- 172.21.15.8:0/3301556666 wait complete. 2023-10-18T22:32:08.308 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:32:08.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.436+0000 7fa2c13cd700 1 -- 172.21.15.8:0/2121127318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0f77d0 msgr2=0x7fa2bc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.436+0000 7fa2c13cd700 1 --2- 172.21.15.8:0/2121127318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0f77d0 0x7fa2bc0f7c30 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 rx=0x7fa2b0004660 tx=0x7fa2b0009b30).stop 2023-10-18T22:32:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.437+0000 7fa2c13cd700 1 -- 172.21.15.8:0/2121127318 shutdown_connections 2023-10-18T22:32:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.437+0000 7fa2c13cd700 1 --2- 172.21.15.8:0/2121127318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0f77d0 0x7fa2bc0f7c30 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.437+0000 7fa2c13cd700 1 --2- 172.21.15.8:0/2121127318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2bc0f6530 0x7fa2bc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.437+0000 7fa2c13cd700 1 -- 172.21.15.8:0/2121127318 >> 172.21.15.8:0/2121127318 conn(0x7fa2bc0f1c90 msgr2=0x7fa2bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.437+0000 7fa2c13cd700 1 -- 172.21.15.8:0/2121127318 shutdown_connections 2023-10-18T22:32:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.437+0000 7fa2c13cd700 1 -- 172.21.15.8:0/2121127318 wait complete. 2023-10-18T22:32:08.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.438+0000 7fa2c13cd700 1 Processor -- start 2023-10-18T22:32:08.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.438+0000 7fa2c13cd700 1 -- start start 2023-10-18T22:32:08.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.438+0000 7fa2c13cd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2bc0f6530 0x7fa2bc106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.438+0000 7fa2c13cd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0f77d0 0x7fa2bc107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.438+0000 7fa2c13cd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc107850 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.438+0000 7fa2c13cd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc108060 con 0x7fa2bc0f6530 2023-10-18T22:32:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.438+0000 7fa2bb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0f77d0 0x7fa2bc107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2bb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0f77d0 0x7fa2bc107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33566/0 (socket says 172.21.15.8:33566) 2023-10-18T22:32:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2bb7fe700 1 -- 172.21.15.8:0/4199623738 learned_addr learned my addr 172.21.15.8:0/4199623738 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2bbfff700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2bc0f6530 0x7fa2bc106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2bb7fe700 1 -- 172.21.15.8:0/4199623738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2bc0f6530 msgr2=0x7fa2bc106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2bb7fe700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2bc0f6530 0x7fa2bc106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2bb7fe700 1 -- 172.21.15.8:0/4199623738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b0005040 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2bb7fe700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0f77d0 0x7fa2bc107250 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7fa2b0004320 tx=0x7fa2b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2b8ff9700 1 -- 172.21.15.8:0/4199623738 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2b0019070 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2b8ff9700 1 -- 172.21.15.8:0/4199623738 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa2b001e420 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2c13cd700 1 -- 172.21.15.8:0/4199623738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc108280 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.439+0000 7fa2b8ff9700 1 -- 172.21.15.8:0/4199623738 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2b0014680 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.440+0000 7fa2c13cd700 1 -- 172.21.15.8:0/4199623738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc108760 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.441+0000 7fa2c13cd700 1 -- 172.21.15.8:0/4199623738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc059100 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.442+0000 7fa2b8ff9700 1 -- 172.21.15.8:0/4199623738 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fa2b001e590 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.442+0000 7fa2b8ff9700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2a4060f70 0x7fa2a4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.443+0000 7fa2b8ff9700 1 -- 172.21.15.8:0/4199623738 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fa2b007dd10 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.443+0000 7fa2bbfff700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2a4060f70 0x7fa2a4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.443+0000 7fa2bbfff700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2a4060f70 0x7fa2a4063430 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fa2bc106ad0 tx=0x7fa2ac00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.447+0000 7fa2b8ff9700 1 -- 172.21.15.8:0/4199623738 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fa2b004d8e0 con 0x7fa2bc0f77d0 2023-10-18T22:32:08.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.647+0000 7fa2c13cd700 1 -- 172.21.15.8:0/4199623738 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2bc0fee30 con 0x7fa2a4060f70 2023-10-18T22:32:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.648+0000 7fa2b8ff9700 1 -- 172.21.15.8:0/4199623738 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa2bc0fee30 con 0x7fa2a4060f70 2023-10-18T22:32:08.684 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:32:08.685 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:32:08.685 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:32:08.685 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:32:08.685 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:32:08.686 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:32:08.686 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:32:08.686 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:32:08.686 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:32:08.686 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:32:08.687 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:32:08.687 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:32:08.687 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:32:08.687 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:32:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.650+0000 7fa2c13cd700 1 -- 172.21.15.8:0/4199623738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2a4060f70 msgr2=0x7fa2a4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.650+0000 7fa2c13cd700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2a4060f70 0x7fa2a4063430 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fa2bc106ad0 tx=0x7fa2ac00b040).stop 2023-10-18T22:32:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.650+0000 7fa2c13cd700 1 -- 172.21.15.8:0/4199623738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0f77d0 msgr2=0x7fa2bc107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.650+0000 7fa2c13cd700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0f77d0 0x7fa2bc107250 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7fa2b0004320 tx=0x7fa2b000b040).stop 2023-10-18T22:32:08.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.650+0000 7fa2c13cd700 1 -- 172.21.15.8:0/4199623738 shutdown_connections 2023-10-18T22:32:08.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.650+0000 7fa2c13cd700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fa2a4060f70 0x7fa2a4063430 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.650+0000 7fa2c13cd700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2bc0f6530 0x7fa2bc106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.650+0000 7fa2c13cd700 1 --2- 172.21.15.8:0/4199623738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2bc0f77d0 0x7fa2bc107250 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:08.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.650+0000 7fa2c13cd700 1 -- 172.21.15.8:0/4199623738 >> 172.21.15.8:0/4199623738 conn(0x7fa2bc0f1c90 msgr2=0x7fa2bc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:08.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.651+0000 7fa2c13cd700 1 -- 172.21.15.8:0/4199623738 shutdown_connections 2023-10-18T22:32:08.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:08.651+0000 7fa2c13cd700 1 -- 172.21.15.8:0/4199623738 wait complete. 2023-10-18T22:32:08.690 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:06.820791+0000 mgr.smithi008.flmjzp (mgr.14640) 5587 : audit [DBG] from='client.38440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:08.690 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:07.174953+0000 mgr.smithi008.flmjzp (mgr.14640) 5588 : audit [DBG] from='client.38444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:08.691 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:07.460507+0000 mgr.smithi008.flmjzp (mgr.14640) 5589 : cluster [DBG] pgmap v3831: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:08.691 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:07.516176+0000 mgr.smithi008.flmjzp (mgr.14640) 5590 : audit [DBG] from='client.38448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:08.691 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:07.924222+0000 mon.smithi008 (mon.0) 5816 : audit [DBG] from='client.? 172.21.15.8:0/3133168872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:08.691 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:08.297083+0000 mon.smithi008 (mon.0) 5817 : audit [DBG] from='client.? 172.21.15.8:0/3301556666' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:32:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:06.820791+0000 mgr.smithi008.flmjzp (mgr.14640) 5587 : audit [DBG] from='client.38440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:07.174953+0000 mgr.smithi008.flmjzp (mgr.14640) 5588 : audit [DBG] from='client.38444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:07.460507+0000 mgr.smithi008.flmjzp (mgr.14640) 5589 : cluster [DBG] pgmap v3831: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:07.516176+0000 mgr.smithi008.flmjzp (mgr.14640) 5590 : audit [DBG] from='client.38448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:07.924222+0000 mon.smithi008 (mon.0) 5816 : audit [DBG] from='client.? 172.21.15.8:0/3133168872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:08.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:08.297083+0000 mon.smithi008 (mon.0) 5817 : audit [DBG] from='client.? 172.21.15.8:0/3301556666' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:32:10.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:08.648567+0000 mgr.smithi008.flmjzp (mgr.14640) 5591 : audit [DBG] from='client.38460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:10.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:09.461016+0000 mgr.smithi008.flmjzp (mgr.14640) 5592 : cluster [DBG] pgmap v3832: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:08.648567+0000 mgr.smithi008.flmjzp (mgr.14640) 5591 : audit [DBG] from='client.38460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:09.461016+0000 mgr.smithi008.flmjzp (mgr.14640) 5592 : cluster [DBG] pgmap v3832: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:11.485071+0000 mon.smithi008 (mon.0) 5818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:11.487094+0000 mon.smithi008 (mon.0) 5819 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:11.488077+0000 mon.smithi008 (mon.0) 5820 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:11.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:11.494405+0000 mon.smithi008 (mon.0) 5821 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:11.500705+0000 mon.smithi008 (mon.0) 5822 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:11.506023+0000 mon.smithi008 (mon.0) 5823 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:11.507688+0000 mon.smithi008 (mon.0) 5824 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:11.509311+0000 mon.smithi008 (mon.0) 5825 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:11.922 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:11 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:11.511352+0000 mon.smithi008 (mon.0) 5826 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:11.485071+0000 mon.smithi008 (mon.0) 5818 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:11.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:11.487094+0000 mon.smithi008 (mon.0) 5819 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:11.488077+0000 mon.smithi008 (mon.0) 5820 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:11.494405+0000 mon.smithi008 (mon.0) 5821 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:11.500705+0000 mon.smithi008 (mon.0) 5822 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:11.506023+0000 mon.smithi008 (mon.0) 5823 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:11.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:11.507688+0000 mon.smithi008 (mon.0) 5824 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:11.509311+0000 mon.smithi008 (mon.0) 5825 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:11.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:11 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:11.511352+0000 mon.smithi008 (mon.0) 5826 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:11.461507+0000 mgr.smithi008.flmjzp (mgr.14640) 5593 : cluster [DBG] pgmap v3833: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:11.488930+0000 mgr.smithi008.flmjzp (mgr.14640) 5594 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:11.489477+0000 mgr.smithi008.flmjzp (mgr.14640) 5595 : cluster [DBG] pgmap v3834: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:11.489861+0000 mgr.smithi008.flmjzp (mgr.14640) 5596 : cluster [DBG] pgmap v3835: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:12.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:11.513363+0000 mgr.smithi008.flmjzp (mgr.14640) 5597 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:11.461507+0000 mgr.smithi008.flmjzp (mgr.14640) 5593 : cluster [DBG] pgmap v3833: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:11.488930+0000 mgr.smithi008.flmjzp (mgr.14640) 5594 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:11.489477+0000 mgr.smithi008.flmjzp (mgr.14640) 5595 : cluster [DBG] pgmap v3834: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:11.489861+0000 mgr.smithi008.flmjzp (mgr.14640) 5596 : cluster [DBG] pgmap v3835: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:11.513363+0000 mgr.smithi008.flmjzp (mgr.14640) 5597 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:13.490524+0000 mgr.smithi008.flmjzp (mgr.14640) 5598 : cluster [DBG] pgmap v3836: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:13.490524+0000 mgr.smithi008.flmjzp (mgr.14640) 5598 : cluster [DBG] pgmap v3836: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:15.491083+0000 mgr.smithi008.flmjzp (mgr.14640) 5599 : cluster [DBG] pgmap v3837: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:15.491083+0000 mgr.smithi008.flmjzp (mgr.14640) 5599 : cluster [DBG] pgmap v3837: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:18.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:17.491754+0000 mgr.smithi008.flmjzp (mgr.14640) 5600 : cluster [DBG] pgmap v3838: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:17.491754+0000 mgr.smithi008.flmjzp (mgr.14640) 5600 : cluster [DBG] pgmap v3838: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:19.492553+0000 mgr.smithi008.flmjzp (mgr.14640) 5601 : cluster [DBG] pgmap v3839: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:19.492553+0000 mgr.smithi008.flmjzp (mgr.14640) 5601 : cluster [DBG] pgmap v3839: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:21.493231+0000 mgr.smithi008.flmjzp (mgr.14640) 5602 : cluster [DBG] pgmap v3840: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:21.524011+0000 mon.smithi008 (mon.0) 5827 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:21.525986+0000 mon.smithi008 (mon.0) 5828 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:22.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:21.526916+0000 mon.smithi008 (mon.0) 5829 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:21.527726+0000 mgr.smithi008.flmjzp (mgr.14640) 5603 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:21.528309+0000 mgr.smithi008.flmjzp (mgr.14640) 5604 : cluster [DBG] pgmap v3841: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:21.528628+0000 mgr.smithi008.flmjzp (mgr.14640) 5605 : cluster [DBG] pgmap v3842: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:21.532544+0000 mon.smithi008 (mon.0) 5830 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:21.540281+0000 mon.smithi008 (mon.0) 5831 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:22.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:21.543347+0000 mon.smithi008 (mon.0) 5832 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:22.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:21.545133+0000 mon.smithi008 (mon.0) 5833 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:22.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:21.546838+0000 mon.smithi008 (mon.0) 5834 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:22.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:21.548866+0000 mon.smithi008 (mon.0) 5835 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:22.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:21.550798+0000 mgr.smithi008.flmjzp (mgr.14640) 5606 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:21.493231+0000 mgr.smithi008.flmjzp (mgr.14640) 5602 : cluster [DBG] pgmap v3840: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:21.524011+0000 mon.smithi008 (mon.0) 5827 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:21.525986+0000 mon.smithi008 (mon.0) 5828 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:21.526916+0000 mon.smithi008 (mon.0) 5829 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:22.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:21.527726+0000 mgr.smithi008.flmjzp (mgr.14640) 5603 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:22.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:21.528309+0000 mgr.smithi008.flmjzp (mgr.14640) 5604 : cluster [DBG] pgmap v3841: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:22.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:21.528628+0000 mgr.smithi008.flmjzp (mgr.14640) 5605 : cluster [DBG] pgmap v3842: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:22.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:21.532544+0000 mon.smithi008 (mon.0) 5830 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:22.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:21.540281+0000 mon.smithi008 (mon.0) 5831 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:22.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:21.543347+0000 mon.smithi008 (mon.0) 5832 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:22.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:21.545133+0000 mon.smithi008 (mon.0) 5833 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:22.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:21.546838+0000 mon.smithi008 (mon.0) 5834 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:22.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:21.548866+0000 mon.smithi008 (mon.0) 5835 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:22.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:21.550798+0000 mgr.smithi008.flmjzp (mgr.14640) 5606 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:23.529282+0000 mgr.smithi008.flmjzp (mgr.14640) 5607 : cluster [DBG] pgmap v3843: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:23.529282+0000 mgr.smithi008.flmjzp (mgr.14640) 5607 : cluster [DBG] pgmap v3843: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:25.529964+0000 mgr.smithi008.flmjzp (mgr.14640) 5608 : cluster [DBG] pgmap v3844: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:25.529964+0000 mgr.smithi008.flmjzp (mgr.14640) 5608 : cluster [DBG] pgmap v3844: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:27.530514+0000 mgr.smithi008.flmjzp (mgr.14640) 5609 : cluster [DBG] pgmap v3845: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:27.530514+0000 mgr.smithi008.flmjzp (mgr.14640) 5609 : cluster [DBG] pgmap v3845: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:29.531116+0000 mgr.smithi008.flmjzp (mgr.14640) 5610 : cluster [DBG] pgmap v3846: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:29.531116+0000 mgr.smithi008.flmjzp (mgr.14640) 5610 : cluster [DBG] pgmap v3846: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:31.531814+0000 mgr.smithi008.flmjzp (mgr.14640) 5611 : cluster [DBG] pgmap v3847: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:31.558634+0000 mon.smithi008 (mon.0) 5836 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:31.560746+0000 mon.smithi008 (mon.0) 5837 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:32.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:31.561772+0000 mon.smithi008 (mon.0) 5838 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:31.562651+0000 mgr.smithi008.flmjzp (mgr.14640) 5612 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:31.563227+0000 mgr.smithi008.flmjzp (mgr.14640) 5613 : cluster [DBG] pgmap v3848: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:31.563586+0000 mgr.smithi008.flmjzp (mgr.14640) 5614 : cluster [DBG] pgmap v3849: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:31.568341+0000 mon.smithi008 (mon.0) 5839 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:32.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:31.574850+0000 mon.smithi008 (mon.0) 5840 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:32.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:31.578146+0000 mon.smithi008 (mon.0) 5841 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:32.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:31.579875+0000 mon.smithi008 (mon.0) 5842 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:32.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:31.581420+0000 mon.smithi008 (mon.0) 5843 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:32.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:31.583421+0000 mon.smithi008 (mon.0) 5844 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:32.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:31.585331+0000 mgr.smithi008.flmjzp (mgr.14640) 5615 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:31.531814+0000 mgr.smithi008.flmjzp (mgr.14640) 5611 : cluster [DBG] pgmap v3847: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:31.558634+0000 mon.smithi008 (mon.0) 5836 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:31.560746+0000 mon.smithi008 (mon.0) 5837 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:31.561772+0000 mon.smithi008 (mon.0) 5838 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:31.562651+0000 mgr.smithi008.flmjzp (mgr.14640) 5612 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:31.563227+0000 mgr.smithi008.flmjzp (mgr.14640) 5613 : cluster [DBG] pgmap v3848: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:32.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:31.563586+0000 mgr.smithi008.flmjzp (mgr.14640) 5614 : cluster [DBG] pgmap v3849: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:32.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:31.568341+0000 mon.smithi008 (mon.0) 5839 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:32.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:31.574850+0000 mon.smithi008 (mon.0) 5840 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:32.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:31.578146+0000 mon.smithi008 (mon.0) 5841 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:32.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:31.579875+0000 mon.smithi008 (mon.0) 5842 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:32.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:31.581420+0000 mon.smithi008 (mon.0) 5843 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:32.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:31.583421+0000 mon.smithi008 (mon.0) 5844 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:32.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:31.585331+0000 mgr.smithi008.flmjzp (mgr.14640) 5615 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:33.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:33.564175+0000 mgr.smithi008.flmjzp (mgr.14640) 5616 : cluster [DBG] pgmap v3850: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:33.564175+0000 mgr.smithi008.flmjzp (mgr.14640) 5616 : cluster [DBG] pgmap v3850: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:35.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:35 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:35.564893+0000 mgr.smithi008.flmjzp (mgr.14640) 5617 : cluster [DBG] pgmap v3851: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:35.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:35 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:35.564893+0000 mgr.smithi008.flmjzp (mgr.14640) 5617 : cluster [DBG] pgmap v3851: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:37.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:37 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:37.565357+0000 mgr.smithi008.flmjzp (mgr.14640) 5618 : cluster [DBG] pgmap v3852: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:37.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:37 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:37.565357+0000 mgr.smithi008.flmjzp (mgr.14640) 5618 : cluster [DBG] pgmap v3852: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:38.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.803+0000 7fad11af9700 1 -- 172.21.15.8:0/2076622180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad0c0f77d0 msgr2=0x7fad0c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:38.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.803+0000 7fad11af9700 1 --2- 172.21.15.8:0/2076622180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad0c0f77d0 0x7fad0c0f7c30 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7facf8004660 tx=0x7facf8009b30).stop 2023-10-18T22:32:38.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.803+0000 7fad11af9700 1 -- 172.21.15.8:0/2076622180 shutdown_connections 2023-10-18T22:32:38.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.803+0000 7fad11af9700 1 --2- 172.21.15.8:0/2076622180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad0c0f77d0 0x7fad0c0f7c30 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:38.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.803+0000 7fad11af9700 1 --2- 172.21.15.8:0/2076622180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad0c0f6530 0x7fad0c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:38.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.803+0000 7fad11af9700 1 -- 172.21.15.8:0/2076622180 >> 172.21.15.8:0/2076622180 conn(0x7fad0c0f1c90 msgr2=0x7fad0c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:38.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.803+0000 7fad11af9700 1 -- 172.21.15.8:0/2076622180 shutdown_connections 2023-10-18T22:32:38.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.803+0000 7fad11af9700 1 -- 172.21.15.8:0/2076622180 wait complete. 2023-10-18T22:32:38.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.804+0000 7fad11af9700 1 Processor -- start 2023-10-18T22:32:38.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.804+0000 7fad11af9700 1 -- start start 2023-10-18T22:32:38.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.804+0000 7fad11af9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad0c0f6530 0x7fad0c108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:38.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.804+0000 7fad11af9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad0c0f77d0 0x7fad0c1093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:38.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.804+0000 7fad11af9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c109980 con 0x7fad0c0f6530 2023-10-18T22:32:38.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.804+0000 7fad11af9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c109ac0 con 0x7fad0c0f77d0 2023-10-18T22:32:38.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.805+0000 7fad10af7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad0c0f6530 0x7fad0c108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:38.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.805+0000 7fad10af7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad0c0f6530 0x7fad0c108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48164/0 (socket says 172.21.15.8:48164) 2023-10-18T22:32:38.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.805+0000 7fad10af7700 1 -- 172.21.15.8:0/3903648052 learned_addr learned my addr 172.21.15.8:0/3903648052 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:38.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.805+0000 7fad0bfff700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad0c0f77d0 0x7fad0c1093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:38.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.805+0000 7fad10af7700 1 -- 172.21.15.8:0/3903648052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad0c0f77d0 msgr2=0x7fad0c1093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:38.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.805+0000 7fad10af7700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad0c0f77d0 0x7fad0c1093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:38.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.805+0000 7fad10af7700 1 -- 172.21.15.8:0/3903648052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8005040 con 0x7fad0c0f6530 2023-10-18T22:32:38.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.805+0000 7fad0bfff700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad0c0f77d0 0x7fad0c1093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:32:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.805+0000 7fad10af7700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad0c0f6530 0x7fad0c108ee0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 rx=0x7fad0000e7c0 tx=0x7fad0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.805+0000 7fad097fa700 1 -- 172.21.15.8:0/3903648052 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad000092e0 con 0x7fad0c0f6530 2023-10-18T22:32:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.806+0000 7fad097fa700 1 -- 172.21.15.8:0/3903648052 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fad0000f040 con 0x7fad0c0f6530 2023-10-18T22:32:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.806+0000 7fad097fa700 1 -- 172.21.15.8:0/3903648052 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad000147e0 con 0x7fad0c0f6530 2023-10-18T22:32:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.806+0000 7fad11af9700 1 -- 172.21.15.8:0/3903648052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c10a460 con 0x7fad0c0f6530 2023-10-18T22:32:38.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.806+0000 7fad11af9700 1 -- 172.21.15.8:0/3903648052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c10a9a0 con 0x7fad0c0f6530 2023-10-18T22:32:38.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.807+0000 7fad11af9700 1 -- 172.21.15.8:0/3903648052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c045ad0 con 0x7fad0c0f6530 2023-10-18T22:32:38.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.808+0000 7fad097fa700 1 -- 172.21.15.8:0/3903648052 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fad0001b030 con 0x7fad0c0f6530 2023-10-18T22:32:38.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.808+0000 7fad097fa700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7facfc060f70 0x7facfc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:38.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.809+0000 7fad097fa700 1 -- 172.21.15.8:0/3903648052 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fad0007c9b0 con 0x7fad0c0f6530 2023-10-18T22:32:38.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.809+0000 7fad0bfff700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7facfc060f70 0x7facfc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:38.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.809+0000 7fad0bfff700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7facfc060f70 0x7facfc063430 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7facf8009880 tx=0x7facf800b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:38.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:38.813+0000 7fad097fa700 1 -- 172.21.15.8:0/3903648052 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fad00050050 con 0x7fad0c0f6530 2023-10-18T22:32:39.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.015+0000 7fad11af9700 1 -- 172.21.15.8:0/3903648052 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad0c10abc0 con 0x7facfc060f70 2023-10-18T22:32:39.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.016+0000 7fad097fa700 1 -- 172.21.15.8:0/3903648052 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fad0c10abc0 con 0x7facfc060f70 2023-10-18T22:32:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 -- 172.21.15.8:0/3903648052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7facfc060f70 msgr2=0x7facfc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7facfc060f70 0x7facfc063430 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7facf8009880 tx=0x7facf800b040).stop 2023-10-18T22:32:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 -- 172.21.15.8:0/3903648052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad0c0f6530 msgr2=0x7fad0c108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad0c0f6530 0x7fad0c108ee0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 rx=0x7fad0000e7c0 tx=0x7fad0000b040).stop 2023-10-18T22:32:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 -- 172.21.15.8:0/3903648052 shutdown_connections 2023-10-18T22:32:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7facfc060f70 0x7facfc063430 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad0c0f6530 0x7fad0c108ee0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 --2- 172.21.15.8:0/3903648052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad0c0f77d0 0x7fad0c1093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 -- 172.21.15.8:0/3903648052 >> 172.21.15.8:0/3903648052 conn(0x7fad0c0f1c90 msgr2=0x7fad0c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 -- 172.21.15.8:0/3903648052 shutdown_connections 2023-10-18T22:32:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.018+0000 7fad11af9700 1 -- 172.21.15.8:0/3903648052 wait complete. 2023-10-18T22:32:39.035 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:32:39.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.156+0000 7f070d7c4700 1 -- 172.21.15.8:0/3203859041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0708060310 msgr2=0x7f07080f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.156+0000 7f070d7c4700 1 --2- 172.21.15.8:0/3203859041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0708060310 0x7f07080f9110 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 rx=0x7f06f8004660 tx=0x7f06f8009b30).stop 2023-10-18T22:32:39.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.156+0000 7f070d7c4700 1 -- 172.21.15.8:0/3203859041 shutdown_connections 2023-10-18T22:32:39.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.156+0000 7f070d7c4700 1 --2- 172.21.15.8:0/3203859041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07080f9690 0x7f07080fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.156+0000 7f070d7c4700 1 --2- 172.21.15.8:0/3203859041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0708060310 0x7f07080f9110 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.156+0000 7f070d7c4700 1 -- 172.21.15.8:0/3203859041 >> 172.21.15.8:0/3203859041 conn(0x7f07080f0b90 msgr2=0x7f07080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:39.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.156+0000 7f070d7c4700 1 -- 172.21.15.8:0/3203859041 shutdown_connections 2023-10-18T22:32:39.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.157+0000 7f070d7c4700 1 -- 172.21.15.8:0/3203859041 wait complete. 2023-10-18T22:32:39.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.157+0000 7f070d7c4700 1 Processor -- start 2023-10-18T22:32:39.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.157+0000 7f070d7c4700 1 -- start start 2023-10-18T22:32:39.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.158+0000 7f070d7c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0708060310 0x7f0708108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:39.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.158+0000 7f070d7c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07080f9690 0x7f07081093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:39.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.158+0000 7f070d7c4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708109980 con 0x7f0708060310 2023-10-18T22:32:39.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.158+0000 7f070d7c4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708109ac0 con 0x7f07080f9690 2023-10-18T22:32:39.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.158+0000 7f0707fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0708060310 0x7f0708108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:39.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.158+0000 7f0707fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0708060310 0x7f0708108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48180/0 (socket says 172.21.15.8:48180) 2023-10-18T22:32:39.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.158+0000 7f0707fff700 1 -- 172.21.15.8:0/4074705479 learned_addr learned my addr 172.21.15.8:0/4074705479 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:39.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.158+0000 7f07077fe700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07080f9690 0x7f07081093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:39.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.158+0000 7f0707fff700 1 -- 172.21.15.8:0/4074705479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07080f9690 msgr2=0x7f07081093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.158+0000 7f0707fff700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07080f9690 0x7f07081093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.159+0000 7f0707fff700 1 -- 172.21.15.8:0/4074705479 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f8005040 con 0x7f0708060310 2023-10-18T22:32:39.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.159+0000 7f07077fe700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07080f9690 0x7f07081093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:32:39.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.159+0000 7f0707fff700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0708060310 0x7f0708108ee0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 rx=0x7f06f8004d80 tx=0x7f06f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:39.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.159+0000 7f0704ff9700 1 -- 172.21.15.8:0/4074705479 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f8019070 con 0x7f0708060310 2023-10-18T22:32:39.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.159+0000 7f0704ff9700 1 -- 172.21.15.8:0/4074705479 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f06f801e420 con 0x7f0708060310 2023-10-18T22:32:39.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.159+0000 7f070d7c4700 1 -- 172.21.15.8:0/4074705479 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070810a400 con 0x7f0708060310 2023-10-18T22:32:39.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.159+0000 7f0704ff9700 1 -- 172.21.15.8:0/4074705479 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f8014680 con 0x7f0708060310 2023-10-18T22:32:39.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.159+0000 7f070d7c4700 1 -- 172.21.15.8:0/4074705479 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070810a8e0 con 0x7f0708060310 2023-10-18T22:32:39.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.160+0000 7f070d7c4700 1 -- 172.21.15.8:0/4074705479 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0708045ad0 con 0x7f0708060310 2023-10-18T22:32:39.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.161+0000 7f0704ff9700 1 -- 172.21.15.8:0/4074705479 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f06f801e9c0 con 0x7f0708060310 2023-10-18T22:32:39.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.162+0000 7f0704ff9700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06f0060f70 0x7f06f0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:39.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.162+0000 7f0704ff9700 1 -- 172.21.15.8:0/4074705479 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f06f807dde0 con 0x7f0708060310 2023-10-18T22:32:39.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.163+0000 7f07077fe700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06f0060f70 0x7f06f0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:39.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.163+0000 7f07077fe700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06f0060f70 0x7f06f0063430 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f06fc009da0 tx=0x7f06fc00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:39.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.167+0000 7f0704ff9700 1 -- 172.21.15.8:0/4074705479 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f06f8051440 con 0x7f0708060310 2023-10-18T22:32:39.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.364+0000 7f070d7c4700 1 -- 172.21.15.8:0/4074705479 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f070810b120 con 0x7f06f0060f70 2023-10-18T22:32:39.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.365+0000 7f0704ff9700 1 -- 172.21.15.8:0/4074705479 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f070810b120 con 0x7f06f0060f70 2023-10-18T22:32:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 -- 172.21.15.8:0/4074705479 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06f0060f70 msgr2=0x7f06f0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06f0060f70 0x7f06f0063430 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f06fc009da0 tx=0x7f06fc00b040).stop 2023-10-18T22:32:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 -- 172.21.15.8:0/4074705479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0708060310 msgr2=0x7f0708108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0708060310 0x7f0708108ee0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 rx=0x7f06f8004d80 tx=0x7f06f800b040).stop 2023-10-18T22:32:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 -- 172.21.15.8:0/4074705479 shutdown_connections 2023-10-18T22:32:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f06f0060f70 0x7f06f0063430 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0708060310 0x7f0708108ee0 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 --2- 172.21.15.8:0/4074705479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07080f9690 0x7f07081093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 -- 172.21.15.8:0/4074705479 >> 172.21.15.8:0/4074705479 conn(0x7f07080f0b90 msgr2=0x7f07080f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 -- 172.21.15.8:0/4074705479 shutdown_connections 2023-10-18T22:32:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.368+0000 7f070d7c4700 1 -- 172.21.15.8:0/4074705479 wait complete. 2023-10-18T22:32:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.504+0000 7f5df53b1700 1 -- 172.21.15.8:0/1229271741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5df00f77d0 msgr2=0x7f5df00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.504+0000 7f5df53b1700 1 --2- 172.21.15.8:0/1229271741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5df00f77d0 0x7f5df00f7c30 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 rx=0x7f5de4004660 tx=0x7f5de4009b30).stop 2023-10-18T22:32:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.504+0000 7f5df53b1700 1 -- 172.21.15.8:0/1229271741 shutdown_connections 2023-10-18T22:32:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.504+0000 7f5df53b1700 1 --2- 172.21.15.8:0/1229271741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5df00f77d0 0x7f5df00f7c30 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.504+0000 7f5df53b1700 1 --2- 172.21.15.8:0/1229271741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df00f6530 0x7f5df00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T22:32:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.504+0000 7f5df53b1700 1 -- 172.21.15.8:0/1229271741 >> 172.21.15.8:0/1229271741 conn(0x7f5df00f1c90 msgr2=0x7f5df00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.504+0000 7f5df53b1700 1 -- 172.21.15.8:0/1229271741 shutdown_connections 2023-10-18T22:32:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.504+0000 7f5df53b1700 1 -- 172.21.15.8:0/1229271741 wait complete. 2023-10-18T22:32:39.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.505+0000 7f5df53b1700 1 Processor -- start 2023-10-18T22:32:39.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.505+0000 7f5df53b1700 1 -- start start 2023-10-18T22:32:39.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5df53b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5df00f6530 0x7f5df0108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:39.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5df53b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df00f77d0 0x7f5df01094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5df53b1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df0109b00 con 0x7f5df00f6530 2023-10-18T22:32:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5df53b1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df010a3b0 con 0x7f5df00f77d0 2023-10-18T22:32:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5deffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5df00f6530 0x7f5df0108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5deffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5df00f6530 0x7f5df0108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48198/0 (socket says 172.21.15.8:48198) 2023-10-18T22:32:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5deffff700 1 -- 172.21.15.8:0/885501556 learned_addr learned my addr 172.21.15.8:0/885501556 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5def7fe700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df00f77d0 0x7f5df01094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5deffff700 1 -- 172.21.15.8:0/885501556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df00f77d0 msgr2=0x7f5df01094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5deffff700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df00f77d0 0x7f5df01094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.506+0000 7f5deffff700 1 -- 172.21.15.8:0/885501556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de4005040 con 0x7f5df00f6530 2023-10-18T22:32:39.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.507+0000 7f5deffff700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5df00f6530 0x7f5df0108fd0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 rx=0x7f5de00093f0 tx=0x7f5de0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.507+0000 7f5decff9700 1 -- 172.21.15.8:0/885501556 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5de0009ea0 con 0x7f5df00f6530 2023-10-18T22:32:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.507+0000 7f5decff9700 1 -- 172.21.15.8:0/885501556 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5de0013b00 con 0x7f5df00f6530 2023-10-18T22:32:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.507+0000 7f5decff9700 1 -- 172.21.15.8:0/885501556 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5de000dbf0 con 0x7f5df00f6530 2023-10-18T22:32:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.507+0000 7f5df53b1700 1 -- 172.21.15.8:0/885501556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df010a690 con 0x7f5df00f6530 2023-10-18T22:32:39.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.507+0000 7f5df53b1700 1 -- 172.21.15.8:0/885501556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df010ac50 con 0x7f5df00f6530 2023-10-18T22:32:39.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.508+0000 7f5df53b1700 1 -- 172.21.15.8:0/885501556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df0059100 con 0x7f5df00f6530 2023-10-18T22:32:39.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.509+0000 7f5decff9700 1 -- 172.21.15.8:0/885501556 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f5de001a060 con 0x7f5df00f6530 2023-10-18T22:32:39.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.510+0000 7f5decff9700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5dd8060f70 0x7f5dd8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:39.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.510+0000 7f5decff9700 1 -- 172.21.15.8:0/885501556 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f5de007c890 con 0x7f5df00f6530 2023-10-18T22:32:39.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.510+0000 7f5def7fe700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5dd8060f70 0x7f5dd8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:39.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.511+0000 7f5def7fe700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5dd8060f70 0x7f5dd8063430 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f5de4009490 tx=0x7f5de4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:39.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.514+0000 7f5decff9700 1 -- 172.21.15.8:0/885501556 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f5de004ff50 con 0x7f5df00f6530 2023-10-18T22:32:39.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.713+0000 7f5df53b1700 1 -- 172.21.15.8:0/885501556 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5df00fee20 con 0x7f5dd8060f70 2023-10-18T22:32:39.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.723+0000 7f5decff9700 1 -- 172.21.15.8:0/885501556 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f5df00fee20 con 0x7f5dd8060f70 2023-10-18T22:32:39.725 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:32:39.726 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (99m) 6m ago 100m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:32:39.726 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (93m) 6m ago 100m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:32:39.726 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (93m) 4m ago 99m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:32:39.726 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (99m) 6m ago 100m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:32:39.726 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 96m - - 2023-10-18T22:32:39.727 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 96m - - 2023-10-18T22:32:39.727 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 96m - - 2023-10-18T22:32:39.727 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 96m - - 2023-10-18T22:32:39.727 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (94m) 6m ago 102m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:32:39.727 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (93m) 4m ago 99m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:32:39.728 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (93m) 6m ago 102m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:32:39.728 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (93m) 4m ago 99m 342M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:32:39.728 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (100m) 6m ago 100m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:32:39.728 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (99m) 4m ago 99m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:32:39.728 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (92m) 6m ago 99m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:32:39.729 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (90m) 6m ago 99m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:32:39.729 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (90m) 6m ago 98m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:32:39.729 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (89m) 4m ago 98m 559M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:32:39.729 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (89m) 4m ago 98m 479M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:32:39.729 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (88m) 4m ago 97m 407M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:32:39.729 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (94m) 6m ago 100m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:32:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.724+0000 7f5df53b1700 1 -- 172.21.15.8:0/885501556 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5dd8060f70 msgr2=0x7f5dd8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.724+0000 7f5df53b1700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5dd8060f70 0x7f5dd8063430 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f5de4009490 tx=0x7f5de4009b30).stop 2023-10-18T22:32:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.724+0000 7f5df53b1700 1 -- 172.21.15.8:0/885501556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5df00f6530 msgr2=0x7f5df0108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.724+0000 7f5df53b1700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5df00f6530 0x7f5df0108fd0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 rx=0x7f5de00093f0 tx=0x7f5de0006ec0).stop 2023-10-18T22:32:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.725+0000 7f5df53b1700 1 -- 172.21.15.8:0/885501556 shutdown_connections 2023-10-18T22:32:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.725+0000 7f5df53b1700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5dd8060f70 0x7f5dd8063430 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.725+0000 7f5df53b1700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5df00f6530 0x7f5df0108fd0 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.725+0000 7f5df53b1700 1 --2- 172.21.15.8:0/885501556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df00f77d0 0x7f5df01094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.725+0000 7f5df53b1700 1 -- 172.21.15.8:0/885501556 >> 172.21.15.8:0/885501556 conn(0x7f5df00f1c90 msgr2=0x7f5df00f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.725+0000 7f5df53b1700 1 -- 172.21.15.8:0/885501556 shutdown_connections 2023-10-18T22:32:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.725+0000 7f5df53b1700 1 -- 172.21.15.8:0/885501556 wait complete. 2023-10-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.859+0000 7f10c34ce700 1 -- 172.21.15.8:0/3519747413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10bc0f77d0 msgr2=0x7f10bc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.859+0000 7f10c34ce700 1 --2- 172.21.15.8:0/3519747413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10bc0f77d0 0x7f10bc0f7c30 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7f10ac004660 tx=0x7f10ac009b30).stop 2023-10-18T22:32:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.859+0000 7f10c34ce700 1 -- 172.21.15.8:0/3519747413 shutdown_connections 2023-10-18T22:32:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.859+0000 7f10c34ce700 1 --2- 172.21.15.8:0/3519747413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10bc0f77d0 0x7f10bc0f7c30 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.859+0000 7f10c34ce700 1 --2- 172.21.15.8:0/3519747413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10bc0f6530 0x7f10bc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.859+0000 7f10c34ce700 1 -- 172.21.15.8:0/3519747413 >> 172.21.15.8:0/3519747413 conn(0x7f10bc0f1c90 msgr2=0x7f10bc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.860+0000 7f10c34ce700 1 -- 172.21.15.8:0/3519747413 shutdown_connections 2023-10-18T22:32:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.860+0000 7f10c34ce700 1 -- 172.21.15.8:0/3519747413 wait complete. 2023-10-18T22:32:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.860+0000 7f10c34ce700 1 Processor -- start 2023-10-18T22:32:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.861+0000 7f10c34ce700 1 -- start start 2023-10-18T22:32:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.861+0000 7f10c34ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10bc0f6530 0x7f10bc108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.861+0000 7f10c34ce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10bc0f77d0 0x7f10bc109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.861+0000 7f10c34ce700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc109a20 con 0x7f10bc0f77d0 2023-10-18T22:32:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.861+0000 7f10c34ce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc109b60 con 0x7f10bc0f6530 2023-10-18T22:32:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.861+0000 7f10c1ccb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10bc0f77d0 0x7f10bc109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.861+0000 7f10c1ccb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10bc0f77d0 0x7f10bc109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48208/0 (socket says 172.21.15.8:48208) 2023-10-18T22:32:39.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.861+0000 7f10c1ccb700 1 -- 172.21.15.8:0/3481352036 learned_addr learned my addr 172.21.15.8:0/3481352036 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:39.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.861+0000 7f10c24cc700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10bc0f6530 0x7f10bc108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:39.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.862+0000 7f10c1ccb700 1 -- 172.21.15.8:0/3481352036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10bc0f6530 msgr2=0x7f10bc108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:39.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.862+0000 7f10c1ccb700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10bc0f6530 0x7f10bc108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:39.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.862+0000 7f10c1ccb700 1 -- 172.21.15.8:0/3481352036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac005040 con 0x7f10bc0f77d0 2023-10-18T22:32:39.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.862+0000 7f10c24cc700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10bc0f6530 0x7f10bc108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:32:39.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.862+0000 7f10c1ccb700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10bc0f77d0 0x7f10bc109470 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 rx=0x7f10ac009990 tx=0x7f10ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:39.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.862+0000 7f10b2ffd700 1 -- 172.21.15.8:0/3481352036 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10ac018070 con 0x7f10bc0f77d0 2023-10-18T22:32:39.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.862+0000 7f10b2ffd700 1 -- 172.21.15.8:0/3481352036 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f10ac009630 con 0x7f10bc0f77d0 2023-10-18T22:32:39.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.862+0000 7f10c34ce700 1 -- 172.21.15.8:0/3481352036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc10a4a0 con 0x7f10bc0f77d0 2023-10-18T22:32:39.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.862+0000 7f10b2ffd700 1 -- 172.21.15.8:0/3481352036 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10ac01c400 con 0x7f10bc0f77d0 2023-10-18T22:32:39.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.862+0000 7f10c34ce700 1 -- 172.21.15.8:0/3481352036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc10aa00 con 0x7f10bc0f77d0 2023-10-18T22:32:39.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.863+0000 7f10c34ce700 1 -- 172.21.15.8:0/3481352036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc045ad0 con 0x7f10bc0f77d0 2023-10-18T22:32:39.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.864+0000 7f10b2ffd700 1 -- 172.21.15.8:0/3481352036 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f10ac01d9e0 con 0x7f10bc0f77d0 2023-10-18T22:32:39.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.865+0000 7f10b2ffd700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a8060f70 0x7f10a8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:39.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.865+0000 7f10b2ffd700 1 -- 172.21.15.8:0/3481352036 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f10ac07e680 con 0x7f10bc0f77d0 2023-10-18T22:32:39.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.865+0000 7f10c24cc700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a8060f70 0x7f10a8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:39.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.866+0000 7f10c24cc700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a8060f70 0x7f10a8063430 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f10bc0f7630 tx=0x7f10b8009c00).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:39.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:39.869+0000 7f10b2ffd700 1 -- 172.21.15.8:0/3481352036 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f10ac051ce0 con 0x7f10bc0f77d0 2023-10-18T22:32:39.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:39.017291+0000 mgr.smithi008.flmjzp (mgr.14640) 5619 : audit [DBG] from='client.38464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:39.366868+0000 mgr.smithi008.flmjzp (mgr.14640) 5620 : audit [DBG] from='client.38468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:39.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:39 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:39.565975+0000 mgr.smithi008.flmjzp (mgr.14640) 5621 : cluster [DBG] pgmap v3853: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:39.017291+0000 mgr.smithi008.flmjzp (mgr.14640) 5619 : audit [DBG] from='client.38464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:39.366868+0000 mgr.smithi008.flmjzp (mgr.14640) 5620 : audit [DBG] from='client.38468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:39.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:39 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:39.565975+0000 mgr.smithi008.flmjzp (mgr.14640) 5621 : cluster [DBG] pgmap v3853: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:40.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.120+0000 7f10c34ce700 1 -- 172.21.15.8:0/3481352036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f10bc0fed60 con 0x7f10bc0f77d0 2023-10-18T22:32:40.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.120+0000 7f10b2ffd700 1 -- 172.21.15.8:0/3481352036 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f10ac0518d0 con 0x7f10bc0f77d0 2023-10-18T22:32:40.123 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:32:40.124 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:32:40.124 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:32:40.124 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:32:40.124 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:32:40.124 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:32:40.125 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:32:40.125 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:32:40.125 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:32:40.125 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:32:40.125 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:32:40.126 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:32:40.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:32:40.126 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:32:40.126 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:32:40.126 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:32:40.127 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:32:40.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.122+0000 7f10c34ce700 1 -- 172.21.15.8:0/3481352036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a8060f70 msgr2=0x7f10a8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:40.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.122+0000 7f10c34ce700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a8060f70 0x7f10a8063430 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f10bc0f7630 tx=0x7f10b8009c00).stop 2023-10-18T22:32:40.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.122+0000 7f10c34ce700 1 -- 172.21.15.8:0/3481352036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10bc0f77d0 msgr2=0x7f10bc109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:40.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.122+0000 7f10c34ce700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10bc0f77d0 0x7f10bc109470 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 rx=0x7f10ac009990 tx=0x7f10ac009b30).stop 2023-10-18T22:32:40.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.123+0000 7f10c34ce700 1 -- 172.21.15.8:0/3481352036 shutdown_connections 2023-10-18T22:32:40.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.123+0000 7f10c34ce700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f10a8060f70 0x7f10a8063430 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.123+0000 7f10c34ce700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10bc0f6530 0x7f10bc108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.123+0000 7f10c34ce700 1 --2- 172.21.15.8:0/3481352036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10bc0f77d0 0x7f10bc109470 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.123+0000 7f10c34ce700 1 -- 172.21.15.8:0/3481352036 >> 172.21.15.8:0/3481352036 conn(0x7f10bc0f1c90 msgr2=0x7f10bc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:40.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.123+0000 7f10c34ce700 1 -- 172.21.15.8:0/3481352036 shutdown_connections 2023-10-18T22:32:40.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.123+0000 7f10c34ce700 1 -- 172.21.15.8:0/3481352036 wait complete. 2023-10-18T22:32:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.259+0000 7f460f96a700 1 -- 172.21.15.8:0/2633277895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f460806a350 msgr2=0x7f460806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.259+0000 7f460f96a700 1 --2- 172.21.15.8:0/2633277895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f460806a350 0x7f460806a7d0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7f45f8004660 tx=0x7f45f8009b30).stop 2023-10-18T22:32:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.259+0000 7f460f96a700 1 -- 172.21.15.8:0/2633277895 shutdown_connections 2023-10-18T22:32:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.259+0000 7f460f96a700 1 --2- 172.21.15.8:0/2633277895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f460806a350 0x7f460806a7d0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.259+0000 7f460f96a700 1 --2- 172.21.15.8:0/2633277895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f460806b960 0x7f4608069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.259+0000 7f460f96a700 1 -- 172.21.15.8:0/2633277895 >> 172.21.15.8:0/2633277895 conn(0x7f46080f1e40 msgr2=0x7f46080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.260+0000 7f460f96a700 1 -- 172.21.15.8:0/2633277895 shutdown_connections 2023-10-18T22:32:40.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.260+0000 7f460f96a700 1 -- 172.21.15.8:0/2633277895 wait complete. 2023-10-18T22:32:40.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.260+0000 7f460f96a700 1 Processor -- start 2023-10-18T22:32:40.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.261+0000 7f460f96a700 1 -- start start 2023-10-18T22:32:40.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.261+0000 7f460f96a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f460806a350 0x7f4608109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:40.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.261+0000 7f460f96a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f460806b960 0x7f4608109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:40.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.261+0000 7f460f96a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4608109c00 con 0x7f460806a350 2023-10-18T22:32:40.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.261+0000 7f460f96a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4608109d40 con 0x7f460806b960 2023-10-18T22:32:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.261+0000 7f460d706700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f460806a350 0x7f4608109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.261+0000 7f460d706700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f460806a350 0x7f4608109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48226/0 (socket says 172.21.15.8:48226) 2023-10-18T22:32:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.261+0000 7f460d706700 1 -- 172.21.15.8:0/2080643946 learned_addr learned my addr 172.21.15.8:0/2080643946 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.261+0000 7f460cf05700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f460806b960 0x7f4608109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.262+0000 7f460d706700 1 -- 172.21.15.8:0/2080643946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f460806b960 msgr2=0x7f4608109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.262+0000 7f460d706700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f460806b960 0x7f4608109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.262+0000 7f460d706700 1 -- 172.21.15.8:0/2080643946 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8005040 con 0x7f460806a350 2023-10-18T22:32:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.262+0000 7f460d706700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f460806a350 0x7f4608109160 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7f46040026d0 tx=0x7f4604009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.262+0000 7f45fdffb700 1 -- 172.21.15.8:0/2080643946 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46040079c0 con 0x7f460806a350 2023-10-18T22:32:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.262+0000 7f45fdffb700 1 -- 172.21.15.8:0/2080643946 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f460400f040 con 0x7f460806a350 2023-10-18T22:32:40.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.262+0000 7f45fdffb700 1 -- 172.21.15.8:0/2080643946 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4604014980 con 0x7f460806a350 2023-10-18T22:32:40.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.262+0000 7f460f96a700 1 -- 172.21.15.8:0/2080643946 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460810a6e0 con 0x7f460806a350 2023-10-18T22:32:40.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.262+0000 7f460f96a700 1 -- 172.21.15.8:0/2080643946 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460810aca0 con 0x7f460806a350 2023-10-18T22:32:40.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.263+0000 7f460f96a700 1 -- 172.21.15.8:0/2080643946 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4608045ad0 con 0x7f460806a350 2023-10-18T22:32:40.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.264+0000 7f45fdffb700 1 -- 172.21.15.8:0/2080643946 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f46040090d0 con 0x7f460806a350 2023-10-18T22:32:40.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.265+0000 7f45fdffb700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45f4060f20 0x7f45f40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:40.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.265+0000 7f45fdffb700 1 -- 172.21.15.8:0/2080643946 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f460407c8a0 con 0x7f460806a350 2023-10-18T22:32:40.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.265+0000 7f460cf05700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45f4060f20 0x7f45f40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:40.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.266+0000 7f460cf05700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45f4060f20 0x7f45f40633e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f45f8004630 tx=0x7f45f8009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:40.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.269+0000 7f45fdffb700 1 -- 172.21.15.8:0/2080643946 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f460404ffb0 con 0x7f460806a350 2023-10-18T22:32:40.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.498+0000 7f460f96a700 1 -- 172.21.15.8:0/2080643946 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4608101170 con 0x7f460806a350 2023-10-18T22:32:40.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.498+0000 7f45fdffb700 1 -- 172.21.15.8:0/2080643946 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f460404fba0 con 0x7f460806a350 2023-10-18T22:32:40.502 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:32:40.502 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:32:40.502 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:32:40.503 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:32:40.503 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:32:40.503 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:32:40.504 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:32:40.504 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:32:40.504 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:32:40.505 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:32:40.505 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:32:40.505 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:32:40.505 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:32:40.506 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:32:40.506 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:32:40.506 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:32:40.507 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:32:40.507 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:32:40.507 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:32:40.508 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:32:40.508 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:32:40.508 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:32:40.508 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:32:40.509 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:32:40.509 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:32:40.509 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:32:40.509 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:32:40.509 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:32:40.510 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:32:40.510 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:32:40.510 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:32:40.510 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:32:40.510 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:32:40.511 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:32:40.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.500+0000 7f460f96a700 1 -- 172.21.15.8:0/2080643946 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45f4060f20 msgr2=0x7f45f40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:40.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.500+0000 7f460f96a700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45f4060f20 0x7f45f40633e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f45f8004630 tx=0x7f45f8009b30).stop 2023-10-18T22:32:40.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.500+0000 7f460f96a700 1 -- 172.21.15.8:0/2080643946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f460806a350 msgr2=0x7f4608109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:40.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.500+0000 7f460f96a700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f460806a350 0x7f4608109160 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7f46040026d0 tx=0x7f4604009de0).stop 2023-10-18T22:32:40.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.501+0000 7f460f96a700 1 -- 172.21.15.8:0/2080643946 shutdown_connections 2023-10-18T22:32:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.501+0000 7f460f96a700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f45f4060f20 0x7f45f40633e0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.501+0000 7f460f96a700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f460806a350 0x7f4608109160 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.501+0000 7f460f96a700 1 --2- 172.21.15.8:0/2080643946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f460806b960 0x7f4608109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.501+0000 7f460f96a700 1 -- 172.21.15.8:0/2080643946 >> 172.21.15.8:0/2080643946 conn(0x7f46080f1e40 msgr2=0x7f46080fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:40.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.501+0000 7f460f96a700 1 -- 172.21.15.8:0/2080643946 shutdown_connections 2023-10-18T22:32:40.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.501+0000 7f460f96a700 1 -- 172.21.15.8:0/2080643946 wait complete. 2023-10-18T22:32:40.514 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:32:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.638+0000 7f4e9759e700 1 -- 172.21.15.8:0/2909603492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 msgr2=0x7f4e980f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.638+0000 7f4e9759e700 1 --2- 172.21.15.8:0/2909603492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e980f6950 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 rx=0x7f4e88004660 tx=0x7f4e88009b30).stop 2023-10-18T22:32:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.638+0000 7f4e9759e700 1 -- 172.21.15.8:0/2909603492 shutdown_connections 2023-10-18T22:32:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.638+0000 7f4e9759e700 1 --2- 172.21.15.8:0/2909603492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 0x7f4e980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.638+0000 7f4e9759e700 1 --2- 172.21.15.8:0/2909603492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e980f6950 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.638+0000 7f4e9759e700 1 -- 172.21.15.8:0/2909603492 >> 172.21.15.8:0/2909603492 conn(0x7f4e980f1c90 msgr2=0x7f4e980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.638+0000 7f4e9759e700 1 -- 172.21.15.8:0/2909603492 shutdown_connections 2023-10-18T22:32:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.638+0000 7f4e9759e700 1 -- 172.21.15.8:0/2909603492 wait complete. 2023-10-18T22:32:40.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.639+0000 7f4e9759e700 1 Processor -- start 2023-10-18T22:32:40.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.639+0000 7f4e9759e700 1 -- start start 2023-10-18T22:32:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e9759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e9759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 0x7f4e98069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e9759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9806a380 con 0x7f4e980f6530 2023-10-18T22:32:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e9759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9806a4c0 con 0x7f4e980f77d0 2023-10-18T22:32:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e9659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e9659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48234/0 (socket says 172.21.15.8:48234) 2023-10-18T22:32:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e9659c700 1 -- 172.21.15.8:0/3170546065 learned_addr learned my addr 172.21.15.8:0/3170546065 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:32:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e95d9b700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 0x7f4e98069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e9659c700 1 -- 172.21.15.8:0/3170546065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 msgr2=0x7f4e98069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:40.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e9659c700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 0x7f4e98069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.640+0000 7f4e9659c700 1 -- 172.21.15.8:0/3170546065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e88005040 con 0x7f4e980f6530 2023-10-18T22:32:40.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.641+0000 7f4e9659c700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 rx=0x7f4e88014040 tx=0x7f4e8800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:40.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.641+0000 7f4e86ffd700 1 -- 172.21.15.8:0/3170546065 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e88019070 con 0x7f4e980f6530 2023-10-18T22:32:40.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.641+0000 7f4e9759e700 1 -- 172.21.15.8:0/3170546065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9806a740 con 0x7f4e980f6530 2023-10-18T22:32:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.641+0000 7f4e86ffd700 1 -- 172.21.15.8:0/3170546065 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4e8801e420 con 0x7f4e980f6530 2023-10-18T22:32:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.641+0000 7f4e86ffd700 1 -- 172.21.15.8:0/3170546065 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e88014660 con 0x7f4e980f6530 2023-10-18T22:32:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.641+0000 7f4e9759e700 1 -- 172.21.15.8:0/3170546065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9806ac20 con 0x7f4e980f6530 2023-10-18T22:32:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.642+0000 7f4e9759e700 1 -- 172.21.15.8:0/3170546065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e98045ad0 con 0x7f4e980f6530 2023-10-18T22:32:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.643+0000 7f4e86ffd700 1 -- 172.21.15.8:0/3170546065 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4e8801e9e0 con 0x7f4e980f6530 2023-10-18T22:32:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.644+0000 7f4e86ffd700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e80060f70 0x7f4e80063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:32:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.644+0000 7f4e86ffd700 1 -- 172.21.15.8:0/3170546065 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4e8807de90 con 0x7f4e980f6530 2023-10-18T22:32:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.644+0000 7f4e95d9b700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e80060f70 0x7f4e80063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:32:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.644+0000 7f4e95d9b700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e80060f70 0x7f4e80063430 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f4e8c007fd0 tx=0x7f4e8c00b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:32:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.648+0000 7f4e86ffd700 1 -- 172.21.15.8:0/3170546065 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4e8804da40 con 0x7f4e980f6530 2023-10-18T22:32:40.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.849+0000 7f4e9759e700 1 -- 172.21.15.8:0/3170546065 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e980fedd0 con 0x7f4e80060f70 2023-10-18T22:32:40.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.851+0000 7f4e86ffd700 1 -- 172.21.15.8:0/3170546065 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4e980fedd0 con 0x7f4e80060f70 2023-10-18T22:32:40.853 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:32:40.854 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:32:40.854 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:32:40.854 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:32:40.854 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:32:40.855 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:32:40.855 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:32:40.855 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:32:40.855 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:32:40.855 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:32:40.856 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:32:40.856 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:32:40.856 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:32:40.857 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:32:40.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 -- 172.21.15.8:0/3170546065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e80060f70 msgr2=0x7f4e80063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:40.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e80060f70 0x7f4e80063430 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f4e8c007fd0 tx=0x7f4e8c00b040).stop 2023-10-18T22:32:40.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 -- 172.21.15.8:0/3170546065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 msgr2=0x7f4e9806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:32:40.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 rx=0x7f4e88014040 tx=0x7f4e8800b040).stop 2023-10-18T22:32:40.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 -- 172.21.15.8:0/3170546065 shutdown_connections 2023-10-18T22:32:40.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4e80060f70 0x7f4e80063430 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e980f6530 0x7f4e9806b9a0 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 --2- 172.21.15.8:0/3170546065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e980f77d0 0x7f4e98069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:32:40.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 -- 172.21.15.8:0/3170546065 >> 172.21.15.8:0/3170546065 conn(0x7f4e980f1c90 msgr2=0x7f4e980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:32:40.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 -- 172.21.15.8:0/3170546065 shutdown_connections 2023-10-18T22:32:40.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:32:40.853+0000 7f4e9759e700 1 -- 172.21.15.8:0/3170546065 wait complete. 2023-10-18T22:32:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:39.715593+0000 mgr.smithi008.flmjzp (mgr.14640) 5622 : audit [DBG] from='client.38472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:40.122092+0000 mon.smithi008 (mon.0) 5845 : audit [DBG] from='client.? 172.21.15.8:0/3481352036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:40.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:40.500027+0000 mon.smithi008 (mon.0) 5846 : audit [DBG] from='client.? 172.21.15.8:0/2080643946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:32:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:39.715593+0000 mgr.smithi008.flmjzp (mgr.14640) 5622 : audit [DBG] from='client.38472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:40.122092+0000 mon.smithi008 (mon.0) 5845 : audit [DBG] from='client.? 172.21.15.8:0/3481352036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:40.500027+0000 mon.smithi008 (mon.0) 5846 : audit [DBG] from='client.? 172.21.15.8:0/2080643946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:32:42.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:40.852035+0000 mgr.smithi008.flmjzp (mgr.14640) 5623 : audit [DBG] from='client.38484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:41.566466+0000 mgr.smithi008.flmjzp (mgr.14640) 5624 : cluster [DBG] pgmap v3854: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:41.596040+0000 mon.smithi008 (mon.0) 5847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:42.149719+0000 mon.smithi008 (mon.0) 5848 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:42.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:42.150535+0000 mon.smithi008 (mon.0) 5849 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:42.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:42.155863+0000 mon.smithi008 (mon.0) 5850 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:42.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:42.160823+0000 mon.smithi008 (mon.0) 5851 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:42.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:42.163243+0000 mon.smithi008 (mon.0) 5852 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:42.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:42.164527+0000 mon.smithi008 (mon.0) 5853 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:42.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:42.165756+0000 mon.smithi008 (mon.0) 5854 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:42.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:42.167371+0000 mon.smithi008 (mon.0) 5855 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:40.852035+0000 mgr.smithi008.flmjzp (mgr.14640) 5623 : audit [DBG] from='client.38484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:32:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:41.566466+0000 mgr.smithi008.flmjzp (mgr.14640) 5624 : cluster [DBG] pgmap v3854: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:41.596040+0000 mon.smithi008 (mon.0) 5847 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:42.149719+0000 mon.smithi008 (mon.0) 5848 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:42.150535+0000 mon.smithi008 (mon.0) 5849 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:42.155863+0000 mon.smithi008 (mon.0) 5850 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:42.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:42.160823+0000 mon.smithi008 (mon.0) 5851 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:42.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:42.163243+0000 mon.smithi008 (mon.0) 5852 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:42.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:42.164527+0000 mon.smithi008 (mon.0) 5853 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:42.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:42.165756+0000 mon.smithi008 (mon.0) 5854 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:42.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:42.167371+0000 mon.smithi008 (mon.0) 5855 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:43.871 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:42.151145+0000 mgr.smithi008.flmjzp (mgr.14640) 5625 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:43.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:42.151674+0000 mgr.smithi008.flmjzp (mgr.14640) 5626 : cluster [DBG] pgmap v3855: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:43.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:42.151963+0000 mgr.smithi008.flmjzp (mgr.14640) 5627 : cluster [DBG] pgmap v3856: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:43.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:42.168933+0000 mgr.smithi008.flmjzp (mgr.14640) 5628 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:42.151145+0000 mgr.smithi008.flmjzp (mgr.14640) 5625 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:42.151674+0000 mgr.smithi008.flmjzp (mgr.14640) 5626 : cluster [DBG] pgmap v3855: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:42.151963+0000 mgr.smithi008.flmjzp (mgr.14640) 5627 : cluster [DBG] pgmap v3856: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:43.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:42.168933+0000 mgr.smithi008.flmjzp (mgr.14640) 5628 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:45.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:44.152586+0000 mgr.smithi008.flmjzp (mgr.14640) 5629 : cluster [DBG] pgmap v3857: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:44.152586+0000 mgr.smithi008.flmjzp (mgr.14640) 5629 : cluster [DBG] pgmap v3857: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:46.153128+0000 mgr.smithi008.flmjzp (mgr.14640) 5630 : cluster [DBG] pgmap v3858: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:46.153128+0000 mgr.smithi008.flmjzp (mgr.14640) 5630 : cluster [DBG] pgmap v3858: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:49.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:48.153703+0000 mgr.smithi008.flmjzp (mgr.14640) 5631 : cluster [DBG] pgmap v3859: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:48.153703+0000 mgr.smithi008.flmjzp (mgr.14640) 5631 : cluster [DBG] pgmap v3859: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:50.154367+0000 mgr.smithi008.flmjzp (mgr.14640) 5632 : cluster [DBG] pgmap v3860: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:50.154367+0000 mgr.smithi008.flmjzp (mgr.14640) 5632 : cluster [DBG] pgmap v3860: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:52.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:52.179141+0000 mon.smithi008 (mon.0) 5856 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:52.529200+0000 mon.smithi008 (mon.0) 5857 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:52.530126+0000 mon.smithi008 (mon.0) 5858 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:52.530945+0000 mon.smithi008 (mon.0) 5859 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:52.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:52 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:52.535828+0000 mon.smithi008 (mon.0) 5860 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:52.179141+0000 mon.smithi008 (mon.0) 5856 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:52.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:52.529200+0000 mon.smithi008 (mon.0) 5857 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:52.530126+0000 mon.smithi008 (mon.0) 5858 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:32:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:52.530945+0000 mon.smithi008 (mon.0) 5859 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:32:52.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:52 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:52.535828+0000 mon.smithi008 (mon.0) 5860 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:32:53.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:52.155096+0000 mgr.smithi008.flmjzp (mgr.14640) 5633 : cluster [DBG] pgmap v3861: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:53.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:52.531644+0000 mgr.smithi008.flmjzp (mgr.14640) 5634 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:53.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:52.532093+0000 mgr.smithi008.flmjzp (mgr.14640) 5635 : cluster [DBG] pgmap v3862: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:53.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:52.532276+0000 mgr.smithi008.flmjzp (mgr.14640) 5636 : cluster [DBG] pgmap v3863: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:53.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:52.542013+0000 mon.smithi008 (mon.0) 5861 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:53.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:52.544509+0000 mon.smithi008 (mon.0) 5862 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:53.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:52.545719+0000 mon.smithi008 (mon.0) 5863 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:53.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:52.546884+0000 mon.smithi008 (mon.0) 5864 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:53.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:32:52.548398+0000 mon.smithi008 (mon.0) 5865 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:53.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:32:52.549997+0000 mgr.smithi008.flmjzp (mgr.14640) 5637 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:52.155096+0000 mgr.smithi008.flmjzp (mgr.14640) 5633 : cluster [DBG] pgmap v3861: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:52.531644+0000 mgr.smithi008.flmjzp (mgr.14640) 5634 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:32:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:52.532093+0000 mgr.smithi008.flmjzp (mgr.14640) 5635 : cluster [DBG] pgmap v3862: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:52.532276+0000 mgr.smithi008.flmjzp (mgr.14640) 5636 : cluster [DBG] pgmap v3863: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:52.542013+0000 mon.smithi008 (mon.0) 5861 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:32:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:52.544509+0000 mon.smithi008 (mon.0) 5862 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:53.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:52.545719+0000 mon.smithi008 (mon.0) 5863 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:53.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:52.546884+0000 mon.smithi008 (mon.0) 5864 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:53.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:32:52.548398+0000 mon.smithi008 (mon.0) 5865 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:32:53.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:32:52.549997+0000 mgr.smithi008.flmjzp (mgr.14640) 5637 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:32:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:54.532939+0000 mgr.smithi008.flmjzp (mgr.14640) 5638 : cluster [DBG] pgmap v3864: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:54.532939+0000 mgr.smithi008.flmjzp (mgr.14640) 5638 : cluster [DBG] pgmap v3864: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:56.533688+0000 mgr.smithi008.flmjzp (mgr.14640) 5639 : cluster [DBG] pgmap v3865: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:56.533688+0000 mgr.smithi008.flmjzp (mgr.14640) 5639 : cluster [DBG] pgmap v3865: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:32:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:32:58.534430+0000 mgr.smithi008.flmjzp (mgr.14640) 5640 : cluster [DBG] pgmap v3866: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:32:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:32:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:32:58.534430+0000 mgr.smithi008.flmjzp (mgr.14640) 5640 : cluster [DBG] pgmap v3866: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:00.535195+0000 mgr.smithi008.flmjzp (mgr.14640) 5641 : cluster [DBG] pgmap v3867: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:00.535195+0000 mgr.smithi008.flmjzp (mgr.14640) 5641 : cluster [DBG] pgmap v3867: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:02.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:02 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:02.557350+0000 mon.smithi008 (mon.0) 5866 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:02.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:02 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:02.557350+0000 mon.smithi008 (mon.0) 5866 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:03.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:02.535953+0000 mgr.smithi008.flmjzp (mgr.14640) 5642 : cluster [DBG] pgmap v3868: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:03.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:03.114353+0000 mon.smithi008 (mon.0) 5867 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:03.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:03.115610+0000 mon.smithi008 (mon.0) 5868 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:03.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:03.122185+0000 mon.smithi008 (mon.0) 5869 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:03.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:03.128762+0000 mon.smithi008 (mon.0) 5870 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:03.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:03.132092+0000 mon.smithi008 (mon.0) 5871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:03.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:03.133833+0000 mon.smithi008 (mon.0) 5872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:03.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:03.135541+0000 mon.smithi008 (mon.0) 5873 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:03.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:03.137651+0000 mon.smithi008 (mon.0) 5874 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:02.535953+0000 mgr.smithi008.flmjzp (mgr.14640) 5642 : cluster [DBG] pgmap v3868: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:03.114353+0000 mon.smithi008 (mon.0) 5867 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:03.115610+0000 mon.smithi008 (mon.0) 5868 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:03.122185+0000 mon.smithi008 (mon.0) 5869 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:03.128762+0000 mon.smithi008 (mon.0) 5870 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:03.132092+0000 mon.smithi008 (mon.0) 5871 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:03.133833+0000 mon.smithi008 (mon.0) 5872 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:03.135541+0000 mon.smithi008 (mon.0) 5873 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:03.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:03.137651+0000 mon.smithi008 (mon.0) 5874 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:03.116567+0000 mgr.smithi008.flmjzp (mgr.14640) 5643 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:03.117200+0000 mgr.smithi008.flmjzp (mgr.14640) 5644 : cluster [DBG] pgmap v3869: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:03.117576+0000 mgr.smithi008.flmjzp (mgr.14640) 5645 : cluster [DBG] pgmap v3870: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:03.139827+0000 mgr.smithi008.flmjzp (mgr.14640) 5646 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:03.116567+0000 mgr.smithi008.flmjzp (mgr.14640) 5643 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:03.117200+0000 mgr.smithi008.flmjzp (mgr.14640) 5644 : cluster [DBG] pgmap v3869: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:03.117576+0000 mgr.smithi008.flmjzp (mgr.14640) 5645 : cluster [DBG] pgmap v3870: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:03.139827+0000 mgr.smithi008.flmjzp (mgr.14640) 5646 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:05.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:05 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:05.118133+0000 mgr.smithi008.flmjzp (mgr.14640) 5647 : cluster [DBG] pgmap v3871: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:05.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:05 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:05.118133+0000 mgr.smithi008.flmjzp (mgr.14640) 5647 : cluster [DBG] pgmap v3871: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:08.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:08 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:07.118722+0000 mgr.smithi008.flmjzp (mgr.14640) 5648 : cluster [DBG] pgmap v3872: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:08.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:08 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:07.118722+0000 mgr.smithi008.flmjzp (mgr.14640) 5648 : cluster [DBG] pgmap v3872: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:10.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:10 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:09.119267+0000 mgr.smithi008.flmjzp (mgr.14640) 5649 : cluster [DBG] pgmap v3873: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:10.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:10 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:09.119267+0000 mgr.smithi008.flmjzp (mgr.14640) 5649 : cluster [DBG] pgmap v3873: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:11.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.007+0000 7f534d91e700 1 -- 172.21.15.8:0/809800805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53480f6530 msgr2=0x7f53480f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.007+0000 7f534d91e700 1 --2- 172.21.15.8:0/809800805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53480f6530 0x7f53480f6950 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 rx=0x7f533c004660 tx=0x7f533c009b30).stop 2023-10-18T22:33:11.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.007+0000 7f534d91e700 1 -- 172.21.15.8:0/809800805 shutdown_connections 2023-10-18T22:33:11.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.007+0000 7f534d91e700 1 --2- 172.21.15.8:0/809800805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53480f77d0 0x7f53480f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.007+0000 7f534d91e700 1 --2- 172.21.15.8:0/809800805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53480f6530 0x7f53480f6950 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.007+0000 7f534d91e700 1 -- 172.21.15.8:0/809800805 >> 172.21.15.8:0/809800805 conn(0x7f53480f1c90 msgr2=0x7f53480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:11.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.007+0000 7f534d91e700 1 -- 172.21.15.8:0/809800805 shutdown_connections 2023-10-18T22:33:11.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.008+0000 7f534d91e700 1 -- 172.21.15.8:0/809800805 wait complete. 2023-10-18T22:33:11.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.008+0000 7f534d91e700 1 Processor -- start 2023-10-18T22:33:11.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.009+0000 7f534d91e700 1 -- start start 2023-10-18T22:33:11.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.009+0000 7f534d91e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53480f6530 0x7f5348106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:11.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.009+0000 7f534d91e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53480f77d0 0x7f5348107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:11.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.009+0000 7f534d91e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348107910 con 0x7f53480f6530 2023-10-18T22:33:11.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.009+0000 7f534d91e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348108120 con 0x7f53480f77d0 2023-10-18T22:33:11.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.009+0000 7f534c91c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53480f6530 0x7f5348106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:11.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.009+0000 7f534c91c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53480f6530 0x7f5348106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44734/0 (socket says 172.21.15.8:44734) 2023-10-18T22:33:11.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.009+0000 7f534c91c700 1 -- 172.21.15.8:0/854259691 learned_addr learned my addr 172.21.15.8:0/854259691 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:11.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.010+0000 7f5347fff700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53480f77d0 0x7f5348107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:11.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.010+0000 7f534c91c700 1 -- 172.21.15.8:0/854259691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53480f77d0 msgr2=0x7f5348107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.010+0000 7f534c91c700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53480f77d0 0x7f5348107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.010+0000 7f534c91c700 1 -- 172.21.15.8:0/854259691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c005040 con 0x7f53480f6530 2023-10-18T22:33:11.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.010+0000 7f5347fff700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53480f77d0 0x7f5348107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:33:11.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.010+0000 7f534c91c700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53480f6530 0x7f5348106e20 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 rx=0x7f533c004e30 tx=0x7f533c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:11.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.010+0000 7f53457fa700 1 -- 172.21.15.8:0/854259691 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f533c018070 con 0x7f53480f6530 2023-10-18T22:33:11.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.010+0000 7f534d91e700 1 -- 172.21.15.8:0/854259691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5348108340 con 0x7f53480f6530 2023-10-18T22:33:11.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.010+0000 7f53457fa700 1 -- 172.21.15.8:0/854259691 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f533c009630 con 0x7f53480f6530 2023-10-18T22:33:11.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.010+0000 7f534d91e700 1 -- 172.21.15.8:0/854259691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53481088a0 con 0x7f53480f6530 2023-10-18T22:33:11.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.011+0000 7f53457fa700 1 -- 172.21.15.8:0/854259691 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f533c01c3c0 con 0x7f53480f6530 2023-10-18T22:33:11.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.012+0000 7f534d91e700 1 -- 172.21.15.8:0/854259691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5348059100 con 0x7f53480f6530 2023-10-18T22:33:11.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.012+0000 7f53457fa700 1 -- 172.21.15.8:0/854259691 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f533c01d420 con 0x7f53480f6530 2023-10-18T22:33:11.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.013+0000 7f53457fa700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5338060f70 0x7f5338063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:11.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.013+0000 7f53457fa700 1 -- 172.21.15.8:0/854259691 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f533c07e560 con 0x7f53480f6530 2023-10-18T22:33:11.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.014+0000 7f5347fff700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5338060f70 0x7f5338063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:11.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.014+0000 7f5347fff700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5338060f70 0x7f5338063430 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f5334009740 tx=0x7f5334009be0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:11.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.018+0000 7f53457fa700 1 -- 172.21.15.8:0/854259691 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f533c04e1d0 con 0x7f53480f6530 2023-10-18T22:33:11.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.214+0000 7f534d91e700 1 -- 172.21.15.8:0/854259691 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53480008d0 con 0x7f5338060f70 2023-10-18T22:33:11.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.216+0000 7f53457fa700 1 -- 172.21.15.8:0/854259691 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f53480008d0 con 0x7f5338060f70 2023-10-18T22:33:11.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 -- 172.21.15.8:0/854259691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5338060f70 msgr2=0x7f5338063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5338060f70 0x7f5338063430 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f5334009740 tx=0x7f5334009be0).stop 2023-10-18T22:33:11.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 -- 172.21.15.8:0/854259691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53480f6530 msgr2=0x7f5348106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53480f6530 0x7f5348106e20 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 rx=0x7f533c004e30 tx=0x7f533c009b30).stop 2023-10-18T22:33:11.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 -- 172.21.15.8:0/854259691 shutdown_connections 2023-10-18T22:33:11.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f5338060f70 0x7f5338063430 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53480f6530 0x7f5348106e20 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 --2- 172.21.15.8:0/854259691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53480f77d0 0x7f5348107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 -- 172.21.15.8:0/854259691 >> 172.21.15.8:0/854259691 conn(0x7f53480f1c90 msgr2=0x7f53480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:11.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 -- 172.21.15.8:0/854259691 shutdown_connections 2023-10-18T22:33:11.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.218+0000 7f534d91e700 1 -- 172.21.15.8:0/854259691 wait complete. 2023-10-18T22:33:11.235 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:33:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.355+0000 7f426a736700 1 -- 172.21.15.8:0/4007209098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42640f6530 msgr2=0x7f42640f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.355+0000 7f426a736700 1 --2- 172.21.15.8:0/4007209098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42640f6530 0x7f42640f6950 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 rx=0x7f4260004660 tx=0x7f4260009b30).stop 2023-10-18T22:33:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.355+0000 7f426a736700 1 -- 172.21.15.8:0/4007209098 shutdown_connections 2023-10-18T22:33:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.355+0000 7f426a736700 1 --2- 172.21.15.8:0/4007209098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42640f77d0 0x7f42640f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.355+0000 7f426a736700 1 --2- 172.21.15.8:0/4007209098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42640f6530 0x7f42640f6950 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.355+0000 7f426a736700 1 -- 172.21.15.8:0/4007209098 >> 172.21.15.8:0/4007209098 conn(0x7f42640f1c90 msgr2=0x7f42640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.356+0000 7f426a736700 1 -- 172.21.15.8:0/4007209098 shutdown_connections 2023-10-18T22:33:11.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.356+0000 7f426a736700 1 -- 172.21.15.8:0/4007209098 wait complete. 2023-10-18T22:33:11.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.356+0000 7f426a736700 1 Processor -- start 2023-10-18T22:33:11.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.357+0000 7f426a736700 1 -- start start 2023-10-18T22:33:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.357+0000 7f426a736700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42640f6530 0x7f426406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.357+0000 7f426a736700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42640f77d0 0x7f4264069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.357+0000 7f426a736700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426406a380 con 0x7f42640f77d0 2023-10-18T22:33:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.357+0000 7f426a736700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426406a4c0 con 0x7f42640f6530 2023-10-18T22:33:11.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.357+0000 7f4268f33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42640f77d0 0x7f4264069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.357+0000 7f4268f33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42640f77d0 0x7f4264069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44756/0 (socket says 172.21.15.8:44756) 2023-10-18T22:33:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.357+0000 7f4268f33700 1 -- 172.21.15.8:0/2760590101 learned_addr learned my addr 172.21.15.8:0/2760590101 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.357+0000 7f4269734700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42640f6530 0x7f426406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.358+0000 7f4268f33700 1 -- 172.21.15.8:0/2760590101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42640f6530 msgr2=0x7f426406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.358+0000 7f4268f33700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42640f6530 0x7f426406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.358+0000 7f4268f33700 1 -- 172.21.15.8:0/2760590101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260005040 con 0x7f42640f77d0 2023-10-18T22:33:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.358+0000 7f4269734700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42640f6530 0x7f426406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T22:33:11.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.358+0000 7f4268f33700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42640f77d0 0x7f4264069e20 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 rx=0x7f42540026d0 tx=0x7f4254009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:11.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.358+0000 7f4259ffb700 1 -- 172.21.15.8:0/2760590101 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42540079c0 con 0x7f42640f77d0 2023-10-18T22:33:11.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.358+0000 7f4259ffb700 1 -- 172.21.15.8:0/2760590101 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f425400f040 con 0x7f42640f77d0 2023-10-18T22:33:11.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.358+0000 7f426a736700 1 -- 172.21.15.8:0/2760590101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426406a7a0 con 0x7f42640f77d0 2023-10-18T22:33:11.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.358+0000 7f4259ffb700 1 -- 172.21.15.8:0/2760590101 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4254014980 con 0x7f42640f77d0 2023-10-18T22:33:11.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.358+0000 7f426a736700 1 -- 172.21.15.8:0/2760590101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426410edd0 con 0x7f42640f77d0 2023-10-18T22:33:11.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.359+0000 7f426a736700 1 -- 172.21.15.8:0/2760590101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4264045ad0 con 0x7f42640f77d0 2023-10-18T22:33:11.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.360+0000 7f4259ffb700 1 -- 172.21.15.8:0/2760590101 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f42540090d0 con 0x7f42640f77d0 2023-10-18T22:33:11.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.361+0000 7f4259ffb700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4250060f70 0x7f4250063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:11.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.361+0000 7f4259ffb700 1 -- 172.21.15.8:0/2760590101 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f425407c8c0 con 0x7f42640f77d0 2023-10-18T22:33:11.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.361+0000 7f4269734700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4250060f70 0x7f4250063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:11.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.362+0000 7f4269734700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4250060f70 0x7f4250063430 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f4260005010 tx=0x7f4260009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:11.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.365+0000 7f4259ffb700 1 -- 172.21.15.8:0/2760590101 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f425404c5e0 con 0x7f42640f77d0 2023-10-18T22:33:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.563+0000 7f426a736700 1 -- 172.21.15.8:0/2760590101 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42640fedd0 con 0x7f4250060f70 2023-10-18T22:33:11.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.564+0000 7f4259ffb700 1 -- 172.21.15.8:0/2760590101 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f42640fedd0 con 0x7f4250060f70 2023-10-18T22:33:11.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.566+0000 7f426a736700 1 -- 172.21.15.8:0/2760590101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4250060f70 msgr2=0x7f4250063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.566+0000 7f426a736700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4250060f70 0x7f4250063430 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f4260005010 tx=0x7f4260009b30).stop 2023-10-18T22:33:11.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.566+0000 7f426a736700 1 -- 172.21.15.8:0/2760590101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42640f77d0 msgr2=0x7f4264069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.566+0000 7f426a736700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42640f77d0 0x7f4264069e20 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 rx=0x7f42540026d0 tx=0x7f4254009de0).stop 2023-10-18T22:33:11.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.566+0000 7f426a736700 1 -- 172.21.15.8:0/2760590101 shutdown_connections 2023-10-18T22:33:11.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.566+0000 7f426a736700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4250060f70 0x7f4250063430 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.567+0000 7f426a736700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42640f6530 0x7f426406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.567+0000 7f426a736700 1 --2- 172.21.15.8:0/2760590101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42640f77d0 0x7f4264069e20 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.567+0000 7f426a736700 1 -- 172.21.15.8:0/2760590101 >> 172.21.15.8:0/2760590101 conn(0x7f42640f1c90 msgr2=0x7f42640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:11.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.567+0000 7f426a736700 1 -- 172.21.15.8:0/2760590101 shutdown_connections 2023-10-18T22:33:11.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.567+0000 7f426a736700 1 -- 172.21.15.8:0/2760590101 wait complete. 2023-10-18T22:33:11.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.705+0000 7f38cbfff700 1 -- 172.21.15.8:0/1156028746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38cc060310 msgr2=0x7f38cc0f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.705+0000 7f38cbfff700 1 --2- 172.21.15.8:0/1156028746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38cc060310 0x7f38cc0f9120 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 rx=0x7f38bc004660 tx=0x7f38bc009b30).stop 2023-10-18T22:33:11.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.705+0000 7f38cbfff700 1 -- 172.21.15.8:0/1156028746 shutdown_connections 2023-10-18T22:33:11.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.705+0000 7f38cbfff700 1 --2- 172.21.15.8:0/1156028746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc0f96a0 0x7f38cc0fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.705+0000 7f38cbfff700 1 --2- 172.21.15.8:0/1156028746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38cc060310 0x7f38cc0f9120 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.705+0000 7f38cbfff700 1 -- 172.21.15.8:0/1156028746 >> 172.21.15.8:0/1156028746 conn(0x7f38cc0f0ba0 msgr2=0x7f38cc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:11.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.705+0000 7f38cbfff700 1 -- 172.21.15.8:0/1156028746 shutdown_connections 2023-10-18T22:33:11.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.706+0000 7f38cbfff700 1 -- 172.21.15.8:0/1156028746 wait complete. 2023-10-18T22:33:11.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.706+0000 7f38cbfff700 1 Processor -- start 2023-10-18T22:33:11.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.706+0000 7f38cbfff700 1 -- start start 2023-10-18T22:33:11.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.707+0000 7f38cbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38cc060310 0x7f38cc106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:11.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.707+0000 7f38cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc0f96a0 0x7f38cc107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:11.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.707+0000 7f38cbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc107850 con 0x7f38cc060310 2023-10-18T22:33:11.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.707+0000 7f38cbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc108060 con 0x7f38cc0f96a0 2023-10-18T22:33:11.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.707+0000 7f38caffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38cc060310 0x7f38cc106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:11.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.707+0000 7f38caffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38cc060310 0x7f38cc106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44780/0 (socket says 172.21.15.8:44780) 2023-10-18T22:33:11.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.707+0000 7f38caffd700 1 -- 172.21.15.8:0/3289938530 learned_addr learned my addr 172.21.15.8:0/3289938530 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:11.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.707+0000 7f38ca7fc700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc0f96a0 0x7f38cc107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:11.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.707+0000 7f38caffd700 1 -- 172.21.15.8:0/3289938530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc0f96a0 msgr2=0x7f38cc107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.707+0000 7f38caffd700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc0f96a0 0x7f38cc107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.708+0000 7f38caffd700 1 -- 172.21.15.8:0/3289938530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc005040 con 0x7f38cc060310 2023-10-18T22:33:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.708+0000 7f38caffd700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38cc060310 0x7f38cc106d60 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 rx=0x7f38bc004320 tx=0x7f38bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.708+0000 7f38b37fe700 1 -- 172.21.15.8:0/3289938530 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38bc019070 con 0x7f38cc060310 2023-10-18T22:33:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.708+0000 7f38b37fe700 1 -- 172.21.15.8:0/3289938530 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f38bc01e420 con 0x7f38cc060310 2023-10-18T22:33:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.708+0000 7f38b37fe700 1 -- 172.21.15.8:0/3289938530 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38bc014660 con 0x7f38cc060310 2023-10-18T22:33:11.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.708+0000 7f38cbfff700 1 -- 172.21.15.8:0/3289938530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc108280 con 0x7f38cc060310 2023-10-18T22:33:11.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.708+0000 7f38cbfff700 1 -- 172.21.15.8:0/3289938530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc108760 con 0x7f38cc060310 2023-10-18T22:33:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.709+0000 7f38cbfff700 1 -- 172.21.15.8:0/3289938530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38cc059100 con 0x7f38cc060310 2023-10-18T22:33:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.710+0000 7f38b37fe700 1 -- 172.21.15.8:0/3289938530 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f38bc01e590 con 0x7f38cc060310 2023-10-18T22:33:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.711+0000 7f38b37fe700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38b4060f70 0x7f38b4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.711+0000 7f38b37fe700 1 -- 172.21.15.8:0/3289938530 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f38bc07dd90 con 0x7f38cc060310 2023-10-18T22:33:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.712+0000 7f38ca7fc700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38b4060f70 0x7f38b4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:11.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.712+0000 7f38ca7fc700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38b4060f70 0x7f38b4063430 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f38cc0600e0 tx=0x7f38c000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:11.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.716+0000 7f38b37fe700 1 -- 172.21.15.8:0/3289938530 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f38bc04d960 con 0x7f38cc060310 2023-10-18T22:33:11.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.909+0000 7f38cbfff700 1 -- 172.21.15.8:0/3289938530 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f38cc0008d0 con 0x7f38b4060f70 2023-10-18T22:33:11.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.918+0000 7f38b37fe700 1 -- 172.21.15.8:0/3289938530 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f38cc0008d0 con 0x7f38b4060f70 2023-10-18T22:33:11.921 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:33:11.921 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (99m) 6m ago 101m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:33:11.921 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (93m) 6m ago 101m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:33:11.922 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (93m) 4m ago 100m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:33:11.922 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (99m) 6m ago 101m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:33:11.922 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 6m ago 97m - - 2023-10-18T22:33:11.922 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 6m ago 97m - - 2023-10-18T22:33:11.922 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 4m ago 97m - - 2023-10-18T22:33:11.923 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 4m ago 97m - - 2023-10-18T22:33:11.923 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (95m) 6m ago 102m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:33:11.923 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (94m) 4m ago 100m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:33:11.923 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (94m) 6m ago 102m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:33:11.923 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (93m) 4m ago 100m 342M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:33:11.924 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (100m) 6m ago 100m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:33:11.924 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (100m) 4m ago 100m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:33:11.924 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (93m) 6m ago 99m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:33:11.924 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (91m) 6m ago 99m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:33:11.924 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (90m) 6m ago 99m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:33:11.925 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (90m) 4m ago 99m 559M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:33:11.925 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (89m) 4m ago 98m 479M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:33:11.925 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (89m) 4m ago 98m 407M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:33:11.925 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (95m) 6m ago 100m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:33:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.920+0000 7f38cbfff700 1 -- 172.21.15.8:0/3289938530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38b4060f70 msgr2=0x7f38b4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.920+0000 7f38cbfff700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38b4060f70 0x7f38b4063430 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f38cc0600e0 tx=0x7f38c000b040).stop 2023-10-18T22:33:11.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.920+0000 7f38cbfff700 1 -- 172.21.15.8:0/3289938530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38cc060310 msgr2=0x7f38cc106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:11.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.920+0000 7f38cbfff700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38cc060310 0x7f38cc106d60 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 rx=0x7f38bc004320 tx=0x7f38bc00b040).stop 2023-10-18T22:33:11.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.920+0000 7f38cbfff700 1 -- 172.21.15.8:0/3289938530 shutdown_connections 2023-10-18T22:33:11.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.920+0000 7f38cbfff700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f38b4060f70 0x7f38b4063430 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.920+0000 7f38cbfff700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38cc060310 0x7f38cc106d60 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.920+0000 7f38cbfff700 1 --2- 172.21.15.8:0/3289938530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc0f96a0 0x7f38cc107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:11.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.920+0000 7f38cbfff700 1 -- 172.21.15.8:0/3289938530 >> 172.21.15.8:0/3289938530 conn(0x7f38cc0f0ba0 msgr2=0x7f38cc0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:11.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.921+0000 7f38cbfff700 1 -- 172.21.15.8:0/3289938530 shutdown_connections 2023-10-18T22:33:11.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:11.921+0000 7f38cbfff700 1 -- 172.21.15.8:0/3289938530 wait complete. 2023-10-18T22:33:12.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.056+0000 7f4d360f1700 1 -- 172.21.15.8:0/3799223512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30060250 msgr2=0x7f4d300f91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:12.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.056+0000 7f4d360f1700 1 --2- 172.21.15.8:0/3799223512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30060250 0x7f4d300f91e0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 rx=0x7f4d2c004660 tx=0x7f4d2c009b30).stop 2023-10-18T22:33:12.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.056+0000 7f4d360f1700 1 -- 172.21.15.8:0/3799223512 shutdown_connections 2023-10-18T22:33:12.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.056+0000 7f4d360f1700 1 --2- 172.21.15.8:0/3799223512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d300f96d0 0x7f4d300fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.056+0000 7f4d360f1700 1 --2- 172.21.15.8:0/3799223512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30060250 0x7f4d300f91e0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.056+0000 7f4d360f1700 1 -- 172.21.15.8:0/3799223512 >> 172.21.15.8:0/3799223512 conn(0x7f4d300f0ba0 msgr2=0x7f4d300f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:12.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.056+0000 7f4d360f1700 1 -- 172.21.15.8:0/3799223512 shutdown_connections 2023-10-18T22:33:12.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.056+0000 7f4d360f1700 1 -- 172.21.15.8:0/3799223512 wait complete. 2023-10-18T22:33:12.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.057+0000 7f4d360f1700 1 Processor -- start 2023-10-18T22:33:12.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.057+0000 7f4d360f1700 1 -- start start 2023-10-18T22:33:12.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.057+0000 7f4d360f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d30060250 0x7f4d30108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:12.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.057+0000 7f4d360f1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d300f96d0 0x7f4d301094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:12.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.057+0000 7f4d360f1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30109a50 con 0x7f4d300f96d0 2023-10-18T22:33:12.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.057+0000 7f4d360f1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30109b90 con 0x7f4d30060250 2023-10-18T22:33:12.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.058+0000 7f4d348ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d300f96d0 0x7f4d301094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:12.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.058+0000 7f4d348ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d300f96d0 0x7f4d301094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44792/0 (socket says 172.21.15.8:44792) 2023-10-18T22:33:12.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.058+0000 7f4d348ee700 1 -- 172.21.15.8:0/1211282028 learned_addr learned my addr 172.21.15.8:0/1211282028 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:12.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.058+0000 7f4d350ef700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d30060250 0x7f4d30108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:12.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.058+0000 7f4d348ee700 1 -- 172.21.15.8:0/1211282028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d30060250 msgr2=0x7f4d30108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:12.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.058+0000 7f4d348ee700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d30060250 0x7f4d30108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.058+0000 7f4d348ee700 1 -- 172.21.15.8:0/1211282028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c005040 con 0x7f4d300f96d0 2023-10-18T22:33:12.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.058+0000 7f4d348ee700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d300f96d0 0x7f4d301094a0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 rx=0x7f4d200026d0 tx=0x7f4d20009d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:12.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.059+0000 7f4d25ffb700 1 -- 172.21.15.8:0/1211282028 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d20009320 con 0x7f4d300f96d0 2023-10-18T22:33:12.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.059+0000 7f4d25ffb700 1 -- 172.21.15.8:0/1211282028 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4d2000f040 con 0x7f4d300f96d0 2023-10-18T22:33:12.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.059+0000 7f4d360f1700 1 -- 172.21.15.8:0/1211282028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3010a530 con 0x7f4d300f96d0 2023-10-18T22:33:12.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.059+0000 7f4d25ffb700 1 -- 172.21.15.8:0/1211282028 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d20014790 con 0x7f4d300f96d0 2023-10-18T22:33:12.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.059+0000 7f4d360f1700 1 -- 172.21.15.8:0/1211282028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3010aaf0 con 0x7f4d300f96d0 2023-10-18T22:33:12.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.060+0000 7f4d360f1700 1 -- 172.21.15.8:0/1211282028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d30045ad0 con 0x7f4d300f96d0 2023-10-18T22:33:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.061+0000 7f4d25ffb700 1 -- 172.21.15.8:0/1211282028 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f4d20009480 con 0x7f4d300f96d0 2023-10-18T22:33:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.061+0000 7f4d25ffb700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 0x7f4d1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.062+0000 7f4d25ffb700 1 -- 172.21.15.8:0/1211282028 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f4d2007cf70 con 0x7f4d300f96d0 2023-10-18T22:33:12.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.062+0000 7f4d350ef700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 0x7f4d1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:12.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.062+0000 7f4d350ef700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 0x7f4d1c063430 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f4d2c004e30 tx=0x7f4d2c009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:12.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.066+0000 7f4d25ffb700 1 -- 172.21.15.8:0/1211282028 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f4d20050570 con 0x7f4d300f96d0 2023-10-18T22:33:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.322+0000 7f4d360f1700 1 -- 172.21.15.8:0/1211282028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4d3010f5d0 con 0x7f4d300f96d0 2023-10-18T22:33:12.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.322+0000 7f4d25ffb700 1 -- 172.21.15.8:0/1211282028 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f4d20050160 con 0x7f4d300f96d0 2023-10-18T22:33:12.325 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:33:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:33:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:33:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:33:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:33:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:33:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:33:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:33:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:33:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:33:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:33:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:33:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:33:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:33:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:33:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:33:12.329 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:33:12.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.324+0000 7f4d360f1700 1 -- 172.21.15.8:0/1211282028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 msgr2=0x7f4d1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:12.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.324+0000 7f4d360f1700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 0x7f4d1c063430 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f4d2c004e30 tx=0x7f4d2c009b30).stop 2023-10-18T22:33:12.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.324+0000 7f4d360f1700 1 -- 172.21.15.8:0/1211282028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d300f96d0 msgr2=0x7f4d301094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:12.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.324+0000 7f4d360f1700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d300f96d0 0x7f4d301094a0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 rx=0x7f4d200026d0 tx=0x7f4d20009d40).stop 2023-10-18T22:33:12.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.324+0000 7f4d360f1700 1 -- 172.21.15.8:0/1211282028 shutdown_connections 2023-10-18T22:33:12.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.324+0000 7f4d360f1700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f4d1c060f70 0x7f4d1c063430 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.324+0000 7f4d360f1700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d30060250 0x7f4d30108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.324+0000 7f4d360f1700 1 --2- 172.21.15.8:0/1211282028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d300f96d0 0x7f4d301094a0 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.324+0000 7f4d360f1700 1 -- 172.21.15.8:0/1211282028 >> 172.21.15.8:0/1211282028 conn(0x7f4d300f0ba0 msgr2=0x7f4d300f5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:12.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.325+0000 7f4d360f1700 1 -- 172.21.15.8:0/1211282028 shutdown_connections 2023-10-18T22:33:12.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.325+0000 7f4d360f1700 1 -- 172.21.15.8:0/1211282028 wait complete. 2023-10-18T22:33:12.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.461+0000 7f949b59e700 1 -- 172.21.15.8:0/2650032003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c0f6530 msgr2=0x7f949c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:12.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.461+0000 7f949b59e700 1 --2- 172.21.15.8:0/2650032003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c0f6530 0x7f949c0f6950 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 rx=0x7f948c004660 tx=0x7f948c009b30).stop 2023-10-18T22:33:12.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.461+0000 7f949b59e700 1 -- 172.21.15.8:0/2650032003 shutdown_connections 2023-10-18T22:33:12.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.461+0000 7f949b59e700 1 --2- 172.21.15.8:0/2650032003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c0f77d0 0x7f949c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.461+0000 7f949b59e700 1 --2- 172.21.15.8:0/2650032003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c0f6530 0x7f949c0f6950 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.461+0000 7f949b59e700 1 -- 172.21.15.8:0/2650032003 >> 172.21.15.8:0/2650032003 conn(0x7f949c0f1c90 msgr2=0x7f949c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:12.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.461+0000 7f949b59e700 1 -- 172.21.15.8:0/2650032003 shutdown_connections 2023-10-18T22:33:12.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.461+0000 7f949b59e700 1 -- 172.21.15.8:0/2650032003 wait complete. 2023-10-18T22:33:12.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.462+0000 7f949b59e700 1 Processor -- start 2023-10-18T22:33:12.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.462+0000 7f949b59e700 1 -- start start 2023-10-18T22:33:12.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f949b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c0f6530 0x7f949c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:12.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f949b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c0f77d0 0x7f949c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:12.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f949b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c107880 con 0x7f949c0f6530 2023-10-18T22:33:12.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f949b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1080c0 con 0x7f949c0f77d0 2023-10-18T22:33:12.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f949a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c0f6530 0x7f949c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:12.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f949a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c0f6530 0x7f949c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44808/0 (socket says 172.21.15.8:44808) 2023-10-18T22:33:12.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f949a59c700 1 -- 172.21.15.8:0/1976398636 learned_addr learned my addr 172.21.15.8:0/1976398636 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:12.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f9499d9b700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c0f77d0 0x7f949c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:12.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f949a59c700 1 -- 172.21.15.8:0/1976398636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c0f77d0 msgr2=0x7f949c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:12.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f949a59c700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c0f77d0 0x7f949c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.463+0000 7f949a59c700 1 -- 172.21.15.8:0/1976398636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c005040 con 0x7f949c0f6530 2023-10-18T22:33:12.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.464+0000 7f949a59c700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c0f6530 0x7f949c106d90 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 rx=0x7f948c009870 tx=0x7f948c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:12.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.464+0000 7f948affd700 1 -- 172.21.15.8:0/1976398636 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948c019070 con 0x7f949c0f6530 2023-10-18T22:33:12.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.464+0000 7f948affd700 1 -- 172.21.15.8:0/1976398636 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f948c01e420 con 0x7f949c0f6530 2023-10-18T22:33:12.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.464+0000 7f948affd700 1 -- 172.21.15.8:0/1976398636 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948c014660 con 0x7f949c0f6530 2023-10-18T22:33:12.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.464+0000 7f949b59e700 1 -- 172.21.15.8:0/1976398636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c108340 con 0x7f949c0f6530 2023-10-18T22:33:12.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.464+0000 7f949b59e700 1 -- 172.21.15.8:0/1976398636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c108820 con 0x7f949c0f6530 2023-10-18T22:33:12.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.465+0000 7f949b59e700 1 -- 172.21.15.8:0/1976398636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c059100 con 0x7f949c0f6530 2023-10-18T22:33:12.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.466+0000 7f948affd700 1 -- 172.21.15.8:0/1976398636 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f948c01e9c0 con 0x7f949c0f6530 2023-10-18T22:33:12.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.467+0000 7f948affd700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9484060f70 0x7f9484063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:12.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.467+0000 7f948affd700 1 -- 172.21.15.8:0/1976398636 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f948c07dcc0 con 0x7f949c0f6530 2023-10-18T22:33:12.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.467+0000 7f9499d9b700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9484060f70 0x7f9484063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:12.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.468+0000 7f9499d9b700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9484060f70 0x7f9484063430 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f949c106b20 tx=0x7f949000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:12.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.471+0000 7f948affd700 1 -- 172.21.15.8:0/1976398636 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f948c04d9b0 con 0x7f949c0f6530 2023-10-18T22:33:12.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:11.119752+0000 mgr.smithi008.flmjzp (mgr.14640) 5650 : cluster [DBG] pgmap v3874: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:11.216937+0000 mgr.smithi008.flmjzp (mgr.14640) 5651 : audit [DBG] from='client.38488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:11.565848+0000 mgr.smithi008.flmjzp (mgr.14640) 5652 : audit [DBG] from='client.38492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:12.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:12 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:12.324059+0000 mon.smithi008 (mon.0) 5875 : audit [DBG] from='client.? 172.21.15.8:0/1211282028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:12.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.697+0000 7f949b59e700 1 -- 172.21.15.8:0/1976398636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f949c0fecc0 con 0x7f949c0f6530 2023-10-18T22:33:12.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.698+0000 7f948affd700 1 -- 172.21.15.8:0/1976398636 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f948c050fd0 con 0x7f949c0f6530 2023-10-18T22:33:12.701 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:33:12.701 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:33:12.701 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:33:12.701 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:33:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:33:12.702 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:33:12.702 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:33:12.702 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:33:12.703 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:33:12.703 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:33:12.703 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:33:12.703 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:33:12.703 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:33:12.704 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:33:12.704 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:33:12.704 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:33:12.704 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:33:12.704 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:33:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:33:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:33:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:33:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:33:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:33:12.706 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:33:12.706 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:33:12.706 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:33:12.706 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:33:12.707 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:33:12.707 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:33:12.707 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:33:12.707 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:33:12.707 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:33:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:33:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:33:12.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 -- 172.21.15.8:0/1976398636 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9484060f70 msgr2=0x7f9484063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:12.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9484060f70 0x7f9484063430 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f949c106b20 tx=0x7f949000b040).stop 2023-10-18T22:33:12.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 -- 172.21.15.8:0/1976398636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c0f6530 msgr2=0x7f949c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:12.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c0f6530 0x7f949c106d90 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 rx=0x7f948c009870 tx=0x7f948c00b040).stop 2023-10-18T22:33:12.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 -- 172.21.15.8:0/1976398636 shutdown_connections 2023-10-18T22:33:12.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9484060f70 0x7f9484063430 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c0f6530 0x7f949c106d90 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 --2- 172.21.15.8:0/1976398636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c0f77d0 0x7f949c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 -- 172.21.15.8:0/1976398636 >> 172.21.15.8:0/1976398636 conn(0x7f949c0f1c90 msgr2=0x7f949c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:12.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 -- 172.21.15.8:0/1976398636 shutdown_connections 2023-10-18T22:33:12.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.700+0000 7f949b59e700 1 -- 172.21.15.8:0/1976398636 wait complete. 2023-10-18T22:33:12.711 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:33:12.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.839+0000 7f27a3fff700 1 -- 172.21.15.8:0/3621429446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27a40f9690 msgr2=0x7f27a40fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:12.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.839+0000 7f27a3fff700 1 --2- 172.21.15.8:0/3621429446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27a40f9690 0x7f27a40fbae0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 rx=0x7f2798004660 tx=0x7f2798009b30).stop 2023-10-18T22:33:12.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.839+0000 7f27a3fff700 1 -- 172.21.15.8:0/3621429446 shutdown_connections 2023-10-18T22:33:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.839+0000 7f27a3fff700 1 --2- 172.21.15.8:0/3621429446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27a40f9690 0x7f27a40fbae0 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.839+0000 7f27a3fff700 1 --2- 172.21.15.8:0/3621429446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a4060310 0x7f27a40f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.839+0000 7f27a3fff700 1 -- 172.21.15.8:0/3621429446 >> 172.21.15.8:0/3621429446 conn(0x7f27a40f0b90 msgr2=0x7f27a40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.839+0000 7f27a3fff700 1 -- 172.21.15.8:0/3621429446 shutdown_connections 2023-10-18T22:33:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.839+0000 7f27a3fff700 1 -- 172.21.15.8:0/3621429446 wait complete. 2023-10-18T22:33:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.840+0000 7f27a3fff700 1 Processor -- start 2023-10-18T22:33:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.840+0000 7f27a3fff700 1 -- start start 2023-10-18T22:33:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.841+0000 7f27a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27a4060310 0x7f27a4108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.841+0000 7f27a3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a40f9690 0x7f27a4109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.841+0000 7f27a3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a41099b0 con 0x7f27a4060310 2023-10-18T22:33:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.841+0000 7f27a3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a4109af0 con 0x7f27a40f9690 2023-10-18T22:33:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.841+0000 7f27a2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27a4060310 0x7f27a4108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.841+0000 7f27a2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27a4060310 0x7f27a4108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44830/0 (socket says 172.21.15.8:44830) 2023-10-18T22:33:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.841+0000 7f27a2ffd700 1 -- 172.21.15.8:0/2629169289 learned_addr learned my addr 172.21.15.8:0/2629169289 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.841+0000 7f27a27fc700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a40f9690 0x7f27a4109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.842+0000 7f27a2ffd700 1 -- 172.21.15.8:0/2629169289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a40f9690 msgr2=0x7f27a4109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.842+0000 7f27a2ffd700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a40f9690 0x7f27a4109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.842+0000 7f27a2ffd700 1 -- 172.21.15.8:0/2629169289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798005040 con 0x7f27a4060310 2023-10-18T22:33:12.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.842+0000 7f27a2ffd700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27a4060310 0x7f27a4108f10 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 rx=0x7f279400e7f0 tx=0x7f279400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.842+0000 7f278b7fe700 1 -- 172.21.15.8:0/2629169289 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27940092e0 con 0x7f27a4060310 2023-10-18T22:33:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.842+0000 7f278b7fe700 1 -- 172.21.15.8:0/2629169289 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f279400f040 con 0x7f27a4060310 2023-10-18T22:33:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.842+0000 7f27a3fff700 1 -- 172.21.15.8:0/2629169289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a410a490 con 0x7f27a4060310 2023-10-18T22:33:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.842+0000 7f278b7fe700 1 -- 172.21.15.8:0/2629169289 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27940147e0 con 0x7f27a4060310 2023-10-18T22:33:12.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.842+0000 7f27a3fff700 1 -- 172.21.15.8:0/2629169289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a410a9d0 con 0x7f27a4060310 2023-10-18T22:33:12.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.843+0000 7f27a3fff700 1 -- 172.21.15.8:0/2629169289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a4045ad0 con 0x7f27a4060310 2023-10-18T22:33:12.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.844+0000 7f278b7fe700 1 -- 172.21.15.8:0/2629169289 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f279401b030 con 0x7f27a4060310 2023-10-18T22:33:12.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.845+0000 7f278b7fe700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f278c060f70 0x7f278c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:12.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.845+0000 7f278b7fe700 1 -- 172.21.15.8:0/2629169289 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f279407c7c0 con 0x7f27a4060310 2023-10-18T22:33:12.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.845+0000 7f27a27fc700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f278c060f70 0x7f278c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:12.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.846+0000 7f27a27fc700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f278c060f70 0x7f278c063430 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f2798005010 tx=0x7f2798016040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:12.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:12.849+0000 7f278b7fe700 1 -- 172.21.15.8:0/2629169289 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f279404fe50 con 0x7f27a4060310 2023-10-18T22:33:12.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:11.119752+0000 mgr.smithi008.flmjzp (mgr.14640) 5650 : cluster [DBG] pgmap v3874: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:11.216937+0000 mgr.smithi008.flmjzp (mgr.14640) 5651 : audit [DBG] from='client.38488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:11.565848+0000 mgr.smithi008.flmjzp (mgr.14640) 5652 : audit [DBG] from='client.38492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:12.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:12 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:12.324059+0000 mon.smithi008 (mon.0) 5875 : audit [DBG] from='client.? 172.21.15.8:0/1211282028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:13.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.050+0000 7f27a3fff700 1 -- 172.21.15.8:0/2629169289 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f27a40f5630 con 0x7f278c060f70 2023-10-18T22:33:13.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.051+0000 7f278b7fe700 1 -- 172.21.15.8:0/2629169289 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f27a40f5630 con 0x7f278c060f70 2023-10-18T22:33:13.054 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:33:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:33:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:33:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:33:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:33:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:33:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:33:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:33:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:33:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:33:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:33:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:33:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:33:13.056 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:33:13.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 -- 172.21.15.8:0/2629169289 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f278c060f70 msgr2=0x7f278c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:13.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f278c060f70 0x7f278c063430 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f2798005010 tx=0x7f2798016040).stop 2023-10-18T22:33:13.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 -- 172.21.15.8:0/2629169289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27a4060310 msgr2=0x7f27a4108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:13.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27a4060310 0x7f27a4108f10 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 rx=0x7f279400e7f0 tx=0x7f279400b040).stop 2023-10-18T22:33:13.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 -- 172.21.15.8:0/2629169289 shutdown_connections 2023-10-18T22:33:13.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f278c060f70 0x7f278c063430 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:13.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27a4060310 0x7f27a4108f10 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:13.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 --2- 172.21.15.8:0/2629169289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a40f9690 0x7f27a4109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:13.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 -- 172.21.15.8:0/2629169289 >> 172.21.15.8:0/2629169289 conn(0x7f27a40f0b90 msgr2=0x7f27a40f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:13.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 -- 172.21.15.8:0/2629169289 shutdown_connections 2023-10-18T22:33:13.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:13.053+0000 7f27a3fff700 1 -- 172.21.15.8:0/2629169289 wait complete. 2023-10-18T22:33:13.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:11.911234+0000 mgr.smithi008.flmjzp (mgr.14640) 5653 : audit [DBG] from='client.38496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:13.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:12.699553+0000 mon.smithi008 (mon.0) 5876 : audit [DBG] from='client.? 172.21.15.8:0/1976398636' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:33:13.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:13.150645+0000 mon.smithi008 (mon.0) 5877 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:13.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:13.152332+0000 mon.smithi008 (mon.0) 5878 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:13.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:13.153116+0000 mon.smithi008 (mon.0) 5879 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:13.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:13.158649+0000 mon.smithi008 (mon.0) 5880 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:13.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:13.164583+0000 mon.smithi008 (mon.0) 5881 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:13.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:13.167191+0000 mon.smithi008 (mon.0) 5882 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:13.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:13.168470+0000 mon.smithi008 (mon.0) 5883 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:13.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:13.169677+0000 mon.smithi008 (mon.0) 5884 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:13.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:13 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:13.171186+0000 mon.smithi008 (mon.0) 5885 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:11.911234+0000 mgr.smithi008.flmjzp (mgr.14640) 5653 : audit [DBG] from='client.38496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:13.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:12.699553+0000 mon.smithi008 (mon.0) 5876 : audit [DBG] from='client.? 172.21.15.8:0/1976398636' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:33:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:13.150645+0000 mon.smithi008 (mon.0) 5877 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:13.152332+0000 mon.smithi008 (mon.0) 5878 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:13.153116+0000 mon.smithi008 (mon.0) 5879 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:13.158649+0000 mon.smithi008 (mon.0) 5880 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:13.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:13.164583+0000 mon.smithi008 (mon.0) 5881 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:13.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:13.167191+0000 mon.smithi008 (mon.0) 5882 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:13.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:13.168470+0000 mon.smithi008 (mon.0) 5883 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:13.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:13.169677+0000 mon.smithi008 (mon.0) 5884 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:13.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:13 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:13.171186+0000 mon.smithi008 (mon.0) 5885 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:14.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:13.052633+0000 mgr.smithi008.flmjzp (mgr.14640) 5654 : audit [DBG] from='client.38508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:13.120247+0000 mgr.smithi008.flmjzp (mgr.14640) 5655 : cluster [DBG] pgmap v3875: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:13.153795+0000 mgr.smithi008.flmjzp (mgr.14640) 5656 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:13.154242+0000 mgr.smithi008.flmjzp (mgr.14640) 5657 : cluster [DBG] pgmap v3876: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:13.154524+0000 mgr.smithi008.flmjzp (mgr.14640) 5658 : cluster [DBG] pgmap v3877: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:14.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:14 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:13.172723+0000 mgr.smithi008.flmjzp (mgr.14640) 5659 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:13.052633+0000 mgr.smithi008.flmjzp (mgr.14640) 5654 : audit [DBG] from='client.38508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:13.120247+0000 mgr.smithi008.flmjzp (mgr.14640) 5655 : cluster [DBG] pgmap v3875: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:14.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:13.153795+0000 mgr.smithi008.flmjzp (mgr.14640) 5656 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:13.154242+0000 mgr.smithi008.flmjzp (mgr.14640) 5657 : cluster [DBG] pgmap v3876: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:13.154524+0000 mgr.smithi008.flmjzp (mgr.14640) 5658 : cluster [DBG] pgmap v3877: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:14.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:14 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:13.172723+0000 mgr.smithi008.flmjzp (mgr.14640) 5659 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:16.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:16 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:15.155182+0000 mgr.smithi008.flmjzp (mgr.14640) 5660 : cluster [DBG] pgmap v3878: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:16.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:16 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:15.155182+0000 mgr.smithi008.flmjzp (mgr.14640) 5660 : cluster [DBG] pgmap v3878: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:18.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:18 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:17.155927+0000 mgr.smithi008.flmjzp (mgr.14640) 5661 : cluster [DBG] pgmap v3879: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:18.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:18 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:17.155927+0000 mgr.smithi008.flmjzp (mgr.14640) 5661 : cluster [DBG] pgmap v3879: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:20.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:20 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:19.156678+0000 mgr.smithi008.flmjzp (mgr.14640) 5662 : cluster [DBG] pgmap v3880: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:20.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:20 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:19.156678+0000 mgr.smithi008.flmjzp (mgr.14640) 5662 : cluster [DBG] pgmap v3880: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:22.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:22 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:21.157406+0000 mgr.smithi008.flmjzp (mgr.14640) 5663 : cluster [DBG] pgmap v3881: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:22.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:22 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:21.157406+0000 mgr.smithi008.flmjzp (mgr.14640) 5663 : cluster [DBG] pgmap v3881: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:23.872 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:23.183472+0000 mon.smithi008 (mon.0) 5886 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:23.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:23.185607+0000 mon.smithi008 (mon.0) 5887 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:23.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:23.186666+0000 mon.smithi008 (mon.0) 5888 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:23.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:23.193328+0000 mon.smithi008 (mon.0) 5889 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:23.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:23.199820+0000 mon.smithi008 (mon.0) 5890 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:23.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:23.203019+0000 mon.smithi008 (mon.0) 5891 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:23.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:23.204802+0000 mon.smithi008 (mon.0) 5892 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:23.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:23.206492+0000 mon.smithi008 (mon.0) 5893 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:23.875 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:23 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:23.208637+0000 mon.smithi008 (mon.0) 5894 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:23.183472+0000 mon.smithi008 (mon.0) 5886 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:23.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:23.185607+0000 mon.smithi008 (mon.0) 5887 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:23.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:23.186666+0000 mon.smithi008 (mon.0) 5888 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:23.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:23.193328+0000 mon.smithi008 (mon.0) 5889 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:23.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:23.199820+0000 mon.smithi008 (mon.0) 5890 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:23.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:23.203019+0000 mon.smithi008 (mon.0) 5891 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:23.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:23.204802+0000 mon.smithi008 (mon.0) 5892 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:23.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:23.206492+0000 mon.smithi008 (mon.0) 5893 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:23.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:23 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:23.208637+0000 mon.smithi008 (mon.0) 5894 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:24.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:23.157927+0000 mgr.smithi008.flmjzp (mgr.14640) 5664 : cluster [DBG] pgmap v3882: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:23.187599+0000 mgr.smithi008.flmjzp (mgr.14640) 5665 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:23.188154+0000 mgr.smithi008.flmjzp (mgr.14640) 5666 : cluster [DBG] pgmap v3883: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:23.188381+0000 mgr.smithi008.flmjzp (mgr.14640) 5667 : cluster [DBG] pgmap v3884: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:24.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:24 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:23.210674+0000 mgr.smithi008.flmjzp (mgr.14640) 5668 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:23.157927+0000 mgr.smithi008.flmjzp (mgr.14640) 5664 : cluster [DBG] pgmap v3882: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:24.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:23.187599+0000 mgr.smithi008.flmjzp (mgr.14640) 5665 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:23.188154+0000 mgr.smithi008.flmjzp (mgr.14640) 5666 : cluster [DBG] pgmap v3883: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:23.188381+0000 mgr.smithi008.flmjzp (mgr.14640) 5667 : cluster [DBG] pgmap v3884: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:24.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:24 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:23.210674+0000 mgr.smithi008.flmjzp (mgr.14640) 5668 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:26.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:26 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:25.189058+0000 mgr.smithi008.flmjzp (mgr.14640) 5669 : cluster [DBG] pgmap v3885: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:26.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:26 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:25.189058+0000 mgr.smithi008.flmjzp (mgr.14640) 5669 : cluster [DBG] pgmap v3885: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:28.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:28 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:27.189647+0000 mgr.smithi008.flmjzp (mgr.14640) 5670 : cluster [DBG] pgmap v3886: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:28.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:28 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:27.189647+0000 mgr.smithi008.flmjzp (mgr.14640) 5670 : cluster [DBG] pgmap v3886: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:30.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:30 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:29.190124+0000 mgr.smithi008.flmjzp (mgr.14640) 5671 : cluster [DBG] pgmap v3887: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:30.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:30 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:29.190124+0000 mgr.smithi008.flmjzp (mgr.14640) 5671 : cluster [DBG] pgmap v3887: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:32.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:32 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:31.190653+0000 mgr.smithi008.flmjzp (mgr.14640) 5672 : cluster [DBG] pgmap v3888: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:32.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:32 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:31.190653+0000 mgr.smithi008.flmjzp (mgr.14640) 5672 : cluster [DBG] pgmap v3888: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:33.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:33.219690+0000 mon.smithi008 (mon.0) 5895 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:33.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:33.221832+0000 mon.smithi008 (mon.0) 5896 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:33.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:33.222839+0000 mon.smithi008 (mon.0) 5897 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:33.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:33.229151+0000 mon.smithi008 (mon.0) 5898 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:33.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:33.235822+0000 mon.smithi008 (mon.0) 5899 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:33.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:33.239048+0000 mon.smithi008 (mon.0) 5900 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:33.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:33.240782+0000 mon.smithi008 (mon.0) 5901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:33.875 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:33.242505+0000 mon.smithi008 (mon.0) 5902 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:33.875 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:33 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:33.244826+0000 mon.smithi008 (mon.0) 5903 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:33.219690+0000 mon.smithi008 (mon.0) 5895 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:33.221832+0000 mon.smithi008 (mon.0) 5896 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:33.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:33.222839+0000 mon.smithi008 (mon.0) 5897 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:33.229151+0000 mon.smithi008 (mon.0) 5898 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:33.235822+0000 mon.smithi008 (mon.0) 5899 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:33.239048+0000 mon.smithi008 (mon.0) 5900 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:33.240782+0000 mon.smithi008 (mon.0) 5901 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:33.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:33.242505+0000 mon.smithi008 (mon.0) 5902 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:33.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:33 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:33.244826+0000 mon.smithi008 (mon.0) 5903 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:34.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:33.191369+0000 mgr.smithi008.flmjzp (mgr.14640) 5673 : cluster [DBG] pgmap v3889: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:33.223736+0000 mgr.smithi008.flmjzp (mgr.14640) 5674 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:33.224332+0000 mgr.smithi008.flmjzp (mgr.14640) 5675 : cluster [DBG] pgmap v3890: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:34.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:33.224600+0000 mgr.smithi008.flmjzp (mgr.14640) 5676 : cluster [DBG] pgmap v3891: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:34.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:34 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:33.246808+0000 mgr.smithi008.flmjzp (mgr.14640) 5677 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:33.191369+0000 mgr.smithi008.flmjzp (mgr.14640) 5673 : cluster [DBG] pgmap v3889: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:34.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:33.223736+0000 mgr.smithi008.flmjzp (mgr.14640) 5674 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:33.224332+0000 mgr.smithi008.flmjzp (mgr.14640) 5675 : cluster [DBG] pgmap v3890: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:33.224600+0000 mgr.smithi008.flmjzp (mgr.14640) 5676 : cluster [DBG] pgmap v3891: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:34.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:34 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:33.246808+0000 mgr.smithi008.flmjzp (mgr.14640) 5677 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:36.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:36 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:35.225263+0000 mgr.smithi008.flmjzp (mgr.14640) 5678 : cluster [DBG] pgmap v3892: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:36.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:36 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:35.225263+0000 mgr.smithi008.flmjzp (mgr.14640) 5678 : cluster [DBG] pgmap v3892: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:38.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:38 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:37.225818+0000 mgr.smithi008.flmjzp (mgr.14640) 5679 : cluster [DBG] pgmap v3893: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:38.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:38 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:37.225818+0000 mgr.smithi008.flmjzp (mgr.14640) 5679 : cluster [DBG] pgmap v3893: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:40.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:40 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:39.226370+0000 mgr.smithi008.flmjzp (mgr.14640) 5680 : cluster [DBG] pgmap v3894: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:40.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:40 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:39.226370+0000 mgr.smithi008.flmjzp (mgr.14640) 5680 : cluster [DBG] pgmap v3894: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:42.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:42 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:41.227041+0000 mgr.smithi008.flmjzp (mgr.14640) 5681 : cluster [DBG] pgmap v3895: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:42.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:42 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:41.227041+0000 mgr.smithi008.flmjzp (mgr.14640) 5681 : cluster [DBG] pgmap v3895: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:43.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.207+0000 7f0c9359e700 1 -- 172.21.15.8:0/234872716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c940f77d0 msgr2=0x7f0c940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:43.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.207+0000 7f0c9359e700 1 --2- 172.21.15.8:0/234872716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c940f77d0 0x7f0c940f7c30 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 rx=0x7f0c88004660 tx=0x7f0c88009b30).stop 2023-10-18T22:33:43.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.207+0000 7f0c9359e700 1 -- 172.21.15.8:0/234872716 shutdown_connections 2023-10-18T22:33:43.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.207+0000 7f0c9359e700 1 --2- 172.21.15.8:0/234872716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c940f77d0 0x7f0c940f7c30 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.207+0000 7f0c9359e700 1 --2- 172.21.15.8:0/234872716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940f6530 0x7f0c940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.207+0000 7f0c9359e700 1 -- 172.21.15.8:0/234872716 >> 172.21.15.8:0/234872716 conn(0x7f0c940f1c90 msgr2=0x7f0c940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:43.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.207+0000 7f0c9359e700 1 -- 172.21.15.8:0/234872716 shutdown_connections 2023-10-18T22:33:43.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.207+0000 7f0c9359e700 1 -- 172.21.15.8:0/234872716 wait complete. 2023-10-18T22:33:43.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.208+0000 7f0c9359e700 1 Processor -- start 2023-10-18T22:33:43.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.208+0000 7f0c9359e700 1 -- start start 2023-10-18T22:33:43.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.209+0000 7f0c9359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940f6530 0x7f0c94106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:43.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.209+0000 7f0c9359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c940f77d0 0x7f0c94107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.209+0000 7f0c9359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94107850 con 0x7f0c940f77d0 2023-10-18T22:33:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.209+0000 7f0c9359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94108060 con 0x7f0c940f6530 2023-10-18T22:33:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.209+0000 7f0c91d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c940f77d0 0x7f0c94107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.209+0000 7f0c91d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c940f77d0 0x7f0c94107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41634/0 (socket says 172.21.15.8:41634) 2023-10-18T22:33:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.209+0000 7f0c91d9b700 1 -- 172.21.15.8:0/4254763241 learned_addr learned my addr 172.21.15.8:0/4254763241 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.209+0000 7f0c9259c700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940f6530 0x7f0c94106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.210+0000 7f0c91d9b700 1 -- 172.21.15.8:0/4254763241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940f6530 msgr2=0x7f0c94106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.210+0000 7f0c91d9b700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940f6530 0x7f0c94106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.210+0000 7f0c91d9b700 1 -- 172.21.15.8:0/4254763241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c88005040 con 0x7f0c940f77d0 2023-10-18T22:33:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.210+0000 7f0c9259c700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940f6530 0x7f0c94106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T22:33:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.210+0000 7f0c91d9b700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c940f77d0 0x7f0c94107250 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 rx=0x7f0c88004320 tx=0x7f0c8800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:43.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.210+0000 7f0c82ffd700 1 -- 172.21.15.8:0/4254763241 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c88019070 con 0x7f0c940f77d0 2023-10-18T22:33:43.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.210+0000 7f0c82ffd700 1 -- 172.21.15.8:0/4254763241 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0c8801e420 con 0x7f0c940f77d0 2023-10-18T22:33:43.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.210+0000 7f0c9359e700 1 -- 172.21.15.8:0/4254763241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c94108280 con 0x7f0c940f77d0 2023-10-18T22:33:43.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.210+0000 7f0c82ffd700 1 -- 172.21.15.8:0/4254763241 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c88014660 con 0x7f0c940f77d0 2023-10-18T22:33:43.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.210+0000 7f0c9359e700 1 -- 172.21.15.8:0/4254763241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c94108760 con 0x7f0c940f77d0 2023-10-18T22:33:43.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.211+0000 7f0c9359e700 1 -- 172.21.15.8:0/4254763241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c94059100 con 0x7f0c940f77d0 2023-10-18T22:33:43.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.212+0000 7f0c82ffd700 1 -- 172.21.15.8:0/4254763241 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f0c8801e590 con 0x7f0c940f77d0 2023-10-18T22:33:43.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.213+0000 7f0c82ffd700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c7c060f70 0x7f0c7c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:43.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.213+0000 7f0c82ffd700 1 -- 172.21.15.8:0/4254763241 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f0c8807dec0 con 0x7f0c940f77d0 2023-10-18T22:33:43.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.214+0000 7f0c9259c700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c7c060f70 0x7f0c7c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:43.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.214+0000 7f0c9259c700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c7c060f70 0x7f0c7c063430 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f0c94106ad0 tx=0x7f0c8400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.218+0000 7f0c82ffd700 1 -- 172.21.15.8:0/4254763241 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f0c8804da10 con 0x7f0c940f77d0 2023-10-18T22:33:43.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.417+0000 7f0c9359e700 1 -- 172.21.15.8:0/4254763241 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c940fee30 con 0x7f0c7c060f70 2023-10-18T22:33:43.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.419+0000 7f0c82ffd700 1 -- 172.21.15.8:0/4254763241 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0c940fee30 con 0x7f0c7c060f70 2023-10-18T22:33:43.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 -- 172.21.15.8:0/4254763241 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c7c060f70 msgr2=0x7f0c7c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:43.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c7c060f70 0x7f0c7c063430 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f0c94106ad0 tx=0x7f0c8400b040).stop 2023-10-18T22:33:43.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 -- 172.21.15.8:0/4254763241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c940f77d0 msgr2=0x7f0c94107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:43.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c940f77d0 0x7f0c94107250 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 rx=0x7f0c88004320 tx=0x7f0c8800b040).stop 2023-10-18T22:33:43.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 -- 172.21.15.8:0/4254763241 shutdown_connections 2023-10-18T22:33:43.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f0c7c060f70 0x7f0c7c063430 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940f6530 0x7f0c94106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 --2- 172.21.15.8:0/4254763241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c940f77d0 0x7f0c94107250 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 -- 172.21.15.8:0/4254763241 >> 172.21.15.8:0/4254763241 conn(0x7f0c940f1c90 msgr2=0x7f0c940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:43.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 -- 172.21.15.8:0/4254763241 shutdown_connections 2023-10-18T22:33:43.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.421+0000 7f0c9359e700 1 -- 172.21.15.8:0/4254763241 wait complete. 2023-10-18T22:33:43.438 INFO:teuthology.orchestra.run.smithi008.stdout:true 2023-10-18T22:33:43.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.562+0000 7fdc49fdc700 1 -- 172.21.15.8:0/1220039539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc44060290 msgr2=0x7fdc440f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:43.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.562+0000 7fdc49fdc700 1 --2- 172.21.15.8:0/1220039539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc44060290 0x7fdc440f91a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdc38004660 tx=0x7fdc38009b30).stop 2023-10-18T22:33:43.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.562+0000 7fdc49fdc700 1 -- 172.21.15.8:0/1220039539 shutdown_connections 2023-10-18T22:33:43.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.562+0000 7fdc49fdc700 1 --2- 172.21.15.8:0/1220039539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc440f9720 0x7fdc440fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.562+0000 7fdc49fdc700 1 --2- 172.21.15.8:0/1220039539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc44060290 0x7fdc440f91a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.562+0000 7fdc49fdc700 1 -- 172.21.15.8:0/1220039539 >> 172.21.15.8:0/1220039539 conn(0x7fdc440f0ba0 msgr2=0x7fdc440f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:43.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.562+0000 7fdc49fdc700 1 -- 172.21.15.8:0/1220039539 shutdown_connections 2023-10-18T22:33:43.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.562+0000 7fdc49fdc700 1 -- 172.21.15.8:0/1220039539 wait complete. 2023-10-18T22:33:43.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.563+0000 7fdc49fdc700 1 Processor -- start 2023-10-18T22:33:43.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.563+0000 7fdc49fdc700 1 -- start start 2023-10-18T22:33:43.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.564+0000 7fdc49fdc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc44060290 0x7fdc44108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:43.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.564+0000 7fdc49fdc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc440f9720 0x7fdc441093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:43.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.564+0000 7fdc49fdc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44109990 con 0x7fdc44060290 2023-10-18T22:33:43.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.564+0000 7fdc49fdc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44109ad0 con 0x7fdc440f9720 2023-10-18T22:33:43.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.564+0000 7fdc48fda700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc44060290 0x7fdc44108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:43.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.564+0000 7fdc48fda700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc44060290 0x7fdc44108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41650/0 (socket says 172.21.15.8:41650) 2023-10-18T22:33:43.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.564+0000 7fdc48fda700 1 -- 172.21.15.8:0/812393706 learned_addr learned my addr 172.21.15.8:0/812393706 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:43.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.564+0000 7fdc43fff700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc440f9720 0x7fdc441093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:43.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.564+0000 7fdc48fda700 1 -- 172.21.15.8:0/812393706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc440f9720 msgr2=0x7fdc441093e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:43.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.564+0000 7fdc48fda700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc440f9720 0x7fdc441093e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.565+0000 7fdc48fda700 1 -- 172.21.15.8:0/812393706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc38005040 con 0x7fdc44060290 2023-10-18T22:33:43.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.565+0000 7fdc48fda700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc44060290 0x7fdc44108ef0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 rx=0x7fdc38004320 tx=0x7fdc3800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:43.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.565+0000 7fdc417fa700 1 -- 172.21.15.8:0/812393706 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc38019070 con 0x7fdc44060290 2023-10-18T22:33:43.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.565+0000 7fdc49fdc700 1 -- 172.21.15.8:0/812393706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4410a410 con 0x7fdc44060290 2023-10-18T22:33:43.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.565+0000 7fdc417fa700 1 -- 172.21.15.8:0/812393706 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdc3801e420 con 0x7fdc44060290 2023-10-18T22:33:43.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.565+0000 7fdc417fa700 1 -- 172.21.15.8:0/812393706 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc38014680 con 0x7fdc44060290 2023-10-18T22:33:43.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.565+0000 7fdc49fdc700 1 -- 172.21.15.8:0/812393706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4410a8f0 con 0x7fdc44060290 2023-10-18T22:33:43.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.566+0000 7fdc49fdc700 1 -- 172.21.15.8:0/812393706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc44045ad0 con 0x7fdc44060290 2023-10-18T22:33:43.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.567+0000 7fdc417fa700 1 -- 172.21.15.8:0/812393706 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fdc3801e590 con 0x7fdc44060290 2023-10-18T22:33:43.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.568+0000 7fdc417fa700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc34060f70 0x7fdc34063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:43.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.568+0000 7fdc417fa700 1 -- 172.21.15.8:0/812393706 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fdc3807dd00 con 0x7fdc44060290 2023-10-18T22:33:43.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.568+0000 7fdc43fff700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc34060f70 0x7fdc34063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:43.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.569+0000 7fdc43fff700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc34060f70 0x7fdc34063430 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fdc30009fd0 tx=0x7fdc3000b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:43.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.577+0000 7fdc417fa700 1 -- 172.21.15.8:0/812393706 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fdc38081030 con 0x7fdc44060290 2023-10-18T22:33:43.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.783+0000 7fdc49fdc700 1 -- 172.21.15.8:0/812393706 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc4410b120 con 0x7fdc34060f70 2023-10-18T22:33:43.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.784+0000 7fdc417fa700 1 -- 172.21.15.8:0/812393706 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdc4410b120 con 0x7fdc34060f70 2023-10-18T22:33:43.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.786+0000 7fdc49fdc700 1 -- 172.21.15.8:0/812393706 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc34060f70 msgr2=0x7fdc34063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:43.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.786+0000 7fdc49fdc700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc34060f70 0x7fdc34063430 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fdc30009fd0 tx=0x7fdc3000b040).stop 2023-10-18T22:33:43.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.786+0000 7fdc49fdc700 1 -- 172.21.15.8:0/812393706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc44060290 msgr2=0x7fdc44108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:43.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.786+0000 7fdc49fdc700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc44060290 0x7fdc44108ef0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 rx=0x7fdc38004320 tx=0x7fdc3800b040).stop 2023-10-18T22:33:43.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.787+0000 7fdc49fdc700 1 -- 172.21.15.8:0/812393706 shutdown_connections 2023-10-18T22:33:43.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.787+0000 7fdc49fdc700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fdc34060f70 0x7fdc34063430 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.787+0000 7fdc49fdc700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc44060290 0x7fdc44108ef0 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.787+0000 7fdc49fdc700 1 --2- 172.21.15.8:0/812393706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc440f9720 0x7fdc441093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.787+0000 7fdc49fdc700 1 -- 172.21.15.8:0/812393706 >> 172.21.15.8:0/812393706 conn(0x7fdc440f0ba0 msgr2=0x7fdc440f4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:43.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.787+0000 7fdc49fdc700 1 -- 172.21.15.8:0/812393706 shutdown_connections 2023-10-18T22:33:43.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.787+0000 7fdc49fdc700 1 -- 172.21.15.8:0/812393706 wait complete. 2023-10-18T22:33:43.873 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:43 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.257371+0000 mon.smithi008 (mon.0) 5904 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:43.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.928+0000 7f96908a5700 1 -- 172.21.15.8:0/3939297538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968c0f77d0 msgr2=0x7f968c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.928+0000 7f96908a5700 1 --2- 172.21.15.8:0/3939297538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968c0f77d0 0x7f968c0f7c30 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 rx=0x7f9680004660 tx=0x7f9680009b30).stop 2023-10-18T22:33:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.928+0000 7f96908a5700 1 -- 172.21.15.8:0/3939297538 shutdown_connections 2023-10-18T22:33:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.928+0000 7f96908a5700 1 --2- 172.21.15.8:0/3939297538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968c0f77d0 0x7f968c0f7c30 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.928+0000 7f96908a5700 1 --2- 172.21.15.8:0/3939297538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f968c0f6530 0x7f968c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.928+0000 7f96908a5700 1 -- 172.21.15.8:0/3939297538 >> 172.21.15.8:0/3939297538 conn(0x7f968c0f1c90 msgr2=0x7f968c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.928+0000 7f96908a5700 1 -- 172.21.15.8:0/3939297538 shutdown_connections 2023-10-18T22:33:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.928+0000 7f96908a5700 1 -- 172.21.15.8:0/3939297538 wait complete. 2023-10-18T22:33:43.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.929+0000 7f96908a5700 1 Processor -- start 2023-10-18T22:33:43.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.929+0000 7f96908a5700 1 -- start start 2023-10-18T22:33:43.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.929+0000 7f96908a5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968c0f6530 0x7f968c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.929+0000 7f96908a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f968c0f77d0 0x7f968c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.929+0000 7f96908a5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c109a20 con 0x7f968c0f6530 2023-10-18T22:33:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.929+0000 7f96908a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c109b60 con 0x7f968c0f77d0 2023-10-18T22:33:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.929+0000 7f968b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968c0f6530 0x7f968c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f968b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968c0f6530 0x7f968c108f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41678/0 (socket says 172.21.15.8:41678) 2023-10-18T22:33:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f968b7fe700 1 -- 172.21.15.8:0/238225954 learned_addr learned my addr 172.21.15.8:0/238225954 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f968affd700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f968c0f77d0 0x7f968c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f968b7fe700 1 -- 172.21.15.8:0/238225954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f968c0f77d0 msgr2=0x7f968c109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f968b7fe700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f968c0f77d0 0x7f968c109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f968b7fe700 1 -- 172.21.15.8:0/238225954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9680005040 con 0x7f968c0f6530 2023-10-18T22:33:43.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f968b7fe700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968c0f6530 0x7f968c108f80 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 rx=0x7f967c002700 tx=0x7f967c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:43.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f9673fff700 1 -- 172.21.15.8:0/238225954 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967c0079c0 con 0x7f968c0f6530 2023-10-18T22:33:43.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f9673fff700 1 -- 172.21.15.8:0/238225954 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f967c00f040 con 0x7f968c0f6530 2023-10-18T22:33:43.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f9673fff700 1 -- 172.21.15.8:0/238225954 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967c0148d0 con 0x7f968c0f6530 2023-10-18T22:33:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.930+0000 7f96908a5700 1 -- 172.21.15.8:0/238225954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c10a500 con 0x7f968c0f6530 2023-10-18T22:33:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.931+0000 7f96908a5700 1 -- 172.21.15.8:0/238225954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c10aac0 con 0x7f968c0f6530 2023-10-18T22:33:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.931+0000 7f96908a5700 1 -- 172.21.15.8:0/238225954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c045ad0 con 0x7f968c0f6530 2023-10-18T22:33:43.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.932+0000 7f9673fff700 1 -- 172.21.15.8:0/238225954 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f967c01b060 con 0x7f968c0f6530 2023-10-18T22:33:43.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.933+0000 7f9673fff700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9674060f70 0x7f9674063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:43.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.933+0000 7f9673fff700 1 -- 172.21.15.8:0/238225954 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f967c07c6b0 con 0x7f968c0f6530 2023-10-18T22:33:43.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.934+0000 7f968affd700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9674060f70 0x7f9674063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:43.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.934+0000 7f968affd700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9674060f70 0x7f9674063430 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f9680004630 tx=0x7f9680009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:43.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:43.937+0000 7f9673fff700 1 -- 172.21.15.8:0/238225954 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f967c04fdd0 con 0x7f968c0f6530 2023-10-18T22:33:43.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:43 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.257371+0000 mon.smithi008 (mon.0) 5904 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:44.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.132+0000 7f96908a5700 1 -- 172.21.15.8:0/238225954 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f968c0fee40 con 0x7f9674060f70 2023-10-18T22:33:44.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.141+0000 7f9673fff700 1 -- 172.21.15.8:0/238225954 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f968c0fee40 con 0x7f9674060f70 2023-10-18T22:33:44.143 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T22:33:44.143 INFO:teuthology.orchestra.run.smithi008.stdout:alertmanager.smithi008 smithi008 *:9093,9094 running (100m) 7m ago 101m 17.4M - 0.20.0 0881eb8f169f 92aba4d60959 2023-10-18T22:33:44.144 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi008 smithi008 running (94m) 7m ago 101m 8014k - 16.2.14-100-gb4ddd52c 92842c92b8bd a6b30b005518 2023-10-18T22:33:44.144 INFO:teuthology.orchestra.run.smithi008.stdout:crash.smithi060 smithi060 running (94m) 5m ago 101m 8010k - 16.2.14-100-gb4ddd52c 92842c92b8bd 855e163b0853 2023-10-18T22:33:44.144 INFO:teuthology.orchestra.run.smithi008.stdout:grafana.smithi008 smithi008 *:3000 running (100m) 7m ago 101m 28.8M - 6.7.4 557c83e11646 ac05df8a0eca 2023-10-18T22:33:44.144 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.lehgco smithi008 error 7m ago 97m - - 2023-10-18T22:33:44.144 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi008.mpstiw smithi008 error 7m ago 97m - - 2023-10-18T22:33:44.145 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.grdzlm smithi060 error 5m ago 97m - - 2023-10-18T22:33:44.145 INFO:teuthology.orchestra.run.smithi008.stdout:mds.cephfs.smithi060.rvrncq smithi060 error 5m ago 97m - - 2023-10-18T22:33:44.145 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi008.flmjzp smithi008 *:8443,9283 running (95m) 7m ago 103m 561M - 16.2.14-100-gb4ddd52c 92842c92b8bd c83370e3feec 2023-10-18T22:33:44.145 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.smithi060.pgqqwa smithi060 *:8443,9283 running (94m) 5m ago 100m 406M - 16.2.14-100-gb4ddd52c 92842c92b8bd 5210f8a6d6ec 2023-10-18T22:33:44.145 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi008 smithi008 running (94m) 7m ago 103m 687M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6e51711a04f7 2023-10-18T22:33:44.145 INFO:teuthology.orchestra.run.smithi008.stdout:mon.smithi060 smithi060 running (94m) 5m ago 100m 342M 2048M 16.2.14-100-gb4ddd52c 92842c92b8bd 6d113d9ab6ef 2023-10-18T22:33:44.146 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi008 smithi008 *:9100 running (101m) 7m ago 101m 10.7M - 0.18.1 e5a616e4b9cf 105802e8a159 2023-10-18T22:33:44.146 INFO:teuthology.orchestra.run.smithi008.stdout:node-exporter.smithi060 smithi060 *:9100 running (100m) 5m ago 100m 10.8M - 0.18.1 e5a616e4b9cf ebeaa94d42dc 2023-10-18T22:33:44.146 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (93m) 7m ago 100m 610M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 8723003d0933 2023-10-18T22:33:44.146 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi008 running (91m) 7m ago 100m 504M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd a27fe035b4c0 2023-10-18T22:33:44.146 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi008 running (91m) 7m ago 99m 396M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd e6761a5759ee 2023-10-18T22:33:44.147 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi060 running (91m) 5m ago 99m 559M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd aa15b18af968 2023-10-18T22:33:44.147 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi060 running (90m) 5m ago 99m 479M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd b2fe70862dcb 2023-10-18T22:33:44.147 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi060 running (89m) 5m ago 99m 407M 4096M 16.2.14-100-gb4ddd52c 92842c92b8bd 6fcd3d853290 2023-10-18T22:33:44.147 INFO:teuthology.orchestra.run.smithi008.stdout:prometheus.smithi008 smithi008 *:9095 running (95m) 7m ago 101m 85.9M - 2.18.1 de242295e225 3a9d49db1f2f 2023-10-18T22:33:44.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.143+0000 7f96908a5700 1 -- 172.21.15.8:0/238225954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9674060f70 msgr2=0x7f9674063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:44.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.143+0000 7f96908a5700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9674060f70 0x7f9674063430 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f9680004630 tx=0x7f9680009b30).stop 2023-10-18T22:33:44.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.143+0000 7f96908a5700 1 -- 172.21.15.8:0/238225954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968c0f6530 msgr2=0x7f968c108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:44.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.143+0000 7f96908a5700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968c0f6530 0x7f968c108f80 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 rx=0x7f967c002700 tx=0x7f967c009d80).stop 2023-10-18T22:33:44.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.144+0000 7f96908a5700 1 -- 172.21.15.8:0/238225954 shutdown_connections 2023-10-18T22:33:44.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.144+0000 7f96908a5700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f9674060f70 0x7f9674063430 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.144+0000 7f96908a5700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968c0f6530 0x7f968c108f80 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.144+0000 7f96908a5700 1 --2- 172.21.15.8:0/238225954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f968c0f77d0 0x7f968c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.144+0000 7f96908a5700 1 -- 172.21.15.8:0/238225954 >> 172.21.15.8:0/238225954 conn(0x7f968c0f1c90 msgr2=0x7f968c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:44.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.144+0000 7f96908a5700 1 -- 172.21.15.8:0/238225954 shutdown_connections 2023-10-18T22:33:44.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.144+0000 7f96908a5700 1 -- 172.21.15.8:0/238225954 wait complete. 2023-10-18T22:33:44.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.279+0000 7f64d3fff700 1 -- 172.21.15.8:0/1905226347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d40f6530 msgr2=0x7f64d40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:44.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.279+0000 7f64d3fff700 1 --2- 172.21.15.8:0/1905226347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d40f6530 0x7f64d40f6950 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 rx=0x7f64c4004660 tx=0x7f64c4009b30).stop 2023-10-18T22:33:44.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.279+0000 7f64d3fff700 1 -- 172.21.15.8:0/1905226347 shutdown_connections 2023-10-18T22:33:44.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.279+0000 7f64d3fff700 1 --2- 172.21.15.8:0/1905226347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d40f77d0 0x7f64d40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.279+0000 7f64d3fff700 1 --2- 172.21.15.8:0/1905226347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d40f6530 0x7f64d40f6950 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.279+0000 7f64d3fff700 1 -- 172.21.15.8:0/1905226347 >> 172.21.15.8:0/1905226347 conn(0x7f64d40f1c90 msgr2=0x7f64d40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:44.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.279+0000 7f64d3fff700 1 -- 172.21.15.8:0/1905226347 shutdown_connections 2023-10-18T22:33:44.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.279+0000 7f64d3fff700 1 -- 172.21.15.8:0/1905226347 wait complete. 2023-10-18T22:33:44.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.280+0000 7f64d3fff700 1 Processor -- start 2023-10-18T22:33:44.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.280+0000 7f64d3fff700 1 -- start start 2023-10-18T22:33:44.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d40f6530 0x7f64d4108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:44.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d40f77d0 0x7f64d41094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:44.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d4109a60 con 0x7f64d40f77d0 2023-10-18T22:33:44.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d4109ba0 con 0x7f64d40f6530 2023-10-18T22:33:44.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d40f77d0 0x7f64d41094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:44.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d40f77d0 0x7f64d41094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41700/0 (socket says 172.21.15.8:41700) 2023-10-18T22:33:44.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d27fc700 1 -- 172.21.15.8:0/2578970384 learned_addr learned my addr 172.21.15.8:0/2578970384 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:44.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d2ffd700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d40f6530 0x7f64d4108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:44.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d27fc700 1 -- 172.21.15.8:0/2578970384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d40f6530 msgr2=0x7f64d4108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:44.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d27fc700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d40f6530 0x7f64d4108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d27fc700 1 -- 172.21.15.8:0/2578970384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c4005040 con 0x7f64d40f77d0 2023-10-18T22:33:44.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.281+0000 7f64d27fc700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d40f77d0 0x7f64d41094b0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 rx=0x7f64c80026d0 tx=0x7f64c8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:44.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.282+0000 7f64bb7fe700 1 -- 172.21.15.8:0/2578970384 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c8009320 con 0x7f64d40f77d0 2023-10-18T22:33:44.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.282+0000 7f64d3fff700 1 -- 172.21.15.8:0/2578970384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d410a540 con 0x7f64d40f77d0 2023-10-18T22:33:44.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.282+0000 7f64bb7fe700 1 -- 172.21.15.8:0/2578970384 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f64c800f040 con 0x7f64d40f77d0 2023-10-18T22:33:44.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.282+0000 7f64bb7fe700 1 -- 172.21.15.8:0/2578970384 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c80148a0 con 0x7f64d40f77d0 2023-10-18T22:33:44.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.282+0000 7f64d3fff700 1 -- 172.21.15.8:0/2578970384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d410ab00 con 0x7f64d40f77d0 2023-10-18T22:33:44.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.283+0000 7f64d3fff700 1 -- 172.21.15.8:0/2578970384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d4045ad0 con 0x7f64d40f77d0 2023-10-18T22:33:44.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.284+0000 7f64bb7fe700 1 -- 172.21.15.8:0/2578970384 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f64c80077b0 con 0x7f64d40f77d0 2023-10-18T22:33:44.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.284+0000 7f64bb7fe700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f64bc060f70 0x7f64bc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:44.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.285+0000 7f64bb7fe700 1 -- 172.21.15.8:0/2578970384 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f64c807cf60 con 0x7f64d40f77d0 2023-10-18T22:33:44.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.285+0000 7f64d2ffd700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f64bc060f70 0x7f64bc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:44.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.285+0000 7f64d2ffd700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f64bc060f70 0x7f64bc063430 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f64c4004630 tx=0x7f64c4009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:44.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.288+0000 7f64bb7fe700 1 -- 172.21.15.8:0/2578970384 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f64c8050670 con 0x7f64d40f77d0 2023-10-18T22:33:44.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.543+0000 7f64d3fff700 1 -- 172.21.15.8:0/2578970384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f64d4027a00 con 0x7f64d40f77d0 2023-10-18T22:33:44.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.543+0000 7f64bb7fe700 1 -- 172.21.15.8:0/2578970384 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f64c8050260 con 0x7f64d40f77d0 2023-10-18T22:33:44.545 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:33:44.546 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": { 2023-10-18T22:33:44.546 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:33:44.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:33:44.546 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": { 2023-10-18T22:33:44.546 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T22:33:44.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:33:44.547 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": { 2023-10-18T22:33:44.547 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 6 2023-10-18T22:33:44.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:33:44.548 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-18T22:33:44.548 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 1 2023-10-18T22:33:44.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-18T22:33:44.548 INFO:teuthology.orchestra.run.smithi008.stdout: "overall": { 2023-10-18T22:33:44.548 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 11 2023-10-18T22:33:44.549 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-18T22:33:44.549 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:33:44.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.545+0000 7f64d3fff700 1 -- 172.21.15.8:0/2578970384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f64bc060f70 msgr2=0x7f64bc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:44.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.545+0000 7f64d3fff700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f64bc060f70 0x7f64bc063430 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f64c4004630 tx=0x7f64c4009b30).stop 2023-10-18T22:33:44.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.545+0000 7f64d3fff700 1 -- 172.21.15.8:0/2578970384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d40f77d0 msgr2=0x7f64d41094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:44.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.545+0000 7f64d3fff700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d40f77d0 0x7f64d41094b0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 rx=0x7f64c80026d0 tx=0x7f64c8009de0).stop 2023-10-18T22:33:44.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.545+0000 7f64d3fff700 1 -- 172.21.15.8:0/2578970384 shutdown_connections 2023-10-18T22:33:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.545+0000 7f64d3fff700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f64bc060f70 0x7f64bc063430 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.545+0000 7f64d3fff700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d40f6530 0x7f64d4108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.545+0000 7f64d3fff700 1 --2- 172.21.15.8:0/2578970384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d40f77d0 0x7f64d41094b0 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.545+0000 7f64d3fff700 1 -- 172.21.15.8:0/2578970384 >> 172.21.15.8:0/2578970384 conn(0x7f64d40f1c90 msgr2=0x7f64d40f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.545+0000 7f64d3fff700 1 -- 172.21.15.8:0/2578970384 shutdown_connections 2023-10-18T22:33:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.546+0000 7f64d3fff700 1 -- 172.21.15.8:0/2578970384 wait complete. 2023-10-18T22:33:44.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:43.227613+0000 mgr.smithi008.flmjzp (mgr.14640) 5682 : cluster [DBG] pgmap v3896: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.419247+0000 mgr.smithi008.flmjzp (mgr.14640) 5683 : audit [DBG] from='client.38512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.610345+0000 mon.smithi008 (mon.0) 5905 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.784716+0000 mgr.smithi008.flmjzp (mgr.14640) 5684 : audit [DBG] from='client.38516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:44.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.824932+0000 mon.smithi008 (mon.0) 5906 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.825808+0000 mon.smithi008 (mon.0) 5907 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:43.826505+0000 mgr.smithi008.flmjzp (mgr.14640) 5685 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:43.827121+0000 mgr.smithi008.flmjzp (mgr.14640) 5686 : cluster [DBG] pgmap v3897: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:44.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:43.827389+0000 mgr.smithi008.flmjzp (mgr.14640) 5687 : cluster [DBG] pgmap v3898: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:44.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.831378+0000 mon.smithi008 (mon.0) 5908 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:44.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.836485+0000 mon.smithi008 (mon.0) 5909 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:44.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.839067+0000 mon.smithi008 (mon.0) 5910 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:44.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.840485+0000 mon.smithi008 (mon.0) 5911 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:44.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.841818+0000 mon.smithi008 (mon.0) 5912 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:44.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:43.843522+0000 mon.smithi008 (mon.0) 5913 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:44.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:43.845225+0000 mgr.smithi008.flmjzp (mgr.14640) 5688 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:44.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:44.133591+0000 mgr.smithi008.flmjzp (mgr.14640) 5689 : audit [DBG] from='client.38520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:44.674 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:44 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:44.543997+0000 mon.smithi008 (mon.0) 5914 : audit [DBG] from='client.? 172.21.15.8:0/2578970384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:44.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.683+0000 7f9793fff700 1 -- 172.21.15.8:0/5564061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97940f77d0 msgr2=0x7f97940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:44.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.683+0000 7f9793fff700 1 --2- 172.21.15.8:0/5564061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97940f77d0 0x7f97940f7c30 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 rx=0x7f9788004660 tx=0x7f9788009b30).stop 2023-10-18T22:33:44.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.683+0000 7f9793fff700 1 -- 172.21.15.8:0/5564061 shutdown_connections 2023-10-18T22:33:44.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.683+0000 7f9793fff700 1 --2- 172.21.15.8:0/5564061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97940f77d0 0x7f97940f7c30 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.683+0000 7f9793fff700 1 --2- 172.21.15.8:0/5564061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97940f6530 0x7f97940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.683+0000 7f9793fff700 1 -- 172.21.15.8:0/5564061 >> 172.21.15.8:0/5564061 conn(0x7f97940f1c90 msgr2=0x7f97940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:44.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.683+0000 7f9793fff700 1 -- 172.21.15.8:0/5564061 shutdown_connections 2023-10-18T22:33:44.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.683+0000 7f9793fff700 1 -- 172.21.15.8:0/5564061 wait complete. 2023-10-18T22:33:44.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.684+0000 7f9793fff700 1 Processor -- start 2023-10-18T22:33:44.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.684+0000 7f9793fff700 1 -- start start 2023-10-18T22:33:44.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.684+0000 7f9793fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97940f6530 0x7f979406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:44.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.684+0000 7f9793fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97940f77d0 0x7f9794069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:44.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.684+0000 7f9793fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979406a380 con 0x7f97940f77d0 2023-10-18T22:33:44.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.684+0000 7f9793fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979406a4c0 con 0x7f97940f6530 2023-10-18T22:33:44.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.685+0000 7f97927fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97940f77d0 0x7f9794069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:44.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.685+0000 7f97927fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97940f77d0 0x7f9794069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41706/0 (socket says 172.21.15.8:41706) 2023-10-18T22:33:44.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.685+0000 7f97927fc700 1 -- 172.21.15.8:0/1879038655 learned_addr learned my addr 172.21.15.8:0/1879038655 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:44.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.685+0000 7f97927fc700 1 -- 172.21.15.8:0/1879038655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97940f6530 msgr2=0x7f979406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:44.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.685+0000 7f9792ffd700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97940f6530 0x7f979406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:44.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.685+0000 7f97927fc700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97940f6530 0x7f979406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.685+0000 7f97927fc700 1 -- 172.21.15.8:0/1879038655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9788005040 con 0x7f97940f77d0 2023-10-18T22:33:44.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.685+0000 7f9792ffd700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97940f6530 0x7f979406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-18T22:33:44.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.685+0000 7f97927fc700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97940f77d0 0x7f9794069e20 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 rx=0x7f9788009990 tx=0x7f9788009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:44.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.686+0000 7f977b7fe700 1 -- 172.21.15.8:0/1879038655 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9788018070 con 0x7f97940f77d0 2023-10-18T22:33:44.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.686+0000 7f977b7fe700 1 -- 172.21.15.8:0/1879038655 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9788009630 con 0x7f97940f77d0 2023-10-18T22:33:44.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.686+0000 7f9793fff700 1 -- 172.21.15.8:0/1879038655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979406a740 con 0x7f97940f77d0 2023-10-18T22:33:44.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.686+0000 7f977b7fe700 1 -- 172.21.15.8:0/1879038655 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f978801c400 con 0x7f97940f77d0 2023-10-18T22:33:44.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.686+0000 7f9793fff700 1 -- 172.21.15.8:0/1879038655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979406aca0 con 0x7f97940f77d0 2023-10-18T22:33:44.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.687+0000 7f9793fff700 1 -- 172.21.15.8:0/1879038655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9794045ad0 con 0x7f97940f77d0 2023-10-18T22:33:44.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.688+0000 7f977b7fe700 1 -- 172.21.15.8:0/1879038655 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7f978801d9e0 con 0x7f97940f77d0 2023-10-18T22:33:44.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.689+0000 7f977b7fe700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f977c060f70 0x7f977c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:44.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.689+0000 7f977b7fe700 1 -- 172.21.15.8:0/1879038655 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7f978807e670 con 0x7f97940f77d0 2023-10-18T22:33:44.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.689+0000 7f9792ffd700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f977c060f70 0x7f977c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:44.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.689+0000 7f9792ffd700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f977c060f70 0x7f977c063430 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f9784009fd0 tx=0x7f978400b040).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:44.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.693+0000 7f977b7fe700 1 -- 172.21.15.8:0/1879038655 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7f978804e2a0 con 0x7f97940f77d0 2023-10-18T22:33:44.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.922+0000 7f9793fff700 1 -- 172.21.15.8:0/1879038655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9794027a00 con 0x7f97940f77d0 2023-10-18T22:33:44.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.922+0000 7f977b7fe700 1 -- 172.21.15.8:0/1879038655 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 75 v75) v1 ==== 76+0+1263 (secure 0 0 0) 0x7f97880518c0 con 0x7f97940f77d0 2023-10-18T22:33:44.924 INFO:teuthology.orchestra.run.smithi008.stdout:e75 2023-10-18T22:33:44.924 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T22:33:44.925 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:33:44.925 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-18T22:33:44.925 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:33:44.925 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-18T22:33:44.925 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-18T22:33:44.926 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 75 2023-10-18T22:33:44.926 INFO:teuthology.orchestra.run.smithi008.stdout:flags 12 2023-10-18T22:33:44.926 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-18T20:55:46.761687+0000 2023-10-18T22:33:44.926 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-18T21:09:59.995358+0000 2023-10-18T22:33:44.926 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-18T22:33:44.927 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-18T22:33:44.927 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 60 2023-10-18T22:33:44.927 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-18T22:33:44.927 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-18T22:33:44.927 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-18T22:33:44.928 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-18T22:33:44.928 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 108 2023-10-18T22:33:44.928 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-10-18T22:33:44.928 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 1 2023-10-18T22:33:44.928 INFO:teuthology.orchestra.run.smithi008.stdout:in 0 2023-10-18T22:33:44.928 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=44605} 2023-10-18T22:33:44.929 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-18T22:33:44.929 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-18T22:33:44.929 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 1 2023-10-18T22:33:44.929 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-18T22:33:44.929 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-18T22:33:44.930 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-18T22:33:44.930 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-18T22:33:44.930 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 1 2023-10-18T22:33:44.930 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.cephfs.smithi060.rvrncq{0:44605} state up:replay seq 1 laggy since 2023-10-18T21:09:59.995334+0000 join_fscid=1 addr [v2:172.21.15.60:6826/852231864,v1:172.21.15.60:6827/852231864] compat {c=[1],r=[1],i=[7ff]}] 2023-10-18T22:33:44.930 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:33:44.930 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-18T22:33:44.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.924+0000 7f9793fff700 1 -- 172.21.15.8:0/1879038655 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f977c060f70 msgr2=0x7f977c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:44.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.924+0000 7f9793fff700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f977c060f70 0x7f977c063430 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f9784009fd0 tx=0x7f978400b040).stop 2023-10-18T22:33:44.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.924+0000 7f9793fff700 1 -- 172.21.15.8:0/1879038655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97940f77d0 msgr2=0x7f9794069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:44.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.924+0000 7f9793fff700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97940f77d0 0x7f9794069e20 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 rx=0x7f9788009990 tx=0x7f9788009b30).stop 2023-10-18T22:33:44.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.924+0000 7f9793fff700 1 -- 172.21.15.8:0/1879038655 shutdown_connections 2023-10-18T22:33:44.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.924+0000 7f9793fff700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7f977c060f70 0x7f977c063430 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.924+0000 7f9793fff700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97940f6530 0x7f979406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.924+0000 7f9793fff700 1 --2- 172.21.15.8:0/1879038655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97940f77d0 0x7f9794069e20 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:44.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.924+0000 7f9793fff700 1 -- 172.21.15.8:0/1879038655 >> 172.21.15.8:0/1879038655 conn(0x7f97940f1c90 msgr2=0x7f97940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:44.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.925+0000 7f9793fff700 1 -- 172.21.15.8:0/1879038655 shutdown_connections 2023-10-18T22:33:44.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:44.925+0000 7f9793fff700 1 -- 172.21.15.8:0/1879038655 wait complete. 2023-10-18T22:33:44.933 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 75 2023-10-18T22:33:44.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:43.227613+0000 mgr.smithi008.flmjzp (mgr.14640) 5682 : cluster [DBG] pgmap v3896: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.419247+0000 mgr.smithi008.flmjzp (mgr.14640) 5683 : audit [DBG] from='client.38512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.610345+0000 mon.smithi008 (mon.0) 5905 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.784716+0000 mgr.smithi008.flmjzp (mgr.14640) 5684 : audit [DBG] from='client.38516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.824932+0000 mon.smithi008 (mon.0) 5906 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.825808+0000 mon.smithi008 (mon.0) 5907 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:44.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:43.826505+0000 mgr.smithi008.flmjzp (mgr.14640) 5685 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:44.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:43.827121+0000 mgr.smithi008.flmjzp (mgr.14640) 5686 : cluster [DBG] pgmap v3897: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:44.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:43.827389+0000 mgr.smithi008.flmjzp (mgr.14640) 5687 : cluster [DBG] pgmap v3898: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:44.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.831378+0000 mon.smithi008 (mon.0) 5908 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:44.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.836485+0000 mon.smithi008 (mon.0) 5909 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:44.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.839067+0000 mon.smithi008 (mon.0) 5910 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:44.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.840485+0000 mon.smithi008 (mon.0) 5911 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:44.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.841818+0000 mon.smithi008 (mon.0) 5912 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:44.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:43.843522+0000 mon.smithi008 (mon.0) 5913 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:44.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:43.845225+0000 mgr.smithi008.flmjzp (mgr.14640) 5688 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:44.990 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:44.133591+0000 mgr.smithi008.flmjzp (mgr.14640) 5689 : audit [DBG] from='client.38520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:44.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:44 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:44.543997+0000 mon.smithi008 (mon.0) 5914 : audit [DBG] from='client.? 172.21.15.8:0/2578970384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:45.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.063+0000 7fe722181700 1 -- 172.21.15.8:0/130698826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe71c0f6530 msgr2=0x7fe71c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:45.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.063+0000 7fe722181700 1 --2- 172.21.15.8:0/130698826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe71c0f6530 0x7fe71c0f6950 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 rx=0x7fe718004660 tx=0x7fe718009b30).stop 2023-10-18T22:33:45.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.063+0000 7fe722181700 1 -- 172.21.15.8:0/130698826 shutdown_connections 2023-10-18T22:33:45.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.063+0000 7fe722181700 1 --2- 172.21.15.8:0/130698826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe71c0f77d0 0x7fe71c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:45.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.063+0000 7fe722181700 1 --2- 172.21.15.8:0/130698826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe71c0f6530 0x7fe71c0f6950 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:45.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.063+0000 7fe722181700 1 -- 172.21.15.8:0/130698826 >> 172.21.15.8:0/130698826 conn(0x7fe71c0f1c90 msgr2=0x7fe71c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:45.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.064+0000 7fe722181700 1 -- 172.21.15.8:0/130698826 shutdown_connections 2023-10-18T22:33:45.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.064+0000 7fe722181700 1 -- 172.21.15.8:0/130698826 wait complete. 2023-10-18T22:33:45.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.064+0000 7fe722181700 1 Processor -- start 2023-10-18T22:33:45.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.065+0000 7fe722181700 1 -- start start 2023-10-18T22:33:45.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.065+0000 7fe722181700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe71c0f6530 0x7fe71c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:45.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.065+0000 7fe722181700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe71c0f77d0 0x7fe71c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:45.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.065+0000 7fe722181700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c06a380 con 0x7fe71c0f77d0 2023-10-18T22:33:45.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.065+0000 7fe722181700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c06a4c0 con 0x7fe71c0f6530 2023-10-18T22:33:45.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.065+0000 7fe72097e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe71c0f77d0 0x7fe71c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:45.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.065+0000 7fe72097e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe71c0f77d0 0x7fe71c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41716/0 (socket says 172.21.15.8:41716) 2023-10-18T22:33:45.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.065+0000 7fe72097e700 1 -- 172.21.15.8:0/1567222156 learned_addr learned my addr 172.21.15.8:0/1567222156 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-18T22:33:45.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.066+0000 7fe72117f700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe71c0f6530 0x7fe71c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:45.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.066+0000 7fe72097e700 1 -- 172.21.15.8:0/1567222156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe71c0f6530 msgr2=0x7fe71c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:45.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.066+0000 7fe72097e700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe71c0f6530 0x7fe71c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:45.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.066+0000 7fe72097e700 1 -- 172.21.15.8:0/1567222156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718005040 con 0x7fe71c0f77d0 2023-10-18T22:33:45.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.066+0000 7fe72097e700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe71c0f77d0 0x7fe71c069e20 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 rx=0x7fe70c00c790 tx=0x7fe70c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:45.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.066+0000 7fe711ffb700 1 -- 172.21.15.8:0/1567222156 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe70c002590 con 0x7fe71c0f77d0 2023-10-18T22:33:45.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.066+0000 7fe711ffb700 1 -- 172.21.15.8:0/1567222156 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe70c002bb0 con 0x7fe71c0f77d0 2023-10-18T22:33:45.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.066+0000 7fe711ffb700 1 -- 172.21.15.8:0/1567222156 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe70c013e10 con 0x7fe71c0f77d0 2023-10-18T22:33:45.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.066+0000 7fe722181700 1 -- 172.21.15.8:0/1567222156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c06a7a0 con 0x7fe71c0f77d0 2023-10-18T22:33:45.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.067+0000 7fe722181700 1 -- 172.21.15.8:0/1567222156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c10ede0 con 0x7fe71c0f77d0 2023-10-18T22:33:45.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.068+0000 7fe722181700 1 -- 172.21.15.8:0/1567222156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c045ad0 con 0x7fe71c0f77d0 2023-10-18T22:33:45.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.068+0000 7fe711ffb700 1 -- 172.21.15.8:0/1567222156 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 30) v1 ==== 77142+0+0 (secure 0 0 0) 0x7fe70c01a060 con 0x7fe71c0f77d0 2023-10-18T22:33:45.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.069+0000 7fe711ffb700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe708060f70 0x7fe708063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T22:33:45.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.069+0000 7fe711ffb700 1 -- 172.21.15.8:0/1567222156 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7876+0+0 (secure 0 0 0) 0x7fe70c07cbe0 con 0x7fe71c0f77d0 2023-10-18T22:33:45.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.070+0000 7fe72117f700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe708060f70 0x7fe708063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T22:33:45.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.070+0000 7fe72117f700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe708060f70 0x7fe708063430 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fe718009490 tx=0x7fe718009b30).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T22:33:45.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.073+0000 7fe711ffb700 1 -- 172.21.15.8:0/1567222156 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163590 (secure 0 0 0) 0x7fe70c04c810 con 0x7fe71c0f77d0 2023-10-18T22:33:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.271+0000 7fe722181700 1 -- 172.21.15.8:0/1567222156 --> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe71c0fedd0 con 0x7fe708060f70 2023-10-18T22:33:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.272+0000 7fe711ffb700 1 -- 172.21.15.8:0/1567222156 <== mgr.14640 v2:172.21.15.8:6800/841132810 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe71c0fedd0 con 0x7fe708060f70 2023-10-18T22:33:45.274 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-18T22:33:45.274 INFO:teuthology.orchestra.run.smithi008.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:93efa232991d02a0dccea4fcaf2f410f1547c504be1b50495ac8057087aeebdc", 2023-10-18T22:33:45.274 INFO:teuthology.orchestra.run.smithi008.stdout: "in_progress": true, 2023-10-18T22:33:45.275 INFO:teuthology.orchestra.run.smithi008.stdout: "which": "Upgrading all daemon types on all hosts", 2023-10-18T22:33:45.275 INFO:teuthology.orchestra.run.smithi008.stdout: "services_complete": [ 2023-10-18T22:33:45.275 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-18T22:33:45.275 INFO:teuthology.orchestra.run.smithi008.stdout: "osd", 2023-10-18T22:33:45.275 INFO:teuthology.orchestra.run.smithi008.stdout: "mon", 2023-10-18T22:33:45.275 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr" 2023-10-18T22:33:45.276 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-18T22:33:45.276 INFO:teuthology.orchestra.run.smithi008.stdout: "progress": "12/21 daemons upgraded", 2023-10-18T22:33:45.276 INFO:teuthology.orchestra.run.smithi008.stdout: "message": "Currently upgrading mds daemons", 2023-10-18T22:33:45.276 INFO:teuthology.orchestra.run.smithi008.stdout: "is_paused": false 2023-10-18T22:33:45.276 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-18T22:33:45.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.274+0000 7fe722181700 1 -- 172.21.15.8:0/1567222156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe708060f70 msgr2=0x7fe708063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:45.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.274+0000 7fe722181700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe708060f70 0x7fe708063430 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fe718009490 tx=0x7fe718009b30).stop 2023-10-18T22:33:45.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.274+0000 7fe722181700 1 -- 172.21.15.8:0/1567222156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe71c0f77d0 msgr2=0x7fe71c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T22:33:45.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.274+0000 7fe722181700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe71c0f77d0 0x7fe71c069e20 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 rx=0x7fe70c00c790 tx=0x7fe70c007d70).stop 2023-10-18T22:33:45.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.275+0000 7fe722181700 1 -- 172.21.15.8:0/1567222156 shutdown_connections 2023-10-18T22:33:45.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.275+0000 7fe722181700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.8:6800/841132810,v1:172.21.15.8:6801/841132810] conn(0x7fe708060f70 0x7fe708063430 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:45.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.275+0000 7fe722181700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe71c0f6530 0x7fe71c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:45.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.275+0000 7fe722181700 1 --2- 172.21.15.8:0/1567222156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe71c0f77d0 0x7fe71c069e20 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T22:33:45.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.275+0000 7fe722181700 1 -- 172.21.15.8:0/1567222156 >> 172.21.15.8:0/1567222156 conn(0x7fe71c0f1c90 msgr2=0x7fe71c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T22:33:45.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.275+0000 7fe722181700 1 -- 172.21.15.8:0/1567222156 shutdown_connections 2023-10-18T22:33:45.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-18T22:33:45.275+0000 7fe722181700 1 -- 172.21.15.8:0/1567222156 wait complete. 2023-10-18T22:33:45.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:44.923056+0000 mon.smithi008 (mon.0) 5915 : audit [DBG] from='client.? 172.21.15.8:0/1879038655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:33:45.942 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:45 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:45.272875+0000 mgr.smithi008.flmjzp (mgr.14640) 5690 : audit [DBG] from='client.38532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:44.923056+0000 mon.smithi008 (mon.0) 5915 : audit [DBG] from='client.? 172.21.15.8:0/1879038655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T22:33:45.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:45 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:45.272875+0000 mgr.smithi008.flmjzp (mgr.14640) 5690 : audit [DBG] from='client.38532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T22:33:47.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:47 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:45.828011+0000 mgr.smithi008.flmjzp (mgr.14640) 5691 : cluster [DBG] pgmap v3899: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:47.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:47 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:45.828011+0000 mgr.smithi008.flmjzp (mgr.14640) 5691 : cluster [DBG] pgmap v3899: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:49.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:49 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:47.828665+0000 mgr.smithi008.flmjzp (mgr.14640) 5692 : cluster [DBG] pgmap v3900: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:49.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:49 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:47.828665+0000 mgr.smithi008.flmjzp (mgr.14640) 5692 : cluster [DBG] pgmap v3900: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:51.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:51 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:49.829200+0000 mgr.smithi008.flmjzp (mgr.14640) 5693 : cluster [DBG] pgmap v3901: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:51.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:51 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:49.829200+0000 mgr.smithi008.flmjzp (mgr.14640) 5693 : cluster [DBG] pgmap v3901: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:53.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:53 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:51.829754+0000 mgr.smithi008.flmjzp (mgr.14640) 5694 : cluster [DBG] pgmap v3902: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:53.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:53 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:51.829754+0000 mgr.smithi008.flmjzp (mgr.14640) 5694 : cluster [DBG] pgmap v3902: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:53.855210+0000 mon.smithi008 (mon.0) 5916 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:53.857411+0000 mon.smithi008 (mon.0) 5917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:54.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:53.858507+0000 mon.smithi008 (mon.0) 5918 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:53.865371+0000 mon.smithi008 (mon.0) 5919 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:53.873684+0000 mon.smithi008 (mon.0) 5920 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:53.877211+0000 mon.smithi008 (mon.0) 5921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:53.879030+0000 mon.smithi008 (mon.0) 5922 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:54.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:53.880606+0000 mon.smithi008 (mon.0) 5923 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:54.673 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:54 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:33:53.882519+0000 mon.smithi008 (mon.0) 5924 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:53.855210+0000 mon.smithi008 (mon.0) 5916 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:53.857411+0000 mon.smithi008 (mon.0) 5917 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:33:54.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:53.858507+0000 mon.smithi008 (mon.0) 5918 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:33:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:53.865371+0000 mon.smithi008 (mon.0) 5919 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:33:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:53.873684+0000 mon.smithi008 (mon.0) 5920 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:33:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:53.877211+0000 mon.smithi008 (mon.0) 5921 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:53.879030+0000 mon.smithi008 (mon.0) 5922 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:54.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:53.880606+0000 mon.smithi008 (mon.0) 5923 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:54.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:54 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:33:53.882519+0000 mon.smithi008 (mon.0) 5924 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:33:55.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:53.830330+0000 mgr.smithi008.flmjzp (mgr.14640) 5695 : cluster [DBG] pgmap v3903: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:53.859419+0000 mgr.smithi008.flmjzp (mgr.14640) 5696 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:53.860025+0000 mgr.smithi008.flmjzp (mgr.14640) 5697 : cluster [DBG] pgmap v3904: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:53.860265+0000 mgr.smithi008.flmjzp (mgr.14640) 5698 : cluster [DBG] pgmap v3905: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:55.921 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:55 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cephadm 2023-10-18T22:33:53.884415+0000 mgr.smithi008.flmjzp (mgr.14640) 5699 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:53.830330+0000 mgr.smithi008.flmjzp (mgr.14640) 5695 : cluster [DBG] pgmap v3903: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:55.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:53.859419+0000 mgr.smithi008.flmjzp (mgr.14640) 5696 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-10-18T22:33:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:53.860025+0000 mgr.smithi008.flmjzp (mgr.14640) 5697 : cluster [DBG] pgmap v3904: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:53.860265+0000 mgr.smithi008.flmjzp (mgr.14640) 5698 : cluster [DBG] pgmap v3905: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:55.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:55 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cephadm 2023-10-18T22:33:53.884415+0000 mgr.smithi008.flmjzp (mgr.14640) 5699 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi060.rvrncq to be up:active (currently up:replay) 2023-10-18T22:33:57.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:57 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:55.860741+0000 mgr.smithi008.flmjzp (mgr.14640) 5700 : cluster [DBG] pgmap v3906: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:57.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:57 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:55.860741+0000 mgr.smithi008.flmjzp (mgr.14640) 5700 : cluster [DBG] pgmap v3906: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:59.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:33:59 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:57.861316+0000 mgr.smithi008.flmjzp (mgr.14640) 5701 : cluster [DBG] pgmap v3907: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:33:59.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:33:59 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:57.861316+0000 mgr.smithi008.flmjzp (mgr.14640) 5701 : cluster [DBG] pgmap v3907: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:34:01.920 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:01 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:33:59.861834+0000 mgr.smithi008.flmjzp (mgr.14640) 5702 : cluster [DBG] pgmap v3908: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:34:01.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:01 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:33:59.861834+0000 mgr.smithi008.flmjzp (mgr.14640) 5702 : cluster [DBG] pgmap v3908: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:34:03.874 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:03 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: cluster 2023-10-18T22:34:01.862427+0000 mgr.smithi008.flmjzp (mgr.14640) 5703 : cluster [DBG] pgmap v3909: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:34:03.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:03 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: cluster 2023-10-18T22:34:01.862427+0000 mgr.smithi008.flmjzp (mgr.14640) 5703 : cluster [DBG] pgmap v3909: 65 pgs: 65 active+clean; 224 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-10-18T22:34:04.670 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:34:03.892143+0000 mon.smithi008 (mon.0) 5925 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:34:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:34:04.448088+0000 mon.smithi008 (mon.0) 5926 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:34:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:34:04.449204+0000 mon.smithi008 (mon.0) 5927 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:34:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:34:04.456075+0000 mon.smithi008 (mon.0) 5928 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:34:04.671 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:34:04.462550+0000 mon.smithi008 (mon.0) 5929 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:34:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:34:04.465388+0000 mon.smithi008 (mon.0) 5930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:34:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:34:04.467017+0000 mon.smithi008 (mon.0) 5931 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:34:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:34:04.468544+0000 mon.smithi008 (mon.0) 5932 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:34:04.672 INFO:journalctl@ceph.mon.smithi008.smithi008.stdout:Oct 18 22:34:04 smithi008 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi008[147101]: audit 2023-10-18T22:34:04.470553+0000 mon.smithi008 (mon.0) 5933 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:34:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:34:03.892143+0000 mon.smithi008 (mon.0) 5925 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:34:04.987 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:34:04.448088+0000 mon.smithi008 (mon.0) 5926 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T22:34:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:34:04.449204+0000 mon.smithi008 (mon.0) 5927 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T22:34:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:34:04.456075+0000 mon.smithi008 (mon.0) 5928 : audit [INF] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' 2023-10-18T22:34:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:34:04.462550+0000 mon.smithi008 (mon.0) 5929 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T22:34:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:34:04.465388+0000 mon.smithi008 (mon.0) 5930 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:34:04.988 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:34:04.467017+0000 mon.smithi008 (mon.0) 5931 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:34:04.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:34:04.468544+0000 mon.smithi008 (mon.0) 5932 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:34:04.989 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Oct 18 22:34:04 smithi060 ceph-e1aaa62c-6df7-11ee-8db6-212e2dc638e7-mon-smithi060[129631]: audit 2023-10-18T22:34:04.470553+0000 mon.smithi008 (mon.0) 5933 : audit [DBG] from='mgr.14640 172.21.15.8:0/2727862848' entity='mgr.smithi008.flmjzp' cmd=[{"prefix": "versions"}]: dispatch 2023-10-18T22:34:05.434 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-10-18T22:34:05.435 DEBUG:teuthology.task.console_log:Killing console logger for smithi008 2023-10-18T22:34:05.435 DEBUG:teuthology.task.console_log:Killing console logger for smithi060 2023-10-18T22:34:05.436 DEBUG:teuthology.exit:Finished running handlers